-- Logs begin at Tue 2021-12-21 02:47:57 UTC, end at Tue 2021-12-21 05:34:50 UTC. -- Dec 21 03:32:01.764429 n-d-822053-11 systemd[1]: Started Devstack devstack@q-svc.service. Dec 21 03:32:04.564802 n-d-822053-11 neutron-server[110199]: INFO neutron.common.config [-] Logging enabled! Dec 21 03:32:04.565420 n-d-822053-11 neutron-server[110199]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev305 Dec 21 03:32:04.565574 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=110199) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 21 03:32:04.568904 n-d-822053-11 neutron-server[110199]: INFO neutron.common.config [-] Logging enabled! Dec 21 03:32:04.569158 n-d-822053-11 neutron-server[110199]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev305 Dec 21 03:32:04.569469 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=110199) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 21 03:32:04.570378 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:32:04.570612 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 21 03:32:04.570996 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 21 03:32:04.571245 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 21 03:32:04.571470 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 21 03:32:04.571787 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.572199 n-d-822053-11 neutron-server[110199]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 21 03:32:04.572508 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.572799 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.573087 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.573423 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.573712 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.573992 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.574276 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.574572 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.574854 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.575166 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.575446 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.575733 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.576008 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] config_source = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.576290 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.576572 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.576851 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] debug = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.577127 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.577550 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.577949 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.578226 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.578521 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.578794 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.579085 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.579359 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.579640 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.579965 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] host = n-d-822053-11 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.580248 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.580534 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.580816 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.581098 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.581372 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.581647 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.581929 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.582198 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_dir = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.582468 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.582741 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.583050 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.583336 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.583623 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.583846 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.584066 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.584360 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.584644 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.584915 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.585187 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.585459 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.585729 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.585999 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.586264 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.586559 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.586823 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.587139 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.587411 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.587683 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.587951 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.588221 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.588503 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.589316 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.589588 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.589860 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.590144 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.590412 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.590687 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.591005 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.591289 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.591568 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.591852 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.592124 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.592403 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.592672 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.592940 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] use_journal = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.593206 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] use_json = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.593473 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.593739 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.594015 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.594284 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.594550 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.594821 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.595122 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.595402 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:04.595691 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.595986 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.596282 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.596559 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.596858 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.597134 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.597419 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.597695 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.597984 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.598274 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.598561 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.598838 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.599143 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.599420 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.599712 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.600012 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.600305 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.600593 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.600871 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.601142 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.601411 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.601684 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.601967 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.602240 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.602524 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.602809 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.603111 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.603406 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.603687 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.603976 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.604262 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.605100 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.605376 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.605661 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.605935 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.606206 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.606481 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.606765 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.607066 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.607339 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.607618 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.607893 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.608161 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.608429 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.608704 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.608993 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.609267 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.609534 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.609799 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.610072 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.610339 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.610618 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.610898 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.611192 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.611460 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.611731 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.612003 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.612272 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.612545 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.612813 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.613085 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.613734 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.613734 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.613892 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.614121 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.614388 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.614654 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.614923 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.615219 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.615486 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.615754 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.616024 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.616292 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.616560 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.616838 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.617128 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.617400 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.617672 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.617943 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.618214 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.618485 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.618754 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.619047 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.619320 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.619587 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.619875 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.620203 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.620487 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.620770 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.621067 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.621359 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.621634 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.621915 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.622188 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.622459 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.622735 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.623036 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.623329 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.623617 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.623908 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.624197 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.624485 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.624760 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.625060 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.625336 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:04.625548 n-d-822053-11 neutron-server[110199]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 21 03:32:04.625789 n-d-822053-11 neutron-server[110199]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=110199) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 21 03:32:05.045238 n-d-822053-11 neutron-server[110199]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 21 03:32:05.045514 n-d-822053-11 neutron-server[110199]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 21 03:32:05.045818 n-d-822053-11 neutron-server[110199]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 21 03:32:05.046163 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 21 03:32:05.367763 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.367977 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.368249 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.369521 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.369804 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.370594 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.415503 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.415792 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.416058 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.430071 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.430354 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.430626 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.459643 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.459919 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.460186 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.497486 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.497766 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.498037 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.829812 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.830441 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.830441 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.830644 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.831321 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.930049 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.930369 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.930654 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.930926 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.931214 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.931526 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.931788 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.932045 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.932300 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.932624 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.932887 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.933154 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.933409 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.933660 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.933913 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.934174 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.934430 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.934696 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.934987 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.935247 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.935517 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.935770 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.936049 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.936429 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.936683 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.936932 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.937329 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:05.937573 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:05.937811 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:05.938051 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:05.938290 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:05.938527 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:05.938891 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 21 03:32:05.942052 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 21 03:32:05.946092 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 21 03:32:05.949880 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(100, 149)])]) Dec 21 03:32:05.951529 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 21 03:32:05.951988 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 21 03:32:05.952322 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 21 03:32:05.952703 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 21 03:32:05.955533 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 21 03:32:05.955790 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 21 03:32:05.956137 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 21 03:32:05.961391 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 21 03:32:05.984938 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 21 03:32:05.985382 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.985676 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=110199) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 21 03:32:05.986034 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.987439 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=110199) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 21 03:32:05.987723 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 21 03:32:05.987969 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 21 03:32:05.991198 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:05.991481 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:06.053841 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 21 03:32:06.054078 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 21 03:32:06.054315 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 21 03:32:06.054677 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 21 03:32:06.075858 n-d-822053-11 neutron-server[110199]: DEBUG oslo_db.sqlalchemy.engines [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 21 03:32:06.629427 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing driver for type 'gre' Dec 21 03:32:06.629958 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] gre ID ranges: [(1, 1000)] Dec 21 03:32:06.804441 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing driver for type 'local' Dec 21 03:32:06.804775 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing driver for type 'vlan' Dec 21 03:32:06.890235 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] VlanTypeDriver initialization complete Dec 21 03:32:06.890795 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing driver for type 'vxlan' Dec 21 03:32:06.891056 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] vxlan ID ranges: [(1, 1000)] Dec 21 03:32:07.075154 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing extension driver 'port_security' Dec 21 03:32:07.075493 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.extensions.port_security [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] PortSecurityExtensionDriver initialization complete Dec 21 03:32:07.075827 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing mechanism driver 'openvswitch' Dec 21 03:32:07.076151 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing mechanism driver 'hyperv' Dec 21 03:32:07.082791 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.plugin [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=110199) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:07.083654 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.084022 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.084372 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.084901 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=110199) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 21 03:32:07.085329 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.085681 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.086022 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.086418 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=110199) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 21 03:32:07.086824 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.087192 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.087532 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.087925 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=110199) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 21 03:32:07.088331 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > security_group after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.088678 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > security_group after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.089611 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > security_group after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.090005 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=110199) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 21 03:32:07.090407 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.090753 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.091118 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.091513 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=110199) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 21 03:32:07.091963 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > address_group after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.092305 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > address_group after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.092640 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > address_group after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.093030 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=110199) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 21 03:32:07.093405 n-d-822053-11 neutron-server[110199]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] ML2 OVO RPC backend initialized. {{(pid=110199) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 21 03:32:07.094107 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_interface after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.094458 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.094874 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.095239 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > networks before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.095582 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.095918 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > ports before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.096255 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.096592 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnets before_response 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.096933 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.097309 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.097643 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.097979 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.098312 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.098640 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.098995 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.099332 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.099660 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > subnet after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.100232 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.plugin [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Modular L2 Plugin initialization complete Dec 21 03:32:07.100555 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading services supported by the core plugin {{(pid=110199) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 21 03:32:07.100879 n-d-822053-11 neutron-server[110199]: INFO neutron.plugins.ml2.managers [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Got port-security extension from driver 'port_security' Dec 21 03:32:07.101343 n-d-822053-11 neutron-server[110199]: INFO neutron.extensions.vlantransparent [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Disabled vlantransparent extension. Dec 21 03:32:07.101835 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=110199) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 21 03:32:07.102147 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: router Dec 21 03:32:07.138975 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_interface before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.139368 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_create 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.139736 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router before_create 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.140097 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.140514 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.140818 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_delete 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.141198 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > floatingip after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.141664 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > floatingip after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.142023 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_create 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.142365 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_update 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.142713 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_update 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.143090 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.143445 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_update 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.143852 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_update 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.144222 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.144556 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.144889 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: subnet after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.145223 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.145567 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > port precommit_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.145908 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_create 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.146245 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.146580 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.146948 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router after_update 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.147297 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_delete 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.147643 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_create 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.148001 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router_interface after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.148342 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_update 55549900 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.148706 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > agent after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.149051 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > agent after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.149389 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > network after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.150249 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Tracking information for resource: router configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:07.150578 n-d-822053-11 neutron-server[110199]: DEBUG neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Tracking information for resource: floatingip configured {{(pid=110199) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 21 03:32:07.156048 n-d-822053-11 neutron-server[110199]: INFO neutron.db.l3_agentschedulers_db [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 21 03:32:07.156622 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.156979 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port after_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.157324 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port after_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.157668 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: port after_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.158452 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router before_create 55550100 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.158811 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_delete 55550100 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.159190 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_create 55550100 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.159544 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > router precommit_update 55550100 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.164189 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.provider_configuration [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service providers = [] {{(pid=110199) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 21 03:32:07.164551 n-d-822053-11 neutron-server[110199]: DEBUG neutron.db.servicetype_db [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=110199) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 21 03:32:07.167499 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.service_base [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=110199) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 21 03:32:07.167845 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.service_base [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=110199) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 21 03:32:07.168185 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.service_base [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=110199) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 21 03:32:07.169071 n-d-822053-11 neutron-server[110199]: DEBUG neutron.services.service_base [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=110199) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 21 03:32:07.169437 n-d-822053-11 neutron-server[110199]: INFO neutron.services.service_base [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 21 03:32:07.169805 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.170116 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 21 03:32:07.180825 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.181167 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: auto_allocate Dec 21 03:32:07.187108 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: network precommit_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.187474 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: network precommit_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.187988 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.188314 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: tag Dec 21 03:32:07.201105 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.201429 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: timestamp Dec 21 03:32:07.205236 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.205567 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: network_ip_availability Dec 21 03:32:07.211059 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.211466 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.211821 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.212538 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.212855 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: flavors Dec 21 03:32:07.222489 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.222823 n-d-822053-11 neutron-server[110199]: INFO neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading Plugin: revisions Dec 21 03:32:07.227202 n-d-822053-11 neutron-server[110199]: DEBUG neutron.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=110199) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 21 03:32:07.227593 n-d-822053-11 neutron-server[110199]: DEBUG oslo_concurrency.lockutils [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.182s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 21 03:32:07.228333 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=110199) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 21 03:32:07.228707 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Initializing extension manager. Dec 21 03:32:07.229218 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: __init__.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.229597 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: __pycache__ {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.229929 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.230261 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: address_group.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.231031 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.231600 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: address-group Dec 21 03:32:07.231921 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: address_scope.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.232627 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.233146 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: address-scope Dec 21 03:32:07.233455 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: admin_state_down_before_update.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.234398 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.234904 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: router-admin-state-down-before-update Dec 21 03:32:07.235253 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: agent.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.235944 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.236448 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: agent Dec 21 03:32:07.236767 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: agent_resources_synced.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.237668 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.238178 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: agent-resources-synced Dec 21 03:32:07.238497 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: allowedaddresspairs.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.240275 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.240840 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: allowed-address-pairs Dec 21 03:32:07.241162 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: auto_allocated_topology.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.242226 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.242753 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: auto-allocated-topology Dec 21 03:32:07.243104 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: availability_zone.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.243790 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.244298 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: availability_zone Dec 21 03:32:07.244613 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: availability_zone_filter.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.245551 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.246094 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: availability_zone_filter Dec 21 03:32:07.246409 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: data_plane_status.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.247334 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.247838 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension data-plane-status not supported by any of loaded plugins Dec 21 03:32:07.248153 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: default_subnetpools.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.249053 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.249557 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: default-subnetpools Dec 21 03:32:07.249874 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: dhcpagentscheduler.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.250667 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.251244 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: dhcp_agent_scheduler Dec 21 03:32:07.251563 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: dns.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.252467 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.252976 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension dns-integration not supported by any of loaded plugins Dec 21 03:32:07.253293 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: dns_domain_ports.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.262295 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.262806 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 21 03:32:07.263162 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.264334 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.264844 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 21 03:32:07.265162 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: dvr.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.265821 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.266329 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: dvr Dec 21 03:32:07.266645 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: ecmp_routes.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.267568 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.268074 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension ecmp_routes not supported by any of loaded plugins Dec 21 03:32:07.268500 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: empty_string_filtering.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.269411 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.269918 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: empty-string-filtering Dec 21 03:32:07.270235 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.271165 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.271669 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 21 03:32:07.271984 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.272890 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.273536 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 21 03:32:07.273856 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: external_net.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.274754 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.275292 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: external-net Dec 21 03:32:07.275610 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: extra_dhcp_opt.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.277070 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.277577 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: extra_dhcp_opt Dec 21 03:32:07.277896 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: extraroute.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.278859 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.279389 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: extraroute Dec 21 03:32:07.279707 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: extraroute_atomic.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.282314 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.282853 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: extraroute-atomic Dec 21 03:32:07.283211 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: filter_validation.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.283891 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.284409 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: filter-validation Dec 21 03:32:07.284782 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: fip_pf_description.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.291179 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.291696 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 21 03:32:07.292048 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: fip_port_details.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.292957 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.293470 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: fip-port-details Dec 21 03:32:07.293792 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: flavors.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.295041 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.295602 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: flavors Dec 21 03:32:07.295933 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.297820 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.298339 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 21 03:32:07.298667 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: floatingip_pools.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.299385 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.299901 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: floatingip-pools Dec 21 03:32:07.300224 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: ip_allocation.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.301143 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.301650 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension ip_allocation not supported by any of loaded plugins Dec 21 03:32:07.302015 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.302940 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.303461 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: ip-substring-filtering Dec 21 03:32:07.303783 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l2_adjacency.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.304694 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.305200 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension l2_adjacency not supported by any of loaded plugins Dec 21 03:32:07.305519 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.306476 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.307023 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: router Dec 21 03:32:07.307347 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3_conntrack_helper.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.309657 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.310185 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 21 03:32:07.310514 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.311461 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.311977 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: ext-gw-mode Dec 21 03:32:07.312301 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.313236 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.313748 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: l3-ha Dec 21 03:32:07.314108 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3_flavors.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.315045 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.315557 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: l3-flavors Dec 21 03:32:07.315882 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.316785 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.317295 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: l3-port-ip-change-not-allowed Dec 21 03:32:07.317615 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: l3agentscheduler.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.318654 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.319189 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: l3_agent_scheduler Dec 21 03:32:07.319514 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: local_ip.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.321324 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.321851 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension local_ip not supported by any of loaded plugins Dec 21 03:32:07.322178 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: logging.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.324225 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.324749 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension logging not supported by any of loaded plugins Dec 21 03:32:07.325080 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: metering.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.325943 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.326530 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: metering Dec 21 03:32:07.326856 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.333469 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.333989 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: metering_source_and_destination_fields Dec 21 03:32:07.334314 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: multiprovidernet.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.335269 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.335782 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: multi-provider Dec 21 03:32:07.336105 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: netmtu.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.337010 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.337637 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: net-mtu Dec 21 03:32:07.337958 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: netmtu_writable.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.338865 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.339437 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: net-mtu-writable Dec 21 03:32:07.339755 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: network_availability_zone.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.340413 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.340920 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: network_availability_zone Dec 21 03:32:07.341238 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: network_ip_availability.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.342372 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.342883 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: network-ip-availability Dec 21 03:32:07.343224 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: network_segment_range.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.343977 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.344481 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension network-segment-range not supported by any of loaded plugins Dec 21 03:32:07.344796 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: pagination.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.345781 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.346110 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: pagination Dec 21 03:32:07.346430 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: port_device_profile.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.347351 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.347869 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: port-device-profile Dec 21 03:32:07.348192 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.349133 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.349649 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: port-mac-address-regenerate Dec 21 03:32:07.349971 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.350867 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.351406 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: port-numa-affinity-policy Dec 21 03:32:07.351726 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: port_resource_request.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.352632 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.353138 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension port-resource-request not supported by any of loaded plugins Dec 21 03:32:07.353456 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: port_resource_request_groups.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.354438 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.355005 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 21 03:32:07.355326 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: portbindings.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.362361 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.362869 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: binding Dec 21 03:32:07.363216 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: portbindings_extended.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.364478 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.364991 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: binding-extended Dec 21 03:32:07.365313 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: portsecurity.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.366289 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.366845 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: port-security Dec 21 03:32:07.367191 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: project_id.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.368166 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.368518 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: project-id Dec 21 03:32:07.368872 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: providernet.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.369785 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.370819 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: provider Dec 21 03:32:07.371164 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.374888 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.375445 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos not supported by any of loaded plugins Dec 21 03:32:07.375774 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.377018 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.377618 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 21 03:32:07.377949 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.378859 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.379399 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 21 03:32:07.379722 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_default.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.380628 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.381140 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-default not supported by any of loaded plugins Dec 21 03:32:07.381539 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_fip.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.382192 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.382695 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-fip not supported by any of loaded plugins Dec 21 03:32:07.383043 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_fip_network_policy.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.391235 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.391696 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-fip-network-policy not supported by any of loaded plugins Dec 21 03:32:07.392018 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_gateway_ip.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.392931 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.393439 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 21 03:32:07.393759 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_port_network_policy.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.394810 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.395356 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 21 03:32:07.395674 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.396706 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.397221 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 21 03:32:07.397545 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_pps_rule.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.398743 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.399279 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-pps not supported by any of loaded plugins Dec 21 03:32:07.399605 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_rule_type_details.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.400509 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.401062 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 21 03:32:07.401385 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: qos_rules_alias.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.403123 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.403642 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 21 03:32:07.403964 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: quota_check_limit.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.404875 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.405392 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: quota-check-limit Dec 21 03:32:07.405888 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: quotasv2.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.406800 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.407151 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: quotas Dec 21 03:32:07.407471 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: quotasv2_detail.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.410723 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.411092 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: quota_details Dec 21 03:32:07.411422 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: rbac.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.412476 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.413009 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: rbac-policies Dec 21 03:32:07.413340 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: rbac_address_group.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.414269 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.414793 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: rbac-address-group Dec 21 03:32:07.415147 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: rbac_address_scope.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.416065 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.416582 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: rbac-address-scope Dec 21 03:32:07.417046 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: rbac_security_groups.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.418026 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.418545 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: rbac-security-groups Dec 21 03:32:07.418867 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: rbac_subnetpool.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.419792 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.420312 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: rbac-subnetpool Dec 21 03:32:07.420634 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: revisionifmatch.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.421596 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.422179 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: revision-if-match Dec 21 03:32:07.422500 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: revisions.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.423635 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.424146 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: standard-attr-revisions Dec 21 03:32:07.424478 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: router_availability_zone.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.425190 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.425705 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: router_availability_zone Dec 21 03:32:07.426024 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: routerservicetype.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.431250 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.431761 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension router-service-type not supported by any of loaded plugins Dec 21 03:32:07.432082 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.433625 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.434147 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: security-groups-normalized-cidr Dec 21 03:32:07.434510 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: security_groups_port_filtering.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.435480 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.435997 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: port-security-groups-filtering Dec 21 03:32:07.436319 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.437285 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.437798 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: security-groups-remote-address-group Dec 21 03:32:07.438118 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.439072 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.439585 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: security-groups-shared-filtering Dec 21 03:32:07.439904 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.440497 n-d-822053-11 neutron-server[110199]: WARNING neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 21 03:32:07.440816 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: securitygroup.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.451389 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.451933 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: security-group Dec 21 03:32:07.452261 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: segment.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.453051 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.453566 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension segment not supported by any of loaded plugins Dec 21 03:32:07.453889 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.454842 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.455424 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 21 03:32:07.455747 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: servicetype.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.456869 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.457396 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: service-type Dec 21 03:32:07.457722 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: sorting.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.458700 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.459069 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: sorting Dec 21 03:32:07.459392 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: standard_attr_segment.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.460352 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.460871 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 21 03:32:07.461191 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: standardattrdescription.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.461896 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.462412 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: standard-attr-description Dec 21 03:32:07.462734 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: stateful_security_group.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.466067 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.466760 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: stateful-security-group Dec 21 03:32:07.467114 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: stdattrs_common.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.467679 n-d-822053-11 neutron-server[110199]: WARNING neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 21 03:32:07.467995 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.468913 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.469753 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 21 03:32:07.470073 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: subnet_onboard.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.474520 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.475090 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: subnet_onboard Dec 21 03:32:07.475425 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.476364 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.476933 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 21 03:32:07.477260 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: subnet_service_types.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.478183 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.478702 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: subnet-service-types Dec 21 03:32:07.479060 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: subnetallocation.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.480185 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.480704 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: subnet_allocation Dec 21 03:32:07.481030 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.481701 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.482211 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: subnetpool-prefix-ops Dec 21 03:32:07.482661 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.483674 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.484189 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 21 03:32:07.484506 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: tagging.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.485588 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.486111 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: standard-attr-tag Dec 21 03:32:07.486434 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: timestamp.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.487665 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.488185 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loaded extension: standard-attr-timestamp Dec 21 03:32:07.488511 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: trunk.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.489577 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.490143 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension trunk not supported by any of loaded plugins Dec 21 03:32:07.490464 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: trunk_details.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.494902 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.495955 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension trunk-details not supported by any of loaded plugins Dec 21 03:32:07.496275 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: uplink_status_propagation.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.497187 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.497704 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 21 03:32:07.498025 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Loading extension file: vlantransparent.py {{(pid=110199) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 21 03:32:07.498694 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=110199) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 21 03:32:07.499243 n-d-822053-11 neutron-server[110199]: INFO neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extension vlan-transparent not supported by any of loaded plugins Dec 21 03:32:07.501906 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:network Dec 21 03:32:07.502449 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:subnet Dec 21 03:32:07.502847 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:subnetpool Dec 21 03:32:07.503265 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:port Dec 21 03:32:07.504553 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.504999 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service FLAVORS assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.505669 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.506095 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.506425 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:router Dec 21 03:32:07.506846 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:floatingip Dec 21 03:32:07.507357 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service METERING assigned prefix: /metering {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.508785 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.509153 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.509503 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110199) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:32:07.510523 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of CountableResource for resource:rbac_policy Dec 21 03:32:07.511614 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:security_group Dec 21 03:32:07.512045 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 21 03:32:07.512725 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service CORE assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.513055 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:subnetpool Dec 21 03:32:07.513657 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] subnetpool is already registered Dec 21 03:32:07.514070 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service CORE assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.514393 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:subnetpool Dec 21 03:32:07.514719 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] subnetpool is already registered Dec 21 03:32:07.517187 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.517714 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service FLAVORS assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:router Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] router is already registered Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:floatingip Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] floatingip is already registered Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service METERING assigned prefix: /metering {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.522442 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of CountableResource for resource:rbac_policy Dec 21 03:32:07.523027 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] rbac_policy is already registered Dec 21 03:32:07.523027 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:security_group Dec 21 03:32:07.523027 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] security_group is already registered Dec 21 03:32:07.523027 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 21 03:32:07.523027 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] security_group_rule is already registered Dec 21 03:32:07.523644 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service CORE assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.523967 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:subnetpool Dec 21 03:32:07.524296 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] subnetpool is already registered Dec 21 03:32:07.524709 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.v2.resource_helper [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Service CORE assigned prefix: {{(pid=110199) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 21 03:32:07.525031 n-d-822053-11 neutron-server[110199]: INFO neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Creating instance of TrackedResource for resource:subnetpool Dec 21 03:32:07.525357 n-d-822053-11 neutron-server[110199]: WARNING neutron.quota.resource_registry [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] subnetpool is already registered Dec 21 03:32:07.525822 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: extensions {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.527424 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: address-groups {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.528974 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: address-scopes {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.530277 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: agents {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.531465 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: auto-allocated-topology {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.532687 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: availability_zones {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.533894 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: dhcp-networks {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.535450 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: dhcp-agents {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.536833 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: routers {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.539053 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: flavors {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.540259 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: service_profiles {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.541464 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: next_providers {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.542974 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: service_profiles {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.545521 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: floatingip-pools {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.546739 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: routers {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.548866 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: floatingips {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.550144 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: l3-routers {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.551577 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: l3-agents {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.552977 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: metering-labels {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.554361 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: metering-label-rules {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.555686 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: network-ip-availabilities {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.556973 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: bindings {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.559162 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: quotas {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.560714 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: quotas {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.562237 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: rbac-policies {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.563585 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: security-groups {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.564794 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: security-group-rules {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.566041 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: service-providers {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.567277 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: subnetpools {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.568692 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: subnetpools {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.570146 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.571813 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.573830 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.575694 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.579791 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.579791 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.581049 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.582955 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.584787 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.586637 n-d-822053-11 neutron-server[110199]: DEBUG neutron.api.extensions [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Extended resource: tags {{(pid=110199) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 21 03:32:07.593119 n-d-822053-11 neutron-server[110199]: WARNING keystonemiddleware.auth_token [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 21 03:32:07.597860 n-d-822053-11 neutron-server[110199]: WARNING keystonemiddleware.auth_token [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 21 03:32:07.606885 n-d-822053-11 neutron-server[110199]: DEBUG oslo_concurrency.lockutils [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Acquired lock "singleton_lock" {{(pid=110199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 21 03:32:07.607366 n-d-822053-11 neutron-server[110199]: DEBUG oslo_concurrency.lockutils [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Releasing lock "singleton_lock" {{(pid=110199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 21 03:32:07.608010 n-d-822053-11 neutron-server[110199]: INFO oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Starting 2 workers Dec 21 03:32:07.613451 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Started child 110310 {{(pid=110199) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 21 03:32:07.617669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Started child 110311 {{(pid=110199) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 21 03:32:07.618636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:07.619337 n-d-822053-11 neutron-server[110199]: INFO neutron.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Neutron service started, listening on 0.0.0.0:9696 Dec 21 03:32:07.619984 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Publish callbacks [] for process, before_spawn {{(pid=110199) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:07.620149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [-] (110310) wsgi starting up on http://0.0.0.0:9696 Dec 21 03:32:07.622328 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:07.622756 n-d-822053-11 neutron-server[110199]: INFO oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Starting 1 workers Dec 21 03:32:07.623712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [-] (110311) wsgi starting up on http://0.0.0.0:9696 Dec 21 03:32:07.627836 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Started child 110312 {{(pid=110199) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 21 03:32:07.628393 n-d-822053-11 neutron-server[110199]: INFO oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Starting 1 workers Dec 21 03:32:07.631573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] calling RpcWorker wait() {{(pid=110312) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 21 03:32:07.632155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] returning from RpcWorker wait() {{(pid=110312) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 21 03:32:07.632909 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Started child 110313 {{(pid=110199) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 21 03:32:07.633341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:07.633683 n-d-822053-11 neutron-server[110199]: DEBUG neutron_lib.callbacks.manager [None req-cd0feccb-9d78-49cb-9f0f-20e3d3df84b5 None None] Publish callbacks [] for process, after_spawn {{(pid=110199) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:07.633872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:07.635744 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=110199) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 21 03:32:07.635959 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:32:07.636145 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 21 03:32:07.636363 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 21 03:32:07.636693 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 21 03:32:07.636875 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 21 03:32:07.637422 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.637702 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.637964 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.638230 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.638761 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:07.639278 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.639415 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.639620 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.639853 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.639981 n-d-822053-11 neutron-server[110313]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:07.640122 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.640357 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.640524 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.640690 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.640933 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.641157 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.641519 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.641717 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.641958 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.642207 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.642376 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.642627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config_source = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.642882 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.643192 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.643451 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] debug = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.643861 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.644235 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.644476 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.644695 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.644907 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.645163 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.645392 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.645630 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.645865 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.646077 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.646315 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.646561 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.646796 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.647030 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.647292 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.647507 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.647763 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.647989 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.648438 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] host = n-d-822053-11 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.648669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.648883 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.649123 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.649374 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.649638 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.649857 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.650187 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.650450 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.650693 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.650920 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.651740 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.651990 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_dir = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_options = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.654418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.655424 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.656333 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.656333 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.656333 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.656682 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.656682 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.656913 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.657036 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.657254 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.657494 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.657750 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.657971 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.658184 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.658396 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.658649 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.658866 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.659109 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.659321 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.659555 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.659797 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.661002 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.661375 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.661898 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.662145 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.662533 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.662686 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.663059 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.663362 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.663703 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.663971 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.664226 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.664488 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.664720 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.664977 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_journal = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.665294 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_json = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.665515 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.665850 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.666053 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.666272 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.666766 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.666766 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.667618 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.668014 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.668625 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.668625 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.668899 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.669086 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.669324 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.669580 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.670041 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.670206 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.670332 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.670582 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.670897 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.671163 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.671466 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.673692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.674631 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.674631 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.674631 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.674631 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.18/identity {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.677621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.678777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.679314 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.679314 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.679469 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.679548 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.679949 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.680104 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.680245 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.680706 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.680832 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.681041 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.681718 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.681718 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.681718 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.681952 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.682126 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.682367 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.682663 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.682913 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.683200 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.683448 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.683666 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.683884 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.684504 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.684504 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.684504 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.684790 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.684933 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.685143 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.685389 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.685607 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.685815 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.686044 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.686278 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.686506 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.686753 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.687022 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.687215 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.687451 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.687676 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.687887 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.688096 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.688306 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.688515 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.688713 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.688946 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.689166 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.689377 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.689581 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.689799 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.690005 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.690214 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.690495 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.690802 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.691114 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.691367 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.691582 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.691835 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.692070 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.692474 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.692641 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.692784 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.692957 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.693188 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.693521 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.693724 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.693995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.694142 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.694293 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.694534 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.694756 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.694986 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.695225 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.695443 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.695721 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.695949 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.696174 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.696418 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.696664 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.696931 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.697178 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.697440 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.697660 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.697922 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.698237 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.698504 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.698762 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.699031 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.699295 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.699540 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.699774 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.700032 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.700276 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.700553 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.700833 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.701080 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.701324 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.701552 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.701795 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.702095 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.702332 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.702555 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.702767 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.703052 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.18/identity {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.706460 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707093 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707624 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707624 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707624 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707624 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707624 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.707969 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.708045 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.708250 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.708488 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.708721 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.708956 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.709169 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.709401 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.709618 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.709866 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.710082 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.710344 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.710607 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.710849 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.711114 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.711357 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.711615 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.711862 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.712109 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.712326 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.712536 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.712747 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.712961 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.713171 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.713380 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.713602 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.714355 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.714590 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.714856 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.715230 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.715478 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.715706 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.715954 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.716160 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.716373 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.716618 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.716854 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.717069 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.717302 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.717569 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.717807 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.718051 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.718302 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.718513 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.718721 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.718946 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.719160 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.719369 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.719667 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.719913 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.720155 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.720405 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.720638 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.720867 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.721096 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.721302 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.721507 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.721723 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.721956 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.722166 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.722392 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.722599 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.722806 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.723140 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.723361 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.723638 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.724054 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.724184 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.724401 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.724619 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.724833 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.725041 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.725265 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.725473 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.725681 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.725897 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.726224 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.726323 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.726523 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.726728 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.726972 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.727193 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.727426 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.727630 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.727926 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.728177 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.728413 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.728697 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.728940 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.729169 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.729454 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.729750 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.729990 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.730242 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.730463 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.730680 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.730914 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.731208 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.734995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.735549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.736147 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.736147 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.736296 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.736417 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.736640 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.736886 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.737112 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.737329 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.737549 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.737777 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.738013 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.738237 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.738396 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 21 03:32:07.738964 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=110199) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 21 03:32:07.739119 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 21 03:32:07.739272 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 21 03:32:07.739458 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 21 03:32:07.739630 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 21 03:32:07.739782 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 21 03:32:07.739985 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.740149 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.740308 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.740491 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.740648 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.740825 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.740985 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.741143 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.741298 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.741456 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.741613 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.741769 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.741927 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.742083 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.742240 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.742397 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.742553 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.742708 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.742871 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.743048 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] config_source = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.743205 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.743363 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.743518 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] debug = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.743674 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.743893 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.744044 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.744200 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.744355 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.744510 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.744666 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.744826 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745007 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745164 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745320 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745476 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745630 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745788 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.745945 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.746100 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.746257 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.746407 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.746633 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] host = n-d-822053-11 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.746798 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.746965 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.747126 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.747282 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.747438 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.747587 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.747746 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.747901 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.748057 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.748197 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.748359 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.748515 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.748672 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_dir = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.748833 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749020 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_options = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749174 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749326 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749463 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749598 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749752 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.749911 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750065 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750227 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750382 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750519 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750655 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750812 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.750996 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.751140 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.751300 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.751455 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.751610 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.751766 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.751925 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.752298 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.752423 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.752542 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.752671 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.752778 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.752930 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.753092 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.753247 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.753404 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.753559 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.753714 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.753870 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754028 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754188 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754346 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754503 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754658 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754818 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.754971 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.755130 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.755287 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.755446 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.755602 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.755758 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.755916 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.756071 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.756226 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_journal = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.756381 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_json = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.756536 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.756692 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.756848 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.757004 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.757160 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.757316 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.757471 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.757626 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 21 03:32:07.757801 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.757960 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.758130 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.758290 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.758497 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.758621 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.758757 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.758959 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.759077 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.759240 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.759412 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.759572 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.763627 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764309 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.18/identity {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.764851 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.765669 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.766372 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767054 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767054 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767054 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767054 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767054 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767579 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767579 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767579 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767828 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767828 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.767968 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.768105 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.768265 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.768423 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.768582 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.768740 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.768911 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.769090 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.769252 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.769411 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.769570 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.769729 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.769886 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.770045 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.770205 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.770289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:07.770381 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.770512 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.770676 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.770835 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771014 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771177 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771335 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771495 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771654 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771812 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.771970 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.772127 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.772286 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.772444 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.772611 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.772784 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.772942 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.773101 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.773259 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.773417 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.773577 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.773736 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.773962 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.774128 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.774289 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.774449 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.774610 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.774771 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.774962 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.775110 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.775271 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.775430 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.775589 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.775747 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776100 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776100 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776374 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776485 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776594 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776712 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.776833 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777004 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777160 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777345 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777476 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777642 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777810 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.777970 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.778130 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.778288 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.778446 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.778602 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.778760 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.778919 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.779096 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.779255 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.779412 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.779582 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.779741 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.779900 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.780059 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.780241 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.780399 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.780558 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.780911 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.780911 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781129 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781233 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781415 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781522 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781658 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781817 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.781976 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.18/identity {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.782138 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.782295 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.782454 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.782615 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.782774 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.782951 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.783107 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.783267 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.783427 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.783586 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.783747 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.783906 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.784063 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.784226 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.784444 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.784607 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.784769 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.784930 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.785089 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.785249 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.785406 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.785564 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.785724 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.785882 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.786042 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.786203 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.786363 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.786523 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.786681 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.786840 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787023 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787201 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787343 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787503 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787664 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787823 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.787982 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.788166 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.788327 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.788486 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.788645 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.788803 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.788962 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.789139 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.789298 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.789459 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.789617 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.789775 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.789959 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.790150 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.790310 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.790468 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.790631 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.790789 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.790981 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.791155 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.791314 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.791474 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.791633 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.792313 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.792476 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.792636 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.792808 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.792969 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.793129 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.793287 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.793445 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.793602 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.793771 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.793931 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.794090 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.794275 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.794436 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.794598 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.794767 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.794926 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.795105 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.795339 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.795505 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.795665 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.795835 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.795995 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.796154 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.796313 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.796471 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.796631 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.796798 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.796958 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.797116 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.797273 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.797452 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.797584 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.797959 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.797959 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798213 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798213 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798452 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798534 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798644 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798804 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.798982 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.799152 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.799311 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.799471 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.799629 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.799799 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.799959 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.800120 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.800279 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.800436 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.800593 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.800753 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.800934 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.801067 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.801231 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.801390 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.801562 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.801729 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.801897 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.802251 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.802251 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.802469 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.802575 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.802678 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.802820 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.803063 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.803224 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.803382 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.803540 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.803698 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807035 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807645 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807645 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 21 03:32:07.807645 n-d-822053-11 neutron-server[110199]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 21 03:32:07.948271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:07.956997 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [-] 10.222.0.18 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064855 Dec 21 03:32:19.792290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6c75c1b-ea06-4469-b330-8b070b1dbf2e None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 03:32:19.846371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6c75c1b-ea06-4469-b330-8b070b1dbf2e None None] No non-hosted networks {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 21 03:32:19.861213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.agentschedulers_db [None req-e6c75c1b-ea06-4469-b330-8b070b1dbf2e None None] DHCP Agent not found on host n-d-822053-11 {{(pid=110312) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Dec 21 03:32:20.000374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-874f3d55-bc35-4542-9ee2-b3fd15fe49cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:22.172681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-137bc9f4-7c87-4b47-9bc1-d40798364425 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:22.231105 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-ca8d86ba-6b43-4846-9efd-8e02d93dbc89 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-n-d-822053-11 {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:32:22.231621 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-ca8d86ba-6b43-4846-9efd-8e02d93dbc89 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:32:22.818662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca8d86ba-6b43-4846-9efd-8e02d93dbc89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:23.081111 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:24.892829 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:25.034036 n-d-822053-11 neutron-server[110312]: INFO neutron.db.l3_hamode_db [None req-19d03273-b67a-4fa0-a3cc-a0222d819e72 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 21 03:32:25.108575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19d03273-b67a-4fa0-a3cc-a0222d819e72 None None] Routers set() bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:32:25.108958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19d03273-b67a-4fa0-a3cc-a0222d819e72 None None] Router IDs set() for agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 21 03:32:25.618362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:25.619088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.619428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.620291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.620621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.620945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.621267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.621588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.621908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.622227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.622547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.622862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.623212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.623530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:25.623934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'n-d-822053-11', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:25.634588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'n-d-822053-11', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:26.027672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37602) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:26.520406 n-d-822053-11 neutron-server[110311]: WARNING oslo_policy.policy [None req-c1b8bdfd-fc92-47e3-ad9c-c9d29e0aa585 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:32:26.521030 n-d-822053-11 neutron-server[110311]: WARNING oslo_policy.policy [None req-c1b8bdfd-fc92-47e3-ad9c-c9d29e0aa585 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:32:26.756081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-c1b8bdfd-fc92-47e3-ad9c-c9d29e0aa585 admin admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:32:26.770961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1b8bdfd-fc92-47e3-ad9c-c9d29e0aa585 admin admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7284071 Dec 21 03:32:29.381461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37618) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:29.877944 n-d-822053-11 neutron-server[110310]: WARNING oslo_policy.policy [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:32:29.878568 n-d-822053-11 neutron-server[110310]: WARNING oslo_policy.policy [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:32:30.104591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] Request body: {'subnetpool': {'shared': True, 'name': 'shared-default-subnetpool-v4', 'is_default': True, 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:32:30.200223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.policy [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=110310) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 21 03:32:30.245329 n-d-822053-11 neutron-server[110310]: WARNING oslo_policy.policy [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:32:30.245707 n-d-822053-11 neutron-server[110310]: WARNING oslo_policy.policy [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:32:30.254181 n-d-822053-11 neutron-server[110310]: INFO neutron.quota [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] Loaded quota_driver: . Dec 21 03:32:30.406239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762545166405', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762545165850', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762545250446', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762545244437', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762545268062', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8762545262453', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-592492', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-594161', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7872238', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7782471'] for rbac-policy, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:30.606951 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:30.608346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e3d54580-2285-4c29-a296-0da308fe0aa5 admin admin] 10.222.0.18 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.2247624 Dec 21 03:32:33.398674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37636) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:33.695216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Request body: {'network': {'name': 'private', 'admin_state_up': True, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:32:33.812137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Made reservation on behalf of 0d3aa4b8a8ad4eb4b3947f8f963974bd for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:32:33.814904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:33.831497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:33.938356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:34.006148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:34.030256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:32:34.054534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8762542825939', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:34.055533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Unsubscribe: segment precommit_create {{(pid=110310) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 21 03:32:34.056387 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Added segment 1adfc140-70b3-4f2d-b57c-504c9f7d5a2e of type vlan for network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 Dec 21 03:32:34.064428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e272fb39-e876-4979-bff7-fe784a6f505e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:34.085117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.085459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.085791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.086119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.086441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.086759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.087117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.087434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.087748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.088684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.089013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.089326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.089637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Tracked resource versions report: Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: pushed versions: Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: { 'AddressGroup': {'1.2'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'ConntrackHelper': {'1.0'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Log': {'1.0'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Network': {'1.1'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Port': {'1.7'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'PortForwarding': {'1.2'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'QosPolicy': {'1.10'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'SecurityGroup': {'1.5'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'SubPort': {'1.0'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Subnet': {'1.1'}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Trunk': {'1.1'}} Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: consumer versions: Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: L3 agent@n-d-822053-11: {}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: Metadata agent@n-d-822053-11: {}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: Metering agent@n-d-822053-11: {}, Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'ConntrackHelper': '1.0', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'LocalIPAssociation': '1.0', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Log': '1.0', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Network': '1.1', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Port': '1.7', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'PortForwarding': '1.2', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'QosPolicy': '1.10', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'SecurityGroup': '1.5', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'SecurityGroupRule': '1.2', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'SubPort': '1.0', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Subnet': '1.1', Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: 'Trunk': '1.1'}} Dec 21 03:32:34.090748 n-d-822053-11 neutron-server[110310]: {{(pid=110310) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:32:34.166583 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:34.246336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:34.247864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:32:34.248621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:34.344687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] Pushing event updated for resources: {'Network': ['ID=d9a910b9-c9fb-4e84-bdaa-e641d17f9845,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:34.349926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f2ec9428-c5bc-4489-be80-19ccf78d8638 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.9502292 Dec 21 03:32:34.362076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:32:37.170206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37650) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:37.559186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09d4b9d7-b9b7-4234-8d7f-bed227b4a880 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:32:37.560517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-09d4b9d7-b9b7-4234-8d7f-bed227b4a880 admin admin] 10.222.0.18 "GET /v2.0/networks/d9a910b9-c9fb-4e84-bdaa-e641d17f9845 HTTP/1.1" status: 200 len: 825 time: 0.3893003 Dec 21 03:32:37.584323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e75e83aa-707c-47d5-a262-d26b911a6624 admin admin] 10.222.0.18 "GET /v2.0/subnetpools/57978d5f-ab17-4aeb-86be-276e9aa8f540 HTTP/1.1" status: 200 len: 734 time: 0.0178049 Dec 21 03:32:37.593569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Request body: {'subnet': {'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'ip_version': 4, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:32:37.675112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Made reservation on behalf of 0d3aa4b8a8ad4eb4b3947f8f963974bd for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:32:37.677528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:38.018355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:38.089367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Checking segment: {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:32:38.089763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Network hostable DHCP agents. Network: d9a910b9-c9fb-4e84-bdaa-e641d17f9845, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:32:38.094243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:38.177394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:32:38.251718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d9a910b9-c9fb-4e84-bdaa-e641d17f9845) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:32:38.256173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:32:38.256760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:38.261208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47d06c8b-f348-42f1-a548-516635a2a6d3 None None] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:32:38.346084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f0be6b08-207d-481d-a139-6b33ca6e16dd admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7555692 Dec 21 03:32:38.519026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:32:38.520327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:38.825663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Allocated IP 172.20.0.2 (d9a910b9-c9fb-4e84-bdaa-e641d17f9845/5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea/ffef7d67-2954-407f-90d8-1b029125c580) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:32:39.062097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:39.144180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:39.223068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:32:39.231462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:32:39.233916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Pushing event updated for resources: {'Port': ['ID=ffef7d67-2954-407f-90d8-1b029125c580,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:39.236088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:32:39.245473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.245820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.246162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.246498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.246829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.247190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.247519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.247842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.248165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.248486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.248807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.249128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.249445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Tracked resource versions report: Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: pushed versions: Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: { 'AddressGroup': {'1.2'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'ConntrackHelper': {'1.0'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Log': {'1.0'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Network': {'1.1'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Port': {'1.7'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'PortForwarding': {'1.2'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'QosPolicy': {'1.10'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'SecurityGroup': {'1.5'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'SubPort': {'1.0'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Subnet': {'1.1'}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Trunk': {'1.1'}} Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: consumer versions: Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: L3 agent@n-d-822053-11: {}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: Metadata agent@n-d-822053-11: {}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: Metering agent@n-d-822053-11: {}, Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'ConntrackHelper': '1.0', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'LocalIPAssociation': '1.0', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Log': '1.0', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Network': '1.1', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Port': '1.7', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'PortForwarding': '1.2', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'QosPolicy': '1.10', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'SecurityGroup': '1.5', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'SecurityGroupRule': '1.2', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'SubPort': '1.0', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Subnet': '1.1', Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: 'Trunk': '1.1'}} Dec 21 03:32:39.250595 n-d-822053-11 neutron-server[110312]: {{(pid=110312) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:32:39.319906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Attempting to bind port ffef7d67-2954-407f-90d8-1b029125c580 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:32:39.320505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Attempting to bind port ffef7d67-2954-407f-90d8-1b029125c580 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:32:39.320630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Attempting to bind port ffef7d67-2954-407f-90d8-1b029125c580 on network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:32:39.325952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 32, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:32:39.326329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Checking segment: {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:32:39.326802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:39.327229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Bound using segment: {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:32:39.327711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Bound port: ffef7d67-2954-407f-90d8-1b029125c580, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:32:39.328118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:39.390256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] For port ffef7d67-2954-407f-90d8-1b029125c580, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:32:39.394417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] For port ffef7d67-2954-407f-90d8-1b029125c580, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ffef7d67-2954-407f-90d8-1b029125c580,segment=NetworkSegment(1adfc140-70b3-4f2d-b57c-504c9f7d5a2e),segment_id=1adfc140-70b3-4f2d-b57c-504c9f7d5a2e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:32:39.487097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:39.553755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6b6d1b-8146-4eab-8b76-61fa78c49d1d None None] Pushing event updated for resources: {'Port': ['ID=ffef7d67-2954-407f-90d8-1b029125c580,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:41.064621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:41.372866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-0d79a39f-7050-4f3e-8f73-4eb59358aca1 admin admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:32:41.386956 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d79a39f-7050-4f3e-8f73-4eb59358aca1 admin admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3082702 Dec 21 03:32:44.022965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37666) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:44.331529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-b169f0c4-dd59-40b8-ae5f-6f0f9564bd0e admin admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:32:44.332541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b169f0c4-dd59-40b8-ae5f-6f0f9564bd0e admin admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3086219 Dec 21 03:32:47.162362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37676) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:47.484795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] Request body: {'router': {'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'name': 'router1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:32:47.578610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:47.580179 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:47.716971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:47.776907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:47.863271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:47.864412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89454696-88f5-4fd8-9fa9-175ad4d9f6bb admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.7010269 Dec 21 03:32:48.628209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f8c3c54-cdcd-4181-aa9c-27d8952c0623 None None] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:32:48.716886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f002cf4c-1bb3-4890-bbc4-296d0bfc01be None None] Provisioning complete for port ffef7d67-2954-407f-90d8-1b029125c580 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:32:48.717275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f002cf4c-1bb3-4890-bbc4-296d0bfc01be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:48.897516 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f002cf4c-1bb3-4890-bbc4-296d0bfc01be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:48.933475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f002cf4c-1bb3-4890-bbc4-296d0bfc01be None None] For port ffef7d67-2954-407f-90d8-1b029125c580, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ffef7d67-2954-407f-90d8-1b029125c580,segment=NetworkSegment(1adfc140-70b3-4f2d-b57c-504c9f7d5a2e),segment_id=1adfc140-70b3-4f2d-b57c-504c9f7d5a2e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:32:48.992287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f002cf4c-1bb3-4890-bbc4-296d0bfc01be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:49.040324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f002cf4c-1bb3-4890-bbc4-296d0bfc01be None None] Pushing event updated for resources: {'Port': ['ID=ffef7d67-2954-407f-90d8-1b029125c580,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:49.113189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-955b60ef-7587-4c54-8216-7bfc3975a44e None None] Provisioning complete for port ffef7d67-2954-407f-90d8-1b029125c580 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:32:49.113513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-955b60ef-7587-4c54-8216-7bfc3975a44e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:49.346631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ffef7d67-2954-407f-90d8-1b029125c580 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:32:49.399377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ffef7d67-2954-407f-90d8-1b029125c580 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:32:49.399657 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:49.788978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4583df42-8326-4542-a6df-eed0a991a1e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:50.467742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37688) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:50.780360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-f356691a-bf5f-4204-a31b-9a6c9e5fbded admin admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:32:50.781357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f356691a-bf5f-4204-a31b-9a6c9e5fbded admin admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3126826 Dec 21 03:32:52.109376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ef155ce-efa5-4074-89f8-3acb183875d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.027197 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.340015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37706) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:53.471181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'router:external': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'is_default': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:32:53.554532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Made reservation on behalf of 3c45fcecc3c14ed4b517471aaa113a5b for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:32:53.556811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.564541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.637651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.712220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.727347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Reserving flat network on physical network physnet1 {{(pid=110310) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 21 03:32:53.746015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea28cf45-71b3-4f48-819a-07917cba042c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:53.748769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.754102 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Added segment 4831152c-b350-45f0-9c97-ced0bcd6cc54 of type flat for network 30f5b79f-275c-4003-8999-814f6db142e1 Dec 21 03:32:53.794302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.889310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.890176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:32:53.890799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:53.948158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] Pushing event updated for resources: {'Network': ['ID=30f5b79f-275c-4003-8999-814f6db142e1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:53.957569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 30f5b79f-275c-4003-8999-814f6db142e1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:32:54.012424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-00f8d96c-4d7e-4110-924e-765db9d7e108 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6713250 Dec 21 03:32:54.838605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:55.609586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:56.472469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37724) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:32:56.563233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18baff63-c7bb-4992-a85d-957e803ad284 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:32:56.564527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-18baff63-c7bb-4992-a85d-957e803ad284 admin admin] 10.222.0.18 "GET /v2.0/subnets/5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea HTTP/1.1" status: 200 len: 849 time: 0.0911317 Dec 21 03:32:56.678176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-21d9ffc7-2373-4648-8ac5-aa51bcefa038 admin admin] 10.222.0.18 "GET /v2.0/routers/b7f01545-b348-45d2-bb4f-ae8fae9942e4 HTTP/1.1" status: 200 len: 704 time: 0.1075799 Dec 21 03:32:56.943510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:57.228748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Allocated IP 172.20.0.1 (d9a910b9-c9fb-4e84-bdaa-e641d17f9845/5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea/1a676179-c7b3-4b5b-a29a-4a565d0ab6c4) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:32:57.419869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:57.541676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:57.610633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:32:57.615269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:32:57.621540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:32:57.622056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:57.685246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Pushing event updated for resources: {'Port': ['ID=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:57.811563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6c881721-7036-4dab-bb15-c56118bcddb0 None None] Provisioning complete for port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:32:57.812098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6c881721-7036-4dab-bb15-c56118bcddb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:57.845259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6c881721-7036-4dab-bb15-c56118bcddb0 None None] Port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:32:57.900901 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:58.105818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:58.165895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:58.166655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:58.246834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Pushing event updated for resources: {'Port': ['ID=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:32:58.287496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:32:58.288763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:32:58.469080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-33bf1f8b-a594-46a4-b7f2-02d7db3f1fc0 None None] Provisioning complete for port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:32:58.469453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33bf1f8b-a594-46a4-b7f2-02d7db3f1fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:58.518069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Router b7f01545-b348-45d2-bb4f-ae8fae9942e4 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:32:58.544393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-33bf1f8b-a594-46a4-b7f2-02d7db3f1fc0 None None] Port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:32:58.609155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:32:58.615779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0cf9579-c594-46a5-88c7-8906352bcfbe admin admin] 10.222.0.18 "PUT /v2.0/routers/b7f01545-b348-45d2-bb4f-ae8fae9942e4/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9318628 Dec 21 03:32:58.620957 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Sync routers for ids ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:32:58.633544 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Routers {'b7f01545-b348-45d2-bb4f-ae8fae9942e4'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:32:58.634352 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:32:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:58.829002 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Set router b7f01545-b348-45d2-bb4f-ae8fae9942e4 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:32:59.254183 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'name': 'router1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:32:47Z', 'updated_at': '2021-12-21T03:32:57Z', 'revision_number': 2, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'gw_port_host': None, '_interfaces': [{'id': '1a676179-c7b3-4b5b-a29a-4a565d0ab6c4', 'name': '', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'mac_address': 'fa:16:3e:23:10:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:32:56Z', 'updated_at': '2021-12-21T03:32:57Z', 'revision_number': 2, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'subnets': [{'id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:32:59.304194 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Checking router: b7f01545-b348-45d2-bb4f-ae8fae9942e4 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:32:59.304566 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Updating router b7f01545-b348-45d2-bb4f-ae8fae9942e4 port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:32:59.350896 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:59.854520 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:32:59.920669 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.058978 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Pushing event updated for resources: {'Port': ['ID=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:00.086993 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.087337 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.088212 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.088546 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.088873 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.089269 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.089500 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.089814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.090130 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.090445 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.090759 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.091097 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.091414 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Tracked resource versions report: Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: pushed versions: Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: { 'AddressGroup': {'1.2'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'ConntrackHelper': {'1.0'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Log': {'1.0'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Network': {'1.1'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Port': {'1.7'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'PortForwarding': {'1.2'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'QosPolicy': {'1.10'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'SecurityGroup': {'1.5'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'SubPort': {'1.0'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Subnet': {'1.1'}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Trunk': {'1.1'}} Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: consumer versions: Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: L3 agent@n-d-822053-11: {}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: Metadata agent@n-d-822053-11: {}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: Metering agent@n-d-822053-11: {}, Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'ConntrackHelper': '1.0', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'LocalIPAssociation': '1.0', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Log': '1.0', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Network': '1.1', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Port': '1.7', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'PortForwarding': '1.2', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'QosPolicy': '1.10', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'SecurityGroup': '1.5', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'SecurityGroupRule': '1.2', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'SubPort': '1.0', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Subnet': '1.1', Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: 'Trunk': '1.1'}} Dec 21 03:33:00.092560 n-d-822053-11 neutron-server[110313]: {{(pid=110313) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:33:00.100334 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Attempting to bind port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:33:00.100734 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Attempting to bind port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:33:00.101152 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Attempting to bind port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 on network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:33:00.107151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 32, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:33:00.107547 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Checking segment: {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:33:00.108012 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.108394 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Bound using segment: {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:33:00.108860 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Bound port: 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1adfc140-70b3-4f2d-b57c-504c9f7d5a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:33:00.109231 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.172111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-887ab4f3-61a9-4e37-93a8-2e3c764a818a None None] Provisioning complete for port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:33:00.172704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-887ab4f3-61a9-4e37-93a8-2e3c764a818a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.177369 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] For port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:33:00.196652 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] For port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,segment=NetworkSegment(1adfc140-70b3-4f2d-b57c-504c9f7d5a2e),segment_id=1adfc140-70b3-4f2d-b57c-504c9f7d5a2e)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:33:00.205003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-887ab4f3-61a9-4e37-93a8-2e3c764a818a None None] Port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:33:00.267144 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.318916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Routers {'b7f01545-b348-45d2-bb4f-ae8fae9942e4'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:33:00.318916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:32:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:33:00.396854 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e626b0c-c38f-49aa-abf3-4b67e7df1ac6 None None] Pushing event updated for resources: {'Port': ['ID=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:00.413314 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] Set router b7f01545-b348-45d2-bb4f-ae8fae9942e4 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:33:00.525169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-727df6d8-02b2-4ec0-bb31-99ab87b43eda None None] Provisioning complete for port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:33:00.525643 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-727df6d8-02b2-4ec0-bb31-99ab87b43eda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.615983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-727df6d8-02b2-4ec0-bb31-99ab87b43eda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.631130 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'name': 'router1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:32:47Z', 'updated_at': '2021-12-21T03:32:57Z', 'revision_number': 2, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'gw_port_host': None, '_interfaces': [{'id': '1a676179-c7b3-4b5b-a29a-4a565d0ab6c4', 'name': '', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'mac_address': 'fa:16:3e:23:10:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:32:56Z', 'updated_at': '2021-12-21T03:33:00Z', 'revision_number': 4, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'subnets': [{'id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:33:00.645433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-727df6d8-02b2-4ec0-bb31-99ab87b43eda None None] For port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,segment=NetworkSegment(1adfc140-70b3-4f2d-b57c-504c9f7d5a2e),segment_id=1adfc140-70b3-4f2d-b57c-504c9f7d5a2e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:33:00.658253 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02015746-a7c9-4883-8c2e-93922aa2493a None None] The sync data for ids ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'] in n-d-822053-11 is: [{'id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'name': 'router1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:32:47Z', 'updated_at': '2021-12-21T03:32:57Z', 'revision_number': 2, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'gw_port_host': None, '_interfaces': [{'id': '1a676179-c7b3-4b5b-a29a-4a565d0ab6c4', 'name': '', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'mac_address': 'fa:16:3e:23:10:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:32:56Z', 'updated_at': '2021-12-21T03:33:00Z', 'revision_number': 4, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'subnets': [{'id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:33:00.723719 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-727df6d8-02b2-4ec0-bb31-99ab87b43eda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:00.772943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727df6d8-02b2-4ec0-bb31-99ab87b43eda None None] Pushing event updated for resources: {'Port': ['ID=1a676179-c7b3-4b5b-a29a-4a565d0ab6c4,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:01.064587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37734) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:33:01.173506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90c1c9f5-697e-405d-b2fa-0a25d41d1f2d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:33:01.174893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-90c1c9f5-697e-405d-b2fa-0a25d41d1f2d admin admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 842 time: 0.1093681 Dec 21 03:33:01.184745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Request body: {'subnet': {'gateway_ip': '172.25.5.1', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_dhcp': False, 'cidr': '172.25.5.0/24', 'name': 'public-subnet', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:33:01.266273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Made reservation on behalf of 3c45fcecc3c14ed4b517471aaa113a5b for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:33:01.268622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:01.667803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 03:33:01.668260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:01.725647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=d97763f7-6055-4080-b2b6-7cd4d7f7d537,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:01.734241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:33:01.734639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Network hostable DHCP agents. Network: 30f5b79f-275c-4003-8999-814f6db142e1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:33:01.855505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:33:01.923630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 30f5b79f-275c-4003-8999-814f6db142e1) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:33:01.927772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:33:01.928361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:01.933072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dce7c1b5-cfcd-4ae5-9be5-79081235def5 None None] Network 30f5b79f-275c-4003-8999-814f6db142e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:33:02.019010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6200965f-914b-4cbb-84ab-6feb312eb0ee admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8217003 Dec 21 03:33:02.035503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00fc0f01-185c-436b-94f9-eefb3bdbe7b0 None None] Network 30f5b79f-275c-4003-8999-814f6db142e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:33:04.627358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37742) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:33:04.772437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c26c008d-e8e9-45b1-8162-3b428a33a495 admin admin] 10.222.0.18 "GET /v2.0/routers/b7f01545-b348-45d2-bb4f-ae8fae9942e4 HTTP/1.1" status: 200 len: 710 time: 0.1550856 Dec 21 03:33:04.857981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b81878f7-78f8-49b5-bc75-2699db547dcf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:33:04.859396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b81878f7-78f8-49b5-bc75-2699db547dcf admin admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 886 time: 0.0813510 Dec 21 03:33:04.868718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:33:05.115611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:05.433038 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:05.511769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:05.613902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Allocated IP 172.25.5.215 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/860c385e-360e-40a8-abc8-4ad451913db1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:33:05.847725 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:05.937987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:05.975228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:33:05.978643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:33:05.982672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:33:06.018745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Pushing event updated for resources: {'Port': ['ID=860c385e-360e-40a8-abc8-4ad451913db1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:06.419312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:06.615457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:06.615457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:06.719470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Router b7f01545-b348-45d2-bb4f-ae8fae9942e4 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:33:06.828300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:33:06.833009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:06.833783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5e9dde9f-6e40-4a1b-a2b7-fbddf5ebf1cc admin admin] 10.222.0.18 "PUT /v2.0/routers/b7f01545-b348-45d2-bb4f-ae8fae9942e4 HTTP/1.1" status: 200 len: 890 time: 1.9683485 Dec 21 03:33:07.356033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:33:07.403931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:33:07.404359 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:07.611057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Sync routers for ids ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:33:07.622124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Routers {'b7f01545-b348-45d2-bb4f-ae8fae9942e4'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:33:07.622865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:32:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:33:07.828758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Set router b7f01545-b348-45d2-bb4f-ae8fae9942e4 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:33:08.215589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'name': 'router1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.215'}], 'enable_snat': True}, 'gw_port_id': '860c385e-360e-40a8-abc8-4ad451913db1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:32:47Z', 'updated_at': '2021-12-21T03:33:06Z', 'revision_number': 4, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'gw_port': {'id': '860c385e-360e-40a8-abc8-4ad451913db1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:89:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:33:05Z', 'updated_at': '2021-12-21T03:33:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1a676179-c7b3-4b5b-a29a-4a565d0ab6c4', 'name': '', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'mac_address': 'fa:16:3e:23:10:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:32:56Z', 'updated_at': '2021-12-21T03:33:00Z', 'revision_number': 5, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'subnets': [{'id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:33:08.342441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Checking router: b7f01545-b348-45d2-bb4f-ae8fae9942e4 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:33:08.342799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Updating router b7f01545-b348-45d2-bb4f-ae8fae9942e4 port 860c385e-360e-40a8-abc8-4ad451913db1 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:33:08.388632 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:08.698477 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:08.792180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:08.843644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Attempting to bind port 860c385e-360e-40a8-abc8-4ad451913db1 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:33:08.844024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Attempting to bind port 860c385e-360e-40a8-abc8-4ad451913db1 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:33:08.844392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Attempting to bind port 860c385e-360e-40a8-abc8-4ad451913db1 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:33:08.847158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f75b13e-6f40-4906-9b6a-25570b3dabc2 None None] Pushing event updated for resources: {'Port': ['ID=860c385e-360e-40a8-abc8-4ad451913db1,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:08.851562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 32, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:33:08.851942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:33:08.852352 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:08.852721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:33:08.853215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Bound port: 860c385e-360e-40a8-abc8-4ad451913db1, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:33:08.853611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:08.901828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] For port 860c385e-360e-40a8-abc8-4ad451913db1, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:33:08.904666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] For port 860c385e-360e-40a8-abc8-4ad451913db1, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=860c385e-360e-40a8-abc8-4ad451913db1,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:33:08.969559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:09.030766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f75b13e-6f40-4906-9b6a-25570b3dabc2 None None] Pushing event updated for resources: {'Port': ['ID=860c385e-360e-40a8-abc8-4ad451913db1,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:09.033478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Routers {'b7f01545-b348-45d2-bb4f-ae8fae9942e4'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:33:09.034066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:32:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:33:09.137118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] Set router b7f01545-b348-45d2-bb4f-ae8fae9942e4 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:33:09.338898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'name': 'router1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.215'}], 'enable_snat': True}, 'gw_port_id': '860c385e-360e-40a8-abc8-4ad451913db1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:32:47Z', 'updated_at': '2021-12-21T03:33:06Z', 'revision_number': 4, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'gw_port': {'id': '860c385e-360e-40a8-abc8-4ad451913db1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:89:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:33:05Z', 'updated_at': '2021-12-21T03:33:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1a676179-c7b3-4b5b-a29a-4a565d0ab6c4', 'name': '', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'mac_address': 'fa:16:3e:23:10:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:32:56Z', 'updated_at': '2021-12-21T03:33:00Z', 'revision_number': 5, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'subnets': [{'id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:33:09.367185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778e22d6-4725-43dc-840b-0e7559757a70 None None] The sync data for ids ['b7f01545-b348-45d2-bb4f-ae8fae9942e4'] in n-d-822053-11 is: [{'id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'name': 'router1', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.215'}], 'enable_snat': True}, 'gw_port_id': '860c385e-360e-40a8-abc8-4ad451913db1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:32:47Z', 'updated_at': '2021-12-21T03:33:06Z', 'revision_number': 4, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'gw_port': {'id': '860c385e-360e-40a8-abc8-4ad451913db1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:fc:89:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:33:05Z', 'updated_at': '2021-12-21T03:33:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1a676179-c7b3-4b5b-a29a-4a565d0ab6c4', 'name': '', 'network_id': 'd9a910b9-c9fb-4e84-bdaa-e641d17f9845', 'tenant_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'mac_address': 'fa:16:3e:23:10:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7f01545-b348-45d2-bb4f-ae8fae9942e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:32:56Z', 'updated_at': '2021-12-21T03:33:00Z', 'revision_number': 5, 'project_id': '0d3aa4b8a8ad4eb4b3947f8f963974bd', 'subnets': [{'id': '5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '57978d5f-ab17-4aeb-86be-276e9aa8f540'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:33:09.452628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:33:09.727203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.policy [None req-1a097660-765e-4d55-aace-8b2d5ffa6bb5 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=110311) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 21 03:33:09.775436 n-d-822053-11 neutron-server[110311]: WARNING oslo_policy.policy [None req-1a097660-765e-4d55-aace-8b2d5ffa6bb5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:33:09.775827 n-d-822053-11 neutron-server[110311]: WARNING oslo_policy.policy [None req-1a097660-765e-4d55-aace-8b2d5ffa6bb5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 21 03:33:09.785766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1a097660-765e-4d55-aace-8b2d5ffa6bb5 admin admin] 10.222.0.18 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.3321242 Dec 21 03:33:11.349456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 860c385e-360e-40a8-abc8-4ad451913db1 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:33:11.396222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 860c385e-360e-40a8-abc8-4ad451913db1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:33:11.396621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:11.469715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:11.489240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 860c385e-360e-40a8-abc8-4ad451913db1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=860c385e-360e-40a8-abc8-4ad451913db1,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:33:11.569484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:11.628730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=860c385e-360e-40a8-abc8-4ad451913db1,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:33:13.370457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 860c385e-360e-40a8-abc8-4ad451913db1 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:33:13.452859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 860c385e-360e-40a8-abc8-4ad451913db1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:33:13.453585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:14.687527 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:33:19.852229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8314c358-e47d-4cf5-88d7-f8958cf873d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:22.134590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd07dbdb-48c0-4329-9fef-b2ecc97912e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:23.023399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:24.837856 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:25.607981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:49.802795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a35323a2-13f2-4650-afb9-19c5ef0cd997 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:51.673298 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:33:52.142773 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8b580b30-8b0b-4d26-97df-f9ee28f49e44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:53.022394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:54.842726 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:33:56.165957 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:19.799086 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca32d35c-214b-4a2e-90ba-03db1e7ecd3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:22.119589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-add53780-ccef-41a5-b7d0-8b8bb6f8c460 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:23.022138 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:24.856499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:25.612428 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:28.671648 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:34:36.991156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38272) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:37.070228 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-80fc0daf-1638-4fe3-bd9d-caaa6c809af2 admin admin] GET failed (client error): The resource could not be found. Dec 21 03:34:37.071583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80fc0daf-1638-4fe3-bd9d-caaa6c809af2 admin admin] 10.222.0.18 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0795102 Dec 21 03:34:37.261402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60147f5-ae71-4968-81ea-a3673045df6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:37.262763 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c60147f5-ae71-4968-81ea-a3673045df6c admin admin] 10.222.0.18 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1866338 Dec 21 03:34:39.692421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38282) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:39.821943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb004c41-520e-4440-b3e7-89afb988fab1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:39.823295 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cb004c41-520e-4440-b3e7-89afb988fab1 admin admin] 10.222.0.18 "GET /v2.0/subnets/5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea HTTP/1.1" status: 200 len: 849 time: 0.1296430 Dec 21 03:34:39.833350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:34:39.916929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Publish callbacks [] for subnet, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:40.126653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8762542841402'] for subnet, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:40.187119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:40.187646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:40.189225 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] 10.222.0.18 "PUT /v2.0/subnets/5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea HTTP/1.1" status: 200 len: 868 time: 0.3593416 Dec 21 03:34:40.192072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c436a6b-623e-46d6-a956-c333848b6aae None None] Network d9a910b9-c9fb-4e84-bdaa-e641d17f9845 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:34:40.199719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:34:40.209573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.209972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.210269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.210605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.210963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.211300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.211629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.211958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.212285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.212666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.212998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.213323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.213646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77181420-bf86-45ac-98c4-c329ef4970a9 admin admin] Tracked resource versions report: Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: pushed versions: Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: { 'AddressGroup': {'1.2'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'ConntrackHelper': {'1.0'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Log': {'1.0'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Network': {'1.1'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Port': {'1.7'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'PortForwarding': {'1.2'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'QosPolicy': {'1.10'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'SecurityGroup': {'1.5'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'SubPort': {'1.0'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Subnet': {'1.1'}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Trunk': {'1.1'}} Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: consumer versions: Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: L3 agent@n-d-822053-11: {}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: Metadata agent@n-d-822053-11: {}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: Metering agent@n-d-822053-11: {}, Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'ConntrackHelper': '1.0', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'LocalIPAssociation': '1.0', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Log': '1.0', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Network': '1.1', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Port': '1.7', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'PortForwarding': '1.2', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'QosPolicy': '1.10', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'SecurityGroup': '1.5', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'SecurityGroupRule': '1.2', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'SubPort': '1.0', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Subnet': '1.1', Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: 'Trunk': '1.1'}} Dec 21 03:34:40.214845 n-d-822053-11 neutron-server[110311]: {{(pid=110311) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:34:40.493700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1c8d4155-e67b-4719-aee0-9f36d75799d2 None None] Provisioning complete for port ffef7d67-2954-407f-90d8-1b029125c580 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:34:40.494071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c8d4155-e67b-4719-aee0-9f36d75799d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:40.577393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1c8d4155-e67b-4719-aee0-9f36d75799d2 None None] Provisioning complete for port 1a676179-c7b3-4b5b-a29a-4a565d0ab6c4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:34:40.577762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c8d4155-e67b-4719-aee0-9f36d75799d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:42.601924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38294) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:42.815140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d42d6a1a-d655-4f3f-ac3c-93990299fcda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:42.815528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d42d6a1a-d655-4f3f-ac3c-93990299fcda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:42.817058 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d42d6a1a-d655-4f3f-ac3c-93990299fcda admin admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2141917 Dec 21 03:34:45.179895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38302) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:45.310796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79d2fd71-10fe-41cb-a1b3-60094772d15d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:45.311296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79d2fd71-10fe-41cb-a1b3-60094772d15d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:45.312777 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-79d2fd71-10fe-41cb-a1b3-60094772d15d admin admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1319406 Dec 21 03:34:47.695013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38310) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:47.820284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-117eac97-2e36-4b8a-9ee9-d4a0cc6f68bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:47.821629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-117eac97-2e36-4b8a-9ee9-d4a0cc6f68bc admin admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 886 time: 0.1256068 Dec 21 03:34:49.789140 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-502bc3c9-2d42-416f-8882-53a4e25afeb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:50.160135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38320) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:50.290483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b9c3b4b-ea33-47da-ae7d-1261c5a080ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:50.291931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8b9c3b4b-ea33-47da-ae7d-1261c5a080ec admin admin] 10.222.0.18 "GET /v2.0/networks/d9a910b9-c9fb-4e84-bdaa-e641d17f9845 HTTP/1.1" status: 200 len: 869 time: 0.1307898 Dec 21 03:34:52.115986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-55ea9de4-dc37-4d61-96cc-c48eaeb3701d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:52.665994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38328) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:52.801013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53faced3-d240-4d73-89ea-562586988600 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:52.801479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53faced3-d240-4d73-89ea-562586988600 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:52.803043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-53faced3-d240-4d73-89ea-562586988600 admin admin] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1360753 Dec 21 03:34:53.006548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:54.834649 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:55.183267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38336) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:55.304496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66c4bf25-fb1f-427b-a3e8-eb12e19fd8eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:55.304949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66c4bf25-fb1f-427b-a3e8-eb12e19fd8eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:55.306441 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-66c4bf25-fb1f-427b-a3e8-eb12e19fd8eb admin admin] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1222568 Dec 21 03:34:55.623080 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:34:57.700602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38344) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:34:57.793572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee0cc6e5-b004-4864-90fc-3ef9ca3c78bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:34:57.795000 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ee0cc6e5-b004-4864-90fc-3ef9ca3c78bc admin admin] 10.222.0.18 "GET /v2.0/subnets/5f14ff14-dd9e-4fcb-a2ae-8f5e124a28ea HTTP/1.1" status: 200 len: 868 time: 0.0934122 Dec 21 03:35:00.167317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38352) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:35:00.252665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a63f851-4263-4450-8b3a-691575ed8486 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:35:00.254127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a63f851-4263-4450-8b3a-691575ed8486 admin admin] 10.222.0.18 "GET /v2.0/subnets/d97763f7-6055-4080-b2b6-7cd4d7f7d537 HTTP/1.1" status: 200 len: 816 time: 0.0858178 Dec 21 03:35:05.670106 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:35:19.805159 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11663632-2ae1-471f-9869-364eafb096ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:22.113846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6a1af705-15cd-4846-a210-2a90d2fb84e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:23.022919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:24.838222 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:25.494228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38406) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:35:25.543483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-c3379eea-ded8-46ba-998a-7b7a4a990a38 admin admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:35:25.544575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c3379eea-ded8-46ba-998a-7b7a4a990a38 admin admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0494125 Dec 21 03:35:25.622434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:28.009333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38414) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:35:28.069180 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-3cd6f8c8-cee1-44ef-97d2-62ee5858266d admin admin] GET failed (client error): The resource could not be found. Dec 21 03:35:28.070493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3cd6f8c8-cee1-44ef-97d2-62ee5858266d admin admin] 10.222.0.18 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0602462 Dec 21 03:35:28.207983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa0d04e1-a7ea-4701-a108-72fa8d036d71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:35:28.209363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fa0d04e1-a7ea-4701-a108-72fa8d036d71 admin admin] 10.222.0.18 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1344590 Dec 21 03:35:30.608385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:35:30.655370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:35:30.782363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Made reservation on behalf of 3c45fcecc3c14ed4b517471aaa113a5b for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:35:30.784688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:30.812786 n-d-822053-11 neutron-server[110310]: WARNING neutron.services.revisions.revision_plugin [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Could not find related network for resource to bump revision. Dec 21 03:35:30.823310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] vlan segment allocate from pool success with {'vlan_id': 108, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:35:30.832869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:30.837677 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Added segment fe6a8e81-8288-4b64-be23-c7427ee6dc4c of type vlan for network bfd89982-1206-47e5-b884-d7d59ce490d8 Dec 21 03:35:30.874324 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:30.970473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:30.971427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:35:30.972023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:31.027135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Pushing event updated for resources: {'Network': ['ID=bfd89982-1206-47e5-b884-d7d59ce490d8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:35:31.033349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.037404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:31.047652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network bfd89982-1206-47e5-b884-d7d59ce490d8 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:35:31.059135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7689101d-5e1e-4f7d-bf21-c22a1706cd3a admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4496288 Dec 21 03:35:33.442111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38430) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:35:33.501165 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-bd52190f-f992-471f-a895-cf46be277ab1 admin admin] GET failed (client error): The resource could not be found. Dec 21 03:35:33.502411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bd52190f-f992-471f-a895-cf46be277ab1 admin admin] 10.222.0.18 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0592697 Dec 21 03:35:33.572255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f290b61-0b09-4204-a5f9-3917f2bec459 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:35:33.573694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1f290b61-0b09-4204-a5f9-3917f2bec459 admin admin] 10.222.0.18 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0666373 Dec 21 03:35:33.584516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'ip_version': 4, 'description': 'shared-subnet', 'name': 'shared-subnet'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:35:33.707765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Made reservation on behalf of 3c45fcecc3c14ed4b517471aaa113a5b for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:35:33.710588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:33.965308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.019251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Pushing event updated for resources: {'Subnet': ['ID=a989d27f-6484-4ad7-8d07-9ce1c321b9d2,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:35:34.027494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:35:34.027494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Network hostable DHCP agents. Network: bfd89982-1206-47e5-b884-d7d59ce490d8, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:35:34.096273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:35:34.187526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, bfd89982-1206-47e5-b884-d7d59ce490d8) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:35:34.192038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:35:34.193526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.197071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f01b1f48-d36c-414a-9f3e-835836121c02 None None] Network bfd89982-1206-47e5-b884-d7d59ce490d8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:35:34.265288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ff203a57-b1df-41f2-927c-908d7da3580c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6842792 Dec 21 03:35:34.298821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-bfd89982-1206-47e5-b884-d7d59ce490d8', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'project_id': '3c45fcecc3c14ed4b517471aaa113a5b', 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:35:34.299752 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.447124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Allocated IP 192.168.233.2 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/742d62fb-2f85-4c05-8376-235e455a9238) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:35:34.586076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.685540 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.728300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:35:34.731112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:35:34.733643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:35:34.745027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Pushing event updated for resources: {'Port': ['ID=742d62fb-2f85-4c05-8376-235e455a9238,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:35:34.767204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.767546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.767879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.768211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.768551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.768857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.769205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.769640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.769877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.770196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.770513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.770858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.771205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:35:34.803719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Attempting to bind port 742d62fb-2f85-4c05-8376-235e455a9238 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:35:34.804091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Attempting to bind port 742d62fb-2f85-4c05-8376-235e455a9238 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:35:34.804452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Attempting to bind port 742d62fb-2f85-4c05-8376-235e455a9238 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:35:34.809781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 35, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:35:34.810158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:35:34.810920 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.810920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:35:34.811486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Bound port: 742d62fb-2f85-4c05-8376-235e455a9238, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:35:34.811834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:34.873836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] For port 742d62fb-2f85-4c05-8376-235e455a9238, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:35:34.877255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] For port 742d62fb-2f85-4c05-8376-235e455a9238, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=742d62fb-2f85-4c05-8376-235e455a9238,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:35:34.942861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:35.096881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9511cf4-24a2-49cb-bb8f-9c780c804943 None None] Pushing event updated for resources: {'Port': ['ID=742d62fb-2f85-4c05-8376-235e455a9238,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:35:35.502218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 742d62fb-2f85-4c05-8376-235e455a9238 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:35:35.558600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 742d62fb-2f85-4c05-8376-235e455a9238 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:35:35.558991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:35.640204 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:35.679019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 742d62fb-2f85-4c05-8376-235e455a9238, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=742d62fb-2f85-4c05-8376-235e455a9238,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:35:35.737865 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:35.791453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=742d62fb-2f85-4c05-8376-235e455a9238,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:35:35.956622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e53d7191-d26f-4a11-bf97-d2d16d68d355 None None] Network bfd89982-1206-47e5-b884-d7d59ce490d8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:35:36.029696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-20599d1e-2d64-4466-a531-0e22c8be7bdc None None] Provisioning complete for port 742d62fb-2f85-4c05-8376-235e455a9238 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:35:36.030063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20599d1e-2d64-4466-a531-0e22c8be7bdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:36.361881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1495488d-028c-479d-858e-5281baea5100 None None] Provisioning complete for port 742d62fb-2f85-4c05-8376-235e455a9238 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:35:36.362258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1495488d-028c-479d-858e-5281baea5100 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:37.424157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 742d62fb-2f85-4c05-8376-235e455a9238 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:35:37.471642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 742d62fb-2f85-4c05-8376-235e455a9238 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:35:37.472004 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:42.668721 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:35:49.815613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e722420c-4d7a-430e-be4f-5e7a57a3e767 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:52.101415 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12ab06d1-82e8-4a22-bcae-d018d1a7cdc7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:53.044470 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:54.844200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:35:55.615635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:19.667634 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:36:19.786630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51683596-deb7-45a5-bebc-a1b7d1c5b445 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:22.117193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc67d9db-345c-4e08-8966-9a8c801112f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:23.043251 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:24.843329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:25.649430 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:49.785861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ba18986-e550-41aa-987d-787904d9b942 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:52.100073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c793ab67-e720-4d6d-9c19-ff1db5997298 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:53.048524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:54.848225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:55.631027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:36:56.667719 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:37:14.002170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:37:14.008110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-a132cd28-e409-442f-8df8-ae33596f8a36 tempest-verify_tempest_config-745219238 tempest-verify_tempest_config-745219238-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:37:14.009082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a132cd28-e409-442f-8df8-ae33596f8a36 tempest-verify_tempest_config-745219238 tempest-verify_tempest_config-745219238-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0059536 Dec 21 03:37:14.476666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38492) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:37:14.577158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:14.648520 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:14.721473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:14.857711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d454a777cd2041e39fb305340bc195a8&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3799021 Dec 21 03:37:14.858525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=388e7fb8-d9c9-4e5d-a52e-27c77ac10e38,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:37:14.860354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38496) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:37:14.865790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.866138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.866496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.866822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.867183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.867513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.867839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.868186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.868509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.868831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.869154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.869519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.869843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da96e65f-293b-4072-b942-53f3fa16b31e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:14.939353 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:14.960195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:15.110844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:15.113406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:15.114580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/388e7fb8-d9c9-4e5d-a52e-27c77ac10e38 HTTP/1.1" status: 204 len: 168 time: 0.2532690 Dec 21 03:37:15.122204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=388e7fb8-d9c9-4e5d-a52e-27c77ac10e38,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:37:15.129030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.129565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.129915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.130254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.131299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.131689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.132024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.132355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.132690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.133046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.133374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.133800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:15.134161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9bd3444-f0bd-488a-b88b-f936fc8e3b6b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:37:19.802073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e520b5d8-bb32-4f63-b8ed-e3f0e19e5032 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:22.115941 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d71f8a0-868c-4357-9428-851ba9bed749 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:23.070012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:24.842142 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:25.590077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:33.666207 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:37:49.766569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b53149e4-6041-45f8-9bb9-0a53fd356687 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:52.132314 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-294c916f-ec70-4a2a-93e8-ef86164513fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:53.092198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:54.852670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:37:55.629244 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:10.666430 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:38:19.789265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17e74d52-3209-467f-b353-83fbbe5aeb85 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:22.097927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a1e40ea-0aeb-4032-bf97-39c610d734ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:23.046099 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:24.857634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:25.628687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:47.665199 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:38:49.840121 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d06e2b5-fd4c-404b-b9cf-1c15c5eee8e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:52.108298 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-641c0302-3b47-4f5b-8673-246ba0bba6e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:53.051253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:54.856249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:38:55.616943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:19.816782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b75524-791c-4297-bb75-b535d588862c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:22.090659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a84caaa7-dfca-4876-bef0-e92ee7b72811 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:23.038964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:24.663313 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:39:24.856390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:25.621985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:49.781664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b469a89c-cc7b-406b-b980-a696cf52cfdf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:52.099442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cba5a70b-6743-4823-a184-3c3530bfe4e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:53.064975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:54.838725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:39:55.613993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:01.662390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 5 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:40:19.797789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1482527b-e45c-4d79-8e8e-63244e3ffeba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:22.100973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b15aff1-68d0-4644-bd85-da550d277013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:22.395978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:23.066193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:24.647552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7875191'] for agent, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:24.876163 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:25.624467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:38.661876 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:40:49.797856 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2c35091-6020-4fc0-ad8a-e4bb9c36600b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:52.103248 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-315413a3-b85b-4d27-a750-fcb736257dd2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:52.360418 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:53.060249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:54.366716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38554) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:40:54.468683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07efd608-3724-4e33-aa6e-2bbfb3f927e7 admin admin] 10.222.0.18 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4939 time: 0.1007347 Dec 21 03:40:54.686248 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:54.880788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:55.620189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:40:56.864287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38564) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:40:56.923416 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-610bab47-41b5-4fb7-a1d1-70ce3ebf924d admin admin] 10.222.0.18 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4939 time: 0.0580611 Dec 21 03:41:15.662364 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:41:19.782440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d05e201-9e43-4bb3-b42a-9de02e2a3449 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:22.105367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3a21aaa2-0d2e-4b81-8e76-6ad22cf117d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:22.394512 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:23.062156 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:24.619389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:24.910958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:25.607928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:49.790739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5cc8ebe-cef4-4281-8067-58dbdbbc1ff6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:52.127730 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-806d3f47-fbf9-47bf-9351-584feaa10a3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:52.408050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:52.661818 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:41:53.087780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:54.619280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:54.873174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:41:55.621607 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:19.887235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14050dd2-83af-4a3b-9321-6a5a080481e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:21.435534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38712) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:22.107073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f7d4c616-e515-4feb-9295-3ee368d230e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:22.108419 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0e4f0027-0bf0-4c07-9d45-da12b5fde80d tempest-AutoAllocateNetworkTest-476339906 tempest-AutoAllocateNetworkTest-476339906-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=bfa6d1fadd3d4cb7bdbef2ed9e389bb2&shared=False HTTP/1.1" status: 200 len: 208 time: 0.6717541 Dec 21 03:42:22.112328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38734) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:22.291587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcfe467e-1825-49ca-9dc6-3bb595fc6167 tempest-AutoAllocateNetworkTest-476339906 tempest-AutoAllocateNetworkTest-476339906-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:22.293059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bcfe467e-1825-49ca-9dc6-3bb595fc6167 tempest-AutoAllocateNetworkTest-476339906 tempest-AutoAllocateNetworkTest-476339906-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 764 time: 0.1791198 Dec 21 03:42:22.300415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38744) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:22.370900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-88399b7e-5e32-4625-9a07-e1521d5f8b71 tempest-AutoAllocateNetworkTest-476339906 tempest-AutoAllocateNetworkTest-476339906-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0693343 Dec 21 03:42:22.373827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:22.404400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d4b53205-c9b9-4e38-be22-a228713204a8 tempest-AutoAllocateNetworkTest-476339906 tempest-AutoAllocateNetworkTest-476339906-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=bfa6d1fadd3d4cb7bdbef2ed9e389bb2 HTTP/1.1" status: 200 len: 208 time: 0.0272148 Dec 21 03:42:22.406102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:23.071057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:23.316234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38792) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:23.553364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38802) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:23.790071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:23.798366 n-d-822053-11 neutron-server[110311]: INFO neutron.quota [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Loaded quota_driver: . Dec 21 03:42:23.890854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:23.963443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:23.978223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Request body: {'network': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-network', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:24.007304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd68f0d4-1731-48a1-aaba-258d9936141d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:24.019397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.019758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.020098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.020599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.020936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.021269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.021599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.021926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.022249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.022571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.022910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.023228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.023598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] Tracked resource versions report: Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: pushed versions: Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: { 'AddressGroup': {'1.2'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'ConntrackHelper': {'1.0'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Log': {'1.0'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Network': {'1.1'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Port': {'1.7'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'PortForwarding': {'1.2'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'QosPolicy': {'1.10'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'SecurityGroup': {'1.5'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'SubPort': {'1.0'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Subnet': {'1.1'}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Trunk': {'1.1'}} Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: consumer versions: Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: HyperV agent@n-h1-822053-11: {}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: HyperV agent@n-h2-822053-11: {}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: L3 agent@n-d-822053-11: {}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: Metadata agent@n-d-822053-11: {}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: Metering agent@n-d-822053-11: {}, Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'ConntrackHelper': '1.0', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'LocalIPAssociation': '1.0', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Log': '1.0', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Network': '1.1', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Port': '1.7', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'PortForwarding': '1.2', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'QosPolicy': '1.10', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'SecurityGroup': '1.5', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'SecurityGroupRule': '1.2', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'SubPort': '1.0', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Subnet': '1.1', Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: 'Trunk': '1.1'}} Dec 21 03:42:24.024779 n-d-822053-11 neutron-server[110311]: {{(pid=110311) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:42:24.044037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38818) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:24.044564 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f37b7d5-60c9-46a1-a499-b01a3a39cead admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bfa6d1fadd3d4cb7bdbef2ed9e389bb2&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7267661 Dec 21 03:42:24.091356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Made reservation on behalf of 2637e7ec4ea74cb6a3ec5d635dce4a5c for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:24.093626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.110798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.119361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.150408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.288011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.293208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.293208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dd68f0d4-1731-48a1-aaba-258d9936141d HTTP/1.1" status: 204 len: 168 time: 0.2468832 Dec 21 03:42:24.311218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd68f0d4-1731-48a1-aaba-258d9936141d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:24.324735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.325091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.325439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.325775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.326107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.326435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.326763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.327114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.327443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.327761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.328081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.328400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.328719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c91ff69e-8d14-471f-8b4d-e7e6412a369f admin admin] Tracked resource versions report: Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: pushed versions: Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: { 'AddressGroup': {'1.2'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'ConntrackHelper': {'1.0'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Log': {'1.0'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Network': {'1.1'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Port': {'1.7'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'PortForwarding': {'1.2'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'QosPolicy': {'1.10'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'SecurityGroup': {'1.5'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'SubPort': {'1.0'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Subnet': {'1.1'}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Trunk': {'1.1'}} Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: consumer versions: Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: HyperV agent@n-h1-822053-11: {}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: HyperV agent@n-h2-822053-11: {}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: L3 agent@n-d-822053-11: {}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: Metadata agent@n-d-822053-11: {}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: Metering agent@n-d-822053-11: {}, Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'ConntrackHelper': '1.0', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'LocalIPAssociation': '1.0', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Log': '1.0', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Network': '1.1', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Port': '1.7', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'PortForwarding': '1.2', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'QosPolicy': '1.10', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'SecurityGroup': '1.5', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'SecurityGroupRule': '1.2', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'SubPort': '1.0', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Subnet': '1.1', Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: 'Trunk': '1.1'}} Dec 21 03:42:24.329846 n-d-822053-11 neutron-server[110310]: {{(pid=110310) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:42:24.333443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.403468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.427207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:42:24.443550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b94efdf9-2416-4a37-8ab4-c310be91fbce,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:24.450489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.450853 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Added segment cf58b462-5a49-4e04-8d36-e96ea1fa5db5 of type vlan for network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 Dec 21 03:42:24.489951 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.580861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.582093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:24.585280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.635946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.648921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] Pushing event updated for resources: {'Network': ['ID=97e3dbcb-7ac2-4207-82ae-df7e1df411c2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:24.659054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:42:24.725849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38840) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:24.726421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7cc95050-d0b3-4646-9971-5df780b0c5ca admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.1703012 Dec 21 03:42:24.729832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Request body: {'subnet': {'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-subnet', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:24.860382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Made reservation on behalf of 2637e7ec4ea74cb6a3ec5d635dce4a5c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:24.863462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Publish callbacks [] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:24.883163 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.186508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.249429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8ca201b9-7506-4b6b-8a03-05d4689a5e59,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:25.265203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Checking segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:25.265852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Network hostable DHCP agents. Network: 97e3dbcb-7ac2-4207-82ae-df7e1df411c2, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:42:25.368837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:42:25.452713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 97e3dbcb-7ac2-4207-82ae-df7e1df411c2) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:25.457585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:25.458171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.464494 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c63dacf3-8bf7-4d11-88ae-ac5c3d7a5936 None None] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:42:25.552334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fe835cad-9e86-4aad-bb2b-7f6167aa8284 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 0.8265908 Dec 21 03:42:25.552909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38878) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:25.557704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Request body: {'router': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:25.599815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:42:25.601147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.655293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.656291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.673932 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.719786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.750066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Allocated IP 172.20.0.2 (97e3dbcb-7ac2-4207-82ae-df7e1df411c2/8ca201b9-7506-4b6b-8a03-05d4689a5e59/e76cb2bf-a660-4015-b282-3705d7707d77) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:25.903139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.950826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:25.996550 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.068457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Pushing event updated for resources: {'Port': ['ID=e76cb2bf-a660-4015-b282-3705d7707d77,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:26.077717 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.078234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.078587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.078921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.079278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.079605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.080675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.081232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.081567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.081947 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.082876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.083284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.083610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Tracked resource versions report: Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: pushed versions: Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: { 'AddressGroup': {'1.2'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'ConntrackHelper': {'1.0'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Log': {'1.0'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Network': {'1.1'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Port': {'1.7'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'PortForwarding': {'1.2'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'QosPolicy': {'1.10'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'SecurityGroup': {'1.5'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'SubPort': {'1.0'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Subnet': {'1.1'}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Trunk': {'1.1'}} Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: consumer versions: Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: HyperV agent@n-h1-822053-11: {}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: HyperV agent@n-h2-822053-11: {}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: L3 agent@n-d-822053-11: {}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: Metadata agent@n-d-822053-11: {}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: Metering agent@n-d-822053-11: {}, Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'ConntrackHelper': '1.0', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'LocalIPAssociation': '1.0', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Log': '1.0', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Network': '1.1', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Port': '1.7', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'PortForwarding': '1.2', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'QosPolicy': '1.10', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'SecurityGroup': '1.5', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'SecurityGroupRule': '1.2', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'SubPort': '1.0', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Subnet': '1.1', Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: 'Trunk': '1.1'}} Dec 21 03:42:26.084747 n-d-822053-11 neutron-server[110312]: {{(pid=110312) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:42:26.096900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:26.098453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:26.101719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:26.172894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Attempting to bind port e76cb2bf-a660-4015-b282-3705d7707d77 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:26.173283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Attempting to bind port e76cb2bf-a660-4015-b282-3705d7707d77 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:26.173970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Attempting to bind port e76cb2bf-a660-4015-b282-3705d7707d77 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:26.180216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:26.180603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Checking segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:26.181010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.181403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Bound using segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:26.181885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Bound port: e76cb2bf-a660-4015-b282-3705d7707d77, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:26.182286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.260235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] For port e76cb2bf-a660-4015-b282-3705d7707d77, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:26.263814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] For port e76cb2bf-a660-4015-b282-3705d7707d77, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e76cb2bf-a660-4015-b282-3705d7707d77,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:26.330505 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.364480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.388975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.424284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34f76f2-5381-4a18-b41d-b6095498ecd7 None None] Pushing event updated for resources: {'Port': ['ID=e76cb2bf-a660-4015-b282-3705d7707d77,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:26.562966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Allocated IP 172.25.5.3 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/0d5c7ebe-dc41-41e7-b8b6-33a474569859) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:26.722432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.818453 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:26.862450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:26.865553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:26.868901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:26.875051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Pushing event updated for resources: {'Port': ['ID=0d5c7ebe-dc41-41e7-b8b6-33a474569859,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:27.393698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:27.611715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-febd1f82-7016-4107-a01b-8d8379e54f88 None None] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:42:27.665042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:27.753979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e76cb2bf-a660-4015-b282-3705d7707d77 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:27.791637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b8ad0146-ae9b-4424-8393-f25bddd0af4d None None] Provisioning complete for port e76cb2bf-a660-4015-b282-3705d7707d77 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:27.792212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8ad0146-ae9b-4424-8393-f25bddd0af4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:27.950480 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8ad0146-ae9b-4424-8393-f25bddd0af4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:27.953548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e76cb2bf-a660-4015-b282-3705d7707d77 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:27.953916 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:27.979077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Router 138198e8-cb21-4974-9773-632cfe7c78d0 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:42:28.039686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b8ad0146-ae9b-4424-8393-f25bddd0af4d None None] For port e76cb2bf-a660-4015-b282-3705d7707d77, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e76cb2bf-a660-4015-b282-3705d7707d77,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:28.102051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8ad0146-ae9b-4424-8393-f25bddd0af4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.146541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.171576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:42:28.185742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:42:28.188556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ad0146-ae9b-4424-8393-f25bddd0af4d None None] Pushing event updated for resources: {'Port': ['ID=e76cb2bf-a660-4015-b282-3705d7707d77,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:28.200390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:28.202022 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:28.274804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:42:28.275302 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:42:28.276589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6727a71c-762c-4b02-83ac-b9a7d2b871f4 None None] Provisioning complete for port e76cb2bf-a660-4015-b282-3705d7707d77 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:28.277016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6727a71c-762c-4b02-83ac-b9a7d2b871f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.278698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.283782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ae0163ef-ab92-4833-a4df-1bb63bc9ca17 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 934 time: 2.7269948 Dec 21 03:42:28.284649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38988) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:28.402219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38996) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:28.459425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:28.741061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:26Z', 'revision_number': 3, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:28.750672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cad0cbc-b531-4f09-a0c6-4c6a7270be42 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.802487 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:42:28.806396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Updating router 138198e8-cb21-4974-9773-632cfe7c78d0 port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:42:28.868429 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.893797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cad0cbc-b531-4f09-a0c6-4c6a7270be42 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.956234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cad0cbc-b531-4f09-a0c6-4c6a7270be42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:28.998381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6cad0cbc-b531-4f09-a0c6-4c6a7270be42 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1d5276584df94863bc24d2c4b085e05d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5948825 Dec 21 03:42:29.005891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39042) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:29.055529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cad0cbc-b531-4f09-a0c6-4c6a7270be42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e8f848d-2598-45ad-8ed0-32e2a25c84db,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:29.079509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.110381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10225b89-bf95-410d-a3be-bdf7d467bd62 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.148119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10225b89-bf95-410d-a3be-bdf7d467bd62 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.281470 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.283826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10225b89-bf95-410d-a3be-bdf7d467bd62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.287035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10225b89-bf95-410d-a3be-bdf7d467bd62 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.290865 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10225b89-bf95-410d-a3be-bdf7d467bd62 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8e8f848d-2598-45ad-8ed0-32e2a25c84db HTTP/1.1" status: 204 len: 168 time: 0.2812417 Dec 21 03:42:29.297206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10225b89-bf95-410d-a3be-bdf7d467bd62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e8f848d-2598-45ad-8ed0-32e2a25c84db,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:29.356995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Allocated IP 172.20.0.1 (97e3dbcb-7ac2-4207-82ae-df7e1df411c2/8ca201b9-7506-4b6b-8a03-05d4689a5e59/6db4167b-38cd-4236-9f39-55706e3db79a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:29.381356 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.483854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.484040 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Attempting to bind port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:29.484237 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Attempting to bind port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:29.484773 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Attempting to bind port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:29.493164 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:29.493543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:29.493937 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.494353 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:29.494808 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Bound port: 0d5c7ebe-dc41-41e7-b8b6-33a474569859, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:29.495642 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.523186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Pushing event updated for resources: {'Port': ['ID=0d5c7ebe-dc41-41e7-b8b6-33a474569859,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:29.534020 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.534369 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.534713 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.535080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.535572 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.536064 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.536531 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.536994 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.537456 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.537918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.538390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.539053 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.539576 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Tracked resource versions report: Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: pushed versions: Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: { 'AddressGroup': {'1.2'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'ConntrackHelper': {'1.0'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'LocalIPAssociation': {'1.0'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Log': {'1.0'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Network': {'1.1'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Port': {'1.7'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'PortForwarding': {'1.2'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'QosPolicy': {'1.10'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'SecurityGroup': {'1.5'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'SecurityGroupRule': {'1.2'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'SubPort': {'1.0'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Subnet': {'1.1'}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Trunk': {'1.1'}} Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: consumer versions: Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: { DHCP agent@n-d-822053-11: {}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: HyperV agent@n-h1-822053-11: {}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: HyperV agent@n-h2-822053-11: {}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: L3 agent@n-d-822053-11: {}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: Metadata agent@n-d-822053-11: {}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: Metering agent@n-d-822053-11: {}, Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: Open vSwitch agent@n-d-822053-11: { 'AddressGroup': '1.2', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'ConntrackHelper': '1.0', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'LocalIPAssociation': '1.0', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Log': '1.0', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Network': '1.1', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Port': '1.7', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'PortForwarding': '1.2', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'QosPolicy': '1.10', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'SecurityGroup': '1.5', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'SecurityGroupRule': '1.2', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'SubPort': '1.0', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Subnet': '1.1', Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: 'Trunk': '1.1'}} Dec 21 03:42:29.541537 n-d-822053-11 neutron-server[110313]: {{(pid=110313) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 21 03:42:29.570433 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] For port 0d5c7ebe-dc41-41e7-b8b6-33a474569859, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:29.574759 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] For port 0d5c7ebe-dc41-41e7-b8b6-33a474569859, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0d5c7ebe-dc41-41e7-b8b6-33a474569859,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:29.588722 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.654091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Pushing event updated for resources: {'Port': ['ID=6db4167b-38cd-4236-9f39-55706e3db79a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:29.657729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:29.659717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:29.662169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:29.662914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.678903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e76cb2bf-a660-4015-b282-3705d7707d77 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:29.695043 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.704921 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:42:29.758843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e76cb2bf-a660-4015-b282-3705d7707d77 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:29.759257 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:29.822357 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:29.826924 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:29.871638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39104) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:29.939353 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f235d29c-735e-4979-85b1-5f4bffc36297 None None] Pushing event updated for resources: {'Port': ['ID=0d5c7ebe-dc41-41e7-b8b6-33a474569859,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:30.014102 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:30.063104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0800e73b-c37e-4b58-afbc-0f69ebca525d None None] Provisioning complete for port 6db4167b-38cd-4236-9f39-55706e3db79a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:30.063470 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0800e73b-c37e-4b58-afbc-0f69ebca525d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.078551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.109140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0800e73b-c37e-4b58-afbc-0f69ebca525d None None] Port 6db4167b-38cd-4236-9f39-55706e3db79a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:30.249654 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:26Z', 'revision_number': 3, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:30.274662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.278414 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5e36c8f-146d-4d66-8ad6-64505783bd54 None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:26Z', 'revision_number': 3, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:42:30.363736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.364473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.477830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b6dc766-362b-436b-9563-4603e78660bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.542118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Pushing event updated for resources: {'Port': ['ID=6db4167b-38cd-4236-9f39-55706e3db79a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:30.575320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:30.654305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40df2ebf-5262-483b-af5d-a8073198142d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.663727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b6dc766-362b-436b-9563-4603e78660bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.699225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39126) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:30.722024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:30.723773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b6dc766-362b-436b-9563-4603e78660bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.727477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:30.800792 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b6dc766-362b-436b-9563-4603e78660bd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=94da2591851e4befb323b3d6a0dec40c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9268880 Dec 21 03:42:30.803533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b6dc766-362b-436b-9563-4603e78660bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4069635-40c5-4d17-93f5-2641f7596faf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:30.805120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39132) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:30.896974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40df2ebf-5262-483b-af5d-a8073198142d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.950372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b999612c-2d89-4279-a36e-6abeca1b88e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.969155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40df2ebf-5262-483b-af5d-a8073198142d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:30.987808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Router 138198e8-cb21-4974-9773-632cfe7c78d0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:42:31.011662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b999612c-2d89-4279-a36e-6abeca1b88e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.052928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-40df2ebf-5262-483b-af5d-a8073198142d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=fd5e84c690d74571a3dec00db99e9bca&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4218838 Dec 21 03:42:31.055950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:31.076086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40df2ebf-5262-483b-af5d-a8073198142d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fa164f0-004f-4267-9779-56cfcc92b532,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:31.140999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9d9a6701-cc09-46db-8079-2a0fc8b01f0f None None] Provisioning complete for port 6db4167b-38cd-4236-9f39-55706e3db79a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:31.142020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9d9a6701-cc09-46db-8079-2a0fc8b01f0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.148145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d23dd0e-cf0d-45de-b8f1-b649caf50924 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.172180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d23dd0e-cf0d-45de-b8f1-b649caf50924 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.185462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9d9a6701-cc09-46db-8079-2a0fc8b01f0f None None] Port 6db4167b-38cd-4236-9f39-55706e3db79a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:31.242111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:42:31.250971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96fc8fa-0cea-47fd-95e8-47b5fc7347b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.275226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8a593b6e-0deb-46c5-bdfe-f5cc867afeb6 admin admin] 10.222.0.18 "PUT /v2.0/routers/138198e8-cb21-4974-9773-632cfe7c78d0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9804485 Dec 21 03:42:31.356062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d23dd0e-cf0d-45de-b8f1-b649caf50924 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.358832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d23dd0e-cf0d-45de-b8f1-b649caf50924 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.362739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d23dd0e-cf0d-45de-b8f1-b649caf50924 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2fa164f0-004f-4267-9779-56cfcc92b532 HTTP/1.1" status: 204 len: 168 time: 0.3028924 Dec 21 03:42:31.369925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d23dd0e-cf0d-45de-b8f1-b649caf50924 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fa164f0-004f-4267-9779-56cfcc92b532,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:31.385573 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b999612c-2d89-4279-a36e-6abeca1b88e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.398353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b999612c-2d89-4279-a36e-6abeca1b88e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.400090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b999612c-2d89-4279-a36e-6abeca1b88e9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d4069635-40c5-4d17-93f5-2641f7596faf HTTP/1.1" status: 204 len: 168 time: 0.5940418 Dec 21 03:42:31.418146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b999612c-2d89-4279-a36e-6abeca1b88e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4069635-40c5-4d17-93f5-2641f7596faf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:31.498114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96fc8fa-0cea-47fd-95e8-47b5fc7347b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.586029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96fc8fa-0cea-47fd-95e8-47b5fc7347b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.651559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e96fc8fa-0cea-47fd-95e8-47b5fc7347b1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=abcfa37d2e984c07be9bf583e58f61a5&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9498966 Dec 21 03:42:31.652732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96fc8fa-0cea-47fd-95e8-47b5fc7347b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7b6208a-230b-4a6c-a1af-fff2385a0856,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:31.654291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39180) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:31.657775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0d5c7ebe-dc41-41e7-b8b6-33a474569859 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:31.709428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157d2174-d2aa-4284-9f8a-5bbb9b30f5cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.722194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:31.722575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.733223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157d2174-d2aa-4284-9f8a-5bbb9b30f5cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.812985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.838023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 0d5c7ebe-dc41-41e7-b8b6-33a474569859, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0d5c7ebe-dc41-41e7-b8b6-33a474569859,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:31.854835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157d2174-d2aa-4284-9f8a-5bbb9b30f5cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.857373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157d2174-d2aa-4284-9f8a-5bbb9b30f5cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.858518 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-157d2174-d2aa-4284-9f8a-5bbb9b30f5cf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d7b6208a-230b-4a6c-a1af-fff2385a0856 HTTP/1.1" status: 204 len: 168 time: 0.2025776 Dec 21 03:42:31.869989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157d2174-d2aa-4284-9f8a-5bbb9b30f5cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7b6208a-230b-4a6c-a1af-fff2385a0856,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:31.916864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:31.976287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=0d5c7ebe-dc41-41e7-b8b6-33a474569859,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:32.217026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:42:32.227790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:32.228400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:32.402081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:32.415940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c7e07e2-5839-4603-9ed9-a1256a51e879 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.449493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:32.505980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c7e07e2-5839-4603-9ed9-a1256a51e879 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.598562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c7e07e2-5839-4603-9ed9-a1256a51e879 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.651528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0c7e07e2-5839-4603-9ed9-a1256a51e879 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e1e9b4cafc8d4904a2d967bc68da409d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2480218 Dec 21 03:42:32.653973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7e07e2-5839-4603-9ed9-a1256a51e879 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07cc5e5f-571b-4eb2-9732-e4df759d2366,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:32.654730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39222) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:32.696400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:30Z', 'revision_number': 2, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:32.724255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:42:32.724627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Updating router 138198e8-cb21-4974-9773-632cfe7c78d0 port 6db4167b-38cd-4236-9f39-55706e3db79a binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:42:32.728087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43512e69-bd2d-4bfb-90c0-ec68864cd54b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.751285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.752090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43512e69-bd2d-4bfb-90c0-ec68864cd54b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.805644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39224) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:32.824703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8142f20-3cc5-48bf-8570-eb4a812feed0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.862680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43512e69-bd2d-4bfb-90c0-ec68864cd54b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.865925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43512e69-bd2d-4bfb-90c0-ec68864cd54b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:32.870370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-43512e69-bd2d-4bfb-90c0-ec68864cd54b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/07cc5e5f-571b-4eb2-9732-e4df759d2366 HTTP/1.1" status: 204 len: 168 time: 0.2121062 Dec 21 03:42:32.877423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43512e69-bd2d-4bfb-90c0-ec68864cd54b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07cc5e5f-571b-4eb2-9732-e4df759d2366,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:32.955454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8142f20-3cc5-48bf-8570-eb4a812feed0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.018265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8142f20-3cc5-48bf-8570-eb4a812feed0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.073709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b8142f20-3cc5-48bf-8570-eb4a812feed0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=85983c7b3fb74f46bc7583254597af2d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2645459 Dec 21 03:42:33.073998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39246) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:33.084277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8142f20-3cc5-48bf-8570-eb4a812feed0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=511401df-add7-405e-b2e1-aa31cd141879,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:33.090265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.135350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90775c86-40a2-4ec8-be93-a3a1ca662524 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.165072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90775c86-40a2-4ec8-be93-a3a1ca662524 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.170198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.240619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc26fae-1c37-43a1-bea1-964520c25ad5 None None] Pushing event updated for resources: {'Port': ['ID=6db4167b-38cd-4236-9f39-55706e3db79a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:33.304259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Attempting to bind port 6db4167b-38cd-4236-9f39-55706e3db79a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:33.304633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Attempting to bind port 6db4167b-38cd-4236-9f39-55706e3db79a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:33.304995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Attempting to bind port 6db4167b-38cd-4236-9f39-55706e3db79a on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:33.311277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:33.311658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Checking segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:33.312059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.312449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Bound using segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:33.313122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Bound port: 6db4167b-38cd-4236-9f39-55706e3db79a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:33.313727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.361305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90775c86-40a2-4ec8-be93-a3a1ca662524 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.364300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90775c86-40a2-4ec8-be93-a3a1ca662524 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.367528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90775c86-40a2-4ec8-be93-a3a1ca662524 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/511401df-add7-405e-b2e1-aa31cd141879 HTTP/1.1" status: 204 len: 168 time: 0.2925630 Dec 21 03:42:33.388243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90775c86-40a2-4ec8-be93-a3a1ca662524 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=511401df-add7-405e-b2e1-aa31cd141879,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:33.391950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] For port 6db4167b-38cd-4236-9f39-55706e3db79a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:33.396988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] For port 6db4167b-38cd-4236-9f39-55706e3db79a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6db4167b-38cd-4236-9f39-55706e3db79a,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:33.464732 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.515872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:33.516399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:33.600664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39276) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:33.606327 n-d-822053-11 neutron-server[110310]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 21 03:42:33.607067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc26fae-1c37-43a1-bea1-964520c25ad5 None None] Pushing event updated for resources: {'Port': ['ID=6db4167b-38cd-4236-9f39-55706e3db79a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:33.661526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1e6a1948-d29a-4841-9c92-abfd60156f97 None None] Provisioning complete for port 6db4167b-38cd-4236-9f39-55706e3db79a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:33.661993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e6a1948-d29a-4841-9c92-abfd60156f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.687051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-1f44fe5a-2dd6-4939-8ef1-d6a867778e6b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=f877f9c747b149198ac1b9cf3f6528bc&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0806034 Dec 21 03:42:33.708643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0d5c7ebe-dc41-41e7-b8b6-33a474569859 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:33.790648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:33.885378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-dfe9b583-edbc-4582-aca7-7843bd44978d tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:33.891954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-dfe9b583-edbc-4582-aca7-7843bd44978d tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1980309 Dec 21 03:42:33.916499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-0ba5b34f-6784-41a3-a09f-70b5da4a9b75 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/quotas/f877f9c747b149198ac1b9cf3f6528bc HTTP/1.1" status: 200 len: 375 time: 0.0151691 Dec 21 03:42:33.962667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:33.963071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.968604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:33.969116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e6a1948-d29a-4841-9c92-abfd60156f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:33.976456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Request body: {'network': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-network', 'tenant_id': '0432748fee1345f888406a94a41fcadb'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:33.996943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-b97743dd-614c-4bc3-aa82-107501cfbc25 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f877f9c747b149198ac1b9cf3f6528bc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0734463 Dec 21 03:42:34.106551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Made reservation on behalf of 0432748fee1345f888406a94a41fcadb for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:34.109141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.113200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1e6a1948-d29a-4841-9c92-abfd60156f97 None None] For port 6db4167b-38cd-4236-9f39-55706e3db79a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6db4167b-38cd-4236-9f39-55706e3db79a,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:34.125400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.212710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e6a1948-d29a-4841-9c92-abfd60156f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.241141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:33Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:34.268706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.288661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66f21759-0d64-416b-90c9-accad4eb91ff None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:33Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:42:34.310499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6a1948-d29a-4841-9c92-abfd60156f97 None None] Pushing event updated for resources: {'Port': ['ID=6db4167b-38cd-4236-9f39-55706e3db79a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:34.340431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.400357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e818bb4b-a2f8-4e8f-9661-726c0fa4d636 None None] Provisioning complete for port 6db4167b-38cd-4236-9f39-55706e3db79a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:34.400814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e818bb4b-a2f8-4e8f-9661-726c0fa4d636 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.403807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:42:34.512056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-888b5d71-0bce-44b9-8627-4c09735e47f9 req-7efd7718-9566-4ef7-82a9-b35a1aa20212 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.1279056 Dec 21 03:42:34.533559 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8762542825939', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.535609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Unsubscribe: segment precommit_create {{(pid=110311) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 21 03:42:34.536553 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Added segment 98b0f2d4-acea-405d-b169-baa382d740ef of type vlan for network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 Dec 21 03:42:34.663080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.667989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b22c54b-4e89-40ca-b64c-3f1457ee3fce,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:34.770213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:34.771480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:34.772501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:35.003517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.0331850 Dec 21 03:42:35.007188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39364) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:35.012208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Request body: {'subnet': {'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-subnet', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:35.016510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f880cb13-ed6e-4887-968b-0b18cdc9bed0 admin admin] Pushing event updated for resources: {'Network': ['ID=8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:35.029713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:42:35.178137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Made reservation on behalf of 0432748fee1345f888406a94a41fcadb for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:35.184644 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:35.550434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:35.618815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5a8480b0-ced1-4eac-af2b-b002cf1f0d61,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:35.633012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Checking segment: {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:35.637003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Network hostable DHCP agents. Network: 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:42:35.745200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db4167b-38cd-4236-9f39-55706e3db79a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:35.797219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:42:35.816381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6db4167b-38cd-4236-9f39-55706e3db79a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:35.816875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:35.828311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:35.886714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:35.891134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:35.891769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:35.900228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02bf8d2e-77b5-4755-a7ad-fbe6ad55076c None None] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:42:35.994748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39432) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:36.000747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-559008cd-8467-4ac6-9066-dbc87f0cf5a5 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 0.9899395 Dec 21 03:42:36.002875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39434) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:36.011220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Request body: {'router': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:36.059158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96', 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96', 'project_id': '0432748fee1345f888406a94a41fcadb', 'fixed_ips': [{'subnet_id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:42:36.060103 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.127621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.129243 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.204728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Allocated IP 172.20.0.2 (8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96/5a8480b0-ced1-4eac-af2b-b002cf1f0d61/23bf4bf5-111b-445b-8459-db2a55bcc55b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:36.243922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-network', 'tenant_id': 'd3c7911e116e4170812afec94091929a'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:36.257953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.394409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Made reservation on behalf of d3c7911e116e4170812afec94091929a for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:36.397825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.423301 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.446995 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.482569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b02d548-3f26-4d7d-918c-599be2d671a2 req-71aca11b-91a1-45d9-b1a7-08f5f67b708d tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.4818115 Dec 21 03:42:36.527547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.565628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.593528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.633238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:36.638967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:36.641143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Pushing event updated for resources: {'Port': ['ID=23bf4bf5-111b-445b-8459-db2a55bcc55b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:36.643978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:36.671674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.686507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:42:36.696299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.696639 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Added segment 615ceb9a-cc82-4e2a-8669-b83fa9d4dd24 of type vlan for network be2315d6-c735-4ecb-b299-a3b1405aa378 Dec 21 03:42:36.717380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Attempting to bind port 23bf4bf5-111b-445b-8459-db2a55bcc55b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:36.717757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Attempting to bind port 23bf4bf5-111b-445b-8459-db2a55bcc55b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:36.718117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Attempting to bind port 23bf4bf5-111b-445b-8459-db2a55bcc55b on network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:36.724070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:36.724444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Checking segment: {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:36.724839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.725229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Bound using segment: {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:36.726231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Bound port: 23bf4bf5-111b-445b-8459-db2a55bcc55b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:36.726962 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.784326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.832550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40e14095-76ef-4df5-a8c5-063f87511c10,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:36.856268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] For port 23bf4bf5-111b-445b-8459-db2a55bcc55b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:36.859773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] For port 23bf4bf5-111b-445b-8459-db2a55bcc55b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=23bf4bf5-111b-445b-8459-db2a55bcc55b,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:36.934359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.935430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:36.936044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.993362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:36.993851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] Pushing event updated for resources: {'Network': ['ID=be2315d6-c735-4ecb-b299-a3b1405aa378,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:37.009229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network be2315d6-c735-4ecb-b299-a3b1405aa378 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:42:37.023433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c30ba202-e794-42f1-a9f9-f2daf3f766dd admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 1.1937850 Dec 21 03:42:37.029520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39476) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:37.036241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Request body: {'subnet': {'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-subnet', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:37.041226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.077325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.140705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c928e7-7ba7-4909-a1e5-cfe25d6b767e None None] Pushing event updated for resources: {'Port': ['ID=23bf4bf5-111b-445b-8459-db2a55bcc55b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:37.156695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Made reservation on behalf of d3c7911e116e4170812afec94091929a for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:37.161081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.285023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Allocated IP 172.25.5.154 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/9d92d017-b049-4dba-8eef-81a84567d3c0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:37.509760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a59f0d5a-fe53-4026-b92d-8f06d3def4d9 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=dc54f4797de4426ba52a3489b5990c5e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0391705 Dec 21 03:42:37.527771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39496) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:37.547987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.570685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.702577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8f347100-a6ac-44b8-b4d2-4439cc3e6889,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:37.707801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Checking segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:37.708157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Network hostable DHCP agents. Network: be2315d6-c735-4ecb-b299-a3b1405aa378, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:42:37.718953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-edf878e0-5905-4389-baf4-1365c53668fd tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:37.727112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-edf878e0-5905-4389-baf4-1365c53668fd tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2155085 Dec 21 03:42:37.748289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 23bf4bf5-111b-445b-8459-db2a55bcc55b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:37.752665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-8e2a5ac5-22ec-4bd1-bbaa-b129176adc3e tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/quotas/dc54f4797de4426ba52a3489b5990c5e HTTP/1.1" status: 200 len: 375 time: 0.0246644 Dec 21 03:42:37.780633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.892991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 23bf4bf5-111b-445b-8459-db2a55bcc55b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:37.894867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:37.921557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-41dbb168-a37f-4348-94e6-f7060c1baba4 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=dc54f4797de4426ba52a3489b5990c5e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1605794 Dec 21 03:42:37.930360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Network be2315d6-c735-4ecb-b299-a3b1405aa378 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:42:37.947776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:37.951316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8e13f9e-b7f1-48ca-a950-27b97d8101d6 req-68bdf3f3-8a37-43a6-b9fb-eb746617bd99 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.0286593 Dec 21 03:42:37.965023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:37.973985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:37.985779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebb867ac-eadb-4be0-9b13-d05bbfd31240 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.014178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, be2315d6-c735-4ecb-b299-a3b1405aa378) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:38.019745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:38.020574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.036089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37f74bfd-bc8a-426d-8bc2-088d5aac73dd None None] Network be2315d6-c735-4ecb-b299-a3b1405aa378 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:42:38.095953 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.115397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-083fa13a-c940-4f6f-a734-2baf0614c072 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.0842690 Dec 21 03:42:38.118111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39512) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:38.123331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:38.205110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 23bf4bf5-111b-445b-8459-db2a55bcc55b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=23bf4bf5-111b-445b-8459-db2a55bcc55b,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:38.236868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Pushing event updated for resources: {'Port': ['ID=9d92d017-b049-4dba-8eef-81a84567d3c0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:38.245793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.246924 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.276904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.381435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-601cf317-a303-4b2e-a8d8-fe5253a3a71f req-0a5d8caa-c4ee-49d3-9d98-24141316cf6e tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 210 time: 0.0958147 Dec 21 03:42:38.445571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=23bf4bf5-111b-445b-8459-db2a55bcc55b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:38.470801 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.476635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-be2315d6-c735-4ecb-b299-a3b1405aa378', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:42:38.477592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.540245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebb867ac-eadb-4be0-9b13-d05bbfd31240 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.653372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.54', 58365) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:38.671870 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebb867ac-eadb-4be0-9b13-d05bbfd31240 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.708763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37fb8d0d-d538-411d-9ad5-3ec01a6fe03b None None] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:42:38.744169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-dfa9f0fe-3632-4d21-a517-c535c2ec4751 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=f877f9c747b149198ac1b9cf3f6528bc&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0880065 Dec 21 03:42:38.784700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3b1b4efb-fb6b-4133-9460-e26bb195f3e6 None None] Provisioning complete for port 23bf4bf5-111b-445b-8459-db2a55bcc55b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:38.785271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b1b4efb-fb6b-4133-9460-e26bb195f3e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.848322 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.881239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Allocated IP 172.20.0.2 (be2315d6-c735-4ecb-b299-a3b1405aa378/8f347100-a6ac-44b8-b4d2-4439cc3e6889/000d5819-ddfc-432d-9f39-d6627ebcbc60) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:38.906881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:38.980650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-9d328757-5f83-46e6-9a72-dd14ad2b5a0b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:38.982277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-9d328757-5f83-46e6-9a72-dd14ad2b5a0b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1490006 Dec 21 03:42:39.148329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39556) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:39.168136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ebb867ac-eadb-4be0-9b13-d05bbfd31240 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=442fd181e40a4af39f5ebc079ac1bf55&name=default HTTP/1.1" status: 200 len: 2995 time: 1.6392531 Dec 21 03:42:39.171076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb867ac-eadb-4be0-9b13-d05bbfd31240 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=114bec86-8cbe-461d-9a58-1d59a16462ba,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:39.177020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39560) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:39.231976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Request body: {'port': {'device_id': '4bf004a2-2597-405c-961a-417297bcb4bc', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'f877f9c747b149198ac1b9cf3f6528bc'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:39.256126 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.309942 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.335974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cce49828-3e20-4401-bf59-94f674528166 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.375178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.451267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cce49828-3e20-4401-bf59-94f674528166 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.495831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd94b16f-92ff-4f66-9b7d-43f6b86b988e req-27098522-0e57-419b-9c24-42fdf46017fb tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.2749376 Dec 21 03:42:39.497332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Network be2315d6-c735-4ecb-b299-a3b1405aa378 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:39.505382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:39.520815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Pushing event updated for resources: {'Port': ['ID=000d5819-ddfc-432d-9f39-d6627ebcbc60,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:39.523173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:39.546753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-42722df2-7a9c-434d-87b9-004cee60e687 None None] Provisioning complete for port 23bf4bf5-111b-445b-8459-db2a55bcc55b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:39.547154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-42722df2-7a9c-434d-87b9-004cee60e687 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.567791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ac189f6-1945-466d-9af3-873bf5f3bd98 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.571115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39574) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:39.649518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18c016aa-cce4-4a06-8c94-3d9c54626728 req-e3d48edb-d017-47e1-88c3-2f9e995d1c70 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 210 time: 0.1525657 Dec 21 03:42:39.709564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Attempting to bind port 000d5819-ddfc-432d-9f39-d6627ebcbc60 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:39.709951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Attempting to bind port 000d5819-ddfc-432d-9f39-d6627ebcbc60 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:39.710319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Attempting to bind port 000d5819-ddfc-432d-9f39-d6627ebcbc60 on network be2315d6-c735-4ecb-b299-a3b1405aa378 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:39.713860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 23bf4bf5-111b-445b-8459-db2a55bcc55b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:39.718885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.755573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cce49828-3e20-4401-bf59-94f674528166 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.758353 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cce49828-3e20-4401-bf59-94f674528166 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.760638 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cce49828-3e20-4401-bf59-94f674528166 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/114bec86-8cbe-461d-9a58-1d59a16462ba HTTP/1.1" status: 204 len: 168 time: 0.5752478 Dec 21 03:42:39.764124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.788735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:39.789126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Checking segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:39.789580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.790149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Bound using segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:39.791069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Bound port: 000d5819-ddfc-432d-9f39-d6627ebcbc60, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:39.791336 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.794703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 23bf4bf5-111b-445b-8459-db2a55bcc55b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:39.794926 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.797364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Router 02bebca8-a642-41be-a94c-12fbc201788d is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:42:39.803421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce49828-3e20-4401-bf59-94f674528166 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=114bec86-8cbe-461d-9a58-1d59a16462ba,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:39.889356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Made reservation on behalf of f877f9c747b149198ac1b9cf3f6528bc for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:39.894034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.909121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.928640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84a3c4f-77a1-4f68-9572-35e371219cf9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:39.958725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Allocated IP 172.25.5.76 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/69582d3a-accd-497a-809a-ae3ddf602b75) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:40.044267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ac189f6-1945-466d-9af3-873bf5f3bd98 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.074035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:42:40.090910 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Sync routers for ids ['02bebca8-a642-41be-a94c-12fbc201788d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:42:40.105784 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Routers {'02bebca8-a642-41be-a94c-12fbc201788d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:40.106404 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['02bebca8-a642-41be-a94c-12fbc201788d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:40.109346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ac189f6-1945-466d-9af3-873bf5f3bd98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.133755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.134351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84a3c4f-77a1-4f68-9572-35e371219cf9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.143910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.158794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac189f6-1945-466d-9af3-873bf5f3bd98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61d11751-524b-49df-9a87-bd34b8403e23,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:40.177276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ac189f6-1945-466d-9af3-873bf5f3bd98 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=034406f913c24396b0540677c5f8e535&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0211473 Dec 21 03:42:40.177491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:40.224757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] For port 000d5819-ddfc-432d-9f39-d6627ebcbc60, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:40.231011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.232502 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-646b1e0f-b04d-49f4-9e81-a35dc3834c33 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 936 time: 4.2285047 Dec 21 03:42:40.235584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39604) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:40.257020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84a3c4f-77a1-4f68-9572-35e371219cf9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.262593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] For port 000d5819-ddfc-432d-9f39-d6627ebcbc60, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=000d5819-ddfc-432d-9f39-d6627ebcbc60,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:40.299926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84a3c4f-77a1-4f68-9572-35e371219cf9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac7531af-34c9-4e31-a130-2bfa26439c22,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:40.303107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9e9246-1c72-49c6-8ac5-cfc7f494d6ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.331004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.335083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e84a3c4f-77a1-4f68-9572-35e371219cf9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5be5cbdd0c0a4898a364aa3f584f7916&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7603571 Dec 21 03:42:40.340271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39608) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:40.345289 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.357000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Set router 02bebca8-a642-41be-a94c-12fbc201788d gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:40.375517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9e9246-1c72-49c6-8ac5-cfc7f494d6ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.423878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.426664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77cc3caa-2542-4274-8314-9c63d3caa412 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.450833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77cc3caa-2542-4274-8314-9c63d3caa412 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.474963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c50cb848-6b79-4121-a836-5ff330e479c2 None None] Pushing event updated for resources: {'Port': ['ID=000d5819-ddfc-432d-9f39-d6627ebcbc60,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:40.490193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Pushing event updated for resources: {'SecurityGroup': ['ID=96f618ad-8507-4bab-a069-bd6e46faf322,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:40.564162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:40.570069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9e9246-1c72-49c6-8ac5-cfc7f494d6ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.571908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9e9246-1c72-49c6-8ac5-cfc7f494d6ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.575682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c9e9246-1c72-49c6-8ac5-cfc7f494d6ed admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/61d11751-524b-49df-9a87-bd34b8403e23 HTTP/1.1" status: 204 len: 168 time: 0.3945994 Dec 21 03:42:40.582596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:40.588158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:40.594234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9e9246-1c72-49c6-8ac5-cfc7f494d6ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61d11751-524b-49df-9a87-bd34b8403e23,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:40.632816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77cc3caa-2542-4274-8314-9c63d3caa412 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.636500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77cc3caa-2542-4274-8314-9c63d3caa412 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:40.637891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77cc3caa-2542-4274-8314-9c63d3caa412 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ac7531af-34c9-4e31-a130-2bfa26439c22 HTTP/1.1" status: 204 len: 168 time: 0.2965269 Dec 21 03:42:40.659341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77cc3caa-2542-4274-8314-9c63d3caa412 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac7531af-34c9-4e31-a130-2bfa26439c22,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:40.850968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:42:38Z', 'revision_number': 3, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:40.922205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Checking router: 02bebca8-a642-41be-a94c-12fbc201788d for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:42:40.922879 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Updating router 02bebca8-a642-41be-a94c-12fbc201788d port 9d92d017-b049-4dba-8eef-81a84567d3c0 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:42:40.968474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39624) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:41.006579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b86ed64-56a7-4604-ac58-79f6a9d7b65c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:41.015707 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:41.127980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Pushing event updated for resources: {'Port': ['ID=69582d3a-accd-497a-809a-ae3ddf602b75,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:41.302645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b86ed64-56a7-4604-ac58-79f6a9d7b65c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:41.368296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7735847-d7aa-400d-9758-994a9c18d4d3 req-47e99ec0-2c3f-450d-a071-5311d737a51b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.6135850 Dec 21 03:42:41.393247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9eda9125-38b5-4273-bc17-792614679ca8 req-2c658445-fb34-4d06-83bd-b7c53699e006 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 210 time: 0.2817988 Dec 21 03:42:41.447174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b86ed64-56a7-4604-ac58-79f6a9d7b65c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:41.564273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b86ed64-56a7-4604-ac58-79f6a9d7b65c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ee36072-233a-409b-839d-4b71e2c7f239,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:41.607969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9b86ed64-56a7-4604-ac58-79f6a9d7b65c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=30d23c83329043af9cb03073416921a2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6340966 Dec 21 03:42:41.609050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39628) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:41.804865 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:41.808240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63c29d7b-91e5-4ccc-bf62-ed90dddd8d44 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:41.829920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Allocated IP 192.168.233.67 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/09554808-aec9-4511-ba46-8a6519a51c3a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:41.863374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63c29d7b-91e5-4ccc-bf62-ed90dddd8d44 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.055714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.068750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 000d5819-ddfc-432d-9f39-d6627ebcbc60 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:42.126021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 000d5819-ddfc-432d-9f39-d6627ebcbc60 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:42.126391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.185837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b22da4f-721d-4f8a-adf4-028b36450c49 None None] Network be2315d6-c735-4ecb-b299-a3b1405aa378 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:42:42.200375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39630) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:42.221265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42465579-d119-4682-815d-18e88edc9433 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.288625 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.305786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4ae45bbf-9a58-42a0-8334-8c0837d22939 None None] Provisioning complete for port 000d5819-ddfc-432d-9f39-d6627ebcbc60 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:42.306171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4ae45bbf-9a58-42a0-8334-8c0837d22939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.329232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63c29d7b-91e5-4ccc-bf62-ed90dddd8d44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.334797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63c29d7b-91e5-4ccc-bf62-ed90dddd8d44 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.336062 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-63c29d7b-91e5-4ccc-bf62-ed90dddd8d44 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3ee36072-233a-409b-839d-4b71e2c7f239 HTTP/1.1" status: 204 len: 168 time: 0.7260609 Dec 21 03:42:42.427944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c29d7b-91e5-4ccc-bf62-ed90dddd8d44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ee36072-233a-409b-839d-4b71e2c7f239,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:42.488381 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961f1ee9-10b0-4637-9491-042bb2e577e6 None None] Pushing event updated for resources: {'Port': ['ID=9d92d017-b049-4dba-8eef-81a84567d3c0,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:42.545210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.31', 52055) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:42.562835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.567542 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Attempting to bind port 9d92d017-b049-4dba-8eef-81a84567d3c0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:42.567995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Attempting to bind port 9d92d017-b049-4dba-8eef-81a84567d3c0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:42.568476 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Attempting to bind port 9d92d017-b049-4dba-8eef-81a84567d3c0 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:42.573110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.575212 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:42.575620 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:42.576257 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.576737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:42.577418 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Bound port: 9d92d017-b049-4dba-8eef-81a84567d3c0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:42.578019 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.628372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.629765 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-8cd5ebc3-34e3-4ed4-bd32-533f3ddc4aec tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=dc54f4797de4426ba52a3489b5990c5e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0759990 Dec 21 03:42:42.696806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] For port 9d92d017-b049-4dba-8eef-81a84567d3c0, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:42.708523 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] For port 9d92d017-b049-4dba-8eef-81a84567d3c0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9d92d017-b049-4dba-8eef-81a84567d3c0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:42.759577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0423c342-2b87-4f89-b038-b0a7791e3734 req-fa729236-bd2b-4a00-8ead-c8a6115a23bc tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.2045560 Dec 21 03:42:42.804598 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.810284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 000d5819-ddfc-432d-9f39-d6627ebcbc60, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=000d5819-ddfc-432d-9f39-d6627ebcbc60,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:42.811448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4ae45bbf-9a58-42a0-8334-8c0837d22939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.857561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42465579-d119-4682-815d-18e88edc9433 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.857667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9458edf1-017a-4991-91be-3608738d1552 req-3262da4e-ea3f-4df2-a82a-93acd5b34249 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 210 time: 0.2925334 Dec 21 03:42:42.904557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:42.946695 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Routers {'02bebca8-a642-41be-a94c-12fbc201788d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:42.951138 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['02bebca8-a642-41be-a94c-12fbc201788d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:43.118561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=000d5819-ddfc-432d-9f39-d6627ebcbc60,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:43.119169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39642) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:43.121883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-4ae45bbf-9a58-42a0-8334-8c0837d22939 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:42:43.121883 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-4ae45bbf-9a58-42a0-8334-8c0837d22939 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:42:43.125093 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961f1ee9-10b0-4637-9491-042bb2e577e6 None None] Pushing event updated for resources: {'Port': ['ID=9d92d017-b049-4dba-8eef-81a84567d3c0,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:43.170848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42465579-d119-4682-815d-18e88edc9433 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.214086 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] Set router 02bebca8-a642-41be-a94c-12fbc201788d gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:43.238265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-112cb48b-9a6f-4aa6-aacb-7d7a45d6c0d8 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:43.246667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-112cb48b-9a6f-4aa6-aacb-7d7a45d6c0d8 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.6088073 Dec 21 03:42:43.249812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.266878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42465579-d119-4682-815d-18e88edc9433 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=50b2810de5d743f4aa68326be3885f0a&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0654068 Dec 21 03:42:43.270534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:43.303317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42465579-d119-4682-815d-18e88edc9433 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be9b13c3-0a9e-42dc-9c86-403e844dd446,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:43.323508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0363252c-d844-4a3f-a165-0129d3cf3758 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.401107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5139803a-74dd-45e2-b60c-0ebb6583552d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.405338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.452011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5139803a-74dd-45e2-b60c-0ebb6583552d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.456854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Request body: {'port': {'device_id': '1ae433f7-b449-4490-aa67-080e50be8d75', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'dc54f4797de4426ba52a3489b5990c5e'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:43.606126 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:42:38Z', 'revision_number': 3, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:43.680576 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8718a94-9674-46e4-aab1-3e9b2d0ac66a None None] The sync data for ids ['02bebca8-a642-41be-a94c-12fbc201788d'] in n-d-822053-11 is: [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:42:38Z', 'revision_number': 3, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:42:43.749398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 000d5819-ddfc-432d-9f39-d6627ebcbc60 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:43.810536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5139803a-74dd-45e2-b60c-0ebb6583552d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.816513 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5139803a-74dd-45e2-b60c-0ebb6583552d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.819074 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5139803a-74dd-45e2-b60c-0ebb6583552d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/be9b13c3-0a9e-42dc-9c86-403e844dd446 HTTP/1.1" status: 204 len: 168 time: 0.5432038 Dec 21 03:42:43.859835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5139803a-74dd-45e2-b60c-0ebb6583552d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be9b13c3-0a9e-42dc-9c86-403e844dd446,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:43.891473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Made reservation on behalf of dc54f4797de4426ba52a3489b5990c5e for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:42:43.891473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:43.905111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.006783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Pushing event updated for resources: {'Port': ['ID=09554808-aec9-4511-ba46-8a6519a51c3a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:44.028167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5a71cd77-a6a0-48fb-9119-902a7e1b5585 None None] Provisioning complete for port 000d5819-ddfc-432d-9f39-d6627ebcbc60 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:44.028884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a71cd77-a6a0-48fb-9119-902a7e1b5585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.031367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:44.040396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.050432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:44.075815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:44.098284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 000d5819-ddfc-432d-9f39-d6627ebcbc60 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:44.098448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:44.098545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.099018 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.147977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.526683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc835a6-8b61-4046-8269-3800f2e377c9 req-1034c693-a219-4ca8-958f-2d7278f547a9 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:44.527509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1dc835a6-8b61-4046-8269-3800f2e377c9 req-1034c693-a219-4ca8-958f-2d7278f547a9 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 935 time: 0.5146191 Dec 21 03:42:44.533166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-a24e2c51-8d14-422a-8eb7-52006d91dac3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 5.3101513 Dec 21 03:42:44.549333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1065f1e7-e210-44fc-a634-4f4d9c3b8022,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:44.579676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-d4b1dd57-8af8-4578-b37a-64833665900b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:42:44.583124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-d4b1dd57-8af8-4578-b37a-64833665900b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0338511 Dec 21 03:42:44.628735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5daac721-efcd-4d25-97c8-2eb69e6f9207 None None] Provisioning complete for port 09554808-aec9-4511-ba46-8a6519a51c3a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:44.630169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5daac721-efcd-4d25-97c8-2eb69e6f9207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.652516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0363252c-d844-4a3f-a165-0129d3cf3758 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.714149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70c529f0-8bff-46f4-a813-68820f44e8e6 req-d5573813-de96-495f-9950-c6b4039e4d6b tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 210 time: 0.5746779 Dec 21 03:42:44.714149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Router 96057fa7-9fcd-425e-9649-549b503668e8 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:42:44.761166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5daac721-efcd-4d25-97c8-2eb69e6f9207 None None] Port 09554808-aec9-4511-ba46-8a6519a51c3a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:44.782875 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0363252c-d844-4a3f-a165-0129d3cf3758 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:44.855868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Allocated IP 192.168.233.247 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/07e6b3ff-ea95-40ee-bb57-6dd4050fb305) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:44.879774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Allocated IP 172.20.0.1 (8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96/5a8480b0-ced1-4eac-af2b-b002cf1f0d61/a084ed55-6630-433c-8054-e4311f90873e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:44.911774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1dc835a6-8b61-4046-8269-3800f2e377c9 req-545d4922-ab8b-4fb3-94a1-2733c0ba25a8 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3592043 Dec 21 03:42:45.250211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.272937 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.293282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:45.320844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cdfbc26f-dd87-4940-a9cc-4b40aee47cff admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.321745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0363252c-d844-4a3f-a165-0129d3cf3758 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cefa385b-ae65-49c9-9ee1-8f3e89421c3c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:45.400948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.452247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0363252c-d844-4a3f-a165-0129d3cf3758 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=32d976e2cacf46389bf12d6ed447ad89&name=default HTTP/1.1" status: 200 len: 2996 time: 2.3289945 Dec 21 03:42:45.461784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39690) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:45.546089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:45.560700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:45.583107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:45.589722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:45.590368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.632371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ada84da0-42ac-4f00-9369-571781a4d3d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.647440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Request body: {'port': {'device_id': '4bf004a2-2597-405c-961a-417297bcb4bc', 'device_owner': 'compute:tempest-test_az-2070989439', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:45.647905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Pushing event updated for resources: {'Port': ['ID=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:45.687532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cdfbc26f-dd87-4940-a9cc-4b40aee47cff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.731425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-c010f205-52d9-4ee6-88e2-0366134e7c01 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.2851405 Dec 21 03:42:45.751865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.761171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cdfbc26f-dd87-4940-a9cc-4b40aee47cff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.769028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:45.854715 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cdfbc26f-dd87-4940-a9cc-4b40aee47cff admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4a79068c99124c50990f4f0bcbbf60e3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5669172 Dec 21 03:42:45.891722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39696) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:45.906771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9d92d017-b049-4dba-8eef-81a84567d3c0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:45.920269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:42:45.950652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:45.955966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ada84da0-42ac-4f00-9369-571781a4d3d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.003449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:46.011563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:42:46.100925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:46.103415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:46.120605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935379c4-d01a-42a2-83a2-de6e560f29b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.125426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdfbc26f-dd87-4940-a9cc-4b40aee47cff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80dc4545-e64a-40dc-bb3d-ac712d3d873a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:46.127911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3f378c91-392a-4d8f-8714-92af464bbc61 None None] Provisioning complete for port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:46.128368 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f378c91-392a-4d8f-8714-92af464bbc61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.166275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:46.166595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.188448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935379c4-d01a-42a2-83a2-de6e560f29b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.253196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-935f0a2f-ea16-4d27-b5c0-7b7456aff96f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:42:46.254250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-935f0a2f-ea16-4d27-b5c0-7b7456aff96f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0129702 Dec 21 03:42:46.326772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Pushing event updated for resources: {'Port': ['ID=a084ed55-6630-433c-8054-e4311f90873e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:46.352559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.362037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d7861c8b-04a8-4551-a2b7-ed4905ea1d5d admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 932 time: 8.2427633 Dec 21 03:42:46.364789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39708) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:46.447148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9d92d017-b049-4dba-8eef-81a84567d3c0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:46.447600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.449301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3f378c91-392a-4d8f-8714-92af464bbc61 None None] Port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:46.507858 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935379c4-d01a-42a2-83a2-de6e560f29b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.510575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935379c4-d01a-42a2-83a2-de6e560f29b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:46.514144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-935379c4-d01a-42a2-83a2-de6e560f29b5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/80dc4545-e64a-40dc-bb3d-ac712d3d873a HTTP/1.1" status: 204 len: 168 time: 0.6158748 Dec 21 03:42:46.577326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935379c4-d01a-42a2-83a2-de6e560f29b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80dc4545-e64a-40dc-bb3d-ac712d3d873a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:46.633699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:46.733616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee52b018-8623-4510-82d3-1aa70acf44b7 req-71677ead-4c1e-4f48-b4fc-aae69ba79391 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:46.746024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee52b018-8623-4510-82d3-1aa70acf44b7 req-71677ead-4c1e-4f48-b4fc-aae69ba79391 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 935 time: 0.5718040 Dec 21 03:42:46.837396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b459c348-8219-406b-9838-6066f9b78868 req-b59605c6-fa1f-4e28-a6b4-ac41591fcdf0 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:46.839214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b459c348-8219-406b-9838-6066f9b78868 req-b59605c6-fa1f-4e28-a6b4-ac41591fcdf0 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 936 time: 0.9227798 Dec 21 03:42:46.932604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c24ee690-cc2c-4eb2-b7dc-eec541c22432 None None] Provisioning complete for port a084ed55-6630-433c-8054-e4311f90873e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:46.933129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c24ee690-cc2c-4eb2-b7dc-eec541c22432 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.024781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Request body: {'port': {'device_id': '1ae433f7-b449-4490-aa67-080e50be8d75', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:47.066778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c24ee690-cc2c-4eb2-b7dc-eec541c22432 None None] Port a084ed55-6630-433c-8054-e4311f90873e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:47.098557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.187122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 9d92d017-b049-4dba-8eef-81a84567d3c0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9d92d017-b049-4dba-8eef-81a84567d3c0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:47.193327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.250022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:41Z', 'revision_number': 3, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:47.259699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ada84da0-42ac-4f00-9369-571781a4d3d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.271891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ada84da0-42ac-4f00-9369-571781a4d3d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.278229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ada84da0-42ac-4f00-9369-571781a4d3d3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/cefa385b-ae65-49c9-9ee1-8f3e89421c3c HTTP/1.1" status: 204 len: 168 time: 1.8130639 Dec 21 03:42:47.320314 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.331622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:42:47.332163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Updating router 96057fa7-9fcd-425e-9649-549b503668e8 port 69582d3a-accd-497a-809a-ae3ddf602b75 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:42:47.454139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.545360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada84da0-42ac-4f00-9369-571781a4d3d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cefa385b-ae65-49c9-9ee1-8f3e89421c3c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:47.659128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=9d92d017-b049-4dba-8eef-81a84567d3c0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:47.696580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:47.805209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee52b018-8623-4510-82d3-1aa70acf44b7 req-9b9187cb-2c4a-4e52-94a2-240689da1de3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9271853 Dec 21 03:42:47.886850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b459c348-8219-406b-9838-6066f9b78868 req-88c3f91f-1523-4044-8af8-70f9db3745cf tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8122768 Dec 21 03:42:48.013876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 09554808-aec9-4511-ba46-8a6519a51c3a {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:42:48.026916 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.047020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Transition to ACTIVE for port object 09554808-aec9-4511-ba46-8a6519a51c3a will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:42:48.156966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.215146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.293892 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.294436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.332468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Pushing event updated for resources: {'Port': ['ID=09554808-aec9-4511-ba46-8a6519a51c3a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:48.413299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ad821e-2a6f-44a9-95c0-8c8fed4259c2 None None] Pushing event updated for resources: {'Port': ['ID=69582d3a-accd-497a-809a-ae3ddf602b75,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:48.470134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Attempting to bind port 09554808-aec9-4511-ba46-8a6519a51c3a on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:48.470527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Attempting to bind port 09554808-aec9-4511-ba46-8a6519a51c3a by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:48.470736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Attempting to bind port 09554808-aec9-4511-ba46-8a6519a51c3a on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:48.494557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Attempting to bind port 69582d3a-accd-497a-809a-ae3ddf602b75 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:48.494917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Attempting to bind port 69582d3a-accd-497a-809a-ae3ddf602b75 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:48.495303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Attempting to bind port 69582d3a-accd-497a-809a-ae3ddf602b75 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:48.505861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:48.509655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:48.509655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.509655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:48.509905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Port 09554808-aec9-4511-ba46-8a6519a51c3a on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:42:48.509905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Attempting to bind port 09554808-aec9-4511-ba46-8a6519a51c3a on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:48.510460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Bound port: 69582d3a-accd-497a-809a-ae3ddf602b75, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:48.510726 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.531438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:48.531788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:48.532366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:48.532830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Bound port: 09554808-aec9-4511-ba46-8a6519a51c3a, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:48.533281 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.657646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] For port 69582d3a-accd-497a-809a-ae3ddf602b75, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:48.669871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] For port 69582d3a-accd-497a-809a-ae3ddf602b75, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=69582d3a-accd-497a-809a-ae3ddf602b75,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:48.683280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.738970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] For port 09554808-aec9-4511-ba46-8a6519a51c3a, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:48.744375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] For port 09554808-aec9-4511-ba46-8a6519a51c3a, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=09554808-aec9-4511-ba46-8a6519a51c3a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:48.746537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.791684 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.792476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.850714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:42:48.852571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ad821e-2a6f-44a9-95c0-8c8fed4259c2 None None] Pushing event updated for resources: {'Port': ['ID=69582d3a-accd-497a-809a-ae3ddf602b75,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:48.875448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.887757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:48.921413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:48.922213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:48.950080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Transition to ACTIVE for port object 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:42:48.960040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Allocated IP 172.20.0.1 (be2315d6-c735-4ecb-b299-a3b1405aa378/8f347100-a6ac-44b8-b4d2-4439cc3e6889/7f63ca03-ada3-4c58-babe-357dcf805077) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:42:49.173548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:49.234907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.267345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.395339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Pushing event updated for resources: {'Port': ['ID=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:49.401730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Pushing event updated for resources: {'Port': ['ID=a084ed55-6630-433c-8054-e4311f90873e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:49.502160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:49.504482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.504597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] 10.222.0.54 "PUT /v2.0/ports/09554808-aec9-4511-ba46-8a6519a51c3a HTTP/1.1" status: 200 len: 1118 time: 4.1918938 Dec 21 03:42:49.511152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4bf004a2-2597-405c-961a-417297bcb4bc', 'tag': '09554808-aec9-4511-ba46-8a6519a51c3a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:42:49.594194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Attempting to bind port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:49.594565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Attempting to bind port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:49.594894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Attempting to bind port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:49.605920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:42:49.606532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Attempting to bind port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:49.616542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:49.618591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:49.620589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:49.621185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Bound port: 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:49.625659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.642956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.768483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9d92d017-b049-4dba-8eef-81a84567d3c0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:49.837789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Network be2315d6-c735-4ecb-b299-a3b1405aa378 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:49.845196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:49.849937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Pushing event updated for resources: {'Port': ['ID=7f63ca03-ada3-4c58-babe-357dcf805077,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:49.859190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:42:49.863262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.935534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ac1f8ee-80c2-4d93-8aca-40ca5e2fe398 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:49.949103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9d92d017-b049-4dba-8eef-81a84567d3c0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:49.949484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:50.030438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:41Z', 'revision_number': 3, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:50.099729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:50.125030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f7f462-3d25-45a0-9887-df3bdc4140ae None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:41Z', 'revision_number': 3, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:42:50.174907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:50.218709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-ebf40ed9-f907-43d5-bb0f-6f66f9b0a75a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:50.222026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-ebf40ed9-f907-43d5-bb0f-6f66f9b0a75a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f877f9c747b149198ac1b9cf3f6528bc&device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 1121 time: 0.5298178 Dec 21 03:42:50.241262 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] For port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:50.256281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4293b7c-023f-4136-b3be-eb76c87b4e27 req-e5004d83-f952-437f-94b6-44db5a41809a tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:50.262650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4293b7c-023f-4136-b3be-eb76c87b4e27 req-e5004d83-f952-437f-94b6-44db5a41809a tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.8802981 Dec 21 03:42:50.330599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] For port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:50.379481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-16835847-b6e1-4e80-8e2a-cc781eefe4ac None None] Provisioning complete for port 7f63ca03-ada3-4c58-babe-357dcf805077 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:50.381389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-16835847-b6e1-4e80-8e2a-cc781eefe4ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:50.483925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:50.535569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:50.536325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:50.537946 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] 10.222.0.31 "PUT /v2.0/ports/07e6b3ff-ea95-40ee-bb57-6dd4050fb305 HTTP/1.1" status: 200 len: 1097 time: 4.0251551 Dec 21 03:42:50.538914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ae433f7-b449-4490-aa67-080e50be8d75', 'tag': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:42:50.607478 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5" -d '{"events": [{"name": "network-changed", "server_uuid": "4bf004a2-2597-405c-961a-417297bcb4bc", "tag": "09554808-aec9-4511-ba46-8a6519a51c3a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:42:50.632515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-16835847-b6e1-4e80-8e2a-cc781eefe4ac None None] Port 7f63ca03-ada3-4c58-babe-357dcf805077 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:50.783636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5e131458-6e8b-4f7e-93cb-43626a3ff10a None None] Provisioning complete for port a084ed55-6630-433c-8054-e4311f90873e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:50.785188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e131458-6e8b-4f7e-93cb-43626a3ff10a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:50.813157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-374a78fa-9123-470a-a56d-adbfd18bfd98 req-4b0b5a57-4ad5-4ccd-b1aa-50f6bf1301a2 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:50.851676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-374a78fa-9123-470a-a56d-adbfd18bfd98 req-4b0b5a57-4ad5-4ccd-b1aa-50f6bf1301a2 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 1.4654975 Dec 21 03:42:50.853125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-8ab25fa9-1385-4f7e-9f6a-bd425bf4ce89 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.67&port_id=09554808-aec9-4511-ba46-8a6519a51c3a HTTP/1.1" status: 200 len: 217 time: 0.5879929 Dec 21 03:42:50.857216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a380c172-60cb-4ca1-84fb-2586fdb36672 service neutron] Pushing event updated for resources: {'Port': ['ID=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:50.885841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:50.921209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5e131458-6e8b-4f7e-93cb-43626a3ff10a None None] Port a084ed55-6630-433c-8054-e4311f90873e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:50.943946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d05513c-a00e-4fa8-965b-bfa42b316042 service neutron] Pushing event updated for resources: {'Port': ['ID=09554808-aec9-4511-ba46-8a6519a51c3a,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:51.215187 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-809e22fb-ca68-4168-b734-276ee504811a" -d '{"events": [{"name": "network-changed", "server_uuid": "1ae433f7-b449-4490-aa67-080e50be8d75", "tag": "07e6b3ff-ea95-40ee-bb57-6dd4050fb305"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:42:51.315320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-eb3724e9-1aff-49ff-a42a-6b20ccae3bb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:51.321272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-eb3724e9-1aff-49ff-a42a-6b20ccae3bb3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.3654103 Dec 21 03:42:51.328543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:51.341202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4293b7c-023f-4136-b3be-eb76c87b4e27 req-968c8c55-e4b5-4bf8-b631-b86c5a5ee773 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8874540 Dec 21 03:42:51.437101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:51.438134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:51.457110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-374a78fa-9123-470a-a56d-adbfd18bfd98 req-b5c1fe92-6be1-424d-b52f-6ce37db1b887 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4878085 Dec 21 03:42:51.486413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Router 02bebca8-a642-41be-a94c-12fbc201788d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:42:51.538426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-5601b24c-7f2f-4eb5-a9d2-1b44ba7e248f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:51.540268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-5601b24c-7f2f-4eb5-a9d2-1b44ba7e248f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2106440 Dec 21 03:42:51.752469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 69582d3a-accd-497a-809a-ae3ddf602b75 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:51.887970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 69582d3a-accd-497a-809a-ae3ddf602b75 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:51.888643 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:52.086814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-9ba69992-1f87-48fc-926b-7576ffc84932 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4448388 Dec 21 03:42:52.092191 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:42:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eae365ef-8696-4413-b4cf-cfb956e6d9b4 x-openstack-request-id: req-eae365ef-8696-4413-b4cf-cfb956e6d9b4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:42:52.092191 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4bf004a2-2597-405c-961a-417297bcb4bc", "tag": "09554808-aec9-4511-ba46-8a6519a51c3a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:42:52.092415 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eae365ef-8696-4413-b4cf-cfb956e6d9b4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:42:52.094007 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4bf004a2-2597-405c-961a-417297bcb4bc', 'tag': '09554808-aec9-4511-ba46-8a6519a51c3a', 'status': 'completed', 'code': 200} Dec 21 03:42:52.096804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:42:52.126153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:52.141750 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Sync routers for ids ['02bebca8-a642-41be-a94c-12fbc201788d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:42:52.142353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-619c89a4-5fe2-4ef6-a500-b71b09d04da7 admin admin] 10.222.0.18 "PUT /v2.0/routers/02bebca8-a642-41be-a94c-12fbc201788d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.8969111 Dec 21 03:42:52.166693 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Routers {'02bebca8-a642-41be-a94c-12fbc201788d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:52.171247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 69582d3a-accd-497a-809a-ae3ddf602b75, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=69582d3a-accd-497a-809a-ae3ddf602b75,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:52.173197 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['02bebca8-a642-41be-a94c-12fbc201788d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:52.180390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ce8fce8-6851-4943-bef4-60e00dc543da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:52.197570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Pushing event updated for resources: {'Port': ['ID=7f63ca03-ada3-4c58-babe-357dcf805077,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:52.247574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-e7fff4c6-4195-4bab-829f-5be129562dab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:52.253455 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:52.253624 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-e7fff4c6-4195-4bab-829f-5be129562dab service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dc54f4797de4426ba52a3489b5990c5e&device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 1100 time: 0.7202551 Dec 21 03:42:52.344597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=69582d3a-accd-497a-809a-ae3ddf602b75,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:52.409804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:52.429273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ab77f5-31ae-4f0d-a0fe-59effd51be20 req-80d8ff47-58f9-492c-adec-bc60d6661341 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3339045 Dec 21 03:42:52.430478 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Set router 02bebca8-a642-41be-a94c-12fbc201788d gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:52.490867 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:42:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a233a8cd-6526-4e3b-ba75-96ac33295c97 x-openstack-request-id: req-a233a8cd-6526-4e3b-ba75-96ac33295c97 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:42:52.491176 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1ae433f7-b449-4490-aa67-080e50be8d75", "tag": "07e6b3ff-ea95-40ee-bb57-6dd4050fb305", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:42:52.491701 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a233a8cd-6526-4e3b-ba75-96ac33295c97 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:42:52.491973 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ae433f7-b449-4490-aa67-080e50be8d75', 'tag': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305', 'status': 'completed', 'code': 200} Dec 21 03:42:52.495137 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-1bd88146-f486-4cba-81f8-ac97fd70aa55 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.247&port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305 HTTP/1.1" status: 200 len: 217 time: 0.1806545 Dec 21 03:42:52.503901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Network be2315d6-c735-4ecb-b299-a3b1405aa378 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:42:52.505907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:42:52.809401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-a8b274cf-7480-4b72-8031-7a77ce8e2456 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:52.812332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-a8b274cf-7480-4b72-8031-7a77ce8e2456 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f877f9c747b149198ac1b9cf3f6528bc&device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 1121 time: 0.2304063 Dec 21 03:42:52.865093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:42:52.896912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a0c9df-d34a-47ba-b429-8b6347e92ad2 req-844d35a0-5749-4d3d-9828-a7a7adfa0a5f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:52.904472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0a0c9df-d34a-47ba-b429-8b6347e92ad2 req-844d35a0-5749-4d3d-9828-a7a7adfa0a5f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.2394781 Dec 21 03:42:52.971505 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a084ed55-6630-433c-8054-e4311f90873e', 'name': '', 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'mac_address': 'fa:16:3e:80:ae:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_interface', 'standard_attr_id': 131, 'fixed_ips': [{'subnet_id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:43Z', 'updated_at': '2021-12-21T03:42:48Z', 'revision_number': 2, 'project_id': '0432748fee1345f888406a94a41fcadb', 'subnets': [{'id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:53.008429 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Checking router: 02bebca8-a642-41be-a94c-12fbc201788d for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:42:53.008792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Updating router 02bebca8-a642-41be-a94c-12fbc201788d port a084ed55-6630-433c-8054-e4311f90873e binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:42:53.045115 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:53.096936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cac91e5f-bd9c-4311-854f-751fc1018fe6 None None] Provisioning complete for port 7f63ca03-ada3-4c58-babe-357dcf805077 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:53.097689 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cac91e5f-bd9c-4311-854f-751fc1018fe6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:53.171634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:42:53.187390 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d065235-f2d3-4545-9c04-ec022ccccb24 admin admin] 10.222.0.18 "PUT /v2.0/routers/96057fa7-9fcd-425e-9649-549b503668e8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8213553 Dec 21 03:42:53.198691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0a0c9df-d34a-47ba-b429-8b6347e92ad2 req-2e2ae819-f173-420e-8ae4-ae8ecad5935e tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2899251 Dec 21 03:42:53.202521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-dce993b5-42fe-476b-9629-e4f50bbadce4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:53.218283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:53.241243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cac91e5f-bd9c-4311-854f-751fc1018fe6 None None] Port 7f63ca03-ada3-4c58-babe-357dcf805077 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:53.253162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-dce993b5-42fe-476b-9629-e4f50bbadce4 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.4096761 Dec 21 03:42:53.264357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:42:53.280401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:53.282162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:53.364044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-ddecb6f6-74de-490d-82dd-73847a5b7c8b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.67&port_id=09554808-aec9-4511-ba46-8a6519a51c3a HTTP/1.1" status: 200 len: 217 time: 0.1120093 Dec 21 03:42:53.523342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-be2cbe65-5cbd-406c-ac79-2bf7000ca3c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:53.528916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-be2cbe65-5cbd-406c-ac79-2bf7000ca3c6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1543598 Dec 21 03:42:53.562553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:53.636409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3b8cca-4591-45bc-a471-e3fadbef789a req-c8c0a1fc-b4b7-452f-8134-0a1d122f74b5 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:53.643594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd3b8cca-4591-45bc-a471-e3fadbef789a req-c8c0a1fc-b4b7-452f-8134-0a1d122f74b5 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.2317502 Dec 21 03:42:53.666600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:53.682185 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:53.744763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-290760de-5d5e-4e9a-8dc4-27d16f18407b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:53.749179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-290760de-5d5e-4e9a-8dc4-27d16f18407b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2129469 Dec 21 03:42:53.763238 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:53.939199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 69582d3a-accd-497a-809a-ae3ddf602b75 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:53.994132 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e7eac6-67ee-44b2-b0bb-cbfa08b8ed77 None None] Pushing event updated for resources: {'Port': ['ID=a084ed55-6630-433c-8054-e4311f90873e,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:54.061116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5432ad97-c7d4-4f89-a30b-1646f959b310 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.123138 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Attempting to bind port a084ed55-6630-433c-8054-e4311f90873e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:54.123420 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Attempting to bind port a084ed55-6630-433c-8054-e4311f90873e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:54.126067 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Attempting to bind port a084ed55-6630-433c-8054-e4311f90873e on network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:54.143202 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:54.151836 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Checking segment: {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:54.155501 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.157706 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Bound using segment: {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:54.158196 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Bound port: a084ed55-6630-433c-8054-e4311f90873e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '98b0f2d4-acea-405d-b169-baa382d740ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:54.159168 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.217108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 69582d3a-accd-497a-809a-ae3ddf602b75 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:54.217867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.238761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd3b8cca-4591-45bc-a471-e3fadbef789a req-dd5fca02-e7a9-4d35-b333-e11b4daf85c8 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5683768 Dec 21 03:42:54.327231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5432ad97-c7d4-4f89-a30b-1646f959b310 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.340370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-2b52ee2c-af9a-4816-92dd-ab4e048566a6 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5845623 Dec 21 03:42:54.355720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-d80fd150-b5fd-4290-85ff-407731e7c35e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:54.357479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-d80fd150-b5fd-4290-85ff-407731e7c35e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1633954 Dec 21 03:42:54.367361 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] For port a084ed55-6630-433c-8054-e4311f90873e, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:54.370772 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] For port a084ed55-6630-433c-8054-e4311f90873e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a084ed55-6630-433c-8054-e4311f90873e,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:54.415358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5432ad97-c7d4-4f89-a30b-1646f959b310 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.416575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7844c029-f642-40f8-b442-893c1416fa60 None None] Provisioning complete for port a084ed55-6630-433c-8054-e4311f90873e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:54.419125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7844c029-f642-40f8-b442-893c1416fa60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.443407 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.489283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5432ad97-c7d4-4f89-a30b-1646f959b310 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b694a9bf-d621-48ff-a7df-7adce8964c77,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:54.567465 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5432ad97-c7d4-4f89-a30b-1646f959b310 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e791fae2c6fa4c28b85edb0da4f729dc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8996508 Dec 21 03:42:54.571598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:54.590411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca7afd1-be9d-40db-88ac-7e5a3ac62ee5 req-6c2e8847-4245-487b-8928-ed4463881641 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2341828 Dec 21 03:42:54.617269 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Routers {'02bebca8-a642-41be-a94c-12fbc201788d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:54.618962 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['02bebca8-a642-41be-a94c-12fbc201788d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:54.703129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-538e9912-9af8-43be-8972-44e21f66e47f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.756170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7844c029-f642-40f8-b442-893c1416fa60 None None] Port a084ed55-6630-433c-8054-e4311f90873e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:54.762680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-538e9912-9af8-43be-8972-44e21f66e47f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.802409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:51Z', 'revision_number': 2, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:54.851253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:42:54.851815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Updating router 96057fa7-9fcd-425e-9649-549b503668e8 port 7f63ca03-ada3-4c58-babe-357dcf805077 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:42:54.902914 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e7eac6-67ee-44b2-b0bb-cbfa08b8ed77 None None] Pushing event updated for resources: {'Port': ['ID=a084ed55-6630-433c-8054-e4311f90873e,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:54.929729 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.942446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.972675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] Set router 02bebca8-a642-41be-a94c-12fbc201788d gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:54.978710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3a8691-0a52-45b9-ad06-a23b051ff8b9 req-0bda0030-949d-4f54-9caf-066cc6334e0c tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:54.990021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c3a8691-0a52-45b9-ad06-a23b051ff8b9 req-0bda0030-949d-4f54-9caf-066cc6334e0c tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.0685997 Dec 21 03:42:54.991509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-538e9912-9af8-43be-8972-44e21f66e47f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.996494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-538e9912-9af8-43be-8972-44e21f66e47f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:54.997834 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-538e9912-9af8-43be-8972-44e21f66e47f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b694a9bf-d621-48ff-a7df-7adce8964c77 HTTP/1.1" status: 204 len: 168 time: 0.4248388 Dec 21 03:42:55.016675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538e9912-9af8-43be-8972-44e21f66e47f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b694a9bf-d621-48ff-a7df-7adce8964c77,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:55.070237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c3a8691-0a52-45b9-ad06-a23b051ff8b9 req-939edada-48b4-441d-8e0c-c0da114652ad tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795960 Dec 21 03:42:55.286022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:55.290686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6a85714e-a3cd-40df-b0d2-2132c466c12c None None] Provisioning complete for port a084ed55-6630-433c-8054-e4311f90873e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:55.291495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6a85714e-a3cd-40df-b0d2-2132c466c12c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:55.419565 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a084ed55-6630-433c-8054-e4311f90873e', 'name': '', 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'mac_address': 'fa:16:3e:80:ae:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_interface', 'standard_attr_id': 131, 'fixed_ips': [{'subnet_id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:43Z', 'updated_at': '2021-12-21T03:42:54Z', 'revision_number': 4, 'project_id': '0432748fee1345f888406a94a41fcadb', 'subnets': [{'id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:55.505938 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3080356-967e-4b85-8c7d-ddc163f684ab None None] The sync data for ids ['02bebca8-a642-41be-a94c-12fbc201788d'] in n-d-822053-11 is: [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a084ed55-6630-433c-8054-e4311f90873e', 'name': '', 'network_id': '8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'mac_address': 'fa:16:3e:80:ae:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_interface', 'standard_attr_id': 131, 'fixed_ips': [{'subnet_id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:43Z', 'updated_at': '2021-12-21T03:42:54Z', 'revision_number': 4, 'project_id': '0432748fee1345f888406a94a41fcadb', 'subnets': [{'id': '5a8480b0-ced1-4eac-af2b-b002cf1f0d61', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:42:55.777051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:55.790551 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6a85714e-a3cd-40df-b0d2-2132c466c12c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:55.809192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f455b5b2-a257-4abe-afee-a290876e4431 req-0b7a24c9-c4a4-41a5-824a-e66227b1de7f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:55.816449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f455b5b2-a257-4abe-afee-a290876e4431 req-0b7a24c9-c4a4-41a5-824a-e66227b1de7f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.1201448 Dec 21 03:42:55.883952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6a85714e-a3cd-40df-b0d2-2132c466c12c None None] For port a084ed55-6630-433c-8054-e4311f90873e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a084ed55-6630-433c-8054-e4311f90873e,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:55.889185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a084ed55-6630-433c-8054-e4311f90873e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:55.925908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f455b5b2-a257-4abe-afee-a290876e4431 req-c1f9d348-c95d-4bd3-87ec-c5f4d61c8acb tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995131 Dec 21 03:42:55.936348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-1254e0b5-b907-4fc3-ad94-52f7a4809d53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:55.940327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-1254e0b5-b907-4fc3-ad94-52f7a4809d53 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1340854 Dec 21 03:42:55.966509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:55.968495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.095236 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6a85714e-a3cd-40df-b0d2-2132c466c12c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.185767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39916) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:56.211475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b976cc33-0531-4f7d-bd9a-84c981bb3a5b None None] Pushing event updated for resources: {'Port': ['ID=7f63ca03-ada3-4c58-babe-357dcf805077,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:56.281259 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-683565b7-bbb3-41a3-af38-06dadd64290b service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3256540 Dec 21 03:42:56.283012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159190a4-0d81-4acd-a2ab-e5c832fb55b4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.425428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Attempting to bind port 7f63ca03-ada3-4c58-babe-357dcf805077 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:42:56.426004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Attempting to bind port 7f63ca03-ada3-4c58-babe-357dcf805077 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:42:56.435875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Attempting to bind port 7f63ca03-ada3-4c58-babe-357dcf805077 on network be2315d6-c735-4ecb-b299-a3b1405aa378 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:42:56.478846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a084ed55-6630-433c-8054-e4311f90873e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:56.481572 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.483716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:42:56.487423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Checking segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:42:56.487942 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.488490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Bound using segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:42:56.489711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Bound port: 7f63ca03-ada3-4c58-babe-357dcf805077, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:42:56.490167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.493132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4e6e456b-f183-4ed4-88a7-947a19f6e546 req-55ab2a21-2a59-455d-b193-894e1588f817 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1989541 Dec 21 03:42:56.498154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a85714e-a3cd-40df-b0d2-2132c466c12c None None] Pushing event updated for resources: {'Port': ['ID=a084ed55-6630-433c-8054-e4311f90873e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:56.529016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b430488-e397-41b5-a0f3-61bf8ef793f3 req-369e75c8-62a4-436d-b9c5-54d560c4df1b tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:56.537130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b430488-e397-41b5-a0f3-61bf8ef793f3 req-369e75c8-62a4-436d-b9c5-54d560c4df1b tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.1207635 Dec 21 03:42:56.663829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b430488-e397-41b5-a0f3-61bf8ef793f3 req-d16489c4-0d53-4d5d-a263-e3c67b452857 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1256785 Dec 21 03:42:56.687743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159190a4-0d81-4acd-a2ab-e5c832fb55b4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.696921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b78fa520-1ee1-43a5-8e32-94402dbff389 None None] Provisioning complete for port 7f63ca03-ada3-4c58-babe-357dcf805077 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:56.698072 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b78fa520-1ee1-43a5-8e32-94402dbff389 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.745505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159190a4-0d81-4acd-a2ab-e5c832fb55b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.769634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] For port 7f63ca03-ada3-4c58-babe-357dcf805077, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:42:56.785262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] For port 7f63ca03-ada3-4c58-babe-357dcf805077, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7f63ca03-ada3-4c58-babe-357dcf805077,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:42:56.790980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b78fa520-1ee1-43a5-8e32-94402dbff389 None None] Port 7f63ca03-ada3-4c58-babe-357dcf805077 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:42:56.837795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159190a4-0d81-4acd-a2ab-e5c832fb55b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36ca844b-d30b-4a70-8771-1c59d2667668,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:56.854386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:56.909642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39922) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:56.912024 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-159190a4-0d81-4acd-a2ab-e5c832fb55b4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=63e03ec445b943389250e24c61afb58c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7226026 Dec 21 03:42:56.934069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:42:56.934987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:42:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:57.055936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69fcb42a-3ed7-4ca8-9006-b8aa55f2ddde admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.097528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b976cc33-0531-4f7d-bd9a-84c981bb3a5b None None] Pushing event updated for resources: {'Port': ['ID=7f63ca03-ada3-4c58-babe-357dcf805077,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:57.124982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69fcb42a-3ed7-4ca8-9006-b8aa55f2ddde admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.148937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39926) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:57.155300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1678634864', 'description': 'tempest-description--1229624456'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:57.305733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.315477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:42:57.317256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69fcb42a-3ed7-4ca8-9006-b8aa55f2ddde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.320175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69fcb42a-3ed7-4ca8-9006-b8aa55f2ddde admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.324876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-69fcb42a-3ed7-4ca8-9006-b8aa55f2ddde admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/36ca844b-d30b-4a70-8771-1c59d2667668 HTTP/1.1" status: 204 len: 168 time: 0.4013054 Dec 21 03:42:57.344276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69fcb42a-3ed7-4ca8-9006-b8aa55f2ddde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36ca844b-d30b-4a70-8771-1c59d2667668,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:57.571990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.581096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809e22fb-ca68-4168-b734-276ee504811a req-393b6a30-41db-43b2-9e24-7d171f08ea42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:57.583183 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-393b6a30-41db-43b2-9e24-7d171f08ea42 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dc54f4797de4426ba52a3489b5990c5e&device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 1100 time: 0.1797683 Dec 21 03:42:57.738021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243a09ed-a59e-480c-a9e0-d35f817c9384 req-d57ed1ac-ff1c-43ba-8e42-5ed965cf256f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:57.743100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a084ed55-6630-433c-8054-e4311f90873e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:57.752868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-243a09ed-a59e-480c-a9e0-d35f817c9384 req-d57ed1ac-ff1c-43ba-8e42-5ed965cf256f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.1638227 Dec 21 03:42:57.773214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8892a02d-adf7-45c4-9ce0-2e22bee2e401 None None] Provisioning complete for port 7f63ca03-ada3-4c58-babe-357dcf805077 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:57.773585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8892a02d-adf7-45c4-9ce0-2e22bee2e401 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.846145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-243a09ed-a59e-480c-a9e0-d35f817c9384 req-3acc211d-dbb9-4247-a8fd-229689a2ff13 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913725 Dec 21 03:42:57.849888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.928689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a084ed55-6630-433c-8054-e4311f90873e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:57.929063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:57.964989 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8892a02d-adf7-45c4-9ce0-2e22bee2e401 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.018713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:56Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:42:58.023157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8892a02d-adf7-45c4-9ce0-2e22bee2e401 None None] For port 7f63ca03-ada3-4c58-babe-357dcf805077, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7f63ca03-ada3-4c58-babe-357dcf805077,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:42:58.064982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5945e54b-22d9-4061-bd7c-9708765f4d8d None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:56Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:42:58.148963 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8892a02d-adf7-45c4-9ce0-2e22bee2e401 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.184081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa8f8344-ed72-403c-a269-225bbf5487c9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:58.226968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.230709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e4a827f-0a50-43ca-aef2-f8691392f1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.0774524 Dec 21 03:42:58.241591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39942) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:58.252436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9fccae-9e06-4985-9802-3ded89bfb558 req-96c27a8e-8deb-4467-98b1-08884e8a7b0b tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:58.254237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'security_group_rule': {'security_group_id': 'fa8f8344-ed72-403c-a269-225bbf5487c9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:58.280372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809e22fb-ca68-4168-b734-276ee504811a req-5245fd49-e45c-464a-9ef7-a2fe724415be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:58.284368 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-5245fd49-e45c-464a-9ef7-a2fe724415be service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.6773584 Dec 21 03:42:58.286350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd9fccae-9e06-4985-9802-3ded89bfb558 req-96c27a8e-8deb-4467-98b1-08884e8a7b0b tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.2251706 Dec 21 03:42:58.317198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8892a02d-adf7-45c4-9ce0-2e22bee2e401 None None] Pushing event updated for resources: {'Port': ['ID=7f63ca03-ada3-4c58-babe-357dcf805077,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:58.434168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39944) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:58.450851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-ae3b67de-fd65-4ccf-b305-8a06f8fb7f46 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.247&port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305 HTTP/1.1" status: 200 len: 217 time: 0.1174631 Dec 21 03:42:58.458081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.539665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd9fccae-9e06-4985-9802-3ded89bfb558 req-53845990-30d2-4f25-921c-b912291025d4 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2432070 Dec 21 03:42:58.583439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809e22fb-ca68-4168-b734-276ee504811a req-1b5f7857-8571-494a-8193-eef6f7100406 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:58.585129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-1b5f7857-8571-494a-8193-eef6f7100406 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1079285 Dec 21 03:42:58.620739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.635461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41942fc4-f89d-419b-a652-813cf270e81b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.698711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.733181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f8ab77d-b589-4c8a-a7ee-3be476811bea,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:58.788759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41942fc4-f89d-419b-a652-813cf270e81b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.826570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.833026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b0c038b7-36a1-4937-a547-17cf5377833f tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5865841 Dec 21 03:42:58.833748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:58.838139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'security_group_rule': {'security_group_id': 'fa8f8344-ed72-403c-a269-225bbf5487c9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:58.882983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41942fc4-f89d-419b-a652-813cf270e81b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:58.943865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-41942fc4-f89d-419b-a652-813cf270e81b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=773173be9ea341058d5244d097feda45&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5080462 Dec 21 03:42:58.946718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:58.981469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.072795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41942fc4-f89d-419b-a652-813cf270e81b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54e96817-5f66-4857-800f-3a09cbaf8ec7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:59.196427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c10af5e5-0d45-4c9e-a5ac-0cf7e22ce2c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.249397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:59.323732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c10af5e5-0d45-4c9e-a5ac-0cf7e22ce2c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.352777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.362567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809e22fb-ca68-4168-b734-276ee504811a req-69118b1d-48ac-4947-87fb-b7041ddc86a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:59.364086 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-69118b1d-48ac-4947-87fb-b7041ddc86a1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2916310 Dec 21 03:42:59.420763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.545263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f10b82-8ad0-40d7-87a7-352419d6a606 req-e5ac3d36-3747-4d14-bbbc-55ca6b536d12 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:59.560271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95f10b82-8ad0-40d7-87a7-352419d6a606 req-e5ac3d36-3747-4d14-bbbc-55ca6b536d12 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.5460093 Dec 21 03:42:59.792732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7f63ca03-ada3-4c58-babe-357dcf805077 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:42:59.799835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-8ab4da23-c761-434e-80dd-ed04133e2cc6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:42:59.809575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-8ab4da23-c761-434e-80dd-ed04133e2cc6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 821 time: 0.8152385 Dec 21 03:42:59.837750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95f10b82-8ad0-40d7-87a7-352419d6a606 req-10d26d9a-88b6-42dd-977f-47c1f47485f6 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2753663 Dec 21 03:42:59.867486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a25995dd-1630-49d2-a4a1-befce28f9519,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:42:59.875136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7f63ca03-ada3-4c58-babe-357dcf805077 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:42:59.875940 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.890157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-e5428307-ce80-49d3-9a4f-20cac0d27f8f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/quotas/d3c7911e116e4170812afec94091929a HTTP/1.1" status: 200 len: 375 time: 0.0741303 Dec 21 03:42:59.891206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:42:59.894374 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61b7731f-c1df-4573-b377-e4581353c312 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0598445 Dec 21 03:42:59.898572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39986) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:42:59.924252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:42:59.945535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87d73248-1f53-499f-b858-1872f9164ef9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.013993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c10af5e5-0d45-4c9e-a5ac-0cf7e22ce2c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.017582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c10af5e5-0d45-4c9e-a5ac-0cf7e22ce2c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.019760 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c10af5e5-0d45-4c9e-a5ac-0cf7e22ce2c8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/54e96817-5f66-4857-800f-3a09cbaf8ec7 HTTP/1.1" status: 204 len: 168 time: 1.0720742 Dec 21 03:43:00.025157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-e482f51d-aeed-4e74-9088-81b9622e5640 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1385326 Dec 21 03:43:00.043853 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-b4f391b8-081a-4e2c-81b3-a2fb50a98e68 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6681683 Dec 21 03:43:00.067146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10af5e5-0d45-4c9e-a5ac-0cf7e22ce2c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54e96817-5f66-4857-800f-3a09cbaf8ec7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:00.163079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.233103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dd0e72-3f07-49ae-b7f8-ffaeb1de7bda req-84fa5c4d-c408-4ed8-901b-20e9c6553efc tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:00.244276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5dd0e72-3f07-49ae-b7f8-ffaeb1de7bda req-84fa5c4d-c408-4ed8-901b-20e9c6553efc tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.2061007 Dec 21 03:43:00.288779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-809e22fb-ca68-4168-b734-276ee504811a req-6c4f5397-2be1-401c-a00e-fee45ecf2069 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2355185 Dec 21 03:43:00.343747 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87d73248-1f53-499f-b858-1872f9164ef9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.363551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5dd0e72-3f07-49ae-b7f8-ffaeb1de7bda req-1fd17a8f-abc9-4c75-8a64-3a6675d7f38c tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109033 Dec 21 03:43:00.411522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.464740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87d73248-1f53-499f-b858-1872f9164ef9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.531334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-87d73248-1f53-499f-b858-1872f9164ef9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5abe02d9db1e4e908bc5f7e98431d410&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2706373 Dec 21 03:43:00.535603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:00.559675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d73248-1f53-499f-b858-1872f9164ef9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88077380-8783-4a4c-9929-a2ecac1aad08,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:00.615505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Allocated IP 172.25.5.85 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/aabe47a0-1a41-443e-b763-8ee7a51d7d3e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:00.643804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4087f033-fb0f-483b-b154-eb3e2a6ffca0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.684852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4087f033-fb0f-483b-b154-eb3e2a6ffca0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.798044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.834714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-d2862c87-1b97-4133-a6fe-4c3c7b447034 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:43:00.835883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-d2862c87-1b97-4133-a6fe-4c3c7b447034 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1088479 Dec 21 03:43:00.842793 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4087f033-fb0f-483b-b154-eb3e2a6ffca0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.852677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4087f033-fb0f-483b-b154-eb3e2a6ffca0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.853864 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4087f033-fb0f-483b-b154-eb3e2a6ffca0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/88077380-8783-4a4c-9929-a2ecac1aad08 HTTP/1.1" status: 204 len: 168 time: 0.3177660 Dec 21 03:43:00.866654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4087f033-fb0f-483b-b154-eb3e2a6ffca0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88077380-8783-4a4c-9929-a2ecac1aad08,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:00.906337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:00.989199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:00.994166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:00.998688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:01.022608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'Port': ['ID=aabe47a0-1a41-443e-b763-8ee7a51d7d3e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:01.049754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1416e2cb-0236-4ace-8866-0f68bb2709cb req-044a29bb-4dab-418c-9c21-6e2300a81aa3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:01.051479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1416e2cb-0236-4ace-8866-0f68bb2709cb req-044a29bb-4dab-418c-9c21-6e2300a81aa3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.0770335 Dec 21 03:43:01.057727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-8f973c7a-9821-4355-a79f-865be6b2e838 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2149062 Dec 21 03:43:01.098104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:01.134567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c69b1c2a-b8bf-4c51-a63e-f070ea97c005 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.169529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.235567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1416e2cb-0236-4ace-8866-0f68bb2709cb req-3f41187a-5478-45be-85e6-66856df7f4ae tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1691911 Dec 21 03:43:01.279527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-73ec09e9-b369-44bb-8389-4f9f08deae9f service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2111366 Dec 21 03:43:01.303151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c69b1c2a-b8bf-4c51-a63e-f070ea97c005 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.311826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.364880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c69b1c2a-b8bf-4c51-a63e-f070ea97c005 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.453532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c69b1c2a-b8bf-4c51-a63e-f070ea97c005 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d193cbe7c3b54d84adce00920abbfd9e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3518133 Dec 21 03:43:01.456367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40020) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:01.500191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c69b1c2a-b8bf-4c51-a63e-f070ea97c005 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a678104-c347-4a91-823d-17b83c33b740,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:01.664985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40028) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:01.693043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe815f36-5e8d-4fbe-bab1-61deb5ae83ab req-3a4b3113-908b-4c77-add3-8804a39c21d0 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 210 time: 0.0639627 Dec 21 03:43:01.718711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52560741-ed75-470d-b3bc-2930ad7e9244 req-a0589f05-46ab-4b3c-89bf-b5d7c24803fc tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:01.721908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52560741-ed75-470d-b3bc-2930ad7e9244 req-a0589f05-46ab-4b3c-89bf-b5d7c24803fc tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.2418330 Dec 21 03:43:01.752893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7466af0f-436f-4ee3-b99e-792f8ab74e19 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.756070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.759519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-875744a8-9277-4d0d-b147-2fac989bf202 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.836350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52560741-ed75-470d-b3bc-2930ad7e9244 req-fd86658e-d988-48a8-b36c-9681576bb4d1 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0916638 Dec 21 03:43:01.852534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7466af0f-436f-4ee3-b99e-792f8ab74e19 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.871730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-875744a8-9277-4d0d-b147-2fac989bf202 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.873898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.928483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'Port': ['ID=aabe47a0-1a41-443e-b763-8ee7a51d7d3e,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:01.930855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.946184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-875744a8-9277-4d0d-b147-2fac989bf202 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:01.987772 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-875744a8-9277-4d0d-b147-2fac989bf202 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3583c9798bd64f7ab88432da867f7faf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2627432 Dec 21 03:43:01.990452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40040) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:02.019395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7466af0f-436f-4ee3-b99e-792f8ab74e19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.024052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7466af0f-436f-4ee3-b99e-792f8ab74e19 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.027932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7466af0f-436f-4ee3-b99e-792f8ab74e19 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4a678104-c347-4a91-823d-17b83c33b740 HTTP/1.1" status: 204 len: 168 time: 0.5655446 Dec 21 03:43:02.028199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.028510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b5469fc-059c-4cd4-87fe-7fc55c9e5f05 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.1266065 Dec 21 03:43:02.040875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875744a8-9277-4d0d-b147-2fac989bf202 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8050e988-b34a-4214-a936-f9a57b669af1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:02.074646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9055b7da-6f6a-43d3-9914-d5f7f61009b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.087207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7466af0f-436f-4ee3-b99e-792f8ab74e19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a678104-c347-4a91-823d-17b83c33b740,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:02.104075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9055b7da-6f6a-43d3-9914-d5f7f61009b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.225721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9055b7da-6f6a-43d3-9914-d5f7f61009b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.228376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9055b7da-6f6a-43d3-9914-d5f7f61009b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:02.232867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9055b7da-6f6a-43d3-9914-d5f7f61009b4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8050e988-b34a-4214-a936-f9a57b669af1 HTTP/1.1" status: 204 len: 168 time: 0.2411854 Dec 21 03:43:02.257080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9055b7da-6f6a-43d3-9914-d5f7f61009b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8050e988-b34a-4214-a936-f9a57b669af1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:02.469985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d0e00b-5b00-4958-b5a8-517d5835ab70 req-f25f6464-b077-47dd-b1c7-97183966ae1f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:02.473668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5d0e00b-5b00-4958-b5a8-517d5835ab70 req-f25f6464-b077-47dd-b1c7-97183966ae1f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.1130922 Dec 21 03:43:02.565192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-72cd0837-4859-4eea-ad4b-2a95570166ee tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1678634864&fields=id&tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c HTTP/1.1" status: 200 len: 267 time: 0.1107061 Dec 21 03:43:02.568817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5d0e00b-5b00-4958-b5a8-517d5835ab70 req-2e4cc8e1-c31e-4b05-80ca-15965b046be9 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862563 Dec 21 03:43:02.780578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-79c929c5-c226-4582-b39d-a71022486713 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:02.780578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-79c929c5-c226-4582-b39d-a71022486713 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 824 time: 0.1712868 Dec 21 03:43:02.780578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-42bc281d-902e-40dc-86ad-d2fdf834a97c tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/quotas/2637e7ec4ea74cb6a3ec5d635dce4a5c HTTP/1.1" status: 200 len: 375 time: 0.0107255 Dec 21 03:43:02.853347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99c51a65-5790-484f-b697-f13c84f6df71 req-68039494-b3eb-4597-916c-fc5f83d0fd70 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 210 time: 0.0415971 Dec 21 03:43:02.860418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-fadc2f38-e240-46e8-93e7-01d605cb04af tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0898645 Dec 21 03:43:02.976014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-284f152c-84e2-473c-bb97-c38af1c510ee req-bd087136-8b83-4ec0-a30b-3855b2f4a062 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:02.977567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-284f152c-84e2-473c-bb97-c38af1c510ee req-bd087136-8b83-4ec0-a30b-3855b2f4a062 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 948 time: 0.0506856 Dec 21 03:43:03.048198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-284f152c-84e2-473c-bb97-c38af1c510ee req-4cbd2e6c-4370-4f5c-b52f-db73d7974210 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645940 Dec 21 03:43:03.188014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:03.319559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:03.332834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305', 'mac_address': 'fa:16:3e:83:3f:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.247'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:03.386667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-68766080-8508-486a-83bf-fa60f3d88029 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:43:03.395812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-68766080-8508-486a-83bf-fa60f3d88029 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1607873 Dec 21 03:43:03.400562 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:03.416942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:03.442658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:03.515438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-212d4f37-f158-458c-b62b-6b0d2982403e service neutron] 10.222.0.18 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1175849 Dec 21 03:43:03.526888 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:03.593383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:03.686142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-e6bc1482-4f6f-4239-91e7-48fe4644537b service neutron] 10.222.0.18 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1618309 Dec 21 03:43:03.756567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b484a7e1-9bc0-4a36-bd39-5d63d0fa0a3b req-dc8ed51f-7ba9-49fa-bf5e-99d951ce5ccb tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:03.759050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b484a7e1-9bc0-4a36-bd39-5d63d0fa0a3b req-dc8ed51f-7ba9-49fa-bf5e-99d951ce5ccb tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.0719733 Dec 21 03:43:03.844038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b484a7e1-9bc0-4a36-bd39-5d63d0fa0a3b req-ffe2e237-4709-4e3f-81f0-62b43978286f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764596 Dec 21 03:43:03.990424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['07e6b3ff-ea95-40ee-bb57-6dd4050fb305'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:04.041425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-955b7dcd-f801-4ca6-9e08-2be77c6db62d req-e88c72ba-601e-4b94-a6f0-83bef4ee2777 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 210 time: 0.0961421 Dec 21 03:43:04.141518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40cd5785-907f-452e-8553-0db214a346f0 req-7fc80ec4-bafa-4494-94fc-d8aa12017607 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 210 time: 0.0447299 Dec 21 03:43:04.207490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e54d64f-f600-4aa3-82a7-cafaeac7abc6 req-eeb889eb-7493-427d-a9cb-afb3538bb889 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:04.216164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e54d64f-f600-4aa3-82a7-cafaeac7abc6 req-eeb889eb-7493-427d-a9cb-afb3538bb889 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 949 time: 0.0782850 Dec 21 03:43:04.307977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e54d64f-f600-4aa3-82a7-cafaeac7abc6 req-ec7da80e-df92-4410-a761-a823d674c2ab tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908067 Dec 21 03:43:04.813919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6a189fe1-0ff9-4ea5-a28c-078acee4790e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:04.815530 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6a189fe1-0ff9-4ea5-a28c-078acee4790e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.31 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 821 time: 0.2008762 Dec 21 03:43:04.837309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'port': {'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'admin_state_up': True, 'tenant_id': 'd3c7911e116e4170812afec94091929a'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:04.993969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa08ffff-b8c5-445e-a4be-6613bff5d173 req-366364dc-9b87-4dff-9d77-492bf46d220d tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:04.995923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa08ffff-b8c5-445e-a4be-6613bff5d173 req-366364dc-9b87-4dff-9d77-492bf46d220d tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.0615833 Dec 21 03:43:05.060759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa08ffff-b8c5-445e-a4be-6613bff5d173 req-431e4746-d542-44e4-a74c-ea985bb008de tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582874 Dec 21 03:43:05.144404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Made reservation on behalf of d3c7911e116e4170812afec94091929a for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:05.147957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.151934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b349e08b-601b-4e75-b6b6-4b1e18136091 req-95378429-0e91-4ec5-b958-5df9f5a53b79 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 210 time: 0.0309234 Dec 21 03:43:05.198084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:05.303829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Allocated IP 172.20.0.8 (be2315d6-c735-4ecb-b299-a3b1405aa378/8f347100-a6ac-44b8-b4d2-4439cc3e6889/552d2bbd-e22b-4bf0-a3fc-056e9948167e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:05.304348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a050776-a464-4b3d-aa7a-ee98e7bab43a req-20dfb819-fa8e-43fe-8663-aa6f41dff44a tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 210 time: 0.0616794 Dec 21 03:43:05.358552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:05.363353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:05.366399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.481340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.492246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4fbb4b-ebcf-4423-9df8-58ad61f59f1b req-de035bed-317a-4e55-8dd4-97a724e6869d tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:05.496364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a4fbb4b-ebcf-4423-9df8-58ad61f59f1b req-de035bed-317a-4e55-8dd4-97a724e6869d tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 949 time: 0.0857053 Dec 21 03:43:05.539498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:05.540364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ae433f7-b449-4490-aa67-080e50be8d75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:05.568845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a4fbb4b-ebcf-4423-9df8-58ad61f59f1b req-4aa60908-c244-45ba-b742-79e8fc1d9943 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663321 Dec 21 03:43:05.585863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.643816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.680168 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b75e6008-ac66-4107-908a-69333ab97e07" -d '{"events": [{"server_uuid": "1ae433f7-b449-4490-aa67-080e50be8d75", "name": "network-vif-plugged", "status": "completed", "tag": "07e6b3ff-ea95-40ee-bb57-6dd4050fb305"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:05.698039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:05.739222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.805268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Network be2315d6-c735-4ecb-b299-a3b1405aa378 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:05.810406 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8248334-86f8-4ead-898a-6935d8ca5140 x-openstack-request-id: req-f8248334-86f8-4ead-898a-6935d8ca5140 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:05.810737 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ae433f7-b449-4490-aa67-080e50be8d75", "name": "network-vif-plugged", "status": "completed", "tag": "07e6b3ff-ea95-40ee-bb57-6dd4050fb305", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:05.811049 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f8248334-86f8-4ead-898a-6935d8ca5140 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:05.811407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:05.811511 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ae433f7-b449-4490-aa67-080e50be8d75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305', 'code': 200} Dec 21 03:43:05.814301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event updated for resources: {'Port': ['ID=552d2bbd-e22b-4bf0-a3fc-056e9948167e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:05.817628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:05.828347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:05.828347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:05.930066 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-6014ff87-30b1-4f1b-9b37-7179c69c8c15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0979505 Dec 21 03:43:05.968006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.31', 52064) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:05.974806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Request body: {'port': {'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:06.058795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.065123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5ae30ddd-a84d-48b0-a9bb-a65c1ffda950 None None] Provisioning complete for port 552d2bbd-e22b-4bf0-a3fc-056e9948167e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:06.065494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5ae30ddd-a84d-48b0-a9bb-a65c1ffda950 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.117366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b540f50-0267-4583-8056-57f7cdfb7a8f req-dd642f91-2318-4779-bbc6-e23326b3fe0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:06.125217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b540f50-0267-4583-8056-57f7cdfb7a8f req-dd642f91-2318-4779-bbc6-e23326b3fe0e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 1102 time: 0.1506586 Dec 21 03:43:06.128049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5ae30ddd-a84d-48b0-a9bb-a65c1ffda950 None None] Port 552d2bbd-e22b-4bf0-a3fc-056e9948167e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:06.150847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5b540f50-0267-4583-8056-57f7cdfb7a8f req-75a5ab9d-f895-49d5-9c3e-f1f1f8f11e99 service neutron] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.239425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad7dc69-7b90-44fd-8ab7-376aa6600c2e req-918b757b-16ea-4baa-9ee5-3bae0404387b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:06.240919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ad7dc69-7b90-44fd-8ab7-376aa6600c2e req-918b757b-16ea-4baa-9ee5-3bae0404387b tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 969 time: 0.0862679 Dec 21 03:43:06.335760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c5f67c-3819-402a-af50-55013b534f47 req-e7325644-1da9-40d9-8fb7-d357bececd00 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:06.337235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5c5f67c-3819-402a-af50-55013b534f47 req-e7325644-1da9-40d9-8fb7-d357bececd00 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 931 time: 0.0954297 Dec 21 03:43:06.365697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ad7dc69-7b90-44fd-8ab7-376aa6600c2e req-76ed3e80-da3d-4d83-b04f-630a72b57685 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137421 Dec 21 03:43:06.367537 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5b540f50-0267-4583-8056-57f7cdfb7a8f req-75a5ab9d-f895-49d5-9c3e-f1f1f8f11e99 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.430783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5c5f67c-3819-402a-af50-55013b534f47 req-e86d32e0-8088-4c6b-8a05-95239d9cfdf2 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875795 Dec 21 03:43:06.443829 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5b540f50-0267-4583-8056-57f7cdfb7a8f req-75a5ab9d-f895-49d5-9c3e-f1f1f8f11e99 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.448231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 552d2bbd-e22b-4bf0-a3fc-056e9948167e {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:06.457401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.472565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Transition to ACTIVE for port object 552d2bbd-e22b-4bf0-a3fc-056e9948167e will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:06.534215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f523643-fb24-4c50-8ca5-471bb97b8079 req-a54b602f-d9a9-4bd7-8fb0-4f7d788aac75 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 210 time: 0.0459552 Dec 21 03:43:06.536180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a5ab9d-f895-49d5-9c3e-f1f1f8f11e99 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=a4787eaa-1dc9-4c06-8bc8-40ab4a818e9b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:06.541052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b540f50-0267-4583-8056-57f7cdfb7a8f req-75a5ab9d-f895-49d5-9c3e-f1f1f8f11e99 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4111030 Dec 21 03:43:06.557167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.613184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Pushing event updated for resources: {'Port': ['ID=552d2bbd-e22b-4bf0-a3fc-056e9948167e,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:06.654744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40234) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:06.658180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Attempting to bind port 552d2bbd-e22b-4bf0-a3fc-056e9948167e on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:06.659410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Attempting to bind port 552d2bbd-e22b-4bf0-a3fc-056e9948167e by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:06.660135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Attempting to bind port 552d2bbd-e22b-4bf0-a3fc-056e9948167e on network be2315d6-c735-4ecb-b299-a3b1405aa378 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:06.664390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:43:06.670034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Port 552d2bbd-e22b-4bf0-a3fc-056e9948167e on network be2315d6-c735-4ecb-b299-a3b1405aa378 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:06.670839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Attempting to bind port 552d2bbd-e22b-4bf0-a3fc-056e9948167e on network be2315d6-c735-4ecb-b299-a3b1405aa378 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:06.676794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:06.677412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Checking segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:06.678039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Bound using segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:06.678678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Bound port: 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:06.679276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.793661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-e7e14789-b23d-4ad2-a82c-e31e88b0e06d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:06.795274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-e7e14789-b23d-4ad2-a82c-e31e88b0e06d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.54 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 824 time: 0.2314110 Dec 21 03:43:06.807902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5497ed43-394e-4173-81e1-84a51aeee415 req-1df594c4-8c2f-4186-b901-3f07e2f182a6 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:06.809574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5497ed43-394e-4173-81e1-84a51aeee415 req-1df594c4-8c2f-4186-b901-3f07e2f182a6 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 950 time: 0.1102195 Dec 21 03:43:06.959444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 09554808-aec9-4511-ba46-8a6519a51c3a details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:06.980911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63108dd7-368a-466b-adb2-5c19bad4734e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:06.985230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-09f9a85b-9037-480d-9251-293cfc1e7c96 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c HTTP/1.1" status: 200 len: 380 time: 0.1692541 Dec 21 03:43:07.014119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'port': {'device_id': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'admin_state_up': True, 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'security_groups': ['fa8f8344-ed72-403c-a269-225bbf5487c9']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:07.031185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] For port 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:07.047407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5497ed43-394e-4173-81e1-84a51aeee415 req-f4a88ecf-b0ac-413d-87f3-8fa9506ba5e8 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2253971 Dec 21 03:43:07.051668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] For port 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:07.124640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.134693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63108dd7-368a-466b-adb2-5c19bad4734e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.152562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 09554808-aec9-4511-ba46-8a6519a51c3a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=09554808-aec9-4511-ba46-8a6519a51c3a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:07.176342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:07.176990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.178402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] 10.222.0.31 "PUT /v2.0/ports/552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 1092 time: 1.2101531 Dec 21 03:43:07.178865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:07.181961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '09554808-aec9-4511-ba46-8a6519a51c3a', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '09554808-aec9-4511-ba46-8a6519a51c3a', 'mac_address': 'fa:16:3e:2b:ba:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.67'}], 'device_owner': 'compute:tempest-test_az-2070989439', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:07.182470 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7" -d '{"events": [{"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:07.202092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63108dd7-368a-466b-adb2-5c19bad4734e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.242589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.263618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 09554808-aec9-4511-ba46-8a6519a51c3a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:07.271850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21b74dc-c943-411d-8097-62781f1f08e1 service neutron] Pushing event updated for resources: {'Port': ['ID=552d2bbd-e22b-4bf0-a3fc-056e9948167e,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:07.282573 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-353bc839-f6be-4b9a-867f-f1aeadd6eaf6 x-openstack-request-id: req-353bc839-f6be-4b9a-867f-f1aeadd6eaf6 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:07.282999 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:07.283257 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-353bc839-f6be-4b9a-867f-f1aeadd6eaf6 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:07.283926 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'status': 'completed', 'code': 200} Dec 21 03:43:07.289259 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-63108dd7-368a-466b-adb2-5c19bad4734e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9fa2f99db7e749ff8187852acdf998c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6301646 Dec 21 03:43:07.292564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40254) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:07.303186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 09554808-aec9-4511-ba46-8a6519a51c3a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=09554808-aec9-4511-ba46-8a6519a51c3a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:07.307114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63108dd7-368a-466b-adb2-5c19bad4734e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=154d177a-06a5-4c37-a615-78e06e6f92fc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:07.352375 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.395787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-277db391-14cd-461d-af62-322ff0c7ab9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.419823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=09554808-aec9-4511-ba46-8a6519a51c3a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:07.425451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7 req-ff4964de-52b8-4e82-898e-4f1a4de8e559 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:07.428252 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7 req-ff4964de-52b8-4e82-898e-4f1a4de8e559 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1095 time: 0.1104126 Dec 21 03:43:07.442671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-277db391-14cd-461d-af62-322ff0c7ab9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.489444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Made reservation on behalf of 2637e7ec4ea74cb6a3ec5d635dce4a5c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:07.492693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.514476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b39395ff-6159-4b06-8fc7-fdf558d61f9a req-efbb28e2-3020-4ccf-b9bc-44cc0df774a7 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:07.516286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b39395ff-6159-4b06-8fc7-fdf558d61f9a req-efbb28e2-3020-4ccf-b9bc-44cc0df774a7 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 970 time: 0.0713995 Dec 21 03:43:07.662419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40264) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:07.664467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd31cdf-9f5a-4972-a159-02c5106bfa75 req-becff85a-17e7-4a04-ad50-d15c58f394c7 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:07.669792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd31cdf-9f5a-4972-a159-02c5106bfa75 req-becff85a-17e7-4a04-ad50-d15c58f394c7 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 943 time: 0.1498988 Dec 21 03:43:07.673489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7 req-134f2af0-dc26-4245-9a6b-f3a796277371 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:07.675708 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7 req-134f2af0-dc26-4245-9a6b-f3a796277371 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=d3c7911e116e4170812afec94091929a&shared=False HTTP/1.1" status: 200 len: 922 time: 0.2306993 Dec 21 03:43:07.700272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b39395ff-6159-4b06-8fc7-fdf558d61f9a req-d46d08a5-3d69-4ee0-853f-9d21dbd8d03c tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1721504 Dec 21 03:43:07.717532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-277db391-14cd-461d-af62-322ff0c7ab9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.720090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-277db391-14cd-461d-af62-322ff0c7ab9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.721789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-277db391-14cd-461d-af62-322ff0c7ab9d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/154d177a-06a5-4c37-a615-78e06e6f92fc HTTP/1.1" status: 204 len: 168 time: 0.4277012 Dec 21 03:43:07.761481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277db391-14cd-461d-af62-322ff0c7ab9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=154d177a-06a5-4c37-a615-78e06e6f92fc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:07.773012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Allocated IP 172.20.0.13 (97e3dbcb-7ac2-4207-82ae-df7e1df411c2/8ca201b9-7506-4b6b-8a03-05d4689a5e59/3879ae01-e336-4975-a479-fdaef03236a1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:07.775328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['09554808-aec9-4511-ba46-8a6519a51c3a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:07.810703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd31cdf-9f5a-4972-a159-02c5106bfa75 req-e6024dd0-3c71-452c-b02a-af4e0871e9d7 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191127 Dec 21 03:43:07.866750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9aff155-13ac-4bb0-a4db-76f2870263c7 req-ba51c126-c508-43b4-ac2b-7b65ea1f4370 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 210 time: 0.0473838 Dec 21 03:43:07.889352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5470ee72-919e-46cc-8b88-121ca9400757 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:07.974058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7 req-d118d387-0ef9-41ea-821f-3d439e3d65c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:07.976646 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-755d96cb-57e5-48ed-a188-1a8c9bb17ca7 req-d118d387-0ef9-41ea-821f-3d439e3d65c0 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2926371 Dec 21 03:43:07.999514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:08.033214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5470ee72-919e-46cc-8b88-121ca9400757 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:08.087920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-96b2f2e8-9c07-48e4-91b4-5d18cf90d7a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:08.089420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-96b2f2e8-9c07-48e4-91b4-5d18cf90d7a2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1095 time: 0.0429103 Dec 21 03:43:08.140336 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-d7e5c3bc-82b2-4344-a560-0d044641bbb3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 217 time: 0.0349684 Dec 21 03:43:08.174101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81da90d2-48e0-4b4f-9495-fcc20b1242d2 req-640d76b3-fa8b-41e9-8370-30d5d8ca5ed3 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:08.175601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81da90d2-48e0-4b4f-9495-fcc20b1242d2 req-640d76b3-fa8b-41e9-8370-30d5d8ca5ed3 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 950 time: 0.0552764 Dec 21 03:43:08.198452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-27da036a-0c71-44f0-9b19-892e5c0558c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:08.199967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-27da036a-0c71-44f0-9b19-892e5c0558c5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.0507405 Dec 21 03:43:08.235933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81da90d2-48e0-4b4f-9495-fcc20b1242d2 req-7ded1eee-6465-49fd-bcab-0d93e73980d4 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523062 Dec 21 03:43:08.253328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d7845-55c0-4734-9a31-27f18400df7e req-c793c597-75d4-4729-b5bb-3fec3bf54dc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:08.253656 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-c793c597-75d4-4729-b5bb-3fec3bf54dc1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0422075 Dec 21 03:43:08.342354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-aef4babe-4aff-419e-a0b4-fb8939dc4c19 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808349 Dec 21 03:43:08.451532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c84d7845-55c0-4734-9a31-27f18400df7e req-e0fa27cc-0114-4b77-ad01-9f30c3f929da service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0967798 Dec 21 03:43:08.823224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a00717-d9d6-475a-87a1-a9ad5cfc2a65 req-1243546b-527f-4777-94b4-3550c2eea65a tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:08.824728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26a00717-d9d6-475a-87a1-a9ad5cfc2a65 req-1243546b-527f-4777-94b4-3550c2eea65a tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 970 time: 0.0492773 Dec 21 03:43:08.870893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5470ee72-919e-46cc-8b88-121ca9400757 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:08.871174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:08.899317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26a00717-d9d6-475a-87a1-a9ad5cfc2a65 req-72a67e96-40e0-42ad-b73e-c8462b5fecd3 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638282 Dec 21 03:43:08.927510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5470ee72-919e-46cc-8b88-121ca9400757 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=29e82da054a24c77aba8afba146bd7b6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2639918 Dec 21 03:43:08.928235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40280) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:08.928869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5470ee72-919e-46cc-8b88-121ca9400757 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87fec5af-463f-496c-878f-577e75f43b49,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:08.968307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 09554808-aec9-4511-ba46-8a6519a51c3a up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:08.978955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:08.997419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d40429d-705a-4bc0-aebc-5297daf5f431 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:08.997653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:09.001530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:09.009631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:09.010288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.012985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'Port': ['ID=3879ae01-e336-4975-a479-fdaef03236a1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:09.025607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d40429d-705a-4bc0-aebc-5297daf5f431 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.072093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d77b78-7288-4621-8913-25314704c542 req-6bbb4132-bc4d-4391-99f6-4e70dba16be3 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:09.077635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88d77b78-7288-4621-8913-25314704c542 req-6bbb4132-bc4d-4391-99f6-4e70dba16be3 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 943 time: 0.1430371 Dec 21 03:43:09.084283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2212a34-54bb-41de-ae57-95b24bd56374 req-5f044f87-15cc-4698-8405-5f41b75222df tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:09.085818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2212a34-54bb-41de-ae57-95b24bd56374 req-5f044f87-15cc-4698-8405-5f41b75222df tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 932 time: 0.1090612 Dec 21 03:43:09.162338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-5276531a-9772-4c48-8d09-193d46612947 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1580238 Dec 21 03:43:09.169075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88d77b78-7288-4621-8913-25314704c542 req-0ef05504-b36c-4627-a631-823184b1e233 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773199 Dec 21 03:43:09.190505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 09554808-aec9-4511-ba46-8a6519a51c3a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:09.190654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d40429d-705a-4bc0-aebc-5297daf5f431 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.191216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 09554808-aec9-4511-ba46-8a6519a51c3a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:09.191308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2212a34-54bb-41de-ae57-95b24bd56374 req-5a10ceb0-5811-4e33-b712-750ec2e0c4a9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0799942 Dec 21 03:43:09.191395 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.194556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Request body: {'port': {'device_id': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'device_owner': 'compute:tempest-test_az-2070989439', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:09.200218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d40429d-705a-4bc0-aebc-5297daf5f431 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.204894 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d40429d-705a-4bc0-aebc-5297daf5f431 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/87fec5af-463f-496c-878f-577e75f43b49 HTTP/1.1" status: 204 len: 168 time: 0.2688036 Dec 21 03:43:09.231857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d40429d-705a-4bc0-aebc-5297daf5f431 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87fec5af-463f-496c-878f-577e75f43b49,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:09.280188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.317208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.342077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4bf004a2-2597-405c-961a-417297bcb4bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '09554808-aec9-4511-ba46-8a6519a51c3a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:09.344283 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be9b106a-2a2e-4f92-bc9f-aaa6e633133c" -d '{"events": [{"server_uuid": "4bf004a2-2597-405c-961a-417297bcb4bc", "name": "network-vif-plugged", "status": "completed", "tag": "09554808-aec9-4511-ba46-8a6519a51c3a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:09.368698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 09554808-aec9-4511-ba46-8a6519a51c3a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=09554808-aec9-4511-ba46-8a6519a51c3a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:09.373773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ddd54a03-78f6-426c-9424-2c9c3149bda4 None None] Provisioning complete for port 3879ae01-e336-4975-a479-fdaef03236a1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:09.374368 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ddd54a03-78f6-426c-9424-2c9c3149bda4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.397454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:09.405157 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55c0c428-ada9-496a-a848-d516cc2da63a x-openstack-request-id: req-55c0c428-ada9-496a-a848-d516cc2da63a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:09.408242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4bf004a2-2597-405c-961a-417297bcb4bc", "name": "network-vif-plugged", "status": "completed", "tag": "09554808-aec9-4511-ba46-8a6519a51c3a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:09.409117 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-55c0c428-ada9-496a-a848-d516cc2da63a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:09.409545 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4bf004a2-2597-405c-961a-417297bcb4bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '09554808-aec9-4511-ba46-8a6519a51c3a', 'code': 200} Dec 21 03:43:09.413231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4993775d-49a9-4242-a8bb-c68e3d5c7b32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.427074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ddd54a03-78f6-426c-9424-2c9c3149bda4 None None] Port 3879ae01-e336-4975-a479-fdaef03236a1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:09.443416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.472228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce0edb6-9dd0-4da3-8dae-6fc2e8ad24c2 req-6a27ea87-ef06-4b97-9153-8259cee6b7cf tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:09.480816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dce0edb6-9dd0-4da3-8dae-6fc2e8ad24c2 req-6a27ea87-ef06-4b97-9153-8259cee6b7cf tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 950 time: 0.1563585 Dec 21 03:43:09.492425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.54', 58372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:09.510001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=09554808-aec9-4511-ba46-8a6519a51c3a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:09.547912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4993775d-49a9-4242-a8bb-c68e3d5c7b32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.569012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5349f2c-721e-43c1-8ead-fa7585499a48 req-adabf6ee-e24c-41a4-9882-e60a48b21d1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:09.570498 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c5349f2c-721e-43c1-8ead-fa7585499a48 req-adabf6ee-e24c-41a4-9882-e60a48b21d1e service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 1123 time: 0.0771732 Dec 21 03:43:09.578904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dce0edb6-9dd0-4da3-8dae-6fc2e8ad24c2 req-cd8b6a82-7605-4345-a121-ecb84e3db412 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971959 Dec 21 03:43:09.629962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4993775d-49a9-4242-a8bb-c68e3d5c7b32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.666992 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c5349f2c-721e-43c1-8ead-fa7585499a48 req-22faf459-f7ed-46f0-88a9-360d1503b671 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887790 Dec 21 03:43:09.682808 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4993775d-49a9-4242-a8bb-c68e3d5c7b32 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=19b0448f2e024cb0aba3aac71e4ecf55&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2841201 Dec 21 03:43:09.686179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:09.689381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4993775d-49a9-4242-a8bb-c68e3d5c7b32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0d46257-f193-41b3-a110-1d7c5282043a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:09.707639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3879ae01-e336-4975-a479-fdaef03236a1 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:09.715589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.729530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Transition to ACTIVE for port object 3879ae01-e336-4975-a479-fdaef03236a1 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:09.748639 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7fccaaa3-8d72-4b58-a1db-9552265b740f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.771179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7fccaaa3-8d72-4b58-a1db-9552265b740f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.808506 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.859779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Pushing event updated for resources: {'Port': ['ID=3879ae01-e336-4975-a479-fdaef03236a1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:09.892225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Attempting to bind port 3879ae01-e336-4975-a479-fdaef03236a1 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:09.892581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Attempting to bind port 3879ae01-e336-4975-a479-fdaef03236a1 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:09.893474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Attempting to bind port 3879ae01-e336-4975-a479-fdaef03236a1 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:09.894271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7fccaaa3-8d72-4b58-a1db-9552265b740f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.897942 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7fccaaa3-8d72-4b58-a1db-9552265b740f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.898405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Port 3879ae01-e336-4975-a479-fdaef03236a1 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:09.901704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Attempting to bind port 3879ae01-e336-4975-a479-fdaef03236a1 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:09.901805 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7fccaaa3-8d72-4b58-a1db-9552265b740f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f0d46257-f193-41b3-a110-1d7c5282043a HTTP/1.1" status: 204 len: 168 time: 0.2120481 Dec 21 03:43:09.904335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:09.904700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Checking segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:09.905056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Bound using segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:09.905488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Bound port: 3879ae01-e336-4975-a479-fdaef03236a1, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:09.905848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:09.907735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fccaaa3-8d72-4b58-a1db-9552265b740f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0d46257-f193-41b3-a110-1d7c5282043a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:10.042633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] For port 3879ae01-e336-4975-a479-fdaef03236a1, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:10.047102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] For port 3879ae01-e336-4975-a479-fdaef03236a1, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3879ae01-e336-4975-a479-fdaef03236a1,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: from cryptography.utils import int_from_bytes Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: from cryptography.utils import int_from_bytes Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.052261 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:10.054882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:10.056667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e525745b-729b-47e4-a5ab-9b796cbd6d24 req-962fb8a6-97c6-41f5-9ed2-38e1464bf802 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.058186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e525745b-729b-47e4-a5ab-9b796cbd6d24 req-962fb8a6-97c6-41f5-9ed2-38e1464bf802 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 971 time: 0.0878108 Dec 21 03:43:10.103106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40302) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:10.117676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.119796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfcfa19b-e39a-46c3-bacf-a731c86d1038 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.123760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e525745b-729b-47e4-a5ab-9b796cbd6d24 req-1d046087-66da-47c0-9d9c-e54e2cda421c tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595217 Dec 21 03:43:10.164087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.164717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.166101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] 10.222.0.54 "PUT /v2.0/ports/3879ae01-e336-4975-a479-fdaef03236a1 HTTP/1.1" status: 200 len: 1115 time: 0.9763563 Dec 21 03:43:10.166552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:10.168893 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7967b1f-1542-409a-94eb-73375d7c92a9" -d '{"events": [{"name": "network-changed", "server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "tag": "3879ae01-e336-4975-a479-fdaef03236a1"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:10.190157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e55131-b2cc-449c-89b3-5abbd6a8d450 service neutron] Pushing event updated for resources: {'Port': ['ID=3879ae01-e336-4975-a479-fdaef03236a1,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:10.224331 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6659e6fb-8587-4c2a-94ea-07d60ac66984 x-openstack-request-id: req-6659e6fb-8587-4c2a-94ea-07d60ac66984 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:10.233843 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "tag": "3879ae01-e336-4975-a479-fdaef03236a1", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:10.233843 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6659e6fb-8587-4c2a-94ea-07d60ac66984 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:10.233843 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1', 'status': 'completed', 'code': 200} Dec 21 03:43:10.257466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfcfa19b-e39a-46c3-bacf-a731c86d1038 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.360912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7967b1f-1542-409a-94eb-73375d7c92a9 req-757b7056-029e-43d5-bb1a-24ec73cc80a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.362588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7967b1f-1542-409a-94eb-73375d7c92a9 req-757b7056-029e-43d5-bb1a-24ec73cc80a5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 1118 time: 0.0852485 Dec 21 03:43:10.374240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b678ccb1-4d3d-4c56-88ee-6261c8ebc850 req-685279ae-3a1a-42a1-9fb3-4ba48dbe5cf5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.375954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b678ccb1-4d3d-4c56-88ee-6261c8ebc850 req-685279ae-3a1a-42a1-9fb3-4ba48dbe5cf5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 943 time: 0.0883520 Dec 21 03:43:10.392224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfcfa19b-e39a-46c3-bacf-a731c86d1038 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.442157 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfcfa19b-e39a-46c3-bacf-a731c86d1038 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e8a81527a6884dfeb745e9655894c88e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3377490 Dec 21 03:43:10.445906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40320) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:10.453724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfcfa19b-e39a-46c3-bacf-a731c86d1038 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95f39577-e4b8-4a98-8935-5165ce7bc41c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:10.637467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b678ccb1-4d3d-4c56-88ee-6261c8ebc850 req-ae66ee98-7011-4ad6-99f1-43f597935b89 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2490602 Dec 21 03:43:10.659626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22ec8f38-d1dd-4ff9-8234-1989b2343451 req-e027b9b5-b663-42ac-9a9d-268fb1306e54 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.661103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22ec8f38-d1dd-4ff9-8234-1989b2343451 req-e027b9b5-b663-42ac-9a9d-268fb1306e54 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 966 time: 0.1645157 Dec 21 03:43:10.662084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7967b1f-1542-409a-94eb-73375d7c92a9 req-7999b644-dbe1-460a-9bcd-12ce6a2acf80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.663468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7967b1f-1542-409a-94eb-73375d7c92a9 req-7999b644-dbe1-460a-9bcd-12ce6a2acf80 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&shared=False HTTP/1.1" status: 200 len: 925 time: 0.2831130 Dec 21 03:43:10.670263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74b9fc8c-6a40-45c3-8793-ff66189d2f8e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.790953 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74b9fc8c-6a40-45c3-8793-ff66189d2f8e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:10.929424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa4f4f48-1551-42ed-b24a-695b3a318ac5 req-04da0528-4679-45f9-8d7b-77bfe6b92df4 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.934314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa4f4f48-1551-42ed-b24a-695b3a318ac5 req-04da0528-4679-45f9-8d7b-77bfe6b92df4 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 950 time: 0.2140298 Dec 21 03:43:10.934314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22ec8f38-d1dd-4ff9-8234-1989b2343451 req-d6e3073e-f6be-4913-9f9d-cd9d9fe28255 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2659073 Dec 21 03:43:10.963408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7967b1f-1542-409a-94eb-73375d7c92a9 req-3bb89eda-5c65-42c3-b7b8-946ce7873a25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:10.964772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7967b1f-1542-409a-94eb-73375d7c92a9 req-3bb89eda-5c65-42c3-b7b8-946ce7873a25 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2881086 Dec 21 03:43:10.999629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa4f4f48-1551-42ed-b24a-695b3a318ac5 req-4af00c02-6021-4dbf-b80c-41416938b068 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601461 Dec 21 03:43:11.058781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74b9fc8c-6a40-45c3-8793-ff66189d2f8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:11.061378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74b9fc8c-6a40-45c3-8793-ff66189d2f8e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:11.062450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-74b9fc8c-6a40-45c3-8793-ff66189d2f8e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/95f39577-e4b8-4a98-8935-5165ce7bc41c HTTP/1.1" status: 204 len: 168 time: 0.6139266 Dec 21 03:43:11.075725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b9fc8c-6a40-45c3-8793-ff66189d2f8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95f39577-e4b8-4a98-8935-5165ce7bc41c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:11.083929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-04ce8fe6-fd16-4995-845e-eb36cf22fdd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:11.088451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-04ce8fe6-fd16-4995-845e-eb36cf22fdd2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 1118 time: 0.0572543 Dec 21 03:43:11.139144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-224d966d-60e5-4816-ba10-6ef146e3c492 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3879ae01-e336-4975-a479-fdaef03236a1 HTTP/1.1" status: 200 len: 217 time: 0.0357294 Dec 21 03:43:11.400215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-2fb2f09b-a1c9-4cd2-be8b-363db776f1a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:11.401862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-2fb2f09b-a1c9-4cd2-be8b-363db776f1a1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.2550323 Dec 21 03:43:11.429097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e05f9e-d32b-4f03-933c-9d3820e52c71 req-41b00e50-2bc8-42b1-963e-f931999f656f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:11.430595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52e05f9e-d32b-4f03-933c-9d3820e52c71 req-41b00e50-2bc8-42b1-963e-f931999f656f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 971 time: 0.0723355 Dec 21 03:43:11.488724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-850ace1c-642a-4c9a-b9c9-94e61b675c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:11.490165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-850ace1c-642a-4c9a-b9c9-94e61b675c2b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0799699 Dec 21 03:43:11.497598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52e05f9e-d32b-4f03-933c-9d3820e52c71 req-1fa2a611-9f16-4645-87af-125724ba98f9 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535131 Dec 21 03:43:11.636073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-139ffd79-97cf-4498-9b87-7da1372a374c service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1139874 Dec 21 03:43:11.796885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fcd53a-1c6e-4b48-a4d5-e6e099db67fb req-f2c1e28d-469e-4047-b940-b04d2c220e5e service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1515725 Dec 21 03:43:11.805456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1130a4fc-e0eb-4f4c-b7c7-4de93954ea37 req-54e30217-4c18-4779-ab89-d91941e1c528 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:11.806903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1130a4fc-e0eb-4f4c-b7c7-4de93954ea37 req-54e30217-4c18-4779-ab89-d91941e1c528 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 943 time: 0.0810823 Dec 21 03:43:11.864714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1130a4fc-e0eb-4f4c-b7c7-4de93954ea37 req-b2dc2061-af42-4cce-b8f5-14bdb77b34b4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503230 Dec 21 03:43:12.058738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f6d6ef-6d4d-422c-8818-216ce05bb1b8 req-ac070c81-b9bc-4d4d-a7c3-c212f6f2f715 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:12.060277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07f6d6ef-6d4d-422c-8818-216ce05bb1b8 req-ac070c81-b9bc-4d4d-a7c3-c212f6f2f715 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 966 time: 0.0556781 Dec 21 03:43:12.110530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07f6d6ef-6d4d-422c-8818-216ce05bb1b8 req-fccda8d2-411b-40a8-acae-3eaace21c51e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426381 Dec 21 03:43:12.170900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-cb91d141-cb0f-4418-a08d-8243867498c0 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=680af371fc8f43789a63fa788b00602b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0218475 Dec 21 03:43:12.184225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0920928f-c528-447a-a601-aeb01387677d req-76111f80-cbe5-4bd9-bc27-4ff5508d63cc tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:12.186306 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0920928f-c528-447a-a601-aeb01387677d req-76111f80-cbe5-4bd9-bc27-4ff5508d63cc tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 1102 time: 0.0469673 Dec 21 03:43:12.274449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Deleting port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:43:12.274876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:12.308858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac1cf29-0a33-4612-87cb-761fb7610b65 req-cdb6da9e-41e4-487d-821b-10eb2269212f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:12.308858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cac1cf29-0a33-4612-87cb-761fb7610b65 req-cdb6da9e-41e4-487d-821b-10eb2269212f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 950 time: 0.1041720 Dec 21 03:43:12.338548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-991b6e56-38d5-43bb-a60f-5699a757f2ba tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:12.340017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-991b6e56-38d5-43bb-a60f-5699a757f2ba tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1635497 Dec 21 03:43:12.371474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-0d88fccc-77b4-4399-9e76-5c9015a54820 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/quotas/680af371fc8f43789a63fa788b00602b HTTP/1.1" status: 200 len: 375 time: 0.0233197 Dec 21 03:43:12.372001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] For port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:12.372366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:12.389872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Calling delete_port for 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:43:12.399511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cac1cf29-0a33-4612-87cb-761fb7610b65 req-3e5740e8-63e1-4692-8d11-7addba9ee77e tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811613 Dec 21 03:43:12.420905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-33ac53d1-e5b3-493e-8130-7e05a5fe42ff tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=680af371fc8f43789a63fa788b00602b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0343955 Dec 21 03:43:12.622460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed30865-81f8-4db0-b316-7ae911d5c13d req-db3c9ed7-9b25-4fd5-90f8-15867036627f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:12.624059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aed30865-81f8-4db0-b316-7ae911d5c13d req-db3c9ed7-9b25-4fd5-90f8-15867036627f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 971 time: 0.0503588 Dec 21 03:43:12.676284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:12.712631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aed30865-81f8-4db0-b316-7ae911d5c13d req-832b030d-aa1b-406d-9c90-18b9ec6dd34f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806253 Dec 21 03:43:12.720035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['07e6b3ff-ea95-40ee-bb57-6dd4050fb305'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:12.770670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Pushing event deleted for resources: {'Port': ['ID=07e6b3ff-ea95-40ee-bb57-6dd4050fb305,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:12.818649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] No DVR routers for this DVR port 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:43:12.822284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:12.826043 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0920928f-c528-447a-a601-aeb01387677d req-683cd441-157e-4c5c-b6cd-6ae69d0ae389 tempest-DeleteServersAdminTestJSON-1245117755 tempest-DeleteServersAdminTestJSON-1245117755-project-admin] 10.222.0.31 "DELETE /v2.0/ports/07e6b3ff-ea95-40ee-bb57-6dd4050fb305 HTTP/1.1" status: 204 len: 173 time: 0.6310849 Dec 21 03:43:12.826686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ae433f7-b449-4490-aa67-080e50be8d75', 'name': 'network-vif-deleted', 'tag': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:12.828813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4bed5e4-df72-46cb-b4f7-4f04ea68dda1 req-815b0dd7-134c-45a0-ac73-07162ea88df3 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 210 time: 0.0525880 Dec 21 03:43:12.832422 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85eadfbf-0562-4e5c-9d7c-34dd3ee81309" -d '{"events": [{"server_uuid": "1ae433f7-b449-4490-aa67-080e50be8d75", "name": "network-vif-deleted", "tag": "07e6b3ff-ea95-40ee-bb57-6dd4050fb305"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:12.993513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-602fb8db-9e9e-4984-8b3b-cd531bd6638b req-e57d35d3-7f66-4428-8a9b-7b39319402ea tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:12.995185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-602fb8db-9e9e-4984-8b3b-cd531bd6638b req-e57d35d3-7f66-4428-8a9b-7b39319402ea tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 1123 time: 0.0986996 Dec 21 03:43:13.017473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-602fb8db-9e9e-4984-8b3b-cd531bd6638b req-67b157fc-dcdd-46ce-b664-fb7de7d4da31 tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:13.076718 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5fc6ae3-9f83-4528-9634-9c9c9b747db9 x-openstack-request-id: req-f5fc6ae3-9f83-4528-9634-9c9c9b747db9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:13.077016 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ae433f7-b449-4490-aa67-080e50be8d75", "name": "network-vif-deleted", "tag": "07e6b3ff-ea95-40ee-bb57-6dd4050fb305", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:13.077270 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f5fc6ae3-9f83-4528-9634-9c9c9b747db9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:13.077667 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ae433f7-b449-4490-aa67-080e50be8d75', 'name': 'network-vif-deleted', 'tag': '07e6b3ff-ea95-40ee-bb57-6dd4050fb305', 'status': 'completed', 'code': 200} Dec 21 03:43:13.115589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-602fb8db-9e9e-4984-8b3b-cd531bd6638b req-67b157fc-dcdd-46ce-b664-fb7de7d4da31 tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:13.169273 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-602fb8db-9e9e-4984-8b3b-cd531bd6638b req-67b157fc-dcdd-46ce-b664-fb7de7d4da31 tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:13.224195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0858438-80d4-4ed9-8a39-9f1d5080d8ef req-36614737-a52d-47a2-893a-3dc4c6f53e9f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:13.226449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0858438-80d4-4ed9-8a39-9f1d5080d8ef req-36614737-a52d-47a2-893a-3dc4c6f53e9f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 943 time: 0.0836549 Dec 21 03:43:13.232016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 552d2bbd-e22b-4bf0-a3fc-056e9948167e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:13.243167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-602fb8db-9e9e-4984-8b3b-cd531bd6638b req-67b157fc-dcdd-46ce-b664-fb7de7d4da31 tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2321928 Dec 21 03:43:13.245694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b157fc-dcdd-46ce-b664-fb7de7d4da31 tempest-AggregatesAdminTestJSON-1705659024 tempest-AggregatesAdminTestJSON-1705659024-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8abddbc5-66bf-4cb7-a4b4-c7c8398fc37f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:13.309510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0858438-80d4-4ed9-8a39-9f1d5080d8ef req-c23b29e8-5f0b-4c9f-8db4-cd98fff9dfca tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650332 Dec 21 03:43:13.348970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c75294-cabf-44bb-923c-804cdbd78dd7 req-49d68b1d-17d0-48cf-bce1-cf18d7a28f10 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:13.350566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46c75294-cabf-44bb-923c-804cdbd78dd7 req-49d68b1d-17d0-48cf-bce1-cf18d7a28f10 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 966 time: 0.0572712 Dec 21 03:43:13.377537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:13.389016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:13.404449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46c75294-cabf-44bb-923c-804cdbd78dd7 req-5034f9e8-ad7e-4c4c-831a-e5b7047a77c4 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442672 Dec 21 03:43:13.437567 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:13.449277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 552d2bbd-e22b-4bf0-a3fc-056e9948167e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:13.480527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:13.545854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:13.594906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=552d2bbd-e22b-4bf0-a3fc-056e9948167e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:13.635889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc9bc1f1-ecf0-48b5-8700-078911e9a942 req-d4c80eda-7c7a-49c4-b939-2e75ea829bd9 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=1ae433f7-b449-4490-aa67-080e50be8d75 HTTP/1.1" status: 200 len: 210 time: 0.0377567 Dec 21 03:43:13.862838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['552d2bbd-e22b-4bf0-a3fc-056e9948167e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:14.119408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91993a0c-b131-42a0-981d-f34861641bd8 req-83433594-cef2-4307-85f4-9d4cd205a9bc tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 210 time: 0.0254493 Dec 21 03:43:14.450495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c06396f-4ce8-4d83-a69b-0af8b2313751 req-8ee25a82-d1c0-409d-8ff2-93c28e74c1a5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:14.452419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c06396f-4ce8-4d83-a69b-0af8b2313751 req-8ee25a82-d1c0-409d-8ff2-93c28e74c1a5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 944 time: 0.0638807 Dec 21 03:43:14.525064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c06396f-4ce8-4d83-a69b-0af8b2313751 req-6a4406d7-ee8a-4bfc-8591-ff21b762dab1 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645089 Dec 21 03:43:14.594222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40488) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:14.638807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd3d534-140c-45cb-9248-3834a0ff2627 req-756a9e6c-3500-4fff-a29f-c6fcce25ffb9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:14.640302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fd3d534-140c-45cb-9248-3834a0ff2627 req-756a9e6c-3500-4fff-a29f-c6fcce25ffb9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 966 time: 0.0569825 Dec 21 03:43:14.704930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fd3d534-140c-45cb-9248-3834a0ff2627 req-e1eaa799-88e7-45ed-9848-938fcf390d77 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532115 Dec 21 03:43:14.726546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e797cbb9-7f26-45c7-bf20-412d44ff63fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:14.802662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e797cbb9-7f26-45c7-bf20-412d44ff63fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:14.868421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e797cbb9-7f26-45c7-bf20-412d44ff63fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:14.882559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-c3651d7d-7413-4fba-91a8-9c3fa0982240 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=dc54f4797de4426ba52a3489b5990c5e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0260093 Dec 21 03:43:14.951060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e797cbb9-7f26-45c7-bf20-412d44ff63fb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5cd3ba5c341d43769ed78287ea1cdf87&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3553951 Dec 21 03:43:14.953628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:14.954220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e797cbb9-7f26-45c7-bf20-412d44ff63fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eae5a1b7-3f32-4c74-a68d-6ce34cb18b65,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:14.987229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3879ae01-e336-4975-a479-fdaef03236a1 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:15.028379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-fb34ff63-356e-44e3-adf6-5c4ae42ebea7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:15.035226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-802f06b5-2b74-4fea-9e81-42a03cc7f575 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.035895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-fb34ff63-356e-44e3-adf6-5c4ae42ebea7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1407003 Dec 21 03:43:15.051847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-83df598a-5bd3-453a-8736-e36c27796c4c tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/quotas/dc54f4797de4426ba52a3489b5990c5e HTTP/1.1" status: 200 len: 375 time: 0.0150177 Dec 21 03:43:15.065588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-802f06b5-2b74-4fea-9e81-42a03cc7f575 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.088714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-ac1aace1-8e2c-4ac1-8e85-66955375e265 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=dc54f4797de4426ba52a3489b5990c5e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0358980 Dec 21 03:43:15.134548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3879ae01-e336-4975-a479-fdaef03236a1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3879ae01-e336-4975-a479-fdaef03236a1,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:15.148243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '3879ae01-e336-4975-a479-fdaef03236a1', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'port_id': '3879ae01-e336-4975-a479-fdaef03236a1', 'mac_address': 'fa:16:3e:b6:7b:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:tempest-test_az-2070989439', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:15.196694 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-c5e0e2ab-a722-4dd9-890c-bae15dfa07e5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=680af371fc8f43789a63fa788b00602b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0242093 Dec 21 03:43:15.232201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-802f06b5-2b74-4fea-9e81-42a03cc7f575 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.235642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-802f06b5-2b74-4fea-9e81-42a03cc7f575 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.237105 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-802f06b5-2b74-4fea-9e81-42a03cc7f575 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/eae5a1b7-3f32-4c74-a68d-6ce34cb18b65 HTTP/1.1" status: 204 len: 168 time: 0.2825227 Dec 21 03:43:15.251438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802f06b5-2b74-4fea-9e81-42a03cc7f575 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eae5a1b7-3f32-4c74-a68d-6ce34cb18b65,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:15.339351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-679c9fd3-fcb6-4fa6-8431-87eacbc505ab req-abad920a-f99b-49c1-97ee-7ca4a209d20f tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 210 time: 0.0415726 Dec 21 03:43:15.352003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 552d2bbd-e22b-4bf0-a3fc-056e9948167e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:15.390953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-a47c8aa2-16a6-4aa5-a2a1-e611efb45859 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:15.399052 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-a47c8aa2-16a6-4aa5-a2a1-e611efb45859 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1959081 Dec 21 03:43:15.406455 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.413366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01be2ab6-6f07-4c10-afcd-77a1077e7e65 req-46b0a802-1fe2-4773-9b6e-36e0794f2c7a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 210 time: 0.0790982 Dec 21 03:43:15.431157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3879ae01-e336-4975-a479-fdaef03236a1 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:15.431381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Request body: {'port': {'device_id': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '680af371fc8f43789a63fa788b00602b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:15.453577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3879ae01-e336-4975-a479-fdaef03236a1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3879ae01-e336-4975-a479-fdaef03236a1,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:15.506094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 552d2bbd-e22b-4bf0-a3fc-056e9948167e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:15.509766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.517492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 552d2bbd-e22b-4bf0-a3fc-056e9948167e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:15.517912 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.597005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3879ae01-e336-4975-a479-fdaef03236a1,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:15.659838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Made reservation on behalf of 680af371fc8f43789a63fa788b00602b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:15.663583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.664048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a68994-e605-4e4c-9924-23884e964475 req-3f6ec698-81a2-4e1e-9022-6b0ceacb1909 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:15.664165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.665570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04a68994-e605-4e4c-9924-23884e964475 req-3f6ec698-81a2-4e1e-9022-6b0ceacb1909 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 944 time: 0.0650241 Dec 21 03:43:15.672880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.699800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:15.703665 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-019c1516-0b3b-493a-9be0-17c406e51d4f" -d '{"events": [{"server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "name": "network-vif-plugged", "status": "completed", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:15.715333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:15.741434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04a68994-e605-4e4c-9924-23884e964475 req-fccaa734-cf93-419a-809f-5f99d06a7db8 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662353 Dec 21 03:43:15.789621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.790524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.827413 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20e10df5-e3de-4445-8e38-457601102e9c x-openstack-request-id: req-20e10df5-e3de-4445-8e38-457601102e9c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:15.827793 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "name": "network-vif-plugged", "status": "completed", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:15.828636 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-20e10df5-e3de-4445-8e38-457601102e9c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:15.828769 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'code': 200} Dec 21 03:43:15.830898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['3879ae01-e336-4975-a479-fdaef03236a1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:15.865782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:15.923190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=552d2bbd-e22b-4bf0-a3fc-056e9948167e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:15.939463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac04d94-3315-4555-8505-47493f2685eb req-91e8c0c3-6cd5-475c-8e78-05f894d97b34 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:15.939771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:15.943010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac04d94-3315-4555-8505-47493f2685eb req-91e8c0c3-6cd5-475c-8e78-05f894d97b34 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 967 time: 0.0624850 Dec 21 03:43:16.064309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac04d94-3315-4555-8505-47493f2685eb req-e67e27a3-7f96-4212-bd68-2b21a0179b7a tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1159170 Dec 21 03:43:16.075386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e55934a-07af-40c8-9e4b-66288f41df8a req-47ab1fbd-43a3-495f-863c-5a563e9dd987 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:16.077149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e55934a-07af-40c8-9e4b-66288f41df8a req-47ab1fbd-43a3-495f-863c-5a563e9dd987 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.0860732 Dec 21 03:43:16.114235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Allocated IP 192.168.233.97 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/43cbd190-b145-423d-9f7c-f2f1eabaabc2) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:16.133678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e55934a-07af-40c8-9e4b-66288f41df8a req-4d1171ad-fecb-42af-b654-7c15f16a0d07 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440850 Dec 21 03:43:16.157917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40562) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:16.172226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7fb47e9-618a-4eda-9fc3-4855da5b2bb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.247895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7fb47e9-618a-4eda-9fc3-4855da5b2bb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.280408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.368432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7fb47e9-618a-4eda-9fc3-4855da5b2bb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.392586 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.406793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f7fb47e9-618a-4eda-9fc3-4855da5b2bb6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5112dee9c40c43818589ff9da207a473&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2447760 Dec 21 03:43:16.407679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40576) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:16.425925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7fb47e9-618a-4eda-9fc3-4855da5b2bb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81d346bc-0a6d-4722-ac03-7c99dfa2173d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:16.490115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85675ac6-456b-416b-a03e-32f3679eec5e req-b6b37a94-7674-42d3-9657-5baaafdeeae5 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 210 time: 0.0361953 Dec 21 03:43:16.505367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5763646-104b-48d8-ae7c-0f34a3fc6194 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.529772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5763646-104b-48d8-ae7c-0f34a3fc6194 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.632244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75608502-1add-42fa-bce5-781429cc8aaf req-afce0a6e-8077-4a52-8044-d3b9b6cc26c3 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:16.633751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75608502-1add-42fa-bce5-781429cc8aaf req-afce0a6e-8077-4a52-8044-d3b9b6cc26c3 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 935 time: 0.0735729 Dec 21 03:43:16.645783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:16.648765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:16.654098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:16.661300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:16.661300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.667606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Pushing event updated for resources: {'Port': ['ID=43cbd190-b145-423d-9f7c-f2f1eabaabc2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:16.700485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75608502-1add-42fa-bce5-781429cc8aaf req-da1c04c9-6141-455d-90e2-62feb27d46a5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606110 Dec 21 03:43:16.728421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5763646-104b-48d8-ae7c-0f34a3fc6194 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.731109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5763646-104b-48d8-ae7c-0f34a3fc6194 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.732407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5763646-104b-48d8-ae7c-0f34a3fc6194 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/81d346bc-0a6d-4722-ac03-7c99dfa2173d HTTP/1.1" status: 204 len: 168 time: 0.3236423 Dec 21 03:43:16.740396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5763646-104b-48d8-ae7c-0f34a3fc6194 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81d346bc-0a6d-4722-ac03-7c99dfa2173d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:16.765340 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-30ef2b6e-a75c-4a1f-bbb9-6b26e24f7e53 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.3416800 Dec 21 03:43:16.789595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Request body: {'port': {'device_id': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:16.898738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9a7a9420-b330-4900-b9d0-c7c35833e82a None None] Provisioning complete for port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:16.899339 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a7a9420-b330-4900-b9d0-c7c35833e82a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.911557 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:16.946791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71c6754-d884-4e44-93a0-dfe63c7ae7c5 req-e0dde532-2c2a-4edb-be86-3310d0949305 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:16.948291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71c6754-d884-4e44-93a0-dfe63c7ae7c5 req-e0dde532-2c2a-4edb-be86-3310d0949305 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 945 time: 0.0652511 Dec 21 03:43:16.963615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9a7a9420-b330-4900-b9d0-c7c35833e82a None None] Port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:16.999456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3879ae01-e336-4975-a479-fdaef03236a1 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:17.011168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71c6754-d884-4e44-93a0-dfe63c7ae7c5 req-9808aa17-2d01-4576-9efb-dd8794168b98 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565045 Dec 21 03:43:17.178193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 3879ae01-e336-4975-a479-fdaef03236a1 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:17.184788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 3879ae01-e336-4975-a479-fdaef03236a1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:17.185413 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.223278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-580b9f33-7048-4b24-a305-37c898fdf42a req-f0c01508-8619-42f3-ae03-e3919ebe3f9d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:17.225325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-580b9f33-7048-4b24-a305-37c898fdf42a req-f0c01508-8619-42f3-ae03-e3919ebe3f9d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 967 time: 0.0593951 Dec 21 03:43:17.252433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:43:17.265892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 43cbd190-b145-423d-9f7c-f2f1eabaabc2 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:17.274478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.293946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:43:17.294102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Transition to ACTIVE for port object 43cbd190-b145-423d-9f7c-f2f1eabaabc2 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:17.294215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 07e6b3ff-ea95-40ee-bb57-6dd4050fb305 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:43:17.303944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-580b9f33-7048-4b24-a305-37c898fdf42a req-2cc8ad1e-b494-46be-8f69-267a8bc22a6e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710764 Dec 21 03:43:17.363616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.368978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.432045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Pushing event updated for resources: {'Port': ['ID=43cbd190-b145-423d-9f7c-f2f1eabaabc2,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:17.447760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3879ae01-e336-4975-a479-fdaef03236a1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3879ae01-e336-4975-a479-fdaef03236a1,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:17.476517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Attempting to bind port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:17.477202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Attempting to bind port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:17.483169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Attempting to bind port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:17.485875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:17.485875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Attempting to bind port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:17.493668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:17.494005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:17.494581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:17.495059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Bound port: 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:17.495406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.498709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.581729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3879ae01-e336-4975-a479-fdaef03236a1,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:17.602991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] For port 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:17.606613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] For port 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:17.691452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.729247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f193dfaa-cd85-495c-986c-391235e851c6 req-57cd3068-f7d9-4521-ab7f-d542103f3051 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 210 time: 0.0283210 Dec 21 03:43:17.751684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:17.752322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:17.753741 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] 10.222.0.31 "PUT /v2.0/ports/43cbd190-b145-423d-9f7c-f2f1eabaabc2 HTTP/1.1" status: 200 len: 1096 time: 0.9703267 Dec 21 03:43:17.761103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'tag': '43cbd190-b145-423d-9f7c-f2f1eabaabc2'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:17.762835 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94894811-633a-43fc-85ee-0a747ea815b4" -d '{"events": [{"name": "network-changed", "server_uuid": "0354f6e5-2b90-41cf-924b-b3b9a8fc83b0", "tag": "43cbd190-b145-423d-9f7c-f2f1eabaabc2"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:17.793382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bab8a9-d157-43d9-8073-42d31f9404f9 service neutron] Pushing event updated for resources: {'Port': ['ID=43cbd190-b145-423d-9f7c-f2f1eabaabc2,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:17.821470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-14784698-1f71-402e-b1a1-20e02b5affde tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=dc54f4797de4426ba52a3489b5990c5e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0485342 Dec 21 03:43:17.830404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:17.841363 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-506af79f-d882-4f7d-a965-4051a5f3bd4d" -d '{"events": [{"server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "name": "network-vif-plugged", "status": "completed", "tag": "3879ae01-e336-4975-a479-fdaef03236a1"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:17.893885 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1505fcd7-8da2-4999-b981-58a55d4056b8 x-openstack-request-id: req-1505fcd7-8da2-4999-b981-58a55d4056b8 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:17.896010 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0354f6e5-2b90-41cf-924b-b3b9a8fc83b0", "tag": "43cbd190-b145-423d-9f7c-f2f1eabaabc2", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:17.896762 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1505fcd7-8da2-4999-b981-58a55d4056b8 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:17.900251 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'tag': '43cbd190-b145-423d-9f7c-f2f1eabaabc2', 'status': 'completed', 'code': 200} Dec 21 03:43:17.996789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-083a7102-ccee-4ba0-b8ee-49517785e0e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:17.999320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-083a7102-ccee-4ba0-b8ee-49517785e0e6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=680af371fc8f43789a63fa788b00602b&device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 1099 time: 0.0834105 Dec 21 03:43:18.065475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09b5a5f-9240-4721-a285-6121d70df7ae req-77e47b15-1979-4391-98c3-b98901173a0f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.068749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-6be03488-f896-4e8e-a53b-47117b19d258 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.97&port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2 HTTP/1.1" status: 200 len: 217 time: 0.0486388 Dec 21 03:43:18.078202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f09b5a5f-9240-4721-a285-6121d70df7ae req-77e47b15-1979-4391-98c3-b98901173a0f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 947 time: 0.1748266 Dec 21 03:43:18.113870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-8fe31903-317e-413e-a710-68569bdebf83 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.115782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-8fe31903-317e-413e-a710-68569bdebf83 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2880201 Dec 21 03:43:18.132516 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b74e67b-74f5-4f70-9062-88f136f76b5d x-openstack-request-id: req-2b74e67b-74f5-4f70-9062-88f136f76b5d {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:18.134247 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "name": "network-vif-plugged", "status": "completed", "tag": "3879ae01-e336-4975-a479-fdaef03236a1", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:18.134668 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2b74e67b-74f5-4f70-9062-88f136f76b5d {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:18.135326 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1', 'code': 200} Dec 21 03:43:18.135644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-b25e8095-3fb0-4cd5-baf7-f88d66ae6d86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.137192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-b25e8095-3fb0-4cd5-baf7-f88d66ae6d86 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0602579 Dec 21 03:43:18.145408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Request body: {'port': {'device_id': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'dc54f4797de4426ba52a3489b5990c5e'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:18.186965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71517ccb-0793-489a-b008-434f79e814c8 req-a0d3c6ae-a576-40b7-8955-1e73792ba0c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.188731 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-a0d3c6ae-a576-40b7-8955-1e73792ba0c9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0432160 Dec 21 03:43:18.311262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f09b5a5f-9240-4721-a285-6121d70df7ae req-74bf6d00-8c13-4586-a1f3-cb82fec10950 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1942759 Dec 21 03:43:18.320863 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-5c2c5f42-0bc1-43cd-911e-735a648a41b7 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235373 Dec 21 03:43:18.371950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d891e90-10d3-4975-8f1c-e3623a8f0528 req-6c1d8f35-d9b0-4262-90cf-80967ce40d29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.373469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d891e90-10d3-4975-8f1c-e3623a8f0528 req-6c1d8f35-d9b0-4262-90cf-80967ce40d29 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 1120 time: 0.1187103 Dec 21 03:43:18.400845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2400359-8c87-49ad-bbfa-defd0c6dce86 req-efc0381c-727d-4997-ae07-1abaf82d6ee9 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.402402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2400359-8c87-49ad-bbfa-defd0c6dce86 req-efc0381c-727d-4997-ae07-1abaf82d6ee9 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 945 time: 0.1082065 Dec 21 03:43:18.444457 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71517ccb-0793-489a-b008-434f79e814c8 req-8fb81fca-c30c-4bc5-aac8-59a41d938d08 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1156027 Dec 21 03:43:18.511178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2400359-8c87-49ad-bbfa-defd0c6dce86 req-94ff9348-3629-42aa-9be1-d9f4d24b28c5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941956 Dec 21 03:43:18.511178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d891e90-10d3-4975-8f1c-e3623a8f0528 req-9e14f32e-c880-40b6-9821-5e4b0d14d649 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1282814 Dec 21 03:43:18.551568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Made reservation on behalf of dc54f4797de4426ba52a3489b5990c5e for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:18.555315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:18.673512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db099027-b3cb-4775-a318-a86c03634fb3 req-bff2bf70-b787-4013-8b8c-25674495bae9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.675931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db099027-b3cb-4775-a318-a86c03634fb3 req-bff2bf70-b787-4013-8b8c-25674495bae9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 968 time: 0.1087303 Dec 21 03:43:18.691141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94894811-633a-43fc-85ee-0a747ea815b4 req-5adf6759-b05e-48ce-87ed-c8fad739f8ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.692718 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-5adf6759-b05e-48ce-87ed-c8fad739f8ce service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=680af371fc8f43789a63fa788b00602b&device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 1099 time: 0.0569811 Dec 21 03:43:18.766781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Allocated IP 192.168.233.158 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/e48308a4-e659-4026-9fcb-3c27d30462d6) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:18.772636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db099027-b3cb-4775-a318-a86c03634fb3 req-6361af76-06ea-4352-848c-69662e3394fc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0884709 Dec 21 03:43:18.843246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94894811-633a-43fc-85ee-0a747ea815b4 req-6d8cff50-26fc-49dd-ad45-b4e2bd5e8a39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.844774 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-6d8cff50-26fc-49dd-ad45-b4e2bd5e8a39 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1440251 Dec 21 03:43:18.897020 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-c3566985-3ff5-471d-b224-9242c540fe9b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.97&port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2 HTTP/1.1" status: 200 len: 217 time: 0.0439255 Dec 21 03:43:18.954895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94894811-633a-43fc-85ee-0a747ea815b4 req-31c88d76-c6cc-4dda-a734-5693ae237fdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:18.954895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-31c88d76-c6cc-4dda-a734-5693ae237fdc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0508275 Dec 21 03:43:19.006103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94894811-633a-43fc-85ee-0a747ea815b4 req-45e020a3-4791-4430-abe9-19e460d527f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:19.008141 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-45e020a3-4791-4430-abe9-19e460d527f1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0458722 Dec 21 03:43:19.105115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54633fca-7dba-4bef-902b-b2c2ac88dd1e req-d2323c29-991e-4ce0-9ee3-9df470ab857c tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 210 time: 0.0584438 Dec 21 03:43:19.133458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-495febee-c523-4184-8d2f-8f966b9227c8 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1061320 Dec 21 03:43:19.166159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.175782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6949be94-e08f-4734-b7ee-db5b569b401f req-cb880fe5-40c8-4402-af48-00fd7781f911 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2935383 Dec 21 03:43:19.200076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:19.239765 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-94894811-633a-43fc-85ee-0a747ea815b4 req-c0079eb6-180b-4d30-8d5d-0962fe900821 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1063514 Dec 21 03:43:19.327516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.366667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.384947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:19.390317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:19.400123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:19.411989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:19.414480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.432943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Pushing event updated for resources: {'Port': ['ID=e48308a4-e659-4026-9fcb-3c27d30462d6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:19.514044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.520909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-adcd31b9-1cca-48bd-ac2e-9c4acdeff6e7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.3891575 Dec 21 03:43:19.563543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Request body: {'port': {'device_id': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:19.655676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.678118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b5041ba2-1c0f-4b29-95fc-10c9f7c3dfbc None None] Provisioning complete for port e48308a4-e659-4026-9fcb-3c27d30462d6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:19.678674 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b5041ba2-1c0f-4b29-95fc-10c9f7c3dfbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:19.706132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Allocated IP 172.25.5.99 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/1d749e01-d629-4538-acc8-570b5314081b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:19.737230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b5041ba2-1c0f-4b29-95fc-10c9f7c3dfbc None None] Port e48308a4-e659-4026-9fcb-3c27d30462d6 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:19.809327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44cebbe4-61aa-4c9a-93a6-6df539a80577 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.158279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8868250a-d9b5-4fe0-adcd-9e16197d6c33 req-cd52aab6-e04f-4cde-8cf0-2261ae958f54 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:20.159807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8868250a-d9b5-4fe0-adcd-9e16197d6c33 req-cd52aab6-e04f-4cde-8cf0-2261ae958f54 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 947 time: 0.3236284 Dec 21 03:43:20.181887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.261699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8868250a-d9b5-4fe0-adcd-9e16197d6c33 req-0c9e6167-2901-4d8f-9824-fa32a119a269 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953429 Dec 21 03:43:20.312871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e48308a4-e659-4026-9fcb-3c27d30462d6 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:20.319510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.332427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Transition to ACTIVE for port object e48308a4-e659-4026-9fcb-3c27d30462d6 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:20.369811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.404828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:20.410227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:20.413726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:20.420708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.457022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event updated for resources: {'Port': ['ID=1d749e01-d629-4538-acc8-570b5314081b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:20.583885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Pushing event updated for resources: {'Port': ['ID=e48308a4-e659-4026-9fcb-3c27d30462d6,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:20.594532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.600874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Attempting to bind port e48308a4-e659-4026-9fcb-3c27d30462d6 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:20.601244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Attempting to bind port e48308a4-e659-4026-9fcb-3c27d30462d6 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:20.601641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Attempting to bind port e48308a4-e659-4026-9fcb-3c27d30462d6 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:20.608692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Port e48308a4-e659-4026-9fcb-3c27d30462d6 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:20.609009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Attempting to bind port e48308a4-e659-4026-9fcb-3c27d30462d6 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:20.614770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:20.615141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:20.615523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:20.615992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Bound port: e48308a4-e659-4026-9fcb-3c27d30462d6, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:20.616328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.686909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] For port e48308a4-e659-4026-9fcb-3c27d30462d6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:20.689936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] For port e48308a4-e659-4026-9fcb-3c27d30462d6, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e48308a4-e659-4026-9fcb-3c27d30462d6,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:20.731155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.809403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.868850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40746) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:20.893727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:20.894348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:20.895798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] 10.222.0.31 "PUT /v2.0/ports/e48308a4-e659-4026-9fcb-3c27d30462d6 HTTP/1.1" status: 200 len: 1097 time: 1.3363969 Dec 21 03:43:20.901472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'tag': 'e48308a4-e659-4026-9fcb-3c27d30462d6'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:20.903733 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7" -d '{"events": [{"name": "network-changed", "server_uuid": "2277f3cf-549f-4cd0-96da-348fc79ea7c8", "tag": "e48308a4-e659-4026-9fcb-3c27d30462d6"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:20.964150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4be34e4-6663-44a2-a7b8-53b3b23e87d9 service neutron] Pushing event updated for resources: {'Port': ['ID=e48308a4-e659-4026-9fcb-3c27d30462d6,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:20.980972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98d9f88-7726-45f9-9a1c-d9c764e9cd1d req-743ea452-111a-4bb4-ba47-9c6044966834 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:20.984084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a98d9f88-7726-45f9-9a1c-d9c764e9cd1d req-743ea452-111a-4bb4-ba47-9c6044966834 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 968 time: 0.1761980 Dec 21 03:43:20.997851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c67927e8-400e-4d58-a711-ff3603a53486 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.075491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.084050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c67927e8-400e-4d58-a711-ff3603a53486 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.096643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a98d9f88-7726-45f9-9a1c-d9c764e9cd1d req-86403e20-ba6b-4212-9645-8d758d4874f1 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1048398 Dec 21 03:43:21.102630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-d1f6220f-c0d0-4ad0-afa5-6f1c0eba1122 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:21.104223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-d1f6220f-c0d0-4ad0-afa5-6f1c0eba1122 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dc54f4797de4426ba52a3489b5990c5e&device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 1100 time: 0.0818460 Dec 21 03:43:21.160101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.162616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-b6ec2f81-716b-4a93-9edf-875bd8133d02 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.158&port_id=e48308a4-e659-4026-9fcb-3c27d30462d6 HTTP/1.1" status: 200 len: 217 time: 0.0439992 Dec 21 03:43:21.181769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c67927e8-400e-4d58-a711-ff3603a53486 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.223480 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c67927e8-400e-4d58-a711-ff3603a53486 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8e3b48415a22478892154202605767ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3535047 Dec 21 03:43:21.224079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:21.226342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c67927e8-400e-4d58-a711-ff3603a53486 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7de9f60e-4c4a-460c-b13f-e5ab403a8666,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:21.240087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.245601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 43cbd190-b145-423d-9f7c-f2f1eabaabc2 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:21.276181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event updated for resources: {'Port': ['ID=1d749e01-d629-4538-acc8-570b5314081b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:21.285723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe69e9f-4922-4963-915a-48ed77f1e746 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.290737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-78d6ed9c-e916-4131-b7b2-af1efccba7eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:21.292258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-78d6ed9c-e916-4131-b7b2-af1efccba7eb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1205399 Dec 21 03:43:21.300876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26c7f32-3115-4f4d-a039-b47f084c1574 req-7d579586-09cd-41c0-9d62-bdb96c6c2840 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:21.307416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26c7f32-3115-4f4d-a039-b47f084c1574 req-7d579586-09cd-41c0-9d62-bdb96c6c2840 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 948 time: 0.1492364 Dec 21 03:43:21.312908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe69e9f-4922-4963-915a-48ed77f1e746 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.358684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:21.370795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '43cbd190-b145-423d-9f7c-f2f1eabaabc2', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '43cbd190-b145-423d-9f7c-f2f1eabaabc2', 'mac_address': 'fa:16:3e:a5:01:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.97'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:21.391112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.392588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6949be94-e08f-4734-b7ee-db5b569b401f req-c3c9af27-f096-4159-ac69-22fa6971da31 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 2.1965053 Dec 21 03:43:21.396999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26c7f32-3115-4f4d-a039-b47f084c1574 req-3c023859-5ba1-4fbc-bcb5-38b412c057d0 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885561 Dec 21 03:43:21.399012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-ab5e7265-c8b4-4762-83e0-4ddd8699a190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:21.400449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-ab5e7265-c8b4-4762-83e0-4ddd8699a190 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0827296 Dec 21 03:43:21.423980 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.439434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 43cbd190-b145-423d-9f7c-f2f1eabaabc2 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:21.448539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe69e9f-4922-4963-915a-48ed77f1e746 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.454816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe69e9f-4922-4963-915a-48ed77f1e746 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.454816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-efe69e9f-4922-4963-915a-48ed77f1e746 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7de9f60e-4c4a-460c-b13f-e5ab403a8666 HTTP/1.1" status: 204 len: 168 time: 0.2273777 Dec 21 03:43:21.463647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:21.467083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efe69e9f-4922-4963-915a-48ed77f1e746 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7de9f60e-4c4a-460c-b13f-e5ab403a8666,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:21.490837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6949be94-e08f-4734-b7ee-db5b569b401f req-975fbd3e-ea1e-4638-b6fa-83c5e6a92712 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 695 time: 0.0894270 Dec 21 03:43:21.528768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:21.589883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=43cbd190-b145-423d-9f7c-f2f1eabaabc2,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:21.635669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-68921f8a-f668-441c-a7f3-0d647fd2bbba service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1772110 Dec 21 03:43:21.682704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6949be94-e08f-4734-b7ee-db5b569b401f req-f3a1f479-2ad4-4bc0-960a-e6ea5c2ae97e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:21.684069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6949be94-e08f-4734-b7ee-db5b569b401f req-f3a1f479-2ad4-4bc0-960a-e6ea5c2ae97e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1851139 Dec 21 03:43:21.719083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-6949be94-e08f-4734-b7ee-db5b569b401f req-1d578ee7-5053-4a41-ad9d-d18e78df9d13 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:43:21.724779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6949be94-e08f-4734-b7ee-db5b569b401f req-1d578ee7-5053-4a41-ad9d-d18e78df9d13 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0302000 Dec 21 03:43:21.804509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6edc9fc-bd72-4804-9ccf-f3b4368625be req-1e3e871e-5dba-4aaf-8fec-fcc9361220b8 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1583099 Dec 21 03:43:21.819907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1d22f1-43ff-4e27-89f9-a409b80f94b3 req-d53e28f2-1a75-4f64-8123-14756f056832 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0345964 Dec 21 03:43:21.839815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['43cbd190-b145-423d-9f7c-f2f1eabaabc2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:21.942834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f1d22f1-43ff-4e27-89f9-a409b80f94b3 req-1ad8c5b3-4468-4de8-bf42-67790a8b50f1 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:21.944468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1d22f1-43ff-4e27-89f9-a409b80f94b3 req-1ad8c5b3-4468-4de8-bf42-67790a8b50f1 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1182487 Dec 21 03:43:21.962831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1d22f1-43ff-4e27-89f9-a409b80f94b3 req-3430c551-759c-45e7-a64e-2b4a675c14a8 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/quotas/43c96c035c4f427eb98a4f3d56b32aaf HTTP/1.1" status: 200 len: 375 time: 0.0096459 Dec 21 03:43:21.998329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1d22f1-43ff-4e27-89f9-a409b80f94b3 req-dc49618b-e6e1-4c08-8a9d-bf9cb24d47f0 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0272815 Dec 21 03:43:22.096752 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f241686-5462-4831-ae25-0687b7814235 x-openstack-request-id: req-9f241686-5462-4831-ae25-0687b7814235 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:22.097110 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2277f3cf-549f-4cd0-96da-348fc79ea7c8", "tag": "e48308a4-e659-4026-9fcb-3c27d30462d6", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:22.097428 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9f241686-5462-4831-ae25-0687b7814235 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:22.097888 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'tag': 'e48308a4-e659-4026-9fcb-3c27d30462d6', 'status': 'completed', 'code': 200} Dec 21 03:43:22.134271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-913c5252-d952-4761-8510-cbabee347513 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.167413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40782) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:22.180347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8846a4a5-97be-4b1b-950f-15bf72bfbee1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.252440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-802a0d08-4569-47f5-91d4-e1a0ea01443e req-f968b8d3-f10c-43c7-8db3-e84f681787f5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.253822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-802a0d08-4569-47f5-91d4-e1a0ea01443e req-f968b8d3-f10c-43c7-8db3-e84f681787f5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 948 time: 0.1121013 Dec 21 03:43:22.254822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8846a4a5-97be-4b1b-950f-15bf72bfbee1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.260454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-55b3103a-100f-422f-ad43-6c3751cf519f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.261916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-55b3103a-100f-422f-ad43-6c3751cf519f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dc54f4797de4426ba52a3489b5990c5e&device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 1100 time: 0.1076458 Dec 21 03:43:22.271513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922260a9-c164-4aec-9e16-d92cac404493 req-e94b03ec-fd8d-492e-965a-690ce34d3f14 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.272850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-922260a9-c164-4aec-9e16-d92cac404493 req-e94b03ec-fd8d-492e-965a-690ce34d3f14 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 968 time: 0.1196797 Dec 21 03:43:22.281808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40784) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:22.287504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'floatingip': {'port_id': '3879ae01-e336-4975-a479-fdaef03236a1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:22.352981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8846a4a5-97be-4b1b-950f-15bf72bfbee1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.382627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.413059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-802a0d08-4569-47f5-91d4-e1a0ea01443e req-7181a915-17bf-4f2b-a816-1d37cc288a4b tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1500564 Dec 21 03:43:22.437203 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8846a4a5-97be-4b1b-950f-15bf72bfbee1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=eb29b359e3134542aafb6bfb50dcbec7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2686524 Dec 21 03:43:22.437818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40798) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:22.438104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.472697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-a7d4774e-9b06-4c38-8066-4c51937c8652 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.474240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-a7d4774e-9b06-4c38-8066-4c51937c8652 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1956832 Dec 21 03:43:22.487874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8846a4a5-97be-4b1b-950f-15bf72bfbee1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99948c39-ae7b-4422-8b9c-85342fbdc12d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:22.531589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-d1d787c4-658f-4ff9-8315-9ad99b2f8712 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.158&port_id=e48308a4-e659-4026-9fcb-3c27d30462d6 HTTP/1.1" status: 200 len: 217 time: 0.0456669 Dec 21 03:43:22.538907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-de3b021c-82a7-470f-bfb8-b0498fdf69fe tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.540210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-de3b021c-82a7-470f-bfb8-b0498fdf69fe tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 821 time: 0.1805367 Dec 21 03:43:22.579817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-d87c55ce-7252-4105-81e1-0826a1012d5b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/quotas/d3c7911e116e4170812afec94091929a HTTP/1.1" status: 200 len: 375 time: 0.0312855 Dec 21 03:43:22.603735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-c8916fc3-e186-4c23-a697-abdb3817a016 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.604148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-c8916fc3-e186-4c23-a697-abdb3817a016 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0630784 Dec 21 03:43:22.617690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75cd9083-7752-4b96-b3ef-9581a6f10853 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.673212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75cd9083-7752-4b96-b3ef-9581a6f10853 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.674602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-7ba653bf-2954-4dde-b9f6-6b5ee5f525ce tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0840735 Dec 21 03:43:22.676623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-1af46390-3a63-4b7e-b945-88160b8fcbd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:22.677867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-1af46390-3a63-4b7e-b945-88160b8fcbd9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0593886 Dec 21 03:43:22.928349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75cd9083-7752-4b96-b3ef-9581a6f10853 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.931277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75cd9083-7752-4b96-b3ef-9581a6f10853 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:22.935253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-75cd9083-7752-4b96-b3ef-9581a6f10853 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/99948c39-ae7b-4422-8b9c-85342fbdc12d HTTP/1.1" status: 204 len: 168 time: 0.4730194 Dec 21 03:43:22.964045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75cd9083-7752-4b96-b3ef-9581a6f10853 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99948c39-ae7b-4422-8b9c-85342fbdc12d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:23.103187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-5454756e-ffbc-4489-a78e-7a2e6068a540 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4161541 Dec 21 03:43:23.105705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:23.106118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-9abead31-3c8d-4c08-8031-cd68f852cdad service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4183941 Dec 21 03:43:23.138997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb89bda-d120-4a15-acc2-27ca81c24f30 req-26a5e9a4-feda-4f36-83b3-34ba48b2d6aa tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:23.140547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffb89bda-d120-4a15-acc2-27ca81c24f30 req-26a5e9a4-feda-4f36-83b3-34ba48b2d6aa tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 948 time: 0.1244998 Dec 21 03:43:23.254579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.resource_extend [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] It took 0.27 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 03:43:23.261409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 43cbd190-b145-423d-9f7c-f2f1eabaabc2 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:23.319241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffb89bda-d120-4a15-acc2-27ca81c24f30 req-40706cb6-93d7-4e4c-a6d5-dd326ff02629 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1640811 Dec 21 03:43:23.350032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:23.351671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-202e686b-27ed-455b-8e6f-c141e8f56d6d service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2323520 Dec 21 03:43:23.354191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48c4f3b-1492-4e5f-bb41-f97a66ee9dd7 req-81649a64-d1be-4fe7-8939-b19ccad96ea2 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2439644 Dec 21 03:43:23.414339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:23.418804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:23.419217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:23.448553 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:23.506811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:23.535545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43cbd190-b145-423d-9f7c-f2f1eabaabc2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:23.538084 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dae96d5a-e795-4189-8c70-0b171721727c" -d '{"events": [{"server_uuid": "0354f6e5-2b90-41cf-924b-b3b9a8fc83b0", "name": "network-vif-plugged", "status": "completed", "tag": "43cbd190-b145-423d-9f7c-f2f1eabaabc2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:23.558566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:23.578040 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def associated. External IP: 172.25.5.85, port: 3879ae01-e336-4975-a479-fdaef03236a1. Dec 21 03:43:23.609662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:23.701200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=43cbd190-b145-423d-9f7c-f2f1eabaabc2,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:23.714381 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b856170-4e8b-41d1-b30a-9ed52afef294 x-openstack-request-id: req-2b856170-4e8b-41d1-b30a-9ed52afef294 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:23.714701 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0354f6e5-2b90-41cf-924b-b3b9a8fc83b0", "name": "network-vif-plugged", "status": "completed", "tag": "43cbd190-b145-423d-9f7c-f2f1eabaabc2", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:23.714987 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2b856170-4e8b-41d1-b30a-9ed52afef294 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:23.715380 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43cbd190-b145-423d-9f7c-f2f1eabaabc2', 'code': 200} Dec 21 03:43:23.807229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0aad621a-660d-4946-a865-06ca6a850bc5 req-ff3104cc-e7e8-4b94-833d-641a680b6fe1 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 210 time: 0.0323961 Dec 21 03:43:23.832413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af4ba32-9ae8-4737-a001-c584d0b33abb req-8805a0f0-1800-42d0-8d2a-7468ca9e1ff5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:23.839964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7af4ba32-9ae8-4737-a001-c584d0b33abb req-8805a0f0-1800-42d0-8d2a-7468ca9e1ff5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 949 time: 0.0976372 Dec 21 03:43:23.909094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9876275b-64fd-4d05-801e-2a69d97efebf req-d6fc752d-7237-4d10-828e-454f8de1be7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:23.912947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9876275b-64fd-4d05-801e-2a69d97efebf req-d6fc752d-7237-4d10-828e-454f8de1be7c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 1101 time: 0.0978096 Dec 21 03:43:23.915473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Router 138198e8-cb21-4974-9773-632cfe7c78d0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:43:23.927514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7af4ba32-9ae8-4737-a001-c584d0b33abb req-8c86155c-18b8-489a-bf39-e86c1c01e05c tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866284 Dec 21 03:43:23.974918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9876275b-64fd-4d05-801e-2a69d97efebf req-22a94c66-7a20-40a8-8a85-bdc5206e82e9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431142 Dec 21 03:43:24.058039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:43:24.070416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:24.088163 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:43:24.102830 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:24.103487 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:24.123644 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6ec255fb-166a-4d15-9c76-e1c44a1c60f2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "PUT /v2.0/floatingips/631c6293-0c83-45b1-8aca-1ed5976f4def HTTP/1.1" status: 200 len: 1013 time: 1.8406765 Dec 21 03:43:24.125371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:24.129715 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31" -d '{"events": [{"name": "network-changed", "server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "tag": "3879ae01-e336-4975-a479-fdaef03236a1"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:24.239296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:24.381108 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d50063fe-1edd-49ea-a577-f175f4974637 x-openstack-request-id: req-d50063fe-1edd-49ea-a577-f175f4974637 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:24.385597 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "tag": "3879ae01-e336-4975-a479-fdaef03236a1", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:24.385597 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d50063fe-1edd-49ea-a577-f175f4974637 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:24.385597 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1', 'status': 'completed', 'code': 200} Dec 21 03:43:24.528077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-e05d3ba8-c869-446f-ad60-e52bac2180ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:24.529719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-e05d3ba8-c869-446f-ad60-e52bac2180ed service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 1120 time: 0.0975933 Dec 21 03:43:24.650825 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '631c6293-0c83-45b1-8aca-1ed5976f4def', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'floating_ip_address': '172.25.5.85', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'port_id': '3879ae01-e336-4975-a479-fdaef03236a1', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 175, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'mac_address': 'fa:16:3e:b6:7b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'device_owner': 'compute:tempest-test_az-2070989439'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:01Z', 'updated_at': '2021-12-21T03:43:22Z', 'revision_number': 1, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:24.660240 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:24.664014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5169ea42-4e7f-4c85-b26d-3d9d34a8b129 req-c75bf18a-77ed-4f04-a51e-23a18684f9fa tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:24.665530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5169ea42-4e7f-4c85-b26d-3d9d34a8b129 req-c75bf18a-77ed-4f04-a51e-23a18684f9fa tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 948 time: 0.0948465 Dec 21 03:43:24.688772 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:43:24.691170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-dd7aa306-b260-4fe2-a3a1-e593936340bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:24.692621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-dd7aa306-b260-4fe2-a3a1-e593936340bb service neutron] 10.222.0.54 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 925 time: 0.1533220 Dec 21 03:43:24.698503 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:24.699154 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:24.821991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:24.835900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5169ea42-4e7f-4c85-b26d-3d9d34a8b129 req-8e2bf12a-994e-479e-9463-927254981d8d tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601739 Dec 21 03:43:24.857005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-ab0d5d9a-180d-48a0-8d0e-0ac838896fe2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3879ae01-e336-4975-a479-fdaef03236a1 HTTP/1.1" status: 200 len: 1021 time: 0.1475694 Dec 21 03:43:24.884161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:24.977073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ed505c7-fd11-41dc-9063-aa8998b587a9 req-fedbdeec-9300-411a-a307-e0e1cc2991b4 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0699348 Dec 21 03:43:25.036528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-8002fbf9-918b-47f3-b4c5-f2192cc46db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:25.038574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-8002fbf9-918b-47f3-b4c5-f2192cc46db1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.1181481 Dec 21 03:43:25.122147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c3a44d2-139d-4a86-8286-1a4d8a745da3 req-77b32b44-f1b8-4215-b97f-7ed634da461d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 210 time: 0.0355353 Dec 21 03:43:25.176455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-98d7c1a1-6c7e-45ca-9b54-38e868ac9ff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:25.178609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-98d7c1a1-6c7e-45ca-9b54-38e868ac9ff4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0930800 Dec 21 03:43:25.227896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ed505c7-fd11-41dc-9063-aa8998b587a9 req-d13878a0-ce09-4729-bb30-de31fd9b9f41 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:25.234905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ed505c7-fd11-41dc-9063-aa8998b587a9 req-d13878a0-ce09-4729-bb30-de31fd9b9f41 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2461855 Dec 21 03:43:25.252528 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '631c6293-0c83-45b1-8aca-1ed5976f4def', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'floating_ip_address': '172.25.5.85', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'port_id': '3879ae01-e336-4975-a479-fdaef03236a1', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 175, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'mac_address': 'fa:16:3e:b6:7b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'device_owner': 'compute:tempest-test_az-2070989439'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:01Z', 'updated_at': '2021-12-21T03:43:22Z', 'revision_number': 1, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:25.282345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e48308a4-e659-4026-9fcb-3c27d30462d6 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:25.292481 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb415abd-89a4-4cdb-b5af-8ab111f27b8d None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '631c6293-0c83-45b1-8aca-1ed5976f4def', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'floating_ip_address': '172.25.5.85', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'port_id': '3879ae01-e336-4975-a479-fdaef03236a1', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 175, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'mac_address': 'fa:16:3e:b6:7b:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'device_owner': 'compute:tempest-test_az-2070989439'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:01Z', 'updated_at': '2021-12-21T03:43:22Z', 'revision_number': 1, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:43:25.338805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ed505c7-fd11-41dc-9063-aa8998b587a9 req-ffb60bda-a6ca-4268-bb24-42804e87e8c9 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/quotas/43c96c035c4f427eb98a4f3d56b32aaf HTTP/1.1" status: 200 len: 375 time: 0.1025579 Dec 21 03:43:25.385516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ed505c7-fd11-41dc-9063-aa8998b587a9 req-b9d953cf-c774-48e4-9c61-0a00b01e61f0 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0359662 Dec 21 03:43:25.396294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2d9bed-82d1-47e5-8418-74c7d28dc7f4 req-9a93209c-a987-4b94-9b77-c45e316c1482 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:25.406632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a2d9bed-82d1-47e5-8418-74c7d28dc7f4 req-9a93209c-a987-4b94-9b77-c45e316c1482 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 971 time: 0.1866658 Dec 21 03:43:25.436965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-8cea9dd6-98f6-4a72-a4b5-16e5f6e8d23b service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2411673 Dec 21 03:43:25.460728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port e48308a4-e659-4026-9fcb-3c27d30462d6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e48308a4-e659-4026-9fcb-3c27d30462d6,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:25.473997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'e48308a4-e659-4026-9fcb-3c27d30462d6', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'e48308a4-e659-4026-9fcb-3c27d30462d6', 'mac_address': 'fa:16:3e:b6:fc:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.158'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:25.492579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a2d9bed-82d1-47e5-8418-74c7d28dc7f4 req-9cb419e2-d73b-4049-b37f-f1c7b7d5bc41 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850384 Dec 21 03:43:25.527065 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:25.546044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e48308a4-e659-4026-9fcb-3c27d30462d6 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:25.586786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port e48308a4-e659-4026-9fcb-3c27d30462d6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e48308a4-e659-4026-9fcb-3c27d30462d6,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:25.624175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279cfaed-8a5d-49de-bcfc-ed0b65a87a31 req-b5d51e0a-acb4-4e20-9b58-aab3a0833c8b service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1722353 Dec 21 03:43:25.624959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf48fd87-e5ad-4dc3-a503-8457c451961e None None] New status for floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:43:25.633540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bc8e0ed-19a0-473c-b914-430c5f79ac31 req-2aee9fb0-cb9d-49f5-b3bb-f1d649805a9a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:25.640596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bc8e0ed-19a0-473c-b914-430c5f79ac31 req-2aee9fb0-cb9d-49f5-b3bb-f1d649805a9a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 949 time: 0.1025355 Dec 21 03:43:25.662897 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:25.665052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:25.696341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bc8e0ed-19a0-473c-b914-430c5f79ac31 req-79d01f1a-28d3-4c2a-aafe-25c65e9edc72 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549095 Dec 21 03:43:25.831441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=e48308a4-e659-4026-9fcb-3c27d30462d6,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:26.007628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['e48308a4-e659-4026-9fcb-3c27d30462d6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:26.171050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-0829d37a-f11b-4283-9695-8467dc3db253 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:26.172587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-0829d37a-f11b-4283-9695-8467dc3db253 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.54 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 821 time: 0.1207402 Dec 21 03:43:26.200570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'port': {'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'admin_state_up': True, 'tenant_id': 'd3c7911e116e4170812afec94091929a'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:26.285500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-e44ac957-42a2-454e-9800-3d4831a9bfb5 req-55e1aa0b-67f3-4f79-ba52-ef5dc0ff6434 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:43:26.285500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e44ac957-42a2-454e-9800-3d4831a9bfb5 req-55e1aa0b-67f3-4f79-ba52-ef5dc0ff6434 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0069795 Dec 21 03:43:26.403916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cb4168-e6ac-4a6f-9d09-2a12417a3a89 req-9b91869b-826e-428e-851e-2c3f1e18acd7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:26.405410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4cb4168-e6ac-4a6f-9d09-2a12417a3a89 req-9b91869b-826e-428e-851e-2c3f1e18acd7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 949 time: 0.0714519 Dec 21 03:43:26.454824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4cb4168-e6ac-4a6f-9d09-2a12417a3a89 req-f510362d-6968-408b-8726-44713020fbcf tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425799 Dec 21 03:43:26.479818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Made reservation on behalf of d3c7911e116e4170812afec94091929a for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:26.481313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:26.591504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e382a68-19f3-491c-adbe-6792eef78718 req-b931db39-489c-4bee-bf6f-a9e0abc1a148 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 210 time: 0.0684650 Dec 21 03:43:26.649508 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-a6413eba-a0ae-4796-a9ca-0fc2106ee63a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0509157 Dec 21 03:43:26.667928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af46f4b-7173-47dd-8f2a-55bcf4a36274 req-027cf2ca-5080-485f-bcd8-e02c94803740 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:26.669424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6af46f4b-7173-47dd-8f2a-55bcf4a36274 req-027cf2ca-5080-485f-bcd8-e02c94803740 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 949 time: 0.1347010 Dec 21 03:43:26.699975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Allocated IP 172.20.0.7 (be2315d6-c735-4ecb-b299-a3b1405aa378/8f347100-a6ac-44b8-b4d2-4439cc3e6889/8ce7fb06-2f70-4696-904a-92f477cbea6e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:26.749171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6af46f4b-7173-47dd-8f2a-55bcf4a36274 req-11dcf4bd-2e81-41b0-aa71-75254f4d5b52 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723953 Dec 21 03:43:26.794211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-f0487f5d-c386-498a-ada3-cc79bbcd2b51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:26.796449 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-f0487f5d-c386-498a-ada3-cc79bbcd2b51 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 1120 time: 0.0662987 Dec 21 03:43:26.857988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.54', 58379) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: from cryptography.utils import int_from_bytes Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: from cryptography.utils import int_from_bytes Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.935292 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:26.937877 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:26.938674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-f1b26598-d9ca-406d-9317-f5fd914df9f8 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:26.940672 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-f1b26598-d9ca-406d-9317-f5fd914df9f8 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.54 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 971 time: 0.0828636 Dec 21 03:43:27.045741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36e5f60-6891-4cf9-ba45-6e29a6c715b4 req-8f9e2d0a-a8e1-47d3-af69-dddac078ec77 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:27.053248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e36e5f60-6891-4cf9-ba45-6e29a6c715b4 req-8f9e2d0a-a8e1-47d3-af69-dddac078ec77 tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 971 time: 0.1401088 Dec 21 03:43:27.091160 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.094018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-9056ead7-f80c-47c7-b695-70761f466244 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:27.095552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-9056ead7-f80c-47c7-b695-70761f466244 service neutron] 10.222.0.54 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 925 time: 0.2369258 Dec 21 03:43:27.110320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Deleting port 09554808-aec9-4511-ba46-8a6519a51c3a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:43:27.110695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.206469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] For port 09554808-aec9-4511-ba46-8a6519a51c3a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=09554808-aec9-4511-ba46-8a6519a51c3a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:27.207119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.207877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e36e5f60-6891-4cf9-ba45-6e29a6c715b4 req-4516bb2e-5980-41a0-86c3-7ff4d03649fc tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/security-groups?id=96f618ad-8507-4bab-a069-bd6e46faf322&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1538393 Dec 21 03:43:27.212713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-6b0560d8-11d3-4c3c-87b2-2ab8d1aab1aa tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=680af371fc8f43789a63fa788b00602b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0569081 Dec 21 03:43:27.224014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Calling delete_port for 09554808-aec9-4511-ba46-8a6519a51c3a owned by compute:tempest-test_az-2070989439 {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:43:27.227489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-3bd67688-00cf-4149-9e64-c0a6332e0706 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3879ae01-e336-4975-a479-fdaef03236a1 HTTP/1.1" status: 200 len: 1023 time: 0.1223969 Dec 21 03:43:27.307585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e48308a4-e659-4026-9fcb-3c27d30462d6 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:27.343046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-82b3e153-5fb1-4eaf-8277-6c1c93b12a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:27.345052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-82b3e153-5fb1-4eaf-8277-6c1c93b12a28 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.1064973 Dec 21 03:43:27.349218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.388010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['552d2bbd-e22b-4bf0-a3fc-056e9948167e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:27.393432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Network be2315d6-c735-4ecb-b299-a3b1405aa378 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:27.431867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:27.434646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port e48308a4-e659-4026-9fcb-3c27d30462d6 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:27.438170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:27.442694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port e48308a4-e659-4026-9fcb-3c27d30462d6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:27.442975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.444418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:27.445032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.501021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.539123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['09554808-aec9-4511-ba46-8a6519a51c3a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:27.593737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Pushing event deleted for resources: {'Port': ['ID=09554808-aec9-4511-ba46-8a6519a51c3a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:27.645435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] No DVR routers for this DVR port 09554808-aec9-4511-ba46-8a6519a51c3a on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:43:27.650847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.654562 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4d7b591a-1d84-467d-8534-da7b1c77d643 req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.54 "DELETE /v2.0/ports/09554808-aec9-4511-ba46-8a6519a51c3a HTTP/1.1" status: 204 len: 173 time: 0.7075362 Dec 21 03:43:27.655964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4bf004a2-2597-405c-961a-417297bcb4bc', 'name': 'network-vif-deleted', 'tag': '09554808-aec9-4511-ba46-8a6519a51c3a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:27.659805 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0c07168-06c9-4761-9fdb-ab711c5106e8" -d '{"events": [{"server_uuid": "4bf004a2-2597-405c-961a-417297bcb4bc", "name": "network-vif-deleted", "tag": "09554808-aec9-4511-ba46-8a6519a51c3a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:27.664447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.665315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.665892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.666297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.666696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.667114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.667528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.667922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.668337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.668722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.669930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.670872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.671330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2828b162-6a67-4b70-b70f-fc32cb232dbd tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.695315 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.729867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e48308a4-e659-4026-9fcb-3c27d30462d6'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:27.732552 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43560802-09bf-4bdf-98dc-7712d0d7388e" -d '{"events": [{"server_uuid": "2277f3cf-549f-4cd0-96da-348fc79ea7c8", "name": "network-vif-plugged", "status": "completed", "tag": "e48308a4-e659-4026-9fcb-3c27d30462d6"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:27.747355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port e48308a4-e659-4026-9fcb-3c27d30462d6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e48308a4-e659-4026-9fcb-3c27d30462d6,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:27.759550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-73c520a2-7456-4358-9dda-c6b7efbc6d19 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:27.766564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-73c520a2-7456-4358-9dda-c6b7efbc6d19 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5436499 Dec 21 03:43:27.769187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0f82a9bf-0293-4636-8d93-6f1e3135ed93 None None] Provisioning complete for port 8ce7fb06-2f70-4696-904a-92f477cbea6e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:27.769631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f82a9bf-0293-4636-8d93-6f1e3135ed93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.769850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b532e527-bf89-4e07-bff3-4c934f064228 req-d6ed39a0-a9ff-47e9-b5ec-af0d9a8fea36 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&shared=False HTTP/1.1" status: 200 len: 213 time: 0.3180151 Dec 21 03:43:27.789400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event updated for resources: {'Port': ['ID=8ce7fb06-2f70-4696-904a-92f477cbea6e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:27.807766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0f82a9bf-0293-4636-8d93-6f1e3135ed93 None None] Port 8ce7fb06-2f70-4696-904a-92f477cbea6e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:27.811553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-dcecbd1b-351b-40d9-ad2c-9302534084aa tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/quotas/680af371fc8f43789a63fa788b00602b HTTP/1.1" status: 200 len: 375 time: 0.0436325 Dec 21 03:43:27.815935 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:27.837124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.837485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.837838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.838180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.838517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.838858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.839221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.839555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.839885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.840215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.840555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.840869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.841199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.860044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-67e03aa3-5160-431a-a03e-5f726449ebef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:27.861595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-67e03aa3-5160-431a-a03e-5f726449ebef service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.4960732 Dec 21 03:43:27.873733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=e48308a4-e659-4026-9fcb-3c27d30462d6,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:27.881548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.881911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.882258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.882603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.882964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.883309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.883869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.884206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.884682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.885021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.885364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.885682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.886009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:43:27.922899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-6f1ea326-79cd-4143-b126-fb274e5972e6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7279513 Dec 21 03:43:27.954247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Request body: {'port': {'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:28.034532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-16a02196-a562-4df6-9b56-21dc0794e373 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=680af371fc8f43789a63fa788b00602b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2005482 Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.046172 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:28.048319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532e527-bf89-4e07-bff3-4c934f064228 req-986d7879-6332-4f78-a173-5c8a94437df4 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:28.049077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b532e527-bf89-4e07-bff3-4c934f064228 req-986d7879-6332-4f78-a173-5c8a94437df4 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2632413 Dec 21 03:43:28.106534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b532e527-bf89-4e07-bff3-4c934f064228 req-e0d1046f-ae0f-4e79-9528-5e941202ac35 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/quotas/43c96c035c4f427eb98a4f3d56b32aaf HTTP/1.1" status: 200 len: 375 time: 0.0479486 Dec 21 03:43:28.109294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-75a73069-dc50-4bba-ab29-6d206e948b81 service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2322006 Dec 21 03:43:28.109847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:28.168013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b532e527-bf89-4e07-bff3-4c934f064228 req-1173389a-4645-4a4f-8b5a-ea7e215efa28 tempest-QuotasAdminNegativeTest-743132343 tempest-QuotasAdminNegativeTest-743132343-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0469811 Dec 21 03:43:28.383469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd5a471-e98d-40d8-ba06-23460363c2b5 req-ad975ffb-ea82-4ffd-8b9a-35b51fa0c1a5 service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2645524 Dec 21 03:43:28.462271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64d3f242-bd7a-40c1-bd61-9f42902795ce req-6b1ec878-10a8-45d5-801f-f03fb45ce94b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:28.463809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64d3f242-bd7a-40c1-bd61-9f42902795ce req-6b1ec878-10a8-45d5-801f-f03fb45ce94b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 931 time: 0.1586366 Dec 21 03:43:28.473016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5281adf-d92f-4fcb-961e-85ef4c783864 req-86b068c0-325c-4974-98d9-a11e792e0830 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:28.474485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5281adf-d92f-4fcb-961e-85ef4c783864 req-86b068c0-325c-4974-98d9-a11e792e0830 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.1681926 Dec 21 03:43:28.573614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64d3f242-bd7a-40c1-bd61-9f42902795ce req-1d0ded6d-540b-48a4-8cde-078c2a9b4a07 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981195 Dec 21 03:43:28.596585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5281adf-d92f-4fcb-961e-85ef4c783864 req-a7d2ac3f-30ec-4051-be0e-5920536e3f73 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1119502 Dec 21 03:43:28.634522 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1bcd945c-33b9-4201-bb6b-c1619f26c5c7 x-openstack-request-id: req-1bcd945c-33b9-4201-bb6b-c1619f26c5c7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:28.634522 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4bf004a2-2597-405c-961a-417297bcb4bc", "name": "network-vif-deleted", "tag": "09554808-aec9-4511-ba46-8a6519a51c3a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:28.634522 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1bcd945c-33b9-4201-bb6b-c1619f26c5c7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:28.634522 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4bf004a2-2597-405c-961a-417297bcb4bc', 'name': 'network-vif-deleted', 'tag': '09554808-aec9-4511-ba46-8a6519a51c3a', 'status': 'completed', 'code': 200} Dec 21 03:43:28.637210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8ce7fb06-2f70-4696-904a-92f477cbea6e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:28.646897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:28.663065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Transition to ACTIVE for port object 8ce7fb06-2f70-4696-904a-92f477cbea6e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:28.670881 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94f88ac9-182c-4279-aae9-1dad2c457123 x-openstack-request-id: req-94f88ac9-182c-4279-aae9-1dad2c457123 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:28.670881 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2277f3cf-549f-4cd0-96da-348fc79ea7c8", "name": "network-vif-plugged", "status": "completed", "tag": "e48308a4-e659-4026-9fcb-3c27d30462d6", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:28.670881 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-94f88ac9-182c-4279-aae9-1dad2c457123 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:28.670881 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e48308a4-e659-4026-9fcb-3c27d30462d6', 'code': 200} Dec 21 03:43:28.726826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e04e7987-8775-4a9e-9063-bdfdcf3f258b req-89bc1f85-aca8-4ebf-8843-32cca566b94a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 210 time: 0.0325511 Dec 21 03:43:28.751393 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:28.854704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Pushing event updated for resources: {'Port': ['ID=8ce7fb06-2f70-4696-904a-92f477cbea6e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:28.895139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-959d4c77-1d7f-4404-8ade-e200c287e214 req-a94b644c-e671-4a57-8d1b-c9f0d2820a7f tempest-AggregatesAdminTestJSON-1374156463 tempest-AggregatesAdminTestJSON-1374156463-project] 10.222.0.18 "GET /v2.0/ports?device_id=4bf004a2-2597-405c-961a-417297bcb4bc HTTP/1.1" status: 200 len: 210 time: 0.0458663 Dec 21 03:43:28.949421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-2f7d5105-9bd7-4435-8cd7-981359603d50 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1206393 Dec 21 03:43:28.957077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e0c7e8-a23a-4763-ba02-d7041e1a4e2b req-04152255-4748-4ffe-beee-134e2caa835c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:28.959896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f4e0c7e8-a23a-4763-ba02-d7041e1a4e2b req-04152255-4748-4ffe-beee-134e2caa835c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 1102 time: 0.0604765 Dec 21 03:43:28.987239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Attempting to bind port 8ce7fb06-2f70-4696-904a-92f477cbea6e on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:28.987583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Attempting to bind port 8ce7fb06-2f70-4696-904a-92f477cbea6e by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:28.988153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Attempting to bind port 8ce7fb06-2f70-4696-904a-92f477cbea6e on network be2315d6-c735-4ecb-b299-a3b1405aa378 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:28.992871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Port 8ce7fb06-2f70-4696-904a-92f477cbea6e on network be2315d6-c735-4ecb-b299-a3b1405aa378 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:28.993200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Attempting to bind port 8ce7fb06-2f70-4696-904a-92f477cbea6e on network be2315d6-c735-4ecb-b299-a3b1405aa378 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:28.999223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:28.999690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Checking segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:29.000205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Bound using segment: {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:29.000901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Bound port: 8ce7fb06-2f70-4696-904a-92f477cbea6e, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:29.001781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:29.065774 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f4e0c7e8-a23a-4763-ba02-d7041e1a4e2b req-4380a1b8-4c57-4a58-a83f-a9dbfa25a52c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828233 Dec 21 03:43:29.143770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-10b94f39-bbae-4681-9dde-650f7596bba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.145724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-10b94f39-bbae-4681-9dde-650f7596bba1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.1251302 Dec 21 03:43:29.147332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] For port 8ce7fb06-2f70-4696-904a-92f477cbea6e, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:29.151038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] For port 8ce7fb06-2f70-4696-904a-92f477cbea6e, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:29.271558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:29.314487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.315263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:29.316546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] 10.222.0.54 "PUT /v2.0/ports/8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 1092 time: 1.3705590 Dec 21 03:43:29.318871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:29.321327 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c420bf7-beaa-49b8-8096-9c83b7a89b64" -d '{"events": [{"name": "network-changed", "server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:29.346649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88578a72-2a18-42b3-b430-73cfe9a714f0 service neutron] Pushing event updated for resources: {'Port': ['ID=8ce7fb06-2f70-4696-904a-92f477cbea6e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:29.394712 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9dc3c57e-4c5b-414a-847a-c2d2bbd3dce4 x-openstack-request-id: req-9dc3c57e-4c5b-414a-847a-c2d2bbd3dce4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:29.395032 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:29.395286 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9dc3c57e-4c5b-414a-847a-c2d2bbd3dce4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:29.395678 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'status': 'completed', 'code': 200} Dec 21 03:43:29.493152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-e947fa49-96c5-4590-adf5-628457f9c6b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.494654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-e947fa49-96c5-4590-adf5-628457f9c6b4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.1286047 Dec 21 03:43:29.500694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c420bf7-beaa-49b8-8096-9c83b7a89b64 req-b6d94060-9b0a-41b0-8d3b-871b78b5c1ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.502195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c420bf7-beaa-49b8-8096-9c83b7a89b64 req-b6d94060-9b0a-41b0-8d3b-871b78b5c1ba service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1095 time: 0.0563364 Dec 21 03:43:29.573255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-cafb067e-1c7e-48a2-8b2c-2ad615742329 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 217 time: 0.0622470 Dec 21 03:43:29.705823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41086) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:29.746601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-502ab5e8-f2c7-43db-bebe-c13c341c074c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.748004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-502ab5e8-f2c7-43db-bebe-c13c341c074c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1663647 Dec 21 03:43:29.770694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41094) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:29.803459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c420bf7-beaa-49b8-8096-9c83b7a89b64 req-a09e94a3-01d6-4ea6-a731-29fc97ae8646 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.804942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c420bf7-beaa-49b8-8096-9c83b7a89b64 req-a09e94a3-01d6-4ea6-a731-29fc97ae8646 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=d3c7911e116e4170812afec94091929a&shared=False HTTP/1.1" status: 200 len: 922 time: 0.2868078 Dec 21 03:43:29.814596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a51fb73-2875-4729-afe7-d7ad432c14c0 req-610fd7d4-7ccd-435a-9ab4-e5232defef10 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.816139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a51fb73-2875-4729-afe7-d7ad432c14c0 req-610fd7d4-7ccd-435a-9ab4-e5232defef10 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 943 time: 0.1266727 Dec 21 03:43:29.890191 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b44326c-20ae-4f03-a150-880fc37b99f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:29.914012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-d08c4085-40f1-4362-b4a8-6344dbc3a507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:29.915574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-d08c4085-40f1-4362-b4a8-6344dbc3a507 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1498649 Dec 21 03:43:29.932206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d45eb25-110e-4d44-a69f-24477e94b005 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:29.988212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a51fb73-2875-4729-afe7-d7ad432c14c0 req-331cf41a-e9be-4368-9c5e-b7a4b5901287 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1596956 Dec 21 03:43:30.042065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c420bf7-beaa-49b8-8096-9c83b7a89b64 req-90f1b042-51db-4a48-b26f-1d200a298375 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:30.043561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c420bf7-beaa-49b8-8096-9c83b7a89b64 req-90f1b042-51db-4a48-b26f-1d200a298375 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2257788 Dec 21 03:43:30.054465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b44326c-20ae-4f03-a150-880fc37b99f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.081178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d45eb25-110e-4d44-a69f-24477e94b005 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.082793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7020f9a8-fec9-4e7e-8110-4f4b4cc0a1f3 req-da45a16e-6969-479f-b3de-e986a15c2ecf tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:30.084154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7020f9a8-fec9-4e7e-8110-4f4b4cc0a1f3 req-da45a16e-6969-479f-b3de-e986a15c2ecf tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.1255200 Dec 21 03:43:30.090851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-1aac3d6f-8193-4210-84cc-77fd503299b4 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1628985 Dec 21 03:43:30.117144 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b44326c-20ae-4f03-a150-880fc37b99f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.161702 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b44326c-20ae-4f03-a150-880fc37b99f1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=43c96c035c4f427eb98a4f3d56b32aaf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4547672 Dec 21 03:43:30.163147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b44326c-20ae-4f03-a150-880fc37b99f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2716c4ed-bede-4f92-86cf-4aa1742efc83,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:30.165581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41102) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:30.172556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d45eb25-110e-4d44-a69f-24477e94b005 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.203834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7020f9a8-fec9-4e7e-8110-4f4b4cc0a1f3 req-b048a558-1c37-4b91-8b96-d0a8292b20be tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1119959 Dec 21 03:43:30.240038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d45eb25-110e-4d44-a69f-24477e94b005 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d02115ab4c7d45e1896440ff15e7e639&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4682331 Dec 21 03:43:30.240770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d45eb25-110e-4d44-a69f-24477e94b005 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c0785ab-9610-43ee-b7fe-5ca0808e8dc5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:30.242836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41104) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:30.246722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcb02cee-63b2-40a2-8a82-66adc4a953a7 req-9d52d383-bc3a-4caa-95d6-429d1488850a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 210 time: 0.0592942 Dec 21 03:43:30.259252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c65eb9f-6521-4ded-862c-1397a4bec88a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.289655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-3062d95a-13e5-4376-9bcb-b0250ff28df7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:30.291484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-3062d95a-13e5-4376-9bcb-b0250ff28df7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1095 time: 0.1555529 Dec 21 03:43:30.301663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c65eb9f-6521-4ded-862c-1397a4bec88a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.332505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53b0e2fe-fdae-4106-86f8-46ee8794e241 req-e0e7a6fc-56a1-4937-b4b4-09adc8fcd8ce service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2076080 Dec 21 03:43:30.361330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-4c59c433-14bd-49dc-9371-ababfd5057e6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 217 time: 0.0488091 Dec 21 03:43:30.383198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-509462d0-6de5-49e1-aaef-639283500387 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.430706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-509462d0-6de5-49e1-aaef-639283500387 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.439243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-e0154e75-832b-46b9-a943-47c7bf926d8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:30.441370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-e0154e75-832b-46b9-a943-47c7bf926d8c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.0713384 Dec 21 03:43:30.460813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c65eb9f-6521-4ded-862c-1397a4bec88a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.462651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c65eb9f-6521-4ded-862c-1397a4bec88a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.466267 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8c65eb9f-6521-4ded-862c-1397a4bec88a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2716c4ed-bede-4f92-86cf-4aa1742efc83 HTTP/1.1" status: 204 len: 168 time: 0.2971256 Dec 21 03:43:30.487503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c65eb9f-6521-4ded-862c-1397a4bec88a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2716c4ed-bede-4f92-86cf-4aa1742efc83,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:30.517047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-7acd27a3-6e70-45da-a779-8b06ece72262 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:30.519506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-7acd27a3-6e70-45da-a779-8b06ece72262 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0691688 Dec 21 03:43:30.624703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-505a55b2-6447-4204-b6d5-7bed8993ec73 service neutron] 10.222.0.54 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0949376 Dec 21 03:43:30.649068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-509462d0-6de5-49e1-aaef-639283500387 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.652009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-509462d0-6de5-49e1-aaef-639283500387 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:30.654606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-509462d0-6de5-49e1-aaef-639283500387 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3c0785ab-9610-43ee-b7fe-5ca0808e8dc5 HTTP/1.1" status: 204 len: 168 time: 0.4051857 Dec 21 03:43:30.708631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-509462d0-6de5-49e1-aaef-639283500387 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c0785ab-9610-43ee-b7fe-5ca0808e8dc5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:30.745212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcfa0ec4-cbff-4a6e-8238-c074a75b18eb req-8ff537a5-bee3-473b-b39b-9192255dbb2b service neutron] 10.222.0.54 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1130855 Dec 21 03:43:30.798507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c835848e-f3fa-48e1-8887-08c0beb639e6 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=680af371fc8f43789a63fa788b00602b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0224290 Dec 21 03:43:30.909023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-47100b36-0764-4ceb-befa-ce9f5bc1eb8b tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:30.910533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-47100b36-0764-4ceb-befa-ce9f5bc1eb8b tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1024487 Dec 21 03:43:30.931536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Request body: {'port': {'device_id': 'e90912e0-65c9-436f-aa71-025151c63148', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '680af371fc8f43789a63fa788b00602b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:31.082541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 09554808-aec9-4511-ba46-8a6519a51c3a no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:43:31.103693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 09554808-aec9-4511-ba46-8a6519a51c3a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:43:31.104511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 09554808-aec9-4511-ba46-8a6519a51c3a not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:43:31.119369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1ac945-d930-4436-a7f6-aa4447a54f90 req-ca16eb42-0403-4795-84ee-28583039d703 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:31.121075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1ac945-d930-4436-a7f6-aa4447a54f90 req-ca16eb42-0403-4795-84ee-28583039d703 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 943 time: 0.0533812 Dec 21 03:43:31.146676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Made reservation on behalf of 680af371fc8f43789a63fa788b00602b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:31.150316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.196826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1ac945-d930-4436-a7f6-aa4447a54f90 req-81c4850a-42af-44f1-8d61-6523d008939b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696702 Dec 21 03:43:31.230415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41136) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:31.262723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:31.545724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:31.563076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-56a00bff-921d-4c67-8d71-3f87f2ea4f6d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.614638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2663a7c8-8efa-408c-b087-d0fa63b45f0c req-08a84de8-fd17-434e-a862-6795e267094a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 210 time: 0.0517430 Dec 21 03:43:31.635813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41148) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:31.636587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Allocated IP 192.168.233.190 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/13c4445f-fe81-4621-b4be-b1b64372a9c0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:31.662451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9581ffad-d90a-441c-88cf-81cb0ed2ca4e req-e77ca5af-5c04-4def-b1f9-d081e35ebf32 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:31.670200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9581ffad-d90a-441c-88cf-81cb0ed2ca4e req-e77ca5af-5c04-4def-b1f9-d081e35ebf32 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.3656728 Dec 21 03:43:31.684382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-56a00bff-921d-4c67-8d71-3f87f2ea4f6d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.686922 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ac99ffb-f3eb-4f3d-bae9-3390afafde33 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.753131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-56a00bff-921d-4c67-8d71-3f87f2ea4f6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.801043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9581ffad-d90a-441c-88cf-81cb0ed2ca4e req-25a66da1-9977-425f-a5e3-5c989df213ce tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1297288 Dec 21 03:43:31.822985 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-56a00bff-921d-4c67-8d71-3f87f2ea4f6d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4abf63514e4742ea973a0b04570eda87&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2731202 Dec 21 03:43:31.826446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:31.831573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a00bff-921d-4c67-8d71-3f87f2ea4f6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5204f385-3e88-40bd-b82a-6d32a0b8bfd9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:31.844731 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-994a4da6-494c-4b98-8119-066aad0e3ca8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f877f9c747b149198ac1b9cf3f6528bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6131423 Dec 21 03:43:31.847417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:31.858548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ff674448-b285-477d-ba30-2f81d73128ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.922622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ac99ffb-f3eb-4f3d-bae9-3390afafde33 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.925901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6dccfd0-cbdb-4840-bcc3-e47f453ea8cc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.949092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.958201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6dccfd0-cbdb-4840-bcc3-e47f453ea8cc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.962415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b00ab5d1-3758-4262-87bd-230bbfa09323 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:31.996082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b00ab5d1-3758-4262-87bd-230bbfa09323 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.008629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ff674448-b285-477d-ba30-2f81d73128ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.028484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ac99ffb-f3eb-4f3d-bae9-3390afafde33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.069129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac99ffb-f3eb-4f3d-bae9-3390afafde33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe42dd91-588a-4531-859a-bee0da75987d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.073179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0ac99ffb-f3eb-4f3d-bae9-3390afafde33 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e043a757a005469682a5766cd1390d6a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4343715 Dec 21 03:43:32.075879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:32.077835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ff674448-b285-477d-ba30-2f81d73128ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.118439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ff674448-b285-477d-ba30-2f81d73128ac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=84b69030f83c42f7a464cfcb9e9fe617&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8542352 Dec 21 03:43:32.122568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41158) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:32.125173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff674448-b285-477d-ba30-2f81d73128ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ee97e16-f1d2-47c0-b346-ed007e3bc87d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.142340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fc729c3-4b7a-4eae-b105-78a62e8269de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.144305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.144665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6dccfd0-cbdb-4840-bcc3-e47f453ea8cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.148273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6dccfd0-cbdb-4840-bcc3-e47f453ea8cc admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.149054 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d6dccfd0-cbdb-4840-bcc3-e47f453ea8cc admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5204f385-3e88-40bd-b82a-6d32a0b8bfd9 HTTP/1.1" status: 204 len: 168 time: 0.3138249 Dec 21 03:43:32.168905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6dccfd0-cbdb-4840-bcc3-e47f453ea8cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5204f385-3e88-40bd-b82a-6d32a0b8bfd9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.178652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['43cbd190-b145-423d-9f7c-f2f1eabaabc2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:32.194650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b00ab5d1-3758-4262-87bd-230bbfa09323 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.195757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b00ab5d1-3758-4262-87bd-230bbfa09323 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.196897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b00ab5d1-3758-4262-87bd-230bbfa09323 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/96f618ad-8507-4bab-a069-bd6e46faf322 HTTP/1.1" status: 204 len: 168 time: 0.3475006 Dec 21 03:43:32.236594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fc729c3-4b7a-4eae-b105-78a62e8269de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.246059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00ab5d1-3758-4262-87bd-230bbfa09323 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96f618ad-8507-4bab-a069-bd6e46faf322,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.260386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:32.271128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:32.272942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Pushing event updated for resources: {'Port': ['ID=13c4445f-fe81-4621-b4be-b1b64372a9c0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.275188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:32.280971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:32.281602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.317512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-262b5913-e956-4d7f-9ab7-3ba48b5dcaf3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.380210 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-262b5913-e956-4d7f-9ab7-3ba48b5dcaf3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.416083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-c1fb07ee-3d1c-4cb7-82bf-90c2376e3ff7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.4883604 Dec 21 03:43:32.448710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Request body: {'port': {'device_id': 'e90912e0-65c9-436f-aa71-025151c63148', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:32.503437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c5e21fe-6119-452b-be6e-b468291120b1 req-ab0e766c-9efc-4d63-95bd-1469478792ba tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:32.505038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c5e21fe-6119-452b-be6e-b468291120b1 req-ab0e766c-9efc-4d63-95bd-1469478792ba tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 943 time: 0.1669691 Dec 21 03:43:32.505694 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fc729c3-4b7a-4eae-b105-78a62e8269de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.508447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fc729c3-4b7a-4eae-b105-78a62e8269de admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.509383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3fc729c3-4b7a-4eae-b105-78a62e8269de admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fe42dd91-588a-4531-859a-bee0da75987d HTTP/1.1" status: 204 len: 168 time: 0.4326150 Dec 21 03:43:32.544809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc729c3-4b7a-4eae-b105-78a62e8269de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe42dd91-588a-4531-859a-bee0da75987d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.590145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-262b5913-e956-4d7f-9ab7-3ba48b5dcaf3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.592724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-262b5913-e956-4d7f-9ab7-3ba48b5dcaf3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.596889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-262b5913-e956-4d7f-9ab7-3ba48b5dcaf3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5ee97e16-f1d2-47c0-b346-ed007e3bc87d HTTP/1.1" status: 204 len: 168 time: 0.4718518 Dec 21 03:43:32.601577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.627284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dcccdea6-ec13-48bb-a030-6406a98d4066 None None] Provisioning complete for port 13c4445f-fe81-4621-b4be-b1b64372a9c0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:32.631436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dcccdea6-ec13-48bb-a030-6406a98d4066 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:32.634378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-262b5913-e956-4d7f-9ab7-3ba48b5dcaf3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ee97e16-f1d2-47c0-b346-ed007e3bc87d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:32.672168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c5e21fe-6119-452b-be6e-b468291120b1 req-a63ea385-965c-4348-8a79-a90e2d166354 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1541872 Dec 21 03:43:32.685238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fbe7055-0d42-4075-8565-79874ea1d4af req-4a0d6fb2-03bb-426f-99ae-46d9cba21bc7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:32.685573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fbe7055-0d42-4075-8565-79874ea1d4af req-4a0d6fb2-03bb-426f-99ae-46d9cba21bc7 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.1419201 Dec 21 03:43:32.702022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dcccdea6-ec13-48bb-a030-6406a98d4066 None None] Port 13c4445f-fe81-4621-b4be-b1b64372a9c0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:32.863987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fbe7055-0d42-4075-8565-79874ea1d4af req-7931388b-1b0e-4596-9e9e-f5b33296462e tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1537807 Dec 21 03:43:32.885190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55ea546-1c29-47ff-984d-b3f51d75beb2 req-107ca2aa-320b-4444-ba15-34c81007510a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:32.886484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c55ea546-1c29-47ff-984d-b3f51d75beb2 req-107ca2aa-320b-4444-ba15-34c81007510a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 936 time: 0.1101589 Dec 21 03:43:32.974278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41186) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:32.978145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c55ea546-1c29-47ff-984d-b3f51d75beb2 req-53feba20-0939-4d1f-a67d-9af012927ca7 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657477 Dec 21 03:43:33.023043 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f2b4000-08d5-4c8d-9208-6cb8ded6b8d2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a4a979d7ed294515b73903692c633ee7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0470269 Dec 21 03:43:33.025611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:33.070993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13c4445f-fe81-4621-b4be-b1b64372a9c0 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:33.079348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.084114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a08bab2f-2e59-424c-9a0b-6dca84315b45 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.092376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Transition to ACTIVE for port object 13c4445f-fe81-4621-b4be-b1b64372a9c0 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:33.106752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a08bab2f-2e59-424c-9a0b-6dca84315b45 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.157313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.215145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a08bab2f-2e59-424c-9a0b-6dca84315b45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.221562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a08bab2f-2e59-424c-9a0b-6dca84315b45 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.228484 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a08bab2f-2e59-424c-9a0b-6dca84315b45 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8abddbc5-66bf-4cb7-a4b4-c7c8398fc37f HTTP/1.1" status: 204 len: 168 time: 0.1974366 Dec 21 03:43:33.235231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08bab2f-2e59-424c-9a0b-6dca84315b45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8abddbc5-66bf-4cb7-a4b4-c7c8398fc37f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:33.280358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Pushing event updated for resources: {'Port': ['ID=13c4445f-fe81-4621-b4be-b1b64372a9c0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:33.285443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Attempting to bind port 13c4445f-fe81-4621-b4be-b1b64372a9c0 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:33.285780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Attempting to bind port 13c4445f-fe81-4621-b4be-b1b64372a9c0 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:33.286473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Attempting to bind port 13c4445f-fe81-4621-b4be-b1b64372a9c0 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:33.301209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Port 13c4445f-fe81-4621-b4be-b1b64372a9c0 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:33.301209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Attempting to bind port 13c4445f-fe81-4621-b4be-b1b64372a9c0 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:33.302794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:33.303334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:33.303882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:33.304889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Bound port: 13c4445f-fe81-4621-b4be-b1b64372a9c0, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:33.312740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.427163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d241b24a-7e70-48fb-9178-eaca7d27d506 req-b3f892c2-9537-4cff-b6ab-1680d1fe7828 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:33.428680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d241b24a-7e70-48fb-9178-eaca7d27d506 req-b3f892c2-9537-4cff-b6ab-1680d1fe7828 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.0950832 Dec 21 03:43:33.429786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] For port 13c4445f-fe81-4621-b4be-b1b64372a9c0, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:33.433091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] For port 13c4445f-fe81-4621-b4be-b1b64372a9c0, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=13c4445f-fe81-4621-b4be-b1b64372a9c0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:33.477800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d241b24a-7e70-48fb-9178-eaca7d27d506 req-9a1307d0-a423-454d-9e5d-058736f9130b tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430369 Dec 21 03:43:33.534553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.567800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:33.568421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.569795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] 10.222.0.31 "PUT /v2.0/ports/13c4445f-fe81-4621-b4be-b1b64372a9c0 HTTP/1.1" status: 200 len: 1097 time: 1.1307101 Dec 21 03:43:33.570234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e90912e0-65c9-436f-aa71-025151c63148', 'tag': '13c4445f-fe81-4621-b4be-b1b64372a9c0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:33.572466 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-123c1e16-4e7b-45f9-b9fc-0065ae4f44b5" -d '{"events": [{"name": "network-changed", "server_uuid": "e90912e0-65c9-436f-aa71-025151c63148", "tag": "13c4445f-fe81-4621-b4be-b1b64372a9c0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:33.605269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253579d9-740d-4f3b-9d07-006bc3fabfbd service neutron] Pushing event updated for resources: {'Port': ['ID=13c4445f-fe81-4621-b4be-b1b64372a9c0,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:33.624844 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-334b7078-f772-480b-b7e1-c25eac1f3561 x-openstack-request-id: req-334b7078-f772-480b-b7e1-c25eac1f3561 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:33.625140 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e90912e0-65c9-436f-aa71-025151c63148", "tag": "13c4445f-fe81-4621-b4be-b1b64372a9c0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:33.625395 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-334b7078-f772-480b-b7e1-c25eac1f3561 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:33.625801 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e90912e0-65c9-436f-aa71-025151c63148', 'tag': '13c4445f-fe81-4621-b4be-b1b64372a9c0', 'status': 'completed', 'code': 200} Dec 21 03:43:33.635578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41208) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:33.652271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c7861c2-38b9-4738-822a-fb9befc69bd2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.771538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123c1e16-4e7b-45f9-b9fc-0065ae4f44b5 req-37b254e7-d5be-4d23-8dec-8ea0a1076991 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:33.773684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-123c1e16-4e7b-45f9-b9fc-0065ae4f44b5 req-37b254e7-d5be-4d23-8dec-8ea0a1076991 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=680af371fc8f43789a63fa788b00602b&device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 1100 time: 0.0814335 Dec 21 03:43:33.847342 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c7861c2-38b9-4738-822a-fb9befc69bd2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:33.849458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-123c1e16-4e7b-45f9-b9fc-0065ae4f44b5 req-aabe2abe-ac4b-454a-9587-2300d5c312f7 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=680af371fc8f43789a63fa788b00602b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0542016 Dec 21 03:43:33.897782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0546aba7-4613-4dd4-86e3-a5c06612c6f1 req-fa084a6c-165c-4cad-a315-9984b95ebe15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:33.899436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0546aba7-4613-4dd4-86e3-a5c06612c6f1 req-fa084a6c-165c-4cad-a315-9984b95ebe15 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 943 time: 0.1127830 Dec 21 03:43:33.933994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c7861c2-38b9-4738-822a-fb9befc69bd2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:34.015586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c7861c2-38b9-4738-822a-fb9befc69bd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e80f52a5-90f6-46f4-96ba-13a4a3bf0156,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:34.028802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5c7861c2-38b9-4738-822a-fb9befc69bd2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f3a29c1a06114973986bc9d3907fab90&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3879793 Dec 21 03:43:34.056065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:34.057069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123c1e16-4e7b-45f9-b9fc-0065ae4f44b5 req-447bc6ff-40d1-4057-80fc-fe61744a81dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:34.057069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-123c1e16-4e7b-45f9-b9fc-0065ae4f44b5 req-447bc6ff-40d1-4057-80fc-fe61744a81dc service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1788018 Dec 21 03:43:34.057069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0546aba7-4613-4dd4-86e3-a5c06612c6f1 req-8eaa284b-b313-4321-abdb-bda3f0660eb3 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1133034 Dec 21 03:43:34.272850 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9c91967-1863-43e6-bb0c-c3260000ce99 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:34.272850 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9c91967-1863-43e6-bb0c-c3260000ce99 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:34.273138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803972a0-7344-4f02-a41c-2fb0d7f3e722 req-e466504a-7861-4a0e-897c-b282ee86eae5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:34.273138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-803972a0-7344-4f02-a41c-2fb0d7f3e722 req-e466504a-7861-4a0e-897c-b282ee86eae5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 948 time: 0.0962083 Dec 21 03:43:34.273138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-b4a863d2-9588-4f93-833d-7643881c0130 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:34.273138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-b4a863d2-9588-4f93-833d-7643881c0130 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=680af371fc8f43789a63fa788b00602b&device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 1100 time: 0.0744214 Dec 21 03:43:34.273138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-0f950445-38f3-4afe-9610-b4491e994a9f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=13c4445f-fe81-4621-b4be-b1b64372a9c0 HTTP/1.1" status: 200 len: 217 time: 0.0446267 Dec 21 03:43:34.310045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-803972a0-7344-4f02-a41c-2fb0d7f3e722 req-857bfd13-7f58-49e3-8e5e-4638e01f5276 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1154611 Dec 21 03:43:34.329265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-bc877705-8b2c-4b51-982d-fb6bef06d392 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:34.331297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-bc877705-8b2c-4b51-982d-fb6bef06d392 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0549881 Dec 21 03:43:34.379221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-ddcd840d-581c-4528-ae35-85d340498549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:34.380673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-ddcd840d-581c-4528-ae35-85d340498549 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0415907 Dec 21 03:43:34.470335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9c91967-1863-43e6-bb0c-c3260000ce99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:34.471060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-f62c50a1-6844-4f96-aa34-45aa923a0072 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824685 Dec 21 03:43:34.473048 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9c91967-1863-43e6-bb0c-c3260000ce99 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:34.474166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c9c91967-1863-43e6-bb0c-c3260000ce99 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e80f52a5-90f6-46f4-96ba-13a4a3bf0156 HTTP/1.1" status: 204 len: 168 time: 0.4454923 Dec 21 03:43:34.482081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9c91967-1863-43e6-bb0c-c3260000ce99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e80f52a5-90f6-46f4-96ba-13a4a3bf0156,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:34.581509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f425859a-d171-4fe7-86db-e016d2d1a9f2 req-461e78f0-8539-414c-84c2-6605627d01f3 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1020446 Dec 21 03:43:34.660899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ed42f3-7424-4e15-be74-56126d61658f req-0cc834f2-3e19-4620-93cd-2230e0aa0070 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:34.662773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18ed42f3-7424-4e15-be74-56126d61658f req-0cc834f2-3e19-4620-93cd-2230e0aa0070 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.0613406 Dec 21 03:43:34.713457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18ed42f3-7424-4e15-be74-56126d61658f req-ff51f58f-78e5-467d-8d7e-38d7bae5ce4a tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418699 Dec 21 03:43:35.052215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-46110432-aac9-46df-aca6-f8bc1d750dfb tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:35.053899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-46110432-aac9-46df-aca6-f8bc1d750dfb tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.0754473 Dec 21 03:43:35.076045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ce7fb06-2f70-4696-904a-92f477cbea6e details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:35.211486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8ce7fb06-2f70-4696-904a-92f477cbea6e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:35.224578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:35.249828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c8f252-55ad-4a36-a2ad-54b6d8a64f0f req-c8d48083-a055-4720-ac99-502b85027fdd tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:35.251450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47c8f252-55ad-4a36-a2ad-54b6d8a64f0f req-c8d48083-a055-4720-ac99-502b85027fdd tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 943 time: 0.0876656 Dec 21 03:43:35.295312 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:35.314555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8ce7fb06-2f70-4696-904a-92f477cbea6e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:35.317887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47c8f252-55ad-4a36-a2ad-54b6d8a64f0f req-4652b82c-fd9d-45f4-9fce-eeb2f8fe4eb3 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586104 Dec 21 03:43:35.319787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Deleting port e48308a4-e659-4026-9fcb-3c27d30462d6 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:43:35.326464 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:35.345435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8ce7fb06-2f70-4696-904a-92f477cbea6e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:35.414503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:35.464815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7e548f-b37c-43ac-a764-4161ad2f583b req-1bd32da3-c3ca-46d4-a6cc-d6e4abbfb6e4 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:35.472424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c7e548f-b37c-43ac-a764-4161ad2f583b req-1bd32da3-c3ca-46d4-a6cc-d6e4abbfb6e4 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 948 time: 0.0874062 Dec 21 03:43:35.476167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] For port e48308a4-e659-4026-9fcb-3c27d30462d6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e48308a4-e659-4026-9fcb-3c27d30462d6,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:35.476534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:35.477229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8ce7fb06-2f70-4696-904a-92f477cbea6e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:35.511362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Calling delete_port for e48308a4-e659-4026-9fcb-3c27d30462d6 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:43:35.712963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['8ce7fb06-2f70-4696-904a-92f477cbea6e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:35.841314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c7e548f-b37c-43ac-a764-4161ad2f583b req-da30025a-d43f-453c-a404-5c3fb484ed22 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3679335 Dec 21 03:43:35.901282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def9c275-b812-493f-80fe-a3606b8792ac req-962c2c12-69a7-4a37-a9e3-c88c36b17709 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:35.902784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-def9c275-b812-493f-80fe-a3606b8792ac req-962c2c12-69a7-4a37-a9e3-c88c36b17709 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 950 time: 0.0806732 Dec 21 03:43:35.989751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-def9c275-b812-493f-80fe-a3606b8792ac req-071784f3-e00f-4fbe-bbaf-b3a25dcb5ede tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/security-groups?id=1065f1e7-e210-44fc-a634-4f4d9c3b8022&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759699 Dec 21 03:43:36.099911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:36.135895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Pushing event deleted for resources: {'Port': ['ID=e48308a4-e659-4026-9fcb-3c27d30462d6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:36.138809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['e48308a4-e659-4026-9fcb-3c27d30462d6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:36.207366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] No DVR routers for this DVR port e48308a4-e659-4026-9fcb-3c27d30462d6 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:43:36.211687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:36.214690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a00bed3d-038a-42ae-a62d-440ab87a66ae req-cc1aff94-20d8-4aec-ba72-82b519f13f04 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.31 "DELETE /v2.0/ports/e48308a4-e659-4026-9fcb-3c27d30462d6 HTTP/1.1" status: 204 len: 173 time: 1.1540015 Dec 21 03:43:36.215370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'name': 'network-vif-deleted', 'tag': 'e48308a4-e659-4026-9fcb-3c27d30462d6'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:36.217877 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c07cb5a4-35c1-47b7-82d1-d7ba3a519a44" -d '{"events": [{"server_uuid": "2277f3cf-549f-4cd0-96da-348fc79ea7c8", "name": "network-vif-deleted", "tag": "e48308a4-e659-4026-9fcb-3c27d30462d6"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:36.261854 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-510c59ce-cb48-4ccd-b758-4b55ddde8984 x-openstack-request-id: req-510c59ce-cb48-4ccd-b758-4b55ddde8984 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:36.261854 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2277f3cf-549f-4cd0-96da-348fc79ea7c8", "name": "network-vif-deleted", "tag": "e48308a4-e659-4026-9fcb-3c27d30462d6", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:36.261854 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-510c59ce-cb48-4ccd-b758-4b55ddde8984 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:36.262675 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2277f3cf-549f-4cd0-96da-348fc79ea7c8', 'name': 'network-vif-deleted', 'tag': 'e48308a4-e659-4026-9fcb-3c27d30462d6', 'status': 'completed', 'code': 200} Dec 21 03:43:36.474145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d27a4f-3594-469e-b3d8-7a861cae5c7b req-7221527f-9319-4797-81ac-0c9e6e121dcb tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:36.475852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4d27a4f-3594-469e-b3d8-7a861cae5c7b req-7221527f-9319-4797-81ac-0c9e6e121dcb tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 944 time: 0.0759449 Dec 21 03:43:36.529294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4d27a4f-3594-469e-b3d8-7a861cae5c7b req-b61c64bd-e95a-447d-b003-ff5702461080 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472779 Dec 21 03:43:36.992182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605b4edc-44dd-4626-bce7-521b74bc038f req-abda045b-38f4-49e3-bdcb-b86a99e45b36 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:36.999444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-605b4edc-44dd-4626-bce7-521b74bc038f req-abda045b-38f4-49e3-bdcb-b86a99e45b36 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 948 time: 0.0659914 Dec 21 03:43:37.056693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-605b4edc-44dd-4626-bce7-521b74bc038f req-2e2b62c7-e74f-4a63-8408-05e429d0e723 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477977 Dec 21 03:43:37.090768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ce7fb06-2f70-4696-904a-92f477cbea6e up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:37.157015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c81188-c6d1-404a-a606-b50ff2b4c29c req-a75112c0-5cf0-461a-a143-3a765389ea90 tempest-DeleteServersAdminTestJSON-1686154496 tempest-DeleteServersAdminTestJSON-1686154496-project] 10.222.0.18 "GET /v2.0/ports?device_id=2277f3cf-549f-4cd0-96da-348fc79ea7c8 HTTP/1.1" status: 200 len: 210 time: 0.0353954 Dec 21 03:43:37.243886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 8ce7fb06-2f70-4696-904a-92f477cbea6e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:37.247962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 8ce7fb06-2f70-4696-904a-92f477cbea6e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:37.248330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:37.346843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:37.370498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:37.373011 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86980108-c655-4d13-89fc-7525f7306ed9" -d '{"events": [{"server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "name": "network-vif-plugged", "status": "completed", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:37.389149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 13c4445f-fe81-4621-b4be-b1b64372a9c0 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:37.393409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8ce7fb06-2f70-4696-904a-92f477cbea6e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:37.499238 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1f90c90-acc4-40b5-a844-335855bc78be x-openstack-request-id: req-d1f90c90-acc4-40b5-a844-335855bc78be {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:37.504899 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "name": "network-vif-plugged", "status": "completed", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:37.504899 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d1f90c90-acc4-40b5-a844-335855bc78be {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:37.504899 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'code': 200} Dec 21 03:43:37.504899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:37.515301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-84196ef4-716d-4c3d-93cf-9faa94970c3b tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0336843 Dec 21 03:43:37.544794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 13c4445f-fe81-4621-b4be-b1b64372a9c0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=13c4445f-fe81-4621-b4be-b1b64372a9c0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:37.601527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '13c4445f-fe81-4621-b4be-b1b64372a9c0', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '13c4445f-fe81-4621-b4be-b1b64372a9c0', 'mac_address': 'fa:16:3e:00:5e:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.190'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:37.603418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8ce7fb06-2f70-4696-904a-92f477cbea6e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:37.661698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:37.676837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13c4445f-fe81-4621-b4be-b1b64372a9c0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:37.700480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 13c4445f-fe81-4621-b4be-b1b64372a9c0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=13c4445f-fe81-4621-b4be-b1b64372a9c0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:37.712909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506208b6-590e-4a20-b3a1-41f18c77d802 req-daea95d1-cb0e-4043-a85f-c9b98eab3467 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:37.712909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-506208b6-590e-4a20-b3a1-41f18c77d802 req-daea95d1-cb0e-4043-a85f-c9b98eab3467 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1097 time: 0.1570544 Dec 21 03:43:37.743641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb4c12a-7494-4c58-bf4d-7a7c6ff1efae req-e0768f4e-6160-4eac-9c1d-ec0a3ea29256 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:37.745115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eeb4c12a-7494-4c58-bf4d-7a7c6ff1efae req-e0768f4e-6160-4eac-9c1d-ec0a3ea29256 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 945 time: 0.1077592 Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.754257 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:37.756729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:37.757540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-cad104d5-3d0d-4f4f-883a-eb67736165e1 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:37.758920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-cad104d5-3d0d-4f4f-883a-eb67736165e1 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2425017 Dec 21 03:43:37.785639 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:37.796462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f7ae28a9-71ff-45f1-9491-611aabd25146 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/quotas/f99ea8b7ae9a4d40aed93882fd7c11fc HTTP/1.1" status: 200 len: 375 time: 0.0272899 Dec 21 03:43:37.826217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-506208b6-590e-4a20-b3a1-41f18c77d802 req-f922d1a6-de6f-4714-943a-5617e1606139 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132894 Dec 21 03:43:37.840714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=13c4445f-fe81-4621-b4be-b1b64372a9c0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:37.846179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-d3f0f847-9b0d-420b-8c2a-7b315852c7f9 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0373485 Dec 21 03:43:37.874015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eeb4c12a-7494-4c58-bf4d-7a7c6ff1efae req-0ee9da4a-20f0-4d20-8cbd-19e37970ce1f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999494 Dec 21 03:43:37.955553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41400) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:38.124449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb4120f1-3285-44e9-9ca9-f5e17efb8723 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.157033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['13c4445f-fe81-4621-b4be-b1b64372a9c0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:38.272244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a9356e8-db51-43b3-8eb0-91110210810c req-0f9c3e0f-6435-4459-bf11-b2634982c3eb tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 210 time: 0.0600047 Dec 21 03:43:38.274204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-d34c84e0-bbf8-4341-b783-0d0fb0a939c0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0616691 Dec 21 03:43:38.418192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb4120f1-3285-44e9-9ca9-f5e17efb8723 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.449195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-a9bf8891-d094-404f-a461-53beb95b3f6a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:38.450673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-a9bf8891-d094-404f-a461-53beb95b3f6a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1697969 Dec 21 03:43:38.461205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6aaa4ba-2682-4aa1-94df-571431d42783 req-fb0bc198-afaf-4796-9b42-663608383c74 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:38.461885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6aaa4ba-2682-4aa1-94df-571431d42783 req-fb0bc198-afaf-4796-9b42-663608383c74 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 949 time: 0.1014762 Dec 21 03:43:38.478086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb4120f1-3285-44e9-9ca9-f5e17efb8723 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.488918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-45f4f860-372b-4e9d-b376-6fd961c35a21 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/quotas/408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 375 time: 0.0261157 Dec 21 03:43:38.557993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c295e37d-d8f8-4a27-953d-7cde6c4ed8e2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0571511 Dec 21 03:43:38.565741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bb4120f1-3285-44e9-9ca9-f5e17efb8723 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f3ece6037864422c84aba08ce415262f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6091430 Dec 21 03:43:38.568630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41430) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:38.569137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4120f1-3285-44e9-9ca9-f5e17efb8723 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48c6bb68-43bc-45a4-92a3-c24bead50f0d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:38.576320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6aaa4ba-2682-4aa1-94df-571431d42783 req-b8775b30-14f0-493b-a36e-4d1114057c7c tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071589 Dec 21 03:43:38.661200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0e68a7-7bf5-4cf3-8c9a-4da71e1b6534 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.685949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0e68a7-7bf5-4cf3-8c9a-4da71e1b6534 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.836841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0e68a7-7bf5-4cf3-8c9a-4da71e1b6534 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.840291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0e68a7-7bf5-4cf3-8c9a-4da71e1b6534 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:38.848400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2a0e68a7-7bf5-4cf3-8c9a-4da71e1b6534 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/48c6bb68-43bc-45a4-92a3-c24bead50f0d HTTP/1.1" status: 204 len: 168 time: 0.2719767 Dec 21 03:43:38.866885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a0e68a7-7bf5-4cf3-8c9a-4da71e1b6534 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48c6bb68-43bc-45a4-92a3-c24bead50f0d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:38.957186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db9d4d3a-8197-434a-ba15-bedf8c98372a req-a3712608-d455-4a1f-a16d-bfc6ba268051 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 210 time: 0.0388343 Dec 21 03:43:39.059379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12b017b-023c-4944-86f1-1b589725e312 req-13cb96b1-3adb-450d-832f-4b72968956a4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:39.059379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b12b017b-023c-4944-86f1-1b589725e312 req-13cb96b1-3adb-450d-832f-4b72968956a4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 945 time: 0.0655282 Dec 21 03:43:39.140109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b12b017b-023c-4944-86f1-1b589725e312 req-9ee55dba-d8c2-4721-a42c-8bf933fb381f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741057 Dec 21 03:43:39.368818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fbbcd83-6a9e-4ae4-80a2-9b3c9ab31c97 req-d86cc592-ac6d-41a0-9017-395f54f5c74c tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 210 time: 0.0258055 Dec 21 03:43:39.394175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 13c4445f-fe81-4621-b4be-b1b64372a9c0 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:39.510812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 13c4445f-fe81-4621-b4be-b1b64372a9c0 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:39.516205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 13c4445f-fe81-4621-b4be-b1b64372a9c0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:39.516582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:39.606751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:39.638362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e90912e0-65c9-436f-aa71-025151c63148', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13c4445f-fe81-4621-b4be-b1b64372a9c0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:39.640959 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47699857-f961-42e2-af2f-e997cee5d53d" -d '{"events": [{"server_uuid": "e90912e0-65c9-436f-aa71-025151c63148", "name": "network-vif-plugged", "status": "completed", "tag": "13c4445f-fe81-4621-b4be-b1b64372a9c0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:39.656618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 13c4445f-fe81-4621-b4be-b1b64372a9c0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=13c4445f-fe81-4621-b4be-b1b64372a9c0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:39.708226 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d537ad11-e5e7-401b-a672-c80ce5c93245 x-openstack-request-id: req-d537ad11-e5e7-401b-a672-c80ce5c93245 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:39.708818 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e90912e0-65c9-436f-aa71-025151c63148", "name": "network-vif-plugged", "status": "completed", "tag": "13c4445f-fe81-4621-b4be-b1b64372a9c0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:39.709195 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d537ad11-e5e7-401b-a672-c80ce5c93245 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:39.709724 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e90912e0-65c9-436f-aa71-025151c63148', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13c4445f-fe81-4621-b4be-b1b64372a9c0', 'code': 200} Dec 21 03:43:39.739934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:39.741273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e48308a4-e659-4026-9fcb-3c27d30462d6 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:43:39.782991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: e48308a4-e659-4026-9fcb-3c27d30462d6 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:43:39.784192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e48308a4-e659-4026-9fcb-3c27d30462d6 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:43:39.787041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215899ff-463b-497e-80a6-4c7fc93417e1 req-4398ad46-ae01-4421-9c7c-eb773d33cf92 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:39.795058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41482) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:39.796486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-215899ff-463b-497e-80a6-4c7fc93417e1 req-4398ad46-ae01-4421-9c7c-eb773d33cf92 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 949 time: 0.1013453 Dec 21 03:43:39.838874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41486) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:39.844305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=13c4445f-fe81-4621-b4be-b1b64372a9c0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:39.863295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-215899ff-463b-497e-80a6-4c7fc93417e1 req-24f132a7-145d-4d2d-8b47-c1b0dd838f6c tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657747 Dec 21 03:43:39.894880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964bf2fe-e7dd-46e5-bdb8-15ad6c2aaa85 req-b2f3f52c-d7cc-44a6-a0ce-5bb7eaf7491a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:39.896628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-964bf2fe-e7dd-46e5-bdb8-15ad6c2aaa85 req-b2f3f52c-d7cc-44a6-a0ce-5bb7eaf7491a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 1102 time: 0.0463243 Dec 21 03:43:39.948678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-964bf2fe-e7dd-46e5-bdb8-15ad6c2aaa85 req-ba3ebaaf-0fee-43a6-83db-0501cbd21c3d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407474 Dec 21 03:43:39.990838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79e7d9e5-50a5-4540-acf9-3de2f7df274c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:39.996812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-27c8e48a-42ca-4d0e-adc8-2c177911626d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=dc54f4797de4426ba52a3489b5990c5e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1956627 Dec 21 03:43:39.997695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41492) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:40.045819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98d47294-97f8-43c6-a316-c390c898ddf6 req-906d8f20-e345-480e-9cc9-cec532fc5583 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 210 time: 0.0343935 Dec 21 03:43:40.080970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879a2f8e-1765-488f-a7b4-64cacca6fe6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.084208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79e7d9e5-50a5-4540-acf9-3de2f7df274c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.118248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879a2f8e-1765-488f-a7b4-64cacca6fe6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.174545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41496) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:40.187192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79e7d9e5-50a5-4540-acf9-3de2f7df274c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.189868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c36ac690-5649-4537-a9ca-65b0ba99e0fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.245807 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-79e7d9e5-50a5-4540-acf9-3de2f7df274c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=548daeacfe9d48879291b400518c8493&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4054878 Dec 21 03:43:40.248419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e7d9e5-50a5-4540-acf9-3de2f7df274c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7da1fcd0-bc98-43c3-a03b-797d3f9b6e3f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:40.250662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:40.253862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879a2f8e-1765-488f-a7b4-64cacca6fe6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.256923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879a2f8e-1765-488f-a7b4-64cacca6fe6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.260516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-879a2f8e-1765-488f-a7b4-64cacca6fe6f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1065f1e7-e210-44fc-a634-4f4d9c3b8022 HTTP/1.1" status: 204 len: 168 time: 0.2594404 Dec 21 03:43:40.296510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-81d7fb02-e273-4956-9a1d-d9187020c0ee tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0347352 Dec 21 03:43:40.298720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-879a2f8e-1765-488f-a7b4-64cacca6fe6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1065f1e7-e210-44fc-a634-4f4d9c3b8022,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:40.362290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b85986a-f2da-49af-85dd-8c7e90a5a0ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.385812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12d21fcd-ae1c-485c-b287-af758aff262e req-09aa4aeb-ec96-4715-ac5b-487accdc6c34 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:40.387804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12d21fcd-ae1c-485c-b287-af758aff262e req-09aa4aeb-ec96-4715-ac5b-487accdc6c34 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 945 time: 0.1745305 Dec 21 03:43:40.390509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c36ac690-5649-4537-a9ca-65b0ba99e0fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.400399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b85986a-f2da-49af-85dd-8c7e90a5a0ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.458170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c36ac690-5649-4537-a9ca-65b0ba99e0fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.507048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c36ac690-5649-4537-a9ca-65b0ba99e0fc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=fee1879e8f874b76906cb4db3493012d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3324592 Dec 21 03:43:40.509616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41506) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:40.512989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d8a73b-2503-4f3a-abee-33bce83ab288 req-8a40cacb-9c6c-487e-995f-08e6921c356b tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 210 time: 0.0517175 Dec 21 03:43:40.517470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c36ac690-5649-4537-a9ca-65b0ba99e0fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f739365f-f280-4be1-ac17-a44a483e1aae,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:40.545577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-735a5936-6f27-41f0-ba49-1798559ee391 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:40.547472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-735a5936-6f27-41f0-ba49-1798559ee391 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2414293 Dec 21 03:43:40.551856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12d21fcd-ae1c-485c-b287-af758aff262e req-5dbff3df-dec2-47d7-a12d-60b27b8eac34 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250556 Dec 21 03:43:40.564241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9778608c-637c-45c7-8a28-d51616fe9bc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.569008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Request body: {'port': {'device_id': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'f99ea8b7ae9a4d40aed93882fd7c11fc'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:40.587947 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9778608c-637c-45c7-8a28-d51616fe9bc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.621878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b85986a-f2da-49af-85dd-8c7e90a5a0ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.624776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b85986a-f2da-49af-85dd-8c7e90a5a0ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.626046 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7b85986a-f2da-49af-85dd-8c7e90a5a0ca admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7da1fcd0-bc98-43c3-a03b-797d3f9b6e3f HTTP/1.1" status: 204 len: 168 time: 0.3596959 Dec 21 03:43:40.639096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b85986a-f2da-49af-85dd-8c7e90a5a0ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7da1fcd0-bc98-43c3-a03b-797d3f9b6e3f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:40.706421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9778608c-637c-45c7-8a28-d51616fe9bc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.713706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9778608c-637c-45c7-8a28-d51616fe9bc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.714855 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9778608c-637c-45c7-8a28-d51616fe9bc3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f739365f-f280-4be1-ac17-a44a483e1aae HTTP/1.1" status: 204 len: 168 time: 0.2041824 Dec 21 03:43:40.723300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9778608c-637c-45c7-8a28-d51616fe9bc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f739365f-f280-4be1-ac17-a44a483e1aae,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:40.820961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-ee97482a-35ff-4148-b5df-caa52b5ba694 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:40.822434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-ee97482a-35ff-4148-b5df-caa52b5ba694 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.1178885 Dec 21 03:43:40.876135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-0cff6058-2c2e-4b57-ac1b-3358f1fef92b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 695 time: 0.0464265 Dec 21 03:43:40.886411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'floatingip': {'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:40.957442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Made reservation on behalf of f99ea8b7ae9a4d40aed93882fd7c11fc for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:40.960869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:40.992622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.026091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.118754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b0ef9f-b4c3-4114-9ca3-3ec2d2430c50 req-627db0d5-1241-41ad-a7d2-9b6c59df93d5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:41.120257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73b0ef9f-b4c3-4114-9ca3-3ec2d2430c50 req-627db0d5-1241-41ad-a7d2-9b6c59df93d5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 950 time: 0.1712897 Dec 21 03:43:41.274371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73b0ef9f-b4c3-4114-9ca3-3ec2d2430c50 req-67e2645e-cad0-4918-91ce-e4a68be8290f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1473315 Dec 21 03:43:41.321552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.443816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41526) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:41.454797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.458973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a647396-c0af-4812-a715-bc9732fd590a req-161132b3-1f64-48a6-83a4-db46a35e9bec tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 210 time: 0.1034021 Dec 21 03:43:41.473186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce39789d-8272-4070-9849-208d1344004e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.482774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-0c0a893d-77e8-4265-ac3c-a07c0d6aef78 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0974376 Dec 21 03:43:41.558369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41530) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:41.576258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6d89c53-a0d3-4714-8aef-f8250f716125 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.686731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce39789d-8272-4070-9849-208d1344004e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.720318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6d89c53-a0d3-4714-8aef-f8250f716125 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.756990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce39789d-8272-4070-9849-208d1344004e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.795146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6d89c53-a0d3-4714-8aef-f8250f716125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.809223 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ce39789d-8272-4070-9849-208d1344004e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=46d9c7082b434334b66e4ef6d3e193de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3641195 Dec 21 03:43:41.812058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce39789d-8272-4070-9849-208d1344004e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2972115-fd14-4885-91c3-1a6acafb4052,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:41.816957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41538) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:41.848724 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b6d89c53-a0d3-4714-8aef-f8250f716125 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2be126d8f0fe4e7f86883f60bfef0a22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2874999 Dec 21 03:43:41.855057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41540) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:41.858647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6d89c53-a0d3-4714-8aef-f8250f716125 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7697af50-2f52-4d9f-a809-a03e31bda771,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:41.896243 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abb68a2e-a023-4011-b841-a1c2e569d5ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.920317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abb68a2e-a023-4011-b841-a1c2e569d5ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:41.926954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d773ba01-fbb2-417a-953a-40f1a940b3ee req-62fdc6fe-3146-424d-8206-04a39ad3eadd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 210 time: 0.1355066 Dec 21 03:43:41.933653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Pushing event updated for resources: {'SecurityGroup': ['ID=722fdac3-6a9b-4ced-a2f9-99c599556be3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:42.025634 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abb68a2e-a023-4011-b841-a1c2e569d5ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.029244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abb68a2e-a023-4011-b841-a1c2e569d5ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.030397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-abb68a2e-a023-4011-b841-a1c2e569d5ab admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c2972115-fd14-4885-91c3-1a6acafb4052 HTTP/1.1" status: 204 len: 168 time: 0.2125986 Dec 21 03:43:42.039433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb68a2e-a023-4011-b841-a1c2e569d5ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2972115-fd14-4885-91c3-1a6acafb4052,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:42.199978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Allocated IP 192.168.233.30 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:42.227467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-964702d7-253f-4c83-8290-1bbc1bdef7d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.230478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.resource_extend [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 03:43:42.273633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-4673b47b-0875-46a3-8365-69b0a05c1990 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:42.275122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-4673b47b-0875-46a3-8365-69b0a05c1990 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.7709391 Dec 21 03:43:42.325429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Request body: {'port': {'device_id': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '408f05064a77442595f2b5d444671b8a'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:42.386572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-964702d7-253f-4c83-8290-1bbc1bdef7d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.416124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.485799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.678192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a251e185-2076-4fb2-a32c-edf839e61be1 req-f03f1b1d-5db3-4f39-add5-6e308aef371a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:42.685369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a251e185-2076-4fb2-a32c-edf839e61be1 req-f03f1b1d-5db3-4f39-add5-6e308aef371a tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 950 time: 0.3191237 Dec 21 03:43:42.771062 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de associated. External IP: 172.25.5.99, port: 552d2bbd-e22b-4bf0-a3fc-056e9948167e. Dec 21 03:43:42.831144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.832951 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-964702d7-253f-4c83-8290-1bbc1bdef7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.835546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-964702d7-253f-4c83-8290-1bbc1bdef7d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.836746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-964702d7-253f-4c83-8290-1bbc1bdef7d0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7697af50-2f52-4d9f-a809-a03e31bda771 HTTP/1.1" status: 204 len: 168 time: 0.9354436 Dec 21 03:43:42.845502 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a251e185-2076-4fb2-a32c-edf839e61be1 req-21e83b38-427b-4844-ba55-d7e7f43edb85 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1593065 Dec 21 03:43:42.860224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Made reservation on behalf of 408f05064a77442595f2b5d444671b8a for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:42.864039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.869934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-964702d7-253f-4c83-8290-1bbc1bdef7d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7697af50-2f52-4d9f-a809-a03e31bda771,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:42.890779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:42.986699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec304c2f-2dca-4333-95f4-3d7d81adb413 req-83b0cf7c-a0a8-4f1a-a97b-4dc03773856c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 210 time: 0.0473313 Dec 21 03:43:43.076930 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.152571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:43.186320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:43.189410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:43.195740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:43.196368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.219964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.225347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Pushing event updated for resources: {'Port': ['ID=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:43.226291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:43.251315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:43:43.316849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f304fd16-fbf4-4b75-a66e-cfb20d14cc9d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.7524374 Dec 21 03:43:43.318131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.419047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be4d1d79-41a8-475c-bd15-be387ef5161d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:43.429635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Request body: {'port': {'device_id': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:43.454629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1e6a94af-4887-4e71-892d-c19a9cf114ee None None] Provisioning complete for port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:43.455285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e6a94af-4887-4e71-892d-c19a9cf114ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.501039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1e6a94af-4887-4e71-892d-c19a9cf114ee None None] Port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:43.538464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationRemoteConsolesV26Test-208909440-network', 'tenant_id': '9e9a4372886b4f7ebed85a583875d800'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:43.567270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:43:43.573621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.587379 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:43:43.599623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:43.600450 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:43.687630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Made reservation on behalf of 9e9a4372886b4f7ebed85a583875d800 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:43.691124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.701701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.722485 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:43.724823 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:43:43.803130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.894519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.919017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:43:43.935730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfcea89b-dca5-468c-8073-7041e2856a25,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:43.938779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.939221 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Added segment 78ff881b-e5ba-4cb6-b441-abc38d5fb9cf of type vlan for network 930c4f27-3351-4963-bbbe-c07045367531 Dec 21 03:43:43.975669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:43.978470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-361bc4cf-ff5a-4c05-81cc-2e483dabf0e4 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "PUT /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 995 time: 3.0960069 Dec 21 03:43:43.980752 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:42Z', 'revision_number': 1, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:43.982413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:43.984727 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dafc28bd-ca10-462f-a772-f6e5bf735b1f" -d '{"events": [{"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:43.986682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.022749 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:43:44.031295 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:44.032144 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:44.052736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Allocated IP 192.168.233.144 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/54f03f61-5bac-4c58-8af3-224512e89641) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:43:44.104912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0fbe3e-77fe-4275-b06d-e9752d8af940 req-e56f0845-9f00-4500-94c4-3e4abfaa12da tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.106426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c0fbe3e-77fe-4275-b06d-e9752d8af940 req-e56f0845-9f00-4500-94c4-3e4abfaa12da tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 935 time: 0.5060892 Dec 21 03:43:44.120891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.121876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.122535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.168123 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:44.241967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-b50da05b-b052-4692-98ab-d46b336d29d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.242669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] Pushing event updated for resources: {'Network': ['ID=930c4f27-3351-4963-bbbe-c07045367531,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:44.243521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-b50da05b-b052-4692-98ab-d46b336d29d3 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.2060702 Dec 21 03:43:44.253866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 930c4f27-3351-4963-bbbe-c07045367531 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:43:44.285727 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e47402d6-b8af-49c9-b0eb-e9f7bc5c4098 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.0569079 Dec 21 03:43:44.289358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41630) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:44.299494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Request body: {'subnet': {'network_id': '930c4f27-3351-4963-bbbe-c07045367531', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationRemoteConsolesV26Test-208909440-subnet', 'tenant_id': '9e9a4372886b4f7ebed85a583875d800', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:44.397453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c0fbe3e-77fe-4275-b06d-e9752d8af940 req-3475b112-427b-46aa-a964-e941784850c7 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2752457 Dec 21 03:43:44.448343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Made reservation on behalf of 9e9a4372886b4f7ebed85a583875d800 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:44.452037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Publish callbacks [] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.485082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.488035 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:42Z', 'revision_number': 1, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:44.488341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-53529fc1-41fd-405d-81ed-542853575280 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.489780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-53529fc1-41fd-405d-81ed-542853575280 service neutron] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2382917 Dec 21 03:43:44.534684 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ced1fd6-6dbf-4a75-af1c-bd826ccbbd47 None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:42Z', 'revision_number': 1, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:43:44.596745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-b7f23b99-2532-4f02-919b-941346c25cf2 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 998 time: 0.0964205 Dec 21 03:43:44.655680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee97a8ff-17a5-4cd7-b070-cd1ddeefb900 req-d83f8dd2-afaf-4d47-b17a-44b9394bf6b9 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.663144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee97a8ff-17a5-4cd7-b070-cd1ddeefb900 req-d83f8dd2-afaf-4d47-b17a-44b9394bf6b9 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 950 time: 0.1759257 Dec 21 03:43:44.707601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-ac25e55a-d40e-4588-82b5-680e24cbb80b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.709172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-ac25e55a-d40e-4588-82b5-680e24cbb80b service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1025610 Dec 21 03:43:44.756035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee97a8ff-17a5-4cd7-b070-cd1ddeefb900 req-452ded8d-d362-45cd-963a-9cc614cfe8e6 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921888 Dec 21 03:43:44.773648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.784786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-541d3c9c-0986-4bdf-b3e6-a98de909f809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:44.786723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-541d3c9c-0986-4bdf-b3e6-a98de909f809 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0692935 Dec 21 03:43:44.797762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-5970612a-c098-46a8-9900-e5d4f52b4869 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:43:44.799683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-5970612a-c098-46a8-9900-e5d4f52b4869 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058279 Dec 21 03:43:44.807363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa56ebbc-4819-4cc8-8f0d-b1bea1a1cb67 None None] New status for floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:43:44.843161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ac907275-4280-4964-b8fe-f178f58025f8,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:44.886549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Checking segment: {'id': '78ff881b-e5ba-4cb6-b441-abc38d5fb9cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '930c4f27-3351-4963-bbbe-c07045367531'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:44.887247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Network hostable DHCP agents. Network: 930c4f27-3351-4963-bbbe-c07045367531, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:43:44.944559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:44.997150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Network 930c4f27-3351-4963-bbbe-c07045367531 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:43:45.014158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:45.064738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.070402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:43:45.077774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 930c4f27-3351-4963-bbbe-c07045367531) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:45.079139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:45.083903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:45.085074 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.091922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63ebb49b-4adf-405e-bc25-3d915bdc3c50 None None] Network 930c4f27-3351-4963-bbbe-c07045367531 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:45.092335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:43:45.099040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:45.099461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.107027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:45.132357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Transition to ACTIVE for port object ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:45.135561 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5dbbf934-d0bf-4397-a9ab-f8ad2651e550 x-openstack-request-id: req-5dbbf934-d0bf-4397-a9ab-f8ad2651e550 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:45.135850 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:45.136123 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5dbbf934-d0bf-4397-a9ab-f8ad2651e550 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:45.136564 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'status': 'completed', 'code': 200} Dec 21 03:43:45.146015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-5c54ab46-3fdd-4fa9-a034-152c3a02d286 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1988256 Dec 21 03:43:45.165798 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-575899ce-bfe5-4ebf-ad1e-d2ccece73668 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.8752410 Dec 21 03:43:45.209830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-8a60990c-8fea-4df3-b2cc-310b9222683c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.9134364 Dec 21 03:43:45.288579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Request body: {'port': {'device_id': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:45.320889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ef0aaef-0382-4084-a49e-933efd5c5c68 None None] Network 930c4f27-3351-4963-bbbe-c07045367531 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:45.335740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.465635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c2cb5f52-038a-4fba-9ece-c8bd85ba60d0 None None] Provisioning complete for port 54f03f61-5bac-4c58-8af3-224512e89641 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:45.467128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c2cb5f52-038a-4fba-9ece-c8bd85ba60d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.490504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Pushing event updated for resources: {'Port': ['ID=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:45.509341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c2cb5f52-038a-4fba-9ece-c8bd85ba60d0 None None] Port 54f03f61-5bac-4c58-8af3-224512e89641 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:43:45.511286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.524976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-952249bd-cbef-465c-bca0-8e6adadd3119 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:45.526556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-952249bd-cbef-465c-bca0-8e6adadd3119 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.3204651 Dec 21 03:43:45.553281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06740429-ea02-478e-84e5-a236b73d6c64 req-b6e4adb2-880c-43ec-9dcc-5a39d1827f77 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:45.555363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06740429-ea02-478e-84e5-a236b73d6c64 req-b6e4adb2-880c-43ec-9dcc-5a39d1827f77 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 936 time: 0.2807083 Dec 21 03:43:45.601420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b23b100a-ed3f-4ca2-98f2-983aae154820 req-62070657-b518-4e55-ba65-5cf0ce5e6ad4 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4540017 Dec 21 03:43:45.692012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Attempting to bind port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:45.692354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Attempting to bind port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:45.697979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Attempting to bind port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:45.714803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:45.715153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Attempting to bind port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:45.748474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:45.748761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:45.749146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:45.749579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Bound port: ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:45.749931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:45.795822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06740429-ea02-478e-84e5-a236b73d6c64 req-351243a1-4d4a-4926-a0a2-c15d6084359d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2289960 Dec 21 03:43:45.834670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-3b25b14e-5d2b-49eb-a79b-aae19e094c6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:45.836206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-3b25b14e-5d2b-49eb-a79b-aae19e094c6c service neutron] 10.222.0.31 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2935860 Dec 21 03:43:46.056688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] For port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:46.065124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-3475931d-41a1-400c-b743-a1a6309b3042 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 1000 time: 0.1969347 Dec 21 03:43:46.088129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] For port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:46.092478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be215c8-c61f-45b4-837a-79c703d0e66b req-6d6ff9b7-9c61-4d83-a8cd-a2c90d26b3e1 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.094027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1be215c8-c61f-45b4-837a-79c703d0e66b req-6d6ff9b7-9c61-4d83-a8cd-a2c90d26b3e1 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 1102 time: 0.2303960 Dec 21 03:43:46.098269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:46.103812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1721225388-network', 'tenant_id': '408d1216081643b9b230bf19221e6eca'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:46.146475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46daf539-6301-46b4-95bd-641888918284 req-898240e8-e5a4-43df-a735-194899f2ff2f tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.147959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46daf539-6301-46b4-95bd-641888918284 req-898240e8-e5a4-43df-a735-194899f2ff2f tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 947 time: 0.2149141 Dec 21 03:43:46.174610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1be215c8-c61f-45b4-837a-79c703d0e66b req-d9dafe3b-bb3b-4be0-9ece-fc9bf5e3afe7 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.203940 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.219985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Made reservation on behalf of 408d1216081643b9b230bf19221e6eca for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:46.223699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.232371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.245383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-13f939b3-7489-4d8d-aa00-759b3706d096 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.246829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-13f939b3-7489-4d8d-aa00-759b3706d096 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1727684 Dec 21 03:43:46.312594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.313211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.314619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] 10.222.0.54 "PUT /v2.0/ports/ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 HTTP/1.1" status: 200 len: 1096 time: 2.8973777 Dec 21 03:43:46.356419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41678) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:46.359641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.383446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46daf539-6301-46b4-95bd-641888918284 req-8d6ad893-1fc1-4333-8940-b4a1084cf8ec tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2284443 Dec 21 03:43:46.389490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 54f03f61-5bac-4c58-8af3-224512e89641 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:46.395677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4299ccbe-847c-46ad-adfb-a2547c561dd6 service neutron] Pushing event updated for resources: {'Port': ['ID=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:46.412762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.436830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-ad88eb2f-8b72-4ea4-886d-1f09f9711d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.438357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-ad88eb2f-8b72-4ea4-886d-1f09f9711d6f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1711035 Dec 21 03:43:46.444254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Transition to ACTIVE for port object 54f03f61-5bac-4c58-8af3-224512e89641 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:43:46.453221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.472181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:43:46.497207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.497551 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Added segment 256db8a4-0c23-40b2-afd3-270006ad32fe of type vlan for network b3a8d773-8699-4f78-b4a8-9b34b72aa9bf Dec 21 03:43:46.516535 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.562502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1be215c8-c61f-45b4-837a-79c703d0e66b req-d9dafe3b-bb3b-4be0-9ece-fc9bf5e3afe7 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.576406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1988bd9-fff7-44b0-9824-f812035d9199 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.594541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.608230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35d762d4-b117-4a3f-8521-db1dc499a8d8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:46.630548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-c4606617-02e7-4111-8ba2-b8f65bbefbf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.632089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-c4606617-02e7-4111-8ba2-b8f65bbefbf0 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 1099 time: 0.1707995 Dec 21 03:43:46.648178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:46.654583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-2e37fda9-4a5e-4c68-a01b-a0830c1e52e2 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2031541 Dec 21 03:43:46.655735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1be215c8-c61f-45b4-837a-79c703d0e66b req-d9dafe3b-bb3b-4be0-9ece-fc9bf5e3afe7 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.719697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1988bd9-fff7-44b0-9824-f812035d9199 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.728745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.729910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:46.731335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.795304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1988bd9-fff7-44b0-9824-f812035d9199 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.811218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] Pushing event updated for resources: {'Network': ['ID=b3a8d773-8699-4f78-b4a8-9b34b72aa9bf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:46.823179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b3a8d773-8699-4f78-b4a8-9b34b72aa9bf details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:43:46.840133 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-40e69c42-c5d6-44ba-9dac-dcf8e3d10baa admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.7406797 Dec 21 03:43:46.850861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41690) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:46.856951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Request body: {'subnet': {'network_id': 'b3a8d773-8699-4f78-b4a8-9b34b72aa9bf', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1721225388-subnet', 'tenant_id': '408d1216081643b9b230bf19221e6eca', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:46.878032 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1988bd9-fff7-44b0-9824-f812035d9199 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e19a139e905f4c4ea9855023e3951dd9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5196662 Dec 21 03:43:46.879108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41692) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:46.889508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1988bd9-fff7-44b0-9824-f812035d9199 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db2f69c9-edd7-4f4f-b239-4e19d944d888,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:46.968126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cbd5455-f252-4c66-84b2-a2d2c2696f1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.997102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cbd5455-f252-4c66-84b2-a2d2c2696f1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:46.999471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Made reservation on behalf of 408d1216081643b9b230bf19221e6eca for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:47.002018 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Publish callbacks [] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.028656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-ff754e7f-1f5c-4d7f-a5ce-f8334d9c02ee service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.30&port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 HTTP/1.1" status: 200 len: 217 time: 0.3764305 Dec 21 03:43:47.107414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:43:47.107757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:43:47.108088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:47.136001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1be215c8-c61f-45b4-837a-79c703d0e66b req-d9dafe3b-bb3b-4be0-9ece-fc9bf5e3afe7 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0111787 Dec 21 03:43:47.141170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'tag': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:47.143746 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1f083dd-64cd-4554-aab3-93a40f033466" -d '{"events": [{"name": "network-changed", "server_uuid": "3bca8311-21bf-44dc-8d3c-944816c0ff92", "tag": "ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:47.151810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9dafe3b-bb3b-4be0-9ece-fc9bf5e3afe7 tempest-LiveMigrationNegativeTest-1992246247 tempest-LiveMigrationNegativeTest-1992246247-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f814dba-84a1-4261-94a6-3487ce0843b5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:47.156978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Port 54f03f61-5bac-4c58-8af3-224512e89641 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:43:47.157306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:43:47.177241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:43:47.177593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:47.177985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:43:47.178425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Bound port: 54f03f61-5bac-4c58-8af3-224512e89641, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:43:47.178783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.199687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f30f207c-9a0d-4891-a168-23067df0cc5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.200991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-f30f207c-9a0d-4891-a168-23067df0cc5d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1557181 Dec 21 03:43:47.205926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cbd5455-f252-4c66-84b2-a2d2c2696f1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.208673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cbd5455-f252-4c66-84b2-a2d2c2696f1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.210978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6cbd5455-f252-4c66-84b2-a2d2c2696f1e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/db2f69c9-edd7-4f4f-b239-4e19d944d888 HTTP/1.1" status: 204 len: 168 time: 0.3286505 Dec 21 03:43:47.219462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-92a5d9a2-ab79-46e7-8e28-3744e89838a7 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.226009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-92a5d9a2-ab79-46e7-8e28-3744e89838a7 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.2148480 Dec 21 03:43:47.226168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbd5455-f252-4c66-84b2-a2d2c2696f1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db2f69c9-edd7-4f4f-b239-4e19d944d888,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:47.277079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.310319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dafc28bd-ca10-462f-a772-f6e5bf735b1f req-3f837888-7aa3-44a4-ab0f-082919e59847 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6266990 Dec 21 03:43:47.346559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3dbf8611-4376-4d92-a09e-4b6d1c90c6b2,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:47.368041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Checking segment: {'id': '256db8a4-0c23-40b2-afd3-270006ad32fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'b3a8d773-8699-4f78-b4a8-9b34b72aa9bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:47.368397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Network hostable DHCP agents. Network: b3a8d773-8699-4f78-b4a8-9b34b72aa9bf, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:43:47.391743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-5caf84e2-764d-4181-afe9-02281ea907c7 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1607080 Dec 21 03:43:47.393965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-9c4c6b4b-1229-4032-9d92-8843f1fc3eb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.395743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-9c4c6b4b-1229-4032-9d92-8843f1fc3eb6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1873531 Dec 21 03:43:47.399446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:43:47.413390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:43:47.416806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'floatingip': {'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:47.458817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Network b3a8d773-8699-4f78-b4a8-9b34b72aa9bf is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:43:47.529383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.545263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b3a8d773-8699-4f78-b4a8-9b34b72aa9bf) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:47.551226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.552891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.558738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26ce5e35-9916-4213-b339-2ec2b273fde0 None None] Network b3a8d773-8699-4f78-b4a8-9b34b72aa9bf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:47.590569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.591215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.592597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] 10.222.0.54 "PUT /v2.0/ports/54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 1097 time: 2.3402297 Dec 21 03:43:47.599872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.650707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0937e3d-cce5-4c48-8f13-d9b784822670 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.7986829 Dec 21 03:43:47.679744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8d1f0d3-4826-486b-a2bd-669fd4cbea1c req-8c7ad2e3-7d59-4b84-af8c-16bae6c50a05 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.687160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8d1f0d3-4826-486b-a2bd-669fd4cbea1c req-8c7ad2e3-7d59-4b84-af8c-16bae6c50a05 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.2277422 Dec 21 03:43:47.691772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20971777-6264-4cdd-a945-415343c7541f None None] Network b3a8d773-8699-4f78-b4a8-9b34b72aa9bf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:47.710679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cda522-ab4c-41a1-aee5-e9db5e876789 service neutron] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:47.722995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-d835718f-c352-4bdc-9781-2a15b7388b28 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3183296 Dec 21 03:43:47.819933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41710) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:47.880445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Deleting subnet ac907275-4280-4964-b8fe-f178f58025f8 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:43:47.884090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.924599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.938303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:47.950137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8d1f0d3-4826-486b-a2bd-669fd4cbea1c req-ef6cf067-1a5f-4688-b668-208b046c7272 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2622564 Dec 21 03:43:47.950606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41712) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:47.985365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-bc41a28e-1663-4f0f-9277-66ff58c93303 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:47.986900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-bc41a28e-1663-4f0f-9277-66ff58c93303 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1100 time: 0.1762123 Dec 21 03:43:47.987648 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97dc7296-2831-4184-9318-5a24c9a6dffe admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.051660 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b1b5a21-b75c-4b56-a4f6-7ef241cc6145 x-openstack-request-id: req-6b1b5a21-b75c-4b56-a4f6-7ef241cc6145 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:48.055754 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3bca8311-21bf-44dc-8d3c-944816c0ff92", "tag": "ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:48.055754 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6b1b5a21-b75c-4b56-a4f6-7ef241cc6145 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:48.055754 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'tag': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440', 'status': 'completed', 'code': 200} Dec 21 03:43:48.093254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-aae7960f-e2c1-4b18-81a1-b76f3ef21514 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0834689 Dec 21 03:43:48.095320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee3ab1b-14a2-4e24-a3b9-6ae91fc347ac req-5a6bb84f-ef42-46a7-b878-1395de43c74d service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3581383 Dec 21 03:43:48.101541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.132072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ac907275-4280-4964-b8fe-f178f58025f8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:48.141399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.144273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d2ef7065-ca4d-4c96-9f78-098c2f380723 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/ac907275-4280-4964-b8fe-f178f58025f8 HTTP/1.1" status: 204 len: 168 time: 0.3233254 Dec 21 03:43:48.146835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41720) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:48.222367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.262917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-14a4f8f0-0810-44bb-8d72-8e50be86305f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:48.264449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-14a4f8f0-0810-44bb-8d72-8e50be86305f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1435275 Dec 21 03:43:48.276233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa4eec2-480d-44f0-a9bf-762b521a4706 req-b113d879-9b26-4692-93d8-e9dda96c6960 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:48.277700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fa4eec2-480d-44f0-a9bf-762b521a4706 req-b113d879-9b26-4692-93d8-e9dda96c6960 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 947 time: 0.1721258 Dec 21 03:43:48.309132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.332278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > segment before_delete 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.332693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.333356 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.333686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > port after_create 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.334005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > port after_delete 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.334320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > port after_update 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.335078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > segment after_delete 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.335078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.335300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.335589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet after_update 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.403584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.403933 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.404252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet before_create 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.406174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Subscribe: > subnet before_update 55550000 {{(pid=110311) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:43:48.406174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['930c4f27-3351-4963-bbbe-c07045367531']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:48.421193 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97dc7296-2831-4184-9318-5a24c9a6dffe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.422897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78ff881b-e5ba-4cb6-b441-abc38d5fb9cf') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:48.423290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78ff881b-e5ba-4cb6-b441-abc38d5fb9cf') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:48.440765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.467499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.478818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Releasing vlan 123 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:43:48.487942 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97dc7296-2831-4184-9318-5a24c9a6dffe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.490850 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.500804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-48a8f9ba-7c05-4045-b9ee-94d925867e20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:48.502899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-48a8f9ba-7c05-4045-b9ee-94d925867e20 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 1099 time: 0.2214952 Dec 21 03:43:48.523366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-0d5c8dcb-9fbb-46d1-9239-ca3ce4c134d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:48.524825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-0d5c8dcb-9fbb-46d1-9239-ca3ce4c134d0 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2450669 Dec 21 03:43:48.538810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41726) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:48.552567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fa4eec2-480d-44f0-a9bf-762b521a4706 req-ee2e93b0-722c-4da3-9750-91581ebb0677 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2318420 Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:43:48.555012 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:43:48.631836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.645990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-97dc7296-2831-4184-9318-5a24c9a6dffe admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6945570989fb4841ab8696542ab0a0e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6892927 Dec 21 03:43:48.651508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97dc7296-2831-4184-9318-5a24c9a6dffe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93175999-3962-4875-8c5f-436685784f6f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:48.676582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.679063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41732) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:48.685669 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] 10.222.0.18 "DELETE /v2.0/networks/930c4f27-3351-4963-bbbe-c07045367531 HTTP/1.1" status: 204 len: 168 time: 0.5353436 Dec 21 03:43:48.685669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f86702-d0a2-4407-ae11-734ebb48260e admin admin] Pushing event deleted for resources: {'Network': ['ID=930c4f27-3351-4963-bbbe-c07045367531,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:48.686016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41734) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:48.743375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Deleting subnet 3dbf8611-4376-4d92-a09e-4b6d1c90c6b2 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:43:48.747272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.789717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.830732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:48.980369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.008325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3dbf8611-4376-4d92-a09e-4b6d1c90c6b2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:49.015146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.021686 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bc300713-c7a6-4d92-afa3-54e0ee609ee5 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/3dbf8611-4376-4d92-a09e-4b6d1c90c6b2 HTTP/1.1" status: 204 len: 168 time: 0.3347666 Dec 21 03:43:49.022495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:49.029896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74196903-f85c-4b2b-a76f-a86414d017b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.100685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-ddbb8728-f0fd-4514-a784-b7dfd2b447db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:49.102154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-ddbb8728-f0fd-4514-a784-b7dfd2b447db service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.5825922 Dec 21 03:43:49.105808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.155272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-70574fb8-be10-4253-a6a8-7458ebfbb17a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6101592 Dec 21 03:43:49.190703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.211233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b3a8d773-8699-4f78-b4a8-9b34b72aa9bf']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:49.218377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-15acbe75-4c70-45cb-9ad0-e422402f691e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.30&port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 HTTP/1.1" status: 200 len: 217 time: 0.1015837 Dec 21 03:43:49.221728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '256db8a4-0c23-40b2-afd3-270006ad32fe') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:49.222232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '256db8a4-0c23-40b2-afd3-270006ad32fe') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:49.232585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.238009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e97c399-daea-4a85-8f45-22eb77d90e87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.245415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.251756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:43:49.251756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:43:49.254184 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:43:49.295066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.368146 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.371642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e97c399-daea-4a85-8f45-22eb77d90e87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.379929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.385706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.389110 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] 10.222.0.18 "DELETE /v2.0/networks/b3a8d773-8699-4f78-b4a8-9b34b72aa9bf HTTP/1.1" status: 204 len: 168 time: 0.3658774 Dec 21 03:43:49.403531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7070bfa-5acb-4d85-adf4-8065703a542b admin admin] Pushing event deleted for resources: {'Network': ['ID=b3a8d773-8699-4f78-b4a8-9b34b72aa9bf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:49.470275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-6a468c1a-4b99-4b03-9626-3d972eeada19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:49.471852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-6a468c1a-4b99-4b03-9626-3d972eeada19 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.2313271 Dec 21 03:43:49.539105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba697b9-1a08-4917-9f91-72e2512eee57 req-3d070d9f-c1e6-4f83-8649-aebb57d8560e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:49.540504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ba697b9-1a08-4917-9f91-72e2512eee57 req-3d070d9f-c1e6-4f83-8649-aebb57d8560e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.3343067 Dec 21 03:43:49.582120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a148211-0cad-4ed6-bf1f-f5e1d6271518 req-39a36e27-cb88-42df-a0d5-dbc195b34110 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3836985 Dec 21 03:43:49.612108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74196903-f85c-4b2b-a76f-a86414d017b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.641936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-df2abd38-c861-45ca-af53-e4d1955469b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:49.644279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-df2abd38-c861-45ca-af53-e4d1955469b0 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1540132 Dec 21 03:43:49.649860 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de associated. External IP: 172.25.5.99, port: 552d2bbd-e22b-4bf0-a3fc-056e9948167e. Dec 21 03:43:49.692886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41746) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:49.720201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74196903-f85c-4b2b-a76f-a86414d017b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.722417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e97c399-daea-4a85-8f45-22eb77d90e87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.725570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e97c399-daea-4a85-8f45-22eb77d90e87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.726170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9e97c399-daea-4a85-8f45-22eb77d90e87 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/93175999-3962-4875-8c5f-436685784f6f HTTP/1.1" status: 204 len: 168 time: 1.0445721 Dec 21 03:43:49.730248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ba697b9-1a08-4917-9f91-72e2512eee57 req-f7799408-98f7-447d-b5ae-1cbe78f0c781 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1510746 Dec 21 03:43:49.745593 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e3a361f-76b0-46ec-8beb-df27c068decf admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9e9a4372886b4f7ebed85a583875d800&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0493028 Dec 21 03:43:49.745819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41752) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:49.813159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c29e0f23-a0a7-4554-a8c4-6c3332c76508 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.815690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0ccebe2-f3fc-4924-9e37-5d7f30fbae02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.838071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c29e0f23-a0a7-4554-a8c4-6c3332c76508 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:49.846405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-74196903-f85c-4b2b-a76f-a86414d017b7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f350e8b3b56048b8bced6668dc9afd9e&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2978795 Dec 21 03:43:49.850909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74196903-f85c-4b2b-a76f-a86414d017b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71c26960-0a09-4d01-93c5-4a31cc48bdba,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:49.853223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:49.920100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e97c399-daea-4a85-8f45-22eb77d90e87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93175999-3962-4875-8c5f-436685784f6f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:49.968836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-9bfedeba-56e3-404e-bb6d-a0a8bdb52432 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3118215 Dec 21 03:43:50.048922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21328982-511a-461f-b511-7e4be8d1d890 req-f89b4f07-33a9-433a-b72e-dfc48621ea1f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:50.051094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21328982-511a-461f-b511-7e4be8d1d890 req-f89b4f07-33a9-433a-b72e-dfc48621ea1f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 950 time: 0.2109358 Dec 21 03:43:50.062792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:50.065593 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-feea3698-8924-467b-bb18-467ace903c1c" -d '{"events": [{"name": "network-changed", "server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:50.110166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6870083-e219-4e3f-abb2-47cc3f1073ad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:50.173420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c29e0f23-a0a7-4554-a8c4-6c3332c76508 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:50.176610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c29e0f23-a0a7-4554-a8c4-6c3332c76508 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:50.177819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c29e0f23-a0a7-4554-a8c4-6c3332c76508 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/cfcea89b-dca5-468c-8073-7041e2856a25 HTTP/1.1" status: 204 len: 168 time: 0.4311004 Dec 21 03:43:50.192120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c29e0f23-a0a7-4554-a8c4-6c3332c76508 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfcea89b-dca5-468c-8073-7041e2856a25,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:50.222240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6870083-e219-4e3f-abb2-47cc3f1073ad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:50.250259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21328982-511a-461f-b511-7e4be8d1d890 req-1912c12f-8f4c-4132-b561-8038c0d8432d tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1762657 Dec 21 03:43:50.259023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f083dd-64cd-4554-aab3-93a40f033466 req-f51cc293-40f8-405b-b5a9-a6efd1a192c1 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2506480 Dec 21 03:43:50.283229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:43:50.401763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6870083-e219-4e3f-abb2-47cc3f1073ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:50.404278 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6870083-e219-4e3f-abb2-47cc3f1073ad admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:50.405399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b6870083-e219-4e3f-abb2-47cc3f1073ad admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/71c26960-0a09-4d01-93c5-4a31cc48bdba HTTP/1.1" status: 204 len: 168 time: 0.5415409 Dec 21 03:43:50.422088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6870083-e219-4e3f-abb2-47cc3f1073ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71c26960-0a09-4d01-93c5-4a31cc48bdba,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:50.431456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8274a34d-ba4e-4a4c-a5d7-f4604e09d464 req-c05359e3-e5de-46b1-8dea-94feff3b4618 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:50.432974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8274a34d-ba4e-4a4c-a5d7-f4604e09d464 req-c05359e3-e5de-46b1-8dea-94feff3b4618 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 947 time: 0.1034753 Dec 21 03:43:50.469304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:43:50.479187 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:43:50.493070 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:50.493689 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:50.546214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8274a34d-ba4e-4a4c-a5d7-f4604e09d464 req-e7550d84-5511-42d1-a6f8-1481886cd60e tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028211 Dec 21 03:43:50.683549 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:50.790538 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8675bd60-74e4-45a4-9354-69247020af94 x-openstack-request-id: req-8675bd60-74e4-45a4-9354-69247020af94 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:50.790817 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:50.793079 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8675bd60-74e4-45a4-9354-69247020af94 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:50.793495 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'status': 'completed', 'code': 200} Dec 21 03:43:50.806393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:43:50.946529 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:49Z', 'revision_number': 3, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:50.973755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:43:50.983046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:50.983673 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:51.175643 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:51.197225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:51.210870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41782) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:51.278771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41786) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:51.279848 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-71be57cb-3ff3-40a0-851e-0d817436373d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=408d1216081643b9b230bf19221e6eca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0653367 Dec 21 03:43:51.286202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41788) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:51.309497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feea3698-8924-467b-bb18-467ace903c1c req-24499432-978f-435b-86ac-0278859e86e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:51.311010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-24499432-978f-435b-86ac-0278859e86e5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1100 time: 0.4489942 Dec 21 03:43:51.325153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8934e45c-2f33-478f-b0d2-021eed56d5ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.331163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7179ba8-ec6f-4282-a56e-222ace85a3af req-49f66c35-e28c-4665-b942-915cb9c23e74 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:51.332655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7179ba8-ec6f-4282-a56e-222ace85a3af req-49f66c35-e28c-4665-b942-915cb9c23e74 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.4561760 Dec 21 03:43:51.333761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:43:51.355238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.365265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-12de7163-fed9-4d48-a6b3-790cebd74e5b tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:51.367299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-12de7163-fed9-4d48-a6b3-790cebd74e5b tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 950 time: 0.1921256 Dec 21 03:43:51.379180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:51.393071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440', 'mac_address': 'fa:16:3e:65:64:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.30'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:51.453884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.462395 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:49Z', 'revision_number': 3, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:51.475413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8934e45c-2f33-478f-b0d2-021eed56d5ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.495424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:51.505175 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c74c2d4c-4d5a-4c4d-9edc-47744e4e98ac None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:49Z', 'revision_number': 3, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:43:51.529447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:51.534241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8934e45c-2f33-478f-b0d2-021eed56d5ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.571464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8934e45c-2f33-478f-b0d2-021eed56d5ba admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6d27aa1a7c0a4811af942dbc15370ebf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2839463 Dec 21 03:43:51.573906 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.583230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:51.594540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a97aa8fd-be83-48b6-a61b-d5512098dfe5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "PUT /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 997 time: 4.1918814 Dec 21 03:43:51.609412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8934e45c-2f33-478f-b0d2-021eed56d5ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c85857d2-5c7d-4e39-9f78-fa5eff192e5b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:51.656870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:51.671797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d335403-6db3-4040-831d-8b25f84ed838 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.692495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73a1e1a9-5560-4906-897f-846eb12aab8a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.696294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7179ba8-ec6f-4282-a56e-222ace85a3af req-799eeba6-4f7d-4ee9-8092-d521c8ee3f1b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3455632 Dec 21 03:43:51.727514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feea3698-8924-467b-bb18-467ace903c1c req-adb0820b-4990-4ddb-8670-420764b1b5df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:51.729258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73a1e1a9-5560-4906-897f-846eb12aab8a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.729344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-adb0820b-4990-4ddb-8670-420764b1b5df service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.4054337 Dec 21 03:43:51.748194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-51924a4e-a2f0-4fa5-9772-b7f0a5bc5499 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:51.749620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-51924a4e-a2f0-4fa5-9772-b7f0a5bc5499 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports/552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 942 time: 0.1112285 Dec 21 03:43:51.771888 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d335403-6db3-4040-831d-8b25f84ed838 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.825355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-4dbe38ba-259f-4823-8a77-dff22098b37a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0702255 Dec 21 03:43:51.843228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-732ccbb3-2909-4040-b1ee-5d6cd24db049 None None] New status for floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:43:51.894203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:51.899740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73a1e1a9-5560-4906-897f-846eb12aab8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.902379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73a1e1a9-5560-4906-897f-846eb12aab8a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:51.903587 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73a1e1a9-5560-4906-897f-846eb12aab8a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c85857d2-5c7d-4e39-9f78-fa5eff192e5b HTTP/1.1" status: 204 len: 168 time: 0.3193583 Dec 21 03:43:51.917673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a1e1a9-5560-4906-897f-846eb12aab8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c85857d2-5c7d-4e39-9f78-fa5eff192e5b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:51.939852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Deleting port 13c4445f-fe81-4621-b4be-b1b64372a9c0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:43:51.940217 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:52.028655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feea3698-8924-467b-bb18-467ace903c1c req-6cc4420a-d66a-41bb-9a94-ede1e0cc5526 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.030298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-6cc4420a-d66a-41bb-9a94-ede1e0cc5526 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1842268 Dec 21 03:43:52.059343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255bcff4-5bb7-46c2-865e-29f7e9cfea2a req-8d4d21e2-a852-4e01-bf44-e18c67251abf tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.060856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-255bcff4-5bb7-46c2-865e-29f7e9cfea2a req-8d4d21e2-a852-4e01-bf44-e18c67251abf tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 950 time: 0.2428472 Dec 21 03:43:52.082476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-84cba096-4b7b-46d5-9140-daf19afb826d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.084160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-84cba096-4b7b-46d5-9140-daf19afb826d service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.1835711 Dec 21 03:43:52.108011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] For port 13c4445f-fe81-4621-b4be-b1b64372a9c0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=13c4445f-fe81-4621-b4be-b1b64372a9c0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:52.108376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:52.154557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Calling delete_port for 13c4445f-fe81-4621-b4be-b1b64372a9c0 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:43:52.179851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d335403-6db3-4040-831d-8b25f84ed838 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:52.182399 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d335403-6db3-4040-831d-8b25f84ed838 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:52.186676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d335403-6db3-4040-831d-8b25f84ed838 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/35d762d4-b117-4a3f-8521-db1dc499a8d8 HTTP/1.1" status: 204 len: 168 time: 0.9023597 Dec 21 03:43:52.200817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e23b58f-4bf0-4d09-b999-e0d1b6b2f076 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:52.290307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d335403-6db3-4040-831d-8b25f84ed838 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35d762d4-b117-4a3f-8521-db1dc499a8d8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:52.298922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feea3698-8924-467b-bb18-467ace903c1c req-89075046-28ac-45b3-a924-78ac4087d4bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.301123 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:43:52.305010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-89075046-28ac-45b3-a924-78ac4087d4bb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2595158 Dec 21 03:43:52.310722 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:52.311993 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:52.359321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-255bcff4-5bb7-46c2-865e-29f7e9cfea2a req-e42d3a9e-85ce-4532-9eae-a1303e899dbe tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2570291 Dec 21 03:43:52.441782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:52.449919 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:52.459070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-bc1e5c82-0053-4001-a79b-3098774c73e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.460634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-bc1e5c82-0053-4001-a79b-3098774c73e3 service neutron] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.3593152 Dec 21 03:43:52.549753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-b9bf3d8a-66da-483f-b723-3b0ed6b1378a service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 217 time: 0.0501101 Dec 21 03:43:52.597226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2005c840-b2ee-4a1b-912f-44cfb3dfeba9 req-0fe28219-11a2-4ff4-9e52-6bf4d1431768 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.604381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2005c840-b2ee-4a1b-912f-44cfb3dfeba9 req-0fe28219-11a2-4ff4-9e52-6bf4d1431768 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 948 time: 0.1517143 Dec 21 03:43:52.636711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-6aa679c5-ee4a-42ee-a3a4-c921d3c57bae service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3085761 Dec 21 03:43:52.699381 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:52Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:52.727619 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:43:52.736336 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:52.737061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:52.744410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2005c840-b2ee-4a1b-912f-44cfb3dfeba9 req-6f25579a-602a-4b93-9bf9-8e143f5648b5 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1343513 Dec 21 03:43:52.809041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}, {'name': 'network-changed', 'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:52.812236 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb" -d '{"events": [{"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}, {"name": "network-changed", "server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:52.823190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-ddbc64d2-2547-4607-af83-659fc400384d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.825159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-ddbc64d2-2547-4607-af83-659fc400384d service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.2534704 Dec 21 03:43:52.855812 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:52.904957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feea3698-8924-467b-bb18-467ace903c1c req-8a719d8a-322b-49fe-8909-3152bd220fb8 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2564006 Dec 21 03:43:52.912163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-78183e66-f29c-4f59-ba4e-2271f8a7a1c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:52.914186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-78183e66-f29c-4f59-ba4e-2271f8a7a1c6 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0719311 Dec 21 03:43:52.932334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-6e0415cd-16ea-49f6-ae8a-ebe60ed9ca6c service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:43:52.946564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-6e0415cd-16ea-49f6-ae8a-ebe60ed9ca6c service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0236964 Dec 21 03:43:52.964575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.001716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['43cbd190-b145-423d-9f7c-f2f1eabaabc2', '13c4445f-fe81-4621-b4be-b1b64372a9c0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:53.067678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Pushing event deleted for resources: {'Port': ['ID=13c4445f-fe81-4621-b4be-b1b64372a9c0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:53.143669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.188416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] No DVR routers for this DVR port 13c4445f-fe81-4621-b4be-b1b64372a9c0 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:43:53.210260 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:52Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:53.211293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.215106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-befcb1bb-3bec-4a9a-a1fb-92e630e7c860 req-e8ab5884-a28c-4278-a808-4f2c5f29fd8f tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "DELETE /v2.0/ports/13c4445f-fe81-4621-b4be-b1b64372a9c0 HTTP/1.1" status: 204 len: 173 time: 1.8306139 Dec 21 03:43:53.216114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:43:53.238013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-709f22d5-d1d9-4b9e-9670-26e470f58731 req-5e8d4509-5395-4277-9c87-f298193eabdd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:53.252147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-709f22d5-d1d9-4b9e-9670-26e470f58731 req-5e8d4509-5395-4277-9c87-f298193eabdd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.2835958 Dec 21 03:43:53.271390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-fcc35789-e806-4349-867c-435c096eed28 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3238220 Dec 21 03:43:53.289729 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01d0a77d-3bdf-4fb4-a246-002a2a0c661f None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:5a:e6:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:43:52Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:43:53.351677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:53.410905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-709f22d5-d1d9-4b9e-9670-26e470f58731 req-cb522528-705d-47e2-a02f-9dade6dee3e1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1578431 Dec 21 03:43:53.414061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:53.435850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '54f03f61-5bac-4c58-8af3-224512e89641', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '54f03f61-5bac-4c58-8af3-224512e89641', 'mac_address': 'fa:16:3e:2b:d0:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.144'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:43:53.462926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-df1d9971-c356-4827-943f-7c8dfbfd3c2e service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1736693 Dec 21 03:43:53.511742 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca9e6f85-7efd-4508-88fc-4fb413c9799a x-openstack-request-id: req-ca9e6f85-7efd-4508-88fc-4fb413c9799a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:53.512269 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:53.512675 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ca9e6f85-7efd-4508-88fc-4fb413c9799a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:53.513213 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'status': 'completed', 'code': 200} Dec 21 03:43:53.513609 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'status': 'completed', 'code': 200} Dec 21 03:43:53.568771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.595314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 54f03f61-5bac-4c58-8af3-224512e89641 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:43:53.628580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:53.642083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:53.647603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:53.648166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.708919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.795714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:53.807221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.837272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:53.840264 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66b5b61d-4415-422d-b858-7c7e5ffef88a" -d '{"events": [{"server_uuid": "3bca8311-21bf-44dc-8d3c-944816c0ff92", "name": "network-vif-plugged", "status": "completed", "tag": "ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:53.856291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:53.905391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:53.959315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:53.986315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:53.989146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1f1e8a-90fc-47c1-98ef-ac028f0a7405 req-11a9c3bb-f653-4dc2-b70e-dbb5445e60c3 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=e90912e0-65c9-436f-aa71-025151c63148 HTTP/1.1" status: 200 len: 210 time: 0.3497229 Dec 21 03:43:54.008081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-492db51f-2b24-4fa7-962a-5f13e5156343 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.017264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-492db51f-2b24-4fa7-962a-5f13e5156343 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1097 time: 0.4400957 Dec 21 03:43:54.023556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-6740da82-bd4e-4ea0-ae1a-bcdd59b22a79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.024968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-6740da82-bd4e-4ea0-ae1a-bcdd59b22a79 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.4569778 Dec 21 03:43:54.060283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:54.072813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-c9a0c153-fad1-4b8c-9477-245a07e48027 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.081151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-c9a0c153-fad1-4b8c-9477-245a07e48027 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1097 time: 0.4788797 Dec 21 03:43:54.265506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-c3cebf4c-53cc-4657-8bd9-43c0714d9c27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.266043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Request body: {'network': {'name': 'tempest-LiveAutoBlockMigrationV225Test-253855048-network', 'tenant_id': '7662e8b89a444924a01bee5e34421908'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:54.267027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-c3cebf4c-53cc-4657-8bd9-43c0714d9c27 service neutron] 10.222.0.54 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2411613 Dec 21 03:43:54.328099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-df67c98b-87aa-4ed7-889a-9ce8b04d452e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.329568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-df67c98b-87aa-4ed7-889a-9ce8b04d452e service neutron] 10.222.0.31 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2766690 Dec 21 03:43:54.333278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-6529e411-d783-427e-a9ed-dbdfce0076a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.340505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-6529e411-d783-427e-a9ed-dbdfce0076a6 service neutron] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2583828 Dec 21 03:43:54.373877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Made reservation on behalf of 7662e8b89a444924a01bee5e34421908 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:54.376476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.386899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.423061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-2abfc4bf-1190-4173-b255-c83f1d44d80b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 217 time: 0.0717740 Dec 21 03:43:54.461885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-11cc4e10-3dc3-4935-9dbb-546fbd7f962e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 1000 time: 0.1864042 Dec 21 03:43:54.474096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.528636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.545275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-a460cf00-7dd7-4c71-8e76-8335af8e49fc service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 1000 time: 0.2033229 Dec 21 03:43:54.554175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:43:54.565484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f49e32c9-7ac4-4473-9e8e-3ee032077854,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:54.570420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.570759 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Added segment 6d9290ab-2323-4925-8697-d275634cc5ec of type vlan for network 8b13f1ae-b717-40da-b68e-bdf950529b14 Dec 21 03:43:54.599428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-bb0ade68-5bc6-4d03-bb6b-dbaa977b0628 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.600909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-bb0ade68-5bc6-4d03-bb6b-dbaa977b0628 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1649930 Dec 21 03:43:54.622126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.638088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2012df-5c9e-4055-a7d9-2f326bd315bb req-80b9f1e3-3e20-4136-811c-cf78b67d39b7 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.639596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f2012df-5c9e-4055-a7d9-2f326bd315bb req-80b9f1e3-3e20-4136-811c-cf78b67d39b7 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 949 time: 0.2118781 Dec 21 03:43:54.656197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-33e71131-7b7c-4485-bed3-495b75582a4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.657628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-33e71131-7b7c-4485-bed3-495b75582a4f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1652782 Dec 21 03:43:54.663500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-ac81e780-1ff7-41f5-a849-24602f488477 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.664854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-ac81e780-1ff7-41f5-a849-24602f488477 service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1195233 Dec 21 03:43:54.665662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.739691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.740678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.741290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:54.750468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-bbdc6b8c-4be3-4df9-a0d7-ec7ee3f159d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.751991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-bbdc6b8c-4be3-4df9-a0d7-ec7ee3f159d5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1353335 Dec 21 03:43:54.790116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f2012df-5c9e-4055-a7d9-2f326bd315bb req-c34b6dcc-b2c7-4420-8c79-ffeadf0a84f1 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311247 Dec 21 03:43:54.801711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-fa598644-9c0a-441e-b55f-7cda9f4de6b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.803587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-fa598644-9c0a-441e-b55f-7cda9f4de6b6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1318088 Dec 21 03:43:54.808831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] Pushing event updated for resources: {'Network': ['ID=8b13f1ae-b717-40da-b68e-bdf950529b14,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:54.810623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-c74caaba-fb1f-4e83-a578-ae1ff64098f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:54.814058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-c74caaba-fb1f-4e83-a578-ae1ff64098f7 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1320298 Dec 21 03:43:54.831896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:43:54.834967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7b6ba269-460d-4a94-971b-354af390d36e admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 0.8474393 Dec 21 03:43:54.837815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41884) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:54.867357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Request body: {'subnet': {'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveAutoBlockMigrationV225Test-253855048-subnet', 'tenant_id': '7662e8b89a444924a01bee5e34421908', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:54.870049 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b72f664-7414-47b4-9590-6ddbde96a2da x-openstack-request-id: req-4b72f664-7414-47b4-9590-6ddbde96a2da {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:54.870359 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3bca8311-21bf-44dc-8d3c-944816c0ff92", "name": "network-vif-plugged", "status": "completed", "tag": "ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:54.870971 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4b72f664-7414-47b4-9590-6ddbde96a2da {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:54.871674 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440', 'code': 200} Dec 21 03:43:54.944378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.001787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Made reservation on behalf of 7662e8b89a444924a01bee5e34421908 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:55.004403 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.043543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-b3033106-a025-43e9-898b-f3b444d4ef23 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2701056 Dec 21 03:43:55.046072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-d3c5b57f-afda-4055-a14f-dffe07e71699 service neutron] 10.222.0.54 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2331028 Dec 21 03:43:55.064447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-eb156beb-e7c2-4ef5-9b2c-d0498457c0d2 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2405980 Dec 21 03:43:55.225983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:43:55.268862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dcefeff-2b2a-469c-8afa-b862136c63fa req-0d0e0eee-8b8c-43b2-a701-a0fc777b3db0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:55.270375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dcefeff-2b2a-469c-8afa-b862136c63fa req-0d0e0eee-8b8c-43b2-a701-a0fc777b3db0 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 1101 time: 0.2632639 Dec 21 03:43:55.304686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.335676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4303e5-7b6f-4d70-9aed-26f24efb27ee req-d9dbf84d-aef1-4ad9-b957-23c6715e4279 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:55.337235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a4303e5-7b6f-4d70-9aed-26f24efb27ee req-d9dbf84d-aef1-4ad9-b957-23c6715e4279 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 949 time: 0.2522609 Dec 21 03:43:55.351949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 54f03f61-5bac-4c58-8af3-224512e89641 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:43:55.358216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 54f03f61-5bac-4c58-8af3-224512e89641 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:43:55.365828 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.365963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Pushing event updated for resources: {'Subnet': ['ID=84e57960-b2b1-49b0-85de-36fd5e1ebd6a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:55.370638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-9cc4bc98-eb19-44a4-8000-82295eaff126 service neutron] 10.222.0.54 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3084650 Dec 21 03:43:55.378405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:55.379080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Network hostable DHCP agents. Network: 8b13f1ae-b717-40da-b68e-bdf950529b14, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:43:55.399223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79fd70da-ba38-4c4d-9ef5-c86ec84f320b req-41345c63-a1b7-4f72-9a07-4ef614a7280e service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3159637 Dec 21 03:43:55.404960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43a43c54-b8df-43ef-8f3f-04c1e70e71eb req-13251898-f8bf-4e68-9076-b55fc4014fea service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3523190 Dec 21 03:43:55.427427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dcefeff-2b2a-469c-8afa-b862136c63fa req-547d4e61-b88b-47b6-b4dc-1df1c6d44b66 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1399512 Dec 21 03:43:55.449919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a4303e5-7b6f-4d70-9aed-26f24efb27ee req-3b20e1ad-e98a-4e88-8b9c-b4a95b3f4e16 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0972612 Dec 21 03:43:55.507031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:43:55.507135 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.526598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 13c4445f-fe81-4621-b4be-b1b64372a9c0 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:43:55.554228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 13c4445f-fe81-4621-b4be-b1b64372a9c0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:43:55.557671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 13c4445f-fe81-4621-b4be-b1b64372a9c0 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:43:55.557837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e90912e0-65c9-436f-aa71-025151c63148', 'name': 'network-vif-deleted', 'tag': '13c4445f-fe81-4621-b4be-b1b64372a9c0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:55.560010 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03702cc9-c0b5-4a72-95c8-e524ef90cb39" -d '{"events": [{"server_uuid": "e90912e0-65c9-436f-aa71-025151c63148", "name": "network-vif-deleted", "tag": "13c4445f-fe81-4621-b4be-b1b64372a9c0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:55.573070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8b13f1ae-b717-40da-b68e-bdf950529b14) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:55.587412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:55.588480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.590035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17cc8d3e-bd52-455b-84ea-1e84b8529e67 None None] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:55.592879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:55.595368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:55.617377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29aa35cb-391d-4e01-b904-283850ca1de5 req-222753bf-f41b-4c92-a067-ec6bc084341f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1208465 Dec 21 03:43:55.666085 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.673431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29aa35cb-391d-4e01-b904-283850ca1de5 req-1fa0479c-8087-48b4-963d-30c61d96ff3d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:55.675214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29aa35cb-391d-4e01-b904-283850ca1de5 req-1fa0479c-8087-48b4-963d-30c61d96ff3d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports/8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 942 time: 0.0555463 Dec 21 03:43:55.679667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e4c2484b-3d02-402b-b06b-1a93074895ab admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 0.8402619 Dec 21 03:43:55.687629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.747214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f933c34-bb54-4a3f-baea-6f06aaaaab12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.769951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fea11453-8b29-4ff1-8abd-58fc0005757b None None] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:55.796530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:55.843796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29aa35cb-391d-4e01-b904-283850ca1de5 req-62ee3a0d-eb55-4e02-a1c3-5d938056a16c tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1139071 Dec 21 03:43:55.888151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f933c34-bb54-4a3f-baea-6f06aaaaab12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.940642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f933c34-bb54-4a3f-baea-6f06aaaaab12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:55.992684 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f933c34-bb54-4a3f-baea-6f06aaaaab12 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8a6a8abd4a484b2db6539a19182c18ef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3950214 Dec 21 03:43:55.992684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f933c34-bb54-4a3f-baea-6f06aaaaab12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a1017e4-856c-402f-8ac8-8f0e914e4729,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:55.993827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41926) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.993961 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:43:55.998583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29aa35cb-391d-4e01-b904-283850ca1de5 req-015e03bb-9f9e-4c16-ae76-2d81987b36eb tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:56.011995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29aa35cb-391d-4e01-b904-283850ca1de5 req-015e03bb-9f9e-4c16-ae76-2d81987b36eb tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1540501 Dec 21 03:43:56.041694 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64fb4442-36c7-4f72-953c-5385d2d006aa x-openstack-request-id: req-64fb4442-36c7-4f72-953c-5385d2d006aa {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:56.042184 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e90912e0-65c9-436f-aa71-025151c63148", "name": "network-vif-deleted", "tag": "13c4445f-fe81-4621-b4be-b1b64372a9c0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:56.042524 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-64fb4442-36c7-4f72-953c-5385d2d006aa {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:56.043013 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e90912e0-65c9-436f-aa71-025151c63148', 'name': 'network-vif-deleted', 'tag': '13c4445f-fe81-4621-b4be-b1b64372a9c0', 'status': 'completed', 'code': 200} Dec 21 03:43:56.058246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-480bb502-6442-41fc-bc49-ec7c0dc024e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.087625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-480bb502-6442-41fc-bc49-ec7c0dc024e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.145879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54368967-7a16-4a62-adef-0b5164f272b8 req-b2ca5f2d-bd4f-40d6-890f-d77ef18cf48c tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:56.148296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54368967-7a16-4a62-adef-0b5164f272b8 req-b2ca5f2d-bd4f-40d6-890f-d77ef18cf48c tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 949 time: 0.0517554 Dec 21 03:43:56.199359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54368967-7a16-4a62-adef-0b5164f272b8 req-df5bfe9b-338a-42c3-a653-905034f92a4d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441663 Dec 21 03:43:56.202769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-480bb502-6442-41fc-bc49-ec7c0dc024e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.206249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-480bb502-6442-41fc-bc49-ec7c0dc024e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.213773 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-480bb502-6442-41fc-bc49-ec7c0dc024e4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2a1017e4-856c-402f-8ac8-8f0e914e4729 HTTP/1.1" status: 204 len: 168 time: 0.2160039 Dec 21 03:43:56.221914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-480bb502-6442-41fc-bc49-ec7c0dc024e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a1017e4-856c-402f-8ac8-8f0e914e4729,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:56.304676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-90891c46-c761-47b7-9c05-3b957cc1ec21 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=780f03990e134c4b9f0ed57113abb273&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0325646 Dec 21 03:43:56.403782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2c4d19-2aa4-40d0-b0eb-ad717ddd8ce9 req-d26c87fc-57ab-4b5f-b0cc-893b4a5a1554 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:56.405307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e2c4d19-2aa4-40d0-b0eb-ad717ddd8ce9 req-d26c87fc-57ab-4b5f-b0cc-893b4a5a1554 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 949 time: 0.1192861 Dec 21 03:43:56.454681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-c4f58e04-6dfa-4bff-9c6e-ebc3ea1602ac tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:56.456221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-c4f58e04-6dfa-4bff-9c6e-ebc3ea1602ac tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1384330 Dec 21 03:43:56.484251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-40e71925-69a3-49de-bfc0-52ca5f1ccee9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/quotas/780f03990e134c4b9f0ed57113abb273 HTTP/1.1" status: 200 len: 375 time: 0.0208008 Dec 21 03:43:56.488552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e2c4d19-2aa4-40d0-b0eb-ad717ddd8ce9 req-06ab7f3b-2575-4be6-aaa4-ebdf9a077020 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734668 Dec 21 03:43:56.511721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41954) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:56.519366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Request body: {'network': {'name': 'tempest-LiveAutoBlockMigrationV225Test-1392207191-network', 'tenant_id': '01233913dd88490b9667c9c68175aa6c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:56.531054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-855e0f15-b9c0-4c55-a28d-2666e55b1066 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=780f03990e134c4b9f0ed57113abb273&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0355861 Dec 21 03:43:56.585713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Made reservation on behalf of 01233913dd88490b9667c9c68175aa6c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:56.588369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.603779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.725440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.791607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.821301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:43:56.837716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7163d148-c620-49d0-a15c-447e171d8a7a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:56.843012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.843438 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Added segment 88540a7a-dd9a-4f71-9af3-aebbbf41d2b8 of type vlan for network 757dabb2-8171-4998-adab-f7eeb2080d65 Dec 21 03:43:56.873497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:56.878476 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c106e666-7e6e-4ac0-8527-067fe4bcbe90" -d '{"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-plugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:56.888917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.922818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:56.941350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44222d83-3820-4a3b-aaac-04fc1d54b09b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.998646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:56.999634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.000288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.004970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-cb681431-5c45-484f-ad61-cb256b5ea7da tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.3843453 Dec 21 03:43:57.017037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5252c670-a52d-4800-b4e5-8000ee69d291 req-a83460e5-af7b-46cd-8c71-3e54ce148375 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.019409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5252c670-a52d-4800-b4e5-8000ee69d291 req-a83460e5-af7b-46cd-8c71-3e54ce148375 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0662930 Dec 21 03:43:57.073142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44222d83-3820-4a3b-aaac-04fc1d54b09b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.075644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-04fba2dd-6879-4610-b191-617a3fcdddf5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.076806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] Pushing event updated for resources: {'Network': ['ID=757dabb2-8171-4998-adab-f7eeb2080d65,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:57.076931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-04fba2dd-6879-4610-b191-617a3fcdddf5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports/8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 942 time: 0.0566745 Dec 21 03:43:57.089208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 757dabb2-8171-4998-adab-f7eeb2080d65 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:43:57.108971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5252c670-a52d-4800-b4e5-8000ee69d291 req-f8d9a5db-0462-4be4-9e69-99b62a1d81aa tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795331 Dec 21 03:43:57.128659 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f5ab2708-6716-48f5-805c-80fe4e720685 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 0.6154435 Dec 21 03:43:57.131299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41968) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:57.137587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Request body: {'subnet': {'network_id': '757dabb2-8171-4998-adab-f7eeb2080d65', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveAutoBlockMigrationV225Test-1392207191-subnet', 'tenant_id': '01233913dd88490b9667c9c68175aa6c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:57.146820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44222d83-3820-4a3b-aaac-04fc1d54b09b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.195794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-44222d83-3820-4a3b-aaac-04fc1d54b09b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=59248895951c4b1d9127c4fc5f48ea0f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2694762 Dec 21 03:43:57.196748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41970) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:43:57.205308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44222d83-3820-4a3b-aaac-04fc1d54b09b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=260bc986-99d8-49b4-843b-c013fdfbdd20,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:57.207963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbeb01d2-34d1-49a9-9014-ab094a232b7d req-be6d6322-46b1-4408-b97e-aabb5cdef211 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 210 time: 0.0611982 Dec 21 03:43:57.242465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-2724ed0f-5778-4121-9638-ea78c7ae6463 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1031799 Dec 21 03:43:57.257369 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d15d4531-793f-4073-8734-e969fb923e55 x-openstack-request-id: req-d15d4531-793f-4073-8734-e969fb923e55 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:43:57.257756 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-plugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:43:57.258141 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d15d4531-793f-4073-8734-e969fb923e55 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:43:57.258798 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'code': 200} Dec 21 03:43:57.293882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Made reservation on behalf of 01233913dd88490b9667c9c68175aa6c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:43:57.297602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.365207 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65234a87-2f31-42b7-9a5f-c1ec95624bd9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.445467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65234a87-2f31-42b7-9a5f-c1ec95624bd9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.462069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-9fb81d12-7c3b-4706-a40f-aacf7c67488e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.470016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-9fb81d12-7c3b-4706-a40f-aacf7c67488e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2266688 Dec 21 03:43:57.482109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8862748a-491f-4893-ac24-cdb1394b38bd req-8db632eb-1b17-4250-a270-d915aff9d3f7 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.483595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8862748a-491f-4893-ac24-cdb1394b38bd req-8db632eb-1b17-4250-a270-d915aff9d3f7 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 949 time: 0.1623623 Dec 21 03:43:57.523002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.566452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b119b1f0-cf16-4ea0-a0b1-2bf0ce2fbd37 req-8d78cb36-9e84-4848-a1d8-65e945b3f193 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.568187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b119b1f0-cf16-4ea0-a0b1-2bf0ce2fbd37 req-8d78cb36-9e84-4848-a1d8-65e945b3f193 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1102 time: 0.1790991 Dec 21 03:43:57.577630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Pushing event updated for resources: {'Subnet': ['ID=dcda1b60-cc54-4783-8e64-f3a891a1ee17,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:57.596259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Checking segment: {'id': '88540a7a-dd9a-4f71-9af3-aebbbf41d2b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '757dabb2-8171-4998-adab-f7eeb2080d65'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:43:57.597279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Network hostable DHCP agents. Network: 757dabb2-8171-4998-adab-f7eeb2080d65, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:43:57.616286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-d1329bf2-6799-4eb4-9215-7d9d859d3e99 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1454022 Dec 21 03:43:57.637978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'floatingip': {'port_id': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:57.651686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8862748a-491f-4893-ac24-cdb1394b38bd req-a01e1ed6-949d-41fa-b30f-c4b25787ceeb tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1578960 Dec 21 03:43:57.699652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Network 757dabb2-8171-4998-adab-f7eeb2080d65 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:43:57.702482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65234a87-2f31-42b7-9a5f-c1ec95624bd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.705084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65234a87-2f31-42b7-9a5f-c1ec95624bd9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.706481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-65234a87-2f31-42b7-9a5f-c1ec95624bd9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/260bc986-99d8-49b4-843b-c013fdfbdd20 HTTP/1.1" status: 204 len: 168 time: 0.5073128 Dec 21 03:43:57.712731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b119b1f0-cf16-4ea0-a0b1-2bf0ce2fbd37 req-584eab5c-cf44-456c-a1b8-5730c02646dd service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358302 Dec 21 03:43:57.734755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65234a87-2f31-42b7-9a5f-c1ec95624bd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=260bc986-99d8-49b4-843b-c013fdfbdd20,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:57.739009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.807960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 757dabb2-8171-4998-adab-f7eeb2080d65) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:43:57.813360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.814025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:57.823566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99fe5779-fef8-43de-8512-5395a33ca7a2 None None] Network 757dabb2-8171-4998-adab-f7eeb2080d65 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:57.895301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f37951-5913-4231-8c79-35f6d905118d req-010249c6-9eae-4324-af8a-7fd96a726c90 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.896698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93f37951-5913-4231-8c79-35f6d905118d req-010249c6-9eae-4324-af8a-7fd96a726c90 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 949 time: 0.1787467 Dec 21 03:43:57.911403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-05c4c95a-0338-46d6-b7c7-d438f7b6edc2 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:57.912830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-05c4c95a-0338-46d6-b7c7-d438f7b6edc2 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "GET /v2.0/ports?device_id=0354f6e5-2b90-41cf-924b-b3b9a8fc83b0 HTTP/1.1" status: 200 len: 949 time: 0.1792035 Dec 21 03:43:57.929530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-482b15d8-44de-4d6b-b361-fb09814c568a None None] Network 757dabb2-8171-4998-adab-f7eeb2080d65 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:43:57.950336 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c7e0004-8b47-4aba-8e73-52d81ba6697f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 0.8128006 Dec 21 03:43:58.005289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.059277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93f37951-5913-4231-8c79-35f6d905118d req-0f047cab-b99f-4954-a763-75fed3add1b5 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.18 "GET /v2.0/security-groups?id=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1436715 Dec 21 03:43:58.093185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.093731 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de disassociated. External IP: 172.25.5.99, port: 8ce7fb06-2f70-4696-904a-92f477cbea6e. Dec 21 03:43:58.152227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Deleting port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:43:58.152227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.304291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] For port 43cbd190-b145-423d-9f7c-f2f1eabaabc2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=43cbd190-b145-423d-9f7c-f2f1eabaabc2,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:43:58.304291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.316105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Calling delete_port for 43cbd190-b145-423d-9f7c-f2f1eabaabc2 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:43:58.510585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:43:58.611863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94baa05e-ce4d-449f-90f4-cb821bd56830 req-ebc8a9a0-f9d2-4a9b-af39-ff1d757de506 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:58.613350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94baa05e-ce4d-449f-90f4-cb821bd56830 req-ebc8a9a0-f9d2-4a9b-af39-ff1d757de506 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1436100 Dec 21 03:43:58.708674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94baa05e-ce4d-449f-90f4-cb821bd56830 req-fe41c467-6dd6-470c-b6d1-90c121ec45a9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877576 Dec 21 03:43:58.717308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:43:58.722065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.742428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.760224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:43:58.772162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:58.773066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:58.783803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Pushing event deleted for resources: {'Port': ['ID=43cbd190-b145-423d-9f7c-f2f1eabaabc2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:43:58.786662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-343e95fb-0882-47eb-960f-0dc5472af126 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "PUT /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 694 time: 1.1565032 Dec 21 03:43:58.789118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:43:58.791996 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd180422-0b84-4399-b30c-c5a4950eb811" -d '{"events": [{"name": "network-changed", "server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:43:58.855276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] No DVR routers for this DVR port 43cbd190-b145-423d-9f7c-f2f1eabaabc2 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:43:58.882973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:43:58.893155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c818b6-73c4-47c8-a357-68c90bad2c7c req-7d475b91-5bc8-492c-8179-88ee5f24fa07 tempest-LiveMigrationNegativeTest-829457002 tempest-LiveMigrationNegativeTest-829457002-project] 10.222.0.31 "DELETE /v2.0/ports/43cbd190-b145-423d-9f7c-f2f1eabaabc2 HTTP/1.1" status: 204 len: 173 time: 0.9625862 Dec 21 03:43:58.911186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-953a7499-3879-45f6-a08b-fb50f281cda6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:58.912763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-953a7499-3879-45f6-a08b-fb50f281cda6 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1097 time: 0.1125369 Dec 21 03:43:59.059412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-9476fe52-2dbd-4d7d-97d6-8e4d690d6b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:59.061190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-9476fe52-2dbd-4d7d-97d6-8e4d690d6b4a service neutron] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.1411951 Dec 21 03:43:59.130973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['43cbd190-b145-423d-9f7c-f2f1eabaabc2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:43:59.165338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-900a452e-5284-47e6-a994-229445ba3044 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 217 time: 0.0934820 Dec 21 03:43:59.209342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:59.349797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-e90044e3-3e94-46d7-98d4-b7d75c9cb03b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:59.357652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-e90044e3-3e94-46d7-98d4-b7d75c9cb03b service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1892123 Dec 21 03:43:59.373528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-343e9339-5907-4b66-b671-daca669a2fa2 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=780f03990e134c4b9f0ed57113abb273&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0573840 Dec 21 03:43:59.426530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-d8f498fb-294f-4e63-89d9-14e51226e433 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:59.436910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-d8f498fb-294f-4e63-89d9-14e51226e433 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.2228479 Dec 21 03:43:59.489440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2d97681f-52d0-4db2-9d62-f0f4fa2d5888 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/quotas/7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 375 time: 0.0516410 Dec 21 03:43:59.513701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:59.541095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:43:59.549914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:43:59.550523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:43:59.556948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-89cca0f9-c392-49d7-a137-c6063df7c482 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0583069 Dec 21 03:43:59.558853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-be30cf49-b201-414c-95a1-25d19cb8956a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:59.560358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-be30cf49-b201-414c-95a1-25d19cb8956a service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2016897 Dec 21 03:43:59.679396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-0761cbc5-0f82-42c5-9079-4780db0094b5 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:43:59.681275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-0761cbc5-0f82-42c5-9079-4780db0094b5 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2341475 Dec 21 03:43:59.697705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:43:59.735089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Request body: {'port': {'device_id': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '780f03990e134c4b9f0ed57113abb273'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:43:59.911221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-bc2317c9-a097-4f03-b134-cecbe68f9ec6 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3056641 Dec 21 03:43:59.957512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:00.004326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d03de16b-8855-47f8-a7f5-54923a85265d None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:00.255506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-ce04e712-272e-419a-9271-696b12bf7bc2 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6845479 Dec 21 03:44:00.379502 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd8e4286-bf0c-45d3-a3f3-87032615d177 None None] New status for floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:44:00.380100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-321d44c6-4625-4c21-9f22-294147682e29 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4673700 Dec 21 03:44:00.418720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a9d6d1-4dd1-4d34-b64f-f372fdae7136 req-2bf0c888-e156-47bd-9929-19ffa198a893 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1490386 Dec 21 03:44:00.448862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Made reservation on behalf of 780f03990e134c4b9f0ed57113abb273 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:00.453412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:00.465532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:00.604299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc3e9ada-54ad-498d-b495-f7ae42b23410 req-b2e0dac3-2545-4059-ba04-0d860e663431 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 210 time: 0.0410585 Dec 21 03:44:00.610037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:00.677675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:00.747707 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:43:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5941747-2f70-4a20-8703-f43181ff7045 x-openstack-request-id: req-a5941747-2f70-4a20-8703-f43181ff7045 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:00.754462 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:00.754856 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a5941747-2f70-4a20-8703-f43181ff7045 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:00.755397 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'status': 'completed', 'code': 200} Dec 21 03:44:00.820895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-67bc2f95-6f6b-4c37-85b4-2def2920cebf tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0789495 Dec 21 03:44:00.837906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Pushing event updated for resources: {'SecurityGroup': ['ID=443bb859-4613-44c4-81cf-16150a9fecf2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:01.021308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-39bf460f-1f3b-4177-91b9-f83f197e0b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.022718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-39bf460f-1f3b-4177-91b9-f83f197e0b19 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 1097 time: 0.2597921 Dec 21 03:44:01.107236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ab867d-ddba-49cd-9755-feed9e28752c req-07dae94e-f1bf-47d9-8966-35b9d7a01587 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.108721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3ab867d-ddba-49cd-9755-feed9e28752c req-07dae94e-f1bf-47d9-8966-35b9d7a01587 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1598439 Dec 21 03:44:01.115417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-3ee0e373-478e-47c4-8aa8-44e384d2077d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.116764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-3ee0e373-478e-47c4-8aa8-44e384d2077d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2950666 Dec 21 03:44:01.117925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Allocated IP 192.168.233.167 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/272ba7b9-365d-4afd-bfd3-3be655599b4c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:01.192297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-cbd6689c-226e-48f2-b00d-0c346c286eac tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/quotas/f99ea8b7ae9a4d40aed93882fd7c11fc HTTP/1.1" status: 200 len: 375 time: 0.0393481 Dec 21 03:44:01.285589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-8c748740-55d7-4367-a772-0d20a05968c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.285589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-8c748740-55d7-4367-a772-0d20a05968c5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2471333 Dec 21 03:44:01.299522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3ab867d-ddba-49cd-9755-feed9e28752c req-56373089-55f8-43e5-9cd7-622350d29e28 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516218 Dec 21 03:44:01.314370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42074) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:01.373479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-937a548f-19c3-4711-9d64-75e53e953ede service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 200 len: 217 time: 0.0521460 Dec 21 03:44:01.462271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-217253ba-3e8c-4dcf-9a4a-e3fe4c6f1c41 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2594631 Dec 21 03:44:01.479191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-a0b072c3-4784-4118-b350-2113c84f3140 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.480631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-a0b072c3-4784-4118-b350-2113c84f3140 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.0974991 Dec 21 03:44:01.494459 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f324efbd-f9cc-4902-a57d-dcfb886734b4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=680af371fc8f43789a63fa788b00602b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1788168 Dec 21 03:44:01.499419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42084) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:01.518892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 43cbd190-b145-423d-9f7c-f2f1eabaabc2 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:01.553886 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.554153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06176a24-05fa-4ec9-909d-ba57f72eff86 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.569036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 43cbd190-b145-423d-9f7c-f2f1eabaabc2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:01.569395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 43cbd190-b145-423d-9f7c-f2f1eabaabc2 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:01.581497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06176a24-05fa-4ec9-909d-ba57f72eff86 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.587193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-c53ae617-3db5-4569-9e8e-ee8ed69abb2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.588801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-c53ae617-3db5-4569-9e8e-ee8ed69abb2f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1002765 Dec 21 03:44:01.695664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-ce7b4c80-9de9-4f98-9086-e18b6909e200 service neutron] 10.222.0.54 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0980341 Dec 21 03:44:01.759060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06176a24-05fa-4ec9-909d-ba57f72eff86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.768601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06176a24-05fa-4ec9-909d-ba57f72eff86 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.771589 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-06176a24-05fa-4ec9-909d-ba57f72eff86 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6211d76c-4592-48aa-8c1a-6cbf78d1ce4b HTTP/1.1" status: 204 len: 168 time: 0.2695317 Dec 21 03:44:01.782114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.798630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06176a24-05fa-4ec9-909d-ba57f72eff86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6211d76c-4592-48aa-8c1a-6cbf78d1ce4b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:01.892474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:01.901440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:01.915274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:01.915274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:01.915274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:01.922093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Pushing event updated for resources: {'Port': ['ID=272ba7b9-365d-4afd-bfd3-3be655599b4c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:01.947588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd180422-0b84-4399-b30c-c5a4950eb811 req-83891647-1d4a-4c08-931a-245b5e3e201c service neutron] 10.222.0.54 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2312870 Dec 21 03:44:01.977552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bfade5b-2dba-4b8b-ab94-6b62d1e3affa req-39c5b071-3987-4eb7-83e4-c981053b5cf6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 210 time: 0.0365357 Dec 21 03:44:02.023847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-19ddc82f-9c0d-41ad-88ff-2d78994288d9 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.2933342 Dec 21 03:44:02.048228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Request body: {'port': {'device_id': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:02.108433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.213701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1d521670-8d88-48ca-a0b6-93fe3d7df1ff None None] Provisioning complete for port 272ba7b9-365d-4afd-bfd3-3be655599b4c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:02.214308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d521670-8d88-48ca-a0b6-93fe3d7df1ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.266456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1d521670-8d88-48ca-a0b6-93fe3d7df1ff None None] Port 272ba7b9-365d-4afd-bfd3-3be655599b4c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:02.336135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b389d3f9-ebdb-4487-a276-fee54016f948 req-e314a1a4-b9c9-48fc-a793-ada4ce7649fb tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:02.337645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b389d3f9-ebdb-4487-a276-fee54016f948 req-e314a1a4-b9c9-48fc-a793-ada4ce7649fb tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 936 time: 0.1533182 Dec 21 03:44:02.460523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91af7e94-0d32-4042-b33e-63920dfe3054 req-4295fd63-abf2-4412-83f7-800181ed56ae tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:02.462072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91af7e94-0d32-4042-b33e-63920dfe3054 req-4295fd63-abf2-4412-83f7-800181ed56ae tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1102 time: 0.1235490 Dec 21 03:44:02.466958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b389d3f9-ebdb-4487-a276-fee54016f948 req-b84af969-ebea-4bf2-86da-fe66d8fb13c1 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181409 Dec 21 03:44:02.494113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-91af7e94-0d32-4042-b33e-63920dfe3054 req-86ed58a7-6be5-4725-b922-b2dc9226bb80 tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.549974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9627fd11-6316-4700-99e2-1ab2eb2aee16 req-bdb31ad9-5732-4733-80b0-ac61c5a1f48d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 210 time: 0.0361307 Dec 21 03:44:02.621790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 272ba7b9-365d-4afd-bfd3-3be655599b4c {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:02.633187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.653658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Transition to ACTIVE for port object 272ba7b9-365d-4afd-bfd3-3be655599b4c will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:02.671862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-91af7e94-0d32-4042-b33e-63920dfe3054 req-86ed58a7-6be5-4725-b922-b2dc9226bb80 tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.715084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:02.749278 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.758145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'name': 'network-vif-deleted', 'tag': '43cbd190-b145-423d-9f7c-f2f1eabaabc2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:02.761119 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43d1b782-489f-4490-8e08-67466156a7ca" -d '{"events": [{"server_uuid": "0354f6e5-2b90-41cf-924b-b3b9a8fc83b0", "name": "network-vif-deleted", "tag": "43cbd190-b145-423d-9f7c-f2f1eabaabc2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:02.796108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-91af7e94-0d32-4042-b33e-63920dfe3054 req-86ed58a7-6be5-4725-b922-b2dc9226bb80 tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.800831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-939b8a0c-7d6e-4bdd-9396-46be2695bdc0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e9c27dc3be0348c1ad020c6b7971c169&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0838144 Dec 21 03:44:02.804477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:02.877130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Pushing event updated for resources: {'Port': ['ID=272ba7b9-365d-4afd-bfd3-3be655599b4c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:02.888255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91af7e94-0d32-4042-b33e-63920dfe3054 req-86ed58a7-6be5-4725-b922-b2dc9226bb80 tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4145248 Dec 21 03:44:02.888900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ed58a7-6be5-4725-b922-b2dc9226bb80 tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55838b97-24c3-4e34-9586-b2323bc79830,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:02.928511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b227a6ea-7f87-4dff-b3a1-ccbadeae77e1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.949753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Attempting to bind port 272ba7b9-365d-4afd-bfd3-3be655599b4c on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:02.950093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Attempting to bind port 272ba7b9-365d-4afd-bfd3-3be655599b4c by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:02.950434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Attempting to bind port 272ba7b9-365d-4afd-bfd3-3be655599b4c on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:02.965878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Port 272ba7b9-365d-4afd-bfd3-3be655599b4c on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:02.966422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Attempting to bind port 272ba7b9-365d-4afd-bfd3-3be655599b4c on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:02.978303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:02.978902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:02.979551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:02.980159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Bound port: 272ba7b9-365d-4afd-bfd3-3be655599b4c, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:02.980673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:02.984042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b227a6ea-7f87-4dff-b3a1-ccbadeae77e1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:03.102151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] For port 272ba7b9-365d-4afd-bfd3-3be655599b4c, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:03.134502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b227a6ea-7f87-4dff-b3a1-ccbadeae77e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:03.137164 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b227a6ea-7f87-4dff-b3a1-ccbadeae77e1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:03.137312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] For port 272ba7b9-365d-4afd-bfd3-3be655599b4c, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:03.138553 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b227a6ea-7f87-4dff-b3a1-ccbadeae77e1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2f814dba-84a1-4261-94a6-3487ce0843b5 HTTP/1.1" status: 204 len: 168 time: 0.3318257 Dec 21 03:44:03.150713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b227a6ea-7f87-4dff-b3a1-ccbadeae77e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f814dba-84a1-4261-94a6-3487ce0843b5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:03.173133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-63d36071-b9bf-4cfe-a6c7-6c0e154ba85a tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:03.175431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-63d36071-b9bf-4cfe-a6c7-6c0e154ba85a tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.0769396 Dec 21 03:44:03.249489 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-855f497e-b851-4fb3-aba1-70e43e6480c9 x-openstack-request-id: req-855f497e-b851-4fb3-aba1-70e43e6480c9 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:03.252211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0354f6e5-2b90-41cf-924b-b3b9a8fc83b0", "name": "network-vif-deleted", "tag": "43cbd190-b145-423d-9f7c-f2f1eabaabc2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:03.252211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-855f497e-b851-4fb3-aba1-70e43e6480c9 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:03.252211 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0354f6e5-2b90-41cf-924b-b3b9a8fc83b0', 'name': 'network-vif-deleted', 'tag': '43cbd190-b145-423d-9f7c-f2f1eabaabc2', 'status': 'completed', 'code': 200} Dec 21 03:44:03.253394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:03.263838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-1f85dab6-aaf0-4d94-b323-009e81f7713d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 695 time: 0.0821533 Dec 21 03:44:03.297558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:03.307622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:03.309924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] 10.222.0.31 "PUT /v2.0/ports/272ba7b9-365d-4afd-bfd3-3be655599b4c HTTP/1.1" status: 200 len: 1097 time: 1.2661836 Dec 21 03:44:03.315988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'floatingip': {'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:03.392077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:03.603238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-b772161f-883b-47aa-9af0-8f2c3e95650c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:03.612396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-b772161f-883b-47aa-9af0-8f2c3e95650c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=780f03990e134c4b9f0ed57113abb273&device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 1100 time: 0.0716674 Dec 21 03:44:03.652449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45e4c366-3c3c-43f4-9607-875bfe10dad6 service neutron] Pushing event updated for resources: {'Port': ['ID=272ba7b9-365d-4afd-bfd3-3be655599b4c,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:03.672857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f8026768-a1b6-4ee0-8ccb-be6b06cb2000 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:03.674393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f8026768-a1b6-4ee0-8ccb-be6b06cb2000 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.1637566 Dec 21 03:44:03.709720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Request body: {'port': {'device_id': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'admin_state_up': True, 'tenant_id': '7662e8b89a444924a01bee5e34421908'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:03.712383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-d730f845-4ecf-4b03-badb-c62cd3f2ba1b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.167&port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c HTTP/1.1" status: 200 len: 217 time: 0.0757544 Dec 21 03:44:03.811604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-e317ddf4-fd84-444a-ba91-34e38ba6514d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:03.813102 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-e317ddf4-fd84-444a-ba91-34e38ba6514d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0924385 Dec 21 03:44:03.884353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-eb32fe3e-8b36-489b-98c3-f961d342d442 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:03.887517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-eb32fe3e-8b36-489b-98c3-f961d342d442 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0628383 Dec 21 03:44:04.009807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-f610904f-3874-4737-b78b-a94c3e5b5374 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:04.011292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-f610904f-3874-4737-b78b-a94c3e5b5374 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.54 "GET /v2.0/ports?device_id=f0f1c245-eedc-46f1-8a56-6abb61b17ccc HTTP/1.1" status: 200 len: 945 time: 0.1873491 Dec 21 03:44:04.042306 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-c6ffd073-e4c8-48bd-ab7e-915229c44378 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1455617 Dec 21 03:44:04.269100 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9678db2c-4f73-4e56-9970-5c78e9614453 req-6d4c8036-2d2e-4709-bc2f-09c9be4ddb31 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1734338 Dec 21 03:44:04.445200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a113c0a2-f9fa-4085-9343-b1f26c32abdd req-bc00c8b1-f420-4fd9-9615-c1f63d9f54a7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 210 time: 0.0845075 Dec 21 03:44:04.574000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Made reservation on behalf of 7662e8b89a444924a01bee5e34421908 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:04.577783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:04.580672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42164) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:04.601556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-2243864a-074c-4c9d-a412-d0bc2e5602f3 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0331869 Dec 21 03:44:04.673275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Deleting port 8ce7fb06-2f70-4696-904a-92f477cbea6e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:04.673630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:04.749042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:04.806209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-a7a9041a-a53d-4e60-ad9c-0eab32d3f99b tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:04.807885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-a7a9041a-a53d-4e60-ad9c-0eab32d3f99b tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1949813 Dec 21 03:44:04.814091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed5b1da1-7b48-4ee8-afab-583ca144b2a6 req-fe8527a9-312e-4588-9aa2-15d49b6db37d tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:04.815940 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-63179a41-75c9-40d6-913f-504a0309c7ee service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2341976 Dec 21 03:44:04.821328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-c9b04aa8-15bb-4438-be70-d5272cd1b038 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:04.821469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed5b1da1-7b48-4ee8-afab-583ca144b2a6 req-fe8527a9-312e-4588-9aa2-15d49b6db37d tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 948 time: 0.2949715 Dec 21 03:44:04.823443 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-c9b04aa8-15bb-4438-be70-d5272cd1b038 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0061975 Dec 21 03:44:04.843103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Request body: {'port': {'device_id': 'f14c723c-76d3-45ed-874b-833d6d130856', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'f99ea8b7ae9a4d40aed93882fd7c11fc'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:04.859504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:04.977463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] For port 8ce7fb06-2f70-4696-904a-92f477cbea6e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ce7fb06-2f70-4696-904a-92f477cbea6e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:04.977739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:04.991377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Allocated IP 172.20.0.7 (8b13f1ae-b717-40da-b68e-bdf950529b14/84e57960-b2b1-49b0-85de-36fd5e1ebd6a/c312fda9-2565-4637-8907-d38449a7ab27) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:05.028536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed5b1da1-7b48-4ee8-afab-583ca144b2a6 req-046fea22-48b1-4994-a1fc-596dbca58b44 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2052534 Dec 21 03:44:05.212913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Calling delete_port for 8ce7fb06-2f70-4696-904a-92f477cbea6e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:05.212913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e620a37f-732a-46b5-ac55-b59a1980c356 req-a6145c80-5e9d-4aa6-9a61-25ab7a2757bd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 210 time: 0.0801220 Dec 21 03:44:05.212913 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de associated. External IP: 172.25.5.99, port: 552d2bbd-e22b-4bf0-a3fc-056e9948167e. Dec 21 03:44:05.258982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'tag': '272ba7b9-365d-4afd-bfd3-3be655599b4c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:05.261550 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab84d723-4a09-436d-b7b2-7fb697a9370f" -d '{"events": [{"name": "network-changed", "server_uuid": "9768f2c8-df71-45ed-a4a8-70d702d1602e", "tag": "272ba7b9-365d-4afd-bfd3-3be655599b4c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:05.497674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Made reservation on behalf of f99ea8b7ae9a4d40aed93882fd7c11fc for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:05.498349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:05.539572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70ce12ee-bf79-40e5-abd0-89ec7e8d4e69 req-5d502397-3bea-4090-87fd-e4597c4762f1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:05.541064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70ce12ee-bf79-40e5-abd0-89ec7e8d4e69 req-5d502397-3bea-4090-87fd-e4597c4762f1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.2000508 Dec 21 03:44:05.565789 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:05.655416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Allocated IP 192.168.233.233 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/59042474-2f15-4ece-b823-a6a823f26939) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:05.686126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70ce12ee-bf79-40e5-abd0-89ec7e8d4e69 req-0e6d0a05-a526-4e8a-94a2-067a62f1326b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240010 Dec 21 03:44:05.692805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:44:05.701327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:05.749764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['552d2bbd-e22b-4bf0-a3fc-056e9948167e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:05.788610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event deleted for resources: {'Port': ['ID=8ce7fb06-2f70-4696-904a-92f477cbea6e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:05.793728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:05.923844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.028416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] No DVR routers for this DVR port 8ce7fb06-2f70-4696-904a-92f477cbea6e on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:06.033053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:06.041245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.046025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-790f5097-b557-4527-bdc5-5db6aead3f4f req-61cae227-5697-4e8a-a583-bacba85d3a57 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.54 "DELETE /v2.0/ports/8ce7fb06-2f70-4696-904a-92f477cbea6e HTTP/1.1" status: 204 len: 173 time: 2.0012674 Dec 21 03:44:06.049601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:06.054783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:06.055626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:06.062002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.063443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.071069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.104632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:06.110686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:06.115931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.139910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:06.144089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:06.149002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:06.154380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Pushing event updated for resources: {'Port': ['ID=59042474-2f15-4ece-b823-a6a823f26939,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:06.175752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:06.223119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-a2304148-41e3-4a7b-9e55-f288f9fdbe73 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "PUT /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 995 time: 2.9341390 Dec 21 03:44:06.238894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2779db62-85ce-43f5-a8bc-0c1a3142861e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5335388 Dec 21 03:44:06.253772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.258182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.260376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:06.267477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:06.297789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Request body: {'port': {'device_id': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:06.383263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.31', 52079) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:06.404785 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc0286c0-7c6c-4f37-95d0-f84115258f26 x-openstack-request-id: req-dc0286c0-7c6c-4f37-95d0-f84115258f26 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:06.405087 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9768f2c8-df71-45ed-a4a8-70d702d1602e", "tag": "272ba7b9-365d-4afd-bfd3-3be655599b4c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:06.407488 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dc0286c0-7c6c-4f37-95d0-f84115258f26 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:06.407927 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'tag': '272ba7b9-365d-4afd-bfd3-3be655599b4c', 'status': 'completed', 'code': 200} Dec 21 03:44:06.428851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:06.439116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-19a92581-7f09-410d-93fa-8815eac5eecd tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.6128736 Dec 21 03:44:06.459319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-82bbec75-0155-4233-bb67-8f28f0f10446 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.460958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-82bbec75-0155-4233-bb67-8f28f0f10446 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=780f03990e134c4b9f0ed57113abb273&device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 1100 time: 0.0766218 Dec 21 03:44:06.466705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Request body: {'port': {'device_id': 'f14c723c-76d3-45ed-874b-833d6d130856', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:06.519826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.562394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-7d8669b9-054e-4f4c-9342-927273405bae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.564223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-7d8669b9-054e-4f4c-9342-927273405bae service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.3170156 Dec 21 03:44:06.593756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.672920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-f6bf3398-1e5b-4bcc-88b7-eaa5389552df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.674888 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-f6bf3398-1e5b-4bcc-88b7-eaa5389552df service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2044997 Dec 21 03:44:06.675882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-23c59580-247a-46a6-a292-ae163ae1aa3e None None] Provisioning complete for port 59042474-2f15-4ece-b823-a6a823f26939 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:06.676252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23c59580-247a-46a6-a292-ae163ae1aa3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:06.776360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-23c59580-247a-46a6-a292-ae163ae1aa3e None None] Port 59042474-2f15-4ece-b823-a6a823f26939 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:06.785687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-b6c23cd8-f6ae-40c9-93eb-bb1f73d42fa0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.167&port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c HTTP/1.1" status: 200 len: 217 time: 0.0517521 Dec 21 03:44:06.794871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd52ec29-5ee3-43a1-aeb5-569a98e54161 req-cec00d03-0f37-4d4c-8097-19b8ed2da227 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.797843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd52ec29-5ee3-43a1-aeb5-569a98e54161 req-cec00d03-0f37-4d4c-8097-19b8ed2da227 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 931 time: 0.3509574 Dec 21 03:44:06.904167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-c75f7de0-181c-4030-93b3-3ed2cc5427b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.905763 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-c75f7de0-181c-4030-93b3-3ed2cc5427b8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1077924 Dec 21 03:44:06.911770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:44:04Z', 'revision_number': 8, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:06.944607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:06.954159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:06.954762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:06.969651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-9c35438e-65c1-4ada-8968-a86167a3cec0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.971863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-9c35438e-65c1-4ada-8968-a86167a3cec0 service neutron] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.2475722 Dec 21 03:44:06.982310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-8b94f61e-fe85-45c7-bd71-82373a4e50a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:06.983960 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-8b94f61e-fe85-45c7-bd71-82373a4e50a8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0708315 Dec 21 03:44:07.059938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 59042474-2f15-4ece-b823-a6a823f26939 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:07.073693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:07.091876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd52ec29-5ee3-43a1-aeb5-569a98e54161 req-7c498b4b-886a-45e7-9b15-f89bfab6df06 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2354639 Dec 21 03:44:07.101157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.131229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-0cd06a66-9a47-4e48-91c2-15ee30bf22f6 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 998 time: 0.1338542 Dec 21 03:44:07.148944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Transition to ACTIVE for port object 59042474-2f15-4ece-b823-a6a823f26939 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:07.199617 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-a196ecb1-0e59-4aee-b2a1-4ce41b23e228 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1887658 Dec 21 03:44:07.230203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.252605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c312fda9-2565-4637-8907-d38449a7ab27 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:07.266805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ce7fb06-2f70-4696-904a-92f477cbea6e no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:07.275965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.326791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-b0d9d361-6e4f-4a8c-9b66-00b30285e5f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:07.326791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-b0d9d361-6e4f-4a8c-9b66-00b30285e5f2 service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.1435218 Dec 21 03:44:07.327153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 8ce7fb06-2f70-4696-904a-92f477cbea6e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:07.327153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ce7fb06-2f70-4696-904a-92f477cbea6e not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:07.327309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Transition to ACTIVE for port object c312fda9-2565-4637-8907-d38449a7ab27 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:07.354135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4156f6-0cee-4e49-981b-5f92640a9437 req-69466bd8-88cf-4d18-adef-7ac3512646da tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:07.356609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f4156f6-0cee-4e49-981b-5f92640a9437 req-69466bd8-88cf-4d18-adef-7ac3512646da tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 948 time: 0.0980396 Dec 21 03:44:07.365489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Pushing event updated for resources: {'Port': ['ID=59042474-2f15-4ece-b823-a6a823f26939,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:07.428859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-c447c79f-6481-43de-9364-d42fef912c25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:07.430322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-c447c79f-6481-43de-9364-d42fef912c25 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0953560 Dec 21 03:44:07.441408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.450572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f4156f6-0cee-4e49-981b-5f92640a9437 req-782047b7-c313-4393-92be-fcd70b3c73e8 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774474 Dec 21 03:44:07.470817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ab84d723-4a09-436d-b7b2-7fb697a9370f req-e0253681-d8b8-4ab0-a0ed-466a84ffb874 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2555461 Dec 21 03:44:07.530366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Attempting to bind port 59042474-2f15-4ece-b823-a6a823f26939 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:07.530775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Attempting to bind port 59042474-2f15-4ece-b823-a6a823f26939 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:07.531241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Attempting to bind port 59042474-2f15-4ece-b823-a6a823f26939 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:07.540097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Port 59042474-2f15-4ece-b823-a6a823f26939 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:07.540873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Attempting to bind port 59042474-2f15-4ece-b823-a6a823f26939 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:07.546746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:07.547254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:07.547767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:07.548259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Bound port: 59042474-2f15-4ece-b823-a6a823f26939, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:07.548678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.552943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 272ba7b9-365d-4afd-bfd3-3be655599b4c details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:07.638791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] For port 59042474-2f15-4ece-b823-a6a823f26939, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:07.642504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] For port 59042474-2f15-4ece-b823-a6a823f26939, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=59042474-2f15-4ece-b823-a6a823f26939,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:07.713845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 272ba7b9-365d-4afd-bfd3-3be655599b4c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:07.717997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.733699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:44:04Z', 'revision_number': 8, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:07.738993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '272ba7b9-365d-4afd-bfd3-3be655599b4c', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '272ba7b9-365d-4afd-bfd3-3be655599b4c', 'mac_address': 'fa:16:3e:72:5f:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.167'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:07.757389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:07.758009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.759450 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] 10.222.0.31 "PUT /v2.0/ports/59042474-2f15-4ece-b823-a6a823f26939 HTTP/1.1" status: 200 len: 1097 time: 1.2975936 Dec 21 03:44:07.759896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f14c723c-76d3-45ed-874b-833d6d130856', 'tag': '59042474-2f15-4ece-b823-a6a823f26939'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:07.762312 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a1a2849-0d30-4134-bc8b-b1ac46beb760" -d '{"events": [{"name": "network-changed", "server_uuid": "f14c723c-76d3-45ed-874b-833d6d130856", "tag": "59042474-2f15-4ece-b823-a6a823f26939"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:07.773693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5e18bcd-7095-4115-85f2-3556157348f6 None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e08af3ae-c535-4e9e-bad4-de0b170b62de', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'floating_ip_address': '172.25.5.99', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'port_id': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 236, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'mac_address': 'fa:16:3e:2d:c5:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:20Z', 'updated_at': '2021-12-21T03:44:04Z', 'revision_number': 8, 'project_id': 'd3c7911e116e4170812afec94091929a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:07.809679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f909c38-431f-4375-aa8d-4be5e4a4109c service neutron] Pushing event updated for resources: {'Port': ['ID=59042474-2f15-4ece-b823-a6a823f26939,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:07.831794 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.856286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 272ba7b9-365d-4afd-bfd3-3be655599b4c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:07.873206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 272ba7b9-365d-4afd-bfd3-3be655599b4c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:07.889811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:07.954770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-b7767fb6-bf51-40e1-891f-9d4f2cbc257c service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4800601 Dec 21 03:44:07.979182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-6b27900f-8a6a-4b00-8b3e-33942a908c1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:07.980820 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-6b27900f-8a6a-4b00-8b3e-33942a908c1e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 1100 time: 0.0568149 Dec 21 03:44:07.982179 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:07.985879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:07.992656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:07.992656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.015317 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:08.017370 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:08.022107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5de0bd-4cd1-4aba-8c14-2d67cf38cee9 req-b0d67a80-f34b-4e36-8148-6473151802ec tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.032932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea5de0bd-4cd1-4aba-8c14-2d67cf38cee9 req-b0d67a80-f34b-4e36-8148-6473151802ec tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 948 time: 0.4879773 Dec 21 03:44:08.045143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:08.045402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:08.046709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-6cf06f13-471a-444f-bd15-b88532805fcc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.233&port_id=59042474-2f15-4ece-b823-a6a823f26939 HTTP/1.1" status: 200 len: 217 time: 0.0434117 Dec 21 03:44:08.052617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=272ba7b9-365d-4afd-bfd3-3be655599b4c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:08.077946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:08.078284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:08.078683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:08.079156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Bound port: c312fda9-2565-4637-8907-d38449a7ab27, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:08.079513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:08.120841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-4d0573b8-d831-4fdb-ab17-64ef98d3251d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.122619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-4d0573b8-d831-4fdb-ab17-64ef98d3251d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0677116 Dec 21 03:44:08.171635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-ea317676-7ee1-4450-a7c2-abe7e72b3ae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.173300 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-ea317676-7ee1-4450-a7c2-abe7e72b3ae4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0431283 Dec 21 03:44:08.202480 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6530a8c-bcce-426b-85c4-062d23d5cdb4 None None] New status for floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:44:08.227198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a7ca7e-9b80-4716-8f74-2c796a3a9525 req-4397e0ba-1abb-4d61-a7cf-955a068651c5 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2709739 Dec 21 03:44:08.248000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea5de0bd-4cd1-4aba-8c14-2d67cf38cee9 req-9e8329e1-0598-4375-b13f-a66a2595085a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2133405 Dec 21 03:44:08.256208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-3eb27d85-b1fb-4c93-b0ad-825dca881c21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.257995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-3eb27d85-b1fb-4c93-b0ad-825dca881c21 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1102 time: 0.1669052 Dec 21 03:44:08.348878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['272ba7b9-365d-4afd-bfd3-3be655599b4c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:08.363682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-c7fbcc3c-066f-4c0c-820d-aabcf49ab5af service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1806047 Dec 21 03:44:08.373107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:08.386416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-83bd8206-dfda-49ef-9ebe-52c7013fed03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.388109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-83bd8206-dfda-49ef-9ebe-52c7013fed03 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1162970 Dec 21 03:44:08.390021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:08.409465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'name': 'network-vif-deleted', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e'}, {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:08.412083 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0" -d '{"events": [{"server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "name": "network-vif-deleted", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e"}, {"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:08.468532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-921989a9-ae5c-403a-b742-fde8621d28a4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0527468 Dec 21 03:44:08.472185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:08.520813 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e631c00b-d649-483f-b805-5b8f7f754a25 req-bad063c2-72d1-42a6-94cf-bbee7d0a749f service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1478364 Dec 21 03:44:08.604948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.605746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:08.607182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] 10.222.0.31 "PUT /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 1092 time: 2.3206306 Dec 21 03:44:08.624124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f280d896-acdc-42c2-8f7e-953153675e03 service neutron] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:08.642102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-0dc3d3f6-d444-42b8-8fa6-35c9e5f878f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.644139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-0dc3d3f6-d444-42b8-8fa6-35c9e5f878f3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1297317 Dec 21 03:44:08.655854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1edbb8e-0c4e-495d-aa20-d4e6bdaf3649 req-0a7ec2f4-256a-4afa-b970-eb1805ff86d8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.657267 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1edbb8e-0c4e-495d-aa20-d4e6bdaf3649 req-0a7ec2f4-256a-4afa-b970-eb1805ff86d8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1439695 Dec 21 03:44:08.726455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-91118476-93f9-42cb-b3bd-ed3319168be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.728000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-91118476-93f9-42cb-b3bd-ed3319168be4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0698903 Dec 21 03:44:08.732623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1edbb8e-0c4e-495d-aa20-d4e6bdaf3649 req-78e34050-7947-4ba7-a9bd-6c6b847d76e4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667052 Dec 21 03:44:08.740500 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-daa6a9b7-9c72-46b6-8999-a3c8edb363fb x-openstack-request-id: req-daa6a9b7-9c72-46b6-8999-a3c8edb363fb {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:08.743426 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f14c723c-76d3-45ed-874b-833d6d130856", "tag": "59042474-2f15-4ece-b823-a6a823f26939", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:08.743426 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-daa6a9b7-9c72-46b6-8999-a3c8edb363fb {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:08.743426 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f14c723c-76d3-45ed-874b-833d6d130856', 'tag': '59042474-2f15-4ece-b823-a6a823f26939', 'status': 'completed', 'code': 200} Dec 21 03:44:08.843999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-4368c779-e70d-4454-8300-5f3fa3a09de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.845504 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-4368c779-e70d-4454-8300-5f3fa3a09de3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1095 time: 0.0466366 Dec 21 03:44:08.899283 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-4eb3f879-5ef7-4eb5-bf00-1c545e430e7e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.0384097 Dec 21 03:44:08.949160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-50c0716f-8633-4db0-b109-cb90224b2906 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.950632 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-50c0716f-8633-4db0-b109-cb90224b2906 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0437140 Dec 21 03:44:08.963554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77106375-65cb-41b3-bdbc-072694e1a4a4 req-2d1915a9-8ddc-4e42-853a-2a3b0675a30a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.965036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77106375-65cb-41b3-bdbc-072694e1a4a4 req-2d1915a9-8ddc-4e42-853a-2a3b0675a30a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.1788340 Dec 21 03:44:08.970412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ead9de1-52dc-48b7-bae7-318c423fb4f3 req-59ac04e5-53da-4d0f-b781-2b07279d2d27 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 997 time: 0.1222801 Dec 21 03:44:08.972170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-1fa9c074-4158-4f7e-86d0-109c6e6be4b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:08.973543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-1fa9c074-4158-4f7e-86d0-109c6e6be4b1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 1100 time: 0.1759086 Dec 21 03:44:08.977367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-eedcd611-41a4-4049-b5b8-13ffe9fea501 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2276413 Dec 21 03:44:08.981665 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-61a8b6f7-acd0-4688-9e97-f28b0a766853 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0230143 Dec 21 03:44:09.074534 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-3a7b20c4-63e4-446f-b322-bada37030403 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854876 Dec 21 03:44:09.166619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83b993c6-5cd5-43e5-a8f4-251736878044 req-2df33d80-d92a-499d-a814-d7dcbc2ce7b4 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837998 Dec 21 03:44:09.209947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77106375-65cb-41b3-bdbc-072694e1a4a4 req-8d1f90d3-c59b-4a08-b742-41936d6f03ad tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2354558 Dec 21 03:44:09.243977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-d8185aad-2e69-4b47-8410-fb3cbd42b974 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.245423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-d8185aad-2e69-4b47-8410-fb3cbd42b974 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2614882 Dec 21 03:44:09.262402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ead9de1-52dc-48b7-bae7-318c423fb4f3 req-7859d530-8a1a-4d93-8ffd-5c411bac1f9b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.263796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ead9de1-52dc-48b7-bae7-318c423fb4f3 req-7859d530-8a1a-4d93-8ffd-5c411bac1f9b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2817078 Dec 21 03:44:09.265473 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdfee3b8-a785-4111-b61d-4f9276667e2c x-openstack-request-id: req-cdfee3b8-a785-4111-b61d-4f9276667e2c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:09.265765 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0f1c245-eedc-46f1-8a56-6abb61b17ccc", "name": "network-vif-deleted", "tag": "8ce7fb06-2f70-4696-904a-92f477cbea6e", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:09.266013 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cdfee3b8-a785-4111-b61d-4f9276667e2c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:09.266417 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0f1c245-eedc-46f1-8a56-6abb61b17ccc', 'name': 'network-vif-deleted', 'tag': '8ce7fb06-2f70-4696-904a-92f477cbea6e', 'status': 'completed', 'code': 200} Dec 21 03:44:09.266643 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'status': 'completed', 'code': 200} Dec 21 03:44:09.275926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-8125d005-9771-4588-95d7-a9fd1e5b8b9f service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2692459 Dec 21 03:44:09.280950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-2ead9de1-52dc-48b7-bae7-318c423fb4f3 req-3b096390-2c54-48be-a613-c83e6d701ae1 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:09.281898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ead9de1-52dc-48b7-bae7-318c423fb4f3 req-3b096390-2c54-48be-a613-c83e6d701ae1 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052373 Dec 21 03:44:09.312521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-83e5f893-5ce6-4671-aca2-5ff4f44dd77a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.233&port_id=59042474-2f15-4ece-b823-a6a823f26939 HTTP/1.1" status: 200 len: 217 time: 0.0450399 Dec 21 03:44:09.398510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-7e9b60c4-587c-4bc4-9f94-2e717075728b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.400819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-7e9b60c4-587c-4bc4-9f94-2e717075728b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.0534704 Dec 21 03:44:09.407068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-2fd5a618-38e2-4c9e-8502-aef2d9f221b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.407068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-2fd5a618-38e2-4c9e-8502-aef2d9f221b6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0548515 Dec 21 03:44:09.415226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c62223ec-0b60-43b7-9bef-29d567a57db6 req-f01c7d70-e91a-4c2b-9b31-125869f2a89d tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.416767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c62223ec-0b60-43b7-9bef-29d567a57db6 req-f01c7d70-e91a-4c2b-9b31-125869f2a89d tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 949 time: 0.0946219 Dec 21 03:44:09.485274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-08a994b4-9618-4493-b900-825c4cb661fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.486678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-08a994b4-9618-4493-b900-825c4cb661fe service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0689993 Dec 21 03:44:09.491305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c62223ec-0b60-43b7-9bef-29d567a57db6 req-92777d1b-1ac0-4e84-9286-bd242425f550 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663800 Dec 21 03:44:09.534081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-afcce629-d830-4b35-b810-4e3940f6c73e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.535801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-afcce629-d830-4b35-b810-4e3940f6c73e service neutron] 10.222.0.31 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.1194825 Dec 21 03:44:09.542943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 272ba7b9-365d-4afd-bfd3-3be655599b4c up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:09.654844 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-1e1cf2fd-f17d-4b1a-b09d-93d38476d495 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 1000 time: 0.1103327 Dec 21 03:44:09.672526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-95c892b2-fd68-421a-8c72-c26184c517b1 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1532147 Dec 21 03:44:09.677835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 272ba7b9-365d-4afd-bfd3-3be655599b4c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:44:09.689351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 272ba7b9-365d-4afd-bfd3-3be655599b4c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:09.690271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:09.694726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-f49565c0-27f0-4e6a-a459-bb013a52fbd0 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1998174 Dec 21 03:44:09.702072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a2a308f-61d8-48bf-8856-258c2f9d4a8f req-110cf0db-93ac-447b-82ee-63343d959400 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.703630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a2a308f-61d8-48bf-8856-258c2f9d4a8f req-110cf0db-93ac-447b-82ee-63343d959400 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 948 time: 0.1348791 Dec 21 03:44:09.725402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-0d8c9f69-fef4-4ce0-820a-67c09c74b008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.727475 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-0d8c9f69-fef4-4ce0-820a-67c09c74b008 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.0646298 Dec 21 03:44:09.776078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-60d9b785-844b-44f2-9faf-35dafed48784 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.783451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-5fbbea3b-f17a-43e1-a4f7-69b63c8cd148 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:09.785096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-5fbbea3b-f17a-43e1-a4f7-69b63c8cd148 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0490031 Dec 21 03:44:09.787212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-60d9b785-844b-44f2-9faf-35dafed48784 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports/552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 942 time: 0.1030633 Dec 21 03:44:09.792751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:09.823906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '272ba7b9-365d-4afd-bfd3-3be655599b4c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:09.826446 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b64dcc4b-0480-42e6-8cd2-bda143e301a9" -d '{"events": [{"server_uuid": "9768f2c8-df71-45ed-a4a8-70d702d1602e", "name": "network-vif-plugged", "status": "completed", "tag": "272ba7b9-365d-4afd-bfd3-3be655599b4c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:09.841224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 272ba7b9-365d-4afd-bfd3-3be655599b4c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:09.894166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-699a93f0-ae48-496a-a791-96d8b6d8e9e4 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990672 Dec 21 03:44:09.894421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:09.929968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a2a308f-61d8-48bf-8856-258c2f9d4a8f req-709e20b2-75e8-40ae-adcd-0c0812d92663 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2025027 Dec 21 03:44:09.941707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1a2849-0d30-4134-bc8b-b1ac46beb760 req-2b923736-2b48-41a2-be52-d58a9b4205a2 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2371402 Dec 21 03:44:09.952132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-54d43d24-62fd-4fad-97ad-9b5b4fc4d756 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.1134014 Dec 21 03:44:09.962206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=272ba7b9-365d-4afd-bfd3-3be655599b4c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:09.994125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e9fcb250-faca-49f5-9f9d-368bfa42cdb0 req-1943cc48-4815-4f60-b553-0efccb76d432 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913100 Dec 21 03:44:10.067750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-76779bfc-3c03-40d6-8ea6-11d7785964be tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:10.069106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-76779bfc-3c03-40d6-8ea6-11d7785964be tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1162210 Dec 21 03:44:10.137337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-96b675b3-84fc-4ea3-be27-7a4eef3505ce tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 1000 time: 0.0613086 Dec 21 03:44:10.149139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Request body: {'floatingip': {'port_id': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:10.213629 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:10.359297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:10.475693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:10.476400 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de disassociated. External IP: 172.25.5.99, port: 552d2bbd-e22b-4bf0-a3fc-056e9948167e. Dec 21 03:44:10.584879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ad41e1-eb25-48c0-b488-1a292c15535c req-35fc6997-84d0-4220-b91b-32668cc71c96 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:10.586362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37ad41e1-eb25-48c0-b488-1a292c15535c req-35fc6997-84d0-4220-b91b-32668cc71c96 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1216071 Dec 21 03:44:10.684104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37ad41e1-eb25-48c0-b488-1a292c15535c req-c9b7a3e4-4ddc-4aa5-bf39-ed23efd8a155 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909314 Dec 21 03:44:10.685014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:10.727050 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bd234b3-807b-4b5a-8f15-cc42e5067baf x-openstack-request-id: req-0bd234b3-807b-4b5a-8f15-cc42e5067baf {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:10.727538 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9768f2c8-df71-45ed-a4a8-70d702d1602e", "name": "network-vif-plugged", "status": "completed", "tag": "272ba7b9-365d-4afd-bfd3-3be655599b4c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:10.727638 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0bd234b3-807b-4b5a-8f15-cc42e5067baf {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:10.728831 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '272ba7b9-365d-4afd-bfd3-3be655599b4c', 'code': 200} Dec 21 03:44:10.755679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:44:10.811639 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42c315ab-d8a0-4a26-84c7-6a4666457fc1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:10.914858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb65a8e-526d-4e2c-8738-9ecfb562f3ab req-40b44097-e493-4587-9227-31132ab00f45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:10.916382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bb65a8e-526d-4e2c-8738-9ecfb562f3ab req-40b44097-e493-4587-9227-31132ab00f45 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 1102 time: 0.0648804 Dec 21 03:44:10.949563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42c315ab-d8a0-4a26-84c7-6a4666457fc1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:10.977181 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bb65a8e-526d-4e2c-8738-9ecfb562f3ab req-d92d03e0-fffa-4181-aadb-0b8ebddf9337 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494261 Dec 21 03:44:10.991257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42c315ab-d8a0-4a26-84c7-6a4666457fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:11.028786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c315ab-d8a0-4a26-84c7-6a4666457fc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c490adae-db03-43ab-b316-290d531fe096,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:11.036016 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42c315ab-d8a0-4a26-84c7-6a4666457fc1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b40c7cf5d05a4520a3a73dedf3611684&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3469315 Dec 21 03:44:11.036232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42294) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:11.087578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5711ada8-0530-4ab2-9023-43bad359612a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:11.108510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5711ada8-0530-4ab2-9023-43bad359612a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:11.148182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872366b1-24df-4ecd-b5a7-4afe812a9dfc req-b366d5e4-a339-4dcd-8dce-64fc4a14ee7f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:11.149667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-872366b1-24df-4ecd-b5a7-4afe812a9dfc req-b366d5e4-a339-4dcd-8dce-64fc4a14ee7f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.0956731 Dec 21 03:44:11.172607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:11.177943 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:11.182159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:11.192599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:11.193222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:11.216669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-d26acde6-ca7d-42c2-9773-56f35ccc3a23 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "PUT /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 695 time: 1.0723464 Dec 21 03:44:11.225209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5711ada8-0530-4ab2-9023-43bad359612a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:11.229729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-872366b1-24df-4ecd-b5a7-4afe812a9dfc req-dde5a0e1-eb84-48b5-aa10-74031da05b05 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707319 Dec 21 03:44:11.229877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5711ada8-0530-4ab2-9023-43bad359612a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:11.230068 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5711ada8-0530-4ab2-9023-43bad359612a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c490adae-db03-43ab-b316-290d531fe096 HTTP/1.1" status: 204 len: 168 time: 0.1925588 Dec 21 03:44:11.239404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5711ada8-0530-4ab2-9023-43bad359612a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c490adae-db03-43ab-b316-290d531fe096,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:11.283757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27'}, {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:11.286743 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85f77280-94e0-499d-a8ab-b9ab90054e9e" -d '{"events": [{"name": "network-changed", "server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "tag": "c312fda9-2565-4637-8907-d38449a7ab27"}, {"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:11.316540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-73a18139-b4b6-4724-8e57-5c174da12945 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:11.318273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-73a18139-b4b6-4724-8e57-5c174da12945 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.0672593 Dec 21 03:44:11.320320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:11.418147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-30e4567b-9480-49a1-b1a6-b0f3c6b4de0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:11.423508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-30e4567b-9480-49a1-b1a6-b0f3c6b4de0f service neutron] 10.222.0.18 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.0988097 Dec 21 03:44:11.463511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-85301bb0-3041-4a1e-9d90-ff7e5b7a0265 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 217 time: 0.0363185 Dec 21 03:44:11.524480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-8dfdb250-9495-4a57-ac75-1abf70fb8ef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:11.532924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-8dfdb250-9495-4a57-ac75-1abf70fb8ef3 service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.0632162 Dec 21 03:44:11.543410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:11.578100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:11.581846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-c1dade49-6d88-4f99-bf2b-3e82c8d63497 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:11.583795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-c1dade49-6d88-4f99-bf2b-3e82c8d63497 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0500786 Dec 21 03:44:11.585121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 59042474-2f15-4ece-b823-a6a823f26939 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:11.604634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:11.605271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:11.742321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-f326dfbd-1dfa-46fb-9a61-3e4f35533bd7 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1491504 Dec 21 03:44:11.784034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d314790a-0852-4fa5-8df1-df956f7cbb87 req-b4f74b01-533c-41f4-87d6-41d754704823 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:11.787401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d314790a-0852-4fa5-8df1-df956f7cbb87 req-b4f74b01-533c-41f4-87d6-41d754704823 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 950 time: 0.0932360 Dec 21 03:44:11.802492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:11.849628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 59042474-2f15-4ece-b823-a6a823f26939, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=59042474-2f15-4ece-b823-a6a823f26939,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:11.868483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '59042474-2f15-4ece-b823-a6a823f26939', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '59042474-2f15-4ece-b823-a6a823f26939', 'mac_address': 'fa:16:3e:fa:81:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.233'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:11.886779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d314790a-0852-4fa5-8df1-df956f7cbb87 req-a37acd03-ce27-4edf-994f-83abfbfd0e2c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944223 Dec 21 03:44:11.888817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46a5ec8e-5f02-44e2-a768-f875e9f99f49 req-10cc2bbb-7a6d-416f-89e9-5ae44530b1c7 service neutron] 10.222.0.18 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1394851 Dec 21 03:44:11.981316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.003833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 59042474-2f15-4ece-b823-a6a823f26939 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:12.005711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c1e3651-f3f0-492d-9874-a413f2c937aa req-d623e249-fd22-423a-85a7-84facecedb1f tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:12.007836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c1e3651-f3f0-492d-9874-a413f2c937aa req-d623e249-fd22-423a-85a7-84facecedb1f tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 948 time: 0.0594206 Dec 21 03:44:12.037424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 59042474-2f15-4ece-b823-a6a823f26939, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=59042474-2f15-4ece-b823-a6a823f26939,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:12.037667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42316) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:12.053510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34c74ed7-688b-4467-9089-30c3d63c75c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.081336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c1e3651-f3f0-492d-9874-a413f2c937aa req-d182646e-12fd-4cef-aecc-b1d3b0f48168 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672724 Dec 21 03:44:12.091731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:12.123613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.124297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:12.126216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34af3173-9f77-4165-8630-cefa9399dd2c None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:42:50Z', 'revision_number': 4, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7f63ca03-ada3-4c58-babe-357dcf805077', 'name': '', 'network_id': 'be2315d6-c735-4ecb-b299-a3b1405aa378', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'mac_address': 'fa:16:3e:8c:a7:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 148, 'fixed_ips': [{'subnet_id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:48Z', 'updated_at': '2021-12-21T03:42:57Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'subnets': [{'id': '8f347100-a6ac-44b8-b4d2-4439cc3e6889', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:12.208198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34c74ed7-688b-4467-9089-30c3d63c75c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.225046 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e5904197-2338-4cf6-94af-5af78ec31de2 x-openstack-request-id: req-e5904197-2338-4cf6-94af-5af78ec31de2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:12.225360 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "tag": "c312fda9-2565-4637-8907-d38449a7ab27", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:12.225596 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e5904197-2338-4cf6-94af-5af78ec31de2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:12.225986 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27', 'status': 'completed', 'code': 200} Dec 21 03:44:12.228513 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'status': 'completed', 'code': 200} Dec 21 03:44:12.258579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f105db-d547-4f22-9181-61a398c13464 req-4845de4c-fc81-4f12-9d6e-83d013ad9ae6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:12.260523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47f105db-d547-4f22-9181-61a398c13464 req-4845de4c-fc81-4f12-9d6e-83d013ad9ae6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0777621 Dec 21 03:44:12.300933 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34c74ed7-688b-4467-9089-30c3d63c75c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.358509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47f105db-d547-4f22-9181-61a398c13464 req-27b10bcc-d2e7-4554-bfb5-700ce36967c4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871544 Dec 21 03:44:12.442813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34c74ed7-688b-4467-9089-30c3d63c75c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e788552c-ee55-420d-8c20-29cfdae41451,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:12.444191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=59042474-2f15-4ece-b823-a6a823f26939,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:12.493589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7c69d2-ee0c-49c2-a704-22568a9f06fb req-1848a31a-b321-4cb4-bc15-ff9595c39bd3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:12.494041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34c74ed7-688b-4467-9089-30c3d63c75c8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=255d070cc40b457f80a5f4ed6811ecd1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4484098 Dec 21 03:44:12.495615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee7c69d2-ee0c-49c2-a704-22568a9f06fb req-1848a31a-b321-4cb4-bc15-ff9595c39bd3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.1161172 Dec 21 03:44:12.496884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42326) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:12.511915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:12.528787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'c312fda9-2565-4637-8907-d38449a7ab27', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'port_id': 'c312fda9-2565-4637-8907-d38449a7ab27', 'mac_address': 'fa:16:3e:5e:a0:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84e57960-b2b1-49b0-85de-36fd5e1ebd6a', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:12.593009 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.618110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-bd11237b-ba12-4cfa-ba93-743ed4a49e19 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 200 len: 695 time: 0.1044734 Dec 21 03:44:12.627405 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df31ad61-9f6f-4078-b039-443584dcc08c None None] New status for floating IP e08af3ae-c535-4e9e-bad4-de0b170b62de: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:44:12.646109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c312fda9-2565-4637-8907-d38449a7ab27 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:12.681476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:12.723692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee7c69d2-ee0c-49c2-a704-22568a9f06fb req-cdb1d4d9-4fb8-4f01-80cc-863b7326464a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2271783 Dec 21 03:44:12.757271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.812922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:12.818904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-99f07250-e3a2-4674-a139-e2b7acae0249 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:12.825993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-99f07250-e3a2-4674-a139-e2b7acae0249 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2069671 Dec 21 03:44:12.832869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-e6e7ea0c-ca5f-4959-a900-ced269fe1697 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:12.835460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-e6e7ea0c-ca5f-4959-a900-ced269fe1697 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0086462 Dec 21 03:44:12.871953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-e75f536b-66ac-4978-aff5-1339828f05bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:12.878804 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-e75f536b-66ac-4978-aff5-1339828f05bf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1095 time: 0.5235505 Dec 21 03:44:12.920754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5baa0950-a38a-4240-8080-28d2f2ea0d65 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:12.923737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-47db69b9-bce5-489c-8ff2-6c90298d846b tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 698 time: 0.0825758 Dec 21 03:44:12.987488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-97739704-7cc2-4bcd-bbe5-7c7e2f529929 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.99 HTTP/1.1" status: 200 len: 698 time: 0.0625348 Dec 21 03:44:12.997535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5baa0950-a38a-4240-8080-28d2f2ea0d65 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.048913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-5d174e67-a8d5-4172-9cfe-4797fc2d3f27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.050382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-5d174e67-a8d5-4172-9cfe-4797fc2d3f27 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1633008 Dec 21 03:44:13.085685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26cc0ccf-bc20-427c-a322-61b2041089ec req-8795d810-68c4-45aa-82f3-1e8623866c4e tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.094447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26cc0ccf-bc20-427c-a322-61b2041089ec req-8795d810-68c4-45aa-82f3-1e8623866c4e tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 950 time: 0.1160717 Dec 21 03:44:13.108690 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-592bdbb3-3fee-4e94-a36d-7b6fe483ec51 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.0417526 Dec 21 03:44:13.125517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['59042474-2f15-4ece-b823-a6a823f26939'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:13.186272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-2a693dca-cc42-4036-809b-0cdf29982552 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.189280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-2a693dca-cc42-4036-809b-0cdf29982552 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0733793 Dec 21 03:44:13.191883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['c312fda9-2565-4637-8907-d38449a7ab27'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:13.196891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5baa0950-a38a-4240-8080-28d2f2ea0d65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.199897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5baa0950-a38a-4240-8080-28d2f2ea0d65 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.208290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5baa0950-a38a-4240-8080-28d2f2ea0d65 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e788552c-ee55-420d-8c20-29cfdae41451 HTTP/1.1" status: 204 len: 168 time: 0.7075620 Dec 21 03:44:13.213260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26cc0ccf-bc20-427c-a322-61b2041089ec req-a3d6c27c-d563-4f7b-b1a9-0d0c54bb255a tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1176326 Dec 21 03:44:13.251650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Deleting port 1d749e01-d629-4538-acc8-570b5314081b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:13.252680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.278382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42340) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:13.284287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5baa0950-a38a-4240-8080-28d2f2ea0d65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e788552c-ee55-420d-8c20-29cfdae41451,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:13.298592 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-2bd57c7d-4e66-4aae-8198-8d10062838c5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0865755 Dec 21 03:44:13.368006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.368359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.384322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Calling delete_port for 1d749e01-d629-4538-acc8-570b5314081b owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:13.458839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee40169d-03ef-47e6-acb1-7f4919fa4849 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.501858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-cca1f349-0b02-4587-866e-26a720c6ac06 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1820462 Dec 21 03:44:13.516415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972d359d-0081-4c13-82c8-d961277e149a req-92314aac-89c9-4a2a-982e-a5d396a176f1 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.525175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-972d359d-0081-4c13-82c8-d961277e149a req-92314aac-89c9-4a2a-982e-a5d396a176f1 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 949 time: 0.0809584 Dec 21 03:44:13.607551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-972d359d-0081-4c13-82c8-d961277e149a req-cf9b9b39-0dc4-44ed-b587-e0b86255adbb tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813994 Dec 21 03:44:13.653383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee40169d-03ef-47e6-acb1-7f4919fa4849 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.655766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-24ced51a-cfed-4d21-a280-bd3189299b85 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1434133 Dec 21 03:44:13.716845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.749574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event deleted for resources: {'Port': ['ID=1d749e01-d629-4538-acc8-570b5314081b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:13.762010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee40169d-03ef-47e6-acb1-7f4919fa4849 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.778135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.781456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.796785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ba96d3-6821-46c5-8cfb-a4d250776d81 req-400194fe-4d75-4ee2-a3ce-f6724613e76e tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "DELETE /v2.0/floatingips/e08af3ae-c535-4e9e-bad4-de0b170b62de HTTP/1.1" status: 204 len: 173 time: 0.8014376 Dec 21 03:44:13.840797 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ee40169d-03ef-47e6-acb1-7f4919fa4849 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=aaa9973a22134d6bb73a87635f5a4612&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5382092 Dec 21 03:44:13.841788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42358) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:13.846557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee40169d-03ef-47e6-acb1-7f4919fa4849 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b608100f-07fa-4a48-b341-c2de7035fc5f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:13.851787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-1ed44b28-e8a4-48d8-978d-2b573b2ad07d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.853292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-1ed44b28-e8a4-48d8-978d-2b573b2ad07d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d3c7911e116e4170812afec94091929a&device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 1097 time: 0.1131380 Dec 21 03:44:13.943495 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1a2140c-f809-4ec9-9d24-d334562844ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:13.953111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7180a3d-3d8a-43b6-b5ce-c640b031e63e req-c71b3243-e6c8-4a19-a9a8-0ad50950e674 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.954617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7180a3d-3d8a-43b6-b5ce-c640b031e63e req-c71b3243-e6c8-4a19-a9a8-0ad50950e674 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0813854 Dec 21 03:44:13.965254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-9f007111-e3c5-47c7-af9f-c290dabbfa5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:13.966885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-9f007111-e3c5-47c7-af9f-c290dabbfa5a service neutron] 10.222.0.31 "GET /v2.0/networks?id=be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 200 len: 922 time: 0.1048799 Dec 21 03:44:13.999472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1a2140c-f809-4ec9-9d24-d334562844ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:14.018859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-1bcf4ada-a7a4-44dd-aa8b-c9620e11bf53 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 200 len: 217 time: 0.0427666 Dec 21 03:44:14.090981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7180a3d-3d8a-43b6-b5ce-c640b031e63e req-00613edb-23ba-415d-9595-3250bcb00afa tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1193168 Dec 21 03:44:14.108715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-074e5d3f-d8ad-4ba1-a849-801baee0087b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:14.110510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-074e5d3f-d8ad-4ba1-a849-801baee0087b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 200 len: 860 time: 0.0842035 Dec 21 03:44:14.129179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bf2d9a-41f9-4493-beb9-3af8f293739b req-94dccde4-76b7-464d-b108-95a7f9479670 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:14.130766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5bf2d9a-41f9-4493-beb9-3af8f293739b req-94dccde4-76b7-464d-b108-95a7f9479670 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 944 time: 0.0902879 Dec 21 03:44:14.163907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-0b605b36-5c87-47a6-a74c-d35e716ce011 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:14.165519 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-0b605b36-5c87-47a6-a74c-d35e716ce011 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=be2315d6-c735-4ecb-b299-a3b1405aa378&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0464797 Dec 21 03:44:14.191265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5bf2d9a-41f9-4493-beb9-3af8f293739b req-b8660275-4982-469f-b70b-ebc335b1598c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541043 Dec 21 03:44:14.219627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1a2140c-f809-4ec9-9d24-d334562844ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:14.223201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1a2140c-f809-4ec9-9d24-d334562844ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:14.225743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1a2140c-f809-4ec9-9d24-d334562844ca admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b608100f-07fa-4a48-b341-c2de7035fc5f HTTP/1.1" status: 204 len: 168 time: 0.3819528 Dec 21 03:44:14.237551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a2140c-f809-4ec9-9d24-d334562844ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b608100f-07fa-4a48-b341-c2de7035fc5f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:14.283478 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-3cff072d-9296-4b1e-86cf-b77ced8e2085 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1097369 Dec 21 03:44:14.403354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85f77280-94e0-499d-a8ab-b9ab90054e9e req-e24fa095-d652-4f7d-bc26-6c162dea8cb9 service neutron] 10.222.0.31 "GET /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1120987 Dec 21 03:44:14.548455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a1fb6d-0e0e-48d5-b865-c6a548127565 req-af223732-629f-4b4e-8b9b-c008c0cc117d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:14.550050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84a1fb6d-0e0e-48d5-b865-c6a548127565 req-af223732-629f-4b4e-8b9b-c008c0cc117d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 945 time: 0.0511401 Dec 21 03:44:14.612042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84a1fb6d-0e0e-48d5-b865-c6a548127565 req-3d0bbed4-e41f-4955-aacf-5b6402bde65f tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553477 Dec 21 03:44:14.729633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58bdd506-f5a9-46b5-9edc-daf37e1e74f0 req-3a9bd6d7-580e-4ee9-90a7-21d59a96706a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:14.731153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58bdd506-f5a9-46b5-9edc-daf37e1e74f0 req-3a9bd6d7-580e-4ee9-90a7-21d59a96706a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 949 time: 0.0576286 Dec 21 03:44:14.780164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58bdd506-f5a9-46b5-9edc-daf37e1e74f0 req-5562cf4d-2cd1-4500-ae1d-48315c5f359d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427351 Dec 21 03:44:14.955268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db7ea50-5a3f-49c7-ad10-9ebcd537ec0c req-59ad2e6d-281d-42e6-9e6a-f77f25d24604 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:14.956790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db7ea50-5a3f-49c7-ad10-9ebcd537ec0c req-59ad2e6d-281d-42e6-9e6a-f77f25d24604 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 950 time: 0.0512388 Dec 21 03:44:15.003375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db7ea50-5a3f-49c7-ad10-9ebcd537ec0c req-91620587-7c14-4df3-8ee8-31d50ef3ffde tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406394 Dec 21 03:44:15.058303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42398) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:15.071579 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca469f36-1134-4431-a26e-151152fbc1fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.148373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca469f36-1134-4431-a26e-151152fbc1fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.191588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca469f36-1134-4431-a26e-151152fbc1fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.237424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ca469f36-1134-4431-a26e-151152fbc1fe admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=cccbb4afbdc843dead127d905401f0d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1774669 Dec 21 03:44:15.239703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca469f36-1134-4431-a26e-151152fbc1fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a58037f3-8d60-4843-89e4-57d6dce7f329,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:15.240204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42406) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:15.263235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f0f764-6c03-47b7-a588-4a4984946c16 req-55cc2e11-919b-481c-8f23-faea7d56986b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:15.264872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51f0f764-6c03-47b7-a588-4a4984946c16 req-55cc2e11-919b-481c-8f23-faea7d56986b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1004155 Dec 21 03:44:15.294121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba2fcdc5-a44b-4075-963f-457a009d6cc1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.318507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba2fcdc5-a44b-4075-963f-457a009d6cc1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.368765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e653e205-1461-4b1e-99f8-eb2f19f2d26e req-3ebaff23-75a1-4a74-a87c-3294384059fb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:15.371942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e653e205-1461-4b1e-99f8-eb2f19f2d26e req-3ebaff23-75a1-4a74-a87c-3294384059fb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 944 time: 0.0890319 Dec 21 03:44:15.379039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51f0f764-6c03-47b7-a588-4a4984946c16 req-5f3d92be-4908-4fda-b9d3-0179be3ca83e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1038296 Dec 21 03:44:15.423632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e653e205-1461-4b1e-99f8-eb2f19f2d26e req-5b4c4f17-d3b6-4c2f-bacc-4faa71ad3f19 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434511 Dec 21 03:44:15.448251 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba2fcdc5-a44b-4075-963f-457a009d6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.451387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba2fcdc5-a44b-4075-963f-457a009d6cc1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.455096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ba2fcdc5-a44b-4075-963f-457a009d6cc1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a58037f3-8d60-4843-89e4-57d6dce7f329 HTTP/1.1" status: 204 len: 168 time: 0.2114253 Dec 21 03:44:15.462307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2fcdc5-a44b-4075-963f-457a009d6cc1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a58037f3-8d60-4843-89e4-57d6dce7f329,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:15.558382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 59042474-2f15-4ece-b823-a6a823f26939 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:15.660217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 59042474-2f15-4ece-b823-a6a823f26939 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:44:15.664678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 59042474-2f15-4ece-b823-a6a823f26939 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:15.664952 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.731213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d33899-e2c0-4c9d-9940-9dec073a1df8 req-738f88e3-2ab3-4edf-8a31-4aac03ff71b5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:15.732733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05d33899-e2c0-4c9d-9940-9dec073a1df8 req-738f88e3-2ab3-4edf-8a31-4aac03ff71b5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 945 time: 0.0528824 Dec 21 03:44:15.748557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.790659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05d33899-e2c0-4c9d-9940-9dec073a1df8 req-46d3393b-3310-4ed2-8a6f-db975f106d5d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520301 Dec 21 03:44:15.791107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 59042474-2f15-4ece-b823-a6a823f26939, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=59042474-2f15-4ece-b823-a6a823f26939,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:15.792040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f14c723c-76d3-45ed-874b-833d6d130856', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59042474-2f15-4ece-b823-a6a823f26939'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:15.794816 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7bc62fa-6dcc-4494-b641-77c20859fa64" -d '{"events": [{"server_uuid": "f14c723c-76d3-45ed-874b-833d6d130856", "name": "network-vif-plugged", "status": "completed", "tag": "59042474-2f15-4ece-b823-a6a823f26939"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:15.844870 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7e895ea-591f-46fb-990d-d98c39760427 x-openstack-request-id: req-c7e895ea-591f-46fb-990d-d98c39760427 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:15.845823 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f14c723c-76d3-45ed-874b-833d6d130856", "name": "network-vif-plugged", "status": "completed", "tag": "59042474-2f15-4ece-b823-a6a823f26939", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:15.845823 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c7e895ea-591f-46fb-990d-d98c39760427 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:15.846452 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f14c723c-76d3-45ed-874b-833d6d130856', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59042474-2f15-4ece-b823-a6a823f26939', 'code': 200} Dec 21 03:44:15.866446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:15.867343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:15.962871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebda307-4a48-4a9d-82a9-57cfff6d2239 req-b344bc24-a905-4fb6-bd9b-8ab5a07da4fe tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:15.984384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cebda307-4a48-4a9d-82a9-57cfff6d2239 req-b344bc24-a905-4fb6-bd9b-8ab5a07da4fe tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 950 time: 0.0850818 Dec 21 03:44:15.988396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=59042474-2f15-4ece-b823-a6a823f26939,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:16.027501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-9a99d373-0b9d-48ad-b43d-1fb3c9609ce5 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=95c8a6929b04466fbe843361793ffdf4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0345321 Dec 21 03:44:16.047944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4322fa15-d1e1-4423-a113-18e3162eeb03 req-e0b7945d-9974-44de-9e84-706a4922ae74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.049479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4322fa15-d1e1-4423-a113-18e3162eeb03 req-e0b7945d-9974-44de-9e84-706a4922ae74 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 1102 time: 0.0446138 Dec 21 03:44:16.059774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port c312fda9-2565-4637-8907-d38449a7ab27 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:44:16.064067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port c312fda9-2565-4637-8907-d38449a7ab27 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:16.065589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:16.102666 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4322fa15-d1e1-4423-a113-18e3162eeb03 req-5edd3c58-75b3-4107-a6ef-4591ec2b9fbc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444634 Dec 21 03:44:16.113998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cebda307-4a48-4a9d-82a9-57cfff6d2239 req-2835c2be-f3bb-414f-b1f3-9d7c9e7aec70 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1316483 Dec 21 03:44:16.151548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:16.173009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-fd52afe2-b272-4f6b-be26-4ec49c364794 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.181544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-fd52afe2-b272-4f6b-be26-4ec49c364794 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1488709 Dec 21 03:44:16.195303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:16.201665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-423cc39a-f2ef-47d8-a1b7-fd92aaa6b964 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/quotas/95c8a6929b04466fbe843361793ffdf4 HTTP/1.1" status: 200 len: 375 time: 0.0192573 Dec 21 03:44:16.244151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-983020ea-a862-4afd-ad7f-e872148c21d8 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=95c8a6929b04466fbe843361793ffdf4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0290153 Dec 21 03:44:16.260035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08d2dadb-417a-4a5a-a9ae-b95873cb9f97 req-d9820ff5-4250-4f06-8787-4dc870adbbf0 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.261396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08d2dadb-417a-4a5a-a9ae-b95873cb9f97 req-d9820ff5-4250-4f06-8787-4dc870adbbf0 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 950 time: 0.0779064 Dec 21 03:44:16.265075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:16.310708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08d2dadb-417a-4a5a-a9ae-b95873cb9f97 req-cbb2c352-cebd-4d9c-bbdf-47738fbc7b19 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426688 Dec 21 03:44:16.320080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:16.497962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-6d4e69f1-f7e2-4a00-b6f2-b61219c15cd5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.499467 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-6d4e69f1-f7e2-4a00-b6f2-b61219c15cd5 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.31 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 945 time: 0.0681410 Dec 21 03:44:16.511735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a38a3b5e-eca4-48f3-abcd-54f4d80bb09f req-d50ae73a-1e65-4347-9ada-1e537b464548 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 210 time: 0.0417981 Dec 21 03:44:16.569500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87016cce-07a1-4549-a5e7-9b8b40eb19e5 req-40060fcb-5fb6-4fc4-b1ac-bb61714f3df9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.579871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87016cce-07a1-4549-a5e7-9b8b40eb19e5 req-40060fcb-5fb6-4fc4-b1ac-bb61714f3df9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0980992 Dec 21 03:44:16.626729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Deleting port 552d2bbd-e22b-4bf0-a3fc-056e9948167e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:16.627263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:16.666005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13017f1-7293-40b5-89da-02fc64e27a68 req-4c877745-764b-4ad7-ab37-6841e85b972a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.673137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b13017f1-7293-40b5-89da-02fc64e27a68 req-4c877745-764b-4ad7-ab37-6841e85b972a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.0918059 Dec 21 03:44:16.700060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87016cce-07a1-4549-a5e7-9b8b40eb19e5 req-5bb83881-cd73-44da-a03c-f19064bf6d38 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087203 Dec 21 03:44:16.744731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] For port 552d2bbd-e22b-4bf0-a3fc-056e9948167e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=552d2bbd-e22b-4bf0-a3fc-056e9948167e,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:16.745092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:16.747912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b13017f1-7293-40b5-89da-02fc64e27a68 req-6383aab7-023d-4bde-a05b-b01cd11f19a1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738420 Dec 21 03:44:16.770325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Calling delete_port for 552d2bbd-e22b-4bf0-a3fc-056e9948167e owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:16.933544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c2ca4e1-5b1f-4711-83eb-391df712a81f req-d090ee2a-d8c2-467e-b793-25e7421ab08a tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.935102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c2ca4e1-5b1f-4711-83eb-391df712a81f req-d090ee2a-d8c2-467e-b793-25e7421ab08a tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 945 time: 0.0687835 Dec 21 03:44:16.943397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-fa6a1752-42f8-48b2-bbbd-224c4c30299e tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:16.944817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-fa6a1752-42f8-48b2-bbbd-224c4c30299e tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.31 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 950 time: 0.0901945 Dec 21 03:44:17.009310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:17.038501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c2ca4e1-5b1f-4711-83eb-391df712a81f req-1e817533-3185-4cc4-be8f-3402c23b93a6 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/security-groups?id=40e14095-76ef-4df5-a8c5-063f87511c10&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927293 Dec 21 03:44:17.043366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Pushing event deleted for resources: {'Port': ['ID=552d2bbd-e22b-4bf0-a3fc-056e9948167e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:17.054804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['552d2bbd-e22b-4bf0-a3fc-056e9948167e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:17.077073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Deleting port 272ba7b9-365d-4afd-bfd3-3be655599b4c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:17.077073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:17.112169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] No DVR routers for this DVR port 552d2bbd-e22b-4bf0-a3fc-056e9948167e on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:17.116094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:17.119721 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8199a79-ab18-46d0-9813-bf7232d1a241 req-f5b13b82-644e-4a87-8672-2423e667964d tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.31 "DELETE /v2.0/ports/552d2bbd-e22b-4bf0-a3fc-056e9948167e HTTP/1.1" status: 204 len: 173 time: 0.6118462 Dec 21 03:44:17.120189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'name': 'network-vif-deleted', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:17.122450 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6baf79c5-9cd5-4937-bfd1-cd3ef4886bd0" -d '{"events": [{"server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "name": "network-vif-deleted", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:17.175174 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c49e059-6911-48a8-93c9-a1ad1460e94c x-openstack-request-id: req-7c49e059-6911-48a8-93c9-a1ad1460e94c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:17.175472 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "906cd1f7-1d5f-452c-a50b-96fb705d5ce2", "name": "network-vif-deleted", "tag": "552d2bbd-e22b-4bf0-a3fc-056e9948167e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:17.175725 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7c49e059-6911-48a8-93c9-a1ad1460e94c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:17.176125 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '906cd1f7-1d5f-452c-a50b-96fb705d5ce2', 'name': 'network-vif-deleted', 'tag': '552d2bbd-e22b-4bf0-a3fc-056e9948167e', 'status': 'completed', 'code': 200} Dec 21 03:44:17.185954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] For port 272ba7b9-365d-4afd-bfd3-3be655599b4c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=272ba7b9-365d-4afd-bfd3-3be655599b4c,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:17.186348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:17.232145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Calling delete_port for 272ba7b9-365d-4afd-bfd3-3be655599b4c owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:17.296771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881665d1-5d2e-4ffc-939b-212b426f5d0b req-2caa1f38-84e1-4d2d-bc26-73bced4967cb tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:17.298297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-881665d1-5d2e-4ffc-939b-212b426f5d0b req-2caa1f38-84e1-4d2d-bc26-73bced4967cb tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 950 time: 0.1026692 Dec 21 03:44:17.383352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-881665d1-5d2e-4ffc-939b-212b426f5d0b req-4c7ce0ae-588d-4a47-8154-363394cd129d tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750868 Dec 21 03:44:17.501300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810c4aa2-611a-4789-90d7-3e557b55f1fc req-daf79cb1-455b-4f4b-ad57-ab830d94dd45 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:17.504001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-810c4aa2-611a-4789-90d7-3e557b55f1fc req-daf79cb1-455b-4f4b-ad57-ab830d94dd45 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 950 time: 0.0815172 Dec 21 03:44:17.571343 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:17.582759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-810c4aa2-611a-4789-90d7-3e557b55f1fc req-3e763635-c874-41fb-b301-fb563e8aca7a tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/security-groups?id=443bb859-4613-44c4-81cf-16150a9fecf2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711792 Dec 21 03:44:17.611040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['272ba7b9-365d-4afd-bfd3-3be655599b4c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:17.642552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a12d2927-0bde-49ab-9917-8746432cc9b0 req-ef8d442a-c853-41f6-aaf8-d6aafb9b5fc5 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 210 time: 0.0678141 Dec 21 03:44:17.645338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Pushing event deleted for resources: {'Port': ['ID=272ba7b9-365d-4afd-bfd3-3be655599b4c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:17.700241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] No DVR routers for this DVR port 272ba7b9-365d-4afd-bfd3-3be655599b4c on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:17.702696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:17.707080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8aeeac4-b51b-401e-aab7-dcf45b31df3c req-ebf64027-9758-4558-875b-96828484123c tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.31 "DELETE /v2.0/ports/272ba7b9-365d-4afd-bfd3-3be655599b4c HTTP/1.1" status: 204 len: 173 time: 0.7540555 Dec 21 03:44:17.707551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'name': 'network-vif-deleted', 'tag': '272ba7b9-365d-4afd-bfd3-3be655599b4c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:17.710312 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1eab3350-1981-4a3a-bc0d-711e232cf420" -d '{"events": [{"server_uuid": "9768f2c8-df71-45ed-a4a8-70d702d1602e", "name": "network-vif-deleted", "tag": "272ba7b9-365d-4afd-bfd3-3be655599b4c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:17.755702 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de384f1a-bb56-449b-989c-0545b9216939 x-openstack-request-id: req-de384f1a-bb56-449b-989c-0545b9216939 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:17.755702 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9768f2c8-df71-45ed-a4a8-70d702d1602e", "name": "network-vif-deleted", "tag": "272ba7b9-365d-4afd-bfd3-3be655599b4c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:17.756342 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-de384f1a-bb56-449b-989c-0545b9216939 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:17.756342 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9768f2c8-df71-45ed-a4a8-70d702d1602e', 'name': 'network-vif-deleted', 'tag': '272ba7b9-365d-4afd-bfd3-3be655599b4c', 'status': 'completed', 'code': 200} Dec 21 03:44:17.847753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:17.851585 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7510f629-f23d-4ad6-8342-4313d8dd8c98" -d '{"events": [{"server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "name": "network-vif-plugged", "status": "completed", "tag": "c312fda9-2565-4637-8907-d38449a7ab27"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:17.871187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478d3ade-65f1-4b16-bbc1-f98ef90fc6e0 req-5781e0c4-a437-4737-926f-b43375e08a0b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:17.872427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-478d3ade-65f1-4b16-bbc1-f98ef90fc6e0 req-5781e0c4-a437-4737-926f-b43375e08a0b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0591967 Dec 21 03:44:17.955330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-478d3ade-65f1-4b16-bbc1-f98ef90fc6e0 req-b1aac511-a972-45c4-b743-9fe5a231d294 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732718 Dec 21 03:44:17.978469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6b7908-c98b-44c9-8c74-940ece330d79 req-2ac677f2-9338-4bee-9019-bc8bbebdcd1d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:17.980980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c6b7908-c98b-44c9-8c74-940ece330d79 req-2ac677f2-9338-4bee-9019-bc8bbebdcd1d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.0612333 Dec 21 03:44:18.031830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c6b7908-c98b-44c9-8c74-940ece330d79 req-501d09ba-b0cf-41fe-b3ba-34001bc09078 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450051 Dec 21 03:44:18.080890 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58810127-46f0-43a3-8013-dd534c9431bd x-openstack-request-id: req-58810127-46f0-43a3-8013-dd534c9431bd {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:18.084906 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "name": "network-vif-plugged", "status": "completed", "tag": "c312fda9-2565-4637-8907-d38449a7ab27", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:18.085572 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-58810127-46f0-43a3-8013-dd534c9431bd {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:18.086969 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27', 'code': 200} Dec 21 03:44:18.174810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d9dc9bd-905b-41fb-82d5-3a94d283f100 req-c8eea735-5d88-4d3d-b09f-70ce5d6afbd2 tempest-FloatingIPsAssociationTestJSON-178322071 tempest-FloatingIPsAssociationTestJSON-178322071-project] 10.222.0.18 "GET /v2.0/ports?device_id=906cd1f7-1d5f-452c-a50b-96fb705d5ce2 HTTP/1.1" status: 200 len: 210 time: 0.0289836 Dec 21 03:44:18.235829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef027da9-d6cd-4a6a-9dee-677c2628484e req-09711034-753f-44ba-8d50-40074490de9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:18.237970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef027da9-d6cd-4a6a-9dee-677c2628484e req-09711034-753f-44ba-8d50-40074490de9d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1097 time: 0.0470119 Dec 21 03:44:18.292295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef027da9-d6cd-4a6a-9dee-677c2628484e req-f6ccf50d-afc3-4217-87e0-f4d8c048317b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453062 Dec 21 03:44:18.509914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ed21e7-711c-4678-a114-524228810849 req-54abbc65-1d56-41c3-9435-3df985b3815a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:18.512035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75ed21e7-711c-4678-a114-524228810849 req-54abbc65-1d56-41c3-9435-3df985b3815a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 950 time: 0.0549924 Dec 21 03:44:18.570027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75ed21e7-711c-4678-a114-524228810849 req-207691c2-5c26-445d-849f-416625101795 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510411 Dec 21 03:44:18.717433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c19d3690-aa37-4128-a318-8b47c35abd3b req-fb3f1751-471b-4826-8d23-214ccbfc8959 tempest-TenantUsagesTestJSON-1590621672 tempest-TenantUsagesTestJSON-1590621672-project] 10.222.0.18 "GET /v2.0/ports?device_id=9768f2c8-df71-45ed-a4a8-70d702d1602e HTTP/1.1" status: 200 len: 210 time: 0.0276642 Dec 21 03:44:18.810132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdf0fd52-2f1a-448c-b63d-64d530c5da7d req-88e9b4c3-0b0b-40f2-9da8-67c123aff090 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 210 time: 0.0307963 Dec 21 03:44:18.994618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-be6c2910-0822-40e3-8caa-d2296ce53b4f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=95c8a6929b04466fbe843361793ffdf4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0290368 Dec 21 03:44:19.135361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:19.203414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d779ec-7f9e-45bd-96c3-51e36c42b040 req-7f1d840c-8b35-44ba-a8b8-1b1a91fd9822 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:19.205041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34d779ec-7f9e-45bd-96c3-51e36c42b040 req-7f1d840c-8b35-44ba-a8b8-1b1a91fd9822 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1099055 Dec 21 03:44:19.216994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-6e48a310-b6ea-4902-924c-3ddeafb1f0f7 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:19.216994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-6e48a310-b6ea-4902-924c-3ddeafb1f0f7 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2107260 Dec 21 03:44:19.220523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d9cf383-1f7f-49a6-b59c-e149e44ab50a req-cb9977d8-ff3c-4e87-9690-fb6f34d68953 tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:19.221974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d9cf383-1f7f-49a6-b59c-e149e44ab50a req-cb9977d8-ff3c-4e87-9690-fb6f34d68953 tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 1102 time: 0.1248937 Dec 21 03:44:19.244449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Request body: {'port': {'device_id': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '95c8a6929b04466fbe843361793ffdf4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:19.269731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a872e824-3144-4d51-9f11-58a1be54b593 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.280416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d9cf383-1f7f-49a6-b59c-e149e44ab50a req-103829ae-486b-47fa-8427-25feeb23bd1a tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.346051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a872e824-3144-4d51-9f11-58a1be54b593 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.357442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34d779ec-7f9e-45bd-96c3-51e36c42b040 req-764de226-93e9-4553-a6ca-fe5a07aca9dc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1345356 Dec 21 03:44:19.436612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a872e824-3144-4d51-9f11-58a1be54b593 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.488657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a872e824-3144-4d51-9f11-58a1be54b593 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0bc6e715-6cf9-4865-be0a-0676a7c6cc94,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:19.494113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d9cf383-1f7f-49a6-b59c-e149e44ab50a req-103829ae-486b-47fa-8427-25feeb23bd1a tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.499756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a872e824-3144-4d51-9f11-58a1be54b593 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=13bbc5db511344088fa3b6d381afebb1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3618400 Dec 21 03:44:19.499756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42572) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:19.502319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6233d0-5207-48ee-b1dd-c00c772c2c4d req-7c6d1909-9ab5-4de8-be4f-167fa8ee0e90 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:19.503862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd6233d0-5207-48ee-b1dd-c00c772c2c4d req-7c6d1909-9ab5-4de8-be4f-167fa8ee0e90 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.0880063 Dec 21 03:44:19.537710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Made reservation on behalf of 95c8a6929b04466fbe843361793ffdf4 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:19.541149 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.548377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ffb3a65-e434-40c6-97d4-a8ed678fa90c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.558669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.561630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d9cf383-1f7f-49a6-b59c-e149e44ab50a req-103829ae-486b-47fa-8427-25feeb23bd1a tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.576903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ffb3a65-e434-40c6-97d4-a8ed678fa90c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.583428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd6233d0-5207-48ee-b1dd-c00c772c2c4d req-70de7077-3c5e-4c5e-a6c5-371478ed6f64 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735152 Dec 21 03:44:19.593787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 552d2bbd-e22b-4bf0-a3fc-056e9948167e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:19.630886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d9cf383-1f7f-49a6-b59c-e149e44ab50a req-103829ae-486b-47fa-8427-25feeb23bd1a tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3916459 Dec 21 03:44:19.637233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103829ae-486b-47fa-8427-25feeb23bd1a tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc2bb1aa-65b3-4e42-a958-e1490b415dbc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:19.660023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 552d2bbd-e22b-4bf0-a3fc-056e9948167e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:19.660378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 552d2bbd-e22b-4bf0-a3fc-056e9948167e not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:19.678252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42574) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:19.727737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.731918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ffb3a65-e434-40c6-97d4-a8ed678fa90c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.734484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ffb3a65-e434-40c6-97d4-a8ed678fa90c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.735758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5ffb3a65-e434-40c6-97d4-a8ed678fa90c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0bc6e715-6cf9-4865-be0a-0676a7c6cc94 HTTP/1.1" status: 204 len: 168 time: 0.2351604 Dec 21 03:44:19.755084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffb3a65-e434-40c6-97d4-a8ed678fa90c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bc6e715-6cf9-4865-be0a-0676a7c6cc94,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:19.814175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.816531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8341e30-54e8-411f-835d-3ca43b3a7a87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:19.895941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Pushing event updated for resources: {'SecurityGroup': ['ID=61aff54c-174f-4df3-87a4-1e4329a18b83,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:19.955899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2325f9d4-ce8e-4085-87ea-2faa298b51c5 req-a876a75e-e45a-4433-bc83-0f6c8c4425e2 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 210 time: 0.0415032 Dec 21 03:44:20.003349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Allocated IP 192.168.233.147 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/73ac0d75-dfb3-42a5-b9f8-10f70f27485a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:20.161608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.167508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.289852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.299617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42588) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:20.344760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:20.351408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:20.365905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:20.372889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:20.373542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.386711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Pushing event updated for resources: {'Port': ['ID=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:20.471018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e00219e4-b3bb-41e3-8705-3be19da7a4ef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.2319672 Dec 21 03:44:20.488550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Deleting port 7f63ca03-ada3-4c58-babe-357dcf805077 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:20.489032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.494774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:20.532671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a9efef61-30a5-4a72-b26a-a87fb7032b39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.631857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9aa773e9-d917-4b07-9b6f-34bea7a26bd5 None None] Provisioning complete for port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:20.632894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9aa773e9-d917-4b07-9b6f-34bea7a26bd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.634531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] For port 7f63ca03-ada3-4c58-babe-357dcf805077, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7f63ca03-ada3-4c58-babe-357dcf805077,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:20.634926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.655020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Calling delete_port for 7f63ca03-ada3-4c58-babe-357dcf805077 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:20.677739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9aa773e9-d917-4b07-9b6f-34bea7a26bd5 None None] Port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:20.694295 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:44:20.742747 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a9efef61-30a5-4a72-b26a-a87fb7032b39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.775700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Request body: {'port': {'device_id': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:20.794108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a9efef61-30a5-4a72-b26a-a87fb7032b39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.863535 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a9efef61-30a5-4a72-b26a-a87fb7032b39 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2aa649c332944a28a65d15f0d02a4982&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3680074 Dec 21 03:44:20.864908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9efef61-30a5-4a72-b26a-a87fb7032b39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=125cf580-df99-4d7f-958a-d4e140b1f215,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:20.869061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42602) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:20.871643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-448a4d05-3e6d-462c-82a0-8c41ec3805c3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=780f03990e134c4b9f0ed57113abb273&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5705626 Dec 21 03:44:20.874732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42604) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:20.931654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed5bf8-099f-42ee-9166-e584676fcdf8 req-1d387d84-47b2-44f8-9967-a184b6b5ad20 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:20.933332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8eed5bf8-099f-42ee-9166-e584676fcdf8 req-1d387d84-47b2-44f8-9967-a184b6b5ad20 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.4805934 Dec 21 03:44:20.946913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c748335f-1d25-4cd2-8804-c9d89aa1cce0 req-fab90c20-edd3-4789-9300-030efe0e7f57 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:20.948373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c748335f-1d25-4cd2-8804-c9d89aa1cce0 req-fab90c20-edd3-4789-9300-030efe0e7f57 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.1789720 Dec 21 03:44:20.948932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.954989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5506c885-6ae2-4ca7-be2c-4b2466f3248d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:20.977511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5506c885-6ae2-4ca7-be2c-4b2466f3248d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.006211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.036010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Pushing event deleted for resources: {'Port': ['ID=7f63ca03-ada3-4c58-babe-357dcf805077,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:21.103094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8eed5bf8-099f-42ee-9166-e584676fcdf8 req-6feddfb5-7b08-4a55-bcf4-5b99351f6a2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1518764 Dec 21 03:44:21.154860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96594797-c4d9-49f5-8844-a3185c23f48e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.170123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c748335f-1d25-4cd2-8804-c9d89aa1cce0 req-0f44754f-5612-4656-bb4c-ccdc09649552 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2137115 Dec 21 03:44:21.210773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96594797-c4d9-49f5-8844-a3185c23f48e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.212924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5506c885-6ae2-4ca7-be2c-4b2466f3248d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.221435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5506c885-6ae2-4ca7-be2c-4b2466f3248d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.221435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5506c885-6ae2-4ca7-be2c-4b2466f3248d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/125cf580-df99-4d7f-958a-d4e140b1f215 HTTP/1.1" status: 204 len: 168 time: 0.3488157 Dec 21 03:44:21.240757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5506c885-6ae2-4ca7-be2c-4b2466f3248d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=125cf580-df99-4d7f-958a-d4e140b1f215,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:21.253799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.381813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bea5c50-e71e-4293-b096-a4d9d5f7ed02 req-e2b387d4-8d31-415b-8406-1d798f6982aa tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:21.387450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bea5c50-e71e-4293-b096-a4d9d5f7ed02 req-e2b387d4-8d31-415b-8406-1d798f6982aa tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 1102 time: 0.1793084 Dec 21 03:44:21.492839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a32d7-36aa-41c6-a92d-f41c511caae2 req-908ba010-862f-4e77-b5b4-863fcd926578 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:21.494520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-967a32d7-36aa-41c6-a92d-f41c511caae2 req-908ba010-862f-4e77-b5b4-863fcd926578 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 936 time: 0.1206043 Dec 21 03:44:21.519938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bea5c50-e71e-4293-b096-a4d9d5f7ed02 req-4a5185a7-6da5-43ef-b550-c0af11d5ee59 tempest-ServersAdminNegativeTestJSON-1816668744 tempest-ServersAdminNegativeTestJSON-1816668744-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1218870 Dec 21 03:44:21.549370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96594797-c4d9-49f5-8844-a3185c23f48e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.553216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96594797-c4d9-49f5-8844-a3185c23f48e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.557133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-96594797-c4d9-49f5-8844-a3185c23f48e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/443bb859-4613-44c4-81cf-16150a9fecf2 HTTP/1.1" status: 204 len: 168 time: 0.6778438 Dec 21 03:44:21.561525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 73ac0d75-dfb3-42a5-b9f8-10f70f27485a {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:21.582176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.591389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 272ba7b9-365d-4afd-bfd3-3be655599b4c no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:21.605422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96594797-c4d9-49f5-8844-a3185c23f48e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=443bb859-4613-44c4-81cf-16150a9fecf2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:21.643679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 272ba7b9-365d-4afd-bfd3-3be655599b4c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:21.655540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 272ba7b9-365d-4afd-bfd3-3be655599b4c not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:21.666469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Transition to ACTIVE for port object 73ac0d75-dfb3-42a5-b9f8-10f70f27485a will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:21.675611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-967a32d7-36aa-41c6-a92d-f41c511caae2 req-16771f5b-fbf5-4e2a-8657-f18ec89bd1d2 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1598225 Dec 21 03:44:21.739909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.782497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Router 96057fa7-9fcd-425e-9649-549b503668e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:44:21.810994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Pushing event updated for resources: {'Port': ['ID=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:21.839920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-7c37ec94-1b72-4ab7-b08b-135049f9805a req-aedf6e08-2e7e-4018-b28e-3357fd1de950 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:21.840887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c37ec94-1b72-4ab7-b08b-135049f9805a req-aedf6e08-2e7e-4018-b28e-3357fd1de950 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052412 Dec 21 03:44:21.905231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Attempting to bind port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:21.905850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Attempting to bind port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:21.905965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Attempting to bind port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:21.921690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:21.923411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Attempting to bind port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:21.938248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 43, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:21.940868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:21.941297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:21.941757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Bound port: 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:21.942129 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:21.958071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:21.966302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9b5e37f5-071f-4853-8a0c-58c48544efde admin admin] 10.222.0.18 "PUT /v2.0/routers/96057fa7-9fcd-425e-9649-549b503668e8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2865171 Dec 21 03:44:21.967190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42628) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:21.969151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] Sync routers for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:22.000144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:22.004474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:43:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:22.153985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] For port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:22.172580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] For port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:22.186179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229bf73a-250c-48ce-ae6e-e6bc01461f46 req-d57e8fa6-6b46-4a7a-9950-c131713b30c8 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:22.188269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-229bf73a-250c-48ce-ae6e-e6bc01461f46 req-d57e8fa6-6b46-4a7a-9950-c131713b30c8 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1097 time: 0.1167161 Dec 21 03:44:22.209476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.219241 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2489b8a3-d21d-49bb-beb6-37bdf11e6a5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.243925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-229bf73a-250c-48ce-ae6e-e6bc01461f46 req-0d4f1b9e-6c55-43ec-a003-b9c9c90efd0c tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485811 Dec 21 03:44:22.255200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:22.260879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.350243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:22.350243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.351701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] 10.222.0.54 "PUT /v2.0/ports/73ac0d75-dfb3-42a5-b9f8-10f70f27485a HTTP/1.1" status: 200 len: 1097 time: 1.5807765 Dec 21 03:44:22.363722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'tag': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:22.379375 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f" -d '{"events": [{"name": "network-changed", "server_uuid": "da547605-8361-4b87-abba-ced2c3fbaea0", "tag": "73ac0d75-dfb3-42a5-b9f8-10f70f27485a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:22.384492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.413616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb52dbb-c8fb-4009-a41b-f2521db82205 service neutron] Pushing event updated for resources: {'Port': ['ID=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:22.504703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.541418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b2a0cd-264e-438e-8894-acd63bc57cc4 req-15091cdc-7800-4acb-9817-77ebdb4d417b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:22.545282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5b2a0cd-264e-438e-8894-acd63bc57cc4 req-15091cdc-7800-4acb-9817-77ebdb4d417b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1067488 Dec 21 03:44:22.590897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42650) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:22.606840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76'}], 'enable_snat': True}, 'gw_port_id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:44:20Z', 'revision_number': 5, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port': {'id': '69582d3a-accd-497a-809a-ae3ddf602b75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:94:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96057fa7-9fcd-425e-9649-549b503668e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.76', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:39Z', 'updated_at': '2021-12-21T03:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:22.640209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d19c8dd1-d79f-4006-9ec4-9cfc067ceecd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.663812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] Checking router: 96057fa7-9fcd-425e-9649-549b503668e8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:22.679314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] Routers {'96057fa7-9fcd-425e-9649-549b503668e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:22.679945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['96057fa7-9fcd-425e-9649-549b503668e8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:22.702735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-65f27a65-b9ca-4386-948c-72fc037d8903 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:22.704233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-65f27a65-b9ca-4386-948c-72fc037d8903 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=95c8a6929b04466fbe843361793ffdf4&device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 1100 time: 0.1578739 Dec 21 03:44:22.725616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5b2a0cd-264e-438e-8894-acd63bc57cc4 req-0fe1c9ca-1511-4fc3-9e57-f5754cb8bc84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1568415 Dec 21 03:44:22.750458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d19c8dd1-d79f-4006-9ec4-9cfc067ceecd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.757735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Deleting port 69582d3a-accd-497a-809a-ae3ddf602b75 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:22.758080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.776122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-aaaf7472-0c61-4128-8b02-55368f57a506 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.147&port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a HTTP/1.1" status: 200 len: 217 time: 0.0559177 Dec 21 03:44:22.778797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20eacfdf-aa31-40b1-b5c0-fef0e036852d req-20fe779f-08f4-4dd9-a355-34d4f8eb02d5 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:22.780473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20eacfdf-aa31-40b1-b5c0-fef0e036852d req-20fe779f-08f4-4dd9-a355-34d4f8eb02d5 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1097 time: 0.1346679 Dec 21 03:44:22.781656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] Set router 96057fa7-9fcd-425e-9649-549b503668e8 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:22.845062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d19c8dd1-d79f-4006-9ec4-9cfc067ceecd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.852280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:44:22Z', 'revision_number': 6, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:22.864255 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04401889-415b-4e0b-b337-802e8d529967 x-openstack-request-id: req-04401889-415b-4e0b-b337-802e8d529967 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:22.864534 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "da547605-8361-4b87-abba-ced2c3fbaea0", "tag": "73ac0d75-dfb3-42a5-b9f8-10f70f27485a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:22.864798 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-04401889-415b-4e0b-b337-802e8d529967 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:22.865203 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'tag': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a', 'status': 'completed', 'code': 200} Dec 21 03:44:22.867593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20eacfdf-aa31-40b1-b5c0-fef0e036852d req-d314b064-88d7-4997-9aa7-df27de5ea173 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747044 Dec 21 03:44:22.907623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] For port 69582d3a-accd-497a-809a-ae3ddf602b75, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=69582d3a-accd-497a-809a-ae3ddf602b75,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:22.907988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:22.923490 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d19c8dd1-d79f-4006-9ec4-9cfc067ceecd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9b0c2be4f3ca44d2950d2a8c25758b2d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3256104 Dec 21 03:44:22.923650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1319fc2-0c08-49fc-a756-a828b85ccf6b None None] The sync data for ids ['96057fa7-9fcd-425e-9649-549b503668e8'] in n-d-822053-11 is: [{'id': '96057fa7-9fcd-425e-9649-549b503668e8', 'name': 'tempest-FloatingIPsAssociationTestJSON-1810363457-router', 'tenant_id': 'd3c7911e116e4170812afec94091929a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:38Z', 'updated_at': '2021-12-21T03:44:22Z', 'revision_number': 6, 'project_id': 'd3c7911e116e4170812afec94091929a', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:22.924584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:22.957203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e6d6c969-978c-483e-a180-a049a03c623a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:22.959525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-e6d6c969-978c-483e-a180-a049a03c623a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1757946 Dec 21 03:44:22.959782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19c8dd1-d79f-4006-9ec4-9cfc067ceecd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69337743-634d-41e2-bd2c-784b953a7af5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:22.963522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Calling delete_port for 69582d3a-accd-497a-809a-ae3ddf602b75 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:23.026255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02fdff12-8cf9-4c92-acc9-e6f6ee9cd313 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.065688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02fdff12-8cf9-4c92-acc9-e6f6ee9cd313 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.076310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a4c3bd-d18d-48c9-8b51-1087ef2f0316 req-8c88efa6-71ea-41de-bf41-0c353caceb8a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:23.077249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.079034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8a4c3bd-d18d-48c9-8b51-1087ef2f0316 req-8c88efa6-71ea-41de-bf41-0c353caceb8a tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 950 time: 0.1918490 Dec 21 03:44:23.108845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-a859ce42-c2d5-48a9-a8b0-842a96e623f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:23.110335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-a859ce42-c2d5-48a9-a8b0-842a96e623f8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1340933 Dec 21 03:44:23.145553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6931fb7d-fb01-4658-8b23-ae9b6d93d59f req-c1fb2571-1400-4ed9-98f5-26cfb4bf7bef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:23.147078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6931fb7d-fb01-4658-8b23-ae9b6d93d59f req-c1fb2571-1400-4ed9-98f5-26cfb4bf7bef tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 948 time: 0.1118112 Dec 21 03:44:23.193505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8a4c3bd-d18d-48c9-8b51-1087ef2f0316 req-f9fe6dfb-0607-4e33-9029-e3fd77089df1 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063056 Dec 21 03:44:23.221972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42666) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:23.229148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02fdff12-8cf9-4c92-acc9-e6f6ee9cd313 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.238832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02fdff12-8cf9-4c92-acc9-e6f6ee9cd313 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.238832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-02fdff12-8cf9-4c92-acc9-e6f6ee9cd313 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/69337743-634d-41e2-bd2c-784b953a7af5 HTTP/1.1" status: 204 len: 168 time: 0.3079638 Dec 21 03:44:23.242149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02fdff12-8cf9-4c92-acc9-e6f6ee9cd313 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69337743-634d-41e2-bd2c-784b953a7af5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:23.272383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6931fb7d-fb01-4658-8b23-ae9b6d93d59f req-c818bf00-acd6-4554-80ca-896387fc1450 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1127536 Dec 21 03:44:23.283350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.303360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-47280162-d293-4060-9850-15cb93fea0ea service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1838973 Dec 21 03:44:23.320665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Pushing event deleted for resources: {'Port': ['ID=69582d3a-accd-497a-809a-ae3ddf602b75,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:23.401950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.425952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-network', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:23.458601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9abdee05-c9bd-4274-9de1-92e10c55bdf3 req-39a1a739-e174-4729-a6d5-c8405cfec8d1 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1362057 Dec 21 03:44:23.542288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.545997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.619731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Made reservation on behalf of 6152d205cbf24532b57c0a62bd05450d for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:23.622669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.633141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.685153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.685721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 96057fa7-9fcd-425e-9649-549b503668e8 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:44:23.693320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.694489 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d3ec7b6c-20b3-4dde-a399-c2f1acf38107 admin admin] 10.222.0.18 "DELETE /v2.0/routers/96057fa7-9fcd-425e-9649-549b503668e8 HTTP/1.1" status: 204 len: 168 time: 1.7262323 Dec 21 03:44:23.698676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42682) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:23.708885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-664d02ea-a0ce-4cbd-b501-40fb5202ff7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:23.710377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-664d02ea-a0ce-4cbd-b501-40fb5202ff7f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=95c8a6929b04466fbe843361793ffdf4&device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 1100 time: 0.0564644 Dec 21 03:44:23.724743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.785757 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.827885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:44:23.847439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-bbf6b717-bd5c-41cf-ab61-c4b5089a077e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:23.847887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.848335 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Added segment af0f1c65-4b10-4991-bbab-e021be9d7624 of type vlan for network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 Dec 21 03:44:23.848946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-bbf6b717-bd5c-41cf-ab61-c4b5089a077e service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1173720 Dec 21 03:44:23.849994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9eab3df9-8a1c-4829-a64e-d0f01a0561ae,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:23.857131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Deleting subnet 8f347100-a6ac-44b8-b4d2-4439cc3e6889 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:44:23.863411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.909542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.941832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 69582d3a-accd-497a-809a-ae3ddf602b75 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:23.956945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-fed27f82-be5f-4499-b821-d249c42271c3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.147&port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a HTTP/1.1" status: 200 len: 217 time: 0.0561423 Dec 21 03:44:23.967087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 69582d3a-accd-497a-809a-ae3ddf602b75 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:23.967433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 69582d3a-accd-497a-809a-ae3ddf602b75 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:23.967856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7f63ca03-ada3-4c58-babe-357dcf805077 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:23.990222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.994685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7f63ca03-ada3-4c58-babe-357dcf805077 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:23.995062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7f63ca03-ada3-4c58-babe-357dcf805077 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:23.996910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:23.997949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:23.998540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.086597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] Pushing event updated for resources: {'Network': ['ID=7bc2df93-ed75-4ee4-81c6-f3b3411325a4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:24.103535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:44:24.104081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16671c8c-b63b-4f77-b448-2e6761ec7ac1 req-2dd2d97a-0556-4839-bd87-81b316d52123 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:24.111222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16671c8c-b63b-4f77-b448-2e6761ec7ac1 req-2dd2d97a-0556-4839-bd87-81b316d52123 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.2092791 Dec 21 03:44:24.128382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e09dfc2-72bd-4b94-b883-ee86ed574bb8 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 900 time: 0.9018331 Dec 21 03:44:24.128744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42698) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:24.134012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Request body: {'subnet': {'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-subnet', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:24.154138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-96a4976b-a07b-41c5-b15d-8080c57ad8e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:24.155757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-96a4976b-a07b-41c5-b15d-8080c57ad8e0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1832016 Dec 21 03:44:24.204706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.233568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Made reservation on behalf of 6152d205cbf24532b57c0a62bd05450d for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:24.237726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.304723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16671c8c-b63b-4f77-b448-2e6761ec7ac1 req-4635c06b-3d6f-48eb-9c4d-78f534ec581c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1920085 Dec 21 03:44:24.346757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d066c56e-25d7-4830-bab3-b08a811d589c req-9ec4bdef-7a71-4936-92a0-67eccc6bde54 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:24.348860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d066c56e-25d7-4830-bab3-b08a811d589c req-9ec4bdef-7a71-4936-92a0-67eccc6bde54 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.31 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 950 time: 0.2251775 Dec 21 03:44:24.485083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-d7577130-a458-405b-a819-6263eb763072 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:24.486492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-d7577130-a458-405b-a819-6263eb763072 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3066137 Dec 21 03:44:24.523015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.589458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bcc5cdc-c1c4-4803-bae1-e1639a06bc1d req-57b3923f-0b2c-4162-8261-c06d70e06409 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:24.590902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bcc5cdc-c1c4-4803-bae1-e1639a06bc1d req-57b3923f-0b2c-4162-8261-c06d70e06409 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 950 time: 0.1577799 Dec 21 03:44:24.604615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.608194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Deleting port 59042474-2f15-4ece-b823-a6a823f26939 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:24.608529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.611758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Checking segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:24.613411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Network hostable DHCP agents. Network: 7bc2df93-ed75-4ee4-81c6-f3b3411325a4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:44:24.617315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Pushing event updated for resources: {'Subnet': ['ID=8fae910f-1046-400a-b90e-c801ea409ae9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:24.665503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.682815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:44:24.691341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8f347100-a6ac-44b8-b4d2-4439cc3e6889,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:24.693433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.696611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0f52f87b-c990-4ad5-bf00-1a744bac76cb admin admin] 10.222.0.18 "DELETE /v2.0/subnets/8f347100-a6ac-44b8-b4d2-4439cc3e6889 HTTP/1.1" status: 204 len: 168 time: 0.9967017 Dec 21 03:44:24.697120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-133e4c60-ddb3-4a82-a087-4ae5d3c5ac3e None None] Network be2315d6-c735-4ecb-b299-a3b1405aa378 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:24.700242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42732) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:24.728105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-bf26fc18-fb93-4ee2-9c4b-6f856dc0d12b service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2307999 Dec 21 03:44:24.790600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7bc2df93-ed75-4ee4-81c6-f3b3411325a4) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:24.793819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bcc5cdc-c1c4-4803-bae1-e1639a06bc1d req-265eb0de-c921-458b-a9c0-80f77cc90f99 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1938908 Dec 21 03:44:24.799490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:24.799490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.810957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-108c0be1-4f6c-4500-ba80-9a1aee5b45a8 None None] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:24.811598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.849094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] For port 59042474-2f15-4ece-b823-a6a823f26939, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=59042474-2f15-4ece-b823-a6a823f26939,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:24.849456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.866742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Calling delete_port for 59042474-2f15-4ece-b823-a6a823f26939 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:24.879835 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f14a2e4e-4aed-424a-a292-851304fd8c7f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 863 time: 0.7501495 Dec 21 03:44:24.884673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42736) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:24.891473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:24.899145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0de3560-bc4a-4e3e-9fb6-9f9508c17c4f req-aaacabaf-df83-4423-9959-fe1d0d644a0e service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1620884 Dec 21 03:44:24.910969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] DHCP port deletion for be2315d6-c735-4ecb-b299-a3b1405aa378 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:44:24.931473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Deleting port 000d5819-ddfc-432d-9f39-d6627ebcbc60 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:24.931873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.996034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:24.997470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.006036 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.023424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] For port 000d5819-ddfc-432d-9f39-d6627ebcbc60, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=000d5819-ddfc-432d-9f39-d6627ebcbc60,segment=NetworkSegment(615ceb9a-cc82-4e2a-8669-b83fa9d4dd24),segment_id=615ceb9a-cc82-4e2a-8669-b83fa9d4dd24)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:25.025748 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.043267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Calling delete_port for 000d5819-ddfc-432d-9f39-d6627ebcbc60 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:25.071769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b58cf9d-2f97-4f57-9430-7711e091029f req-3d7e8358-9f17-4014-9284-2ca6c44f4d1b tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:25.073659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b58cf9d-2f97-4f57-9430-7711e091029f req-3d7e8358-9f17-4014-9284-2ca6c44f4d1b tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 948 time: 0.0884042 Dec 21 03:44:25.130555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b58cf9d-2f97-4f57-9430-7711e091029f req-579a127e-a0a9-42ba-b770-5ae4f86267dd tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476031 Dec 21 03:44:25.132017 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.165260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Pushing event deleted for resources: {'Port': ['ID=59042474-2f15-4ece-b823-a6a823f26939,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:25.177332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['59042474-2f15-4ece-b823-a6a823f26939'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:25.179705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:25.186647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.208775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] No DVR routers for this DVR port 59042474-2f15-4ece-b823-a6a823f26939 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:25.211407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.215336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d066c56e-25d7-4830-bab3-b08a811d589c req-707508b7-612f-4d71-a2d7-9ecbf2842074 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.31 "DELETE /v2.0/ports/59042474-2f15-4ece-b823-a6a823f26939 HTTP/1.1" status: 204 len: 173 time: 0.8496511 Dec 21 03:44:25.215803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f14c723c-76d3-45ed-874b-833d6d130856', 'name': 'network-vif-deleted', 'tag': '59042474-2f15-4ece-b823-a6a823f26939'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:25.218083 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fe0c264-c3d7-46bb-aa06-bebf552ce6f2" -d '{"events": [{"server_uuid": "f14c723c-76d3-45ed-874b-833d6d130856", "name": "network-vif-deleted", "tag": "59042474-2f15-4ece-b823-a6a823f26939"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:25.239354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:44:25.240420 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.268017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Pushing event deleted for resources: {'Port': ['ID=000d5819-ddfc-432d-9f39-d6627ebcbc60,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:25.276375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Deleting port 000d5819-ddfc-432d-9f39-d6627ebcbc60 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:25.277015 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.289724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] No DVR routers for this DVR port 000d5819-ddfc-432d-9f39-d6627ebcbc60 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:25.407592 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.433599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['be2315d6-c735-4ecb-b299-a3b1405aa378']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:25.445273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:25.445880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '615ceb9a-cc82-4e2a-8669-b83fa9d4dd24') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:25.463864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.478515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] For port 000d5819-ddfc-432d-9f39-d6627ebcbc60, host n-d-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:25.479171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.480893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.491339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:44:25.491933 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:44:25.503326 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:44:25.509134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.545766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Calling delete_port for 000d5819-ddfc-432d-9f39-d6627ebcbc60 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:25.554231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.ipam_backend_mixin [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Port 000d5819-ddfc-432d-9f39-d6627ebcbc60 was not found and therefore no delete operation was performed {{(pid=110312) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 03:44:25.578820 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.578989 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-405bc3ab-655c-45cf-b563-16f317ce0f45 x-openstack-request-id: req-405bc3ab-655c-45cf-b563-16f317ce0f45 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:25.578989 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f14c723c-76d3-45ed-874b-833d6d130856", "name": "network-vif-deleted", "tag": "59042474-2f15-4ece-b823-a6a823f26939", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:25.578989 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-405bc3ab-655c-45cf-b563-16f317ce0f45 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:25.578989 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f14c723c-76d3-45ed-874b-833d6d130856', 'name': 'network-vif-deleted', 'tag': '59042474-2f15-4ece-b823-a6a823f26939', 'status': 'completed', 'code': 200} Dec 21 03:44:25.614343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] Pushing event deleted for resources: {'Port': ['ID=000d5819-ddfc-432d-9f39-d6627ebcbc60,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:25.636749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Allocated IP 172.20.0.2 (7bc2df93-ed75-4ee4-81c6-f3b3411325a4/8fae910f-1046-400a-b90e-c801ea409ae9/8571756f-471a-43a3-bf9d-513d598638a9) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:25.639414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fef084c0-b364-4cff-81cb-18bfbaa72204 None None] No DVR routers for this DVR port 000d5819-ddfc-432d-9f39-d6627ebcbc60 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:25.668825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.677161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.683194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.692048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] 10.222.0.18 "DELETE /v2.0/networks/be2315d6-c735-4ecb-b299-a3b1405aa378 HTTP/1.1" status: 204 len: 168 time: 0.9827933 Dec 21 03:44:25.730418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f68988c-7329-463a-a70a-a69960eb8bf2 req-b175f45c-ca37-4e08-af6f-c0d1898092c0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:25.739175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f68988c-7329-463a-a70a-a69960eb8bf2 req-b175f45c-ca37-4e08-af6f-c0d1898092c0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0942116 Dec 21 03:44:25.780846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44c0762-05ff-4bcd-9a96-e0f97a3f052f admin admin] Pushing event deleted for resources: {'Network': ['ID=be2315d6-c735-4ecb-b299-a3b1405aa378,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:25.788471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.819961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f68988c-7329-463a-a70a-a69960eb8bf2 req-9467da54-38af-4729-87ea-5b010ee25590 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772672 Dec 21 03:44:25.821672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 000d5819-ddfc-432d-9f39-d6627ebcbc60 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:25.880174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 000d5819-ddfc-432d-9f39-d6627ebcbc60 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:25.880534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 000d5819-ddfc-432d-9f39-d6627ebcbc60 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:25.913104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.981882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:25.991599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d30842a-70fd-47ac-851c-46f2d01ce34e req-d659c525-b1a6-48ed-a772-fcebfcd4af2f tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=f14c723c-76d3-45ed-874b-833d6d130856 HTTP/1.1" status: 200 len: 210 time: 0.0313764 Dec 21 03:44:26.048775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:26.052078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:26.055330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:26.097072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Pushing event updated for resources: {'Port': ['ID=8571756f-471a-43a3-bf9d-513d598638a9,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:26.130337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Attempting to bind port 8571756f-471a-43a3-bf9d-513d598638a9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:26.130896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Attempting to bind port 8571756f-471a-43a3-bf9d-513d598638a9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:26.131447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Attempting to bind port 8571756f-471a-43a3-bf9d-513d598638a9 on network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:26.137837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:26.154459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Checking segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:26.154459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.154459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Bound using segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:26.154459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Bound port: 8571756f-471a-43a3-bf9d-513d598638a9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:26.154459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.155083 n-d-822053-11 neutron-server[110311]: WARNING keystonemiddleware.auth_token [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-c9b04aa8-15bb-4438-be70-d5272cd1b038 service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 21 03:44:26.161572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-27ce54cc-eb0c-4838-b71b-94ace3dd5baa tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:26.162567 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-27ce54cc-eb0c-4838-b71b-94ace3dd5baa tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2162771 Dec 21 03:44:26.168363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.223713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.236427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42774) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:26.243150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] For port 8571756f-471a-43a3-bf9d-513d598638a9, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:26.247531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] For port 8571756f-471a-43a3-bf9d-513d598638a9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8571756f-471a-43a3-bf9d-513d598638a9,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:26.280753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-e03a2160-f556-4000-8d61-9b7a11604dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:26.282264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-e03a2160-f556-4000-8d61-9b7a11604dc9 service neutron] 10.222.0.18 "GET /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 1094 time: 0.1118662 Dec 21 03:44:26.296667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:26.297128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Unknown quota resources ['binding']. {{(pid=110311) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:44:26.311933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.316617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ef61e7a5-d8b3-4417-b023-06826e783541 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d3c7911e116e4170812afec94091929a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0790031 Dec 21 03:44:26.319197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42776) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:26.343239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb34819-0f99-4cd5-9a16-a057bc023e3d req-d2446030-6cbc-405a-b96a-40ae69aa89cd tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:26.345319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fb34819-0f99-4cd5-9a16-a057bc023e3d req-d2446030-6cbc-405a-b96a-40ae69aa89cd tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 948 time: 0.0841548 Dec 21 03:44:26.404314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1359ba37-9f55-416b-9048-f9da17ded831 None None] Pushing event updated for resources: {'Port': ['ID=8571756f-471a-43a3-bf9d-513d598638a9,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:26.412028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Allocated IP 172.25.5.235 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:26.429475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b093963-5f23-4866-a3f8-4ee0406a0d0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.446638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fb34819-0f99-4cd5-9a16-a057bc023e3d req-6d392c97-06aa-467f-9968-32aca8587e3c tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759764 Dec 21 03:44:26.460394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b093963-5f23-4866-a3f8-4ee0406a0d0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.581635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:26.581984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:26.582323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:26.596320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:26.596823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:26.617745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b093963-5f23-4866-a3f8-4ee0406a0d0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.630582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b093963-5f23-4866-a3f8-4ee0406a0d0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.634596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8b093963-5f23-4866-a3f8-4ee0406a0d0c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/40e14095-76ef-4df5-a8c5-063f87511c10 HTTP/1.1" status: 204 len: 168 time: 0.3142180 Dec 21 03:44:26.638479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.643382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b093963-5f23-4866-a3f8-4ee0406a0d0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40e14095-76ef-4df5-a8c5-063f87511c10,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:26.652478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:26.652833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:26.653230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:26.653678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Bound port: c312fda9-2565-4637-8907-d38449a7ab27, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:26.766170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:26.831914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.875036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:26.882355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:26.883612 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c2abf04d-3732-471e-b433-b7551f5a9800 service neutron] 10.222.0.18 "POST /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27/bindings HTTP/1.1" status: 201 len: 390 time: 0.5927088 Dec 21 03:44:26.887836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:26.890820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:26.895629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Pushing event updated for resources: {'Port': ['ID=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:27.286235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b34002b-4c98-41fe-b717-e967a4734339 req-7ba08a1f-2aea-4812-afbd-a0f219d99a84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:27.289036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b34002b-4c98-41fe-b717-e967a4734339 req-7ba08a1f-2aea-4812-afbd-a0f219d99a84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.3782773 Dec 21 03:44:27.349640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 73ac0d75-dfb3-42a5-b9f8-10f70f27485a details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:27.418992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b34002b-4c98-41fe-b717-e967a4734339 req-687051dc-ba93-4f5f-aa1c-3bbb2fd3a966 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113036 Dec 21 03:44:27.484115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:27.499088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a', 'mac_address': 'fa:16:3e:dd:e4:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.147'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:27.516229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca9ebcd-c8df-40ab-beb6-c467c5a7ab81 req-0649b3ed-26bb-4999-9579-4e180a8bbc71 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:27.517942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ca9ebcd-c8df-40ab-beb6-c467c5a7ab81 req-0649b3ed-26bb-4999-9579-4e180a8bbc71 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.1413255 Dec 21 03:44:27.581662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:27.614023 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:27.621305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 73ac0d75-dfb3-42a5-b9f8-10f70f27485a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:27.638008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 59042474-2f15-4ece-b823-a6a823f26939 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:27.685601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ca9ebcd-c8df-40ab-beb6-c467c5a7ab81 req-1659d793-a67b-4e74-8678-d7eb5ee44c20 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1556296 Dec 21 03:44:27.688889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-8ac8c10a-1c07-4bcf-bd00-5c8f90fc3dc4 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1024034 Dec 21 03:44:27.693556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1cab688-7bf0-44e0-aebd-9d0dabc5166f None None] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:27.697105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-9a6dc9c3-70c6-4445-8c33-d7d74f5f9a63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:27.699276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-9a6dc9c3-70c6-4445-8c33-d7d74f5f9a63 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1097 time: 0.1798651 Dec 21 03:44:27.702117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:27.763825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 59042474-2f15-4ece-b823-a6a823f26939 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:27.764053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 59042474-2f15-4ece-b823-a6a823f26939 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:27.796397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:27.909691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:27.914568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8571756f-471a-43a3-bf9d-513d598638a9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:27.947790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c68b7834-15d4-4c4c-9ca6-5022d88b23fe None None] Provisioning complete for port 8571756f-471a-43a3-bf9d-513d598638a9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:27.948172 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c68b7834-15d4-4c4c-9ca6-5022d88b23fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:27.992020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-cb440f84-1344-43c3-8779-ca057c3f7ffb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:27.993792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-cb440f84-1344-43c3-8779-ca057c3f7ffb service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.2669435 Dec 21 03:44:28.038020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41856daf-a1c7-4119-a84a-e6e8db59eb4b req-e50e0e1e-659a-4a63-a084-f62cdc3413eb tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:28.040194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41856daf-a1c7-4119-a84a-e6e8db59eb4b req-e50e0e1e-659a-4a63-a084-f62cdc3413eb tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 949 time: 0.1343980 Dec 21 03:44:28.043285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:28.076099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.076432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.076757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.077091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.077418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.077742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.078066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.078395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.078705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.079072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.079399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.079713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.080034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:28.087478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-ca65686d-143a-463b-9006-14436b3262d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:28.089655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-ca65686d-143a-463b-9006-14436b3262d3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 1120 time: 0.1821966 Dec 21 03:44:28.107403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-c90e268b-cc8a-4ead-9b50-2b493073eba3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.0929418 Dec 21 03:44:28.209340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c68b7834-15d4-4c4c-9ca6-5022d88b23fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.213513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['73ac0d75-dfb3-42a5-b9f8-10f70f27485a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:28.225310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42838) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:28.235889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:44:28.257217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-6f1b3033-6eac-4ee2-bb69-43027a48dd96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:28.261096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-6f1b3033-6eac-4ee2-bb69-43027a48dd96 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1355238 Dec 21 03:44:28.349501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-657712a5-f203-413d-83b0-db148323c803 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273495 Dec 21 03:44:28.354027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8571756f-471a-43a3-bf9d-513d598638a9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:28.355685 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.426724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsTestJSON-383730547-network', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:28.456312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c68b7834-15d4-4c4c-9ca6-5022d88b23fe None None] For port 8571756f-471a-43a3-bf9d-513d598638a9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8571756f-471a-43a3-bf9d-513d598638a9,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:28.457467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:28.474464 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Sync routers for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:28.484806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:28.485826 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:28.534826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.568863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c68b7834-15d4-4c4c-9ca6-5022d88b23fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.571219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c25af32-5c35-46b1-a477-ebe78643053d req-6e038012-636f-48cc-bcb5-772a7b4fbe1e tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:28.578450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c25af32-5c35-46b1-a477-ebe78643053d req-6e038012-636f-48cc-bcb5-772a7b4fbe1e tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 949 time: 0.3162167 Dec 21 03:44:28.588730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41856daf-a1c7-4119-a84a-e6e8db59eb4b req-75109aff-3455-498e-9eea-c533bb95d1c3 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4978378 Dec 21 03:44:28.620686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Made reservation on behalf of 7abd8149eaa64d9f94b2460800f5436e for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:28.629002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.639407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-aecc1a3f-8e61-49a6-b0de-adeb21514d11 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2704258 Dec 21 03:44:28.647731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-a5e547a4-c6e8-4d84-8d1a-23e4c704d169 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:28.649408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-a5e547a4-c6e8-4d84-8d1a-23e4c704d169 service neutron] 10.222.0.54 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 925 time: 0.3366613 Dec 21 03:44:28.670178 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:28.672512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.674300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c68b7834-15d4-4c4c-9ca6-5022d88b23fe None None] Pushing event updated for resources: {'Port': ['ID=8571756f-471a-43a3-bf9d-513d598638a9,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:28.689076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:44:28.689965 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:44:28.693324 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0406ae50-cf05-41c4-9814-2786652b5b85 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 939 time: 3.8055918 Dec 21 03:44:28.699148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42846) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:28.701807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-28c5ed6d-d6f0-479f-b9f7-d63d49fe6996 None None] Provisioning complete for port 8571756f-471a-43a3-bf9d-513d598638a9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:28.702181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-28c5ed6d-d6f0-479f-b9f7-d63d49fe6996 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.706531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:28.827290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c25af32-5c35-46b1-a477-ebe78643053d req-afaed9aa-f591-4b83-ac8f-153d5b2c2b4e tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2479429 Dec 21 03:44:28.873842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42850) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:28.886691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-60ae9aeb-03f0-44de-9c84-a71c4ef513e9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3879ae01-e336-4975-a479-fdaef03236a1 HTTP/1.1" status: 200 len: 1023 time: 0.2228355 Dec 21 03:44:28.939110 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:27Z', 'revision_number': 3, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:28.975631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Checking router: 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:28.976162 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Updating router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:44:28.994869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07d2a9b-1b89-469a-b9c1-ce58fc7c79b2 req-1f2539bb-0a63-45e3-8db2-ffd5739269c9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.002693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b07d2a9b-1b89-469a-b9c1-ce58fc7c79b2 req-1f2539bb-0a63-45e3-8db2-ffd5739269c9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.2306705 Dec 21 03:44:29.009827 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.034362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.046779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.058788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-97f75474-b86d-412a-a484-c8ba26357c02 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4084470 Dec 21 03:44:29.076129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-f8a749e1-6eef-418b-a28c-8ca11b85723b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.077600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-f8a749e1-6eef-418b-a28c-8ca11b85723b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.1819127 Dec 21 03:44:29.089917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.100962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ce7e62-15e6-4edb-b202-1af692a0cac7 req-c7d92da5-eccd-4e8c-b088-faae65e13df8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.102322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88ce7e62-15e6-4edb-b202-1af692a0cac7 req-c7d92da5-eccd-4e8c-b088-faae65e13df8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.1676817 Dec 21 03:44:29.128180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:44:29.155057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b07d2a9b-1b89-469a-b9c1-ce58fc7c79b2 req-f0abaeef-c0b2-4558-bf27-3c07e6bdc0a0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1429842 Dec 21 03:44:29.210013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.210371 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Added segment e6446f0e-d962-4cdb-b5e0-527bd0f210fc of type vlan for network d818b5e2-0d66-470d-b08f-ad7d366af0b0 Dec 21 03:44:29.229418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be57f0f3-1d0e-4349-b56e-fee4f9306eb9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:29.245392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88ce7e62-15e6-4edb-b202-1af692a0cac7 req-318cb0ed-eea5-4fdd-a2f1-a457ba8637a4 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1270571 Dec 21 03:44:29.260813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-83b338ed-406c-4119-9dd1-173058a27d2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.262338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-83b338ed-406c-4119-9dd1-173058a27d2f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1721516 Dec 21 03:44:29.277459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.277836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.278158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.278491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.278845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.279189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.279523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.279853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.280182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.281072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.281426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.281759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.282385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.308994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.320460 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.326397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.355031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 73ac0d75-dfb3-42a5-b9f8-10f70f27485a up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:29.366670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.380034 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.410469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a65e72a3-d5ba-4ef2-a468-bc34fef6419e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:29.421403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.421746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.422083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.422433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.422749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.426484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.445899 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Attempting to bind port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:29.446565 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Attempting to bind port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:29.447115 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Attempting to bind port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:29.450712 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Pushing event updated for resources: {'Port': ['ID=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:29.460952 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:29.461810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:29.462505 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.463087 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:29.463815 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Bound port: 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:29.464519 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.467409 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.467750 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.468248 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.468741 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.469080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.469417 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.469743 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.470219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.471239 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.471724 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.471853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.472431 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.472881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.473056 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.473280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:44:29.473537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.473839 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:44:29.480577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:29.482011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.531707 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] For port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:29.536878 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] For port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:29.543226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8169c210-337e-4184-aa13-6d8576755b56 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b2d2f9876f324c1ca702174922cc174a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6672232 Dec 21 03:44:29.546081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42856) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:29.548550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] Pushing event updated for resources: {'Network': ['ID=d818b5e2-0d66-470d-b08f-ad7d366af0b0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:29.561656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:44:29.569608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.580667 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.622005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-fccb2f31-8628-43cc-9e44-21ed385e2906 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.623549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-fccb2f31-8628-43cc-9e44-21ed385e2906 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.1783102 Dec 21 03:44:29.628906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-beacf2be-dc26-409d-81b1-953b13bdd3d6 service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2813852 Dec 21 03:44:29.634618 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9fd3e0d9-1e88-429e-9ff0-ef354360e0bd admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.4076974 Dec 21 03:44:29.636522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42860) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:29.657871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Request body: {'subnet': {'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsTestJSON-383730547-subnet', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:29.670434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:29.671484 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:29.675152 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe415db4-68f8-431c-a456-0c4ecda3b14b None None] Pushing event updated for resources: {'Port': ['ID=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:29.675522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:29.727263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-2d372de0-3d41-4806-8a34-3b259bb06d33 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:29.732230 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-2d372de0-3d41-4806-8a34-3b259bb06d33 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.54 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 949 time: 0.1389182 Dec 21 03:44:29.749690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.792133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d9e461d-4342-4a99-b974-86aa3a1f9bb9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.802289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:29.804652 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2652786c-5f84-42cc-937c-b484bb9e9f23" -d '{"events": [{"server_uuid": "da547605-8361-4b87-abba-ced2c3fbaea0", "name": "network-vif-plugged", "status": "completed", "tag": "73ac0d75-dfb3-42a5-b9f8-10f70f27485a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:29.825781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8571756f-471a-43a3-bf9d-513d598638a9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:29.833201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d9e461d-4342-4a99-b974-86aa3a1f9bb9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.869955 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:29.883378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:29.916644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:29.926357 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d141457-60e8-47cf-95f4-a5c158a9dc49 x-openstack-request-id: req-2d141457-60e8-47cf-95f4-a5c158a9dc49 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:29.926686 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "da547605-8361-4b87-abba-ced2c3fbaea0", "name": "network-vif-plugged", "status": "completed", "tag": "73ac0d75-dfb3-42a5-b9f8-10f70f27485a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:29.927427 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2d141457-60e8-47cf-95f4-a5c158a9dc49 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:29.927863 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a', 'code': 200} Dec 21 03:44:29.984397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.54', 58390) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:29.993521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8571756f-471a-43a3-bf9d-513d598638a9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:29.993903 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.001250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Deleting port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:30.001640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.012759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052ac2a8-60a9-4ee7-a4c4-add15c94cb88 req-036062a4-5bc3-4772-8a79-67135d32937b tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:30.015501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-052ac2a8-60a9-4ee7-a4c4-add15c94cb88 req-036062a4-5bc3-4772-8a79-67135d32937b tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 949 time: 0.2871733 Dec 21 03:44:30.023754 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.078532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Made reservation on behalf of 7abd8149eaa64d9f94b2460800f5436e for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:30.081787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.097094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:30.107581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] For port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:30.108162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.125070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078fb478-6ef5-4870-888d-4f8b87862dd4 req-c4a856fd-e12c-469d-b79d-5a1b4e55c51b service neutron] 10.222.0.54 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4710884 Dec 21 03:44:30.148204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Calling delete_port for ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:30.180269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Allocated IP 172.20.0.1 (7bc2df93-ed75-4ee4-81c6-f3b3411325a4/8fae910f-1046-400a-b90e-c801ea409ae9/e99106f7-f780-4fbe-8b19-7d63d11935cd) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:30.200128 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d9e461d-4342-4a99-b974-86aa3a1f9bb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.202655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d9e461d-4342-4a99-b974-86aa3a1f9bb9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.203791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5d9e461d-4342-4a99-b974-86aa3a1f9bb9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a65e72a3-d5ba-4ef2-a468-bc34fef6419e HTTP/1.1" status: 204 len: 168 time: 0.6568282 Dec 21 03:44:30.235694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484b18ac-aefb-4e04-8990-0ab3d50b6d77 req-478afb39-2cf5-4270-87da-c39251569872 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:30.237476 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-484b18ac-aefb-4e04-8990-0ab3d50b6d77 req-478afb39-2cf5-4270-87da-c39251569872 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 1102 time: 0.1196876 Dec 21 03:44:30.263573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d9e461d-4342-4a99-b974-86aa3a1f9bb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a65e72a3-d5ba-4ef2-a468-bc34fef6419e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:30.274575 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:27Z', 'revision_number': 3, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:30.326585 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65c25d9-c639-47b1-a70d-b70093ab024b None None] The sync data for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 is: [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:27Z', 'revision_number': 3, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:30.331302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-052ac2a8-60a9-4ee7-a4c4-add15c94cb88 req-e2775e69-373c-4b71-aa65-53fb1168f60e tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2513781 Dec 21 03:44:30.345073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2f43ec-997a-4a02-a705-cca2e4493391 req-00ae1c2d-58d8-4217-ab89-6571385b6625 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:30.352716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a2f43ec-997a-4a02-a705-cca2e4493391 req-00ae1c2d-58d8-4217-ab89-6571385b6625 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 949 time: 0.2846808 Dec 21 03:44:30.363894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:30.459348 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-484b18ac-aefb-4e04-8990-0ab3d50b6d77 req-b52830ed-a2c4-4753-8066-7b20254afc7d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1569543 Dec 21 03:44:30.500392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a2f43ec-997a-4a02-a705-cca2e4493391 req-1ad6859e-c896-4a17-9db7-8fc9847967d4 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/security-groups?id=722fdac3-6a9b-4ced-a2f9-99c599556be3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1468110 Dec 21 03:44:30.522161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:30.571309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.580115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc8869a-3cee-4c9e-b212-00799b429425 req-7b7adb91-e181-4bef-9279-0751c3b69cd6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:30.581665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adc8869a-3cee-4c9e-b212-00799b429425 req-7b7adb91-e181-4bef-9279-0751c3b69cd6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1556988 Dec 21 03:44:30.587932 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.620188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:30.630101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Pushing event deleted for resources: {'Port': ['ID=ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:30.644910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:30.647195 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abb8500b-c093-431d-b4ab-8f9791f99955" -d '{"events": [{"server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "name": "network-vif-unplugged", "status": "completed", "tag": "c312fda9-2565-4637-8907-d38449a7ab27"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:30.653778 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.695672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] No DVR routers for this DVR port ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:30.699529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.703122 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-740c64cf-6c13-4934-a433-c7696a4b8073 req-1e332fe5-de55-4b3f-aa23-8fae5cdb9784 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.54 "DELETE /v2.0/ports/ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 HTTP/1.1" status: 204 len: 173 time: 0.9620700 Dec 21 03:44:30.703585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'name': 'network-vif-deleted', 'tag': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:30.706510 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4fa9e5f5-c04a-4d26-9708-56ddff404a73" -d '{"events": [{"server_uuid": "3bca8311-21bf-44dc-8d3c-944816c0ff92", "name": "network-vif-deleted", "tag": "ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:30.751731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adc8869a-3cee-4c9e-b212-00799b429425 req-43e27ba9-859b-4cc6-9db0-9b70df354e18 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1529803 Dec 21 03:44:30.754619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.756643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:30.765697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd0c57c-f97e-4d85-9e8b-f441aa87a4a3 req-fcf372e2-929c-4110-bfde-61ccf75f85e3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:30.767261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fd0c57c-f97e-4d85-9e8b-f441aa87a4a3 req-fcf372e2-929c-4110-bfde-61ccf75f85e3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 945 time: 0.1797955 Dec 21 03:44:30.815967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.213511 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8ee0a85-d133-4491-8f88-2bd080fd02b2 x-openstack-request-id: req-d8ee0a85-d133-4491-8f88-2bd080fd02b2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:31.213739 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "name": "network-vif-unplugged", "status": "completed", "tag": "c312fda9-2565-4637-8907-d38449a7ab27", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:31.215634 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d8ee0a85-d133-4491-8f88-2bd080fd02b2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:31.215634 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27', 'code': 200} Dec 21 03:44:31.227703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=72829a15-a3e7-4f70-8cd0-2cbaf77976b3,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:31.248239 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e1f23e2-38ba-4ac3-b357-1f936dc03db5 x-openstack-request-id: req-8e1f23e2-38ba-4ac3-b357-1f936dc03db5 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:31.248818 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3bca8311-21bf-44dc-8d3c-944816c0ff92", "name": "network-vif-deleted", "tag": "ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:31.248818 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8e1f23e2-38ba-4ac3-b357-1f936dc03db5 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:31.249172 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3bca8311-21bf-44dc-8d3c-944816c0ff92', 'name': 'network-vif-deleted', 'tag': 'ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440', 'status': 'completed', 'code': 200} Dec 21 03:44:31.282542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:31.282542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Pushing event updated for resources: {'Port': ['ID=e99106f7-f780-4fbe-8b19-7d63d11935cd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:31.284967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:31.287682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:31.339655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.341389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:31.359057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:31.359776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:31.360582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:31.380983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fd0c57c-f97e-4d85-9e8b-f441aa87a4a3 req-a80305f2-317b-4077-96ee-682e65b12cc9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5891731 Dec 21 03:44:31.387822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Checking segment: {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:31.407331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Network hostable DHCP agents. Network: d818b5e2-0d66-470d-b08f-ad7d366af0b0, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:44:31.407331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:31.407331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Attempting to bind port c312fda9-2565-4637-8907-d38449a7ab27 on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:31.418406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:31.431930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:31.431930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:31.432745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Bound port: c312fda9-2565-4637-8907-d38449a7ab27, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:31.432939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.524920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:44:31.548302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.637460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:31.649630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:31.667222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f0c6b4-9bc9-4323-8e22-2e26c805919f req-392c9462-ba26-437a-b43a-7fdfb9ef0bf1 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:31.675320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12f0c6b4-9bc9-4323-8e22-2e26c805919f req-392c9462-ba26-437a-b43a-7fdfb9ef0bf1 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 950 time: 0.1945088 Dec 21 03:44:31.684773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d818b5e2-0d66-470d-b08f-ad7d366af0b0) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:31.693913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69b20f6e-5066-4362-9b4b-6e293794f759 None None] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:31.721519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:31.722201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.726429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5edf2e5a-d28b-40ef-a305-1f13c1e181ac req-b4393953-141c-4ddd-aa8f-6d3f1e865b27 tempest-ServersAdminNegativeTestJSON-1273459801 tempest-ServersAdminNegativeTestJSON-1273459801-project] 10.222.0.18 "GET /v2.0/ports?device_id=3bca8311-21bf-44dc-8d3c-944816c0ff92 HTTP/1.1" status: 200 len: 210 time: 0.0863733 Dec 21 03:44:31.734605 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.859515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.903104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:31.917439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12f0c6b4-9bc9-4323-8e22-2e26c805919f req-5a51dfcb-216a-487f-8dfb-69aa770e7806 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2368116 Dec 21 03:44:31.923284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-de309570-d7dd-435e-b936-a6a3d58cdb98 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 2.2822876 Dec 21 03:44:31.927598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42906) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:31.938616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:31.985189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d818b5e2-0d66-470d-b08f-ad7d366af0b0', 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0', 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'fixed_ips': [{'subnet_id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:44:31.985395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=8']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:31.985483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.990782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:31.991514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:31.992909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d3f864a8-eb28-47ac-a77d-b832a5fff5ed service neutron] 10.222.0.54 "PUT /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 1123 time: 2.3401926 Dec 21 03:44:31.998925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.016369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efeed1ca-3299-4349-b273-92a78cea217e req-e948c755-3e6a-4b5b-bb8a-5a19b924a181 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:32.017942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efeed1ca-3299-4349-b273-92a78cea217e req-e948c755-3e6a-4b5b-bb8a-5a19b924a181 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1329827 Dec 21 03:44:32.025176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-807a7458-5e8c-4af1-96b9-0d54a9afad11 None None] Provisioning complete for port e99106f7-f780-4fbe-8b19-7d63d11935cd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:32.025551 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-807a7458-5e8c-4af1-96b9-0d54a9afad11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.088010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Pushing event updated for resources: {'Port': ['ID=e99106f7-f780-4fbe-8b19-7d63d11935cd,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:32.093595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efeed1ca-3299-4349-b273-92a78cea217e req-45d5d8d1-9043-447f-83a4-63249e5017b9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655208 Dec 21 03:44:32.101374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.102507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.139916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.216010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.263339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['c312fda9-2565-4637-8907-d38449a7ab27'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:32.286524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:32.290684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:32.311138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-807a7458-5e8c-4af1-96b9-0d54a9afad11 None None] Port e99106f7-f780-4fbe-8b19-7d63d11935cd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:32.344332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:32.344711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.416935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Allocated IP 172.20.0.2 (d818b5e2-0d66-470d-b08f-ad7d366af0b0/72829a15-a3e7-4f70-8cd0-2cbaf77976b3/3ca5d939-c5fe-495d-b18d-625cac1cb678) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:32.561761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.630835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:44:32.643383 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-b226178d-e7d1-476b-9346-9989e9d34044 service neutron] show failed (client error): The resource could not be found. Dec 21 03:44:32.646635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-b226178d-e7d1-476b-9346-9989e9d34044 service neutron] 10.222.0.54 "GET /v2.0/ports/54f03f61-5bac-4c58-8af3-224512e89641/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.1787786 Dec 21 03:44:32.661478 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.680936 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:32.683694 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:32.692866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac41d9a-d9f7-41f5-b0ac-c09c68ddb799 req-20dea6dd-453f-43ae-81ac-1ea51f1fe473 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:32.706355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ac41d9a-d9f7-41f5-b0ac-c09c68ddb799 req-20dea6dd-453f-43ae-81ac-1ea51f1fe473 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.1393559 Dec 21 03:44:32.712659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:32.780012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.821138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bbea5c08-6d6a-49f2-99f1-92e46344a749 None None] Provisioning complete for port e99106f7-f780-4fbe-8b19-7d63d11935cd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:32.821342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bbea5c08-6d6a-49f2-99f1-92e46344a749 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.829860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ac41d9a-d9f7-41f5-b0ac-c09c68ddb799 req-e3a67ad0-1d37-472b-8061-34625febb793 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1269064 Dec 21 03:44:32.862386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.915488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:32.918066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:32.920762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bbea5c08-6d6a-49f2-99f1-92e46344a749 None None] Port e99106f7-f780-4fbe-8b19-7d63d11935cd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:32.924891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b6e5171-c62c-42af-bef6-67cb57dada25 admin admin] 10.222.0.18 "PUT /v2.0/routers/5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2246420 Dec 21 03:44:32.942466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:32.985794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:32.988770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:32.992316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:32.999736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Pushing event updated for resources: {'Port': ['ID=3ca5d939-c5fe-495d-b18d-625cac1cb678,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:33.032626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Sync routers for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:33.068212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Attempting to bind port 3ca5d939-c5fe-495d-b18d-625cac1cb678 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:33.068593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Attempting to bind port 3ca5d939-c5fe-495d-b18d-625cac1cb678 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:33.068962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Attempting to bind port 3ca5d939-c5fe-495d-b18d-625cac1cb678 on network d818b5e2-0d66-470d-b08f-ad7d366af0b0 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:33.086090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:33.086483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Checking segment: {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:33.086894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.087319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Bound using segment: {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:33.087802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Bound port: 3ca5d939-c5fe-495d-b18d-625cac1cb678, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:33.088190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.093958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:33.094600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:33.096420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0dd0c5-d157-4284-b511-29f2ea06877a req-ae85532a-af9d-48bf-8b38-8f3e374970cf tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:33.100696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0dd0c5-d157-4284-b511-29f2ea06877a req-ae85532a-af9d-48bf-8b38-8f3e374970cf tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 950 time: 0.0792007 Dec 21 03:44:33.192307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.201070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0dd0c5-d157-4284-b511-29f2ea06877a req-039ff88f-383f-4f88-a954-219d777d32c2 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920155 Dec 21 03:44:33.229499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.238622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:33.247304 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1e4c100-f882-4c96-92e0-d5c7ecafb240" -d '{"events": [{"name": "network-changed", "server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "tag": "c312fda9-2565-4637-8907-d38449a7ab27"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:33.373047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:33.397164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Allocated IP 172.25.5.156 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/b18a511c-c0b8-4212-a38f-0a57a232fc90) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:33.434802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-46bb1280-2733-435c-a939-5f8d917977b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:33.436511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-46bb1280-2733-435c-a939-5f8d917977b1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5&tenant_id=408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 1102 time: 0.2613072 Dec 21 03:44:33.446411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:33.455332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf64796-c0cd-4376-90e5-92c0dff9a22d req-4b8544d6-4105-49f5-81fd-5872001d3522 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:33.457520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] For port 3ca5d939-c5fe-495d-b18d-625cac1cb678, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:33.461098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:33.466597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bf64796-c0cd-4376-90e5-92c0dff9a22d req-4b8544d6-4105-49f5-81fd-5872001d3522 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.2009094 Dec 21 03:44:33.474514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:33.494137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] For port 3ca5d939-c5fe-495d-b18d-625cac1cb678, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3ca5d939-c5fe-495d-b18d-625cac1cb678,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:33.523200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:33.544883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:33.545142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ec0f4c65-e0de-4ae6-bbeb-63e7e3dc9440 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:33.560087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.587123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.613175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.666761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-959f515f-6ab4-4243-80f7-095f61d71151 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.675146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bf64796-c0cd-4376-90e5-92c0dff9a22d req-ca0c9ccc-d86c-46ee-9119-9ade2f6033ce tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2053270 Dec 21 03:44:33.708285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc09167-4856-4fcc-9969-299c98ca4654 None None] Pushing event updated for resources: {'Port': ['ID=3ca5d939-c5fe-495d-b18d-625cac1cb678,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:33.809317 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d97a11f9-ecf4-4140-bf0c-b5d4c1eadafd x-openstack-request-id: req-d97a11f9-ecf4-4140-bf0c-b5d4c1eadafd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:33.809317 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "tag": "c312fda9-2565-4637-8907-d38449a7ab27", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:33.809317 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d97a11f9-ecf4-4140-bf0c-b5d4c1eadafd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:33.809317 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27', 'status': 'completed', 'code': 200} Dec 21 03:44:33.827199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 2, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:33.865180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Checking router: 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:33.865541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Updating router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 port e99106f7-f780-4fbe-8b19-7d63d11935cd binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:44:33.880251 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:33.890513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-782f458e-6b49-4944-b4b7-eebde4c26e41 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f99ea8b7ae9a4d40aed93882fd7c11fc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3632460 Dec 21 03:44:33.896059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42984) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:33.913752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:33.957367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.077042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb8d58c-d5ce-4894-bf80-05c6e9417795 req-88ca0e9b-5872-443d-8ed9-a817b98a8c0d tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:34.078696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-959f515f-6ab4-4243-80f7-095f61d71151 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.080636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Pushing event updated for resources: {'Port': ['ID=b18a511c-c0b8-4212-a38f-0a57a232fc90,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:34.088457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bb8d58c-d5ce-4894-bf80-05c6e9417795 req-88ca0e9b-5872-443d-8ed9-a817b98a8c0d tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 950 time: 0.2151475 Dec 21 03:44:34.091539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:34.099312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-8940185e-0b3d-4847-9f8b-edfd45a1da21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:34.100939 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-8940185e-0b3d-4847-9f8b-edfd45a1da21 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1126 time: 0.2914317 Dec 21 03:44:34.102147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:34.106307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:34.123749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6a1b789-ff0e-4c5c-ac93-970ffc98436c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.223999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6a1b789-ff0e-4c5c-ac93-970ffc98436c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.226674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:34.227798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.228665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:34.255646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-959f515f-6ab4-4243-80f7-095f61d71151 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.299939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-a186fb3c-c823-4cb8-a9fd-423ca1ff08b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:34.301465 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-a186fb3c-c823-4cb8-a9fd-423ca1ff08b3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1421080 Dec 21 03:44:34.316592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bb8d58c-d5ce-4894-bf80-05c6e9417795 req-14b5b804-64fb-4453-990e-a03beee985cb tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2298367 Dec 21 03:44:34.408895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.421679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-f523f727-8958-47a8-b03e-b230589e081f tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:34.423214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-f523f727-8958-47a8-b03e-b230589e081f tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 827 time: 0.2806535 Dec 21 03:44:34.433463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-385f6659-c453-4556-a073-5920b4a00715 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.0933340 Dec 21 03:44:34.436865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-959f515f-6ab4-4243-80f7-095f61d71151 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72204503-70db-4618-9ccf-02258e38b1e0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:34.443441 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-959f515f-6ab4-4243-80f7-095f61d71151 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7fb5b9f127714114bdcde57f936e98fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9957571 Dec 21 03:44:34.449188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42996) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:34.458692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:34.476600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.487622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-822e1e77-3083-49e1-b9e0-471c0e5496cb tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/quotas/6152d205cbf24532b57c0a62bd05450d HTTP/1.1" status: 200 len: 375 time: 0.0567279 Dec 21 03:44:34.517085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6a1b789-ff0e-4c5c-ac93-970ffc98436c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.520521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6a1b789-ff0e-4c5c-ac93-970ffc98436c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.521774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e6a1b789-ff0e-4c5c-ac93-970ffc98436c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/722fdac3-6a9b-4ced-a2f9-99c599556be3 HTTP/1.1" status: 204 len: 168 time: 0.6007214 Dec 21 03:44:34.528486 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.530842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-6a16dc63-7036-4640-81a1-fab3d09ddd47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:34.532364 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-6a16dc63-7036-4640-81a1-fab3d09ddd47 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0880556 Dec 21 03:44:34.563391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e707c1d-7c1a-40a5-befb-e4040a13704a None None] Pushing event updated for resources: {'Port': ['ID=e99106f7-f780-4fbe-8b19-7d63d11935cd,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:34.568315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a1b789-ff0e-4c5c-ac93-970ffc98436c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=722fdac3-6a9b-4ced-a2f9-99c599556be3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:34.579461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cdb53c3-3115-40fc-a7f0-53da366e2f45 req-a9fad691-30e9-477b-8bb1-4176a87fd0bf tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:34.579461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cdb53c3-3115-40fc-a7f0-53da366e2f45 req-a9fad691-30e9-477b-8bb1-4176a87fd0bf tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.1820207 Dec 21 03:44:34.579660 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-1d8c29e3-5f68-4699-8cba-fc1a5989143e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0388520 Dec 21 03:44:34.581195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df1bcadb-b849-4488-b57e-1dd73882e21b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.587951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Transition to ACTIVE for port object 54f03f61-5bac-4c58-8af3-224512e89641 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:34.653478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-75bcae0a-0ce4-4c4a-8f19-a6ca376d7945 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1597867 Dec 21 03:44:34.667597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.685692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df1bcadb-b849-4488-b57e-1dd73882e21b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.800576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cdb53c3-3115-40fc-a7f0-53da366e2f45 req-6fd0c019-025e-4674-97d1-9cde6918cb11 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2002223 Dec 21 03:44:34.836404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:34.903663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:34.950762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] No DVR routers for this DVR port 54f03f61-5bac-4c58-8af3-224512e89641 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:35.062065 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-d7471aaa-c4a9-45a1-875c-78377b32fb2b service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4705055 Dec 21 03:44:35.068631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:35.069037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Attempting to bind port e99106f7-f780-4fbe-8b19-7d63d11935cd on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:35.069555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:35.070115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:35.073690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Attempting to bind port e99106f7-f780-4fbe-8b19-7d63d11935cd by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:35.074068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Attempting to bind port e99106f7-f780-4fbe-8b19-7d63d11935cd on network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:35.078260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Port 54f03f61-5bac-4c58-8af3-224512e89641 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:35.078894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Attempting to bind port 54f03f61-5bac-4c58-8af3-224512e89641 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:35.084745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:35.085116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Checking segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:35.085515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.085900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Bound using segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:35.086422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Bound port: e99106f7-f780-4fbe-8b19-7d63d11935cd, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:35.086825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.100059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-9f84ba90-24f5-461a-b089-f852ac0cac43 service neutron] 10.222.0.18 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4239919 Dec 21 03:44:35.165165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df1bcadb-b849-4488-b57e-1dd73882e21b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.167746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df1bcadb-b849-4488-b57e-1dd73882e21b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.177511 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-df1bcadb-b849-4488-b57e-1dd73882e21b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/72204503-70db-4618-9ccf-02258e38b1e0 HTTP/1.1" status: 204 len: 168 time: 0.7200387 Dec 21 03:44:35.192031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3b0e1c5c-8003-4c6e-802a-06fc4942d724 None None] Provisioning complete for port e99106f7-f780-4fbe-8b19-7d63d11935cd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:35.203296 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b0e1c5c-8003-4c6e-802a-06fc4942d724 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.216088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1bcadb-b849-4488-b57e-1dd73882e21b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72204503-70db-4618-9ccf-02258e38b1e0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:35.269653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-c7639b80-d033-4fbf-991f-b8543adb7b94 service neutron] 10.222.0.18 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1736488 Dec 21 03:44:35.271326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:35.271850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:35.272402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:35.275974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Bound port: 54f03f61-5bac-4c58-8af3-224512e89641, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:35.276523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.297176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] For port e99106f7-f780-4fbe-8b19-7d63d11935cd, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:35.315336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b0e1c5c-8003-4c6e-802a-06fc4942d724 None None] Port e99106f7-f780-4fbe-8b19-7d63d11935cd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:35.317964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] For port e99106f7-f780-4fbe-8b19-7d63d11935cd, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e99106f7-f780-4fbe-8b19-7d63d11935cd,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:35.374579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.410034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:35.433041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1e4c100-f882-4c96-92e0-d5c7ecafb240 req-20929087-ca5b-4aa1-b15f-9df7eb495fa5 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2984021 Dec 21 03:44:35.442416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738b663d-c851-4288-9437-74e423e25b67 req-cf2e9c4c-d854-4b44-b83a-8cb49c53fc88 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:35.443293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-738b663d-c851-4288-9437-74e423e25b67 req-cf2e9c4c-d854-4b44-b83a-8cb49c53fc88 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.2223096 Dec 21 03:44:35.479501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-f197f48d-1628-485c-b162-c9655d77b032 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:35.482833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e707c1d-7c1a-40a5-befb-e4040a13704a None None] Pushing event updated for resources: {'Port': ['ID=e99106f7-f780-4fbe-8b19-7d63d11935cd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:35.484270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-f197f48d-1628-485c-b162-c9655d77b032 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.54 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 950 time: 0.1717951 Dec 21 03:44:35.503185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.507725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:35.508785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:35.537668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43008) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:35.569217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:35.656667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:35.692597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:35.711279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:44:35.715082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86ff215c-4e41-406b-bf39-2247b13aa4f0 None None] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:35.758341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.772078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b00306b8-2908-44e8-87d7-52c2580dd622 None None] Provisioning complete for port 3ca5d939-c5fe-495d-b18d-625cac1cb678 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:35.772699 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b00306b8-2908-44e8-87d7-52c2580dd622 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:35.839547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:35.848930 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd3e1db6-8a52-41d7-9a9a-7cc0dccc346d" -d '{"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:35.854716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-738b663d-c851-4288-9437-74e423e25b67 req-2506cd91-dd14-468f-ace4-ef29106960f5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3854747 Dec 21 03:44:35.969123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3ca5d939-c5fe-495d-b18d-625cac1cb678 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:35.981164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c097e6d6-5c28-4ecf-aeaa-3d5484f6ca51 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e86f9241678945699d054b9bdb31471d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4392412 Dec 21 03:44:36.004967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:36.006031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.008411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] 10.222.0.31 "PUT /v2.0/ports/54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 1097 time: 2.5390804 Dec 21 03:44:36.068070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-588c37c3-477f-4025-9809-ac8901408c50 req-49c32bac-9252-4782-913b-a52bb5a9da93 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 210 time: 0.0773203 Dec 21 03:44:36.133999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:36.135067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Deleting port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:36.135067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.169621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe7b087-e4bb-4fea-8eab-b2d7849950a2 service neutron] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:36.169971 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b00306b8-2908-44e8-87d7-52c2580dd622 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.180914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43030) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:36.230425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df399ca-f924-48a3-bb08-60911e8a26a7 req-e112cd33-5e96-49e3-a1e0-382b4d3ae292 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:36.238617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9df399ca-f924-48a3-bb08-60911e8a26a7 req-e112cd33-5e96-49e3-a1e0-382b4d3ae292 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 950 time: 0.4893849 Dec 21 03:44:36.240369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3ca5d939-c5fe-495d-b18d-625cac1cb678 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:36.240905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.320184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b00306b8-2908-44e8-87d7-52c2580dd622 None None] For port 3ca5d939-c5fe-495d-b18d-625cac1cb678, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3ca5d939-c5fe-495d-b18d-625cac1cb678,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:36.369276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-b54c7b8a-290a-45cb-a319-3e1957f88e2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:36.370779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-b54c7b8a-290a-45cb-a319-3e1957f88e2d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1100 time: 0.3054328 Dec 21 03:44:36.431962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d308a3c-7230-411c-99ed-aef7896552a9 req-5dc0ccc2-2c91-4da6-b5d6-dc691aa887f5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:36.433454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d308a3c-7230-411c-99ed-aef7896552a9 req-5dc0ccc2-2c91-4da6-b5d6-dc691aa887f5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.2615185 Dec 21 03:44:36.443670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9df399ca-f924-48a3-bb08-60911e8a26a7 req-75a9ad52-8c4b-4293-b294-cd8fffb5fe03 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/security-groups?id=61aff54c-174f-4df3-87a4-1e4329a18b83&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2035489 Dec 21 03:44:36.448136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] For port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:36.448516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.460868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.501410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Calling delete_port for 73ac0d75-dfb3-42a5-b9f8-10f70f27485a owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:36.532033 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7cdd1dac-a122-40ca-98ca-3dd0f8602a49 x-openstack-request-id: req-7cdd1dac-a122-40ca-98ca-3dd0f8602a49 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:36.532327 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:36.532582 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7cdd1dac-a122-40ca-98ca-3dd0f8602a49 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:36.533032 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'code': 200} Dec 21 03:44:36.537701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61d3f050-326f-47bd-9d57-a8d0616c8a29 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.538397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:35Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:36.582311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7528a719-eb81-4fb6-8c12-b60eb949806e None None] The sync data for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 is: [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:35Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:36.641175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b00306b8-2908-44e8-87d7-52c2580dd622 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.645596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Router 9cf108fe-d806-4d27-bb77-e2381c596d6a is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:44:36.693664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:44:36.693664 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:44:36.700732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61d3f050-326f-47bd-9d57-a8d0616c8a29 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.732623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d308a3c-7230-411c-99ed-aef7896552a9 req-d34109a3-3726-4e89-8158-5919b01c0e90 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2877390 Dec 21 03:44:36.773599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-4a0e9ddc-6cc9-4d82-8715-aaa45e5200d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:36.775384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-4a0e9ddc-6cc9-4d82-8715-aaa45e5200d7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3842340 Dec 21 03:44:36.823551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00306b8-2908-44e8-87d7-52c2580dd622 None None] Pushing event updated for resources: {'Port': ['ID=3ca5d939-c5fe-495d-b18d-625cac1cb678,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:36.836066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-39176d07-07c4-4ce2-913a-6bc9b9a670eb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0477901 Dec 21 03:44:36.838790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:36.844589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Provisioning complete for port e99106f7-f780-4fbe-8b19-7d63d11935cd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:36.844994 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.853113 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08648224-b561-4e04-9993-286fc014220d None None] Sync routers for ids ['9cf108fe-d806-4d27-bb77-e2381c596d6a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:36.869357 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08648224-b561-4e04-9993-286fc014220d None None] Routers {'9cf108fe-d806-4d27-bb77-e2381c596d6a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:36.869983 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-08648224-b561-4e04-9993-286fc014220d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9cf108fe-d806-4d27-bb77-e2381c596d6a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:36.945397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.947172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f732406-1dcd-4421-8e2f-a35900414f65 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 5.0172865 Dec 21 03:44:36.955750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43038) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:36.976210 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61d3f050-326f-47bd-9d57-a8d0616c8a29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.979246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61d3f050-326f-47bd-9d57-a8d0616c8a29 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:36.982834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-61d3f050-326f-47bd-9d57-a8d0616c8a29 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fc2bb1aa-65b3-4e42-a958-e1490b415dbc HTTP/1.1" status: 204 len: 168 time: 0.7961092 Dec 21 03:44:36.988775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-72a901ec-91fe-4f9f-998f-ac7ca5bb2211 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:36.990633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-72a901ec-91fe-4f9f-998f-ac7ca5bb2211 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1025283 Dec 21 03:44:36.995761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d3f050-326f-47bd-9d57-a8d0616c8a29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc2bb1aa-65b3-4e42-a958-e1490b415dbc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:37.038563 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:37.104324 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:37.107106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] For port e99106f7-f780-4fbe-8b19-7d63d11935cd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e99106f7-f780-4fbe-8b19-7d63d11935cd,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:37.146902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['73ac0d75-dfb3-42a5-b9f8-10f70f27485a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:37.151948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Pushing event deleted for resources: {'Port': ['ID=73ac0d75-dfb3-42a5-b9f8-10f70f27485a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:37.171037 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-08648224-b561-4e04-9993-286fc014220d None None] Set router 9cf108fe-d806-4d27-bb77-e2381c596d6a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:37.217731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d478ca-8449-4b29-a535-a07c95545a39 req-41501538-ff2d-4a30-80e3-cf1f351b5438 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:37.234056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d478ca-8449-4b29-a535-a07c95545a39 req-41501538-ff2d-4a30-80e3-cf1f351b5438 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.2091563 Dec 21 03:44:37.251109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-45ebc85f-8b3a-4ef6-8dd0-ce2120c35c33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:37.260624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-45ebc85f-8b3a-4ef6-8dd0-ce2120c35c33 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2592709 Dec 21 03:44:37.285436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:37.309550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] No DVR routers for this DVR port 73ac0d75-dfb3-42a5-b9f8-10f70f27485a on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:37.317269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:37.333953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690379ac-62cb-4555-8019-e85e3ca963c2 req-a7efb691-71b9-493f-9324-bb23c6e6d94f tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.54 "DELETE /v2.0/ports/73ac0d75-dfb3-42a5-b9f8-10f70f27485a HTTP/1.1" status: 204 len: 173 time: 1.8379600 Dec 21 03:44:37.434578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:37.478108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dffdba7-0384-4261-8017-2bdfd4036d34 req-dccc95e3-88af-40dd-a6ac-7dd365358cfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 210 time: 0.1760547 Dec 21 03:44:37.485190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Provisioning complete for port 3ca5d939-c5fe-495d-b18d-625cac1cb678 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:37.492259 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:37.592294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a432e43-e4f1-42c1-a2ee-9a218ef6febb None None] Pushing event updated for resources: {'Port': ['ID=e99106f7-f780-4fbe-8b19-7d63d11935cd,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:37.685875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d478ca-8449-4b29-a535-a07c95545a39 req-a3806404-ab18-4480-8087-ba4c02dda71a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4505115 Dec 21 03:44:37.692310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 54f03f61-5bac-4c58-8af3-224512e89641 host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:44:37.692785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:37.763698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43060) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:37.799384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-08648224-b561-4e04-9993-286fc014220d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:44:34Z', 'revision_number': 3, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:37.897205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08648224-b561-4e04-9993-286fc014220d None None] Checking router: 9cf108fe-d806-4d27-bb77-e2381c596d6a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:37.899563 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08648224-b561-4e04-9993-286fc014220d None None] Updating router 9cf108fe-d806-4d27-bb77-e2381c596d6a port b18a511c-c0b8-4212-a38f-0a57a232fc90 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:44:37.938747 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-08648224-b561-4e04-9993-286fc014220d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.017195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3ca5d939-c5fe-495d-b18d-625cac1cb678 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:38.045755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Request body: {'network': {'name': 'tempest-ServersTestBootFromVolume-771579807-network', 'tenant_id': '7fa1b480ce544ae89f56493527b75054'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:38.089586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-77cacd4a-a562-4ee6-8712-d28b4cbc49c7 service neutron] 10.222.0.31 "GET /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.3490162 Dec 21 03:44:38.163288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3ca5d939-c5fe-495d-b18d-625cac1cb678 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:38.163863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.356727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Made reservation on behalf of 7fa1b480ce544ae89f56493527b75054 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:38.368713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.397673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e99106f7-f780-4fbe-8b19-7d63d11935cd up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:38.441170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.461430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e99106f7-f780-4fbe-8b19-7d63d11935cd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:38.461969 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.537899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}, {'server_uuid': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'name': 'network-vif-deleted', 'tag': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:38.540200 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe086faa-3016-4817-9d3e-23bf089f7737" -d '{"events": [{"name": "network-changed", "server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}, {"server_uuid": "da547605-8361-4b87-abba-ced2c3fbaea0", "name": "network-vif-deleted", "tag": "73ac0d75-dfb3-42a5-b9f8-10f70f27485a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:38.612125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-318352fd-44cd-4cd4-b645-23cf6c85a420 req-66f1a8f2-580e-49a4-95cf-82a9a3822244 tempest-ServerDiagnosticsNegativeTest-398503683 tempest-ServerDiagnosticsNegativeTest-398503683-project] 10.222.0.18 "GET /v2.0/ports?device_id=da547605-8361-4b87-abba-ced2c3fbaea0 HTTP/1.1" status: 200 len: 210 time: 0.8204122 Dec 21 03:44:38.689971 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-08648224-b561-4e04-9993-286fc014220d None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.701185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-eaf0db5b-5652-4665-8d94-11c4be6d2616 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.3893442 Dec 21 03:44:38.720097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9b4cfa-8777-493c-823a-e0dc0dfdafde req-0488ca34-e274-44bf-859e-8f1e61923cef tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:38.728956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a9b4cfa-8777-493c-823a-e0dc0dfdafde req-0488ca34-e274-44bf-859e-8f1e61923cef tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 943 time: 0.2281041 Dec 21 03:44:38.742798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.785448 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-08648224-b561-4e04-9993-286fc014220d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.824538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:38.835617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1f6c2b-163a-4592-a3b6-13034749ef52 None None] Pushing event updated for resources: {'Port': ['ID=b18a511c-c0b8-4212-a38f-0a57a232fc90,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:38.857835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dc7deb0-0331-4805-997f-08c80ecb6c72 req-38dfafdc-83ae-4baf-b6c8-4d937bb375de tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 210 time: 0.0525677 Dec 21 03:44:38.864048 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-08648224-b561-4e04-9993-286fc014220d None None] Attempting to bind port b18a511c-c0b8-4212-a38f-0a57a232fc90 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:38.864048 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-08648224-b561-4e04-9993-286fc014220d None None] Attempting to bind port b18a511c-c0b8-4212-a38f-0a57a232fc90 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:38.874599 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08648224-b561-4e04-9993-286fc014220d None None] Attempting to bind port b18a511c-c0b8-4212-a38f-0a57a232fc90 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:38.892865 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08648224-b561-4e04-9993-286fc014220d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:38.894617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08648224-b561-4e04-9993-286fc014220d None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:38.895290 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-08648224-b561-4e04-9993-286fc014220d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.895592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a9b4cfa-8777-493c-823a-e0dc0dfdafde req-b702a227-85ef-418a-82e2-e4debd8a2e80 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1656466 Dec 21 03:44:38.897463 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08648224-b561-4e04-9993-286fc014220d None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:38.898072 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-08648224-b561-4e04-9993-286fc014220d None None] Bound port: b18a511c-c0b8-4212-a38f-0a57a232fc90, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:38.898900 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-08648224-b561-4e04-9993-286fc014220d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:38.911405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e21155d-7c16-475e-bfbb-5d04fe930642 req-ed35a982-09da-4125-942b-39a1486823db service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1785092 Dec 21 03:44:38.946505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:38.994006 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-08648224-b561-4e04-9993-286fc014220d None None] For port b18a511c-c0b8-4212-a38f-0a57a232fc90, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:38.996207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c312fda9-2565-4637-8907-d38449a7ab27 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:38.999341 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-08648224-b561-4e04-9993-286fc014220d None None] For port b18a511c-c0b8-4212-a38f-0a57a232fc90, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b18a511c-c0b8-4212-a38f-0a57a232fc90,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:39.007189 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25387eba-a2df-4d05-b131-05d271185358 x-openstack-request-id: req-25387eba-a2df-4d05-b131-05d271185358 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:39.007497 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "status": "completed", "code": 200}, {"server_uuid": "da547605-8361-4b87-abba-ced2c3fbaea0", "name": "network-vif-deleted", "tag": "73ac0d75-dfb3-42a5-b9f8-10f70f27485a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:39.007750 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-25387eba-a2df-4d05-b131-05d271185358 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:39.008133 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'status': 'completed', 'code': 200} Dec 21 03:44:39.008387 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'da547605-8361-4b87-abba-ced2c3fbaea0', 'name': 'network-vif-deleted', 'tag': '73ac0d75-dfb3-42a5-b9f8-10f70f27485a', 'status': 'completed', 'code': 200} Dec 21 03:44:39.010691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.012957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:39.033975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f5cfbc-fb85-47df-a49b-a90fbff9f9a4 req-d91cb95f-1f0f-4fb3-aa59-f15616326703 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.035588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43088) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:39.035697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34f5cfbc-fb85-47df-a49b-a90fbff9f9a4 req-d91cb95f-1f0f-4fb3-aa59-f15616326703 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.0664399 Dec 21 03:44:39.117131 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-08648224-b561-4e04-9993-286fc014220d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.149534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34f5cfbc-fb85-47df-a49b-a90fbff9f9a4 req-a6c1a2cc-3b8f-41c5-8804-b33d6c91a18e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066923 Dec 21 03:44:39.153010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-aed65744-5152-4125-b345-43d69a599d5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.154481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-aed65744-5152-4125-b345-43d69a599d5d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1100 time: 0.1034586 Dec 21 03:44:39.160701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Allocated IP 172.20.0.1 (d818b5e2-0d66-470d-b08f-ad7d366af0b0/72829a15-a3e7-4f70-8cd0-2cbaf77976b3/3d4c871a-dd3a-455c-a51c-b017ad4b99ef) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:39.164226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-7c47e87e-03ab-4ae2-8984-a046f7fea1a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.164226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-7c47e87e-03ab-4ae2-8984-a046f7fea1a6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1100 time: 0.0780745 Dec 21 03:44:39.171134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.235304 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08648224-b561-4e04-9993-286fc014220d None None] Routers {'9cf108fe-d806-4d27-bb77-e2381c596d6a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:39.236136 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-08648224-b561-4e04-9993-286fc014220d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9cf108fe-d806-4d27-bb77-e2381c596d6a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:39.240315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.285663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Request body: {'network': {'name': 'tempest-VolumesAdminNegativeTest-1318911950-network', 'tenant_id': '259704f866224ed694b05e3868cd9f5c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:39.327690 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1f6c2b-163a-4592-a3b6-13034749ef52 None None] Pushing event updated for resources: {'Port': ['ID=b18a511c-c0b8-4212-a38f-0a57a232fc90,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:39.341206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-6a844d5d-1836-4c75-8859-32cf00efcf09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.342678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-6a844d5d-1836-4c75-8859-32cf00efcf09 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1779315 Dec 21 03:44:39.344124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-422cfc34-5fac-42c9-91ca-39f3d8c82b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.345219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-422cfc34-5fac-42c9-91ca-39f3d8c82b65 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1687825 Dec 21 03:44:39.347181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:44:39.399143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-d76effb6-79d1-4641-bfb8-573c23bc11a9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0487132 Dec 21 03:44:39.411671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 73ac0d75-dfb3-42a5-b9f8-10f70f27485a no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:39.414317 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-08648224-b561-4e04-9993-286fc014220d None None] Set router 9cf108fe-d806-4d27-bb77-e2381c596d6a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:39.429279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.429633 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Added segment 4d133d37-f925-4e60-b2a4-eec93a137782 of type vlan for network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd Dec 21 03:44:39.443464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c9fdf78-55d2-4298-bf4d-4e47b82966b1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:39.446761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-2950c802-531e-4ada-a550-54d41026c696 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0565128 Dec 21 03:44:39.557598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Made reservation on behalf of 259704f866224ed694b05e3868cd9f5c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:39.559849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.572600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.587795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-12de3b58-1b59-45f1-9d4b-859a49266a0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.593112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-12de3b58-1b59-45f1-9d4b-859a49266a0c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1121101 Dec 21 03:44:39.612369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-0572cdac-a0be-4f0f-8c08-933f49acfc85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.613446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 73ac0d75-dfb3-42a5-b9f8-10f70f27485a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:44:39.613927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-0572cdac-a0be-4f0f-8c08-933f49acfc85 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1543500 Dec 21 03:44:39.616226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 73ac0d75-dfb3-42a5-b9f8-10f70f27485a not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:39.618617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.670174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.675000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-08648224-b561-4e04-9993-286fc014220d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:44:34Z', 'revision_number': 3, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:39.689113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] Transition to ACTIVE for port object c312fda9-2565-4637-8907-d38449a7ab27 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:39.710916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08648224-b561-4e04-9993-286fc014220d None None] The sync data for ids ['9cf108fe-d806-4d27-bb77-e2381c596d6a'] in n-d-822053-11 is: [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:44:34Z', 'revision_number': 3, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:39.741794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-b1a87fbc-b9fc-4284-b1ea-bb3412dba6c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.743969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-b1a87fbc-b9fc-4284-b1ea-bb3412dba6c8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1286185 Dec 21 03:44:39.745655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-4f1b8a32-9105-47d1-a9af-05ad41f85c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.747709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-4f1b8a32-9105-47d1-a9af-05ad41f85c91 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1202447 Dec 21 03:44:39.772823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.785702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-7d318164-4ea2-4cdb-ac03-04eff91c49d6 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.787559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-7d318164-4ea2-4cdb-ac03-04eff91c49d6 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.31 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 827 time: 0.3374310 Dec 21 03:44:39.832060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Request body: {'port': {'device_id': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'admin_state_up': True, 'tenant_id': '6152d205cbf24532b57c0a62bd05450d'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:39.856709 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.857685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:39.858292 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:39.941536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-08ed4651-5656-416a-9f14-0475ef3ca319 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1842799 Dec 21 03:44:40.021483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-8d4e9418-52cb-4066-82dd-11733bf0c0e3 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2654140 Dec 21 03:44:40.062570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] Pushing event updated for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:40.113399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] Pushing event updated for resources: {'Network': ['ID=1413c5b2-d3e7-46e6-af39-45068f2d8ddd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:40.131692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:44:40.153545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03221e02-98cf-424c-9538-fbf10cc87a66 req-ff296eee-23ea-4fcc-a3dc-0fd857a64523 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 210 time: 0.0955143 Dec 21 03:44:40.155615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.158559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] No DVR routers for this DVR port c312fda9-2565-4637-8907-d38449a7ab27 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:44:40.188825 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-97374bc9-d07b-43b6-9aaf-225d7d7135b7 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 2.4240105 Dec 21 03:44:40.191436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43108) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:40.191769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:40.238849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-163d7f48-1a67-40a2-a6ee-b3d18db9a4dc service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2839386 Dec 21 03:44:40.250152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff4f24c-78b8-4ff8-8d93-437c551cb556 req-f50787eb-90a4-45a9-af67-5f45ff20dec1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:40.251789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dff4f24c-78b8-4ff8-8d93-437c551cb556 req-f50787eb-90a4-45a9-af67-5f45ff20dec1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 944 time: 0.1770656 Dec 21 03:44:40.269931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe086faa-3016-4817-9d3e-23bf089f7737 req-789a2dab-e0c9-4c7e-b5b7-28d934cd862e service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2384267 Dec 21 03:44:40.303924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Request body: {'subnet': {'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestBootFromVolume-771579807-subnet', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:40.332854 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-5b937839-6bf2-4d43-a77b-7a2618506330 service neutron] 10.222.0.31 "PUT /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 2.2231069 Dec 21 03:44:40.346105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dff4f24c-78b8-4ff8-8d93-437c551cb556 req-2703727e-9be3-4b26-a64e-130c8111f672 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840333 Dec 21 03:44:40.366129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb56facc-c9ca-42c0-8bea-fd5ab97fcbb7 req-edaafbe3-db60-4221-9778-f1e6247d4a26 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:40.367779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb56facc-c9ca-42c0-8bea-fd5ab97fcbb7 req-edaafbe3-db60-4221-9778-f1e6247d4a26 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.0797138 Dec 21 03:44:40.405477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:40.456582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb56facc-c9ca-42c0-8bea-fd5ab97fcbb7 req-4eb1fb2b-3327-4fb2-9d1f-f60d46658683 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797052 Dec 21 03:44:40.464498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:40.466392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Pushing event updated for resources: {'Port': ['ID=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:40.479505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:40.544921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.582606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.602489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-f2c12e49-9c32-4df1-8894-e0ff4d64c1b4 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:40.604751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-f2c12e49-9c32-4df1-8894-e0ff4d64c1b4 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0621152 Dec 21 03:44:40.639351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Made reservation on behalf of 7fa1b480ce544ae89f56493527b75054 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:40.641806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.648322 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d302a86-1c51-4697-98e1-93b0a3805e85 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=95c8a6929b04466fbe843361793ffdf4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4498556 Dec 21 03:44:40.653899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Made reservation on behalf of 6152d205cbf24532b57c0a62bd05450d for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:40.657362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43120) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:40.657888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.660828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.743189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3826d8a5-527e-4b3a-8482-04bec4624b6e None None] Provisioning complete for port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:40.743736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3826d8a5-527e-4b3a-8482-04bec4624b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.751746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1027fd3b-8d8f-4c8c-b7ab-20df9a26d541 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.755330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-ef2327e5-e5cd-4aec-9dd5-c00ca30b0cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:40.757115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-ef2327e5-e5cd-4aec-9dd5-c00ca30b0cc6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&tenant_id=7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 1096 time: 0.1427970 Dec 21 03:44:40.783988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1027fd3b-8d8f-4c8c-b7ab-20df9a26d541 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.784239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:44:40.802723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3826d8a5-527e-4b3a-8482-04bec4624b6e None None] Port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:40.812867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd369f87-b6b5-4935-8864-c8abdbfdeeb8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:40.828515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.828837 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Added segment c924054a-32a4-4063-a961-2d7b2907f729 of type vlan for network 545d576d-bcad-43dd-a453-7df1e631e6e2 Dec 21 03:44:40.882999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-9b132623-a521-4494-b79c-790771e6dd7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:40.885197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-9b132623-a521-4494-b79c-790771e6dd7f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1096 time: 0.0756001 Dec 21 03:44:40.931952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.963790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1027fd3b-8d8f-4c8c-b7ab-20df9a26d541 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.966330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1027fd3b-8d8f-4c8c-b7ab-20df9a26d541 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:40.967507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1027fd3b-8d8f-4c8c-b7ab-20df9a26d541 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/61aff54c-174f-4df3-87a4-1e4329a18b83 HTTP/1.1" status: 204 len: 168 time: 0.3113031 Dec 21 03:44:40.981037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1027fd3b-8d8f-4c8c-b7ab-20df9a26d541 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61aff54c-174f-4df3-87a4-1e4329a18b83,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:40.999014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-0450e9d2-45c5-4cfc-ba54-08e963240ef1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:41.000190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-0450e9d2-45c5-4cfc-ba54-08e963240ef1 service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1065371 Dec 21 03:44:41.056419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.057315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-20cf2fce-cc00-4b5f-9988-a2fb0735da72 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.0487933 Dec 21 03:44:41.109250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Allocated IP 172.20.0.10 (7bc2df93-ed75-4ee4-81c6-f3b3411325a4/8fae910f-1046-400a-b90e-c801ea409ae9/742f0270-e348-4b05-82d9-88e6e724dc14) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:41.118575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-61c0b4e8-bc1c-4182-afb2-1ba1f1f7c873 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:41.120447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-61c0b4e8-bc1c-4182-afb2-1ba1f1f7c873 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0549026 Dec 21 03:44:41.148447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.149267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:41.150769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.157213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-a6420114-0f63-49f6-b555-ba826a862350 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261350 Dec 21 03:44:41.291153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.296026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 2.2602854 Dec 21 03:44:41.324865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf79c66f-05d7-4240-8aea-c07fdf32c125 req-02a6048a-222a-4dfb-948f-d788f9ba3b68 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 210 time: 0.0676048 Dec 21 03:44:41.325114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:41.333695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-80edbeb4-d0a1-4b9e-8dbc-0d838d7d5ff5 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1684790 Dec 21 03:44:41.352384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Request body: {'subnet': {'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesAdminNegativeTest-1318911950-subnet', 'tenant_id': '259704f866224ed694b05e3868cd9f5c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:41.355584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290c8ffe-39d7-48a0-a515-9fb9fc3e305a admin admin] Pushing event updated for resources: {'Network': ['ID=545d576d-bcad-43dd-a453-7df1e631e6e2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:41.366406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 545d576d-bcad-43dd-a453-7df1e631e6e2 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:44:41.488798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-4d42888b-05af-460d-92d7-bb40d65590d1 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1462073 Dec 21 03:44:41.521517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Pushing event updated for resources: {'Subnet': ['ID=48142ae2-dce2-450f-96ff-f72f7dcd96bb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:41.578620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d3584a-39b6-4293-b81e-7f840580ce87 req-afaeba8d-ebcb-44f0-8604-f0a7cfeee1b4 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:41.581234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91d3584a-39b6-4293-b81e-7f840580ce87 req-afaeba8d-ebcb-44f0-8604-f0a7cfeee1b4 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 944 time: 0.0832138 Dec 21 03:44:41.582641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Checking segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:41.583031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Network hostable DHCP agents. Network: 1413c5b2-d3e7-46e6-af39-45068f2d8ddd, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:44:41.626058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.641897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.644370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Made reservation on behalf of 259704f866224ed694b05e3868cd9f5c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:41.646820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.696781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:41.701065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91d3584a-39b6-4293-b81e-7f840580ce87 req-ceaba913-f560-4a91-9bdf-64b51ce1e4bb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1085317 Dec 21 03:44:41.714689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:44:41.714833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785c9f3a-a1a6-4499-814b-3b92e7d09c2a req-ae2b73b7-4bc3-4a5c-9cb8-33a5f81e6837 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:41.716348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-785c9f3a-a1a6-4499-814b-3b92e7d09c2a req-ae2b73b7-4bc3-4a5c-9cb8-33a5f81e6837 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.1083844 Dec 21 03:44:41.787602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43136) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:41.804138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-785c9f3a-a1a6-4499-814b-3b92e7d09c2a req-03d25cd8-ea25-4053-b72d-b24f099277fc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812511 Dec 21 03:44:41.830031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8f72455-f212-41bf-a411-548764bbe0c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:41.916401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b18a511c-c0b8-4212-a38f-0a57a232fc90 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:41.968404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8f72455-f212-41bf-a411-548764bbe0c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.001424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port c312fda9-2565-4637-8907-d38449a7ab27 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:44:42.001837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:44:42.047965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8f72455-f212-41bf-a411-548764bbe0c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.051027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:42.061548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b18a511c-c0b8-4212-a38f-0a57a232fc90 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:42.061927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.083871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '54f03f61-5bac-4c58-8af3-224512e89641', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '54f03f61-5bac-4c58-8af3-224512e89641', 'mac_address': 'fa:16:3e:2b:d0:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.144'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:42.090306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:44:42.092308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.104235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d1c11ce4-1644-470d-adee-8f5facb106f2 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.106120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-d1c11ce4-1644-470d-adee-8f5facb106f2 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0930734 Dec 21 03:44:42.111082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c8f72455-f212-41bf-a411-548764bbe0c3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=dfda99bb34bd47e293cf3df47403dd44&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3059092 Dec 21 03:44:42.112358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:42.125551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f72455-f212-41bf-a411-548764bbe0c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42280ab9-7ead-4706-b396-c46d67a13110,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.164821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.192472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1413c5b2-d3e7-46e6-af39-45068f2d8ddd) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:42.201526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Pushing event updated for resources: {'Port': ['ID=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.208482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.208832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.225520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.245157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 54f03f61-5bac-4c58-8af3-224512e89641 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:42.247491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a85419bf-b268-4a16-bf87-618f99938487 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.252098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.278984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.279223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b18a511c-c0b8-4212-a38f-0a57a232fc90, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b18a511c-c0b8-4212-a38f-0a57a232fc90,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:42.282502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43ad9f98-ae6a-4613-9b0a-cd58ebde22bd None None] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:42.323264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:42.354446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a85419bf-b268-4a16-bf87-618f99938487 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.359150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.362056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c52d5651-ceaa-480b-9d30-0ae829faef15 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 2.1624980 Dec 21 03:44:42.375926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:42.391143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Request body: {'router': {'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:42.405305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.446037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2995df42-1003-4f37-a0d4-e640dfaf167d req-dabadd8b-100b-4769-aeac-a941e088a9e2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.448222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2995df42-1003-4f37-a0d4-e640dfaf167d req-dabadd8b-100b-4769-aeac-a941e088a9e2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 948 time: 0.1618285 Dec 21 03:44:42.469543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b18a511c-c0b8-4212-a38f-0a57a232fc90,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.478819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:42.489604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-959b8821-f9b3-4796-bd32-e14b5c3449b0 service neutron] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:42.498350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:42.499247 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-959b8821-f9b3-4796-bd32-e14b5c3449b0 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.500499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c90d9b7-d28b-4dc5-b09a-5e57f360897c req-959b8821-f9b3-4796-bd32-e14b5c3449b0 service neutron] 10.222.0.54 "DELETE /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.3812447 Dec 21 03:44:42.508550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event updated for resources: {'Port': ['ID=742f0270-e348-4b05-82d9-88e6e724dc14,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.512143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:42.527837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.532093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'project_id': '7fa1b480ce544ae89f56493527b75054', 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:44:42.534439 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.589866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a85419bf-b268-4a16-bf87-618f99938487 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.592777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a85419bf-b268-4a16-bf87-618f99938487 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.597561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a85419bf-b268-4a16-bf87-618f99938487 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/42280ab9-7ead-4706-b396-c46d67a13110 HTTP/1.1" status: 204 len: 168 time: 0.4803286 Dec 21 03:44:42.630396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.642132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2995df42-1003-4f37-a0d4-e640dfaf167d req-2cff03f4-eec8-40af-bd52-1120415d6d99 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1786656 Dec 21 03:44:42.660209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a85419bf-b268-4a16-bf87-618f99938487 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42280ab9-7ead-4706-b396-c46d67a13110,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.669770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-64092c57-9049-4014-b9a9-e9368ffe8c46 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.671647 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-64092c57-9049-4014-b9a9-e9368ffe8c46 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5&tenant_id=408f05064a77442595f2b5d444671b8a&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 949 time: 0.2965319 Dec 21 03:44:42.673526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:42.686962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f02974-07f3-4f23-b495-66efc3a179ff req-1a7f58ce-25f1-4325-88c9-026352b74a3d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.689059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37f02974-07f3-4f23-b495-66efc3a179ff req-1a7f58ce-25f1-4325-88c9-026352b74a3d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 932 time: 0.1547337 Dec 21 03:44:42.711188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.712255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.740110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.740855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:42.743483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:42.803726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:42.821239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37f02974-07f3-4f23-b495-66efc3a179ff req-678bedfe-b145-4313-8b33-cda5ade21fda tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030991 Dec 21 03:44:42.895252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Allocated IP 172.20.0.2 (1413c5b2-d3e7-46e6-af39-45068f2d8ddd/48142ae2-dce2-450f-96ff-f72f7dcd96bb/ef6bc27d-9833-430f-8730-fa885dc7971b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:42.921470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa52458-9b3f-4d28-9d1a-6c1cf3bb64b1 req-a1fdfeab-81f5-4857-8fae-cce448d87f54 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:42.923584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=132b2a84-19ec-4b46-aad8-63966b0011e0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:42.930207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fa52458-9b3f-4d28-9d1a-6c1cf3bb64b1 req-a1fdfeab-81f5-4857-8fae-cce448d87f54 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 944 time: 0.0633955 Dec 21 03:44:42.950855 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-b5779bdf-65dd-4ad4-8781-a4e7c44c27cf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.1426687 Dec 21 03:44:42.997028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fa52458-9b3f-4d28-9d1a-6c1cf3bb64b1 req-90c68832-ec46-4f55-9916-2a52bf810cd7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649583 Dec 21 03:44:43.014556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.020316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Request body: {'port': {'device_id': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:43.074596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Checking segment: {'id': 'c924054a-32a4-4063-a961-2d7b2907f729', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:43.075000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Network hostable DHCP agents. Network: 545d576d-bcad-43dd-a453-7df1e631e6e2, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:44:43.079298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7f749cd6-e06e-4fe7-b44c-7d7fcb8af2fc None None] Provisioning complete for port 742f0270-e348-4b05-82d9-88e6e724dc14 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:43.079836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f749cd6-e06e-4fe7-b44c-7d7fcb8af2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.146847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7f749cd6-e06e-4fe7-b44c-7d7fcb8af2fc None None] Port 742f0270-e348-4b05-82d9-88e6e724dc14 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:43.215242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9483d18-db22-4209-a2a2-8c390be825d8 req-a3f5f240-f83e-4dac-aa1f-2111c8660cbe tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:43.218645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9483d18-db22-4209-a2a2-8c390be825d8 req-a3f5f240-f83e-4dac-aa1f-2111c8660cbe tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1096 time: 0.0816541 Dec 21 03:44:43.278086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9483d18-db22-4209-a2a2-8c390be825d8 req-1ed1c177-71d3-4da3-bfe7-496b500e7c0f tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519109 Dec 21 03:44:43.298683 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-3b921ad3-8898-4cce-82b9-0bb1516a1994 service neutron] delete failed (client error): The resource could not be found. Dec 21 03:44:43.300598 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-3b921ad3-8898-4cce-82b9-0bb1516a1994 service neutron] 10.222.0.54 "DELETE /v2.0/ports/54f03f61-5bac-4c58-8af3-224512e89641/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.6206076 Dec 21 03:44:43.307873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ac87ba13-f3ba-4653-bba6-036776e320ed None None] Provisioning complete for port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:43.308246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac87ba13-f3ba-4653-bba6-036776e320ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.336675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.372476 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.381720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ac87ba13-f3ba-4653-bba6-036776e320ed None None] Port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:43.404302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.466053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Router 9cf108fe-d806-4d27-bb77-e2381c596d6a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:44:43.477376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.480552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Network 545d576d-bcad-43dd-a453-7df1e631e6e2 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:44:43.529966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:43.531686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:43.543243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:43.560079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Pushing event updated for resources: {'Port': ['ID=ef6bc27d-9833-430f-8730-fa885dc7971b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:43.584849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-b5d6f2f8-0b3c-4c6a-b1a3-5ce1c47c6f85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:43.587396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-b5d6f2f8-0b3c-4c6a-b1a3-5ce1c47c6f85 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1101 time: 0.1747978 Dec 21 03:44:43.619805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Attempting to bind port ef6bc27d-9833-430f-8730-fa885dc7971b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:43.620187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Attempting to bind port ef6bc27d-9833-430f-8730-fa885dc7971b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:43.620547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Attempting to bind port ef6bc27d-9833-430f-8730-fa885dc7971b on network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:43.626404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:43.626784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Checking segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:43.627261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.627648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Bound using segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:43.628284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Bound port: ef6bc27d-9833-430f-8730-fa885dc7971b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:43.628665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.644678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 545d576d-bcad-43dd-a453-7df1e631e6e2) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:43.655643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52e0e3cf-d4f0-466d-b6d2-89c0be377a3b None None] Network 545d576d-bcad-43dd-a453-7df1e631e6e2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:43.674831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:43.674831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.749944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-c4c4f4d3-3a14-4613-8a39-cdbf262ab25e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:43.762404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-c4c4f4d3-3a14-4613-8a39-cdbf262ab25e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.2220080 Dec 21 03:44:43.806225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] For port ef6bc27d-9833-430f-8730-fa885dc7971b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:43.812683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] For port ef6bc27d-9833-430f-8730-fa885dc7971b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ef6bc27d-9833-430f-8730-fa885dc7971b,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:43.840090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-6e5891f7-64f7-4171-bd89-5ac0c20dcaac tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/quotas/7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 375 time: 0.0719805 Dec 21 03:44:43.883024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ee5e1ce-274a-40f9-9ccd-6e73c9cddf3a None None] Network 545d576d-bcad-43dd-a453-7df1e631e6e2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:43.886966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a1c620e-0927-44e5-88b4-5b628c856f30 req-cc462e8e-9a57-4720-b57c-377d101b0297 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:43.888268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a1c620e-0927-44e5-88b4-5b628c856f30 req-cc462e8e-9a57-4720-b57c-377d101b0297 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 949 time: 0.1176348 Dec 21 03:44:43.900857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b18a511c-c0b8-4212-a38f-0a57a232fc90 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:43.903637 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b47a2b1b-9acd-4bc9-ad4f-83451ed0bbb6 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.5774848 Dec 21 03:44:43.917473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:43.934837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-3b1d3149-4ca3-4c81-87a3-9e10c0c443a2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0827692 Dec 21 03:44:44.018627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:44.029278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-ca9997b6-35fe-4ef3-be15-a8cde6427123 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:44.032103 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-ca9997b6-35fe-4ef3-be15-a8cde6427123 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3895535 Dec 21 03:44:44.039659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a1c620e-0927-44e5-88b4-5b628c856f30 req-89b94619-17f7-4264-82e6-4daa3b1314dd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1371772 Dec 21 03:44:44.040084 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-47f79a2a-f392-48f3-b5d2-509295285030 admin admin] 10.222.0.18 "PUT /v2.0/routers/9cf108fe-d806-4d27-bb77-e2381c596d6a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.0890517 Dec 21 03:44:44.061061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Sync routers for ids ['9cf108fe-d806-4d27-bb77-e2381c596d6a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:44.118682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-c868cdba-02a2-49d7-9472-dbe1f4d394ab service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0735500 Dec 21 03:44:44.150762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Routers {'9cf108fe-d806-4d27-bb77-e2381c596d6a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:44.151448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9cf108fe-d806-4d27-bb77-e2381c596d6a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:44.202508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-fa4ee991-ea1f-46ec-9e69-382f497689f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:44.204271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-fa4ee991-ea1f-46ec-9e69-382f497689f7 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0743852 Dec 21 03:44:44.215350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb24ff22-e156-45df-b34a-b972244e8501 None None] Pushing event updated for resources: {'Port': ['ID=ef6bc27d-9833-430f-8730-fa885dc7971b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:44.240098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-cf9fa231-9daa-430c-8667-4ae16f435af3 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2959337 Dec 21 03:44:44.329214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 742f0270-e348-4b05-82d9-88e6e724dc14 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:44.340889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:44.374126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Transition to ACTIVE for port object 742f0270-e348-4b05-82d9-88e6e724dc14 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:44.407204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb7d127-f24a-4d05-92d5-f2d8de4b07a9 req-7c6bb430-d1cb-42c7-bb0a-fb527174e428 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:44.422442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9eb7d127-f24a-4d05-92d5-f2d8de4b07a9 req-7c6bb430-d1cb-42c7-bb0a-fb527174e428 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 932 time: 0.2150748 Dec 21 03:44:44.457992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:44.485510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-25874b77-015f-4da1-855f-0b78af09f47c service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2440572 Dec 21 03:44:44.528021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9eb7d127-f24a-4d05-92d5-f2d8de4b07a9 req-3b41b279-804b-4ca9-a290-df0f07d099c3 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042216 Dec 21 03:44:44.606609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Pushing event updated for resources: {'Port': ['ID=742f0270-e348-4b05-82d9-88e6e724dc14,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:44.622516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-beae5d97-8042-4f02-b8fc-43845f3b44b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:44.624378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-beae5d97-8042-4f02-b8fc-43845f3b44b7 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2477326 Dec 21 03:44:44.765871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b18a511c-c0b8-4212-a38f-0a57a232fc90 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:44.766246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:44.856908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Set router 9cf108fe-d806-4d27-bb77-e2381c596d6a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:44.923007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ce0726e-243b-4d77-b62f-b494233ebf06 req-cd313736-a116-478c-8b00-57fa73afea46 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 210 time: 0.0492017 Dec 21 03:44:44.941673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Attempting to bind port 742f0270-e348-4b05-82d9-88e6e724dc14 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:44.944915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Attempting to bind port 742f0270-e348-4b05-82d9-88e6e724dc14 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:44.944915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Attempting to bind port 742f0270-e348-4b05-82d9-88e6e724dc14 on network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:45.047960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Port 742f0270-e348-4b05-82d9-88e6e724dc14 on network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:45.052270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Attempting to bind port 742f0270-e348-4b05-82d9-88e6e724dc14 on network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:45.305089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:44:40Z', 'revision_number': 4, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3d4c871a-dd3a-455c-a51c-b017ad4b99ef', 'name': '', 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'mac_address': 'fa:16:3e:48:d8:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 480, 'fixed_ips': [{'subnet_id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:38Z', 'updated_at': '2021-12-21T03:44:41Z', 'revision_number': 2, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'subnets': [{'id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:45.349737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Checking router: 9cf108fe-d806-4d27-bb77-e2381c596d6a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:45.350051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Updating router 9cf108fe-d806-4d27-bb77-e2381c596d6a port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:44:45.460040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07972441-5eb5-4059-b536-661e397a8cca req-c70378a0-d3bf-4571-8dad-5c11eff1affe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:45.461209 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.461641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07972441-5eb5-4059-b536-661e397a8cca req-c70378a0-d3bf-4571-8dad-5c11eff1affe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 949 time: 0.3159990 Dec 21 03:44:45.479049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:45.479691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Checking segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:45.479808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Bound using segment: {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:45.480199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Bound port: 742f0270-e348-4b05-82d9-88e6e724dc14, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'af0f1c65-4b10-4991-bbab-e021be9d7624', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:45.480556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.485658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43232) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:45.503239 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-8541d929-0dd8-4ce3-b597-c0e1689dd3ba service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8516192 Dec 21 03:44:45.543946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Request body: {'network': {'name': 'tempest-VolumesAdminNegativeTest-1770320840-network', 'tenant_id': '427ea7c865c3448a8c4002314a502dc5'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:45.572790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07972441-5eb5-4059-b536-661e397a8cca req-491c97c7-7437-4e05-8fb5-2467c9d3fded tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877771 Dec 21 03:44:45.588259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-2c6f1bb6-df3e-414c-a62e-afe86f9e8cc5 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3713608 Dec 21 03:44:45.618430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:45.681041 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.727032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.737186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3526f8b-1008-499d-9c9e-206e7697eaa4 req-884e790d-60f5-4a0a-8c07-638de9da0faa tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:45.741379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:45.744556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3526f8b-1008-499d-9c9e-206e7697eaa4 req-884e790d-60f5-4a0a-8c07-638de9da0faa tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 944 time: 0.0698411 Dec 21 03:44:45.748003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af2418d6-8781-4a97-adb2-758543d45aab None None] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:45.795358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Made reservation on behalf of 427ea7c865c3448a8c4002314a502dc5 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:45.798855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.816835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3526f8b-1008-499d-9c9e-206e7697eaa4 req-05fe0f5c-d793-4c03-97e8-aacbfd3014e3 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667901 Dec 21 03:44:45.817709 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.840569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] For port 742f0270-e348-4b05-82d9-88e6e724dc14, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:45.869061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:45.896145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] For port 742f0270-e348-4b05-82d9-88e6e724dc14, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=742f0270-e348-4b05-82d9-88e6e724dc14,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:45.901818 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-673ea0d0-2adc-4cd4-9fd4-ac53bb79663a req-29cd62af-25ef-43f5-add0-40dd83fdf13a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3558772 Dec 21 03:44:45.983739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ef6bc27d-9833-430f-8730-fa885dc7971b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:46.007903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Allocated IP 172.25.5.182 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/08d81f05-279a-4e14-ac86-e5e708e73032) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:46.011860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.069261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ea5cfe10-75de-4440-a2ef-9c503aff8e97 None None] Provisioning complete for port ef6bc27d-9833-430f-8730-fa885dc7971b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:46.069733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ea5cfe10-75de-4440-a2ef-9c503aff8e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.089115 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.133678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ef6bc27d-9833-430f-8730-fa885dc7971b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:46.134047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.159281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-250e64d6-f193-4cf0-92c7-a749beafe3b7 req-0ab8783d-16e4-44ce-88f5-1ee364f0f264 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 210 time: 0.0335855 Dec 21 03:44:46.171147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Pushing event updated for resources: {'Port': ['ID=742f0270-e348-4b05-82d9-88e6e724dc14,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:46.180173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.195821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:46.199436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:44:46.201515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.206620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-dabefb10-3d3a-4d21-ae7e-5c2ebca35c38 service neutron] 10.222.0.31 "PUT /v2.0/ports/742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 1093 time: 3.2111917 Dec 21 03:44:46.212553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:46.218008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.218349 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Added segment 39358102-6fda-4efd-9865-d73087b710d4 of type vlan for network fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2 Dec 21 03:44:46.220844 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa" -d '{"events": [{"name": "network-changed", "server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:46.275529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.310400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.370401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b20224f-80ea-4f3e-b34c-fbf38815554a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:46.380136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.384868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.386529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:46.388558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.396381 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5d5ce85-c025-4c35-996d-f71bac22789d x-openstack-request-id: req-c5d5ce85-c025-4c35-996d-f71bac22789d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:46.396381 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:46.396679 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c5d5ce85-c025-4c35-996d-f71bac22789d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:46.396896 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14', 'status': 'completed', 'code': 200} Dec 21 03:44:46.448897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port ef6bc27d-9833-430f-8730-fa885dc7971b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ef6bc27d-9833-430f-8730-fa885dc7971b,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:46.460896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 54f03f61-5bac-4c58-8af3-224512e89641 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:44:46.483794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 54f03f61-5bac-4c58-8af3-224512e89641 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:46.484161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.501053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9958313 Dec 21 03:44:46.508517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43252) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:46.534894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Request body: {'subnet': {'network_id': 'fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesAdminNegativeTest-1770320840-subnet', 'tenant_id': '427ea7c865c3448a8c4002314a502dc5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:46.549577 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.572696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.601810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-005c602e-7b2c-48aa-a834-0f6fa2cb86a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:46.604893 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-005c602e-7b2c-48aa-a834-0f6fa2cb86a5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1096 time: 0.2069159 Dec 21 03:44:46.613654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6be37d-6f53-4000-885c-0ce5b2dc3763 admin admin] Pushing event updated for resources: {'Network': ['ID=fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:46.645468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:44:46.667275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.708817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-2aca4013-061a-4728-a0a7-abce451c5fda service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 217 time: 0.0812070 Dec 21 03:44:46.728208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Made reservation on behalf of 427ea7c865c3448a8c4002314a502dc5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:46.731515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Publish callbacks [] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.793478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ef6bc27d-9833-430f-8730-fa885dc7971b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:46.810246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-ae2659b7-38b3-426f-8cf0-6ed6ae1ea78c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:46.812886 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-ae2659b7-38b3-426f-8cf0-6ed6ae1ea78c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 200 len: 866 time: 0.0947692 Dec 21 03:44:46.873002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.876129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.877807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-8c71d32a-7e9c-491c-b597-e66a8656cddd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:46.879608 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-8c71d32a-7e9c-491c-b597-e66a8656cddd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0477746 Dec 21 03:44:46.925244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:46.967884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:46.975164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:46.977480 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-714cc6a2-fa8b-46ec-b9a3-b82951e389a0" -d '{"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-plugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:47.005267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd3bf26-be3c-45c4-b1f1-7615f986219d None None] Pushing event updated for resources: {'Port': ['ID=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:47.022660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:47.033093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:47.037860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:47.085700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Pushing event updated for resources: {'Port': ['ID=08d81f05-279a-4e14-ac86-e5e708e73032,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:47.094473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.105050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f06c48b9-8dcb-4637-acb9-94796f78b495 None None] Provisioning complete for port ef6bc27d-9833-430f-8730-fa885dc7971b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:47.105423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f06c48b9-8dcb-4637-acb9-94796f78b495 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.125144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Attempting to bind port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:47.125528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Attempting to bind port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:47.125897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Attempting to bind port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef on network d818b5e2-0d66-470d-b08f-ad7d366af0b0 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:47.126773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-dd6d9871-806c-4dda-86b3-772e4fed466f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=4712c556d73e4ad2b805061c976ddd2e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0637422 Dec 21 03:44:47.139260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-471788f0-20b5-4bb2-b49d-3af00f868f1c service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2476852 Dec 21 03:44:47.183348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:47.183737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Checking segment: {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:47.184147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.184603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Bound using segment: {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:47.185091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Bound port: 3d4c871a-dd3a-455c-a51c-b017ad4b99ef, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:47.185481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.283252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Allocated IP 172.25.5.129 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/bf34d979-502b-4191-9b85-67024922976b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:47.285692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:47.318398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] For port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:47.323464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] For port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:47.363277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3bcf67f2-32a9-4d00-86ce-09e6c771e062 req-7d4c4c2b-0ec9-4c8b-b366-dcbbec4a45b8 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1763918 Dec 21 03:44:47.437394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.449022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-79789e2e-91a3-4e4a-a14d-f71d9ada2a16 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:47.450514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-79789e2e-91a3-4e4a-a14d-f71d9ada2a16 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3228128 Dec 21 03:44:47.492035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Routers {'9cf108fe-d806-4d27-bb77-e2381c596d6a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:47.492235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-3d07032a-9a3a-437e-8e4f-eee4a96f27b9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/quotas/4712c556d73e4ad2b805061c976ddd2e HTTP/1.1" status: 200 len: 375 time: 0.0267348 Dec 21 03:44:47.492663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9cf108fe-d806-4d27-bb77-e2381c596d6a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:47.546352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.570159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd3bf26-be3c-45c4-b1f1-7615f986219d None None] Pushing event updated for resources: {'Port': ['ID=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:47.581848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-b59cca4e-305a-4269-ae59-5a626d9c0da2 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0662324 Dec 21 03:44:47.645734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.647077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.677607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5b00ef5d-a33b-4349-8527-5fd2fe55fcf9 None None] Provisioning complete for port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:47.677985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b00ef5d-a33b-4349-8527-5fd2fe55fcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.691905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-6679ac21-1317-411d-8ed4-2e450836ed4a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:47.694031 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-6679ac21-1317-411d-8ed4-2e450836ed4a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.2741547 Dec 21 03:44:47.740693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-8a83b710-7d4e-4d06-bcd3-81f70c4fa825 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:47.743007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-8a83b710-7d4e-4d06-bcd3-81f70c4fa825 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1096 time: 0.1905169 Dec 21 03:44:47.747633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Request body: {'port': {'device_id': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'admin_state_up': True, 'tenant_id': '7662e8b89a444924a01bee5e34421908'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:47.749515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:47.777490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:47.785251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:47.811929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:47.854336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=47bff4ed-3527-4095-bb53-44458099d102,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:47.958571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Checking segment: {'id': '39358102-6fda-4efd-9865-d73087b710d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:47.958991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Network hostable DHCP agents. Network: fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:44:47.980222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Pushing event updated for resources: {'Port': ['ID=bf34d979-502b-4191-9b85-67024922976b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:47.985240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ef6bc27d-9833-430f-8730-fa885dc7971b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:48.054241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] Set router 9cf108fe-d806-4d27-bb77-e2381c596d6a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:48.067217 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.087249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-98660387-c917-4ffc-b513-a7bc2d384e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:48.087453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ba6cc7-a56f-4cdd-a90c-2c74ebd55281 req-40e58f92-951b-49bf-ad1b-609a74b30b8d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:48.088875 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-98660387-c917-4ffc-b513-a7bc2d384e0f service neutron] 10.222.0.31 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 928 time: 0.3346477 Dec 21 03:44:48.100234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08ba6cc7-a56f-4cdd-a90c-2c74ebd55281 req-40e58f92-951b-49bf-ad1b-609a74b30b8d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.0885174 Dec 21 03:44:48.109239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ef6bc27d-9833-430f-8730-fa885dc7971b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:48.109817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.114611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Network fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:44:48.156006 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-489f1d3f-4063-4434-ad20-5e4c179265cf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 217 time: 0.0418496 Dec 21 03:44:48.157632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08ba6cc7-a56f-4cdd-a90c-2c74ebd55281 req-1bdb0763-85bc-490c-ab58-9619071a2d5b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616848 Dec 21 03:44:48.197136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.216010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Made reservation on behalf of 7662e8b89a444924a01bee5e34421908 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:48.220188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.237974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:48.250403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5064091-4499-41ca-a4af-515455c846ce None None] Network fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:48.260645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:48.261357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.278715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b00ef5d-a33b-4349-8527-5fd2fe55fcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.298839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-3b6b60a7-ddcc-45c4-8897-66280eccd3cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:48.300851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-3b6b60a7-ddcc-45c4-8897-66280eccd3cb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 200 len: 866 time: 0.1303327 Dec 21 03:44:48.335036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827a8f2f-49f2-48fa-90a0-10623ef12f28 req-5cef1007-3bd9-4a9c-8ca4-94c5518ce571 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:48.336702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-827a8f2f-49f2-48fa-90a0-10623ef12f28 req-5cef1007-3bd9-4a9c-8ca4-94c5518ce571 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 944 time: 0.1035950 Dec 21 03:44:48.342918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.379232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5b00ef5d-a33b-4349-8527-5fd2fe55fcf9 None None] For port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:48.414816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-419ca548-9671-40b0-ab9b-164a9def74bd admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.8914874 Dec 21 03:44:48.416103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-827a8f2f-49f2-48fa-90a0-10623ef12f28 req-6b9c3d04-cad4-420b-9d04-90a6436fcff5 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681894 Dec 21 03:44:48.463341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b00ef5d-a33b-4349-8527-5fd2fe55fcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.503466 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4ac98cf-457f-4a9f-8ef7-037dabd06501 x-openstack-request-id: req-d4ac98cf-457f-4a9f-8ef7-037dabd06501 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:48.503758 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-plugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:48.504016 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d4ac98cf-457f-4a9f-8ef7-037dabd06501 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:48.504401 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'code': 200} Dec 21 03:44:48.580792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-f9610008-b11f-4c07-999d-72e66fb55438 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:48.583098 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-f9610008-b11f-4c07-999d-72e66fb55438 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2505331 Dec 21 03:44:48.598008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b00ef5d-a33b-4349-8527-5fd2fe55fcf9 None None] Pushing event updated for resources: {'Port': ['ID=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:48.609724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39c28657-b243-4d05-8b77-ca222bb67821 None None] Network fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:44:48.655371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.673946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Allocated IP 172.20.0.2 (8b13f1ae-b717-40da-b68e-bdf950529b14/84e57960-b2b1-49b0-85de-36fd5e1ebd6a/ac725df3-7862-483f-82a4-1cc27a3a5efa) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:48.694431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ffcf7311-a610-4a66-865e-a0178057d82c None None] Provisioning complete for port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:48.694805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ffcf7311-a610-4a66-865e-a0178057d82c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.723745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:44:40Z', 'revision_number': 4, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3d4c871a-dd3a-455c-a51c-b017ad4b99ef', 'name': '', 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'mac_address': 'fa:16:3e:48:d8:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 480, 'fixed_ips': [{'subnet_id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:38Z', 'updated_at': '2021-12-21T03:44:47Z', 'revision_number': 4, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'subnets': [{'id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:48.768694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17fa78dd-a818-4e6d-9e5e-756c6dd1f6f9 None None] The sync data for ids ['9cf108fe-d806-4d27-bb77-e2381c596d6a'] in n-d-822053-11 is: [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:44:40Z', 'revision_number': 4, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3d4c871a-dd3a-455c-a51c-b017ad4b99ef', 'name': '', 'network_id': 'd818b5e2-0d66-470d-b08f-ad7d366af0b0', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'mac_address': 'fa:16:3e:48:d8:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_interface', 'standard_attr_id': 480, 'fixed_ips': [{'subnet_id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:38Z', 'updated_at': '2021-12-21T03:44:47Z', 'revision_number': 4, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'subnets': [{'id': '72829a15-a3e7-4f70-8cd0-2cbaf77976b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:48.783973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c8c0918-71f3-4c28-9b59-fe3cff6caeb6 req-7bd4cafa-56c3-48d6-a3d2-2aae2b9de203 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 210 time: 0.0700221 Dec 21 03:44:48.791229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.800119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Router aa3076a7-dfbe-4587-b5a8-fe25629afc18 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:44:48.826239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.925419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Pushing event updated for resources: {'Port': ['ID=bf34d979-502b-4191-9b85-67024922976b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:48.974381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-e9f1fad9-7eb9-448e-98ae-15a9c6cff903 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=4712c556d73e4ad2b805061c976ddd2e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0234423 Dec 21 03:44:48.994911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:48.996463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-e2bbd01f-2345-445f-919c-3bb20526b18a tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.3995988 Dec 21 03:44:49.106223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-47d383f5-d71b-4178-a4c2-bd3b8f21c32f tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.129 HTTP/1.1" status: 200 len: 696 time: 0.0986626 Dec 21 03:44:49.207660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-2f832b48-078a-49fe-a222-6b0c9a6307b4 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:49.209172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-2f832b48-078a-49fe-a222-6b0c9a6307b4 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2281957 Dec 21 03:44:49.235617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-e087adb0-d934-4d70-9e5f-1f37da0d9fed tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/quotas/4712c556d73e4ad2b805061c976ddd2e HTTP/1.1" status: 200 len: 375 time: 0.0186491 Dec 21 03:44:49.260915 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-af2a1379-1226-402f-be4b-a4d842a7fd20 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6597154 Dec 21 03:44:49.293883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-c0f4f946-8dad-4394-9081-ad4c0b14f619 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0534165 Dec 21 03:44:49.305901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-5d66e8d6-f182-464e-a688-06667d6a9541 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:49.307529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c4e808-c0a4-41dc-8617-99ad2cae3ce4 req-5d66e8d6-f182-464e-a688-06667d6a9541 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1935408 Dec 21 03:44:49.362309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:49.409545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:49.424400 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Sync routers for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:49.436041 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:49.437010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:49.450516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c49eab7-8900-48e5-a936-2c534cb85a60 req-bbc49267-fcef-43bf-bf57-a7ab5f9a834b tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:49.462597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c49eab7-8900-48e5-a936-2c534cb85a60 req-bbc49267-fcef-43bf-bf57-a7ab5f9a834b tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1102 time: 0.0908959 Dec 21 03:44:49.524978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c49eab7-8900-48e5-a936-2c534cb85a60 req-9e3af587-cd09-43f0-9ee7-7f17290ba73b tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0613382 Dec 21 03:44:49.560175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:49.566697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1497bec9-4fc2-4966-9f39-01f4a37edb5a admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 7.1793988 Dec 21 03:44:49.569119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43316) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:49.573811 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5cdca56f-5d07-4763-ab90-0fb53cdb0eaa req-72cfc4de-c092-48cf-a1a6-931b122ae9f9 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2840447 Dec 21 03:44:49.614160 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:49.633366 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:49.723403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dac1bf68-bbb0-4af6-85f7-84b199bee3f2 req-43b4fc48-e7db-4131-8287-0297d519f5e1 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips/8c949847-717c-470a-9f06-e0d8cf971533 HTTP/1.1" status: 200 len: 693 time: 0.1614795 Dec 21 03:44:49.755136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 742f0270-e348-4b05-82d9-88e6e724dc14 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:49.865443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66e79f82-33fe-4bc4-bb69-722517770de1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:49.879876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3d4c871a-dd3a-455c-a51c-b017ad4b99ef up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:49.899924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:49.911169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:49.925573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:49.930295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:49.984276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac1bf68-bbb0-4af6-85f7-84b199bee3f2 req-e52a23b3-dbdd-44aa-8780-03463a7f3ab9 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:49.985109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dac1bf68-bbb0-4af6-85f7-84b199bee3f2 req-e52a23b3-dbdd-44aa-8780-03463a7f3ab9 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2538710 Dec 21 03:44:50.077633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 742f0270-e348-4b05-82d9-88e6e724dc14, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=742f0270-e348-4b05-82d9-88e6e724dc14,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:50.101677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:50.102200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.160924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-ccd94214-6467-42e9-9797-0141cff175f1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:50.169276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-ccd94214-6467-42e9-9797-0141cff175f1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/networks?id=545d576d-bcad-43dd-a453-7df1e631e6e2 HTTP/1.1" status: 200 len: 815 time: 0.4447482 Dec 21 03:44:50.172791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '742f0270-e348-4b05-82d9-88e6e724dc14', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'port_id': '742f0270-e348-4b05-82d9-88e6e724dc14', 'mac_address': 'fa:16:3e:6d:af:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 119, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:50.203642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b732058b-66d3-4a9e-94b3-6ff4f1fbe377 req-a52e65b4-51db-44de-ae1a-2cc969e47017 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:50.205291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b732058b-66d3-4a9e-94b3-6ff4f1fbe377 req-a52e65b4-51db-44de-ae1a-2cc969e47017 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 944 time: 0.1024010 Dec 21 03:44:50.213429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-b353d482-2d66-437b-83c5-32b515ed0268 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/quotas/259704f866224ed694b05e3868cd9f5c HTTP/1.1" status: 200 len: 375 time: 0.0429840 Dec 21 03:44:50.289111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-877f5c9f-3306-4c97-8cae-504accf74006 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=259704f866224ed694b05e3868cd9f5c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0746911 Dec 21 03:44:50.323287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.324083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:50.324925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.338919 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:47Z', 'revision_number': 3, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:50.342900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 742f0270-e348-4b05-82d9-88e6e724dc14 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:50.378605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 742f0270-e348-4b05-82d9-88e6e724dc14, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=742f0270-e348-4b05-82d9-88e6e724dc14,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:50.383511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Checking router: aa3076a7-dfbe-4587-b5a8-fe25629afc18 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:50.384107 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Updating router aa3076a7-dfbe-4587-b5a8-fe25629afc18 port 08d81f05-279a-4e14-ac86-e5e708e73032 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:44:50.400305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b732058b-66d3-4a9e-94b3-6ff4f1fbe377 req-80dbe51e-6aed-4633-b81a-1ab6377b518c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1847591 Dec 21 03:44:50.442658 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-86ab90c1-bfb1-40af-8487-79b941d81bbd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7050967 Dec 21 03:44:50.448231 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.453488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-3a7d95b9-fba8-4e42-a223-83d9d821cb65 service neutron] 10.222.0.18 "GET /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1631820 Dec 21 03:44:50.466006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Request body: {'port': {'device_id': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:50.493991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.569862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=742f0270-e348-4b05-82d9-88e6e724dc14,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:50.580992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-fa093596-07f6-48fc-af56-82df4b641465 service neutron] 10.222.0.18 "GET /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1198514 Dec 21 03:44:50.658079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0c2fc79-d01a-4ef1-8fba-22fafff95737 req-d316ca9f-8918-4bd3-a07a-1cf52c2cae72 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 210 time: 0.0743549 Dec 21 03:44:50.679406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.728697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-ffda8c79-e31c-44a2-9f87-87512cbf198d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=4712c556d73e4ad2b805061c976ddd2e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0621686 Dec 21 03:44:50.816901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.831614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['742f0270-e348-4b05-82d9-88e6e724dc14'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:50.843023 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:50.905156 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.037559 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Attempting to bind port 08d81f05-279a-4e14-ac86-e5e708e73032 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:51.043427 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Attempting to bind port 08d81f05-279a-4e14-ac86-e5e708e73032 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:51.044081 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Attempting to bind port 08d81f05-279a-4e14-ac86-e5e708e73032 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:51.058454 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:51.061843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61be6d60-d7a5-4775-878e-46a46465493b req-08ad3f84-27d7-48cc-9dac-5ebbdfa0a959 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?tenant_id=7abd8149eaa64d9f94b2460800f5436e HTTP/1.1" status: 200 len: 696 time: 0.1650872 Dec 21 03:44:51.063764 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:51.065781 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.066382 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:51.067104 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Bound port: 08d81f05-279a-4e14-ac86-e5e708e73032, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:51.067697 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.073125 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a763a13-0b11-41cb-b1b9-ea8825b61f24 None None] Pushing event updated for resources: {'Port': ['ID=08d81f05-279a-4e14-ac86-e5e708e73032,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:51.135028 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] For port 08d81f05-279a-4e14-ac86-e5e708e73032, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:51.138735 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] For port 08d81f05-279a-4e14-ac86-e5e708e73032, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=08d81f05-279a-4e14-ac86-e5e708e73032,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:51.177072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9177bd70-6426-4ce2-947d-b5b739580bcb req-165833b2-c716-48f3-a1c9-e17eea060813 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:51.178693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9177bd70-6426-4ce2-947d-b5b739580bcb req-165833b2-c716-48f3-a1c9-e17eea060813 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 931 time: 0.1926646 Dec 21 03:44:51.198632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-bbe43a12-f1f2-457b-9963-653761e2ea2c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:51.200175 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-bbe43a12-f1f2-457b-9963-653761e2ea2c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4618979 Dec 21 03:44:51.231990 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.238403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Allocated IP 172.20.0.1 (1413c5b2-d3e7-46e6-af39-45068f2d8ddd/48142ae2-dce2-450f-96ff-f72f7dcd96bb/7858b624-ab23-47c3-8ea5-3fd3edbec98d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:51.259380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Request body: {'port': {'device_id': '0024898a-7143-4c97-b092-729064ba192d', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '4712c556d73e4ad2b805061c976ddd2e'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:51.287460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9177bd70-6426-4ce2-947d-b5b739580bcb req-08e06ab2-c2c3-417a-95fc-4743f3abe451 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811684 Dec 21 03:44:51.316709 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:51.317630 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:51.362125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-387386ae-ee5b-461e-948a-2ebebd59acfb req-e93de365-569d-40a5-bdd1-f5c98305ada4 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 210 time: 0.0299845 Dec 21 03:44:51.379268 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a763a13-0b11-41cb-b1b9-ea8825b61f24 None None] Pushing event updated for resources: {'Port': ['ID=08d81f05-279a-4e14-ac86-e5e708e73032,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:51.411030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61be6d60-d7a5-4775-878e-46a46465493b req-0dd002cc-ef9c-4149-8500-1cfcd4dd1dfc tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:51.422395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61be6d60-d7a5-4775-878e-46a46465493b req-0dd002cc-ef9c-4149-8500-1cfcd4dd1dfc tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks?id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 787 time: 0.3592865 Dec 21 03:44:51.431345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-61be6d60-d7a5-4775-878e-46a46465493b req-b8afafcb-c0ef-4067-a274-3aad37536905 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:51.447171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61be6d60-d7a5-4775-878e-46a46465493b req-b8afafcb-c0ef-4067-a274-3aad37536905 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0241332 Dec 21 03:44:51.453631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:51.507967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-944072ad-5d62-4188-b129-343a0c5111ee tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0292704 Dec 21 03:44:51.653379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.694105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60bdeb34-22b0-4cd3-a302-e7aeb9a56ca2 req-6d6f30a0-8def-46d9-a381-4eb2192619d3 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:51.695636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60bdeb34-22b0-4cd3-a302-e7aeb9a56ca2 req-6d6f30a0-8def-46d9-a381-4eb2192619d3 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 945 time: 0.1480949 Dec 21 03:44:51.704681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ac725df3-7862-483f-82a4-1cc27a3a5efa {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:51.714955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-eadc6ab2-34ad-42c6-a7bc-5fee2203bf69 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:51.716109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.716836 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:47Z', 'revision_number': 3, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:51.722214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-eadc6ab2-34ad-42c6-a7bc-5fee2203bf69 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2079620 Dec 21 03:44:51.734663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Transition to ACTIVE for port object ac725df3-7862-483f-82a4-1cc27a3a5efa will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:51.741992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-f247adb8-340f-4032-aef3-7cf1f3837e75 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/quotas/408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 375 time: 0.0188694 Dec 21 03:44:51.747735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Made reservation on behalf of 4712c556d73e4ad2b805061c976ddd2e for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:51.749887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-377e1cfe-2bd8-4800-afe7-8139e8ffe981 None None] The sync data for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 is: [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:47Z', 'revision_number': 3, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:51.751470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.753822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 742f0270-e348-4b05-82d9-88e6e724dc14 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:51.762107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.839358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60bdeb34-22b0-4cd3-a302-e7aeb9a56ca2 req-a2ce13c3-9248-403f-bb26-8832d9b566c5 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141927 Dec 21 03:44:51.844127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-0c7aa671-ca36-4105-bc94-0501fb334806 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0904989 Dec 21 03:44:51.857726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.910511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.917314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.934639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 742f0270-e348-4b05-82d9-88e6e724dc14 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:44:51.943945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:51.945757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-6d05fd64-081b-485e-bb4f-e25deec517c8 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips/8c949847-717c-470a-9f06-e0d8cf971533 HTTP/1.1" status: 200 len: 693 time: 0.0735686 Dec 21 03:44:51.951875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:51.957232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 742f0270-e348-4b05-82d9-88e6e724dc14 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:51.960014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.974867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:51.979682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:51.982648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Pushing event updated for resources: {'Port': ['ID=7858b624-ab23-47c3-8ea5-3fd3edbec98d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:52.158030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:52.175721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786f5197-00b0-4860-8475-7d766a810b42 req-fba2ab36-2914-4676-be9c-451b7892cc2b tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:52.177983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-fba2ab36-2914-4676-be9c-451b7892cc2b tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2199092 Dec 21 03:44:52.207119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdf81763-a332-4582-bbd3-5af7f07c4ef8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.232115 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.240766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-e4e6c3cf-d94d-4248-a1a5-fc7bed1d651e tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:52.244641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-e4e6c3cf-d94d-4248-a1a5-fc7bed1d651e tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0240328 Dec 21 03:44:52.264996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:52.267211 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e50a0fe-0fc1-4add-a45e-3e15e2ffbc27" -d '{"events": [{"server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "name": "network-vif-plugged", "status": "completed", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:52.308470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 742f0270-e348-4b05-82d9-88e6e724dc14, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=742f0270-e348-4b05-82d9-88e6e724dc14,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:52.318719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-8555fe21-9509-4352-83d2-988bb0799861 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=4712c556d73e4ad2b805061c976ddd2e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1166494 Dec 21 03:44:52.411128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.444439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ecf57b12-b3df-4362-97bd-0b49563f1502,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:52.457014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5866d914-6f3d-4393-93af-f9e19d59885b req-09840967-3d03-4516-b5a0-1d6a474b2947 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 210 time: 0.1702716 Dec 21 03:44:52.504711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.510916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-fbd795fa-789d-444b-aa02-de4f7d66a9a4 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.129 HTTP/1.1" status: 200 len: 696 time: 0.2291713 Dec 21 03:44:52.518106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.557320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f90a2767-5b9e-463c-a576-93bdb49e7796 None None] Provisioning complete for port 7858b624-ab23-47c3-8ea5-3fd3edbec98d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:52.557688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f90a2767-5b9e-463c-a576-93bdb49e7796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.582467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=742f0270-e348-4b05-82d9-88e6e724dc14,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:52.619374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f90a2767-5b9e-463c-a576-93bdb49e7796 None None] Port 7858b624-ab23-47c3-8ea5-3fd3edbec98d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:52.695244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-3e93d790-9782-4ae4-ba02-4da2990d5635 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.129 HTTP/1.1" status: 200 len: 696 time: 0.1741405 Dec 21 03:44:52.722250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:52.722598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:52.722909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:52.737521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bcb4a44-61b0-4230-9140-0c0a4c6f4fc3 req-a02928ed-783e-4d97-9c67-0e7667a0a2f2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 210 time: 0.0412900 Dec 21 03:44:52.750110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:52.750638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:52.760330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Allocated IP 192.168.233.145 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/cf770d29-1c69-4f15-b07a-7cd04c2724a4) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:52.770711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:52.771343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:52.771947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:52.773024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Bound port: ac725df3-7862-483f-82a4-1cc27a3a5efa, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:52.773721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.829074 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6991a638-5bab-44e9-bac8-aeac171b4c7f x-openstack-request-id: req-6991a638-5bab-44e9-bac8-aeac171b4c7f {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:52.830797 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "name": "network-vif-plugged", "status": "completed", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:52.831254 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6991a638-5bab-44e9-bac8-aeac171b4c7f {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:52.831859 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14', 'code': 200} Dec 21 03:44:52.857848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-028cc4d4-7017-4b1f-a5be-2ce04b73c799 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:52.859438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-028cc4d4-7017-4b1f-a5be-2ce04b73c799 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5081794 Dec 21 03:44:52.887575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Request body: {'port': {'device_id': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '4712c556d73e4ad2b805061c976ddd2e'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:52.947063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:52.968378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:53.040486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:53.050719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-647492e0-8477-420f-ac9e-56f3dd737556 req-d07f0a27-7b75-4bc7-be26-8a09f8b6057f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:53.058015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-647492e0-8477-420f-ac9e-56f3dd737556 req-d07f0a27-7b75-4bc7-be26-8a09f8b6057f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.1270785 Dec 21 03:44:53.112815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd86f33-e872-4802-9e36-c3beaeff3a85 req-26e778af-8ca2-403d-910a-ca8381e50f75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:53.113735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.114341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fbd86f33-e872-4802-9e36-c3beaeff3a85 req-26e778af-8ca2-403d-910a-ca8381e50f75 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1098 time: 0.1434033 Dec 21 03:44:53.153282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.289508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:53.290179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.291628 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] 10.222.0.31 "PUT /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 1092 time: 2.8311627 Dec 21 03:44:53.293753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:53.296004 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e184d25c-4262-4979-8bf6-a74ef0047eaa" -d '{"events": [{"name": "network-changed", "server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:53.356477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Deleting port bf34d979-502b-4191-9b85-67024922976b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:44:53.357026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.357529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa26ec47-7a5d-4e0b-a984-ebb618a91f4e service neutron] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:53.373927 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fbd86f33-e872-4802-9e36-c3beaeff3a85 req-15f4a74b-d124-4488-bceb-aa5b3aaddb1a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2356920 Dec 21 03:44:53.398437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.427254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.447491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-647492e0-8477-420f-ac9e-56f3dd737556 req-d423e790-7e48-4c5f-91b4-76291c55b3e1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3886421 Dec 21 03:44:53.482528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.525225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.530463 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.530852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.553102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df07b404-ff7e-4c67-a0f8-4be6f24259e4 req-65d2d920-65df-4302-ac4f-3f715c82281d tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 210 time: 0.0389743 Dec 21 03:44:53.555786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Made reservation on behalf of 4712c556d73e4ad2b805061c976ddd2e for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:53.560242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.572467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Calling delete_port for bf34d979-502b-4191-9b85-67024922976b owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:44:53.787234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e778bd16-4d8a-4100-905e-1499eaec0fa8 req-a14967d3-8c5d-4342-b04d-5b1cb0405dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:53.788845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e778bd16-4d8a-4100-905e-1499eaec0fa8 req-a14967d3-8c5d-4342-b04d-5b1cb0405dc3 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 946 time: 0.1331999 Dec 21 03:44:53.870285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 08d81f05-279a-4e14-ac86-e5e708e73032 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:53.897104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.933944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 08d81f05-279a-4e14-ac86-e5e708e73032 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:53.936152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:53.950064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Allocated IP 192.168.233.146 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/6807c0f5-8451-4ed4-a51e-0d565a72e491) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:53.959139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:53.987606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e778bd16-4d8a-4100-905e-1499eaec0fa8 req-5db0318f-4932-40c9-b7c0-f43e48a88375 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1909130 Dec 21 03:44:53.992047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:54.000891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:54.071448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.082282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Pushing event updated for resources: {'Port': ['ID=7858b624-ab23-47c3-8ea5-3fd3edbec98d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:54.112950 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.135570 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b48e539f-190b-4b42-ae8f-d0393d530d6c x-openstack-request-id: req-b48e539f-190b-4b42-ae8f-d0393d530d6c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:44:54.135875 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:44:54.137195 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b48e539f-190b-4b42-ae8f-d0393d530d6c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:44:54.137195 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'status': 'completed', 'code': 200} Dec 21 03:44:54.149111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 08d81f05-279a-4e14-ac86-e5e708e73032, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=08d81f05-279a-4e14-ac86-e5e708e73032,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:54.156755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Pushing event deleted for resources: {'Port': ['ID=bf34d979-502b-4191-9b85-67024922976b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:54.190101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-ea2a5522-1afe-4105-acd9-8cccf8be7ce4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:54.191720 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-ea2a5522-1afe-4105-acd9-8cccf8be7ce4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1095 time: 0.2922077 Dec 21 03:44:54.198783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.201352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.202639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-786f5197-00b0-4860-8475-7d766a810b42 req-bbf7178d-e1cd-4172-9ad9-302cb75bbc29 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "DELETE /v2.0/floatingips/8c949847-717c-470a-9f06-e0d8cf971533 HTTP/1.1" status: 204 len: 173 time: 1.4916840 Dec 21 03:44:54.241703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36fc1f73-e60c-4abb-88ce-8e377aa56c85 req-cf9e8456-e449-448e-9c39-23284d6f4c41 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 210 time: 0.0444829 Dec 21 03:44:54.245275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.318330 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-695b6805-2b1d-43a4-8e9c-f1d21cc126fe service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 217 time: 0.1023293 Dec 21 03:44:54.333733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:54.334384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.357002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=08d81f05-279a-4e14-ac86-e5e708e73032,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.377683 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-27d5188d-d481-4a23-9646-e587b806ee0e tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:54.380367 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-27d5188d-d481-4a23-9646-e587b806ee0e tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.54 "GET /v2.0/networks?id=545d576d-bcad-43dd-a453-7df1e631e6e2 HTTP/1.1" status: 200 len: 815 time: 0.4687216 Dec 21 03:44:54.381075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:54.391678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.396836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adf333f1-123c-49ce-950d-24b28ed77210 req-98c94457-e9c3-486f-a9c9-bf19f9f6c0c2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 210 time: 0.0484164 Dec 21 03:44:54.421244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Request body: {'port': {'device_id': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2', 'admin_state_up': True, 'tenant_id': '259704f866224ed694b05e3868cd9f5c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:54.456891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ea9f00a2-b244-4311-a6e8-662702af2eaa None None] Provisioning complete for port cf770d29-1c69-4f15-b07a-7cd04c2724a4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:54.457331 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ea9f00a2-b244-4311-a6e8-662702af2eaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.500938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-a0da2d30-1889-44a2-8e68-f8c132820938 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:54.503779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-a0da2d30-1889-44a2-8e68-f8c132820938 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1317885 Dec 21 03:44:54.506153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:54.513958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ea9f00a2-b244-4311-a6e8-662702af2eaa None None] Port cf770d29-1c69-4f15-b07a-7cd04c2724a4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:54.518867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:54.521760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-d6f31b1e-b2a0-4b48-8dcf-d683e6b0a807 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.1569779 Dec 21 03:44:54.527023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:54.557451 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-3fb36e73-7e7e-45e8-ad81-ef35ed6c0007 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0360155 Dec 21 03:44:54.567169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-c1b0798b-5f81-42f6-bf34-028a3490328d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.3119087 Dec 21 03:44:54.573995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.603096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Request body: {'port': {'device_id': '0024898a-7143-4c97-b092-729064ba192d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:54.643243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.649235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.698005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:54.718589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:54.721534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event updated for resources: {'Port': ['ID=6807c0f5-8451-4ed4-a51e-0d565a72e491,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:54.728992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.732673 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:44:54.734867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:54.735882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.823489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e7fc3b-5885-4683-8d75-180b83e057af req-e726e864-0389-4876-9ed7-ebe9f3ec4419 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:54.835709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05e7fc3b-5885-4683-8d75-180b83e057af req-e726e864-0389-4876-9ed7-ebe9f3ec4419 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.2180469 Dec 21 03:44:54.843372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-41b1e397-4dac-4bc1-b700-1d82c6f338b5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.9613397 Dec 21 03:44:54.868023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Request body: {'port': {'device_id': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:54.868235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.886178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-39f0395f-4875-4ae9-8c3b-ec633fa47160 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0459650 Dec 21 03:44:54.922261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.954342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Made reservation on behalf of 259704f866224ed694b05e3868cd9f5c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:54.957087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.958465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.961670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-004328d7-1289-4ebf-9785-d74e64e0eec3 None None] Provisioning complete for port 7858b624-ab23-47c3-8ea5-3fd3edbec98d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:54.961851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Router aa3076a7-dfbe-4587-b5a8-fe25629afc18 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:44:54.962842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-004328d7-1289-4ebf-9785-d74e64e0eec3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:54.984323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-cd9bfb92-d724-4a9c-9303-5b6252f798b6 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3785276 Dec 21 03:44:54.995887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05e7fc3b-5885-4683-8d75-180b83e057af req-4ee1556e-72f5-457f-8150-40fb7b00824a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1536944 Dec 21 03:44:55.073073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-004328d7-1289-4ebf-9785-d74e64e0eec3 None None] Port 7858b624-ab23-47c3-8ea5-3fd3edbec98d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:55.130350 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.151233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e41e147a-918c-4541-8fd1-dfd64ef99d55 req-e1fabcd1-e6a0-4426-9f67-1cc1d69fe591 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 210 time: 0.0461822 Dec 21 03:44:55.198960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f092222c-67f1-4e25-98aa-8743988ac6eb None None] Provisioning complete for port 6807c0f5-8451-4ed4-a51e-0d565a72e491 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:55.200609 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f092222c-67f1-4e25-98aa-8743988ac6eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.257358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f092222c-67f1-4e25-98aa-8743988ac6eb None None] Port 6807c0f5-8451-4ed4-a51e-0d565a72e491 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:55.368022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Allocated IP 172.25.5.20 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/4d190e16-8db9-4502-b2d0-caff34db66a1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:55.369754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-ca8df86d-9ddd-4d3a-bf21-f464e13a79b5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:55.371248 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-ca8df86d-9ddd-4d3a-bf21-f464e13a79b5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4651453 Dec 21 03:44:55.391072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4fb178-7b07-4e5e-a2c6-bd9f0ced8fad req-5c427dec-85e7-4af3-867b-dad35397bd78 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:55.392503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4fb178-7b07-4e5e-a2c6-bd9f0ced8fad req-5c427dec-85e7-4af3-867b-dad35397bd78 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 946 time: 0.1340849 Dec 21 03:44:55.434728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Request body: {'port': {'device_id': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '408f05064a77442595f2b5d444671b8a'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:55.452079 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1153b0e1-3c80-4276-81a3-644441936fa5 req-55a110b7-63ef-47a2-9049-982bc8a9a643 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4554858 Dec 21 03:44:55.518828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6807c0f5-8451-4ed4-a51e-0d565a72e491 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:55.523866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:44:55.525877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Allocated IP 172.20.0.2 (545d576d-bcad-43dd-a453-7df1e631e6e2/132b2a84-19ec-4b46-aad8-63966b0011e0/91a886a0-1771-4716-ac84-bee4f7ab2879) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:55.533019 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7886123a-ac35-4d24-9d6e-1dd7e0b3a0ef admin admin] 10.222.0.18 "PUT /v2.0/routers/aa3076a7-dfbe-4587-b5a8-fe25629afc18/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9615028 Dec 21 03:44:55.536551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.537442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Sync routers for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:44:55.582174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:55.582996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:55.590391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4fb178-7b07-4e5e-a2c6-bd9f0ced8fad req-75ccace3-d16d-4650-9d6c-d79d6b1ead04 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1859124 Dec 21 03:44:55.652831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Transition to ACTIVE for port object 6807c0f5-8451-4ed4-a51e-0d565a72e491 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:55.691048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.751336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-68424047-a7a7-4449-986e-643a8570ed40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:55.752915 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-68424047-a7a7-4449-986e-643a8570ed40 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1095 time: 0.1649404 Dec 21 03:44:55.755016 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.801023 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.829562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Made reservation on behalf of 408f05064a77442595f2b5d444671b8a for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:44:55.833636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.844527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c471a775-04e3-4556-9de0-04ad5fd6ff98 req-403de8e1-85bc-41fc-8a69-5943e732e738 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:55.846911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c471a775-04e3-4556-9de0-04ad5fd6ff98 req-403de8e1-85bc-41fc-8a69-5943e732e738 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 936 time: 0.1365252 Dec 21 03:44:55.848926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:55.851127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Pushing event updated for resources: {'Port': ['ID=6807c0f5-8451-4ed4-a51e-0d565a72e491,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:55.864810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 08d81f05-279a-4e14-ac86-e5e708e73032 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:55.936082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:55.948416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Attempting to bind port 6807c0f5-8451-4ed4-a51e-0d565a72e491 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:55.949172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Attempting to bind port 6807c0f5-8451-4ed4-a51e-0d565a72e491 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:55.949733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Attempting to bind port 6807c0f5-8451-4ed4-a51e-0d565a72e491 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:55.951618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:55.957989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:55.964608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:55.974515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Pushing event updated for resources: {'Port': ['ID=4d190e16-8db9-4502-b2d0-caff34db66a1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:55.977397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Port 6807c0f5-8451-4ed4-a51e-0d565a72e491 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:55.978045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Attempting to bind port 6807c0f5-8451-4ed4-a51e-0d565a72e491 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:55.991165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 08d81f05-279a-4e14-ac86-e5e708e73032 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:55.991414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.006377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:56.007080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:56.007656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:56.009484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Bound port: 6807c0f5-8451-4ed4-a51e-0d565a72e491, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:56.009484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.037737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c471a775-04e3-4556-9de0-04ad5fd6ff98 req-68004b82-674e-4868-946d-5901dfeb7d37 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1366749 Dec 21 03:44:56.104305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.150513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] For port 6807c0f5-8451-4ed4-a51e-0d565a72e491, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:56.153754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] For port 6807c0f5-8451-4ed4-a51e-0d565a72e491, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:56.204838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.234002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.296713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:53Z', 'revision_number': 2, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:56.326720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Checking router: aa3076a7-dfbe-4587-b5a8-fe25629afc18 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:44:56.327121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Updating router aa3076a7-dfbe-4587-b5a8-fe25629afc18 port 7858b624-ab23-47c3-8ea5-3fd3edbec98d binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:44:56.333524 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.355522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.357504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a8cfb99-1d17-4bc0-a734-2e3ad6914ba2 req-a726c966-e2ea-4019-83e3-06ffbcd42f4c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 210 time: 0.0633192 Dec 21 03:44:56.359867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Pushing event updated for resources: {'Port': ['ID=6807c0f5-8451-4ed4-a51e-0d565a72e491,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:56.383881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:56.389454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.389454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-4d5b3ec6-3dc1-4b95-90cf-a5839dd3ed3c service neutron] 10.222.0.54 "PUT /v2.0/ports/6807c0f5-8451-4ed4-a51e-0d565a72e491 HTTP/1.1" status: 200 len: 1097 time: 1.5235865 Dec 21 03:44:56.389454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'tag': '6807c0f5-8451-4ed4-a51e-0d565a72e491'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:56.389454 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99a038ff-48df-4473-8c38-7170ceb295eb" -d '{"events": [{"name": "network-changed", "server_uuid": "32d7a1bb-3071-42ac-82de-cf478fb10b00", "tag": "6807c0f5-8451-4ed4-a51e-0d565a72e491"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:56.448725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-8a69f466-7b8a-481b-8856-3ddd88507e19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:56.450131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-8a69f466-7b8a-481b-8856-3ddd88507e19 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.6728063 Dec 21 03:44:56.525367 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-f00bc1b7-f82b-4ee1-af1f-7e9b05fd3178 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 217 time: 0.0635624 Dec 21 03:44:56.546790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:56.582622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.602757 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.623957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Transition to ACTIVE for port object cf770d29-1c69-4f15-b07a-7cd04c2724a4 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:56.645318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-597afde1-8dc5-4e58-bbbc-45b8e0abf30b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:56.646887 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-597afde1-8dc5-4e58-bbbc-45b8e0abf30b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1111538 Dec 21 03:44:56.671277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Network 545d576d-bcad-43dd-a453-7df1e631e6e2 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:56.688070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:56.694113 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-1c92abed-f32e-4030-a7da-cba5d2c5c1c6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0358851 Dec 21 03:44:56.694698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:56.731569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.733279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Pushing event updated for resources: {'Port': ['ID=91a886a0-1771-4716-ac84-bee4f7ab2879,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:56.735481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-634255c8-1101-4f02-8a45-e7f2522ec471 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 258 time: 0.3280497 Dec 21 03:44:56.739315 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.753331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-27b0c8e8-33e6-4e97-9720-fb736e10b884 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:56.754871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-27b0c8e8-33e6-4e97-9720-fb736e10b884 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 1100 time: 0.1600628 Dec 21 03:44:56.759460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:56.821557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-8c01af97-320d-43a7-8c61-f83581fb045a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.146&port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491 HTTP/1.1" status: 200 len: 217 time: 0.0500004 Dec 21 03:44:56.825286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.882223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.888196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d1d4b97-0bbf-4615-a3a3-d9d3701db141 None None] Pushing event updated for resources: {'Port': ['ID=7858b624-ab23-47c3-8ea5-3fd3edbec98d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:56.891291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:56.891291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.913373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-5cba0f3d-e862-47fb-ab7d-0c12a6746467 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:56.914911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-5cba0f3d-e862-47fb-ab7d-0c12a6746467 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0843279 Dec 21 03:44:56.917228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:56.924957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Allocated IP 192.168.233.154 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/4e3a8359-5d74-431f-a914-f74c7cc55e15) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:56.974187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Attempting to bind port 7858b624-ab23-47c3-8ea5-3fd3edbec98d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:56.974631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Attempting to bind port 7858b624-ab23-47c3-8ea5-3fd3edbec98d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:56.975037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Attempting to bind port 7858b624-ab23-47c3-8ea5-3fd3edbec98d on network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:56.988180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:56.988180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Checking segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:56.988473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.988559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:56.988559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Bound using segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:56.988559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Bound port: 7858b624-ab23-47c3-8ea5-3fd3edbec98d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:56.988559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.038964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.050639 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-80c9cff0-ae86-4077-97a6-0a9bc1611eb5 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3306379 Dec 21 03:44:57.059934 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.063389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc45dde9-3424-4ffe-b548-387796ca8ea8 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.6454880 Dec 21 03:44:57.087869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Request body: {'port': {'device_id': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:57.089006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-9c365596-6cb7-4f3a-954e-343f18a14f5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:57.090517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-9c365596-6cb7-4f3a-954e-343f18a14f5c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1587203 Dec 21 03:44:57.097760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] For port 7858b624-ab23-47c3-8ea5-3fd3edbec98d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:57.104368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] For port 7858b624-ab23-47c3-8ea5-3fd3edbec98d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7858b624-ab23-47c3-8ea5-3fd3edbec98d,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:57.184040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Pushing event updated for resources: {'Port': ['ID=4d190e16-8db9-4502-b2d0-caff34db66a1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:57.191319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.228866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.230387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bc75aab1-f012-4830-b8a8-8998bc95ab1c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 2.7078001 Dec 21 03:44:57.289026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Attempting to bind port cf770d29-1c69-4f15-b07a-7cd04c2724a4 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:57.289026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Attempting to bind port cf770d29-1c69-4f15-b07a-7cd04c2724a4 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:57.289309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Attempting to bind port cf770d29-1c69-4f15-b07a-7cd04c2724a4 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:57.293657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:44:57.294874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:57.314992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-938c7d2f-e51e-4cc0-9694-7ef1c141464b tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.20 HTTP/1.1" status: 200 len: 695 time: 0.0760159 Dec 21 03:44:57.323826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-281a359e-e742-41c9-94b0-d0e50b7fcb8a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2214727 Dec 21 03:44:57.338692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Port cf770d29-1c69-4f15-b07a-7cd04c2724a4 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:57.339061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Attempting to bind port cf770d29-1c69-4f15-b07a-7cd04c2724a4 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:57.343331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d1d4b97-0bbf-4615-a3a3-d9d3701db141 None None] Pushing event updated for resources: {'Port': ['ID=7858b624-ab23-47c3-8ea5-3fd3edbec98d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:57.346790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.364948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-89c4d474-f5cd-404f-ad97-58dbeb6fdfa0 None None] Provisioning complete for port 7858b624-ab23-47c3-8ea5-3fd3edbec98d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:57.365602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89c4d474-f5cd-404f-ad97-58dbeb6fdfa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.473402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:57.473871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:57.474552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:57.474868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Bound port: cf770d29-1c69-4f15-b07a-7cd04c2724a4, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:57.475322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.506346 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e184d25c-4262-4979-8bf6-a74ef0047eaa req-375d0caa-c49e-4f4a-b8bd-295f8f1c13f7 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4323020 Dec 21 03:44:57.511144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:44:57.567509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89c4d474-f5cd-404f-ad97-58dbeb6fdfa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.635470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.669729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:57.674744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:57.696444 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:44:57.706495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-89c4d474-f5cd-404f-ad97-58dbeb6fdfa0 None None] For port 7858b624-ab23-47c3-8ea5-3fd3edbec98d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7858b624-ab23-47c3-8ea5-3fd3edbec98d,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:57.758050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.771609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:44:57.784992 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89c4d474-f5cd-404f-ad97-58dbeb6fdfa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.793989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.807499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 91a886a0-1771-4716-ac84-bee4f7ab2879 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:57.809144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.819726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:57.820341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.821748 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] 10.222.0.54 "PUT /v2.0/ports/cf770d29-1c69-4f15-b07a-7cd04c2724a4 HTTP/1.1" status: 200 len: 1097 time: 3.2359474 Dec 21 03:44:57.826267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:44:57.828054 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7117d6d-2e3f-4a39-a398-ba885fcef13a" -d '{"events": [{"name": "network-changed", "server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:44:57.835113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.835875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:57.867946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:57.867946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Transition to ACTIVE for port object 91a886a0-1771-4716-ac84-bee4f7ab2879 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:57.870370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:57.874395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:57.879033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50015242-fc53-497e-b579-dcaa4fac888d service neutron] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:57.891227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86ffdf12-1353-4745-a9d2-36a83abde138 req-5e5e8b69-14fa-4687-ad8b-996ccd04b555 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5541067 Dec 21 03:44:57.902025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-098899b7-37cb-4f88-aa1f-1fb24e2a4e0c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:57.904591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-098899b7-37cb-4f88-aa1f-1fb24e2a4e0c tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.5783000 Dec 21 03:44:57.956456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:57.965931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c4d474-f5cd-404f-ad97-58dbeb6fdfa0 None None] Pushing event updated for resources: {'Port': ['ID=7858b624-ab23-47c3-8ea5-3fd3edbec98d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:57.997607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:44:58.002613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bd51c79a-5757-4456-9d18-ce708fa92813 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:44:58.004796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a368eee7-d0b0-46c9-8643-3365c749d076 req-bd51c79a-5757-4456-9d18-ce708fa92813 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0456064 Dec 21 03:44:58.006907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:58.007592 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.018523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:58.081365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Allocated IP 172.25.5.194 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/af431c0b-bc02-4a67-9ff3-f2b2cb32a5ad) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:44:58.097168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-89641792-ae04-4356-852b-3c4157bf42ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:58.098912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-89641792-ae04-4356-852b-3c4157bf42ce service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1100 time: 0.0928161 Dec 21 03:44:58.104238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e938abe-3c6d-40a7-82bb-667acbca8407 None None] The sync data for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 is: [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:44:58.122564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:58.126272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Pushing event updated for resources: {'Port': ['ID=91a886a0-1771-4716-ac84-bee4f7ab2879,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:58.137116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-510d75ec-dfed-44cb-910f-507dc920e6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.7111013 Dec 21 03:44:58.157828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Request body: {'port': {'device_id': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:58.172288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-a99672f8-e918-4161-8ade-d03858fa7fc4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4 HTTP/1.1" status: 200 len: 217 time: 0.0543354 Dec 21 03:44:58.179434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'port_id': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'mac_address': 'fa:16:3e:91:59:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84e57960-b2b1-49b0-85de-36fd5e1ebd6a', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:44:58.190237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5d389b96-f017-4915-950a-af2cf3d67a1a None None] Provisioning complete for port 7858b624-ab23-47c3-8ea5-3fd3edbec98d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:58.190610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d389b96-f017-4915-950a-af2cf3d67a1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.302692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Attempting to bind port 91a886a0-1771-4716-ac84-bee4f7ab2879 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:58.303114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Attempting to bind port 91a886a0-1771-4716-ac84-bee4f7ab2879 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'c924054a-32a4-4063-a961-2d7b2907f729', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:58.303392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Attempting to bind port 91a886a0-1771-4716-ac84-bee4f7ab2879 on network 545d576d-bcad-43dd-a453-7df1e631e6e2 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:58.321893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.338957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.344452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Port 91a886a0-1771-4716-ac84-bee4f7ab2879 on network 545d576d-bcad-43dd-a453-7df1e631e6e2 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:58.344789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Attempting to bind port 91a886a0-1771-4716-ac84-bee4f7ab2879 on network 545d576d-bcad-43dd-a453-7df1e631e6e2 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:58.352632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:58.352978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Checking segment: {'id': 'c924054a-32a4-4063-a961-2d7b2907f729', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:58.353371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Bound using segment: {'id': 'c924054a-32a4-4063-a961-2d7b2907f729', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:58.353814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Bound port: 91a886a0-1771-4716-ac84-bee4f7ab2879, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c924054a-32a4-4063-a961-2d7b2907f729', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:58.354615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.437824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.469211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-970a5c51-e2b8-4804-bf98-f9ac4c5e8473 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:58.471209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-970a5c51-e2b8-4804-bf98-f9ac4c5e8473 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1241722 Dec 21 03:44:58.570514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-0ad27ef8-102a-473d-8b6b-fa3043820590 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:58.572077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-0ad27ef8-102a-473d-8b6b-fa3043820590 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0879323 Dec 21 03:44:58.626023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.672924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ac725df3-7862-483f-82a4-1cc27a3a5efa {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:58.712627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] For port 91a886a0-1771-4716-ac84-bee4f7ab2879, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:58.731815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] For port 91a886a0-1771-4716-ac84-bee4f7ab2879, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=91a886a0-1771-4716-ac84-bee4f7ab2879,segment=NetworkSegment(c924054a-32a4-4063-a961-2d7b2907f729),segment_id=c924054a-32a4-4063-a961-2d7b2907f729)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:58.776842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:44:58.792964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:44:58.800737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:44:58.805872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:44:58.824759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event updated for resources: {'Port': ['ID=af431c0b-bc02-4a67-9ff3-f2b2cb32a5ad,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:58.846762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.852764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-d92ec0a8-4342-4aeb-a0e3-3bf8e7d535a7 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2716322 Dec 21 03:44:58.898828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.899930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:58.900910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.902594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] 10.222.0.54 "PUT /v2.0/ports/91a886a0-1771-4716-ac84-bee4f7ab2879 HTTP/1.1" status: 200 len: 1092 time: 1.8199310 Dec 21 03:44:58.904225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.939251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc14b4bb-5849-4e3f-a1ec-d42cc48483f0 service neutron] Pushing event updated for resources: {'Port': ['ID=91a886a0-1771-4716-ac84-bee4f7ab2879,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:58.943438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b5d5f29c-e019-4943-be70-179ed13a1b37 None None] Provisioning complete for port 4e3a8359-5d74-431f-a914-f74c7cc55e15 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:58.944035 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b5d5f29c-e019-4943-be70-179ed13a1b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:58.972073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69a99d6f-c360-41cf-a2b9-a2d952369491 req-fed20cee-9d08-484f-8aaf-9aa581c02638 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1092083 Dec 21 03:44:59.000264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:59.001823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4e3a8359-5d74-431f-a914-f74c7cc55e15 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:44:59.004823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b5d5f29c-e019-4943-be70-179ed13a1b37 None None] Port 4e3a8359-5d74-431f-a914-f74c7cc55e15 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:44:59.011976 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.028807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Transition to ACTIVE for port object 4e3a8359-5d74-431f-a914-f74c7cc55e15 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:44:59.029655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43432) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:59.035642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Request body: {'security_group': {'name': 'tempest-securitygroup--787839608', 'description': 'tempest-description--1219857815'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:59.049383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.093673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.167719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-6339828e-2d43-4652-b697-d6c0e46fa2fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.168623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.169243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-6339828e-2d43-4652-b697-d6c0e46fa2fa service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=259704f866224ed694b05e3868cd9f5c&device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 1095 time: 0.0962429 Dec 21 03:44:59.197081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a3b07fc-12f6-43a8-ac04-14a3d103f58a req-0cf4ecce-f480-4016-b924-cafc8b0ed64b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.198598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a3b07fc-12f6-43a8-ac04-14a3d103f58a req-0cf4ecce-f480-4016-b924-cafc8b0ed64b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.1109412 Dec 21 03:44:59.206949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:59.241091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['ac725df3-7862-483f-82a4-1cc27a3a5efa'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:44:59.271609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Attempting to bind port 4e3a8359-5d74-431f-a914-f74c7cc55e15 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:44:59.272380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Attempting to bind port 4e3a8359-5d74-431f-a914-f74c7cc55e15 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:44:59.272811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Attempting to bind port 4e3a8359-5d74-431f-a914-f74c7cc55e15 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:59.276559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-7ac52be4-24a5-49ac-8b9d-e8b562b7cfcb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=91a886a0-1771-4716-ac84-bee4f7ab2879 HTTP/1.1" status: 200 len: 217 time: 0.0752125 Dec 21 03:44:59.281538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Port 4e3a8359-5d74-431f-a914-f74c7cc55e15 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:44:59.281824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Attempting to bind port 4e3a8359-5d74-431f-a914-f74c7cc55e15 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:44:59.288320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:44:59.288723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:44:59.289594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:44:59.289735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Bound port: 4e3a8359-5d74-431f-a914-f74c7cc55e15, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:44:59.290174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.348300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.388296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-3ee5e6ed-8aba-4d4c-9fbc-07242bec2ef7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.389775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-3ee5e6ed-8aba-4d4c-9fbc-07242bec2ef7 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=132b2a84-19ec-4b46-aad8-63966b0011e0 HTTP/1.1" status: 200 len: 855 time: 0.1035459 Dec 21 03:44:59.396284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:44:59.399715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:44:59.400097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a3b07fc-12f6-43a8-ac04-14a3d103f58a req-0b935ecf-e314-4efa-a494-152decec55dc tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1904016 Dec 21 03:44:59.413564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.430168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-4f87e3a2-00aa-49be-87ad-f7627f2d877b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=545d576d-bcad-43dd-a453-7df1e631e6e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0276821 Dec 21 03:44:59.458183 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.463436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d37501a6-0469-46d6-b49f-78211ef2e8d1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:59.472295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.511717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.515945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ee86e67-c62a-48ad-81da-22f0b8d0805b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.4850302 Dec 21 03:44:59.516549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43434) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:44:59.525299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Request body: {'security_group_rule': {'security_group_id': 'd37501a6-0469-46d6-b49f-78211ef2e8d1', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:44:59.530124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.530748 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.532205 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] 10.222.0.31 "PUT /v2.0/ports/4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 1097 time: 1.3786128 Dec 21 03:44:59.540105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.570433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3928213e-1669-47db-83b1-4f082aec17d4 service neutron] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:59.622623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.663141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event updated for resources: {'Port': ['ID=af431c0b-bc02-4a67-9ff3-f2b2cb32a5ad,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:44:59.675852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.679496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-39659ab1-6c44-4c8d-afd1-dc7f0180f3e9 service neutron] 10.222.0.54 "GET /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2184484 Dec 21 03:44:59.700291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b659a87-faa0-4ad6-839f-88af4830af4e req-26107ac6-cb7e-4d21-8abf-fcb16e420de1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.707555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b659a87-faa0-4ad6-839f-88af4830af4e req-26107ac6-cb7e-4d21-8abf-fcb16e420de1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 943 time: 0.1684129 Dec 21 03:44:59.745256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-617ea024-207e-42f1-8273-35497d070e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.746779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-617ea024-207e-42f1-8273-35497d070e26 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1100 time: 0.0818996 Dec 21 03:44:59.819009 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-dfb0ad74-a862-4619-88f6-a48c0ad31536 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.154&port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 217 time: 0.0495231 Dec 21 03:44:59.865562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7858b624-ab23-47c3-8ea5-3fd3edbec98d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:44:59.868507 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.870248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-6954dd6c-60a2-4271-875b-8b75131a054e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.1144416 Dec 21 03:44:59.880343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.892955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-690971c5-8bb9-461e-b797-31cb9484f2c5 req-a82c3346-ce2b-48aa-8808-1368fef13539 service neutron] 10.222.0.54 "GET /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2038009 Dec 21 03:44:59.899273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-63461c0e-ca96-483c-853c-b75a5c0d3ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.901127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-63461c0e-ca96-483c-853c-b75a5c0d3ebd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0706475 Dec 21 03:44:59.955145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.957626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-d78a8eb4-8198-40d1-b30b-5dd97876ce1e tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 696 time: 0.0715189 Dec 21 03:44:59.959039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7858b624-ab23-47c3-8ea5-3fd3edbec98d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:44:59.959915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:44:59.983428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-12ce2fd3-27d3-44a6-8c16-6394a5894cdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:44:59.989435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-12ce2fd3-27d3-44a6-8c16-6394a5894cdc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0758123 Dec 21 03:44:59.989435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d4ad765-6d05-4b17-999e-1bf54c2ea61e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:00.068504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b659a87-faa0-4ad6-839f-88af4830af4e req-546a90e0-583a-4be3-b24a-c7580d85cf33 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2267280 Dec 21 03:45:00.085157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.086354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-032227f6-e47f-41ba-944b-34ee12d31a97 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5644987 Dec 21 03:45:00.089209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:00.093770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Request body: {'security_group_rule': {'security_group_id': 'd37501a6-0469-46d6-b49f-78211ef2e8d1', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:00.122660 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab1e6118-bbf1-4e59-bc92-a09f103d6a56 x-openstack-request-id: req-ab1e6118-bbf1-4e59-bc92-a09f103d6a56 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:00.124308 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "32d7a1bb-3071-42ac-82de-cf478fb10b00", "tag": "6807c0f5-8451-4ed4-a51e-0d565a72e491", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:00.124653 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ab1e6118-bbf1-4e59-bc92-a09f103d6a56 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:00.125142 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'tag': '6807c0f5-8451-4ed4-a51e-0d565a72e491', 'status': 'completed', 'code': 200} Dec 21 03:45:00.141439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-2a1f49bc-9f6f-416c-855d-c7eaf0d377f7 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1462839 Dec 21 03:45:00.145775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-7f4bc2ac-f48e-4cf4-b4bd-408b340d5ece tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.147346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3abec6f-9349-45e5-9fbc-d34737d492c9 req-7f4bc2ac-f48e-4cf4-b4bd-408b340d5ece tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1772826 Dec 21 03:45:00.231644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.257847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a038ff-48df-4473-8c38-7170ceb295eb req-34bea60c-9914-49ed-a99b-54fba2f5bd39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.259902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-34bea60c-9914-49ed-a99b-54fba2f5bd39 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 1100 time: 0.0738733 Dec 21 03:45:00.269679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2796a67-c105-4d56-ac5d-5ab43f62729b req-119f6531-b999-4043-b34a-34c34b3d81a9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.271292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2796a67-c105-4d56-ac5d-5ab43f62729b req-119f6531-b999-4043-b34a-34c34b3d81a9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 948 time: 0.0972223 Dec 21 03:45:00.309138 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f54c67cb-1c2c-4a0f-aac2-0b8cef4b55bd req-9e6a0d77-3926-431a-a156-afb389718105 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1574767 Dec 21 03:45:00.316275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.385277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.408076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e2499da6-bc50-4796-90a0-07f15e9a60f3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:00.412488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2796a67-c105-4d56-ac5d-5ab43f62729b req-01340d74-e781-44a9-b09f-0f6f2bf0b08f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304607 Dec 21 03:45:00.439130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1189b8-0215-4061-a710-fb5912f3742d req-22830d13-188f-40ca-9c67-8849c036a231 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.441347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef1189b8-0215-4061-a710-fb5912f3742d req-22830d13-188f-40ca-9c67-8849c036a231 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 948 time: 0.1246762 Dec 21 03:45:00.442498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a038ff-48df-4473-8c38-7170ceb295eb req-9e735f6c-e205-41a6-98b0-bc666284e5da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.443840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-9e735f6c-e205-41a6-98b0-bc666284e5da service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1716185 Dec 21 03:45:00.458695 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:44:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25455a45-9a96-483c-9bac-f89eddaf52c1 x-openstack-request-id: req-25455a45-9a96-483c-9bac-f89eddaf52c1 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:00.459301 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:00.459818 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-25455a45-9a96-483c-9bac-f89eddaf52c1 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:00.460429 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'status': 'completed', 'code': 200} Dec 21 03:45:00.467398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.469354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4213a82b-3de7-4d6f-a46b-f8e6f9b5a8a6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3792279 Dec 21 03:45:00.472314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43444) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:00.476754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:00.497094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-8963414f-988f-4e69-84e0-16f3b5af6af3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.146&port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491 HTTP/1.1" status: 200 len: 217 time: 0.0440509 Dec 21 03:45:00.547134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.553086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-c3ea3fb0-0c58-4dfb-948d-a753f5df4f53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.554591 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-c3ea3fb0-0c58-4dfb-948d-a753f5df4f53 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1100 time: 0.0430951 Dec 21 03:45:00.588501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d1da461-f872-4208-9a34-0cb182516591 req-6cfea434-dab4-4695-b72b-4231911a78d4 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips/ace375c8-df40-4f87-b1ff-0259ccec85cd HTTP/1.1" status: 200 len: 692 time: 0.0939939 Dec 21 03:45:00.598724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef1189b8-0215-4061-a710-fb5912f3742d req-9fd1ebcf-5cc0-4fd5-89cb-0554d7a05592 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1515601 Dec 21 03:45:00.638081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a038ff-48df-4473-8c38-7170ceb295eb req-e1c67b7f-6512-4baa-bd53-82e676f1df2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.639496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-e1c67b7f-6512-4baa-bd53-82e676f1df2a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1284938 Dec 21 03:45:00.707143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-4442954a-495c-4a03-a5c8-e7cc334ef881 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.708596 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-4442954a-495c-4a03-a5c8-e7cc334ef881 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1451831 Dec 21 03:45:00.765974 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-59fb221f-5fff-42b3-a9c6-59ec5c89c84f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4 HTTP/1.1" status: 200 len: 217 time: 0.0366361 Dec 21 03:45:00.767339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:00.769853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1da461-f872-4208-9a34-0cb182516591 req-948a9997-42eb-4388-bae9-722c451c069e tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.771247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d1da461-f872-4208-9a34-0cb182516591 req-948a9997-42eb-4388-bae9-722c451c069e tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1762640 Dec 21 03:45:00.774736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a038ff-48df-4473-8c38-7170ceb295eb req-287c2427-b703-4a74-a25c-9be5ca6331a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.776130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-287c2427-b703-4a74-a25c-9be5ca6331a9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1046665 Dec 21 03:45:00.784850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-c024f5c6-afbd-4ee4-b200-9f650f147d94 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.786250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-c024f5c6-afbd-4ee4-b200-9f650f147d94 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 946 time: 0.1158700 Dec 21 03:45:00.859663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-1aefe4c7-c229-45be-b674-a2d7ee64ff3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.861130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-1aefe4c7-c229-45be-b674-a2d7ee64ff3c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0862453 Dec 21 03:45:00.919370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d1da461-f872-4208-9a34-0cb182516591 req-039a9345-3c52-49fb-b795-3195d38b9eaa tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.20 HTTP/1.1" status: 200 len: 695 time: 0.1321468 Dec 21 03:45:00.924756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-5da5829e-0f9f-41c6-8fd8-78dd05df1d09 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 696 time: 0.1292667 Dec 21 03:45:00.945048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Allocated IP 172.25.5.229 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/40e63e72-c385-43ec-94ea-84400fa5a08a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:00.950652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-1f56c970-cd85-4ad9-ad8a-b90560c2d90e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:00.952173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-1f56c970-cd85-4ad9-ad8a-b90560c2d90e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0830884 Dec 21 03:45:00.970194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Request body: {'floatingip': {'port_id': '742f0270-e348-4b05-82d9-88e6e724dc14', 'fixed_ip_address': '172.20.0.10'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:01.022067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d1da461-f872-4208-9a34-0cb182516591 req-2d3f01eb-9896-4513-bd91-d45b1c72b5fc tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.20 HTTP/1.1" status: 200 len: 695 time: 0.0930996 Dec 21 03:45:01.036969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.381594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-68afe1d1-4588-4f7e-9c99-5894cd36fcf7 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4197693 Dec 21 03:45:01.391040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-1461bbbd-f57d-4b7b-a98f-02a275580386 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6027830 Dec 21 03:45:01.391240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.494282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:01.499048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7117d6d-2e3f-4a39-a398-ba885fcef13a req-9e574d78-5c18-4085-a67f-366f8f0b2a53 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1055441 Dec 21 03:45:01.568646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.616001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:01.619586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:01.619825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:01.623703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:01.625680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event updated for resources: {'Port': ['ID=40e63e72-c385-43ec-94ea-84400fa5a08a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:01.639012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'mac_address': 'fa:16:3e:61:86:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:01.650863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a038ff-48df-4473-8c38-7170ceb295eb req-ff6fa56f-b37b-4673-9f52-660e0ec7d1e8 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2365475 Dec 21 03:45:01.690409 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.701907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Deleting port 4d190e16-8db9-4502-b2d0-caff34db66a1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:01.702241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.707401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:01.726542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.729202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:01.780511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:01.806053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.806693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6807c0f5-8451-4ed4-a51e-0d565a72e491 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:01.881881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.889510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.889721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:01.889839 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.893350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6807c0f5-8451-4ed4-a51e-0d565a72e491, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:01.908372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Calling delete_port for 4d190e16-8db9-4502-b2d0-caff34db66a1 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:01.908525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '6807c0f5-8451-4ed4-a51e-0d565a72e491', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '6807c0f5-8451-4ed4-a51e-0d565a72e491', 'mac_address': 'fa:16:3e:fb:38:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.146'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:01.949892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:01.963048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6807c0f5-8451-4ed4-a51e-0d565a72e491 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:01.974923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port ac725df3-7862-483f-82a4-1cc27a3a5efa completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:01.985460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6807c0f5-8451-4ed4-a51e-0d565a72e491, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:01.987120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port ac725df3-7862-483f-82a4-1cc27a3a5efa triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:01.987493 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.047555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.054944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.055735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.091235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.129238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:02.131460 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd62f9fb-9f71-4415-aed6-3da0c7c71cf9" -d '{"events": [{"server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "name": "network-vif-plugged", "status": "completed", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:02.133440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.143914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6807c0f5-8451-4ed4-a51e-0d565a72e491,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:02.151636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:02.156385 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.206581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event updated for resources: {'Port': ['ID=40e63e72-c385-43ec-94ea-84400fa5a08a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:02.216610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.236153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.242105 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.275336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Pushing event deleted for resources: {'Port': ['ID=4d190e16-8db9-4502-b2d0-caff34db66a1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:02.300833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:02.305293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.307819 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.308961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d1da461-f872-4208-9a34-0cb182516591 req-018abbfb-92f6-4ee3-8345-29db997ed102 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "DELETE /v2.0/floatingips/ace375c8-df40-4f87-b1ff-0259ccec85cd HTTP/1.1" status: 204 len: 173 time: 1.2806580 Dec 21 03:45:02.310374 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Floating IP c9b308b1-ac49-4887-88d7-b116974f8653 associated. External IP: 172.25.5.194, port: 742f0270-e348-4b05-82d9-88e6e724dc14. Dec 21 03:45:02.318617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.327658 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9f649f9f-813c-4b77-9e5c-761ed7d5a82c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.8543327 Dec 21 03:45:02.395970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cf770d29-1c69-4f15-b07a-7cd04c2724a4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:02.423211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6807c0f5-8451-4ed4-a51e-0d565a72e491'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:02.459363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077b378e-7f3d-4af1-b11b-75bea334c2db req-f65ca638-25e6-457c-bb8e-c816e12da5ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:02.460881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-077b378e-7f3d-4af1-b11b-75bea334c2db req-f65ca638-25e6-457c-bb8e-c816e12da5ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 968 time: 0.0671148 Dec 21 03:45:02.461709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'tag': '91a886a0-1771-4716-ac84-bee4f7ab2879'}, {'name': 'network-changed', 'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:02.463752 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77e3c616-c87d-4776-a7b0-2deee6e1419d" -d '{"events": [{"name": "network-changed", "server_uuid": "bbaddaa0-3286-4622-94fe-6e23a7e61c09", "tag": "91a886a0-1771-4716-ac84-bee4f7ab2879"}, {"name": "network-changed", "server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:02.597048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-077b378e-7f3d-4af1-b11b-75bea334c2db req-f207090b-a6dc-4f3b-b7a7-9208ea4eb27d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0975046 Dec 21 03:45:02.650272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:02.794227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3316c361-46e5-4e58-a36e-efa363993e27 req-14b2469d-80f5-4296-b5b1-792b0ae96ead tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:02.795721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3316c361-46e5-4e58-a36e-efa363993e27 req-14b2469d-80f5-4296-b5b1-792b0ae96ead tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 945 time: 0.0895061 Dec 21 03:45:02.819322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:02.824326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:02.832543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] Sync routers for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:02.846711 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:02.849718 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:02.876973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-71c01954-5deb-4401-8b80-11744b169dad tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "PUT /v2.0/floatingips/c9b308b1-ac49-4887-88d7-b116974f8653 HTTP/1.1" status: 200 len: 997 time: 1.9334321 Dec 21 03:45:02.889531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:02.891645 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d03e755d-2f13-4e03-92e4-9388a6490835" -d '{"events": [{"name": "network-changed", "server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:02.918167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3316c361-46e5-4e58-a36e-efa363993e27 req-eec59c65-4e9d-4160-b24a-6379850060ac tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1152196 Dec 21 03:45:02.932477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-bf81131b-5d30-4737-8dd4-5212dd5c6aaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:02.940676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-bf81131b-5d30-4737-8dd4-5212dd5c6aaa service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1098 time: 0.0628076 Dec 21 03:45:02.997126 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:03.032642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-19f03788-4951-4bb9-bbfc-72c7f0840d33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:03.039299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-19f03788-4951-4bb9-bbfc-72c7f0840d33 service neutron] 10.222.0.18 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 928 time: 0.0974019 Dec 21 03:45:03.137794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-f94ccd65-30d5-49f0-9b1a-473d2fb55f53 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 1000 time: 0.0965269 Dec 21 03:45:03.149574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e15532-f823-47c4-8896-176a6e7c58db req-18cd5f4d-236a-439c-bf70-c6131accfe85 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:03.151268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17e15532-f823-47c4-8896-176a6e7c58db req-18cd5f4d-236a-439c-bf70-c6131accfe85 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 943 time: 0.1111810 Dec 21 03:45:03.227930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-7457d392-913e-4500-83c4-f568587c60d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:03.229426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-7457d392-913e-4500-83c4-f568587c60d9 service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 200 len: 866 time: 0.0767338 Dec 21 03:45:03.234696 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c9b308b1-ac49-4887-88d7-b116974f8653', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'floating_ip_address': '172.25.5.194', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'port_id': '742f0270-e348-4b05-82d9-88e6e724dc14', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 525, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'mac_address': 'fa:16:3e:6d:af:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:44:58Z', 'updated_at': '2021-12-21T03:45:01Z', 'revision_number': 1, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:37Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:03.252444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17e15532-f823-47c4-8896-176a6e7c58db req-302a63e0-4939-4902-903e-80a0e67a3ed3 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0916245 Dec 21 03:45:03.268215 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] Checking router: 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:03.278712 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:03.280057 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:03.297044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-c51dc725-6039-4d0a-b5cc-9a369a12bf39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:03.299387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-c51dc725-6039-4d0a-b5cc-9a369a12bf39 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0601168 Dec 21 03:45:03.405944 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:03.444651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5118e7a-617a-4cc2-a2a5-0a5adde9df33 req-b0d64427-9af2-4070-b8eb-31c565d004b2 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:03.447021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5118e7a-617a-4cc2-a2a5-0a5adde9df33 req-b0d64427-9af2-4070-b8eb-31c565d004b2 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 949 time: 0.0998156 Dec 21 03:45:03.449748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-1d7b6757-7205-4543-a00b-20fff4398fba service neutron] 10.222.0.18 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1428189 Dec 21 03:45:03.509997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 91a886a0-1771-4716-ac84-bee4f7ab2879 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:03.526706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:03.570003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5118e7a-617a-4cc2-a2a5-0a5adde9df33 req-ad82252a-f6a7-4a33-adfc-1efd59c7eb19 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124396 Dec 21 03:45:03.610778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea91a47-b4a3-4e88-8440-1d887f218549 req-bb4ce4dc-ce4d-43c9-89a3-e427902bd8e4 service neutron] 10.222.0.18 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1544402 Dec 21 03:45:03.751198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 91a886a0-1771-4716-ac84-bee4f7ab2879, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=91a886a0-1771-4716-ac84-bee4f7ab2879,segment=NetworkSegment(c924054a-32a4-4063-a961-2d7b2907f729),segment_id=c924054a-32a4-4063-a961-2d7b2907f729)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:03.759498 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67e08306-b0fe-412d-bb67-93da950a1979 x-openstack-request-id: req-67e08306-b0fe-412d-bb67-93da950a1979 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:03.759926 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "name": "network-vif-plugged", "status": "completed", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:03.760339 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-67e08306-b0fe-412d-bb67-93da950a1979 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:03.764621 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'code': 200} Dec 21 03:45:03.778199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:03.848659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59472c88-1448-4fab-86e2-1958bceee553 req-cec3f8dc-fbff-4274-954c-100f62b0c8c0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:03.850514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59472c88-1448-4fab-86e2-1958bceee553 req-cec3f8dc-fbff-4274-954c-100f62b0c8c0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 948 time: 0.1534543 Dec 21 03:45:03.851992 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-9936a670-c51f-447e-af9a-7d5c6f4ef159 req-37388296-4c53-45ea-9f9d-40d574790499 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] show failed (client error): The resource could not be found. Dec 21 03:45:03.865868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9936a670-c51f-447e-af9a-7d5c6f4ef159 req-37388296-4c53-45ea-9f9d-40d574790499 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips/ace375c8-df40-4f87-b1ff-0259ccec85cd HTTP/1.1" status: 404 len: 350 time: 0.0991995 Dec 21 03:45:03.884462 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c9b308b1-ac49-4887-88d7-b116974f8653', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'floating_ip_address': '172.25.5.194', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'port_id': '742f0270-e348-4b05-82d9-88e6e724dc14', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 525, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'mac_address': 'fa:16:3e:6d:af:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:44:58Z', 'updated_at': '2021-12-21T03:45:01Z', 'revision_number': 1, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:37Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:03.907622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:03.921736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'mac_address': 'fa:16:3e:8b:ca:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.154'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:03.925086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '91a886a0-1771-4716-ac84-bee4f7ab2879', 'network_id': '545d576d-bcad-43dd-a453-7df1e631e6e2', 'port_id': '91a886a0-1771-4716-ac84-bee4f7ab2879', 'mac_address': 'fa:16:3e:9f:29:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 117, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '132b2a84-19ec-4b46-aad8-63966b0011e0', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:03.929058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port cf770d29-1c69-4f15-b07a-7cd04c2724a4 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:03.933161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-217b0f90-b0ba-4fa8-b9a8-ef26306ab16f None None] The sync data for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 is: [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c9b308b1-ac49-4887-88d7-b116974f8653', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'floating_ip_address': '172.25.5.194', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'port_id': '742f0270-e348-4b05-82d9-88e6e724dc14', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 525, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'mac_address': 'fa:16:3e:6d:af:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:44:58Z', 'updated_at': '2021-12-21T03:45:01Z', 'revision_number': 1, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:37Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:03.936184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port cf770d29-1c69-4f15-b07a-7cd04c2724a4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:03.936809 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:03.947657 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eef2d40d-3dff-4408-b752-276f00436e84 x-openstack-request-id: req-eef2d40d-3dff-4408-b752-276f00436e84 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:03.948241 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bbaddaa0-3286-4622-94fe-6e23a7e61c09", "tag": "91a886a0-1771-4716-ac84-bee4f7ab2879", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:03.948241 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eef2d40d-3dff-4408-b752-276f00436e84 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:03.950087 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'tag': '91a886a0-1771-4716-ac84-bee4f7ab2879', 'status': 'completed', 'code': 200} Dec 21 03:45:03.950362 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'status': 'completed', 'code': 200} Dec 21 03:45:03.977339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59472c88-1448-4fab-86e2-1958bceee553 req-454c9116-ca8f-43f0-8743-ee60d886b81b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1102364 Dec 21 03:45:04.014468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5a99ed-c74f-4c1b-9944-0e3bd9079a90 req-6c200162-1dd9-4da1-97da-bd680c71dc95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.029179 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b5a99ed-c74f-4c1b-9944-0e3bd9079a90 req-6c200162-1dd9-4da1-97da-bd680c71dc95 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1097 time: 0.1761055 Dec 21 03:45:04.059709 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce12ab7e-2920-46f8-a3c9-58344218c853 x-openstack-request-id: req-ce12ab7e-2920-46f8-a3c9-58344218c853 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:04.059997 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:04.060260 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ce12ab7e-2920-46f8-a3c9-58344218c853 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:04.060663 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14', 'status': 'completed', 'code': 200} Dec 21 03:45:04.110984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:04.150133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:04.154377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 91a886a0-1771-4716-ac84-bee4f7ab2879 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:04.211113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4e3a8359-5d74-431f-a914-f74c7cc55e15 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:04.221935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 91a886a0-1771-4716-ac84-bee4f7ab2879, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=91a886a0-1771-4716-ac84-bee4f7ab2879,segment=NetworkSegment(c924054a-32a4-4063-a961-2d7b2907f729),segment_id=c924054a-32a4-4063-a961-2d7b2907f729)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:04.224491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-69868ca5-d105-4bec-ac63-9f6845273d78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.230517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-69868ca5-d105-4bec-ac63-9f6845273d78 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1100 time: 0.1971312 Dec 21 03:45:04.240139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-c01076af-3066-4e9a-9cdc-d5f59233d43c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.244384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-c01076af-3066-4e9a-9cdc-d5f59233d43c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1098 time: 0.1092837 Dec 21 03:45:04.246278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-77fefdc3-7006-4f76-b0da-ada8b7c349ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.247652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-77fefdc3-7006-4f76-b0da-ada8b7c349ec service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=259704f866224ed694b05e3868cd9f5c&device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 1095 time: 0.2643163 Dec 21 03:45:04.262770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:04.267010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:04.308337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b5a99ed-c74f-4c1b-9944-0e3bd9079a90 req-e4340eed-5dd4-4d62-acdc-d1507a0350fa service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2301548 Dec 21 03:45:04.322132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:04.335844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:04.404109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-5eb5b0dd-c912-4506-a868-91660162fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 258 time: 0.3293617 Dec 21 03:45:04.412061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:04.413026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-ec40d82c-fbe1-42f6-a35a-da3508aba9df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.415270 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-ec40d82c-fbe1-42f6-a35a-da3508aba9df service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1718388 Dec 21 03:45:04.417954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=91a886a0-1771-4716-ac84-bee4f7ab2879,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:04.426983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:04.427856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6807c0f5-8451-4ed4-a51e-0d565a72e491 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:04.430348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23d239c5-571c-4ea3-8724-015b4d0cf5b6 None None] New status for floating IP c9b308b1-ac49-4887-88d7-b116974f8653: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:45:04.436185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:04.639123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:04.675760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['91a886a0-1771-4716-ac84-bee4f7ab2879'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:04.678435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-2ba7f42f-dd55-4cdf-9319-a3db3e71b0cd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.154&port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 217 time: 0.0625074 Dec 21 03:45:04.805951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:04.808143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-963681ec-ecb3-41d9-a1be-b34ae8db34a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.810166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-963681ec-ecb3-41d9-a1be-b34ae8db34a1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1105285 Dec 21 03:45:04.885381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-fd7bba6d-ce68-470c-806a-15b092fb9aef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:04.886994 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-fd7bba6d-ce68-470c-806a-15b092fb9aef service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0586579 Dec 21 03:45:04.974820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 6807c0f5-8451-4ed4-a51e-0d565a72e491 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:04.989393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:05.003486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 6807c0f5-8451-4ed4-a51e-0d565a72e491 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:05.004072 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:05.037502 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-28985570-63f3-4985-a41d-2b115468e6c9 req-79a03378-8a1f-4ecb-b800-28ce6c653b34 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] show failed (client error): The resource could not be found. Dec 21 03:45:05.049487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:05.056706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28985570-63f3-4985-a41d-2b115468e6c9 req-79a03378-8a1f-4ecb-b800-28ce6c653b34 tempest-FloatingIPsTestJSON-277952988 tempest-FloatingIPsTestJSON-277952988-project] 10.222.0.18 "GET /v2.0/floatingips/ace375c8-df40-4f87-b1ff-0259ccec85cd HTTP/1.1" status: 404 len: 350 time: 0.1244786 Dec 21 03:45:05.139580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-afb3a6f8-470c-402d-9471-73390b7e3f55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:05.141045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-afb3a6f8-470c-402d-9471-73390b7e3f55 service neutron] 10.222.0.31 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 928 time: 0.8862135 Dec 21 03:45:05.148400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-70d365da-2c13-4cbb-82ba-a0c92555d024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:05.150184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-70d365da-2c13-4cbb-82ba-a0c92555d024 service neutron] 10.222.0.54 "GET /v2.0/networks?id=545d576d-bcad-43dd-a453-7df1e631e6e2 HTTP/1.1" status: 200 len: 916 time: 0.8712869 Dec 21 03:45:05.172490 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-cee24aef-14dd-4db4-8fc9-788400afaae4 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2715189 Dec 21 03:45:05.223279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:05.235756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-ab084d81-5116-4d89-9420-c9129ba5d696 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 1002 time: 0.0838444 Dec 21 03:45:05.297404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-a731fd1b-52cb-470d-82a5-c62209fa7e0c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=91a886a0-1771-4716-ac84-bee4f7ab2879 HTTP/1.1" status: 200 len: 217 time: 0.0607564 Dec 21 03:45:05.298121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:05.315541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6807c0f5-8451-4ed4-a51e-0d565a72e491, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:05.374980 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:05.404407 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-657eefe0-3f49-42bd-aeb1-4d2bea527d47 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2218804 Dec 21 03:45:05.451907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6807c0f5-8451-4ed4-a51e-0d565a72e491,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:05.477644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-d37760a4-7c2b-4102-8387-5532fdbab899 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:05.479141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-d37760a4-7c2b-4102-8387-5532fdbab899 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 200 len: 866 time: 0.1773500 Dec 21 03:45:05.482145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-b9c0864c-c32f-4ac4-b930-b30ee883d1ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:05.483527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-b9c0864c-c32f-4ac4-b930-b30ee883d1ef service neutron] 10.222.0.54 "GET /v2.0/subnets?id=132b2a84-19ec-4b46-aad8-63966b0011e0 HTTP/1.1" status: 200 len: 855 time: 0.1475773 Dec 21 03:45:05.492939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4085bc-8359-4bde-92bd-1f78cceda9a8 req-26b2c75d-68c3-4a83-8b95-d571649d3f7b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:05.494377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c4085bc-8359-4bde-92bd-1f78cceda9a8 req-26b2c75d-68c3-4a83-8b95-d571649d3f7b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 945 time: 0.2562277 Dec 21 03:45:05.588137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-a73c6431-fa79-4b19-a17e-8adba8858cd9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=545d576d-bcad-43dd-a453-7df1e631e6e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0927079 Dec 21 03:45:05.677804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c4085bc-8359-4bde-92bd-1f78cceda9a8 req-10d056ce-8102-4bbb-ba0c-493e612795f5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1553640 Dec 21 03:45:05.678815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:05.735206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-7f332cb4-3783-4636-a26c-999a209084df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:05.737349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-7f332cb4-3783-4636-a26c-999a209084df service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1999352 Dec 21 03:45:05.765792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'}, {'server_uuid': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6807c0f5-8451-4ed4-a51e-0d565a72e491'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:05.768597 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9eaffe7-64ea-45ef-8b40-649466efebc9" -d '{"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-plugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4"}, {"server_uuid": "32d7a1bb-3071-42ac-82de-cf478fb10b00", "name": "network-vif-plugged", "status": "completed", "tag": "6807c0f5-8451-4ed4-a51e-0d565a72e491"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:05.847362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-d9621708-87cd-4eb9-b79d-ebfda90a473d service neutron] 10.222.0.54 "GET /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2470155 Dec 21 03:45:05.886810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.021680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Deleting port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:06.022599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.034245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d5aa27-f4eb-4124-a633-b079fe60c00d req-45e38f33-bbbf-473e-8559-cea9e6d3ca48 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:06.039540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71d5aa27-f4eb-4124-a633-b079fe60c00d req-45e38f33-bbbf-473e-8559-cea9e6d3ca48 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 944 time: 0.2434831 Dec 21 03:45:06.046121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-7f062c4f-5881-487c-a1d2-134f154566d9 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2972059 Dec 21 03:45:06.131609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-b4eb9d6a-fe15-4f37-8b73-53ec436503e7 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:06.133023 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-b4eb9d6a-fe15-4f37-8b73-53ec436503e7 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.54 "GET /v2.0/ports?device_id=9a8c724e-0ff5-4fe9-97bd-fe7a7500838e HTTP/1.1" status: 200 len: 968 time: 0.1081045 Dec 21 03:45:06.158715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77e3c616-c87d-4776-a7b0-2deee6e1419d req-b454918c-b142-4e6e-8505-955eb55fdbe0 service neutron] 10.222.0.54 "GET /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2891638 Dec 21 03:45:06.176350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] For port 3d4c871a-dd3a-455c-a51c-b017ad4b99ef, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:06.176738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.195960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Calling delete_port for 3d4c871a-dd3a-455c-a51c-b017ad4b99ef owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:06.242525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Allocated IP 172.25.5.69 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/c41a5e1b-e34d-4318-a03b-5dc45ad8c0ea) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:06.249044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71d5aa27-f4eb-4124-a633-b079fe60c00d req-53201ede-4236-4a09-8a0d-d66b84659c3f tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1992283 Dec 21 03:45:06.272986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e755d-2f13-4e03-92e4-9388a6490835 req-2d8d9a3f-ff0f-4bda-9a0e-b38e66d98c28 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2170434 Dec 21 03:45:06.310375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Deleting port 3879ae01-e336-4975-a479-fdaef03236a1 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:06.310724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.443210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ee30dd-a2c9-41ca-9760-2ae53e1c81bf req-d1e55c6c-8318-4aee-bd5f-14387077f3ab tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:06.444752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90ee30dd-a2c9-41ca-9760-2ae53e1c81bf req-d1e55c6c-8318-4aee-bd5f-14387077f3ab tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 950 time: 0.0773964 Dec 21 03:45:06.463224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.463442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] For port 3879ae01-e336-4975-a479-fdaef03236a1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3879ae01-e336-4975-a479-fdaef03236a1,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:06.464550 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.527941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90ee30dd-a2c9-41ca-9760-2ae53e1c81bf req-eb968778-8555-47f2-abfe-7a92b386297d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738397 Dec 21 03:45:06.585493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.638879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:06.651045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:06.652097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:06.676414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event updated for resources: {'Port': ['ID=c41a5e1b-e34d-4318-a03b-5dc45ad8c0ea,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:06.719673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.744848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-559897d2-72d5-419d-9532-66ea501ad993 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1678634864&fields=id&tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c HTTP/1.1" status: 200 len: 267 time: 0.1101372 Dec 21 03:45:06.751116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.763075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Pushing event deleted for resources: {'Port': ['ID=3d4c871a-dd3a-455c-a51c-b017ad4b99ef,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:06.775365 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.775816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:06.776164 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def disassociated. External IP: 172.25.5.85, port: 3879ae01-e336-4975-a479-fdaef03236a1. Dec 21 03:45:06.776521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Calling delete_port for 3879ae01-e336-4975-a479-fdaef03236a1 owned by compute:tempest-test_az-2070989439 {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:06.921597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.082339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-efa2dfff-2163-40f0-9dc9-e4344b4676b7 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:07.082339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-efa2dfff-2163-40f0-9dc9-e4344b4676b7 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 824 time: 0.2572794 Dec 21 03:45:07.082339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-457752cf-4214-48bf-bd5d-c08442e659b4 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/quotas/2637e7ec4ea74cb6a3ec5d635dce4a5c HTTP/1.1" status: 200 len: 375 time: 0.0221114 Dec 21 03:45:07.179996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-f923a21f-763e-44b6-b956-35469bbb19cc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1152539 Dec 21 03:45:07.297459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.327892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-516f4db7-3c69-43be-9d26-c022c8d41003 service neutron] 10.222.0.18 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278739 Dec 21 03:45:07.380311 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.394292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.441806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.474262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-6505c762-d913-4bbe-ba5b-77a96b30918b service neutron] 10.222.0.18 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1392632 Dec 21 03:45:07.475093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event updated for resources: {'Port': ['ID=c41a5e1b-e34d-4318-a03b-5dc45ad8c0ea,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:07.561001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 91a886a0-1771-4716-ac84-bee4f7ab2879 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:07.575843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.622064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event deleted for resources: {'Port': ['ID=3879ae01-e336-4975-a479-fdaef03236a1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:07.730623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Router 9cf108fe-d806-4d27-bb77-e2381c596d6a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:07.801711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:07.833376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Router 138198e8-cb21-4974-9773-632cfe7c78d0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:07.930058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:07.932183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-a79adfcf-877b-47fb-88d4-def4b9950bfe tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 3.5271518 Dec 21 03:45:07.940114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:07.950896 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] Sync routers for ids ['9cf108fe-d806-4d27-bb77-e2381c596d6a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:07.960664 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] Routers {'9cf108fe-d806-4d27-bb77-e2381c596d6a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:07.961603 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9cf108fe-d806-4d27-bb77-e2381c596d6a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:07.972318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 4e3a8359-5d74-431f-a914-f74c7cc55e15 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:07.975143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 91a886a0-1771-4716-ac84-bee4f7ab2879 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:07.985695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-46d80f98-baa0-45a0-b4cb-9f8566338d88 admin admin] 10.222.0.18 "PUT /v2.0/routers/9cf108fe-d806-4d27-bb77-e2381c596d6a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9338028 Dec 21 03:45:07.985695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:07.993177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 4e3a8359-5d74-431f-a914-f74c7cc55e15 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:07.994418 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.009042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 91a886a0-1771-4716-ac84-bee4f7ab2879 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:08.027719 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.098208 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] Set router 9cf108fe-d806-4d27-bb77-e2381c596d6a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:08.100705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:08.207261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:08.231084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] No DVR routers for this DVR port 3879ae01-e336-4975-a479-fdaef03236a1 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:08.234810 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.238816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-91158722-1847-4af3-bf87-f2bc3ecab97c req-c20fe731-78ef-483b-b125-d91d36139b01 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.54 "DELETE /v2.0/ports/3879ae01-e336-4975-a479-fdaef03236a1 HTTP/1.1" status: 204 len: 173 time: 2.0989866 Dec 21 03:45:08.243357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'name': 'network-vif-deleted', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:08.248629 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83595d6b-d587-431d-abd6-499dc37cef90" -d '{"events": [{"server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "name": "network-vif-deleted", "tag": "3879ae01-e336-4975-a479-fdaef03236a1"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:08.258693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-0830d239-a5e7-4ae8-97f6-f769da82e9eb tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.69 HTTP/1.1" status: 200 len: 695 time: 0.3187864 Dec 21 03:45:08.275962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:08.277579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.278286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:08.352747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b44722-9840-49c8-9544-a7ff42d7eefd req-7d458739-69ea-4007-8837-d91a268677ea tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:08.360598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7b44722-9840-49c8-9544-a7ff42d7eefd req-7d458739-69ea-4007-8837-d91a268677ea tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 949 time: 0.1800048 Dec 21 03:45:08.475556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7b44722-9840-49c8-9544-a7ff42d7eefd req-3a5cfe96-19ca-4551-909e-4a50130b50ba tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131918 Dec 21 03:45:08.488414 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:45:06Z', 'revision_number': 5, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:08.529456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.551737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] Checking router: 9cf108fe-d806-4d27-bb77-e2381c596d6a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:08.554600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-79ff2d7b-4342-41fe-944b-3999f95996ca tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:08.559196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9cdcf1f-c5de-402d-88f3-544ebbac8b9b req-79ff2d7b-4342-41fe-944b-3999f95996ca tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.3000042 Dec 21 03:45:08.572145 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] Routers {'9cf108fe-d806-4d27-bb77-e2381c596d6a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:08.572796 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9cf108fe-d806-4d27-bb77-e2381c596d6a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:08.635144 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93b0a217-2415-4e09-b9b5-6e1e0a8201c2 x-openstack-request-id: req-93b0a217-2415-4e09-b9b5-6e1e0a8201c2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:08.635774 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-plugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4", "code": 200}, {"server_uuid": "32d7a1bb-3071-42ac-82de-cf478fb10b00", "name": "network-vif-plugged", "status": "completed", "tag": "6807c0f5-8451-4ed4-a51e-0d565a72e491", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:08.635891 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-93b0a217-2415-4e09-b9b5-6e1e0a8201c2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:08.636306 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'code': 200} Dec 21 03:45:08.636560 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6807c0f5-8451-4ed4-a51e-0d565a72e491', 'code': 200} Dec 21 03:45:08.689296 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.728794 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.786032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b84d302-6173-40ac-86dc-eb93f292d0c5 req-b9342d50-6146-437d-97d2-70a3d4b2cfa1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:08.793455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:08.799090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b84d302-6173-40ac-86dc-eb93f292d0c5 req-b9342d50-6146-437d-97d2-70a3d4b2cfa1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 945 time: 0.1603570 Dec 21 03:45:08.812772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Deleting port b18a511c-c0b8-4212-a38f-0a57a232fc90 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:08.813820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.860194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8757ad2-9e4f-45d9-bdfa-1567bdd93efa req-0f3eb203-43b8-4caf-b4fc-b8f6576653ea tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:08.862594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8757ad2-9e4f-45d9-bdfa-1567bdd93efa req-0f3eb203-43b8-4caf-b4fc-b8f6576653ea tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 944 time: 0.1459072 Dec 21 03:45:08.863025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:08.871995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] Set router 9cf108fe-d806-4d27-bb77-e2381c596d6a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:08.880172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 91a886a0-1771-4716-ac84-bee4f7ab2879, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=91a886a0-1771-4716-ac84-bee4f7ab2879,segment=NetworkSegment(c924054a-32a4-4063-a961-2d7b2907f729),segment_id=c924054a-32a4-4063-a961-2d7b2907f729)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:08.947334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b84d302-6173-40ac-86dc-eb93f292d0c5 req-346f259b-46ba-47e4-ad33-0c3165fca32b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1472113 Dec 21 03:45:08.947953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66f466c-5d63-4b62-9b70-c21060e9de7a req-c798704d-3b09-4022-85f3-16d8c9f3a3ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:08.950403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e66f466c-5d63-4b62-9b70-c21060e9de7a req-c798704d-3b09-4022-85f3-16d8c9f3a3ce service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 1102 time: 0.1401327 Dec 21 03:45:08.961859 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.961859 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:08.961859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3879ae01-e336-4975-a479-fdaef03236a1 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:09.046615 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e66f466c-5d63-4b62-9b70-c21060e9de7a req-9919131f-8cd6-45f0-8f45-1c90ae24ef15 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865631 Dec 21 03:45:09.054571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] For port b18a511c-c0b8-4212-a38f-0a57a232fc90, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b18a511c-c0b8-4212-a38f-0a57a232fc90,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:09.055120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.066289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb89861-0be0-40bf-a765-60334332e1bd req-6fb46921-62c5-4134-8a72-6b44df4d11e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:09.067843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efb89861-0be0-40bf-a765-60334332e1bd req-6fb46921-62c5-4134-8a72-6b44df4d11e1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1102 time: 0.2405779 Dec 21 03:45:09.069828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Calling delete_port for b18a511c-c0b8-4212-a38f-0a57a232fc90 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:09.101711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8757ad2-9e4f-45d9-bdfa-1567bdd93efa req-44723e6d-f515-414c-9efd-c8661018db50 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2152963 Dec 21 03:45:09.135405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 3879ae01-e336-4975-a479-fdaef03236a1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:09.137367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3879ae01-e336-4975-a479-fdaef03236a1 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:09.200044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:09.218429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36f5390c-67c2-4bb0-8410-7de61416ff1f req-085d0bb0-9c8e-4565-b8fe-a7e9be134c5c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:09.223471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36f5390c-67c2-4bb0-8410-7de61416ff1f req-085d0bb0-9c8e-4565-b8fe-a7e9be134c5c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 950 time: 0.0970862 Dec 21 03:45:09.297252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a15dcd8-d4c9-454b-b1f0-563065902729 req-064758cd-fb73-4928-b754-9f6360c48f57 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 210 time: 0.0725765 Dec 21 03:45:09.301619 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:45:06Z', 'revision_number': 5, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:09.331251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=91a886a0-1771-4716-ac84-bee4f7ab2879,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:09.369590 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-099e17de-86ba-49c9-9044-3e92d6549afa None None] The sync data for ids ['9cf108fe-d806-4d27-bb77-e2381c596d6a'] in n-d-822053-11 is: [{'id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'name': 'tempest-FloatingIPsTestJSON-383730547-router', 'tenant_id': '7abd8149eaa64d9f94b2460800f5436e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156'}], 'enable_snat': True}, 'gw_port_id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:32Z', 'updated_at': '2021-12-21T03:45:06Z', 'revision_number': 5, 'project_id': '7abd8149eaa64d9f94b2460800f5436e', 'gw_port': {'id': 'b18a511c-c0b8-4212-a38f-0a57a232fc90', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d2:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf108fe-d806-4d27-bb77-e2381c596d6a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:33Z', 'updated_at': '2021-12-21T03:44:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:09.384090 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b916c7a6-2bd3-4b4a-9e6b-defa5dfc52bd x-openstack-request-id: req-b916c7a6-2bd3-4b4a-9e6b-defa5dfc52bd {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:09.384090 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9a8c724e-0ff5-4fe9-97bd-fe7a7500838e", "name": "network-vif-deleted", "tag": "3879ae01-e336-4975-a479-fdaef03236a1", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:09.384090 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b916c7a6-2bd3-4b4a-9e6b-defa5dfc52bd {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:09.384090 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9a8c724e-0ff5-4fe9-97bd-fe7a7500838e', 'name': 'network-vif-deleted', 'tag': '3879ae01-e336-4975-a479-fdaef03236a1', 'status': 'completed', 'code': 200} Dec 21 03:45:09.412012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:09.425472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.443558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36f5390c-67c2-4bb0-8410-7de61416ff1f req-5034c49d-873b-48ce-ad55-3acbd1541cd7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2130730 Dec 21 03:45:09.462142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Pushing event deleted for resources: {'Port': ['ID=b18a511c-c0b8-4212-a38f-0a57a232fc90,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:09.469064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efb89861-0be0-40bf-a765-60334332e1bd req-13cdc1a6-93e0-42ab-a7a3-d3caebe0fda0 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1551089 Dec 21 03:45:09.491095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:09.510776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:09.511715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:09.525935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-33097c07-5776-4f67-8f97-7aae0c5e1be7 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:09.525935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-33097c07-5776-4f67-8f97-7aae0c5e1be7 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 946 time: 0.0751522 Dec 21 03:45:09.582711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.615109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-17e6f634-f187-4955-aa5b-640aa9ab13d7 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.69 HTTP/1.1" status: 200 len: 695 time: 0.0765307 Dec 21 03:45:09.634549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-d16283cb-7e64-4dd6-a2c6-5e70980c8d66 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Request body: {'floatingip': {'port_id': '742f0270-e348-4b05-82d9-88e6e724dc14', 'fixed_ip_address': '172.20.0.10'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:09.676765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:09.685747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10799360-f475-42c2-b7d3-7f993ae0c713 req-f0d1e2f7-e4d3-4072-bff1-3317407fb12f tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:09.687344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10799360-f475-42c2-b7d3-7f993ae0c713 req-f0d1e2f7-e4d3-4072-bff1-3317407fb12f tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1097 time: 0.1617806 Dec 21 03:45:09.690046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-d16283cb-7e64-4dd6-a2c6-5e70980c8d66 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.708430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.711423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.853770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.854591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9cf108fe-d806-4d27-bb77-e2381c596d6a {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:45:09.860665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:09.864463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c961ada1-1545-4933-8793-8df6df8d498d admin admin] 10.222.0.18 "DELETE /v2.0/routers/9cf108fe-d806-4d27-bb77-e2381c596d6a HTTP/1.1" status: 204 len: 168 time: 1.8750436 Dec 21 03:45:09.867149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:09.898545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3d4c871a-dd3a-455c-a51c-b017ad4b99ef no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:09.945228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10799360-f475-42c2-b7d3-7f993ae0c713 req-3f7231df-b96c-439e-a719-a70c00b4e4f5 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1232197 Dec 21 03:45:09.945406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 3d4c871a-dd3a-455c-a51c-b017ad4b99ef {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:09.945803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3d4c871a-dd3a-455c-a51c-b017ad4b99ef not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:10.004311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Deleting subnet 72829a15-a3e7-4f70-8cd0-2cbaf77976b3 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:45:10.043542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.090637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.182079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:10.230500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38857bb0-86c9-4edb-ad0b-59c346c60749 None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:10.267431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.426052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.462062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=72829a15-a3e7-4f70-8cd0-2cbaf77976b3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:10.469359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.470375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6acf3378-99f4-4de0-8d7c-0c4758b7acd0 None None] Network d818b5e2-0d66-470d-b08f-ad7d366af0b0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:10.473349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-30130d75-0eb7-4a3a-a4d1-e66932c55bc2 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/72829a15-a3e7-4f70-8cd0-2cbaf77976b3 HTTP/1.1" status: 204 len: 168 time: 0.6062591 Dec 21 03:45:10.476001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43626) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:10.538027 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-d16283cb-7e64-4dd6-a2c6-5e70980c8d66 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] update failed (client error): There was a conflict when trying to complete your request. Dec 21 03:45:10.552879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c51ec4be-192e-4fb9-807f-8c148eb5cbfd req-d16283cb-7e64-4dd6-a2c6-5e70980c8d66 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "PUT /v2.0/floatingips/ef573071-8248-4872-ad0d-318b8f508f01 HTTP/1.1" status: 409 len: 550 time: 0.9226387 Dec 21 03:45:10.578797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4748b08-e00a-431e-87c3-750da4d1b3fd req-dc8f830d-8d9f-424e-a76e-593fe6c14ce5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:10.580975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.585525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4748b08-e00a-431e-87c3-750da4d1b3fd req-dc8f830d-8d9f-424e-a76e-593fe6c14ce5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1115887 Dec 21 03:45:10.645294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15'}, {'server_uuid': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91a886a0-1771-4716-ac84-bee4f7ab2879'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:10.649001 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2177a1a-bfa3-4b59-b1cc-cb0730d4394b" -d '{"events": [{"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-plugged", "status": "completed", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15"}, {"server_uuid": "bbaddaa0-3286-4622-94fe-6e23a7e61c09", "name": "network-vif-plugged", "status": "completed", "tag": "91a886a0-1771-4716-ac84-bee4f7ab2879"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:10.688917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4748b08-e00a-431e-87c3-750da4d1b3fd req-75de18c5-ad01-434e-bdde-b06476b4a338 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983250 Dec 21 03:45:10.692346 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee04f3dc-260b-4b6b-94f9-39db5b6dd893 None None] New status for floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:45:10.709617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba90a41-050e-41f0-aead-6aa0cb551629 req-055f11b8-33e3-4bbb-9baf-3c50d5bd2233 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:10.720966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dba90a41-050e-41f0-aead-6aa0cb551629 req-055f11b8-33e3-4bbb-9baf-3c50d5bd2233 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1097 time: 0.0743129 Dec 21 03:45:10.787155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] DHCP port deletion for d818b5e2-0d66-470d-b08f-ad7d366af0b0 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:45:10.796735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Deleting port 3ca5d939-c5fe-495d-b18d-625cac1cb678 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:10.797343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.842262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dba90a41-050e-41f0-aead-6aa0cb551629 req-7f79ba7f-39a2-49dd-bd10-7c4651f57b85 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064930 Dec 21 03:45:10.901032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] For port 3ca5d939-c5fe-495d-b18d-625cac1cb678, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3ca5d939-c5fe-495d-b18d-625cac1cb678,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:10.901418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.904767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] Deleting port 3ca5d939-c5fe-495d-b18d-625cac1cb678 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:10.905153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:10.933280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Calling delete_port for 3ca5d939-c5fe-495d-b18d-625cac1cb678 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:10.978348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1b9efc-009e-4b40-8d93-d9b323539c0d req-d5946e69-d5e8-45c6-a270-67360e74de39 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:10.992376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a1b9efc-009e-4b40-8d93-d9b323539c0d req-d5946e69-d5e8-45c6-a270-67360e74de39 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 945 time: 0.1331818 Dec 21 03:45:11.011160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] For port 3ca5d939-c5fe-495d-b18d-625cac1cb678, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3ca5d939-c5fe-495d-b18d-625cac1cb678,segment=NetworkSegment(e6446f0e-d962-4cdb-b5e0-527bd0f210fc),segment_id=e6446f0e-d962-4cdb-b5e0-527bd0f210fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:11.011532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.062294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5eb2d652-1344-48a9-a158-6e221c416fd8 req-86f09cfc-653f-4ff5-a923-0793f2bd87f4 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 210 time: 0.0612936 Dec 21 03:45:11.105866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.146103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] No DVR routers for this DVR port 3ca5d939-c5fe-495d-b18d-625cac1cb678 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:11.177670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a1b9efc-009e-4b40-8d93-d9b323539c0d req-8d8c690a-9b3b-47b7-85ef-3396bd11491e tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1870196 Dec 21 03:45:11.178842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=3ca5d939-c5fe-495d-b18d-625cac1cb678,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:11.203816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] Calling delete_port for 3ca5d939-c5fe-495d-b18d-625cac1cb678 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:11.284552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.331554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d818b5e2-0d66-470d-b08f-ad7d366af0b0']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:11.343013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:11.343370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e6446f0e-d962-4cdb-b5e0-527bd0f210fc') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:11.356620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.364743 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.367932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-d290813f-2340-447b-826d-4a8283161c7e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:11.369699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-d290813f-2340-447b-826d-4a8283161c7e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.31 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 824 time: 0.3112376 Dec 21 03:45:11.373536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.378803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8411d9e4-baec-416a-acf7-0da3db6910db req-505758a0-2cd5-47a5-a60a-6b08fd09d77d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips/ef573071-8248-4872-ad0d-318b8f508f01 HTTP/1.1" status: 200 len: 692 time: 0.1151149 Dec 21 03:45:11.386316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:45:11.391531 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:45:11.394471 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:45:11.395454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] Pushing event deleted for resources: {'Port': ['ID=3ca5d939-c5fe-495d-b18d-625cac1cb678,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:11.395544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee4c9425-aaad-4540-9e61-59f97164e716 None None] No DVR routers for this DVR port 3ca5d939-c5fe-495d-b18d-625cac1cb678 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:11.449972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2c80ab-9ce6-4573-a28b-167baa39abd3 req-5b77fe42-f874-4de6-a973-4d0bf4e26a4c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:11.455113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c2c80ab-9ce6-4573-a28b-167baa39abd3 req-5b77fe42-f874-4de6-a973-4d0bf4e26a4c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 950 time: 0.2382238 Dec 21 03:45:11.516511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.524089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:11.534223 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] 10.222.0.18 "DELETE /v2.0/networks/d818b5e2-0d66-470d-b08f-ad7d366af0b0 HTTP/1.1" status: 204 len: 168 time: 1.0539432 Dec 21 03:45:11.550890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34af9d48-874a-4866-8ecf-faeacb7b21d3 admin admin] Pushing event deleted for resources: {'Network': ['ID=d818b5e2-0d66-470d-b08f-ad7d366af0b0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:11.596999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-04665c4c-ded9-485d-bec3-fe078202ab52 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c HTTP/1.1" status: 200 len: 380 time: 0.2052364 Dec 21 03:45:11.619300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'port': {'device_id': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'admin_state_up': True, 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'security_groups': ['fa8f8344-ed72-403c-a269-225bbf5487c9']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:11.639008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c2c80ab-9ce6-4573-a28b-167baa39abd3 req-9ffb7c7f-b8f2-4883-96d1-55462490af6e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1643167 Dec 21 03:45:11.675666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8411d9e4-baec-416a-acf7-0da3db6910db req-442d151b-cbf7-46c0-adf4-1b5e54784ee6 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:11.676644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8411d9e4-baec-416a-acf7-0da3db6910db req-442d151b-cbf7-46c0-adf4-1b5e54784ee6 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2894297 Dec 21 03:45:11.702821 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a20ecf83-dcc8-42ac-8018-b88fa85f7124 x-openstack-request-id: req-a20ecf83-dcc8-42ac-8018-b88fa85f7124 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:11.703230 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-plugged", "status": "completed", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15", "code": 200}, {"server_uuid": "bbaddaa0-3286-4622-94fe-6e23a7e61c09", "name": "network-vif-plugged", "status": "completed", "tag": "91a886a0-1771-4716-ac84-bee4f7ab2879", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:11.703593 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a20ecf83-dcc8-42ac-8018-b88fa85f7124 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:11.704078 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'code': 200} Dec 21 03:45:11.704398 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91a886a0-1771-4716-ac84-bee4f7ab2879', 'code': 200} Dec 21 03:45:11.768673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8411d9e4-baec-416a-acf7-0da3db6910db req-07cd3c21-85c6-44f2-9686-c55e5e80990c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.69 HTTP/1.1" status: 200 len: 695 time: 0.0853214 Dec 21 03:45:11.877257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b18a511c-c0b8-4212-a38f-0a57a232fc90 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:11.893677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8411d9e4-baec-416a-acf7-0da3db6910db req-faa3f02e-920a-4740-a521-7ba446548eaf tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.69 HTTP/1.1" status: 200 len: 695 time: 0.1168787 Dec 21 03:45:11.895976 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b18a511c-c0b8-4212-a38f-0a57a232fc90 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:11.896343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b18a511c-c0b8-4212-a38f-0a57a232fc90 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:11.897606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3ca5d939-c5fe-495d-b18d-625cac1cb678 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:11.902692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8d9ff5-2a6d-4c76-bb42-8127a5dbe9c6 req-3fdb39d6-4b0e-4d1b-8392-3b7d9a65e4ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:11.904506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aa8d9ff5-2a6d-4c76-bb42-8127a5dbe9c6 req-3fdb39d6-4b0e-4d1b-8392-3b7d9a65e4ad service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1102 time: 0.0547409 Dec 21 03:45:11.921818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 3ca5d939-c5fe-495d-b18d-625cac1cb678 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:11.922173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3ca5d939-c5fe-495d-b18d-625cac1cb678 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:11.962017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43646) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:11.997311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aa8d9ff5-2a6d-4c76-bb42-8127a5dbe9c6 req-9a11ac02-7a89-4ff6-ba2b-4133f221d7ea service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594683 Dec 21 03:45:12.000867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a87ed1-5095-4812-998e-320a31e65c88 req-3f153903-8c0c-453d-a7b8-ded7d83c3bb7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:12.002472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16a87ed1-5095-4812-998e-320a31e65c88 req-3f153903-8c0c-453d-a7b8-ded7d83c3bb7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1769109 Dec 21 03:45:12.014035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c295e0-e640-4a09-842d-9a7525d767ae req-105d5b37-e628-482b-8a92-b9d9433036e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:12.015587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64c295e0-e640-4a09-842d-9a7525d767ae req-105d5b37-e628-482b-8a92-b9d9433036e6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 1097 time: 0.1911254 Dec 21 03:45:12.104872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Made reservation on behalf of 2637e7ec4ea74cb6a3ec5d635dce4a5c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:12.108442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.154419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-27186cd5-15f9-44b2-833a-481bc9f35010 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7abd8149eaa64d9f94b2460800f5436e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1903799 Dec 21 03:45:12.157270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43650) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:12.201073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64c295e0-e640-4a09-842d-9a7525d767ae req-24cd30bc-74c8-43ed-a510-f1e55e5a7504 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1429529 Dec 21 03:45:12.215641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0f6b1e-e7ac-49f5-bc2c-317e3d54d70a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.238184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0f6b1e-e7ac-49f5-bc2c-317e3d54d70a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.241242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16a87ed1-5095-4812-998e-320a31e65c88 req-ac1a012a-fb98-4946-80f5-e592fc0034ff tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2230413 Dec 21 03:45:12.336309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Deleting port c41a5e1b-e34d-4318-a03b-5dc45ad8c0ea {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:12.336646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.379536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0f6b1e-e7ac-49f5-bc2c-317e3d54d70a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.382225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a0f6b1e-e7ac-49f5-bc2c-317e3d54d70a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.383431 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2a0f6b1e-e7ac-49f5-bc2c-317e3d54d70a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/be57f0f3-1d0e-4349-b56e-fee4f9306eb9 HTTP/1.1" status: 204 len: 168 time: 0.2251792 Dec 21 03:45:12.397586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a0f6b1e-e7ac-49f5-bc2c-317e3d54d70a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be57f0f3-1d0e-4349-b56e-fee4f9306eb9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:12.407748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Allocated IP 172.20.0.7 (97e3dbcb-7ac2-4207-82ae-df7e1df411c2/8ca201b9-7506-4b6b-8a03-05d4689a5e59/191b83a9-628d-4985-aca6-eb18b8810e59) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:12.482727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.483079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.518148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Calling delete_port for c41a5e1b-e34d-4318-a03b-5dc45ad8c0ea owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:12.695451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.821505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923bcd24-982c-4bae-8469-09043fc11e79 req-59660ecc-f7c3-496b-aee8-f1af775e37b7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:12.823382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-923bcd24-982c-4bae-8469-09043fc11e79 req-59660ecc-f7c3-496b-aee8-f1af775e37b7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0698223 Dec 21 03:45:12.854734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.876199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:12.942326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:12.965089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-923bcd24-982c-4bae-8469-09043fc11e79 req-4c38297d-dacf-406e-99cb-38c54f8a8615 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214995 Dec 21 03:45:12.975380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:12.990692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:13.003560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:13.003560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:13.004996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event updated for resources: {'Port': ['ID=191b83a9-628d-4985-aca6-eb18b8810e59,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:13.014816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:13.017921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:13.019456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8411d9e4-baec-416a-acf7-0da3db6910db req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "DELETE /v2.0/floatingips/ef573071-8248-4872-ad0d-318b8f508f01 HTTP/1.1" status: 204 len: 173 time: 1.1104023 Dec 21 03:45:13.045856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9328d2c2-a04c-4aa1-8ef1-18e9f394ad9d tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event deleted for resources: {'Port': ['ID=c41a5e1b-e34d-4318-a03b-5dc45ad8c0ea,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:13.143066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-a49035c0-7a1e-47d8-9059-b41424622d8d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5284526 Dec 21 03:45:13.157696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-031e1313-a334-420e-af41-1d224af5fe50 req-bf504a22-0ba9-424c-9848-9cf1bfe8b0be tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:13.160161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-031e1313-a334-420e-af41-1d224af5fe50 req-bf504a22-0ba9-424c-9848-9cf1bfe8b0be tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 931 time: 0.1115391 Dec 21 03:45:13.200374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e950de-c164-4725-9861-75ef76bbcdf8 req-3d96a022-adae-4aad-a26a-2d6fc56b144d tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:13.201948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34e950de-c164-4725-9861-75ef76bbcdf8 req-3d96a022-adae-4aad-a26a-2d6fc56b144d tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 945 time: 0.0960350 Dec 21 03:45:13.233691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Request body: {'port': {'device_id': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:13.292053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-031e1313-a334-420e-af41-1d224af5fe50 req-37c4abe4-95a3-49f1-86ce-e81545a25cb0 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1234946 Dec 21 03:45:13.358140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34e950de-c164-4725-9861-75ef76bbcdf8 req-fc8dffed-c4a7-404b-adb1-351a39ef3ee1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1489818 Dec 21 03:45:13.360040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:13.438086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b7f8cc3f-8299-4941-af63-5e65684e99c4 None None] Provisioning complete for port 191b83a9-628d-4985-aca6-eb18b8810e59 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:13.448421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b7f8cc3f-8299-4941-af63-5e65684e99c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:13.511682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-1bf1d2a9-9e62-4823-bcd2-98db01a4a2da tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=4712c556d73e4ad2b805061c976ddd2e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0401394 Dec 21 03:45:13.541614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b7f8cc3f-8299-4941-af63-5e65684e99c4 None None] Port 191b83a9-628d-4985-aca6-eb18b8810e59 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:13.808761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43694) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:13.815338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ad9fa7-1b3a-4f32-b6e8-81f8860150c2 req-72ed8113-1b22-4905-995b-848c8278472e tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:13.815338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41ad9fa7-1b3a-4f32-b6e8-81f8860150c2 req-72ed8113-1b22-4905-995b-848c8278472e tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1097 time: 0.1994498 Dec 21 03:45:13.867661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d252a48c-589f-4485-9a22-7b9064e3531c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:13.874505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d252a48c-589f-4485-9a22-7b9064e3531c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3400135 Dec 21 03:45:13.903972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b4f66ad9-06cd-46e9-bc2a-4ee3cb95f90f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/quotas/4712c556d73e4ad2b805061c976ddd2e HTTP/1.1" status: 200 len: 375 time: 0.0280821 Dec 21 03:45:13.926454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-network', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:13.990769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41ad9fa7-1b3a-4f32-b6e8-81f8860150c2 req-6e697b12-d0cc-404b-b897-d0ecded37f06 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1623926 Dec 21 03:45:14.002572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Made reservation on behalf of 8f2eb29d24414a7ebe3c5bd20a786a31 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:14.005926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.010888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 191b83a9-628d-4985-aca6-eb18b8810e59 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:14.017040 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.021842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-79f5fa1d-4387-4236-ad9e-900ecc71010b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1159420 Dec 21 03:45:14.041487 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.100925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Transition to ACTIVE for port object 191b83a9-628d-4985-aca6-eb18b8810e59 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:45:14.125735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-c61621cf-1563-4da6-ad43-f807c38e47b2 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 1002 time: 0.0861499 Dec 21 03:45:14.141030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.165738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.214684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-c2cb933d-fa83-493d-8b48-4415e1efe53f tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:14.216095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-c2cb933d-fa83-493d-8b48-4415e1efe53f tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports/742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 943 time: 0.0788207 Dec 21 03:45:14.230925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Pushing event updated for resources: {'Port': ['ID=191b83a9-628d-4985-aca6-eb18b8810e59,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:14.242897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.254074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:45:14.267571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.268049 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Added segment ee16d6fe-99ec-4da8-b055-dee4ca67b943 of type vlan for network 18a094f5-b40b-4b83-80a8-7471f10d9e18 Dec 21 03:45:14.291854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Attempting to bind port 191b83a9-628d-4985-aca6-eb18b8810e59 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:14.292192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Attempting to bind port 191b83a9-628d-4985-aca6-eb18b8810e59 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:14.292684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Attempting to bind port 191b83a9-628d-4985-aca6-eb18b8810e59 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:14.307773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Port 191b83a9-628d-4985-aca6-eb18b8810e59 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:14.308115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Attempting to bind port 191b83a9-628d-4985-aca6-eb18b8810e59 on network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:14.322855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:14.323176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Checking segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:14.323573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Bound using segment: {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:14.324026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Bound port: 191b83a9-628d-4985-aca6-eb18b8810e59, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:14.324388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.345292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0017e8d-b83e-443a-8ee6-0e113c3185e5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:14.384157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.499404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.500810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:14.501809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.528453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-22886243-a884-49e1-a46f-ff7d359bccac tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 1002 time: 0.2111223 Dec 21 03:45:14.552535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24177a20-e65d-4537-96f3-bcf4dfed3ce0 req-34acae19-c842-42d8-aca3-0ba3c262e58d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:14.554363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24177a20-e65d-4537-96f3-bcf4dfed3ce0 req-34acae19-c842-42d8-aca3-0ba3c262e58d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1586108 Dec 21 03:45:14.598218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] Pushing event updated for resources: {'Network': ['ID=18a094f5-b40b-4b83-80a8-7471f10d9e18,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:14.619268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:45:14.642189 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c76df55a-8b43-42b3-b516-ebba18a1df03 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.8321357 Dec 21 03:45:14.646024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:14.652422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Request body: {'subnet': {'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-subnet', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:14.698752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] For port 191b83a9-628d-4985-aca6-eb18b8810e59, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:14.732905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] For port 191b83a9-628d-4985-aca6-eb18b8810e59, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=191b83a9-628d-4985-aca6-eb18b8810e59,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.741339 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:14.744569 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:14.745537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-7d2b622a-d6fc-4d6b-b060-66585b78f54c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:14.746696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-7d2b622a-d6fc-4d6b-b060-66585b78f54c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2174687 Dec 21 03:45:14.751063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Made reservation on behalf of 8f2eb29d24414a7ebe3c5bd20a786a31 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:14.756572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.794566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24177a20-e65d-4537-96f3-bcf4dfed3ce0 req-786bd98c-520e-483d-b9e2-18868c310680 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1906695 Dec 21 03:45:14.831862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.916228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:14.916228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:14.916228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] 10.222.0.31 "PUT /v2.0/ports/191b83a9-628d-4985-aca6-eb18b8810e59 HTTP/1.1" status: 200 len: 1092 time: 1.6925924 Dec 21 03:45:14.916228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:14.918244 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1" -d '{"events": [{"name": "network-changed", "server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:14.946245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-ec9b84eb-7560-4e6a-81b6-7767855e5290 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 1002 time: 0.1796997 Dec 21 03:45:14.946870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522eac57-17b4-43c9-9eee-b183f9dd8190 service neutron] Pushing event updated for resources: {'Port': ['ID=191b83a9-628d-4985-aca6-eb18b8810e59,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:14.958495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Request body: {'floatingip': {'port_id': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:15.034601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.071507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.148700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Pushing event updated for resources: {'Subnet': ['ID=38e2bfb3-afda-4171-9221-c30960cbbdb4,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:15.157814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Checking segment: {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:15.158221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Network hostable DHCP agents. Network: 18a094f5-b40b-4b83-80a8-7471f10d9e18, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:45:15.195621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-f4ca3eac-23a8-45dc-a185-07b946e6efeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:15.197194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-f4ca3eac-23a8-45dc-a185-07b946e6efeb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 1095 time: 0.1267371 Dec 21 03:45:15.236830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:45:15.258770 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.305442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 18a094f5-b40b-4b83-80a8-7471f10d9e18) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:15.310516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:15.311181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.317917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d8bd93a-e0e5-47c8-adbc-72bf0c9b52ba None None] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:15.411277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e95af09c-3030-413d-8691-9055771cb360 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7635746 Dec 21 03:45:15.413991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43730) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:15.418474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:15.477809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-18a094f5-b40b-4b83-80a8-7471f10d9e18', 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18', 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'fixed_ips': [{'subnet_id': '38e2bfb3-afda-4171-9221-c30960cbbdb4'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:45:15.481933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.522834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.525160 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.635294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.659993 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.660248 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Floating IP c9b308b1-ac49-4887-88d7-b116974f8653 disassociated. External IP: 172.25.5.194, port: 742f0270-e348-4b05-82d9-88e6e724dc14. Dec 21 03:45:15.679624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-b98a86e4-9dc7-4fbb-8492-c51be1963b84 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=191b83a9-628d-4985-aca6-eb18b8810e59 HTTP/1.1" status: 200 len: 217 time: 0.4585626 Dec 21 03:45:15.723064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Allocated IP 172.20.0.2 (18a094f5-b40b-4b83-80a8-7471f10d9e18/38e2bfb3-afda-4171-9221-c30960cbbdb4/8071f922-7132-49bf-a278-27ae884b948e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:15.810723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-d978de07-a132-43a2-a413-a21ce76df6b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:15.812465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-d978de07-a132-43a2-a413-a21ce76df6b3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.1068428 Dec 21 03:45:15.876420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:15.929293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af47901-6319-4582-a39d-1658d59551d7 req-bb76c135-17c7-4ac3-b920-15a70c5ffd3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:15.930852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-bb76c135-17c7-4ac3-b920-15a70c5ffd3e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1087415 Dec 21 03:45:15.948249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.020347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.061138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:16.068627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:16.072280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:16.076051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:16.084169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Pushing event updated for resources: {'Port': ['ID=8071f922-7132-49bf-a278-27ae884b948e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:16.146804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Attempting to bind port 8071f922-7132-49bf-a278-27ae884b948e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:16.147524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Attempting to bind port 8071f922-7132-49bf-a278-27ae884b948e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:16.147960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Attempting to bind port 8071f922-7132-49bf-a278-27ae884b948e on network 18a094f5-b40b-4b83-80a8-7471f10d9e18 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:16.155262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:16.156213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Checking segment: {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:16.156691 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.157195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Bound using segment: {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:16.158534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Bound port: 8071f922-7132-49bf-a278-27ae884b948e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:16.158965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.160713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-dfa13f76-456a-462f-87e5-bec6fddca70c service neutron] 10.222.0.31 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1868327 Dec 21 03:45:16.249395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] For port 8071f922-7132-49bf-a278-27ae884b948e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:16.254768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] For port 8071f922-7132-49bf-a278-27ae884b948e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8071f922-7132-49bf-a278-27ae884b948e,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:16.314476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:16.320292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.327360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7720f193-5618-4424-a24b-061f428d930e None None] Sync routers for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:16.341962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:16.343359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:16.349270 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.355563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af47901-6319-4582-a39d-1658d59551d7 req-5a418bd7-2148-46e1-bfda-9a1933c360f7 service neutron] 10.222.0.31 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1863909 Dec 21 03:45:16.393360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-49cdd550-8a26-4dd1-b9fa-80805379fa1c tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "PUT /v2.0/floatingips/c9b308b1-ac49-4887-88d7-b116974f8653 HTTP/1.1" status: 200 len: 695 time: 1.4394979 Dec 21 03:45:16.459093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-eb82ad2e-b73e-4dfe-a897-a89cf15b0a68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:16.461372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-eb82ad2e-b73e-4dfe-a897-a89cf15b0a68 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1098 time: 0.0672324 Dec 21 03:45:16.521607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73f15fe-ac79-401a-9486-07f3269e2d49 None None] Pushing event updated for resources: {'Port': ['ID=8071f922-7132-49bf-a278-27ae884b948e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:16.592849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:16.596776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.618309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-005d32be-62ff-46b9-8d9e-5f460a072c41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:16.631553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-005d32be-62ff-46b9-8d9e-5f460a072c41 service neutron] 10.222.0.18 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 928 time: 0.1620336 Dec 21 03:45:16.650165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:16.711906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-679e16fb-1e55-49e8-8e5b-7a3b2f6738bc service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 217 time: 0.0794766 Dec 21 03:45:16.768112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-94742df2-0589-4f7c-899a-980889ba71a4 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=4712c556d73e4ad2b805061c976ddd2e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0408916 Dec 21 03:45:16.940622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Allocated IP 172.25.5.232 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/19909a2d-bb9e-4cec-b7f4-3ad7d7025185) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:16.958101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:37Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:16.965550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-34ece46e-fa75-4892-bca4-4de8536b3fd7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:16.966270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-34ece46e-fa75-4892-bca4-4de8536b3fd7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1787510 Dec 21 03:45:16.970745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-fcb1784f-e51e-4156-ae96-380356fc5388 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:16.975061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-fcb1784f-e51e-4156-ae96-380356fc5388 service neutron] 10.222.0.18 "GET /v2.0/subnets?id=8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 200 len: 866 time: 0.2592866 Dec 21 03:45:17.003217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Request body: {'port': {'device_id': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '4712c556d73e4ad2b805061c976ddd2e'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:17.013934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7720f193-5618-4424-a24b-061f428d930e None None] Checking router: 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:17.031609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:17.031609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:17.150556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:17.156695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-75dbb135-03ed-4e24-a171-6052fabeb54a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:17.158390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-75dbb135-03ed-4e24-a171-6052fabeb54a service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1779866 Dec 21 03:45:17.170776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:17.273831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:17.283527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-f99a8bf5-be71-4d09-8e92-408f8a945a26 service neutron] 10.222.0.18 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1135879 Dec 21 03:45:17.369742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:17.371307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Made reservation on behalf of 4712c556d73e4ad2b805061c976ddd2e for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:17.375909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:17.377777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43758) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:17.383991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:17.386566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:17.427398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d026107-302c-4a57-9cdd-25557ef95fbc req-b5af4593-b1c4-4ae5-9644-fffe241f701f service neutron] 10.222.0.18 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1366489 Dec 21 03:45:17.438186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Pushing event updated for resources: {'Port': ['ID=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:17.448698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7720f193-5618-4424-a24b-061f428d930e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:37Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:17.496962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7720f193-5618-4424-a24b-061f428d930e None None] The sync data for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 is: [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:44:31Z', 'revision_number': 4, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e99106f7-f780-4fbe-8b19-7d63d11935cd', 'name': '', 'network_id': '7bc2df93-ed75-4ee4-81c6-f3b3411325a4', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'mac_address': 'fa:16:3e:81:cb:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_interface', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:29Z', 'updated_at': '2021-12-21T03:44:37Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'subnets': [{'id': '8fae910f-1046-400a-b90e-c801ea409ae9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:17.505433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-5b23f552-a085-4ef2-995c-519590497ed1 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:45:17.506810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-5b23f552-a085-4ef2-995c-519590497ed1 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1251733 Dec 21 03:45:17.651885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Allocated IP 192.168.233.220 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/465bd6cc-6c8f-4b1c-924a-e655a016d3db) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:17.670350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-897aaa04-a46c-4bc0-bf8a-a6a4747c75ac req-632dcb6a-10d9-4622-9990-34b0231358fd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 210 time: 0.0473280 Dec 21 03:45:17.761657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-ee70821f-1696-4d04-b71c-e1cd249806b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:17.763100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-ee70821f-1696-4d04-b71c-e1cd249806b4 service neutron] 10.222.0.18 "GET /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 1094 time: 0.1705251 Dec 21 03:45:17.870039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:17.876114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Unknown quota resources ['binding']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:45:17.884161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8071f922-7132-49bf-a278-27ae884b948e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:17.946346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:17.988903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8071f922-7132-49bf-a278-27ae884b948e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:17.989510 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.036074 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e0218cc-a6d3-4334-a05d-e8b285edb569 None None] New status for floating IP c9b308b1-ac49-4887-88d7-b116974f8653: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:45:18.102303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.111826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49c66d5-3e8f-4f9c-94bd-21e13ba64e17 req-775ae443-612b-4ea2-a068-339348b42288 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:18.113880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49c66d5-3e8f-4f9c-94bd-21e13ba64e17 req-775ae443-612b-4ea2-a068-339348b42288 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 943 time: 0.3176785 Dec 21 03:45:18.154566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 8071f922-7132-49bf-a278-27ae884b948e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8071f922-7132-49bf-a278-27ae884b948e,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:18.167059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3185f2b9-4e7f-47ec-aa9f-83ddce57149c None None] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:18.249838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.254300 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.318059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49c66d5-3e8f-4f9c-94bd-21e13ba64e17 req-11d85b33-9c3d-4de9-8750-56236e585263 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1496933 Dec 21 03:45:18.348831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.360215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e23d35d4-fefd-4fdd-9907-2aab8a2e6a26 None None] Provisioning complete for port 8071f922-7132-49bf-a278-27ae884b948e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:18.360608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e23d35d4-fefd-4fdd-9907-2aab8a2e6a26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.389853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:18.389853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:18.389853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:18.397862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:18.397862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:18.415961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:18.415961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:18.415961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:18.415961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Bound port: ac725df3-7862-483f-82a4-1cc27a3a5efa, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:18.430409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=8071f922-7132-49bf-a278-27ae884b948e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:18.477246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.546201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cf770d29-1c69-4f15-b07a-7cd04c2724a4', '6807c0f5-8451-4ed4-a51e-0d565a72e491'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:18.664695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:18.675364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:18.688600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:18.695056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:18.695745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.710673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:18.716798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event updated for resources: {'Port': ['ID=465bd6cc-6c8f-4b1c-924a-e655a016d3db,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:18.734658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Router 42d516dc-3fc9-4356-b366-0a38870a320d is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:45:18.756078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-196fffd1-1aac-4851-aae8-b25c4330a63d req-5864bf1c-9a45-4826-8cdb-0a5b330c7a53 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:18.757765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-196fffd1-1aac-4851-aae8-b25c4330a63d req-5864bf1c-9a45-4826-8cdb-0a5b330c7a53 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 945 time: 0.2600768 Dec 21 03:45:18.819879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:18.821118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7c4c4dae-a137-4093-a09e-172de9935a01 service neutron] 10.222.0.18 "POST /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa/bindings HTTP/1.1" status: 201 len: 390 time: 1.0265834 Dec 21 03:45:18.830881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-b32daf35-d5bc-4db8-a9bc-3cf67229d4d5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.8313000 Dec 21 03:45:18.864471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Request body: {'port': {'device_id': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:18.929805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-196fffd1-1aac-4851-aae8-b25c4330a63d req-fedca061-7e6a-4abc-80f6-9ff7cd6e18e4 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1653869 Dec 21 03:45:18.943594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:18.987857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Sync routers for ids ['42d516dc-3fc9-4356-b366-0a38870a320d'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:19.004814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:19.006378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-51d024fb-bb09-47e2-b635-86ca30e002a6 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 3.5913079 Dec 21 03:45:19.009407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43776) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:19.030882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:19.043485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Routers {'42d516dc-3fc9-4356-b366-0a38870a320d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:19.044143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['42d516dc-3fc9-4356-b366-0a38870a320d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:19.046140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e400a3f7-f192-434c-b89b-d3ff63b9c987 None None] Provisioning complete for port 8071f922-7132-49bf-a278-27ae884b948e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:19.047468 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e400a3f7-f192-434c-b89b-d3ff63b9c987 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:19.230310 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a01fe86f-5751-4909-b944-d59a192a2d67 x-openstack-request-id: req-a01fe86f-5751-4909-b944-d59a192a2d67 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:19.230839 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:19.230839 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a01fe86f-5751-4909-b944-d59a192a2d67 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:19.231268 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59', 'status': 'completed', 'code': 200} Dec 21 03:45:19.325369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-a4aee530-4c30-4d1e-b98c-57bdd254342b tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips/c9b308b1-ac49-4887-88d7-b116974f8653 HTTP/1.1" status: 200 len: 693 time: 0.0741472 Dec 21 03:45:19.366681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-6e9c9832-1e1c-4428-9a0e-bd25e3911b10 req-839b465b-1843-4352-ad4f-aea57c8569e3 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:45:19.367409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e9c9832-1e1c-4428-9a0e-bd25e3911b10 req-839b465b-1843-4352-ad4f-aea57c8569e3 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0392194 Dec 21 03:45:19.458664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Set router 42d516dc-3fc9-4356-b366-0a38870a320d gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:19.467309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-48f2d834-170f-4bc4-b202-a0f79526ce39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:19.468744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-48f2d834-170f-4bc4-b202-a0f79526ce39 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 1095 time: 0.1393886 Dec 21 03:45:19.578326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-d71083a5-bc2e-472d-bbf2-274c8821d366 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:19.583497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-d71083a5-bc2e-472d-bbf2-274c8821d366 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2113125 Dec 21 03:45:19.638620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-4840d583-9496-44c5-9e7c-53e2aa8b2ae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:19.641295 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-4840d583-9496-44c5-9e7c-53e2aa8b2ae6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1097 time: 0.1512699 Dec 21 03:45:19.687567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dd4b8c27-5a92-414f-b19f-bd3173552184 None None] Provisioning complete for port 465bd6cc-6c8f-4b1c-924a-e655a016d3db triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:19.687941 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd4b8c27-5a92-414f-b19f-bd3173552184 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:19.792275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-62697c73-05c7-49c8-8ebf-ef9600824fef tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 696 time: 0.1835639 Dec 21 03:45:19.838060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 191b83a9-628d-4985-aca6-eb18b8810e59 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:19.843753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dd4b8c27-5a92-414f-b19f-bd3173552184 None None] Port 465bd6cc-6c8f-4b1c-924a-e655a016d3db cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:19.917152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-18598082-2264-4f01-8d87-ef8c1d54e186 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.194 HTTP/1.1" status: 200 len: 696 time: 0.0949330 Dec 21 03:45:19.926700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 465bd6cc-6c8f-4b1c-924a-e655a016d3db {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:19.990882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:19.999249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8071f922-7132-49bf-a278-27ae884b948e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:20.007448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c814320a-98a7-4ea1-bb18-3eb4d2c8d2d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.122574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-95ddd02b-0318-4b4e-a1f8-7b8806085693 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:20.125031 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-95ddd02b-0318-4b4e-a1f8-7b8806085693 service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.4494638 Dec 21 03:45:20.141517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-bad88078-734f-46b2-8f78-23bce3e1c9ce service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2399302 Dec 21 03:45:20.157421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 191b83a9-628d-4985-aca6-eb18b8810e59, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=191b83a9-628d-4985-aca6-eb18b8810e59,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:20.170073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '191b83a9-628d-4985-aca6-eb18b8810e59', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'port_id': '191b83a9-628d-4985-aca6-eb18b8810e59', 'mac_address': 'fa:16:3e:e5:70:a9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:20.201386 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-e976a81d-7752-4103-9ac7-697b5683ad24 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 217 time: 0.0586941 Dec 21 03:45:20.205679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.245194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.253994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8071f922-7132-49bf-a278-27ae884b948e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:20.253994 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.289555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:17Z', 'revision_number': 3, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:20.327325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Checking router: 42d516dc-3fc9-4356-b366-0a38870a320d for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:20.327689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Updating router 42d516dc-3fc9-4356-b366-0a38870a320d port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:45:20.339488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 191b83a9-628d-4985-aca6-eb18b8810e59 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:20.362819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 191b83a9-628d-4985-aca6-eb18b8810e59, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=191b83a9-628d-4985-aca6-eb18b8810e59,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:20.392856 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.421621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.449658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Transition to ACTIVE for port object 465bd6cc-6c8f-4b1c-924a-e655a016d3db will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:45:20.490958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Allocated IP 172.20.0.1 (18a094f5-b40b-4b83-80a8-7471f10d9e18/38e2bfb3-afda-4171-9221-c30960cbbdb4/27718740-90c8-4029-83bb-09302fe8a973) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:20.503786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-538b59df-73f4-485d-a8b1-a82ec7fcf7ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:20.505305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-538b59df-73f4-485d-a8b1-a82ec7fcf7ad service neutron] 10.222.0.31 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 925 time: 0.9155002 Dec 21 03:45:20.548069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60118fa2-cbb9-44a8-89f1-f80d1ccf9aff req-ddae01bc-366f-4e1e-9117-ff6279077385 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:20.550129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60118fa2-cbb9-44a8-89f1-f80d1ccf9aff req-ddae01bc-366f-4e1e-9117-ff6279077385 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 936 time: 0.6287868 Dec 21 03:45:20.558613 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.645815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-4bc62732-8e69-4264-b302-5ba78ea0320f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=191b83a9-628d-4985-aca6-eb18b8810e59 HTTP/1.1" status: 200 len: 217 time: 0.1210244 Dec 21 03:45:20.650296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=191b83a9-628d-4985-aca6-eb18b8810e59,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:20.715741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-dc34c966-9a83-4e1f-8611-3831f9c6fb79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:20.727617 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-dc34c966-9a83-4e1f-8611-3831f9c6fb79 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.4880056 Dec 21 03:45:20.736287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Pushing event updated for resources: {'Port': ['ID=465bd6cc-6c8f-4b1c-924a-e655a016d3db,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:20.763831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Deleting port af431c0b-bc02-4a67-9ff3-f2b2cb32a5ad {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:20.764192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:20.818134 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-b05bb471-fe2f-41c0-b54f-959f7278e1dd service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0762544 Dec 21 03:45:20.840140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-835f2b15-5688-4213-b066-442082e6569a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:20.841784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-835f2b15-5688-4213-b066-442082e6569a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.1783786 Dec 21 03:45:20.845483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['191b83a9-628d-4985-aca6-eb18b8810e59'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:20.876597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60118fa2-cbb9-44a8-89f1-f80d1ccf9aff req-e88f43e6-f010-49d6-a326-3fa7ac9b94d3 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2726746 Dec 21 03:45:20.919895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Attempting to bind port 465bd6cc-6c8f-4b1c-924a-e655a016d3db on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:20.919895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Attempting to bind port 465bd6cc-6c8f-4b1c-924a-e655a016d3db by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:20.919895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Attempting to bind port 465bd6cc-6c8f-4b1c-924a-e655a016d3db on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:20.933489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Port 465bd6cc-6c8f-4b1c-924a-e655a016d3db on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:20.933829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Attempting to bind port 465bd6cc-6c8f-4b1c-924a-e655a016d3db on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:20.948014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:20.954191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:20.954191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:20.954191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Bound port: 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:20.954191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.007263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-0caccb3e-caac-4b01-a479-483b4f446d36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:21.009225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-0caccb3e-caac-4b01-a479-483b4f446d36 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1571047 Dec 21 03:45:21.016184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.018388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.056260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.155262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Calling delete_port for af431c0b-bc02-4a67-9ff3-f2b2cb32a5ad owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:21.161826 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-0d47fa09-b2a3-420c-a742-ce32e898807c service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3317213 Dec 21 03:45:21.250754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:21.255336 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4de0b1bb-626d-4719-a56c-6ddda1e6864a" -d '{"events": [{"name": "network-changed", "server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:21.380054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.404800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] For port 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:21.419559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.438973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78764055-e9e3-4759-bacc-1cb07bb85463 req-11eac16a-939a-4c7e-9a8d-b93708844f95 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:21.448966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78764055-e9e3-4759-bacc-1cb07bb85463 req-11eac16a-939a-4c7e-9a8d-b93708844f95 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 945 time: 0.2773950 Dec 21 03:45:21.456934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] For port 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:21.541202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-e9767a76-8ed0-41ce-ac8b-fafbe0d54c4a service neutron] 10.222.0.31 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4757590 Dec 21 03:45:21.552725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Attempting to bind port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:21.552871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Attempting to bind port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:21.553239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Attempting to bind port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:21.560060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78764055-e9e3-4759-bacc-1cb07bb85463 req-e5fd42a5-3210-450f-8d04-250a14326ecd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097472 Dec 21 03:45:21.560601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e469166-7316-49b0-8e9d-f0959717db5c None None] Pushing event updated for resources: {'Port': ['ID=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:21.564997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.567465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:21.567853 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:21.568309 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.568709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:21.569299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Bound port: 19909a2d-bb9e-4cec-b7f4-3ad7d7025185, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:21.569555 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.666002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] For port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:21.675832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] For port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:21.690491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.729588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:21.730259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.731775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] 10.222.0.54 "PUT /v2.0/ports/465bd6cc-6c8f-4b1c-924a-e655a016d3db HTTP/1.1" status: 200 len: 1097 time: 2.8767083 Dec 21 03:45:21.744240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:21.751772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:21.763401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.769855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:21.852857 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-87aeb12c-cf18-47e4-820a-3da3635f4c9f service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6769240 Dec 21 03:45:21.855880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Pushing event updated for resources: {'Port': ['ID=27718740-90c8-4029-83bb-09302fe8a973,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:21.896647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:21.912719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e469166-7316-49b0-8e9d-f0959717db5c None None] Pushing event updated for resources: {'Port': ['ID=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:21.976237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Routers {'42d516dc-3fc9-4356-b366-0a38870a320d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:21.976954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:44:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['42d516dc-3fc9-4356-b366-0a38870a320d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:22.210334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-dd8b0235-2edd-485d-88eb-e18658c62191 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:22.234913 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-dd8b0235-2edd-485d-88eb-e18658c62191 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 1100 time: 0.1783540 Dec 21 03:45:22.245337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee34648b-a761-4b83-b00a-d06fa258929e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.282479 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aacd170-4a13-4c87-94cc-da91941eb640 req-4457f409-1b70-4d43-a183-5c32dcfe4f12 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:22.285780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aacd170-4a13-4c87-94cc-da91941eb640 req-4457f409-1b70-4d43-a183-5c32dcfe4f12 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 944 time: 0.6120214 Dec 21 03:45:22.289835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9686ca9-3b3a-4e00-be86-589ce1d712be service neutron] Pushing event updated for resources: {'Port': ['ID=465bd6cc-6c8f-4b1c-924a-e655a016d3db,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:22.334299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-82fd6ddc-5e91-44d6-b315-264a73de5366 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.220&port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db HTTP/1.1" status: 200 len: 217 time: 0.0930848 Dec 21 03:45:22.342913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c6e3a9-dad8-4b77-9d64-6cb875d093d1 req-21532d87-d729-4e7d-9892-ff6a661a3e1b service neutron] 10.222.0.31 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7799978 Dec 21 03:45:22.397084 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.446043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-117fe420-0b58-43c5-9b3d-201e3ecc357d None None] Provisioning complete for port 27718740-90c8-4029-83bb-09302fe8a973 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:22.446662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-117fe420-0b58-43c5-9b3d-201e3ecc357d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.505280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aacd170-4a13-4c87-94cc-da91941eb640 req-315262f7-fccb-4e7c-96f4-696db4cdf8a1 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1831677 Dec 21 03:45:22.508872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] Set router 42d516dc-3fc9-4356-b366-0a38870a320d gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:22.513532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-b3f24074-9805-4f28-b4ac-b786540b72f2 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:22.516081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-b3f24074-9805-4f28-b4ac-b786540b72f2 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.3634205 Dec 21 03:45:22.517145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.528817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d41c7ef7-206c-49b3-ab92-6cd7f822c4fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:22.530427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-d41c7ef7-206c-49b3-ab92-6cd7f822c4fd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1645575 Dec 21 03:45:22.563867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:22.587090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-117fe420-0b58-43c5-9b3d-201e3ecc357d None None] Port 27718740-90c8-4029-83bb-09302fe8a973 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:22.600485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.729364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-a7315d69-61df-487f-a2d1-6526623f4a4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:22.731883 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-a7315d69-61df-487f-a2d1-6526623f4a4f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1720653 Dec 21 03:45:22.739886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event deleted for resources: {'Port': ['ID=af431c0b-bc02-4a67-9ff3-f2b2cb32a5ad,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:22.754759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.757313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.763281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-812ba21c-fbdf-4cb6-8e6f-72094fe03d15 req-79f29654-e181-442c-88cf-3762e20b21a0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "DELETE /v2.0/floatingips/c9b308b1-ac49-4887-88d7-b116974f8653 HTTP/1.1" status: 204 len: 173 time: 2.8437226 Dec 21 03:45:22.824847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.845070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.866670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac17637c-80c0-44e9-a1ae-7a296c354776 req-76b5b8e3-72bd-40b2-ae83-ad1220b1bcc7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:22.868292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac17637c-80c0-44e9-a1ae-7a296c354776 req-76b5b8e3-72bd-40b2-ae83-ad1220b1bcc7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1353159 Dec 21 03:45:22.880157 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f48bd6cb-10b6-48c3-ba97-e361490328cc x-openstack-request-id: req-f48bd6cb-10b6-48c3-ba97-e361490328cc {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:22.880306 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:22.880591 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f48bd6cb-10b6-48c3-ba97-e361490328cc {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:22.881014 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14', 'status': 'completed', 'code': 200} Dec 21 03:45:22.912544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:22.915886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:17Z', 'revision_number': 3, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:22.969689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Pushing event updated for resources: {'Port': ['ID=27718740-90c8-4029-83bb-09302fe8a973,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:22.970078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8993c6a-b66e-4a1a-8bcc-5fd1a97d370e None None] The sync data for ids ['42d516dc-3fc9-4356-b366-0a38870a320d'] in n-d-822053-11 is: [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:17Z', 'revision_number': 3, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:23.035920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:23.040574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-7d828653-1cb0-42c4-9caa-a9099c64dc1d service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2890761 Dec 21 03:45:23.123478 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:23.128971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac17637c-80c0-44e9-a1ae-7a296c354776 req-e6d2f779-6c58-4f4f-903e-ad1cf39a2218 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2465737 Dec 21 03:45:23.170285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-6a787fa6-43c5-4d7d-b48b-3e275b8e2c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:23.174021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-6a787fa6-43c5-4d7d-b48b-3e275b8e2c4e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6152d205cbf24532b57c0a62bd05450d&device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 1098 time: 0.2392263 Dec 21 03:45:23.256135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:23.264321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:23.277925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c7cb4b6-02c2-487f-9eb3-c8f20ef2a8f5 req-29a73a41-607f-4c80-8d7e-4b05c3de10c2 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1952608 Dec 21 03:45:23.295173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798384b4-e2df-4e47-b9bc-a9ad78f1fea7 req-717bf4ab-3f80-42db-9e1d-abdf6793c9aa tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:23.296677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-798384b4-e2df-4e47-b9bc-a9ad78f1fea7 req-717bf4ab-3f80-42db-9e1d-abdf6793c9aa tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 948 time: 0.3226962 Dec 21 03:45:23.452329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-996f3529-d1f2-4684-bf06-cdcfef2145bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:23.453873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-996f3529-d1f2-4684-bf06-cdcfef2145bc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1102 time: 0.0967944 Dec 21 03:45:23.499046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Router 42d516dc-3fc9-4356-b366-0a38870a320d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:23.519161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-798384b4-e2df-4e47-b9bc-a9ad78f1fea7 req-f13c27f5-935e-4833-93de-1eb7cec5ed46 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1644592 Dec 21 03:45:23.592524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:23.632767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501de906-412e-40a0-ab86-a102b9a6f091 req-bc9f8e1a-416f-4647-b148-aac987ef67b8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:23.640578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-501de906-412e-40a0-ab86-a102b9a6f091 req-bc9f8e1a-416f-4647-b148-aac987ef67b8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 945 time: 0.3929431 Dec 21 03:45:23.694245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-36c29f44-eb02-48fa-a0a4-e586fe62b7cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:23.697254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-279a0176-39c2-4b94-8c91-28c5f1e5dd19 None None] Provisioning complete for port 27718740-90c8-4029-83bb-09302fe8a973 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:23.697772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-279a0176-39c2-4b94-8c91-28c5f1e5dd19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:23.697984 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-36c29f44-eb02-48fa-a0a4-e586fe62b7cb service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2355130 Dec 21 03:45:23.706691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-a7dc2970-2d99-4ece-bfcc-007f1e7d1e65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:23.708218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-a7dc2970-2d99-4ece-bfcc-007f1e7d1e65 service neutron] 10.222.0.31 "GET /v2.0/networks?id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 200 len: 928 time: 0.4581296 Dec 21 03:45:23.747594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:23.796666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-279a0176-39c2-4b94-8c91-28c5f1e5dd19 None None] Port 27718740-90c8-4029-83bb-09302fe8a973 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:23.863655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 191b83a9-628d-4985-aca6-eb18b8810e59 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:23.864358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-136d71e4-f55c-40d9-a4ac-2aedda5bd681 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 200 len: 217 time: 0.0959282 Dec 21 03:45:23.882597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-501de906-412e-40a0-ab86-a102b9a6f091 req-5dac95b6-22da-4621-85d3-cc2bdc2479e7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2411356 Dec 21 03:45:23.925665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:23.927396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-16c2da4d-1a31-4a17-86c8-2e56814b20f3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.154&port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 217 time: 0.1094325 Dec 21 03:45:23.991217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:23.991734 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.010589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.041621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-58c2d112-054d-4325-b510-34f338b20e73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.042980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-58c2d112-054d-4325-b510-34f338b20e73 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 200 len: 866 time: 0.1930499 Dec 21 03:45:24.061278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:24.064021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-f6f0ec4c-5307-4d6b-bc85-28d3a6ef49fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.065666 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-f6f0ec4c-5307-4d6b-bc85-28d3a6ef49fe service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1281254 Dec 21 03:45:24.070983 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-43368d14-68ab-43a9-9559-4f89f40aa524 admin admin] 10.222.0.18 "PUT /v2.0/routers/42d516dc-3fc9-4356-b366-0a38870a320d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0578458 Dec 21 03:45:24.099545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.105386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1c7c11-2df3-40c1-be0a-5430197fcf0b req-58dd1eba-0026-4f00-ab12-3a706c125087 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.106904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c1c7c11-2df3-40c1-be0a-5430197fcf0b req-58dd1eba-0026-4f00-ab12-3a706c125087 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 946 time: 0.1322331 Dec 21 03:45:24.132854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-ca93d5fe-8beb-4ae7-8b33-53bcdf8a52b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.132854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-ca93d5fe-8beb-4ae7-8b33-53bcdf8a52b3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7bc2df93-ed75-4ee4-81c6-f3b3411325a4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0742283 Dec 21 03:45:24.133121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:24.177850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-771b92b1-dabb-4760-be37-1d937d26f8ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.179971 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-771b92b1-dabb-4760-be37-1d937d26f8ac service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1055224 Dec 21 03:45:24.194375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c1c7c11-2df3-40c1-be0a-5430197fcf0b req-5a2ba751-b6c5-4b31-8c07-e8b2490d7ca8 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=0.0.0.0 HTTP/1.1" status: 200 len: 217 time: 0.0622525 Dec 21 03:45:24.321779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-523b6cae-39ef-43f1-854e-0cae9fe3ec66 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1341171 Dec 21 03:45:24.338310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-48df721c-8313-4ef2-84d1-32ad4a29dc85 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1530998 Dec 21 03:45:24.362734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c781a0-1794-4b88-955a-cc44cefee90b req-246e6813-ee9d-4fb7-b5ac-2534ff6e944d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.364579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56c781a0-1794-4b88-955a-cc44cefee90b req-246e6813-ee9d-4fb7-b5ac-2534ff6e944d tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 944 time: 0.0779505 Dec 21 03:45:24.483424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-2ada5c63-3b36-49f9-9658-68dc7d5856fe service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1537297 Dec 21 03:45:24.487127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56c781a0-1794-4b88-955a-cc44cefee90b req-b065c37b-5c67-4456-86b9-7d659624c8cd tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1056163 Dec 21 03:45:24.507133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de0b1bb-626d-4719-a56c-6ddda1e6864a req-f29e647a-0f73-44f4-9f10-4b672007a906 service neutron] 10.222.0.31 "GET /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1600957 Dec 21 03:45:24.600534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae0b7c8-3d7d-4971-aaba-073a178aae94 req-bfadc5dd-fcdd-49f7-9977-cbb5440748bb tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:24.602337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fae0b7c8-3d7d-4971-aaba-073a178aae94 req-bfadc5dd-fcdd-49f7-9977-cbb5440748bb tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0500724 Dec 21 03:45:24.654459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 191b83a9-628d-4985-aca6-eb18b8810e59 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:24.656987 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.671139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fae0b7c8-3d7d-4971-aaba-073a178aae94 req-84304050-a739-4e60-945a-f1f8296dc4a7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622461 Dec 21 03:45:24.672541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.700068 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.722079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 191b83a9-628d-4985-aca6-eb18b8810e59 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:24.722461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.779018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb85bd74-e74d-459a-9e98-7e7917f67e76 req-4c21fff1-1e7e-4ae6-bb7f-d1de2d248ff0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=0.0.0.0 HTTP/1.1" status: 200 len: 217 time: 0.0768330 Dec 21 03:45:24.790228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:24.856208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:24.856547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:24.856935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:24.872531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:24.873034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Attempting to bind port ac725df3-7862-483f-82a4-1cc27a3a5efa on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:24.895708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'tag': '465bd6cc-6c8f-4b1c-924a-e655a016d3db'}, {'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:24.899344 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c" -d '{"events": [{"name": "network-changed", "server_uuid": "07e22202-8c9b-481b-b5b1-eb2fb572b5b6", "tag": "465bd6cc-6c8f-4b1c-924a-e655a016d3db"}, {"server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "name": "network-vif-unplugged", "status": "completed", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:24.923166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:24.927024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:24.927385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:24.927769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:24.928413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Bound port: ac725df3-7862-483f-82a4-1cc27a3a5efa, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:24.928771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.944080 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:24.976298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:24.979213 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2a2b001-9c53-4fa4-8d56-277280220e7b" -d '{"events": [{"server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "name": "network-vif-plugged", "status": "completed", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:24.993953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 191b83a9-628d-4985-aca6-eb18b8810e59, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=191b83a9-628d-4985-aca6-eb18b8810e59,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:25.030716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:25.053760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d3179bf-9d03-4910-91a0-86d27bebe924 req-474331e8-b9a2-4bc2-b04b-c710d3d2096a tempest-FloatingIPsNegativeTestJSON-2074892689 tempest-FloatingIPsNegativeTestJSON-2074892689-project] 10.222.0.18 "GET /v2.0/floatingips?tenant_id=8f2eb29d24414a7ebe3c5bd20a786a31 HTTP/1.1" status: 200 len: 217 time: 0.0791523 Dec 21 03:45:25.082230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:25.101104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:25.104717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:25.134117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=191b83a9-628d-4985-aca6-eb18b8810e59,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:25.164843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c60fc5e-e3bc-4ede-9120-16496ba1afd0 req-6784b9d3-46e6-4da8-9c79-9824e01a301f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:25.167430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c60fc5e-e3bc-4ede-9120-16496ba1afd0 req-6784b9d3-46e6-4da8-9c79-9824e01a301f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 948 time: 0.0528200 Dec 21 03:45:25.217350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c60fc5e-e3bc-4ede-9120-16496ba1afd0 req-4244f81f-a6bd-4659-8a40-38294769f27f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450573 Dec 21 03:45:25.223750 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:25.311724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=8']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:25.334216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:25.335223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:25.336933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-185bb70a-633e-4c52-b376-1c0649a750e9 service neutron] 10.222.0.54 "PUT /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 1123 time: 2.7948363 Dec 21 03:45:25.364275 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Sync routers for ids ['42d516dc-3fc9-4356-b366-0a38870a320d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:25.382138 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Routers {'42d516dc-3fc9-4356-b366-0a38870a320d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:25.382904 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['42d516dc-3fc9-4356-b366-0a38870a320d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:25.479896 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 352 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-664126ff-25fc-41b4-93a3-2918e69b30da x-openstack-request-id: req-664126ff-25fc-41b4-93a3-2918e69b30da {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:25.480195 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "07e22202-8c9b-481b-b5b1-eb2fb572b5b6", "tag": "465bd6cc-6c8f-4b1c-924a-e655a016d3db", "status": "completed", "code": 200}, {"server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "name": "network-vif-unplugged", "status": "completed", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:25.480453 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-664126ff-25fc-41b4-93a3-2918e69b30da {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:25.480865 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'tag': '465bd6cc-6c8f-4b1c-924a-e655a016d3db', 'status': 'completed', 'code': 200} Dec 21 03:45:25.481106 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'code': 200} Dec 21 03:45:25.511602 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Set router 42d516dc-3fc9-4356-b366-0a38870a320d gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:25.530276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['ac725df3-7862-483f-82a4-1cc27a3a5efa'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:25.652960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-9ef214d4-f734-42d2-ab80-cca7760bb2e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:25.659304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-9ef214d4-f734-42d2-ab80-cca7760bb2e0 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4712c556d73e4ad2b805061c976ddd2e&device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 1100 time: 0.0927794 Dec 21 03:45:25.669058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6567714d-b62d-47e4-9317-43ea37731cc3 req-0dfd68f9-5698-4ad6-ab13-222adfae53f9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:25.678337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6567714d-b62d-47e4-9317-43ea37731cc3 req-0dfd68f9-5698-4ad6-ab13-222adfae53f9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.1171474 Dec 21 03:45:25.697292 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:25.742152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6567714d-b62d-47e4-9317-43ea37731cc3 req-810fa492-f1a6-4659-8999-64ea37b7bfdf tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627789 Dec 21 03:45:25.766338 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30051729-f8e3-4b10-a496-526ad375ccf6 x-openstack-request-id: req-30051729-f8e3-4b10-a496-526ad375ccf6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:25.767407 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "name": "network-vif-plugged", "status": "completed", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:25.767971 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-30051729-f8e3-4b10-a496-526ad375ccf6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:25.768369 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59', 'code': 200} Dec 21 03:45:25.867701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:25.869445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0cef88a7-0b5a-4c91-882b-dc1fdefe21d9 req-d2910aee-68d5-4bc0-ae69-afd6c8ea2def tempest-FloatingIPsNegativeTestJSON-2074892689 tempest-FloatingIPsNegativeTestJSON-2074892689-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=non_exist_pool HTTP/1.1" status: 200 len: 213 time: 0.0535953 Dec 21 03:45:25.910423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493a3d84-e06e-4631-bab3-943065cc750d req-4f0abe84-3995-4e29-a0ac-99e05dc44cb0 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:25.934193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-493a3d84-e06e-4631-bab3-943065cc750d req-4f0abe84-3995-4e29-a0ac-99e05dc44cb0 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.1168146 Dec 21 03:45:25.947330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:25.947996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:25.952518 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:22Z', 'revision_number': 4, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '27718740-90c8-4029-83bb-09302fe8a973', 'name': '', 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'mac_address': 'fa:16:3e:85:74:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '38e2bfb3-afda-4171-9221-c30960cbbdb4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:20Z', 'updated_at': '2021-12-21T03:45:22Z', 'revision_number': 2, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'subnets': [{'id': '38e2bfb3-afda-4171-9221-c30960cbbdb4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:25.980183 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Checking router: 42d516dc-3fc9-4356-b366-0a38870a320d for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:25.980827 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Updating router 42d516dc-3fc9-4356-b366-0a38870a320d port 27718740-90c8-4029-83bb-09302fe8a973 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:45:26.005627 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:26.061516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db6f5cd-b495-41d6-98c6-a369e3327e60 req-817bfb53-b7de-4f51-91bc-f0b5b2512afd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:26.063376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2db6f5cd-b495-41d6-98c6-a369e3327e60 req-817bfb53-b7de-4f51-91bc-f0b5b2512afd service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 1097 time: 0.1380448 Dec 21 03:45:26.093761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-493a3d84-e06e-4631-bab3-943065cc750d req-8f6ccc34-0d03-4b68-a74d-a76f0bf80600 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1607807 Dec 21 03:45:26.152860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60acc353-b708-4986-9d9e-59fc45a07f74 req-2b700500-42af-4f49-822f-1e7560541956 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:26.161044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60acc353-b708-4986-9d9e-59fc45a07f74 req-2b700500-42af-4f49-822f-1e7560541956 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 946 time: 0.1813931 Dec 21 03:45:26.225044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2db6f5cd-b495-41d6-98c6-a369e3327e60 req-e4b4be14-4d14-47ec-95f6-f0ddbed89b21 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1500609 Dec 21 03:45:26.255497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-b0dfdd86-e2bd-439c-be31-4d8280682918 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:26.257172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-b0dfdd86-e2bd-439c-be31-4d8280682918 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2270029 Dec 21 03:45:26.323591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60acc353-b708-4986-9d9e-59fc45a07f74 req-1307de46-2e6c-4d91-955a-2e6b26328f1b tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1615677 Dec 21 03:45:26.326067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-77d6e6c0-8550-41f9-937e-45579aeca5a1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.220&port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db HTTP/1.1" status: 200 len: 217 time: 0.0532794 Dec 21 03:45:26.348545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a809ba8-1a15-42c5-8260-2efafc414fba req-771b491a-76e6-4257-b771-b4ec44ff1461 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:26.348545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a809ba8-1a15-42c5-8260-2efafc414fba req-771b491a-76e6-4257-b771-b4ec44ff1461 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1493452 Dec 21 03:45:26.431925 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:26.439923 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-155c45c9-04ce-42fa-a3f8-056a03083cbc req-74482ee1-cae0-4b09-bc29-ed5c53e359ec tempest-FloatingIPsNegativeTestJSON-2074892689 tempest-FloatingIPsNegativeTestJSON-2074892689-project] show failed (client error): The resource could not be found. Dec 21 03:45:26.440966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-155c45c9-04ce-42fa-a3f8-056a03083cbc req-74482ee1-cae0-4b09-bc29-ed5c53e359ec tempest-FloatingIPsNegativeTestJSON-2074892689 tempest-FloatingIPsNegativeTestJSON-2074892689-project] 10.222.0.18 "GET /v2.0/floatingips/9aa1c270-6f31-49ca-aac0-a8dfc78c57cb HTTP/1.1" status: 404 len: 350 time: 0.0575945 Dec 21 03:45:26.452596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43906) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:26.477396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-877e9657-e787-4b10-8f29-211bedd18694 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:26.478878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-877e9657-e787-4b10-8f29-211bedd18694 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1291754 Dec 21 03:45:26.506627 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:26.520592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a809ba8-1a15-42c5-8260-2efafc414fba req-0d2dd692-4943-4f04-a833-d66b3407d0f4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1673582 Dec 21 03:45:26.745176 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Attempting to bind port 27718740-90c8-4029-83bb-09302fe8a973 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:26.745611 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Attempting to bind port 27718740-90c8-4029-83bb-09302fe8a973 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:26.752769 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Attempting to bind port 27718740-90c8-4029-83bb-09302fe8a973 on network 18a094f5-b40b-4b83-80a8-7471f10d9e18 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:26.778248 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfdaacc5-2cdd-4d25-a520-e8387ced99dc None None] Pushing event updated for resources: {'Port': ['ID=27718740-90c8-4029-83bb-09302fe8a973,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:26.789605 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:26.790153 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Checking segment: {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:26.790686 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:26.792051 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Bound using segment: {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:26.795207 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Bound port: 27718740-90c8-4029-83bb-09302fe8a973, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ee16d6fe-99ec-4da8-b055-dee4ca67b943', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:26.796008 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:26.922465 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] For port 27718740-90c8-4029-83bb-09302fe8a973, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:26.927373 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] For port 27718740-90c8-4029-83bb-09302fe8a973, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27718740-90c8-4029-83bb-09302fe8a973,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:26.966902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0d1015a1-1635-416f-9f49-7a46f4937ab0 None None] Provisioning complete for port 27718740-90c8-4029-83bb-09302fe8a973 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:26.978468 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d1015a1-1635-416f-9f49-7a46f4937ab0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:27.014384 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:27.038392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0d1015a1-1635-416f-9f49-7a46f4937ab0 None None] Port 27718740-90c8-4029-83bb-09302fe8a973 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:27.085796 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfdaacc5-2cdd-4d25-a520-e8387ced99dc None None] Pushing event updated for resources: {'Port': ['ID=27718740-90c8-4029-83bb-09302fe8a973,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:27.096469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04435db6-7d20-48cc-be1b-3937b2183b88 req-c345681a-4d12-4354-bb2d-e36f28f97fe2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:27.103956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04435db6-7d20-48cc-be1b-3937b2183b88 req-c345681a-4d12-4354-bb2d-e36f28f97fe2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.1214609 Dec 21 03:45:27.129068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2546b057-78df-4b3f-9f73-608eb9e0aeb7 req-a6fdaf25-5ee2-47a4-8107-8be3867db56e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:27.130679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2546b057-78df-4b3f-9f73-608eb9e0aeb7 req-a6fdaf25-5ee2-47a4-8107-8be3867db56e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 948 time: 0.1552205 Dec 21 03:45:27.132688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-c0b85ba8-cdd5-403d-a207-1ad5a366ead8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:27.137995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Routers {'42d516dc-3fc9-4356-b366-0a38870a320d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:27.138635 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['42d516dc-3fc9-4356-b366-0a38870a320d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:27.140345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-c0b85ba8-cdd5-403d-a207-1ad5a366ead8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.6398208 Dec 21 03:45:27.315067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:27.337441 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] Set router 42d516dc-3fc9-4356-b366-0a38870a320d gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:27.434645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2546b057-78df-4b3f-9f73-608eb9e0aeb7 req-19f69af0-d649-467f-8764-9859eee4729d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2926328 Dec 21 03:45:27.468321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-b63b557d-2015-4e74-b377-b4128cd79675 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3150647 Dec 21 03:45:27.475466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04435db6-7d20-48cc-be1b-3937b2183b88 req-31ad6f1f-4992-436f-8529-59c914957549 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3323605 Dec 21 03:45:27.482476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:27.485688 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1" -d '{"events": [{"name": "network-changed", "server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:27.580423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Provisioning complete for port 27718740-90c8-4029-83bb-09302fe8a973 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:27.580423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:27.679681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:27.791150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5b796f4-fe29-4e22-8fef-ae0d2cb7848c req-2915bc98-7610-4390-a108-e031f33d0a42 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3004966 Dec 21 03:45:27.807024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb8eac0f-fcdc-413e-a410-b0cb6aa61bfa req-54a986cc-98aa-4824-9d2c-13d61429de99 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:27.808528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb8eac0f-fcdc-413e-a410-b0cb6aa61bfa req-54a986cc-98aa-4824-9d2c-13d61429de99 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.2278202 Dec 21 03:45:27.819894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40296c9b-e8cc-4b99-929d-86d0ce6804ec req-e3c7b7f9-6cea-4a1e-8bb5-fdfc5ee1bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:27.825095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40296c9b-e8cc-4b99-929d-86d0ce6804ec req-e3c7b7f9-6cea-4a1e-8bb5-fdfc5ee1bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 946 time: 0.2259188 Dec 21 03:45:27.832524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:27.851661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:45:27.851884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 465bd6cc-6c8f-4b1c-924a-e655a016d3db details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:27.856602 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:22Z', 'revision_number': 4, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '27718740-90c8-4029-83bb-09302fe8a973', 'name': '', 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'mac_address': 'fa:16:3e:85:74:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '38e2bfb3-afda-4171-9221-c30960cbbdb4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:20Z', 'updated_at': '2021-12-21T03:45:26Z', 'revision_number': 4, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'subnets': [{'id': '38e2bfb3-afda-4171-9221-c30960cbbdb4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:27.911830 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb1dc8a8-e518-4def-b679-cd678da9b87a None None] The sync data for ids ['42d516dc-3fc9-4356-b366-0a38870a320d'] in n-d-822053-11 is: [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:22Z', 'revision_number': 4, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '27718740-90c8-4029-83bb-09302fe8a973', 'name': '', 'network_id': '18a094f5-b40b-4b83-80a8-7471f10d9e18', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'mac_address': 'fa:16:3e:85:74:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '38e2bfb3-afda-4171-9221-c30960cbbdb4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:20Z', 'updated_at': '2021-12-21T03:45:26Z', 'revision_number': 4, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'subnets': [{'id': '38e2bfb3-afda-4171-9221-c30960cbbdb4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:27.919091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb8eac0f-fcdc-413e-a410-b0cb6aa61bfa req-2d768455-9ffb-473c-9341-2d769cb2eef7 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0887489 Dec 21 03:45:27.996577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Deleting port 27718740-90c8-4029-83bb-09302fe8a973 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:27.997076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.030862 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba0bf3f5-4ff2-4def-b416-2bd14e9f3f38 x-openstack-request-id: req-ba0bf3f5-4ff2-4def-b416-2bd14e9f3f38 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:28.031308 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:28.031569 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ba0bf3f5-4ff2-4def-b416-2bd14e9f3f38 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:28.031972 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'status': 'completed', 'code': 200} Dec 21 03:45:28.047750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40296c9b-e8cc-4b99-929d-86d0ce6804ec req-3fe7e46c-71a1-4306-835c-4014e9422bfa tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/security-groups?id=9eab3df9-8a1c-4829-a64e-d0f01a0561ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2215989 Dec 21 03:45:28.089508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-1a4449a3-b46c-49c5-9028-94502d28849b tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.089669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-1a4449a3-b46c-49c5-9028-94502d28849b tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.31 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 946 time: 0.1387105 Dec 21 03:45:28.212705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.233798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:28.247976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-2a5bad01-1730-415e-a013-14d60f40bf98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.249978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-2a5bad01-1730-415e-a013-14d60f40bf98 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1126 time: 0.1086886 Dec 21 03:45:28.291767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '465bd6cc-6c8f-4b1c-924a-e655a016d3db', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '465bd6cc-6c8f-4b1c-924a-e655a016d3db', 'mac_address': 'fa:16:3e:57:f9:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.220'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:28.305736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0188bf1c-5379-40a2-a267-fbe18398b871 req-054343f3-d122-44ee-bca6-b86d24a1c727 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.327015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0188bf1c-5379-40a2-a267-fbe18398b871 req-054343f3-d122-44ee-bca6-b86d24a1c727 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1743407 Dec 21 03:45:28.340552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] For port 27718740-90c8-4029-83bb-09302fe8a973, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27718740-90c8-4029-83bb-09302fe8a973,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:28.340845 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.381577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] For port 27718740-90c8-4029-83bb-09302fe8a973, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27718740-90c8-4029-83bb-09302fe8a973,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:28.417721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Calling delete_port for 27718740-90c8-4029-83bb-09302fe8a973 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:28.431866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.438687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0188bf1c-5379-40a2-a267-fbe18398b871 req-045b9e3e-64a4-4d21-bf6b-236aed4c11af tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095793 Dec 21 03:45:28.440548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Deleting port 742f0270-e348-4b05-82d9-88e6e724dc14 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:28.440896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.450322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 465bd6cc-6c8f-4b1c-924a-e655a016d3db {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:28.484169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:28.486807 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.561867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.567446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Pushing event updated for resources: {'Port': ['ID=27718740-90c8-4029-83bb-09302fe8a973,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:28.576249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.576746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.577203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.577650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.578187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.578758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.579068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.579549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.580142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.580625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.581057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.581668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.582148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d788f532-7814-4eb9-8b6e-721089cd1d71 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:28.608216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] For port 742f0270-e348-4b05-82d9-88e6e724dc14, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=742f0270-e348-4b05-82d9-88e6e724dc14,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:28.609276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:28.624203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Calling delete_port for 742f0270-e348-4b05-82d9-88e6e724dc14 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:28.686574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=465bd6cc-6c8f-4b1c-924a-e655a016d3db,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:28.705093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-448507b3-d4d9-4cc1-896e-a96c131c4f68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.710858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-448507b3-d4d9-4cc1-896e-a96c131c4f68 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.4496267 Dec 21 03:45:28.768733 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-4c7abce2-0e4b-4836-bd6a-18ac7c01da3a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 217 time: 0.0438392 Dec 21 03:45:28.958482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78691335-bccd-4c81-afa5-cf0824fd674a req-fcbed81e-8c95-4307-891b-69196636fb33 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.960444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78691335-bccd-4c81-afa5-cf0824fd674a req-fcbed81e-8c95-4307-891b-69196636fb33 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 949 time: 0.2403202 Dec 21 03:45:28.969817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505691d9-5d9a-4417-a4f2-3ac47515d1da req-b0702313-6633-4b9b-8e42-06f98766d7d9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.972375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-505691d9-5d9a-4417-a4f2-3ac47515d1da req-b0702313-6633-4b9b-8e42-06f98766d7d9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.2643929 Dec 21 03:45:28.985888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-8c860833-c00b-4880-97e8-cf12361d3b6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:28.987633 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-8c860833-c00b-4880-97e8-cf12361d3b6c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1477735 Dec 21 03:45:28.992213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:29.023833 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-70cee1de-11f7-45ac-97ab-afb03ad7f503 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1938846 Dec 21 03:45:29.035532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['742f0270-e348-4b05-82d9-88e6e724dc14'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:29.046097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Pushing event deleted for resources: {'Port': ['ID=742f0270-e348-4b05-82d9-88e6e724dc14,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:29.059695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-2255adf7-3ea8-4811-80ae-2c8b30fccef8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0558228 Dec 21 03:45:29.132965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-505691d9-5d9a-4417-a4f2-3ac47515d1da req-92457a82-8132-424d-8660-7db8835fb2a3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1415827 Dec 21 03:45:29.191234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['465bd6cc-6c8f-4b1c-924a-e655a016d3db'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:29.202307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78691335-bccd-4c81-afa5-cf0824fd674a req-59c2dbae-4961-4c48-a9e7-cacf715a0dfd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2286775 Dec 21 03:45:29.244852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] No DVR routers for this DVR port 742f0270-e348-4b05-82d9-88e6e724dc14 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:29.254882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:29.257426 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-8147c145-da71-4d0c-83b4-aadae5f98d01 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1827669 Dec 21 03:45:29.261994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4d6c453-2e2a-4246-ae01-2e6b1f34c50d req-64935cbf-8e42-4d9a-81aa-ee0be6a77a45 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.31 "DELETE /v2.0/ports/742f0270-e348-4b05-82d9-88e6e724dc14 HTTP/1.1" status: 204 len: 173 time: 1.1598468 Dec 21 03:45:29.375303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-954e0363-b46d-4370-85d0-96a14a7bea78 req-e7512572-1869-483e-849b-71cc270a97c4 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480 tempest-FloatingIPsAssociationNegativeTestJSON-1143231480-project] 10.222.0.18 "GET /v2.0/ports?device_id=e3f941ea-f66c-496c-8a93-3fbefa23ef42 HTTP/1.1" status: 200 len: 210 time: 0.0468364 Dec 21 03:45:29.395944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd2a4f0-2ad4-45d9-8d30-2d75ea8fde18 req-79fab0a4-8cae-420c-aea0-e18354f2f215 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:29.404007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fd2a4f0-2ad4-45d9-8d30-2d75ea8fde18 req-79fab0a4-8cae-420c-aea0-e18354f2f215 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.1325402 Dec 21 03:45:29.494264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fd2a4f0-2ad4-45d9-8d30-2d75ea8fde18 req-6d6132ec-4839-4360-8143-560cfe33d0f4 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0890317 Dec 21 03:45:29.547911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-15bef8d4-b0ea-4d57-94d4-27df2cd544bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:29.550891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-15bef8d4-b0ea-4d57-94d4-27df2cd544bd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1102 time: 0.2870245 Dec 21 03:45:29.598168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4e22fee-e47b-4f30-a493-55f1dc5be3d1 req-9f7e9434-3289-4292-ab5a-1da1624885de service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2704861 Dec 21 03:45:29.608929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:29.645994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Pushing event deleted for resources: {'Port': ['ID=27718740-90c8-4029-83bb-09302fe8a973,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:29.930054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c21c7e-d014-4a50-a933-47958bfe7ad7 req-e683cdb1-7ad4-4127-91c3-122089c34427 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:29.940350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89c21c7e-d014-4a50-a933-47958bfe7ad7 req-e683cdb1-7ad4-4127-91c3-122089c34427 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.2817254 Dec 21 03:45:29.963673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27718740-90c8-4029-83bb-09302fe8a973 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:29.987325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9659d9a2-77e5-447f-aad1-c5d6f860db9c req-3291fd06-60a0-430b-be14-4714b3813fb4 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:29.989178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9659d9a2-77e5-447f-aad1-c5d6f860db9c req-3291fd06-60a0-430b-be14-4714b3813fb4 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.2886839 Dec 21 03:45:30.006484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43954) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:30.034276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 27718740-90c8-4029-83bb-09302fe8a973 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:30.038732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Request body: {'floatingip': {'port_id': '191b83a9-628d-4985-aca6-eb18b8810e59'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:30.039569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27718740-90c8-4029-83bb-09302fe8a973 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 21 03:45:30.064792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'name': 'network-vif-deleted', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:30.067104 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28d899ae-12ce-4153-871b-974d30c17ca1" -d '{"events": [{"server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "name": "network-vif-deleted", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:30.071288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Port 27718740-90c8-4029-83bb-09302fe8a973 not found, will not notify nova. {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 21 03:45:30.141029 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15322ef7-01a3-4c65-8827-d3417504994e x-openstack-request-id: req-15322ef7-01a3-4c65-8827-d3417504994e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:30.141379 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e3f941ea-f66c-496c-8a93-3fbefa23ef42", "name": "network-vif-deleted", "tag": "742f0270-e348-4b05-82d9-88e6e724dc14", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:30.141582 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-15322ef7-01a3-4c65-8827-d3417504994e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:30.141992 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e3f941ea-f66c-496c-8a93-3fbefa23ef42', 'name': 'network-vif-deleted', 'tag': '742f0270-e348-4b05-82d9-88e6e724dc14', 'status': 'completed', 'code': 200} Dec 21 03:45:30.169199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:30.346252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-628465df-02b4-4405-bd42-4a326768165d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:30.348067 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-628465df-02b4-4405-bd42-4a326768165d service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.6799111 Dec 21 03:45:30.381474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.381823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.382160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.382503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.382829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.383188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.383516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.383845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.384171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.389723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.389723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.389723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.389723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:30.441413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-4d02d3ef-6d98-4f0e-aacd-c06760ba9e45 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0671997 Dec 21 03:45:30.536314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-1b051b51-f32a-4186-9bda-1a4d31d7041e service neutron] 10.222.0.31 "GET /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.1995780 Dec 21 03:45:30.539410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-94f3e405-c8c9-4b61-89a3-950f2baee41f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:30.541054 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-94f3e405-c8c9-4b61-89a3-950f2baee41f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0792053 Dec 21 03:45:30.685869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:30.772519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:30.780354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89c21c7e-d014-4a50-a933-47958bfe7ad7 req-40e7a415-9d70-4573-aa40-c09660a90485 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8391349 Dec 21 03:45:30.839790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:30.900765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c38fec-25de-4b01-9fe3-6df2375e7776 req-24926acf-cda0-474a-be49-c9a38436e9f2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:30.910007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60c38fec-25de-4b01-9fe3-6df2375e7776 req-24926acf-cda0-474a-be49-c9a38436e9f2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.1352017 Dec 21 03:45:31.046599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-6210f32b-0c57-438c-be65-9401b62d3c93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:31.051830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-6210f32b-0c57-438c-be65-9401b62d3c93 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3556561 Dec 21 03:45:31.104110 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def associated. External IP: 172.25.5.85, port: 191b83a9-628d-4985-aca6-eb18b8810e59. Dec 21 03:45:31.176919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2460bba7-2a5a-4385-a4a7-feba1f275c36 req-395594f1-4f2e-416c-80e6-5cf73d89f45e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:31.178538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2460bba7-2a5a-4385-a4a7-feba1f275c36 req-395594f1-4f2e-416c-80e6-5cf73d89f45e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 949 time: 0.1573520 Dec 21 03:45:31.236205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60c38fec-25de-4b01-9fe3-6df2375e7776 req-c302d7f5-f0a2-427c-bf2e-c8d3bde932af tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3252099 Dec 21 03:45:31.290187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Router 42d516dc-3fc9-4356-b366-0a38870a320d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:31.323112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43968) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:31.399944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2460bba7-2a5a-4385-a4a7-feba1f275c36 req-21880aa0-9f40-4d0e-a299-a3a1c56fe83d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2135217 Dec 21 03:45:31.473436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-38d22023-2ed4-4670-96cd-ab2e8f75295a service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4042428 Dec 21 03:45:31.633459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Router 138198e8-cb21-4974-9773-632cfe7c78d0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:31.641178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 465bd6cc-6c8f-4b1c-924a-e655a016d3db up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:31.656921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:31.703125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:31.709536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:31.716781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] Sync routers for ids ['42d516dc-3fc9-4356-b366-0a38870a320d'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:31.721130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e268b008-f690-4f32-9f24-ea61bf666a9b admin admin] 10.222.0.18 "PUT /v2.0/routers/42d516dc-3fc9-4356-b366-0a38870a320d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2652867 Dec 21 03:45:31.721558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:31.739304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] Routers {'42d516dc-3fc9-4356-b366-0a38870a320d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:31.740277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['42d516dc-3fc9-4356-b366-0a38870a320d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:31.899001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:31.906429 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adea9c87-777d-4cd3-8aef-05e67dc7f961 req-340d56f5-613b-48ac-824b-baf9857e8e6d service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4196913 Dec 21 03:45:31.948421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 742f0270-e348-4b05-82d9-88e6e724dc14 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:31.953221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 465bd6cc-6c8f-4b1c-924a-e655a016d3db completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:31.983401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 465bd6cc-6c8f-4b1c-924a-e655a016d3db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:31.984133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:31.987672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 742f0270-e348-4b05-82d9-88e6e724dc14 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:31.991624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 742f0270-e348-4b05-82d9-88e6e724dc14 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:31.991624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:31.998142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ac725df3-7862-483f-82a4-1cc27a3a5efa {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:32.015491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:32.054822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] Set router 42d516dc-3fc9-4356-b366-0a38870a320d gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:32.171940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.197089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.303335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] Transition to ACTIVE for port object ac725df3-7862-483f-82a4-1cc27a3a5efa will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:45:32.363663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Deleting port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:32.364471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.456984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:32.462389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.469465 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:32.487574 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:32.488248 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:32.505064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a1823a-940b-4aaf-8077-448d619f1b57 req-2b6c091e-5ddd-439c-8a61-df749774b8a2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:32.514614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14a1823a-940b-4aaf-8077-448d619f1b57 req-2b6c091e-5ddd-439c-8a61-df749774b8a2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.2373302 Dec 21 03:45:32.533015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcbcdd2f-2085-4e0b-93ba-3545ce3f9d3c req-172a4a7a-025a-42d8-91d3-599d09f154ad tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:32.534978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcbcdd2f-2085-4e0b-93ba-3545ce3f9d3c req-172a4a7a-025a-42d8-91d3-599d09f154ad tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 943 time: 0.1700602 Dec 21 03:45:32.549267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.555320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] For port 19909a2d-bb9e-4cec-b7f4-3ad7d7025185, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:32.555988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.583564 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.618623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Calling delete_port for 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:32.639769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14a1823a-940b-4aaf-8077-448d619f1b57 req-34ad7f05-3548-43c0-b15f-6f8392d305c3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1239431 Dec 21 03:45:32.646304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '465bd6cc-6c8f-4b1c-924a-e655a016d3db'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:32.648857 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed00658a-b717-4174-a5e2-283a84a1e07f" -d '{"events": [{"server_uuid": "07e22202-8c9b-481b-b5b1-eb2fb572b5b6", "name": "network-vif-plugged", "status": "completed", "tag": "465bd6cc-6c8f-4b1c-924a-e655a016d3db"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:32.667683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:32.677387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-65a3bdcf-04ec-41b0-9f10-4980b9a97781 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "PUT /v2.0/floatingips/631c6293-0c83-45b1-8aca-1ed5976f4def HTTP/1.1" status: 200 len: 990 time: 2.6525886 Dec 21 03:45:32.702173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:32.702173 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4db1302-4107-49dc-8642-e4f1160bddb1" -d '{"events": [{"name": "network-changed", "server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:32.702550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] No DVR routers for this DVR port ac725df3-7862-483f-82a4-1cc27a3a5efa on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:32.729909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232'}], 'enable_snat': True}, 'gw_port_id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:29Z', 'revision_number': 5, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port': {'id': '19909a2d-bb9e-4cec-b7f4-3ad7d7025185', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:5b:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:16Z', 'updated_at': '2021-12-21T03:45:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:32.749267 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:32.784349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] Pushing event updated for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:32.801389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-d64b965b-bdb6-43b7-a524-93a73d026360 service neutron] 10.222.0.31 "PUT /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 2.1124153 Dec 21 03:45:32.817658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] Checking router: 42d516dc-3fc9-4356-b366-0a38870a320d for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:32.824914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:32.860025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcbcdd2f-2085-4e0b-93ba-3545ce3f9d3c req-a698e8ca-f11e-4108-b47e-d11c1d76bffb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3096313 Dec 21 03:45:32.896873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] Routers {'42d516dc-3fc9-4356-b366-0a38870a320d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:32.896873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['42d516dc-3fc9-4356-b366-0a38870a320d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:32.936636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a65d0e-fa61-4444-bf21-ce53a30d2233 req-df19cfd9-24eb-49b5-8ab9-f2a7f500f431 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:32.940185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89a65d0e-fa61-4444-bf21-ce53a30d2233 req-df19cfd9-24eb-49b5-8ab9-f2a7f500f431 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.1635358 Dec 21 03:45:33.054238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] Set router 42d516dc-3fc9-4356-b366-0a38870a320d gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:33.062743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89a65d0e-fa61-4444-bf21-ce53a30d2233 req-aaac55a9-2309-4831-8f0a-fb80c7e6d85a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099653 Dec 21 03:45:33.078864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.112871 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-474ce636-648f-4aa2-8e73-3f8a9bda7ca4 x-openstack-request-id: req-474ce636-648f-4aa2-8e73-3f8a9bda7ca4 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:33.117545 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "07e22202-8c9b-481b-b5b1-eb2fb572b5b6", "name": "network-vif-plugged", "status": "completed", "tag": "465bd6cc-6c8f-4b1c-924a-e655a016d3db", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:33.117545 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-474ce636-648f-4aa2-8e73-3f8a9bda7ca4 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:33.117545 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '465bd6cc-6c8f-4b1c-924a-e655a016d3db', 'code': 200} Dec 21 03:45:33.117545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:32Z', 'revision_number': 6, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:33.143506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cd7150-a5d1-4489-b4e2-bc3557711375 None None] The sync data for ids ['42d516dc-3fc9-4356-b366-0a38870a320d'] in n-d-822053-11 is: [{'id': '42d516dc-3fc9-4356-b366-0a38870a320d', 'name': 'tempest-FloatingIPsNegativeTestJSON-1390170282-router', 'tenant_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:15Z', 'updated_at': '2021-12-21T03:45:32Z', 'revision_number': 6, 'project_id': '8f2eb29d24414a7ebe3c5bd20a786a31', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:33.151357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.168577 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-145b1657-67e0-4ec5-b098-db257fcb7966 x-openstack-request-id: req-145b1657-67e0-4ec5-b098-db257fcb7966 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:33.169648 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:33.170116 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-145b1657-67e0-4ec5-b098-db257fcb7966 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:33.170744 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59', 'status': 'completed', 'code': 200} Dec 21 03:45:33.232705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=465bd6cc-6c8f-4b1c-924a-e655a016d3db,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:33.278694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecc34e9-59dc-4442-869f-6990314cfcd1 req-cd749344-d597-4e5d-b59c-423b5474285b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:33.278694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecc34e9-59dc-4442-869f-6990314cfcd1 req-cd749344-d597-4e5d-b59c-423b5474285b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 1102 time: 0.1147439 Dec 21 03:45:33.289193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=19909a2d-bb9e-4cec-b7f4-3ad7d7025185,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:33.317861 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '631c6293-0c83-45b1-8aca-1ed5976f4def', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'floating_ip_address': '172.25.5.85', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'port_id': '191b83a9-628d-4985-aca6-eb18b8810e59', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 175, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'mac_address': 'fa:16:3e:e5:70:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:01Z', 'updated_at': '2021-12-21T03:45:30Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:33.350123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-45f22813-328c-4f60-a5bf-d50935821220 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:33.351660 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-45f22813-328c-4f60-a5bf-d50935821220 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 1097 time: 0.1136930 Dec 21 03:45:33.355032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:33.365202 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:33.366070 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:33.368341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.449171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecc34e9-59dc-4442-869f-6990314cfcd1 req-477b8d9a-10ad-4ef9-9c32-45dca7852127 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1592410 Dec 21 03:45:33.515970 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:33.596926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.645510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Deleting port e99106f7-f780-4fbe-8b19-7d63d11935cd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:33.646072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.665018 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.760615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-923f2e0d-b052-450d-b64b-dd27e587320d tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:33.762191 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-923f2e0d-b052-450d-b64b-dd27e587320d tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.3158715 Dec 21 03:45:33.781242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-9d6d509b-6d7d-4ff0-b2f5-6865b493ba3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:33.782574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-9d6d509b-6d7d-4ff0-b2f5-6865b493ba3b service neutron] 10.222.0.31 "GET /v2.0/networks?id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 200 len: 925 time: 0.4228687 Dec 21 03:45:33.851689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] For port e99106f7-f780-4fbe-8b19-7d63d11935cd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e99106f7-f780-4fbe-8b19-7d63d11935cd,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:33.852066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:33.871329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Calling delete_port for e99106f7-f780-4fbe-8b19-7d63d11935cd owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:33.895186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6716170e-7d4d-4d99-b9a5-755ce673a8c5 req-6884d7e0-e3a1-4d2e-9f9e-05ffbb4dd688 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:33.903742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6716170e-7d4d-4d99-b9a5-755ce673a8c5 req-6884d7e0-e3a1-4d2e-9f9e-05ffbb4dd688 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1022666 Dec 21 03:45:33.911008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '631c6293-0c83-45b1-8aca-1ed5976f4def', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'floating_ip_address': '172.25.5.85', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'port_id': '191b83a9-628d-4985-aca6-eb18b8810e59', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 175, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'mac_address': 'fa:16:3e:e5:70:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:01Z', 'updated_at': '2021-12-21T03:45:30Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:33.955314 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05d5b8a3-6833-4064-86da-ee6048d56cc6 None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '631c6293-0c83-45b1-8aca-1ed5976f4def', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'floating_ip_address': '172.25.5.85', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'port_id': '191b83a9-628d-4985-aca6-eb18b8810e59', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 175, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'mac_address': 'fa:16:3e:e5:70:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:43:01Z', 'updated_at': '2021-12-21T03:45:30Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:34.038834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6716170e-7d4d-4d99-b9a5-755ce673a8c5 req-75ed9c4c-5941-4263-831f-f2d9107cb8c5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1341071 Dec 21 03:45:34.153633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e822277b-7328-4103-878e-b1a56540551f req-9e70df47-835c-416f-be00-13c1637f0c8f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:34.160704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e822277b-7328-4103-878e-b1a56540551f req-9e70df47-835c-416f-be00-13c1637f0c8f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.1732273 Dec 21 03:45:34.191401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27718740-90c8-4029-83bb-09302fe8a973 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:34.227419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 27718740-90c8-4029-83bb-09302fe8a973 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:34.227779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27718740-90c8-4029-83bb-09302fe8a973 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:34.228213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:34.239837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e822277b-7328-4103-878e-b1a56540551f req-1448a3b0-e2e0-4867-a44a-64d4fa7f9aa7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540559 Dec 21 03:45:34.280072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:34.280948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19909a2d-bb9e-4cec-b7f4-3ad7d7025185 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:34.366169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203f5065-5897-4992-bde8-1f53e8ec4cf6 req-ce409680-5394-4648-a62b-37b029842712 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:34.376327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-203f5065-5897-4992-bde8-1f53e8ec4cf6 req-ce409680-5394-4648-a62b-37b029842712 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.1439478 Dec 21 03:45:34.417740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5045e3a-db01-42b5-8042-2c721ebb5db9 None None] New status for floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:45:34.445913 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-138c8518-78d4-40c7-83ff-c769a6d76bc4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=191b83a9-628d-4985-aca6-eb18b8810e59 HTTP/1.1" status: 200 len: 998 time: 0.6411777 Dec 21 03:45:34.446747 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:34.447359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 42d516dc-3fc9-4356-b366-0a38870a320d {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:45:34.449821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-203f5065-5897-4992-bde8-1f53e8ec4cf6 req-71ea131e-fddb-4054-8be2-d1772dcbfd0d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717471 Dec 21 03:45:34.477217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:34.480982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-71c331ee-27f4-45fc-8756-1d139f3191c8 admin admin] 10.222.0.18 "DELETE /v2.0/routers/42d516dc-3fc9-4356-b366-0a38870a320d HTTP/1.1" status: 204 len: 168 time: 2.7355886 Dec 21 03:45:34.481129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44004) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:34.553589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Deleting subnet 38e2bfb3-afda-4171-9221-c30960cbbdb4 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:45:34.558009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:34.567869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:34.587272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-e8bdc5d2-dcdd-4ba5-86be-bb8f33601ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:34.590145 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-e8bdc5d2-dcdd-4ba5-86be-bb8f33601ed8 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335&tenant_id=7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 1096 time: 0.8172395 Dec 21 03:45:34.593157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-b98b43cf-ebe2-496e-9c37-fbab46a73fea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:34.594646 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-b98b43cf-ebe2-496e-9c37-fbab46a73fea service neutron] 10.222.0.31 "GET /v2.0/subnets?id=8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 200 len: 863 time: 0.0949721 Dec 21 03:45:34.686536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-81f2232d-b305-47b9-975f-0a744d74ccf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:34.687179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Pushing event deleted for resources: {'Port': ['ID=e99106f7-f780-4fbe-8b19-7d63d11935cd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:34.688148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-81f2232d-b305-47b9-975f-0a744d74ccf0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=97e3dbcb-7ac2-4207-82ae-df7e1df411c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0843611 Dec 21 03:45:34.698058 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:45:34.793832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-a1b50008-2e60-4954-a5be-2f605ca740d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:34.795413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-a1b50008-2e60-4954-a5be-2f605ca740d3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1096 time: 0.1326828 Dec 21 03:45:34.852936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:34.871377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.871727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.872073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.872416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.872746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.873075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.873555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.873879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.874202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.874534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.874847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.875672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.875672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:34.888158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:34.924626 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-67520acb-2388-4304-82d5-59846c6e7040 service neutron] 10.222.0.31 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2252634 Dec 21 03:45:35.014964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-2154869d-5d8d-4d9d-b4f9-e60978706bd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:35.016455 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-2154869d-5d8d-4d9d-b4f9-e60978706bd4 service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.2097316 Dec 21 03:45:35.026062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.079436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-814e6682-c676-4f81-a00a-5041c9741a4b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 217 time: 0.0433936 Dec 21 03:45:35.083590 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4db1302-4107-49dc-8642-e4f1160bddb1 req-86aea905-d979-421d-add3-303237f8293b service neutron] 10.222.0.31 "GET /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1490152 Dec 21 03:45:35.156247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-6c758c74-3cca-4724-b7e7-b68eb9a96f5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:35.157717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-6c758c74-3cca-4724-b7e7-b68eb9a96f5e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0534849 Dec 21 03:45:35.198010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-82b434e4-8bb5-4de1-9399-5e1d23408c41 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287840 Dec 21 03:45:35.240853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98b99fdb-b0aa-45d0-abb9-5f0d213231c6 req-6a209485-a7bf-4d2a-b423-329c483f3c4e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:35.242448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98b99fdb-b0aa-45d0-abb9-5f0d213231c6 req-6a209485-a7bf-4d2a-b423-329c483f3c4e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0975883 Dec 21 03:45:35.247512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:35.323631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.324229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-819aa101-3e07-41ff-89ac-6956ae3e8266 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1178136 Dec 21 03:45:35.382876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.387391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] 10.222.0.18 "DELETE /v2.0/subnets/38e2bfb3-afda-4171-9221-c30960cbbdb4 HTTP/1.1" status: 204 len: 168 time: 0.9052305 Dec 21 03:45:35.388461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb3efb9f-c863-49bf-a936-8abaf02ee33c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=38e2bfb3-afda-4171-9221-c30960cbbdb4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:35.392147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2aa4f793-870c-4584-ad8b-030af65b4eab None None] Network 18a094f5-b40b-4b83-80a8-7471f10d9e18 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:35.400552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44010) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:35.436047 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-8a2c1048-6d29-4587-a47f-697181a28bc3 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0968561 Dec 21 03:45:35.458886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98b99fdb-b0aa-45d0-abb9-5f0d213231c6 req-693fc3c5-eba1-47f2-b914-51880e3d4d8b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2084200 Dec 21 03:45:35.566070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:35.572528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-295fd2ff-a0d1-48b9-82bd-71b15ef26523 admin admin] 10.222.0.18 "PUT /v2.0/routers/5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2471147 Dec 21 03:45:35.577077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.581000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44020) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:35.585766 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] Sync routers for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:35.587193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d3a8f1-70df-47c6-93b7-f849dd5b9adf req-c5899708-f9ea-4f0b-8fad-29aa3b03a063 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:35.588624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67d3a8f1-70df-47c6-93b7-f849dd5b9adf req-c5899708-f9ea-4f0b-8fad-29aa3b03a063 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.2157118 Dec 21 03:45:35.590092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] DHCP port deletion for 18a094f5-b40b-4b83-80a8-7471f10d9e18 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:45:35.639596 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:35.640829 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:35.685527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67d3a8f1-70df-47c6-93b7-f849dd5b9adf req-30d05ad8-1098-4cb2-8b6f-113afdf4c7c5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887809 Dec 21 03:45:35.691572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Deleting port 8071f922-7132-49bf-a278-27ae884b948e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:35.692154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.770896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] Deleting port 8071f922-7132-49bf-a278-27ae884b948e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:35.771307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.785817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.817758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] For port 8071f922-7132-49bf-a278-27ae884b948e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8071f922-7132-49bf-a278-27ae884b948e,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:35.818131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.836456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8aa86fc-2f1b-476b-8813-d48ec60eb3b8 req-f517997c-1c27-40b8-ba60-b3f1f0e255ad tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:35.843557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8aa86fc-2f1b-476b-8813-d48ec60eb3b8 req-f517997c-1c27-40b8-ba60-b3f1f0e255ad tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.1300542 Dec 21 03:45:35.857697 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:35.863613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Calling delete_port for 8071f922-7132-49bf-a278-27ae884b948e owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:35.914720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] For port 8071f922-7132-49bf-a278-27ae884b948e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8071f922-7132-49bf-a278-27ae884b948e,segment=NetworkSegment(ee16d6fe-99ec-4da8-b055-dee4ca67b943),segment_id=ee16d6fe-99ec-4da8-b055-dee4ca67b943)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:35.914720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.935285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] Calling delete_port for 8071f922-7132-49bf-a278-27ae884b948e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:35.968452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:35.988149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8071f922-7132-49bf-a278-27ae884b948e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:36.000146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8aa86fc-2f1b-476b-8813-d48ec60eb3b8 req-98a45e59-ece1-4844-8dd7-4a858236cf4e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1557307 Dec 21 03:45:36.101563 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.105481 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:45:34Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:36.136709 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] Checking router: 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:36.146382 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] Routers {'5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:36.146950 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:36.156193 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.195990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Pushing event deleted for resources: {'Port': ['ID=8071f922-7132-49bf-a278-27ae884b948e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:36.197673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.204538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] No DVR routers for this DVR port 8071f922-7132-49bf-a278-27ae884b948e on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:36.231727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] Pushing event deleted for resources: {'Port': ['ID=8071f922-7132-49bf-a278-27ae884b948e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:36.239155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58fb507c-744a-46e1-a17e-2514ace91121 None None] No DVR routers for this DVR port 8071f922-7132-49bf-a278-27ae884b948e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:36.304488 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.323515 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] Set router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:36.327885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7214549c-a566-479d-9ad2-b89a53c3cabe tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:36.330176 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-7214549c-a566-479d-9ad2-b89a53c3cabe tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0898201 Dec 21 03:45:36.341404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.342029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.343408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.344424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > port after_create 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.344923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > port after_delete 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.347298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > port after_update 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.347807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.348306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.348818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.351067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.382367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Deleting port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:36.382693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.447651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.448259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.448746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.449255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=110310) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 21 03:45:36.449806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['18a094f5-b40b-4b83-80a8-7471f10d9e18']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:36.468251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ee16d6fe-99ec-4da8-b055-dee4ca67b943') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:36.468815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ee16d6fe-99ec-4da8-b055-dee4ca67b943') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:36.487546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.510717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.519908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:45:36.520769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:45:36.526421 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:45:36.563660 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:45:34Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:36.611870 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95911d70-e01e-46b9-ac2f-3ae850761cfe None None] The sync data for ids ['5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5'] in n-d-822053-11 is: [{'id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-69557819-router', 'tenant_id': '6152d205cbf24532b57c0a62bd05450d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235'}], 'enable_snat': True}, 'gw_port_id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:25Z', 'updated_at': '2021-12-21T03:45:34Z', 'revision_number': 5, 'project_id': '6152d205cbf24532b57c0a62bd05450d', 'gw_port': {'id': '5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2b:6a:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 452, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:26Z', 'updated_at': '2021-12-21T03:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:36.669602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] For port 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:36.669977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.685855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Calling delete_port for 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:36.761668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-cc47b96b-ab95-4f69-ad75-e24fb3a2becd service neutron] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:36.767302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-cc47b96b-ab95-4f69-ad75-e24fb3a2becd service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:36.768422 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-000fb036-7f26-4e9b-924b-4274ff444b97 req-cc47b96b-ab95-4f69-ad75-e24fb3a2becd service neutron] 10.222.0.54 "DELETE /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.4305267 Dec 21 03:45:36.990974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.011373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320882fd-3c9c-4c9f-9cb1-5354c1f977c3 req-b3e3104f-805e-4c40-85ed-2a186aeafaec tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.013052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-320882fd-3c9c-4c9f-9cb1-5354c1f977c3 req-b3e3104f-805e-4c40-85ed-2a186aeafaec tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.4282758 Dec 21 03:45:37.018879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Pushing event deleted for resources: {'Port': ['ID=5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:37.030813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.031318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.031788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.032249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.032711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.033758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.034246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.034709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.035213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.037220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-650a03c7-3390-40b4-904a-ae1565008edb req-6f81e971-6fa5-428a-8f9f-a86c0a11cd94 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6&device_id=1d8b3d0f-8d53-4152-952e-6872427beaae&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c&device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09&device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00&device_id=0024898a-7143-4c97-b092-729064ba192d&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 8217 time: 0.0773315 Dec 21 03:45:37.075469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-650a03c7-3390-40b4-904a-ae1565008edb req-4b7e060d-2058-4044-9f1f-2344642efdcf tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.077217 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.087091 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.102608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.108188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] 10.222.0.18 "DELETE /v2.0/networks/18a094f5-b40b-4b83-80a8-7471f10d9e18 HTTP/1.1" status: 204 len: 168 time: 1.7034009 Dec 21 03:45:37.128484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9af5149-8586-42d3-a5ed-9f2464d2e5c0 admin admin] Pushing event deleted for resources: {'Network': ['ID=18a094f5-b40b-4b83-80a8-7471f10d9e18,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:37.141604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-320882fd-3c9c-4c9f-9cb1-5354c1f977c3 req-3f72ed63-e345-42f6-8272-891d40b70f16 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020529 Dec 21 03:45:37.187475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.197551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.248927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-650a03c7-3390-40b4-904a-ae1565008edb req-4b7e060d-2058-4044-9f1f-2344642efdcf tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.360488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac25ae8-3b11-4084-8b6d-59f5ab191ba2 req-343a6fb4-0688-4d33-9c77-66ab0bef4313 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.362659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ac25ae8-3b11-4084-8b6d-59f5ab191ba2 req-343a6fb4-0688-4d33-9c77-66ab0bef4313 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.0512583 Dec 21 03:45:37.373484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.374057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:45:37.375457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-650a03c7-3390-40b4-904a-ae1565008edb req-4b7e060d-2058-4044-9f1f-2344642efdcf tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.379757 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.386424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4557366e-cea0-4bc3-bd0d-26b33e15a705 admin admin] 10.222.0.18 "DELETE /v2.0/routers/5d8b2b4e-a6c9-4a5f-9110-aa2e2fb17bf5 HTTP/1.1" status: 204 len: 168 time: 1.7995665 Dec 21 03:45:37.386424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44042) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:37.442289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Deleting subnet 8fae910f-1046-400a-b90e-c801ea409ae9 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:45:37.446519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.470093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b7e060d-2058-4044-9f1f-2344642efdcf tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16bdfce7-993d-4bda-ae76-8ed15b1c0604,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:37.494155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.505565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ac25ae8-3b11-4084-8b6d-59f5ab191ba2 req-552dda2b-1807-4fb8-afd0-481a7b167ec2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1373677 Dec 21 03:45:37.543938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-650a03c7-3390-40b4-904a-ae1565008edb req-4b7e060d-2058-4044-9f1f-2344642efdcf tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&id=ecf57b12-b3df-4362-97bd-0b49563f1502&id=f49e32c9-7ac4-4473-9e8e-3ee032077854&id=be4d1d79-41a8-475c-bd15-be387ef5161d&id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 581 time: 0.4863691 Dec 21 03:45:37.617438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44052) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:37.648857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.692401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ed79460f-a839-472e-8bbf-318cd76136f5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8f2eb29d24414a7ebe3c5bd20a786a31&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0795674 Dec 21 03:45:37.695833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44054) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:37.743899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4aedd9a-1b34-47d2-972e-0fe06ab9bff9 req-ba907580-554d-4b56-a477-aad5d476573b tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:37.745394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4aedd9a-1b34-47d2-972e-0fe06ab9bff9 req-ba907580-554d-4b56-a477-aad5d476573b tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1096 time: 0.0904155 Dec 21 03:45:37.779708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78093204-1503-4a2a-ae49-7ca4d45b016b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.816820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.817665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78093204-1503-4a2a-ae49-7ca4d45b016b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.832288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4aedd9a-1b34-47d2-972e-0fe06ab9bff9 req-628337a9-68dc-4b27-8d9f-fbc12b86d668 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734956 Dec 21 03:45:37.866568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8fae910f-1046-400a-b90e-c801ea409ae9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:37.877837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:37.881870 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7927ff54-aec2-4814-8ac1-6e489a8112b0 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/8fae910f-1046-400a-b90e-c801ea409ae9 HTTP/1.1" status: 204 len: 168 time: 0.4963195 Dec 21 03:45:37.890896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44060) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:37.891555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8aa4964-5396-4aeb-a499-f63b08deaf4e None None] Network 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:38.015823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.018225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78093204-1503-4a2a-ae49-7ca4d45b016b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.022137 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78093204-1503-4a2a-ae49-7ca4d45b016b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.029405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78093204-1503-4a2a-ae49-7ca4d45b016b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c0017e8d-b83e-443a-8ee6-0e113c3185e5 HTTP/1.1" status: 204 len: 168 time: 0.3327320 Dec 21 03:45:38.039684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f11c39-bae7-4155-a19f-65a91a5ce21a req-c9bd3491-8822-49fc-aafc-ca92b0c75156 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:38.039684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f11c39-bae7-4155-a19f-65a91a5ce21a req-c9bd3491-8822-49fc-aafc-ca92b0c75156 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:38.039684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f11c39-bae7-4155-a19f-65a91a5ce21a req-c9bd3491-8822-49fc-aafc-ca92b0c75156 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:38.040634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61f11c39-bae7-4155-a19f-65a91a5ce21a req-c9bd3491-8822-49fc-aafc-ca92b0c75156 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6&device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00&device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 2887 time: 0.0729737 Dec 21 03:45:38.049231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:38.063617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78093204-1503-4a2a-ae49-7ca4d45b016b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0017e8d-b83e-443a-8ee6-0e113c3185e5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:38.074223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:38.074658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5ebe3eea-9254-4dc5-b117-e2b8b3d33d6d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:38.075195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e99106f7-f780-4fbe-8b19-7d63d11935cd no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:38.097941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e99106f7-f780-4fbe-8b19-7d63d11935cd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:38.098516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e99106f7-f780-4fbe-8b19-7d63d11935cd not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:38.149767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61f11c39-bae7-4155-a19f-65a91a5ce21a req-61f294f4-1b88-432c-90e6-fe7495e6ffb1 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827744 Dec 21 03:45:38.154736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Deleting port 8571756f-471a-43a3-bf9d-513d598638a9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:38.155332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.236677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] DHCP port deletion for 7bc2df93-ed75-4ee4-81c6-f3b3411325a4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:45:38.295502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] For port 8571756f-471a-43a3-bf9d-513d598638a9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8571756f-471a-43a3-bf9d-513d598638a9,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:38.295978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.309896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] Deleting port 8571756f-471a-43a3-bf9d-513d598638a9 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:38.310282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.314795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Calling delete_port for 8571756f-471a-43a3-bf9d-513d598638a9 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:38.330711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-714636b4-e4a9-42bb-b860-12af2a2731da tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:38.332265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-714636b4-e4a9-42bb-b860-12af2a2731da tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.1741450 Dec 21 03:45:38.369518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-2d551adc-2ab7-43ac-95f8-0f40a17ce7ec tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/quotas/7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 375 time: 0.0268357 Dec 21 03:45:38.387424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] For port 8571756f-471a-43a3-bf9d-513d598638a9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8571756f-471a-43a3-bf9d-513d598638a9,segment=NetworkSegment(af0f1c65-4b10-4991-bbab-e021be9d7624),segment_id=af0f1c65-4b10-4991-bbab-e021be9d7624)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:38.387828 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.401174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] Calling delete_port for 8571756f-471a-43a3-bf9d-513d598638a9 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:38.417679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32d7b8e-7f93-4de0-a1b5-23f597baef64 req-0bb3da97-521c-4cde-91a9-f6a3e728dab4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:38.419222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b32d7b8e-7f93-4de0-a1b5-23f597baef64 req-0bb3da97-521c-4cde-91a9-f6a3e728dab4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0860071 Dec 21 03:45:38.454803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-47e96b59-01df-4277-8d0c-81e346ff75cb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0786326 Dec 21 03:45:38.506053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b32d7b8e-7f93-4de0-a1b5-23f597baef64 req-7e579145-be6d-47f2-abb1-26e20b46db5c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790906 Dec 21 03:45:38.567212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-c015223f-b228-4aec-93bb-3db8ef1a64f7 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1030068 Dec 21 03:45:38.572982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.576891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.612374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] Pushing event deleted for resources: {'Port': ['ID=8571756f-471a-43a3-bf9d-513d598638a9,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:38.615181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4a4011d-d0d1-48f2-8e23-bd2c675fb56a None None] No DVR routers for this DVR port 8571756f-471a-43a3-bf9d-513d598638a9 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:38.629764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] No DVR routers for this DVR port 8571756f-471a-43a3-bf9d-513d598638a9 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:45:38.645781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Pushing event deleted for resources: {'Port': ['ID=8571756f-471a-43a3-bf9d-513d598638a9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:38.735177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.738624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-f4e57e93-8cff-47e4-900b-6b1759b6cd26 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1505759 Dec 21 03:45:38.768088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7bc2df93-ed75-4ee4-81c6-f3b3411325a4']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:38.780552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af0f1c65-4b10-4991-bbab-e021be9d7624') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:38.780944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af0f1c65-4b10-4991-bbab-e021be9d7624') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:38.792019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.820157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.827494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:45:38.827971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:45:38.848272 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:45:38.968682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.982601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:38.988135 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] 10.222.0.18 "DELETE /v2.0/networks/7bc2df93-ed75-4ee4-81c6-f3b3411325a4 HTTP/1.1" status: 204 len: 168 time: 1.0931265 Dec 21 03:45:39.006694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76341053-9bca-4623-9775-f8389cb06826 admin admin] Pushing event deleted for resources: {'Network': ['ID=7bc2df93-ed75-4ee4-81c6-f3b3411325a4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:39.019531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f964b0bc-81fb-42b4-a120-cf75a16f63da req-2b6255cb-5799-4516-9c33-0dbb3a3e39bd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 210 time: 0.0405316 Dec 21 03:45:39.474209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:39.518063 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-40b07133-04e5-4f48-81de-af64e3230593 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6152d205cbf24532b57c0a62bd05450d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0426598 Dec 21 03:45:39.521663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44118) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:39.590232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daccd433-1991-479c-9b83-a4cfbe4a76e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:39.631988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daccd433-1991-479c-9b83-a4cfbe4a76e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:39.643638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a70376d-2c59-4181-a424-48a62eb1ea65 req-d913d17a-f694-47ce-97dc-19620a05ce37 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:39.651943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a70376d-2c59-4181-a424-48a62eb1ea65 req-d913d17a-f694-47ce-97dc-19620a05ce37 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0667789 Dec 21 03:45:39.696861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a70376d-2c59-4181-a424-48a62eb1ea65 req-d2718bff-e535-4db4-bda6-2a0af7214c37 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438550 Dec 21 03:45:39.831668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b76878-0924-4ef0-9e64-e44032c9bc69 req-2750f680-e2fc-4977-ac20-1e43be645adc tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:39.835821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0b76878-0924-4ef0-9e64-e44032c9bc69 req-2750f680-e2fc-4977-ac20-1e43be645adc tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1102 time: 0.0500963 Dec 21 03:45:39.847996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daccd433-1991-479c-9b83-a4cfbe4a76e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:39.850614 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daccd433-1991-479c-9b83-a4cfbe4a76e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:39.851829 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-daccd433-1991-479c-9b83-a4cfbe4a76e4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9eab3df9-8a1c-4829-a64e-d0f01a0561ae HTTP/1.1" status: 204 len: 168 time: 0.3292511 Dec 21 03:45:39.862679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daccd433-1991-479c-9b83-a4cfbe4a76e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9eab3df9-8a1c-4829-a64e-d0f01a0561ae,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:39.894346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8571756f-471a-43a3-bf9d-513d598638a9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:39.918824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0b76878-0924-4ef0-9e64-e44032c9bc69 req-41702dfd-d515-40bb-81f9-e11afce805dd tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775483 Dec 21 03:45:39.935109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8571756f-471a-43a3-bf9d-513d598638a9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:45:39.935109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8571756f-471a-43a3-bf9d-513d598638a9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:45:40.033468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-054df1b6-2aef-4ddf-9c67-8feb1145156a req-f7aa6ac0-4d4e-476f-bc28-e81c6e68af56 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:40.035160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-054df1b6-2aef-4ddf-9c67-8feb1145156a req-f7aa6ac0-4d4e-476f-bc28-e81c6e68af56 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1102 time: 0.0412104 Dec 21 03:45:40.080909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-054df1b6-2aef-4ddf-9c67-8feb1145156a req-838cfdce-879d-48f4-8feb-cb8c23438756 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396674 Dec 21 03:45:40.167551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-982d08c8-8ef2-4cb4-b981-8b903c288110 req-0b3a2aea-3b8e-4872-81b1-df4fb9e7ed49 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 210 time: 0.0282629 Dec 21 03:45:40.820902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188b75bf-3582-4674-bd8a-b58df036d09c req-bc0f7a6d-47c5-44c4-822a-1b2b49f394a1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:40.820902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-188b75bf-3582-4674-bd8a-b58df036d09c req-bc0f7a6d-47c5-44c4-822a-1b2b49f394a1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0551908 Dec 21 03:45:40.907749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-188b75bf-3582-4674-bd8a-b58df036d09c req-9446c8ae-5ed7-4f02-a0a4-c4cd65093ca1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813227 Dec 21 03:45:40.977688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:41.097650 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ef2b-3881-44f6-861c-93ab912c9e50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.169672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ef2b-3881-44f6-861c-93ab912c9e50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.272482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b000124-f0a3-480a-bea9-6b7842493d67 req-ea49e289-2aba-4dc7-9ad4-d8e3fc74ec0f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 210 time: 0.0296161 Dec 21 03:45:41.299082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44234) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:41.322346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ef2b-3881-44f6-861c-93ab912c9e50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.367470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cbd3ef2b-3881-44f6-861c-93ab912c9e50 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e9a7b336a79f4aa190405a64aa1a9687&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3855889 Dec 21 03:45:41.367470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd3ef2b-3881-44f6-861c-93ab912c9e50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37ac9306-af26-4c5f-9293-653bd28f98e2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:41.367682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44238) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:41.396158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Request body: {'network': {'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-network', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:41.425190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaff5971-f9f4-4b30-a1f7-7487f589abd3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.447452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaff5971-f9f4-4b30-a1f7-7487f589abd3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.522351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Made reservation on behalf of 601d004f9a144ac985592abc4d3dfcbc for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:41.524900 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.535218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.604061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaff5971-f9f4-4b30-a1f7-7487f589abd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.606751 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaff5971-f9f4-4b30-a1f7-7487f589abd3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.607920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eaff5971-f9f4-4b30-a1f7-7487f589abd3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/37ac9306-af26-4c5f-9293-653bd28f98e2 HTTP/1.1" status: 204 len: 168 time: 0.2385347 Dec 21 03:45:41.620653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaff5971-f9f4-4b30-a1f7-7487f589abd3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37ac9306-af26-4c5f-9293-653bd28f98e2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:41.641829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4535e703-a21e-4754-9c3d-28476628df5d req-c2ad4dfa-782b-4f3f-b376-36e2c1d4b1d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:41.644489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4535e703-a21e-4754-9c3d-28476628df5d req-c2ad4dfa-782b-4f3f-b376-36e2c1d4b1d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0709445 Dec 21 03:45:41.686124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.708106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4535e703-a21e-4754-9c3d-28476628df5d req-03c9b006-d9e5-4267-a3a5-3d7e59edcb5e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534492 Dec 21 03:45:41.808216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.838457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:45:41.849168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b71bc5d-184c-4f79-a438-b593c8d976fe,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:41.853962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:41.854310 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Added segment 65c18066-7cae-4372-80d2-c4b2caf0f73a of type vlan for network 98282c17-34d3-411f-a67f-a04e2e9118d9 Dec 21 03:45:41.896465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.046192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-bc86af17-3c2b-4380-a105-a2412142e875 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:42.047851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-bc86af17-3c2b-4380-a105-a2412142e875 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.1476703 Dec 21 03:45:42.075953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375e4fb2-5be0-4dc4-a487-95287a6bdbe5 req-b4e053c0-dc8e-4352-bb41-61db3fd84e29 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:42.085416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-375e4fb2-5be0-4dc4-a487-95287a6bdbe5 req-b4e053c0-dc8e-4352-bb41-61db3fd84e29 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0887325 Dec 21 03:45:42.088103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Request body: {'port': {'device_id': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'admin_state_up': True, 'tenant_id': '7662e8b89a444924a01bee5e34421908'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:42.094525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.095924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:42.096506 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.170319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-375e4fb2-5be0-4dc4-a487-95287a6bdbe5 req-0043501a-2f5c-4094-91f2-8102653d9a93 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783598 Dec 21 03:45:42.226760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] Pushing event updated for resources: {'Network': ['ID=98282c17-34d3-411f-a67f-a04e2e9118d9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:42.241516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:45:42.317871 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1a8ab146-5be3-4e81-b92d-d0ce49888dfe admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.0252342 Dec 21 03:45:42.321192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44270) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:42.331107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Request body: {'subnet': {'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-subnet', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:42.385604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cabf7e9b-a020-41db-a812-e1a914028f1e req-dfa655b8-9f49-47aa-b0e9-7adc97e08241 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 210 time: 0.0277421 Dec 21 03:45:42.562031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Made reservation on behalf of 601d004f9a144ac985592abc4d3dfcbc for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:42.562295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Made reservation on behalf of 7662e8b89a444924a01bee5e34421908 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:42.565765 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.566710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.729576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Allocated IP 172.20.0.5 (8b13f1ae-b717-40da-b68e-bdf950529b14/84e57960-b2b1-49b0-85de-36fd5e1ebd6a/b1bddbab-3a32-4687-b97f-eada22b71c0f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:42.844527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b9e37cd-80ce-4dd1-9127-e210befe20b6 req-5a2856d0-98d0-4711-8bdc-8b703c38afe8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:42.846987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b9e37cd-80ce-4dd1-9127-e210befe20b6 req-5a2856d0-98d0-4711-8bdc-8b703c38afe8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0575907 Dec 21 03:45:42.907163 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.908556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b9e37cd-80ce-4dd1-9127-e210befe20b6 req-3bdf92c7-26f3-48dc-9aae-168a346a5db1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547211 Dec 21 03:45:42.913613 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:42.981863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a24d8f8f-087d-42bd-ac2a-2cdb7329426e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:42.993860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Checking segment: {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:42.993860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Network hostable DHCP agents. Network: 98282c17-34d3-411f-a67f-a04e2e9118d9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:45:43.016224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.081783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:43.083251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:43.086569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:43.093732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:45:43.149415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:43.162840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:43.163627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.295022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-ade624ec-7e37-4e44-b0e9-6593b4764cdc tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=a31642b4b357428184e50f7d8f1ebb76&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0222411 Dec 21 03:45:43.363300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 98282c17-34d3-411f-a67f-a04e2e9118d9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:43.372845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:43.375469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.375608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c1d7f70-a31a-4131-b1db-c1ac24cbdd08 None None] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:43.422430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-9ad11c8d-275e-413e-8404-6038b9685c2e tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:43.427116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-9858306e-c621-4242-b588-ec6cd7c98385 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3405514 Dec 21 03:45:43.427246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-9ad11c8d-275e-413e-8404-6038b9685c2e tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1242471 Dec 21 03:45:43.444310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Request body: {'port': {'device_id': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:43.446810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-28bef419-0b99-4b4a-b304-6719ce67d20a tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/quotas/a31642b4b357428184e50f7d8f1ebb76 HTTP/1.1" status: 200 len: 375 time: 0.0155339 Dec 21 03:45:43.488948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-d6cda014-ea1b-47e9-8c98-8ac14afe30af tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=a31642b4b357428184e50f7d8f1ebb76&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0388038 Dec 21 03:45:43.520309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-98282c17-34d3-411f-a67f-a04e2e9118d9', 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9', 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'fixed_ips': [{'subnet_id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:45:43.521707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.533820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd65eb89-a6cd-4950-bd7e-3d7c9ec87fd5 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 1.2086399 Dec 21 03:45:43.533935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44318) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:43.538655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:43.572399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.654011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.655492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.757955 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:43.768772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Allocated IP 172.20.0.2 (98282c17-34d3-411f-a67f-a04e2e9118d9/a24d8f8f-087d-42bd-ac2a-2cdb7329426e/7be597c9-1c9a-4d3e-bd36-e295e3d198fa) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:43.803563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a838d2-4082-4782-a79b-e042b52a1bae req-229a0b44-4067-4267-889b-be2ccd4e07ae tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:43.812378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77a838d2-4082-4782-a79b-e042b52a1bae req-229a0b44-4067-4267-889b-be2ccd4e07ae tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1256542 Dec 21 03:45:44.045454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77a838d2-4082-4782-a79b-e042b52a1bae req-1b6df7b3-e89d-4c3c-934d-75b729f99359 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2255208 Dec 21 03:45:44.137574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.190434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0595ff64-d904-4c6f-911e-af391648a4c7 req-55ba1c8b-c57e-497e-ab9b-6b6f0a63ec20 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:44.191985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.192672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0595ff64-d904-4c6f-911e-af391648a4c7 req-55ba1c8b-c57e-497e-ab9b-6b6f0a63ec20 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 931 time: 0.1428874 Dec 21 03:45:44.217322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b1bddbab-3a32-4687-b97f-eada22b71c0f {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:44.227535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.242722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Transition to ACTIVE for port object b1bddbab-3a32-4687-b97f-eada22b71c0f will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:45:44.272211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.310518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:44.315855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:44.321787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:44.326984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0595ff64-d904-4c6f-911e-af391648a4c7 req-726a29bd-3c1d-4c42-9ed0-4b1f0e804d3c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1216826 Dec 21 03:45:44.336628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Pushing event updated for resources: {'Port': ['ID=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:44.394526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Attempting to bind port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:44.395368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Attempting to bind port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:44.395368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Attempting to bind port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa on network 98282c17-34d3-411f-a67f-a04e2e9118d9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:44.401822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:44.402082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.402222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Checking segment: {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:44.402609 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.403051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Bound using segment: {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:44.403526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Bound port: 7be597c9-1c9a-4d3e-bd36-e295e3d198fa, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:44.403914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.493907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] For port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:44.498728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] For port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:44.511061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94543784-3eaf-4d02-b1e2-e33eb7871919 req-351356af-cd0a-4570-834c-1066f1cd5bcb tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 210 time: 0.0655196 Dec 21 03:45:44.512090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:44.563073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.581131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.588945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.638111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:44.641091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:44.641522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:44.653360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:44.653828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:44.661892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:44.662323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:44.662807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:44.663570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Bound port: b1bddbab-3a32-4687-b97f-eada22b71c0f, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:44.663881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.680041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b75f85-d5a7-4161-8b7b-0bf3dba9e7b8 None None] Pushing event updated for resources: {'Port': ['ID=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:44.771925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6eb7d71-403a-4a02-a2c5-bd7db62bc771 req-4b9de550-747d-4cf9-ab40-3d2193c3e557 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:44.773482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6eb7d71-403a-4a02-a2c5-bd7db62bc771 req-4b9de550-747d-4cf9-ab40-3d2193c3e557 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1815283 Dec 21 03:45:44.801544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:44.805778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:44.865923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.883035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Allocated IP 172.25.5.176 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/b3a5d380-a58f-4030-b88c-87371f69b18a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:44.914240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:44.939865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:44.941607 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] 10.222.0.31 "PUT /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 1092 time: 1.5023646 Dec 21 03:45:44.945226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:44.947938 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a" -d '{"events": [{"name": "network-changed", "server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:44.975273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6eb7d71-403a-4a02-a2c5-bd7db62bc771 req-30153260-edde-430b-9e39-e9f23ece7803 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1490757 Dec 21 03:45:45.026529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a413c5-b6b3-4f3c-b2ea-93d3e1e841e0 service neutron] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:45.040644 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1da98298-3229-46af-8eff-a0a769e4fb63 x-openstack-request-id: req-1da98298-3229-46af-8eff-a0a769e4fb63 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:45.040939 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:45.041193 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1da98298-3229-46af-8eff-a0a769e4fb63 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:45.041590 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'status': 'completed', 'code': 200} Dec 21 03:45:45.076651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:45.140233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a req-c7025bcb-96a1-4c96-875d-8d935e0dbb75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.141756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a req-c7025bcb-96a1-4c96-875d-8d935e0dbb75 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1095 time: 0.0535326 Dec 21 03:45:45.198377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0a603e-29c9-41bc-8d78-baa167de8e3a req-4d71fb46-48cb-48dc-a102-a326c4266ece tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.200007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f0a603e-29c9-41bc-8d78-baa167de8e3a req-4d71fb46-48cb-48dc-a102-a326c4266ece tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0596282 Dec 21 03:45:45.201046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:45.262016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a req-953f2e3b-7229-4b0e-b150-6064f4decd36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.262610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:45.263776 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a req-953f2e3b-7229-4b0e-b150-6064f4decd36 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=7662e8b89a444924a01bee5e34421908&shared=False HTTP/1.1" status: 200 len: 921 time: 0.1072791 Dec 21 03:45:45.273391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:45.277474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Pushing event updated for resources: {'Port': ['ID=b3a5d380-a58f-4030-b88c-87371f69b18a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:45.282408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:45.318255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f0a603e-29c9-41bc-8d78-baa167de8e3a req-999c3f58-b794-49c5-86e0-5883d78c7eab tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1112468 Dec 21 03:45:45.404157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a req-e0dd9808-345c-47fa-acbd-acb4c83f980a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.405827 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7e4eeb48-e581-4bf0-98c0-fde36e49a41a req-e0dd9808-345c-47fa-acbd-acb4c83f980a service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1340287 Dec 21 03:45:45.531263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-5458f6aa-f7a1-402c-a0f2-52fb021956ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.533096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-5458f6aa-f7a1-402c-a0f2-52fb021956ab service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1095 time: 0.0605793 Dec 21 03:45:45.542058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-53ac9fd2-62aa-49e1-92f1-b31946be2ab2 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--787839608&fields=id&tenant_id=7fa1b480ce544ae89f56493527b75054 HTTP/1.1" status: 200 len: 267 time: 0.1158831 Dec 21 03:45:45.568506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87b416c2-904d-4575-a467-5634aae6aabf req-c6d7f363-7237-415d-9797-78b9f439d9f9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.575745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87b416c2-904d-4575-a467-5634aae6aabf req-c6d7f363-7237-415d-9797-78b9f439d9f9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1692669 Dec 21 03:45:45.607279 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-5ac2ae28-d0a6-4c56-876c-714db3d8240e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 217 time: 0.0589554 Dec 21 03:45:45.668119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-7aac54ec-29d5-4ac5-8d2c-13f64dad593f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.669652 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-7aac54ec-29d5-4ac5-8d2c-13f64dad593f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0539818 Dec 21 03:45:45.709957 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-7ac38c5f-772a-4b33-bbde-ad4cb6028588 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0320759 Dec 21 03:45:45.738659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87b416c2-904d-4575-a467-5634aae6aabf req-5f1412fc-9658-4ecd-87ec-7e1133464275 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1619656 Dec 21 03:45:45.859425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-1e793be0-ed63-4d4d-8214-639bfff1e397 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394444 Dec 21 03:45:45.886778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-231d6d3a-8e5c-4776-a8e7-e602fe31acf7 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:45.894036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-231d6d3a-8e5c-4776-a8e7-e602fe31acf7 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/networks?id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd HTTP/1.1" status: 200 len: 815 time: 0.3485000 Dec 21 03:45:45.900090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bfeed3f-72b2-42d5-bc0e-dfc6189512bc req-74c626ba-4fe6-4ccb-90b5-9602ae84d743 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 210 time: 0.0746813 Dec 21 03:45:45.905699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:45.919816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-b524001c-e44c-43e8-a8a2-1a2d5537ac03 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/quotas/7fa1b480ce544ae89f56493527b75054 HTTP/1.1" status: 200 len: 375 time: 0.0248830 Dec 21 03:45:45.982425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f24985c-4360-457d-b329-4a8dd9c7c744 None None] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:45:46.064381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7be597c9-1c9a-4d3e-bd36-e295e3d198fa up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:46.092237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-554e20b2-07cd-4c67-99ea-a87044e046cd tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7fa1b480ce544ae89f56493527b75054&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1714015 Dec 21 03:45:46.159016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a8b034b0-a1e7-4572-bb41-bca9d5d727e7 None None] Provisioning complete for port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:46.159709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a8b034b0-a1e7-4572-bb41-bca9d5d727e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.266652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:46.267751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.386957 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a8b034b0-a1e7-4572-bb41-bca9d5d727e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.452286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.464102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-5968cc9b-e354-475a-a3fa-9e5b8d13e750 service neutron] 10.222.0.18 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3706200 Dec 21 03:45:46.492716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a8b034b0-a1e7-4572-bb41-bca9d5d727e7 None None] For port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:46.522073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.542861 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75f103b3-3920-4bce-ae2d-90a406131aa4 req-0deb8538-dca8-4790-a017-b997db284da0 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6723223 Dec 21 03:45:46.551890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a8b034b0-a1e7-4572-bb41-bca9d5d727e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.634322 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:45:46.634678 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:45:46.639425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b034b0-a1e7-4572-bb41-bca9d5d727e7 None None] Pushing event updated for resources: {'Port': ['ID=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:46.677288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a61e869e-ae80-4464-8e50-b135c6f2fa08 None None] Provisioning complete for port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:46.677913 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a61e869e-ae80-4464-8e50-b135c6f2fa08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:46.889726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd8273d-f45a-48bf-81b6-b78b9ad364a1 req-97179212-b5d9-4ab0-ae97-ead8bcd2c2e1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:46.891270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccd8273d-f45a-48bf-81b6-b78b9ad364a1 req-97179212-b5d9-4ab0-ae97-ead8bcd2c2e1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.5599771 Dec 21 03:45:46.940520 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-bd700632-fb41-4c27-9964-0e048d2dbb2a tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=a31642b4b357428184e50f7d8f1ebb76&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0300148 Dec 21 03:45:47.022464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccd8273d-f45a-48bf-81b6-b78b9ad364a1 req-65bb293d-39d4-4472-8d73-bdeedd54eeb8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002505 Dec 21 03:45:47.062918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-05ce1482-f4dd-4505-b8b2-554e2a72150a service neutron] 10.222.0.18 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2225089 Dec 21 03:45:47.176411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Router 8bc1a5c7-d429-47c0-a284-10ec8773981e is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:45:47.205092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-78cadc8a-a6fc-44ec-bfd2-1783ec671d6d tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:47.207357 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-78cadc8a-a6fc-44ec-bfd2-1783ec671d6d tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2535110 Dec 21 03:45:47.236551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbe1926-2032-4238-bc58-53edbaed6d2e req-d733f96b-2a79-4bd7-912e-d08aac3a6ff9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:47.242822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bbe1926-2032-4238-bc58-53edbaed6d2e req-d733f96b-2a79-4bd7-912e-d08aac3a6ff9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1441672 Dec 21 03:45:47.260811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Request body: {'port': {'device_id': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'a31642b4b357428184e50f7d8f1ebb76'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:47.297491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-df84f6c4-7a67-4834-903c-61f63ebfd050 service neutron] 10.222.0.31 "GET /v2.0/ports/4e3a8359-5d74-431f-a914-f74c7cc55e15/bindings/n-h2-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.1655369 Dec 21 03:45:47.386095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bbe1926-2032-4238-bc58-53edbaed6d2e req-fbb898d7-07e8-4443-b585-1f45badb2a4a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1366842 Dec 21 03:45:47.402542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:47.422655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Sync routers for ids ['8bc1a5c7-d429-47c0-a284-10ec8773981e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:47.441257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Routers {'8bc1a5c7-d429-47c0-a284-10ec8773981e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:47.444127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8bc1a5c7-d429-47c0-a284-10ec8773981e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:47.448924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Made reservation on behalf of a31642b4b357428184e50f7d8f1ebb76 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:47.452137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:47.463277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:47.500595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:47.504692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b1e29c52-3be5-4fc5-811e-22b2487fc898 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 936 time: 3.9671345 Dec 21 03:45:47.520861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44388) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:47.585769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:47.601660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb71a042-6c4c-4905-a6a3-1bd1cfb2c61c req-12f66947-5947-4f52-8bd3-16a3ab7f5032 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:47.607362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Set router 8bc1a5c7-d429-47c0-a284-10ec8773981e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:47.613503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a042-6c4c-4905-a6a3-1bd1cfb2c61c req-12f66947-5947-4f52-8bd3-16a3ab7f5032 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1212962 Dec 21 03:45:47.671604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:47.724322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a042-6c4c-4905-a6a3-1bd1cfb2c61c req-e8c902ec-2542-4983-a850-419f986f2648 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1136703 Dec 21 03:45:47.744132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2b91dc82-f9a5-4074-a9a2-7088d3d1b763,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:47.839316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f44c545-6750-42d8-960e-17f846bbe266 req-47df7e35-c1d4-4523-bf4e-4f969b78c269 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 210 time: 0.0654805 Dec 21 03:45:47.978042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:45Z', 'revision_number': 3, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:47.990700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7be597c9-1c9a-4d3e-bd36-e295e3d198fa up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:47.997120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-ebcff2ff-b448-4ff4-81b9-a574a8221f3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:47.998636 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-ebcff2ff-b448-4ff4-81b9-a574a8221f3a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c&tenant_id=408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 1102 time: 0.1855898 Dec 21 03:45:48.011538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-074fa1e1-54ba-48fd-972c-5ce657841ad6 req-9ba0b6e9-b2c3-40d4-803f-15085dccccd6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0452468 Dec 21 03:45:48.081229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Checking router: 8bc1a5c7-d429-47c0-a284-10ec8773981e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:48.081592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Updating router 8bc1a5c7-d429-47c0-a284-10ec8773981e port b3a5d380-a58f-4030-b88c-87371f69b18a binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:45:48.086175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Allocated IP 192.168.233.21 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/eccc8c5c-70cc-45fa-b816-4e666ed149dd) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:48.129431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.145420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-d27c9327-5823-4383-a444-c462178cccef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:48.147375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-d27c9327-5823-4383-a444-c462178cccef service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1102 time: 0.1011384 Dec 21 03:45:48.236708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:48.237086 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.254963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3cd738-b8b3-4eb5-bfde-a249035f5e90 req-ae888872-fd58-4168-99cd-6cf0b2d58c59 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:48.256888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec3cd738-b8b3-4eb5-bfde-a249035f5e90 req-ae888872-fd58-4168-99cd-6cf0b2d58c59 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1410654 Dec 21 03:45:48.328605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-77627285-d2ca-4df4-a16f-5c905689865d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:48.330695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-77627285-d2ca-4df4-a16f-5c905689865d service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1710944 Dec 21 03:45:48.378214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec3cd738-b8b3-4eb5-bfde-a249035f5e90 req-81872b74-3f5b-45b9-9494-104bd5c30d51 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046069 Dec 21 03:45:48.390252 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-bb22e127-e71a-45a1-b7f9-e55982b0ee50 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.154&port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 217 time: 0.0512314 Dec 21 03:45:48.444979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.476205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-ba029ba6-26c5-4cc6-bec1-394d860c8d26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:48.477772 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-ba029ba6-26c5-4cc6-bec1-394d860c8d26 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0772228 Dec 21 03:45:48.484313 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.501544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.537051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-002dc7ef-3a91-4317-b2a9-18a98485c777 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:48.538565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-002dc7ef-3a91-4317-b2a9-18a98485c777 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0499535 Dec 21 03:45:48.574461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.670267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6471de23-f3ec-472c-9a07-138accadd0cc None None] Pushing event updated for resources: {'Port': ['ID=b3a5d380-a58f-4030-b88c-87371f69b18a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:48.685633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Attempting to bind port b3a5d380-a58f-4030-b88c-87371f69b18a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:48.685931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Attempting to bind port b3a5d380-a58f-4030-b88c-87371f69b18a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:48.686349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Attempting to bind port b3a5d380-a58f-4030-b88c-87371f69b18a on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:48.693470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-a793e248-5104-406d-b551-6ebdeb056afe service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1453311 Dec 21 03:45:48.696174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.699794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:48.700185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:48.700580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.700977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:48.701450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Bound port: b3a5d380-a58f-4030-b88c-87371f69b18a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:48.701835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.737489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Allocated IP 172.20.0.1 (98282c17-34d3-411f-a67f-a04e2e9118d9/a24d8f8f-087d-42bd-ac2a-2cdb7329426e/22d08d87-fed0-40a6-83de-294c37165d6b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:48.781982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] For port b3a5d380-a58f-4030-b88c-87371f69b18a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:48.796085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] For port b3a5d380-a58f-4030-b88c-87371f69b18a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b3a5d380-a58f-4030-b88c-87371f69b18a,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:48.798985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2948228-157f-43c8-8163-423b7e61b376 req-d089781c-2942-49cf-9290-33866d7bdbad tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:48.802282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2948228-157f-43c8-8163-423b7e61b376 req-d089781c-2942-49cf-9290-33866d7bdbad tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.2789323 Dec 21 03:45:48.804390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:48.842229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:48.887704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:48.896332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:48.897414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.900170 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:48.918267 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b956ddea-eb06-4749-95f3-b8d22b3352bc req-c43ab681-cc1c-466a-aa7b-83d5b28d21bc service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2105131 Dec 21 03:45:48.968628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Routers {'8bc1a5c7-d429-47c0-a284-10ec8773981e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:48.969308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8bc1a5c7-d429-47c0-a284-10ec8773981e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:49.014909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:49.015629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.048542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6471de23-f3ec-472c-9a07-138accadd0cc None None] Pushing event updated for resources: {'Port': ['ID=b3a5d380-a58f-4030-b88c-87371f69b18a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:49.066775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.101048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-e6ec0018-d9a6-4d73-b898-b4eda8558619 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.8471344 Dec 21 03:45:49.140692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Request body: {'port': {'device_id': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:49.145902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] Set router 8bc1a5c7-d429-47c0-a284-10ec8773981e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:49.166508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2948228-157f-43c8-8163-423b7e61b376 req-3a69824b-3b36-4a00-a503-bbfda837ff77 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3551199 Dec 21 03:45:49.177481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:49.185769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5bb5d7-e171-40d2-8218-18a3d608a220 req-c728df5c-46b3-4c3f-8c71-ed3bd73c4017 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:49.208082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c5bb5d7-e171-40d2-8218-18a3d608a220 req-c728df5c-46b3-4c3f-8c71-ed3bd73c4017 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.2635036 Dec 21 03:45:49.213267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:49.265072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:49.271552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.285248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Pushing event updated for resources: {'Port': ['ID=22d08d87-fed0-40a6-83de-294c37165d6b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:49.392093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c5bb5d7-e171-40d2-8218-18a3d608a220 req-b0262a93-d825-45db-a7f7-a1974f3e0c68 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1784971 Dec 21 03:45:49.396459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.443392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-52e30212-cec9-48b4-8173-fc547bf0ab8c None None] Provisioning complete for port eccc8c5c-70cc-45fa-b816-4e666ed149dd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:49.443982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52e30212-cec9-48b4-8173-fc547bf0ab8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.500492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f074d4a6-4418-47ef-8522-1d4ddc38c3d7 req-9a26bdae-9520-464e-a097-d0a1e4889dec tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:49.514020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f074d4a6-4418-47ef-8522-1d4ddc38c3d7 req-9a26bdae-9520-464e-a097-d0a1e4889dec tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 935 time: 0.1972480 Dec 21 03:45:49.725551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f074d4a6-4418-47ef-8522-1d4ddc38c3d7 req-10e05af1-224e-4d89-9e9b-b8460e8646d3 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2106187 Dec 21 03:45:49.782130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-52e30212-cec9-48b4-8173-fc547bf0ab8c None None] Port eccc8c5c-70cc-45fa-b816-4e666ed149dd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:49.819671 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-befd4001-e602-4484-89e5-c164fd449c67 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.843419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:45Z', 'revision_number': 3, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:49.875536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c3d2fd-18f2-4e95-ac0a-b1b626a27247 req-fe212569-f41b-4ff9-a9a7-fd9330a516c4 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0981548 Dec 21 03:45:49.883472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0960afe1-543b-437e-bb68-8fabac858554 None None] The sync data for ids ['8bc1a5c7-d429-47c0-a284-10ec8773981e'] in n-d-822053-11 is: [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:45Z', 'revision_number': 3, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:49.889211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.894405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eccc8c5c-70cc-45fa-b816-4e666ed149dd {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:49.907697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.918171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9295dc2e-dd94-4dcc-8259-dcd6b55bd3bf None None] Provisioning complete for port 22d08d87-fed0-40a6-83de-294c37165d6b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:49.918543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9295dc2e-dd94-4dcc-8259-dcd6b55bd3bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:49.923716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Transition to ACTIVE for port object eccc8c5c-70cc-45fa-b816-4e666ed149dd will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:45:49.973840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9295dc2e-dd94-4dcc-8259-dcd6b55bd3bf None None] Port 22d08d87-fed0-40a6-83de-294c37165d6b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:49.984839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:49.997401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:50.008087 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.010473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2158592-12d5-4401-b992-c0acf1e8ea05 req-03844800-9e9b-4792-b839-f13a826e156a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:50.012073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2158592-12d5-4401-b992-c0acf1e8ea05 req-03844800-9e9b-4792-b839-f13a826e156a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1252813 Dec 21 03:45:50.129908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2158592-12d5-4401-b992-c0acf1e8ea05 req-2a789fe6-2cdd-49ec-ac4f-1e31d9a0463f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990489 Dec 21 03:45:50.197243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:50.212656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.222667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'port_id': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'mac_address': 'fa:16:3e:99:26:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84e57960-b2b1-49b0-85de-36fd5e1ebd6a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:50.242005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:50.243656 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.332908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.334994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Attempting to bind port eccc8c5c-70cc-45fa-b816-4e666ed149dd on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:50.336600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Attempting to bind port eccc8c5c-70cc-45fa-b816-4e666ed149dd by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:50.337224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Attempting to bind port eccc8c5c-70cc-45fa-b816-4e666ed149dd on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:50.348582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Port eccc8c5c-70cc-45fa-b816-4e666ed149dd on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:50.349055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Attempting to bind port eccc8c5c-70cc-45fa-b816-4e666ed149dd on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:50.363109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:50.363688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:50.364789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:50.365748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Bound port: eccc8c5c-70cc-45fa-b816-4e666ed149dd, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:50.365885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.365982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:50.369700 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d22a1964-3374-4d85-8cb8-be69eb0f01f7" -d '{"events": [{"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-unplugged", "status": "completed", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:50.428972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:50.440274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.459659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b1bddbab-3a32-4687-b97f-eada22b71c0f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:50.473966 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-080f07f2-b931-4fbf-8d88-1d369380bb8a x-openstack-request-id: req-080f07f2-b931-4fbf-8d88-1d369380bb8a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:50.474253 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-unplugged", "status": "completed", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:50.474579 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-080f07f2-b931-4fbf-8d88-1d369380bb8a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:50.474997 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'code': 200} Dec 21 03:45:50.483638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:50.510765 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.541553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.592159 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.611828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:50.634909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:50.664514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:50.704754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-7a092fc3-4643-43ca-858e-4d91a8ce4177 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:50.705123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:50.706500 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-7a092fc3-4643-43ca-858e-4d91a8ce4177 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.31 "GET /v2.0/networks?id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd HTTP/1.1" status: 200 len: 815 time: 0.2348926 Dec 21 03:45:50.720606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Pushing event updated for resources: {'Port': ['ID=22d08d87-fed0-40a6-83de-294c37165d6b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:50.742273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af9c4da-d0ca-48d3-9ed3-993300a6c2f9 req-7c329339-ded9-49a0-88cf-ccdb6d4283c8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:50.746601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.752094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7af9c4da-d0ca-48d3-9ed3-993300a6c2f9 req-7c329339-ded9-49a0-88cf-ccdb6d4283c8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.4361031 Dec 21 03:45:50.821731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e939dac2-a2d3-46ee-9fa8-66577e3ad12b req-89d1de96-2b88-4a32-9f82-b1b7b2c0e5e4 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:50.830435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e939dac2-a2d3-46ee-9fa8-66577e3ad12b req-89d1de96-2b88-4a32-9f82-b1b7b2c0e5e4 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.2862542 Dec 21 03:45:50.849800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:50.850572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:50.852241 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] 10.222.0.54 "PUT /v2.0/ports/eccc8c5c-70cc-45fa-b816-4e666ed149dd HTTP/1.1" status: 200 len: 1096 time: 1.7243099 Dec 21 03:45:50.853502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:50.857374 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3515c1e-42a2-437f-a3be-f67410b43b62" -d '{"events": [{"name": "network-changed", "server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:50.905337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cadf49-3867-4ecb-b692-5c65f99bed0b service neutron] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:50.922556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-357e70b1-3137-48b8-9ba0-e1e6575d5985 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7fa1b480ce544ae89f56493527b75054 HTTP/1.1" status: 200 len: 379 time: 0.1946318 Dec 21 03:45:50.939579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7af9c4da-d0ca-48d3-9ed3-993300a6c2f9 req-a64f32b7-2caa-45c9-9183-aa925c5b3c87 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1811066 Dec 21 03:45:50.975137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b1bddbab-3a32-4687-b97f-eada22b71c0f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:50.997799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e939dac2-a2d3-46ee-9fa8-66577e3ad12b req-5b5ed0f8-6953-4150-8de1-6f1d69fa2f0c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1665385 Dec 21 03:45:51.044285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:51.052895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:51.138286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-586c3d72-4db8-4099-b5f4-a3e626fdc904 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:51.150042 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-586c3d72-4db8-4099-b5f4-a3e626fdc904 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a31642b4b357428184e50f7d8f1ebb76&device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 1099 time: 0.1254570 Dec 21 03:45:51.268555 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-fbbe5b3f-6f36-491c-99cd-ce32a13dbf45 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.21&port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd HTTP/1.1" status: 200 len: 217 time: 0.0961537 Dec 21 03:45:51.279738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Request body: {'port': {'device_id': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'admin_state_up': True, 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'security_groups': ['d37501a6-0469-46d6-b49f-78211ef2e8d1']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:51.394794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Router 8bc1a5c7-d429-47c0-a284-10ec8773981e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:51.418388 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf33b3ec-2ffd-4482-a3be-8376d25b60f3 x-openstack-request-id: req-bf33b3ec-2ffd-4482-a3be-8376d25b60f3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:51.418684 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:51.418959 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bf33b3ec-2ffd-4482-a3be-8376d25b60f3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:51.419358 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'status': 'completed', 'code': 200} Dec 21 03:45:51.473352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fff16cc5-75ce-4126-88b2-d9e6bb7dfdd7 req-2c7a179c-747c-472a-82d6-e966aa665c39 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0742981 Dec 21 03:45:51.503911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-bf8cb649-d035-4a97-bfac-4a64f64e98d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:51.520602 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-bf8cb649-d035-4a97-bfac-4a64f64e98d5 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1057301 Dec 21 03:45:51.563377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3b99a8c8-fc80-4bca-877d-a36fa84edcd9 None None] Provisioning complete for port 22d08d87-fed0-40a6-83de-294c37165d6b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:51.563749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b99a8c8-fc80-4bca-877d-a36fa84edcd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:51.602795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-c4b62992-aca4-4a02-bc2c-57adc6ea94b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:51.602795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-c4b62992-aca4-4a02-bc2c-57adc6ea94b1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0789933 Dec 21 03:45:51.630080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b99a8c8-fc80-4bca-877d-a36fa84edcd9 None None] Port 22d08d87-fed0-40a6-83de-294c37165d6b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:51.646671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659f4619-e6fe-44e5-9bb9-95ed7a83f0df req-c9326f0e-b59a-4605-90b5-3f85ce07b03e tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:51.655212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-659f4619-e6fe-44e5-9bb9-95ed7a83f0df req-c9326f0e-b59a-4605-90b5-3f85ce07b03e tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 947 time: 0.3414412 Dec 21 03:45:51.710420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Made reservation on behalf of 7fa1b480ce544ae89f56493527b75054 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:45:51.719993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:51.776296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4890913-88aa-499e-8945-1efc0146be56 req-012cae95-b3bb-4338-8dfa-54b1d5d97cdd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:51.777837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4890913-88aa-499e-8945-1efc0146be56 req-012cae95-b3bb-4338-8dfa-54b1d5d97cdd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1107783 Dec 21 03:45:51.784063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:51.799200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-659f4619-e6fe-44e5-9bb9-95ed7a83f0df req-a56956ac-2850-45bf-9c31-57f18cf14c40 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1396127 Dec 21 03:45:51.805964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d5972a21-7768-438d-bd0c-39611c09abc5 admin admin] 10.222.0.18 "PUT /v2.0/routers/8bc1a5c7-d429-47c0-a284-10ec8773981e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2793467 Dec 21 03:45:51.919788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4890913-88aa-499e-8945-1efc0146be56 req-2bd67a88-fab4-4575-824e-c0052ab4b5ae tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121240 Dec 21 03:45:51.949018 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-9fff84e5-db00-46ef-818d-ee04e6821864 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3308771 Dec 21 03:45:52.009702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:52.018190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3a5d380-a58f-4030-b88c-87371f69b18a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:52.138151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:52.188499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Allocated IP 172.20.0.3 (1413c5b2-d3e7-46e6-af39-45068f2d8ddd/48142ae2-dce2-450f-96ff-f72f7dcd96bb/310284e4-97b1-4722-9326-ad03ce2e793c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:45:52.250069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b3a5d380-a58f-4030-b88c-87371f69b18a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:52.250191 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.300020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-591ba6c9-2f74-4ef9-8bd2-5953287bfd23 req-e3573bc8-e43d-4a8e-b0ae-f17d65303c2d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:52.301572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-591ba6c9-2f74-4ef9-8bd2-5953287bfd23 req-e3573bc8-e43d-4a8e-b0ae-f17d65303c2d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.1731849 Dec 21 03:45:52.334131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e653aac1-b3e0-45d3-abf2-7a0ac74b0b94 req-bc965bac-75be-4bc3-aebe-8845fedb6724 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:52.334958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e653aac1-b3e0-45d3-abf2-7a0ac74b0b94 req-bc965bac-75be-4bc3-aebe-8845fedb6724 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 948 time: 0.1942852 Dec 21 03:45:52.362783 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ac9d8be-967b-460d-bda2-122b9e95a7b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.419786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-591ba6c9-2f74-4ef9-8bd2-5953287bfd23 req-7331af44-8e52-4e93-b96f-dd3e7888507a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069055 Dec 21 03:45:52.436378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.456053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e653aac1-b3e0-45d3-abf2-7a0ac74b0b94 req-fd7e9ae2-e1d3-4e09-912d-eac23020d697 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117456 Dec 21 03:45:52.473338 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79129fd9-0d56-4899-bf9d-a6198562bd93 req-22aa5f2d-6b25-4ef9-bb91-1c697792011d service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4755251 Dec 21 03:45:52.494554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port b1bddbab-3a32-4687-b97f-eada22b71c0f completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:52.502668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.524950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:52.529462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b1bddbab-3a32-4687-b97f-eada22b71c0f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:52.529786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.586072 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.599073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'mac_address': 'fa:16:3e:8b:ca:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.154'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:52.619721 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-a32818f3-c51f-4380-815d-403acb9d8f0b req-09cb67ba-5af9-4361-9942-be2b4537c201 tempest-FloatingIPDetailsNegativeTestJSON-1673936319 tempest-FloatingIPDetailsNegativeTestJSON-1673936319-project] show failed (client error): The resource could not be found. Dec 21 03:45:52.620936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a32818f3-c51f-4380-815d-403acb9d8f0b req-09cb67ba-5af9-4361-9942-be2b4537c201 tempest-FloatingIPDetailsNegativeTestJSON-1673936319 tempest-FloatingIPDetailsNegativeTestJSON-1673936319-project] 10.222.0.18 "GET /v2.0/floatingips/5e53301f-ee69-4ddb-9c73-b4690ba21a31 HTTP/1.1" status: 404 len: 350 time: 0.0989976 Dec 21 03:45:52.630216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:52.632066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.661838 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Sync routers for ids ['8bc1a5c7-d429-47c0-a284-10ec8773981e'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:52.672427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b3a5d380-a58f-4030-b88c-87371f69b18a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b3a5d380-a58f-4030-b88c-87371f69b18a,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:52.683392 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Routers {'8bc1a5c7-d429-47c0-a284-10ec8773981e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:52.684029 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8bc1a5c7-d429-47c0-a284-10ec8773981e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:52.736605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:45:52.745979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:45:52.751172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:45:52.753340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.782983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event updated for resources: {'Port': ['ID=310284e4-97b1-4722-9326-ad03ce2e793c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:52.790153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.833396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-5628cce1-2e66-4d78-b562-ccc0d5158461 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:52.835055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-5628cce1-2e66-4d78-b562-ccc0d5158461 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a31642b4b357428184e50f7d8f1ebb76&device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 1099 time: 0.1759672 Dec 21 03:45:52.886032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:52.886032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.925001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:52.932488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4e3a8359-5d74-431f-a914-f74c7cc55e15 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:52.949989 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Set router 8bc1a5c7-d429-47c0-a284-10ec8773981e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:53.052700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b3a5d380-a58f-4030-b88c-87371f69b18a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:53.058365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:53.078094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:53.085833 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-72508f9b-d159-4425-af58-aa2b1d604ace" -d '{"events": [{"server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "name": "network-vif-plugged", "status": "completed", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:53.093660 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-c42f2c0f-32ea-4ea3-af3d-f7c2647ad9b3 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8238583 Dec 21 03:45:53.122925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:53.123603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Request body: {'port': {'device_id': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:45:53.128639 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.139082 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.222358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2a513c76-12a5-4009-9614-78795c506fac None None] Provisioning complete for port 310284e4-97b1-4722-9326-ad03ce2e793c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:53.223006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2a513c76-12a5-4009-9614-78795c506fac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.233618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-54e78ce6-21a3-4073-9f35-215db944b798 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.233618 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-54e78ce6-21a3-4073-9f35-215db944b798 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3802347 Dec 21 03:45:53.236283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.285371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:53.331982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2a513c76-12a5-4009-9614-78795c506fac None None] Port 310284e4-97b1-4722-9326-ad03ce2e793c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:53.368289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:53.378505 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-f6b52de7-f4c5-47e7-956b-d1fe580714c1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.21&port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd HTTP/1.1" status: 200 len: 217 time: 0.1321461 Dec 21 03:45:53.379192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.389010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194d501e-5808-49c7-b473-097f68ab0015 req-324fc621-9f44-48fb-b132-14905130c83e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.390675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-324fc621-9f44-48fb-b132-14905130c83e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c&tenant_id=408f05064a77442595f2b5d444671b8a&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 949 time: 0.1581213 Dec 21 03:45:53.450690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-04c9afa6-ae52-496a-a836-29728397f6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.452586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-04c9afa6-ae52-496a-a836-29728397f6fb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0526836 Dec 21 03:45:53.480476 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:49Z', 'revision_number': 4, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '22d08d87-fed0-40a6-83de-294c37165d6b', 'name': '', 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'mac_address': 'fa:16:3e:16:3d:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_interface', 'standard_attr_id': 577, 'fixed_ips': [{'subnet_id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:48Z', 'updated_at': '2021-12-21T03:45:49Z', 'revision_number': 2, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'subnets': [{'id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:53.501856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:53.508442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Checking router: 8bc1a5c7-d429-47c0-a284-10ec8773981e for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:53.508793 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Updating router 8bc1a5c7-d429-47c0-a284-10ec8773981e port 22d08d87-fed0-40a6-83de-294c37165d6b binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:45:53.538715 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.596856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f761b57-bf27-4b72-bc2e-efae5169323a req-79deaabe-d906-4626-a9ca-cad9c7c3ccf2 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.604809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f761b57-bf27-4b72-bc2e-efae5169323a req-79deaabe-d906-4626-a9ca-cad9c7c3ccf2 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 931 time: 0.6343279 Dec 21 03:45:53.623412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9522b3f-0cf8-4146-b99b-5dda3708d560 req-8daf703d-1205-406b-8bf3-028aeb051c72 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.631710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9522b3f-0cf8-4146-b99b-5dda3708d560 req-8daf703d-1205-406b-8bf3-028aeb051c72 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 947 time: 0.1915014 Dec 21 03:45:53.738200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194d501e-5808-49c7-b473-097f68ab0015 req-0a92cbed-4b28-444d-a233-7528c6fe0dc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.739734 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-0a92cbed-4b28-444d-a233-7528c6fe0dc1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1101 time: 0.1038840 Dec 21 03:45:53.752879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f761b57-bf27-4b72-bc2e-efae5169323a req-812153ed-e6c2-4469-a379-b572c5127852 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1457732 Dec 21 03:45:53.793650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-7023448b-eaa2-47c1-b769-715bfa1c671c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:53.795274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-7023448b-eaa2-47c1-b769-715bfa1c671c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1604662 Dec 21 03:45:53.812135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9522b3f-0cf8-4146-b99b-5dda3708d560 req-e2293524-8eb2-4fa9-8528-caec95b76a57 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1794693 Dec 21 03:45:53.912573 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:53.950298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3a5d380-a58f-4030-b88c-87371f69b18a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:53.979516 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.027231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91980e5e-bfea-4ccd-8cdf-e0e109053d0f req-440596ac-ff01-4dd4-b91b-33ee572c1dc1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:54.038029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91980e5e-bfea-4ccd-8cdf-e0e109053d0f req-440596ac-ff01-4dd4-b91b-33ee572c1dc1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 949 time: 0.1417959 Dec 21 03:45:54.038889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194d501e-5808-49c7-b473-097f68ab0015 req-eee1c147-3141-4fd7-bf7f-4acf6c87ab5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:54.040817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-eee1c147-3141-4fd7-bf7f-4acf6c87ab5e service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2904646 Dec 21 03:45:54.054586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b3a5d380-a58f-4030-b88c-87371f69b18a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:54.055612 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.062130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d11c55-f754-438f-889e-618f1806ad7f req-41c94742-b3dd-4930-a6f0-d5c5de279d95 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:54.065781 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Pushing event updated for resources: {'Port': ['ID=22d08d87-fed0-40a6-83de-294c37165d6b,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:54.072673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53d11c55-f754-438f-889e-618f1806ad7f req-41c94742-b3dd-4930-a6f0-d5c5de279d95 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1742229 Dec 21 03:45:54.078493 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.079089 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.080146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.080640 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.081154 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.081640 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.082123 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.082644 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.083177 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.083711 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.084222 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.084730 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.085333 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:45:54.154253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53d11c55-f754-438f-889e-618f1806ad7f req-142224af-52a6-4cb4-8a5b-ef24cfc7c1f1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804658 Dec 21 03:45:54.167766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-924c1c04-3a70-4fdd-a927-1357fe358e5d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.154&port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 217 time: 0.1113131 Dec 21 03:45:54.186619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-f6205240-f3b0-476f-8ca8-4a58a31ee017 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3480763 Dec 21 03:45:54.191442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Attempting to bind port 22d08d87-fed0-40a6-83de-294c37165d6b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:54.192711 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Attempting to bind port 22d08d87-fed0-40a6-83de-294c37165d6b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:54.196673 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Attempting to bind port 22d08d87-fed0-40a6-83de-294c37165d6b on network 98282c17-34d3-411f-a67f-a04e2e9118d9 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:54.211756 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:54.215045 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Checking segment: {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:54.216142 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.216766 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Bound using segment: {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:54.218509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Bound port: 22d08d87-fed0-40a6-83de-294c37165d6b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65c18066-7cae-4372-80d2-c4b2caf0f73a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:54.219284 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.322835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91980e5e-bfea-4ccd-8cdf-e0e109053d0f req-6b57b5e2-6a38-4871-8c18-a922a33b1b20 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2831321 Dec 21 03:45:54.361914 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b30c9bf-6b75-4c76-ac60-b04354dd869e x-openstack-request-id: req-4b30c9bf-6b75-4c76-ac60-b04354dd869e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:54.361914 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "name": "network-vif-plugged", "status": "completed", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:54.361914 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4b30c9bf-6b75-4c76-ac60-b04354dd869e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:54.361914 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'code': 200} Dec 21 03:45:54.370659 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] For port 22d08d87-fed0-40a6-83de-294c37165d6b, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:54.378430 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] For port 22d08d87-fed0-40a6-83de-294c37165d6b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22d08d87-fed0-40a6-83de-294c37165d6b,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:54.390227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.471307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7fce084f-7df1-4053-bc53-6cba89034517 None None] Provisioning complete for port 22d08d87-fed0-40a6-83de-294c37165d6b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:54.471682 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fce084f-7df1-4053-bc53-6cba89034517 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.494000 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.556821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7fce084f-7df1-4053-bc53-6cba89034517 None None] Port 22d08d87-fed0-40a6-83de-294c37165d6b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:45:54.601453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b57f8a2-365a-4163-adf4-141689277f12 req-a53e0b83-d28b-4b04-a0ed-5c524cf3579a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:54.612107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b57f8a2-365a-4163-adf4-141689277f12 req-a53e0b83-d28b-4b04-a0ed-5c524cf3579a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.1807272 Dec 21 03:45:54.642017 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Routers {'8bc1a5c7-d429-47c0-a284-10ec8773981e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:54.642889 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8bc1a5c7-d429-47c0-a284-10ec8773981e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:54.648927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe8d27a-6cbb-4163-9d95-c3fef22397de req-3188bd18-eac6-4e9b-a9ad-6734c86640fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:54.651121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbe8d27a-6cbb-4163-9d95-c3fef22397de req-3188bd18-eac6-4e9b-a9ad-6734c86640fe service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1097 time: 0.2110748 Dec 21 03:45:54.682565 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.694786 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ee48f4-6a80-4427-b1e0-0937d6f54778 None None] Pushing event updated for resources: {'Port': ['ID=22d08d87-fed0-40a6-83de-294c37165d6b,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:54.738295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b57f8a2-365a-4163-adf4-141689277f12 req-312ecda6-2ced-42a2-996b-f30dd2917482 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244633 Dec 21 03:45:54.849060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 310284e4-97b1-4722-9326-ad03ce2e793c {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:54.872574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:54.934554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194d501e-5808-49c7-b473-097f68ab0015 req-8cf18f22-59a1-4bdb-9ee2-b91799616bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:54.940731 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-8cf18f22-59a1-4bdb-9ee2-b91799616bd9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.7714791 Dec 21 03:45:54.944733 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] Set router 8bc1a5c7-d429-47c0-a284-10ec8773981e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:54.961887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Transition to ACTIVE for port object 310284e4-97b1-4722-9326-ad03ce2e793c will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:45:55.002503 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3515c1e-42a2-437f-a3be-f67410b43b62 req-65cf67fd-7a54-433a-986b-5129f3d7fe5e service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7978687 Dec 21 03:45:55.011450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194d501e-5808-49c7-b473-097f68ab0015 req-807fff2e-6f8d-4b8c-a3c2-d4f4ac9e5fb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:55.012927 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-807fff2e-6f8d-4b8c-a3c2-d4f4ac9e5fb1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0606790 Dec 21 03:45:55.036459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-42f3032f-c7ee-4e2a-a96e-b73f4894b02d None None] Provisioning complete for port 22d08d87-fed0-40a6-83de-294c37165d6b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:55.036796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-42f3032f-c7ee-4e2a-a96e-b73f4894b02d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.046323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.056744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.208454 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-42f3032f-c7ee-4e2a-a96e-b73f4894b02d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.219349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Pushing event updated for resources: {'Port': ['ID=310284e4-97b1-4722-9326-ad03ce2e793c,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:55.243450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdec01a0-fd6e-4754-a4b3-bfaf36eeae12 req-28c9f6c1-5c09-44ec-bb25-bf29a795bfa7 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:55.253907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdec01a0-fd6e-4754-a4b3-bfaf36eeae12 req-28c9f6c1-5c09-44ec-bb25-bf29a795bfa7 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 931 time: 0.3155630 Dec 21 03:45:55.265789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbe8d27a-6cbb-4163-9d95-c3fef22397de req-ae6e6416-3127-44fa-8110-45cf221a4077 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6040757 Dec 21 03:45:55.276344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-42f3032f-c7ee-4e2a-a96e-b73f4894b02d None None] For port 22d08d87-fed0-40a6-83de-294c37165d6b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22d08d87-fed0-40a6-83de-294c37165d6b,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:55.286879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c3cdf2-b1ad-46c3-8f9c-6879c29973d8 req-4b661fbe-3934-4f36-9dc4-f012fe8392c8 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:55.288546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67c3cdf2-b1ad-46c3-8f9c-6879c29973d8 req-4b661fbe-3934-4f36-9dc4-f012fe8392c8 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 947 time: 0.3300166 Dec 21 03:45:55.302588 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:49Z', 'revision_number': 4, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '22d08d87-fed0-40a6-83de-294c37165d6b', 'name': '', 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'mac_address': 'fa:16:3e:16:3d:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_interface', 'standard_attr_id': 577, 'fixed_ips': [{'subnet_id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:48Z', 'updated_at': '2021-12-21T03:45:54Z', 'revision_number': 4, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'subnets': [{'id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:55.314646 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-82fb3331-20ba-4440-85ea-8133ad2baa61 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2918155 Dec 21 03:45:55.351724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-42f3032f-c7ee-4e2a-a96e-b73f4894b02d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.352450 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d210a74f-4988-4139-b625-e07e0d147c62 None None] The sync data for ids ['8bc1a5c7-d429-47c0-a284-10ec8773981e'] in n-d-822053-11 is: [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:49Z', 'revision_number': 4, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '22d08d87-fed0-40a6-83de-294c37165d6b', 'name': '', 'network_id': '98282c17-34d3-411f-a67f-a04e2e9118d9', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'mac_address': 'fa:16:3e:16:3d:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_interface', 'standard_attr_id': 577, 'fixed_ips': [{'subnet_id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:48Z', 'updated_at': '2021-12-21T03:45:54Z', 'revision_number': 4, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'subnets': [{'id': 'a24d8f8f-087d-42bd-ac2a-2cdb7329426e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:55.392787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Attempting to bind port 310284e4-97b1-4722-9326-ad03ce2e793c on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:45:55.393126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Attempting to bind port 310284e4-97b1-4722-9326-ad03ce2e793c by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:45:55.393457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Attempting to bind port 310284e4-97b1-4722-9326-ad03ce2e793c on network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:55.418666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Port 310284e4-97b1-4722-9326-ad03ce2e793c on network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:45:55.419037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Attempting to bind port 310284e4-97b1-4722-9326-ad03ce2e793c on network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:45:55.446712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:45:55.446712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Checking segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:45:55.449326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Bound using segment: {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:45:55.450022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Bound port: 310284e4-97b1-4722-9326-ad03ce2e793c, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4d133d37-f925-4e60-b2a4-eec93a137782', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:45:55.454231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.490548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f3032f-c7ee-4e2a-a96e-b73f4894b02d None None] Pushing event updated for resources: {'Port': ['ID=22d08d87-fed0-40a6-83de-294c37165d6b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:55.507243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67c3cdf2-b1ad-46c3-8f9c-6879c29973d8 req-372deef7-1f1f-4fd2-b035-97bb7b617696 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1549966 Dec 21 03:45:55.554601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdec01a0-fd6e-4754-a4b3-bfaf36eeae12 req-62f0a97d-5d23-4289-82ef-c13f3f5a1964 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2857254 Dec 21 03:45:55.659864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.660108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] For port 310284e4-97b1-4722-9326-ad03ce2e793c, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:45:55.711275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] For port 310284e4-97b1-4722-9326-ad03ce2e793c, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=310284e4-97b1-4722-9326-ad03ce2e793c,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:45:55.760756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-194d501e-5808-49c7-b473-097f68ab0015 req-cfa03d73-127e-4c50-9804-909a9f14155a service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1415813 Dec 21 03:45:55.791971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.803467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:55.812804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf148df-10d2-4af3-91d3-4601d9c06611 req-12b8fbc9-9e10-408a-96e2-3e8a8a12035f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:55.816483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecf148df-10d2-4af3-91d3-4601d9c06611 req-12b8fbc9-9e10-408a-96e2-3e8a8a12035f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1745641 Dec 21 03:45:55.835636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88d2cb9-417d-4676-95a4-b5e1bb1168c6 req-f3ce9161-097e-4666-91fe-f537d9823ed8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:55.842951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f88d2cb9-417d-4676-95a4-b5e1bb1168c6 req-f3ce9161-097e-4666-91fe-f537d9823ed8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 949 time: 0.1346970 Dec 21 03:45:55.894887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:55.897869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:55.905685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] 10.222.0.31 "PUT /v2.0/ports/310284e4-97b1-4722-9326-ad03ce2e793c HTTP/1.1" status: 200 len: 1092 time: 2.7948399 Dec 21 03:45:55.926598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:55.931416 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-577e6f15-051c-4d1b-806f-180626d17325" -d '{"events": [{"name": "network-changed", "server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:55.987836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698df9e2-af88-4f20-9701-98300dbb1dd5 service neutron] Pushing event updated for resources: {'Port': ['ID=310284e4-97b1-4722-9326-ad03ce2e793c,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:56.006613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:56.027108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Deleting port 22d08d87-fed0-40a6-83de-294c37165d6b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:56.027460 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:56.131347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22d08d87-fed0-40a6-83de-294c37165d6b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:56.153218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecf148df-10d2-4af3-91d3-4601d9c06611 req-500debe9-cb16-4f5a-b54c-90d405e37b9b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2724361 Dec 21 03:45:56.175997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-82625a0c-58bc-4da8-b449-e3ac673e3d8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:56.177619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-82625a0c-58bc-4da8-b449-e3ac673e3d8d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7fa1b480ce544ae89f56493527b75054&device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 1095 time: 0.0914049 Dec 21 03:45:56.250849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:56.277176 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-a675a755-9f84-48fd-befa-72df58bdb88e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=310284e4-97b1-4722-9326-ad03ce2e793c HTTP/1.1" status: 200 len: 217 time: 0.0776486 Dec 21 03:45:56.304680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'mac_address': 'fa:16:3e:56:8d:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:56.355008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 4e3a8359-5d74-431f-a914-f74c7cc55e15 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:56.355247 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:56.380244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f88d2cb9-417d-4676-95a4-b5e1bb1168c6 req-c2259159-a43d-4b50-813c-1b255433ccb7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5278935 Dec 21 03:45:56.418038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-b5dfcbb6-7e24-4f36-92c4-094e2ac0c6ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:56.419683 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-b5dfcbb6-7e24-4f36-92c4-094e2ac0c6ad service neutron] 10.222.0.31 "GET /v2.0/subnets?id=48142ae2-dce2-450f-96ff-f72f7dcd96bb HTTP/1.1" status: 200 len: 854 time: 0.0980008 Dec 21 03:45:56.431315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] For port 22d08d87-fed0-40a6-83de-294c37165d6b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22d08d87-fed0-40a6-83de-294c37165d6b,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:56.431705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:56.463555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Calling delete_port for 22d08d87-fed0-40a6-83de-294c37165d6b owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:56.486740 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce1322ae-d544-4c67-8ad4-017ba6564641 x-openstack-request-id: req-ce1322ae-d544-4c67-8ad4-017ba6564641 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:56.488946 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:56.489390 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ce1322ae-d544-4c67-8ad4-017ba6564641 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:56.490133 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c', 'status': 'completed', 'code': 200} Dec 21 03:45:56.539884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-e3a04a64-3b36-4de6-86ee-360ff5ccca27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:56.541896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-e3a04a64-3b36-4de6-86ee-360ff5ccca27 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1131577 Dec 21 03:45:56.585996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 22d08d87-fed0-40a6-83de-294c37165d6b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:56.586210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:56.618423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3957ad38-4654-45d5-9f8a-d57cf2655ad1 req-fceab7cb-3d89-4a0d-bac5-9f0e5129589c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:56.626755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3957ad38-4654-45d5-9f8a-d57cf2655ad1 req-fceab7cb-3d89-4a0d-bac5-9f0e5129589c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.1608882 Dec 21 03:45:56.744387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:56.787042 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-1a454fa9-9294-4f10-aa7d-2037d46f4cef service neutron] 10.222.0.31 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2288074 Dec 21 03:45:56.795982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3957ad38-4654-45d5-9f8a-d57cf2655ad1 req-29062ec7-4612-4d65-bfb6-194caba351d8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1679039 Dec 21 03:45:56.845883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eccc8c5c-70cc-45fa-b816-4e666ed149dd {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:56.870126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:56.986051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:57.001850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1120f9fe-5ccd-4e80-ab76-6f34b1cb44c4 req-f4783e0e-354c-427d-85f5-2e80a040dabc service neutron] 10.222.0.31 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2072942 Dec 21 03:45:57.036177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:57.037506 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:57.045516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:45:57.048087 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8374a359-7aee-482b-a9d0-4c91809ff116" -d '{"events": [{"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-plugged", "status": "completed", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:45:57.103116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:57.145693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:57.193079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa795be-2e12-4690-9e59-ca4dc758f38c req-a275786e-aae2-44fa-a2d8-ff5de0b2a019 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.198257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fa795be-2e12-4690-9e59-ca4dc758f38c req-a275786e-aae2-44fa-a2d8-ff5de0b2a019 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 947 time: 0.5477891 Dec 21 03:45:57.241945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:57.265181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577e6f15-051c-4d1b-806f-180626d17325 req-eb67028c-b94a-418b-8029-e17d83375a3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.267660 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-eb67028c-b94a-418b-8029-e17d83375a3b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7fa1b480ce544ae89f56493527b75054&device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 1095 time: 0.0851181 Dec 21 03:45:57.297216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:57.434190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['eccc8c5c-70cc-45fa-b816-4e666ed149dd'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:57.442574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Pushing event deleted for resources: {'Port': ['ID=22d08d87-fed0-40a6-83de-294c37165d6b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:57.481957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58930ca4-5fcd-4850-8918-0d3739aa1d34 req-744b3f0b-0702-481e-86e6-da6942cd6e45 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.487001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58930ca4-5fcd-4850-8918-0d3739aa1d34 req-744b3f0b-0702-481e-86e6-da6942cd6e45 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.3628244 Dec 21 03:45:57.505378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577e6f15-051c-4d1b-806f-180626d17325 req-d4076cec-a96b-49fd-8441-41352ca7823f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.507232 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-d4076cec-a96b-49fd-8441-41352ca7823f service neutron] 10.222.0.31 "GET /v2.0/networks?id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd HTTP/1.1" status: 200 len: 916 time: 0.2307105 Dec 21 03:45:57.561813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fa795be-2e12-4690-9e59-ca4dc758f38c req-e8f1bb1e-2e30-4221-b53f-1f14e390520e tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3422074 Dec 21 03:45:57.630828 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-7b0ab0f3-b52b-4734-bb30-944497862e5c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=310284e4-97b1-4722-9326-ad03ce2e793c HTTP/1.1" status: 200 len: 217 time: 0.1151686 Dec 21 03:45:57.675110 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:45:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd39d7e7-229c-4898-a587-6bcc642cf5ff x-openstack-request-id: req-fd39d7e7-229c-4898-a587-6bcc642cf5ff {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:45:57.676070 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-plugged", "status": "completed", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:45:57.676434 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fd39d7e7-229c-4898-a587-6bcc642cf5ff {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:45:57.677678 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'code': 200} Dec 21 03:45:57.693437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58930ca4-5fcd-4850-8918-0d3739aa1d34 req-8367658d-b553-4e71-bc90-862f3f032027 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1734900 Dec 21 03:45:57.741114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577e6f15-051c-4d1b-806f-180626d17325 req-866edddc-6490-40fb-82d8-6c8264cbd868 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.742697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-866edddc-6490-40fb-82d8-6c8264cbd868 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=48142ae2-dce2-450f-96ff-f72f7dcd96bb HTTP/1.1" status: 200 len: 854 time: 0.0989587 Dec 21 03:45:57.803413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577e6f15-051c-4d1b-806f-180626d17325 req-aac823a5-635c-40bf-89ad-5b97d1e5ff92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.805343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-aac823a5-635c-40bf-89ad-5b97d1e5ff92 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0469363 Dec 21 03:45:57.821328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:45:57.841091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:45:57.917400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7393b086-8581-4d20-8fff-4bb6f1e5b596 req-889f0fee-ac40-4734-a80e-508b365b8707 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:57.919423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7393b086-8581-4d20-8fff-4bb6f1e5b596 req-889f0fee-ac40-4734-a80e-508b365b8707 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1349909 Dec 21 03:45:57.983672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:57.995455 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-d0d68ae8-dbf3-4292-a4d8-0d4ffd587880 service neutron] 10.222.0.31 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1717944 Dec 21 03:45:58.089749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d32bf9-6cb9-410a-ad44-964adab4077f req-32e6e491-4834-408d-bc27-3d651966b895 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:58.097644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3d32bf9-6cb9-410a-ad44-964adab4077f req-32e6e491-4834-408d-bc27-3d651966b895 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1604996 Dec 21 03:45:58.105845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7393b086-8581-4d20-8fff-4bb6f1e5b596 req-3aa1253b-5c58-4639-ba98-9f5d4f3ef1d3 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1778653 Dec 21 03:45:58.121789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-577e6f15-051c-4d1b-806f-180626d17325 req-0d70583b-192e-4233-b848-f53b05065090 service neutron] 10.222.0.31 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1096787 Dec 21 03:45:58.177832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:58.197422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'mac_address': 'fa:16:3e:61:86:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:45:58.239091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3d32bf9-6cb9-410a-ad44-964adab4077f req-bbf361b0-5963-4596-8dd7-3406e99aa2da tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302555 Dec 21 03:45:58.273022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:58.307850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:58.321628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:58.342969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:58.366002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96668c5e-1a6f-4202-be40-49b16e114a90 req-7950f105-b571-4943-8ec5-06a0942f6f7e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:58.367514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96668c5e-1a6f-4202-be40-49b16e114a90 req-7950f105-b571-4943-8ec5-06a0942f6f7e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.1796055 Dec 21 03:45:58.391638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:58.464851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c46c082-f989-4727-9691-eb54ab75dca8 req-56a804bd-d71e-4bb4-9f16-e671ea96ae7d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:58.466023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c46c082-f989-4727-9691-eb54ab75dca8 req-56a804bd-d71e-4bb4-9f16-e671ea96ae7d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.1447740 Dec 21 03:45:58.467504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:45:58.468375 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:45:58.471800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:58.495537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Router 8bc1a5c7-d429-47c0-a284-10ec8773981e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:45:58.505795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96668c5e-1a6f-4202-be40-49b16e114a90 req-b5045d1b-1e55-4297-b714-9fa42d40eaee tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304593 Dec 21 03:45:58.575153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c46c082-f989-4727-9691-eb54ab75dca8 req-2bfa9135-2e41-4ba1-861f-c36e65d8cca0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986414 Dec 21 03:45:58.709420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f636d5c-caec-4325-b093-e08533bf2a2a req-b7e5cb40-3360-413e-8ba7-b98026c579af tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:58.710993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f636d5c-caec-4325-b093-e08533bf2a2a req-b7e5cb40-3360-413e-8ba7-b98026c579af tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1097 time: 0.1240728 Dec 21 03:45:58.717365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:45:58.726229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f63f7b36-507d-44c9-9b6f-3918f5aa0a3b admin admin] 10.222.0.18 "PUT /v2.0/routers/8bc1a5c7-d429-47c0-a284-10ec8773981e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0923955 Dec 21 03:45:58.726557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44522) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:45:58.728709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] Sync routers for ids ['8bc1a5c7-d429-47c0-a284-10ec8773981e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:45:58.741846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] Routers {'8bc1a5c7-d429-47c0-a284-10ec8773981e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:58.743307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8bc1a5c7-d429-47c0-a284-10ec8773981e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:58.755964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2660b8-30f1-4513-890a-33cc9f88c7bf req-dff9659d-4536-4034-b4d0-ff60b39bdc98 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:58.766614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb2660b8-30f1-4513-890a-33cc9f88c7bf req-dff9659d-4536-4034-b4d0-ff60b39bdc98 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 948 time: 0.1038218 Dec 21 03:45:58.793677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cf770d29-1c69-4f15-b07a-7cd04c2724a4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:45:58.838657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb2660b8-30f1-4513-890a-33cc9f88c7bf req-50033947-7681-4d1f-a580-a36e3b8c7f94 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667806 Dec 21 03:45:58.902246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:58.920325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f636d5c-caec-4325-b093-e08533bf2a2a req-cd9460d3-cf55-4727-b9d9-c6c77cb3bc42 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2001176 Dec 21 03:45:58.954220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] Set router 8bc1a5c7-d429-47c0-a284-10ec8773981e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:59.052600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.093326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71295cf4-1b9f-4b80-aac7-3f210d2403ed req-027538d9-a8de-43d0-b5bd-a5082f2c4ff1 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:59.095432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71295cf4-1b9f-4b80-aac7-3f210d2403ed req-027538d9-a8de-43d0-b5bd-a5082f2c4ff1 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.0843706 Dec 21 03:45:59.106583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.140571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:45:59.165608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71295cf4-1b9f-4b80-aac7-3f210d2403ed req-b7b26097-cce9-4674-a259-4641c5c621c8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0625243 Dec 21 03:45:59.196692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:59.254640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Deleting port b3a5d380-a58f-4030-b88c-87371f69b18a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:45:59.255954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.271383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.338242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:59.343091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:57Z', 'revision_number': 5, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port': {'id': 'b3a5d380-a58f-4030-b88c-87371f69b18a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:23:e2:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 570, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:45:44Z', 'updated_at': '2021-12-21T03:45:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:59.385525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] Checking router: 8bc1a5c7-d429-47c0-a284-10ec8773981e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:45:59.395599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] For port b3a5d380-a58f-4030-b88c-87371f69b18a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b3a5d380-a58f-4030-b88c-87371f69b18a,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:45:59.396138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] Routers {'8bc1a5c7-d429-47c0-a284-10ec8773981e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:45:59.396260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.397021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8bc1a5c7-d429-47c0-a284-10ec8773981e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:59.406825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cec9c7e-2b7d-49c1-b8b0-b61ee387ed77 req-f1cc9fa1-6f77-4a5c-aa4c-bc642a1b3187 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:59.408930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cec9c7e-2b7d-49c1-b8b0-b61ee387ed77 req-f1cc9fa1-6f77-4a5c-aa4c-bc642a1b3187 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 948 time: 0.0992675 Dec 21 03:45:59.427261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Calling delete_port for b3a5d380-a58f-4030-b88c-87371f69b18a owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:45:59.511611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cec9c7e-2b7d-49c1-b8b0-b61ee387ed77 req-fdb96fe3-23c7-4adb-81c0-1820c0b2f688 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0949221 Dec 21 03:45:59.525784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] Set router 8bc1a5c7-d429-47c0-a284-10ec8773981e gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:45:59.602004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:59Z', 'revision_number': 6, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:45:59.639673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec3ce0ae-1d95-4870-861a-8313b0d65351 None None] The sync data for ids ['8bc1a5c7-d429-47c0-a284-10ec8773981e'] in n-d-822053-11 is: [{'id': '8bc1a5c7-d429-47c0-a284-10ec8773981e', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-2101439553-router', 'tenant_id': '601d004f9a144ac985592abc4d3dfcbc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:45:43Z', 'updated_at': '2021-12-21T03:45:59Z', 'revision_number': 6, 'project_id': '601d004f9a144ac985592abc4d3dfcbc', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:45:59.692852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-9924adec-cc0b-45b8-a910-c019b5d7b8fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0375638 Dec 21 03:45:59.815815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:45:59.825714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-b8529fc6-62d2-4a27-ad1c-a73431f72fc3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:45:59.827789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-b8529fc6-62d2-4a27-ad1c-a73431f72fc3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1339288 Dec 21 03:45:59.843168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.846771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-441fc6c3-a98d-499d-ab3d-c4cee733fa2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/quotas/408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 375 time: 0.0127249 Dec 21 03:45:59.893918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Pushing event deleted for resources: {'Port': ['ID=b3a5d380-a58f-4030-b88c-87371f69b18a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:45:59.969127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:45:59.988227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port eccc8c5c-70cc-45fa-b816-4e666ed149dd completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:45:59.996278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port eccc8c5c-70cc-45fa-b816-4e666ed149dd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:45:59.997210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.011184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-32d46fb6-0f99-41f3-835c-6b3db781f406 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1578593 Dec 21 03:46:00.054461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4285e2cb-2685-4b87-9400-cea5075a1580 req-2d5d914d-c986-45cd-84da-d22e2fe9fc18 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:00.059896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4285e2cb-2685-4b87-9400-cea5075a1580 req-2d5d914d-c986-45cd-84da-d22e2fe9fc18 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 948 time: 0.1443253 Dec 21 03:46:00.121598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.126880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.170248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4285e2cb-2685-4b87-9400-cea5075a1580 req-aff0a4cf-d482-4f23-a170-2a17aec41c20 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064768 Dec 21 03:46:00.204508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22d08d87-fed0-40a6-83de-294c37165d6b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:00.246428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 22d08d87-fed0-40a6-83de-294c37165d6b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:46:00.246922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22d08d87-fed0-40a6-83de-294c37165d6b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:46:00.256881 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.271434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.271964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8bc1a5c7-d429-47c0-a284-10ec8773981e {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:46:00.278289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.282443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44570) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:00.296139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa898c2d-d169-402a-ac8a-fd2849d268fd admin admin] 10.222.0.18 "DELETE /v2.0/routers/8bc1a5c7-d429-47c0-a284-10ec8773981e HTTP/1.1" status: 204 len: 168 time: 1.5683947 Dec 21 03:46:00.308972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:00.344598 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e8ad6cb-c243-4fc8-a5c7-51558c4450ee" -d '{"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-plugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:00.393114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:00.410110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Deleting subnet a24d8f8f-087d-42bd-ac2a-2cdb7329426e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:46:00.433851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.442883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.514562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:00.528000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bbcf1e2-9eca-4836-922b-10f8e355a17f req-e007f8cd-8aed-4a13-a921-86ad5d136225 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 210 time: 0.0952857 Dec 21 03:46:00.547552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.623534 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c59fae91-fba3-418b-afa2-b2a758fb3085 x-openstack-request-id: req-c59fae91-fba3-418b-afa2-b2a758fb3085 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:00.624325 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-plugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:00.624730 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c59fae91-fba3-418b-afa2-b2a758fb3085 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:00.625298 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'code': 200} Dec 21 03:46:00.667617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9180228b-c3a7-4d98-a311-447b287965a6 req-c929d462-ee53-4da3-b6b9-6aca27bb85a8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:00.680803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9180228b-c3a7-4d98-a311-447b287965a6 req-c929d462-ee53-4da3-b6b9-6aca27bb85a8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.2634196 Dec 21 03:46:00.746254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:00.830495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9180228b-c3a7-4d98-a311-447b287965a6 req-7f07d0d3-b21a-41f5-8e1e-442e338baa6f tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1482337 Dec 21 03:46:00.848079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe1d591-f9e9-4281-84d7-be140d1b466d req-9b920c1f-e9e8-4db5-9dfb-d3c4a368df43 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:00.849648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbe1d591-f9e9-4281-84d7-be140d1b466d req-9b920c1f-e9e8-4db5-9dfb-d3c4a368df43 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 948 time: 0.1537220 Dec 21 03:46:00.862009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c4c22f-f2f2-4e3f-ad5a-642428d3a05d req-eff497c0-53e5-43a0-b574-4ba5166fccf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:00.869280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-03c4c22f-f2f2-4e3f-ad5a-642428d3a05d req-eff497c0-53e5-43a0-b574-4ba5166fccf2 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 1101 time: 0.1070154 Dec 21 03:46:00.934361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbe1d591-f9e9-4281-84d7-be140d1b466d req-0afd6987-2000-4944-a065-347a3056218a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761693 Dec 21 03:46:00.953005 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-03c4c22f-f2f2-4e3f-ad5a-642428d3a05d req-73e98b97-f37d-443f-96bb-ae8acd74fcd1 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727966 Dec 21 03:46:00.998117 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.017547 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.017547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/a24d8f8f-087d-42bd-ac2a-2cdb7329426e HTTP/1.1" status: 204 len: 168 time: 0.7340655 Dec 21 03:46:01.020535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:01.032417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-865b2916-4903-44cd-9efe-409dadfee301 None None] Network 98282c17-34d3-411f-a67f-a04e2e9118d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:01.059793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d10f56-9b64-4f1b-9f6a-78ab3cad58c9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a24d8f8f-087d-42bd-ac2a-2cdb7329426e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:01.152885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.233454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] DHCP port deletion for 98282c17-34d3-411f-a67f-a04e2e9118d9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:46:01.242914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Deleting port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:46:01.243291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.314424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e782d30c-1e57-42c8-b4bc-ecef5821455e req-757e484b-1c76-429d-aece-91bc54a84aef tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:01.316320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e782d30c-1e57-42c8-b4bc-ecef5821455e req-757e484b-1c76-429d-aece-91bc54a84aef tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 949 time: 0.0732377 Dec 21 03:46:01.333976 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] Deleting port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:46:01.334348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.374155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] For port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:01.376497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.409470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Calling delete_port for 7be597c9-1c9a-4d3e-bd36-e295e3d198fa owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:46:01.418585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e782d30c-1e57-42c8-b4bc-ecef5821455e req-912c85d2-bb9c-4696-9542-327fbd0297c1 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945866 Dec 21 03:46:01.467763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] For port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,segment=NetworkSegment(65c18066-7cae-4372-80d2-c4b2caf0f73a),segment_id=65c18066-7cae-4372-80d2-c4b2caf0f73a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:01.468237 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.484181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] Calling delete_port for 7be597c9-1c9a-4d3e-bd36-e295e3d198fa owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:46:01.648777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.656762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.666708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0741f330-0bd9-4f1c-9deb-d8be9c5262e4 req-4d9cc2e7-de08-44ec-ba55-86047f63a4b4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 210 time: 0.0520470 Dec 21 03:46:01.673085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] No DVR routers for this DVR port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:46:01.720284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924cd621-97e9-4191-a4a8-d6486c947285 None None] Pushing event deleted for resources: {'Port': ['ID=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:01.729986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] No DVR routers for this DVR port 7be597c9-1c9a-4d3e-bd36-e295e3d198fa on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:46:01.732381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Pushing event deleted for resources: {'Port': ['ID=7be597c9-1c9a-4d3e-bd36-e295e3d198fa,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:01.822910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:01.832663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.861620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['98282c17-34d3-411f-a67f-a04e2e9118d9']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:01.873674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65c18066-7cae-4372-80d2-c4b2caf0f73a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:01.875244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65c18066-7cae-4372-80d2-c4b2caf0f73a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:01.895488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.909901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.917361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:46:01.917984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.942196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port cf770d29-1c69-4f15-b07a-7cd04c2724a4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:01.942585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:01.976711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7be597c9-1c9a-4d3e-bd36-e295e3d198fa no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:02.013010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7be597c9-1c9a-4d3e-bd36-e295e3d198fa {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:46:02.013373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7be597c9-1c9a-4d3e-bd36-e295e3d198fa not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:46:02.013867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3a5d380-a58f-4030-b88c-87371f69b18a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.020398 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:46:02.023085 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:46:02.025373 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:46:02.044591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b3a5d380-a58f-4030-b88c-87371f69b18a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:46:02.045292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3a5d380-a58f-4030-b88c-87371f69b18a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:46:02.073128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ef858e-a9c2-4446-8cf5-990b5c675560 req-51da5f22-0802-4c7b-951e-a2e8c11c2195 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:02.074605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5ef858e-a9c2-4446-8cf5-990b5c675560 req-51da5f22-0802-4c7b-951e-a2e8c11c2195 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.1142533 Dec 21 03:46:02.085249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5464be0f-d1cf-4e16-b884-2f399669310d req-3ce85214-ef84-488b-9228-086358d78a21 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:02.086699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5464be0f-d1cf-4e16-b884-2f399669310d req-3ce85214-ef84-488b-9228-086358d78a21 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 948 time: 0.0702040 Dec 21 03:46:02.109634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.116894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.136820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.140206 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] 10.222.0.18 "DELETE /v2.0/networks/98282c17-34d3-411f-a67f-a04e2e9118d9 HTTP/1.1" status: 204 len: 168 time: 1.1182945 Dec 21 03:46:02.158679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1fbca8-3e7a-4027-b9cd-c990bd993394 admin admin] Pushing event deleted for resources: {'Network': ['ID=98282c17-34d3-411f-a67f-a04e2e9118d9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:02.170104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5ef858e-a9c2-4446-8cf5-990b5c675560 req-333d7709-a5cf-4b9c-9a11-8bf03e207aa5 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0822191 Dec 21 03:46:02.176010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:02.213667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.215328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5464be0f-d1cf-4e16-b884-2f399669310d req-d7a5a982-aeb7-49a7-8def-3be23fd0a977 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116762 Dec 21 03:46:02.277246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:02.564495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87cee016-84d5-44b1-9353-0bd9543ffe7d req-3d9dabbf-4808-4d23-a497-dea21bbfee06 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:02.576102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87cee016-84d5-44b1-9353-0bd9543ffe7d req-3d9dabbf-4808-4d23-a497-dea21bbfee06 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 949 time: 0.0892050 Dec 21 03:46:02.627071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:02.629839 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-607f8ead-b0f5-43a3-bc3a-f9ab7eb98ad8" -d '{"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-plugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:02.667984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44620) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:02.676563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87cee016-84d5-44b1-9353-0bd9543ffe7d req-15901fb5-1e50-4207-a551-ffeeffce6e35 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994244 Dec 21 03:46:02.729757 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-15a179d0-3bbf-4ae4-92e4-3f20c265db91 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=601d004f9a144ac985592abc4d3dfcbc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0602248 Dec 21 03:46:02.732405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44626) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:02.742435 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7da1620-b1ed-4e67-bf9b-81c234cf9aa2 x-openstack-request-id: req-e7da1620-b1ed-4e67-bf9b-81c234cf9aa2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:02.743498 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-plugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:02.743928 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e7da1620-b1ed-4e67-bf9b-81c234cf9aa2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:02.744472 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'code': 200} Dec 21 03:46:02.819340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9af30357-7751-4da9-934d-2da346592566 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.835514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c411dbca-86e2-4479-93ed-423cb991bba5 req-5942d1ff-6c89-4d48-a4bc-d9f189ffb1af tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 210 time: 0.0303855 Dec 21 03:46:02.862838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9af30357-7751-4da9-934d-2da346592566 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.986828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9af30357-7751-4da9-934d-2da346592566 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.990060 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9af30357-7751-4da9-934d-2da346592566 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:02.994059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9af30357-7751-4da9-934d-2da346592566 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0b71bc5d-184c-4f79-a438-b593c8d976fe HTTP/1.1" status: 204 len: 168 time: 0.2565403 Dec 21 03:46:03.017351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af30357-7751-4da9-934d-2da346592566 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b71bc5d-184c-4f79-a438-b593c8d976fe,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:03.036421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-5a864888-9acf-46c0-9665-80e2f60618f3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0391731 Dec 21 03:46:03.143492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e393c7f-f2ed-4612-9c50-582b53d8e938 req-92ab7c7c-11bd-479c-b882-236290a92237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:03.153592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e393c7f-f2ed-4612-9c50-582b53d8e938 req-92ab7c7c-11bd-479c-b882-236290a92237 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1102 time: 0.0982308 Dec 21 03:46:03.194164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-95a4e175-2cf3-48e1-8eef-eb8488bd24b4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:03.196280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-95a4e175-2cf3-48e1-8eef-eb8488bd24b4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1242175 Dec 21 03:46:03.213423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e393c7f-f2ed-4612-9c50-582b53d8e938 req-b5749722-de88-4c7d-b838-24b7a9a9c3f4 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573328 Dec 21 03:46:03.525912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Request body: {'port': {'device_id': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '408f05064a77442595f2b5d444671b8a'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:03.790786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Made reservation on behalf of 408f05064a77442595f2b5d444671b8a for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:03.800993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:03.820200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2484402-d08a-4ee8-96d1-3cca670f8793 req-11ae9b1b-6a6f-4f16-b9fc-962d63a9016a tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:03.828343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2484402-d08a-4ee8-96d1-3cca670f8793 req-11ae9b1b-6a6f-4f16-b9fc-962d63a9016a tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.5698450 Dec 21 03:46:03.851643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875f629e-ad0d-4606-b02c-3f84f6f7f93b req-3950a0c4-29c6-40cc-97c4-bbb33b759438 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:03.853435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-875f629e-ad0d-4606-b02c-3f84f6f7f93b req-3950a0c4-29c6-40cc-97c4-bbb33b759438 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1338310 Dec 21 03:46:03.961302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2484402-d08a-4ee8-96d1-3cca670f8793 req-5e0c21aa-56c4-42b4-a0fc-ed897aabeb18 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1275706 Dec 21 03:46:04.042197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-875f629e-ad0d-4606-b02c-3f84f6f7f93b req-176e3808-1d60-40e9-a07a-6dc245d53a8d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1748686 Dec 21 03:46:04.097224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Allocated IP 192.168.233.114 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/52f73cf2-b045-4f07-b974-6c29f7b35de0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:04.230009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ebc21f-1617-4380-ac3f-d4065958f3eb req-a0241d3a-752f-42c8-85b1-d06ead891d54 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:04.240878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75ebc21f-1617-4380-ac3f-d4065958f3eb req-a0241d3a-752f-42c8-85b1-d06ead891d54 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 949 time: 0.1132710 Dec 21 03:46:04.346104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75ebc21f-1617-4380-ac3f-d4065958f3eb req-993a7592-39c9-4e3e-aeb5-55390cdcb444 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0988338 Dec 21 03:46:04.421922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50c7bf3c-82a9-4fee-81b4-70aac1b258db req-43935572-5a07-4553-bb22-8744b1c67646 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 210 time: 0.0860803 Dec 21 03:46:04.447444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:04.597622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:04.655879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641', '4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:04.773039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:04.782054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:04.782647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:04.785327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:04.909378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:04.910051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:05.045156 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-51cf6d6f-f4b4-4376-a096-d13774eeb5b3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.5259972 Dec 21 03:46:05.067730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Request body: {'port': {'device_id': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:05.212961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:05.291478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-012742b7-7d2c-4034-9a77-3bd4d645fb99 None None] Provisioning complete for port 52f73cf2-b045-4f07-b974-6c29f7b35de0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:05.294879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-012742b7-7d2c-4034-9a77-3bd4d645fb99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:05.352257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-012742b7-7d2c-4034-9a77-3bd4d645fb99 None None] Port 52f73cf2-b045-4f07-b974-6c29f7b35de0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:05.368700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a91e2c2-d190-4629-9d22-86cebc350b16 req-887bf14f-1f19-4c0d-a5c5-1b1e54a9b83b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:05.376253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a91e2c2-d190-4629-9d22-86cebc350b16 req-887bf14f-1f19-4c0d-a5c5-1b1e54a9b83b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.0985587 Dec 21 03:46:05.422720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65370f3e-ca70-483b-bb29-e75e3166e6c4 req-bd97b637-d175-454a-991d-2528ca33e5ac tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:05.424310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65370f3e-ca70-483b-bb29-e75e3166e6c4 req-bd97b637-d175-454a-991d-2528ca33e5ac tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1034501 Dec 21 03:46:05.462748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a91e2c2-d190-4629-9d22-86cebc350b16 req-038f50d2-830c-488b-963f-1c0a90e17f8a tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0849214 Dec 21 03:46:05.516232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65370f3e-ca70-483b-bb29-e75e3166e6c4 req-2e2e5ddc-fab8-4fdb-9495-d8932e2d0557 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839698 Dec 21 03:46:05.562249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 52f73cf2-b045-4f07-b974-6c29f7b35de0 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:05.572980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:05.601392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Transition to ACTIVE for port object 52f73cf2-b045-4f07-b974-6c29f7b35de0 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:05.682198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:05.793115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04782af6-6d52-493c-84ce-d69a5715ef98 req-73aff5c2-279c-4a4c-898b-37fa602cd1cc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:05.794612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04782af6-6d52-493c-84ce-d69a5715ef98 req-73aff5c2-279c-4a4c-898b-37fa602cd1cc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 936 time: 0.1276076 Dec 21 03:46:05.813073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116292c1-6cde-4041-9dea-623a3593a378 req-ac2d89e6-384c-4b79-9cff-1aef5d240f4b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:05.821176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-116292c1-6cde-4041-9dea-623a3593a378 req-ac2d89e6-384c-4b79-9cff-1aef5d240f4b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1022661 Dec 21 03:46:05.826773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:05.914107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-116292c1-6cde-4041-9dea-623a3593a378 req-4646ad95-89ea-4bd6-8cd2-2e1d711e24f9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905125 Dec 21 03:46:05.922335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04782af6-6d52-493c-84ce-d69a5715ef98 req-b33dc40f-ebae-4b72-bd64-c32629e30a63 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182852 Dec 21 03:46:05.938270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Attempting to bind port 52f73cf2-b045-4f07-b974-6c29f7b35de0 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:05.938580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Attempting to bind port 52f73cf2-b045-4f07-b974-6c29f7b35de0 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:05.939392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Attempting to bind port 52f73cf2-b045-4f07-b974-6c29f7b35de0 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:05.954635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Port 52f73cf2-b045-4f07-b974-6c29f7b35de0 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:05.954977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Attempting to bind port 52f73cf2-b045-4f07-b974-6c29f7b35de0 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:05.983517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:05.985051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:05.989070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:05.989685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Bound port: 52f73cf2-b045-4f07-b974-6c29f7b35de0, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:05.990116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:06.115075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:06.132497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:06.214416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:06.250419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:06.252713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:06.252713 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] 10.222.0.54 "PUT /v2.0/ports/52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 1097 time: 1.1909013 Dec 21 03:46:06.253258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:06.255644 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4affa41e-ca98-4e61-a660-bf9a0b29f682" -d '{"events": [{"name": "network-changed", "server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:06.299872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a57d39-1201-4678-9eff-60a702fd4c8e service neutron] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:06.323778 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60dffde6-be7d-43d4-8453-8b695b29a457 x-openstack-request-id: req-60dffde6-be7d-43d4-8453-8b695b29a457 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:06.324324 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:06.324590 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-60dffde6-be7d-43d4-8453-8b695b29a457 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:06.324998 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'status': 'completed', 'code': 200} Dec 21 03:46:06.456092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4affa41e-ca98-4e61-a660-bf9a0b29f682 req-8e36ac5b-6bce-425a-ba8d-8774f9bdd2a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:06.458251 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4affa41e-ca98-4e61-a660-bf9a0b29f682 req-8e36ac5b-6bce-425a-ba8d-8774f9bdd2a5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1100 time: 0.0666895 Dec 21 03:46:06.524822 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4affa41e-ca98-4e61-a660-bf9a0b29f682 req-242a0191-775a-4a18-9338-18ed474d7464 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0483904 Dec 21 03:46:06.641103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2ca244-c58e-4f8d-b5f5-d31f64e2fa66 req-08836fd7-8060-469c-9d27-efce532c99a8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:06.653398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a2ca244-c58e-4f8d-b5f5-d31f64e2fa66 req-08836fd7-8060-469c-9d27-efce532c99a8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.0877039 Dec 21 03:46:06.698923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4affa41e-ca98-4e61-a660-bf9a0b29f682 req-cd11d854-7dfb-4509-b00f-dd1ee0044fa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:06.700491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4affa41e-ca98-4e61-a660-bf9a0b29f682 req-cd11d854-7dfb-4509-b00f-dd1ee0044fa4 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1660094 Dec 21 03:46:06.768651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a2ca244-c58e-4f8d-b5f5-d31f64e2fa66 req-11c0c3e1-1d40-4b84-b94e-4c6b77c3b2aa tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1143515 Dec 21 03:46:06.806489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a29a235-27c7-4d7b-a563-ce48221ac7c3 req-4bd79497-8ad5-44af-9221-0c87b8c7f793 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:06.814299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a29a235-27c7-4d7b-a563-ce48221ac7c3 req-4bd79497-8ad5-44af-9221-0c87b8c7f793 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1565762 Dec 21 03:46:06.857609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44774) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:06.884781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-7675e1aa-07af-4c2b-9adc-6a7f33a964cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:06.886985 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-7675e1aa-07af-4c2b-9adc-6a7f33a964cb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1100 time: 0.0661383 Dec 21 03:46:06.940890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a29a235-27c7-4d7b-a563-ce48221ac7c3 req-c5bfa7a8-9001-49b3-82da-5fbd384cbd98 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137037 Dec 21 03:46:07.003925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-e05ae434-59cb-4150-9a4b-de686789d46f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.114&port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 217 time: 0.0830071 Dec 21 03:46:07.115998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f04f5b9b-5529-4365-adb6-9b8e9d13fa8c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.122959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af218bf6-465b-4e1a-9041-83b12fc1be39 req-5f3e344b-b18f-4e67-be5c-50327e902cae tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:07.131910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af218bf6-465b-4e1a-9041-83b12fc1be39 req-5f3e344b-b18f-4e67-be5c-50327e902cae tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.1019254 Dec 21 03:46:07.140507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-703404c8-40be-4af0-9e00-cb2834ca2828 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:07.142527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-703404c8-40be-4af0-9e00-cb2834ca2828 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1299264 Dec 21 03:46:07.191234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af218bf6-465b-4e1a-9041-83b12fc1be39 req-c85708af-1b4f-4cb8-af9d-191d66c47cf7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545888 Dec 21 03:46:07.216416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-6a8a3bce-5907-4059-a661-0afcf5188613 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:07.218010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-6a8a3bce-5907-4059-a661-0afcf5188613 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0669494 Dec 21 03:46:07.326629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f04f5b9b-5529-4365-adb6-9b8e9d13fa8c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.361919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-05d45395-65f7-4121-92bf-c8f7c9b11117 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1144097 Dec 21 03:46:07.385227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f04f5b9b-5529-4365-adb6-9b8e9d13fa8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.496543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f04f5b9b-5529-4365-adb6-9b8e9d13fa8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a91bb7d-df51-477a-9743-c47e43f74bff,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:07.502901 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f04f5b9b-5529-4365-adb6-9b8e9d13fa8c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=005673c9a1e34ecf95a67e11be9bc07f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6439126 Dec 21 03:46:07.505697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44790) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:07.563192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0215b580-8754-4748-96ad-a9bf3e8e018b req-4fcb673b-9f4c-4b3d-94e3-55f20a56a856 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1574483 Dec 21 03:46:07.577352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3d4e221-9ba3-4cd4-8990-a724fa4ea9fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.600337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3d4e221-9ba3-4cd4-8990-a724fa4ea9fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.722483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3d4e221-9ba3-4cd4-8990-a724fa4ea9fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.725378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3d4e221-9ba3-4cd4-8990-a724fa4ea9fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:07.726543 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f3d4e221-9ba3-4cd4-8990-a724fa4ea9fb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6a91bb7d-df51-477a-9743-c47e43f74bff HTTP/1.1" status: 204 len: 168 time: 0.2200897 Dec 21 03:46:07.746127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d4e221-9ba3-4cd4-8990-a724fa4ea9fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a91bb7d-df51-477a-9743-c47e43f74bff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:07.866238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:07.961108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59897c6e-f72b-49b0-ac1d-17a0121bfdf0 req-c72eacc4-5a53-481d-a3c3-b81ecd23006e tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:07.962639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59897c6e-f72b-49b0-ac1d-17a0121bfdf0 req-c72eacc4-5a53-481d-a3c3-b81ecd23006e tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.0864367 Dec 21 03:46:08.065688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59897c6e-f72b-49b0-ac1d-17a0121bfdf0 req-3a9ebf8f-c86a-40ba-84b1-2dcc1a4cc6b4 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0826042 Dec 21 03:46:08.066334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:08.080864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'mac_address': 'fa:16:3e:56:8d:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:08.153897 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:08.159117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68200cb2-fbef-4ec6-ba77-8081f5c37663 req-4868d3e8-ed7c-4ee7-adac-7ae363408104 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:08.160772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68200cb2-fbef-4ec6-ba77-8081f5c37663 req-4868d3e8-ed7c-4ee7-adac-7ae363408104 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1246932 Dec 21 03:46:08.185653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id eccc8c5c-70cc-45fa-b816-4e666ed149dd {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:08.242051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68200cb2-fbef-4ec6-ba77-8081f5c37663 req-44fb6ed6-c65c-4813-8001-2a33fbb550d3 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665364 Dec 21 03:46:08.249573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:08.383963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f75d23e-f78e-49bc-8666-007c5e312c0d req-b223d065-bbb0-414a-b1ad-ec0abb78fa2c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:08.386140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f75d23e-f78e-49bc-8666-007c5e312c0d req-b223d065-bbb0-414a-b1ad-ec0abb78fa2c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.0539472 Dec 21 03:46:08.402471 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:08.439297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f75d23e-f78e-49bc-8666-007c5e312c0d req-8ec1a9a6-8646-440a-a393-efdcaff5d253 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476952 Dec 21 03:46:08.474505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:08.642499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['eccc8c5c-70cc-45fa-b816-4e666ed149dd'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:09.172367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44848) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:09.172367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Request body: {'network': {'name': 'tempest-ImagesOneServerNegativeTestJSON-1519846830-network', 'tenant_id': '7a49d4228d05498db20fade9b7651659'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:09.218821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d772dce-c57a-48db-b90f-5c90129b87a6 req-41df3b12-137a-40f6-9b0a-dcea0b806c14 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:09.218821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d772dce-c57a-48db-b90f-5c90129b87a6 req-41df3b12-137a-40f6-9b0a-dcea0b806c14 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.0785575 Dec 21 03:46:09.299645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d772dce-c57a-48db-b90f-5c90129b87a6 req-ad033bef-cf2b-440d-9275-6080bf2d1bc0 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0731537 Dec 21 03:46:09.441240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9995824f-6018-4c84-96f9-d9e4f2e781ef req-68848c26-1bed-48de-a0ed-97a80c8a2319 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:09.446782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9995824f-6018-4c84-96f9-d9e4f2e781ef req-68848c26-1bed-48de-a0ed-97a80c8a2319 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0672338 Dec 21 03:46:09.509719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9995824f-6018-4c84-96f9-d9e4f2e781ef req-40074e35-9168-4479-a11a-9015c7a0d371 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566342 Dec 21 03:46:09.556707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Made reservation on behalf of 7a49d4228d05498db20fade9b7651659 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:09.560109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:09.580078 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:09.829035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:09.868568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf05b120-5892-4ae1-8bb9-0885a8aac641 req-1b81ff60-ac4c-475b-a0d0-686f31ceaf26 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:09.881304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf05b120-5892-4ae1-8bb9-0885a8aac641 req-1b81ff60-ac4c-475b-a0d0-686f31ceaf26 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.1941669 Dec 21 03:46:09.896961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:09.916567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:09.984200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1873ffb-f366-40cc-998e-567b08c2283c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:10.085319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:46:10.148952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.149797 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Added segment 01718413-2838-40fe-a380-2d2cdba03082 of type vlan for network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 Dec 21 03:46:10.165904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 310284e4-97b1-4722-9326-ad03ce2e793c details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:10.170166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf05b120-5892-4ae1-8bb9-0885a8aac641 req-661abc88-2156-49d2-a3b3-682318105d53 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2876868 Dec 21 03:46:10.220196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcded5b1-c206-4a52-85a5-8708d73ef3d2 req-ab111b73-2b6c-47be-ae6c-600cc6b0fd05 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:10.225443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcded5b1-c206-4a52-85a5-8708d73ef3d2 req-ab111b73-2b6c-47be-ae6c-600cc6b0fd05 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 945 time: 0.2448447 Dec 21 03:46:10.304373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.387287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port eccc8c5c-70cc-45fa-b816-4e666ed149dd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:10.387708 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.426924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcded5b1-c206-4a52-85a5-8708d73ef3d2 req-3208aa1c-f2c3-4058-a1d0-e34739a34df6 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1936851 Dec 21 03:46:10.487751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bd8cf7-eaad-4abe-9c03-d2920d71d078 req-ad71fa95-c964-42a2-b839-a243979d2924 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:10.494998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46bd8cf7-eaad-4abe-9c03-d2920d71d078 req-ad71fa95-c964-42a2-b839-a243979d2924 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 943 time: 0.0642984 Dec 21 03:46:10.512353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.513325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:10.513945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.518144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 310284e4-97b1-4722-9326-ad03ce2e793c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=310284e4-97b1-4722-9326-ad03ce2e793c,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:10.539989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '310284e4-97b1-4722-9326-ad03ce2e793c', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'port_id': '310284e4-97b1-4722-9326-ad03ce2e793c', 'mac_address': 'fa:16:3e:49:72:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:10.606150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] Pushing event updated for resources: {'Network': ['ID=7c34a09c-fe79-4a56-ac99-3b531a9f3f91,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:10.626007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:10.633307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Request body: {'subnet': {'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImagesOneServerNegativeTestJSON-1519846830-subnet', 'tenant_id': '7a49d4228d05498db20fade9b7651659', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:10.644623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38b7561b-2679-4fc4-9ec3-a6870fb97539 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 895 time: 1.6232135 Dec 21 03:46:10.647761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:46:10.685610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.695981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.722515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46bd8cf7-eaad-4abe-9c03-d2920d71d078 req-b659a5df-e799-4efa-b163-3b4c12be91ba tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2264168 Dec 21 03:46:10.741414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Made reservation on behalf of 7a49d4228d05498db20fade9b7651659 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:10.744166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:10.769086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 310284e4-97b1-4722-9326-ad03ce2e793c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:10.840783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:10.842819 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6aa4ee4-4333-41b3-ba40-bc3185627f05" -d '{"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-plugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:10.846767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c61c615-715a-4baa-a4ad-76975d7e470e req-c8657ff1-d40c-4ee8-abad-7c93c43bbd08 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:10.849055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c61c615-715a-4baa-a4ad-76975d7e470e req-c8657ff1-d40c-4ee8-abad-7c93c43bbd08 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0796638 Dec 21 03:46:10.931345 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f9481db-faa4-400e-86ad-3292c9532667 x-openstack-request-id: req-9f9481db-faa4-400e-86ad-3292c9532667 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:10.939744 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-plugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:10.939744 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9f9481db-faa4-400e-86ad-3292c9532667 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:10.939744 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'code': 200} Dec 21 03:46:10.939744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:10.939744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 310284e4-97b1-4722-9326-ad03ce2e793c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=310284e4-97b1-4722-9326-ad03ce2e793c,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:10.977469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c61c615-715a-4baa-a4ad-76975d7e470e req-f6022de1-3ebd-4584-b8b5-124d5f8a354f tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163480 Dec 21 03:46:11.008244 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:11.050100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:11.078514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:11.145384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:11.158750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=310284e4-97b1-4722-9326-ad03ce2e793c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:11.214156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ec8e3a7f-1bef-41ac-8b72-508d262fe30c,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:11.232559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Checking segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:11.233458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Network hostable DHCP agents. Network: 7c34a09c-fe79-4a56-ac99-3b531a9f3f91, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:46:11.344077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6ff069-3f4f-4c53-bdfd-e97b5ba978f6 req-7c2feba8-1b2b-44e8-8034-1610eb530029 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:11.352759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6ff069-3f4f-4c53-bdfd-e97b5ba978f6 req-7c2feba8-1b2b-44e8-8034-1610eb530029 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.0967200 Dec 21 03:46:11.356365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:46:11.408407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6ff069-3f4f-4c53-bdfd-e97b5ba978f6 req-b611244c-6f22-433f-ae75-42f4aa46c0c8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539887 Dec 21 03:46:11.420105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['310284e4-97b1-4722-9326-ad03ce2e793c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:11.448287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7c34a09c-fe79-4a56-ac99-3b531a9f3f91) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:11.457856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:11.460156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:11.478971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0bda0d8-e149-47b9-810e-3849d48f650d None None] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:11.562469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc656fc4-af96-4241-8fbe-8d12b0e22d98 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 859 time: 0.9402196 Dec 21 03:46:11.603025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13482724-b393-44cc-b4e5-b88545564dd2 req-50aa87fa-ae28-4519-bd24-26c1c8407aa9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:11.612890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13482724-b393-44cc-b4e5-b88545564dd2 req-50aa87fa-ae28-4519-bd24-26c1c8407aa9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 945 time: 0.0808682 Dec 21 03:46:11.674572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13482724-b393-44cc-b4e5-b88545564dd2 req-2466511b-3852-47c0-aa5b-b48ca227b269 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/security-groups?id=bd369f87-b6b5-4935-8864-c8abdbfdeeb8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590115 Dec 21 03:46:11.698897 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:46:11.707316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa4bb2a1-e509-46e0-ba15-7e3d27d5f108 None None] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:11.922913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:11.929645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9052cbe-5f17-4474-a9a3-fa2167dae0b2 req-d0d0faed-6c74-4113-bae3-5c682bd34895 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:11.935232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9052cbe-5f17-4474-a9a3-fa2167dae0b2 req-d0d0faed-6c74-4113-bae3-5c682bd34895 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 944 time: 0.1092522 Dec 21 03:46:11.971537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-a60e3c56-52a7-4048-9886-37b3df4630e1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:11.975382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-a60e3c56-52a7-4048-9886-37b3df4630e1 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.54 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 945 time: 0.1089594 Dec 21 03:46:12.038870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9052cbe-5f17-4474-a9a3-fa2167dae0b2 req-e70672db-a0cf-480a-ab4d-6d68e0f9f05b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0949097 Dec 21 03:46:12.128507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:12.203526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Deleting port 91a886a0-1771-4716-ac84-bee4f7ab2879 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:46:12.204028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:12.218991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'mac_address': 'fa:16:3e:aa:2e:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.114'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:12.278894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29275de1-d7ad-4c51-b3cd-2103e19bcbe8 req-e38bdc66-9a87-4fdd-a36c-49163ae5124b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:12.281614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:12.289734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29275de1-d7ad-4c51-b3cd-2103e19bcbe8 req-e38bdc66-9a87-4fdd-a36c-49163ae5124b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1203988 Dec 21 03:46:12.298829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 52f73cf2-b045-4f07-b974-6c29f7b35de0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:12.333381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:12.342318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] For port 91a886a0-1771-4716-ac84-bee4f7ab2879, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=91a886a0-1771-4716-ac84-bee4f7ab2879,segment=NetworkSegment(c924054a-32a4-4063-a961-2d7b2907f729),segment_id=c924054a-32a4-4063-a961-2d7b2907f729)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:12.344094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:12.357751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Calling delete_port for 91a886a0-1771-4716-ac84-bee4f7ab2879 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:46:12.379946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:12.473450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:12.482969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29275de1-d7ad-4c51-b3cd-2103e19bcbe8 req-6f6098d3-bf0e-478c-83ed-67baf9bb1aab tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1922905 Dec 21 03:46:12.532956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-e9a9489c-493f-4b00-b859-5a4feb52eae8 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:12.534787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-e9a9489c-493f-4b00-b859-5a4feb52eae8 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 822 time: 0.3052275 Dec 21 03:46:12.575596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-77b1fcd1-c441-4856-bf10-7f6d580c9c26 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/quotas/7a49d4228d05498db20fade9b7651659 HTTP/1.1" status: 200 len: 375 time: 0.0330966 Dec 21 03:46:12.628743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-8827dbac-ac37-436f-9472-11c63ad2a77a tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0385811 Dec 21 03:46:12.652984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a9033a-6a95-4e3a-8a64-468adb7e013b req-a1abd7af-928d-4e30-a51b-12b3c145c6e1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:12.654549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04a9033a-6a95-4e3a-8a64-468adb7e013b req-a1abd7af-928d-4e30-a51b-12b3c145c6e1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 949 time: 0.1108174 Dec 21 03:46:12.659809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:12.705944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['91a886a0-1771-4716-ac84-bee4f7ab2879'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:12.709177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Pushing event deleted for resources: {'Port': ['ID=91a886a0-1771-4716-ac84-bee4f7ab2879,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:12.755304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] No DVR routers for this DVR port 91a886a0-1771-4716-ac84-bee4f7ab2879 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:46:12.760176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:12.762561 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-03d3a84f-640d-4410-bdd8-79999d5c459e req-d4e457ea-761a-4cc7-b665-d304da50d7b9 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.54 "DELETE /v2.0/ports/91a886a0-1771-4716-ac84-bee4f7ab2879 HTTP/1.1" status: 204 len: 173 time: 0.7768681 Dec 21 03:46:12.763487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'name': 'network-vif-deleted', 'tag': '91a886a0-1771-4716-ac84-bee4f7ab2879'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:12.766352 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1115f1b9-1491-4884-acd8-eb30ccf6ad63" -d '{"events": [{"server_uuid": "bbaddaa0-3286-4622-94fe-6e23a7e61c09", "name": "network-vif-deleted", "tag": "91a886a0-1771-4716-ac84-bee4f7ab2879"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:12.802781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04a9033a-6a95-4e3a-8a64-468adb7e013b req-9cbfecc0-c4a9-4e14-a7b0-c776ccfb0485 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334825 Dec 21 03:46:12.830765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-26e0f0cb-9701-482e-9d13-3f59831e9366 service neutron] 10.222.0.18 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1935718 Dec 21 03:46:12.832152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['52f73cf2-b045-4f07-b974-6c29f7b35de0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:12.987880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba480c73-d77f-45ff-84f5-cc087ec8e848 req-86b3cdee-2ffc-455a-ae11-6a0ed0f82e3d tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 210 time: 0.0413721 Dec 21 03:46:13.031101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-0b662a33-518e-47de-9a8f-d4f8419217e5 service neutron] 10.222.0.18 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1930833 Dec 21 03:46:13.081009 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5936651f-a36f-4182-bb55-58566f9d753f x-openstack-request-id: req-5936651f-a36f-4182-bb55-58566f9d753f {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:13.086555 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bbaddaa0-3286-4622-94fe-6e23a7e61c09", "name": "network-vif-deleted", "tag": "91a886a0-1771-4716-ac84-bee4f7ab2879", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:13.086555 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5936651f-a36f-4182-bb55-58566f9d753f {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:13.086555 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bbaddaa0-3286-4622-94fe-6e23a7e61c09', 'name': 'network-vif-deleted', 'tag': '91a886a0-1771-4716-ac84-bee4f7ab2879', 'status': 'completed', 'code': 200} Dec 21 03:46:13.340642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a020f09-0289-4d5c-82e2-74b79923e953 req-8874c73b-4f49-405c-a32a-d1317c0a062f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.0414882 Dec 21 03:46:13.405971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0453296-4b70-4b33-8de2-fe086e29d3e4 req-9616771e-2924-41cd-bfa7-267354035c04 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:13.409796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0453296-4b70-4b33-8de2-fe086e29d3e4 req-9616771e-2924-41cd-bfa7-267354035c04 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 944 time: 0.0676830 Dec 21 03:46:13.477054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0453296-4b70-4b33-8de2-fe086e29d3e4 req-31996c1e-f980-4efd-93d3-77536a49c1fd tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0608728 Dec 21 03:46:13.601482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2674e8e9-b70f-4490-b67a-9f16d5233ce0 req-d7dad340-c3a3-4c21-a254-75d9401bf11e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:13.609312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2674e8e9-b70f-4490-b67a-9f16d5233ce0 req-d7dad340-c3a3-4c21-a254-75d9401bf11e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0600557 Dec 21 03:46:13.665643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2674e8e9-b70f-4490-b67a-9f16d5233ce0 req-bfbb4c18-c6c8-4367-b4f1-0f65748c2008 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552986 Dec 21 03:46:13.942877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d2a846-6f93-47d7-a889-b7be1ccda677 req-f1f41f1d-26b1-4aa4-ada1-b27473419552 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:13.954832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76d2a846-6f93-47d7-a889-b7be1ccda677 req-f1f41f1d-26b1-4aa4-ada1-b27473419552 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 949 time: 0.0606892 Dec 21 03:46:14.008275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76d2a846-6f93-47d7-a889-b7be1ccda677 req-3a45259d-18fe-4b68-8a65-dc8b357932c5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523486 Dec 21 03:46:14.129359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6bce578-89e8-4106-b21c-d437f98eae03 req-e0c540f6-ac48-4ebc-8cd0-ec6b16c4ff91 tempest-VolumesAdminNegativeTest-245669948 tempest-VolumesAdminNegativeTest-245669948-project] 10.222.0.18 "GET /v2.0/ports?device_id=bbaddaa0-3286-4622-94fe-6e23a7e61c09 HTTP/1.1" status: 200 len: 210 time: 0.0400455 Dec 21 03:46:14.155020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 310284e4-97b1-4722-9326-ad03ce2e793c up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:14.272369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 310284e4-97b1-4722-9326-ad03ce2e793c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:46:14.277736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 310284e4-97b1-4722-9326-ad03ce2e793c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:14.279822 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:14.373597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:14.399481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:14.401841 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-300d0956-4cbb-430a-a944-af3e68a76845" -d '{"events": [{"server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "name": "network-vif-plugged", "status": "completed", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:14.416566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 310284e4-97b1-4722-9326-ad03ce2e793c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=310284e4-97b1-4722-9326-ad03ce2e793c,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:14.430860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28a3fbb6-c8eb-4f80-9ca2-a968af72442d req-a582fccf-df09-4224-9a2e-862685b0a1b6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.0282879 Dec 21 03:46:14.492440 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cffcea7d-88ef-4c8a-802a-c9d1cf246263 x-openstack-request-id: req-cffcea7d-88ef-4c8a-802a-c9d1cf246263 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:14.492831 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "name": "network-vif-plugged", "status": "completed", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:14.493148 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cffcea7d-88ef-4c8a-802a-c9d1cf246263 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:14.493616 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c', 'code': 200} Dec 21 03:46:14.602920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368f3d41-02e6-454f-a802-fe9e2ef566f2 req-41afab38-d5d8-43db-ad7b-d72488685cca tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:14.604450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-368f3d41-02e6-454f-a802-fe9e2ef566f2 req-41afab38-d5d8-43db-ad7b-d72488685cca tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 944 time: 0.0579548 Dec 21 03:46:14.660103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efa134d2-6594-4b4b-8a84-99a3b241825f req-2d72e857-a2e3-4a77-a7bf-defbbc68378b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:14.662586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-368f3d41-02e6-454f-a802-fe9e2ef566f2 req-d784076b-5c33-439f-981f-bb409301eec0 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0520647 Dec 21 03:46:14.662753 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efa134d2-6594-4b4b-8a84-99a3b241825f req-2d72e857-a2e3-4a77-a7bf-defbbc68378b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 1096 time: 0.0543628 Dec 21 03:46:14.717029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efa134d2-6594-4b4b-8a84-99a3b241825f req-be0069ba-fd9f-4a72-93ca-0b1f2335b794 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466609 Dec 21 03:46:14.782545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7643949-58fe-4804-9024-2025d52f040d req-5e2e534e-d47c-4be0-8193-478cbf69ce9a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:14.784558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7643949-58fe-4804-9024-2025d52f040d req-5e2e534e-d47c-4be0-8193-478cbf69ce9a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0477738 Dec 21 03:46:14.833273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7643949-58fe-4804-9024-2025d52f040d req-7a08e447-b4ec-4ef7-ba8d-30adbf51c7d0 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428038 Dec 21 03:46:14.835718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:14.883408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=310284e4-97b1-4722-9326-ad03ce2e793c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:15.122207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ef34c3-85c4-4569-906d-83758cc70042 req-f532483b-4c65-4118-a25d-9a35db102cca tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:15.123938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1ef34c3-85c4-4569-906d-83758cc70042 req-f532483b-4c65-4118-a25d-9a35db102cca tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 949 time: 0.0526936 Dec 21 03:46:15.185015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1ef34c3-85c4-4569-906d-83758cc70042 req-5be62fce-5558-4154-9fb9-3efdcd99cb58 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541742 Dec 21 03:46:15.190571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45022) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:15.243186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Deleting subnet 132b2a84-19ec-4b46-aad8-63966b0011e0 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:46:15.250566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.319712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.365288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.494286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.532980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.539904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/132b2a84-19ec-4b46-aad8-63966b0011e0 HTTP/1.1" status: 204 len: 168 time: 0.3477101 Dec 21 03:46:15.540981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45038) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:15.549104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159f6e64-7879-4d71-aaed-6f6274551438 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=132b2a84-19ec-4b46-aad8-63966b0011e0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:15.584974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0081580f-95ec-4c13-900b-10a615a3f6d8 req-8e7d21da-c2d1-41ad-81e5-bb00748af4f5 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.0556822 Dec 21 03:46:15.650900 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.747390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.771646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['545d576d-bcad-43dd-a453-7df1e631e6e2']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:15.787709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c924054a-32a4-4063-a961-2d7b2907f729') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:15.788097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c924054a-32a4-4063-a961-2d7b2907f729') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:15.791996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49fc6dc1-8522-46cf-a488-0b1bec5ab29e req-5d82e094-e21d-4d3f-b5bc-c5a575720ef5 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:15.794399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49fc6dc1-8522-46cf-a488-0b1bec5ab29e req-5d82e094-e21d-4d3f-b5bc-c5a575720ef5 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.0544317 Dec 21 03:46:15.800587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.829789 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.834554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Releasing vlan 117 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:46:15.836378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:46:15.839024 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:46:15.896185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49fc6dc1-8522-46cf-a488-0b1bec5ab29e req-2bd193d6-4a89-4adb-a787-10b0a84e7efc tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0921519 Dec 21 03:46:15.904840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:15.994252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3ae1f9-6284-446b-9676-4d26e329fcf2 req-8603e628-5f98-4791-a1d2-3cee9d880b7a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:16.002788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff3ae1f9-6284-446b-9676-4d26e329fcf2 req-8603e628-5f98-4791-a1d2-3cee9d880b7a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0716429 Dec 21 03:46:16.065013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 52f73cf2-b045-4f07-b974-6c29f7b35de0 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:46:16.071788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 52f73cf2-b045-4f07-b974-6c29f7b35de0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:16.072502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.080893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff3ae1f9-6284-446b-9676-4d26e329fcf2 req-eba5ce50-7aac-41b3-99c3-855b8417782c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771413 Dec 21 03:46:16.195252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.236882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:16.339725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.340540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 91a886a0-1771-4716-ac84-bee4f7ab2879 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:16.360158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341d5dc0-72f7-4683-9b01-970455c1fb9f req-ccc9fccf-c8ba-4674-97f1-4ea071d5d372 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:16.367558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-341d5dc0-72f7-4683-9b01-970455c1fb9f req-ccc9fccf-c8ba-4674-97f1-4ea071d5d372 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 949 time: 0.0632234 Dec 21 03:46:16.392788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.405625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.409768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 91a886a0-1771-4716-ac84-bee4f7ab2879 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:46:16.411495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 91a886a0-1771-4716-ac84-bee4f7ab2879 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:46:16.424403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] 10.222.0.18 "DELETE /v2.0/networks/545d576d-bcad-43dd-a453-7df1e631e6e2 HTTP/1.1" status: 204 len: 168 time: 0.8814349 Dec 21 03:46:16.426353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:16.459745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:16.475715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-341d5dc0-72f7-4683-9b01-970455c1fb9f req-d4b25e7e-c247-4b67-bef2-bb05ee035670 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917275 Dec 21 03:46:16.491876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999f91a4-6fcb-4334-a09f-2edb6ea57eb2 admin admin] Pushing event deleted for resources: {'Network': ['ID=545d576d-bcad-43dd-a453-7df1e631e6e2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:16.508655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:16.513084 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50c28ef4-cef3-421f-ae70-4a91d533ba44" -d '{"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-plugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:16.550401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Deleting subnet 47bff4ed-3527-4095-bb53-44458099d102 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:46:16.554373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.558829 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e5de2c4-4305-4b0a-b669-997706239994 x-openstack-request-id: req-3e5de2c4-4305-4b0a-b669-997706239994 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:16.559354 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-plugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:16.559967 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3e5de2c4-4305-4b0a-b669-997706239994 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:16.560541 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'code': 200} Dec 21 03:46:16.691447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.770403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15e8dc3e-d75b-411b-9fca-29113abee583 req-eef96855-9dd0-4f9b-80e9-70e9f9c1091b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.0706937 Dec 21 03:46:16.811827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:16.847509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-f7d49b0a-5abc-48ce-b724-9f41d891a470 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:16.849057 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-f7d49b0a-5abc-48ce-b724-9f41d891a470 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 822 time: 0.2708261 Dec 21 03:46:16.863019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13439aad-1cab-462a-8ce8-fa2bb4d8ccc0 req-a702961f-3b0d-4065-97ae-4738b92efb24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:16.864571 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-13439aad-1cab-462a-8ce8-fa2bb4d8ccc0 req-a702961f-3b0d-4065-97ae-4738b92efb24 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1102 time: 0.1168420 Dec 21 03:46:16.876897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'port': {'device_id': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'admin_state_up': True, 'tenant_id': '7a49d4228d05498db20fade9b7651659'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:17.052968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e0521cb-2f1b-4142-b46f-89b1a9d59f89 req-6cac4bfa-fe4b-44dd-b553-e8585db7711f tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:17.061382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e0521cb-2f1b-4142-b46f-89b1a9d59f89 req-6cac4bfa-fe4b-44dd-b553-e8585db7711f tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.0701630 Dec 21 03:46:17.075975 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-13439aad-1cab-462a-8ce8-fa2bb4d8ccc0 req-6f046ae3-e6f6-43e8-8392-9d328d4b8e9e service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879874 Dec 21 03:46:17.120045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e0521cb-2f1b-4142-b46f-89b1a9d59f89 req-374a6e9f-e157-4197-894e-309586297d5c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0573902 Dec 21 03:46:17.181407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.220608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=47bff4ed-3527-4095-bb53-44458099d102,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:17.228044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.232018 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c78ed8e0-bf92-4002-b86b-e66a461b1361 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/47bff4ed-3527-4095-bb53-44458099d102 HTTP/1.1" status: 204 len: 168 time: 0.8046937 Dec 21 03:46:17.234473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45074) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:17.256086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Made reservation on behalf of 7a49d4228d05498db20fade9b7651659 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:17.259771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.276478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db19600a-1679-467a-a432-fbaed5a86862 req-abab8c39-d7e9-4d1f-92c3-fa95eadc9f20 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:17.284293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db19600a-1679-467a-a432-fbaed5a86862 req-abab8c39-d7e9-4d1f-92c3-fa95eadc9f20 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0857892 Dec 21 03:46:17.299386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a232d9f-e390-4055-a88c-1b9cda9502f1 req-a3969242-35bd-44f0-bc68-6a7610f07c36 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:17.302277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a232d9f-e390-4055-a88c-1b9cda9502f1 req-a3969242-35bd-44f0-bc68-6a7610f07c36 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.1122611 Dec 21 03:46:17.313346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45076) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:17.318356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Request body: {'floatingip': {'port_id': '310284e4-97b1-4722-9326-ad03ce2e793c'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:17.368022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.385917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.459226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db19600a-1679-467a-a432-fbaed5a86862 req-d05c609b-2d06-4257-8b8f-63dadd790933 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1628938 Dec 21 03:46:17.496710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.519387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:17.540611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '39358102-6fda-4efd-9865-d73087b710d4') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:17.540922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '39358102-6fda-4efd-9865-d73087b710d4') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:17.566367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.607753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.643851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Allocated IP 172.20.0.8 (7c34a09c-fe79-4a56-ac99-3b531a9f3f91/ec8e3a7f-1bef-41ac-8b72-508d262fe30c/4490e4d7-08f5-4900-ad49-b4bd801be378) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:17.687074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:46:17.687484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:46:17.689815 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:46:17.699377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39de1059-ec02-45d1-bb73-ad43f2ff109d req-878a2bae-5016-48f7-92a3-b683137f1a90 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:17.707175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39de1059-ec02-45d1-bb73-ad43f2ff109d req-878a2bae-5016-48f7-92a3-b683137f1a90 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1141572 Dec 21 03:46:17.778256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39de1059-ec02-45d1-bb73-ad43f2ff109d req-d93d1cb1-d892-4634-9089-d7b1ac8f2931 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691450 Dec 21 03:46:17.866420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.880653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:17.883864 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] 10.222.0.18 "DELETE /v2.0/networks/fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2 HTTP/1.1" status: 204 len: 168 time: 0.6481047 Dec 21 03:46:17.900835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c14f20-18e9-411f-9703-d4a7500d8c56 admin admin] Pushing event deleted for resources: {'Network': ['ID=fb0f3e5b-90a3-4014-8b97-9e7abc00b7e2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:17.961976 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.019024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13caf9f1-0d01-4158-a4b5-708ce9def351 req-1ea76cf2-8ad0-45a3-8a2e-652436ba382b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.0419989 Dec 21 03:46:18.077015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.125905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:18.129839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:18.134441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:18.163652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:18.187446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.197979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:18.197979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.237688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.265118 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-7f23c7a1-8ba2-4eaf-8cf0-e3cf517d9cf4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3920503 Dec 21 03:46:18.293830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Request body: {'port': {'device_id': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:18.298072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:18.374553 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b50f36d6-e0d7-4fea-b2be-26aef8265aa4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=259704f866224ed694b05e3868cd9f5c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0748374 Dec 21 03:46:18.377729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45100) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:18.383183 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Floating IP d027d1db-04ad-43b0-9c77-67105c361095 associated. External IP: 172.25.5.229, port: 310284e4-97b1-4722-9326-ad03ce2e793c. Dec 21 03:46:18.469983 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.484632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-390761d6-baa1-4f7e-8969-e8b28c04a8cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.535428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-390761d6-baa1-4f7e-8969-e8b28c04a8cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.694985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5316cb6-2209-4bdf-9d9d-0be3a25a2fd2 req-4550cd2c-25fe-4204-ac5d-e5f2df12b8f7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:18.703017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5316cb6-2209-4bdf-9d9d-0be3a25a2fd2 req-4550cd2c-25fe-4204-ac5d-e5f2df12b8f7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1760626 Dec 21 03:46:18.821394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5316cb6-2209-4bdf-9d9d-0be3a25a2fd2 req-8fd8e7ac-7098-4225-b0ab-bf64a9148baa tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1172028 Dec 21 03:46:18.831218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Router aa3076a7-dfbe-4587-b5a8-fe25629afc18 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:46:18.929311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4490e4d7-08f5-4900-ad49-b4bd801be378 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:18.937666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:18.956669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Transition to ACTIVE for port object 4490e4d7-08f5-4900-ad49-b4bd801be378 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:19.259945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-390761d6-baa1-4f7e-8969-e8b28c04a8cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.262742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-390761d6-baa1-4f7e-8969-e8b28c04a8cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.268035 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-390761d6-baa1-4f7e-8969-e8b28c04a8cf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bd369f87-b6b5-4935-8864-c8abdbfdeeb8 HTTP/1.1" status: 204 len: 168 time: 0.8855994 Dec 21 03:46:19.275269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.312204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:46:19.315371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-390761d6-baa1-4f7e-8969-e8b28c04a8cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd369f87-b6b5-4935-8864-c8abdbfdeeb8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:19.317222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.349647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:19.352046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] Sync routers for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:46:19.402896 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:46:19.404569 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:19.417683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157d0776-c794-4ed5-b47a-0c695eb724b3 req-2ccf6d4c-45fe-4ff9-9c40-b253e5d9af4f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:19.419499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-157d0776-c794-4ed5-b47a-0c695eb724b3 req-2ccf6d4c-45fe-4ff9-9c40-b253e5d9af4f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1869500 Dec 21 03:46:19.425205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b025636f-031f-4c2b-91e7-064634095b2c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "PUT /v2.0/floatingips/d027d1db-04ad-43b0-9c77-67105c361095 HTTP/1.1" status: 200 len: 991 time: 2.1110044 Dec 21 03:46:19.429456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:19.431837 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a18ed544-ec4d-4e10-b812-1607bbebb930" -d '{"events": [{"name": "network-changed", "server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:19.442597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9915c4ae-c4f0-4bcd-af58-accee01ee504 req-c11b9e62-c74b-490e-a1e4-6a46932a6b0b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:19.449859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9915c4ae-c4f0-4bcd-af58-accee01ee504 req-c11b9e62-c74b-490e-a1e4-6a46932a6b0b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 931 time: 0.2161610 Dec 21 03:46:19.469017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Attempting to bind port 4490e4d7-08f5-4900-ad49-b4bd801be378 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:19.469380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Attempting to bind port 4490e4d7-08f5-4900-ad49-b4bd801be378 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:19.469675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Attempting to bind port 4490e4d7-08f5-4900-ad49-b4bd801be378 on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:19.475011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Port 4490e4d7-08f5-4900-ad49-b4bd801be378 on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:19.475659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Attempting to bind port 4490e4d7-08f5-4900-ad49-b4bd801be378 on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:19.481037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 45, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:19.481799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Checking segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:19.481799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Bound using segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:19.482323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Bound port: 4490e4d7-08f5-4900-ad49-b4bd801be378, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:19.482868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.539409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-157d0776-c794-4ed5-b47a-0c695eb724b3 req-1f5a0339-33c7-4da5-8e80-b34c1c5766f0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074584 Dec 21 03:46:19.547442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:46:19.567585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9915c4ae-c4f0-4bcd-af58-accee01ee504 req-dd9160ff-3401-4ba2-b520-0ad960900849 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1168330 Dec 21 03:46:19.598094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:19.605814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:19.686643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f4d3601-1920-4197-b57d-468635dd6926 req-60010119-20f4-453e-ba1b-4fe9d358d888 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:19.690613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f4d3601-1920-4197-b57d-468635dd6926 req-60010119-20f4-453e-ba1b-4fe9d358d888 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1097 time: 0.0516660 Dec 21 03:46:19.708717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.776981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f4d3601-1920-4197-b57d-468635dd6926 req-2455e29e-8344-4961-84c3-4e0386f28c00 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710278 Dec 21 03:46:19.800409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:19.801095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.814899 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0539ed62-5b44-49f9-91be-93382016f775 x-openstack-request-id: req-0539ed62-5b44-49f9-91be-93382016f775 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:19.814899 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:19.814899 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0539ed62-5b44-49f9-91be-93382016f775 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:19.814899 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c', 'status': 'completed', 'code': 200} Dec 21 03:46:19.821268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] 10.222.0.31 "PUT /v2.0/ports/4490e4d7-08f5-4900-ad49-b4bd801be378 HTTP/1.1" status: 200 len: 1092 time: 1.5315382 Dec 21 03:46:19.821511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'tag': '4490e4d7-08f5-4900-ad49-b4bd801be378'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:19.823878 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe" -d '{"events": [{"name": "network-changed", "server_uuid": "0fb974b6-7ee7-46ef-a7bc-358362b4ff2a", "tag": "4490e4d7-08f5-4900-ad49-b4bd801be378"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:19.846697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12fd719f-7637-4ba6-b949-eac4696cbc3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:19.930537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c650ba2-576c-4fca-82a7-3e9e28e23aa6 service neutron] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:19.939394 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd027d1db-04ad-43b0-9c77-67105c361095', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'floating_ip_address': '172.25.5.229', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'port_id': '310284e4-97b1-4722-9326-ad03ce2e793c', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 532, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'mac_address': 'fa:16:3e:49:72:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:45:01Z', 'updated_at': '2021-12-21T03:46:18Z', 'revision_number': 1, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:19.984881 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] Checking router: aa3076a7-dfbe-4587-b5a8-fe25629afc18 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:46:19.995995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:46:19.996939 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:45:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:20.000837 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-619ab5a8-f71d-41d7-bbc3-2469330de7d1 x-openstack-request-id: req-619ab5a8-f71d-41d7-bbc3-2469330de7d1 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:20.001011 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0fb974b6-7ee7-46ef-a7bc-358362b4ff2a", "tag": "4490e4d7-08f5-4900-ad49-b4bd801be378", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:20.001823 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-619ab5a8-f71d-41d7-bbc3-2469330de7d1 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:20.002143 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'tag': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'status': 'completed', 'code': 200} Dec 21 03:46:20.052832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-2f416924-e564-44ae-a34b-ad468e64b12c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.053752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-2f416924-e564-44ae-a34b-ad468e64b12c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7fa1b480ce544ae89f56493527b75054&device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 1097 time: 0.1442258 Dec 21 03:46:20.165221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50d906f-182a-47ec-9ad7-b90b3d7d93db req-b6af21e3-e8a8-4378-b5c3-94cc38d804e1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.174326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c50d906f-182a-47ec-9ad7-b90b3d7d93db req-b6af21e3-e8a8-4378-b5c3-94cc38d804e1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0960286 Dec 21 03:46:20.229481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-b896aca4-447a-45be-8680-ed5b99b61710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.238189 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:46:20.239388 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-b896aca4-447a-45be-8680-ed5b99b61710 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 1095 time: 0.2057569 Dec 21 03:46:20.243530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c50d906f-182a-47ec-9ad7-b90b3d7d93db req-b73bf241-14a5-4ae1-b901-fb0e481ae770 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682447 Dec 21 03:46:20.273253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45158) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:20.313852 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-df230d7a-3ab6-46cb-bf75-047d09082f5e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4490e4d7-08f5-4900-ad49-b4bd801be378 HTTP/1.1" status: 200 len: 217 time: 0.0482903 Dec 21 03:46:20.359637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-41961993-1e32-4ea1-926f-858fe66be090 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=427ea7c865c3448a8c4002314a502dc5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0852067 Dec 21 03:46:20.360217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45160) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:20.384213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-4692d801-f595-422d-877e-165ed86dffff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.385664 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-4692d801-f595-422d-877e-165ed86dffff service neutron] 10.222.0.31 "GET /v2.0/networks?id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd HTTP/1.1" status: 200 len: 916 time: 0.2677469 Dec 21 03:46:20.497461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e96b0b-5b74-4a33-9d57-53ab69cc43d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:20.538043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e96b0b-5b74-4a33-9d57-53ab69cc43d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:20.575034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-3f85faef-0007-4460-a781-22276dcb4302 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.582865 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-3f85faef-0007-4460-a781-22276dcb4302 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 200 len: 862 time: 0.2544708 Dec 21 03:46:20.637323 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd027d1db-04ad-43b0-9c77-67105c361095', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'floating_ip_address': '172.25.5.229', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'port_id': '310284e4-97b1-4722-9326-ad03ce2e793c', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 532, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'mac_address': 'fa:16:3e:49:72:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:45:01Z', 'updated_at': '2021-12-21T03:46:18Z', 'revision_number': 1, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:20.676372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-f9285ffc-3400-493d-9214-a3ff50195686 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0826833 Dec 21 03:46:20.683828 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-e8c587b8-e3eb-46f7-bc01-30b93ef5535a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=310284e4-97b1-4722-9326-ad03ce2e793c HTTP/1.1" status: 200 len: 999 time: 0.2803490 Dec 21 03:46:20.691471 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f3038dd-da99-418c-a3c7-9ac4963faf36 None None] The sync data for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 is: [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd027d1db-04ad-43b0-9c77-67105c361095', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'floating_ip_address': '172.25.5.229', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'port_id': '310284e4-97b1-4722-9326-ad03ce2e793c', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 532, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'mac_address': 'fa:16:3e:49:72:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:45:01Z', 'updated_at': '2021-12-21T03:46:18Z', 'revision_number': 1, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:46:20.716742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e96b0b-5b74-4a33-9d57-53ab69cc43d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:20.719300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e96b0b-5b74-4a33-9d57-53ab69cc43d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:20.721019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-53e96b0b-5b74-4a33-9d57-53ab69cc43d9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6b20224f-80ea-4f3e-b34c-fbf38815554a HTTP/1.1" status: 204 len: 168 time: 0.3588774 Dec 21 03:46:20.748030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e96b0b-5b74-4a33-9d57-53ab69cc43d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b20224f-80ea-4f3e-b34c-fbf38815554a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:20.777371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba59f6ba-02c2-4331-bc35-2f2c1edd11ff req-53821cdc-3867-4acf-b3d5-a6fc9a5eaaf5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.811869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba59f6ba-02c2-4331-bc35-2f2c1edd11ff req-53821cdc-3867-4acf-b3d5-a6fc9a5eaaf5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1360722 Dec 21 03:46:20.821819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-683dc129-c11d-4548-87a9-9e6c7a06903b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:20.823880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-683dc129-c11d-4548-87a9-9e6c7a06903b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=48142ae2-dce2-450f-96ff-f72f7dcd96bb HTTP/1.1" status: 200 len: 854 time: 0.0753756 Dec 21 03:46:20.918894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba59f6ba-02c2-4331-bc35-2f2c1edd11ff req-50da6f12-b2ac-4b4a-a980-987077173e1c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061392 Dec 21 03:46:21.068670 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-86b84a85-2add-4089-9477-6d3f70625634 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3826160 Dec 21 03:46:21.071897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-0d6b9995-1893-42b7-be0d-027374d9b275 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:21.072124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-0d6b9995-1893-42b7-be0d-027374d9b275 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1413c5b2-d3e7-46e6-af39-45068f2d8ddd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2346103 Dec 21 03:46:21.139925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-170b4922-af73-41f8-bf46-bb07e7b62763 None None] New status for floating IP d027d1db-04ad-43b0-9c77-67105c361095: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:46:21.196712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6647ac6-14ab-4853-964c-031e500a2f7d req-b9658535-daab-42fb-83c5-107c2f400198 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:21.198631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6647ac6-14ab-4853-964c-031e500a2f7d req-b9658535-daab-42fb-83c5-107c2f400198 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 943 time: 0.1322536 Dec 21 03:46:21.271110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6647ac6-14ab-4853-964c-031e500a2f7d req-e2d49b60-a9ad-460d-9f29-b71509de8c02 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616996 Dec 21 03:46:21.445037 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-6ac3f7f1-98e4-4bb7-8763-c8234e49cbfd service neutron] 10.222.0.31 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3464937 Dec 21 03:46:21.468154 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c9a799d-06cc-4035-9d75-3316ccfcb2a8 req-dbd4ae40-9592-4aac-8d2f-53dbaabab075 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3768661 Dec 21 03:46:21.692647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5865d767-417e-4b48-a32b-2f95ca1c29b9 req-c5fecd6d-d42a-4a1c-aa9e-dc5b9790b956 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:21.701321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5865d767-417e-4b48-a32b-2f95ca1c29b9 req-c5fecd6d-d42a-4a1c-aa9e-dc5b9790b956 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1305990 Dec 21 03:46:21.721894 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a18ed544-ec4d-4e10-b812-1607bbebb930 req-10d58219-0cc7-4bcb-bd8a-83365468f981 service neutron] 10.222.0.31 "GET /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2527869 Dec 21 03:46:21.731639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-d2561352-01bd-4173-9edc-d8f07b02f18c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:21.739545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-d2561352-01bd-4173-9edc-d8f07b02f18c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 1095 time: 0.0690067 Dec 21 03:46:21.814337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5865d767-417e-4b48-a32b-2f95ca1c29b9 req-1c584360-0cfb-4e9e-ba5c-55a6a105c4a9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083374 Dec 21 03:46:21.920978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-d95613c8-a7cc-421e-a21b-98aea27650aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:21.922551 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-d95613c8-a7cc-421e-a21b-98aea27650aa service neutron] 10.222.0.31 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 923 time: 0.1716685 Dec 21 03:46:21.979964 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-89375730-3e70-487c-865f-da74666a7ce2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4490e4d7-08f5-4900-ad49-b4bd801be378 HTTP/1.1" status: 200 len: 217 time: 0.0430787 Dec 21 03:46:21.984586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a3d83e-2dd4-4684-898b-e0c97b857b4c req-e7e349fe-8b62-4a71-a88a-b47315a8ca2e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:21.987217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03a3d83e-2dd4-4684-898b-e0c97b857b4c req-e7e349fe-8b62-4a71-a88a-b47315a8ca2e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0743337 Dec 21 03:46:22.044228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-5cdcfa72-f16a-4b33-a070-a810217dd29a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:22.045965 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-5cdcfa72-f16a-4b33-a070-a810217dd29a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 200 len: 862 time: 0.0517693 Dec 21 03:46:22.070046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03a3d83e-2dd4-4684-898b-e0c97b857b4c req-e68861e2-5d3f-412d-93ca-2cb9a4f821ff tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760148 Dec 21 03:46:22.088688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-e3309a69-f9e9-479e-a371-cb6c331701c7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0312924 Dec 21 03:46:22.156846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01663c75-1f06-4db6-9539-c814372f2876 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:22.234468 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-be045eff-6b40-4ca5-889a-421a8f9f4042 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323686 Dec 21 03:46:22.355435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7da146f3-3042-4d0a-ac0e-183a17e5d8fe req-839e8754-b611-4ad5-893c-4c11a2ae4428 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1081898 Dec 21 03:46:22.462005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65bc5330-4367-4e13-bfb9-55dfd7b6a6f2 req-edb2a513-d522-4e73-bae6-5ef44a8cef7d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:22.469598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65bc5330-4367-4e13-bfb9-55dfd7b6a6f2 req-edb2a513-d522-4e73-bae6-5ef44a8cef7d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 943 time: 0.0782073 Dec 21 03:46:22.494817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:22.519853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65bc5330-4367-4e13-bfb9-55dfd7b6a6f2 req-17921a99-b4a8-4a55-a8e6-56bbcde830f3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492473 Dec 21 03:46:22.669958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-6174cd33-7f59-43e6-8e34-8d42dc3f291b tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:46:22.671645 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-6174cd33-7f59-43e6-8e34-8d42dc3f291b tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0119851 Dec 21 03:46:22.722215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-42c8ef27-6e3e-4a23-8c39-57cdf7ef934d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:22.724028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-42c8ef27-6e3e-4a23-8c39-57cdf7ef934d service neutron] 10.222.0.18 "GET /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 1094 time: 0.0408347 Dec 21 03:46:22.738013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:22.738013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Unknown quota resources ['binding']. {{(pid=110311) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:46:22.898689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:22.899088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:22.899417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:22.904462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:22.904776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:22.910420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:22.910756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:22.911277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:22.911705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Bound port: b1bddbab-3a32-4687-b97f-eada22b71c0f, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:22.973182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:23.083704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:23.085253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-66a5282e-86bb-40fc-8f46-08d9ed4d21aa service neutron] 10.222.0.18 "POST /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f/bindings HTTP/1.1" status: 201 len: 390 time: 0.3558881 Dec 21 03:46:23.098187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-48c19fb8-e516-4dad-817a-c2809695a37f req-08c39fa2-5f0e-4078-b7ca-4599e1d4ca78 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:46:23.098187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48c19fb8-e516-4dad-817a-c2809695a37f req-08c39fa2-5f0e-4078-b7ca-4599e1d4ca78 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0093391 Dec 21 03:46:23.116463 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:23.412890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0257a396-8165-4a9a-841a-c1cf9da34a35 req-a3f1a561-b260-4bd5-8f57-742c95c60cd0 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:23.414398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0257a396-8165-4a9a-841a-c1cf9da34a35 req-a3f1a561-b260-4bd5-8f57-742c95c60cd0 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0642307 Dec 21 03:46:23.543770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0257a396-8165-4a9a-841a-c1cf9da34a35 req-b9ab617e-8c3c-4396-a30c-2bde9b3cb6fd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143470 Dec 21 03:46:23.697447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:23.745445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-6868a988-6db9-4477-9a2d-075c00e8d976 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1187084 Dec 21 03:46:23.756527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-07af2158-8384-4d64-838f-6ece67b44a0f service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:46:23.773440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-07af2158-8384-4d64-838f-6ece67b44a0f service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0150831 Dec 21 03:46:23.847770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aeab149-cc2c-4b87-ad25-9bd1d55ab700 req-461c2fa4-be22-4eed-8ad1-28c21433f3bb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:23.849514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9aeab149-cc2c-4b87-ad25-9bd1d55ab700 req-461c2fa4-be22-4eed-8ad1-28c21433f3bb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.1919162 Dec 21 03:46:23.872553 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d204e1d6-1e0d-40a3-88bb-7056a2a620f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:23.885804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-238866a8-861f-4548-8f9a-9cd90a0d2397 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:23.886077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-294c9ae1-0eaf-4e00-8feb-9995c83e7c7f req-14b3778e-895f-42db-a6cb-cea7fa126f8b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:23.890119 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-238866a8-861f-4548-8f9a-9cd90a0d2397 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1097 time: 0.0922489 Dec 21 03:46:23.894962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-294c9ae1-0eaf-4e00-8feb-9995c83e7c7f req-14b3778e-895f-42db-a6cb-cea7fa126f8b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.2041745 Dec 21 03:46:23.999229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-294c9ae1-0eaf-4e00-8feb-9995c83e7c7f req-14c2579f-e724-4820-8353-51a21ad751f3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994141 Dec 21 03:46:24.017389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9aeab149-cc2c-4b87-ad25-9bd1d55ab700 req-20905806-1536-4e69-b33f-d862e78657bf tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1598632 Dec 21 03:46:24.025615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-81b8f1a4-465c-4125-91de-fa95049afeee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:24.027421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-81b8f1a4-465c-4125-91de-fa95049afeee service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1296124 Dec 21 03:46:24.110715 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-817bc178-2517-4f3c-891b-1e44af902695 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 217 time: 0.0668850 Dec 21 03:46:24.129162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d204e1d6-1e0d-40a3-88bb-7056a2a620f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.186106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d204e1d6-1e0d-40a3-88bb-7056a2a620f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.187365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b263bd-9e06-4096-97d1-6fb997d5514f req-703a6f8a-363f-44d0-bd87-bb5ea01f6629 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:24.189603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22b263bd-9e06-4096-97d1-6fb997d5514f req-703a6f8a-363f-44d0-bd87-bb5ea01f6629 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 943 time: 0.0906436 Dec 21 03:46:24.206432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4490e4d7-08f5-4900-ad49-b4bd801be378 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:24.356644 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d204e1d6-1e0d-40a3-88bb-7056a2a620f6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=db9ce31dff01434d8db443061ef3e33f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6557260 Dec 21 03:46:24.357921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:24.365476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22b263bd-9e06-4096-97d1-6fb997d5514f req-799b7c54-287e-49eb-ac79-20b5760769c2 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1496665 Dec 21 03:46:24.385453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-aff1dc2d-1545-4fa4-834d-238a9b003637 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:24.387438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-aff1dc2d-1545-4fa4-834d-238a9b003637 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.2566297 Dec 21 03:46:24.392084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d204e1d6-1e0d-40a3-88bb-7056a2a620f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e70f5710-4aa4-49b3-aade-47785e1123b5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:24.437436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-50e219b4-ca76-415e-a2c6-124b10b7e02a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0335670 Dec 21 03:46:24.437658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:24.452616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'port_id': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'mac_address': 'fa:16:3e:dc:9a:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec8e3a7f-1bef-41ac-8b72-508d262fe30c', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:24.495749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.509322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4490e4d7-08f5-4900-ad49-b4bd801be378 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:24.530491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:24.533859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-596f750f-2b3c-41d8-a0ed-cdaaaf8ec8f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.573460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-596f750f-2b3c-41d8-a0ed-cdaaaf8ec8f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.581439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-6a5363de-94a3-4587-ae2f-eac7f0a92a41 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1321547 Dec 21 03:46:24.669200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff90645c-99f4-4ba1-b592-ae2b16e1946b req-b0d108ba-04a0-462b-be74-ad8cdd6d88dc tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:24.670892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff90645c-99f4-4ba1-b592-ae2b16e1946b req-b0d108ba-04a0-462b-be74-ad8cdd6d88dc tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0557027 Dec 21 03:46:24.723448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff90645c-99f4-4ba1-b592-ae2b16e1946b req-f6192a0b-b581-4dd0-8d23-8b9cb18d7e44 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460508 Dec 21 03:46:24.728963 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-300e8e14-b986-431c-9847-7cee75981bfb service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1368694 Dec 21 03:46:24.848601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-596f750f-2b3c-41d8-a0ed-cdaaaf8ec8f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.851394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-596f750f-2b3c-41d8-a0ed-cdaaaf8ec8f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.854753 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-596f750f-2b3c-41d8-a0ed-cdaaaf8ec8f7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e70f5710-4aa4-49b3-aade-47785e1123b5 HTTP/1.1" status: 204 len: 168 time: 0.4939563 Dec 21 03:46:24.855801 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.860046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.886585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-596f750f-2b3c-41d8-a0ed-cdaaaf8ec8f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e70f5710-4aa4-49b3-aade-47785e1123b5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:24.919068 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:24.923716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:25.225919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a9d62d-8327-4349-a54b-e8d0d6b3982a req-2b9a2e56-24f9-4ffe-9a4a-506482b0da64 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:25.236015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4a9d62d-8327-4349-a54b-e8d0d6b3982a req-2b9a2e56-24f9-4ffe-9a4a-506482b0da64 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1394274 Dec 21 03:46:25.244308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['4490e4d7-08f5-4900-ad49-b4bd801be378'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:25.273357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b84bd28-8e9a-4474-a01c-3723905d3140 req-42976d54-5e13-4e06-9e31-87016dab696b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:25.283005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b84bd28-8e9a-4474-a01c-3723905d3140 req-42976d54-5e13-4e06-9e31-87016dab696b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.1273654 Dec 21 03:46:25.352106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4a9d62d-8327-4349-a54b-e8d0d6b3982a req-47942856-699b-4c6a-bfc3-2f61334feed0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097791 Dec 21 03:46:25.425967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b84bd28-8e9a-4474-a01c-3723905d3140 req-c67ccedc-083d-4afe-bfc4-7633a56399b2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1361890 Dec 21 03:46:25.603373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:25.673936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d61f508-5fc3-41a1-ba91-e00ffa321fff req-fd46faf5-5522-4751-abbb-942aead371ff tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:25.676078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d61f508-5fc3-41a1-ba91-e00ffa321fff req-fd46faf5-5522-4751-abbb-942aead371ff tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 944 time: 0.1071434 Dec 21 03:46:25.803815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d61f508-5fc3-41a1-ba91-e00ffa321fff req-51fbb3ff-85b2-478c-ab14-65f63ba25208 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1078854 Dec 21 03:46:25.904064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07fdc2d-08cb-4353-b448-a9001c6fee58 req-e4eea8b2-9196-4bdd-8633-0c0eca3c9450 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:25.914069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07fdc2d-08cb-4353-b448-a9001c6fee58 req-e4eea8b2-9196-4bdd-8633-0c0eca3c9450 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0669377 Dec 21 03:46:25.957933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07fdc2d-08cb-4353-b448-a9001c6fee58 req-1a1c8edd-7c59-4e54-9226-426408c20ec9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429902 Dec 21 03:46:26.506675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e68b53f-f0b9-4d75-a85d-3865fd2c1cce req-19a3899a-583c-4230-893b-9f105a69a689 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:26.508249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e68b53f-f0b9-4d75-a85d-3865fd2c1cce req-19a3899a-583c-4230-893b-9f105a69a689 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0674691 Dec 21 03:46:26.588876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b7cad8-ea6b-4e11-9de7-7f7f536f582b req-7c5eb205-5e26-4114-8b66-afaf210be965 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:26.590389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4b7cad8-ea6b-4e11-9de7-7f7f536f582b req-7c5eb205-5e26-4114-8b66-afaf210be965 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0774753 Dec 21 03:46:26.603243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e68b53f-f0b9-4d75-a85d-3865fd2c1cce req-36fc028b-5f83-4277-b513-3d9746d07e20 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745823 Dec 21 03:46:26.650739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4b7cad8-ea6b-4e11-9de7-7f7f536f582b req-d910af48-ba90-4655-bf91-5305d4b376b1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507014 Dec 21 03:46:26.965174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f39e6f-a2a1-47f1-abd3-0fd7caa1a260 req-ad2cf900-e8de-4c12-8087-6ad5bf4848f5 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:26.967174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3f39e6f-a2a1-47f1-abd3-0fd7caa1a260 req-ad2cf900-e8de-4c12-8087-6ad5bf4848f5 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 949 time: 0.0564554 Dec 21 03:46:27.064613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5aa0829-cdb9-4380-ad07-e2d1c803b463 req-0b9961d3-e698-4928-844d-340c1072ff9c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.066109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5aa0829-cdb9-4380-ad07-e2d1c803b463 req-0b9961d3-e698-4928-844d-340c1072ff9c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 944 time: 0.0849881 Dec 21 03:46:27.069291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3f39e6f-a2a1-47f1-abd3-0fd7caa1a260 req-75bc7b71-25b0-44db-8ca9-9b7fd9792f00 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0868528 Dec 21 03:46:27.124616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5aa0829-cdb9-4380-ad07-e2d1c803b463 req-c64c5b3c-ccef-43b4-9d7f-13d1758872ae tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524004 Dec 21 03:46:27.179778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caee457d-4af5-4931-8da7-6dbd0c2ab84b req-c3a76aa6-db39-4fa9-adec-6f0c0877e253 tempest-AbsoluteLimitsNegativeTestJSON-405028134 tempest-AbsoluteLimitsNegativeTestJSON-405028134-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=8fc84c75ed12493ab5348240df7b720b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0225673 Dec 21 03:46:27.295573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-7753bcec-60a7-49cb-9d9d-8ed80c341383 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.296150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a33e46-26b1-4e71-87f3-c35176ea25b3 req-73b467a5-8306-4684-9a89-a666314ceaf6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.297262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75a33e46-26b1-4e71-87f3-c35176ea25b3 req-73b467a5-8306-4684-9a89-a666314ceaf6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1120067 Dec 21 03:46:27.297389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-7753bcec-60a7-49cb-9d9d-8ed80c341383 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1102 time: 0.0448596 Dec 21 03:46:27.353698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75a33e46-26b1-4e71-87f3-c35176ea25b3 req-88317161-1a57-4096-971e-1c1216057e46 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482481 Dec 21 03:46:27.382463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caee457d-4af5-4931-8da7-6dbd0c2ab84b req-6b21b996-7917-4973-b83a-0e5fb4a1a78b tempest-AbsoluteLimitsNegativeTestJSON-405028134 tempest-AbsoluteLimitsNegativeTestJSON-405028134-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.384269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caee457d-4af5-4931-8da7-6dbd0c2ab84b req-6b21b996-7917-4973-b83a-0e5fb4a1a78b tempest-AbsoluteLimitsNegativeTestJSON-405028134 tempest-AbsoluteLimitsNegativeTestJSON-405028134-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1973367 Dec 21 03:46:27.408604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caee457d-4af5-4931-8da7-6dbd0c2ab84b req-d9c32009-51c0-4552-b7c2-9e0055b070ac tempest-AbsoluteLimitsNegativeTestJSON-405028134 tempest-AbsoluteLimitsNegativeTestJSON-405028134-project] 10.222.0.18 "GET /v2.0/quotas/8fc84c75ed12493ab5348240df7b720b HTTP/1.1" status: 200 len: 375 time: 0.0179052 Dec 21 03:46:27.408817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-b31880a2-0867-4024-b033-c1c3b0c62fda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.410253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-b31880a2-0867-4024-b033-c1c3b0c62fda service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1044073 Dec 21 03:46:27.452756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caee457d-4af5-4931-8da7-6dbd0c2ab84b req-0fe51c85-dd22-4668-896a-7f8c45a63964 tempest-AbsoluteLimitsNegativeTestJSON-405028134 tempest-AbsoluteLimitsNegativeTestJSON-405028134-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=8fc84c75ed12493ab5348240df7b720b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0336347 Dec 21 03:46:27.472723 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-ee9b7139-e950-45dd-b719-07eaac803d57 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.114&port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 217 time: 0.0526323 Dec 21 03:46:27.543569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-ce3e7c71-41e7-472d-8a29-7ba458348b80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.545197 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-ce3e7c71-41e7-472d-8a29-7ba458348b80 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0574586 Dec 21 03:46:27.615226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-ca1e28f5-5223-4726-9905-0e858c5bb694 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.619091 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-ca1e28f5-5223-4726-9905-0e858c5bb694 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0620251 Dec 21 03:46:27.729130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-a4502477-4735-456a-822d-57f97027dabc service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1001258 Dec 21 03:46:27.744220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e1c980-6491-4ff0-b692-2d8d92bef036 req-26bbec9d-f219-40e1-a8e2-62efc43d287a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.756036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29e1c980-6491-4ff0-b692-2d8d92bef036 req-26bbec9d-f219-40e1-a8e2-62efc43d287a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0718999 Dec 21 03:46:27.817440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29e1c980-6491-4ff0-b692-2d8d92bef036 req-bd15b2ba-5554-4129-8ad7-6aacf2e9b762 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604069 Dec 21 03:46:27.854561 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-acdcfa10-2a94-4e5d-b797-58809c7dd3a2 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1164782 Dec 21 03:46:27.925324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae5c698-3687-4203-a928-5e5ca1256bc0 req-bf10f636-c78e-4aca-8dd8-572b242d8deb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:27.929761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ae5c698-3687-4203-a928-5e5ca1256bc0 req-bf10f636-c78e-4aca-8dd8-572b242d8deb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0560560 Dec 21 03:46:27.990750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ae5c698-3687-4203-a928-5e5ca1256bc0 req-3a7369c3-8956-46de-bd80-acfacc493ebb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517702 Dec 21 03:46:28.025839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:28.174490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e335b8f-ee9a-4735-84fc-aae6eca8990d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.230230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4490e4d7-08f5-4900-ad49-b4bd801be378 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:28.280830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e335b8f-ee9a-4735-84fc-aae6eca8990d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.299802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478fda22-d089-4e22-b6f0-86dfcd9c4484 req-bdb99270-9b18-410c-a2de-8c8eeef2164f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:28.301392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-478fda22-d089-4e22-b6f0-86dfcd9c4484 req-bdb99270-9b18-410c-a2de-8c8eeef2164f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 944 time: 0.0501881 Dec 21 03:46:28.365570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-478fda22-d089-4e22-b6f0-86dfcd9c4484 req-093878df-3ec4-4674-af38-85bdb002dd3a tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578966 Dec 21 03:46:28.410183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e335b8f-ee9a-4735-84fc-aae6eca8990d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.430681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 4490e4d7-08f5-4900-ad49-b4bd801be378 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:46:28.444260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 4490e4d7-08f5-4900-ad49-b4bd801be378 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:28.444780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.448214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e335b8f-ee9a-4735-84fc-aae6eca8990d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe42b1b3-0bba-4dff-9902-82f2e7dd6e4c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:28.455459 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6e335b8f-ee9a-4735-84fc-aae6eca8990d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8fc84c75ed12493ab5348240df7b720b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4254878 Dec 21 03:46:28.455720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:28.512754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9392-5089-4e7e-9deb-daee6dd59934 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.522241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c194bd-8e70-4ca5-b679-6b51391cac35 req-586c4550-5668-4005-b485-8886c8b1cf02 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:28.524033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5c194bd-8e70-4ca5-b679-6b51391cac35 req-586c4550-5668-4005-b485-8886c8b1cf02 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0731952 Dec 21 03:46:28.540432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9392-5089-4e7e-9deb-daee6dd59934 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.634260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5c194bd-8e70-4ca5-b679-6b51391cac35 req-641432f4-504f-4519-a7f7-573a581744ca tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037059 Dec 21 03:46:28.670675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9392-5089-4e7e-9deb-daee6dd59934 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.673503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a8e9392-5089-4e7e-9deb-daee6dd59934 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.674677 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a8e9392-5089-4e7e-9deb-daee6dd59934 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fe42b1b3-0bba-4dff-9902-82f2e7dd6e4c HTTP/1.1" status: 204 len: 168 time: 0.2180195 Dec 21 03:46:28.689093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a8e9392-5089-4e7e-9deb-daee6dd59934 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe42b1b3-0bba-4dff-9902-82f2e7dd6e4c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:28.758601 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.788305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4490e4d7-08f5-4900-ad49-b4bd801be378'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:28.791136 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6efb9d55-244b-43b2-8e6f-10eb06c15d21" -d '{"events": [{"server_uuid": "0fb974b6-7ee7-46ef-a7bc-358362b4ff2a", "name": "network-vif-plugged", "status": "completed", "tag": "4490e4d7-08f5-4900-ad49-b4bd801be378"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:28.806422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:28.835959 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82542119-1f99-413d-be16-e0e0ad547de6 x-openstack-request-id: req-82542119-1f99-413d-be16-e0e0ad547de6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:28.836335 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0fb974b6-7ee7-46ef-a7bc-358362b4ff2a", "name": "network-vif-plugged", "status": "completed", "tag": "4490e4d7-08f5-4900-ad49-b4bd801be378", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:28.836810 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-82542119-1f99-413d-be16-e0e0ad547de6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:28.837341 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'code': 200} Dec 21 03:46:28.877665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:28.952617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:28.960706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.961213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.961671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.962074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.962688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.963322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.964352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.964999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.965619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.966192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.966834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.967437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.968087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:28.980536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c5b621-0d00-4f55-ad11-c9f9770bee52 req-c0a1524e-d8e9-4da7-ae48-689eb545498c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:28.982091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48c5b621-0d00-4f55-ad11-c9f9770bee52 req-c0a1524e-d8e9-4da7-ae48-689eb545498c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0757406 Dec 21 03:46:29.047108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3c28fd-3ee9-43f5-a4f8-7fcd4c426fe7 req-45c7354b-5646-4eb9-8b2d-a778cdaca1b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:29.049514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a3c28fd-3ee9-43f5-a4f8-7fcd4c426fe7 req-45c7354b-5646-4eb9-8b2d-a778cdaca1b3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 1097 time: 0.0653241 Dec 21 03:46:29.081853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48c5b621-0d00-4f55-ad11-c9f9770bee52 req-80d7b714-59de-42c4-9f23-a549b670a3c8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862989 Dec 21 03:46:29.114810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a3c28fd-3ee9-43f5-a4f8-7fcd4c426fe7 req-8dadbfda-7890-42fe-9fd7-9c1526b267d9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562880 Dec 21 03:46:29.232473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a982428-e417-415b-97f0-6bb57d3631be req-36d5589e-4982-452c-8f5f-93e18a24a2f6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:29.232473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a982428-e417-415b-97f0-6bb57d3631be req-36d5589e-4982-452c-8f5f-93e18a24a2f6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0909457 Dec 21 03:46:29.281909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a982428-e417-415b-97f0-6bb57d3631be req-749ba3c6-e2f7-40da-8ffb-b6b97b03da31 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432985 Dec 21 03:46:29.655291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f6e39f-0207-4cea-bbff-9224cb0f4e65 req-4a879886-c93d-438d-9b20-c01c65783eed tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:29.670864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68f6e39f-0207-4cea-bbff-9224cb0f4e65 req-4a879886-c93d-438d-9b20-c01c65783eed tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0750453 Dec 21 03:46:29.678450 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-7cc878a7-b508-4da3-9b4f-355bb41e23bb service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0969555 Dec 21 03:46:29.745380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68f6e39f-0207-4cea-bbff-9224cb0f4e65 req-81ee83c6-d2db-4e40-843f-d681f042d80c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735462 Dec 21 03:46:29.817206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40fd8de1-9821-43d3-8211-5d8823fd8e60 req-3a5beb3d-6473-4d0c-9ac4-c71bf0e14f2d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:29.818856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40fd8de1-9821-43d3-8211-5d8823fd8e60 req-3a5beb3d-6473-4d0c-9ac4-c71bf0e14f2d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0558579 Dec 21 03:46:29.831409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-665b6ae2-962c-4148-99de-1bea9aea44a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:29.833150 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-665b6ae2-962c-4148-99de-1bea9aea44a4 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1096 time: 0.0452743 Dec 21 03:46:29.919962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40fd8de1-9821-43d3-8211-5d8823fd8e60 req-8ec617dd-510d-42fb-a3f7-8ad3b7569738 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894151 Dec 21 03:46:29.946606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:29.955062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45548) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:30.003011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-98984fbc-f1d2-4924-9735-2193a88e1e0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:30.004725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-98984fbc-f1d2-4924-9735-2193a88e1e0d service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1399751 Dec 21 03:46:30.063249 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-2adb9c50-55f9-4402-96f4-5d21aad1c7eb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.0463352 Dec 21 03:46:30.087124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.090635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1776710071-network', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:30.122549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:30.124578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-5df032e6-de6e-45a1-8779-2a0eb4af76f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:30.126645 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-5df032e6-de6e-45a1-8779-2a0eb4af76f9 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0481658 Dec 21 03:46:30.168146 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-7220eae3-b3e9-43a9-92e2-fe9a3734b59f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0336387 Dec 21 03:46:30.168557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.230827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd2efdb9-931b-4dae-b96e-d7d75f47ce67 req-2ae13646-dadb-45af-8221-bdbc7120f64a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:30.231634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:30.233130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd2efdb9-931b-4dae-b96e-d7d75f47ce67 req-2ae13646-dadb-45af-8221-bdbc7120f64a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0695798 Dec 21 03:46:30.234619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:30.239169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.272910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.283791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-f8c03693-ce4e-4325-bb59-60d71c072dd8 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1070731 Dec 21 03:46:30.324235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd2efdb9-931b-4dae-b96e-d7d75f47ce67 req-78180f9b-cb9d-44d9-8776-9e006f23aac1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803273 Dec 21 03:46:30.433516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.462168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1acd02-3a0f-49fe-ad37-2cf33f3e3fa9 req-2c2aeb53-0360-4a69-a5df-fd5a6176a6e3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:30.464080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e1acd02-3a0f-49fe-ad37-2cf33f3e3fa9 req-2c2aeb53-0360-4a69-a5df-fd5a6176a6e3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0724208 Dec 21 03:46:30.505885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.550412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e1acd02-3a0f-49fe-ad37-2cf33f3e3fa9 req-1a65756b-f06d-4cad-92f4-7f4822e653f9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784087 Dec 21 03:46:30.551165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:46:30.563154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee8f46ef-0867-4837-a5c1-b137634c081d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:30.568976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.569325 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Added segment 5469b806-d564-4fcf-b26d-9b436ec63f2a of type vlan for network e1f2bb15-a6a2-4b9b-b159-32c8384807ed Dec 21 03:46:30.625484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.713201 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b563d2f4-c19c-48c9-89ad-fa5ab467ca05 req-47f1bbea-9c23-4faf-b9c5-5ac17af4fdc2 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4207299 Dec 21 03:46:30.716663 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.717955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:30.718885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.797021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] Pushing event updated for resources: {'Network': ['ID=e1f2bb15-a6a2-4b9b-b159-32c8384807ed,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:30.803417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2d35b2a1-8bce-4a31-ba18-e9a369b194c6 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.8468871 Dec 21 03:46:30.805684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45572) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:30.813348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Request body: {'subnet': {'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestMultiNic-1776710071-subnet', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:30.816625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:46:30.841668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:30.844250 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-531be500-1360-4f2a-aa41-14b67bdccfb4" -d '{"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-unplugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:30.904996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:30.907383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:30.912095 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa19652b-42a3-429a-9042-1dd96a1b7485 x-openstack-request-id: req-aa19652b-42a3-429a-9042-1dd96a1b7485 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:30.912557 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-unplugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:30.913038 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-aa19652b-42a3-429a-9042-1dd96a1b7485 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:30.913691 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'code': 200} Dec 21 03:46:30.926235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c98370-7379-406b-924b-a65a68c9437d req-7b30ac72-f6a9-4121-8789-0239c6141fc9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:30.928935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41c98370-7379-406b-924b-a65a68c9437d req-7b30ac72-f6a9-4121-8789-0239c6141fc9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0616524 Dec 21 03:46:30.992034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41c98370-7379-406b-924b-a65a68c9437d req-4167993b-e67a-42f6-b834-6b4663b230be tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523386 Dec 21 03:46:31.052123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfc1719-2108-4182-9fd2-309bfc7b3d0a req-0abf91b1-adb8-4ade-bb21-3f6de3a41c76 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.060049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bfc1719-2108-4182-9fd2-309bfc7b3d0a req-0abf91b1-adb8-4ade-bb21-3f6de3a41c76 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0667305 Dec 21 03:46:31.135430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bfc1719-2108-4182-9fd2-309bfc7b3d0a req-ed87fb0b-0d94-4baa-827f-5e58a0119ae6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745721 Dec 21 03:46:31.161104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.161479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30341e79-1b46-4cb3-bad6-b624422d018e req-9a1f615a-99d9-463b-bac7-bd865ac93d31 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.161479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30341e79-1b46-4cb3-bad6-b624422d018e req-9a1f615a-99d9-463b-bac7-bd865ac93d31 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0707505 Dec 21 03:46:31.201326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Pushing event updated for resources: {'Subnet': ['ID=a7e49167-2a86-4f1d-8301-e4c25f706fd5,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:31.211885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30341e79-1b46-4cb3-bad6-b624422d018e req-0c24c635-bfd1-4e77-bef8-b0d29a460176 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470490 Dec 21 03:46:31.218345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.218345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.218569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.218822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.219171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.219525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.219879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.220201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.220531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.220862 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.221158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.221473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.221790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:31.233252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Checking segment: {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:31.233252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Network hostable DHCP agents. Network: e1f2bb15-a6a2-4b9b-b159-32c8384807ed, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:46:31.333923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:46:31.339894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74fe4dd-ec4e-4499-bb32-eebf878a1769 req-92a12bd4-5581-4e84-a455-551b12703faa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.341537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f74fe4dd-ec4e-4499-bb32-eebf878a1769 req-92a12bd4-5581-4e84-a455-551b12703faa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0517881 Dec 21 03:46:31.392541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f74fe4dd-ec4e-4499-bb32-eebf878a1769 req-e942ff42-87e7-4557-8c9d-7677dd727f9c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436497 Dec 21 03:46:31.450137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e1f2bb15-a6a2-4b9b-b159-32c8384807ed) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:31.456257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.456866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.464520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21b2ea51-651e-4a60-8904-809147923147 None None] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:31.472422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25208440-b9a3-4f0b-9298-dd1507719fca req-233cf9f3-1cbd-462d-af49-caeaf4dcaf42 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.482197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25208440-b9a3-4f0b-9298-dd1507719fca req-233cf9f3-1cbd-462d-af49-caeaf4dcaf42 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0784557 Dec 21 03:46:31.553953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25208440-b9a3-4f0b-9298-dd1507719fca req-4a9f0035-3414-4bdb-b036-5bc6a247ed92 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708842 Dec 21 03:46:31.569597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bed332ee-9cd9-4529-acd0-0f5b17e8c736 req-a0ef251d-6a35-4cc2-848e-7256f61ae786 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.571163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bed332ee-9cd9-4529-acd0-0f5b17e8c736 req-a0ef251d-6a35-4cc2-848e-7256f61ae786 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0723023 Dec 21 03:46:31.581813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-e1f2bb15-a6a2-4b9b-b159-32c8384807ed', 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed', 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'fixed_ips': [{'subnet_id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:46:31.583271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.588070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-91f3412d-315f-4681-981c-1ddd81253ecc admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7808332 Dec 21 03:46:31.588711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:31.595248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Request body: {'router': {'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:31.648817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bed332ee-9cd9-4529-acd0-0f5b17e8c736 req-f7009a19-a99d-4692-b377-d3f462c82b6c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544331 Dec 21 03:46:31.706355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.706851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.730600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa87e5d4-d738-414f-9541-656bb337679a req-c6a6a2a0-4b31-4cd5-8190-b4bbe9f5fbdd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.739365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa87e5d4-d738-414f-9541-656bb337679a req-c6a6a2a0-4b31-4cd5-8190-b4bbe9f5fbdd tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0742800 Dec 21 03:46:31.775458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Allocated IP 172.20.0.2 (e1f2bb15-a6a2-4b9b-b159-32c8384807ed/a7e49167-2a86-4f1d-8301-e4c25f706fd5/e05e8bec-ac7f-4a7b-b5d1-1db09862014f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:31.784301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.807572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa87e5d4-d738-414f-9541-656bb337679a req-b93fc55a-9f4c-4010-b622-3ca818b1e634 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673363 Dec 21 03:46:31.935140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b218ece-d863-4cdc-8b41-89f873526713 req-cac3dd43-6450-4717-99f8-eaf8d504af7f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:31.938375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b218ece-d863-4cdc-8b41-89f873526713 req-cac3dd43-6450-4717-99f8-eaf8d504af7f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0551403 Dec 21 03:46:31.961256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:31.979809 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:31.989706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b218ece-d863-4cdc-8b41-89f873526713 req-93ced02f-5f74-4797-bf7a-469d88993496 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458302 Dec 21 03:46:32.016751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.048821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.096669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:32.108324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:32.110204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c56229a0-b69d-4739-a39d-3b6cd0070e19 req-7d82139b-aed3-4ba8-8fe1-4d252043fc6c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.111252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:32.118472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c56229a0-b69d-4739-a39d-3b6cd0070e19 req-7d82139b-aed3-4ba8-8fe1-4d252043fc6c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0578356 Dec 21 03:46:32.125566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:32.142053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Pushing event updated for resources: {'Port': ['ID=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:32.161451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'mac_address': 'fa:16:3e:56:8d:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.21'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:32.163493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c56229a0-b69d-4739-a39d-3b6cd0070e19 req-0dfa1556-527b-460b-9f99-94195b5a7534 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437467 Dec 21 03:46:32.221058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Attempting to bind port e05e8bec-ac7f-4a7b-b5d1-1db09862014f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:32.221640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Attempting to bind port e05e8bec-ac7f-4a7b-b5d1-1db09862014f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:32.222113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Attempting to bind port e05e8bec-ac7f-4a7b-b5d1-1db09862014f on network e1f2bb15-a6a2-4b9b-b159-32c8384807ed {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:32.234760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:32.236066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Checking segment: {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:32.236786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.237293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Bound using segment: {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:32.237889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Bound port: e05e8bec-ac7f-4a7b-b5d1-1db09862014f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:32.238378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.260818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.304007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eccc8c5c-70cc-45fa-b816-4e666ed149dd {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:32.328579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ecce151-c8ad-4815-87c4-90e5e0528e40 req-1b792476-81c9-49b8-96e0-430fed3c7cbd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.330116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ecce151-c8ad-4815-87c4-90e5e0528e40 req-1b792476-81c9-49b8-96e0-430fed3c7cbd tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0823481 Dec 21 03:46:32.340578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:32.341363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.347958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] For port e05e8bec-ac7f-4a7b-b5d1-1db09862014f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:32.353937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] For port e05e8bec-ac7f-4a7b-b5d1-1db09862014f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:32.364745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.370116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c6ed3d-d731-4694-a66c-5e79845c81e3 req-1569e788-f73b-4f51-8bfe-0a86e86ee6c0 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.371653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00c6ed3d-d731-4694-a66c-5e79845c81e3 req-1569e788-f73b-4f51-8bfe-0a86e86ee6c0 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.1104629 Dec 21 03:46:32.379958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-4ef986c3-73fc-4f8a-9202-4fc45b40729f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0821171 Dec 21 03:46:32.416195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ecce151-c8ad-4815-87c4-90e5e0528e40 req-c0020480-4414-421f-ba85-c9d14dd6c082 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765462 Dec 21 03:46:32.439097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00c6ed3d-d731-4694-a66c-5e79845c81e3 req-43c9cdd3-b3f6-42f4-9404-b6b397673daf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611300 Dec 21 03:46:32.483350 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.506975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-770db499-1cf0-4540-b8f6-7fa595e1ba1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.508494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-770db499-1cf0-4540-b8f6-7fa595e1ba1b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 1102 time: 0.0809054 Dec 21 03:46:32.513243 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.533545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Allocated IP 172.25.5.54 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/f5fc55e1-56b4-443a-a322-879452c583dc) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:32.552623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:32.589702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b3492f-6d3c-4498-82a3-7650237f7ab7 req-2549a53d-afc5-45c3-b66d-155b58362629 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.601236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4b3492f-6d3c-4498-82a3-7650237f7ab7 req-2549a53d-afc5-45c3-b66d-155b58362629 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0905640 Dec 21 03:46:32.622918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a67976-65b4-4bad-9fca-b2e2718949c5 None None] Pushing event updated for resources: {'Port': ['ID=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:32.706006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4b3492f-6d3c-4498-82a3-7650237f7ab7 req-1d9ee816-7308-4c79-a7a4-655c39ea57dc tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039703 Dec 21 03:46:32.722470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['eccc8c5c-70cc-45fa-b816-4e666ed149dd'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:32.732461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63cf0d5-ebec-4621-91c3-8780c61f5de5 req-bdf1cb1b-5cb6-41f3-a6c8-0a309eff3387 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.732998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-e6961e0a-e527-4b2f-b668-ec69565aef2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.734342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c63cf0d5-ebec-4621-91c3-8780c61f5de5 req-bdf1cb1b-5cb6-41f3-a6c8-0a309eff3387 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0842226 Dec 21 03:46:32.734506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-e6961e0a-e527-4b2f-b668-ec69565aef2c service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1910386 Dec 21 03:46:32.821554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-cb457331-2f6c-475f-a42a-b4b79651c126 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.154&port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 200 len: 217 time: 0.0725832 Dec 21 03:46:32.832491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c63cf0d5-ebec-4621-91c3-8780c61f5de5 req-e0030a51-eec1-46c0-8178-e83f102987e7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902526 Dec 21 03:46:32.850971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:32.902378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-6c77e253-595d-4a9c-87cd-9e23a4f3a41f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.909267 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-6c77e253-595d-4a9c-87cd-9e23a4f3a41f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0758946 Dec 21 03:46:32.975394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-660c928b-7a11-4a81-a9d7-29dfbc4e66fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:32.976908 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-660c928b-7a11-4a81-a9d7-29dfbc4e66fb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0579975 Dec 21 03:46:33.032616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:33.104296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e0035d-18c0-4cc4-bb7b-c5123f6d8aa3 req-e19daf81-9197-4027-89ef-cf4d9513350b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:33.105692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4e0035d-18c0-4cc4-bb7b-c5123f6d8aa3 req-e19daf81-9197-4027-89ef-cf4d9513350b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0490046 Dec 21 03:46:33.122788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:33.127810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Pushing event updated for resources: {'Port': ['ID=f5fc55e1-56b4-443a-a322-879452c583dc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:33.128952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:33.132207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:33.173720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4e0035d-18c0-4cc4-bb7b-c5123f6d8aa3 req-c4b49c60-513b-4107-b356-ee2b81bcfa08 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607955 Dec 21 03:46:33.179022 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-94a617b8-f266-4f15-bd1e-74f1ad8a2f2f service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1729891 Dec 21 03:46:33.383403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d7df5dfd-3487-4071-b73a-d4607f4e8a5d req-1ddee2a6-d42b-402a-84e3-f9fcc91e86d4 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1956968 Dec 21 03:46:33.587791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e2b8371-7901-4ab4-89ad-1305146901cc req-805a8ec0-4618-4170-89ab-e07ae578af61 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:33.595399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e2b8371-7901-4ab4-89ad-1305146901cc req-805a8ec0-4618-4170-89ab-e07ae578af61 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0858276 Dec 21 03:46:33.650694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:33.651580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e2b8371-7901-4ab4-89ad-1305146901cc req-72ea2795-f9f6-4d8f-9b90-0920dd7f228c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552480 Dec 21 03:46:33.680281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8458e3f7-0165-4818-8e51-43324fc5c206 None None] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:33.800469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666e8139-1736-4ee9-858c-4937d23827d5 req-c60c53ae-b794-4f0c-b86d-5424ab9ee1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:33.802351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-666e8139-1736-4ee9-858c-4937d23827d5 req-c60c53ae-b794-4f0c-b86d-5424ab9ee1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0714083 Dec 21 03:46:33.830967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-edb74f52-cfc9-427d-9913-1e55fdfbd778 None None] Provisioning complete for port e05e8bec-ac7f-4a7b-b5d1-1db09862014f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:33.831597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-edb74f52-cfc9-427d-9913-1e55fdfbd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:33.878004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:33.899590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-666e8139-1736-4ee9-858c-4937d23827d5 req-b7187a42-7c07-44f3-be36-8ff32daed717 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828059 Dec 21 03:46:33.939031 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-edb74f52-cfc9-427d-9913-1e55fdfbd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:33.969604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:34.041933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-edb74f52-cfc9-427d-9913-1e55fdfbd778 None None] For port e05e8bec-ac7f-4a7b-b5d1-1db09862014f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:34.067477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port eccc8c5c-70cc-45fa-b816-4e666ed149dd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:34.068042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.105478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c56d93-7f3f-44b7-8593-1d7e18375dc8 req-6ddbcf59-6ef5-4a8b-9ff5-8b96cc4c9157 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:34.119786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3c56d93-7f3f-44b7-8593-1d7e18375dc8 req-6ddbcf59-6ef5-4a8b-9ff5-8b96cc4c9157 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1418786 Dec 21 03:46:34.123269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e05e8bec-ac7f-4a7b-b5d1-1db09862014f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:34.162542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:46:34.184267 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-edb74f52-cfc9-427d-9913-1e55fdfbd778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.191567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3c56d93-7f3f-44b7-8593-1d7e18375dc8 req-f28a4330-f8c9-4790-a3b3-d6c7379ffb19 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706444 Dec 21 03:46:34.263704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb74f52-cfc9-427d-9913-1e55fdfbd778 None None] Pushing event updated for resources: {'Port': ['ID=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:34.320572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e05e8bec-ac7f-4a7b-b5d1-1db09862014f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:34.321037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.355099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:46:34.367833 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Sync routers for ids ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:46:34.374667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad55b818-94b1-478d-9e83-a7679a1969f1 req-919d7b71-0834-49db-adb0-4fd4aad7cbc7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:34.376590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad55b818-94b1-478d-9e83-a7679a1969f1 req-919d7b71-0834-49db-adb0-4fd4aad7cbc7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0994077 Dec 21 03:46:34.379818 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Routers {'3524514a-1e59-47e1-a83a-b0a5af9e17c3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:46:34.380760 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:34.412036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.416035 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d71a997a-7fa2-43c3-a83f-90f535dd0ea0 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.8235548 Dec 21 03:46:34.416995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45688) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:34.425263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-35349c7c-e642-4d82-9f2f-494d53415897 None None] Provisioning complete for port e05e8bec-ac7f-4a7b-b5d1-1db09862014f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:34.425640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35349c7c-e642-4d82-9f2f-494d53415897 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.468350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad55b818-94b1-478d-9e83-a7679a1969f1 req-c03f5338-f951-41e0-b251-594c8d9e0e71 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838723 Dec 21 03:46:34.516524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.549418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:34.551638 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f085268d-69ff-499a-a6df-5ec57f78e2bc" -d '{"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-plugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:34.559119 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Set router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:46:34.607905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:34.621616 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83617073-9714-47f9-b145-75c2d760eeda x-openstack-request-id: req-83617073-9714-47f9-b145-75c2d760eeda {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:34.621912 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-plugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:34.622170 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-83617073-9714-47f9-b145-75c2d760eeda {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:34.622608 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'code': 200} Dec 21 03:46:34.665361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.738809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:34.754389 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:46:33Z', 'revision_number': 3, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:34.787179 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Checking router: 3524514a-1e59-47e1-a83a-b0a5af9e17c3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:46:34.787725 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Updating router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 port f5fc55e1-56b4-443a-a322-879452c583dc binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:46:34.799189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ef60fe-09f5-4838-bdb3-6fe4dc0ccee5 req-e841d161-4533-4189-abba-55c12c1cac66 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:34.808904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36ef60fe-09f5-4838-bdb3-6fe4dc0ccee5 req-e841d161-4533-4189-abba-55c12c1cac66 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0597286 Dec 21 03:46:34.841027 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:34.903824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36ef60fe-09f5-4838-bdb3-6fe4dc0ccee5 req-3ab1ea1d-8724-4eda-a5ed-7bd2b4a9098b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859430 Dec 21 03:46:35.071062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee164f5-57ad-4672-8a95-5b786057d9d0 req-af327b47-f15b-4b0a-a34b-22618704a8a3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:35.073702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ee164f5-57ad-4672-8a95-5b786057d9d0 req-af327b47-f15b-4b0a-a34b-22618704a8a3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.0761511 Dec 21 03:46:35.120593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.162627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ee164f5-57ad-4672-8a95-5b786057d9d0 req-b95f722e-68fe-4c72-ac5f-251598c6bd20 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808837 Dec 21 03:46:35.226975 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.322304 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.358898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e57489-87d3-4f4f-9cf4-09744784bf03 req-bf55b237-821d-4466-ae0a-1422f808ba05 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:35.361293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21e57489-87d3-4f4f-9cf4-09744784bf03 req-bf55b237-821d-4466-ae0a-1422f808ba05 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0770140 Dec 21 03:46:35.373245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Allocated IP 172.20.0.1 (e1f2bb15-a6a2-4b9b-b159-32c8384807ed/a7e49167-2a86-4f1d-8301-e4c25f706fd5/3940a4ac-09dc-4221-b41b-857f5d916950) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:35.408865 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Attempting to bind port f5fc55e1-56b4-443a-a322-879452c583dc on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:35.409462 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Attempting to bind port f5fc55e1-56b4-443a-a322-879452c583dc by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:35.409949 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Attempting to bind port f5fc55e1-56b4-443a-a322-879452c583dc on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:35.423888 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:35.424668 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:35.425287 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.425882 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:35.426571 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Bound port: f5fc55e1-56b4-443a-a322-879452c583dc, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:35.427293 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.484071 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] For port f5fc55e1-56b4-443a-a322-879452c583dc, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:35.491442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] For port f5fc55e1-56b4-443a-a322-879452c583dc, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f5fc55e1-56b4-443a-a322-879452c583dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:35.497797 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfa4707c-fd1e-425f-a673-89fba5105a09 None None] Pushing event updated for resources: {'Port': ['ID=f5fc55e1-56b4-443a-a322-879452c583dc,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:35.503730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21e57489-87d3-4f4f-9cf4-09744784bf03 req-1f446221-c653-42c7-81cd-8cfe3d7c24ce tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1297579 Dec 21 03:46:35.558071 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.573915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.665646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.681603 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfa4707c-fd1e-425f-a673-89fba5105a09 None None] Pushing event updated for resources: {'Port': ['ID=f5fc55e1-56b4-443a-a322-879452c583dc,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:35.687156 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Routers {'3524514a-1e59-47e1-a83a-b0a5af9e17c3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:46:35.688022 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:35.704491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc9eccf-8131-458d-803d-cf5b1afe7f34 req-8fc084a0-ab05-4bb0-8895-9ad14ea94118 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:35.708713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bc9eccf-8131-458d-803d-cf5b1afe7f34 req-8fc084a0-ab05-4bb0-8895-9ad14ea94118 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.1135254 Dec 21 03:46:35.741602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:35.746866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:35.751750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:35.797455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Pushing event updated for resources: {'Port': ['ID=3940a4ac-09dc-4221-b41b-857f5d916950,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:35.819307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:35.821788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bc9eccf-8131-458d-803d-cf5b1afe7f34 req-4a13bf7c-868d-4a01-aa12-868404597cc2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069911 Dec 21 03:46:35.834004 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] Set router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:46:35.948877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e05e8bec-ac7f-4a7b-b5d1-1db09862014f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:36.050220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e05e8bec-ac7f-4a7b-b5d1-1db09862014f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:36.050687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:36.103647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316c3a1f-a15d-4ec4-875e-63d5d8319b7a req-6b93afa8-00d7-4f12-8ceb-c1d62bd53537 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:36.105366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-316c3a1f-a15d-4ec4-875e-63d5d8319b7a req-6b93afa8-00d7-4f12-8ceb-c1d62bd53537 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0909553 Dec 21 03:46:36.150771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:36.178512 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:46:33Z', 'revision_number': 3, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:36.208734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-afaac01b-261c-41f3-bf00-a0f5d7d6d1e2 None None] Provisioning complete for port 3940a4ac-09dc-4221-b41b-857f5d916950 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:36.210790 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afaac01b-261c-41f3-bf00-a0f5d7d6d1e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:36.214384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5cdf9-49ad-429f-91c6-89aa4e51a1fa None None] The sync data for ids ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'] in n-d-822053-11 is: [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:46:33Z', 'revision_number': 3, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:46:36.254329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-316c3a1f-a15d-4ec4-875e-63d5d8319b7a req-a97976e8-3dfc-4287-a902-cb2d3c91d078 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1331215 Dec 21 03:46:36.323841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4490e4d7-08f5-4900-ad49-b4bd801be378 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:36.425520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:36.428469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9616eee0-a60d-48a5-a109-7d8861886af6 req-5146a69f-15a3-4458-9ea3-b2446acf9203 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:36.436990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9616eee0-a60d-48a5-a109-7d8861886af6 req-5146a69f-15a3-4458-9ea3-b2446acf9203 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 945 time: 0.1356261 Dec 21 03:46:36.494269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9616eee0-a60d-48a5-a109-7d8861886af6 req-092b6277-2589-4ccb-8777-94b3a96ee140 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561595 Dec 21 03:46:36.499689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:36.637989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Pushing event updated for resources: {'Port': ['ID=3940a4ac-09dc-4221-b41b-857f5d916950,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:36.701780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589ad1c8-37bb-4e10-80be-825876b7cd79 req-5ed13d04-0dff-400d-b9f1-4fc90b5e68e9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:36.702406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:36.706878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-589ad1c8-37bb-4e10-80be-825876b7cd79 req-5ed13d04-0dff-400d-b9f1-4fc90b5e68e9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0603123 Dec 21 03:46:36.781569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-589ad1c8-37bb-4e10-80be-825876b7cd79 req-be0f9059-78f1-421f-8c9b-69aa3fc4e930 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651240 Dec 21 03:46:36.836762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-afaac01b-261c-41f3-bf00-a0f5d7d6d1e2 None None] Port 3940a4ac-09dc-4221-b41b-857f5d916950 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:36.906898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:36.934323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'port_id': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'mac_address': 'fa:16:3e:dc:9a:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec8e3a7f-1bef-41ac-8b72-508d262fe30c', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:36.949253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:36.953621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:36.991095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3704f61-c1e0-4a38-84d8-733054be56b3 req-22984122-96fc-474f-94b4-39bbe3073276 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:37.000167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3704f61-c1e0-4a38-84d8-733054be56b3 req-22984122-96fc-474f-94b4-39bbe3073276 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0679843 Dec 21 03:46:37.036483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:37.070015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4490e4d7-08f5-4900-ad49-b4bd801be378 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:37.112346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3704f61-c1e0-4a38-84d8-733054be56b3 req-fa4fc44a-a65f-4538-84a6-23e22b9be134 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110640 Dec 21 03:46:37.132032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:37.202488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:37.348157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:37.384441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7c89f631-306b-4966-be0e-cc34622950d0 None None] Provisioning complete for port 3940a4ac-09dc-4221-b41b-857f5d916950 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:37.384804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c89f631-306b-4966-be0e-cc34622950d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:37.435393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['4490e4d7-08f5-4900-ad49-b4bd801be378'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:37.453507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a83764-7467-4ac4-9424-92ba06bd4aba req-ae48b95e-e4d7-4c5d-a54f-387e500bd7ba tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:37.458970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76a83764-7467-4ac4-9424-92ba06bd4aba req-ae48b95e-e4d7-4c5d-a54f-387e500bd7ba tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0870743 Dec 21 03:46:37.480794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7c89f631-306b-4966-be0e-cc34622950d0 None None] Port 3940a4ac-09dc-4221-b41b-857f5d916950 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:37.595902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76a83764-7467-4ac4-9424-92ba06bd4aba req-a55e31c1-2344-4109-8af1-db49f49e9372 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1274054 Dec 21 03:46:37.716441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:46:37.799665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a8a8c4-eb99-49bd-ba9f-5e8dcee8f672 req-d3c0dbc5-d316-4332-aefe-3594595e8b57 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:37.804675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03a8a8c4-eb99-49bd-ba9f-5e8dcee8f672 req-d3c0dbc5-d316-4332-aefe-3594595e8b57 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 944 time: 0.0997808 Dec 21 03:46:37.885097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:46:37.899308 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dcb167e0-9a1a-4e6b-879d-9e59ef16c8ee admin admin] 10.222.0.18 "PUT /v2.0/routers/3524514a-1e59-47e1-a83a-b0a5af9e17c3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4810622 Dec 21 03:46:37.902544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03a8a8c4-eb99-49bd-ba9f-5e8dcee8f672 req-bd31251d-4cac-4f18-b003-03aac10467ee tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852220 Dec 21 03:46:38.060985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f5fc55e1-56b4-443a-a322-879452c583dc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:38.110438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ad7a10-85f2-47b5-9471-9bd596127d48 req-8c121b0a-bee5-48ea-a0eb-784b28210350 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:38.118242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ad7a10-85f2-47b5-9471-9bd596127d48 req-8c121b0a-bee5-48ea-a0eb-784b28210350 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1078005 Dec 21 03:46:38.136787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f5fc55e1-56b4-443a-a322-879452c583dc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:38.138622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.141428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45776) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:38.210141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ad7a10-85f2-47b5-9471-9bd596127d48 req-636a08ed-9101-4ec3-abab-bd644ae31e9c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866613 Dec 21 03:46:38.233904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-53284301'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:38.315569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.337893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0208d8f4-376a-4100-b17d-a3101ac0a577 req-1432d292-97a6-4135-a046-999028d34fa2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:38.345511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4490e4d7-08f5-4900-ad49-b4bd801be378 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:38.346459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0208d8f4-376a-4100-b17d-a3101ac0a577 req-1432d292-97a6-4135-a046-999028d34fa2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 945 time: 0.0616407 Dec 21 03:46:38.354334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port f5fc55e1-56b4-443a-a322-879452c583dc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f5fc55e1-56b4-443a-a322-879452c583dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:38.362808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:38.368404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.418073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0208d8f4-376a-4100-b17d-a3101ac0a577 req-fe08bd5b-edbe-43a3-9e4a-980cf1eedde7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705214 Dec 21 03:46:38.433962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-0b219836-734e-4123-8892-ba307ae03464 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:38.436143 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-0b219836-734e-4123-8892-ba307ae03464 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.1753514 Dec 21 03:46:38.450478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:46:38.458434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:38.466587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.523733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.524216 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.524622 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Added segment 19106602-1c52-4fa6-98dd-9ea225025426 of type vlan for network 6ab64731-1736-45c2-9cd4-cd4313abad0e Dec 21 03:46:38.560072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 4490e4d7-08f5-4900-ad49-b4bd801be378 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:38.569762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=f5fc55e1-56b4-443a-a322-879452c583dc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:38.588589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:38.651007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.659307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.701651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.720664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d3b0767-b27e-4627-9663-e7c7568120ea req-00f5a966-a8c6-439f-bc08-f559cca53720 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:38.730778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d3b0767-b27e-4627-9663-e7c7568120ea req-00f5a966-a8c6-439f-bc08-f559cca53720 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 944 time: 0.0920601 Dec 21 03:46:38.753684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:38.866535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.872380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:38.873464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:38.875114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb635b9-8fc4-43c1-96c3-77c55c1dcf4c req-f27d049f-275d-4b91-86b1-251b0979c485 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:38.879723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cb635b9-8fc4-43c1-96c3-77c55c1dcf4c req-f27d049f-275d-4b91-86b1-251b0979c485 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1124692 Dec 21 03:46:38.883250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d3b0767-b27e-4627-9663-e7c7568120ea req-22556c5d-1662-4368-b14e-73eb91319e0c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1515939 Dec 21 03:46:38.966029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cb635b9-8fc4-43c1-96c3-77c55c1dcf4c req-54a2b4e6-5693-406e-a783-cfa0c9fab865 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811613 Dec 21 03:46:38.978100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Sync routers for ids ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:46:38.998719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Routers {'3524514a-1e59-47e1-a83a-b0a5af9e17c3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:46:38.999483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:39.061186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Network': ['ID=6ab64731-1736-45c2-9cd4-cd4313abad0e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:39.097080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:39.099159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:46:39.128294 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b18127e3-83b8-44ae-865d-c00b6b73f111 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9850461 Dec 21 03:46:39.131075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45798) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:39.136241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'subnet': {'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e', 'cidr': '19.80.0.0/24', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:39.201382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:39.236145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Set router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:46:39.305112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:39.307589 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc260a5f-f91d-4b0f-bc21-85cf688a0437" -d '{"events": [{"server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "name": "network-vif-unplugged", "status": "completed", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:39.312365 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:39.350254 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c55da0d-3da0-4327-b11a-b656353d41bd x-openstack-request-id: req-2c55da0d-3da0-4327-b11a-b656353d41bd {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:39.350995 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "name": "network-vif-unplugged", "status": "completed", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:39.351457 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2c55da0d-3da0-4327-b11a-b656353d41bd {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:39.351835 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'code': 200} Dec 21 03:46:39.407914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:39.425477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b4ad0e-ddc5-4d4a-8530-bec67f9f99a1 req-701d8b2e-9a65-44ea-bbba-68da5f0b17df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:39.433699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7b4ad0e-ddc5-4d4a-8530-bec67f9f99a1 req-701d8b2e-9a65-44ea-bbba-68da5f0b17df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0668399 Dec 21 03:46:39.486997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:39.490680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:39.494075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:39.528841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:46:36Z', 'revision_number': 4, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3940a4ac-09dc-4221-b41b-857f5d916950', 'name': '', 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'mac_address': 'fa:16:3e:6e:6c:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:35Z', 'updated_at': '2021-12-21T03:46:36Z', 'revision_number': 2, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'subnets': [{'id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:39.566173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Checking router: 3524514a-1e59-47e1-a83a-b0a5af9e17c3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:46:39.566636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Updating router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 port 3940a4ac-09dc-4221-b41b-857f5d916950 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:46:39.592111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:39.592845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:39.593454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:39.595596 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:39.608177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:39.619250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Attempting to bind port b1bddbab-3a32-4687-b97f-eada22b71c0f on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:39.625865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:39.628503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:39.628503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:39.628503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Bound port: b1bddbab-3a32-4687-b97f-eada22b71c0f, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:39.628503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:39.769737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:39.796102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:39.895625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:39.896216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7b4ad0e-ddc5-4d4a-8530-bec67f9f99a1 req-997789da-3773-45fd-b6c0-d3c7fbe92355 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4603617 Dec 21 03:46:39.901366 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.021575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce0cedd-982c-4f45-9d0b-bfefb0141613 req-da35c01b-0e25-4a77-a641-a01aa339c1f7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.035551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ce0cedd-982c-4f45-9d0b-bfefb0141613 req-da35c01b-0e25-4a77-a641-a01aa339c1f7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.2309291 Dec 21 03:46:40.065314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=8']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:40.107537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.108411 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.110958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-24db9c51-eab9-48ea-bc4f-6e15c225213e service neutron] 10.222.0.54 "PUT /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 1123 time: 1.6570225 Dec 21 03:46:40.116591 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.122979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:40.125139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f5fc55e1-56b4-443a-a322-879452c583dc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:40.134551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Subnet': ['ID=02556e47-25b2-4c72-a874-afa8b0d11077,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:40.172545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.173435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.173936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.174505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.174746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.175190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.175727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.176011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.176403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.177133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.177133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.177512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.177937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:46:40.197572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Checking segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:40.198026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network hostable DHCP agents. Network: 6ab64731-1736-45c2-9cd4-cd4313abad0e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:46:40.215708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec73302-2366-450d-a276-6be27e444602 req-7f28c998-bbb6-4934-a90c-c45bec03f964 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.223703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ec73302-2366-450d-a276-6be27e444602 req-7f28c998-bbb6-4934-a90c-c45bec03f964 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 943 time: 0.1756661 Dec 21 03:46:40.226829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f5fc55e1-56b4-443a-a322-879452c583dc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:40.232910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.251147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ce0cedd-982c-4f45-9d0b-bfefb0141613 req-51f73225-0500-41a2-b4ff-9abf1b37aaec tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2115629 Dec 21 03:46:40.295656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.322504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b1bddbab-3a32-4687-b97f-eada22b71c0f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:40.370170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['b1bddbab-3a32-4687-b97f-eada22b71c0f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:40.383850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ec73302-2366-450d-a276-6be27e444602 req-05e6441e-5a99-42d5-baf2-e9a2915cb8a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1588666 Dec 21 03:46:40.391473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:46:40.422895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d899733-5737-451f-9660-490f94d20644 req-d6371550-3835-445f-b502-fe641a88098c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.424445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d899733-5737-451f-9660-490f94d20644 req-d6371550-3835-445f-b502-fe641a88098c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0746517 Dec 21 03:46:40.488753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6ab64731-1736-45c2-9cd4-cd4313abad0e) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:40.495240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.496338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.507334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-349f994e-e057-4386-a2ac-5ec80fdb5253 None None] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:40.513892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d899733-5737-451f-9660-490f94d20644 req-96973447-36a5-489d-84fd-9727688693d1 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699284 Dec 21 03:46:40.525538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:40.604194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ba21020e-dcc5-4dc6-b288-dc5ca115fd2d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.4718285 Dec 21 03:46:40.606819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45828) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:40.611980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-258214774'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:40.661694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-cd2ff3cd-155c-4109-aaa0-bd6902e147c5 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.663443 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-cd2ff3cd-155c-4109-aaa0-bd6902e147c5 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 943 time: 0.0707693 Dec 21 03:46:40.673888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6cf8a4a-2cfe-459f-abba-0fa490f28688 None None] Pushing event updated for resources: {'Port': ['ID=3940a4ac-09dc-4221-b41b-857f5d916950,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:40.739680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:40.743267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.802223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:46:40.816430 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.816838 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Added segment 7b4d34cf-3c63-49c3-abdd-3f6308c046d4 of type vlan for network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 Dec 21 03:46:40.820042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Deleting port 4490e4d7-08f5-4900-ad49-b4bd801be378 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:46:40.821018 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.883702 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.952586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] For port 4490e4d7-08f5-4900-ad49-b4bd801be378, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4490e4d7-08f5-4900-ad49-b4bd801be378,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:40.953073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.966817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Calling delete_port for 4490e4d7-08f5-4900-ad49-b4bd801be378 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:46:40.979607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:40.987180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:40.987953 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.002356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-6ab64731-1736-45c2-9cd4-cd4313abad0e', 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e', 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'fixed_ips': [{'subnet_id': '02556e47-25b2-4c72-a874-afa8b0d11077'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:46:41.004566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.107728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Attempting to bind port 3940a4ac-09dc-4221-b41b-857f5d916950 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:41.108068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Attempting to bind port 3940a4ac-09dc-4221-b41b-857f5d916950 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:41.108363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Attempting to bind port 3940a4ac-09dc-4221-b41b-857f5d916950 on network e1f2bb15-a6a2-4b9b-b159-32c8384807ed {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:41.110923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:46:41.171686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:41.172426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Checking segment: {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:41.172739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.173625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Bound using segment: {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:41.174134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Bound port: 3940a4ac-09dc-4221-b41b-857f5d916950, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5469b806-d564-4fcf-b26d-9b436ec63f2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:41.174488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.176161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.5681005 Dec 21 03:46:41.179722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:41.182500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838c29b4-1f1d-465f-89c0-78513d8e6ede tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Network': ['ID=9ac60f83-5dc7-4da3-bc95-925c1ce35491,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:41.195662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcba58e-ccb5-4510-9eec-f185848a9fbb req-9e7570e9-a049-4a46-aebf-3dfc3c4a4453 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:41.198980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'subnet': {'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491', 'cidr': '19.86.0.0/24', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:41.200968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dcba58e-ccb5-4510-9eec-f185848a9fbb req-9e7570e9-a049-4a46-aebf-3dfc3c4a4453 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.2002742 Dec 21 03:46:41.248775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:46:41.273423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dcba58e-ccb5-4510-9eec-f185848a9fbb req-07c6116c-2825-4d69-b5d9-03003e5ce2ac tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713615 Dec 21 03:46:41.308456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.356824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f726ac3-a504-4a48-bac4-592597f0a8d2 None None] Provisioning complete for port 3940a4ac-09dc-4221-b41b-857f5d916950 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:41.357187 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f726ac3-a504-4a48-bac4-592597f0a8d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.371621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:41.374297 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3" -d '{"events": [{"name": "network-changed", "server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:41.381045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event deleted for resources: {'Port': ['ID=4490e4d7-08f5-4900-ad49-b4bd801be378,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:41.420851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] No DVR routers for this DVR port 4490e4d7-08f5-4900-ad49-b4bd801be378 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:46:41.424718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.427711 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c0103f0-d5de-4632-b89d-233f9ba56388 req-ddc931c0-caca-4a03-a8e8-026dd8bf809d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "DELETE /v2.0/ports/4490e4d7-08f5-4900-ad49-b4bd801be378 HTTP/1.1" status: 204 len: 173 time: 0.7527890 Dec 21 03:46:41.448372 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b1062745-9b61-463c-a625-cb9504bf475e x-openstack-request-id: req-b1062745-9b61-463c-a625-cb9504bf475e {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:41.453386 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:41.453386 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b1062745-9b61-463c-a625-cb9504bf475e {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:41.453386 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'status': 'completed', 'code': 200} Dec 21 03:46:41.461060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca0c6e6-66e4-406c-9e58-a6fc87777dd2 req-95bda53c-cffe-4bd8-b2e6-a34ad9223055 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:41.496636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ca0c6e6-66e4-406c-9e58-a6fc87777dd2 req-95bda53c-cffe-4bd8-b2e6-a34ad9223055 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1066248 Dec 21 03:46:41.504563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:41.504790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Allocated IP 19.80.0.2 (6ab64731-1736-45c2-9cd4-cd4313abad0e/02556e47-25b2-4c72-a874-afa8b0d11077/797de223-f760-46f4-8e39-72bd74ad01d4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:41.508246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2f726ac3-a504-4a48-bac4-592597f0a8d2 None None] Port 3940a4ac-09dc-4221-b41b-857f5d916950 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:41.509408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.564090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] For port 3940a4ac-09dc-4221-b41b-857f5d916950, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:41.575071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ca0c6e6-66e4-406c-9e58-a6fc87777dd2 req-e09514b1-6dba-4b87-b00d-c5b3056faf36 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773585 Dec 21 03:46:41.612535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] For port 3940a4ac-09dc-4221-b41b-857f5d916950, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3940a4ac-09dc-4221-b41b-857f5d916950,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:41.628590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17936230-56e7-4872-86be-61b6ef95acc5 req-08606da7-aec4-414b-afe5-aee034899a52 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.1036196 Dec 21 03:46:41.709423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:41.712240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-e3884d02-87ad-43a2-87c8-bcb2ff47b5bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:41.717735 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-e3884d02-87ad-43a2-87c8-bcb2ff47b5bd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1126 time: 0.0869308 Dec 21 03:46:41.864549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Routers {'3524514a-1e59-47e1-a83a-b0a5af9e17c3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:46:41.865210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:41.935707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6cf8a4a-2cfe-459f-abba-0fa490f28688 None None] Pushing event updated for resources: {'Port': ['ID=3940a4ac-09dc-4221-b41b-857f5d916950,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:41.966715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b8625e-96ff-4f1c-9aae-5b62647ee30a req-1cca09d3-5112-46db-a0db-3cad6e6d7c9c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:41.972500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71b8625e-96ff-4f1c-9aae-5b62647ee30a req-1cca09d3-5112-46db-a0db-3cad6e6d7c9c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.2188730 Dec 21 03:46:41.984010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-5a86e71f-f9c8-46c2-bbba-037a64203331 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:41.985604 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-5a86e71f-f9c8-46c2-bbba-037a64203331 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.2570169 Dec 21 03:46:42.053601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-2e0235e1-5ea8-4132-a77a-1a8360e50cc6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 217 time: 0.0447390 Dec 21 03:46:42.068232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71b8625e-96ff-4f1c-9aae-5b62647ee30a req-d1dcd90b-90ca-4f6c-8dcf-d026ed06ade4 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892768 Dec 21 03:46:42.100619 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.127416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.129898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] Set router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:46:42.195442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.196853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Subnet': ['ID=5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:42.214544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-dd008210-50c8-4f1b-9033-49e6c0d46716 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:42.216401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-dd008210-50c8-4f1b-9033-49e6c0d46716 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1526284 Dec 21 03:46:42.264648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Checking segment: {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:42.265441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network hostable DHCP agents. Network: 9ac60f83-5dc7-4da3-bc95-925c1ce35491, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:46:42.270044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-4801bcf9-fcb0-4de8-9c6c-4f51c0be4434 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414991 Dec 21 03:46:42.333049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:42.340747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:42.374223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:42.385508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:46:42.394874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Pushing event updated for resources: {'Port': ['ID=797de223-f760-46f4-8e39-72bd74ad01d4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:42.436789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-bf6433c1-70c8-4917-9960-8e963887038b service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1341805 Dec 21 03:46:42.465575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5089fc7d-9863-4e24-a962-c909d4b89e6f req-b2ff0171-3c27-4a89-aea8-4c1524e0c11c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:42.469880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f49edafa-e704-4689-bc65-399647e0f61f None None] Provisioning complete for port 3940a4ac-09dc-4221-b41b-857f5d916950 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:42.469880 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f49edafa-e704-4689-bc65-399647e0f61f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.476572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5089fc7d-9863-4e24-a962-c909d4b89e6f req-b2ff0171-3c27-4a89-aea8-4c1524e0c11c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0991328 Dec 21 03:46:42.534762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9ac60f83-5dc7-4da3-bc95-925c1ce35491) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:42.547659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:42.547659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.571474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5089fc7d-9863-4e24-a962-c909d4b89e6f req-0db27de1-6620-4866-8171-ba214c07dcb3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898285 Dec 21 03:46:42.588421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bd460af-a320-4de6-b9dd-8d52b4cb28e4 None None] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:42.589321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a36ec62c-438c-4c9b-b438-db2cc3d38aa3 req-3e02fb84-d9b0-4dc4-802f-de81d2fd6308 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1424942 Dec 21 03:46:42.650787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Attempting to bind port 797de223-f760-46f4-8e39-72bd74ad01d4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:42.650787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Attempting to bind port 797de223-f760-46f4-8e39-72bd74ad01d4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:42.651145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Attempting to bind port 797de223-f760-46f4-8e39-72bd74ad01d4 on network 6ab64731-1736-45c2-9cd4-cd4313abad0e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:42.659818 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b39dca6f-b251-44d2-9a75-920411c93946 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.4771988 Dec 21 03:46:42.751902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:42.752244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Checking segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:42.752751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.753257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Bound using segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:42.753813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Bound port: 797de223-f760-46f4-8e39-72bd74ad01d4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:42.754264 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.813656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0b20a46-e113-4dbc-897d-9c1768784067 req-181cf431-6146-4ee8-a3d2-af875f32aefa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=0fb974b6-7ee7-46ef-a7bc-358362b4ff2a HTTP/1.1" status: 200 len: 210 time: 0.0619304 Dec 21 03:46:42.824663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f49edafa-e704-4689-bc65-399647e0f61f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.844248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34d2f16-34f5-43e4-bc74-8632bea48245 req-48ebc56b-5928-464c-b8a5-aeb36ea8d0d7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:42.846547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a34d2f16-34f5-43e4-bc74-8632bea48245 req-48ebc56b-5928-464c-b8a5-aeb36ea8d0d7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1317945 Dec 21 03:46:42.901899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9ac60f83-5dc7-4da3-bc95-925c1ce35491', 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491', 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'fixed_ips': [{'subnet_id': '5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:46:42.902686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:42.930299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a34d2f16-34f5-43e4-bc74-8632bea48245 req-5f395ab2-0ad7-4683-9887-c7582ad1620b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752778 Dec 21 03:46:42.969613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f49edafa-e704-4689-bc65-399647e0f61f None None] For port 3940a4ac-09dc-4221-b41b-857f5d916950, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3940a4ac-09dc-4221-b41b-857f5d916950,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:42.989037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] For port 797de223-f760-46f4-8e39-72bd74ad01d4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:42.993347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:46:36Z', 'revision_number': 4, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3940a4ac-09dc-4221-b41b-857f5d916950', 'name': '', 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'mac_address': 'fa:16:3e:6e:6c:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:35Z', 'updated_at': '2021-12-21T03:46:41Z', 'revision_number': 4, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'subnets': [{'id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:46:43.078042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] For port 797de223-f760-46f4-8e39-72bd74ad01d4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=797de223-f760-46f4-8e39-72bd74ad01d4,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:43.080961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f49edafa-e704-4689-bc65-399647e0f61f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:43.091027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31fac5cb-3dd2-4c1a-839f-c86d55332e21 None None] The sync data for ids ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'] in n-d-822053-11 is: [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:46:36Z', 'revision_number': 4, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3940a4ac-09dc-4221-b41b-857f5d916950', 'name': '', 'network_id': 'e1f2bb15-a6a2-4b9b-b159-32c8384807ed', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'mac_address': 'fa:16:3e:6e:6c:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:35Z', 'updated_at': '2021-12-21T03:46:41Z', 'revision_number': 4, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'subnets': [{'id': 'a7e49167-2a86-4f1d-8301-e4c25f706fd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:46:43.131514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-7e87dcae-402f-4d82-b3c1-af0207c8c1d0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:43.155017 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:43.173993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-7e87dcae-402f-4d82-b3c1-af0207c8c1d0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:43.185437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-7e87dcae-402f-4d82-b3c1-af0207c8c1d0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/networks?id=6ab64731-1736-45c2-9cd4-cd4313abad0e&id=9ac60f83-5dc7-4da3-bc95-925c1ce35491&id=6ab64731-1736-45c2-9cd4-cd4313abad0e HTTP/1.1" status: 200 len: 1389 time: 0.2525876 Dec 21 03:46:43.206640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-4dcb71e3-e444-4de6-9f70-5415fcd7e53d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/quotas/955f4bcbbfba4ef4acf8124b0274572c HTTP/1.1" status: 200 len: 375 time: 0.0190606 Dec 21 03:46:43.237410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f49edafa-e704-4689-bc65-399647e0f61f None None] Pushing event updated for resources: {'Port': ['ID=3940a4ac-09dc-4221-b41b-857f5d916950,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:43.304885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-b4ddb32b-7da2-4200-83f3-ce173b72b8de tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0974627 Dec 21 03:46:43.328858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c81f074-010e-41da-8e8f-03086b259cd9 None None] Pushing event updated for resources: {'Port': ['ID=797de223-f760-46f4-8e39-72bd74ad01d4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:43.337694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Allocated IP 19.86.0.2 (9ac60f83-5dc7-4da3-bc95-925c1ce35491/5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691/8ffa6954-1cc5-44fc-98d8-92b6c857198f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:43.451931 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'name': 'network-vif-deleted', 'tag': '4490e4d7-08f5-4900-ad49-b4bd801be378'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:43.455782 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce2491f8-f307-40c3-827c-2178760f3290" -d '{"events": [{"server_uuid": "0fb974b6-7ee7-46ef-a7bc-358362b4ff2a", "name": "network-vif-deleted", "tag": "4490e4d7-08f5-4900-ad49-b4bd801be378"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:43.499403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-79e95424-c83f-45fa-ab98-7e889f068ec5 service neutron] 10.222.0.18 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1934781 Dec 21 03:46:43.883600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:43.974424 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.059608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:46:44.066386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:44.083321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:44.133827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4968a4d-abca-461d-807b-122ab06de63b req-fe00291d-a53d-4fe9-8c20-dd14660e71a2 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:44.141128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4968a4d-abca-461d-807b-122ab06de63b req-fe00291d-a53d-4fe9-8c20-dd14660e71a2 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1241460 Dec 21 03:46:44.185802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3940a4ac-09dc-4221-b41b-857f5d916950 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:44.190215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:44.204584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:44.217325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-abd5a9b8-eb4a-437d-a822-6b9133034870 service neutron] 10.222.0.18 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7170081 Dec 21 03:46:44.244144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4968a4d-abca-461d-807b-122ab06de63b req-131fca15-54f6-4feb-aba6-21b6a69a25e7 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1021013 Dec 21 03:46:44.310000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Pushing event updated for resources: {'Port': ['ID=8ffa6954-1cc5-44fc-98d8-92b6c857198f,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:44.317800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.resource_extend [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 03:46:44.354181 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e976b678-233a-474d-853e-bde47bdd7094 x-openstack-request-id: req-e976b678-233a-474d-853e-bde47bdd7094 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:44.354798 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0fb974b6-7ee7-46ef-a7bc-358362b4ff2a", "name": "network-vif-deleted", "tag": "4490e4d7-08f5-4900-ad49-b4bd801be378", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:44.355267 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e976b678-233a-474d-853e-bde47bdd7094 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:44.355979 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0fb974b6-7ee7-46ef-a7bc-358362b4ff2a', 'name': 'network-vif-deleted', 'tag': '4490e4d7-08f5-4900-ad49-b4bd801be378', 'status': 'completed', 'code': 200} Dec 21 03:46:44.373981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4490e4d7-08f5-4900-ad49-b4bd801be378 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:44.402561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 4490e4d7-08f5-4900-ad49-b4bd801be378 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:46:44.402907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4490e4d7-08f5-4900-ad49-b4bd801be378 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:46:44.417917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-9b82f917-841e-4a66-83a7-4c177d4111ab service neutron] 10.222.0.18 "GET /v2.0/networks/9ac60f83-5dc7-4da3-bc95-925c1ce35491?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1906099 Dec 21 03:46:44.549486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:44.569098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'mac_address': 'fa:16:3e:61:86:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:46:44.600884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491bb66-61dd-46e8-9796-de4f5547a283 req-bddae5e2-c420-4cc9-946d-1084b37a31db tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:44.602653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491bb66-61dd-46e8-9796-de4f5547a283 req-bddae5e2-c420-4cc9-946d-1084b37a31db tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1658964 Dec 21 03:46:44.670751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-de0d40fb-6ec5-43ce-88e0-6c94c6b2982a service neutron] 10.222.0.18 "GET /v2.0/networks/9ac60f83-5dc7-4da3-bc95-925c1ce35491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2517333 Dec 21 03:46:44.672964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.686905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Attempting to bind port 8ffa6954-1cc5-44fc-98d8-92b6c857198f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:44.687343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Attempting to bind port 8ffa6954-1cc5-44fc-98d8-92b6c857198f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:44.687732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Attempting to bind port 8ffa6954-1cc5-44fc-98d8-92b6c857198f on network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:44.724694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:44.726149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:44.726737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Checking segment: {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:44.727273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.728093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Bound using segment: {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:44.728742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Bound port: 8ffa6954-1cc5-44fc-98d8-92b6c857198f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:44.729349 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.743326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:44.746538 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f19aba9-d981-4ad2-bff1-fea04ee8df6a" -d '{"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-unplugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:44.767478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3940a4ac-09dc-4221-b41b-857f5d916950 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:44.773385 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.829843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.855369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-32999dcd-6de5-4fa6-80bf-4953a194e040 service neutron] 10.222.0.18 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1835954 Dec 21 03:46:44.938251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:44.942288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:44.987165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491bb66-61dd-46e8-9796-de4f5547a283 req-7b53e4b9-b3ff-4c0f-b64e-d304eb183f75 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3552170 Dec 21 03:46:44.988535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:45.132697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-38e432d7-f157-41d1-a397-dd115a3e6bf8 service neutron] 10.222.0.18 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2759609 Dec 21 03:46:45.154986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:46:45.155227 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:46:45.156351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 797de223-f760-46f4-8e39-72bd74ad01d4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:45.158270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d43c4e16-ffe9-4c0a-8281-12032cdd564f None None] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:45.194598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] For port 8ffa6954-1cc5-44fc-98d8-92b6c857198f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:45.241248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] For port 8ffa6954-1cc5-44fc-98d8-92b6c857198f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8ffa6954-1cc5-44fc-98d8-92b6c857198f,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:45.259689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f496e5-9050-4cff-b0dc-bce9c9d9d89b req-87eb5544-46fe-4456-9979-e48d2f5d9089 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:45.268450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20f496e5-9050-4cff-b0dc-bce9c9d9d89b req-87eb5544-46fe-4456-9979-e48d2f5d9089 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1105757 Dec 21 03:46:45.294758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f909e35a-7100-4293-bf9a-220ed1310005 None None] Provisioning complete for port 797de223-f760-46f4-8e39-72bd74ad01d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:45.323228 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f909e35a-7100-4293-bf9a-220ed1310005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.323902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20f496e5-9050-4cff-b0dc-bce9c9d9d89b req-2ac3311e-cf0f-42d3-8405-ef77b541071f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519679 Dec 21 03:46:45.357951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.415203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 797de223-f760-46f4-8e39-72bd74ad01d4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:45.415611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.596124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f909e35a-7100-4293-bf9a-220ed1310005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.614575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be65241-99fe-4187-bc0d-97d9e1a8c54b None None] Pushing event updated for resources: {'Port': ['ID=8ffa6954-1cc5-44fc-98d8-92b6c857198f,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:45.650843 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d549caf9-7cce-459c-ad14-6505f31501f6 x-openstack-request-id: req-d549caf9-7cce-459c-ad14-6505f31501f6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:45.651168 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-unplugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:45.651431 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d549caf9-7cce-459c-ad14-6505f31501f6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:45.651828 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'code': 200} Dec 21 03:46:45.680815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f909e35a-7100-4293-bf9a-220ed1310005 None None] For port 797de223-f760-46f4-8e39-72bd74ad01d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=797de223-f760-46f4-8e39-72bd74ad01d4,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:45.783815 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f909e35a-7100-4293-bf9a-220ed1310005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.863597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f0fa7f-ab21-4fd9-ab65-4f6f2741f7a4 req-5b958463-87b8-4564-b3c7-448835f6ebd8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:45.866547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8f0fa7f-ab21-4fd9-ab65-4f6f2741f7a4 req-5b958463-87b8-4564-b3c7-448835f6ebd8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 948 time: 0.1375530 Dec 21 03:46:45.889384 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.960187 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:45.964116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f909e35a-7100-4293-bf9a-220ed1310005 None None] Pushing event updated for resources: {'Port': ['ID=797de223-f760-46f4-8e39-72bd74ad01d4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:45.989468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:45.990790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8f0fa7f-ab21-4fd9-ab65-4f6f2741f7a4 req-971d4cfc-0100-42a5-8a5c-2d735aa451ba tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132803 Dec 21 03:46:46.079552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:46.092986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8ae595d-f9ae-4eac-b8b9-a8d09d02ce17 req-160fabfa-fa3e-41de-9724-0a507dc0006d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 210 time: 0.0382769 Dec 21 03:46:46.105273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:46:46.105687 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:46:46.122673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0f38893e-f71f-4d35-99e9-0cf30ae7f005 None None] Provisioning complete for port 797de223-f760-46f4-8e39-72bd74ad01d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:46.122889 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f38893e-f71f-4d35-99e9-0cf30ae7f005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:46.178070 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:46.238878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7378e568-1581-41d8-8973-e4f88987c8cb req-81106c14-7db3-454a-8021-c152dec82ed0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:46.258024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7378e568-1581-41d8-8973-e4f88987c8cb req-81106c14-7db3-454a-8021-c152dec82ed0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0974669 Dec 21 03:46:46.274788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:46.342476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7378e568-1581-41d8-8973-e4f88987c8cb req-2f9520c3-26d5-4ce3-b2e5-0fe07a219da0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733502 Dec 21 03:46:46.529714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4622ad71-744d-452f-8dc8-f2e6cee58cca req-335e8ec7-c54c-41fd-b72a-f5e5ffb49a86 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:46.531475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4622ad71-744d-452f-8dc8-f2e6cee58cca req-335e8ec7-c54c-41fd-b72a-f5e5ffb49a86 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.0868804 Dec 21 03:46:46.629271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4622ad71-744d-452f-8dc8-f2e6cee58cca req-29a761ce-cb19-43a5-afdf-33319f67f047 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890787 Dec 21 03:46:46.672164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cf770d29-1c69-4f15-b07a-7cd04c2724a4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:47.036588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ffa6954-1cc5-44fc-98d8-92b6c857198f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:47.138279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8ffa6954-1cc5-44fc-98d8-92b6c857198f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:47.139011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.169943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1c2f99-e7ba-4f6e-9d0f-f2ddb1ffe44f req-3210bd7c-5262-4edb-9264-4382d9b0683b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:47.173381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1c2f99-e7ba-4f6e-9d0f-f2ddb1ffe44f req-3210bd7c-5262-4edb-9264-4382d9b0683b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.0862939 Dec 21 03:46:47.259065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a1c2f99-e7ba-4f6e-9d0f-f2ddb1ffe44f req-89b19dc5-880c-43b0-b27a-79b6c496116d tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786774 Dec 21 03:46:47.350772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11a2d030-23a3-4beb-8ed0-33724b4ece54 req-94fe12ca-9b39-4506-bd54-c5cefc924d95 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 210 time: 0.0438550 Dec 21 03:46:47.383077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45962) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:47.402813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'security_group': {'name': 'tempest-securitygroup--658248662', 'description': 'tempest-description--500541787'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:47.484726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2824c5b-d4c3-4fdd-8bfe-872ae6772d7b None None] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:46:47.539855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.556911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e546e3-5a5a-4d2d-b6c5-6a4e1222f8f5 req-9d6d9d4a-6e2a-43e1-a3bb-ad0988050020 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:47.565590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.573778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4e546e3-5a5a-4d2d-b6c5-6a4e1222f8f5 req-9d6d9d4a-6e2a-43e1-a3bb-ad0988050020 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1093156 Dec 21 03:46:47.584130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bc23de72-bba6-4a44-93e0-90c996f0163d None None] Provisioning complete for port 8ffa6954-1cc5-44fc-98d8-92b6c857198f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:47.584510 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc23de72-bba6-4a44-93e0-90c996f0163d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.685798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4e546e3-5a5a-4d2d-b6c5-6a4e1222f8f5 req-6c9deda9-85c8-4a73-8a1d-4fba246d6a80 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989604 Dec 21 03:46:47.686030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 8ffa6954-1cc5-44fc-98d8-92b6c857198f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8ffa6954-1cc5-44fc-98d8-92b6c857198f,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:47.709037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.783293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.785745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 797de223-f760-46f4-8e39-72bd74ad01d4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:47.822438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.882883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3e55b34c-2fa2-47cc-89c2-9cc268e74cf2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:47.926058 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc23de72-bba6-4a44-93e0-90c996f0163d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.944561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:47.959164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99bf159b-a21b-4e78-8af6-ea5d77509d9c req-f1e41040-35ea-4cd7-8ed4-4ae70b15ceda tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:47.960598 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e23f64d-d2b6-4218-807f-28dfd9f972aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.5696812 Dec 21 03:46:47.961411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99bf159b-a21b-4e78-8af6-ea5d77509d9c req-f1e41040-35ea-4cd7-8ed4-4ae70b15ceda tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1814430 Dec 21 03:46:47.961939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45970) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:47.983000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'security_group_rule': {'security_group_id': '3e55b34c-2fa2-47cc-89c2-9cc268e74cf2', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:48.065244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=8ffa6954-1cc5-44fc-98d8-92b6c857198f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:48.112340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 797de223-f760-46f4-8e39-72bd74ad01d4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:48.112724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.131869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-bc23de72-bba6-4a44-93e0-90c996f0163d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:46:48.132311 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-bc23de72-bba6-4a44-93e0-90c996f0163d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:46:48.163329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99bf159b-a21b-4e78-8af6-ea5d77509d9c req-0361dd70-0cc7-40de-808b-1934e0669f21 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1660054 Dec 21 03:46:48.249898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:48.325293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.378503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port cf770d29-1c69-4f15-b07a-7cd04c2724a4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:48.378503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.513481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-107f9619-2d41-43d4-ba92-d54227d687e7 req-00eb1f75-92ef-472d-b6fb-3613ebc425b1 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 210 time: 0.0474162 Dec 21 03:46:48.534167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.547509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.557887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317c2bc2-5203-4d92-b492-1ed1ac399a4d req-7c02dc4d-c39d-42b9-b65e-b236e5aa9e78 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:48.566030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-317c2bc2-5203-4d92-b492-1ed1ac399a4d req-7c02dc4d-c39d-42b9-b65e-b236e5aa9e78 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 950 time: 0.1531830 Dec 21 03:46:48.591255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:48.592762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:48.596158 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fb798d0-bceb-41e4-8163-b03786b6c51d" -d '{"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-plugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:48.620065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-317c2bc2-5203-4d92-b492-1ed1ac399a4d req-d22db561-1bea-4b2a-b165-bf20e023603a tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529642 Dec 21 03:46:48.664887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.668774 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b504b24-1495-4b6f-8f6c-a9ad050c0709 x-openstack-request-id: req-1b504b24-1495-4b6f-8f6c-a9ad050c0709 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:48.668774 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-plugged", "status": "completed", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:48.668774 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1b504b24-1495-4b6f-8f6c-a9ad050c0709 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:48.668774 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'code': 200} Dec 21 03:46:48.687348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.704680 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:46:48.712642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a2328b52-cf4c-4326-951f-0d4612f2920b,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:48.817391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.818832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f921ab63-4812-4d2c-9f48-75050f43decd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8556428 Dec 21 03:46:48.821461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45990) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:48.828775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'security_group_rule': {'security_group_id': '3e55b34c-2fa2-47cc-89c2-9cc268e74cf2', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:48.850491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:48.858176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064037c0-73ce-4776-9d4d-762681466d8a req-ab67d288-95f1-4b29-a3f0-8202a5df18b4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:48.859764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-064037c0-73ce-4776-9d4d-762681466d8a req-ab67d288-95f1-4b29-a3f0-8202a5df18b4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0995905 Dec 21 03:46:48.877805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d6c8c47e-ef1c-4e8e-b943-c8d3a6ed93b6 None None] Provisioning complete for port 8ffa6954-1cc5-44fc-98d8-92b6c857198f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:48.879397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6c8c47e-ef1c-4e8e-b943-c8d3a6ed93b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.974666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ffa6954-1cc5-44fc-98d8-92b6c857198f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:46:48.977868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:48.980979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-064037c0-73ce-4776-9d4d-762681466d8a req-153166be-4db5-4e71-a8d8-30b97795ce9c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103909 Dec 21 03:46:49.035110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c104d0b-1e41-4c10-a393-d6d11cfd8260 req-1eff0818-ec00-40d6-a05a-a612200399d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:49.036880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c104d0b-1e41-4c10-a393-d6d11cfd8260 req-1eff0818-ec00-40d6-a05a-a612200399d4 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1103 time: 0.1443303 Dec 21 03:46:49.167648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.173872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8ffa6954-1cc5-44fc-98d8-92b6c857198f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:49.174253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.174380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9c104d0b-1e41-4c10-a393-d6d11cfd8260 req-0526bede-3115-4e6a-932c-b06e90da3962 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1272871 Dec 21 03:46:49.271464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.372216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d913781b-df65-4843-bd02-64cfe0b14e2d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:49.418009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f456c423-ed3a-4ab2-8b50-8bf6e15cfcbf req-4fa229c5-e070-413d-ae7e-a2de92ca6575 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:49.426245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-ffc127a9-cdc1-4b4a-9a54-5a07357921c8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:49.432260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-ffc127a9-cdc1-4b4a-9a54-5a07357921c8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:49.433853 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-ffc127a9-cdc1-4b4a-9a54-5a07357921c8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "GET /v2.0/networks?id=6ab64731-1736-45c2-9cd4-cd4313abad0e&id=9ac60f83-5dc7-4da3-bc95-925c1ce35491&id=6ab64731-1736-45c2-9cd4-cd4313abad0e HTTP/1.1" status: 200 len: 1389 time: 0.2585926 Dec 21 03:46:49.436190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f456c423-ed3a-4ab2-8b50-8bf6e15cfcbf req-4fa229c5-e070-413d-ae7e-a2de92ca6575 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.1313546 Dec 21 03:46:49.452501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.453693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c61cae73-e406-441d-81eb-9d49cb44d5a7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6307631 Dec 21 03:46:49.458990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:46:49.465157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:49.478589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'port': {'device_id': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e', 'admin_state_up': True, 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:49.502211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f456c423-ed3a-4ab2-8b50-8bf6e15cfcbf req-71408e30-474c-4dfa-857c-a41b8d14af07 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647476 Dec 21 03:46:49.614531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.706622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aaee4dc-77a6-4f3a-b347-e8b5518cb94f req-71707bf2-ccc8-4da0-a346-7774cc7c724f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 210 time: 0.0624354 Dec 21 03:46:49.749838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:49.754367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.798315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-425bca2c-71bc-495e-bf19-37214ae281fb req-a2dbbc3d-caa0-4723-beee-a4c32dc5b48c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:49.801728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.805199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-425bca2c-71bc-495e-bf19-37214ae281fb req-a2dbbc3d-caa0-4723-beee-a4c32dc5b48c tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 951 time: 0.0764408 Dec 21 03:46:49.819739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc961b6b-0d5d-4d6e-8718-4bf5926faa99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:49.873151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-425bca2c-71bc-495e-bf19-37214ae281fb req-5c917f58-15be-4c5f-846b-908b9f8ef623 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617816 Dec 21 03:46:50.010893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Allocated IP 19.80.0.66 (6ab64731-1736-45c2-9cd4-cd4313abad0e/02556e47-25b2-4c72-a874-afa8b0d11077/309abf42-4548-412c-ad2e-67d338e5fa00) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:50.032848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Allocated IP 172.25.5.177 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/d002a68b-67fc-4712-a314-b63a2d44310d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:50.159119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc680fd-506f-4c2d-8daa-31d802263494 req-2b1279f7-fa11-425f-9b1f-ac467845b5a4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:50.161377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc680fd-506f-4c2d-8daa-31d802263494 req-2b1279f7-fa11-425f-9b1f-ac467845b5a4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0635724 Dec 21 03:46:50.227281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc680fd-506f-4c2d-8daa-31d802263494 req-43817ba6-69e4-4941-8172-8e5085af5e2a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547602 Dec 21 03:46:50.327381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:50.366210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:50.416419 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-56236c0b-4eea-4a5b-bb24-10946c89e3e6 service neutron] 10.222.0.31 "GET /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.2291131 Dec 21 03:46:50.421645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:50.572488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:50.664255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153e1f75-6866-4009-95ee-aef737333113 req-dce7f979-a181-4e57-bb8d-39a6a2ac38c0 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:50.675496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-153e1f75-6866-4009-95ee-aef737333113 req-dce7f979-a181-4e57-bb8d-39a6a2ac38c0 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 943 time: 0.0980530 Dec 21 03:46:50.703709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'Port': ['ID=d002a68b-67fc-4712-a314-b63a2d44310d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:50.733780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:50.756134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-153e1f75-6866-4009-95ee-aef737333113 req-fdcae38e-dbee-4fc0-8515-ed9d0b0d7691 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735164 Dec 21 03:46:50.817175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:50.825681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:50.834773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:50.877090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:50.891284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:50.898763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2895d1c-81bb-4eb6-9cb7-57750f056e24 req-39088d4e-1ff6-452d-aa47-cba2ef8bdfdf tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:50.900825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:50.905138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:50.917984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2895d1c-81bb-4eb6-9cb7-57750f056e24 req-39088d4e-1ff6-452d-aa47-cba2ef8bdfdf tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 931 time: 0.0906167 Dec 21 03:46:50.920647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Port': ['ID=309abf42-4548-412c-ad2e-67d338e5fa00,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:50.999703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:51.060082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2895d1c-81bb-4eb6-9cb7-57750f056e24 req-6bc3f1e4-5d0c-421e-977e-fad9d05808d2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1389518 Dec 21 03:46:51.099194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:51.100042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.104055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce715067-ba7d-4741-bbc0-56af2d7e28c5 req-4954ca6e-9b48-427e-939f-3d7e66a110e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:51.114864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce715067-ba7d-4741-bbc0-56af2d7e28c5 req-4954ca6e-9b48-427e-939f-3d7e66a110e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 951 time: 0.0998993 Dec 21 03:46:51.142608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b1bddbab-3a32-4687-b97f-eada22b71c0f {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:51.169654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:51.172058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce715067-ba7d-4741-bbc0-56af2d7e28c5 req-434daa96-1143-4d11-bebd-9d803e7d9a59 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574386 Dec 21 03:46:51.172538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.244383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-f80a7176-9c2c-4851-8668-840f86456466 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7706630 Dec 21 03:46:51.266727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'port': {'device_id': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491', 'admin_state_up': True, 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:51.289878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.338747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f1b153bf-ebab-4455-966f-e148fc0c11f2 None None] Provisioning complete for port 309abf42-4548-412c-ad2e-67d338e5fa00 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:51.340075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1b153bf-ebab-4455-966f-e148fc0c11f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.411952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.421214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f1b153bf-ebab-4455-966f-e148fc0c11f2 None None] Port 309abf42-4548-412c-ad2e-67d338e5fa00 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:51.494163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee1f84c-6947-4974-8db4-f34fb944890e req-a6521d82-4ff1-4c46-be29-f554d2019c7d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:51.503761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fee1f84c-6947-4974-8db4-f34fb944890e req-a6521d82-4ff1-4c46-be29-f554d2019c7d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0767078 Dec 21 03:46:51.552323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fee1f84c-6947-4974-8db4-f34fb944890e req-36c162b9-8cb1-46b1-ab60-d035b7aaac85 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475721 Dec 21 03:46:51.613269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] Transition to ACTIVE for port object b1bddbab-3a32-4687-b97f-eada22b71c0f will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:51.684600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.700198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.745745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:51.749329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.800731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:51.821394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd65baa0-8f6e-42bc-98a0-7d3cd4200dc1 req-94d63f48-053d-41cd-9d61-9385db9e6d9c tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:51.834541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd65baa0-8f6e-42bc-98a0-7d3cd4200dc1 req-94d63f48-053d-41cd-9d61-9385db9e6d9c tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1103 time: 0.0692582 Dec 21 03:46:51.918383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] No DVR routers for this DVR port b1bddbab-3a32-4687-b97f-eada22b71c0f on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:46:51.928456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] Pushing event updated for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:51.939617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd65baa0-8f6e-42bc-98a0-7d3cd4200dc1 req-a9047037-66e8-4af4-abb0-5aa1181d9389 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039972 Dec 21 03:46:51.983253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c49001-79f4-4d07-967f-95c0b688ec87 req-3edc8d5e-e829-4b11-bafc-a50e337782de tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:51.986191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c49001-79f4-4d07-967f-95c0b688ec87 req-3edc8d5e-e829-4b11-bafc-a50e337782de tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.1012468 Dec 21 03:46:52.052444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c49001-79f4-4d07-967f-95c0b688ec87 req-c5df2455-e56f-48d3-b5b1-06c7f49ec5f3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597465 Dec 21 03:46:52.098511 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-43b3ff7e-bd04-4ace-8a3b-0eff3027f583 service neutron] 10.222.0.31 "PUT /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 1.6683311 Dec 21 03:46:52.106970 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:52.126600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'Port': ['ID=d002a68b-67fc-4712-a314-b63a2d44310d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:52.181802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Allocated IP 19.86.0.185 (9ac60f83-5dc7-4da3-bc95-925c1ce35491/5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691/54e4beae-74f2-4632-b9a3-5c575004e2a8) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:52.203358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bece5d-bf01-4cf2-948c-c0670a7a1cce req-6ecc209c-14f2-4af1-bb2a-919f103b1577 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:52.205803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72bece5d-bf01-4cf2-948c-c0670a7a1cce req-6ecc209c-14f2-4af1-bb2a-919f103b1577 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 931 time: 0.0548298 Dec 21 03:46:52.227478 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e188e145-ad97-4f88-81ec-3821be1388ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:52.303003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72bece5d-bf01-4cf2-948c-c0670a7a1cce req-b871f87b-86e4-4a35-8ed3-7b66e28095bd tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900424 Dec 21 03:46:52.313260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:52.347311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-abd6a965-c2a9-4179-8510-429f7d7a6d95 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8547740 Dec 21 03:46:52.412722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:52.708969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-fd8b31ac-563d-4dc1-bc9a-28374cf9cb36 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:52.710422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-fd8b31ac-563d-4dc1-bc9a-28374cf9cb36 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 822 time: 0.1050868 Dec 21 03:46:52.724753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-d683d88c-900a-4a04-bd21-9ee9f9dc57f4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/quotas/7a49d4228d05498db20fade9b7651659 HTTP/1.1" status: 200 len: 375 time: 0.0088460 Dec 21 03:46:52.758856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-8604be7d-a42f-40f7-b166-4fd5343d0d03 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0288892 Dec 21 03:46:52.854734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-0f34487b-dc67-4fa9-8dbe-010ec5212513 service neutron] 10.222.0.18 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889525 Dec 21 03:46:52.950077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-63f9838b-304b-4d96-83be-8f5e89b11a66 service neutron] 10.222.0.18 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888178 Dec 21 03:46:52.984626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:52.988293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:53.071566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:53.079991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:53.086060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:53.091819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-1ac61d45-4051-4c7b-af55-51023cbc78ca tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.097775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-1ac61d45-4051-4c7b-af55-51023cbc78ca tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.1493018 Dec 21 03:46:53.100008 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:53.205334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bac22e06-28d1-462c-a78b-04aba7b3fec5 req-d3c02e1c-8891-469c-881f-68397b78d015 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.228554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bac22e06-28d1-462c-a78b-04aba7b3fec5 req-d3c02e1c-8891-469c-881f-68397b78d015 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1142478 Dec 21 03:46:53.321928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bac22e06-28d1-462c-a78b-04aba7b3fec5 req-8456d45f-88e0-4f6d-a3d8-7e9d14f189fc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920830 Dec 21 03:46:53.441653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4081b4-23cd-445e-98ae-a7b7afb33f95 req-b3172129-7cb0-498b-9374-864338aed72d tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.452354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d4081b4-23cd-445e-98ae-a7b7afb33f95 req-b3172129-7cb0-498b-9374-864338aed72d tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 1103 time: 0.0689917 Dec 21 03:46:53.539876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d4081b4-23cd-445e-98ae-a7b7afb33f95 req-8b3d995e-16a9-4bd5-acff-59e724f93683 tempest-ServersAdminTestJSON-564906988 tempest-ServersAdminTestJSON-564906988-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0856605 Dec 21 03:46:53.575384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f0b82236-8d1f-4d74-8f2c-c4fd0a3d6a2a None None] Provisioning complete for port 54e4beae-74f2-4632-b9a3-5c575004e2a8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:53.580028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b82236-8d1f-4d74-8f2c-c4fd0a3d6a2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:53.662623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f0b82236-8d1f-4d74-8f2c-c4fd0a3d6a2a None None] Port 54e4beae-74f2-4632-b9a3-5c575004e2a8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:53.665033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9be54a5-7b90-49bf-858c-c634280a19ac req-4f771038-04aa-40be-986d-567645cff90f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.673559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9be54a5-7b90-49bf-858c-c634280a19ac req-4f771038-04aa-40be-986d-567645cff90f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.1266999 Dec 21 03:46:53.688025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.695749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:53.698779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8077cef5-2f1e-4b16-acbe-6cb81120679c req-85086527-2298-41c5-9b47-9a610611cac6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 210 time: 0.0891879 Dec 21 03:46:53.700012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:53.744775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9be54a5-7b90-49bf-858c-c634280a19ac req-531d630d-9bcd-4a62-b4fe-26f44156ae56 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701802 Dec 21 03:46:53.765117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-f71ac019-f13d-4194-8268-cada5f9cd3b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.779548 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-f71ac019-f13d-4194-8268-cada5f9cd3b9 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517&tenant_id=7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 1096 time: 0.0869215 Dec 21 03:46:53.815390 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-a980fc00-799a-40b9-ae02-cc55b5026eef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.5532942 Dec 21 03:46:53.870265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'port': {'device_id': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e', 'admin_state_up': True, 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:53.898529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ec87c6-c7c2-48ce-af75-0516cc9a3d84 req-9613a506-cdc1-4ffe-9845-79670133c317 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.915911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ec87c6-c7c2-48ce-af75-0516cc9a3d84 req-9613a506-cdc1-4ffe-9845-79670133c317 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.923785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8ec87c6-c7c2-48ce-af75-0516cc9a3d84 req-9613a506-cdc1-4ffe-9845-79670133c317 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 1654 time: 0.1236100 Dec 21 03:46:53.976896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-2b4db8cd-3539-451a-8459-327280fb3b05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:53.978400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-2b4db8cd-3539-451a-8459-327280fb3b05 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1096 time: 0.1223733 Dec 21 03:46:54.002188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8ec87c6-c7c2-48ce-af75-0516cc9a3d84 req-63bd38f0-a966-4cb5-9cb3-55c28d251b10 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770357 Dec 21 03:46:54.094349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-2d3efc1e-038a-4244-9c34-de00d9726374 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:54.095902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-2d3efc1e-038a-4244-9c34-de00d9726374 service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1054392 Dec 21 03:46:54.139074 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-f6c5123c-801e-4a94-b66a-0ef87ee8af2d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 200 len: 217 time: 0.0341272 Dec 21 03:46:54.194482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-a0edf673-d2a2-4504-a72e-01f35d173b63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:54.195993 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-a0edf673-d2a2-4504-a72e-01f35d173b63 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0496643 Dec 21 03:46:54.201147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:54.201147 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:54.241467 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-ee4c45bc-fd45-4d3f-92b4-1f38794c7f11 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0311401 Dec 21 03:46:54.433308 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-5c9d68c7-12a6-4f7e-9d2b-41b320227c3b service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1823227 Dec 21 03:46:54.434381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Allocated IP 19.80.0.101 (6ab64731-1736-45c2-9cd4-cd4313abad0e/02556e47-25b2-4c72-a874-afa8b0d11077/204c72a6-5710-46ff-87ad-a1a7bbd4f24a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:54.453539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101f7d0f-35d2-42b5-a41b-5b87395efbed req-2cbc6494-bf56-4877-9750-293918d2c5ed tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:54.455117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-101f7d0f-35d2-42b5-a41b-5b87395efbed req-2cbc6494-bf56-4877-9750-293918d2c5ed tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0604446 Dec 21 03:46:54.515779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-101f7d0f-35d2-42b5-a41b-5b87395efbed req-5c5c422a-a805-459e-9032-f9b28a9bed62 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532732 Dec 21 03:46:54.572945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-2b5afee5-ce58-4dea-a8f0-bee9b3cf79dd service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315527 Dec 21 03:46:54.637071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f669eee2-1b49-4016-ba80-d1cbd0533889 req-b53eb0cf-f2c1-4324-ae1f-418faa4598c9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:54.638894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f669eee2-1b49-4016-ba80-d1cbd0533889 req-b53eb0cf-f2c1-4324-ae1f-418faa4598c9 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.0651109 Dec 21 03:46:54.681427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:54.686977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f669eee2-1b49-4016-ba80-d1cbd0533889 req-31220a97-c7fa-4531-a0b7-2f0d25be3931 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415912 Dec 21 03:46:54.695459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:54.820260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:54.828419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd9b33c8-6164-4ab4-86f0-049630bd0d83 req-492794fc-2a88-4a58-9027-0f8f27eefd19 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 210 time: 0.0379560 Dec 21 03:46:54.881809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:54.884897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:54.888907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:54.895857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Port': ['ID=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:54.914597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf55d6dd-69b0-4b6c-9a63-70b02ebe8f45 req-98759529-77b9-4702-bc13-42c0e75f6d84 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:54.919477 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf55d6dd-69b0-4b6c-9a63-70b02ebe8f45 req-98759529-77b9-4702-bc13-42c0e75f6d84 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.0831232 Dec 21 03:46:54.940041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.948776 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:54.951817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:54.993655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf55d6dd-69b0-4b6c-9a63-70b02ebe8f45 req-79e090e2-b359-4410-8b0f-83c3086aebdb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683777 Dec 21 03:46:55.034905 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-32ec1c24-49c9-4be9-89c5-1545fa968e07 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1687028 Dec 21 03:46:55.065784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Request body: {'port': {'device_id': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:55.162605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.211769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fdfcb96e-7b13-4d43-8c22-94b515fc9f73 None None] Provisioning complete for port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:46:55.213717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fdfcb96e-7b13-4d43-8c22-94b515fc9f73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.252021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fdfcb96e-7b13-4d43-8c22-94b515fc9f73 None None] Port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:46:55.386445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f53dec-2ca4-40dc-9256-9be62eb4ac79 req-9c7a345f-20d4-461c-a5f9-dd17be131e7f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.393877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f53dec-2ca4-40dc-9256-9be62eb4ac79 req-9c7a345f-20d4-461c-a5f9-dd17be131e7f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.401503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f53dec-2ca4-40dc-9256-9be62eb4ac79 req-9c7a345f-20d4-461c-a5f9-dd17be131e7f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.403383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f53dec-2ca4-40dc-9256-9be62eb4ac79 req-9c7a345f-20d4-461c-a5f9-dd17be131e7f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2376 time: 0.0718341 Dec 21 03:46:55.446752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-39731294-36e9-48e9-9312-6375bc106dba tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.448352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-39731294-36e9-48e9-9312-6375bc106dba tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0774133 Dec 21 03:46:55.458173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f53dec-2ca4-40dc-9256-9be62eb4ac79 req-be172a3b-583a-41ea-8b87-e107b75be26c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479784 Dec 21 03:46:55.555413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92bb554a-a705-48aa-b1b6-4a7538b75fdb req-375d615d-3d14-4597-9d12-7e6bc43daaa1 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.556971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92bb554a-a705-48aa-b1b6-4a7538b75fdb req-375d615d-3d14-4597-9d12-7e6bc43daaa1 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 950 time: 0.0572281 Dec 21 03:46:55.565056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 309abf42-4548-412c-ad2e-67d338e5fa00 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:55.576539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.619201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92bb554a-a705-48aa-b1b6-4a7538b75fdb req-87c71339-7020-4abc-b026-ae3b0b35a558 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538814 Dec 21 03:46:55.627966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Transition to ACTIVE for port object 309abf42-4548-412c-ad2e-67d338e5fa00 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:55.648991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.704822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.747419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9255e6af-e5d9-4d3a-aa52-ed63721f7893 req-13d79d2a-842d-4852-ad97-d2c41470a6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.749094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9255e6af-e5d9-4d3a-aa52-ed63721f7893 req-13d79d2a-842d-4852-ad97-d2c41470a6b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0656903 Dec 21 03:46:55.754251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-c088534a-b042-4e79-84cd-9eb470b18946 service neutron] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:55.762580 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-c088534a-b042-4e79-84cd-9eb470b18946 service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.763865 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-78e5527a-353d-4afc-b4ea-43a0ca30dfc2 req-c088534a-b042-4e79-84cd-9eb470b18946 service neutron] 10.222.0.54 "DELETE /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.3049824 Dec 21 03:46:55.781366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Pushing event updated for resources: {'Port': ['ID=309abf42-4548-412c-ad2e-67d338e5fa00,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:55.828112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9255e6af-e5d9-4d3a-aa52-ed63721f7893 req-226d2cca-d1b1-410f-9296-444f5bff25eb tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704916 Dec 21 03:46:55.860056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Attempting to bind port 309abf42-4548-412c-ad2e-67d338e5fa00 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:55.861085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Attempting to bind port 309abf42-4548-412c-ad2e-67d338e5fa00 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:55.861316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Attempting to bind port 309abf42-4548-412c-ad2e-67d338e5fa00 on network 6ab64731-1736-45c2-9cd4-cd4313abad0e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:55.866126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Port 309abf42-4548-412c-ad2e-67d338e5fa00 on network 6ab64731-1736-45c2-9cd4-cd4313abad0e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:55.866458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Attempting to bind port 309abf42-4548-412c-ad2e-67d338e5fa00 on network 6ab64731-1736-45c2-9cd4-cd4313abad0e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:55.871499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:55.871852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Checking segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:55.872240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Bound using segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:55.872669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Bound port: 309abf42-4548-412c-ad2e-67d338e5fa00, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:55.873028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:55.951234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb221e94-7b89-4395-ba3f-010f9afdfc9a req-eb86c2e3-c63f-4b9c-8d33-17a047e3b1ac tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:55.957516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb221e94-7b89-4395-ba3f-010f9afdfc9a req-eb86c2e3-c63f-4b9c-8d33-17a047e3b1ac tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.0610399 Dec 21 03:46:55.973069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] For port 309abf42-4548-412c-ad2e-67d338e5fa00, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:55.975522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] For port 309abf42-4548-412c-ad2e-67d338e5fa00, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=309abf42-4548-412c-ad2e-67d338e5fa00,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:56.026388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb221e94-7b89-4395-ba3f-010f9afdfc9a req-e2f80a22-73cc-4f8b-ac3a-9c5972851a50 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590558 Dec 21 03:46:56.059833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:56.133619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f1a547e-da52-4471-8187-ca11488275a6 req-a0967efe-ba77-418e-a641-eb570e6f65ad tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 210 time: 0.0471663 Dec 21 03:46:56.134327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.135025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:56.136456 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] 10.222.0.31 "PUT /v2.0/ports/309abf42-4548-412c-ad2e-67d338e5fa00 HTTP/1.1" status: 200 len: 1092 time: 1.0765214 Dec 21 03:46:56.137053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'tag': '309abf42-4548-412c-ad2e-67d338e5fa00'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:56.139299 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-266e67b7-5aab-4992-b4e0-d33ef2469b40" -d '{"events": [{"name": "network-changed", "server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "tag": "309abf42-4548-412c-ad2e-67d338e5fa00"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:56.198150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa01dea-e737-4f2a-886c-e46f8c818a46 service neutron] Pushing event updated for resources: {'Port': ['ID=309abf42-4548-412c-ad2e-67d338e5fa00,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:56.249966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-4603d953-7670-4826-b340-7f213a540dee tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.251802 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-4603d953-7670-4826-b340-7f213a540dee tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 822 time: 0.1815219 Dec 21 03:46:56.283415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'port': {'device_id': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'admin_state_up': True, 'tenant_id': '7a49d4228d05498db20fade9b7651659'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:56.294668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Request body: {'port': {'device_id': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:56.365898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04597685-b290-4b73-9f35-1642f9eb570b req-81217bea-eaa0-4a0e-b1f8-3a896e07a9b0 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.367431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04597685-b290-4b73-9f35-1642f9eb570b req-81217bea-eaa0-4a0e-b1f8-3a896e07a9b0 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.0518506 Dec 21 03:46:56.435206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:56.439661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04597685-b290-4b73-9f35-1642f9eb570b req-5fae4d3b-2dfc-46c6-a62d-fc6f2b07804c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628867 Dec 21 03:46:56.502593 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-355f9d1e-334e-414d-b48c-758e6f09f128 x-openstack-request-id: req-355f9d1e-334e-414d-b48c-758e6f09f128 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:56.503130 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "tag": "309abf42-4548-412c-ad2e-67d338e5fa00", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:56.503487 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-355f9d1e-334e-414d-b48c-758e6f09f128 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:56.504193 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'tag': '309abf42-4548-412c-ad2e-67d338e5fa00', 'status': 'completed', 'code': 200} Dec 21 03:46:56.567390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-a6ed2235-cddc-4b33-9d77-6e9481f7a72b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.569076 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-a6ed2235-cddc-4b33-9d77-6e9481f7a72b tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.1315839 Dec 21 03:46:56.656018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e1dc72-cda9-4dd0-8fab-7680043046f0 req-5ec53739-053d-49d4-890a-441c5412b843 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.664058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e1dc72-cda9-4dd0-8fab-7680043046f0 req-5ec53739-053d-49d4-890a-441c5412b843 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.670642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e1dc72-cda9-4dd0-8fab-7680043046f0 req-5ec53739-053d-49d4-890a-441c5412b843 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.676181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09e1dc72-cda9-4dd0-8fab-7680043046f0 req-5ec53739-053d-49d4-890a-441c5412b843 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2388 time: 0.0978858 Dec 21 03:46:56.682828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-c6d4c42d-d63c-4208-81be-cec49c30f52a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.683437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-c6d4c42d-d63c-4208-81be-cec49c30f52a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.683970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-c6d4c42d-d63c-4208-81be-cec49c30f52a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.685825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-c6d4c42d-d63c-4208-81be-cec49c30f52a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2732 time: 0.1170566 Dec 21 03:46:56.739334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09e1dc72-cda9-4dd0-8fab-7680043046f0 req-444bb1b3-5a6e-4cfa-a2ad-33622027899e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524967 Dec 21 03:46:56.796374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Made reservation on behalf of 7a49d4228d05498db20fade9b7651659 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:46:56.800119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:56.874591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-2ee81c12-4ad2-4ca8-ab44-2ba0a83934ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.875193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-2ee81c12-4ad2-4ca8-ab44-2ba0a83934ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.875709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-2ee81c12-4ad2-4ca8-ab44-2ba0a83934ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.877268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-2ee81c12-4ad2-4ca8-ab44-2ba0a83934ec service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&shared=False HTTP/1.1" status: 200 len: 2289 time: 0.1520927 Dec 21 03:46:56.903047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Deleting port 465bd6cc-6c8f-4b1c-924a-e655a016d3db {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:46:56.903609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:56.924068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2cacab5-80f4-454f-9e37-0fa34152c171 req-9a56835f-343f-4520-90b6-f292264b243a tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:56.926451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2cacab5-80f4-454f-9e37-0fa34152c171 req-9a56835f-343f-4520-90b6-f292264b243a tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1096 time: 0.0929663 Dec 21 03:46:57.024049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-1c5bf2b9-091d-4eca-a111-1534bd7836ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.025438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-266e67b7-5aab-4992-b4e0-d33ef2469b40 req-1c5bf2b9-091d-4eca-a111-1534bd7836ce service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1372938 Dec 21 03:46:57.036971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2cacab5-80f4-454f-9e37-0fa34152c171 req-e4818bf1-cae9-43e6-810c-87221db75eb3 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834279 Dec 21 03:46:57.080985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 54e4beae-74f2-4632-b9a3-5c575004e2a8 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:57.093379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5062a487-76b7-40ea-b9d4-d9dcdf14e034 req-650bb59a-0492-40cf-9423-7013ab504b35 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.094976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5062a487-76b7-40ea-b9d4-d9dcdf14e034 req-650bb59a-0492-40cf-9423-7013ab504b35 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0686522 Dec 21 03:46:57.104562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.117243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] For port 465bd6cc-6c8f-4b1c-924a-e655a016d3db, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=465bd6cc-6c8f-4b1c-924a-e655a016d3db,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:57.117487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.134274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Allocated IP 172.20.0.12 (7c34a09c-fe79-4a56-ac99-3b531a9f3f91/ec8e3a7f-1bef-41ac-8b72-508d262fe30c/f8716759-f9e1-41d6-94ee-713ee38eca01) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:46:57.146814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Calling delete_port for 465bd6cc-6c8f-4b1c-924a-e655a016d3db owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:46:57.150679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Transition to ACTIVE for port object 54e4beae-74f2-4632-b9a3-5c575004e2a8 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:57.161007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5062a487-76b7-40ea-b9d4-d9dcdf14e034 req-f2479e78-f124-4f22-b17d-e8915293aa8d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517795 Dec 21 03:46:57.215533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a337fd59-5a84-4091-89d0-9d85f5253a7c req-e5acde48-21a2-495e-bde9-0b4850f19f81 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.217067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a337fd59-5a84-4091-89d0-9d85f5253a7c req-e5acde48-21a2-495e-bde9-0b4850f19f81 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 950 time: 0.0608511 Dec 21 03:46:57.253352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.298332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a337fd59-5a84-4091-89d0-9d85f5253a7c req-e5a61c06-259a-4693-99e5-cb3d113d1dba tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742552 Dec 21 03:46:57.302561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d587c5-198e-4c5c-ab30-b6fa24f9445e req-1f9d9504-80e2-4fd9-b2f2-6263a05ef49e tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.304142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11d587c5-198e-4c5c-ab30-b6fa24f9445e req-1f9d9504-80e2-4fd9-b2f2-6263a05ef49e tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 1096 time: 0.0666356 Dec 21 03:46:57.379327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11d587c5-198e-4c5c-ab30-b6fa24f9445e req-e9d21867-537a-491f-a6e1-2d40160db825 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655570 Dec 21 03:46:57.391972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Pushing event updated for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:57.526735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d426726b-451c-4971-8757-b0050c33e48d req-addc9e7f-ba9a-42c9-8539-3128a0ecf640 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 210 time: 0.0478773 Dec 21 03:46:57.551775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.572069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Attempting to bind port 54e4beae-74f2-4632-b9a3-5c575004e2a8 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:57.572416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Attempting to bind port 54e4beae-74f2-4632-b9a3-5c575004e2a8 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:57.572750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Attempting to bind port 54e4beae-74f2-4632-b9a3-5c575004e2a8 on network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:57.582005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Port 54e4beae-74f2-4632-b9a3-5c575004e2a8 on network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:57.582331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Attempting to bind port 54e4beae-74f2-4632-b9a3-5c575004e2a8 on network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:57.601854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:57.602150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Checking segment: {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:57.602551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Bound using segment: {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:57.603044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Bound port: 54e4beae-74f2-4632-b9a3-5c575004e2a8, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7b4d34cf-3c63-49c3-abdd-3f6308c046d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:57.603407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.621685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.657591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6807c0f5-8451-4ed4-a51e-0d565a72e491', '465bd6cc-6c8f-4b1c-924a-e655a016d3db', 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:46:57.679142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event deleted for resources: {'Port': ['ID=465bd6cc-6c8f-4b1c-924a-e655a016d3db,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:57.734049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] No DVR routers for this DVR port 465bd6cc-6c8f-4b1c-924a-e655a016d3db on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:46:57.737647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.741792 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74b16d14-18f3-46f5-9d21-c77f02cef718 req-8c7d3fe1-ed0f-47a0-984a-6b5d19ea80d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "DELETE /v2.0/ports/465bd6cc-6c8f-4b1c-924a-e655a016d3db HTTP/1.1" status: 204 len: 173 time: 1.1616175 Dec 21 03:46:57.760758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.777357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:57.819149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:57.828198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:46:57.831600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:46:57.834442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:46:57.865935 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:57.881562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9086f67e-bad9-427f-8b65-9d8a1eda5c51 req-e09d49ba-c824-4092-91ac-26993f98455b tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.886689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9086f67e-bad9-427f-8b65-9d8a1eda5c51 req-e09d49ba-c824-4092-91ac-26993f98455b tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 950 time: 0.0850680 Dec 21 03:46:57.901687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.902419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.907515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.938539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9086f67e-bad9-427f-8b65-9d8a1eda5c51 req-020116bf-7ac6-47c2-82b6-0f71d467d1e4 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480676 Dec 21 03:46:57.951642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:57.952135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:57.953542 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] 10.222.0.31 "PUT /v2.0/ports/54e4beae-74f2-4632-b9a3-5c575004e2a8 HTTP/1.1" status: 200 len: 1093 time: 1.6663284 Dec 21 03:46:57.994577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a7831ee-2c60-4068-a4f7-8037cf3c73b8 service neutron] Pushing event updated for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:58.048505 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-40d2fcce-e454-48fe-abdd-123de88d09b9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7709429 Dec 21 03:46:58.061221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8591a8-78ad-4e8e-9175-2f94cb2b38a4 req-0263cd40-b670-498c-a283-d8b809e60391 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.067284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8591a8-78ad-4e8e-9175-2f94cb2b38a4 req-0263cd40-b670-498c-a283-d8b809e60391 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.073008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Request body: {'port': {'device_id': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:58.077265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8591a8-78ad-4e8e-9175-2f94cb2b38a4 req-0263cd40-b670-498c-a283-d8b809e60391 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.077265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c8591a8-78ad-4e8e-9175-2f94cb2b38a4 req-0263cd40-b670-498c-a283-d8b809e60391 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2400 time: 0.0779183 Dec 21 03:46:58.118877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Request body: {'port': {'device_id': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:46:58.137963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c8591a8-78ad-4e8e-9175-2f94cb2b38a4 req-3322eacf-4099-4580-94a4-72c466fbb8b1 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539088 Dec 21 03:46:58.197004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:58.308341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:46:58.381710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08d7a2bd-4426-4e72-96fb-0941aca7fddc req-dac5d567-7355-4588-928a-02c43d96068b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.385559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08d7a2bd-4426-4e72-96fb-0941aca7fddc req-dac5d567-7355-4588-928a-02c43d96068b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0854995 Dec 21 03:46:58.427586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:58.445272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4082b5ad-68f1-46b6-aa26-c9971e97ad82 req-4ea5ae14-270d-4d00-9841-fbfbd5c43f26 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=07e22202-8c9b-481b-b5b1-eb2fb572b5b6 HTTP/1.1" status: 200 len: 210 time: 0.0346673 Dec 21 03:46:58.454605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:58.456439 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f90544a-9f25-4b61-8d25-32acb83a4b53" -d '{"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-unplugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:58.477104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:46:58.483187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08d7a2bd-4426-4e72-96fb-0941aca7fddc req-6589d4e8-0129-47ec-a0e2-11f96f3cedfc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892365 Dec 21 03:46:58.500335 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-525924ff-bb99-4ed3-9aff-87e5388e347a x-openstack-request-id: req-525924ff-bb99-4ed3-9aff-87e5388e347a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:58.500656 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-unplugged", "status": "completed", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:58.501449 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-525924ff-bb99-4ed3-9aff-87e5388e347a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:58.501840 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'code': 200} Dec 21 03:46:58.534096 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:58.583233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:58.589237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'name': 'network-vif-deleted', 'tag': '465bd6cc-6c8f-4b1c-924a-e655a016d3db'}, {'name': 'network-changed', 'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:46:58.591500 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c536f414-57a2-41ab-8652-a4e8c1876e66" -d '{"events": [{"server_uuid": "07e22202-8c9b-481b-b5b1-eb2fb572b5b6", "name": "network-vif-deleted", "tag": "465bd6cc-6c8f-4b1c-924a-e655a016d3db"}, {"name": "network-changed", "server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:46:58.611804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:58.639913 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:46:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbb661cf-533d-4c65-b0f5-cbc93f5da651 x-openstack-request-id: req-dbb661cf-533d-4c65-b0f5-cbc93f5da651 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:46:58.645650 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "07e22202-8c9b-481b-b5b1-eb2fb572b5b6", "name": "network-vif-deleted", "tag": "465bd6cc-6c8f-4b1c-924a-e655a016d3db", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:46:58.645650 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dbb661cf-533d-4c65-b0f5-cbc93f5da651 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:46:58.645650 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07e22202-8c9b-481b-b5b1-eb2fb572b5b6', 'name': 'network-vif-deleted', 'tag': '465bd6cc-6c8f-4b1c-924a-e655a016d3db', 'status': 'completed', 'code': 200} Dec 21 03:46:58.645650 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8', 'status': 'completed', 'code': 200} Dec 21 03:46:58.670702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ae99bb-22e5-47a0-9baa-c9457e65110b req-64a94166-e866-4a0b-9ab3-f8b7ef03c150 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.672359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5ae99bb-22e5-47a0-9baa-c9457e65110b req-64a94166-e866-4a0b-9ab3-f8b7ef03c150 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 932 time: 0.0771997 Dec 21 03:46:58.726808 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5ae99bb-22e5-47a0-9baa-c9457e65110b req-ac4bfcfb-b1f9-4207-bcdb-8dbe0a527ff3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436873 Dec 21 03:46:58.780436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-54563bb9-40ac-40da-af83-275ad4f78fff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.781655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-54563bb9-40ac-40da-af83-275ad4f78fff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.784533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-54563bb9-40ac-40da-af83-275ad4f78fff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.788146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-54563bb9-40ac-40da-af83-275ad4f78fff service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2800 time: 0.0601659 Dec 21 03:46:58.911112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-7b5223b2-188a-4691-a10c-86075b3af7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.911478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-7b5223b2-188a-4691-a10c-86075b3af7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.912081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-7b5223b2-188a-4691-a10c-86075b3af7a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:58.913535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-7b5223b2-188a-4691-a10c-86075b3af7a3 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&shared=False HTTP/1.1" status: 200 len: 2289 time: 0.1043887 Dec 21 03:46:59.019978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-aee18a8b-26eb-4a5c-980f-32d03137366c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.020247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f8716759-f9e1-41d6-94ee-713ee38eca01 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:59.021573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c536f414-57a2-41ab-8652-a4e8c1876e66 req-aee18a8b-26eb-4a5c-980f-32d03137366c service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0972092 Dec 21 03:46:59.034982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.083140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Transition to ACTIVE for port object f8716759-f9e1-41d6-94ee-713ee38eca01 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:59.088870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 204c72a6-5710-46ff-87ad-a1a7bbd4f24a {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:46:59.097416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.110610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Transition to ACTIVE for port object 204c72a6-5710-46ff-87ad-a1a7bbd4f24a will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:46:59.110814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0d8cd7-9cef-42ea-8a59-9a173be80844 req-4adbb25b-e5b0-443b-9451-823ca43287f8 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.112308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b0d8cd7-9cef-42ea-8a59-9a173be80844 req-4adbb25b-e5b0-443b-9451-823ca43287f8 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 948 time: 0.0736039 Dec 21 03:46:59.156718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.176790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b0d8cd7-9cef-42ea-8a59-9a173be80844 req-01660bad-6ef2-4e08-9e45-ce93b2a482e9 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580249 Dec 21 03:46:59.211112 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.228256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:59.336803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Pushing event updated for resources: {'Port': ['ID=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:59.376336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741dc9f-cc42-4eb5-9ee7-460594f77541 req-fd3519ec-9d67-4bbd-bfeb-36f2b0993a17 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.383751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741dc9f-cc42-4eb5-9ee7-460594f77541 req-fd3519ec-9d67-4bbd-bfeb-36f2b0993a17 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.397864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741dc9f-cc42-4eb5-9ee7-460594f77541 req-fd3519ec-9d67-4bbd-bfeb-36f2b0993a17 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.400311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d741dc9f-cc42-4eb5-9ee7-460594f77541 req-fd3519ec-9d67-4bbd-bfeb-36f2b0993a17 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2412 time: 0.1314595 Dec 21 03:46:59.442986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Attempting to bind port f8716759-f9e1-41d6-94ee-713ee38eca01 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:59.443372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Attempting to bind port f8716759-f9e1-41d6-94ee-713ee38eca01 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:59.443761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Attempting to bind port f8716759-f9e1-41d6-94ee-713ee38eca01 on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:59.452589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Port f8716759-f9e1-41d6-94ee-713ee38eca01 on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:59.452980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Attempting to bind port f8716759-f9e1-41d6-94ee-713ee38eca01 on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:59.467107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:59.467440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Checking segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:59.467832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Bound using segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:59.468259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Bound port: f8716759-f9e1-41d6-94ee-713ee38eca01, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:59.468609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.471230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Attempting to bind port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:46:59.471554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Attempting to bind port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:46:59.471872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Attempting to bind port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a on network 6ab64731-1736-45c2-9cd4-cd4313abad0e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:59.484456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a on network 6ab64731-1736-45c2-9cd4-cd4313abad0e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:46:59.484623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Attempting to bind port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a on network 6ab64731-1736-45c2-9cd4-cd4313abad0e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:46:59.501475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:46:59.501838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d741dc9f-cc42-4eb5-9ee7-460594f77541 req-a6163908-c6c6-4498-9f76-c48a34bbbb1f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689769 Dec 21 03:46:59.502149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Checking segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:46:59.502149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Bound using segment: {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:46:59.502149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Bound port: 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '19106602-1c52-4fa6-98dd-9ea225025426', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:46:59.502149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.591945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:59.595710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:59.605800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8f8025-3681-4a9c-965c-b28604c57233 req-4c587909-1306-4c86-b98c-7c01fde98669 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.614351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c8f8025-3681-4a9c-965c-b28604c57233 req-4c587909-1306-4c86-b98c-7c01fde98669 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0597172 Dec 21 03:46:59.660931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.674922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c8f8025-3681-4a9c-965c-b28604c57233 req-37bfe4c2-26d6-408e-9424-e0900afa77e1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596998 Dec 21 03:46:59.689708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] For port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:46:59.713724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] For port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:46:59.715391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.716005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.717366 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] 10.222.0.31 "PUT /v2.0/ports/f8716759-f9e1-41d6-94ee-713ee38eca01 HTTP/1.1" status: 200 len: 1093 time: 1.6486938 Dec 21 03:46:59.733842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eceb2478-c3e7-4112-8a64-9370de04074c service neutron] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:59.797112 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.852904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.854152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:46:59.856142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] 10.222.0.31 "PUT /v2.0/ports/204c72a6-5710-46ff-87ad-a1a7bbd4f24a HTTP/1.1" status: 200 len: 1093 time: 1.7417448 Dec 21 03:46:59.936922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea25abaa-a5c9-43f3-a004-229e3e826355 service neutron] Pushing event updated for resources: {'Port': ['ID=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:46:59.955561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-b0950d03-38a9-4c06-b6c2-9fa138e9b494 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:46:59.957347 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-b0950d03-38a9-4c06-b6c2-9fa138e9b494 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 1096 time: 0.0777423 Dec 21 03:47:00.018622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adbb3d6-6fd5-4607-9eee-85b33ce71451 req-c44c94d4-58c9-4f30-a21b-590be36e95c6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.020950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9adbb3d6-6fd5-4607-9eee-85b33ce71451 req-c44c94d4-58c9-4f30-a21b-590be36e95c6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 944 time: 0.1176932 Dec 21 03:47:00.066282 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-ceb01263-ba7c-46d0-996d-9ac04231ff95 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f8716759-f9e1-41d6-94ee-713ee38eca01 HTTP/1.1" status: 200 len: 217 time: 0.0851433 Dec 21 03:47:00.128119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9adbb3d6-6fd5-4607-9eee-85b33ce71451 req-8ef781b8-32c7-4484-b54e-7476b59f7679 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994785 Dec 21 03:47:00.133434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-936efeb8-55ae-4c5b-8d92-bab7ec84b264 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.133949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-936efeb8-55ae-4c5b-8d92-bab7ec84b264 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.134574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-936efeb8-55ae-4c5b-8d92-bab7ec84b264 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.136291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-936efeb8-55ae-4c5b-8d92-bab7ec84b264 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2868 time: 0.1450295 Dec 21 03:47:00.145255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972e94c3-d076-4c9f-b57f-784e99abf504 req-930bab5b-c29c-4b2f-8120-2ba0c714ac42 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.146787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-972e94c3-d076-4c9f-b57f-784e99abf504 req-930bab5b-c29c-4b2f-8120-2ba0c714ac42 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 950 time: 0.0921066 Dec 21 03:47:00.150883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac90163d-1040-4c56-8118-7145fee84d20 req-d7d83be7-7f21-4a35-8c14-595308f14117 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.152339 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-d7d83be7-7f21-4a35-8c14-595308f14117 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 200 len: 862 time: 0.0711668 Dec 21 03:47:00.208002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-972e94c3-d076-4c9f-b57f-784e99abf504 req-2fde2455-a348-456c-892c-d96f967df3da tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495191 Dec 21 03:47:00.231511 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-29e3c975-e101-429b-b55f-b00ed8b5ac6d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.66&port_id=309abf42-4548-412c-ad2e-67d338e5fa00 HTTP/1.1" status: 200 len: 217 time: 0.0691955 Dec 21 03:47:00.233756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-0786ab58-ad87-41a9-9487-4429cdf3f732 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0649457 Dec 21 03:47:00.296262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 465bd6cc-6c8f-4b1c-924a-e655a016d3db no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:00.303881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bbc562-d781-4c5c-a581-291d3889b546 req-31c9d3ba-7ab3-4d98-b88a-04bdd65545cc tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.305459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03bbc562-d781-4c5c-a581-291d3889b546 req-31c9d3ba-7ab3-4d98-b88a-04bdd65545cc tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 948 time: 0.0548644 Dec 21 03:47:00.329509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 465bd6cc-6c8f-4b1c-924a-e655a016d3db {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:00.330166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 465bd6cc-6c8f-4b1c-924a-e655a016d3db not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:00.356627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03bbc562-d781-4c5c-a581-291d3889b546 req-a540f105-679a-4eb9-8324-a43777287856 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453753 Dec 21 03:47:00.363717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-ae4d29c8-6a39-428e-a991-ac2787ef6458 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.365379 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-ae4d29c8-6a39-428e-a991-ac2787ef6458 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=02556e47-25b2-4c72-a874-afa8b0d11077 HTTP/1.1" status: 200 len: 801 time: 0.1127172 Dec 21 03:47:00.419942 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-3a21d01d-2ae1-45f8-8b98-e333d12c1245 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1583955 Dec 21 03:47:00.432573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-e8e94134-cff8-4d0c-8b87-a38e15a95839 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.433994 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-e8e94134-cff8-4d0c-8b87-a38e15a95839 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6ab64731-1736-45c2-9cd4-cd4313abad0e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0591061 Dec 21 03:47:00.605361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94cf21f-425a-4eca-a27d-d753fd88d6b3 req-69f06226-517f-4b42-a2ad-4cdfca1bb3b9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.612737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94cf21f-425a-4eca-a27d-d753fd88d6b3 req-69f06226-517f-4b42-a2ad-4cdfca1bb3b9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.619216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94cf21f-425a-4eca-a27d-d753fd88d6b3 req-69f06226-517f-4b42-a2ad-4cdfca1bb3b9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.621090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e94cf21f-425a-4eca-a27d-d753fd88d6b3 req-69f06226-517f-4b42-a2ad-4cdfca1bb3b9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2412 time: 0.0681100 Dec 21 03:47:00.639137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-79a6033a-1699-44db-8b6b-77541ec8a702 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.640679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-79a6033a-1699-44db-8b6b-77541ec8a702 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.54 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 948 time: 0.1870394 Dec 21 03:47:00.644403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01'}, {'name': 'network-changed', 'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'tag': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:00.646663 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a463a02-94f4-4f5e-9af9-7c4737021dcb" -d '{"events": [{"name": "network-changed", "server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01"}, {"name": "network-changed", "server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "tag": "204c72a6-5710-46ff-87ad-a1a7bbd4f24a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:00.674041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e94cf21f-425a-4eca-a27d-d753fd88d6b3 req-62d55a41-81d7-4dcc-b9c6-5cd39b46d8ef tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458989 Dec 21 03:47:00.697969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac90163d-1040-4c56-8118-7145fee84d20 req-b6141f1e-d02b-4c85-a056-285a70adc073 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2630408 Dec 21 03:47:00.705515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-0de7761f-8153-4c2a-bd1e-d8d03c0f84a6 service neutron] 10.222.0.31 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2470231 Dec 21 03:47:00.707065 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33553b71-fd18-4676-81be-e2cf06fa6e26 x-openstack-request-id: req-33553b71-fd18-4676-81be-e2cf06fa6e26 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:00.707364 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "tag": "204c72a6-5710-46ff-87ad-a1a7bbd4f24a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:00.707623 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-33553b71-fd18-4676-81be-e2cf06fa6e26 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:00.708019 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'status': 'completed', 'code': 200} Dec 21 03:47:00.708371 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'tag': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a', 'status': 'completed', 'code': 200} Dec 21 03:47:00.850343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Deleting port eccc8c5c-70cc-45fa-b816-4e666ed149dd {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:00.850687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:00.870288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed5b05ad-de49-4442-ac08-2a6023d673bb req-c27b37cf-c63b-44c1-b89b-b3947e1bf131 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:00.872029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed5b05ad-de49-4442-ac08-2a6023d673bb req-c27b37cf-c63b-44c1-b89b-b3947e1bf131 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1103582 Dec 21 03:47:00.876032 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-71c5beab-152b-4d64-bee8-4ac10a320064 service neutron] 10.222.0.31 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1333771 Dec 21 03:47:00.883583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-15ae2888-badd-4d32-af1c-0748b97f74bc service neutron] 10.222.0.54 "GET /v2.0/ports/52f73cf2-b045-4f07-b974-6c29f7b35de0/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.0815601 Dec 21 03:47:00.946425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed5b05ad-de49-4442-ac08-2a6023d673bb req-ab25eeaa-0629-4355-9511-ad126ffad8a9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568159 Dec 21 03:47:00.980381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-66fd79ae-c283-4db4-903c-2e3c71692e7f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.185&port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8 HTTP/1.1" status: 200 len: 217 time: 0.0689602 Dec 21 03:47:01.058101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] For port eccc8c5c-70cc-45fa-b816-4e666ed149dd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=eccc8c5c-70cc-45fa-b816-4e666ed149dd,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:01.058862 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:01.070801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-f4bc8fa4-d461-4e84-b6c3-b6851f535edf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.072329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-f4bc8fa4-d461-4e84-b6c3-b6851f535edf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 1096 time: 0.1621377 Dec 21 03:47:01.079570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-5a8cfbfe-600d-4dfb-9340-54f83f794e27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.079570 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-5a8cfbfe-600d-4dfb-9340-54f83f794e27 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691 HTTP/1.1" status: 200 len: 801 time: 0.0875981 Dec 21 03:47:01.081971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Calling delete_port for eccc8c5c-70cc-45fa-b816-4e666ed149dd owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:01.255129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-d922000e-b747-4486-899f-cce837bc9c03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.256632 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-d922000e-b747-4486-899f-cce837bc9c03 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9ac60f83-5dc7-4da3-bc95-925c1ce35491&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1684701 Dec 21 03:47:01.286551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce246bd8-caeb-49a1-8255-cb7d309b8a04 req-f1c8562d-7d8e-470a-9e61-f72e72e40971 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.289561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce246bd8-caeb-49a1-8255-cb7d309b8a04 req-f1c8562d-7d8e-470a-9e61-f72e72e40971 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 944 time: 0.0895138 Dec 21 03:47:01.299322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-dc76c559-a3e1-4438-9b0b-39ad0ad5d86f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.300804 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-dc76c559-a3e1-4438-9b0b-39ad0ad5d86f service neutron] 10.222.0.31 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 923 time: 0.2115173 Dec 21 03:47:01.378788 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-f2ee66c4-52b9-46e9-925e-c48590825f1c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f8716759-f9e1-41d6-94ee-713ee38eca01 HTTP/1.1" status: 200 len: 217 time: 0.0695207 Dec 21 03:47:01.399634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce246bd8-caeb-49a1-8255-cb7d309b8a04 req-5a2e900a-85c3-46ad-8d0b-d72bf7603409 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039853 Dec 21 03:47:01.463417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e41329-8585-4a3c-8b92-e8dfcee4dc3b req-8699b19a-d4a5-4bef-b71d-195884934a29 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.471162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6e41329-8585-4a3c-8b92-e8dfcee4dc3b req-8699b19a-d4a5-4bef-b71d-195884934a29 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 950 time: 0.1450884 Dec 21 03:47:01.493430 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-8e8c9084-b06f-45f7-b345-01db1260809f service neutron] 10.222.0.31 "GET /v2.0/networks/9ac60f83-5dc7-4da3-bc95-925c1ce35491?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2248037 Dec 21 03:47:01.495577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-b24924e5-d295-4da6-977b-a44c3da32ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.496441 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-b24924e5-d295-4da6-977b-a44c3da32ce6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 200 len: 862 time: 0.0978653 Dec 21 03:47:01.527040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-054c6885-ca19-448d-87fe-2b9cb3b4a0b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.528337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-054c6885-ca19-448d-87fe-2b9cb3b4a0b1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030&tenant_id=408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 1102 time: 0.1210186 Dec 21 03:47:01.554421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-d86666d4-91ed-441e-84eb-03b71a1c78cd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0387914 Dec 21 03:47:01.562477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:01.573111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6e41329-8585-4a3c-8b92-e8dfcee4dc3b req-100ff2a1-0d8d-4ed6-aa71-b7ebd1251677 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010785 Dec 21 03:47:01.617209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24bbfc67-19f9-48f8-b63b-d9c454bc92c5 req-5e54e79a-e932-4c97-bc1e-1d5ba7e50618 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.618723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24bbfc67-19f9-48f8-b63b-d9c454bc92c5 req-5e54e79a-e932-4c97-bc1e-1d5ba7e50618 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 866 time: 0.1144607 Dec 21 03:47:01.679292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-73212993-d7e6-4f8c-9290-c4662f04f3aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.680770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-73212993-d7e6-4f8c-9290-c4662f04f3aa service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1102 time: 0.1001284 Dec 21 03:47:01.689864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24bbfc67-19f9-48f8-b63b-d9c454bc92c5 req-e7e6d269-aa08-48d2-b8c5-271793ba0e6d tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/security-groups?id=2b91dc82-f9a5-4074-a9a2-7088d3d1b763&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578704 Dec 21 03:47:01.721325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-d85526dc-de04-4b98-ab59-6dcebfa3b9bd service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1548288 Dec 21 03:47:01.776238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Pushing event deleted for resources: {'Port': ['ID=eccc8c5c-70cc-45fa-b816-4e666ed149dd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:01.854415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-9a8aee68-0cbf-43e4-bbb0-4f6affe2cfdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.856238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-9a8aee68-0cbf-43e4-bbb0-4f6affe2cfdc service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1655285 Dec 21 03:47:01.866765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc368bd-7456-4b80-8e8f-d5a06b6e5c7e req-504e72a8-c70d-4714-b341-54da225193f1 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.872987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc368bd-7456-4b80-8e8f-d5a06b6e5c7e req-504e72a8-c70d-4714-b341-54da225193f1 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.879693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc368bd-7456-4b80-8e8f-d5a06b6e5c7e req-504e72a8-c70d-4714-b341-54da225193f1 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:01.881306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efc368bd-7456-4b80-8e8f-d5a06b6e5c7e req-504e72a8-c70d-4714-b341-54da225193f1 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2412 time: 0.1077919 Dec 21 03:47:01.883050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] No DVR routers for this DVR port eccc8c5c-70cc-45fa-b816-4e666ed149dd on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:01.888103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:01.891725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2a5c3b02-ebbf-4d58-aed3-5ac604652b9e req-7643f157-5ebb-4160-a992-a974bdb1a401 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.54 "DELETE /v2.0/ports/eccc8c5c-70cc-45fa-b816-4e666ed149dd HTTP/1.1" status: 204 len: 173 time: 1.2363367 Dec 21 03:47:01.958886 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-ac368eac-e627-4896-a8ad-32c5c42e8934 service neutron] 10.222.0.31 "GET /v2.0/networks/9ac60f83-5dc7-4da3-bc95-925c1ce35491?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4510777 Dec 21 03:47:01.964061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-e469401b-82f1-484b-933c-dfc8098abdd1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.114&port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 217 time: 0.0495920 Dec 21 03:47:01.983809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efc368bd-7456-4b80-8e8f-d5a06b6e5c7e req-cac28d71-dc5a-4185-8fda-1f8155dd1ecf tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869541 Dec 21 03:47:02.010832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-eee236a0-9a18-4541-bde7-4bb6f4a119a2 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2376444 Dec 21 03:47:02.012446 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-0f1874ed-deae-430c-a76c-fbb0e6846cc5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.101&port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a HTTP/1.1" status: 200 len: 217 time: 0.0454543 Dec 21 03:47:02.115584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-cdf5d989-3052-4331-a825-a0e6da987424 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.117702 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-cdf5d989-3052-4331-a825-a0e6da987424 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=02556e47-25b2-4c72-a874-afa8b0d11077 HTTP/1.1" status: 200 len: 801 time: 0.0731161 Dec 21 03:47:02.123803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-c4ad59dc-6a99-4ac9-87df-e5c6a4788410 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.125391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-c4ad59dc-6a99-4ac9-87df-e5c6a4788410 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1379514 Dec 21 03:47:02.141367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-6adb2c28-c2ab-4c9c-8bc6-85a5b922c491 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.144010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-6adb2c28-c2ab-4c9c-8bc6-85a5b922c491 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 950 time: 0.2249131 Dec 21 03:47:02.182719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62217eff-cb85-49c4-ae9b-268d09115f18 req-b8bfffa7-e67b-4aaf-9470-8b0209a6192c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.192181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62217eff-cb85-49c4-ae9b-268d09115f18 req-b8bfffa7-e67b-4aaf-9470-8b0209a6192c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1255889 Dec 21 03:47:02.239557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-6bc985d6-74ee-4f64-9309-10e3e24e4473 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.241597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-6bc985d6-74ee-4f64-9309-10e3e24e4473 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1070356 Dec 21 03:47:02.265823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62217eff-cb85-49c4-ae9b-268d09115f18 req-5aa4bd46-f97f-45a8-94d7-0e2e11aed036 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725770 Dec 21 03:47:02.316655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70704917-ccef-41d6-b45d-043747017598 req-4e6de7cd-1615-4a3f-9b7e-c221a3e70419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.318321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-4e6de7cd-1615-4a3f-9b7e-c221a3e70419 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6ab64731-1736-45c2-9cd4-cd4313abad0e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1730049 Dec 21 03:47:02.382069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-b57b072f-49c9-45d3-817d-33c687ab4142 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1151323 Dec 21 03:47:02.408715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Deleting port 6807c0f5-8451-4ed4-a51e-0d565a72e491 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:02.409129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:02.489172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-1dfa33ab-7529-47ff-a99d-8f6f0c053def service neutron] 10.222.0.31 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1555667 Dec 21 03:47:02.507957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edb489d9-fb97-4674-8180-39a1d63b6316 req-96daf01f-427b-4aac-9e7e-f5b4b4c53018 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1171126 Dec 21 03:47:02.543023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8118ba-8f5c-40e4-8ddc-92c753b7540b req-a9766a38-7972-417e-80f6-d55c4fc89c19 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:02.543995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] For port 6807c0f5-8451-4ed4-a51e-0d565a72e491, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6807c0f5-8451-4ed4-a51e-0d565a72e491,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:02.544433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:02.549237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a8118ba-8f5c-40e4-8ddc-92c753b7540b req-a9766a38-7972-417e-80f6-d55c4fc89c19 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 944 time: 0.0707870 Dec 21 03:47:02.591225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Calling delete_port for 6807c0f5-8451-4ed4-a51e-0d565a72e491 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:02.640337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a8118ba-8f5c-40e4-8ddc-92c753b7540b req-1dc8c8f3-14e4-4a70-a4b4-0e7344f3c9a5 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809479 Dec 21 03:47:02.649572 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-70704917-ccef-41d6-b45d-043747017598 req-0cbbc212-e9d3-49b9-8658-53b0f4b65d7b service neutron] 10.222.0.31 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1470528 Dec 21 03:47:02.709750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-deleted', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:02.712789 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a096c2c-2f21-4025-ab1f-784a7901686e" -d '{"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-deleted", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:02.864269 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9203c87-b06d-4ada-ac23-017855fa51e0 x-openstack-request-id: req-d9203c87-b06d-4ada-ac23-017855fa51e0 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:02.864889 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b657c944-8790-47fa-9a50-dfd701f1bdbf", "name": "network-vif-deleted", "tag": "eccc8c5c-70cc-45fa-b816-4e666ed149dd", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:02.865415 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d9203c87-b06d-4ada-ac23-017855fa51e0 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:02.865961 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b657c944-8790-47fa-9a50-dfd701f1bdbf', 'name': 'network-vif-deleted', 'tag': 'eccc8c5c-70cc-45fa-b816-4e666ed149dd', 'status': 'completed', 'code': 200} Dec 21 03:47:02.974477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:03.009891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6807c0f5-8451-4ed4-a51e-0d565a72e491', 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:03.026799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event deleted for resources: {'Port': ['ID=6807c0f5-8451-4ed4-a51e-0d565a72e491,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:03.124537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6b20da2-5cdf-4a53-bc7c-104cb3bfc850 req-e5c05167-4527-494d-96a3-f18695bc7f66 tempest-ImagesOneServerTestJSON-796446391 tempest-ImagesOneServerTestJSON-796446391-project] 10.222.0.18 "GET /v2.0/ports?device_id=b657c944-8790-47fa-9a50-dfd701f1bdbf HTTP/1.1" status: 200 len: 210 time: 0.0680821 Dec 21 03:47:03.192681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1cc994-0f9f-48a7-9db1-0f7c9b350679 req-f8693151-22ae-46b1-b812-2b695560c7fe tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.196675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1cc994-0f9f-48a7-9db1-0f7c9b350679 req-f8693151-22ae-46b1-b812-2b695560c7fe tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 867 time: 0.5392973 Dec 21 03:47:03.201401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] No DVR routers for this DVR port 6807c0f5-8451-4ed4-a51e-0d565a72e491 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:03.204974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:03.209963 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f984dcc6-7891-4f50-b1e6-4913ce195361 req-27f160ec-44de-4b90-b67d-b024a9398ec6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "DELETE /v2.0/ports/6807c0f5-8451-4ed4-a51e-0d565a72e491 HTTP/1.1" status: 204 len: 173 time: 1.0477066 Dec 21 03:47:03.218000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-7c3a66fa-6aae-4239-95b8-e5c085bd635e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.218681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-7c3a66fa-6aae-4239-95b8-e5c085bd635e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.229625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-7c3a66fa-6aae-4239-95b8-e5c085bd635e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.232498 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-7c3a66fa-6aae-4239-95b8-e5c085bd635e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2868 time: 0.2208378 Dec 21 03:47:03.314859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1cc994-0f9f-48a7-9db1-0f7c9b350679 req-3c64ca3a-cc01-4a56-b72c-0e05116315a6 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098773 Dec 21 03:47:03.398158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-f6e1deab-342c-4cdc-90f4-7638f4d0b0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.399969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-f6e1deab-342c-4cdc-90f4-7638f4d0b0a4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=6ab64731-1736-45c2-9cd4-cd4313abad0e HTTP/1.1" status: 200 len: 901 time: 0.1601384 Dec 21 03:47:03.409943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf7ec18-9087-45de-85ba-35a348ecf44a req-ada94eb5-7e75-4c8e-8abc-4f5c424219e9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.416448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf7ec18-9087-45de-85ba-35a348ecf44a req-ada94eb5-7e75-4c8e-8abc-4f5c424219e9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.423196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf7ec18-9087-45de-85ba-35a348ecf44a req-ada94eb5-7e75-4c8e-8abc-4f5c424219e9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.425008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bf7ec18-9087-45de-85ba-35a348ecf44a req-ada94eb5-7e75-4c8e-8abc-4f5c424219e9 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2412 time: 0.0675528 Dec 21 03:47:03.536707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bf7ec18-9087-45de-85ba-35a348ecf44a req-0f1f4c83-691a-4d10-89fd-79c9332a8956 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998764 Dec 21 03:47:03.544464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-727cbd0d-1c15-467f-a635-a000ad18ec0c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.101&port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a HTTP/1.1" status: 200 len: 217 time: 0.1117249 Dec 21 03:47:03.624835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66f3af2d-4c4e-41b5-9e6f-72d63e50a6d9 req-9f8b6d29-d2ae-4fee-b00a-f3981e5aa714 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.637217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66f3af2d-4c4e-41b5-9e6f-72d63e50a6d9 req-9f8b6d29-d2ae-4fee-b00a-f3981e5aa714 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0909359 Dec 21 03:47:03.707643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66f3af2d-4c4e-41b5-9e6f-72d63e50a6d9 req-45986038-bcf2-4f6e-a976-34afaae624cc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652833 Dec 21 03:47:03.801730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adb47893-3e61-48c5-b6e6-23647646e95a req-e18fdae0-8f62-43b2-a9fa-0dfa40c768cc tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.816214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adb47893-3e61-48c5-b6e6-23647646e95a req-e18fdae0-8f62-43b2-a9fa-0dfa40c768cc tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 944 time: 0.0724611 Dec 21 03:47:03.915056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adb47893-3e61-48c5-b6e6-23647646e95a req-faa7e573-7b86-422f-8784-5d0b5f7ba8d7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918412 Dec 21 03:47:03.976802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-1bcb837b-a3ad-429e-bcb8-7bc010e2be9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:03.978257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-1bcb837b-a3ad-429e-bcb8-7bc010e2be9b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=02556e47-25b2-4c72-a874-afa8b0d11077 HTTP/1.1" status: 200 len: 801 time: 0.4256976 Dec 21 03:47:04.029031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-a324e450-3576-4a91-b9e8-327f2de503e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:04.030654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-a324e450-3576-4a91-b9e8-327f2de503e8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6ab64731-1736-45c2-9cd4-cd4313abad0e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0442195 Dec 21 03:47:04.130877 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-b3ac041f-6600-43f5-be57-ed721a67f66f service neutron] 10.222.0.31 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904844 Dec 21 03:47:04.264520 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5a463a02-94f4-4f5e-9af9-7c4737021dcb req-2794a5db-b50b-4bb5-b0ab-1e255cc8001c service neutron] 10.222.0.31 "GET /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265593 Dec 21 03:47:04.313598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:04.383739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:04.412040 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:04.449695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecfc578c-c8f5-48ad-8834-0241ace600a7 req-fc3442c0-82b4-46c0-9a22-f5e016ec9d23 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=32d7a1bb-3071-42ac-82de-cf478fb10b00 HTTP/1.1" status: 200 len: 210 time: 0.0408831 Dec 21 03:47:04.479660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:04.486534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:04.491207 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-425354e7-cf0b-4a5f-a6c1-0189dc17376a" -d '{"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-unplugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:04.542919 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d04d3967-0ca9-40de-8f9a-f3b122c4e6a9 x-openstack-request-id: req-d04d3967-0ca9-40de-8f9a-f3b122c4e6a9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:04.543276 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-unplugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:04.543525 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d04d3967-0ca9-40de-8f9a-f3b122c4e6a9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:04.543920 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'code': 200} Dec 21 03:47:04.566532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:04.578173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'port_id': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'mac_address': 'fa:16:3e:6f:53:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec8e3a7f-1bef-41ac-8b72-508d262fe30c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:04.581671 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:04.582319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:04.637981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: eccc8c5c-70cc-45fa-b816-4e666ed149dd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:04.638246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device eccc8c5c-70cc-45fa-b816-4e666ed149dd not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:04.675845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a3a16f4-3dab-4145-82f7-4683971da0ef req-cd9e5ce4-d461-4d2c-b457-4272f635324f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:04.682480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a3a16f4-3dab-4145-82f7-4683971da0ef req-cd9e5ce4-d461-4d2c-b457-4272f635324f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:04.683720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:04.689453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a3a16f4-3dab-4145-82f7-4683971da0ef req-cd9e5ce4-d461-4d2c-b457-4272f635324f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:04.690866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:04.697504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a3a16f4-3dab-4145-82f7-4683971da0ef req-cd9e5ce4-d461-4d2c-b457-4272f635324f tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2412 time: 0.0764084 Dec 21 03:47:04.708877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f8716759-f9e1-41d6-94ee-713ee38eca01 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:04.742397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:04.745095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46366) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:04.756519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a3a16f4-3dab-4145-82f7-4683971da0ef req-0b11f912-a5f0-461f-8a4b-710f9363956e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537379 Dec 21 03:47:04.830136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca54172-9ace-4467-a778-892c3c789f75 req-a2506231-22db-4caf-b3b8-47a16c180ee0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:04.831670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ca54172-9ace-4467-a778-892c3c789f75 req-a2506231-22db-4caf-b3b8-47a16c180ee0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.0548763 Dec 21 03:47:04.867010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:04.867264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'name': 'network-vif-deleted', 'tag': '6807c0f5-8451-4ed4-a51e-0d565a72e491'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:04.869683 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81354c35-1695-4419-a7aa-fdea33c3c6ca" -d '{"events": [{"server_uuid": "32d7a1bb-3071-42ac-82de-cf478fb10b00", "name": "network-vif-deleted", "tag": "6807c0f5-8451-4ed4-a51e-0d565a72e491"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:04.888781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ca54172-9ace-4467-a778-892c3c789f75 req-deb8bfde-06a8-42f7-9773-49fd91261590 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497043 Dec 21 03:47:04.912551 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6fba74d5-1bdc-4401-8b3a-0d3511fc3c60 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a31642b4b357428184e50f7d8f1ebb76&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1660714 Dec 21 03:47:04.915528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46374) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:04.927903 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be42c9c3-bcdd-4488-bb24-03768a6ee6ee x-openstack-request-id: req-be42c9c3-bcdd-4488-bb24-03768a6ee6ee {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:04.928201 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32d7a1bb-3071-42ac-82de-cf478fb10b00", "name": "network-vif-deleted", "tag": "6807c0f5-8451-4ed4-a51e-0d565a72e491", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:04.928508 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-be42c9c3-bcdd-4488-bb24-03768a6ee6ee {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:04.931588 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32d7a1bb-3071-42ac-82de-cf478fb10b00', 'name': 'network-vif-deleted', 'tag': '6807c0f5-8451-4ed4-a51e-0d565a72e491', 'status': 'completed', 'code': 200} Dec 21 03:47:04.937801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:04.988485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d0a27f38-7e3c-4590-8277-dc3251e30f49 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:05.036189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d0a27f38-7e3c-4590-8277-dc3251e30f49 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:05.078324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99dc54a6-e303-4dce-8837-90000ed7c1c5 req-65ae02c0-3719-475d-87a4-626d9a30d199 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:05.079895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99dc54a6-e303-4dce-8837-90000ed7c1c5 req-65ae02c0-3719-475d-87a4-626d9a30d199 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 945 time: 0.0812094 Dec 21 03:47:05.138888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99dc54a6-e303-4dce-8837-90000ed7c1c5 req-f3e17e7c-69d8-4a70-bdd8-2fe900eb60e4 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502338 Dec 21 03:47:05.162733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d0a27f38-7e3c-4590-8277-dc3251e30f49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:05.173672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d0a27f38-7e3c-4590-8277-dc3251e30f49 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:05.173672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d0a27f38-7e3c-4590-8277-dc3251e30f49 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2b91dc82-f9a5-4074-a9a2-7088d3d1b763 HTTP/1.1" status: 204 len: 168 time: 0.2497482 Dec 21 03:47:05.175156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a27f38-7e3c-4590-8277-dc3251e30f49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b91dc82-f9a5-4074-a9a2-7088d3d1b763,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:05.254805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['f8716759-f9e1-41d6-94ee-713ee38eca01'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:05.875316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8907e61-123f-4f5d-9bb0-79b3532db60b req-9028a8ae-a72e-4a69-bd8d-510e16c84cac tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:05.890507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8907e61-123f-4f5d-9bb0-79b3532db60b req-9028a8ae-a72e-4a69-bd8d-510e16c84cac tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:05.897919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8907e61-123f-4f5d-9bb0-79b3532db60b req-9028a8ae-a72e-4a69-bd8d-510e16c84cac tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:05.899146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8907e61-123f-4f5d-9bb0-79b3532db60b req-9028a8ae-a72e-4a69-bd8d-510e16c84cac tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2412 time: 0.0737143 Dec 21 03:47:05.953785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8907e61-123f-4f5d-9bb0-79b3532db60b req-45cb9e25-4d57-4706-8663-c6c947781cca tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482967 Dec 21 03:47:06.117467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4dc4c2-fa5e-4d38-9f9c-cf39425dfb9b req-fe34e735-1859-4b4f-a7cb-7c78f442c101 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:06.118969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c4dc4c2-fa5e-4d38-9f9c-cf39425dfb9b req-fe34e735-1859-4b4f-a7cb-7c78f442c101 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.0760698 Dec 21 03:47:06.127630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b9bc3f-4293-48bc-ba99-67cc8900e6d7 req-efeaaf6c-9dc7-4710-8ae2-16985676c0e3 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:06.129010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70b9bc3f-4293-48bc-ba99-67cc8900e6d7 req-efeaaf6c-9dc7-4710-8ae2-16985676c0e3 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 951 time: 0.0772488 Dec 21 03:47:06.197642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c4dc4c2-fa5e-4d38-9f9c-cf39425dfb9b req-e8633426-4467-47a8-a7a0-d413b691c696 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676076 Dec 21 03:47:06.205833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70b9bc3f-4293-48bc-ba99-67cc8900e6d7 req-edeb9aae-591b-490e-84d3-eb4dbd53401e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701385 Dec 21 03:47:06.304928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:06.321368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6807c0f5-8451-4ed4-a51e-0d565a72e491 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:06.351083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c9fb44-b8b9-4f57-a5d4-df54b7c76b43 req-fbd0a37b-a31f-4314-9683-efe1139dcf05 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:06.359283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10c9fb44-b8b9-4f57-a5d4-df54b7c76b43 req-fbd0a37b-a31f-4314-9683-efe1139dcf05 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 945 time: 0.0658398 Dec 21 03:47:06.364026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 6807c0f5-8451-4ed4-a51e-0d565a72e491 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:06.364367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6807c0f5-8451-4ed4-a51e-0d565a72e491 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:06.426660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10c9fb44-b8b9-4f57-a5d4-df54b7c76b43 req-78d81630-97fa-4185-b3dc-60e55e83200c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654786 Dec 21 03:47:06.443488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 54e4beae-74f2-4632-b9a3-5c575004e2a8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:06.443488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:06.543870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:06.591876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'mac_address': 'fa:16:3e:aa:2e:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.114'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:06.656489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port f8716759-f9e1-41d6-94ee-713ee38eca01 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:06.661078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:06.675814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port f8716759-f9e1-41d6-94ee-713ee38eca01 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:06.676189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:06.679420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '54e4beae-74f2-4632-b9a3-5c575004e2a8', 'network_id': '9ac60f83-5dc7-4da3-bc95-925c1ce35491', 'port_id': '54e4beae-74f2-4632-b9a3-5c575004e2a8', 'mac_address': 'fa:16:3e:a7:d6:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691', 'ip_address': '19.86.0.185'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:06.702224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:06.748857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 52f73cf2-b045-4f07-b974-6c29f7b35de0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:06.781528 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:06.786671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:06.804051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 54e4beae-74f2-4632-b9a3-5c575004e2a8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:06.847621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:06.851887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:06.875430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:06.877683 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcd08a56-8808-4c31-be6f-53420cf2d982" -d '{"events": [{"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-plugged", "status": "completed", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:06.893941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:06.905707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.021866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44a0df6-3978-42a2-908b-3fd976be157a req-38b89468-5456-4cb9-830a-d9da159d39bd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.024627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a44a0df6-3978-42a2-908b-3fd976be157a req-38b89468-5456-4cb9-830a-d9da159d39bd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.1416626 Dec 21 03:47:07.092171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-c231e0af-2fbb-4383-b4a0-9e8cae25e7ec tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.095058 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-c231e0af-2fbb-4383-b4a0-9e8cae25e7ec tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030&tenant_id=408f05064a77442595f2b5d444671b8a&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 949 time: 0.1734698 Dec 21 03:47:07.138910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a44a0df6-3978-42a2-908b-3fd976be157a req-2a29a2c8-9675-4495-870c-23d39ef65b44 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1052961 Dec 21 03:47:07.185880 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-689a25b4-d8aa-45ea-bb4b-0e8f05617cab x-openstack-request-id: req-689a25b4-d8aa-45ea-bb4b-0e8f05617cab {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:07.186286 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-plugged", "status": "completed", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:07.186475 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-689a25b4-d8aa-45ea-bb4b-0e8f05617cab {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:07.186836 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'code': 200} Dec 21 03:47:07.192099 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.194360 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.195015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 204c72a6-5710-46ff-87ad-a1a7bbd4f24a details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:07.217015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd8ae258-d33a-4dd9-9669-fe127cf671bb req-33df62b7-052c-4f7d-aa14-f0ce65e28723 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.225168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd8ae258-d33a-4dd9-9669-fe127cf671bb req-33df62b7-052c-4f7d-aa14-f0ce65e28723 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.233015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd8ae258-d33a-4dd9-9669-fe127cf671bb req-33df62b7-052c-4f7d-aa14-f0ce65e28723 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.235043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd8ae258-d33a-4dd9-9669-fe127cf671bb req-33df62b7-052c-4f7d-aa14-f0ce65e28723 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2413 time: 0.1212716 Dec 21 03:47:07.236623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:07.278941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842934d3-a18d-4be4-b90c-a14cb1366068 req-8175430c-7b01-42ea-8df8-82afdc4316a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.289337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-842934d3-a18d-4be4-b90c-a14cb1366068 req-8175430c-7b01-42ea-8df8-82afdc4316a5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 1098 time: 0.2263458 Dec 21 03:47:07.337637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd8ae258-d33a-4dd9-9669-fe127cf671bb req-85678be5-fb42-4cc2-bc50-f81441abe80b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918083 Dec 21 03:47:07.339146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:07.340483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['52f73cf2-b045-4f07-b974-6c29f7b35de0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:07.368745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-5bb0380d-8a2a-40c1-a2b4-aaaf908919be service neutron] 10.222.0.54 "GET /v2.0/ports/52f73cf2-b045-4f07-b974-6c29f7b35de0/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.2562129 Dec 21 03:47:07.388480 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-842934d3-a18d-4be4-b90c-a14cb1366068 req-29ae7a8d-d262-4a62-9b12-fc8fe285337f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866089 Dec 21 03:47:07.389327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:07.448306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:07.450035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455024ca-e335-49c3-b0fa-c63572c84d2a req-b686c120-d7f9-4176-80dc-e614d7970d44 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.460880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-455024ca-e335-49c3-b0fa-c63572c84d2a req-b686c120-d7f9-4176-80dc-e614d7970d44 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 951 time: 0.0940466 Dec 21 03:47:07.484008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a', 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e', 'port_id': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a', 'mac_address': 'fa:16:3e:44:07:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '02556e47-25b2-4c72-a874-afa8b0d11077', 'ip_address': '19.80.0.101'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:07.503648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:07.520746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-455024ca-e335-49c3-b0fa-c63572c84d2a req-465ca647-6d4c-45af-b5b9-7449e55b6f2e tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/security-groups?id=ecf57b12-b3df-4362-97bd-0b49563f1502&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602760 Dec 21 03:47:07.563044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10912807-f311-40c8-afd3-14ca071becb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.567298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-0f250327-a9d1-4a8a-b026-85c24617795e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.568953 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-0f250327-a9d1-4a8a-b026-85c24617795e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1101 time: 0.1435349 Dec 21 03:47:07.581361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.609794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 204c72a6-5710-46ff-87ad-a1a7bbd4f24a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:07.648699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:07.663724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b128977-d681-43ff-b041-2eb3381217af req-0e9abeb5-e733-42c5-887e-c42e8027d2aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.665365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b128977-d681-43ff-b041-2eb3381217af req-0e9abeb5-e733-42c5-887e-c42e8027d2aa tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.0977604 Dec 21 03:47:07.710923 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.712516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 309abf42-4548-412c-ad2e-67d338e5fa00 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:07.750591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-40e82bf2-b9f4-4ed9-8809-52b155e1217b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.753173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-40e82bf2-b9f4-4ed9-8809-52b155e1217b service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1280956 Dec 21 03:47:07.784199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-aef9b4e7-5b41-44c1-9bc6-bd9b87fdff92 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.785905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-aef9b4e7-5b41-44c1-9bc6-bd9b87fdff92 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 951 time: 0.1428938 Dec 21 03:47:07.796849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 309abf42-4548-412c-ad2e-67d338e5fa00, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=309abf42-4548-412c-ad2e-67d338e5fa00,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:07.799682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:07.805760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b128977-d681-43ff-b041-2eb3381217af req-6d974a20-2c40-40f0-a7a7-bd31cec6e1e1 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1255734 Dec 21 03:47:07.821878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '309abf42-4548-412c-ad2e-67d338e5fa00', 'network_id': '6ab64731-1736-45c2-9cd4-cd4313abad0e', 'port_id': '309abf42-4548-412c-ad2e-67d338e5fa00', 'mac_address': 'fa:16:3e:3c:20:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '02556e47-25b2-4c72-a874-afa8b0d11077', 'ip_address': '19.80.0.66'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:07.824960 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-5447750d-5405-4ef9-9d88-ce64b6f0de34 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.114&port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 217 time: 0.0620716 Dec 21 03:47:07.830899 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10912807-f311-40c8-afd3-14ca071becb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.871698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.890165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 309abf42-4548-412c-ad2e-67d338e5fa00 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:07.912029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-159cc04c-efdc-4a53-8753-cde83de6c60f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.913512 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-159cc04c-efdc-4a53-8753-cde83de6c60f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0814681 Dec 21 03:47:07.918233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 309abf42-4548-412c-ad2e-67d338e5fa00, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=309abf42-4548-412c-ad2e-67d338e5fa00,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:07.928503 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10912807-f311-40c8-afd3-14ca071becb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.966619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-500fe0ce-dc25-46de-89d3-35b958aef4dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:07.968217 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-500fe0ce-dc25-46de-89d3-35b958aef4dd service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0464947 Dec 21 03:47:07.984592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:07.987609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10912807-f311-40c8-afd3-14ca071becb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbd56d60-f60f-4760-99b9-ae62deaea88c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:08.008503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46524) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:08.009162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-10912807-f311-40c8-afd3-14ca071becb1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a62b65ab7fcd4fa6a531d364e88cd3e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6672101 Dec 21 03:47:08.026272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Deleting port cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:08.027423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.054279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=309abf42-4548-412c-ad2e-67d338e5fa00,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:08.116221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-592d181e-1671-4a06-a410-19b3e789beb4 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1401553 Dec 21 03:47:08.120985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-208e3d25-44da-4e5d-baa8-48491a913f44 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.160472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] For port cf770d29-1c69-4f15-b07a-7cd04c2724a4, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cf770d29-1c69-4f15-b07a-7cd04c2724a4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:08.160993 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.169911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-208e3d25-44da-4e5d-baa8-48491a913f44 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.176002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Calling delete_port for cf770d29-1c69-4f15-b07a-7cd04c2724a4 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:08.259947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-68ab0c14-25ab-48b0-8d93-1780fd6a9eeb service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358581 Dec 21 03:47:08.314336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d739850d-f764-4f54-9560-4106b639f52e req-e4f9eb64-a717-4b7c-8b7b-a8bb321f2ba3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:08.315940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d739850d-f764-4f54-9560-4106b639f52e req-e4f9eb64-a717-4b7c-8b7b-a8bb321f2ba3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 949 time: 0.0687795 Dec 21 03:47:08.319820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:08.397422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-208e3d25-44da-4e5d-baa8-48491a913f44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.398012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d739850d-f764-4f54-9560-4106b639f52e req-27fe4778-c706-4a2e-9dc8-1cf2106a8c54 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750146 Dec 21 03:47:08.409826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-208e3d25-44da-4e5d-baa8-48491a913f44 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.409826 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-208e3d25-44da-4e5d-baa8-48491a913f44 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bbd56d60-f60f-4760-99b9-ae62deaea88c HTTP/1.1" status: 204 len: 168 time: 0.3927093 Dec 21 03:47:08.425969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208e3d25-44da-4e5d-baa8-48491a913f44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbd56d60-f60f-4760-99b9-ae62deaea88c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:08.447370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 52f73cf2-b045-4f07-b974-6c29f7b35de0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:08.447910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.492617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['204c72a6-5710-46ff-87ad-a1a7bbd4f24a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:08.512025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2f2ff4-235f-4b7a-b526-ef8c847abe4f req-0b1ac940-306b-4533-99f6-ad0708c6784d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:08.518448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2f2ff4-235f-4b7a-b526-ef8c847abe4f req-0b1ac940-306b-4533-99f6-ad0708c6784d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:08.526918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2f2ff4-235f-4b7a-b526-ef8c847abe4f req-0b1ac940-306b-4533-99f6-ad0708c6784d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:08.528110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a2f2ff4-235f-4b7a-b526-ef8c847abe4f req-0b1ac940-306b-4533-99f6-ad0708c6784d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2415 time: 0.1036603 Dec 21 03:47:08.529266 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.551700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['309abf42-4548-412c-ad2e-67d338e5fa00'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:08.589873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cf770d29-1c69-4f15-b07a-7cd04c2724a4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:08.594425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Pushing event deleted for resources: {'Port': ['ID=cf770d29-1c69-4f15-b07a-7cd04c2724a4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:08.642831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.738145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:08.746165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bf8c649-990c-4363-8e0e-d5a3093c4126 req-fa7ae431-cd6a-46fd-8212-cbefc37388ea tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 210 time: 0.0733163 Dec 21 03:47:08.746954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] No DVR routers for this DVR port cf770d29-1c69-4f15-b07a-7cd04c2724a4 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:08.750631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:08.753924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19dc8cb3-6aa8-416a-952c-86985059cbe7 req-5e2b47bf-05a7-4da2-adfc-483afda3d8e5 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.54 "DELETE /v2.0/ports/cf770d29-1c69-4f15-b07a-7cd04c2724a4 HTTP/1.1" status: 204 len: 173 time: 0.9406326 Dec 21 03:47:08.755235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-deleted', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:08.757310 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3910b11c-f370-4e07-955c-fa2e85b8ac42" -d '{"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-deleted", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:08.763432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a2f2ff4-235f-4b7a-b526-ef8c847abe4f req-d85c9378-f0d2-428e-b4f7-54b5a1b27358 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2256465 Dec 21 03:47:08.883755 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba145078-3a94-400a-9107-1f49010dab0b x-openstack-request-id: req-ba145078-3a94-400a-9107-1f49010dab0b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:08.884270 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0024898a-7143-4c97-b092-729064ba192d", "name": "network-vif-deleted", "tag": "cf770d29-1c69-4f15-b07a-7cd04c2724a4", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:08.884618 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ba145078-3a94-400a-9107-1f49010dab0b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:08.885354 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0024898a-7143-4c97-b092-729064ba192d', 'name': 'network-vif-deleted', 'tag': 'cf770d29-1c69-4f15-b07a-7cd04c2724a4', 'status': 'completed', 'code': 200} Dec 21 03:47:08.896348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:09.006734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:09.024640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c807596-6014-46c6-8157-66410599bc35 req-6cbee835-4926-46c9-8e68-0f4ab74c536b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:09.026238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c807596-6014-46c6-8157-66410599bc35 req-6cbee835-4926-46c9-8e68-0f4ab74c536b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.1000006 Dec 21 03:47:09.114576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c807596-6014-46c6-8157-66410599bc35 req-739125e7-5b62-493c-a82d-1d9d05634992 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809958 Dec 21 03:47:09.187808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:09.190834 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a454b269-42a4-4fd7-9abb-57b09eeb5877" -d '{"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-plugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:09.263478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36c012f-c3da-4448-b0f2-c86e6c31c865 req-d67f481d-5b2a-49da-b2c2-d8cc2492278c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:09.265360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a36c012f-c3da-4448-b0f2-c86e6c31c865 req-d67f481d-5b2a-49da-b2c2-d8cc2492278c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.0557878 Dec 21 03:47:09.270630 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16242666-beb1-48ee-8eec-4a28340d2b01 x-openstack-request-id: req-16242666-beb1-48ee-8eec-4a28340d2b01 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:09.270630 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-plugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:09.270630 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-16242666-beb1-48ee-8eec-4a28340d2b01 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:09.270630 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'code': 200} Dec 21 03:47:09.323450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a36c012f-c3da-4448-b0f2-c86e6c31c865 req-744fd378-6b52-4ca0-b269-64c550a37b91 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495460 Dec 21 03:47:09.559823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d1514a5-98f5-4f50-809d-0bbef1afc876 req-ccc3f620-2ed8-444a-8b15-c38076c9a4c9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:09.561400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d1514a5-98f5-4f50-809d-0bbef1afc876 req-ccc3f620-2ed8-444a-8b15-c38076c9a4c9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0737069 Dec 21 03:47:09.594301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54e4beae-74f2-4632-b9a3-5c575004e2a8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:09.619780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d1514a5-98f5-4f50-809d-0bbef1afc876 req-a74ac280-ef4e-46dc-bbc1-82dbac5ea175 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478978 Dec 21 03:47:09.783881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:09.906688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc78cb63-6041-46b1-8432-88c81aa4417b req-5afdd59d-7724-4757-a33c-3e00b03a50d8 tempest-ServersAdminTestJSON-1288975209 tempest-ServersAdminTestJSON-1288975209-project] 10.222.0.18 "GET /v2.0/ports?device_id=0024898a-7143-4c97-b092-729064ba192d HTTP/1.1" status: 200 len: 210 time: 0.0347555 Dec 21 03:47:09.910740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest-1984839539-network', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:10.057583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb0e58b-dbcd-4eb3-ae43-8959dec48ef4 req-ad6209d5-84ac-4ed5-8fb0-b70be5338450 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:10.063955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb0e58b-dbcd-4eb3-ae43-8959dec48ef4 req-ad6209d5-84ac-4ed5-8fb0-b70be5338450 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:10.070169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb0e58b-dbcd-4eb3-ae43-8959dec48ef4 req-ad6209d5-84ac-4ed5-8fb0-b70be5338450 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:10.072042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcb0e58b-dbcd-4eb3-ae43-8959dec48ef4 req-ad6209d5-84ac-4ed5-8fb0-b70be5338450 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2415 time: 0.0739839 Dec 21 03:47:10.105661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:10.108051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.117098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.124350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcb0e58b-dbcd-4eb3-ae43-8959dec48ef4 req-db62a0ad-6a30-4499-8129-188bbb563c80 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457222 Dec 21 03:47:10.230086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.350035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.382055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:47:10.388122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7e08fd5-b884-449b-bda4-3e7982fc9b69,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:10.398276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.399159 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Added segment df1c8e1e-6e63-47c0-b048-9d0ec8ca1792 of type vlan for network 04ed2fa2-4e59-410d-9778-4535a349c6b9 Dec 21 03:47:10.423952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 204c72a6-5710-46ff-87ad-a1a7bbd4f24a up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:10.459105 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.570617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383a2043-8483-478a-983b-3153d36daaa3 req-0f9017bd-7945-4628-8e7b-8e56faf3a7ae tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:10.572152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-383a2043-8483-478a-983b-3153d36daaa3 req-0f9017bd-7945-4628-8e7b-8e56faf3a7ae tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.0578587 Dec 21 03:47:10.585449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.586460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:10.596736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.638617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-383a2043-8483-478a-983b-3153d36daaa3 req-037e6363-a696-4d60-b7f8-bf18ebf74cd7 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576155 Dec 21 03:47:10.640970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:10.649372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:10.650094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.680289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] Pushing event updated for resources: {'Network': ['ID=04ed2fa2-4e59-410d-9778-4535a349c6b9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:10.692719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:47:10.697387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-508d8d63-4527-4d74-a4cb-f5f4295e84a0 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.9122651 Dec 21 03:47:10.700493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46610) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:10.709862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Request body: {'subnet': {'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest-1984839539-subnet', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:10.793450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd329841-4e14-4e99-92c1-c79edfc077ba req-ac9dacfc-7e67-454e-abcc-ecbeb98c4226 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:10.795215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd329841-4e14-4e99-92c1-c79edfc077ba req-ac9dacfc-7e67-454e-abcc-ecbeb98c4226 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.0766547 Dec 21 03:47:10.811852 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:10.846025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:10.871810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd329841-4e14-4e99-92c1-c79edfc077ba req-1585288b-243c-4f6a-8795-a7bef4b5c555 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610869 Dec 21 03:47:10.973743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:10.990315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:11.252976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d19bbb-d57d-4abb-8b80-338ebfdf52a3 req-7267d62c-a3b3-42c5-a538-3f65544c6e13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:11.259283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d19bbb-d57d-4abb-8b80-338ebfdf52a3 req-7267d62c-a3b3-42c5-a538-3f65544c6e13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:11.265361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d19bbb-d57d-4abb-8b80-338ebfdf52a3 req-7267d62c-a3b3-42c5-a538-3f65544c6e13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:11.267189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87d19bbb-d57d-4abb-8b80-338ebfdf52a3 req-7267d62c-a3b3-42c5-a538-3f65544c6e13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2415 time: 0.0721004 Dec 21 03:47:11.270082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:11.273408 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d08b11d5-b5af-48f6-b411-f9cab961a737" -d '{"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-plugged", "status": "completed", "tag": "204c72a6-5710-46ff-87ad-a1a7bbd4f24a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:11.334782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87d19bbb-d57d-4abb-8b80-338ebfdf52a3 req-27481866-7a29-4e5a-a3e4-26b3750614cc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604920 Dec 21 03:47:11.379265 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10f3267d-966f-4d11-9ee9-b874cdccc7d8 x-openstack-request-id: req-10f3267d-966f-4d11-9ee9-b874cdccc7d8 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:11.379265 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-plugged", "status": "completed", "tag": "204c72a6-5710-46ff-87ad-a1a7bbd4f24a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:11.379265 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-10f3267d-966f-4d11-9ee9-b874cdccc7d8 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:11.379265 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a', 'code': 200} Dec 21 03:47:11.500052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:11.500286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:11.500962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 309abf42-4548-412c-ad2e-67d338e5fa00 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:11.557332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c714b82d-d957-4fc4-96b0-f175d6a234f5,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:11.567013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Checking segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:11.572859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Network hostable DHCP agents. Network: 04ed2fa2-4e59-410d-9778-4535a349c6b9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:47:11.591755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:11.659559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:47:11.693670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 309abf42-4548-412c-ad2e-67d338e5fa00 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:11.698510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 309abf42-4548-412c-ad2e-67d338e5fa00 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:11.699254 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:11.781284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29deb61d-2637-4c99-a37c-af2a6aa54ce5 req-dd284651-26e9-49a3-afea-e6e9d94b0a1a tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:11.787705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29deb61d-2637-4c99-a37c-af2a6aa54ce5 req-dd284651-26e9-49a3-afea-e6e9d94b0a1a tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.0680208 Dec 21 03:47:11.807018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 04ed2fa2-4e59-410d-9778-4535a349c6b9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:11.813493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:11.814718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:11.821520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d1b3e3d-2150-41d8-b7e8-8350bb615278 None None] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:11.846416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46630) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:11.892662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29deb61d-2637-4c99-a37c-af2a6aa54ce5 req-4a4f4be5-01cd-411b-a30d-232d07a3172a tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925610 Dec 21 03:47:11.893019 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:11.931889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ef345c8e-a5d2-46db-a2f5-bcdc39ac34c7 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2251124 Dec 21 03:47:11.931889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46634) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:11.935414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:11.963947 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 309abf42-4548-412c-ad2e-67d338e5fa00, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=309abf42-4548-412c-ad2e-67d338e5fa00,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:12.036144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-04ed2fa2-4e59-410d-9778-4535a349c6b9', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:47:12.036144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.037523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.057910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.061772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.100870 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a18d2a31-6d2d-4b60-86c5-45ca46b74f1e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4712c556d73e4ad2b805061c976ddd2e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2522895 Dec 21 03:47:12.103685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46638) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:12.143832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.161662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdedf9c3-0732-4bc9-87df-a9b4d6dfa44c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.166342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5bfe449-82d1-4141-970a-3b5c5174a5e6 req-90c31dc1-1d6a-44e8-8377-07aabb7bad87 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.168086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5bfe449-82d1-4141-970a-3b5c5174a5e6 req-90c31dc1-1d6a-44e8-8377-07aabb7bad87 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1548376 Dec 21 03:47:12.177394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=309abf42-4548-412c-ad2e-67d338e5fa00,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:12.185435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdedf9c3-0732-4bc9-87df-a9b4d6dfa44c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.274774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Allocated IP 172.20.0.2 (04ed2fa2-4e59-410d-9778-4535a349c6b9/c714b82d-d957-4fc4-96b0-f175d6a234f5/096bbe5b-b9c8-4d19-aa19-4fe410665822) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:12.303953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdedf9c3-0732-4bc9-87df-a9b4d6dfa44c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.303953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdedf9c3-0732-4bc9-87df-a9b4d6dfa44c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.309491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fdedf9c3-0732-4bc9-87df-a9b4d6dfa44c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ecf57b12-b3df-4362-97bd-0b49563f1502 HTTP/1.1" status: 204 len: 168 time: 0.2045774 Dec 21 03:47:12.321520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdedf9c3-0732-4bc9-87df-a9b4d6dfa44c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecf57b12-b3df-4362-97bd-0b49563f1502,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:12.336555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5bfe449-82d1-4141-970a-3b5c5174a5e6 req-91797430-8f86-460b-a97b-dc878c932f4d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1624415 Dec 21 03:47:12.429108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-d58c8a97-0ad4-4711-a340-a0034c4e97c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.429917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-d58c8a97-0ad4-4711-a340-a0034c4e97c5 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030&tenant_id=408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 1102 time: 0.2338736 Dec 21 03:47:12.436373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.448484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:12.455468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:12.455468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 54e4beae-74f2-4632-b9a3-5c575004e2a8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:12.486502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: cf770d29-1c69-4f15-b07a-7cd04c2724a4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:12.487963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cf770d29-1c69-4f15-b07a-7cd04c2724a4 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:12.573931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-790e1cd3-c201-404a-b02a-7df3b8f8ce1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.575698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-790e1cd3-c201-404a-b02a-7df3b8f8ce1b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1102 time: 0.0881412 Dec 21 03:47:12.586855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc06789-83ad-4bee-bc18-b59279f8cd8a req-bd71ed65-a4cc-406d-b0a7-610325938dd5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.594584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc06789-83ad-4bee-bc18-b59279f8cd8a req-bd71ed65-a4cc-406d-b0a7-610325938dd5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.603013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc06789-83ad-4bee-bc18-b59279f8cd8a req-bd71ed65-a4cc-406d-b0a7-610325938dd5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.609173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dc06789-83ad-4bee-bc18-b59279f8cd8a req-bd71ed65-a4cc-406d-b0a7-610325938dd5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2417 time: 0.1554382 Dec 21 03:47:12.710077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.734812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:12.752093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'port_id': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'mac_address': 'fa:16:3e:6f:53:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec8e3a7f-1bef-41ac-8b72-508d262fe30c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:12.758539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 54e4beae-74f2-4632-b9a3-5c575004e2a8 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:12.778226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dc06789-83ad-4bee-bc18-b59279f8cd8a req-629d28b6-887c-4156-9b09-10626611ba4d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1546133 Dec 21 03:47:12.785909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 54e4beae-74f2-4632-b9a3-5c575004e2a8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:12.786281 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:12.802955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-16e56f57-e313-4a18-9192-820bcfb18468 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:12.804753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-16e56f57-e313-4a18-9192-820bcfb18468 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1924672 Dec 21 03:47:12.862278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-4641406e-c3e4-49f0-9314-56a3c9573cfc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.114&port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 217 time: 0.0495009 Dec 21 03:47:12.967744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.011898 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.025917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-5e92540a-9df4-441b-a40a-b45958bc4d90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.027407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-5e92540a-9df4-441b-a40a-b45958bc4d90 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1573331 Dec 21 03:47:13.044683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:13.050489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id f8716759-f9e1-41d6-94ee-713ee38eca01 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:13.053352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:13.055923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:13.062553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Pushing event updated for resources: {'Port': ['ID=096bbe5b-b9c8-4d19-aa19-4fe410665822,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:13.074795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.102054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:13.102576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:13.110624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e97fe31-a7f0-414e-bb5a-68eb2c5cb20e req-957fe767-c168-4e48-81b9-97f93d32eeca tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.110624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e97fe31-a7f0-414e-bb5a-68eb2c5cb20e req-957fe767-c168-4e48-81b9-97f93d32eeca tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.1450062 Dec 21 03:47:13.114065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.143532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4283e-af67-4933-bc36-916054635f6c req-8e294343-c290-4b6c-bfe0-407f2d068fc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.145025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-8e294343-c290-4b6c-bfe0-407f2d068fc6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1095054 Dec 21 03:47:13.175619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Attempting to bind port 096bbe5b-b9c8-4d19-aa19-4fe410665822 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:13.175991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Attempting to bind port 096bbe5b-b9c8-4d19-aa19-4fe410665822 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:13.176366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Attempting to bind port 096bbe5b-b9c8-4d19-aa19-4fe410665822 on network 04ed2fa2-4e59-410d-9778-4535a349c6b9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:13.180788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.191347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:13.191760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Checking segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:13.192635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.192635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Bound using segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:13.192990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Bound port: 096bbe5b-b9c8-4d19-aa19-4fe410665822, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:13.193369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.203262 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-56ccb129-5ec4-41f1-897e-95a305286a38 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=56df2f39545c463faebcb31197eef171&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0968661 Dec 21 03:47:13.205685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46656) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:13.215623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.262054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-684e23e1-7aef-4ccd-83b5-2aac8dead5e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.277554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:13.286752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e97fe31-a7f0-414e-bb5a-68eb2c5cb20e req-9d0bbd65-ccce-4921-8b6d-ffe13e284392 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1680677 Dec 21 03:47:13.312324 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-684e23e1-7aef-4ccd-83b5-2aac8dead5e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.320010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:13.333074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] For port 096bbe5b-b9c8-4d19-aa19-4fe410665822, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:13.336820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] For port 096bbe5b-b9c8-4d19-aa19-4fe410665822, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=096bbe5b-b9c8-4d19-aa19-4fe410665822,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:13.359307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Allocated IP 172.25.5.208 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/ed63a46c-413e-4dc5-a3f2-93a3a6e4330d) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:13.367525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-48afd589-3ff3-41a9-be22-2d34ce12e7a9 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1889031 Dec 21 03:47:13.368062 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.380271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '309abf42-4548-412c-ad2e-67d338e5fa00'}, {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:13.382870 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb89808c-c67e-45f7-9539-8d5fbee83f63" -d '{"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-plugged", "status": "completed", "tag": "309abf42-4548-412c-ad2e-67d338e5fa00"}, {"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-plugged", "status": "completed", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:13.451182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:13.463528 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f1aa5f9-ba85-4a2a-a9b4-0fafea372ee0 x-openstack-request-id: req-7f1aa5f9-ba85-4a2a-a9b4-0fafea372ee0 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:13.464587 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-plugged", "status": "completed", "tag": "309abf42-4548-412c-ad2e-67d338e5fa00", "code": 200}, {"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-plugged", "status": "completed", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:13.469505 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7f1aa5f9-ba85-4a2a-a9b4-0fafea372ee0 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:13.469505 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '309abf42-4548-412c-ad2e-67d338e5fa00', 'code': 200} Dec 21 03:47:13.469505 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8', 'code': 200} Dec 21 03:47:13.469505 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.488953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-684e23e1-7aef-4ccd-83b5-2aac8dead5e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.492795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-684e23e1-7aef-4ccd-83b5-2aac8dead5e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.495880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-684e23e1-7aef-4ccd-83b5-2aac8dead5e9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/16bdfce7-993d-4bda-ae76-8ed15b1c0604 HTTP/1.1" status: 204 len: 168 time: 0.2867689 Dec 21 03:47:13.521952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684e23e1-7aef-4ccd-83b5-2aac8dead5e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16bdfce7-993d-4bda-ae76-8ed15b1c0604,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:13.543933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['f8716759-f9e1-41d6-94ee-713ee38eca01'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:13.550022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59cb425c-fd23-421d-8b1b-8a826c273d0c None None] Pushing event updated for resources: {'Port': ['ID=096bbe5b-b9c8-4d19-aa19-4fe410665822,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:13.680097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41b36e9-85d3-475d-be4d-1de81bc44026 req-7e3d8185-f3df-4bbe-9ee3-013bd9446591 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.681684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e41b36e9-85d3-475d-be4d-1de81bc44026 req-7e3d8185-f3df-4bbe-9ee3-013bd9446591 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.2410009 Dec 21 03:47:13.714285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97a4283e-af67-4933-bc36-916054635f6c req-fe2a9fa4-f790-4c47-a973-92568b171cf8 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3196464 Dec 21 03:47:13.721975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:13.744196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3e5999-9326-4195-a83f-0827a38f78e2 req-81f22135-5553-4b45-9188-67c6a765502b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.745000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3e5999-9326-4195-a83f-0827a38f78e2 req-81f22135-5553-4b45-9188-67c6a765502b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.745898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3e5999-9326-4195-a83f-0827a38f78e2 req-81f22135-5553-4b45-9188-67c6a765502b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:13.747762 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e3e5999-9326-4195-a83f-0827a38f78e2 req-81f22135-5553-4b45-9188-67c6a765502b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2874 time: 0.0943933 Dec 21 03:47:13.812575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e41b36e9-85d3-475d-be4d-1de81bc44026 req-151a0c2e-19b5-48ba-b260-7b7fc132ef60 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137822 Dec 21 03:47:13.817785 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e3e5999-9326-4195-a83f-0827a38f78e2 req-0416dfa0-78f1-4275-b8cc-3d9b869fe377 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590568 Dec 21 03:47:13.933689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:14.021632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:14.032608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:14.039118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:14.039118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Pushing event updated for resources: {'Port': ['ID=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:14.052373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff43ed4-bd10-40f4-a259-8a7c584f3858 req-1bd31d7d-7f86-46b7-bc44-3ff6356adcce tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:14.055487 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ff43ed4-bd10-40f4-a259-8a7c584f3858 req-1bd31d7d-7f86-46b7-bc44-3ff6356adcce tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.1553717 Dec 21 03:47:14.087376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725b2d00-cc11-4d81-b94d-0d4a8754f7db req-fce7f62e-f847-4f24-89ec-ce721fbe14f4 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:14.093579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725b2d00-cc11-4d81-b94d-0d4a8754f7db req-fce7f62e-f847-4f24-89ec-ce721fbe14f4 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:14.099574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725b2d00-cc11-4d81-b94d-0d4a8754f7db req-fce7f62e-f847-4f24-89ec-ce721fbe14f4 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:14.101161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-725b2d00-cc11-4d81-b94d-0d4a8754f7db req-fce7f62e-f847-4f24-89ec-ce721fbe14f4 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2418 time: 0.1717920 Dec 21 03:47:14.349712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-725b2d00-cc11-4d81-b94d-0d4a8754f7db req-c149e56a-d3b3-4765-bd82-6bf779ddc134 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2355192 Dec 21 03:47:14.359196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ff43ed4-bd10-40f4-a259-8a7c584f3858 req-901182b0-d385-47e9-b687-77a865c70d37 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2815874 Dec 21 03:47:14.398229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:14.442361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:14.650788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port f8716759-f9e1-41d6-94ee-713ee38eca01 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:14.651319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:14.653300 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:14.742053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:14.822629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:14.860690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:14.999514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:15.001044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:15.009576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 096bbe5b-b9c8-4d19-aa19-4fe410665822 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:15.041583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e47c74f1-ab43-46eb-a0fc-377c4033a72b req-528d8274-e709-426f-b62d-cedcc489a1e3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:15.043142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e47c74f1-ab43-46eb-a0fc-377c4033a72b req-528d8274-e709-426f-b62d-cedcc489a1e3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 945 time: 0.5471292 Dec 21 03:47:15.082346 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.084591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-030adc80-7e02-4145-a20e-525283385def None None] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:15.214037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.225884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92cae4cc-efbb-4713-a465-f2de10e66b70 req-d76b5733-f345-4716-8965-713a96f41607 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:15.227291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 096bbe5b-b9c8-4d19-aa19-4fe410665822 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:15.227670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.231540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92cae4cc-efbb-4713-a465-f2de10e66b70 req-d76b5733-f345-4716-8965-713a96f41607 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.1415837 Dec 21 03:47:15.235088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a138fddd-2d65-4eab-afad-67faee15d4bb None None] Provisioning complete for port 096bbe5b-b9c8-4d19-aa19-4fe410665822 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:15.235460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a138fddd-2d65-4eab-afad-67faee15d4bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.271394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e47c74f1-ab43-46eb-a0fc-377c4033a72b req-1eea3d3f-7838-42a8-b53d-193cec96a1ca tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1895220 Dec 21 03:47:15.288020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:15.404345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92cae4cc-efbb-4713-a465-f2de10e66b70 req-5d17b8e1-8f2b-491a-b749-359907b370e5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246634 Dec 21 03:47:15.435643 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a138fddd-2d65-4eab-afad-67faee15d4bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.481615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}, {'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:15.488435 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b228ce6-8f33-4cd3-99e4-8a098ed8932a" -d '{"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-unplugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}, {"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-plugged", "status": "completed", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:15.518443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.568278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a138fddd-2d65-4eab-afad-67faee15d4bb None None] For port 096bbe5b-b9c8-4d19-aa19-4fe410665822, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=096bbe5b-b9c8-4d19-aa19-4fe410665822,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:15.722518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a138fddd-2d65-4eab-afad-67faee15d4bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.756268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.830740 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:47:15.832139 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:47:15.832871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a138fddd-2d65-4eab-afad-67faee15d4bb None None] Pushing event updated for resources: {'Port': ['ID=096bbe5b-b9c8-4d19-aa19-4fe410665822,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:15.864996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6befc5b9-35bb-42e9-b650-1c58ecdd1f52 None None] Provisioning complete for port 096bbe5b-b9c8-4d19-aa19-4fe410665822 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:15.865374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6befc5b9-35bb-42e9-b650-1c58ecdd1f52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:15.995973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609efcbe-7a52-4223-b261-1b0ee5886ce8 req-9b440b88-3f83-4265-ad18-548c4d0f017e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:16.002122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609efcbe-7a52-4223-b261-1b0ee5886ce8 req-9b440b88-3f83-4265-ad18-548c4d0f017e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:16.008240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609efcbe-7a52-4223-b261-1b0ee5886ce8 req-9b440b88-3f83-4265-ad18-548c4d0f017e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:16.009892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-609efcbe-7a52-4223-b261-1b0ee5886ce8 req-9b440b88-3f83-4265-ad18-548c4d0f017e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2418 time: 0.0820031 Dec 21 03:47:16.067772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-609efcbe-7a52-4223-b261-1b0ee5886ce8 req-66e71350-61d9-4c1e-a273-8576b945624a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505822 Dec 21 03:47:16.070801 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-51d0ec24-7f9a-4e33-a2d2-4a91b3bf9f5e x-openstack-request-id: req-51d0ec24-7f9a-4e33-a2d2-4a91b3bf9f5e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:16.071149 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-unplugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "code": 200}, {"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-plugged", "status": "completed", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:16.071435 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-51d0ec24-7f9a-4e33-a2d2-4a91b3bf9f5e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:16.071876 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'code': 200} Dec 21 03:47:16.072142 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'code': 200} Dec 21 03:47:16.168912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Router 2376a5de-876f-4295-bee4-f95526e6331c is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:47:16.190017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a3917d-7770-40d5-9f93-6e100fef5453 req-d7c87f6c-d52d-4843-baea-cd877e86eeba tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:16.191569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6a3917d-7770-40d5-9f93-6e100fef5453 req-d7c87f6c-d52d-4843-baea-cd877e86eeba tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.0612473 Dec 21 03:47:16.333848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6a3917d-7770-40d5-9f93-6e100fef5453 req-eb33b4a4-a0e4-4d71-8933-c5b21959826b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1362691 Dec 21 03:47:16.359917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:16.372697 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Sync routers for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:16.387126 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:16.387738 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:16.400265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:16.475449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:16.476912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-deebb697-2448-4411-8fbf-69b45545466e admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 4.5463786 Dec 21 03:47:16.479720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:16.558571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:16.573911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'mac_address': 'fa:16:3e:aa:2e:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.114'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:16.636384 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:16.677726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac00112-8a54-4e91-a5c9-f0afa96d3340 req-5b254289-d25c-4e76-9216-53b86be04207 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:16.680387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 52f73cf2-b045-4f07-b974-6c29f7b35de0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:16.687947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cac00112-8a54-4e91-a5c9-f0afa96d3340 req-5b254289-d25c-4e76-9216-53b86be04207 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 948 time: 0.1752083 Dec 21 03:47:16.723706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf82788-d533-46dd-85ef-069c22338bb3 req-0bdadab4-4309-41b4-8e7b-b92b41d5e1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:16.731641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bf82788-d533-46dd-85ef-069c22338bb3 req-0bdadab4-4309-41b4-8e7b-b92b41d5e1b2 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.2528052 Dec 21 03:47:16.741088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:16.752377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:16.813625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cac00112-8a54-4e91-a5c9-f0afa96d3340 req-9bdefc15-cf71-4f5a-b92e-f2d988bfb369 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1231349 Dec 21 03:47:16.814977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:16.861784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bf82788-d533-46dd-85ef-069c22338bb3 req-338bf0d0-8762-4bed-b674-448e6185583c tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1291480 Dec 21 03:47:16.973894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:16.981931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 096bbe5b-b9c8-4d19-aa19-4fe410665822 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:17.049613 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:14Z', 'revision_number': 3, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:17.060171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 096bbe5b-b9c8-4d19-aa19-4fe410665822 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:17.060171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.120047 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Checking router: 2376a5de-876f-4295-bee4-f95526e6331c for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:17.120047 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Updating router 2376a5de-876f-4295-bee4-f95526e6331c port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:47:17.123413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c33a3876-54e2-473a-aac5-3acc47fc7a7e req-5801e391-9549-4bcd-a561-a171d1bf3162 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:17.132692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c33a3876-54e2-473a-aac5-3acc47fc7a7e req-5801e391-9549-4bcd-a561-a171d1bf3162 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 950 time: 0.1189795 Dec 21 03:47:17.154150 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.174296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['52f73cf2-b045-4f07-b974-6c29f7b35de0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:17.232100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c33a3876-54e2-473a-aac5-3acc47fc7a7e req-28ff27e9-7a01-4f70-a32b-5e56d1776771 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979941 Dec 21 03:47:17.345728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.530912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5711f3d8-38b7-4213-a338-ed1a777e2499 req-9aae2638-dc67-49a9-ba11-eb8594eddf21 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:17.546727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5711f3d8-38b7-4213-a338-ed1a777e2499 req-9aae2638-dc67-49a9-ba11-eb8594eddf21 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:17.556563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5711f3d8-38b7-4213-a338-ed1a777e2499 req-9aae2638-dc67-49a9-ba11-eb8594eddf21 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:17.558270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5711f3d8-38b7-4213-a338-ed1a777e2499 req-9aae2638-dc67-49a9-ba11-eb8594eddf21 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2418 time: 0.1105466 Dec 21 03:47:17.562023 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.621709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Allocated IP 172.20.0.1 (04ed2fa2-4e59-410d-9778-4535a349c6b9/c714b82d-d957-4fc4-96b0-f175d6a234f5/97ca28df-516e-42ca-a7be-46ce5c12dab9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:17.631108 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.669661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5711f3d8-38b7-4213-a338-ed1a777e2499 req-d28a0c8a-618d-4b49-a8f9-dd5a29fed11d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037807 Dec 21 03:47:17.683226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a926f9f2-4de2-4043-a7e5-1344a095e718 req-e59c1371-4b68-4e92-ae69-0441fc0d85ac tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:17.683512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a926f9f2-4de2-4043-a7e5-1344a095e718 req-e59c1371-4b68-4e92-ae69-0441fc0d85ac tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.1024067 Dec 21 03:47:17.722801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Attempting to bind port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:17.722801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Attempting to bind port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:17.723203 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Attempting to bind port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:17.733376 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:17.733753 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:17.734155 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.734554 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:17.737370 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Bound port: ed63a46c-413e-4dc5-a3f2-93a3a6e4330d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:17.738222 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.768862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a926f9f2-4de2-4043-a7e5-1344a095e718 req-b4617c6d-a121-4643-9c81-fe6ad4b1c8b8 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762441 Dec 21 03:47:17.802398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.817590 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Pushing event updated for resources: {'Port': ['ID=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:17.849378 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.849736 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.850080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.850415 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.850747 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.855789 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.856181 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.856526 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.856871 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.857208 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.857533 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.859991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.859991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:17.884449 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] For port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:17.894266 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] For port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:17.907936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-5c109220-ef07-4ab1-a0b6-3a299a6dae94 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0247974 Dec 21 03:47:17.948038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c84bdec-587d-49c4-82be-cd5611253159 req-a4b13fb0-c897-4468-9ab4-490b1cc045a9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:17.949956 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7c84bdec-587d-49c4-82be-cd5611253159 req-a4b13fb0-c897-4468-9ab4-490b1cc045a9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.0616441 Dec 21 03:47:17.985659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:17.994413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47e4a8a2-aa7d-4ce5-a8b0-b9abd59c05cd req-c5a9f9a3-e311-4146-a425-4dd3b461cda5 tempest-FlavorsV2NegativeTest-1513673080 tempest-FlavorsV2NegativeTest-1513673080-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=b60c4fd0f7be46dcaf34c82fc72b2c88&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0562961 Dec 21 03:47:17.999357 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.008075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:18.011062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:18.014119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:18.108918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-19eb0c67-8f89-4770-b562-30238d8166fa tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.116732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-19eb0c67-8f89-4770-b562-30238d8166fa tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2025437 Dec 21 03:47:18.131209 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94c91024-d770-4b83-b0ac-f837059f1f1c None None] Pushing event updated for resources: {'Port': ['ID=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:18.148906 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:18.149844 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:18.158186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-a8ce10bd-d2cd-4b6b-9de3-f2f5dc44618e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/quotas/408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 375 time: 0.0402420 Dec 21 03:47:18.187531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Pushing event updated for resources: {'Port': ['ID=97ca28df-516e-42ca-a7be-46ce5c12dab9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:18.225716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e4a8a2-aa7d-4ce5-a8b0-b9abd59c05cd req-d82ced8f-4e6f-4690-bcd6-3b203a6bdd33 tempest-FlavorsV2NegativeTest-1513673080 tempest-FlavorsV2NegativeTest-1513673080-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.226711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.233182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47e4a8a2-aa7d-4ce5-a8b0-b9abd59c05cd req-d82ced8f-4e6f-4690-bcd6-3b203a6bdd33 tempest-FlavorsV2NegativeTest-1513673080 tempest-FlavorsV2NegativeTest-1513673080-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2139583 Dec 21 03:47:18.265992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-aed29012-d610-4920-986e-9bcdafd349ca tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1068330 Dec 21 03:47:18.276092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47e4a8a2-aa7d-4ce5-a8b0-b9abd59c05cd req-8c4fd0eb-b6a0-44ac-851d-b7acc0dad8bf tempest-FlavorsV2NegativeTest-1513673080 tempest-FlavorsV2NegativeTest-1513673080-project] 10.222.0.18 "GET /v2.0/quotas/b60c4fd0f7be46dcaf34c82fc72b2c88 HTTP/1.1" status: 200 len: 375 time: 0.0419688 Dec 21 03:47:18.294399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-fcc7a255-907d-4e73-8b02-4f34cd06b397 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.296300 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-fcc7a255-907d-4e73-8b02-4f34cd06b397 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.31 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.2465403 Dec 21 03:47:18.348284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47e4a8a2-aa7d-4ce5-a8b0-b9abd59c05cd req-526c0e22-03aa-41ca-9118-6fdd0df57dc4 tempest-FlavorsV2NegativeTest-1513673080 tempest-FlavorsV2NegativeTest-1513673080-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=b60c4fd0f7be46dcaf34c82fc72b2c88&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0712268 Dec 21 03:47:18.348964 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:18.438018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:18.450323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:18.481151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c001aac-af92-4492-b46f-3a9912eecd4f req-7b52c4da-9a09-4b62-8ba5-58ef313f89d9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.490052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c001aac-af92-4492-b46f-3a9912eecd4f req-7b52c4da-9a09-4b62-8ba5-58ef313f89d9 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.0845754 Dec 21 03:47:18.513682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Deleting port f8716759-f9e1-41d6-94ee-713ee38eca01 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:18.514690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.561904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c001aac-af92-4492-b46f-3a9912eecd4f req-24147af3-786f-414e-9002-eb5f6db88819 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708065 Dec 21 03:47:18.590812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1123232a-b384-4a78-b260-ecd919d733f6 None None] Provisioning complete for port 97ca28df-516e-42ca-a7be-46ce5c12dab9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:18.597337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1123232a-b384-4a78-b260-ecd919d733f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.679105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 52f73cf2-b045-4f07-b974-6c29f7b35de0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:18.680383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.682369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1123232a-b384-4a78-b260-ecd919d733f6 None None] Port 97ca28df-516e-42ca-a7be-46ce5c12dab9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:18.772945 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.823981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1542a821-008f-41e3-8e1a-9eae38c90309 req-5d3f2003-fabd-4b08-992f-3e3e74b1555c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 210 time: 0.1089883 Dec 21 03:47:18.836522 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:14Z', 'revision_number': 3, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:18.840479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Deleting port 191b83a9-628d-4985-aca6-eb18b8810e59 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:18.840955 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.894630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.900162 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf6fe406-eb19-463d-8662-5214ddae3195 None None] The sync data for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 is: [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:14Z', 'revision_number': 3, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:18.900779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:18.910793 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46cbd5de-4f2d-4f03-b923-e6025f705cda" -d '{"events": [{"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-unplugged", "status": "completed", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:18.946672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:18.947090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:18.953410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531f6f97-a100-4e1e-b6a8-e1f6695e735f req-f2e0afe1-72e0-4c85-9bac-d1f7a67109d6 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.965621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531f6f97-a100-4e1e-b6a8-e1f6695e735f req-f2e0afe1-72e0-4c85-9bac-d1f7a67109d6 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.974676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531f6f97-a100-4e1e-b6a8-e1f6695e735f req-f2e0afe1-72e0-4c85-9bac-d1f7a67109d6 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:18.984438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-531f6f97-a100-4e1e-b6a8-e1f6695e735f req-f2e0afe1-72e0-4c85-9bac-d1f7a67109d6 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2418 time: 0.1516597 Dec 21 03:47:18.996354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.041201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f8716759-f9e1-41d6-94ee-713ee38eca01, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f8716759-f9e1-41d6-94ee-713ee38eca01,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:19.042921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Calling delete_port for f8716759-f9e1-41d6-94ee-713ee38eca01 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:19.086105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:19.100365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.128147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32897d15-bb72-4992-a162-357e3f2f2277 req-da13bdfd-7c9d-459f-b1e9-ce733a1c4a1d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:19.130031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32897d15-bb72-4992-a162-357e3f2f2277 req-da13bdfd-7c9d-459f-b1e9-ce733a1c4a1d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 946 time: 0.1143425 Dec 21 03:47:19.141073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-531f6f97-a100-4e1e-b6a8-e1f6695e735f req-9cb490bb-562b-4ab9-b0ce-89a58cb07740 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1541026 Dec 21 03:47:19.201550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] For port 191b83a9-628d-4985-aca6-eb18b8810e59, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=191b83a9-628d-4985-aca6-eb18b8810e59,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:19.201918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.222339 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35c78c2b-fc7b-4ab7-a523-4c335b5ea56d x-openstack-request-id: req-35c78c2b-fc7b-4ab7-a523-4c335b5ea56d {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:19.222339 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-unplugged", "status": "completed", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:19.222896 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-35c78c2b-fc7b-4ab7-a523-4c335b5ea56d {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:19.223482 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'code': 200} Dec 21 03:47:19.227393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.256336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:19.315861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32897d15-bb72-4992-a162-357e3f2f2277 req-c5286231-1275-4ac5-9b6d-e1b5f6f13a0c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1511703 Dec 21 03:47:19.398900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:19.460496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584573a7-605f-4b17-bd29-a240f590966b req-810bdeb5-a1c7-41d5-890f-29667a22aae5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:19.480324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584573a7-605f-4b17-bd29-a240f590966b req-810bdeb5-a1c7-41d5-890f-29667a22aae5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:19.489494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584573a7-605f-4b17-bd29-a240f590966b req-810bdeb5-a1c7-41d5-890f-29667a22aae5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:19.491262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-584573a7-605f-4b17-bd29-a240f590966b req-810bdeb5-a1c7-41d5-890f-29667a22aae5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2418 time: 0.1602023 Dec 21 03:47:19.659992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 309abf42-4548-412c-ad2e-67d338e5fa00 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:19.665024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.670294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.712989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.713390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.714893 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def disassociated. External IP: 172.25.5.85, port: 191b83a9-628d-4985-aca6-eb18b8810e59. Dec 21 03:47:19.715395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Calling delete_port for 191b83a9-628d-4985-aca6-eb18b8810e59 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:19.810778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.812753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.836613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 309abf42-4548-412c-ad2e-67d338e5fa00, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=309abf42-4548-412c-ad2e-67d338e5fa00,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:19.837236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.852026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-79bb0d1a-f5e3-4343-b66b-0f4539530d3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.857213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12213ebf-531d-4009-a406-7e1aed3c5ce3 req-ff7b0f63-590d-40e7-9f2a-26262d2d3e87 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:19.875460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12213ebf-531d-4009-a406-7e1aed3c5ce3 req-ff7b0f63-590d-40e7-9f2a-26262d2d3e87 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 945 time: 0.1548803 Dec 21 03:47:19.904487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Pushing event updated for resources: {'Port': ['ID=97ca28df-516e-42ca-a7be-46ce5c12dab9,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:19.913004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:19.920992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 309abf42-4548-412c-ad2e-67d338e5fa00 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:20.026519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event deleted for resources: {'Port': ['ID=f8716759-f9e1-41d6-94ee-713ee38eca01,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:20.081654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46844) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:20.087599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] No DVR routers for this DVR port f8716759-f9e1-41d6-94ee-713ee38eca01 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:20.096377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:20.100307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7c84bdec-587d-49c4-82be-cd5611253159 req-1518d8b3-8bd1-4f7d-a167-22581b16c1cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "DELETE /v2.0/ports/f8716759-f9e1-41d6-94ee-713ee38eca01 HTTP/1.1" status: 204 len: 173 time: 2.0518289 Dec 21 03:47:20.100770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-deleted', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:20.104669 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ebf00f9-b593-4598-8fcf-3c5da4f24d8a" -d '{"events": [{"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-deleted", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:20.131801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12213ebf-531d-4009-a406-7e1aed3c5ce3 req-b53f223c-8338-4ae9-8d4e-1ebc7899ce02 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups?id=fa8f8344-ed72-403c-a269-225bbf5487c9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2574909 Dec 21 03:47:20.235977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6e81897-5f6c-46c6-90df-04c52da658d8 req-d29b2445-1c87-403c-a79d-dbd4b4eea327 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 210 time: 0.1502557 Dec 21 03:47:20.345902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b120bd50-d1de-4d76-9f2f-bd77b6b10e2a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:20.442102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:20.483293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['204c72a6-5710-46ff-87ad-a1a7bbd4f24a', '309abf42-4548-412c-ad2e-67d338e5fa00', '54e4beae-74f2-4632-b9a3-5c575004e2a8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:20.525215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b214f33-30fa-4443-88cc-aad7399205f5 req-ab4de24c-ee6d-4dd9-a1a2-c75e29823f4e tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 210 time: 0.0960765 Dec 21 03:47:20.584816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=309abf42-4548-412c-ad2e-67d338e5fa00,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:20.604571 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee3ed5db-1336-448e-97a7-330326fae313 x-openstack-request-id: req-ee3ed5db-1336-448e-97a7-330326fae313 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:20.605541 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf434f60-071b-45f8-a92b-95ae507578b7", "name": "network-vif-deleted", "tag": "f8716759-f9e1-41d6-94ee-713ee38eca01", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:20.606003 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ee3ed5db-1336-448e-97a7-330326fae313 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:20.606662 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf434f60-071b-45f8-a92b-95ae507578b7', 'name': 'network-vif-deleted', 'tag': 'f8716759-f9e1-41d6-94ee-713ee38eca01', 'status': 'completed', 'code': 200} Dec 21 03:47:20.658478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd9f95d-1d45-4f83-b796-8c91ef9e580a req-dedc5fdf-7bbf-4457-8d6a-7207b250e0eb tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:20.671220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd9f95d-1d45-4f83-b796-8c91ef9e580a req-dedc5fdf-7bbf-4457-8d6a-7207b250e0eb tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:20.678636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:20.680562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd9f95d-1d45-4f83-b796-8c91ef9e580a req-dedc5fdf-7bbf-4457-8d6a-7207b250e0eb tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:20.683115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:20.701744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd9f95d-1d45-4f83-b796-8c91ef9e580a req-dedc5fdf-7bbf-4457-8d6a-7207b250e0eb tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 2340 time: 0.3450866 Dec 21 03:47:20.732362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 309abf42-4548-412c-ad2e-67d338e5fa00 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:20.747880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:20.760027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-584573a7-605f-4b17-bd29-a240f590966b req-25619217-92fe-4c93-b6d1-8907c3bbaa51 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "DELETE /v2.0/ports/309abf42-4548-412c-ad2e-67d338e5fa00 HTTP/1.1" status: 204 len: 173 time: 1.2585390 Dec 21 03:47:20.784763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-deleted', 'tag': '309abf42-4548-412c-ad2e-67d338e5fa00'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:20.787112 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f258312-3ca9-47e8-b27f-7c644fb7159c" -d '{"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-deleted", "tag": "309abf42-4548-412c-ad2e-67d338e5fa00"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:20.921239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd9f95d-1d45-4f83-b796-8c91ef9e580a req-c6464cca-1b13-413a-b178-79b95f7c7239 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2180357 Dec 21 03:47:20.953112 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61927bb0-1c30-49e8-96ed-c20e4b3b1489 x-openstack-request-id: req-61927bb0-1c30-49e8-96ed-c20e4b3b1489 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:20.953112 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-deleted", "tag": "309abf42-4548-412c-ad2e-67d338e5fa00", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:20.953112 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-61927bb0-1c30-49e8-96ed-c20e4b3b1489 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:20.953112 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-deleted', 'tag': '309abf42-4548-412c-ad2e-67d338e5fa00', 'status': 'completed', 'code': 200} Dec 21 03:47:21.034700 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b120bd50-d1de-4d76-9f2f-bd77b6b10e2a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.050883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:21.051809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.074576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Router 2376a5de-876f-4295-bee4-f95526e6331c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:47:21.082650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed63a46c-413e-4dc5-a3f2-93a3a6e4330d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:21.107221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.146266 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b120bd50-d1de-4d76-9f2f-bd77b6b10e2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.198901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event deleted for resources: {'Port': ['ID=191b83a9-628d-4985-aca6-eb18b8810e59,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:21.205309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b120bd50-d1de-4d76-9f2f-bd77b6b10e2a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b60c4fd0f7be46dcaf34c82fc72b2c88&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1183596 Dec 21 03:47:21.206757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46862) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:21.221887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:21.225886 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.276597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:21.280789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b120bd50-d1de-4d76-9f2f-bd77b6b10e2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=faa1136c-c216-4ccd-bb13-e217730e210e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:21.287959 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-616d7d37-79f0-48d1-a6a7-f225b275ade5" -d '{"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-plugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:21.322697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a74fe900-1f76-4761-8b65-40df94d89cb5 req-f8f767bb-1eaa-47f9-8899-99038a7dc2d7 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 210 time: 0.0614548 Dec 21 03:47:21.355567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:21.359376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bbe55b4e-abb1-48b6-9a45-28cf942e6c57 None None] Provisioning complete for port 97ca28df-516e-42ca-a7be-46ce5c12dab9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:21.360118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bbe55b4e-abb1-48b6-9a45-28cf942e6c57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.364625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.425524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 204c72a6-5710-46ff-87ad-a1a7bbd4f24a owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:21.519725 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e9f81e3-00e0-4212-a587-ceb48a5a5057 x-openstack-request-id: req-1e9f81e3-00e0-4212-a587-ceb48a5a5057 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:21.520068 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-plugged", "status": "completed", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:21.520328 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1e9f81e3-00e0-4212-a587-ceb48a5a5057 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:21.520767 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'code': 200} Dec 21 03:47:21.523812 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.531401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bbe55b4e-abb1-48b6-9a45-28cf942e6c57 None None] Port 97ca28df-516e-42ca-a7be-46ce5c12dab9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:21.550974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:21.575380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8775d1d3-b6a6-4a79-b431-fe33128f25fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.624846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:21.641624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36e6ca91-4304-49a1-a634-3e9074c1702a req-e099f9c9-264a-4338-b6c9-a7f0e086fadf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 210 time: 0.0723381 Dec 21 03:47:21.644517 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.668512 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-acf18a4d-6459-4d30-b08b-0875be568791 admin admin] 10.222.0.18 "PUT /v2.0/routers/2376a5de-876f-4295-bee4-f95526e6331c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1872907 Dec 21 03:47:21.673010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8775d1d3-b6a6-4a79-b431-fe33128f25fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:21.728402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Router 138198e8-cb21-4974-9773-632cfe7c78d0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:47:21.799945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:21.858333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ec0e1bf-7fcf-48bb-94f0-eb13fdb3efe0 req-d116ca76-7cbd-4294-8d95-8837f6bfd9ac tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=bf434f60-071b-45f8-a92b-95ae507578b7 HTTP/1.1" status: 200 len: 210 time: 0.0876851 Dec 21 03:47:21.907758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Sync routers for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:21.949407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:21.950086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:21.955240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-daad858e-0c6a-4c8a-8f95-13fc293bad14 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=408f05064a77442595f2b5d444671b8a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0388799 Dec 21 03:47:22.057087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:22.075981 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:22.091314 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:22.092852 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:46:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:22.138669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-29489950-a1e8-4429-8149-b6bc81fc36af tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:22.144171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-29489950-a1e8-4429-8149-b6bc81fc36af tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1851616 Dec 21 03:47:22.166882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8775d1d3-b6a6-4a79-b431-fe33128f25fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.175611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8775d1d3-b6a6-4a79-b431-fe33128f25fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.189247 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8775d1d3-b6a6-4a79-b431-fe33128f25fe admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/faa1136c-c216-4ccd-bb13-e217730e210e HTTP/1.1" status: 204 len: 168 time: 0.9701827 Dec 21 03:47:22.200596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Request body: {'port': {'device_id': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '408f05064a77442595f2b5d444671b8a'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:22.207117 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.244092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] No DVR routers for this DVR port 191b83a9-628d-4985-aca6-eb18b8810e59 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:22.246695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8775d1d3-b6a6-4a79-b431-fe33128f25fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=faa1136c-c216-4ccd-bb13-e217730e210e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:22.249451 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.256028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a071346-82a6-47ec-83d5-2bc0e3d51d62 req-e877d1cb-287b-45a3-a98e-ab9db7d150ba tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.31 "DELETE /v2.0/ports/191b83a9-628d-4985-aca6-eb18b8810e59 HTTP/1.1" status: 204 len: 173 time: 3.9456389 Dec 21 03:47:22.272548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=204c72a6-5710-46ff-87ad-a1a7bbd4f24a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:22.330679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffca52b-0e23-466a-b232-94dc8a67dc65 req-140131c6-85d0-4543-b286-41aa12ed465c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:22.336914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffca52b-0e23-466a-b232-94dc8a67dc65 req-140131c6-85d0-4543-b286-41aa12ed465c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:22.345053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ffca52b-0e23-466a-b232-94dc8a67dc65 req-140131c6-85d0-4543-b286-41aa12ed465c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 1604 time: 0.1958880 Dec 21 03:47:22.370900 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:22.429000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 204c72a6-5710-46ff-87ad-a1a7bbd4f24a on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:22.433791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.443326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-584573a7-605f-4b17-bd29-a240f590966b req-f6ff79c9-47bf-43ae-bb4d-db5647dfca78 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "DELETE /v2.0/ports/204c72a6-5710-46ff-87ad-a1a7bbd4f24a HTTP/1.1" status: 204 len: 173 time: 1.6491151 Dec 21 03:47:22.536992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 54e4beae-74f2-4632-b9a3-5c575004e2a8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:22.611090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'name': 'network-vif-deleted', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:22.613782 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7bf3ac4b-388b-4d66-a829-b9603da372cd" -d '{"events": [{"server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "name": "network-vif-deleted", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:22.626282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cab79ada-ac50-4b1e-a5ff-2377f3b7d640 req-ecbdf47a-d303-46b7-8057-80ec9c370b40 tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 210 time: 0.0839090 Dec 21 03:47:22.665125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ffca52b-0e23-466a-b232-94dc8a67dc65 req-2ed19e31-24df-4445-9087-c12ae67cfe63 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3134568 Dec 21 03:47:22.741685 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0682c539-4c14-4799-af79-62582612292d x-openstack-request-id: req-0682c539-4c14-4799-af79-62582612292d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:22.742223 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d8b3d0f-8d53-4152-952e-6872427beaae", "name": "network-vif-deleted", "tag": "191b83a9-628d-4985-aca6-eb18b8810e59", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:22.742621 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0682c539-4c14-4799-af79-62582612292d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:22.743288 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d8b3d0f-8d53-4152-952e-6872427beaae', 'name': 'network-vif-deleted', 'tag': '191b83a9-628d-4985-aca6-eb18b8810e59', 'status': 'completed', 'code': 200} Dec 21 03:47:22.791130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 54e4beae-74f2-4632-b9a3-5c575004e2a8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:22.793445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.856723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:22.924063 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:22.957725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-deleted', 'tag': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:22.961918 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eea25653-b1b0-4807-a5c2-ecc581240417" -d '{"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-deleted", "tag": "204c72a6-5710-46ff-87ad-a1a7bbd4f24a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:22.969913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d3a1e0e-21f7-43a0-a7c0-84dacb31ab0f req-e1a11e61-f4bf-451a-9263-791e6c9a8bdc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 210 time: 0.0607803 Dec 21 03:47:22.970622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Made reservation on behalf of 408f05064a77442595f2b5d444671b8a for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:22.975169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.978906 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:22.983545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:22.988501 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed63a46c-413e-4dc5-a3f2-93a3a6e4330d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:22.991096 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:22.991758 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:22.997019 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c374b574-6c97-4b9b-959d-b8e80f156e70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.093847 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08eef3c3-3987-4acf-8a16-5ee2affa0a46 x-openstack-request-id: req-08eef3c3-3987-4acf-8a16-5ee2affa0a46 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:23.094178 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-deleted", "tag": "204c72a6-5710-46ff-87ad-a1a7bbd4f24a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:23.096647 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-08eef3c3-3987-4acf-8a16-5ee2affa0a46 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:23.096647 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-deleted', 'tag': '204c72a6-5710-46ff-87ad-a1a7bbd4f24a', 'status': 'completed', 'code': 200} Dec 21 03:47:23.126151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:23.126794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.150974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 54e4beae-74f2-4632-b9a3-5c575004e2a8 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:23.204323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.205008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:23.303664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.399865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54e4beae-74f2-4632-b9a3-5c575004e2a8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54e4beae-74f2-4632-b9a3-5c575004e2a8,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:23.411146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:23.415525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.437291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:23.443060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest-1378558027-network', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:23.463509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Allocated IP 192.168.233.105 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/7be0b6c0-d923-4d30-8201-1599bce159fb) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:23.528885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:23.534163 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68c0e9db-83b8-43ad-afba-a66a1b320249" -d '{"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-unplugged", "status": "completed", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:23.560409 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.561124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 191b83a9-628d-4985-aca6-eb18b8810e59 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:23.608378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Made reservation on behalf of f7e825d467974290b733e78d9d0bbb49 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:23.614870 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.628007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.652521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-bea95f25-57b2-4c2b-b9e7-3e5403baa084 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:23.668333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-bea95f25-57b2-4c2b-b9e7-3e5403baa084 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 822 time: 0.2606266 Dec 21 03:47:23.736021 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77521f3d-6db9-4042-b1de-42c3d8801043 x-openstack-request-id: req-77521f3d-6db9-4042-b1de-42c3d8801043 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:23.736256 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-unplugged", "status": "completed", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:23.736493 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-77521f3d-6db9-4042-b1de-42c3d8801043 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:23.736898 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8', 'code': 200} Dec 21 03:47:23.738280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:23.757509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 191b83a9-628d-4985-aca6-eb18b8810e59 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:23.757862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 191b83a9-628d-4985-aca6-eb18b8810e59 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:23.758305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 204c72a6-5710-46ff-87ad-a1a7bbd4f24a no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:23.775202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.807148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-6509e519-782f-40ac-82a4-88fb38eb42ee tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/quotas/7a49d4228d05498db20fade9b7651659 HTTP/1.1" status: 200 len: 375 time: 0.1381691 Dec 21 03:47:23.823979 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:23.849721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 204c72a6-5710-46ff-87ad-a1a7bbd4f24a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:23.850082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 204c72a6-5710-46ff-87ad-a1a7bbd4f24a not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:23.851463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c52d8b93-72f9-4ecf-b69e-91d970e100ab req-7bda9c2e-2ea2-43ad-99a3-7df579cc4a2b tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/ports?device_id=1d8b3d0f-8d53-4152-952e-6872427beaae HTTP/1.1" status: 200 len: 210 time: 0.0792463 Dec 21 03:47:23.852755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9f808f5-8765-422e-97e6-d49e13ddb5a9 None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:42:29Z', 'revision_number': 4, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6db4167b-38cd-4236-9f39-55706e3db79a', 'name': '', 'network_id': '97e3dbcb-7ac2-4207-82ae-df7e1df411c2', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'mac_address': 'fa:16:3e:c0:05:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:29Z', 'updated_at': '2021-12-21T03:42:34Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'subnets': [{'id': '8ca201b9-7506-4b6b-8a03-05d4689a5e59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:23.855030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:23.896966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: f8716759-f9e1-41d6-94ee-713ee38eca01 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:23.897311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f8716759-f9e1-41d6-94ee-713ee38eca01 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:23.897757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 309abf42-4548-412c-ad2e-67d338e5fa00 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:23.900752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.926441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 309abf42-4548-412c-ad2e-67d338e5fa00 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:23.933666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 309abf42-4548-412c-ad2e-67d338e5fa00 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:23.939011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:47:23.949021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:23.950205 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Added segment 9cac79f9-2a11-44fa-be96-df9a5374778e of type vlan for network db71f3b3-7195-4c4a-b30b-67dc14f350a1 Dec 21 03:47:23.957904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-9d214d94-625b-4b34-a745-5b373e0db36b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1497927 Dec 21 03:47:23.962366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:19Z', 'revision_number': 2, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:24.010437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Checking router: 2376a5de-876f-4295-bee4-f95526e6331c for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:24.010804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Updating router 2376a5de-876f-4295-bee4-f95526e6331c port 97ca28df-516e-42ca-a7be-46ce5c12dab9 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:47:24.015916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.055831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.060332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=566c6b7f-b7f4-464d-9c23-cd6e583d9def,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:24.071295 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.097116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-afaa95d4-fe7f-4d97-ad1e-e18179274d00 service neutron] 10.222.0.18 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1382923 Dec 21 03:47:24.142265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e482a84-142e-4bb3-af51-b10a716f77f3 req-64f1ad9f-c80c-4b32-b4f3-27ec50d32e30 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 210 time: 0.2146969 Dec 21 03:47:24.155306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.155306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:24.155306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.264154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] Pushing event updated for resources: {'Network': ['ID=db71f3b3-7195-4c4a-b30b-67dc14f350a1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:24.315484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:47:24.369758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d27e07e-cbcb-41f8-9d6d-8bfb3b2eac5a admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.9305315 Dec 21 03:47:24.373658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46940) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:24.376950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Request body: {'subnet': {'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest-1378558027-subnet', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:24.452530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71c1ce05-4f56-408a-8b91-d58e2373fbf0 None None] New status for floating IP 631c6293-0c83-45b1-8aca-1ed5976f4def: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:47:24.520702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Made reservation on behalf of f7e825d467974290b733e78d9d0bbb49 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:24.520702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.695951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.706809 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.717764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46952) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:24.737430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=54e4beae-74f2-4632-b9a3-5c575004e2a8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:24.767229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.775247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-426b52cd-96bc-4a3c-b738-cf5ea61a6577 req-7c02e28d-ac70-4062-9247-6d19ef6376b0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 210 time: 0.0543938 Dec 21 03:47:24.944784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:24.979979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Request body: {'network': {'name': 'tempest-ImagesTestJSON-1927448517-network', 'tenant_id': '597df5e2769740859ecb4f30e4aefff3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:25.020134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.047893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2791e6eb-1a32-4948-8c9a-2aa486fa41bf None None] Pushing event updated for resources: {'Port': ['ID=97ca28df-516e-42ca-a7be-46ce5c12dab9,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:25.054991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.058181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 54e4beae-74f2-4632-b9a3-5c575004e2a8 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:25.062812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.073766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-584573a7-605f-4b17-bd29-a240f590966b req-d1482913-437a-4f6d-a6f5-1012bf3b051b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.31 "DELETE /v2.0/ports/54e4beae-74f2-4632-b9a3-5c575004e2a8 HTTP/1.1" status: 204 len: 173 time: 2.6190436 Dec 21 03:47:25.103222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-deleted', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:25.105956 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9fc9d3dc-c333-4267-80ea-f4d602351c82" -d '{"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-deleted", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:25.116826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Attempting to bind port 97ca28df-516e-42ca-a7be-46ce5c12dab9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:25.118486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Attempting to bind port 97ca28df-516e-42ca-a7be-46ce5c12dab9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:25.118867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Attempting to bind port 97ca28df-516e-42ca-a7be-46ce5c12dab9 on network 04ed2fa2-4e59-410d-9778-4535a349c6b9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:25.133579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b881d58-71d9-4f25-ae52-9da80d5e2920,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:25.138381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:25.138897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Checking segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:25.139343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.140372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Bound using segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:25.140889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Bound port: 97ca28df-516e-42ca-a7be-46ce5c12dab9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:25.141245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.154814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-5b72e42a-841b-4cc0-bb52-142046cc0724 service neutron] 10.222.0.18 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0565343 Dec 21 03:47:25.176164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Checking segment: {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:25.176661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Network hostable DHCP agents. Network: db71f3b3-7195-4c4a-b30b-67dc14f350a1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:47:25.213990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Made reservation on behalf of 597df5e2769740859ecb4f30e4aefff3 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:25.217174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.237458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.248392 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.291523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['52f73cf2-b045-4f07-b974-6c29f7b35de0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:25.302251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641', '4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:25.339991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:47:25.343443 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c670bb7d-a5ab-4fd1-a80d-497c9321a09a x-openstack-request-id: req-c670bb7d-a5ab-4fd1-a80d-497c9321a09a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:25.345209 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d0669e0-a564-4749-93f1-d779cc9a5d81", "name": "network-vif-deleted", "tag": "54e4beae-74f2-4632-b9a3-5c575004e2a8", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:25.346247 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c670bb7d-a5ab-4fd1-a80d-497c9321a09a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:25.346749 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d0669e0-a564-4749-93f1-d779cc9a5d81', 'name': 'network-vif-deleted', 'tag': '54e4beae-74f2-4632-b9a3-5c575004e2a8', 'status': 'completed', 'code': 200} Dec 21 03:47:25.379250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:25.395168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:25.397737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:25.411850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:25.417408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] For port 97ca28df-516e-42ca-a7be-46ce5c12dab9, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:25.428563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.442887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, db71f3b3-7195-4c4a-b30b-67dc14f350a1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:25.452574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:25.454868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.480426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] For port 97ca28df-516e-42ca-a7be-46ce5c12dab9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=97ca28df-516e-42ca-a7be-46ce5c12dab9,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:25.486246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-160e22a4-5ac9-4b5a-924a-e90be28698f7 None None] Provisioning complete for port 97ca28df-516e-42ca-a7be-46ce5c12dab9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:25.486246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-160e22a4-5ac9-4b5a-924a-e90be28698f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.486609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a33ad2f-735e-4df6-a0e8-55c906bcac31 None None] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:25.521632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b097b39-52da-475e-8c8e-c3fcceb3035e req-a74a9164-3857-4b3d-a8b9-5d368c1cfe0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=3d0669e0-a564-4749-93f1-d779cc9a5d81 HTTP/1.1" status: 200 len: 210 time: 0.0584383 Dec 21 03:47:25.556924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.586107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:47:25.601686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:25.605277 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.611009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.611246 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Added segment 3789d19b-ea4e-4b6d-9d1f-c151d5e5de79 of type vlan for network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 Dec 21 03:47:25.626988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46974) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:25.652762 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-63981d1e-aedf-4e2f-ab38-d55035477f9a admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2808237 Dec 21 03:47:25.660280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46976) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:25.697477 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:47:25.699776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:25.743889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.747894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af7d5fbe-4198-4920-9356-ff83261b7d16,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:25.784564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc761020-7dc8-4dc7-be81-187cc629358f req-46c75a4e-de5f-4d93-af71-b7031ae12d6f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.1692770 Dec 21 03:47:25.823288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c8688d85-536e-4110-b147-adc59174d5fe tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.6308031 Dec 21 03:47:25.825708 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.837167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.838601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:25.839215 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.888170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Request body: {'port': {'device_id': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:25.921528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.922880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:25.931778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] Pushing event updated for resources: {'Network': ['ID=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:25.953472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2791e6eb-1a32-4948-8c9a-2aa486fa41bf None None] Pushing event updated for resources: {'Port': ['ID=97ca28df-516e-42ca-a7be-46ce5c12dab9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:26.010032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152b1416-28f0-4596-a843-2d236083defc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.018343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:47:26.079777 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-01308f02-0ff6-49c5-8a0b-461c2fc38850 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 1.3608172 Dec 21 03:47:26.082581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46986) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:26.089140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.108768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Request body: {'subnet': {'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImagesTestJSON-1927448517-subnet', 'tenant_id': '597df5e2769740859ecb4f30e4aefff3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:26.126888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:26.128041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:26.139752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.176743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152b1416-28f0-4596-a843-2d236083defc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.242389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-160e22a4-5ac9-4b5a-924a-e90be28698f7 None None] Port 97ca28df-516e-42ca-a7be-46ce5c12dab9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:26.288618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Made reservation on behalf of 597df5e2769740859ecb4f30e4aefff3 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:26.291904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.304698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.305654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ee6d03-faec-42f2-b2ac-24abb162f35c req-90d81d23-a8ce-41df-b426-92f74c255558 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:26.317970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ee6d03-faec-42f2-b2ac-24abb162f35c req-90d81d23-a8ce-41df-b426-92f74c255558 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 936 time: 0.3344293 Dec 21 03:47:26.390393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ee6d03-faec-42f2-b2ac-24abb162f35c req-80c1af28-8beb-4fe8-9442-dbf9aaeab090 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672319 Dec 21 03:47:26.391838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152b1416-28f0-4596-a843-2d236083defc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.396639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152b1416-28f0-4596-a843-2d236083defc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.401256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-152b1416-28f0-4596-a843-2d236083defc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "DELETE /v2.0/security-groups/fa8f8344-ed72-403c-a269-225bbf5487c9 HTTP/1.1" status: 204 len: 168 time: 0.7726276 Dec 21 03:47:26.403922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46988) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:26.434005 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-741a2551-1aba-4c59-bbb2-1c18aa84d53a tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] show failed (client error): The resource could not be found. Dec 21 03:47:26.434828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.439795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46990) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:26.440745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-741a2551-1aba-4c59-bbb2-1c18aa84d53a tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "GET /v2.0/security-groups/fa8f8344-ed72-403c-a269-225bbf5487c9 HTTP/1.1" status: 404 len: 347 time: 0.0323887 Dec 21 03:47:26.447282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-152b1416-28f0-4596-a843-2d236083defc tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa8f8344-ed72-403c-a269-225bbf5487c9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:26.508900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-db71f3b3-7195-4c4a-b30b-67dc14f350a1', 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1', 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'fixed_ips': [{'subnet_id': '4b881d58-71d9-4f25-ae52-9da80d5e2920'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:47:26.510198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.515677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:26.632104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Provisioning complete for port 7be0b6c0-d923-4d30-8201-1599bce159fb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:26.632104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.669189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46998) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:26.794269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Deleting port aabe47a0-1a41-443e-b763-8ee7a51d7d3e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:26.794859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.816627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting subnet 5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:47:26.817265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Port 7be0b6c0-d923-4d30-8201-1599bce159fb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:26.823452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.890963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.893854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.894412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.904904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:26.917629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Calling delete_port for aabe47a0-1a41-443e-b763-8ee7a51d7d3e owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:26.973656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-769eb5d3-bd54-46e8-98b5-20a6966780a2 req-4860675d-f55e-47e1-88a3-444615851be2 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.0531576 Dec 21 03:47:26.992539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Provisioning complete for port 97ca28df-516e-42ca-a7be-46ce5c12dab9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:26.993534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.063404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Allocated IP 172.20.0.2 (db71f3b3-7195-4c4a-b30b-67dc14f350a1/4b881d58-71d9-4f25-ae52-9da80d5e2920/8cfa8526-a054-4aa9-89b9-350cec538e00) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:27.069788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7be0b6c0-d923-4d30-8201-1599bce159fb {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:27.079965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.092443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.111781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Pushing event updated for resources: {'Subnet': ['ID=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:27.130694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Transition to ACTIVE for port object 7be0b6c0-d923-4d30-8201-1599bce159fb will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:47:27.211345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Checking segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:27.211712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Network hostable DHCP agents. Network: d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:47:27.217645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.254563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.277144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.375020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] For port 97ca28df-516e-42ca-a7be-46ce5c12dab9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=97ca28df-516e-42ca-a7be-46ce5c12dab9,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:27.379356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.384966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:25Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:27.401800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Allocated IP 172.25.5.13 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/40cff15a-139d-47bc-b79f-04e33eca7b3f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:27.414542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a074314-7c5c-4d6d-a7f7-99efe49563fa None None] The sync data for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 is: [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:25Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:27.606974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.724886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7931e4e8-b2e7-40b6-86c2-9fdbd49752b3 req-c046f5c2-5737-4fc0-ab49-fad669deed84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:27.726513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7931e4e8-b2e7-40b6-86c2-9fdbd49752b3 req-c046f5c2-5737-4fc0-ab49-fad669deed84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 936 time: 0.0601013 Dec 21 03:47:27.777748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7931e4e8-b2e7-40b6-86c2-9fdbd49752b3 req-d373681c-c8ad-44bb-995a-bd97ef487cea tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454059 Dec 21 03:47:27.843365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.844305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.848181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:47:27.848408 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.849293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.851149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.860146 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.913450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:27.925054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:27.926441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:27.934708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/subnets/5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691 HTTP/1.1" status: 204 len: 168 time: 1.2640603 Dec 21 03:47:27.935127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:27.941485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47016) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:27.942588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-386cb502-3da1-4970-a176-5cf919f204d8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Subnet': ['ID=5fe82e72-f3c0-431c-bc6d-fd4c3e4f7691,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:27.946713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d318044b-5d16-43e4-b30e-dfe9ce1b6300 None None] Network 9ac60f83-5dc7-4da3-bc95-925c1ce35491 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:27.956154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:27.961846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:27.985206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Pushing event updated for resources: {'Port': ['ID=40cff15a-139d-47bc-b79f-04e33eca7b3f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:27.991730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:27.997039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:28.019996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:28.102447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55e04e09-07fe-440a-beca-2dfad18622ca None None] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:28.160888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:28.161391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.173778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1739eaf0-de7c-45cd-95d7-138515f4178f None None] Pushing event updated for resources: {'Port': ['ID=97ca28df-516e-42ca-a7be-46ce5c12dab9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:28.176385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Pushing event deleted for resources: {'Port': ['ID=aabe47a0-1a41-443e-b763-8ee7a51d7d3e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:28.208097 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.228054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.256367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.258565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81ad2382-6a9d-4db0-b992-95d60d1c8b0e tempest-ServersWithSpecificFlavorTestJSON-1752506143 tempest-ServersWithSpecificFlavorTestJSON-1752506143-project] 10.222.0.18 "DELETE /v2.0/floatingips/631c6293-0c83-45b1-8aca-1ed5976f4def HTTP/1.1" status: 204 len: 168 time: 1.8168604 Dec 21 03:47:28.276094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-813a0cd7-64e8-478b-81e1-17d7afaa3aef req-07874008-8ed6-4ea9-8ddc-9f84cbcc1e1f tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.1156964 Dec 21 03:47:28.320277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:28.323405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:28.325768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:28.331514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Pushing event updated for resources: {'Port': ['ID=8cfa8526-a054-4aa9-89b9-350cec538e00,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:28.366291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:47:28.367108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:28.376878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:28.377483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:28.377897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:28.378342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Bound port: 7be0b6c0-d923-4d30-8201-1599bce159fb, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:28.379282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.407424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-15e9f4bd-5d1d-49c8-9862-8cd60ae2da3f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 2.3134768 Dec 21 03:47:28.487462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:28.490971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:28.498765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Attempting to bind port 8cfa8526-a054-4aa9-89b9-350cec538e00 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:28.499131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Attempting to bind port 8cfa8526-a054-4aa9-89b9-350cec538e00 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:28.507221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Attempting to bind port 8cfa8526-a054-4aa9-89b9-350cec538e00 on network db71f3b3-7195-4c4a-b30b-67dc14f350a1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:28.526681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:28.527313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Checking segment: {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:28.528114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.528653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Bound using segment: {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:28.529253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Bound port: 8cfa8526-a054-4aa9-89b9-350cec538e00, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:28.529739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.617723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 8ffa6954-1cc5-44fc-98d8-92b6c857198f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:28.619734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.803791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.826255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 8ffa6954-1cc5-44fc-98d8-92b6c857198f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8ffa6954-1cc5-44fc-98d8-92b6c857198f,segment=NetworkSegment(7b4d34cf-3c63-49c3-abdd-3f6308c046d4),segment_id=7b4d34cf-3c63-49c3-abdd-3f6308c046d4)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:28.826695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:28.884115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 8ffa6954-1cc5-44fc-98d8-92b6c857198f owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:28.906895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.120605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61e7cd86-b359-4e19-a98a-a3355c352ec0 None None] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:29.131378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:29.144479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.146408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] 10.222.0.54 "PUT /v2.0/ports/7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 1097 time: 3.3029423 Dec 21 03:47:29.146884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eacc228b-1d59-48b5-94cd-5137e3af6cf1 None None] DHCP port deletion for 9ac60f83-5dc7-4da3-bc95-925c1ce35491 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:47:29.150002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 97ca28df-516e-42ca-a7be-46ce5c12dab9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:29.151245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:29.153352 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43" -d '{"events": [{"name": "network-changed", "server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:29.251818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.291363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0736b6d-ee46-4ad5-bf5b-e6fda33a6f5a service neutron] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:29.321520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=8ffa6954-1cc5-44fc-98d8-92b6c857198f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:29.350891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 8ffa6954-1cc5-44fc-98d8-92b6c857198f on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:29.366106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eacc228b-1d59-48b5-94cd-5137e3af6cf1 None None] The port '8ffa6954-1cc5-44fc-98d8-92b6c857198f' was deleted {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 21 03:47:29.397120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1c79e2-c732-46b5-a837-9863a515453e req-2b4b49e2-38c3-4f71-a296-d7196e165249 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:29.401623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d1c79e2-c732-46b5-a837-9863a515453e req-2b4b49e2-38c3-4f71-a296-d7196e165249 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 948 time: 0.2524841 Dec 21 03:47:29.463208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] For port 8cfa8526-a054-4aa9-89b9-350cec538e00, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:29.484127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] For port 8cfa8526-a054-4aa9-89b9-350cec538e00, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8cfa8526-a054-4aa9-89b9-350cec538e00,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:29.524406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 97ca28df-516e-42ca-a7be-46ce5c12dab9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:29.525044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.577039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.605894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ac60f83-5dc7-4da3-bc95-925c1ce35491']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:29.620362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7b4d34cf-3c63-49c3-abdd-3f6308c046d4') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:29.620743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7b4d34cf-3c63-49c3-abdd-3f6308c046d4') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:29.631338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.654270 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.658267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c7fada03-5122-41ab-ab36-db9ed604cd63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:29.658404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-c7fada03-5122-41ab-ab36-db9ed604cd63 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1100 time: 0.2283778 Dec 21 03:47:29.710632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.800605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Pushing event updated for resources: {'Port': ['ID=8cfa8526-a054-4aa9-89b9-350cec538e00,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:29.814276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:29.816714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.817142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.817551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.817962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.822181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.826513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.826513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.826513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.826513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.826513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.829843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.829843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.829843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-def4744a-447b-47d6-9283-a41d8bb04929 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:29.833879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d1c79e2-c732-46b5-a837-9863a515453e req-4e019f2e-79fe-4ca7-ac5c-b75fdd7f39f7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3635092 Dec 21 03:47:29.922329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ffa6954-1cc5-44fc-98d8-92b6c857198f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:29.945526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8ffa6954-1cc5-44fc-98d8-92b6c857198f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:29.946021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ffa6954-1cc5-44fc-98d8-92b6c857198f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:29.960540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-dc32b45b-8313-4516-a69b-afe933f95300 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:29.963769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-dc32b45b-8313-4516-a69b-afe933f95300 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 822 time: 0.2487330 Dec 21 03:47:29.992673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-943506d7-91cb-4486-9bc3-b2d3669860d6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:29.994283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-943506d7-91cb-4486-9bc3-b2d3669860d6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.8143404 Dec 21 03:47:29.995448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:47:29.995863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.000128 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c92d455c-b663-44eb-a00e-e2838a6954d2 x-openstack-request-id: req-c92d455c-b663-44eb-a00e-e2838a6954d2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:30.000965 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:30.001211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c92d455c-b663-44eb-a00e-e2838a6954d2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:30.001609 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'status': 'completed', 'code': 200} Dec 21 03:47:30.019418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Request body: {'port': {'device_id': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'admin_state_up': True, 'tenant_id': '7a49d4228d05498db20fade9b7651659'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.073015 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:47:30.076033 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:47:30.094525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-43a4b458-d6de-4442-aa76-ae05241c6f65 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.3941033 Dec 21 03:47:30.196660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Router d77e5fe8-df91-4709-bd5f-2eb276d9f270 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:47:30.239481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e51b4a51-ab99-4afa-9d51-9fc4990e91b4 req-d8653c07-b6a3-4b98-a993-f204352f15cf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.1617849 Dec 21 03:47:30.247587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-b0a6822f-6d50-4f73-a517-15eef5e2235f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/quotas/597df5e2769740859ecb4f30e4aefff3 HTTP/1.1" status: 200 len: 375 time: 0.1546540 Dec 21 03:47:30.349615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-6d14f5c2-b575-4b86-97c9-923365eae2e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:30.351094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-6d14f5c2-b575-4b86-97c9-923365eae2e8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.2327049 Dec 21 03:47:30.354378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-5c2a322c-8010-4995-bd0d-434f14b62df3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0427775 Dec 21 03:47:30.377013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:30.387450 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Sync routers for ids ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:30.404689 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Routers {'d77e5fe8-df91-4709-bd5f-2eb276d9f270'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:30.411533 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:30.424193 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.435134 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.441416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/networks/9ac60f83-5dc7-4da3-bc95-925c1ce35491 HTTP/1.1" status: 204 len: 168 time: 2.4932022 Dec 21 03:47:30.443529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47072) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:30.494406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcbc7709-529a-4ea5-8969-66f27f9f7f7d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Network': ['ID=9ac60f83-5dc7-4da3-bc95-925c1ce35491,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:30.511790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da08c4-389a-4a94-a392-561e71d42f01 req-f1c318cb-f192-4101-aaa2-df5e2237c6e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:30.511790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-f1c318cb-f192-4101-aaa2-df5e2237c6e6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1506650 Dec 21 03:47:30.522648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting subnet 02556e47-25b2-4c72-a874-afa8b0d11077 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:47:30.531849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.558569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47076) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:30.571960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.574790 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-166210df-280b-4555-9087-31281d54ae3c admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.8835063 Dec 21 03:47:30.576703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47080) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:30.598428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.624493 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Set router d77e5fe8-df91-4709-bd5f-2eb276d9f270 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:30.629217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-7296f5b1-b8eb-49dd-b9eb-30f596e21792 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2381599 Dec 21 03:47:30.701820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Made reservation on behalf of 7a49d4228d05498db20fade9b7651659 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:30.705552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.719938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.910882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.961907 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:47:28Z', 'revision_number': 3, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:30.974376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8cfa8526-a054-4aa9-89b9-350cec538e00 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:30.977886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Subnet': ['ID=02556e47-25b2-4c72-a874-afa8b0d11077,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:30.980057 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:30.989682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26399d2b-d534-4f69-9284-7d7a53dc2486 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/subnets/02556e47-25b2-4c72-a874-afa8b0d11077 HTTP/1.1" status: 204 len: 168 time: 0.5449944 Dec 21 03:47:30.990364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47086) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:31.040143 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Checking router: d77e5fe8-df91-4709-bd5f-2eb276d9f270 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:31.040784 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Updating router d77e5fe8-df91-4709-bd5f-2eb276d9f270 port 40cff15a-139d-47bc-b79f-04e33eca7b3f binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:47:31.056271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-870f7d62-3906-4ef8-869f-850a93efc71d None None] Network 6ab64731-1736-45c2-9cd4-cd4313abad0e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:31.088185 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.122111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.165674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8cfa8526-a054-4aa9-89b9-350cec538e00 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:31.169964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.199596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 797de223-f760-46f4-8e39-72bd74ad01d4 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:31.200197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.282860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56402608-54bf-4725-92f4-713543d70dad None None] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:31.314105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 797de223-f760-46f4-8e39-72bd74ad01d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=797de223-f760-46f4-8e39-72bd74ad01d4,segment=NetworkSegment(19106602-1c52-4fa6-98dd-9ea225025426),segment_id=19106602-1c52-4fa6-98dd-9ea225025426)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:31.314473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.346776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 797de223-f760-46f4-8e39-72bd74ad01d4 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:31.455301 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.517074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-18a141f0-66be-498f-95b0-aa037e2c39f6 None None] Provisioning complete for port 8cfa8526-a054-4aa9-89b9-350cec538e00 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:31.517074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18a141f0-66be-498f-95b0-aa037e2c39f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.518346 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.548974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-256856e6-c666-445a-b32f-1b0f34156492 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0274475 Dec 21 03:47:31.582386 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-2ffc7e7a-7fe4-46cc-ae96-14c154c44874 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0640984 Dec 21 03:47:31.583737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.586869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed37046c-3c57-448b-9d3b-5af9a7202863 None None] DHCP port deletion for 6ab64731-1736-45c2-9cd4-cd4313abad0e request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:47:31.590052 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Attempting to bind port 40cff15a-139d-47bc-b79f-04e33eca7b3f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:31.590536 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Attempting to bind port 40cff15a-139d-47bc-b79f-04e33eca7b3f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:31.590904 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Attempting to bind port 40cff15a-139d-47bc-b79f-04e33eca7b3f on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:31.605408 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:31.605408 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:31.612256 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.612256 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:31.612256 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Bound port: 40cff15a-139d-47bc-b79f-04e33eca7b3f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:31.612256 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.645176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.654717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 797de223-f760-46f4-8e39-72bd74ad01d4 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:31.688633 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] For port 40cff15a-139d-47bc-b79f-04e33eca7b3f, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:31.693086 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] For port 40cff15a-139d-47bc-b79f-04e33eca7b3f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=40cff15a-139d-47bc-b79f-04e33eca7b3f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:31.704818 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f95a352-bb55-4ca2-bca3-a19542498a59 None None] Pushing event updated for resources: {'Port': ['ID=40cff15a-139d-47bc-b79f-04e33eca7b3f,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:31.725607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=797de223-f760-46f4-8e39-72bd74ad01d4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:31.727679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 8cfa8526-a054-4aa9-89b9-350cec538e00, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8cfa8526-a054-4aa9-89b9-350cec538e00,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:31.762091 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.783140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.783528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.783819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.784153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.784492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.784829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.785158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.785618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.785958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.793391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.794383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.794383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.794617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.794716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:31.794842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db984ad-be72-4a76-95dd-1d7a6624addc req-779aaf14-b21b-4390-ae67-75d897f4eec5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:31.796569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2db984ad-be72-4a76-95dd-1d7a6624addc req-779aaf14-b21b-4390-ae67-75d897f4eec5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 948 time: 0.5033224 Dec 21 03:47:31.858325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-e191a266-6e4a-42f9-b1ac-e771e9768b48 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1821876 Dec 21 03:47:31.873588 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18a141f0-66be-498f-95b0-aa037e2c39f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:31.902201 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Routers {'d77e5fe8-df91-4709-bd5f-2eb276d9f270'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:31.905568 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:31.989455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=8cfa8526-a054-4aa9-89b9-350cec538e00,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:32.008320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.027354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-18a141f0-66be-498f-95b0-aa037e2c39f6 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:47:32.027805 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-18a141f0-66be-498f-95b0-aa037e2c39f6 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:47:32.033724 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f95a352-bb55-4ca2-bca3-a19542498a59 None None] Pushing event updated for resources: {'Port': ['ID=40cff15a-139d-47bc-b79f-04e33eca7b3f,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:32.046911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-a885920a-9df6-4f15-8535-c9e8c769cb1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:32.049180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-a885920a-9df6-4f15-8535-c9e8c769cb1c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 1096 time: 0.3274615 Dec 21 03:47:32.062257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ab64731-1736-45c2-9cd4-cd4313abad0e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:32.074545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19106602-1c52-4fa6-98dd-9ea225025426') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:32.077258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19106602-1c52-4fa6-98dd-9ea225025426') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:32.111248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Allocated IP 172.20.0.10 (7c34a09c-fe79-4a56-ac99-3b531a9f3f91/ec8e3a7f-1bef-41ac-8b72-508d262fe30c/cd66adb7-3082-409b-aa05-c9a7248bb04b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:32.182891 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] Set router d77e5fe8-df91-4709-bd5f-2eb276d9f270 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:32.199344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.223888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.240431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:47:32.240770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.244174 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:47:32.246601 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:47:32.302001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-a3e03e94-20e9-4177-b25a-6c582047734a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:32.304454 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-a3e03e94-20e9-4177-b25a-6c582047734a service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.2215436 Dec 21 03:47:32.356451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da08c4-389a-4a94-a392-561e71d42f01 req-7f9b3c9e-d4a7-45f6-891a-2ae5a75b701b service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7550986 Dec 21 03:47:32.380179 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-3d3b8915-32dd-4fe1-b119-9fe8be0376ea service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 200 len: 217 time: 0.0595555 Dec 21 03:47:32.401614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2db984ad-be72-4a76-95dd-1d7a6624addc req-638c2fc8-da0b-446b-9dcb-8f647f9fa6f5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5676286 Dec 21 03:47:32.411695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1770a98a-cfa5-42e3-89c9-88d6c988b337 req-f68ea16c-b151-4bf1-ae28-e72de2fa4e47 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.1572001 Dec 21 03:47:32.489361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-8d80d7f3-df4b-4cbe-8f4e-bdc12f4bf68b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:32.490912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-8d80d7f3-df4b-4cbe-8f4e-bdc12f4bf68b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1023896 Dec 21 03:47:32.495385 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.505273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.514395 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/networks/6ab64731-1736-45c2-9cd4-cd4313abad0e HTTP/1.1" status: 204 len: 168 time: 1.5222325 Dec 21 03:47:32.538426 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:47:28Z', 'revision_number': 3, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:32.550326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:32.558082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-689658851'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:32.581071 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0d9b24d-aac4-4b55-8d82-063e991e68c4 None None] The sync data for ids ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'] in n-d-822053-11 is: [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:47:28Z', 'revision_number': 3, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:32.603434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edb4040-13d1-4591-a5a9-cc008a53ea0e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Network': ['ID=6ab64731-1736-45c2-9cd4-cd4313abad0e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:32.607921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-df548b79-95bb-4610-bafb-a1bc4b101aab service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0906169 Dec 21 03:47:32.655289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad6c1a46-5c88-4356-8edb-930acfb799b1 req-58ad1467-867a-4178-abdd-fb1524f7bc5a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 210 time: 0.1559634 Dec 21 03:47:32.748189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a13bfb44-2661-410e-8d04-f219441eefaf None None] Provisioning complete for port 8cfa8526-a054-4aa9-89b9-350cec538e00 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:32.748467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a13bfb44-2661-410e-8d04-f219441eefaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.750952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:32.763846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.821189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:47:32.831168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-74c054bc-e4be-4f7b-b179-d52176158494 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:32.832722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-74c054bc-e4be-4f7b-b179-d52176158494 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1100 time: 0.2855110 Dec 21 03:47:32.900802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:32.902416 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Added segment 2422dd6d-5de4-4305-9d41-4b5afbffe8bb of type vlan for network 74b92324-668f-4e02-853d-3aaf26a99a26 Dec 21 03:47:32.939378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-e244eee4-a2db-46bf-9492-bf6485a7e32a service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2955596 Dec 21 03:47:32.985031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.028375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8cfa8526-a054-4aa9-89b9-350cec538e00 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:33.086231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.096743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8cfa8526-a054-4aa9-89b9-350cec538e00 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:33.097238 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.273619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e8be799-6877-4f66-ad25-42530ceb6360 req-ed8efbed-b796-4090-8ace-e702e745b0a4 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2424872 Dec 21 03:47:33.304700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 797de223-f760-46f4-8e39-72bd74ad01d4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:33.305101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-c3d57c78-b59e-42f3-b7b3-db433a2dee66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:33.307346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-c3d57c78-b59e-42f3-b7b3-db433a2dee66 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.4605756 Dec 21 03:47:33.322829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.330445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:33.331260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.335068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 797de223-f760-46f4-8e39-72bd74ad01d4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:33.335812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 797de223-f760-46f4-8e39-72bd74ad01d4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:33.368085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.430697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-3f76af0f-18a2-436c-a923-ac20594878ac service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0936928 Dec 21 03:47:33.439898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Network': ['ID=74b92324-668f-4e02-853d-3aaf26a99a26,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:33.455937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 74b92324-668f-4e02-853d-3aaf26a99a26 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:47:33.474574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.486588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-affc5a2f-0498-4320-add5-fffb0195c1ad tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.9332087 Dec 21 03:47:33.489059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47120) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:33.494154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'subnet': {'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26', 'cidr': '19.80.0.0/24', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:33.735510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:33.752386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:33.754881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:33.757665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event updated for resources: {'Port': ['ID=cd66adb7-3082-409b-aa05-c9a7248bb04b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:33.778165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:33.784558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:33.806896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-2ba6816e-9359-496c-8f47-acdace716761 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:33.809852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-2ba6816e-9359-496c-8f47-acdace716761 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.3592234 Dec 21 03:47:33.958097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff62caf-1740-4877-b4d3-54fd7df89345 req-d11aeefc-b230-47e1-bef2-9fef9929b140 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:33.959735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aff62caf-1740-4877-b4d3-54fd7df89345 req-d11aeefc-b230-47e1-bef2-9fef9929b140 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 948 time: 0.3394299 Dec 21 03:47:33.967638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.036078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:34.036743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.159621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.263909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Subnet': ['ID=90423e11-83e3-4a02-8325-6b52e25ac647,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:34.283751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Checking segment: {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:34.284488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network hostable DHCP agents. Network: 74b92324-668f-4e02-853d-3aaf26a99a26, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:47:34.381042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 74b92324-668f-4e02-853d-3aaf26a99a26 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:47:34.415572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f88cb9-f3f0-4607-9ce2-aacb6aa1c82f req-3a532139-67f3-4ca0-be4d-269f779411b3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:34.417088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57f88cb9-f3f0-4607-9ce2-aacb6aa1c82f req-3a532139-67f3-4ca0-be4d-269f779411b3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 932 time: 0.8391027 Dec 21 03:47:34.438394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-89de75cf-f66f-4523-ad3d-6c2b633ce334 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:34.443172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-89de75cf-f66f-4523-ad3d-6c2b633ce334 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.6071117 Dec 21 03:47:34.459638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 74b92324-668f-4e02-853d-3aaf26a99a26) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:34.474738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:34.488022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:34.490264 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.522836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f7f5c82-eaa8-4ade-bc98-383fc833ba9d None None] Network 74b92324-668f-4e02-853d-3aaf26a99a26 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:34.557169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-802a845e-b6eb-45fe-b882-f10ec7532a53 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.5546770 Dec 21 03:47:34.593982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d17dc542-422c-45bd-b861-7a2fd1708911 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.1037743 Dec 21 03:47:34.596683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47130) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:34.615445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-768429782'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:34.629179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Allocated IP 172.20.0.1 (db71f3b3-7195-4c4a-b30b-67dc14f350a1/4b881d58-71d9-4f25-ae52-9da80d5e2920/48ed0705-b46c-42de-9f83-231addc73f4e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:34.667589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Request body: {'port': {'device_id': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:34.683014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aff62caf-1740-4877-b4d3-54fd7df89345 req-3515e094-3bfb-4355-b6de-72256830dea9 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6656222 Dec 21 03:47:34.748886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:34.751916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:34.754752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-74b92324-668f-4e02-853d-3aaf26a99a26', 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26', 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'fixed_ips': [{'subnet_id': '90423e11-83e3-4a02-8325-6b52e25ac647'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:47:34.755656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.757116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.825594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:47:34.836828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.837219 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Added segment 11b27198-f796-49c2-bb1b-da4ad92e1d22 of type vlan for network 65cd0343-3e56-4d28-b026-1efe272456ef Dec 21 03:47:34.921271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.943825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:34.978983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'mac_address': 'fa:16:3e:01:64:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.105'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:34.987953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 40cff15a-139d-47bc-b79f-04e33eca7b3f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:34.999761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57f88cb9-f3f0-4607-9ce2-aacb6aa1c82f req-a3ed9d8c-cfe6-4ec6-a58b-149bd819a772 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5672679 Dec 21 03:47:35.050270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13398879-03eb-40d0-85ef-491fa0383155 req-fe7059cc-0340-4058-8ca4-2d7bbca47c86 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 210 time: 0.0478761 Dec 21 03:47:35.088211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.094642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:35.095737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.112953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-9ee208cb-91e7-4235-8aca-0f08f2299ff6 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6352968 Dec 21 03:47:35.116541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.145707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Allocated IP 19.80.0.2 (74b92324-668f-4e02-853d-3aaf26a99a26/90423e11-83e3-4a02-8325-6b52e25ac647/7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:35.149009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7be0b6c0-d923-4d30-8201-1599bce159fb {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:35.155289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.186552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 40cff15a-139d-47bc-b79f-04e33eca7b3f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:35.186855 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.198647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:35.277194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-8c06b51b-b1a6-42e2-bace-77380cdff2ba tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:35.279195 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-8c06b51b-b1a6-42e2-bace-77380cdff2ba tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.1473472 Dec 21 03:47:35.286319 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.6862876 Dec 21 03:47:35.298429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47132) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:35.303332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'subnet': {'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef', 'cidr': '19.86.0.0/24', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:35.375663 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.412873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.420452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Request body: {'port': {'device_id': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'admin_state_up': True, 'tenant_id': '597df5e2769740859ecb4f30e4aefff3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:35.532534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:35.543293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8548388d-9176-48c4-a1e3-180d659c4fde tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Network': ['ID=65cd0343-3e56-4d28-b026-1efe272456ef,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:35.545522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:35.573410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 65cd0343-3e56-4d28-b026-1efe272456ef details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:47:35.575991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:35.586767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Pushing event updated for resources: {'Port': ['ID=48ed0705-b46c-42de-9f83-231addc73f4e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:35.591051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:35.661076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:35.665905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.669525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aca7585-fa3b-4fdc-ab5a-1bb12f4adf43 req-0fc8d4a4-eb9f-4a04-a17e-a0783a0f983a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4912922 Dec 21 03:47:35.718735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.720334 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.738920 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.763535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 40cff15a-139d-47bc-b79f-04e33eca7b3f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=40cff15a-139d-47bc-b79f-04e33eca7b3f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:35.814856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7be0b6c0-d923-4d30-8201-1599bce159fb'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:35.858243 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.910076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Made reservation on behalf of 597df5e2769740859ecb4f30e4aefff3 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:35.913318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.927144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd66adb7-3082-409b-aa05-c9a7248bb04b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:35.940660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.941084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Pushing event updated for resources: {'Port': ['ID=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:35.951054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.965453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Deleting port 6db4167b-38cd-4236-9f39-55706e3db79a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:35.966022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:35.981980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Network 74b92324-668f-4e02-853d-3aaf26a99a26 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:35.986456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Transition to ACTIVE for port object cd66adb7-3082-409b-aa05-c9a7248bb04b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:47:36.001535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca72238d-94a4-4c88-9079-2afb0323510b req-33075d4e-ae2b-4ba8-acd1-f4722a5749e3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:36.007340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca72238d-94a4-4c88-9079-2afb0323510b req-33075d4e-ae2b-4ba8-acd1-f4722a5749e3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.1810603 Dec 21 03:47:36.015706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:36.029698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:36.100377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.137915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca72238d-94a4-4c88-9079-2afb0323510b req-e1cab49a-0876-4e53-ad6c-e788d1c055cb tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1261623 Dec 21 03:47:36.139922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] For port 6db4167b-38cd-4236-9f39-55706e3db79a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6db4167b-38cd-4236-9f39-55706e3db79a,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:36.140181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.144367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ed898223-d2c0-48fe-8b77-83f5393eb4dd None None] Provisioning complete for port 48ed0705-b46c-42de-9f83-231addc73f4e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:36.144528 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed898223-d2c0-48fe-8b77-83f5393eb4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.151455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=40cff15a-139d-47bc-b79f-04e33eca7b3f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:36.154301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Allocated IP 172.20.0.6 (d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1/d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766/2245f877-8d64-488f-bc12-d173f88c7450) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:36.157334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Calling delete_port for 6db4167b-38cd-4236-9f39-55706e3db79a owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:36.161214 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.173097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Attempting to bind port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:36.173484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Attempting to bind port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:36.173840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Attempting to bind port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 on network 74b92324-668f-4e02-853d-3aaf26a99a26 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:36.197102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:36.199362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Checking segment: {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:36.199362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.199362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Bound using segment: {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:36.199362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Bound port: 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:36.199362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.208401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ed898223-d2c0-48fe-8b77-83f5393eb4dd None None] Port 48ed0705-b46c-42de-9f83-231addc73f4e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:36.214089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Subnet': ['ID=c64439a7-5fd1-4867-990d-55fe8b8f1bbb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:36.248216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476f24df-73ef-467e-8d17-cb5647eca143 req-6113fd0b-6172-4a7e-90d5-6d91ee2b13d1 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:36.249775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-476f24df-73ef-467e-8d17-cb5647eca143 req-6113fd0b-6172-4a7e-90d5-6d91ee2b13d1 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 932 time: 0.1702824 Dec 21 03:47:36.250820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.263233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Checking segment: {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:36.263577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network hostable DHCP agents. Network: 65cd0343-3e56-4d28-b026-1efe272456ef, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:47:36.318218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] For port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:36.322287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] For port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:36.336252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Pushing event updated for resources: {'Port': ['ID=cd66adb7-3082-409b-aa05-c9a7248bb04b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:36.394830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a21e9c7-737a-4093-bcfc-449cf16cd1b3 req-2cbe29b6-5ee2-4e42-808d-ba43d781d75b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 210 time: 0.0749331 Dec 21 03:47:36.441908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.444842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.477435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 65cd0343-3e56-4d28-b026-1efe272456ef is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:47:36.500325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc045c7-07af-4ea6-aec7-a2bf0a42d072 None None] Pushing event updated for resources: {'Port': ['ID=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:36.608599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-476f24df-73ef-467e-8d17-cb5647eca143 req-2fa12b7c-7d12-4bd5-a543-0d660a6ef750 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3148782 Dec 21 03:47:36.620392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.620546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Attempting to bind port cd66adb7-3082-409b-aa05-c9a7248bb04b on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:36.620750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Attempting to bind port cd66adb7-3082-409b-aa05-c9a7248bb04b by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:36.621088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Attempting to bind port cd66adb7-3082-409b-aa05-c9a7248bb04b on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:36.654531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Port cd66adb7-3082-409b-aa05-c9a7248bb04b on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:47:36.654795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Attempting to bind port cd66adb7-3082-409b-aa05-c9a7248bb04b on network 7c34a09c-fe79-4a56-ac99-3b531a9f3f91 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:36.662602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 65cd0343-3e56-4d28-b026-1efe272456ef) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:36.667091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:36.667609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Checking segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:36.667999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Bound using segment: {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:36.669241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Bound port: cd66adb7-3082-409b-aa05-c9a7248bb04b, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01718413-2838-40fe-a380-2d2cdba03082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:36.669241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.686086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:36.686686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.705945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:36.719209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a018f861-b64c-4327-bc78-ae04c13563dc None None] Network 65cd0343-3e56-4d28-b026-1efe272456ef requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:36.722220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:36.727843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:36.732657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:36.803903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:36.811145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.818761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.863651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] For port cd66adb7-3082-409b-aa05-c9a7248bb04b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:36.866632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] For port cd66adb7-3082-409b-aa05-c9a7248bb04b, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:36.877864 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e07d14f5-ed6d-4e17-8b6a-80827b517652 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.5752032 Dec 21 03:47:36.885771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-65cd0343-3e56-4d28-b026-1efe272456ef', 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef', 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'fixed_ips': [{'subnet_id': 'c64439a7-5fd1-4867-990d-55fe8b8f1bbb'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:47:36.885771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.905700 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:36.908838 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6930214c-b6bc-4cfc-aa4a-0dde198d9d3e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5030997 Dec 21 03:47:36.938297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Request body: {'port': {'device_id': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:37.023661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.033504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.037104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.058196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 40cff15a-139d-47bc-b79f-04e33eca7b3f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:37.075319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.102979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:37.103986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.105085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] 10.222.0.31 "PUT /v2.0/ports/cd66adb7-3082-409b-aa05-c9a7248bb04b HTTP/1.1" status: 200 len: 1093 time: 2.4822831 Dec 21 03:47:37.114818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Allocated IP 19.86.0.2 (65cd0343-3e56-4d28-b026-1efe272456ef/c64439a7-5fd1-4867-990d-55fe8b8f1bbb/104843bf-4949-4494-9c96-3e0624e2bc72) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:37.116188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'tag': 'cd66adb7-3082-409b-aa05-c9a7248bb04b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:37.118546 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23" -d '{"events": [{"name": "network-changed", "server_uuid": "73db65ed-b4e5-4ea0-a124-cacdf2a7aef4", "tag": "cd66adb7-3082-409b-aa05-c9a7248bb04b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:37.135505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Pushing event updated for resources: {'Port': ['ID=48ed0705-b46c-42de-9f83-231addc73f4e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:37.215216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 40cff15a-139d-47bc-b79f-04e33eca7b3f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:37.215875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.245098 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d13d9713-4b64-462b-b6cb-c200de81c399 x-openstack-request-id: req-d13d9713-4b64-462b-b6cb-c200de81c399 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:37.245464 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "73db65ed-b4e5-4ea0-a124-cacdf2a7aef4", "tag": "cd66adb7-3082-409b-aa05-c9a7248bb04b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:37.245631 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d13d9713-4b64-462b-b6cb-c200de81c399 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:37.246037 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'tag': 'cd66adb7-3082-409b-aa05-c9a7248bb04b', 'status': 'completed', 'code': 200} Dec 21 03:47:37.406168 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.490617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:37.541137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2245f877-8d64-488f-bc12-d173f88c7450 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:37.542648 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.551416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.566099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Transition to ACTIVE for port object 2245f877-8d64-488f-bc12-d173f88c7450 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:47:37.581902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce2dfa3-40b4-48b0-a39f-284587fff2c8 service neutron] Pushing event updated for resources: {'Port': ['ID=cd66adb7-3082-409b-aa05-c9a7248bb04b,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:37.613279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Network 65cd0343-3e56-4d28-b026-1efe272456ef is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:37.620101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:37.623282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:37.634522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:37.635636 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.637254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Pushing event updated for resources: {'Port': ['ID=104843bf-4949-4494-9c96-3e0624e2bc72,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:37.676039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd299d3-2530-4cb6-9bea-ed0a63976b91 req-fe69042d-2b84-4ca5-9b5d-00d3ddea1b53 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:37.677735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abd299d3-2530-4cb6-9bea-ed0a63976b91 req-fe69042d-2b84-4ca5-9b5d-00d3ddea1b53 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.3843513 Dec 21 03:47:37.690653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fcfb17c6-eb87-4c4f-91b8-d12b30346b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:37.691607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-fcfb17c6-eb87-4c4f-91b8-d12b30346b19 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 1096 time: 0.3999543 Dec 21 03:47:37.698520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.705735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Pushing event deleted for resources: {'Port': ['ID=6db4167b-38cd-4236-9f39-55706e3db79a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:37.705735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:37.729344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Attempting to bind port 104843bf-4949-4494-9c96-3e0624e2bc72 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:37.729909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Attempting to bind port 104843bf-4949-4494-9c96-3e0624e2bc72 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:37.730246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Attempting to bind port 104843bf-4949-4494-9c96-3e0624e2bc72 on network 65cd0343-3e56-4d28-b026-1efe272456ef {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:37.737354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-ffb82ecc-3429-4054-84f9-b00158abc4ee tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:37.738050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:37.738551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Checking segment: {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:37.739052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.739523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Bound using segment: {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:37.740265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Bound port: 104843bf-4949-4494-9c96-3e0624e2bc72, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:37.740805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.746757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-ffb82ecc-3429-4054-84f9-b00158abc4ee tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:37.748475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-ffb82ecc-3429-4054-84f9-b00158abc4ee tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/networks?id=74b92324-668f-4e02-853d-3aaf26a99a26&id=65cd0343-3e56-4d28-b026-1efe272456ef HTTP/1.1" status: 200 len: 1390 time: 0.6073501 Dec 21 03:47:37.749464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:37.769941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:37.836476 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.861779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daf03416-74e5-48d2-afc8-fff4b0f2ae0d None None] Network 74b92324-668f-4e02-853d-3aaf26a99a26 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:37.883294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Attempting to bind port 2245f877-8d64-488f-bc12-d173f88c7450 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:37.883731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Attempting to bind port 2245f877-8d64-488f-bc12-d173f88c7450 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:37.884925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Attempting to bind port 2245f877-8d64-488f-bc12-d173f88c7450 on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:37.891886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-dec49ab2-cd12-4ffe-ac72-92e71286f879 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/quotas/955f4bcbbfba4ef4acf8124b0274572c HTTP/1.1" status: 200 len: 375 time: 0.0189209 Dec 21 03:47:37.892040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Port 2245f877-8d64-488f-bc12-d173f88c7450 on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:47:37.892268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Attempting to bind port 2245f877-8d64-488f-bc12-d173f88c7450 on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:37.893307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-86094c78-56c9-4c21-9126-fc18e94d150c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b HTTP/1.1" status: 200 len: 217 time: 0.1804459 Dec 21 03:47:37.900627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:37.901259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Checking segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:37.901649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Bound using segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:37.903368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Bound port: 2245f877-8d64-488f-bc12-d173f88c7450, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:37.903991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.953910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] For port 104843bf-4949-4494-9c96-3e0624e2bc72, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:37.977062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-242e5028-6540-49e2-badd-bc009b598373 None None] Provisioning complete for port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:37.977358 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-242e5028-6540-49e2-badd-bc009b598373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:37.984494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:37.989754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:38.007107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] For port 104843bf-4949-4494-9c96-3e0624e2bc72, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=104843bf-4949-4494-9c96-3e0624e2bc72,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:38.010777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:38.100573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.108728 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-242e5028-6540-49e2-badd-bc009b598373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.130296 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.132624 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.151018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:38.151946 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.153672 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] 10.222.0.31 "PUT /v2.0/ports/2245f877-8d64-488f-bc12-d173f88c7450 HTTP/1.1" status: 200 len: 1092 time: 1.2255352 Dec 21 03:47:38.154708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:38.158634 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ea24cac-62fe-468e-82b2-6e8b4117880b" -d '{"events": [{"name": "network-changed", "server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "tag": "2245f877-8d64-488f-bc12-d173f88c7450"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:38.196427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b7ae9c2-ce71-42e0-803f-e25fdab72320 service neutron] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:38.220130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-242e5028-6540-49e2-badd-bc009b598373 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:47:38.220491 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-242e5028-6540-49e2-badd-bc009b598373 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:47:38.225263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:38.311060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d14250fa-c441-4e52-80b8-a4b34fdf61a3 None None] Pushing event updated for resources: {'Port': ['ID=104843bf-4949-4494-9c96-3e0624e2bc72,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:38.357761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-98de57a8-4e7c-4c43-8c54-97ca7b9ecda7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:38.359981 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-98de57a8-4e7c-4c43-8c54-97ca7b9ecda7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 1095 time: 0.0669875 Dec 21 03:47:38.427236 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-c3f63246-fa57-4035-b635-13f15795b8d3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2245f877-8d64-488f-bc12-d173f88c7450 HTTP/1.1" status: 200 len: 217 time: 0.0452774 Dec 21 03:47:38.467508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.493305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:38.501610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abd299d3-2530-4cb6-9bea-ed0a63976b91 req-2cddfddf-a222-4f8e-ac0d-7291164686a6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8087788 Dec 21 03:47:38.526327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6488def3-084e-4b2b-bc17-8b162034a090 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:38.528914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-6488def3-084e-4b2b-bc17-8b162034a090 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.0942433 Dec 21 03:47:38.574382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Router d77e5fe8-df91-4709-bd5f-2eb276d9f270 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:47:38.577948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-f474dcd0-f5a5-4b63-a4e8-ee560597121f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:38.584578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-f474dcd0-f5a5-4b63-a4e8-ee560597121f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 200 len: 862 time: 0.6829336 Dec 21 03:47:38.585365 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-fbce7d1c-ffb5-499c-b516-943828dd4477 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0474017 Dec 21 03:47:38.671082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-19e778c6-7771-4e72-a4ac-45a8c765ec1c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&fields=id HTTP/1.1" status: 200 len: 394 time: 0.7655277 Dec 21 03:47:38.689130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 7be0b6c0-d923-4d30-8201-1599bce159fb completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:38.700894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 7be0b6c0-d923-4d30-8201-1599bce159fb triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:38.700894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.705744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-2ea90de8-a581-4b88-a98c-ee249cc8590a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0719323 Dec 21 03:47:38.714445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-9ce2be6f-fa06-4e06-a68e-97de8edc8146 service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1148372 Dec 21 03:47:38.821823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.835878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7b5b7d44-8ff9-4ca9-b30a-2a707aa51b77 req-0cb2e1d4-da0a-4aa1-8513-a24d8b31784a service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1101596 Dec 21 03:47:38.855471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:38.857812 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-317d2f70-eeb5-43a3-851a-5b7051107180" -d '{"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:38.871825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:38.901366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-81f177d4-86e5-4d88-8d7b-8d651b59c37a None None] Provisioning complete for port 48ed0705-b46c-42de-9f83-231addc73f4e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:38.901742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-81f177d4-86e5-4d88-8d7b-8d651b59c37a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.939896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-81f177d4-86e5-4d88-8d7b-8d651b59c37a None None] Port 48ed0705-b46c-42de-9f83-231addc73f4e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:38.953199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-81f177d4-86e5-4d88-8d7b-8d651b59c37a None None] Provisioning complete for port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:38.953641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-81f177d4-86e5-4d88-8d7b-8d651b59c37a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:38.981152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4186b1-c4dc-4889-a551-b8a8f72f1a97 req-72859ef3-fc95-4ea2-80d3-c1c6abc8c8f8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:38.982651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c4186b1-c4dc-4889-a551-b8a8f72f1a97 req-72859ef3-fc95-4ea2-80d3-c1c6abc8c8f8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 943 time: 0.3478870 Dec 21 03:47:39.037366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:39.098861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-007ad121-265b-4036-b556-f15b071e6905 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3667030 Dec 21 03:47:39.108200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:39.143667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 104843bf-4949-4494-9c96-3e0624e2bc72 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:39.186028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-b8eaf48a-2f76-47eb-a491-046ba01403da service neutron] 10.222.0.18 "GET /v2.0/networks/74b92324-668f-4e02-853d-3aaf26a99a26?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4575160 Dec 21 03:47:39.212474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:39.217850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f67aa900-fbe1-48db-9fca-97ec98c1ea06 admin admin] 10.222.0.18 "PUT /v2.0/routers/d77e5fe8-df91-4709-bd5f-2eb276d9f270/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.6396286 Dec 21 03:47:39.229232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 104843bf-4949-4494-9c96-3e0624e2bc72 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:39.229438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:39.232633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Sync routers for ids ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:39.256051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c4186b1-c4dc-4889-a551-b8a8f72f1a97 req-ce35ae7b-2904-49b0-b5f9-467301470533 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2615745 Dec 21 03:47:39.274526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Routers {'d77e5fe8-df91-4709-bd5f-2eb276d9f270'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:39.275375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:39.472130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Router 138198e8-cb21-4974-9773-632cfe7c78d0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:47:39.502592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eae5c6d-4a4b-493f-a128-53a0206b1346 None None] Network 65cd0343-3e56-4d28-b026-1efe272456ef requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:39.510468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-575790bb-873b-403c-8f11-34a32a46df34 service neutron] 10.222.0.18 "GET /v2.0/networks/74b92324-668f-4e02-853d-3aaf26a99a26?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3132379 Dec 21 03:47:39.523035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daab5402-f38c-46f6-bb73-e97b7af9dfd1 req-1a142a54-38a0-4fc0-b16e-9553016e2b86 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:39.525090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-daab5402-f38c-46f6-bb73-e97b7af9dfd1 req-1a142a54-38a0-4fc0-b16e-9553016e2b86 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 944 time: 0.1467390 Dec 21 03:47:39.529574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd0a8a30-17ec-49ed-a5b9-006654c52169 req-05c3ed87-47a1-4011-80e5-895fb945a31d service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3833172 Dec 21 03:47:39.647627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a0d5406f-1d40-443e-b951-32654ea211a9 None None] Provisioning complete for port 104843bf-4949-4494-9c96-3e0624e2bc72 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:39.653985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0d5406f-1d40-443e-b951-32654ea211a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:39.679861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-daab5402-f38c-46f6-bb73-e97b7af9dfd1 req-bfd66701-3c93-435c-9af5-77031883fc47 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439695 Dec 21 03:47:39.763288 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53ecd988-28f7-4b21-8d7b-e52e06ae75de x-openstack-request-id: req-53ecd988-28f7-4b21-8d7b-e52e06ae75de {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:39.763852 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "tag": "2245f877-8d64-488f-bc12-d173f88c7450", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:39.763852 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-53ecd988-28f7-4b21-8d7b-e52e06ae75de {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:39.764231 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450', 'status': 'completed', 'code': 200} Dec 21 03:47:39.780147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:39.793900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Set router d77e5fe8-df91-4709-bd5f-2eb276d9f270 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:39.869591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-6dad6c05-5fe8-4b37-90db-4645e78157ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:39.872894 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-6dad6c05-5fe8-4b37-90db-4645e78157ee service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 1095 time: 0.0491204 Dec 21 03:47:39.887131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 104843bf-4949-4494-9c96-3e0624e2bc72, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=104843bf-4949-4494-9c96-3e0624e2bc72,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:39.918752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-2d07a8d7-052a-4d36-8b3f-2ca8f57010b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:39.920941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-2d07a8d7-052a-4d36-8b3f-2ca8f57010b8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7a49d4228d05498db20fade9b7651659&device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 1096 time: 0.1760440 Dec 21 03:47:39.928167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-aaf5806c-ab37-47fd-891d-f9f60f20528c service neutron] 10.222.0.18 "GET /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3891749 Dec 21 03:47:39.933124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:39.939199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e80fe76f-cd40-466c-9e6a-11e36ea9c610 admin admin] 10.222.0.18 "PUT /v2.0/routers/138198e8-cb21-4974-9773-632cfe7c78d0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.3780293 Dec 21 03:47:39.951524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47218) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:39.954968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] Sync routers for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:39.964033 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef5f38c3-8c7a-44ae-8be4-03b1e50dd0ac x-openstack-request-id: req-ef5f38c3-8c7a-44ae-8be4-03b1e50dd0ac {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:39.964478 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:39.964746 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ef5f38c3-8c7a-44ae-8be4-03b1e50dd0ac {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:39.966404 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'code': 200} Dec 21 03:47:39.981672 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:39.982352 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:40.015741 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:40.017157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:40.113369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-1a2504db-5aac-4234-9698-44b317d92409 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:40.119696 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-1a2504db-5aac-4234-9698-44b317d92409 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 906 time: 0.2330027 Dec 21 03:47:40.195467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0d5406f-1d40-443e-b951-32654ea211a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:40.212270 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-3d944593-6831-4823-9481-a43cc4cff6ce service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2245f877-8d64-488f-bc12-d173f88c7450 HTTP/1.1" status: 200 len: 217 time: 0.0769413 Dec 21 03:47:40.249707 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:40.298591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=104843bf-4949-4494-9c96-3e0624e2bc72,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:40.317418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-2f1f4dde-078d-4322-99a5-9f525b60e16e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:40.318903 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-2f1f4dde-078d-4322-99a5-9f525b60e16e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.0903640 Dec 21 03:47:40.374549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-64999fe9-a6b0-46d2-9e5a-6927fc247d5f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0468676 Dec 21 03:47:40.376191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:40.376648 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:40.380224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-a0d5406f-1d40-443e-b951-32654ea211a9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:47:40.380481 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-a0d5406f-1d40-443e-b951-32654ea211a9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:47:40.433151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '48ed0705-b46c-42de-9f83-231addc73f4e', 'name': '', 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'mac_address': 'fa:16:3e:ed:22:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_interface', 'standard_attr_id': 680, 'fixed_ips': [{'subnet_id': '4b881d58-71d9-4f25-ae52-9da80d5e2920', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:33Z', 'updated_at': '2021-12-21T03:47:36Z', 'revision_number': 2, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'subnets': [{'id': '4b881d58-71d9-4f25-ae52-9da80d5e2920', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:40.462033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Checking router: d77e5fe8-df91-4709-bd5f-2eb276d9f270 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:40.468412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Updating router d77e5fe8-df91-4709-bd5f-2eb276d9f270 port 48ed0705-b46c-42de-9f83-231addc73f4e binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:47:40.472395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-f5a2c670-a5b2-40c8-b7b1-c6d70013dedc service neutron] 10.222.0.18 "GET /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4845388 Dec 21 03:47:40.475587 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-b6aeb1cc-3cf5-45f9-9763-765fc5bc76ad service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891345 Dec 21 03:47:40.508298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:40.524677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:40.611567 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:47:36Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:40.666487 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0ea24cac-62fe-468e-82b2-6e8b4117880b req-6b954a19-788f-4ef0-ac87-9ecfe5664bbc service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1802094 Dec 21 03:47:40.682583 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:40.685848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784fd47c-f2f7-4a2f-8426-9855006882a8 req-ddf0bc1a-4ae9-4454-8adb-eda92ad2ecf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:40.689993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-784fd47c-f2f7-4a2f-8426-9855006882a8 req-ddf0bc1a-4ae9-4454-8adb-eda92ad2ecf7 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1102 time: 0.5538313 Dec 21 03:47:40.700947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad13ec0-b845-4f65-96e8-3d69e5808689 req-4f1808f6-a10b-4a67-ae4e-24a811d65e33 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:40.703446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ad13ec0-b845-4f65-96e8-3d69e5808689 req-4f1808f6-a10b-4a67-ae4e-24a811d65e33 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.5712414 Dec 21 03:47:40.708218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-cd62e0fd-b0d6-48be-9b27-38f69010c435 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:40.710042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-cd62e0fd-b0d6-48be-9b27-38f69010c435 service neutron] 10.222.0.31 "GET /v2.0/networks?id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 200 len: 923 time: 0.7697494 Dec 21 03:47:40.762879 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] Checking router: 138198e8-cb21-4974-9773-632cfe7c78d0 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:40.776817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:40.777107 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] Routers {'138198e8-cb21-4974-9773-632cfe7c78d0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:40.779046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['138198e8-cb21-4974-9773-632cfe7c78d0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:40.808839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '2245f877-8d64-488f-bc12-d173f88c7450', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': '2245f877-8d64-488f-bc12-d173f88c7450', 'mac_address': 'fa:16:3e:86:0b:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:40.889918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-96b9cbe7-2f71-4fb8-a611-e4013141ee60 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b HTTP/1.1" status: 200 len: 217 time: 0.1258476 Dec 21 03:47:40.903211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] Set router 138198e8-cb21-4974-9773-632cfe7c78d0 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:40.993432 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.001016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 104843bf-4949-4494-9c96-3e0624e2bc72 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:41.055705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2245f877-8d64-488f-bc12-d173f88c7450 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:41.109753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:41.153172 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:47:36Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:41.183098 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b96bf7b-d235-40ec-9b6a-12597873846c None None] The sync data for ids ['138198e8-cb21-4974-9773-632cfe7c78d0'] in n-d-822053-11 is: [{'id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2117810793-router', 'tenant_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:25Z', 'updated_at': '2021-12-21T03:47:36Z', 'revision_number': 5, 'project_id': '2637e7ec4ea74cb6a3ec5d635dce4a5c', 'gw_port': {'id': '0d5c7ebe-dc41-41e7-b8b6-33a474569859', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:61:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '138198e8-cb21-4974-9773-632cfe7c78d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 46, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:26Z', 'updated_at': '2021-12-21T03:42:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:41.197709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-784fd47c-f2f7-4a2f-8426-9855006882a8 req-762ae80e-1522-41cc-ae31-2c4271109baf service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4909306 Dec 21 03:47:41.206597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 104843bf-4949-4494-9c96-3e0624e2bc72 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:41.207022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.211041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.214404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ad13ec0-b845-4f65-96e8-3d69e5808689 req-d33d074d-6d73-44a9-8b61-d61427d06587 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4864812 Dec 21 03:47:41.262770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-87ac489c-bf0a-4ead-af40-f2c6a0a7ded3 None None] Provisioning complete for port 104843bf-4949-4494-9c96-3e0624e2bc72 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:41.262770 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-87ac489c-bf0a-4ead-af40-f2c6a0a7ded3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.268456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-cdf7a117-4ab6-40da-840d-2a38d6b1e428 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:41.270303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-cdf7a117-4ab6-40da-840d-2a38d6b1e428 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 200 len: 862 time: 0.3606875 Dec 21 03:47:41.276307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.285924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.295257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f4e707-4b0b-4180-9a25-8ed81f2603b3 req-d8d1c6a7-1897-4b81-be13-fdb7c33bbdc8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:41.296737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68f4e707-4b0b-4180-9a25-8ed81f2603b3 req-d8d1c6a7-1897-4b81-be13-fdb7c33bbdc8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 943 time: 0.2201383 Dec 21 03:47:41.331296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-108b663d-8b80-40ad-9898-c625c7e09fe5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7c34a09c-fe79-4a56-ac99-3b531a9f3f91&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0313597 Dec 21 03:47:41.376815 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.396020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:41.755409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dce56f2-840d-458d-96cd-7fa0a1bad5e7 None None] Pushing event updated for resources: {'Port': ['ID=48ed0705-b46c-42de-9f83-231addc73f4e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:41.815462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Attempting to bind port 48ed0705-b46c-42de-9f83-231addc73f4e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:41.815925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Attempting to bind port 48ed0705-b46c-42de-9f83-231addc73f4e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:41.816397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Attempting to bind port 48ed0705-b46c-42de-9f83-231addc73f4e on network db71f3b3-7195-4c4a-b30b-67dc14f350a1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:41.824037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:41.824828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Checking segment: {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:41.825638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.826189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Bound using segment: {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:41.826874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Bound port: 48ed0705-b46c-42de-9f83-231addc73f4e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9cac79f9-2a11-44fa-be96-df9a5374778e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:41.827969 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:41.908078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['2245f877-8d64-488f-bc12-d173f88c7450'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:42.038760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] For port 48ed0705-b46c-42de-9f83-231addc73f4e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:42.038760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] For port 48ed0705-b46c-42de-9f83-231addc73f4e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=48ed0705-b46c-42de-9f83-231addc73f4e,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:42.038760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-26d587ac-2355-46e9-aa57-784d6f7db3e6 None None] Provisioning complete for port 48ed0705-b46c-42de-9f83-231addc73f4e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:42.038760 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26d587ac-2355-46e9-aa57-784d6f7db3e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.041791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68f4e707-4b0b-4180-9a25-8ed81f2603b3 req-7960aeb0-32d5-401b-8754-835c05a44c48 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6687346 Dec 21 03:47:42.041791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314542a7-0f63-431c-8e4a-be3bd8b01dfc req-b6a6aa71-4968-4f51-a851-9b6d1b4af068 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:42.041791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-314542a7-0f63-431c-8e4a-be3bd8b01dfc req-b6a6aa71-4968-4f51-a851-9b6d1b4af068 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 944 time: 0.7181447 Dec 21 03:47:42.043946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-26d587ac-2355-46e9-aa57-784d6f7db3e6 None None] Port 48ed0705-b46c-42de-9f83-231addc73f4e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:42.065528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-f9345725-53f7-4cb1-bb50-475ae11fc87f service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7168231 Dec 21 03:47:42.130074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33509526-4d95-4a7e-aeb4-341524346438 req-38d1100d-fb9a-4a5e-8052-a3e1c0ebb7d6 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 210 time: 0.0612414 Dec 21 03:47:42.150609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Deleting port 0d5c7ebe-dc41-41e7-b8b6-33a474569859 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:42.150978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.250015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-314542a7-0f63-431c-8e4a-be3bd8b01dfc req-4ba47e91-a80f-412e-8f67-97ec9f71df40 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2134852 Dec 21 03:47:42.311705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.315091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] For port 0d5c7ebe-dc41-41e7-b8b6-33a474569859, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0d5c7ebe-dc41-41e7-b8b6-33a474569859,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:42.315562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.337608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d5c35d6-fc0d-49b0-9e17-3de463ff0e23 req-7bcdcc5a-87b8-4da6-9b06-181ea5983176 service neutron] 10.222.0.31 "GET /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2504950 Dec 21 03:47:42.372922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Calling delete_port for 0d5c7ebe-dc41-41e7-b8b6-33a474569859 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:42.417079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Routers {'d77e5fe8-df91-4709-bd5f-2eb276d9f270'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:42.417719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:42.472865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dce56f2-840d-458d-96cd-7fa0a1bad5e7 None None] Pushing event updated for resources: {'Port': ['ID=48ed0705-b46c-42de-9f83-231addc73f4e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:42.519387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd66adb7-3082-409b-aa05-c9a7248bb04b details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:42.543397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8804aa1-e519-43a5-8190-fc7664032f55 req-3b6a68c7-4a82-4ef6-b858-5d7d1d549c92 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:42.545197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8804aa1-e519-43a5-8190-fc7664032f55 req-3b6a68c7-4a82-4ef6-b858-5d7d1d549c92 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.2377827 Dec 21 03:47:42.562857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] Set router d77e5fe8-df91-4709-bd5f-2eb276d9f270 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:42.687505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8804aa1-e519-43a5-8190-fc7664032f55 req-da675f29-415e-456b-acf9-d6b7d231d6d5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302414 Dec 21 03:47:42.793339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cd66adb7-3082-409b-aa05-c9a7248bb04b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:42.798235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.820082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'cd66adb7-3082-409b-aa05-c9a7248bb04b', 'network_id': '7c34a09c-fe79-4a56-ac99-3b531a9f3f91', 'port_id': 'cd66adb7-3082-409b-aa05-c9a7248bb04b', 'mac_address': 'fa:16:3e:bc:f1:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 113, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec8e3a7f-1bef-41ac-8b72-508d262fe30c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:42.830133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-13f0baa6-43b8-41f9-9720-a53ae5ece188 None None] Provisioning complete for port 48ed0705-b46c-42de-9f83-231addc73f4e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:42.830345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Pushing event deleted for resources: {'Port': ['ID=0d5c7ebe-dc41-41e7-b8b6-33a474569859,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:42.834333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13f0baa6-43b8-41f9-9720-a53ae5ece188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.876605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.876988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.877343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.877687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.878032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.878363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.878695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.879048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.879383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.879710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.880439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.880573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.880849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:47:42.884938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db4167b-38cd-4236-9f39-55706e3db79a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:42.908417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:42.974545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6db4167b-38cd-4236-9f39-55706e3db79a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:42.974896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db4167b-38cd-4236-9f39-55706e3db79a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:42.985959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.022147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cd66adb7-3082-409b-aa05-c9a7248bb04b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:43.025054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.027538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.074395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cd66adb7-3082-409b-aa05-c9a7248bb04b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:43.098094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '48ed0705-b46c-42de-9f83-231addc73f4e', 'name': '', 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'mac_address': 'fa:16:3e:ed:22:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_interface', 'standard_attr_id': 680, 'fixed_ips': [{'subnet_id': '4b881d58-71d9-4f25-ae52-9da80d5e2920', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:33Z', 'updated_at': '2021-12-21T03:47:41Z', 'revision_number': 4, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'subnets': [{'id': '4b881d58-71d9-4f25-ae52-9da80d5e2920', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:43.102607 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13f0baa6-43b8-41f9-9720-a53ae5ece188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.133896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbcc9353-2d37-48ea-be4c-5babfba295b4 None None] The sync data for ids ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'] in n-d-822053-11 is: [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '48ed0705-b46c-42de-9f83-231addc73f4e', 'name': '', 'network_id': 'db71f3b3-7195-4c4a-b30b-67dc14f350a1', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'mac_address': 'fa:16:3e:ed:22:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_interface', 'standard_attr_id': 680, 'fixed_ips': [{'subnet_id': '4b881d58-71d9-4f25-ae52-9da80d5e2920', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:33Z', 'updated_at': '2021-12-21T03:47:41Z', 'revision_number': 4, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'subnets': [{'id': '4b881d58-71d9-4f25-ae52-9da80d5e2920', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:43.194798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43f27fa-3eba-4be0-81e8-05eb2956c0f7 req-2bc87c24-6de2-42ad-a41b-73c3e34fad22 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:43.199897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-13f0baa6-43b8-41f9-9720-a53ae5ece188 None None] For port 48ed0705-b46c-42de-9f83-231addc73f4e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=48ed0705-b46c-42de-9f83-231addc73f4e,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:43.203845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d43f27fa-3eba-4be0-81e8-05eb2956c0f7 req-2bc87c24-6de2-42ad-a41b-73c3e34fad22 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 944 time: 0.1005435 Dec 21 03:47:43.236928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.320306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=cd66adb7-3082-409b-aa05-c9a7248bb04b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:43.334126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.334313 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13f0baa6-43b8-41f9-9720-a53ae5ece188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.335103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 138198e8-cb21-4974-9773-632cfe7c78d0 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:47:43.350819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc04c496-7231-496e-8930-8597fa8f7d34 req-77a6d608-036a-4ec0-b858-31f2c7252843 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 210 time: 0.0745416 Dec 21 03:47:43.355820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.357098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4b600d6b-b0cd-4c66-b436-8820123e76ae admin admin] 10.222.0.18 "DELETE /v2.0/routers/138198e8-cb21-4974-9773-632cfe7c78d0 HTTP/1.1" status: 204 len: 168 time: 3.4034832 Dec 21 03:47:43.361022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:43.364880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d43f27fa-3eba-4be0-81e8-05eb2956c0f7 req-56d3d3f5-8960-4f44-bafa-db0df1734ef5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601942 Dec 21 03:47:43.462370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f0baa6-43b8-41f9-9720-a53ae5ece188 None None] Pushing event updated for resources: {'Port': ['ID=48ed0705-b46c-42de-9f83-231addc73f4e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:43.463335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Deleting subnet 8ca201b9-7506-4b6b-8a03-05d4689a5e59 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:47:43.489716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.543875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d68aa96-5df6-4f30-8ac8-fef050c3336b req-ccc1b50f-69bb-4ab3-b896-dbcc51af410d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:43.550607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d68aa96-5df6-4f30-8ac8-fef050c3336b req-ccc1b50f-69bb-4ab3-b896-dbcc51af410d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 945 time: 0.0648508 Dec 21 03:47:43.573439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.635202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d68aa96-5df6-4f30-8ac8-fef050c3336b req-a0d84801-a332-4035-b0f8-734eab7c2d7e tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708618 Dec 21 03:47:43.646143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['cd66adb7-3082-409b-aa05-c9a7248bb04b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:43.692523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.850161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f70ff4-409a-4d93-ab67-682a91d9b932 req-3680a125-83d1-4d9f-aaf9-cd8f0023d402 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:43.851789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1f70ff4-409a-4d93-ab67-682a91d9b932 req-3680a125-83d1-4d9f-aaf9-cd8f0023d402 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.0579488 Dec 21 03:47:43.862594 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.883600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8ca201b9-7506-4b6b-8a03-05d4689a5e59,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:43.891724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:43.893420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-97ef7554-3405-42c4-88be-ec68eb3d83f6 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/8ca201b9-7506-4b6b-8a03-05d4689a5e59 HTTP/1.1" status: 204 len: 168 time: 0.5313828 Dec 21 03:47:43.895937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47300) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:43.899306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-290c84bd-eacd-4da8-bf17-50a4436fbb4b None None] Network 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:43.942136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1f70ff4-409a-4d93-ab67-682a91d9b932 req-66c98b48-8569-4799-9a52-4c9ef6840cb6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830350 Dec 21 03:47:44.062309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.146126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Deleting port e76cb2bf-a660-4015-b282-3705d7707d77 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:44.146464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.146926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] DHCP port deletion for 97e3dbcb-7ac2-4207-82ae-df7e1df411c2 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:47:44.191713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ae3644-2cc0-417a-8998-68f6e7f458ca req-371ba9c5-2377-443d-84c2-ab4655c8321b tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:44.198277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75ae3644-2cc0-417a-8998-68f6e7f458ca req-371ba9c5-2377-443d-84c2-ab4655c8321b tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1102 time: 0.1120701 Dec 21 03:47:44.220050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] Deleting port e76cb2bf-a660-4015-b282-3705d7707d77 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:44.220430 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.229450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] For port e76cb2bf-a660-4015-b282-3705d7707d77, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e76cb2bf-a660-4015-b282-3705d7707d77,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:44.230758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.251206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Calling delete_port for e76cb2bf-a660-4015-b282-3705d7707d77 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:44.393570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75ae3644-2cc0-417a-8998-68f6e7f458ca req-27a87120-19f0-4cd3-9058-d690a10a869f tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1506209 Dec 21 03:47:44.468806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] For port e76cb2bf-a660-4015-b282-3705d7707d77, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e76cb2bf-a660-4015-b282-3705d7707d77,segment=NetworkSegment(cf58b462-5a49-4e04-8d36-e96ea1fa5db5),segment_id=cf58b462-5a49-4e04-8d36-e96ea1fa5db5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:44.471586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.473562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-205fc6c7-7f35-4217-bec4-d497ba696d43 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:44.481637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-205fc6c7-7f35-4217-bec4-d497ba696d43 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:44.483417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-205fc6c7-7f35-4217-bec4-d497ba696d43 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.54 "GET /v2.0/networks?id=74b92324-668f-4e02-853d-3aaf26a99a26&id=65cd0343-3e56-4d28-b026-1efe272456ef HTTP/1.1" status: 200 len: 1390 time: 0.2031851 Dec 21 03:47:44.485980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] Calling delete_port for e76cb2bf-a660-4015-b282-3705d7707d77 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:44.509500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.530081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'port': {'device_id': 'a664715e-9689-471e-b499-cee0814f76ef', 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26', 'admin_state_up': True, 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:44.538078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dd084fd-b239-4ead-bd2f-f77a726f3155 req-72d548a0-047d-4b3a-8f3c-54d7771b2c5c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 210 time: 0.0519373 Dec 21 03:47:44.574281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:44.586978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Pushing event deleted for resources: {'Port': ['ID=e76cb2bf-a660-4015-b282-3705d7707d77,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:44.591651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] No DVR routers for this DVR port e76cb2bf-a660-4015-b282-3705d7707d77 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:44.740838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026d0f25-1a1b-4d54-a54b-d5cba9f0ef4f req-b437ba23-8713-4376-9c6c-2eeb9e60ab91 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:44.743020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-026d0f25-1a1b-4d54-a54b-d5cba9f0ef4f req-b437ba23-8713-4376-9c6c-2eeb9e60ab91 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 944 time: 0.2195048 Dec 21 03:47:44.802174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.804099 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.842087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['97e3dbcb-7ac2-4207-82ae-df7e1df411c2']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:44.845349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] No DVR routers for this DVR port e76cb2bf-a660-4015-b282-3705d7707d77 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:44.861474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:44.861741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf58b462-5a49-4e04-8d36-e96ea1fa5db5') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:44.883253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.923813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-026d0f25-1a1b-4d54-a54b-d5cba9f0ef4f req-0018fcf1-fc19-4894-bec9-d27769d4d589 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440768 Dec 21 03:47:44.926254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.935137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:47:44.935568 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:44.935893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf90e72-d3d0-425f-81f4-b63587e5b540 None None] Pushing event deleted for resources: {'Port': ['ID=e76cb2bf-a660-4015-b282-3705d7707d77,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:47:44.937392 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:47:44.941362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 2245f877-8d64-488f-bc12-d173f88c7450 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:44.974443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 2245f877-8d64-488f-bc12-d173f88c7450 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:44.974921 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.065448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:45.071729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.082836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.089113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.101314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47322) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:45.103296 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] 10.222.0.18 "DELETE /v2.0/networks/97e3dbcb-7ac2-4207-82ae-df7e1df411c2 HTTP/1.1" status: 204 len: 168 time: 1.2047689 Dec 21 03:47:45.152867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df13a7c8-c568-464f-8499-7d5d273b3277 admin admin] Pushing event deleted for resources: {'Network': ['ID=97e3dbcb-7ac2-4207-82ae-df7e1df411c2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:45.210198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 48ed0705-b46c-42de-9f83-231addc73f4e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:45.289157 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.329970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:45.333647 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f91a79d-5356-4288-9b7d-3fcec6f4b5b3" -d '{"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-plugged", "status": "completed", "tag": "2245f877-8d64-488f-bc12-d173f88c7450"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:45.340917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:45.352793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 48ed0705-b46c-42de-9f83-231addc73f4e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:45.353198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.425034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894b87cc-a097-4ff0-8426-f448ed9477e1 req-db3c5f85-4d54-4f77-924a-1f87c9019b61 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:45.427399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-894b87cc-a097-4ff0-8426-f448ed9477e1 req-db3c5f85-4d54-4f77-924a-1f87c9019b61 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1507468 Dec 21 03:47:45.493303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c83d273-e314-48e6-9431-7f44124af2dc req-bd6185b6-19a4-4705-9a2c-2a3128a39eb6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:45.497101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c83d273-e314-48e6-9431-7f44124af2dc req-bd6185b6-19a4-4705-9a2c-2a3128a39eb6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 945 time: 0.2101593 Dec 21 03:47:45.517372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-7369cc6b-5ed0-4b0a-880f-d76ffe72b8a1 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0493512 Dec 21 03:47:45.525138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0d5c7ebe-dc41-41e7-b8b6-33a474569859 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:45.530049 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:45.666081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Allocated IP 19.80.0.27 (74b92324-668f-4e02-853d-3aaf26a99a26/90423e11-83e3-4a02-8325-6b52e25ac647/aebb91e6-09ee-4d92-866b-c742bc0012b3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:45.677625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-894b87cc-a097-4ff0-8426-f448ed9477e1 req-7f38dfa6-a962-4152-823b-6899a60cad60 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2162840 Dec 21 03:47:45.704830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c83d273-e314-48e6-9431-7f44124af2dc req-403bab31-c527-4c85-87a7-6fa293d8df12 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1826198 Dec 21 03:47:45.706669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 0d5c7ebe-dc41-41e7-b8b6-33a474569859 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:45.707117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0d5c7ebe-dc41-41e7-b8b6-33a474569859 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:45.707661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e76cb2bf-a660-4015-b282-3705d7707d77 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:45.752497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e76cb2bf-a660-4015-b282-3705d7707d77 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:45.752940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e76cb2bf-a660-4015-b282-3705d7707d77 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:45.773675 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-87b176a3-fa67-450c-9727-14dd3f1f58b5 x-openstack-request-id: req-87b176a3-fa67-450c-9727-14dd3f1f58b5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:45.774034 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-plugged", "status": "completed", "tag": "2245f877-8d64-488f-bc12-d173f88c7450", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:45.774402 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-87b176a3-fa67-450c-9727-14dd3f1f58b5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:45.774869 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450', 'code': 200} Dec 21 03:47:45.825542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:45.960451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ec3fb57-1f0e-4fd4-afea-2584c87b9177 req-227786e5-c254-4acf-97e9-32d5be75a464 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 210 time: 0.0645933 Dec 21 03:47:46.064833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f560584-d476-447f-9578-215da69040a1 req-f01aa831-03b7-4618-8a02-cb96c070d9a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:46.066447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f560584-d476-447f-9578-215da69040a1 req-f01aa831-03b7-4618-8a02-cb96c070d9a1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 1097 time: 0.1683054 Dec 21 03:47:46.088463 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.164006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c85aec-aceb-4036-a836-edd61a0d4807 req-2187f377-2508-436d-a484-38a716670981 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:46.165514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c85aec-aceb-4036-a836-edd61a0d4807 req-2187f377-2508-436d-a484-38a716670981 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 945 time: 0.1354032 Dec 21 03:47:46.217470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f560584-d476-447f-9578-215da69040a1 req-0a5e831d-7bcb-40eb-a52e-4dba19d5a5d5 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1270003 Dec 21 03:47:46.259560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c85aec-aceb-4036-a836-edd61a0d4807 req-147bf182-0138-4aa5-8245-f14d495a8aad tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723276 Dec 21 03:47:46.270855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.318772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.410041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 74b92324-668f-4e02-853d-3aaf26a99a26 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:46.412379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Port': ['ID=aebb91e6-09ee-4d92-866b-c742bc0012b3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:46.416903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:46.421220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:46.527739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd66adb7-3082-409b-aa05-c9a7248bb04b up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:46.533607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:46.534341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.630333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-c8831bb3-5879-4a8d-aeef-51e7b7b3b852 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1045516 Dec 21 03:47:46.664152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Request body: {'port': {'device_id': 'a664715e-9689-471e-b499-cee0814f76ef', 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef', 'admin_state_up': True, 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:46.717506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port cd66adb7-3082-409b-aa05-c9a7248bb04b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:47:46.723519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port cd66adb7-3082-409b-aa05-c9a7248bb04b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:46.724007 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.787563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Deleting port a084ed55-6630-433c-8054-e4311f90873e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:46.787937 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.801799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dad7806-df48-481e-bbff-993b860f4a40 None None] Provisioning complete for port aebb91e6-09ee-4d92-866b-c742bc0012b3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:46.806188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dad7806-df48-481e-bbff-993b860f4a40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.901838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dad7806-df48-481e-bbff-993b860f4a40 None None] Port aebb91e6-09ee-4d92-866b-c742bc0012b3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:46.925006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:46.958218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075a9878-d20c-46cf-b5a5-06de56c9cb1b req-f3f73c0d-5ea5-40bf-8fd8-915e292179ee tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:46.959764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-075a9878-d20c-46cf-b5a5-06de56c9cb1b req-f3f73c0d-5ea5-40bf-8fd8-915e292179ee tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1839473 Dec 21 03:47:46.994538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] For port a084ed55-6630-433c-8054-e4311f90873e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a084ed55-6630-433c-8054-e4311f90873e,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:46.994757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:47.018056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70dc30dd-523c-4e76-8a7c-243f57df8df9 req-a8512486-d31b-410e-8ab2-e85f65b8cf1d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:47.019604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70dc30dd-523c-4e76-8a7c-243f57df8df9 req-a8512486-d31b-410e-8ab2-e85f65b8cf1d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 945 time: 0.1357150 Dec 21 03:47:47.027114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cd66adb7-3082-409b-aa05-c9a7248bb04b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:47.037975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Calling delete_port for a084ed55-6630-433c-8054-e4311f90873e owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:47.110619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-075a9878-d20c-46cf-b5a5-06de56c9cb1b req-5cd5b760-9ce3-44ea-903e-d6e23d30a4ce tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1392851 Dec 21 03:47:47.118638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Made reservation on behalf of 955f4bcbbfba4ef4acf8124b0274572c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:47:47.122181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:47.154223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:47.169142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70dc30dd-523c-4e76-8a7c-243f57df8df9 req-53ec22b5-165f-4397-8a3b-ed1cd59df7bf tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323688 Dec 21 03:47:47.237617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=cd66adb7-3082-409b-aa05-c9a7248bb04b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:47.735488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58eca4bc-8a63-4d01-b0db-623962a7ec8b req-3aea2d35-400a-4bf1-a92b-b7c6a5565f4c tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:47.737050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58eca4bc-8a63-4d01-b0db-623962a7ec8b req-3aea2d35-400a-4bf1-a92b-b7c6a5565f4c tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 945 time: 0.1643107 Dec 21 03:47:47.754890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34d4d60-71fc-4804-b233-aa05077cee4c req-d8cfbef9-5839-48bb-8d35-6a11e22bb8e8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:47.761456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c34d4d60-71fc-4804-b233-aa05077cee4c req-d8cfbef9-5839-48bb-8d35-6a11e22bb8e8 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 931 time: 0.1824539 Dec 21 03:47:47.770168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Allocated IP 19.86.0.138 (65cd0343-3e56-4d28-b026-1efe272456ef/c64439a7-5fd1-4867-990d-55fe8b8f1bbb/47c47db1-99b2-46c2-8459-be68d32f368f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:47:47.775805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd66adb7-3082-409b-aa05-c9a7248bb04b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:47.782112 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82867ce0-516d-441e-9144-c45b15644bff" -d '{"events": [{"server_uuid": "73db65ed-b4e5-4ea0-a124-cacdf2a7aef4", "name": "network-vif-plugged", "status": "completed", "tag": "cd66adb7-3082-409b-aa05-c9a7248bb04b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:47.899092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58eca4bc-8a63-4d01-b0db-623962a7ec8b req-c3abe459-9465-4ce9-9d25-c064610bc730 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543775 Dec 21 03:47:47.918418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c34d4d60-71fc-4804-b233-aa05077cee4c req-c279bb87-a465-4c36-80a8-14661325af86 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1459234 Dec 21 03:47:47.947719 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15155228-25ec-4e02-9656-93d4ddc07e57 x-openstack-request-id: req-15155228-25ec-4e02-9656-93d4ddc07e57 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:47.948016 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73db65ed-b4e5-4ea0-a124-cacdf2a7aef4", "name": "network-vif-plugged", "status": "completed", "tag": "cd66adb7-3082-409b-aa05-c9a7248bb04b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:47.948280 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-15155228-25ec-4e02-9656-93d4ddc07e57 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:47.948738 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd66adb7-3082-409b-aa05-c9a7248bb04b', 'code': 200} Dec 21 03:47:48.028734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:48.089498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:48.091426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Pushing event deleted for resources: {'Port': ['ID=a084ed55-6630-433c-8054-e4311f90873e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:48.312936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a465757-4861-426b-9959-89c9196b23d2 req-a4d71cce-605d-4c9f-8097-b8ea4b17a806 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:48.314317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a465757-4861-426b-9959-89c9196b23d2 req-a4d71cce-605d-4c9f-8097-b8ea4b17a806 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 1098 time: 0.2356231 Dec 21 03:47:48.335268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:48.436122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57145b3-6e4e-41bd-b9b2-4777f68c5792 req-003a488c-8f2f-42a8-bc74-68a06629b034 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:48.437634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b57145b3-6e4e-41bd-b9b2-4777f68c5792 req-003a488c-8f2f-42a8-bc74-68a06629b034 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.2321858 Dec 21 03:47:48.479457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Network 65cd0343-3e56-4d28-b026-1efe272456ef is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:47:48.506710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:47:48.512717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event updated for resources: {'Port': ['ID=47c47db1-99b2-46c2-8459-be68d32f368f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:48.522789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafa8a07-8e7a-4a0d-aa3c-f8321872b92d req-56cf3c62-19a0-4bd6-b9b9-80beab9497bd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:48.531222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eafa8a07-8e7a-4a0d-aa3c-f8321872b92d req-56cf3c62-19a0-4bd6-b9b9-80beab9497bd tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 946 time: 0.2493258 Dec 21 03:47:48.535361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:48.547178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:47:48.568270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a465757-4861-426b-9959-89c9196b23d2 req-f3ce4529-7fc5-47a4-a060-2eccc80650da service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2344179 Dec 21 03:47:48.700901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b57145b3-6e4e-41bd-b9b2-4777f68c5792 req-5902b530-980d-44a5-96f9-875dc4af2741 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2532406 Dec 21 03:47:48.719907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:48.721029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:48.737592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eafa8a07-8e7a-4a0d-aa3c-f8321872b92d req-add29c32-87d1-461d-9e46-f6c9cf7d583b tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2049007 Dec 21 03:47:48.859338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1e06486b-e73f-46c9-a04e-f07337d3b9c4 None None] Provisioning complete for port 47c47db1-99b2-46c2-8459-be68d32f368f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:48.859979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e06486b-e73f-46c9-a04e-f07337d3b9c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:48.861741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-3e93d452-77f3-4a6d-9383-229dcdba9c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:48.863849 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-3e93d452-77f3-4a6d-9383-229dcdba9c2b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1102 time: 0.1569705 Dec 21 03:47:48.874445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-783972df-22a3-4ad4-b705-c85d4baca3f0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2147782 Dec 21 03:47:48.898861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Request body: {'port': {'device_id': 'a664715e-9689-471e-b499-cee0814f76ef', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:48.930321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1e06486b-e73f-46c9-a04e-f07337d3b9c4 None None] Port 47c47db1-99b2-46c2-8459-be68d32f368f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:47:48.996518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-8e2ff71f-ce8f-4965-9b8a-1edc7d5b9ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:48.998225 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-8e2ff71f-ce8f-4965-9b8a-1edc7d5b9ac3 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1259723 Dec 21 03:47:49.049807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:49.065066 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-11848660-4f6d-43cd-a102-d6ded7a6433a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0517752 Dec 21 03:47:49.092377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Router 02bebca8-a642-41be-a94c-12fbc201788d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:47:49.120924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-b0fd625c-9c0d-4fda-8aec-9b758ecda261 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:49.122898 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-b0fd625c-9c0d-4fda-8aec-9b758ecda261 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0538754 Dec 21 03:47:49.129205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f88464e-947e-432a-b861-52df6217680b req-1c03f25d-aca0-4a70-9205-99b19f22c1bf tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:49.130704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f88464e-947e-432a-b861-52df6217680b req-1c03f25d-aca0-4a70-9205-99b19f22c1bf tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 945 time: 0.1393099 Dec 21 03:47:49.178119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-7563c536-697f-4a3d-abfe-66ea8fa77217 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:49.179668 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-7563c536-697f-4a3d-abfe-66ea8fa77217 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0419931 Dec 21 03:47:49.194003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e852d99d-79c4-4aba-bc08-c0517da5f563 req-6f136da4-cbca-4782-b5f8-227c217f954e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:49.200528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e852d99d-79c4-4aba-bc08-c0517da5f563 req-6f136da4-cbca-4782-b5f8-227c217f954e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:49.202147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e852d99d-79c4-4aba-bc08-c0517da5f563 req-6f136da4-cbca-4782-b5f8-227c217f954e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1654 time: 0.1682673 Dec 21 03:47:49.297877 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-2e122ae5-dfe7-439c-8274-fa86f39220a8 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077292 Dec 21 03:47:49.362722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f88464e-947e-432a-b861-52df6217680b req-b151be3a-7083-48c0-ad1f-0233104e3e25 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2251527 Dec 21 03:47:49.406044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-d2bc9d8b-87ea-436f-8100-2c5f61719ebf service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0996678 Dec 21 03:47:49.494032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e852d99d-79c4-4aba-bc08-c0517da5f563 req-8e79a282-08cb-4a81-86b8-38c161a00836 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2335181 Dec 21 03:47:49.505052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:47:49.513582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-533ff672-3839-474a-a1c3-da36f82d2b11 admin admin] 10.222.0.18 "PUT /v2.0/routers/02bebca8-a642-41be-a94c-12fbc201788d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4086933 Dec 21 03:47:49.514029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47400) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:49.522914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] Sync routers for ids ['02bebca8-a642-41be-a94c-12fbc201788d'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:47:49.535246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] Routers {'02bebca8-a642-41be-a94c-12fbc201788d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:49.548174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['02bebca8-a642-41be-a94c-12fbc201788d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:49.616948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aebb91e6-09ee-4d92-866b-c742bc0012b3 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:49.643310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:49.670620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Transition to ACTIVE for port object aebb91e6-09ee-4d92-866b-c742bc0012b3 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:47:49.780757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] Set router 02bebca8-a642-41be-a94c-12fbc201788d gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:49.795030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:49.865521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40153a8a-6293-4dce-bea8-2983993cf70e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:49.960838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Pushing event updated for resources: {'Port': ['ID=aebb91e6-09ee-4d92-866b-c742bc0012b3,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:50.079627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Attempting to bind port aebb91e6-09ee-4d92-866b-c742bc0012b3 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:50.080004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Attempting to bind port aebb91e6-09ee-4d92-866b-c742bc0012b3 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:50.080307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Attempting to bind port aebb91e6-09ee-4d92-866b-c742bc0012b3 on network 74b92324-668f-4e02-853d-3aaf26a99a26 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:50.093979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808d0c16-c347-491b-b183-36539f6f9580 req-06424804-1023-4472-b241-5b3694ebbb1e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.100704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:47:47Z', 'revision_number': 5, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:50.103536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-808d0c16-c347-491b-b183-36539f6f9580 req-06424804-1023-4472-b241-5b3694ebbb1e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 945 time: 0.2454343 Dec 21 03:47:50.129471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] Checking router: 02bebca8-a642-41be-a94c-12fbc201788d for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:47:50.138699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] Routers {'02bebca8-a642-41be-a94c-12fbc201788d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:47:50.139429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:47:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['02bebca8-a642-41be-a94c-12fbc201788d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:50.145187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Port aebb91e6-09ee-4d92-866b-c742bc0012b3 on network 74b92324-668f-4e02-853d-3aaf26a99a26 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:47:50.153113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Attempting to bind port aebb91e6-09ee-4d92-866b-c742bc0012b3 on network 74b92324-668f-4e02-853d-3aaf26a99a26 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:50.182548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.188357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:50.190693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Checking segment: {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:50.191125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Bound using segment: {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:50.191833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Bound port: aebb91e6-09ee-4d92-866b-c742bc0012b3, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2422dd6d-5de4-4305-9d41-4b5afbffe8bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:50.192262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.229807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c923daff-9d9c-402a-8ce7-257390e9ffb2 req-73432c61-eaf7-4a20-8cbe-3b381b89c25d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.231279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c923daff-9d9c-402a-8ce7-257390e9ffb2 req-73432c61-eaf7-4a20-8cbe-3b381b89c25d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.3720798 Dec 21 03:47:50.312073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.324458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] Set router 02bebca8-a642-41be-a94c-12fbc201788d gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:47:50.334971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-808d0c16-c347-491b-b183-36539f6f9580 req-819e30cb-f7fa-4742-9be3-42a5fa290c7b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2283156 Dec 21 03:47:50.354217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] For port aebb91e6-09ee-4d92-866b-c742bc0012b3, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:50.359801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] For port aebb91e6-09ee-4d92-866b-c742bc0012b3, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aebb91e6-09ee-4d92-866b-c742bc0012b3,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:50.387581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c923daff-9d9c-402a-8ce7-257390e9ffb2 req-3140d5e4-8366-4726-ab9d-05f21506d53a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337240 Dec 21 03:47:50.461096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521b3bec-0e7b-41d8-b114-f7fd0c6c0723 req-a860d429-e401-4cb5-a8fa-7685f403f659 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.462640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-521b3bec-0e7b-41d8-b114-f7fd0c6c0723 req-a860d429-e401-4cb5-a8fa-7685f403f659 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 946 time: 0.0579312 Dec 21 03:47:50.544081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.549936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Deleting port 9d92d017-b049-4dba-8eef-81a84567d3c0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:50.550743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.604767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:47:47Z', 'revision_number': 5, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:50.652958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] For port 9d92d017-b049-4dba-8eef-81a84567d3c0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9d92d017-b049-4dba-8eef-81a84567d3c0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:50.653265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.653742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.654363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.655767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] 10.222.0.54 "PUT /v2.0/ports/aebb91e6-09ee-4d92-866b-c742bc0012b3 HTTP/1.1" status: 200 len: 1092 time: 1.7619431 Dec 21 03:47:50.656262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd6cc3d7-ad75-4962-a007-089eda71a856 None None] The sync data for ids ['02bebca8-a642-41be-a94c-12fbc201788d'] in n-d-822053-11 is: [{'id': '02bebca8-a642-41be-a94c-12fbc201788d', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-1156957583-router', 'tenant_id': '0432748fee1345f888406a94a41fcadb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154'}], 'enable_snat': True}, 'gw_port_id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:42:36Z', 'updated_at': '2021-12-21T03:47:47Z', 'revision_number': 5, 'project_id': '0432748fee1345f888406a94a41fcadb', 'gw_port': {'id': '9d92d017-b049-4dba-8eef-81a84567d3c0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bebca8-a642-41be-a94c-12fbc201788d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:42:37Z', 'updated_at': '2021-12-21T03:42:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:47:50.661099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'tag': 'aebb91e6-09ee-4d92-866b-c742bc0012b3'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:50.667370 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f" -d '{"events": [{"name": "network-changed", "server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "tag": "aebb91e6-09ee-4d92-866b-c742bc0012b3"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:50.669640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Calling delete_port for 9d92d017-b049-4dba-8eef-81a84567d3c0 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:50.674238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-521b3bec-0e7b-41d8-b114-f7fd0c6c0723 req-3ede8db0-350d-448a-8616-0ab25340dcf0 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1992710 Dec 21 03:47:50.734147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1634817f-b7fd-44ca-9325-0597ef03ae1b service neutron] Pushing event updated for resources: {'Port': ['ID=aebb91e6-09ee-4d92-866b-c742bc0012b3,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.779770 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:47:50.783266 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:47:50.784098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc90c63c-08b0-4989-9c03-9db83b59ed84 req-ff0e9794-e473-4894-9c7b-347a48cf2c26 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.801173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc90c63c-08b0-4989-9c03-9db83b59ed84 req-ff0e9794-e473-4894-9c7b-347a48cf2c26 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.805616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc90c63c-08b0-4989-9c03-9db83b59ed84 req-ff0e9794-e473-4894-9c7b-347a48cf2c26 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1666 time: 0.2094767 Dec 21 03:47:50.810911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Request body: {'port': {'device_id': 'a664715e-9689-471e-b499-cee0814f76ef', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:47:50.819712 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf4fe7a0-1c32-4d91-9d95-63b40fa597e0 x-openstack-request-id: req-bf4fe7a0-1c32-4d91-9d95-63b40fa597e0 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:50.824538 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "tag": "aebb91e6-09ee-4d92-866b-c742bc0012b3", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:50.824538 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bf4fe7a0-1c32-4d91-9d95-63b40fa597e0 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:50.824538 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'tag': 'aebb91e6-09ee-4d92-866b-c742bc0012b3', 'status': 'completed', 'code': 200} Dec 21 03:47:50.948328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-6a363693-4809-469b-a634-dc910412f3fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.948803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-6a363693-4809-469b-a634-dc910412f3fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:50.950400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-6a363693-4809-469b-a634-dc910412f3fd service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1914 time: 0.1017880 Dec 21 03:47:50.960948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:50.978825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc90c63c-08b0-4989-9c03-9db83b59ed84 req-d31344d8-9143-41ab-ac40-264a4cb06fa3 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1732273 Dec 21 03:47:51.045442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a084ed55-6630-433c-8054-e4311f90873e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:51.084124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.089404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a084ed55-6630-433c-8054-e4311f90873e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:51.089762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a084ed55-6630-433c-8054-e4311f90873e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:51.119792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Pushing event deleted for resources: {'Port': ['ID=9d92d017-b049-4dba-8eef-81a84567d3c0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:51.147754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-1f6d1479-84b3-47e3-aa4e-a9ee56a80c9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.148233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-1f6d1479-84b3-47e3-aa4e-a9ee56a80c9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.149092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-1f6d1479-84b3-47e3-aa4e-a9ee56a80c9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.151038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-1f6d1479-84b3-47e3-aa4e-a9ee56a80c9b service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&shared=False HTTP/1.1" status: 200 len: 2290 time: 0.1862268 Dec 21 03:47:51.257585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.368773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 47c47db1-99b2-46c2-8459-be68d32f368f {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:51.369391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.374487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.379631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.381880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-c23a2d09-cf3b-4c5a-aa5a-8889053fff97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.384122 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b8f618b8-40d6-4e6d-8c8a-4d3e293ab77f req-c23a2d09-cf3b-4c5a-aa5a-8889053fff97 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2078311 Dec 21 03:47:51.405202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Transition to ACTIVE for port object 47c47db1-99b2-46c2-8459-be68d32f368f will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:47:51.484505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ffdca0-367b-43f7-95c2-89ec64508488 req-15d6eecd-aee8-4ef7-8729-78a19cdc76ca tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.486237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24ffdca0-367b-43f7-95c2-89ec64508488 req-15d6eecd-aee8-4ef7-8729-78a19cdc76ca tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 945 time: 0.0543516 Dec 21 03:47:51.522514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.568676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.572417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 02bebca8-a642-41be-a94c-12fbc201788d {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:47:51.574855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.576948 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d910b700-c70b-448e-8649-7207b6d9ad3b admin admin] 10.222.0.18 "DELETE /v2.0/routers/02bebca8-a642-41be-a94c-12fbc201788d HTTP/1.1" status: 204 len: 168 time: 2.0610492 Dec 21 03:47:51.579831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47432) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:51.629222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Pushing event updated for resources: {'Port': ['ID=47c47db1-99b2-46c2-8459-be68d32f368f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:51.644147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24ffdca0-367b-43f7-95c2-89ec64508488 req-a346cc1a-00de-4979-a44d-9fae6ceedabd tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1448605 Dec 21 03:47:51.652441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Deleting subnet 5a8480b0-ced1-4eac-af2b-b002cf1f0d61 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:47:51.668561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.679570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92ec625-3033-47b2-84a7-a63a3381f507 req-59d11763-79b9-4aaf-9015-d0402ae787b5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.681133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d92ec625-3033-47b2-84a7-a63a3381f507 req-59d11763-79b9-4aaf-9015-d0402ae787b5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1906257 Dec 21 03:47:51.752098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.868040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Attempting to bind port 47c47db1-99b2-46c2-8459-be68d32f368f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:47:51.869807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Attempting to bind port 47c47db1-99b2-46c2-8459-be68d32f368f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:47:51.870640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Attempting to bind port 47c47db1-99b2-46c2-8459-be68d32f368f on network 65cd0343-3e56-4d28-b026-1efe272456ef {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:51.908965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d92ec625-3033-47b2-84a7-a63a3381f507 req-24c0e465-59e6-4046-9e7d-6c2faf1267c1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1996896 Dec 21 03:47:51.909548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Port 47c47db1-99b2-46c2-8459-be68d32f368f on network 65cd0343-3e56-4d28-b026-1efe272456ef not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:47:51.909879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Attempting to bind port 47c47db1-99b2-46c2-8459-be68d32f368f on network 65cd0343-3e56-4d28-b026-1efe272456ef {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:47:51.917615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:47:51.917847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Checking segment: {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:47:51.918240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Bound using segment: {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:47:51.918778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Bound port: 47c47db1-99b2-46c2-8459-be68d32f368f, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11b27198-f796-49c2-bb1b-da4ad92e1d22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:47:51.919063 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.927457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:51.931291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dbb4e11-dec0-4481-afca-89eef5f811a9 req-32271fd8-db2d-465c-991f-ba44e3075cb9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:51.931291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0dbb4e11-dec0-4481-afca-89eef5f811a9 req-32271fd8-db2d-465c-991f-ba44e3075cb9 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 946 time: 0.1471426 Dec 21 03:47:52.037220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0dbb4e11-dec0-4481-afca-89eef5f811a9 req-53b1b34e-6ec7-4236-88ad-46b8c320a6a0 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953839 Dec 21 03:47:52.051178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] For port 47c47db1-99b2-46c2-8459-be68d32f368f, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:47:52.055168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] For port 47c47db1-99b2-46c2-8459-be68d32f368f, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47c47db1-99b2-46c2-8459-be68d32f368f,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:47:52.157174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.193558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.197305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4cc94b6-5cc8-472c-8c64-2658d8d1f4e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.201646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc40d729-cbd3-407c-8e41-aa0579ad2235 None None] Network 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:47:52.209715 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/5a8480b0-ced1-4eac-af2b-b002cf1f0d61 HTTP/1.1" status: 204 len: 168 time: 0.6285512 Dec 21 03:47:52.211387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47444) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:52.243565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18ecc649-7097-4a3c-80d0-74c99b47fd14 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5a8480b0-ced1-4eac-af2b-b002cf1f0d61,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:52.245037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59021d2-1559-42dd-a1c4-86782be53b6f req-848fb32a-7ca7-45c5-b7b2-82ed5c198000 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:52.256512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59021d2-1559-42dd-a1c4-86782be53b6f req-848fb32a-7ca7-45c5-b7b2-82ed5c198000 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:52.259855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b59021d2-1559-42dd-a1c4-86782be53b6f req-848fb32a-7ca7-45c5-b7b2-82ed5c198000 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1678 time: 0.1377447 Dec 21 03:47:52.261355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.321974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:52.322719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.324240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] 10.222.0.54 "PUT /v2.0/ports/47c47db1-99b2-46c2-8459-be68d32f368f HTTP/1.1" status: 200 len: 1093 time: 1.5177352 Dec 21 03:47:52.371447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.395574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b59021d2-1559-42dd-a1c4-86782be53b6f req-5cb4b96d-f82b-4785-834e-26a49bd3046a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1267297 Dec 21 03:47:52.400707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d737fec-48e0-44f0-adf0-92fea26ab44e service neutron] Pushing event updated for resources: {'Port': ['ID=47c47db1-99b2-46c2-8459-be68d32f368f,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:52.463799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Deleting port 23bf4bf5-111b-445b-8459-db2a55bcc55b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:52.464144 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.488241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] DHCP port deletion for 8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:47:52.546185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.583178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] For port 23bf4bf5-111b-445b-8459-db2a55bcc55b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=23bf4bf5-111b-445b-8459-db2a55bcc55b,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:52.583539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.584708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] Deleting port 23bf4bf5-111b-445b-8459-db2a55bcc55b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:52.585090 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.598508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Calling delete_port for 23bf4bf5-111b-445b-8459-db2a55bcc55b owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:52.634077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-fbbadc1f-cd9b-4595-a2c7-34c52049809c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:52.634872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-fbbadc1f-cd9b-4595-a2c7-34c52049809c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:52.638409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-fbbadc1f-cd9b-4595-a2c7-34c52049809c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1982 time: 0.0883942 Dec 21 03:47:52.717604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] For port 23bf4bf5-111b-445b-8459-db2a55bcc55b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=23bf4bf5-111b-445b-8459-db2a55bcc55b,segment=NetworkSegment(98b0f2d4-acea-405d-b169-baa382d740ef),segment_id=98b0f2d4-acea-405d-b169-baa382d740ef)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:52.722879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.766431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] Calling delete_port for 23bf4bf5-111b-445b-8459-db2a55bcc55b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:52.863402 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.880342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] No DVR routers for this DVR port 23bf4bf5-111b-445b-8459-db2a55bcc55b on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:52.924760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Pushing event deleted for resources: {'Port': ['ID=23bf4bf5-111b-445b-8459-db2a55bcc55b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:52.926223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:52.986616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] Pushing event deleted for resources: {'Port': ['ID=23bf4bf5-111b-445b-8459-db2a55bcc55b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:52.993200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32410601-dfb5-41e5-9c60-ce2002619d16 None None] No DVR routers for this DVR port 23bf4bf5-111b-445b-8459-db2a55bcc55b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:53.125781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.152014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.169891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 23bf4bf5-111b-445b-8459-db2a55bcc55b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:53.172797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:53.191620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '98b0f2d4-acea-405d-b169-baa382d740ef') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:53.191942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '98b0f2d4-acea-405d-b169-baa382d740ef') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:47:53.200724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 23bf4bf5-111b-445b-8459-db2a55bcc55b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:53.201687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 23bf4bf5-111b-445b-8459-db2a55bcc55b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:53.202123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9d92d017-b049-4dba-8eef-81a84567d3c0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:53.202924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.218089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.223205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9d92d017-b049-4dba-8eef-81a84567d3c0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:53.223975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9d92d017-b049-4dba-8eef-81a84567d3c0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:53.231050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Releasing vlan 133 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:47:53.231050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:47:53.231619 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:47:53.288008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'tag': '47c47db1-99b2-46c2-8459-be68d32f368f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:53.292019 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10562460-5d50-4ed5-8ab9-b62079b68217" -d '{"events": [{"name": "network-changed", "server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "tag": "47c47db1-99b2-46c2-8459-be68d32f368f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:53.312015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-ddf85ecf-7f06-40c8-b5f6-8772b84ebf42 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.27&port_id=aebb91e6-09ee-4d92-866b-c742bc0012b3 HTTP/1.1" status: 200 len: 217 time: 0.6467247 Dec 21 03:47:53.385477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.393332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.398115 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] 10.222.0.18 "DELETE /v2.0/networks/8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96 HTTP/1.1" status: 204 len: 168 time: 1.1855288 Dec 21 03:47:53.430957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748e528d-614b-43d6-b809-b50b9bf140e2 admin admin] Pushing event deleted for resources: {'Network': ['ID=8b48bf1d-3d31-4c14-aa00-dbdf6ac13a96,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:53.461367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1cf01c5-fac9-46dc-887d-46a2a83d26b9 req-366bb1ca-7fbb-488d-9073-b5ab67154ff2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:53.467417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1cf01c5-fac9-46dc-887d-46a2a83d26b9 req-366bb1ca-7fbb-488d-9073-b5ab67154ff2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1572247 Dec 21 03:47:53.499496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-8fdcf501-355b-4b7c-8c39-b3c8886ea1d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:53.501490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-8fdcf501-355b-4b7c-8c39-b3c8886ea1d1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=90423e11-83e3-4a02-8325-6b52e25ac647 HTTP/1.1" status: 200 len: 801 time: 0.1509864 Dec 21 03:47:53.517558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-a039803a-6855-4074-9b73-384f26b302ad tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:53.533777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-a039803a-6855-4074-9b73-384f26b302ad tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 946 time: 0.2227809 Dec 21 03:47:53.533777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33658327-c2c9-405d-9ecc-f3e25eba5aeb req-0f327802-68c9-4d5e-8499-3a04885dfa0e tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:53.533777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33658327-c2c9-405d-9ecc-f3e25eba5aeb req-0f327802-68c9-4d5e-8499-3a04885dfa0e tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 946 time: 0.2227886 Dec 21 03:47:53.670371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1cf01c5-fac9-46dc-887d-46a2a83d26b9 req-8713af3d-68a1-4b7f-a093-6f0c344924ae tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1884036 Dec 21 03:47:53.707550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33658327-c2c9-405d-9ecc-f3e25eba5aeb req-e3aa9eab-7c51-4061-ad8b-f1e0b041c7b6 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups?id=b1873ffb-f366-40cc-998e-567b08c2283c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1623828 Dec 21 03:47:53.707818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-5822fc2d-3898-4cef-af44-2d5d4b4a5578 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:53.709332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-5822fc2d-3898-4cef-af44-2d5d4b4a5578 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74b92324-668f-4e02-853d-3aaf26a99a26&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1892519 Dec 21 03:47:53.766636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:53.842370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Deleting port cd66adb7-3082-409b-aa05-c9a7248bb04b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:47:53.842770 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:53.872248 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ddff1ab9-e79d-479f-8168-4a23ffca2f26 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2637e7ec4ea74cb6a3ec5d635dce4a5c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1020329 Dec 21 03:47:53.874505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47482) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:53.919226 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86669620-7189-4b60-88e0-a8f052d186d6 x-openstack-request-id: req-86669620-7189-4b60-88e0-a8f052d186d6 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:53.919521 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "tag": "47c47db1-99b2-46c2-8459-be68d32f368f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:53.919773 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-86669620-7189-4b60-88e0-a8f052d186d6 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:53.920165 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'tag': '47c47db1-99b2-46c2-8459-be68d32f368f', 'status': 'completed', 'code': 200} Dec 21 03:47:54.016620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-144b7231-d2d8-4e04-81a7-0704062ff655 service neutron] 10.222.0.54 "GET /v2.0/networks/74b92324-668f-4e02-853d-3aaf26a99a26?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2944677 Dec 21 03:47:54.089726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dbfd35-30e2-4519-83cf-dc1bbc6a6810 req-37ccbdcd-f484-4502-a378-2fa6cccea048 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:54.096743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dbfd35-30e2-4519-83cf-dc1bbc6a6810 req-37ccbdcd-f484-4502-a378-2fa6cccea048 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:54.098673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2dbfd35-30e2-4519-83cf-dc1bbc6a6810 req-37ccbdcd-f484-4502-a378-2fa6cccea048 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1678 time: 0.2140913 Dec 21 03:47:54.110349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] For port cd66adb7-3082-409b-aa05-c9a7248bb04b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd66adb7-3082-409b-aa05-c9a7248bb04b,segment=NetworkSegment(01718413-2838-40fe-a380-2d2cdba03082),segment_id=01718413-2838-40fe-a380-2d2cdba03082)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:54.110828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.113903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e32a8d3-cfa6-45ea-a7a0-facd16ebe6bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.158189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Calling delete_port for cd66adb7-3082-409b-aa05-c9a7248bb04b owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:47:54.249549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e32a8d3-cfa6-45ea-a7a0-facd16ebe6bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.311788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2dbfd35-30e2-4519-83cf-dc1bbc6a6810 req-858d388f-64b3-49c2-a7ac-646b981a8081 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1914425 Dec 21 03:47:54.313740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-cd6b6261-c953-4a1e-9ffe-cae164b4b477 service neutron] 10.222.0.54 "GET /v2.0/networks/74b92324-668f-4e02-853d-3aaf26a99a26?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2861280 Dec 21 03:47:54.373331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-ec84251c-2b2d-423b-9d3a-65af394b124f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.138&port_id=47c47db1-99b2-46c2-8459-be68d32f368f HTTP/1.1" status: 200 len: 217 time: 0.0503519 Dec 21 03:47:54.459944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-7737f8f4-f067-4166-81a6-5265606029ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:54.461416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-7737f8f4-f067-4166-81a6-5265606029ed service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c64439a7-5fd1-4867-990d-55fe8b8f1bbb HTTP/1.1" status: 200 len: 801 time: 0.0809045 Dec 21 03:47:54.505019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e32a8d3-cfa6-45ea-a7a0-facd16ebe6bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.507618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e32a8d3-cfa6-45ea-a7a0-facd16ebe6bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.508742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9e32a8d3-cfa6-45ea-a7a0-facd16ebe6bf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b94efdf9-2416-4a37-8ab4-c310be91fbce HTTP/1.1" status: 204 len: 168 time: 0.6327162 Dec 21 03:47:54.520906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-3a2168c5-a2a9-425a-8a7e-7998eea2c9de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:54.522395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-3a2168c5-a2a9-425a-8a7e-7998eea2c9de service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=65cd0343-3e56-4d28-b026-1efe272456ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0532906 Dec 21 03:47:54.523276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e32a8d3-cfa6-45ea-a7a0-facd16ebe6bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b94efdf9-2416-4a37-8ab4-c310be91fbce,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:54.544976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.546484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:54.589603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['cd66adb7-3082-409b-aa05-c9a7248bb04b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:54.667063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event deleted for resources: {'Port': ['ID=cd66adb7-3082-409b-aa05-c9a7248bb04b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:54.695946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:54.716435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] No DVR routers for this DVR port cd66adb7-3082-409b-aa05-c9a7248bb04b on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:47:54.725728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.728321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '2245f877-8d64-488f-bc12-d173f88c7450', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': '2245f877-8d64-488f-bc12-d173f88c7450', 'mac_address': 'fa:16:3e:86:0b:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:54.729251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-016dcb40-08fc-4f65-862e-e0af8ca29022 req-f0bf11de-fffe-4c92-b9a2-84d387454b60 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.31 "DELETE /v2.0/ports/cd66adb7-3082-409b-aa05-c9a7248bb04b HTTP/1.1" status: 204 len: 173 time: 1.1882102 Dec 21 03:47:54.748628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-7c5e54bc-3a91-40ae-9ea7-0e6cfd141d53 service neutron] 10.222.0.54 "GET /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2178466 Dec 21 03:47:54.779338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.797813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.817866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2245f877-8d64-488f-bc12-d173f88c7450 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:54.859871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:54.893758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69657eb0-d04b-41fa-92ec-da2a3a758930 req-548f74ae-308f-4b60-9910-4b71c7ef017d tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.0681169 Dec 21 03:47:54.911776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b571b76b-9e83-40e9-9f12-97c220d75af0 req-42b42a14-e0b7-4555-bcee-933bab32b552 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:54.914705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b571b76b-9e83-40e9-9f12-97c220d75af0 req-42b42a14-e0b7-4555-bcee-933bab32b552 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1571367 Dec 21 03:47:54.934552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:54.962203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5d533b0-d73a-4bfa-ab35-dc7c28fc1c87 req-9ddefbd5-7db6-4ce4-8586-ac3de571d671 service neutron] 10.222.0.54 "GET /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2045994 Dec 21 03:47:54.995293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b571b76b-9e83-40e9-9f12-97c220d75af0 req-b91c9778-c05f-49ce-81ea-b169e39250e8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711420 Dec 21 03:47:55.011524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:55.070392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:55.176072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['2245f877-8d64-488f-bc12-d173f88c7450'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:47:55.258977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-8e1a545d-4134-47d6-b61a-542998ca4d0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.259447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-8e1a545d-4134-47d6-b61a-542998ca4d0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.261024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-8e1a545d-4134-47d6-b61a-542998ca4d0e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1982 time: 0.0730071 Dec 21 03:47:55.270223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-a75dd7e5-c95c-4e61-8cab-d1a7bd147305 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.277575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-a75dd7e5-c95c-4e61-8cab-d1a7bd147305 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.1599779 Dec 21 03:47:55.319498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-57878132-3e27-4c41-898e-55077898d6c3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/quotas/7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 375 time: 0.0409560 Dec 21 03:47:55.404459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47526) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:55.444056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-e5bbbdcd-031b-46d0-942a-714e1bc3b65a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1174769 Dec 21 03:47:55.458734 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-08a591c1-d1eb-494a-a64c-cb493fd10734 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0432748fee1345f888406a94a41fcadb&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0530798 Dec 21 03:47:55.461145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47528) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:47:55.472837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-b624c2cb-cc03-4278-8192-f298923f7c80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.474287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-b624c2cb-cc03-4278-8192-f298923f7c80 service neutron] 10.222.0.54 "GET /v2.0/networks?id=65cd0343-3e56-4d28-b026-1efe272456ef HTTP/1.1" status: 200 len: 902 time: 0.1877732 Dec 21 03:47:55.512646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1122762-ebf0-406f-8a77-a07e0d549461 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:55.534764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1122762-ebf0-406f-8a77-a07e0d549461 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:55.560281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-b6117c96-b2f9-4cd0-8909-807316185d7c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.138&port_id=47c47db1-99b2-46c2-8459-be68d32f368f HTTP/1.1" status: 200 len: 217 time: 0.0727632 Dec 21 03:47:55.595786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb00eda-5fcc-405d-99d5-73f9738b670d req-25092ace-69ad-487e-8c8e-462762127912 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.601769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb00eda-5fcc-405d-99d5-73f9738b670d req-25092ace-69ad-487e-8c8e-462762127912 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.609260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bb00eda-5fcc-405d-99d5-73f9738b670d req-25092ace-69ad-487e-8c8e-462762127912 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1678 time: 0.2108488 Dec 21 03:47:55.669450 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:55.682565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-6eb54cd8-6ff0-4f39-9e9a-ea94b6fade74 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2219608 Dec 21 03:47:55.683916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-51c5810c-124b-4780-a6db-a77fd64f8e58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.685232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-51c5810c-124b-4780-a6db-a77fd64f8e58 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c64439a7-5fd1-4867-990d-55fe8b8f1bbb HTTP/1.1" status: 200 len: 801 time: 0.1100738 Dec 21 03:47:55.697316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1122762-ebf0-406f-8a77-a07e0d549461 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:55.700143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1122762-ebf0-406f-8a77-a07e0d549461 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:55.701281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1122762-ebf0-406f-8a77-a07e0d549461 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1b22c54b-4e89-40ca-b64c-3f1457ee3fce HTTP/1.1" status: 204 len: 168 time: 0.2390916 Dec 21 03:47:55.712572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1122762-ebf0-406f-8a77-a07e0d549461 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b22c54b-4e89-40ca-b64c-3f1457ee3fce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:55.750963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bb00eda-5fcc-405d-99d5-73f9738b670d req-a0dab511-f995-4b97-bc5d-5bb90e02ce12 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1384144 Dec 21 03:47:55.823733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-31edb156-67cd-404a-a458-78af5f81178e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:55.825266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-31edb156-67cd-404a-a458-78af5f81178e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=65cd0343-3e56-4d28-b026-1efe272456ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1291609 Dec 21 03:47:55.905980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-196a96bd-22cf-4acc-8477-e4d43e4f5f02 service neutron] 10.222.0.18 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2086139 Dec 21 03:47:55.925754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'name': 'network-vif-deleted', 'tag': 'cd66adb7-3082-409b-aa05-c9a7248bb04b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:55.926418 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c518695f-46ba-421b-ab0e-583ceb57442f" -d '{"events": [{"server_uuid": "73db65ed-b4e5-4ea0-a124-cacdf2a7aef4", "name": "network-vif-deleted", "tag": "cd66adb7-3082-409b-aa05-c9a7248bb04b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:55.968724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-e0cfdd61-2a80-467f-8b32-0472730d5537 service neutron] 10.222.0.54 "GET /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323738 Dec 21 03:47:56.054398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc258eab-6cac-47f1-8fce-5b4ff3fa33d8 req-f81dc0d6-6c55-4d08-92b7-dbe2d7044cf8 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/ports?device_id=73db65ed-b4e5-4ea0-a124-cacdf2a7aef4 HTTP/1.1" status: 200 len: 210 time: 0.0422633 Dec 21 03:47:56.127874 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d86d8741-2343-4c02-b9b9-991cac5234e1 x-openstack-request-id: req-d86d8741-2343-4c02-b9b9-991cac5234e1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:56.128173 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73db65ed-b4e5-4ea0-a124-cacdf2a7aef4", "name": "network-vif-deleted", "tag": "cd66adb7-3082-409b-aa05-c9a7248bb04b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:56.128434 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d86d8741-2343-4c02-b9b9-991cac5234e1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:56.129050 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73db65ed-b4e5-4ea0-a124-cacdf2a7aef4', 'name': 'network-vif-deleted', 'tag': 'cd66adb7-3082-409b-aa05-c9a7248bb04b', 'status': 'completed', 'code': 200} Dec 21 03:47:56.136655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562460-5d50-4ed5-8ab9-b62079b68217 req-fedd0dab-73ca-4330-8e26-563df7fb7155 service neutron] 10.222.0.54 "GET /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1551161 Dec 21 03:47:56.286284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19122bbd-6515-45b7-b6af-e4f2c6e77a71 req-fd407382-b175-4246-a479-109b734c158a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:56.287984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19122bbd-6515-45b7-b6af-e4f2c6e77a71 req-fd407382-b175-4246-a479-109b734c158a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.0782936 Dec 21 03:47:56.350461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19122bbd-6515-45b7-b6af-e4f2c6e77a71 req-cab8c74c-9fd3-4b91-aeda-dfde26e518de tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555480 Dec 21 03:47:56.551468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:47:56.627655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 2245f877-8d64-488f-bc12-d173f88c7450 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:47:56.631647 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:56.720915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:56.750474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:47:56.752879 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27808565-f636-4cb5-8465-65081a2d63f8" -d '{"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-plugged", "status": "completed", "tag": "2245f877-8d64-488f-bc12-d173f88c7450"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:47:56.785900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:56.797998 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:47:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-026b4384-9acd-40c1-acf5-5f72e37bd31f x-openstack-request-id: req-026b4384-9acd-40c1-acf5-5f72e37bd31f {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:47:56.798203 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-plugged", "status": "completed", "tag": "2245f877-8d64-488f-bc12-d173f88c7450", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:47:56.798461 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-026b4384-9acd-40c1-acf5-5f72e37bd31f {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:47:56.798861 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450', 'code': 200} Dec 21 03:47:56.848534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:56.849358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd66adb7-3082-409b-aa05-c9a7248bb04b no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:47:56.955947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7797fe23-586a-4120-b9ee-d14b0641a7b8 req-bcfe75e9-faa1-4e9e-bd83-f97bbc1d52f3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0430686 Dec 21 03:47:56.961740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:56.974281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: cd66adb7-3082-409b-aa05-c9a7248bb04b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:47:56.974707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd66adb7-3082-409b-aa05-c9a7248bb04b not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:47:56.990302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5adbd3-3c59-43a3-b73b-e53526096ed9 req-a28c48b4-0a45-4e68-8f3d-9626e18bb10a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:56.996402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5adbd3-3c59-43a3-b73b-e53526096ed9 req-a28c48b4-0a45-4e68-8f3d-9626e18bb10a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:56.998225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d5adbd3-3c59-43a3-b73b-e53526096ed9 req-a28c48b4-0a45-4e68-8f3d-9626e18bb10a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1678 time: 0.1414249 Dec 21 03:47:57.059479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d5adbd3-3c59-43a3-b73b-e53526096ed9 req-03f1344a-0293-4c7e-b876-3763e265c8d0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487392 Dec 21 03:47:57.490706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cb175e-70a9-417e-983f-be01ce6327fb req-0e1d4df6-f539-422e-9764-f58988279f50 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:57.490706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66cb175e-70a9-417e-983f-be01ce6327fb req-0e1d4df6-f539-422e-9764-f58988279f50 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.0611153 Dec 21 03:47:57.562583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66cb175e-70a9-417e-983f-be01ce6327fb req-feec942b-6635-493b-8a31-933a1c5889f1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610991 Dec 21 03:47:58.597766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aebb91e6-09ee-4d92-866b-c742bc0012b3 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:58.748404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aebb91e6-09ee-4d92-866b-c742bc0012b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aebb91e6-09ee-4d92-866b-c742bc0012b3,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:58.762006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'aebb91e6-09ee-4d92-866b-c742bc0012b3', 'network_id': '74b92324-668f-4e02-853d-3aaf26a99a26', 'port_id': 'aebb91e6-09ee-4d92-866b-c742bc0012b3', 'mac_address': 'fa:16:3e:9f:a6:85', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 102, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '90423e11-83e3-4a02-8325-6b52e25ac647', 'ip_address': '19.80.0.27'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:58.825617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:58.855662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aebb91e6-09ee-4d92-866b-c742bc0012b3 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:58.892046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aebb91e6-09ee-4d92-866b-c742bc0012b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aebb91e6-09ee-4d92-866b-c742bc0012b3,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:59.201575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:59.201575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47c47db1-99b2-46c2-8459-be68d32f368f details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:47:59.373116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 47c47db1-99b2-46c2-8459-be68d32f368f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47c47db1-99b2-46c2-8459-be68d32f368f,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:59.389590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '47c47db1-99b2-46c2-8459-be68d32f368f', 'network_id': '65cd0343-3e56-4d28-b026-1efe272456ef', 'port_id': '47c47db1-99b2-46c2-8459-be68d32f368f', 'mac_address': 'fa:16:3e:97:f8:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c64439a7-5fd1-4867-990d-55fe8b8f1bbb', 'ip_address': '19.86.0.138'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:47:59.472048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-302273e1-3fd4-4fe8-9b22-3fbc313b9fb6 req-796fec83-7477-45d5-92f3-62b5152c6dcb tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0612352 Dec 21 03:47:59.552505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2978377-322f-44bd-a774-683a10163f6f req-ae4039da-183f-4575-a6fb-93a689fb6344 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:59.590319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2978377-322f-44bd-a774-683a10163f6f req-ae4039da-183f-4575-a6fb-93a689fb6344 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:59.591996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2978377-322f-44bd-a774-683a10163f6f req-ae4039da-183f-4575-a6fb-93a689fb6344 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1679 time: 0.1348495 Dec 21 03:47:59.711916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2978377-322f-44bd-a774-683a10163f6f req-1d58fd10-e729-4dc0-a777-7f91d230b122 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1019256 Dec 21 03:47:59.736484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:59.742033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=aebb91e6-09ee-4d92-866b-c742bc0012b3,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:47:59.761739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 47c47db1-99b2-46c2-8459-be68d32f368f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:47:59.788529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 47c47db1-99b2-46c2-8459-be68d32f368f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47c47db1-99b2-46c2-8459-be68d32f368f,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:47:59.863502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:47:59.928119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc601bf-d920-4c0e-8195-94374e6fe6a4 req-f56dfbf6-3ac4-4078-83c7-0224a35cb3db tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:47:59.930079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fc601bf-d920-4c0e-8195-94374e6fe6a4 req-f56dfbf6-3ac4-4078-83c7-0224a35cb3db tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.0954843 Dec 21 03:47:59.973591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=47c47db1-99b2-46c2-8459-be68d32f368f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:00.007150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fc601bf-d920-4c0e-8195-94374e6fe6a4 req-8bd78c2c-556b-43cb-aa50-6ccfa89d0d4c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701632 Dec 21 03:48:00.158194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:00.251385 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c1a85e2-39da-472d-b4da-9339d435322c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.261431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['aebb91e6-09ee-4d92-866b-c742bc0012b3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:00.314690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c1a85e2-39da-472d-b4da-9339d435322c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.499491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c1a85e2-39da-472d-b4da-9339d435322c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.503093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c1a85e2-39da-472d-b4da-9339d435322c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.504584 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0c1a85e2-39da-472d-b4da-9339d435322c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "DELETE /v2.0/security-groups/3e55b34c-2fa2-47cc-89c2-9cc268e74cf2 HTTP/1.1" status: 204 len: 168 time: 0.3453002 Dec 21 03:48:00.521876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47718) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:00.574126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c1a85e2-39da-472d-b4da-9339d435322c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e55b34c-2fa2-47cc-89c2-9cc268e74cf2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:00.578091 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-923552c5-2874-4804-9d22-3afba9c237e3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] show failed (client error): The resource could not be found. Dec 21 03:48:00.583171 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-923552c5-2874-4804-9d22-3afba9c237e3 tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "GET /v2.0/security-groups/3e55b34c-2fa2-47cc-89c2-9cc268e74cf2 HTTP/1.1" status: 404 len: 347 time: 0.0602367 Dec 21 03:48:00.584997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47720) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:00.751419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Deleting port d002a68b-67fc-4712-a314-b63a2d44310d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:00.751956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.824100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82d74e09-0214-4a29-95cb-91c79f008b7a req-e8aa1c37-e5a3-444f-a445-96e2b6d9089b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.2178302 Dec 21 03:48:00.888183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.888567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:00.928055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-99fb1607-cdd4-4663-9a34-2e7e963b7cae tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:00.931672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-99fb1607-cdd4-4663-9a34-2e7e963b7cae tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 820 time: 0.4478769 Dec 21 03:48:00.933016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Calling delete_port for d002a68b-67fc-4712-a314-b63a2d44310d owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:00.981258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4664dfcc-1ef5-4b8f-be4d-6eac4c8524d0 req-41d24cdd-0dd5-4f1f-8851-3a17e930e6b3 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:01.001243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4664dfcc-1ef5-4b8f-be4d-6eac4c8524d0 req-41d24cdd-0dd5-4f1f-8851-3a17e930e6b3 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:01.011593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4664dfcc-1ef5-4b8f-be4d-6eac4c8524d0 req-41d24cdd-0dd5-4f1f-8851-3a17e930e6b3 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1680 time: 0.1263735 Dec 21 03:48:01.022484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Request body: {'port': {'device_id': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'admin_state_up': True, 'tenant_id': '7662e8b89a444924a01bee5e34421908'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:01.068124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47730) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:01.277965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d34e2a3-4424-4ede-8e1d-ac5fe0aa4f7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.284587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4664dfcc-1ef5-4b8f-be4d-6eac4c8524d0 req-8d724dd5-1343-4cca-bb2f-90ef62d60587 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2688725 Dec 21 03:48:01.319716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['47c47db1-99b2-46c2-8459-be68d32f368f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:01.382012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2c044d-5b21-43db-af49-73aa0503b4a5 req-2294bc7a-04d0-4f36-865d-432915cc6fdc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:01.389993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d34e2a3-4424-4ede-8e1d-ac5fe0aa4f7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.396218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f2c044d-5b21-43db-af49-73aa0503b4a5 req-2294bc7a-04d0-4f36-865d-432915cc6fdc tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1915772 Dec 21 03:48:01.396354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.422317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Pushing event deleted for resources: {'Port': ['ID=d002a68b-67fc-4712-a314-b63a2d44310d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:01.537315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f2c044d-5b21-43db-af49-73aa0503b4a5 req-fc71bb61-538f-45df-8f09-8bb075c83ce0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1428268 Dec 21 03:48:01.540173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d34e2a3-4424-4ede-8e1d-ac5fe0aa4f7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.545713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.567146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.582268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-290c01a2-26e1-46dd-bc35-80d25c817b7c tempest-ImagesOneServerNegativeTestJSON-603162868 tempest-ImagesOneServerNegativeTestJSON-603162868-project] 10.222.0.18 "DELETE /v2.0/floatingips/dfc9fc06-1a1f-408f-ad86-a29492c22b43 HTTP/1.1" status: 204 len: 168 time: 0.9845788 Dec 21 03:48:01.628908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Made reservation on behalf of 7662e8b89a444924a01bee5e34421908 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:01.632580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.689297 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d34e2a3-4424-4ede-8e1d-ac5fe0aa4f7a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a6ef79b79b80400395bd0b40d459e38a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6197362 Dec 21 03:48:01.690372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d34e2a3-4424-4ede-8e1d-ac5fe0aa4f7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20e46a53-dda0-4d14-a581-b374a373816f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:01.697648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:01.758433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47758) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:01.861130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Deleting subnet ec8e3a7f-1bef-41ac-8b72-508d262fe30c {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:48:01.867464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.879531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e199e23-99c6-44cc-be5a-f704233dcc26 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.905648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Allocated IP 172.20.0.6 (8b13f1ae-b717-40da-b68e-bdf950529b14/84e57960-b2b1-49b0-85de-36fd5e1ebd6a/f39fe48f-e6af-49d1-a42c-899b81bdf60b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:01.932122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e199e23-99c6-44cc-be5a-f704233dcc26 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:01.954861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.066992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.231263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.266624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ec8e3a7f-1bef-41ac-8b72-508d262fe30c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:02.271804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.276885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-94b1480b-42c4-4238-9a62-610c9ea50536 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/ec8e3a7f-1bef-41ac-8b72-508d262fe30c HTTP/1.1" status: 204 len: 168 time: 0.5172758 Dec 21 03:48:02.279582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47764) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:02.384301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.406452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e987bdd-b448-40b0-8986-716b815359fb req-518516c2-ad8d-4aff-9d11-f6bf99127e66 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.4361203 Dec 21 03:48:02.619677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aebb91e6-09ee-4d92-866b-c742bc0012b3 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:02.635273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.642580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fc2a15-b965-4f50-a265-abb3f1bb4a66 req-5ce42745-021f-4a63-a2d4-272975b090bc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:02.649820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fc2a15-b965-4f50-a265-abb3f1bb4a66 req-5ce42745-021f-4a63-a2d4-272975b090bc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:02.661192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fc2a15-b965-4f50-a265-abb3f1bb4a66 req-5ce42745-021f-4a63-a2d4-272975b090bc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1680 time: 0.2561076 Dec 21 03:48:02.680892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7c34a09c-fe79-4a56-ac99-3b531a9f3f91']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:02.703155 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:48:02.731241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01718413-2838-40fe-a380-2d2cdba03082') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:02.731546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01718413-2838-40fe-a380-2d2cdba03082') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:02.769755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.793102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.794062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8fc2a15-b965-4f50-a265-abb3f1bb4a66 req-dba3ff0d-bf15-4200-98be-be78bf8add8c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311502 Dec 21 03:48:02.801355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Releasing vlan 113 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:48:02.802678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.837136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.880008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e199e23-99c6-44cc-be5a-f704233dcc26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.884635 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e199e23-99c6-44cc-be5a-f704233dcc26 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:48:02.887278 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:48:02.895621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9e199e23-99c6-44cc-be5a-f704233dcc26 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/20e46a53-dda0-4d14-a581-b374a373816f HTTP/1.1" status: 204 len: 168 time: 1.1930299 Dec 21 03:48:02.955632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e199e23-99c6-44cc-be5a-f704233dcc26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20e46a53-dda0-4d14-a581-b374a373816f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:02.975234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27cff6a-e9e3-49f5-a852-13f59d6520a6 req-2b92c604-0143-4718-b3f9-30f52a86087c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:02.983651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a27cff6a-e9e3-49f5-a852-13f59d6520a6 req-2b92c604-0143-4718-b3f9-30f52a86087c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1419649 Dec 21 03:48:03.042465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port aebb91e6-09ee-4d92-866b-c742bc0012b3 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:03.044124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a27cff6a-e9e3-49f5-a852-13f59d6520a6 req-b955b62f-16e1-410f-8bef-dcbc668ee9ab tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581234 Dec 21 03:48:03.046697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port aebb91e6-09ee-4d92-866b-c742bc0012b3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:03.047554 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.065923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.070906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.072906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.078027 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] 10.222.0.18 "DELETE /v2.0/networks/7c34a09c-fe79-4a56-ac99-3b531a9f3f91 HTTP/1.1" status: 204 len: 168 time: 0.7955420 Dec 21 03:48:03.096211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ecd0244-8991-4630-a9e8-8a807d7c4948 admin admin] Pushing event deleted for resources: {'Network': ['ID=7c34a09c-fe79-4a56-ac99-3b531a9f3f91,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:03.160808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['b1bddbab-3a32-4687-b97f-eada22b71c0f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:03.231120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Network 8b13f1ae-b717-40da-b68e-bdf950529b14 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:03.242286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:03.271965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:03.399245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.439447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:03.527035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:03.528986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.538681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aebb91e6-09ee-4d92-866b-c742bc0012b3'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:03.549587 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94a62289-c6b0-4ad0-b37f-4cf5fe67899c" -d '{"events": [{"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-plugged", "status": "completed", "tag": "aebb91e6-09ee-4d92-866b-c742bc0012b3"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:03.612681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aebb91e6-09ee-4d92-866b-c742bc0012b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aebb91e6-09ee-4d92-866b-c742bc0012b3,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:03.675680 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b9db9e8-5a9f-4f8b-9fce-a7708d03919a x-openstack-request-id: req-3b9db9e8-5a9f-4f8b-9fce-a7708d03919a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:03.677075 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-plugged", "status": "completed", "tag": "aebb91e6-09ee-4d92-866b-c742bc0012b3", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:03.678698 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3b9db9e8-5a9f-4f8b-9fce-a7708d03919a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:03.679155 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aebb91e6-09ee-4d92-866b-c742bc0012b3', 'code': 200} Dec 21 03:48:03.694535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-7e15aabc-8aef-4ec5-9f60-579fc71f92a9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7339094 Dec 21 03:48:03.697499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.698348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47c47db1-99b2-46c2-8459-be68d32f368f up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:03.703423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47812) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:03.728166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Request body: {'port': {'device_id': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:03.814018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47822) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:03.880115 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ace74ab1-d038-4605-9f45-05a562a427a9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7a49d4228d05498db20fade9b7651659&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1736407 Dec 21 03:48:03.886495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e102fbd3-5e69-452b-8552-540f41110e0f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.896883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:03.910011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:03.962076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17596ea-cd6d-4d84-b9e9-fd53dbb8b59a req-e93d0406-6997-4a12-822b-d736938ddb03 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:03.989710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17596ea-cd6d-4d84-b9e9-fd53dbb8b59a req-e93d0406-6997-4a12-822b-d736938ddb03 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 931 time: 0.3680763 Dec 21 03:48:04.039076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=aebb91e6-09ee-4d92-866b-c742bc0012b3,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:04.051952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45e4ef37-8f6c-486b-b3e7-b9b1133498c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.091103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45e4ef37-8f6c-486b-b3e7-b9b1133498c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.092351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 47c47db1-99b2-46c2-8459-be68d32f368f completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:04.108431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 47c47db1-99b2-46c2-8459-be68d32f368f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:04.112449 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.170199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e102fbd3-5e69-452b-8552-540f41110e0f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.236600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e102fbd3-5e69-452b-8552-540f41110e0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.276760 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.303718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45e4ef37-8f6c-486b-b3e7-b9b1133498c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.308848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45e4ef37-8f6c-486b-b3e7-b9b1133498c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.324957 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-45e4ef37-8f6c-486b-b3e7-b9b1133498c3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b1873ffb-f366-40cc-998e-567b08c2283c HTTP/1.1" status: 204 len: 168 time: 0.4264295 Dec 21 03:48:04.334600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e102fbd3-5e69-452b-8552-540f41110e0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1fc50b0f-b3be-4d19-a847-89e56f9f33de,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:04.340579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17596ea-cd6d-4d84-b9e9-fd53dbb8b59a req-5ac81fec-43cd-4625-8a8c-7b69da3430fa tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3060796 Dec 21 03:48:04.348585 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e102fbd3-5e69-452b-8552-540f41110e0f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2d13a990016743bba5826748c7b48c25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5285723 Dec 21 03:48:04.354094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47832) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:04.394112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 47c47db1-99b2-46c2-8459-be68d32f368f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47c47db1-99b2-46c2-8459-be68d32f368f,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:04.395688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45e4ef37-8f6c-486b-b3e7-b9b1133498c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1873ffb-f366-40cc-998e-567b08c2283c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:04.452112 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec34deda-2232-480b-81fc-1a10055ac5d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.453103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4984b74d-f158-4a21-8359-7b48351cfdc6 req-0286bc04-5362-4761-a0fb-faed3e4d86cc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:04.477099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4984b74d-f158-4a21-8359-7b48351cfdc6 req-0286bc04-5362-4761-a0fb-faed3e4d86cc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:04.489411 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.498219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4984b74d-f158-4a21-8359-7b48351cfdc6 req-0286bc04-5362-4761-a0fb-faed3e4d86cc tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1681 time: 0.5737646 Dec 21 03:48:04.506804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec34deda-2232-480b-81fc-1a10055ac5d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.588537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=47c47db1-99b2-46c2-8459-be68d32f368f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:04.686169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec34deda-2232-480b-81fc-1a10055ac5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.691056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec34deda-2232-480b-81fc-1a10055ac5d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:04.694803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ec34deda-2232-480b-81fc-1a10055ac5d7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1fc50b0f-b3be-4d19-a847-89e56f9f33de HTTP/1.1" status: 204 len: 168 time: 0.3371367 Dec 21 03:48:04.705065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec34deda-2232-480b-81fc-1a10055ac5d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1fc50b0f-b3be-4d19-a847-89e56f9f33de,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:04.847998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4984b74d-f158-4a21-8359-7b48351cfdc6 req-e3564c0b-3ea6-49e6-80b1-94959fd9fb31 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3426564 Dec 21 03:48:05.124294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e51efd-e098-40ea-80f0-2533bae911da req-86ab8ce8-5c10-4a18-bbc5-caddcfba0e6d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:05.137337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04e51efd-e098-40ea-80f0-2533bae911da req-86ab8ce8-5c10-4a18-bbc5-caddcfba0e6d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.5642738 Dec 21 03:48:05.299688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04e51efd-e098-40ea-80f0-2533bae911da req-3df3ae52-8664-425f-af90-4f224985e55e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1469271 Dec 21 03:48:05.494015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f39fe48f-e6af-49d1-a42c-899b81bdf60b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:05.518031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:05.573273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Transition to ACTIVE for port object f39fe48f-e6af-49d1-a42c-899b81bdf60b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:05.592881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12378ad2-f39e-4eb0-9c85-42244604e20b req-85815848-5ced-4b07-b7ba-ff7354848f45 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:05.604179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12378ad2-f39e-4eb0-9c85-42244604e20b req-85815848-5ced-4b07-b7ba-ff7354848f45 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 931 time: 0.1039872 Dec 21 03:48:05.636938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:05.680580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47c47db1-99b2-46c2-8459-be68d32f368f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:05.683127 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9678e5d3-5b45-426f-9fe3-8c7269920fc0" -d '{"events": [{"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-plugged", "status": "completed", "tag": "47c47db1-99b2-46c2-8459-be68d32f368f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:05.751635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12378ad2-f39e-4eb0-9c85-42244604e20b req-87a3a637-9b81-4b0f-b29c-5d078135e90e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1462896 Dec 21 03:48:05.909700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:05.995441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:05.995801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:05.996287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:06.007147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:06.007493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:06.021692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:06.022045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:06.022449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:06.022895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Bound port: f39fe48f-e6af-49d1-a42c-899b81bdf60b, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:06.023277 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:06.182083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:06.213567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d404e43-caad-42e8-8f01-52bbb5157b7d req-f0bf2773-5960-45b4-8288-a2d3b3d2ec66 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.229248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d404e43-caad-42e8-8f01-52bbb5157b7d req-f0bf2773-5960-45b4-8288-a2d3b3d2ec66 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.232448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d404e43-caad-42e8-8f01-52bbb5157b7d req-f0bf2773-5960-45b4-8288-a2d3b3d2ec66 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1682 time: 0.1961572 Dec 21 03:48:06.242375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:06.307170 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-500e11f6-7d21-4615-9b0f-c0f3196f2931 x-openstack-request-id: req-500e11f6-7d21-4615-9b0f-c0f3196f2931 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:06.307724 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-plugged", "status": "completed", "tag": "47c47db1-99b2-46c2-8459-be68d32f368f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:06.308527 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-500e11f6-7d21-4615-9b0f-c0f3196f2931 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:06.309527 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47c47db1-99b2-46c2-8459-be68d32f368f', 'code': 200} Dec 21 03:48:06.333936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:06.416975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d404e43-caad-42e8-8f01-52bbb5157b7d req-26ae046b-73dc-4034-9d18-f23851ac07a3 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1636667 Dec 21 03:48:06.611957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.612586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:06.614035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] 10.222.0.31 "PUT /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 1092 time: 2.8965073 Dec 21 03:48:06.617730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:06.628658 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7008ad72-f3a7-4e18-b384-e4e3278ec757" -d '{"events": [{"name": "network-changed", "server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:06.745131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6de68f1-9cf5-4245-8b9e-bd7194f81466 req-48020283-73ba-4dc0-9a65-4f0508c0d6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.746216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6de68f1-9cf5-4245-8b9e-bd7194f81466 req-48020283-73ba-4dc0-9a65-4f0508c0d6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.747835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6de68f1-9cf5-4245-8b9e-bd7194f81466 req-48020283-73ba-4dc0-9a65-4f0508c0d6bc service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1986 time: 0.3192451 Dec 21 03:48:06.757372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5f4341-5587-4fb8-8d29-0ea71d78d9de service neutron] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:06.787928 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4ba00a1-0ab1-417e-8c64-595f287e4a5a x-openstack-request-id: req-b4ba00a1-0ab1-417e-8c64-595f287e4a5a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:06.788315 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:06.788641 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b4ba00a1-0ab1-417e-8c64-595f287e4a5a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:06.789106 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'status': 'completed', 'code': 200} Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.853151 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:06.856111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72cce0bb-f8cf-44d2-8277-4c7e27ca3d0f req-17354f79-ac07-4fb6-bb56-88087a97c007 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.864727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72cce0bb-f8cf-44d2-8277-4c7e27ca3d0f req-17354f79-ac07-4fb6-bb56-88087a97c007 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1631176 Dec 21 03:48:06.904571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6de68f1-9cf5-4245-8b9e-bd7194f81466 req-334b6268-bb4a-4de5-82a0-1d129c36dfe6 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1480637 Dec 21 03:48:06.919006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-4eee6512-3ea0-4d62-856f-deea899f191f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:06.921221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-4eee6512-3ea0-4d62-856f-deea899f191f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1095 time: 0.1385908 Dec 21 03:48:07.042567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72cce0bb-f8cf-44d2-8277-4c7e27ca3d0f req-6a2a7537-00cf-4b5c-b491-ee295a609339 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1768565 Dec 21 03:48:07.046085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-9e9fb197-04b7-475e-8145-4b191a361c0d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 217 time: 0.0955570 Dec 21 03:48:07.057986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59a702ee-bbd7-4f21-b97e-aa0cf22dbfe6 req-33ea69ce-3c9d-461d-9b6c-e34c6efc9c21 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:07.061883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59a702ee-bbd7-4f21-b97e-aa0cf22dbfe6 req-33ea69ce-3c9d-461d-9b6c-e34c6efc9c21 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1631887 Dec 21 03:48:07.119828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47918) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:07.239465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59a702ee-bbd7-4f21-b97e-aa0cf22dbfe6 req-c98996ab-18c8-41fd-b016-973490e90b9b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1680014 Dec 21 03:48:07.255654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-bae945aa-084b-4dd8-b21a-134f1897071f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:07.260736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-bae945aa-084b-4dd8-b21a-134f1897071f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1981580 Dec 21 03:48:07.318744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-89e350cd-be90-461a-b663-b1d8f4bf6b45 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0469298 Dec 21 03:48:07.435248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-2124633782-network', 'tenant_id': '312e76b5662644cd80c71ddc59520e9a'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:07.535430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-31adfa38-a446-4010-8451-1a09bfe7f0fe service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2044597 Dec 21 03:48:07.545324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Made reservation on behalf of 312e76b5662644cd80c71ddc59520e9a for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:07.548500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:07.562851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:07.747894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ebda93a-712f-4a85-a8a4-124dde32d816 req-e97974f3-3c70-4d11-9dbc-0e122d34f223 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:07.764767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ebda93a-712f-4a85-a8a4-124dde32d816 req-e97974f3-3c70-4d11-9dbc-0e122d34f223 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:07.765691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:07.772226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ebda93a-712f-4a85-a8a4-124dde32d816 req-e97974f3-3c70-4d11-9dbc-0e122d34f223 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1682 time: 0.2338059 Dec 21 03:48:07.831284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:07.882845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:48:07.912903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:07.913505 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Added segment 7b8deec8-8ff1-4898-9af4-0735e68f2e3a of type vlan for network 129b2302-7816-412e-834e-da61125b0dc4 Dec 21 03:48:07.918501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ebda93a-712f-4a85-a8a4-124dde32d816 req-1b4ceb3c-1bc5-473e-b135-a142131b916d tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391380 Dec 21 03:48:07.921797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9f901e1-52c4-48d4-bb09-b4e71d6b6fe5 req-9d528650-51ce-47e1-aa0e-bb6d8765bd76 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3557317 Dec 21 03:48:07.943063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3d3be71-ed6d-4068-8a1a-86583d58bb6b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:08.050603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:08.192581 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:08.194489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:08.195130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:08.242720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-2c124704-1ba5-4d80-8e0b-18f274bb6170 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:08.244358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-2c124704-1ba5-4d80-8e0b-18f274bb6170 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1095 time: 0.1559839 Dec 21 03:48:08.407869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-4d0568f7-403a-466a-8b48-6de51cd1d6aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:08.409639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-4d0568f7-403a-466a-8b48-6de51cd1d6aa service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1541896 Dec 21 03:48:08.424548 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.3003852 Dec 21 03:48:08.425442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:08.430561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Request body: {'subnet': {'network_id': '129b2302-7816-412e-834e-da61125b0dc4', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupRulesNegativeTestJSON-2124633782-subnet', 'tenant_id': '312e76b5662644cd80c71ddc59520e9a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:08.435635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2faecb47-c09d-42bc-9fb4-d5a7530dbb6f admin admin] Pushing event updated for resources: {'Network': ['ID=129b2302-7816-412e-834e-da61125b0dc4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:08.447690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 129b2302-7816-412e-834e-da61125b0dc4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:48:08.499821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340b2b58-ac3b-4a73-a9a7-6f9bad109e04 req-2e8a4e44-1679-4c6a-913d-aee61e3df8f3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:08.508439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-340b2b58-ac3b-4a73-a9a7-6f9bad109e04 req-2e8a4e44-1679-4c6a-913d-aee61e3df8f3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.3424828 Dec 21 03:48:08.522526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-e66043dc-dde2-4f33-bb86-645914a02853 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 217 time: 0.0953922 Dec 21 03:48:08.620643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Made reservation on behalf of 312e76b5662644cd80c71ddc59520e9a for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:08.623679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:08.649595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8260853a-a02e-45e5-848c-3f99f8436b44 req-1338af60-af66-4224-9c33-823882435aca tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:08.657799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8260853a-a02e-45e5-848c-3f99f8436b44 req-1338af60-af66-4224-9c33-823882435aca tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.2526813 Dec 21 03:48:08.667753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-340b2b58-ac3b-4a73-a9a7-6f9bad109e04 req-2ee5d748-fdba-4040-b2d9-26cfaf8b4bcd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1582143 Dec 21 03:48:08.689405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-7cb7f7d9-88b0-4919-b971-8cbdf3c81273 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:08.694262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-7cb7f7d9-88b0-4919-b971-8cbdf3c81273 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1589754 Dec 21 03:48:08.743211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-01b61336-821e-4c26-b1ed-d2fa83d0fe2b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0355067 Dec 21 03:48:08.805659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8260853a-a02e-45e5-848c-3f99f8436b44 req-3ba125cc-61cf-41f8-8688-a062d2896e92 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1469696 Dec 21 03:48:08.898153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-146761c8-1ef3-40b9-b1ba-c5706635f215 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1346133 Dec 21 03:48:09.038923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.131543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7008ad72-f3a7-4e18-b384-e4e3278ec757 req-9b52751d-f21f-492f-80cd-5534b228cc42 service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2245977 Dec 21 03:48:09.171150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-182d65d1-0b8c-4942-b9ee-94b44b5c2845 req-7da15f45-3557-4169-b52c-4835dae26833 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:09.178855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-182d65d1-0b8c-4942-b9ee-94b44b5c2845 req-7da15f45-3557-4169-b52c-4835dae26833 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:09.183101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-182d65d1-0b8c-4942-b9ee-94b44b5c2845 req-7da15f45-3557-4169-b52c-4835dae26833 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1682 time: 0.1767969 Dec 21 03:48:09.198096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47974) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:09.209012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Pushing event updated for resources: {'Subnet': ['ID=08e7be3d-b12f-4d5f-ac09-9170fd38a0cd,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:09.224032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Checking segment: {'id': '7b8deec8-8ff1-4898-9af4-0735e68f2e3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '129b2302-7816-412e-834e-da61125b0dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:09.224406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Network hostable DHCP agents. Network: 129b2302-7816-412e-834e-da61125b0dc4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:48:09.292139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-182d65d1-0b8c-4942-b9ee-94b44b5c2845 req-14642747-ea88-4514-8ca8-15427dc2e156 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996852 Dec 21 03:48:09.436808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Network 129b2302-7816-412e-834e-da61125b0dc4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:48:09.443977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a6f5bc1-f23b-4204-bc2d-a1804359fe73 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.520155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 129b2302-7816-412e-834e-da61125b0dc4) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:09.530690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:09.532079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.535897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa5ed1b4-c10b-495a-99a2-8871b024143e None None] Network 129b2302-7816-412e-834e-da61125b0dc4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:09.605956 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a6f5bc1-f23b-4204-bc2d-a1804359fe73 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.685678 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4f6eb007-9118-45c3-ac7c-15e283c09f39 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.2591803 Dec 21 03:48:09.728328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a6f5bc1-f23b-4204-bc2d-a1804359fe73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.760200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06237be9-fd25-48a3-b093-44ca4429d5c2 None None] Network 129b2302-7816-412e-834e-da61125b0dc4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:09.783413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4a6f5bc1-f23b-4204-bc2d-a1804359fe73 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0c68368d9ed44023b5036c50ac7de868&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5844109 Dec 21 03:48:09.783955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47990) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:09.878627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a6f5bc1-f23b-4204-bc2d-a1804359fe73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d636ddbb-7122-4b59-8d82-e6cb2d78e3eb,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:09.924997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55142d80-337f-43bb-aaa1-51f5c1348700 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.974454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55142d80-337f-43bb-aaa1-51f5c1348700 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:09.996567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56beeb6e-3c0a-4434-aa22-62b80760e1dc req-7a1f41e8-11b0-4a51-a1d0-e2720ccf3639 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:10.009921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56beeb6e-3c0a-4434-aa22-62b80760e1dc req-7a1f41e8-11b0-4a51-a1d0-e2720ccf3639 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1232686 Dec 21 03:48:10.127355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56beeb6e-3c0a-4434-aa22-62b80760e1dc req-9c34c0ba-a308-4969-9baa-3158feae6ca5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1084378 Dec 21 03:48:10.186134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55142d80-337f-43bb-aaa1-51f5c1348700 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:10.189614 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55142d80-337f-43bb-aaa1-51f5c1348700 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:10.190968 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-55142d80-337f-43bb-aaa1-51f5c1348700 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d636ddbb-7122-4b59-8d82-e6cb2d78e3eb HTTP/1.1" status: 204 len: 168 time: 0.4051635 Dec 21 03:48:10.220499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55142d80-337f-43bb-aaa1-51f5c1348700 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d636ddbb-7122-4b59-8d82-e6cb2d78e3eb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:10.327319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f27ad62-049c-40f9-9ac2-d890ac50257f req-fbbc1829-081e-4b5a-a226-520e95331dac tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:10.337107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f27ad62-049c-40f9-9ac2-d890ac50257f req-fbbc1829-081e-4b5a-a226-520e95331dac tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1316428 Dec 21 03:48:10.465252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f27ad62-049c-40f9-9ac2-d890ac50257f req-a8577cdb-3cb5-45af-8f3d-a714b15f27a5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1271527 Dec 21 03:48:10.736444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c62545-540a-4b94-a325-d55709a60c87 req-984bd3ed-ca70-4627-a857-1bedc2b3cf13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:10.745730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c62545-540a-4b94-a325-d55709a60c87 req-984bd3ed-ca70-4627-a857-1bedc2b3cf13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:10.747605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30c62545-540a-4b94-a325-d55709a60c87 req-984bd3ed-ca70-4627-a857-1bedc2b3cf13 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1682 time: 0.1745992 Dec 21 03:48:10.820189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30c62545-540a-4b94-a325-d55709a60c87 req-f5d2506e-dc87-4561-be9f-5e992041b43c tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638225 Dec 21 03:48:10.824866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-35d28654-12ca-4012-99cd-e595587fbeb5 req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1493793001', 'description': 'tempest-description-231305816'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:11.243582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba8ebd0-453e-4a34-a249-8be5e78719a6 req-6df9d56d-8a25-402c-a6d2-3bb12db7e749 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:11.245096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ba8ebd0-453e-4a34-a249-8be5e78719a6 req-6df9d56d-8a25-402c-a6d2-3bb12db7e749 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.0501418 Dec 21 03:48:11.293936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ba8ebd0-453e-4a34-a249-8be5e78719a6 req-ec907966-9893-42d0-8daa-2c975ba4c65a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421205 Dec 21 03:48:11.440468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-35d28654-12ca-4012-99cd-e595587fbeb5 req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:11.525971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-35d28654-12ca-4012-99cd-e595587fbeb5 req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:11.622561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d3eff9-b2c4-47e3-9b8e-53f0ffb73dab req-6cc0ce7d-56d9-4a29-abe7-0aa87d2b349e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:11.630511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7d3eff9-b2c4-47e3-9b8e-53f0ffb73dab req-6cc0ce7d-56d9-4a29-abe7-0aa87d2b349e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.0671542 Dec 21 03:48:11.645538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-35d28654-12ca-4012-99cd-e595587fbeb5 req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:11.711537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7d3eff9-b2c4-47e3-9b8e-53f0ffb73dab req-d704868d-fa50-402b-a41b-9b72668c1151 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798450 Dec 21 03:48:11.744199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9aaa960d-ce9a-4fd5-ae25-feb8b159de37,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:11.769213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-35d28654-12ca-4012-99cd-e595587fbeb5 req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:11.775335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35d28654-12ca-4012-99cd-e595587fbeb5 req-ec442a79-6113-481c-9a0f-ed817201daa7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1834 time: 0.9525430 Dec 21 03:48:11.786827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-cfbe4a5e-1b34-40f7-a70a-2335f650692b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:11.788012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48040) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:11.794120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-cfbe4a5e-1b34-40f7-a70a-2335f650692b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:11.795781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-cfbe4a5e-1b34-40f7-a70a-2335f650692b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.54 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1682 time: 0.1268229 Dec 21 03:48:11.809150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-224f46be-d0b6-4e51-8a9d-514db58ec079 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:11.913013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-224f46be-d0b6-4e51-8a9d-514db58ec079 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:11.963954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-12faa852-05d4-4db0-a2f3-67eb4f2127d2 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/9aaa960d-ce9a-4fd5-ae25-feb8b159de37 HTTP/1.1" status: 200 len: 1829 time: 0.1647687 Dec 21 03:48:11.986437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '9aaa960d-ce9a-4fd5-ae25-feb8b159de37', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:11.993786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '9aaa960d-ce9a-4fd5-ae25-feb8b159de37', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:12.039389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-224f46be-d0b6-4e51-8a9d-514db58ec079 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.075762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 47c47db1-99b2-46c2-8459-be68d32f368f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:12.075762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.091485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc5455b-5417-4453-93bb-afb72a911c6d req-5ab7ee0b-4b2a-4c49-80eb-50fe828a1ad7 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:12.101568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc5455b-5417-4453-93bb-afb72a911c6d req-5ab7ee0b-4b2a-4c49-80eb-50fe828a1ad7 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:12.103651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fc5455b-5417-4453-93bb-afb72a911c6d req-5ab7ee0b-4b2a-4c49-80eb-50fe828a1ad7 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 1682 time: 0.1436372 Dec 21 03:48:12.147192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-224f46be-d0b6-4e51-8a9d-514db58ec079 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=431bb103-7f9d-48d9-95e6-974f9e769aaf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:12.167879 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-224f46be-d0b6-4e51-8a9d-514db58ec079 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1ed9a81c2df243ff811356d410346fe5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3786371 Dec 21 03:48:12.174074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48046) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:12.200835 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-960ae16f-e90d-49e6-aac8-98e70339f3c2 service neutron] show failed (client error): The resource could not be found. Dec 21 03:48:12.202169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-960ae16f-e90d-49e6-aac8-98e70339f3c2 service neutron] 10.222.0.54 "GET /v2.0/ports/7be0b6c0-d923-4d30-8201-1599bce159fb/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.2091835 Dec 21 03:48:12.248076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c2bf441-76e1-4edf-8ffe-6766a6228025 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.253100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fc5455b-5417-4453-93bb-afb72a911c6d req-f2c25c14-c725-411b-aed3-b72d15230fe0 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1318843 Dec 21 03:48:12.278778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c2bf441-76e1-4edf-8ffe-6766a6228025 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.291997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.295534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 47c47db1-99b2-46c2-8459-be68d32f368f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47c47db1-99b2-46c2-8459-be68d32f368f,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:12.295989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.320398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 47c47db1-99b2-46c2-8459-be68d32f368f owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:12.344554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.488111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c2bf441-76e1-4edf-8ffe-6766a6228025 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.493006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c2bf441-76e1-4edf-8ffe-6766a6228025 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.494413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2c2bf441-76e1-4edf-8ffe-6766a6228025 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/431bb103-7f9d-48d9-95e6-974f9e769aaf HTTP/1.1" status: 204 len: 168 time: 0.3185208 Dec 21 03:48:12.511509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.512032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2bf441-76e1-4edf-8ffe-6766a6228025 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=431bb103-7f9d-48d9-95e6-974f9e769aaf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:12.549473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=da13181b-987a-4280-a9e5-9a38ab27039f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:12.574266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc35bc5-0e43-4f78-abeb-afdd5a4f9320 req-3ee2b669-eb39-4c36-b126-1105fffbad1a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:12.588203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbc35bc5-0e43-4f78-abeb-afdd5a4f9320 req-3ee2b669-eb39-4c36-b126-1105fffbad1a tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1124659 Dec 21 03:48:12.646919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbc35bc5-0e43-4f78-abeb-afdd5a4f9320 req-703a6bbd-e59f-4d51-aad8-21529d132727 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626631 Dec 21 03:48:12.663978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.671204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0d4a391-9849-466e-9cd2-3fe4b8ea5adf req-5a6903f9-50b8-487f-9b6f-ce1730e942fb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.6912456 Dec 21 03:48:12.716213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.760887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=47c47db1-99b2-46c2-8459-be68d32f368f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:12.814973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c5ea896-20b2-4144-adf2-827178571042 req-b43a6413-7052-4b6f-babb-8f799661e026 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/9aaa960d-ce9a-4fd5-ae25-feb8b159de37 HTTP/1.1" status: 200 len: 2422 time: 0.1190200 Dec 21 03:48:12.859782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 47c47db1-99b2-46c2-8459-be68d32f368f on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:12.863417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:12.867010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-f55fd2d6-bee5-4c59-8cce-a548fbb9a5af tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.54 "DELETE /v2.0/ports/47c47db1-99b2-46c2-8459-be68d32f368f HTTP/1.1" status: 204 len: 173 time: 1.0608566 Dec 21 03:48:12.867645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-deleted', 'tag': '47c47db1-99b2-46c2-8459-be68d32f368f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:12.870008 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee171e2a-4680-47ec-afc0-25b916392954" -d '{"events": [{"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-deleted", "tag": "47c47db1-99b2-46c2-8459-be68d32f368f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:12.904034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14586de2-446d-49b6-914e-1c3883a41c08 req-9c5f3a5f-2861-411d-aed4-b653c8e55093 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-group-rules/da13181b-987a-4280-a9e5-9a38ab27039f HTTP/1.1" status: 200 len: 778 time: 0.0461519 Dec 21 03:48:13.078618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14586de2-446d-49b6-914e-1c3883a41c08 req-2dc55ce8-5504-4209-9fa8-347b128cda1c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/9aaa960d-ce9a-4fd5-ae25-feb8b159de37 HTTP/1.1" status: 200 len: 2422 time: 0.1723220 Dec 21 03:48:13.141157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee621d5-6d14-4fd2-986a-49978c36b1dc req-a885f187-8a61-41c6-87f7-762e0bb68e04 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:13.142900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee621d5-6d14-4fd2-986a-49978c36b1dc req-a885f187-8a61-41c6-87f7-762e0bb68e04 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.2354214 Dec 21 03:48:13.186423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14586de2-446d-49b6-914e-1c3883a41c08 req-858eaf32-8d27-4615-925c-ec7527960dea tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.205357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14586de2-446d-49b6-914e-1c3883a41c08 req-858eaf32-8d27-4615-925c-ec7527960dea tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.251692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-f49b60e4-4c7a-4283-b013-d04a1eeca8cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:13.253180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-f49b60e4-4c7a-4283-b013-d04a1eeca8cb service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff&tenant_id=408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 1102 time: 0.1696267 Dec 21 03:48:13.278985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:13.290543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port aebb91e6-09ee-4d92-866b-c742bc0012b3 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:13.290961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.297354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee621d5-6d14-4fd2-986a-49978c36b1dc req-628f398e-d902-4a87-8efb-dc4687a0c0a7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1398096 Dec 21 03:48:13.400737 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c6dee77-d3ab-4b15-9eba-4ac4ef4abdab x-openstack-request-id: req-8c6dee77-d3ab-4b15-9eba-4ac4ef4abdab {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:13.401135 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-deleted", "tag": "47c47db1-99b2-46c2-8459-be68d32f368f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:13.401474 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8c6dee77-d3ab-4b15-9eba-4ac4ef4abdab {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:13.401872 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-deleted', 'tag': '47c47db1-99b2-46c2-8459-be68d32f368f', 'status': 'completed', 'code': 200} Dec 21 03:48:13.417509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14586de2-446d-49b6-914e-1c3883a41c08 req-858eaf32-8d27-4615-925c-ec7527960dea tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.430867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14586de2-446d-49b6-914e-1c3883a41c08 req-858eaf32-8d27-4615-925c-ec7527960dea tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.443606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14586de2-446d-49b6-914e-1c3883a41c08 req-858eaf32-8d27-4615-925c-ec7527960dea tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/da13181b-987a-4280-a9e5-9a38ab27039f HTTP/1.1" status: 204 len: 173 time: 0.3627038 Dec 21 03:48:13.453724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.481597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858eaf32-8d27-4615-925c-ec7527960dea tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=da13181b-987a-4280-a9e5-9a38ab27039f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:13.905843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-fefb71f4-903c-44ad-8821-74f8bcf5b965 req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-424815484', 'description': 'tempest-description-1007191958'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:13.919808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port aebb91e6-09ee-4d92-866b-c742bc0012b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aebb91e6-09ee-4d92-866b-c742bc0012b3,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:13.920051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:13.977389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for aebb91e6-09ee-4d92-866b-c742bc0012b3 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:14.162474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c5215a-0603-44d7-a4ee-fc93ef9539f7 req-2b9d094c-f752-4759-86d6-5571f50cde8b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:14.162474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c5215a-0603-44d7-a4ee-fc93ef9539f7 req-2b9d094c-f752-4759-86d6-5571f50cde8b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 945 time: 0.2818093 Dec 21 03:48:14.272777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fefb71f4-903c-44ad-8821-74f8bcf5b965 req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.314118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c5215a-0603-44d7-a4ee-fc93ef9539f7 req-9f9f112b-118b-467f-a09b-4e5fa20101a7 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/security-groups?id=ee8f46ef-0867-4837-a5c1-b137634c081d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1396599 Dec 21 03:48:14.355585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:14.452849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:14.520043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fefb71f4-903c-44ad-8821-74f8bcf5b965 req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.543721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.589595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.598905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=aebb91e6-09ee-4d92-866b-c742bc0012b3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:14.638723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Transition to ACTIVE for port object 7be0b6c0-d923-4d30-8201-1599bce159fb will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:14.639143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fefb71f4-903c-44ad-8821-74f8bcf5b965 req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.641054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aebb91e6-09ee-4d92-866b-c742bc0012b3 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:14.670651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06392e94-6abd-4f3d-99cc-1ea8ddbeff65 req-2ad52a55-acc0-45df-803d-2e8ba8c7c427 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:14.673057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06392e94-6abd-4f3d-99cc-1ea8ddbeff65 req-2ad52a55-acc0-45df-803d-2e8ba8c7c427 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1763072 Dec 21 03:48:14.676666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port aebb91e6-09ee-4d92-866b-c742bc0012b3 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:14.695597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: aebb91e6-09ee-4d92-866b-c742bc0012b3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:14.696536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aebb91e6-09ee-4d92-866b-c742bc0012b3 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:14.697040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47c47db1-99b2-46c2-8459-be68d32f368f no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:14.699242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.704916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96d59a75-9d60-49aa-8a48-aca2f3a442c4 req-ebe3f855-e96a-48f3-8ddc-b88e8568379b tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.54 "DELETE /v2.0/ports/aebb91e6-09ee-4d92-866b-c742bc0012b3 HTTP/1.1" status: 204 len: 173 time: 1.7983131 Dec 21 03:48:14.729977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 47c47db1-99b2-46c2-8459-be68d32f368f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:14.730337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47c47db1-99b2-46c2-8459-be68d32f368f not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:14.736199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:14.776020 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:14.817513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b06ad91e-305a-4d86-964c-128cfbe725ae,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:14.906744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 7be0b6c0-d923-4d30-8201-1599bce159fb host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:48:14.909825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:15.006471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06392e94-6abd-4f3d-99cc-1ea8ddbeff65 req-f0d310af-4deb-4f6a-908f-1654ff77aa74 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2941914 Dec 21 03:48:15.015452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fefb71f4-903c-44ad-8821-74f8bcf5b965 req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:15.041061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fefb71f4-903c-44ad-8821-74f8bcf5b965 req-13023200-8f08-463c-ba17-5597a932eee7 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1834 time: 1.1664743 Dec 21 03:48:15.190544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] No DVR routers for this DVR port 7be0b6c0-d923-4d30-8201-1599bce159fb on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:15.261846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:15.315216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:15.323290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:15.323290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:15.323290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:15.323290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:15.341620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 47, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:15.341899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:15.342356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:15.342788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Bound port: 7be0b6c0-d923-4d30-8201-1599bce159fb, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:15.343169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:15.391842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae75869-ad12-466a-9c49-1b11d31d9f85 req-57338bef-12bb-43bd-8e15-85750f2013e7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:15.407452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae75869-ad12-466a-9c49-1b11d31d9f85 req-57338bef-12bb-43bd-8e15-85750f2013e7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1982043 Dec 21 03:48:15.449263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}, {'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-deleted', 'tag': 'aebb91e6-09ee-4d92-866b-c742bc0012b3'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:15.451586 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa039355-6343-4993-a5fd-727fcca495d5" -d '{"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-unplugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}, {"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-deleted", "tag": "aebb91e6-09ee-4d92-866b-c742bc0012b3"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:15.529534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d38ec11-62d9-4fad-8de1-f119e9eee001 req-afdb0ef8-11a4-4837-bd63-4dcac162efd2 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/b06ad91e-305a-4d86-964c-128cfbe725ae HTTP/1.1" status: 200 len: 1829 time: 0.1149719 Dec 21 03:48:15.573855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae75869-ad12-466a-9c49-1b11d31d9f85 req-f924a8ec-e4a4-40d8-8aaa-ac0492c843ca tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1642854 Dec 21 03:48:15.584617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:15.588358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:15.689865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145287ff-31ba-48c0-a523-be3dc7aa6038 req-8c44e924-b9b6-4a30-9a3d-58b7fbdb4a5e tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "GET /v2.0/ports?device_id=a664715e-9689-471e-b499-cee0814f76ef HTTP/1.1" status: 200 len: 210 time: 0.0385294 Dec 21 03:48:15.691437 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe1cac23-5af0-4112-afe2-4fa264aea6bf x-openstack-request-id: req-fe1cac23-5af0-4112-afe2-4fa264aea6bf {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:15.691797 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-unplugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "code": 200}, {"server_uuid": "a664715e-9689-471e-b499-cee0814f76ef", "name": "network-vif-deleted", "tag": "aebb91e6-09ee-4d92-866b-c742bc0012b3", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:15.692317 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fe1cac23-5af0-4112-afe2-4fa264aea6bf {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:15.692828 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'code': 200} Dec 21 03:48:15.693154 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a664715e-9689-471e-b499-cee0814f76ef', 'name': 'network-vif-deleted', 'tag': 'aebb91e6-09ee-4d92-866b-c742bc0012b3', 'status': 'completed', 'code': 200} Dec 21 03:48:15.694873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:15.755131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e1fa025e-4a95-4cb1-afd9-d3f9f7484521 req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-175983320', 'description': 'tempest-description-196345701'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:15.771940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:15.772571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:15.774767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] 10.222.0.31 "PUT /v2.0/ports/7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 1097 time: 2.5031252 Dec 21 03:48:15.791997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-156918f2-147a-49bc-92df-bdf8ea5b944a service neutron] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:15.892573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-a97c5176-50c9-4dcf-af9c-3d5f7703bdff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:15.895871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-a97c5176-50c9-4dcf-af9c-3d5f7703bdff service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1100 time: 0.0679452 Dec 21 03:48:15.945136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Request body: {'security_group': {'name': 'tempest-securitygroup-524594767', 'description': 'tempest-description-210045732'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:16.030267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-65a8c8c6-f233-4f4c-9a2d-bca54a27aca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:16.031772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-65a8c8c6-f233-4f4c-9a2d-bca54a27aca8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1246500 Dec 21 03:48:16.083511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e1fa025e-4a95-4cb1-afd9-d3f9f7484521 req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.096345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-a5faf441-0083-48bc-9fd4-c2d213db59dc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0403101 Dec 21 03:48:16.168834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-1fc354c9-d772-46cb-a30a-c4065add7d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:16.168834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-1fc354c9-d772-46cb-a30a-c4065add7d6a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0691676 Dec 21 03:48:16.259341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e1fa025e-4a95-4cb1-afd9-d3f9f7484521 req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.262635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-77cf1ab8-ee13-48a1-bda9-9e0ea3949e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:16.264193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-77cf1ab8-ee13-48a1-bda9-9e0ea3949e3c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0846300 Dec 21 03:48:16.303821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.316812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.413438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-4cd027a7-cb33-47e6-abb2-2b8480fd0cc6 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1368277 Dec 21 03:48:16.446305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e1fa025e-4a95-4cb1-afd9-d3f9f7484521 req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.539892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4c0c82b4-06a4-41c6-a553-e4c97507d9ca,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:16.553238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.573344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e70f0b-0a62-4404-b5fa-bb2057249db6 req-d9732f36-9d8e-4d24-8d4a-490deff93b34 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1479914 Dec 21 03:48:16.684640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e1fa025e-4a95-4cb1-afd9-d3f9f7484521 req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.686636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1fa025e-4a95-4cb1-afd9-d3f9f7484521 req-51e08cb8-28e8-4346-b7af-619c8eea397c tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1833 time: 0.9443045 Dec 21 03:48:16.744197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.811944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1af3ce9d-2040-4e91-9501-3fe37a77e2c4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:16.836710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea97b6b-55b6-4764-8c8b-27087534bb05 req-857e54e5-4915-4124-84f7-fbbf0b754759 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:16.836710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea97b6b-55b6-4764-8c8b-27087534bb05 req-857e54e5-4915-4124-84f7-fbbf0b754759 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 948 time: 0.0961068 Dec 21 03:48:16.876842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:16.900984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea97b6b-55b6-4764-8c8b-27087534bb05 req-07a9aa5b-f787-4cd9-a4e9-9302116762ef tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627406 Dec 21 03:48:16.994083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.027441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3589ffb0-0ef7-4f9b-9f0e-2a382e176669,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:17.146820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.148057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56bb125f-0a18-47a1-9628-0e4df52f899f req-b8e0d853-fbf8-4084-85db-cf0b14de743b tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 1.2089128 Dec 21 03:48:17.164955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8d126f-d45b-45c5-94bf-426394ba4c3c req-af221350-7e24-4645-848e-e00eb4808619 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:17.166439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e8d126f-d45b-45c5-94bf-426394ba4c3c req-af221350-7e24-4645-848e-e00eb4808619 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.0535069 Dec 21 03:48:17.231480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1003401d-0fdd-40ed-96f7-df984389edcb req-d0896e1f-0eed-4d69-ab37-6c893b311658 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/4c0c82b4-06a4-41c6-a553-e4c97507d9ca HTTP/1.1" status: 200 len: 1828 time: 0.0640404 Dec 21 03:48:17.249735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e8d126f-d45b-45c5-94bf-426394ba4c3c req-da9595e8-00c7-4a30-b888-30a91ae17f90 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759785 Dec 21 03:48:17.280907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48196) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:17.293008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-34cafb62-d1e0-4555-9ed6-cf76088b3182 req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Request body: {'security_group': {'name': 'tempest-securitygroup-782860280', 'description': 'tempest-description-2046380596'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:17.322745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f49c12fc-1886-42bf-9a50-72b85309cf79 req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-961425279', 'description': 'tempest-description-548963014'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:17.372346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting subnet c64439a7-5fd1-4867-990d-55fe8b8f1bbb {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:48:17.378412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.421496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.494511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34cafb62-d1e0-4555-9ed6-cf76088b3182 req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.501989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f49c12fc-1886-42bf-9a50-72b85309cf79 req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.544626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.665775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34cafb62-d1e0-4555-9ed6-cf76088b3182 req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.668082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f49c12fc-1886-42bf-9a50-72b85309cf79 req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.694090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:17.696469 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60139068-01bf-43a1-9cba-4838beb19ab9" -d '{"events": [{"name": "network-changed", "server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:17.754958 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.786772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f49c12fc-1886-42bf-9a50-72b85309cf79 req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.789028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Subnet': ['ID=c64439a7-5fd1-4867-990d-55fe8b8f1bbb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:17.790721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34cafb62-d1e0-4555-9ed6-cf76088b3182 req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.805388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.807939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41202e78-c202-4df4-9975-8789d1ac4d64 None None] Network 65cd0343-3e56-4d28-b026-1efe272456ef requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:17.808536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fa3a8895-f2c1-48de-8581-d4a9489e8706 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/subnets/c64439a7-5fd1-4867-990d-55fe8b8f1bbb HTTP/1.1" status: 204 len: 168 time: 0.5264487 Dec 21 03:48:17.811362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48202) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:17.832856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c87de05-c073-4861-b518-3815a642483a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:17.860868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f270bfc7-d252-4eec-84f6-cedeb7772367,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:17.898835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.905026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f49c12fc-1886-42bf-9a50-72b85309cf79 req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.906332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f49c12fc-1886-42bf-9a50-72b85309cf79 req-667670d2-c76c-41f5-acb5-ce7f039d8a26 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1833 time: 0.6063421 Dec 21 03:48:17.958631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 104843bf-4949-4494-9c96-3e0624e2bc72 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:17.958755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.962676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34cafb62-d1e0-4555-9ed6-cf76088b3182 req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:17.979947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34cafb62-d1e0-4555-9ed6-cf76088b3182 req-be4447b4-70fa-4f03-9e99-3955e7bc65b8 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.6998489 Dec 21 03:48:17.986726 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d6fd102-1448-40c2-bb06-a4bf0c94d5ab x-openstack-request-id: req-5d6fd102-1448-40c2-bb06-a4bf0c94d5ab {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:17.987497 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:17.987497 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5d6fd102-1448-40c2-bb06-a4bf0c94d5ab {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:17.989057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] DHCP port deletion for 65cd0343-3e56-4d28-b026-1efe272456ef request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:48:17.989908 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'status': 'completed', 'code': 200} Dec 21 03:48:18.047841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] Deleting port 104843bf-4949-4494-9c96-3e0624e2bc72 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:18.048234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.058022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 104843bf-4949-4494-9c96-3e0624e2bc72, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=104843bf-4949-4494-9c96-3e0624e2bc72,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:18.058683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.072757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 104843bf-4949-4494-9c96-3e0624e2bc72 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:18.119041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] For port 104843bf-4949-4494-9c96-3e0624e2bc72, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=104843bf-4949-4494-9c96-3e0624e2bc72,segment=NetworkSegment(11b27198-f796-49c2-bb1b-da4ad92e1d22),segment_id=11b27198-f796-49c2-bb1b-da4ad92e1d22)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:18.119626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.134343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] Calling delete_port for 104843bf-4949-4494-9c96-3e0624e2bc72 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:18.157408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75d38fb8-c9fb-4bdb-971b-6c95f08f166d req-c40fdd9b-7a34-425c-816d-403784c48490 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/3c87de05-c073-4861-b518-3815a642483a HTTP/1.1" status: 200 len: 1828 time: 0.1651001 Dec 21 03:48:18.166772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-ce8be1e5-f248-4ab2-b34c-ad13903908c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.168968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-ce8be1e5-f248-4ab2-b34c-ad13903908c3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1100 time: 0.1372802 Dec 21 03:48:18.192637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-97bdff99-f481-4875-ae18-141c71bd8cf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.194152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-97bdff99-f481-4875-ae18-141c71bd8cf6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1100 time: 0.1672127 Dec 21 03:48:18.240958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53e36e5-f67b-42c9-b470-9b5af4062421 req-1ab60327-82b4-4ee0-9e9a-9347fdb0a495 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.242565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d53e36e5-f67b-42c9-b470-9b5af4062421 req-1ab60327-82b4-4ee0-9e9a-9347fdb0a495 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 948 time: 0.1505275 Dec 21 03:48:18.278742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.284327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Request body: {'security_group': {'name': 'tempest-securitygroup-808212513', 'description': 'tempest-description-184198681'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:18.296088 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.308689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=104843bf-4949-4494-9c96-3e0624e2bc72,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:18.310320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] Pushing event deleted for resources: {'Port': ['ID=104843bf-4949-4494-9c96-3e0624e2bc72,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:18.310888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 104843bf-4949-4494-9c96-3e0624e2bc72 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:18.314293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6acacf9a-63d8-4601-ad27-da1a3ad117f9 None None] No DVR routers for this DVR port 104843bf-4949-4494-9c96-3e0624e2bc72 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:18.396990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.417867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-79c3c5f4-8e06-425e-803a-660210529cc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.419381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-79c3c5f4-8e06-425e-803a-660210529cc3 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2396362 Dec 21 03:48:18.419508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['65cd0343-3e56-4d28-b026-1efe272456ef']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:18.428656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d53e36e5-f67b-42c9-b470-9b5af4062421 req-e4aa67a4-a4e9-4a29-8d85-28c4f209a23e tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1735227 Dec 21 03:48:18.428845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '11b27198-f796-49c2-bb1b-da4ad92e1d22') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:18.428954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '11b27198-f796-49c2-bb1b-da4ad92e1d22') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:18.439589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.440484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-75c7cbd5-825b-4c46-9db9-436602afddbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.441927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-75c7cbd5-825b-4c46-9db9-436602afddbb service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2366586 Dec 21 03:48:18.465420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.472544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:48:18.472929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:48:18.476102 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:48:18.480970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-1aaf4847-f433-486d-af04-a8ec76223ef1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0513694 Dec 21 03:48:18.519248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-f0e8c856-f341-42a9-85bc-e3eddcfdf6cd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0449972 Dec 21 03:48:18.521102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.579162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.619158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2beab812-34be-4a51-b225-1533006216fa req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1980207518', 'description': 'tempest-description-1243196682'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:18.635037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-963e825d-f9c6-48c0-aadc-7da43e3f5d55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.636498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-963e825d-f9c6-48c0-aadc-7da43e3f5d55 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1268799 Dec 21 03:48:18.647980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-484f554b-d9c7-49b8-9a3d-ed3818a8473a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.649486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-484f554b-d9c7-49b8-9a3d-ed3818a8473a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1055882 Dec 21 03:48:18.670866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.675255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.682605 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/networks/65cd0343-3e56-4d28-b026-1efe272456ef HTTP/1.1" status: 204 len: 168 time: 0.8664789 Dec 21 03:48:18.682801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48232) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:18.718461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c56ad2a-18fa-40ea-8bbe-bc5a36424f7a tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Network': ['ID=65cd0343-3e56-4d28-b026-1efe272456ef,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:18.746422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting subnet 90423e11-83e3-4a02-8325-6b52e25ac647 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:48:18.753319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.757285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-85ce7ef1-8d77-4ad7-b462-df7399eed3e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.758827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-85ce7ef1-8d77-4ad7-b462-df7399eed3e5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1136661 Dec 21 03:48:18.784568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-2e7380d7-2e5e-425e-a490-9d1a09d65035 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:18.786146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-2e7380d7-2e5e-425e-a490-9d1a09d65035 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1207330 Dec 21 03:48:18.795694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.817125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.867881 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2beab812-34be-4a51-b225-1533006216fa req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.883738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.945950 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:18.997529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-b2e5e0d6-b072-4735-a5d3-9450e97cc8ec service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2260621 Dec 21 03:48:18.999407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-22ea82ee-74ef-47f2-8c09-045afbada543 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1997993 Dec 21 03:48:19.065999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.070245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fb6cab8-fc4e-430b-9d78-f99b32bf0fa6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:19.105599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Subnet': ['ID=90423e11-83e3-4a02-8325-6b52e25ac647,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:19.108182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.115461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8a0aa98-731b-4ad1-b228-e2fd5e0fd545 None None] Network 74b92324-668f-4e02-853d-3aaf26a99a26 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:19.116116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-005226d7-50b2-4687-b7ec-acb9e156dba5 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/subnets/90423e11-83e3-4a02-8325-6b52e25ac647 HTTP/1.1" status: 204 len: 168 time: 0.4317954 Dec 21 03:48:19.116968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48236) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:19.153186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 104843bf-4949-4494-9c96-3e0624e2bc72 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:19.175360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 104843bf-4949-4494-9c96-3e0624e2bc72 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:19.175712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 104843bf-4949-4494-9c96-3e0624e2bc72 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:19.196368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2beab812-34be-4a51-b225-1533006216fa req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.209422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.213081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.241297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-4a8b782d-8abd-4162-bcd0-785457b538f4 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2170613 Dec 21 03:48:19.245022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60139068-01bf-43a1-9cba-4838beb19ab9 req-e53accd9-54c9-4a81-b49f-8af07b1bbe89 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2362189 Dec 21 03:48:19.275363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2beab812-34be-4a51-b225-1533006216fa req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.289873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Deleting port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:19.290602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.306575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=503f6c96-09cf-4465-88bb-37323ebf2eac,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:19.318895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.341295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26056f4e-8bb4-4cfe-9684-370903919703,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:19.360750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] DHCP port deletion for 74b92324-668f-4e02-853d-3aaf26a99a26 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:48:19.363134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] For port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:19.363564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.379376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Calling delete_port for 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:19.411668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] Deleting port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:19.412048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.462442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2beab812-34be-4a51-b225-1533006216fa req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.463771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2beab812-34be-4a51-b225-1533006216fa req-1fa29dde-4a7c-4139-aa7b-f3ef100d567f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1835 time: 0.8605986 Dec 21 03:48:19.478264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] For port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,segment=NetworkSegment(2422dd6d-5de4-4305-9d41-4b5afbffe8bb),segment_id=2422dd6d-5de4-4305-9d41-4b5afbffe8bb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:19.478759 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.491665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] Calling delete_port for 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:19.533952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.536787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36253fab-d3a0-448b-8ea6-d2e7785cff6e req-f8879f7b-e15a-47a9-adb0-007e7494531a tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 1.2847223 Dec 21 03:48:19.563734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.578666 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.603713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] Pushing event deleted for resources: {'Port': ['ID=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:19.607587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d46da8-f398-4b7a-84f8-f93c207ed07c None None] No DVR routers for this DVR port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:19.623600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Port': ['ID=7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:19.625879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] No DVR routers for this DVR port 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:19.633836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d808ed4e-6888-43e6-a3b1-41c08535a32c req-1a40ab94-a870-44f1-9e01-5ce3f619adfe tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:19.635706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d808ed4e-6888-43e6-a3b1-41c08535a32c req-1a40ab94-a870-44f1-9e01-5ce3f619adfe tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1176829 Dec 21 03:48:19.697237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d808ed4e-6888-43e6-a3b1-41c08535a32c req-cacf0723-c524-40d3-a31d-0dd3818ae664 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533073 Dec 21 03:48:19.723997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.743237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74b92324-668f-4e02-853d-3aaf26a99a26']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:19.754416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00210d80-5319-4d33-993b-9c183e108dee req-516393c2-9a20-49dd-b8c6-a0a5f4cbfb4b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:19.755212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2422dd6d-5de4-4305-9d41-4b5afbffe8bb') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:19.755514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2422dd6d-5de4-4305-9d41-4b5afbffe8bb') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:19.756142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00210d80-5319-4d33-993b-9c183e108dee req-516393c2-9a20-49dd-b8c6-a0a5f4cbfb4b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 948 time: 0.0753367 Dec 21 03:48:19.766277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.779909 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.786094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Releasing vlan 102 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:48:19.786508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:48:19.790422 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:48:19.818671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714da0b3-eb6c-4d79-a31c-5858fef30c8c req-9e2ab785-ad25-4f26-ab74-c32e4feecde9 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/503f6c96-09cf-4465-88bb-37323ebf2eac HTTP/1.1" status: 200 len: 1830 time: 0.0615361 Dec 21 03:48:19.834483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f6e82b0d-ae3f-4329-a9df-e566120f0e77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.844873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00210d80-5319-4d33-993b-9c183e108dee req-0febe283-b9da-4c82-9aae-de880451b4d8 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790255 Dec 21 03:48:19.872086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c5304a06-d227-4133-b8c0-1a2808399e7c req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Request body: {'security_group': {'name': 'tempest-securitygroup-741196732', 'description': 'tempest-description-1074881320'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:19.979526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.988529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:19.992313 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] 10.222.0.18 "DELETE /v2.0/networks/74b92324-668f-4e02-853d-3aaf26a99a26 HTTP/1.1" status: 204 len: 168 time: 0.8734789 Dec 21 03:48:20.009501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591ca359-e912-49e5-a7ea-e787c61268e2 tempest-ServersTestMultiNic-238942122 tempest-ServersTestMultiNic-238942122-project] Pushing event deleted for resources: {'Network': ['ID=74b92324-668f-4e02-853d-3aaf26a99a26,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:20.013649 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5304a06-d227-4133-b8c0-1a2808399e7c req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.087840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5304a06-d227-4133-b8c0-1a2808399e7c req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.202116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5304a06-d227-4133-b8c0-1a2808399e7c req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.228241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56c5c590-d734-4558-a53d-d8daef6f4d62,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:20.324699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5304a06-d227-4133-b8c0-1a2808399e7c req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.325948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5304a06-d227-4133-b8c0-1a2808399e7c req-03146e42-a059-445f-b0f2-ea65c9c8eede tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.4577851 Dec 21 03:48:20.355290 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-94f6c895-45b0-46f5-9018-a9432af92854 req-92294fec-c1c0-4332-aaf0-d41790b70368 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] show failed (client error): The resource could not be found. Dec 21 03:48:20.357555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94f6c895-45b0-46f5-9018-a9432af92854 req-92294fec-c1c0-4332-aaf0-d41790b70368 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/4eb33e1e-7da9-418c-921a-dd2cc25fe231 HTTP/1.1" status: 404 len: 352 time: 0.0173650 Dec 21 03:48:20.647228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:20.658341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:20.735357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-679c88e3-4629-422e-8e7b-d8ff20d07c1e tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 59007 time: 0.3076842 Dec 21 03:48:20.781066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-5afed317-e1f0-4ccc-9545-b7f1e40ce193 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/1af3ce9d-2040-4e91-9501-3fe37a77e2c4 HTTP/1.1" status: 200 len: 2998 time: 0.0375960 Dec 21 03:48:20.810796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:20.824827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-5e490848-f1b6-4610-9892-97be13b9528c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/1af3ce9d-2040-4e91-9501-3fe37a77e2c4 HTTP/1.1" status: 200 len: 2998 time: 0.0363600 Dec 21 03:48:20.827756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.849525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14', 'port_id': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'mac_address': 'fa:16:3e:38:83:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84e57960-b2b1-49b0-85de-36fd5e1ebd6a', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:20.856268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:20.858706 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86724a3a-a778-41de-9d53-5654da3b519e" -d '{"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-unplugged", "status": "completed", "tag": "2245f877-8d64-488f-bc12-d173f88c7450"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:20.873637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:20.873885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-1f284bb7-4457-4a88-a401-cdd4c764fe27 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/2fb6cab8-fc4e-430b-9d78-f99b32bf0fa6 HTTP/1.1" status: 200 len: 2998 time: 0.0405853 Dec 21 03:48:20.906736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.922998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f39fe48f-e6af-49d1-a42c-899b81bdf60b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:20.928629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-878be063-7356-421d-b301-1e83c82493e8 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/2fb6cab8-fc4e-430b-9d78-f99b32bf0fa6 HTTP/1.1" status: 200 len: 2998 time: 0.0480335 Dec 21 03:48:20.941062 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:20.976468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:20.978045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-cd49dbc6-b41d-4439-ace8-9081d9ba1e7c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/3c9fdf78-55d2-4298-bf4d-4e47b82966b1 HTTP/1.1" status: 200 len: 2998 time: 0.0476623 Dec 21 03:48:21.001136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:21.014562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-aa9e2700-18be-49d6-b3c5-7b59f3c142e6 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/3c9fdf78-55d2-4298-bf4d-4e47b82966b1 HTTP/1.1" status: 200 len: 2998 time: 0.0356486 Dec 21 03:48:21.053962 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:21.054686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:21.091323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-cf04358c-7aa4-46be-9a60-1a957859c341 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/55838b97-24c3-4e34-9586-b2323bc79830 HTTP/1.1" status: 200 len: 2998 time: 0.0690746 Dec 21 03:48:21.139640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:21.153737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-81cce75c-a90f-4f9b-88c0-0972a7f89963 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/55838b97-24c3-4e34-9586-b2323bc79830 HTTP/1.1" status: 200 len: 2998 time: 0.0610256 Dec 21 03:48:21.158541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:21.215387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:21.215748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7cc8ea3e-d8fd-4bf2-8252-fa7191bb1f11 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:21.219503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-e0c83753-a7ae-41bb-954a-8b8d34fd74bf tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/566c6b7f-b7f4-464d-9c23-cd6e583d9def HTTP/1.1" status: 200 len: 2998 time: 0.0550318 Dec 21 03:48:21.254159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:21.265454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-82ef25ac-7a15-4dd0-bd55-e327ecb454ab tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/566c6b7f-b7f4-464d-9c23-cd6e583d9def HTTP/1.1" status: 200 len: 2998 time: 0.0485091 Dec 21 03:48:21.269818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'mac_address': 'fa:16:3e:01:64:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.105'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:21.316832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:21.330858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7be0b6c0-d923-4d30-8201-1599bce159fb {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:21.351158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:21.417687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:21.471570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:21.640461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-f9aca078-433c-4a92-b691-44d79ebe8ab6 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/7163d148-c620-49d0-a15c-447e171d8a7a HTTP/1.1" status: 200 len: 2998 time: 0.3679130 Dec 21 03:48:21.644700 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-dcc1c940-df47-4be8-8c2a-544e00616cec req-754981de-9f94-4933-9940-b010979923a8 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] show failed (client error): The resource could not be found. Dec 21 03:48:21.645638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcc1c940-df47-4be8-8c2a-544e00616cec req-754981de-9f94-4933-9940-b010979923a8 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-group-rules/cd9b24d9-3514-4dc0-83d9-8bb521682f16 HTTP/1.1" status: 404 len: 361 time: 0.0155640 Dec 21 03:48:21.706156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-08bd8105-464f-4428-af07-72910139f0ce tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/7163d148-c620-49d0-a15c-447e171d8a7a HTTP/1.1" status: 200 len: 2998 time: 0.0534949 Dec 21 03:48:21.758022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-30b47a69-1798-4390-bce6-893820c45131 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/a4787eaa-1dc9-4c06-8bc8-40ab4a818e9b HTTP/1.1" status: 200 len: 2998 time: 0.0453959 Dec 21 03:48:21.795748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['f39fe48f-e6af-49d1-a42c-899b81bdf60b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:21.820269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d45f6e-ac54-4551-92dd-9d621d478a44 req-3691924f-bd6d-4b45-a1ee-3143b232154a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:21.821739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31d45f6e-ac54-4551-92dd-9d621d478a44 req-3691924f-bd6d-4b45-a1ee-3143b232154a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.0762622 Dec 21 03:48:21.821981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['7be0b6c0-d923-4d30-8201-1599bce159fb'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:21.826689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-7d18f3bc-3dd9-4ff2-8ea3-14f9c0d1c8c5 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/a4787eaa-1dc9-4c06-8bc8-40ab4a818e9b HTTP/1.1" status: 200 len: 2998 time: 0.0559003 Dec 21 03:48:21.900610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31d45f6e-ac54-4551-92dd-9d621d478a44 req-0ccb9113-7b3e-462e-a1bb-c003b6e08bb4 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711386 Dec 21 03:48:21.901854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-847128de-8be0-4999-9219-51167e9ce42e tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/af7d5fbe-4198-4920-9356-ff83261b7d16 HTTP/1.1" status: 200 len: 2998 time: 0.0667436 Dec 21 03:48:21.966166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-449d7f65-84c3-4e51-a192-d6786a1de81f tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/af7d5fbe-4198-4920-9356-ff83261b7d16 HTTP/1.1" status: 200 len: 2998 time: 0.0566409 Dec 21 03:48:21.969626 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67f0f5d0-a33c-4c19-ace5-d1ee84498c95 x-openstack-request-id: req-67f0f5d0-a33c-4c19-ace5-d1ee84498c95 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:21.969919 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-unplugged", "status": "completed", "tag": "2245f877-8d64-488f-bc12-d173f88c7450", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:21.970177 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-67f0f5d0-a33c-4c19-ace5-d1ee84498c95 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:21.970573 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450', 'code': 200} Dec 21 03:48:22.025959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-520db4d8-51b6-415d-b5dd-0cb4e1a7dcd2 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/be4d1d79-41a8-475c-bd15-be387ef5161d HTTP/1.1" status: 200 len: 2998 time: 0.0525360 Dec 21 03:48:22.104693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-8fee29de-a825-4389-aa90-cb15705dbbb0 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/be4d1d79-41a8-475c-bd15-be387ef5161d HTTP/1.1" status: 200 len: 2998 time: 0.0689681 Dec 21 03:48:22.115331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfb599e-6511-4af3-8c3e-e7af5466d755 req-30c7cdea-96d8-4be6-968e-b4136b8bc550 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:22.116793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bfb599e-6511-4af3-8c3e-e7af5466d755 req-30c7cdea-96d8-4be6-968e-b4136b8bc550 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.0745137 Dec 21 03:48:22.150999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-782e5e16-e8fd-4d07-87e7-1ca08e48dade None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:22.176703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-1ca0c264-cb77-45f1-8d96-e871fbe64ea2 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/d3d3be71-ed6d-4068-8a1a-86583d58bb6b HTTP/1.1" status: 200 len: 2998 time: 0.0589626 Dec 21 03:48:22.201131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bfb599e-6511-4af3-8c3e-e7af5466d755 req-47da8cec-0b05-4c1b-b0de-497a571544cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780456 Dec 21 03:48:22.226054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-fd22d831-e845-4a0e-a42b-c82a593dcda4 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/d3d3be71-ed6d-4068-8a1a-86583d58bb6b HTTP/1.1" status: 200 len: 2998 time: 0.0420916 Dec 21 03:48:22.267769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-24a34330-1388-4bbc-b894-8610ea2f5d5f tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/e272fb39-e876-4979-bff7-fe784a6f505e HTTP/1.1" status: 200 len: 2990 time: 0.0355809 Dec 21 03:48:22.312285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-704afa04-78a9-4c60-a89a-c5a6cb3783c6 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/e272fb39-e876-4979-bff7-fe784a6f505e HTTP/1.1" status: 200 len: 2990 time: 0.0372951 Dec 21 03:48:22.355701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-99201a72-d758-4144-9dbf-ebd3c367af9d tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/e7e08fd5-b884-449b-bda4-3e7982fc9b69 HTTP/1.1" status: 200 len: 2998 time: 0.0358908 Dec 21 03:48:22.397076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-1a0a61fa-9c4e-45f9-8025-abb40b71c320 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/e7e08fd5-b884-449b-bda4-3e7982fc9b69 HTTP/1.1" status: 200 len: 2998 time: 0.0350270 Dec 21 03:48:22.443832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-33ba306a-ddfe-4fd6-9387-3952b098aefc tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/ea28cf45-71b3-4f48-819a-07917cba042c HTTP/1.1" status: 200 len: 2994 time: 0.0404732 Dec 21 03:48:22.485721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-8269ba0c-d49e-4fcb-8ed1-7796cdc7ada9 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/ea28cf45-71b3-4f48-819a-07917cba042c HTTP/1.1" status: 200 len: 2994 time: 0.0354340 Dec 21 03:48:22.526368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-cb1604ef-cc4d-4367-87e7-cf6ee0e5eb98 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/ee8f46ef-0867-4837-a5c1-b137634c081d HTTP/1.1" status: 200 len: 2998 time: 0.0346346 Dec 21 03:48:22.554400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:22.567596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-9c49eec0-8cbc-4970-90d6-634a72225b46 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/ee8f46ef-0867-4837-a5c1-b137634c081d HTTP/1.1" status: 200 len: 2998 time: 0.0347912 Dec 21 03:48:22.609860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-8ee0513c-b80c-4b18-a4e7-f4ed945c0396 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/f49e32c9-7ac4-4473-9e8e-3ee032077854 HTTP/1.1" status: 200 len: 2998 time: 0.0358055 Dec 21 03:48:22.654772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b7e3cdc-b268-4e17-80b1-0a9a66904288 req-0886fa9e-7369-4991-87de-b471b1498622 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/f49e32c9-7ac4-4473-9e8e-3ee032077854 HTTP/1.1" status: 200 len: 2998 time: 0.0372846 Dec 21 03:48:22.716089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7eb74db3-1086-4dc7-ab55-462448045e6b req-f510bb1a-a31e-49da-a56c-febb7f76b69a tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/503f6c96-09cf-4465-88bb-37323ebf2eac HTTP/1.1" status: 200 len: 1830 time: 0.0459819 Dec 21 03:48:22.779281 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7eb74db3-1086-4dc7-ab55-462448045e6b req-1e113753-b6c0-4450-a5b7-2bc51db86cee tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:22.803655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7eb74db3-1086-4dc7-ab55-462448045e6b req-1e113753-b6c0-4450-a5b7-2bc51db86cee tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:22.916737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7eb74db3-1086-4dc7-ab55-462448045e6b req-1e113753-b6c0-4450-a5b7-2bc51db86cee tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:22.921099 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7eb74db3-1086-4dc7-ab55-462448045e6b req-1e113753-b6c0-4450-a5b7-2bc51db86cee tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:22.921099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7eb74db3-1086-4dc7-ab55-462448045e6b req-1e113753-b6c0-4450-a5b7-2bc51db86cee tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "DELETE /v2.0/security-groups/503f6c96-09cf-4465-88bb-37323ebf2eac HTTP/1.1" status: 204 len: 173 time: 0.1967402 Dec 21 03:48:22.932039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e113753-b6c0-4450-a5b7-2bc51db86cee tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=503f6c96-09cf-4465-88bb-37323ebf2eac,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:22.999494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e246ad36-0cb5-4bda-8f91-a966741e89de req-8a7b59a4-e716-4b29-9a76-df54f572626d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4191c1d155c14ce78c23c0e6fe1f73a6 HTTP/1.1" status: 200 len: 6152 time: 0.0632091 Dec 21 03:48:23.047339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e246ad36-0cb5-4bda-8f91-a966741e89de req-50187955-5ba5-4275-8de0-c90d74556fbc tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "GET /v2.0/security-groups/1af3ce9d-2040-4e91-9501-3fe37a77e2c4 HTTP/1.1" status: 200 len: 2998 time: 0.0392547 Dec 21 03:48:23.094197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48340) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:23.110772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:23.130062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e246ad36-0cb5-4bda-8f91-a966741e89de req-1281f019-a7b0-4150-8ced-0416a3b1701a tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "GET /v2.0/security-groups/1af3ce9d-2040-4e91-9501-3fe37a77e2c4 HTTP/1.1" status: 200 len: 2998 time: 0.0788291 Dec 21 03:48:23.329538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-736e1c71-ae5f-49b1-b51f-37992fa8ef08 req-1d2f76ce-4c9e-40c0-947b-91b6e1b8087f tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/3c87de05-c073-4861-b518-3815a642483a HTTP/1.1" status: 200 len: 1828 time: 0.1814027 Dec 21 03:48:23.340332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-e567447a-081f-4625-a840-c5419a02f323 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:23.341864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-e567447a-081f-4625-a840-c5419a02f323 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff&tenant_id=408f05064a77442595f2b5d444671b8a&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 949 time: 0.1848040 Dec 21 03:48:23.430471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-d1323170-9e86-46bf-b789-622e7fb78988 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:23.432035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-d1323170-9e86-46bf-b789-622e7fb78988 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.2556138 Dec 21 03:48:23.470882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11cf8a1f-e3d2-462d-a14a-0c173e26b320 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/quotas/597df5e2769740859ecb4f30e4aefff3 HTTP/1.1" status: 200 len: 375 time: 0.0266855 Dec 21 03:48:23.500904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-736e1c71-ae5f-49b1-b51f-37992fa8ef08 req-941a1f68-48ed-4539-99a2-45583766ed60 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:23.500904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-5794e6a2-2cf5-434b-9808-bc117fe89b2f service neutron] 10.222.0.31 "GET /v2.0/ports/7be0b6c0-d923-4d30-8201-1599bce159fb/bindings/n-h2-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.1455359 Dec 21 03:48:23.539990 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-736e1c71-ae5f-49b1-b51f-37992fa8ef08 req-941a1f68-48ed-4539-99a2-45583766ed60 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:23.603668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-b34719cd-50df-4f9e-bf51-6644ca19a714 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1264577 Dec 21 03:48:23.622317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-d74a6da0-a032-4367-95dd-14cf217d05a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:23.623830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-d74a6da0-a032-4367-95dd-14cf217d05a4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1101 time: 0.0797880 Dec 21 03:48:23.717933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-736e1c71-ae5f-49b1-b51f-37992fa8ef08 req-941a1f68-48ed-4539-99a2-45583766ed60 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:23.721226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-736e1c71-ae5f-49b1-b51f-37992fa8ef08 req-941a1f68-48ed-4539-99a2-45583766ed60 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:23.722293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-736e1c71-ae5f-49b1-b51f-37992fa8ef08 req-941a1f68-48ed-4539-99a2-45583766ed60 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "DELETE /v2.0/security-groups/3c87de05-c073-4861-b518-3815a642483a HTTP/1.1" status: 204 len: 173 time: 0.3772094 Dec 21 03:48:23.746415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-941a1f68-48ed-4539-99a2-45583766ed60 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c87de05-c073-4861-b518-3815a642483a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:23.788318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-90a68bba-92d4-4f1e-9509-5e2cfb8f3e07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:23.791067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-90a68bba-92d4-4f1e-9509-5e2cfb8f3e07 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1590848 Dec 21 03:48:23.800873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:23.874306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-58eab7bf-a91a-48f5-8545-18659479d215 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0632386 Dec 21 03:48:23.967533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b0cb50-a9e7-428f-a470-29ea39b58030 req-759b65e2-7caa-4944-a47e-725bd4856a05 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:23.969566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7b0cb50-a9e7-428f-a470-29ea39b58030 req-759b65e2-7caa-4944-a47e-725bd4856a05 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.1766126 Dec 21 03:48:23.982032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-99fdd808-0e4b-40c1-bf1f-f68fcbd2d068 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:23.983745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-99fdd808-0e4b-40c1-bf1f-f68fcbd2d068 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0844586 Dec 21 03:48:24.034434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-9f7b600e-7d24-4e01-8098-585e6f01d907 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4215584 Dec 21 03:48:24.068266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Deleting port 3940a4ac-09dc-4221-b41b-857f5d916950 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:24.068973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.126799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7b0cb50-a9e7-428f-a470-29ea39b58030 req-5f9aa672-b9db-48f1-96ce-5079bb36d634 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1464148 Dec 21 03:48:24.135135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-ecbf1064-cc82-43a6-be16-1b0808b54733 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:24.136698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-ecbf1064-cc82-43a6-be16-1b0808b54733 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1397438 Dec 21 03:48:24.158683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] For port 3940a4ac-09dc-4221-b41b-857f5d916950, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3940a4ac-09dc-4221-b41b-857f5d916950,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:24.159230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.175097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Calling delete_port for 3940a4ac-09dc-4221-b41b-857f5d916950 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:24.198513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-d10724c2-e496-4ce1-aa42-f0b5aa790a31 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1631200 Dec 21 03:48:24.293867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-717b9104-850e-43fa-b5e9-360f3942e451 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1485953 Dec 21 03:48:24.308311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7076e1e-1a18-4f5a-a68b-7b5264dd5a91 req-9759a65e-7c51-4713-92fd-ac88f56cb458 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:24.311647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7076e1e-1a18-4f5a-a68b-7b5264dd5a91 req-9759a65e-7c51-4713-92fd-ac88f56cb458 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.1101770 Dec 21 03:48:24.435260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7076e1e-1a18-4f5a-a68b-7b5264dd5a91 req-5e23c378-f33e-418f-b783-704e5aeef5e0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1127849 Dec 21 03:48:24.458098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-3d5ebf51-6077-4992-b32f-ff518902394e service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1435537 Dec 21 03:48:24.505381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.522429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15c1cc18-1811-47d6-98ec-501ae02b572c req-733ceb2c-9de9-4609-bc4a-be48f0bae39b tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/56c5c590-d734-4558-a53d-d8daef6f4d62 HTTP/1.1" status: 200 len: 1794 time: 0.0627577 Dec 21 03:48:24.535605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Pushing event deleted for resources: {'Port': ['ID=3940a4ac-09dc-4221-b41b-857f5d916950,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:24.667210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:24.684853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b28afda7-598d-43bd-9410-3478391d4668 req-cecb5af5-6241-4b90-a5d0-93570c282edb tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/4c0c82b4-06a4-41c6-a553-e4c97507d9ca HTTP/1.1" status: 200 len: 1828 time: 0.1106985 Dec 21 03:48:24.696915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-15c1cc18-1811-47d6-98ec-501ae02b572c req-c3ce7426-a862-4a8b-9949-e1f73d8d8811 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.705633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.751015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.766114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-15c1cc18-1811-47d6-98ec-501ae02b572c req-c3ce7426-a862-4a8b-9949-e1f73d8d8811 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.792762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b28afda7-598d-43bd-9410-3478391d4668 req-11fe510b-85ae-4ceb-bf12-b2f14653fcec tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.825508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port f39fe48f-e6af-49d1-a42c-899b81bdf60b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:24.835481 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b28afda7-598d-43bd-9410-3478391d4668 req-11fe510b-85ae-4ceb-bf12-b2f14653fcec tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.837585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port f39fe48f-e6af-49d1-a42c-899b81bdf60b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:24.838166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.941534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-110f59ff-6b34-4bf7-9447-1f79d42d9cfa tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:24.943144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-110f59ff-6b34-4bf7-9447-1f79d42d9cfa tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "GET /v2.0/ports?device_id=6a6fbce8-3f02-49d8-9cf5-4b42d6006df6 HTTP/1.1" status: 200 len: 943 time: 0.0536017 Dec 21 03:48:24.944050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-15c1cc18-1811-47d6-98ec-501ae02b572c req-c3ce7426-a862-4a8b-9949-e1f73d8d8811 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.946682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-15c1cc18-1811-47d6-98ec-501ae02b572c req-c3ce7426-a862-4a8b-9949-e1f73d8d8811 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.948006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15c1cc18-1811-47d6-98ec-501ae02b572c req-c3ce7426-a862-4a8b-9949-e1f73d8d8811 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "DELETE /v2.0/security-groups/56c5c590-d734-4558-a53d-d8daef6f4d62 HTTP/1.1" status: 204 len: 173 time: 0.4116416 Dec 21 03:48:24.964741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b28afda7-598d-43bd-9410-3478391d4668 req-11fe510b-85ae-4ceb-bf12-b2f14653fcec tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.966329 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b28afda7-598d-43bd-9410-3478391d4668 req-11fe510b-85ae-4ceb-bf12-b2f14653fcec tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:24.972662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b28afda7-598d-43bd-9410-3478391d4668 req-11fe510b-85ae-4ceb-bf12-b2f14653fcec tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "DELETE /v2.0/security-groups/4c0c82b4-06a4-41c6-a553-e4c97507d9ca HTTP/1.1" status: 204 len: 173 time: 0.2868886 Dec 21 03:48:25.023808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:48:25.031756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ce7426-a862-4a8b-9949-e1f73d8d8811 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56c5c590-d734-4558-a53d-d8daef6f4d62,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:25.105707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5eaaeefe-735c-407c-8806-08a3211efa6e req-7da68222-c04e-4140-afea-54c4a130593a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 210 time: 0.0552888 Dec 21 03:48:25.106457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11fe510b-85ae-4ceb-bf12-b2f14653fcec tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c0c82b4-06a4-41c6-a553-e4c97507d9ca,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:25.141117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95f5f2cc-65ec-483a-be12-f5f48b87537c req-4ddfedcb-fd52-49c6-b53c-b5e90243cd18 tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "GET /v2.0/security-groups/26056f4e-8bb4-4cfe-9684-370903919703 HTTP/1.1" status: 200 len: 1793 time: 0.1192904 Dec 21 03:48:25.146414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.177427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.208504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:48:25.214469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8943f152-7d6b-4a4d-a005-90069e0746af admin admin] 10.222.0.18 "PUT /v2.0/routers/3524514a-1e59-47e1-a83a-b0a5af9e17c3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1191559 Dec 21 03:48:25.215358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:25.217850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:25.218769 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] Sync routers for ids ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:48:25.219802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:25.222673 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3919a47-b604-4dc6-a280-9c65455cd143" -d '{"events": [{"server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "name": "network-vif-plugged", "status": "completed", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:25.233952 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] Routers {'3524514a-1e59-47e1-a83a-b0a5af9e17c3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:48:25.235471 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:48:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:25.235633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-396d4b1c-07c1-4d7a-8d6d-705dda87929b req-25fd3fd4-99cb-4b6a-9e01-f38053630144 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/b06ad91e-305a-4d86-964c-128cfbe725ae HTTP/1.1" status: 200 len: 1829 time: 0.0865002 Dec 21 03:48:25.239837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Deleting port 2245f877-8d64-488f-bc12-d173f88c7450 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:25.242776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.292027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.294838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:25.329932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-95f5f2cc-65ec-483a-be12-f5f48b87537c req-d6adf344-a638-49fb-a758-533d3910122c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.369202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.383672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:25.394898 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] Set router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:48:25.425837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-95f5f2cc-65ec-483a-be12-f5f48b87537c req-d6adf344-a638-49fb-a758-533d3910122c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.457128 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-396d4b1c-07c1-4d7a-8d6d-705dda87929b req-7ee20394-ab62-4e9c-9481-4a0b6b29ecd6 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.505303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 7be0b6c0-d923-4d30-8201-1599bce159fb completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:25.510554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.511153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 7be0b6c0-d923-4d30-8201-1599bce159fb triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:25.511579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.517737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] For port 2245f877-8d64-488f-bc12-d173f88c7450, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2245f877-8d64-488f-bc12-d173f88c7450,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:25.518121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.544015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-396d4b1c-07c1-4d7a-8d6d-705dda87929b req-7ee20394-ab62-4e9c-9481-4a0b6b29ecd6 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.547998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Calling delete_port for 2245f877-8d64-488f-bc12-d173f88c7450 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:25.622190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.653973 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54'}], 'enable_snat': True}, 'gw_port_id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:48:24Z', 'revision_number': 5, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port': {'id': 'f5fc55e1-56b4-443a-a322-879452c583dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:0c:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:46:32Z', 'updated_at': '2021-12-21T03:46:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:25.658263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:25.666006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-95f5f2cc-65ec-483a-be12-f5f48b87537c req-d6adf344-a638-49fb-a758-533d3910122c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.668725 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-95f5f2cc-65ec-483a-be12-f5f48b87537c req-d6adf344-a638-49fb-a758-533d3910122c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.669889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95f5f2cc-65ec-483a-be12-f5f48b87537c req-d6adf344-a638-49fb-a758-533d3910122c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] 10.222.0.18 "DELETE /v2.0/security-groups/26056f4e-8bb4-4cfe-9684-370903919703 HTTP/1.1" status: 204 len: 173 time: 0.5140355 Dec 21 03:48:25.689360 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] Checking router: 3524514a-1e59-47e1-a83a-b0a5af9e17c3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:48:25.692394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.701521 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] Routers {'3524514a-1e59-47e1-a83a-b0a5af9e17c3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:48:25.701639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6adf344-a638-49fb-a758-533d3910122c tempest-SecurityGroupsTestAdminJSON-1064919844 tempest-SecurityGroupsTestAdminJSON-1064919844-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26056f4e-8bb4-4cfe-9684-370903919703,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:25.701742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:48:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:25.732966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Deleting port f5fc55e1-56b4-443a-a322-879452c583dc {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:25.733311 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.751217 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-396d4b1c-07c1-4d7a-8d6d-705dda87929b req-7ee20394-ab62-4e9c-9481-4a0b6b29ecd6 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.754892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.757641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-396d4b1c-07c1-4d7a-8d6d-705dda87929b req-7ee20394-ab62-4e9c-9481-4a0b6b29ecd6 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.768640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-396d4b1c-07c1-4d7a-8d6d-705dda87929b req-7ee20394-ab62-4e9c-9481-4a0b6b29ecd6 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "DELETE /v2.0/security-groups/b06ad91e-305a-4d86-964c-128cfbe725ae HTTP/1.1" status: 204 len: 173 time: 0.5118732 Dec 21 03:48:25.804419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] Set router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:48:25.832603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:25.850629 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-119170b1-670f-4d29-993a-db7b96c2289a x-openstack-request-id: req-119170b1-670f-4d29-993a-db7b96c2289a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:25.850961 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "name": "network-vif-plugged", "status": "completed", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:25.851227 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-119170b1-670f-4d29-993a-db7b96c2289a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:25.852636 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'code': 200} Dec 21 03:48:25.856379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.868133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee20394-ab62-4e9c-9481-4a0b6b29ecd6 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b06ad91e-305a-4d86-964c-128cfbe725ae,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:25.874396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:48:25Z', 'revision_number': 6, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:25.908018 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4dc330b-a0b3-427d-b626-d491ed590c89 None None] The sync data for ids ['3524514a-1e59-47e1-a83a-b0a5af9e17c3'] in n-d-822053-11 is: [{'id': '3524514a-1e59-47e1-a83a-b0a5af9e17c3', 'name': 'tempest-ServersTestMultiNic-1776710071-router', 'tenant_id': '955f4bcbbfba4ef4acf8124b0274572c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:46:31Z', 'updated_at': '2021-12-21T03:48:25Z', 'revision_number': 6, 'project_id': '955f4bcbbfba4ef4acf8124b0274572c', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:48:25.937270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] For port f5fc55e1-56b4-443a-a322-879452c583dc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f5fc55e1-56b4-443a-a322-879452c583dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:25.937677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:25.952193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Calling delete_port for f5fc55e1-56b4-443a-a322-879452c583dc owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:25.972047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event deleted for resources: {'Port': ['ID=2245f877-8d64-488f-bc12-d173f88c7450,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:26.010220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd4827e1-023f-4e64-b505-f6639b1aa36e req-4e3cea87-71d4-4658-b6f3-6cae82964ce6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:26.012183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd4827e1-023f-4e64-b505-f6639b1aa36e req-4e3cea87-71d4-4658-b6f3-6cae82964ce6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.2353401 Dec 21 03:48:26.065581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] No DVR routers for this DVR port 2245f877-8d64-488f-bc12-d173f88c7450 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:26.074323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.077640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deed36dc-e8c6-4616-8ed3-6cc288e3fb61 req-c0281651-7c17-4c66-b4e6-a7254944afab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "DELETE /v2.0/ports/2245f877-8d64-488f-bc12-d173f88c7450 HTTP/1.1" status: 204 len: 173 time: 1.1272824 Dec 21 03:48:26.078635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-deleted', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:26.082359 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7da42079-0eba-451b-9c85-f132b25bc629" -d '{"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-deleted", "tag": "2245f877-8d64-488f-bc12-d173f88c7450"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:26.108396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96f916c-ac5b-46cc-bae0-eaf18a58254b req-e1b1f1ad-e1c3-49b9-b3c1-6954f2d0b0d2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:26.110029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b96f916c-ac5b-46cc-bae0-eaf18a58254b req-e1b1f1ad-e1c3-49b9-b3c1-6954f2d0b0d2 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1529262 Dec 21 03:48:26.133810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd4827e1-023f-4e64-b505-f6639b1aa36e req-05bf347b-95da-4aee-a6de-1b54eb49f689 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1040866 Dec 21 03:48:26.163038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cadd9775-9f86-4188-b8e0-37e667ae5c9f req-5a73f592-cf8b-41ef-a402-4ec1be9b360f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:26.163038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cadd9775-9f86-4188-b8e0-37e667ae5c9f req-5a73f592-cf8b-41ef-a402-4ec1be9b360f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1097 time: 0.1439390 Dec 21 03:48:26.179896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b96f916c-ac5b-46cc-bae0-eaf18a58254b req-5ce1d5b7-2e7b-493a-a8f9-6af878ae4ec4 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619941 Dec 21 03:48:26.262558 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cadd9775-9f86-4188-b8e0-37e667ae5c9f req-27c7ca28-1be8-44b1-90a1-2483b64be226 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873630 Dec 21 03:48:26.278141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f5dab68-ec6a-483a-86ea-7e37500709e7 req-4efef8da-f2cb-42f6-83b2-1be6b9d868fa tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "GET /v2.0/security-groups/f270bfc7-d252-4eec-84f6-cedeb7772367 HTTP/1.1" status: 200 len: 1794 time: 0.0599220 Dec 21 03:48:26.348826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.376843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Pushing event deleted for resources: {'Port': ['ID=f5fc55e1-56b4-443a-a322-879452c583dc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:26.389776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65025f6b-b5c3-4789-a081-35734816b69f req-db2121c0-5ba6-4948-8ef5-4c375c62d4f0 tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "GET /v2.0/security-groups/9aaa960d-ce9a-4fd5-ae25-feb8b159de37 HTTP/1.1" status: 200 len: 1829 time: 0.1028335 Dec 21 03:48:26.427040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f5dab68-ec6a-483a-86ea-7e37500709e7 req-cd3bb0c2-ebc0-4687-996a-b517a25cee7c tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.467661 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.471483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f5dab68-ec6a-483a-86ea-7e37500709e7 req-cd3bb0c2-ebc0-4687-996a-b517a25cee7c tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.504941 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-65025f6b-b5c3-4789-a081-35734816b69f req-92c69cd7-67a1-488b-9059-c069834fcdda tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.540135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-65025f6b-b5c3-4789-a081-35734816b69f req-92c69cd7-67a1-488b-9059-c069834fcdda tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.562620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.565355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.596562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f5dab68-ec6a-483a-86ea-7e37500709e7 req-cd3bb0c2-ebc0-4687-996a-b517a25cee7c tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.600528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f5dab68-ec6a-483a-86ea-7e37500709e7 req-cd3bb0c2-ebc0-4687-996a-b517a25cee7c tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.602119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f5dab68-ec6a-483a-86ea-7e37500709e7 req-cd3bb0c2-ebc0-4687-996a-b517a25cee7c tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "DELETE /v2.0/security-groups/f270bfc7-d252-4eec-84f6-cedeb7772367 HTTP/1.1" status: 204 len: 173 time: 0.3169949 Dec 21 03:48:26.619218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3bb0c2-ebc0-4687-996a-b517a25cee7c tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f270bfc7-d252-4eec-84f6-cedeb7772367,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:26.663419 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba37d5fc-7e9a-4aac-a026-41b7ee66e1bd x-openstack-request-id: req-ba37d5fc-7e9a-4aac-a026-41b7ee66e1bd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:26.663769 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a6fbce8-3f02-49d8-9cf5-4b42d6006df6", "name": "network-vif-deleted", "tag": "2245f877-8d64-488f-bc12-d173f88c7450", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:26.664068 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ba37d5fc-7e9a-4aac-a026-41b7ee66e1bd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:26.664482 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a6fbce8-3f02-49d8-9cf5-4b42d6006df6', 'name': 'network-vif-deleted', 'tag': '2245f877-8d64-488f-bc12-d173f88c7450', 'status': 'completed', 'code': 200} Dec 21 03:48:26.681593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-65025f6b-b5c3-4789-a081-35734816b69f req-92c69cd7-67a1-488b-9059-c069834fcdda tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.684381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-65025f6b-b5c3-4789-a081-35734816b69f req-92c69cd7-67a1-488b-9059-c069834fcdda tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.685626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65025f6b-b5c3-4789-a081-35734816b69f req-92c69cd7-67a1-488b-9059-c069834fcdda tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] 10.222.0.18 "DELETE /v2.0/security-groups/9aaa960d-ce9a-4fd5-ae25-feb8b159de37 HTTP/1.1" status: 204 len: 173 time: 0.2950623 Dec 21 03:48:26.692188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48410) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:26.706069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c69cd7-67a1-488b-9059-c069834fcdda tempest-SecurityGroupRulesNegativeTestJSON-1790370681 tempest-SecurityGroupRulesNegativeTestJSON-1790370681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9aaa960d-ce9a-4fd5-ae25-feb8b159de37,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:26.731107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.731833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3524514a-1e59-47e1-a83a-b0a5af9e17c3 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:48:26.757554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.763564 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f38aa20-9bf4-43df-b457-32d5634463ea admin admin] 10.222.0.18 "DELETE /v2.0/routers/3524514a-1e59-47e1-a83a-b0a5af9e17c3 HTTP/1.1" status: 204 len: 168 time: 1.5469813 Dec 21 03:48:26.764004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48412) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:26.780033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Deleting subnet 08e7be3d-b12f-4d5f-ac09-9170fd38a0cd {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:48:26.789012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.815179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fa081c7-65b8-4ab7-946d-88b2e246ebb5 req-ec99cd83-274c-4e8b-bf2c-865a74d5c928 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 210 time: 0.0911450 Dec 21 03:48:26.845053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.867077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-971f3b7f-4f1d-4918-a732-327db9b69d0d req-bbd0f97c-49a5-46b9-9301-39ffcf3d5c13 tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "GET /v2.0/security-groups/3589ffb0-0ef7-4f9b-9f0e-2a382e176669 HTTP/1.1" status: 200 len: 1793 time: 0.1532116 Dec 21 03:48:26.890593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.893219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Deleting subnet a7e49167-2a86-4f1d-8301-e4c25f706fd5 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:48:26.904575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.969303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:26.971216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-971f3b7f-4f1d-4918-a732-327db9b69d0d req-cfe6652a-576d-4b21-a956-84367dc7060d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.012765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.023878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-971f3b7f-4f1d-4918-a732-327db9b69d0d req-cfe6652a-576d-4b21-a956-84367dc7060d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.040805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=08e7be3d-b12f-4d5f-ac09-9170fd38a0cd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:27.044380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.051063 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7a527b36-a527-4282-99b5-481d46e5354b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/08e7be3d-b12f-4d5f-ac09-9170fd38a0cd HTTP/1.1" status: 204 len: 168 time: 0.3555019 Dec 21 03:48:27.051784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48414) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:27.126785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.190535 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-971f3b7f-4f1d-4918-a732-327db9b69d0d req-cfe6652a-576d-4b21-a956-84367dc7060d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.193628 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-971f3b7f-4f1d-4918-a732-327db9b69d0d req-cfe6652a-576d-4b21-a956-84367dc7060d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.194474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-971f3b7f-4f1d-4918-a732-327db9b69d0d req-cfe6652a-576d-4b21-a956-84367dc7060d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] 10.222.0.18 "DELETE /v2.0/security-groups/3589ffb0-0ef7-4f9b-9f0e-2a382e176669 HTTP/1.1" status: 204 len: 173 time: 0.3212538 Dec 21 03:48:27.260778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.269335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3940a4ac-09dc-4221-b41b-857f5d916950 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:27.380187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 3940a4ac-09dc-4221-b41b-857f5d916950 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:27.381578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3940a4ac-09dc-4221-b41b-857f5d916950 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:27.382886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f5fc55e1-56b4-443a-a322-879452c583dc no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:27.396857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfe6652a-576d-4b21-a956-84367dc7060d tempest-SecurityGroupsTestAdminJSON-827867969 tempest-SecurityGroupsTestAdminJSON-827867969-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3589ffb0-0ef7-4f9b-9f0e-2a382e176669,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:27.460028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f5fc55e1-56b4-443a-a322-879452c583dc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:27.461091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f5fc55e1-56b4-443a-a322-879452c583dc not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:27.523815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4bd7e03-7233-431d-a23d-ed943416a8e7 req-647799c5-87c4-49ce-90a3-b5a660d83c26 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:27.529362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.532412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4bd7e03-7233-431d-a23d-ed943416a8e7 req-647799c5-87c4-49ce-90a3-b5a660d83c26 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.2324007 Dec 21 03:48:27.561690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['129b2302-7816-412e-834e-da61125b0dc4']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:27.572010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7b8deec8-8ff1-4898-9af4-0735e68f2e3a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:27.572564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7b8deec8-8ff1-4898-9af4-0735e68f2e3a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:27.581963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-3436162b-cfae-4eb9-863f-52532c4a0187 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:27.583614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-3436162b-cfae-4eb9-863f-52532c4a0187 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.54 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.4711130 Dec 21 03:48:27.584882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.599305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.605821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Request body: {'port': {'device_id': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'admin_state_up': True, 'tenant_id': '597df5e2769740859ecb4f30e4aefff3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:27.608548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:48:27.608949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:48:27.610805 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:48:27.616154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5674864-ea4c-418a-9389-1982ea899668 req-91b04f12-e3c9-47a0-81d0-e2fa83fe2226 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:27.617673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5674864-ea4c-418a-9389-1982ea899668 req-91b04f12-e3c9-47a0-81d0-e2fa83fe2226 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.1951258 Dec 21 03:48:27.654736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4bd7e03-7233-431d-a23d-ed943416a8e7 req-bd1bbe09-6fdb-4dbb-8798-4eb910b75771 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212585 Dec 21 03:48:27.666553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.713235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.716488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/a7e49167-2a86-4f1d-8301-e4c25f706fd5 HTTP/1.1" status: 204 len: 168 time: 0.9233685 Dec 21 03:48:27.720415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48426) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:27.722805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d27acac2-d6aa-42cc-bce7-c980d5f972bf None None] Network e1f2bb15-a6a2-4b9b-b159-32c8384807ed requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:27.745495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc3f6af-226a-45dd-989c-87509fe51f18 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a7e49167-2a86-4f1d-8301-e4c25f706fd5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:27.763933 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.782697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.786846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5674864-ea4c-418a-9389-1982ea899668 req-75da5683-3203-4821-bd25-2978892c024c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1604402 Dec 21 03:48:27.787707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] 10.222.0.18 "DELETE /v2.0/networks/129b2302-7816-412e-834e-da61125b0dc4 HTTP/1.1" status: 204 len: 168 time: 0.7351048 Dec 21 03:48:27.850970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51ba8614-4fe0-44d0-8c8d-ca13af89cce1 admin admin] Pushing event deleted for resources: {'Network': ['ID=129b2302-7816-412e-834e-da61125b0dc4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:27.864032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:27.866423 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c62a28b-5990-4a70-8fb5-60ff00151368" -d '{"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:27.873617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.893832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Made reservation on behalf of 597df5e2769740859ecb4f30e4aefff3 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:27.903507 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:27.969116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e14f9535-777e-415f-b545-20a23944790e None None] DHCP port deletion for e1f2bb15-a6a2-4b9b-b159-32c8384807ed request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:48:28.005950 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a1178b8-6bf7-4e4b-ae83-20e68d83c355 x-openstack-request-id: req-1a1178b8-6bf7-4e4b-ae83-20e68d83c355 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:28.006513 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:28.007773 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1a1178b8-6bf7-4e4b-ae83-20e68d83c355 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:28.007773 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'code': 200} Dec 21 03:48:28.026743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Deleting port e05e8bec-ac7f-4a7b-b5d1-1db09862014f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:28.034399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.036730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e14f9535-777e-415f-b545-20a23944790e None None] Deleting port e05e8bec-ac7f-4a7b-b5d1-1db09862014f {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:28.036926 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e14f9535-777e-415f-b545-20a23944790e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.110609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0931920-87db-4496-b6ba-8c8c8e38988f req-4f24a070-7edd-45ff-b517-fce741cf093b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 210 time: 0.0583348 Dec 21 03:48:28.111180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48436) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:28.128842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e14f9535-777e-415f-b545-20a23944790e None None] For port e05e8bec-ac7f-4a7b-b5d1-1db09862014f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:28.129080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] For port e05e8bec-ac7f-4a7b-b5d1-1db09862014f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,segment=NetworkSegment(5469b806-d564-4fcf-b26d-9b436ec63f2a),segment_id=5469b806-d564-4fcf-b26d-9b436ec63f2a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:28.129418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.129824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e14f9535-777e-415f-b545-20a23944790e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.154926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e14f9535-777e-415f-b545-20a23944790e None None] Calling delete_port for e05e8bec-ac7f-4a7b-b5d1-1db09862014f owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:28.157953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Calling delete_port for e05e8bec-ac7f-4a7b-b5d1-1db09862014f owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:28.188311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Allocated IP 172.20.0.4 (d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1/d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766/2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:28.273292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48442) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:28.274440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48444) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:28.280524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'network': {'name': 'tempest-device-tagging-net1-125189058'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:28.302961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-3944405d-68ba-494f-b77d-7603002c43ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:28.304568 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-3944405d-68ba-494f-b77d-7603002c43ed service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff&tenant_id=408f05064a77442595f2b5d444671b8a HTTP/1.1" status: 200 len: 1102 time: 0.0777209 Dec 21 03:48:28.324693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:28.378054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e14f9535-777e-415f-b545-20a23944790e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.382853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.397000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.407919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e14f9535-777e-415f-b545-20a23944790e None None] No DVR routers for this DVR port e05e8bec-ac7f-4a7b-b5d1-1db09862014f on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:28.412722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e14f9535-777e-415f-b545-20a23944790e None None] Pushing event deleted for resources: {'Port': ['ID=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:28.413395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db0ef2db-90c0-4735-95bd-19b2727c2b6c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=312e76b5662644cd80c71ddc59520e9a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1366975 Dec 21 03:48:28.420877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48446) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:28.428327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Pushing event deleted for resources: {'Port': ['ID=e05e8bec-ac7f-4a7b-b5d1-1db09862014f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:28.452624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] No DVR routers for this DVR port e05e8bec-ac7f-4a7b-b5d1-1db09862014f on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:28.471859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78fcf79f-8e9a-4536-8ce8-0bb9dd82c771 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4191c1d155c14ce78c23c0e6fe1f73a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3571801 Dec 21 03:48:28.478381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48448) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:28.509396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:28.512836 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.519441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.587000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:48:28.588938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555a03b1-9e8f-42d4-a90a-1d415abf4922 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.596165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.623584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.623938 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Added segment 246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8 of type vlan for network 48839244-4ebd-4f7e-a6df-11292c1938d9 Dec 21 03:48:28.628722 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfea96e4-f015-49b8-8cf2-84742863e96d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.640591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e1f2bb15-a6a2-4b9b-b159-32c8384807ed']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:28.653423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555a03b1-9e8f-42d4-a90a-1d415abf4922 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.653975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5469b806-d564-4fcf-b26d-9b436ec63f2a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:28.654277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5469b806-d564-4fcf-b26d-9b436ec63f2a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:48:28.678824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:28.696483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.716438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.733855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Releasing vlan 104 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:48:28.739509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:48:28.740756 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:48:28.763484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:28.790748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.832102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:28.886971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:28.889370 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e1dc2dd-fb19-4185-b12a-6788a404068b" -d '{"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-unplugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:28.894654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.898414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.903619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:28.907766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] 10.222.0.18 "DELETE /v2.0/networks/e1f2bb15-a6a2-4b9b-b159-32c8384807ed HTTP/1.1" status: 204 len: 168 time: 1.1860094 Dec 21 03:48:28.928053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c04f25-d426-4111-a8e5-a669f07f51b3 admin admin] Pushing event deleted for resources: {'Network': ['ID=e1f2bb15-a6a2-4b9b-b159-32c8384807ed,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:28.932888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Transition to ACTIVE for port object 7be0b6c0-d923-4d30-8201-1599bce159fb will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:28.999177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.033929 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.057605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:48:29.058286 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:48:29.072538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.076608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] No DVR routers for this DVR port 7be0b6c0-d923-4d30-8201-1599bce159fb on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:29.085477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:29.124876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:29.125323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:29.125741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:29.126768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:29.130075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfea96e4-f015-49b8-8cf2-84742863e96d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.132173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:29.136202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Attempting to bind port 7be0b6c0-d923-4d30-8201-1599bce159fb on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:29.137383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:29.145377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:29.145817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:29.146301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:29.146845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Bound port: 7be0b6c0-d923-4d30-8201-1599bce159fb, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:29.147833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.160404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e05e8bec-ac7f-4a7b-b5d1-1db09862014f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:29.172663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:29.195865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e05e8bec-ac7f-4a7b-b5d1-1db09862014f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:29.196409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e05e8bec-ac7f-4a7b-b5d1-1db09862014f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:29.242480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:29.247384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:29.303597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1775e2f3-626e-4e33-b5e9-809b44296f20 req-d8600c16-3c1f-48e4-be08-bcfec88a5b15 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.307959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1775e2f3-626e-4e33-b5e9-809b44296f20 req-d8600c16-3c1f-48e4-be08-bcfec88a5b15 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.3145392 Dec 21 03:48:29.307959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:29.316411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48462) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:29.329504 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.336811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.337434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.346694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b688508c-ca34-4762-bec1-74cd40967f2d req-98101abd-65c1-4c42-8155-0be4232befef tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.348276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b688508c-ca34-4762-bec1-74cd40967f2d req-98101abd-65c1-4c42-8155-0be4232befef tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.3602164 Dec 21 03:48:29.407931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.410311 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:29.413234 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:29.414231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.414231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.444369 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555a03b1-9e8f-42d4-a90a-1d415abf4922 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.446949 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555a03b1-9e8f-42d4-a90a-1d415abf4922 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.448065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-555a03b1-9e8f-42d4-a90a-1d415abf4922 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d3d3be71-ed6d-4068-8a1a-86583d58bb6b HTTP/1.1" status: 204 len: 168 time: 1.0237088 Dec 21 03:48:29.486631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-213c287c-f346-4e99-9878-94ad131ccd8a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=955f4bcbbfba4ef4acf8124b0274572c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1653688 Dec 21 03:48:29.489358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:29.493322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-85b53503-0c60-42da-afe3-3bc2af6bd85f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8913267 Dec 21 03:48:29.514027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1775e2f3-626e-4e33-b5e9-809b44296f20 req-d492fc39-1ee7-4988-9e61-70f9f664deb1 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1863384 Dec 21 03:48:29.516237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-555a03b1-9e8f-42d4-a90a-1d415abf4922 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3d3be71-ed6d-4068-8a1a-86583d58bb6b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:29.534127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Request body: {'port': {'device_id': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:29.548756 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfea96e4-f015-49b8-8cf2-84742863e96d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.551298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfea96e4-f015-49b8-8cf2-84742863e96d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.552431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bfea96e4-f015-49b8-8cf2-84742863e96d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1af3ce9d-2040-4e91-9501-3fe37a77e2c4 HTTP/1.1" status: 204 len: 168 time: 1.0707638 Dec 21 03:48:29.583741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b688508c-ca34-4762-bec1-74cd40967f2d req-4644959d-0a5d-48b0-9476-3b338fe5f8d3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2202148 Dec 21 03:48:29.631902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 1.3564198 Dec 21 03:48:29.643186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:29.649848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'network': {'name': 'tempest-device-tagging-net2-1939553786'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:29.654345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.655005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.656497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] 10.222.0.54 "PUT /v2.0/ports/7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 1098 time: 1.3359172 Dec 21 03:48:29.658866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfea96e4-f015-49b8-8cf2-84742863e96d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1af3ce9d-2040-4e91-9501-3fe37a77e2c4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:29.663575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71418105-13b4-4685-b9dd-ae64d04272c5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Network': ['ID=48839244-4ebd-4f7e-a6df-11292c1938d9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:29.694967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2897a140-ecb7-4fd6-9db4-8b8e42b3bef5 service neutron] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=11']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:29.733816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:48:29.779951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-e62c3e0a-b5e2-413a-8784-a6b6a5f9c84e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.784764 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-e62c3e0a-b5e2-413a-8784-a6b6a5f9c84e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1101 time: 0.0768147 Dec 21 03:48:29.796992 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30049a2c-788a-42bc-a29b-87aa4aa7c18d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.799655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.820529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:29.858917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:29.867327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.900637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 2245f877-8d64-488f-bc12-d173f88c7450 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:29.901396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2245f877-8d64-488f-bc12-d173f88c7450 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:29.953912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-eb07dcd1-40f8-4f08-89ac-1668fe145ffb service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1674068 Dec 21 03:48:29.954297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30049a2c-788a-42bc-a29b-87aa4aa7c18d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:29.987710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-970577f9-6677-423f-93a5-fbe25b751fc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:29.989366 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-970577f9-6677-423f-93a5-fbe25b751fc8 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1827981 Dec 21 03:48:30.045030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:48:30.061370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-f54f6f48-7d06-408e-91e2-0e011e50884c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0641954 Dec 21 03:48:30.078203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.082371 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Added segment e638ba70-0b52-4055-af99-ba8a9035d3f8 of type vlan for network 19393033-2861-465d-ab20-b8ec53781acb Dec 21 03:48:30.101246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f82c4dc0-864a-4291-bcc5-bc5e795e0d58 req-ddf09fd3-a678-4766-a619-657edeac2364 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.102758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f82c4dc0-864a-4291-bcc5-bc5e795e0d58 req-ddf09fd3-a678-4766-a619-657edeac2364 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 931 time: 0.2243974 Dec 21 03:48:30.148764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-bae74c7d-6cee-4017-a841-c6be6f0cc2db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.151350 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-bae74c7d-6cee-4017-a841-c6be6f0cc2db service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0689282 Dec 21 03:48:30.153669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-2c43b5b5-6ecb-456d-b3c0-8ea2734a3c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.155150 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-2c43b5b5-6ecb-456d-b3c0-8ea2734a3c4e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 1102 time: 0.1050396 Dec 21 03:48:30.183716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.255480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30049a2c-788a-42bc-a29b-87aa4aa7c18d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.258735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30049a2c-788a-42bc-a29b-87aa4aa7c18d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.260074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-30049a2c-788a-42bc-a29b-87aa4aa7c18d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ee8f46ef-0867-4837-a5c1-b137634c081d HTTP/1.1" status: 204 len: 168 time: 0.7703633 Dec 21 03:48:30.282009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f82c4dc0-864a-4291-bcc5-bc5e795e0d58 req-d73ba0e1-f82f-4a16-afc4-f9f7e3ad4a06 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439443 Dec 21 03:48:30.283126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-8a5930ab-4a83-4fba-b16f-8613bd5ca8c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.284867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-8a5930ab-4a83-4fba-b16f-8613bd5ca8c5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1256869 Dec 21 03:48:30.285535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30049a2c-788a-42bc-a29b-87aa4aa7c18d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee8f46ef-0867-4837-a5c1-b137634c081d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:30.330229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.342731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.343957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.352307 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c257d4eb-45e7-435a-8c7f-4ca21359ddad x-openstack-request-id: req-c257d4eb-45e7-435a-8c7f-4ca21359ddad {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:30.352307 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-unplugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:30.352570 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c257d4eb-45e7-435a-8c7f-4ca21359ddad {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:30.352892 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'code': 200} Dec 21 03:48:30.398602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-82163162-4124-4dff-bf68-b75d4547d8f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.400371 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-82163162-4124-4dff-bf68-b75d4547d8f9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2104292 Dec 21 03:48:30.451014 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-1679d919-b8ca-4c2a-b79e-bb5038c300ed service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 200 len: 217 time: 0.0416980 Dec 21 03:48:30.489854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.8439605 Dec 21 03:48:30.495032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48488) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:30.495678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-941d7b82-7f7e-4af2-a2ab-572c110200bd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Network': ['ID=19393033-2861-465d-ab20-b8ec53781acb,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:30.504491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-bb59803b-07ad-4157-89bf-7acc7dd456ac service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2106478 Dec 21 03:48:30.504668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'subnet': {'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'cidr': '10.1.1.0/24', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:30.507412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 19393033-2861-465d-ab20-b8ec53781acb details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:48:30.533648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:30.554095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.563922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1843a193-cddd-4026-943d-b9929cdd1882 req-4c160110-3f70-4913-af6e-be2babb1d6ab tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.565588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1843a193-cddd-4026-943d-b9929cdd1882 req-4c160110-3f70-4913-af6e-be2babb1d6ab tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1097 time: 0.1556084 Dec 21 03:48:30.583825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-c2eb638d-8348-4e5c-b7c6-a3da4fb0b5c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.592687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-c2eb638d-8348-4e5c-b7c6-a3da4fb0b5c9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1334186 Dec 21 03:48:30.619325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Transition to ACTIVE for port object 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:30.676171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48492) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:30.698264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1843a193-cddd-4026-943d-b9929cdd1882 req-d56ff9e9-24c0-4c12-9987-1f89be3ec5f3 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018052 Dec 21 03:48:30.705052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.727921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-33a816bd-cf78-4c0e-937a-65f8c3378985 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.729460 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-33a816bd-cf78-4c0e-937a-65f8c3378985 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1238210 Dec 21 03:48:30.757121 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d3457cd9-2b66-4809-9705-b98091b8a452 req-322b82e1-1533-4f61-961d-0428e3a95316 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2393262 Dec 21 03:48:30.779622 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-908132e9-c0e5-4efc-b85b-3a401c7ed172 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2c807d638ca54cbf9224f2a6a3e9838b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1022236 Dec 21 03:48:30.782062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48498) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:30.784943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:30.807404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b9643d-1141-47ed-9bf6-5bd8702b252b req-e0d77323-b633-47d6-9c56-d108c0c042ce tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:30.807404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42b9643d-1141-47ed-9bf6-5bd8702b252b req-e0d77323-b633-47d6-9c56-d108c0c042ce tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.1604433 Dec 21 03:48:30.852066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:30.856224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.884089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-6aae7191-3203-4aeb-9482-6d7449043727 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449063 Dec 21 03:48:30.889350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f3001fe-da33-42ff-aa8a-374ca70d2fbf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:30.938307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f3001fe-da33-42ff-aa8a-374ca70d2fbf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.025453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619d16e1-36ae-4a8e-86e7-0fc78c01ef25 req-393875c7-7bb4-4820-8e0d-54a43bbbb15a service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1326609 Dec 21 03:48:31.037426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42b9643d-1141-47ed-9bf6-5bd8702b252b req-00cf4f83-e515-472a-83a4-389a7bbd814f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2221172 Dec 21 03:48:31.100304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30753f67-38ad-489f-a054-577b9be8d41c req-9e7fdee6-0aa1-4099-bfcb-f7e0802f28de tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:31.107768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30753f67-38ad-489f-a054-577b9be8d41c req-9e7fdee6-0aa1-4099-bfcb-f7e0802f28de tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1097 time: 0.1047096 Dec 21 03:48:31.117846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Attempting to bind port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:31.122187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Attempting to bind port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:31.122187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Attempting to bind port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:31.131856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:31.132189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Attempting to bind port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:31.138115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f3001fe-da33-42ff-aa8a-374ca70d2fbf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.140876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f3001fe-da33-42ff-aa8a-374ca70d2fbf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.144521 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f3001fe-da33-42ff-aa8a-374ca70d2fbf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2fb6cab8-fc4e-430b-9d78-f99b32bf0fa6 HTTP/1.1" status: 204 len: 168 time: 0.3590162 Dec 21 03:48:31.150683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f3001fe-da33-42ff-aa8a-374ca70d2fbf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fb6cab8-fc4e-430b-9d78-f99b32bf0fa6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:31.150885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:31.151263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Checking segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:31.151655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Bound using segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:31.152801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Bound port: 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:31.153241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.182491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30753f67-38ad-489f-a054-577b9be8d41c req-83ee9120-7164-4fd1-bc1d-17928e72442f tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738537 Dec 21 03:48:31.314850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:31.335520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:31.449131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.452275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.542830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:31.543481 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.544874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] 10.222.0.54 "PUT /v2.0/ports/2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd HTTP/1.1" status: 200 len: 1092 time: 2.0274880 Dec 21 03:48:31.545319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:31.550472 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75893d16-5360-427b-86c3-b06ecacaecfc" -d '{"events": [{"name": "network-changed", "server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:31.588446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4cc1a6-e5e9-40be-b1c4-88b7b4278319 req-63021ee7-a28d-4c34-bdeb-07162d02e361 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:31.589945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc4cc1a6-e5e9-40be-b1c4-88b7b4278319 req-63021ee7-a28d-4c34-bdeb-07162d02e361 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 943 time: 0.1846540 Dec 21 03:48:31.593022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Subnet': ['ID=fdb8123e-5581-4093-99c4-63d41dd3436d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:31.599695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f93678-09ae-4d49-a4cc-91e84268bef9 service neutron] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:31.638091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Checking segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:31.638656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network hostable DHCP agents. Network: 48839244-4ebd-4f7e-a6df-11292c1938d9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:48:31.706782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc4cc1a6-e5e9-40be-b1c4-88b7b4278319 req-c61851d0-7841-4a64-a4c3-6f9dc4cf3069 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076345 Dec 21 03:48:31.722456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-13f2d144-7eb3-447f-8445-2e31409db149 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:31.723978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-13f2d144-7eb3-447f-8445-2e31409db149 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 1095 time: 0.0703619 Dec 21 03:48:31.786617 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e26963cc-52f8-4227-89c5-0d4987f633d3 x-openstack-request-id: req-e26963cc-52f8-4227-89c5-0d4987f633d3 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:31.786919 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:31.787418 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e26963cc-52f8-4227-89c5-0d4987f633d3 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:31.787828 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'status': 'completed', 'code': 200} Dec 21 03:48:31.788968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:48:31.791826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-afd40628-1bc9-4d9a-a58d-369fbd706bc7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd HTTP/1.1" status: 200 len: 217 time: 0.0516326 Dec 21 03:48:31.794699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:31.840173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48554) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:31.848129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 48839244-4ebd-4f7e-a6df-11292c1938d9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:31.851614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-3f78fba0-9205-47bc-a348-ebf41869fb64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:31.853372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-3f78fba0-9205-47bc-a348-ebf41869fb64 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.0536740 Dec 21 03:48:31.856648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:31.859591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:31.859723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8d06165-d37a-49f9-a19b-5faddcb234b1 None None] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:31.894747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-2af0f818-2f4e-4fb0-b5d6-71e1283c7139 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0291450 Dec 21 03:48:31.969006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupsTestJSON-230234504-network', 'tenant_id': '0c51448e6fcd494e8c92714cc6e79d52'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:31.975001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9a381d2f-5105-406f-8b75-60dfc7b3e29e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.4700067 Dec 21 03:48:31.975001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48564) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:31.983429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'subnet': {'network_id': '19393033-2861-465d-ab20-b8ec53781acb', 'cidr': '10.2.2.0/24', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:31.999780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-48839244-4ebd-4f7e-a6df-11292c1938d9', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:48:32.006148 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.013577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-797509724-network', 'tenant_id': '20acfa324e9b4279a50bf03610639a83'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:32.107856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Made reservation on behalf of 0c51448e6fcd494e8c92714cc6e79d52 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:32.114481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.115807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-fae7155a-abcf-4595-ad08-53654b46cd58 service neutron] 10.222.0.54 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2158282 Dec 21 03:48:32.142352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.204484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Allocated IP 10.1.1.2 (48839244-4ebd-4f7e-a6df-11292c1938d9/fdb8123e-5581-4093-99c4-63d41dd3436d/e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:32.254505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:32.261421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.274555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.276757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Made reservation on behalf of 20acfa324e9b4279a50bf03610639a83 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:32.281161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.307508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.351810 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.362478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:32.364862 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f" -d '{"events": [{"name": "network-changed", "server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:32.367392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baaaa4b7-2d62-44e3-a02b-97ef4c18b649 req-9d0041f2-0400-48f2-9b23-0eb5d0fc1888 service neutron] 10.222.0.54 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2423985 Dec 21 03:48:32.388395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d27d3f-984f-40f2-ac28-850166a8c1c0 req-96995a4c-58d4-4f26-a346-93c11a2bad84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:32.390014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65d27d3f-984f-40f2-ac28-850166a8c1c0 req-96995a4c-58d4-4f26-a346-93c11a2bad84 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 949 time: 0.1839607 Dec 21 03:48:32.397898 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.399868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:48:32.424825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81a36cae-1a32-4478-b646-000893538e6f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:32.428110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.428521 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Added segment a212bdf2-4f6e-4cc1-a1e5-789fec8069b8 of type vlan for network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a Dec 21 03:48:32.460640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65d27d3f-984f-40f2-ac28-850166a8c1c0 req-9bfd846d-a5cf-4794-b1db-4d6d7018729b tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602894 Dec 21 03:48:32.469406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.469758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.470101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.472750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.472750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.472750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.472750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.472750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.472750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.473373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.473549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.473868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.474197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.516654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.550389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.565092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.580854 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f40b22c6-98a8-45af-9e27-aa2392394033 x-openstack-request-id: req-f40b22c6-98a8-45af-9e27-aa2392394033 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:32.581341 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:32.581454 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f40b22c6-98a8-45af-9e27-aa2392394033 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:32.581790 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'status': 'completed', 'code': 200} Dec 21 03:48:32.604640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:32.614775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:32.618563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:32.628987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Pushing event updated for resources: {'Port': ['ID=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:32.645116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.659327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.659681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.660027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.660369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.660703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.661038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.661371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.661700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.662027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.662353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.662676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.663031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.663356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:32.697922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:32.729087 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.730130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:32.739538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75893d16-5360-427b-86c3-b06ecacaecfc req-9656a504-1553-4a95-a765-17cac32958f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:32.742913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.743659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-9656a504-1553-4a95-a765-17cac32958f4 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 1095 time: 0.0706882 Dec 21 03:48:32.747076 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.854289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:32.867670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'mac_address': 'fa:16:3e:01:64:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.105'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:32.887283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Attempting to bind port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:32.887666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Attempting to bind port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:32.888041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Attempting to bind port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:32.916398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:32.916782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Checking segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:32.917204 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.917596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Bound using segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:32.918181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Bound port: e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:32.918461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.937911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:32.945799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Subnet': ['ID=8e39c1be-57b7-471e-a252-0b9469588d52,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:32.966352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c785269-c2cf-4bd5-b908-319fe95f7047 req-399ec45f-45ac-43e7-8c91-c753185b46d8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:32.969346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c785269-c2cf-4bd5-b908-319fe95f7047 req-399ec45f-45ac-43e7-8c91-c753185b46d8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 943 time: 0.1518610 Dec 21 03:48:32.975283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] Pushing event updated for resources: {'Network': ['ID=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:32.980001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a78c1f3-f15c-416f-a11d-b8fbe571abb6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:32.991149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:48:32.993467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Checking segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:32.994251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] For port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:32.997158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network hostable DHCP agents. Network: 19393033-2861-465d-ab20-b8ec53781acb, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:48:32.997396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] For port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:33.007126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:48:33.019997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-0d0ee995-ee30-47d0-ad81-15a810f8ecee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.021578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-0d0ee995-ee30-47d0-ad81-15a810f8ecee service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1101 time: 0.3217807 Dec 21 03:48:33.026988 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-755fe03d-1570-46d1-92c9-77e6213a69af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.029094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-755fe03d-1570-46d1-92c9-77e6213a69af service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1101 time: 0.4029012 Dec 21 03:48:33.031343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.032010 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Added segment 4af8e8d9-376d-4a96-ae0c-b27352fe558a of type vlan for network 24735258-b5ad-42e8-a231-667c1278689e Dec 21 03:48:33.037929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7be0b6c0-d923-4d30-8201-1599bce159fb {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:33.058239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75893d16-5360-427b-86c3-b06ecacaecfc req-e1a15d29-d4f2-41c4-be4a-4da8c6136c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.060195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-e1a15d29-d4f2-41c4-be4a-4da8c6136c35 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 906 time: 0.2993007 Dec 21 03:48:33.088233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4f29aa25-2398-403a-82b8-ef05b6a9363e admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.2912993 Dec 21 03:48:33.095798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.098325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48602) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:33.104044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Request body: {'subnet': {'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupsTestJSON-230234504-subnet', 'tenant_id': '0c51448e6fcd494e8c92714cc6e79d52', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:33.117018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:33.128461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c785269-c2cf-4bd5-b908-319fe95f7047 req-c57fab39-dee1-4869-a5ce-b544e292b22d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1524332 Dec 21 03:48:33.200936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c2a05a-9e12-485a-97b6-6659abcabb28 None None] Pushing event updated for resources: {'Port': ['ID=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:33.222909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-8fd236c5-ecbe-4fca-b679-e23a4b3bb1ad service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd HTTP/1.1" status: 200 len: 217 time: 0.0912573 Dec 21 03:48:33.223578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 19393033-2861-465d-ab20-b8ec53781acb is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:48:33.239274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.264211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.286774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-5259d29d-8263-40a7-91ce-fa4f4b5b9495 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.289654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-5259d29d-8263-40a7-91ce-fa4f4b5b9495 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.2421596 Dec 21 03:48:33.323967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75893d16-5360-427b-86c3-b06ecacaecfc req-909686b8-39af-40d8-9283-19d94c1864c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.325302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-909686b8-39af-40d8-9283-19d94c1864c4 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.0705893 Dec 21 03:48:33.329380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 19393033-2861-465d-ab20-b8ec53781acb) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:33.350691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.351882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.358664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8dada4c-6839-4e8b-82fc-fb5bc56dd83f None None] Network 19393033-2861-465d-ab20-b8ec53781acb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:33.396693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-bd33aa1f-b25a-49b8-8675-6b33f0caa17b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406637 Dec 21 03:48:33.399613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Made reservation on behalf of 0c51448e6fcd494e8c92714cc6e79d52 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:33.402680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.422832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-3e833fce-d6f8-4ad1-bf55-acbc8a930f4f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0969408 Dec 21 03:48:33.425139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:33.582436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-6741c700-3462-400a-a07b-d6a500fbae1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.588169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-6741c700-3462-400a-a07b-d6a500fbae1f service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.4244173 Dec 21 03:48:33.637263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-19393033-2861-465d-ab20-b8ec53781acb', 'network_id': '19393033-2861-465d-ab20-b8ec53781acb', 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'fixed_ips': [{'subnet_id': '8e39c1be-57b7-471e-a252-0b9469588d52'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:48:33.638714 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.648997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7be0b6c0-d923-4d30-8201-1599bce159fb'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:33.686821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-d99b732a-7fda-4cbf-859a-902da4642bbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.688972 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-d99b732a-7fda-4cbf-859a-902da4642bbc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.2494278 Dec 21 03:48:33.690264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-66a818c7-ade9-4b54-8d7c-cc79440868f8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.105&port_id=7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 200 len: 217 time: 0.0820253 Dec 21 03:48:33.692097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.693031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.693601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:33.713077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-42790fb4-8b6e-42c7-9a7e-1b51afbe6410 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.7367730 Dec 21 03:48:33.720122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48612) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:33.775449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'name': 'tempest-TaggedBootDevicesTest-1241240235', 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:33.799307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-ba69c367-9a73-43b0-8efd-09ca5702f53f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.800931 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-ba69c367-9a73-43b0-8efd-09ca5702f53f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0992229 Dec 21 03:48:33.903155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-1f58888e-7abf-42cf-9783-dfe5a382b9e0 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:48:33.909050 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 2.0678070 Dec 21 03:48:33.911405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-1f58888e-7abf-42cf-9783-dfe5a382b9e0 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0148072 Dec 21 03:48:33.917422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48618) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:33.919323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc2f15b-3ac5-455d-8229-9fcbdcc355ad admin admin] Pushing event updated for resources: {'Network': ['ID=24735258-b5ad-42e8-a231-667c1278689e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:33.933904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Request body: {'subnet': {'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-797509724-subnet', 'tenant_id': '20acfa324e9b4279a50bf03610639a83', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:33.952382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 24735258-b5ad-42e8-a231-667c1278689e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:48:33.961351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-92a7b3b9-de88-41ed-8ae6-707ad52f7736 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.962968 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-92a7b3b9-de88-41ed-8ae6-707ad52f7736 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1438603 Dec 21 03:48:33.970423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-5065c38e-792c-45f3-86fd-51c874971e84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.972051 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-5065c38e-792c-45f3-86fd-51c874971e84 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2714849 Dec 21 03:48:33.975238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508f113d-2fb1-461a-bb29-21d02d588fb1 req-f0348255-d040-46fc-a7ab-13b3b74ad326 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.980000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-508f113d-2fb1-461a-bb29-21d02d588fb1 req-f0348255-d040-46fc-a7ab-13b3b74ad326 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 950 time: 0.2586799 Dec 21 03:48:33.981540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-f5c95523-32d4-4858-bf63-9319a663afa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:33.983052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-f5c95523-32d4-4858-bf63-9319a663afa8 service neutron] 10.222.0.18 "GET /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 1094 time: 0.0708604 Dec 21 03:48:33.994884 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-3783d4d8-cf29-47da-b72f-81c303baa231 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1771727 Dec 21 03:48:34.046016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:34.047085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Unknown quota resources ['binding']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:48:34.131660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Allocated IP 10.2.2.2 (19393033-2861-465d-ab20-b8ec53781acb/8e39c1be-57b7-471e-a252-0b9469588d52/fa2f395b-5d54-49d2-bd99-243f0bbabadf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:34.146592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Made reservation on behalf of 20acfa324e9b4279a50bf03610639a83 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:34.148825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:34.207705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-f08bc92e-e5fa-4c76-b56d-7db17faaedea service neutron] 10.222.0.54 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5863135 Dec 21 03:48:34.265774 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-28914d89-a667-4a18-a450-700103a545a1 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2744813 Dec 21 03:48:34.278773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-4f0297fc-556e-403b-b62a-a229dc7ed7ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:34.282011 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-4f0297fc-556e-403b-b62a-a229dc7ed7ed service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=408f05064a77442595f2b5d444671b8a&device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 1103 time: 0.2411566 Dec 21 03:48:34.284197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:34.290878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-b18a412d-e9c1-4aee-baf0-bfddab74db8f service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3124118 Dec 21 03:48:34.420211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Pushing event updated for resources: {'Subnet': ['ID=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:34.537350 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:34.538031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-508f113d-2fb1-461a-bb29-21d02d588fb1 req-678555ef-60da-40ed-9980-37215fa8feb6 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5139942 Dec 21 03:48:34.595661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:34.599738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7f1cc7b-fe3d-4319-9b19-eeb50fda8a7f None None] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:34.633522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:34.636497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-7a6257b1-c9a5-492c-884d-4ff20d88752a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3360555 Dec 21 03:48:34.637506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-b17e7752-8f42-4efe-ab70-02269a303809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:34.638794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-b17e7752-8f42-4efe-ab70-02269a303809 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3155713 Dec 21 03:48:34.710573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:34.758031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Network 19393033-2861-465d-ab20-b8ec53781acb is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:34.772921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:34.775778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:34.785501 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Pushing event updated for resources: {'Port': ['ID=fa2f395b-5d54-49d2-bd99-243f0bbabadf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:34.798232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7eadf5e0-45f4-454a-9a12-4c3719e1bc4a None None] Provisioning complete for port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:34.798615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7eadf5e0-45f4-454a-9a12-4c3719e1bc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:34.976358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Attempting to bind port fa2f395b-5d54-49d2-bd99-243f0bbabadf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:34.977009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Attempting to bind port fa2f395b-5d54-49d2-bd99-243f0bbabadf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:34.977009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Attempting to bind port fa2f395b-5d54-49d2-bd99-243f0bbabadf on network 19393033-2861-465d-ab20-b8ec53781acb {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:34.998491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:34.998946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Checking segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:34.999573 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.000073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Bound using segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:35.000640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Bound port: fa2f395b-5d54-49d2-bd99-243f0bbabadf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:35.001118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.015045 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-b032e36b-ca68-4ef7-a719-8e844beb78c1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.114&port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 200 len: 217 time: 0.3547823 Dec 21 03:48:35.039804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:35.061138 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9214fa50-f6b5-4cf7-bbc9-6a12a75cfe8f req-9aa2d793-39ad-46ad-87ec-67a058849791 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7781143 Dec 21 03:48:35.087825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-180a4655-d295-491a-899f-7fd912d74429 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:35.089160 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-180a4655-d295-491a-899f-7fd912d74429 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0664001 Dec 21 03:48:35.089826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Checking segment: {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:35.094926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Network hostable DHCP agents. Network: ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:48:35.124155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'mac_address': 'fa:16:3e:7d:fe:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:35.163500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7eadf5e0-45f4-454a-9a12-4c3719e1bc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.181399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-a5a51dd8-37ae-456f-a026-6d5364540c11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:35.184055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-a5a51dd8-37ae-456f-a026-6d5364540c11 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0664699 Dec 21 03:48:35.192916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75893d16-5360-427b-86c3-b06ecacaecfc req-476cc82b-26bf-4714-8f18-f4e6cb25cbe9 service neutron] 10.222.0.54 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9302514 Dec 21 03:48:35.193813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:35.194254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:35.194999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:35.218232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] For port fa2f395b-5d54-49d2-bd99-243f0bbabadf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:35.224269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:35.230111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:35.230411 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.248604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d622b6cb-e6c1-47b2-991c-9710b18e0436 req-1b15adf6-82c6-4bee-8321-a348bf519562 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:35.257865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d622b6cb-e6c1-47b2-991c-9710b18e0436 req-1b15adf6-82c6-4bee-8321-a348bf519562 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 943 time: 0.6368885 Dec 21 03:48:35.264063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.267836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] For port fa2f395b-5d54-49d2-bd99-243f0bbabadf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fa2f395b-5d54-49d2-bd99-243f0bbabadf,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:35.272571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:35.276035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:35.276597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7eadf5e0-45f4-454a-9a12-4c3719e1bc4a None None] For port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:35.276799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:35.281919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:35.281919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Bound port: f39fe48f-e6af-49d1-a42c-899b81bdf60b, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:35.291298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.299952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:48:35.311618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:35.322486 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.349399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=da10d7f0-623a-4e8a-b5fc-286a12beadcd,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:35.370706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Checking segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:35.371098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Network hostable DHCP agents. Network: 24735258-b5ad-42e8-a231-667c1278689e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:48:35.376919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-02515a88-823c-4e35-b54f-820f87071eae service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1770325 Dec 21 03:48:35.377463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] device_id is not set on port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:48:35.393803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:35.398785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d622b6cb-e6c1-47b2-991c-9710b18e0436 req-f572f144-47a9-431a-aa6a-03545ec6a2a4 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1397402 Dec 21 03:48:35.402579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7eadf5e0-45f4-454a-9a12-4c3719e1bc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.457300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d91e1a-043b-4904-94c7-906e7c3bb3e6 None None] Pushing event updated for resources: {'Port': ['ID=fa2f395b-5d54-49d2-bd99-243f0bbabadf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:35.469408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:35.469787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.489596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:35.494086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:35.494691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.499054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:35.519552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce242cdd-d980-4ce3-9d23-6475f7ef5419 None None] Network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:35.533859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aaf7c611-a93d-42c1-bc96-b21615a70791 req-d4c50e4a-6923-42ee-9a12-fc1158ea9537 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1468055 Dec 21 03:48:35.583734 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.604150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Network 24735258-b5ad-42e8-a231-667c1278689e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:48:35.618044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 24735258-b5ad-42e8-a231-667c1278689e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:35.633355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:35.634517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf5e0-45f4-454a-9a12-4c3719e1bc4a None None] Pushing event updated for resources: {'Port': ['ID=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:35.637181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cd7e36c-1ecc-4da4-9261-fef5dd2c2916 None None] Network 24735258-b5ad-42e8-a231-667c1278689e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:35.637736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.678140 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.679701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-81a4724b-8bf7-4d64-95a5-4b8bd7fa2e66 service neutron] 10.222.0.18 "POST /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b/bindings HTTP/1.1" status: 201 len: 390 time: 1.6495707 Dec 21 03:48:35.709254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b18a814a-a636-41dd-b724-9ace71add843 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.6019869 Dec 21 03:48:35.740359 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-46ec2a45-1834-4da9-8592-ce8fec7a3ea1 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.8172543 Dec 21 03:48:35.756696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 10.1.1.34 (48839244-4ebd-4f7e-a6df-11292c1938d9/fdb8123e-5581-4093-99c4-63d41dd3436d/1a539edc-6061-4a94-a9d0-3e97bd54fe56) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:35.766649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7b3de998-6cac-49e8-be7f-bd7a2cc6cf2b None None] Provisioning complete for port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:35.767043 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b3de998-6cac-49e8-be7f-bd7a2cc6cf2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:35.873594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-250d66a0-563d-4a17-a877-158049cf9b3d None None] Network 24735258-b5ad-42e8-a231-667c1278689e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:36.000953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:36.017843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-96f4957a-5dbb-4948-9768-e0a4d0c32f6f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0558298 Dec 21 03:48:36.080154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:36.089085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0aaeac5c-d740-4115-9162-36a121239988 None None] Network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:36.127084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.275928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4a8202-0bb2-454b-8b0b-41bb81b9ed8e req-bc237472-0d7e-47f6-a655-b64672cbd32a tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.277429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a4a8202-0bb2-454b-8b0b-41bb81b9ed8e req-bc237472-0d7e-47f6-a655-b64672cbd32a tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 1102 time: 0.1356189 Dec 21 03:48:36.315550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.362525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-5ca4ed1c-e54b-4165-92ef-35641ef8a85f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.364074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-5ca4ed1c-e54b-4165-92ef-35641ef8a85f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3451314 Dec 21 03:48:36.408096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:36.424333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-9c3fe614-ea1b-433c-b162-4ec4627edd80 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/quotas/9839aab3796944fe8a09f1cfbd7edf8b HTTP/1.1" status: 200 len: 375 time: 0.0511644 Dec 21 03:48:36.427578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:36.431131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a4a8202-0bb2-454b-8b0b-41bb81b9ed8e req-0165bd54-6e33-4632-acd7-673c66d70961 tempest-MigrationsAdminTest-337655343 tempest-MigrationsAdminTest-337655343-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1473784 Dec 21 03:48:36.431751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:36.434119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:36.488467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-38d9c54b-902e-4988-bff7-a1fd2b474e7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.490399 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-38d9c54b-902e-4988-bff7-a1fd2b474e7d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1097 time: 0.0852468 Dec 21 03:48:36.524180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-047c3bcd-ef6a-4360-ae71-64a2232cfbba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0986001 Dec 21 03:48:36.545945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.545945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.579151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-ed05642b-8155-4bfe-8a00-1622efd8aa39 req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1368905810', 'description': 'tempest-description-1041170472'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:36.632042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d7fc697b-2df1-4e0a-b355-233aac091ea3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.8636773 Dec 21 03:48:36.636640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48664) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:36.641764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'name': 'tempest-TaggedBootDevicesTest-872597948', 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:36.652890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-1781aac9-034e-4acc-8ff6-4b7663912477 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.654699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-1781aac9-034e-4acc-8ff6-4b7663912477 service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1526358 Dec 21 03:48:36.707478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:36.720997 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-758dfd14-7ae6-402d-97f9-158c8cb9583b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 217 time: 0.0484610 Dec 21 03:48:36.758436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed05642b-8155-4bfe-8a00-1622efd8aa39 req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.826275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-f9bb7b6f-51e1-41a2-b670-c5623add9dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.828070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-f9bb7b6f-51e1-41a2-b670-c5623add9dcc service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.0966702 Dec 21 03:48:36.874212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-41f0bfb0-5336-4864-9a12-abd8d9e3cd94 None None] Provisioning complete for port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:36.874633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41f0bfb0-5336-4864-9a12-abd8d9e3cd94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.891740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2973ac36-c98e-43ed-a918-cc4c21537c42 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0557656 Dec 21 03:48:36.902025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 7be0b6c0-d923-4d30-8201-1599bce159fb completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:36.915434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 7be0b6c0-d923-4d30-8201-1599bce159fb triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:36.916124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.928799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-41f0bfb0-5336-4864-9a12-abd8d9e3cd94 None None] Port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:48:36.930783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79cb4f0f-b3a6-4e7f-9444-429e2e88ac70 req-c6c9d3e3-2c7e-4484-8710-e67d9c5d70a3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:36.932421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79cb4f0f-b3a6-4e7f-9444-429e2e88ac70 req-c6c9d3e3-2c7e-4484-8710-e67d9c5d70a3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.1136799 Dec 21 03:48:36.978900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed05642b-8155-4bfe-8a00-1622efd8aa39 req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:36.986966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99a41483-5c71-4398-a439-7eea41a9b61f None None] Network 19393033-2861-465d-ab20-b8ec53781acb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:48:37.010072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:37.015810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.028334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-6eae9ecc-fe5f-40a4-a7c3-397f9e16c79a service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278858 Dec 21 03:48:37.034835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79cb4f0f-b3a6-4e7f-9444-429e2e88ac70 req-42de0cd8-36e6-4c72-b126-c86ad87907f3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864530 Dec 21 03:48:37.044343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] device_id is not set on port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:48:37.159959 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-f0f87c44-b8fa-47b3-86ea-1abf8448142a service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1235166 Dec 21 03:48:37.166921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed05642b-8155-4bfe-8a00-1622efd8aa39 req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.227928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-526f7744-1f29-4e5b-9751-869fa9a3579f None None] Provisioning complete for port fa2f395b-5d54-49d2-bd99-243f0bbabadf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:37.228832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-526f7744-1f29-4e5b-9751-869fa9a3579f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.314787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.350892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1f9e72e0-e144-4773-b0f9-6520a96c3335,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:37.353256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:37.356105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed05642b-8155-4bfe-8a00-1622efd8aa39 req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.357344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed05642b-8155-4bfe-8a00-1622efd8aa39 req-d6fbca3e-23ae-4a67-b3f7-a35501ad038b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 0.7877421 Dec 21 03:48:37.382135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:37.386144 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2cdf046a-0597-4cd7-b3d1-7a2a96f22b96" -d '{"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:37.430184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:37.454136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-526f7744-1f29-4e5b-9751-869fa9a3579f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.465902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-23d50460-6d2c-4568-80e5-0466e02c2b07 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:37.467525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-23d50460-6d2c-4568-80e5-0466e02c2b07 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 814 time: 0.2046583 Dec 21 03:48:37.502902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:37.503385 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.508252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-526f7744-1f29-4e5b-9751-869fa9a3579f None None] For port fa2f395b-5d54-49d2-bd99-243f0bbabadf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fa2f395b-5d54-49d2-bd99-243f0bbabadf,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:37.516789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-223e041a-c235-4b92-a6d2-5d00471cab18 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/quotas/20acfa324e9b4279a50bf03610639a83 HTTP/1.1" status: 200 len: 375 time: 0.0268252 Dec 21 03:48:37.526923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 10.1.1.198 (48839244-4ebd-4f7e-a6df-11292c1938d9/fdb8123e-5581-4093-99c4-63d41dd3436d/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:37.530527 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.557506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11bd1c12-84db-4da8-8c3c-b937ccbb8394 req-da5f6eec-02c5-49d2-a9ad-fb1dbc6df05b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:37.559203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11bd1c12-84db-4da8-8c3c-b937ccbb8394 req-da5f6eec-02c5-49d2-a9ad-fb1dbc6df05b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 944 time: 0.1319304 Dec 21 03:48:37.585560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-5ec59524-7ba1-41f7-9177-f6986e8eb966 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0558012 Dec 21 03:48:37.633448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-526f7744-1f29-4e5b-9751-869fa9a3579f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.677580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11bd1c12-84db-4da8-8c3c-b937ccbb8394 req-bc5b5cfd-efff-4c93-8449-cbdc371f0957 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894608 Dec 21 03:48:37.712052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=13']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:37.793103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa2f395b-5d54-49d2-bd99-243f0bbabadf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:37.847914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526f7744-1f29-4e5b-9751-869fa9a3579f None None] Pushing event updated for resources: {'Port': ['ID=fa2f395b-5d54-49d2-bd99-243f0bbabadf,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:37.866979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6dc0d087-416b-4305-9d3d-50044b87d5e8 None None] Provisioning complete for port fa2f395b-5d54-49d2-bd99-243f0bbabadf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:37.866979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6dc0d087-416b-4305-9d3d-50044b87d5e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.933710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port fa2f395b-5d54-49d2-bd99-243f0bbabadf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:37.934093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.943337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:37.986752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-49cc6ec4-cf8d-45a0-9ba2-c520ebdf3f4c service neutron] 10.222.0.18 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4005554 Dec 21 03:48:38.064974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.123383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:38.131664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:38.136833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:38.144909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-1bb77379-6d86-4693-afe2-d39f16434561 service neutron] 10.222.0.18 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1462574 Dec 21 03:48:38.166223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.200005 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:38.203499 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.388833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4634d09d-056a-4c6f-81d5-6ce6dcfb1062 req-b6f882a9-da6c-4af9-92e7-a99158c50059 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 210 time: 0.0275497 Dec 21 03:48:38.396038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f3f6012f-921d-4c5d-b701-3df40e645fb8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.7547145 Dec 21 03:48:38.420006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c6cb21e5-b34d-4a70-bb65-7f1b09c5b605 req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1825503055', 'description': 'tempest-description-1679298559'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:38.505149 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dceb757b-f51e-4cea-b49d-1ac2131066c6 x-openstack-request-id: req-dceb757b-f51e-4cea-b49d-1ac2131066c6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:38.506262 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-plugged", "status": "completed", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:38.506781 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dceb757b-f51e-4cea-b49d-1ac2131066c6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:38.507410 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'code': 200} Dec 21 03:48:38.511412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-81fb894a-b7f8-4cf2-b0ac-26326413023e None None] Provisioning complete for port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:38.512006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-81fb894a-b7f8-4cf2-b0ac-26326413023e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.544407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6cb21e5-b34d-4a70-bb65-7f1b09c5b605 req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.592995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-81fb894a-b7f8-4cf2-b0ac-26326413023e None None] Port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:48:38.701903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7109cbe-8e2e-4ac2-9cc8-095e25ea3725 req-339ee583-7f36-47f8-ba8e-42c4b2cc5923 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:38.704530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7109cbe-8e2e-4ac2-9cc8-095e25ea3725 req-339ee583-7f36-47f8-ba8e-42c4b2cc5923 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.0852199 Dec 21 03:48:38.708896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:38.745044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6cb21e5-b34d-4a70-bb65-7f1b09c5b605 req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.782342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7109cbe-8e2e-4ac2-9cc8-095e25ea3725 req-24861830-610d-4483-877a-7abd4353fc9f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670102 Dec 21 03:48:38.813050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6cb21e5-b34d-4a70-bb65-7f1b09c5b605 req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.851454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=073a7b61-e5f8-496f-b950-4eee24692787,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:38.916381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:38.920977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:38.921388 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.941840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b366b448-4504-46da-ad0e-8b1e8652a27e req-09bfac47-dd13-454b-8abf-398789373aa3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:38.960650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b366b448-4504-46da-ad0e-8b1e8652a27e req-09bfac47-dd13-454b-8abf-398789373aa3 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 951 time: 0.0706480 Dec 21 03:48:38.971358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c6cb21e5-b34d-4a70-bb65-7f1b09c5b605 req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:38.972587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6cb21e5-b34d-4a70-bb65-7f1b09c5b605 req-b07cb807-8bd4-45aa-b2aa-b692893cb420 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 0.5567861 Dec 21 03:48:39.046966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b366b448-4504-46da-ad0e-8b1e8652a27e req-9491ebb1-aaf9-4496-a084-1d2e283dce52 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853257 Dec 21 03:48:39.053598 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:39.142465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:39.155307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf7d6af9-8376-492e-88b6-56b68ef72c9f req-88c78d5a-3359-4868-9665-ad1cb8e45ccc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 210 time: 0.0435038 Dec 21 03:48:39.193810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa2f395b-5d54-49d2-bd99-243f0bbabadf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:39.245609 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:39.311538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ee04eb-9ee6-43db-9ee6-a59116f5e608 req-90bb5fae-ab8a-41d7-98ae-c725f98c4744 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:39.314012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7ee04eb-9ee6-43db-9ee6-a59116f5e608 req-90bb5fae-ab8a-41d7-98ae-c725f98c4744 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0629942 Dec 21 03:48:39.339482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port fa2f395b-5d54-49d2-bd99-243f0bbabadf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:39.339764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:39.387214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:39.417909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7ee04eb-9ee6-43db-9ee6-a59116f5e608 req-2e18c6a1-cad4-4399-ab97-8f36ce3305b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899854 Dec 21 03:48:39.631233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-cdfa8431-1f44-4b11-95c9-0f19a90562a4 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0409865 Dec 21 03:48:39.703809 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:48:39.719119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-130d348b-15c9-4f9f-ba34-3552b0ab293b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:39.720808 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-130d348b-15c9-4f9f-ba34-3552b0ab293b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 812 time: 0.1847405 Dec 21 03:48:39.742297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-858e5fde-749e-4704-808f-436fab3b2d86 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/quotas/0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 375 time: 0.0140688 Dec 21 03:48:39.770790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-cba0226c-ee18-446e-b458-8549a99e975e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:39.772586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-cba0226c-ee18-446e-b458-8549a99e975e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1356478 Dec 21 03:48:39.783515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-2ed66d01-ccfa-4b68-8d03-90f62c5e80e0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0340953 Dec 21 03:48:39.813236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:39.880855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48730) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:39.885660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'security_group': {'name': 'tempest-securitygroup--312189738', 'description': 'tempest-description--125181373'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:39.949358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-b8333f5a-146f-4ae0-908d-005c5ad5ebe7 service neutron] 10.222.0.18 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1551440 Dec 21 03:48:40.004202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-9b9ddd45-b63d-404b-b624-a3e0945f2399 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:40.006114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-9b9ddd45-b63d-404b-b624-a3e0945f2399 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 951 time: 0.2516863 Dec 21 03:48:40.024030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.113046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-77aa44bb-2bf2-4b23-9278-66ea1ae9dc27 service neutron] 10.222.0.18 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1624522 Dec 21 03:48:40.162000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3304ced-32dd-4dfd-b084-a381aff18ca1 req-959f0806-f17a-4481-8323-c3f973da5c81 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 210 time: 0.0385859 Dec 21 03:48:40.166487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Deleting port 7be0b6c0-d923-4d30-8201-1599bce159fb {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:40.175821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.190113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.262730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.276156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:40.283100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.297417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.326147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'SecurityGroup': ['ID=23bc1696-ad98-4340-b8bf-f563caa89a24,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:40.352758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8bac4d-8036-4608-aac7-741337f217ad req-680f23d4-0bf9-4c02-acab-4dfc5f61a7f5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:40.361997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac8bac4d-8036-4608-aac7-741337f217ad req-680f23d4-0bf9-4c02-acab-4dfc5f61a7f5 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.1089835 Dec 21 03:48:40.387932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.390695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b90a0e8-fcc3-45d7-b72b-bd74906ffcce tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.5079434 Dec 21 03:48:40.395675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] For port 7be0b6c0-d923-4d30-8201-1599bce159fb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7be0b6c0-d923-4d30-8201-1599bce159fb,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:40.396276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.398308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48738) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:40.403684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'security_group_rule': {'security_group_id': '23bc1696-ad98-4340-b8bf-f563caa89a24', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:40.419147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Calling delete_port for 7be0b6c0-d923-4d30-8201-1599bce159fb owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:40.472576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac8bac4d-8036-4608-aac7-741337f217ad req-8d2c6040-db4c-4494-beea-52228b308ef9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1085863 Dec 21 03:48:40.509488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:40.512680 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00e6e130-46bc-4726-87d5-85abff950c4b" -d '{"events": [{"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-plugged", "status": "completed", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:40.518634 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.582105 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.681231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8125f37d-6245-40f4-a216-738e643d64b7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:40.705067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3536e75e-caf7-48c1-84b0-96ee74ff70dd req-765c0dac-ffce-42a2-98e9-ca0b6373a7b3 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 210 time: 0.1306000 Dec 21 03:48:40.709814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.775199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e04e8f-de49-4684-a71c-b654f15b3a83 req-7a8eac5d-7120-4d21-a610-cbc24f829484 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:40.776850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1e04e8f-de49-4684-a71c-b654f15b3a83 req-7a8eac5d-7120-4d21-a610-cbc24f829484 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 951 time: 0.2243984 Dec 21 03:48:40.822918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccd1a26c-907f-4851-ba98-8e3cb2ba49c9 req-22cedc47-e70e-4822-819b-0c7cc607a0c0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 210 time: 0.0407345 Dec 21 03:48:40.851427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.107 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/284452f9-cda6-4672-8b3a-5f31dab9e362) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:40.900645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1e04e8f-de49-4684-a71c-b654f15b3a83 req-6e23645b-c6a3-445c-9d3b-bd1f006beb7f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1068203 Dec 21 03:48:40.906780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.912392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.947301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['52f73cf2-b045-4f07-b974-6c29f7b35de0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:40.972889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:40.983558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event deleted for resources: {'Port': ['ID=7be0b6c0-d923-4d30-8201-1599bce159fb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:41.022718 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a8187f7-23de-484a-afb8-ae7dac0de7f9 x-openstack-request-id: req-1a8187f7-23de-484a-afb8-ae7dac0de7f9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:41.023552 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-plugged", "status": "completed", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:41.024209 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1a8187f7-23de-484a-afb8-ae7dac0de7f9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:41.025139 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'code': 200} Dec 21 03:48:41.028185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641', '4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:41.041638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=561897b0-740a-4019-b7e7-60b5bc37c187,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:41.089919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.097719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aac0ef0e-da59-42de-b8fd-ca9d5b157a12 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6979549 Dec 21 03:48:41.101431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:41.115745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'security_group_rule': {'security_group_id': '23bc1696-ad98-4340-b8bf-f563caa89a24', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:41.165210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] No DVR routers for this DVR port 7be0b6c0-d923-4d30-8201-1599bce159fb on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:41.168237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.179841 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b6318e8-3ab4-40fc-aa57-c2545c21a4b5 req-47229c9a-707e-4ffe-a817-caaf2b667c2f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "DELETE /v2.0/ports/7be0b6c0-d923-4d30-8201-1599bce159fb HTTP/1.1" status: 204 len: 173 time: 1.1642046 Dec 21 03:48:41.181477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e30142c-d722-4510-83a4-b8ce1a51736c req-523b8f69-487a-4b13-9878-a6aa13fa9560 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:41.184771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-deleted', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:41.188791 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab094626-4651-4f06-8645-e503eb494b82" -d '{"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-deleted", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:41.193574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e30142c-d722-4510-83a4-b8ce1a51736c req-523b8f69-487a-4b13-9878-a6aa13fa9560 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.2507453 Dec 21 03:48:41.300485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.321282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.415737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8507b4e1-75cf-4c0b-ba96-b9e1c16f6f0c req-04e49260-d530-4b0a-825c-faa903f9397f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 210 time: 0.1084726 Dec 21 03:48:41.442846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e30142c-d722-4510-83a4-b8ce1a51736c req-6a9a5fab-b621-463d-ac4d-ec3a52ced1d0 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2296684 Dec 21 03:48:41.493835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e54007df-dc5e-4e39-a664-ddbf61ddd15b req-5e753827-c9d9-40e3-80d6-e2cb804eb443 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:41.494477 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0169258b-8e79-4f79-bd8d-f35262f01ccc x-openstack-request-id: req-0169258b-8e79-4f79-bd8d-f35262f01ccc {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:41.494838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e54007df-dc5e-4e39-a664-ddbf61ddd15b req-5e753827-c9d9-40e3-80d6-e2cb804eb443 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 1097 time: 0.3219321 Dec 21 03:48:41.495809 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3be063ed-0cb0-4484-a469-fe9a531f05ff", "name": "network-vif-deleted", "tag": "7be0b6c0-d923-4d30-8201-1599bce159fb", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:41.496328 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0169258b-8e79-4f79-bd8d-f35262f01ccc {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:41.496997 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3be063ed-0cb0-4484-a469-fe9a531f05ff', 'name': 'network-vif-deleted', 'tag': '7be0b6c0-d923-4d30-8201-1599bce159fb', 'status': 'completed', 'code': 200} Dec 21 03:48:41.517993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.587154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:41.605149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:41.619286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:41.628014 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.672794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=284452f9-cda6-4672-8b3a-5f31dab9e362,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:41.693716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:41.694614 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.717543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e54007df-dc5e-4e39-a664-ddbf61ddd15b req-8ccec7e6-0bf1-411a-88f5-e3c4bcafbc3d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1865263 Dec 21 03:48:41.718072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:41.733680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-23a13330-e479-4df8-a332-b543aaa947a9 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:41.735384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-23a13330-e479-4df8-a332-b543aaa947a9 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.31 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 814 time: 0.2912478 Dec 21 03:48:41.771442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607fe6fa-a98c-40bb-a86c-7b5ce0fda738 req-743d9925-9dac-49c3-a2de-64a381bdc820 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:41.773399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-607fe6fa-a98c-40bb-a86c-7b5ce0fda738 req-743d9925-9dac-49c3-a2de-64a381bdc820 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.1615922 Dec 21 03:48:41.777959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e941562-1627-43bc-80fa-c036cf729894,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:41.788058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Request body: {'port': {'device_id': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'admin_state_up': True, 'tenant_id': '20acfa324e9b4279a50bf03610639a83'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:41.913400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-32bce748-1b57-42f7-ba58-4fd07813c1ba tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1062462 Dec 21 03:48:41.916493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0189a2a6-3ca7-4cf3-ad62-50ab46932d82 req-b906049f-5cce-488a-8a4b-196a9b303bf1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 210 time: 0.0563691 Dec 21 03:48:41.958393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Request body: {'port': {'device_id': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:41.959098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-12250c83-1d13-43db-8bc4-55f79c96a0b9 None None] Provisioning complete for port 284452f9-cda6-4672-8b3a-5f31dab9e362 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:41.959098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12250c83-1d13-43db-8bc4-55f79c96a0b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.007664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-607fe6fa-a98c-40bb-a86c-7b5ce0fda738 req-0d9376d0-3f64-4489-b250-dc8a9821ddd3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2247133 Dec 21 03:48:42.019639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.020881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cda7a682-1f7d-43c5-8091-20c879a0a150 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9158411 Dec 21 03:48:42.025073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-12250c83-1d13-43db-8bc4-55f79c96a0b9 None None] Port 284452f9-cda6-4672-8b3a-5f31dab9e362 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:48:42.042171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48768) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:48:42.059709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:42.069064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.081971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67140bc2-f0d5-466a-98df-bee0f76d7e4b req-e79549a5-9e3f-4514-8bc4-cda30660350e tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 210 time: 0.0599957 Dec 21 03:48:42.157460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21390212-fd56-4a77-a430-23608d26c462 req-c80e2c91-bb44-4a81-9ff4-8ded1cee444c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=3be063ed-0cb0-4484-a469-fe9a531f05ff HTTP/1.1" status: 200 len: 210 time: 0.0465212 Dec 21 03:48:42.159179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Made reservation on behalf of 20acfa324e9b4279a50bf03610639a83 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:42.163432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.290125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.394830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Allocated IP 172.20.0.7 (24735258-b5ad-42e8-a231-667c1278689e/da10d7f0-623a-4e8a-b5fc-286a12beadcd/da821d06-09e0-4580-a540-b604a6a13c16) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:42.412483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 284452f9-cda6-4672-8b3a-5f31dab9e362 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:42.422742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.442771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Transition to ACTIVE for port object 284452f9-cda6-4672-8b3a-5f31dab9e362 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:42.540319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.565268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.650632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Pushing event updated for resources: {'Port': ['ID=284452f9-cda6-4672-8b3a-5f31dab9e362,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:42.707394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:42.763747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Attempting to bind port 284452f9-cda6-4672-8b3a-5f31dab9e362 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:42.764311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Attempting to bind port 284452f9-cda6-4672-8b3a-5f31dab9e362 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:42.764439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Attempting to bind port 284452f9-cda6-4672-8b3a-5f31dab9e362 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:42.775827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Port 284452f9-cda6-4672-8b3a-5f31dab9e362 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:42.800592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Attempting to bind port 284452f9-cda6-4672-8b3a-5f31dab9e362 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:42.809925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:42.810586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:42.811555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:42.812733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Bound port: 284452f9-cda6-4672-8b3a-5f31dab9e362, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:42.813311 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:42.818843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 7be0b6c0-d923-4d30-8201-1599bce159fb {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:42.825811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7be0b6c0-d923-4d30-8201-1599bce159fb not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:42.910562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] For port 284452f9-cda6-4672-8b3a-5f31dab9e362, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:42.914436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] For port 284452f9-cda6-4672-8b3a-5f31dab9e362, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=284452f9-cda6-4672-8b3a-5f31dab9e362,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:42.985606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.021905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.022910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.025427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] 10.222.0.31 "PUT /v2.0/ports/284452f9-cda6-4672-8b3a-5f31dab9e362 HTTP/1.1" status: 200 len: 1097 time: 1.0961726 Dec 21 03:48:43.063082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40881b48-080a-4e60-9047-5c18b74a634c service neutron] Pushing event updated for resources: {'Port': ['ID=284452f9-cda6-4672-8b3a-5f31dab9e362,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:43.087991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0eb973-5770-4300-a4ca-99d4a3c1aec4 req-e29f9379-581a-486f-860e-376a86e07bd7 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.099233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f0eb973-5770-4300-a4ca-99d4a3c1aec4 req-e29f9379-581a-486f-860e-376a86e07bd7 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.5707052 Dec 21 03:48:43.136332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.152636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cf2a59-db60-4cc4-8b9c-e8a189f43b05 req-7bb7e01b-84b1-40bf-90af-e9d376f46727 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.160044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53cf2a59-db60-4cc4-8b9c-e8a189f43b05 req-7bb7e01b-84b1-40bf-90af-e9d376f46727 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 948 time: 0.5922811 Dec 21 03:48:43.275508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 172.25.5.36 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/38c1e6b4-a01b-45a9-9a05-d4bdede43e0f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:43.301439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53cf2a59-db60-4cc4-8b9c-e8a189f43b05 req-824abf86-d88d-42d2-98ed-07c5606aa6c3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1405234 Dec 21 03:48:43.304585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f0eb973-5770-4300-a4ca-99d4a3c1aec4 req-d96c6ad5-f66e-4e4b-b857-21904c3662f6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2045476 Dec 21 03:48:43.408907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.428842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-f71c13d3-48fe-4b76-a61b-24bdcb54b9c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.430341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-f71c13d3-48fe-4b76-a61b-24bdcb54b9c6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 1100 time: 0.1494670 Dec 21 03:48:43.487438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-419e5b74-7669-4477-bb12-63f04ffb1459 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=284452f9-cda6-4672-8b3a-5f31dab9e362 HTTP/1.1" status: 200 len: 217 time: 0.0407791 Dec 21 03:48:43.504118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'tag': '284452f9-cda6-4672-8b3a-5f31dab9e362'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:43.508186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.508334 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262" -d '{"events": [{"name": "network-changed", "server_uuid": "7912fa8b-d98e-4443-9bdc-d9159d1af766", "tag": "284452f9-cda6-4672-8b3a-5f31dab9e362"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:43.547998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-9dbe54b9-e9ac-4500-a5a4-df78311d8192 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.548643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Network 24735258-b5ad-42e8-a231-667c1278689e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:43.549507 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-9dbe54b9-e9ac-4500-a5a4-df78311d8192 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0529957 Dec 21 03:48:43.560429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:43.568285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:43.596130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:43.621338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-24419763-eab8-40d0-bf5c-2f5d90da04ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.623574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-24419763-eab8-40d0-bf5c-2f5d90da04ff service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0654583 Dec 21 03:48:43.637753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.638164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.638451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.638793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.639158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.639493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.639823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.640194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.640524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.640857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.641273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.641604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.641940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:48:43.669552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900fa03f-4399-4861-a945-796cd525f152 req-3fe4c764-acbc-42c6-8c03-8ffb6dd6c60e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.671192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-900fa03f-4399-4861-a945-796cd525f152 req-3fe4c764-acbc-42c6-8c03-8ffb6dd6c60e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.2029996 Dec 21 03:48:43.688485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841061a8-a03f-4d4b-bda4-99ecc2479120 req-cd1beb38-c5ee-4956-a72b-33a8ef6d09e4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.689935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-841061a8-a03f-4d4b-bda4-99ecc2479120 req-cd1beb38-c5ee-4956-a72b-33a8ef6d09e4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 931 time: 0.2167649 Dec 21 03:48:43.697373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:43.697988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.730604 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-35163f8b-fd3a-423a-aea4-2d13e10e2037 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0979865 Dec 21 03:48:43.772379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:43.782394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-900fa03f-4399-4861-a945-796cd525f152 req-ccbb3dcd-967c-44a3-84bf-e2dfb1873e07 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017976 Dec 21 03:48:43.809110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-841061a8-a03f-4d4b-bda4-99ecc2479120 req-ac7b6500-150f-46b1-8a5b-b077b927e89b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083775 Dec 21 03:48:43.824685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:43.832685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:43.841079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:43.867902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=38c1e6b4-a01b-45a9-9a05-d4bdede43e0f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:43.872877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-4d3580de-deb0-49d0-a861-1dbaba931535 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0963788 Dec 21 03:48:43.911546 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-01bf51cd-1434-498e-ae1e-0328568b1f61 req-fb8075d2-1fe6-4120-a430-4b6d669c3d19 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1718702 Dec 21 03:48:43.920016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Request body: {'port': {'device_id': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:43.923877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-118b607f-d780-48ba-ae2d-59bde36b5011 req-ce51ac96-1ede-4e2e-9bca-ebbe7c9a08f6 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 210 time: 0.0428550 Dec 21 03:48:43.980655 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eecaf187-adcc-4a25-94d3-9cc348b77e43 x-openstack-request-id: req-eecaf187-adcc-4a25-94d3-9cc348b77e43 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:43.980655 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7912fa8b-d98e-4443-9bdc-d9159d1af766", "tag": "284452f9-cda6-4672-8b3a-5f31dab9e362", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:43.980655 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eecaf187-adcc-4a25-94d3-9cc348b77e43 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:43.980655 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'tag': '284452f9-cda6-4672-8b3a-5f31dab9e362', 'status': 'completed', 'code': 200} Dec 21 03:48:44.013448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.034197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.190913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-e54ad61f-9fc5-4a19-94c6-5325df97b36d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.192534 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-e54ad61f-9fc5-4a19-94c6-5325df97b36d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 1100 time: 0.0977845 Dec 21 03:48:44.194705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.203492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-c9977de8-8a19-447c-8790-51b97cf5cddf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.204995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-c9977de8-8a19-447c-8790-51b97cf5cddf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 812 time: 0.1461656 Dec 21 03:48:44.227602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'port': {'device_id': '53f0e223-22b0-4253-a538-864a424aed19', 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a', 'admin_state_up': True, 'tenant_id': '0c51448e6fcd494e8c92714cc6e79d52'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:44.395195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-207eb7e0-ddf3-45d4-a9c3-c4f6ec5069d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.396770 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-207eb7e0-ddf3-45d4-a9c3-c4f6ec5069d9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1908062 Dec 21 03:48:44.451817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-7e93e085-b6d8-4dcb-be1d-2918eaa69bbd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=284452f9-cda6-4672-8b3a-5f31dab9e362 HTTP/1.1" status: 200 len: 217 time: 0.0411370 Dec 21 03:48:44.513395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da821d06-09e0-4580-a540-b604a6a13c16 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:44.518146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-88fdcd3a-b6d5-4294-b77e-5b794fe5d884 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.519632 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-88fdcd3a-b6d5-4294-b77e-5b794fe5d884 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0497603 Dec 21 03:48:44.527763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Made reservation on behalf of 0c51448e6fcd494e8c92714cc6e79d52 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:44.531270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.534001 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.567817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.569872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Transition to ACTIVE for port object da821d06-09e0-4580-a540-b604a6a13c16 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:44.586494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d778d322-5e24-4a2f-a0fa-88707d884472 req-e35e6826-6c66-4052-b0d8-0d0960858b70 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.588063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d778d322-5e24-4a2f-a0fa-88707d884472 req-e35e6826-6c66-4052-b0d8-0d0960858b70 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 948 time: 0.1401019 Dec 21 03:48:44.596402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e95db6a-8f90-44ca-a6f2-544961015087 req-6ce7abd9-4aa8-48d8-82ce-8589d5b5fa66 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.597741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e95db6a-8f90-44ca-a6f2-544961015087 req-6ce7abd9-4aa8-48d8-82ce-8589d5b5fa66 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1407232 Dec 21 03:48:44.642541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-17ced8e6-e0e6-4e26-907d-87ecfb0486fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.644148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-17ced8e6-e0e6-4e26-907d-87ecfb0486fb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0977497 Dec 21 03:48:44.652823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.698093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.705755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d778d322-5e24-4a2f-a0fa-88707d884472 req-d5826156-18fb-4d27-aa63-bdcbe793b0b4 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070955 Dec 21 03:48:44.708870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e95db6a-8f90-44ca-a6f2-544961015087 req-1e3a9df9-b254-475e-8b19-3a33b887fb83 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1043534 Dec 21 03:48:44.750298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Allocated IP 172.20.0.2 (ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a/787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca/6520df7f-f451-4f99-acca-7d2857ec0001) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:44.772455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=38c1e6b4-a01b-45a9-9a05-d4bdede43e0f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:44.820968 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-dbc5047e-1587-4dfc-bc59-7773b4bce793 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1535621 Dec 21 03:48:44.868148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.902292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:44.935929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bdc6a5d-89e0-48e2-a3ef-1a7f24455f4e req-d45ecf5b-4203-4abc-8578-4f8897091e68 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:44.938062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bdc6a5d-89e0-48e2-a3ef-1a7f24455f4e req-d45ecf5b-4203-4abc-8578-4f8897091e68 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 951 time: 0.1208022 Dec 21 03:48:44.938706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Attempting to bind port da821d06-09e0-4580-a540-b604a6a13c16 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:44.939061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Attempting to bind port da821d06-09e0-4580-a540-b604a6a13c16 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:44.939387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Attempting to bind port da821d06-09e0-4580-a540-b604a6a13c16 on network 24735258-b5ad-42e8-a231-667c1278689e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:44.944097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Port da821d06-09e0-4580-a540-b604a6a13c16 on network 24735258-b5ad-42e8-a231-667c1278689e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:44.944422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Attempting to bind port da821d06-09e0-4580-a540-b604a6a13c16 on network 24735258-b5ad-42e8-a231-667c1278689e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:44.955850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:44.961733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Checking segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:44.961733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Bound using segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:44.961733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Bound port: da821d06-09e0-4580-a540-b604a6a13c16, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:44.961733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:44.994919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb14b2ae-718c-4f1d-a43a-2ca4242b9262 req-8b2c3e1a-c12f-43d4-9fa8-ace656a14c38 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1641636 Dec 21 03:48:45.009702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.012312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.022247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-808cc17a-9a1d-4b4f-b999-b71d1e6075c1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.9604421 Dec 21 03:48:45.036280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bdc6a5d-89e0-48e2-a3ef-1a7f24455f4e req-eb243a50-d3d6-4b7c-b9bb-54f62ebbc7b7 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883169 Dec 21 03:48:45.061361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:45.064056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:45.120613 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.135884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.177923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.178784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.180391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] 10.222.0.31 "PUT /v2.0/ports/da821d06-09e0-4580-a540-b604a6a13c16 HTTP/1.1" status: 200 len: 1092 time: 1.2848403 Dec 21 03:48:45.180915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:45.183211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86716958-dba9-405d-b174-22f85e27aac5" -d '{"events": [{"name": "network-changed", "server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "tag": "da821d06-09e0-4580-a540-b604a6a13c16"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:45.186198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:45.189662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:45.199498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:45.203590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:45.249960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.250575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.255887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a8b5b4-fd6b-4d07-8633-2314c26dab2f service neutron] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:45.266908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcc86e4-5668-4e9c-a38e-9942b9d795c3 req-6104dc3b-5da4-4331-8abe-205f5bffe378 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.268451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0dcc86e4-5668-4e9c-a38e-9942b9d795c3 req-6104dc3b-5da4-4331-8abe-205f5bffe378 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.1610301 Dec 21 03:48:45.288922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b821a847-095d-4db5-afdd-59971a36d2c5 req-1e974ff4-e3df-4d53-9612-c7841be97e73 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.290381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b821a847-095d-4db5-afdd-59971a36d2c5 req-1e974ff4-e3df-4d53-9612-c7841be97e73 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 943 time: 0.1480668 Dec 21 03:48:45.330151 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-6b341bf6-c82b-491f-a8c1-da02c4d09ce4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1064343 Dec 21 03:48:45.350490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Request body: {'port': {'device_id': '53f0e223-22b0-4253-a538-864a424aed19', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:45.382690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0dcc86e4-5668-4e9c-a38e-9942b9d795c3 req-b92b20f2-d804-483a-823d-5544575f1ac1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071675 Dec 21 03:48:45.387078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b821a847-095d-4db5-afdd-59971a36d2c5 req-899e0b45-4d4e-49bc-8ed7-a863224f82c9 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885196 Dec 21 03:48:45.396895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-d0600ffb-2988-489a-844c-4e5a079a5991 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.402661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-d0600ffb-2988-489a-844c-4e5a079a5991 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 1095 time: 0.0898786 Dec 21 03:48:45.418270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.474804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-93c8d53b-fe4f-4173-9b64-c671c248181a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=da821d06-09e0-4580-a540-b604a6a13c16 HTTP/1.1" status: 200 len: 217 time: 0.0617986 Dec 21 03:48:45.551094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-628d9fb4-2fb5-4e9b-8d04-82a54ceed208 req-8a412261-c46f-43a6-b0ec-37d73cbedac1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.552611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-628d9fb4-2fb5-4e9b-8d04-82a54ceed208 req-8a412261-c46f-43a6-b0ec-37d73cbedac1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 931 time: 0.0808201 Dec 21 03:48:45.591513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aec015-dcab-4444-8a46-3eade4335534 req-4c0c0e46-93bf-47ea-a09f-b0905c1f21a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.592927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-4c0c0e46-93bf-47ea-a09f-b0905c1f21a7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 200 len: 854 time: 0.0809653 Dec 21 03:48:45.645330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-42cbc8bb-9e46-4a41-bfaa-1c91334fec59 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=24735258-b5ad-42e8-a231-667c1278689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0374207 Dec 21 03:48:45.687724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-628d9fb4-2fb5-4e9b-8d04-82a54ceed208 req-d6fd1dfb-2db7-4e56-87e0-19104e1f4f16 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264763 Dec 21 03:48:45.695554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6520df7f-f451-4f99-acca-7d2857ec0001 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:45.703877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.705863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df58fa53-19eb-40d2-bf16-935b33a5c218 req-8afa4981-029b-46ea-9afc-8ac728d4b239 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:45.707027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df58fa53-19eb-40d2-bf16-935b33a5c218 req-8afa4981-029b-46ea-9afc-8ac728d4b239 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1360178 Dec 21 03:48:45.716501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Transition to ACTIVE for port object 6520df7f-f451-4f99-acca-7d2857ec0001 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:48:45.741459 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04f51176-870c-4882-9814-10df7cd5409a x-openstack-request-id: req-04f51176-870c-4882-9814-10df7cd5409a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:45.741740 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "tag": "da821d06-09e0-4580-a540-b604a6a13c16", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:45.741996 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-04f51176-870c-4882-9814-10df7cd5409a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:45.742389 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16', 'status': 'completed', 'code': 200} Dec 21 03:48:45.767734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:45.809735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-e6efff2d-0dae-474d-8372-ae315e9efd94 service neutron] 10.222.0.31 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517866 Dec 21 03:48:45.813204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df58fa53-19eb-40d2-bf16-935b33a5c218 req-c478f63c-ed04-422a-8a28-c57eebdbb60f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760036 Dec 21 03:48:45.822507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:45.961585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-d63abddc-e3dd-473d-9dec-c9887eadee7a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--312189738&fields=id&tenant_id=6d65cc45e25946eeb479e45c44089cf7 HTTP/1.1" status: 200 len: 267 time: 0.1473989 Dec 21 03:48:46.048168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51aec015-dcab-4444-8a46-3eade4335534 req-48af0070-0e21-47a4-8adf-084e54bd9ce1 service neutron] 10.222.0.31 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2275195 Dec 21 03:48:46.056336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44493358-4444-418d-bac6-a5f083fae89e req-94ff2499-bbdd-4e9d-ae78-0611d2cb9438 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.059998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44493358-4444-418d-bac6-a5f083fae89e req-94ff2499-bbdd-4e9d-ae78-0611d2cb9438 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 948 time: 0.1682055 Dec 21 03:48:46.069946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-65cbc91e-a1e6-41ba-8f95-321ced904332 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.072018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-65cbc91e-a1e6-41ba-8f95-321ced904332 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 931 time: 0.0910904 Dec 21 03:48:46.089352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e6f065-b018-493d-979c-11dffb974f49 req-16caadf8-2412-4407-a384-7967e3073d17 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.090816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e6f065-b018-493d-979c-11dffb974f49 req-16caadf8-2412-4407-a384-7967e3073d17 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 951 time: 0.1471977 Dec 21 03:48:46.170889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Attempting to bind port 6520df7f-f451-4f99-acca-7d2857ec0001 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:46.172023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Attempting to bind port 6520df7f-f451-4f99-acca-7d2857ec0001 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:46.172143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Attempting to bind port 6520df7f-f451-4f99-acca-7d2857ec0001 on network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:46.176613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Port 6520df7f-f451-4f99-acca-7d2857ec0001 on network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:46.176932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Attempting to bind port 6520df7f-f451-4f99-acca-7d2857ec0001 on network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:46.182024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:46.182358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Checking segment: {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:46.182753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Bound using segment: {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:46.183187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Bound port: 6520df7f-f451-4f99-acca-7d2857ec0001, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:46.183720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:46.186418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-c5fd9852-9934-4fd3-aeeb-c7163371e909 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.188400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-c5fd9852-9934-4fd3-aeeb-c7163371e909 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 931 time: 0.0966556 Dec 21 03:48:46.248847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:46.252308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:46.279516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44493358-4444-418d-bac6-a5f083fae89e req-1afcdc69-d17a-40d4-9282-d6924a9374b4 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2045028 Dec 21 03:48:46.297073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-dce8bbb3-52d1-4577-bd8a-b392e1943073 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&fixed_ips=ip_address%3D10.2.2.100&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0958862 Dec 21 03:48:46.321113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:46.341472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.342947 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:46.343655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-cd2078ab-909a-4db6-9e0b-365d9e13a3f4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&fixed_ips=ip_address%3D10.2.2.200&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0354562 Dec 21 03:48:46.344757 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] 10.222.0.31 "PUT /v2.0/ports/6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 1092 time: 0.9983466 Dec 21 03:48:46.366170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:46.368854 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02313956-a51a-43fb-b20f-04a901435ec2" -d '{"events": [{"name": "network-changed", "server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:46.370024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86716958-dba9-405d-b174-22f85e27aac5 req-a39db24f-2882-4a8a-97b9-e5a071d03873 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.371521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-a39db24f-2882-4a8a-97b9-e5a071d03873 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 1095 time: 0.1664269 Dec 21 03:48:46.402776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3abc5157-b9c2-45d8-8ce9-4cef61f2480a service neutron] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:46.447586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Deleting port 52f73cf2-b045-4f07-b974-6c29f7b35de0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:46.447933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:46.541411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-f07f1e19-241e-4c97-8bc6-3b1aa7b06011 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.543403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-f07f1e19-241e-4c97-8bc6-3b1aa7b06011 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1095 time: 0.0454428 Dec 21 03:48:46.589925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a69746-0afc-440d-bbad-2c3e397dcf35 req-3b5b6e03-29f3-4d39-a208-53dc5f790a83 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.591435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60a69746-0afc-440d-bbad-2c3e397dcf35 req-3b5b6e03-29f3-4d39-a208-53dc5f790a83 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=dc0f3acf-6074-4280-a0ca-acba7f203030 HTTP/1.1" status: 200 len: 951 time: 0.2511871 Dec 21 03:48:46.594464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-715d24be-a022-41af-bfe7-9613df6bf88d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 217 time: 0.0345030 Dec 21 03:48:46.645685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429911e-3e48-4373-a795-2193dcf1af75 req-d729e296-54ff-493d-b70a-f06176d4d983 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.647172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-d729e296-54ff-493d-b70a-f06176d4d983 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.0449104 Dec 21 03:48:46.665869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-84d6756a-015e-42d1-9168-c0be3fc93126 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.672258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-84d6756a-015e-42d1-9168-c0be3fc93126 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.678039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-84d6756a-015e-42d1-9168-c0be3fc93126 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.679660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-84d6756a-015e-42d1-9168-c0be3fc93126 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/networks?id=04ed2fa2-4e59-410d-9778-4535a349c6b9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=19393033-2861-465d-ab20-b8ec53781acb&id=19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 200 len: 1990 time: 0.3246942 Dec 21 03:48:46.679926 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-eff43f23-cb6a-4231-b5b0-1296d9a70ad8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244734 Dec 21 03:48:46.705087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86716958-dba9-405d-b174-22f85e27aac5 req-bdd262a8-d140-4aff-bca7-edc7bbf912f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:46.706529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-bdd262a8-d140-4aff-bca7-edc7bbf912f7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 915 time: 0.3184557 Dec 21 03:48:46.708261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] For port 52f73cf2-b045-4f07-b974-6c29f7b35de0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=52f73cf2-b045-4f07-b974-6c29f7b35de0,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:46.708628 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:46.770091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e050451d-b6b3-4c56-ac34-4965e7a01e6b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/quotas/6d65cc45e25946eeb479e45c44089cf7 HTTP/1.1" status: 200 len: 375 time: 0.0785933 Dec 21 03:48:46.771839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Calling delete_port for 52f73cf2-b045-4f07-b974-6c29f7b35de0 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:46.773341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 284452f9-cda6-4672-8b3a-5f31dab9e362 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:46.777176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-75ddfabc-fdb9-4cdd-917a-9950560747c9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=da821d06-09e0-4580-a540-b604a6a13c16 HTTP/1.1" status: 200 len: 217 time: 0.0533285 Dec 21 03:48:46.783880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60a69746-0afc-440d-bbad-2c3e397dcf35 req-ea8310e5-5294-4cad-937a-b84237ac7cbd tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1818542 Dec 21 03:48:46.792443 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-382ae6dd-4300-4da0-a6a5-1e6451929184 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952108 Dec 21 03:48:46.870291 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbded4b5-e38c-4527-940a-d96946d8d8f3 x-openstack-request-id: req-dbded4b5-e38c-4527-940a-d96946d8d8f3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:46.871034 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:46.871525 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dbded4b5-e38c-4527-940a-d96946d8d8f3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:46.872133 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001', 'status': 'completed', 'code': 200} Dec 21 03:48:46.898155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 284452f9-cda6-4672-8b3a-5f31dab9e362, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=284452f9-cda6-4672-8b3a-5f31dab9e362,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:46.910509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '284452f9-cda6-4672-8b3a-5f31dab9e362', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '284452f9-cda6-4672-8b3a-5f31dab9e362', 'mac_address': 'fa:16:3e:fc:46:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.107'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:46.917229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7429911e-3e48-4373-a795-2193dcf1af75 req-9e52f433-1806-4ccb-87fe-2b52b7118f63 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1138997 Dec 21 03:48:46.955043 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:46.968682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 284452f9-cda6-4672-8b3a-5f31dab9e362 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:46.990735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 284452f9-cda6-4672-8b3a-5f31dab9e362, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=284452f9-cda6-4672-8b3a-5f31dab9e362,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:47.068723 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:47.125855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=284452f9-cda6-4672-8b3a-5f31dab9e362,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:47.152157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02313956-a51a-43fb-b20f-04a901435ec2 req-52459848-0fe5-44b2-a042-63ec39a8bee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:47.153712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-52459848-0fe5-44b2-a042-63ec39a8bee3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1095 time: 0.0417597 Dec 21 03:48:47.247193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02313956-a51a-43fb-b20f-04a901435ec2 req-0ba30f48-88d6-4efc-a1b2-8635b0efb6cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:47.248671 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-0ba30f48-88d6-4efc-a1b2-8635b0efb6cd service neutron] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 913 time: 0.0867128 Dec 21 03:48:47.273445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-9e1e7e59-dfa2-4e0a-9d8a-594bbd29ee8f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&fields=id HTTP/1.1" status: 200 len: 486 time: 0.4938076 Dec 21 03:48:47.275109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86716958-dba9-405d-b174-22f85e27aac5 req-9bb6f459-cfca-4393-99cb-7fd9437571e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:47.276433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-9bb6f459-cfca-4393-99cb-7fd9437571e2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 200 len: 854 time: 0.4882798 Dec 21 03:48:47.294680 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-36190f65-1a60-4938-a6dc-59718a9fa623 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 217 time: 0.0380576 Dec 21 03:48:47.317719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605e69b7-3d96-44cf-a56a-642a27f0e1d9 req-818cde5c-7273-4728-9b39-1f32248a6656 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:47.320262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-605e69b7-3d96-44cf-a56a-642a27f0e1d9 req-818cde5c-7273-4728-9b39-1f32248a6656 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.1515050 Dec 21 03:48:47.346031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02313956-a51a-43fb-b20f-04a901435ec2 req-6cc9d33e-026a-4e2b-9ac4-f772a00b33bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:47.347723 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-6cc9d33e-026a-4e2b-9ac4-f772a00b33bb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.0452995 Dec 21 03:48:47.348698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-bc0e4b7f-1f42-4300-b5dc-37eb549626dc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=24735258-b5ad-42e8-a231-667c1278689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0599725 Dec 21 03:48:47.388010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-8b8f8c3e-1497-4320-90e5-82e35115c647 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249922 Dec 21 03:48:47.440586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:47.492852 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-2386c9e0-0449-4135-ae47-b9fcb930a21f service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0961187 Dec 21 03:48:47.526823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-605e69b7-3d96-44cf-a56a-642a27f0e1d9 req-eee478af-5dcf-4bec-b627-9b33079255b6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1865082 Dec 21 03:48:47.544178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-3b9ae6e9-9b93-4e60-ba25-413f5d4ae066 service neutron] 10.222.0.18 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2570436 Dec 21 03:48:47.599803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:47.610745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02313956-a51a-43fb-b20f-04a901435ec2 req-d684f3ec-c742-4e8a-a0aa-4b7a84885549 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036508 Dec 21 03:48:47.638865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-f24340de-d95d-464e-9163-eef931596cbc service neutron] 10.222.0.31 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2468641 Dec 21 03:48:47.681024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event deleted for resources: {'Port': ['ID=52f73cf2-b045-4f07-b974-6c29f7b35de0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:47.774844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] No DVR routers for this DVR port 52f73cf2-b045-4f07-b974-6c29f7b35de0 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:47.783716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:47.786938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3e6f065-b018-493d-979c-11dffb974f49 req-7632fe8e-88b6-4c32-bff4-cb920942016d tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.54 "DELETE /v2.0/ports/52f73cf2-b045-4f07-b974-6c29f7b35de0 HTTP/1.1" status: 204 len: 173 time: 1.6798577 Dec 21 03:48:47.787374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-deleted', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:47.789625 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-432b124b-52ea-487f-837a-244b5c3fc05f" -d '{"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-deleted", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:47.856141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3680e783-b47c-4fec-b856-c65eacab8bd4 req-269e8c68-2f8b-42f8-92bb-1a38c83c6105 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:47.857555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3680e783-b47c-4fec-b856-c65eacab8bd4 req-269e8c68-2f8b-42f8-92bb-1a38c83c6105 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 943 time: 0.2384050 Dec 21 03:48:47.862671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-52a232cf-7d17-41b9-9a81-5f45f66960d2 service neutron] 10.222.0.18 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3093755 Dec 21 03:48:47.928634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86716958-dba9-405d-b174-22f85e27aac5 req-b681a0f3-42b7-455c-9a1f-1e3992ffab01 service neutron] 10.222.0.31 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2620203 Dec 21 03:48:47.942140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-f569793c-ac10-43b5-a3ed-ef9bda565416 service neutron] 10.222.0.18 "GET /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0665870 Dec 21 03:48:47.966718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3680e783-b47c-4fec-b856-c65eacab8bd4 req-beb02d3d-f8ab-4c3f-96fb-c759a2788488 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1013577 Dec 21 03:48:48.051459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-9b8b1364-5767-40e7-9197-035fa25763a5 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1008437 Dec 21 03:48:48.171495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-1c0ec872-c0c4-40ee-a168-d62d49876155 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1147153 Dec 21 03:48:48.205172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641', '4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:48.228225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-38856461-cf99-44ce-926b-658553622b89 service neutron] 10.222.0.18 "GET /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0432031 Dec 21 03:48:48.237865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190460d1-5645-4daa-b4b6-92e4e3f9934e req-28538474-72da-4179-8595-3751d4c4207d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:48.239377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-190460d1-5645-4daa-b4b6-92e4e3f9934e req-28538474-72da-4179-8595-3751d4c4207d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 943 time: 0.0890102 Dec 21 03:48:48.352981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-190460d1-5645-4daa-b4b6-92e4e3f9934e req-10369482-716e-4d50-8d4d-7788a17adfa0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034398 Dec 21 03:48:48.369490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-927061e8-d288-46d5-821b-44235ac805d9 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291516 Dec 21 03:48:48.514350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54d59d57-ec68-4974-be13-6e974d80d41b req-436134d6-9637-4d45-8dee-a97d07458541 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:48.515911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54d59d57-ec68-4974-be13-6e974d80d41b req-436134d6-9637-4d45-8dee-a97d07458541 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0990372 Dec 21 03:48:48.519795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a12d3155-51dc-4430-bbc5-14e51ede1682 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1421585 Dec 21 03:48:48.626585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54d59d57-ec68-4974-be13-6e974d80d41b req-8b64232a-aa76-40cb-a560-223bb13899a6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1035347 Dec 21 03:48:48.649024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8bfd2997-6ca1-43e7-bde2-6b069cd403a8 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1197596 Dec 21 03:48:48.767641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:48.789440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 52f73cf2-b045-4f07-b974-6c29f7b35de0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:48.789790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 52f73cf2-b045-4f07-b974-6c29f7b35de0 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:48.793643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aee09e5-64b1-443e-8e2c-cc28634956cd req-3a82ec01-7f0c-4d25-ab68-7797772256c3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:48.795383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aee09e5-64b1-443e-8e2c-cc28634956cd req-3a82ec01-7f0c-4d25-ab68-7797772256c3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 949 time: 0.0990319 Dec 21 03:48:48.798010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-2da0e02d-494d-4c75-9e9b-8f946c4d926a service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1394126 Dec 21 03:48:48.809855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6520df7f-f451-4f99-acca-7d2857ec0001 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:48.823504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 284452f9-cda6-4672-8b3a-5f31dab9e362 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:48.902643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aee09e5-64b1-443e-8e2c-cc28634956cd req-9ee19990-df02-46f9-ab07-112b81330333 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999584 Dec 21 03:48:48.936908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-ab655a26-12c6-46d2-9f30-85e58b87e208 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278627 Dec 21 03:48:48.954331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:48.955412 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f69c2b9-a351-4d73-8222-de3d7abb91fe x-openstack-request-id: req-4f69c2b9-a351-4d73-8222-de3d7abb91fe {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:48.955702 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc0f3acf-6074-4280-a0ca-acba7f203030", "name": "network-vif-deleted", "tag": "52f73cf2-b045-4f07-b974-6c29f7b35de0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:48.955998 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4f69c2b9-a351-4d73-8222-de3d7abb91fe {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:48.956385 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc0f3acf-6074-4280-a0ca-acba7f203030', 'name': 'network-vif-deleted', 'tag': '52f73cf2-b045-4f07-b974-6c29f7b35de0', 'status': 'completed', 'code': 200} Dec 21 03:48:48.967237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '6520df7f-f451-4f99-acca-7d2857ec0001', 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a', 'port_id': '6520df7f-f451-4f99-acca-7d2857ec0001', 'mac_address': 'fa:16:3e:68:d5:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:49.004308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 284452f9-cda6-4672-8b3a-5f31dab9e362 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:49.011849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 284452f9-cda6-4672-8b3a-5f31dab9e362 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:49.012219 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.014802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.056297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6520df7f-f451-4f99-acca-7d2857ec0001 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:49.080768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:49.091915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6a3df1ff-e6f2-475c-971e-67945d2feff8 service neutron] 10.222.0.18 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1455595 Dec 21 03:48:49.123862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b129755a-e199-4095-9915-52c3f1699d65 req-ea826007-ed73-4a77-b055-49c4050330e1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:49.125434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b129755a-e199-4095-9915-52c3f1699d65 req-ea826007-ed73-4a77-b055-49c4050330e1 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.0955784 Dec 21 03:48:49.128752 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.154232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '284452f9-cda6-4672-8b3a-5f31dab9e362'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:49.157728 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-639f31f7-55fb-42bc-8853-bceff25bea40" -d '{"events": [{"server_uuid": "7912fa8b-d98e-4443-9bdc-d9159d1af766", "name": "network-vif-plugged", "status": "completed", "tag": "284452f9-cda6-4672-8b3a-5f31dab9e362"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:49.162432 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.163116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:49.194262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 284452f9-cda6-4672-8b3a-5f31dab9e362, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=284452f9-cda6-4672-8b3a-5f31dab9e362,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:49.224610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b129755a-e199-4095-9915-52c3f1699d65 req-c88c7085-cddc-4127-a641-b86859e5db8f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904257 Dec 21 03:48:49.230695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-125ad7a4-5e42-4f0d-965b-c19341e14a2e service neutron] 10.222.0.18 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1351020 Dec 21 03:48:49.243223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:49.247084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.336169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-4f3bc989-bd98-4e86-bce9-0837d6d5c3c2 service neutron] 10.222.0.18 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0990260 Dec 21 03:48:49.338957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=284452f9-cda6-4672-8b3a-5f31dab9e362,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:49.348145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:49.359151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'da821d06-09e0-4580-a540-b604a6a13c16', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'port_id': 'da821d06-09e0-4580-a540-b604a6a13c16', 'mac_address': 'fa:16:3e:7d:93:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da10d7f0-623a-4e8a-b5fc-286a12beadcd', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:48:49.396338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.409849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da821d06-09e0-4580-a540-b604a6a13c16 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:48:49.428731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:49.436417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-4568cd05-fa09-4055-b81b-a573caaacde0 service neutron] 10.222.0.18 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884602 Dec 21 03:48:49.519405 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.524846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-4ef8e5fb-bc2b-4f35-a366-d69baf8c4eb1 service neutron] 10.222.0.18 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817659 Dec 21 03:48:49.583495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:49.740737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab96bfc-0fd2-4846-9c3c-33f80d6ce448 req-6f256d2a-b866-40e7-9ef5-4b25083d07e2 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:49.742227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ab96bfc-0fd2-4846-9c3c-33f80d6ce448 req-6f256d2a-b866-40e7-9ef5-4b25083d07e2 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 944 time: 0.0583618 Dec 21 03:48:49.790287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ab96bfc-0fd2-4846-9c3c-33f80d6ce448 req-c34cf149-e67e-4b37-9787-6aa5a0d5a48f tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422199 Dec 21 03:48:49.790523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af460ffc-1785-45f3-899c-93c21bc372dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:49.912634 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c311b1dc-e843-4c9f-94f0-aa0b0625c6ac x-openstack-request-id: req-c311b1dc-e843-4c9f-94f0-aa0b0625c6ac {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:49.912933 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7912fa8b-d98e-4443-9bdc-d9159d1af766", "name": "network-vif-plugged", "status": "completed", "tag": "284452f9-cda6-4672-8b3a-5f31dab9e362", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:49.913193 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c311b1dc-e843-4c9f-94f0-aa0b0625c6ac {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:49.913591 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '284452f9-cda6-4672-8b3a-5f31dab9e362', 'code': 200} Dec 21 03:48:49.925138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:49.950222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['da821d06-09e0-4580-a540-b604a6a13c16'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:50.024048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b86f2-f918-4cf3-82eb-381e0abfac30 req-64894ac0-5650-441e-bcab-c9cbd889fb8b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.027017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-598b86f2-f918-4cf3-82eb-381e0abfac30 req-64894ac0-5650-441e-bcab-c9cbd889fb8b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 944 time: 0.0654044 Dec 21 03:48:50.100545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5895f96-abce-4514-adf6-62a2bf1d9a9d req-c2077dff-0028-471f-add1-39c319a08ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.101959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5895f96-abce-4514-adf6-62a2bf1d9a9d req-c2077dff-0028-471f-add1-39c319a08ea6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 1102 time: 0.0738945 Dec 21 03:48:50.105751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-598b86f2-f918-4cf3-82eb-381e0abfac30 req-a5a4ac07-5a7f-4696-8b7c-0586e59b2def tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684478 Dec 21 03:48:50.159104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5895f96-abce-4514-adf6-62a2bf1d9a9d req-2ffd2423-ac9e-4c5a-93d5-3ec1362ba222 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464220 Dec 21 03:48:50.223146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334f487f-31a2-4e39-a692-d826ff4b9fab req-06ed010d-8523-4cb4-a6f3-c252c9456bd5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.224689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-334f487f-31a2-4e39-a692-d826ff4b9fab req-06ed010d-8523-4cb4-a6f3-c252c9456bd5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0498018 Dec 21 03:48:50.271306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-334f487f-31a2-4e39-a692-d826ff4b9fab req-3217f814-6ac9-495c-8869-63d23c3f35a5 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406327 Dec 21 03:48:50.373746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1be337-2a26-4df6-a46a-6e5c15ead17c req-b522f34b-4964-45c3-ad4e-b0746aeac335 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.375221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc1be337-2a26-4df6-a46a-6e5c15ead17c req-b522f34b-4964-45c3-ad4e-b0746aeac335 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0487680 Dec 21 03:48:50.426135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc1be337-2a26-4df6-a46a-6e5c15ead17c req-6bd9f98c-f0fd-4780-a1e4-57832429faf6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445585 Dec 21 03:48:50.527725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10562468-0a8a-4c95-ae85-219b59a5ad75 req-7ab7a1ea-83f9-4010-8755-e64c2407ca87 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.529205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562468-0a8a-4c95-ae85-219b59a5ad75 req-7ab7a1ea-83f9-4010-8755-e64c2407ca87 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 950 time: 0.0495543 Dec 21 03:48:50.607333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10562468-0a8a-4c95-ae85-219b59a5ad75 req-422de80f-920c-400f-bbbe-f67251de3070 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648417 Dec 21 03:48:50.609352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-0ae31b47-65a4-46ff-bd27-d170affe68b6 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.610766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-0ae31b47-65a4-46ff-bd27-d170affe68b6 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.0763791 Dec 21 03:48:50.630781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:50.707123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:50.766473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-debc3201-5e05-4aab-a3d1-03eb4b4ddabf req-e670bf12-71c6-40c8-ad50-4d90d691c4bc tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:50.769852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-debc3201-5e05-4aab-a3d1-03eb4b4ddabf req-e670bf12-71c6-40c8-ad50-4d90d691c4bc tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 945 time: 0.0927699 Dec 21 03:48:50.771906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:48:50.845826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-255db314-e66a-4207-9f34-acaae6c21b58 req-0783f8dd-61e6-4698-9136-a3d2ca2288d6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0843778 Dec 21 03:48:50.950389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-debc3201-5e05-4aab-a3d1-03eb4b4ddabf req-84ba0e47-1e45-4fac-867b-b27cf581af33 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1755028 Dec 21 03:48:50.990392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:51.018553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6018eb36-b2ad-45bf-a704-b2006329faee req-6c18b53e-a663-49db-8648-0b9491b5c36b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:51.020103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6018eb36-b2ad-45bf-a704-b2006329faee req-6c18b53e-a663-49db-8648-0b9491b5c36b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 944 time: 0.0909786 Dec 21 03:48:51.020519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:51.032459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:48:51.059713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:51.120261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6018eb36-b2ad-45bf-a704-b2006329faee req-0542b9fc-aa1f-4473-80e2-f7f874421268 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0924852 Dec 21 03:48:51.122828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:51.125739 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a109fcb-b557-473a-a7d6-10043a239780" -d '{"events": [{"server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "name": "network-vif-unplugged", "status": "completed", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:51.129701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:51.167831 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc4d4a80-e447-4dd3-bb88-f0b6c0854fc8 x-openstack-request-id: req-cc4d4a80-e447-4dd3-bb88-f0b6c0854fc8 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:51.168136 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "name": "network-vif-unplugged", "status": "completed", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:51.168392 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cc4d4a80-e447-4dd3-bb88-f0b6c0854fc8 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:51.168789 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'code': 200} Dec 21 03:48:51.217582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:51.257878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79746b4e-d020-4edf-bd52-460f1fead0dc req-b742f1c9-f3cb-417c-b683-0d036a27e942 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:51.259535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79746b4e-d020-4edf-bd52-460f1fead0dc req-b742f1c9-f3cb-417c-b683-0d036a27e942 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 944 time: 0.0760310 Dec 21 03:48:51.312766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:51.366596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:48:51.366960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:48:51.367277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:51.374094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79746b4e-d020-4edf-bd52-460f1fead0dc req-bcd4038a-4553-4f40-ad04-1976df943b23 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041982 Dec 21 03:48:51.389514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:48:51.389838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Attempting to bind port f39fe48f-e6af-49d1-a42c-899b81bdf60b on network 8b13f1ae-b717-40da-b68e-bdf950529b14 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:48:51.399989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:48:51.400322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Checking segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:48:51.400702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Bound using segment: {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:48:51.401130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Bound port: f39fe48f-e6af-49d1-a42c-899b81bdf60b, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d9290ab-2323-4925-8697-d275634cc5ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '8b13f1ae-b717-40da-b68e-bdf950529b14'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:48:51.401479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:51.429665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b1e7661-f23a-452f-b931-8cfb94b95aed req-c42b832a-74d8-49c3-bb6c-82385f6a166f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:51.431171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b1e7661-f23a-452f-b931-8cfb94b95aed req-c42b832a-74d8-49c3-bb6c-82385f6a166f tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0755022 Dec 21 03:48:51.536363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:48:51.553922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b1e7661-f23a-452f-b931-8cfb94b95aed req-e71ef3b8-3638-495e-bb0c-5dbc51c9011c tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1058657 Dec 21 03:48:51.559114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:48:51.574967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35293414-ad3b-4a21-8e9c-0fff7a560068 req-cb5dc92f-66df-4ecb-8b48-53b322c8709f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:51.579283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35293414-ad3b-4a21-8e9c-0fff7a560068 req-cb5dc92f-66df-4ecb-8b48-53b322c8709f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0790274 Dec 21 03:48:51.626845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35293414-ad3b-4a21-8e9c-0fff7a560068 req-49fadcf7-a53a-4b11-9f96-a0c0aeadfd43 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441427 Dec 21 03:48:51.657869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:51.763453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:51.764424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:51.765858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] 10.222.0.54 "PUT /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 1123 time: 1.1426084 Dec 21 03:48:51.782119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee787b3-3000-4f2d-be03-c5dbb63cbc63 service neutron] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=8']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.790919 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:48:51.793955 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:48:51.795049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e1ebd9-95ce-4c83-8eec-b6a7365ae3a7 req-0a870922-a7ca-41d7-af62-fb88055b52f4 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:51.802434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e1ebd9-95ce-4c83-8eec-b6a7365ae3a7 req-0a870922-a7ca-41d7-af62-fb88055b52f4 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 950 time: 0.1116693 Dec 21 03:48:51.845006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e1ebd9-95ce-4c83-8eec-b6a7365ae3a7 req-5bd778dd-da4b-43f4-9ca0-6e068b9fd950 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424733 Dec 21 03:48:51.924272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['f39fe48f-e6af-49d1-a42c-899b81bdf60b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:51.943480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd2c2143-843b-4b3e-b9a5-09517cbc598a req-37003eee-ed11-43dd-986d-760b1ff60f79 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0382006 Dec 21 03:48:51.971713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['f39fe48f-e6af-49d1-a42c-899b81bdf60b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:52.013290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-2026bc6e-0ec6-4981-85c6-5a404b200d25 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:52.016655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-2026bc6e-0ec6-4981-85c6-5a404b200d25 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 950 time: 0.0820689 Dec 21 03:48:52.136386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801ac662-7e30-4848-a8ae-22db78b2bec4 req-7cbcd51e-6252-4ef3-96e0-338ebf5c9bb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:52.140784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-801ac662-7e30-4848-a8ae-22db78b2bec4 req-7cbcd51e-6252-4ef3-96e0-338ebf5c9bb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 1102 time: 0.1471138 Dec 21 03:48:52.156750 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-79e89e04-5eb5-46b1-b1c0-b755d679f59a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.181963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e7f090-09fb-45bc-848d-4ff5e34214ab req-5f8f8e44-997c-4a07-a50e-2b1d9719d378 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:52.183692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73e7f090-09fb-45bc-848d-4ff5e34214ab req-5f8f8e44-997c-4a07-a50e-2b1d9719d378 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1437562 Dec 21 03:48:52.184827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-801ac662-7e30-4848-a8ae-22db78b2bec4 req-fafdd21f-feac-40fe-a305-78f7dc468cb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.244070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Deleting port 4e3a8359-5d74-431f-a914-f74c7cc55e15 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:52.244418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.303184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73e7f090-09fb-45bc-848d-4ff5e34214ab req-f93effb9-433b-4310-8336-2216acc6ba1e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050248 Dec 21 03:48:52.402639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] For port 4e3a8359-5d74-431f-a914-f74c7cc55e15, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=4e3a8359-5d74-431f-a914-f74c7cc55e15,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:52.402926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.407144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-801ac662-7e30-4848-a8ae-22db78b2bec4 req-fafdd21f-feac-40fe-a305-78f7dc468cb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.419900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Calling delete_port for 4e3a8359-5d74-431f-a914-f74c7cc55e15 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:52.503637 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-801ac662-7e30-4848-a8ae-22db78b2bec4 req-fafdd21f-feac-40fe-a305-78f7dc468cb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.557451 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.573453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-801ac662-7e30-4848-a8ae-22db78b2bec4 req-fafdd21f-feac-40fe-a305-78f7dc468cb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4238846 Dec 21 03:48:52.575442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fafdd21f-feac-40fe-a305-78f7dc468cb3 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14d1e1d2-7258-40a7-a152-58d70f1c226c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:52.589714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e2246d-85e1-4c88-bd42-602ca57a4918 req-4a5dba76-ef99-4811-b3a7-4e8eb9ccc66c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:52.590735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43e2246d-85e1-4c88-bd42-602ca57a4918 req-4a5dba76-ef99-4811-b3a7-4e8eb9ccc66c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 944 time: 0.1251974 Dec 21 03:48:52.700938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43e2246d-85e1-4c88-bd42-602ca57a4918 req-1dee5874-dbc8-44c4-8b97-9fd6e2bea083 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042194 Dec 21 03:48:52.725942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa477bd1-06fe-40f9-b883-a6fd8a48e087 req-575cc8b0-5198-4b86-95eb-7f9f66866a23 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:52.727731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa477bd1-06fe-40f9-b883-a6fd8a48e087 req-575cc8b0-5198-4b86-95eb-7f9f66866a23 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 944 time: 0.0802660 Dec 21 03:48:52.800410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.803929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ccbc0c8-b58d-4e38-b4c1-8fa1c290b6ef req-f44b0d2d-c5c3-42ec-b6a7-f14acb372808 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 210 time: 0.0403318 Dec 21 03:48:52.813307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa477bd1-06fe-40f9-b883-a6fd8a48e087 req-d7c98bab-e8e8-4d8e-a5ae-6878d6bce8f4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748212 Dec 21 03:48:52.833934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['54f03f61-5bac-4c58-8af3-224512e89641', '4e3a8359-5d74-431f-a914-f74c7cc55e15'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:52.835638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event deleted for resources: {'Port': ['ID=4e3a8359-5d74-431f-a914-f74c7cc55e15,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:52.875708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6520df7f-f451-4f99-acca-7d2857ec0001 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:52.899472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] No DVR routers for this DVR port 4e3a8359-5d74-431f-a914-f74c7cc55e15 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:48:52.902502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:52.906295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28ddb6fc-77d6-4641-bb05-1849127ad957 req-8ef46169-e753-4156-a659-b75a652a92cf tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "DELETE /v2.0/ports/4e3a8359-5d74-431f-a914-f74c7cc55e15 HTTP/1.1" status: 204 len: 173 time: 0.8768475 Dec 21 03:48:52.960141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c47043-b315-4687-8f18-060062dc7a61 req-f78deb27-ee0a-4e8d-9a36-022a4627df12 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:52.961945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23c47043-b315-4687-8f18-060062dc7a61 req-f78deb27-ee0a-4e8d-9a36-022a4627df12 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0639558 Dec 21 03:48:53.017080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23c47043-b315-4687-8f18-060062dc7a61 req-9992244a-4281-43fa-bf52-bcffe85c531c tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485885 Dec 21 03:48:53.130819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 6520df7f-f451-4f99-acca-7d2857ec0001 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:53.140497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 6520df7f-f451-4f99-acca-7d2857ec0001 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:53.141124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.161994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2fccd80-c564-418a-8f66-e91fe02d8e1e req-5d323546-aecb-4c8d-9f05-e03cc9646e7b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0285468 Dec 21 03:48:53.168979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.169948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b'}, {'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-deleted', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:53.173663 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2553d930-e5a7-4e42-b678-a2d18d1ca321" -d '{"events": [{"name": "network-changed", "server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b"}, {"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-deleted", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:53.249754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-8b2f742d-3673-429b-a110-0d5bfda71b71 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0275917 Dec 21 03:48:53.273762 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b1f8e26-42b1-466e-a601-d0599e423a9d x-openstack-request-id: req-5b1f8e26-42b1-466e-a601-d0599e423a9d {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:53.274060 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b", "status": "completed", "code": 200}, {"server_uuid": "7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c", "name": "network-vif-deleted", "tag": "4e3a8359-5d74-431f-a914-f74c7cc55e15", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:53.274316 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5b1f8e26-42b1-466e-a601-d0599e423a9d {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:53.275000 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'status': 'completed', 'code': 200} Dec 21 03:48:53.275261 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c', 'name': 'network-vif-deleted', 'tag': '4e3a8359-5d74-431f-a914-f74c7cc55e15', 'status': 'completed', 'code': 200} Dec 21 03:48:53.275429 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.305660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:53.309122 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ca9a96f-0a0f-4327-bb48-c2769dc1942c" -d '{"events": [{"server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "name": "network-vif-plugged", "status": "completed", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:53.329063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:53.359881 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b277e29-ca87-4894-a6b6-859ecc8e7a61 x-openstack-request-id: req-6b277e29-ca87-4894-a6b6-859ecc8e7a61 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:53.360174 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "name": "network-vif-plugged", "status": "completed", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:53.360435 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6b277e29-ca87-4894-a6b6-859ecc8e7a61 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:53.361111 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001', 'code': 200} Dec 21 03:48:53.402722 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.403586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:48:53.490390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:53.546161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74146d81-f319-470c-9ab2-0f37be5521c4 req-3ee9242b-216a-4f40-8a14-96ab16d9d876 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:53.548687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74146d81-f319-470c-9ab2-0f37be5521c4 req-3ee9242b-216a-4f40-8a14-96ab16d9d876 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1097 time: 0.0551114 Dec 21 03:48:53.579885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port da821d06-09e0-4580-a540-b604a6a13c16 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:48:53.584511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port da821d06-09e0-4580-a540-b604a6a13c16 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:53.584971 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.619417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74146d81-f319-470c-9ab2-0f37be5521c4 req-90e3e9b8-3a32-49e6-a631-577a2d852ed3 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574062 Dec 21 03:48:53.678063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.712084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:53.791190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:53.807575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5700c5a9-5f21-49e8-851a-059d6ee4d431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:53.808920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5700c5a9-5f21-49e8-851a-059d6ee4d431 service neutron] 10.222.0.54 "GET /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 1027 time: 0.0803692 Dec 21 03:48:53.819408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-466b09d6-007d-42af-bf83-46daa5543774 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:53.820885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-466b09d6-007d-42af-bf83-46daa5543774 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5647714 Dec 21 03:48:53.828622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-120a5f43-8bb5-47ea-9a11-058a66c8f3ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:53.830056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-120a5f43-8bb5-47ea-9a11-058a66c8f3ae service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1126 time: 0.4802582 Dec 21 03:48:53.843939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:53.877610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87011dd2-ae7d-440f-b92a-95f93382065f req-e4d4107b-ddc7-4c0e-ba39-980e578ee28a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:53.879212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87011dd2-ae7d-440f-b92a-95f93382065f req-e4d4107b-ddc7-4c0e-ba39-980e578ee28a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1517296 Dec 21 03:48:53.882619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1df4019f-8386-49e8-8fdb-26fd1b70106f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/quotas/9839aab3796944fe8a09f1cfbd7edf8b HTTP/1.1" status: 200 len: 375 time: 0.0438602 Dec 21 03:48:53.885465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-330c22cb-bc6c-4654-9844-00ae00f5b7b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:53.886742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-330c22cb-bc6c-4654-9844-00ae00f5b7b6 service neutron] 10.222.0.54 "GET /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 1027 time: 0.0621502 Dec 21 03:48:54.037564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87011dd2-ae7d-440f-b92a-95f93382065f req-6ff16d7b-62a2-4c35-93d9-0fa666e07900 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1498728 Dec 21 03:48:54.089834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-fcc08028-8bc0-4b89-8cd4-05e0865787e0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1995378 Dec 21 03:48:54.121684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-58c09c52-9595-4833-90c6-1dd347a93b35 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.128541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-58c09c52-9595-4833-90c6-1dd347a93b35 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.134979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-58c09c52-9595-4833-90c6-1dd347a93b35 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.136671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-58c09c52-9595-4833-90c6-1dd347a93b35 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "GET /v2.0/networks?id=04ed2fa2-4e59-410d-9778-4535a349c6b9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=19393033-2861-465d-ab20-b8ec53781acb&id=19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 200 len: 1990 time: 0.2275207 Dec 21 03:48:54.156942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-d8a16b74-d3b3-40c7-b3d9-31f0bd639ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.157805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-d8a16b74-d3b3-40c7-b3d9-31f0bd639ea2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.1504283 Dec 21 03:48:54.241710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-ea648be8-7fd6-4100-a378-8d03bccf4ec8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 217 time: 0.0487728 Dec 21 03:48:54.345696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-cf733ca4-a712-4501-a5d4-fa8305388348 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6d65cc45e25946eeb479e45c44089cf7 HTTP/1.1" status: 200 len: 379 time: 0.1715920 Dec 21 03:48:54.359498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'admin_state_up': True, 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'security_groups': ['23bc1696-ad98-4340-b8bf-f563caa89a24']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:54.363297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-bd511d8e-d360-4346-ba9a-01ee1a88910b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.364790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-bd511d8e-d360-4346-ba9a-01ee1a88910b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1075530 Dec 21 03:48:54.373082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc87d471-b477-43bb-83a8-bb51c6db865a req-782a1aac-fdd6-4ff8-809e-ff60f81c05fe tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.375537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc87d471-b477-43bb-83a8-bb51c6db865a req-782a1aac-fdd6-4ff8-809e-ff60f81c05fe tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1393175 Dec 21 03:48:54.434448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-31db3fd4-2682-4d17-893b-7e6c75acc141 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0567093 Dec 21 03:48:54.561686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc87d471-b477-43bb-83a8-bb51c6db865a req-ce111578-3d70-4ccb-bb86-7889e9ea8c9c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1674292 Dec 21 03:48:54.633694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-ef0a2e0b-25a9-420a-87f8-9d875b1b4e1a service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1733689 Dec 21 03:48:54.711005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b9b0d62-c73b-4bf4-80f4-9d098091ec0e req-60d4e5d0-b852-44ac-9fdc-00a74f8042ac tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=7aae157a-82f1-4ad9-b4e9-2ccc41a36c8c HTTP/1.1" status: 200 len: 210 time: 0.0421150 Dec 21 03:48:54.780280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553d930-e5a7-4e42-b678-a2d18d1ca321 req-3b7aad4b-4282-440a-b7cf-99f13a269fba service neutron] 10.222.0.31 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1339164 Dec 21 03:48:54.788157 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:54.794353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:54.798457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:54.856224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:54.878966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 4e3a8359-5d74-431f-a914-f74c7cc55e15 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:48:54.879395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 4e3a8359-5d74-431f-a914-f74c7cc55e15 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:48:54.880987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86cb8c0f-1907-44d7-802c-347334bd4460 req-49ecf588-d92d-4f59-8500-86c18806fb87 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:54.882289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86cb8c0f-1907-44d7-802c-347334bd4460 req-49ecf588-d92d-4f59-8500-86c18806fb87 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 945 time: 0.0982695 Dec 21 03:48:54.937509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:55.003665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86cb8c0f-1907-44d7-802c-347334bd4460 req-8acd4ad7-6440-4378-8441-661f2989ec2e tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095145 Dec 21 03:48:55.033466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 172.20.0.6 (04ed2fa2-4e59-410d-9778-4535a349c6b9/c714b82d-d957-4fc4-96b0-f175d6a234f5/3a3dc231-a27a-4c00-a859-1a62de02e991) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:55.157818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8ea4df-87f9-4d5c-9a90-d6f33b5ca678 req-7dd83ea4-eb8f-4653-bb61-0aed5d170b72 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:55.161175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c8ea4df-87f9-4d5c-9a90-d6f33b5ca678 req-7dd83ea4-eb8f-4653-bb61-0aed5d170b72 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1232867 Dec 21 03:48:55.184626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a7cb0f7-b278-4dee-8d53-317c1f7dfc78 req-c3ddf409-2189-4d12-9727-2ab5fe520d73 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0775003 Dec 21 03:48:55.285174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c8ea4df-87f9-4d5c-9a90-d6f33b5ca678 req-b30ae951-71d1-47e7-b318-5b3df461343b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1053126 Dec 21 03:48:55.303359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:55.367775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:55.367775 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e33d102f-3c76-466f-80c4-a6d38b35ac3e" -d '{"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "da821d06-09e0-4580-a540-b604a6a13c16"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:55.473681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:55.538296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219410c8-00b3-4775-9f31-b147307cfab4 req-fd8f0d56-616c-4803-b494-241f4e0fb326 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:55.541651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-219410c8-00b3-4775-9f31-b147307cfab4 req-fd8f0d56-616c-4803-b494-241f4e0fb326 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.1443551 Dec 21 03:48:55.548663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:55.556252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:55.562016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:55.607138 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f3e6995-6581-49c1-9ec3-6c3b23203990 x-openstack-request-id: req-5f3e6995-6581-49c1-9ec3-6c3b23203990 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:55.615650 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "da821d06-09e0-4580-a540-b604a6a13c16", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:55.615650 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5f3e6995-6581-49c1-9ec3-6c3b23203990 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:55.615650 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16', 'code': 200} Dec 21 03:48:55.637878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:55.680403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:55.719344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:55.720001 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:55.723910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abefe452-b5e6-4713-9b1d-f307861e0990 req-6aa7d335-287f-469a-b3e3-eca35f19c1da tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 210 time: 0.0604870 Dec 21 03:48:55.781201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-219410c8-00b3-4775-9f31-b147307cfab4 req-ad932314-2bf6-47c5-b5a9-c22486e1d360 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2199314 Dec 21 03:48:55.816316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2abe139-9d8c-4c3a-8b4a-46127a0f2c55 req-d2938f45-c85d-4b60-942d-7eef61305e05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:55.817880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2abe139-9d8c-4c3a-8b4a-46127a0f2c55 req-d2938f45-c85d-4b60-942d-7eef61305e05 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 1097 time: 0.0893214 Dec 21 03:48:55.894969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5152299c-ee99-4aa2-9f96-03f41dd8c283 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5399814 Dec 21 03:48:55.944002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2abe139-9d8c-4c3a-8b4a-46127a0f2c55 req-f1c6c8e4-0936-497d-8fd7-5be57a916a70 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086240 Dec 21 03:48:55.949509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c171e6f4-7135-4a7d-bd3f-b98fb09bdc3e None None] Provisioning complete for port 3a3dc231-a27a-4c00-a859-1a62de02e991 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:55.951859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'admin_state_up': True, 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'security_groups': ['23bc1696-ad98-4340-b8bf-f563caa89a24']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:55.953130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c171e6f4-7135-4a7d-bd3f-b98fb09bdc3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:55.984452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd007e48-54a4-4ac8-a25b-af79519b118f req-78f7cc60-4643-40f4-b3d2-9444a05a1467 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:55.991511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd007e48-54a4-4ac8-a25b-af79519b118f req-78f7cc60-4643-40f4-b3d2-9444a05a1467 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1552629 Dec 21 03:48:56.023605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c171e6f4-7135-4a7d-bd3f-b98fb09bdc3e None None] Port 3a3dc231-a27a-4c00-a859-1a62de02e991 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:48:56.102505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd007e48-54a4-4ac8-a25b-af79519b118f req-c4a3c880-badf-48fd-bba9-6c849c71f2db tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099997 Dec 21 03:48:56.224302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e54b846c-6cd9-4967-abf9-8e8bd63b533a req-23a94da2-bc65-4699-be6a-2c42791fe8af tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:56.225835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e54b846c-6cd9-4967-abf9-8e8bd63b533a req-23a94da2-bc65-4699-be6a-2c42791fe8af tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 945 time: 0.0628943 Dec 21 03:48:56.230762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:56.234226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:56.326312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e54b846c-6cd9-4967-abf9-8e8bd63b533a req-06af8dd7-8d0a-4c30-88f4-bffe03b29b5f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894353 Dec 21 03:48:56.480893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 10.1.1.95 (48839244-4ebd-4f7e-a6df-11292c1938d9/fdb8123e-5581-4093-99c4-63d41dd3436d/d826c2ac-b9f5-444f-bb74-8ff9a966c08d) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:56.505361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973ec95f-786d-44f5-8465-e4d995abcf06 req-35038418-154e-49d2-bbce-7e0ff472a583 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:56.506918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-973ec95f-786d-44f5-8465-e4d995abcf06 req-35038418-154e-49d2-bbce-7e0ff472a583 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 931 time: 0.1130219 Dec 21 03:48:56.557488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0675d7db-ffcc-48b1-9968-4273e1260197 req-6995a1e9-a4ad-45e7-a161-e8a5143b7265 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:56.559062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0675d7db-ffcc-48b1-9968-4273e1260197 req-6995a1e9-a4ad-45e7-a161-e8a5143b7265 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1299865 Dec 21 03:48:56.666698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-973ec95f-786d-44f5-8465-e4d995abcf06 req-c1ac741b-a24d-4cd7-b3ec-2c523cf5c214 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1501741 Dec 21 03:48:56.712108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0675d7db-ffcc-48b1-9968-4273e1260197 req-b537244e-64f4-471c-ab11-0698d724ec79 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1409113 Dec 21 03:48:56.747517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:56.864596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e8d539-08d8-4612-aa01-e87576cdebfc req-1a4643fa-6ee4-48d5-b98d-a6dbcad8b5fe tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:56.866101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46e8d539-08d8-4612-aa01-e87576cdebfc req-1a4643fa-6ee4-48d5-b98d-a6dbcad8b5fe tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1037149 Dec 21 03:48:56.893564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-b5b15b4a-07d5-43e5-8f7d-cd58e5df8f5c tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-1368905810&fields=id&tenant_id=0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 267 time: 0.0885921 Dec 21 03:48:56.894664 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:56.999832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:57.012951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:57.018257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:57.024492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46e8d539-08d8-4612-aa01-e87576cdebfc req-ded104f8-0604-46a2-8b83-10a8a9144644 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1503448 Dec 21 03:48:57.025332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:57.102388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-76166360-8d55-4bcf-ab50-9084f3fe5960 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:57.110663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-76166360-8d55-4bcf-ab50-9084f3fe5960 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 945 time: 0.2080016 Dec 21 03:48:57.124703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'port': {'security_groups': ['81a36cae-1a32-4478-b646-000893538e6f', '1f9e72e0-e144-4773-b0f9-6520a96c3335']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:57.188184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:57.188945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.242425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.323379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63fb75ed-7bdd-4575-9a65-05791f51a78d req-cae82276-11f2-4d03-8f3c-d8d6e7c3439b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 210 time: 0.0638788 Dec 21 03:48:57.347793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-037f7810-c044-49cf-ae43-73dc80487022 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 1.4026513 Dec 21 03:48:57.375782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'admin_state_up': True, 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'security_groups': ['23bc1696-ad98-4340-b8bf-f563caa89a24']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:57.476855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ce79d1e2-c087-4123-ab64-d0e14cf653d0 None None] Provisioning complete for port d826c2ac-b9f5-444f-bb74-8ff9a966c08d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:57.477444 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce79d1e2-c087-4123-ab64-d0e14cf653d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.533362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ce79d1e2-c087-4123-ab64-d0e14cf653d0 None None] Port d826c2ac-b9f5-444f-bb74-8ff9a966c08d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:48:57.614559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e56c725-ae6f-4112-9b1c-fa3c56b87bf6 req-c6685dc5-54fd-4cd1-a023-0ad921cbae4c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:57.619414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e56c725-ae6f-4112-9b1c-fa3c56b87bf6 req-c6685dc5-54fd-4cd1-a023-0ad921cbae4c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.2101295 Dec 21 03:48:57.704593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:57.724014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e56c725-ae6f-4112-9b1c-fa3c56b87bf6 req-0ff447d0-3d48-4dd9-b2c7-a9d9d5c09d3f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005599 Dec 21 03:48:57.755370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.798524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:57.803087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.846297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.879683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:57.928926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccea759-a122-48d2-931c-11c57feeeeb1 req-3c64d8ce-0b65-408d-b557-18dab4f60017 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:57.930457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fccea759-a122-48d2-931c-11c57feeeeb1 req-3c64d8ce-0b65-408d-b557-18dab4f60017 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1427445 Dec 21 03:48:57.946810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:57.947467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:57.948945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7fa9a20-64b7-48b1-a5ab-b034473a9e7f req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "PUT /v2.0/ports/6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 981 time: 0.8373642 Dec 21 03:48:57.957781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:57.964534 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99401307-5bd9-4dca-854e-b773ef76dcbf" -d '{"events": [{"name": "network-changed", "server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:58.067324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57a2aef-2b71-41ee-91c4-583e265db693 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:58.112194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:48:58.129399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fccea759-a122-48d2-931c-11c57feeeeb1 req-c08d3e6e-ecf5-47d6-9754-e31ad720fb38 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1771636 Dec 21 03:48:58.174860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 10.1.1.123 (48839244-4ebd-4f7e-a6df-11292c1938d9/fdb8123e-5581-4093-99c4-63d41dd3436d/aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:58.192898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f3fc02-b619-45b7-adcb-8c87565d3f08 req-f6f9e178-d750-4aea-beef-a4406cb5a49e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.199734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f3fc02-b619-45b7-adcb-8c87565d3f08 req-f6f9e178-d750-4aea-beef-a4406cb5a49e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.201899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04f3fc02-b619-45b7-adcb-8c87565d3f08 req-f6f9e178-d750-4aea-beef-a4406cb5a49e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 1652 time: 0.1416914 Dec 21 03:48:58.360576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-48cdb74c-c22a-48c5-a0cd-28f924826f67 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.361982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-48cdb74c-c22a-48c5-a0cd-28f924826f67 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.1780505 Dec 21 03:48:58.380853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04f3fc02-b619-45b7-adcb-8c87565d3f08 req-ee7ed391-482b-4616-9c9f-21874914ef11 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1651103 Dec 21 03:48:58.382629 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-6ac6de6f-4a73-4f0d-b537-06d72ed08776 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0321341 Dec 21 03:48:58.534190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-037d3470-4080-4de6-9ef6-7ade98931edf tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.535707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-037d3470-4080-4de6-9ef6-7ade98931edf tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1469886 Dec 21 03:48:58.537084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0734e798-268e-48b6-888e-bebd67b1f54f req-ab0050ab-b1ae-4959-9cca-335cfa8df706 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.538609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0734e798-268e-48b6-888e-bebd67b1f54f req-ab0050ab-b1ae-4959-9cca-335cfa8df706 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 950 time: 0.2885318 Dec 21 03:48:58.563116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': '9019203a-40f7-4110-be70-375894886933', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:58.645245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:58.702113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-fa365d54-70ee-47b3-9f6a-8381c58721a3 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-1825503055&fields=id&tenant_id=0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 267 time: 0.2275069 Dec 21 03:48:58.712150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0734e798-268e-48b6-888e-bebd67b1f54f req-42700c2a-44fd-4a56-99c5-133d8c0084e0 tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/security-groups?id=be4d1d79-41a8-475c-bd15-be387ef5161d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1577456 Dec 21 03:48:58.773774 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7a4b77c-67ac-4a92-b6ad-32d791e262e1 x-openstack-request-id: req-e7a4b77c-67ac-4a92-b6ad-32d791e262e1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:48:58.774059 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:48:58.774312 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e7a4b77c-67ac-4a92-b6ad-32d791e262e1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:48:58.774980 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001', 'status': 'completed', 'code': 200} Dec 21 03:48:58.785228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Deleting port 54f03f61-5bac-4c58-8af3-224512e89641 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:48:58.785566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:58.796731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:48:58.802082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:58.828721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-f49226e5-20cd-4253-8997-7bafb77fa6c7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.831126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-f49226e5-20cd-4253-8997-7bafb77fa6c7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 984 time: 0.1169086 Dec 21 03:48:58.878533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:58.889147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'port': {'security_groups': ['1f9e72e0-e144-4773-b0f9-6520a96c3335', '81a36cae-1a32-4478-b646-000893538e6f', '073a7b61-e5f8-496f-b950-4eee24692787']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:58.903217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:58.954982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-d1ed018d-492e-4b30-8a78-805ae656e5eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:58.957027 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-d1ed018d-492e-4b30-8a78-805ae656e5eb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1136 time: 0.1029034 Dec 21 03:48:59.041514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 54f03f61-5bac-4c58-8af3-224512e89641 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:48:59.116448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-36e33ac8-0225-4ca5-887c-ab7c5b5c8509 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:59.119707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-36e33ac8-0225-4ca5-887c-ab7c5b5c8509 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 913 time: 0.1519084 Dec 21 03:48:59.145131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.175376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:48:59.178173 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93546e82-f8b5-4dcb-8dcd-b14ab552a563" -d '{"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:48:59.195253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:59.224693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-05602d37-3a01-40da-9bc7-9bb2ffe59c5e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0807574 Dec 21 03:48:59.228887 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-ff633383-af21-414d-872d-0499697390ca service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 217 time: 0.0836952 Dec 21 03:48:59.285804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.346960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:59.363621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-2bd39a9e-5cf5-4f7b-b69b-1f6aa6e95456 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:59.365337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-2bd39a9e-5cf5-4f7b-b69b-1f6aa6e95456 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1332548 Dec 21 03:48:59.398596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:48:59.419169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-f615c2b1-e586-4620-b733-648e32a7fe97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:59.422055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-f615c2b1-e586-4620-b733-648e32a7fe97 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.0529287 Dec 21 03:48:59.434750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:59.447755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:48:59.452153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:48:59.475169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:48:59.482722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.190 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/d4a89fe6-e810-43b4-bd73-b205091236af) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:48:59.483420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] For port 54f03f61-5bac-4c58-8af3-224512e89641, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=54f03f61-5bac-4c58-8af3-224512e89641,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:48:59.484561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.535522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.539358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Calling delete_port for 54f03f61-5bac-4c58-8af3-224512e89641 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:48:59.570096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-ebbc2070-55ca-4a1d-a13b-ac58ba243444 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0998662 Dec 21 03:48:59.585086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dda4c20-4c64-4914-8c1b-4a93da74e2b8 req-279c83c7-9dcc-4a24-b8ad-97f555053b2d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:59.594966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dda4c20-4c64-4914-8c1b-4a93da74e2b8 req-279c83c7-9dcc-4a24-b8ad-97f555053b2d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.7013450 Dec 21 03:48:59.616517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:48:59.616517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.797345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-78a98ae6-8f53-4f69-8eae-a19f988137a4 None None] Provisioning complete for port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:48:59.797976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78a98ae6-8f53-4f69-8eae-a19f988137a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.818377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dda4c20-4c64-4914-8c1b-4a93da74e2b8 req-712bc33b-5e19-4983-8db2-44efc69911c9 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2225227 Dec 21 03:48:59.819748 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-9a1c5cfd-628c-4531-a265-08a7dd49fbfa service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2378304 Dec 21 03:48:59.853679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-654eb38e-46a0-47a7-90f7-93f60aedc281 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4884629 Dec 21 03:48:59.872405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'fixed_ips': [{'ip_address': '10.2.2.100'}], 'network_id': '19393033-2861-465d-ab20-b8ec53781acb', 'admin_state_up': True, 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'security_groups': ['23bc1696-ad98-4340-b8bf-f563caa89a24']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:48:59.914429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-78a98ae6-8f53-4f69-8eae-a19f988137a4 None None] Port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:48:59.931326 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-99401307-5bd9-4dca-854e-b773ef76dcbf req-3c8d4e6b-d4a5-40a1-8adb-950193bd181e service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1027131 Dec 21 03:48:59.969843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:48:59.997347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:00.001854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.052974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:00.133351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.142904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.174695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a7fd24-2d71-417e-bbc2-7e26d0010f8d req-b3c9701a-9623-449b-beb5-ea14bd530dec tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:00.174695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1a7fd24-2d71-417e-bbc2-7e26d0010f8d req-b3c9701a-9623-449b-beb5-ea14bd530dec tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.0963769 Dec 21 03:49:00.174695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.184053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:00.221533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Pushing event deleted for resources: {'Port': ['ID=54f03f61-5bac-4c58-8af3-224512e89641,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:00.239253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:00.244501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.248258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:00.255144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:00.291190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.145 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/7d0b7a63-470a-45ab-900c-1fd451ed2bd5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:00.296502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:00.303772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=d4a89fe6-e810-43b4-bd73-b205091236af,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:00.330674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] No DVR routers for this DVR port 54f03f61-5bac-4c58-8af3-224512e89641 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.335040 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:00.346920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.348046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.348046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae78c4e2-f4fc-45c3-bb6e-257752008c45 req-af4b1988-c22a-4c7c-9a04-aa823473d3df tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.31 "DELETE /v2.0/ports/54f03f61-5bac-4c58-8af3-224512e89641 HTTP/1.1" status: 204 len: 173 time: 1.9573734 Dec 21 03:49:00.387442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:00.388340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.390069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2f70726-f2ba-4274-8684-d4fd2a3d7599 req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "PUT /v2.0/ports/6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 1020 time: 1.5205803 Dec 21 03:49:00.413940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1a7fd24-2d71-417e-bbc2-7e26d0010f8d req-bb8b1813-ae67-4d79-8ad7-c5b59e9e5250 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2037225 Dec 21 03:49:00.493608 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-ffe9fc0d-1215-46cb-b935-c4a5980148c8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.9352579 Dec 21 03:49:00.516344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b093b0dd-e6d3-4eb2-a95e-ee22b06a5d6a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:00.530203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Request body: {'port': {'device_id': '9019203a-40f7-4110-be70-375894886933', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:00.611792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cfd3a462-fdff-46b3-8c3a-cf558d7c563c req-b0f1a045-2fbc-4257-befb-d0d088451a14 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 210 time: 0.0716136 Dec 21 03:49:00.618301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:00.636444 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.645525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.647665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:00.672874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-0cadaeab-414b-470a-af3c-4422522dc145 service neutron] 10.222.0.31 "GET /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.2442646 Dec 21 03:49:00.705488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:00.761239 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:48:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d85d01a-6cd8-427e-a8c9-ad1d53bd1ade x-openstack-request-id: req-3d85d01a-6cd8-427e-a8c9-ad1d53bd1ade {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:00.761955 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:00.762214 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3d85d01a-6cd8-427e-a8c9-ad1d53bd1ade {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:00.762608 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'code': 200} Dec 21 03:49:00.778182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-deleted', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641'}, {'name': 'network-changed', 'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:00.781195 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a039de1-d40b-40c8-8799-f8087559e56c" -d '{"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-deleted", "tag": "54f03f61-5bac-4c58-8af3-224512e89641"}, {"name": "network-changed", "server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.076135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:01.079941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14bbcf84-a730-46d1-b9b6-819d29acd00e req-f5b4bccb-b08d-4189-85f3-7c1997c4854d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:01.088998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14bbcf84-a730-46d1-b9b6-819d29acd00e req-f5b4bccb-b08d-4189-85f3-7c1997c4854d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 943 time: 0.4293697 Dec 21 03:49:01.169224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c095f6d6-b3d2-494f-a0d6-3aa6f3f993e0 req-ac22ef6f-bcdb-4add-8901-3ac05def86fd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:01.181200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c095f6d6-b3d2-494f-a0d6-3aa6f3f993e0 req-ac22ef6f-bcdb-4add-8901-3ac05def86fd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:01.189744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c095f6d6-b3d2-494f-a0d6-3aa6f3f993e0 req-ac22ef6f-bcdb-4add-8901-3ac05def86fd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:01.199440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c095f6d6-b3d2-494f-a0d6-3aa6f3f993e0 req-ac22ef6f-bcdb-4add-8901-3ac05def86fd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 2373 time: 0.2029884 Dec 21 03:49:01.248868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2a6a5ed3-90f6-4dad-a4fe-3fcf8c84923e None None] Provisioning complete for port d4a89fe6-e810-43b4-bd73-b205091236af triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:01.249803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d4a89fe6-e810-43b4-bd73-b205091236af {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:01.250184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2a6a5ed3-90f6-4dad-a4fe-3fcf8c84923e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.260194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.273256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Transition to ACTIVE for port object d4a89fe6-e810-43b4-bd73-b205091236af will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:01.275227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.311044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2a6a5ed3-90f6-4dad-a4fe-3fcf8c84923e None None] Port d4a89fe6-e810-43b4-bd73-b205091236af cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:01.311775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14bbcf84-a730-46d1-b9b6-819d29acd00e req-ae97b8ad-8864-4add-8d8c-7fdfe7ca82f7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2202933 Dec 21 03:49:01.319353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:01.331498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:01.331498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:01.354214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c095f6d6-b3d2-494f-a0d6-3aa6f3f993e0 req-b60395b5-7de3-4fea-a4d0-10797e8aff7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1539614 Dec 21 03:49:01.402448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:01.420053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:01.420719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.428276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.472526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:01.512864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2e5f382-990d-45a9-81ea-9bcd4b0d6b74 req-086183fa-8b4c-4860-b8b0-4b67ead18adb tempest-MigrationsAdminTest-1382188900 tempest-MigrationsAdminTest-1382188900-project] 10.222.0.18 "GET /v2.0/ports?device_id=e24472b2-5209-445e-b5d7-70386b620fa5 HTTP/1.1" status: 200 len: 210 time: 0.0564535 Dec 21 03:49:01.514748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 10.2.2.100 (19393033-2861-465d-ab20-b8ec53781acb/8e39c1be-57b7-471e-a252-0b9469588d52/3136aa12-8de7-43c2-8cde-55879999fd27) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:01.550294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Pushing event updated for resources: {'Port': ['ID=d4a89fe6-e810-43b4-bd73-b205091236af,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:01.577978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-d1330116-4f26-4752-8fde-aeb89096179c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1446433 Dec 21 03:49:01.619650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Request body: {'port': {'device_id': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:01.663632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33775af1-ac8c-4a70-a4f5-003078da35a3 req-6e2ec6e0-c23c-4be7-bb62-ac969507c474 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:01.680050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33775af1-ac8c-4a70-a4f5-003078da35a3 req-6e2ec6e0-c23c-4be7-bb62-ac969507c474 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1023 time: 0.1466289 Dec 21 03:49:01.768660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.787304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7a071ca5-46cf-4a26-a11f-a04c5c734268 None None] Provisioning complete for port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:01.788134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7a071ca5-46cf-4a26-a11f-a04c5c734268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:01.819869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33775af1-ac8c-4a70-a4f5-003078da35a3 req-917c841a-0b68-4da6-a389-c9a4f5e23d9c tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=1f9e72e0-e144-4773-b0f9-6520a96c3335&id=81a36cae-1a32-4478-b646-000893538e6f&id=073a7b61-e5f8-496f-b950-4eee24692787 HTTP/1.1" status: 200 len: 6201 time: 0.1379640 Dec 21 03:49:01.843113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:01.859636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7a071ca5-46cf-4a26-a11f-a04c5c734268 None None] Port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:01.890629 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f65c2925-8755-4657-bb8d-3bb76b1ffd79 x-openstack-request-id: req-f65c2925-8755-4657-bb8d-3bb76b1ffd79 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:01.890995 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e24472b2-5209-445e-b5d7-70386b620fa5", "name": "network-vif-deleted", "tag": "54f03f61-5bac-4c58-8af3-224512e89641", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:01.891219 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f65c2925-8755-4657-bb8d-3bb76b1ffd79 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:01.894156 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e24472b2-5209-445e-b5d7-70386b620fa5', 'name': 'network-vif-deleted', 'tag': '54f03f61-5bac-4c58-8af3-224512e89641', 'status': 'completed', 'code': 200} Dec 21 03:49:01.894435 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001', 'status': 'completed', 'code': 200} Dec 21 03:49:01.898805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Attempting to bind port d4a89fe6-e810-43b4-bd73-b205091236af on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:01.899205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Attempting to bind port d4a89fe6-e810-43b4-bd73-b205091236af by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:01.899535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Attempting to bind port d4a89fe6-e810-43b4-bd73-b205091236af on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:01.909447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Port d4a89fe6-e810-43b4-bd73-b205091236af on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:01.909921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Attempting to bind port d4a89fe6-e810-43b4-bd73-b205091236af on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:02.023920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:02.029232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:02.029583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:02.029969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:02.031060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Bound port: d4a89fe6-e810-43b4-bd73-b205091236af, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:02.031060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.078624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f39fe48f-e6af-49d1-a42c-899b81bdf60b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:02.115859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:02.150343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] For port d4a89fe6-e810-43b4-bd73-b205091236af, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:02.153829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] For port d4a89fe6-e810-43b4-bd73-b205091236af, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d4a89fe6-e810-43b4-bd73-b205091236af,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:02.165755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a039de1-d40b-40c8-8799-f8087559e56c req-6b4a6060-f095-47df-923e-0aa25472e2e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.167317 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-6b4a6060-f095-47df-923e-0aa25472e2e0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1175 time: 0.1906588 Dec 21 03:49:02.183985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.207679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01add1c3-ca7d-4149-9b8b-3af8e0d56d35 req-c001c09b-44a9-4d3d-86d6-4937f7ebba0b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.209499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01add1c3-ca7d-4149-9b8b-3af8e0d56d35 req-c001c09b-44a9-4d3d-86d6-4937f7ebba0b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.2419641 Dec 21 03:49:02.283007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01add1c3-ca7d-4149-9b8b-3af8e0d56d35 req-860739d6-154f-4da3-a9bf-1732d6b5ef99 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628674 Dec 21 03:49:02.311347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.331671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.354274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-25855af4-2605-4abb-a1a2-cc2c218f7513 req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': ' tempest-securitygroup -1514951654 ', 'description': 'tempest-description-1915571540'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:02.387086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.388293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.390147 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] 10.222.0.54 "PUT /v2.0/ports/d4a89fe6-e810-43b4-bd73-b205091236af HTTP/1.1" status: 200 len: 1097 time: 1.8691411 Dec 21 03:49:02.396337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9019203a-40f7-4110-be70-375894886933', 'tag': 'd4a89fe6-e810-43b4-bd73-b205091236af'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:02.398869 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4" -d '{"events": [{"name": "network-changed", "server_uuid": "9019203a-40f7-4110-be70-375894886933", "tag": "d4a89fe6-e810-43b4-bd73-b205091236af"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:02.411504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.444717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef6d86c9-480a-4ced-bad6-d60ae0954d0c req-2b2b6680-71ab-4921-9b1e-a110b305e0d2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.446399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef6d86c9-480a-4ced-bad6-d60ae0954d0c req-2b2b6680-71ab-4921-9b1e-a110b305e0d2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 936 time: 0.1323173 Dec 21 03:49:02.461750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a039de1-d40b-40c8-8799-f8087559e56c req-bea981f1-076c-4f78-9178-9481dad014e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.463462 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-bea981f1-076c-4f78-9178-9481dad014e2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 913 time: 0.2883892 Dec 21 03:49:02.488509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afab5eb6-caec-4186-b451-3ccd382311d8 service neutron] Pushing event updated for resources: {'Port': ['ID=d4a89fe6-e810-43b4-bd73-b205091236af,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:02.508622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 19393033-2861-465d-ab20-b8ec53781acb is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:02.520590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:02.527619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:02.543062 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-4a27756e-0705-4a88-80e7-8f31e274a766 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 200 len: 217 time: 0.0713606 Dec 21 03:49:02.602976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-25855af4-2605-4abb-a1a2-cc2c218f7513 req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.602976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:02.671691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] Transition to ACTIVE for port object f39fe48f-e6af-49d1-a42c-899b81bdf60b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:02.676320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:02.690021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.714188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a039de1-d40b-40c8-8799-f8087559e56c req-482f7c69-cf96-4b3f-939a-062114ae5946 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.715866 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-482f7c69-cf96-4b3f-939a-062114ae5946 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.1488612 Dec 21 03:49:02.723960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Transition to ACTIVE for port object 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:02.738927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-a4df6362-a63e-4ca2-a96c-9479727da889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.740604 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-a4df6362-a63e-4ca2-a96c-9479727da889 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 1100 time: 0.1404719 Dec 21 03:49:02.813109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-25855af4-2605-4abb-a1a2-cc2c218f7513 req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.830240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef6d86c9-480a-4ced-bad6-d60ae0954d0c req-43f012b1-0771-41f5-a9f2-716011f08c0f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3506243 Dec 21 03:49:02.837397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.869112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:02.872757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.926258 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-25855af4-2605-4abb-a1a2-cc2c218f7513 req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:02.990081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-184acfae-a158-41d4-ad56-3d29669796e1 None None] Provisioning complete for port 3136aa12-8de7-43c2-8cde-55879999fd27 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:02.991692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-184acfae-a158-41d4-ad56-3d29669796e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:03.055346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-184acfae-a158-41d4-ad56-3d29669796e1 None None] Port 3136aa12-8de7-43c2-8cde-55879999fd27 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:03.069991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b13f39b-684a-4e8d-b672-7f0fd36950ef,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:03.092541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a2446c9f-132a-43d9-9e1d-364d22256564 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2243445 Dec 21 03:49:03.093178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] Pushing event updated for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=10']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:03.097786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] No DVR routers for this DVR port f39fe48f-e6af-49d1-a42c-899b81bdf60b on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:03.119749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a434922-0d70-40fd-88b8-360692dc0823 req-159f734c-62f4-421f-9e97-9ca7e40ae897 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.121290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a434922-0d70-40fd-88b8-360692dc0823 req-159f734c-62f4-421f-9e97-9ca7e40ae897 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1661794 Dec 21 03:49:03.126045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'fixed_ips': [{'ip_address': '10.2.2.200'}], 'network_id': '19393033-2861-465d-ab20-b8ec53781acb', 'admin_state_up': True, 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'security_groups': ['23bc1696-ad98-4340-b8bf-f563caa89a24']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:03.169122 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-923105fc-0c0f-486f-b9a6-0cf209ea17f5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4437623 Dec 21 03:49:03.175835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:03.177760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-25855af4-2605-4abb-a1a2-cc2c218f7513 req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:03.191521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25855af4-2605-4abb-a1a2-cc2c218f7513 req-e7efb4b3-c86b-415a-a47a-1ef9d3f496f0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1803 time: 0.8663151 Dec 21 03:49:03.233725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-2eb8ef0a-b7ad-4881-874e-05c1ed544d99 service neutron] 10.222.0.31 "PUT /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 2.5274746 Dec 21 03:49:03.247121 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-e9f23fb5-edc1-49da-8419-f5dad270fe01 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=d4a89fe6-e810-43b4-bd73-b205091236af HTTP/1.1" status: 200 len: 217 time: 0.0803306 Dec 21 03:49:03.361211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a434922-0d70-40fd-88b8-360692dc0823 req-6175cec8-a71f-4796-b9d3-dbeb1fb54ae1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2306805 Dec 21 03:49:03.395093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Pushing event updated for resources: {'Port': ['ID=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:03.435781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-047224f5-2d26-42fa-b5ac-4ce0db5c19b2 req-691565e5-0448-4424-995c-a43bba201726 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.440940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-047224f5-2d26-42fa-b5ac-4ce0db5c19b2 req-691565e5-0448-4424-995c-a43bba201726 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.1625037 Dec 21 03:49:03.453804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-7fe40cb4-a85c-41bd-8b58-b34bb0662b6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.456192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-7fe40cb4-a85c-41bd-8b58-b34bb0662b6b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1694293 Dec 21 03:49:03.535413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-047224f5-2d26-42fa-b5ac-4ce0db5c19b2 req-b8b431cf-8de0-469f-82b6-a8196c04377c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800319 Dec 21 03:49:03.550993 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-1a404996-afb0-4e82-ac19-247e8ea6e2ee service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3699133 Dec 21 03:49:03.634682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ed2e71-1f27-421c-a254-00dae27e4549 req-9fee4012-b7ae-46e6-b0f7-9723a400ef01 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.641178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ed2e71-1f27-421c-a254-00dae27e4549 req-9fee4012-b7ae-46e6-b0f7-9723a400ef01 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.647478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ed2e71-1f27-421c-a254-00dae27e4549 req-9fee4012-b7ae-46e6-b0f7-9723a400ef01 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.654004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ed2e71-1f27-421c-a254-00dae27e4549 req-9fee4012-b7ae-46e6-b0f7-9723a400ef01 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.662124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10ed2e71-1f27-421c-a254-00dae27e4549 req-9fee4012-b7ae-46e6-b0f7-9723a400ef01 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 3094 time: 0.1383293 Dec 21 03:49:03.680437 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0d46ac8-9872-4048-a599-f9ce29e16d16 x-openstack-request-id: req-a0d46ac8-9872-4048-a599-f9ce29e16d16 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:03.681087 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9019203a-40f7-4110-be70-375894886933", "tag": "d4a89fe6-e810-43b4-bd73-b205091236af", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:03.681087 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a0d46ac8-9872-4048-a599-f9ce29e16d16 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:03.681823 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9019203a-40f7-4110-be70-375894886933', 'tag': 'd4a89fe6-e810-43b4-bd73-b205091236af', 'status': 'completed', 'code': 200} Dec 21 03:49:03.688979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-10b7391b-adba-4c33-b65d-0e570d9328b3 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.690028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-10b7391b-adba-4c33-b65d-0e570d9328b3 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.1754453 Dec 21 03:49:03.700464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Attempting to bind port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:03.700890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Attempting to bind port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:03.701315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Attempting to bind port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:03.707747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-518a1aa4-224b-44ef-8e1d-d3a5c7f7469a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.709355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-518a1aa4-224b-44ef-8e1d-d3a5c7f7469a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2120528 Dec 21 03:49:03.713544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:03.713956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Attempting to bind port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:03.733309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:03.734277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:03.734849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:03.735428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Bound port: 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:03.735863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:03.758145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Made reservation on behalf of 6d65cc45e25946eeb479e45c44089cf7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:03.767588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:03.846607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10ed2e71-1f27-421c-a254-00dae27e4549 req-66132007-2995-45a4-bf5d-2e09b1f72d07 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1785455 Dec 21 03:49:03.864685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1a039de1-d40b-40c8-8799-f8087559e56c req-47505319-8c14-41b5-880d-2f165a509e38 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3036199 Dec 21 03:49:03.901299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-efac0b17-e43f-47ee-9652-b97f86ced1d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:03.903464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-efac0b17-e43f-47ee-9652-b97f86ced1d7 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c&tenant_id=7662e8b89a444924a01bee5e34421908 HTTP/1.1" status: 200 len: 1096 time: 0.1993542 Dec 21 03:49:03.923295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] For port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:03.927253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-b0ceae00-ff0d-42ce-bc70-d399ae3f1121 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2075751 Dec 21 03:49:03.928940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] For port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:03.935620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5829ca5b-97a9-4c6d-89f9-d7aa33af5604 req-269debbf-32bb-4ed1-bf86-b2b4d887e5db tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/9b13f39b-684a-4e8d-b672-7f0fd36950ef HTTP/1.1" status: 200 len: 1798 time: 0.1859055 Dec 21 03:49:04.025537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:04.084231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-df7d33cc-e1ce-402e-8661-9be9fc6fc4df service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1496480 Dec 21 03:49:04.089401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.090331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:04.091795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] 10.222.0.54 "PUT /v2.0/ports/7d0b7a63-470a-45ab-900c-1fd451ed2bd5 HTTP/1.1" status: 200 len: 1097 time: 2.4878988 Dec 21 03:49:04.136520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbd5a92-fa49-4fca-aa9a-8533c705512e service neutron] Pushing event updated for resources: {'Port': ['ID=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:04.183999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ba3ed3-f449-4cfb-9dae-bb745c944219 req-ef1022d1-1689-45ba-8e7d-eebc91e3d211 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.185877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5ba3ed3-f449-4cfb-9dae-bb745c944219 req-ef1022d1-1689-45ba-8e7d-eebc91e3d211 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1787639 Dec 21 03:49:04.195306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-dc406fe3-7e71-4a43-bf0a-5d952596624e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.200859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-dc406fe3-7e71-4a43-bf0a-5d952596624e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1096 time: 0.2477930 Dec 21 03:49:04.361725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5ba3ed3-f449-4cfb-9dae-bb745c944219 req-b5b1f72e-9b75-4664-9322-89f62e46408a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353791 Dec 21 03:49:04.466963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49090) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:04.493124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176a70dc-2a28-458c-812c-89602697bfb1 req-0db10128-0021-487d-a76f-56ed8cf975b3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.497685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-8dfed0e4-7bca-40c6-851f-85408952a4a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.499242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-8dfed0e4-7bca-40c6-851f-85408952a4a3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 1100 time: 0.1327078 Dec 21 03:49:04.501056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-176a70dc-2a28-458c-812c-89602697bfb1 req-0db10128-0021-487d-a76f-56ed8cf975b3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 948 time: 0.3541000 Dec 21 03:49:04.501229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-7d73def6-b6be-4be1-945c-a1e263866845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.502576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-7d73def6-b6be-4be1-945c-a1e263866845 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 1100 time: 0.1373072 Dec 21 03:49:04.527326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Allocated IP 10.2.2.200 (19393033-2861-465d-ab20-b8ec53781acb/8e39c1be-57b7-471e-a252-0b9469588d52/8288eff7-b10c-4c94-a0c7-0e3894ee03f5) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:04.567553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13ec990f-fe52-4feb-a4c2-bea3b01d6e81 req-eb2ed076-a197-45ae-83cf-db7e4dd4d1a0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/9b13f39b-684a-4e8d-b672-7f0fd36950ef HTTP/1.1" status: 200 len: 1798 time: 0.1593080 Dec 21 03:49:04.631247 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-9b5e529e-ac9f-4f11-9259-f646886325a9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5 HTTP/1.1" status: 200 len: 217 time: 0.1069872 Dec 21 03:49:04.650563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-176a70dc-2a28-458c-812c-89602697bfb1 req-d4458c1a-a3cd-4c08-bc37-597015c6a24d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440434 Dec 21 03:49:04.654242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-51360169-52ae-46a1-b49e-49a599972e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.656344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-51360169-52ae-46a1-b49e-49a599972e02 service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.4212370 Dec 21 03:49:04.731487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-482c4b3a-94f2-4c5a-87fc-164167550e80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.733078 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-482c4b3a-94f2-4c5a-87fc-164167550e80 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0660338 Dec 21 03:49:04.823572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-ecad78f1-9a57-4cd0-8dfb-2823eb0afa35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.825068 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-ecad78f1-9a57-4cd0-8dfb-2823eb0afa35 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3022037 Dec 21 03:49:04.831709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-01f3c238-d0ce-4d8b-bdd5-386aaa74131f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=408f05064a77442595f2b5d444671b8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3594108 Dec 21 03:49:04.832474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49096) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:04.886445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-51d746ed-d087-41ef-91e9-06a53a9ec3aa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=d4a89fe6-e810-43b4-bd73-b205091236af HTTP/1.1" status: 200 len: 217 time: 0.0507610 Dec 21 03:49:04.896631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-62a46f3b-a34b-4ac0-8a11-1fddc1663940 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:04.898295 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-62a46f3b-a34b-4ac0-8a11-1fddc1663940 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1539164 Dec 21 03:49:05.045011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-0ddf75ff-52d5-4b1d-ab78-05a9a8d202b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.046801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-0ddf75ff-52d5-4b1d-ab78-05a9a8d202b7 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1428647 Dec 21 03:49:05.051596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5b8df44-0528-42f5-999f-dc75885f0306 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.102486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-ff99e2af-bda6-4957-a85c-8a42b1663463 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 200 len: 217 time: 0.4365945 Dec 21 03:49:05.118840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5b8df44-0528-42f5-999f-dc75885f0306 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.131206 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-c11a45a4-00c4-44b7-a2ff-1df9df641b8c service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2054996 Dec 21 03:49:05.187694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-a7505bfa-c232-43ef-9574-c032948289e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.189269 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-a7505bfa-c232-43ef-9574-c032948289e6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1340642 Dec 21 03:49:05.253139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-13ec990f-fe52-4feb-a4c2-bea3b01d6e81 req-6fe3b760-b82b-44f3-ab6d-778e8174bee1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.281050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-52e6c932-c6ed-4b1b-9a40-90cfa62c5403 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.282615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-52e6c932-c6ed-4b1b-9a40-90cfa62c5403 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.1584556 Dec 21 03:49:05.294815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1ba14f-a4be-4fac-8495-23e3d3a77bbc req-284d171e-508e-4ca0-a1e6-68cf44029029 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.296392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c1ba14f-a4be-4fac-8495-23e3d3a77bbc req-284d171e-508e-4ca0-a1e6-68cf44029029 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.5669308 Dec 21 03:49:05.317631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a4d29af-3114-4dfe-9875-c991250fb2dc req-e014e3a3-5928-4619-8304-fec3c7d7d654 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1759100 Dec 21 03:49:05.330205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.342273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-39f0c13f-49f6-4a8e-a220-8f091ae87d90 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1210372 Dec 21 03:49:05.350055 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-13ec990f-fe52-4feb-a4c2-bea3b01d6e81 req-6fe3b760-b82b-44f3-ab6d-778e8174bee1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.356795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-a5b7f5c1-b0cb-4e34-9169-d3292932b3d6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0593874 Dec 21 03:49:05.371096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5b8df44-0528-42f5-999f-dc75885f0306 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.373929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5b8df44-0528-42f5-999f-dc75885f0306 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.375873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d5b8df44-0528-42f5-999f-dc75885f0306 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/be4d1d79-41a8-475c-bd15-be387ef5161d HTTP/1.1" status: 204 len: 168 time: 0.5423279 Dec 21 03:49:05.461909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b8df44-0528-42f5-999f-dc75885f0306 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be4d1d79-41a8-475c-bd15-be387ef5161d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:05.483897 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cfba17e7-03c4-4b48-b8cd-da2a7e5fe6d4 req-9070eec7-b8b7-473c-8375-dbf32c6c96fd service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1335957 Dec 21 03:49:05.519794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c1ba14f-a4be-4fac-8495-23e3d3a77bbc req-6f96468a-bc72-4a1e-9765-2db746b5f2ac tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1979380 Dec 21 03:49:05.551570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-0dcc21e1-36a1-4ed8-9659-eb976acf55c4 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1813705 Dec 21 03:49:05.586527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-13ec990f-fe52-4feb-a4c2-bea3b01d6e81 req-6fe3b760-b82b-44f3-ab6d-778e8174bee1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.589618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-13ec990f-fe52-4feb-a4c2-bea3b01d6e81 req-6fe3b760-b82b-44f3-ab6d-778e8174bee1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.590994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13ec990f-fe52-4feb-a4c2-bea3b01d6e81 req-6fe3b760-b82b-44f3-ab6d-778e8174bee1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/9b13f39b-684a-4e8d-b672-7f0fd36950ef HTTP/1.1" status: 204 len: 173 time: 1.0118561 Dec 21 03:49:05.652580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:05.683056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'tag': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:05.685683 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3350fe44-8155-4606-8918-d2bb227327e1" -d '{"events": [{"name": "network-changed", "server_uuid": "f751db3c-17ec-4665-b871-1aeef7c0df0c", "tag": "7d0b7a63-470a-45ab-900c-1fd451ed2bd5"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:05.737425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe3b760-b82b-44f3-ab6d-778e8174bee1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b13f39b-684a-4e8d-b672-7f0fd36950ef,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:05.788180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-f721340e-0efa-422e-8d98-0a02dc834e83 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2282369 Dec 21 03:49:05.794185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Network 19393033-2861-465d-ab20-b8ec53781acb is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:05.806347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:05.808664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event updated for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:05.815419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:05.869668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-7e627df4-3f68-4c4e-9c4a-03dd98f1638b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.872851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-7e627df4-3f68-4c4e-9c4a-03dd98f1638b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.880113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-7e627df4-3f68-4c4e-9c4a-03dd98f1638b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.886240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-7e627df4-3f68-4c4e-9c4a-03dd98f1638b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.892481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-7e627df4-3f68-4c4e-9c4a-03dd98f1638b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.894441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-7e627df4-3f68-4c4e-9c4a-03dd98f1638b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 3815 time: 0.2383447 Dec 21 03:49:05.902643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16071174-aef1-4a19-87b9-d2a212daa4df req-69604feb-e5c5-4b64-85dc-e70601cb717d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.904246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16071174-aef1-4a19-87b9-d2a212daa4df req-69604feb-e5c5-4b64-85dc-e70601cb717d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.3107507 Dec 21 03:49:05.977012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:05.977677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.028738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-525ab27d-e8cb-4831-8c4f-68a8138a5ed7 req-3953e071-3389-48be-a1b0-47c9c2569073 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1211400 Dec 21 03:49:06.044881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16071174-aef1-4a19-87b9-d2a212daa4df req-8d6260d1-3bad-4a53-953f-e0b6d83efff9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1327620 Dec 21 03:49:06.162230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-336c390b-cf86-4461-b6fe-2f0b9b9d123e None None] Provisioning complete for port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:06.163502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-336c390b-cf86-4461-b6fe-2f0b9b9d123e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.193693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-e56d4c67-47f4-44e8-98fa-669f97d8753e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.0840061 Dec 21 03:49:06.228303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:06.233256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-336c390b-cf86-4461-b6fe-2f0b9b9d123e None None] Port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:06.254871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:06.264744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50536edf-a589-46c3-80f3-d8218846e2df req-7abb71f5-c149-432e-a33a-062bdb30c0bd tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.266307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50536edf-a589-46c3-80f3-d8218846e2df req-7abb71f5-c149-432e-a33a-062bdb30c0bd tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1128399 Dec 21 03:49:06.288760 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4b91e146-c3d2-4518-97d7-7d7b930942c0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=323b6b326651468f8be919d718f63d85&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0577309 Dec 21 03:49:06.296708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49116) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:06.316661 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-25a496da-6051-464d-b44b-326835b8be24 req-0311618e-9f1d-4c0b-88be-ec3220fd53e5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:49:06.317675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25a496da-6051-464d-b44b-326835b8be24 req-0311618e-9f1d-4c0b-88be-ec3220fd53e5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/9b13f39b-684a-4e8d-b672-7f0fd36950ef HTTP/1.1" status: 404 len: 352 time: 0.0710151 Dec 21 03:49:06.432165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.464498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50536edf-a589-46c3-80f3-d8218846e2df req-4db44bf1-1ba3-4a26-b0ea-c79a69d9541e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1722610 Dec 21 03:49:06.515434 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-099ae562-3854-4e1e-b162-fc4c7d5dd094 x-openstack-request-id: req-099ae562-3854-4e1e-b162-fc4c7d5dd094 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:06.516038 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f751db3c-17ec-4665-b871-1aeef7c0df0c", "tag": "7d0b7a63-470a-45ab-900c-1fd451ed2bd5", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:06.516533 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-099ae562-3854-4e1e-b162-fc4c7d5dd094 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:06.517153 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'tag': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'status': 'completed', 'code': 200} Dec 21 03:49:06.529566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f526a81e-d56b-47ad-94f3-76f5d2c7bb50 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.547957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-897e17de-f721-48d8-af3d-4e93f1dfd253 req-164e008b-b9bf-42fa-9b43-e50b2b2e764b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.550654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-897e17de-f721-48d8-af3d-4e93f1dfd253 req-164e008b-b9bf-42fa-9b43-e50b2b2e764b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 948 time: 0.1702569 Dec 21 03:49:06.561421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bd5fc33b-9bc7-4d39-868c-7c332cd83133 req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1664060607', 'description': 'tempest-description-2065968749'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:06.568644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-1c7b3588-fc12-45aa-a79c-6f9b883cbae8 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.570346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-1c7b3588-fc12-45aa-a79c-6f9b883cbae8 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c&tenant_id=7662e8b89a444924a01bee5e34421908&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.1928556 Dec 21 03:49:06.611531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f526a81e-d56b-47ad-94f3-76f5d2c7bb50 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.620431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3350fe44-8155-4606-8918-d2bb227327e1 req-000c74da-d80d-4d04-a2f9-8385627b20e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.622148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-000c74da-d80d-4d04-a2f9-8385627b20e9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 1100 time: 0.0533776 Dec 21 03:49:06.717585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3350fe44-8155-4606-8918-d2bb227327e1 req-467d8afe-e566-4c57-9633-4a30c6eade04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.719362 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-467d8afe-e566-4c57-9633-4a30c6eade04 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.0901721 Dec 21 03:49:06.767639 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-98b75e33-9a39-498a-b844-cb8d1f5bef66 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5 HTTP/1.1" status: 200 len: 217 time: 0.0410593 Dec 21 03:49:06.819634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3350fe44-8155-4606-8918-d2bb227327e1 req-ee5bfe03-b39a-4f1f-9947-a378b65dd7f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.822967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-ee5bfe03-b39a-4f1f-9947-a378b65dd7f0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0467870 Dec 21 03:49:06.824538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-897e17de-f721-48d8-af3d-4e93f1dfd253 req-efd61cc1-2444-4591-8676-51b2e681d60b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2479782 Dec 21 03:49:06.825677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:06.887893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd5fc33b-9bc7-4d39-868c-7c332cd83133 req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.924920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3350fe44-8155-4606-8918-d2bb227327e1 req-cf82db74-7933-40eb-aed3-ef613c6581d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:06.926880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-cf82db74-7933-40eb-aed3-ef613c6581d6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0894611 Dec 21 03:49:06.959427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f526a81e-d56b-47ad-94f3-76f5d2c7bb50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.962108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f526a81e-d56b-47ad-94f3-76f5d2c7bb50 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:06.966104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f526a81e-d56b-47ad-94f3-76f5d2c7bb50 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/55838b97-24c3-4e34-9586-b2323bc79830 HTTP/1.1" status: 204 len: 168 time: 0.6616774 Dec 21 03:49:06.979584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:06.992645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'mac_address': 'fa:16:3e:34:2e:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:07.038460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.045871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f526a81e-d56b-47ad-94f3-76f5d2c7bb50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55838b97-24c3-4e34-9586-b2323bc79830,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:07.054207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:07.086267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:07.127524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c29d96d-0035-471f-858a-0873e1c0a530 req-05af24d1-d72e-4ea1-95f9-45621c52fe8a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.129006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c29d96d-0035-471f-858a-0873e1c0a530 req-05af24d1-d72e-4ea1-95f9-45621c52fe8a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.2159781 Dec 21 03:49:07.156812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-2e27c7e8-3ade-4a49-ad85-5b6e6fc519f7 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2147460 Dec 21 03:49:07.172445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-98cb9cf8-3878-4b41-a063-9b0bfa9a9e1f service neutron] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:07.185443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.191049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d4a89fe6-e810-43b4-bd73-b205091236af details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:07.191197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-98cb9cf8-3878-4b41-a063-9b0bfa9a9e1f service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.191197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48040f3d-32e5-4804-acda-a68551ff0c50 req-98cb9cf8-3878-4b41-a063-9b0bfa9a9e1f service neutron] 10.222.0.54 "DELETE /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.6081505 Dec 21 03:49:07.207787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3a3dc231-a27a-4c00-a859-1a62de02e991 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:07.215297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd5fc33b-9bc7-4d39-868c-7c332cd83133 req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.220865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.251140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Transition to ACTIVE for port object 3a3dc231-a27a-4c00-a859-1a62de02e991 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:07.260092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c29d96d-0035-471f-858a-0873e1c0a530 req-045eece3-a51c-4984-b54f-f91051415603 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1082485 Dec 21 03:49:07.282178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3350fe44-8155-4606-8918-d2bb227327e1 req-6b0ed341-2f9e-4a16-9b17-141427b0b4f3 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1112716 Dec 21 03:49:07.285971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:07.292777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d4a89fe6-e810-43b4-bd73-b205091236af, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d4a89fe6-e810-43b4-bd73-b205091236af,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:07.314405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'd4a89fe6-e810-43b4-bd73-b205091236af', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'd4a89fe6-e810-43b4-bd73-b205091236af', 'mac_address': 'fa:16:3e:8e:ae:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.190'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:07.334412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd5fc33b-9bc7-4d39-868c-7c332cd83133 req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.365166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.380612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d4a89fe6-e810-43b4-bd73-b205091236af {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:07.401500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.401645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d4a89fe6-e810-43b4-bd73-b205091236af, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d4a89fe6-e810-43b4-bd73-b205091236af,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:07.416695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=992c614c-17c7-48de-b4c8-7a6a3c0b7e86,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:07.472144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684c72e3-8941-4c4c-8807-87544981fb78 req-cf2122ee-9425-4033-8e98-718aed0a0211 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.478824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684c72e3-8941-4c4c-8807-87544981fb78 req-cf2122ee-9425-4033-8e98-718aed0a0211 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.488435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684c72e3-8941-4c4c-8807-87544981fb78 req-cf2122ee-9425-4033-8e98-718aed0a0211 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.493558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684c72e3-8941-4c4c-8807-87544981fb78 req-cf2122ee-9425-4033-8e98-718aed0a0211 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.499769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684c72e3-8941-4c4c-8807-87544981fb78 req-cf2122ee-9425-4033-8e98-718aed0a0211 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.507424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-684c72e3-8941-4c4c-8807-87544981fb78 req-cf2122ee-9425-4033-8e98-718aed0a0211 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 3815 time: 0.1628835 Dec 21 03:49:07.512694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.525714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd5fc33b-9bc7-4d39-868c-7c332cd83133 req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.536686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd5fc33b-9bc7-4d39-868c-7c332cd83133 req-3296e901-7ba7-4003-b4f1-dd1815f9a6cc tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 1.0023668 Dec 21 03:49:07.540928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Pushing event updated for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:07.611530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d4a89fe6-e810-43b4-bd73-b205091236af,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:07.697978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-684c72e3-8941-4c4c-8807-87544981fb78 req-3281d89d-d938-4b73-beb4-e102242067e1 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1896636 Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.753342 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:07.755832 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:07.762577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df16afd-2831-49fc-9855-8e97ab8d5a14 req-085d8d1d-2901-4a5c-bdfc-26e77fc00d68 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:07.768263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2df16afd-2831-49fc-9855-8e97ab8d5a14 req-085d8d1d-2901-4a5c-bdfc-26e77fc00d68 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.1720495 Dec 21 03:49:07.772824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Attempting to bind port 3a3dc231-a27a-4c00-a859-1a62de02e991 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:07.772824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Attempting to bind port 3a3dc231-a27a-4c00-a859-1a62de02e991 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:07.775678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Attempting to bind port 3a3dc231-a27a-4c00-a859-1a62de02e991 on network 04ed2fa2-4e59-410d-9778-4535a349c6b9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:07.817784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Port 3a3dc231-a27a-4c00-a859-1a62de02e991 on network 04ed2fa2-4e59-410d-9778-4535a349c6b9 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:07.818095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Attempting to bind port 3a3dc231-a27a-4c00-a859-1a62de02e991 on network 04ed2fa2-4e59-410d-9778-4535a349c6b9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:07.826830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:07.827758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Checking segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:07.828158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Bound using segment: {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:07.828685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Bound port: 3a3dc231-a27a-4c00-a859-1a62de02e991, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:07.829212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:07.919060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2df16afd-2831-49fc-9855-8e97ab8d5a14 req-e73c29e1-e21c-4a50-9233-3c80b96bfa8c tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385961 Dec 21 03:49:07.924967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:07.983063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:07.988195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a94ca02c-8888-4144-98d0-db5cedc08380 req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-256620231', 'description': 'tempest-description-830365115'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:07.988695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d4a89fe6-e810-43b4-bd73-b205091236af'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:08.004848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3a3dc231-a27a-4c00-a859-1a62de02e991,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:08.037154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c1a388-00c6-4258-92d8-13c0f771e7d5 req-0bbdaba4-48aa-414c-b090-795cdc99fcf8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.038965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60c1a388-00c6-4258-92d8-13c0f771e7d5 req-0bbdaba4-48aa-414c-b090-795cdc99fcf8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1187479 Dec 21 03:49:08.100376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60c1a388-00c6-4258-92d8-13c0f771e7d5 req-3fb2945d-3b07-490b-ab52-0df759e0b8a4 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525277 Dec 21 03:49:08.101961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.146489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.146489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.148945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] 10.222.0.54 "PUT /v2.0/ports/3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 200 len: 1092 time: 1.9095514 Dec 21 03:49:08.152652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:08.156752 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df7f545b-801d-4e2d-9510-3bcf477f2138" -d '{"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:08.165889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94ca02c-8888-4144-98d0-db5cedc08380 req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.200823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3a8054-ddc7-4bd7-bd65-6f0f528e2e23 service neutron] Pushing event updated for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:08.290435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:08.363789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f0ac78-b8e5-46ee-b729-1da7a5033438 req-c6507bd5-9c48-41f3-9694-1856474bf082 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.371636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1f0ac78-b8e5-46ee-b729-1da7a5033438 req-c6507bd5-9c48-41f3-9694-1856474bf082 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 949 time: 0.1470649 Dec 21 03:49:08.442045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94ca02c-8888-4144-98d0-db5cedc08380 req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.448626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.463988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1f0ac78-b8e5-46ee-b729-1da7a5033438 req-70864fae-ab93-4e35-99bc-12ec4f5be25a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914903 Dec 21 03:49:08.592785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94ca02c-8888-4144-98d0-db5cedc08380 req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.642757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1a26e962-4681-4879-b24c-6debfb2147b6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:08.746766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3ae2a5-677e-49fd-9702-3ff6dbaec569 req-daf6e679-25a9-47dd-855e-a6971d65b812 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.747800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba3ae2a5-677e-49fd-9702-3ff6dbaec569 req-daf6e679-25a9-47dd-855e-a6971d65b812 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.1561880 Dec 21 03:49:08.753072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94ca02c-8888-4144-98d0-db5cedc08380 req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.754229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a94ca02c-8888-4144-98d0-db5cedc08380 req-2e7e07b4-67f0-4571-8f58-273533e57e0d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1821 time: 0.7773349 Dec 21 03:49:08.819427 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-537473de-0fb0-4fa6-904b-976d2976a6fb x-openstack-request-id: req-537473de-0fb0-4fa6-904b-976d2976a6fb {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:08.819723 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:08.819982 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-537473de-0fb0-4fa6-904b-976d2976a6fb {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:08.826005 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'status': 'completed', 'code': 200} Dec 21 03:49:08.827603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba3ae2a5-677e-49fd-9702-3ff6dbaec569 req-8c299c5c-77a2-4a76-b9c5-cb3b8be1cc39 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0706387 Dec 21 03:49:08.891627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1a539edc-6061-4a94-a9d0-3e97bd54fe56 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:08.915281 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:08.932674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Transition to ACTIVE for port object 1a539edc-6061-4a94-a9d0-3e97bd54fe56 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:08.936396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-291f3172-4b6d-41eb-9723-33531f946c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.937641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-291f3172-4b6d-41eb-9723-33531f946c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.938186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-291f3172-4b6d-41eb-9723-33531f946c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.938713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-291f3172-4b6d-41eb-9723-33531f946c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.939297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-291f3172-4b6d-41eb-9723-33531f946c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:08.941118 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-291f3172-4b6d-41eb-9723-33531f946c31 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 4363 time: 0.0647712 Dec 21 03:49:09.099199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-64ad5d90-17eb-4d78-84fc-3e3e0e38d55e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.099951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-64ad5d90-17eb-4d78-84fc-3e3e0e38d55e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.100796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-64ad5d90-17eb-4d78-84fc-3e3e0e38d55e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.103038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-64ad5d90-17eb-4d78-84fc-3e3e0e38d55e service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=6d65cc45e25946eeb479e45c44089cf7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.1446171 Dec 21 03:49:09.230218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.246774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-bf5a6a76-26e2-403d-9691-f83ef3b3650e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.248642 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df7f545b-801d-4e2d-9510-3bcf477f2138 req-bf5a6a76-26e2-403d-9691-f83ef3b3650e service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1368508 Dec 21 03:49:09.305188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b487a1-b196-439b-a75e-1e2f28d4275b req-3436a5d5-b893-42d1-995a-a3116f131ed3 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.316476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92b487a1-b196-439b-a75e-1e2f28d4275b req-3436a5d5-b893-42d1-995a-a3116f131ed3 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.3666921 Dec 21 03:49:09.336292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-b2317e36-94f3-4af6-af9e-cb0ffef0b950 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.348614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-b2317e36-94f3-4af6-af9e-cb0ffef0b950 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.355391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-b2317e36-94f3-4af6-af9e-cb0ffef0b950 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.362072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-b2317e36-94f3-4af6-af9e-cb0ffef0b950 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.368188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-b2317e36-94f3-4af6-af9e-cb0ffef0b950 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.371935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-b2317e36-94f3-4af6-af9e-cb0ffef0b950 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 3827 time: 0.4378583 Dec 21 03:49:09.372918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Pushing event updated for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:09.491613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92b487a1-b196-439b-a75e-1e2f28d4275b req-8b614d22-9272-4c1e-b7db-2b38621e0ab4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1776645 Dec 21 03:49:09.535559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de09cd9e-fb36-4a8e-b37e-cbc1d71a8bb0 req-3e713331-48cd-4f2e-a65e-84f34514e4a0 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1411960 Dec 21 03:49:09.547629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-666b05e5-25c4-4b54-8e7c-9cef056b60a7 req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1841096150', 'description': 'tempest-description-1138156610'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:09.590411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Attempting to bind port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:09.590823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Attempting to bind port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:09.591286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Attempting to bind port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:09.601414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:09.601831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Attempting to bind port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:09.611537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:09.611952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Checking segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:09.612498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Bound using segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:09.612942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Bound port: 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:09.613300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.690672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-666b05e5-25c4-4b54-8e7c-9cef056b60a7 req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.722326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a713910-0962-41d7-86f9-ca637f016395 req-463fe341-3af9-4fe7-94f7-c4b6e61684e8 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.723929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a713910-0962-41d7-86f9-ca637f016395 req-463fe341-3af9-4fe7-94f7-c4b6e61684e8 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 1096 time: 0.1008887 Dec 21 03:49:09.764478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:09.787536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:09.814222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a713910-0962-41d7-86f9-ca637f016395 req-65471ad0-2122-421f-a06e-cbe146db9b58 tempest-LiveAutoBlockMigrationV225Test-1638482311 tempest-LiveAutoBlockMigrationV225Test-1638482311-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804970 Dec 21 03:49:09.837733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-666b05e5-25c4-4b54-8e7c-9cef056b60a7 req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.882504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.947259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:09.947871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.949261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] 10.222.0.54 "PUT /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 1131 time: 1.6711659 Dec 21 03:49:09.974049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8601ee57-a0fd-44ef-b6f3-43a9fc8a305b service neutron] Pushing event updated for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:09.983081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-666b05e5-25c4-4b54-8e7c-9cef056b60a7 req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:09.999530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a099b57-657c-4352-8ca9-9144fd5d4d81 req-172ff79b-22ce-440f-a125-7713fb39d125 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.001102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a099b57-657c-4352-8ca9-9144fd5d4d81 req-172ff79b-22ce-440f-a125-7713fb39d125 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0903559 Dec 21 03:49:10.036941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3e1b2f8-982c-4b4a-ab18-dc6f4b68eb09,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:10.047627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:10.097468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a099b57-657c-4352-8ca9-9144fd5d4d81 req-545a38e9-bc0b-47d4-98d5-92cae8b0f1ef tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850706 Dec 21 03:49:10.128494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:10.137328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-666b05e5-25c4-4b54-8e7c-9cef056b60a7 req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:10.143483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-666b05e5-25c4-4b54-8e7c-9cef056b60a7 req-71d5e8a3-8dbb-48e4-ab0c-fa83a7d0f6cd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 0.6153910 Dec 21 03:49:10.377339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c074c5-71f2-4311-a851-c262d46aa977 req-810eb2ab-fc11-4330-82ad-66ee718563d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.378954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c074c5-71f2-4311-a851-c262d46aa977 req-810eb2ab-fc11-4330-82ad-66ee718563d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 949 time: 0.1769414 Dec 21 03:49:10.590991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c074c5-71f2-4311-a851-c262d46aa977 req-b90e8c17-7641-4a46-9fba-e41a6582bb46 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1773565 Dec 21 03:49:10.604631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.605114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.605587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.606053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.606581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.607029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.607507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.607975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.609722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.610256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.610662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.611155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.611709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:10.614257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7631144-eebe-40fb-a98a-af9f657f72ba req-ef4ba596-ea18-43fe-be80-7ac304cee774 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 9200 time: 0.3106663 Dec 21 03:49:10.753464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:10.766244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:10.794215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Transition to ACTIVE for port object 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:10.809343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950f8b21-352c-4ebc-abd6-e7249d4ef679 req-fa62ccd7-55b3-49f9-a96a-71db01767f3b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 11000 time: 0.1604154 Dec 21 03:49:10.821881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '1a539edc-6061-4a94-a9d0-3e97bd54fe56'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:10.824134 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927" -d '{"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "1a539edc-6061-4a94-a9d0-3e97bd54fe56"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:10.853903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:10.879068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950f8b21-352c-4ebc-abd6-e7249d4ef679 req-49b0a1db-4206-4d95-b86f-33ee0430bbc4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/81a36cae-1a32-4478-b646-000893538e6f HTTP/1.1" status: 200 len: 2998 time: 0.0631239 Dec 21 03:49:10.905935 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:10.975775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950f8b21-352c-4ebc-abd6-e7249d4ef679 req-b72ad2be-7bcb-4e38-acc7-55dc0a0b8320 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/81a36cae-1a32-4478-b646-000893538e6f HTTP/1.1" status: 200 len: 2998 time: 0.0906641 Dec 21 03:49:10.981531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Pushing event updated for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:10.981643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:49:10.985335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:10.985765 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.097460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.134063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:11.136291 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9330562-f135-4351-b80b-75f9990cd92f" -d '{"events": [{"server_uuid": "f751db3c-17ec-4665-b871-1aeef7c0df0c", "name": "network-vif-plugged", "status": "completed", "tag": "7d0b7a63-470a-45ab-900c-1fd451ed2bd5"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:11.151605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:11.153890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91f95566-196f-4b7a-9dbf-2e45dbea3c54 req-d769412f-7994-4f65-9914-ec40604b44f9 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.156138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91f95566-196f-4b7a-9dbf-2e45dbea3c54 req-d769412f-7994-4f65-9914-ec40604b44f9 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1201003 Dec 21 03:49:11.158971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Attempting to bind port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:11.161330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Attempting to bind port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:11.161330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Attempting to bind port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:11.197718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:11.198108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Attempting to bind port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:11.218700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:11.219067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Checking segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:11.219456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Bound using segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:11.219887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Bound port: 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:11.220375 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.228628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.229443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d4a89fe6-e810-43b4-bd73-b205091236af up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:11.267107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.273530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.280090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.286454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.292603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.298591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.305008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.307086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-dccb34f5-9f15-416c-a948-6aa04af8b183 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5371 time: 0.1753066 Dec 21 03:49:11.321674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:11.337065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91f95566-196f-4b7a-9dbf-2e45dbea3c54 req-f679d57a-9e13-4e30-9d94-9847ba55f11b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1742401 Dec 21 03:49:11.468080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port d4a89fe6-e810-43b4-bd73-b205091236af completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:49:11.472169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port d4a89fe6-e810-43b4-bd73-b205091236af triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:11.472548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.482526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-056a743a-8ca9-4001-b402-9e9380e24f73 req-82dbffb1-ebb3-4f97-8b8f-b3393e570449 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1672072 Dec 21 03:49:11.502785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:11.505690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5de6adf0-56a0-4313-a4b5-7ce4277bbcee req-a68c28ab-5554-4ac3-bcb8-6498a75695f1 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.507165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5de6adf0-56a0-4313-a4b5-7ce4277bbcee req-a68c28ab-5554-4ac3-bcb8-6498a75695f1 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 886 time: 0.1468081 Dec 21 03:49:11.508855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:11.558211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba1860e7-e830-42a7-9a23-66a0bcfe1ac7 x-openstack-request-id: req-ba1860e7-e830-42a7-9a23-66a0bcfe1ac7 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:11.558507 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "1a539edc-6061-4a94-a9d0-3e97bd54fe56", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:11.558766 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ba1860e7-e830-42a7-9a23-66a0bcfe1ac7 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:11.559220 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '1a539edc-6061-4a94-a9d0-3e97bd54fe56', 'status': 'completed', 'code': 200} Dec 21 03:49:11.567357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.606548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d4a89fe6-e810-43b4-bd73-b205091236af, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d4a89fe6-e810-43b4-bd73-b205091236af,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:11.620747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.632287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc399561-ddfe-4a7c-b18f-12dcaddc6519 req-abe1adf8-1c67-47db-b1ab-efc337207582 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/992c614c-17c7-48de-b4c8-7a6a3c0b7e86 HTTP/1.1" status: 200 len: 1818 time: 0.0575945 Dec 21 03:49:11.666140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.667120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.668890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] 10.222.0.54 "PUT /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 1131 time: 1.6272688 Dec 21 03:49:11.737594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.737796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.743660 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-363b569a-bfe3-4070-95e8-b3e378847d9b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6211 time: 0.0845931 Dec 21 03:49:11.774705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c5dea03-7497-4d91-88a3-f01db54eea5e service neutron] Pushing event updated for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:11.809771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bc399561-ddfe-4a7c-b18f-12dcaddc6519 req-9e2ed04e-53f2-4284-996c-69b2fd2bcaf9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.840759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bc399561-ddfe-4a7c-b18f-12dcaddc6519 req-9e2ed04e-53f2-4284-996c-69b2fd2bcaf9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.893846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:11.906690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-6a6b990b-64b6-40cf-8709-ed90236696c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.907515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-6a6b990b-64b6-40cf-8709-ed90236696c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.908097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-6a6b990b-64b6-40cf-8709-ed90236696c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:11.910241 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-6a6b990b-64b6-40cf-8709-ed90236696c1 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=6d65cc45e25946eeb479e45c44089cf7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.1459754 Dec 21 03:49:11.952522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bc399561-ddfe-4a7c-b18f-12dcaddc6519 req-9e2ed04e-53f2-4284-996c-69b2fd2bcaf9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.955271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bc399561-ddfe-4a7c-b18f-12dcaddc6519 req-9e2ed04e-53f2-4284-996c-69b2fd2bcaf9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:11.969804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc399561-ddfe-4a7c-b18f-12dcaddc6519 req-9e2ed04e-53f2-4284-996c-69b2fd2bcaf9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/992c614c-17c7-48de-b4c8-7a6a3c0b7e86 HTTP/1.1" status: 204 len: 173 time: 0.3177686 Dec 21 03:49:12.013944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d4a89fe6-e810-43b4-bd73-b205091236af,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:12.093468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-992d78d8-e473-4f01-9b80-5814441cdf23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:12.094898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2ed04e-53f2-4284-996c-69b2fd2bcaf9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=992c614c-17c7-48de-b4c8-7a6a3c0b7e86,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:12.099441 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7aa7ffb5-ce3f-4fde-8178-bd8abcaee927 req-992d78d8-e473-4f01-9b80-5814441cdf23 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1435635 Dec 21 03:49:12.123261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17dab80b-31d6-4fae-b8c5-033e06e250fd req-7254be95-9af9-43ca-b988-c2502859aad8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:12.124836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17dab80b-31d6-4fae-b8c5-033e06e250fd req-7254be95-9af9-43ca-b988-c2502859aad8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.3334098 Dec 21 03:49:12.136500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:12.183978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303678be-eff9-4839-911f-28fddf2ef212 req-bd7fdf86-d9b5-485a-ab23-2951b7ad9d4f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:12.185457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-303678be-eff9-4839-911f-28fddf2ef212 req-bd7fdf86-d9b5-485a-ab23-2951b7ad9d4f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 944 time: 0.2142265 Dec 21 03:49:12.240703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2f4b74-4a1a-4e8a-8b0a-ce68e9d19899 req-6bfda897-3795-43ad-941d-dcd589e77fbc tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:12.242129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac2f4b74-4a1a-4e8a-8b0a-ce68e9d19899 req-6bfda897-3795-43ad-941d-dcd589e77fbc tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1762366 Dec 21 03:49:12.366047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17dab80b-31d6-4fae-b8c5-033e06e250fd req-d7edeaa0-6511-43a5-a91f-772a9f3807ca tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2330430 Dec 21 03:49:12.422372 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-327395e5-3960-49b1-888b-a21027afbd43 x-openstack-request-id: req-327395e5-3960-49b1-888b-a21027afbd43 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:12.422372 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f751db3c-17ec-4665-b871-1aeef7c0df0c", "name": "network-vif-plugged", "status": "completed", "tag": "7d0b7a63-470a-45ab-900c-1fd451ed2bd5", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:12.422372 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-327395e5-3960-49b1-888b-a21027afbd43 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:12.422372 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'code': 200} Dec 21 03:49:12.480462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac2f4b74-4a1a-4e8a-8b0a-ce68e9d19899 req-32568675-6d37-4e14-908e-f9cb28c3363e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2103274 Dec 21 03:49:12.572222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30163789-7fa4-4d5e-9814-71623c932041 req-a457db2b-a0bd-4fd6-979b-ccc995af4c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:12.574055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-30163789-7fa4-4d5e-9814-71623c932041 req-a457db2b-a0bd-4fd6-979b-ccc995af4c2d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 1102 time: 0.0553763 Dec 21 03:49:12.632323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-30163789-7fa4-4d5e-9814-71623c932041 req-b7ace318-1759-4cdb-9454-8e16975e8db1 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507112 Dec 21 03:49:12.879819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Deleting port f39fe48f-e6af-49d1-a42c-899b81bdf60b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:12.880500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:12.994670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5c142b-e5b1-4d2c-9341-0fdbb902bbc7 req-8e4a9fda-34f7-4db4-93e6-2eb2c3ce1161 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:12.996333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea5c142b-e5b1-4d2c-9341-0fdbb902bbc7 req-8e4a9fda-34f7-4db4-93e6-2eb2c3ce1161 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 950 time: 0.1769476 Dec 21 03:49:13.046047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.046517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.046998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.047456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.047982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.048442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.048893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.049339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.049784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.050229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.050672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.051142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.051591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.053647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-020d0fcf-48b6-4a8f-b55f-d9677aafe47e req-e2b7f6f7-739b-422b-a541-1656228f9a88 tempest-NetworksTest-1965226002 tempest-NetworksTest-1965226002-project-admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 9200 time: 0.6112723 Dec 21 03:49:13.097131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] For port f39fe48f-e6af-49d1-a42c-899b81bdf60b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f39fe48f-e6af-49d1-a42c-899b81bdf60b,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:13.097705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:13.145810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Calling delete_port for f39fe48f-e6af-49d1-a42c-899b81bdf60b owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:13.174704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea5c142b-e5b1-4d2c-9341-0fdbb902bbc7 req-120d62cb-b278-4642-9d8a-346f026f7a2f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1574795 Dec 21 03:49:13.215133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d826c2ac-b9f5-444f-bb74-8ff9a966c08d {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:13.225611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:13.254879 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-d09a5b64-5f0e-4f84-abda-64b823047372 req-c388c01f-7f8c-4de9-9f59-e624bc2cee55 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:49:13.255950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d09a5b64-5f0e-4f84-abda-64b823047372 req-c388c01f-7f8c-4de9-9f59-e624bc2cee55 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/992c614c-17c7-48de-b4c8-7a6a3c0b7e86 HTTP/1.1" status: 404 len: 352 time: 0.0276477 Dec 21 03:49:13.284616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Transition to ACTIVE for port object d826c2ac-b9f5-444f-bb74-8ff9a966c08d will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:13.345273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b156cb-84f9-4607-b7b8-3cf6d379b324 req-b7e855eb-a858-424c-8ef4-babebc4ae22b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.346847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55b156cb-84f9-4607-b7b8-3cf6d379b324 req-b7e855eb-a858-424c-8ef4-babebc4ae22b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.0769713 Dec 21 03:49:13.447574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:13.494457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8884d229-024d-4d14-b58a-62ca15f5aec7 req-661ec29e-4348-4521-a3cb-0330cff49464 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.496061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8884d229-024d-4d14-b58a-62ca15f5aec7 req-661ec29e-4348-4521-a3cb-0330cff49464 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1269529 Dec 21 03:49:13.499885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55b156cb-84f9-4607-b7b8-3cf6d379b324 req-49038b6d-9383-41a9-aa46-de416a138bb6 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1290126 Dec 21 03:49:13.536080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Pushing event updated for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:13.552496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:13.566238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:13.572821 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e71efcc-9a69-494a-bf50-8772bebc9dcd" -d '{"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:13.589970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['b1bddbab-3a32-4687-b97f-eada22b71c0f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:13.649488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event deleted for resources: {'Port': ['ID=f39fe48f-e6af-49d1-a42c-899b81bdf60b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:13.687764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49240) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:13.779610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8884d229-024d-4d14-b58a-62ca15f5aec7 req-a300409f-43d0-4785-b24f-b4b2263acacf tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2450597 Dec 21 03:49:13.821476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] No DVR routers for this DVR port f39fe48f-e6af-49d1-a42c-899b81bdf60b on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:13.829608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:13.833065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-303678be-eff9-4839-911f-28fddf2ef212 req-75dc8ced-1598-4abc-910b-bb9b3032d03e tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "DELETE /v2.0/ports/f39fe48f-e6af-49d1-a42c-899b81bdf60b HTTP/1.1" status: 204 len: 173 time: 1.6269529 Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.851115 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:13.853873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.863419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.870063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.883477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.889586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.898634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.907192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:13.909273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cce55757-53c3-4621-9927-b42ac8059d93 req-887170e4-358f-4fec-9799-1b2cb3aa1bbe tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5383 time: 0.2827892 Dec 21 03:49:13.917221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Attempting to bind port d826c2ac-b9f5-444f-bb74-8ff9a966c08d on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:13.917567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Attempting to bind port d826c2ac-b9f5-444f-bb74-8ff9a966c08d by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:13.917924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Attempting to bind port d826c2ac-b9f5-444f-bb74-8ff9a966c08d on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:13.949838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Port d826c2ac-b9f5-444f-bb74-8ff9a966c08d on network 48839244-4ebd-4f7e-a6df-11292c1938d9 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:13.950167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Attempting to bind port d826c2ac-b9f5-444f-bb74-8ff9a966c08d on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:13.962103 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-586bf508-0fed-4419-9881-e9c0fa50bdd4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:13.997002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:13.997002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Checking segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:13.997002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Bound using segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:13.997329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Bound port: d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:13.997428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.057966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1ae5bcc-136a-44c3-8efe-b890242e6e29 req-7669aaaa-a24c-482b-9bad-ab335da48e7b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/1a26e962-4681-4879-b24c-6debfb2147b6 HTTP/1.1" status: 200 len: 1816 time: 0.2381501 Dec 21 03:49:14.081403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cce55757-53c3-4621-9927-b42ac8059d93 req-d58b37d8-11b2-4260-8ba8-286429ba7b76 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1589458 Dec 21 03:49:14.177525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:14.211880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3117cec7-aa6b-4681-b137-f7e006672037 req-c68a7f3d-b881-4504-8376-eb27892b6b5b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0530591 Dec 21 03:49:14.218950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:14.248297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-586bf508-0fed-4419-9881-e9c0fa50bdd4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.249371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1ae5bcc-136a-44c3-8efe-b890242e6e29 req-499865ec-6069-44b7-bfde-49dc2bdbcbf5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.278134 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1ae5bcc-136a-44c3-8efe-b890242e6e29 req-499865ec-6069-44b7-bfde-49dc2bdbcbf5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.302106 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.359948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-586bf508-0fed-4419-9881-e9c0fa50bdd4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.418716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.418999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.420285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] 10.222.0.54 "PUT /v2.0/ports/d826c2ac-b9f5-444f-bb74-8ff9a966c08d HTTP/1.1" status: 200 len: 1091 time: 2.5312018 Dec 21 03:49:14.423485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9019203a-40f7-4110-be70-375894886933', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd4a89fe6-e810-43b4-bd73-b205091236af'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:14.425822 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-901c45ad-5d89-4faf-9eab-f8f361555b3c" -d '{"events": [{"server_uuid": "9019203a-40f7-4110-be70-375894886933", "name": "network-vif-plugged", "status": "completed", "tag": "d4a89fe6-e810-43b4-bd73-b205091236af"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:14.447458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-586bf508-0fed-4419-9881-e9c0fa50bdd4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=12680a25004145cdbcac7980888ea863&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7507749 Dec 21 03:49:14.448241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-586bf508-0fed-4419-9881-e9c0fa50bdd4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b566f4c9-6643-45ae-afbb-19ce16d5e1f8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:14.448753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49248) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:14.453895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049e5e96-1225-445c-85dd-339b9b775933 service neutron] Pushing event updated for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:14.478405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136bf613-9b1d-40d5-89c6-72e96e85721d req-b78cc15e-4c99-45ad-9993-2d1a12f4cb16 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.480833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-136bf613-9b1d-40d5-89c6-72e96e85721d req-b78cc15e-4c99-45ad-9993-2d1a12f4cb16 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.1858542 Dec 21 03:49:14.504563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1ae5bcc-136a-44c3-8efe-b890242e6e29 req-499865ec-6069-44b7-bfde-49dc2bdbcbf5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.507432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1ae5bcc-136a-44c3-8efe-b890242e6e29 req-499865ec-6069-44b7-bfde-49dc2bdbcbf5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.508586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1ae5bcc-136a-44c3-8efe-b890242e6e29 req-499865ec-6069-44b7-bfde-49dc2bdbcbf5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/1a26e962-4681-4879-b24c-6debfb2147b6 HTTP/1.1" status: 204 len: 173 time: 0.4262857 Dec 21 03:49:14.529117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8735d0b-0113-4cfc-aed4-150b8cbd9648 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.569849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:14.578879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8735d0b-0113-4cfc-aed4-150b8cbd9648 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.582646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-499865ec-6069-44b7-bfde-49dc2bdbcbf5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a26e962-4681-4879-b24c-6debfb2147b6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:14.626013 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e965dc26-387a-40ae-9479-8aaab9c787ce x-openstack-request-id: req-e965dc26-387a-40ae-9479-8aaab9c787ce {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:14.626312 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:14.632017 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e965dc26-387a-40ae-9479-8aaab9c787ce {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:14.632414 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3', 'status': 'completed', 'code': 200} Dec 21 03:49:14.703331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-136bf613-9b1d-40d5-89c6-72e96e85721d req-7171bb16-ca2a-4791-825f-468fe9761599 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2145083 Dec 21 03:49:14.752083 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d77d139d-81ce-48cb-849e-291bcfd4ebf1 x-openstack-request-id: req-d77d139d-81ce-48cb-849e-291bcfd4ebf1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:14.752628 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9019203a-40f7-4110-be70-375894886933", "name": "network-vif-plugged", "status": "completed", "tag": "d4a89fe6-e810-43b4-bd73-b205091236af", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:14.752628 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d77d139d-81ce-48cb-849e-291bcfd4ebf1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:14.753887 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9019203a-40f7-4110-be70-375894886933', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd4a89fe6-e810-43b4-bd73-b205091236af', 'code': 200} Dec 21 03:49:14.762125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8735d0b-0113-4cfc-aed4-150b8cbd9648 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.766481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8735d0b-0113-4cfc-aed4-150b8cbd9648 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.767929 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f8735d0b-0113-4cfc-aed4-150b8cbd9648 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b566f4c9-6643-45ae-afbb-19ce16d5e1f8 HTTP/1.1" status: 204 len: 168 time: 0.3176703 Dec 21 03:49:14.779665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8735d0b-0113-4cfc-aed4-150b8cbd9648 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b566f4c9-6643-45ae-afbb-19ce16d5e1f8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:14.808604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:14.831775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.832260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.832851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.833322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.833781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.835631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.835631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.836799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-784ab3ff-4f6f-4091-a759-eef0c74a05cc service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6279 time: 0.1904838 Dec 21 03:49:14.862627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:14.874527 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-44991198-15a5-48bd-915c-525aa53a8408 req-39103144-ef24-4004-a6db-42a0a9bcb8b3 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:49:14.882215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44991198-15a5-48bd-915c-525aa53a8408 req-39103144-ef24-4004-a6db-42a0a9bcb8b3 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/1a26e962-4681-4879-b24c-6debfb2147b6 HTTP/1.1" status: 404 len: 352 time: 0.0911961 Dec 21 03:49:14.903428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: f39fe48f-e6af-49d1-a42c-899b81bdf60b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:14.906569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f39fe48f-e6af-49d1-a42c-899b81bdf60b not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:14.930450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3dc4ee-2ff3-4229-ba77-f0a828f60288 req-228e4199-33aa-4569-956a-d2b068fd545a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.938050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a3dc4ee-2ff3-4229-ba77-f0a828f60288 req-228e4199-33aa-4569-956a-d2b068fd545a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 950 time: 0.2333214 Dec 21 03:49:14.954444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2a225c-499e-4043-8911-c1b85bfa3cd7 req-d6616f2a-990f-4378-97b9-0d9b8f8b2394 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:14.956514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cd2a225c-499e-4043-8911-c1b85bfa3cd7 req-d6616f2a-990f-4378-97b9-0d9b8f8b2394 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 1102 time: 0.0870359 Dec 21 03:49:15.009586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cd2a225c-499e-4043-8911-c1b85bfa3cd7 req-3d648757-16e5-4f62-8501-bbe117f83a2f service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441318 Dec 21 03:49:15.271716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a3dc4ee-2ff3-4229-ba77-f0a828f60288 req-1a548f60-ef77-44a9-a2b6-3c9a69436241 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3324492 Dec 21 03:49:15.276425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-dba50813-7f4f-437b-85fc-1ef6f4fad773 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:15.276899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-dba50813-7f4f-437b-85fc-1ef6f4fad773 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:15.277363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-dba50813-7f4f-437b-85fc-1ef6f4fad773 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:15.281414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-dba50813-7f4f-437b-85fc-1ef6f4fad773 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=6d65cc45e25946eeb479e45c44089cf7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.3953307 Dec 21 03:49:15.328108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6946b6-7baf-4333-a0c3-52a4d7eb421b req-9c381105-ea1a-4501-8933-ba6215c66166 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:15.329685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc6946b6-7baf-4333-a0c3-52a4d7eb421b req-9c381105-ea1a-4501-8933-ba6215c66166 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.3580320 Dec 21 03:49:15.534528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49270) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:15.549767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45df6cbb-67bb-4fd4-9c62-5eaeaff09a79 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:15.588781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc6946b6-7baf-4333-a0c3-52a4d7eb421b req-3422fca7-61f0-471c-b03a-1618e7ebf106 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2411602 Dec 21 03:49:15.600124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c112ac5e-4953-4692-8eb5-e751bc3a65e4 req-4c2e21cc-a80f-4083-a1e2-f6dde6a7d055 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/f3e1b2f8-982c-4b4a-ab18-dc6f4b68eb09 HTTP/1.1" status: 200 len: 1818 time: 0.2985196 Dec 21 03:49:15.691591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-ea6d582b-e8ce-4999-bdce-84de4c8398b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:15.693358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e71efcc-9a69-494a-bf50-8772bebc9dcd req-ea6d582b-e8ce-4999-bdce-84de4c8398b7 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3892765 Dec 21 03:49:15.713819 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45df6cbb-67bb-4fd4-9c62-5eaeaff09a79 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:15.776920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45df6cbb-67bb-4fd4-9c62-5eaeaff09a79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:15.823251 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-45df6cbb-67bb-4fd4-9c62-5eaeaff09a79 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=08ddcd53d8bd44a7ae2b30818f3992ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2869599 Dec 21 03:49:15.824455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45df6cbb-67bb-4fd4-9c62-5eaeaff09a79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c583d8c-3904-488f-9730-23f3078198df,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:15.828164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49274) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:15.889178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c49880a-1ca9-46e9-bcd8-13fa81ff0f86 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:15.912387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c49880a-1ca9-46e9-bcd8-13fa81ff0f86 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:15.994812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:16.009022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.016336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c112ac5e-4953-4692-8eb5-e751bc3a65e4 req-4037ae28-a6fb-4e59-939e-0e4d207bd962 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.032195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Transition to ACTIVE for port object aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:16.032828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c49880a-1ca9-46e9-bcd8-13fa81ff0f86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.036945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c49880a-1ca9-46e9-bcd8-13fa81ff0f86 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.040896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c49880a-1ca9-46e9-bcd8-13fa81ff0f86 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0c583d8c-3904-488f-9730-23f3078198df HTTP/1.1" status: 204 len: 168 time: 0.2088020 Dec 21 03:49:16.047508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c112ac5e-4953-4692-8eb5-e751bc3a65e4 req-4037ae28-a6fb-4e59-939e-0e4d207bd962 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.048651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c49880a-1ca9-46e9-bcd8-13fa81ff0f86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c583d8c-3904-488f-9730-23f3078198df,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:16.113760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.211440 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c112ac5e-4953-4692-8eb5-e751bc3a65e4 req-4037ae28-a6fb-4e59-939e-0e4d207bd962 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.214043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c112ac5e-4953-4692-8eb5-e751bc3a65e4 req-4037ae28-a6fb-4e59-939e-0e4d207bd962 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.227575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c112ac5e-4953-4692-8eb5-e751bc3a65e4 req-4037ae28-a6fb-4e59-939e-0e4d207bd962 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/f3e1b2f8-982c-4b4a-ab18-dc6f4b68eb09 HTTP/1.1" status: 204 len: 173 time: 0.6188142 Dec 21 03:49:16.283727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4037ae28-a6fb-4e59-939e-0e4d207bd962 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3e1b2f8-982c-4b4a-ab18-dc6f4b68eb09,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:16.288492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Pushing event updated for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:16.367407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-111bd9d5-2259-477e-832a-228471ccb33d req-77b38c7f-a2d7-4a85-8877-efd7c9b57f0d tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0597584 Dec 21 03:49:16.384019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.401199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.414164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.420379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.428248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.434765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.441754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.451806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c687c137-43ee-4c7c-8536-d264885d4708 req-e4e6cf68-c544-42bb-b8e1-89b9347f72fa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5395 time: 0.2940218 Dec 21 03:49:16.526668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Attempting to bind port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:16.527037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Attempting to bind port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:16.527365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Attempting to bind port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:16.550282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e on network 48839244-4ebd-4f7e-a6df-11292c1938d9 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:16.550544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Attempting to bind port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:16.578267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:16.578615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Checking segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:16.579023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Bound using segment: {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:16.579472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Bound port: aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:16.579827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.594419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a691ee57-21ef-4366-91a3-182e2621efab req-167b3132-f5a9-4fcb-9d5a-2ed1b2ad8886 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.595967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a691ee57-21ef-4366-91a3-182e2621efab req-167b3132-f5a9-4fcb-9d5a-2ed1b2ad8886 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 950 time: 0.1392863 Dec 21 03:49:16.624622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c687c137-43ee-4c7c-8536-d264885d4708 req-2c21024c-e33e-4f80-893b-731d25d3522d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1708705 Dec 21 03:49:16.639046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'name': 'network-vif-deleted', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b'}, {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:16.642220 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b" -d '{"events": [{"server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "name": "network-vif-deleted", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b"}, {"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:16.703417 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:49:16.715456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a691ee57-21ef-4366-91a3-182e2621efab req-6297e1fd-c693-4764-906e-ae23fb364664 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991788 Dec 21 03:49:16.728009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:16.731185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:16.841200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0e3db9-7aed-4e68-b8f3-dd9e86d9f369 req-5401fefe-3f9a-4954-9adb-d4ca77c014d2 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.842677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b0e3db9-7aed-4e68-b8f3-dd9e86d9f369 req-5401fefe-3f9a-4954-9adb-d4ca77c014d2 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 945 time: 0.0897188 Dec 21 03:49:16.848385 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.922095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faebfe39-138d-473f-a4ef-0ed6c3ede000 req-411a5317-a866-4aa3-87f2-49bb6ea71fb8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.923633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-faebfe39-138d-473f-a4ef-0ed6c3ede000 req-411a5317-a866-4aa3-87f2-49bb6ea71fb8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.1268554 Dec 21 03:49:16.934898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:16.935833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:16.937804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] 10.222.0.54 "PUT /v2.0/ports/aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e HTTP/1.1" status: 200 len: 1092 time: 2.3990254 Dec 21 03:49:16.956508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b700dd-db50-4fc6-894e-51b75e65e6c1 service neutron] Pushing event updated for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:17.010699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b0e3db9-7aed-4e68-b8f3-dd9e86d9f369 req-a585faea-15d2-4dda-b3da-5fca2966bcbd tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1600072 Dec 21 03:49:17.034642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-faebfe39-138d-473f-a4ef-0ed6c3ede000 req-b205b40f-7157-4b4b-ae0b-b41101a1ab50 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0930576 Dec 21 03:49:17.043898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:17.105742 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-687f7f74-07e2-406f-824d-b9ae7aead019 req-1be675c7-690a-45e1-8684-27621c752398 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:49:17.106959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-687f7f74-07e2-406f-824d-b9ae7aead019 req-1be675c7-690a-45e1-8684-27621c752398 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/f3e1b2f8-982c-4b4a-ab18-dc6f4b68eb09 HTTP/1.1" status: 404 len: 352 time: 0.0594206 Dec 21 03:49:17.187081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:17.196097 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8dac8d1b-d6be-4526-be42-599fcfbbfd12 x-openstack-request-id: req-8dac8d1b-d6be-4526-be42-599fcfbbfd12 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:17.196600 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdc698c8-84c9-4bc7-a84e-23e02cbf100c", "name": "network-vif-deleted", "tag": "f39fe48f-e6af-49d1-a42c-899b81bdf60b", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:17.196859 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8dac8d1b-d6be-4526-be42-599fcfbbfd12 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:17.197755 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdc698c8-84c9-4bc7-a84e-23e02cbf100c', 'name': 'network-vif-deleted', 'tag': 'f39fe48f-e6af-49d1-a42c-899b81bdf60b', 'status': 'completed', 'code': 200} Dec 21 03:49:17.197999 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d', 'status': 'completed', 'code': 200} Dec 21 03:49:17.308887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.309361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.309821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.310276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.310726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.311204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.311689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.313577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-1e37e6cc-899c-4cb2-9f94-2819fb28937e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6347 time: 0.0978079 Dec 21 03:49:17.329361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4340d8d-8f58-46c0-a82a-84d3a38c6ea2 req-528a5446-6500-472c-82dc-ca881fee3c0b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.333153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4340d8d-8f58-46c0-a82a-84d3a38c6ea2 req-528a5446-6500-472c-82dc-ca881fee3c0b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.2266014 Dec 21 03:49:17.592151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4340d8d-8f58-46c0-a82a-84d3a38c6ea2 req-f0ab1140-8090-410c-8629-f5800afd4016 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2460401 Dec 21 03:49:17.669725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bf2368-3292-4043-8578-982ab37910eb req-7094a907-55f3-4643-8dff-cfb4916bfb88 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.675940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bf2368-3292-4043-8578-982ab37910eb req-7094a907-55f3-4643-8dff-cfb4916bfb88 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.677633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bf2368-3292-4043-8578-982ab37910eb req-7094a907-55f3-4643-8dff-cfb4916bfb88 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933&device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 1691 time: 0.2114191 Dec 21 03:49:17.682753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-00cd65ab-1792-4f9a-aacb-bfb12c58ded4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.683528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-00cd65ab-1792-4f9a-aacb-bfb12c58ded4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.684003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-00cd65ab-1792-4f9a-aacb-bfb12c58ded4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.685578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-00cd65ab-1792-4f9a-aacb-bfb12c58ded4 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=6d65cc45e25946eeb479e45c44089cf7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.3538597 Dec 21 03:49:17.781738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3136aa12-8de7-43c2-8cde-55879999fd27 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:17.789387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:17.850093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Transition to ACTIVE for port object 3136aa12-8de7-43c2-8cde-55879999fd27 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:17.911896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bf2368-3292-4043-8578-982ab37910eb req-b9694e49-3e7e-4e6b-a400-61c12161275d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2219820 Dec 21 03:49:17.941464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-102b998b-ce54-43b0-878b-79de77a6ba0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:17.943389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cb831f8-f5fd-4c8b-9ca2-eb764434c25b req-102b998b-ce54-43b0-878b-79de77a6ba0a service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1506007 Dec 21 03:49:17.971563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.079361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Pushing event updated for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:18.116109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-521a4432-abd2-4597-877a-18c99133d591 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.118298 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-521a4432-abd2-4597-877a-18c99133d591 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.31 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.0776765 Dec 21 03:49:18.211205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa08c99e-d750-44dc-b661-43cb1471cdc6 req-2368bbaa-f472-4495-8e41-d3d26367fa22 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 6201 time: 0.2598944 Dec 21 03:49:18.276481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Attempting to bind port 3136aa12-8de7-43c2-8cde-55879999fd27 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:18.276824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Attempting to bind port 3136aa12-8de7-43c2-8cde-55879999fd27 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:18.277147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Attempting to bind port 3136aa12-8de7-43c2-8cde-55879999fd27 on network 19393033-2861-465d-ab20-b8ec53781acb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:18.291962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa08c99e-d750-44dc-b661-43cb1471cdc6 req-f1f5cbd4-7184-4bb2-a77b-085f49f1c971 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/81a36cae-1a32-4478-b646-000893538e6f HTTP/1.1" status: 200 len: 2998 time: 0.0852323 Dec 21 03:49:18.294903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Port 3136aa12-8de7-43c2-8cde-55879999fd27 on network 19393033-2861-465d-ab20-b8ec53781acb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:18.295247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Attempting to bind port 3136aa12-8de7-43c2-8cde-55879999fd27 on network 19393033-2861-465d-ab20-b8ec53781acb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:18.321073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Deleting port 310284e4-97b1-4722-9326-ad03ce2e793c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:18.321073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.321380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:18.321704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Checking segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:18.322102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Bound using segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:18.322559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Bound port: 3136aa12-8de7-43c2-8cde-55879999fd27, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:18.322970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.400777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a84781ba-b6b8-4e95-84eb-9ffb8369d1ac req-e896aa11-e99f-4e58-9405-93d18dcf1ff6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0994205 Dec 21 03:49:18.439210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa08c99e-d750-44dc-b661-43cb1471cdc6 req-d4871aa3-94a0-47cb-97e1-6ee9bcbbdc64 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/81a36cae-1a32-4478-b646-000893538e6f HTTP/1.1" status: 200 len: 2998 time: 0.1392505 Dec 21 03:49:18.445883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] For port 310284e4-97b1-4722-9326-ad03ce2e793c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=310284e4-97b1-4722-9326-ad03ce2e793c,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:18.446257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.483060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:18.483060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3136aa12-8de7-43c2-8cde-55879999fd27,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:18.590348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.729841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.730580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.732082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] 10.222.0.54 "PUT /v2.0/ports/3136aa12-8de7-43c2-8cde-55879999fd27 HTTP/1.1" status: 200 len: 1092 time: 1.6929340 Dec 21 03:49:18.762016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.767355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.767355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.767355 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Floating IP d027d1db-04ad-43b0-9c77-67105c361095 disassociated. External IP: 172.25.5.229, port: 310284e4-97b1-4722-9326-ad03ce2e793c. Dec 21 03:49:18.767355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Calling delete_port for 310284e4-97b1-4722-9326-ad03ce2e793c owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:18.772949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.784302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.790975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.801448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.807626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.814241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.816746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-07080a5d-01f0-4ce6-8833-2af3956b224a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5407 time: 0.2814765 Dec 21 03:49:18.817438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf33b9a-3622-4e13-9d19-80c70cb56804 service neutron] Pushing event updated for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:18.826303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Request body: {'port': {'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:18.890566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d7d6f7-b228-40a1-88e9-26cecd2e3d8c req-0ae85423-5d7e-439b-a05c-c5799bc8a22f tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:18.892416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2d7d6f7-b228-40a1-88e9-26cecd2e3d8c req-0ae85423-5d7e-439b-a05c-c5799bc8a22f tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 945 time: 0.2478683 Dec 21 03:49:18.960513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:18.968744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e0462d1-db83-4ad6-ae26-9267974935a5 req-d672e99d-4de1-4fc8-9639-957d9ce0ee47 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1219347 Dec 21 03:49:19.025315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.070640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2d7d6f7-b228-40a1-88e9-26cecd2e3d8c req-e2c352dc-6ce4-443f-a693-77ef44f56c4c tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups?id=d37501a6-0469-46d6-b49f-78211ef2e8d1&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1486354 Dec 21 03:49:19.088285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event deleted for resources: {'Port': ['ID=310284e4-97b1-4722-9326-ad03ce2e793c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:19.172620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2ee7414e-7007-46c6-b0d5-b679a03201b8 req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-365304586', 'description': 'tempest-description-1438467586'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:19.212207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e'}, {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:19.214331 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcae74cd-bb4a-479e-9128-00950dcbfdcf" -d '{"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e"}, {"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:19.229689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Router aa3076a7-dfbe-4587-b5a8-fe25629afc18 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:49:19.307280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a93b726e-e32f-4339-98d0-e730f94cf7e6 req-66066148-6ca7-422c-86cd-44a2ce24318c tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:19.308798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a93b726e-e32f-4339-98d0-e730f94cf7e6 req-66066148-6ca7-422c-86cd-44a2ce24318c tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 1102 time: 0.1319547 Dec 21 03:49:19.348045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:49:19.349308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2ee7414e-7007-46c6-b0d5-b679a03201b8 req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.361534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] Sync routers for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:49:19.371199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:19.372533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:48:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:19.391536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] No DVR routers for this DVR port 310284e4-97b1-4722-9326-ad03ce2e793c on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:19.394209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.398087 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-40e811e4-94dc-480c-9c2a-cbb8ce8e27aa req-368bfd04-3522-44ca-8d09-e94cd7acb4cf tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.31 "DELETE /v2.0/ports/310284e4-97b1-4722-9326-ad03ce2e793c HTTP/1.1" status: 204 len: 173 time: 1.2685449 Dec 21 03:49:19.398565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'name': 'network-vif-deleted', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:19.401068 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d4eddc1-dbf8-47de-8995-94bd30494e6a" -d '{"events": [{"server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "name": "network-vif-deleted", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:19.414029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a93b726e-e32f-4339-98d0-e730f94cf7e6 req-4ba665b1-e7b0-43c0-be04-8b275dd3aca2 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936787 Dec 21 03:49:19.477410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2ee7414e-7007-46c6-b0d5-b679a03201b8 req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.547374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:19.559963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:19.568037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2ee7414e-7007-46c6-b0d5-b679a03201b8 req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.572589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.619777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Transition to ACTIVE for port object 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:19.633418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e519c85-7f97-4b82-8653-52bf7ee02a15 req-61406bab-0c34-40ff-900c-82f2372bc4b6 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:19.641740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e519c85-7f97-4b82-8653-52bf7ee02a15 req-61406bab-0c34-40ff-900c-82f2372bc4b6 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1248488 Dec 21 03:49:19.661601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bb4f0e15-9be1-4c6e-8512-b8df6c1654c0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:19.692846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2ee7414e-7007-46c6-b0d5-b679a03201b8 req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.694285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ee7414e-7007-46c6-b0d5-b679a03201b8 req-963aaeee-2d93-4e51-a3f2-08a0f1ab92bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1822 time: 0.5882862 Dec 21 03:49:19.707538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e519c85-7f97-4b82-8653-52bf7ee02a15 req-b52f9836-6d81-4538-958b-6ddd7b236e6f tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646999 Dec 21 03:49:19.711927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.799771 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-034c1702-0e6b-4b07-afe1-308d56c3815e x-openstack-request-id: req-034c1702-0e6b-4b07-afe1-308d56c3815e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:19.800082 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:19.800340 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-034c1702-0e6b-4b07-afe1-308d56c3815e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:19.800743 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e', 'status': 'completed', 'code': 200} Dec 21 03:49:19.801099 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27', 'status': 'completed', 'code': 200} Dec 21 03:49:19.805388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Pushing event updated for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:19.832307 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2302ce3c-663f-48d3-85d8-35b9c7f5509a x-openstack-request-id: req-2302ce3c-663f-48d3-85d8-35b9c7f5509a {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:19.832599 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "df0ef1b8-921c-4e9f-9dd4-127a94a0f905", "name": "network-vif-deleted", "tag": "310284e4-97b1-4722-9326-ad03ce2e793c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:19.832855 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2302ce3c-663f-48d3-85d8-35b9c7f5509a {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:19.833300 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df0ef1b8-921c-4e9f-9dd4-127a94a0f905', 'name': 'network-vif-deleted', 'tag': '310284e4-97b1-4722-9326-ad03ce2e793c', 'status': 'completed', 'code': 200} Dec 21 03:49:19.843407 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e6ca40af-d463-4858-8a39-5d18585b6746 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:19.865389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:19.909294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] Checking router: aa3076a7-dfbe-4587-b5a8-fe25629afc18 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:49:19.921653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:19.922285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:48:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:19.955740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2217a947-6c6e-4ed3-abb8-c3abf62feaf3 req-7393aef5-687f-46eb-935d-fbd8654e2fe2 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0616491 Dec 21 03:49:20.014551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Attempting to bind port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:20.014904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Attempting to bind port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:20.015322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Attempting to bind port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 on network 19393033-2861-465d-ab20-b8ec53781acb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:20.024473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 on network 19393033-2861-465d-ab20-b8ec53781acb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:20.024815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Attempting to bind port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 on network 19393033-2861-465d-ab20-b8ec53781acb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:20.042882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 48, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:20.043249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Checking segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:20.043893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Bound using segment: {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:20.044347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Bound port: 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e638ba70-0b52-4055-af99-ba8a9035d3f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '19393033-2861-465d-ab20-b8ec53781acb'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:20.044713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:20.070967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.073682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.074890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.075419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.076080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.076774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.076881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.078809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-9355faac-9ee0-4108-991e-2435d35f118a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6441 time: 0.2217138 Dec 21 03:49:20.079795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:20.170044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:20.173740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:20.214374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2148f61f-1475-4694-ac4b-5e4c962d78a9 req-a6c60f49-cf63-4fa8-a5fb-00a5ae3333aa tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.215993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2148f61f-1475-4694-ac4b-5e4c962d78a9 req-a6c60f49-cf63-4fa8-a5fb-00a5ae3333aa tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 1102 time: 0.1362448 Dec 21 03:49:20.255619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bbd91ddc-832a-4e3b-bb8e-b276553bc098 req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-783010139', 'description': 'tempest-description-1968128217'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:20.281952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:20.313567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:20.328660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.335182 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:20.335182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] 10.222.0.54 "PUT /v2.0/ports/8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 200 len: 1092 time: 1.5089250 Dec 21 03:49:20.345866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca2c845-aee0-4613-ae77-36b86ff1ef6b None None] The sync data for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 is: [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:44:52Z', 'revision_number': 4, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7858b624-ab23-47c3-8ea5-3fd3edbec98d', 'name': '', 'network_id': '1413c5b2-d3e7-46e6-af39-45068f2d8ddd', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'mac_address': 'fa:16:3e:bf:ab:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_interface', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:50Z', 'updated_at': '2021-12-21T03:44:57Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'subnets': [{'id': '48142ae2-dce2-450f-96ff-f72f7dcd96bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:49:20.406745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2148f61f-1475-4694-ac4b-5e4c962d78a9 req-11e4b48f-4708-4db5-8792-7f881eb72090 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1580474 Dec 21 03:49:20.412873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-421c1129-9a5f-443a-9ba1-3a99266865e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.413207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-421c1129-9a5f-443a-9ba1-3a99266865e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.413667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-421c1129-9a5f-443a-9ba1-3a99266865e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.415269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-421c1129-9a5f-443a-9ba1-3a99266865e0 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=6d65cc45e25946eeb479e45c44089cf7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.3028252 Dec 21 03:49:20.461797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-532191ba-fb5a-4389-8848-977b4eb78f23 service neutron] Pushing event updated for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:20.578659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbd91ddc-832a-4e3b-bb8e-b276553bc098 req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:20.583080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-66f540c9-8dbf-4aba-8374-23fbff16adb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.587978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-66f540c9-8dbf-4aba-8374-23fbff16adb0 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1460841 Dec 21 03:49:20.679200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.685478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.691919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.696357 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3307be7e-1588-4468-a08c-ad0eeb9e94fa None None] New status for floating IP d027d1db-04ad-43b0-9c77-67105c361095: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:49:20.699083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.705719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.711850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.718600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:20.720591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-9c1ff972-190e-4725-880f-d99f7cf55b7d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.1453228 Dec 21 03:49:20.788970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbd91ddc-832a-4e3b-bb8e-b276553bc098 req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:20.883459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:21.029199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 310284e4-97b1-4722-9326-ad03ce2e793c no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:21.068767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 310284e4-97b1-4722-9326-ad03ce2e793c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:21.072575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 310284e4-97b1-4722-9326-ad03ce2e793c not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:21.078283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:21.090827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.091432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.091908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.092453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.092952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.093414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.093871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.095847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-903ab2cb-fcc6-4417-9de1-9d68892c71be service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6483 time: 0.3743370 Dec 21 03:49:21.100455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbd91ddc-832a-4e3b-bb8e-b276553bc098 req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:21.110245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'mac_address': 'fa:16:3e:7d:fe:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:21.173364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:21.176762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84ee10e5-a284-4101-89c7-3419cab89a94 req-7aad6dbe-a719-44ad-8f1b-72359d49ec90 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.4395478 Dec 21 03:49:21.188414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:21.211229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:21.214899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:21.276727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbd91ddc-832a-4e3b-bb8e-b276553bc098 req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:21.279458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd91ddc-832a-4e3b-bb8e-b276553bc098 req-71ff6790-e1b4-4e94-8cad-abb38c2bf0d5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1822 time: 1.0298359 Dec 21 03:49:21.322450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7666fea2-c930-49c7-ad4e-c7b070642fd7 req-2856a263-9ebf-4322-a73a-2c41f72d1b6b tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0770822 Dec 21 03:49:21.337724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:21.371394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-24c0bf88-4bba-4b1e-bf3d-47e4dca25ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.371864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-24c0bf88-4bba-4b1e-bf3d-47e4dca25ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.372395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-24c0bf88-4bba-4b1e-bf3d-47e4dca25ccd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.374657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-24c0bf88-4bba-4b1e-bf3d-47e4dca25ccd service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=6d65cc45e25946eeb479e45c44089cf7&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.2570662 Dec 21 03:49:21.439872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:21.528155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-656acdd4-2e77-4558-9b94-04fb95cb722d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.529359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcae74cd-bb4a-479e-9128-00950dcbfdcf req-656acdd4-2e77-4558-9b94-04fb95cb722d service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1462245 Dec 21 03:49:21.542073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:21.743660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.744593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.745287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.746854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.747524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.748282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.748937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.751411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-863d9265-3643-49d6-a1f7-4aee63083710 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6483 time: 0.1369300 Dec 21 03:49:21.788681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-342d1c8b-2935-4307-a5b3-6b7834fed6d1 req-a232b199-4c46-4a94-92a7-268a461120d8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0310307 Dec 21 03:49:21.885466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:21.893582 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4024363d-61ca-4732-b830-32b3d0e35538" -d '{"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:21.903128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-64364815-1771-4580-ba9b-3f3c10975df4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 200 len: 217 time: 0.1131234 Dec 21 03:49:21.916255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca79b542-ddf0-4f8f-901b-1735ccf116da req-c34bb8ec-98f1-4228-aeef-f45116011bc5 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:21.923579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca79b542-ddf0-4f8f-901b-1735ccf116da req-c34bb8ec-98f1-4228-aeef-f45116011bc5 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.2468176 Dec 21 03:49:22.102684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-344b57ce-19e6-4313-b9a0-3acf937492b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:22.104290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-344b57ce-19e6-4313-b9a0-3acf937492b3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c714b82d-d957-4fc4-96b0-f175d6a234f5 HTTP/1.1" status: 200 len: 851 time: 0.1766715 Dec 21 03:49:22.128944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca79b542-ddf0-4f8f-901b-1735ccf116da req-8d1168e4-f3e6-4f9a-8d1e-88f527ff9d07 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2044859 Dec 21 03:49:22.160195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca69581f-0efe-46d3-8670-85cac25dfa5e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.177152 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:22.180427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-f20dedf1-c682-4710-b016-2fea5bb9a554 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:22.185241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-f20dedf1-c682-4710-b016-2fea5bb9a554 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 812 time: 0.2592993 Dec 21 03:49:22.200430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-89c1af08-cd2c-4b1c-be99-03772358def2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:22.201946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-89c1af08-cd2c-4b1c-be99-03772358def2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=04ed2fa2-4e59-410d-9778-4535a349c6b9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0895238 Dec 21 03:49:22.209167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-e9953509-54b3-4051-bdc7-7403df942029 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/quotas/0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 375 time: 0.0230589 Dec 21 03:49:22.221781 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7dd2cdc-9c98-4471-b309-4030c164b83b x-openstack-request-id: req-a7dd2cdc-9c98-4471-b309-4030c164b83b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:22.221781 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:22.221781 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a7dd2cdc-9c98-4471-b309-4030c164b83b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:22.221781 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5', 'status': 'completed', 'code': 200} Dec 21 03:49:22.344368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-60f293cd-520d-4b48-973a-a774f62923c5 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0506275 Dec 21 03:49:22.368779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-60e4f6a6-625c-4ed4-b0fd-f760fb732906 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1586595 Dec 21 03:49:22.435806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-c930c79b-fb3c-4dc8-8fdf-09c232c38394 service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2238767 Dec 21 03:49:22.501825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:22.637378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-26bc82bf-6b77-403a-a489-05273907a7a9 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:22.644797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-26bc82bf-6b77-403a-a489-05273907a7a9 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2996585 Dec 21 03:49:22.675481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-730c0cd0-633e-4df1-b3ce-477c36c915dd service neutron] 10.222.0.18 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3058026 Dec 21 03:49:22.683259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-6f22470c-ef04-4daa-8d6b-ecb106cf2eae tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/quotas/9839aab3796944fe8a09f1cfbd7edf8b HTTP/1.1" status: 200 len: 375 time: 0.0374653 Dec 21 03:49:22.695901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-f694a683-8dea-4bec-8d4a-7a1b110c194b service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1923761 Dec 21 03:49:22.821929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-3cd2362a-3bf7-4f76-86a5-9e81735706e4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.34&port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 217 time: 0.1013639 Dec 21 03:49:22.872194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-a08f7f40-91a0-417c-a6a6-d9a7a5e5c217 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1785123 Dec 21 03:49:22.878130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:22.948717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-7e54cac0-feba-4687-a395-b5c2790f2650 service neutron] 10.222.0.18 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2639687 Dec 21 03:49:22.952535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6654bbb6-04ab-4398-8a79-0e192ff86d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:22.956155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6654bbb6-04ab-4398-8a79-0e192ff86d75 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.1231966 Dec 21 03:49:22.965586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:22.966050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:23.057050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-ec4bcbf0-6e3b-4beb-b0c6-25dea13dab4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:23.060560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-ec4bcbf0-6e3b-4beb-b0c6-25dea13dab4c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0907698 Dec 21 03:49:23.124326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:23.161900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:23.179968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:23.187014 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-828c6ba6-085d-4bfc-becd-b88dbdd72ef1" -d '{"events": [{"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-plugged", "status": "completed", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:23.207735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:23.240854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-c0736e3c-163a-4203-aa82-e67d86358b13 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672897 Dec 21 03:49:23.296450 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:23.379970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-065c09a0-9a62-4a6d-a37b-dbaf790e610c service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1341393 Dec 21 03:49:23.427240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:23.467178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-6dc08b26-2a3b-449a-9ede-435cc012b5c5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.198&port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 217 time: 0.0757358 Dec 21 03:49:23.544338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-1ffcca4f-2093-4fa1-92e2-832749485297 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:23.546156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-1ffcca4f-2093-4fa1-92e2-832749485297 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0706968 Dec 21 03:49:23.634281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-62d6200e-a1ed-4766-966a-5c42472b342b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:23.635883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-62d6200e-a1ed-4766-966a-5c42472b342b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0828028 Dec 21 03:49:23.977523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:23.985597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:23.992212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.001695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.009798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.016196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.022796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.032434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11d45acb-1952-416a-84f2-92ea020427cd req-eba7be12-7f3f-4376-b7cf-12ab6c65b6bf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.2159579 Dec 21 03:49:24.103987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-cc1d2014-4179-470b-9afe-e8d7e3a4fefa service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4586258 Dec 21 03:49:24.257054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-eb27e61f-7b2b-40a7-a8bb-56e4c553a228 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929604 Dec 21 03:49:24.294529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53647dca-87f3-4974-b0ad-08b12d543502 req-a282dfac-6212-481f-a828-560ce2bd5ac0 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.2544100 Dec 21 03:49:24.373328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-189006d9-e0f9-4520-9657-313f6c13d697 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.95&port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d HTTP/1.1" status: 200 len: 217 time: 0.0918038 Dec 21 03:49:24.409340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11d45acb-1952-416a-84f2-92ea020427cd req-fd7942ee-a440-47a6-9d84-6d9263311dfb tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3758717 Dec 21 03:49:24.478373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-44486829-ff72-4442-baf8-762edfbf6847 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.480072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-44486829-ff72-4442-baf8-762edfbf6847 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0697234 Dec 21 03:49:24.571273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-998deca1-297d-42cd-9527-7519af6060d7 req-4d1f2468-ead2-4936-b934-c9e69e9d43c3 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=fdc698c8-84c9-4bc7-a84e-23e02cbf100c HTTP/1.1" status: 200 len: 210 time: 0.0751803 Dec 21 03:49:24.660338 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d129dd1-ddd2-4c1e-8b48-c7ba594c727b x-openstack-request-id: req-5d129dd1-ddd2-4c1e-8b48-c7ba594c727b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:24.660815 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-plugged", "status": "completed", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:24.660959 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5d129dd1-ddd2-4c1e-8b48-c7ba594c727b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:24.661341 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'code': 200} Dec 21 03:49:24.727758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:24.740380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a25f7718-6498-413a-b9a2-26e10d146599 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.742411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a25f7718-6498-413a-b9a2-26e10d146599 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2367873 Dec 21 03:49:24.770798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462d73e6-4670-4862-96ec-a6f0617bbbb7 req-826e4dc3-ea53-444d-b877-46609b61a6df tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:24.772429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-462d73e6-4670-4862-96ec-a6f0617bbbb7 req-826e4dc3-ea53-444d-b877-46609b61a6df tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.2274683 Dec 21 03:49:24.838709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434194d-9b59-4153-93f6-3aaed993ac7e req-a985a182-46d1-4a97-971d-ce09a353bc37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 210 time: 0.0790300 Dec 21 03:49:24.874639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-462d73e6-4670-4862-96ec-a6f0617bbbb7 req-a7ab68c6-4450-4986-9470-9480238c0ad1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869172 Dec 21 03:49:24.965652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-f7f4ef64-b0fd-4ea5-ad6b-6c8f7cf55a87 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2043273 Dec 21 03:49:25.045044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:25.201109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a51d216b-db9b-4fc8-afb1-35c9bbf96eef req-e69339ed-7a74-4578-80d0-a23045e2e73a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 210 time: 0.0428057 Dec 21 03:49:25.219554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-38f50b97-4416-49be-a797-69260dd8a1cc service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2406752 Dec 21 03:49:25.288691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-5d0823c5-7fe1-4cde-a020-5e3c2c68f328 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.123&port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e HTTP/1.1" status: 200 len: 217 time: 0.0582747 Dec 21 03:49:25.361778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-2db7da27-cd2e-4b0c-bbc5-2ab2f6bc9e0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.363347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-2db7da27-cd2e-4b0c-bbc5-2ab2f6bc9e0a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0655181 Dec 21 03:49:25.488984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46aa47c4-c6ad-493b-b3cf-5edfda60073b req-c6859eef-6474-4e66-be29-526a216a87a8 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0665264 Dec 21 03:49:25.511504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-543cf3f1-cba1-427f-a521-321bf02e3ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.517317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-543cf3f1-cba1-427f-a521-321bf02e3ea2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1429393 Dec 21 03:49:25.676229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:25.724906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a49fa217-f230-4e5f-a41b-801776d8546d service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1988525 Dec 21 03:49:25.744877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.763868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.776640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.784136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.793756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.800144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.807485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:25.817933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-ad1e1e2f-4c40-4521-87ee-4298d9debb27 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.1810579 Dec 21 03:49:26.188400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d54ed12-7ae5-4bad-8ddb-91035b20672f req-d47ebd11-a9f4-4a99-ae47-56fd7eeee282 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 210 time: 0.0849574 Dec 21 03:49:26.230258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5705e8d1-8a98-4ec7-b76a-5a83098166f1 req-f6ef8cc4-20f9-41fa-823d-a3d690550ca2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.4062021 Dec 21 03:49:26.292866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-eea38dd2-f1a4-40f6-aa64-05b89b95e7c1 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4710536 Dec 21 03:49:26.361182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-f840acaf-62ab-41eb-af36-9b78457e4626 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=3136aa12-8de7-43c2-8cde-55879999fd27 HTTP/1.1" status: 200 len: 217 time: 0.0543928 Dec 21 03:49:26.459088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9d5dbc1-eedd-4ef3-bce5-086e6206b74d req-cd577500-9a08-4e32-b45f-921f016d0bde tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 210 time: 0.0882056 Dec 21 03:49:26.681255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-69326b00-a428-4578-8894-3b1279a57bfb tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:26.687619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-69326b00-a428-4578-8894-3b1279a57bfb tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 812 time: 0.2917356 Dec 21 03:49:26.710295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'port': {'device_id': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a', 'admin_state_up': True, 'tenant_id': '0c51448e6fcd494e8c92714cc6e79d52'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:26.809826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49564) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:27.052947 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-addaa9b5-7e41-4136-91e9-39afbfc9273c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.053667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d5ea2db-05d8-4004-b104-34bdb234e516 req-096ddde6-e262-4d0c-adaf-6432fdf3d099 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.062636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d5ea2db-05d8-4004-b104-34bdb234e516 req-096ddde6-e262-4d0c-adaf-6432fdf3d099 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.6987815 Dec 21 03:49:27.071625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-b8baf5e5-09eb-4a7a-83e7-ba14b4e16a41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.073467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-b8baf5e5-09eb-4a7a-83e7-ba14b4e16a41 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.7014322 Dec 21 03:49:27.083324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8df9871b-59ea-40dd-8d09-a98fcbf86828 req-6cafeab4-ec93-478c-8e23-65ccb5fc1b22 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0873203 Dec 21 03:49:27.159815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-addaa9b5-7e41-4136-91e9-39afbfc9273c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.162277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Made reservation on behalf of 0c51448e6fcd494e8c92714cc6e79d52 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:27.166213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.229527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-7cf2dd61-da17-4daf-bdc9-661485c2380d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.231042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-7cf2dd61-da17-4daf-bdc9-661485c2380d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1255405 Dec 21 03:49:27.238561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d5ea2db-05d8-4004-b104-34bdb234e516 req-e8c5fcbf-ca3f-4de7-8e38-ed593649c765 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1749194 Dec 21 03:49:27.265057 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-addaa9b5-7e41-4136-91e9-39afbfc9273c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.372962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-addaa9b5-7e41-4136-91e9-39afbfc9273c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e40eec8-6c07-455d-8d62-c92000e2206f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:27.397739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-addaa9b5-7e41-4136-91e9-39afbfc9273c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=dc0029f607b04865bb4f7ec428994c7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5865881 Dec 21 03:49:27.401837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:27.438130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e92ce0c-e5aa-42f2-a2ee-1a11270bc4be req-d1ea8a51-6a74-48c7-a0be-ee631958a0aa tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 210 time: 0.0961952 Dec 21 03:49:27.499407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a9b738f-4023-4d7c-9da7-6fb5a0a3a421 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.517681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Allocated IP 172.20.0.14 (ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a/787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca/b078a85f-2d87-4a50-931c-09b26621fea9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:27.584963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.592953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.606727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.632283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.639171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.645522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.652348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:27.661458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ce18070-0af6-4cf7-827f-343371100cfd req-715781fa-373f-402d-b7b7-0637aea73b6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.2662287 Dec 21 03:49:27.726541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a9b738f-4023-4d7c-9da7-6fb5a0a3a421 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.758226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.810872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ce18070-0af6-4cf7-827f-343371100cfd req-6adad07d-d7e0-42b6-8c0a-fcc2d5537094 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1425133 Dec 21 03:49:27.813469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-46e3e1ec-6028-47d8-9756-729ecbfe8ec4 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5739553 Dec 21 03:49:27.819895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22581a36-16bc-455d-8dbf-6d069db2b48e req-3472d8fb-bfd9-473c-93c4-e4cb54d4b17d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 210 time: 0.1366761 Dec 21 03:49:27.916473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.923221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a9b738f-4023-4d7c-9da7-6fb5a0a3a421 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.926598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a9b738f-4023-4d7c-9da7-6fb5a0a3a421 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:27.931492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9a9b738f-4023-4d7c-9da7-6fb5a0a3a421 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8e40eec8-6c07-455d-8d62-c92000e2206f HTTP/1.1" status: 204 len: 168 time: 0.5284016 Dec 21 03:49:27.955409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:28.006643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9b738f-4023-4d7c-9da7-6fb5a0a3a421 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e40eec8-6c07-455d-8d62-c92000e2206f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:28.044906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:28.055087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:28.060715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:28.063142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-9f88ebec-c695-42d6-8bce-2cb0c52252fa tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1714814 Dec 21 03:49:28.067684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:28.135296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:28.135967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:28.481906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-cbb4006c-b524-445e-bb2c-21dff7ea9bfd service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5078611 Dec 21 03:49:28.481906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9fb1d99-575b-476b-8001-b4468b3e2d96 req-56586a60-05b6-408d-80e8-c5b1208c274e tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.1461310 Dec 21 03:49:28.481906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-0bb49292-74de-41fc-85c5-71a3bb428474 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 200 len: 217 time: 0.1056087 Dec 21 03:49:28.538667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-87565629-2a55-43d3-bf47-5d8a3cc87204 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:28.540579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-87565629-2a55-43d3-bf47-5d8a3cc87204 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4615145 Dec 21 03:49:28.568030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26dda590-e39c-456e-8b7d-c8a46f54e6e4 req-c624569d-3359-4ffd-9105-e2350ab07cf4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:28.569738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26dda590-e39c-456e-8b7d-c8a46f54e6e4 req-c624569d-3359-4ffd-9105-e2350ab07cf4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1649144 Dec 21 03:49:28.574320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-00e7fb41-89ed-4fc0-80b1-fffe53e31761 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:28.575816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-00e7fb41-89ed-4fc0-80b1-fffe53e31761 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.0957334 Dec 21 03:49:28.579505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:28.651332 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-fea5e93e-1149-447b-a462-ea9b395f681f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9447095 Dec 21 03:49:28.674906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Request body: {'port': {'device_id': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:28.747446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:28.800975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26dda590-e39c-456e-8b7d-c8a46f54e6e4 req-6053f478-2a58-4709-b090-fd59b25a4827 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2061405 Dec 21 03:49:28.833066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d9a286a-cd66-4fd8-86b7-479e03a68804 req-8045e87e-25a1-4d5b-b9d5-e8f65436cdb4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:28.835439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d9a286a-cd66-4fd8-86b7-479e03a68804 req-8045e87e-25a1-4d5b-b9d5-e8f65436cdb4 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 932 time: 0.2620931 Dec 21 03:49:28.885833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-38e856ae-5bda-4dc3-abd7-cd2ac0319a1e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0669065 Dec 21 03:49:28.954479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a6e949e4-9e10-441d-ac88-7f1f5f4c9f3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:28.957655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-a6e949e4-9e10-441d-ac88-7f1f5f4c9f3e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.3545308 Dec 21 03:49:29.308348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-369954d5-02e2-4018-aa02-82cc32d62e51 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.316631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-369954d5-02e2-4018-aa02-82cc32d62e51 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3620293 Dec 21 03:49:29.316631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-4be49dde-fdcd-47de-87ed-1f99edcea52a service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3148057 Dec 21 03:49:29.323844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:29.330529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:29.364024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:29.466595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49622) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:29.491130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50f6a502-0570-49c6-b3eb-307871d98c71 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:29.536324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.543391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.550180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.556260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.564242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.569266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.575341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:29.583776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-79725c11-d276-4d81-ad60-de76629ed5a5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.6345415 Dec 21 03:49:29.630706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d9a286a-cd66-4fd8-86b7-479e03a68804 req-514d75ba-58fe-4c92-8b04-26bd985fde28 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6996531 Dec 21 03:49:29.768279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50f6a502-0570-49c6-b3eb-307871d98c71 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:29.783700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b078a85f-2d87-4a50-931c-09b26621fea9 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:29.804721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:29.824302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Transition to ACTIVE for port object b078a85f-2d87-4a50-931c-09b26621fea9 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:29.830468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50f6a502-0570-49c6-b3eb-307871d98c71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:29.858677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e251dc6d-b855-4aac-8a76-81ea13e7736d req-7e51b5e2-c2ae-4417-989f-fce6e377d420 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2733233 Dec 21 03:49:29.905877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0448274-6328-4f7a-a2ef-19675ceea1e6 req-b3527f0e-641a-4721-a89f-604150d23b07 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4944985 Dec 21 03:49:29.909753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:29.945798 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-50f6a502-0570-49c6-b3eb-307871d98c71 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0e05628664b24223a476e2f853d8816f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4776952 Dec 21 03:49:29.948952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49632) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:29.958514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8956fdab-0074-49b2-9c0c-c14e101fd8e2 req-28523c05-cedd-427f-aba6-48f548496c79 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 210 time: 0.1872118 Dec 21 03:49:29.995320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f6a502-0570-49c6-b3eb-307871d98c71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9c24d51-6c60-4df4-9f56-a8704af96422,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:30.078266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.243 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/feb7c6fe-4296-4b97-bdd3-ef39ffcbadba) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:30.091592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:30.109906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c929a1ae-6663-450f-b225-3c694dbddfad req-f40dc2a4-46f2-4a11-ba7e-c3d5e26bc59a tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/ports?device_id=df0ef1b8-921c-4e9f-9dd4-127a94a0f905 HTTP/1.1" status: 200 len: 210 time: 0.0580056 Dec 21 03:49:30.110566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:30.114047 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.252729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-689041a4-4349-49a0-b087-25151fa951f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.282531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-689041a4-4349-49a0-b087-25151fa951f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.290860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d27462-6af7-4e05-be9a-910c479a62a0 req-50ecf382-9bf4-4eba-b6f6-b1dd3a1d2a0c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.292439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1d27462-6af7-4e05-be9a-910c479a62a0 req-50ecf382-9bf4-4eba-b6f6-b1dd3a1d2a0c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1857140 Dec 21 03:49:30.327321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Attempting to bind port b078a85f-2d87-4a50-931c-09b26621fea9 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:30.327753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Attempting to bind port b078a85f-2d87-4a50-931c-09b26621fea9 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:30.328040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Attempting to bind port b078a85f-2d87-4a50-931c-09b26621fea9 on network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:30.340032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Port b078a85f-2d87-4a50-931c-09b26621fea9 on network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:30.340354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Attempting to bind port b078a85f-2d87-4a50-931c-09b26621fea9 on network ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:30.348408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:30.348784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Checking segment: {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:30.349112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Bound using segment: {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:30.349537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Bound port: b078a85f-2d87-4a50-931c-09b26621fea9, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:30.349891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.420097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.420622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.421106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.421576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.422042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.422504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.422978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.424878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2414e18d-3606-45ac-a2c4-31c047a4cc7a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6483 time: 0.1616457 Dec 21 03:49:30.466588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:30.471536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:30.502133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1d27462-6af7-4e05-be9a-910c479a62a0 req-d0d21438-890d-437f-84ca-0a93440bbc27 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1751809 Dec 21 03:49:30.553931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.564933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.616383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-d1a45320-f14a-40ea-a97e-c8f6016308be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.617803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-d1a45320-f14a-40ea-a97e-c8f6016308be service neutron] 10.222.0.54 "GET /v2.0/networks?id=19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 200 len: 903 time: 0.1777923 Dec 21 03:49:30.618362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:30.624084 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-689041a4-4349-49a0-b087-25151fa951f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.626733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-689041a4-4349-49a0-b087-25151fa951f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.628083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-689041a4-4349-49a0-b087-25151fa951f9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a9c24d51-6c60-4df4-9f56-a8704af96422 HTTP/1.1" status: 204 len: 168 time: 0.6737642 Dec 21 03:49:30.643470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689041a4-4349-49a0-b087-25151fa951f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9c24d51-6c60-4df4-9f56-a8704af96422,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:30.645856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.646469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.647844 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-741a2856-df8b-4614-b6e6-a23bc4d85eb4 service neutron] 10.222.0.31 "PUT /v2.0/ports/b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 1093 time: 1.9803545 Dec 21 03:49:30.648266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:30.663404 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-190b06d4-bce4-4e36-bd35-ad3a5a21be84" -d '{"events": [{"name": "network-changed", "server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:30.735473 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed63fb54-9bb7-4436-b3f7-177605228191 x-openstack-request-id: req-ed63fb54-9bb7-4436-b3f7-177605228191 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:30.735803 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:30.736057 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ed63fb54-9bb7-4436-b3f7-177605228191 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:30.736493 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'status': 'completed', 'code': 200} Dec 21 03:49:30.872111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190b06d4-bce4-4e36-bd35-ad3a5a21be84 req-751ebcc5-68f6-48f0-81e2-d4a91aeb01bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:30.874715 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-190b06d4-bce4-4e36-bd35-ad3a5a21be84 req-751ebcc5-68f6-48f0-81e2-d4a91aeb01bd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1096 time: 0.0528722 Dec 21 03:49:30.927073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-2f2c4555-0c6b-4567-b724-8a83976330bd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 200 len: 217 time: 0.2979383 Dec 21 03:49:30.928474 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:30.977070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:30.987581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:31.048856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190b06d4-bce4-4e36-bd35-ad3a5a21be84 req-08f65b74-b55d-48b7-8c90-54a665c7cf63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:31.051208 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-190b06d4-bce4-4e36-bd35-ad3a5a21be84 req-08f65b74-b55d-48b7-8c90-54a665c7cf63 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1493013 Dec 21 03:49:31.228233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190b06d4-bce4-4e36-bd35-ad3a5a21be84 req-b74f9f54-1135-46b7-a400-83ec0d17b4d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:31.229811 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-190b06d4-bce4-4e36-bd35-ad3a5a21be84 req-b74f9f54-1135-46b7-a400-83ec0d17b4d8 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1658428 Dec 21 03:49:31.328853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:31.335350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.7 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/e8f918db-131d-40f7-91ab-86a7099533b5) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:31.384202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-bf68f73f-670b-4f98-9e2a-29650b45d05b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:31.385747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-bf68f73f-670b-4f98-9e2a-29650b45d05b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1096 time: 0.0902777 Dec 21 03:49:31.390085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6270869-eff7-48a8-b42a-6e0a46c2d587 req-2b4b3ce1-b4f4-4a82-9e24-bcf900500daf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:31.393696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6270869-eff7-48a8-b42a-6e0a46c2d587 req-2b4b3ce1-b4f4-4a82-9e24-bcf900500daf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 944 time: 0.5055246 Dec 21 03:49:31.406228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:31.451087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:31.465863 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-44329235-eb20-4386-a2a3-af2dae648bcc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 217 time: 0.0622718 Dec 21 03:49:31.492645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:31.503594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-27eaf25e-711f-4b30-bfef-accd1fa635bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:31.509382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-27eaf25e-711f-4b30-bfef-accd1fa635bd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.5082691 Dec 21 03:49:31.555707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-2109fd81-958e-4903-a919-605d064860b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:31.557613 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-2109fd81-958e-4903-a919-605d064860b8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.0799103 Dec 21 03:49:31.663432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-82c5e8bb-427e-4abf-b07d-257453d86c02 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0683880 Dec 21 03:49:31.842046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7f24f42b-e921-4a4b-9554-17a83918a56d None None] Provisioning complete for port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:31.843590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f24f42b-e921-4a4b-9554-17a83918a56d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:31.890348 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-651adb03-f631-4eea-97ed-a4d3c8f78290 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2102525 Dec 21 03:49:31.907432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7f24f42b-e921-4a4b-9554-17a83918a56d None None] Port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:32.072326 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-306a381a-f579-4e48-bbd7-527e1c2c0075 req-e70a0a58-dcb8-42c9-a8f2-b54c758aecd5 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1768622 Dec 21 03:49:32.237252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.244097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.251636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.258871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.267202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.274827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.292895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.293417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90d86010-483a-48c7-939b-48b1e45e06bf req-0a989ae0-5509-4c24-b6db-0b3e3765ab1d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 1.2081215 Dec 21 03:49:32.417654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.418595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:32.433508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6270869-eff7-48a8-b42a-6e0a46c2d587 req-ba3de950-cbc9-4b71-b058-157d838c2db2 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9983156 Dec 21 03:49:32.450796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4024363d-61ca-4732-b830-32b3d0e35538 req-13076503-e8be-45f4-a090-064c9ea6366b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:32.453396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-13076503-e8be-45f4-a090-064c9ea6366b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.8803458 Dec 21 03:49:32.583202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:32.607670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:32.617944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-f9605af6-1153-47f9-8cdd-74e5bdad90d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.0470929 Dec 21 03:49:32.657032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90d86010-483a-48c7-939b-48b1e45e06bf req-e4d70430-dd34-414d-81e1-e67f2c2af043 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3010917 Dec 21 03:49:32.721919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Request body: {'port': {'device_id': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:32.738238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c60f94-cf7a-430c-9b64-c8bcf0726cc0 req-6e9ab895-b7c2-4df5-bf95-d973549c81bb tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 210 time: 0.1542993 Dec 21 03:49:32.896844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Request body: {'network': {'name': 'tempest-FloatingIPDetailsTestJSON-761887281-network', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:32.942394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49692) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:32.995340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-d80cca67-e67e-4821-9cf6-71f7a5538c21 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5324917 Dec 21 03:49:33.062194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Made reservation on behalf of 55f2bf80332241bbb5e3eda21038f4f0 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:33.064585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.073006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.087153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.090167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.182722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.218445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.261394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:33.346959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:33.401244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.418964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d9be36-3513-4d8b-81c4-2e090e0ad835 req-3acb4461-27d4-4fa5-b7ec-8b2f8013bd56 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:33.427250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8d9be36-3513-4d8b-81c4-2e090e0ad835 req-3acb4461-27d4-4fa5-b7ec-8b2f8013bd56 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.4684012 Dec 21 03:49:33.439131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.441814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.447789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "DELETE /v2.0/security-groups/d37501a6-0469-46d6-b49f-78211ef2e8d1 HTTP/1.1" status: 204 len: 168 time: 0.5022478 Dec 21 03:49:33.447789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49694) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:33.492551 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-d27b9877-1673-4dfd-94c6-7c9853277138 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] show failed (client error): The resource could not be found. Dec 21 03:49:33.496597 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d27b9877-1673-4dfd-94c6-7c9853277138 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "GET /v2.0/security-groups/d37501a6-0469-46d6-b49f-78211ef2e8d1 HTTP/1.1" status: 404 len: 347 time: 0.0466602 Dec 21 03:49:33.499837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49698) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:33.500032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:33.506587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d37501a6-0469-46d6-b49f-78211ef2e8d1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:33.511471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.525608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.525970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.526320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.526661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.539449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.539947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.540364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.540724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.541056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.541412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.541726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.542062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.542388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-318b8c1d-cee9-49e3-b468-6c67b53bd741 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:33.571149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:49:33.666435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89234168-afdd-4780-adcb-832eb8195d6d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:33.714607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.714984 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Added segment fad4816d-65f0-4062-ab9b-67c169c7b23c of type vlan for network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 Dec 21 03:49:33.853848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.859221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-733c8ecc-7fcb-4d81-8b87-f5eed00a385f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.2594635 Dec 21 03:49:33.947914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.948854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:33.949455 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:33.981317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:34.067377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:34.070366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=e8f918db-131d-40f7-91ab-86a7099533b5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:34.105775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.5206194 Dec 21 03:49:34.112339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49708) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:34.131626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0deaf0e5-97bf-450d-9ecb-d5f0e18aafec admin admin] Pushing event updated for resources: {'Network': ['ID=243dd4d9-cd73-4cd5-a1b2-67566e390a56,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:34.138643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Request body: {'subnet': {'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-subnet', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:34.142124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:49:34.195969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-68478d05-199f-443c-aea9-b043e6d0afaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:34.197515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-68478d05-199f-443c-aea9-b043e6d0afaa service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7662e8b89a444924a01bee5e34421908&device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 1096 time: 0.2349274 Dec 21 03:49:34.229932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4024363d-61ca-4732-b830-32b3d0e35538 req-4455b146-8b46-4964-928a-6fd7f03b96e8 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1878655 Dec 21 03:49:34.356055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8d9be36-3513-4d8b-81c4-2e090e0ad835 req-60cd3426-5c77-4216-a905-1923ddc60eab tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9278500 Dec 21 03:49:34.408314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Made reservation on behalf of 55f2bf80332241bbb5e3eda21038f4f0 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:34.429630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:34.555165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-50c6f50e-bb37-4bdb-974b-67779a1d8864 None None] Provisioning complete for port e8f918db-131d-40f7-91ab-86a7099533b5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:34.555660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50c6f50e-bb37-4bdb-974b-67779a1d8864 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:34.593488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-50c6f50e-bb37-4bdb-974b-67779a1d8864 None None] Port e8f918db-131d-40f7-91ab-86a7099533b5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:34.613285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:34.620380 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:34.835540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8b3919b7-45f1-4ff6-856f-3cfda98fce92 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 5.4762456 Dec 21 03:49:34.917032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Request body: {'port': {'device_id': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:34.923756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-f1921fc7-db84-4d47-a923-475e937f0d4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:34.927214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-f1921fc7-db84-4d47-a923-475e937f0d4f service neutron] 10.222.0.54 "GET /v2.0/networks?id=8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 200 len: 921 time: 0.7006867 Dec 21 03:49:34.933822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.029792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f9bd4f-38b9-44a0-b474-0a3c2a013bd0 req-3d012908-c9c2-4cb8-be91-330415cc8925 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.033600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28f9bd4f-38b9-44a0-b474-0a3c2a013bd0 req-3d012908-c9c2-4cb8-be91-330415cc8925 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 944 time: 0.9707358 Dec 21 03:49:35.053968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Pushing event updated for resources: {'Subnet': ['ID=980e5c6c-efca-4c8e-9554-34f78b220c78,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:35.056475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b078a85f-2d87-4a50-931c-09b26621fea9 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:35.201865 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-581e18b4-529d-47e8-aa1c-c35203dea879 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 200 len: 217 time: 0.2633431 Dec 21 03:49:35.226446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:35.240483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'network_id': 'ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a', 'port_id': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'mac_address': 'fa:16:3e:48:be:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:35.306595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.328436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.343425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.360360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Checking segment: {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:35.360722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Network hostable DHCP agents. Network: 243dd4d9-cd73-4cd5-a1b2-67566e390a56, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:49:35.377681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.389883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.411998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.428961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-f6355dd8-4163-45b1-ad93-ddd1686c3744 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.430452 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-f6355dd8-4163-45b1-ad93-ddd1686c3744 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 200 len: 860 time: 0.2087958 Dec 21 03:49:35.431038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.437738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b078a85f-2d87-4a50-931c-09b26621fea9 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:35.441752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.457377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-41528a76-e75c-4dc3-b687-89e7d6dc2e52 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.8724082 Dec 21 03:49:35.492460 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-497c0ae1-5198-41da-ac76-2b374001faa2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8b13f1ae-b717-40da-b68e-bdf950529b14&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0497656 Dec 21 03:49:35.512550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:35.523928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Deleting port 40e63e72-c385-43ec-94ea-84400fa5a08a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:35.524702 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.526740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.535014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:49:35.615640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.659179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28f9bd4f-38b9-44a0-b474-0a3c2a013bd0 req-73f27a52-9079-4288-a6a1-56141551e466 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5613101 Dec 21 03:49:35.701081 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-d9a4619d-93b2-4aef-9026-35f855b7bbe8 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1965110 Dec 21 03:49:35.734793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 243dd4d9-cd73-4cd5-a1b2-67566e390a56) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:35.777000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a6abfd7-f4ec-432e-ab34-ac0acff2b053 None None] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:49:35.789234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:35.791380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.826516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:35.904122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.904487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.905420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.916797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.919399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.919789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.920142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:35.938381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id feb7c6fe-4296-4b97-bdd3-ef39ffcbadba {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:35.962774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:35.964386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b078a85f-2d87-4a50-931c-09b26621fea9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:35.964496 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1351b3a0-8247-4ae5-9fe2-873609a86d9c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.8340468 Dec 21 03:49:35.965148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:35.974681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:36.010089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Transition to ACTIVE for port object feb7c6fe-4296-4b97-bdd3-ef39ffcbadba will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:36.034689 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-be2e48be-f47f-498d-a3d7-c41ad7230d46 req-daf8a73f-a7fc-4677-9218-90a263bc7f46 service neutron] 10.222.0.54 "GET /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3206184 Dec 21 03:49:36.106990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.106990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.155826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-243dd4d9-cd73-4cd5-a1b2-67566e390a56', 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56', 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'fixed_ips': [{'subnet_id': '980e5c6c-efca-4c8e-9554-34f78b220c78'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:49:36.159743 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.258288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.263194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.316464 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.317231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:36.444979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d7dfd11-b3de-4564-8062-4d3424c7b5ba req-2b975f0c-d20c-4254-bf25-da9658a07593 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.9861143 Dec 21 03:49:36.456347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Calling delete_port for 40e63e72-c385-43ec-94ea-84400fa5a08a owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:36.689824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3abb6b7-057b-42dc-85d6-9020a46f5b6f req-4a39fe7c-d849-4a4a-84be-a6af0fa9f6dd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:36.696576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3abb6b7-057b-42dc-85d6-9020a46f5b6f req-4a39fe7c-d849-4a4a-84be-a6af0fa9f6dd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 934 time: 0.8479338 Dec 21 03:49:36.701165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Pushing event updated for resources: {'Port': ['ID=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:36.905724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Allocated IP 172.20.0.2 (243dd4d9-cd73-4cd5-a1b2-67566e390a56/980e5c6c-efca-4c8e-9554-34f78b220c78/a7e14bf3-f9ff-4d21-a803-53108ebc7835) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:36.932980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.072617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:37.085266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:37.177568 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.284324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.355209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:37.383461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:37.395015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:37.398373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Pushing event updated for resources: {'Port': ['ID=a7e14bf3-f9ff-4d21-a803-53108ebc7835,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:37.409152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:37.453471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'da821d06-09e0-4580-a540-b604a6a13c16', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'port_id': 'da821d06-09e0-4580-a540-b604a6a13c16', 'mac_address': 'fa:16:3e:7d:93:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da10d7f0-623a-4e8a-b5fc-286a12beadcd', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:37.468693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.533197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3abb6b7-057b-42dc-85d6-9020a46f5b6f req-90076ad8-0110-480f-ac6b-e68fece95d76 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3961380 Dec 21 03:49:37.585433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Attempting to bind port a7e14bf3-f9ff-4d21-a803-53108ebc7835 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:37.586070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Attempting to bind port a7e14bf3-f9ff-4d21-a803-53108ebc7835 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:37.586785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Attempting to bind port a7e14bf3-f9ff-4d21-a803-53108ebc7835 on network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:37.588843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.639650 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.642615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f94ea1-9e55-4782-b14b-b97cf94a7b7f req-ec9058fd-5f7a-4da0-9078-c09947297145 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:37.649966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05f94ea1-9e55-4782-b14b-b97cf94a7b7f req-ec9058fd-5f7a-4da0-9078-c09947297145 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.4891675 Dec 21 03:49:37.662919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:37.663633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Checking segment: {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:37.664216 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.664893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Bound using segment: {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:37.665580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Bound port: a7e14bf3-f9ff-4d21-a803-53108ebc7835, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:37.666155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.668566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:37.671749 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01133754-d49d-41a6-8f43-1b2c6276f8e1" -d '{"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "da821d06-09e0-4580-a540-b604a6a13c16"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:37.697244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:37.704640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.747506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id da821d06-09e0-4580-a540-b604a6a13c16 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:37.804440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:37.900179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Allocated IP 172.25.5.194 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:37.916846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] For port a7e14bf3-f9ff-4d21-a803-53108ebc7835, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:37.917449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Attempting to bind port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:37.918041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Attempting to bind port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:37.918481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Attempting to bind port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:37.951467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] For port a7e14bf3-f9ff-4d21-a803-53108ebc7835, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7e14bf3-f9ff-4d21-a803-53108ebc7835,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:37.955462 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:49:37.956045 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:49:37.976664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:38.005044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:38.005044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Attempting to bind port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:38.033303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:38.033810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:38.034309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:38.034884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Bound port: feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:38.035384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.048301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.060571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b863add-d79e-4eb9-a7ab-851acad92e3c req-f2bd7341-7bd9-44df-a9aa-951918edd580 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:38.062395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b863add-d79e-4eb9-a7ab-851acad92e3c req-f2bd7341-7bd9-44df-a9aa-951918edd580 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 945 time: 0.3786795 Dec 21 03:49:38.161299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcea2616-a4e6-4bad-b630-274c57f23cb3 None None] Pushing event updated for resources: {'Port': ['ID=a7e14bf3-f9ff-4d21-a803-53108ebc7835,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:38.181092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.187155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05f94ea1-9e55-4782-b14b-b97cf94a7b7f req-25429acb-fff1-4bd9-bd85-8010507a9531 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5345316 Dec 21 03:49:38.319273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.327657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] For port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:38.333493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] For port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:38.363753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.406836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:38.441013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:38.446549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:38.487697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.490673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Pushing event deleted for resources: {'Port': ['ID=40e63e72-c385-43ec-94ea-84400fa5a08a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:38.574421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.616214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da821d06-09e0-4580-a540-b604a6a13c16 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:38.635563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Pushing event updated for resources: {'Port': ['ID=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:38.659047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:38.692188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Pushing event updated for resources: {'Port': ['ID=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:38.740167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.801756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8f918db-131d-40f7-91ab-86a7099533b5 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:38.893719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:38.908293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:38.909262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.913460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1a484c37-41ba-4f43-ba9a-0fb49e7db5e4 service neutron] 10.222.0.31 "PUT /v2.0/ports/feb7c6fe-4296-4b97-bdd3-ef39ffcbadba HTTP/1.1" status: 200 len: 1097 time: 6.2529356 Dec 21 03:49:38.918386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'tag': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:38.921976 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d" -d '{"events": [{"name": "network-changed", "server_uuid": "f2df3f34-9f1a-40f7-828d-f6264abfbb19", "tag": "feb7c6fe-4296-4b97-bdd3-ef39ffcbadba"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:38.955151 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:38.978665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b863add-d79e-4eb9-a7ab-851acad92e3c req-60053dc7-75d1-44b8-aa21-599c43dca1b8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8387938 Dec 21 03:49:39.066370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Transition to ACTIVE for port object e8f918db-131d-40f7-91ab-86a7099533b5 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:39.087721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b078a85f-2d87-4a50-931c-09b26621fea9 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:39.201242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d214b9d1-5285-4518-a088-d7566d355a0e x-openstack-request-id: req-d214b9d1-5285-4518-a088-d7566d355a0e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:39.201502 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "da821d06-09e0-4580-a540-b604a6a13c16", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:39.201849 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d214b9d1-5285-4518-a088-d7566d355a0e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:39.202256 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16', 'code': 200} Dec 21 03:49:39.203358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['da821d06-09e0-4580-a540-b604a6a13c16'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:39.227746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:39.436291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:39.439752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:39.444551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b9294db5-d3dd-4724-8bd3-f1abc0b26204 tempest-ServersTestBootFromVolume-474219177 tempest-ServersTestBootFromVolume-474219177-project] 10.222.0.18 "DELETE /v2.0/floatingips/d027d1db-04ad-43b0-9c77-67105c361095 HTTP/1.1" status: 204 len: 168 time: 5.9077427 Dec 21 03:49:39.456523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49758) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:39.461238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.473026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7e14bf3-f9ff-4d21-a803-53108ebc7835 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:39.473883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.476495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:39.481436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.488285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.496125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.505396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.517836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.519963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-0c257b87-ffee-4881-bf0f-359db8f6f419 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.6338639 Dec 21 03:49:39.737392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port b078a85f-2d87-4a50-931c-09b26621fea9 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:49:39.801447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b078a85f-2d87-4a50-931c-09b26621fea9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:39.802243 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:39.838669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-fcb6658f-32cd-41fe-bf21-276f5ac7ea01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:39.850961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-fcb6658f-32cd-41fe-bf21-276f5ac7ea01 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 1100 time: 0.6688178 Dec 21 03:49:39.893572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Pushing event updated for resources: {'Port': ['ID=e8f918db-131d-40f7-91ab-86a7099533b5,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:39.945929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:39.988695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:39.995955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a7e14bf3-f9ff-4d21-a803-53108ebc7835 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:39.996705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:40.030570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f00dcb0-c70d-4e96-9e4c-2eca5caf50be req-828e0e6e-8ad2-4dd8-8cf8-6bc32f6855ce tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:40.041224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f00dcb0-c70d-4e96-9e4c-2eca5caf50be req-828e0e6e-8ad2-4dd8-8cf8-6bc32f6855ce tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 946 time: 0.6222928 Dec 21 03:49:40.081337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:40.154990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:40.192908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:40.195413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-2903dbb5-7fb1-4755-a2de-abe8992d89ed tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:40.196954 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-2903dbb5-7fb1-4755-a2de-abe8992d89ed tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.4337862 Dec 21 03:49:40.263570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port a7e14bf3-f9ff-4d21-a803-53108ebc7835, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7e14bf3-f9ff-4d21-a803-53108ebc7835,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:40.271966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40a43460-6b3d-4871-8f45-c28864f415e2 None None] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:49:40.340718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-8a12ba43-848d-4035-ac70-898a0874e7e2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.243&port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba HTTP/1.1" status: 200 len: 217 time: 0.4372575 Dec 21 03:49:40.354298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6e7bf2d-d814-430e-98ca-8a41f1438e3b req-7d8c9aea-3544-4646-a632-b06b096ab198 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.7672114 Dec 21 03:49:40.477335 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:40.627285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f00dcb0-c70d-4e96-9e4c-2eca5caf50be req-7698d8df-a25c-4557-ba91-2002b91a8576 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4817872 Dec 21 03:49:40.629326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-da101d31-4c7b-48ba-8500-8b6ac99e172e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:40.632549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-da101d31-4c7b-48ba-8500-8b6ac99e172e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.2308452 Dec 21 03:49:40.726534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Attempting to bind port e8f918db-131d-40f7-91ab-86a7099533b5 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:40.727022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Attempting to bind port e8f918db-131d-40f7-91ab-86a7099533b5 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:40.727447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Attempting to bind port e8f918db-131d-40f7-91ab-86a7099533b5 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:40.734038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Port e8f918db-131d-40f7-91ab-86a7099533b5 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:40.734244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b58c0c7a-784c-4520-b278-8f48aa764068 None None] Provisioning complete for port a7e14bf3-f9ff-4d21-a803-53108ebc7835 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:40.734422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b58c0c7a-784c-4520-b278-8f48aa764068 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:40.734638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Attempting to bind port e8f918db-131d-40f7-91ab-86a7099533b5 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:40.745585 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56c0ceca-0e17-4b5b-bbf8-850f0a3007aa x-openstack-request-id: req-56c0ceca-0e17-4b5b-bbf8-850f0a3007aa {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:40.746000 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f2df3f34-9f1a-40f7-828d-f6264abfbb19", "tag": "feb7c6fe-4296-4b97-bdd3-ef39ffcbadba", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:40.746352 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-56c0ceca-0e17-4b5b-bbf8-850f0a3007aa {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:40.746849 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'tag': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba', 'status': 'completed', 'code': 200} Dec 21 03:49:40.769610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-add97b3c-412d-4133-b9a4-cacf857e2414 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:40.771433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-add97b3c-412d-4133-b9a4-cacf857e2414 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1151621 Dec 21 03:49:40.772291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:40.772954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:40.773438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:40.773979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Bound port: e8f918db-131d-40f7-91ab-86a7099533b5, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:40.774426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:40.806313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ff6aa5-99c8-489b-864b-f103e5437653 req-7aefa704-b6da-4ef5-8d60-fb6036c5f9c6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:40.814195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36ff6aa5-99c8-489b-864b-f103e5437653 req-7aefa704-b6da-4ef5-8d60-fb6036c5f9c6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 944 time: 0.2720659 Dec 21 03:49:40.914923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=a7e14bf3-f9ff-4d21-a803-53108ebc7835,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:41.120469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36ff6aa5-99c8-489b-864b-f103e5437653 req-a1387fdf-8340-439c-a67d-ccedc5cbf591 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3028991 Dec 21 03:49:41.121402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:41.159415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.202823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:41.205727 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-153cd32c-f0a3-4713-97f4-8e9df13b0698" -d '{"events": [{"server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "name": "network-vif-plugged", "status": "completed", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:41.224379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed82346-e114-4194-9fe0-6df6d9750669 req-a99ff7cd-d6f3-464c-9c9a-a51e70e81246 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:41.227382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed82346-e114-4194-9fe0-6df6d9750669 req-a99ff7cd-d6f3-464c-9c9a-a51e70e81246 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 944 time: 0.3474810 Dec 21 03:49:41.252988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port da821d06-09e0-4580-a540-b604a6a13c16 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:41.253369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.338414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Deleting port b1bddbab-3a32-4687-b97f-eada22b71c0f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:41.338958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.357880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-1fdff60c-ef69-4b86-bbab-086419b0b7cc service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5677900 Dec 21 03:49:41.378121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7e14bf3-f9ff-4d21-a803-53108ebc7835 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:41.406558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] For port e8f918db-131d-40f7-91ab-86a7099533b5, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:41.455774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] For port e8f918db-131d-40f7-91ab-86a7099533b5, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e8f918db-131d-40f7-91ab-86a7099533b5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:41.541857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.582713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a4f2716e-45d6-4ca4-8544-b40d3de40315 None None] Provisioning complete for port a7e14bf3-f9ff-4d21-a803-53108ebc7835 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:41.582713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4f2716e-45d6-4ca4-8544-b40d3de40315 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.663102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.693015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a7e14bf3-f9ff-4d21-a803-53108ebc7835 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:41.693648 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.705763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:41.706425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.707970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] 10.222.0.54 "PUT /v2.0/ports/e8f918db-131d-40f7-91ab-86a7099533b5 HTTP/1.1" status: 200 len: 1095 time: 6.8524077 Dec 21 03:49:41.716001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed82346-e114-4194-9fe0-6df6d9750669 req-2b9af3a2-69cd-4d0f-a251-4d0882b24835 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4741845 Dec 21 03:49:41.723953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] For port b1bddbab-3a32-4687-b97f-eada22b71c0f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b1bddbab-3a32-4687-b97f-eada22b71c0f,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:41.724354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.800543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7197c803-c06c-4af1-9710-108328ac6bf6 req-71a3fcb7-e829-4a31-abd1-ed0df7a45fc3 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:41.802150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7197c803-c06c-4af1-9710-108328ac6bf6 req-71a3fcb7-e829-4a31-abd1-ed0df7a45fc3 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 946 time: 0.4397130 Dec 21 03:49:41.803953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Calling delete_port for b1bddbab-3a32-4687-b97f-eada22b71c0f owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:41.816205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:41.862758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7180af13-d504-4ce4-a7f0-3dccaef1a73c service neutron] Pushing event updated for resources: {'Port': ['ID=e8f918db-131d-40f7-91ab-86a7099533b5,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:41.890843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:41.938221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-be270106-f2d4-4955-8405-7c7d762ebd9a service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5650570 Dec 21 03:49:41.996344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:49:42.057264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7197c803-c06c-4af1-9710-108328ac6bf6 req-ef1673f0-e2ba-4e4d-b893-0184e2031d44 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2162766 Dec 21 03:49:42.070654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7ebfb0e5-8ace-4ed2-b310-4da124f9ec4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.072254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-7ebfb0e5-8ace-4ed2-b310-4da124f9ec4b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 1098 time: 0.1516597 Dec 21 03:49:42.179333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-9db363e3-ba50-4c99-a49c-d4106aa708d6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.7&port_id=e8f918db-131d-40f7-91ab-86a7099533b5 HTTP/1.1" status: 200 len: 217 time: 0.0905788 Dec 21 03:49:42.217948 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c185ddf-2eb8-4e6b-9bbb-7ffe0e8442e6 x-openstack-request-id: req-2c185ddf-2eb8-4e6b-9bbb-7ffe0e8442e6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:42.218865 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "name": "network-vif-plugged", "status": "completed", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:42.219327 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2c185ddf-2eb8-4e6b-9bbb-7ffe0e8442e6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:42.219888 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'code': 200} Dec 21 03:49:42.263523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:42.339218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:42.458131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-68ea66d6-23cc-43c6-954a-b929ba87bf67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.459646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-68ea66d6-23cc-43c6-954a-b929ba87bf67 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.2017627 Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.486050 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89b61452-011f-4122-b15b-3d3c42d18582 req-f5f8a9fc-b8a6-4365-aa0c-98d39735dac2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.488871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89b61452-011f-4122-b15b-3d3c42d18582 req-f5f8a9fc-b8a6-4365-aa0c-98d39735dac2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 946 time: 0.3082533 Dec 21 03:49:42.504644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.510994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.518495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.525019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.532951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.554699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.561200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.566106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:49:42.569501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-e6b4e299-b9f1-445a-a840-783fd4f467e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.4112549 Dec 21 03:49:42.573076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-ba6f9163-8711-4308-a81d-494c25145a96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.574566 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-ba6f9163-8711-4308-a81d-494c25145a96 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 1100 time: 0.2740457 Dec 21 03:49:42.579663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Sync routers for ids ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:49:42.613452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02705552-589e-4c9f-8df6-a5672c038d37 req-4c2d7465-ca54-48ad-9cde-ee4933949849 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.614657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02705552-589e-4c9f-8df6-a5672c038d37 req-4c2d7465-ca54-48ad-9cde-ee4933949849 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1098 time: 0.4204748 Dec 21 03:49:42.618880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Routers {'d1b7ae4c-e59a-4693-84a5-d0a6f5972720'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:42.622604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:42.648674 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:42.744126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02705552-589e-4c9f-8df6-a5672c038d37 req-3f697285-cb45-41fa-917b-73f8cc8bafb3 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164789 Dec 21 03:49:42.749160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89b61452-011f-4122-b15b-3d3c42d18582 req-5e31916c-1fb0-4ccf-b3a9-b333ad5557e7 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1566069 Dec 21 03:49:42.754251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'tag': 'e8f918db-131d-40f7-91ab-86a7099533b5'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:42.758076 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b32eb011-1cf9-4b05-81e1-23777178d58b" -d '{"events": [{"name": "network-changed", "server_uuid": "60ce7efc-44aa-46fb-a6b0-9ce9383f5c00", "tag": "e8f918db-131d-40f7-91ab-86a7099533b5"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:42.767976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event deleted for resources: {'Port': ['ID=b1bddbab-3a32-4687-b97f-eada22b71c0f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:42.786977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438d0d7c-349e-42f9-807d-cd720d096503 req-9dfda3de-4359-4629-96a2-e591a326d46a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.788905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-9dfda3de-4359-4629-96a2-e591a326d46a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3130233 Dec 21 03:49:42.814465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b89beb0a-b712-4468-b06e-46223fc05e55 req-7419ea31-57d2-4ced-b99a-a1c05e756a46 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2439456 Dec 21 03:49:42.885022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:42.894559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d2d2058-1220-4856-8a58-aedb9c6467e8 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 6.9225817 Dec 21 03:49:42.895532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49786) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:42.967830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-1eeabebf-af64-4d16-972d-91fa16f134e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:42.978755 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-1eeabebf-af64-4d16-972d-91fa16f134e4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3935289 Dec 21 03:49:42.989112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-265c378b-ca1d-4442-8526-3083ce7f3708 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672950 Dec 21 03:49:43.011757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:43.018726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Set router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:43.064044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: b1bddbab-3a32-4687-b97f-eada22b71c0f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:43.064397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b1bddbab-3a32-4687-b97f-eada22b71c0f not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:43.191370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] No DVR routers for this DVR port b1bddbab-3a32-4687-b97f-eada22b71c0f on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:43.196345 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-8052312c-7cde-4e25-9a5f-26a5efd4f29b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.243&port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba HTTP/1.1" status: 200 len: 217 time: 0.1445632 Dec 21 03:49:43.200125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:43.204579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438d0d7c-349e-42f9-807d-cd720d096503 req-68cdd702-1ae4-4ddb-8863-b0c257d74db9 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1470010 Dec 21 03:49:43.212478 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e1e8a3c2-45fd-49d6-9f82-cac412368d0b req-dd7d4875-8043-4cf3-8736-bb9e244d90b9 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "DELETE /v2.0/ports/b1bddbab-3a32-4687-b97f-eada22b71c0f HTTP/1.1" status: 204 len: 173 time: 2.9937813 Dec 21 03:49:43.214367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'name': 'network-vif-deleted', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:43.222344 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c78bf27d-6a03-48e4-ba02-6e1ef66f06e7" -d '{"events": [{"server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "name": "network-vif-deleted", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:43.276537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd79c59b-9f8c-40a1-ba61-7fcc88efe900 req-c2fa9499-509c-4e2e-b6f6-f91f85d0425b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 210 time: 0.2383926 Dec 21 03:49:43.297489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd9bc79b-dbef-40d9-b9cd-78109a477eb4 req-566567b0-50c6-48a9-abc7-5cd750b281cc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:43.299832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd9bc79b-dbef-40d9-b9cd-78109a477eb4 req-566567b0-50c6-48a9-abc7-5cd750b281cc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.3091347 Dec 21 03:49:43.367798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:49:38Z', 'revision_number': 3, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:43.369891 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-762d5a1c-201d-4487-8877-7ced322036dd x-openstack-request-id: req-762d5a1c-201d-4487-8877-7ced322036dd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:43.370725 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "60ce7efc-44aa-46fb-a6b0-9ce9383f5c00", "tag": "e8f918db-131d-40f7-91ab-86a7099533b5", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:43.371342 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-762d5a1c-201d-4487-8877-7ced322036dd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:43.372264 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'tag': 'e8f918db-131d-40f7-91ab-86a7099533b5', 'status': 'completed', 'code': 200} Dec 21 03:49:43.445558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd9bc79b-dbef-40d9-b9cd-78109a477eb4 req-37a3ee73-fe37-47a4-a90c-abc051e1447b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1367209 Dec 21 03:49:43.465119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Checking router: d1b7ae4c-e59a-4693-84a5-d0a6f5972720 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:49:43.465661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Updating router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:49:43.524811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:43.531158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-b156fe00-647a-4ccc-a7dc-9b2050a4b550 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:43.531158 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-b156fe00-647a-4ccc-a7dc-9b2050a4b550 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.2959285 Dec 21 03:49:43.581038 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-269b7040-62f0-472f-a115-a67776f26f72 x-openstack-request-id: req-269b7040-62f0-472f-a115-a67776f26f72 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:43.581580 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f531d8a3-5517-4e40-8284-5181f3f3c517", "name": "network-vif-deleted", "tag": "b1bddbab-3a32-4687-b97f-eada22b71c0f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:43.582614 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-269b7040-62f0-472f-a115-a67776f26f72 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:43.583215 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f531d8a3-5517-4e40-8284-5181f3f3c517', 'name': 'network-vif-deleted', 'tag': 'b1bddbab-3a32-4687-b97f-eada22b71c0f', 'status': 'completed', 'code': 200} Dec 21 03:49:43.704221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e12ee8-8938-454f-8232-89805e9b1877 req-c30d502a-7b8a-43dc-9a6f-30f40cc4f7b8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:43.706033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94e12ee8-8938-454f-8232-89805e9b1877 req-c30d502a-7b8a-43dc-9a6f-30f40cc4f7b8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 946 time: 0.1507134 Dec 21 03:49:43.811834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94e12ee8-8938-454f-8232-89805e9b1877 req-5ed4ecc5-4b7a-4e94-a19d-1725e3462970 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923684 Dec 21 03:49:43.929920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-3ee90f1e-fc61-4b7a-b09f-ec1352feb5d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:43.937679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-3ee90f1e-fc61-4b7a-b09f-ec1352feb5d0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3533587 Dec 21 03:49:43.963078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-0187f8ae-d10c-4ff0-81e7-42d6091fa1e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:43.964997 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-0187f8ae-d10c-4ff0-81e7-42d6091fa1e8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 1098 time: 0.4700472 Dec 21 03:49:44.065409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18d6a84-444e-46af-8a22-4f5f97f3bbf1 req-40745caf-288e-40db-966a-c38e4a6c4281 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.074729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d18d6a84-444e-46af-8a22-4f5f97f3bbf1 req-40745caf-288e-40db-966a-c38e4a6c4281 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 946 time: 0.1753659 Dec 21 03:49:44.115340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.131661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-db1f8a81-e331-4530-bab7-8c638766d3a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.133581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-db1f8a81-e331-4530-bab7-8c638766d3a5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1569488 Dec 21 03:49:44.141728 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:44.141924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.161935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.181039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.204982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.211370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.217790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.219905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-181bef5b-f25e-433a-8413-57e264c80117 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.2666900 Dec 21 03:49:44.221180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:44.224057 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4bbd8dfb-d657-401a-befb-0edcc54c5e66" -d '{"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "da821d06-09e0-4580-a540-b604a6a13c16"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:44.272788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:44.300963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d18d6a84-444e-46af-8a22-4f5f97f3bbf1 req-1c7fc4d3-db9c-469c-bc23-4865a3e72a25 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2252045 Dec 21 03:49:44.310905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Deleting port 7858b624-ab23-47c3-8ea5-3fd3edbec98d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:44.312022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:44.331052 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-a888ac8e-f71e-40fc-9adc-8d2e383470a6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.7&port_id=e8f918db-131d-40f7-91ab-86a7099533b5 HTTP/1.1" status: 200 len: 217 time: 0.1782293 Dec 21 03:49:44.396120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea3bfd8-96a0-4f61-b0cb-ebaaf69d7053 None None] Pushing event updated for resources: {'Port': ['ID=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:44.422614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b359c89-7df9-4fbb-a8fe-208feb3f219b req-f29fddcc-eb13-4f9d-b361-84bd8a98bbaf tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1872005 Dec 21 03:49:44.425072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Attempting to bind port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:44.430264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Attempting to bind port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:44.430697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Attempting to bind port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:44.438597 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fe9281b-8317-4024-889b-1665ffd9a5a9 x-openstack-request-id: req-4fe9281b-8317-4024-889b-1665ffd9a5a9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:44.438858 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "da821d06-09e0-4580-a540-b604a6a13c16", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:44.439195 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4fe9281b-8317-4024-889b-1665ffd9a5a9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:44.439590 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16', 'code': 200} Dec 21 03:49:44.440766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:44.441201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:44.441607 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:44.441997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:44.442475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Bound port: a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:44.442853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:44.556178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] For port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:44.559924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] For port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:44.622609 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:44.685886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afe2168-767a-4ec8-af0b-36e065174503 req-6a19c059-ddfc-4ce8-bea5-8b1741e975c6 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=f531d8a3-5517-4e40-8284-5181f3f3c517 HTTP/1.1" status: 200 len: 210 time: 0.0889196 Dec 21 03:49:44.749240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Routers {'d1b7ae4c-e59a-4693-84a5-d0a6f5972720'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:44.750402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:44.794596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea3bfd8-96a0-4f61-b0cb-ebaaf69d7053 None None] Pushing event updated for resources: {'Port': ['ID=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:44.901327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dbbc79a-85fa-4381-a02f-cc81421e9fbd req-2e303a5f-6c35-440f-b904-90397845e272 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.902205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-16dfbe86-1fda-49ca-9bb8-7d002cdd62bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:44.903695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-16dfbe86-1fda-49ca-9bb8-7d002cdd62bc service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.5481961 Dec 21 03:49:44.909831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dbbc79a-85fa-4381-a02f-cc81421e9fbd req-2e303a5f-6c35-440f-b904-90397845e272 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.1622620 Dec 21 03:49:44.913805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] Set router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:45.027412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] For port 7858b624-ab23-47c3-8ea5-3fd3edbec98d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7858b624-ab23-47c3-8ea5-3fd3edbec98d,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:45.027782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.042115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Calling delete_port for 7858b624-ab23-47c3-8ea5-3fd3edbec98d owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:45.058612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ef3985-3baf-4c0e-819e-1210852d1f19 req-c26f30cc-238f-4447-857d-58dcf650b0c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:45.060524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97ef3985-3baf-4c0e-819e-1210852d1f19 req-c26f30cc-238f-4447-857d-58dcf650b0c9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 1097 time: 0.2227023 Dec 21 03:49:45.071651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e8f918db-131d-40f7-91ab-86a7099533b5 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:45.079512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dbbc79a-85fa-4381-a02f-cc81421e9fbd req-0511f3bb-a221-4af9-a0b4-286e9cd2e085 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1484010 Dec 21 03:49:45.137063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c8a535d-5c66-43f8-b275-459ee875e8d2 req-62e42725-bb0f-4d88-b870-77a90e06dfd5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:45.146802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c8a535d-5c66-43f8-b275-459ee875e8d2 req-62e42725-bb0f-4d88-b870-77a90e06dfd5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 946 time: 0.1933060 Dec 21 03:49:45.166685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device feb7c6fe-4296-4b97-bdd3-ef39ffcbadba details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:45.225984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97ef3985-3baf-4c0e-819e-1210852d1f19 req-1810ae1c-f73e-4005-814b-44499e7745e6 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1451344 Dec 21 03:49:45.246006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c8a535d-5c66-43f8-b275-459ee875e8d2 req-d9cda202-0ceb-4e58-84a0-63441533c76a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982149 Dec 21 03:49:45.287371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port e8f918db-131d-40f7-91ab-86a7099533b5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e8f918db-131d-40f7-91ab-86a7099533b5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:45.304797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:49:38Z', 'revision_number': 3, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:45.327192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-1ea92b28-ab31-470d-8f65-4927bfbe98c3 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.3579342 Dec 21 03:49:45.346386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'e8f918db-131d-40f7-91ab-86a7099533b5', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'e8f918db-131d-40f7-91ab-86a7099533b5', 'mac_address': 'fa:16:3e:cc:16:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:45.354163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57d3a7c2-23a4-497e-a086-d0906e460aaf None None] The sync data for ids ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'] in n-d-822053-11 is: [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:49:38Z', 'revision_number': 3, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:49:45.368431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:45.378604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.395695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-4af76367-9e46-4608-af1c-fd1dc7426596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:45.403175 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-4af76367-9e46-4608-af1c-fd1dc7426596 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.4821913 Dec 21 03:49:45.418382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba', 'mac_address': 'fa:16:3e:54:e9:74', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.243'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:45.454249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Pushing event deleted for resources: {'Port': ['ID=7858b624-ab23-47c3-8ea5-3fd3edbec98d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:45.456603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.457918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-4c1eb192-64d4-4944-8c9b-fb13cb0991ef tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-365304586&fields=id&tenant_id=0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 267 time: 0.1373398 Dec 21 03:49:45.504190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8f918db-131d-40f7-91ab-86a7099533b5 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:45.510442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.537739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port e8f918db-131d-40f7-91ab-86a7099533b5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e8f918db-131d-40f7-91ab-86a7099533b5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:45.539849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id feb7c6fe-4296-4b97-bdd3-ef39ffcbadba {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:45.582225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:45.587337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deaf9db6-e04a-4e64-8a72-aa7dc80dd9b5 req-e286057a-19fd-466a-a2e9-8cf25d29b931 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:45.589438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deaf9db6-e04a-4e64-8a72-aa7dc80dd9b5 req-e286057a-19fd-466a-a2e9-8cf25d29b931 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 946 time: 0.1617908 Dec 21 03:49:45.628611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.656214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-f82896a4-76bf-413f-a4eb-e61a4cba3f7f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:45.672443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-f82896a4-76bf-413f-a4eb-e61a4cba3f7f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 946 time: 0.2124951 Dec 21 03:49:45.676986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.679015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'port': {'security_groups': ['81a36cae-1a32-4478-b646-000893538e6f', 'bb4f0e15-9be1-4c6e-8512-b8df6c1654c0']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:45.746339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=e8f918db-131d-40f7-91ab-86a7099533b5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:45.845467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:45.896919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deaf9db6-e04a-4e64-8a72-aa7dc80dd9b5 req-c613c881-7739-4bb4-ada6-10eb7213cc63 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2838066 Dec 21 03:49:45.902101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:45.929502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:46.027655 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-04b4fe4a-a3e6-4ea4-8c09-530abb78b18d req-43ac2d60-2630-4811-b529-23a347b19ae0 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5365214 Dec 21 03:49:46.061945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['e8f918db-131d-40f7-91ab-86a7099533b5'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:46.068255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:46.071651 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-deb7e8c0-749e-4563-8e00-af5d66665b6a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6270304 Dec 21 03:49:46.206987 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b32eb011-1cf9-4b05-81e1-23777178d58b req-39ff62a8-af1c-40bd-8991-13dfd04fe1b0 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1210454 Dec 21 03:49:46.516815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:46.543948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.552528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.560024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.567795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.576074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.584197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.590621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.600750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1a91460-242e-493b-b182-9a64cc66c301 req-33299479-2ee7-4780-9386-10ed68136c71 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.5713475 Dec 21 03:49:46.630296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Allocated IP 172.20.0.1 (243dd4d9-cd73-4cd5-a1b2-67566e390a56/980e5c6c-efca-4c8e-9554-34f78b220c78/ff6421b9-f83c-4f61-a374-b480489375bf) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:46.740586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1a91460-242e-493b-b182-9a64cc66c301 req-bab68a26-312e-40a7-bd7b-292831d6b8ac tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1379564 Dec 21 03:49:46.744417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:46.794479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:46.884517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:46.907886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:46.917670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Router aa3076a7-dfbe-4587-b5a8-fe25629afc18 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:49:46.969185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:46.969790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:46.971393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49a10b9c-4a35-486b-ac45-f20270c7278e req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "PUT /v2.0/ports/b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 982 time: 1.2977736 Dec 21 03:49:46.977217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:46.978455 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-931b6470-5a2e-4cc7-a536-576a09394c52" -d '{"events": [{"name": "network-changed", "server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:47.059585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:47.064462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:49:47.073300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.073443 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6771992d-9995-41cc-ae60-7ba8acca361a admin admin] 10.222.0.18 "PUT /v2.0/routers/aa3076a7-dfbe-4587-b5a8-fe25629afc18/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6186309 Dec 21 03:49:47.073678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.074034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.074382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.074573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49856) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:47.074764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.075108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.075453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.076937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.076937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.076937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.076937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.079311 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] Sync routers for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:49:47.083752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:47.089230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.089663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6167ca6-3321-4dbf-b73b-eb8e93a32bb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:49:47.101058 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:47.101994 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:47.112130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b078a85f-2d87-4a50-931c-09b26621fea9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:47.151914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c085b8ca-fa54-49e2-9051-d9fd8023df7b req-0f748b0e-d8f6-43f7-9e50-b0ade1596ea1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:47.175271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:47.190730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c085b8ca-fa54-49e2-9051-d9fd8023df7b req-0f748b0e-d8f6-43f7-9e50-b0ade1596ea1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.2466409 Dec 21 03:49:47.211579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:47.218620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:47.223448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Pushing event updated for resources: {'Port': ['ID=ff6421b9-f83c-4f61-a374-b480489375bf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:47.267433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001', 'b078a85f-2d87-4a50-931c-09b26621fea9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:47.296231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:47.386972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:47.448264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c085b8ca-fa54-49e2-9051-d9fd8023df7b req-e06d9734-ddd2-4c24-9e41-b38708080815 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2548456 Dec 21 03:49:47.501144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:47.515710 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:47.724892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c63ac9b-14d1-40a1-a15f-671ae5f2eb49 req-bb92d326-0169-4197-ac08-3f7fd21d3e0f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/bb4f0e15-9be1-4c6e-8512-b8df6c1654c0 HTTP/1.1" status: 200 len: 1817 time: 0.1251857 Dec 21 03:49:47.747450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5043adb5-906f-4df7-9bff-f6e4585f57f3 None None] Provisioning complete for port ff6421b9-f83c-4f61-a374-b480489375bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:47.747928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5043adb5-906f-4df7-9bff-f6e4585f57f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:47.760051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:47.760562 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:47.804384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa9f6e0-5a47-4d09-8d1d-22db2c8de395 req-d49c84c3-a554-48dd-a9a9-a96537892ac7 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:47.812414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa9f6e0-5a47-4d09-8d1d-22db2c8de395 req-d49c84c3-a554-48dd-a9a9-a96537892ac7 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 947 time: 0.1558418 Dec 21 03:49:47.863244 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-9c63ac9b-14d1-40a1-a15f-671ae5f2eb49 req-a6e0489e-d7d7-4e77-9cbe-0710a04b8860 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 21 03:49:47.864614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c63ac9b-14d1-40a1-a15f-671ae5f2eb49 req-a6e0489e-d7d7-4e77-9cbe-0710a04b8860 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/bb4f0e15-9be1-4c6e-8512-b8df6c1654c0 HTTP/1.1" status: 409 len: 341 time: 0.1329007 Dec 21 03:49:47.888749 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:49:45Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:47.895251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa9f6e0-5a47-4d09-8d1d-22db2c8de395 req-81ad840e-1890-4847-851a-33501f2a5872 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815840 Dec 21 03:49:47.942977 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] Checking router: aa3076a7-dfbe-4587-b5a8-fe25629afc18 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:49:47.949827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:47.962788 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] Routers {'aa3076a7-dfbe-4587-b5a8-fe25629afc18'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:47.963853 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:47.970729 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4ad0531-ae9b-422e-a248-aad8fabb111f x-openstack-request-id: req-a4ad0531-ae9b-422e-a248-aad8fabb111f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:47.971067 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:47.971326 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a4ad0531-ae9b-422e-a248-aad8fabb111f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:47.971754 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'status': 'completed', 'code': 200} Dec 21 03:49:47.978500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5043adb5-906f-4df7-9bff-f6e4585f57f3 None None] Port ff6421b9-f83c-4f61-a374-b480489375bf cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:48.094497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:48.120412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:48.145365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20545494-3bc6-42e7-b80a-e4a56b463177 req-6a4f4924-0b56-4685-a803-626aaaa31755 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.149571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20545494-3bc6-42e7-b80a-e4a56b463177 req-6a4f4924-0b56-4685-a803-626aaaa31755 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.0843716 Dec 21 03:49:48.203492 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:48.239646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-7895eb0c-82f5-4336-9fea-f39c690d23a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.242169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-7895eb0c-82f5-4336-9fea-f39c690d23a8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1137 time: 0.2252295 Dec 21 03:49:48.249708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:48.254112 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] Set router aa3076a7-dfbe-4587-b5a8-fe25629afc18 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:48.313452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:48.323299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20545494-3bc6-42e7-b80a-e4a56b463177 req-7d590790-0234-4ab2-bbd2-de59f597c513 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610496 Dec 21 03:49:48.344762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.352003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.359625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.366867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.375604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.384016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.395013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.397668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-715e5669-12c7-4dba-a486-e66df4b0826f req-c24857d4-1694-4815-9441-09c58eb83e1f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.1985600 Dec 21 03:49:48.444562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Deleting port 08d81f05-279a-4e14-ac86-e5e708e73032 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:48.444907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:48.487942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-3ec2666b-991b-4312-ac57-11eed94c9c1b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.490057 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-3ec2666b-991b-4312-ac57-11eed94c9c1b tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.2061684 Dec 21 03:49:48.514892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-715e5669-12c7-4dba-a486-e66df4b0826f req-6266e844-cd00-4913-8650-75d897679c5d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1093321 Dec 21 03:49:48.565050 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:49:45Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:48.619656 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15fbdd47-749a-4fc0-afa1-5793200b1a95 None None] The sync data for ids ['aa3076a7-dfbe-4587-b5a8-fe25629afc18'] in n-d-822053-11 is: [{'id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'name': 'tempest-ServersTestBootFromVolume-771579807-router', 'tenant_id': '7fa1b480ce544ae89f56493527b75054', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182'}], 'enable_snat': True}, 'gw_port_id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:44:42Z', 'updated_at': '2021-12-21T03:49:45Z', 'revision_number': 5, 'project_id': '7fa1b480ce544ae89f56493527b75054', 'gw_port': {'id': '08d81f05-279a-4e14-ac86-e5e708e73032', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:4c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa3076a7-dfbe-4587-b5a8-fe25629afc18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:44:45Z', 'updated_at': '2021-12-21T03:44:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:49:48.643880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-4ef9e3b9-6596-4d4b-a2e0-ca0463810390 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.645373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-4ef9e3b9-6596-4d4b-a2e0-ca0463810390 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 913 time: 0.3772442 Dec 21 03:49:48.657825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15844080-a598-4fbd-8baa-8b00e41552c1 req-0010c0c8-f601-469f-858e-4b5c0ad2597b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.659406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15844080-a598-4fbd-8baa-8b00e41552c1 req-0010c0c8-f601-469f-858e-4b5c0ad2597b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.0702271 Dec 21 03:49:48.723283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15844080-a598-4fbd-8baa-8b00e41552c1 req-5b6c6738-39d8-47f4-adc3-c6b599957eff tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518706 Dec 21 03:49:48.726551 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-27bfaa41-8759-4d3a-a120-3a6b7a74057c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 217 time: 0.0721583 Dec 21 03:49:48.772658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] For port 08d81f05-279a-4e14-ac86-e5e708e73032, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=08d81f05-279a-4e14-ac86-e5e708e73032,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:48.773364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:48.851570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb621b2a-2a0e-4732-a456-e9f6fba719e9 req-0d3244d9-6178-44f5-942f-3119124aa5ab tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.853234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb621b2a-2a0e-4732-a456-e9f6fba719e9 req-0d3244d9-6178-44f5-942f-3119124aa5ab tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 985 time: 0.0912545 Dec 21 03:49:48.869589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5a257a-053c-4ad9-9bab-9ed25257cf9e req-ab406724-21b4-42d0-855b-29750cc0295a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:48.871387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac5a257a-053c-4ad9-9bab-9ed25257cf9e req-ab406724-21b4-42d0-855b-29750cc0295a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.0741591 Dec 21 03:49:48.958091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac5a257a-053c-4ad9-9bab-9ed25257cf9e req-e1eb4dd4-6935-4c99-b028-16d0adf561d4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785604 Dec 21 03:49:48.971756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb621b2a-2a0e-4732-a456-e9f6fba719e9 req-2fa0857f-af83-43e1-b70b-8078cbe708bf tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=bb4f0e15-9be1-4c6e-8512-b8df6c1654c0&id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 401 time: 0.1115994 Dec 21 03:49:49.020726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d826c2ac-b9f5-444f-bb74-8ff9a966c08d details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:49.038371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e8f918db-131d-40f7-91ab-86a7099533b5 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:49.135213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Calling delete_port for 08d81f05-279a-4e14-ac86-e5e708e73032 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:49.146874 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.164704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f02a3c0-3508-4f5b-85fc-bdf2e28822a8 req-f78f0b0d-8c19-4551-bb16-e48928d5ffed tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.175634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f02a3c0-3508-4f5b-85fc-bdf2e28822a8 req-f78f0b0d-8c19-4551-bb16-e48928d5ffed tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 947 time: 0.0883188 Dec 21 03:49:49.190576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device feb7c6fe-4296-4b97-bdd3-ef39ffcbadba up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:49.196895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-aefd30fa-279a-4656-836d-8153caea3952 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.198511 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-aefd30fa-279a-4656-836d-8153caea3952 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.4356689 Dec 21 03:49:49.247165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f02a3c0-3508-4f5b-85fc-bdf2e28822a8 req-b7cc053f-9d10-472f-8622-a52a87be5e85 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706589 Dec 21 03:49:49.308563 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-848aee1d-84b7-4ee2-b276-3584432737b1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0475287 Dec 21 03:49:49.312011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.353237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Deleting port ac725df3-7862-483f-82a4-1cc27a3a5efa {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:49.353601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.393729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:49.401046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port e8f918db-131d-40f7-91ab-86a7099533b5 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:49:49.439432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port e8f918db-131d-40f7-91ab-86a7099533b5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:49.440186 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.506893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:49.528475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'port_id': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d', 'mac_address': 'fa:16:3e:48:6a:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d', 'ip_address': '10.1.1.95'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:49.541997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:49.542372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.563643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ec4722-1c83-43dc-8fc7-0834b278227c req-cfa7a227-a3fa-4034-9e6e-6a91fa47a091 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.566171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ec4722-1c83-43dc-8fc7-0834b278227c req-cfa7a227-a3fa-4034-9e6e-6a91fa47a091 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 944 time: 0.1235592 Dec 21 03:49:49.600049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:49:49.622157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Pushing event updated for resources: {'Port': ['ID=ff6421b9-f83c-4f61-a374-b480489375bf,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:49.637572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:49.637927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.662014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.677276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.697057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ec4722-1c83-43dc-8fc7-0834b278227c req-67b0f25c-7777-463e-b99e-4049a8a583fc tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/security-groups?id=f49e32c9-7ac4-4473-9e8e-3ee032077854&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242049 Dec 21 03:49:49.698185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.719683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d826c2ac-b9f5-444f-bb74-8ff9a966c08d {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:49.757019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8f918db-131d-40f7-91ab-86a7099533b5'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:49.758772 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6fd93e1-dd2e-42df-b314-b8e27d44a2da" -d '{"events": [{"server_uuid": "60ce7efc-44aa-46fb-a6b0-9ce9383f5c00", "name": "network-vif-plugged", "status": "completed", "tag": "e8f918db-131d-40f7-91ab-86a7099533b5"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:49.790033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:49.808498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port e8f918db-131d-40f7-91ab-86a7099533b5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e8f918db-131d-40f7-91ab-86a7099533b5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:49.815022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] For port ac725df3-7862-483f-82a4-1cc27a3a5efa, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac725df3-7862-483f-82a4-1cc27a3a5efa,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:49.815022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.823499 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-9afbebc6-2ddd-4170-a8c0-9fcb1b72cafa service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4584186 Dec 21 03:49:49.837864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-d670afcd-d7f3-43de-b5e0-26a25c44b0fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.845302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-d670afcd-d7f3-43de-b5e0-26a25c44b0fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 814 time: 0.2040575 Dec 21 03:49:49.856575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.861986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-f9c526a1-2ac8-4b78-bd23-75207fa2fa0e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/quotas/20acfa324e9b4279a50bf03610639a83 HTTP/1.1" status: 200 len: 375 time: 0.0157106 Dec 21 03:49:49.875636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7858b624-ab23-47c3-8ea5-3fd3edbec98d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:49.877910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.880509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Calling delete_port for ac725df3-7862-483f-82a4-1cc27a3a5efa owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:49.884247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.886870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.887799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:49.892683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.901251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.907267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.907808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:49.913287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.919339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:49.921830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-13a309de-97e9-4f21-80fa-9d3545bf3772 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5419 time: 0.1425095 Dec 21 03:49:49.946451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7858b624-ab23-47c3-8ea5-3fd3edbec98d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:49.947283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:49.947425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7858b624-ab23-47c3-8ea5-3fd3edbec98d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:49.950364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0f59da5-e7a9-4db4-800c-be8e0493f4d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.952496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:49.989215 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.000175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:50.001090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-e9323c79-1143-40e7-8650-a0eca95769af tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0782619 Dec 21 03:49:50.029917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:50.031993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2621520e-694e-4cf1-8f5a-b54fd0746bdb req-4c2a0977-8999-4b4a-9aee-589407499c09 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0990677 Dec 21 03:49:50.055366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:50.084130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Pushing event deleted for resources: {'Port': ['ID=08d81f05-279a-4e14-ac86-e5e708e73032,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:50.109728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'port_id': '1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3', 'mac_address': 'fa:16:3e:ef:e1:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d', 'ip_address': '10.1.1.198'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:50.111582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.131714 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-931b6470-5a2e-4cc7-a536-576a09394c52 req-b9096d65-ee1a-4cfa-8ea2-7a73f7240615 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2926998 Dec 21 03:49:50.136959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-229b829e-4004-42ca-b63d-9a82403d7ab7 service neutron] 10.222.0.18 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251562 Dec 21 03:49:50.213685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=e8f918db-131d-40f7-91ab-86a7099533b5,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:50.221594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.263875 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-598975f0-7cd3-4775-9b06-530e1fbf9304 x-openstack-request-id: req-598975f0-7cd3-4775-9b06-530e1fbf9304 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:50.263875 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "60ce7efc-44aa-46fb-a6b0-9ce9383f5c00", "name": "network-vif-plugged", "status": "completed", "tag": "e8f918db-131d-40f7-91ab-86a7099533b5", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:50.263875 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-598975f0-7cd3-4775-9b06-530e1fbf9304 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:50.263875 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8f918db-131d-40f7-91ab-86a7099533b5', 'code': 200} Dec 21 03:49:50.271126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:50.285678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1bdac274-fb2e-4ef4-9f31-05c0ab5bad31 service neutron] 10.222.0.18 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1413729 Dec 21 03:49:50.308045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:49:50.363526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:50.381226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:50.385980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-33151012-30f5-472c-a3e4-8ce5e8db2612 None None] Provisioning complete for port ff6421b9-f83c-4f61-a374-b480489375bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:50.386289 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33151012-30f5-472c-a3e4-8ce5e8db2612 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.425047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-33151012-30f5-472c-a3e4-8ce5e8db2612 None None] Port ff6421b9-f83c-4f61-a374-b480489375bf cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:50.427206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.427865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1a539edc-6061-4a94-a9d0-3e97bd54fe56 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:50.434389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.460486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70928710-e3df-4658-8b72-cc5d3deed7c5 req-33064fa1-40c9-432e-8cfd-99c54ee98fe0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:50.468321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70928710-e3df-4658-8b72-cc5d3deed7c5 req-33064fa1-40c9-432e-8cfd-99c54ee98fe0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 985 time: 0.1183245 Dec 21 03:49:50.488781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1011bf91-2604-4ef4-bb38-932e71d56c33 req-f1ad6cca-b18f-477d-8296-2c6865cca623 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:50.490277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1011bf91-2604-4ef4-bb38-932e71d56c33 req-f1ad6cca-b18f-477d-8296-2c6865cca623 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 1100 time: 0.0984442 Dec 21 03:49:50.503137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:50.505719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:50.518664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '1a539edc-6061-4a94-a9d0-3e97bd54fe56', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'port_id': '1a539edc-6061-4a94-a9d0-3e97bd54fe56', 'mac_address': 'fa:16:3e:c0:41:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d', 'ip_address': '10.1.1.34'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:50.561130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70928710-e3df-4658-8b72-cc5d3deed7c5 req-295af142-a7b6-4e01-a900-4faef84cdf85 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=bb4f0e15-9be1-4c6e-8512-b8df6c1654c0&id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 401 time: 0.0872421 Dec 21 03:49:50.582697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-a4750aec-561d-4094-b27e-aed1f8d79720 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:50.586774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.589969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-a4750aec-561d-4094-b27e-aed1f8d79720 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1137 time: 0.2669311 Dec 21 03:49:50.598305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1011bf91-2604-4ef4-bb38-932e71d56c33 req-434c8c03-6d24-4193-9428-ba36232b3e38 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965879 Dec 21 03:49:50.622908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1a539edc-6061-4a94-a9d0-3e97bd54fe56 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:50.657471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:50.669406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.680198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.706042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50efb251-81a9-4d53-a8e5-f89823dc3168 req-a601f0cb-e20d-4864-a941-c5b87aab5108 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:50.715879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50efb251-81a9-4d53-a8e5-f89823dc3168 req-a601f0cb-e20d-4864-a941-c5b87aab5108 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 948 time: 0.0691431 Dec 21 03:49:50.749098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.750207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3a3dc231-a27a-4c00-a859-1a62de02e991 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:50.774957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50efb251-81a9-4d53-a8e5-f89823dc3168 req-44b21749-d299-4b9c-8176-c8a630f8ff29 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580866 Dec 21 03:49:50.835540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:49:50.843651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.851172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-91b410e1-b5df-4c40-b4d0-f15dbad2bac5 admin admin] 10.222.0.18 "PUT /v2.0/routers/d1b7ae4c-e59a-4693-84a5-d0a6f5972720/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.8849041 Dec 21 03:49:50.875078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7cb0db51-fb27-4f5e-af4d-77e517ea9c1a req-4570184c-879d-4f84-82e0-e58695cf3736 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 210 time: 0.0516489 Dec 21 03:49:50.883337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3a3dc231-a27a-4c00-a859-1a62de02e991,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:50.903268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'port_id': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'mac_address': 'fa:16:3e:d6:ce:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:50.903268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Sync routers for ids ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:49:50.917510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event deleted for resources: {'Port': ['ID=ac725df3-7862-483f-82a4-1cc27a3a5efa,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:50.934898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.938077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Fanout notify agent at l3_agent the message router_deleted on router aa3076a7-dfbe-4587-b5a8-fe25629afc18 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:49:50.975950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:50.980150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49960) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:50.999258 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9113b9c3-8ad6-4fcf-9e7e-c3480e869cae admin admin] 10.222.0.18 "DELETE /v2.0/routers/aa3076a7-dfbe-4587-b5a8-fe25629afc18 HTTP/1.1" status: 204 len: 168 time: 3.9220545 Dec 21 03:49:51.002064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.008154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Routers {'d1b7ae4c-e59a-4693-84a5-d0a6f5972720'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:51.010338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:51.048306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-47af47fd-7ec3-4644-8012-bc0b9690c3aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:51.048306 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-47af47fd-7ec3-4644-8012-bc0b9690c3aa service neutron] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 913 time: 0.4024048 Dec 21 03:49:51.048306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] No DVR routers for this DVR port ac725df3-7862-483f-82a4-1cc27a3a5efa on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:51.056230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.059714 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1fda5bfc-21c3-4217-8927-d71519aafb56 req-38dee243-fadd-449d-b11e-eacb7e953b5a tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "DELETE /v2.0/ports/ac725df3-7862-483f-82a4-1cc27a3a5efa HTTP/1.1" status: 204 len: 173 time: 2.5550835 Dec 21 03:49:51.061951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'name': 'network-vif-deleted', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:51.064285 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8da1cf80-3914-4a70-bb52-574f850eddf4" -d '{"events": [{"server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "name": "network-vif-deleted", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:51.127826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3a3dc231-a27a-4c00-a859-1a62de02e991 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:51.142002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:51.145532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-78724325-5ae2-4b58-b013-e3fe2c9b087a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 217 time: 0.0848248 Dec 21 03:49:51.147828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0ca1a05-83df-4fd8-9464-1a039e9516cb req-f1646771-4498-4858-8138-c0e45ce99dff tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4ac8da0-d2f6-4903-86f1-7fae5a381335 HTTP/1.1" status: 200 len: 210 time: 0.0878747 Dec 21 03:49:51.185360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Deleting subnet 48142ae2-dce2-450f-96ff-f72f7dcd96bb {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:49:51.192499 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.231200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8633b529-f6db-4766-9056-d0051f886200 req-721ad81a-a72b-48d6-92c8-1161477d3dfe tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:51.232426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8633b529-f6db-4766-9056-d0051f886200 req-721ad81a-a72b-48d6-92c8-1161477d3dfe tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.31 "GET /v2.0/ports?device_id=e05073c9-8855-4a9f-aef4-53ca21f8fd3d HTTP/1.1" status: 200 len: 945 time: 0.2498059 Dec 21 03:49:51.246984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-1021680c-3f0f-4e85-829a-1420b603d53d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:51.249255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-1021680c-3f0f-4e85-829a-1420b603d53d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.0958686 Dec 21 03:49:51.267378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3a3dc231-a27a-4c00-a859-1a62de02e991,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:51.294753 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-dd3a9fa9-17a5-4b52-8d65-5241ee15356d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0352383 Dec 21 03:49:51.295048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Set router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:51.296042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.351608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.352179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:51.430758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-8cfe8bc4-fbe6-48e4-9ee0-8774397543b0 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262512 Dec 21 03:49:51.442345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:51.472285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e', 'network_id': '48839244-4ebd-4f7e-a6df-11292c1938d9', 'port_id': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e', 'mac_address': 'fa:16:3e:5d:85:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fdb8123e-5581-4093-99c4-63d41dd3436d', 'ip_address': '10.1.1.123'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:51.606381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ff6bcc6b-bbbc-42f8-9516-25ce6cd6c49c req-c252b6b2-4d44-4bf2-8046-790fa53ca45a service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1655667 Dec 21 03:49:51.649515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.659920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:51.702910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.727856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Deleting port da821d06-09e0-4580-a540-b604a6a13c16 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:51.728469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.732490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:51.758221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:51.767726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:49:47Z', 'revision_number': 4, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff6421b9-f83c-4f61-a374-b480489375bf', 'name': '', 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'mac_address': 'fa:16:3e:be:24:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_interface', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': '980e5c6c-efca-4c8e-9554-34f78b220c78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:46Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 2, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'subnets': [{'id': '980e5c6c-efca-4c8e-9554-34f78b220c78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:51.773207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-75a2c1b7-9d37-4f93-b565-8b9f17597097 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3595254 Dec 21 03:49:51.800959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Checking router: d1b7ae4c-e59a-4693-84a5-d0a6f5972720 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:49:51.801329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Updating router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 port ff6421b9-f83c-4f61-a374-b480489375bf binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:49:51.819337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:51.828276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.865075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] For port da821d06-09e0-4580-a540-b604a6a13c16, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da821d06-09e0-4580-a540-b604a6a13c16,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:51.865442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.877926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Calling delete_port for da821d06-09e0-4580-a540-b604a6a13c16 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:51.927862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.936905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.938324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:51.963572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=48142ae2-dce2-450f-96ff-f72f7dcd96bb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:51.973905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:51.979896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50004) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:51.980107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-27e01b43-e2d0-4a0c-8984-7aadc005c31d admin admin] 10.222.0.18 "DELETE /v2.0/subnets/48142ae2-dce2-450f-96ff-f72f7dcd96bb HTTP/1.1" status: 204 len: 168 time: 0.9985223 Dec 21 03:49:51.983632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.018364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6216f826-d534-47a6-bf41-5820b47d5400 None None] Network 1413c5b2-d3e7-46e6-af39-45068f2d8ddd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:49:52.113100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.179684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:52.190415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.199708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Deleting port ef6bc27d-9833-430f-8730-fa885dc7971b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:52.200360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.234606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.274397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Pushing event deleted for resources: {'Port': ['ID=da821d06-09e0-4580-a540-b604a6a13c16,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:52.304462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] For port ef6bc27d-9833-430f-8730-fa885dc7971b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ef6bc27d-9833-430f-8730-fa885dc7971b,segment=NetworkSegment(4d133d37-f925-4e60-b2a4-eec93a137782),segment_id=4d133d37-f925-4e60-b2a4-eec93a137782)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:52.309143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.327201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Calling delete_port for ef6bc27d-9833-430f-8730-fa885dc7971b owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:52.370319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] No DVR routers for this DVR port da821d06-09e0-4580-a540-b604a6a13c16 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:52.377198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.383937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8633b529-f6db-4766-9056-d0051f886200 req-f195b0ab-2935-4ef3-9b53-44b5f547a0cb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.31 "DELETE /v2.0/ports/da821d06-09e0-4580-a540-b604a6a13c16 HTTP/1.1" status: 204 len: 173 time: 1.1333730 Dec 21 03:49:52.383937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-deleted', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:52.384752 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ad0e151-1f0f-4f3a-85fc-99998f10ff14" -d '{"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-deleted", "tag": "da821d06-09e0-4580-a540-b604a6a13c16"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:52.421499 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ef3bbaa-dc44-4d0f-8e3a-99cf5215e969 x-openstack-request-id: req-9ef3bbaa-dc44-4d0f-8e3a-99cf5215e969 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:52.421774 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4ac8da0-d2f6-4903-86f1-7fae5a381335", "name": "network-vif-deleted", "tag": "ac725df3-7862-483f-82a4-1cc27a3a5efa", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:52.422037 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9ef3bbaa-dc44-4d0f-8e3a-99cf5215e969 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:52.422445 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4ac8da0-d2f6-4903-86f1-7fae5a381335', 'name': 'network-vif-deleted', 'tag': 'ac725df3-7862-483f-82a4-1cc27a3a5efa', 'status': 'completed', 'code': 200} Dec 21 03:49:52.427205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Allocated IP 172.25.5.25 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/90e34b11-747a-428c-a783-5bf373f849cb) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:52.465519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:52.468379 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0c62e8e-7079-4d94-9241-a606649af3a9" -d '{"events": [{"server_uuid": "f2df3f34-9f1a-40f7-828d-f6264abfbb19", "name": "network-vif-plugged", "status": "completed", "tag": "feb7c6fe-4296-4b97-bdd3-ef39ffcbadba"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:52.493038 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-04a72670-494f-46a7-829f-4699fb2ed61a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.562134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.565262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.571628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.576321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:52.579046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.581490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.585683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.591424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.602413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5', 'network_id': '19393033-2861-465d-ab20-b8ec53781acb', 'port_id': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5', 'mac_address': 'fa:16:3e:5f:b2:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8e39c1be-57b7-471e-a252-0b9469588d52', 'ip_address': '10.2.2.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:52.606478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:52.619628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57b89625-d701-4760-8dc5-c7a041c5292d req-d80b2cf9-5637-43c0-aa6e-850b8bb668a4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5424 time: 0.1783273 Dec 21 03:49:52.620615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Pushing event deleted for resources: {'Port': ['ID=ef6bc27d-9833-430f-8730-fa885dc7971b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:52.622518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] No DVR routers for this DVR port ef6bc27d-9833-430f-8730-fa885dc7971b on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:52.656798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.664790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bb203aa-0be6-4da5-8877-f4d26acdac2f None None] DHCP port deletion for 1413c5b2-d3e7-46e6-af39-45068f2d8ddd request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:49:52.695626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.697758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.713361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:52.734962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:52.744486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.747456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.766558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1413c5b2-d3e7-46e6-af39-45068f2d8ddd']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:52.769467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57b89625-d701-4760-8dc5-c7a041c5292d req-ea3fa60e-55a6-457f-a94c-009921d96952 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1399748 Dec 21 03:49:52.776331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4d133d37-f925-4e60-b2a4-eec93a137782') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:52.776633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4d133d37-f925-4e60-b2a4-eec93a137782') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:52.796296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.796485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.820218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.836904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Releasing vlan 131 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:49:52.837314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:49:52.839191 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:49:52.842426 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:49:52.856276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.856925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3136aa12-8de7-43c2-8cde-55879999fd27 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:52.876404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a38d7a8-d5d5-426e-a460-e8f6b32bde17 None None] Pushing event updated for resources: {'Port': ['ID=ff6421b9-f83c-4f61-a374-b480489375bf,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:52.919292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.960293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Attempting to bind port ff6421b9-f83c-4f61-a374-b480489375bf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:52.961333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Attempting to bind port ff6421b9-f83c-4f61-a374-b480489375bf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:52.961861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Attempting to bind port ff6421b9-f83c-4f61-a374-b480489375bf on network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:52.988551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.989549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3136aa12-8de7-43c2-8cde-55879999fd27,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:52.993572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:52.993572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=90e34b11-747a-428c-a783-5bf373f849cb,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:52.993793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:52.994084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Checking segment: {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:52.994410 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:52.994894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Bound using segment: {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:52.995297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Bound port: ff6421b9-f83c-4f61-a374-b480489375bf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fad4816d-65f0-4062-ab9b-67c169c7b23c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:52.995682 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.003929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.007275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:53.007526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:53.019661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:53.020400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '3136aa12-8de7-43c2-8cde-55879999fd27', 'network_id': '19393033-2861-465d-ab20-b8ec53781acb', 'port_id': '3136aa12-8de7-43c2-8cde-55879999fd27', 'mac_address': 'fa:16:3e:6a:e0:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8e39c1be-57b7-471e-a252-0b9469588d52', 'ip_address': '10.2.2.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:53.022834 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] 10.222.0.18 "DELETE /v2.0/networks/1413c5b2-d3e7-46e6-af39-45068f2d8ddd HTTP/1.1" status: 204 len: 168 time: 1.0407665 Dec 21 03:49:53.034978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe83e9b0-6ef5-4629-8836-c0c37ca42475 req-882b60b2-56ae-4e28-911e-0255979cec3e tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:53.037373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-892260d6-e428-474f-acec-2ffb7a66d784 admin admin] Pushing event deleted for resources: {'Network': ['ID=1413c5b2-d3e7-46e6-af39-45068f2d8ddd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:53.038325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe83e9b0-6ef5-4629-8836-c0c37ca42475 req-882b60b2-56ae-4e28-911e-0255979cec3e tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 985 time: 0.1673026 Dec 21 03:49:53.133188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.153088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] For port ff6421b9-f83c-4f61-a374-b480489375bf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:53.156002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3136aa12-8de7-43c2-8cde-55879999fd27 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:53.162396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe83e9b0-6ef5-4629-8836-c0c37ca42475 req-6d59fd89-8a44-4421-82d6-1c6c1b2a432d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=bb4f0e15-9be1-4c6e-8512-b8df6c1654c0&id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 401 time: 0.1010725 Dec 21 03:49:53.185531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.193122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] For port ff6421b9-f83c-4f61-a374-b480489375bf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff6421b9-f83c-4f61-a374-b480489375bf,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:53.198610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:53.226737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3136aa12-8de7-43c2-8cde-55879999fd27,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:53.228439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-235ba316-513e-4b09-b86b-99209e1df0b9 None None] Provisioning complete for port ff6421b9-f83c-4f61-a374-b480489375bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:53.228812 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-235ba316-513e-4b09-b86b-99209e1df0b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.255213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 08d81f05-279a-4e14-ac86-e5e708e73032 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:53.257235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: da821d06-09e0-4580-a540-b604a6a13c16 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:53.257563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da821d06-09e0-4580-a540-b604a6a13c16 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:53.264346 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.266132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.308789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee6894a-c41b-4bea-9da9-9aea90b9d357 req-737af4a3-8712-4275-a142-c7900b477f84 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:53.310319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ee6894a-c41b-4bea-9da9-9aea90b9d357 req-737af4a3-8712-4275-a142-c7900b477f84 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 948 time: 0.0752947 Dec 21 03:49:53.311138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.316892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 08d81f05-279a-4e14-ac86-e5e708e73032 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:53.317243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 08d81f05-279a-4e14-ac86-e5e708e73032 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:53.317659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ef6bc27d-9833-430f-8730-fa885dc7971b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:53.350511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ef6bc27d-9833-430f-8730-fa885dc7971b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:53.350873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ef6bc27d-9833-430f-8730-fa885dc7971b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:53.352120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-235ba316-513e-4b09-b86b-99209e1df0b9 None None] Port ff6421b9-f83c-4f61-a374-b480489375bf cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:49:53.358775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.396497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a38d7a8-d5d5-426e-a460-e8f6b32bde17 None None] Pushing event updated for resources: {'Port': ['ID=ff6421b9-f83c-4f61-a374-b480489375bf,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:53.406024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Routers {'d1b7ae4c-e59a-4693-84a5-d0a6f5972720'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:49:53.406869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:53.502704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50022) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:53.539425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:53.597250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] Set router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:49:53.613588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-045303bc-7fc8-4513-ba28-7a1307350234 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7fa1b480ce544ae89f56493527b75054&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1090438 Dec 21 03:49:53.614315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50024) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:53.707933 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:49:53.725076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0d0e41df-38a9-455d-a78b-5d25b0a14dc1 None None] Provisioning complete for port ff6421b9-f83c-4f61-a374-b480489375bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:53.725453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d0e41df-38a9-455d-a78b-5d25b0a14dc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.746127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-373b1489-4022-47bb-b83d-60b98d22cf9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.791885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-373b1489-4022-47bb-b83d-60b98d22cf9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.807742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-267e2005-9638-4e01-8061-28c8f4e05adf tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:53.809661 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-267e2005-9638-4e01-8061-28c8f4e05adf tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 814 time: 0.1579983 Dec 21 03:49:53.842082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Request body: {'port': {'device_id': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'admin_state_up': True, 'tenant_id': '20acfa324e9b4279a50bf03610639a83'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:53.847650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.857544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ee6894a-c41b-4bea-9da9-9aea90b9d357 req-a7cad5b2-6190-442d-9a3d-e14b824f107a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5007565 Dec 21 03:49:53.942526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:53.979589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d0e41df-38a9-455d-a78b-5d25b0a14dc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.027306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0d0e41df-38a9-455d-a78b-5d25b0a14dc1 None None] For port ff6421b9-f83c-4f61-a374-b480489375bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff6421b9-f83c-4f61-a374-b480489375bf,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:54.027828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-373b1489-4022-47bb-b83d-60b98d22cf9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.030624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-373b1489-4022-47bb-b83d-60b98d22cf9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.032090 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-373b1489-4022-47bb-b83d-60b98d22cf9c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3c9fdf78-55d2-4298-bf4d-4e47b82966b1 HTTP/1.1" status: 204 len: 168 time: 0.4167404 Dec 21 03:49:54.040226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:49:47Z', 'revision_number': 4, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff6421b9-f83c-4f61-a374-b480489375bf', 'name': '', 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'mac_address': 'fa:16:3e:be:24:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_interface', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': '980e5c6c-efca-4c8e-9554-34f78b220c78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:46Z', 'updated_at': '2021-12-21T03:49:53Z', 'revision_number': 4, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'subnets': [{'id': '980e5c6c-efca-4c8e-9554-34f78b220c78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:49:54.048815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-373b1489-4022-47bb-b83d-60b98d22cf9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c9fdf78-55d2-4298-bf4d-4e47b82966b1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:54.057189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae9b356d-2dc7-4275-8840-d7f4057851f2 req-a1a62e95-c7fa-430c-897b-985956e7c9aa tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 210 time: 0.0453684 Dec 21 03:49:54.067783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=90e34b11-747a-428c-a783-5bf373f849cb,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:54.080414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.082103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1333090-67dd-4547-a0a1-5181d5b1a648 None None] The sync data for ids ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'] in n-d-822053-11 is: [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:49:47Z', 'revision_number': 4, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff6421b9-f83c-4f61-a374-b480489375bf', 'name': '', 'network_id': '243dd4d9-cd73-4cd5-a1b2-67566e390a56', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'mac_address': 'fa:16:3e:be:24:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_interface', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': '980e5c6c-efca-4c8e-9554-34f78b220c78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:46Z', 'updated_at': '2021-12-21T03:49:53Z', 'revision_number': 4, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'subnets': [{'id': '980e5c6c-efca-4c8e-9554-34f78b220c78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:49:54.113460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Made reservation on behalf of 20acfa324e9b4279a50bf03610639a83 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:54.124762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.153374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d0e41df-38a9-455d-a78b-5d25b0a14dc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.223199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0e41df-38a9-455d-a78b-5d25b0a14dc1 None None] Pushing event updated for resources: {'Port': ['ID=ff6421b9-f83c-4f61-a374-b480489375bf,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:54.229375 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.230549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-130a488f-ddfc-4236-ac94-fdcd16e9ce10 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 2.4252291 Dec 21 03:49:54.313799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-d6aac8b9-9dab-47c7-9346-8b87803043d3 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.25 HTTP/1.1" status: 200 len: 695 time: 0.0769773 Dec 21 03:49:54.329055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Allocated IP 172.20.0.14 (24735258-b5ad-42e8-a231-667c1278689e/da10d7f0-623a-4e8a-b5fc-286a12beadcd/90696376-ba84-4217-a845-b149d216aace) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:54.448750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-0a03782a-3fac-48f4-9731-ac14a1ee29a3 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.456500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f96fdbc-7fb0-4ef4-b851-5b30a7348d40 req-0a03782a-3fac-48f4-9731-ac14a1ee29a3 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1361074 Dec 21 03:49:54.499110 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42a7791e-9286-41d7-ad08-a5c5806424c8 x-openstack-request-id: req-42a7791e-9286-41d7-ad08-a5c5806424c8 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:54.499552 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e05073c9-8855-4a9f-aef4-53ca21f8fd3d", "name": "network-vif-deleted", "tag": "da821d06-09e0-4580-a540-b604a6a13c16", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:54.500179 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-42a7791e-9286-41d7-ad08-a5c5806424c8 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:54.500845 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e05073c9-8855-4a9f-aef4-53ca21f8fd3d', 'name': 'network-vif-deleted', 'tag': 'da821d06-09e0-4580-a540-b604a6a13c16', 'status': 'completed', 'code': 200} Dec 21 03:49:54.540494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.544406 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03e7de07-2d25-4c49-bd98-e513db978c5f x-openstack-request-id: req-03e7de07-2d25-4c49-bd98-e513db978c5f {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:54.544886 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f2df3f34-9f1a-40f7-828d-f6264abfbb19", "name": "network-vif-plugged", "status": "completed", "tag": "feb7c6fe-4296-4b97-bdd3-ef39ffcbadba", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:54.545000 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-03e7de07-2d25-4c49-bd98-e513db978c5f {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:54.545908 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba', 'code': 200} Dec 21 03:49:54.682426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.707362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.749023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Network 24735258-b5ad-42e8-a231-667c1278689e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:54.752149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:54.757415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:54.764343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:54.767761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9db2204e-2084-4204-a164-ea484bf5e672 req-d2f7a049-44ff-475e-89fd-fccfc94ee002 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-783010139&fields=id&tenant_id=0c51448e6fcd494e8c92714cc6e79d52 HTTP/1.1" status: 200 len: 267 time: 0.1358964 Dec 21 03:49:54.819656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.820291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.847357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145c3b20-d1db-4772-a790-67d1fa925084 req-9f53ed76-c7f8-4615-b213-d00acbae6c62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.848895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145c3b20-d1db-4772-a790-67d1fa925084 req-9f53ed76-c7f8-4615-b213-d00acbae6c62 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 1102 time: 0.1739531 Dec 21 03:49:54.894336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.900444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.907831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.914029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-1dcd01c6-30fb-4ae8-afc1-f995cc65da3e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0771933 Dec 21 03:49:54.916288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.922999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.929131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.935159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.936238 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:54.937156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-b6facba8-6768-4793-bb01-b457ffd95ff7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5426 time: 0.1931920 Dec 21 03:49:54.943147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Request body: {'port': {'device_id': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:54.956359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db2204e-2084-4204-a164-ea484bf5e672 req-dbc53746-71c0-4c92-87f3-55ed9babaf22 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:54.957925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9db2204e-2084-4204-a164-ea484bf5e672 req-dbc53746-71c0-4c92-87f3-55ed9babaf22 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 985 time: 0.1630611 Dec 21 03:49:54.989574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'port': {'security_groups': ['81a36cae-1a32-4478-b646-000893538e6f', 'bb4f0e15-9be1-4c6e-8512-b8df6c1654c0', '4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:54.990151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d826c2ac-b9f5-444f-bb74-8ff9a966c08d'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.038693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['1a539edc-6061-4a94-a9d0-3e97bd54fe56'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.061748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145c3b20-d1db-4772-a790-67d1fa925084 req-6fd87425-40d7-42e0-90f8-5c32f7983dac service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2045159 Dec 21 03:49:55.066698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.091702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.124121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.131214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d680dc99-6c47-43cd-8684-09f1a6d68c81 req-84229641-8f90-4373-9409-9bd4d497c8d6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1722679 Dec 21 03:49:55.133846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['8288eff7-b10c-4c94-a0c7-0e3894ee03f5'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.172767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.274620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['3a3dc231-a27a-4c00-a859-1a62de02e991'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.277105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['3136aa12-8de7-43c2-8cde-55879999fd27'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.358895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff6421b9-f83c-4f61-a374-b480489375bf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:55.421286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed38a0c5-5c90-4d63-b601-ec4d5cc20409 req-e0242d29-2fa9-4525-9dbf-21f20ebfe822 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:55.428797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed38a0c5-5c90-4d63-b601-ec4d5cc20409 req-e0242d29-2fa9-4525-9dbf-21f20ebfe822 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 950 time: 0.1197658 Dec 21 03:49:55.534632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed38a0c5-5c90-4d63-b601-ec4d5cc20409 req-6a6cbf50-25d5-4769-9ca0-adc8e1d28693 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048944 Dec 21 03:49:55.616682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:55.644435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:55.645288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 90696376-ba84-4217-a845-b149d216aace {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:55.656302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50066) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:55.668821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.674815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.690020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: ac725df3-7862-483f-82a4-1cc27a3a5efa {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:49:55.690478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac725df3-7862-483f-82a4-1cc27a3a5efa not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:49:55.691047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:49:55.697016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Transition to ACTIVE for port object 90696376-ba84-4217-a845-b149d216aace will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:49:55.759099 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.787527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:55.789470 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.797819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Request body: {'network': {'name': 'tempest-ServersTestFqdnHostnames-598268614-network', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:55.801605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9db2204e-2084-4204-a164-ea484bf5e672 req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "PUT /v2.0/ports/b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 1021 time: 0.8263881 Dec 21 03:49:55.802770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.812483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001', 'b078a85f-2d87-4a50-931c-09b26621fea9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:55.829581 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.875024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:55.955986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19628b0-5e2d-47e4-9d15-5b59b5597bc7 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:55.957433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Made reservation on behalf of e8135ee47f84444cb5d3eb45b6c7590b for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:55.960059 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:55.980325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.008268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-3d1d8857-4517-4920-8c49-74b60740c0d6 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.1653852 Dec 21 03:49:56.013594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:56.021091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Attempting to bind port 90696376-ba84-4217-a845-b149d216aace on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:56.021528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Attempting to bind port 90696376-ba84-4217-a845-b149d216aace by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:56.021941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Attempting to bind port 90696376-ba84-4217-a845-b149d216aace on network 24735258-b5ad-42e8-a231-667c1278689e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:56.031174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Port 90696376-ba84-4217-a845-b149d216aace on network 24735258-b5ad-42e8-a231-667c1278689e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:49:56.031174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Attempting to bind port 90696376-ba84-4217-a845-b149d216aace on network 24735258-b5ad-42e8-a231-667c1278689e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:56.043593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:56.045866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Checking segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:56.045866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Bound using segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:56.045866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Bound port: 90696376-ba84-4217-a845-b149d216aace, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:56.045866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.102687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ff6421b9-f83c-4f61-a374-b480489375bf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:56.103870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.153039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.162758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:56.177756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.181840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:56.228774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b078a85f-2d87-4a50-931c-09b26621fea9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:49:56.242630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.248490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-f340574c-a4aa-4e7a-ab64-d096dc36f1d2 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:56.254966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-f340574c-a4aa-4e7a-ab64-d096dc36f1d2 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.1795337 Dec 21 03:49:56.268494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:49:56.273134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-90dde4c1-8bc4-4e65-832b-261b44ef46ed tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/quotas/597df5e2769740859ecb4f30e4aefff3 HTTP/1.1" status: 200 len: 375 time: 0.0172167 Dec 21 03:49:56.281136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.344041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-bf2ae5f8-a328-46f4-972d-e6f16cb4c0a7 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0699410 Dec 21 03:49:56.355953 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.356198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.503224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:56.505641 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-866de82c-5c22-455a-bdbd-3aa259314ff7" -d '{"events": [{"name": "network-changed", "server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:56.529050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0aab2e7b-36d9-41cd-8d55-0a05d2ce8075 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1748228 Dec 21 03:49:56.554563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Allocated IP 172.25.5.58 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/7e173c08-659d-4b40-8a4c-d091072e6f35) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:56.559423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:56.562277 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4fa3513-a1e4-44e1-ae38-b1923136af70" -d '{"events": [{"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-unplugged", "status": "completed", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:56.625318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:56.644763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9834ffae-bcf9-49f9-b3df-a2c4adf5359f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:56.647931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.648398 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Added segment d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3 of type vlan for network 38668209-04ad-4602-a5aa-ab7bc4e1b781 Dec 21 03:49:56.697419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:56.698180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.699699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] 10.222.0.54 "PUT /v2.0/ports/90696376-ba84-4217-a845-b149d216aace HTTP/1.1" status: 200 len: 1093 time: 1.7622283 Dec 21 03:49:56.700359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'tag': '90696376-ba84-4217-a845-b149d216aace'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:49:56.703380 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5" -d '{"events": [{"name": "network-changed", "server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "tag": "90696376-ba84-4217-a845-b149d216aace"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:49:56.730995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.733248 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.735285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-820bf75e-6185-40ea-b438-383be7a03226 service neutron] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:56.784782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-6816f023-42b8-4c32-8a3d-2a3e5475bc86 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2326798 Dec 21 03:49:56.798273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-29c05b37-92a6-4cd0-996c-011b10edccf8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:56.799805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-29c05b37-92a6-4cd0-996c-011b10edccf8 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 944 time: 0.1169400 Dec 21 03:49:56.830846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.832548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.836466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:56.836466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:56.888017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:56.931379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] Pushing event updated for resources: {'Network': ['ID=38668209-04ad-4602-a5aa-ab7bc4e1b781,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:56.947977 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c0b4d737-1de3-4ab7-ba8c-07c8778ffc4e admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.2905707 Dec 21 03:49:56.953730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50094) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:56.962279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Request body: {'subnet': {'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestFqdnHostnames-598268614-subnet', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:56.964877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:49:56.973085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-0c6f0dbf-a5c2-4d76-843e-1a39a515c112 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:56.975671 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-0c6f0dbf-a5c2-4d76-843e-1a39a515c112 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 1096 time: 0.1087723 Dec 21 03:49:56.987717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Deleting port c312fda9-2565-4637-8907-d38449a7ab27 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:56.988757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.035794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.084399 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-d4dd688d-966e-493f-a059-6a65a161ce5c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=90696376-ba84-4217-a845-b149d216aace HTTP/1.1" status: 200 len: 217 time: 0.0795310 Dec 21 03:49:57.102580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Made reservation on behalf of e8135ee47f84444cb5d3eb45b6c7590b for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:49:57.106452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.148145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:57.207168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:57.209883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=7e173c08-659d-4b40-8a4c-d091072e6f35,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:57.216627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:57.316550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-6d622e84-0b88-407a-bf26-6a6de360e83f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:57.318535 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-6d622e84-0b88-407a-bf26-6a6de360e83f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 200 len: 854 time: 0.1174259 Dec 21 03:49:57.324974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090386cf-a6a4-46af-a87c-51d1992e1ee4 req-b8e65998-c3fd-43eb-b44f-5ddeacc7bbe7 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:57.327146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-090386cf-a6a4-46af-a87c-51d1992e1ee4 req-b8e65998-c3fd-43eb-b44f-5ddeacc7bbe7 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 944 time: 0.2377748 Dec 21 03:49:57.340035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-8c1aed17-e820-4607-8df5-7d60b262d12e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:57.341798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-8c1aed17-e820-4607-8df5-7d60b262d12e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.54 "GET /v2.0/ports?device_id=5b7fbfb2-861d-44be-9361-0849ea092d24 HTTP/1.1" status: 200 len: 943 time: 0.1924403 Dec 21 03:49:57.344494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] For port c312fda9-2565-4637-8907-d38449a7ab27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c312fda9-2565-4637-8907-d38449a7ab27,segment=NetworkSegment(6d9290ab-2323-4925-8697-d275634cc5ec),segment_id=6d9290ab-2323-4925-8697-d275634cc5ec)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:57.344935 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.378214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-35ef9ca9-5367-4593-b54a-ddd320bc7a26 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=24735258-b5ad-42e8-a231-667c1278689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0474412 Dec 21 03:49:57.425796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Calling delete_port for c312fda9-2565-4637-8907-d38449a7ab27 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:57.486686 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-8e074506-b4e5-45a4-b472-7a3840231e9e service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990498 Dec 21 03:49:57.540603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.547234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-090386cf-a6a4-46af-a87c-51d1992e1ee4 req-e697a35e-bdbf-48b5-8b53-465e237df36a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1992149 Dec 21 03:49:57.636372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.669320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5c312bf8-c5bc-4cc1-b578-54a2e8b9046c req-930e0651-cfe6-4c49-b68f-c2da17f76c03 service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1553669 Dec 21 03:49:57.675751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Deleting port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:49:57.676090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.702239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Pushing event updated for resources: {'Subnet': ['ID=2f0e0720-c89e-4a8a-888b-1e146411b74a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:57.710898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Checking segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:57.711383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Network hostable DHCP agents. Network: 38668209-04ad-4602-a5aa-ab7bc4e1b781, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:49:57.722216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79b9e75d-a5e2-4b20-b001-63a1dfb0ea7b req-8d8bec68-cc7e-4cc0-93ce-23b701352f2c tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25 HTTP/1.1" status: 200 len: 1817 time: 0.1415026 Dec 21 03:49:57.738484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.804506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:49:57.815896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.877504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Pushing event deleted for resources: {'Port': ['ID=c312fda9-2565-4637-8907-d38449a7ab27,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:57.901849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 38668209-04ad-4602-a5aa-ab7bc4e1b781) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:57.906599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:57.907447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.927606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] For port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:57.927988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.970203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] No DVR routers for this DVR port c312fda9-2565-4637-8907-d38449a7ab27 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:57.971988 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-79b9e75d-a5e2-4b20-b001-63a1dfb0ea7b req-1bd11eae-da42-4332-a782-fe9338a5dbd5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 21 03:49:57.973048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79b9e75d-a5e2-4b20-b001-63a1dfb0ea7b req-1bd11eae-da42-4332-a782-fe9338a5dbd5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25 HTTP/1.1" status: 409 len: 341 time: 0.2386127 Dec 21 03:49:57.974009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Calling delete_port for 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:49:57.976594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:57.981587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c68e2cd-9fd4-40a5-a7ff-9335b0674856 req-75e4ecda-9364-4731-8b5f-a70074df35c7 tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.54 "DELETE /v2.0/ports/c312fda9-2565-4637-8907-d38449a7ab27 HTTP/1.1" status: 204 len: 173 time: 1.1280975 Dec 21 03:49:58.032594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2bcfe68-a93e-448a-842e-8174620db1fd admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.0750480 Dec 21 03:49:58.032964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50108) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:49:58.037175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Request body: {'router': {'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:58.043802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68682593-df1c-4c9a-a5bd-18d85b9e6718 None None] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:49:58.118959 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.120344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.183987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.184235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-38668209-04ad-4602-a5aa-ab7bc4e1b781', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:49:58.185111 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.340260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Allocated IP 172.20.0.2 (38668209-04ad-4602-a5aa-ab7bc4e1b781/2f0e0720-c89e-4a8a-888b-1e146411b74a/e89d64be-3c0f-4397-b660-e4f7f387730c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:58.368142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-090b1f3c-9519-42ff-9a41-a4ebec4c5cb4 req-8f8db456-44d3-4e53-9983-8066534b107f tempest-LiveAutoBlockMigrationV225Test-1701324662 tempest-LiveAutoBlockMigrationV225Test-1701324662-project] 10.222.0.18 "GET /v2.0/ports?device_id=78468d9f-ac52-47b6-abd4-3f344da42e28 HTTP/1.1" status: 200 len: 210 time: 0.3032882 Dec 21 03:49:58.421319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.434509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.510672 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.539822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.546519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.552553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.560058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.565731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.571731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.577728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:58.579792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-eb42d367-1236-49ed-8969-7b32a29176a2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5426 time: 0.1101494 Dec 21 03:49:58.584489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.648554 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.694145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.702755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=7e173c08-659d-4b40-8a4c-d091072e6f35,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:58.708043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:58.711450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:58.718785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:58.729461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Pushing event updated for resources: {'Port': ['ID=e89d64be-3c0f-4397-b660-e4f7f387730c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:58.769869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event deleted for resources: {'Port': ['ID=2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:58.771226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.783889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3eab39a-45cb-430d-8962-abf0cbae54c7 req-31d18ab4-ffcb-4af9-8050-9e727ad5ae5a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1958861 Dec 21 03:49:58.793951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Attempting to bind port e89d64be-3c0f-4397-b660-e4f7f387730c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:49:58.796019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Attempting to bind port e89d64be-3c0f-4397-b660-e4f7f387730c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:49:58.798288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Attempting to bind port e89d64be-3c0f-4397-b660-e4f7f387730c on network 38668209-04ad-4602-a5aa-ab7bc4e1b781 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:49:58.801910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.808307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:49:58.808699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Checking segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:49:58.809156 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.809319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.809565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Bound using segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:49:58.810044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Bound port: e89d64be-3c0f-4397-b660-e4f7f387730c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:49:58.810433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.832908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] No DVR routers for this DVR port 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:49:58.835554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.838984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1683e4d4-af2f-410a-ab6d-c48712d5be09 req-3b1a86e2-afc7-4e87-81a2-47845ba48c1d tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.54 "DELETE /v2.0/ports/2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd HTTP/1.1" status: 204 len: 173 time: 1.4834232 Dec 21 03:49:58.862548 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07ab7a96-2ff5-414e-8783-1f9bd807981b x-openstack-request-id: req-07ab7a96-2ff5-414e-8783-1f9bd807981b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:58.862916 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:58.863275 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-07ab7a96-2ff5-414e-8783-1f9bd807981b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:58.863804 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'status': 'completed', 'code': 200} Dec 21 03:49:58.877306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] For port e89d64be-3c0f-4397-b660-e4f7f387730c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:49:58.883157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] For port e89d64be-3c0f-4397-b660-e4f7f387730c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e89d64be-3c0f-4397-b660-e4f7f387730c,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:49:58.952511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Allocated IP 172.25.5.185 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/4459081b-f094-4195-870e-e1e6744c65ca) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:49:58.978123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:58.979363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-0f565104-28a8-4e36-9870-76e98b12cbea tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 2.9701793 Dec 21 03:49:58.987793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:59.070383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dae59cf-f8fe-4b76-8d89-875d4bfe6c9f None None] Pushing event updated for resources: {'Port': ['ID=e89d64be-3c0f-4397-b660-e4f7f387730c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:59.075804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:59.080328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-52056eb1-f0ad-4306-bed1-40ce43a45a4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.087533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-52056eb1-f0ad-4306-bed1-40ce43a45a4d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1176 time: 0.1612794 Dec 21 03:49:59.118788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-72602484-b978-420a-8615-00a9e0c05bbd tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.58 HTTP/1.1" status: 200 len: 695 time: 0.1208129 Dec 21 03:49:59.128410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08210ff1-49d2-4434-9cde-7568eedeff90 req-0d4d89f3-9270-4697-808b-07bd8c0533b2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.129890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08210ff1-49d2-4434-9cde-7568eedeff90 req-0d4d89f3-9270-4697-808b-07bd8c0533b2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 950 time: 0.2156775 Dec 21 03:49:59.176412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:59.222035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:49:59.227036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:49:59.236947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:49:59.244256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Pushing event updated for resources: {'Port': ['ID=4459081b-f094-4195-870e-e1e6744c65ca,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:49:59.364945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08210ff1-49d2-4434-9cde-7568eedeff90 req-055eaef8-e150-42d0-a1ad-2caa9d6f25f3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2232192 Dec 21 03:49:59.403176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-f9f74524-25b6-4fd1-ad4b-c57208f3df45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.403176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-f9f74524-25b6-4fd1-ad4b-c57208f3df45 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 200 len: 913 time: 0.2836149 Dec 21 03:49:59.403176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-6e471b33-6e76-4379-b4c2-21a25ec57061 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.403176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b277d1a5-ea26-485f-9c3e-44c41208d982 req-6e471b33-6e76-4379-b4c2-21a25ec57061 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2660539 Dec 21 03:49:59.431825 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0f5ba27-ceea-4472-967c-a0ca16eff5a9 x-openstack-request-id: req-e0f5ba27-ceea-4472-967c-a0ca16eff5a9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:59.432506 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-unplugged", "status": "completed", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:59.433079 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e0f5ba27-ceea-4472-967c-a0ca16eff5a9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:59.433646 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'code': 200} Dec 21 03:49:59.487952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-78112656-c930-4b57-9fac-80e53677d5a5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 200 len: 217 time: 0.0840285 Dec 21 03:49:59.498812 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:49:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e9005d85-90a7-464a-98fc-5d250fbd8948 x-openstack-request-id: req-e9005d85-90a7-464a-98fc-5d250fbd8948 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:49:59.504695 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "tag": "90696376-ba84-4217-a845-b149d216aace", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:49:59.504949 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e9005d85-90a7-464a-98fc-5d250fbd8948 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:49:59.509128 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'tag': '90696376-ba84-4217-a845-b149d216aace', 'status': 'completed', 'code': 200} Dec 21 03:49:59.598308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbb1be4a-12bd-4d39-a2c9-a1c3d1eac7d3 req-737f88b6-41bd-412f-96b0-07058c5db8c9 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 210 time: 0.0756173 Dec 21 03:49:59.606060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:49:59.634829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-138787ab-f4b9-46ab-820f-f6e9277514e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.634829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-138787ab-f4b9-46ab-820f-f6e9277514e2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 200 len: 852 time: 0.1244788 Dec 21 03:49:59.635527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3a3dc231-a27a-4c00-a859-1a62de02e991 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:49:59.635647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-31b4bd4b-9f28-491e-80d5-8a7a22418fa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.637409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-31b4bd4b-9f28-491e-80d5-8a7a22418fa0 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 1096 time: 0.0902886 Dec 21 03:49:59.676057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-b6837fad-33aa-4490-839e-24c914b15c32 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0376594 Dec 21 03:49:59.794047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:59.806313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '90696376-ba84-4217-a845-b149d216aace', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'port_id': '90696376-ba84-4217-a845-b149d216aace', 'mac_address': 'fa:16:3e:51:9f:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da10d7f0-623a-4e8a-b5fc-286a12beadcd', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:49:59.861711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 3a3dc231-a27a-4c00-a859-1a62de02e991 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:49:59.875711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 3a3dc231-a27a-4c00-a859-1a62de02e991 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:49:59.878270 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:59.880143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a400d14-eeb3-4b20-a62c-9ec202b37734 req-e9ccd9f0-b5d6-4501-849e-a14fa54544c3 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.881727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a400d14-eeb3-4b20-a62c-9ec202b37734 req-e9ccd9f0-b5d6-4501-849e-a14fa54544c3 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 944 time: 0.2040882 Dec 21 03:49:59.891476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-67a990cb-8a4c-4946-b7e5-92da6bc80d67 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.893304 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-67a990cb-8a4c-4946-b7e5-92da6bc80d67 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.2306092 Dec 21 03:49:59.908724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:59.911067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:49:59.914887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Request body: {'port': {'device_id': '5c02924a-d743-4110-9095-9ee5214a0914', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'admin_state_up': True, 'tenant_id': '597df5e2769740859ecb4f30e4aefff3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:49:59.941615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90696376-ba84-4217-a845-b149d216aace {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:49:59.974605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:49:59.985330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-4917e72c-4c30-46b5-b88e-ea039d05060d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:49:59.986754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-4917e72c-4c30-46b5-b88e-ea039d05060d service neutron] 10.222.0.54 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 915 time: 0.3148808 Dec 21 03:50:00.034911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.053296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-6be35c90-4be7-485e-a92f-eec0d5d24f3b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=90696376-ba84-4217-a845-b149d216aace HTTP/1.1" status: 200 len: 217 time: 0.0542946 Dec 21 03:50:00.055752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-a9227f50-3ad9-4a75-8942-a25d82679e4e service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3678720 Dec 21 03:50:00.062647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a400d14-eeb3-4b20-a62c-9ec202b37734 req-79e29b54-f7b0-4bb1-a4e0-5713aed92308 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1720514 Dec 21 03:50:00.114413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-b0fa4434-970b-47f3-b6d6-0f4cb7b60f86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.115977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-b0fa4434-970b-47f3-b6d6-0f4cb7b60f86 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 200 len: 854 time: 0.0522671 Dec 21 03:50:00.134080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3a3dc231-a27a-4c00-a859-1a62de02e991,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:00.136547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.203110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:00.213521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.214353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d826c2ac-b9f5-444f-bb74-8ff9a966c08d up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:00.216499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-a1d6a07b-4d6a-4dde-888d-e53540beafbb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=24735258-b5ad-42e8-a231-667c1278689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0800142 Dec 21 03:50:00.329169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:00.420008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port d826c2ac-b9f5-444f-bb74-8ff9a966c08d completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:00.426248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port d826c2ac-b9f5-444f-bb74-8ff9a966c08d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:00.433334 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.436881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.533274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-542d850c-f747-4e3c-925e-45f501af456b req-bc4264fe-99bd-45c4-bf80-197df45e531b tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3810296 Dec 21 03:50:00.538219 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.539694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:00.550760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8aa20d0e-21b2-47c9-842e-4f0134025893 None None] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:00.563240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8bc9c83-d393-469f-b7da-57c2ee93d8fc req-6ccfec89-d2b7-4f3a-ad8a-a29a6fbc466c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.569196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8bc9c83-d393-469f-b7da-57c2ee93d8fc req-6ccfec89-d2b7-4f3a-ad8a-a29a6fbc466c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.570812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8bc9c83-d393-469f-b7da-57c2ee93d8fc req-6ccfec89-d2b7-4f3a-ad8a-a29a6fbc466c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00&device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 1689 time: 0.1317670 Dec 21 03:50:00.587402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-866de82c-5c22-455a-bdbd-3aa259314ff7 req-d566adff-a1ab-4eeb-9c76-28ab28ae7b67 service neutron] 10.222.0.31 "GET /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4704149 Dec 21 03:50:00.605327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-dd270428-7814-4360-b41a-86248b56d21d service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3752248 Dec 21 03:50:00.627750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['90696376-ba84-4217-a845-b149d216aace'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:00.630884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Made reservation on behalf of 597df5e2769740859ecb4f30e4aefff3 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:00.635823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.665497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Router 6db05df4-511a-4269-9149-e3a795af8359 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:50:00.668845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:00.671806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8bc9c83-d393-469f-b7da-57c2ee93d8fc req-b6d65df5-8b68-41bc-b883-334488be71f6 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867701 Dec 21 03:50:00.715002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50126) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:00.755857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9078d07a-908d-4e09-9a51-cd52f8b9dfd5 req-e03729d9-61ac-44a8-a6ef-fa65d0b9e59c service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1370542 Dec 21 03:50:00.761666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-984e8ab9-c332-494f-b732-a9c74a610935 None None] Provisioning complete for port e89d64be-3c0f-4397-b660-e4f7f387730c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:00.762262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-984e8ab9-c332-494f-b732-a9c74a610935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.767816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.768500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:00.821427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:00.865527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'name': 'network-vif-deleted', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27'}, {'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-deleted', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:00.867843 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4fd4446f-85f3-44ad-9b03-0c92a6ba5fc8" -d '{"events": [{"server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "name": "network-vif-deleted", "tag": "c312fda9-2565-4637-8907-d38449a7ab27"}, {"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-deleted", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:00.892510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:50:00.901362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Deleting subnet 84e57960-b2b1-49b0-85de-36fd5e1ebd6a {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:50:00.906702 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Sync routers for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:50:00.915551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.922035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.922836 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:00.925146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:00.928605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.934472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.942129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.948451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.948699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Allocated IP 172.20.0.5 (d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1/d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766/abe0c0b5-39cd-48b7-a7cf-ad2813087b79) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:00.955365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:00.963609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-da6e94df-2ffa-4365-8160-1c2226f06f22 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5428 time: 0.1874404 Dec 21 03:50:00.972811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.024280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: c312fda9-2565-4637-8907-d38449a7ab27 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:01.024680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c312fda9-2565-4637-8907-d38449a7ab27 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:01.068155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.099185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:01.103355 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:01.144294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d82e53d-3b55-4cb1-a12e-3b969f0961e2 req-94b95572-a2f2-48cd-a6fc-5b7d93eb8df8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1734998 Dec 21 03:50:01.144538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.147383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0edccd25-df0a-4531-9ee2-48bd391242d3 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 3.1129367 Dec 21 03:50:01.150415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:01.184542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.303155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-984e8ab9-c332-494f-b732-a9c74a610935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.318132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.377172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.380700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e89d64be-3c0f-4397-b660-e4f7f387730c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:01.393802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-984e8ab9-c332-494f-b732-a9c74a610935 None None] For port e89d64be-3c0f-4397-b660-e4f7f387730c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e89d64be-3c0f-4397-b660-e4f7f387730c,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:01.394553 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:49:59Z', 'revision_number': 3, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:49:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:01.443703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:01.447799 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68d258ad-9704-42e8-8d9e-cb984d47f896" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:01.461053 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Checking router: 6db05df4-511a-4269-9149-e3a795af8359 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:50:01.462768 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Updating router 6db05df4-511a-4269-9149-e3a795af8359 port 4459081b-f094-4195-870e-e1e6744c65ca binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:50:01.462899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c701dba-ba50-4210-be74-68cf6b4ae1f8 req-1aff0596-df17-42f2-9cd3-5b8a94a67f4b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:01.464936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c701dba-ba50-4210-be74-68cf6b4ae1f8 req-1aff0596-df17-42f2-9cd3-5b8a94a67f4b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1024 time: 0.1818604 Dec 21 03:50:01.491345 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.497719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e89d64be-3c0f-4397-b660-e4f7f387730c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:01.498206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.505490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.521950 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.525663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/84e57960-b2b1-49b0-85de-36fd5e1ebd6a HTTP/1.1" status: 204 len: 168 time: 0.8081396 Dec 21 03:50:01.530173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50138) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:01.530835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-984e8ab9-c332-494f-b732-a9c74a610935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.628117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5f0c37c-6ad0-4ab0-a066-f316ead36bf4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=84e57960-b2b1-49b0-85de-36fd5e1ebd6a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:01.630724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:01.659701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-984e8ab9-c332-494f-b732-a9c74a610935 None None] Pushing event updated for resources: {'Port': ['ID=e89d64be-3c0f-4397-b660-e4f7f387730c,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:01.719570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Allocated IP 172.25.5.111 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/0732b815-0b16-469d-9da7-d91439235e00) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:01.726485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-668bc00d-79fa-44d5-b7c9-c095125c681d None None] Provisioning complete for port e89d64be-3c0f-4397-b660-e4f7f387730c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:01.726906 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-668bc00d-79fa-44d5-b7c9-c095125c681d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.776591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c701dba-ba50-4210-be74-68cf6b4ae1f8 req-45266b1c-8efb-448b-a792-1911b7c9b5d3 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25&id=bb4f0e15-9be1-4c6e-8512-b8df6c1654c0&id=81a36cae-1a32-4478-b646-000893538e6f&fields=id&fields=name HTTP/1.1" status: 200 len: 515 time: 0.3000584 Dec 21 03:50:01.781059 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.824081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.840465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:01.846063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:01.846719 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.885211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:01.889818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-d9319062-acbe-41d6-925b-042dcf678775 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:01.891354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-d9319062-acbe-41d6-925b-042dcf678775 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 1024 time: 0.1780512 Dec 21 03:50:01.919472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:01.923221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:01.925456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:01.957987 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:01.999912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:02.010893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:02.011542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.105592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.106453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1a539edc-6061-4a94-a9d0-3e97bd54fe56 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:02.117806 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0431d04c-e3a3-4266-8a2d-e497837449c5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2067194 Dec 21 03:50:02.150438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Request body: {'port': {'device_id': '5c02924a-d743-4110-9095-9ee5214a0914', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:02.192598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:02.195118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.230346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.265088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:02.269295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:02.269644 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.343621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.353844 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.387845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:02.393304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36c5fd0-5d9c-4b43-9714-dc70cb192f51 req-b8e5873a-adf9-4f3b-a6a6-dbfaf83dfe77 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:02.394823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a36c5fd0-5d9c-4b43-9714-dc70cb192f51 req-b8e5873a-adf9-4f3b-a6a6-dbfaf83dfe77 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 931 time: 0.5177145 Dec 21 03:50:02.418922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8b13f1ae-b717-40da-b68e-bdf950529b14']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:02.431802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.454066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.455191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:02.459590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d9290ab-2323-4925-8697-d275634cc5ec') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:02.459936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d9290ab-2323-4925-8697-d275634cc5ec') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:02.492439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.528123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Allocated IP 172.20.0.1 (38668209-04ad-4602-a5aa-ab7bc4e1b781/2f0e0720-c89e-4a8a-888b-1e146411b74a/9b00b4ae-18ab-43d1-9823-ff309e6a5a81) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:02.539947 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:02.551174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.562384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a36c5fd0-5d9c-4b43-9714-dc70cb192f51 req-81939bdf-f988-4dcf-be48-cb1b960fe7cf tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1497197 Dec 21 03:50:02.566718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:50:02.567160 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:50:02.569059 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:50:02.572898 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:50:02.574052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Deleting port b078a85f-2d87-4a50-931c-09b26621fea9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:02.574052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.609837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:02.616773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:02.618008 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.664839 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.755334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:02.762133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:02.765661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:02.772152 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1a5a816-e254-4f23-82b2-3515121539d2 x-openstack-request-id: req-f1a5a816-e254-4f23-82b2-3515121539d2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:02.772152 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78468d9f-ac52-47b6-abd4-3f344da42e28", "name": "network-vif-deleted", "tag": "c312fda9-2565-4637-8907-d38449a7ab27", "status": "completed", "code": 200}, {"server_uuid": "5b7fbfb2-861d-44be-9361-0849ea092d24", "name": "network-vif-deleted", "tag": "2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:02.772450 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f1a5a816-e254-4f23-82b2-3515121539d2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:02.773153 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78468d9f-ac52-47b6-abd4-3f344da42e28', 'name': 'network-vif-deleted', 'tag': 'c312fda9-2565-4637-8907-d38449a7ab27', 'status': 'completed', 'code': 200} Dec 21 03:50:02.773153 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b7fbfb2-861d-44be-9361-0849ea092d24', 'name': 'network-vif-deleted', 'tag': '2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd', 'status': 'completed', 'code': 200} Dec 21 03:50:02.778699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id abe0c0b5-39cd-48b7-a7cf-ad2813087b79 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:02.785716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.804057 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.806246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.812974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.816242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] 10.222.0.18 "DELETE /v2.0/networks/8b13f1ae-b717-40da-b68e-bdf950529b14 HTTP/1.1" status: 204 len: 168 time: 1.2558563 Dec 21 03:50:02.820826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:02.822606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=0732b815-0b16-469d-9da7-d91439235e00,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:02.849008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.855002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ffeabb-5f2f-4e91-8ef4-fd39d4f1c2c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=8b13f1ae-b717-40da-b68e-bdf950529b14,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:02.869741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] For port b078a85f-2d87-4a50-931c-09b26621fea9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b078a85f-2d87-4a50-931c-09b26621fea9,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:02.870371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.880751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:02.898250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Transition to ACTIVE for port object abe0c0b5-39cd-48b7-a7cf-ad2813087b79 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:02.899683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Calling delete_port for b078a85f-2d87-4a50-931c-09b26621fea9 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:02.932019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Deleting subnet dcda1b60-cc54-4783-8e64-f3a891a1ee17 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:50:02.936872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.941862 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.944854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:02.956618 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:02.973452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.008846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.017934 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.028713 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.040441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89813c55-e1f3-4832-8b30-950b9d5f8ace req-7dfbaa85-c4dd-4f2f-9a72-b452cbe09b7f tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.048944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89813c55-e1f3-4832-8b30-950b9d5f8ace req-7dfbaa85-c4dd-4f2f-9a72-b452cbe09b7f tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 945 time: 0.1694007 Dec 21 03:50:03.058618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.073509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.079847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.134027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.152060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Attempting to bind port 4459081b-f094-4195-870e-e1e6744c65ca on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:03.152060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Attempting to bind port 4459081b-f094-4195-870e-e1e6744c65ca by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:03.152060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Attempting to bind port 4459081b-f094-4195-870e-e1e6744c65ca on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:03.158109 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:03.159195 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:03.159899 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.160454 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:03.161077 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Bound port: 4459081b-f094-4195-870e-e1e6744c65ca, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:03.161773 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.192930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:03.201665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:03.211467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:03.213427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:03.218556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:03.219435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.221301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Pushing event updated for resources: {'Port': ['ID=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.267496 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] For port 4459081b-f094-4195-870e-e1e6744c65ca, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:03.274451 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] For port 4459081b-f094-4195-870e-e1e6744c65ca, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4459081b-f094-4195-870e-e1e6744c65ca,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:03.276645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Attempting to bind port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:03.276645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Attempting to bind port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:03.276993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Attempting to bind port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:03.278918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Pushing event updated for resources: {'Port': ['ID=4459081b-f094-4195-870e-e1e6744c65ca,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.286108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:03.286338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Attempting to bind port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:03.289752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.298368 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.298722 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.301497 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.305677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.307588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.307739 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:03.326071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e89d64be-3c0f-4397-b660-e4f7f387730c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:03.355809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:03.356155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Checking segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:03.356575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Bound using segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:03.357021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Bound port: abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:03.357434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.370467 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.379347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.408046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:03.436320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'Port': ['ID=b078a85f-2d87-4a50-931c-09b26621fea9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.461857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:03.466139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:03.476384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89813c55-e1f3-4832-8b30-950b9d5f8ace req-54247a28-ca23-4575-b88f-3d832a1c79c1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4068706 Dec 21 03:50:03.487301 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:03.487301 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:03.487301 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7408999-628f-44d8-babe-3beb189db115 None None] Pushing event updated for resources: {'Port': ['ID=4459081b-f094-4195-870e-e1e6744c65ca,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.524379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.567602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.588727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dcda1b60-cc54-4783-8e64-f3a891a1ee17,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:03.597267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] No DVR routers for this DVR port b078a85f-2d87-4a50-931c-09b26621fea9 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:03.599852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.606842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-13f75b1d-b381-41d1-888c-b0e774fefa76 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/dcda1b60-cc54-4783-8e64-f3a891a1ee17 HTTP/1.1" status: 204 len: 168 time: 0.7848282 Dec 21 03:50:03.607882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.620731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4c4b3ef-22ab-4272-a675-b8027a0af513 req-e49feeb9-15ac-4db4-8da7-643a477d8f19 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "DELETE /v2.0/ports/b078a85f-2d87-4a50-931c-09b26621fea9 HTTP/1.1" status: 204 len: 173 time: 1.7065377 Dec 21 03:50:03.620731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:03.640799 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55b5c63d-f238-4021-b09a-134bb9c670ca x-openstack-request-id: req-55b5c63d-f238-4021-b09a-134bb9c670ca {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:03.641093 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:03.641350 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-55b5c63d-f238-4021-b09a-134bb9c670ca {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:03.642444 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'code': 200} Dec 21 03:50:03.642729 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d', 'code': 200} Dec 21 03:50:03.644444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.645224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.646745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] 10.222.0.31 "PUT /v2.0/ports/abe0c0b5-39cd-48b7-a7cf-ad2813087b79 HTTP/1.1" status: 200 len: 1092 time: 1.5024261 Dec 21 03:50:03.649472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:03.652335 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-76319e3a-cf88-41fa-a07d-baf070c5a781" -d '{"events": [{"name": "network-changed", "server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:03.743212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dc7e8956-1e24-4924-91b1-f02435261658 None None] Provisioning complete for port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:03.743581 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dc7e8956-1e24-4924-91b1-f02435261658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.756186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.811835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dc7e8956-1e24-4924-91b1-f02435261658 None None] Port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:50:03.829124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.868145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.899267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.906459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.914717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.915301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:03.919756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.926208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.929948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e89d64be-3c0f-4397-b660-e4f7f387730c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:03.931299 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:03.933301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.940454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:03.948850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-9a9980d8-2ac0-4e3b-8b3b-0412c223fd41 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5431 time: 0.2123528 Dec 21 03:50:03.997108 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:04.037009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.044658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.046296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3136aa12-8de7-43c2-8cde-55879999fd27 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:04.053701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a88972-84fe-4ab4-8255-852298ec1d93 service neutron] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:04.099936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af41d92b-c445-4085-ab0c-3009fe1642aa req-dda138a1-3190-443a-b581-77719ff55166 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1497400 Dec 21 03:50:04.101188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b470a8ae-aae1-4e5e-91cf-4d8bfb6ab557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:04.102703 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b470a8ae-aae1-4e5e-91cf-4d8bfb6ab557 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 1095 time: 0.0616448 Dec 21 03:50:04.112519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.190102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.255921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-a8742cac-5895-46f1-9d63-e54b644f1eaf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79 HTTP/1.1" status: 200 len: 217 time: 0.0731711 Dec 21 03:50:04.258671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.277870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:04.317605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0a7cd257-f98f-4b9e-a4e6-d4c82553ff03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:04.319153 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-0a7cd257-f98f-4b9e-a4e6-d4c82553ff03 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.0523114 Dec 21 03:50:04.319669 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:49:59Z', 'revision_number': 3, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:04.328189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 3136aa12-8de7-43c2-8cde-55879999fd27 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:04.330986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['757dabb2-8171-4998-adab-f7eeb2080d65']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:04.333594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 3136aa12-8de7-43c2-8cde-55879999fd27 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:04.334677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.352972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88540a7a-dd9a-4f71-9af3-aebbbf41d2b8') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:04.355365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88540a7a-dd9a-4f71-9af3-aebbbf41d2b8') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:04.364388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.370010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-b81f434c-666b-4834-99be-d8cb6ec6ac1c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0366602 Dec 21 03:50:04.372825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.380646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Pushing event updated for resources: {'Port': ['ID=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:04.395642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e88a476-59dc-40cf-b631-e4ed07020236 req-c4ff8921-58e1-4bac-b259-736e05c6934a tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:04.405428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e88a476-59dc-40cf-b631-e4ed07020236 req-c4ff8921-58e1-4bac-b259-736e05c6934a tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 1100 time: 0.1590497 Dec 21 03:50:04.426421 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b1bd5ca-ebc0-45f0-90a0-b65939aefe18 None None] The sync data for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 is: [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:49:59Z', 'revision_number': 3, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:50:04.449827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.453842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.494752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Releasing vlan 116 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:50:04.495176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:50:04.497124 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:50:04.511617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.521821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-afb3105d-29ee-41fa-9ebf-06345c9527c4 service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1112063 Dec 21 03:50:04.561940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3136aa12-8de7-43c2-8cde-55879999fd27,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:04.630014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e88a476-59dc-40cf-b631-e4ed07020236 req-56a58201-6739-48ec-b3d9-1f8688ad2a95 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2231328 Dec 21 03:50:04.634964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:04.643130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:04.644110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=0732b815-0b16-469d-9da7-d91439235e00,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:04.655988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.657171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:04.664454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.670143 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-61ecfc26-784b-43d0-b196-eed57273b836 req-2006005b-e63b-43f3-a5f2-31b25a32da32 service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1375959 Dec 21 03:50:04.724371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.729440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:04.730020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2dcb90fd-9a5a-4c94-9ee4-d9e428b9f1bd not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:04.735510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.740279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] 10.222.0.18 "DELETE /v2.0/networks/757dabb2-8171-4998-adab-f7eeb2080d65 HTTP/1.1" status: 204 len: 168 time: 1.1091602 Dec 21 03:50:04.767849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:04.785484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'name': 'network-vif-deleted', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:04.788102 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8eafd9e2-3ecd-4a92-82be-d5272cc6c6b3" -d '{"events": [{"server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "name": "network-vif-deleted", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:04.807499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd73821-523b-48e9-a8fb-0efb7f5ef969 admin admin] Pushing event deleted for resources: {'Network': ['ID=757dabb2-8171-4998-adab-f7eeb2080d65,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:04.836815 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:04.838205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-542d850c-f747-4e3c-925e-45f501af456b req-ea70093f-a49b-414a-8296-eacf634b99e4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 4.3032527 Dec 21 03:50:04.848855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Router 6db05df4-511a-4269-9149-e3a795af8359 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:50:04.870000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-594658f5-9018-4dcf-ac2b-12a5946d358b req-20107646-9bb3-4684-9464-3e8fd730763d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=b52a670d-9ba4-42ec-af7f-8481a2fa37c8 HTTP/1.1" status: 200 len: 210 time: 0.0688422 Dec 21 03:50:04.963567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:05.013942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-542d850c-f747-4e3c-925e-45f501af456b req-30cbdc82-b10d-44f2-a95d-eebfce1c9359 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.111 HTTP/1.1" status: 200 len: 696 time: 0.1530702 Dec 21 03:50:05.062350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 90696376-ba84-4217-a845-b149d216aace completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:05.069882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 90696376-ba84-4217-a845-b149d216aace triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:05.077249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.163638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:50:05.168457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-14260519-5a77-4715-a9be-c56baabcd6a5 None None] Provisioning complete for port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:05.168822 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14260519-5a77-4715-a9be-c56baabcd6a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.191747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76591caa-c578-4a55-b5e8-2b04f4035bce admin admin] 10.222.0.18 "PUT /v2.0/routers/6db05df4-511a-4269-9149-e3a795af8359/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0315049 Dec 21 03:50:05.217822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b078a85f-2d87-4a50-931c-09b26621fea9 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:05.229720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50956895-ec24-48c8-96a6-4d6034512404 req-472d525b-822a-400f-8075-b6444f74ddbe tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.231579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50956895-ec24-48c8-96a6-4d6034512404 req-472d525b-822a-400f-8075-b6444f74ddbe tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 943 time: 0.2156949 Dec 21 03:50:05.252271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: b078a85f-2d87-4a50-931c-09b26621fea9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:05.252271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b078a85f-2d87-4a50-931c-09b26621fea9 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:05.259264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-14260519-5a77-4715-a9be-c56baabcd6a5 None None] Port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:50:05.308272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50168) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:05.314054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.344721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542d850c-f747-4e3c-925e-45f501af456b req-d5b9af7a-527b-403f-b251-ef6b89554013 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.360721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-542d850c-f747-4e3c-925e-45f501af456b req-d5b9af7a-527b-403f-b251-ef6b89554013 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.3418901 Dec 21 03:50:05.371633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:05.379386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50956895-ec24-48c8-96a6-4d6034512404 req-ed630c16-0499-4485-937f-a8589405f1de tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368122 Dec 21 03:50:05.388249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4459081b-f094-4195-870e-e1e6744c65ca up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:05.415702 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e56f2d21-f2b2-4e0a-9a04-93b1f6d1e475 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7662e8b89a444924a01bee5e34421908&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1040368 Dec 21 03:50:05.420821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50174) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:05.427974 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e13e285e-56f2-4d90-8085-8565f116f0e2 x-openstack-request-id: req-e13e285e-56f2-4d90-8085-8565f116f0e2 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:05.428267 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:05.437167 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e13e285e-56f2-4d90-8085-8565f116f0e2 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:05.437167 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'status': 'completed', 'code': 200} Dec 21 03:50:05.468631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.515572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf0315c-16e9-4ec6-8527-97aa7f33d36c req-39465f56-a531-4b0a-accb-8e355d7a4ad0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.524282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf0315c-16e9-4ec6-8527-97aa7f33d36c req-39465f56-a531-4b0a-accb-8e355d7a4ad0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0690711 Dec 21 03:50:05.542995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:05.555661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4459081b-f094-4195-870e-e1e6744c65ca triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:05.556109 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.571139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-316fc279-0d08-4a6e-a9c7-60861776a5b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.572567 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-316fc279-0d08-4a6e-a9c7-60861776a5b6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 1095 time: 0.0904367 Dec 21 03:50:05.578777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05a059ad-5aa2-49e7-8cde-541fb526253f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.634852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf0315c-16e9-4ec6-8527-97aa7f33d36c req-f0821d73-5ea4-4912-90cf-70ccfa6200e1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1096051 Dec 21 03:50:05.642172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a935d3-29fe-4c44-81de-7660fedd4fd4 req-e984b55f-4d21-4924-82a2-052f6ddcb9e2 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.644683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0a935d3-29fe-4c44-81de-7660fedd4fd4 req-e984b55f-4d21-4924-82a2-052f6ddcb9e2 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 1102 time: 0.1109192 Dec 21 03:50:05.650718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a539edc-6061-4a94-a9d0-3e97bd54fe56'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27'}, {'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90696376-ba84-4217-a845-b149d216aace'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:05.661004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05a059ad-5aa2-49e7-8cde-541fb526253f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.661143 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e87b2a8-564c-4d8a-a8cc-0e239a4d16e9" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "1a539edc-6061-4a94-a9d0-3e97bd54fe56"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27"}, {"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-plugged", "status": "completed", "tag": "90696376-ba84-4217-a845-b149d216aace"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:05.706960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0a935d3-29fe-4c44-81de-7660fedd4fd4 req-2a103f66-2d7f-4dbf-952e-0ce3d1fe62a7 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547900 Dec 21 03:50:05.741054 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3874f482-ecf9-49e7-9c7b-f7f793314e20 x-openstack-request-id: req-3874f482-ecf9-49e7-9c7b-f7f793314e20 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:05.741054 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b52a670d-9ba4-42ec-af7f-8481a2fa37c8", "name": "network-vif-deleted", "tag": "b078a85f-2d87-4a50-931c-09b26621fea9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:05.741054 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3874f482-ecf9-49e7-9c7b-f7f793314e20 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:05.741054 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b52a670d-9ba4-42ec-af7f-8481a2fa37c8', 'name': 'network-vif-deleted', 'tag': 'b078a85f-2d87-4a50-931c-09b26621fea9', 'status': 'completed', 'code': 200} Dec 21 03:50:05.748853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-e39623cf-33af-4488-ac12-3b3fe84b6fba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.750341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-e39623cf-33af-4488-ac12-3b3fe84b6fba service neutron] 10.222.0.31 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 906 time: 0.1688135 Dec 21 03:50:05.763235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.800188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 4459081b-f094-4195-870e-e1e6744c65ca, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4459081b-f094-4195-870e-e1e6744c65ca,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:05.829177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-1766d95c-2fdd-475b-b6da-ee3b77615c92 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79 HTTP/1.1" status: 200 len: 217 time: 0.0617168 Dec 21 03:50:05.851450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05a059ad-5aa2-49e7-8cde-541fb526253f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.854323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05a059ad-5aa2-49e7-8cde-541fb526253f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.858294 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05a059ad-5aa2-49e7-8cde-541fb526253f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f49e32c9-7ac4-4473-9e8e-3ee032077854 HTTP/1.1" status: 204 len: 168 time: 0.4337204 Dec 21 03:50:05.880376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:05.909942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05a059ad-5aa2-49e7-8cde-541fb526253f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f49e32c9-7ac4-4473-9e8e-3ee032077854,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:05.937551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-e43c40e7-97cc-4a3b-893a-9a9aa55906a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.940131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-e43c40e7-97cc-4a3b-893a-9a9aa55906a6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.1006589 Dec 21 03:50:05.947774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=4459081b-f094-4195-870e-e1e6744c65ca,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:05.959073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.965691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.977088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.983960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.990550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:05.990831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-55f36430-cd74-4ae5-b030-4b7c31573d20 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0399692 Dec 21 03:50:05.996973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:06.003111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:06.005016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-ab7b72fa-1042-4337-9dfa-a2391375245f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.2159967 Dec 21 03:50:06.043288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-c4a33a2f-9254-4ff3-9838-5c14564f5cd4 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2893188 Dec 21 03:50:06.060131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:06.089111 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-09ed2a61-aac4-4fe4-b84e-89a1c78d1c16 service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902898 Dec 21 03:50:06.095823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcc0e3dd-8cad-4e2a-82aa-3a7b902afe2c req-2ea368d7-1900-4644-9332-5768e3b0cf68 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0777180 Dec 21 03:50:06.187419 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.192712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-76319e3a-cf88-41fa-a07d-baf070c5a781 req-ee81f581-6da3-48f1-b047-316f688feef0 service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0963309 Dec 21 03:50:06.293555 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.411245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Allocated IP 172.25.5.190 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/a8ec12f0-1ffe-4c81-b6cd-35db106c23fe) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:06.518345 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.578147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50192) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:06.582830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1262234453', 'description': 'tempest-description--1007536166'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:06.610584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.624476 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 1038 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b83b9a6b-c5ac-49ef-a3bc-d8b7e55bf7e0 x-openstack-request-id: req-b83b9a6b-c5ac-49ef-a3bc-d8b7e55bf7e0 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:06.624957 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "1a539edc-6061-4a94-a9d0-3e97bd54fe56", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-plugged", "status": "completed", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27", "code": 200}, {"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-plugged", "status": "completed", "tag": "90696376-ba84-4217-a845-b149d216aace", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:06.625087 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b83b9a6b-c5ac-49ef-a3bc-d8b7e55bf7e0 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:06.625474 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3', 'code': 200} Dec 21 03:50:06.625740 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a539edc-6061-4a94-a9d0-3e97bd54fe56', 'code': 200} Dec 21 03:50:06.626126 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e', 'code': 200} Dec 21 03:50:06.626381 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5', 'code': 200} Dec 21 03:50:06.626641 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27', 'code': 200} Dec 21 03:50:06.627079 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90696376-ba84-4217-a845-b149d216aace', 'code': 200} Dec 21 03:50:06.661493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:06.664536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:06.667166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.668293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:06.695057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=a8ec12f0-1ffe-4c81-b6cd-35db106c23fe,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:06.726854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-89236735-a39d-48db-a512-f40c3c1da83d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0291281 Dec 21 03:50:06.748655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Sync routers for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:50:06.756572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50204) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:06.758013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.759283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:06.760008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:06.821520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.858051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event updated for resources: {'SecurityGroup': ['ID=05fa0fae-c6cf-433a-b048-dc55af7ef60f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:06.871093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.941833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:06.942067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4ff3f311-4568-4dac-8159-41f405a909eb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=01233913dd88490b9667c9c68175aa6c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1611919 Dec 21 03:50:06.942177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8b3827a-589f-4066-81b0-777f8a549141 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.3613052 Dec 21 03:50:06.942177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50206) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:06.947848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:06.953847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Request body: {'security_group_rule': {'security_group_id': '05fa0fae-c6cf-433a-b048-dc55af7ef60f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:07.016570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:07.017918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9401b12-f6ad-40a8-8e17-134d09ea9f35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.034740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-ce38d8c3-56bd-474e-98c6-65b0b299d745 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.037080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-ce38d8c3-56bd-474e-98c6-65b0b299d745 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2958734 Dec 21 03:50:07.041371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9401b12-f6ad-40a8-8e17-134d09ea9f35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.045302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefb7100-b78f-428a-aff5-d4938af30225 req-66f90fd3-dab1-4106-a729-9eef96e2a8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.047165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cefb7100-b78f-428a-aff5-d4938af30225 req-66f90fd3-dab1-4106-a729-9eef96e2a8c1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 1098 time: 0.1711645 Dec 21 03:50:07.049725 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.057503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.057986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.058465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.058946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.059431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.059886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.060412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:07.063130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-878eaa87-a260-41a7-8934-adea8f388961 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6497 time: 0.1583381 Dec 21 03:50:07.103945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.161259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.210344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9401b12-f6ad-40a8-8e17-134d09ea9f35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.213437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9401b12-f6ad-40a8-8e17-134d09ea9f35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.214904 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c9401b12-f6ad-40a8-8e17-134d09ea9f35 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7163d148-c620-49d0-a15c-447e171d8a7a HTTP/1.1" status: 204 len: 168 time: 0.2719970 Dec 21 03:50:07.223973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9401b12-f6ad-40a8-8e17-134d09ea9f35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7163d148-c620-49d0-a15c-447e171d8a7a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:07.236673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.254451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=439944ef-2a22-48c1-9211-d62ec2b72b72,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:07.258267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4459081b-f094-4195-870e-e1e6744c65ca up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:07.265876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 2, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:07.321091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Checking router: 6db05df4-511a-4269-9149-e3a795af8359 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:50:07.321538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Updating router 6db05df4-511a-4269-9149-e3a795af8359 port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:50:07.336331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.340554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d21502de-f712-4202-92d3-aeabd021c305 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3893249 Dec 21 03:50:07.341217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50214) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:07.353006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Request body: {'security_group_rule': {'security_group_id': '05fa0fae-c6cf-433a-b048-dc55af7ef60f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:07.360319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.410560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-fdc28d3e-43be-4323-843b-7a365d8de72f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/quotas/9839aab3796944fe8a09f1cfbd7edf8b HTTP/1.1" status: 200 len: 375 time: 0.3616555 Dec 21 03:50:07.417752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4459081b-f094-4195-870e-e1e6744c65ca triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:07.418244 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.502696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cefb7100-b78f-428a-aff5-d4938af30225 req-a261af55-3dd7-41da-b358-2a8bd585e50c service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4376314 Dec 21 03:50:07.511050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.571825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68158376-7952-4c9e-8c62-1ef7a511fcd1 req-3b18c8a6-cde9-41c9-97be-6f4d5da1a564 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.4887848 Dec 21 03:50:07.589112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-3cbe2fde-9d20-487b-b98a-e5e0f889bb28 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1636369 Dec 21 03:50:07.600366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.643808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.670886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.690173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=efc58b26-de43-4bdd-bfe2-bd71a5373b96,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:07.727744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.765139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.774484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.778502 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ce3b4f0-1416-4990-ab8a-0af3465a6dcb tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4352503 Dec 21 03:50:07.782632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50220) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:07.799817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:07.835179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event updated for resources: {'Port': ['ID=a8ec12f0-1ffe-4c81-b6cd-35db106c23fe,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:07.840793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.848122 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.907103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.932897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cece8866-4ba6-40c8-b046-246a616b89dd None None] Pushing event updated for resources: {'Port': ['ID=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:07.945216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:07.946703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-a45f5d7b-971a-450c-9908-97c08ed7d776 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 1.8930578 Dec 21 03:50:08.031135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Attempting to bind port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:08.031604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Attempting to bind port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:08.032196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Attempting to bind port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 on network 38668209-04ad-4602-a5aa-ab7bc4e1b781 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:08.037723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:08.038212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Checking segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:08.038766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.039266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Bound using segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:08.039819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Bound port: 9b00b4ae-18ab-43d1-9823-ff309e6a5a81, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:08.040271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.077155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.109480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] For port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:08.113649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] For port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:08.127932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13eb6285-6788-449d-9ad4-458e7bfc7b02 req-b8abb3f9-8b59-4b3c-9a5a-e4ac9d37605f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.137119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13eb6285-6788-449d-9ad4-458e7bfc7b02 req-b8abb3f9-8b59-4b3c-9a5a-e4ac9d37605f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 943 time: 0.2058570 Dec 21 03:50:08.152425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-bafed9ab-1db4-4923-b393-07a3836773b3 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.190 HTTP/1.1" status: 200 len: 696 time: 0.1633837 Dec 21 03:50:08.200308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.213599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1c9b798c-6371-435a-af6d-bda61094d2c8 None None] Provisioning complete for port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:08.213599 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c9b798c-6371-435a-af6d-bda61094d2c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.227955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Allocated IP 172.25.5.144 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/666ec68c-fa52-4f1f-9b84-078de6ae1a38) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:08.293463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13eb6285-6788-449d-9ad4-458e7bfc7b02 req-09f08d29-2bc3-4d85-919a-0bf74e56b216 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1554461 Dec 21 03:50:08.330507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:08.333331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:08.371433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-d691fe61-7989-4732-99c7-eefc28eb5716 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.374004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d43b3305-9642-41d7-8d3c-b5259a744442 req-d691fe61-7989-4732-99c7-eefc28eb5716 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1981037 Dec 21 03:50:08.387014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.424552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cece8866-4ba6-40c8-b046-246a616b89dd None None] Pushing event updated for resources: {'Port': ['ID=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:08.496591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.537569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-270918be-c903-4781-8f8a-99adeda390f7 req-72a002a5-32bd-4d86-859c-443815ed4fcc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.544378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:08.546403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-270918be-c903-4781-8f8a-99adeda390f7 req-72a002a5-32bd-4d86-859c-443815ed4fcc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1020563 Dec 21 03:50:08.548327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:08.556052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c9b798c-6371-435a-af6d-bda61094d2c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.556743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:08.584848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:08.639283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.649755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.665423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1c9b798c-6371-435a-af6d-bda61094d2c8 None None] For port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:08.669694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.677487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.684582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.684875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.692951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.694202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50250) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:08.699002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:08.701126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-e70b09e1-50d9-4965-8c8c-7c435eef1794 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.2227230 Dec 21 03:50:08.724554 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c9b798c-6371-435a-af6d-bda61094d2c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.733430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event updated for resources: {'Port': ['ID=666ec68c-fa52-4f1f-9b84-078de6ae1a38,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:08.770483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-270918be-c903-4781-8f8a-99adeda390f7 req-84aed6cf-4f93-4a0d-b901-f6bdce204a78 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2188363 Dec 21 03:50:08.793726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.828793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d68512e8-48eb-43f2-917e-1d2018403e26 req-7ec1f85a-ced0-47ca-be67-540c7b3cbf6f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1166282 Dec 21 03:50:08.871676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be61ed8d-a833-4530-bbc8-c459c00cdd2a req-a0cedb79-31d4-4c48-9320-888ffa9cfbbf tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 210 time: 0.0592110 Dec 21 03:50:08.872345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationTest-507775656-network', 'tenant_id': 'e49c9575c393446a904ba5840d68746b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:08.898182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9b798c-6371-435a-af6d-bda61094d2c8 None None] Pushing event updated for resources: {'Port': ['ID=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:08.937843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e9cbbf47-a828-49c4-b15c-8fe62559f916 None None] Provisioning complete for port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:08.938572 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e9cbbf47-a828-49c4-b15c-8fe62559f916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:08.975379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50ca0dd4-8aa4-443d-b235-c1edc7939222 req-69de8189-c898-4f2b-93f5-2358e33ce29c tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips/39f05d74-7519-4640-9b92-a5744eaff04d HTTP/1.1" status: 200 len: 693 time: 0.0667191 Dec 21 03:50:08.980727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9fff1e2-2167-4f79-97cf-50480335a8a3 req-45a1117b-1524-45f0-80a1-3cbe9f649d23 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/bb4f0e15-9be1-4c6e-8512-b8df6c1654c0 HTTP/1.1" status: 200 len: 1817 time: 0.0981326 Dec 21 03:50:09.025825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:09.058826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.061391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Made reservation on behalf of e49c9575c393446a904ba5840d68746b for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:09.063997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.074026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-001e2b33-79e0-4476-b738-043cdb696581 None None] The sync data for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 is: [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:50:09.074568 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.125359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.173713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9fff1e2-2167-4f79-97cf-50480335a8a3 req-b6e619e2-ed30-4262-923c-bbe42488d73f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.202974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ca0dd4-8aa4-443d-b235-c1edc7939222 req-2363159c-ffd8-4f8b-95d0-7443a249044d tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:09.211968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50ca0dd4-8aa4-443d-b235-c1edc7939222 req-2363159c-ffd8-4f8b-95d0-7443a249044d tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2252522 Dec 21 03:50:09.215650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:09.223059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-50ca0dd4-8aa4-443d-b235-c1edc7939222 req-4db5946e-571b-4060-9008-5aab36d4b492 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:50:09.236032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50ca0dd4-8aa4-443d-b235-c1edc7939222 req-4db5946e-571b-4060-9008-5aab36d4b492 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0172763 Dec 21 03:50:09.255472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event updated for resources: {'Port': ['ID=666ec68c-fa52-4f1f-9b84-078de6ae1a38,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:09.284002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.287917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.331843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9fff1e2-2167-4f79-97cf-50480335a8a3 req-b6e619e2-ed30-4262-923c-bbe42488d73f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.343527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-b46ba571-6585-4842-8ba0-30758155ab30 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips/39f05d74-7519-4640-9b92-a5744eaff04d HTTP/1.1" status: 200 len: 693 time: 0.0815282 Dec 21 03:50:09.391842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.396609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:09.406413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:50:09.416156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.416970 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Added segment a7e04703-d86d-45a9-b1f8-027f2f6defdb of type vlan for network 5fd01e07-75a4-4745-ad05-8ade1a021605 Dec 21 03:50:09.461075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:09.463737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.483805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'mac_address': 'fa:16:3e:90:ee:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:09.517682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2c471e6-8d60-4cbd-b863-2cb8acac8120,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:09.522457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.523950 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b67a3a4-ec13-4e48-9a68-f5bbbac61296 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.7404137 Dec 21 03:50:09.558658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-6e934ea1-c796-438e-a5d2-28a2cb52fd78 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:09.570005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-6e934ea1-c796-438e-a5d2-28a2cb52fd78 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2088869 Dec 21 03:50:09.577391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.589503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:09.589917 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.599783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.601063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:09.601832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.638220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id abe0c0b5-39cd-48b7-a7cf-ad2813087b79 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:09.646196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9fff1e2-2167-4f79-97cf-50480335a8a3 req-b6e619e2-ed30-4262-923c-bbe42488d73f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.649864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9fff1e2-2167-4f79-97cf-50480335a8a3 req-b6e619e2-ed30-4262-923c-bbe42488d73f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.658904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9fff1e2-2167-4f79-97cf-50480335a8a3 req-b6e619e2-ed30-4262-923c-bbe42488d73f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/bb4f0e15-9be1-4c6e-8512-b8df6c1654c0 HTTP/1.1" status: 204 len: 173 time: 0.6659584 Dec 21 03:50:09.677788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:09.692837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-f402a772-15bc-4dab-a48f-d07e07255b26 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.190 HTTP/1.1" status: 200 len: 696 time: 0.1178193 Dec 21 03:50:09.761528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 1.0637696 Dec 21 03:50:09.763657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9bb2bc0-9485-46b8-8126-9337dc32e216 admin admin] Pushing event updated for resources: {'Network': ['ID=5fd01e07-75a4-4745-ad05-8ade1a021605,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:09.768230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50264) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:09.770760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e619e2-ed30-4262-923c-bbe42488d73f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb4f0e15-9be1-4c6e-8512-b8df6c1654c0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:09.775760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Request body: {'subnet': {'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationTest-507775656-subnet', 'tenant_id': 'e49c9575c393446a904ba5840d68746b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:09.793689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:50:09.832299 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.841407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-f485a7fc-522b-48e3-a5cc-de6dc1390159 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.190 HTTP/1.1" status: 200 len: 696 time: 0.1476712 Dec 21 03:50:09.870870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Made reservation on behalf of e49c9575c393446a904ba5840d68746b for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:09.873346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:09.939793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f290171-f0e0-40c8-994b-3b99376c0e9a req-7aa7613d-e067-4e81-a346-1af57dc6bf7a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:09.941411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f290171-f0e0-40c8-994b-3b99376c0e9a req-7aa7613d-e067-4e81-a346-1af57dc6bf7a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 944 time: 0.1684570 Dec 21 03:50:09.983466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:10.087923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f290171-f0e0-40c8-994b-3b99376c0e9a req-34e2beb3-8960-4e7a-bdcd-1f2a03c3dedd tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859799 Dec 21 03:50:10.099089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Deleting port a8ec12f0-1ffe-4c81-b6cd-35db106c23fe {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:10.099519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.150814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.206303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fc0b46b-5d78-45c8-a01c-466ba59a25dc req-f4ab3f29-ebf9-4704-8d98-87ba5c540b87 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25 HTTP/1.1" status: 200 len: 1817 time: 0.0869138 Dec 21 03:50:10.207875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Pushing event updated for resources: {'Subnet': ['ID=13099c8a-54c1-41b2-a4f4-664d17e69495,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:10.210081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['abe0c0b5-39cd-48b7-a7cf-ad2813087b79'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:10.214810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.215185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.223743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:10.224528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Network hostable DHCP agents. Network: 5fd01e07-75a4-4745-ad05-8ade1a021605, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:50:10.238084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Calling delete_port for a8ec12f0-1ffe-4c81-b6cd-35db106c23fe owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:10.318807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:50:10.334957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fc0b46b-5d78-45c8-a01c-466ba59a25dc req-890c8a73-a53e-455b-a621-cce9e4ce7c4d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.374308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fc0b46b-5d78-45c8-a01c-466ba59a25dc req-890c8a73-a53e-455b-a621-cce9e4ce7c4d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.402237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5fd01e07-75a4-4745-ad05-8ade1a021605) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:10.407925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:10.408954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.413071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb930e2c-d0d8-44db-834d-3b0bd6e2ae0a None None] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:10.494607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-fc9c2311-3e88-486d-8859-f061031d7025 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0318279 Dec 21 03:50:10.520922 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4f8fd3ea-5e1d-49d4-8206-b7a86b20d49e admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.7508786 Dec 21 03:50:10.588082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fc0b46b-5d78-45c8-a01c-466ba59a25dc req-890c8a73-a53e-455b-a621-cce9e4ce7c4d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.595016 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fc0b46b-5d78-45c8-a01c-466ba59a25dc req-890c8a73-a53e-455b-a621-cce9e4ce7c4d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.613500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fc0b46b-5d78-45c8-a01c-466ba59a25dc req-890c8a73-a53e-455b-a621-cce9e4ce7c4d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25 HTTP/1.1" status: 204 len: 173 time: 0.3837619 Dec 21 03:50:10.624841 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.674024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-890c8a73-a53e-455b-a621-cce9e4ce7c4d tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:10.678294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event deleted for resources: {'Port': ['ID=a8ec12f0-1ffe-4c81-b6cd-35db106c23fe,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:10.745376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f811c38a-fdc2-4a8f-9134-a0ec8f281e8d None None] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:10.759450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-826fe9ef-930f-4256-bd6b-8d69afb9dbc6 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:10.760923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-826fe9ef-930f-4256-bd6b-8d69afb9dbc6 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2605472 Dec 21 03:50:10.781861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:10.868719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.871251 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:10.883346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7490125e-719a-46aa-a2d4-cf8dd265e269 req-ea833afe-4c5b-4404-978a-2d7eb2af91ef tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "DELETE /v2.0/floatingips/39f05d74-7519-4640-9b92-a5744eaff04d HTTP/1.1" status: 204 len: 173 time: 1.0296576 Dec 21 03:50:10.900352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-2d3ed649-5521-460c-a1b8-c700466b801a tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1262234453&fields=id&tenant_id=e8135ee47f84444cb5d3eb45b6c7590b HTTP/1.1" status: 200 len: 267 time: 0.1799169 Dec 21 03:50:11.066908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc484335-4003-4619-96eb-6c41deb37369 req-50b8fcf6-b67e-455c-838a-c621cedc4a49 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.068402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc484335-4003-4619-96eb-6c41deb37369 req-50b8fcf6-b67e-455c-838a-c621cedc4a49 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1259298 Dec 21 03:50:11.080228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-f9b0daed-a350-40f4-bfc5-85f8aeb634cc tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.080799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-f9b0daed-a350-40f4-bfc5-85f8aeb634cc tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/networks?id=38668209-04ad-4602-a5aa-ab7bc4e1b781 HTTP/1.1" status: 200 len: 814 time: 0.1736677 Dec 21 03:50:11.109773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-5db79e26-e23c-4129-a20f-c01b0994df07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/quotas/e8135ee47f84444cb5d3eb45b6c7590b HTTP/1.1" status: 200 len: 375 time: 0.0218275 Dec 21 03:50:11.155493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc484335-4003-4619-96eb-6c41deb37369 req-87c4959d-2219-4995-9f34-4aaddc458cd2 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741944 Dec 21 03:50:11.157272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:11.160677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.200911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-1e9d56b3-a1fa-4c60-a9dd-f730791029d8 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e8135ee47f84444cb5d3eb45b6c7590b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0832646 Dec 21 03:50:11.209266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:11.329802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:11.334969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:11.335566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.366226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50302) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:11.372302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationTest-1688750540-network', 'tenant_id': '9332531de7d447ff93976e70d1e5a307'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:11.394758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.400672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.407459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.413358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.419241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.421141 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.425790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.431744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.433611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-28ca1c14-6010-40bb-8eb7-e8438e0e0fd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.2029550 Dec 21 03:50:11.443771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:11.445996 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01d2c95f-3c98-4943-93e1-2b70c8b46571" -d '{"events": [{"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-plugged", "status": "completed", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:11.458183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:11.476082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.94 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/37f13e0f-1f8b-4106-974a-bdabfab506b1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:11.486293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-667312de-2014-4f0d-bfea-c30337e216b7 service neutron] 10.222.0.18 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2503417 Dec 21 03:50:11.512531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Made reservation on behalf of 9332531de7d447ff93976e70d1e5a307 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:11.514912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.528659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.541742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.594839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:11.614422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.622558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a5c513f-e82f-430a-b471-f08e5eea4b70 req-8872f045-becb-4593-a217-644d09013aab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1808965 Dec 21 03:50:11.678204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.700310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:50:11.714481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-55ca135f-16d2-4703-94ed-9184bb3db15d service neutron] 10.222.0.18 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2205350 Dec 21 03:50:11.717553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7880b47d-91f0-4079-9950-f0e9428f0132,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:11.722156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.722507 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Added segment 5b8f9651-08e1-4f94-9bf2-9c0c825b5138 of type vlan for network 3f120346-c5f7-4563-898a-43b3922a09f6 Dec 21 03:50:11.733466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67d758fa-562c-4215-b4fb-dcb45e59c192 req-476266fe-ecdd-4add-869e-e5e67d9f11d5 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 210 time: 0.0400879 Dec 21 03:50:11.774971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.778015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.788272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-03474165-d13f-4394-a176-19cd24274da5 req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1831711470', 'description': 'tempest-description-1712598621'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:11.855681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.856690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:11.857445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.889211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-03474165-d13f-4394-a176-19cd24274da5 req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.892384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:11.922964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] Pushing event updated for resources: {'Network': ['ID=3f120346-c5f7-4563-898a-43b3922a09f6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:11.926991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:11.933217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:11.939793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3f120346-c5f7-4563-898a-43b3922a09f6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:50:11.956974 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4eb4cf25-2dc2-45cd-af5c-d27793db0b32 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5869057 Dec 21 03:50:11.957246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50312) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:11.962903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Request body: {'subnet': {'network_id': '3f120346-c5f7-4563-898a-43b3922a09f6', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationTest-1688750540-subnet', 'tenant_id': '9332531de7d447ff93976e70d1e5a307', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:11.992204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=37f13e0f-1f8b-4106-974a-bdabfab506b1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:12.019901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:12.054071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:12.065250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:12.066741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Made reservation on behalf of 9332531de7d447ff93976e70d1e5a307 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:12.069542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.130981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:12.131622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.253302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f7358de5-de5b-497b-8a3a-59961f585455 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4763098 Dec 21 03:50:12.378358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.396248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-befbd6fe-1046-49f0-b845-986b73206473 None None] Provisioning complete for port 37f13e0f-1f8b-4106-974a-bdabfab506b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:12.396842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-befbd6fe-1046-49f0-b845-986b73206473 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.440955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Pushing event updated for resources: {'Subnet': ['ID=c499b151-e14a-4090-8dc0-bbb3e129fdec,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:12.463396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Checking segment: {'id': '5b8f9651-08e1-4f94-9bf2-9c0c825b5138', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '3f120346-c5f7-4563-898a-43b3922a09f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:12.463797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Network hostable DHCP agents. Network: 3f120346-c5f7-4563-898a-43b3922a09f6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:50:12.470235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-befbd6fe-1046-49f0-b845-986b73206473 None None] Port 37f13e0f-1f8b-4106-974a-bdabfab506b1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:50:12.551708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Network 3f120346-c5f7-4563-898a-43b3922a09f6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:50:12.586508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Request body: {'port': {'device_id': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:12.636214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 3f120346-c5f7-4563-898a-43b3922a09f6) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:12.641622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:12.642214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.646823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-779835f6-2435-4298-b927-15e3fec2a619 None None] Network 3f120346-c5f7-4563-898a-43b3922a09f6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:12.679703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14825d4c-3747-4981-8801-d0dcd956f8c6 req-f9a08e0e-3e85-4321-85c0-f52b0e6f7ebe tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:12.681376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14825d4c-3747-4981-8801-d0dcd956f8c6 req-f9a08e0e-3e85-4321-85c0-f52b0e6f7ebe tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 787 time: 0.7617643 Dec 21 03:50:12.703348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-03474165-d13f-4394-a176-19cd24274da5 req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.710078 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.752055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d57b4d2-0adb-4cb7-a8ec-c662ff175e9a admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7902832 Dec 21 03:50:12.756728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b3c0167-fbe7-49bc-9dfe-a048640914cf None None] Network 3f120346-c5f7-4563-898a-43b3922a09f6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:12.786177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-03474165-d13f-4394-a176-19cd24274da5 req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.922733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26630f8-cd1c-4a89-a612-bd1450e74f1e req-812e7999-4fec-4a65-8f33-4d32ed1b5782 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:12.922733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b26630f8-cd1c-4a89-a612-bd1450e74f1e req-812e7999-4fec-4a65-8f33-4d32ed1b5782 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 945 time: 0.1607633 Dec 21 03:50:12.922733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-03474165-d13f-4394-a176-19cd24274da5 req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:12.922733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03474165-d13f-4394-a176-19cd24274da5 req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 1.1367538 Dec 21 03:50:12.930599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b3a077-7daa-4783-a2ae-d693cb249d37 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=169ecac2-300f-4c12-a483-baef23697095,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:13.058325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b26630f8-cd1c-4a89-a612-bd1450e74f1e req-03ee64d9-5194-41a2-a607-435819da8ff1 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1338859 Dec 21 03:50:13.088501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546d424b-a708-499e-8153-57912dab0a29 req-b7d2d7a5-e1b0-469f-ab76-8e14d52938ac tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.090072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-546d424b-a708-499e-8153-57912dab0a29 req-b7d2d7a5-e1b0-469f-ab76-8e14d52938ac tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0825522 Dec 21 03:50:13.104677 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee7d890f-269a-465a-a4b4-127e07358d01 x-openstack-request-id: req-ee7d890f-269a-465a-a4b4-127e07358d01 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:13.105345 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-plugged", "status": "completed", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:13.105809 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ee7d890f-269a-465a-a4b4-127e07358d01 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:13.106431 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'code': 200} Dec 21 03:50:13.217486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-546d424b-a708-499e-8153-57912dab0a29 req-2a61cd37-9856-4afd-ac6d-03407b5abc4b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200116 Dec 21 03:50:13.222259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 37f13e0f-1f8b-4106-974a-bdabfab506b1 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:13.233428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:13.262149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.268764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.274715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.280513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a10da38-e77e-4281-bdaa-bcfc2e888c91 req-9ea6147a-a702-44c6-adeb-596c003e442c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.281599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.282216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a10da38-e77e-4281-bdaa-bcfc2e888c91 req-9ea6147a-a702-44c6-adeb-596c003e442c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 1097 time: 0.0517502 Dec 21 03:50:13.287594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.293770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.299795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.301701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef88b781-3dad-42e7-bb47-7264597c0078 req-60378547-59cb-4355-b4f7-b0f1453a5bd6 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.1509049 Dec 21 03:50:13.302781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Transition to ACTIVE for port object 37f13e0f-1f8b-4106-974a-bdabfab506b1 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:13.313633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50334) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:13.318081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Request body: {'floatingip': {'port_id': '3a3dc231-a27a-4c00-a859-1a62de02e991'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:13.334961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a10da38-e77e-4281-bdaa-bcfc2e888c91 req-73dd6e72-a540-47a4-932c-43b2180344cf service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444934 Dec 21 03:50:13.367200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a4bfcd9-0eb9-48ec-8c24-d2f796ed3c60 req-2cc746ae-2a25-4bde-8014-bc218c7eae63 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 210 time: 0.0630968 Dec 21 03:50:13.396739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:13.445956 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:13.517618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e2821c3-da22-4121-be7b-cc848cfdda0d req-32722fa3-623f-4b44-aa42-72201fefd419 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?tenant_id=55f2bf80332241bbb5e3eda21038f4f0 HTTP/1.1" status: 200 len: 1655 time: 0.1831062 Dec 21 03:50:13.621070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Pushing event updated for resources: {'Port': ['ID=37f13e0f-1f8b-4106-974a-bdabfab506b1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:13.729030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ef8d29-c575-424d-9313-dff72d3bef32 req-7521732a-aed1-42d3-9284-7ff62029f230 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.730501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ef8d29-c575-424d-9313-dff72d3bef32 req-7521732a-aed1-42d3-9284-7ff62029f230 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 947 time: 0.2975399 Dec 21 03:50:13.864428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2821c3-da22-4121-be7b-cc848cfdda0d req-3cefe462-d48e-489a-9338-c180ddc97226 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:13.865919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e2821c3-da22-4121-be7b-cc848cfdda0d req-3cefe462-d48e-489a-9338-c180ddc97226 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks?id=30f5b79f-275c-4003-8999-814f6db142e1&id=30f5b79f-275c-4003-8999-814f6db142e1&id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 787 time: 0.3227110 Dec 21 03:50:13.914786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-2e2821c3-da22-4121-be7b-cc848cfdda0d req-939c8a68-1b39-4e07-896b-9ce1b214b4af tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:50:13.915796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e2821c3-da22-4121-be7b-cc848cfdda0d req-939c8a68-1b39-4e07-896b-9ce1b214b4af tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0384827 Dec 21 03:50:13.934530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Attempting to bind port 37f13e0f-1f8b-4106-974a-bdabfab506b1 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:13.934855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Attempting to bind port 37f13e0f-1f8b-4106-974a-bdabfab506b1 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:13.935205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Attempting to bind port 37f13e0f-1f8b-4106-974a-bdabfab506b1 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:13.942670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ef8d29-c575-424d-9313-dff72d3bef32 req-7d1b225a-559c-4d42-ad87-5d473574e65c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1800160 Dec 21 03:50:13.968997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Port 37f13e0f-1f8b-4106-974a-bdabfab506b1 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:13.969323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Attempting to bind port 37f13e0f-1f8b-4106-974a-bdabfab506b1 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:14.025079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:14.025400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:14.025797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:14.026496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Bound port: 37f13e0f-1f8b-4106-974a-bdabfab506b1, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:14.026845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.118734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-0d3b3958-a15b-470f-87de-9203d3dcb23e tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/169ecac2-300f-4c12-a483-baef23697095 HTTP/1.1" status: 200 len: 1818 time: 0.1750753 Dec 21 03:50:14.140856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Request body: {'security_group': {'name': 'tempest-sg-hth-1303258368', 'description': 'tempest-description-hth-9774865'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:14.377199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.422300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] For port 37f13e0f-1f8b-4106-974a-bdabfab506b1, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:14.478422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] For port 37f13e0f-1f8b-4106-974a-bdabfab506b1, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:14.500145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-1f6c4fe6-ccfc-4403-ab99-f4efd7f3e8ea tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:14.501674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-1f6c4fe6-ccfc-4403-ab99-f4efd7f3e8ea tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.3577924 Dec 21 03:50:14.532477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.resource_extend [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 03:50:14.539622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.578739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.590580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-8e6e8ee1-9289-42b5-928c-da5c15ca4d87 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/quotas/e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 375 time: 0.0790899 Dec 21 03:50:14.655559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-edbf4578-7b17-4f11-b0e8-6c66b0a51253 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:14.656562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.657180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-edbf4578-7b17-4f11-b0e8-6c66b0a51253 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.31 "GET /v2.0/networks?id=38668209-04ad-4602-a5aa-ab7bc4e1b781 HTTP/1.1" status: 200 len: 814 time: 0.1125274 Dec 21 03:50:14.660089 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.661445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb8c504c-5491-4a6a-90cd-46879a9f41aa req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "PUT /v2.0/security-groups/169ecac2-300f-4c12-a483-baef23697095 HTTP/1.1" status: 200 len: 1789 time: 0.5355656 Dec 21 03:50:14.667165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:14.667832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.669138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] 10.222.0.54 "PUT /v2.0/ports/37f13e0f-1f8b-4106-974a-bdabfab506b1 HTTP/1.1" status: 200 len: 1096 time: 2.0888455 Dec 21 03:50:14.690219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'tag': '37f13e0f-1f8b-4106-974a-bdabfab506b1'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:14.692007 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b424c4fa-683d-4050-929a-f479670f535d" -d '{"events": [{"name": "network-changed", "server_uuid": "e79302e4-e242-46c5-9c2e-815f45ecc574", "tag": "37f13e0f-1f8b-4106-974a-bdabfab506b1"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:14.703496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-6b6d49c0-8192-4289-ab7b-477fac4c2be8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0951324 Dec 21 03:50:14.718641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:14.736503 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-40bf96f0-f712-43ec-9d0c-b41e9c6b89a8 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e8135ee47f84444cb5d3eb45b6c7590b HTTP/1.1" status: 200 len: 380 time: 0.0627010 Dec 21 03:50:14.751492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Request body: {'port': {'device_id': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'admin_state_up': True, 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'security_groups': ['05fa0fae-c6cf-433a-b048-dc55af7ef60f']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:14.768657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51318bde-18a3-4767-a815-223544700cbd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=169ecac2-300f-4c12-a483-baef23697095,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:14.770660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f789b2a-70cb-4560-ad97-a92e6025ce5e service neutron] Pushing event updated for resources: {'Port': ['ID=37f13e0f-1f8b-4106-974a-bdabfab506b1,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:15.041818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Made reservation on behalf of e8135ee47f84444cb5d3eb45b6c7590b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:15.045814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:15.137282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:15.180006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Allocated IP 172.20.0.10 (38668209-04ad-4602-a5aa-ab7bc4e1b781/2f0e0720-c89e-4a8a-888b-1e146411b74a/365ed775-700d-4bba-8a8e-a1419759e777) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:15.247816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-207b7423-d860-4469-8594-b89f93eb5091 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips/4deae396-e354-4579-b552-0d2c6aa4df0a HTTP/1.1" status: 200 len: 693 time: 0.1200836 Dec 21 03:50:15.339918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-2d528001-a8ef-4445-9afc-08aa3b9e2b62 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6127594 Dec 21 03:50:15.345510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-ce7cd77d-a16c-469c-bdda-0d5345be9f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:15.347041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-ce7cd77d-a16c-469c-bdda-0d5345be9f5f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 1099 time: 0.2208991 Dec 21 03:50:15.475604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-73457a07-28ce-4f69-be94-6800d891fb78 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.94&port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1 HTTP/1.1" status: 200 len: 217 time: 0.0831456 Dec 21 03:50:15.481313 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Floating IP 7b75aeab-4063-4bcf-904d-54f363b49069 associated. External IP: 172.25.5.36, port: 3a3dc231-a27a-4c00-a859-1a62de02e991. Dec 21 03:50:15.608488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ebf12ddc-a885-423e-8700-0570a30b049e tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:15.609342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ebf12ddc-a885-423e-8700-0570a30b049e tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.3510540 Dec 21 03:50:15.619682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:15.675697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-913b9d6a-3104-4297-a588-578b1fc92ad4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:15.677184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-913b9d6a-3104-4297-a588-578b1fc92ad4 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1893415 Dec 21 03:50:15.722085 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:15.727760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-d3fb6cdd-43e0-49ad-abd3-e39a090794c1 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.111 HTTP/1.1" status: 200 len: 696 time: 0.1089315 Dec 21 03:50:15.770690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-e50ea354-9d87-4794-b503-9588f8e01e83 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4189832 Dec 21 03:50:15.778477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:15.782517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:15.787076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:15.840328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-39816a81-d77d-477a-8fe9-82c12d1f89a1 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.111 HTTP/1.1" status: 200 len: 696 time: 0.0894036 Dec 21 03:50:15.850903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:15.851563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:15.861207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event updated for resources: {'Port': ['ID=365ed775-700d-4bba-8a8e-a1419759e777,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:15.950451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-8ff04da7-19dc-40a6-bc9f-1a07dafa9c03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:15.952062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-8ff04da7-19dc-40a6-bc9f-1a07dafa9c03 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2425580 Dec 21 03:50:15.978655 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d051604d-7420-459a-83dd-1e6e5a9cbc07 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2313948 Dec 21 03:50:16.000662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Request body: {'port': {'device_id': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:16.091720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.157224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8f1b79c5-2956-4e28-bf59-8bc8506cc081 None None] Provisioning complete for port 365ed775-700d-4bba-8a8e-a1419759e777 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:16.158627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f1b79c5-2956-4e28-bf59-8bc8506cc081 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.206401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8f1b79c5-2956-4e28-bf59-8bc8506cc081 None None] Port 365ed775-700d-4bba-8a8e-a1419759e777 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:50:16.231261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Router 2376a5de-876f-4295-bee4-f95526e6331c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:50:16.244026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-4a559b9d-e92a-475f-89d8-117933a7a33a service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2583468 Dec 21 03:50:16.253668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8308de45-b72a-46d6-bcbb-2320d5061b21 req-19074122-23a4-4cff-ac62-34c51f2ee5c1 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:16.261081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8308de45-b72a-46d6-bcbb-2320d5061b21 req-19074122-23a4-4cff-ac62-34c51f2ee5c1 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 945 time: 0.1333516 Dec 21 03:50:16.266168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Deleting port 0732b815-0b16-469d-9da7-d91439235e00 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:16.266509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.403873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 365ed775-700d-4bba-8a8e-a1419759e777 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:16.412380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.424612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Transition to ACTIVE for port object 365ed775-700d-4bba-8a8e-a1419759e777 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:16.476598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8308de45-b72a-46d6-bcbb-2320d5061b21 req-6ad4122e-15a7-4313-8c52-32ec72a6bf69 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2146318 Dec 21 03:50:16.518415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.518748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.519125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.541041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a99247-129f-4d4a-a9f2-903df3737fe4 req-f65bea0d-bc15-4d94-aa26-f7ef382758ee service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2772999 Dec 21 03:50:16.544214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Calling delete_port for 0732b815-0b16-469d-9da7-d91439235e00 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:16.582103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Pushing event updated for resources: {'Port': ['ID=365ed775-700d-4bba-8a8e-a1419759e777,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:16.603558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:50:16.617950 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] Sync routers for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:50:16.629701 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:16.630848 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:16.647337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.688212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-860a34c3-4928-4a9e-9a46-a15440487334 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "PUT /v2.0/floatingips/7b75aeab-4063-4bcf-904d-54f363b49069 HTTP/1.1" status: 200 len: 990 time: 3.3734374 Dec 21 03:50:16.690135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Attempting to bind port 365ed775-700d-4bba-8a8e-a1419759e777 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:16.690484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Attempting to bind port 365ed775-700d-4bba-8a8e-a1419759e777 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:16.690962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Attempting to bind port 365ed775-700d-4bba-8a8e-a1419759e777 on network 38668209-04ad-4602-a5aa-ab7bc4e1b781 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:16.697043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Port 365ed775-700d-4bba-8a8e-a1419759e777 on network 38668209-04ad-4602-a5aa-ab7bc4e1b781 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:16.700694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Attempting to bind port 365ed775-700d-4bba-8a8e-a1419759e777 on network 38668209-04ad-4602-a5aa-ab7bc4e1b781 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:16.700821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b16313c-a174-4aac-b04f-e12f891afa39 req-d2cb6361-dc48-42c6-9fba-96cfaab27d74 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:16.704922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b16313c-a174-4aac-b04f-e12f891afa39 req-d2cb6361-dc48-42c6-9fba-96cfaab27d74 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 944 time: 0.1661179 Dec 21 03:50:16.705434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:16.705912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Checking segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:16.706526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Bound using segment: {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:16.707136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Bound port: 365ed775-700d-4bba-8a8e-a1419759e777, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:16.707517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.786199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] For port 365ed775-700d-4bba-8a8e-a1419759e777, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:16.789343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b16313c-a174-4aac-b04f-e12f891afa39 req-e2695cfc-9c44-48b7-940d-8883c1a4d345 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834203 Dec 21 03:50:16.791094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] For port 365ed775-700d-4bba-8a8e-a1419759e777, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=365ed775-700d-4bba-8a8e-a1419759e777,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:16.804982 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:16.861871 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.878092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-babde4e1-daea-4fc7-864b-59d80b898cac req-f8b651db-8add-417a-abde-94bf1367b2ed tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/169ecac2-300f-4c12-a483-baef23697095 HTTP/1.1" status: 200 len: 1789 time: 0.0571370 Dec 21 03:50:16.913427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:16.914104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.915500 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] 10.222.0.31 "PUT /v2.0/ports/365ed775-700d-4bba-8a8e-a1419759e777 HTTP/1.1" status: 200 len: 1093 time: 0.9194679 Dec 21 03:50:16.915977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:16.918722 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d" -d '{"events": [{"name": "network-changed", "server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "tag": "365ed775-700d-4bba-8a8e-a1419759e777"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:16.940869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-240cb154-746b-4c60-9f08-2443b3e0693f service neutron] Pushing event updated for resources: {'Port': ['ID=365ed775-700d-4bba-8a8e-a1419759e777,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:16.950627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:16.968421 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90284600-261f-476d-95ce-c7dfb542ef7e x-openstack-request-id: req-90284600-261f-476d-95ce-c7dfb542ef7e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:16.968802 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e79302e4-e242-46c5-9c2e-815f45ecc574", "tag": "37f13e0f-1f8b-4106-974a-bdabfab506b1", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:16.969129 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-90284600-261f-476d-95ce-c7dfb542ef7e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:16.969664 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'tag': '37f13e0f-1f8b-4106-974a-bdabfab506b1', 'status': 'completed', 'code': 200} Dec 21 03:50:16.993601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event deleted for resources: {'Port': ['ID=0732b815-0b16-469d-9da7-d91439235e00,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:17.099984 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '7b75aeab-4063-4bcf-904d-54f363b49069', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'floating_ip_address': '172.25.5.36', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'port_id': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 803, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'mac_address': 'fa:16:3e:d6:ce:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:48:43Z', 'updated_at': '2021-12-21T03:50:14Z', 'revision_number': 1, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:17.118501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-6bcae464-140d-4cc4-ba5d-3695cc4f238f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.120748 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-6bcae464-140d-4cc4-ba5d-3695cc4f238f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e8135ee47f84444cb5d3eb45b6c7590b&device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 1096 time: 0.0750668 Dec 21 03:50:17.132951 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] Checking router: 2376a5de-876f-4295-bee4-f95526e6331c for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:50:17.134533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:17.137260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:17.139045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d7ff944-f88d-4e1e-9710-cd27e67529d9 req-ea8b797b-86b6-4453-848b-ee6b68b3e259 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "DELETE /v2.0/floatingips/4deae396-e354-4579-b552-0d2c6aa4df0a HTTP/1.1" status: 204 len: 173 time: 1.2973795 Dec 21 03:50:17.141392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b424c4fa-683d-4050-929a-f479670f535d req-9420ae2f-810e-4ded-99cb-f0ecceb9856b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.143145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-9420ae2f-810e-4ded-99cb-f0ecceb9856b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 1099 time: 0.1458247 Dec 21 03:50:17.147086 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:17.147719 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:49:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:17.181986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9153e08-c1ca-449f-a270-8098b91f2a31 req-efaee24e-cdb1-4f6a-aefa-eb569fe53965 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.190036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b9153e08-c1ca-449f-a270-8098b91f2a31 req-efaee24e-cdb1-4f6a-aefa-eb569fe53965 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1192393 Dec 21 03:50:17.242994 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-3356238f-7aa3-4cb3-96e9-fa5672981e3a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=365ed775-700d-4bba-8a8e-a1419759e777 HTTP/1.1" status: 200 len: 217 time: 0.1054256 Dec 21 03:50:17.292304 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:17.308703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-a4f2d4af-3b9c-413c-a2a1-59dbedee3a81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.310293 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-a4f2d4af-3b9c-413c-a2a1-59dbedee3a81 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2f0e0720-c89e-4a8a-888b-1e146411b74a HTTP/1.1" status: 200 len: 853 time: 0.0606673 Dec 21 03:50:17.363701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-5ae1f50e-6b1c-4159-b105-8c6cefe1cb47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.365741 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-5ae1f50e-6b1c-4159-b105-8c6cefe1cb47 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=38668209-04ad-4602-a5aa-ab7bc4e1b781&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0461528 Dec 21 03:50:17.489433 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-d94d13f9-3fe8-4d77-81ab-8fa87afbb9c3 service neutron] 10.222.0.31 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0983882 Dec 21 03:50:17.554762 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '7b75aeab-4063-4bcf-904d-54f363b49069', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'floating_ip_address': '172.25.5.36', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'port_id': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 803, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'mac_address': 'fa:16:3e:d6:ce:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:48:43Z', 'updated_at': '2021-12-21T03:50:14Z', 'revision_number': 1, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:17.604718 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ff035d8-e08e-4ad0-b573-65d7dbf4bddd None None] The sync data for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 is: [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '7b75aeab-4063-4bcf-904d-54f363b49069', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'floating_ip_address': '172.25.5.36', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'port_id': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 803, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'mac_address': 'fa:16:3e:d6:ce:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:48:43Z', 'updated_at': '2021-12-21T03:50:14Z', 'revision_number': 1, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:50:17.609621 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8f164f86-3069-4c6f-ab70-b3839df8cee3 req-45a71cd8-64dd-45d3-a93f-217b24337925 service neutron] 10.222.0.31 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0985873 Dec 21 03:50:17.635469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b9153e08-c1ca-449f-a270-8098b91f2a31 req-e6264b90-9256-4abd-ac1f-0d5ef94a06d0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4445176 Dec 21 03:50:17.657226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08263359-43c9-4478-b63a-f54f95dde7f1 req-00fe3c4f-3bb2-4a90-a73f-3c3bce73a1e9 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.657226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08263359-43c9-4478-b63a-f54f95dde7f1 req-00fe3c4f-3bb2-4a90-a73f-3c3bce73a1e9 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 947 time: 0.4064825 Dec 21 03:50:17.657226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b424c4fa-683d-4050-929a-f479670f535d req-46c46495-50b3-476a-95d5-9274cbd20a5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.657226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-46c46495-50b3-476a-95d5-9274cbd20a5b service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.5007000 Dec 21 03:50:17.709852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-d3d08b86-eed5-4293-af5a-78e01305ecf9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.94&port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1 HTTP/1.1" status: 200 len: 217 time: 0.0439308 Dec 21 03:50:17.745912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3eb56a1a-b16b-4cf1-9816-1361f4582cb2 req-ab7edeaf-5f43-4012-a96e-144b54301751 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 210 time: 0.0377417 Dec 21 03:50:17.797964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08263359-43c9-4478-b63a-f54f95dde7f1 req-5462799a-db34-46aa-9587-3e3b554216d8 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1381667 Dec 21 03:50:17.805658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b424c4fa-683d-4050-929a-f479670f535d req-d4a47486-9bb4-4462-b51a-3e76cf91a99d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.809396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-d4a47486-9bb4-4462-b51a-3e76cf91a99d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0863886 Dec 21 03:50:17.885650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b424c4fa-683d-4050-929a-f479670f535d req-581bcda3-7531-46da-abfc-d416b7622b31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:17.887228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-581bcda3-7531-46da-abfc-d416b7622b31 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0587487 Dec 21 03:50:17.900766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e42e0cb-0d67-4039-9a68-970de30d1ac7 None None] New status for floating IP 7b75aeab-4063-4bcf-904d-54f363b49069: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:50:18.059707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63ca4cc1-56bd-4dda-872c-8faaef67dbb2 req-920a0c2e-c354-4f0f-9b4c-e62f920dc56f tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/169ecac2-300f-4c12-a483-baef23697095 HTTP/1.1" status: 200 len: 1789 time: 0.0912230 Dec 21 03:50:18.094350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-9c2a0ae5-7e9a-469e-a998-1a5f95d425a6 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1340635 Dec 21 03:50:18.148281 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79375404-1246-44f1-9ade-bb50c2016af3 x-openstack-request-id: req-79375404-1246-44f1-9ade-bb50c2016af3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:18.148816 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "tag": "365ed775-700d-4bba-8a8e-a1419759e777", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:18.148816 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-79375404-1246-44f1-9ade-bb50c2016af3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:18.149233 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777', 'status': 'completed', 'code': 200} Dec 21 03:50:18.196597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-63ca4cc1-56bd-4dda-872c-8faaef67dbb2 req-ffce4767-20af-45a2-a52d-9f9f94929c31 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:18.249626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-57fd951c-5f48-4e32-a1fe-73881a845a07 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips/8a8ad8ce-6321-4258-9f29-fbfb5d7d2fa2 HTTP/1.1" status: 200 len: 692 time: 0.0747926 Dec 21 03:50:18.252515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-b84a70ca-9b2e-4eb2-ab44-c756513f9eea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.254240 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-b84a70ca-9b2e-4eb2-ab44-c756513f9eea service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e8135ee47f84444cb5d3eb45b6c7590b&device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 1096 time: 0.0456405 Dec 21 03:50:18.280263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-63ca4cc1-56bd-4dda-872c-8faaef67dbb2 req-ffce4767-20af-45a2-a52d-9f9f94929c31 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:18.290527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b424c4fa-683d-4050-929a-f479670f535d req-e74511cf-97b1-4d9b-bb43-4dd262f192fa service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1870027 Dec 21 03:50:18.349564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-2c3bf7bd-5ec4-40d6-b077-68aecf53379a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.350995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-2c3bf7bd-5ec4-40d6-b077-68aecf53379a service neutron] 10.222.0.31 "GET /v2.0/networks?id=38668209-04ad-4602-a5aa-ab7bc4e1b781 HTTP/1.1" status: 200 len: 915 time: 0.0880983 Dec 21 03:50:18.401544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-022aeabd-b767-49b3-8c80-0977d3810c48 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.402975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-022aeabd-b767-49b3-8c80-0977d3810c48 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1418800 Dec 21 03:50:18.427469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-57b9dcc0-121e-4d86-94a9-476dc1d5e431 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=365ed775-700d-4bba-8a8e-a1419759e777 HTTP/1.1" status: 200 len: 217 time: 0.0407493 Dec 21 03:50:18.451574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-63ca4cc1-56bd-4dda-872c-8faaef67dbb2 req-ffce4767-20af-45a2-a52d-9f9f94929c31 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:18.454152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-63ca4cc1-56bd-4dda-872c-8faaef67dbb2 req-ffce4767-20af-45a2-a52d-9f9f94929c31 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:18.455303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63ca4cc1-56bd-4dda-872c-8faaef67dbb2 req-ffce4767-20af-45a2-a52d-9f9f94929c31 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/169ecac2-300f-4c12-a483-baef23697095 HTTP/1.1" status: 204 len: 173 time: 0.3897369 Dec 21 03:50:18.464321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-63e2b3e8-4789-41b7-b74e-55560e4d463f tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.58 HTTP/1.1" status: 200 len: 695 time: 0.0538638 Dec 21 03:50:18.469809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffce4767-20af-45a2-a52d-9f9f94929c31 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=169ecac2-300f-4c12-a483-baef23697095,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:18.484320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-a024a6b2-708c-4e1b-9836-ba9e40f284a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.488755 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-a024a6b2-708c-4e1b-9836-ba9e40f284a6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2f0e0720-c89e-4a8a-888b-1e146411b74a HTTP/1.1" status: 200 len: 853 time: 0.0524907 Dec 21 03:50:18.555961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-ee35bfbe-68dc-49de-afcf-bd45bc390f4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.557461 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-ee35bfbe-68dc-49de-afcf-bd45bc390f4b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=38668209-04ad-4602-a5aa-ab7bc4e1b781&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0423362 Dec 21 03:50:18.570262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-fd66fe15-6818-4a8e-835d-ded77df4d852 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.58 HTTP/1.1" status: 200 len: 695 time: 0.0933893 Dec 21 03:50:18.668736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-54a24122-6a8b-4158-8882-b8b7cf23d13b service neutron] 10.222.0.31 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929556 Dec 21 03:50:18.742757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c752de9-3edf-4b66-860c-355e2095cefe req-7019e657-e3f3-4f8b-9c49-675174524c33 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.744290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c752de9-3edf-4b66-860c-355e2095cefe req-7019e657-e3f3-4f8b-9c49-675174524c33 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.2157452 Dec 21 03:50:18.781233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-8a1eec24-d4ea-4244-b722-09788b0d1766 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:18.782737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-8a1eec24-d4ea-4244-b722-09788b0d1766 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.2552869 Dec 21 03:50:18.803302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f8ab6b0a-d1bf-4fe9-8e70-630161d8906d req-0b2d6169-c29e-41ba-a981-79b40fdc38d5 service neutron] 10.222.0.31 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917881 Dec 21 03:50:18.809853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Request body: {'port': {'device_id': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'admin_state_up': True, 'tenant_id': 'e49c9575c393446a904ba5840d68746b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:18.858784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c752de9-3edf-4b66-860c-355e2095cefe req-e3019bf7-3d44-49ca-8118-b1c9b090aaa7 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071565 Dec 21 03:50:18.911804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Deleting port 7e173c08-659d-4b40-8a4c-d091072e6f35 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:18.912151 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:18.989038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:18.991279 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50718d52-6b56-4cda-8465-7fd72f3e3396" -d '{"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:19.049586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.049920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.061853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e1563e-91df-4719-a475-b5098133a7d5 req-45816476-7620-45fc-bf41-c47e32ff0a27 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:19.063367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0e1563e-91df-4719-a475-b5098133a7d5 req-45816476-7620-45fc-bf41-c47e32ff0a27 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 944 time: 0.1382096 Dec 21 03:50:19.095091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Calling delete_port for 7e173c08-659d-4b40-8a4c-d091072e6f35 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:19.160171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Made reservation on behalf of e49c9575c393446a904ba5840d68746b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:19.163639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.170378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0e1563e-91df-4719-a475-b5098133a7d5 req-19739fca-fe72-4472-8ef1-201ab834037d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0999432 Dec 21 03:50:19.382783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e6d9fed-199b-4d54-9003-283d57e60146 req-78c326f4-9884-4861-b2fc-226d5cccbdf6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:19.384385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e6d9fed-199b-4d54-9003-283d57e60146 req-78c326f4-9884-4861-b2fc-226d5cccbdf6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 945 time: 0.1389930 Dec 21 03:50:19.389436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Allocated IP 172.20.0.9 (5fd01e07-75a4-4745-ad05-8ade1a021605/13099c8a-54c1-41b2-a4f4-664d17e69495/9e909a4e-75c1-4fe8-8139-ff2546a86bf6) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:19.464551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e6d9fed-199b-4d54-9003-283d57e60146 req-4723d486-e5de-4ecf-b343-76d898ccf6a2 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702190 Dec 21 03:50:19.537471 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.574000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event deleted for resources: {'Port': ['ID=7e173c08-659d-4b40-8a4c-d091072e6f35,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:19.626515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bb4fd29-a227-4c61-bb39-ad2834a556e5 req-8252ea8d-995f-4a7b-8043-740979bf4c39 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 210 time: 0.0561447 Dec 21 03:50:19.660592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 37f13e0f-1f8b-4106-974a-bdabfab506b1 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:19.682274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.705190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.707778 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.708909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06aa21a9-6177-46ea-91ae-eb1a1e7db04f req-6fca174c-d99d-4dae-8504-21e34ec18305 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "DELETE /v2.0/floatingips/8a8ad8ce-6321-4258-9f29-fbfb5d7d2fa2 HTTP/1.1" status: 204 len: 173 time: 1.1190701 Dec 21 03:50:19.763331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0e0359-3736-4f7a-8704-093932d6f7aa req-39316115-a3db-463a-a708-a4b2082dea0c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:19.764909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b0e0359-3736-4f7a-8704-093932d6f7aa req-39316115-a3db-463a-a708-a4b2082dea0c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 947 time: 0.0757325 Dec 21 03:50:19.780022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 37f13e0f-1f8b-4106-974a-bdabfab506b1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:19.792608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '37f13e0f-1f8b-4106-974a-bdabfab506b1', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '37f13e0f-1f8b-4106-974a-bdabfab506b1', 'mac_address': 'fa:16:3e:f3:f1:ab', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.94'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:19.832110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.832267 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.840263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b0e0359-3736-4f7a-8704-093932d6f7aa req-f171a511-c771-47f9-a490-44542dead622 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678015 Dec 21 03:50:19.851735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32f02fbf-4c82-4982-a15f-77696edc1b3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.854054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 37f13e0f-1f8b-4106-974a-bdabfab506b1 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:19.876255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 37f13e0f-1f8b-4106-974a-bdabfab506b1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:19.880585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:19.883686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:19.887464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:19.894603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.938795 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:19.941976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.963820 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:19.981656 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-defef3c2-48f3-4c58-a8d0-ccd53ad71edf x-openstack-request-id: req-defef3c2-48f3-4c58-a8d0-ccd53ad71edf {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:19.982192 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:19.982627 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-defef3c2-48f3-4c58-a8d0-ccd53ad71edf {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:19.983124 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'status': 'completed', 'code': 200} Dec 21 03:50:20.017289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=37f13e0f-1f8b-4106-974a-bdabfab506b1,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:20.058820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-9ac4d72e-d42c-4de0-a0ce-f60f7aae31cd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2532861 Dec 21 03:50:20.084198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Request body: {'port': {'device_id': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:20.151425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.151948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.152420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.152884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.153346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.153804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.154829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.156725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-e0f34bdd-c0ba-4417-a844-3fda8879a263 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6497 time: 0.1117489 Dec 21 03:50:20.210670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:20.224247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-0ed7ffce-d074-4c13-ba17-0d436a766e1e tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips/fabbe06a-27f4-4a50-9b5b-02170090b749 HTTP/1.1" status: 200 len: 692 time: 0.0816405 Dec 21 03:50:20.416090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['37f13e0f-1f8b-4106-974a-bdabfab506b1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:20.454447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-fcbbd4dd-2f34-49bf-9c38-95e321e20251 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.455960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-fcbbd4dd-2f34-49bf-9c38-95e321e20251 service neutron] 10.222.0.54 "GET /v2.0/networks?id=04ed2fa2-4e59-410d-9778-4535a349c6b9 HTTP/1.1" status: 200 len: 913 time: 0.2608612 Dec 21 03:50:20.546972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-a50544df-f425-43f2-bafc-21d888069b0d tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:20.548283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-a50544df-f425-43f2-bafc-21d888069b0d tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.3110693 Dec 21 03:50:20.706658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-0f1036a5-6454-4d03-8227-ef36ead56453 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.25 HTTP/1.1" status: 200 len: 695 time: 0.1426487 Dec 21 03:50:20.715337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-6a021057-8082-4815-bb1b-01fd1e327955 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 200 len: 1000 time: 0.2322912 Dec 21 03:50:21.076242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9cd299-f3bd-4c3c-9b28-9a48949e108f req-9c6e5cad-cb82-4f50-b6f6-5623b0d494d6 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:21.077674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9cd299-f3bd-4c3c-9b28-9a48949e108f req-9c6e5cad-cb82-4f50-b6f6-5623b0d494d6 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.5471580 Dec 21 03:50:21.111230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-416b5d57-0291-4313-963b-ebd2818eea81 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.25 HTTP/1.1" status: 200 len: 695 time: 0.3918772 Dec 21 03:50:21.244121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-471719ab-993d-451e-8922-157141a37298 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:21.245051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-471719ab-993d-451e-8922-157141a37298 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c714b82d-d957-4fc4-96b0-f175d6a234f5 HTTP/1.1" status: 200 len: 851 time: 0.1896451 Dec 21 03:50:21.288351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 365ed775-700d-4bba-8a8e-a1419759e777 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:21.338815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9cd299-f3bd-4c3c-9b28-9a48949e108f req-96be8d74-7043-4c3f-bc7d-b07aa3c27003 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2357302 Dec 21 03:50:21.344538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:21.366336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.391920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 365ed775-700d-4bba-8a8e-a1419759e777, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=365ed775-700d-4bba-8a8e-a1419759e777,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:21.405539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '365ed775-700d-4bba-8a8e-a1419759e777', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'port_id': '365ed775-700d-4bba-8a8e-a1419759e777', 'mac_address': 'fa:16:3e:c8:0c:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:21.405785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Transition to ACTIVE for port object 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:21.407674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-349fb90d-fe89-4f57-a4b6-51c435b24584 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:21.411325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-349fb90d-fe89-4f57-a4b6-51c435b24584 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=04ed2fa2-4e59-410d-9778-4535a349c6b9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1380901 Dec 21 03:50:21.411325 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-bd825f2c-217f-4e9b-9ff3-207037a1aed8 req-0b5a8b6c-c9d4-40ec-a928-cae81032ee10 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:50:21.411975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd825f2c-217f-4e9b-9ff3-207037a1aed8 req-0b5a8b6c-c9d4-40ec-a928-cae81032ee10 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/4e3d2ef3-ddb0-4f02-bff6-3326d4c2ed25 HTTP/1.1" status: 404 len: 352 time: 0.0410872 Dec 21 03:50:21.432941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Deleting port 90e34b11-747a-428c-a783-5bf373f849cb {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:21.433286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.453661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.468243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 365ed775-700d-4bba-8a8e-a1419759e777 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:21.491908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 365ed775-700d-4bba-8a8e-a1419759e777, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=365ed775-700d-4bba-8a8e-a1419759e777,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:21.546578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.569794 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.622797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=365ed775-700d-4bba-8a8e-a1419759e777,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:21.668958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-0fa15c97-b4e2-4e3e-a709-879b856f53d2 service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2461743 Dec 21 03:50:21.671588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:21.678219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.678630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.728719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Calling delete_port for 90e34b11-747a-428c-a783-5bf373f849cb owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:21.752467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e8bb2c7-cb87-45f5-83d8-a2b5ca25a34e req-a4baf603-f691-40d3-a25e-5c336f5e54b1 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:21.753996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e8bb2c7-cb87-45f5-83d8-a2b5ca25a34e req-a4baf603-f691-40d3-a25e-5c336f5e54b1 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 944 time: 0.2562096 Dec 21 03:50:21.941286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50718d52-6b56-4cda-8465-7fd72f3e3396 req-5cc9e621-750c-4cdd-acf5-a3807b238bbe service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2518501 Dec 21 03:50:21.946592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:21.946997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:21.947332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:21.954203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e8bb2c7-cb87-45f5-83d8-a2b5ca25a34e req-6af6bbfc-8dca-4ed6-a288-60c6ec35fcda tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1779561 Dec 21 03:50:21.960727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:21.961093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:21.978324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 49, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:21.978675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:21.979105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:21.979557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Bound port: 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:21.979917 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:21.987360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['365ed775-700d-4bba-8a8e-a1419759e777'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:22.115358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:22.144979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:22.170636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84cd4291-155a-4389-ac98-32826048db02 req-78dc4e38-2311-4821-822d-cbc9f3841ab4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:22.172238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84cd4291-155a-4389-ac98-32826048db02 req-78dc4e38-2311-4821-822d-cbc9f3841ab4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.0760217 Dec 21 03:50:22.178661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9d6103c5-8362-4965-86b3-5d6f47215a9d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.227495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84cd4291-155a-4389-ac98-32826048db02 req-04268363-acd9-4ab9-a44a-c51486c97aaf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458775 Dec 21 03:50:22.229432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.231612 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.282764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:22.283408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.285027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] 10.222.0.31 "PUT /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 1092 time: 2.2062566 Dec 21 03:50:22.285538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:22.288039 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e" -d '{"events": [{"name": "network-changed", "server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:22.359468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525d3b81-3be8-4eb0-aa9a-6055558bdc0d service neutron] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:22.428088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Pushing event deleted for resources: {'Port': ['ID=90e34b11-747a-428c-a783-5bf373f849cb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:22.468365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a452438a-de2e-4260-85b5-7d778fa7a5a4 req-cd704036-2c7d-4db6-86ac-3ec3542c4932 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:22.470202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a452438a-de2e-4260-85b5-7d778fa7a5a4 req-cd704036-2c7d-4db6-86ac-3ec3542c4932 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 948 time: 0.1763308 Dec 21 03:50:22.474844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.477698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.478621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1c0dc8d-c0ca-418b-a002-3811c42e79d6 req-5181c836-fb08-4378-827d-daf537396e16 tempest-FloatingIPDetailsTestJSON-902925630 tempest-FloatingIPDetailsTestJSON-902925630-project] 10.222.0.18 "DELETE /v2.0/floatingips/fabbe06a-27f4-4a50-9b5b-02170090b749 HTTP/1.1" status: 204 len: 173 time: 1.3527143 Dec 21 03:50:22.484850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50452) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:22.520040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-1678feea-7ba6-4d90-93ec-2e6591fbcd85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:22.521783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-1678feea-7ba6-4d90-93ec-2e6591fbcd85 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1095 time: 0.1052592 Dec 21 03:50:22.522102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.541197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a452438a-de2e-4260-85b5-7d778fa7a5a4 req-aa3b91c6-2847-4147-915f-fe78bdbeaf4b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615613 Dec 21 03:50:22.590365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-5651c688-b1ab-4196-8790-c29e091b1171 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 217 time: 0.0479417 Dec 21 03:50:22.619510 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8680f18d-4703-47e1-89ae-93bd78cad12b x-openstack-request-id: req-8680f18d-4703-47e1-89ae-93bd78cad12b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:22.619510 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:22.619510 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8680f18d-4703-47e1-89ae-93bd78cad12b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:22.619863 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'status': 'completed', 'code': 200} Dec 21 03:50:22.646174 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-ba9be4ab-2ccb-4194-bc8c-adb8be4c64e0 req-bacdd18c-d6b7-4d85-92f2-6fa3193310e5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:50:22.648030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba9be4ab-2ccb-4194-bc8c-adb8be4c64e0 req-bacdd18c-d6b7-4d85-92f2-6fa3193310e5 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/bb4f0e15-9be1-4c6e-8512-b8df6c1654c0 HTTP/1.1" status: 404 len: 352 time: 0.0594952 Dec 21 03:50:22.706799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323d1d56-354d-4993-8961-2c332e3a0963 req-af35e945-6462-4014-975f-3b027c5b3d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:22.708390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-af35e945-6462-4014-975f-3b027c5b3d23 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.1073110 Dec 21 03:50:22.719279 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-2b0ed977-9224-4e40-8480-538300bfa101 req-c6c20bd4-93de-4af7-9d98-37168ddea636 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:50:22.720288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b0ed977-9224-4e40-8480-538300bfa101 req-c6c20bd4-93de-4af7-9d98-37168ddea636 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/f3e1b2f8-982c-4b4a-ab18-dc6f4b68eb09 HTTP/1.1" status: 404 len: 352 time: 0.0425823 Dec 21 03:50:22.753955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-b7bdc04a-b6cd-4c2a-97aa-d7a1ea7e57f8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0356553 Dec 21 03:50:22.802204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6378976d-7a6b-4c6f-b591-7b27733f3e43 req-120ce916-c926-47b7-99af-b763c4f3de1b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:22.803455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6378976d-7a6b-4c6f-b591-7b27733f3e43 req-120ce916-c926-47b7-99af-b763c4f3de1b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1414001 Dec 21 03:50:22.804523 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-85a4f461-1ba6-46d9-947f-0c7041d3be75 req-6ce99331-eeb4-423a-b25d-dbf61f4fd63b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:50:22.805451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a4f461-1ba6-46d9-947f-0c7041d3be75 req-6ce99331-eeb4-423a-b25d-dbf61f4fd63b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/1a26e962-4681-4879-b24c-6debfb2147b6 HTTP/1.1" status: 404 len: 352 time: 0.0543795 Dec 21 03:50:22.900336 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-2f6e01c8-12af-49f6-b560-2808c988c245 req-679c16aa-ee05-47bf-8c68-a6741202adb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:50:22.901660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f6e01c8-12af-49f6-b560-2808c988c245 req-679c16aa-ee05-47bf-8c68-a6741202adb8 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/992c614c-17c7-48de-b4c8-7a6a3c0b7e86 HTTP/1.1" status: 404 len: 352 time: 0.0614569 Dec 21 03:50:22.918404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:22.955802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6378976d-7a6b-4c6f-b591-7b27733f3e43 req-915da5b1-0d25-45b4-ab36-d908968fedc0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1434894 Dec 21 03:50:22.963564 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-c407ffe8-22e6-467f-9e3c-e1b6e08d8bb0 req-b428a2c0-6fb8-424a-b89a-f8bd30376178 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] show failed (client error): The resource could not be found. Dec 21 03:50:22.965422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c407ffe8-22e6-467f-9e3c-e1b6e08d8bb0 req-b428a2c0-6fb8-424a-b89a-f8bd30376178 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/9b13f39b-684a-4e8d-b672-7f0fd36950ef HTTP/1.1" status: 404 len: 352 time: 0.0340495 Dec 21 03:50:22.968732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-96fe057f-41e8-45f7-a9d6-7469a4fe2ab7 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2045388 Dec 21 03:50:23.119600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323d1d56-354d-4993-8961-2c332e3a0963 req-75dc07c1-0891-4c0d-acd4-769e69a1a563 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1394243 Dec 21 03:50:23.127370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd303f5c-405f-4c06-ae6e-e34d968c2765 req-017d189e-e8f9-4097-848d-2f1fab8a0924 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:23.128804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd303f5c-405f-4c06-ae6e-e34d968c2765 req-017d189e-e8f9-4097-848d-2f1fab8a0924 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 945 time: 0.0718141 Dec 21 03:50:23.158041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.191661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd303f5c-405f-4c06-ae6e-e34d968c2765 req-161df320-5e37-4504-aeae-dffa4f37ba74 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569136 Dec 21 03:50:23.236893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Deleting port ff6421b9-f83c-4f61-a374-b480489375bf {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:23.237243 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.289395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:23.311120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 365ed775-700d-4bba-8a8e-a1419759e777 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:23.320843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] For port ff6421b9-f83c-4f61-a374-b480489375bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff6421b9-f83c-4f61-a374-b480489375bf,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:23.321312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.337990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Calling delete_port for ff6421b9-f83c-4f61-a374-b480489375bf owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:23.468741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:23.483864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'mac_address': 'fa:16:3e:90:ee:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:23.515384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 365ed775-700d-4bba-8a8e-a1419759e777 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:23.525856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 365ed775-700d-4bba-8a8e-a1419759e777 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:23.526724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.546155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-7370b089-8b88-40db-9b25-aca797795a46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:23.547688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-7370b089-8b88-40db-9b25-aca797795a46 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1095 time: 0.2203269 Dec 21 03:50:23.561511 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.567462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6ba699-72c2-4936-8c13-158e287f2395 req-1309f7e0-b9d3-4526-b032-bf5558f1b35b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:23.570079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb6ba699-72c2-4936-8c13-158e287f2395 req-1309f7e0-b9d3-4526-b032-bf5558f1b35b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.2053125 Dec 21 03:50:23.584573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a805f07a-8112-4dcc-bd3b-8dd18020448e req-d2382f68-a144-45cb-ba05-b5208792fa47 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:23.584735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id abe0c0b5-39cd-48b7-a7cf-ad2813087b79 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:23.584836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a805f07a-8112-4dcc-bd3b-8dd18020448e req-d2382f68-a144-45cb-ba05-b5208792fa47 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1023 time: 0.1302466 Dec 21 03:50:23.604780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:23.606891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.645703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Pushing event deleted for resources: {'Port': ['ID=ff6421b9-f83c-4f61-a374-b480489375bf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:23.783630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb6ba699-72c2-4936-8c13-158e287f2395 req-6ccb0ea8-78f8-4902-b8a4-9c49adab1453 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2009177 Dec 21 03:50:23.808315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 37f13e0f-1f8b-4106-974a-bdabfab506b1 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:23.816964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.832691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-b8c082b8-a248-4d9d-affb-99fab2894f35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:23.834411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-b8c082b8-a248-4d9d-affb-99fab2894f35 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.2528512 Dec 21 03:50:23.860309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a805f07a-8112-4dcc-bd3b-8dd18020448e req-7b0772db-8739-4c4d-878a-94a5a96b5d6b tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=1f9e72e0-e144-4773-b0f9-6520a96c3335&id=81a36cae-1a32-4478-b646-000893538e6f&id=073a7b61-e5f8-496f-b950-4eee24692787&fields=id&fields=name HTTP/1.1" status: 200 len: 517 time: 0.2637565 Dec 21 03:50:23.892052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.910999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:23.965809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-791c787b-f417-4918-baac-33cee06d082b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 217 time: 0.1028695 Dec 21 03:50:23.979931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:23.983071 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe57c8cc-aa23-4a4a-af77-2405d976437e" -d '{"events": [{"server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "name": "network-vif-plugged", "status": "completed", "tag": "365ed775-700d-4bba-8a8e-a1419759e777"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:23.989093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:24.005113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 365ed775-700d-4bba-8a8e-a1419759e777, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=365ed775-700d-4bba-8a8e-a1419759e777,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:24.018467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['abe0c0b5-39cd-48b7-a7cf-ad2813087b79'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:24.076813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.110443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 37f13e0f-1f8b-4106-974a-bdabfab506b1 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:24.113687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-e0c8994b-6cc7-47e4-93d1-5c5e21e9e00d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:24.115336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-e0c8994b-6cc7-47e4-93d1-5c5e21e9e00d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.1356874 Dec 21 03:50:24.135490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 37f13e0f-1f8b-4106-974a-bdabfab506b1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:24.135872 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.155592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-15f93aa5-a9a0-433b-8afb-aeaefc8dafa1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0311673 Dec 21 03:50:24.175357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36f32832-c1a5-4853-a32e-dea2e09f67d5 req-bd75c9ee-6175-4ffb-8c30-e0a4b6d11d88 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:24.176496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36f32832-c1a5-4853-a32e-dea2e09f67d5 req-bd75c9ee-6175-4ffb-8c30-e0a4b6d11d88 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 948 time: 0.2221227 Dec 21 03:50:24.178044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=365ed775-700d-4bba-8a8e-a1419759e777,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:24.226468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:50:24.244424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f36621-31aa-4256-b9bc-031099c13b7d req-e6d8ea84-1715-4c11-bacb-51c91eaa8c78 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:24.246342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9f36621-31aa-4256-b9bc-031099c13b7d req-e6d8ea84-1715-4c11-bacb-51c91eaa8c78 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1701708 Dec 21 03:50:24.326860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.354607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:50:24.357053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36f32832-c1a5-4853-a32e-dea2e09f67d5 req-585c3cc0-dd04-404b-9611-482ae8690819 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1562910 Dec 21 03:50:24.375272 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] Sync routers for ids ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:50:24.381681 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ac01c3de-a757-430e-a4e2-31d4bc64828b admin admin] 10.222.0.18 "PUT /v2.0/routers/d1b7ae4c-e59a-4693-84a5-d0a6f5972720/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8929551 Dec 21 03:50:24.382385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50514) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:24.400527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 37f13e0f-1f8b-4106-974a-bdabfab506b1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:24.402210 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] Routers {'d1b7ae4c-e59a-4693-84a5-d0a6f5972720'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:24.402841 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:50:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:24.417155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9f36621-31aa-4256-b9bc-031099c13b7d req-33a68acb-c97a-4986-9253-0114fbfabc49 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121292 Dec 21 03:50:24.425311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-1f5b54d6-6704-43c0-a3b8-4cc5da6a7c53 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2445846 Dec 21 03:50:24.430423 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2cce5de9-99c8-441e-a05d-fb1fda71d2b2 x-openstack-request-id: req-2cce5de9-99c8-441e-a05d-fb1fda71d2b2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:24.430856 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "name": "network-vif-plugged", "status": "completed", "tag": "365ed775-700d-4bba-8a8e-a1419759e777", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:24.431242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2cce5de9-99c8-441e-a05d-fb1fda71d2b2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:24.431792 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777', 'code': 200} Dec 21 03:50:24.470782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.596324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=37f13e0f-1f8b-4106-974a-bdabfab506b1,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:24.611307 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] Set router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:24.639269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11c8b9ab-cdb5-448e-9b1f-af01a57f254e req-442f5ccc-4fa4-4fa2-8072-a08596956c32 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1982102 Dec 21 03:50:24.674677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4ab75-2eca-446f-ad57-3af62db5cea8 req-56bf09b1-cc8b-4a26-adc9-64bdf55b2d41 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:24.676289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccf4ab75-2eca-446f-ad57-3af62db5cea8 req-56bf09b1-cc8b-4a26-adc9-64bdf55b2d41 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.1270239 Dec 21 03:50:24.686076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.692384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fb8854-f894-4617-8be2-4c4785d8f0d2 req-d41a0c12-3278-412d-83b7-4b582afbdd7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:24.694492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64fb8854-f894-4617-8be2-4c4785d8f0d2 req-d41a0c12-3278-412d-83b7-4b582afbdd7d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 1098 time: 0.1043978 Dec 21 03:50:24.739213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.771747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccf4ab75-2eca-446f-ad57-3af62db5cea8 req-128e6af0-e0b1-40ba-b354-5ef2239b7771 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0891418 Dec 21 03:50:24.819601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64fb8854-f894-4617-8be2-4c4785d8f0d2 req-97837f28-54e7-4859-a21e-e31eb6211492 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0915990 Dec 21 03:50:24.841478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:24.877161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:50:23Z', 'revision_number': 5, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:24.929802 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] Checking router: d1b7ae4c-e59a-4693-84a5-d0a6f5972720 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:50:24.940937 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] Routers {'d1b7ae4c-e59a-4693-84a5-d0a6f5972720'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:24.941838 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:50:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:24.975464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d0a541-6f90-4a83-94f8-00c9d9831621 req-403314e4-57c8-4f7f-9796-afd141b07097 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:24.986697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90d0a541-6f90-4a83-94f8-00c9d9831621 req-403314e4-57c8-4f7f-9796-afd141b07097 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.1135907 Dec 21 03:50:25.004914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.103420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Deleting port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:25.105943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90d0a541-6f90-4a83-94f8-00c9d9831621 req-ea241f80-7af0-4584-92be-d2d4355e0a38 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182063 Dec 21 03:50:25.108773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.256115 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] Set router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:25.269160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] For port a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:25.269316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.283613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Calling delete_port for a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:25.290124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa296c9c-d144-402e-ab69-84cda492fb4b req-6ec46985-8063-43ee-910d-914b44a1aff9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:25.292424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa296c9c-d144-402e-ab69-84cda492fb4b req-6ec46985-8063-43ee-910d-914b44a1aff9 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1023 time: 0.0894225 Dec 21 03:50:25.327484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:25.383263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa296c9c-d144-402e-ab69-84cda492fb4b req-9e4e00a5-f146-4b82-9e17-7f9cddab3b56 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=1f9e72e0-e144-4773-b0f9-6520a96c3335&id=81a36cae-1a32-4478-b646-000893538e6f&id=073a7b61-e5f8-496f-b950-4eee24692787&fields=id&fields=name HTTP/1.1" status: 200 len: 517 time: 0.0817196 Dec 21 03:50:25.494824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:25.501237 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.521104 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:50:23Z', 'revision_number': 5, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:25.557982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbdbd53-38b5-4ca9-8f90-3e5ba40744cf req-403cb38a-fc6e-4d0e-91c5-b05f0771de97 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:25.569890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfbdbd53-38b5-4ca9-8f90-3e5ba40744cf req-403cb38a-fc6e-4d0e-91c5-b05f0771de97 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.0980597 Dec 21 03:50:25.576404 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c6ea8d-6455-4409-b11b-1203ea8c019a None None] The sync data for ids ['d1b7ae4c-e59a-4693-84a5-d0a6f5972720'] in n-d-822053-11 is: [{'id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'name': 'tempest-FloatingIPDetailsTestJSON-761887281-router', 'tenant_id': '55f2bf80332241bbb5e3eda21038f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194'}], 'enable_snat': True}, 'gw_port_id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:36Z', 'updated_at': '2021-12-21T03:50:23Z', 'revision_number': 5, 'project_id': '55f2bf80332241bbb5e3eda21038f4f0', 'gw_port': {'id': 'a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:45:47:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1b7ae4c-e59a-4693-84a5-d0a6f5972720', 'device_owner': 'network:router_gateway', 'standard_attr_id': 868, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:37Z', 'updated_at': '2021-12-21T03:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.614033 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c8a614-010d-440d-8d54-8298292197ca req-0ea8015c-6424-4765-922a-f03a77034711 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-91c8a614-010d-440d-8d54-8298292197ca req-0ea8015c-6424-4765-922a-f03a77034711 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1023 time: 0.1155033 Dec 21 03:50:25.617499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.649912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:25.690075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.700946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.720158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfbdbd53-38b5-4ca9-8f90-3e5ba40744cf req-91024443-9a19-40c1-964d-2a9d72217ed3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1406507 Dec 21 03:50:25.740988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438553f9-ad4f-406c-8a85-e03156d95bf4 req-96595394-77c4-4c15-81bc-7552fe119327 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:25.743702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438553f9-ad4f-406c-8a85-e03156d95bf4 req-96595394-77c4-4c15-81bc-7552fe119327 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1694689 Dec 21 03:50:25.816398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:25.873476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-438553f9-ad4f-406c-8a85-e03156d95bf4 req-50ba1534-e562-4613-9682-e06f95a02e65 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1144664 Dec 21 03:50:25.894376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:25.994525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37d64cf-8d90-49e2-9555-31f684c876eb req-8a8a7074-3729-4d7d-b5b9-6a3ea5c1b3f4 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:25.996322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f37d64cf-8d90-49e2-9555-31f684c876eb req-8a8a7074-3729-4d7d-b5b9-6a3ea5c1b3f4 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.1050394 Dec 21 03:50:26.013915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:26.082768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f37d64cf-8d90-49e2-9555-31f684c876eb req-7299a024-ea68-409b-a84e-a618a1e60c91 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774083 Dec 21 03:50:26.227189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.259828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae9c727d-2a56-4b55-a714-17aac85e7798 req-3453546b-cf26-4f87-976a-de3e3b582aae tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:26.268101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae9c727d-2a56-4b55-a714-17aac85e7798 req-3453546b-cf26-4f87-976a-de3e3b582aae tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.1055319 Dec 21 03:50:26.363603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae9c727d-2a56-4b55-a714-17aac85e7798 req-d37fc82d-be4a-4121-877a-c0aa14ec1a42 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944889 Dec 21 03:50:26.400028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.403559 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.433311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37f13e0f-1f8b-4106-974a-bdabfab506b1'}, {'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:26.437013 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ab58d03-9e19-4c89-9dea-c09c9ac0a0d6" -d '{"events": [{"server_uuid": "e79302e4-e242-46c5-9c2e-815f45ecc574", "name": "network-vif-plugged", "status": "completed", "tag": "37f13e0f-1f8b-4106-974a-bdabfab506b1"}, {"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-plugged", "status": "completed", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:26.486522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Deleting port 6520df7f-f451-4f99-acca-7d2857ec0001 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:26.486868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.495088 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-041a89ec-64fa-4183-8140-e433b761a31a x-openstack-request-id: req-041a89ec-64fa-4183-8140-e433b761a31a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:26.495514 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e79302e4-e242-46c5-9c2e-815f45ecc574", "name": "network-vif-plugged", "status": "completed", "tag": "37f13e0f-1f8b-4106-974a-bdabfab506b1", "code": 200}, {"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-plugged", "status": "completed", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:26.495890 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-041a89ec-64fa-4183-8140-e433b761a31a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:26.496412 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37f13e0f-1f8b-4106-974a-bdabfab506b1', 'code': 200} Dec 21 03:50:26.496769 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'code': 200} Dec 21 03:50:26.558852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.559619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d1b7ae4c-e59a-4693-84a5-d0a6f5972720 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:50:26.571133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.572600 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d9412abb-375c-4ec6-b5d2-ca12f51ed8c3 admin admin] 10.222.0.18 "DELETE /v2.0/routers/d1b7ae4c-e59a-4693-84a5-d0a6f5972720 HTTP/1.1" status: 204 len: 168 time: 2.1892574 Dec 21 03:50:26.575639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50556) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:26.590621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03876fa-e80a-4b33-af55-3d4cf0182db3 req-01d467f5-4fbb-4af9-a323-b79e311050e0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:26.600399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c03876fa-e80a-4b33-af55-3d4cf0182db3 req-01d467f5-4fbb-4af9-a323-b79e311050e0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 1023 time: 0.0938981 Dec 21 03:50:26.677067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Deleting subnet 980e5c6c-efca-4c8e-9554-34f78b220c78 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:50:26.688910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] For port 6520df7f-f451-4f99-acca-7d2857ec0001, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6520df7f-f451-4f99-acca-7d2857ec0001,segment=NetworkSegment(a212bdf2-4f6e-4cc1-a1e5-789fec8069b8),segment_id=a212bdf2-4f6e-4cc1-a1e5-789fec8069b8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:26.689426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.692090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.730824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c03876fa-e80a-4b33-af55-3d4cf0182db3 req-89ccfc10-42fe-4900-999f-3507c0b42499 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups?id=1f9e72e0-e144-4773-b0f9-6520a96c3335&id=81a36cae-1a32-4478-b646-000893538e6f&id=073a7b61-e5f8-496f-b950-4eee24692787&fields=id&fields=name HTTP/1.1" status: 200 len: 517 time: 0.1294219 Dec 21 03:50:26.767744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c529b2c-30c4-4576-980b-e1722675de9d req-9d7f19c4-29cb-416a-aee1-6cfae9aeed67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:26.769299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c529b2c-30c4-4576-980b-e1722675de9d req-9d7f19c4-29cb-416a-aee1-6cfae9aeed67 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 1101 time: 0.1477082 Dec 21 03:50:26.780486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Calling delete_port for 6520df7f-f451-4f99-acca-7d2857ec0001 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:26.804948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:26.840467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c529b2c-30c4-4576-980b-e1722675de9d req-cdd3402b-e3a7-4f75-871d-a898faec72cf service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621786 Dec 21 03:50:26.957050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623a4583-176c-4da2-a27b-a14ca3c88858 req-a1bb8047-ad80-4351-82c0-40db9d209abd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:26.965619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-623a4583-176c-4da2-a27b-a14ca3c88858 req-a1bb8047-ad80-4351-82c0-40db9d209abd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.1102583 Dec 21 03:50:27.054129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.073599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-623a4583-176c-4da2-a27b-a14ca3c88858 req-ef9c5691-9221-472e-b9c5-fb862d1c410e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067283 Dec 21 03:50:27.115234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87730a47-35e9-4632-807d-049a9ef99f1d req-b4588250-0ff2-42c9-b1e2-503d5767a2b4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:27.133803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87730a47-35e9-4632-807d-049a9ef99f1d req-b4588250-0ff2-42c9-b1e2-503d5767a2b4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1574559 Dec 21 03:50:27.270288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.283700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.296320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-328a500f-f05e-4b50-93e5-3ee0890d0fe3 None None] Network 243dd4d9-cd73-4cd5-a1b2-67566e390a56 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:27.323959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87730a47-35e9-4632-807d-049a9ef99f1d req-ff5f3792-1f84-4dc1-86af-c7a0a5c4197e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1853607 Dec 21 03:50:27.325065 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.332653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50574) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:27.338449 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/980e5c6c-efca-4c8e-9554-34f78b220c78 HTTP/1.1" status: 204 len: 168 time: 0.7522600 Dec 21 03:50:27.347067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff6421b9-f83c-4f61-a374-b480489375bf no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:27.349348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6389e8c6-f571-4560-bbe4-523986e24a8d req-e89f6646-0c58-46eb-a5f8-489246a09156 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:27.349529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6520df7f-f451-4f99-acca-7d2857ec0001'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:27.351694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6389e8c6-f571-4560-bbe4-523986e24a8d req-e89f6646-0c58-46eb-a5f8-489246a09156 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.1382649 Dec 21 03:50:27.362290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:27.394654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8278ff7-ec5c-465b-91f8-0fc82ff91e33 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=980e5c6c-efca-4c8e-9554-34f78b220c78,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:27.437582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'Port': ['ID=6520df7f-f451-4f99-acca-7d2857ec0001,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:27.447752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] No DVR routers for this DVR port 6520df7f-f451-4f99-acca-7d2857ec0001 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:27.458286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6389e8c6-f571-4560-bbe4-523986e24a8d req-7e278a44-cdec-4926-945a-255687f6f341 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0939994 Dec 21 03:50:27.460637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.464236 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-91c8a614-010d-440d-8d54-8298292197ca req-16c3a403-854f-4634-9c8b-70ae2220b48a tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.31 "DELETE /v2.0/ports/6520df7f-f451-4f99-acca-7d2857ec0001 HTTP/1.1" status: 204 len: 173 time: 1.8419912 Dec 21 03:50:27.464713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'name': 'network-vif-deleted', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:27.481510 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9b87489-f118-491b-ac25-6f293680942e" -d '{"events": [{"server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "name": "network-vif-deleted", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:27.503512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.608185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ff6421b9-f83c-4f61-a374-b480489375bf {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:27.608534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff6421b9-f83c-4f61-a374-b480489375bf not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:27.608958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:27.648416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6bfabf-7552-4668-b3eb-aa0d9fb02a83 req-01df5b42-9cf5-4b9b-8255-9fd4a5745246 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:27.650206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc6bfabf-7552-4668-b3eb-aa0d9fb02a83 req-01df5b42-9cf5-4b9b-8255-9fd4a5745246 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.1179833 Dec 21 03:50:27.655841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:27.656248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6c0a1ea-1dae-4e14-9b0e-1a78b01f14db not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:27.682478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Deleting port a7e14bf3-f9ff-4d21-a803-53108ebc7835 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:27.682830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.695918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:27.714127 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2a81ab2-84e0-4686-b3d6-10c3494c5284 x-openstack-request-id: req-f2a81ab2-84e0-4686-b3d6-10c3494c5284 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:27.714714 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "53f0e223-22b0-4253-a538-864a424aed19", "name": "network-vif-deleted", "tag": "6520df7f-f451-4f99-acca-7d2857ec0001", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:27.716085 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f2a81ab2-84e0-4686-b3d6-10c3494c5284 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:27.717094 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '53f0e223-22b0-4253-a538-864a424aed19', 'name': 'network-vif-deleted', 'tag': '6520df7f-f451-4f99-acca-7d2857ec0001', 'status': 'completed', 'code': 200} Dec 21 03:50:27.727557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'port_id': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'mac_address': 'fa:16:3e:87:17:f1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13099c8a-54c1-41b2-a4f4-664d17e69495', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:27.800491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc6bfabf-7552-4668-b3eb-aa0d9fb02a83 req-70e7d930-5259-45eb-894f-e49c3ca0b76c tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1369765 Dec 21 03:50:27.801958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.819949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] For port a7e14bf3-f9ff-4d21-a803-53108ebc7835, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7e14bf3-f9ff-4d21-a803-53108ebc7835,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:27.820395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:27.833762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] DHCP port deletion for 243dd4d9-cd73-4cd5-a1b2-67566e390a56 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:50:27.844798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:27.924817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:27.949192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] Deleting port a7e14bf3-f9ff-4d21-a803-53108ebc7835 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:27.949502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:28.006593 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:28.050638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] For port a7e14bf3-f9ff-4d21-a803-53108ebc7835, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7e14bf3-f9ff-4d21-a803-53108ebc7835,segment=NetworkSegment(fad4816d-65f0-4062-ab9b-67c169c7b23c),segment_id=fad4816d-65f0-4062-ab9b-67c169c7b23c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:28.051337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:28.073702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] Calling delete_port for a7e14bf3-f9ff-4d21-a803-53108ebc7835 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:28.103531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:28.195669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Calling delete_port for a7e14bf3-f9ff-4d21-a803-53108ebc7835 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:28.230122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12bcc9b0-54e2-4486-ab1b-387aa5877b11 req-feb908c4-d0ef-4021-98bf-40d41a94a137 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/ports?device_id=53f0e223-22b0-4253-a538-864a424aed19 HTTP/1.1" status: 200 len: 210 time: 0.0613954 Dec 21 03:50:28.293427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:28.318853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b91717b-5850-4df5-ad48-2913e3ea47a1 req-876a517c-229b-4d6d-be2e-c033e0ec0b1a tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:28.325431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b91717b-5850-4df5-ad48-2913e3ea47a1 req-876a517c-229b-4d6d-be2e-c033e0ec0b1a tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.4952464 Dec 21 03:50:28.331202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50598) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:28.338662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Request body: {'floatingip': {'port_id': '365ed775-700d-4bba-8a8e-a1419759e777'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:28.362818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] No DVR routers for this DVR port a7e14bf3-f9ff-4d21-a803-53108ebc7835 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:28.402617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:28.448357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9e909a4e-75c1-4fe8-8139-ff2546a86bf6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:28.499669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc0d15a-574c-4f31-9875-892627b8462e None None] Pushing event deleted for resources: {'Port': ['ID=a7e14bf3-f9ff-4d21-a803-53108ebc7835,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:28.617792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60a8f30-0dee-4966-9d64-3645f0d813d4 req-783e233e-d04d-4a4e-8222-503e07806170 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:28.619476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e60a8f30-0dee-4966-9d64-3645f0d813d4 req-783e233e-d04d-4a4e-8222-503e07806170 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1438084 Dec 21 03:50:28.635321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373aa40f-5508-4890-baaf-748115fa5f5b req-dc24d4a7-a9c5-410e-9fce-974a4db0e7cc tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:28.637103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-373aa40f-5508-4890-baaf-748115fa5f5b req-dc24d4a7-a9c5-410e-9fce-974a4db0e7cc tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.2458682 Dec 21 03:50:28.661059 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:28.782499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Pushing event deleted for resources: {'Port': ['ID=a7e14bf3-f9ff-4d21-a803-53108ebc7835,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:28.796434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] No DVR routers for this DVR port a7e14bf3-f9ff-4d21-a803-53108ebc7835 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:28.878881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e60a8f30-0dee-4966-9d64-3645f0d813d4 req-bc7b7048-1e00-40eb-9ccc-d25a1efa10fc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2389431 Dec 21 03:50:28.927149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-373aa40f-5508-4890-baaf-748115fa5f5b req-8fb101d5-bcf6-41b2-b31a-addd64353175 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2669346 Dec 21 03:50:29.007082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.064066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['243dd4d9-cd73-4cd5-a1b2-67566e390a56']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:29.077611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fad4816d-65f0-4062-ab9b-67c169c7b23c') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:29.077917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fad4816d-65f0-4062-ab9b-67c169c7b23c') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:29.093485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.113541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d3d271e-b6c7-4d26-9aaf-3263fa45a285 req-edded11e-279c-407d-8b85-43d060ec8948 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:29.120842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d3d271e-b6c7-4d26-9aaf-3263fa45a285 req-edded11e-279c-407d-8b85-43d060ec8948 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.0982080 Dec 21 03:50:29.140937 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.153276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Releasing vlan 117 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:50:29.153668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:50:29.157500 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:50:29.161713 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:50:29.165737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.237827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.247202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d3d271e-b6c7-4d26-9aaf-3263fa45a285 req-cb2f95ae-7e2d-4954-8cdc-73e7417f9865 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200151 Dec 21 03:50:29.299710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7e14bf3-f9ff-4d21-a803-53108ebc7835 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:29.335186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.345257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.345690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6520df7f-f451-4f99-acca-7d2857ec0001 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:29.345803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] 10.222.0.18 "DELETE /v2.0/networks/243dd4d9-cd73-4cd5-a1b2-67566e390a56 HTTP/1.1" status: 204 len: 168 time: 2.0112295 Dec 21 03:50:29.366345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 6520df7f-f451-4f99-acca-7d2857ec0001 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:29.369101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6520df7f-f451-4f99-acca-7d2857ec0001 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:29.369101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a7e14bf3-f9ff-4d21-a803-53108ebc7835 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:29.369101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7e14bf3-f9ff-4d21-a803-53108ebc7835 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:29.405426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02caac0-1b10-484b-8d9e-94d3ac096117 admin admin] Pushing event deleted for resources: {'Network': ['ID=243dd4d9-cd73-4cd5-a1b2-67566e390a56,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:29.429470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b07ccb3b-ad96-4e4a-bf3a-808de81f6337 req-51cbb45d-ac88-4445-83e2-0c278f0ad3b0 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/073a7b61-e5f8-496f-b950-4eee24692787 HTTP/1.1" status: 200 len: 1818 time: 0.0827482 Dec 21 03:50:29.483393 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Floating IP 763cfb1a-8f1e-49ad-bf81-a1738a7252e1 associated. External IP: 172.25.5.144, port: 365ed775-700d-4bba-8a8e-a1419759e777. Dec 21 03:50:29.512203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b07ccb3b-ad96-4e4a-bf3a-808de81f6337 req-fc31e5eb-eede-4bf9-9863-a3b65bca62bd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.555143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b07ccb3b-ad96-4e4a-bf3a-808de81f6337 req-fc31e5eb-eede-4bf9-9863-a3b65bca62bd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.750990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Router 6db05df4-511a-4269-9149-e3a795af8359 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:50:29.856814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:50:29.863781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.868231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] Sync routers for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:50:29.878712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:29.879457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:50:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:29.894812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-554b6b16-cf18-4798-bad4-2e45bdf09136 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "PUT /v2.0/floatingips/763cfb1a-8f1e-49ad-bf81-a1738a7252e1 HTTP/1.1" status: 200 len: 992 time: 1.5624399 Dec 21 03:50:29.895564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:29.906019 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753" -d '{"events": [{"name": "network-changed", "server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "tag": "365ed775-700d-4bba-8a8e-a1419759e777"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:29.979164 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b07ccb3b-ad96-4e4a-bf3a-808de81f6337 req-fc31e5eb-eede-4bf9-9863-a3b65bca62bd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.981897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b07ccb3b-ad96-4e4a-bf3a-808de81f6337 req-fc31e5eb-eede-4bf9-9863-a3b65bca62bd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:29.995290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b07ccb3b-ad96-4e4a-bf3a-808de81f6337 req-fc31e5eb-eede-4bf9-9863-a3b65bca62bd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/073a7b61-e5f8-496f-b950-4eee24692787 HTTP/1.1" status: 204 len: 173 time: 0.5647955 Dec 21 03:50:30.021732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:30.023309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc31e5eb-eede-4bf9-9863-a3b65bca62bd tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=073a7b61-e5f8-496f-b950-4eee24692787,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:30.032305 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11f6a1b7-77db-41e1-ada6-82628e6fe638 x-openstack-request-id: req-11f6a1b7-77db-41e1-ada6-82628e6fe638 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:30.032478 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "tag": "365ed775-700d-4bba-8a8e-a1419759e777", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:30.032660 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-11f6a1b7-77db-41e1-ada6-82628e6fe638 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:30.033083 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777', 'status': 'completed', 'code': 200} Dec 21 03:50:30.144556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-d7b7b4b8-8e19-4179-b067-2deca959e11b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.146208 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-d7b7b4b8-8e19-4179-b067-2deca959e11b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e8135ee47f84444cb5d3eb45b6c7590b&device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 1098 time: 0.0502026 Dec 21 03:50:30.180017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51222b81-d270-4fe8-a637-3eac739bc417 req-a759fa27-11df-4bfc-beeb-755eea006ce5 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.181634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51222b81-d270-4fe8-a637-3eac739bc417 req-a759fa27-11df-4bfc-beeb-755eea006ce5 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1025071 Dec 21 03:50:30.194972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5621a3a8-452f-4641-ba2b-8de5cd8c6bbe req-f362b834-5b19-4d67-b7ae-a1bdd903d781 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.196162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5621a3a8-452f-4641-ba2b-8de5cd8c6bbe req-f362b834-5b19-4d67-b7ae-a1bdd903d781 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.0988591 Dec 21 03:50:30.269873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51222b81-d270-4fe8-a637-3eac739bc417 req-efcd1249-5f12-4992-a301-273118220f24 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716984 Dec 21 03:50:30.294361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-3ff341e2-c223-4f2c-9b20-0d57874bd525 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.296611 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-3ff341e2-c223-4f2c-9b20-0d57874bd525 service neutron] 10.222.0.31 "GET /v2.0/networks?id=38668209-04ad-4602-a5aa-ab7bc4e1b781 HTTP/1.1" status: 200 len: 915 time: 0.1422162 Dec 21 03:50:30.319370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '763cfb1a-8f1e-49ad-bf81-a1738a7252e1', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'floating_ip_address': '172.25.5.144', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '6db05df4-511a-4269-9149-e3a795af8359', 'port_id': '365ed775-700d-4bba-8a8e-a1419759e777', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 898, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'mac_address': 'fa:16:3e:c8:0c:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:50:08Z', 'updated_at': '2021-12-21T03:50:29Z', 'revision_number': 1, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:30.333988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5621a3a8-452f-4641-ba2b-8de5cd8c6bbe req-48b1c460-4dc6-4145-9108-cc8c8863c9a1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750043 Dec 21 03:50:30.361046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50640) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:30.390607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] Checking router: 6db05df4-511a-4269-9149-e3a795af8359 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:50:30.406015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:50:30.408641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:50:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:30.439093 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-f7dd5e85-6817-4dd8-97a1-31222bdce4cf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=365ed775-700d-4bba-8a8e-a1419759e777 HTTP/1.1" status: 200 len: 1000 time: 0.1336365 Dec 21 03:50:30.444038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e17abb9-bf13-4b40-a1f2-45a776f68620 req-8369e03b-8394-4c31-a497-6f6bd07757d1 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "GET /v2.0/security-groups/1f9e72e0-e144-4773-b0f9-6520a96c3335 HTTP/1.1" status: 200 len: 1818 time: 0.1090012 Dec 21 03:50:30.447889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1c29efb-051b-4c51-bebe-5c09e677bdac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=55f2bf80332241bbb5e3eda21038f4f0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0849297 Dec 21 03:50:30.453287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:30.567958 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e17abb9-bf13-4b40-a1f2-45a776f68620 req-7045c7aa-5379-42f3-a368-e06d0fc6a881 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:30.573165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:50:30.602530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e17abb9-bf13-4b40-a1f2-45a776f68620 req-7045c7aa-5379-42f3-a368-e06d0fc6a881 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:30.641851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-04b88ae3-06b2-4d0e-9a59-a4dfe2af0a94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.648205 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-04b88ae3-06b2-4d0e-9a59-a4dfe2af0a94 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2f0e0720-c89e-4a8a-888b-1e146411b74a HTTP/1.1" status: 200 len: 853 time: 0.1937890 Dec 21 03:50:30.709351 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:50:30.756939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f4ea2af-9ab0-485b-949b-8e19be978c0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:30.759660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e17abb9-bf13-4b40-a1f2-45a776f68620 req-7045c7aa-5379-42f3-a368-e06d0fc6a881 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:30.764267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e17abb9-bf13-4b40-a1f2-45a776f68620 req-7045c7aa-5379-42f3-a368-e06d0fc6a881 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:30.766514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e17abb9-bf13-4b40-a1f2-45a776f68620 req-7045c7aa-5379-42f3-a368-e06d0fc6a881 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] 10.222.0.18 "DELETE /v2.0/security-groups/1f9e72e0-e144-4773-b0f9-6520a96c3335 HTTP/1.1" status: 204 len: 173 time: 0.2994754 Dec 21 03:50:30.778842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50650) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:30.812849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f4ea2af-9ab0-485b-949b-8e19be978c0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:30.825258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-b6a57ebf-b7cb-45bb-b1a5-18897925e84c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.827476 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-b6a57ebf-b7cb-45bb-b1a5-18897925e84c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=38668209-04ad-4602-a5aa-ab7bc4e1b781&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1705034 Dec 21 03:50:30.834038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca52b7f-e65c-435a-be2e-39ea539e2323 req-1f17ce0d-961b-434d-88e1-dd93eb00f7e3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.835755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eca52b7f-e65c-435a-be2e-39ea539e2323 req-1f17ce0d-961b-434d-88e1-dd93eb00f7e3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.1428587 Dec 21 03:50:30.890895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7045c7aa-5379-42f3-a368-e06d0fc6a881 tempest-SecurityGroupsTestJSON-343274120 tempest-SecurityGroupsTestJSON-343274120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f9e72e0-e144-4773-b0f9-6520a96c3335,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:30.997544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23e3954-3c0e-4c16-a45f-918480de5725 req-1c248cfa-9d51-495f-ac27-b702e0e52b8b tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:30.999285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c23e3954-3c0e-4c16-a45f-918480de5725 req-1c248cfa-9d51-495f-ac27-b702e0e52b8b tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 1101 time: 0.1503365 Dec 21 03:50:31.002297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Deleting subnet 787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:50:31.010198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.014812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-c4e8c8de-a093-4065-aea0-4ebf10b9167d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1739562 Dec 21 03:50:31.023442 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-6de028f3-680a-489d-a7e7-521e81da38d5 service neutron] 10.222.0.31 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1659651 Dec 21 03:50:31.095410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eca52b7f-e65c-435a-be2e-39ea539e2323 req-0d6aa917-38a0-411f-9377-70300f55755d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2305927 Dec 21 03:50:31.115077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f4ea2af-9ab0-485b-949b-8e19be978c0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.119051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f4ea2af-9ab0-485b-949b-8e19be978c0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.123612 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f4ea2af-9ab0-485b-949b-8e19be978c0e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/89234168-afdd-4780-adcb-832eb8195d6d HTTP/1.1" status: 204 len: 168 time: 0.6680310 Dec 21 03:50:31.161998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.167041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '763cfb1a-8f1e-49ad-bf81-a1738a7252e1', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'floating_ip_address': '172.25.5.144', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '6db05df4-511a-4269-9149-e3a795af8359', 'port_id': '365ed775-700d-4bba-8a8e-a1419759e777', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 898, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'mac_address': 'fa:16:3e:c8:0c:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:50:08Z', 'updated_at': '2021-12-21T03:50:29Z', 'revision_number': 1, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:31.167981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4ea2af-9ab0-485b-949b-8e19be978c0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89234168-afdd-4780-adcb-832eb8195d6d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:31.239586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f2e4601-c62f-4320-b206-a950e0d51825 None None] The sync data for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 is: [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '763cfb1a-8f1e-49ad-bf81-a1738a7252e1', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'floating_ip_address': '172.25.5.144', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '6db05df4-511a-4269-9149-e3a795af8359', 'port_id': '365ed775-700d-4bba-8a8e-a1419759e777', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 898, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'mac_address': 'fa:16:3e:c8:0c:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:50:08Z', 'updated_at': '2021-12-21T03:50:29Z', 'revision_number': 1, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:50:31.284712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.361308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:31.368754 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e4dd5e40-08d5-4bad-8f1c-658ac69cf753 req-39600935-72d1-4a8c-ab61-2ad3b6f2878a service neutron] 10.222.0.31 "GET /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3119462 Dec 21 03:50:31.414895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c23e3954-3c0e-4c16-a45f-918480de5725 req-98cf06c5-04e4-4f9a-a804-009e697c722e tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4050050 Dec 21 03:50:31.448823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-ac7683e9-b2f3-4afe-bc9b-93bfe30e5efa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:31.452478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-ac7683e9-b2f3-4afe-bc9b-93bfe30e5efa service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 1102 time: 0.3466249 Dec 21 03:50:31.573657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.613769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:31.619354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:31.622533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.641074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.667178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca HTTP/1.1" status: 204 len: 168 time: 0.8722563 Dec 21 03:50:31.668447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50670) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:31.687036 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8b1b6d6-86c5-422f-8fb1-b12c6c14f447 None None] New status for floating IP 763cfb1a-8f1e-49ad-bf81-a1738a7252e1: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:50:31.778828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17a310dd-d4f3-46ba-b01f-f5e1c739dcf8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=787c4b4a-d8e6-40a8-8e4c-ed17e6b69eca,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:31.805606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.831299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.857997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:31.860788 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da2ff7db-6b08-4437-8a1a-dfcf34a52aeb" -d '{"events": [{"server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "name": "network-vif-plugged", "status": "completed", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:31.914925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:31.933516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-65a7f50b-ae77-4e99-aa04-a55f6251638d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0840983 Dec 21 03:50:31.937571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.966492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:31.971916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa08e521-005d-4fd5-bd50-564d1932d4c3 req-b541cb50-91da-43a1-8776-1c99e96b4f13 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:31.979746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:31.980243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a212bdf2-4f6e-4cc1-a1e5-789fec8069b8') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:50:31.981090 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:31.986051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa08e521-005d-4fd5-bd50-564d1932d4c3 req-b541cb50-91da-43a1-8776-1c99e96b4f13 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.4726162 Dec 21 03:50:32.001015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:32.035756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:32.047595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:50:32.047595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:50:32.056869 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:50:32.090794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:32.181347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-9d0e444f-8571-4093-b2eb-0a1360b7112b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:32.201392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-9d0e444f-8571-4093-b2eb-0a1360b7112b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2357819 Dec 21 03:50:32.212424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-a8fe32ec-aa39-4030-9caa-4867b61e0ec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:32.214642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-a8fe32ec-aa39-4030-9caa-4867b61e0ec9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.7318652 Dec 21 03:50:32.227264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-2c08b5f3-9281-46db-9fc3-2e089ca9053c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/quotas/9839aab3796944fe8a09f1cfbd7edf8b HTTP/1.1" status: 200 len: 375 time: 0.0356331 Dec 21 03:50:32.285047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:32.296215 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:32.304609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] 10.222.0.18 "DELETE /v2.0/networks/ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a HTTP/1.1" status: 204 len: 168 time: 0.6351149 Dec 21 03:50:32.324960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-3693db9f-bb36-497c-9ecc-6f40272de9b9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=284452f9-cda6-4672-8b3a-5f31dab9e362 HTTP/1.1" status: 200 len: 217 time: 0.0953553 Dec 21 03:50:32.326884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef393f3-20ab-4926-aac5-1cbf273eee1d admin admin] Pushing event deleted for resources: {'Network': ['ID=ccd3c6ae-ebf3-46c8-9d5a-5a09cffefd7a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:32.348193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa08e521-005d-4fd5-bd50-564d1932d4c3 req-d57327d8-88b6-446c-89a2-ca96ef421c08 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3570945 Dec 21 03:50:32.407705 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d9eaef3-68e3-48b0-a045-02a146a86ff8 x-openstack-request-id: req-2d9eaef3-68e3-48b0-a045-02a146a86ff8 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:32.408227 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "name": "network-vif-plugged", "status": "completed", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:32.409066 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2d9eaef3-68e3-48b0-a045-02a146a86ff8 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:32.409480 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'code': 200} Dec 21 03:50:32.422602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-641cad6e-177b-4b1f-bc60-f6e060c8f53d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&fields=id HTTP/1.1" status: 200 len: 486 time: 0.1938791 Dec 21 03:50:32.465021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-931d527f-0244-4518-b666-8dc4db42a78c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:32.466585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-931d527f-0244-4518-b666-8dc4db42a78c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1170721 Dec 21 03:50:32.588272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fedbc35-7b3a-488e-839c-724787c3976d req-42f16bb4-02e8-42eb-9302-38ad9e1d1ffc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:32.595499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fedbc35-7b3a-488e-839c-724787c3976d req-42f16bb4-02e8-42eb-9302-38ad9e1d1ffc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 945 time: 0.1232111 Dec 21 03:50:32.599197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-ab093a84-4717-4347-914d-a0ad395ba65e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:32.600664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-ab093a84-4717-4347-914d-a0ad395ba65e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1106241 Dec 21 03:50:32.633118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d656d2-2606-407c-8908-b5e25c499df1 req-c9e805ba-2536-4a94-8445-d439751ac5f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:32.635165 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-22d656d2-2606-407c-8908-b5e25c499df1 req-c9e805ba-2536-4a94-8445-d439751ac5f7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1097 time: 0.0914941 Dec 21 03:50:32.720492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-22d656d2-2606-407c-8908-b5e25c499df1 req-7f8091bc-0ead-4a8d-824e-1d3b151ab327 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751534 Dec 21 03:50:32.721891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fedbc35-7b3a-488e-839c-724787c3976d req-a06094f9-d4f6-4bd0-969d-960f5db59057 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1235089 Dec 21 03:50:32.811400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-8d9976aa-d29b-4ccf-bcad-38010a873cbe service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1954234 Dec 21 03:50:32.964302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50726) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:33.040710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-51648976-6b0b-412c-b03a-7c8d3ee34c26 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0c51448e6fcd494e8c92714cc6e79d52&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0753338 Dec 21 03:50:33.041072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50730) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:33.101157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-787ea476-d42d-4f37-97a1-31c874da8d1e req-e88a3e59-3c9e-48a9-98b7-f677984f1c62 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 210 time: 0.0668263 Dec 21 03:50:33.169670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa6c9b67-3dd9-422c-b460-29946242761c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:33.211215 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa6c9b67-3dd9-422c-b460-29946242761c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:33.243099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86f9dc89-f482-45dc-85c9-ad4852703cb6 req-f29c3c82-0779-42ae-be7b-4328f5db2968 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1929014 Dec 21 03:50:33.424352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa6c9b67-3dd9-422c-b460-29946242761c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:33.428203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa6c9b67-3dd9-422c-b460-29946242761c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:33.429540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa6c9b67-3dd9-422c-b460-29946242761c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/81a36cae-1a32-4478-b646-000893538e6f HTTP/1.1" status: 204 len: 168 time: 0.3858621 Dec 21 03:50:33.496430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a673a293-cbe9-4935-8dea-32c836e53943 req-7f7a488a-bf95-4637-829a-50deab36ef19 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:33.496582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6c9b67-3dd9-422c-b460-29946242761c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81a36cae-1a32-4478-b646-000893538e6f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:33.505610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a673a293-cbe9-4935-8dea-32c836e53943 req-7f7a488a-bf95-4637-829a-50deab36ef19 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0831153 Dec 21 03:50:33.583613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a673a293-cbe9-4935-8dea-32c836e53943 req-7830380b-3c19-4afe-8543-0a53d401689c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765152 Dec 21 03:50:33.733302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-11e34079-5f2b-42a1-9a11-6be06790b8e8 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0644476 Dec 21 03:50:33.916902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b797c5-70c1-4756-8859-423d678c9c8e req-15283f9f-d708-41d9-8d80-62265ebbe284 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:33.918423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-15283f9f-d708-41d9-8d80-62265ebbe284 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 1102 time: 0.1289339 Dec 21 03:50:33.938248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d65e59b-0760-4141-ad59-35485f11ddd4 req-e73c90c9-4d5c-4f61-b4b5-61bee0140164 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:33.939990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d65e59b-0760-4141-ad59-35485f11ddd4 req-e73c90c9-4d5c-4f61-b4b5-61bee0140164 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 945 time: 0.0696461 Dec 21 03:50:34.089285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b797c5-70c1-4756-8859-423d678c9c8e req-d70adc9e-5dc0-4744-82fe-53bc895437e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:34.090763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-d70adc9e-5dc0-4744-82fe-53bc895437e7 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1345270 Dec 21 03:50:34.096333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d65e59b-0760-4141-ad59-35485f11ddd4 req-a199b31b-1621-430a-84ca-73eb5943ffc0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1488774 Dec 21 03:50:34.205723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-5c515772-70f7-4863-b7bb-f270a9f09dcd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=d4a89fe6-e810-43b4-bd73-b205091236af HTTP/1.1" status: 200 len: 217 time: 0.0970013 Dec 21 03:50:34.313248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b797c5-70c1-4756-8859-423d678c9c8e req-74ecd78c-2590-4deb-8829-7f74c8105ff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:34.315485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-74ecd78c-2590-4deb-8829-7f74c8105ff1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1003802 Dec 21 03:50:34.389772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b797c5-70c1-4756-8859-423d678c9c8e req-14edf369-c0f8-40e5-92b5-d941a27ee306 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:34.391671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-14edf369-c0f8-40e5-92b5-d941a27ee306 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0533917 Dec 21 03:50:34.567237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06cc501e-9cbb-46ec-8824-2461fb3a775f req-9e011122-4d79-4d33-93f3-b67d08728848 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 210 time: 0.0754173 Dec 21 03:50:34.619438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-dfbf11a0-eaa8-4ac8-a19e-0e99f98da596 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1974719 Dec 21 03:50:34.771883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97b797c5-70c1-4756-8859-423d678c9c8e req-0d08d7d2-f3c7-4214-b5cd-22db2088bb56 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1408732 Dec 21 03:50:34.778479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb534002-38d6-4898-a254-51c23cffa623 req-84a0d34a-7aa4-4793-8aef-40bf30923b37 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:34.780480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb534002-38d6-4898-a254-51c23cffa623 req-84a0d34a-7aa4-4793-8aef-40bf30923b37 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0807812 Dec 21 03:50:34.875056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb534002-38d6-4898-a254-51c23cffa623 req-525a77fa-c9f3-41a8-bd23-15fe19ecfbf8 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792859 Dec 21 03:50:35.236567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:35.330791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc89c21-7b38-4d3d-a98e-56d46952ddda req-64ff9626-f83f-44be-8437-07936e7f59ec tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:35.339173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cc89c21-7b38-4d3d-a98e-56d46952ddda req-64ff9626-f83f-44be-8437-07936e7f59ec tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 945 time: 0.0980377 Dec 21 03:50:35.385174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Request body: {'network': {'name': 'tempest-ServerTagsTestJSON-1374588347-network', 'tenant_id': '21b9e879064f458587507ce6fac2365f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:35.390492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cc89c21-7b38-4d3d-a98e-56d46952ddda req-e14b7ecc-307e-4e5a-913d-5380f51cc257 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497339 Dec 21 03:50:35.740973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Made reservation on behalf of 21b9e879064f458587507ce6fac2365f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:35.744113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:35.768544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:35.848357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-7e1ec3fd-e6ea-4d32-a38f-65ecbe9d3571 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0739379 Dec 21 03:50:35.898453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:35.966957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b0a9b1b-9c7a-40d7-b144-6adb2459699a req-6470e4fc-2948-47a4-8fa0-6f7eb44c78de tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 210 time: 0.0871067 Dec 21 03:50:35.993920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.009033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:50:36.027188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.028297 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Added segment ebc72439-11da-4c52-8368-1d661af040c0 of type vlan for network 922fdee6-1b18-4910-afce-31d41ad320e3 Dec 21 03:50:36.098423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90f270a-dc54-4e56-ab5f-947f1e7abb67 req-689f72a9-33b7-4e53-a8b0-964e225642b9 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:36.104775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.113634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b90f270a-dc54-4e56-ab5f-947f1e7abb67 req-689f72a9-33b7-4e53-a8b0-964e225642b9 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1097 time: 0.2674289 Dec 21 03:50:36.198237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b67cfb7c-a445-4992-b901-21dce2417478,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:36.211096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.212550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.217290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.219495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.220064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.220597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.221136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.221661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.222193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.222728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.223280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.223821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.224352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:36.238876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-c7648dbb-2e94-4912-a571-226a221f58bd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:36.240499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-c7648dbb-2e94-4912-a571-226a221f58bd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3502417 Dec 21 03:50:36.244997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b90f270a-dc54-4e56-ab5f-947f1e7abb67 req-0a85b23a-e9b4-441a-aa29-1e71e818759e tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304977 Dec 21 03:50:36.273056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.274220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:36.275200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.280686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:36.376126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] Pushing event updated for resources: {'Network': ['ID=922fdee6-1b18-4910-afce-31d41ad320e3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:36.394138 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-162a5d51-c182-4f94-acf4-bae8a64457c8 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.1536860 Dec 21 03:50:36.394646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50902) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:36.395514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 922fdee6-1b18-4910-afce-31d41ad320e3 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:50:36.403177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Request body: {'subnet': {'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerTagsTestJSON-1374588347-subnet', 'tenant_id': '21b9e879064f458587507ce6fac2365f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:36.514099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45904df-4744-4230-8006-5f7d1230f97f req-d6f3d0b2-7462-465d-b6c5-58133190b78c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:36.515392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b45904df-4744-4230-8006-5f7d1230f97f req-d6f3d0b2-7462-465d-b6c5-58133190b78c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0907755 Dec 21 03:50:36.535289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Made reservation on behalf of 21b9e879064f458587507ce6fac2365f for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:36.544267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.601370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b45904df-4744-4230-8006-5f7d1230f97f req-93bcfb35-5309-4138-adeb-baad7ff22434 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750794 Dec 21 03:50:36.649233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:36.653114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.876723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:36.940676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b0f536-06bf-4f3e-84c9-5b6de138531a req-04094cf4-48c7-4356-b6d9-30f68b2f948e tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:36.952790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1b0f536-06bf-4f3e-84c9-5b6de138531a req-04094cf4-48c7-4356-b6d9-30f68b2f948e tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1097 time: 0.1690013 Dec 21 03:50:36.955657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Checking segment: {'id': 'ebc72439-11da-4c52-8368-1d661af040c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:36.956015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Network hostable DHCP agents. Network: 922fdee6-1b18-4910-afce-31d41ad320e3, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:50:36.959426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6c297c4e-6464-429b-85d1-7a6696565116,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:37.009839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.61 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/66e96a75-3965-47db-900b-9dfdb214fd6b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:37.054732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Network 922fdee6-1b18-4910-afce-31d41ad320e3 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:50:37.097560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1b0f536-06bf-4f3e-84c9-5b6de138531a req-4000a206-79f0-4530-bbb1-8ae962deded2 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1420155 Dec 21 03:50:37.129140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 922fdee6-1b18-4910-afce-31d41ad320e3) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:37.133171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:37.133798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:37.146267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b274ebe6-ec2e-44b9-a593-7e911304c11d None None] Network 922fdee6-1b18-4910-afce-31d41ad320e3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:37.237802 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1ad25bed-767a-4fd9-9c35-aeb47566cf74 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8330293 Dec 21 03:50:37.333087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3ebecf4-2cc8-4ef9-8fff-46e79b99244f None None] Network 922fdee6-1b18-4910-afce-31d41ad320e3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:50:37.642713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96b2f42-55d3-47d6-9c51-c7650ca4ef99 req-28bc57cc-1322-4344-9e8c-0f6798eda382 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 210 time: 0.4864156 Dec 21 03:50:37.729448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:37.836591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:37.875152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5', '37f13e0f-1f8b-4106-974a-bdabfab506b1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:37.903857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=66e96a75-3965-47db-900b-9dfdb214fd6b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:37.911991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:37.937752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:37.992131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:38.005414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:38.208767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40921162-74dc-4419-a3a6-6d73b33cf932 req-5914e64c-9b4b-47b7-ba7b-e7e84ea97d73 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:38.210360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40921162-74dc-4419-a3a6-6d73b33cf932 req-5914e64c-9b4b-47b7-ba7b-e7e84ea97d73 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.2719152 Dec 21 03:50:38.219369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:38.220000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:38.318245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-74bad0e9-bde3-4b82-872c-30c97c914e48 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:38.332065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-74bad0e9-bde3-4b82-872c-30c97c914e48 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/networks?id=922fdee6-1b18-4910-afce-31d41ad320e3 HTTP/1.1" status: 200 len: 809 time: 0.3701751 Dec 21 03:50:38.365238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-33503e78-0ea0-4939-858d-41654cff694e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.0982771 Dec 21 03:50:38.381319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-cafb49c7-e39b-4c96-8ac8-8b9b71d28a7d tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/quotas/21b9e879064f458587507ce6fac2365f HTTP/1.1" status: 200 len: 375 time: 0.0478787 Dec 21 03:50:38.397853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Request body: {'port': {'device_id': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:38.420848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40921162-74dc-4419-a3a6-6d73b33cf932 req-4721e391-45ca-4540-ac52-c76f593abe65 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1960261 Dec 21 03:50:38.438841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a7ba57e4-a5b6-4b59-986d-6e3daf9629ef None None] Provisioning complete for port 66e96a75-3965-47db-900b-9dfdb214fd6b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:38.439311 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a7ba57e4-a5b6-4b59-986d-6e3daf9629ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:38.448847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-2090aab3-b16f-449e-80c3-06218259e905 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=21b9e879064f458587507ce6fac2365f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0665777 Dec 21 03:50:38.483876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a7ba57e4-a5b6-4b59-986d-6e3daf9629ef None None] Port 66e96a75-3965-47db-900b-9dfdb214fd6b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:50:38.572035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:38.752096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-a743fb30-12ea-41ff-bfa9-75e3c8a2281c service neutron] 10.222.0.18 "GET /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3019850 Dec 21 03:50:39.006538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-21be7879-8dde-4e45-b820-dd7d3152d3d3 service neutron] 10.222.0.18 "GET /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2449160 Dec 21 03:50:39.052714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 66e96a75-3965-47db-900b-9dfdb214fd6b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:39.066391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:39.081896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Transition to ACTIVE for port object 66e96a75-3965-47db-900b-9dfdb214fd6b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:39.158238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:39.300785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Pushing event updated for resources: {'Port': ['ID=66e96a75-3965-47db-900b-9dfdb214fd6b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:39.448243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Attempting to bind port 66e96a75-3965-47db-900b-9dfdb214fd6b on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:39.448592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Attempting to bind port 66e96a75-3965-47db-900b-9dfdb214fd6b by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:39.448927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Attempting to bind port 66e96a75-3965-47db-900b-9dfdb214fd6b on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:39.462504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Port 66e96a75-3965-47db-900b-9dfdb214fd6b on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:39.462834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Attempting to bind port 66e96a75-3965-47db-900b-9dfdb214fd6b on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:39.470086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:39.470425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:39.470816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:39.472168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Bound port: 66e96a75-3965-47db-900b-9dfdb214fd6b, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:39.472557 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:39.646198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] For port 66e96a75-3965-47db-900b-9dfdb214fd6b, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:39.653093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] For port 66e96a75-3965-47db-900b-9dfdb214fd6b, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=66e96a75-3965-47db-900b-9dfdb214fd6b,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:39.765037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:39.796018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:39.809806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:39.811899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] 10.222.0.54 "PUT /v2.0/ports/66e96a75-3965-47db-900b-9dfdb214fd6b HTTP/1.1" status: 200 len: 1096 time: 1.4203596 Dec 21 03:50:39.843016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'tag': '66e96a75-3965-47db-900b-9dfdb214fd6b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:39.848558 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-658a6c19-8d05-4c14-93d3-06dc2d3afae6" -d '{"events": [{"name": "network-changed", "server_uuid": "fd9dbec7-49c0-4dc4-9c5c-290458789754", "tag": "66e96a75-3965-47db-900b-9dfdb214fd6b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:39.963804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14589b72-e782-46ee-967f-4e19f121c748 req-b5fce86f-6807-48cb-9085-6f1f4cd193bb tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:39.971277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14589b72-e782-46ee-967f-4e19f121c748 req-b5fce86f-6807-48cb-9085-6f1f4cd193bb tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 947 time: 0.1002319 Dec 21 03:50:39.974018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18fcb33d-0927-4fbf-8150-6d354dd0df40 service neutron] Pushing event updated for resources: {'Port': ['ID=66e96a75-3965-47db-900b-9dfdb214fd6b,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:40.109693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14589b72-e782-46ee-967f-4e19f121c748 req-b05ec7b1-4f35-42fc-8ee9-23888fb40911 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1374769 Dec 21 03:50:40.145779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-2665f170-83d8-43cf-b5c5-af66cd7b7d42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:40.148131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-2665f170-83d8-43cf-b5c5-af66cd7b7d42 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 1099 time: 0.1154723 Dec 21 03:50:40.228727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-23a39bcf-ffb7-48d4-b7db-df6573f8ff30 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.61&port_id=66e96a75-3965-47db-900b-9dfdb214fd6b HTTP/1.1" status: 200 len: 217 time: 0.0562515 Dec 21 03:50:40.258091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9327042-c877-43c4-814f-eedee0b263c8 req-0005c719-1339-43d7-a52f-113e2b3aaafb tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 210 time: 0.0787842 Dec 21 03:50:40.331168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-39a2507c-7d21-4f50-8cbb-a425d49424a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:40.332968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-39a2507c-7d21-4f50-8cbb-a425d49424a8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0775101 Dec 21 03:50:40.445549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-87e63abf-4c8b-49b2-b05d-c1eaf5901427 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:40.448632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-87e63abf-4c8b-49b2-b05d-c1eaf5901427 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1003122 Dec 21 03:50:40.623758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-368a3486-ed95-450f-bccc-2db93e5bff6c service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1673126 Dec 21 03:50:40.767728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2cc2df4-760e-484c-bdc6-02896560e409 req-59add277-6916-4d45-982d-3ac429258556 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1338918 Dec 21 03:50:40.831401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49044e2-7449-42fe-80dc-9a4f12b7fd5c req-4aedf06d-665a-4df1-8457-989f3cd8d92d tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:40.832947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d49044e2-7449-42fe-80dc-9a4f12b7fd5c req-4aedf06d-665a-4df1-8457-989f3cd8d92d tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0641351 Dec 21 03:50:40.924932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d49044e2-7449-42fe-80dc-9a4f12b7fd5c req-be8292ce-1ad2-4a06-ba58-f0745f5a1dd4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853481 Dec 21 03:50:40.984919 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6bcc326-f8f7-42eb-87a2-cb973fe00e2d x-openstack-request-id: req-b6bcc326-f8f7-42eb-87a2-cb973fe00e2d {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:40.987905 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd9dbec7-49c0-4dc4-9c5c-290458789754", "tag": "66e96a75-3965-47db-900b-9dfdb214fd6b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:40.987905 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b6bcc326-f8f7-42eb-87a2-cb973fe00e2d {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:40.987905 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'tag': '66e96a75-3965-47db-900b-9dfdb214fd6b', 'status': 'completed', 'code': 200} Dec 21 03:50:41.177709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-15806b64-1041-484f-b26b-102b0e449267 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:41.179425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-15806b64-1041-484f-b26b-102b0e449267 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 1099 time: 0.0543644 Dec 21 03:50:41.301565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-5213cb81-9450-4231-a056-2ce2fddb1a01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:41.303185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-5213cb81-9450-4231-a056-2ce2fddb1a01 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1054809 Dec 21 03:50:41.371081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-776b2c8b-9f15-45fe-8cec-beaa7b6383ba service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.61&port_id=66e96a75-3965-47db-900b-9dfdb214fd6b HTTP/1.1" status: 200 len: 217 time: 0.0557008 Dec 21 03:50:41.392891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd195c2-f361-43a2-b18d-02c8c72e968a req-7621d6cf-802b-413a-bc31-6752277b2d68 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:41.394402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dd195c2-f361-43a2-b18d-02c8c72e968a req-7621d6cf-802b-413a-bc31-6752277b2d68 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 947 time: 0.0903521 Dec 21 03:50:41.448958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dd195c2-f361-43a2-b18d-02c8c72e968a req-17a0aa2f-e0c3-4093-b8f5-b82a0b1980ed tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477588 Dec 21 03:50:41.663891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-49cab56f-fffe-42ac-9524-92ffb13d30bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:41.665732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-49cab56f-fffe-42ac-9524-92ffb13d30bd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1083865 Dec 21 03:50:41.736429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-60ef9bac-e05c-4141-8648-87cd896259f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:41.738018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-60ef9bac-e05c-4141-8648-87cd896259f5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0618219 Dec 21 03:50:41.949241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-f52003bd-4f17-44d6-92e1-ec855ba5a578 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1780133 Dec 21 03:50:42.008205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-98829832-f9d4-44ab-8494-74d40961fe0f tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:50:42.009228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-98829832-f9d4-44ab-8494-74d40961fe0f tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1828544 Dec 21 03:50:42.055981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c3ffafe-44aa-415b-9a6a-9f29970f3b63 req-cab8dfb9-714e-4237-8b9d-62e9ba4042e0 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 210 time: 0.0724919 Dec 21 03:50:42.106234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-658a6c19-8d05-4c14-93d3-06dc2d3afae6 req-debfc00f-1474-44c2-97d2-d530bf01201f service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1428895 Dec 21 03:50:42.159211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-f13a2fcd-6733-4595-8dcf-4c2557390792 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:42.160714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-f13a2fcd-6733-4595-8dcf-4c2557390792 service neutron] 10.222.0.18 "GET /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 1094 time: 0.1072588 Dec 21 03:50:42.173305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:42.174057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Unknown quota resources ['binding']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:50:42.328601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:42.328977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:42.329701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:42.334925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:42.335511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:42.344353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:42.344970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:42.345999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:42.346524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Bound port: 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:42.414355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:42.552890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:42.554094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-2804db5f-423e-4d33-b9d8-161ccdfc2d91 service neutron] 10.222.0.18 "POST /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6/bindings HTTP/1.1" status: 201 len: 390 time: 0.3855820 Dec 21 03:50:42.731437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7804a7-8f12-4570-a5e3-7be8ddf5adc3 req-c7ca77e7-eb20-43ac-810c-ca278fe97667 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:42.732949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d7804a7-8f12-4570-a5e3-7be8ddf5adc3 req-c7ca77e7-eb20-43ac-810c-ca278fe97667 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0548191 Dec 21 03:50:42.783888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d7804a7-8f12-4570-a5e3-7be8ddf5adc3 req-95234130-34e5-4d68-b98d-67f301fa2773 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449305 Dec 21 03:50:43.005877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b77d6ad-0f74-452d-ac48-853507f150a4 req-be16940f-d6b2-40b1-8d3a-f6e89cfece6a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:43.007808 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b77d6ad-0f74-452d-ac48-853507f150a4 req-be16940f-d6b2-40b1-8d3a-f6e89cfece6a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 947 time: 0.0542412 Dec 21 03:50:43.094283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b77d6ad-0f74-452d-ac48-853507f150a4 req-ed348f43-b9a7-451b-a4bc-b778f169921d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783637 Dec 21 03:50:43.115555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b667d873-0294-41a9-9468-c6975e89987a req-70933a97-629c-49a1-b667-6385d01f27b0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:43.115555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b667d873-0294-41a9-9468-c6975e89987a req-70933a97-629c-49a1-b667-6385d01f27b0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 945 time: 0.0773504 Dec 21 03:50:43.208079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b667d873-0294-41a9-9468-c6975e89987a req-eddca73f-c7d4-405d-95db-b1fb1bd77231 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902846 Dec 21 03:50:43.284060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-14f783fe-f65d-4c21-ba94-63c488ca7ed7 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:43.285934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-14f783fe-f65d-4c21-ba94-63c488ca7ed7 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.31 "GET /v2.0/networks?id=922fdee6-1b18-4910-afce-31d41ad320e3 HTTP/1.1" status: 200 len: 809 time: 0.1342759 Dec 21 03:50:43.322987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Request body: {'port': {'device_id': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3', 'admin_state_up': True, 'tenant_id': '21b9e879064f458587507ce6fac2365f'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:43.370534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd40fc1a-d0dc-43cc-a83d-dfa7ef95863e req-155f4d26-b45f-4d7e-8a7a-5aa721f44d09 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 210 time: 0.0742178 Dec 21 03:50:43.527659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-19a1980a-9569-4af4-a068-0780c5a76b4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:43.529626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-19a1980a-9569-4af4-a068-0780c5a76b4d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1097 time: 0.0846746 Dec 21 03:50:43.659580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-80c17eb3-a497-40fa-bc07-b086a69af0d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:43.662324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-80c17eb3-a497-40fa-bc07-b086a69af0d0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1191506 Dec 21 03:50:43.666215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Made reservation on behalf of 21b9e879064f458587507ce6fac2365f for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:43.671627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:43.735517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b17a527d-cddf-424c-940d-4ef6516c2198 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 217 time: 0.0599644 Dec 21 03:50:43.785996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 66e96a75-3965-47db-900b-9dfdb214fd6b details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:43.845622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-a3019c3b-a303-4413-8f6e-c1643596bad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:43.847125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-a3019c3b-a303-4413-8f6e-c1643596bad6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0996008 Dec 21 03:50:43.893549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 66e96a75-3965-47db-900b-9dfdb214fd6b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=66e96a75-3965-47db-900b-9dfdb214fd6b,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:43.906037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-ecda9370-74cc-4a95-aae8-3531c734abdf service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0496254 Dec 21 03:50:43.907372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '66e96a75-3965-47db-900b-9dfdb214fd6b', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '66e96a75-3965-47db-900b-9dfdb214fd6b', 'mac_address': 'fa:16:3e:4e:a5:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.61'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:43.946599 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:43.959504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 66e96a75-3965-47db-900b-9dfdb214fd6b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:43.960063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Allocated IP 172.20.0.6 (922fdee6-1b18-4910-afce-31d41ad320e3/6c297c4e-6464-429b-85d1-7a6696565116/5a6e8017-d827-4a67-93f9-d0890e97d658) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:43.980116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 66e96a75-3965-47db-900b-9dfdb214fd6b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=66e96a75-3965-47db-900b-9dfdb214fd6b,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:44.059374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-13f7ffef-196f-40ff-aae1-f88eed90ae13 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1332920 Dec 21 03:50:44.099271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:44.153085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=66e96a75-3965-47db-900b-9dfdb214fd6b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:44.165991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.166444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.166810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.167943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.168838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.169208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.170215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.170574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.171074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.171418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.171759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.172094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.172593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:44.228391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-18b210a2-2a18-42e1-ba07-c360d7caaef4 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1517982 Dec 21 03:50:44.228391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:44.330497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-433abd32-6308-4b5d-ba6c-637f5bbd4086 req-a13657a1-51ca-46fb-ac8c-9d72dfcd6508 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:44.332063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-433abd32-6308-4b5d-ba6c-637f5bbd4086 req-a13657a1-51ca-46fb-ac8c-9d72dfcd6508 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0539804 Dec 21 03:50:44.387117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-433abd32-6308-4b5d-ba6c-637f5bbd4086 req-6a1b9890-a16b-45ee-b978-804fbdca2b4e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443161 Dec 21 03:50:44.388820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:44.433907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Network 922fdee6-1b18-4910-afce-31d41ad320e3 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:44.437199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:44.440891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:44.477965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Pushing event updated for resources: {'Port': ['ID=5a6e8017-d827-4a67-93f9-d0890e97d658,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:44.533246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:44.533915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:44.547481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-1d0ef816-9625-43f9-aa62-82f03743edd7 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:44.549002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-1d0ef816-9625-43f9-aa62-82f03743edd7 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.0830710 Dec 21 03:50:44.581716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:44.614336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-1052f344-3bfd-4416-939b-1cd73c983df5 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2969091 Dec 21 03:50:44.615451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['66e96a75-3965-47db-900b-9dfdb214fd6b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:44.662548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Request body: {'port': {'device_id': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:44.699257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:44.782733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d76d5c1-ea29-493d-be84-b8fc10573b02 req-33bdf600-a38a-4ce7-b088-155fd1fc2943 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:44.784019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d76d5c1-ea29-493d-be84-b8fc10573b02 req-33bdf600-a38a-4ce7-b088-155fd1fc2943 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 948 time: 0.1548986 Dec 21 03:50:44.805125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:44.991637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d76d5c1-ea29-493d-be84-b8fc10573b02 req-d2e3015e-4893-4710-a976-56ca96fad54a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1970723 Dec 21 03:50:45.083801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:45.111984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43e3596-6f89-49ce-8da9-e2e6af138d0b req-2114f7f7-5b24-4508-a12e-75ba45720b8d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:45.113586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b43e3596-6f89-49ce-8da9-e2e6af138d0b req-2114f7f7-5b24-4508-a12e-75ba45720b8d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 945 time: 0.2338257 Dec 21 03:50:45.214696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:45.272350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b43e3596-6f89-49ce-8da9-e2e6af138d0b req-171f4ee7-b1ee-444a-bdef-d5f9e6bb44d9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1467192 Dec 21 03:50:45.315980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:45.318215 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82118b02-9ae9-42a6-9cfc-dcb28e2b383b" -d '{"events": [{"server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "name": "network-vif-unplugged", "status": "completed", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:45.322138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:45.373531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90767396-9078-4eff-96e8-8bbc9d1bd484 req-5de15064-03d2-4fbf-a388-4af389edd40c tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:45.375043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90767396-9078-4eff-96e8-8bbc9d1bd484 req-5de15064-03d2-4fbf-a388-4af389edd40c tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 931 time: 0.1068246 Dec 21 03:50:45.398114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:45.461301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5a6e8017-d827-4a67-93f9-d0890e97d658 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:45.476455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:45.789136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:45.796534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:45.823666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:45.829090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Transition to ACTIVE for port object 5a6e8017-d827-4a67-93f9-d0890e97d658 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:45.835820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90767396-9078-4eff-96e8-8bbc9d1bd484 req-0ef99d7b-6606-481f-a949-dcc2ef339c5b tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4406123 Dec 21 03:50:45.863152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:45.863486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:45.864293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:45.868802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:45.869124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Attempting to bind port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:45.886175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:45.886887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:45.886887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:45.887399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Bound port: 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:45.887759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:45.927244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:45.975304 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5d8c97b-a31b-48ee-9378-d2b5428dbcaa x-openstack-request-id: req-c5d8c97b-a31b-48ee-9378-d2b5428dbcaa {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:45.975644 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "name": "network-vif-unplugged", "status": "completed", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:45.976236 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c5d8c97b-a31b-48ee-9378-d2b5428dbcaa {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:45.976458 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'code': 200} Dec 21 03:50:45.978836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Pushing event updated for resources: {'Port': ['ID=5a6e8017-d827-4a67-93f9-d0890e97d658,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:45.988977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:45.992618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:46.022454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '90696376-ba84-4217-a845-b149d216aace', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'port_id': '90696376-ba84-4217-a845-b149d216aace', 'mac_address': 'fa:16:3e:51:9f:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da10d7f0-623a-4e8a-b5fc-286a12beadcd', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:46.029932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90696376-ba84-4217-a845-b149d216aace'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:46.030162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:46.032650 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3793d2a5-3f90-4ee8-957d-4c98292049d7" -d '{"events": [{"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-unplugged", "status": "completed", "tag": "90696376-ba84-4217-a845-b149d216aace"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:46.036109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:46.048206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:46.083151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.096245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 90696376-ba84-4217-a845-b149d216aace {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:46.129958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.136266 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.148532 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea86a91-7a1b-43cc-8373-4e8e0c668ccd req-8b9dbb45-76bf-4e27-9639-5a88999c85ca tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:46.152197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ea86a91-7a1b-43cc-8373-4e8e0c668ccd req-8b9dbb45-76bf-4e27-9639-5a88999c85ca tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0973506 Dec 21 03:50:46.158722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Attempting to bind port 5a6e8017-d827-4a67-93f9-d0890e97d658 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:46.159100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Attempting to bind port 5a6e8017-d827-4a67-93f9-d0890e97d658 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'ebc72439-11da-4c52-8368-1d661af040c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:46.161488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Attempting to bind port 5a6e8017-d827-4a67-93f9-d0890e97d658 on network 922fdee6-1b18-4910-afce-31d41ad320e3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:46.181127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Port 5a6e8017-d827-4a67-93f9-d0890e97d658 on network 922fdee6-1b18-4910-afce-31d41ad320e3 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:46.181449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Attempting to bind port 5a6e8017-d827-4a67-93f9-d0890e97d658 on network 922fdee6-1b18-4910-afce-31d41ad320e3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:46.203566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:50:46.203941 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:50:46.221346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:46.221695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Checking segment: {'id': 'ebc72439-11da-4c52-8368-1d661af040c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:46.222080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Bound using segment: {'id': 'ebc72439-11da-4c52-8368-1d661af040c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:46.222510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Bound port: 5a6e8017-d827-4a67-93f9-d0890e97d658, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ebc72439-11da-4c52-8368-1d661af040c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:46.222863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.225663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:46.309201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=8']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:46.321684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:46.322131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.323559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b74252b0-1ef1-4aa5-a526-8edd5a3c119f service neutron] 10.222.0.54 "PUT /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 1123 time: 1.7476871 Dec 21 03:50:46.327609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ea86a91-7a1b-43cc-8373-4e8e0c668ccd req-aa778ca2-c617-47e9-a1bc-53666cd13d8a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1416187 Dec 21 03:50:46.354742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] For port 5a6e8017-d827-4a67-93f9-d0890e97d658, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:46.358020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] For port 5a6e8017-d827-4a67-93f9-d0890e97d658, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=5a6e8017-d827-4a67-93f9-d0890e97d658,segment=NetworkSegment(ebc72439-11da-4c52-8368-1d661af040c0),segment_id=ebc72439-11da-4c52-8368-1d661af040c0)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:46.494589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9e909a4e-75c1-4fe8-8139-ff2546a86bf6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:46.503367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.570498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-999328d2-a599-4f88-8b42-45bea115553e req-2d19e3c4-5a64-4322-9da2-ad922b47934b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:46.572042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-999328d2-a599-4f88-8b42-45bea115553e req-2d19e3c4-5a64-4322-9da2-ad922b47934b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 948 time: 0.1481698 Dec 21 03:50:46.573291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:46.573887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.575241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] 10.222.0.31 "PUT /v2.0/ports/5a6e8017-d827-4a67-93f9-d0890e97d658 HTTP/1.1" status: 200 len: 1092 time: 1.9185064 Dec 21 03:50:46.631593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-7966d122-30b9-4f3c-8970-82312d6caa3f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:46.633094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-7966d122-30b9-4f3c-8970-82312d6caa3f tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.2196972 Dec 21 03:50:46.633715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5afc3288-1842-42bf-b112-9739a121f1b4 service neutron] Pushing event updated for resources: {'Port': ['ID=5a6e8017-d827-4a67-93f9-d0890e97d658,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:46.661111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-9b02e9c8-a69a-4b44-bb25-5b99f09076ea tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/quotas/597df5e2769740859ecb4f30e4aefff3 HTTP/1.1" status: 200 len: 375 time: 0.0207725 Dec 21 03:50:46.681353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-999328d2-a599-4f88-8b42-45bea115553e req-94c76a65-8bb0-4141-8d60-edd9b3ea510e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005332 Dec 21 03:50:46.721313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-e8efdd68-ab3f-4c32-ae4d-b97362b69621 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0527682 Dec 21 03:50:46.727558 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75848eb7-60b1-497a-8e9c-e7458fe8aa9e x-openstack-request-id: req-75848eb7-60b1-497a-8e9c-e7458fe8aa9e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:46.728063 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-unplugged", "status": "completed", "tag": "90696376-ba84-4217-a845-b149d216aace", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:46.728324 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-75848eb7-60b1-497a-8e9c-e7458fe8aa9e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:46.728773 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90696376-ba84-4217-a845-b149d216aace', 'code': 200} Dec 21 03:50:46.746087 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.760281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90696376-ba84-4217-a845-b149d216aace {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:46.788081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:46.843871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-8b553f2c-3a18-4ad8-acfe-4a1ee6768d1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:46.845364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-8b553f2c-3a18-4ad8-acfe-4a1ee6768d1f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=21b9e879064f458587507ce6fac2365f&device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 1095 time: 0.0901961 Dec 21 03:50:46.859040 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:46.863511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-933dfcdb-de15-4de8-a3d4-5ef90012fd25 service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1327302 Dec 21 03:50:46.913149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:46.916950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-912f9a73-fadc-4551-ad27-8b7f814df8ca service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5a6e8017-d827-4a67-93f9-d0890e97d658 HTTP/1.1" status: 200 len: 217 time: 0.0524297 Dec 21 03:50:47.021156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-e0e1f689-d255-4a91-bfeb-21d7fdb0a70b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:47.022653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-e0e1f689-d255-4a91-bfeb-21d7fdb0a70b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6c297c4e-6464-429b-85d1-7a6696565116 HTTP/1.1" status: 200 len: 849 time: 0.0954099 Dec 21 03:50:47.028372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-8f4a773e-7353-4734-aea7-99d7c0fefe5a service neutron] 10.222.0.18 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1566293 Dec 21 03:50:47.081901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-80c5a42a-8f0a-421c-ba19-20460fb27db1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=922fdee6-1b18-4910-afce-31d41ad320e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0264139 Dec 21 03:50:47.180686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-17944479-5450-4733-a8ff-b4ba175bbd38 service neutron] 10.222.0.31 "GET /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863321 Dec 21 03:50:47.291156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6be9cd1d-935c-4715-b35c-fd3c13f4a2c7 req-63097147-8e36-4378-8e86-04a3d85ac183 service neutron] 10.222.0.31 "GET /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1022816 Dec 21 03:50:47.298363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['90696376-ba84-4217-a845-b149d216aace'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:47.391164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60e6e45-4847-46fb-882d-b541291cc218 req-e49704c6-a985-42f9-b116-a622488ccbd6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:47.392688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e60e6e45-4847-46fb-882d-b541291cc218 req-e49704c6-a985-42f9-b116-a622488ccbd6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.0938756 Dec 21 03:50:47.404995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa810d1e-762f-4751-ad8a-e20f60613601 req-6aea6347-9887-4f07-ac10-fffb166d1b00 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:47.405670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa810d1e-762f-4751-ad8a-e20f60613601 req-6aea6347-9887-4f07-ac10-fffb166d1b00 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 943 time: 0.0942266 Dec 21 03:50:47.449500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:47.482782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e60e6e45-4847-46fb-882d-b541291cc218 req-e0b812ad-e67a-46fe-8fd5-f7c59f8dcd90 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750990 Dec 21 03:50:47.487252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa810d1e-762f-4751-ad8a-e20f60613601 req-677f24ce-c977-471f-ad21-2115c6b68b9a tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724037 Dec 21 03:50:47.539946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:47.583298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6196f3e-f7e0-44d0-926e-349ae5e76e83 req-73cccdf3-608d-4b19-ad2b-f12e50220934 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 210 time: 0.0413518 Dec 21 03:50:47.585802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:47.683914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:47.722824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e79acd-7149-44f1-a807-38d4db434828 req-16aeb2a4-8bbd-4e6f-8ef3-657d5346edce tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:47.724682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32e79acd-7149-44f1-a807-38d4db434828 req-16aeb2a4-8bbd-4e6f-8ef3-657d5346edce tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 945 time: 0.0571177 Dec 21 03:50:47.746644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:47.791849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32e79acd-7149-44f1-a807-38d4db434828 req-924ffa78-1145-4743-a055-6a4d856ebf5e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602007 Dec 21 03:50:47.802656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:47.815623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 66e96a75-3965-47db-900b-9dfdb214fd6b up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:47.911201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e811e65-4b9f-4510-aa07-32c464c565ed req-badcc6ca-b072-4453-b80a-ae17062044ce tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:47.919472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e811e65-4b9f-4510-aa07-32c464c565ed req-badcc6ca-b072-4453-b80a-ae17062044ce tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 948 time: 0.0761681 Dec 21 03:50:47.948391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:47.960913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:50:47.968342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e811e65-4b9f-4510-aa07-32c464c565ed req-9eeaacaf-734c-4810-8df8-09004519d9d0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460043 Dec 21 03:50:47.977944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6'}, {'name': 'network-changed', 'server_uuid': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'tag': '5a6e8017-d827-4a67-93f9-d0890e97d658'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:47.980391 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bee4b9b-1c73-44da-8927-19181a094b1f" -d '{"events": [{"name": "network-changed", "server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6"}, {"name": "network-changed", "server_uuid": "2ce99e5a-872c-46a7-9dfd-be41a66caa45", "tag": "5a6e8017-d827-4a67-93f9-d0890e97d658"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:47.996009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 66e96a75-3965-47db-900b-9dfdb214fd6b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:48.000815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 66e96a75-3965-47db-900b-9dfdb214fd6b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:48.001227 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.020345 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c1412c7-edef-4220-8caf-fcce41627479 x-openstack-request-id: req-4c1412c7-edef-4220-8caf-fcce41627479 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:48.023407 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "2ce99e5a-872c-46a7-9dfd-be41a66caa45", "tag": "5a6e8017-d827-4a67-93f9-d0890e97d658", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:48.023407 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4c1412c7-edef-4220-8caf-fcce41627479 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:48.023407 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'status': 'completed', 'code': 200} Dec 21 03:50:48.023407 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'tag': '5a6e8017-d827-4a67-93f9-d0890e97d658', 'status': 'completed', 'code': 200} Dec 21 03:50:48.085317 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.116991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 66e96a75-3965-47db-900b-9dfdb214fd6b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=66e96a75-3965-47db-900b-9dfdb214fd6b,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:48.188514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-add5413d-2220-4d8e-b212-c7b73a92d2f3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.190130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-add5413d-2220-4d8e-b212-c7b73a92d2f3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "GET /v2.0/ports?device_id=5c02924a-d743-4110-9095-9ee5214a0914 HTTP/1.1" status: 200 len: 943 time: 0.0558343 Dec 21 03:50:48.192088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-af6c5e27-bc44-4c6f-b1b5-d1be3e8b1647 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.193568 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-af6c5e27-bc44-4c6f-b1b5-d1be3e8b1647 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1126 time: 0.0597162 Dec 21 03:50:48.272132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.295165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-c33f5679-4bf4-4a2c-b038-beef420090f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.296675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-c33f5679-4bf4-4a2c-b038-beef420090f0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.0872529 Dec 21 03:50:48.313179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Deleting port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:48.313617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.322064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=66e96a75-3965-47db-900b-9dfdb214fd6b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:48.356182 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-a88e81d2-7b69-4e9a-915b-9cca1eeda510 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 217 time: 0.0437407 Dec 21 03:50:48.404967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] For port abe0c0b5-39cd-48b7-a7cf-ad2813087b79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:48.406134 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.410737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-5f10db66-ee15-47ff-b508-ca2e22425d6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.412367 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-5f10db66-ee15-47ff-b508-ca2e22425d6e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0481629 Dec 21 03:50:48.417932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Calling delete_port for abe0c0b5-39cd-48b7-a7cf-ad2813087b79 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:48.445442 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-dc3c0997-e741-482b-b47d-5bad946e1398 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247064 Dec 21 03:50:48.552196 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-5686d518-dfa7-43a7-ac8a-b932475f2986 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0979331 Dec 21 03:50:48.623346 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.660955 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-e8b84e01-0040-4a87-82a3-f94689b6a405 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971682 Dec 21 03:50:48.687730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event deleted for resources: {'Port': ['ID=abe0c0b5-39cd-48b7-a7cf-ad2813087b79,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:48.709139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:48.719607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.719968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.720317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.727952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:50:48.730562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79'}, {'server_uuid': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66e96a75-3965-47db-900b-9dfdb214fd6b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:48.733818 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-922da2f4-118f-4c49-82df-98a0569f542e" -d '{"events": [{"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-unplugged", "status": "completed", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79"}, {"server_uuid": "fd9dbec7-49c0-4dc4-9c5c-290458789754", "name": "network-vif-plugged", "status": "completed", "tag": "66e96a75-3965-47db-900b-9dfdb214fd6b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:48.748407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2579f619-b436-4546-b403-1db2f2dbc554 req-9be2ecae-c036-4cad-86a7-d6380e86fb00 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.749934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2579f619-b436-4546-b403-1db2f2dbc554 req-9be2ecae-c036-4cad-86a7-d6380e86fb00 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 943 time: 0.1716537 Dec 21 03:50:48.752042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] No DVR routers for this DVR port abe0c0b5-39cd-48b7-a7cf-ad2813087b79 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:48.760952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129ba359-3039-4bb0-b626-4d634f317a5e req-428631b0-d725-424c-a14e-ed19e2d860e0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.762494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-129ba359-3039-4bb0-b626-4d634f317a5e req-428631b0-d725-424c-a14e-ed19e2d860e0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.1704431 Dec 21 03:50:48.763697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.767033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fdfb4e1-2a1b-4518-828c-19e0d2253136 req-e7ae4545-60b9-4bc3-b6b0-f47d6f411119 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "DELETE /v2.0/ports/abe0c0b5-39cd-48b7-a7cf-ad2813087b79 HTTP/1.1" status: 204 len: 173 time: 0.5589581 Dec 21 03:50:48.846225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2579f619-b436-4546-b403-1db2f2dbc554 req-d2b139d0-09ed-4061-b017-3e144a34a06a tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782549 Dec 21 03:50:48.855561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3781e671-c918-49b3-9054-1058dc084be7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:48.855732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-129ba359-3039-4bb0-b626-4d634f317a5e req-0b91a0aa-0e9b-4adb-82dd-852a21625009 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816977 Dec 21 03:50:48.948191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-3ca1e7d0-1770-4bb7-88dc-1f8b885e32df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:48.949687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-3ca1e7d0-1770-4bb7-88dc-1f8b885e32df service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=21b9e879064f458587507ce6fac2365f&device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 1095 time: 0.0818841 Dec 21 03:50:48.963712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-776bc5ee-4614-452a-8463-0aa4e97d17f1 req-a22b3027-3104-44c3-b9ac-2a6d51125870 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 210 time: 0.0273032 Dec 21 03:50:48.987387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3781e671-c918-49b3-9054-1058dc084be7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.023410 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89c1c590-3432-43ea-b364-c4d1e6260e15 x-openstack-request-id: req-89c1c590-3432-43ea-b364-c4d1e6260e15 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:49.023922 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-unplugged", "status": "completed", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79", "code": 200}, {"server_uuid": "fd9dbec7-49c0-4dc4-9c5c-290458789754", "name": "network-vif-plugged", "status": "completed", "tag": "66e96a75-3965-47db-900b-9dfdb214fd6b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:49.023922 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-89c1c590-3432-43ea-b364-c4d1e6260e15 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:49.024348 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'code': 200} Dec 21 03:50:49.024578 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66e96a75-3965-47db-900b-9dfdb214fd6b', 'code': 200} Dec 21 03:50:49.067905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-f5fc2d8c-9222-4559-9cbe-c8bb54c23eb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:49.069387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-f5fc2d8c-9222-4559-9cbe-c8bb54c23eb3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=922fdee6-1b18-4910-afce-31d41ad320e3 HTTP/1.1" status: 200 len: 910 time: 0.0991685 Dec 21 03:50:49.089807 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3781e671-c918-49b3-9054-1058dc084be7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.138803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3781e671-c918-49b3-9054-1058dc084be7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=02dc7c7793d34bbdb782d99411e9bd73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4279909 Dec 21 03:50:49.140742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:50:49.160255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3781e671-c918-49b3-9054-1058dc084be7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df9da6f0-798b-4f90-88be-0410478ed26a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:49.161757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-87d2426a-8673-42ec-9d81-ececfafbd9d0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5a6e8017-d827-4a67-93f9-d0890e97d658 HTTP/1.1" status: 200 len: 217 time: 0.0500343 Dec 21 03:50:49.195345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21c14efa-a611-45c0-b94d-bf1608b9539a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.221327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21c14efa-a611-45c0-b94d-bf1608b9539a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.262816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71df6aa4-1b42-4773-ab20-7e98acdbea12 req-ee1b178a-2b13-427d-a8c7-778abe723e2b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:49.264891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71df6aa4-1b42-4773-ab20-7e98acdbea12 req-ee1b178a-2b13-427d-a8c7-778abe723e2b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 945 time: 0.1837630 Dec 21 03:50:49.287400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad8a367-b164-4ce2-a030-f9bca9ea8e93 req-41feb302-2f63-4170-827b-309f1aa0d24d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:49.288740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aad8a367-b164-4ce2-a030-f9bca9ea8e93 req-41feb302-2f63-4170-827b-309f1aa0d24d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 1101 time: 0.1365299 Dec 21 03:50:49.291924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-b573ac32-fe0e-404a-81c6-4f04dbf92efa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:49.293231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-b573ac32-fe0e-404a-81c6-4f04dbf92efa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6c297c4e-6464-429b-85d1-7a6696565116 HTTP/1.1" status: 200 len: 849 time: 0.1136215 Dec 21 03:50:49.324299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb908e7-700e-4644-972f-815e0d243f25 req-6c3b97a9-0104-4896-9ca1-07615a55ba94 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:49.326260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feb908e7-700e-4644-972f-815e0d243f25 req-6c3b97a9-0104-4896-9ca1-07615a55ba94 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.1288466 Dec 21 03:50:49.349945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-0424a3f1-68f8-452a-ae01-dafa003f8c5e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=922fdee6-1b18-4910-afce-31d41ad320e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0437162 Dec 21 03:50:49.356079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21c14efa-a611-45c0-b94d-bf1608b9539a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.361349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21c14efa-a611-45c0-b94d-bf1608b9539a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.362801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21c14efa-a611-45c0-b94d-bf1608b9539a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/df9da6f0-798b-4f90-88be-0410478ed26a HTTP/1.1" status: 204 len: 168 time: 0.2195923 Dec 21 03:50:49.371197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c14efa-a611-45c0-b94d-bf1608b9539a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df9da6f0-798b-4f90-88be-0410478ed26a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:49.431751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71df6aa4-1b42-4773-ab20-7e98acdbea12 req-9e9c0f6a-50e0-47bc-8304-b610448d599a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1581390 Dec 21 03:50:49.492244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feb908e7-700e-4644-972f-815e0d243f25 req-c2670592-79f3-4ebf-9cd5-e575a76757af tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444421 Dec 21 03:50:49.496055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aad8a367-b164-4ce2-a030-f9bca9ea8e93 req-152fe287-cf38-4b99-ac02-adae1b90bcbc service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1807218 Dec 21 03:50:49.521735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-2339b232-d72f-4ddc-a371-ec8313eec083 service neutron] 10.222.0.31 "GET /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1550181 Dec 21 03:50:49.624986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bee4b9b-1c73-44da-8927-19181a094b1f req-ff09d7fd-0893-4cec-bb4c-0e6eff57fbaa service neutron] 10.222.0.31 "GET /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0935919 Dec 21 03:50:49.798218 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-efbf9c47-6b76-4684-9bbe-1e5faac12be5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.817019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:49.881690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 90696376-ba84-4217-a845-b149d216aace triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:49.882306 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:49.980368 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:50.023615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-deleted', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:50.024238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:50.026837 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1f68c94-1792-4735-9f8e-101432efe2c9" -d '{"events": [{"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-deleted", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:50.092629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983ab22-8ba6-43e8-9d57-ffb49004f3bf req-5cb47f18-49fa-473f-b586-0b443261afdb tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:50.094078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f983ab22-8ba6-43e8-9d57-ffb49004f3bf req-5cb47f18-49fa-473f-b586-0b443261afdb tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 943 time: 0.1511502 Dec 21 03:50:50.119558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-443961e6-d9d8-439b-900d-77f9c84a3665 req-c5095b6d-6195-4eb4-bd02-b96b3775027b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:50.121118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-443961e6-d9d8-439b-900d-77f9c84a3665 req-c5095b6d-6195-4eb4-bd02-b96b3775027b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.1590374 Dec 21 03:50:50.129159 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:50.129644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-ed0742f1-48d1-4b02-9da6-19c530389b5a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:50.131588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-ed0742f1-48d1-4b02-9da6-19c530389b5a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "GET /v2.0/networks?id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 200 len: 805 time: 0.2330587 Dec 21 03:50:50.166007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Request body: {'port': {'device_id': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'admin_state_up': True, 'tenant_id': '597df5e2769740859ecb4f30e4aefff3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:50.187222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:50.239802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f983ab22-8ba6-43e8-9d57-ffb49004f3bf req-48b784b7-657c-4b67-b1b6-74a173ba59b6 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1363645 Dec 21 03:50:50.284905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-443961e6-d9d8-439b-900d-77f9c84a3665 req-a97e4a0f-2a0a-473e-987d-6ae5786e3e98 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1466250 Dec 21 03:50:50.392463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae367d73-0ef9-4625-9f7a-10799fe8f642 req-fc9f3283-8bb4-4f3f-8bdb-109c15028444 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 210 time: 0.0381503 Dec 21 03:50:50.402301 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8267d17c-89c2-4b3e-a159-8625a21fb7cd x-openstack-request-id: req-8267d17c-89c2-4b3e-a159-8625a21fb7cd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:50.402604 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c02924a-d743-4110-9095-9ee5214a0914", "name": "network-vif-deleted", "tag": "abe0c0b5-39cd-48b7-a7cf-ad2813087b79", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:50.402864 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8267d17c-89c2-4b3e-a159-8625a21fb7cd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:50.403297 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c02924a-d743-4110-9095-9ee5214a0914', 'name': 'network-vif-deleted', 'tag': 'abe0c0b5-39cd-48b7-a7cf-ad2813087b79', 'status': 'completed', 'code': 200} Dec 21 03:50:50.466953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Made reservation on behalf of 597df5e2769740859ecb4f30e4aefff3 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:50.471005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:50.677662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e7f3a2e-624e-43c2-a8c2-9e3ddefa7ad8 req-7e61dafd-645e-4889-a3f3-0c8c35a273f1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:50.679154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e7f3a2e-624e-43c2-a8c2-9e3ddefa7ad8 req-7e61dafd-645e-4889-a3f3-0c8c35a273f1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1318936 Dec 21 03:50:50.707886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9175ec-5595-41bd-8890-30ea48ec7662 req-52a36bd0-3797-471a-a4ed-3cdbe7691ca0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:50.709661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c9175ec-5595-41bd-8890-30ea48ec7662 req-52a36bd0-3797-471a-a4ed-3cdbe7691ca0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.1260366 Dec 21 03:50:50.724774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Allocated IP 172.20.0.7 (d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1/d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766/1f510541-26ad-4ad3-a08b-3bc716e8e4db) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:50.804389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e7f3a2e-624e-43c2-a8c2-9e3ddefa7ad8 req-a35a304f-84d7-40fb-bb8b-c147bcb99396 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182976 Dec 21 03:50:50.813413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c9175ec-5595-41bd-8890-30ea48ec7662 req-df975e1d-4b8e-4341-a9c6-dbd66207e896 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956933 Dec 21 03:50:50.929252 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:51.015572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:51.026024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90696376-ba84-4217-a845-b149d216aace'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:51.029372 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1786a245-3933-446b-b13b-ba8cfb61bd56" -d '{"events": [{"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-plugged", "status": "completed", "tag": "90696376-ba84-4217-a845-b149d216aace"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:51.074985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:51.078953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:51.082349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:51.111989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:51.147439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:51.148483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:51.169179 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20e83ee3-ff65-4776-b962-4e7080f1ffb4 x-openstack-request-id: req-20e83ee3-ff65-4776-b962-4e7080f1ffb4 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:51.169477 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-plugged", "status": "completed", "tag": "90696376-ba84-4217-a845-b149d216aace", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:51.169732 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-20e83ee3-ff65-4776-b962-4e7080f1ffb4 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:51.170111 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90696376-ba84-4217-a845-b149d216aace', 'code': 200} Dec 21 03:50:51.246537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-34a40fd8-6942-486f-9504-89ca704cf0e8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0866406 Dec 21 03:50:51.271917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Request body: {'port': {'device_id': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:51.364339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8f2e6b-8b2b-4c36-b716-8922eb91214d req-57272749-e77e-4ed2-8124-99e2133bd0d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:51.365829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a8f2e6b-8b2b-4c36-b716-8922eb91214d req-57272749-e77e-4ed2-8124-99e2133bd0d1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 1098 time: 0.1078587 Dec 21 03:50:51.392218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:51.479250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 5a6e8017-d827-4a67-93f9-d0890e97d658 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:51.583984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 5a6e8017-d827-4a67-93f9-d0890e97d658, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=5a6e8017-d827-4a67-93f9-d0890e97d658,segment=NetworkSegment(ebc72439-11da-4c52-8368-1d661af040c0),segment_id=ebc72439-11da-4c52-8368-1d661af040c0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:51.597425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '5a6e8017-d827-4a67-93f9-d0890e97d658', 'network_id': '922fdee6-1b18-4910-afce-31d41ad320e3', 'port_id': '5a6e8017-d827-4a67-93f9-d0890e97d658', 'mac_address': 'fa:16:3e:fa:27:64', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c297c4e-6464-429b-85d1-7a6696565116', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:51.646650 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:51.665313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5a6e8017-d827-4a67-93f9-d0890e97d658 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:51.686852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 5a6e8017-d827-4a67-93f9-d0890e97d658, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=5a6e8017-d827-4a67-93f9-d0890e97d658,segment=NetworkSegment(ebc72439-11da-4c52-8368-1d661af040c0),segment_id=ebc72439-11da-4c52-8368-1d661af040c0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:51.797443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:51.804336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57a3f76-9e64-49ab-9561-a5d8ecca6045 req-13d7d8d1-d399-4ce5-ba91-55c298cc8715 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:51.805842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f57a3f76-9e64-49ab-9561-a5d8ecca6045 req-13d7d8d1-d399-4ce5-ba91-55c298cc8715 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 943 time: 0.4605062 Dec 21 03:50:51.817010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa483ce1-3984-48bf-bf25-763779d1f3c7 req-fa655eb2-462c-47a5-93b4-a5a05ba2899d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:51.818492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa483ce1-3984-48bf-bf25-763779d1f3c7 req-fa655eb2-462c-47a5-93b4-a5a05ba2899d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 943 time: 0.4517887 Dec 21 03:50:51.822489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a8f2e6b-8b2b-4c36-b716-8922eb91214d req-fec1bba7-f207-4152-9c8a-6946a3b3c0e3 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4281297 Dec 21 03:50:51.874260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=5a6e8017-d827-4a67-93f9-d0890e97d658,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:51.877110 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-063ff68f-1d8f-427d-bdd5-ddd6e8c04cf7 service neutron] 10.222.0.31 "GET /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.0801725 Dec 21 03:50:51.967372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f57a3f76-9e64-49ab-9561-a5d8ecca6045 req-adc7cacf-6423-4a17-a374-73c4d8f43f64 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1339002 Dec 21 03:50:51.991246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa483ce1-3984-48bf-bf25-763779d1f3c7 req-0d02d55a-9aa6-4dff-89a9-f3589acd9170 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1557407 Dec 21 03:50:52.116868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:52.152863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46015c9f-3745-490a-9c27-991deeab324a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.158577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:52.170406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60b02e0-e1b7-47f7-aac8-21d0ba2eb930 req-1727d5dc-9079-44fa-b431-fd471af0216a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.177578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d60b02e0-e1b7-47f7-aac8-21d0ba2eb930 req-1727d5dc-9079-44fa-b431-fd471af0216a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 931 time: 0.0992107 Dec 21 03:50:52.200072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['5a6e8017-d827-4a67-93f9-d0890e97d658'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:52.207958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:52.222291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:52.308790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f510541-26ad-4ad3-a08b-3bc716e8e4db {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:52.320329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d60b02e0-e1b7-47f7-aac8-21d0ba2eb930 req-c3c12cbb-3676-4fcb-a0c3-9e6bf98538ab tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419125 Dec 21 03:50:52.322798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.348245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Transition to ACTIVE for port object 1f510541-26ad-4ad3-a08b-3bc716e8e4db will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:52.354672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.365609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4d962f-b0d0-4ab7-b3b2-6c436cd9318b req-a4c8c3c6-a3be-462d-aa41-fba0936f5519 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.368629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de4d962f-b0d0-4ab7-b3b2-6c436cd9318b req-a4c8c3c6-a3be-462d-aa41-fba0936f5519 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1035838 Dec 21 03:50:52.431114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] Transition to ACTIVE for port object 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:52.431978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.474705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de4d962f-b0d0-4ab7-b3b2-6c436cd9318b req-e7c1a83c-f655-43bb-8acc-b26fb78bbf45 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0997145 Dec 21 03:50:52.495722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.509835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-536a24e3-4e5f-4ef2-bb56-fedb9d1e2a66 req-ac74edf9-e19c-4f07-9a4c-19299f4a7385 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.511334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-536a24e3-4e5f-4ef2-bb56-fedb9d1e2a66 req-ac74edf9-e19c-4f07-9a4c-19299f4a7385 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.1210289 Dec 21 03:50:52.512727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:52.528999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.571997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] No DVR routers for this DVR port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:52.585007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] Pushing event updated for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:52.609357 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-8563644b-f72f-4da2-a03d-9084c2ef3ccb service neutron] 10.222.0.31 "PUT /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 0.7235970 Dec 21 03:50:52.622255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-536a24e3-4e5f-4ef2-bb56-fedb9d1e2a66 req-4b158d9a-b15c-4bbe-938d-0e98383aa42d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834405 Dec 21 03:50:52.623881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Attempting to bind port 1f510541-26ad-4ad3-a08b-3bc716e8e4db on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:52.624222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Attempting to bind port 1f510541-26ad-4ad3-a08b-3bc716e8e4db by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:52.624548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Attempting to bind port 1f510541-26ad-4ad3-a08b-3bc716e8e4db on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:52.629201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Port 1f510541-26ad-4ad3-a08b-3bc716e8e4db on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:52.629519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Attempting to bind port 1f510541-26ad-4ad3-a08b-3bc716e8e4db on network d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:52.634387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:52.634744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Checking segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:52.635268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Bound using segment: {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:52.635703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Bound port: 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:52.636058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.745050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:52.762708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:52.780484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c9bcb1-90f3-426b-8c4e-216430263903 req-096a1404-a96d-4396-abe5-95b378551155 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.780484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0c9bcb1-90f3-426b-8c4e-216430263903 req-096a1404-a96d-4396-abe5-95b378551155 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 1101 time: 0.0662701 Dec 21 03:50:52.834019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.875312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0c9bcb1-90f3-426b-8c4e-216430263903 req-1baf1e30-82a4-48f0-9ab8-f2b53ed0e99f tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0972111 Dec 21 03:50:52.893671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.895590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:52.895718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] 10.222.0.31 "PUT /v2.0/ports/1f510541-26ad-4ad3-a08b-3bc716e8e4db HTTP/1.1" status: 200 len: 1092 time: 1.6281540 Dec 21 03:50:52.896088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:52.898275 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39017a12-7ff4-4133-ac59-57fa659c9fa5" -d '{"events": [{"name": "network-changed", "server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:52.904970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-63640920-9d54-4357-957d-2c8ea3fdd5dd tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.908095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-63640920-9d54-4357-957d-2c8ea3fdd5dd tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.1101394 Dec 21 03:50:52.936948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001e163d-dee2-459a-be4c-459ae8ce0ccc service neutron] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:52.957677 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7b29850-f79f-4a4c-9bc5-586b6874c6b6 x-openstack-request-id: req-a7b29850-f79f-4a4c-9bc5-586b6874c6b6 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:52.958006 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:52.958258 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a7b29850-f79f-4a4c-9bc5-586b6874c6b6 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:52.958653 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'status': 'completed', 'code': 200} Dec 21 03:50:52.971917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-88094f0b-6ce4-425c-906a-ce910b96a5a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:52.973561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-88094f0b-6ce4-425c-906a-ce910b96a5a4 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d&tenant_id=e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 1096 time: 0.0560842 Dec 21 03:50:53.057304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39017a12-7ff4-4133-ac59-57fa659c9fa5 req-d50a2d18-f0a2-4946-b207-92d76fff72f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.058817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39017a12-7ff4-4133-ac59-57fa659c9fa5 req-d50a2d18-f0a2-4946-b207-92d76fff72f1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 1095 time: 0.0479052 Dec 21 03:50:53.106119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:53.171770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-1050e0b3-3a0c-43be-80e0-d291b521555d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0947981 Dec 21 03:50:53.260808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d976b9c9-4bb6-40c5-bd7f-96bbaa476198 req-876e10e7-7db2-4e05-90f8-865c35b37d26 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.262303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d976b9c9-4bb6-40c5-bd7f-96bbaa476198 req-876e10e7-7db2-4e05-90f8-865c35b37d26 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 944 time: 0.1955037 Dec 21 03:50:53.311721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-9c1b8cf5-ca31-4019-af60-32f3e8869d39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.313094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-9c1b8cf5-ca31-4019-af60-32f3e8869d39 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1096 time: 0.2372687 Dec 21 03:50:53.367203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39017a12-7ff4-4133-ac59-57fa659c9fa5 req-bde55580-55f8-4bca-b2aa-12e968205a86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.368617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39017a12-7ff4-4133-ac59-57fa659c9fa5 req-bde55580-55f8-4bca-b2aa-12e968205a86 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=597df5e2769740859ecb4f30e4aefff3&shared=False HTTP/1.1" status: 200 len: 906 time: 0.2822227 Dec 21 03:50:53.440013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d976b9c9-4bb6-40c5-bd7f-96bbaa476198 req-2b760df1-5fbd-4a92-921b-581c6d99afc8 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1682489 Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.443662 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:50:53.446923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-743722bc-aee6-4788-bb05-790f575a632c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.448636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-743722bc-aee6-4788-bb05-790f575a632c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2680511 Dec 21 03:50:53.494878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 5a6e8017-d827-4a67-93f9-d0890e97d658 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:50:53.524469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-cc1e9727-846f-43c1-93af-fc4c418e08a7 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/quotas/9839aab3796944fe8a09f1cfbd7edf8b HTTP/1.1" status: 200 len: 375 time: 0.0451441 Dec 21 03:50:53.628211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b4755c3d-b1be-4029-8e72-3cc96b41e685 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.633521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-b4755c3d-b1be-4029-8e72-3cc96b41e685 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.2785935 Dec 21 03:50:53.643486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39017a12-7ff4-4133-ac59-57fa659c9fa5 req-3602ce2e-2a6c-42e1-81ce-6ac47641bb38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.644881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39017a12-7ff4-4133-ac59-57fa659c9fa5 req-3602ce2e-2a6c-42e1-81ce-6ac47641bb38 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2563546 Dec 21 03:50:53.654846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 5a6e8017-d827-4a67-93f9-d0890e97d658 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:50:53.658768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 5a6e8017-d827-4a67-93f9-d0890e97d658 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:53.661425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:53.695624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dda53b7-80ea-4d24-8ca8-e1d3b0f99e4a req-f5741fc8-dac1-4d5b-b25e-f07171bdd351 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.696700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dda53b7-80ea-4d24-8ca8-e1d3b0f99e4a req-f5741fc8-dac1-4d5b-b25e-f07171bdd351 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.1694391 Dec 21 03:50:53.698898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-1cbed5fc-e0c6-4108-89f8-376ce87b5697 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 217 time: 0.0589690 Dec 21 03:50:53.714580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-93e12ddc-d6ec-45b2-abb3-bc9d0dd969b3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&fields=id HTTP/1.1" status: 200 len: 532 time: 0.1715796 Dec 21 03:50:53.746891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:53.771273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a6e8017-d827-4a67-93f9-d0890e97d658'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:53.773562 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5152a40-5baa-41b2-be92-7c10f02de1e0" -d '{"events": [{"server_uuid": "2ce99e5a-872c-46a7-9dfd-be41a66caa45", "name": "network-vif-plugged", "status": "completed", "tag": "5a6e8017-d827-4a67-93f9-d0890e97d658"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:53.787256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 5a6e8017-d827-4a67-93f9-d0890e97d658, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=5a6e8017-d827-4a67-93f9-d0890e97d658,segment=NetworkSegment(ebc72439-11da-4c52-8368-1d661af040c0),segment_id=ebc72439-11da-4c52-8368-1d661af040c0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:53.810745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-0afd2af4-ea1c-4872-86d6-b481e58fbce1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.812277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-0afd2af4-ea1c-4872-86d6-b481e58fbce1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0951345 Dec 21 03:50:53.843229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dda53b7-80ea-4d24-8ca8-e1d3b0f99e4a req-c9922ca7-b7e3-459d-8306-c5f34202bf83 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276135 Dec 21 03:50:53.849183 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:53.850434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:53.859041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-d814ac27-b567-4b11-8edd-f6da3099bae6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0355175 Dec 21 03:50:53.862176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-6f09f503-0ac7-421f-8b74-075380e7d100 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:53.864565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-6f09f503-0ac7-421f-8b74-075380e7d100 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=597df5e2769740859ecb4f30e4aefff3&device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 1095 time: 0.1338449 Dec 21 03:50:53.944311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=5a6e8017-d827-4a67-93f9-d0890e97d658,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:53.947957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:50:53.948557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:53.949153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:53.976505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: abe0c0b5-39cd-48b7-a7cf-ad2813087b79 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:53.977084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device abe0c0b5-39cd-48b7-a7cf-ad2813087b79 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:50:54.013177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-97c9c081-93ba-45b5-88e1-4f8a3876c366 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db HTTP/1.1" status: 200 len: 217 time: 0.1221290 Dec 21 03:50:54.123351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-f5af6a36-6666-4b86-8492-c70ade067833 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.124322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-f5af6a36-6666-4b86-8492-c70ade067833 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 200 len: 845 time: 0.0981824 Dec 21 03:50:54.127606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-0a2bf422-ece6-4a8d-9f82-74c7b93fe7bf service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2609584 Dec 21 03:50:54.150567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2930b1-b367-4a34-ac1c-f909f67d3f41 req-7dddfdbb-573b-4461-924d-df67515dea22 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.152351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be2930b1-b367-4a34-ac1c-f909f67d3f41 req-7dddfdbb-573b-4461-924d-df67515dea22 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 943 time: 0.1142313 Dec 21 03:50:54.194994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-6c441252-6a54-4855-9199-eb7033bbe451 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0609033 Dec 21 03:50:54.389083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be2930b1-b367-4a34-ac1c-f909f67d3f41 req-a8a761b9-3131-4e87-8ef7-a1c38b7609c0 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2268722 Dec 21 03:50:54.403505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553bafbe-1285-47e6-99c9-566d4c035011 req-a21ef317-a341-49b0-b114-09f3d0222deb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.405053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-553bafbe-1285-47e6-99c9-566d4c035011 req-a21ef317-a341-49b0-b114-09f3d0222deb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.2518523 Dec 21 03:50:54.430774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-05b49800-f238-44a2-94b2-5502bf119f5b service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2883461 Dec 21 03:50:54.439674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-058db71b-6216-4ff2-a791-2f04745e5405 service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2182143 Dec 21 03:50:54.454142 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44a3ee7b-5cbe-4920-9d20-7ce70fbee9c6 x-openstack-request-id: req-44a3ee7b-5cbe-4920-9d20-7ce70fbee9c6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:54.454142 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ce99e5a-872c-46a7-9dfd-be41a66caa45", "name": "network-vif-plugged", "status": "completed", "tag": "5a6e8017-d827-4a67-93f9-d0890e97d658", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:54.454142 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-44a3ee7b-5cbe-4920-9d20-7ce70fbee9c6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:54.454142 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a6e8017-d827-4a67-93f9-d0890e97d658', 'code': 200} Dec 21 03:50:54.516791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-553bafbe-1285-47e6-99c9-566d4c035011 req-a5aa641b-d03f-4cfd-8418-03551c341fd5 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1029847 Dec 21 03:50:54.520442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23551729-229b-4019-bfa3-05cbdb381df9 req-57dc8297-2fa3-4142-8b6f-f3a5d236728d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 210 time: 0.0408795 Dec 21 03:50:54.593647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a7d1137-10ec-4993-9067-d20e23a18d61 req-c2cb6614-80b1-487b-80ea-82007758824c service neutron] 10.222.0.31 "GET /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1406918 Dec 21 03:50:54.636318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d77a5a8-8d0d-4ceb-87b6-871d53c8f1a1 req-42db6a15-4b06-47a1-b95b-01b5f40afa88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.636318 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1d77a5a8-8d0d-4ceb-87b6-871d53c8f1a1 req-42db6a15-4b06-47a1-b95b-01b5f40afa88 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 1097 time: 0.0789378 Dec 21 03:50:54.686580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1d77a5a8-8d0d-4ceb-87b6-871d53c8f1a1 req-064f105a-1e18-4975-a2b5-aa034349463f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425539 Dec 21 03:50:54.721650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da05949a-10b0-4405-adb7-c0e2baf7be2c req-a5bba3a9-d223-45fb-a69e-e3f8d1a131a6 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.723186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da05949a-10b0-4405-adb7-c0e2baf7be2c req-a5bba3a9-d223-45fb-a69e-e3f8d1a131a6 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.0913024 Dec 21 03:50:54.738880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9490b9a2-cbe6-40af-a159-ceec173cccfc req-7f19e74a-759a-41d3-b3c0-c9df029c7e99 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.740353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9490b9a2-cbe6-40af-a159-ceec173cccfc req-7f19e74a-759a-41d3-b3c0-c9df029c7e99 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 945 time: 0.0705388 Dec 21 03:50:54.803297 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:54.808586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da05949a-10b0-4405-adb7-c0e2baf7be2c req-fb9f015a-a80d-4b05-b9f3-b27188b0064c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778553 Dec 21 03:50:54.816520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9490b9a2-cbe6-40af-a159-ceec173cccfc req-2a53eeab-0f39-46f9-9a7e-399d3e56d61f tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696549 Dec 21 03:50:54.945790 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:54.983680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fea7715c-8d5e-4807-9da3-140d23191aac req-ce49b6b9-029b-4736-87cd-c1bc2ac16265 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:54.985149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fea7715c-8d5e-4807-9da3-140d23191aac req-ce49b6b9-029b-4736-87cd-c1bc2ac16265 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.0534933 Dec 21 03:50:55.033288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fea7715c-8d5e-4807-9da3-140d23191aac req-b4459d61-0f7e-4332-8b7d-f675c422a6b0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420983 Dec 21 03:50:55.147235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-1ea8fbd9-83c0-4b40-8a42-a8dd4f6a0626 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:55.148680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-1ea8fbd9-83c0-4b40-8a42-a8dd4f6a0626 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0485060 Dec 21 03:50:55.339580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-c2f1075f-6a8d-41e7-8084-e8369a903e07 service neutron] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:55.343219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-c2f1075f-6a8d-41e7-8084-e8369a903e07 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:55.344415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ca672a3-e990-4bfb-9313-3180dd1a3e9b req-c2f1075f-6a8d-41e7-8084-e8369a903e07 service neutron] 10.222.0.54 "DELETE /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.1869063 Dec 21 03:50:55.576694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe39077-bdcc-4202-8c34-288c8b1f049b req-d552c8cc-f596-4e35-931a-859482119358 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:55.578132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebe39077-bdcc-4202-8c34-288c8b1f049b req-d552c8cc-f596-4e35-931a-859482119358 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 943 time: 0.1147125 Dec 21 03:50:55.625289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-2004de1e-6388-4a89-a855-4abf0d64b002 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:55.626778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-2004de1e-6388-4a89-a855-4abf0d64b002 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 814 time: 0.1331587 Dec 21 03:50:55.654902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:55.665045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebe39077-bdcc-4202-8c34-288c8b1f049b req-d2eb8a98-9607-4d70-a242-b874070f7c8b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0793543 Dec 21 03:50:55.666308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-f604170a-ab0b-4baf-aa61-8cb14712b1c5 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/quotas/20acfa324e9b4279a50bf03610639a83 HTTP/1.1" status: 200 len: 375 time: 0.0323617 Dec 21 03:50:55.717290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-a7f43317-c1a1-454a-9683-573175cd6840 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0441041 Dec 21 03:50:55.769604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d07015f-05d2-4447-a996-17d6d35b67ad req-a0794d03-4e58-49e0-a1d2-171b3fa9849e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 210 time: 0.0447598 Dec 21 03:50:55.834083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-f1163c03-7f40-488b-98b2-01c9a0842f45 service neutron] 10.222.0.18 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1081688 Dec 21 03:50:55.957877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-f973991e-2856-4662-b7c0-cae7341a4bd5 service neutron] 10.222.0.18 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1164989 Dec 21 03:50:55.968961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc19a17-1300-4c7c-8902-c4476cf78ddd req-5644c556-3e76-4f8f-97a3-99977e925999 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:55.970402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fc19a17-1300-4c7c-8902-c4476cf78ddd req-5644c556-3e76-4f8f-97a3-99977e925999 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 945 time: 0.0749319 Dec 21 03:50:56.023904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fc19a17-1300-4c7c-8902-c4476cf78ddd req-4114235f-de18-42d3-b87e-8dcccfbe0f5e tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470140 Dec 21 03:50:56.148619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145a703d-bc09-4a1d-a577-19d7ae56bbd8 req-5f3ac365-0f73-4d49-a36a-4a0d8cd6da0e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:56.150137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145a703d-bc09-4a1d-a577-19d7ae56bbd8 req-5f3ac365-0f73-4d49-a36a-4a0d8cd6da0e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.0510714 Dec 21 03:50:56.232957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4bf919e-51dd-43b0-b9c9-d5638d8b7d3c req-d48c62c8-e5f5-410d-a6d6-f0258abf5f61 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 210 time: 0.0416338 Dec 21 03:50:56.238063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145a703d-bc09-4a1d-a577-19d7ae56bbd8 req-eafcbc35-140e-4d8c-9c43-5c84ce1e9b53 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802872 Dec 21 03:50:56.441487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c45b4da-4cfe-47d0-ba35-c6444e3c99ed req-4bf69695-9553-4b9b-ab27-6270a9c305da tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:56.443060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c45b4da-4cfe-47d0-ba35-c6444e3c99ed req-4bf69695-9553-4b9b-ab27-6270a9c305da tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1096 time: 0.0420284 Dec 21 03:50:56.503712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c45b4da-4cfe-47d0-ba35-c6444e3c99ed req-2cdfade6-8aa7-46f2-ae53-a0a6ec1e42fe tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526254 Dec 21 03:50:56.521889 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-e613df7b-fa96-41f0-8622-312e4b897f0f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0286863 Dec 21 03:50:56.668917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-b02e34b4-7dd0-45a4-b46b-81e17db779c2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:56.672431 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-b02e34b4-7dd0-45a4-b46b-81e17db779c2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1391799 Dec 21 03:50:56.706898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Request body: {'port': {'device_id': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '9839aab3796944fe8a09f1cfbd7edf8b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:56.880024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee375d9-d4bf-4bf8-adaf-a5b5c1950e03 req-792bf665-4593-4da4-9b2d-4dd527f271e3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:56.881755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ee375d9-d4bf-4bf8-adaf-a5b5c1950e03 req-792bf665-4593-4da4-9b2d-4dd527f271e3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 943 time: 0.0837398 Dec 21 03:50:56.895863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-f21e9a33-b3c1-4943-b0bc-14b39860f84d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:56.897737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-f21e9a33-b3c1-4943-b0bc-14b39860f84d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.1788642 Dec 21 03:50:56.959937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-47aa4766-8ad0-4e4a-9e64-ed436d0a2629 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/quotas/e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 375 time: 0.0404756 Dec 21 03:50:56.973469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ee375d9-d4bf-4bf8-adaf-a5b5c1950e03 req-0c459453-2553-456e-8082-1079a3dc1de3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727942 Dec 21 03:50:57.031540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-d592ae73-ca7f-478b-bee8-60514137c516 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0705831 Dec 21 03:50:57.086464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a320843f-bec7-4635-9c59-33a1fadc8559 req-410261da-aa1e-4068-bce1-bb29546dd4d4 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 210 time: 0.0539274 Dec 21 03:50:57.237390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Made reservation on behalf of 9839aab3796944fe8a09f1cfbd7edf8b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:50:57.241053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:57.388496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Allocated IP 192.168.233.236 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/9f9f5b3f-ff4d-4ea3-8721-8290f66f1552) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:50:57.527996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-7a65b43b-cde3-4432-b371-8883e881172b service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4942107 Dec 21 03:50:57.540572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b170e68-48e3-44d6-baca-9cf665d69390 req-034c2faf-e781-4028-9015-dfe4dd8f7faa tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:57.542042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b170e68-48e3-44d6-baca-9cf665d69390 req-034c2faf-e781-4028-9015-dfe4dd8f7faa tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 945 time: 0.1118078 Dec 21 03:50:57.554979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:57.559128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-66ddeb6c-955e-4856-bdab-e5165deaae2b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:57.561177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-66ddeb6c-955e-4856-bdab-e5165deaae2b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "GET /v2.0/ports?device_id=340f0f34-f3fa-4feb-9aeb-d6e453a1fe01 HTTP/1.1" status: 200 len: 946 time: 0.1320281 Dec 21 03:50:57.689880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:57.719175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b170e68-48e3-44d6-baca-9cf665d69390 req-995409d2-dfdc-46e9-92bc-a2056fe26a6f tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1568940 Dec 21 03:50:57.729084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:57.741276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:50:57.741394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5', '37f13e0f-1f8b-4106-974a-bdabfab506b1', '66e96a75-3965-47db-900b-9dfdb214fd6b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:50:57.741491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:50:57.744225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:50:57.751594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event updated for resources: {'Port': ['ID=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:57.761807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c95f9488-99f1-45eb-ada5-ed28dbaf86c5 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2164822 Dec 21 03:50:57.785894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Deleting port 90696376-ba84-4217-a845-b149d216aace {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:50:57.785894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:57.837548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:57.838695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:57.954321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] For port 90696376-ba84-4217-a845-b149d216aace, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=90696376-ba84-4217-a845-b149d216aace,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:57.955554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:57.960706 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-ab4d49bc-d8db-497e-b0ea-c7ee2d5dd9cd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.2621207 Dec 21 03:50:57.973205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Calling delete_port for 90696376-ba84-4217-a845-b149d216aace owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:50:57.986855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Request body: {'port': {'device_id': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:50:58.055565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e986fe0-4144-4629-a709-8fbf5cbd76bf req-94f5ff12-aa73-44fc-98a7-0f2eaa3cd4bf tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 210 time: 0.0684743 Dec 21 03:50:58.151613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:58.307400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7ab9fc0d-cdbc-4fa5-8e1c-5c7df7a51bc3 None None] Provisioning complete for port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:50:58.307777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ab9fc0d-cdbc-4fa5-8e1c-5c7df7a51bc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:58.361116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7ab9fc0d-cdbc-4fa5-8e1c-5c7df7a51bc3 None None] Port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:50:58.406962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a41d872-fade-4921-b95b-8fb87a2ef06d req-6239efea-b86f-4114-bd7c-a759d47666f5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:58.409857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a41d872-fade-4921-b95b-8fb87a2ef06d req-6239efea-b86f-4114-bd7c-a759d47666f5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 943 time: 0.0695953 Dec 21 03:50:58.480105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a41d872-fade-4921-b95b-8fb87a2ef06d req-43261d14-b43e-4f98-888d-ee53dea1e3e7 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629714 Dec 21 03:50:58.481550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:58.525156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Pushing event deleted for resources: {'Port': ['ID=90696376-ba84-4217-a845-b149d216aace,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:58.819280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-bedbc5a0-a807-4f9b-8fa4-ade30d73b013 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=a2b50fd62fc440ddb648791821139549&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0503786 Dec 21 03:50:58.819434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:58.819434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:58.820089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] No DVR routers for this DVR port 90696376-ba84-4217-a845-b149d216aace on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:50:58.820193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Transition to ACTIVE for port object 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:50:58.820307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:58.820307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aeb04663-2cf3-4d45-b682-04b5c3e2fd69 req-bd97b280-9a9d-46d7-8b26-4141d7c6b9fb tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "DELETE /v2.0/ports/90696376-ba84-4217-a845-b149d216aace HTTP/1.1" status: 204 len: 173 time: 1.1289177 Dec 21 03:50:58.820307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-deleted', 'tag': '90696376-ba84-4217-a845-b149d216aace'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:58.820307 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee9b3a10-a5db-4748-91c1-5e8a61958973" -d '{"events": [{"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-deleted", "tag": "90696376-ba84-4217-a845-b149d216aace"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:58.820307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87348475-4c44-4f33-a49d-9c0d6c13faa2 req-c80d51e2-9540-4106-b184-9693223502ab tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 210 time: 0.1040127 Dec 21 03:50:58.836925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-940497fb-1ce7-4271-bc46-af1e26784f61 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:58.838395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-940497fb-1ce7-4271-bc46-af1e26784f61 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2131357 Dec 21 03:50:58.866007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:58.870338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-474bfc53-3527-4f05-b916-fbbe682f9207 req-82d14dce-20ee-403d-94cc-9038ea773949 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:58.871947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-474bfc53-3527-4f05-b916-fbbe682f9207 req-82d14dce-20ee-403d-94cc-9038ea773949 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 936 time: 0.0831752 Dec 21 03:50:58.874459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-6d5b5c63-6b60-4f77-8336-3c8cf88862e2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/quotas/a2b50fd62fc440ddb648791821139549 HTTP/1.1" status: 200 len: 375 time: 0.0240293 Dec 21 03:50:58.938514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-b5727d01-54d4-4cac-a857-c06f845b8495 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=a2b50fd62fc440ddb648791821139549&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0499079 Dec 21 03:50:58.967516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-474bfc53-3527-4f05-b916-fbbe682f9207 req-31b75886-0050-4ec9-95d9-0121f7f1e16d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848653 Dec 21 03:50:59.020024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Pushing event updated for resources: {'Port': ['ID=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:59.069019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Attempting to bind port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:50:59.069706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Attempting to bind port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:50:59.070344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Attempting to bind port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:59.081695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:50:59.081695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Attempting to bind port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:50:59.084426 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d610da5a-a8ee-47ff-aad6-8c20da5495ae x-openstack-request-id: req-d610da5a-a8ee-47ff-aad6-8c20da5495ae {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:59.084720 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "340f0f34-f3fa-4feb-9aeb-d6e453a1fe01", "name": "network-vif-deleted", "tag": "90696376-ba84-4217-a845-b149d216aace", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:59.084976 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d610da5a-a8ee-47ff-aad6-8c20da5495ae {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:59.085410 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '340f0f34-f3fa-4feb-9aeb-d6e453a1fe01', 'name': 'network-vif-deleted', 'tag': '90696376-ba84-4217-a845-b149d216aace', 'status': 'completed', 'code': 200} Dec 21 03:50:59.086761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:50:59.087123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:50:59.087540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:50:59.088515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Bound port: 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:50:59.088515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:59.168443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] For port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:50:59.171939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] For port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:50:59.284507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-191b28a4-80bb-4b86-89ba-ee5af9796272 req-cebb07f7-0619-43c9-9a7a-b434ef2243cc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 210 time: 0.0278883 Dec 21 03:50:59.307774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:59.353156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:59.353778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:59.355321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] 10.222.0.31 "PUT /v2.0/ports/9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 HTTP/1.1" status: 200 len: 1097 time: 1.3775644 Dec 21 03:50:59.355659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'tag': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:50:59.358974 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0b5e29e-3090-44dc-b4ab-6c99eba21465" -d '{"events": [{"name": "network-changed", "server_uuid": "71c3a61a-efe8-4347-8357-415b7c010eb6", "tag": "9f9f5b3f-ff4d-4ea3-8721-8290f66f1552"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:50:59.385690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2abfa58-9e19-48e3-80ff-19bf01838078 service neutron] Pushing event updated for resources: {'Port': ['ID=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:50:59.510179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:50:59.510697 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:50:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eff12278-116f-4548-aab6-b5239225b8d3 x-openstack-request-id: req-eff12278-116f-4548-aab6-b5239225b8d3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:50:59.510697 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "71c3a61a-efe8-4347-8357-415b7c010eb6", "tag": "9f9f5b3f-ff4d-4ea3-8721-8290f66f1552", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:50:59.510975 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eff12278-116f-4548-aab6-b5239225b8d3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:50:59.511249 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'tag': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552', 'status': 'completed', 'code': 200} Dec 21 03:50:59.579048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-8d630147-3d7f-4058-888c-9d9673f44006 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=a2b50fd62fc440ddb648791821139549&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0624371 Dec 21 03:50:59.607002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-38787772-970b-4238-bb96-10891a9cba29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:59.610030 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-38787772-970b-4238-bb96-10891a9cba29 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 1100 time: 0.0753992 Dec 21 03:50:59.681593 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-0b7e19c3-fa48-4a3e-9229-a16250e8562c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.236&port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 HTTP/1.1" status: 200 len: 217 time: 0.0440631 Dec 21 03:50:59.744271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:59.761812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'mac_address': 'fa:16:3e:ad:44:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:50:59.772205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-a43b7575-9465-4c74-846a-083df88893ef tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:59.779562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-a43b7575-9465-4c74-846a-083df88893ef tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1835699 Dec 21 03:50:59.789597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-e3519b51-3487-4dd7-9bbf-05be3a6455c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:59.795367 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-e3519b51-3487-4dd7-9bbf-05be3a6455c6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0923817 Dec 21 03:50:59.809596 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:59.817699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-3248f7e4-53f9-45ed-8d59-13434374782d tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/quotas/a2b50fd62fc440ddb648791821139549 HTTP/1.1" status: 200 len: 375 time: 0.0343685 Dec 21 03:50:59.826684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f510541-26ad-4ad3-a08b-3bc716e8e4db {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:50:59.845027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384df1e3-03db-40e8-b624-df773204bb74 req-c3929ad9-d3a9-41a9-a8c0-e9f4e19435ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:59.846580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa85169-ce9d-4b08-ac22-e1891e5d1e1a req-7fe6d548-6ed6-4115-82e3-74c85999d80a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:50:59.846866 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-c3929ad9-d3a9-41a9-a8c0-e9f4e19435ae service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0476539 Dec 21 03:50:59.848736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5aa85169-ce9d-4b08-ac22-e1891e5d1e1a req-7fe6d548-6ed6-4115-82e3-74c85999d80a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 943 time: 0.0676591 Dec 21 03:50:59.858062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:50:59.901106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-c64ceda0-c43e-40c1-a36a-71240cf1e674 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=a2b50fd62fc440ddb648791821139549&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0447879 Dec 21 03:50:59.929573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:50:59.956008 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-90c91f13-cf5a-4f9f-a0d8-a2d77697eaf4 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1001241 Dec 21 03:50:59.963673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:50:59.982584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 90696376-ba84-4217-a845-b149d216aace {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:50:59.984496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 90696376-ba84-4217-a845-b149d216aace not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:00.023741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5aa85169-ce9d-4b08-ac22-e1891e5d1e1a req-3f473e52-d40f-4ec5-b7f4-ac700ca3bf66 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1546481 Dec 21 03:51:00.072959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:00.088823 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384df1e3-03db-40e8-b624-df773204bb74 req-dbd5c6e5-242b-418f-b9a4-6b23212d6043 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1233540 Dec 21 03:51:00.110196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-7df75f7a-2a73-4a57-8b53-eb271c7e1ea8 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:00.111880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-7df75f7a-2a73-4a57-8b53-eb271c7e1ea8 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 814 time: 0.2099147 Dec 21 03:51:00.135524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Request body: {'port': {'device_id': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'admin_state_up': True, 'tenant_id': '20acfa324e9b4279a50bf03610639a83'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:00.276062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c82b6452-d6ec-4f1a-a1b9-b2e411f07279 req-4d6c0f19-128b-4562-934d-d7853a274473 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 210 time: 0.0602930 Dec 21 03:51:00.314696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1f510541-26ad-4ad3-a08b-3bc716e8e4db'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:00.361163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-7c3af281-8b27-4b99-8b4e-6f9a9931f1b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:00.361163 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-7c3af281-8b27-4b99-8b4e-6f9a9931f1b7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 1100 time: 0.0743299 Dec 21 03:51:00.384519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939b508a-3ae9-4fb5-b01f-889216206dd9 req-9ad4fcaf-b2a7-4b1e-9b0a-af8d0a86171d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:00.384519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-939b508a-3ae9-4fb5-b01f-889216206dd9 req-9ad4fcaf-b2a7-4b1e-9b0a-af8d0a86171d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 948 time: 0.1027393 Dec 21 03:51:00.487485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-f8f052a1-8476-4449-9d41-ad21dbfdc498 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:00.489561 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-f8f052a1-8476-4449-9d41-ad21dbfdc498 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1211500 Dec 21 03:51:00.490222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-939b508a-3ae9-4fb5-b01f-889216206dd9 req-cba2e08a-e823-41d1-b39e-85eca6d3028b tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971780 Dec 21 03:51:00.542415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-1885dfa2-db77-4180-a0ab-1b0e808bbfc0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.236&port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 HTTP/1.1" status: 200 len: 217 time: 0.0414779 Dec 21 03:51:00.565412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fb3e270-9f4a-4cc5-a611-3af3e401526d req-70b4c2c1-c746-4345-9e3d-4c9aa5b8f2a5 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 210 time: 0.0291381 Dec 21 03:51:00.566540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Made reservation on behalf of 20acfa324e9b4279a50bf03610639a83 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:00.574302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:00.645069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-d19ab207-e6c0-4f6f-bda2-479c14409c2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:00.646570 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-d19ab207-e6c0-4f6f-bda2-479c14409c2a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0930831 Dec 21 03:51:00.718506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6100b07c-bf81-401f-9da5-f9b28664a33a req-fd062864-0a5b-42f1-b481-a81fa754a1cc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 210 time: 0.0435295 Dec 21 03:51:00.724850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-43ee89c5-025f-4808-a0d7-052d416a04e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:00.727842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-43ee89c5-025f-4808-a0d7-052d416a04e7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0668881 Dec 21 03:51:00.804739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Allocated IP 172.20.0.13 (24735258-b5ad-42e8-a231-667c1278689e/da10d7f0-623a-4e8a-b5fc-286a12beadcd/05a0e112-ef34-4410-b1cb-36798e5b7d77) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:00.887514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-6ae04949-e5d1-48bc-883b-5c5a153ec11f service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1336203 Dec 21 03:51:00.988500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.027595 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d0b5e29e-3090-44dc-b4ab-6c99eba21465 req-f242e111-c7d0-4cda-967f-ca8ab7d0ea67 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1184919 Dec 21 03:51:01.154145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8925f9e-1c6b-4c02-976d-c4244d2cbae2 req-e62c2410-fe7e-4d99-a346-04c38336ed20 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:01.155699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8925f9e-1c6b-4c02-976d-c4244d2cbae2 req-e62c2410-fe7e-4d99-a346-04c38336ed20 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 944 time: 0.0515530 Dec 21 03:51:01.157355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.227529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Network 24735258-b5ad-42e8-a231-667c1278689e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:01.235603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:01.242691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Pushing event updated for resources: {'Port': ['ID=05a0e112-ef34-4410-b1cb-36798e5b7d77,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:01.246993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:01.294748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8925f9e-1c6b-4c02-976d-c4244d2cbae2 req-d545aaa7-1136-4083-9cf7-860b543697ae tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1280088 Dec 21 03:51:01.315574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:01.316317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.392387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-7595ecdc-dfad-437c-a6fd-4c74a8831570 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:01.394397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-7595ecdc-dfad-437c-a6fd-4c74a8831570 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.1580372 Dec 21 03:51:01.416429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53a169cb-e276-4abe-9cd3-0dd25bcc2852 req-97c8a63b-32f0-4f39-8f31-1fa5fd7ea303 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 210 time: 0.0273733 Dec 21 03:51:01.418793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Request body: {'port': {'device_id': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'admin_state_up': True, 'tenant_id': 'e49c9575c393446a904ba5840d68746b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:01.468866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-dfff2fd6-a3df-4b19-a7f8-e9a231da028a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3383126 Dec 21 03:51:01.492751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Request body: {'port': {'device_id': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:01.541387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:01.561672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.596059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Made reservation on behalf of e49c9575c393446a904ba5840d68746b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:01.600296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.683401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 1f510541-26ad-4ad3-a08b-3bc716e8e4db completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:01.689269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 1f510541-26ad-4ad3-a08b-3bc716e8e4db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:01.694268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.754360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Allocated IP 172.20.0.14 (5fd01e07-75a4-4745-ad05-8ade1a021605/13099c8a-54c1-41b2-a4f4-664d17e69495/291446c0-79fe-4164-ba73-8b5de753da33) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:01.777369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2526530-52ea-4156-81c3-7066261bbba0 req-c77475af-485e-412b-a26b-86330ff2b7c3 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 210 time: 0.0998490 Dec 21 03:51:01.780094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.803260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f818b65-7ea0-400e-9ae3-b1cfa6259742 req-3d97500a-c03d-4f7a-880b-b0ec89f8a22f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:01.811945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f818b65-7ea0-400e-9ae3-b1cfa6259742 req-3d97500a-c03d-4f7a-880b-b0ec89f8a22f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 948 time: 0.1803110 Dec 21 03:51:01.830636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:01.831753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:01.834450 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17521e11-5365-48da-b972-f49ef0124733" -d '{"events": [{"server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "name": "network-vif-plugged", "status": "completed", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:01.895143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.955821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:01.970685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:01.976430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f818b65-7ea0-400e-9ae3-b1cfa6259742 req-dc6dc0fa-c18d-45a7-bbec-42556d1fe56d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1633475 Dec 21 03:51:02.029729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea155583-d68c-4a30-b473-ef242f835d3c req-0bfd4a39-75aa-4a43-94bd-60aac7bcf6e4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.031227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea155583-d68c-4a30-b473-ef242f835d3c req-0bfd4a39-75aa-4a43-94bd-60aac7bcf6e4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 932 time: 0.1164877 Dec 21 03:51:02.088334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.105601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 05a0e112-ef34-4410-b1cb-36798e5b7d77 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:02.117298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.120385 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f372992a-d1c7-4a10-b453-f63452b92362 x-openstack-request-id: req-f372992a-d1c7-4a10-b453-f63452b92362 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:02.121252 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "name": "network-vif-plugged", "status": "completed", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:02.122070 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f372992a-d1c7-4a10-b453-f63452b92362 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:02.124058 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'code': 200} Dec 21 03:51:02.139111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea155583-d68c-4a30-b473-ef242f835d3c req-082c8f80-708c-4302-8404-d2c19ac5d910 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989213 Dec 21 03:51:02.153087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Transition to ACTIVE for port object 05a0e112-ef34-4410-b1cb-36798e5b7d77 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:02.185530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:02.189297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:02.190772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:02.195868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:02.249695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.256569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.256569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.358782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Pushing event updated for resources: {'Port': ['ID=05a0e112-ef34-4410-b1cb-36798e5b7d77,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:02.377037 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-310bd127-e604-42f0-8e7d-319b9f4ebf1b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9620590 Dec 21 03:51:02.397337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Request body: {'port': {'device_id': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:02.438806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73cc8ad9-1d77-4c8c-a44d-82bd08ff9d6d req-3e0d0fb3-0f09-4e04-ab68-6b97768b616f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.440863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73cc8ad9-1d77-4c8c-a44d-82bd08ff9d6d req-3e0d0fb3-0f09-4e04-ab68-6b97768b616f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 1097 time: 0.1558151 Dec 21 03:51:02.451573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.487018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16ab438-dd76-4b83-9be3-f4e1c0ff3b18 req-7419b96f-b02b-447f-8611-24942b5be534 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.488986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f16ab438-dd76-4b83-9be3-f4e1c0ff3b18 req-7419b96f-b02b-447f-8611-24942b5be534 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.1227472 Dec 21 03:51:02.495467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Attempting to bind port 05a0e112-ef34-4410-b1cb-36798e5b7d77 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:02.495740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Attempting to bind port 05a0e112-ef34-4410-b1cb-36798e5b7d77 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:02.496067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Attempting to bind port 05a0e112-ef34-4410-b1cb-36798e5b7d77 on network 24735258-b5ad-42e8-a231-667c1278689e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:02.511560 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-01f310a7-11cc-4d49-9c1f-aa36e0ab6d39 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=a2b50fd62fc440ddb648791821139549&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0268948 Dec 21 03:51:02.516174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Port 05a0e112-ef34-4410-b1cb-36798e5b7d77 on network 24735258-b5ad-42e8-a231-667c1278689e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:02.516604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Attempting to bind port 05a0e112-ef34-4410-b1cb-36798e5b7d77 on network 24735258-b5ad-42e8-a231-667c1278689e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:02.539916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:02.540255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Checking segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:02.540641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Bound using segment: {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:02.541073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Bound port: 05a0e112-ef34-4410-b1cb-36798e5b7d77, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4af8e8d9-376d-4a96-ae0c-b27352fe558a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '24735258-b5ad-42e8-a231-667c1278689e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:02.541429 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.606423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73cc8ad9-1d77-4c8c-a44d-82bd08ff9d6d req-c9730c39-17e6-43da-b7c0-95b5e3c817f4 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163993 Dec 21 03:51:02.635723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f16ab438-dd76-4b83-9be3-f4e1c0ff3b18 req-804e21d4-e5b6-4851-a39c-4ba1064dadaa tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1374955 Dec 21 03:51:02.672809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] For port 05a0e112-ef34-4410-b1cb-36798e5b7d77, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:02.683114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] For port 05a0e112-ef34-4410-b1cb-36798e5b7d77, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:02.732729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3151655-6229-40ec-814d-367210469aea req-7626bdc3-9a44-49b0-9990-d2913d678f3e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.740891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3151655-6229-40ec-814d-367210469aea req-7626bdc3-9a44-49b0-9990-d2913d678f3e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 932 time: 0.0630972 Dec 21 03:51:02.760864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.775780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-4dabdd97-0742-4a9f-9edb-48a0dd5dbccf tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.777794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-4dabdd97-0742-4a9f-9edb-48a0dd5dbccf tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2563291 Dec 21 03:51:02.812538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:02.814138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.815662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] 10.222.0.54 "PUT /v2.0/ports/05a0e112-ef34-4410-b1cb-36798e5b7d77 HTTP/1.1" status: 200 len: 1093 time: 1.3271670 Dec 21 03:51:02.822006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'tag': '05a0e112-ef34-4410-b1cb-36798e5b7d77'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:02.824357 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7dd919a-bed4-486d-ab0b-34174f874293" -d '{"events": [{"name": "network-changed", "server_uuid": "cfd732b3-47df-42cc-a36f-336064d168c8", "tag": "05a0e112-ef34-4410-b1cb-36798e5b7d77"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:02.863143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3151655-6229-40ec-814d-367210469aea req-900b30b7-450d-414b-87de-070e1c8535c2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177673 Dec 21 03:51:02.875897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931a9c58-871e-4435-a3e3-5d1eec276f63 service neutron] Pushing event updated for resources: {'Port': ['ID=05a0e112-ef34-4410-b1cb-36798e5b7d77,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:02.908705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 291446c0-79fe-4164-ba73-8b5de753da33 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:02.917309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:02.932686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Transition to ACTIVE for port object 291446c0-79fe-4164-ba73-8b5de753da33 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:02.941261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Request body: {'port': {'device_id': 'b159aaab-0940-4762-949f-a365b005eb7d', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'a2b50fd62fc440ddb648791821139549'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:03.020626 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.021250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f974e3a3-b8f3-461c-b61f-e6dee660dc9f req-cec6d231-bd42-41bb-88b1-c4aacfe15b09 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 210 time: 0.0706875 Dec 21 03:51:03.024459 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f3fa5a9-01cc-4ca6-af93-7f8bd23fc76e x-openstack-request-id: req-7f3fa5a9-01cc-4ca6-af93-7f8bd23fc76e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:03.025891 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfd732b3-47df-42cc-a36f-336064d168c8", "tag": "05a0e112-ef34-4410-b1cb-36798e5b7d77", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:03.027290 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7f3fa5a9-01cc-4ca6-af93-7f8bd23fc76e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:03.030330 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'tag': '05a0e112-ef34-4410-b1cb-36798e5b7d77', 'status': 'completed', 'code': 200} Dec 21 03:51:03.088516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-e3cfb743-06d1-4f09-884d-f30c500483bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:03.089800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-e3cfb743-06d1-4f09-884d-f30c500483bf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 1096 time: 0.0568948 Dec 21 03:51:03.127810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:03.168647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-e698d36d-df92-4513-818d-169b570192c7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77 HTTP/1.1" status: 200 len: 217 time: 0.0462520 Dec 21 03:51:03.225135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:03.225291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92aa5a8-0b8a-4b60-9490-4ba814ed1fd9 req-65cc9058-3a78-4c08-a016-5dcf03bf2646 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:03.225638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:03.226178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:03.226858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f92aa5a8-0b8a-4b60-9490-4ba814ed1fd9 req-65cc9058-3a78-4c08-a016-5dcf03bf2646 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 948 time: 0.1331456 Dec 21 03:51:03.241596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:03.242040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:03.248251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:03.248251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:03.248873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:03.249400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Bound port: 291446c0-79fe-4164-ba73-8b5de753da33, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:03.249848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.261590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-d1eb36c2-a9aa-4dd4-8513-a0e9a436c1a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:03.264254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-d1eb36c2-a9aa-4dd4-8513-a0e9a436c1a2 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 200 len: 854 time: 0.0878112 Dec 21 03:51:03.307918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Made reservation on behalf of a2b50fd62fc440ddb648791821139549 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:03.312777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.326163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-2e3b5a5a-440a-4bdd-8c4c-344dc171d095 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=24735258-b5ad-42e8-a231-667c1278689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0497606 Dec 21 03:51:03.334341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f92aa5a8-0b8a-4b60-9490-4ba814ed1fd9 req-09737280-7f62-47b7-8eda-09de79a90398 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958850 Dec 21 03:51:03.350226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:03.355974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:03.359904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.454071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.468475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0f6bae-530b-44ac-b0c6-79e355c1e6b0 req-6952978b-2431-48cb-b3e7-026278460fc7 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:03.469976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f0f6bae-530b-44ac-b0c6-79e355c1e6b0 req-6952978b-2431-48cb-b3e7-026278460fc7 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 944 time: 0.0968935 Dec 21 03:51:03.492894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-2e12a422-e267-4daa-85eb-436f6d33571d service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1511564 Dec 21 03:51:03.547084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:03.548047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.550578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] 10.222.0.31 "PUT /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 1093 time: 1.1575990 Dec 21 03:51:03.554286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:03.557381 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b" -d '{"events": [{"name": "network-changed", "server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "tag": "291446c0-79fe-4164-ba73-8b5de753da33"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:03.564579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:03.594788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.620583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a6a21b-0632-4923-95ee-ed5af793a418 service neutron] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:03.653439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.695355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:03.712179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552', 'mac_address': 'fa:16:3e:1e:23:dd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.236'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:03.755533 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5965fb51-3e54-41fb-ba76-d2e1f339d66a x-openstack-request-id: req-5965fb51-3e54-41fb-ba76-d2e1f339d66a {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:03.757519 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "tag": "291446c0-79fe-4164-ba73-8b5de753da33", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:03.757881 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5965fb51-3e54-41fb-ba76-d2e1f339d66a {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:03.760485 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33', 'status': 'completed', 'code': 200} Dec 21 03:51:03.768594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-01fc3d7b-f488-43c8-99a7-12aeb6c76f83 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=a2b50fd62fc440ddb648791821139549&shared=False HTTP/1.1" status: 200 len: 213 time: 0.2186193 Dec 21 03:51:03.786772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f0f6bae-530b-44ac-b0c6-79e355c1e6b0 req-3417499f-2fba-4be9-8219-20da12682a44 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3053155 Dec 21 03:51:03.801126 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:03.819370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe803ee-8327-43a6-a9e3-b522099b2bf0 req-5ec9996c-66ea-40d7-8a34-0651cd177f10 service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3115427 Dec 21 03:51:03.857472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:03.910057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b0070dcb-d89e-44e0-815b-423b077edf00,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:03.923245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:03.967454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-105e9f83-1ceb-4b4f-95d8-f351c22e4bec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:03.969112 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-105e9f83-1ceb-4b4f-95d8-f351c22e4bec service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1096 time: 0.2466152 Dec 21 03:51:04.047537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.051321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-5c117011-16cc-4c0b-b4e8-f5d03decd7cc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 217 time: 0.0614188 Dec 21 03:51:04.052700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Allocated IP 192.168.233.200 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/b5fc9274-dcad-49e4-9ea7-4a6e85e6581e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:04.088338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8c681a-af56-4dcd-bbe5-074d691e069e req-434e1fd1-04aa-4c21-a7c4-645da89fcc8b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.089818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae8c681a-af56-4dcd-bbe5-074d691e069e req-434e1fd1-04aa-4c21-a7c4-645da89fcc8b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.2116899 Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.096464 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-ac46a5c6-e7fe-456c-bf05-0a648188689c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.099748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-ac46a5c6-e7fe-456c-bf05-0a648188689c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3106863 Dec 21 03:51:04.114833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-f6da0ab5-1255-4764-9bd7-1b87f8677b36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.115620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f522255-c5a6-4307-abcf-423e641eff65 req-0eb79adf-f140-47e1-892b-947c2b6a3aea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.116309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-f6da0ab5-1255-4764-9bd7-1b87f8677b36 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=20acfa324e9b4279a50bf03610639a83&device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 1096 time: 0.1041603 Dec 21 03:51:04.117335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-0eb79adf-f140-47e1-892b-947c2b6a3aea service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0586152 Dec 21 03:51:04.118706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:04.135204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Request body: {'port': {'device_id': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'a2b50fd62fc440ddb648791821139549'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:04.174704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-3758635d-6aeb-4136-904d-3e612d72e0dc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0357950 Dec 21 03:51:04.222372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae8c681a-af56-4dcd-bbe5-074d691e069e req-981c6ed4-8073-45c8-b7b3-be3111557ddb tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1162689 Dec 21 03:51:04.383859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2689003c-6b5b-4c06-bc3c-fb1fd8b0399d req-7fbbf299-72cf-4e8b-80ef-29ac1c8624a0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.385367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2689003c-6b5b-4c06-bc3c-fb1fd8b0399d req-7fbbf299-72cf-4e8b-80ef-29ac1c8624a0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.0909672 Dec 21 03:51:04.398422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-a481202d-bfd9-4d2d-9f03-47f0c592400f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.399916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-a481202d-bfd9-4d2d-9f03-47f0c592400f service neutron] 10.222.0.54 "GET /v2.0/networks?id=24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 200 len: 915 time: 0.2698426 Dec 21 03:51:04.414623 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-8e150849-298d-4dca-91a7-25b49f5af9f1 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1975403 Dec 21 03:51:04.417334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.441140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9f9f5b3f-ff4d-4ea3-8721-8290f66f1552'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:04.495254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9b252b2-cc83-4232-aa8b-c9dbe15ab864 req-5582556d-9ec2-4114-8fc5-97eb023f0b26 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 210 time: 0.0701523 Dec 21 03:51:04.496376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-72a4ea72-810c-4e0e-86a5-c60e62f51a06 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77 HTTP/1.1" status: 200 len: 217 time: 0.0774961 Dec 21 03:51:04.538996 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4f522255-c5a6-4307-abcf-423e641eff65 req-85334703-f03e-4e15-82aa-6f72e299ea44 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1104014 Dec 21 03:51:04.579501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2689003c-6b5b-4c06-bc3c-fb1fd8b0399d req-106f35b5-3d75-416f-871f-594bfabb3018 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759956 Dec 21 03:51:04.589193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-d32113df-aa45-4ae4-9aae-361e5798444a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.591768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-d32113df-aa45-4ae4-9aae-361e5798444a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 200 len: 854 time: 0.0861785 Dec 21 03:51:04.591961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.641724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:04.644952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:04.649051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:04.656382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:04.673073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-2df25172-2694-453d-b6bf-d1399e76b54c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=24735258-b5ad-42e8-a231-667c1278689e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0623033 Dec 21 03:51:04.675022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Made reservation on behalf of a2b50fd62fc440ddb648791821139549 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:04.679882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.723160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.723808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.766171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-882543c3-4490-4d6e-9eab-73ae29bf5179 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.768175 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-882543c3-4490-4d6e-9eab-73ae29bf5179 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1096 time: 0.0577064 Dec 21 03:51:04.836839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-426e21d1-d325-4468-86ee-c3524a1a92a2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.9058723 Dec 21 03:51:04.865675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Request body: {'port': {'device_id': 'b159aaab-0940-4762-949f-a365b005eb7d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:04.899810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-a1df8293-1243-4564-b6c2-a441ec923f59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:04.901292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-a1df8293-1243-4564-b6c2-a441ec923f59 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1247866 Dec 21 03:51:04.953042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-31e70b09-c121-4bf8-9593-ce7db206a24a None None] Provisioning complete for port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:04.954044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31e70b09-c121-4bf8-9593-ce7db206a24a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.963946 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-649fcaa7-a8a4-431f-b736-b8d87bee3e6e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 217 time: 0.0524755 Dec 21 03:51:04.968776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:04.996920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-31e70b09-c121-4bf8-9593-ce7db206a24a None None] Port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:51:05.055279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-f186df56-6d45-4c06-b248-a9c15e51a143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.056739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-f186df56-6d45-4c06-b248-a9c15e51a143 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0846484 Dec 21 03:51:05.093603 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-42a09e75-41c8-4784-952b-6b6ef79271af service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278544 Dec 21 03:51:05.210448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089b9f07-7e88-49f1-9bba-2e0ffae6825d req-849d49ee-772a-4c26-9a65-d296bde95e57 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.211802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089b9f07-7e88-49f1-9bba-2e0ffae6825d req-849d49ee-772a-4c26-9a65-d296bde95e57 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 945 time: 0.5021520 Dec 21 03:51:05.219748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c01057e4-a0cb-4a85-9ba6-8d9ad3671920 req-3cf0bf9b-b85d-44c7-89f8-24d3b268f0ac tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.221163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c01057e4-a0cb-4a85-9ba6-8d9ad3671920 req-3cf0bf9b-b85d-44c7-89f8-24d3b268f0ac tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 949 time: 0.5126054 Dec 21 03:51:05.243140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-a9d023a6-f126-4a87-901d-3e631db4c9b8 service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5581713 Dec 21 03:51:05.284821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-ec948cc7-a4c6-4671-8162-9ab0915a57b4 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1511507 Dec 21 03:51:05.360521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089b9f07-7e88-49f1-9bba-2e0ffae6825d req-b9610ca9-8fca-4327-87e0-8ccae6d3cebd tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1383829 Dec 21 03:51:05.365575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c01057e4-a0cb-4a85-9ba6-8d9ad3671920 req-f1917c47-5d42-41d7-9e31-af14071e0e5f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1345849 Dec 21 03:51:05.403129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7dd919a-bed4-486d-ab0b-34174f874293 req-fba0efc2-5ae9-43a2-b6e1-b0bfb1319019 service neutron] 10.222.0.54 "GET /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1441615 Dec 21 03:51:05.452901 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a356de6d-3f19-4b6f-8f2a-99aadda35c2b req-05f063da-cc65-4739-a2f7-ae3a33f61558 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1562114 Dec 21 03:51:05.454986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b5fc9274-dcad-49e4-9ea7-4a6e85e6581e {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:05.462738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.480574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Transition to ACTIVE for port object b5fc9274-dcad-49e4-9ea7-4a6e85e6581e will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:05.491323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51c7197-c07b-4433-a88f-ed19c205e02c req-8f847d1c-9694-4844-9ada-c43cf229fc3b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.496657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a51c7197-c07b-4433-a88f-ed19c205e02c req-8f847d1c-9694-4844-9ada-c43cf229fc3b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 944 time: 0.0538170 Dec 21 03:51:05.545213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.567506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:05.603655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:05.613273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a51c7197-c07b-4433-a88f-ed19c205e02c req-51df8c36-90d0-47d7-96b3-bff6b6b7c67e tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131692 Dec 21 03:51:05.657751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3a63bc-d57e-4f3d-86fa-de5ad137f504 req-73349a60-0f3f-4351-9724-7aabf5b67b60 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.659308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f3a63bc-d57e-4f3d-86fa-de5ad137f504 req-73349a60-0f3f-4351-9724-7aabf5b67b60 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.1274192 Dec 21 03:51:05.668248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Allocated IP 192.168.233.85 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/131c672e-d86b-490a-b8c0-d22ce7f197d4) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:05.699892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Attempting to bind port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:05.700801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Attempting to bind port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:05.701081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Attempting to bind port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:05.706283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:05.706589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Attempting to bind port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:05.712622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:05.712952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:05.713338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:05.713777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Bound port: b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:05.714266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.740103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:05.747483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:05.751804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.762484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f3a63bc-d57e-4f3d-86fa-de5ad137f504 req-4fc0f6ac-052d-4500-8ffd-11084339369c tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956051 Dec 21 03:51:05.770413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b38cb3c-60fd-4ca4-99a8-8426dab358a4 req-4d240c87-da35-453a-babe-e4a468c02aa4 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 210 time: 0.0411072 Dec 21 03:51:05.808050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:05.816120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:05.879887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.912662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:05.917015 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28175d57-d226-44ed-b243-2e6215552c9d" -d '{"events": [{"server_uuid": "71c3a61a-efe8-4347-8357-415b7c010eb6", "name": "network-vif-plugged", "status": "completed", "tag": "9f9f5b3f-ff4d-4ea3-8721-8290f66f1552"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:05.928115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 05a0e112-ef34-4410-b1cb-36798e5b7d77 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:05.933367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:05.945784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.969196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e409cf-82a0-4894-a29a-24df59170e2b req-ee02519e-8274-429b-b0ba-3ac4db1c1f8f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.973688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01e409cf-82a0-4894-a29a-24df59170e2b req-ee02519e-8274-429b-b0ba-3ac4db1c1f8f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.1009655 Dec 21 03:51:05.983216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:05.983971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:05.986873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] 10.222.0.31 "PUT /v2.0/ports/b5fc9274-dcad-49e4-9ea7-4a6e85e6581e HTTP/1.1" status: 200 len: 1097 time: 1.1257741 Dec 21 03:51:05.987642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:05.991363 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9" -d '{"events": [{"name": "network-changed", "server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:06.008747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.045469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-886ad35a-42d8-4f14-b268-fba23380766a service neutron] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:06.065902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.071333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01e409cf-82a0-4894-a29a-24df59170e2b req-c720f09b-ffd1-4e64-83a3-9dee710185f2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967643 Dec 21 03:51:06.137596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:06.162080 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8eede9e0-fcb1-467e-ad4e-268eebef54a9 x-openstack-request-id: req-8eede9e0-fcb1-467e-ad4e-268eebef54a9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:06.162504 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "71c3a61a-efe8-4347-8357-415b7c010eb6", "name": "network-vif-plugged", "status": "completed", "tag": "9f9f5b3f-ff4d-4ea3-8721-8290f66f1552", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:06.162862 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8eede9e0-fcb1-467e-ad4e-268eebef54a9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:06.163382 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552', 'code': 200} Dec 21 03:51:06.171701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.209007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 05a0e112-ef34-4410-b1cb-36798e5b7d77, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:06.231138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '05a0e112-ef34-4410-b1cb-36798e5b7d77', 'network_id': '24735258-b5ad-42e8-a231-667c1278689e', 'port_id': '05a0e112-ef34-4410-b1cb-36798e5b7d77', 'mac_address': 'fa:16:3e:18:f5:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da10d7f0-623a-4e8a-b5fc-286a12beadcd', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:06.245962 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad389b16-ff05-4fe1-b795-009c320f2244 x-openstack-request-id: req-ad389b16-ff05-4fe1-b795-009c320f2244 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:06.246609 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:06.246793 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ad389b16-ff05-4fe1-b795-009c320f2244 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:06.247359 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'status': 'completed', 'code': 200} Dec 21 03:51:06.264712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-a81aca81-a714-4f11-8350-a7ac3af9376c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.268987 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-a81aca81-a714-4f11-8350-a7ac3af9376c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a2b50fd62fc440ddb648791821139549&device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 1100 time: 0.0810015 Dec 21 03:51:06.283561 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.284532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:06.287958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:06.291522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:06.305281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 05a0e112-ef34-4410-b1cb-36798e5b7d77 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:06.320337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:06.322402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 05a0e112-ef34-4410-b1cb-36798e5b7d77, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:06.345422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.31', 52285) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:06.361850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.362504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.420373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.433723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-5b9cafd5-590e-48d7-a49f-5ffc3cf77f1b tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.436296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-5b9cafd5-590e-48d7-a49f-5ffc3cf77f1b tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.31 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 945 time: 0.0898914 Dec 21 03:51:06.470562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-61ac97ba-b5de-43d7-a8d9-c528032a901c tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.3437610 Dec 21 03:51:06.486850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=05a0e112-ef34-4410-b1cb-36798e5b7d77,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:06.502573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Request body: {'port': {'device_id': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:06.639890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.654522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eedf4881-71e4-4904-8344-ace53577571c req-da26baad-44c3-426f-80a3-b12ccd4c30f0 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.655985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d9e354ba-3c95-4902-9bf2-0ce2880623bf None None] Provisioning complete for port 131c672e-d86b-490a-b8c0-d22ce7f197d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:06.658378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eedf4881-71e4-4904-8344-ace53577571c req-da26baad-44c3-426f-80a3-b12ccd4c30f0 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 945 time: 0.1597378 Dec 21 03:51:06.658522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d9e354ba-3c95-4902-9bf2-0ce2880623bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.694397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d9e354ba-3c95-4902-9bf2-0ce2880623bf None None] Port 131c672e-d86b-490a-b8c0-d22ce7f197d4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:51:06.737958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-20b986d1-d090-4f23-8079-dbcbcfc72808 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.200&port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e HTTP/1.1" status: 200 len: 217 time: 0.3952193 Dec 21 03:51:06.744032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Deleting port 5a6e8017-d827-4a67-93f9-d0890e97d658 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:06.744475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:06.782634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277e3ce4-f132-4454-bef1-0aacc145df07 req-02ad048f-b0d5-4ec1-a419-8c00f96c8dfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.784124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-277e3ce4-f132-4454-bef1-0aacc145df07 req-02ad048f-b0d5-4ec1-a419-8c00f96c8dfa service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 1102 time: 0.4563169 Dec 21 03:51:06.807065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-4c0d5df4-9aea-425c-acd6-0387becf7c10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.808532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-4c0d5df4-9aea-425c-acd6-0387becf7c10 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0614121 Dec 21 03:51:06.867053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-277e3ce4-f132-4454-bef1-0aacc145df07 req-4c79cf6c-8afa-48f0-be04-47830397fab3 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752254 Dec 21 03:51:06.877529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-7aa333b4-4452-4bf7-9711-0588ff9d28b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.879046 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-7aa333b4-4452-4bf7-9711-0588ff9d28b2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0572689 Dec 21 03:51:06.896501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eedf4881-71e4-4904-8344-ace53577571c req-b024c2be-c894-4db7-a473-d5585974fb0a tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/security-groups?id=b67cfb7c-a445-4992-b901-21dce2417478&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2309277 Dec 21 03:51:06.920387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['05a0e112-ef34-4410-b1cb-36798e5b7d77'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:06.929192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b14cd658-ccd6-4930-8f7b-99d54c2c719b req-efbe96a7-95c8-4a00-af8e-1026ecd6e54e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:06.930751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b14cd658-ccd6-4930-8f7b-99d54c2c719b req-efbe96a7-95c8-4a00-af8e-1026ecd6e54e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 950 time: 0.2111528 Dec 21 03:51:07.017033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] For port 5a6e8017-d827-4a67-93f9-d0890e97d658, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=5a6e8017-d827-4a67-93f9-d0890e97d658,segment=NetworkSegment(ebc72439-11da-4c52-8368-1d661af040c0),segment_id=ebc72439-11da-4c52-8368-1d661af040c0)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:07.017404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.066283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Calling delete_port for 5a6e8017-d827-4a67-93f9-d0890e97d658 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:07.074519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b14cd658-ccd6-4930-8f7b-99d54c2c719b req-ab86fc2f-5b54-461c-9c37-6653823d5b0f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1364381 Dec 21 03:51:07.277549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-694dbe8d-a7eb-4bbe-ba8d-35a603da80a0 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1087844 Dec 21 03:51:07.323597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 131c672e-d86b-490a-b8c0-d22ce7f197d4 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:07.335347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.349212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4048666f-57a3-44ec-abfc-c4265640d971 req-2984999f-0c7b-4534-a06a-06206a5ac54a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:07.350731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4048666f-57a3-44ec-abfc-c4265640d971 req-2984999f-0c7b-4534-a06a-06206a5ac54a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 945 time: 0.1635320 Dec 21 03:51:07.368999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d681a4cf-86b8-472f-90fb-6ddfeb9b89be req-dc049ade-b644-4339-9d17-3acebe7250ff service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838063 Dec 21 03:51:07.383422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Transition to ACTIVE for port object 131c672e-d86b-490a-b8c0-d22ce7f197d4 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:07.391343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-916955d5-3762-436a-b141-030fcd7b992a req-47277c0f-7de7-4396-b261-4ea3c5a886fd tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:07.396371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-916955d5-3762-436a-b141-030fcd7b992a req-47277c0f-7de7-4396-b261-4ea3c5a886fd tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 935 time: 0.1681273 Dec 21 03:51:07.441813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4048666f-57a3-44ec-abfc-c4265640d971 req-036b00f0-5a2d-4c57-9107-7b2e8dbe7d27 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830321 Dec 21 03:51:07.461352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.497450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['5a6e8017-d827-4a67-93f9-d0890e97d658'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:07.498887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-916955d5-3762-436a-b141-030fcd7b992a req-34d13ec7-3b1c-4284-94e7-6ddb21859d6b tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982792 Dec 21 03:51:07.502521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Pushing event deleted for resources: {'Port': ['ID=5a6e8017-d827-4a67-93f9-d0890e97d658,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:07.504424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.581428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:07.585949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] No DVR routers for this DVR port 5a6e8017-d827-4a67-93f9-d0890e97d658 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:07.603024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.604941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc8909e2-5b2b-486b-8d30-5011a228bf89 req-146357ea-f42b-435d-80b6-ed5cd63e9fec tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.31 "DELETE /v2.0/ports/5a6e8017-d827-4a67-93f9-d0890e97d658 HTTP/1.1" status: 204 len: 173 time: 1.1600108 Dec 21 03:51:07.605415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'name': 'network-vif-deleted', 'tag': '5a6e8017-d827-4a67-93f9-d0890e97d658'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:07.608323 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fef54fbe-2013-459b-9fed-8abbbe28155b" -d '{"events": [{"server_uuid": "2ce99e5a-872c-46a7-9dfd-be41a66caa45", "name": "network-vif-deleted", "tag": "5a6e8017-d827-4a67-93f9-d0890e97d658"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:07.630259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:07.712584 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:51:07.718608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:07.720186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e68c96-b07a-4301-b40d-aa6bd254a175 req-27a03400-cc37-4e2c-aa08-6f0066f3e00d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:07.728511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8e68c96-b07a-4301-b40d-aa6bd254a175 req-27a03400-cc37-4e2c-aa08-6f0066f3e00d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.1474481 Dec 21 03:51:07.732793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '291446c0-79fe-4164-ba73-8b5de753da33', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'port_id': '291446c0-79fe-4164-ba73-8b5de753da33', 'mac_address': 'fa:16:3e:ea:a5:00', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13099c8a-54c1-41b2-a4f4-664d17e69495', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:07.752154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-d1420929-4307-4756-947d-05e56dee8912 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:07.753741 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-d1420929-4307-4756-947d-05e56dee8912 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a2b50fd62fc440ddb648791821139549&device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 1100 time: 0.1338499 Dec 21 03:51:07.791726 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.808403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 291446c0-79fe-4164-ba73-8b5de753da33 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:07.830637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:07.837620 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7bc9303-2abd-419f-b3dc-fee91d626edc x-openstack-request-id: req-f7bc9303-2abd-419f-b3dc-fee91d626edc {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:07.837915 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ce99e5a-872c-46a7-9dfd-be41a66caa45", "name": "network-vif-deleted", "tag": "5a6e8017-d827-4a67-93f9-d0890e97d658", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:07.839178 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f7bc9303-2abd-419f-b3dc-fee91d626edc {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:07.839178 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ce99e5a-872c-46a7-9dfd-be41a66caa45', 'name': 'network-vif-deleted', 'tag': '5a6e8017-d827-4a67-93f9-d0890e97d658', 'status': 'completed', 'code': 200} Dec 21 03:51:07.851225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8e68c96-b07a-4301-b40d-aa6bd254a175 req-d3a9cb46-7cf1-49a7-9164-541b6095dec2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1189601 Dec 21 03:51:07.864770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Attempting to bind port 131c672e-d86b-490a-b8c0-d22ce7f197d4 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:07.864770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Attempting to bind port 131c672e-d86b-490a-b8c0-d22ce7f197d4 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:07.864770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Attempting to bind port 131c672e-d86b-490a-b8c0-d22ce7f197d4 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:07.864770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Port 131c672e-d86b-490a-b8c0-d22ce7f197d4 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:07.864770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Attempting to bind port 131c672e-d86b-490a-b8c0-d22ce7f197d4 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:07.869479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:07.869819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:07.870204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:07.870635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Bound port: 131c672e-d86b-490a-b8c0-d22ce7f197d4, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:07.871018 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.905508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:07.919429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-54001fe1-163b-4ffa-9700-cdd36880dfc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:07.921048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-54001fe1-163b-4ffa-9700-cdd36880dfc9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1509719 Dec 21 03:51:07.970648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:07.974448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:07.978881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:07.988612 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-0bbe21ce-df37-4329-8b90-e401c20b0b46 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.200&port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e HTTP/1.1" status: 200 len: 217 time: 0.0557470 Dec 21 03:51:08.006084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84e07469-5c17-4636-80a3-5b4c2488a2d0 req-cbe8b207-9219-44dd-9f08-d4b4db18c21b tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 210 time: 0.0266707 Dec 21 03:51:08.063755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-d933e261-f5a6-478b-af4d-3f533d50bd03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.065203 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-d933e261-f5a6-478b-af4d-3f533d50bd03 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0470335 Dec 21 03:51:08.112682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:08.114430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-f9238552-cfcf-43a3-a2a4-7897c3c00109 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.115988 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-f9238552-cfcf-43a3-a2a4-7897c3c00109 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0409095 Dec 21 03:51:08.157654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.158213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:08.159640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] 10.222.0.31 "PUT /v2.0/ports/131c672e-d86b-490a-b8c0-d22ce7f197d4 HTTP/1.1" status: 200 len: 1096 time: 1.6616714 Dec 21 03:51:08.219114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be30125a-7cc3-438c-80b7-604a7a8d37db service neutron] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:08.237172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-893c9446-9fdf-418f-b65b-56ffdcf1a14e service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1101210 Dec 21 03:51:08.243765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3496433b-f935-4edf-a174-14e47fb3e20a req-fb305dcb-2c68-4aed-bf1e-c505e56c1f22 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.245501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3496433b-f935-4edf-a174-14e47fb3e20a req-fb305dcb-2c68-4aed-bf1e-c505e56c1f22 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 950 time: 0.1034336 Dec 21 03:51:08.332353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3496433b-f935-4edf-a174-14e47fb3e20a req-14f78704-f859-47d6-ac76-9de2d1230f5a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765312 Dec 21 03:51:08.389252 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-00791d40-d10a-4f41-9d8f-9eb6bb88aaf9 req-ae6a2b32-3699-4541-8db6-ded8a967fd6d service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1199296 Dec 21 03:51:08.443646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a1171c-fd07-491c-badd-8c504c386ed0 req-59975930-93d8-425c-af28-9ac58729afe3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.445172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06a1171c-fd07-491c-badd-8c504c386ed0 req-59975930-93d8-425c-af28-9ac58729afe3 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.0537333 Dec 21 03:51:08.456186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['291446c0-79fe-4164-ba73-8b5de753da33'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:08.531872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06a1171c-fd07-491c-badd-8c504c386ed0 req-0a9a29ca-74c5-441d-9625-bb989b998525 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798457 Dec 21 03:51:08.545906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-5be575c1-4ab1-43fa-b594-f18ec8afadf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.547448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-5be575c1-4ab1-43fa-b594-f18ec8afadf4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a2b50fd62fc440ddb648791821139549&device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 1099 time: 0.0883455 Dec 21 03:51:08.611122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-96e1e725-6d11-4df2-b015-2e0be0f67f13 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.85&port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4 HTTP/1.1" status: 200 len: 217 time: 0.0428879 Dec 21 03:51:08.623350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-957beebb-3efd-456c-82f7-4eae1c17afa5 req-063d89c1-0be9-47fd-8462-c6af4b4250f4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.624912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-957beebb-3efd-456c-82f7-4eae1c17afa5 req-063d89c1-0be9-47fd-8462-c6af4b4250f4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 945 time: 0.1005158 Dec 21 03:51:08.729126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-b6c36914-7e36-4b2d-a0c9-0799631fe9f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.730548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-b6c36914-7e36-4b2d-a0c9-0799631fe9f9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1047740 Dec 21 03:51:08.741454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-957beebb-3efd-456c-82f7-4eae1c17afa5 req-ea0d2de9-3e30-45a2-8949-be6b692f218c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067636 Dec 21 03:51:08.750432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00622a0c-6ebc-4c56-86a7-0135308e9d3b req-ef6e969a-caad-48aa-8061-19f7fce9c4c3 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.751918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00622a0c-6ebc-4c56-86a7-0135308e9d3b req-ef6e969a-caad-48aa-8061-19f7fce9c4c3 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.1188509 Dec 21 03:51:08.823892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d89cd2-548b-4821-9885-30deab3de68e req-0a6151db-c117-4c9f-a0da-9b295e793e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:08.825404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-0a6151db-c117-4c9f-a0da-9b295e793e8c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0715914 Dec 21 03:51:08.829114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00622a0c-6ebc-4c56-86a7-0135308e9d3b req-78e21f1e-8af9-4a49-9be6-0dc0e34fd211 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678694 Dec 21 03:51:08.992724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-aae147a1-060b-401a-8763-0c56616a5901 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1168039 Dec 21 03:51:09.000984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e4401f-3b9a-4512-9df1-181894a93c61 req-53457eaf-2e21-44db-86dd-d7304b38a650 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:09.002349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6e4401f-3b9a-4512-9df1-181894a93c61 req-53457eaf-2e21-44db-86dd-d7304b38a650 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.0741339 Dec 21 03:51:09.107898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6e4401f-3b9a-4512-9df1-181894a93c61 req-dea5c8c9-5e4f-4fdd-8afa-d643965dfb6e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0976751 Dec 21 03:51:09.143559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22ba6aaa-26bd-4d3d-89f4-afdb58b8b472 req-3a8bb469-9f08-4e59-8c52-35d9c5052dd2 tempest-ServerTagsTestJSON-1905158610 tempest-ServerTagsTestJSON-1905158610-project] 10.222.0.18 "GET /v2.0/ports?device_id=2ce99e5a-872c-46a7-9dfd-be41a66caa45 HTTP/1.1" status: 200 len: 210 time: 0.0346608 Dec 21 03:51:09.147228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62d89cd2-548b-4821-9885-30deab3de68e req-57d0630a-8871-41b0-9003-42c845c04e3b service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1439993 Dec 21 03:51:09.440102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd015b9-b5f7-4ef5-96ea-0feb382c08a7 req-072bf014-a831-4627-87fd-0f99ea969639 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:09.441639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfd015b9-b5f7-4ef5-96ea-0feb382c08a7 req-072bf014-a831-4627-87fd-0f99ea969639 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 950 time: 0.0480115 Dec 21 03:51:09.487203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfd015b9-b5f7-4ef5-96ea-0feb382c08a7 req-4cfea7cd-5ea2-4100-b087-22f83e8372ec tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396857 Dec 21 03:51:09.575934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 5a6e8017-d827-4a67-93f9-d0890e97d658 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:09.601676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 5a6e8017-d827-4a67-93f9-d0890e97d658 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:09.604287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 5a6e8017-d827-4a67-93f9-d0890e97d658 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:09.621384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7416a73-cc8e-4c14-b97b-f419e7a08505 req-a72c6f2c-4ace-46eb-99b6-6a56392b1a02 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:09.623500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7416a73-cc8e-4c14-b97b-f419e7a08505 req-a72c6f2c-4ace-46eb-99b6-6a56392b1a02 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 1102 time: 0.0676606 Dec 21 03:51:09.689491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb9c021-4080-4176-9179-8236630719a3 req-be3fba40-ca54-48ed-94ec-5582d6dfed59 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:09.690983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffb9c021-4080-4176-9179-8236630719a3 req-be3fba40-ca54-48ed-94ec-5582d6dfed59 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.0858521 Dec 21 03:51:09.697292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7416a73-cc8e-4c14-b97b-f419e7a08505 req-2b2abe43-6ab0-4c7f-bfcf-f942d9a6e336 tempest-ServersOnMultiNodesTest-1128774943 tempest-ServersOnMultiNodesTest-1128774943-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569110 Dec 21 03:51:09.743746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffb9c021-4080-4176-9179-8236630719a3 req-a868d82a-8bd6-4a2d-b897-5212d1450f4b tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433671 Dec 21 03:51:09.841324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:09.843561 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70d8abe2-8290-47d5-b631-be9a940145ca" -d '{"events": [{"name": "network-changed", "server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:09.862786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7614c464-8b6d-4a2d-8536-c00f07362512 req-93cde739-9487-4c31-b607-c3f911cd4b60 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:09.864859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7614c464-8b6d-4a2d-8536-c00f07362512 req-93cde739-9487-4c31-b607-c3f911cd4b60 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 945 time: 0.0543962 Dec 21 03:51:09.925020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7614c464-8b6d-4a2d-8536-c00f07362512 req-f43c989e-5341-48d8-b404-037e3eb42950 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544987 Dec 21 03:51:09.949258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 05a0e112-ef34-4410-b1cb-36798e5b7d77 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:09.968555 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40d9b6a9-3975-4366-bc3c-0afbdac430fe x-openstack-request-id: req-40d9b6a9-3975-4366-bc3c-0afbdac430fe {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:09.968555 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:09.968555 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-40d9b6a9-3975-4366-bc3c-0afbdac430fe {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:09.969130 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'status': 'completed', 'code': 200} Dec 21 03:51:10.091572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd993e04-35c9-4bee-9cf4-26f7bb18c5ee req-8a014ffb-7d98-4369-879e-28dec5991254 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.092991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd993e04-35c9-4bee-9cf4-26f7bb18c5ee req-8a014ffb-7d98-4369-879e-28dec5991254 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.0802171 Dec 21 03:51:10.102183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d8abe2-8290-47d5-b631-be9a940145ca req-4a258bbf-888a-42e9-9e5c-71d9b49d989c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.102183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-4a258bbf-888a-42e9-9e5c-71d9b49d989c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a2b50fd62fc440ddb648791821139549&device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 1099 time: 0.0755777 Dec 21 03:51:10.123114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 05a0e112-ef34-4410-b1cb-36798e5b7d77 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:10.129134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 05a0e112-ef34-4410-b1cb-36798e5b7d77 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:10.131120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:10.202176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd993e04-35c9-4bee-9cf4-26f7bb18c5ee req-c0e88526-1ac2-4360-b295-f13df6f7b919 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006672 Dec 21 03:51:10.207324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:10.236555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d8abe2-8290-47d5-b631-be9a940145ca req-23752a9c-6e89-4cd4-9eb7-22e279a9f298 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.238034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-23752a9c-6e89-4cd4-9eb7-22e279a9f298 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.1233702 Dec 21 03:51:10.246922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05a0e112-ef34-4410-b1cb-36798e5b7d77'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:10.250120 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d91f6bb6-635b-4a4e-9004-8f1457ba4c57" -d '{"events": [{"server_uuid": "cfd732b3-47df-42cc-a36f-336064d168c8", "name": "network-vif-plugged", "status": "completed", "tag": "05a0e112-ef34-4410-b1cb-36798e5b7d77"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:10.302290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-52b47dc9-ac36-47a1-8907-4ca8a93609ca service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.85&port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4 HTTP/1.1" status: 200 len: 217 time: 0.0542097 Dec 21 03:51:10.397950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 05a0e112-ef34-4410-b1cb-36798e5b7d77, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:10.414503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca7489d-6c1b-4324-9743-a19efe6f31fe req-fef09457-3a27-4023-9f00-d00dfd6856e0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.416015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eca7489d-6c1b-4324-9743-a19efe6f31fe req-fef09457-3a27-4023-9f00-d00dfd6856e0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 950 time: 0.1259127 Dec 21 03:51:10.417284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d8abe2-8290-47d5-b631-be9a940145ca req-56f005c5-5691-47b4-a128-ddcf65f21f1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.418592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-56f005c5-5691-47b4-a128-ddcf65f21f1b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0948381 Dec 21 03:51:10.425928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abce119-f103-4d05-90ee-9d2039b3a652 req-2cf1f2e2-cb2d-4563-a725-29c0f831a285 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.427333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3abce119-f103-4d05-90ee-9d2039b3a652 req-2cf1f2e2-cb2d-4563-a725-29c0f831a285 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.1346438 Dec 21 03:51:10.455438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:10.504345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=05a0e112-ef34-4410-b1cb-36798e5b7d77,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:10.528071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eca7489d-6c1b-4324-9743-a19efe6f31fe req-2c172265-cf81-4c1c-985d-193718dec1a3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998235 Dec 21 03:51:10.534718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3abce119-f103-4d05-90ee-9d2039b3a652 req-eacbea2a-104d-46c3-832a-3a9c0ada00f2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1008773 Dec 21 03:51:10.547469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d8abe2-8290-47d5-b631-be9a940145ca req-7c04e54e-ce5a-4cd3-be29-a3895bd1eae0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:10.547469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-7c04e54e-ce5a-4cd3-be29-a3895bd1eae0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0795245 Dec 21 03:51:10.576180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:10.591784 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6baa6d21-0541-418b-bc33-1ceb19d85ce0 x-openstack-request-id: req-6baa6d21-0541-418b-bc33-1ceb19d85ce0 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:10.592293 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cfd732b3-47df-42cc-a36f-336064d168c8", "name": "network-vif-plugged", "status": "completed", "tag": "05a0e112-ef34-4410-b1cb-36798e5b7d77", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:10.592403 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6baa6d21-0541-418b-bc33-1ceb19d85ce0 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:10.592728 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05a0e112-ef34-4410-b1cb-36798e5b7d77', 'code': 200} Dec 21 03:51:10.680362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Deleting subnet 6c297c4e-6464-429b-85d1-7a6696565116 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:51:10.686659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.109548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-f54495c6-bab8-4eb0-93d3-2729ca3c544e service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5310001 Dec 21 03:51:11.119979 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.188367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fdf4473-f7e7-4c4e-82ba-0c23c670e5f2 req-892a7275-ada2-40fb-9a70-161bbe837d05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:11.189841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fdf4473-f7e7-4c4e-82ba-0c23c670e5f2 req-892a7275-ada2-40fb-9a70-161bbe837d05 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 1098 time: 0.1819761 Dec 21 03:51:11.201435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d141184-bb7a-482a-8af6-337fda51ae76 req-4b5b0cbd-0b7b-427a-a7c7-5eb39a347353 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:11.202864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d141184-bb7a-482a-8af6-337fda51ae76 req-4b5b0cbd-0b7b-427a-a7c7-5eb39a347353 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.1938407 Dec 21 03:51:11.246525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef57be23-5236-4896-b44e-5c128133a39c req-69be35ad-3022-4233-8e74-457867055dfa tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:11.248060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef57be23-5236-4896-b44e-5c128133a39c req-69be35ad-3022-4233-8e74-457867055dfa tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.2364259 Dec 21 03:51:11.275694 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.409603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fdf4473-f7e7-4c4e-82ba-0c23c670e5f2 req-1b3c020d-e8e9-4048-b357-405bd198fb82 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024953 Dec 21 03:51:11.414984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70d8abe2-8290-47d5-b631-be9a940145ca req-ead95f5f-5ec0-4667-9746-f5ad9c940f67 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2879963 Dec 21 03:51:11.422413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef57be23-5236-4896-b44e-5c128133a39c req-ad572000-187a-4a45-82c6-3c7d33cb3b27 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1633351 Dec 21 03:51:11.425605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d141184-bb7a-482a-8af6-337fda51ae76 req-c70859c4-ca1c-4d68-b636-4c0d09118469 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1750450 Dec 21 03:51:11.519682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.555353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6c297c4e-6464-429b-85d1-7a6696565116,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:11.561935 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.567794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8bd88349-b210-4e10-90ef-ff03d952c249 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/6c297c4e-6464-429b-85d1-7a6696565116 HTTP/1.1" status: 204 len: 168 time: 0.9879460 Dec 21 03:51:11.568224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52174) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:11.569317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:11.584465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:11.600593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdfe9b4-d244-46c9-b2f3-1bf651cb4392 req-8d5dc56a-3ec9-4f32-8296-ad6765ed45f0 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:11.602790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efdfe9b4-d244-46c9-b2f3-1bf651cb4392 req-8d5dc56a-3ec9-4f32-8296-ad6765ed45f0 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.1116326 Dec 21 03:51:11.645374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.700819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6686fa4-702d-488a-83fa-28a0d588cdba req-e30bd2a5-80c6-4f38-9b6d-ee88fab205d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:11.702440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6686fa4-702d-488a-83fa-28a0d588cdba req-e30bd2a5-80c6-4f38-9b6d-ee88fab205d1 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 950 time: 0.0780740 Dec 21 03:51:11.710336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efdfe9b4-d244-46c9-b2f3-1bf651cb4392 req-d8680d95-e524-4020-b4d3-4f705cca853a tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010125 Dec 21 03:51:11.730543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:11.737139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.746828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'network_id': 'd1ba1866-e49e-4d17-94eb-51d6ac2d5ea1', 'port_id': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'mac_address': 'fa:16:3e:ad:44:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:11.763999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['922fdee6-1b18-4910-afce-31d41ad320e3']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:11.767051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6686fa4-702d-488a-83fa-28a0d588cdba req-9985ca6c-a20d-47d1-9762-08d73112a368 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511332 Dec 21 03:51:11.775072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 291446c0-79fe-4164-ba73-8b5de753da33 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:11.780499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ebc72439-11da-4c52-8368-1d661af040c0') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:11.780806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ebc72439-11da-4c52-8368-1d661af040c0') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:11.784566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 291446c0-79fe-4164-ba73-8b5de753da33 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:11.785143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.808726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.831048 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.838901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:51:11.842981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.844602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.850381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18755981-7567-42c7-81ee-357bc48ed542 req-17656432-2d6b-4c32-9337-5bfbffd91418 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:11.852114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18755981-7567-42c7-81ee-357bc48ed542 req-17656432-2d6b-4c32-9337-5bfbffd91418 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.0675411 Dec 21 03:51:11.868370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1f510541-26ad-4ad3-a08b-3bc716e8e4db {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.883388 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:51:11.886969 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:51:11.909670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18755981-7567-42c7-81ee-357bc48ed542 req-f1de2e75-b9af-4002-9c69-4da1d5fd0a83 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502181 Dec 21 03:51:11.912867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:11.920838 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.953438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:11.991418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:11.999244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.002349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] 10.222.0.18 "DELETE /v2.0/networks/922fdee6-1b18-4910-afce-31d41ad320e3 HTTP/1.1" status: 204 len: 168 time: 0.4331000 Dec 21 03:51:12.011738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de48e95c-fc8e-443c-b7ee-9b4d41495cc2 admin admin] Pushing event deleted for resources: {'Network': ['ID=922fdee6-1b18-4910-afce-31d41ad320e3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:12.020403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.022198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.022784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:12.094414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:12.134831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167ffc89-618f-4091-845e-8d35027a65bf req-a267b806-1e09-48de-9d61-07fd838b57b5 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:12.136351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-167ffc89-618f-4091-845e-8d35027a65bf req-a267b806-1e09-48de-9d61-07fd838b57b5 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 950 time: 0.0521514 Dec 21 03:51:12.183393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:12.197044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:12.207898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'mac_address': 'fa:16:3e:9b:33:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:12.234754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:12.235131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.244806 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.257833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b5fc9274-dcad-49e4-9ea7-4a6e85e6581e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:12.279533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:12.333780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:12.334140 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.346077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:12.361453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.411290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:12.439396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52180) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:12.486216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6656b0e5-85af-4778-8fdb-cbca478d23b9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=21b9e879064f458587507ce6fac2365f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0455472 Dec 21 03:51:12.489069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52186) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:12.552608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.590062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba', '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:12.593336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:12.595750 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85665129-63ef-4e27-957b-05cbc9c26312" -d '{"events": [{"server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "name": "network-vif-plugged", "status": "completed", "tag": "291446c0-79fe-4164-ba73-8b5de753da33"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:12.616281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=9f9f5b3f-ff4d-4ea3-8721-8290f66f1552,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:12.618664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5', '37f13e0f-1f8b-4106-974a-bdabfab506b1', '66e96a75-3965-47db-900b-9dfdb214fd6b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:12.625869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1f510541-26ad-4ad3-a08b-3bc716e8e4db'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:12.648386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f972364e-f4e9-4283-a3ae-a5abfb01987a req-0f9a0a2c-7d80-4ef7-bdbb-b91c8577c63e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:12.651107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f972364e-f4e9-4283-a3ae-a5abfb01987a req-0f9a0a2c-7d80-4ef7-bdbb-b91c8577c63e tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 944 time: 0.1467211 Dec 21 03:51:12.686834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9232aef-6e2f-4bf8-b8af-a64fd7d1a130 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.695906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23d6f2f8-c612-4199-ae56-18cabd3d699a req-bd247a78-717f-49e7-ae2c-423dba9b9236 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:12.697595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23d6f2f8-c612-4199-ae56-18cabd3d699a req-bd247a78-717f-49e7-ae2c-423dba9b9236 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.1799004 Dec 21 03:51:12.721173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:12.736848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.740168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-167ffc89-618f-4091-845e-8d35027a65bf req-dcd582ad-ef4e-4aa0-8f18-7107c5afaefd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "DELETE /v2.0/ports/9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 HTTP/1.1" status: 204 len: 173 time: 0.5974047 Dec 21 03:51:12.747393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'name': 'network-vif-deleted', 'tag': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:12.749661 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1b33217-c75b-4b85-a398-f9695423150c" -d '{"events": [{"server_uuid": "71c3a61a-efe8-4347-8357-415b7c010eb6", "name": "network-vif-deleted", "tag": "9f9f5b3f-ff4d-4ea3-8721-8290f66f1552"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:12.777220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9232aef-6e2f-4bf8-b8af-a64fd7d1a130 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.857564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:12.866690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f972364e-f4e9-4283-a3ae-a5abfb01987a req-b9a33baa-9287-41c6-8d81-b2f0e565dbd5 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1901700 Dec 21 03:51:12.891688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23d6f2f8-c612-4199-ae56-18cabd3d699a req-4873c669-2a87-4557-a8e5-134d5b0af4a7 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1742342 Dec 21 03:51:12.959078 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-789de674-0d84-45d3-9f68-7fab9ee4a365 x-openstack-request-id: req-789de674-0d84-45d3-9f68-7fab9ee4a365 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:12.959358 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "name": "network-vif-plugged", "status": "completed", "tag": "291446c0-79fe-4164-ba73-8b5de753da33", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:12.959618 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-789de674-0d84-45d3-9f68-7fab9ee4a365 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:12.960021 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33', 'code': 200} Dec 21 03:51:12.985889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9232aef-6e2f-4bf8-b8af-a64fd7d1a130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.988454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9232aef-6e2f-4bf8-b8af-a64fd7d1a130 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:12.990713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c9232aef-6e2f-4bf8-b8af-a64fd7d1a130 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b67cfb7c-a445-4992-b901-21dce2417478 HTTP/1.1" status: 204 len: 168 time: 0.5006075 Dec 21 03:51:13.014516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9232aef-6e2f-4bf8-b8af-a64fd7d1a130 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b67cfb7c-a445-4992-b901-21dce2417478,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:13.071788 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5f0bba7-7388-4c64-8346-feb84512d29f x-openstack-request-id: req-a5f0bba7-7388-4c64-8346-feb84512d29f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:13.072122 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "71c3a61a-efe8-4347-8357-415b7c010eb6", "name": "network-vif-deleted", "tag": "9f9f5b3f-ff4d-4ea3-8721-8290f66f1552", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:13.072341 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a5f0bba7-7388-4c64-8346-feb84512d29f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:13.072739 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '71c3a61a-efe8-4347-8357-415b7c010eb6', 'name': 'network-vif-deleted', 'tag': '9f9f5b3f-ff4d-4ea3-8721-8290f66f1552', 'status': 'completed', 'code': 200} Dec 21 03:51:13.106366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7773eaa-8e76-4286-82b0-183ffda87c56 req-e9364497-f939-4100-8026-66fdb7fc5558 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:13.112986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7773eaa-8e76-4286-82b0-183ffda87c56 req-e9364497-f939-4100-8026-66fdb7fc5558 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.0844836 Dec 21 03:51:13.195520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b80cc4e0-4b92-45a3-8f3a-2e1968b0f314 req-e2af2bf7-67fc-4069-b5f6-3977f6291b5c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 210 time: 0.0473125 Dec 21 03:51:13.238627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7773eaa-8e76-4286-82b0-183ffda87c56 req-a0437130-b0d0-4f81-a4f2-ac9fd476b4d8 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244116 Dec 21 03:51:13.255599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abcd9ed2-6c53-4ed5-9287-438b7e4f3e1c req-34ffd800-3f3c-4a5a-a5d3-269d095d7cb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:13.257591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abcd9ed2-6c53-4ed5-9287-438b7e4f3e1c req-34ffd800-3f3c-4a5a-a5d3-269d095d7cb8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1098 time: 0.0963604 Dec 21 03:51:13.329930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abcd9ed2-6c53-4ed5-9287-438b7e4f3e1c req-87200ffd-2997-4a59-8c4c-3226ca87afe0 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615773 Dec 21 03:51:13.496135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d5dfdbb-399b-4c2a-8ab3-187ea132c5b1 req-78383e22-8a68-4e8c-8e30-19474665c156 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:13.498186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d5dfdbb-399b-4c2a-8ab3-187ea132c5b1 req-78383e22-8a68-4e8c-8e30-19474665c156 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 946 time: 0.0571933 Dec 21 03:51:13.552685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d5dfdbb-399b-4c2a-8ab3-187ea132c5b1 req-b954b4c5-0683-4217-bac4-fbf2f6f9f69f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479426 Dec 21 03:51:13.571145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:13.579188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:13.803059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:13.806491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:13.831351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'mac_address': 'fa:16:3e:3d:e7:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.85'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:13.837053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 1f510541-26ad-4ad3-a08b-3bc716e8e4db {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:13.878451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:13.890093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:13.907710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 131c672e-d86b-490a-b8c0-d22ce7f197d4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:13.929096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:13.939576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d066697c-525d-4d59-b63e-a877200cee06 req-6a11d9de-9de3-4ca0-9ad5-326453e0adc6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:13.941179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d066697c-525d-4d59-b63e-a877200cee06 req-6a11d9de-9de3-4ca0-9ad5-326453e0adc6 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 944 time: 0.0546901 Dec 21 03:51:13.976533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:14.022522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:14.029027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:14.041472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d066697c-525d-4d59-b63e-a877200cee06 req-6ab408be-c794-4b2e-8473-505e60fccfeb tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896504 Dec 21 03:51:14.066140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bef5ac6-ccee-4ac2-8876-d8611e9fd951 req-3a12d58b-6fff-4596-9cdd-4a64d18ef257 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:14.076082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bef5ac6-ccee-4ac2-8876-d8611e9fd951 req-3a12d58b-6fff-4596-9cdd-4a64d18ef257 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.1220613 Dec 21 03:51:14.095706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:14.134563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bef5ac6-ccee-4ac2-8876-d8611e9fd951 req-5d30b714-a68f-4bc4-a287-4844a012f30d tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503523 Dec 21 03:51:14.255326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b8b9a6-b227-4f6b-b551-57bbbb888eed req-7e173cb3-29bd-49a7-89b1-b4b373f0aad0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:14.257286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02b8b9a6-b227-4f6b-b551-57bbbb888eed req-7e173cb3-29bd-49a7-89b1-b4b373f0aad0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0520902 Dec 21 03:51:14.331363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02b8b9a6-b227-4f6b-b551-57bbbb888eed req-b5fefd59-a8b5-443f-8a5a-cb1ee5e63dcc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654757 Dec 21 03:51:14.378683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ce71959-1318-43a2-bce1-3d52f556a915 req-656da96e-e8d7-4cda-bc55-7c5d7b6daad6 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=71c3a61a-efe8-4347-8357-415b7c010eb6 HTTP/1.1" status: 200 len: 210 time: 0.0460095 Dec 21 03:51:14.457097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f258de68-4a2e-4680-9f2e-975eca295a29 req-2ab4d6bd-9f6a-4c5b-93e2-1b9a8b70ed50 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:14.458709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f258de68-4a2e-4680-9f2e-975eca295a29 req-2ab4d6bd-9f6a-4c5b-93e2-1b9a8b70ed50 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 948 time: 0.0491524 Dec 21 03:51:14.460228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['131c672e-d86b-490a-b8c0-d22ce7f197d4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:14.534896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f258de68-4a2e-4680-9f2e-975eca295a29 req-e16a26f2-2d30-4c76-a67e-aef6b545cb8e tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696888 Dec 21 03:51:14.693977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1c5da8-e448-409a-b983-7ac3f49b1813 req-5b1e9c19-059a-44dc-b295-888cead1b78a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:14.695511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a1c5da8-e448-409a-b983-7ac3f49b1813 req-5b1e9c19-059a-44dc-b295-888cead1b78a tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0716875 Dec 21 03:51:14.780752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0212648f-ac81-431a-8443-4ba3e2b5e5b1 req-0ed82f33-ec06-4e1f-b4bb-70c6f68b48d6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:14.782290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0212648f-ac81-431a-8443-4ba3e2b5e5b1 req-0ed82f33-ec06-4e1f-b4bb-70c6f68b48d6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 946 time: 0.0858917 Dec 21 03:51:14.787111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a1c5da8-e448-409a-b983-7ac3f49b1813 req-761b1bbe-585a-4d41-8f2e-59bd633be1bc tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821137 Dec 21 03:51:14.836740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0212648f-ac81-431a-8443-4ba3e2b5e5b1 req-09802e18-bf36-4b71-8df0-244b32d12027 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470083 Dec 21 03:51:14.914590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f79b8b-67bc-4362-84a5-542ef7d68193 req-4a5b855b-6cce-41a9-adcc-86323724c434 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:14.914890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03f79b8b-67bc-4362-84a5-542ef7d68193 req-4a5b855b-6cce-41a9-adcc-86323724c434 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0529752 Dec 21 03:51:14.966165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03f79b8b-67bc-4362-84a5-542ef7d68193 req-7eef158a-50e2-4482-b5c5-c260c7f1359c tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434999 Dec 21 03:51:15.152765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2b1029-4971-4594-9274-9ac5397d7fac req-c4741d8a-bc17-4585-900d-5abbf3d0f873 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:15.154734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c2b1029-4971-4594-9274-9ac5397d7fac req-c4741d8a-bc17-4585-900d-5abbf3d0f873 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 943 time: 0.0523686 Dec 21 03:51:15.238442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c2b1029-4971-4594-9274-9ac5397d7fac req-d8a964ea-479a-437a-843c-ee6c164d07c0 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711839 Dec 21 03:51:15.255313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8087e06c-bb5e-4e2a-9258-b49924e04135 req-08a62717-6363-46c6-9592-16144b3c48ff tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:15.256806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8087e06c-bb5e-4e2a-9258-b49924e04135 req-08a62717-6363-46c6-9592-16144b3c48ff tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0711040 Dec 21 03:51:15.307180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8087e06c-bb5e-4e2a-9258-b49924e04135 req-23a7ccc7-1209-4940-9cfc-68b405c2d252 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426571 Dec 21 03:51:15.422062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01c5a91-1df5-4879-bfd4-16242d33a62d req-ea2cd80e-0b18-424e-9198-f9c5cfb4e7fd tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:15.423810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a01c5a91-1df5-4879-bfd4-16242d33a62d req-ea2cd80e-0b18-424e-9198-f9c5cfb4e7fd tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0493438 Dec 21 03:51:15.473123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a01c5a91-1df5-4879-bfd4-16242d33a62d req-f17a77fd-4fff-4bd8-86f1-b7d96c3bf09b tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433912 Dec 21 03:51:15.596574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:15.648057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 1f510541-26ad-4ad3-a08b-3bc716e8e4db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:15.651839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:15.740904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:15.765634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:15.767927 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da07908b-10be-4b26-babc-50054d79f273" -d '{"events": [{"server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "name": "network-vif-plugged", "status": "completed", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:15.781032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:15.859013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc32fea-1eda-4d34-9bf7-489f5ae03ba7 req-3176701e-d2de-433d-8026-cda0e84a2011 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:15.859919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cc32fea-1eda-4d34-9bf7-489f5ae03ba7 req-3176701e-d2de-433d-8026-cda0e84a2011 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 948 time: 0.0500708 Dec 21 03:51:15.895334 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:15.896786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:15.930002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cc32fea-1eda-4d34-9bf7-489f5ae03ba7 req-4467bd6e-0952-4317-a13c-ff84abbbfcb3 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608664 Dec 21 03:51:16.002722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:16.081001 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-100920e8-e5fc-4262-8f36-d1813a174e4d x-openstack-request-id: req-100920e8-e5fc-4262-8f36-d1813a174e4d {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:16.081401 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "name": "network-vif-plugged", "status": "completed", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:16.081759 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-100920e8-e5fc-4262-8f36-d1813a174e4d {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:16.082088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-c4987846-e28a-4e1c-8a07-da38db228210 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:16.082616 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'code': 200} Dec 21 03:51:16.090544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-c4987846-e28a-4e1c-8a07-da38db228210 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.0771890 Dec 21 03:51:16.103492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da2cc99e-e785-4519-82b2-5710e72dd5f4 req-a6a08ae7-9438-45c1-a62e-9de6707c5965 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:16.105231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da2cc99e-e785-4519-82b2-5710e72dd5f4 req-a6a08ae7-9438-45c1-a62e-9de6707c5965 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.0724635 Dec 21 03:51:16.121735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 131c672e-d86b-490a-b8c0-d22ce7f197d4 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:16.130767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 131c672e-d86b-490a-b8c0-d22ce7f197d4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:16.136472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.234662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.266421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da2cc99e-e785-4519-82b2-5710e72dd5f4 req-a0aee031-ce0e-4b09-8ba9-885299831022 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1535387 Dec 21 03:51:16.274010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:16.281672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd7a9fba-4375-4440-a9be-114785a7b36e req-b74aad28-88b8-4993-84dc-f80c12cd6cfb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:16.291134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd7a9fba-4375-4440-a9be-114785a7b36e req-b74aad28-88b8-4993-84dc-f80c12cd6cfb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 946 time: 0.1442330 Dec 21 03:51:16.343970 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.346922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:16.365038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Deleting port 1f510541-26ad-4ad3-a08b-3bc716e8e4db {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:16.365446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.405998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd7a9fba-4375-4440-a9be-114785a7b36e req-81163fee-5ec6-4adb-9c7e-b918de6f127b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088409 Dec 21 03:51:16.420778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:16.505766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:16.511476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:16.512220 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.564017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] For port 1f510541-26ad-4ad3-a08b-3bc716e8e4db, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f510541-26ad-4ad3-a08b-3bc716e8e4db,segment=NetworkSegment(3789d19b-ea4e-4b6d-9d1f-c151d5e5de79),segment_id=3789d19b-ea4e-4b6d-9d1f-c151d5e5de79)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:16.565005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.584095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Calling delete_port for 1f510541-26ad-4ad3-a08b-3bc716e8e4db owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:16.596084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ab1da4-1447-4020-b81a-7be70c75450e req-e397ceab-54c4-4a0b-a1a6-8c29dcc8767a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:16.597617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8ab1da4-1447-4020-b81a-7be70c75450e req-e397ceab-54c4-4a0b-a1a6-8c29dcc8767a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 945 time: 0.0932283 Dec 21 03:51:16.615692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.671089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:16.736695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8ab1da4-1447-4020-b81a-7be70c75450e req-9fa2f259-e1df-4bae-a54c-741830770950 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/security-groups?id=af7d5fbe-4198-4920-9356-ff83261b7d16&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1300898 Dec 21 03:51:16.750182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1040365-852e-400a-b958-a0b823b2494f req-615072f4-a187-4fc5-aac8-6bc549da08b0 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:16.752022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:16.753368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:16.756932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1040365-852e-400a-b958-a0b823b2494f req-615072f4-a187-4fc5-aac8-6bc549da08b0 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1098 time: 0.0888002 Dec 21 03:51:16.778387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:16.779013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9f9f5b3f-ff4d-4ea3-8721-8290f66f1552 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:16.831799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:16.854118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1040365-852e-400a-b958-a0b823b2494f req-585b856e-b34b-4aee-841c-c43b917bb9ac tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890856 Dec 21 03:51:16.907345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ca440f-af12-4d0e-bb7b-657a59e4d489 req-254717b0-44e6-4c4f-ba86-26cbc8ef4558 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:16.908900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31ca440f-af12-4d0e-bb7b-657a59e4d489 req-254717b0-44e6-4c4f-ba86-26cbc8ef4558 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0789766 Dec 21 03:51:16.983197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:17.018268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1f510541-26ad-4ad3-a08b-3bc716e8e4db'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:17.035042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Pushing event deleted for resources: {'Port': ['ID=1f510541-26ad-4ad3-a08b-3bc716e8e4db,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:17.061649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31ca440f-af12-4d0e-bb7b-657a59e4d489 req-70c0ca2f-c5b0-4a02-b36e-dc3880a2cadf tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1443377 Dec 21 03:51:17.073229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d69b13-43d0-4651-a5fb-9d70a79bdb57 req-898996de-01d9-41df-8fae-9a72ac404427 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:17.074355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60d69b13-43d0-4651-a5fb-9d70a79bdb57 req-898996de-01d9-41df-8fae-9a72ac404427 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1098 time: 0.1339808 Dec 21 03:51:17.098234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] No DVR routers for this DVR port 1f510541-26ad-4ad3-a08b-3bc716e8e4db on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:17.104926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:17.109000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3624e33e-a598-49af-adeb-64d0b5a8eacf req-cd4066e6-aa6c-4237-ae9d-d969820d01b8 tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.31 "DELETE /v2.0/ports/1f510541-26ad-4ad3-a08b-3bc716e8e4db HTTP/1.1" status: 204 len: 173 time: 0.9806387 Dec 21 03:51:17.109517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'name': 'network-vif-deleted', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:17.111699 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fbe696f0-295b-4cb7-ae48-2d85b9a775ab" -d '{"events": [{"server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "name": "network-vif-deleted", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:17.177467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60d69b13-43d0-4651-a5fb-9d70a79bdb57 req-b9a4a834-9780-4a8d-80c1-b983df5da5f9 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802717 Dec 21 03:51:17.196452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b08fcce1-f091-49b7-8137-c9513ca8d181 req-c3516bce-9aa9-4d9b-ae4f-6d0d3d85f311 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:17.198538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b08fcce1-f091-49b7-8137-c9513ca8d181 req-c3516bce-9aa9-4d9b-ae4f-6d0d3d85f311 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 949 time: 0.0736809 Dec 21 03:51:17.261977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b08fcce1-f091-49b7-8137-c9513ca8d181 req-8d0e5d2c-6333-40d1-bc7d-18e7a6b2d0ec tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492270 Dec 21 03:51:17.311837 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-915a70eb-054f-4c24-8678-58bb81767b32 x-openstack-request-id: req-915a70eb-054f-4c24-8678-58bb81767b32 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:17.312137 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4e64e43-e163-4c83-acb2-f5ef86378561", "name": "network-vif-deleted", "tag": "1f510541-26ad-4ad3-a08b-3bc716e8e4db", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:17.312421 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-915a70eb-054f-4c24-8678-58bb81767b32 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:17.313338 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4e64e43-e163-4c83-acb2-f5ef86378561', 'name': 'network-vif-deleted', 'tag': '1f510541-26ad-4ad3-a08b-3bc716e8e4db', 'status': 'completed', 'code': 200} Dec 21 03:51:17.422497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68a8dc0-8898-44cd-9cde-7a567358d656 req-7809dba7-3676-409c-b377-09fe13ddfd73 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:17.424028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a68a8dc0-8898-44cd-9cde-7a567358d656 req-7809dba7-3676-409c-b377-09fe13ddfd73 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.0500548 Dec 21 03:51:17.482235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a68a8dc0-8898-44cd-9cde-7a567358d656 req-1295d864-f178-4b29-ba45-f6344d0aa68e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514235 Dec 21 03:51:17.689266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5417c6ea-adb6-4921-b926-6f58e2e15fcf req-a636d673-3ce5-4f79-9045-9a09c414efd5 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:17.691079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5417c6ea-adb6-4921-b926-6f58e2e15fcf req-a636d673-3ce5-4f79-9045-9a09c414efd5 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1098 time: 0.0551662 Dec 21 03:51:17.741161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5417c6ea-adb6-4921-b926-6f58e2e15fcf req-e1cdd397-46bf-427a-82b1-421b2ce2f7f9 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434043 Dec 21 03:51:17.848093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00ab8f5d-7e90-4b09-9237-77416519ce71 req-a253be7f-1458-47ed-8cf6-ab9ba133927a tempest-ImagesTestJSON-579699362 tempest-ImagesTestJSON-579699362-project] 10.222.0.18 "GET /v2.0/ports?device_id=f4e64e43-e163-4c83-acb2-f5ef86378561 HTTP/1.1" status: 200 len: 210 time: 0.0292883 Dec 21 03:51:18.083766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4'}, {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:18.086215 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4aba47d9-f54e-43fd-88e9-7c617dbda7f3" -d '{"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-plugged", "status": "completed", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4"}, {"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:18.135482 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e626c7f-bb61-45e7-af31-399f5c5d30f9 x-openstack-request-id: req-7e626c7f-bb61-45e7-af31-399f5c5d30f9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:18.135779 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-plugged", "status": "completed", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4", "code": 200}, {"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:18.136056 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7e626c7f-bb61-45e7-af31-399f5c5d30f9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:18.136642 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'code': 200} Dec 21 03:51:18.136901 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'code': 200} Dec 21 03:51:18.219612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09395365-d816-4605-9598-ed6c887a784a req-6b4818cd-2cb6-4474-99ba-db3e40f5ecd4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.221210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09395365-d816-4605-9598-ed6c887a784a req-6b4818cd-2cb6-4474-99ba-db3e40f5ecd4 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0719442 Dec 21 03:51:18.230069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95b1cd8-b472-49ed-b355-1df40b74977b req-06e752df-2536-4072-91c6-b4a9fceb2b43 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.232250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f95b1cd8-b472-49ed-b355-1df40b74977b req-06e752df-2536-4072-91c6-b4a9fceb2b43 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0928633 Dec 21 03:51:18.401674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25d0cec-bd90-4861-9be6-882aaa1ba7ab req-4129f157-4974-4021-bb99-0b08253b2603 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.404387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d25d0cec-bd90-4861-9be6-882aaa1ba7ab req-4129f157-4974-4021-bb99-0b08253b2603 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 1102 time: 0.0508790 Dec 21 03:51:18.432164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f95b1cd8-b472-49ed-b355-1df40b74977b req-7a02e2c1-d703-4f61-8470-47a7bd3743a1 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1908844 Dec 21 03:51:18.463656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-897ef8a4-8445-402c-8f5d-19551139a33c req-9fb72886-802e-4f31-8c37-caa03a9e94ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.465126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-897ef8a4-8445-402c-8f5d-19551139a33c req-9fb72886-802e-4f31-8c37-caa03a9e94ea service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 1101 time: 0.1595881 Dec 21 03:51:18.469689 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d25d0cec-bd90-4861-9be6-882aaa1ba7ab req-50b3ca74-05b2-4e9a-948a-b51c58bd172e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536861 Dec 21 03:51:18.476196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd68583-ff3e-479a-ac88-169189b817ab req-51df36c3-dde1-4191-af40-8bbb47ebb1c9 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.476783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd68583-ff3e-479a-ac88-169189b817ab req-51df36c3-dde1-4191-af40-8bbb47ebb1c9 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.2292988 Dec 21 03:51:18.488048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ed56c7-72ae-497d-b8af-ca754700053d req-e90cb8da-69db-48ab-a75d-4cc22393b673 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.489742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06ed56c7-72ae-497d-b8af-ca754700053d req-e90cb8da-69db-48ab-a75d-4cc22393b673 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 949 time: 0.1373341 Dec 21 03:51:18.586744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Deleting port 05a0e112-ef34-4410-b1cb-36798e5b7d77 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:18.587144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:18.660791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06ed56c7-72ae-497d-b8af-ca754700053d req-ef3de7cb-17bb-4e98-acfd-6b757a0b7d93 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1621199 Dec 21 03:51:18.740277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4129a4cf-6d65-4737-a153-3db32af7eece req-7b3cd8fd-be43-49f6-b425-04ead4a7ce3c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:18.741862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4129a4cf-6d65-4737-a153-3db32af7eece req-7b3cd8fd-be43-49f6-b425-04ead4a7ce3c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 949 time: 0.1478188 Dec 21 03:51:18.766482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port 66e96a75-3965-47db-900b-9dfdb214fd6b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:18.766854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:18.774689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] For port 05a0e112-ef34-4410-b1cb-36798e5b7d77, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=05a0e112-ef34-4410-b1cb-36798e5b7d77,segment=NetworkSegment(4af8e8d9-376d-4a96-ae0c-b27352fe558a),segment_id=4af8e8d9-376d-4a96-ae0c-b27352fe558a)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:18.775154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:18.823402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Calling delete_port for 05a0e112-ef34-4410-b1cb-36798e5b7d77 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:19.275697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-897ef8a4-8445-402c-8f5d-19551139a33c req-cb21f431-7700-4698-b3d1-650b4a03176d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5265555 Dec 21 03:51:19.285017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4129a4cf-6d65-4737-a153-3db32af7eece req-509f93df-6e4a-45cc-96db-59c4f0f6294a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5284488 Dec 21 03:51:19.303875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port 66e96a75-3965-47db-900b-9dfdb214fd6b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=66e96a75-3965-47db-900b-9dfdb214fd6b,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:19.304355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:19.327122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af34d28e-e69a-4489-95f2-0b4695458317 req-3ecf9e72-ec8b-4cd2-a094-848e67b921a5 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:19.328652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af34d28e-e69a-4489-95f2-0b4695458317 req-3ecf9e72-ec8b-4cd2-a094-848e67b921a5 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1098 time: 0.1688149 Dec 21 03:51:19.333758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for 66e96a75-3965-47db-900b-9dfdb214fd6b owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:19.472134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af34d28e-e69a-4489-95f2-0b4695458317 req-0e869aac-c0c0-4477-adb0-db986a4919c3 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326389 Dec 21 03:51:19.584910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:19.618094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:19.628008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f19613e-b478-4ad5-8e53-cfb6e074b1c2 req-5dfe0c54-1d07-4f56-b446-c6c75eb1d017 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:19.629616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f19613e-b478-4ad5-8e53-cfb6e074b1c2 req-5dfe0c54-1d07-4f56-b446-c6c75eb1d017 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 946 time: 0.0971463 Dec 21 03:51:19.630404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Pushing event deleted for resources: {'Port': ['ID=05a0e112-ef34-4410-b1cb-36798e5b7d77,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:19.645617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['05a0e112-ef34-4410-b1cb-36798e5b7d77'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:19.649172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 1f510541-26ad-4ad3-a08b-3bc716e8e4db {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:19.654765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f510541-26ad-4ad3-a08b-3bc716e8e4db not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:19.660331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:19.688567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] No DVR routers for this DVR port 05a0e112-ef34-4410-b1cb-36798e5b7d77 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:19.693948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:19.697540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09395365-d816-4605-9598-ed6c887a784a req-922a849d-5d6f-47ed-9f24-090ddefcaa87 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.54 "DELETE /v2.0/ports/05a0e112-ef34-4410-b1cb-36798e5b7d77 HTTP/1.1" status: 204 len: 173 time: 1.4478388 Dec 21 03:51:19.702280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:19.705131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'name': 'network-vif-deleted', 'tag': '05a0e112-ef34-4410-b1cb-36798e5b7d77'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:19.709218 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-030a65c7-9ac4-4fba-8fa3-5e3685c79b9f" -d '{"events": [{"server_uuid": "cfd732b3-47df-42cc-a36f-336064d168c8", "name": "network-vif-deleted", "tag": "05a0e112-ef34-4410-b1cb-36798e5b7d77"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:19.738902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=66e96a75-3965-47db-900b-9dfdb214fd6b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:19.750516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5', '37f13e0f-1f8b-4106-974a-bdabfab506b1', '66e96a75-3965-47db-900b-9dfdb214fd6b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:19.800390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port 66e96a75-3965-47db-900b-9dfdb214fd6b on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:19.818000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f19613e-b478-4ad5-8e53-cfb6e074b1c2 req-3c118544-3255-4516-b5ce-526c5aedfa43 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a78c1f3-f15c-416f-a11d-b8fbe571abb6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1583700 Dec 21 03:51:19.819312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:19.823463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd68583-ff3e-479a-ac88-169189b817ab req-376081a5-ccbf-4bd1-b66a-588d9f91b54d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "DELETE /v2.0/ports/66e96a75-3965-47db-900b-9dfdb214fd6b HTTP/1.1" status: 204 len: 173 time: 1.3327661 Dec 21 03:51:19.986431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab7384bc-e9c6-47dc-833c-066bcb3f9bf5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:20.149654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d64123-252d-421c-89ac-2f28d6c92b79 req-3aabf317-15e6-45a3-82c7-f090d75593f7 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:20.152797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44d64123-252d-421c-89ac-2f28d6c92b79 req-3aabf317-15e6-45a3-82c7-f090d75593f7 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 949 time: 0.0860445 Dec 21 03:51:20.236179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44d64123-252d-421c-89ac-2f28d6c92b79 req-4b2e7250-abf3-4c9a-bf32-bfe3a04d829f tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734961 Dec 21 03:51:20.283475 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b7b3de7-9cfd-4b58-a103-58e9f61617c0 x-openstack-request-id: req-3b7b3de7-9cfd-4b58-a103-58e9f61617c0 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:20.283475 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cfd732b3-47df-42cc-a36f-336064d168c8", "name": "network-vif-deleted", "tag": "05a0e112-ef34-4410-b1cb-36798e5b7d77", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:20.283475 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3b7b3de7-9cfd-4b58-a103-58e9f61617c0 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:20.284294 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cfd732b3-47df-42cc-a36f-336064d168c8', 'name': 'network-vif-deleted', 'tag': '05a0e112-ef34-4410-b1cb-36798e5b7d77', 'status': 'completed', 'code': 200} Dec 21 03:51:20.520783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8621a906-2a80-4325-afcb-ac328685b204 req-e270d5a1-eb9a-486c-b6fa-9f750e1413a0 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=fd9dbec7-49c0-4dc4-9c5c-290458789754 HTTP/1.1" status: 200 len: 210 time: 0.0418141 Dec 21 03:51:20.613586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:20.661737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Deleting subnet d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:51:20.665228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:20.714794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:20.763570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:20.916884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7abeca58-d4c5-4231-9b87-a44b82b58f42 req-76e445d3-6612-4bb1-b340-3b3ddbee7af0 tempest-ServerDiskConfigTestJSON-852152852 tempest-ServerDiskConfigTestJSON-852152852-project] 10.222.0.18 "GET /v2.0/ports?device_id=cfd732b3-47df-42cc-a36f-336064d168c8 HTTP/1.1" status: 200 len: 210 time: 0.0268846 Dec 21 03:51:21.014337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.036533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:21.043209 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.046754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b58cd9ef-62be-4cf1-a90a-d00d0aea03fd admin admin] 10.222.0.18 "DELETE /v2.0/subnets/d1bd52a3-85b9-4dc2-90c7-ae3fd2fbc766 HTTP/1.1" status: 204 len: 168 time: 0.4320881 Dec 21 03:51:21.049280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52472) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:21.119381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.210832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.230441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:21.239712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:21.240007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3789d19b-ea4e-4b6d-9d1f-c151d5e5de79') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:21.254774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.280540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.281221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Releasing vlan 106 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:51:21.281337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:51:21.283094 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:51:21.384293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264eb5ba-7c83-4d5f-9436-59c83990cfa9 req-9507ff30-fec5-4c03-b4a6-3b54d790e8d2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:21.385833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-264eb5ba-7c83-4d5f-9436-59c83990cfa9 req-9507ff30-fec5-4c03-b4a6-3b54d790e8d2 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 949 time: 0.0708158 Dec 21 03:51:21.436145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-264eb5ba-7c83-4d5f-9436-59c83990cfa9 req-2579afa6-ada3-4931-add5-7bb3101f5a13 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441155 Dec 21 03:51:21.500367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.507049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:21.510469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] 10.222.0.18 "DELETE /v2.0/networks/d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1 HTTP/1.1" status: 204 len: 168 time: 0.4600909 Dec 21 03:51:21.523494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8af87b2-c697-456e-a183-df626133c8f4 admin admin] Pushing event deleted for resources: {'Network': ['ID=d1ba1866-e49e-4d17-94eb-51d6ac2d5ea1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:21.687910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1204af-044c-45db-834e-1dd9d8fe0ac5 req-00744ebb-5835-4347-938b-d544e5dbb9c8 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:21.689511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c1204af-044c-45db-834e-1dd9d8fe0ac5 req-00744ebb-5835-4347-938b-d544e5dbb9c8 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 950 time: 0.0604858 Dec 21 03:51:21.739976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c1204af-044c-45db-834e-1dd9d8fe0ac5 req-5bd5edc4-85e6-467f-8092-a9ff8adc4c6e tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437179 Dec 21 03:51:22.048109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 05a0e112-ef34-4410-b1cb-36798e5b7d77 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:22.088266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 05a0e112-ef34-4410-b1cb-36798e5b7d77 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:22.088613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 05a0e112-ef34-4410-b1cb-36798e5b7d77 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:22.089036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 66e96a75-3965-47db-900b-9dfdb214fd6b no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:22.110433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 66e96a75-3965-47db-900b-9dfdb214fd6b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:22.110794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 66e96a75-3965-47db-900b-9dfdb214fd6b not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:22.116809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52510) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:22.160179 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2873b6bd-94bb-493d-bae6-2aace075b2a9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=597df5e2769740859ecb4f30e4aefff3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398576 Dec 21 03:51:22.160346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:22.207511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfcfd93e-39a6-4edb-ad5f-8aa8a46604a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.229388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfcfd93e-39a6-4edb-ad5f-8aa8a46604a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.248919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784a3140-1c9d-47fe-b4fc-4cfc77044490 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.263435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-158e7598-1946-4ada-913b-ca597a48e708 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:51:22.264417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-158e7598-1946-4ada-913b-ca597a48e708 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0065575 Dec 21 03:51:22.294319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'name': 'network-vif-deleted', 'tag': '66e96a75-3965-47db-900b-9dfdb214fd6b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:22.296550 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3bb21254-b905-449d-ac6c-83c8b7c1eefe" -d '{"events": [{"server_uuid": "fd9dbec7-49c0-4dc4-9c5c-290458789754", "name": "network-vif-deleted", "tag": "66e96a75-3965-47db-900b-9dfdb214fd6b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:22.307809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-9d3d71de-4fa8-4d9f-b527-d59c2f5e3928 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:22.309213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-9d3d71de-4fa8-4d9f-b527-d59c2f5e3928 service neutron] 10.222.0.18 "GET /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 1095 time: 0.0385547 Dec 21 03:51:22.320519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:22.321006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Unknown quota resources ['binding']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:51:22.419735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfcfd93e-39a6-4edb-ad5f-8aa8a46604a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.422353 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfcfd93e-39a6-4edb-ad5f-8aa8a46604a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.423541 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cfcfd93e-39a6-4edb-ad5f-8aa8a46604a8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/af7d5fbe-4198-4920-9356-ff83261b7d16 HTTP/1.1" status: 204 len: 168 time: 0.2623618 Dec 21 03:51:22.431552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfcfd93e-39a6-4edb-ad5f-8aa8a46604a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af7d5fbe-4198-4920-9356-ff83261b7d16,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:22.458137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:22.458782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:22.458782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:22.463258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:22.463588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:22.468909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 50, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:22.469287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:22.469630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:22.470014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Bound port: 291446c0-79fe-4164-ba73-8b5de753da33, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:22.525121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:22.574337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.679445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:22.680639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-61515125-5a6a-4665-a9bb-fc6f9975168b service neutron] 10.222.0.18 "POST /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33/bindings HTTP/1.1" status: 201 len: 390 time: 0.3637004 Dec 21 03:51:23.012113 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89d22b80-2069-46e4-9bcd-4aac6f0bf80c x-openstack-request-id: req-89d22b80-2069-46e4-9bcd-4aac6f0bf80c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:23.012788 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd9dbec7-49c0-4dc4-9c5c-290458789754", "name": "network-vif-deleted", "tag": "66e96a75-3965-47db-900b-9dfdb214fd6b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:23.013132 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-89d22b80-2069-46e4-9bcd-4aac6f0bf80c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:23.013741 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd9dbec7-49c0-4dc4-9c5c-290458789754', 'name': 'network-vif-deleted', 'tag': '66e96a75-3965-47db-900b-9dfdb214fd6b', 'status': 'completed', 'code': 200} Dec 21 03:51:23.201371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.215851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52548) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:23.218860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7385e22-f716-472f-ae3f-de37fa552fb1 req-7423dcaa-88c0-4c4a-adfb-5be218a6a98f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:23.221064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7385e22-f716-472f-ae3f-de37fa552fb1 req-7423dcaa-88c0-4c4a-adfb-5be218a6a98f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.0837073 Dec 21 03:51:23.313419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24004f8-c08d-49e3-bb97-afe8edcdc616 req-3857a562-a54c-47fd-b0c5-883da1d59220 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:23.315026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24004f8-c08d-49e3-bb97-afe8edcdc616 req-3857a562-a54c-47fd-b0c5-883da1d59220 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 946 time: 0.0894372 Dec 21 03:51:23.322679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7385e22-f716-472f-ae3f-de37fa552fb1 req-8f128ae3-8ee6-415c-8f5b-74a6829c8cff tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865462 Dec 21 03:51:23.332811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b8e5177-98ea-40fd-93ff-2af1e62f4fe9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.418863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24004f8-c08d-49e3-bb97-afe8edcdc616 req-2b925a0c-40a3-454d-bb92-488ef355768b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872767 Dec 21 03:51:23.448755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b8e5177-98ea-40fd-93ff-2af1e62f4fe9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.523879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52560) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:23.553697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b8e5177-98ea-40fd-93ff-2af1e62f4fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.610563 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4b8e5177-98ea-40fd-93ff-2af1e62f4fe9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=361340e3168347e88249590921ee8d0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3933430 Dec 21 03:51:23.612735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52562) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:23.613364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Deleting subnet da10d7f0-623a-4e8a-b5fc-286a12beadcd {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:51:23.617385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8e5177-98ea-40fd-93ff-2af1e62f4fe9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c4c139b-699e-4952-8fb4-171329893616,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:23.619988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.658086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.660495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-ceb9afe7-70ca-4794-a234-4c18e9a15cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:23.660986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-ceb9afe7-70ca-4794-a234-4c18e9a15cc1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1098 time: 0.0795488 Dec 21 03:51:23.704201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.707640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-661cec34-ec9a-41b7-839e-9af66eef06fa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.770012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-661cec34-ec9a-41b7-839e-9af66eef06fa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.813581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-f323a84d-9634-46ee-87bb-546c520b61bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:23.815079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-f323a84d-9634-46ee-87bb-546c520b61bc service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1452689 Dec 21 03:51:23.865790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-61d407cc-6c42-455d-824d-e26679e709f3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 217 time: 0.0407584 Dec 21 03:51:23.894796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.920184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-661cec34-ec9a-41b7-839e-9af66eef06fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.921924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=da10d7f0-623a-4e8a-b5fc-286a12beadcd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:23.922639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-661cec34-ec9a-41b7-839e-9af66eef06fa admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.924140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-661cec34-ec9a-41b7-839e-9af66eef06fa admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9c4c139b-699e-4952-8fb4-171329893616 HTTP/1.1" status: 204 len: 168 time: 0.3097274 Dec 21 03:51:23.929834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:23.931647 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5d16c5f-4bde-4796-83f6-96bd64b8bdc9 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/da10d7f0-623a-4e8a-b5fc-286a12beadcd HTTP/1.1" status: 204 len: 168 time: 0.4067602 Dec 21 03:51:23.936611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52574) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:23.942340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661cec34-ec9a-41b7-839e-9af66eef06fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c4c139b-699e-4952-8fb4-171329893616,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:23.952269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-e70a3072-c372-4bce-88fd-fd6acf4f3f51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:23.956971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-e70a3072-c372-4bce-88fd-fd6acf4f3f51 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0775330 Dec 21 03:51:24.002417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-10c31d9f-2fba-4bf4-aea2-c254ff2a868f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0368247 Dec 21 03:51:24.032158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.136319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-cefe643a-5171-4a3a-a2db-9fa35c19fde7 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1203494 Dec 21 03:51:24.157223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.179227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['24735258-b5ad-42e8-a231-667c1278689e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:24.190583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4af8e8d9-376d-4a96-ae0c-b27352fe558a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:24.190976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4af8e8d9-376d-4a96-ae0c-b27352fe558a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:24.205691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.239066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:51:24.257368 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:51:24.302656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-5ea79a58-bdc1-4093-85fd-5bfefb82376c service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1055329 Dec 21 03:51:24.460929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.471688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.477157 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] 10.222.0.18 "DELETE /v2.0/networks/24735258-b5ad-42e8-a231-667c1278689e HTTP/1.1" status: 204 len: 168 time: 0.5369790 Dec 21 03:51:24.482136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdcf580-1abe-4f30-a6f5-4f0921aa6be9 req-b11d43e3-ea2d-41ce-816a-648940149a4f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:24.483974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efdcf580-1abe-4f30-a6f5-4f0921aa6be9 req-b11d43e3-ea2d-41ce-816a-648940149a4f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.0616624 Dec 21 03:51:24.523986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f88a81d-eb65-4f3c-b3a5-5fe39618a55b admin admin] Pushing event deleted for resources: {'Network': ['ID=24735258-b5ad-42e8-a231-667c1278689e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:24.558860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efdcf580-1abe-4f30-a6f5-4f0921aa6be9 req-3f20ef26-b7cc-4b90-9ca6-b0645adae1cf tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673487 Dec 21 03:51:24.605338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-2695cf8b-b7cb-4d81-94e3-32c1c5348581 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:24.607791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-2695cf8b-b7cb-4d81-94e3-32c1c5348581 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1098 time: 0.0474303 Dec 21 03:51:24.620104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:24.706767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.716369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e480a1-b796-455e-b8a6-582833cc9612 req-293c6e7f-9fca-47be-8d3d-60aed61657d6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:24.717873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7e480a1-b796-455e-b8a6-582833cc9612 req-293c6e7f-9fca-47be-8d3d-60aed61657d6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 946 time: 0.0932212 Dec 21 03:51:24.724265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.842121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7e480a1-b796-455e-b8a6-582833cc9612 req-d35db84f-fc9f-4a80-8077-6cc5aa962925 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050012 Dec 21 03:51:24.850148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d590d3-003b-4673-95fd-93ceb2588604 req-e398d015-6e97-4e3f-9efd-887da6468346 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:24.851883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86d590d3-003b-4673-95fd-93ceb2588604 req-e398d015-6e97-4e3f-9efd-887da6468346 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.1320384 Dec 21 03:51:24.887809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52608) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:24.904181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da06c184-e345-4b22-ad7b-ea42bf9a2f5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.938987 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:24.950221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52610) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:25.017077 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f05f3621-c71e-44db-86ce-af8d4c064bdc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=20acfa324e9b4279a50bf03610639a83&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0655997 Dec 21 03:51:25.019617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:25.025767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:25.044763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da06c184-e345-4b22-ad7b-ea42bf9a2f5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.068321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port 37f13e0f-1f8b-4106-974a-bdabfab506b1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:25.068664 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.078908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-901a05fc-2e7f-4793-91aa-55f654ab43de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.101284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-901a05fc-2e7f-4793-91aa-55f654ab43de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.101995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:25.182878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:25.185203 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eed8a591-1395-448f-82d3-72ad853c8394" -d '{"events": [{"server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "name": "network-vif-unplugged", "status": "completed", "tag": "291446c0-79fe-4164-ba73-8b5de753da33"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:25.191881 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.213712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port 37f13e0f-1f8b-4106-974a-bdabfab506b1, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=37f13e0f-1f8b-4106-974a-bdabfab506b1,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:25.217469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.229098 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-921379d8-65a7-4b35-a866-1573c02bc238 x-openstack-request-id: req-921379d8-65a7-4b35-a866-1573c02bc238 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:25.229388 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "name": "network-vif-unplugged", "status": "completed", "tag": "291446c0-79fe-4164-ba73-8b5de753da33", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:25.229632 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-921379d8-65a7-4b35-a866-1573c02bc238 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:25.230023 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33', 'code': 200} Dec 21 03:51:25.231030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for 37f13e0f-1f8b-4106-974a-bdabfab506b1 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:25.246152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da06c184-e345-4b22-ad7b-ea42bf9a2f5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.289643 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-da06c184-e345-4b22-ad7b-ea42bf9a2f5b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7b7509c3c8764ec9b75c64ed556c9c79&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4005077 Dec 21 03:51:25.292221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52630) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:25.292637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da06c184-e345-4b22-ad7b-ea42bf9a2f5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3aaf032-8d64-482e-987b-2affd1a3e220,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:25.298174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-901a05fc-2e7f-4793-91aa-55f654ab43de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.300644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-901a05fc-2e7f-4793-91aa-55f654ab43de admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.302554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-901a05fc-2e7f-4793-91aa-55f654ab43de admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7a78c1f3-f15c-416f-a11d-b8fbe571abb6 HTTP/1.1" status: 204 len: 168 time: 0.2818577 Dec 21 03:51:25.311330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901a05fc-2e7f-4793-91aa-55f654ab43de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a78c1f3-f15c-416f-a11d-b8fbe571abb6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:25.351061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.506212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:25.545133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a05718c5-fd51-4d74-8cd0-cad83fddb42f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.565959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:25.568733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:25.568733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:25.587453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:25.587787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Attempting to bind port 291446c0-79fe-4164-ba73-8b5de753da33 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:25.591365 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a05718c5-fd51-4d74-8cd0-cad83fddb42f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.611338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:25.611687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:25.612082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:25.612561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Bound port: 291446c0-79fe-4164-ba73-8b5de753da33, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:25.612956 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.666163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:25.677083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.730523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.739733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:25.751608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98b9d9ef-8c51-49e6-868e-10ad054b7375 req-2cdf2081-8ea4-4ab3-86c8-4f1ec6ffa336 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:25.753187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98b9d9ef-8c51-49e6-868e-10ad054b7375 req-2cdf2081-8ea4-4ab3-86c8-4f1ec6ffa336 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 949 time: 0.1080136 Dec 21 03:51:25.780900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:25.784596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5', '37f13e0f-1f8b-4106-974a-bdabfab506b1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:25.789598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=37f13e0f-1f8b-4106-974a-bdabfab506b1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:25.793209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:25.817865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a05718c5-fd51-4d74-8cd0-cad83fddb42f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.818884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a05718c5-fd51-4d74-8cd0-cad83fddb42f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.823112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a05718c5-fd51-4d74-8cd0-cad83fddb42f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c3aaf032-8d64-482e-987b-2affd1a3e220 HTTP/1.1" status: 204 len: 168 time: 0.5260494 Dec 21 03:51:25.861177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port 37f13e0f-1f8b-4106-974a-bdabfab506b1 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:25.867669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05718c5-fd51-4d74-8cd0-cad83fddb42f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3aaf032-8d64-482e-987b-2affd1a3e220,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:25.869775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.875385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86d590d3-003b-4673-95fd-93ceb2588604 req-1997aa12-0d5c-4b5f-817b-32bdbbe65893 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "DELETE /v2.0/ports/37f13e0f-1f8b-4106-974a-bdabfab506b1 HTTP/1.1" status: 204 len: 173 time: 1.0112042 Dec 21 03:51:25.889810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:25.904347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98b9d9ef-8c51-49e6-868e-10ad054b7375 req-f07837da-1e85-493c-8b7f-f71653240117 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1193585 Dec 21 03:51:25.930710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:25.945359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'mac_address': 'fa:16:3e:9b:33:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:26.048842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=8']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:26.067824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:26.068455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.070364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-77fca3d0-b98d-48c1-a916-563255e8940c service neutron] 10.222.0.54 "PUT /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 1124 time: 1.4541082 Dec 21 03:51:26.081220 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.097612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23528b20-f481-4856-be8c-8cf842efed9e req-a0282c27-9374-469b-a0b6-93489d17d8b2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:26.107095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23528b20-f481-4856-be8c-8cf842efed9e req-a0282c27-9374-469b-a0b6-93489d17d8b2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.0971923 Dec 21 03:51:26.142273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b5fc9274-dcad-49e4-9ea7-4a6e85e6581e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:26.172670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23528b20-f481-4856-be8c-8cf842efed9e req-f9a4b7ba-577f-4675-85ff-61a66fe63635 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636194 Dec 21 03:51:26.177363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:26.263702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52672) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:26.295804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.304366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['291446c0-79fe-4164-ba73-8b5de753da33'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:26.468393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:26.502915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:26.655736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7119a9f4-2c48-4ac9-96f1-1a815831432a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.761107 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7119a9f4-2c48-4ac9-96f1-1a815831432a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.819843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7119a9f4-2c48-4ac9-96f1-1a815831432a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.860549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52712) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:26.868671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7119a9f4-2c48-4ac9-96f1-1a815831432a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=11c248856c224ecaad41ab0eacc207c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5978534 Dec 21 03:51:26.921638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7119a9f4-2c48-4ac9-96f1-1a815831432a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d5eef67-a841-40e7-9bfb-716db92d7957,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:26.972039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6fa7086-1ece-49ed-8ac1-97d186467bf3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:26.996451 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6fa7086-1ece-49ed-8ac1-97d186467bf3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:27.023980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4f4dd74-a091-423f-9c01-2b29fc3326fe req-d138151a-adc7-4396-bc91-b3ebbf45a87a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=e79302e4-e242-46c5-9c2e-815f45ecc574 HTTP/1.1" status: 200 len: 210 time: 0.0368123 Dec 21 03:51:27.167021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6fa7086-1ece-49ed-8ac1-97d186467bf3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:27.169631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6fa7086-1ece-49ed-8ac1-97d186467bf3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:27.171077 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a6fa7086-1ece-49ed-8ac1-97d186467bf3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1d5eef67-a841-40e7-9bfb-716db92d7957 HTTP/1.1" status: 204 len: 168 time: 0.3091154 Dec 21 03:51:27.179053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6fa7086-1ece-49ed-8ac1-97d186467bf3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d5eef67-a841-40e7-9bfb-716db92d7957,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:27.231715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'name': 'network-vif-deleted', 'tag': '37f13e0f-1f8b-4106-974a-bdabfab506b1'}, {'name': 'network-changed', 'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:27.234173 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d16069b-219e-4bcc-91ad-aea6e867e950" -d '{"events": [{"server_uuid": "e79302e4-e242-46c5-9c2e-815f45ecc574", "name": "network-vif-deleted", "tag": "37f13e0f-1f8b-4106-974a-bdabfab506b1"}, {"name": "network-changed", "server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "tag": "291446c0-79fe-4164-ba73-8b5de753da33"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:27.360010 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ec54791-ba3c-4e62-8e9f-545adedcbde8 x-openstack-request-id: req-8ec54791-ba3c-4e62-8e9f-545adedcbde8 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:27.360310 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e79302e4-e242-46c5-9c2e-815f45ecc574", "name": "network-vif-deleted", "tag": "37f13e0f-1f8b-4106-974a-bdabfab506b1", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "tag": "291446c0-79fe-4164-ba73-8b5de753da33", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:27.360565 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8ec54791-ba3c-4e62-8e9f-545adedcbde8 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:27.360974 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e79302e4-e242-46c5-9c2e-815f45ecc574', 'name': 'network-vif-deleted', 'tag': '37f13e0f-1f8b-4106-974a-bdabfab506b1', 'status': 'completed', 'code': 200} Dec 21 03:51:27.361232 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33', 'status': 'completed', 'code': 200} Dec 21 03:51:27.420890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c56d81-daca-4e78-b121-b65555066e9f req-79259a0f-d237-4b96-be06-7b25bfbabcb5 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:27.422425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78c56d81-daca-4e78-b121-b65555066e9f req-79259a0f-d237-4b96-be06-7b25bfbabcb5 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.1258571 Dec 21 03:51:27.461410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-18c357ce-8662-49a7-9465-0d180f8f6ae7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:27.462924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-18c357ce-8662-49a7-9465-0d180f8f6ae7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1127 time: 0.0858285 Dec 21 03:51:27.572190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78c56d81-daca-4e78-b121-b65555066e9f req-2d155636-cad7-4d9b-8e1b-4a828f682c48 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1425080 Dec 21 03:51:27.686561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:27.700458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-fb0ae8a7-e6ba-4f2a-873e-536231c2b387 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:27.706734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-fb0ae8a7-e6ba-4f2a-873e-536231c2b387 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.2097464 Dec 21 03:51:27.712011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:27.776239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:27.776956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:27.799321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-b956ecf2-2717-4a88-8362-252a0f8d5fb6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 217 time: 0.0737426 Dec 21 03:51:27.910100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-61995d8d-5c6a-4f95-b697-592d3e4945b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:27.914657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-61995d8d-5c6a-4f95-b697-592d3e4945b2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.1048446 Dec 21 03:51:27.933042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:27.960686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:27.964568 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eca2913e-a757-4971-9ae7-d7525a81e048" -d '{"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:27.968407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-network', 'tenant_id': '920e98327f8340b0966241ad0871434f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:27.987752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-2255f252-2dc0-4120-b5c2-0569e25b47ab service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0660720 Dec 21 03:51:28.007748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:28.028874 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f88b4ac-c9d5-489f-9551-da097e152ed8 x-openstack-request-id: req-1f88b4ac-c9d5-489f-9551-da097e152ed8 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:28.029377 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:28.029810 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1f88b4ac-c9d5-489f-9551-da097e152ed8 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:28.030504 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'code': 200} Dec 21 03:51:28.063738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 37f13e0f-1f8b-4106-974a-bdabfab506b1 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:28.102916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 37f13e0f-1f8b-4106-974a-bdabfab506b1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:28.103292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 37f13e0f-1f8b-4106-974a-bdabfab506b1 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:28.105877 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.142007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Made reservation on behalf of 920e98327f8340b0966241ad0871434f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:28.160351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.177605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-11f40e44-0ac8-4b19-a570-fb355f5e94fb service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1805294 Dec 21 03:51:28.193168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.248451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:28.346611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d16069b-219e-4bcc-91ad-aea6e867e950 req-700b4208-edc2-4980-b573-af45bfed251b service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1601577 Dec 21 03:51:28.395889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.519179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.576345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] vlan segment allocate from pool success with {'vlan_id': 114, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:51:28.645115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3a7c1b3-cd89-415c-8815-d4c442d51c8e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:28.649589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.650162 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Added segment 2a112885-d444-478f-82ef-20aafe136b97 of type vlan for network e94928bb-be91-4772-b576-ae2f90f005ad Dec 21 03:51:28.744670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.855120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953dbc43-b13e-44cb-b3f3-a6ac3cef0068 req-6b1fb873-86db-45ce-811d-ca8d33efdbb6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:28.863186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-953dbc43-b13e-44cb-b3f3-a6ac3cef0068 req-6b1fb873-86db-45ce-811d-ca8d33efdbb6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.0804563 Dec 21 03:51:28.893775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.896130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:28.898758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:28.945224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-953dbc43-b13e-44cb-b3f3-a6ac3cef0068 req-e53c3183-e6a0-4273-b45e-038ab8fcb554 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765474 Dec 21 03:51:29.056340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] Pushing event updated for resources: {'Network': ['ID=e94928bb-be91-4772-b576-ae2f90f005ad,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:29.067473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e94928bb-be91-4772-b576-ae2f90f005ad details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:51:29.165098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52814) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:29.198169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-28f7dee8-50c0-4b0a-9d2e-199fb563cfe4 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.4848788 Dec 21 03:51:29.198681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52818) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:29.222186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Request body: {'subnet': {'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-subnet', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:29.278840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac2cba1-0b41-46e6-9603-7b91ce4067f6 req-b6f3f5fb-d14e-4540-ba55-870a38437cf3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:29.289132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ac2cba1-0b41-46e6-9603-7b91ce4067f6 req-b6f3f5fb-d14e-4540-ba55-870a38437cf3 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 950 time: 0.1264820 Dec 21 03:51:29.371434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ac2cba1-0b41-46e6-9603-7b91ce4067f6 req-88ac507c-65cc-4ed9-bf2c-1d464886bb68 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756974 Dec 21 03:51:29.403741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Made reservation on behalf of 920e98327f8340b0966241ad0871434f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:29.407458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.470769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1164487222-network', 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:29.621553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:29.623345 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.643042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.757567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.759545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.851197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f8a63e48-36eb-4a7d-be87-03acc85470f7,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:29.855260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Checking segment: {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:29.855890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Network hostable DHCP agents. Network: e94928bb-be91-4772-b576-ae2f90f005ad, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:51:29.858139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.888654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:51:29.914037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:29.923638 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Added segment fafae862-c9cf-4d93-83f4-6f5447ca2985 of type vlan for network a0e5eeee-a736-4bd3-bdf6-679e8da99022 Dec 21 03:51:29.923638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b078e631-a51a-4efd-887f-6f8872cf6b3b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:29.971660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.008137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Network e94928bb-be91-4772-b576-ae2f90f005ad is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:51:30.083196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:30.111952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.112926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:30.113513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.222841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:30.236498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:51:30.245472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] Pushing event updated for resources: {'Network': ['ID=a0e5eeee-a736-4bd3-bdf6-679e8da99022,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:30.257888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e94928bb-be91-4772-b576-ae2f90f005ad) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:30.267395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:51:30.274149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7948ef3b-49aa-4123-ae5a-6e76dc152717 None None] Network e94928bb-be91-4772-b576-ae2f90f005ad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:51:30.283068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:30.283669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.314413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23206182-3db7-4aee-9dd2-c5e3c7d6b888 req-49a48c5b-533b-43e0-aa23-faeacf348810 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:30.316225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23206182-3db7-4aee-9dd2-c5e3c7d6b888 req-49a48c5b-533b-43e0-aa23-faeacf348810 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.2924380 Dec 21 03:51:30.385009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4501626a-9a80-4490-945f-c4c00f1533a0 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.1835256 Dec 21 03:51:30.385355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52850) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:30.387461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-94900c58-db36-48b1-80bb-a4ea037f5965 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.2211142 Dec 21 03:51:30.391685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52854) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:30.393227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-cf231bce-65d9-441d-ba32-1014bbf0b60c service neutron] 10.222.0.31 "GET /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.1516156 Dec 21 03:51:30.397888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Request body: {'subnet': {'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1164487222-subnet', 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:30.398729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:30.413201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23206182-3db7-4aee-9dd2-c5e3c7d6b888 req-4c175670-dee0-4f5c-8ca7-aa1567c86541 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847375 Dec 21 03:51:30.488306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9286172f-3aaa-416d-8919-5d96fa35b629 None None] Network e94928bb-be91-4772-b576-ae2f90f005ad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:51:30.561128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:30.563512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.594104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.597880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.677975 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:51:30.680791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb31c15-9c1d-414f-8aee-9327461e0f0d req-10f8b004-45e2-40f0-92f3-f882fd840708 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:30.687300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acb31c15-9c1d-414f-8aee-9327461e0f0d req-10f8b004-45e2-40f0-92f3-f882fd840708 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 950 time: 0.1879878 Dec 21 03:51:30.696336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-ec1c7cf7-3e3a-4299-8091-2d20ad3af28d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:30.699559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-ec1c7cf7-3e3a-4299-8091-2d20ad3af28d tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 950 time: 0.1799307 Dec 21 03:51:30.754052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:30.821170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acb31c15-9c1d-414f-8aee-9327461e0f0d req-b643c00f-cfe8-41a9-851b-7ea0621f78ab tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282485 Dec 21 03:51:30.947878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-5c54e47e-ff32-414b-9eec-ac58f3a4db79 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:30.952346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-5c54e47e-ff32-414b-9eec-ac58f3a4db79 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/ports?device_id=60ce7efc-44aa-46fb-a6b0-9ce9383f5c00 HTTP/1.1" status: 200 len: 948 time: 0.1298952 Dec 21 03:51:31.022805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.031090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:31.054870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:31.055262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.101224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:31.130406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.140498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52862) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:31.212232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0937a3b1-7f54-409b-bba0-29fa72617a82,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:31.234580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 291446c0-79fe-4164-ba73-8b5de753da33 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:31.254746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:31.299866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port e8f918db-131d-40f7-91ab-86a7099533b5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:31.300415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.300731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:31.301248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.314207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f23dd7db-f834-48ac-a1c8-bb728544d4f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.321035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:31.324885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Network hostable DHCP agents. Network: a0e5eeee-a736-4bd3-bdf6-679e8da99022, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:51:31.336664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for feb7c6fe-4296-4b97-bdd3-ef39ffcbadba owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:31.379576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.749259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f23dd7db-f834-48ac-a1c8-bb728544d4f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.816778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.823276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port e8f918db-131d-40f7-91ab-86a7099533b5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e8f918db-131d-40f7-91ab-86a7099533b5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:31.823276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.836003 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.842950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:51:31.869118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for e8f918db-131d-40f7-91ab-86a7099533b5 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:31.885806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.890716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f23dd7db-f834-48ac-a1c8-bb728544d4f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:31.890996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6c554e-fc55-47d8-99a6-779f832fc5ec req-8985cd5e-a556-4e31-badf-2fbdf75b39d4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:31.898906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff6c554e-fc55-47d8-99a6-779f832fc5ec req-8985cd5e-a556-4e31-badf-2fbdf75b39d4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 944 time: 0.1840076 Dec 21 03:51:31.925405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af', 'e8f918db-131d-40f7-91ab-86a7099533b5'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:31.928076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:31.936209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] Transition to ACTIVE for port object 291446c0-79fe-4164-ba73-8b5de753da33 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:31.987690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=feb7c6fe-4296-4b97-bdd3-ef39ffcbadba,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:32.008363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e09d68b5-fc3e-4d63-9a65-ce8fa4ac3939 req-435708fc-7ce6-4293-b0ea-a7f6b0ed7a23 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 210 time: 0.0741377 Dec 21 03:51:32.072714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23dd7db-f834-48ac-a1c8-bb728544d4f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e98fa203-04fc-4216-8e40-75330671627a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:32.097869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff6c554e-fc55-47d8-99a6-779f832fc5ec req-cdb4676a-737b-4fb5-be3d-6368432e5df7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1979704 Dec 21 03:51:32.115864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, a0e5eeee-a736-4bd3-bdf6-679e8da99022) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:32.206537 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f23dd7db-f834-48ac-a1c8-bb728544d4f7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=147b679cd767409d9a103eaaf4e904f6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9924314 Dec 21 03:51:32.206537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port feb7c6fe-4296-4b97-bdd3-ef39ffcbadba on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:32.206537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.207333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:32.207333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.207788 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85c5f6ec-b890-4ac0-8e07-2578372bb23c req-0fc9a15d-02cf-45f4-ba07-6cb1d256332c tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "DELETE /v2.0/ports/feb7c6fe-4296-4b97-bdd3-ef39ffcbadba HTTP/1.1" status: 204 len: 173 time: 1.4404235 Dec 21 03:51:32.207788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'name': 'network-vif-deleted', 'tag': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:32.207788 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-430e6ce6-f112-4089-961b-b35954d6eaf7" -d '{"events": [{"server_uuid": "f2df3f34-9f1a-40f7-828d-f6264abfbb19", "name": "network-vif-deleted", "tag": "feb7c6fe-4296-4b97-bdd3-ef39ffcbadba"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:32.208628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2856f97e-cb19-4b85-831b-2a548b4ee55b None None] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:51:32.208736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Allocated IP 172.25.5.21 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/284d1f4a-5df5-4efe-84d7-9ca11e55d8ca) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:32.213296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52884) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:32.225313 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8751727-5c70-4ebf-92f2-c2321b33a7c9 x-openstack-request-id: req-a8751727-5c70-4ebf-92f2-c2321b33a7c9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:32.225747 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f2df3f34-9f1a-40f7-828d-f6264abfbb19", "name": "network-vif-deleted", "tag": "feb7c6fe-4296-4b97-bdd3-ef39ffcbadba", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:32.226098 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a8751727-5c70-4ebf-92f2-c2321b33a7c9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:32.226584 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2df3f34-9f1a-40f7-828d-f6264abfbb19', 'name': 'network-vif-deleted', 'tag': 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba', 'status': 'completed', 'code': 200} Dec 21 03:51:32.333133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.343362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.377222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f454ac0-df3c-4792-8a77-4b9b83de0008 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.9767668 Dec 21 03:51:32.379788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.466732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f48adef3-7fe8-4eec-828d-e7e2a6a374e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.480020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2fe4f81-d8d8-496f-b22d-4a2b7f70f65d None None] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:51:32.515447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f48adef3-7fe8-4eec-828d-e7e2a6a374e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.523740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.623154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:32.624906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Pushing event updated for resources: {'Port': ['ID=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:32.639250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:32.644461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:32.673521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] No DVR routers for this DVR port 291446c0-79fe-4164-ba73-8b5de753da33 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:32.779742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f48adef3-7fe8-4eec-828d-e7e2a6a374e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.787923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f48adef3-7fe8-4eec-828d-e7e2a6a374e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.794299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f48adef3-7fe8-4eec-828d-e7e2a6a374e5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e98fa203-04fc-4216-8e40-75330671627a HTTP/1.1" status: 204 len: 168 time: 0.5791249 Dec 21 03:51:32.857304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f48adef3-7fe8-4eec-828d-e7e2a6a374e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e98fa203-04fc-4216-8e40-75330671627a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:32.870835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] Pushing event updated for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=10']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:32.882499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port e8f918db-131d-40f7-91ab-86a7099533b5 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:32.907780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-d5dcaf11-0fcc-41af-ac07-92765fcbc110 service neutron] 10.222.0.31 "PUT /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 2.5038724 Dec 21 03:51:32.940233 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:32.946777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc96fcc-52fc-40d5-9191-c9a51df1afbc req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "DELETE /v2.0/ports/e8f918db-131d-40f7-91ab-86a7099533b5 HTTP/1.1" status: 204 len: 173 time: 1.9241626 Dec 21 03:51:32.948449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'name': 'network-vif-deleted', 'tag': 'e8f918db-131d-40f7-91ab-86a7099533b5'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:32.954050 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc474222-b0a5-4043-933b-b0ee8fee7d16" -d '{"events": [{"server_uuid": "60ce7efc-44aa-46fb-a6b0-9ce9383f5c00", "name": "network-vif-deleted", "tag": "e8f918db-131d-40f7-91ab-86a7099533b5"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:32.976626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362', 'feb7c6fe-4296-4b97-bdd3-ef39ffcbadba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:32.986139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e1e1549e-75bc-48d2-8689-1abaf521b00c req-db80625f-0bcb-49ea-8be5-feebf5959009 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0315518 Dec 21 03:51:33.058587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a09d3764-4df5-47df-a2ba-97e4a9ada729 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=e8f918db-131d-40f7-91ab-86a7099533b5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:33.079952 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2cc58e00-98a5-4b8b-9a69-f6d4fe913bea x-openstack-request-id: req-2cc58e00-98a5-4b8b-9a69-f6d4fe913bea {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:33.080254 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "60ce7efc-44aa-46fb-a6b0-9ce9383f5c00", "name": "network-vif-deleted", "tag": "e8f918db-131d-40f7-91ab-86a7099533b5", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:33.080521 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2cc58e00-98a5-4b8b-9a69-f6d4fe913bea {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:33.080940 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '60ce7efc-44aa-46fb-a6b0-9ce9383f5c00', 'name': 'network-vif-deleted', 'tag': 'e8f918db-131d-40f7-91ab-86a7099533b5', 'status': 'completed', 'code': 200} Dec 21 03:51:33.117378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e1e1549e-75bc-48d2-8689-1abaf521b00c req-6b911749-9aa3-462e-bf42-932dc70ea754 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 210 time: 0.0775688 Dec 21 03:51:33.304824 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e1e1549e-75bc-48d2-8689-1abaf521b00c req-b585d3ec-3240-4adf-b518-e0028fb132db service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0755467 Dec 21 03:51:33.521265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e1549e-75bc-48d2-8689-1abaf521b00c req-a96ae9b2-c0b7-4bfa-8f2c-b6181aba636c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:33.526523 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e1e1549e-75bc-48d2-8689-1abaf521b00c req-a96ae9b2-c0b7-4bfa-8f2c-b6181aba636c service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2185302 Dec 21 03:51:33.529662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:33.581736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-127fc69b-9904-40ff-9c8a-19a5f1004935 req-5cb73dea-e16c-452b-8918-e631bab09b4f tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=f2df3f34-9f1a-40f7-828d-f6264abfbb19 HTTP/1.1" status: 200 len: 210 time: 0.3721061 Dec 21 03:51:33.670463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-31c35ddb-e80a-4a4d-88e4-73f604714bf1 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:33.672389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-31c35ddb-e80a-4a4d-88e4-73f604714bf1 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.3312435 Dec 21 03:51:33.688758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-1cdf638f-61a9-4f6f-93c1-dc05d66dc177 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:33.697116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-1cdf638f-61a9-4f6f-93c1-dc05d66dc177 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.5604889 Dec 21 03:51:33.741291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:33.819230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-c4262f95-d0ce-465c-b54a-c592460facb9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.1208091 Dec 21 03:51:33.874515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 291446c0-79fe-4164-ba73-8b5de753da33 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:51:33.875581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:33.875581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device feb7c6fe-4296-4b97-bdd3-ef39ffcbadba no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:33.901741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: feb7c6fe-4296-4b97-bdd3-ef39ffcbadba {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:33.902184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device feb7c6fe-4296-4b97-bdd3-ef39ffcbadba not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:33.910777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3ef76d29-8fec-414f-bf13-234c096bdb8e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0893676 Dec 21 03:51:33.949977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-c271ca3b-a143-40db-a49e-4ddc2baaf31e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:33.951532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-c271ca3b-a143-40db-a49e-4ddc2baaf31e service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd&tenant_id=e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 1097 time: 0.2513814 Dec 21 03:51:33.958674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52938) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:33.980808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1518e34-1ac3-4ced-806a-749665d50253 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:34.018182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:34.068326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb89337-c4f0-4b31-8e83-f7a506e3402a req-0a74c240-fe9f-40e9-aa3e-1813ac0955ff tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:34.069863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bb89337-c4f0-4b31-8e83-f7a506e3402a req-0a74c240-fe9f-40e9-aa3e-1813ac0955ff tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.2135484 Dec 21 03:51:34.103506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-58a3487f-0496-472e-862d-8070a5af149e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:34.105010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-58a3487f-0496-472e-862d-8070a5af149e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1097 time: 0.0888002 Dec 21 03:51:34.120465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-6eb06a4d-d043-4b6f-a222-6b0d5306b02f service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2087228 Dec 21 03:51:34.131221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e8f918db-131d-40f7-91ab-86a7099533b5 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:34.181425 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1518e34-1ac3-4ced-806a-749665d50253 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:34.185109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: e8f918db-131d-40f7-91ab-86a7099533b5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:34.185831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e8f918db-131d-40f7-91ab-86a7099533b5 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:34.264304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1518e34-1ac3-4ced-806a-749665d50253 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:34.293310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bb89337-c4f0-4b31-8e83-f7a506e3402a req-e2c6fe0b-ca68-4319-8632-1f7553ad35ff tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2134163 Dec 21 03:51:34.306666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1518e34-1ac3-4ced-806a-749665d50253 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bcceed7-1300-4442-9de1-bb3403602800,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:34.311263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Router cbef927a-234e-4845-b539-e85731a2c3f3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:51:34.385171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-5df76a9c-9847-462a-8ee6-08aed8a5c8af service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2634683 Dec 21 03:51:34.410868 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1518e34-1ac3-4ced-806a-749665d50253 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5138b8564eea4e2cb0156335b7dce642&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4511287 Dec 21 03:51:34.418907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52948) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:34.481120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-85506c12-bca7-4310-80e0-8ce209815b93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:34.482820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-85506c12-bca7-4310-80e0-8ce209815b93 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.3586099 Dec 21 03:51:34.525514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'd4a89fe6-e810-43b4-bd73-b205091236af'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:34.582053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-9bca29f3-e6df-46c7-88c0-3049fb644a04 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 217 time: 0.0887072 Dec 21 03:51:34.608916 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6678ebe-14cd-4898-aaa1-c745153d54f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:34.672287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6678ebe-14cd-4898-aaa1-c745153d54f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:34.719195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-7ebd9ff2-cdf9-4b53-88d3-2d1d1334381a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:34.726614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-7ebd9ff2-cdf9-4b53-88d3-2d1d1334381a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.1327078 Dec 21 03:51:34.777812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-b4a52d9f-0907-4905-8bf4-d36b00710abb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0395253 Dec 21 03:51:34.901083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-4cd80990-11bb-43ac-95e0-cad06bcc8a12 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1159656 Dec 21 03:51:35.056179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-c963ac5e-f046-4334-a1ff-c853f80d1d84 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1382740 Dec 21 03:51:35.076245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9b82be5-5b23-4da9-93be-70a14ce53302 req-89b168ea-5085-46ba-b17a-9be636007835 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 210 time: 0.1713257 Dec 21 03:51:35.168962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6678ebe-14cd-4898-aaa1-c745153d54f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:35.171620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e6678ebe-14cd-4898-aaa1-c745153d54f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:35.172773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e6678ebe-14cd-4898-aaa1-c745153d54f7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4bcceed7-1300-4442-9de1-bb3403602800 HTTP/1.1" status: 204 len: 168 time: 0.7526650 Dec 21 03:51:35.182891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6678ebe-14cd-4898-aaa1-c745153d54f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bcceed7-1300-4442-9de1-bb3403602800,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:35.198506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:51:35.217122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Sync routers for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:51:35.236218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:51:35.238348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:35.367060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:35.368394 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d224a8e6-f0d2-41b6-b694-e65112fa9356 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 4.9832969 Dec 21 03:51:35.371299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52972) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:35.430137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:51:35.604538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d54c78-9aee-4406-8994-4747c65dfa2f req-d27b85db-66c7-4851-b163-a08b93ed8747 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:35.612100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95d54c78-9aee-4406-8994-4747c65dfa2f req-d27b85db-66c7-4851-b163-a08b93ed8747 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.1982031 Dec 21 03:51:35.807152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-a23d460c-d9e8-47eb-a3ff-66436a324862 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.2204978 Dec 21 03:51:35.836755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95d54c78-9aee-4406-8994-4747c65dfa2f req-2d4e98f9-2019-408f-acd3-b2b281796ed4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2237043 Dec 21 03:51:35.865611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:32Z', 'revision_number': 3, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:35.939133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Checking router: cbef927a-234e-4845-b539-e85731a2c3f3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:51:35.939133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Updating router cbef927a-234e-4845-b539-e85731a2c3f3 port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:51:36.013622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.017946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b684654f-711f-43e4-a035-7e01763217dc req-25acd415-f60b-4d21-acc5-070e0df05ee3 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:36.026265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-25acd415-f60b-4d21-acc5-070e0df05ee3 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.2927310 Dec 21 03:51:36.065904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-b6c0cad2-7f24-430a-80b0-39b67d6dcc8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:36.067443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-b6c0cad2-7f24-430a-80b0-39b67d6dcc8e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 1102 time: 0.1520376 Dec 21 03:51:36.430672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-050f5335-b9e6-4e43-a1c8-392ed6f6b6f9 req-91071b70-4cbc-40b3-a9c2-79c9208b1910 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 210 time: 0.1525943 Dec 21 03:51:36.457081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.632637 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.643464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-e2ec803f-6edc-40a1-8701-7e99f6213a46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:36.643464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-e2ec803f-6edc-40a1-8701-7e99f6213a46 service neutron] 10.222.0.54 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.5326595 Dec 21 03:51:36.736644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Attempting to bind port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:36.737388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Attempting to bind port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:36.738113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Attempting to bind port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:36.740254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-e751d96d-d4e1-45cf-94e9-b2456f454588 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5 HTTP/1.1" status: 200 len: 217 time: 0.0887842 Dec 21 03:51:36.775838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0c37e5-f3fc-46e6-8146-e18bd78e3ad4 req-4b748eb4-22c5-4f77-b0ef-3309603eae76 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:36.778892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e0c37e5-f3fc-46e6-8146-e18bd78e3ad4 req-4b748eb4-22c5-4f77-b0ef-3309603eae76 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 950 time: 0.2919648 Dec 21 03:51:36.787956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:36.788447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:36.788952 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.792244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:36.792885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Bound port: 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:36.794815 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.805657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.816058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b684654f-711f-43e4-a035-7e01763217dc req-2a678aa3-da08-4d5d-97be-8f0668c05faf service neutron] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:36.828240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e0a5d8c-3bf8-4a51-9622-517a3c084f70 None None] Pushing event updated for resources: {'Port': ['ID=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:36.835822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b684654f-711f-43e4-a035-7e01763217dc req-2a678aa3-da08-4d5d-97be-8f0668c05faf service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:36.837528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b684654f-711f-43e4-a035-7e01763217dc req-2a678aa3-da08-4d5d-97be-8f0668c05faf service neutron] 10.222.0.54 "DELETE /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.8074956 Dec 21 03:51:36.872800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-7ae69657-b78d-4b56-91c7-998bf03fb920 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:36.874292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-7ae69657-b78d-4b56-91c7-998bf03fb920 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1220732 Dec 21 03:51:36.929545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] For port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:36.934326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] For port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:37.026711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e0c37e5-f3fc-46e6-8146-e18bd78e3ad4 req-41df5862-9980-4e64-b3f5-e296f9b10194 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2265329 Dec 21 03:51:37.034921 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:37.149935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:51:37.150723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:37.158010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-3e8cdd6f-c27c-42f9-a4c3-057942479186 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:37.159592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-3e8cdd6f-c27c-42f9-a4c3-057942479186 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2539399 Dec 21 03:51:37.181121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b0395d-653a-4adc-a620-0095770c96af req-e4e3df37-945f-4039-822f-f5083411c55f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:37.182719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16b0395d-653a-4adc-a620-0095770c96af req-e4e3df37-945f-4039-822f-f5083411c55f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.1734514 Dec 21 03:51:37.250303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e0a5d8c-3bf8-4a51-9622-517a3c084f70 None None] Pushing event updated for resources: {'Port': ['ID=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:37.378816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:51:37.717898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:32Z', 'revision_number': 3, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:37.795832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bde1a8e-1964-44e3-92c5-18744921301b req-27db7445-9c67-44c5-8025-3294d1df4950 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 210 time: 0.1048946 Dec 21 03:51:37.810144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-175d34ea-9c55-4ca0-8d38-265bbe17dff8 None None] The sync data for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 is: [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:32Z', 'revision_number': 3, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:51:37.948979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16b0395d-653a-4adc-a620-0095770c96af req-818a39ee-979a-41f7-8b3d-36a81bb23578 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7353790 Dec 21 03:51:37.948979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Allocated IP 172.20.0.1 (e94928bb-be91-4772-b576-ae2f90f005ad/f8a63e48-36eb-4a7d-be87-03acc85470f7/24bea13f-7eed-47c1-8222-2eb2fea02484) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:38.025591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-1ced8b6c-707b-4a4b-abcd-7ed6a6f9f2df tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:38.039673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-1ced8b6c-707b-4a4b-abcd-7ed6a6f9f2df tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 950 time: 0.3790014 Dec 21 03:51:38.136043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-bac3d33b-e757-416c-bc20-4b36857988de service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9486799 Dec 21 03:51:38.383420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-e4d95a20-bf84-4968-b87b-1681fb73d050 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:38.391934 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-e4d95a20-bf84-4968-b87b-1681fb73d050 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "GET /v2.0/ports?device_id=f751db3c-17ec-4665-b871-1aeef7c0df0c HTTP/1.1" status: 200 len: 950 time: 0.2197766 Dec 21 03:51:38.531701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1c58b6-88aa-4817-b64c-af00087a2798 req-ad31bce8-f315-4d83-8448-31e42cf39190 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:38.550425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e1c58b6-88aa-4817-b64c-af00087a2798 req-ad31bce8-f315-4d83-8448-31e42cf39190 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1097 time: 0.4210961 Dec 21 03:51:38.567879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-646069ee-8466-45f4-a4f5-f63486078a75 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:38.569495 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-646069ee-8466-45f4-a4f5-f63486078a75 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.3382254 Dec 21 03:51:38.594759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:38.595906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Request body: {'port': {'device_id': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'admin_state_up': True, 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:38.633445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port d4a89fe6-e810-43b4-bd73-b205091236af {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:38.636910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:38.643898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac9f966-e51a-4eba-97f6-28e531cba104 req-325218e0-07a6-4480-9d33-827a40596586 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:38.651777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ac9f966-e51a-4eba-97f6-28e531cba104 req-325218e0-07a6-4480-9d33-827a40596586 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 950 time: 0.4025724 Dec 21 03:51:38.742987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-19fe0e2f-9cd2-4e81-a529-889636c51897 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5317013 Dec 21 03:51:38.746058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:38.746444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:38.766012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e1c58b6-88aa-4817-b64c-af00087a2798 req-341678fd-d731-4154-9dc0-5017f697f6bc tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2146535 Dec 21 03:51:38.881141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ac9f966-e51a-4eba-97f6-28e531cba104 req-ace5f9ef-a74d-4021-846d-4a0f4f552269 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2287323 Dec 21 03:51:39.052991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port d4a89fe6-e810-43b4-bd73-b205091236af, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d4a89fe6-e810-43b4-bd73-b205091236af,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:39.052991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.055041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:39.055041 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.055041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:39.056870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for d4a89fe6-e810-43b4-bd73-b205091236af owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:39.141751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a939a497-e695-456d-af42-c78f34cc5949 req-99567b3d-d334-4c70-ab34-f40a5a1b4698 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 210 time: 0.0462027 Dec 21 03:51:39.244220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.294419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:39.298457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.353154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.407020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:39.435026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Network e94928bb-be91-4772-b576-ae2f90f005ad is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:39.462898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:39.474214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=7d0b7a63-470a-45ab-900c-1fd451ed2bd5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:39.488651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:39.499511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Pushing event updated for resources: {'Port': ['ID=24bea13f-7eed-47c1-8222-2eb2fea02484,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:39.509678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:39.541637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.543797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.543797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.543797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.543797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.544210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.544210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.545029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.545029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.545303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.545644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.545977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.546454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:39.569741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:39.574090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-96c226a8-2520-46d8-af45-53e2ee684de0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:39.574410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.575473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-96c226a8-2520-46d8-af45-53e2ee684de0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.3719621 Dec 21 03:51:39.587767 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d6e31d31-aafa-4f18-a0b5-d2643cef3fda req-6821518c-8fb5-48fb-81f1-7551713a8a4e tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "DELETE /v2.0/ports/7d0b7a63-470a-45ab-900c-1fd451ed2bd5 HTTP/1.1" status: 204 len: 173 time: 1.1878831 Dec 21 03:51:39.593347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'name': 'network-vif-deleted', 'tag': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:39.612602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-8a97c72f-311a-47ea-90a3-3885bb5f0fd9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/quotas/e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 375 time: 0.0175228 Dec 21 03:51:39.612602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.614148 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-feda8260-e926-417f-a5c9-f81021cfb357" -d '{"events": [{"server_uuid": "f751db3c-17ec-4665-b871-1aeef7c0df0c", "name": "network-vif-deleted", "tag": "7d0b7a63-470a-45ab-900c-1fd451ed2bd5"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:39.700757 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed77f82f-3a35-4b7e-8aa8-dfaff22b6008 x-openstack-request-id: req-ed77f82f-3a35-4b7e-8aa8-dfaff22b6008 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:39.701066 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f751db3c-17ec-4665-b871-1aeef7c0df0c", "name": "network-vif-deleted", "tag": "7d0b7a63-470a-45ab-900c-1fd451ed2bd5", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:39.701314 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ed77f82f-3a35-4b7e-8aa8-dfaff22b6008 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:39.701719 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f751db3c-17ec-4665-b871-1aeef7c0df0c', 'name': 'network-vif-deleted', 'tag': '7d0b7a63-470a-45ab-900c-1fd451ed2bd5', 'status': 'completed', 'code': 200} Dec 21 03:51:39.718208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:39.719552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.736618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.787455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Allocated IP 172.20.0.10 (a0e5eeee-a736-4bd3-bdf6-679e8da99022/0937a3b1-7f54-409b-bba0-29fa72617a82/9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:39.816220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4217706a-3cd7-4f57-b468-f7354a125467 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2067151 Dec 21 03:51:39.821412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=d4a89fe6-e810-43b4-bd73-b205091236af,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:39.955896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port d4a89fe6-e810-43b4-bd73-b205091236af on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:39.974551 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.981516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:39.985343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2def531-4bdb-421d-9e24-5559c2557af1 req-fae252f4-37e1-49e6-9c59-bdedc236d496 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.54 "DELETE /v2.0/ports/d4a89fe6-e810-43b4-bd73-b205091236af HTTP/1.1" status: 204 len: 173 time: 1.9296176 Dec 21 03:51:39.986192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9019203a-40f7-4110-be70-375894886933', 'name': 'network-vif-deleted', 'tag': 'd4a89fe6-e810-43b4-bd73-b205091236af'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:39.998037 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e28e2d4c-3eb6-4af7-90ff-ec35301aadbd" -d '{"events": [{"server_uuid": "9019203a-40f7-4110-be70-375894886933", "name": "network-vif-deleted", "tag": "d4a89fe6-e810-43b4-bd73-b205091236af"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:40.040102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:40.153985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:40.162587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:40.214583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:40.214953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7d0b7a63-470a-45ab-900c-1fd451ed2bd5 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:40.217380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d4a89fe6-e810-43b4-bd73-b205091236af no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:40.223434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0c6c0e2-379e-4b8b-8bdb-5d297c7199f8 req-9711a0fd-3413-41c4-8bb4-c200ca86f2a5 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 210 time: 0.0712795 Dec 21 03:51:40.224165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:40.339748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-112f3bfa-27dc-4bc7-953b-54852de22331 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4440200 Dec 21 03:51:40.351533 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:40.432770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:40.443921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:40.449467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:40.465084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:40.539097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: d4a89fe6-e810-43b4-bd73-b205091236af {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:40.539555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d4a89fe6-e810-43b4-bd73-b205091236af not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:40.553400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:40.603639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event updated for resources: {'Port': ['ID=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:40.645695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00da2de4-558f-4e05-9e80-6655834848a4 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2972672 Dec 21 03:51:40.655072 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2d153aa-8902-4fbd-aebf-a1e9390b93b8 x-openstack-request-id: req-d2d153aa-8902-4fbd-aebf-a1e9390b93b8 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:40.655226 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9019203a-40f7-4110-be70-375894886933", "name": "network-vif-deleted", "tag": "d4a89fe6-e810-43b4-bd73-b205091236af", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:40.655542 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d2d153aa-8902-4fbd-aebf-a1e9390b93b8 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:40.656149 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9019203a-40f7-4110-be70-375894886933', 'name': 'network-vif-deleted', 'tag': 'd4a89fe6-e810-43b4-bd73-b205091236af', 'status': 'completed', 'code': 200} Dec 21 03:51:40.673251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:40.677967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:40.731596 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:40.838713 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-3f3f603d-3a63-487f-9cb3-b506130eb70c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2496998 Dec 21 03:51:40.863009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Request body: {'port': {'device_id': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:41.007162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.140785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c892ff56-7639-498e-a7c9-3ea32ec5bacb req-76771145-f9cd-44d3-8ccf-fda4f6559479 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 210 time: 0.0760820 Dec 21 03:51:41.180303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.301577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be980d05-fea4-40eb-b646-480a58a7e394 req-ecd03625-aff5-471b-ad4a-c85e630e89af tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:41.305351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be980d05-fea4-40eb-b646-480a58a7e394 req-ecd03625-aff5-471b-ad4a-c85e630e89af tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 932 time: 0.1818390 Dec 21 03:51:41.385713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be980d05-fea4-40eb-b646-480a58a7e394 req-1999419d-9277-40bf-b1b0-7584c100c787 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720890 Dec 21 03:51:41.386340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.392904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:41.581113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:41.581730 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.596676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c8d1bde-99a0-4768-ae1c-51bc5eea9718 req-b3678859-a7c8-4c3d-bdf2-2fd9d0a8fdfd tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=9019203a-40f7-4110-be70-375894886933 HTTP/1.1" status: 200 len: 210 time: 0.1177206 Dec 21 03:51:41.651115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Pushing event updated for resources: {'Port': ['ID=24bea13f-7eed-47c1-8222-2eb2fea02484,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:41.657967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:41.667403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.690427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.716857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Transition to ACTIVE for port object 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:41.816086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:41.845728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Network e94928bb-be91-4772-b576-ae2f90f005ad is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:41.849935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:41.954618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Pushing event updated for resources: {'Port': ['ID=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:42.036240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Router cbef927a-234e-4845-b539-e85731a2c3f3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:51:42.092682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Attempting to bind port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:42.093025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Attempting to bind port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:42.093354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Attempting to bind port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:42.099852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:42.100319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Attempting to bind port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:42.106209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:42.106560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:42.106973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Bound using segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:42.107422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Bound port: 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:42.107781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:42.209254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:51:42.221960 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Sync routers for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:51:42.235718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] For port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:42.240301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] For port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:42.248026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-57792075-12ed-4316-9e61-210ba3bc8e36 admin admin] 10.222.0.18 "PUT /v2.0/routers/cbef927a-234e-4845-b539-e85731a2c3f3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8753791 Dec 21 03:51:42.261473 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:51:42.267261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:42.287817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f6a55ea-4242-4309-89a3-24b4f1723d2c req-90a09349-b486-447e-8499-bf9e3aa2f94c tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 210 time: 0.0679979 Dec 21 03:51:42.368443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:42.399346 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:51:42.473374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:42.485076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:42.486640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] 10.222.0.54 "PUT /v2.0/ports/9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc HTTP/1.1" status: 200 len: 1093 time: 1.6294756 Dec 21 03:51:42.489643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'tag': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:42.495119 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355" -d '{"events": [{"name": "network-changed", "server_uuid": "b6364012-fa40-4252-89bc-9c97b109f46b", "tag": "9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:42.556090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcb44c2-d739-493e-a7d4-0edd0147536e service neutron] Pushing event updated for resources: {'Port': ['ID=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:42.614205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45067655-fa02-41ec-8e3f-adc1bf5f2202 req-f3816589-b644-4983-95a4-c8fbe8f40687 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:42.618902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45067655-fa02-41ec-8e3f-adc1bf5f2202 req-f3816589-b644-4983-95a4-c8fbe8f40687 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 944 time: 0.0704064 Dec 21 03:51:42.656790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53196) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:42.725780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45067655-fa02-41ec-8e3f-adc1bf5f2202 req-acad3809-f0ec-46a7-aafa-6b9ccb60d53f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816023 Dec 21 03:51:42.801140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-6821bcac-dbd7-4403-a286-cea565e68ac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:42.802840 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-6821bcac-dbd7-4403-a286-cea565e68ac9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 1096 time: 0.1323900 Dec 21 03:51:42.814146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 2, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:42.820367 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3acd53de-9df7-4417-ad68-d29ca6be6125 x-openstack-request-id: req-3acd53de-9df7-4417-ad68-d29ca6be6125 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:42.824234 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6364012-fa40-4252-89bc-9c97b109f46b", "tag": "9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:42.824234 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3acd53de-9df7-4417-ad68-d29ca6be6125 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:42.824234 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'tag': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc', 'status': 'completed', 'code': 200} Dec 21 03:51:42.869339 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Checking router: cbef927a-234e-4845-b539-e85731a2c3f3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:51:42.870000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Updating router cbef927a-234e-4845-b539-e85731a2c3f3 port 24bea13f-7eed-47c1-8222-2eb2fea02484 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:51:42.904503 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:42.919701 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-9bf0cc61-7ec8-4797-bf2f-e4147421069c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc HTTP/1.1" status: 200 len: 217 time: 0.0768392 Dec 21 03:51:42.925703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25fa954a-2751-4b4e-91db-f7c609858f30 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.143406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7b3c6a7e-0c82-4073-b2f0-adda0d4cf977 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:43.145539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25fa954a-2751-4b4e-91db-f7c609858f30 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.151135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7b3c6a7e-0c82-4073-b2f0-adda0d4cf977 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 820 time: 0.2163496 Dec 21 03:51:43.159867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-e7915cda-4fe5-4d9f-8e14-69ae2655cca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:43.162296 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-e7915cda-4fe5-4d9f-8e14-69ae2655cca8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.2335877 Dec 21 03:51:43.169051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-57911bde-853f-404d-a00d-0c25d0f47f82 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/quotas/920e98327f8340b0966241ad0871434f HTTP/1.1" status: 200 len: 375 time: 0.0165546 Dec 21 03:51:43.244005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-de6371ee-5ff0-4dd4-9a45-b16e0088d44f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0735953 Dec 21 03:51:43.245001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25fa954a-2751-4b4e-91db-f7c609858f30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.280982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-ce52899e-dad5-4019-9290-8843162fb8bf service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1057248 Dec 21 03:51:43.283896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25fa954a-2751-4b4e-91db-f7c609858f30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=876f398d-d4ae-4b01-b563-a3634224e221,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:43.403764 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-25fa954a-2751-4b4e-91db-f7c609858f30 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=dd4af58bfed64e02ac1cf26db1ee2db8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7447100 Dec 21 03:51:43.406452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53230) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:43.408307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-b106d5f5-253f-46de-b94a-ce4787c3bafc service neutron] 10.222.0.18 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1625969 Dec 21 03:51:43.488957 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-4e5bcbe5-67d1-4cb3-a94c-3c1a899a2f23 service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1898880 Dec 21 03:51:43.489683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d728e5-666c-4c09-90e8-7bc5365ae0d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.516723 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.519914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d728e5-666c-4c09-90e8-7bc5365ae0d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.602689 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.663701 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f5d06f2d-369e-40b5-beaf-98967b7a0a3c req-fb172880-5590-485e-b47b-cfcb7bedee17 service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1319411 Dec 21 03:51:43.722436 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Pushing event updated for resources: {'Port': ['ID=24bea13f-7eed-47c1-8222-2eb2fea02484,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:43.754143 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.754772 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.755383 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.756150 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.756657 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.757200 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.757692 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.758370 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.759302 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.759814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.760318 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.760835 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.761418 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:43.766024 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d728e5-666c-4c09-90e8-7bc5365ae0d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.769826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d728e5-666c-4c09-90e8-7bc5365ae0d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.779618 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f9d728e5-666c-4c09-90e8-7bc5365ae0d7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/876f398d-d4ae-4b01-b563-a3634224e221 HTTP/1.1" status: 204 len: 168 time: 0.3659909 Dec 21 03:51:43.786169 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Attempting to bind port 24bea13f-7eed-47c1-8222-2eb2fea02484 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:43.787013 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Attempting to bind port 24bea13f-7eed-47c1-8222-2eb2fea02484 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:43.787558 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Attempting to bind port 24bea13f-7eed-47c1-8222-2eb2fea02484 on network e94928bb-be91-4772-b576-ae2f90f005ad {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:43.795275 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:43.795945 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Checking segment: {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:43.796671 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.797351 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Bound using segment: {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:43.798008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Bound port: 24bea13f-7eed-47c1-8222-2eb2fea02484, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:43.798572 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:43.803243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d728e5-666c-4c09-90e8-7bc5365ae0d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=876f398d-d4ae-4b01-b563-a3634224e221,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:43.935706 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] For port 24bea13f-7eed-47c1-8222-2eb2fea02484, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:43.956234 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] For port 24bea13f-7eed-47c1-8222-2eb2fea02484, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24bea13f-7eed-47c1-8222-2eb2fea02484,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:43.957110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-02149fd8-14c4-4d00-9c83-2a636f66a050 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:43.959215 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-02149fd8-14c4-4d00-9c83-2a636f66a050 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 1096 time: 0.0593977 Dec 21 03:51:44.001113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7cf6e30a-f3ad-4ffb-a7cc-0e216407531a service neutron] 10.222.0.18 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5919330 Dec 21 03:51:44.047249 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:44.063670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0495cab-a21d-4301-b19c-98c4089df522 req-346c60fa-de12-4d38-b99f-c43b2cf689a0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 210 time: 0.0404308 Dec 21 03:51:44.167043 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:51:44.172173 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:44.172173 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f950761a-6f50-4039-b441-4536b9a020fd None None] Pushing event updated for resources: {'Port': ['ID=24bea13f-7eed-47c1-8222-2eb2fea02484,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:44.238138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48539d77-6b60-4168-9c90-ccf2f9ac7e68 req-8aef3019-dbb5-4689-bb69-fb5efaba08f3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:44.246296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48539d77-6b60-4168-9c90-ccf2f9ac7e68 req-8aef3019-dbb5-4689-bb69-fb5efaba08f3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 944 time: 0.0759201 Dec 21 03:51:44.305875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-adc2bc0b-5337-4da6-8fb0-e8756ee5adf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:44.307393 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-adc2bc0b-5337-4da6-8fb0-e8756ee5adf8 service neutron] 10.222.0.54 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.3294675 Dec 21 03:51:44.382660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48539d77-6b60-4168-9c90-ccf2f9ac7e68 req-bfd723b0-f574-4c6e-986c-d35acf1b6a26 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1325729 Dec 21 03:51:44.439130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-4e5e44d7-0df1-464f-9f56-2182df13dde2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc HTTP/1.1" status: 200 len: 217 time: 0.1172149 Dec 21 03:51:44.534619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-934f458f-4b97-4bda-b0eb-d57f0a678bbf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:44.534619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-934f458f-4b97-4bda-b0eb-d57f0a678bbf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.3677385 Dec 21 03:51:44.551973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Request body: {'port': {'device_id': '2876a6d6-9052-40da-a242-e2969b6d5399', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'admin_state_up': True, 'tenant_id': 'e49c9575c393446a904ba5840d68746b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:44.625632 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:51:44.708288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-930ab58b-c200-476f-929f-74418e850e67 req-1ea563a7-89b6-496b-beda-144454c8c691 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:44.713690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-930ab58b-c200-476f-929f-74418e850e67 req-1ea563a7-89b6-496b-beda-144454c8c691 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 950 time: 0.1229784 Dec 21 03:51:44.743128 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:51:44.778344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-b4071105-d33a-4e41-83c2-2324670292d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:44.780574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-b4071105-d33a-4e41-83c2-2324670292d4 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.3338823 Dec 21 03:51:44.810304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-930ab58b-c200-476f-929f-74418e850e67 req-7c911813-4bc1-4c40-b639-f9727d95e82a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891531 Dec 21 03:51:44.852562 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-4c542083-0a5a-42a0-ad1a-231546c6f171 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0626082 Dec 21 03:51:44.855238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Made reservation on behalf of e49c9575c393446a904ba5840d68746b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:44.860972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:44.865641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53262) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:44.890620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4c903d6-19be-4027-871b-b2f52c1fa57a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:44.952869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fefb6d57-26e3-4645-ab42-f90734707299 req-1a53747e-c0e5-4e35-97e2-82af8ead39e3 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 210 time: 0.0627701 Dec 21 03:51:45.054691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4c903d6-19be-4027-871b-b2f52c1fa57a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.076949 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:43Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:51:45.099431 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-d0775a67-5076-413e-a885-344140ea813b service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2346263 Dec 21 03:51:45.108494 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7c79f21-1e7c-4727-8ccf-de5969c28373 None None] The sync data for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 is: [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:43Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:51:45.225129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-908d202a-0258-4d3a-b430-05eb86ae1379 req-51542c88-2475-43e9-813f-4be1d78f4124 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 210 time: 0.0713410 Dec 21 03:51:45.235739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4c903d6-19be-4027-871b-b2f52c1fa57a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.286424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Allocated IP 172.20.0.10 (5fd01e07-75a4-4745-ad05-8ade1a021605/13099c8a-54c1-41b2-a4f4-664d17e69495/425b1a38-084b-43fc-ab16-7a0f86f2eb65) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:45.324325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f4c903d6-19be-4027-871b-b2f52c1fa57a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f2e4de0914ab4c8e90bba5602352fc67&name=default HTTP/1.1" status: 200 len: 2999 time: 0.4566748 Dec 21 03:51:45.331191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53266) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:45.343853 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d9c43a79-bfb0-4f8b-9169-7dcee2c90355 req-40e9516f-9014-4610-90b6-690e9e3526aa service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2366095 Dec 21 03:51:45.465880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c903d6-19be-4027-871b-b2f52c1fa57a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=146a4408-826b-4df4-8745-4c84377eaec7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:45.523944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bea13f-7eed-47c1-8222-2eb2fea02484 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:45.593148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 24bea13f-7eed-47c1-8222-2eb2fea02484 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:45.607033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.609814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.706318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-346b4959-9717-4d2d-be7a-d3b474321e0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.753110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.765991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16221e9e-5e79-4f6c-a6e6-bd45458b3c3e req-38ce0ec2-30ea-4db3-b345-cb06bd351d51 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:45.774305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.810439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16221e9e-5e79-4f6c-a6e6-bd45458b3c3e req-38ce0ec2-30ea-4db3-b345-cb06bd351d51 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 944 time: 0.2294035 Dec 21 03:51:45.825838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-346b4959-9717-4d2d-be7a-d3b474321e0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.827827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 24bea13f-7eed-47c1-8222-2eb2fea02484, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24bea13f-7eed-47c1-8222-2eb2fea02484,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:45.887846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:45.915855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:45.921165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:45.927864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:45.932751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16221e9e-5e79-4f6c-a6e6-bd45458b3c3e req-1cd47e2e-f4d0-453e-bb50-281fa51515b6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150444 Dec 21 03:51:45.957231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:46.056976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-d0ddbd10-1395-4adc-8bff-c37fe9984e5a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:46.064273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-d0ddbd10-1395-4adc-8bff-c37fe9984e5a tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 950 time: 0.1256065 Dec 21 03:51:46.088156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-346b4959-9717-4d2d-be7a-d3b474321e0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.094309 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-346b4959-9717-4d2d-be7a-d3b474321e0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.095592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=24bea13f-7eed-47c1-8222-2eb2fea02484,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:46.099420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-346b4959-9717-4d2d-be7a-d3b474321e0f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/146a4408-826b-4df4-8745-4c84377eaec7 HTTP/1.1" status: 204 len: 168 time: 0.7656484 Dec 21 03:51:46.123501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:46.124439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.139779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.140131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.145690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.147543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.149790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.150149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.150497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:46.179053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-346b4959-9717-4d2d-be7a-d3b474321e0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=146a4408-826b-4df4-8745-4c84377eaec7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:46.250786 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-4d3febb2-c885-49b5-b667-60d32a675d61 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7089334 Dec 21 03:51:46.251434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a77408c2-296c-4f08-b8b8-51e9095cb480 req-1e6d732a-7059-4d11-bec0-0707b72fb8fd tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 210 time: 0.0861614 Dec 21 03:51:46.273687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Request body: {'port': {'device_id': '2876a6d6-9052-40da-a242-e2969b6d5399', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:46.364549 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.384652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c65a5df4-abb0-4ae7-a3e2-72b4adafd429 req-b80d8acc-e181-4407-9f6d-a5c5808087d2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:46.393097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c65a5df4-abb0-4ae7-a3e2-72b4adafd429 req-b80d8acc-e181-4407-9f6d-a5c5808087d2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 950 time: 0.2923102 Dec 21 03:51:46.553381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c65a5df4-abb0-4ae7-a3e2-72b4adafd429 req-6d8969a0-4c92-4d17-8222-e4ca66907f99 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/security-groups?id=8125f37d-6245-40f4-a216-738e643d64b7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1592534 Dec 21 03:51:46.585976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Deleting port 284452f9-cda6-4672-8b3a-5f31dab9e362 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:46.586803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.604996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64c9744-8ce5-4440-ba34-c4522785e52d req-df5f7c30-7d66-4995-9d46-296d774d9279 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:46.606728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d64c9744-8ce5-4440-ba34-c4522785e52d req-df5f7c30-7d66-4995-9d46-296d774d9279 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 932 time: 0.2323864 Dec 21 03:51:46.839434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d64c9744-8ce5-4440-ba34-c4522785e52d req-028e75f5-ab37-4ba7-ab20-7cc2b9a65980 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066754 Dec 21 03:51:46.839434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] For port 284452f9-cda6-4672-8b3a-5f31dab9e362, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=284452f9-cda6-4672-8b3a-5f31dab9e362,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:46.839434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.839434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Calling delete_port for 284452f9-cda6-4672-8b3a-5f31dab9e362 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:46.859698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 425b1a38-084b-43fc-ab16-7a0f86f2eb65 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:46.868414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:46.882481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Transition to ACTIVE for port object 425b1a38-084b-43fc-ab16-7a0f86f2eb65 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:47.087988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8003165f-88da-4c53-924b-91ddac6cb392 req-3d9d69d4-01de-4371-87ee-38b724e252c8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:47.092054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8003165f-88da-4c53-924b-91ddac6cb392 req-3d9d69d4-01de-4371-87ee-38b724e252c8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 944 time: 0.0822675 Dec 21 03:51:47.156841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.176764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8003165f-88da-4c53-924b-91ddac6cb392 req-9783ec36-8530-4991-83c8-9374e19af50d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837379 Dec 21 03:51:47.178451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.220180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['284452f9-cda6-4672-8b3a-5f31dab9e362'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:47.276155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Pushing event deleted for resources: {'Port': ['ID=284452f9-cda6-4672-8b3a-5f31dab9e362,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:47.293942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:47.362122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] No DVR routers for this DVR port 284452f9-cda6-4672-8b3a-5f31dab9e362 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:47.364530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.370708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b6d0324-6729-49dc-af57-40e67abd8e5a req-c54f2b42-960e-4b75-b567-e8b0565de642 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.31 "DELETE /v2.0/ports/284452f9-cda6-4672-8b3a-5f31dab9e362 HTTP/1.1" status: 204 len: 173 time: 1.3024709 Dec 21 03:51:47.371388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'name': 'network-vif-deleted', 'tag': '284452f9-cda6-4672-8b3a-5f31dab9e362'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:47.377604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:47.378200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:47.381074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:47.384845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:47.390431 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5bde272f-961f-40d7-8832-72a686de7716" -d '{"events": [{"server_uuid": "7912fa8b-d98e-4443-9bdc-d9159d1af766", "name": "network-vif-deleted", "tag": "284452f9-cda6-4672-8b3a-5f31dab9e362"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:47.394233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:47.401655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:47.402016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:47.403709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:47.403709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Bound port: 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:47.403967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.410372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bea13f-7eed-47c1-8222-2eb2fea02484 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:47.502275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 24bea13f-7eed-47c1-8222-2eb2fea02484 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:47.502774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.503513 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fa14184-0726-4dce-96bd-35f9578d62f1 x-openstack-request-id: req-1fa14184-0726-4dce-96bd-35f9578d62f1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:47.504020 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7912fa8b-d98e-4443-9bdc-d9159d1af766", "name": "network-vif-deleted", "tag": "284452f9-cda6-4672-8b3a-5f31dab9e362", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:47.504452 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1fa14184-0726-4dce-96bd-35f9578d62f1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:47.505032 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7912fa8b-d98e-4443-9bdc-d9159d1af766', 'name': 'network-vif-deleted', 'tag': '284452f9-cda6-4672-8b3a-5f31dab9e362', 'status': 'completed', 'code': 200} Dec 21 03:51:47.519365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72d03678-18da-44cb-b3ae-254932d9753f req-bbfa0b1c-566c-4679-a21c-751c3c2081cc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 210 time: 0.1243021 Dec 21 03:51:47.627388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:47.645033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:47.738091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a331b5fe-a1da-4c40-a57f-74c44dceb398 req-e16f74ca-28fd-4f88-8cc2-1abca11179ea tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 210 time: 0.0417833 Dec 21 03:51:47.756370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.814279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:47.814279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:47.814279 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] 10.222.0.31 "PUT /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 1093 time: 1.5447154 Dec 21 03:51:47.820760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:47.825919 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9001ce28-8526-4d43-a73a-3d789184ec93" -d '{"events": [{"name": "network-changed", "server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:47.910683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e0f40e-62b2-4847-9778-0b27d63a4c51 service neutron] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:47.943509 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c81da56-5932-4059-90e6-c3d5273986c8 x-openstack-request-id: req-0c81da56-5932-4059-90e6-c3d5273986c8 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:47.944013 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:47.944643 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0c81da56-5932-4059-90e6-c3d5273986c8 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:47.945498 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'status': 'completed', 'code': 200} Dec 21 03:51:48.101888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eacf2b5-b3a7-4c3c-8226-dbf464ce7812 req-0405978b-27b9-4cec-bd5d-e06483a76b78 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.104493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9001ce28-8526-4d43-a73a-3d789184ec93 req-dc8da84f-608f-4f9f-a736-ec79ec4d6712 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.107572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5eacf2b5-b3a7-4c3c-8226-dbf464ce7812 req-0405978b-27b9-4cec-bd5d-e06483a76b78 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0957425 Dec 21 03:51:48.111253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9001ce28-8526-4d43-a73a-3d789184ec93 req-dc8da84f-608f-4f9f-a736-ec79ec4d6712 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1096 time: 0.0992591 Dec 21 03:51:48.162600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5eacf2b5-b3a7-4c3c-8226-dbf464ce7812 req-4e87cd80-0a23-4ffd-b233-ef9aeff140ee tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526540 Dec 21 03:51:48.172071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:48.282471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9001ce28-8526-4d43-a73a-3d789184ec93 req-12074216-f905-4b7a-b5ce-e75a2706a877 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.284337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9001ce28-8526-4d43-a73a-3d789184ec93 req-12074216-f905-4b7a-b5ce-e75a2706a877 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=e49c9575c393446a904ba5840d68746b&shared=False HTTP/1.1" status: 200 len: 908 time: 0.1571414 Dec 21 03:51:48.351957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:48.361600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604aa92e-100e-45d2-8685-5004f188c9d3 req-131aef45-9142-4f88-b857-3943048355da tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.363617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-604aa92e-100e-45d2-8685-5004f188c9d3 req-131aef45-9142-4f88-b857-3943048355da tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 944 time: 0.0953748 Dec 21 03:51:48.381709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc', 'mac_address': 'fa:16:3e:b9:0e:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:48.418811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-604aa92e-100e-45d2-8685-5004f188c9d3 req-caa6a202-a164-480f-9c40-ba9826209792 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480423 Dec 21 03:51:48.490675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-a3a4d4e6-a50a-4aa0-a028-d0e3f7f18140 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.492178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-a3a4d4e6-a50a-4aa0-a028-d0e3f7f18140 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 820 time: 0.2379949 Dec 21 03:51:48.493324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9001ce28-8526-4d43-a73a-3d789184ec93 req-840812e2-414b-498c-b84f-31727a72c399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.494808 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9001ce28-8526-4d43-a73a-3d789184ec93 req-840812e2-414b-498c-b84f-31727a72c399 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2010174 Dec 21 03:51:48.513669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'port': {'device_id': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'admin_state_up': True, 'tenant_id': '920e98327f8340b0966241ad0871434f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:48.552705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:48.574220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:48.606873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:48.641280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f8b8360-2009-4974-a524-788a7a2c2974 req-2215b5c3-99f7-4e9f-a182-a06025c1f81b tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 210 time: 0.0408158 Dec 21 03:51:48.658628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-a3e415fb-2bab-4fc9-b236-3cb67ae7e359 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.660505 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-a3e415fb-2bab-4fc9-b236-3cb67ae7e359 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1096 time: 0.0708184 Dec 21 03:51:48.694623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:48.734586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-b71fd585-3dd9-45e0-b9de-c74e80f54efe service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 217 time: 0.0480368 Dec 21 03:51:48.736822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:48.814076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-74ed206e-5600-4e65-a347-f67efbf3078b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:48.815682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-74ed206e-5600-4e65-a347-f67efbf3078b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0626433 Dec 21 03:51:48.836605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Made reservation on behalf of 920e98327f8340b0966241ad0871434f for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:51:48.841157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:48.858254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-800572de-2c71-448b-ba20-cc2d6e2d6bda req-0525fbec-041f-400d-9085-f879d3a6a4f2 tempest-ServersOnMultiNodesTest-37664161 tempest-ServersOnMultiNodesTest-37664161-project] 10.222.0.18 "GET /v2.0/ports?device_id=7912fa8b-d98e-4443-9bdc-d9159d1af766 HTTP/1.1" status: 200 len: 210 time: 0.0355427 Dec 21 03:51:48.868423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-ea2c5e64-ff25-4c37-9e35-6369080f675b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0438743 Dec 21 03:51:49.057879 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-20749907-0531-4c75-9f56-14e0828fadec service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1753592 Dec 21 03:51:49.070437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Allocated IP 172.20.0.9 (e94928bb-be91-4772-b576-ae2f90f005ad/f8a63e48-36eb-4a7d-be87-03acc85470f7/0c5b3c7d-3a97-48ca-b6c5-74849173c787) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:51:49.071527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:49.333326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:49.337246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53eeea47-5d9a-4fef-8a2b-46ea3cd26d9e req-b3b675ab-b3b6-4755-a236-eecdbb013a31 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:49.345687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53eeea47-5d9a-4fef-8a2b-46ea3cd26d9e req-b3b675ab-b3b6-4755-a236-eecdbb013a31 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0804811 Dec 21 03:51:49.354055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-35b2a5a9-f3c1-47a9-b886-1872376e686e req-19c2ea4a-ab95-4746-be6a-9af1ab54824f service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2286611 Dec 21 03:51:49.410914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53eeea47-5d9a-4fef-8a2b-46ea3cd26d9e req-1018b093-7b7c-4ebe-95a3-34f13e489d4c tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644443 Dec 21 03:51:49.508088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1232842-5f26-4bc8-b834-b1f94f9a3350 req-ec4597f4-1e0d-47be-bf21-d2e8928bbdad tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:49.509675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1232842-5f26-4bc8-b834-b1f94f9a3350 req-ec4597f4-1e0d-47be-bf21-d2e8928bbdad tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 950 time: 0.0583677 Dec 21 03:51:49.517358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:49.567935 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Network e94928bb-be91-4772-b576-ae2f90f005ad is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:51:49.571000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:51:49.575357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:51:49.580721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cbffad-d90d-4d42-b9f8-e03ea0381449 req-73c470ab-0706-4a6c-b4db-a1e8291b90a1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:49.582681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67cbffad-d90d-4d42-b9f8-e03ea0381449 req-73c470ab-0706-4a6c-b4db-a1e8291b90a1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 945 time: 0.0914540 Dec 21 03:51:49.603510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:49.610395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1232842-5f26-4bc8-b834-b1f94f9a3350 req-511e2a52-af66-4da1-be0a-cd555d633bc6 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782368 Dec 21 03:51:49.644693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67cbffad-d90d-4d42-b9f8-e03ea0381449 req-bb7190ea-d8fe-4e5a-baa0-b5a93d599cd4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539947 Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.651454 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:49.655636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:49.765347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b40c3e6-923b-4cc5-98f3-d61bbba2ba2e req-807017b4-620b-45a9-9e1b-3a04625f7fe0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:49.766740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b40c3e6-923b-4cc5-98f3-d61bbba2ba2e req-807017b4-620b-45a9-9e1b-3a04625f7fe0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 931 time: 0.0498021 Dec 21 03:51:49.793735 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7d7d703b-f08c-4e36-91d7-001c6f660709 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2846875 Dec 21 03:51:49.802052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3ae3b944-3dcc-4eb3-8076-d1572211431a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:49.807118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 284452f9-cda6-4672-8b3a-5f31dab9e362 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:49.816233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Request body: {'port': {'device_id': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:51:49.828206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b40c3e6-923b-4cc5-98f3-d61bbba2ba2e req-942e8f28-e8cb-424e-ae88-2276c3131807 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549548 Dec 21 03:51:49.833096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 284452f9-cda6-4672-8b3a-5f31dab9e362 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:49.833593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 284452f9-cda6-4672-8b3a-5f31dab9e362 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:49.889966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.171856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:50.182126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0c5b3c7d-3a97-48ca-b6c5-74849173c787 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:50.190970 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.209365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Transition to ACTIVE for port object 0c5b3c7d-3a97-48ca-b6c5-74849173c787 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:51:50.293628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.339362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:50.345007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:50.345670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.351735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:50.423964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Attempting to bind port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:51:50.424417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Attempting to bind port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:51:50.424758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Attempting to bind port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 on network e94928bb-be91-4772-b576-ae2f90f005ad {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:50.429758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 on network e94928bb-be91-4772-b576-ae2f90f005ad not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:51:50.435157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Attempting to bind port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 on network e94928bb-be91-4772-b576-ae2f90f005ad {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:51:50.437401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:51:50.437747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Checking segment: {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:51:50.438136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Bound using segment: {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:51:50.438558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Bound port: 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2a112885-d444-478f-82ef-20aafe136b97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:51:50.439060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.474721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.509395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:50.512754 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c94447bd-933d-4555-8bc0-834b47961395" -d '{"events": [{"server_uuid": "b6364012-fa40-4252-89bc-9c97b109f46b", "name": "network-vif-plugged", "status": "completed", "tag": "9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:50.520408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:51:50.526342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53472) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:50.529687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:50.534865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:51:50.563794 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-140825a0-1131-424a-81d1-60ce47da9290 x-openstack-request-id: req-140825a0-1131-424a-81d1-60ce47da9290 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:50.564432 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6364012-fa40-4252-89bc-9c97b109f46b", "name": "network-vif-plugged", "status": "completed", "tag": "9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:50.564848 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-140825a0-1131-424a-81d1-60ce47da9290 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:50.565414 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc', 'code': 200} Dec 21 03:51:50.582825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888256e8-cc32-4c70-bb6f-8eefea9ae18f req-d35216d5-b9ca-406c-94d3-94d979c3d0e7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:50.591191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-888256e8-cc32-4c70-bb6f-8eefea9ae18f req-d35216d5-b9ca-406c-94d3-94d979c3d0e7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0692246 Dec 21 03:51:50.636727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.649049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.686301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-888256e8-cc32-4c70-bb6f-8eefea9ae18f req-633fa573-e802-4662-a928-b6bd3517d07b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948830 Dec 21 03:51:50.702206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:50.702909 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:50.704477 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] 10.222.0.54 "PUT /v2.0/ports/0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 1092 time: 0.8940659 Dec 21 03:51:50.707207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:50.709683 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-077c9280-b601-4eb6-b35b-e3122cc6eb2d" -d '{"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:50.736050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:50.762262 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d45851-9084-4738-ac89-da46189eb3f5 service neutron] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:50.775422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85a0ba9-5547-48bf-9d1e-bf802d5b397e req-2f10c74d-73bb-4732-ac90-fc10881e5a10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:50.776912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b85a0ba9-5547-48bf-9d1e-bf802d5b397e req-2f10c74d-73bb-4732-ac90-fc10881e5a10 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 1098 time: 0.0810742 Dec 21 03:51:50.782717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b37df070-bbff-4c66-99b3-a07034402edc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9839aab3796944fe8a09f1cfbd7edf8b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2517412 Dec 21 03:51:50.783160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:50.804054 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01d82a53-1411-4ba4-9e17-109a57d9b371 x-openstack-request-id: req-01d82a53-1411-4ba4-9e17-109a57d9b371 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:50.804367 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:50.804626 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-01d82a53-1411-4ba4-9e17-109a57d9b371 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:50.805278 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'status': 'completed', 'code': 200} Dec 21 03:51:50.872813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7240199d-3813-4744-bdd8-364eaf5ff016 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:50.875084 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7240199d-3813-4744-bdd8-364eaf5ff016 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1095 time: 0.0515580 Dec 21 03:51:50.899589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b85a0ba9-5547-48bf-9d1e-bf802d5b397e req-85a80d58-37c8-4815-b89c-34a38ad47a99 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138926 Dec 21 03:51:50.915620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77751271-1b8a-44fc-9fb6-6aeabecfbcd4 req-e13e0eb5-fccb-48a2-9bf9-ee398ea8aa73 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:50.923977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77751271-1b8a-44fc-9fb6-6aeabecfbcd4 req-e13e0eb5-fccb-48a2-9bf9-ee398ea8aa73 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 946 time: 0.1108365 Dec 21 03:51:51.029716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77751271-1b8a-44fc-9fb6-6aeabecfbcd4 req-b36af354-f4bd-4d15-9867-5d8f92bb267d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1047578 Dec 21 03:51:51.031803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:51.062226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435c48ab-ade2-42e3-93d2-fff605c1459c req-65336eb9-fc75-4c2f-8f8a-a9da0b1ba1b9 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:51.069783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-435c48ab-ade2-42e3-93d2-fff605c1459c req-65336eb9-fc75-4c2f-8f8a-a9da0b1ba1b9 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 943 time: 0.1178904 Dec 21 03:51:51.088228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:51.150473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-435c48ab-ade2-42e3-93d2-fff605c1459c req-e15a721b-1fd3-4884-918c-949f07838aa2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797694 Dec 21 03:51:51.236647 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:51.237172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-7ffd6182-08a8-4aff-9886-35c3832915ff service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.3482280 Dec 21 03:51:51.239861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:51.243377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8125f37d-6245-40f4-a216-738e643d64b7 HTTP/1.1" status: 204 len: 168 time: 0.4567692 Dec 21 03:51:51.262192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8125f37d-6245-40f4-a216-738e643d64b7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:51.279251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.280092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.281044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.281943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.282867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.283696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.284007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.288308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.289719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.290156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.292814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.293893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.294263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89a6bac5-bb41-4315-86fe-aad631c0b621 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:51:51.315891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-2646a08c-29a4-4c61-a7f1-8ebc4c9d2868 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:51.317489 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-2646a08c-29a4-4c61-a7f1-8ebc4c9d2868 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.0614433 Dec 21 03:51:51.355401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-14f82794-14fc-4c6f-b834-b17706c27a38 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278175 Dec 21 03:51:51.452435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-78f8046a-080c-4efc-9152-57176b9934dc service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897605 Dec 21 03:51:51.548401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f001eec0-9f66-416d-881d-0249fe7c81b7 req-4ac341d0-6d84-4270-bc24-7fab6aa4db0b service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876553 Dec 21 03:51:51.804261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d0b790-6b11-4d5c-80c4-b0bfb1d6ca6b req-1df7e217-a0b6-4763-b8b9-3f7ebeaff73a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:51.805697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0d0b790-6b11-4d5c-80c4-b0bfb1d6ca6b req-1df7e217-a0b6-4763-b8b9-3f7ebeaff73a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0566363 Dec 21 03:51:51.836292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-432182f9-231b-4589-a521-74addebb1718 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:51.838914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-432182f9-231b-4589-a521-74addebb1718 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1095 time: 0.0429168 Dec 21 03:51:51.862052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0d0b790-6b11-4d5c-80c4-b0bfb1d6ca6b req-3bddd385-9081-4d79-8b1d-92c4c7333809 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492282 Dec 21 03:51:51.948075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-f948410a-1b21-470b-93b1-42b3f2cd6a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:51.950109 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-f948410a-1b21-470b-93b1-42b3f2cd6a7b service neutron] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.1034288 Dec 21 03:51:51.998199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53538) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:51.999907 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-d31ef246-eb2e-4d34-855f-15d8a3520d45 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.0413010 Dec 21 03:51:52.046739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e493aaf6-4035-49b5-a4ca-b694eff01d40 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a48bea01de1f4d7b8e162f33874a4595&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0449500 Dec 21 03:51:52.047236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53540) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:52.064214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-0d5344b6-8226-4b58-88fc-272ecb84c1f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:52.065322 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-0d5344b6-8226-4b58-88fc-272ecb84c1f1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.0507715 Dec 21 03:51:52.101897 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-51ebbfbe-09ff-4eee-88bf-9b5ca6f0679c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0259774 Dec 21 03:51:52.103971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-66013b01-78d4-446a-ba26-29cfccfd8ade admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.138098 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-66013b01-78d4-446a-ba26-29cfccfd8ade admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.158149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30c14d60-16a8-4ee2-80e4-5aff1a3207ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.204982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388c7939-1d62-46e0-8bca-c2d6589423a3 req-3a4bb97f-ae40-4d2a-b35a-5841254678d8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:52.206600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-388c7939-1d62-46e0-8bca-c2d6589423a3 req-3a4bb97f-ae40-4d2a-b35a-5841254678d8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 946 time: 0.0823066 Dec 21 03:51:52.219685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-5514a33c-f6eb-4b90-8b83-897b4f60e903 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1055367 Dec 21 03:51:52.270585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-388c7939-1d62-46e0-8bca-c2d6589423a3 req-2a7f3e3a-4b50-4065-98ba-4cbf14b3f9c4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576763 Dec 21 03:51:52.315653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0992fb-b35d-4055-bd3f-76973d013051 req-b4351aee-9a6c-411c-8bb8-71c1a266a53c tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:52.317235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f0992fb-b35d-4055-bd3f-76973d013051 req-b4351aee-9a6c-411c-8bb8-71c1a266a53c tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 943 time: 0.0636199 Dec 21 03:51:52.321894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-66013b01-78d4-446a-ba26-29cfccfd8ade admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.326045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-66013b01-78d4-446a-ba26-29cfccfd8ade admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.327513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-66013b01-78d4-446a-ba26-29cfccfd8ade admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/14d1e1d2-7258-40a7-a152-58d70f1c226c HTTP/1.1" status: 204 len: 168 time: 0.2793200 Dec 21 03:51:52.352631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66013b01-78d4-446a-ba26-29cfccfd8ade admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14d1e1d2-7258-40a7-a152-58d70f1c226c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:52.361046 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-077c9280-b601-4eb6-b35b-e3122cc6eb2d req-23bf42a0-6b9b-44c9-ad08-6eb4ea711c15 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253285 Dec 21 03:51:52.431771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f0992fb-b35d-4055-bd3f-76973d013051 req-4d23dc13-eb34-467c-8dee-bd151e85c8d2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788891 Dec 21 03:51:52.483713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53560) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:52.545425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.622388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c063f0ef-edcd-4147-b6f2-dd09c7eb1265 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.695481 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c063f0ef-edcd-4147-b6f2-dd09c7eb1265 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.761161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c063f0ef-edcd-4147-b6f2-dd09c7eb1265 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.803013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c063f0ef-edcd-4147-b6f2-dd09c7eb1265 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4f13f28fc0ec43d9a1df29d017336f3e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3181753 Dec 21 03:51:52.803968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c063f0ef-edcd-4147-b6f2-dd09c7eb1265 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1578ec80-f1e0-4236-9385-9ecdb580800e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:52.805785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:52.855125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfe869eb-043b-461f-9dae-937839e6081b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.875806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfe869eb-043b-461f-9dae-937839e6081b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.990789 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfe869eb-043b-461f-9dae-937839e6081b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.992755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0253a6fd-aa20-4976-b24f-8b356b7dc8f5 req-2b69bfd9-d22a-4efb-a3fe-d4d6dfa40316 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:52.994053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfe869eb-043b-461f-9dae-937839e6081b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:52.994243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0253a6fd-aa20-4976-b24f-8b356b7dc8f5 req-2b69bfd9-d22a-4efb-a3fe-d4d6dfa40316 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0505040 Dec 21 03:51:52.995761 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfe869eb-043b-461f-9dae-937839e6081b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1578ec80-f1e0-4236-9385-9ecdb580800e HTTP/1.1" status: 204 len: 168 time: 0.1888845 Dec 21 03:51:53.006113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe869eb-043b-461f-9dae-937839e6081b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1578ec80-f1e0-4236-9385-9ecdb580800e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:53.049880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0253a6fd-aa20-4976-b24f-8b356b7dc8f5 req-5e6c37d3-2ce7-4a1d-9ad8-685b493d4a51 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450654 Dec 21 03:51:53.145623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:53.391894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e5b57c-1b70-4561-9fe3-99893728f6cf req-1f78b25a-49a8-4368-a835-dc3a74258363 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:53.393380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61e5b57c-1b70-4561-9fe3-99893728f6cf req-1f78b25a-49a8-4368-a835-dc3a74258363 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 946 time: 0.0496914 Dec 21 03:51:53.443620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61e5b57c-1b70-4561-9fe3-99893728f6cf req-a162d9ed-79bb-4b9e-9f2c-7277064084c3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440631 Dec 21 03:51:53.563360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3322ce90-9a96-455d-93f8-41f6b38a2b3b req-9fe34587-fa76-47e7-81fb-e6e430b85339 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:53.565649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3322ce90-9a96-455d-93f8-41f6b38a2b3b req-9fe34587-fa76-47e7-81fb-e6e430b85339 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 943 time: 0.0596139 Dec 21 03:51:53.578192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53606) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:53.591787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d950b1e-26d3-4e57-8c59-a8518ceb1ce9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:53.637286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3322ce90-9a96-455d-93f8-41f6b38a2b3b req-517ea82b-9b87-41d1-b46a-98ac6e1722bd tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632167 Dec 21 03:51:53.688869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d950b1e-26d3-4e57-8c59-a8518ceb1ce9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:53.783908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d950b1e-26d3-4e57-8c59-a8518ceb1ce9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:53.819940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:53.823212 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d950b1e-26d3-4e57-8c59-a8518ceb1ce9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7671286bd9c042fda8e2ba9336de8056&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2441854 Dec 21 03:51:53.824683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d950b1e-26d3-4e57-8c59-a8518ceb1ce9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9bd94821-9663-42b4-b478-7fc2c9277fc1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:53.825948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53618) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:53.839130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:53.885367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03c674f0-b27a-4396-bb35-a11bc0814b92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:53.916367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03c674f0-b27a-4396-bb35-a11bc0814b92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.004643 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.012822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:54.021433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78792c1-ca99-4fa3-b7b6-378a92044414 req-6d2760c0-1ea6-4753-addb-72728fda40e0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:54.022921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a78792c1-ca99-4fa3-b7b6-378a92044414 req-6d2760c0-1ea6-4753-addb-72728fda40e0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 946 time: 0.0514324 Dec 21 03:51:54.036648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'port_id': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'mac_address': 'fa:16:3e:e4:79:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13099c8a-54c1-41b2-a4f4-664d17e69495', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:54.042830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:54.045829 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2680a11-3ae5-469a-9567-ab69dd854b25" -d '{"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:54.061016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:54.067257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03c674f0-b27a-4396-bb35-a11bc0814b92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.069821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03c674f0-b27a-4396-bb35-a11bc0814b92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.073704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-03c674f0-b27a-4396-bb35-a11bc0814b92 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9bd94821-9663-42b4-b478-7fc2c9277fc1 HTTP/1.1" status: 204 len: 168 time: 0.2437100 Dec 21 03:51:54.104543 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59016c5d-65a0-4c6a-968b-601ed362dbf2 x-openstack-request-id: req-59016c5d-65a0-4c6a-968b-601ed362dbf2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:54.104543 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:54.104543 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-59016c5d-65a0-4c6a-968b-601ed362dbf2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:54.104543 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'code': 200} Dec 21 03:51:54.104924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c674f0-b27a-4396-bb35-a11bc0814b92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9bd94821-9663-42b4-b478-7fc2c9277fc1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:54.104924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a78792c1-ca99-4fa3-b7b6-378a92044414 req-7144af8d-177e-404d-89ff-0d2bf8ec518a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723474 Dec 21 03:51:54.111649 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.132997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 425b1a38-084b-43fc-ab16-7a0f86f2eb65 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:54.155569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:54.156680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.217925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:54.228052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f4a714-ae15-44e4-a0e5-813b4956e1a4 req-1ac26407-1c5d-488c-9d27-aacf7981b7ee tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:54.229610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43f4a714-ae15-44e4-a0e5-813b4956e1a4 req-1ac26407-1c5d-488c-9d27-aacf7981b7ee tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0696909 Dec 21 03:51:54.232687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.233417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:54.289350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43f4a714-ae15-44e4-a0e5-813b4956e1a4 req-1f002dcd-ce3c-4413-ab15-00972c01488d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493689 Dec 21 03:51:54.312991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:54.375077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:54.398879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'mac_address': 'fa:16:3e:3d:e7:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.85'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:54.445246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.464626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 131c672e-d86b-490a-b8c0-d22ce7f197d4 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:54.486259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:54.579240 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.642011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:54.785181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:54.789197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4568b8c4-378b-4842-93a8-25aa00ddcb9b req-f2f3a655-b957-4ac0-8047-af48be389338 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:54.790704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4568b8c4-378b-4842-93a8-25aa00ddcb9b req-f2f3a655-b957-4ac0-8047-af48be389338 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 943 time: 0.0500333 Dec 21 03:51:54.814564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['131c672e-d86b-490a-b8c0-d22ce7f197d4'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:54.842769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4568b8c4-378b-4842-93a8-25aa00ddcb9b req-30f54f2a-2172-44f9-bf6e-2793acf0e758 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453429 Dec 21 03:51:55.034850 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:55.066105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['425b1a38-084b-43fc-ab16-7a0f86f2eb65'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:55.289751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb6eeb5-3f67-4291-87e6-55f45de8ca6f req-941dd96e-deea-402d-a0f7-06493d926d17 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:55.291574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bb6eeb5-3f67-4291-87e6-55f45de8ca6f req-941dd96e-deea-402d-a0f7-06493d926d17 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 946 time: 0.0776489 Dec 21 03:51:55.362585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bb6eeb5-3f67-4291-87e6-55f45de8ca6f req-c6e31fcf-778e-49d2-81ed-632561644ede tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607584 Dec 21 03:51:55.472805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41b1c31c-e29d-4035-9c76-8e656170fee0 req-41584157-9943-4afb-9383-09540eb2e8f3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:55.475077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41b1c31c-e29d-4035-9c76-8e656170fee0 req-41584157-9943-4afb-9383-09540eb2e8f3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.0802994 Dec 21 03:51:55.560535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41b1c31c-e29d-4035-9c76-8e656170fee0 req-7ac8cda9-146f-48a7-ab2c-03e3b3bae192 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773520 Dec 21 03:51:55.570699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-c17449bf-3924-4cb6-b5f5-5200ce8eea1f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:55.572263 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-c17449bf-3924-4cb6-b5f5-5200ce8eea1f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 946 time: 0.0766053 Dec 21 03:51:55.613306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53722) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:55.661152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:55.760348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Deleting port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:51:55.760778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:55.813125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1462b88-54ed-4cfc-ba83-106087d26641 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:55.834856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:55.944236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] For port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:55.945704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:55.958567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 131c672e-d86b-490a-b8c0-d22ce7f197d4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:55.959301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:55.981360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Calling delete_port for 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:51:55.989174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1462b88-54ed-4cfc-ba83-106087d26641 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.069572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1462b88-54ed-4cfc-ba83-106087d26641 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.147724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1462b88-54ed-4cfc-ba83-106087d26641 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed76d18b-ce53-45f7-9465-f9e28055161f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:56.167851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.177743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b1462b88-54ed-4cfc-ba83-106087d26641 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ff144f1efe524738a017152f9c5098fe&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5629761 Dec 21 03:51:56.180866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:56.192504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0c5b3c7d-3a97-48ca-b6c5-74849173c787 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:51:56.205266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3c4ae3-9507-4d1f-8a91-dcc5fe924b9c req-da2d4264-c4b1-4ab7-8c5c-469c1af431ea tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:56.207110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3c4ae3-9507-4d1f-8a91-dcc5fe924b9c req-da2d4264-c4b1-4ab7-8c5c-469c1af431ea tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 943 time: 0.2026787 Dec 21 03:51:56.254962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:56.257203 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e338588f-aa42-418f-9f8b-6859975a6cf3" -d '{"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-plugged", "status": "completed", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:56.313887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:56.353801 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-09c63c1c-06d1-4b76-a502-ff3315b7acb1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.385290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3c4ae3-9507-4d1f-8a91-dcc5fe924b9c req-488482aa-7102-4091-85c6-9cdb6e2838bf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1687624 Dec 21 03:51:56.402371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.409015 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ecf7d42-c626-4173-92d2-6f265536b0ac x-openstack-request-id: req-4ecf7d42-c626-4173-92d2-6f265536b0ac {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:56.409316 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-plugged", "status": "completed", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:56.409577 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4ecf7d42-c626-4173-92d2-6f265536b0ac {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:56.409970 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'code': 200} Dec 21 03:51:56.424988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-09c63c1c-06d1-4b76-a502-ff3315b7acb1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.427344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.438414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:56.494475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event deleted for resources: {'Port': ['ID=9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:56.528906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72105f74-e963-4409-8406-bd65c676f8e2 req-bfb20b25-315d-4c36-a7d5-efe295470210 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 210 time: 0.0436051 Dec 21 03:51:56.529295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:56.554077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:56.560656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'port_id': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'mac_address': 'fa:16:3e:52:1f:23', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:51:56.582141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] No DVR routers for this DVR port 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:51:56.585632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.589685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-384cfdff-5d97-47b9-b52c-15a586d15426 req-f0f59d19-62e5-4b90-8fc2-f0a53dd461ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "DELETE /v2.0/ports/9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc HTTP/1.1" status: 204 len: 173 time: 1.0105164 Dec 21 03:51:56.591242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'name': 'network-vif-deleted', 'tag': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:56.595115 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3874c1e9-39fc-4e5e-b705-623656dff112" -d '{"events": [{"server_uuid": "b6364012-fa40-4252-89bc-9c97b109f46b", "name": "network-vif-deleted", "tag": "9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:56.611013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.647771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0c5b3c7d-3a97-48ca-b6c5-74849173c787 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:51:56.657389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-09c63c1c-06d1-4b76-a502-ff3315b7acb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.661357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-09c63c1c-06d1-4b76-a502-ff3315b7acb1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.667155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-09c63c1c-06d1-4b76-a502-ff3315b7acb1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ed76d18b-ce53-45f7-9465-f9e28055161f HTTP/1.1" status: 204 len: 168 time: 0.4806974 Dec 21 03:51:56.684178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c63c1c-06d1-4b76-a502-ff3315b7acb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed76d18b-ce53-45f7-9465-f9e28055161f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:56.713847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:56.733963 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13bd2671-ecba-459b-b403-4f53a2026526 x-openstack-request-id: req-13bd2671-ecba-459b-b403-4f53a2026526 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:56.734275 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6364012-fa40-4252-89bc-9c97b109f46b", "name": "network-vif-deleted", "tag": "9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:56.734532 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-13bd2671-ecba-459b-b403-4f53a2026526 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:56.734977 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6364012-fa40-4252-89bc-9c97b109f46b', 'name': 'network-vif-deleted', 'tag': '9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc', 'status': 'completed', 'code': 200} Dec 21 03:51:56.807820 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:56.870786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a730ffe-4f7e-4c1e-8c35-56c8af444ca7 req-c997f33e-0e6b-4a36-b973-63c307a2c945 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:56.872462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a730ffe-4f7e-4c1e-8c35-56c8af444ca7 req-c997f33e-0e6b-4a36-b973-63c307a2c945 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.1381826 Dec 21 03:51:56.919360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:56.962574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a730ffe-4f7e-4c1e-8c35-56c8af444ca7 req-14bb5a1d-39de-410d-95b9-4c6002cad2b9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836058 Dec 21 03:51:57.277497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0c5b3c7d-3a97-48ca-b6c5-74849173c787'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:51:57.529441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afcdbee-23da-4aeb-aa4c-5978d4ff0d60 req-23be2305-823c-4de5-9c86-0ac5a801f1e0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:57.531273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afcdbee-23da-4aeb-aa4c-5978d4ff0d60 req-23be2305-823c-4de5-9c86-0ac5a801f1e0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 944 time: 0.0650625 Dec 21 03:51:57.620400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afcdbee-23da-4aeb-aa4c-5978d4ff0d60 req-f5ec3f3d-3fe9-48b0-be9a-885b3ba7de44 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795565 Dec 21 03:51:57.683156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89b8a492-9615-4bcf-9134-54c1cde22887 req-f2a468c8-231c-47cb-95c9-9a859edd523c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6364012-fa40-4252-89bc-9c97b109f46b HTTP/1.1" status: 200 len: 210 time: 0.0311069 Dec 21 03:51:57.771507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53804) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:57.789053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9429dba-5f1d-43c3-a798-90108a3ab2bc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:57.836433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:51:57.897098 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9429dba-5f1d-43c3-a798-90108a3ab2bc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:57.962380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:51:57.963189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9429dba-5f1d-43c3-a798-90108a3ab2bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:57.967928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:51:57.968724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.041051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b9429dba-5f1d-43c3-a798-90108a3ab2bc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0f5d830ba39042b592543b05b206eb85&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2673898 Dec 21 03:51:58.042873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53822) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:51:58.050650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9429dba-5f1d-43c3-a798-90108a3ab2bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db2fd4be-99bd-44b6-925b-4f321eaaace5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:58.099889 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.122805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-14b462be-c94b-49ee-a28d-5e3706e27bad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.140515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:51:58.141610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac140ad-6071-4cb6-b45e-c415b9f5cb10 req-52b86c4f-8c8e-4aa2-8dac-2b93778f894f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:58.143332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac140ad-6071-4cb6-b45e-c415b9f5cb10 req-52b86c4f-8c8e-4aa2-8dac-2b93778f894f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.0718732 Dec 21 03:51:58.147412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-14b462be-c94b-49ee-a28d-5e3706e27bad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.209656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:51:58.220537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac140ad-6071-4cb6-b45e-c415b9f5cb10 req-e005319b-fdbc-466d-8af6-eefa486b9eb9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640578 Dec 21 03:51:58.232259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:51:58.232612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9d6fc80b-8426-45fd-9dcb-8a2c7561c5cc not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:51:58.236059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.265023 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-14b462be-c94b-49ee-a28d-5e3706e27bad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.269020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-14b462be-c94b-49ee-a28d-5e3706e27bad admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:51:58.270639 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-14b462be-c94b-49ee-a28d-5e3706e27bad admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/db2fd4be-99bd-44b6-925b-4f321eaaace5 HTTP/1.1" status: 204 len: 168 time: 0.2261705 Dec 21 03:51:58.292966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b462be-c94b-49ee-a28d-5e3706e27bad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db2fd4be-99bd-44b6-925b-4f321eaaace5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:58.310796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:51:58.410964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:51:58.416019 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59564842-c3b7-4aef-8153-65261dd0df89" -d '{"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-plugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:51:58.472409 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:51:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8481e0d8-6636-42c3-ac54-40905ca26c30 x-openstack-request-id: req-8481e0d8-6636-42c3-ac54-40905ca26c30 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:51:58.472707 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-plugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:51:58.472967 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8481e0d8-6636-42c3-ac54-40905ca26c30 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:51:58.473359 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'code': 200} Dec 21 03:51:58.665660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e3810-166b-4a18-9b10-117e0734d0c4 req-24bd75bc-7b1c-4117-85ab-01d0acd75078 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:58.667734 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-715e3810-166b-4a18-9b10-117e0734d0c4 req-24bd75bc-7b1c-4117-85ab-01d0acd75078 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1098 time: 0.0750973 Dec 21 03:51:58.795347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9610ba18-b981-4e40-82d6-0108204751f2 req-99ec5f7e-1e96-4b36-b285-d25b3b1ac233 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:58.807092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9610ba18-b981-4e40-82d6-0108204751f2 req-99ec5f7e-1e96-4b36-b285-d25b3b1ac233 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 944 time: 0.0994561 Dec 21 03:51:58.815840 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-715e3810-166b-4a18-9b10-117e0734d0c4 req-e76d1a16-03b4-4e7a-9901-59090046062e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1377945 Dec 21 03:51:58.895777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9610ba18-b981-4e40-82d6-0108204751f2 req-e6be01e5-3bcf-4b72-a320-f2ff611727b6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843499 Dec 21 03:51:59.370250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2116535-9ba5-4a20-bb9f-ca1fc08750bc req-46993df4-ab01-4572-887f-35534f317ae4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:59.372089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2116535-9ba5-4a20-bb9f-ca1fc08750bc req-46993df4-ab01-4572-887f-35534f317ae4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.0689526 Dec 21 03:51:59.446406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2116535-9ba5-4a20-bb9f-ca1fc08750bc req-6ddcc364-b2ae-42b0-89e3-0762a9e266f1 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631077 Dec 21 03:51:59.589042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-2220974a-fcf0-4989-ad6e-b5d3c84dc929 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:51:59.591100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-2220974a-fcf0-4989-ad6e-b5d3c84dc929 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.1195486 Dec 21 03:51:59.607187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-9375357e-b89d-46c5-ae85-74062d8c984b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.0103452 Dec 21 03:51:59.639242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-7fee276f-2ae8-4534-b4dc-fba2a5368371 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0261698 Dec 21 03:51:59.733006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-dbd081f5-d288-4537-95a4-f4839d0cdd4e service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865114 Dec 21 03:51:59.823288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-0cfa8ef5-7cad-47a2-b039-67cbb3723e02 service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840206 Dec 21 03:52:00.090986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53948) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:00.221421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0c5b3c7d-3a97-48ca-b6c5-74849173c787 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:00.305255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a1f9d9b-2e7c-4d97-b3c0-b29a06286f5b req-d63844c7-a275-4971-8dcc-8c59e6006749 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.0826185 Dec 21 03:52:00.386629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-423170150-network', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:00.447491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d729a742-799a-4197-8235-3e6470f94fb1 req-e741401d-7744-49e1-97c3-2d8695755d95 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:00.462054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d729a742-799a-4197-8235-3e6470f94fb1 req-e741401d-7744-49e1-97c3-2d8695755d95 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 944 time: 0.1889086 Dec 21 03:52:00.469888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:52:00.473948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:00.474329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.518300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d729a742-799a-4197-8235-3e6470f94fb1 req-c0e4c61d-16fa-417c-9b05-b6dd7bd39be3 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552628 Dec 21 03:52:00.533887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Made reservation on behalf of 068e67c3e7bc40e397d83d4acaa3afd1 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:00.537780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.558314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.645976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.684428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:00.687326 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-989f0cf9-4555-475a-beff-fca9a1ba7ba8" -d '{"events": [{"server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "name": "network-vif-plugged", "status": "completed", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:00.709736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:00.766505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.777337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f51982-91f7-4d54-9d34-96e85f0c37ee req-3a842dba-03b5-4a18-bff6-adcb0fee9fb5 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:00.780589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.794882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f51982-91f7-4d54-9d34-96e85f0c37ee req-3a842dba-03b5-4a18-bff6-adcb0fee9fb5 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1407990 Dec 21 03:52:00.828568 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a429c632-036a-4a83-915c-269871bba0ef x-openstack-request-id: req-a429c632-036a-4a83-915c-269871bba0ef {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:00.829192 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "name": "network-vif-plugged", "status": "completed", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:00.829703 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a429c632-036a-4a83-915c-269871bba0ef {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:00.830323 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'code': 200} Dec 21 03:52:00.880991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:00.904571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:00.941554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f51982-91f7-4d54-9d34-96e85f0c37ee req-95428887-3d47-4289-a248-bc293db21b18 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1324155 Dec 21 03:52:01.035539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:01.076410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9467bf76-955f-469a-b18a-f60f4ea69998,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:01.080257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:01.080669 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Added segment 4a9353ec-21a7-452e-9044-b5e6bec5e758 of type vlan for network a4370ec5-c219-4c56-a17c-433f7c352683 Dec 21 03:52:01.083834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c0923f-6311-499e-aa58-f9597e6c49ad req-785a5f4f-2da5-463f-9053-2cc1d72b44fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:01.085545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27c0923f-6311-499e-aa58-f9597e6c49ad req-785a5f4f-2da5-463f-9053-2cc1d72b44fd service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.1559954 Dec 21 03:52:01.109525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f814a1a-7c45-4afd-87cd-6b6f8a110ea8 req-dc59da9f-0f0f-469a-9604-963f33c4399c tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:01.126595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f814a1a-7c45-4afd-87cd-6b6f8a110ea8 req-dc59da9f-0f0f-469a-9604-963f33c4399c tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1098 time: 0.0645492 Dec 21 03:52:01.185403 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:01.211509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f814a1a-7c45-4afd-87cd-6b6f8a110ea8 req-19c570a3-dc80-4cf9-8000-676008bf1a88 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838935 Dec 21 03:52:01.212513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27c0923f-6311-499e-aa58-f9597e6c49ad req-f42eed0a-28fe-4a00-9ecd-fd93307a3abb service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1176374 Dec 21 03:52:01.327131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:01.328378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:01.330385 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:01.435187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed9ae95e-bbf3-4c90-bfaf-5c1ab747b85d req-422b0a53-1e63-401b-9c55-ef91d949ddf3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.0542860 Dec 21 03:52:01.444182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] Pushing event updated for resources: {'Network': ['ID=a4370ec5-c219-4c56-a17c-433f7c352683,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:01.457014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network a4370ec5-c219-4c56-a17c-433f7c352683 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:01.462667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c2a262c8-198e-4ff9-9a13-14aa396cbd1f admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.3666422 Dec 21 03:52:01.462667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54034) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:01.475178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Request body: {'subnet': {'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-423170150-subnet', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:01.630335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Made reservation on behalf of 068e67c3e7bc40e397d83d4acaa3afd1 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:01.633071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:01.679374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0858fd4f-5f5e-4c80-b414-858392d2e0d0 req-c12a6f62-0182-4cf8-aa4d-9b27e714478c tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:01.680917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0858fd4f-5f5e-4c80-b414-858392d2e0d0 req-c12a6f62-0182-4cf8-aa4d-9b27e714478c tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0573075 Dec 21 03:52:01.764906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0858fd4f-5f5e-4c80-b414-858392d2e0d0 req-e0dd95ef-597f-4772-8b11-63a06a35c7ab tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743155 Dec 21 03:52:01.940415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.000589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:02.021435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Checking segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:02.022087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Network hostable DHCP agents. Network: a4370ec5-c219-4c56-a17c-433f7c352683, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:02.132648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Network a4370ec5-c219-4c56-a17c-433f7c352683 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:02.242184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, a4370ec5-c219-4c56-a17c-433f7c352683) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:02.247930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:02.248670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.266443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17e2b1bf-ed03-4640-9998-01b1cdcdc6f7 None None] Network a4370ec5-c219-4c56-a17c-433f7c352683 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:02.339417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2cb98749-d6cf-45d0-8cc5-31f632134872 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8730195 Dec 21 03:52:02.341711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54058) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:02.347504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:02.418471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54062) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:02.431962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-a4370ec5-c219-4c56-a17c-433f7c352683', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:02.433371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.645909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2be48d34-e4d4-46c9-8c40-cc2c285bcda0 req-608e55c3-d5fa-49b0-9cef-474a14621ad7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.0828938 Dec 21 03:52:02.658112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.659584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.748129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Allocated IP 172.20.0.2 (a4370ec5-c219-4c56-a17c-433f7c352683/96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7/3b0649a6-4e23-4e4e-a21c-55dd3eea1322) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:02.775299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.836920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9de2f17-9389-4e46-9f2a-36b2dc81f178 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:02.998814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.103194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9de2f17-9389-4e46-9f2a-36b2dc81f178 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.124051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.166485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-f9d6395d-21ad-42de-80c1-57debd325766 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:03.168666 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-f9d6395d-21ad-42de-80c1-57debd325766 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.1787782 Dec 21 03:52:03.190519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Request body: {'port': {'device_id': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'admin_state_up': True, 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:03.218774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Network a4370ec5-c219-4c56-a17c-433f7c352683 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:03.227444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:03.235229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:03.266037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Pushing event updated for resources: {'Port': ['ID=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:03.293961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9de2f17-9389-4e46-9f2a-36b2dc81f178 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.381145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Attempting to bind port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:03.382706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Attempting to bind port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:03.382706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Attempting to bind port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 on network a4370ec5-c219-4c56-a17c-433f7c352683 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:03.390776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:03.391194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Checking segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:03.391957 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.392106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Bound using segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:03.394768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Bound port: 3b0649a6-4e23-4e4e-a21c-55dd3eea1322, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:03.394768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.403962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9de2f17-9389-4e46-9f2a-36b2dc81f178 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f2a4914-f6aa-4db5-8e2b-1aa6724c850d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:03.487406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] For port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:03.493452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] For port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:03.503959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.524458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d9de2f17-9389-4e46-9f2a-36b2dc81f178 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6aac0cfc340240b4b4e963d10dd386a6&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1047769 Dec 21 03:52:03.527156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54088) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:03.533951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebf78d23-39a9-4fd2-9924-e39560809433 req-0d972a39-cc77-4f37-9c3a-fc79918226d6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:03.542366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebf78d23-39a9-4fd2-9924-e39560809433 req-0d972a39-cc77-4f37-9c3a-fc79918226d6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2570076 Dec 21 03:52:03.639830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebf78d23-39a9-4fd2-9924-e39560809433 req-ad071812-66bc-4766-b23a-ad0972439424 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934787 Dec 21 03:52:03.671160 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.697864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:03.708672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.836612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0844c50f-3bc2-4cd1-87a2-593c5defe609 None None] Pushing event updated for resources: {'Port': ['ID=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:03.839517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-972ae34f-8580-4f10-8606-159f66c2858c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:03.898022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a783b924-9c02-4577-bdd9-71436e8113f3 req-d7099091-a05f-4348-9210-7ad9a6b33036 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.0781972 Dec 21 03:52:04.031885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-972ae34f-8580-4f10-8606-159f66c2858c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:04.220008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Allocated IP 172.20.0.13 (a0e5eeee-a736-4bd3-bdf6-679e8da99022/0937a3b1-7f54-409b-bba0-29fa72617a82/25663143-e39b-4924-bcdd-d94c13f30fd2) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:04.292738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:04.305725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-972ae34f-8580-4f10-8606-159f66c2858c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:04.308689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-972ae34f-8580-4f10-8606-159f66c2858c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:04.330967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-972ae34f-8580-4f10-8606-159f66c2858c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3f2a4914-f6aa-4db5-8e2b-1aa6724c850d HTTP/1.1" status: 204 len: 168 time: 0.7837689 Dec 21 03:52:04.374913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:04.396199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-972ae34f-8580-4f10-8606-159f66c2858c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f2a4914-f6aa-4db5-8e2b-1aa6724c850d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:04.689008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:04.693654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Allocated IP 172.25.5.254 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/efb6ba28-97e5-44d1-ba11-ad2bc92b030b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:04.865838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.008051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.021689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f3476b8-2ffd-493f-b18a-e46ab9bf8b66 req-20cddcd1-595e-4af7-a201-e46ffe3f0fc8 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:05.023719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:05.024873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f3476b8-2ffd-493f-b18a-e46ab9bf8b66 req-20cddcd1-595e-4af7-a201-e46ffe3f0fc8 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1946564 Dec 21 03:52:05.034900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:05.058098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:05.115872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event updated for resources: {'Port': ['ID=25663143-e39b-4924-bcdd-d94c13f30fd2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:05.159252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f3476b8-2ffd-493f-b18a-e46ab9bf8b66 req-e2661295-8b87-4816-abe5-f18f71311220 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247458 Dec 21 03:52:05.180488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:05.182316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.280653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.307775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-bcc13552-0c7f-43d4-949b-a9850d1c8c7b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1212263 Dec 21 03:52:05.329214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Request body: {'port': {'device_id': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:05.345437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff0b681-636c-490f-92dd-638d794bb0ae req-d50ed9c8-b8b7-4638-8e2a-87d193138997 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:05.355041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ff0b681-636c-490f-92dd-638d794bb0ae req-d50ed9c8-b8b7-4638-8e2a-87d193138997 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 932 time: 0.1783195 Dec 21 03:52:05.437266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Pushing event updated for resources: {'Port': ['ID=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:05.480892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:05.497210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ff0b681-636c-490f-92dd-638d794bb0ae req-05c5984c-97cf-4643-85b7-d4e94f609d7a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1418233 Dec 21 03:52:05.502848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:05.505486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:05.508940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:05.514181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.524615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:05.542017 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73cad215-205d-4f3a-86c7-ecc26f046c0b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.591688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:05.592332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.862002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb3465a8-686d-4df5-96d3-55eac8b2c36e None None] Network a4370ec5-c219-4c56-a17c-433f7c352683 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:05.892595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73cad215-205d-4f3a-86c7-ecc26f046c0b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.909183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ad9f0d3e-2074-4520-b769-0a1dfb145b9f None None] Provisioning complete for port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:05.909597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad9f0d3e-2074-4520-b769-0a1dfb145b9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.966542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 25663143-e39b-4924-bcdd-d94c13f30fd2 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:52:05.979221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:05.996964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Transition to ACTIVE for port object 25663143-e39b-4924-bcdd-d94c13f30fd2 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:52:06.024308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.075282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73cad215-205d-4f3a-86c7-ecc26f046c0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.104417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:06.106297 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad9f0d3e-2074-4520-b769-0a1dfb145b9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.153985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.197092 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.245261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73cad215-205d-4f3a-86c7-ecc26f046c0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bef8835c-2412-40b8-879d-4710e1c5c259,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:06.248375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Pushing event updated for resources: {'Port': ['ID=25663143-e39b-4924-bcdd-d94c13f30fd2,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:06.254453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73cad215-205d-4f3a-86c7-ecc26f046c0b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4581b58bc66f4758b890baaf61d7d10c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7550333 Dec 21 03:52:06.262396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54160) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:06.389906 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-ad9f0d3e-2074-4520-b769-0a1dfb145b9f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:52:06.402378 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-ad9f0d3e-2074-4520-b769-0a1dfb145b9f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:52:06.422411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:06.460256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbfda70c-1604-4230-b4c2-8c1c19051a7a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.488551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-fb515e5e-c2d8-4188-984d-769920cae702 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:06.491900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-fb515e5e-c2d8-4188-984d-769920cae702 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.1957376 Dec 21 03:52:06.503300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbfda70c-1604-4230-b4c2-8c1c19051a7a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.518076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Attempting to bind port 25663143-e39b-4924-bcdd-d94c13f30fd2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:06.518492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Attempting to bind port 25663143-e39b-4924-bcdd-d94c13f30fd2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:06.522269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Attempting to bind port 25663143-e39b-4924-bcdd-d94c13f30fd2 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:06.539493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Port 25663143-e39b-4924-bcdd-d94c13f30fd2 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:52:06.545382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Attempting to bind port 25663143-e39b-4924-bcdd-d94c13f30fd2 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:06.551708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:06.552391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:06.553028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Bound using segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:06.553672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Bound port: 25663143-e39b-4924-bcdd-d94c13f30fd2, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:06.554253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.591957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-428f4dc9-1e1e-46a2-a567-daa5b3ef0cf8 req-f10d6889-4351-46a9-a129-7f59ffaa9fae tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:06.594454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-428f4dc9-1e1e-46a2-a567-daa5b3ef0cf8 req-f10d6889-4351-46a9-a129-7f59ffaa9fae tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2967081 Dec 21 03:52:06.648201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] For port 25663143-e39b-4924-bcdd-d94c13f30fd2, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:06.652079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] For port 25663143-e39b-4924-bcdd-d94c13f30fd2, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=25663143-e39b-4924-bcdd-d94c13f30fd2,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:06.685384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.734287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.749637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-428f4dc9-1e1e-46a2-a567-daa5b3ef0cf8 req-5bfe57b9-7f23-4f91-a57a-2851f25bc918 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1468313 Dec 21 03:52:06.762960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-4f263f11-9dae-493f-b113-3da583e0662f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:06.764387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-4f263f11-9dae-493f-b113-3da583e0662f service neutron] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.2652080 Dec 21 03:52:06.803677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbfda70c-1604-4230-b4c2-8c1c19051a7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.805966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbfda70c-1604-4230-b4c2-8c1c19051a7a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.819998 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bbfda70c-1604-4230-b4c2-8c1c19051a7a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bef8835c-2412-40b8-879d-4710e1c5c259 HTTP/1.1" status: 204 len: 168 time: 0.5503201 Dec 21 03:52:06.863405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:06.863405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:06.868696 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] 10.222.0.54 "PUT /v2.0/ports/25663143-e39b-4924-bcdd-d94c13f30fd2 HTTP/1.1" status: 200 len: 1093 time: 1.5447981 Dec 21 03:52:06.872934 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'tag': '25663143-e39b-4924-bcdd-d94c13f30fd2'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:06.878426 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af95c5ca-3f41-4e7e-9399-93cbb70f0289" -d '{"events": [{"name": "network-changed", "server_uuid": "01aab21a-a0a5-4f10-b49a-20e1b8ea2db8", "tag": "25663143-e39b-4924-bcdd-d94c13f30fd2"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:06.894500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-de33d6d2-8d54-42a3-a51e-07999d3777e0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.0747313 Dec 21 03:52:06.922665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbfda70c-1604-4230-b4c2-8c1c19051a7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bef8835c-2412-40b8-879d-4710e1c5c259,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:06.968422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ccf3fd-289b-40d8-bf17-118a11af455d service neutron] Pushing event updated for resources: {'Port': ['ID=25663143-e39b-4924-bcdd-d94c13f30fd2,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:07.106309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-5af22057-f2fb-4dcf-8d16-3e1b76cb28e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:07.107818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-5af22057-f2fb-4dcf-8d16-3e1b76cb28e3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.2080960 Dec 21 03:52:07.159359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6e8f1685-984f-4f2a-938f-a60e1a3f359a None None] Provisioning complete for port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:07.159974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e8f1685-984f-4f2a-938f-a60e1a3f359a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:07.220439 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c29acd6d-ba97-4d97-b472-2423f322dca5 x-openstack-request-id: req-c29acd6d-ba97-4d97-b472-2423f322dca5 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:07.220744 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "01aab21a-a0a5-4f10-b49a-20e1b8ea2db8", "tag": "25663143-e39b-4924-bcdd-d94c13f30fd2", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:07.224112 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c29acd6d-ba97-4d97-b472-2423f322dca5 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:07.224749 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'tag': '25663143-e39b-4924-bcdd-d94c13f30fd2', 'status': 'completed', 'code': 200} Dec 21 03:52:07.229543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-0b4dc10b-dba3-4de4-acd7-c24944debbc9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0915265 Dec 21 03:52:07.274198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e259bd2-936a-400b-bee4-08b14abcd883 req-38a2ca77-b347-4184-ab4f-b0bb404043cd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:07.282033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e259bd2-936a-400b-bee4-08b14abcd883 req-38a2ca77-b347-4184-ab4f-b0bb404043cd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 944 time: 0.2163503 Dec 21 03:52:07.306626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-c359f0b0-11d8-492b-b03d-de6ae7563806 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:07.312260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-c359f0b0-11d8-492b-b03d-de6ae7563806 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 1096 time: 0.1870849 Dec 21 03:52:07.363376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:07.382592 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-c34c0dc3-8f62-44e3-ac22-586b7eb86157 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=25663143-e39b-4924-bcdd-d94c13f30fd2 HTTP/1.1" status: 200 len: 217 time: 0.0512662 Dec 21 03:52:07.438638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:07.497900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e259bd2-936a-400b-bee4-08b14abcd883 req-62cefdeb-afa1-42da-9cc7-e6b01b89af43 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2126975 Dec 21 03:52:07.521325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8eaa04-10c9-4229-b645-12681777e031 req-198bd6d7-48bc-45bd-a431-31bc5fd76e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:07.524055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-198bd6d7-48bc-45bd-a431-31bc5fd76e45 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.1300428 Dec 21 03:52:07.553400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-ad40d8a0-9c7e-4110-9b7e-f40c65595cd0 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3117263 Dec 21 03:52:07.592112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:07.592575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:07.606521 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-fd4d1785-47b2-4c02-9d66-5fd289af0e18 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0741549 Dec 21 03:52:07.851779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-10247521-c249-4978-8737-67c15c71b0fb service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2375202 Dec 21 03:52:07.884915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4210cff5-ed1e-4cdb-937a-85ee8cc74a53 req-11c01b99-bbe2-4933-9e01-6bba377b54ea service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3226383 Dec 21 03:52:08.035227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2771d627-07db-4c00-8544-e56ecfd07f29 req-44084772-a10f-4e92-af14-911aa8fc23a9 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:08.046729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2771d627-07db-4c00-8544-e56ecfd07f29 req-44084772-a10f-4e92-af14-911aa8fc23a9 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1424015 Dec 21 03:52:08.066692 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7d8eaa04-10c9-4229-b645-12681777e031 req-6824e3dc-7d0b-43e4-aba4-06f6830f13ad service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2074630 Dec 21 03:52:08.086178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Router afc96f13-e71f-4841-88a7-5c551515b510 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:52:08.235970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2771d627-07db-4c00-8544-e56ecfd07f29 req-4f691b76-1bc0-407b-ac55-9569b2bfa5f6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1798553 Dec 21 03:52:08.377439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-a2110700-a8fc-4e06-a860-e8a1ac11980e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:08.383972 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-a2110700-a8fc-4e06-a860-e8a1ac11980e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 1096 time: 0.0947204 Dec 21 03:52:08.408948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:08.433189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Sync routers for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:08.447047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:08.447869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:08.499106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-560939a0-6e16-45f2-85e5-8e2e15dc67cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:08.507848 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-560939a0-6e16-45f2-85e5-8e2e15dc67cc service neutron] 10.222.0.54 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.1191468 Dec 21 03:52:08.535454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:08.538065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-864e2927-2add-47e7-a292-677bfd991654 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 6.1945994 Dec 21 03:52:08.540230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54224) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:08.577425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:08.703084 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-0db0eed4-23e3-452b-a62f-13d436a2f29e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=25663143-e39b-4924-bcdd-d94c13f30fd2 HTTP/1.1" status: 200 len: 217 time: 0.1814909 Dec 21 03:52:08.800286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea414e53-c280-443c-9807-e027899cd5ac req-c1a408da-c915-4837-a6be-0de405d091fa tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:08.818257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea414e53-c280-443c-9807-e027899cd5ac req-c1a408da-c915-4837-a6be-0de405d091fa tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 944 time: 0.1629381 Dec 21 03:52:08.830493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-ac86b90f-0f56-4d76-8743-ec140f35920b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:08.833577 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-ac86b90f-0f56-4d76-8743-ec140f35920b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.1239967 Dec 21 03:52:08.893874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-08c09b3f-1ed0-4af0-a2be-15dca4e9baea service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0504053 Dec 21 03:52:09.037242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:06Z', 'revision_number': 3, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:09.065677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea414e53-c280-443c-9807-e027899cd5ac req-a547d7b4-f016-4d90-9c71-3ed885ba8189 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2436903 Dec 21 03:52:09.097290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-e3235e7b-15d2-425c-bf82-420a1586cde2 service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1933808 Dec 21 03:52:09.125021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Checking router: afc96f13-e71f-4841-88a7-5c551515b510 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:09.126027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Updating router afc96f13-e71f-4841-88a7-5c551515b510 port efb6ba28-97e5-44d1-ba11-ad2bc92b030b binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:52:09.198575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:09.384385 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-af95c5ca-3f41-4e7e-9399-93cbb70f0289 req-107edfb2-f859-4d53-a469-dbb57fa373ca service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2705350 Dec 21 03:52:09.554438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:09.601027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c98a81-8bfe-4ac8-b1b7-30c4e0acd81a req-540e2fc0-5074-4816-9764-1dd32ee81908 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:09.615014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7c98a81-8bfe-4ac8-b1b7-30c4e0acd81a req-540e2fc0-5074-4816-9764-1dd32ee81908 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1545095 Dec 21 03:52:09.753613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7c98a81-8bfe-4ac8-b1b7-30c4e0acd81a req-f197d749-24e1-4eb2-b040-7cd15ba8ae9a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1313026 Dec 21 03:52:09.933108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:09.944164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Allocated IP 172.20.0.1 (a4370ec5-c219-4c56-a17c-433f7c352683/96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7/da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:10.024848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.078904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4630fc-6ce7-473e-8e13-31ffc4fd4c43 None None] Pushing event updated for resources: {'Port': ['ID=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:10.103291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Attempting to bind port efb6ba28-97e5-44d1-ba11-ad2bc92b030b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:10.103291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Attempting to bind port efb6ba28-97e5-44d1-ba11-ad2bc92b030b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:10.103727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Attempting to bind port efb6ba28-97e5-44d1-ba11-ad2bc92b030b on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:10.110374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:10.110579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:10.111057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.111556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:10.112286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Bound port: efb6ba28-97e5-44d1-ba11-ad2bc92b030b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:10.112938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.169031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.270120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] For port efb6ba28-97e5-44d1-ba11-ad2bc92b030b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:10.273977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] For port efb6ba28-97e5-44d1-ba11-ad2bc92b030b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:10.274716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b49949a-725d-4613-9fdb-f7a8a38e1839 req-95997f7a-63b6-4d1f-97d4-94cadf278ff4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:10.285180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b49949a-725d-4613-9fdb-f7a8a38e1839 req-95997f7a-63b6-4d1f-97d4-94cadf278ff4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 944 time: 0.0788906 Dec 21 03:52:10.303459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.337633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54282) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:10.344600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.357703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Pushing event updated for resources: {'Port': ['ID=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:10.399266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Network a4370ec5-c219-4c56-a17c-433f7c352683 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:10.410109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:10.415521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:10.436692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b49949a-725d-4613-9fdb-f7a8a38e1839 req-ef485fbb-658c-4c66-8855-ee9d5c6390b3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505480 Dec 21 03:52:10.442065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:10.442694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:10.536850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.548847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4630fc-6ce7-473e-8e13-31ffc4fd4c43 None None] Pushing event updated for resources: {'Port': ['ID=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:10.669758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c6ad241-efdc-4efe-bdc6-ffba20d30b99 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.692900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:10.824043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c6ad241-efdc-4efe-bdc6-ffba20d30b99 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.921975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c6ad241-efdc-4efe-bdc6-ffba20d30b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.983456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-29dbc30d-7961-4b68-9aee-0ec02d2c16d7 None None] Provisioning complete for port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:10.983456 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-29dbc30d-7961-4b68-9aee-0ec02d2c16d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:10.984908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.021510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6ad241-efdc-4efe-bdc6-ffba20d30b99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a62395b6-6b63-413c-9379-2f42724e4356,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:11.029387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:06Z', 'revision_number': 3, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:11.031921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9c6ad241-efdc-4efe-bdc6-ffba20d30b99 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9c087cf4f5e24bf3a17ecd3cd76054d1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6902821 Dec 21 03:52:11.032747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54300) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:11.079268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4852e0c-3e48-4bc1-b24e-00bc089111e9 None None] The sync data for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 is: [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:06Z', 'revision_number': 3, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:11.084581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-29dbc30d-7961-4b68-9aee-0ec02d2c16d7 None None] Port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:11.105056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f74097b-5e8f-4abf-92be-6c92218218e2 req-4638640d-323f-4ad7-a43c-6afa5cf7873d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:11.113924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f74097b-5e8f-4abf-92be-6c92218218e2 req-4638640d-323f-4ad7-a43c-6afa5cf7873d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2651169 Dec 21 03:52:11.140430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbef44c0-46e9-4251-b378-e9a51222f33a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.205855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbef44c0-46e9-4251-b378-e9a51222f33a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.224713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f74097b-5e8f-4abf-92be-6c92218218e2 req-ea51fcda-f650-4a36-87fd-8e7f9aee1da8 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076567 Dec 21 03:52:11.358445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbef44c0-46e9-4251-b378-e9a51222f33a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.358445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bbef44c0-46e9-4251-b378-e9a51222f33a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.358445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bbef44c0-46e9-4251-b378-e9a51222f33a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a62395b6-6b63-413c-9379-2f42724e4356 HTTP/1.1" status: 204 len: 168 time: 0.3209598 Dec 21 03:52:11.371962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbef44c0-46e9-4251-b378-e9a51222f33a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a62395b6-6b63-413c-9379-2f42724e4356,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:11.426772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.521939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.718407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Pushing event updated for resources: {'Port': ['ID=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:11.722794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:11.748088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb4bbca-4f99-4720-93a6-3f79769d062c req-94640a3c-7d66-463e-8866-caf08c0288ec tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:11.758593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb4bbca-4f99-4720-93a6-3f79769d062c req-94640a3c-7d66-463e-8866-caf08c0288ec tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 944 time: 0.1309171 Dec 21 03:52:12.279972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 25663143-e39b-4924-bcdd-d94c13f30fd2 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:52:12.322456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb4bbca-4f99-4720-93a6-3f79769d062c req-52a204c5-a916-495e-b8fd-6ebedf680807 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951049 Dec 21 03:52:12.382166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Network a4370ec5-c219-4c56-a17c-433f7c352683 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:12.406454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:12.566246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 25663143-e39b-4924-bcdd-d94c13f30fd2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=25663143-e39b-4924-bcdd-d94c13f30fd2,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:12.573367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac48283a-7976-41c2-bb0b-b0be6e5215d3 req-2847fb92-d4d6-48d9-aaa3-4e5656c85f3e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:12.587955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '25663143-e39b-4924-bcdd-d94c13f30fd2', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': '25663143-e39b-4924-bcdd-d94c13f30fd2', 'mac_address': 'fa:16:3e:69:8a:f1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:52:12.589391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac48283a-7976-41c2-bb0b-b0be6e5215d3 req-2847fb92-d4d6-48d9-aaa3-4e5656c85f3e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2220454 Dec 21 03:52:12.676954 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:12.713891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 25663143-e39b-4924-bcdd-d94c13f30fd2 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:52:12.786165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 25663143-e39b-4924-bcdd-d94c13f30fd2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=25663143-e39b-4924-bcdd-d94c13f30fd2,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:12.810851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac48283a-7976-41c2-bb0b-b0be6e5215d3 req-496197c0-0f5d-4e02-b521-65ebc193cee5 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2057946 Dec 21 03:52:12.829764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Router afc96f13-e71f-4841-88a7-5c551515b510 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:52:12.847332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3c2ce879-8ed9-42d0-ae24-10a59c02e885 None None] Provisioning complete for port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:12.848366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c2ce879-8ed9-42d0-ae24-10a59c02e885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:12.947419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3c2ce879-8ed9-42d0-ae24-10a59c02e885 None None] Port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:12.950012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:13.054959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=25663143-e39b-4924-bcdd-d94c13f30fd2,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:13.086857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:13.100707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d04a3e66-93b9-4b78-a335-e3990e8ca203 admin admin] 10.222.0.18 "PUT /v2.0/routers/afc96f13-e71f-4841-88a7-5c551515b510/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5591681 Dec 21 03:52:13.479030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['25663143-e39b-4924-bcdd-d94c13f30fd2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:13.480208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce5e004-796b-4c3d-a644-0c276d793db1 req-0067cab4-8003-4d2a-ac68-8f95eb82ad74 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:13.480208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ce5e004-796b-4c3d-a644-0c276d793db1 req-0067cab4-8003-4d2a-ac68-8f95eb82ad74 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 945 time: 0.0646381 Dec 21 03:52:13.514458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device efb6ba28-97e5-44d1-ba11-ad2bc92b030b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:13.529171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ce5e004-796b-4c3d-a644-0c276d793db1 req-b9d55314-d67b-4bbc-b1d3-d3d4b7b09bc7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543575 Dec 21 03:52:13.598741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port efb6ba28-97e5-44d1-ba11-ad2bc92b030b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:13.599147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:13.686362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:13.781942 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Sync routers for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:13.802462 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:13.803138 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:13.892671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port efb6ba28-97e5-44d1-ba11-ad2bc92b030b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:13.927423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:13.940776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1603688548', 'description': 'tempest-description--1308427969'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:13.973303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.104979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.122551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:14.140463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b854f02e-5c7d-4d5c-814e-90ceb0fea47e req-df0b531a-c6cf-4806-a359-390dad051ca0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:14.145270 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:14.151816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b854f02e-5c7d-4d5c-814e-90ceb0fea47e req-df0b531a-c6cf-4806-a359-390dad051ca0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1035941 Dec 21 03:52:14.260697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.264703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b854f02e-5c7d-4d5c-814e-90ceb0fea47e req-5513ea29-5d8d-4533-944d-4419615d4c90 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088712 Dec 21 03:52:14.316220 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.348276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aea81f67-7856-4a95-a9d4-70c172b531de,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:14.415197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.419579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4af0fa5a-d48b-4d82-8330-877bdf74f8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.4857373 Dec 21 03:52:14.419981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54402) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:14.424806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Request body: {'security_group_rule': {'security_group_id': 'aea81f67-7856-4a95-a9d4-70c172b531de', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:14.534378 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:11Z', 'revision_number': 2, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:14.566909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.628995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Checking router: afc96f13-e71f-4841-88a7-5c551515b510 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:14.632581 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Updating router afc96f13-e71f-4841-88a7-5c551515b510 port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:52:14.692000 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.826782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3a99f9-80be-4e17-89d1-dfae9947e4c0 req-c9660547-2f20-4ff4-a8f7-22509dfb2f0b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:14.835869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba3a99f9-80be-4e17-89d1-dfae9947e4c0 req-c9660547-2f20-4ff4-a8f7-22509dfb2f0b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 945 time: 0.1711357 Dec 21 03:52:14.860492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:14.984515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.010295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba3a99f9-80be-4e17-89d1-dfae9947e4c0 req-90569d54-e3ec-4dd2-8ef8-ce04d1c6ff6b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1734817 Dec 21 03:52:15.024906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8f00243a-2d07-4dcd-8ff2-fbed4a980dd3,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:15.043542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54418) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.098896 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.161250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5e33c5ae-4412-4f86-b18a-5de40b379288 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:15.172272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.173574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0eccfd97-c700-46f1-9957-633dc6a90d64 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7524433 Dec 21 03:52:15.176178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.180681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Request body: {'security_group_rule': {'security_group_id': 'aea81f67-7856-4a95-a9d4-70c172b531de', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:15.196385 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.295447 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79200e49-ed75-4fb5-b523-b098aacc862c None None] Pushing event updated for resources: {'Port': ['ID=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:15.313623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.406789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device efb6ba28-97e5-44d1-ba11-ad2bc92b030b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:15.415313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5e33c5ae-4412-4f86-b18a-5de40b379288 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "PUT /v2.0/quotas/9fc8535184e14c55b642de8b0d543d9f HTTP/1.1" status: 200 len: 366 time: 0.3705952 Dec 21 03:52:15.420754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54444) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.439578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.461910 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Attempting to bind port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:15.462222 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Attempting to bind port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:15.462547 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Attempting to bind port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe on network a4370ec5-c219-4c56-a17c-433f7c352683 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:15.473493 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:15.473872 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Checking segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:15.474277 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.474611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port efb6ba28-97e5-44d1-ba11-ad2bc92b030b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:15.474742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Bound using segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:15.475029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.475156 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Bound port: da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:15.475658 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.483724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54450) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.492329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f184db36-9f06-4a10-a613-064d10140997 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 468 time: 0.0698657 Dec 21 03:52:15.499748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.501747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34106876-2948-45b0-8bee-102811051987 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "GET /v2.0/quotas/9fc8535184e14c55b642de8b0d543d9f HTTP/1.1" status: 200 len: 366 time: 0.0152190 Dec 21 03:52:15.504992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.534491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5a630f4e-ef78-44fb-890f-f47265c7677d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:15.562963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a8c7524-d070-470f-b292-ece958210ebf req-a067d7bf-0daf-4281-a20d-54d876557c47 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:15.565285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a8c7524-d070-470f-b292-ece958210ebf req-a067d7bf-0daf-4281-a20d-54d876557c47 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1828549 Dec 21 03:52:15.604244 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] For port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:15.608649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-73dcc43b-078f-4ffa-be96-45019a984f23 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "DELETE /v2.0/quotas/9fc8535184e14c55b642de8b0d543d9f HTTP/1.1" status: 204 len: 168 time: 0.1010020 Dec 21 03:52:15.609156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54454) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.609541 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] For port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:15.621173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a23cbfbd-a8e2-4631-bc77-7c6591849674 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 207 time: 0.0123026 Dec 21 03:52:15.623734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54456) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.626358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.627819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-baef254b-7011-4c1c-8f47-df888655574e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4506454 Dec 21 03:52:15.632640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.637419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:15.642190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-354d7271-e355-481b-b352-fa9f1c7fb719 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "GET /v2.0/quotas/9fc8535184e14c55b642de8b0d543d9f HTTP/1.1" status: 200 len: 370 time: 0.0153718 Dec 21 03:52:15.644676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54460) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.649837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a8c7524-d070-470f-b292-ece958210ebf req-2c30c3d5-1132-420d-96a2-c71f89934fba tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784101 Dec 21 03:52:15.650257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d0459a9-00b3-42ac-a920-0b35aecc5aa7 tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "GET /v2.0/quotas/9fc8535184e14c55b642de8b0d543d9f/default HTTP/1.1" status: 200 len: 370 time: 0.0041616 Dec 21 03:52:15.655651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54462) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:15.665731 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.679699 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-ac7ac8c9-5da2-41c4-b375-6928082f386c tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] delete failed (client error): The resource could not be found. Dec 21 03:52:15.683121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ac7ac8c9-5da2-41c4-b375-6928082f386c tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "DELETE /v2.0/quotas/9fc8535184e14c55b642de8b0d543d9f HTTP/1.1" status: 404 len: 348 time: 0.0239873 Dec 21 03:52:15.723048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-15d09f06-1426-4047-85b1-aaf476246229 None None] Provisioning complete for port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:15.723048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-15d09f06-1426-4047-85b1-aaf476246229 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.733978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.755501 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:15.756148 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:15.833247 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79200e49-ed75-4fb5-b523-b098aacc862c None None] Pushing event updated for resources: {'Port': ['ID=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:15.849289 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-15d09f06-1426-4047-85b1-aaf476246229 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.906768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:15.921452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-15d09f06-1426-4047-85b1-aaf476246229 None None] For port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:15.977938 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:15.997165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-15d09f06-1426-4047-85b1-aaf476246229 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.029926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:16.090803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d09f06-1426-4047-85b1-aaf476246229 None None] Pushing event updated for resources: {'Port': ['ID=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:16.095337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:network and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.101607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.123799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:subnet and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.126211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Allocated IP 172.25.5.69 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/37f80abf-83e2-432a-a5ae-59b5714dccdb) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:16.127242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-714a8616-730a-4c11-a4d1-6b602847a4d8 None None] Provisioning complete for port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:16.127386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.127950 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-714a8616-730a-4c11-a4d1-6b602847a4d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.140396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:subnetpool and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.148095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.166847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:port and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.171186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.200541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:router and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.206037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.223309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b773b94d-cdd3-4bee-8fa4-19ea322122b6 req-32e6ebc8-f3b2-4c76-89a4-2bbf5c01eca2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:16.231506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b773b94d-cdd3-4bee-8fa4-19ea322122b6 req-32e6ebc8-f3b2-4c76-89a4-2bbf5c01eca2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 945 time: 0.0773702 Dec 21 03:52:16.241016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:floatingip and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.251428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.298035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 25663143-e39b-4924-bcdd-d94c13f30fd2 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:16.317855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.323071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b773b94d-cdd3-4bee-8fa4-19ea322122b6 req-5cfa5408-6eae-4864-b560-6a8abb780d47 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903332 Dec 21 03:52:16.342890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:security_group and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.347374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.354890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Usage tracker for resource:security_group_rule and project:3070fcf8def846a68cc9015b05dcbe26 is out of sync, need to count used quota {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 21 03:52:16.359352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.quota.resource [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=110310) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 21 03:52:16.367971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b022734e-301c-46b9-97c8-e6d3e58fea1b tempest-QuotasTest-355503030 tempest-QuotasTest-355503030-project-admin] 10.222.0.18 "GET /v2.0/quotas/3070fcf8def846a68cc9015b05dcbe26/details.json HTTP/1.1" status: 200 len: 703 time: 0.3337777 Dec 21 03:52:16.383007 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:16.413651 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c72391-3ad6-4dac-8e51-275bccafe099 None None] The sync data for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 is: [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:16.474537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 25663143-e39b-4924-bcdd-d94c13f30fd2 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:52:16.481828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 25663143-e39b-4924-bcdd-d94c13f30fd2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:16.482800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.499472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.595570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:16.603093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:16.612007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:16.626609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event updated for resources: {'Port': ['ID=37f80abf-83e2-432a-a5ae-59b5714dccdb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:16.715151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.784567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25663143-e39b-4924-bcdd-d94c13f30fd2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:16.786152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c47192-35ab-4228-b62a-8389e85059a6 req-1aca95b9-67b0-4ac9-8b72-ef350f5c1c52 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:16.798193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.799840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87c47192-35ab-4228-b62a-8389e85059a6 req-1aca95b9-67b0-4ac9-8b72-ef350f5c1c52 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 949 time: 0.1663780 Dec 21 03:52:16.801479 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f3c0b4f-449d-47f2-bbc3-44f522ecf287" -d '{"events": [{"server_uuid": "01aab21a-a0a5-4f10-b49a-20e1b8ea2db8", "name": "network-vif-plugged", "status": "completed", "tag": "25663143-e39b-4924-bcdd-d94c13f30fd2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:16.839473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 25663143-e39b-4924-bcdd-d94c13f30fd2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=25663143-e39b-4924-bcdd-d94c13f30fd2,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:16.907503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87c47192-35ab-4228-b62a-8389e85059a6 req-13246fd8-625c-4207-b642-ee431a20d625 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054471 Dec 21 03:52:16.910161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:16.941931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5997ee2-9b0f-4d53-a876-e77c87a58859 req-5a0d9427-15d4-4c1c-be2e-304e056d2be0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:16.948460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5997ee2-9b0f-4d53-a876-e77c87a58859 req-5a0d9427-15d4-4c1c-be2e-304e056d2be0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1160359 Dec 21 03:52:16.978499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.004320 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11a887dd-dc8e-441d-9734-5ad1401f3949 x-openstack-request-id: req-11a887dd-dc8e-441d-9734-5ad1401f3949 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:17.004320 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "01aab21a-a0a5-4f10-b49a-20e1b8ea2db8", "name": "network-vif-plugged", "status": "completed", "tag": "25663143-e39b-4924-bcdd-d94c13f30fd2", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:17.004562 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-11a887dd-dc8e-441d-9734-5ad1401f3949 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:17.005074 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25663143-e39b-4924-bcdd-d94c13f30fd2', 'code': 200} Dec 21 03:52:17.054517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=25663143-e39b-4924-bcdd-d94c13f30fd2,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:17.073538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5997ee2-9b0f-4d53-a876-e77c87a58859 req-89752161-d8a2-4b76-97b0-01b2be64ee1a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1158061 Dec 21 03:52:17.239064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54518) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:17.317172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc084ce-ddb1-4afb-b683-27dda837e31b req-d499e9f5-c90b-4f31-8891-6b889e04ae2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:17.318673 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cdc084ce-ddb1-4afb-b683-27dda837e31b req-d499e9f5-c90b-4f31-8891-6b889e04ae2d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 1098 time: 0.1680124 Dec 21 03:52:17.431230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:17.483436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.487544 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cdc084ce-ddb1-4afb-b683-27dda837e31b req-93d05ab7-f39d-467b-8269-b3f302ceb324 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1589658 Dec 21 03:52:17.488629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f8b2ac2-ba22-49dd-b4bb-1bf21c61e0fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.507017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:17.508360 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.547619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.669719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e91bb9-d7e9-4adc-add9-48c47284e956 req-8d3f765f-9ec7-4063-9afd-92044981286e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:17.679731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f8b2ac2-ba22-49dd-b4bb-1bf21c61e0fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.680198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1e91bb9-d7e9-4adc-add9-48c47284e956 req-8d3f765f-9ec7-4063-9afd-92044981286e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 946 time: 0.1007106 Dec 21 03:52:17.680971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.686182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event updated for resources: {'Port': ['ID=37f80abf-83e2-432a-a5ae-59b5714dccdb,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:17.747186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1e91bb9-d7e9-4adc-add9-48c47284e956 req-ce48f33b-b2e7-45d2-8e00-d60a81bc3670 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660017 Dec 21 03:52:17.770001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f8b2ac2-ba22-49dd-b4bb-1bf21c61e0fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.796722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:17.806098 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ce41fea9-d206-4874-a255-1fbd6f77c122 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.1645670 Dec 21 03:52:17.821559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8b2ac2-ba22-49dd-b4bb-1bf21c61e0fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f0ba2fc-b19a-47b8-a166-35ee89553579,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:17.829968 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9f8b2ac2-ba22-49dd-b4bb-1bf21c61e0fc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=34fbe755150747cfb3490cc0a02f508b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5896966 Dec 21 03:52:17.830285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54536) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:17.970731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84dd059f-5000-4ef8-9d28-06f73c4d54ca req-508e9a87-bc4e-4eda-8a23-6e1b88b6829e tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:17.972377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84dd059f-5000-4ef8-9d28-06f73c4d54ca req-508e9a87-bc4e-4eda-8a23-6e1b88b6829e tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.1259494 Dec 21 03:52:17.978312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0244654-fd70-48ab-81e3-a7e68e1537ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:18.020554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0244654-fd70-48ab-81e3-a7e68e1537ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:18.094550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84dd059f-5000-4ef8-9d28-06f73c4d54ca req-1223332f-bb41-4cdf-bbf6-c3d5836fe9e3 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1142347 Dec 21 03:52:18.133904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-e2df931f-54da-427b-82ca-dbe5639cbc4b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1603688548&fields=id&tenant_id=068e67c3e7bc40e397d83d4acaa3afd1 HTTP/1.1" status: 200 len: 267 time: 0.0923166 Dec 21 03:52:18.231474 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0244654-fd70-48ab-81e3-a7e68e1537ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:18.238138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0244654-fd70-48ab-81e3-a7e68e1537ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:18.239334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f0244654-fd70-48ab-81e3-a7e68e1537ff admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2f0ba2fc-b19a-47b8-a166-35ee89553579 HTTP/1.1" status: 204 len: 168 time: 0.4076614 Dec 21 03:52:18.262669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0244654-fd70-48ab-81e3-a7e68e1537ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f0ba2fc-b19a-47b8-a166-35ee89553579,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:18.299554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bada4ca-c5a3-4d56-a8f5-18b7c3b23d68 req-3722aee0-6140-4c88-bc6d-91dfd94a2433 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:18.301059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bada4ca-c5a3-4d56-a8f5-18b7c3b23d68 req-3722aee0-6140-4c88-bc6d-91dfd94a2433 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1283362 Dec 21 03:52:18.307528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-5bf6af13-ed5c-4eee-b63d-bfffd0ae72eb tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:18.309001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-5bf6af13-ed5c-4eee-b63d-bfffd0ae72eb tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/networks?id=a4370ec5-c219-4c56-a17c-433f7c352683 HTTP/1.1" status: 200 len: 811 time: 0.1656299 Dec 21 03:52:18.334596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-db5f1bdc-7914-4a1c-b40c-448d40dae621 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/quotas/068e67c3e7bc40e397d83d4acaa3afd1 HTTP/1.1" status: 200 len: 375 time: 0.0185316 Dec 21 03:52:18.384002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bada4ca-c5a3-4d56-a8f5-18b7c3b23d68 req-a251164c-a7bb-4008-aad3-55d4f353f278 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739629 Dec 21 03:52:18.412006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-1a4b1c3f-40de-4601-863a-b036245e4556 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=068e67c3e7bc40e397d83d4acaa3afd1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0670936 Dec 21 03:52:18.510387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-443e25d6-e863-4a60-ab55-5533bb0bd234 service neutron] 10.222.0.18 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863683 Dec 21 03:52:18.608777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6313baaf-1f1d-4de8-8b01-ab0c4f767f9e service neutron] 10.222.0.18 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913076 Dec 21 03:52:18.882948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54572) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:18.894837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff22fa58-4640-4c67-81bb-7fa60c57ee78 req-0cff9657-42de-439e-8e9b-d3eac7d85dff tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 210 time: 0.0461259 Dec 21 03:52:18.911051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75aac2bf-28f1-4f40-9f09-b8d4e84e541e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:18.921146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16375416-b928-46c1-9fa4-a80165affdc0 req-d6a20128-6f3c-4d6d-b6f2-b81c66484e5c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:18.923163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16375416-b928-46c1-9fa4-a80165affdc0 req-d6a20128-6f3c-4d6d-b6f2-b81c66484e5c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 946 time: 0.1068988 Dec 21 03:52:19.020220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16375416-b928-46c1-9fa4-a80165affdc0 req-e1dedf64-ebe9-452c-a614-90f34857367b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884018 Dec 21 03:52:19.038470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75aac2bf-28f1-4f40-9f09-b8d4e84e541e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.133151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75aac2bf-28f1-4f40-9f09-b8d4e84e541e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.182497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-75aac2bf-28f1-4f40-9f09-b8d4e84e541e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3070fcf8def846a68cc9015b05dcbe26&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2978094 Dec 21 03:52:19.185363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75aac2bf-28f1-4f40-9f09-b8d4e84e541e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d04893c-473d-439d-a75d-2941193aa8b3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:19.188726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:19.234403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830d3e64-afe3-4a54-8283-86993fbb3f2a req-616cc59c-82ea-407b-8a12-5298da0871a4 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:19.235961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-830d3e64-afe3-4a54-8283-86993fbb3f2a req-616cc59c-82ea-407b-8a12-5298da0871a4 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.0637190 Dec 21 03:52:19.249850 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78f63131-ad4a-4b3c-a6de-3025ebd43de0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.271063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78f63131-ad4a-4b3c-a6de-3025ebd43de0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.287666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-830d3e64-afe3-4a54-8283-86993fbb3f2a req-0d9ec7ff-a84a-4a1d-9af8-f2cf0028d13b tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups?id=05fa0fae-c6cf-433a-b048-dc55af7ef60f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451119 Dec 21 03:52:19.384259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78f63131-ad4a-4b3c-a6de-3025ebd43de0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.386873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78f63131-ad4a-4b3c-a6de-3025ebd43de0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.388080 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-78f63131-ad4a-4b3c-a6de-3025ebd43de0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6d04893c-473d-439d-a75d-2941193aa8b3 HTTP/1.1" status: 204 len: 168 time: 0.1992016 Dec 21 03:52:19.402728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f63131-ad4a-4b3c-a6de-3025ebd43de0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d04893c-473d-439d-a75d-2941193aa8b3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:19.520705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-c356a04d-063c-4cfe-8ec2-e57fda3a67ef tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:19.522323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-c356a04d-063c-4cfe-8ec2-e57fda3a67ef tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.31 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 946 time: 0.0562119 Dec 21 03:52:19.530273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be619759-3899-40ef-94bb-e3e59554a4bb req-5e7a45ef-8749-40cd-b69a-6b7b6fd03eba tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:19.531955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be619759-3899-40ef-94bb-e3e59554a4bb req-5e7a45ef-8749-40cd-b69a-6b7b6fd03eba tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0677631 Dec 21 03:52:19.581139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be619759-3899-40ef-94bb-e3e59554a4bb req-982287e7-b158-4c0f-a67b-ccd1b405ffac tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425720 Dec 21 03:52:19.621371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Deleting port 365ed775-700d-4bba-8a8e-a1419759e777 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:19.621711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.717016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] For port 365ed775-700d-4bba-8a8e-a1419759e777, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=365ed775-700d-4bba-8a8e-a1419759e777,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:19.717372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.824845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-75ecddbd-39a8-4dc6-bfab-fe15a55d503c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.896307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.896779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:19.896883 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Floating IP 763cfb1a-8f1e-49ad-bf81-a1738a7252e1 disassociated. External IP: 172.25.5.144, port: 365ed775-700d-4bba-8a8e-a1419759e777. Dec 21 03:52:19.897215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Calling delete_port for 365ed775-700d-4bba-8a8e-a1419759e777 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:19.974193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:19.977709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd93fc33-5d33-47bc-b184-89f58f3bdef5 req-a12c2846-a702-4641-8575-4a6f6055039c tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 210 time: 0.0271184 Dec 21 03:52:20.085047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:20.110877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:20.113138 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60da84cd-fba8-4a25-98d2-92100c190d18" -d '{"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-unplugged", "status": "completed", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:20.128080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:20.133162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:20.172849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event deleted for resources: {'Port': ['ID=365ed775-700d-4bba-8a8e-a1419759e777,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:20.178916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-474f6e5f-10f0-4d88-a3ea-f97793a34712 req-c48ad27a-66b2-4960-9b00-2653e6627378 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:20.186983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-474f6e5f-10f0-4d88-a3ea-f97793a34712 req-c48ad27a-66b2-4960-9b00-2653e6627378 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 946 time: 0.0702240 Dec 21 03:52:20.239937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-474f6e5f-10f0-4d88-a3ea-f97793a34712 req-870d53b5-c00e-44fd-b3be-7fa9847c6890 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522206 Dec 21 03:52:20.241806 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:20.271225 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a21c19b-263c-4a2f-8342-b5e998539a3e x-openstack-request-id: req-4a21c19b-263c-4a2f-8342-b5e998539a3e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:20.271522 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-unplugged", "status": "completed", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:20.271776 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4a21c19b-263c-4a2f-8342-b5e998539a3e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:20.272167 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'code': 200} Dec 21 03:52:20.300888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:20.305538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Router 6db05df4-511a-4269-9149-e3a795af8359 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:52:20.403158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe67e756-59dc-407c-afe2-28d6be484365 req-df742dd2-dc08-4620-b4ee-3e62e4f8ec06 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 210 time: 0.0356441 Dec 21 03:52:20.461192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:20.472027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] Sync routers for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:20.492870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:20.492870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:20.641569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:20.809774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4e656d-2a1c-429c-b011-2dd715c37aad req-8c0c179b-49bc-49b2-ba28-730509376683 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:20.811809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae4e656d-2a1c-429c-b011-2dd715c37aad req-8c0c179b-49bc-49b2-ba28-730509376683 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0739956 Dec 21 03:52:20.821840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54644) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:20.828937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] No DVR routers for this DVR port 365ed775-700d-4bba-8a8e-a1419759e777 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:20.832628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:20.836822 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fc617292-613a-470f-bec0-f9dbe8c99fd4 req-a91e75e9-b5b5-4935-bd3d-01b96351f456 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.31 "DELETE /v2.0/ports/365ed775-700d-4bba-8a8e-a1419759e777 HTTP/1.1" status: 204 len: 173 time: 1.3063648 Dec 21 03:52:20.837306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'name': 'network-vif-deleted', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:20.853145 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cee1253c-a852-411a-8945-a9bcf04e44c8" -d '{"events": [{"server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "name": "network-vif-deleted", "tag": "365ed775-700d-4bba-8a8e-a1419759e777"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:20.898743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae4e656d-2a1c-429c-b011-2dd715c37aad req-3310b0a4-b51c-4805-a9f7-1131b4b504f4 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643015 Dec 21 03:52:20.918793 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0fec91c-1819-4e38-a72b-b486b58d9d45 x-openstack-request-id: req-c0fec91c-1819-4e38-a72b-b486b58d9d45 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:20.920062 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "349f4a31-bae7-437d-8c39-c2e1a66ed3da", "name": "network-vif-deleted", "tag": "365ed775-700d-4bba-8a8e-a1419759e777", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:20.925842 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c0fec91c-1819-4e38-a72b-b486b58d9d45 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:20.925842 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '349f4a31-bae7-437d-8c39-c2e1a66ed3da', 'name': 'network-vif-deleted', 'tag': '365ed775-700d-4bba-8a8e-a1419759e777', 'status': 'completed', 'code': 200} Dec 21 03:52:20.937430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:20.967899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-132299884'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:20.973003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] Checking router: 6db05df4-511a-4269-9149-e3a795af8359 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:20.983500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:20.984228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:51:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:21.084873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:21.090344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.112814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.121466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:21.127000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e0e20e4-2a3f-4d68-a9f9-1d1d8650f31c req-3d7f2da5-2221-47c8-8ff3-9d8d2c142df3 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 210 time: 0.0635264 Dec 21 03:52:21.227586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.282167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.318150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:21.329995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6919a562-0cbc-44d5-bfe1-c2c1baa7db2d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:21.336810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.337150 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 72027ca3-bddd-484e-8ece-680372e2dacb of type vlan for network ee67a52b-0310-46e9-bd3e-9290f6b608a2 Dec 21 03:52:21.369359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:21.388859 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.399094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eda4952-c95e-4c9f-bf90-8a5b658f1d1a None None] The sync data for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 is: [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:03Z', 'revision_number': 4, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9b00b4ae-18ab-43d1-9823-ff309e6a5a81', 'name': '', 'network_id': '38668209-04ad-4602-a5aa-ab7bc4e1b781', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'mac_address': 'fa:16:3e:ed:54:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_interface', 'standard_attr_id': 888, 'fixed_ips': [{'subnet_id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:50:02Z', 'updated_at': '2021-12-21T03:50:08Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'subnets': [{'id': '2f0e0720-c89e-4a8a-888b-1e146411b74a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:21.507005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.517648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:21.518264 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:21.542653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-563c6ab7-a447-4e73-a7ca-71199b329b8a req-0ab0b5fc-2043-47ca-87d7-322023eb702e tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/ports?device_id=349f4a31-bae7-437d-8c39-c2e1a66ed3da HTTP/1.1" status: 200 len: 210 time: 0.0461473 Dec 21 03:52:21.616388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.7928712 Dec 21 03:52:21.623097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b5a89d-5a5a-480c-a294-cc249c4ba2c2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=ee67a52b-0310-46e9-bd3e-9290f6b608a2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:21.635512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ee67a52b-0310-46e9-bd3e-9290f6b608a2 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:21.655267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-77bb0bd1-0e50-4a48-965c-b0d019ba44cd tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:21.656742 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-77bb0bd1-0e50-4a48-965c-b0d019ba44cd tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.31 "GET /v2.0/networks?id=a4370ec5-c219-4c56-a17c-433f7c352683 HTTP/1.1" status: 200 len: 811 time: 0.1670363 Dec 21 03:52:21.715522 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:52:21.804611 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-746e56a5-8a12-42c7-9362-7984397bd102 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=068e67c3e7bc40e397d83d4acaa3afd1 HTTP/1.1" status: 200 len: 380 time: 0.1290669 Dec 21 03:52:21.806896 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f478355-1a71-4c7f-a6dc-8555f1c38ba5 None None] New status for floating IP 763cfb1a-8f1e-49ad-bf81-a1738a7252e1: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:52:21.829951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Request body: {'port': {'device_id': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'admin_state_up': True, 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'security_groups': ['aea81f67-7856-4a95-a9d4-70c172b531de']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:21.990416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:52:22.101926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7ecd0a-bad7-46e9-991c-25dc6b7d6d8b req-c6a58399-6bfe-4953-8797-28e6cc79b1c0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:22.116720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7ecd0a-bad7-46e9-991c-25dc6b7d6d8b req-c6a58399-6bfe-4953-8797-28e6cc79b1c0 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0912113 Dec 21 03:52:22.126833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:22.145716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'mac_address': 'fa:16:3e:9b:33:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:52:22.240884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.241126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Made reservation on behalf of 068e67c3e7bc40e397d83d4acaa3afd1 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:22.245202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.280446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fcb52c3e-b132-4793-9262-cc3fcb66fa75 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.298749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7ecd0a-bad7-46e9-991c-25dc6b7d6d8b req-29f3a668-e266-4bbb-b8da-831aec508c82 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1804862 Dec 21 03:52:22.306972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b5fc9274-dcad-49e4-9ea7-4a6e85e6581e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:52:22.363601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:22.400334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f647d50-70b1-451e-8d04-1d5396c89e0f req-d9893e9f-db32-434a-86bc-1b29a2ed7d5f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 210 time: 0.0597713 Dec 21 03:52:22.466020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.602232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:22.630484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.645026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Allocated IP 172.20.0.11 (a4370ec5-c219-4c56-a17c-433f7c352683/96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7/c0232674-4f5f-4ef3-aaac-768ebf42fd82) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:22.662300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:22.782971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54708) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:22.849214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.876536 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff1d4e3-7f4d-4287-88a0-a8f1a7857eab tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.926467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff1d4e3-7f4d-4287-88a0-a8f1a7857eab tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:22.962251 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.026361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Network a4370ec5-c219-4c56-a17c-433f7c352683 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:23.030169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:23.050343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:23.064107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event updated for resources: {'Port': ['ID=c0232674-4f5f-4ef3-aaac-768ebf42fd82,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:23.081450 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff1d4e3-7f4d-4287-88a0-a8f1a7857eab tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.085947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff1d4e3-7f4d-4287-88a0-a8f1a7857eab tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.092117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5ff1d4e3-7f4d-4287-88a0-a8f1a7857eab tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "DELETE /v2.0/security-groups/05fa0fae-c6cf-433a-b048-dc55af7ef60f HTTP/1.1" status: 204 len: 168 time: 0.3032327 Dec 21 03:52:23.092117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54716) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:23.134430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff1d4e3-7f4d-4287-88a0-a8f1a7857eab tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=05fa0fae-c6cf-433a-b048-dc55af7ef60f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:23.148811 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-67a456c1-202d-4618-a058-89efdb164646 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] show failed (client error): The resource could not be found. Dec 21 03:52:23.149804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-67a456c1-202d-4618-a058-89efdb164646 tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "GET /v2.0/security-groups/05fa0fae-c6cf-433a-b048-dc55af7ef60f HTTP/1.1" status: 404 len: 347 time: 0.0558565 Dec 21 03:52:23.155658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54718) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:23.176343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.195047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:23.195799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.295918 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-c52e45e3-10df-42ab-a4a6-4032cb44ec6b tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4722140 Dec 21 03:52:23.329386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Request body: {'port': {'device_id': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:23.582032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6937a478-8fc6-472d-8c61-0958e0a4684b None None] Provisioning complete for port c0232674-4f5f-4ef3-aaac-768ebf42fd82 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:23.582817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6937a478-8fc6-472d-8c61-0958e0a4684b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.608643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.664783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Deleting port 666ec68c-fa52-4f1f-9b84-078de6ae1a38 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:23.665493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.676564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14bdad63-c781-407b-921c-c374eb113879 req-f041f016-d376-4c84-b662-776797612c50 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:23.678420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14bdad63-c781-407b-921c-c374eb113879 req-f041f016-d376-4c84-b662-776797612c50 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1262522 Dec 21 03:52:23.692263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6937a478-8fc6-472d-8c61-0958e0a4684b None None] Port c0232674-4f5f-4ef3-aaac-768ebf42fd82 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:23.888805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14bdad63-c781-407b-921c-c374eb113879 req-e9b1c8dd-69e0-4b8c-9bd0-8f42bafd4f6e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1994557 Dec 21 03:52:23.891368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.903816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:23.939583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Calling delete_port for 666ec68c-fa52-4f1f-9b84-078de6ae1a38 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:24.021903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:24.052359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0232674-4f5f-4ef3-aaac-768ebf42fd82 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:52:24.061829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.076602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Transition to ACTIVE for port object c0232674-4f5f-4ef3-aaac-768ebf42fd82 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:52:24.128293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:24.128574 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.173801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.193175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4e3457-6c64-489d-aae3-229e2061e9ca req-8730059a-af69-4495-a6ef-dde6b53cbf6d tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:24.194757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd4e3457-6c64-489d-aae3-229e2061e9ca req-8730059a-af69-4495-a6ef-dde6b53cbf6d tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 932 time: 0.1980164 Dec 21 03:52:24.285348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Pushing event updated for resources: {'Port': ['ID=c0232674-4f5f-4ef3-aaac-768ebf42fd82,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:24.298371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.347756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:24.355044 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-829a5c34-dc10-42dd-95ef-96ffbc9229bc" -d '{"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:24.393447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:24.412769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd4e3457-6c64-489d-aae3-229e2061e9ca req-a58bf347-a501-4fb7-929b-494ff5399975 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1455660 Dec 21 03:52:24.510058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.552402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.559034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 365ed775-700d-4bba-8a8e-a1419759e777 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:24.623867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Attempting to bind port c0232674-4f5f-4ef3-aaac-768ebf42fd82 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:24.624829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Attempting to bind port c0232674-4f5f-4ef3-aaac-768ebf42fd82 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:24.625374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Attempting to bind port c0232674-4f5f-4ef3-aaac-768ebf42fd82 on network a4370ec5-c219-4c56-a17c-433f7c352683 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:24.632615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Port c0232674-4f5f-4ef3-aaac-768ebf42fd82 on network a4370ec5-c219-4c56-a17c-433f7c352683 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:52:24.635226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Attempting to bind port c0232674-4f5f-4ef3-aaac-768ebf42fd82 on network a4370ec5-c219-4c56-a17c-433f7c352683 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:24.664435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 51, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:24.665069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Checking segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:24.666152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Pushing event deleted for resources: {'Port': ['ID=666ec68c-fa52-4f1f-9b84-078de6ae1a38,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:24.668812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Bound using segment: {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:24.669462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Bound port: c0232674-4f5f-4ef3-aaac-768ebf42fd82, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4a9353ec-21a7-452e-9044-b5e6bec5e758', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:24.672518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.681329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 365ed775-700d-4bba-8a8e-a1419759e777 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:24.681798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 365ed775-700d-4bba-8a8e-a1419759e777 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:24.752843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:24.797575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.803110 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b8f45b9-779c-46d0-a34b-ad4a45832298 x-openstack-request-id: req-3b8f45b9-779c-46d0-a34b-ad4a45832298 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:24.804263 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:24.804767 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3b8f45b9-779c-46d0-a34b-ad4a45832298 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:24.805379 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'code': 200} Dec 21 03:52:24.901409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] For port c0232674-4f5f-4ef3-aaac-768ebf42fd82, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:24.906417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] For port c0232674-4f5f-4ef3-aaac-768ebf42fd82, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:24.914763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.918457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.922504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4753b0e5-e46e-49f5-b3c4-fc4129a9d06d tempest-ServersTestFqdnHostnames-1893869516 tempest-ServersTestFqdnHostnames-1893869516-project] 10.222.0.18 "DELETE /v2.0/floatingips/763cfb1a-8f1e-49ad-bf81-a1738a7252e1 HTTP/1.1" status: 204 len: 168 time: 1.7631028 Dec 21 03:52:24.922854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:24.927683 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:24.947937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54768) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:24.954281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:24.961763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063d3478-edf0-4500-b301-fca39976687c req-da672bd1-39ab-487e-9838-d0ce4607ce3e tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:24.963318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-063d3478-edf0-4500-b301-fca39976687c req-da672bd1-39ab-487e-9838-d0ce4607ce3e tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1098 time: 0.1512094 Dec 21 03:52:25.013565 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:25.086005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-063d3478-edf0-4500-b301-fca39976687c req-167e5f2c-6f94-462c-8487-1e57afb3aa90 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1081288 Dec 21 03:52:25.102655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Pushing event updated for resources: {'Port': ['ID=c0232674-4f5f-4ef3-aaac-768ebf42fd82,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:25.158966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:25.158966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:25.158966 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-6a1b3bc2-f2c4-4eba-a115-8a4b82b6fbe0 service neutron] 10.222.0.31 "PUT /v2.0/ports/c0232674-4f5f-4ef3-aaac-768ebf42fd82 HTTP/1.1" status: 200 len: 1093 time: 1.8421514 Dec 21 03:52:25.158966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:25.159941 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c" -d '{"events": [{"name": "network-changed", "server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:25.171270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc25265d-8906-4369-8594-09c1c5cd92cc req-ee83b554-34ec-4187-adbc-30fc2855ea69 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:25.179375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc25265d-8906-4369-8594-09c1c5cd92cc req-ee83b554-34ec-4187-adbc-30fc2855ea69 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0783172 Dec 21 03:52:25.216885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:25.226756 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:25.332149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc25265d-8906-4369-8594-09c1c5cd92cc req-dd1f51a8-4dae-480c-9974-c9a15332eeac tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1511197 Dec 21 03:52:25.423250 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7693c556-6351-46d7-be24-f1ea637f4003 x-openstack-request-id: req-7693c556-6351-46d7-be24-f1ea637f4003 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:25.423551 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:25.423833 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7693c556-6351-46d7-be24-f1ea637f4003 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:25.424216 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'status': 'completed', 'code': 200} Dec 21 03:52:25.487133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-9d0f873c-ddc0-4ea9-914a-a88f1fcd9f5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:25.490166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-9d0f873c-ddc0-4ea9-914a-a88f1fcd9f5d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=068e67c3e7bc40e397d83d4acaa3afd1&device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 1096 time: 0.1320996 Dec 21 03:52:25.565751 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-069196bb-4692-408d-b48b-e514d83006bb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82 HTTP/1.1" status: 200 len: 217 time: 0.0560329 Dec 21 03:52:25.727578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3e7c6b9-1e60-4357-841c-41aaf429c605 req-eba239ef-5cbc-43a0-a1f0-2d1c64e6c1af tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:25.727852 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:25.735196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3e7c6b9-1e60-4357-841c-41aaf429c605 req-eba239ef-5cbc-43a0-a1f0-2d1c64e6c1af tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 944 time: 0.1357799 Dec 21 03:52:25.750187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-cab79690-e879-4112-8011-08ba8e17f523 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:25.751766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-cab79690-e879-4112-8011-08ba8e17f523 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7 HTTP/1.1" status: 200 len: 850 time: 0.1634235 Dec 21 03:52:25.827993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-5ce49ae9-4a18-454a-ae1e-18e353b1be71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:25.828813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3e7c6b9-1e60-4357-841c-41aaf429c605 req-d23a3658-f28f-4592-8dbc-7967c2342df0 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875390 Dec 21 03:52:25.829687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-5ce49ae9-4a18-454a-ae1e-18e353b1be71 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a4370ec5-c219-4c56-a17c-433f7c352683&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0652738 Dec 21 03:52:25.847721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:25.934332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=11abf2fc-903a-4998-b1a7-de8e90d875ca,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:25.969372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '72027ca3-bddd-484e-8ece-680372e2dacb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:25.969892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: ee67a52b-0310-46e9-bd3e-9290f6b608a2, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:26.053326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network ee67a52b-0310-46e9-bd3e-9290f6b608a2 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:26.068782 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-e2911455-c047-498c-854b-b1fb5b000ae6 service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2289109 Dec 21 03:52:26.076834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.138495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ee67a52b-0310-46e9-bd3e-9290f6b608a2) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:26.150769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:26.152776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.154467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d782ad2-7c58-4db4-95c0-561693e35f65 None None] Network ee67a52b-0310-46e9-bd3e-9290f6b608a2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:26.256654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0f09c95-5d34-46d1-9782-ca7026611b15 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.3074987 Dec 21 03:52:26.257696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54802) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:26.264191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-442332911'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:26.302973 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0d0230f6-8252-40c9-9995-0960a16b4556 req-2b15a66e-e24e-4130-bc64-08960462c09b service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2227261 Dec 21 03:52:26.379452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-ee67a52b-0310-46e9-bd3e-9290f6b608a2', 'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '11abf2fc-903a-4998-b1a7-de8e90d875ca'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:26.380223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.436507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:26.441260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.519541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:26.541571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ade2789-dba3-4058-b3a6-cf542c1af7e6 req-c063ce01-964d-48bd-8266-b19e4129140c tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:26.549624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ade2789-dba3-4058-b3a6-cf542c1af7e6 req-c063ce01-964d-48bd-8266-b19e4129140c tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0810440 Dec 21 03:52:26.563977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.564586 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 750ce10b-7490-4cec-97cb-5342597f947f of type vlan for network fc5163dc-6b50-45e0-bd93-7304689f326f Dec 21 03:52:26.694558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-8fb39a14-51e0-428d-aa5a-45b631467c9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:26.696174 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-8fb39a14-51e0-428d-aa5a-45b631467c9a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=068e67c3e7bc40e397d83d4acaa3afd1&device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 1096 time: 0.1654882 Dec 21 03:52:26.704156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Allocated IP 2001:db8:0:ffff::2 (ee67a52b-0310-46e9-bd3e-9290f6b608a2/11abf2fc-903a-4998-b1a7-de8e90d875ca/def8992a-7925-4a11-92c9-1f4edef567c3) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:26.733354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Deleting port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:26.733696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.748408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ade2789-dba3-4058-b3a6-cf542c1af7e6 req-f4547f47-8ec6-4ec0-8ea4-1727a8bc0afd tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1978052 Dec 21 03:52:26.755759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.875502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:26.881385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:26.882406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.008268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] For port 9b00b4ae-18ab-43d1-9823-ff309e6a5a81, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:27.009340 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.029466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Calling delete_port for 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:27.057592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-196ec0ec-175c-4277-aba0-66395795dd72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:27.060028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-196ec0ec-175c-4277-aba0-66395795dd72 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a4370ec5-c219-4c56-a17c-433f7c352683 HTTP/1.1" status: 200 len: 912 time: 0.3431292 Dec 21 03:52:27.126720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.127984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.8689966 Dec 21 03:52:27.135946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3afa39fa-6d4b-4465-98cb-19dc92e9ef7d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=fc5163dc-6b50-45e0-bd93-7304689f326f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:27.139018 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-672bbb1f-d7dc-41b3-80a3-5830637a4fb2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82 HTTP/1.1" status: 200 len: 217 time: 0.0453064 Dec 21 03:52:27.142231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54824) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:27.153498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:27.179289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network fc5163dc-6b50-45e0-bd93-7304689f326f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:27.251371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.256527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-d4e125a4-6f2c-40d7-9b5c-11e6a95793fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:27.258541 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-d4e125a4-6f2c-40d7-9b5c-11e6a95793fd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7 HTTP/1.1" status: 200 len: 850 time: 0.1077287 Dec 21 03:52:27.326522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d05e32-889d-48d4-a496-d7569e786fe4 req-94f9f8d2-97f0-4a0a-956d-e8386666fcf0 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:27.335287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79d05e32-889d-48d4-a496-d7569e786fe4 req-94f9f8d2-97f0-4a0a-956d-e8386666fcf0 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 944 time: 0.3613961 Dec 21 03:52:27.388010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-81570759-c32a-4165-9ead-37f1b377142c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:27.390015 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-81570759-c32a-4165-9ead-37f1b377142c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a4370ec5-c219-4c56-a17c-433f7c352683&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1188548 Dec 21 03:52:27.416753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Network ee67a52b-0310-46e9-bd3e-9290f6b608a2 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:27.422313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79d05e32-889d-48d4-a496-d7569e786fe4 req-9ea7eb0c-8907-4ada-b886-b807c866cb6a tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858395 Dec 21 03:52:27.428714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:27.445028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:27.545357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:27.551007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.579924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-ee832196-1f35-4c51-b008-ff33ab7d08fb service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1801965 Dec 21 03:52:27.610146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.623629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Pushing event updated for resources: {'Port': ['ID=def8992a-7925-4a11-92c9-1f4edef567c3,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:27.665002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Attempting to bind port def8992a-7925-4a11-92c9-1f4edef567c3 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:27.665397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Attempting to bind port def8992a-7925-4a11-92c9-1f4edef567c3 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '72027ca3-bddd-484e-8ece-680372e2dacb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:27.665972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Attempting to bind port def8992a-7925-4a11-92c9-1f4edef567c3 on network ee67a52b-0310-46e9-bd3e-9290f6b608a2 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:27.676217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:27.676641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Checking segment: {'id': '72027ca3-bddd-484e-8ece-680372e2dacb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:27.682860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.682860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Bound using segment: {'id': '72027ca3-bddd-484e-8ece-680372e2dacb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:27.682860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Bound port: def8992a-7925-4a11-92c9-1f4edef567c3, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '72027ca3-bddd-484e-8ece-680372e2dacb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ee67a52b-0310-46e9-bd3e-9290f6b608a2'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:27.682860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.748047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Pushing event deleted for resources: {'Port': ['ID=9b00b4ae-18ab-43d1-9823-ff309e6a5a81,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:27.815198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] For port def8992a-7925-4a11-92c9-1f4edef567c3, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:27.836062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] For port def8992a-7925-4a11-92c9-1f4edef567c3, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=def8992a-7925-4a11-92c9-1f4edef567c3,segment=NetworkSegment(72027ca3-bddd-484e-8ece-680372e2dacb),segment_id=72027ca3-bddd-484e-8ece-680372e2dacb)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:27.910110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:27.941863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-a9445e35-0665-49f6-be75-c9a9279da5cb tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:52:27.950347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-a9445e35-0665-49f6-be75-c9a9279da5cb tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2105420 Dec 21 03:52:28.030834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:28.122020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10886b12-d548-43f6-9ae6-a1ac3038a59d None None] Pushing event updated for resources: {'Port': ['ID=def8992a-7925-4a11-92c9-1f4edef567c3,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:28.163820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c7aa7388-227f-4f12-b095-1d536f5f9e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:28.165559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c7aa7388-227f-4f12-b095-1d536f5f9e7f service neutron] 10.222.0.18 "GET /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 1095 time: 0.2089002 Dec 21 03:52:28.191853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:28.192312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Unknown quota resources ['binding']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:52:28.452196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:28.452866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:28.452866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:28.466135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e3fbfd-db3b-4aef-b829-f41e31918362 req-34b94971-9ad6-4853-9937-156b7de6ced3 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:28.470909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07e3fbfd-db3b-4aef-b829-f41e31918362 req-34b94971-9ad6-4853-9937-156b7de6ced3 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.5051646 Dec 21 03:52:28.480502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=6176e051-86c2-47c9-a7cc-7dcc759b68c1,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:28.491566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '750ce10b-7490-4cec-97cb-5342597f947f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:28.491940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: fc5163dc-6b50-45e0-bd93-7304689f326f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:28.512842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7077b18-8ad2-40f0-8d53-b41f0d5a3a8c req-5d3f9717-663e-4eb1-a327-2dcc155cf73b service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9232693 Dec 21 03:52:28.524402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:52:28.524737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:28.544561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:28.544997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:28.545297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:28.545745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Bound port: 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:28.634077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network fc5163dc-6b50-45e0-bd93-7304689f326f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:28.653469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07e3fbfd-db3b-4aef-b829-f41e31918362 req-e3c21afa-c542-4569-94bc-21edba62782f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1743903 Dec 21 03:52:28.681199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:28.699433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:28.745590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, fc5163dc-6b50-45e0-bd93-7304689f326f) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:28.758209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d12fb6e-dec3-4b90-bcf6-6db04e2a1f00 None None] Network fc5163dc-6b50-45e0-bd93-7304689f326f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:28.766495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:28.768704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:28.789112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:28.793295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-470f120c-5296-426e-a33d-fec1a1314ae6 service neutron] 10.222.0.18 "POST /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65/bindings HTTP/1.1" status: 201 len: 390 time: 0.6163764 Dec 21 03:52:28.920133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95cd0d50-4d1e-4356-9508-afe1c27bb9b5 req-7d72b4f4-b694-4b2c-93ae-78c46c8cd8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:28.921662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95cd0d50-4d1e-4356-9508-afe1c27bb9b5 req-7d72b4f4-b694-4b2c-93ae-78c46c8cd8aa tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 944 time: 0.1206305 Dec 21 03:52:28.964459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-844cb5cb-b443-4cc8-8483-df226abd2b23 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 1.8170249 Dec 21 03:52:28.964779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54846) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:29.018570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-fc5163dc-6b50-45e0-bd93-7304689f326f', 'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '6176e051-86c2-47c9-a7cc-7dcc759b68c1'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:29.019601 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:29.059388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Router 6db05df4-511a-4269-9149-e3a795af8359 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:52:29.420041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:29.427773 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e0b066e0-281f-419e-b32d-02fbad5fa745 admin admin] 10.222.0.18 "PUT /v2.0/routers/6db05df4-511a-4269-9149-e3a795af8359/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5016158 Dec 21 03:52:29.431439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Allocated IP 2001:db8::1 (fc5163dc-6b50-45e0-bd93-7304689f326f/6176e051-86c2-47c9-a7cc-7dcc759b68c1/34672315-d449-43a2-9eb0-5bc5f83cde47) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:29.431714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54858) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:29.765307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:29.767539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:29.775521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device def8992a-7925-4a11-92c9-1f4edef567c3 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:29.782092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] Sync routers for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:29.824373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb754619-8fce-4d55-b7b1-49f41d522de1 None None] Network ee67a52b-0310-46e9-bd3e-9290f6b608a2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:29.859438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:29.860230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:29.910698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95cd0d50-4d1e-4356-9508-afe1c27bb9b5 req-7a8cf823-90e3-40c1-9502-31b0889f6647 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.9816165 Dec 21 03:52:30.012238 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.051281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-30c37f2d-47d9-422e-bde3-d1298e2747bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:30.070619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-30c37f2d-47d9-422e-bde3-d1298e2747bb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1098 time: 0.5080676 Dec 21 03:52:30.252797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-897d3074-168a-4379-9d24-e35643f3785a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:30.254926 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-897d3074-168a-4379-9d24-e35643f3785a service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1669629 Dec 21 03:52:30.259672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:30.261336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fe38b65-5ee2-4291-8007-08e4ecccad9d req-96fb144e-d482-43f8-a29d-fc781008a6d3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:30.264045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fe38b65-5ee2-4291-8007-08e4ecccad9d req-96fb144e-d482-43f8-a29d-fc781008a6d3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.4346161 Dec 21 03:52:30.272100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b75d8be-f31d-4726-83ad-96256a515cee req-66313176-7d3e-4af4-bf9c-fecbf749d5d2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:30.280000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b75d8be-f31d-4726-83ad-96256a515cee req-66313176-7d3e-4af4-bf9c-fecbf749d5d2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2078059 Dec 21 03:52:30.286565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.334853 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c0208b37-d369-4ab5-92e1-0c703701e043 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 217 time: 0.0479727 Dec 21 03:52:30.394452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-105fdf87-91f0-475b-addd-5b7c9fd55906 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:30.396281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-105fdf87-91f0-475b-addd-5b7c9fd55906 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0519700 Dec 21 03:52:30.410922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fe38b65-5ee2-4291-8007-08e4ecccad9d req-275d6394-4347-4417-8562-fd3e9c02a07b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1287036 Dec 21 03:52:30.426542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b75d8be-f31d-4726-83ad-96256a515cee req-01ca152e-a937-4514-b6ae-47f5f7c73ab2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1418657 Dec 21 03:52:30.439175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c0232674-4f5f-4ef3-aaac-768ebf42fd82 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:52:30.439586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.484321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port 34672315-d449-43a2-9eb0-5bc5f83cde47 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:30.484838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.523982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-0fd7789c-c3bd-4116-9f55-34bd18282c1c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1191123 Dec 21 03:52:30.563855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Network fc5163dc-6b50-45e0-bd93-7304689f326f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:30.581839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8c13366f-19cd-486f-ac55-9be3aaef33a8 None None] Provisioning complete for port def8992a-7925-4a11-92c9-1f4edef567c3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:30.582208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c13366f-19cd-486f-ac55-9be3aaef33a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.679341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Deleting port 4459081b-f094-4195-870e-e1e6744c65ca {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:30.679341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.763169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port 34672315-d449-43a2-9eb0-5bc5f83cde47, host n-d-822053-11, got binding levels [] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:30.764869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.798256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for 34672315-d449-43a2-9eb0-5bc5f83cde47 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:30.861221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] For port 4459081b-f094-4195-870e-e1e6744c65ca, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4459081b-f094-4195-870e-e1e6744c65ca,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:30.888927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:30.889100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c0232674-4f5f-4ef3-aaac-768ebf42fd82, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:30.889650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Calling delete_port for 4459081b-f094-4195-870e-e1e6744c65ca owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:30.889794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Pushing event updated for resources: {'Port': ['ID=34672315-d449-43a2-9eb0-5bc5f83cde47,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:30.892430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:30.900206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'port_id': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'mac_address': 'fa:16:3e:e1:75:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:52:30.904827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:31.008396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-bb70e09f-a056-43f7-9f85-9fea24ea566f service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4747105 Dec 21 03:52:31.017903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port def8992a-7925-4a11-92c9-1f4edef567c3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:31.018291 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.168792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ec86a8-9b43-4e98-aa39-a3dc0aca7ea5 req-72d7309a-1ef4-43b8-94df-9862e9a4bd7a tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:31.174092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09ec86a8-9b43-4e98-aa39-a3dc0aca7ea5 req-72d7309a-1ef4-43b8-94df-9862e9a4bd7a tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 944 time: 0.0874922 Dec 21 03:52:31.212107 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e8754f95-0378-46d9-9ed8-b4f2827c37ba service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1353436 Dec 21 03:52:31.214557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.272087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.272416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0232674-4f5f-4ef3-aaac-768ebf42fd82 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:52:31.320978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c0232674-4f5f-4ef3-aaac-768ebf42fd82, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:31.373189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Attempting to bind port 34672315-d449-43a2-9eb0-5bc5f83cde47 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:31.376322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=34672315-d449-43a2-9eb0-5bc5f83cde47,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:31.376493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Attempting to bind port 34672315-d449-43a2-9eb0-5bc5f83cde47 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '750ce10b-7490-4cec-97cb-5342597f947f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:31.376493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Attempting to bind port 34672315-d449-43a2-9eb0-5bc5f83cde47 on network fc5163dc-6b50-45e0-bd93-7304689f326f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:31.381689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:31.382219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Checking segment: {'id': '750ce10b-7490-4cec-97cb-5342597f947f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:31.382729 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.383258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Bound using segment: {'id': '750ce10b-7490-4cec-97cb-5342597f947f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:31.384200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Bound port: 34672315-d449-43a2-9eb0-5bc5f83cde47, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '750ce10b-7490-4cec-97cb-5342597f947f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'fc5163dc-6b50-45e0-bd93-7304689f326f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:31.384200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.408919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185'}], 'enable_snat': True}, 'gw_port_id': '4459081b-f094-4195-870e-e1e6744c65ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:52:27Z', 'revision_number': 5, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port': {'id': '4459081b-f094-4195-870e-e1e6744c65ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:c7:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6db05df4-511a-4269-9149-e3a795af8359', 'device_owner': 'network:router_gateway', 'standard_attr_id': 885, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:50:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:31.435592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-51916453-ad23-4197-b578-82b8e96c2573 None None] Port 34672315-d449-43a2-9eb0-5bc5f83cde47 has been deleted concurrently {{(pid=110312) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Dec 21 03:52:31.441484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port 34672315-d449-43a2-9eb0-5bc5f83cde47 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:31.474232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09ec86a8-9b43-4e98-aa39-a3dc0aca7ea5 req-2a6ac6fe-ff1f-42f9-8a99-d091c7e2f1f3 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2904863 Dec 21 03:52:31.480566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c13366f-19cd-486f-ac55-9be3aaef33a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.491553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.527794 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.623321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Pushing event deleted for resources: {'Port': ['ID=4459081b-f094-4195-870e-e1e6744c65ca,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:31.670024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] Checking router: 6db05df4-511a-4269-9149-e3a795af8359 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:31.679109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c0232674-4f5f-4ef3-aaac-768ebf42fd82,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:31.711407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] Routers {'6db05df4-511a-4269-9149-e3a795af8359'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:31.712447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6db05df4-511a-4269-9149-e3a795af8359'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:31.821484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.825231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:31.882072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a69143f-abe0-47a0-9b28-8b947fe05eb3 req-d8bd8ca7-8110-47c8-bfdf-8c2dda575a4f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:31.944551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a69143f-abe0-47a0-9b28-8b947fe05eb3 req-d8bd8ca7-8110-47c8-bfdf-8c2dda575a4f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.3436120 Dec 21 03:52:32.012356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['c0232674-4f5f-4ef3-aaac-768ebf42fd82'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:32.022708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.025378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.088611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8c13366f-19cd-486f-ac55-9be3aaef33a8 None None] For port def8992a-7925-4a11-92c9-1f4edef567c3, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=def8992a-7925-4a11-92c9-1f4edef567c3,segment=NetworkSegment(72027ca3-bddd-484e-8ece-680372e2dacb),segment_id=72027ca3-bddd-484e-8ece-680372e2dacb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:32.093579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] Set router 6db05df4-511a-4269-9149-e3a795af8359 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:32.098656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.154442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.158986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6db05df4-511a-4269-9149-e3a795af8359 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:52:32.169217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.174089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1000d40-edc7-4e9a-ad23-e34f8694f47e admin admin] 10.222.0.18 "DELETE /v2.0/routers/6db05df4-511a-4269-9149-e3a795af8359 HTTP/1.1" status: 204 len: 168 time: 2.7413752 Dec 21 03:52:32.185521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:32.199954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:52:31Z', 'revision_number': 7, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:32.243046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e5e83a-ab7f-4160-8f21-614590afb798 req-8e33d522-a6d4-41d8-bfce-7f0c8c960fa1 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:32.244517 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:52:32.244979 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:52:32.246299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61e5e83a-ab7f-4160-8f21-614590afb798 req-8e33d522-a6d4-41d8-bfce-7f0c8c960fa1 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.5665922 Dec 21 03:52:32.254629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Deleting subnet 2f0e0720-c89e-4a8a-888b-1e146411b74a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:52:32.256381 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c13366f-19cd-486f-ac55-9be3aaef33a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.272486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.355410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c13366f-19cd-486f-ac55-9be3aaef33a8 None None] Pushing event updated for resources: {'Port': ['ID=def8992a-7925-4a11-92c9-1f4edef567c3,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:32.365254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a69143f-abe0-47a0-9b28-8b947fe05eb3 req-aef15f04-b6f2-4341-ac00-728b68f885d3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4197240 Dec 21 03:52:32.366767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e59014b9-87f8-4204-9e21-77ce86e0b1d5 None None] The sync data for ids ['6db05df4-511a-4269-9149-e3a795af8359'] in n-d-822053-11 is: [{'id': '6db05df4-511a-4269-9149-e3a795af8359', 'name': 'tempest-ServersTestFqdnHostnames-598268614-router', 'tenant_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:49:58Z', 'updated_at': '2021-12-21T03:52:31Z', 'revision_number': 7, 'project_id': 'e8135ee47f84444cb5d3eb45b6c7590b', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:32.418232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.465330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61e5e83a-ab7f-4160-8f21-614590afb798 req-200e9263-5bf8-4096-ac83-b476ccc99822 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2012627 Dec 21 03:52:32.487807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.499143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-56aed17e-2ac0-4cb6-b8e5-206f805accac None None] Provisioning complete for port def8992a-7925-4a11-92c9-1f4edef567c3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:32.499837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-56aed17e-2ac0-4cb6-b8e5-206f805accac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.612400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=6176e051-86c2-47c9-a7cc-7dcc759b68c1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:32.701958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.763677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.809338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc5163dc-6b50-45e0-bd93-7304689f326f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:32.823161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '750ce10b-7490-4cec-97cb-5342597f947f') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:32.824409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '750ce10b-7490-4cec-97cb-5342597f947f') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:32.843578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.861285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.870226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.918691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:32.919267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:32.922574 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:32.926854 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:32.939807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2f0e0720-c89e-4a8a-888b-1e146411b74a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:32.956648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c171a503-48a4-4170-b847-2b8f6ab31048 None None] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:32.963174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:32.967273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84dcc6e6-de53-4db3-bab6-001b63321696 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/2f0e0720-c89e-4a8a-888b-1e146411b74a HTTP/1.1" status: 204 len: 168 time: 0.7913191 Dec 21 03:52:32.975533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54902) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:33.067575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a71010-fc1b-4eb8-aab1-1ec43ca4cde9 req-eb9e5bca-8903-4c84-a7b2-de1874080554 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:33.069659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4a71010-fc1b-4eb8-aab1-1ec43ca4cde9 req-eb9e5bca-8903-4c84-a7b2-de1874080554 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 945 time: 0.1764302 Dec 21 03:52:33.183940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.220669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4a71010-fc1b-4eb8-aab1-1ec43ca4cde9 req-5c702808-d592-4da5-8fab-4ce51df9b4b3 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1318529 Dec 21 03:52:33.221532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.228584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.238156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/fc5163dc-6b50-45e0-bd93-7304689f326f HTTP/1.1" status: 204 len: 168 time: 4.2709911 Dec 21 03:52:33.240271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54904) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:33.261292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2128538606'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:33.284304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] DHCP port deletion for 38668209-04ad-4602-a5aa-ab7bc4e1b781 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:33.308207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da77f4a-44e2-4fe6-8d34-5e2f31173229 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=fc5163dc-6b50-45e0-bd93-7304689f326f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:33.339225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Deleting port e89d64be-3c0f-4397-b660-e4f7f387730c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:33.340124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.424209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:33.428507 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.518417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:33.559927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.560298 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 0707d19e-ff9c-4cd2-8c75-f9213b4df08a of type vlan for network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 Dec 21 03:52:33.615000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] For port e89d64be-3c0f-4397-b660-e4f7f387730c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e89d64be-3c0f-4397-b660-e4f7f387730c,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:33.615662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.654835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Calling delete_port for e89d64be-3c0f-4397-b660-e4f7f387730c owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:33.829100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device def8992a-7925-4a11-92c9-1f4edef567c3 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:33.841515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40c92fe4-4cad-44d5-ba20-eb4862e73fc4 None None] DHCP port deletion for fc5163dc-6b50-45e0-bd93-7304689f326f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:33.851826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a28ff16-2dfb-435f-b384-903c9f6d5378 None None] Could not find standard attr ID for object 34672315-d449-43a2-9eb0-5bc5f83cde47. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:52:33.867482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Deleting port e89d64be-3c0f-4397-b660-e4f7f387730c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:33.868195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.927562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.951011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c6d595a-5793-4503-a1ee-d2d975433b3f None None] Network fc5163dc-6b50-45e0-bd93-7304689f326f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:33.960402 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:33.971393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dbe4750-2886-4a24-9efd-dfd7215ddb00 req-e1334638-f3b6-4fb0-b3b8-25328332a793 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:33.972981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dbe4750-2886-4a24-9efd-dfd7215ddb00 req-e1334638-f3b6-4fb0-b3b8-25328332a793 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.3539233 Dec 21 03:52:33.994656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] No DVR routers for this DVR port e89d64be-3c0f-4397-b660-e4f7f387730c on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:34.007148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c6d595a-5793-4503-a1ee-d2d975433b3f None None] Network fc5163dc-6b50-45e0-bd93-7304689f326f could not be found, it might have been deleted concurrently. {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 21 03:52:34.058577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Pushing event deleted for resources: {'Port': ['ID=e89d64be-3c0f-4397-b660-e4f7f387730c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:34.064852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] For port e89d64be-3c0f-4397-b660-e4f7f387730c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e89d64be-3c0f-4397-b660-e4f7f387730c,segment=NetworkSegment(d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3),segment_id=d7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:34.073288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.108025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.114634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:34.115535 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.120115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c0232674-4f5f-4ef3-aaac-768ebf42fd82 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:34.129623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Calling delete_port for e89d64be-3c0f-4397-b660-e4f7f387730c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:34.180992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dbe4750-2886-4a24-9efd-dfd7215ddb00 req-be28b326-0f4b-4715-9556-132485603de3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1926713 Dec 21 03:52:34.201092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port def8992a-7925-4a11-92c9-1f4edef567c3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:34.201472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.246367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.258922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9b903a-f488-45cf-9680-4c113dcfaeef req-d4edeb09-02bb-4df7-9472-fc68c598b290 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:34.267795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9b903a-f488-45cf-9680-4c113dcfaeef req-d4edeb09-02bb-4df7-9472-fc68c598b290 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.6698470 Dec 21 03:52:34.269734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=0fb8dff7-c580-4824-b6e5-49d9ea7e0f77,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:34.306981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ce1435b8-a1be-4a65-ac2e-2403cabc00b3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.0611994 Dec 21 03:52:34.309591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54932) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:34.321037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:34.348312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:34.352410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['38668209-04ad-4602-a5aa-ab7bc4e1b781']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:34.388029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9b903a-f488-45cf-9680-4c113dcfaeef req-c54cc95a-c8e6-46b1-b375-6aad156f192e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1192491 Dec 21 03:52:34.394444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:34.394757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7b82dbd-1f49-4af3-b2d3-cab4ae26f7b3') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:34.412739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.429638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.437589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Releasing vlan 131 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:34.438064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.525806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:34.529711 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: from cryptography.utils import int_from_bytes Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: from cryptography.utils import int_from_bytes Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.543736 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:52:34.547648 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 03:52:34.560118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.589911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.595670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.602245 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] 10.222.0.18 "DELETE /v2.0/networks/38668209-04ad-4602-a5aa-ab7bc4e1b781 HTTP/1.1" status: 204 len: 168 time: 1.6248279 Dec 21 03:52:34.613679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Network 38668209-04ad-4602-a5aa-ab7bc4e1b781 is not hosted by any dhcp agent {{(pid=110312) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 03:52:34.614444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] No DVR routers for this DVR port e89d64be-3c0f-4397-b660-e4f7f387730c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:34.617833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port c0232674-4f5f-4ef3-aaac-768ebf42fd82 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:52:34.619205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ea6af6-8a53-4aec-980c-bcfc4232ae23 admin admin] Pushing event deleted for resources: {'Network': ['ID=38668209-04ad-4602-a5aa-ab7bc4e1b781,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:34.637503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:34.637503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71117500-a4ef-487c-a54c-9792479e36f1 None None] Pushing event deleted for resources: {'Port': ['ID=e89d64be-3c0f-4397-b660-e4f7f387730c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:34.651884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73fd0a1-c977-44fe-b5fc-535774d70d83 req-4b5225b0-3947-4aa6-98fd-4c2a45c0191a tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:34.660897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d73fd0a1-c977-44fe-b5fc-535774d70d83 req-4b5225b0-3947-4aa6-98fd-4c2a45c0191a tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 945 time: 0.1458926 Dec 21 03:52:34.668894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:34.670119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port c0232674-4f5f-4ef3-aaac-768ebf42fd82 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:34.670694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.672489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.730432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:34.734372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9b00b4ae-18ab-43d1-9823-ff309e6a5a81 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:34.762479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d73fd0a1-c977-44fe-b5fc-535774d70d83 req-65674895-f176-444d-829a-7b75d2c7fd41 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1006153 Dec 21 03:52:34.820358 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.860978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c0232674-4f5f-4ef3-aaac-768ebf42fd82, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:34.861816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:34.864362 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cab9f19d-9324-4569-b8cd-44c9e12cd72e" -d '{"events": [{"server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "name": "network-vif-plugged", "status": "completed", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:34.921520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:34.933920 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fb8c24e-c0d8-4663-8f56-e8c667b12fc1 x-openstack-request-id: req-1fb8c24e-c0d8-4663-8f56-e8c667b12fc1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:34.934213 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "name": "network-vif-plugged", "status": "completed", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:34.937592 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1fb8c24e-c0d8-4663-8f56-e8c667b12fc1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:34.938345 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'code': 200} Dec 21 03:52:35.088665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e89d64be-3c0f-4397-b660-e4f7f387730c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:35.098789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c0232674-4f5f-4ef3-aaac-768ebf42fd82,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:35.110003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.148349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e89d64be-3c0f-4397-b660-e4f7f387730c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:35.152076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e89d64be-3c0f-4397-b660-e4f7f387730c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:35.154100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9197587b-60d3-49bc-8e9b-47a0a9da7d28 req-cd6f3fc9-5b5c-4deb-999c-5a0cebd3d7f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.155551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 34672315-d449-43a2-9eb0-5bc5f83cde47 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:35.156956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54938) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:35.159150 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9197587b-60d3-49bc-8e9b-47a0a9da7d28 req-cd6f3fc9-5b5c-4deb-999c-5a0cebd3d7f5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 1098 time: 0.1008310 Dec 21 03:52:35.193804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 34672315-d449-43a2-9eb0-5bc5f83cde47 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:35.198502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 34672315-d449-43a2-9eb0-5bc5f83cde47 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:35.198982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4459081b-f094-4195-870e-e1e6744c65ca no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:35.232846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '0707d19e-ff9c-4cd2-8c75-f9213b4df08a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:35.233618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:35.241209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4459081b-f094-4195-870e-e1e6744c65ca {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:35.241570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4459081b-f094-4195-870e-e1e6744c65ca not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:35.242656 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9197587b-60d3-49bc-8e9b-47a0a9da7d28 req-d3a00ce3-a773-49e7-8857-b70f61b23308 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0723081 Dec 21 03:52:35.246306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=46d51fa5-33d1-466e-acf1-184b1bd7b5ff,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:35.273781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4763ec62-7062-40f2-b496-794c96ec5ece admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e8135ee47f84444cb5d3eb45b6c7590b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1135352 Dec 21 03:52:35.277249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54942) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:35.372270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3f5949f1-cf4f-495c-9063-f439c58016d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.378356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:35.420277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae8e7fd-86a0-4a26-92b8-287d61fc3bcc req-7b4634e0-5aae-4a5c-9577-d7ebe4a52fc7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.421906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae8e7fd-86a0-4a26-92b8-287d61fc3bcc req-7b4634e0-5aae-4a5c-9577-d7ebe4a52fc7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1102972 Dec 21 03:52:35.424120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3f5949f1-cf4f-495c-9063-f439c58016d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.465737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:35.475475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-817c514a-e4f1-434d-a16a-3bd2c0bba59c None None] Network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:35.525117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.526059 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.597081 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-99823162-1f57-438c-800c-856b7bcfaa85 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.0877399 Dec 21 03:52:35.606644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae8e7fd-86a0-4a26-92b8-287d61fc3bcc req-14d7eeb8-ee95-4dcf-bb75-599aefe3ebf6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1695018 Dec 21 03:52:35.627248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60e9568-1939-44ed-a9b4-69a3b62d9c59 req-6e39af01-2ff3-4cb4-a4f9-7d91770b04ac tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.637213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d60e9568-1939-44ed-a9b4-69a3b62d9c59 req-6e39af01-2ff3-4cb4-a4f9-7d91770b04ac tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1269372 Dec 21 03:52:35.638445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-0fb8dff7-c580-4824-b6e5-49d9ea7e0f77', 'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '46d51fa5-33d1-466e-acf1-184b1bd7b5ff'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:35.639729 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.698155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:35.703623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-953106ff-0ca7-4557-9eb0-90e7a78b4cfe tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.3896873 Dec 21 03:52:35.706916 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3f5949f1-cf4f-495c-9063-f439c58016d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.709978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3f5949f1-cf4f-495c-9063-f439c58016d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.710763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-487604709'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:35.712618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3f5949f1-cf4f-495c-9063-f439c58016d3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9834ffae-bcf9-49f9-b3df-a2c4adf5359f HTTP/1.1" status: 204 len: 168 time: 0.4343042 Dec 21 03:52:35.737172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5949f1-cf4f-495c-9063-f439c58016d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9834ffae-bcf9-49f9-b3df-a2c4adf5359f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:35.791640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d60e9568-1939-44ed-a9b4-69a3b62d9c59 req-00428c55-efd6-47e4-8b9e-116d698d7b61 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1527705 Dec 21 03:52:35.877462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.883178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.883178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.883178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.883178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.889342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.889984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:35.894273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-502dce8c-6548-47b2-b2b9-c55d91c79df6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6497 time: 0.2099888 Dec 21 03:52:35.920940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:35.929652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:35.958185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Allocated IP 2001:db8::1 (0fb8dff7-c580-4824-b6e5-49d9ea7e0f77/46d51fa5-33d1-466e-acf1-184b1bd7b5ff/a0a3c33b-3d23-41ba-b5dc-486328e004ae) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:35.992571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2641a634-e020-430f-b909-6a2453c3ae85 req-016f37e4-f274-4118-8b7f-25d8434fd33c tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.004495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2641a634-e020-430f-b909-6a2453c3ae85 req-016f37e4-f274-4118-8b7f-25d8434fd33c tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.1027937 Dec 21 03:52:36.131880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-a827f927-463e-4e7f-8446-6b80b7374e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.132639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-a827f927-463e-4e7f-8446-6b80b7374e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.133348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2641a634-e020-430f-b909-6a2453c3ae85 req-e1316c9c-b5ff-491a-b968-dd63f5ab876c tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1278815 Dec 21 03:52:36.146018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-a827f927-463e-4e7f-8446-6b80b7374e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.156453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-a827f927-463e-4e7f-8446-6b80b7374e55 service neutron] 10.222.0.54 "GET /v2.0/networks?id=04ed2fa2-4e59-410d-9778-4535a349c6b9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=19393033-2861-465d-ab20-b8ec53781acb&id=19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 200 len: 2293 time: 0.2152104 Dec 21 03:52:36.237084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:36.258038 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.258764 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 4442fce7-5444-4d12-b2d2-6cbc7efa4687 of type vlan for network 783bd7a9-29da-465c-9005-f07c759c5225 Dec 21 03:52:36.305795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-b8469659-f5a4-4195-b9f2-34315d0df012 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 200 len: 1000 time: 0.1426554 Dec 21 03:52:36.319602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.400351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.402225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.462518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-9b5c3882-fe16-4153-b133-56a9398e98c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.467136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-9b5c3882-fe16-4153-b133-56a9398e98c0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c714b82d-d957-4fc4-96b0-f175d6a234f5 HTTP/1.1" status: 200 len: 851 time: 0.1219618 Dec 21 03:52:36.524736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:36.526139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Pushing event updated for resources: {'Port': ['ID=a0a3c33b-3d23-41ba-b5dc-486328e004ae,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:36.529107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:36.531423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:36.560370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.569870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.570470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.589553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Attempting to bind port a0a3c33b-3d23-41ba-b5dc-486328e004ae on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:36.590244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Attempting to bind port a0a3c33b-3d23-41ba-b5dc-486328e004ae by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0707d19e-ff9c-4cd2-8c75-f9213b4df08a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:36.591017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Attempting to bind port a0a3c33b-3d23-41ba-b5dc-486328e004ae on network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:36.597992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:36.598863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Checking segment: {'id': '0707d19e-ff9c-4cd2-8c75-f9213b4df08a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:36.599523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.600136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Bound using segment: {'id': '0707d19e-ff9c-4cd2-8c75-f9213b4df08a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:36.600885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Bound port: a0a3c33b-3d23-41ba-b5dc-486328e004ae, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0707d19e-ff9c-4cd2-8c75-f9213b4df08a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0fb8dff7-c580-4824-b6e5-49d9ea7e0f77'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:36.601497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:36.655320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.9553533 Dec 21 03:52:36.658770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54982) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:36.665719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '783bd7a9-29da-465c-9005-f07c759c5225', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:36.706019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-9c2511b3-982f-4121-941d-7c52e1edf206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:36.708015 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-9c2511b3-982f-4121-941d-7c52e1edf206 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=04ed2fa2-4e59-410d-9778-4535a349c6b9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2326813 Dec 21 03:52:36.722060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8898fb6-62c8-4789-8f80-080670f63f01 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=783bd7a9-29da-465c-9005-f07c759c5225,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:36.748043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 783bd7a9-29da-465c-9005-f07c759c5225 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:36.777426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] For port a0a3c33b-3d23-41ba-b5dc-486328e004ae, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:36.865858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] For port a0a3c33b-3d23-41ba-b5dc-486328e004ae, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0a3c33b-3d23-41ba-b5dc-486328e004ae,segment=NetworkSegment(0707d19e-ff9c-4cd2-8c75-f9213b4df08a),segment_id=0707d19e-ff9c-4cd2-8c75-f9213b4df08a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:36.884906 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-ccf9acfb-7024-49da-a934-585151f50ac6 service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1638157 Dec 21 03:52:36.968441 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:37.020378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068743a1-082f-4d39-a560-e610a4d93f1b req-307a5137-1f91-4c0b-8503-73bae2166cb5 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:37.024883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-068743a1-082f-4d39-a560-e610a4d93f1b req-307a5137-1f91-4c0b-8503-73bae2166cb5 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0942242 Dec 21 03:52:37.085274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-25873909-7adf-4076-98b6-469c5d3a93da service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1925299 Dec 21 03:52:37.095384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-068743a1-082f-4d39-a560-e610a4d93f1b req-139fed88-5c1f-4b5e-987d-749f2260a76d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630801 Dec 21 03:52:37.096183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:37.099851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:37.189194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47f822b-a245-48f0-9838-ce6de9e0a039 None None] Pushing event updated for resources: {'Port': ['ID=a0a3c33b-3d23-41ba-b5dc-486328e004ae,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:37.249650 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-95556262-a21a-43ce-bb1d-c75bb161ee72 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.34&port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 217 time: 0.1486530 Dec 21 03:52:37.265142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Performing IP validity checks on allocation pools {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 03:52:37.265717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 03:52:37.366353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-77e56b85-6c19-41ed-991d-2db2ecbd950b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:37.368113 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-77e56b85-6c19-41ed-991d-2db2ecbd950b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.1010163 Dec 21 03:52:37.476739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-8790f482-4085-4b4f-a63c-a347f58e784b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:37.484015 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-8790f482-4085-4b4f-a63c-a347f58e784b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0976489 Dec 21 03:52:37.683672 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-50939443-d9f4-497c-894b-76fe103f415c service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1749272 Dec 21 03:52:37.695856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351d72e2-e27f-41fa-aad6-44ce69295365 req-143c101e-53e5-4b77-be69-5b7119bc6f2a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:37.704470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-351d72e2-e27f-41fa-aad6-44ce69295365 req-143c101e-53e5-4b77-be69-5b7119bc6f2a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.7748413 Dec 21 03:52:37.741947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa21fae-0f89-4045-8c3c-88ab7605feca req-01b0b172-c078-4417-bcf0-7ddaa6dba9e0 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:37.753035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfa21fae-0f89-4045-8c3c-88ab7605feca req-01b0b172-c078-4417-bcf0-7ddaa6dba9e0 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.2620609 Dec 21 03:52:37.758144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:37.854723 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-8cc37667-0ead-47fe-a15a-0c3352f17046 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1639998 Dec 21 03:52:37.868995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-351d72e2-e27f-41fa-aad6-44ce69295365 req-a4c7908a-e4e3-4cf8-b89d-7c4309a9b136 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1593056 Dec 21 03:52:37.919815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55012) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:37.925998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=49d8407f-26fa-4bd8-9634-0671eb20727f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:37.956601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-3ff158dc-e0d6-4443-a867-a55a4cd7a217 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.198&port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 217 time: 0.0944014 Dec 21 03:52:37.987422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfa21fae-0f89-4045-8c3c-88ab7605feca req-14fc7c4d-07a7-4af2-89e1-51461ca32237 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2333868 Dec 21 03:52:37.988516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '4442fce7-5444-4d12-b2d2-6cbc7efa4687', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '783bd7a9-29da-465c-9005-f07c759c5225'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:37.988861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: 783bd7a9-29da-465c-9005-f07c759c5225, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:38.059961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-d678e6ba-d53b-4f4a-ab81-aaa17d4aeffd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:38.063494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-d678e6ba-d53b-4f4a-ab81-aaa17d4aeffd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0954678 Dec 21 03:52:38.085544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 783bd7a9-29da-465c-9005-f07c759c5225 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:38.121971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-f9e55160-6d8d-4a1d-8b8a-a7bedca83a3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:38.123489 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-f9e55160-6d8d-4a1d-8b8a-a7bedca83a3d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0527942 Dec 21 03:52:38.148869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-1113571856-network', 'tenant_id': 'c6efab45cf074755a485f41e201aa464'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:38.191034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3bc45e-9933-4ba4-9aa2-4051439ada95 req-671bf515-0275-4f50-a950-301e32b70e5c tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:38.193024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c3bc45e-9933-4ba4-9aa2-4051439ada95 req-671bf515-0275-4f50-a950-301e32b70e5c tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.1048398 Dec 21 03:52:38.194308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 783bd7a9-29da-465c-9005-f07c759c5225) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:38.208383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0f2c6f8-e928-4b90-9f3e-7177d6001602 None None] Network 783bd7a9-29da-465c-9005-f07c759c5225 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:38.209687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55026) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:38.217005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:38.218003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:38.224044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Request body: {'floatingip': {'port_id': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:38.321706 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-7eb2b03d-0550-40b3-9655-bde218e370ab service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1872518 Dec 21 03:52:38.330332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:38.424092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-783bd7a9-29da-465c-9005-f07c759c5225', 'network_id': '783bd7a9-29da-465c-9005-f07c759c5225', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '49d8407f-26fa-4bd8-9634-0671eb20727f'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:38.425422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:38.511167 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-44fe657e-6575-4ca0-b1f9-2b8ae61a6888 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1811504 Dec 21 03:52:38.581579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-abaf3f27-9ce5-4523-8dcd-841be618c8fa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.95&port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d HTTP/1.1" status: 200 len: 217 time: 0.0605288 Dec 21 03:52:38.664936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-479663ff-bd5f-4bde-8b64-cdf972feb424 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:38.667578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-479663ff-bd5f-4bde-8b64-cdf972feb424 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0752847 Dec 21 03:52:38.733209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Allocated IP 2001:db8::3 (783bd7a9-29da-465c-9005-f07c759c5225/49d8407f-26fa-4bd8-9634-0671eb20727f/0016f30d-d2fd-4107-bf09-a345437868f9) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:38.775524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-2b775233-4260-4430-83aa-f45fdf2aeabe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:38.778568 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-2b775233-4260-4430-83aa-f45fdf2aeabe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1025462 Dec 21 03:52:38.910779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8feaa91f-cbcc-4f8a-928c-2447220821ca None None] Network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:38.990543 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-c45d3da8-8ac2-46b9-828d-d1ab30b4926f service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1963022 Dec 21 03:52:39.114294 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.115954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Made reservation on behalf of c6efab45cf074755a485f41e201aa464 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:39.118689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.126925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db51090f-fb9d-43b2-892f-1aff40f05648 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 2.4639034 Dec 21 03:52:39.131712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55034) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:39.187890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.199780 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-d0724c11-c28d-4e8f-aaa6-0cec90e298e9 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1979921 Dec 21 03:52:39.232196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.254552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.262179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0a3c33b-3d23-41ba-b5dc-486328e004ae up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:39.271500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ec9daa73-635c-4aa7-ac8c-47ab263977b5 None None] Provisioning complete for port a0a3c33b-3d23-41ba-b5dc-486328e004ae triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:39.272119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec9daa73-635c-4aa7-ac8c-47ab263977b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.297075 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-b029092f-39ff-4ce8-a849-643d48389d7a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.123&port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e HTTP/1.1" status: 200 len: 217 time: 0.0886199 Dec 21 03:52:39.343880 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.435829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd99d51e-cb5b-4f2c-968c-f1d67d67848a req-9488fdaf-3455-453c-be6f-3d3a2623c3b1 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:39.445200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd99d51e-cb5b-4f2c-968c-f1d67d67848a req-9488fdaf-3455-453c-be6f-3d3a2623c3b1 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 1.1405072 Dec 21 03:52:39.481100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Network 783bd7a9-29da-465c-9005-f07c759c5225 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:39.504154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:39.515344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:39.568531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e5096ed-f1e5-450a-aca9-3cd5895f5c95 req-cbcd216a-6392-4523-83e5-25d4261a167e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:39.585044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e5096ed-f1e5-450a-aca9-3cd5895f5c95 req-cbcd216a-6392-4523-83e5-25d4261a167e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.4580450 Dec 21 03:52:39.594130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Pushing event updated for resources: {'Port': ['ID=0016f30d-d2fd-4107-bf09-a345437868f9,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:39.674325 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec9daa73-635c-4aa7-ac8c-47ab263977b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.709849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e5096ed-f1e5-450a-aca9-3cd5895f5c95 req-a6055ea5-0c28-4750-bdbf-d5f08c84ccb8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229150 Dec 21 03:52:39.720367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a0a3c33b-3d23-41ba-b5dc-486328e004ae triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:39.721389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.748615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd99d51e-cb5b-4f2c-968c-f1d67d67848a req-018043a8-80f6-4fd7-8ade-6a5b9019c790 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3024302 Dec 21 03:52:39.772118 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.793653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Attempting to bind port 0016f30d-d2fd-4107-bf09-a345437868f9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:39.794249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Attempting to bind port 0016f30d-d2fd-4107-bf09-a345437868f9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4442fce7-5444-4d12-b2d2-6cbc7efa4687', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '783bd7a9-29da-465c-9005-f07c759c5225'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:39.794838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Attempting to bind port 0016f30d-d2fd-4107-bf09-a345437868f9 on network 783bd7a9-29da-465c-9005-f07c759c5225 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:39.798193 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Floating IP c1fc1249-2bd4-4e7a-b521-c3523185276b associated. External IP: 172.25.5.69, port: c0232674-4f5f-4ef3-aaac-768ebf42fd82. Dec 21 03:52:39.806137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:39.806137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Checking segment: {'id': '4442fce7-5444-4d12-b2d2-6cbc7efa4687', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '783bd7a9-29da-465c-9005-f07c759c5225'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:39.806137 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.806137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Bound using segment: {'id': '4442fce7-5444-4d12-b2d2-6cbc7efa4687', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '783bd7a9-29da-465c-9005-f07c759c5225'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:39.806137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Bound port: 0016f30d-d2fd-4107-bf09-a345437868f9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4442fce7-5444-4d12-b2d2-6cbc7efa4687', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '783bd7a9-29da-465c-9005-f07c759c5225'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:39.807131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:39.889862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] For port 0016f30d-d2fd-4107-bf09-a345437868f9, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:39.894260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] For port 0016f30d-d2fd-4107-bf09-a345437868f9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0016f30d-d2fd-4107-bf09-a345437868f9,segment=NetworkSegment(4442fce7-5444-4d12-b2d2-6cbc7efa4687),segment_id=4442fce7-5444-4d12-b2d2-6cbc7efa4687)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:39.945093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ec9daa73-635c-4aa7-ac8c-47ab263977b5 None None] For port a0a3c33b-3d23-41ba-b5dc-486328e004ae, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0a3c33b-3d23-41ba-b5dc-486328e004ae,segment=NetworkSegment(0707d19e-ff9c-4cd2-8c75-f9213b4df08a),segment_id=0707d19e-ff9c-4cd2-8c75-f9213b4df08a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:40.007092 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.205322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-e6d3c74c-8ea1-4c10-a135-a40abf2fdc3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:40.208184 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-e6d3c74c-8ea1-4c10-a135-a40abf2fdc3b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.9012363 Dec 21 03:52:40.305313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-416eca75-19d0-4d1a-955d-22414115d465 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:40.307448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-416eca75-19d0-4d1a-955d-22414115d465 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0906074 Dec 21 03:52:40.363609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51e92160-b111-4e5f-847e-601060750f58 req-890d3fae-35a1-4422-9bda-b0e40cd4b5d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:40.365150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51e92160-b111-4e5f-847e-601060750f58 req-890d3fae-35a1-4422-9bda-b0e40cd4b5d1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.6825595 Dec 21 03:52:40.450789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.457289 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec9daa73-635c-4aa7-ac8c-47ab263977b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.504790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b4a720-715e-4e8a-b732-ae3897779293 None None] Pushing event updated for resources: {'Port': ['ID=0016f30d-d2fd-4107-bf09-a345437868f9,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:40.529586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-449ed872-5eaf-48d5-98c0-758369179f8e service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2120152 Dec 21 03:52:40.574468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.621712 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:52:40.622218 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:52:40.657493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7bca0a0c-1d99-4681-96eb-93da6f819de4 None None] Provisioning complete for port a0a3c33b-3d23-41ba-b5dc-486328e004ae triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:40.661271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7bca0a0c-1d99-4681-96eb-93da6f819de4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.661470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9daa73-635c-4aa7-ac8c-47ab263977b5 None None] Pushing event updated for resources: {'Port': ['ID=a0a3c33b-3d23-41ba-b5dc-486328e004ae,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:40.666004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.693082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51e92160-b111-4e5f-847e-601060750f58 req-1ef155f7-7bd6-41e3-a826-f3c48b0771ca service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2988694 Dec 21 03:52:40.719617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port 0016f30d-d2fd-4107-bf09-a345437868f9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:40.720357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:40.903466 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-cadaad5c-d4dd-4519-b2b8-7378dbba84dd service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3644290 Dec 21 03:52:40.906281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:40.994057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76391693-2944-40fa-8b49-94638d94173f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:41.004744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.005121 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Added segment eb1f5276-15a6-4cd0-b282-ce3fce035c1e of type vlan for network 02e2ef7c-d00c-4471-ae34-58e2e22c435a Dec 21 03:52:41.047190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port 0016f30d-d2fd-4107-bf09-a345437868f9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0016f30d-d2fd-4107-bf09-a345437868f9,segment=NetworkSegment(4442fce7-5444-4d12-b2d2-6cbc7efa4687),segment_id=4442fce7-5444-4d12-b2d2-6cbc7efa4687)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:41.047492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.061183 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-9181e9ac-d767-4991-bd44-f41a84206986 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=3136aa12-8de7-43c2-8cde-55879999fd27 HTTP/1.1" status: 200 len: 217 time: 0.0914714 Dec 21 03:52:41.109376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for 0016f30d-d2fd-4107-bf09-a345437868f9 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:41.127344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c48ca9-b7e3-4f89-b9a9-2d5777cc2c98 req-9f76122b-a5ae-482e-b289-df7fab696fb1 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:41.128970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59c48ca9-b7e3-4f89-b9a9-2d5777cc2c98 req-9f76122b-a5ae-482e-b289-df7fab696fb1 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.2748327 Dec 21 03:52:41.139920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.175215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-6e749b94-c208-44d0-9cde-351b69af9be5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:41.176939 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-6e749b94-c208-44d0-9cde-351b69af9be5 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.1081569 Dec 21 03:52:41.189431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Router afc96f13-e71f-4841-88a7-5c551515b510 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:52:41.201029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8721a37-01a9-40bd-956e-69158c7aea37 req-f2f7d9c9-cfae-4dd8-b686-b6fe59499179 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:41.202578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8721a37-01a9-40bd-956e-69158c7aea37 req-f2f7d9c9-cfae-4dd8-b686-b6fe59499179 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2510264 Dec 21 03:52:41.273330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-77dc8049-ac6a-49c0-874a-5e69734dcbce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:41.274819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-77dc8049-ac6a-49c0-874a-5e69734dcbce service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0830119 Dec 21 03:52:41.373621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59c48ca9-b7e3-4f89-b9a9-2d5777cc2c98 req-187d50b6-15e9-48ad-a82a-bb9bb1d000ec tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2360268 Dec 21 03:52:41.389081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.390107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:41.390704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.477714 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-e827a008-c69a-4062-9b40-58785c44b9c4 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1931040 Dec 21 03:52:41.497898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0016f30d-d2fd-4107-bf09-a345437868f9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:41.554344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8721a37-01a9-40bd-956e-69158c7aea37 req-afab8dc3-a96f-4d31-9e54-700fa0359d96 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3362300 Dec 21 03:52:41.575404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 3.6538382 Dec 21 03:52:41.583945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55070) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:41.681536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Request body: {'subnet': {'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-1113571856-subnet', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:41.697355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-0c6d353a-3e8d-49ea-96cf-5e63f6da55a4 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2064743 Dec 21 03:52:41.704032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 0016f30d-d2fd-4107-bf09-a345437868f9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:41.704518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.755675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f21c5d7-6553-499a-89a6-8b5525d3f945 admin admin] Pushing event updated for resources: {'Network': ['ID=02e2ef7c-d00c-4471-ae34-58e2e22c435a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:41.784106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:41.822716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:41.837080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] Sync routers for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:41.846619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:41.881438 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:41.883524 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:41.892595 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-46d12ae4-baab-47b7-ab9a-5a851388a2e6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 200 len: 217 time: 0.1183486 Dec 21 03:52:41.973748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-46cd4930-6837-46c7-9d0f-a17a01e4249f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "PUT /v2.0/floatingips/c1fc1249-2bd4-4e7a-b521-c3523185276b HTTP/1.1" status: 200 len: 991 time: 3.7626219 Dec 21 03:52:41.974463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Made reservation on behalf of c6efab45cf074755a485f41e201aa464 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:41.989679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:42.007681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:42.029504 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-adf3cffa-b4e5-41f9-8327-2f9288090980" -d '{"events": [{"name": "network-changed", "server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:42.045675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Could not find standard attr ID for object 0016f30d-d2fd-4107-bf09-a345437868f9. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:52:42.045675 n-d-822053-11 neutron-server[110312]: INFO neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No ports have port_id starting with 0016f30d-d2fd-4107-bf09-a345437868f9 Dec 21 03:52:42.045675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0a3c33b-3d23-41ba-b5dc-486328e004ae up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:42.055808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:42.109410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-dab66e7a-7e92-4b55-8191-fee25f772c86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:42.111445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-dab66e7a-7e92-4b55-8191-fee25f772c86 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.2082224 Dec 21 03:52:42.266617 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc32e888-0e73-4437-8d4a-1912dbabd894 x-openstack-request-id: req-dc32e888-0e73-4437-8d4a-1912dbabd894 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:42.267767 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:42.268209 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dc32e888-0e73-4437-8d4a-1912dbabd894 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:42.268790 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'status': 'completed', 'code': 200} Dec 21 03:52:42.270104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=0016f30d-d2fd-4107-bf09-a345437868f9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:42.297132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a0a3c33b-3d23-41ba-b5dc-486328e004ae triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:42.297805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:42.303654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-f611df7b-19ce-43dc-8000-42b4b9c844ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:42.305982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-f611df7b-19ce-43dc-8000-42b4b9c844ff service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1775742 Dec 21 03:52:42.313051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port 0016f30d-d2fd-4107-bf09-a345437868f9 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:42.367787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:42.379373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-109f6be2-18d4-4d16-986e-ae27c5a8b1ba None None] Network 783bd7a9-29da-465c-9005-f07c759c5225 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:42.432904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-1adcae11-cc74-4f89-a925-596b2220390c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:42.435583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-1adcae11-cc74-4f89-a925-596b2220390c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=068e67c3e7bc40e397d83d4acaa3afd1&device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 1098 time: 0.1070859 Dec 21 03:52:42.592689 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:42.595121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d1aba31c-52bd-4f21-b165-5544276d9242 None None] Could not find standard attr ID for object 0016f30d-d2fd-4107-bf09-a345437868f9. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:52:42.606346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-b8e5f2c5-403c-4f56-bed1-9de5ab6254d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:42.608981 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-b8e5f2c5-403c-4f56-bed1-9de5ab6254d7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a4370ec5-c219-4c56-a17c-433f7c352683 HTTP/1.1" status: 200 len: 912 time: 0.1448076 Dec 21 03:52:42.689570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e12343-d75c-4510-ad06-03d40c09ab6f req-5302076b-4674-4bb5-b58c-c2bea9c9f229 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:42.700372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82e12343-d75c-4510-ad06-03d40c09ab6f req-5302076b-4674-4bb5-b58c-c2bea9c9f229 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1686766 Dec 21 03:52:42.757307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-48015caf-4d1c-44a8-9dee-9c8ca5d354e2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82 HTTP/1.1" status: 200 len: 999 time: 0.1247268 Dec 21 03:52:42.760329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-fc5ee22e-1813-46fe-ab8f-41ce12c48bc9 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4463992 Dec 21 03:52:42.794443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:42.886854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=49d8407f-26fa-4bd8-9634-0671eb20727f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:42.950176 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b9147e30-6cb9-4696-a314-d766b4fb4569 req-9c1089da-f5dd-4010-989d-193e174f2dcc service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1695218 Dec 21 03:52:42.967059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-e75415c4-119a-4783-b3ab-7a6b066b5d25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:42.968531 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-e75415c4-119a-4783-b3ab-7a6b066b5d25 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7 HTTP/1.1" status: 200 len: 850 time: 0.2026656 Dec 21 03:52:43.003444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ee936c7-3af4-472c-b427-98015ef84d41 None None] Network 783bd7a9-29da-465c-9005-f07c759c5225 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:43.031440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-0772c690-b308-4b58-9764-e75fac629003 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:43.033137 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-0772c690-b308-4b58-9764-e75fac629003 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a4370ec5-c219-4c56-a17c-433f7c352683&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0464945 Dec 21 03:52:43.035288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a28da7-ba4c-4e57-af1c-088c12f9c053 req-8812b021-57dd-4472-9471-be2e00ece33a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:43.040295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77a28da7-ba4c-4e57-af1c-088c12f9c053 req-8812b021-57dd-4472-9471-be2e00ece33a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.3227787 Dec 21 03:52:43.085390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c1fc1249-2bd4-4e7a-b521-c3523185276b', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'floating_ip_address': '172.25.5.69', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'port_id': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1058, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'mac_address': 'fa:16:3e:e1:75:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:52:16Z', 'updated_at': '2021-12-21T03:52:38Z', 'revision_number': 1, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:43.115658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82e12343-d75c-4510-ad06-03d40c09ab6f req-96430e48-011b-4186-a5c9-674159404c39 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4129817 Dec 21 03:52:43.137011 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] Checking router: afc96f13-e71f-4841-88a7-5c551515b510 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:43.154391 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:43.155322 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:43.194065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.207882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6e955fb-c3c1-4feb-a746-35143f9b376a None None] DHCP port deletion for 783bd7a9-29da-465c-9005-f07c759c5225 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:43.325040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0016f30d-d2fd-4107-bf09-a345437868f9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:43.338185 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-f26fba8c-3eae-4152-a3d5-4013a5d6dcae service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2758253 Dec 21 03:52:43.374572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['783bd7a9-29da-465c-9005-f07c759c5225']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:43.385598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 0016f30d-d2fd-4107-bf09-a345437868f9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:43.385851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0016f30d-d2fd-4107-bf09-a345437868f9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:43.395105 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:43.422065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77a28da7-ba4c-4e57-af1c-088c12f9c053 req-867d2307-5989-405a-b872-ed9d158b2a29 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3218725 Dec 21 03:52:43.440628 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.455811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4442fce7-5444-4d12-b2d2-6cbc7efa4687') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:43.456133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4442fce7-5444-4d12-b2d2-6cbc7efa4687') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:43.544287 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adf3cffa-b4e5-41f9-8327-2f9288090980 req-1bee41b3-b0da-4136-8940-e7fe4e670bd7 service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2051578 Dec 21 03:52:43.554497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.575739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Pushing event updated for resources: {'Subnet': ['ID=394148b6-6bdf-4aaa-94d7-be0fbbf6634e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:43.608020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-07d36b61-b3e1-494b-aff1-c14e4b9d461e req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'security_group': {'name': 'tempest-ServerRescueTestJSONUnderV235-securitygroup-2101739864', 'description': 'tempest-description-716610210'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:43.657659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.664116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Checking segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:43.665124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Network hostable DHCP agents. Network: 02e2ef7c-d00c-4471-ae34-58e2e22c435a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:43.678848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:43.679544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:43.684444 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:43.791836 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c1fc1249-2bd4-4e7a-b521-c3523185276b', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'floating_ip_address': '172.25.5.69', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'port_id': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1058, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'mac_address': 'fa:16:3e:e1:75:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:52:16Z', 'updated_at': '2021-12-21T03:52:38Z', 'revision_number': 1, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:43.800907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07d36b61-b3e1-494b-aff1-c14e4b9d461e req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.837700 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a280e3f8-bd52-463f-8bbb-8cf1c730dbf8 None None] The sync data for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 is: [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c1fc1249-2bd4-4e7a-b521-c3523185276b', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'floating_ip_address': '172.25.5.69', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'port_id': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1058, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'mac_address': 'fa:16:3e:e1:75:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:52:16Z', 'updated_at': '2021-12-21T03:52:38Z', 'revision_number': 1, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:43.907959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07d36b61-b3e1-494b-aff1-c14e4b9d461e req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.913163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.934233 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:43.938768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/783bd7a9-29da-465c-9005-f07c759c5225 HTTP/1.1" status: 204 len: 168 time: 4.8056314 Dec 21 03:52:43.942553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55118) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:43.948142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1408360096'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:43.949595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f475b548-87e0-46b6-9a72-630cc77c6c62 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=783bd7a9-29da-465c-9005-f07c759c5225,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:43.955656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:43.978688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07d36b61-b3e1-494b-aff1-c14e4b9d461e req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.012604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4fbd9874-f292-4816-b164-fa0779ad7468,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:44.075635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:44.079421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.097392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 02e2ef7c-d00c-4471-ae34-58e2e22c435a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:44.107582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f9adafc-a6f2-4799-9922-138e8d2f4c15 None None] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:44.127596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:44.129251 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.130411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:44.143461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.144071 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment c8af6b9c-cff4-4bcb-8847-4c1b205078dd of type vlan for network d693b3ee-2988-4a89-878d-e71d9dd5fe79 Dec 21 03:52:44.182546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07d36b61-b3e1-494b-aff1-c14e4b9d461e req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.187058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07d36b61-b3e1-494b-aff1-c14e4b9d461e req-46fca64d-eca0-40c4-9c76-b8aeb9c85daf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1831 time: 0.5826519 Dec 21 03:52:44.218872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25538f5d-3278-4e0d-ac97-7bce91d20599 req-8f97520a-ebd4-4c35-b713-27a6596c1bdf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:44.220641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25538f5d-3278-4e0d-ac97-7bce91d20599 req-8f97520a-ebd4-4c35-b713-27a6596c1bdf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 946 time: 0.1901255 Dec 21 03:52:44.274796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.275462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db6d0d6d-5f11-44d2-bf0b-15bdb9bd5cda admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 2.6140592 Dec 21 03:52:44.278660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:44.284403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:44.285139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5caa5a83-3d6d-4b81-895e-811fcd05d8fd None None] New status for floating IP c1fc1249-2bd4-4e7a-b521-c3523185276b: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:52:44.348171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25538f5d-3278-4e0d-ac97-7bce91d20599 req-3ef142a3-26ad-46df-89c7-8dae8abc235f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1049027 Dec 21 03:52:44.441615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'project_id': 'c6efab45cf074755a485f41e201aa464', 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:44.442487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.452680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.459093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:44.459836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.461527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2db070-7a04-4bb3-8dc6-b44295cb3bb2 req-baaeed3c-ccb4-4f7e-9b03-a3b3a722cd62 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:44.469079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d2db070-7a04-4bb3-8dc6-b44295cb3bb2 req-baaeed3c-ccb4-4f7e-9b03-a3b3a722cd62 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1409550 Dec 21 03:52:44.475824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.479563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.553783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=d693b3ee-2988-4a89-878d-e71d9dd5fe79,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:44.564823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.565180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.565536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.565881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.566224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.566561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.566897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.569534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.569902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.570253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.570691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.571212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.571681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:44.658270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d693b3ee-2988-4a89-878d-e71d9dd5fe79 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:44.667727 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-47281675-5308-4836-aa30-b348ef4a9291 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.7238290 Dec 21 03:52:44.670489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55130) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:44.675428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:44.720607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-fc93a51c-17cf-4026-841f-51c873f6bba5 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-ServerRescueTestJSONUnderV235-securitygroup-2101739864&fields=id&tenant_id=920e98327f8340b0966241ad0871434f HTTP/1.1" status: 200 len: 267 time: 0.2034872 Dec 21 03:52:44.731784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:44.812186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d2db070-7a04-4bb3-8dc6-b44295cb3bb2 req-0fa4d2a2-7019-4582-b9ee-07995b239607 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3265066 Dec 21 03:52:44.893809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Allocated IP 172.20.0.2 (02e2ef7c-d00c-4471-ae34-58e2e22c435a/394148b6-6bdf-4aaa-94d7-be0fbbf6634e/f40c716e-2578-4560-85ad-7ffd1f002677) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:44.966881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:44.971231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.005357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.048543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-fab4f12a-0aaf-4fb5-9cd7-644195357bdf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:45.058525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-fab4f12a-0aaf-4fb5-9cd7-644195357bdf tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.3249707 Dec 21 03:52:45.065997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'port': {'security_groups': ['b3a7c1b3-cd89-415c-8815-d4c442d51c8e', '4fbd9874-f292-4816-b164-fa0779ad7468']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:45.191694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.262961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.270198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.338290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:45.343472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:45.356702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:45.446418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Pushing event updated for resources: {'Port': ['ID=f40c716e-2578-4560-85ad-7ffd1f002677,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:45.460797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Attempting to bind port f40c716e-2578-4560-85ad-7ffd1f002677 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:45.462601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Attempting to bind port f40c716e-2578-4560-85ad-7ffd1f002677 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:45.467594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Attempting to bind port f40c716e-2578-4560-85ad-7ffd1f002677 on network 02e2ef7c-d00c-4471-ae34-58e2e22c435a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:45.470840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:45.471511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Checking segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:45.472701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.473281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Bound using segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:45.474404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Bound port: f40c716e-2578-4560-85ad-7ffd1f002677, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:45.475150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.487590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.567868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=2a50db66-a41e-4c32-8907-915c9e04530b,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:45.582766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] For port f40c716e-2578-4560-85ad-7ffd1f002677, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:45.589186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] For port f40c716e-2578-4560-85ad-7ffd1f002677, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f40c716e-2578-4560-85ad-7ffd1f002677,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:45.652344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:45.654510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: d693b3ee-2988-4a89-878d-e71d9dd5fe79, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:45.660244 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.699730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c182e4a5-3075-452f-ac39-818afcc57da8 req-e17b1004-d1a8-4b9e-9e6c-95783a30e937 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:45.701268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c182e4a5-3075-452f-ac39-818afcc57da8 req-e17b1004-d1a8-4b9e-9e6c-95783a30e937 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 946 time: 0.1913943 Dec 21 03:52:45.706744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.748101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.749825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network d693b3ee-2988-4a89-878d-e71d9dd5fe79 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:45.761186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cf7d08-268f-40ff-a5d5-a98254a0b6a2 None None] Pushing event updated for resources: {'Port': ['ID=f40c716e-2578-4560-85ad-7ffd1f002677,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:45.847844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d693b3ee-2988-4a89-878d-e71d9dd5fe79) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:45.853362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:45.854032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:45.864845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-752e3738-037f-4ea0-b79a-e31656c83ccd None None] Network d693b3ee-2988-4a89-878d-e71d9dd5fe79 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:45.866003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:45.873292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c182e4a5-3075-452f-ac39-818afcc57da8 req-ce26ad0f-0740-4b40-8dff-79d93449fec1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1636841 Dec 21 03:52:45.933870 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cc5c083f-9063-47c7-9c68-fdfadb8b2129 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 1.2622056 Dec 21 03:52:45.934689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:46.024777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.055013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Allocated IP 172.25.5.91 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/eb85ac69-ca96-44cf-913f-9589b9c050bc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:46.095934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d693b3ee-2988-4a89-878d-e71d9dd5fe79', 'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '2a50db66-a41e-4c32-8907-915c9e04530b'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:46.097052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.115934 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-6323bd6e-1450-4553-a107-4719c2166dc7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:46.117584 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-6323bd6e-1450-4553-a107-4719c2166dc7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 946 time: 0.1675675 Dec 21 03:52:46.141414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.200799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0c5b3c7d-3a97-48ca-b6c5-74849173c787'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:46.246996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.324907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:46.325561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.327050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9faa0c-290a-454f-b180-f8807f399f64 req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "PUT /v2.0/ports/0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 981 time: 1.2674024 Dec 21 03:52:46.327545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:46.330088 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3da4ca43-20b8-417e-bfd6-7ea0318538d6" -d '{"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:46.363368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.364425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-853b99b4-f97b-455c-a6a6-cea6ef5b5813 req-4a582ad5-c5f0-4262-8896-b2b668667633 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:46.366094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-853b99b4-f97b-455c-a6a6-cea6ef5b5813 req-4a582ad5-c5f0-4262-8896-b2b668667633 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.3592324 Dec 21 03:52:46.368819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b3e677d-4415-4d6d-ab15-381460968ff2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:46.424370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.463357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-853b99b4-f97b-455c-a6a6-cea6ef5b5813 req-67322146-c8a2-415c-8400-e56a42c36748 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696967 Dec 21 03:52:46.472983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Allocated IP 2001:db8::1 (d693b3ee-2988-4a89-878d-e71d9dd5fe79/2a50db66-a41e-4c32-8907-915c9e04530b/97b53557-850f-4e70-b5e5-e99602441b3b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:46.489584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0c5b3c7d-3a97-48ca-b6c5-74849173c787'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:46.501358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Deleting port 25663143-e39b-4924-bcdd-d94c13f30fd2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:46.501939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.550683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.640273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:46.655052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:46.658606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:46.678377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] For port 25663143-e39b-4924-bcdd-d94c13f30fd2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=25663143-e39b-4924-bcdd-d94c13f30fd2,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:46.679597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:46.700214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Calling delete_port for 25663143-e39b-4924-bcdd-d94c13f30fd2 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:46.706101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Pushing event updated for resources: {'Port': ['ID=eb85ac69-ca96-44cf-913f-9589b9c050bc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:46.709223 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c9c46a2-d126-40e7-b0df-23db0f1368bc x-openstack-request-id: req-8c9c46a2-d126-40e7-b0df-23db0f1368bc {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:46.709519 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:46.709781 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8c9c46a2-d126-40e7-b0df-23db0f1368bc {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:46.710182 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'status': 'completed', 'code': 200} Dec 21 03:52:47.098777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.150012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event deleted for resources: {'Port': ['ID=25663143-e39b-4924-bcdd-d94c13f30fd2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:47.234433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] No DVR routers for this DVR port 25663143-e39b-4924-bcdd-d94c13f30fd2 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:47.239429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.247591 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-79fb73cd-b05e-4814-8cd5-b6756e220fb5 req-4be2c6de-77d4-4f8a-b369-1712422971be tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "DELETE /v2.0/ports/25663143-e39b-4924-bcdd-d94c13f30fd2 HTTP/1.1" status: 204 len: 173 time: 1.1225438 Dec 21 03:52:47.249500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'name': 'network-vif-deleted', 'tag': '25663143-e39b-4924-bcdd-d94c13f30fd2'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:47.266050 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e16007d-a9e0-4131-a219-ea09affdc158" -d '{"events": [{"server_uuid": "01aab21a-a0a5-4f10-b49a-20e1b8ea2db8", "name": "network-vif-deleted", "tag": "25663143-e39b-4924-bcdd-d94c13f30fd2"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:47.307910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.380542 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.437585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.472528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f40c716e-2578-4560-85ad-7ffd1f002677 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:47.503972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=2a50db66-a41e-4c32-8907-915c9e04530b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:47.533552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e4c946c-8461-47fc-b077-77ea4490e0a9 None None] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:47.537908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-e2e32bd7-39cb-4619-92f2-f7381172e339 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-ServerRescueTestJSONUnderV235-securitygroup-2101739864&fields=id&tenant_id=920e98327f8340b0966241ad0871434f HTTP/1.1" status: 200 len: 267 time: 0.8056240 Dec 21 03:52:47.586123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Network d693b3ee-2988-4a89-878d-e71d9dd5fe79 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:47.588119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Pushing event updated for resources: {'Port': ['ID=97b53557-850f-4e70-b5e5-e99602441b3b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:47.637523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:47.648865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:47.658392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.658728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.659113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.659459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.659798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.660132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.660466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.660796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.661122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.661447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.661776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.662107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.662424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:47.701600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.704908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f40c716e-2578-4560-85ad-7ffd1f002677 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:47.705266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.709610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-35372604-d1c0-4c27-a672-abeaeeba65e5 None None] Provisioning complete for port f40c716e-2578-4560-85ad-7ffd1f002677 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:47.709979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35372604-d1c0-4c27-a672-abeaeeba65e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.744418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44e83ec0-7252-49a6-85ad-e91777cf380b req-c09edb12-8be4-4eaa-b1f2-9fefcdf25c96 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.2483356 Dec 21 03:52:47.771369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d693b3ee-2988-4a89-878d-e71d9dd5fe79']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:47.781418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['25663143-e39b-4924-bcdd-d94c13f30fd2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:47.802028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-19cfbe71-28f0-40e0-bcaa-1bee9bdf27bb tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:47.805285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:47.805952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:47.814552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-19cfbe71-28f0-40e0-bcaa-1bee9bdf27bb tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 984 time: 0.2758477 Dec 21 03:52:47.825089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Attempting to bind port 97b53557-850f-4e70-b5e5-e99602441b3b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:47.828921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Attempting to bind port 97b53557-850f-4e70-b5e5-e99602441b3b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:47.828921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Attempting to bind port 97b53557-850f-4e70-b5e5-e99602441b3b on network d693b3ee-2988-4a89-878d-e71d9dd5fe79 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:47.837472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'port': {'security_groups': ['b3a7c1b3-cd89-415c-8815-d4c442d51c8e']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:47.845655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.849985 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96c98ecc-23af-4ef3-82f4-703f401d3a9e x-openstack-request-id: req-96c98ecc-23af-4ef3-82f4-703f401d3a9e {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:47.854418 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "01aab21a-a0a5-4f10-b49a-20e1b8ea2db8", "name": "network-vif-deleted", "tag": "25663143-e39b-4924-bcdd-d94c13f30fd2", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:47.854418 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-96c98ecc-23af-4ef3-82f4-703f401d3a9e {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:47.854418 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '01aab21a-a0a5-4f10-b49a-20e1b8ea2db8', 'name': 'network-vif-deleted', 'tag': '25663143-e39b-4924-bcdd-d94c13f30fd2', 'status': 'completed', 'code': 200} Dec 21 03:52:47.857670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:47.858058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Checking segment: {'id': 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:47.858461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.858860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Bound using segment: {'id': 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:47.859845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Bound port: 97b53557-850f-4e70-b5e5-e99602441b3b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:47.860242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.887161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.907339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:47.907996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:47.916334 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:47.947105 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.065225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-5f67ef1f-6b4b-492c-88bf-ea730a05274b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:48.067857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-5f67ef1f-6b4b-492c-88bf-ea730a05274b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1136 time: 1.2911446 Dec 21 03:52:48.083893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 03:52:48.083893 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 03:52:48.083893 n-d-822053-11 neutron-server[110311]: [parameters: {'id': 'd693b3ee-2988-4a89-878d-e71d9dd5fe79'}] Dec 21 03:52:48.083893 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:52:48.084734 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:52:48.143612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] For port 97b53557-850f-4e70-b5e5-e99602441b3b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:48.148189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port f40c716e-2578-4560-85ad-7ffd1f002677, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f40c716e-2578-4560-85ad-7ffd1f002677,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:48.190473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] For port 97b53557-850f-4e70-b5e5-e99602441b3b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=97b53557-850f-4e70-b5e5-e99602441b3b,segment=NetworkSegment(c8af6b9c-cff4-4bcb-8847-4c1b205078dd),segment_id=c8af6b9c-cff4-4bcb-8847-4c1b205078dd)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:48.194071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35372604-d1c0-4c27-a672-abeaeeba65e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.213141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-95160efe-3c15-400f-9824-96252928d061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:48.214854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-95160efe-3c15-400f-9824-96252928d061 service neutron] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.1059484 Dec 21 03:52:48.221969 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.244848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.294899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.416694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-35372604-d1c0-4c27-a672-abeaeeba65e5 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:52:48.417936 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-35372604-d1c0-4c27-a672-abeaeeba65e5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:52:48.426016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=f40c716e-2578-4560-85ad-7ffd1f002677,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:48.426308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-6e26168d-0330-4984-8e77-8d2a25f3fca8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.0480921 Dec 21 03:52:48.477711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e56e064d-b59c-4a60-be17-2fb402f4b4b7 None None] Network d693b3ee-2988-4a89-878d-e71d9dd5fe79 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:48.585739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.624834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.646090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-557c773a-5105-4def-89e9-b1a07d02e5de req-50793f4a-dd76-4191-abf3-070eb0bd2561 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:48.654233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-557c773a-5105-4def-89e9-b1a07d02e5de req-50793f4a-dd76-4191-abf3-070eb0bd2561 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.4382427 Dec 21 03:52:48.674159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-01e4828e-2788-4337-830b-6b044a85110b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:48.676006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-01e4828e-2788-4337-830b-6b044a85110b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.2076366 Dec 21 03:52:48.690351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb03407-734c-432a-baec-20adb8f43951 None None] Pushing event updated for resources: {'Port': ['ID=97b53557-850f-4e70-b5e5-e99602441b3b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:48.719142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port 97b53557-850f-4e70-b5e5-e99602441b3b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:48.719489 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.723809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-855d8401-de69-4ed5-88ba-d7cb3a7d155b None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 03:52:48.838838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port 97b53557-850f-4e70-b5e5-e99602441b3b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=97b53557-850f-4e70-b5e5-e99602441b3b,segment=NetworkSegment(c8af6b9c-cff4-4bcb-8847-4c1b205078dd),segment_id=c8af6b9c-cff4-4bcb-8847-4c1b205078dd)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:48.840049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:48.858211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for 97b53557-850f-4e70-b5e5-e99602441b3b owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:48.950135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:48.970584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-1a9ace28-5527-4797-a102-ce9173a5f1d9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2838407 Dec 21 03:52:48.988131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-1b139378-43c5-4e8f-936c-ba77efdb840a service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:52:48.989319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-1b139378-43c5-4e8f-936c-ba77efdb840a service neutron] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0062680 Dec 21 03:52:49.032872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.095290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port 97b53557-850f-4e70-b5e5-e99602441b3b on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:49.101315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-855d8401-de69-4ed5-88ba-d7cb3a7d155b None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 03:52:49.114407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=97b53557-850f-4e70-b5e5-e99602441b3b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:49.117592 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.137015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-557c773a-5105-4def-89e9-b1a07d02e5de req-805d0ef9-a32e-40cf-a13c-9b2705f6fd1a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4803860 Dec 21 03:52:49.186023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.188584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.291249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:49.291892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.312494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7a2f55f-fdd2-45a5-9d2e-a66b7925c05b req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "PUT /v2.0/ports/0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 942 time: 1.4966552 Dec 21 03:52:49.314857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:49.322576 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10" -d '{"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:49.421711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-bed5efdc-1d8f-4496-ac5a-3cde729a5d1a service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3893845 Dec 21 03:52:49.464766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.483576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c18f4ad-2770-436e-81df-a76997beac55 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event updated for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:49.514037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b63b44de-5183-4b71-b352-fa9523192e1a req-f2b2de88-e488-4680-ae8b-88b561ec724f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.1136076 Dec 21 03:52:49.533255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d693b3ee-2988-4a89-878d-e71d9dd5fe79']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:49.544484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0c5b3c7d-3a97-48ca-b6c5-74849173c787'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:49.558756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f40c716e-2578-4560-85ad-7ffd1f002677 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:49.572349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:49.578150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c8af6b9c-cff4-4bcb-8847-4c1b205078dd') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:49.620841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.627456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-22decd24-5a58-4692-b766-3796cc92ad4b None None] Provisioning complete for port f40c716e-2578-4560-85ad-7ffd1f002677 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:49.627845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22decd24-5a58-4692-b766-3796cc92ad4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.673828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.687179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:49.687424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:49.690451 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:49.763773 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-72fcc9ae-ef46-4d5a-be5b-e17b8cbbdf04 x-openstack-request-id: req-72fcc9ae-ef46-4d5a-be5b-e17b8cbbdf04 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:49.764673 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:49.765130 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-72fcc9ae-ef46-4d5a-be5b-e17b8cbbdf04 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:49.765708 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'status': 'completed', 'code': 200} Dec 21 03:52:49.772197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3da4ca43-20b8-417e-bfd6-7ea0318538d6 req-1ce9d3d6-76fd-4527-8a83-83fba3473c32 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3212929 Dec 21 03:52:49.803322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-205b14dd-9196-4edc-80eb-71d18af9515a req-361405d8-7ca7-43ea-9ff8-138faac1f8f8 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2410831 Dec 21 03:52:49.810791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:49.857829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0c5b3c7d-3a97-48ca-b6c5-74849173c787'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:49.892998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Router 0c5e87db-9278-4f74-91b4-8f821682e923 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:52:49.967180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:50.008174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:50.014623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:50.019418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/d693b3ee-2988-4a89-878d-e71d9dd5fe79 HTTP/1.1" status: 204 len: 168 time: 4.0802121 Dec 21 03:52:50.021259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b216ef78-9461-4e27-8e60-3b79bf27c087 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=d693b3ee-2988-4a89-878d-e71d9dd5fe79,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:50.027905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55196) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:50.044189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1929898475'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:50.045070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-1abf91a3-78fa-4507-a6f1-7a6344ea1935 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:50.049298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-1abf91a3-78fa-4507-a6f1-7a6344ea1935 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.1876674 Dec 21 03:52:50.208174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:50.218563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:50.225571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:50.304325 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Sync routers for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:50.330911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:50.341500 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:50.353809 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:51.179073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-061ed942-4d6c-4991-82a6-8fa75585b1d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.229302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.229302 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 39b41318-4943-494e-a002-1f844c5b8b91 of type vlan for network 336347cf-4bc6-4502-9dee-629993d9a1f0 Dec 21 03:52:51.229302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.231444 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.231444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ab4e2a39-faf5-4c36-9920-ad33c937dfb3 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 917 time: 6.2150817 Dec 21 03:52:51.232323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55204) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:51.232600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-84b1c69d-9315-4b79-99f4-627bd5877414 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:51.232600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-84b1c69d-9315-4b79-99f4-627bd5877414 service neutron] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.4371579 Dec 21 03:52:51.233064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 25663143-e39b-4924-bcdd-d94c13f30fd2 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:51.235279 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:51.235829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-5d0f28d7-48ab-4861-ad33-ef0f0322ffa0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.0472686 Dec 21 03:52:51.235829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a3dada-8cea-44a7-a993-db3f44695065 req-8b7aad78-ee47-4c51-b894-8554fb8beeb4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:51.235829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75a3dada-8cea-44a7-a993-db3f44695065 req-8b7aad78-ee47-4c51-b894-8554fb8beeb4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.2285495 Dec 21 03:52:51.236625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 25663143-e39b-4924-bcdd-d94c13f30fd2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:52:51.236625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 25663143-e39b-4924-bcdd-d94c13f30fd2 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:52:51.236625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f40c716e-2578-4560-85ad-7ffd1f002677 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.236625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.237215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75a3dada-8cea-44a7-a993-db3f44695065 req-048f54eb-023a-4d52-9efd-547a522852c2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299999 Dec 21 03:52:51.237215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.237649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:47Z', 'revision_number': 3, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:51.237649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Checking router: 0c5e87db-9278-4f74-91b4-8f821682e923 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:51.237649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Updating router 0c5e87db-9278-4f74-91b4-8f821682e923 port eb85ac69-ca96-44cf-913f-9589b9c050bc binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:52:51.238273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Allocated IP 172.25.5.249 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/deebce28-6ffd-4b10-bb20-64ac8e171222) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:51.238471 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.238622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3015e3b-dc86-42c6-9632-5e30fed54a67 None None] DHCP port deletion for e94928bb-be91-4772-b576-ae2f90f005ad request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:51.238824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-691acaea-6cae-43bd-b975-917d0b7ed7a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:51.238824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-691acaea-6cae-43bd-b975-917d0b7ed7a1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.3797214 Dec 21 03:52:51.239200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.239200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.239518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.239518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:51.239835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-c4d284ed-546e-41ad-895b-a3b6920c5f1d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0773666 Dec 21 03:52:51.240033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.240176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 860c385e-360e-40a8-abc8-4ad451913db1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.240176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.251634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b339612-400f-4d4d-ba01-61f2fb7b6fb6 req-2221225e-9e5c-4d44-9ddc-d0c7084f15a2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.0736828 Dec 21 03:52:51.281787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=336347cf-4bc6-4502-9dee-629993d9a1f0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:51.299330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.304230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 336347cf-4bc6-4502-9dee-629993d9a1f0 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:51.328284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.374897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port eb85ac69-ca96-44cf-913f-9589b9c050bc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.376182 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.403834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-a2b54077-6aa6-446e-9caa-855e4c398a38 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3453484 Dec 21 03:52:51.434410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Port eb85ac69-ca96-44cf-913f-9589b9c050bc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:51.447598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 40cff15a-139d-47bc-b79f-04e33eca7b3f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.448125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.562823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.587814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 24bea13f-7eed-47c1-8222-2eb2fea02484 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.588353 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.705448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.706031 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.949181 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.967899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:51.967899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:51.991276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-219a7e53-652d-4640-bcea-b8976c14fd34 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.9619863 Dec 21 03:52:51.996210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55226) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:52.002079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:52.024302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Allocated IP 172.20.0.1 (02e2ef7c-d00c-4471-ae34-58e2e22c435a/394148b6-6bdf-4aaa-94d7-be0fbbf6634e/1c2f58b3-e233-4622-80bb-42a8ad99b338) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:52.029539 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.112095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-779b7e67-5de2-4e4b-983a-d6406bca9536 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:52.172345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:52.180606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Attempting to bind port eb85ac69-ca96-44cf-913f-9589b9c050bc on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:52.195742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Attempting to bind port eb85ac69-ca96-44cf-913f-9589b9c050bc by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:52.197993 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Attempting to bind port eb85ac69-ca96-44cf-913f-9589b9c050bc on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:52.207504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:52.216012 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:52.216729 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:52.217430 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.218181 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:52.218848 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Bound port: eb85ac69-ca96-44cf-913f-9589b9c050bc, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:52.220692 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.224118 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Pushing event updated for resources: {'Port': ['ID=eb85ac69-ca96-44cf-913f-9589b9c050bc,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:52.227732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:52.244037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 37f80abf-83e2-432a-a5ae-59b5714dccdb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:52.244555 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.245056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.256706 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.257344 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.257859 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.263419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.282971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:52.286496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.298180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1147636f-3097-490d-aa3a-7cfd726e8c0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.330854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Port 37f80abf-83e2-432a-a5ae-59b5714dccdb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:52.335837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event updated for resources: {'Port': ['ID=deebce28-6ffd-4b10-bb20-64ac8e171222,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:52.355455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 38c1e6b4-a01b-45a9-9a05-d4bdede43e0f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:52.355836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.361046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] For port eb85ac69-ca96-44cf-913f-9589b9c050bc, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:52.367247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68d5bb3-bde1-48c1-bf81-279cd8ee0b10 req-1447f644-7ee6-46d1-9c7a-8499e5b58305 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9494171 Dec 21 03:52:52.369315 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] For port eb85ac69-ca96-44cf-913f-9589b9c050bc, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=eb85ac69-ca96-44cf-913f-9589b9c050bc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:52.397689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.412535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a183829c-3f47-4377-a5aa-984cb9b0b132 req-c0fcbac0-eb28-4731-b32d-4cf8b243b4fe tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:52.423962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a183829c-3f47-4377-a5aa-984cb9b0b132 req-c0fcbac0-eb28-4731-b32d-4cf8b243b4fe tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.2931476 Dec 21 03:52:52.432587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.433534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.433895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.434236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.434577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.434918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.435285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.435617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.435951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.436282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.436612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.436942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.437275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:52:52.455552 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.458397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Port 38c1e6b4-a01b-45a9-9a05-d4bdede43e0f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:52.466230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Pushing event updated for resources: {'Port': ['ID=1c2f58b3-e233-4622-80bb-42a8ad99b338,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:52.493815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:52.501936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:52.512842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port efb6ba28-97e5-44d1-ba11-ad2bc92b030b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:52.513198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.520730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:52.542629 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e9f1ad-0782-44b3-987e-de1056e0f801 None None] Pushing event updated for resources: {'Port': ['ID=eb85ac69-ca96-44cf-913f-9589b9c050bc,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:52.583985 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:52.585598 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:52.616625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c6f646c-a616-4f64-a523-b801eb84ec2c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:52.626722 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.629708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.642840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-1cb09ab9-dcd3-4b46-bf0c-215fcd8af418 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:52.644752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-1cb09ab9-dcd3-4b46-bf0c-215fcd8af418 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1098 time: 0.2901089 Dec 21 03:52:52.676544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a183829c-3f47-4377-a5aa-984cb9b0b132 req-bb339520-9fae-4645-a490-7f1068a43ac7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2515864 Dec 21 03:52:52.706479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:52.742838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.832322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.834387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Provisioning complete for port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:52.834499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d08027c-97e8-4852-96e0-11a73166fcc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:52.879452 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:52.888906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.120998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:53.168823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.207254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:53.217629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f181baa-8db2-4fd8-9223-05dccff3169c req-11acf50b-f40d-4e94-a21e-3b624ffafb5c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.1576271 Dec 21 03:52:53.229167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.274639 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.362717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:53.365839 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d90e8662-c6d9-47c1-99a0-4f8e29c9d728" -d '{"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-unplugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:53.372182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.409144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Provisioning complete for port 1c2f58b3-e233-4622-80bb-42a8ad99b338 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:53.409669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.451490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.482308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=c934a684-0110-4fb1-a2d1-3fce2ea037ea,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:53.484708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Port 1c2f58b3-e233-4622-80bb-42a8ad99b338 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:53.485743 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37e855e6-7a54-4dfa-b34a-38012aae248a x-openstack-request-id: req-37e855e6-7a54-4dfa-b34a-38012aae248a {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:53.486126 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-unplugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:53.486474 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-37e855e6-7a54-4dfa-b34a-38012aae248a {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:53.487457 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'code': 200} Dec 21 03:52:53.498195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '39b41318-4943-494e-a002-1f844c5b8b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:53.498568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: 336347cf-4bc6-4502-9dee-629993d9a1f0, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:53.503927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Provisioning complete for port eb85ac69-ca96-44cf-913f-9589b9c050bc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:53.505102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.555580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.598228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.626004 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:47Z', 'revision_number': 3, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:53.658981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.667875 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37775b1c-173d-4444-a6c8-7c405aaa3e83 None None] The sync data for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 is: [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:47Z', 'revision_number': 3, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:53.679176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 336347cf-4bc6-4502-9dee-629993d9a1f0 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:53.693827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] For port eb85ac69-ca96-44cf-913f-9589b9c050bc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=eb85ac69-ca96-44cf-913f-9589b9c050bc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:53.708558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event updated for resources: {'Port': ['ID=deebce28-6ffd-4b10-bb20-64ac8e171222,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:53.732481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.757577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.812317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:53.815041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 336347cf-4bc6-4502-9dee-629993d9a1f0) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:53.831537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:53.832132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.842457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Pushing event updated for resources: {'Port': ['ID=eb85ac69-ca96-44cf-913f-9589b9c050bc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:53.853085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72d37b26-f462-4042-9006-76e8ee69c0dd None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:53.855355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd937188-8869-4bb0-8829-93c6637b2d9f None None] Network 336347cf-4bc6-4502-9dee-629993d9a1f0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:53.881446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.883380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:53.883710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:53.884059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:53.884238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16613e07-0ee3-418f-aa43-abbd2b58d981 req-b2a0c117-2cd9-4c66-8576-3a0c0a892e2d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:53.893149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16613e07-0ee3-418f-aa43-abbd2b58d981 req-b2a0c117-2cd9-4c66-8576-3a0c0a892e2d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.0979211 Dec 21 03:52:53.895379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:52:53.895714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:53.905684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:53.905979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:53.906366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:53.906799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Bound port: 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:53.907192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.913633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:53.920532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-205b14dd-9196-4edc-80eb-71d18af9515a req-1da8bdd6-6b03-402c-b382-21413319f4fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 4.1159127 Dec 21 03:52:53.922308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Provisioning complete for port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:53.922686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27dad227-59b2-48a7-883c-02aaf51e0fd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.045053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-205b14dd-9196-4edc-80eb-71d18af9515a req-752d5ecd-32e6-4091-afc2-712570d6506e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 696 time: 0.1019444 Dec 21 03:52:54.061980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16613e07-0ee3-418f-aa43-abbd2b58d981 req-a78fd562-748c-4f35-8f03-046dfc9eceb9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1625347 Dec 21 03:52:54.091528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9969b186-58b5-4aa3-babb-a52d97b28ce1 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 2.0895774 Dec 21 03:52:54.091528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.176940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-336347cf-4bc6-4502-9dee-629993d9a1f0', 'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': 'c934a684-0110-4fb1-a2d1-3fce2ea037ea'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:52:54.178595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.198181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55260) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:54.202360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:54.207201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.292343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205b14dd-9196-4edc-80eb-71d18af9515a req-60d04144-78ef-48d6-be87-10d5ece42ae2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:54.293292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-205b14dd-9196-4edc-80eb-71d18af9515a req-60d04144-78ef-48d6-be87-10d5ece42ae2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2298324 Dec 21 03:52:54.338737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-84fb6482-57b1-4e32-b63c-3747d7e715f8 None None] Provisioning complete for port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:54.339146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84fb6482-57b1-4e32-b63c-3747d7e715f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.434365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-84fb6482-57b1-4e32-b63c-3747d7e715f8 None None] Port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:54.451966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.452449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Allocated IP 2001:db8::1 (336347cf-4bc6-4502-9dee-629993d9a1f0/c934a684-0110-4fb1-a2d1-3fce2ea037ea/fb3b52f1-8801-4356-ae76-a3a9be0f6795) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:52:54.464008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:54.490613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:52:54.521523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Pushing event updated for resources: {'Port': ['ID=1c2f58b3-e233-4622-80bb-42a8ad99b338,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:54.622442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.627383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b173e512-e01f-4b18-bdc4-4cc136b33847 req-df493cca-abae-44ea-b23a-fb4fa43d1d38 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.1110389 Dec 21 03:52:54.694664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-63f6d082-bdf4-4cfe-a63c-110d06267dd6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:54.697982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-63f6d082-bdf4-4cfe-a63c-110d06267dd6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.1710274 Dec 21 03:52:54.786503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b82b68e1-48a5-457f-bacf-0c40942905fd None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:52:54.794478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.808535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-857a9292-6631-4473-be4b-b97a414f739b tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 696 time: 0.0988355 Dec 21 03:52:54.816223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'floatingip': {'port_id': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'fixed_ip_address': '172.20.0.9'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:54.829473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=8']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:54.843862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:54.863279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:54.873119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.891968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:54.918838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:54.921232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.921556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-31529204-ed3b-481f-a5bb-eb221c50a7de service neutron] 10.222.0.54 "PUT /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 1124 time: 2.2197495 Dec 21 03:52:54.932681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.975823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-afdee29f-66e8-4728-b460-a6bed5911563 None None] Provisioning complete for port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:54.981755 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afdee29f-66e8-4728-b460-a6bed5911563 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:54.985716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.065107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c9de9e-7206-48ef-b293-2c77892849b3 req-fe2f2c51-baa0-45cb-9de9-678f0fd57a55 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:55.079974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8c9de9e-7206-48ef-b293-2c77892849b3 req-fe2f2c51-baa0-45cb-9de9-678f0fd57a55 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 951 time: 0.2586694 Dec 21 03:52:55.102701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:55.103949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:55.104328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:55.123668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:52:55.124101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Attempting to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:55.137584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.138693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.177420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:55.178220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:55.178848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:55.179372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Bound port: 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:55.179771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.200424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['425b1a38-084b-43fc-ab16-7a0f86f2eb65'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:55.230832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Router 0c5e87db-9278-4f74-91b4-8f821682e923 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:52:55.246212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['425b1a38-084b-43fc-ab16-7a0f86f2eb65'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:52:55.314137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8c9de9e-7206-48ef-b293-2c77892849b3 req-556634f6-50c6-42d7-9a11-3f6277d5f9d9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2320602 Dec 21 03:52:55.362079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Pushing event updated for resources: {'Port': ['ID=fb3b52f1-8801-4356-ae76-a3a9be0f6795,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:55.475513 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.507290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:55.509695 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77ede5b5-7798-4209-a053-b80073df5d9b" -d '{"events": [{"name": "network-changed", "server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:55.579029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=c934a684-0110-4fb1-a2d1-3fce2ea037ea,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:55.606218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Network 336347cf-4bc6-4502-9dee-629993d9a1f0 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:52:55.615415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device eb85ac69-ca96-44cf-913f-9589b9c050bc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:52:55.615588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:55.640115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:55.642789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98ba64c1-5a1e-4854-bc2f-ba91029bf0c8 admin admin] 10.222.0.18 "PUT /v2.0/routers/0c5e87db-9278-4f74-91b4-8f821682e923/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1413302 Dec 21 03:52:55.715820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:52:55.733210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.752152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ff0175-9b81-4d40-a891-fbfb3fdefcd6 req-71c9f3bc-4465-4f19-9c88-a0e3cb0ab890 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:55.762467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84ff0175-9b81-4d40-a891-fbfb3fdefcd6 req-71c9f3bc-4465-4f19-9c88-a0e3cb0ab890 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 944 time: 0.1285183 Dec 21 03:52:55.777779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['336347cf-4bc6-4502-9dee-629993d9a1f0']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:55.803095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '39b41318-4943-494e-a002-1f844c5b8b91') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:55.804740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '39b41318-4943-494e-a002-1f844c5b8b91') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:55.822563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.823050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Attempting to bind port fb3b52f1-8801-4356-ae76-a3a9be0f6795 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:55.824119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Attempting to bind port fb3b52f1-8801-4356-ae76-a3a9be0f6795 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '39b41318-4943-494e-a002-1f844c5b8b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:55.824649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Attempting to bind port fb3b52f1-8801-4356-ae76-a3a9be0f6795 on network 336347cf-4bc6-4502-9dee-629993d9a1f0 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:55.841948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:55.842338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Checking segment: {'id': '39b41318-4943-494e-a002-1f844c5b8b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:55.842747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.843345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Bound using segment: {'id': '39b41318-4943-494e-a002-1f844c5b8b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:55.843847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Bound port: fb3b52f1-8801-4356-ae76-a3a9be0f6795, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '39b41318-4943-494e-a002-1f844c5b8b91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '336347cf-4bc6-4502-9dee-629993d9a1f0'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:55.844413 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.846858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84ff0175-9b81-4d40-a891-fbfb3fdefcd6 req-9f00f2a5-2ec2-4fd0-be18-c92fef704eaf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822704 Dec 21 03:52:55.866903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.885385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:55.887251 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.921093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afdee29f-66e8-4728-b460-a6bed5911563 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:55.973470 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:55.989425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.019886 n-d-822053-11 neutron-server[110312]: WARNING neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Concurrent port binding operations failed on port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 Dec 21 03:52:56.024008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 03:52:56.024008 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 03:52:56.024008 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '336347cf-4bc6-4502-9dee-629993d9a1f0'}] Dec 21 03:52:56.024008 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:52:56.024441 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:52:56.031093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:56.085194 n-d-822053-11 neutron-server[110312]: INFO neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Attempt 2 to bind port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 Dec 21 03:52:56.085632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:52:56.107312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:56.109423 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-556bffd6-bdae-40a4-ac6a-6fe6bb5ac466" -d '{"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-plugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:56.125838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.153824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-afdee29f-66e8-4728-b460-a6bed5911563 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:56.160985 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa6a5f80-e88f-4ded-a313-09f904f0e5d2 x-openstack-request-id: req-aa6a5f80-e88f-4ded-a313-09f904f0e5d2 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:56.161970 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:56.162298 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-aa6a5f80-e88f-4ded-a313-09f904f0e5d2 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:56.162757 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'status': 'completed', 'code': 200} Dec 21 03:52:56.181324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port eb85ac69-ca96-44cf-913f-9589b9c050bc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:56.181775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.200670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.228772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] For port fb3b52f1-8801-4356-ae76-a3a9be0f6795, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:56.240239 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afdee29f-66e8-4728-b460-a6bed5911563 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.287247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] For port fb3b52f1-8801-4356-ae76-a3a9be0f6795, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fb3b52f1-8801-4356-ae76-a3a9be0f6795,segment=NetworkSegment(39b41318-4943-494e-a002-1f844c5b8b91),segment_id=39b41318-4943-494e-a002-1f844c5b8b91)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:56.325301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30cc994f-6189-48dc-8a24-443ff1ba1cce req-f5f2c1d5-6e8e-4178-a80d-dbce73f11dc8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=01aab21a-a0a5-4f10-b49a-20e1b8ea2db8 HTTP/1.1" status: 200 len: 210 time: 0.0443389 Dec 21 03:52:56.387046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.404309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdee29f-66e8-4728-b460-a6bed5911563 None None] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:56.417757 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Floating IP c223e8a2-cc2d-4478-af5d-47cb4c476446 associated. External IP: 172.25.5.249, port: 0c5b3c7d-3a97-48ca-b6c5-74849173c787. Dec 21 03:52:56.447138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ede5b5-7798-4209-a053-b80073df5d9b req-6bb76b04-af22-4665-b785-04813cf22e28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:56.451229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-6bb76b04-af22-4665-b785-04813cf22e28 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1129 time: 0.2149875 Dec 21 03:52:56.555633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Sync routers for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:56.566173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.601727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4099b8a-cd75-43d2-8232-5aa76450f1e8 None None] Pushing event updated for resources: {'Port': ['ID=fb3b52f1-8801-4356-ae76-a3a9be0f6795,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:56.607786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6397ee8f-fb2c-4431-9295-b2648e700af5 None None] Provisioning complete for port 1c2f58b3-e233-4622-80bb-42a8ad99b338 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:56.608456 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6397ee8f-fb2c-4431-9295-b2648e700af5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.612375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e5e34e0-74bd-4d62-81fa-b5bba389f5c2 None None] Network 336347cf-4bc6-4502-9dee-629993d9a1f0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:56.614424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:56.615183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:56.666767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ede5b5-7798-4209-a053-b80073df5d9b req-72a674c7-5a78-4736-b47f-77cc46a1ab3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:56.669331 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-72a674c7-5a78-4736-b47f-77cc46a1ab3f service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.2030401 Dec 21 03:52:56.720374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Router cbef927a-234e-4845-b539-e85731a2c3f3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:52:56.723565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-a0822c8c-8914-4f76-8788-0bac2091d67c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 217 time: 0.0451491 Dec 21 03:52:56.728073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port fb3b52f1-8801-4356-ae76-a3a9be0f6795 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:52:56.728419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.797509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6397ee8f-fb2c-4431-9295-b2648e700af5 None None] Port 1c2f58b3-e233-4622-80bb-42a8ad99b338 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:52:56.817090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55320) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:56.821590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1526031541', 'description': 'tempest-description--713073597'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:56.845700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:52:56.851632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ede5b5-7798-4209-a053-b80073df5d9b req-7df8c3d1-fb45-46a4-959d-e8f7bef39828 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:56.853109 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-7df8c3d1-fb45-46a4-959d-e8f7bef39828 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.1212740 Dec 21 03:52:56.855513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port fb3b52f1-8801-4356-ae76-a3a9be0f6795, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fb3b52f1-8801-4356-ae76-a3a9be0f6795,segment=NetworkSegment(39b41318-4943-494e-a002-1f844c5b8b91),segment_id=39b41318-4943-494e-a002-1f844c5b8b91)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:56.855870 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.860170 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] Sync routers for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:52:56.865012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:56.875006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:56.893150 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:56.893978 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:56.915045 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-0297ae09-0085-4874-af79-c59a37305284 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0431809 Dec 21 03:52:56.917520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-284c6679-de8c-4c8f-81f2-c65c93b0c9fc tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "PUT /v2.0/floatingips/c223e8a2-cc2d-4478-af5d-47cb4c476446 HTTP/1.1" status: 200 len: 996 time: 2.1010058 Dec 21 03:52:56.918099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for fb3b52f1-8801-4356-ae76-a3a9be0f6795 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:52:56.918780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:56.927766 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d" -d '{"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:56.932177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-21efc289-1c84-44c7-8d04-0286244a61c9 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:52:56.933873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-21efc289-1c84-44c7-8d04-0286244a61c9 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0081561 Dec 21 03:52:56.966085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c90c6da7-497f-44f5-8114-f6f66ecad1d1 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 03:52:56.990875 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d439b70f-4b78-4bbf-a0ad-7470e52083eb x-openstack-request-id: req-d439b70f-4b78-4bbf-a0ad-7470e52083eb {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:56.991206 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-plugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:56.991477 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d439b70f-4b78-4bbf-a0ad-7470e52083eb {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:56.991905 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'code': 200} Dec 21 03:52:57.003055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-8d985df0-ca0c-4d8c-b46e-4f05fdc7b3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:57.011725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-8d985df0-ca0c-4d8c-b46e-4f05fdc7b3d0 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.0805044 Dec 21 03:52:57.056679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.118067 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:57.131195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-02bf2ecb-8151-44bb-bca9-b05137e83025 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:57.133080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-02bf2ecb-8151-44bb-bca9-b05137e83025 service neutron] 10.222.0.18 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.1204486 Dec 21 03:52:57.247706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.292378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-3cb78348-7301-4d4c-8bc2-42fb3bf1a9b9 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3464153 Dec 21 03:52:57.321863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-038cdf86-ef77-41e9-a0dc-90ed0e240b98 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 999 time: 0.1810279 Dec 21 03:52:57.331556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.356995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c90c6da7-497f-44f5-8114-f6f66ecad1d1 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 03:52:57.367536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event updated for resources: {'SecurityGroup': ['ID=27f4831e-56b2-42f0-925d-a97178be0500,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:57.385288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b438664-a410-410c-a9bb-e1f8a2dfd553 req-35456338-73dc-41e2-aeaa-f4e51c529665 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:57.400521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b438664-a410-410c-a9bb-e1f8a2dfd553 req-35456338-73dc-41e2-aeaa-f4e51c529665 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1691399 Dec 21 03:52:57.403626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 2, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:57.414565 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.434877 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c223e8a2-cc2d-4478-af5d-47cb4c476446', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'floating_ip_address': '172.25.5.249', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'port_id': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'mac_address': 'fa:16:3e:52:1f:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:52:52Z', 'updated_at': '2021-12-21T03:52:55Z', 'revision_number': 1, 'project_id': '920e98327f8340b0966241ad0871434f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:45Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:57.454373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=fb3b52f1-8801-4356-ae76-a3a9be0f6795,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:57.460562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port fb3b52f1-8801-4356-ae76-a3a9be0f6795 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:52:57.466115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Checking router: 0c5e87db-9278-4f74-91b4-8f821682e923 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:57.466503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Updating router 0c5e87db-9278-4f74-91b4-8f821682e923 port 1c2f58b3-e233-4622-80bb-42a8ad99b338 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:52:57.470708 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] Checking router: cbef927a-234e-4845-b539-e85731a2c3f3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:52:57.481417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b438664-a410-410c-a9bb-e1f8a2dfd553 req-b572d8bd-4609-4b8d-856f-b7cbf2ff8873 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709834 Dec 21 03:52:57.500449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-740745e7-fa4e-414a-ab58-5f8cfc7c7c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:57.501861 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:57.503560 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:57.506167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.507448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c267e2c-1110-4172-8a59-ff7a2e5e0f24 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.6893919 Dec 21 03:52:57.515580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-740745e7-fa4e-414a-ab58-5f8cfc7c7c5f service neutron] 10.222.0.18 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.1819830 Dec 21 03:52:57.518113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55344) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:57.532420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Request body: {'security_group_rule': {'security_group_id': '27f4831e-56b2-42f0-925d-a97178be0500', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:57.569523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.578753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-15e87e3d-e8b2-4cb4-b59f-6e03ff771d8e service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0326505 Dec 21 03:52:57.604296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.631916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['336347cf-4bc6-4502-9dee-629993d9a1f0']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:57.647165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '39b41318-4943-494e-a002-1f844c5b8b91') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:57.647960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '39b41318-4943-494e-a002-1f844c5b8b91') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:57.650615 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-77ede5b5-7798-4209-a053-b80073df5d9b req-eb335848-53bd-449f-a0b9-072661b3b804 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3504758 Dec 21 03:52:57.665843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.678813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.680149 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:57.695756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:52:57.696322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:52:57.701283 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:52:57.756869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.824749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-0b99e1a8-1e8d-4205-8dca-f84fdf54c382 service neutron] 10.222.0.18 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2357295 Dec 21 03:52:57.837152 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7fca9f7-50bd-47c8-a9fd-b9151532b71f x-openstack-request-id: req-b7fca9f7-50bd-47c8-a9fd-b9151532b71f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:52:57.837461 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:52:57.837775 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b7fca9f7-50bd-47c8-a9fd-b9151532b71f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:52:57.842508 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'status': 'completed', 'code': 200} Dec 21 03:52:57.854106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.859948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.864379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.875086 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/336347cf-4bc6-4502-9dee-629993d9a1f0 HTTP/1.1" status: 204 len: 168 time: 3.6626108 Dec 21 03:52:57.879513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55354) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:57.885977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1283934978'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:57.915895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:57.940259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5560a439-c896-4827-8f04-42745c703f79 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=336347cf-4bc6-4502-9dee-629993d9a1f0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:57.947342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0f036cc-aa26-4e55-a27e-86129fcd09d8,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:57.984216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-781ec119-e1e1-4a57-9537-9c0e0e7e6b47 req-ec3e6a4d-5305-4c01-a196-13425b1b97f5 service neutron] 10.222.0.18 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1517868 Dec 21 03:52:57.989568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-93a55399-608c-48c6-8bad-d7dc96a7d2bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:57.994596 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-93a55399-608c-48c6-8bad-d7dc96a7d2bd service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.0902267 Dec 21 03:52:58.040615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.045296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9d8e5d97-83d5-40ff-9dc8-dcd2b4604082 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5226104 Dec 21 03:52:58.045472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55362) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:58.065537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Request body: {'security_group_rule': {'security_group_id': '27f4831e-56b2-42f0-925d-a97178be0500', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:58.145402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:58.146276 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c223e8a2-cc2d-4478-af5d-47cb4c476446', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'floating_ip_address': '172.25.5.249', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'port_id': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'mac_address': 'fa:16:3e:52:1f:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:52:52Z', 'updated_at': '2021-12-21T03:52:55Z', 'revision_number': 1, 'project_id': '920e98327f8340b0966241ad0871434f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:45Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:58.159304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.192299 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1601109-9a38-48e4-8718-cbac5e287287 None None] The sync data for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 is: [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c223e8a2-cc2d-4478-af5d-47cb4c476446', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'floating_ip_address': '172.25.5.249', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'port_id': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'mac_address': 'fa:16:3e:52:1f:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:52:52Z', 'updated_at': '2021-12-21T03:52:55Z', 'revision_number': 1, 'project_id': '920e98327f8340b0966241ad0871434f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:45Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:52:58.212066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:52:58.219617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:52:58.224049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-33ec1b61-edc0-4424-b0fa-81c57c3c242f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:58.226781 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-33ec1b61-edc0-4424-b0fa-81c57c3c242f service neutron] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.1951635 Dec 21 03:52:58.230675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.231103 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 5c29c207-8f56-40b7-9063-86bef2d84c91 of type vlan for network 284b3ea9-47ad-462a-a649-dd4b568f5b2f Dec 21 03:52:58.340342 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.353150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-f082f452-211b-4693-9583-8a5ee1b33b25 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 999 time: 0.2516670 Dec 21 03:52:58.363066 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-d2a701ee-bb6a-4c9a-a41c-9af296db0a48 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 999 time: 0.1159792 Dec 21 03:52:58.405828 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.455744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-1bb205fb-ed8a-4172-a06a-f0a5c272f7ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:58.457707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-1bb205fb-ed8a-4172-a06a-f0a5c272f7ec service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.0830779 Dec 21 03:52:58.462132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-ea3be06a-c60f-4200-9a7a-d2ad223fc60a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:58.468891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-ea3be06a-c60f-4200-9a7a-d2ad223fc60a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports/0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 942 time: 0.1148210 Dec 21 03:52:58.511671 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-ed755065-999e-423b-870e-4d4f9c60cb28 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0290015 Dec 21 03:52:58.514640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:58.526465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.543602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:58.544441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.569681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3934513e-10b6-4a90-b996-2c861bd4af7d None None] New status for floating IP c223e8a2-cc2d-4478-af5d-47cb4c476446: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:52:58.585001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.653853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.687468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.689782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=284b3ea9-47ad-462a-a649-dd4b568f5b2f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:58.718169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-008e72ac-9534-4eed-a0c9-26f84eaa9945 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.8368206 Dec 21 03:52:58.718983 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:52:58.723121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:58.724187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55406) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:58.725992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:52:58.730095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:58.741244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-b14337bf-7ca4-46b6-a152-10ff489178b6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 999 time: 0.1704729 Dec 21 03:52:58.750274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-a8646d15-232f-4681-a5cb-7702b207a4f7 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2016218 Dec 21 03:52:58.792756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.794211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04a260a-e4ae-4d79-8ee2-20af67252f5c req-7cfdce6d-e02e-4e98-8ee9-ec415f3a8843 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:58.796285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f04a260a-e4ae-4d79-8ee2-20af67252f5c req-7cfdce6d-e02e-4e98-8ee9-ec415f3a8843 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1392596 Dec 21 03:52:58.884327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.912216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ddd2db2-19b8-431d-bbbd-c77bd732af3d req-52831937-25e8-43c8-be0e-c711d6f9ec67 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1496310 Dec 21 03:52:58.920658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062e8528-fb68-4c89-9f81-3a2420d3bb6e None None] Pushing event updated for resources: {'Port': ['ID=1c2f58b3-e233-4622-80bb-42a8ad99b338,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:58.933959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f04a260a-e4ae-4d79-8ee2-20af67252f5c req-f35ea0bb-f4d2-4c12-84b1-3fa7a061e60f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250854 Dec 21 03:52:58.949681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.960879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:52:58.968120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:58.994285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-655f4a09-69b2-4aa8-a250-c7d65f6fccf2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:58.996750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-655f4a09-69b2-4aa8-a250-c7d65f6fccf2 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.2426441 Dec 21 03:52:59.000482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=72555004-12c2-4b2b-90fa-39206b0b7448,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:59.034696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:52:59.036977 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-171e8cc9-a541-4835-b74f-e3f6b6c2d599" -d '{"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:52:59.058779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Attempting to bind port 1c2f58b3-e233-4622-80bb-42a8ad99b338 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:52:59.059194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Attempting to bind port 1c2f58b3-e233-4622-80bb-42a8ad99b338 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:52:59.059600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Attempting to bind port 1c2f58b3-e233-4622-80bb-42a8ad99b338 on network 02e2ef7c-d00c-4471-ae34-58e2e22c435a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:52:59.069175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:52:59.082740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Checking segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:59.082903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.083015 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.083015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Bound using segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:52:59.083015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Bound port: 1c2f58b3-e233-4622-80bb-42a8ad99b338, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:52:59.083257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-be3e30e2-2e67-46f4-8baa-e92345fac332 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0195117 Dec 21 03:52:59.083336 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.083413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:59.083413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:59.134106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-d05dd6d2-a159-4d9d-b07a-f09a85a913d1 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 999 time: 0.1251729 Dec 21 03:52:59.135171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Request body: {'floatingip': {'port_id': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:59.197582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] For port 1c2f58b3-e233-4622-80bb-42a8ad99b338, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:52:59.215225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] For port 1c2f58b3-e233-4622-80bb-42a8ad99b338, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1c2f58b3-e233-4622-80bb-42a8ad99b338,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:52:59.281797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.283796 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.289158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.342442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062e8528-fb68-4c89-9f81-3a2420d3bb6e None None] Pushing event updated for resources: {'Port': ['ID=1c2f58b3-e233-4622-80bb-42a8ad99b338,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:59.375535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-88edb8bc-e45a-4dc8-94e6-35ecb1778a4f None None] Provisioning complete for port 1c2f58b3-e233-4622-80bb-42a8ad99b338 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:59.375758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-887fbd4a-c68e-42ed-b0dc-84b21d812eee tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:59.376032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88edb8bc-e45a-4dc8-94e6-35ecb1778a4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.384640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-887fbd4a-c68e-42ed-b0dc-84b21d812eee tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.2393265 Dec 21 03:52:59.422696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:52:59.422879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:52:59.443492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-8a502cb3-0991-497d-9efd-6836c5ae2c99 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.0579176 Dec 21 03:52:59.523691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-d0646749-b3ce-45fc-a4a4-33aa4febcea6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0736818 Dec 21 03:52:59.605693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:52:59.624360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.636210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88edb8bc-e45a-4dc8-94e6-35ecb1778a4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.693439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-88edb8bc-e45a-4dc8-94e6-35ecb1778a4f None None] For port 1c2f58b3-e233-4622-80bb-42a8ad99b338, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1c2f58b3-e233-4622-80bb-42a8ad99b338,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:52:59.701085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=e834a669-61ec-414d-88ab-c8641289f01d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:59.721794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '5c29c207-8f56-40b7-9063-86bef2d84c91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:52:59.722195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: 284b3ea9-47ad-462a-a649-dd4b568f5b2f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:52:59.749111 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88edb8bc-e45a-4dc8-94e6-35ecb1778a4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.789208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:52:59.842407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 284b3ea9-47ad-462a-a649-dd4b568f5b2f) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:52:59.849063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88edb8bc-e45a-4dc8-94e6-35ecb1778a4f None None] Pushing event updated for resources: {'Port': ['ID=1c2f58b3-e233-4622-80bb-42a8ad99b338,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:52:59.849622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:52:59.852574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.876256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46cc9bbe-a660-4a5e-9b01-738849fb81f1 None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:52:59.916876 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-35c0a610-2aed-436f-b954-858cd8dfab9a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1914339 Dec 21 03:52:59.920236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55434) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:52:59.927852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:52:59.957784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c6a44006-e894-45dd-b8b1-03ecf0c9d5c5 None None] Provisioning complete for port 1c2f58b3-e233-4622-80bb-42a8ad99b338 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:52:59.958157 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6a44006-e894-45dd-b8b1-03ecf0c9d5c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:52:59.963338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.027148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.027487 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Floating IP c223e8a2-cc2d-4478-af5d-47cb4c476446 disassociated. External IP: 172.25.5.249, port: 0c5b3c7d-3a97-48ca-b6c5-74849173c787. Dec 21 03:53:00.040785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:00.065455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-fd377436-7c0b-4565-82b9-edd7771ce20d service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5409155 Dec 21 03:53:00.070575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-284b3ea9-47ad-462a-a649-dd4b568f5b2f', 'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': 'e834a669-61ec-414d-88ab-c8641289f01d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:53:00.071578 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.076247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e747bc6c-4d32-4a35-b11b-30cbc54fc4a3 None None] The sync data for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 is: [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:00.090293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.134354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:00.144783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.342803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-d21c3fb5-f33e-49a7-8835-64144ae4ceda service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2645924 Dec 21 03:53:00.435617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Allocated IP 172.25.5.134 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/3ca8affe-a1ef-42a0-b658-e51c5bac251c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:00.470209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Allocated IP 2001:db8::2 (284b3ea9-47ad-462a-a649-dd4b568f5b2f/e834a669-61ec-414d-88ab-c8641289f01d/dfcc139e-6410-418e-af13-8ee2bdbe361d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:00.562335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.583488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Router cbef927a-234e-4845-b539-e85731a2c3f3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:00.637081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:00.640868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:00.649918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.652393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:00.652989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.688523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=8c6520ca-2298-4357-8601-ab5511bcda05,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:00.731306 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.750890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.771227 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0ecfe59f-d72f-43cb-85e2-f7233e5648b4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 0.8487430 Dec 21 03:53:00.773062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55444) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:00.812910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.853439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:00.861979 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:00.869205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] Sync routers for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:00.892847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:00.894601 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:00.895279 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:00.906568 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:52:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d9adf8f-f46e-4658-a396-5411c4a1aaa0 x-openstack-request-id: req-1d9adf8f-f46e-4658-a396-5411c4a1aaa0 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:00.906826 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:00.907109 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1d9adf8f-f46e-4658-a396-5411c4a1aaa0 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:00.907508 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'code': 200} Dec 21 03:53:00.958377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:00.964526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:00.975157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:00.977482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Pushing event updated for resources: {'Port': ['ID=dfcc139e-6410-418e-af13-8ee2bdbe361d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:00.985668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:00.989146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:01.015236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event updated for resources: {'Port': ['ID=3ca8affe-a1ef-42a0-b658-e51c5bac251c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:01.022192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baa53781-01b8-4db6-93b2-139ed4b14aa8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.028662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-e4a402e5-e5c1-4b3f-baa1-de74ed88ce16 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "PUT /v2.0/floatingips/c223e8a2-cc2d-4478-af5d-47cb4c476446 HTTP/1.1" status: 200 len: 695 time: 1.8973939 Dec 21 03:53:01.031043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baa53781-01b8-4db6-93b2-139ed4b14aa8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.032552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:01.035819 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-694b1e7d-4c71-44e2-a499-440046b0ae61" -d '{"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:01.037471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baa53781-01b8-4db6-93b2-139ed4b14aa8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.039209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baa53781-01b8-4db6-93b2-139ed4b14aa8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.046890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baa53781-01b8-4db6-93b2-139ed4b14aa8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.050782 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-baa53781-01b8-4db6-93b2-139ed4b14aa8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.2763088 Dec 21 03:53:01.054746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:01.066547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-368996169'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:01.143989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Attempting to bind port dfcc139e-6410-418e-af13-8ee2bdbe361d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:01.144368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Attempting to bind port dfcc139e-6410-418e-af13-8ee2bdbe361d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5c29c207-8f56-40b7-9063-86bef2d84c91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:01.144741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Attempting to bind port dfcc139e-6410-418e-af13-8ee2bdbe361d on network 284b3ea9-47ad-462a-a649-dd4b568f5b2f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:01.159870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:01.160256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Checking segment: {'id': '5c29c207-8f56-40b7-9063-86bef2d84c91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:01.160668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.161073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Bound using segment: {'id': '5c29c207-8f56-40b7-9063-86bef2d84c91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:01.161773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Bound port: dfcc139e-6410-418e-af13-8ee2bdbe361d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c29c207-8f56-40b7-9063-86bef2d84c91', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:01.162197 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.184510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:01.188979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.209090 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:01.236760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:01.252081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.252577 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 1c1f94f9-db7a-4261-ac9b-41f1a560f9ac of type vlan for network 9d104924-c03e-45e5-91f9-964b183b5c3a Dec 21 03:53:01.311460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] For port dfcc139e-6410-418e-af13-8ee2bdbe361d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:01.317101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] For port dfcc139e-6410-418e-af13-8ee2bdbe361d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dfcc139e-6410-418e-af13-8ee2bdbe361d,segment=NetworkSegment(5c29c207-8f56-40b7-9063-86bef2d84c91),segment_id=5c29c207-8f56-40b7-9063-86bef2d84c91)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:01.328819 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.333561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-29ee64a6-aebb-46ee-8d2f-6b4ac2726d98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.335171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-29ee64a6-aebb-46ee-8d2f-6b4ac2726d98 service neutron] 10.222.0.18 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.2723763 Dec 21 03:53:01.364046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.377550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20810057-aac4-4458-beb2-e6b03fe58190 req-91345c01-d373-4906-a1d0-034dfed24f0f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.379668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20810057-aac4-4458-beb2-e6b03fe58190 req-91345c01-d373-4906-a1d0-034dfed24f0f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.1921988 Dec 21 03:53:01.420792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1c2f58b3-e233-4622-80bb-42a8ad99b338 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:01.521445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.522113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.528677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.529290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.552552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-f0a916a3-0889-46e7-b643-28c6982b526d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.554059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-f0a916a3-0889-46e7-b643-28c6982b526d service neutron] 10.222.0.18 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.2047400 Dec 21 03:53:01.591678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20810057-aac4-4458-beb2-e6b03fe58190 req-3e061880-5ba9-4b27-8770-015f6144bb73 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1938961 Dec 21 03:53:01.653224 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:45Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:01.678560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af86dbdd-2229-40b8-a381-1a829cbce2f6 None None] Pushing event updated for resources: {'Port': ['ID=dfcc139e-6410-418e-af13-8ee2bdbe361d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:01.698361 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] Checking router: cbef927a-234e-4845-b539-e85731a2c3f3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:01.699470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1c2f58b3-e233-4622-80bb-42a8ad99b338 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:01.699873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.712468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-9481c1a4-9aeb-491b-a937-cfd1672c2c57 service neutron] 10.222.0.18 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.1436918 Dec 21 03:53:01.712658 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:01.713410 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:01.748188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6886337 Dec 21 03:53:01.753162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55466) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:01.774093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:01.782143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'New_network'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:01.801332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48eb7d86-e400-4593-9aff-beef22631d7c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=9d104924-c03e-45e5-91f9-964b183b5c3a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:01.801855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9946cd9d-26a9-4810-b078-1897feb869e5 req-cc1bb104-19dd-4695-830d-fb2f5e3d9c1f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=61ff766c-48ae-4d8d-8914-1189fe53e3d3 HTTP/1.1" status: 200 len: 210 time: 0.0985363 Dec 21 03:53:01.868575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9d104924-c03e-45e5-91f9-964b183b5c3a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:01.975970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-0f16cd38-ac65-412e-b1ff-aa764553ea3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:01.979146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-0f16cd38-ac65-412e-b1ff-aa764553ea3c service neutron] 10.222.0.18 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.1761003 Dec 21 03:53:02.040815 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:02.052415 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ddd69e2a-148c-4304-8470-47934d16e539 x-openstack-request-id: req-ddd69e2a-148c-4304-8470-47934d16e539 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:02.052929 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:02.053369 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ddd69e2a-148c-4304-8470-47934d16e539 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:02.056874 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'status': 'completed', 'code': 200} Dec 21 03:53:02.166606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-ac0b8e32-56bf-47c9-bc1a-ca7c8363faa4 service neutron] 10.222.0.18 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1407504 Dec 21 03:53:02.222181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:02.306331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-b2b0c6e0-6653-4003-835b-40f7f020e889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:02.308728 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-b2b0c6e0-6653-4003-835b-40f7f020e889 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=920e98327f8340b0966241ad0871434f&device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 1097 time: 0.0711563 Dec 21 03:53:02.316696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:02.396059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 9d104924-c03e-45e5-91f9-964b183b5c3a is not hosted by any dhcp agent {{(pid=110311) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 03:53:02.402816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:02.404132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:02.406002 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "PUT /v2.0/networks/9d104924-c03e-45e5-91f9-964b183b5c3a HTTP/1.1" status: 200 len: 723 time: 0.6425681 Dec 21 03:53:02.420674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:02.426635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:02.473999 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:45Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:02.477896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-f9ef262e-c6e7-4a91-8ad0-c70673d027f2 service neutron] 10.222.0.18 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3028531 Dec 21 03:53:02.531759 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5989b9f-e0aa-4e34-9910-0c32a7cdaeb2 None None] The sync data for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 is: [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:51:40Z', 'revision_number': 4, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '24bea13f-7eed-47c1-8222-2eb2fea02484', 'name': '', 'network_id': 'e94928bb-be91-4772-b576-ae2f90f005ad', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'mac_address': 'fa:16:3e:5f:c9:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 990, 'fixed_ips': [{'subnet_id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:36Z', 'updated_at': '2021-12-21T03:51:45Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'subnets': [{'id': 'f8a63e48-36eb-4a7d-be87-03acc85470f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:02.649863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a41759-666a-4ffb-b8fd-9473201adfca tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=9d104924-c03e-45e5-91f9-964b183b5c3a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:02.660971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9d104924-c03e-45e5-91f9-964b183b5c3a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:02.715937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-5fc2d706-cfef-45c2-a441-60e544ccafe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:02.717424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-5fc2d706-cfef-45c2-a441-60e544ccafe0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 200 len: 921 time: 0.3956842 Dec 21 03:53:02.796247 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:02.811608 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-79e8fa8f-fd1d-47dc-968a-db33b209112b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 200 len: 217 time: 0.0858531 Dec 21 03:53:02.817313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b242e38-0443-47f6-ab71-f6154e2fc8e9 req-482238fe-3fce-49c0-958e-ac603a731858 service neutron] 10.222.0.18 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3276920 Dec 21 03:53:02.881565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:02.883901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:02.888078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:03.043728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-e13adae8-45da-4234-81cf-eff33c8c8455 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:03.045718 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-e13adae8-45da-4234-81cf-eff33c8c8455 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 200 len: 860 time: 0.2251866 Dec 21 03:53:03.117881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event updated for resources: {'Port': ['ID=3ca8affe-a1ef-42a0-b658-e51c5bac251c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:03.134364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:03.148606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-994c087a-d1b7-426b-9ca1-3219b69abb0b None None] New status for floating IP c223e8a2-cc2d-4478-af5d-47cb4c476446: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:53:03.196170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-71ad6761-21e7-4f91-af06-d239c8c91a38 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=61ff766c-48ae-4d8d-8914-1189fe53e3d3 HTTP/1.1" status: 200 len: 210 time: 0.0795751 Dec 21 03:53:03.206415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-62fa72b2-546b-408a-85ea-4799035ee636 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e94928bb-be91-4772-b576-ae2f90f005ad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0669732 Dec 21 03:53:03.460736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-818545c1-000c-4a64-894c-28ae15ed7279 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:03.464688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-818545c1-000c-4a64-894c-28ae15ed7279 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=cb6e434168cc48daa3e991310cb6da73&shared=False HTTP/1.1" status: 200 len: 913 time: 0.2179708 Dec 21 03:53:03.487194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:03.495578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3e720546-6388-479b-b2ee-8d578c2e7906 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.4132738 Dec 21 03:53:03.514071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68bbfd7a-5af7-49f4-acd8-823cb486a53a None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:03.516402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dfcc139e-6410-418e-af13-8ee2bdbe361d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:03.558872 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-741ed360-f796-4d59-8631-83c986a43b66 service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3071990 Dec 21 03:53:03.564289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-b6ee2b88-645a-4b23-94de-ec2ddc3ec817 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips/c223e8a2-cc2d-4478-af5d-47cb4c476446 HTTP/1.1" status: 200 len: 695 time: 0.0581996 Dec 21 03:53:03.718253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3e316458-b3c1-421d-8bc0-f51e91d3c8a0 None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:03.718749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3e316458-b3c1-421d-8bc0-f51e91d3c8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:03.735534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-d28854a0-ad38-4c8b-9978-dd0711f3b87f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:03.737757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-d28854a0-ad38-4c8b-9978-dd0711f3b87f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 784 time: 0.1589122 Dec 21 03:53:03.777835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:03.818066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1031edc6-a478-4210-ab65-5a72b6e74ffc req-5c5de6a6-4350-4156-a3ab-9fdfaa349687 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:03.822196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1031edc6-a478-4210-ab65-5a72b6e74ffc req-5c5de6a6-4350-4156-a3ab-9fdfaa349687 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 946 time: 0.3567040 Dec 21 03:53:03.829335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:03.830170 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:03.851866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=9b3e6573-2a8e-4432-bfb4-641a896ed1da,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:03.872133 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-694b1e7d-4c71-44e2-a499-440046b0ae61 req-7d35e513-cfc4-4d22-8e5e-4e0f7fd7215e service neutron] 10.222.0.54 "GET /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2534361 Dec 21 03:53:03.912482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:03.913111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: 9d104924-c03e-45e5-91f9-964b183b5c3a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:03.971954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-df48dad9-4be6-4ccb-a7cb-3358b2d0325d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 696 time: 0.1802981 Dec 21 03:53:04.011484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3e316458-b3c1-421d-8bc0-f51e91d3c8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.017493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 9d104924-c03e-45e5-91f9-964b183b5c3a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:04.043768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-62970831-4d2b-47a8-92ba-e68bd5cf9a41 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/floatingips?floating_ip_address=172.25.5.249 HTTP/1.1" status: 200 len: 696 time: 0.0709543 Dec 21 03:53:04.051507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.074172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] Update dhcp port {'port': {'network_id': '284b3ea9-47ad-462a-a649-dd4b568f5b2f', 'fixed_ips': [{'subnet_id': 'e834a669-61ec-414d-88ab-c8641289f01d', 'ip_address': '2001:db8::2'}, {'subnet_id': '8c6520ca-2298-4357-8601-ab5511bcda05'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'dfcc139e-6410-418e-af13-8ee2bdbe361d'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 03:53:04.109047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3e316458-b3c1-421d-8bc0-f51e91d3c8a0 None None] For port dfcc139e-6410-418e-af13-8ee2bdbe361d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dfcc139e-6410-418e-af13-8ee2bdbe361d,segment=NetworkSegment(5c29c207-8f56-40b7-9063-86bef2d84c91),segment_id=5c29c207-8f56-40b7-9063-86bef2d84c91)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:04.114798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.121245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9d104924-c03e-45e5-91f9-964b183b5c3a) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:04.130302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:04.133349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c83f4e77-ae5c-4cc8-aeb3-57f480acadea None None] Network 9d104924-c03e-45e5-91f9-964b183b5c3a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:04.134198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.203660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3e316458-b3c1-421d-8bc0-f51e91d3c8a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.215628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-fa4b3082-1d1b-45f0-a4c1-476d58da9fea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:04.218346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-fa4b3082-1d1b-45f0-a4c1-476d58da9fea service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.7420485 Dec 21 03:53:04.223973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1031edc6-a478-4210-ab65-5a72b6e74ffc req-20ae4406-7ec8-4d86-8ada-ae56087d7d19 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2956166 Dec 21 03:53:04.236104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:04.238675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d69fe65c-211b-4f87-b703-3a86adb2d29b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8162444 Dec 21 03:53:04.242387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55520) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:04.254778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:04.336331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Deleting port deebce28-6ffd-4b10-bb20-64ac8e171222 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:04.336331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.451431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:53:04.451801 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:53:04.464861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-529064680'] for subnet, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.490252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e316458-b3c1-421d-8bc0-f51e91d3c8a0 None None] Pushing event updated for resources: {'Port': ['ID=dfcc139e-6410-418e-af13-8ee2bdbe361d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:04.587338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497ffa2f-637d-4a36-91eb-fa88359c7b05 req-675e4156-29ff-4900-94df-afc14a7abbc7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/ports?device_id=61ff766c-48ae-4d8d-8914-1189fe53e3d3 HTTP/1.1" status: 200 len: 210 time: 0.0630782 Dec 21 03:53:04.595693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.620847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9d104924-c03e-45e5-91f9-964b183b5c3a', 'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '9b3e6573-2a8e-4432-bfb4-641a896ed1da'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:53:04.621789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.648899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:04.651943 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71000d3c-f94e-4a4b-b564-313e02d46501" -d '{"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-unplugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:04.654169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.656697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.697668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Calling delete_port for deebce28-6ffd-4b10-bb20-64ac8e171222 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:04.774104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] Allocated IP 172.20.0.1 (284b3ea9-47ad-462a-a649-dd4b568f5b2f/8c6520ca-2298-4357-8601-ab5511bcda05/dfcc139e-6410-418e-af13-8ee2bdbe361d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:04.785135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8762542841402', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-529022266'] for subnet, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.796359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:04.862851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.902477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:04.903113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:04.904684 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "PUT /v2.0/subnets/9b3e6573-2a8e-4432-bfb4-641a896ed1da HTTP/1.1" status: 200 len: 826 time: 0.6613166 Dec 21 03:53:04.909713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:04.967998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a879fad-8f90-4df7-88f6-5d0df9661a0b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=9b3e6573-2a8e-4432-bfb4-641a896ed1da,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:05.030716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-5cf88846-f648-4e8c-b145-e826d3dd4fab tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1526031541&fields=id&tenant_id=c6efab45cf074755a485f41e201aa464 HTTP/1.1" status: 200 len: 267 time: 0.2345011 Dec 21 03:53:05.082255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.108148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.112006 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-0ccf8b56-b0ae-4db9-9c13-84fb6285b55d service neutron] 10.222.0.31 "GET /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.1015339 Dec 21 03:53:05.145288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:05.171918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event deleted for resources: {'Port': ['ID=deebce28-6ffd-4b10-bb20-64ac8e171222,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:05.187974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.229535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-0dd3284f-2277-437a-8bfd-a6a18e44092e tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:05.235436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-0dd3284f-2277-437a-8bfd-a6a18e44092e tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/networks?id=02e2ef7c-d00c-4471-ae34-58e2e22c435a HTTP/1.1" status: 200 len: 806 time: 0.1944063 Dec 21 03:53:05.253618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-53e5656a-45f9-49cc-95b1-54648f58f7fb tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/quotas/c6efab45cf074755a485f41e201aa464 HTTP/1.1" status: 200 len: 375 time: 0.0136428 Dec 21 03:53:05.254986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.257112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Allocated IP 2001:db8::2 (9d104924-c03e-45e5-91f9-964b183b5c3a/9b3e6573-2a8e-4432-bfb4-641a896ed1da/06fb2370-2daa-418a-9cf6-8e9319c0da2d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:05.257926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.267311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c67f85f5-e2bc-44a7-ba5f-4127bc74fe80 req-aa9c4167-005e-4bb9-8711-b4bf690a3ae6 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "DELETE /v2.0/floatingips/c223e8a2-cc2d-4478-af5d-47cb4c476446 HTTP/1.1" status: 204 len: 173 time: 1.2099702 Dec 21 03:53:05.305321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] For port dfcc139e-6410-418e-af13-8ee2bdbe361d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dfcc139e-6410-418e-af13-8ee2bdbe361d,segment=NetworkSegment(5c29c207-8f56-40b7-9063-86bef2d84c91),segment_id=5c29c207-8f56-40b7-9063-86bef2d84c91)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:05.359146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-814b6550-a8e1-474e-872f-e3643dff270f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c6efab45cf074755a485f41e201aa464&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0899334 Dec 21 03:53:05.388338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-144040f7-ae40-429a-94fc-628fee32a78b service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:53:05.393152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:05.399752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-144040f7-ae40-429a-94fc-628fee32a78b service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0337830 Dec 21 03:53:05.414116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dfcc139e-6410-418e-af13-8ee2bdbe361d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:05.416816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:05.456657 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.470098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 425b1a38-084b-43fc-ab16-7a0f86f2eb65 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:05.485919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:05.488185 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7e2e445-29ef-4085-aa8f-f6efdb4d404b x-openstack-request-id: req-b7e2e445-29ef-4085-aa8f-f6efdb4d404b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:05.488483 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-unplugged", "status": "completed", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:05.488747 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b7e2e445-29ef-4085-aa8f-f6efdb4d404b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:05.489147 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'code': 200} Dec 21 03:53:05.500971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:05.501366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.542275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-6a6e1e55-a858-4a28-8f2d-7f87b0f6e849 service neutron] 10.222.0.18 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1370306 Dec 21 03:53:05.579265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.584874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.607601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.672059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.718703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-91f67524-93b1-4ad9-b898-6fcba94401d5 service neutron] 10.222.0.18 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1693742 Dec 21 03:53:05.727889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ea4fdd-b8d9-4ffd-aef0-c93740f4f983 None None] Pushing event updated for resources: {'Port': ['ID=dfcc139e-6410-418e-af13-8ee2bdbe361d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:05.728065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-65c4a1d0-2a01-45f9-aefc-c44e4c6e8e79 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:05.730922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-65c4a1d0-2a01-45f9-aefc-c44e4c6e8e79 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.1790743 Dec 21 03:53:05.741214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Network 9d104924-c03e-45e5-91f9-964b183b5c3a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:05.741214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:05.742902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:05.761152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] Transition to ACTIVE for port object 425b1a38-084b-43fc-ab16-7a0f86f2eb65 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:53:05.762512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.762811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-29c930bf-755a-402d-ba8a-c8394d8eac92 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.0165365 Dec 21 03:53:05.796846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Pushing event updated for resources: {'Port': ['ID=06fb2370-2daa-418a-9cf6-8e9319c0da2d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:05.799516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=9b3e6573-2a8e-4432-bfb4-641a896ed1da,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:05.850862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-51e65c83-0e8d-48a7-81f7-0a0f5b56fe05 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0813160 Dec 21 03:53:05.869436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-0925ff30-12ae-425e-9df1-5ec5f406d783 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:53:05.876220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-0925ff30-12ae-425e-9df1-5ec5f406d783 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0157475 Dec 21 03:53:05.882121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Attempting to bind port 06fb2370-2daa-418a-9cf6-8e9319c0da2d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:05.887638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Attempting to bind port 06fb2370-2daa-418a-9cf6-8e9319c0da2d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:05.888079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Attempting to bind port 06fb2370-2daa-418a-9cf6-8e9319c0da2d on network 9d104924-c03e-45e5-91f9-964b183b5c3a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:05.894124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:05.894777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Checking segment: {'id': '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:05.897353 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.897917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Bound using segment: {'id': '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:05.904720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Bound port: 06fb2370-2daa-418a-9cf6-8e9319c0da2d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '9d104924-c03e-45e5-91f9-964b183b5c3a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:05.904720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.905142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.905599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:05.985877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] For port 06fb2370-2daa-418a-9cf6-8e9319c0da2d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:05.998068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] For port 06fb2370-2daa-418a-9cf6-8e9319c0da2d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=06fb2370-2daa-418a-9cf6-8e9319c0da2d,segment=NetworkSegment(1c1f94f9-db7a-4261-ac9b-41f1a560f9ac),segment_id=1c1f94f9-db7a-4261-ac9b-41f1a560f9ac)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:06.003611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09ee40dc-988b-4988-8a65-b63b8a459f92 None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:06.034785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] Pushing event updated for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=12']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:06.052835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d104924-c03e-45e5-91f9-964b183b5c3a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:06.058669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-d1b1eecd-6415-4fc0-b14d-12fecb0f99fb service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1752231 Dec 21 03:53:06.065043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:06.065672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:06.080065 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.082092 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.118779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78be4ee6-f194-4fb3-9c24-4c417a6042a4 req-859830bb-b3b2-42e9-be0b-ddedeb7f9976 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups/4fbd9874-f292-4816-b164-fa0779ad7468 HTTP/1.1" status: 200 len: 1826 time: 0.0879407 Dec 21 03:53:06.125015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] No DVR routers for this DVR port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:06.152193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.165941 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-e717541f-236c-4ec5-91e3-bd7bf0b95ebd service neutron] 10.222.0.31 "PUT /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 1.0304270 Dec 21 03:53:06.167975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:06.168559 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:06.174285 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:06.204753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e585d67a-03b1-4909-bf6c-97bc8b9f6c30 None None] Pushing event updated for resources: {'Port': ['ID=06fb2370-2daa-418a-9cf6-8e9319c0da2d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:06.280361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-252166f8-af5a-4397-98eb-a75fcdf749c3 None None] Network 9d104924-c03e-45e5-91f9-964b183b5c3a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:06.355327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 03:53:06.355327 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 03:53:06.355327 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '9d104924-c03e-45e5-91f9-964b183b5c3a'}] Dec 21 03:53:06.355327 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:53:06.356062 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:53:06.415942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a722a9c9-3185-403e-bcc4-6998e436c866 None None] Network 9d104924-c03e-45e5-91f9-964b183b5c3a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:06.477843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c91cf14a-4f7f-4b53-b9c8-8142f725899a None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:06.574769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-db82982c-8ac0-4ae9-8f7f-a14b5bab0200 None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:06.575178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db82982c-8ac0-4ae9-8f7f-a14b5bab0200 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.646320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-bdc59363-cf05-4be6-bb1e-e02971e1c06d service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5762162 Dec 21 03:53:06.653997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-575e25d4-880e-4fa7-a646-9b399321c695 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:06.655718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-575e25d4-880e-4fa7-a646-9b399321c695 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.1072950 Dec 21 03:53:06.660051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-78be4ee6-f194-4fb3-9c24-4c417a6042a4 req-3c847a33-050b-4657-b832-2fa792bfd96d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.710761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-78be4ee6-f194-4fb3-9c24-4c417a6042a4 req-3c847a33-050b-4657-b832-2fa792bfd96d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.749473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-16c50780-3ba5-40f3-8fb2-2d73a8025ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:06.751007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-16c50780-3ba5-40f3-8fb2-2d73a8025ea2 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399&tenant_id=e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 1097 time: 0.0865145 Dec 21 03:53:06.834001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-1ce1c84c-43cb-4e7e-96a3-6f3795084b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:06.835620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-1ce1c84c-43cb-4e7e-96a3-6f3795084b96 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1097 time: 0.0459938 Dec 21 03:53:06.836682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-78be4ee6-f194-4fb3-9c24-4c417a6042a4 req-3c847a33-050b-4657-b832-2fa792bfd96d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.841332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-78be4ee6-f194-4fb3-9c24-4c417a6042a4 req-3c847a33-050b-4657-b832-2fa792bfd96d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.841332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78be4ee6-f194-4fb3-9c24-4c417a6042a4 req-3c847a33-050b-4657-b832-2fa792bfd96d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "DELETE /v2.0/security-groups/4fbd9874-f292-4816-b164-fa0779ad7468 HTTP/1.1" status: 204 len: 173 time: 0.7210968 Dec 21 03:53:06.857632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:06.892512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a154245-b6fa-4d21-b7c9-24b0b6dcc90e None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 03:53:06.978074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port 06fb2370-2daa-418a-9cf6-8e9319c0da2d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:06.978627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.021171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-43f028bc-4321-4a23-bd59-b60a4f0a55e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:07.024442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-43f028bc-4321-4a23-bd59-b60a4f0a55e6 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1801686 Dec 21 03:53:07.084860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port 06fb2370-2daa-418a-9cf6-8e9319c0da2d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=06fb2370-2daa-418a-9cf6-8e9319c0da2d,segment=NetworkSegment(1c1f94f9-db7a-4261-ac9b-41f1a560f9ac),segment_id=1c1f94f9-db7a-4261-ac9b-41f1a560f9ac)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:07.086213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.094104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ba468ca8-2f16-43c0-8b6f-25c13de38915 None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:07.094487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba468ca8-2f16-43c0-8b6f-25c13de38915 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.114437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-79960b47-8ce9-4475-a329-e9c4565768e7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 200 len: 217 time: 0.0735617 Dec 21 03:53:07.125536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for 06fb2370-2daa-418a-9cf6-8e9319c0da2d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:07.164142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c847a33-050b-4657-b832-2fa792bfd96d tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fbd9874-f292-4816-b164-fa0779ad7468,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:07.284102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70530c41-61aa-4ead-b3bd-f7aeba8d4762 req-d1d8cf7a-04eb-4e57-9ce1-1eef50b20cf0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:07.285963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70530c41-61aa-4ead-b3bd-f7aeba8d4762 req-d1d8cf7a-04eb-4e57-9ce1-1eef50b20cf0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.2560182 Dec 21 03:53:07.314727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c5dccdef-6d47-437b-811a-57ce3bbf3fab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:07.315554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c5dccdef-6d47-437b-811a-57ce3bbf3fab service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.1734917 Dec 21 03:53:07.361086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-27158672-1100-4039-a958-ceb6082eec71 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0372524 Dec 21 03:53:07.367854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.397698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70530c41-61aa-4ead-b3bd-f7aeba8d4762 req-462a023f-78fa-44be-82a8-53c31c052a4b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942791 Dec 21 03:53:07.412128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=06fb2370-2daa-418a-9cf6-8e9319c0da2d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:07.415097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port 06fb2370-2daa-418a-9cf6-8e9319c0da2d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:07.454266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a154245-b6fa-4d21-b7c9-24b0b6dcc90e None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 03:53:07.459660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dfcc139e-6410-418e-af13-8ee2bdbe361d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:07.517072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.547020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d104924-c03e-45e5-91f9-964b183b5c3a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:07.559448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:07.559744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1c1f94f9-db7a-4261-ac9b-41f1a560f9ac') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:07.571239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.596312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.601876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d05ef613-3406-4311-837c-104f803145b9 req-25c89e49-0435-4d84-841a-24e5df38166a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 210 time: 0.1156073 Dec 21 03:53:07.605829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:07.606270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.643169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-7846e33e-34ca-4433-a59d-de1aa1e06e8b service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2705941 Dec 21 03:53:07.648895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:07.649273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:07.717255 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:07.737015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f291f32-8ea5-4df9-ae64-cff8ddaf9954 req-3e686dbf-2d24-487c-982f-a46fc3354d42 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 210 time: 0.0437698 Dec 21 03:53:07.766300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.780362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.786721 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/9d104924-c03e-45e5-91f9-964b183b5c3a HTTP/1.1" status: 204 len: 168 time: 2.8763618 Dec 21 03:53:07.796695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55606) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:07.806648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b480eaf2-ad33-48fb-8eaf-0006ee3d8792 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=9d104924-c03e-45e5-91f9-964b183b5c3a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:07.825117 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-47b23522-5022-4f3e-8aa1-1e789270f7b9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:07.825690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-47b23522-5022-4f3e-8aa1-1e789270f7b9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:07.833182 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-47b23522-5022-4f3e-8aa1-1e789270f7b9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/9d104924-c03e-45e5-91f9-964b183b5c3a HTTP/1.1" status: 404 len: 339 time: 0.0316556 Dec 21 03:53:07.837377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55612) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:07.843085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1106385399', 'description': 'd1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:07.855244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-fef6258e-471c-4e4a-9ec7-3bc45fa87f4a service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2038944 Dec 21 03:53:07.909890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:07.915611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.965987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:07.977031 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:07.977482 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment 7d38cce9-7ab8-4634-8ce2-e07fecdca0bd of type vlan for network f66e0efd-af8f-45a5-83a3-bc1a0db88d6e Dec 21 03:53:08.060643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:08.077952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d48ef0-f41f-4397-9cd6-23cdf55d3c51 req-5fc792b3-ecb6-4f2b-b779-5ed095d32c26 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.079669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31d48ef0-f41f-4397-9cd6-23cdf55d3c51 req-5fc792b3-ecb6-4f2b-b779-5ed095d32c26 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.0681119 Dec 21 03:53:08.138352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31d48ef0-f41f-4397-9cd6-23cdf55d3c51 req-fcda02fe-886b-492f-ac62-3f018238f68a tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520296 Dec 21 03:53:08.149445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:08.160822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.160822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:08.229061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=f66e0efd-af8f-45a5-83a3-bc1a0db88d6e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:08.239815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f66e0efd-af8f-45a5-83a3-bc1a0db88d6e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:08.271876 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e65ef6b5-f5d4-4e11-b2cc-a8af78c63790 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.4360592 Dec 21 03:53:08.274509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:08.362924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c30724cc-923f-475c-9d4f-21ca7a31e8b0 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.364565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c30724cc-923f-475c-9d4f-21ca7a31e8b0 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks?id=f66e0efd-af8f-45a5-83a3-bc1a0db88d6e HTTP/1.1" status: 200 len: 765 time: 0.0889404 Dec 21 03:53:08.367299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55656) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:08.373234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'description': 'd2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:08.564656 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:08.625415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94989b6f-2d6c-4e03-ace8-abebbac50d4a req-36960223-3e21-49a3-bf04-12b18c8eedd3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.627076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94989b6f-2d6c-4e03-ace8-abebbac50d4a req-36960223-3e21-49a3-bf04-12b18c8eedd3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.1167262 Dec 21 03:53:08.688947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:08.733862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network f66e0efd-af8f-45a5-83a3-bc1a0db88d6e is not hosted by any dhcp agent {{(pid=110310) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 03:53:08.740356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.740959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:08.742272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "PUT /v2.0/networks/f66e0efd-af8f-45a5-83a3-bc1a0db88d6e HTTP/1.1" status: 200 len: 762 time: 0.3739667 Dec 21 03:53:08.745701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:08.804530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d47343-4f7d-4e87-98d4-29c412097eab tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=f66e0efd-af8f-45a5-83a3-bc1a0db88d6e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:08.814536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-fdef1de8-5c79-40b2-a4b2-ea198182129b tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.817314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-fdef1de8-5c79-40b2-a4b2-ea198182129b tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.54 "GET /v2.0/networks?id=02e2ef7c-d00c-4471-ae34-58e2e22c435a HTTP/1.1" status: 200 len: 806 time: 0.2338459 Dec 21 03:53:08.819873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f66e0efd-af8f-45a5-83a3-bc1a0db88d6e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:08.821260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94989b6f-2d6c-4e03-ace8-abebbac50d4a req-c520220f-56f5-4890-b8a7-02fceaf380a2 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1854131 Dec 21 03:53:08.841840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16ccaac0-cc75-4744-9d6f-4c218711e8be tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:08.855565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-16ccaac0-cc75-4744-9d6f-4c218711e8be tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks?id=f66e0efd-af8f-45a5-83a3-bc1a0db88d6e HTTP/1.1" status: 200 len: 765 time: 0.1087744 Dec 21 03:53:08.856452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:08.908911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-c3a911d5-e33e-4540-8e20-f184c1f24fda tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c6efab45cf074755a485f41e201aa464 HTTP/1.1" status: 200 len: 380 time: 0.0653529 Dec 21 03:53:08.923234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Request body: {'port': {'device_id': '51462fb8-ab83-44bf-93e6-23a908f29176', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'admin_state_up': True, 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'security_groups': ['27f4831e-56b2-42f0-925d-a97178be0500']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:09.065500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-b9a6465b-099a-45c8-b6e9-d78bbff874ea tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.066906 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-b9a6465b-099a-45c8-b6e9-d78bbff874ea tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.2094433 Dec 21 03:53:09.080489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f656f075-a605-4432-9683-626bc31f85a3 req-d12f52bc-6a52-4524-ba40-48a7a19d6664 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 210 time: 0.0351846 Dec 21 03:53:09.112735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c38dd860-2e62-422b-9d66-267396c5659d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.114276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c38dd860-2e62-422b-9d66-267396c5659d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.2462864 Dec 21 03:53:09.117197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55694) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:09.162960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-687948dc-42b8-4889-acfe-6e15559c3ae4 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 207 time: 0.0407546 Dec 21 03:53:09.162960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Made reservation on behalf of c6efab45cf074755a485f41e201aa464 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:09.163597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:09.166399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55698) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:09.245201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7a3be8a-bcc1-48a9-9d44-a9184ab012f4 req-cb3d417e-acdb-4142-a944-afeebd18b6e7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 210 time: 0.0891025 Dec 21 03:53:09.304648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c716e371-a008-49c3-b2aa-d19ff1da3159 service neutron] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:09.307837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c716e371-a008-49c3-b2aa-d19ff1da3159 service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:09.309302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b4bd4e6-c1a6-42ed-ba9a-3a53e9a11f08 req-c716e371-a008-49c3-b2aa-d19ff1da3159 service neutron] 10.222.0.54 "DELETE /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.1939666 Dec 21 03:53:09.523807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.530729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.537144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.543527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.549392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.555399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.560792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f3e7c2a2-ace1-4f22-9e50-2fa376743fc9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3731 time: 0.3830090 Dec 21 03:53:09.568764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d301e1b-0236-4d43-a98e-d1d04f1fe580 req-9d74981e-e222-473c-933b-914bad75b035 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.570403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d301e1b-0236-4d43-a98e-d1d04f1fe580 req-9d74981e-e222-473c-933b-914bad75b035 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.2486904 Dec 21 03:53:09.571006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55706) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:09.655733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Allocated IP 172.20.0.9 (02e2ef7c-d00c-4471-ae34-58e2e22c435a/394148b6-6bdf-4aaa-94d7-be0fbbf6634e/d2acf96a-cb48-4985-bab5-901e7db33ffc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:09.750943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-c4460a2e-de98-45dd-bea0-486cbadd5bc8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.752421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-c4460a2e-de98-45dd-bea0-486cbadd5bc8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.4353633 Dec 21 03:53:09.765116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d301e1b-0236-4d43-a98e-d1d04f1fe580 req-acea30ea-c577-4243-9c3b-ec62b11b7a14 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792879 Dec 21 03:53:09.796406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cd0bcdee-c5b1-4ce8-85e6-cfc99b09ea8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 813 time: 0.2214432 Dec 21 03:53:09.799908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55722) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:09.832958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Request body: {'port': {'device_id': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'admin_state_up': True, 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:09.906673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:09.931302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4975e59-940e-4af3-82aa-54e600b625bd tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.933579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4975e59-940e-4af3-82aa-54e600b625bd tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.936348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4975e59-940e-4af3-82aa-54e600b625bd tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.938033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4975e59-940e-4af3-82aa-54e600b625bd tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.939559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4975e59-940e-4af3-82aa-54e600b625bd tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:09.941343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4975e59-940e-4af3-82aa-54e600b625bd tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1404438 Dec 21 03:53:09.947583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55730) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:10.066506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d483a4f0-cfe4-48ef-abaf-eaab440664c5 req-2813904d-2ff7-4c06-a494-9cae50c2f66d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.071399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d483a4f0-cfe4-48ef-abaf-eaab440664c5 req-2813904d-2ff7-4c06-a494-9cae50c2f66d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.1403453 Dec 21 03:53:10.076341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd0919b9-1de7-4f8c-8423-bc5ca621564d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.077909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd0919b9-1de7-4f8c-8423-bc5ca621564d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.079424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd0919b9-1de7-4f8c-8423-bc5ca621564d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.080763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:10.081211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd0919b9-1de7-4f8c-8423-bc5ca621564d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.082426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd0919b9-1de7-4f8c-8423-bc5ca621564d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.084050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cd0919b9-1de7-4f8c-8423-bc5ca621564d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.1337686 Dec 21 03:53:10.084368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.097008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:10.111713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.176787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:10.183128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d483a4f0-cfe4-48ef-abaf-eaab440664c5 req-ee228200-6f7f-4ae0-b578-33f9f63c16cc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975566 Dec 21 03:53:10.185972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:10.188750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:10.217587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event updated for resources: {'Port': ['ID=d2acf96a-cb48-4985-bab5-901e7db33ffc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:10.247926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.248460 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.310414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-646e0aa2-98f5-4cbd-be0f-c509fd4de7f8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.316695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-646e0aa2-98f5-4cbd-be0f-c509fd4de7f8 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks/ee67a52b-0310-46e9-bd3e-9290f6b608a2 HTTP/1.1" status: 200 len: 803 time: 0.2177494 Dec 21 03:53:10.324258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:10.343713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-8e8a5336-cdc3-4c30-b6bc-7bf9cf8eb51a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4244637 Dec 21 03:53:10.353495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Allocated IP 172.20.0.9 (a0e5eeee-a736-4bd3-bdf6-679e8da99022/0937a3b1-7f54-409b-bba0-29fa72617a82/ee7741b1-3849-4963-be69-7a915a5e81b3) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:10.373963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Request body: {'port': {'device_id': '51462fb8-ab83-44bf-93e6-23a908f29176', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:10.495601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8b5d58d2-447e-46ff-a2fe-da89689d765d None None] Provisioning complete for port d2acf96a-cb48-4985-bab5-901e7db33ffc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:10.496680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8b5d58d2-447e-46ff-a2fe-da89689d765d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.521051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.543544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8b5d58d2-447e-46ff-a2fe-da89689d765d None None] Port d2acf96a-cb48-4985-bab5-901e7db33ffc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:10.573699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.582732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55801914-cfd1-4ea6-8b79-be3a4dff4144 req-1291a7fb-e733-477c-8625-93742256b98c tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.595490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55801914-cfd1-4ea6-8b79-be3a4dff4144 req-1291a7fb-e733-477c-8625-93742256b98c tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 931 time: 0.1884243 Dec 21 03:53:10.603900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-553971b8-3c60-4dc6-83d6-74c04229ec30 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/networks/ee67a52b-0310-46e9-bd3e-9290f6b608a2?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 319 time: 0.2755136 Dec 21 03:53:10.605116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55764) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:10.680020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8400a08a-50a5-495f-a6d3-71d63d99e6ed tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.684773 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8400a08a-50a5-495f-a6d3-71d63d99e6ed tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/subnets/11abf2fc-903a-4998-b1a7-de8e90d875ca HTTP/1.1" status: 200 len: 843 time: 0.0752523 Dec 21 03:53:10.685017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:10.717448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55801914-cfd1-4ea6-8b79-be3a4dff4144 req-60dfe9e6-5912-4372-b3ce-4e19f7ed6495 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1150572 Dec 21 03:53:10.723496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.791036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40d2733e-3d4b-406b-bee7-07ce68a882f3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.792995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-40d2733e-3d4b-406b-bee7-07ce68a882f3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "GET /v2.0/subnets/11abf2fc-903a-4998-b1a7-de8e90d875ca?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.1070628 Dec 21 03:53:10.795387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:10.796183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event updated for resources: {'Port': ['ID=ee7741b1-3849-4963-be69-7a915a5e81b3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:10.803056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55772) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:10.810622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-539952040'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:10.814167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:10.820307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:10.832863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e985d6ce-2dcd-469c-91a1-6112b21b207c None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:10.877285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-25dc4e82-81dc-42aa-918e-3670fabe0f91 None None] Provisioning complete for port ee7741b1-3849-4963-be69-7a915a5e81b3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:10.877742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-25dc4e82-81dc-42aa-918e-3670fabe0f91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.891750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.892396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.897586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9e1206-53dd-4e2d-bea2-0bf02cfab8d3 req-2f2395e6-361c-4652-91bd-5a469aa77fdf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:10.899204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f9e1206-53dd-4e2d-bea2-0bf02cfab8d3 req-2f2395e6-361c-4652-91bd-5a469aa77fdf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 931 time: 0.0918205 Dec 21 03:53:10.932602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:10.932843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-25dc4e82-81dc-42aa-918e-3670fabe0f91 None None] Port ee7741b1-3849-4963-be69-7a915a5e81b3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:10.941142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:10.976962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-339f1f6c-dde1-40f7-9b2d-4589a366c72a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1661627 Dec 21 03:53:10.996871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:11.000887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f9e1206-53dd-4e2d-bea2-0bf02cfab8d3 req-921bda82-4a53-49af-84e6-809aafd33fb6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930371 Dec 21 03:53:11.012537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Request body: {'port': {'device_id': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:11.013859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d2acf96a-cb48-4985-bab5-901e7db33ffc {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:11.017104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.017450 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Added segment ab81919f-875d-4bb0-9c3f-33f39497bc4c of type vlan for network 890e150b-25f5-427c-9eec-d4899f32e5df Dec 21 03:53:11.022707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.047610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Transition to ACTIVE for port object d2acf96a-cb48-4985-bab5-901e7db33ffc will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:53:11.071600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-5fcb91ef-1c77-400e-875d-76159714107e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:11.073642 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-5fcb91ef-1c77-400e-875d-76159714107e tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.54 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1552064 Dec 21 03:53:11.118092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.154120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.162756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.163387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d2262b-356e-490c-9729-925dd7770c1e req-0acb671b-9ffc-4b22-8167-337c06a2155f tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:11.164943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75d2262b-356e-490c-9729-925dd7770c1e req-0acb671b-9ffc-4b22-8167-337c06a2155f tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1097 time: 0.1094830 Dec 21 03:53:11.212819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c7fd8c-e43e-4c35-9c01-a45d05c5723f req-c4eda076-86c9-4c22-bd78-8449c441ffc7 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:11.214465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4c7fd8c-e43e-4c35-9c01-a45d05c5723f req-c4eda076-86c9-4c22-bd78-8449c441ffc7 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 945 time: 0.1299858 Dec 21 03:53:11.276756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Pushing event updated for resources: {'Port': ['ID=d2acf96a-cb48-4985-bab5-901e7db33ffc,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:11.327914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.331185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75d2262b-356e-490c-9729-925dd7770c1e req-a11f0134-3128-4ca0-8196-abc9c6d79273 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1496885 Dec 21 03:53:11.333770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:11.334377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.362074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4c7fd8c-e43e-4c35-9c01-a45d05c5723f req-9b46e3e7-db9b-41d9-9e2b-a28aebf82fb5 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/security-groups?id=b3a7c1b3-cd89-415c-8815-d4c442d51c8e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1265891 Dec 21 03:53:11.363203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Attempting to bind port d2acf96a-cb48-4985-bab5-901e7db33ffc on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:11.363308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Attempting to bind port d2acf96a-cb48-4985-bab5-901e7db33ffc by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:11.363624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Attempting to bind port d2acf96a-cb48-4985-bab5-901e7db33ffc on network 02e2ef7c-d00c-4471-ae34-58e2e22c435a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:11.368496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Port d2acf96a-cb48-4985-bab5-901e7db33ffc on network 02e2ef7c-d00c-4471-ae34-58e2e22c435a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:53:11.368767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Attempting to bind port d2acf96a-cb48-4985-bab5-901e7db33ffc on network 02e2ef7c-d00c-4471-ae34-58e2e22c435a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:11.374538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:11.374875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Checking segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:11.375300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Bound using segment: {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:11.375727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Bound port: d2acf96a-cb48-4985-bab5-901e7db33ffc, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:11.376746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.444576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Network': ['ID=890e150b-25f5-427c-9eec-d4899f32e5df,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:11.459745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] For port d2acf96a-cb48-4985-bab5-901e7db33ffc, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:11.462502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Deleting port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:11.462811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.463791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 890e150b-25f5-427c-9eec-d4899f32e5df details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:11.474417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] For port d2acf96a-cb48-4985-bab5-901e7db33ffc, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:11.491326 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74dfe286-efac-4da3-9e95-5f5f771121e2 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.6846988 Dec 21 03:53:11.494261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55790) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:11.505828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:11.576924 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.639605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] For port 0c5b3c7d-3a97-48ca-b6c5-74849173c787, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0c5b3c7d-3a97-48ca-b6c5-74849173c787,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:11.640616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.666433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Calling delete_port for 0c5b3c7d-3a97-48ca-b6c5-74849173c787 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:11.683274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:11.684042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.685275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] 10.222.0.54 "PUT /v2.0/ports/d2acf96a-cb48-4985-bab5-901e7db33ffc HTTP/1.1" status: 200 len: 1092 time: 1.3192556 Dec 21 03:53:11.686692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:11.689035 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87bb78e7-61fd-47c5-872a-8ac03fdf834e" -d '{"events": [{"name": "network-changed", "server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:11.719163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ce95b5-e454-49d0-ab2a-1c0688663786 service neutron] Pushing event updated for resources: {'Port': ['ID=d2acf96a-cb48-4985-bab5-901e7db33ffc,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:11.732435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efadc6aa-5931-41e1-a43f-51166148b176 req-65006576-fff7-43e7-872c-e1f9be9a35af tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:11.739395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efadc6aa-5931-41e1-a43f-51166148b176 req-65006576-fff7-43e7-872c-e1f9be9a35af tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 1097 time: 0.1133525 Dec 21 03:53:11.779027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ee7741b1-3849-4963-be69-7a915a5e81b3 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:11.789842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.813195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Transition to ACTIVE for port object ee7741b1-3849-4963-be69-7a915a5e81b3 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:53:11.886448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.940239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:11.948331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3212e34b-2f21-48d6-99ef-9fff50d00329 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:11.970266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Pushing event updated for resources: {'Port': ['ID=ee7741b1-3849-4963-be69-7a915a5e81b3,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:11.975270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0c5b3c7d-3a97-48ca-b6c5-74849173c787'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:12.012450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87399791-b7b7-4b8a-b504-5538b9f4daa0 None None] DHCP port deletion for e94928bb-be91-4772-b576-ae2f90f005ad request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:12.052216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Pushing event deleted for resources: {'Port': ['ID=0c5b3c7d-3a97-48ca-b6c5-74849173c787,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:12.099919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] No DVR routers for this DVR port 0c5b3c7d-3a97-48ca-b6c5-74849173c787 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:12.102774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:12.106918 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f95068b-962b-4fcd-8fae-7024ca61604e req-7ab94b10-419a-4a9d-8024-fb7c5c30947f tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.54 "DELETE /v2.0/ports/0c5b3c7d-3a97-48ca-b6c5-74849173c787 HTTP/1.1" status: 204 len: 173 time: 1.0015278 Dec 21 03:53:12.107657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'name': 'network-vif-deleted', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:12.111819 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-950f0604-c2c5-41be-bff1-b517c9d20fcc" -d '{"events": [{"server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "name": "network-vif-deleted", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:12.127154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Attempting to bind port ee7741b1-3849-4963-be69-7a915a5e81b3 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:12.127491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Attempting to bind port ee7741b1-3849-4963-be69-7a915a5e81b3 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:12.127919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Attempting to bind port ee7741b1-3849-4963-be69-7a915a5e81b3 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:12.133264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Port ee7741b1-3849-4963-be69-7a915a5e81b3 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:53:12.133582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Attempting to bind port ee7741b1-3849-4963-be69-7a915a5e81b3 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:12.139190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:12.139467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:12.139849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Bound using segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:12.140265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Bound port: ee7741b1-3849-4963-be69-7a915a5e81b3, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:12.140653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:12.151800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efadc6aa-5931-41e1-a43f-51166148b176 req-352232a8-a7dd-49fd-bbcf-37cd9f7259fd tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4108934 Dec 21 03:53:12.158314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-e4abec9e-0ae3-48d4-81a5-4883341fe4de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.159879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-e4abec9e-0ae3-48d4-81a5-4883341fe4de service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c6efab45cf074755a485f41e201aa464&device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 1095 time: 0.0608900 Dec 21 03:53:12.161044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Made reservation on behalf of 4a3839e737d4474082b7ac35c76c45ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:12.170410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:12.221783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] For port ee7741b1-3849-4963-be69-7a915a5e81b3, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:12.225278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] For port ee7741b1-3849-4963-be69-7a915a5e81b3, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ee7741b1-3849-4963-be69-7a915a5e81b3,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:12.237057 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1677fecd-74c4-4e44-bfc5-4708fac7635a x-openstack-request-id: req-1677fecd-74c4-4e44-bfc5-4708fac7635a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:12.237355 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:12.237601 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1677fecd-74c4-4e44-bfc5-4708fac7635a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:12.238001 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'status': 'completed', 'code': 200} Dec 21 03:53:12.242084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-b8f5b25b-31e2-44e0-bcdd-57fe164b4cbc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc HTTP/1.1" status: 200 len: 217 time: 0.0515659 Dec 21 03:53:12.293456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:12.299064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Performing IP validity checks on allocation pools {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 03:53:12.301951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 03:53:12.334614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.335256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:12.336713 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] 10.222.0.54 "PUT /v2.0/ports/ee7741b1-3849-4963-be69-7a915a5e81b3 HTTP/1.1" status: 200 len: 1092 time: 1.3289890 Dec 21 03:53:12.337213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eabffe9-6a44-4579-bad4-2c386741fb5f None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:12.360640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-633ab5ee-037f-4601-842c-10450c76d5b5 service neutron] Pushing event updated for resources: {'Port': ['ID=ee7741b1-3849-4963-be69-7a915a5e81b3,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:12.381030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-9005ca54-9dd4-409b-a49b-a1f4b69452ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.386016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-9005ca54-9dd4-409b-a49b-a1f4b69452ed service neutron] 10.222.0.54 "GET /v2.0/subnets?id=394148b6-6bdf-4aaa-94d7-be0fbbf6634e HTTP/1.1" status: 200 len: 845 time: 0.1142197 Dec 21 03:53:12.428561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6310aab-b8c6-4d59-8f2f-2f5e23e3652f req-e693ac6f-58c7-4a82-ab1e-8d249a0452d7 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.430074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6310aab-b8c6-4d59-8f2f-2f5e23e3652f req-e693ac6f-58c7-4a82-ab1e-8d249a0452d7 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 943 time: 0.1280148 Dec 21 03:53:12.535430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f06aacc8-9f9e-461c-a9a6-727907174f62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.536957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-f06aacc8-9f9e-461c-a9a6-727907174f62 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=02e2ef7c-d00c-4471-ae34-58e2e22c435a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1447575 Dec 21 03:53:12.547436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-732c5f7f-750a-443b-b55c-954926f7191f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.549225 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-732c5f7f-750a-443b-b55c-954926f7191f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 1095 time: 0.0547998 Dec 21 03:53:12.550242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6310aab-b8c6-4d59-8f2f-2f5e23e3652f req-b8255a10-a939-479b-9b5f-7d10395abefd tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1091661 Dec 21 03:53:12.616395 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-893b7247-7791-4ce1-a6cb-31dbc2acb398 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ee7741b1-3849-4963-be69-7a915a5e81b3 HTTP/1.1" status: 200 len: 217 time: 0.0445688 Dec 21 03:53:12.674361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-235627b4-d0b9-4a80-afd1-0dfb311e60bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.675848 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-235627b4-d0b9-4a80-afd1-0dfb311e60bd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.0522475 Dec 21 03:53:12.694608 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b19772fb-5c98-458d-b899-ef9e6c3d036e x-openstack-request-id: req-b19772fb-5c98-458d-b899-ef9e6c3d036e {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:12.695022 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3ee09111-f8f4-4001-ac40-70b1efac2a0e", "name": "network-vif-deleted", "tag": "0c5b3c7d-3a97-48ca-b6c5-74849173c787", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:12.695338 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b19772fb-5c98-458d-b899-ef9e6c3d036e {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:12.696026 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ee09111-f8f4-4001-ac40-70b1efac2a0e', 'name': 'network-vif-deleted', 'tag': '0c5b3c7d-3a97-48ca-b6c5-74849173c787', 'status': 'completed', 'code': 200} Dec 21 03:53:12.717405 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:12.718736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-4b6f680b-ea31-47e4-a97a-fce0521961be service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0344617 Dec 21 03:53:12.729416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-b2aaf33e-28a8-4f70-8de3-1fa8d7d09e48 service neutron] 10.222.0.54 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1828980 Dec 21 03:53:12.782235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86485477-d7e4-4a5f-b6ad-d45bba6728fc req-b65a732f-792e-4623-a5b6-d69bd5db6cea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:12.783876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86485477-d7e4-4a5f-b6ad-d45bba6728fc req-b65a732f-792e-4623-a5b6-d69bd5db6cea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 943 time: 0.1247375 Dec 21 03:53:12.831318 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-bb1e08db-2581-4648-9068-bb98e2f61329 service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1026056 Dec 21 03:53:12.858174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=2e88de11-ab79-4a30-87d7-7afdaf82a99d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:12.912889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Checking segment: {'id': 'ab81919f-875d-4bb0-9c3f-33f39497bc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:12.913355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network hostable DHCP agents. Network: 890e150b-25f5-427c-9eec-d4899f32e5df, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:12.929939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86485477-d7e4-4a5f-b6ad-d45bba6728fc req-3a340cc4-58c3-43fb-b098-b99ec42f21b3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196725 Dec 21 03:53:12.937511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c48f5114-9b20-4671-9fe0-7a40d1ea2f0b req-556fe2cc-7fa7-4520-9576-fcf228c0a0d5 service neutron] 10.222.0.54 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1818411 Dec 21 03:53:12.965341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-980a6270-9d0b-4249-ba56-903af4b511f9 req-aff95d45-0b16-4148-bcd6-25230d8eb1f1 service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1057184 Dec 21 03:53:13.057864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cd5029c-d505-4d8b-900c-b0247aace938 req-d82b0f5c-6fa9-4bae-b39f-dc138935f9d1 tempest-ServerRescueTestJSONUnderV235-1675028471 tempest-ServerRescueTestJSONUnderV235-1675028471-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ee09111-f8f4-4001-ac40-70b1efac2a0e HTTP/1.1" status: 200 len: 210 time: 0.0370936 Dec 21 03:53:13.063403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Network 890e150b-25f5-427c-9eec-d4899f32e5df is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:13.143390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 890e150b-25f5-427c-9eec-d4899f32e5df) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:13.147329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.147997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7993267'] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.155287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09f6c8fd-41c7-4cce-935b-9d3e7426412f None None] Network 890e150b-25f5-427c-9eec-d4899f32e5df requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:13.235130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3b07ffd5-d14a-47a2-90d0-516d3ff1838a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 1.7386789 Dec 21 03:53:13.235847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55844) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:13.241150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:13.269346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-d00b68fc-4e8c-4df6-bd0a-2f57b5a4f581 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.272354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-d00b68fc-4e8c-4df6-bd0a-2f57b5a4f581 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c6efab45cf074755a485f41e201aa464&device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 1095 time: 0.0780849 Dec 21 03:53:13.291322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-890e150b-25f5-427c-9eec-d4899f32e5df', 'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df', 'project_id': '4a3839e737d4474082b7ac35c76c45ea', 'fixed_ips': [{'subnet_id': '2e88de11-ab79-4a30-87d7-7afdaf82a99d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:53:13.292481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.385092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-529437191'] for subnet, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.399929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-e96680b8-5d7e-4393-af86-d1c33e9db443 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.402796 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-e96680b8-5d7e-4393-af86-d1c33e9db443 service neutron] 10.222.0.54 "GET /v2.0/networks?id=02e2ef7c-d00c-4471-ae34-58e2e22c435a HTTP/1.1" status: 200 len: 907 time: 0.1226223 Dec 21 03:53:13.446428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Allocated IP 2001:db8::3 (890e150b-25f5-427c-9eec-d4899f32e5df/2e88de11-ab79-4a30-87d7-7afdaf82a99d/ad35be32-3dc3-4bc6-b9a1-7b57527a40e4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:13.459920 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-6fadde6f-90ee-439f-8f14-cbf405aa313b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc HTTP/1.1" status: 200 len: 217 time: 0.0482581 Dec 21 03:53:13.529050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-bfad371e-55a6-47b5-a099-55cf9c4a3d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.530779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-bfad371e-55a6-47b5-a099-55cf9c4a3d19 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=394148b6-6bdf-4aaa-94d7-be0fbbf6634e HTTP/1.1" status: 200 len: 845 time: 0.0473588 Dec 21 03:53:13.603725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-50626e7d-abc3-413c-9484-df29b5df3e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.605802 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-50626e7d-abc3-413c-9484-df29b5df3e45 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=02e2ef7c-d00c-4471-ae34-58e2e22c435a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0626171 Dec 21 03:53:13.606316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.621506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ced6ab-cff9-4710-97c9-d90b2c0f27ae req-f6dde7af-5d5e-443e-9613-09223bc70b7e tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.624158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07ced6ab-cff9-4710-97c9-d90b2c0f27ae req-f6dde7af-5d5e-443e-9613-09223bc70b7e tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.0623567 Dec 21 03:53:13.670330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.708616 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-d52621f0-728b-4bec-8156-a923501b19cb service neutron] 10.222.0.54 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938909 Dec 21 03:53:13.710995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Network 890e150b-25f5-427c-9eec-d4899f32e5df is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:13.711578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07ced6ab-cff9-4710-97c9-d90b2c0f27ae req-5ba108fc-2e40-4039-a033-967bff735abf tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811741 Dec 21 03:53:13.715570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:13.719085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:13.741479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Pushing event updated for resources: {'Port': ['ID=ad35be32-3dc3-4bc6-b9a1-7b57527a40e4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:13.766039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede872fc-bb33-4a72-8a26-e25a04995de7 req-3be06ace-ca2b-4c2b-9994-a14d32af95ec tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:13.773574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ede872fc-bb33-4a72-8a26-e25a04995de7 req-3be06ace-ca2b-4c2b-9994-a14d32af95ec tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 943 time: 0.1352162 Dec 21 03:53:13.797720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Attempting to bind port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:13.798345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Attempting to bind port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ab81919f-875d-4bb0-9c3f-33f39497bc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:13.798896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Attempting to bind port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 on network 890e150b-25f5-427c-9eec-d4899f32e5df {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:13.806725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 52, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:13.808307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Checking segment: {'id': 'ab81919f-875d-4bb0-9c3f-33f39497bc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:13.808866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.809909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Bound using segment: {'id': 'ab81919f-875d-4bb0-9c3f-33f39497bc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:13.810538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Bound port: ad35be32-3dc3-4bc6-b9a1-7b57527a40e4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ab81919f-875d-4bb0-9c3f-33f39497bc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '890e150b-25f5-427c-9eec-d4899f32e5df'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:13.811573 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:13.834596 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-87bb78e7-61fd-47c5-872a-8ac03fdf834e req-64c3c8d5-c157-4fa8-991b-7424021c24d4 service neutron] 10.222.0.54 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1114044 Dec 21 03:53:13.870736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ede872fc-bb33-4a72-8a26-e25a04995de7 req-722c745f-fe8f-4b40-92f2-530d7ec3fe7a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0957689 Dec 21 03:53:13.884484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] For port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:13.887730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] For port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ad35be32-3dc3-4bc6-b9a1-7b57527a40e4,segment=NetworkSegment(ab81919f-875d-4bb0-9c3f-33f39497bc4c),segment_id=ab81919f-875d-4bb0-9c3f-33f39497bc4c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:13.973232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.041948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8762542841402', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-529846482'] for subnet, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.048195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10878a0-9a74-4152-bdb0-58ca6b844b18 None None] Pushing event updated for resources: {'Port': ['ID=ad35be32-3dc3-4bc6-b9a1-7b57527a40e4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:14.103615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:14.104375 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.108657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55856) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:14.108812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "PUT /v2.0/subnets/2e88de11-ab79-4a30-87d7-7afdaf82a99d HTTP/1.1" status: 200 len: 900 time: 0.8718765 Dec 21 03:53:14.122163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573bde90-7708-4f38-8af9-41ef6b1b8eff req-180b2017-5fc9-441e-aba2-c70a52059d6d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:14.130613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-573bde90-7708-4f38-8af9-41ef6b1b8eff req-180b2017-5fc9-441e-aba2-c70a52059d6d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 943 time: 0.1164560 Dec 21 03:53:14.132358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55858) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:14.148069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba999f2-ec86-4abb-b749-d8c2fff31e04 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event updated for resources: {'Subnet': ['ID=2e88de11-ab79-4a30-87d7-7afdaf82a99d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:14.311134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.339689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-573bde90-7708-4f38-8af9-41ef6b1b8eff req-5c560d9a-07b3-46cf-b367-0b1f0e9e3e5f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2079046 Dec 21 03:53:14.414300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:14.414693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.517444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0c5b3c7d-3a97-48ca-b6c5-74849173c787 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:14.535137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ad35be32-3dc3-4bc6-b9a1-7b57527a40e4,segment=NetworkSegment(ab81919f-875d-4bb0-9c3f-33f39497bc4c),segment_id=ab81919f-875d-4bb0-9c3f-33f39497bc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:14.535613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.549226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:14.552235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 0c5b3c7d-3a97-48ca-b6c5-74849173c787 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:14.552598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0c5b3c7d-3a97-48ca-b6c5-74849173c787 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:14.696687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'tag': 'ee7741b1-3849-4963-be69-7a915a5e81b3'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:14.698973 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d33c934-acb7-4ca5-832e-405a8d252610" -d '{"events": [{"name": "network-changed", "server_uuid": "ec20d307-be77-42e5-928c-8ccd35032b95", "tag": "ee7741b1-3849-4963-be69-7a915a5e81b3"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:14.734012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.747204 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70d258b1-acb0-4c2d-965d-5c655a2bc0b7 x-openstack-request-id: req-70d258b1-acb0-4c2d-965d-5c655a2bc0b7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:14.747204 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ec20d307-be77-42e5-928c-8ccd35032b95", "tag": "ee7741b1-3849-4963-be69-7a915a5e81b3", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:14.747204 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-70d258b1-acb0-4c2d-965d-5c655a2bc0b7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:14.747204 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'tag': 'ee7741b1-3849-4963-be69-7a915a5e81b3', 'status': 'completed', 'code': 200} Dec 21 03:53:14.767392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:14.819705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=ad35be32-3dc3-4bc6-b9a1-7b57527a40e4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:14.893016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819d28bc-c5a6-4add-8229-36bf921a3b5e req-2f7a1aa6-f8c3-485d-bb1d-5e32e46b9b09 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:14.894643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-819d28bc-c5a6-4add-8229-36bf921a3b5e req-2f7a1aa6-f8c3-485d-bb1d-5e32e46b9b09 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.1120112 Dec 21 03:53:14.951783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:15.015683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-4b735f9c-ed22-43f7-b15e-2c635b1b33f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:15.017211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-4b735f9c-ed22-43f7-b15e-2c635b1b33f0 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 1095 time: 0.2096810 Dec 21 03:53:15.041172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.124097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-819d28bc-c5a6-4add-8229-36bf921a3b5e req-73672223-eee9-4103-94ff-53ba467ce9ba tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1985912 Dec 21 03:53:15.176224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a553420d-7933-4567-b38e-3acc0b0d2e99 req-5c820b06-8bd7-476f-815c-dc35aa48b3e1 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:15.184140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a553420d-7933-4567-b38e-3acc0b0d2e99 req-5c820b06-8bd7-476f-815c-dc35aa48b3e1 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 943 time: 0.1440527 Dec 21 03:53:15.191285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-05ceab54-4dbb-4f39-9edf-be652a6dd23e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:15.192851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-05ceab54-4dbb-4f39-9edf-be652a6dd23e service neutron] 10.222.0.54 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.1672130 Dec 21 03:53:15.252132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.255367 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-2fb6d0ee-3e6a-4beb-910c-50c54e5aa2b9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ee7741b1-3849-4963-be69-7a915a5e81b3 HTTP/1.1" status: 200 len: 217 time: 0.0547471 Dec 21 03:53:15.297693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a553420d-7933-4567-b38e-3acc0b0d2e99 req-aacf857c-d52d-4780-bb98-287935e54a75 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1123545 Dec 21 03:53:15.309410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=2e88de11-ab79-4a30-87d7-7afdaf82a99d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:15.422892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-d0573032-c370-48c9-9dec-80c300156009 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:15.424438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-d0573032-c370-48c9-9dec-80c300156009 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.1357687 Dec 21 03:53:15.431255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.456026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Deleting port 24bea13f-7eed-47c1-8222-2eb2fea02484 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:15.456700 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.493380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-c8dfd799-cda7-488c-8ba8-7d35b29d84e9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0586882 Dec 21 03:53:15.497325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['890e150b-25f5-427c-9eec-d4899f32e5df']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:15.531126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a776dcc-350f-4c3e-8861-fa5be67a96e3 None None] Network 890e150b-25f5-427c-9eec-d4899f32e5df requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:15.553071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ab81919f-875d-4bb0-9c3f-33f39497bc4c') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:15.553335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ab81919f-875d-4bb0-9c3f-33f39497bc4c') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:15.566530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e6271438-108c-4224-bebd-147f14796cc8 None None] Could not find standard attr ID for object ad35be32-3dc3-4bc6-b9a1-7b57527a40e4. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:53:15.596738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff9bdae-7a74-478a-bcf4-234c74d1322b req-2bed69cb-7fa5-46c4-abb3-b92e82155408 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:15.610234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eff9bdae-7a74-478a-bcf4-234c74d1322b req-2bed69cb-7fa5-46c4-abb3-b92e82155408 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 943 time: 0.1241388 Dec 21 03:53:15.619323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.623179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] For port 24bea13f-7eed-47c1-8222-2eb2fea02484, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24bea13f-7eed-47c1-8222-2eb2fea02484,segment=NetworkSegment(2a112885-d444-478f-82ef-20aafe136b97),segment_id=2a112885-d444-478f-82ef-20aafe136b97)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:15.623548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.648948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Calling delete_port for 24bea13f-7eed-47c1-8222-2eb2fea02484 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:15.669024 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.721309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eff9bdae-7a74-478a-bcf4-234c74d1322b req-5cb422c9-1525-4a2b-b040-9a7652a8373d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1111748 Dec 21 03:53:15.723292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:15.723785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:15.727358 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:15.737524 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:15.737524 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:15.737524 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:15.737524 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:15.737524 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:15.737524 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:15.762209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73c07992-9204-44ec-a932-ae9d94b477e8 None None] DHCP port deletion for 890e150b-25f5-427c-9eec-d4899f32e5df request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:15.786920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbc2dd9f-5a22-49a7-bfc5-0125069ba77c None None] Network 890e150b-25f5-427c-9eec-d4899f32e5df requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:15.862783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-094e2367-f2b6-4c26-bb4f-e2cfd5662e54 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:15.864740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-094e2367-f2b6-4c26-bb4f-e2cfd5662e54 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.2636495 Dec 21 03:53:15.867047 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-c8322c30-e50f-46b6-9a36-e9cc734772a0 service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3377569 Dec 21 03:53:15.920171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.926945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:15.929168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/890e150b-25f5-427c-9eec-d4899f32e5df HTTP/1.1" status: 204 len: 168 time: 1.8195083 Dec 21 03:53:15.937892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55878) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:15.970453 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-1880da8d-4c64-43e6-80f3-96f5b00ef622 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:15.971047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1880da8d-4c64-43e6-80f3-96f5b00ef622 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:15.976475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1880da8d-4c64-43e6-80f3-96f5b00ef622 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/2e88de11-ab79-4a30-87d7-7afdaf82a99d HTTP/1.1" status: 404 len: 337 time: 0.0352056 Dec 21 03:53:15.977132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55882) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:15.995553 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-edab79f4-b8d4-4f75-b2cc-c05f410a203c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:15.996093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-edab79f4-b8d4-4f75-b2cc-c05f410a203c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:16.001788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-edab79f4-b8d4-4f75-b2cc-c05f410a203c tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/890e150b-25f5-427c-9eec-d4899f32e5df HTTP/1.1" status: 404 len: 339 time: 0.0217993 Dec 21 03:53:16.002100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55884) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:16.018985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d045eb-568e-46bc-802b-b2502562fb8a tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=890e150b-25f5-427c-9eec-d4899f32e5df,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:16.084230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.084492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d33c934-acb7-4ca5-832e-405a8d252610 req-7518ba3b-56e7-4e63-a49d-90ebdd24625f service neutron] 10.222.0.54 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1955380 Dec 21 03:53:16.103020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Deleting port 131c672e-d86b-490a-b8c0-d22ce7f197d4 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:16.103358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.137720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Pushing event deleted for resources: {'Port': ['ID=24bea13f-7eed-47c1-8222-2eb2fea02484,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:16.148214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf623c0c-e2cf-4b7c-891b-d41ad58e3257 None None] DHCP port deletion for e94928bb-be91-4772-b576-ae2f90f005ad request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:16.172823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.225356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] For port 131c672e-d86b-490a-b8c0-d22ce7f197d4, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=131c672e-d86b-490a-b8c0-d22ce7f197d4,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:16.225710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.240369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Calling delete_port for 131c672e-d86b-490a-b8c0-d22ce7f197d4 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:16.481094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.493718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76228eea-c001-4ebc-a9f4-4450baa0fcf7 req-5a33f550-8c7d-4d53-85d5-939f820f0d69 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:16.495315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76228eea-c001-4ebc-a9f4-4450baa0fcf7 req-5a33f550-8c7d-4d53-85d5-939f820f0d69 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 947 time: 0.2797043 Dec 21 03:53:16.503124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.513781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Pushing event deleted for resources: {'Port': ['ID=131c672e-d86b-490a-b8c0-d22ce7f197d4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:16.520380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ee7741b1-3849-4963-be69-7a915a5e81b3 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:53:16.554522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f66e0efd-af8f-45a5-83a3-bc1a0db88d6e']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:16.558991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.577809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7d38cce9-7ab8-4634-8ce2-e07fecdca0bd') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:16.578123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7d38cce9-7ab8-4634-8ce2-e07fecdca0bd') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:16.599362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] No DVR routers for this DVR port 131c672e-d86b-490a-b8c0-d22ce7f197d4 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:16.603222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.605891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-81e1918d-89dc-495f-9562-3c6b6bbc48c0 req-dfe0a2e8-c1d3-4ba2-aaef-5d1d54cff819 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "DELETE /v2.0/ports/131c672e-d86b-490a-b8c0-d22ce7f197d4 HTTP/1.1" status: 204 len: 173 time: 0.7337699 Dec 21 03:53:16.609761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cef1816-b589-4acf-9ec3-f3b9772a1d44 req-b617565a-77be-4681-87bb-4da084c5d383 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:16.611350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2cef1816-b589-4acf-9ec3-f3b9772a1d44 req-b617565a-77be-4681-87bb-4da084c5d383 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 943 time: 0.1993647 Dec 21 03:53:16.621870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.695250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ee7741b1-3849-4963-be69-7a915a5e81b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ee7741b1-3849-4963-be69-7a915a5e81b3,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:16.709872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.717871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'ee7741b1-3849-4963-be69-7a915a5e81b3', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': 'ee7741b1-3849-4963-be69-7a915a5e81b3', 'mac_address': 'fa:16:3e:cb:3b:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:53:16.732749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76228eea-c001-4ebc-a9f4-4450baa0fcf7 req-5ed103e1-e1e6-4234-9e26-bd05abc29da4 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2140176 Dec 21 03:53:16.743656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:16.744077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.744350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-deleted', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:16.746630 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65bfc6fd-ed62-4ccd-9efc-830f18e96c23" -d '{"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-deleted", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.747635 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:16.749887 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:16.772203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.790919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ee7741b1-3849-4963-be69-7a915a5e81b3 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:16.811681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ee7741b1-3849-4963-be69-7a915a5e81b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ee7741b1-3849-4963-be69-7a915a5e81b3,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:16.863475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:16.864406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d2acf96a-cb48-4985-bab5-901e7db33ffc details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:53:16.973281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ee7741b1-3849-4963-be69-7a915a5e81b3,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:17.022918 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d36ccd1-c7dd-4bdb-980a-286f6c2b08db x-openstack-request-id: req-2d36ccd1-c7dd-4bdb-980a-286f6c2b08db {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:17.023439 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9695894c-25e8-4ea4-af8a-0323435c5faa", "name": "network-vif-deleted", "tag": "131c672e-d86b-490a-b8c0-d22ce7f197d4", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:17.023870 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2d36ccd1-c7dd-4bdb-980a-286f6c2b08db {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:17.024418 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9695894c-25e8-4ea4-af8a-0323435c5faa', 'name': 'network-vif-deleted', 'tag': '131c672e-d86b-490a-b8c0-d22ce7f197d4', 'status': 'completed', 'code': 200} Dec 21 03:53:17.117417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d2acf96a-cb48-4985-bab5-901e7db33ffc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:17.135100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'port_id': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'mac_address': 'fa:16:3e:4f:28:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:53:17.187414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.208919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d2acf96a-cb48-4985-bab5-901e7db33ffc {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:17.236917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d2acf96a-cb48-4985-bab5-901e7db33ffc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:17.291808 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.331892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2cef1816-b589-4acf-9ec3-f3b9772a1d44 req-e319c961-89aa-44c3-af28-009e2a7e8be0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7042434 Dec 21 03:53:17.471651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d2acf96a-cb48-4985-bab5-901e7db33ffc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:17.494569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:17.540743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:17.542286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ad35be32-3dc3-4bc6-b9a1-7b57527a40e4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:17.553288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3b5ed4-8f43-4a25-941f-c8e195c5dad0 req-533e4586-79bb-4959-951a-e458bf60bc0d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:17.562183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c3b5ed4-8f43-4a25-941f-c8e195c5dad0 req-533e4586-79bb-4959-951a-e458bf60bc0d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 944 time: 0.3059702 Dec 21 03:53:17.564111 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.570618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.574720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/f66e0efd-af8f-45a5-83a3-bc1a0db88d6e HTTP/1.1" status: 204 len: 168 time: 1.5716751 Dec 21 03:53:17.577751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:17.579610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Router cbef927a-234e-4845-b539-e85731a2c3f3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:17.614077 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-52d009af-a212-43f9-a505-5da31fb132ae tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:17.614391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c69c63ee-e8dd-4747-aa2f-d921a32a15dc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=f66e0efd-af8f-45a5-83a3-bc1a0db88d6e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:17.614875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-52d009af-a212-43f9-a505-5da31fb132ae tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:17.623347 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-52d009af-a212-43f9-a505-5da31fb132ae tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/9b3e6573-2a8e-4432-bfb4-641a896ed1da HTTP/1.1" status: 404 len: 337 time: 0.0443716 Dec 21 03:53:17.624040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55902) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:17.645112 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9959d3af-e0d7-477c-a9fe-77384e37ebdc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:17.645822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9959d3af-e0d7-477c-a9fe-77384e37ebdc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:17.651422 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9959d3af-e0d7-477c-a9fe-77384e37ebdc tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/9d104924-c03e-45e5-91f9-964b183b5c3a HTTP/1.1" status: 404 len: 339 time: 0.0261583 Dec 21 03:53:17.652204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:17.702279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c3b5ed4-8f43-4a25-941f-c8e195c5dad0 req-1c0219d2-f45e-47e4-871f-9de2a6e7d4a8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1390533 Dec 21 03:53:17.710407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting subnet 8c6520ca-2298-4357-8601-ab5511bcda05 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:17.714985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.766070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.768365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ee7741b1-3849-4963-be69-7a915a5e81b3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:17.815827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d2acf96a-cb48-4985-bab5-901e7db33ffc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:17.859846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:17.888490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:17.902905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-528e5d2c-b72a-4269-a6df-7a236e8114ee admin admin] 10.222.0.18 "PUT /v2.0/routers/cbef927a-234e-4845-b539-e85731a2c3f3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7655578 Dec 21 03:53:17.905490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55910) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:17.909777 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] Sync routers for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:17.933330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:17.934521 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:17.984572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.038250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8c8916a-87fa-4487-87bd-ed4009b4a0f5 req-309820b5-43b7-467a-8491-2b4aa9aed797 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=9695894c-25e8-4ea4-af8a-0323435c5faa HTTP/1.1" status: 200 len: 210 time: 0.0453987 Dec 21 03:53:18.054176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=8c6520ca-2298-4357-8601-ab5511bcda05,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:18.064763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.067797 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:18.070299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84970776-1058-400c-bbc7-8d415a379646 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/8c6520ca-2298-4357-8601-ab5511bcda05 HTTP/1.1" status: 204 len: 168 time: 0.4167099 Dec 21 03:53:18.072364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55914) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:18.078985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a341403d-6956-49be-a5e5-595d03e17d26 None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:18.160177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.160711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting subnet e834a669-61ec-414d-88ab-c8641289f01d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:18.165444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.235279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.276624 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:53:15Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:18.309461 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] Checking router: cbef927a-234e-4845-b539-e85731a2c3f3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:18.318851 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] Routers {'cbef927a-234e-4845-b539-e85731a2c3f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:18.319729 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:52:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cbef927a-234e-4845-b539-e85731a2c3f3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:18.328811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.398415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.459726 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] Set router cbef927a-234e-4845-b539-e85731a2c3f3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:18.527956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d499da-e670-4399-8a52-3713e4fecbbc req-a127e020-04f1-4bbc-9eb2-9b81ca225595 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:18.529756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37d499da-e670-4399-8a52-3713e4fecbbc req-a127e020-04f1-4bbc-9eb2-9b81ca225595 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 944 time: 0.0931983 Dec 21 03:53:18.603135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Deleting port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:18.603135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.607460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.652490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=e834a669-61ec-414d-88ab-c8641289f01d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:18.662196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37d499da-e670-4399-8a52-3713e4fecbbc req-2d0538f2-18d3-4f11-b771-2a6b28442cd4 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1220455 Dec 21 03:53:18.669246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.673458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80bc503c-ad92-4f1e-9a53-4fb92695a553 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/e834a669-61ec-414d-88ab-c8641289f01d HTTP/1.1" status: 204 len: 168 time: 0.5999258 Dec 21 03:53:18.683348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:18.752088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:53:15Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:18.799675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2aa14ae-308b-4ae0-8909-86509a988b94 None None] The sync data for ids ['cbef927a-234e-4845-b539-e85731a2c3f3'] in n-d-822053-11 is: [{'id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'name': 'tempest-ServerRescueTestJSONUnderV235-1843587225-router', 'tenant_id': '920e98327f8340b0966241ad0871434f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21'}], 'enable_snat': True}, 'gw_port_id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:51:30Z', 'updated_at': '2021-12-21T03:53:15Z', 'revision_number': 5, 'project_id': '920e98327f8340b0966241ad0871434f', 'gw_port': {'id': '284d1f4a-5df5-4efe-84d7-9ca11e55d8ca', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:25:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cbef927a-234e-4845-b539-e85731a2c3f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 984, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:51:31Z', 'updated_at': '2021-12-21T03:51:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:18.857699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.873047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] For port 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:18.873425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:18.894540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Calling delete_port for 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:18.912884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c1536e-a50a-4fd8-a08e-882351ed0188 req-295cac10-b975-4411-835e-a6f67fe4e06b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:18.914503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3c1536e-a50a-4fd8-a08e-882351ed0188 req-295cac10-b975-4411-835e-a6f67fe4e06b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 944 time: 0.1172988 Dec 21 03:53:19.098695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cef987c-2aff-417f-8f52-474a24e0a26e None None] Network 284b3ea9-47ad-462a-a649-dd4b568f5b2f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:19.130660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3c1536e-a50a-4fd8-a08e-882351ed0188 req-950f98ea-b754-4043-ae7d-b608d5f359b1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1951306 Dec 21 03:53:19.151272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port dfcc139e-6410-418e-af13-8ee2bdbe361d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:19.151272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.260949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6cd2d5ec-4886-4631-8dac-3f77f7ae99ae None None] Provisioning complete for port dfcc139e-6410-418e-af13-8ee2bdbe361d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:19.260949 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6cd2d5ec-4886-4631-8dac-3f77f7ae99ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.309013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port dfcc139e-6410-418e-af13-8ee2bdbe361d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dfcc139e-6410-418e-af13-8ee2bdbe361d,segment=NetworkSegment(5c29c207-8f56-40b7-9063-86bef2d84c91),segment_id=5c29c207-8f56-40b7-9063-86bef2d84c91)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:19.309493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.335585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for dfcc139e-6410-418e-af13-8ee2bdbe361d owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:19.344936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bea13f-7eed-47c1-8222-2eb2fea02484 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:19.369337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 24bea13f-7eed-47c1-8222-2eb2fea02484 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:19.369533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bea13f-7eed-47c1-8222-2eb2fea02484 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:19.430156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] DHCP port deletion for 284b3ea9-47ad-462a-a649-dd4b568f5b2f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:19.435833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.475452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Pushing event deleted for resources: {'Port': ['ID=284d1f4a-5df5-4efe-84d7-9ca11e55d8ca,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:19.492440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-890083ce-a684-4a18-9e01-d9042f040c80 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:19.518064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] Deleting port dfcc139e-6410-418e-af13-8ee2bdbe361d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:19.518455 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.572944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.602752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] For port dfcc139e-6410-418e-af13-8ee2bdbe361d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dfcc139e-6410-418e-af13-8ee2bdbe361d,segment=NetworkSegment(5c29c207-8f56-40b7-9063-86bef2d84c91),segment_id=5c29c207-8f56-40b7-9063-86bef2d84c91)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:19.603175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.619028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] Calling delete_port for dfcc139e-6410-418e-af13-8ee2bdbe361d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:19.687515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.747380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.770028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.776858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] Pushing event deleted for resources: {'Port': ['ID=dfcc139e-6410-418e-af13-8ee2bdbe361d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:19.780077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.784386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=dfcc139e-6410-418e-af13-8ee2bdbe361d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:19.785320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dac0769-f25d-40d6-888b-69c16365c674 None None] No DVR routers for this DVR port dfcc139e-6410-418e-af13-8ee2bdbe361d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:19.803846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e5f76e86-37d1-4a1d-8528-6f6c5054a70f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:19.838999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port dfcc139e-6410-418e-af13-8ee2bdbe361d on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:19.954136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-946f987f-5075-4d2f-9c48-0915731b742f req-af4f3f7a-3c5d-4c13-a4d4-cfc9b4c16dc3 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:19.955674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-946f987f-5075-4d2f-9c48-0915731b742f req-af4f3f7a-3c5d-4c13-a4d4-cfc9b4c16dc3 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 949 time: 0.2289257 Dec 21 03:53:20.000042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.009408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49a0a8a-d981-4908-b0d8-c029473a2508 req-16dd19d0-d45d-4b2d-ab4a-dd37014cbd52 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:20.011421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49a0a8a-d981-4908-b0d8-c029473a2508 req-16dd19d0-d45d-4b2d-ab4a-dd37014cbd52 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 944 time: 0.2246430 Dec 21 03:53:20.042289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.042822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Fanout notify agent at l3_agent the message router_deleted on router cbef927a-234e-4845-b539-e85731a2c3f3 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:53:20.051619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['284b3ea9-47ad-462a-a649-dd4b568f5b2f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:20.065251 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.069063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55938) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.069601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ec7e83d-533e-4f0f-ab7f-bfd7f953aeea admin admin] 10.222.0.18 "DELETE /v2.0/routers/cbef927a-234e-4845-b539-e85731a2c3f3 HTTP/1.1" status: 204 len: 168 time: 2.1625984 Dec 21 03:53:20.085350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c29c207-8f56-40b7-9063-86bef2d84c91') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:20.087289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c29c207-8f56-40b7-9063-86bef2d84c91') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:20.113921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.120720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Deleting subnet f8a63e48-36eb-4a7d-be87-03acc85470f7 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:20.124937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.127857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-946f987f-5075-4d2f-9c48-0915731b742f req-bd9a1170-fa25-44c5-a070-19d7c1182f3d tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1375864 Dec 21 03:53:20.140939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49a0a8a-d981-4908-b0d8-c029473a2508 req-3e429538-c039-411c-818b-1207e4775a34 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1172936 Dec 21 03:53:20.156133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.168858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:20.170437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:20.180660 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:20.200938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.257944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.309839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad7a88f-ca91-4948-a355-3784428e5479 req-2e00b7ec-f3ac-44a1-96ef-29e473171845 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:20.315102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:20.318278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dad7a88f-ca91-4948-a355-3784428e5479 req-2e00b7ec-f3ac-44a1-96ef-29e473171845 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 944 time: 0.0660503 Dec 21 03:53:20.344086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 131c672e-d86b-490a-b8c0-d22ce7f197d4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:20.344694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 131c672e-d86b-490a-b8c0-d22ce7f197d4 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:20.361693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.371377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.372336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/284b3ea9-47ad-462a-a649-dd4b568f5b2f HTTP/1.1" status: 204 len: 168 time: 1.6921084 Dec 21 03:53:20.374887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55948) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.381124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dad7a88f-ca91-4948-a355-3784428e5479 req-bd459144-d0b8-4f3e-90d3-d689165dfaa8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618229 Dec 21 03:53:20.390921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f9ab26-51a6-40c3-9fab-c25aca1900d9 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=284b3ea9-47ad-462a-a649-dd4b568f5b2f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:20.406084 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.408651 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b9d541fc-cdff-4668-92a1-cb588e6b8ed3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:20.409253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b9d541fc-cdff-4668-92a1-cb588e6b8ed3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:20.412581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b9d541fc-cdff-4668-92a1-cb588e6b8ed3 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/c934a684-0110-4fb1-a2d1-3fce2ea037ea HTTP/1.1" status: 404 len: 337 time: 0.0359583 Dec 21 03:53:20.416072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55952) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.437502 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-f0b315c9-7f50-4324-99ab-d8a9fa1081c0 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:20.438017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f0b315c9-7f50-4324-99ab-d8a9fa1081c0 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:20.439577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f8a63e48-36eb-4a7d-be87-03acc85470f7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:20.441534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.444724 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1a977964-8b3d-48dc-a251-84d5a306e7f5 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/f8a63e48-36eb-4a7d-be87-03acc85470f7 HTTP/1.1" status: 204 len: 168 time: 0.3737106 Dec 21 03:53:20.445087 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f0b315c9-7f50-4324-99ab-d8a9fa1081c0 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/336347cf-4bc6-4502-9dee-629993d9a1f0 HTTP/1.1" status: 404 len: 339 time: 0.0277250 Dec 21 03:53:20.445592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55954) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.447239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55956) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.455348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88b09082-b97d-4472-8602-c8e38fc42b98 None None] Network e94928bb-be91-4772-b576-ae2f90f005ad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:20.480741 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-cbc65260-9901-4ac5-93b3-fbdcc98e5e1b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:20.481338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cbc65260-9901-4ac5-93b3-fbdcc98e5e1b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:20.489381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cbc65260-9901-4ac5-93b3-fbdcc98e5e1b tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/2a50db66-a41e-4c32-8907-915c9e04530b HTTP/1.1" status: 404 len: 337 time: 0.0426278 Dec 21 03:53:20.490062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.509608 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a296733-024e-42da-a2b5-297b96e2895d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:20.510258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0a296733-024e-42da-a2b5-297b96e2895d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:20.514067 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a296733-024e-42da-a2b5-297b96e2895d tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/d693b3ee-2988-4a89-878d-e71d9dd5fe79 HTTP/1.1" status: 404 len: 339 time: 0.0230136 Dec 21 03:53:20.519265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55960) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.559293 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-7700bf36-cf61-4db8-9673-73295aac4102 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:20.559883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7700bf36-cf61-4db8-9673-73295aac4102 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:20.560222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ee7741b1-3849-4963-be69-7a915a5e81b3 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:20.563195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7700bf36-cf61-4db8-9673-73295aac4102 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/49d8407f-26fa-4bd8-9634-0671eb20727f HTTP/1.1" status: 404 len: 337 time: 0.0429409 Dec 21 03:53:20.565957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55968) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.569371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.588245 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-210ee032-39a0-46f0-96d9-b640665926d5 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:20.592755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-210ee032-39a0-46f0-96d9-b640665926d5 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:20.598353 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-210ee032-39a0-46f0-96d9-b640665926d5 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/783bd7a9-29da-465c-9005-f07c759c5225 HTTP/1.1" status: 404 len: 339 time: 0.0288184 Dec 21 03:53:20.611997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55974) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:20.620897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6ad57bf-d954-4da3-b05c-d0038534393b None None] DHCP port deletion for e94928bb-be91-4772-b576-ae2f90f005ad request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:20.692829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port ee7741b1-3849-4963-be69-7a915a5e81b3 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:53:20.697157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port ee7741b1-3849-4963-be69-7a915a5e81b3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:20.697607 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.730105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.744167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting subnet 46d51fa5-33d1-466e-acf1-184b1bd7b5ff {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:20.754435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.786677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e94928bb-be91-4772-b576-ae2f90f005ad']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:20.813134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2a112885-d444-478f-82ef-20aafe136b97') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:20.813464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2a112885-d444-478f-82ef-20aafe136b97') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:20.822607 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.833588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.836795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.855014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ee7741b1-3849-4963-be69-7a915a5e81b3'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:20.857215 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6076f59-fd6c-4ed5-a870-46bc92a4e00a" -d '{"events": [{"server_uuid": "ec20d307-be77-42e5-928c-8ccd35032b95", "name": "network-vif-plugged", "status": "completed", "tag": "ee7741b1-3849-4963-be69-7a915a5e81b3"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:20.876426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.879231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ee7741b1-3849-4963-be69-7a915a5e81b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ee7741b1-3849-4963-be69-7a915a5e81b3,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:20.887749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Releasing vlan 114 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:20.888141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:20.889803 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:20.959979 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3083336-5dce-4ac6-94e7-1d31fdbc9c72 x-openstack-request-id: req-d3083336-5dce-4ac6-94e7-1d31fdbc9c72 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:20.960457 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec20d307-be77-42e5-928c-8ccd35032b95", "name": "network-vif-plugged", "status": "completed", "tag": "ee7741b1-3849-4963-be69-7a915a5e81b3", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:20.960571 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d3083336-5dce-4ac6-94e7-1d31fdbc9c72 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:20.960958 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ee7741b1-3849-4963-be69-7a915a5e81b3', 'code': 200} Dec 21 03:53:20.962209 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:20.963115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d2acf96a-cb48-4985-bab5-901e7db33ffc up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:21.061366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ee7741b1-3849-4963-be69-7a915a5e81b3,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:21.121104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a305ad7e-b6c7-4216-a9e6-3124412e28be req-8924a900-434f-40af-a919-40dd14b9e4ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:21.123286 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a305ad7e-b6c7-4216-a9e6-3124412e28be req-8924a900-434f-40af-a919-40dd14b9e4ee service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 1097 time: 0.0480382 Dec 21 03:53:21.144214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port d2acf96a-cb48-4985-bab5-901e7db33ffc completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:53:21.148914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port d2acf96a-cb48-4985-bab5-901e7db33ffc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:21.149573 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.259556 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.318217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d2acf96a-cb48-4985-bab5-901e7db33ffc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:21.401550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dfcc139e-6410-418e-af13-8ee2bdbe361d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:21.419695 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.423146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: dfcc139e-6410-418e-af13-8ee2bdbe361d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:21.423513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dfcc139e-6410-418e-af13-8ee2bdbe361d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:21.423922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:21.445245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.472374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:21.472973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 284d1f4a-5df5-4efe-84d7-9ca11e55d8ca not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:21.502375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d2acf96a-cb48-4985-bab5-901e7db33ffc,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:21.509946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3188057-924f-4f11-9142-916f1268d7b1 req-814b20b5-8018-4fec-892a-9ee25380b082 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:21.513629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3188057-924f-4f11-9142-916f1268d7b1 req-814b20b5-8018-4fec-892a-9ee25380b082 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 949 time: 0.2075689 Dec 21 03:53:21.522969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e52bec-1aa4-4500-bd16-ef756873dfd2 req-cb153b51-17cc-42f9-93de-1b11c0f6adb6 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:21.527861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17e52bec-1aa4-4500-bd16-ef756873dfd2 req-cb153b51-17cc-42f9-93de-1b11c0f6adb6 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 944 time: 0.2225480 Dec 21 03:53:21.563768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.569386 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a305ad7e-b6c7-4216-a9e6-3124412e28be req-7b348e8c-1493-4086-9ad9-56e85ceee50a service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4375198 Dec 21 03:53:21.574285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.577500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] 10.222.0.18 "DELETE /v2.0/networks/e94928bb-be91-4772-b576-ae2f90f005ad HTTP/1.1" status: 204 len: 168 time: 1.1285453 Dec 21 03:53:21.626397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed338bc-042c-4104-8278-cd218594f85b admin admin] Pushing event deleted for resources: {'Network': ['ID=e94928bb-be91-4772-b576-ae2f90f005ad,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:21.657971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3188057-924f-4f11-9142-916f1268d7b1 req-709b0ae1-bc22-4425-8da3-76ffb6a4453b tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433389 Dec 21 03:53:21.667598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17e52bec-1aa4-4500-bd16-ef756873dfd2 req-6e1fb77e-d8f5-4a31-94c3-de4de48f36b6 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1281385 Dec 21 03:53:21.669066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.685339 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.692163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91c3ca7c-0ac6-408c-b59f-d00252324bac None None] Network 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:21.692394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56030) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:21.701889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/46d51fa5-33d1-466e-acf1-184b1bd7b5ff HTTP/1.1" status: 204 len: 168 time: 1.0866563 Dec 21 03:53:21.758508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a95d2719-ebcb-4745-b577-cf08a590c385 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=46d51fa5-33d1-466e-acf1-184b1bd7b5ff,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:21.832001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:21.839024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b4468b-9bb0-449d-a36e-6d7fc0ff0e41 req-bd071ca1-9f18-4f37-b4a6-7340705c1807 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:21.841282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6b4468b-9bb0-449d-a36e-6d7fc0ff0e41 req-bd071ca1-9f18-4f37-b4a6-7340705c1807 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.0664191 Dec 21 03:53:21.929063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] DHCP port deletion for 0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:21.939143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6b4468b-9bb0-449d-a36e-6d7fc0ff0e41 req-40497e1b-9aca-4875-8346-9a6a12d5028f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768907 Dec 21 03:53:21.940604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port a0a3c33b-3d23-41ba-b5dc-486328e004ae {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:21.940950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.003871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] Deleting port a0a3c33b-3d23-41ba-b5dc-486328e004ae {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:22.005050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.024110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56058) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:22.025475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port a0a3c33b-3d23-41ba-b5dc-486328e004ae, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0a3c33b-3d23-41ba-b5dc-486328e004ae,segment=NetworkSegment(0707d19e-ff9c-4cd2-8c75-f9213b4df08a),segment_id=0707d19e-ff9c-4cd2-8c75-f9213b4df08a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:22.025887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.042211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for a0a3c33b-3d23-41ba-b5dc-486328e004ae owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:22.090582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-48a6d039-02db-4ff7-b4f4-759c152a9093 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=920e98327f8340b0966241ad0871434f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0624583 Dec 21 03:53:22.090866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56060) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:22.137694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] For port a0a3c33b-3d23-41ba-b5dc-486328e004ae, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0a3c33b-3d23-41ba-b5dc-486328e004ae,segment=NetworkSegment(0707d19e-ff9c-4cd2-8c75-f9213b4df08a),segment_id=0707d19e-ff9c-4cd2-8c75-f9213b4df08a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:22.138488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.161438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5c68b45-ea17-40a4-9824-ef01645bb645 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.161655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] Calling delete_port for a0a3c33b-3d23-41ba-b5dc-486328e004ae owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:22.163734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e58ff56-c429-42c5-8949-404df6945bfb req-372d2492-5beb-4394-a29b-21fcacbdebef tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:22.165721 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8e58ff56-c429-42c5-8949-404df6945bfb req-372d2492-5beb-4394-a29b-21fcacbdebef tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 949 time: 0.1088121 Dec 21 03:53:22.186257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5c68b45-ea17-40a4-9824-ef01645bb645 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.243754 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-554b20de-b8e2-4f5d-b1f5-a3540cd1f2fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.281666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Deleting port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:22.282087 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.310732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.321924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.338960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5c68b45-ea17-40a4-9824-ef01645bb645 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.341001 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5c68b45-ea17-40a4-9824-ef01645bb645 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.345015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d5c68b45-ea17-40a4-9824-ef01645bb645 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b3a7c1b3-cd89-415c-8815-d4c442d51c8e HTTP/1.1" status: 204 len: 168 time: 0.2530229 Dec 21 03:53:22.355121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c68b45-ea17-40a4-9824-ef01645bb645 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3a7c1b3-cd89-415c-8815-d4c442d51c8e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:22.360319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] Pushing event deleted for resources: {'Port': ['ID=a0a3c33b-3d23-41ba-b5dc-486328e004ae,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:22.367213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=a0a3c33b-3d23-41ba-b5dc-486328e004ae,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:22.381730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port a0a3c33b-3d23-41ba-b5dc-486328e004ae on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:22.385401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db9de8e5-7e26-48f3-a330-c84544f1b304 None None] No DVR routers for this DVR port a0a3c33b-3d23-41ba-b5dc-486328e004ae on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:22.458868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] For port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:22.459185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.496014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.505896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Calling delete_port for b5fc9274-dcad-49e4-9ea7-4a6e85e6581e owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:22.526680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0fb8dff7-c580-4824-b6e5-49d9ea7e0f77']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:22.542785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0707d19e-ff9c-4cd2-8c75-f9213b4df08a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:22.543119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0707d19e-ff9c-4cd2-8c75-f9213b4df08a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:22.549357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.580498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.600254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.612939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:22.613351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:22.616408 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:22.789299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.797266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.800530 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/0fb8dff7-c580-4824-b6e5-49d9ea7e0f77 HTTP/1.1" status: 204 len: 168 time: 1.1071186 Dec 21 03:53:22.802883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56072) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:22.822004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5e9c66-6f51-4025-9423-24be74982028 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=0fb8dff7-c580-4824-b6e5-49d9ea7e0f77,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:22.842365 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.844649 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-dab98047-f57e-4629-82a0-9ea6d3443305 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:22.845184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dab98047-f57e-4629-82a0-9ea6d3443305 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:22.848291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dab98047-f57e-4629-82a0-9ea6d3443305 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/6176e051-86c2-47c9-a7cc-7dcc759b68c1 HTTP/1.1" status: 404 len: 337 time: 0.0443807 Dec 21 03:53:22.854172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56074) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:22.875924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0983ed-27d7-4ab2-908c-eb50e7aa0e73 req-ea346dd3-d4ec-49e3-8070-e9484fe3ebd6 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:22.877717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e0983ed-27d7-4ab2-908c-eb50e7aa0e73 req-ea346dd3-d4ec-49e3-8070-e9484fe3ebd6 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 949 time: 0.1325281 Dec 21 03:53:22.880561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Pushing event deleted for resources: {'Port': ['ID=b5fc9274-dcad-49e4-9ea7-4a6e85e6581e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:22.895361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4816698-36bc-4872-87a1-e6d588ea75b8 req-803e48ef-01d7-47e6-aad6-c3f03e7e9ecf tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:22.908809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4816698-36bc-4872-87a1-e6d588ea75b8 req-803e48ef-01d7-47e6-aad6-c3f03e7e9ecf tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.1511302 Dec 21 03:53:22.932878 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-b264de5b-699e-44b7-b44b-0e3d58f58f24 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] DELETE failed (client error): The resource could not be found. Dec 21 03:53:22.933400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b264de5b-699e-44b7-b44b-0e3d58f58f24 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:53:22.941490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b264de5b-699e-44b7-b44b-0e3d58f58f24 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/fc5163dc-6b50-45e0-bd93-7304689f326f HTTP/1.1" status: 404 len: 339 time: 0.0842214 Dec 21 03:53:22.946604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56078) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:22.962377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:22.970425 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a0099c4-9bf7-4adf-a810-11c79ddcc394" -d '{"events": [{"server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "name": "network-vif-plugged", "status": "completed", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:22.970636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] No DVR routers for this DVR port b5fc9274-dcad-49e4-9ea7-4a6e85e6581e on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:22.974327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:22.978222 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8e58ff56-c429-42c5-8949-404df6945bfb req-4b4508d4-851c-4947-b348-02b97f6138c9 tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.31 "DELETE /v2.0/ports/b5fc9274-dcad-49e4-9ea7-4a6e85e6581e HTTP/1.1" status: 204 len: 173 time: 0.7982330 Dec 21 03:53:22.978711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-deleted', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:22.981101 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6204a9f-d516-4078-b1a9-fb55695691fa" -d '{"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-deleted", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:23.070371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4816698-36bc-4872-87a1-e6d588ea75b8 req-6da6f08d-e39d-49d5-a0a5-af0a2766c87f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1577599 Dec 21 03:53:23.102532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e0983ed-27d7-4ab2-908c-eb50e7aa0e73 req-ae8eda37-eb8a-4432-9e00-6b0f0951d6da tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/security-groups?id=b0070dcb-d89e-44e0-815b-423b077edf00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1731718 Dec 21 03:53:23.108243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting subnet 11abf2fc-903a-4998-b1a7-de8e90d875ca {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:23.113614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:23.210018 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:23.217936 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:23.255540 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70862940-3a9d-428f-b079-e7e88b960d26 x-openstack-request-id: req-70862940-3a9d-428f-b079-e7e88b960d26 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:23.256166 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "name": "network-vif-plugged", "status": "completed", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:23.256525 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-70862940-3a9d-428f-b079-e7e88b960d26 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:23.257302 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'code': 200} Dec 21 03:53:23.292751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0d70cd-fbb7-4d40-b7d8-5eff2c3c21e2 req-759f254d-f0a9-42f6-9dab-e5ebcc8871ef tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:23.296517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc0d70cd-fbb7-4d40-b7d8-5eff2c3c21e2 req-759f254d-f0a9-42f6-9dab-e5ebcc8871ef tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.1242352 Dec 21 03:53:23.325848 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d1a70fd-7249-4733-866b-cdd72a38a430 x-openstack-request-id: req-9d1a70fd-7249-4733-866b-cdd72a38a430 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:23.326670 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b159aaab-0940-4762-949f-a365b005eb7d", "name": "network-vif-deleted", "tag": "b5fc9274-dcad-49e4-9ea7-4a6e85e6581e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:23.327107 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9d1a70fd-7249-4733-866b-cdd72a38a430 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:23.327680 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b159aaab-0940-4762-949f-a365b005eb7d', 'name': 'network-vif-deleted', 'tag': 'b5fc9274-dcad-49e4-9ea7-4a6e85e6581e', 'status': 'completed', 'code': 200} Dec 21 03:53:23.468108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0a3c33b-3d23-41ba-b5dc-486328e004ae no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:23.485516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51e35ec1-60c0-46b0-acda-3042ae5e4ea2 req-f48b1a46-c2bc-430c-8ff2-d9e56f5d8abc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:23.487446 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51e35ec1-60c0-46b0-acda-3042ae5e4ea2 req-f48b1a46-c2bc-430c-8ff2-d9e56f5d8abc service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 1097 time: 0.0974040 Dec 21 03:53:23.497985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:23.529221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a0a3c33b-3d23-41ba-b5dc-486328e004ae {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:23.529921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0a3c33b-3d23-41ba-b5dc-486328e004ae not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:23.552983 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51e35ec1-60c0-46b0-acda-3042ae5e4ea2 req-06efcbed-5b44-4169-ac90-eb63eb87384b service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562053 Dec 21 03:53:23.587505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc0d70cd-fbb7-4d40-b7d8-5eff2c3c21e2 req-1810dd06-ad29-420e-a129-46b12d0534b0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2647209 Dec 21 03:53:23.841468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:23.883061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Subnet': ['ID=11abf2fc-903a-4998-b1a7-de8e90d875ca,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:23.887749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:23.891303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-98975a0f-31e3-430e-8587-f472ff3a6aa6 tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/subnets/11abf2fc-903a-4998-b1a7-de8e90d875ca HTTP/1.1" status: 204 len: 168 time: 0.9347775 Dec 21 03:53:23.893718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56106) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:23.902089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c95e3ea-13dc-4bd9-b3fd-9f8935abc261 None None] Network ee67a52b-0310-46e9-bd3e-9290f6b608a2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:24.012269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.041045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fdb35f-46b4-4826-a487-53b9fd492bbe req-5591e441-1cfe-4a71-bf1b-0e2f1e97a481 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:24.042588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70fdb35f-46b4-4826-a487-53b9fd492bbe req-5591e441-1cfe-4a71-bf1b-0e2f1e97a481 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.0614328 Dec 21 03:53:24.091265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Deleting port def8992a-7925-4a11-92c9-1f4edef567c3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:24.095207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.142631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] DHCP port deletion for ee67a52b-0310-46e9-bd3e-9290f6b608a2 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:24.149773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70fdb35f-46b4-4826-a487-53b9fd492bbe req-394531cf-5f25-4f85-a89c-91569893032b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936208 Dec 21 03:53:24.240703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] For port def8992a-7925-4a11-92c9-1f4edef567c3, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=def8992a-7925-4a11-92c9-1f4edef567c3,segment=NetworkSegment(72027ca3-bddd-484e-8ece-680372e2dacb),segment_id=72027ca3-bddd-484e-8ece-680372e2dacb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:24.241095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.241877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] Deleting port def8992a-7925-4a11-92c9-1f4edef567c3 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:24.245459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.266830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Calling delete_port for def8992a-7925-4a11-92c9-1f4edef567c3 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:24.297372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbae1890-cedd-4bae-bfee-e4226512460a req-8e316500-b8a5-400d-856c-b723f5d3b359 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:24.308450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbae1890-cedd-4bae-bfee-e4226512460a req-8e316500-b8a5-400d-856c-b723f5d3b359 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.1239552 Dec 21 03:53:24.320181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56118) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:24.371162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4766ba95-b477-4697-abf5-97258bfbbc8e req-9ffc5469-704a-443d-85d6-cc7b396b836e tempest-ListImageFiltersTestJSON-1507755572 tempest-ListImageFiltersTestJSON-1507755572-project] 10.222.0.18 "GET /v2.0/ports?device_id=b159aaab-0940-4762-949f-a365b005eb7d HTTP/1.1" status: 200 len: 210 time: 0.0495548 Dec 21 03:53:24.410574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] For port def8992a-7925-4a11-92c9-1f4edef567c3, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=def8992a-7925-4a11-92c9-1f4edef567c3,segment=NetworkSegment(72027ca3-bddd-484e-8ece-680372e2dacb),segment_id=72027ca3-bddd-484e-8ece-680372e2dacb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:24.417097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.427022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbae1890-cedd-4bae-bfee-e4226512460a req-2d1bd426-0fa6-43b4-8ebe-fcd07c68bec5 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1173995 Dec 21 03:53:24.434748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] Calling delete_port for def8992a-7925-4a11-92c9-1f4edef567c3 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:24.491623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-413193271-network', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:24.526646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.563553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Port': ['ID=def8992a-7925-4a11-92c9-1f4edef567c3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:24.571207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] No DVR routers for this DVR port def8992a-7925-4a11-92c9-1f4edef567c3 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:24.612112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Made reservation on behalf of 811cd4c8ce3c40c69d5b84fba08dd2ce for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:24.615112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.638359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.703290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.727775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.736042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ee67a52b-0310-46e9-bd3e-9290f6b608a2']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:24.742515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.752773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] Pushing event deleted for resources: {'Port': ['ID=def8992a-7925-4a11-92c9-1f4edef567c3,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:24.762561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e7f09e3-7abb-4289-adca-f1c7eba0eb92 None None] No DVR routers for this DVR port def8992a-7925-4a11-92c9-1f4edef567c3 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:24.771700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '72027ca3-bddd-484e-8ece-680372e2dacb') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:24.771700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '72027ca3-bddd-484e-8ece-680372e2dacb') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:24.776884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.786299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.802025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.808784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:24.809421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:24.813122 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:24.823298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.855471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:24.863141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b886fb02-2b89-4ef5-b70d-e3425d3cb003,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:24.879331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.879331 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Added segment 05af4aed-43f0-4344-9587-0a147eb02792 of type vlan for network fdf5929d-4a6d-4141-a192-66db327cd55e Dec 21 03:53:24.951890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:24.994838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.002447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.008606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.009225 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] 10.222.0.18 "DELETE /v2.0/networks/ee67a52b-0310-46e9-bd3e-9290f6b608a2 HTTP/1.1" status: 204 len: 168 time: 1.1139858 Dec 21 03:53:25.040784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c24de1-5365-448c-9887-ec99bf6048ec tempest-NetworksIpV6Test-1339846006 tempest-NetworksIpV6Test-1339846006-project] Pushing event deleted for resources: {'Network': ['ID=ee67a52b-0310-46e9-bd3e-9290f6b608a2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:25.109185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.110271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:25.110854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.200070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] Pushing event updated for resources: {'Network': ['ID=fdf5929d-4a6d-4141-a192-66db327cd55e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:25.211962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network fdf5929d-4a6d-4141-a192-66db327cd55e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:25.255795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d6c185f6-01c9-4615-a970-63eacf7e8ff4 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.9232407 Dec 21 03:53:25.258631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56130) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:25.266684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Request body: {'subnet': {'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-subnet', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:25.304476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddac5a12-99c1-4fa9-ae34-02788e361970 req-8aa52070-af8c-4f6f-b3d8-48fa9718b286 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:25.305963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddac5a12-99c1-4fa9-ae34-02788e361970 req-8aa52070-af8c-4f6f-b3d8-48fa9718b286 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.0870085 Dec 21 03:53:25.359270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddac5a12-99c1-4fa9-ae34-02788e361970 req-94fb913c-c6c9-445e-8401-04e8423198b2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461459 Dec 21 03:53:25.401752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device def8992a-7925-4a11-92c9-1f4edef567c3 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:25.417269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Made reservation on behalf of 811cd4c8ce3c40c69d5b84fba08dd2ce for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:25.419800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.456115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: def8992a-7925-4a11-92c9-1f4edef567c3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:25.456611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device def8992a-7925-4a11-92c9-1f4edef567c3 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:25.485917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:25.697051 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ed96f253-1ccd-4c77-a971-b82a85beb4c8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4a3839e737d4474082b7ac35c76c45ea&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2096946 Dec 21 03:53:25.699826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:25.727443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.749091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.764832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-431b8d16-54d8-4afe-a1b7-a3df301ee0c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.811194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-431b8d16-54d8-4afe-a1b7-a3df301ee0c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:25.814971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Checking segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:25.815349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Network hostable DHCP agents. Network: fdf5929d-4a6d-4141-a192-66db327cd55e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:25.821322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Pushing event updated for resources: {'Subnet': ['ID=6a24f048-2859-4842-aab3-8ca7a2232eab,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:25.931913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Network fdf5929d-4a6d-4141-a192-66db327cd55e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:25.994058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f363c44b-16f4-400f-8a57-bd3bd7f4c0c6 req-264f308c-89ef-47ae-b2e8-cfa794654454 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:25.996218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f363c44b-16f4-400f-8a57-bd3bd7f4c0c6 req-264f308c-89ef-47ae-b2e8-cfa794654454 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.0593269 Dec 21 03:53:26.029715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-431b8d16-54d8-4afe-a1b7-a3df301ee0c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.032374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-431b8d16-54d8-4afe-a1b7-a3df301ee0c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.033974 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-431b8d16-54d8-4afe-a1b7-a3df301ee0c5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6919a562-0cbc-44d5-bfe1-c2c1baa7db2d HTTP/1.1" status: 204 len: 168 time: 0.3332484 Dec 21 03:53:26.045640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-431b8d16-54d8-4afe-a1b7-a3df301ee0c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6919a562-0cbc-44d5-bfe1-c2c1baa7db2d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:26.057038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f363c44b-16f4-400f-8a57-bd3bd7f4c0c6 req-975e88f2-dbf2-4141-924a-33fe42576547 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522327 Dec 21 03:53:26.079135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, fdf5929d-4a6d-4141-a192-66db327cd55e) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:26.079228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:26.079939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.087757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cffa7946-0424-48fd-9192-9f43869d3f39 None None] Network fdf5929d-4a6d-4141-a192-66db327cd55e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:26.180761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-755ab578-dcd1-4c2b-b8e6-2c85edb6ae4d admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 0.9209232 Dec 21 03:53:26.184668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56176) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:26.189124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:26.224898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a37e107a-8d9d-4a53-bdc5-1994c2c0340b None None] Network fdf5929d-4a6d-4141-a192-66db327cd55e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:26.316032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.317362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.349983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:26.381475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: b5fc9274-dcad-49e4-9ea7-4a6e85e6581e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:26.382244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b5fc9274-dcad-49e4-9ea7-4a6e85e6581e not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:26.391831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.393442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c133c672-8c7f-4d0a-8f95-2aeed495b2b7 req-622e9095-fb65-4b4b-a65f-e33b2826a9b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:26.394778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c133c672-8c7f-4d0a-8f95-2aeed495b2b7 req-622e9095-fb65-4b4b-a65f-e33b2826a9b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.0760999 Dec 21 03:53:26.458080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c133c672-8c7f-4d0a-8f95-2aeed495b2b7 req-6bc5c432-593a-4860-9551-a54826cfec16 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508273 Dec 21 03:53:26.581928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf116f16-843d-45c8-aef2-11481b66b65a req-2f125f66-eecd-4ff4-ae38-08ac361dc15e tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:26.589704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf116f16-843d-45c8-aef2-11481b66b65a req-2f125f66-eecd-4ff4-ae38-08ac361dc15e tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.0824430 Dec 21 03:53:26.593884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56190) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:26.608440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Request body: {'floatingip': {'port_id': 'd2acf96a-cb48-4985-bab5-901e7db33ffc'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:26.655657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:26.742318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.127828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.141479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.221019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.277625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Allocated IP 172.25.5.50 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/157b9f6f-10d7-4b32-8b9e-0d9302d2f49a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:27.398592 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.514998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.623995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4be5615-d2ec-447e-870c-ea0cbc260f87 req-e0d36899-d123-4fac-b3c4-750c21a6e325 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:27.631175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4be5615-d2ec-447e-870c-ea0cbc260f87 req-e0d36899-d123-4fac-b3c4-750c21a6e325 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.1102571 Dec 21 03:53:27.631618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.688829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:27.694474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:27.700582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:27.714021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-10415a21-b35e-48e4-8778-7e29b2eadb52 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:27.714021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-10415a21-b35e-48e4-8778-7e29b2eadb52 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 945 time: 0.1319978 Dec 21 03:53:27.714217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a41068f-8315-49a0-812b-3fed83607951 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:27.714688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Pushing event updated for resources: {'Port': ['ID=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:27.718210 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Floating IP aa96c0f8-c87c-4f60-bc64-30c18fc3d78a associated. External IP: 172.25.5.134, port: d2acf96a-cb48-4985-bab5-901e7db33ffc. Dec 21 03:53:27.730845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4be5615-d2ec-447e-870c-ea0cbc260f87 req-0f044700-a28e-44b7-b20b-17acedd9e9d8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986557 Dec 21 03:53:27.789163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cc9b8048-64ef-43e6-9d77-639f5259719c None None] Provisioning complete for port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:27.790399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cc9b8048-64ef-43e6-9d77-639f5259719c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:27.842907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cc9b8048-64ef-43e6-9d77-639f5259719c None None] Port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:27.989285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Router 0c5e87db-9278-4f74-91b4-8f821682e923 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:28.022269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56234) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:28.057311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Deleting port ee7741b1-3849-4963-be69-7a915a5e81b3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:28.057660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.119736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:28.125061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.135868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] Sync routers for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:28.149046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:28.150515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:28.179375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9a49baec-4464-4825-ae82-67cbc19c6a12 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "PUT /v2.0/floatingips/aa96c0f8-c87c-4f60-bc64-30c18fc3d78a HTTP/1.1" status: 200 len: 991 time: 1.5840864 Dec 21 03:53:28.180051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:28.183514 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162" -d '{"events": [{"name": "network-changed", "server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:28.188116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-393521428', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:28.309592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:28.355278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] For port ee7741b1-3849-4963-be69-7a915a5e81b3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ee7741b1-3849-4963-be69-7a915a5e81b3,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:28.355278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.360244 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e5d87df-6296-411e-a784-3f8b4900722f x-openstack-request-id: req-5e5d87df-6296-411e-a784-3f8b4900722f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:28.360817 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:28.360817 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5e5d87df-6296-411e-a784-3f8b4900722f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:28.361187 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'status': 'completed', 'code': 200} Dec 21 03:53:28.381802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Calling delete_port for ee7741b1-3849-4963-be69-7a915a5e81b3 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:28.413903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.415094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.438889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.475374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-6f74b063-92a9-4a8d-89d9-af736af4468d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:28.477402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-6f74b063-92a9-4a8d-89d9-af736af4468d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c6efab45cf074755a485f41e201aa464&device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 1097 time: 0.0743639 Dec 21 03:53:28.596962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.626264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-d919a682-3217-4a9c-b1e8-9c3ee6b55042 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:28.627572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-d919a682-3217-4a9c-b1e8-9c3ee6b55042 service neutron] 10.222.0.54 "GET /v2.0/networks?id=02e2ef7c-d00c-4471-ae34-58e2e22c435a HTTP/1.1" status: 200 len: 907 time: 0.1425743 Dec 21 03:53:28.639629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'aa96c0f8-c87c-4f60-bc64-30c18fc3d78a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'floating_ip_address': '172.25.5.134', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'port_id': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1127, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'mac_address': 'fa:16:3e:4f:28:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51462fb8-ab83-44bf-93e6-23a908f29176', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:53:01Z', 'updated_at': '2021-12-21T03:53:27Z', 'revision_number': 1, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:28.688132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] Checking router: 0c5e87db-9278-4f74-91b4-8f821682e923 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:28.698704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:28.699367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:28.712158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-eea728be-9f67-48a7-9269-504e86ed2c16 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc HTTP/1.1" status: 200 len: 999 time: 0.0745919 Dec 21 03:53:28.715062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:28.852971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:28.933283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.014848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.016681 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38aace54-5b74-4f0f-9600-f3709706a0f0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.9915938 Dec 21 03:53:29.019346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56262) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:29.033109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1953662450'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:29.072809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.117186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ee7741b1-3849-4963-be69-7a915a5e81b3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:29.207842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ca64bce-9bf9-45c5-b6c9-b62ae7d23bb2 req-7812a983-6151-4727-a558-8266140a1e0e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 210 time: 0.0444512 Dec 21 03:53:29.229740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-21b0c7b8-77ca-47a9-8597-ef300d3458ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:29.231271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-21b0c7b8-77ca-47a9-8597-ef300d3458ee service neutron] 10.222.0.54 "GET /v2.0/subnets?id=394148b6-6bdf-4aaa-94d7-be0fbbf6634e HTTP/1.1" status: 200 len: 845 time: 0.5116205 Dec 21 03:53:29.284916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'aa96c0f8-c87c-4f60-bc64-30c18fc3d78a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'floating_ip_address': '172.25.5.134', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'port_id': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1127, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'mac_address': 'fa:16:3e:4f:28:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51462fb8-ab83-44bf-93e6-23a908f29176', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:53:01Z', 'updated_at': '2021-12-21T03:53:27Z', 'revision_number': 1, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:29.289135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-6ac92db4-8caf-4d89-8481-7083fa7ee4eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:29.291052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-6ac92db4-8caf-4d89-8481-7083fa7ee4eb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=02e2ef7c-d00c-4471-ae34-58e2e22c435a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0521064 Dec 21 03:53:29.325204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2dce3363-bc8a-467c-a501-04a8afea5d28 None None] The sync data for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 is: [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'aa96c0f8-c87c-4f60-bc64-30c18fc3d78a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'floating_ip_address': '172.25.5.134', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'port_id': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 1127, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'mac_address': 'fa:16:3e:4f:28:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51462fb8-ab83-44bf-93e6-23a908f29176', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:53:01Z', 'updated_at': '2021-12-21T03:53:27Z', 'revision_number': 1, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:29.467118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-7011bc70-4602-49b3-8d1f-7aa99e401add service neutron] 10.222.0.54 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1669533 Dec 21 03:53:29.467676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event deleted for resources: {'Port': ['ID=ee7741b1-3849-4963-be69-7a915a5e81b3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:29.492240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e9f6aa2-6fd1-4d11-81a3-2a5f3d886ecb None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:29.529735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] No DVR routers for this DVR port ee7741b1-3849-4963-be69-7a915a5e81b3 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:29.532465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.536346 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7e7f5e71-10b4-497f-8675-28cdd850dbf8 req-b8dd49d5-9077-4022-8147-be4537015260 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.54 "DELETE /v2.0/ports/ee7741b1-3849-4963-be69-7a915a5e81b3 HTTP/1.1" status: 204 len: 173 time: 1.8012264 Dec 21 03:53:29.537992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'name': 'network-vif-deleted', 'tag': 'ee7741b1-3849-4963-be69-7a915a5e81b3'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:29.541921 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fde4e358-a4ec-43c2-a40c-d3afdd2177a8" -d '{"events": [{"server_uuid": "ec20d307-be77-42e5-928c-8ccd35032b95", "name": "network-vif-deleted", "tag": "ee7741b1-3849-4963-be69-7a915a5e81b3"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:29.550883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Made reservation on behalf of c59630953ed24a0e86abb95ad3f7c466 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:29.555416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.573278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.660927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56276) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:29.709856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Router e40244a3-af5e-4667-8b35-411bfa38392f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:53:29.725304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.751232 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88b22e23-1a79-450a-a8d5-e5a21c3a6282 None None] New status for floating IP aa96c0f8-c87c-4f60-bc64-30c18fc3d78a: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:53:29.770840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33f30d2d-ef3f-409a-bedb-4ad10fd8a162 req-da3ebce9-ef55-464c-ba05-fc1664a777d6 service neutron] 10.222.0.54 "GET /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2819290 Dec 21 03:53:29.832743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.887616 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7689a624-7608-41a8-a2ad-3063c6fa47ab x-openstack-request-id: req-7689a624-7608-41a8-a2ad-3063c6fa47ab {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:29.887916 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec20d307-be77-42e5-928c-8ccd35032b95", "name": "network-vif-deleted", "tag": "ee7741b1-3849-4963-be69-7a915a5e81b3", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:29.888320 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7689a624-7608-41a8-a2ad-3063c6fa47ab {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:29.888750 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec20d307-be77-42e5-928c-8ccd35032b95', 'name': 'network-vif-deleted', 'tag': 'ee7741b1-3849-4963-be69-7a915a5e81b3', 'status': 'completed', 'code': 200} Dec 21 03:53:29.889404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:29.941209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bff132f6-992b-44bb-bb44-d21c19ea6ecb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:29.957583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:29.957921 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Added segment a65b66e5-4454-4311-9f04-c9c95f59908e of type vlan for network 23aa1b9b-2199-484a-83ef-4353021e7bec Dec 21 03:53:30.022429 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1111c1f4-0e29-46e2-a81f-c30001316f1b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a2b50fd62fc440ddb648791821139549&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3591931 Dec 21 03:53:30.025102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56282) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:30.032760 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.035689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:30.045648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Sync routers for ids ['e40244a3-af5e-4667-8b35-411bfa38392f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:30.059052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Routers {'e40244a3-af5e-4667-8b35-411bfa38392f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:30.063184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e40244a3-af5e-4667-8b35-411bfa38392f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:30.089306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b28fbbe9-56fc-472f-baa5-c118eef96d74 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.121570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b28fbbe9-56fc-472f-baa5-c118eef96d74 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.153466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.158341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56284) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:30.159423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d829293-01b4-461a-a8b2-5b5f749c62d0 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 3.9732203 Dec 21 03:53:30.185387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Set router e40244a3-af5e-4667-8b35-411bfa38392f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:30.217137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.228069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:30.228069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.312552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Network': ['ID=23aa1b9b-2199-484a-83ef-4353021e7bec,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:30.317412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b28fbbe9-56fc-472f-baa5-c118eef96d74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.325589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b28fbbe9-56fc-472f-baa5-c118eef96d74 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.325755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 23aa1b9b-2199-484a-83ef-4353021e7bec details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:30.330511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b28fbbe9-56fc-472f-baa5-c118eef96d74 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b0070dcb-d89e-44e0-815b-423b077edf00 HTTP/1.1" status: 204 len: 168 time: 0.3015623 Dec 21 03:53:30.391166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e6b5bcc0-489c-40ca-bf0d-3a5086929437 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 1.3705425 Dec 21 03:53:30.391850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56290) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:30.401256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'subnet': {'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:30.492211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:53:28Z', 'revision_number': 3, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:30.503609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64b504a5-660b-4acf-9c6a-9a867032942f req-dfcc0c8c-803e-4389-93ce-26296cf94418 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=ec20d307-be77-42e5-928c-8ccd35032b95 HTTP/1.1" status: 200 len: 210 time: 0.1701262 Dec 21 03:53:30.512789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28fbbe9-56fc-472f-baa5-c118eef96d74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0070dcb-d89e-44e0-815b-423b077edf00,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:30.562875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Checking router: e40244a3-af5e-4667-8b35-411bfa38392f for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:30.563266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Updating router e40244a3-af5e-4667-8b35-411bfa38392f port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:53:30.594767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Made reservation on behalf of c59630953ed24a0e86abb95ad3f7c466 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:30.598671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.605262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.988560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.989525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:30.999557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.052747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.070697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Subnet': ['ID=1b5da811-7a04-4b7f-a181-33c63a1e5b63,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:31.078892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Checking segment: {'id': 'a65b66e5-4454-4311-9f04-c9c95f59908e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:31.079255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network hostable DHCP agents. Network: 23aa1b9b-2199-484a-83ef-4353021e7bec, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:31.148092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae7efe88-4dd6-4c29-968b-3d94ac4e1ed0 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:31.157432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77986e4a-5357-48e6-a04b-00af100ac802 None None] Pushing event updated for resources: {'Port': ['ID=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:31.161676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network 23aa1b9b-2199-484a-83ef-4353021e7bec is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:31.167065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Attempting to bind port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:31.168389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Attempting to bind port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:31.168824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Attempting to bind port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:31.178338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:31.178751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:31.179279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.179706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:31.180446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Bound port: 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:31.180840 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.245381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] For port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:31.251715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 23aa1b9b-2199-484a-83ef-4353021e7bec) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:31.256082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:31.257164 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.257623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Allocated IP 172.20.0.1 (fdf5929d-4a6d-4141-a192-66db327cd55e/6a24f048-2859-4842-aab3-8ca7a2232eab/396f6baa-46b9-4358-9644-14bb8ef20cc4) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:31.260458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] For port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:31.271987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d4f2a88-b259-4823-913b-35a53b8f74e2 None None] Network 23aa1b9b-2199-484a-83ef-4353021e7bec requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:31.356012 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2348db8-129a-448b-adf3-2b1ab1fb1c2f tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9624720 Dec 21 03:53:31.359909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56310) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:31.360042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.364728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'network': {'name': 'tempest-router-network01--1150170183'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:31.415397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.438196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a29f140f-c6f1-4342-84c2-b716f48f8a47 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:31.440772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d66cab1e-1227-4202-b62f-a5a444ea9ca9 None None] Provisioning complete for port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:31.441153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d66cab1e-1227-4202-b62f-a5a444ea9ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.474499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Made reservation on behalf of c59630953ed24a0e86abb95ad3f7c466 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:31.484814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.518167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:31.523632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Routers {'e40244a3-af5e-4667-8b35-411bfa38392f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:31.523632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e40244a3-af5e-4667-8b35-411bfa38392f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:31.533924 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.534280 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Added segment d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1 of type vlan for network 19ab220e-df22-4e71-9fd5-879c729fcbc6 Dec 21 03:53:31.549145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.626362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Network fdf5929d-4a6d-4141-a192-66db327cd55e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:31.634896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:31.640600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:31.644237 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.711906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Pushing event updated for resources: {'Port': ['ID=396f6baa-46b9-4358-9644-14bb8ef20cc4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:31.740713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.801666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.808958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:31.812780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.871879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-23aa1b9b-2199-484a-83ef-4353021e7bec', 'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec', 'project_id': 'c59630953ed24a0e86abb95ad3f7c466', 'fixed_ips': [{'subnet_id': '1b5da811-7a04-4b7f-a181-33c63a1e5b63'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:53:31.872769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:31.883676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77986e4a-5357-48e6-a04b-00af100ac802 None None] Pushing event updated for resources: {'Port': ['ID=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:31.996763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6336441 Dec 21 03:53:31.997351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56344) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:32.003332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'network': {'name': 'tempest-router-network02--224991'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:32.039959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069948d1-ecfa-474a-beb8-b5b420efe747 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Network': ['ID=19ab220e-df22-4e71-9fd5-879c729fcbc6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:32.063026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:32.079696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] Set router e40244a3-af5e-4667-8b35-411bfa38392f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:32.109681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-d743150e-ba6f-4c4c-9c92-e0713231e3f8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:32.113296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-d743150e-ba6f-4c4c-9c92-e0713231e3f8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.2596250 Dec 21 03:53:32.114776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Made reservation on behalf of c59630953ed24a0e86abb95ad3f7c466 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:32.120458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.152639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:32.167744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.168643 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Added segment afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2 of type vlan for network d1484879-37d9-4f9a-af8f-2069eaa33d17 Dec 21 03:53:32.202105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.225819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-f39b3fb9-5b43-4b90-95c8-f4ff401dd245 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.0954893 Dec 21 03:53:32.235323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.287365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-c7d8fb8d-dcbf-49c8-b182-546f79cbb8b3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0597162 Dec 21 03:53:32.320685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.327569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:32.328273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.408356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d66cab1e-1227-4202-b62f-a5a444ea9ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.475654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4767182 Dec 21 03:53:32.478866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-f72ce2e1-bd24-4a23-b987-df10ffbf3c50 service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1906633 Dec 21 03:53:32.479035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56348) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:32.486967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'subnet': {'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:32.492199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ebe7aa-4d09-4480-bf05-bc736ac16d16 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Network': ['ID=d1484879-37d9-4f9a-af8f-2069eaa33d17,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:32.492356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Allocated IP 172.20.0.2 (23aa1b9b-2199-484a-83ef-4353021e7bec/1b5da811-7a04-4b7f-a181-33c63a1e5b63/f305f516-40b1-419b-b497-e9820bf58d96) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:32.512580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d1484879-37d9-4f9a-af8f-2069eaa33d17 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:32.516616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d66cab1e-1227-4202-b62f-a5a444ea9ca9 None None] For port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:32.614878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d66cab1e-1227-4202-b62f-a5a444ea9ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.647511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.666964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-252ed194-477a-4c03-94b0-d83d4ecda84a service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1776135 Dec 21 03:53:32.681808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ee7741b1-3849-4963-be69-7a915a5e81b3 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:32.703479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.726101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Made reservation on behalf of c59630953ed24a0e86abb95ad3f7c466 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:32.730576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.737350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: ee7741b1-3849-4963-be69-7a915a5e81b3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:32.737350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ee7741b1-3849-4963-be69-7a915a5e81b3 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:32.820930 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d66cab1e-1227-4202-b62f-a5a444ea9ca9 None None] Pushing event updated for resources: {'Port': ['ID=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:32.823812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cfb1a16e-94a1-4736-9b2a-2127d98c0d28 None None] Provisioning complete for port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:32.824181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cfb1a16e-94a1-4736-9b2a-2127d98c0d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.840927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.842741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Pushing event updated for resources: {'Port': ['ID=396f6baa-46b9-4358-9644-14bb8ef20cc4,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:32.913616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:32.936298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:53:28Z', 'revision_number': 3, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:32.991215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d6e9d6-389b-45d5-a53d-4eba090a8f30 None None] The sync data for ids ['e40244a3-af5e-4667-8b35-411bfa38392f'] in n-d-822053-11 is: [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:53:28Z', 'revision_number': 3, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:32.997186 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:33.022035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Network fdf5929d-4a6d-4141-a192-66db327cd55e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:33.024553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:33.071809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Network 23aa1b9b-2199-484a-83ef-4353021e7bec is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:33.076186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Pushing event updated for resources: {'Port': ['ID=f305f516-40b1-419b-b497-e9820bf58d96,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:33.078819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:33.081271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:33.177033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Attempting to bind port f305f516-40b1-419b-b497-e9820bf58d96 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:33.177905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Attempting to bind port f305f516-40b1-419b-b497-e9820bf58d96 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a65b66e5-4454-4311-9f04-c9c95f59908e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:33.178735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Attempting to bind port f305f516-40b1-419b-b497-e9820bf58d96 on network 23aa1b9b-2199-484a-83ef-4353021e7bec {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:33.192386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:33.192948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Checking segment: {'id': 'a65b66e5-4454-4311-9f04-c9c95f59908e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:33.193522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:33.194017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Bound using segment: {'id': 'a65b66e5-4454-4311-9f04-c9c95f59908e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:33.194594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Bound port: f305f516-40b1-419b-b497-e9820bf58d96, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a65b66e5-4454-4311-9f04-c9c95f59908e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '23aa1b9b-2199-484a-83ef-4353021e7bec'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:33.195012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:33.223695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:33.295483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-407fc4cf-86e9-4f19-a193-0600de972a7b req-71efa0f1-e7cc-40f3-9169-a0fde8400fb0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 210 time: 0.0599000 Dec 21 03:53:33.347531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Router e40244a3-af5e-4667-8b35-411bfa38392f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:33.373308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] For port f305f516-40b1-419b-b497-e9820bf58d96, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:33.381259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] For port f305f516-40b1-419b-b497-e9820bf58d96, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f305f516-40b1-419b-b497-e9820bf58d96,segment=NetworkSegment(a65b66e5-4454-4311-9f04-c9c95f59908e),segment_id=a65b66e5-4454-4311-9f04-c9c95f59908e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:33.392361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Checking segment: {'id': 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:33.392905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network hostable DHCP agents. Network: 19ab220e-df22-4e71-9fd5-879c729fcbc6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:33.395271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Subnet': ['ID=58798355-0108-46e5-ba91-8cab1b43eb71,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:33.456552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:33.492932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:33.555737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9ad2a1-0d71-428e-9fdb-2c61aec31332 None None] Pushing event updated for resources: {'Port': ['ID=f305f516-40b1-419b-b497-e9820bf58d96,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:33.577706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 19ab220e-df22-4e71-9fd5-879c729fcbc6) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:33.581919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:33.588685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:33.589352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:33.599242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-83191ad1-3e87-418a-8ef5-86fbb11c2c9f admin admin] 10.222.0.18 "PUT /v2.0/routers/e40244a3-af5e-4667-8b35-411bfa38392f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4378247 Dec 21 03:53:33.600150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd25a43c-cc0a-4715-8975-cad89f66ed6b None None] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:33.672239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56372) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:33.672805 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-17c68505-975c-4cde-b9bd-0942486bc00e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1922162 Dec 21 03:53:33.678771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'subnet': {'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:33.810135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-19ab220e-df22-4e71-9fd5-879c729fcbc6', 'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6', 'project_id': 'c59630953ed24a0e86abb95ad3f7c466', 'fixed_ips': [{'subnet_id': '58798355-0108-46e5-ba91-8cab1b43eb71'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:53:33.812832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.149378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Allocated IP 172.20.0.2 (19ab220e-df22-4e71-9fd5-879c729fcbc6/58798355-0108-46e5-ba91-8cab1b43eb71/4858cbd9-daac-42de-ad13-37fa4656259b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:34.426713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.486611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.532039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:34.539276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:34.543614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:34.551254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Pushing event updated for resources: {'Port': ['ID=4858cbd9-daac-42de-ad13-37fa4656259b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:34.627491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-d510ad19-b554-4fb0-9611-f65974fa8ae1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:34.629178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-d510ad19-b554-4fb0-9611-f65974fa8ae1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 818 time: 0.2764966 Dec 21 03:53:34.645050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Attempting to bind port 4858cbd9-daac-42de-ad13-37fa4656259b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:34.645509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Attempting to bind port 4858cbd9-daac-42de-ad13-37fa4656259b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:34.645835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Attempting to bind port 4858cbd9-daac-42de-ad13-37fa4656259b on network 19ab220e-df22-4e71-9fd5-879c729fcbc6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:34.652424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:34.652804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Checking segment: {'id': 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:34.653271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.653669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Bound using segment: {'id': 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:34.654464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Bound port: 4858cbd9-daac-42de-ad13-37fa4656259b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '19ab220e-df22-4e71-9fd5-879c729fcbc6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:34.654858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.659639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-9f90ecb8-933c-4978-9226-275cee6502a8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/quotas/811cd4c8ce3c40c69d5b84fba08dd2ce HTTP/1.1" status: 200 len: 375 time: 0.0239437 Dec 21 03:53:34.665117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Made reservation on behalf of c59630953ed24a0e86abb95ad3f7c466 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:34.669624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.757639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] For port 4858cbd9-daac-42de-ad13-37fa4656259b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:34.762027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] For port 4858cbd9-daac-42de-ad13-37fa4656259b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4858cbd9-daac-42de-ad13-37fa4656259b,segment=NetworkSegment(d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1),segment_id=d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:34.846518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:34.884168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-19ab2393-d903-4af2-8dc8-eda1dc801170 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2088366 Dec 21 03:53:34.934353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476b97aa-aaa3-420e-94c3-8834c8317508 None None] Pushing event updated for resources: {'Port': ['ID=4858cbd9-daac-42de-ad13-37fa4656259b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:35.002902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ddac3e1-8b9e-4e66-9c1b-9e88ab1a8a4a req-367e8dfe-f4d0-4b05-ae89-49a873fc62bb tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 210 time: 0.0755358 Dec 21 03:53:35.253576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:35.372809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4eb57e7-346b-41fd-b665-c38499fb9cae None None] Network 23aa1b9b-2199-484a-83ef-4353021e7bec requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:35.508102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-dae7b1bd-eabb-4a37-b10b-4d3a0e955342 service neutron] 10.222.0.18 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6086392 Dec 21 03:53:35.589134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ba27595f-e844-4041-87e7-99e079e270d6 None None] Provisioning complete for port f305f516-40b1-419b-b497-e9820bf58d96 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:35.589302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Subnet': ['ID=b818df02-18a4-447b-a2e2-5be4c2e45770,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:35.589814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba27595f-e844-4041-87e7-99e079e270d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:35.659690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:35.660017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Checking segment: {'id': 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:35.660412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network hostable DHCP agents. Network: d1484879-37d9-4f9a-af8f-2069eaa33d17, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:35.719936 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:53:35.803279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-968377ee-3d41-405a-86aa-d0b02439d2f5 service neutron] 10.222.0.18 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2934687 Dec 21 03:53:35.804929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network d1484879-37d9-4f9a-af8f-2069eaa33d17 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:35.886389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d1484879-37d9-4f9a-af8f-2069eaa33d17) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:35.893143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:35.893964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:35.977150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8260fe6-40c7-4615-af16-58b056f2c10d None None] Network d1484879-37d9-4f9a-af8f-2069eaa33d17 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:35.987741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2e485a46-de16-4828-8eba-27d89c754afe tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3140500 Dec 21 03:53:35.990579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:36.068665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-b71ad303-76ed-4c24-9f2c-ad1347b9fac5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:36.070198 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-b71ad303-76ed-4c24-9f2c-ad1347b9fac5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.2377114 Dec 21 03:53:36.112775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Request body: {'port': {'device_id': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'admin_state_up': True, 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:36.346233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d1484879-37d9-4f9a-af8f-2069eaa33d17', 'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17', 'project_id': 'c59630953ed24a0e86abb95ad3f7c466', 'fixed_ips': [{'subnet_id': 'b818df02-18a4-447b-a2e2-5be4c2e45770'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:53:36.350007 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:36.462259 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Sync routers for ids ['e40244a3-af5e-4667-8b35-411bfa38392f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:36.483895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Routers {'e40244a3-af5e-4667-8b35-411bfa38392f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:36.486899 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e40244a3-af5e-4667-8b35-411bfa38392f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:36.501097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:36.501646 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:36.518825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba27595f-e844-4041-87e7-99e079e270d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:36.623341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:36.628203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:36.683587 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Set router e40244a3-af5e-4667-8b35-411bfa38392f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:36.716403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-264c2102-8b64-4b47-b626-8fdadf70d884 req-4e6d2051-5a92-4b52-ad96-626861648ad9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 210 time: 0.1545017 Dec 21 03:53:36.848575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf661c59-0837-4192-8494-7ede8dda5f58 req-56fa3bd9-01b0-4e76-a726-2c390c8bc329 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 210 time: 0.1285317 Dec 21 03:53:36.861861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ba27595f-e844-4041-87e7-99e079e270d6 None None] For port f305f516-40b1-419b-b497-e9820bf58d96, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f305f516-40b1-419b-b497-e9820bf58d96,segment=NetworkSegment(a65b66e5-4454-4311-9f04-c9c95f59908e),segment_id=a65b66e5-4454-4311-9f04-c9c95f59908e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:36.930160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Allocated IP 172.20.0.12 (a0e5eeee-a736-4bd3-bdf6-679e8da99022/0937a3b1-7f54-409b-bba0-29fa72617a82/da1bad89-a5fb-446c-af44-dde02dbd5709) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:36.962360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af263d67-e31a-4145-b103-b5ec852ca09f None None] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:37.030363 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba27595f-e844-4041-87e7-99e079e270d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.105920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.146788 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '396f6baa-46b9-4358-9644-14bb8ef20cc4', 'name': '', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'mac_address': 'fa:16:3e:11:41:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1159, 'fixed_ips': [{'subnet_id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:31Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 2, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'subnets': [{'id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:37.148241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.207304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.288649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba27595f-e844-4041-87e7-99e079e270d6 None None] Pushing event updated for resources: {'Port': ['ID=f305f516-40b1-419b-b497-e9820bf58d96,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:37.297073 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Checking router: e40244a3-af5e-4667-8b35-411bfa38392f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:37.297544 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Updating router e40244a3-af5e-4667-8b35-411bfa38392f port 396f6baa-46b9-4358-9644-14bb8ef20cc4 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:53:37.338439 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.362454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:37.372369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:37.380930 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f305f516-40b1-419b-b497-e9820bf58d96 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:37.390721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:37.445450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Allocated IP 172.20.0.2 (d1484879-37d9-4f9a-af8f-2069eaa33d17/b818df02-18a4-447b-a2e2-5be4c2e45770/30117ac4-0d06-4963-8358-6d8caf8e2fa9) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:37.450344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10cf1c25-0b3d-4463-ba25-723844fbcd9e None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:37.467825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Provisioning complete for port f305f516-40b1-419b-b497-e9820bf58d96 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:37.468198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.506178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-0b3dc1dc-8590-4ba0-82b6-e9b5f565ce27 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:37.517964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-0b3dc1dc-8590-4ba0-82b6-e9b5f565ce27 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 818 time: 0.2627413 Dec 21 03:53:37.518413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:37.521846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.531217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:37.619269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f305f516-40b1-419b-b497-e9820bf58d96 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:37.619907 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.650123 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-6553ab90-8f01-4e14-a898-921dfceb1f8f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5471303 Dec 21 03:53:37.679445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Request body: {'port': {'device_id': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:37.896190 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.910475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:37.915987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4858cbd9-daac-42de-ad13-37fa4656259b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:37.943965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-d880c933-8066-4dd7-b0c0-60f33266c977 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/quotas/811cd4c8ce3c40c69d5b84fba08dd2ce HTTP/1.1" status: 200 len: 375 time: 0.4247496 Dec 21 03:53:37.989120 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.028275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Provisioning complete for port 4858cbd9-daac-42de-ad13-37fa4656259b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:38.028577 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.077914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.088589 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ff812d-97dd-4e34-b77d-f3a3f9295731 None None] Pushing event updated for resources: {'Port': ['ID=396f6baa-46b9-4358-9644-14bb8ef20cc4,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:38.136047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4858cbd9-daac-42de-ad13-37fa4656259b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:38.140921 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.162224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-964786de-a130-4b3d-b589-f7e10d92d703 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.6039877 Dec 21 03:53:38.185497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-99e9464d-f7cf-4a0c-a37d-671d059715d8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.2792349 Dec 21 03:53:38.209388 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.215505 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Attempting to bind port 396f6baa-46b9-4358-9644-14bb8ef20cc4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:38.216115 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Attempting to bind port 396f6baa-46b9-4358-9644-14bb8ef20cc4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:38.216205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Attempting to bind port 396f6baa-46b9-4358-9644-14bb8ef20cc4 on network fdf5929d-4a6d-4141-a192-66db327cd55e {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:38.224821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-ed8e11cf-bb2b-4132-8929-89b753309962 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2798743 Dec 21 03:53:38.229155 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:38.233895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Checking segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:38.233895 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.233895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Bound using segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:38.233895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Bound port: 396f6baa-46b9-4358-9644-14bb8ef20cc4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:38.233895 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.243755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Allocated IP 172.20.0.1 (19ab220e-df22-4e71-9fd5-879c729fcbc6/58798355-0108-46e5-ba91-8cab1b43eb71/4e29927d-6c29-4e93-93d1-9d8ceb2f02b2) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:38.333496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Pushing event updated for resources: {'Port': ['ID=30117ac4-0d06-4963-8358-6d8caf8e2fa9,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:38.353934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.381705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Network d1484879-37d9-4f9a-af8f-2069eaa33d17 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:38.391637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:38.396151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:38.415291 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] For port 396f6baa-46b9-4358-9644-14bb8ef20cc4, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:38.422281 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] For port 396f6baa-46b9-4358-9644-14bb8ef20cc4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=396f6baa-46b9-4358-9644-14bb8ef20cc4,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:38.438076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9145525-3cd0-4361-b530-029490704a1b req-36258898-a565-42ec-9c92-130a8d3ac5ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:38.441203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-36258898-a565-42ec-9c92-130a8d3ac5ca service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 1096 time: 0.2355475 Dec 21 03:53:38.456266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da1bad89-a5fb-446c-af44-dde02dbd5709 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:38.457350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-784f1058-39e2-499a-92fb-082472df3814 None None] For port 4858cbd9-daac-42de-ad13-37fa4656259b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4858cbd9-daac-42de-ad13-37fa4656259b,segment=NetworkSegment(d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1),segment_id=d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:38.465805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.477576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Transition to ACTIVE for port object da1bad89-a5fb-446c-af44-dde02dbd5709 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:53:38.480867 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.493150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.538859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.542746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Attempting to bind port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:38.543232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Attempting to bind port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:38.543569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Attempting to bind port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 on network d1484879-37d9-4f9a-af8f-2069eaa33d17 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:38.553087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:38.554651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Checking segment: {'id': 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:38.554651 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.554651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Bound using segment: {'id': 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:38.554887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Bound port: 30117ac4-0d06-4963-8358-6d8caf8e2fa9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'd1484879-37d9-4f9a-af8f-2069eaa33d17'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:38.555207 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.562613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.582106 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Routers {'e40244a3-af5e-4667-8b35-411bfa38392f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:38.583591 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e40244a3-af5e-4667-8b35-411bfa38392f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:38.625901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-687a5b96-3915-44f8-a0fe-6db06d82cc1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:38.632429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-687a5b96-3915-44f8-a0fe-6db06d82cc1a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=068e67c3e7bc40e397d83d4acaa3afd1&device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 1098 time: 0.3422635 Dec 21 03:53:38.642300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:38.657292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] For port 30117ac4-0d06-4963-8358-6d8caf8e2fa9, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:38.659224 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ff812d-97dd-4e34-b77d-f3a3f9295731 None None] Pushing event updated for resources: {'Port': ['ID=396f6baa-46b9-4358-9644-14bb8ef20cc4,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:38.660466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] For port 30117ac4-0d06-4963-8358-6d8caf8e2fa9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30117ac4-0d06-4963-8358-6d8caf8e2fa9,segment=NetworkSegment(afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2),segment_id=afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:38.669787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f243f7aa-0249-431d-a9b5-8dbe79a546f6 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:38.715641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-784f1058-39e2-499a-92fb-082472df3814 None None] Pushing event updated for resources: {'Port': ['ID=4858cbd9-daac-42de-ad13-37fa4656259b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:38.740759 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.759495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ed8700-0a0e-420c-8c32-30060f8d5895 req-2cc727e5-8ac5-4902-a4df-3f4b6a46de24 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:38.763249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Attempting to bind port da1bad89-a5fb-446c-af44-dde02dbd5709 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:38.763980 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] Set router e40244a3-af5e-4667-8b35-411bfa38392f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:38.765180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Attempting to bind port da1bad89-a5fb-446c-af44-dde02dbd5709 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:38.766238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Attempting to bind port da1bad89-a5fb-446c-af44-dde02dbd5709 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:38.767328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74ed8700-0a0e-420c-8c32-30060f8d5895 req-2cc727e5-8ac5-4902-a4df-3f4b6a46de24 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 932 time: 0.4483790 Dec 21 03:53:38.781346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Port da1bad89-a5fb-446c-af44-dde02dbd5709 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:53:38.781985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Attempting to bind port da1bad89-a5fb-446c-af44-dde02dbd5709 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:38.793166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:38.793514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:38.793912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Bound using segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:38.797259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Bound port: da1bad89-a5fb-446c-af44-dde02dbd5709, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:38.797675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.821170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.864009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-289559ca-3e2f-4529-8e1c-d940e960e3a6 None None] Provisioning complete for port 4858cbd9-daac-42de-ad13-37fa4656259b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:38.864549 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-289559ca-3e2f-4529-8e1c-d940e960e3a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:38.915165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9145525-3cd0-4361-b530-029490704a1b req-27bba3aa-f8b8-43b4-b8fd-cbf3dded9426 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:38.915165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-27bba3aa-f8b8-43b4-b8fd-cbf3dded9426 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.3811791 Dec 21 03:53:38.924223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:53:38.926169 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:53:38.940825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb26a48-8d34-47bb-bcc9-d517b851d79b None None] Pushing event updated for resources: {'Port': ['ID=30117ac4-0d06-4963-8358-6d8caf8e2fa9,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:38.971087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:38.975606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:39.033763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-8c6497f2-685a-426d-9e6c-461b153472b2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 200 len: 217 time: 0.0752940 Dec 21 03:53:39.070161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:39.092147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74ed8700-0a0e-420c-8c32-30060f8d5895 req-6d532357-1858-4a11-b662-7354d28f4486 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3238611 Dec 21 03:53:39.146297 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '396f6baa-46b9-4358-9644-14bb8ef20cc4', 'name': '', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'mac_address': 'fa:16:3e:11:41:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1159, 'fixed_ips': [{'subnet_id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:31Z', 'updated_at': '2021-12-21T03:53:38Z', 'revision_number': 4, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'subnets': [{'id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:39.173738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:39.182620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:39.183428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:39.185053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-2e4e9824-e2d0-48c2-833a-8ecae82e2007 service neutron] 10.222.0.31 "PUT /v2.0/ports/da1bad89-a5fb-446c-af44-dde02dbd5709 HTTP/1.1" status: 200 len: 1093 time: 1.5115714 Dec 21 03:53:39.185624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:39.189535 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a00a2c26-87e2-4321-a14d-db0c804e1bdf" -d '{"events": [{"name": "network-changed", "server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:39.196185 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a52de0e-26d5-4dce-994a-2ce10f7511a2 None None] The sync data for ids ['e40244a3-af5e-4667-8b35-411bfa38392f'] in n-d-822053-11 is: [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '396f6baa-46b9-4358-9644-14bb8ef20cc4', 'name': '', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'mac_address': 'fa:16:3e:11:41:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_interface', 'standard_attr_id': 1159, 'fixed_ips': [{'subnet_id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:31Z', 'updated_at': '2021-12-21T03:53:38Z', 'revision_number': 4, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'subnets': [{'id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:39.232873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b5c51a8-4ee8-4d92-8973-95d6d3ebdfc9 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:39.256807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-667f9ae8-bcf6-4bfd-8f1d-ef46b5b3049e service neutron] 10.222.0.18 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0310235 Dec 21 03:53:39.482050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-b7e820fe-dfe0-4b25-bfd7-72c3f5399b2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:39.483581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-b7e820fe-dfe0-4b25-bfd7-72c3f5399b2f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 1096 time: 0.0918267 Dec 21 03:53:39.583139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-6d286638-7fd0-4298-a706-f77d45061cf3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=da1bad89-a5fb-446c-af44-dde02dbd5709 HTTP/1.1" status: 200 len: 217 time: 0.0792935 Dec 21 03:53:39.692749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db74868e-5db7-4318-9885-6e5397c58606 req-b14d3656-d79a-4037-95fc-9c252b954fe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:39.693754 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-b14d3656-d79a-4037-95fc-9c252b954fe5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.0968316 Dec 21 03:53:39.755847 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-d1235e70-7709-47a6-a20e-58ef8c03e686 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0310857 Dec 21 03:53:39.949664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f305f516-40b1-419b-b497-e9820bf58d96 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:39.954255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-bfadd6d1-77fa-4792-bf2d-e613a5f1f923 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1876905 Dec 21 03:53:39.967917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-e38bbaa6-7eaf-4de4-9233-88ffed6c93d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:39.969391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-e38bbaa6-7eaf-4de4-9233-88ffed6c93d7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a4370ec5-c219-4c56-a17c-433f7c352683 HTTP/1.1" status: 200 len: 912 time: 1.2219279 Dec 21 03:53:40.064736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f305f516-40b1-419b-b497-e9820bf58d96 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:40.066681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:40.118285 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5947441b-e3e1-48e0-bb35-540bb3d4059c x-openstack-request-id: req-5947441b-e3e1-48e0-bb35-540bb3d4059c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:40.118285 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:40.118285 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5947441b-e3e1-48e0-bb35-540bb3d4059c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:40.118285 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'status': 'completed', 'code': 200} Dec 21 03:53:40.155085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:40.200561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:40.204071 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db74868e-5db7-4318-9885-6e5397c58606 req-d2883ef4-da05-494f-b890-47872e25eba0 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2300100 Dec 21 03:53:40.254033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:40.275621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4858cbd9-daac-42de-ad13-37fa4656259b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:40.332495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9145525-3cd0-4361-b530-029490704a1b req-38a8949a-0aa7-4606-87b0-b6a1cd39be90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:40.341958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-38a8949a-0aa7-4606-87b0-b6a1cd39be90 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 1.2883334 Dec 21 03:53:40.354568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:40.376265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4858cbd9-daac-42de-ad13-37fa4656259b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:40.376265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:40.491374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-7740bb82-68ec-4dab-bf58-21145a25af71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:40.495178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-7740bb82-68ec-4dab-bf58-21145a25af71 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 1096 time: 0.1117022 Dec 21 03:53:40.501744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:40.719808 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-4fdd0b55-cbbb-470c-a181-3f7cb6461ead service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2122016 Dec 21 03:53:40.732250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Port': ['ID=4e29927d-6c29-4e93-93d1-9d8ceb2f02b2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:40.761230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-b3fe007e-92cf-4d73-bf48-5110adbdd846 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:40.764891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-b3fe007e-92cf-4d73-bf48-5110adbdd846 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.2617822 Dec 21 03:53:40.785525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-400c350c-09a8-405b-9351-3ea0001a2903 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82 HTTP/1.1" status: 200 len: 1001 time: 0.7739384 Dec 21 03:53:40.823826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-8d72116b-39ff-47bd-98cd-9f6321b5670b service neutron] 10.222.0.18 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.5661407 Dec 21 03:53:40.841864 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-af4514d2-a642-4fb7-ba4c-02c5f8f61135 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=da1bad89-a5fb-446c-af44-dde02dbd5709 HTTP/1.1" status: 200 len: 217 time: 0.0688276 Dec 21 03:53:40.843637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb8ba493-d1f7-4a03-bb4b-db2e7e59d5d0 None None] Network d1484879-37d9-4f9a-af8f-2069eaa33d17 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:40.865163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-08a6146c-9262-47fb-a277-ef7ffa7a4d8d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:40.866742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-08a6146c-9262-47fb-a277-ef7ffa7a4d8d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 818 time: 1.7138622 Dec 21 03:53:40.928461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Request body: {'port': {'device_id': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'admin_state_up': True, 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:40.931045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-79f7de23-bc94-4feb-8e4f-f7ab2dd1bb9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:40.932722 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-79f7de23-bc94-4feb-8e4f-f7ab2dd1bb9b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.0806887 Dec 21 03:53:40.934869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Provisioning complete for port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:40.935339 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:40.945011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b282a2-e24c-4bbf-80c9-7a129696d7ef req-0976d560-3ac7-4a77-b720-f5f9095d48ae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:40.946645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1b282a2-e24c-4bbf-80c9-7a129696d7ef req-0976d560-3ac7-4a77-b720-f5f9095d48ae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 944 time: 0.6254194 Dec 21 03:53:40.988252 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-eb3dc078-92d5-4723-b0af-0abb83da0ca1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0458798 Dec 21 03:53:41.086054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30117ac4-0d06-4963-8358-6d8caf8e2fa9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:41.174479 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.251146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:41.251146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.257717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-9c799158-abee-4ba0-9356-c8637f5d3a82 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2610562 Dec 21 03:53:41.276225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] For port 30117ac4-0d06-4963-8358-6d8caf8e2fa9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30117ac4-0d06-4963-8358-6d8caf8e2fa9,segment=NetworkSegment(afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2),segment_id=afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:41.351970 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.353586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-8592fe01-9635-4645-8da4-a9a4b2ee05d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:41.356763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-8592fe01-9635-4645-8da4-a9a4b2ee05d1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7 HTTP/1.1" status: 200 len: 850 time: 0.5446472 Dec 21 03:53:41.400091 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.472672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Provisioning complete for port 4e29927d-6c29-4e93-93d1-9d8ceb2f02b2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:41.473053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.526467 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a00a2c26-87e2-4321-a14d-db0c804e1bdf req-a4f156f6-43e9-4659-be64-b23a2837ddcf service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2585819 Dec 21 03:53:41.589929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Port 4e29927d-6c29-4e93-93d1-9d8ceb2f02b2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:41.614751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d3405c9-2b6a-4397-944f-9f8e9f9b55ee None None] Pushing event updated for resources: {'Port': ['ID=30117ac4-0d06-4963-8358-6d8caf8e2fa9,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:41.626618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:53:41.627226 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:53:41.638424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.642098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-9de652e7-a230-47bc-94f3-46fcd3dc9381 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8996484 Dec 21 03:53:41.671012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1b282a2-e24c-4bbf-80c9-7a129696d7ef req-d0875254-2b8f-498f-9b81-558957f85716 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6063187 Dec 21 03:53:41.691403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-de8fcaaf-a9b5-4fb7-86fc-89a660064f28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:41.693052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-de8fcaaf-a9b5-4fb7-86fc-89a660064f28 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a4370ec5-c219-4c56-a17c-433f7c352683&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3193614 Dec 21 03:53:41.709218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-aec5501a-9087-4828-9156-ec463d995404 None None] Provisioning complete for port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:41.709694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aec5501a-9087-4828-9156-ec463d995404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:41.875728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3449286e-c572-4695-8f0d-71db1344bb0f req-efd3c422-1651-4a7a-943e-532265f66788 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 210 time: 0.1290894 Dec 21 03:53:42.024211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9145525-3cd0-4361-b530-029490704a1b req-9789824a-7d62-44ba-9951-280f7db8e4c0 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3521237 Dec 21 03:53:42.058550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-9627124d-1384-4ec8-bed2-80be0e32b272 service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3308148 Dec 21 03:53:42.186688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 396f6baa-46b9-4358-9644-14bb8ef20cc4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:42.238991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 396f6baa-46b9-4358-9644-14bb8ef20cc4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:42.285537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.285823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4c7e68c-1c50-4ad7-9a04-c2232daad24c req-236b97d5-376c-44d7-b12a-cbfbe8868bac service neutron] 10.222.0.31 "GET /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1824558 Dec 21 03:53:42.294848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.325718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.363439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 396f6baa-46b9-4358-9644-14bb8ef20cc4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=396f6baa-46b9-4358-9644-14bb8ef20cc4,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:42.468805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Made reservation on behalf of 811cd4c8ce3c40c69d5b84fba08dd2ce for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:42.472508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.631417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Allocated IP 172.20.0.8 (fdf5929d-4a6d-4141-a192-66db327cd55e/6a24f048-2859-4842-aab3-8ca7a2232eab/38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:42.776006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.784744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.893362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.912463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Port': ['ID=4e29927d-6c29-4e93-93d1-9d8ceb2f02b2,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:42.927209 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:42.927960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=396f6baa-46b9-4358-9644-14bb8ef20cc4,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:42.966252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a48b26-facc-4131-aa39-66f71e220b91 req-cd21a78c-0671-4e4c-9044-7a8b860e8a81 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:42.967784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40a48b26-facc-4131-aa39-66f71e220b91 req-cd21a78c-0671-4e4c-9044-7a8b860e8a81 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 944 time: 0.1337214 Dec 21 03:53:42.987589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30117ac4-0d06-4963-8358-6d8caf8e2fa9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:43.049788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:43.050162 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.086439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70cd9a9a-1267-4c87-88b2-494e0e85baaf req-df3f1422-49dc-44f9-98dc-b0c22e3c8007 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 210 time: 0.0452971 Dec 21 03:53:43.115965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40a48b26-facc-4131-aa39-66f71e220b91 req-a282f98a-3f79-410b-b1fa-2f07965e3d93 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1376293 Dec 21 03:53:43.122413 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.143332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:43.174442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:43.205391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Network fdf5929d-4a6d-4141-a192-66db327cd55e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:43.212112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:43.245602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Pushing event updated for resources: {'Port': ['ID=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:43.248238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:43.553257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e3972183-9201-4a6f-9903-04d9d9d58f05 None None] Provisioning complete for port 4e29927d-6c29-4e93-93d1-9d8ceb2f02b2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:43.553864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e3972183-9201-4a6f-9903-04d9d9d58f05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.604418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e3972183-9201-4a6f-9903-04d9d9d58f05 None None] Port 4e29927d-6c29-4e93-93d1-9d8ceb2f02b2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:43.682084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:43.682721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.747670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56556) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:43.766447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-6ee1ca3f-ccdd-4d26-b593-f9641e5ff912 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8498945 Dec 21 03:53:43.791267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Request body: {'port': {'device_id': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:43.795934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Router 7416b908-2252-46fd-94c1-42082daa574b is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:53:43.875073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ebed484-2a00-40bc-854e-da29d7dce33b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.925410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.952908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ebed484-2a00-40bc-854e-da29d7dce33b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:43.971203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:43.979879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5c9b9f99-f829-4fe4-bb93-9de91ff9aac0 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.9844720 Dec 21 03:53:43.980279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56562) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:43.981655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] Sync routers for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:43.995715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:43.996394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:44.030312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:44.039729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:44.040581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:44.096537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:44.097384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df380427-12c7-43b3-bce7-2d6c1e733914 None None] The sync data for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:44.108876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ebed484-2a00-40bc-854e-da29d7dce33b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.197881 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ebed484-2a00-40bc-854e-da29d7dce33b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=57658308df724b50a408807de8134dbb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4485707 Dec 21 03:53:44.198211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56568) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:44.206426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebed484-2a00-40bc-854e-da29d7dce33b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ce65667-ee6e-4776-91d0-6a2449541c7b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:44.306869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1162f635-4944-4406-9382-732690e52040 req-1bd97a01-db73-4968-aa9d-a56dd1703527 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 210 time: 0.0656414 Dec 21 03:53:44.428774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6cbe06fa-b737-4e29-8e5e-ad710d000ebe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.450565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:44.453290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:53:44.479268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942cc3a3-31f0-4a53-a2f8-cdd15e48d2fc req-786bfa13-69c3-4def-9d50-ad856dec2b57 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:44.481269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-942cc3a3-31f0-4a53-a2f8-cdd15e48d2fc req-786bfa13-69c3-4def-9d50-ad856dec2b57 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 944 time: 0.2026732 Dec 21 03:53:44.526515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.539715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Transition to ACTIVE for port object 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:53:44.546730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6cbe06fa-b737-4e29-8e5e-ad710d000ebe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.595503 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-b4e28b01-9c7b-4dca-9da5-90629087e16d tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 03:53:44.598766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b4e28b01-9c7b-4dca-9da5-90629087e16d tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.6171770 Dec 21 03:53:44.601671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56572) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:44.625447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.628632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:44.666450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'mac_address': 'fa:16:3e:a4:67:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:53:44.717087 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.733115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da1bad89-a5fb-446c-af44-dde02dbd5709 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:44.755169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-3ccc06ac-c646-41b5-ab7c-8ac7dc2df764 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:44.756683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-3ccc06ac-c646-41b5-ab7c-8ac7dc2df764 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.54 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 818 time: 0.3730218 Dec 21 03:53:44.757936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:44.774571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-942cc3a3-31f0-4a53-a2f8-cdd15e48d2fc req-00fa362b-8dbc-4f2c-8bac-c39cf7f3e107 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2336285 Dec 21 03:53:44.813059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Pushing event updated for resources: {'Port': ['ID=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:44.813739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6cbe06fa-b737-4e29-8e5e-ad710d000ebe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.817085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6cbe06fa-b737-4e29-8e5e-ad710d000ebe admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.818446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6cbe06fa-b737-4e29-8e5e-ad710d000ebe admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0ce65667-ee6e-4776-91d0-6a2449541c7b HTTP/1.1" status: 204 len: 168 time: 0.6182175 Dec 21 03:53:44.825819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Request body: {'port': {'device_id': '75442211-1ded-4d5a-8085-f754879d03c7', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'admin_state_up': True, 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:44.852687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:44.954150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbe06fa-b737-4e29-8e5e-ad710d000ebe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ce65667-ee6e-4776-91d0-6a2449541c7b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:44.959795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:44.968847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 396f6baa-46b9-4358-9644-14bb8ef20cc4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:45.052111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Attempting to bind port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:45.053773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 396f6baa-46b9-4358-9644-14bb8ef20cc4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:45.053903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Attempting to bind port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:45.054006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.054092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Attempting to bind port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a on network fdf5929d-4a6d-4141-a192-66db327cd55e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:45.061782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a on network fdf5929d-4a6d-4141-a192-66db327cd55e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:53:45.062118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Attempting to bind port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a on network fdf5929d-4a6d-4141-a192-66db327cd55e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:45.069753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:45.070102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Checking segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:45.070500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Bound using segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:45.071769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Bound port: 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:45.072147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.173999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] For port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:45.177434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] For port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:45.196026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.246818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.260730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Made reservation on behalf of 811cd4c8ce3c40c69d5b84fba08dd2ce for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:45.263462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['da1bad89-a5fb-446c-af44-dde02dbd5709'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:45.264305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.305500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:45.306128 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.308122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] 10.222.0.31 "PUT /v2.0/ports/38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 1092 time: 1.5218999 Dec 21 03:53:45.308603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'tag': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:45.310905 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-148f8122-d563-4298-80c8-51d1a0a7e583" -d '{"events": [{"name": "network-changed", "server_uuid": "6f2192b8-7c6e-420f-93a8-57849ce29b3f", "tag": "38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:45.445987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955f6d1f-96e1-433e-b2a5-e08a28994150 service neutron] Pushing event updated for resources: {'Port': ['ID=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:45.460857 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a25fe631-bffb-40f9-91f0-2aabe325bb4a x-openstack-request-id: req-a25fe631-bffb-40f9-91f0-2aabe325bb4a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:45.461272 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6f2192b8-7c6e-420f-93a8-57849ce29b3f", "tag": "38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:45.461423 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a25fe631-bffb-40f9-91f0-2aabe325bb4a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:45.462166 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'tag': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a', 'status': 'completed', 'code': 200} Dec 21 03:53:45.519895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38343c91-1578-4aa9-95d8-a5741917042b req-11c43462-c2aa-4bba-8923-9d18cb9de64c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 210 time: 0.0279009 Dec 21 03:53:45.606967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-9f6492cb-4a65-4911-8cc9-857f79d10376 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:45.608536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-9f6492cb-4a65-4911-8cc9-857f79d10376 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1095 time: 0.1331775 Dec 21 03:53:45.650551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Allocated IP 172.20.0.9 (fdf5929d-4a6d-4141-a192-66db327cd55e/6a24f048-2859-4842-aab3-8ca7a2232eab/06503167-02c9-4376-803a-36730accf460) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:45.708121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-cdd0f37d-28b6-4627-90d7-b5f2654de8df service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0747459 Dec 21 03:53:45.712347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Deleting port 4e29927d-6c29-4e93-93d1-9d8ceb2f02b2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:45.713412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.792452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-970a42d1-a11d-48a2-b2b7-01962422d834 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:45.794051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-970a42d1-a11d-48a2-b2b7-01962422d834 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.0778029 Dec 21 03:53:45.804025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:45.829496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Calling delete_port for 4e29927d-6c29-4e93-93d1-9d8ceb2f02b2 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:45.873000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-02969cba-3c8e-4e25-bd84-4c2b993a8ef9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0589523 Dec 21 03:53:46.036907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7af226-10ce-463f-a0e4-289d80aaa451 req-64fa8e92-78ab-47bc-95d5-59326dd9960c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:46.038450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a7af226-10ce-463f-a0e4-289d80aaa451 req-64fa8e92-78ab-47bc-95d5-59326dd9960c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 945 time: 0.1582158 Dec 21 03:53:46.044990 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.098213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-0d8028cc-7520-4104-aaa4-31606e98cdab service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2125146 Dec 21 03:53:46.152110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a7af226-10ce-463f-a0e4-289d80aaa451 req-d928cf08-7f22-4529-9836-63f57464c8f5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039770 Dec 21 03:53:46.183423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.224865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e1fb299-d9bf-4380-a95f-4b171e6d4229 req-985e8b00-8f07-4d5b-897e-098ae93ba30c service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1135731 Dec 21 03:53:46.234315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Port': ['ID=4e29927d-6c29-4e93-93d1-9d8ceb2f02b2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:46.270265 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.270970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.271319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.271664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.272007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.272892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.273233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.273560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.273904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.274229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.274554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.274877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.275229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.276169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:46.313897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56624) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:46.356170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Network fdf5929d-4a6d-4141-a192-66db327cd55e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:46.358158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:46.367518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:46.438636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:46.439563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.441042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.471437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:46.497641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Request body: {'network': {'name': 'tempest-ServerRescueTestJSON-34383565-network', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:46.499839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Pushing event updated for resources: {'Port': ['ID=06503167-02c9-4376-803a-36730accf460,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:46.533675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-94b96638-b505-4ee9-970a-13fd72c5979a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:46.535688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-94b96638-b505-4ee9-970a-13fd72c5979a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1095 time: 0.0838792 Dec 21 03:53:46.540411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-27fcdba5-4432-43f7-95d7-a2dac7979b90 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7318475 Dec 21 03:53:46.577701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Request body: {'port': {'device_id': '75442211-1ded-4d5a-8085-f754879d03c7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:46.616607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port da1bad89-a5fb-446c-af44-dde02dbd5709 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:53:46.623364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port da1bad89-a5fb-446c-af44-dde02dbd5709 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:46.623737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.678215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.730978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.762512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:46.765253 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5cc20193-178e-4e77-ad3b-fa4a3e25c45d" -d '{"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-plugged", "status": "completed", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:46.775928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69935a80-8223-414f-ad1d-40d987a63391 req-274c7107-2dd2-4fac-89c1-2bdebf6d6168 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:46.777541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69935a80-8223-414f-ad1d-40d987a63391 req-274c7107-2dd2-4fac-89c1-2bdebf6d6168 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 931 time: 0.1311872 Dec 21 03:53:46.781329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:46.821983 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f5c12ce-8eaf-4e8a-8cb7-6728c5e320a5 x-openstack-request-id: req-8f5c12ce-8eaf-4e8a-8cb7-6728c5e320a5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:46.823278 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-plugged", "status": "completed", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:46.823835 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8f5c12ce-8eaf-4e8a-8cb7-6728c5e320a5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:46.824440 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'code': 200} Dec 21 03:53:46.844702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69935a80-8223-414f-ad1d-40d987a63391 req-eb52b62b-a07b-4ced-9483-3112e4d9a307 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528371 Dec 21 03:53:46.863385 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:46.957464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-9d50960d-066e-4657-bfb7-6f2906064f03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:46.959091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-9d50960d-066e-4657-bfb7-6f2906064f03 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.4159317 Dec 21 03:53:46.992833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:47.066166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-b270826c-e9c6-478d-a940-9017dfadb7eb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0438409 Dec 21 03:53:47.076867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Router 7416b908-2252-46fd-94c1-42082daa574b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:47.080706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Made reservation on behalf of 0eca6fe3fe274d1abd1d5ce62d18e44d for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:47.083158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.094848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.155534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5e55a7-cc3e-4448-ae8e-d733b09e7920 req-dcde3e1b-581c-4954-a87b-304674a0e729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:47.157060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f5e55a7-cc3e-4448-ae8e-d733b09e7920 req-dcde3e1b-581c-4954-a87b-304674a0e729 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 1098 time: 0.1663754 Dec 21 03:53:47.191239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:47.201815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b754850-4ca5-4b73-9714-c71e6402d90e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5987492 Dec 21 03:53:47.204363 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] Sync routers for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:47.205845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56642) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:47.216324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f5e55a7-cc3e-4448-ae8e-d733b09e7920 req-95110bb2-12a9-493a-ae24-e394a782c9e1 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511310 Dec 21 03:53:47.223563 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:47.224195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-8ae8fd57-38da-4533-ae98-be57073f146a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:47.224610 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:47.225669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-8ae8fd57-38da-4533-ae98-be57073f146a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.1467192 Dec 21 03:53:47.253689 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-6b1b5281-5639-4d3f-b026-6aa7a54ca233 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] delete failed (client error): The resource could not be found. Dec 21 03:53:47.262789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b1b5281-5639-4d3f-b026-6aa7a54ca233 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/routers/tempest-non_exist_router-1592091678 HTTP/1.1" status: 404 len: 335 time: 0.0555933 Dec 21 03:53:47.264892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56644) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:47.269812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2d5b0a00-2a85-4d88-a776-9c8ead8331c9 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'router': {'external_gateway_info': {'network_id': '7416b908-2252-46fd-94c1-42082daa574b'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:47.301454 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:47.310961 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:47.311882 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:47.316530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 06503167-02c9-4376-803a-36730accf460 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:47.325480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.339736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Transition to ACTIVE for port object 06503167-02c9-4376-803a-36730accf460 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:53:47.349117 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:47.350061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fff36f5f-9fd9-4c7f-bc13-fb1ebfe4673f None None] The sync data for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:47.363554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.394720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fc67f8-3df5-4a15-a483-e910637c59ec req-bac8e091-7370-4729-899a-17b2ee99c8b6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:47.396587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fc67f8-3df5-4a15-a483-e910637c59ec req-bac8e091-7370-4729-899a-17b2ee99c8b6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0551994 Dec 21 03:53:47.413073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.469541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.484784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:53:47.491375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Pushing event updated for resources: {'Port': ['ID=06503167-02c9-4376-803a-36730accf460,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:47.501660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fc67f8-3df5-4a15-a483-e910637c59ec req-17e877f4-19ee-4288-8b97-5a7d98b0fc2d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958045 Dec 21 03:53:47.508773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.509175 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Added segment 3daad6e7-a55c-43a2-addf-68e15a0b841f of type vlan for network ee3304b6-e18e-45c8-93c6-239041d697ca Dec 21 03:53:47.574401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-aa0bd09b-a396-44b4-b109-ae10dca457be service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0366583 Dec 21 03:53:47.627882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Attempting to bind port 06503167-02c9-4376-803a-36730accf460 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:47.628239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Attempting to bind port 06503167-02c9-4376-803a-36730accf460 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:47.628577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Attempting to bind port 06503167-02c9-4376-803a-36730accf460 on network fdf5929d-4a6d-4141-a192-66db327cd55e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:47.648147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=399c538d-6c76-4c14-93bc-cec9279ae868,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:47.656157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d5b0a00-2a85-4d88-a776-9c8ead8331c9 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.664285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Port 06503167-02c9-4376-803a-36730accf460 on network fdf5929d-4a6d-4141-a192-66db327cd55e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:53:47.664665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Attempting to bind port 06503167-02c9-4376-803a-36730accf460 on network fdf5929d-4a6d-4141-a192-66db327cd55e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:47.673713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.673876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:47.676710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Checking segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:47.676710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Bound using segment: {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:47.676710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Bound port: 06503167-02c9-4376-803a-36730accf460, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '05af4aed-43f0-4344-9587-0a147eb02792', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:47.676710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.729460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-53874c2d-9026-4222-97e3-593053cb1bb8 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1432619 Dec 21 03:53:47.745178 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-2d5b0a00-2a85-4d88-a776-9c8ead8331c9 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] update failed (client error): The resource could not be found. Dec 21 03:53:47.749912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2d5b0a00-2a85-4d88-a776-9c8ead8331c9 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b HTTP/1.1" status: 404 len: 339 time: 0.4803572 Dec 21 03:53:47.750038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:47.784203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] For port 06503167-02c9-4376-803a-36730accf460, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:47.790924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.791846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:47.792428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.824103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] For port 06503167-02c9-4376-803a-36730accf460, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=06503167-02c9-4376-803a-36730accf460,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:47.851204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-148f8122-d563-4298-80c8-51d1a0a7e583 req-5b9aeb62-a061-4fd9-9256-c41be1397e8f service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1119933 Dec 21 03:53:47.885795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.906861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:47.907853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:47.909681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] 10.222.0.54 "PUT /v2.0/ports/06503167-02c9-4376-803a-36730accf460 HTTP/1.1" status: 200 len: 1092 time: 1.3388546 Dec 21 03:53:47.910556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75442211-1ded-4d5a-8085-f754879d03c7', 'tag': '06503167-02c9-4376-803a-36730accf460'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:47.913307 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-641c5dbe-b10f-413b-bef4-7d3c99084fce" -d '{"events": [{"name": "network-changed", "server_uuid": "75442211-1ded-4d5a-8085-f754879d03c7", "tag": "06503167-02c9-4376-803a-36730accf460"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:47.969482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e27e20-0ade-44f8-9449-f549cea3de04 service neutron] Pushing event updated for resources: {'Port': ['ID=06503167-02c9-4376-803a-36730accf460,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:47.973215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] Pushing event updated for resources: {'Network': ['ID=ee3304b6-e18e-45c8-93c6-239041d697ca,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:47.982769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-848d8b97-8f0c-4f13-af88-493bdcda636f admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.6653447 Dec 21 03:53:47.983498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56656) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:47.990099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Request body: {'subnet': {'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueTestJSON-34383565-subnet', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:48.000175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ee3304b6-e18e-45c8-93c6-239041d697ca details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:53:48.039017 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d114e2d-042e-4c1f-8e8d-9dc59ddbb7d1 x-openstack-request-id: req-2d114e2d-042e-4c1f-8e8d-9dc59ddbb7d1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:48.039195 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "75442211-1ded-4d5a-8085-f754879d03c7", "tag": "06503167-02c9-4376-803a-36730accf460", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:48.039490 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2d114e2d-042e-4c1f-8e8d-9dc59ddbb7d1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:48.039915 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75442211-1ded-4d5a-8085-f754879d03c7', 'tag': '06503167-02c9-4376-803a-36730accf460', 'status': 'completed', 'code': 200} Dec 21 03:53:48.125527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-8f94ab12-eeec-4009-aef2-89ce416854c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:48.129529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-8f94ab12-eeec-4009-aef2-89ce416854c1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 1095 time: 0.0729265 Dec 21 03:53:48.145799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fbd3186-0d66-4eff-ad06-73353b69a39c req-b3301a06-bbb4-41ba-ae1d-9c2259763da9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:48.147560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fbd3186-0d66-4eff-ad06-73353b69a39c req-b3301a06-bbb4-41ba-ae1d-9c2259763da9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 943 time: 0.1378276 Dec 21 03:53:48.173230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:48.177458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Made reservation on behalf of 0eca6fe3fe274d1abd1d5ce62d18e44d for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:53:48.180011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:48.206304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-d5777347-51fa-4bb9-ab9c-3ad7b451b1f6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=06503167-02c9-4376-803a-36730accf460 HTTP/1.1" status: 200 len: 217 time: 0.0576522 Dec 21 03:53:48.294621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fbd3186-0d66-4eff-ad06-73353b69a39c req-d49ff2f2-a8ec-46cf-b9cc-52c53f166d9d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1394963 Dec 21 03:53:48.304919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-b913331d-283d-4439-bf84-ce4edc163623 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:48.306376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-b913331d-283d-4439-bf84-ce4edc163623 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.0763228 Dec 21 03:53:48.355768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-b66517c0-f999-42bf-8b58-5e0af6aa4b37 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0389595 Dec 21 03:53:48.488307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-c98aae85-a9ac-47b7-bb46-4f98e179b7c3 service neutron] 10.222.0.54 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1175585 Dec 21 03:53:48.668846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Allocated IP 172.20.0.1 (23aa1b9b-2199-484a-83ef-4353021e7bec/1b5da811-7a04-4b7f-a181-33c63a1e5b63/9e78f57e-60a6-4551-9aa9-9aea0e21673d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:48.674589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9febdb68-3d78-4af3-b12f-d0a252772a02 req-0caf17ba-72df-4925-912b-c1aee3f573f4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:48.676345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9febdb68-3d78-4af3-b12f-d0a252772a02 req-0caf17ba-72df-4925-912b-c1aee3f573f4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0934784 Dec 21 03:53:48.680649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-992ebb03-8cf2-4a9c-97ba-7aec0878346f req-a46174e8-da97-4d45-9cd7-5b4a1c7bc38e service neutron] 10.222.0.54 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1809411 Dec 21 03:53:48.740316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9febdb68-3d78-4af3-b12f-d0a252772a02 req-2b9a0aff-2fa0-467f-8318-45acbbadddd5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533829 Dec 21 03:53:48.765007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:48.861403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b082405b-1cdc-4188-a989-d408accdc4d2,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:48.888998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:48.902354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Checking segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:48.902716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Network hostable DHCP agents. Network: ee3304b6-e18e-45c8-93c6-239041d697ca, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:53:48.913183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-b1e8329e-c506-45d0-8b96-4a68e16ddf71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:48.914696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-b1e8329e-c506-45d0-8b96-4a68e16ddf71 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 1095 time: 0.0420220 Dec 21 03:53:49.008744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-e68c632c-5bc3-4e31-bb06-74d686a11368 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:49.010796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-e68c632c-5bc3-4e31-bb06-74d686a11368 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.0889864 Dec 21 03:53:49.046075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Network ee3304b6-e18e-45c8-93c6-239041d697ca is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:53:49.058222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-8f5bff4c-da97-4ec2-a9e2-fbce747a8c5b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=06503167-02c9-4376-803a-36730accf460 HTTP/1.1" status: 200 len: 217 time: 0.0389719 Dec 21 03:53:49.080706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.112080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-3dddc40d-3632-472d-9ce8-a7db9dc30c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:49.113573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-3dddc40d-3632-472d-9ce8-a7db9dc30c06 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.0480227 Dec 21 03:53:49.126738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network 23aa1b9b-2199-484a-83ef-4353021e7bec is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:49.129948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:49.135309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:49.148340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-fe7f829f-757a-472f-a570-2e1d15ec6704 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0264344 Dec 21 03:53:49.165608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Port': ['ID=9e78f57e-60a6-4551-9aa9-9aea0e21673d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:49.190790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ee3304b6-e18e-45c8-93c6-239041d697ca) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:49.199355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-049986b1-b348-42c5-b2e9-7adfa7d231bb None None] Network ee3304b6-e18e-45c8-93c6-239041d697ca requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:49.202719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:49.204248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.215945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.280201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-54c5c76a-965b-4870-8f3d-16987593da72 service neutron] 10.222.0.54 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237936 Dec 21 03:53:49.406315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-624dc8f2-5266-4910-b35b-e6180aadc728 None None] Network ee3304b6-e18e-45c8-93c6-239041d697ca requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:49.454225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-641c5dbe-b10f-413b-bef4-7d3c99084fce req-ef2590b9-b2e3-4381-9f1c-8e001e380372 service neutron] 10.222.0.54 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1662397 Dec 21 03:53:49.489967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54b14ab-3a5a-4ff4-9ec0-4c5b0b8c9e65 req-7e9c654b-4374-49a9-8bcd-7e1438cc3033 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:49.493697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9be9a58a-1a91-4cc9-9c87-0a42fd88b117 None None] Provisioning complete for port 9e78f57e-60a6-4551-9aa9-9aea0e21673d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:49.494014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9be9a58a-1a91-4cc9-9c87-0a42fd88b117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.494716 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-72eabf36-42f8-4d6d-86a1-ced637b86146 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.5100737 Dec 21 03:53:49.497874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a54b14ab-3a5a-4ff4-9ec0-4c5b0b8c9e65 req-7e9c654b-4374-49a9-8bcd-7e1438cc3033 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 943 time: 0.0972619 Dec 21 03:53:49.499280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:49.503653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Request body: {'router': {'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:49.545566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a54b14ab-3a5a-4ff4-9ec0-4c5b0b8c9e65 req-8e28c17a-39e0-4686-8a3a-ce4741cd6987 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467336 Dec 21 03:53:49.572081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9be9a58a-1a91-4cc9-9c87-0a42fd88b117 None None] Port 9e78f57e-60a6-4551-9aa9-9aea0e21673d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:49.594306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.684980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.686023 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.787129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.840048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af01bf97-96c4-48a5-97aa-3aeace744d24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:49.869958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95177968-b1e6-41e3-ae18-1924d8d8d2ae req-8c85491c-1b8e-4b07-a221-f3a93d79d4c1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:49.871777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95177968-b1e6-41e3-ae18-1924d8d8d2ae req-8c85491c-1b8e-4b07-a221-f3a93d79d4c1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0541599 Dec 21 03:53:49.922856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95177968-b1e6-41e3-ae18-1924d8d8d2ae req-ecf2d1ee-56c0-4e84-8ad3-f912913ef2b3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440383 Dec 21 03:53:49.989740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.057815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.068655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.144410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.146963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event updated for resources: {'Port': ['ID=9e78f57e-60a6-4551-9aa9-9aea0e21673d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:50.296752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Network 23aa1b9b-2199-484a-83ef-4353021e7bec is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:50.299368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:50.428467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Router 7416b908-2252-46fd-94c1-42082daa574b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:50.501898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:53:50.638973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-50bfb5c0-14fc-46b3-b619-af696970b1d3 None None] Provisioning complete for port 9e78f57e-60a6-4551-9aa9-9aea0e21673d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:50.639633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50bfb5c0-14fc-46b3-b619-af696970b1d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.667551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:50.691207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-50bfb5c0-14fc-46b3-b619-af696970b1d3 None None] Port 9e78f57e-60a6-4551-9aa9-9aea0e21673d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:50.703739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'port_id': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a', 'mac_address': 'fa:16:3e:dc:21:df', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:53:50.711348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47884547-bf6d-490c-b13c-c6f0c53b3c53 req-0d4d896d-d5bc-4db4-9d14-165827cb10f7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:50.718716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47884547-bf6d-490c-b13c-c6f0c53b3c53 req-0d4d896d-d5bc-4db4-9d14-165827cb10f7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 943 time: 0.0710223 Dec 21 03:53:50.751922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.769032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:50.784471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47884547-bf6d-490c-b13c-c6f0c53b3c53 req-bf99b04f-6eb3-4faf-88dc-10fa07103fcc tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595229 Dec 21 03:53:50.792928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:50.857209 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:50.873020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c630bb13-dd17-48db-9f9f-68f69bc4c2c9 req-c64809e7-fbe2-4457-bd8f-badec1ef5182 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:50.875103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c630bb13-dd17-48db-9f9f-68f69bc4c2c9 req-c64809e7-fbe2-4457-bd8f-badec1ef5182 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0700057 Dec 21 03:53:50.924818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:50.933606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.933965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.934363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.934761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.935130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.935519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.935992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.936328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.936663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.936777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c630bb13-dd17-48db-9f9f-68f69bc4c2c9 req-38b34c92-4780-409f-a476-6672d40e48c2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535686 Dec 21 03:53:50.937221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.937370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.937732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.938088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:50.994651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:51.002375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b598cc5-0c43-441a-aac3-1674edeb7347 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2511604 Dec 21 03:53:51.004896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56702) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:51.005031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] Sync routers for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:51.015507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.019055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:51.019913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:51.035844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.054044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:51.066401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:51.067298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:51.108139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:51.108802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdda91b0-eb69-4532-894d-cd1117b6ca10 None None] The sync data for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:51.137039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5dc7341-0434-43d6-8164-dd399980010e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.149264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Allocated IP 172.25.5.242 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:51.168388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:51.269063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.389665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.432076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:51.435165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:51.438926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:51.449545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c115bf4a-c464-49c0-a38e-7e16a21d8069 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:51.473507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Pushing event updated for resources: {'Port': ['ID=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:51.521052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-66615c38-3daf-44d8-9732-b7b47618aba6 None None] Provisioning complete for port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:51.522179 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66615c38-3daf-44d8-9732-b7b47618aba6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.549653 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-c5dc7341-0434-43d6-8164-dd399980010e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 21 03:53:51.554476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5dc7341-0434-43d6-8164-dd399980010e tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b HTTP/1.1" status: 409 len: 329 time: 0.5484488 Dec 21 03:53:51.555235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56708) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:51.566653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-66615c38-3daf-44d8-9732-b7b47618aba6 None None] Port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:51.832890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.918974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:51.995925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27cc9e3e-41c6-4f2f-b186-5114445adb91 req-7f7d2148-23b3-435d-b0fa-4dbfe2d4dca5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:51.997438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27cc9e3e-41c6-4f2f-b186-5114445adb91 req-7f7d2148-23b3-435d-b0fa-4dbfe2d4dca5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 943 time: 0.1338739 Dec 21 03:53:52.052640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.141431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27cc9e3e-41c6-4f2f-b186-5114445adb91 req-66c6af8e-10f7-4c5d-822b-0cf0fffcf77d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1347330 Dec 21 03:53:52.148912 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9cb2f10a-cd6e-4042-8aab-278007992cde None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.151065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a2fc42-70bf-4329-a37e-099a43831a3a req-e86c2dd5-b308-4b4e-bd4d-34e5fcea63b0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:52.152960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a2fc42-70bf-4329-a37e-099a43831a3a req-e86c2dd5-b308-4b4e-bd4d-34e5fcea63b0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1317654 Dec 21 03:53:52.215686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a2fc42-70bf-4329-a37e-099a43831a3a req-2ca3daec-2639-4817-9bb0-8966c223d7aa tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526056 Dec 21 03:53:52.262846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Router 08658061-802f-4cd3-bf36-1f9ac84208e7 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:53:52.302970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Deleting port 9e78f57e-60a6-4551-9aa9-9aea0e21673d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:52.303478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.368833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:52.379182 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Sync routers for ids ['08658061-802f-4cd3-bf36-1f9ac84208e7'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:52.390235 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Routers {'08658061-802f-4cd3-bf36-1f9ac84208e7'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:52.391016 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['08658061-802f-4cd3-bf36-1f9ac84208e7'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:52.405362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.415106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Calling delete_port for 9e78f57e-60a6-4551-9aa9-9aea0e21673d owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:52.487937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.489665 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-11ffb24e-f059-45ae-b0e3-1ab68786de0c admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.9891253 Dec 21 03:53:52.492667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56720) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:52.503303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:52.570868 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Set router 08658061-802f-4cd3-bf36-1f9ac84208e7 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:52.612505 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.664286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:53:52.669131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:52.669509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.731881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 06503167-02c9-4376-803a-36730accf460 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:53:52.756037 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:53:51Z', 'revision_number': 3, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:52.765916 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.787281 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Checking router: 08658061-802f-4cd3-bf36-1f9ac84208e7 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:52.788608 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Updating router 08658061-802f-4cd3-bf36-1f9ac84208e7 port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:53:52.820000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Port': ['ID=9e78f57e-60a6-4551-9aa9-9aea0e21673d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:52.826112 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.898281 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:52.928312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.928976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.929501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.933583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.934174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.934690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.935418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.935910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.936465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.936939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.937420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.937903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.938383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:52.952805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:52.956460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:52.961056 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81ccef31-f675-495c-88ae-243f109fba24" -d '{"events": [{"server_uuid": "6f2192b8-7c6e-420f-93a8-57849ce29b3f", "name": "network-vif-plugged", "status": "completed", "tag": "38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:53.016889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 06503167-02c9-4376-803a-36730accf460, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=06503167-02c9-4376-803a-36730accf460,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:53.049234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '06503167-02c9-4376-803a-36730accf460', 'network_id': 'fdf5929d-4a6d-4141-a192-66db327cd55e', 'port_id': '06503167-02c9-4376-803a-36730accf460', 'mac_address': 'fa:16:3e:21:fe:ab', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a24f048-2859-4842-aab3-8ca7a2232eab', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:53:53.059526 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2614e98b-9f66-499a-9e11-0636d28876b7 x-openstack-request-id: req-2614e98b-9f66-499a-9e11-0636d28876b7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:53.059830 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6f2192b8-7c6e-420f-93a8-57849ce29b3f", "name": "network-vif-plugged", "status": "completed", "tag": "38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:53.061972 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2614e98b-9f66-499a-9e11-0636d28876b7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:53.062527 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a', 'code': 200} Dec 21 03:53:53.158341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.236045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.348655 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.399629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.425588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e472b93b-e115-43ba-b6d0-fbe8b112f854 req-a5e6ea41-1949-475a-b797-707333229337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:53.427249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e472b93b-e115-43ba-b6d0-fbe8b112f854 req-a5e6ea41-1949-475a-b797-707333229337 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.2651041 Dec 21 03:53:53.443464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.475268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 06503167-02c9-4376-803a-36730accf460 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:53:53.475458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Allocated IP 172.20.0.1 (ee3304b6-e18e-45c8-93c6-239041d697ca/b082405b-1cdc-4188-a989-d408accdc4d2/3f22db30-4385-410e-ab0d-8f6c7358038f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:53:53.483559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:53.491691 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.508983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 06503167-02c9-4376-803a-36730accf460, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=06503167-02c9-4376-803a-36730accf460,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:53.521147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.544300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573dff21-a1fd-4d10-9860-20959d6c5811 req-decd9762-90b6-4a56-b0bd-e2c20208a343 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:53.545348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-573dff21-a1fd-4d10-9860-20959d6c5811 req-decd9762-90b6-4a56-b0bd-e2c20208a343 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 943 time: 0.2172482 Dec 21 03:53:53.556983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07511a2f-c025-46c8-a4e7-b8ba4b11e7fd None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:53.559163 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Pushing event updated for resources: {'Port': ['ID=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:53.560767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7398706f-a5ec-45e1-9fe0-119f9e98e4f4 req-ad9e4fab-1d9f-4a96-8366-6ee15b8fbe25 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:53.567682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7398706f-a5ec-45e1-9fe0-119f9e98e4f4 req-ad9e4fab-1d9f-4a96-8366-6ee15b8fbe25 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1959653 Dec 21 03:53:53.571040 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.571562 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.572619 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.573151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.573752 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.574389 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.575092 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.575648 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.576147 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.576659 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.577153 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.578361 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.578872 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:53:53.583952 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Attempting to bind port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:53.585000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Attempting to bind port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:53.585368 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Attempting to bind port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:53.592025 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:53.592389 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:53.595094 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.595094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:53.595094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Bound port: d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:53.595094 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.619751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.620204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-494f6345-c7f6-44f4-8473-19986e55ecb5 None None] Provisioning complete for port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:53.620614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-494f6345-c7f6-44f4-8473-19986e55ecb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.625999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.634260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Router 7416b908-2252-46fd-94c1-42082daa574b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:53.649916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e472b93b-e115-43ba-b6d0-fbe8b112f854 req-9e045732-c45f-4606-b374-0db7ce53ae4f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2112176 Dec 21 03:53:53.655584 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] For port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:53.659166 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] For port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:53.694386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-573dff21-a1fd-4d10-9860-20959d6c5811 req-a433098c-0c15-476c-b0d1-91b9a009f77d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153641 Dec 21 03:53:53.698831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7398706f-a5ec-45e1-9fe0-119f9e98e4f4 req-cead977a-16ad-4e50-ac18-3d46a1dd4dc3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1301830 Dec 21 03:53:53.724476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-494f6345-c7f6-44f4-8473-19986e55ecb5 None None] Port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:53:53.732133 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.736769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=06503167-02c9-4376-803a-36730accf460,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:53.773876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.787452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d555ca37-953e-4407-8b89-d213bc511339 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:53.788908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:53.801965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1edd34d4-b34f-4e7b-996d-8fba51535edd tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2456379 Dec 21 03:53:53.805062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] Sync routers for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:53.805802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56740) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:53.808897 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Routers {'08658061-802f-4cd3-bf36-1f9ac84208e7'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:53.809881 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['08658061-802f-4cd3-bf36-1f9ac84208e7'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:53.831779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:53.832431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:53.849178 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4921d4ba-eccf-4873-a71f-079ed7d06b70 None None] Pushing event updated for resources: {'Port': ['ID=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:53.861168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Pushing event updated for resources: {'Port': ['ID=3f22db30-4385-410e-ab0d-8f6c7358038f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:53.864206 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-44ffa214-d72f-4cea-a67d-bcac62669b90 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] show failed (client error): The resource could not be found. Dec 21 03:53:53.869220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-44ffa214-d72f-4cea-a67d-bcac62669b90 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "GET /v2.0/routers/tempest-non_exist_router-1021012189 HTTP/1.1" status: 404 len: 335 time: 0.0583649 Dec 21 03:53:53.869987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56742) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:53.877836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7d1ac355-74cf-46b2-9b82-6e4dbe3a749b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Request body: {'router': {'name': 'new_name'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:53:53.878097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Network ee3304b6-e18e-45c8-93c6-239041d697ca is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:53.880534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:53.883363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:53:53.897800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:53.923130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] Routers {'7416b908-2252-46fd-94c1-42082daa574b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:53.923769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7416b908-2252-46fd-94c1-42082daa574b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:53.925486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-542539af-3a6d-4592-81a5-3bcbe3cd8a7f None None] Provisioning complete for port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:53.925859 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-542539af-3a6d-4592-81a5-3bcbe3cd8a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.935621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:53.950194 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-7d1ac355-74cf-46b2-9b82-6e4dbe3a749b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] update failed (client error): The resource could not be found. Dec 21 03:53:53.951980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7d1ac355-74cf-46b2-9b82-6e4dbe3a749b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "PUT /v2.0/routers/tempest-non_exist_router-1076951544 HTTP/1.1" status: 404 len: 335 time: 0.0812454 Dec 21 03:53:53.957645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56744) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:53.975141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] Set router 08658061-802f-4cd3-bf36-1f9ac84208e7 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:54.013720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:54.014397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd95d90c-02b5-4707-82f5-8839f91d225a None None] The sync data for ids ['7416b908-2252-46fd-94c1-42082daa574b'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:54.038600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Deleting subnet b818df02-18a4-447b-a2e2-5be4c2e45770 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:54.047304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.066345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['06503167-02c9-4376-803a-36730accf460'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:53:54.097170 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-542539af-3a6d-4592-81a5-3bcbe3cd8a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.113309 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.132989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-542539af-3a6d-4592-81a5-3bcbe3cd8a7f None None] For port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:54.174261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.211274 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:53:51Z', 'revision_number': 3, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:54.215572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.237070 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-542539af-3a6d-4592-81a5-3bcbe3cd8a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.242241 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb46d424-dd2e-47af-bc5e-d6642b880351 None None] The sync data for ids ['08658061-802f-4cd3-bf36-1f9ac84208e7'] in n-d-822053-11 is: [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:53:51Z', 'revision_number': 3, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:54.311385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-542539af-3a6d-4592-81a5-3bcbe3cd8a7f None None] Pushing event updated for resources: {'Port': ['ID=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:54.373393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.411271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.455403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Subnet': ['ID=b818df02-18a4-447b-a2e2-5be4c2e45770,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:54.455403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.455403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c345d86a-58a3-42e5-bb2c-26f7d325f460 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/subnets/b818df02-18a4-447b-a2e2-5be4c2e45770 HTTP/1.1" status: 204 len: 168 time: 0.4966004 Dec 21 03:53:54.455624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56748) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:54.455698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2251dcf-784e-42f5-a387-321a8590bd33 None None] Network d1484879-37d9-4f9a-af8f-2069eaa33d17 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:54.526451 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.595538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Deleting subnet 58798355-0108-46e5-ba91-8cab1b43eb71 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:54.603971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.649744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.654599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Pushing event updated for resources: {'Port': ['ID=3f22db30-4385-410e-ab0d-8f6c7358038f,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:54.677739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] DHCP port deletion for d1484879-37d9-4f9a-af8f-2069eaa33d17 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:54.696334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.755244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] Deleting port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:54.755961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.861784 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.919950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Network ee3304b6-e18e-45c8-93c6-239041d697ca is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:53:54.923018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:53:54.932796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] For port 30117ac4-0d06-4963-8358-6d8caf8e2fa9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30117ac4-0d06-4963-8358-6d8caf8e2fa9,segment=NetworkSegment(afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2),segment_id=afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:54.933200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:54.964813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] Calling delete_port for 30117ac4-0d06-4963-8358-6d8caf8e2fa9 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:55.023670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75295cb-4f55-4e95-905c-673a77e3c7ec req-08d2c20d-7762-447f-aa3f-f01ea0fb9d7f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:55.039133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.044657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d75295cb-4f55-4e95-905c-673a77e3c7ec req-08d2c20d-7762-447f-aa3f-f01ea0fb9d7f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.2145791 Dec 21 03:53:55.060809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6609edf0-9a7f-4b08-b914-727c5299d4f5 req-ceff4568-80c3-4814-9028-f4d6ff79b5b3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:55.070100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.071539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6609edf0-9a7f-4b08-b914-727c5299d4f5 req-ceff4568-80c3-4814-9028-f4d6ff79b5b3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 944 time: 0.1895032 Dec 21 03:53:55.155725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:55.199828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Router 08658061-802f-4cd3-bf36-1f9ac84208e7 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:53:55.215663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d75295cb-4f55-4e95-905c-673a77e3c7ec req-84fdff16-e913-4049-84f1-f03cee712754 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1206527 Dec 21 03:53:55.220732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6609edf0-9a7f-4b08-b914-727c5299d4f5 req-12596d19-cc13-4188-ad11-87a60772b24e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1468911 Dec 21 03:53:55.228467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:55.228843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.271057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.301525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] Pushing event deleted for resources: {'Port': ['ID=30117ac4-0d06-4963-8358-6d8caf8e2fa9,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:55.306844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b2ae795-afb3-4bde-9c05-8b0f54786150 None None] No DVR routers for this DVR port 30117ac4-0d06-4963-8358-6d8caf8e2fa9 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:55.323204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.385323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Subnet': ['ID=58798355-0108-46e5-ba91-8cab1b43eb71,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:55.394978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.398491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4693231-5b9c-44c3-8bd4-1cbd5c129cd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/subnets/58798355-0108-46e5-ba91-8cab1b43eb71 HTTP/1.1" status: 204 len: 168 time: 0.9408772 Dec 21 03:53:55.402799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:55.409345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f08f23f-d63a-4f4e-9a9e-f67897d714ae None None] Network 19ab220e-df22-4e71-9fd5-879c729fcbc6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:55.454991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30117ac4-0d06-4963-8358-6d8caf8e2fa9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:55.505996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 30117ac4-0d06-4963-8358-6d8caf8e2fa9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:55.506346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30117ac4-0d06-4963-8358-6d8caf8e2fa9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:55.532294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.539777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:53:55.545836 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc272609-c997-4b12-a7c1-960ba6ff95c8 admin admin] 10.222.0.18 "PUT /v2.0/routers/08658061-802f-4cd3-bf36-1f9ac84208e7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0511100 Dec 21 03:53:55.631971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-783a8290-ade0-475a-88e1-df5211137863 None None] DHCP port deletion for 19ab220e-df22-4e71-9fd5-879c729fcbc6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:55.650432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.672676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d1484879-37d9-4f9a-af8f-2069eaa33d17']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:55.684220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-783a8290-ade0-475a-88e1-df5211137863 None None] Deleting port 4858cbd9-daac-42de-ad13-37fa4656259b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:55.684884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-783a8290-ade0-475a-88e1-df5211137863 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.689299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:55.689891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'afd7a6c2-7c70-41e3-bbc0-6d686b0dffa2') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:55.703814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.724181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.732199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:55.732847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:55.738985 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:55.767574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-783a8290-ade0-475a-88e1-df5211137863 None None] For port 4858cbd9-daac-42de-ad13-37fa4656259b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4858cbd9-daac-42de-ad13-37fa4656259b,segment=NetworkSegment(d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1),segment_id=d5bbd3d3-3eaa-448c-95b0-9c78d8d798e1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:55.767975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-783a8290-ade0-475a-88e1-df5211137863 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.770700 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.784620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-783a8290-ade0-475a-88e1-df5211137863 None None] Calling delete_port for 4858cbd9-daac-42de-ad13-37fa4656259b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:55.926331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.932187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:55.939663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56776) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:55.943732 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/networks/d1484879-37d9-4f9a-af8f-2069eaa33d17 HTTP/1.1" status: 204 len: 168 time: 0.5398874 Dec 21 03:53:55.959722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746c6f21-77ad-47c2-8b2e-4e9a1d8bfc43 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Network': ['ID=d1484879-37d9-4f9a-af8f-2069eaa33d17,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:55.983709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-783a8290-ade0-475a-88e1-df5211137863 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.010007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783a8290-ade0-475a-88e1-df5211137863 None None] Pushing event deleted for resources: {'Port': ['ID=4858cbd9-daac-42de-ad13-37fa4656259b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:56.017332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-783a8290-ade0-475a-88e1-df5211137863 None None] No DVR routers for this DVR port 4858cbd9-daac-42de-ad13-37fa4656259b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:56.063662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.177651 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-5602aed7-f988-4c75-aa9f-5db1261d294a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:56.180335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-5602aed7-f988-4c75-aa9f-5db1261d294a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 809 time: 0.1691110 Dec 21 03:53:56.223226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.226750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-40e22301-b02c-4976-bb61-0a76a2133154 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/quotas/0eca6fe3fe274d1abd1d5ce62d18e44d HTTP/1.1" status: 200 len: 375 time: 0.0396483 Dec 21 03:53:56.259112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['19ab220e-df22-4e71-9fd5-879c729fcbc6']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:56.260250 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Sync routers for ids ['08658061-802f-4cd3-bf36-1f9ac84208e7'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:53:56.272210 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Routers {'08658061-802f-4cd3-bf36-1f9ac84208e7'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:56.272894 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['08658061-802f-4cd3-bf36-1f9ac84208e7'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:56.284241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:56.284484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd5bbd3d3-3eaa-448c-95b0-9c78d8d798e1') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:56.296706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.340835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.355464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-f789679e-21c5-4084-ae89-5114dba3c3a0 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1203609 Dec 21 03:53:56.358009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:56.358761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:56.361541 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:56.382212 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Set router 08658061-802f-4cd3-bf36-1f9ac84208e7 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:56.456756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9fa4dba-052f-479a-8075-6d01ad252d4b req-f0c82813-ac58-4c29-abdd-a14d489b4494 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:56.458269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9fa4dba-052f-479a-8075-6d01ad252d4b req-f0c82813-ac58-4c29-abdd-a14d489b4494 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1597023 Dec 21 03:53:56.550868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-d3e9eee0-7eeb-4116-90c9-338f9f6f32c6 service neutron] 10.222.0.18 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1874254 Dec 21 03:53:56.554687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9fa4dba-052f-479a-8075-6d01ad252d4b req-10737f0b-11dc-4e2a-924f-c4228b075f44 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663714 Dec 21 03:53:56.594458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.594730 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3f22db30-4385-410e-ab0d-8f6c7358038f', 'name': '', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'mac_address': 'fa:16:3e:41:d9:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1189, 'fixed_ips': [{'subnet_id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:53Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 2, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'subnets': [{'id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:56.604727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.607887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/networks/19ab220e-df22-4e71-9fd5-879c729fcbc6 HTTP/1.1" status: 204 len: 168 time: 0.6672175 Dec 21 03:53:56.615020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:56.641846 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Checking router: 08658061-802f-4cd3-bf36-1f9ac84208e7 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:53:56.642211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Updating router 08658061-802f-4cd3-bf36-1f9ac84208e7 port 3f22db30-4385-410e-ab0d-8f6c7358038f binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:53:56.660745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-206751d9-ded9-4208-8e6b-75366209f84b tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Network': ['ID=19ab220e-df22-4e71-9fd5-879c729fcbc6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:56.674807 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.749989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Deleting subnet 1b5da811-7a04-4b7f-a181-33c63a1e5b63 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:53:56.750526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 06503167-02c9-4376-803a-36730accf460 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:56.756759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.765145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-8c2962f0-4b61-4e15-9e47-ebdee8ab1c01 service neutron] 10.222.0.18 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2077844 Dec 21 03:53:56.829351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ab8afe-d74a-4caf-80cd-7e67dd9d1384 req-0d36e8ec-9155-417c-bb05-b7ef5fa6a00c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:56.830862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7ab8afe-d74a-4caf-80cd-7e67dd9d1384 req-0d36e8ec-9155-417c-bb05-b7ef5fa6a00c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 944 time: 0.1713839 Dec 21 03:53:56.835857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.914694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 06503167-02c9-4376-803a-36730accf460 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:53:56.920603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 06503167-02c9-4376-803a-36730accf460 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:56.920977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.948637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7ab8afe-d74a-4caf-80cd-7e67dd9d1384 req-a51e16b8-a3b1-498d-95d8-c5c71a18b947 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083558 Dec 21 03:53:56.952948 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:56.974267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.032460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.061790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75442211-1ded-4d5a-8085-f754879d03c7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '06503167-02c9-4376-803a-36730accf460'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:53:57.064088 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e5e30fb-5e09-49d1-bdd3-bd5fad520926" -d '{"events": [{"server_uuid": "75442211-1ded-4d5a-8085-f754879d03c7", "name": "network-vif-plugged", "status": "completed", "tag": "06503167-02c9-4376-803a-36730accf460"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:53:57.087739 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.100830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 06503167-02c9-4376-803a-36730accf460, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=06503167-02c9-4376-803a-36730accf460,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:57.115642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.128926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4858cbd9-daac-42de-ad13-37fa4656259b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:57.155220 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a297c3f3-edb7-4f91-80c5-27d6d28aab89 None None] Pushing event updated for resources: {'Port': ['ID=3f22db30-4385-410e-ab0d-8f6c7358038f,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:57.173926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4858cbd9-daac-42de-ad13-37fa4656259b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:57.174373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4858cbd9-daac-42de-ad13-37fa4656259b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:57.184216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aafe7185-02ab-4cd6-b81e-a1ff2d87277a None None] Network 23aa1b9b-2199-484a-83ef-4353021e7bec requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:53:57.187262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.200993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/subnets/1b5da811-7a04-4b7f-a181-33c63a1e5b63 HTTP/1.1" status: 204 len: 168 time: 0.5786419 Dec 21 03:53:57.201902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56802) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:57.245700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d3ab46b-31ec-44ed-bb83-782e6a3a2744 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Subnet': ['ID=1b5da811-7a04-4b7f-a181-33c63a1e5b63,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:57.282211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.313875 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Attempting to bind port 3f22db30-4385-410e-ab0d-8f6c7358038f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:53:57.314359 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Attempting to bind port 3f22db30-4385-410e-ab0d-8f6c7358038f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:53:57.315356 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Attempting to bind port 3f22db30-4385-410e-ab0d-8f6c7358038f on network ee3304b6-e18e-45c8-93c6-239041d697ca {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:53:57.321474 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:53:57.323251 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Checking segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:53:57.323805 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.324333 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Bound using segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:53:57.325082 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Bound port: 3f22db30-4385-410e-ab0d-8f6c7358038f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:53:57.325612 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.339430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46d4a65d-0f6c-4ef1-b4ee-f128be8c2f65 req-3334602e-8c87-43a7-8e2a-4f0c730a3aa6 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 210 time: 0.0739932 Dec 21 03:53:57.344076 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:53:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7eea78b4-bb87-4783-addc-58a4b4c58ce1 x-openstack-request-id: req-7eea78b4-bb87-4783-addc-58a4b4c58ce1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:53:57.346314 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75442211-1ded-4d5a-8085-f754879d03c7", "name": "network-vif-plugged", "status": "completed", "tag": "06503167-02c9-4376-803a-36730accf460", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:53:57.346314 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7eea78b4-bb87-4783-addc-58a4b4c58ce1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:53:57.346314 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75442211-1ded-4d5a-8085-f754879d03c7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '06503167-02c9-4376-803a-36730accf460', 'code': 200} Dec 21 03:53:57.389553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=06503167-02c9-4376-803a-36730accf460,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:57.410097 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] For port 3f22db30-4385-410e-ab0d-8f6c7358038f, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:53:57.410436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.415524 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] For port 3f22db30-4385-410e-ab0d-8f6c7358038f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3f22db30-4385-410e-ab0d-8f6c7358038f,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:53:57.450456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] DHCP port deletion for 23aa1b9b-2199-484a-83ef-4353021e7bec request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:53:57.474544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09abe910-b306-453a-aada-85f3f81065bd req-d296ef1f-f4b3-499b-ab58-d3dadccb7a40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:57.476210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09abe910-b306-453a-aada-85f3f81065bd req-d296ef1f-f4b3-499b-ab58-d3dadccb7a40 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 1097 time: 0.0414610 Dec 21 03:53:57.476750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Deleting port f305f516-40b1-419b-b497-e9820bf58d96 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:57.477083 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.515900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] Deleting port f305f516-40b1-419b-b497-e9820bf58d96 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:53:57.516203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.536321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09abe910-b306-453a-aada-85f3f81065bd req-f3f264e0-41b5-47d8-89ab-021456149c5e service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522294 Dec 21 03:53:57.549566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] For port f305f516-40b1-419b-b497-e9820bf58d96, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f305f516-40b1-419b-b497-e9820bf58d96,segment=NetworkSegment(a65b66e5-4454-4311-9f04-c9c95f59908e),segment_id=a65b66e5-4454-4311-9f04-c9c95f59908e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:57.549924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.560471 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.563565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Calling delete_port for f305f516-40b1-419b-b497-e9820bf58d96 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:57.591196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] For port f305f516-40b1-419b-b497-e9820bf58d96, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f305f516-40b1-419b-b497-e9820bf58d96,segment=NetworkSegment(a65b66e5-4454-4311-9f04-c9c95f59908e),segment_id=a65b66e5-4454-4311-9f04-c9c95f59908e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:57.591196 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.620418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] Calling delete_port for f305f516-40b1-419b-b497-e9820bf58d96 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:53:57.628645 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a297c3f3-edb7-4f91-80c5-27d6d28aab89 None None] Pushing event updated for resources: {'Port': ['ID=3f22db30-4385-410e-ab0d-8f6c7358038f,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:57.632381 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Routers {'08658061-802f-4cd3-bf36-1f9ac84208e7'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:53:57.633030 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:53:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['08658061-802f-4cd3-bf36-1f9ac84208e7'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:57.711148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9143fb1-7695-436b-8b32-46155462bf4d req-79bdbad0-91d8-480a-b7aa-a14c76aab553 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:57.713525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9143fb1-7695-436b-8b32-46155462bf4d req-79bdbad0-91d8-480a-b7aa-a14c76aab553 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0537925 Dec 21 03:53:57.746419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] Set router 08658061-802f-4cd3-bf36-1f9ac84208e7 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:53:57.767841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9143fb1-7695-436b-8b32-46155462bf4d req-2998444c-a148-4dd4-886d-4ebe2d71437e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457497 Dec 21 03:53:57.817803 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.824658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.849144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Port': ['ID=f305f516-40b1-419b-b497-e9820bf58d96,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:57.851419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] No DVR routers for this DVR port f305f516-40b1-419b-b497-e9820bf58d96 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:57.857190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] No DVR routers for this DVR port f305f516-40b1-419b-b497-e9820bf58d96 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:53:57.860796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da27a6c-4458-4b9e-83ba-faa41a61508c None None] Pushing event deleted for resources: {'Port': ['ID=f305f516-40b1-419b-b497-e9820bf58d96,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:57.943593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:57.975895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['23aa1b9b-2199-484a-83ef-4353021e7bec']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:57.999413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a65b66e5-4454-4311-9f04-c9c95f59908e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:57.999717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a65b66e5-4454-4311-9f04-c9c95f59908e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:58.013004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:53:58.127417 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:53:58.130872 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3f22db30-4385-410e-ab0d-8f6c7358038f', 'name': '', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'mac_address': 'fa:16:3e:41:d9:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1189, 'fixed_ips': [{'subnet_id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:53Z', 'updated_at': '2021-12-21T03:53:57Z', 'revision_number': 4, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'subnets': [{'id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:53:58.131053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cfa0470-c527-43f7-87c9-385b3fba520c req-ca08a1b9-c76b-464b-82bd-67f51a0ea1a7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:58.131709 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a4079ea-5ef3-4c5a-8700-9c8d79512e19 None None] The sync data for ids ['08658061-802f-4cd3-bf36-1f9ac84208e7'] in n-d-822053-11 is: [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '3f22db30-4385-410e-ab0d-8f6c7358038f', 'name': '', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'mac_address': 'fa:16:3e:41:d9:15', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1189, 'fixed_ips': [{'subnet_id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:53Z', 'updated_at': '2021-12-21T03:53:57Z', 'revision_number': 4, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'subnets': [{'id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:53:58.131844 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cfa0470-c527-43f7-87c9-385b3fba520c req-ca08a1b9-c76b-464b-82bd-67f51a0ea1a7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0553517 Dec 21 03:53:58.172618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cfa0470-c527-43f7-87c9-385b3fba520c req-dc6ea58c-5e6b-4dbd-8c2f-0859fc738d31 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645378 Dec 21 03:53:58.349010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:58.369124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:58.369124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/networks/23aa1b9b-2199-484a-83ef-4353021e7bec HTTP/1.1" status: 204 len: 168 time: 1.1590416 Dec 21 03:53:58.375735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56824) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:58.443015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-572989ae-f7d9-48ed-8c44-f90df1635e73 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "GET /v2.0/ports?device_id=7416b908-2252-46fd-94c1-42082daa574b HTTP/1.1" status: 200 len: 205 time: 0.0625772 Dec 21 03:53:58.451738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56828) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:53:58.491047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c08bc117-ce1e-4ada-9307-9a361fd6460e req-a35fcfbd-f1b0-4360-99fa-d23597600368 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 210 time: 0.0555401 Dec 21 03:53:58.565005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:58.739490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddf208f-3b72-4363-b2d3-1f3fe7eabfd6 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Pushing event deleted for resources: {'Network': ['ID=23aa1b9b-2199-484a-83ef-4353021e7bec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:59.115910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5ecd3e-8da0-463a-9e23-8d747e6f1434 req-0fadef4b-4cb8-491a-9709-c819e02435e4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:59.118551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f5ecd3e-8da0-463a-9e23-8d747e6f1434 req-0fadef4b-4cb8-491a-9709-c819e02435e4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1748195 Dec 21 03:53:59.126846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.128546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3f22db30-4385-410e-ab0d-8f6c7358038f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:53:59.129743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.182834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3f22db30-4385-410e-ab0d-8f6c7358038f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:53:59.183216 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.235904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f5ecd3e-8da0-463a-9e23-8d747e6f1434 req-4c4c4ca2-6a11-44a4-98f8-bcd840cc455a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116219 Dec 21 03:53:59.280540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.281366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Fanout notify agent at l3_agent the message router_deleted on router 7416b908-2252-46fd-94c1-42082daa574b {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:53:59.306697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.308791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.313361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fe47fa8a-a406-46f6-8d7a-f1ad166f4d00 tempest-RoutersNegativeTest-538396338 tempest-RoutersNegativeTest-538396338-project] 10.222.0.18 "DELETE /v2.0/routers/7416b908-2252-46fd-94c1-42082daa574b HTTP/1.1" status: 204 len: 168 time: 0.8604126 Dec 21 03:53:59.356186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 3f22db30-4385-410e-ab0d-8f6c7358038f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3f22db30-4385-410e-ab0d-8f6c7358038f,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:53:59.376414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27135298-196d-4541-82b3-22a12ecdb564 req-3050412d-2b79-4017-8edd-139a52b8287d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:53:59.378778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27135298-196d-4541-82b3-22a12ecdb564 req-3050412d-2b79-4017-8edd-139a52b8287d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0635428 Dec 21 03:53:59.451505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27135298-196d-4541-82b3-22a12ecdb564 req-ae15ed8a-5756-453e-8745-9770281342a1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658591 Dec 21 03:53:59.526993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:53:59.596623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=3f22db30-4385-410e-ab0d-8f6c7358038f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:53:59.601471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f305f516-40b1-419b-b497-e9820bf58d96 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:53:59.608059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85c99f2d-c83e-4c12-b4f7-b06c3aa14aae req-5fa41e15-2eef-4329-b68c-30625c3a3a0b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 210 time: 0.0361452 Dec 21 03:53:59.641617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f305f516-40b1-419b-b497-e9820bf58d96 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:53:59.641973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f305f516-40b1-419b-b497-e9820bf58d96 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:53:59.972429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56850) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:00.144596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53242d00-a658-4edf-a08a-33eb479c595e req-b9414002-2121-4d81-9969-7448fd904709 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:00.146151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53242d00-a658-4edf-a08a-33eb479c595e req-b9414002-2121-4d81-9969-7448fd904709 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0924742 Dec 21 03:54:00.157180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c325f461-da19-45c7-a2c0-9f47af78f62d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c59630953ed24a0e86abb95ad3f7c466&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1833851 Dec 21 03:54:00.159610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56856) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:00.215277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e535ffe-6930-42cc-b2a9-4e09b84f7def admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:00.232930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53242d00-a658-4edf-a08a-33eb479c595e req-09ae4e1d-6e3f-4b0e-941d-4efc9a6fdd3e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745425 Dec 21 03:54:00.235650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-ffb84f9a-92bd-4804-bb8f-72819656ddf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:00.237080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-ffb84f9a-92bd-4804-bb8f-72819656ddf9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 1097 time: 0.0778127 Dec 21 03:54:00.241450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e535ffe-6930-42cc-b2a9-4e09b84f7def admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:00.335219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-79616525-7f18-443b-a0d0-a9d8912563c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:00.336673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-79616525-7f18-443b-a0d0-a9d8912563c8 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.0911376 Dec 21 03:54:00.399027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-706ca026-2312-4b90-9552-141795eae42a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=06503167-02c9-4376-803a-36730accf460 HTTP/1.1" status: 200 len: 217 time: 0.0539162 Dec 21 03:54:00.405968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e535ffe-6930-42cc-b2a9-4e09b84f7def admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:00.408779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e535ffe-6930-42cc-b2a9-4e09b84f7def admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:00.412327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e535ffe-6930-42cc-b2a9-4e09b84f7def admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bff132f6-992b-44bb-bb44-d21c19ea6ecb HTTP/1.1" status: 204 len: 168 time: 0.2487900 Dec 21 03:54:00.419838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e535ffe-6930-42cc-b2a9-4e09b84f7def admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bff132f6-992b-44bb-bb44-d21c19ea6ecb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:00.467778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c19d27-687c-4149-9534-e51e9679516b req-c87a3f5e-898b-41f2-ba4c-feef5e17709e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:00.477007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83c19d27-687c-4149-9534-e51e9679516b req-c87a3f5e-898b-41f2-ba4c-feef5e17709e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1433210 Dec 21 03:54:00.552149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83c19d27-687c-4149-9534-e51e9679516b req-15e5e781-85c8-4622-b8c2-6ef376cadfdc tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740502 Dec 21 03:54:00.553624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-ea2361e3-7f5e-4766-901d-193b06be7891 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:00.555467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-ea2361e3-7f5e-4766-901d-193b06be7891 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.1475203 Dec 21 03:54:00.608312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-8abbd4ea-a484-48dc-9db6-d892f359a579 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0292408 Dec 21 03:54:00.744563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2466ccf-cbfd-4fc7-9785-40c5caff6221 req-49d4d5ff-5279-45ef-8630-b6d52965a72c tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 210 time: 0.0335224 Dec 21 03:54:00.772465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-b0eb300a-5462-42e7-9164-e32284cc0cc4 service neutron] 10.222.0.54 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1509836 Dec 21 03:54:00.866582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-79fdea9a-7787-4d01-b336-a0a251db0ae2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:00.868243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-79fdea9a-7787-4d01-b336-a0a251db0ae2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.54 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 809 time: 0.1469681 Dec 21 03:54:00.892247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Request body: {'port': {'device_id': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'admin_state_up': True, 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:00.959895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-130f9dae-bfbd-43a9-a606-e3fecf370e5d req-e03f3fe7-0115-49c9-ac2b-1c9398a30dcd service neutron] 10.222.0.54 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1731014 Dec 21 03:54:01.073462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3f22db30-4385-410e-ab0d-8f6c7358038f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:54:01.114283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Made reservation on behalf of 0eca6fe3fe274d1abd1d5ce62d18e44d for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:01.119419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:01.128877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 3f22db30-4385-410e-ab0d-8f6c7358038f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:01.129400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:01.270009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Allocated IP 172.20.0.8 (ee3304b6-e18e-45c8-93c6-239041d697ca/b082405b-1cdc-4188-a989-d408accdc4d2/9ab62435-cf06-4e36-9ac7-82fc6f3c22f7) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:54:01.361274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73cf1864-cf47-4b62-99c0-5d9797cba18c req-1148947a-910d-4f62-b020-098daf5ed0a0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:01.362865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73cf1864-cf47-4b62-99c0-5d9797cba18c req-1148947a-910d-4f62-b020-098daf5ed0a0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0541484 Dec 21 03:54:01.419494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73cf1864-cf47-4b62-99c0-5d9797cba18c req-01b3b59e-0bf6-40ea-8bcc-4a554dc53b87 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495994 Dec 21 03:54:01.443233 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:01.566228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:01.621595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Network ee3304b6-e18e-45c8-93c6-239041d697ca is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:54:01.625007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:54:01.633479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:54:01.642458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Pushing event updated for resources: {'Port': ['ID=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:01.692338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:01.692338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:01.709525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed525d5-ed62-469c-ba98-83c62a1f4764 req-b1950d25-fea1-40e4-a007-276028845b99 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:01.711097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed525d5-ed62-469c-ba98-83c62a1f4764 req-b1950d25-fea1-40e4-a007-276028845b99 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0565939 Dec 21 03:54:01.757556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-c7122359-2a43-4fe9-8e1d-172f099915c8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8704131 Dec 21 03:54:01.762478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed525d5-ed62-469c-ba98-83c62a1f4764 req-22be60c7-0942-4f4d-85d6-94b083016d08 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452003 Dec 21 03:54:01.786059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Request body: {'port': {'device_id': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:01.856837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:01.897650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-a984d966-48a8-4c41-8444-bb476c6ddc00 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:01.901518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-a984d966-48a8-4c41-8444-bb476c6ddc00 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.1141095 Dec 21 03:54:01.924523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-1d95c773-57cf-4971-8969-362603146924 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/quotas/e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 375 time: 0.0165727 Dec 21 03:54:02.008071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-dd876b8a-27f1-442f-b85b-082fc85e351f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0826902 Dec 21 03:54:02.015684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fade9a-e68f-4716-ae64-d2276ceef77c req-8b2d56e7-0ea0-40b8-a80a-13590e862462 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:02.017131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86fade9a-e68f-4716-ae64-d2276ceef77c req-8b2d56e7-0ea0-40b8-a80a-13590e862462 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 931 time: 0.0906503 Dec 21 03:54:02.120365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86fade9a-e68f-4716-ae64-d2276ceef77c req-4285839f-f011-4b85-a28a-6b7611b7fdde tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943103 Dec 21 03:54:02.134293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-6c951086-202f-42c7-9509-2d99bab77663 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1162164 Dec 21 03:54:02.152486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:02.160975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:02.174610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Transition to ACTIVE for port object 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:54:02.237577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-9d34cc5b-f006-4ac1-ade8-b04518802fe1 service neutron] 10.222.0.18 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0965185 Dec 21 03:54:02.251480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:02.328565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Pushing event updated for resources: {'Port': ['ID=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:02.392089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Attempting to bind port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:02.392498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Attempting to bind port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:02.396351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Attempting to bind port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 on network ee3304b6-e18e-45c8-93c6-239041d697ca {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:02.397798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 on network ee3304b6-e18e-45c8-93c6-239041d697ca not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:02.398124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Attempting to bind port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 on network ee3304b6-e18e-45c8-93c6-239041d697ca {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:02.406670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:02.407061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Checking segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:02.407472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Bound using segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:02.407903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Bound port: 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:02.408261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:02.495806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] For port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:02.499168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] For port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:02.539552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed87bdb8-c1ba-4381-a130-d517c50382b0 req-1416ac6b-a57d-48b2-9171-c336f4282db3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:02.541658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed87bdb8-c1ba-4381-a130-d517c50382b0 req-1416ac6b-a57d-48b2-9171-c336f4282db3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0518563 Dec 21 03:54:02.591645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed87bdb8-c1ba-4381-a130-d517c50382b0 req-65070295-0f42-4999-830a-7eb7e380eab8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438294 Dec 21 03:54:02.594431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:02.658617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:02.659456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:02.661579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] 10.222.0.54 "PUT /v2.0/ports/9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 HTTP/1.1" status: 200 len: 1092 time: 0.8802495 Dec 21 03:54:02.662227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'tag': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:02.664711 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b66a419-d708-43f6-a4bf-061987da2e21" -d '{"events": [{"name": "network-changed", "server_uuid": "397c6d65-d795-4261-b5a8-84dfa0b55171", "tag": "9ab62435-cf06-4e36-9ac7-82fc6f3c22f7"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:02.695736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86cfbfe6-7011-470d-9ba4-d830062443dc service neutron] Pushing event updated for resources: {'Port': ['ID=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:02.766369 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34fb4369-4cf0-4f1e-a466-b93c3612f7e9 x-openstack-request-id: req-34fb4369-4cf0-4f1e-a466-b93c3612f7e9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:02.766668 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "397c6d65-d795-4261-b5a8-84dfa0b55171", "tag": "9ab62435-cf06-4e36-9ac7-82fc6f3c22f7", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:02.766949 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-34fb4369-4cf0-4f1e-a466-b93c3612f7e9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:02.767374 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'tag': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7', 'status': 'completed', 'code': 200} Dec 21 03:54:02.895721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-dbd433d4-571e-4a13-8637-c914ab745971 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:02.897306 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-dbd433d4-571e-4a13-8637-c914ab745971 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 1095 time: 0.1080005 Dec 21 03:54:02.985261 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-d489a9da-9e34-41ec-b755-7b97ada78bfd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 HTTP/1.1" status: 200 len: 217 time: 0.0706482 Dec 21 03:54:03.026080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ba4e979-a5f2-4371-a5b0-284ef069bfa4 req-a0097710-17f7-4c19-b04d-d8ddbdd5d9f7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0893033 Dec 21 03:54:03.049035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51110f8d-9258-4778-8828-381bd72b5569 req-69b656f6-b8dd-4b8a-a351-ec1766a6693a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.050527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-69b656f6-b8dd-4b8a-a351-ec1766a6693a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.0548637 Dec 21 03:54:03.060465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290d1dec-653b-43ee-9a00-a56434207922 req-2208b31f-2507-4768-9646-f4d1f4dc1e35 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.064768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-290d1dec-653b-43ee-9a00-a56434207922 req-2208b31f-2507-4768-9646-f4d1f4dc1e35 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.2067513 Dec 21 03:54:03.096286 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-0649eb50-4695-4e63-9c9c-b230b443e39e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0375259 Dec 21 03:54:03.137032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-290d1dec-653b-43ee-9a00-a56434207922 req-59631d85-ec16-4702-b03c-3f1cf2509dd7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658605 Dec 21 03:54:03.265011 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-a50b63f1-92b2-4220-8b4a-aed8e37d4d7b service neutron] 10.222.0.54 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1129210 Dec 21 03:54:03.269844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0582f7ae-e193-4447-94b9-3309999a53fa req-75c50bcc-2dbf-491a-aeac-78fc66471c97 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.272029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0582f7ae-e193-4447-94b9-3309999a53fa req-75c50bcc-2dbf-491a-aeac-78fc66471c97 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 943 time: 0.0642266 Dec 21 03:54:03.337615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0582f7ae-e193-4447-94b9-3309999a53fa req-f2208af1-4fbc-4931-98d8-271c54f0655e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553977 Dec 21 03:54:03.395970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-51110f8d-9258-4778-8828-381bd72b5569 req-023ec18f-fdb8-43fc-b20d-a78ec18c4de2 service neutron] 10.222.0.54 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1223834 Dec 21 03:54:03.672233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-0f7835bd-c2a3-4419-bcd4-fe79d57935af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.674952 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-0f7835bd-c2a3-4419-bcd4-fe79d57935af service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 1095 time: 0.0559657 Dec 21 03:54:03.743689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3154a9b-5163-42f0-a432-7fa541837866 req-5b8e5865-2932-4c0d-beba-98defcca996c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.753679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3154a9b-5163-42f0-a432-7fa541837866 req-5b8e5865-2932-4c0d-beba-98defcca996c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0682740 Dec 21 03:54:03.812817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-a9c3c5af-aa5b-4a9a-b385-6b0e2c433dac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.814181 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-a9c3c5af-aa5b-4a9a-b385-6b0e2c433dac service neutron] 10.222.0.54 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 910 time: 0.1276665 Dec 21 03:54:03.819155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3154a9b-5163-42f0-a432-7fa541837866 req-192903e3-8580-431a-9595-374c5b84bd3c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619586 Dec 21 03:54:03.872200 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-b372ac83-b005-45a0-8e7e-b420134e7d82 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 HTTP/1.1" status: 200 len: 217 time: 0.0384810 Dec 21 03:54:03.933274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-cd96f6c9-e688-49ec-8b9b-d13d5aa759bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:03.934824 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-cd96f6c9-e688-49ec-8b9b-d13d5aa759bb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.0533361 Dec 21 03:54:03.985733 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-447bc6e1-ba84-427c-b92c-04da216b5a31 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271676 Dec 21 03:54:04.086549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-87dc48dd-bc5f-42c0-95c3-29b0356b5f8d service neutron] 10.222.0.54 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0921090 Dec 21 03:54:04.127048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d27cb7f-30f9-47bd-89bc-83abbc6c3875 req-270629a2-d1e6-4698-99ad-453bd9958136 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0292976 Dec 21 03:54:04.185152 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4b66a419-d708-43f6-a4bf-061987da2e21 req-46541459-e3da-44f5-bc32-d2013cd3fc4b service neutron] 10.222.0.54 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912509 Dec 21 03:54:04.259169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b631f63-1e5f-46f7-881f-32b3a4cfb7d4 req-1e923e59-9ac3-456e-ace1-e72b88bf605e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:04.261256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b631f63-1e5f-46f7-881f-32b3a4cfb7d4 req-1e923e59-9ac3-456e-ace1-e72b88bf605e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0540745 Dec 21 03:54:04.309630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b631f63-1e5f-46f7-881f-32b3a4cfb7d4 req-8a97cb18-e661-4579-bb35-48bb11e1afe5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422735 Dec 21 03:54:04.462500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26f0a41-991a-4c6f-9aa2-7471d29a436f req-e958f804-09ae-4e7b-8b18-94a8072941f7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:04.464002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26f0a41-991a-4c6f-9aa2-7471d29a436f req-e958f804-09ae-4e7b-8b18-94a8072941f7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 943 time: 0.0566831 Dec 21 03:54:04.513037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26f0a41-991a-4c6f-9aa2-7471d29a436f req-263372f8-b348-4233-9c08-4208363902b7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428286 Dec 21 03:54:04.945761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb84179-72c9-461f-b7a5-6cedd73ec3cf req-3adeff5d-165a-4b78-91df-9cb620aa2073 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:04.947544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfb84179-72c9-461f-b7a5-6cedd73ec3cf req-3adeff5d-165a-4b78-91df-9cb620aa2073 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0681093 Dec 21 03:54:05.002305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfb84179-72c9-461f-b7a5-6cedd73ec3cf req-f0f982a3-2782-4eda-bcfd-dded3cd2b6d8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482252 Dec 21 03:54:05.187709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-c9491822-5755-4b07-bea8-529cc2c8a3cf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:05.189227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-c9491822-5755-4b07-bea8-529cc2c8a3cf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 807 time: 0.1099210 Dec 21 03:54:05.222575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c608689-2352-4646-9f3e-ffe69a822cd7 req-dfe5c4e3-a4cb-4773-bfb1-c2ecda207bc4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0270522 Dec 21 03:54:05.225934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Request body: {'port': {'device_id': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'admin_state_up': True, 'tenant_id': 'e49c9575c393446a904ba5840d68746b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:05.432009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Made reservation on behalf of e49c9575c393446a904ba5840d68746b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:05.435532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:05.473100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc2d64b-bdfd-45e3-8d4c-018c25701807 req-2cfc4d7d-3805-44dd-b1f9-2d67e3421706 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:05.474593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffc2d64b-bdfd-45e3-8d4c-018c25701807 req-2cfc4d7d-3805-44dd-b1f9-2d67e3421706 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0750761 Dec 21 03:54:05.603272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffc2d64b-bdfd-45e3-8d4c-018c25701807 req-423137ba-17c4-4abc-a3a2-04d27d32a30c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989046 Dec 21 03:54:05.659390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Allocated IP 172.20.0.2 (5fd01e07-75a4-4745-ad05-8ade1a021605/13099c8a-54c1-41b2-a4f4-664d17e69495/68a76cd7-fffa-4866-9c53-87b552b1bde6) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:54:05.690410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-527dce61-6d3a-4274-bab3-d7fb914fa9b3 req-c655da72-6913-4904-adb9-0344d8e35647 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:05.691934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-527dce61-6d3a-4274-bab3-d7fb914fa9b3 req-c655da72-6913-4904-adb9-0344d8e35647 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 943 time: 0.0805371 Dec 21 03:54:05.792116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-527dce61-6d3a-4274-bab3-d7fb914fa9b3 req-7f2048d4-3136-4369-83d1-e5c366fd3f7f tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0929174 Dec 21 03:54:05.871621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:05.954769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:05.991033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['425b1a38-084b-43fc-ab16-7a0f86f2eb65'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:06.001504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:54:06.004912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:54:06.010310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:54:06.018997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:06.077385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-853e0eab-de0b-4d98-99cb-d26d6e0bb7c4 None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:06.123051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:06.123856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:06.193334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c175b27f-6e11-4442-9044-07d00dce881e req-64d06e9f-e68d-45af-a4a8-9461446e6894 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:06.194869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c175b27f-6e11-4442-9044-07d00dce881e req-64d06e9f-e68d-45af-a4a8-9461446e6894 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0537171 Dec 21 03:54:06.196241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b544497d-bccb-4de1-b154-cec89c2bd6e5 None None] Provisioning complete for port 68a76cd7-fffa-4866-9c53-87b552b1bde6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:06.196621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b544497d-bccb-4de1-b154-cec89c2bd6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:06.202034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-de9044dd-d523-41b8-a300-561c7c9a5adc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9816875 Dec 21 03:54:06.227444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Request body: {'port': {'device_id': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:06.256713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b544497d-bccb-4de1-b154-cec89c2bd6e5 None None] Port 68a76cd7-fffa-4866-9c53-87b552b1bde6 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:54:06.288589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c175b27f-6e11-4442-9044-07d00dce881e req-1cdbcea7-aab6-4bcf-bce3-173341a119e0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0856004 Dec 21 03:54:06.340570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:06.402178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e37f4f1-1566-481e-b99d-3df88f0d4704 req-8a2fe71b-4f67-4352-9ec5-8434438cc7f3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:06.405888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e37f4f1-1566-481e-b99d-3df88f0d4704 req-8a2fe71b-4f67-4352-9ec5-8434438cc7f3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 931 time: 0.0985942 Dec 21 03:54:06.533518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e37f4f1-1566-481e-b99d-3df88f0d4704 req-d09c9247-20b4-4af1-bd2b-37c397b8900d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1207690 Dec 21 03:54:06.659400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 68a76cd7-fffa-4866-9c53-87b552b1bde6 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:06.667759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:06.681859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Transition to ACTIVE for port object 68a76cd7-fffa-4866-9c53-87b552b1bde6 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:54:06.737420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20fffceb-d9c3-4721-92b7-2381e380754a req-5e3485a5-ef09-48ee-894f-7628ccbc758c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:06.738922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20fffceb-d9c3-4721-92b7-2381e380754a req-5e3485a5-ef09-48ee-894f-7628ccbc758c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0518160 Dec 21 03:54:06.760306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:06.810850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-268215f9-7ab5-4283-a6b4-d181264572fd None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:06.829147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:06.829485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:06.834762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20fffceb-d9c3-4721-92b7-2381e380754a req-224f3900-0552-489b-b2aa-af08510dd54a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893614 Dec 21 03:54:06.977635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:06.993203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'port_id': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7', 'mac_address': 'fa:16:3e:a6:45:c7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:54:06.997374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:06.997374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:06.997374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:07.002705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:07.003159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:07.008769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 53, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:07.009270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:07.010297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:07.010821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Bound port: 68a76cd7-fffa-4866-9c53-87b552b1bde6, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:07.011803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:07.031427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9547ef83-e1b5-4530-af35-200557d9bc13 req-00f7b45a-f388-4705-a269-534d12630de8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:07.033219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9547ef83-e1b5-4530-af35-200557d9bc13 req-00f7b45a-f388-4705-a269-534d12630de8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 943 time: 0.1162274 Dec 21 03:54:07.037047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:07.064623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:07.088621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:07.147349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9547ef83-e1b5-4530-af35-200557d9bc13 req-32c22cbd-c6f4-422d-9130-fd30278af595 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1045511 Dec 21 03:54:07.153057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:07.163437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:07.171373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:07.212752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:07.269332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:07.304657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:07.305291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:07.307360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] 10.222.0.31 "PUT /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 1092 time: 1.0869970 Dec 21 03:54:07.312500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:07.313322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be5fdb21-e91f-4fd1-ad8f-d8f92e01140f None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:07.313779 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b5bb92d-d290-489e-b810-58ead6a6d5ca" -d '{"events": [{"name": "network-changed", "server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:07.351781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419c8690-7310-40fa-ad8c-e75ac3d0f413 service neutron] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:07.406328 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-282c8d1a-bd13-44a1-bce6-ce90e2dc3f12 x-openstack-request-id: req-282c8d1a-bd13-44a1-bce6-ce90e2dc3f12 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:07.406994 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:07.407292 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-282c8d1a-bd13-44a1-bce6-ce90e2dc3f12 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:07.408143 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'status': 'completed', 'code': 200} Dec 21 03:54:07.488233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b93bca95-8390-4489-82b7-7c46bde392b0 req-e59b9d11-15f9-4053-a68d-bc73c48ffeda tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:07.488233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b93bca95-8390-4489-82b7-7c46bde392b0 req-e59b9d11-15f9-4053-a68d-bc73c48ffeda tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0951478 Dec 21 03:54:07.512631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-e612ef22-f7db-4e16-9d21-62f6ee1da838 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:07.514148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-e612ef22-f7db-4e16-9d21-62f6ee1da838 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1095 time: 0.0816967 Dec 21 03:54:07.553476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:07.585738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-d65559eb-fd62-4822-840c-797a87b2c803 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 217 time: 0.0537355 Dec 21 03:54:07.597431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b93bca95-8390-4489-82b7-7c46bde392b0 req-73ac4374-bc31-42e5-91db-2cb72ac84fc5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026063 Dec 21 03:54:07.700442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-24270cad-5aff-4db8-9163-d9670baf7d00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:07.703383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-24270cad-5aff-4db8-9163-d9670baf7d00 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0981097 Dec 21 03:54:07.749271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-ca73d330-cbc6-4470-af07-ef0167e203f3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0328267 Dec 21 03:54:07.757413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8634b15b-7735-4740-aeb1-0b374490110f req-f0ea1d32-fa16-49bb-aaa2-834f2030ab3e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:07.759817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8634b15b-7735-4740-aeb1-0b374490110f req-f0ea1d32-fa16-49bb-aaa2-834f2030ab3e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.1055655 Dec 21 03:54:07.868439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8634b15b-7735-4740-aeb1-0b374490110f req-89553dac-686c-479d-bf6e-7a1875ad3fc6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996566 Dec 21 03:54:07.906373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-d7a925d1-cc9f-45c1-9c55-e4c54b2e0f3c service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1455021 Dec 21 03:54:08.035402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3251cea3-0382-4d3e-992b-01d7b1431302 req-5c664eef-8835-467d-be9e-6d6231d348d8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:08.037062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3251cea3-0382-4d3e-992b-01d7b1431302 req-5c664eef-8835-467d-be9e-6d6231d348d8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1040807 Dec 21 03:54:08.053503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d80144b0-0c91-41a4-8c23-e4717a88c4ed req-b2f5164d-5516-4ee9-a5ac-a14a38a49271 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1386709 Dec 21 03:54:08.098146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3251cea3-0382-4d3e-992b-01d7b1431302 req-de04edf4-95c9-46c8-8c67-e3f816cde1c6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533147 Dec 21 03:54:08.305635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401551a8-c83d-4138-b3a8-2568359911ca req-4a653fac-59a5-4bd8-a364-ab0de01514ec tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:08.307218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-401551a8-c83d-4138-b3a8-2568359911ca req-4a653fac-59a5-4bd8-a364-ab0de01514ec tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 944 time: 0.0884550 Dec 21 03:54:08.309016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-102c75aa-3fd3-4071-9426-551183606ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:08.310352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-102c75aa-3fd3-4071-9426-551183606ed8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1095 time: 0.0758278 Dec 21 03:54:08.418421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-401551a8-c83d-4138-b3a8-2568359911ca req-c71570bc-afea-4650-8a84-1946cba34e9a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032555 Dec 21 03:54:08.442267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-fa3389b0-57c4-439c-9294-68a4ff52882e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:08.443942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-fa3389b0-57c4-439c-9294-68a4ff52882e service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1228175 Dec 21 03:54:08.493416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-65a240ec-d6eb-47e3-9a84-579774a15257 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 217 time: 0.0410221 Dec 21 03:54:08.547776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-f929693d-ab40-4331-844a-d8d70b4c2e21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:08.549510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-f929693d-ab40-4331-844a-d8d70b4c2e21 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0490398 Dec 21 03:54:08.597108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-529fd8e3-5b1c-4765-8e54-30822ba6679b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0332603 Dec 21 03:54:08.622770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57084) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:08.753375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c64a0f1-42dd-435a-a8aa-03c247d6c0c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:08.763021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074cbf6c-f1e4-476f-ab0f-021aa14c489f req-5ae848a3-f931-41c7-93bf-096ae0b72669 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:08.764522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-074cbf6c-f1e4-476f-ab0f-021aa14c489f req-5ae848a3-f931-41c7-93bf-096ae0b72669 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0767090 Dec 21 03:54:08.766971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-cabdc52c-cda4-4b62-8dce-9f91e318f79d service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1552975 Dec 21 03:54:08.833019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c64a0f1-42dd-435a-a8aa-03c247d6c0c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:08.843844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:54:08.902882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c64a0f1-42dd-435a-a8aa-03c247d6c0c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:08.953182 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c64a0f1-42dd-435a-a8aa-03c247d6c0c9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6b3d9403ed6442dba8e117ec832314a2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3268549 Dec 21 03:54:08.953182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c64a0f1-42dd-435a-a8aa-03c247d6c0c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f7b17ce-ba53-4bfd-adc0-1dd9a11916fc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:08.955061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57092) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:08.994811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:54:08.999970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:09.000476 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.010701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d96e952f-634e-448b-9726-8eb6c8566220 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.047453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d96e952f-634e-448b-9726-8eb6c8566220 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.095738 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.123016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:09.124864 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fb72a5a-7268-49ed-a610-5917debe1932" -d '{"events": [{"server_uuid": "397c6d65-d795-4261-b5a8-84dfa0b55171", "name": "network-vif-plugged", "status": "completed", "tag": "9ab62435-cf06-4e36-9ac7-82fc6f3c22f7"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:09.142098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:09.194443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d96e952f-634e-448b-9726-8eb6c8566220 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.197846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d96e952f-634e-448b-9726-8eb6c8566220 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.199152 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d96e952f-634e-448b-9726-8eb6c8566220 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7f7b17ce-ba53-4bfd-adc0-1dd9a11916fc HTTP/1.1" status: 204 len: 168 time: 0.2429433 Dec 21 03:54:09.207848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96e952f-634e-448b-9726-8eb6c8566220 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f7b17ce-ba53-4bfd-adc0-1dd9a11916fc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:09.248421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-074cbf6c-f1e4-476f-ab0f-021aa14c489f req-f76209a9-09db-4716-91ad-37d9a115c074 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4762278 Dec 21 03:54:09.252188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:09.289697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b5bb92d-d290-489e-b810-58ead6a6d5ca req-290eb338-9634-48d1-8ee5-6c174054c636 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5088594 Dec 21 03:54:09.297738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a534d35-ffce-4e78-b6b4-b1b57252d5d5 req-24b6e195-a1a6-4e8a-bfac-634bc175e7b3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:09.299235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a534d35-ffce-4e78-b6b4-b1b57252d5d5 req-24b6e195-a1a6-4e8a-bfac-634bc175e7b3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.1040986 Dec 21 03:54:09.323546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:09.381116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a534d35-ffce-4e78-b6b4-b1b57252d5d5 req-304638e2-0189-4878-b0e6-75d0cb283bf3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738711 Dec 21 03:54:09.401769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234b058d-b617-422c-97e5-93805305494a req-2c255386-5a8b-4b61-a974-d97757595302 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:09.403492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-234b058d-b617-422c-97e5-93805305494a req-2c255386-5a8b-4b61-a974-d97757595302 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0719953 Dec 21 03:54:09.444849 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7a2c6a4-e74f-40cc-ae70-8032c0db72aa x-openstack-request-id: req-b7a2c6a4-e74f-40cc-ae70-8032c0db72aa {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:09.445207 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "397c6d65-d795-4261-b5a8-84dfa0b55171", "name": "network-vif-plugged", "status": "completed", "tag": "9ab62435-cf06-4e36-9ac7-82fc6f3c22f7", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:09.445465 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b7a2c6a4-e74f-40cc-ae70-8032c0db72aa {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:09.446037 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7', 'code': 200} Dec 21 03:54:09.468233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-234b058d-b617-422c-97e5-93805305494a req-ed07dd9c-e03e-4f1a-94ed-785ff57fd023 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578732 Dec 21 03:54:09.644529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9988b76d-af48-439c-8e6a-cc82d94965ca req-f28b3d41-4dac-4669-938b-725896ae8999 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:09.646283 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9988b76d-af48-439c-8e6a-cc82d94965ca req-f28b3d41-4dac-4669-938b-725896ae8999 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 1097 time: 0.0541396 Dec 21 03:54:09.686822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a741e32f-274e-42bf-9131-d71b8a03fbbe req-1e776bcc-0b9d-4596-bc58-235fbe0d15e4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:09.689538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a741e32f-274e-42bf-9131-d71b8a03fbbe req-1e776bcc-0b9d-4596-bc58-235fbe0d15e4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0655425 Dec 21 03:54:09.709244 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9988b76d-af48-439c-8e6a-cc82d94965ca req-cf4b7432-1cee-46c3-82f7-3f3eea841a26 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524538 Dec 21 03:54:09.741187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a741e32f-274e-42bf-9131-d71b8a03fbbe req-09b11746-a916-4ff0-96bb-975eb71adbfc tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444224 Dec 21 03:54:09.940708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:09.953944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d10c19f-de0b-41d0-a872-af79efb5aaab admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.032576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d10c19f-de0b-41d0-a872-af79efb5aaab admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.131614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d10c19f-de0b-41d0-a872-af79efb5aaab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.171260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9d10c19f-de0b-41d0-a872-af79efb5aaab admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b7b222c4d31e408e9fc75d3767dd37c4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2294352 Dec 21 03:54:10.172127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d10c19f-de0b-41d0-a872-af79efb5aaab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a30df3d7-f125-47a8-a63b-88d77c3d887c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:10.174136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57112) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:10.224124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cee0a27-1c65-4ac5-a907-3dd7394fbb87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.245010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cee0a27-1c65-4ac5-a907-3dd7394fbb87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.371253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cee0a27-1c65-4ac5-a907-3dd7394fbb87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.374265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cee0a27-1c65-4ac5-a907-3dd7394fbb87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:10.377769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3cee0a27-1c65-4ac5-a907-3dd7394fbb87 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a30df3d7-f125-47a8-a63b-88d77c3d887c HTTP/1.1" status: 204 len: 168 time: 0.2002800 Dec 21 03:54:10.380385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc8646f-99ce-4188-81ac-58a8f9f30445 req-d0902207-f256-4dbd-b826-ae2500cf47d0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:10.381596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfc8646f-99ce-4188-81ac-58a8f9f30445 req-d0902207-f256-4dbd-b826-ae2500cf47d0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0535009 Dec 21 03:54:10.386876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cee0a27-1c65-4ac5-a907-3dd7394fbb87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a30df3d7-f125-47a8-a63b-88d77c3d887c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:10.438026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfc8646f-99ce-4188-81ac-58a8f9f30445 req-b9c37b70-c7a3-4203-bf0b-3b5fec665dab tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486999 Dec 21 03:54:10.519025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e941c4a-23c0-44b4-9f0a-ca62d4d213a5 req-b3378739-d0ba-4d84-8131-38363609e843 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:10.520630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e941c4a-23c0-44b4-9f0a-ca62d4d213a5 req-b3378739-d0ba-4d84-8131-38363609e843 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0552621 Dec 21 03:54:10.599600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e941c4a-23c0-44b4-9f0a-ca62d4d213a5 req-e78fd513-856b-4833-976e-8167a69607db tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718470 Dec 21 03:54:10.620675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928b2ac5-0855-4bd6-afac-5f7079cb3862 req-3d70dad4-cb41-4cd9-b813-fbe01aea6823 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:10.622306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-928b2ac5-0855-4bd6-afac-5f7079cb3862 req-3d70dad4-cb41-4cd9-b813-fbe01aea6823 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0612199 Dec 21 03:54:10.677179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-928b2ac5-0855-4bd6-afac-5f7079cb3862 req-028c6ca0-439b-4a95-8e5f-0e92f06672d8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471559 Dec 21 03:54:10.886101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b7b6b4-eb7c-458b-94ce-35ddaf8e400a req-ec34027f-aa6e-4e91-af20-b0a070a5da6e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:10.887978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9b7b6b4-eb7c-458b-94ce-35ddaf8e400a req-ec34027f-aa6e-4e91-af20-b0a070a5da6e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0651519 Dec 21 03:54:10.942495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9b7b6b4-eb7c-458b-94ce-35ddaf8e400a req-46c1ebac-2a65-4085-afc6-a38685e5eab8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472138 Dec 21 03:54:11.564966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff759f4-89c0-40b7-b134-f1851c721757 req-fedb5372-1c9c-45f8-a964-3fc06adf44b3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:11.566592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cff759f4-89c0-40b7-b134-f1851c721757 req-fedb5372-1c9c-45f8-a964-3fc06adf44b3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0513747 Dec 21 03:54:11.615388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cff759f4-89c0-40b7-b134-f1851c721757 req-228755d8-e045-40c6-986c-b1c3e7337cd4 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418859 Dec 21 03:54:11.738277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c39f770-e403-450f-bb43-f2efa48f8f74 req-28342f99-0b05-4b5c-9567-290986f1b4b9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:11.740073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c39f770-e403-450f-bb43-f2efa48f8f74 req-28342f99-0b05-4b5c-9567-290986f1b4b9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0580678 Dec 21 03:54:11.819315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c39f770-e403-450f-bb43-f2efa48f8f74 req-fcf66b0d-49f2-4ecf-ad3e-ff17487b6163 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725880 Dec 21 03:54:11.839329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b76d11-1ef8-41e0-bf30-6e4857019364 req-41799f6a-47e5-4dcb-a327-20bc038d0826 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:11.841298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2b76d11-1ef8-41e0-bf30-6e4857019364 req-41799f6a-47e5-4dcb-a327-20bc038d0826 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0814819 Dec 21 03:54:11.892181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2b76d11-1ef8-41e0-bf30-6e4857019364 req-b7edbfef-5fa3-47c9-8140-ba343ff1f80d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445690 Dec 21 03:54:12.080234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340cd9f1-c943-4098-806b-9a8ee125eae1 req-33e3137c-f24e-4df7-99ca-1a5d02f30fe8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.081738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-340cd9f1-c943-4098-806b-9a8ee125eae1 req-33e3137c-f24e-4df7-99ca-1a5d02f30fe8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0533669 Dec 21 03:54:12.128824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-340cd9f1-c943-4098-806b-9a8ee125eae1 req-dba5800d-d1ad-40dc-b2d5-0cf90ae51934 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403099 Dec 21 03:54:12.560565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0bffc51-a6ba-407a-876b-1bd8f99795b0 req-370eedbb-83b2-48c0-a668-f068c0f8cf46 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.562048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0bffc51-a6ba-407a-876b-1bd8f99795b0 req-370eedbb-83b2-48c0-a668-f068c0f8cf46 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0504711 Dec 21 03:54:12.612533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0bffc51-a6ba-407a-876b-1bd8f99795b0 req-3cadf78d-6d3e-4d02-ac42-d990a6e70171 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444126 Dec 21 03:54:12.629256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-174e41f3-5077-4752-9f08-93a449a83b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.631386 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-174e41f3-5077-4752-9f08-93a449a83b06 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 1097 time: 0.0413971 Dec 21 03:54:12.720971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:54:12.727526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-13222367-4189-4989-87be-308067b34872 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.729035 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-13222367-4189-4989-87be-308067b34872 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 910 time: 0.0909994 Dec 21 03:54:12.739014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f0ffc8-a597-4324-99a2-ed454b572f7f req-96de852f-d97b-4f58-94bc-cf0d2e9e37fc tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.740559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82f0ffc8-a597-4324-99a2-ed454b572f7f req-96de852f-d97b-4f58-94bc-cf0d2e9e37fc tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0533736 Dec 21 03:54:12.774159 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-210cc43b-6be5-48ad-ba48-2fb0799421aa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 HTTP/1.1" status: 200 len: 217 time: 0.0353146 Dec 21 03:54:12.792366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82f0ffc8-a597-4324-99a2-ed454b572f7f req-fc3f7520-62f7-43d2-ad73-ae7dd27d2aaa tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451982 Dec 21 03:54:12.827428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-e482f74f-205f-4ad5-ad9e-e22fc7460c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.828920 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-e482f74f-205f-4ad5-ad9e-e22fc7460c5d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.0485003 Dec 21 03:54:12.860450 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-39cb3bb6-64fb-4828-9bd9-7040ad0a9948 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245423 Dec 21 03:54:12.938300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73991f2a-a047-4c6b-8ff1-8aac3aa2cc70 req-1ccfe4e1-759a-4d6e-a106-3ff7e638fbc8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:12.939970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73991f2a-a047-4c6b-8ff1-8aac3aa2cc70 req-1ccfe4e1-759a-4d6e-a106-3ff7e638fbc8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0490301 Dec 21 03:54:12.957686 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-1807d5da-a593-4aa0-bd22-8357aca89754 service neutron] 10.222.0.54 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893626 Dec 21 03:54:13.020425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73991f2a-a047-4c6b-8ff1-8aac3aa2cc70 req-8deef68a-d6bd-400e-aa07-13d2a269f0a5 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740397 Dec 21 03:54:13.054009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcc0be8-8a81-49e4-bc2f-9d47261f3d3d req-d1158546-2b63-4a95-bd7a-ebe49a033ec8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:13.054009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bcc0be8-8a81-49e4-bc2f-9d47261f3d3d req-d1158546-2b63-4a95-bd7a-ebe49a033ec8 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0866857 Dec 21 03:54:13.062756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc8f50a6-72b4-4453-b88a-d5a859da3b40 req-9f537b44-8244-4470-bab0-d14a4b41448d service neutron] 10.222.0.54 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0973506 Dec 21 03:54:13.100478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bcc0be8-8a81-49e4-bc2f-9d47261f3d3d req-8c6dc60b-91e3-43e9-8c42-c1612fc40fc4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470998 Dec 21 03:54:13.733202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40270f61-a889-4f43-ac5a-34c7d0636315 req-08296db5-b011-45df-a6f9-fcf2f8e23674 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:13.734727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40270f61-a889-4f43-ac5a-34c7d0636315 req-08296db5-b011-45df-a6f9-fcf2f8e23674 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0532324 Dec 21 03:54:13.780942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40270f61-a889-4f43-ac5a-34c7d0636315 req-d1a9c83e-8fe7-48cd-80b9-cc1a8c5b9983 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400712 Dec 21 03:54:13.912595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ec9d55-cb60-470e-af80-085da5789691 req-0e1d9e89-7b8e-41ad-b133-8694a3c851ef tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:13.913983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82ec9d55-cb60-470e-af80-085da5789691 req-0e1d9e89-7b8e-41ad-b133-8694a3c851ef tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0491772 Dec 21 03:54:13.960336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82ec9d55-cb60-470e-af80-085da5789691 req-a381f5d6-6ca2-4a41-99b8-915adbd260b7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403171 Dec 21 03:54:14.147695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15627660-6f4a-44f6-aa19-c32c2e433d31 req-7047d0eb-7126-4332-ae1d-278040f983bc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:14.149409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15627660-6f4a-44f6-aa19-c32c2e433d31 req-7047d0eb-7126-4332-ae1d-278040f983bc tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0565696 Dec 21 03:54:14.230883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15627660-6f4a-44f6-aa19-c32c2e433d31 req-75fafee9-58f7-4794-9950-d6334892ecc8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738914 Dec 21 03:54:14.252034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af663605-dff8-4ca9-a7a1-058b80f1159a req-d4d46d0e-fee6-4113-abdd-86c6c80f927a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:14.252034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af663605-dff8-4ca9-a7a1-058b80f1159a req-d4d46d0e-fee6-4113-abdd-86c6c80f927a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0718851 Dec 21 03:54:14.297161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af663605-dff8-4ca9-a7a1-058b80f1159a req-f4f1e7b1-b170-4d2a-9b34-32409799cbc1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439727 Dec 21 03:54:14.693355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57242) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:14.795183 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b4df7e4-8068-4f40-b0f1-278ede48f43a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:14.894091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b4df7e4-8068-4f40-b0f1-278ede48f43a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:14.913415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74e6f38-1a12-4ae6-8a22-f6e81111d47b req-3e330575-9a7e-4ef6-8c7b-fcf26a02181a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:14.914870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d74e6f38-1a12-4ae6-8a22-f6e81111d47b req-3e330575-9a7e-4ef6-8c7b-fcf26a02181a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0589128 Dec 21 03:54:14.959585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b4df7e4-8068-4f40-b0f1-278ede48f43a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:14.980233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d74e6f38-1a12-4ae6-8a22-f6e81111d47b req-ba9cfe9d-764e-4ae2-a227-a1b42acece1a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588734 Dec 21 03:54:15.006351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4b4df7e4-8068-4f40-b0f1-278ede48f43a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=69c396e520a74e9ba7997b4aff723f57&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3095562 Dec 21 03:54:15.006351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4df7e4-8068-4f40-b0f1-278ede48f43a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00ff4110-294d-41f3-bcd4-b24fdc917e92,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:15.006784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57250) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:15.058548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6643d76e-8786-4753-9d7b-6120ee5d9571 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.080700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6643d76e-8786-4753-9d7b-6120ee5d9571 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.089071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ccb276-3268-4b12-8858-5fde08264eae req-487369f5-b21d-4c8d-b99c-a322352b9df2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:15.090563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15ccb276-3268-4b12-8858-5fde08264eae req-487369f5-b21d-4c8d-b99c-a322352b9df2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0491190 Dec 21 03:54:15.138272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15ccb276-3268-4b12-8858-5fde08264eae req-1edff899-00e1-4174-86da-3c00c1e4fb87 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414901 Dec 21 03:54:15.182684 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6643d76e-8786-4753-9d7b-6120ee5d9571 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.185383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6643d76e-8786-4753-9d7b-6120ee5d9571 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.186496 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6643d76e-8786-4753-9d7b-6120ee5d9571 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/00ff4110-294d-41f3-bcd4-b24fdc917e92 HTTP/1.1" status: 204 len: 168 time: 0.1776390 Dec 21 03:54:15.194549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6643d76e-8786-4753-9d7b-6120ee5d9571 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00ff4110-294d-41f3-bcd4-b24fdc917e92,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:15.352118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d85485b-c8d6-444e-b9fa-37e891fb5890 req-29028609-5461-4526-9c86-ba9cb09bc94f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:15.353838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d85485b-c8d6-444e-b9fa-37e891fb5890 req-29028609-5461-4526-9c86-ba9cb09bc94f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0542707 Dec 21 03:54:15.431725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d85485b-c8d6-444e-b9fa-37e891fb5890 req-7feed6cb-6d95-4acf-aea8-b023734fdea9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714319 Dec 21 03:54:15.443861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0a58d8-9d71-45cd-82de-1b932d0f88c6 req-d70a9b0c-5b49-459e-a574-e4acf701f9d4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:15.445393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b0a58d8-9d71-45cd-82de-1b932d0f88c6 req-d70a9b0c-5b49-459e-a574-e4acf701f9d4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0776429 Dec 21 03:54:15.498399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b0a58d8-9d71-45cd-82de-1b932d0f88c6 req-be36c065-00ae-4540-9188-d9c799bc9ebc tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450735 Dec 21 03:54:15.769725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:15.783237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52df9a8-19c7-4f60-9a38-158f66d4f6d7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.858370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52df9a8-19c7-4f60-9a38-158f66d4f6d7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.936493 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52df9a8-19c7-4f60-9a38-158f66d4f6d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:15.974323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f52df9a8-19c7-4f60-9a38-158f66d4f6d7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4e1a76af3ed844efbf3f10ad094db95d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2035038 Dec 21 03:54:15.975208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52df9a8-19c7-4f60-9a38-158f66d4f6d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d6360b4-767b-4608-996a-7dc712be93f6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:15.977846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57268) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:16.027994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee9c1b9b-fb92-4dc6-b5dc-092698973ecd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:16.049075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee9c1b9b-fb92-4dc6-b5dc-092698973ecd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:16.125492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3140ec64-b0ad-4bd3-a981-54e25a7a9ba3 req-e6b621a2-2521-4c08-b3d5-575a531bed86 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:16.127012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3140ec64-b0ad-4bd3-a981-54e25a7a9ba3 req-e6b621a2-2521-4c08-b3d5-575a531bed86 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0718577 Dec 21 03:54:16.175342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3140ec64-b0ad-4bd3-a981-54e25a7a9ba3 req-a95db42f-ebc6-411f-aa15-3592ff76341d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421133 Dec 21 03:54:16.176909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee9c1b9b-fb92-4dc6-b5dc-092698973ecd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:16.180096 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee9c1b9b-fb92-4dc6-b5dc-092698973ecd admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:16.184037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ee9c1b9b-fb92-4dc6-b5dc-092698973ecd admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9d6360b4-767b-4608-996a-7dc712be93f6 HTTP/1.1" status: 204 len: 168 time: 0.2020919 Dec 21 03:54:16.201199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9c1b9b-fb92-4dc6-b5dc-092698973ecd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d6360b4-767b-4608-996a-7dc712be93f6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:16.280120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0dd000-f304-4762-bb60-ea99407d29fc req-d09aa6fd-809c-4dbd-8bd1-450e12b5b8ee tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:16.281648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f0dd000-f304-4762-bb60-ea99407d29fc req-d09aa6fd-809c-4dbd-8bd1-450e12b5b8ee tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0485847 Dec 21 03:54:16.329557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f0dd000-f304-4762-bb60-ea99407d29fc req-d50c8525-5613-4da8-a8a9-6eb8f47b46de tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417483 Dec 21 03:54:16.558785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef38c3e-8202-4cdf-9751-54bf48416469 req-61703446-92e0-4ada-bb09-ec1f8c654365 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:16.560414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cef38c3e-8202-4cdf-9751-54bf48416469 req-61703446-92e0-4ada-bb09-ec1f8c654365 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0580561 Dec 21 03:54:16.640235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cef38c3e-8202-4cdf-9751-54bf48416469 req-e09ccd60-bdd4-4ec1-8e47-641651d31f28 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739174 Dec 21 03:54:16.651101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f26a67-d216-4b52-a763-f9d7af6ebc0b req-97a758d6-fd5c-4884-8485-9e2a900dade3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:16.652597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5f26a67-d216-4b52-a763-f9d7af6ebc0b req-97a758d6-fd5c-4884-8485-9e2a900dade3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0788562 Dec 21 03:54:16.701433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5f26a67-d216-4b52-a763-f9d7af6ebc0b req-49e81894-e154-4b27-a8c4-f8707588fb84 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423963 Dec 21 03:54:17.303767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6522fba-5088-4363-8d04-12ebd07b44b2 req-25f25282-45a2-4b3d-bba9-11286bbce8c5 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:17.305269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6522fba-5088-4363-8d04-12ebd07b44b2 req-25f25282-45a2-4b3d-bba9-11286bbce8c5 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0497713 Dec 21 03:54:17.356851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6522fba-5088-4363-8d04-12ebd07b44b2 req-d61f036a-ac76-41aa-9dd2-b6e3a234b829 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456057 Dec 21 03:54:17.459377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b2585d-a5fa-4186-a003-6bb251e342ec req-6212081a-cfc6-4796-b5bf-1b5fd22da8a8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:17.459377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91b2585d-a5fa-4186-a003-6bb251e342ec req-6212081a-cfc6-4796-b5bf-1b5fd22da8a8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0514722 Dec 21 03:54:17.504223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91b2585d-a5fa-4186-a003-6bb251e342ec req-b70d0920-119b-4a61-b06b-8e94b560e3e1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428305 Dec 21 03:54:17.765096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed15265-7af7-45e4-ae29-3bb535471aef req-5509a471-1fb2-424f-a111-3b75e915735b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:17.766656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed15265-7af7-45e4-ae29-3bb535471aef req-5509a471-1fb2-424f-a111-3b75e915735b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0562408 Dec 21 03:54:17.857958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed15265-7af7-45e4-ae29-3bb535471aef req-54defe87-410f-496b-a911-e456f13bedc9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786109 Dec 21 03:54:17.871357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3fa96a5-251f-4269-8e1b-b45ed41f522e req-895d26af-557b-4220-9cba-9ee8d677ff70 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:17.873147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3fa96a5-251f-4269-8e1b-b45ed41f522e req-895d26af-557b-4220-9cba-9ee8d677ff70 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0792282 Dec 21 03:54:17.924623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3fa96a5-251f-4269-8e1b-b45ed41f522e req-2e9d3a9c-22cd-421d-8c21-0180d7c75a1b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459950 Dec 21 03:54:18.475207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee50782-4d6a-470e-a553-782033051c31 req-d892c1b7-2f59-4a80-b421-af9cc4b8fd75 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:18.476714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee50782-4d6a-470e-a553-782033051c31 req-d892c1b7-2f59-4a80-b421-af9cc4b8fd75 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0499899 Dec 21 03:54:18.525630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee50782-4d6a-470e-a553-782033051c31 req-1f225384-67a4-4f91-ac0a-1b4c41b84990 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424938 Dec 21 03:54:18.629477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2a3bbf-4879-462c-a5bd-44f9c7b6a1c8 req-716a2adb-72d7-422a-9674-41e1834f32ac tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:18.630990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df2a3bbf-4879-462c-a5bd-44f9c7b6a1c8 req-716a2adb-72d7-422a-9674-41e1834f32ac tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0546048 Dec 21 03:54:18.651737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:18.690731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df2a3bbf-4879-462c-a5bd-44f9c7b6a1c8 req-cf2793fc-ae9f-41e8-9e54-eeb269d6beb2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533822 Dec 21 03:54:18.753655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:18.764974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'mac_address': 'fa:16:3e:a4:67:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:54:18.802104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:18.821809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id da1bad89-a5fb-446c-af44-dde02dbd5709 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:18.841497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:18.925734 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:18.982067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:18.983289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756d7af5-8a1d-4dce-8af7-3668c216cb41 req-957b64b4-33aa-4958-8a35-377aac8ef449 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:18.992239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-756d7af5-8a1d-4dce-8af7-3668c216cb41 req-957b64b4-33aa-4958-8a35-377aac8ef449 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.0648518 Dec 21 03:54:19.047917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-756d7af5-8a1d-4dce-8af7-3668c216cb41 req-837ed203-d8da-40cc-b640-82d993b015bb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546265 Dec 21 03:54:19.091557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe8d23aa-e332-45b9-ab47-2960fc6b66f8 req-43855483-5b99-4445-ac33-2aeb49806dc5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:19.093648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe8d23aa-e332-45b9-ab47-2960fc6b66f8 req-43855483-5b99-4445-ac33-2aeb49806dc5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 945 time: 0.0623016 Dec 21 03:54:19.107010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['da1bad89-a5fb-446c-af44-dde02dbd5709'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:19.150846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe8d23aa-e332-45b9-ab47-2960fc6b66f8 req-191104a6-90bf-4c29-b3b6-0ba6658b8fce tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506465 Dec 21 03:54:19.652683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dff0cbf-51c5-488c-ade7-ec09862941fb req-dd12dc4d-1396-4247-92a1-6fbcc8789d16 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:19.658839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dff0cbf-51c5-488c-ade7-ec09862941fb req-dd12dc4d-1396-4247-92a1-6fbcc8789d16 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0522604 Dec 21 03:54:19.701134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dff0cbf-51c5-488c-ade7-ec09862941fb req-f8d33f0c-886f-48d8-af46-33059e3bca78 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406749 Dec 21 03:54:19.825792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdad8b8a-8795-46e5-aa2a-0651881441e4 req-430a148b-10f8-47a1-9ab8-4ca9b43a842b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:19.827716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdad8b8a-8795-46e5-aa2a-0651881441e4 req-430a148b-10f8-47a1-9ab8-4ca9b43a842b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0570612 Dec 21 03:54:19.894425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdad8b8a-8795-46e5-aa2a-0651881441e4 req-2809faa4-d236-4c19-9f8e-2f6b62966609 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596344 Dec 21 03:54:19.917040 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2cec4fba-e9db-45d9-a455-2fa6505d728f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:20.232650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614cb2e1-f587-471f-baf2-d78a30e785ab req-8493e203-8c89-4b29-9394-14fdfa9a305a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:20.239744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-614cb2e1-f587-471f-baf2-d78a30e785ab req-8493e203-8c89-4b29-9394-14fdfa9a305a tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.1087797 Dec 21 03:54:20.324037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-614cb2e1-f587-471f-baf2-d78a30e785ab req-bbab00c5-3d03-4320-9493-cbb4c34c6eef tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0833514 Dec 21 03:54:20.423842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ebe6ee-a956-47db-a2da-c4056637573e req-fe33e6cf-0d0e-42fd-b74c-5959ba505fc4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:20.438596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69ebe6ee-a956-47db-a2da-c4056637573e req-fe33e6cf-0d0e-42fd-b74c-5959ba505fc4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 945 time: 0.0862775 Dec 21 03:54:20.498501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69ebe6ee-a956-47db-a2da-c4056637573e req-c137da53-c51d-45d9-9cb6-790be1f4ccc6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551968 Dec 21 03:54:20.667110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:20.675217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:54:20.795405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port da1bad89-a5fb-446c-af44-dde02dbd5709 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:20.795795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:20.874325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df15165-c1a0-474b-b7c5-66f39e1183f9 req-f98cb27b-8d1c-4155-b578-a0aa77d31e80 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:20.884101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df15165-c1a0-474b-b7c5-66f39e1183f9 req-f98cb27b-8d1c-4155-b578-a0aa77d31e80 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0910332 Dec 21 03:54:20.906857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:20.927440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:20.929458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605', 'port_id': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'mac_address': 'fa:16:3e:5e:ea:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13099c8a-54c1-41b2-a4f4-664d17e69495', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:54:20.969216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df15165-c1a0-474b-b7c5-66f39e1183f9 req-b65b29a7-ca7b-433f-95b4-559ed96b2047 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830369 Dec 21 03:54:20.989113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:20.991831 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71c53deb-653b-4426-a15d-d069d4e298e5" -d '{"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-plugged", "status": "completed", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:21.011262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:21.014614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:21.030477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 68a76cd7-fffa-4866-9c53-87b552b1bde6 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:21.056546 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:21.061944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:21.078170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec36790d-a946-4303-9426-54c1784e6b33 req-90f85bd0-5a17-49f3-84cf-4ef731739198 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:21.082213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec36790d-a946-4303-9426-54c1784e6b33 req-90f85bd0-5a17-49f3-84cf-4ef731739198 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0692244 Dec 21 03:54:21.085478 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a630f6d4-41b8-47b0-90a7-f823a2d010a2 x-openstack-request-id: req-a630f6d4-41b8-47b0-90a7-f823a2d010a2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:21.085777 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-plugged", "status": "completed", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:21.086036 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a630f6d4-41b8-47b0-90a7-f823a2d010a2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:21.086440 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'code': 200} Dec 21 03:54:21.134354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:21.148120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec36790d-a946-4303-9426-54c1784e6b33 req-3932f9d1-d03c-42a9-922f-7a1e623537f5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606296 Dec 21 03:54:21.171284 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:21.223029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:21.434536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fa382b-d747-4fa1-91be-51c7bc655f0d req-200c9285-ae07-4b66-ba64-4131ea547274 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:21.436837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16fa382b-d747-4fa1-91be-51c7bc655f0d req-200c9285-ae07-4b66-ba64-4131ea547274 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0581822 Dec 21 03:54:21.502725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16fa382b-d747-4fa1-91be-51c7bc655f0d req-49c409f4-034f-4a2f-b2ad-e3d7b429bdab tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597010 Dec 21 03:54:21.553411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['68a76cd7-fffa-4866-9c53-87b552b1bde6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:21.687516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4258d733-eaad-4446-82b4-2e1bae6f5ca5 req-45d39695-0bc4-4cb5-8335-b7ff1f55a3e9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:21.689766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4258d733-eaad-4446-82b4-2e1bae6f5ca5 req-45d39695-0bc4-4cb5-8335-b7ff1f55a3e9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1070247 Dec 21 03:54:21.766359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4258d733-eaad-4446-82b4-2e1bae6f5ca5 req-ed743f7d-d43e-4e5d-9139-e02168daceb7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651712 Dec 21 03:54:22.127566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f926272f-40f2-44c6-adf0-b38073418353 req-0d6a5a96-6eaf-493a-9540-75d71fdbbf48 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:22.129365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f926272f-40f2-44c6-adf0-b38073418353 req-0d6a5a96-6eaf-493a-9540-75d71fdbbf48 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0676258 Dec 21 03:54:22.168498 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f17dedd3-da1d-400e-a06a-a5416f1f8ab3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:22.212051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f926272f-40f2-44c6-adf0-b38073418353 req-b13af0b2-6b8d-4cb6-878e-8aae77fbd13f tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712078 Dec 21 03:54:22.294571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eebb025a-eb43-4ca0-8e31-70a37477ad97 req-f58ba897-46e4-46e1-9240-77f1386d8bb1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:22.296099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eebb025a-eb43-4ca0-8e31-70a37477ad97 req-f58ba897-46e4-46e1-9240-77f1386d8bb1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0621426 Dec 21 03:54:22.363687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eebb025a-eb43-4ca0-8e31-70a37477ad97 req-d468662a-3c68-440b-a7fa-64c74a1adf88 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570707 Dec 21 03:54:22.585823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:22.619828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04541331-7d4b-4133-8b61-4ab71ba39e7d req-3ed9158c-afec-4541-a632-1a3a49723094 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:22.621661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04541331-7d4b-4133-8b61-4ab71ba39e7d req-3ed9158c-afec-4541-a632-1a3a49723094 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.0685003 Dec 21 03:54:22.675288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:54:22.717142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c14ed55-4524-44f6-bb7d-3d69168a43dd req-0c7291f0-a212-483d-a244-c84445ef7f92 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:22.728697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c14ed55-4524-44f6-bb7d-3d69168a43dd req-0c7291f0-a212-483d-a244-c84445ef7f92 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.1052389 Dec 21 03:54:22.740399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04541331-7d4b-4133-8b61-4ab71ba39e7d req-640b0976-7922-43a4-830f-bf0c6dccfc0d tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1093478 Dec 21 03:54:22.792781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c14ed55-4524-44f6-bb7d-3d69168a43dd req-986e2d28-46ac-4acf-9c08-ccebd0de7d2c tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631492 Dec 21 03:54:22.817139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 68a76cd7-fffa-4866-9c53-87b552b1bde6 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:54:22.823003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 68a76cd7-fffa-4866-9c53-87b552b1bde6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:22.823402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:23.030067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:23.044105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c589c13-4e1c-46d0-8083-d38fc9d2178f req-bf6fea15-c0e9-40f6-833e-c14e025a7eb9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:23.045791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c589c13-4e1c-46d0-8083-d38fc9d2178f req-bf6fea15-c0e9-40f6-833e-c14e025a7eb9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0741994 Dec 21 03:54:23.104532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:23.107252 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65126c09-fb36-4716-8eaa-2f543f558032" -d '{"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-plugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:23.117649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:23.155811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c589c13-4e1c-46d0-8083-d38fc9d2178f req-79bc113f-d252-4d96-bb6e-f8f9bafd8a7d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002324 Dec 21 03:54:23.169891 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b36571a4-70ff-4a98-9289-0de2ce2cdc4c x-openstack-request-id: req-b36571a4-70ff-4a98-9289-0de2ce2cdc4c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:23.171102 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-plugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:23.171599 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b36571a4-70ff-4a98-9289-0de2ce2cdc4c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:23.172222 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'code': 200} Dec 21 03:54:23.182696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:23.218060 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:23.256210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:23.356725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a718522-9a11-46c7-9594-f13dc7f94359 req-e72a9c35-2c59-4bb9-ba0c-6760bb12ae36 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:23.358308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a718522-9a11-46c7-9594-f13dc7f94359 req-e72a9c35-2c59-4bb9-ba0c-6760bb12ae36 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0801740 Dec 21 03:54:23.361017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df4226e-b37f-4a30-b305-cc81dd2601a3 req-38a54000-8d62-468b-8791-39d1c37fc67b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:23.362394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3df4226e-b37f-4a30-b305-cc81dd2601a3 req-38a54000-8d62-468b-8791-39d1c37fc67b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1097 time: 0.0739429 Dec 21 03:54:23.434427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a718522-9a11-46c7-9594-f13dc7f94359 req-40f64257-020a-4e1e-98f6-fd836aa96415 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693762 Dec 21 03:54:23.440848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3df4226e-b37f-4a30-b305-cc81dd2601a3 req-b7f6cf01-0310-4242-a776-abb2b9458b72 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620871 Dec 21 03:54:23.496211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad59706c-cba1-429f-8132-dc8387ca094d req-770abdc3-e4ca-4189-9328-2b187ada48f6 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:23.497709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad59706c-cba1-429f-8132-dc8387ca094d req-770abdc3-e4ca-4189-9328-2b187ada48f6 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0516927 Dec 21 03:54:23.546863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad59706c-cba1-429f-8132-dc8387ca094d req-997fc933-d6e8-4d59-a1a7-874055f338cf tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430093 Dec 21 03:54:23.947236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4291ef37-adc3-4cf2-a76d-3e5983b0f3ee req-4b5e63a2-0d6a-4fe4-b395-4211b8962a50 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:23.954640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4291ef37-adc3-4cf2-a76d-3e5983b0f3ee req-4b5e63a2-0d6a-4fe4-b395-4211b8962a50 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.0848024 Dec 21 03:54:24.019507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4291ef37-adc3-4cf2-a76d-3e5983b0f3ee req-08715b0f-aa8a-4a21-9393-775bfa4fc39f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625863 Dec 21 03:54:24.095607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebb68cc-8979-4406-82d8-4104a9a0421c req-7c3a4afd-586d-4b07-affa-bbbb996b91b5 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:24.097431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebb68cc-8979-4406-82d8-4104a9a0421c req-7c3a4afd-586d-4b07-affa-bbbb996b91b5 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.0762312 Dec 21 03:54:24.168366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebb68cc-8979-4406-82d8-4104a9a0421c req-f441fa2a-584a-4677-aeb2-1704ddcdc435 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0643382 Dec 21 03:54:24.663757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d1bd415-529b-4b98-8dc9-81d124336a9a req-a00bf27c-169b-43f5-902e-2d86cc6610b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:24.671447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d1bd415-529b-4b98-8dc9-81d124336a9a req-a00bf27c-169b-43f5-902e-2d86cc6610b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1184711 Dec 21 03:54:24.731357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b302e7-8232-4b1b-b2a1-445201fb7577 req-674d68b1-9e3c-489a-9e02-ac7792b11233 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:24.732792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55b302e7-8232-4b1b-b2a1-445201fb7577 req-674d68b1-9e3c-489a-9e02-ac7792b11233 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1168189 Dec 21 03:54:24.777213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d1bd415-529b-4b98-8dc9-81d124336a9a req-963c3749-aa7e-4e9a-97ad-cc98324afc0c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1047730 Dec 21 03:54:24.826832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:24.883025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55b302e7-8232-4b1b-b2a1-445201fb7577 req-5dafe27c-43a6-41c8-9c90-1d53266d505e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1429017 Dec 21 03:54:25.005391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:25.005604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d200e55-f93a-4339-a0b5-8bef4c1aaef5 req-96d41ea3-9e48-4dd1-9777-d5b4b57e94b1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:25.014780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d200e55-f93a-4339-a0b5-8bef4c1aaef5 req-96d41ea3-9e48-4dd1-9777-d5b4b57e94b1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1046588 Dec 21 03:54:25.099125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d200e55-f93a-4339-a0b5-8bef4c1aaef5 req-26d39f87-b4bf-4d89-a839-3b1f0e92a18c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839202 Dec 21 03:54:25.253216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4dd468-a344-4ddb-9bf1-f3e81e2e48a1 req-0a864386-51af-48c0-823e-2ee6ba5a826f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:25.272140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f4dd468-a344-4ddb-9bf1-f3e81e2e48a1 req-0a864386-51af-48c0-823e-2ee6ba5a826f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.0810492 Dec 21 03:54:25.329392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f4dd468-a344-4ddb-9bf1-f3e81e2e48a1 req-14408bcf-3a09-442b-9c45-8ded4c915a78 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560968 Dec 21 03:54:25.672079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc21abb1-474f-49c7-86ea-be181f8bc06b req-96148bb5-1244-46b3-bff3-e211d92f056f tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:25.674623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:25.683914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc21abb1-474f-49c7-86ea-be181f8bc06b req-96148bb5-1244-46b3-bff3-e211d92f056f tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1097 time: 0.1241074 Dec 21 03:54:25.699913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-469dcf6b-4ed3-4423-9a51-29e060ae711f req-eb80bb8b-3b26-447d-b74e-5fa32d1f87f1 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:25.703467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-469dcf6b-4ed3-4423-9a51-29e060ae711f req-eb80bb8b-3b26-447d-b74e-5fa32d1f87f1 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.0891578 Dec 21 03:54:25.783628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc21abb1-474f-49c7-86ea-be181f8bc06b req-302f6249-960e-4578-87fe-4f466dfa0550 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982029 Dec 21 03:54:25.815557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-469dcf6b-4ed3-4423-9a51-29e060ae711f req-8692ec9a-237d-4b78-9d6c-cda7e18e524f tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1044426 Dec 21 03:54:25.959063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96248b60-1ea5-4582-8db5-156a7d4c43e7 req-cb4a1134-c5bb-42ac-b0ae-86692eb7ff12 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:25.960755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96248b60-1ea5-4582-8db5-156a7d4c43e7 req-cb4a1134-c5bb-42ac-b0ae-86692eb7ff12 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1118228 Dec 21 03:54:25.979700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa419a1-1bd1-44b1-831b-71a64608c47b req-4d3ffdcc-6aaf-4645-9e61-0ada3dff5ab7 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:25.981393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aa419a1-1bd1-44b1-831b-71a64608c47b req-4d3ffdcc-6aaf-4645-9e61-0ada3dff5ab7 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1097 time: 0.0812356 Dec 21 03:54:26.096664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96248b60-1ea5-4582-8db5-156a7d4c43e7 req-45fb2a79-4b64-41a0-b907-5131d112a7db tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1108162 Dec 21 03:54:26.101064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1aa419a1-1bd1-44b1-831b-71a64608c47b req-d86c9041-b0ba-4e3b-ad1d-609536c41dce tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028938 Dec 21 03:54:26.347752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675a0d1c-ea10-4498-913a-249b34be597c req-08bd3dc1-de53-4915-a3e6-620f262df146 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:26.358845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-675a0d1c-ea10-4498-913a-249b34be597c req-08bd3dc1-de53-4915-a3e6-620f262df146 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1412685 Dec 21 03:54:26.431995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-675a0d1c-ea10-4498-913a-249b34be597c req-40ad93ea-b116-45a2-913a-4d36c21f057c tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690050 Dec 21 03:54:26.448252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd24e929-2bac-42c3-ad84-6cc59f5d4262 req-ce7ddbf2-b815-47ac-9a71-6fa160c297e4 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:26.462495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd24e929-2bac-42c3-ad84-6cc59f5d4262 req-ce7ddbf2-b815-47ac-9a71-6fa160c297e4 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1853726 Dec 21 03:54:26.561498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-4e61d566-7869-4063-be17-500443948589 req-b9589efd-9c08-4745-ac74-f6428f406bd9 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:54:26.562773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e61d566-7869-4063-be17-500443948589 req-b9589efd-9c08-4745-ac74-f6428f406bd9 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0113328 Dec 21 03:54:26.571974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd24e929-2bac-42c3-ad84-6cc59f5d4262 req-1b855208-c799-4e82-8e78-aab5b0791aa1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020811 Dec 21 03:54:27.009707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0f7c3c-1aa8-4066-a3d6-c519c23988be req-72b9b41b-dfa3-482b-b1a0-ff7ff358f10d tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:27.028107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e0f7c3c-1aa8-4066-a3d6-c519c23988be req-72b9b41b-dfa3-482b-b1a0-ff7ff358f10d tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.1239309 Dec 21 03:54:27.111129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57556) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:27.158856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e0f7c3c-1aa8-4066-a3d6-c519c23988be req-76c71497-8f99-40d6-9b97-962726b7c639 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups?id=aea81f67-7856-4a95-a9d4-70c172b531de&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1293640 Dec 21 03:54:27.215210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-fae73726-2c08-4de6-8a56-9355bb48803e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:27.224137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-fae73726-2c08-4de6-8a56-9355bb48803e tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.31 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 946 time: 0.1657696 Dec 21 03:54:27.303689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e9a4f6c-6bc6-4f44-a785-7d619ea64051 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:27.462548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e9a4f6c-6bc6-4f44-a785-7d619ea64051 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:27.495897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59657812-8127-4233-9680-54710fcec0df req-e37d5f10-0f0d-4019-b64d-c32793d491b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:27.497472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59657812-8127-4233-9680-54710fcec0df req-e37d5f10-0f0d-4019-b64d-c32793d491b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.2663753 Dec 21 03:54:27.556546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Deleting port c0232674-4f5f-4ef3-aaac-768ebf42fd82 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:27.556910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:27.592748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59657812-8127-4233-9680-54710fcec0df req-fae8d565-5ca1-439c-a409-bc018b58fc32 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854609 Dec 21 03:54:27.715041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] For port c0232674-4f5f-4ef3-aaac-768ebf42fd82, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c0232674-4f5f-4ef3-aaac-768ebf42fd82,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:27.715317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:27.813801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59647d2-92d3-45a8-88c8-2cc04b17f689 req-72d97072-e4d0-49bd-b745-05f563a16639 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:27.819126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a59647d2-92d3-45a8-88c8-2cc04b17f689 req-72d97072-e4d0-49bd-b745-05f563a16639 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1516483 Dec 21 03:54:27.873169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e9a4f6c-6bc6-4f44-a785-7d619ea64051 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:27.914368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9a4f6c-6bc6-4f44-a785-7d619ea64051 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1798316-06c5-42c0-9a8b-8bb4d0dd6ae2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:27.931816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7e9a4f6c-6bc6-4f44-a785-7d619ea64051 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8a2677bbf0de4a99a57a2ea3c7b47946&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8196549 Dec 21 03:54:27.934523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57584) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:27.944940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a59647d2-92d3-45a8-88c8-2cc04b17f689 req-7eca15f9-5d7d-4005-8d00-22329627c9f9 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1187522 Dec 21 03:54:28.013286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-303f0ac9-6f27-4258-a4ee-8eef968d9d46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.048433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-303f0ac9-6f27-4258-a4ee-8eef968d9d46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.051245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.051895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.052384 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Floating IP c1fc1249-2bd4-4e7a-b521-c3523185276b disassociated. External IP: 172.25.5.69, port: c0232674-4f5f-4ef3-aaac-768ebf42fd82. Dec 21 03:54:28.052922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Calling delete_port for c0232674-4f5f-4ef3-aaac-768ebf42fd82 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:28.183049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-303f0ac9-6f27-4258-a4ee-8eef968d9d46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.189577 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-303f0ac9-6f27-4258-a4ee-8eef968d9d46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.191053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-303f0ac9-6f27-4258-a4ee-8eef968d9d46 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b1798316-06c5-42c0-9a8b-8bb4d0dd6ae2 HTTP/1.1" status: 204 len: 168 time: 0.2456865 Dec 21 03:54:28.191177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70abeded-551e-4aa1-9187-9e4dac258516 req-3ff82731-7379-407d-8f7c-0f36e412a19e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:28.193882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70abeded-551e-4aa1-9187-9e4dac258516 req-3ff82731-7379-407d-8f7c-0f36e412a19e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1345351 Dec 21 03:54:28.215062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-303f0ac9-6f27-4258-a4ee-8eef968d9d46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1798316-06c5-42c0-9a8b-8bb4d0dd6ae2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:28.300468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70abeded-551e-4aa1-9187-9e4dac258516 req-f9107e07-5f42-4fe6-9f46-c15208a3265c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934229 Dec 21 03:54:28.446065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:28.517302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event deleted for resources: {'Port': ['ID=c0232674-4f5f-4ef3-aaac-768ebf42fd82,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:28.684250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27c48cb4-9a4a-48c6-a34d-dcaddb3cede7 req-9418562a-a45b-42a2-872a-dafd94a7d7f4 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 210 time: 0.0359371 Dec 21 03:54:28.709742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Router afc96f13-e71f-4841-88a7-5c551515b510 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:54:28.885135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ea1d8f1-5315-4cd1-b909-21f2a0402e33 req-c25a5081-7a11-46ce-8146-6463fea9d10f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:28.886761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ea1d8f1-5315-4cd1-b909-21f2a0402e33 req-c25a5081-7a11-46ce-8146-6463fea9d10f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1059983 Dec 21 03:54:28.890136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:54:28.914657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] Sync routers for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:54:28.933231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:54:28.934169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:28.981325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] No DVR routers for this DVR port c0232674-4f5f-4ef3-aaac-768ebf42fd82 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:54:29.004172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:29.004172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30b2f433-834b-46d9-b0f7-6a9d4fbbcffd req-d2fa0a54-106b-4475-82f9-ea22783323de tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.31 "DELETE /v2.0/ports/c0232674-4f5f-4ef3-aaac-768ebf42fd82 HTTP/1.1" status: 204 len: 173 time: 1.7568102 Dec 21 03:54:29.004172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'name': 'network-vif-deleted', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:29.004172 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df3a524f-c570-40db-b45f-8a7523e38f08" -d '{"events": [{"server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "name": "network-vif-deleted", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:29.011236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ea1d8f1-5315-4cd1-b909-21f2a0402e33 req-8043ff21-6dc2-40a9-9488-df187c2a38f9 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827770 Dec 21 03:54:29.084919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:54:29.225081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6be7fa4-697b-487d-a762-31ff0ef916d1 req-0121eabd-3987-422c-9cd7-3f0e497ed28d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:29.234983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6be7fa4-697b-487d-a762-31ff0ef916d1 req-0121eabd-3987-422c-9cd7-3f0e497ed28d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0793238 Dec 21 03:54:29.293940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6be7fa4-697b-487d-a762-31ff0ef916d1 req-a8bebebc-69b2-4683-b5dd-76a63411282f tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609200 Dec 21 03:54:29.349093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57610) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:29.361712 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6675b3f4-6cf4-4548-bbf5-5b3d36618122 x-openstack-request-id: req-6675b3f4-6cf4-4548-bbf5-5b3d36618122 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:29.362009 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad81a84e-2a09-447d-990d-bf213cae5697", "name": "network-vif-deleted", "tag": "c0232674-4f5f-4ef3-aaac-768ebf42fd82", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:29.362269 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6675b3f4-6cf4-4548-bbf5-5b3d36618122 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:29.362740 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad81a84e-2a09-447d-990d-bf213cae5697', 'name': 'network-vif-deleted', 'tag': 'c0232674-4f5f-4ef3-aaac-768ebf42fd82', 'status': 'completed', 'code': 200} Dec 21 03:54:29.373154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8bb8c17-d353-4656-97cc-51a0b2c7aa51 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:29.451181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:29.499358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-fb516691-291c-4a82-bc71-c4cb9af37032 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 03:54:29.508017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-fb516691-291c-4a82-bc71-c4cb9af37032 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3358259 Dec 21 03:54:29.520949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] Checking router: afc96f13-e71f-4841-88a7-5c551515b510 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:54:29.544795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:54:29.548693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:29.557692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ee0e05-644d-4ebf-a9b6-edc10ab55b7a req-eb0634cf-cf85-4aca-9a6f-0d9293288af8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:29.565385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ee0e05-644d-4ebf-a9b6-edc10ab55b7a req-eb0634cf-cf85-4aca-9a6f-0d9293288af8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1404600 Dec 21 03:54:29.574273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8bb8c17-d353-4656-97cc-51a0b2c7aa51 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:29.625243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ee0e05-644d-4ebf-a9b6-edc10ab55b7a req-1184ea22-df7a-464e-aa32-7dfe85b3d545 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589068 Dec 21 03:54:29.651540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8bb8c17-d353-4656-97cc-51a0b2c7aa51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:29.725638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8bb8c17-d353-4656-97cc-51a0b2c7aa51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7685ee0c-01a5-4a90-983a-abe63a26c46e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:29.741705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:54:29.756976 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a8bb8c17-d353-4656-97cc-51a0b2c7aa51 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2c34beedebd54b6eac586eed28270d9f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4056458 Dec 21 03:54:29.759349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57620) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:29.764955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-af1aa5b1-ca59-4e16-84ea-dd416288d684 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:29.766372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-af1aa5b1-ca59-4e16-84ea-dd416288d684 service neutron] 10.222.0.18 "GET /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 1094 time: 0.2573316 Dec 21 03:54:29.778417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Request body: {'binding': {'host': 'n-h1-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:29.780955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Unknown quota resources ['binding']. {{(pid=110311) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 03:54:29.850068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5743ef2a-5b22-4d09-95cd-b0fdbbbafe3c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:29.908729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5743ef2a-5b22-4d09-95cd-b0fdbbbafe3c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:30.015802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on host n-h1-822053-11 for vnic_type normal with profile None {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:30.016429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:30.016941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:30.020014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4245936-d2ff-4591-b0be-f34ec5781848 req-64cbad0c-5aa0-4074-928a-736930984c20 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/ports?device_id=ad81a84e-2a09-447d-990d-bf213cae5697 HTTP/1.1" status: 200 len: 210 time: 0.0597804 Dec 21 03:54:30.027803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:30.027803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:30.031905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 54, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:30.031905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:30.032209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:30.032526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Bound port: 68a76cd7-fffa-4866-9c53-87b552b1bde6, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:30.054584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:30.109047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0456e7f-b783-4ab2-be09-48e2a3cfcbdd None None] The sync data for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 is: [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:52:10Z', 'revision_number': 4, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe', 'name': '', 'network_id': 'a4370ec5-c219-4c56-a17c-433f7c352683', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'mac_address': 'fa:16:3e:d6:02:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_interface', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:09Z', 'updated_at': '2021-12-21T03:52:15Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'subnets': [{'id': '96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:54:30.116005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:30.125797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5743ef2a-5b22-4d09-95cd-b0fdbbbafe3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:30.128643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5743ef2a-5b22-4d09-95cd-b0fdbbbafe3c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:30.130888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5743ef2a-5b22-4d09-95cd-b0fdbbbafe3c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7685ee0c-01a5-4a90-983a-abe63a26c46e HTTP/1.1" status: 204 len: 168 time: 0.3694439 Dec 21 03:54:30.155614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5743ef2a-5b22-4d09-95cd-b0fdbbbafe3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7685ee0c-01a5-4a90-983a-abe63a26c46e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:30.190546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:30.191830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] 10.222.0.18 "POST /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6/bindings HTTP/1.1" status: 201 len: 390 time: 0.4179621 Dec 21 03:54:30.604945 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4d5a368-ea7b-42ad-a7f1-dadf15bc3788 None None] New status for floating IP c1fc1249-2bd4-4e7a-b521-c3523185276b: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:54:30.708781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c0232674-4f5f-4ef3-aaac-768ebf42fd82 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:30.757391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: c0232674-4f5f-4ef3-aaac-768ebf42fd82 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:54:30.757710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c0232674-4f5f-4ef3-aaac-768ebf42fd82 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:54:30.776446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59a846c-79b3-44b1-bcf3-a841619544cc req-431a9c3e-a7ce-47de-9394-32a4e8148259 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:30.778006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a59a846c-79b3-44b1-bcf3-a841619544cc req-431a9c3e-a7ce-47de-9394-32a4e8148259 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.6184616 Dec 21 03:54:30.790717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bdae0-6bac-4c57-94bf-b0b3b694d4e4 req-80818f32-1ba9-47e9-a8ec-c18a26aebd1d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:30.792422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-600bdae0-6bac-4c57-94bf-b0b3b694d4e4 req-80818f32-1ba9-47e9-a8ec-c18a26aebd1d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0844274 Dec 21 03:54:30.874428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a59a846c-79b3-44b1-bcf3-a841619544cc req-a7398834-8a1a-4687-8a76-12cf78d71b72 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808604 Dec 21 03:54:30.909498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-600bdae0-6bac-4c57-94bf-b0b3b694d4e4 req-8762e7ef-8cd2-4d1b-a941-b7f8ef85e0ad tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1009419 Dec 21 03:54:31.074562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-5c674996-2ff7-4c61-ba09-a68c08e74371 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:31.076321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-5c674996-2ff7-4c61-ba09-a68c08e74371 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1097 time: 0.0709729 Dec 21 03:54:31.103851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86232f5f-288d-46b2-ba77-ed779a60b35b req-347ba639-aabf-45ae-83c9-a6e1a50acb45 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:31.113821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86232f5f-288d-46b2-ba77-ed779a60b35b req-347ba639-aabf-45ae-83c9-a6e1a50acb45 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1155534 Dec 21 03:54:31.141738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57640) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:31.178617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86232f5f-288d-46b2-ba77-ed779a60b35b req-77e7806c-f4f4-4796-b2d1-03d0697ac4f1 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637004 Dec 21 03:54:31.191090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d38437f8-c211-4e12-9056-db226a0bd2fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.201507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58ed8a1-2691-4b78-8364-405e868e774b req-b1c1d6ec-61c6-4e6a-bcab-aa78ae87ab04 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:31.209337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f58ed8a1-2691-4b78-8364-405e868e774b req-b1c1d6ec-61c6-4e6a-bcab-aa78ae87ab04 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1622963 Dec 21 03:54:31.249575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-d5549383-6e1b-418c-9b06-7894013a78a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:31.251557 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-d5549383-6e1b-418c-9b06-7894013a78a2 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1668885 Dec 21 03:54:31.270411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f58ed8a1-2691-4b78-8364-405e868e774b req-b7ab06a7-8cc9-4514-9c31-b3ea6641a7e3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601733 Dec 21 03:54:31.315810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-d7ae5107-2e16-4245-9142-ffe2d36a164b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 217 time: 0.0523813 Dec 21 03:54:31.404412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-ff3e95ee-ba8d-4bb1-9d6d-c50f92c74fc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:31.406234 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-ff3e95ee-ba8d-4bb1-9d6d-c50f92c74fc9 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0786669 Dec 21 03:54:31.408188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d38437f8-c211-4e12-9056-db226a0bd2fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.441535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57644) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:31.444752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-b2588945-9e9d-4dc6-b13d-588c930111ea service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0280182 Dec 21 03:54:31.463697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d38437f8-c211-4e12-9056-db226a0bd2fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.513809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a8e681d-6e91-4d01-9e54-3d66fdf61762 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.546013 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a8e681d-6e91-4d01-9e54-3d66fdf61762 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.566420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d38437f8-c211-4e12-9056-db226a0bd2fa admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0bbaa3b451ef4852a6eead851a1de531&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4213724 Dec 21 03:54:31.567621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57646) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:31.571882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38437f8-c211-4e12-9056-db226a0bd2fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60da7760-d2bc-4843-b3cb-7d0bdbaabbde,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:31.594614 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-8e46bf35-9c91-426b-b512-ddb2628a80cb service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1404009 Dec 21 03:54:31.672595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6245142-7af5-4735-98e6-d4aedefbba6d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.701096 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6245142-7af5-4735-98e6-d4aedefbba6d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.709895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-aecbd458-4b88-4510-9457-dd94f26df70e service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1028225 Dec 21 03:54:31.726794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a8e681d-6e91-4d01-9e54-3d66fdf61762 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.729631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a8e681d-6e91-4d01-9e54-3d66fdf61762 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.730801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a8e681d-6e91-4d01-9e54-3d66fdf61762 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "DELETE /v2.0/security-groups/aea81f67-7856-4a95-a9d4-70c172b531de HTTP/1.1" status: 204 len: 168 time: 0.2879686 Dec 21 03:54:31.734456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:31.749201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8e681d-6e91-4d01-9e54-3d66fdf61762 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aea81f67-7856-4a95-a9d4-70c172b531de,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:31.758657 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-fa5e2128-bb9d-4514-99ab-1c4f3442b8fb tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] show failed (client error): The resource could not be found. Dec 21 03:54:31.762717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa5e2128-bb9d-4514-99ab-1c4f3442b8fb tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "GET /v2.0/security-groups/aea81f67-7856-4a95-a9d4-70c172b531de HTTP/1.1" status: 404 len: 347 time: 0.0238330 Dec 21 03:54:31.763073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57650) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:31.882912 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6245142-7af5-4735-98e6-d4aedefbba6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.886478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6245142-7af5-4735-98e6-d4aedefbba6d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:31.887104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b6245142-7af5-4735-98e6-d4aedefbba6d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/60da7760-d2bc-4843-b3cb-7d0bdbaabbde HTTP/1.1" status: 204 len: 168 time: 0.3184381 Dec 21 03:54:31.901013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6245142-7af5-4735-98e6-d4aedefbba6d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60da7760-d2bc-4843-b3cb-7d0bdbaabbde,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:31.941984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Deleting port 37f80abf-83e2-432a-a5ae-59b5714dccdb {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:31.941984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:32.160737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:32.161238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:32.187415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Calling delete_port for 37f80abf-83e2-432a-a5ae-59b5714dccdb owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:32.197190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03e5cee-c289-4268-8a28-1a3b2368770c req-c2d92a38-3328-458e-aafd-4f93844a7e5a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:32.205232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e5cee-c289-4268-8a28-1a3b2368770c req-c2d92a38-3328-458e-aafd-4f93844a7e5a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1573565 Dec 21 03:54:32.279432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc75905-6014-4e4d-a0f9-291f93e0df25 req-77e145b9-6ebd-4cdc-b3f4-1aa0ec9d06f4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:32.287448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc75905-6014-4e4d-a0f9-291f93e0df25 req-77e145b9-6ebd-4cdc-b3f4-1aa0ec9d06f4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.2040977 Dec 21 03:54:32.357627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d03e5cee-c289-4268-8a28-1a3b2368770c req-d4d36906-0949-438e-aaca-95451052a898 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1513562 Dec 21 03:54:32.383230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc75905-6014-4e4d-a0f9-291f93e0df25 req-4d6e9f15-da55-4c1f-a770-a68232aa30f8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948732 Dec 21 03:54:32.554950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59887a0-9f1d-477c-a024-79642275fa01 req-6a159d7a-0f2f-48e6-a7b4-dcd81815ba5d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:32.556476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e59887a0-9f1d-477c-a024-79642275fa01 req-6a159d7a-0f2f-48e6-a7b4-dcd81815ba5d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0814617 Dec 21 03:54:32.567774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e137d8b-57f1-4010-a204-fb215884cc01 req-fbb4e5a7-f62b-4d92-b2d3-ddef5a68aa9d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:32.569232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e137d8b-57f1-4010-a204-fb215884cc01 req-fbb4e5a7-f62b-4d92-b2d3-ddef5a68aa9d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1046138 Dec 21 03:54:32.640752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:32.697350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e59887a0-9f1d-477c-a024-79642275fa01 req-0cc8ee8a-1433-458d-8511-7ca5ef9f9a5a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1270995 Dec 21 03:54:32.701915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Pushing event deleted for resources: {'Port': ['ID=37f80abf-83e2-432a-a5ae-59b5714dccdb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:32.729691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4430bbc9-e5ae-4f96-8f6d-291380ed4660 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:32.765394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e137d8b-57f1-4010-a204-fb215884cc01 req-785f00c9-6968-45d7-a187-a91433de223b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759667 Dec 21 03:54:32.891275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:32.894775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:32.902440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:32.902896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1db3198e-7afb-4d7c-b0e9-6d72b88f2520 tempest-ServersTestManualDisk-642362945 tempest-ServersTestManualDisk-642362945-project] 10.222.0.18 "DELETE /v2.0/floatingips/c1fc1249-2bd4-4e7a-b521-c3523185276b HTTP/1.1" status: 204 len: 168 time: 1.1381214 Dec 21 03:54:33.005612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59b6b19-3b47-4d82-9c90-9169915e975c req-bde18a1e-5c9d-443d-ad13-11147bd8fadd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:33.007601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b59b6b19-3b47-4d82-9c90-9169915e975c req-bde18a1e-5c9d-443d-ad13-11147bd8fadd service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 1097 time: 0.1624417 Dec 21 03:54:33.231064 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b59b6b19-3b47-4d82-9c90-9169915e975c req-18674e99-eee2-4d79-8c21-d89a1311b6b2 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2159207 Dec 21 03:54:33.477090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:33.576736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb314946-54df-49a7-a659-9690086d4e5f req-b3eecf48-609c-41a5-9d11-5fcae827b4f1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:33.578282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb314946-54df-49a7-a659-9690086d4e5f req-b3eecf48-609c-41a5-9d11-5fcae827b4f1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0892396 Dec 21 03:54:33.591218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bcc8c19-a9ac-44dc-a6c7-a2a9a917a178 req-4402d87d-a931-4e9d-92cd-e38bb1ee8218 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:33.592789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bcc8c19-a9ac-44dc-a6c7-a2a9a917a178 req-4402d87d-a931-4e9d-92cd-e38bb1ee8218 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0937307 Dec 21 03:54:33.658393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb314946-54df-49a7-a659-9690086d4e5f req-c2d17e17-028e-40b6-a051-9fe7912e78dd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645702 Dec 21 03:54:33.716750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bcc8c19-a9ac-44dc-a6c7-a2a9a917a178 req-924e8e6f-566b-4085-828c-f03ed19eee49 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878961 Dec 21 03:54:33.886205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d37952f-e2ad-4ff9-b9ea-633583fe37ee req-c46b4d06-392d-4723-8139-16106e334da2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:33.887538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Deleting port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:33.887893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:33.888054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d37952f-e2ad-4ff9-b9ea-633583fe37ee req-c46b4d06-392d-4723-8139-16106e334da2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0967689 Dec 21 03:54:33.963839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d670dd6-b3fc-41a4-8142-bd518ce1a50a req-62168078-bc4a-4d4b-a144-9975ce390c9d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:33.965359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d670dd6-b3fc-41a4-8142-bd518ce1a50a req-62168078-bc4a-4d4b-a144-9975ce390c9d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1015971 Dec 21 03:54:33.977246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d37952f-e2ad-4ff9-b9ea-633583fe37ee req-3a7c7720-0380-4013-a1fe-5d56afacfc16 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679102 Dec 21 03:54:34.008687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] For port da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:34.009169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:34.033792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Calling delete_port for da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:34.070541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d670dd6-b3fc-41a4-8142-bd518ce1a50a req-1337d441-2889-4ac6-b6ce-5dad970e0178 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0916150 Dec 21 03:54:34.273896 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:34.301473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Pushing event deleted for resources: {'Port': ['ID=da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:34.531518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:34.886390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-36ba0f2e-dd03-4fa6-aef2-0354175f04a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:34.888077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-36ba0f2e-dd03-4fa6-aef2-0354175f04a8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 1098 time: 0.1540070 Dec 21 03:54:34.909366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd723b5f-76d3-418a-94c9-99625ec440c3 req-86dbebb3-2546-41f1-84a3-a2b28eee527e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:34.911026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd723b5f-76d3-418a-94c9-99625ec440c3 req-86dbebb3-2546-41f1-84a3-a2b28eee527e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0853424 Dec 21 03:54:34.928606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fce47c6-0f91-499b-89c9-80bfbf4859eb req-7c8db61b-2ba8-4076-910a-66732d4739d1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:34.930219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fce47c6-0f91-499b-89c9-80bfbf4859eb req-7c8db61b-2ba8-4076-910a-66732d4739d1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1874924 Dec 21 03:54:35.098541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fce47c6-0f91-499b-89c9-80bfbf4859eb req-b8b247e7-9436-4cf4-b0ce-29e1c365df5a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505997 Dec 21 03:54:35.120072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd723b5f-76d3-418a-94c9-99625ec440c3 req-e7eb63c5-0c06-4e27-aa3f-01127afa44f0 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1706843 Dec 21 03:54:35.147987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-69bd107a-ef18-4056-9877-2fbdd6327e96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:35.148749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-69bd107a-ef18-4056-9877-2fbdd6327e96 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.2481012 Dec 21 03:54:35.220718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Router afc96f13-e71f-4841-88a7-5c551515b510 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:54:35.232182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-0672de3c-4e70-43c5-b274-8d6c1c98bc1d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=da1bad89-a5fb-446c-af44-dde02dbd5709 HTTP/1.1" status: 200 len: 217 time: 0.0757041 Dec 21 03:54:35.347013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:54:35.356379 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7a35d151-4721-4bf4-bec1-1f66802f6685 admin admin] 10.222.0.18 "PUT /v2.0/routers/afc96f13-e71f-4841-88a7-5c551515b510/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4427078 Dec 21 03:54:35.356625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57748) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:35.360534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] Sync routers for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:54:35.374832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363ef0e1-1d5a-4719-94c3-7e1b1c9dea61 req-41cf2bb7-cc63-4332-b07e-d58cc1e1ffec tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:35.376630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-363ef0e1-1d5a-4719-94c3-7e1b1c9dea61 req-41cf2bb7-cc63-4332-b07e-d58cc1e1ffec tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1478329 Dec 21 03:54:35.384690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:54:35.385773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:35.390699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d46baa-6b80-49be-9055-8a108c390c11 req-c38de831-4c4d-41e8-95b9-9da8ab0ba7ce tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:35.399334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0d46baa-6b80-49be-9055-8a108c390c11 req-c38de831-4c4d-41e8-95b9-9da8ab0ba7ce tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1721206 Dec 21 03:54:35.443539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-ba612586-909e-4178-a923-0aff2ca85004 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:35.445608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-ba612586-909e-4178-a923-0aff2ca85004 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.1744752 Dec 21 03:54:35.487604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-1f8e9e5b-d002-4e56-b413-9decbd9e53c3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316257 Dec 21 03:54:35.521346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-363ef0e1-1d5a-4719-94c3-7e1b1c9dea61 req-c4247065-7b69-4fff-84aa-c1a3ec65db31 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1197453 Dec 21 03:54:35.523474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:35.547385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:54:35.582504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0d46baa-6b80-49be-9055-8a108c390c11 req-801ffcfe-a6f8-4abf-b467-b12ea024e172 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1822867 Dec 21 03:54:35.660493 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:35.679373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-ccacf9f6-2627-4cbe-902f-7ced597c7f27 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1722460 Dec 21 03:54:35.801893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beccb8f0-4e5e-4453-a038-175d65cd5806 req-37a1ef89-9037-4fbc-bef4-54cea41b5b92 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1147709 Dec 21 03:54:35.814669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Deleting port efb6ba28-97e5-44d1-ba11-ad2bc92b030b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:35.814669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:35.848708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254'}], 'enable_snat': True}, 'gw_port_id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:54:34Z', 'revision_number': 5, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port': {'id': 'efb6ba28-97e5-44d1-ba11-ad2bc92b030b', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:30:94', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1040, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:04Z', 'updated_at': '2021-12-21T03:52:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:35.881886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] Checking router: afc96f13-e71f-4841-88a7-5c551515b510 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:54:35.891999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc437de-c72c-4d7a-ae2b-f332b7f7bb36 req-270c14be-e7e6-457e-8ab3-afa061fbe2ce tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:35.896257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] Routers {'afc96f13-e71f-4841-88a7-5c551515b510'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:54:35.896257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['afc96f13-e71f-4841-88a7-5c551515b510'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:35.896480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1dc437de-c72c-4d7a-ae2b-f332b7f7bb36 req-270c14be-e7e6-457e-8ab3-afa061fbe2ce tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0714617 Dec 21 03:54:35.929601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] For port efb6ba28-97e5-44d1-ba11-ad2bc92b030b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:35.930140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:35.948922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Calling delete_port for efb6ba28-97e5-44d1-ba11-ad2bc92b030b owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:35.982595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1dc437de-c72c-4d7a-ae2b-f332b7f7bb36 req-cbf66b14-2e8e-489b-84a8-94210b0ac952 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805728 Dec 21 03:54:36.244201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] Set router afc96f13-e71f-4841-88a7-5c551515b510 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:54:36.262383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1256bc9-3393-42c4-975b-d13bf7d62abe req-48c433be-5024-4827-8703-ef6da0f27b42 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:36.264170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1256bc9-3393-42c4-975b-d13bf7d62abe req-48c433be-5024-4827-8703-ef6da0f27b42 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0602691 Dec 21 03:54:36.316603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:54:35Z', 'revision_number': 6, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:36.337832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1256bc9-3393-42c4-975b-d13bf7d62abe req-1452678d-3bf8-4e5e-9353-0da5df8d237a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528753 Dec 21 03:54:36.366591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b635d62c-702d-476e-8770-cfde87c2740b None None] The sync data for ids ['afc96f13-e71f-4841-88a7-5c551515b510'] in n-d-822053-11 is: [{'id': 'afc96f13-e71f-4841-88a7-5c551515b510', 'name': 'tempest-ServersTestManualDisk-423170150-router', 'tenant_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:02Z', 'updated_at': '2021-12-21T03:54:35Z', 'revision_number': 6, 'project_id': '068e67c3e7bc40e397d83d4acaa3afd1', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:54:36.416657 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:36.448912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Pushing event deleted for resources: {'Port': ['ID=efb6ba28-97e5-44d1-ba11-ad2bc92b030b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:36.464010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8404f8e-f0f5-43a9-a939-22764579c0d5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:36.507224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb1063b-d163-4f85-b4e4-e892bb9037db req-a1479d5d-01ed-40df-8b9a-fc8738d53770 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:36.513427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acb1063b-d163-4f85-b4e4-e892bb9037db req-a1479d5d-01ed-40df-8b9a-fc8738d53770 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0942185 Dec 21 03:54:36.530744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-482dde19-d333-40fa-a3da-935d58a9e367 req-90aa6e9e-afc2-4ff4-8393-283b903da651 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:36.536315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-482dde19-d333-40fa-a3da-935d58a9e367 req-90aa6e9e-afc2-4ff4-8393-283b903da651 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1165137 Dec 21 03:54:36.564236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:36.656023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-482dde19-d333-40fa-a3da-935d58a9e367 req-c42e2497-926f-4ee5-9c18-27fcc398cae6 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1022079 Dec 21 03:54:36.693413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:36.697060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:36.709037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acb1063b-d163-4f85-b4e4-e892bb9037db req-8debcadd-6d25-4ab7-8a2d-1d7b82091219 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1725502 Dec 21 03:54:36.823205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:36.828326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Fanout notify agent at l3_agent the message router_deleted on router afc96f13-e71f-4841-88a7-5c551515b510 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:54:36.828478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:36.837440 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1fb1765-6239-4c7e-bfe8-acae86951175 admin admin] 10.222.0.18 "DELETE /v2.0/routers/afc96f13-e71f-4841-88a7-5c551515b510 HTTP/1.1" status: 204 len: 168 time: 1.4795439 Dec 21 03:54:36.839139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57776) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:36.945930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945ceede-519a-4b13-8b68-33d3e91c7ce6 req-58e0b5df-e7d7-49e2-abeb-5746583458f0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:36.948305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-945ceede-519a-4b13-8b68-33d3e91c7ce6 req-58e0b5df-e7d7-49e2-abeb-5746583458f0 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1546984 Dec 21 03:54:36.956524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Deleting subnet 96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:54:36.966893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.034602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.126181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-945ceede-519a-4b13-8b68-33d3e91c7ce6 req-a22604f8-24a7-45a1-a909-6277e778656e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1670516 Dec 21 03:54:37.143590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.278224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.334972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.341050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] 10.222.0.18 "DELETE /v2.0/subnets/96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7 HTTP/1.1" status: 204 len: 168 time: 0.4983273 Dec 21 03:54:37.341050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4005dd6e-afde-46bf-bfee-3691d37f63ce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96e9c9a0-2b7b-4a96-bc8f-b72e37f795f7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:37.343297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57780) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:37.345439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f4191fe-5bde-4872-a019-de7fe69c0fbc None None] Network a4370ec5-c219-4c56-a17c-433f7c352683 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:54:37.363313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device efb6ba28-97e5-44d1-ba11-ad2bc92b030b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:37.395513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: efb6ba28-97e5-44d1-ba11-ad2bc92b030b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:54:37.396191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device efb6ba28-97e5-44d1-ba11-ad2bc92b030b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:54:37.396328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:37.429810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:54:37.430713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device da712bf3-f60d-49a2-9e1e-a3db4a9d5bfe not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:54:37.529508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.560536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1416c4f-4a8d-4019-943d-e9201590333b req-30b60c23-52e1-4413-93e8-bf95411438ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:37.562445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1416c4f-4a8d-4019-943d-e9201590333b req-30b60c23-52e1-4413-93e8-bf95411438ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.1139233 Dec 21 03:54:37.636543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Deleting port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:37.637150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.672527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] DHCP port deletion for a4370ec5-c219-4c56-a17c-433f7c352683 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:37.712246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1416c4f-4a8d-4019-943d-e9201590333b req-419569eb-e446-44d5-9e63-21a2485ac912 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391251 Dec 21 03:54:37.715721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] For port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:37.716093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.741930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Calling delete_port for 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:37.801238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] Deleting port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:37.801689 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.919679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.933482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] For port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,segment=NetworkSegment(4a9353ec-21a7-452e-9044-b5e6bec5e758),segment_id=4a9353ec-21a7-452e-9044-b5e6bec5e758)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:37.934048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:37.959483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] Calling delete_port for 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:37.963846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-d782add8-b9b0-476a-a264-9050333ba5f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:37.963985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Pushing event deleted for resources: {'Port': ['ID=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:37.964086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-d782add8-b9b0-476a-a264-9050333ba5f2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 1098 time: 0.0958118 Dec 21 03:54:37.966791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] No DVR routers for this DVR port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:54:37.997930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f383af4-b4c3-4093-abb6-aa8dba232aff req-7ef1483a-1a21-4a5c-9e9f-635a3f3589d4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:38.006864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f383af4-b4c3-4093-abb6-aa8dba232aff req-7ef1483a-1a21-4a5c-9e9f-635a3f3589d4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1804383 Dec 21 03:54:38.058969 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.072813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.095038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] Pushing event deleted for resources: {'Port': ['ID=3b0649a6-4e23-4e4e-a21c-55dd3eea1322,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:38.099921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98dc9541-c9ea-412c-9a8c-929a19b7e0e4 None None] No DVR routers for this DVR port 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:54:38.138200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a4370ec5-c219-4c56-a17c-433f7c352683']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:38.152183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4a9353ec-21a7-452e-9044-b5e6bec5e758') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:38.152183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4a9353ec-21a7-452e-9044-b5e6bec5e758') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:54:38.163262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.178783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-edf3c10a-ac70-4917-853f-058a591526cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:38.179005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.181115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-edf3c10a-ac70-4917-853f-058a591526cf service neutron] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.1594312 Dec 21 03:54:38.187616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Releasing vlan 148 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:54:38.188651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.195969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352c9e43-d2bc-459f-8c6c-1cb175054f36 req-b94d8f45-6a95-4e45-be11-13fed8e760fd tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:38.205700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-352c9e43-d2bc-459f-8c6c-1cb175054f36 req-b94d8f45-6a95-4e45-be11-13fed8e760fd tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.3367927 Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:54:38.247960 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:54:38.281836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-7af00b38-4ecb-40b9-8c72-6793ca0a18be service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=da1bad89-a5fb-446c-af44-dde02dbd5709 HTTP/1.1" status: 200 len: 217 time: 0.0537698 Dec 21 03:54:38.342440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.361192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.362693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-352c9e43-d2bc-459f-8c6c-1cb175054f36 req-1c9a4b22-c640-4964-9af8-f430be1cc81e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1566250 Dec 21 03:54:38.364579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] 10.222.0.18 "DELETE /v2.0/networks/a4370ec5-c219-4c56-a17c-433f7c352683 HTTP/1.1" status: 204 len: 168 time: 1.0218320 Dec 21 03:54:38.365914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab0ae2fa-ee97-437f-8daa-2ba9c167a8bf admin admin] Pushing event deleted for resources: {'Network': ['ID=a4370ec5-c219-4c56-a17c-433f7c352683,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:38.379630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f383af4-b4c3-4093-abb6-aa8dba232aff req-94fc280a-93cb-48cb-a9cb-f0c6ff6d31d8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3716874 Dec 21 03:54:38.387868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-813a2f65-2ec8-4db9-9cd0-98cc281749bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:38.389430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-813a2f65-2ec8-4db9-9cd0-98cc281749bb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.0869095 Dec 21 03:54:38.466276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-725b505e-e777-4683-9928-91061c9cb0a4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0572860 Dec 21 03:54:38.622332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-47615dc3-25e3-4823-a850-8c7b1976a9bb service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1477227 Dec 21 03:54:38.675708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9107c90c-c0a0-4b0f-aa3c-7c0587dc1f80 req-857a56a7-b1b9-4c2a-bdd0-a39b3ccaa6fb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:38.680054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9107c90c-c0a0-4b0f-aa3c-7c0587dc1f80 req-857a56a7-b1b9-4c2a-bdd0-a39b3ccaa6fb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1028912 Dec 21 03:54:38.746131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:38.806782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9107c90c-c0a0-4b0f-aa3c-7c0587dc1f80 req-52054104-ac8c-48b5-bec4-933267aad8b3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1220100 Dec 21 03:54:38.831223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea0cd88-cea5-4a97-9dbe-71d972fafdaa req-37509ca8-6869-4d7c-83a6-36e98844a52a service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1923494 Dec 21 03:54:38.879180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:38.921352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:38.925618 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c49cd28b-410a-4bfe-aa62-17553023cf56" -d '{"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-unplugged", "status": "completed", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:38.930260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:38.940362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf9b5dd-2ea8-4d74-92c9-fb926cf0bff8 req-ce16e970-a785-4a53-b258-0a6f52f8d12a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:38.941519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf9b5dd-2ea8-4d74-92c9-fb926cf0bff8 req-ce16e970-a785-4a53-b258-0a6f52f8d12a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 946 time: 0.0567319 Dec 21 03:54:38.956005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57812) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:39.007684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf9b5dd-2ea8-4d74-92c9-fb926cf0bff8 req-5919a687-cf66-4b87-909e-d274dcb5b230 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575433 Dec 21 03:54:39.016964 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42c50bde-643a-4537-ac7a-77de7f21eac3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=068e67c3e7bc40e397d83d4acaa3afd1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0589328 Dec 21 03:54:39.017337 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2f2c47d-78de-4c63-9cbf-efd57f4d10e1 x-openstack-request-id: req-d2f2c47d-78de-4c63-9cbf-efd57f4d10e1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:39.017622 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-unplugged", "status": "failed", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709", "code": 422}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:39.017894 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d2f2c47d-78de-4c63-9cbf-efd57f4d10e1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:39.018332 n-d-822053-11 neutron-server[110312]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'code': 422} returned with failed status Dec 21 03:54:39.019478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57816) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:39.022515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:39.112693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54b37b5b-e1b6-4c08-921c-bf7ce504819d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:39.122103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:39.137875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54b37b5b-e1b6-4c08-921c-bf7ce504819d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:39.147063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:39.189081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cee602-f938-4c9e-8c76-21455a3622d7 req-6cfed8a6-7da7-41de-8e85-fa0c6cea722e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:39.191748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10cee602-f938-4c9e-8c76-21455a3622d7 req-6cfed8a6-7da7-41de-8e85-fa0c6cea722e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0931888 Dec 21 03:54:39.210900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:54:39.211350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3b0649a6-4e23-4e4e-a21c-55dd3eea1322 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:54:39.257725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10cee602-f938-4c9e-8c76-21455a3622d7 req-7da7705e-f66d-49f7-a32a-63a6c4d8e587 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601215 Dec 21 03:54:39.308026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54b37b5b-e1b6-4c08-921c-bf7ce504819d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:39.311004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54b37b5b-e1b6-4c08-921c-bf7ce504819d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:39.312812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-54b37b5b-e1b6-4c08-921c-bf7ce504819d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9467bf76-955f-469a-b18a-f60f4ea69998 HTTP/1.1" status: 204 len: 168 time: 0.2920456 Dec 21 03:54:39.324503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b37b5b-e1b6-4c08-921c-bf7ce504819d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9467bf76-955f-469a-b18a-f60f4ea69998,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:39.550275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f1f953-dc22-4289-b54e-835d9ce0f67b req-120d93e7-ac5c-41b5-9c25-83ef2c31f84e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:39.551810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f1f953-dc22-4289-b54e-835d9ce0f67b req-120d93e7-ac5c-41b5-9c25-83ef2c31f84e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0780120 Dec 21 03:54:39.592272 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-b22c2d86-1363-43ce-a567-13315bd6ed9a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0437589 Dec 21 03:54:39.602173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75f1f953-dc22-4289-b54e-835d9ce0f67b req-d10b9ff3-6895-4803-9bb4-9f583d9695e7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437288 Dec 21 03:54:39.715771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55812ed1-330a-401f-a641-71927ebe476c req-c60b54e0-c619-46ff-8211-b3532279f3df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:39.720084 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-c60b54e0-c619-46ff-8211-b3532279f3df service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 1097 time: 0.0574355 Dec 21 03:54:39.859802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55812ed1-330a-401f-a641-71927ebe476c req-587437b0-0a8f-4aec-8d89-24a19052c649 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:39.861396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-587437b0-0a8f-4aec-8d89-24a19052c649 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1168938 Dec 21 03:54:39.934555 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-d0a05913-e43c-4260-8bbd-7d3a7894b9ce service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 200 len: 217 time: 0.0492005 Dec 21 03:54:40.015250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55812ed1-330a-401f-a641-71927ebe476c req-1123a4da-4e7d-46c0-9cc5-1cce311e5036 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:40.019086 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-1123a4da-4e7d-46c0-9cc5-1cce311e5036 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0631022 Dec 21 03:54:40.019324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba308b6-2c6b-48ee-a92e-7b02dac91b0b req-a0134b3e-b14a-4495-82a1-64abafaa45de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:40.019733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bba308b6-2c6b-48ee-a92e-7b02dac91b0b req-a0134b3e-b14a-4495-82a1-64abafaa45de service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 1097 time: 0.1047103 Dec 21 03:54:40.078205 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-d50a0a80-3a65-412a-9b32-94a564785b1a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0469306 Dec 21 03:54:40.083325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7dacd3b-080b-4bce-98bb-cebdbfdcf5ba req-39e13e8a-d073-49d2-8757-81dbf6b33d0e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:40.083325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7dacd3b-080b-4bce-98bb-cebdbfdcf5ba req-39e13e8a-d073-49d2-8757-81dbf6b33d0e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1755588 Dec 21 03:54:40.141057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bba308b6-2c6b-48ee-a92e-7b02dac91b0b req-76b0b3d0-c3ff-487c-924d-cf2aa4eb51ba service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0988822 Dec 21 03:54:40.172077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7dacd3b-080b-4bce-98bb-cebdbfdcf5ba req-7fe6ed12-5a2f-43c5-952a-85fc2a43bcce tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752947 Dec 21 03:54:40.202582 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-eab3e3a4-3261-4ff4-be65-ae4165631eb0 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1048527 Dec 21 03:54:40.407730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06806eb5-ab7e-4717-aa65-afeb943b71bf req-489b6bf3-6c68-4c12-9e96-84387ad695e2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:40.417832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06806eb5-ab7e-4717-aa65-afeb943b71bf req-489b6bf3-6c68-4c12-9e96-84387ad695e2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0669458 Dec 21 03:54:40.482499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06806eb5-ab7e-4717-aa65-afeb943b71bf req-44dc3d33-06b2-4a8a-a9f4-0d9a94daf2b3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633378 Dec 21 03:54:40.519586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-55812ed1-330a-401f-a641-71927ebe476c req-17d3151c-947d-4fba-8459-2be8f6b1535d service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1166108 Dec 21 03:54:40.741167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:40.755863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169fdf61-f041-4c73-bf85-7d154e682cb6 req-d1879550-f45d-49e5-bdee-e71e1f5216ae tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:40.757218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-169fdf61-f041-4c73-bf85-7d154e682cb6 req-d1879550-f45d-49e5-bdee-e71e1f5216ae tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0628459 Dec 21 03:54:40.848448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-169fdf61-f041-4c73-bf85-7d154e682cb6 req-ffc25188-b97a-40a0-96c9-e2f38eee54e4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819149 Dec 21 03:54:40.857086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-6b18bf08-e011-4efb-b65b-54884329db93 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:40.858587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-6b18bf08-e011-4efb-b65b-54884329db93 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=a53ec777-c915-4645-9cd2-755dd7dfb2ba HTTP/1.1" status: 200 len: 944 time: 0.0851417 Dec 21 03:54:40.866563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Request body: {'network': {'name': 'tempest-ServerGroupTestJSON-2021425581-network', 'tenant_id': '2b04be31d9cd41a68c439cf66bc7acba'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:40.983233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Made reservation on behalf of 2b04be31d9cd41a68c439cf66bc7acba for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:40.986517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.001805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Deleting port da1bad89-a5fb-446c-af44-dde02dbd5709 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:41.002175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.003135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.109593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.116907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] For port da1bad89-a5fb-446c-af44-dde02dbd5709, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=da1bad89-a5fb-446c-af44-dde02dbd5709,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:41.117284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.129340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Calling delete_port for da1bad89-a5fb-446c-af44-dde02dbd5709 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:41.210843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.252828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:54:41.282335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.282687 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Added segment 8716391c-f24c-4bf6-8bf7-052a04f480c5 of type vlan for network e59364d3-d6aa-4eba-a742-ae8caff077d9 Dec 21 03:54:41.284158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d361e13-be23-4d7d-8f0e-4e3f47508683,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:41.366968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.375904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e690ee-95be-468a-b30a-35ea037a6500 req-d1946a50-7e73-4a65-8cba-0e4baaa32668 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:41.385071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30e690ee-95be-468a-b30a-35ea037a6500 req-d1946a50-7e73-4a65-8cba-0e4baaa32668 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1123879 Dec 21 03:54:41.394969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.441611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event deleted for resources: {'Port': ['ID=da1bad89-a5fb-446c-af44-dde02dbd5709,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:41.458689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97eed2d5-be38-458c-ac10-92a1c1213d53 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:41.501651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] No DVR routers for this DVR port da1bad89-a5fb-446c-af44-dde02dbd5709 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:54:41.504454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.508045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d586520-cf6b-4422-b7b1-e2b98b6d9702 req-03e0e124-94e1-465d-a231-efc811905335 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "DELETE /v2.0/ports/da1bad89-a5fb-446c-af44-dde02dbd5709 HTTP/1.1" status: 204 len: 173 time: 0.6344306 Dec 21 03:54:41.511826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-deleted', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:41.514052 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e124bce8-e036-43cd-b598-8a8019de96e4" -d '{"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-deleted", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:41.523784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30e690ee-95be-468a-b30a-35ea037a6500 req-6e49c30a-b90e-4b13-b192-655724707f82 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1378753 Dec 21 03:54:41.542711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.547782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:41.547782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:41.565677 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03e91576-2cd4-41a4-8c87-6527a9149e74 x-openstack-request-id: req-03e91576-2cd4-41a4-8c87-6527a9149e74 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:41.565977 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a53ec777-c915-4645-9cd2-755dd7dfb2ba", "name": "network-vif-deleted", "tag": "da1bad89-a5fb-446c-af44-dde02dbd5709", "status": "failed", "code": 422}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:41.566261 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-03e91576-2cd4-41a4-8c87-6527a9149e74 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:41.566699 n-d-822053-11 neutron-server[110310]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a53ec777-c915-4645-9cd2-755dd7dfb2ba', 'name': 'network-vif-deleted', 'tag': 'da1bad89-a5fb-446c-af44-dde02dbd5709', 'status': 'failed', 'code': 422} returned with failed status Dec 21 03:54:41.625101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] Pushing event updated for resources: {'Network': ['ID=e59364d3-d6aa-4eba-a742-ae8caff077d9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:41.635406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e59364d3-d6aa-4eba-a742-ae8caff077d9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:54:41.750976 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5ed8e6e2-1540-4333-a96b-2523b2eaf6a2 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.0085688 Dec 21 03:54:41.754200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57946) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:41.758994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Request body: {'subnet': {'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerGroupTestJSON-2021425581-subnet', 'tenant_id': '2b04be31d9cd41a68c439cf66bc7acba', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:41.838635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Made reservation on behalf of 2b04be31d9cd41a68c439cf66bc7acba for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:41.841752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:42.029023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0f6af0-6dbf-4f0c-97ce-52ae4c8b2772 req-417a5370-7af9-4739-9af4-671d44de8f5f tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:42.037589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa0f6af0-6dbf-4f0c-97ce-52ae4c8b2772 req-417a5370-7af9-4739-9af4-671d44de8f5f tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1097188 Dec 21 03:54:42.092726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa0f6af0-6dbf-4f0c-97ce-52ae4c8b2772 req-0ee41e29-8782-43c3-94bc-4c989a6a310d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540910 Dec 21 03:54:42.131973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:42.203927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Pushing event updated for resources: {'Subnet': ['ID=f0bc6df9-47de-41a4-bc1d-a42cf219d093,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:42.212198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Checking segment: {'id': '8716391c-f24c-4bf6-8bf7-052a04f480c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:42.212920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Network hostable DHCP agents. Network: e59364d3-d6aa-4eba-a742-ae8caff077d9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:54:42.359602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Network e59364d3-d6aa-4eba-a742-ae8caff077d9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:54:42.435858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e59364d3-d6aa-4eba-a742-ae8caff077d9) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:54:42.446623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:42.448162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:42.451418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a62f3b25-9afd-4dbf-8380-414c9f659a3c None None] Network e59364d3-d6aa-4eba-a742-ae8caff077d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:54:42.581010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c37b9766-0d43-4897-b2d8-92412de7b5be admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8253291 Dec 21 03:54:42.581667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-c085cfe9-7102-4ac2-ae93-46763bb4ce77 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:42.590180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-c085cfe9-7102-4ac2-ae93-46763bb4ce77 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 809 time: 0.1831088 Dec 21 03:54:42.618488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-9543ca29-1688-4570-bef9-9ce5bedd88d9 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/quotas/0eca6fe3fe274d1abd1d5ce62d18e44d HTTP/1.1" status: 200 len: 375 time: 0.0272400 Dec 21 03:54:42.673670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-737f8d40-8711-4927-86bd-1ac45bec39c2 None None] Network e59364d3-d6aa-4eba-a742-ae8caff077d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:54:42.700494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-66c48e64-6d5c-4f3d-a82f-540d66f57f13 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0808160 Dec 21 03:54:42.769795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:42.792679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: da1bad89-a5fb-446c-af44-dde02dbd5709 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:54:42.793022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device da1bad89-a5fb-446c-af44-dde02dbd5709 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:54:42.856312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-6a6a54d4-4c1d-4698-9fb6-de180a773b47 service neutron] 10.222.0.18 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1547143 Dec 21 03:54:42.865181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91d4821-01ef-426b-a6a3-a07523200a1b req-f87c5b63-2780-4ebd-b37b-d81a16035c2b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:42.866597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a91d4821-01ef-426b-a6a3-a07523200a1b req-f87c5b63-2780-4ebd-b37b-d81a16035c2b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.0984836 Dec 21 03:54:42.969453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a91d4821-01ef-426b-a6a3-a07523200a1b req-f5ed8d92-8b96-4719-81d7-9bd1c730d6dd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934837 Dec 21 03:54:42.996756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-e5581c15-4ae0-4e1a-9b59-57e789127220 service neutron] 10.222.0.18 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291289 Dec 21 03:54:43.698584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-648a3f80-e0e3-4045-9fb8-166a9aa33b24 req-f348d967-78a2-4eaa-8ced-258a636eaa37 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 210 time: 0.0341897 Dec 21 03:54:43.776199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-0317d159-24bc-4a2a-a41e-af1f93f3faa1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:43.777678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-0317d159-24bc-4a2a-a41e-af1f93f3faa1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.5087349 Dec 21 03:54:43.794090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-ffd2a11b-d072-4701-9848-a2ff93d3d20b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.0102553 Dec 21 03:54:43.838489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-773c26d2-bd9a-4e2f-97d1-3bc9913c6f1d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0359547 Dec 21 03:54:43.943004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-8980e17e-fa84-49f0-bc03-b2c4a8d30c7a service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0947053 Dec 21 03:54:44.037706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-b30b9a8a-9c4b-4103-b72f-37986bf258be service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901413 Dec 21 03:54:44.395333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac15a57-698b-4eb1-a81c-416242e50215 req-2545a2cd-c7c7-43ea-a06d-d90386b4444d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:44.396870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ac15a57-698b-4eb1-a81c-416242e50215 req-2545a2cd-c7c7-43ea-a06d-d90386b4444d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.0602219 Dec 21 03:54:44.459803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ac15a57-698b-4eb1-a81c-416242e50215 req-5b49692e-d5ca-49bf-938a-ca3cee4026da tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471618 Dec 21 03:54:44.552497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81286393-2c65-45c7-af68-03c659f2f0cf req-d6706aea-0ecc-422c-9789-92926227a036 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 210 time: 0.0254583 Dec 21 03:54:44.728288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-1ab15bf3-96a3-4b2d-a31a-e0ad1ba1fd32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:44.729981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-1ab15bf3-96a3-4b2d-a31a-e0ad1ba1fd32 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.0818336 Dec 21 03:54:44.738623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0540606e-0dff-463e-8900-2ea5f5d1b9ed req-ac0d9792-5da3-49fd-b6aa-9b51c2493685 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:44.740201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0540606e-0dff-463e-8900-2ea5f5d1b9ed req-ac0d9792-5da3-49fd-b6aa-9b51c2493685 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1210575 Dec 21 03:54:44.852772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0540606e-0dff-463e-8900-2ea5f5d1b9ed req-19664719-fc64-48c4-a0dc-d93d2c6e19df tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0929074 Dec 21 03:54:44.867283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-e3fa49a9-2b2b-4053-b26a-b0bac659f6d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:44.869427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-e3fa49a9-2b2b-4053-b26a-b0bac659f6d7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.1281450 Dec 21 03:54:44.917872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-de469d8f-2710-4055-babb-6c7dcc9ed279 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0398691 Dec 21 03:54:44.979090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3f7d4b5-2e52-4b60-a436-d72784f6cc9a req-07dda84c-2cd6-42c7-a05f-3696e8931056 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 210 time: 0.0558105 Dec 21 03:54:45.001983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-27f510b3-3df1-4451-9910-796a69a3c7f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:45.003779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-27f510b3-3df1-4451-9910-796a69a3c7f1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.0699582 Dec 21 03:54:45.040346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-52b56506-eccd-4f01-b78b-a1173a7765ae service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272548 Dec 21 03:54:45.155399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-5b3f5a75-a56d-473f-82c9-e0946dfa6132 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0997908 Dec 21 03:54:45.259145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f061396-fa9b-4341-85c4-aa130326d0c8 req-383d7e59-abfe-44a3-8fc4-3f272f96784e service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0967658 Dec 21 03:54:45.612130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb27d23-baf6-4fb8-a02a-7f6dc4875846 req-1c3a5792-371c-41f8-bbd0-d46b7f2dc8db tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:45.612130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdb27d23-baf6-4fb8-a02a-7f6dc4875846 req-1c3a5792-371c-41f8-bbd0-d46b7f2dc8db tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.0624619 Dec 21 03:54:45.673648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdb27d23-baf6-4fb8-a02a-7f6dc4875846 req-dcc10421-7360-4d26-8942-3008e4f588ae tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552320 Dec 21 03:54:45.683267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-56f79e7c-1331-4d4e-bc2d-080f6f506f19 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:45.690383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-56f79e7c-1331-4d4e-bc2d-080f6f506f19 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.0960865 Dec 21 03:54:45.705621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-822053-11'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:45.778564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:45.816036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71ac5b5-6377-4f4f-9c5c-15e013e9a7b5 req-88fd0a0f-74d1-40f5-a4bf-1b88a90dbff5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 210 time: 0.0417302 Dec 21 03:54:45.975481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:46.041239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:46.124393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:46.126647 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97363a18-14a0-4a92-b038-886b4c27ebdc" -d '{"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-unplugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:46.131996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.210856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.222848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-0256568d-379e-4fd9-928a-dc5b89dc2d99 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:46.224726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-0256568d-379e-4fd9-928a-dc5b89dc2d99 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.31 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 809 time: 0.3288991 Dec 21 03:54:46.238455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4c168b-844b-47e8-9790-822702b51da4 req-11f1d16b-3f18-43af-8dc0-77f144575eed tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:46.247618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d4c168b-844b-47e8-9790-822702b51da4 req-11f1d16b-3f18-43af-8dc0-77f144575eed tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1879661 Dec 21 03:54:46.269888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4087772-9813-413f-a146-ccd3100b229d None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:46.303860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Request body: {'port': {'device_id': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'admin_state_up': True, 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:46.355702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:46.364064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-429a21f5-2ea9-4b99-939b-48c219a18a83 None None] Provisioning complete for port 68a76cd7-fffa-4866-9c53-87b552b1bde6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:46.364704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-429a21f5-2ea9-4b99-939b-48c219a18a83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.372265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on host n-h2-822053-11 for vnic_type normal with profile {"migrating_to": "n-h1-822053-11"} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:46.372608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:46.373195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:46.379738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:46.379983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Attempting to bind port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on network 5fd01e07-75a4-4745-ad05-8ade1a021605 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:46.388432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 54, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:46.388872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Checking segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:46.389243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Bound using segment: {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:46.389670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Bound port: 68a76cd7-fffa-4866-9c53-87b552b1bde6, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7e04703-d86d-45a9-b1f8-027f2f6defdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '5fd01e07-75a4-4745-ad05-8ade1a021605'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:46.390198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.393322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:46.404929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-429a21f5-2ea9-4b99-939b-48c219a18a83 None None] Port 68a76cd7-fffa-4866-9c53-87b552b1bde6 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:54:46.407394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d4c168b-844b-47e8-9790-822702b51da4 req-69078e94-40cb-4710-bb7c-920de3853445 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1586871 Dec 21 03:54:46.413008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.413564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.414011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.414486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.415585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.416134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.416683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.417233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.417827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.418374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.418913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.419598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.420182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:46.450679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-7b31e7f1-ec33-4b33-ba0d-f83ba9582916 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:46.455433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-7b31e7f1-ec33-4b33-ba0d-f83ba9582916 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/networks?id=e59364d3-d6aa-4eba-a742-ae8caff077d9 HTTP/1.1" status: 200 len: 810 time: 0.3490407 Dec 21 03:54:46.486493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:46.490095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:46.511612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-124f338e-8d1d-4718-97ab-371646cf1008 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/quotas/2b04be31d9cd41a68c439cf66bc7acba HTTP/1.1" status: 200 len: 375 time: 0.0546675 Dec 21 03:54:46.560642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-cda042cf-433e-422c-9146-9c73b78c50a4 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2b04be31d9cd41a68c439cf66bc7acba&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0399127 Dec 21 03:54:46.572037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.573027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1298f114-2412-426b-98ad-44d557e014ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.633831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05379f1b-60f7-41d8-b89a-a160cef8d696 None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:46.679312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:46.679938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.681511 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] 10.222.0.54 "PUT /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 1123 time: 0.9827197 Dec 21 03:54:46.685052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65bbebe5-53e4-4c00-80d7-e69637a88607 service neutron] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=8']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:46.694583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89d162fb-eadf-4c40-be00-d1ebf784aa3d req-d63f6484-8fdb-4254-a4c2-a50c31604cfd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 210 time: 0.0823734 Dec 21 03:54:46.755150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-ef4b2809-9401-4725-b7bb-2691791aef75 service neutron] 10.222.0.18 "GET /v2.0/networks/e59364d3-d6aa-4eba-a742-ae8caff077d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1831565 Dec 21 03:54:46.769281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-06d03063-1c34-4a8b-a7d1-47bcd0afe1e8 None None] Provisioning complete for port 68a76cd7-fffa-4866-9c53-87b552b1bde6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:46.769691 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06d03063-1c34-4a8b-a7d1-47bcd0afe1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.840619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['68a76cd7-fffa-4866-9c53-87b552b1bde6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:46.847211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1298f114-2412-426b-98ad-44d557e014ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.850413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Made reservation on behalf of 0eca6fe3fe274d1abd1d5ce62d18e44d for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:46.854108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.866926 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4b9d783-18a8-4fe8-99c9-cdcfe5a3ed5a x-openstack-request-id: req-b4b9d783-18a8-4fe8-99c9-cdcfe5a3ed5a {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:46.867846 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-unplugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:46.868177 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b4b9d783-18a8-4fe8-99c9-cdcfe5a3ed5a {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:46.868974 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'code': 200} Dec 21 03:54:46.919689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['68a76cd7-fffa-4866-9c53-87b552b1bde6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:46.946791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06d03063-1c34-4a8b-a7d1-47bcd0afe1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.949459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1298f114-2412-426b-98ad-44d557e014ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:46.967029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-72079b1c-f24b-473d-82a8-99b6bb13c7e5 service neutron] 10.222.0.18 "GET /v2.0/networks/e59364d3-d6aa-4eba-a742-ae8caff077d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1991429 Dec 21 03:54:47.043124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-06d03063-1c34-4a8b-a7d1-47bcd0afe1e8 None None] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:47.046064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:47.048336 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db0b4f38-8168-4fa3-b7b8-f581fb82e9c7" -d '{"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-plugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:47.086108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:47.093285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1298f114-2412-426b-98ad-44d557e014ec admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=966053c58c1e4fda92d267fa7022bd87&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7233236 Dec 21 03:54:47.096700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:47.117465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298f114-2412-426b-98ad-44d557e014ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9c5baaa-ec69-4c54-97f2-e4fb8dd0f964,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:47.151881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46674851-32df-4e91-95a9-d3f727ee3bd1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.177945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46674851-32df-4e91-95a9-d3f727ee3bd1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.182038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c35a9fa-47ee-4bfa-a7eb-572ec914e574 req-65c33d83-bda9-4bd2-862a-ce7ac68d336e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:47.183733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c35a9fa-47ee-4bfa-a7eb-572ec914e574 req-65c33d83-bda9-4bd2-862a-ce7ac68d336e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 943 time: 0.2387784 Dec 21 03:54:47.185302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Allocated IP 172.20.0.11 (ee3304b6-e18e-45c8-93c6-239041d697ca/b082405b-1cdc-4188-a989-d408accdc4d2/eaac8238-a002-4ebe-980e-8aa4a84f4e4e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:54:47.193583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-9c0cc43e-d6ac-4c5e-ad61-e163283e267f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:47.195681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-9c0cc43e-d6ac-4c5e-ad61-e163283e267f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.2659786 Dec 21 03:54:47.227261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Request body: {'port': {'device_id': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'admin_state_up': True, 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:47.265819 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06d03063-1c34-4a8b-a7d1-47bcd0afe1e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.353608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46674851-32df-4e91-95a9-d3f727ee3bd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.356677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46674851-32df-4e91-95a9-d3f727ee3bd1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.358354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-46674851-32df-4e91-95a9-d3f727ee3bd1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e9c5baaa-ec69-4c54-97f2-e4fb8dd0f964 HTTP/1.1" status: 204 len: 168 time: 0.2606630 Dec 21 03:54:47.375292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c35a9fa-47ee-4bfa-a7eb-572ec914e574 req-6fc658c3-035e-48ae-8a63-eb63cf575a62 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1650736 Dec 21 03:54:47.386156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46674851-32df-4e91-95a9-d3f727ee3bd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9c5baaa-ec69-4c54-97f2-e4fb8dd0f964,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:47.515433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffe30897-eeea-494f-aaa9-bf02e70f7b03 req-281c45ce-a47c-423e-b956-6ffe1b19732c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 210 time: 0.0462844 Dec 21 03:54:47.541064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:47.548608 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b39fe8f5-49be-44c1-9cac-126902b22d43 x-openstack-request-id: req-b39fe8f5-49be-44c1-9cac-126902b22d43 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:47.549285 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-plugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:47.549847 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b39fe8f5-49be-44c1-9cac-126902b22d43 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:47.551300 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'code': 200} Dec 21 03:54:47.575246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d03063-1c34-4a8b-a7d1-47bcd0afe1e8 None None] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:47.588707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 has no active binding in host n-h1-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 03:54:47.692810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.699896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3292ac5-f7d8-46fc-8dc6-a23e36832f18 req-2533f3bc-95c0-470d-849e-f8aab4757d54 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 210 time: 0.0956466 Dec 21 03:54:47.725018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ad9157-7154-4ea2-94a1-d4e39f42accc req-d7fb4b9e-242c-4842-b2e2-3015bae96b09 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:47.727917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8ad9157-7154-4ea2-94a1-d4e39f42accc req-d7fb4b9e-242c-4842-b2e2-3015bae96b09 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1721687 Dec 21 03:54:47.798894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8ad9157-7154-4ea2-94a1-d4e39f42accc req-cd455639-dcd7-4d27-9270-ab0e2eb7873b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624113 Dec 21 03:54:47.799962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:47.803344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.899072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29751f2d-ba2c-41d8-b3c6-d32b2926f2f5 req-2c0e252b-457d-41c8-9f75-d5f668b82605 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 210 time: 0.0369904 Dec 21 03:54:47.902311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:47.970488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Network ee3304b6-e18e-45c8-93c6-239041d697ca is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:54:47.978886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:54:47.987926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:54:48.026704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Pushing event updated for resources: {'Port': ['ID=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:48.042720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Allocated IP 172.20.0.14 (a0e5eeee-a736-4bd3-bdf6-679e8da99022/0937a3b1-7f54-409b-bba0-29fa72617a82/081f3a22-0532-4780-80e3-e4a902de7cc7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:54:48.061667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:48.062272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.162002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-b29745f9-b007-41a6-aea0-1621dea44a12 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8851829 Dec 21 03:54:48.180720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58156) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:48.188527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Request body: {'port': {'device_id': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:48.193871 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da56c9e8-d983-42c6-b570-99cface4f92d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.233768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.269549 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da56c9e8-d983-42c6-b570-99cface4f92d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.270496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.341375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da56c9e8-d983-42c6-b570-99cface4f92d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.378965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da56c9e8-d983-42c6-b570-99cface4f92d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e999555-5e0a-4dfd-aaa0-a2f8a16c9b6e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:48.385871 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-da56c9e8-d983-42c6-b570-99cface4f92d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=61ed0364284944edb2b6235d87f2aa8e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2037821 Dec 21 03:54:48.388332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:54:48.453716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8eb49969-becd-4350-9420-b653c5a12713 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.472538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.482682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8eb49969-becd-4350-9420-b653c5a12713 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.552485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:54:48.564888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:54:48.571473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event updated for resources: {'Port': ['ID=081f3a22-0532-4780-80e3-e4a902de7cc7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:48.574833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:54:48.579192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e19ecc0-7f72-4303-b525-706c8d08af6b None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:48.603486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8eb49969-becd-4350-9420-b653c5a12713 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.603486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8eb49969-becd-4350-9420-b653c5a12713 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.603486 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8eb49969-becd-4350-9420-b653c5a12713 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2e999555-5e0a-4dfd-aaa0-a2f8a16c9b6e HTTP/1.1" status: 204 len: 168 time: 0.2137969 Dec 21 03:54:48.617311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eb49969-becd-4350-9420-b653c5a12713 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e999555-5e0a-4dfd-aaa0-a2f8a16c9b6e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:48.662632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-34e45cf9-07da-46ca-a940-429ca792cec5 None None] Provisioning complete for port 081f3a22-0532-4780-80e3-e4a902de7cc7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.669181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:54:48.671948 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:54:48.672817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34e45cf9-07da-46ca-a940-429ca792cec5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.672907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa68f21c-5d17-4fda-ad3e-86c00302e639 req-47efab4d-9421-4669-a979-5d5238b5eca3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:48.672907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa68f21c-5d17-4fda-ad3e-86c00302e639 req-47efab4d-9421-4669-a979-5d5238b5eca3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.2002745 Dec 21 03:54:48.702645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-34e45cf9-07da-46ca-a940-429ca792cec5 None None] Port 081f3a22-0532-4780-80e3-e4a902de7cc7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:54:48.708867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:48.731711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:48.732363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.785709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32489e85-4ccc-45d5-8b79-a23c4ef6f8c7 req-488c8004-6111-48f9-ae7f-02366c2a44d0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:48.787270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32489e85-4ccc-45d5-8b79-a23c4ef6f8c7 req-488c8004-6111-48f9-ae7f-02366c2a44d0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 932 time: 0.1679554 Dec 21 03:54:48.844718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eaac8238-a002-4ebe-980e-8aa4a84f4e4e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:48.853065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa68f21c-5d17-4fda-ad3e-86c00302e639 req-92edf2d9-0ec8-4d3d-b639-178e0cd275b6 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1810479 Dec 21 03:54:48.866017 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:48.878124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:48.880969 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06568fe2-f5da-4fc3-8ea6-5bea88695189" -d '{"events": [{"name": "network-changed", "server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:48.893089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-74900de8-7e5a-4321-9092-79eba7192515 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6700082 Dec 21 03:54:48.893993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Transition to ACTIVE for port object eaac8238-a002-4ebe-980e-8aa4a84f4e4e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:54:48.899007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32489e85-4ccc-45d5-8b79-a23c4ef6f8c7 req-998da665-33e8-4b55-9406-a1f4f67f3c2e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0980430 Dec 21 03:54:48.924904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Request body: {'port': {'device_id': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:48.974315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deb4adda-989f-41ed-95cf-162e590a2f3e req-f789a506-0d5d-49ff-a02e-19e3b389a8f5 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 210 time: 0.0464196 Dec 21 03:54:48.978831 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:49.066415 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da90605b-6c7d-4d16-93ed-f51251e8a1ac x-openstack-request-id: req-da90605b-6c7d-4d16-93ed-f51251e8a1ac {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:49.066415 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:49.066415 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-da90605b-6c7d-4d16-93ed-f51251e8a1ac {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:49.066415 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'status': 'completed', 'code': 200} Dec 21 03:54:49.182370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-e550427c-9e56-48fa-a5a0-d9bc0ebc5fd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:49.183947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-e550427c-9e56-48fa-a5a0-d9bc0ebc5fd2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1128 time: 0.0538781 Dec 21 03:54:49.323281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-792b6a7e-0d64-484a-a141-31650b30932d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:49.324894 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-792b6a7e-0d64-484a-a141-31650b30932d service neutron] 10.222.0.31 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.1232052 Dec 21 03:54:49.379880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-c9844ee8-aab6-491e-9348-475c9013cb9a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 217 time: 0.0414736 Dec 21 03:54:49.434757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Pushing event updated for resources: {'Port': ['ID=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:49.439123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-1481de02-f02f-432f-9321-936b3d4bce28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:49.441016 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-1481de02-f02f-432f-9321-936b3d4bce28 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0523865 Dec 21 03:54:49.450255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:49.479085 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-2093bcff-081f-4b7e-820c-59bea55bab11 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0279388 Dec 21 03:54:49.564091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf15cf1d-6ea6-4cde-8a1b-98d99866d8fa req-31a61d4f-2c87-4679-8e08-928887810384 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:49.567963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf15cf1d-6ea6-4cde-8a1b-98d99866d8fa req-31a61d4f-2c87-4679-8e08-928887810384 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.5160446 Dec 21 03:54:49.583842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-3fcc5a99-5d17-40b0-96d7-d1f6f68ba538 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944095 Dec 21 03:54:49.604658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafda71a-5724-4a99-9768-5757231f7b7d req-21160c92-cf10-4679-9a92-8141e7200a05 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:49.606561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eafda71a-5724-4a99-9768-5757231f7b7d req-21160c92-cf10-4679-9a92-8141e7200a05 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 944 time: 0.1786098 Dec 21 03:54:49.693151 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06568fe2-f5da-4fc3-8ea6-5bea88695189 req-bc9f0dc5-ec79-4b74-9269-4bd602551ab8 service neutron] 10.222.0.31 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023254 Dec 21 03:54:49.702038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Attempting to bind port eaac8238-a002-4ebe-980e-8aa4a84f4e4e on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:49.702567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Attempting to bind port eaac8238-a002-4ebe-980e-8aa4a84f4e4e by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:49.705641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Attempting to bind port eaac8238-a002-4ebe-980e-8aa4a84f4e4e on network ee3304b6-e18e-45c8-93c6-239041d697ca {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:49.734142 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:54:49.734738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Port eaac8238-a002-4ebe-980e-8aa4a84f4e4e on network ee3304b6-e18e-45c8-93c6-239041d697ca not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:49.734738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Attempting to bind port eaac8238-a002-4ebe-980e-8aa4a84f4e4e on network ee3304b6-e18e-45c8-93c6-239041d697ca {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:49.785209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 54, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:49.785548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Checking segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:49.785935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Bound using segment: {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:49.786372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Bound port: eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3daad6e7-a55c-43a2-addf-68e15a0b841f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:49.786721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:49.796864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf15cf1d-6ea6-4cde-8a1b-98d99866d8fa req-274e5a42-5c4d-46ab-a8e1-d5605f57f1b7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2162843 Dec 21 03:54:49.811362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eafda71a-5724-4a99-9768-5757231f7b7d req-f82161a8-bab4-4f44-898c-a7e39fe12368 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1881902 Dec 21 03:54:49.837744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-330c3703-960d-41cb-b92d-3d9d66e3d1f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:49.948075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] For port eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:49.998441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] For port eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:50.070864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28244afd-39b5-43bb-ae2a-79f99bf80b7a req-65fa9977-1be6-4a23-a295-223a425846de tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:50.072770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28244afd-39b5-43bb-ae2a-79f99bf80b7a req-65fa9977-1be6-4a23-a295-223a425846de tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1404798 Dec 21 03:54:50.079148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 081f3a22-0532-4780-80e3-e4a902de7cc7 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:50.090542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.093891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.155413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Transition to ACTIVE for port object 081f3a22-0532-4780-80e3-e4a902de7cc7 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:54:50.169700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2349e3c0-6dd2-4e67-83b2-433d9c7528c6 req-55472896-850e-48b5-8a53-68228b6408b1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:50.171934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2349e3c0-6dd2-4e67-83b2-433d9c7528c6 req-55472896-850e-48b5-8a53-68228b6408b1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 932 time: 0.1714814 Dec 21 03:54:50.179662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:50.180326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.181781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] 10.222.0.31 "PUT /v2.0/ports/eaac8238-a002-4ebe-980e-8aa4a84f4e4e HTTP/1.1" status: 200 len: 1093 time: 1.9992843 Dec 21 03:54:50.187089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'tag': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:50.189532 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f0a094c-9914-4a7d-a56b-1514da3f543a" -d '{"events": [{"name": "network-changed", "server_uuid": "bef70845-39fe-4faf-a847-a2c9dd5b51c3", "tag": "eaac8238-a002-4ebe-980e-8aa4a84f4e4e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:50.239178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.247737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28244afd-39b5-43bb-ae2a-79f99bf80b7a req-5e59943a-d1e3-4435-ad95-fad2ba68a8bd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1598563 Dec 21 03:54:50.253845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aedda121-3d6b-404b-91db-9016c1058a75 service neutron] Pushing event updated for resources: {'Port': ['ID=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:50.275860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-c999dc1f-243e-4350-8205-1368f0396aa8 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:50.277508 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-c999dc1f-243e-4350-8205-1368f0396aa8 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.54 "GET /v2.0/networks?id=e59364d3-d6aa-4eba-a742-ae8caff077d9 HTTP/1.1" status: 200 len: 810 time: 0.1310697 Dec 21 03:54:50.287623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aedd52cb-818d-4fdc-bddb-f2ea6398f535 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:50.313624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Request body: {'port': {'device_id': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9', 'admin_state_up': True, 'tenant_id': '2b04be31d9cd41a68c439cf66bc7acba'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:50.363610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2349e3c0-6dd2-4e67-83b2-433d9c7528c6 req-4d87db1d-5107-4389-98fd-b6fc2161ca2b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1640186 Dec 21 03:54:50.430654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Pushing event updated for resources: {'Port': ['ID=081f3a22-0532-4780-80e3-e4a902de7cc7,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:50.495492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f6db43a-4c04-49f5-a315-e77356329fca req-f010c65c-44bc-4fa6-be0a-5f4f38240ad4 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 210 time: 0.0708232 Dec 21 03:54:50.553763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Made reservation on behalf of 2b04be31d9cd41a68c439cf66bc7acba for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:54:50.554702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Attempting to bind port 081f3a22-0532-4780-80e3-e4a902de7cc7 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:50.555199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Attempting to bind port 081f3a22-0532-4780-80e3-e4a902de7cc7 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:50.555910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Attempting to bind port 081f3a22-0532-4780-80e3-e4a902de7cc7 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:50.558770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.561877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-290278d3-ecdb-4562-be60-13a07e329799 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:50.564478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-290278d3-ecdb-4562-be60-13a07e329799 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 1096 time: 0.2387507 Dec 21 03:54:50.567596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Port 081f3a22-0532-4780-80e3-e4a902de7cc7 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:50.568882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Attempting to bind port 081f3a22-0532-4780-80e3-e4a902de7cc7 on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:50.574288 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5930a75a-e792-4eda-9457-405ecfe5d2d3 x-openstack-request-id: req-5930a75a-e792-4eda-9457-405ecfe5d2d3 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:50.574662 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bef70845-39fe-4faf-a847-a2c9dd5b51c3", "tag": "eaac8238-a002-4ebe-980e-8aa4a84f4e4e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:50.575124 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5930a75a-e792-4eda-9457-405ecfe5d2d3 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:50.575594 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'tag': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e', 'status': 'completed', 'code': 200} Dec 21 03:54:50.578963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 54, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:50.579398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:50.579879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Bound using segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:50.581634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Bound port: 081f3a22-0532-4780-80e3-e4a902de7cc7, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:50.582139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.643868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-1b195465-4052-471c-afc1-7b192578f557 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e HTTP/1.1" status: 200 len: 217 time: 0.0577540 Dec 21 03:54:50.727455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Allocated IP 172.20.0.3 (e59364d3-d6aa-4eba-a742-ae8caff077d9/f0bc6df9-47de-41a4-bc1d-a42cf219d093/6ad28080-ec80-43e4-beda-22ada18e8b66) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:54:50.746769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-3a51b06e-1ee6-4c23-98e0-eae690baf231 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:50.748473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-3a51b06e-1ee6-4c23-98e0-eae690baf231 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.0956917 Dec 21 03:54:50.793143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-ca8393c9-ee4b-46ff-b8f3-ab3091686f3f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294876 Dec 21 03:54:50.797712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] For port 081f3a22-0532-4780-80e3-e4a902de7cc7, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:50.841096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] For port 081f3a22-0532-4780-80e3-e4a902de7cc7, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=081f3a22-0532-4780-80e3-e4a902de7cc7,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:50.920082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-9a8010ac-d751-407b-acf8-7caf9c17eda1 service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1180615 Dec 21 03:54:50.925504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:50.944759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.001255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-796c79ec-d2fa-4994-a492-b5b6228465e5 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:51.040156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.041510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.043094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-10664979-53e1-461f-a977-0b4a61072899 service neutron] 10.222.0.31 "PUT /v2.0/ports/081f3a22-0532-4780-80e3-e4a902de7cc7 HTTP/1.1" status: 200 len: 1093 time: 2.1279318 Dec 21 03:54:51.063852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.124964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Network e59364d3-d6aa-4eba-a742-ae8caff077d9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:54:51.131410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:54:51.135564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:54:51.169026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10664979-53e1-461f-a977-0b4a61072899 service neutron] Pushing event updated for resources: {'Port': ['ID=081f3a22-0532-4780-80e3-e4a902de7cc7,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:51.170794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Pushing event updated for resources: {'Port': ['ID=6ad28080-ec80-43e4-beda-22ada18e8b66,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:51.204078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.204464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.231226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a19100-b222-440c-b6ba-1d02c139e157 req-74923e43-04c0-4b2d-bf5d-1e88b319abc5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.232651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a19100-b222-440c-b6ba-1d02c139e157 req-74923e43-04c0-4b2d-bf5d-1e88b319abc5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.2523925 Dec 21 03:54:51.244443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0f65ef2-074a-46f4-a8e6-84c71cf9635d req-36af6eb1-19f6-4b6f-9bfe-7ab17f01cec8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.246283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0f65ef2-074a-46f4-a8e6-84c71cf9635d req-36af6eb1-19f6-4b6f-9bfe-7ab17f01cec8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 944 time: 0.2604253 Dec 21 03:54:51.281550 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-fe40c8a4-ea7e-4286-95ff-7629c168c821 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9729681 Dec 21 03:54:51.306647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ecaf6b4-48fb-43fd-95d3-31fe7aeb4871 req-09a90398-c278-427e-811b-69274efef17a service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3771427 Dec 21 03:54:51.312798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Request body: {'port': {'device_id': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:54:51.324167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-4ec5cebd-552d-4356-929b-60f4f02979d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.324167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-4ec5cebd-552d-4356-929b-60f4f02979d8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 1096 time: 0.1465797 Dec 21 03:54:51.402791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a19100-b222-440c-b6ba-1d02c139e157 req-64c0ab16-da53-44af-8a91-ebeeef3287af tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505871 Dec 21 03:54:51.410317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0f65ef2-074a-46f4-a8e6-84c71cf9635d req-4c4f2835-432b-4c07-807f-5d6a49c1943c tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1498177 Dec 21 03:54:51.411125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-168cd7d0-a983-4aa3-b500-135d41e7025e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=081f3a22-0532-4780-80e3-e4a902de7cc7 HTTP/1.1" status: 200 len: 217 time: 0.0733030 Dec 21 03:54:51.428318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.682129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e0517a-0eda-4748-b837-7ced43e315be req-df4fee3b-403a-43c7-87df-4a57567089c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.683923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-df4fee3b-403a-43c7-87df-4a57567089c5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.2054973 Dec 21 03:54:51.696302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9feb0e-99fb-489f-9147-56203aa6b4f5 req-67e80be0-6132-4a55-9a6b-fd8d00befe49 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.697820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c9feb0e-99fb-489f-9147-56203aa6b4f5 req-67e80be0-6132-4a55-9a6b-fd8d00befe49 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1532273 Dec 21 03:54:51.714524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-9cddce93-c542-40a5-8961-dcb3013223b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.716007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-9cddce93-c542-40a5-8961-dcb3013223b6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 1096 time: 0.1730857 Dec 21 03:54:51.725401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c26ce9-8a16-4564-8865-060029c1e8b1 req-ce9bbb7e-b23c-442b-aea3-e263a9f45b3b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.726913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4c26ce9-8a16-4564-8865-060029c1e8b1 req-ce9bbb7e-b23c-442b-aea3-e263a9f45b3b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 944 time: 0.1799910 Dec 21 03:54:51.749495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-a747308f-c015-41fc-9143-fe380546218d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0489054 Dec 21 03:54:51.793786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6ad28080-ec80-43e4-beda-22ada18e8b66 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:51.804264 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.822820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Transition to ACTIVE for port object 6ad28080-ec80-43e4-beda-22ada18e8b66 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:54:51.885737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:51.933391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c9feb0e-99fb-489f-9147-56203aa6b4f5 req-9ab2b898-4b6b-4586-8a12-535b3328891e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2216587 Dec 21 03:54:51.967854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Pushing event updated for resources: {'Port': ['ID=6ad28080-ec80-43e4-beda-22ada18e8b66,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:51.968178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4c26ce9-8a16-4564-8865-060029c1e8b1 req-7bbd51be-90d2-48f2-a3b1-56db599369ed tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2208169 Dec 21 03:54:51.996364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-76bf6af5-a084-4585-a8c3-f7ac757a4d2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:51.997878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-76bf6af5-a084-4585-a8c3-f7ac757a4d2e service neutron] 10.222.0.31 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 910 time: 0.2527363 Dec 21 03:54:51.999875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-b4e44bcc-207c-4edb-81eb-a6e6b69676d4 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2289424 Dec 21 03:54:52.093744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Attempting to bind port 6ad28080-ec80-43e4-beda-22ada18e8b66 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:54:52.094319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Attempting to bind port 6ad28080-ec80-43e4-beda-22ada18e8b66 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '8716391c-f24c-4bf6-8bf7-052a04f480c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:54:52.094811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Attempting to bind port 6ad28080-ec80-43e4-beda-22ada18e8b66 on network e59364d3-d6aa-4eba-a742-ae8caff077d9 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:52.099892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Port 6ad28080-ec80-43e4-beda-22ada18e8b66 on network e59364d3-d6aa-4eba-a742-ae8caff077d9 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:54:52.100511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Attempting to bind port 6ad28080-ec80-43e4-beda-22ada18e8b66 on network e59364d3-d6aa-4eba-a742-ae8caff077d9 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:54:52.107106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 54, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:54:52.107738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Checking segment: {'id': '8716391c-f24c-4bf6-8bf7-052a04f480c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:54:52.108267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Bound using segment: {'id': '8716391c-f24c-4bf6-8bf7-052a04f480c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:54:52.108839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Bound port: 6ad28080-ec80-43e4-beda-22ada18e8b66, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8716391c-f24c-4bf6-8bf7-052a04f480c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:54:52.109339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:52.126578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-6f58fd98-2b66-462b-9937-68b8bd237c7a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e HTTP/1.1" status: 200 len: 217 time: 0.1091790 Dec 21 03:54:52.193384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] For port 6ad28080-ec80-43e4-beda-22ada18e8b66, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:52.197414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] For port 6ad28080-ec80-43e4-beda-22ada18e8b66, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6ad28080-ec80-43e4-beda-22ada18e8b66,segment=NetworkSegment(8716391c-f24c-4bf6-8bf7-052a04f480c5),segment_id=8716391c-f24c-4bf6-8bf7-052a04f480c5)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:54:52.205190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0e48300c-df93-4eb7-ad19-37213c954a0e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:52.256366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-522feba2-6be1-43ef-b05a-216f0b1e23d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.258008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-522feba2-6be1-43ef-b05a-216f0b1e23d9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.0980296 Dec 21 03:54:52.267871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40003c1f-c4e6-4549-a0cf-aeb4c7bbbe25 req-f1a3dfe4-98f9-4543-aa0f-6d6ac8fa49d0 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.275510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40003c1f-c4e6-4549-a0cf-aeb4c7bbbe25 req-f1a3dfe4-98f9-4543-aa0f-6d6ac8fa49d0 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 943 time: 0.1638796 Dec 21 03:54:52.291171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:52.294590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2e0517a-0eda-4748-b837-7ced43e315be req-a59f5983-79fe-4236-8b4a-e66249149b64 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2713034 Dec 21 03:54:52.332497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.333699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:52.335123 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] 10.222.0.54 "PUT /v2.0/ports/6ad28080-ec80-43e4-beda-22ada18e8b66 HTTP/1.1" status: 200 len: 1092 time: 1.0282924 Dec 21 03:54:52.335574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'tag': '6ad28080-ec80-43e4-beda-22ada18e8b66'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:52.337808 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0e06c5c-fcee-4a72-bc69-0896579db824" -d '{"events": [{"name": "network-changed", "server_uuid": "7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b", "tag": "6ad28080-ec80-43e4-beda-22ada18e8b66"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:52.352197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-c9932b72-c64b-4a4c-97d4-a0122dcb4afb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0745621 Dec 21 03:54:52.360706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b85bc4d4-f1fa-4034-9123-a32a2e48e9f7 service neutron] Pushing event updated for resources: {'Port': ['ID=6ad28080-ec80-43e4-beda-22ada18e8b66,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:52.398279 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f25aa537-2c8a-47b6-864a-cda075b9cd04 x-openstack-request-id: req-f25aa537-2c8a-47b6-864a-cda075b9cd04 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:52.398687 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b", "tag": "6ad28080-ec80-43e4-beda-22ada18e8b66", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:52.399082 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f25aa537-2c8a-47b6-864a-cda075b9cd04 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:52.399703 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'tag': '6ad28080-ec80-43e4-beda-22ada18e8b66', 'status': 'completed', 'code': 200} Dec 21 03:54:52.408776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40003c1f-c4e6-4549-a0cf-aeb4c7bbbe25 req-530c4337-a3ae-4393-afe5-e1a0f7c7af3b tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323946 Dec 21 03:54:52.531111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-5334afc7-a538-4a1c-8561-c469be11bb3d service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1559644 Dec 21 03:54:52.538241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e06c5c-fcee-4a72-bc69-0896579db824 req-e6a4ac29-e235-4c0b-bb12-f40323b839b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.540858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b0e06c5c-fcee-4a72-bc69-0896579db824 req-e6a4ac29-e235-4c0b-bb12-f40323b839b4 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2b04be31d9cd41a68c439cf66bc7acba&device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 1095 time: 0.0747454 Dec 21 03:54:52.576824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'tag': '081f3a22-0532-4780-80e3-e4a902de7cc7'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:52.579049 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d7380dd-592e-49b8-a899-f2ff1054a004" -d '{"events": [{"name": "network-changed", "server_uuid": "d542aa73-2be9-4304-a336-dd58f34594b6", "tag": "081f3a22-0532-4780-80e3-e4a902de7cc7"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:52.633340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:52.661188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e06c5c-fcee-4a72-bc69-0896579db824 req-0543e460-624b-4f43-a5fe-533960a23008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.667695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b0e06c5c-fcee-4a72-bc69-0896579db824 req-0543e460-624b-4f43-a5fe-533960a23008 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2b04be31d9cd41a68c439cf66bc7acba&shared=False HTTP/1.1" status: 200 len: 911 time: 0.1082702 Dec 21 03:54:52.714979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9bc2e2-1a61-4632-9edb-966fea568919 req-358cf1a3-3477-4030-84fc-367c8988b51d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.722503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe9bc2e2-1a61-4632-9edb-966fea568919 req-358cf1a3-3477-4030-84fc-367c8988b51d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1945329 Dec 21 03:54:52.739790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2be10d-6427-421d-a6fb-4af5e32fdf49 req-f6c362b1-8ee9-4340-acdd-bff0394ebbe1 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.741536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d2be10d-6427-421d-a6fb-4af5e32fdf49 req-f6c362b1-8ee9-4340-acdd-bff0394ebbe1 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 944 time: 0.1843901 Dec 21 03:54:52.779277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e06c5c-fcee-4a72-bc69-0896579db824 req-9f4e28c3-6c52-4581-841b-9566269a5330 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.780162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0a094c-9914-4a7d-a56b-1514da3f543a req-b685e7ef-02e3-4d80-a36a-3b20633cca42 service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2214568 Dec 21 03:54:52.781003 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b0e06c5c-fcee-4a72-bc69-0896579db824 req-9f4e28c3-6c52-4581-841b-9566269a5330 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1066227 Dec 21 03:54:52.835714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d2be10d-6427-421d-a6fb-4af5e32fdf49 req-bf387e35-f3cc-46a9-b20c-05915e820bcf tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855672 Dec 21 03:54:52.841207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe9bc2e2-1a61-4632-9edb-966fea568919 req-769072da-5fb0-4bdb-88a7-2c2a3368a52e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1176741 Dec 21 03:54:52.899358 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e267bcc-1b93-4d20-93e2-920a28817d73 x-openstack-request-id: req-8e267bcc-1b93-4d20-93e2-920a28817d73 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:52.899713 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d542aa73-2be9-4304-a336-dd58f34594b6", "tag": "081f3a22-0532-4780-80e3-e4a902de7cc7", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:52.900053 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8e267bcc-1b93-4d20-93e2-920a28817d73 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:52.900495 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'tag': '081f3a22-0532-4780-80e3-e4a902de7cc7', 'status': 'completed', 'code': 200} Dec 21 03:54:52.934433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-bdf80532-8f06-4beb-a4c9-2b607af86471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:52.936725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-bdf80532-8f06-4beb-a4c9-2b607af86471 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2b04be31d9cd41a68c439cf66bc7acba&device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 1095 time: 0.0478470 Dec 21 03:54:53.027789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-34feb89d-e1f1-4219-82ac-edcec6ea6055 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6ad28080-ec80-43e4-beda-22ada18e8b66 HTTP/1.1" status: 200 len: 217 time: 0.0571916 Dec 21 03:54:53.081123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-2e5fad63-867a-434e-85e4-3908b632ba6c service neutron] 10.222.0.31 "GET /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.1309586 Dec 21 03:54:53.095091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-b1514a28-2d86-4ba1-94bc-fd72dbd0b7c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:53.096754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-b1514a28-2d86-4ba1-94bc-fd72dbd0b7c7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 1096 time: 0.1142321 Dec 21 03:54:53.104061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-4eccdc02-7ebe-4775-8615-8a4e98bf2309 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:53.104061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-4eccdc02-7ebe-4775-8615-8a4e98bf2309 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f0bc6df9-47de-41a4-bc1d-a42cf219d093 HTTP/1.1" status: 200 len: 850 time: 0.0572340 Dec 21 03:54:53.144038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-f7cae76c-3616-4512-abe3-893e9e14af32 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e59364d3-d6aa-4eba-a742-ae8caff077d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0282304 Dec 21 03:54:53.152765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e31168e-85ec-4e0b-ae95-df960f266ae2 req-a63d9d0c-7412-4efe-925e-5ba299793261 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:53.154169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e31168e-85ec-4e0b-ae95-df960f266ae2 req-a63d9d0c-7412-4efe-925e-5ba299793261 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 945 time: 0.1269796 Dec 21 03:54:53.199293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:53.256405 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-b96b84c5-4e86-4d9b-9dc3-0b46ee605c82 service neutron] 10.222.0.54 "GET /v2.0/networks/e59364d3-d6aa-4eba-a742-ae8caff077d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1004403 Dec 21 03:54:53.352506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fa3d6f21-e7fc-40d3-9a00-87e3eedc2a93 req-35685ea7-29c1-4661-a856-7d07e78fd183 service neutron] 10.222.0.54 "GET /v2.0/networks/e59364d3-d6aa-4eba-a742-ae8caff077d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871692 Dec 21 03:54:53.355576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2398a5-5d2a-4461-bd70-06133453b7a9 req-8f438135-80b3-48f5-814f-226e77c8159e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:53.364644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c2398a5-5d2a-4461-bd70-06133453b7a9 req-8f438135-80b3-48f5-814f-226e77c8159e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 944 time: 0.2249143 Dec 21 03:54:53.715720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e31168e-85ec-4e0b-ae95-df960f266ae2 req-e70fd5ab-4869-48dc-879c-0a4409c9c78b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5321133 Dec 21 03:54:53.750198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-97344fe3-a839-4288-a3d3-1360d5d7c67c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:53.751688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-97344fe3-a839-4288-a3d3-1360d5d7c67c service neutron] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.6459448 Dec 21 03:54:53.857294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-f31b7627-4d51-4d03-955d-1237560a1752 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=081f3a22-0532-4780-80e3-e4a902de7cc7 HTTP/1.1" status: 200 len: 217 time: 0.0829537 Dec 21 03:54:53.865173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c2398a5-5d2a-4461-bd70-06133453b7a9 req-e5f054a3-3735-47a3-b9ea-669cb26d0e39 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4992056 Dec 21 03:54:53.964703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-ffdcc191-6679-4ad8-970e-87dc42920209 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:53.966164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-ffdcc191-6679-4ad8-970e-87dc42920209 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.0963733 Dec 21 03:54:53.981368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:54.041470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-75fceaea-aab7-4385-84fa-23bea8edbe0d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0559888 Dec 21 03:54:54.056622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:54.105692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07acd2bf-4532-4b5e-bf5b-b80c02dab3ed req-bf772610-9305-419c-bcc7-5294b0c5cb67 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:54.107106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07acd2bf-4532-4b5e-bf5b-b80c02dab3ed req-bf772610-9305-419c-bcc7-5294b0c5cb67 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 943 time: 0.1841114 Dec 21 03:54:54.178031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-365dceb0-f768-43e9-936d-93b39990b305 req-40179e56-131d-4821-8d62-10f5802755cd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:54.179536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-365dceb0-f768-43e9-936d-93b39990b305 req-40179e56-131d-4821-8d62-10f5802755cd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 944 time: 0.2054713 Dec 21 03:54:54.223722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:54.279139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07acd2bf-4532-4b5e-bf5b-b80c02dab3ed req-3cf75699-fb88-46cd-a5a9-5051a395ed0a tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1636169 Dec 21 03:54:54.281225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-0e215731-290e-4e22-b619-69afbac010ff service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2263956 Dec 21 03:54:54.293275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-365dceb0-f768-43e9-936d-93b39990b305 req-035471e4-7d73-4d11-8622-e86a45dc037c tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011913 Dec 21 03:54:54.325826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:54.482121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc389b93-82fe-4764-af8a-6aa8bfb05f2f req-eb465d28-8c9b-4e7b-a20c-e32befe0e525 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:54.483649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc389b93-82fe-4764-af8a-6aa8bfb05f2f req-eb465d28-8c9b-4e7b-a20c-e32befe0e525 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1189923 Dec 21 03:54:54.487255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d7380dd-592e-49b8-a899-f2ff1054a004 req-1bfc0a4e-57b4-4c5c-bf8c-1ab1f602f664 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1929076 Dec 21 03:54:54.510963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Transition to ACTIVE for port object 68a76cd7-fffa-4866-9c53-87b552b1bde6 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:54:54.548275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc389b93-82fe-4764-af8a-6aa8bfb05f2f req-25bd07df-9df5-41a1-b58d-cc28e0d5adb6 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566084 Dec 21 03:54:54.581267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:54.620661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3e73b0c-caf8-4675-9272-7767d590ec34 None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:54:54.648422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] No DVR routers for this DVR port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:54:54.663680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Pushing event updated for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=11']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:54.693577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] 10.222.0.31 "PUT /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6/bindings/n-h1-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 1.6008313 Dec 21 03:54:54.695009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.695368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.696246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.699231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.699231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.699816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.700218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.700705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.701973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.702360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.702697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.703091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.703434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3e8eac9-9e66-4aa4-981c-25caed3baab4 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:54.782899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device eaac8238-a002-4ebe-980e-8aa4a84f4e4e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:54.797138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:54:54.822605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:54.845240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decb834b-fcf7-4ce8-bab4-5f95e53e89db req-1589d648-fdb7-4dab-b5d7-42fdf3b4ebcd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:54.846951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-decb834b-fcf7-4ce8-bab4-5f95e53e89db req-1589d648-fdb7-4dab-b5d7-42fdf3b4ebcd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0554140 Dec 21 03:54:54.900531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 68a76cd7-fffa-4866-9c53-87b552b1bde6 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:54:54.900933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:54:54.901615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:54.904069 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e9754c9-383b-458a-977b-04dc98674765" -d '{"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-unplugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:54.911055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-decb834b-fcf7-4ce8-bab4-5f95e53e89db req-8da59c41-dbb8-4ca5-812d-fad25c4fa1d8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555069 Dec 21 03:54:54.935354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:54.949273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e', 'network_id': 'ee3304b6-e18e-45c8-93c6-239041d697ca', 'port_id': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e', 'mac_address': 'fa:16:3e:6b:7a:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b082405b-1cdc-4188-a989-d408accdc4d2', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:54:55.003258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:55.018142 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-51097f5f-fdbe-4e59-af28-96cb81904926 x-openstack-request-id: req-51097f5f-fdbe-4e59-af28-96cb81904926 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:55.018426 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-unplugged", "status": "completed", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:55.018691 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-51097f5f-fdbe-4e59-af28-96cb81904926 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:55.019127 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'code': 200} Dec 21 03:54:55.020861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:55.025217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-96228662-c1be-4106-9c8e-2e7e141488e2 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.026773 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-96228662-c1be-4106-9c8e-2e7e141488e2 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0920460 Dec 21 03:54:55.039083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eaac8238-a002-4ebe-980e-8aa4a84f4e4e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:55.068967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:55.083546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d861fb-5eca-4648-b296-336e7d88edf2 req-9b41ec73-5ef7-4a55-8a82-bce53cecfde7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.085261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20d861fb-5eca-4648-b296-336e7d88edf2 req-9b41ec73-5ef7-4a55-8a82-bce53cecfde7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 944 time: 0.0644603 Dec 21 03:54:55.091652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-548bbd26-d9af-488e-8ae3-f71ee894461d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.093215 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-548bbd26-d9af-488e-8ae3-f71ee894461d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea&tenant_id=e49c9575c393446a904ba5840d68746b HTTP/1.1" status: 200 len: 1096 time: 0.0521445 Dec 21 03:54:55.140256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20d861fb-5eca-4648-b296-336e7d88edf2 req-723d9359-a504-44bc-b46c-5475261222ad tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465732 Dec 21 03:54:55.187800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:55.188632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 081f3a22-0532-4780-80e3-e4a902de7cc7 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:55.189775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-0bb6dee9-79ed-457b-8664-cd0fe61e4a44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.191325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-0bb6dee9-79ed-457b-8664-cd0fe61e4a44 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e49c9575c393446a904ba5840d68746b&device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1096 time: 0.0409474 Dec 21 03:54:55.286101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-8a022f72-dedf-4df1-a271-f8f330396b93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.287676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-8a022f72-dedf-4df1-a271-f8f330396b93 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 200 len: 908 time: 0.0888445 Dec 21 03:54:55.300968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:55.315106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.315466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.315824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.318899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.319134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.319486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:54:55.335801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-edf58ee5-56c5-47c4-9ab2-621cf98ce90d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 200 len: 217 time: 0.0393250 Dec 21 03:54:55.358669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 081f3a22-0532-4780-80e3-e4a902de7cc7, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=081f3a22-0532-4780-80e3-e4a902de7cc7,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:55.374450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '081f3a22-0532-4780-80e3-e4a902de7cc7', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': '081f3a22-0532-4780-80e3-e4a902de7cc7', 'mac_address': 'fa:16:3e:21:e7:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:54:55.408691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-1f7233a3-245a-4c4a-9563-a8e660b313f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.412441 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-1f7233a3-245a-4c4a-9563-a8e660b313f3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 200 len: 847 time: 0.0678895 Dec 21 03:54:55.425743 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:55.440976 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 081f3a22-0532-4780-80e3-e4a902de7cc7 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:55.455001 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-ac761887-d31e-4d51-b851-c59f0092e646 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5fd01e07-75a4-4745-ad05-8ade1a021605&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309317 Dec 21 03:54:55.465597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 081f3a22-0532-4780-80e3-e4a902de7cc7, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=081f3a22-0532-4780-80e3-e4a902de7cc7,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:55.470607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d195bcd5-5837-4981-ae56-2a300568773b req-78935fe4-0c36-490b-9a75-26b07eca751b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.472335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d195bcd5-5837-4981-ae56-2a300568773b req-78935fe4-0c36-490b-9a75-26b07eca751b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 945 time: 0.0894859 Dec 21 03:54:55.509338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b76481-b5d5-4277-923f-71168317adc5 req-570359ea-3ca9-47ab-98f2-fbf99cc28166 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.516780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4b76481-b5d5-4277-923f-71168317adc5 req-570359ea-3ca9-47ab-98f2-fbf99cc28166 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 943 time: 0.1230993 Dec 21 03:54:55.536469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:55.564097 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-a1874386-126b-4873-aac4-abcc4af1ceaf service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0985854 Dec 21 03:54:55.565064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d195bcd5-5837-4981-ae56-2a300568773b req-b06c6174-2bd2-47f4-94b7-e8b0002ff98c tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830102 Dec 21 03:54:55.600230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4b76481-b5d5-4277-923f-71168317adc5 req-a3145161-a9ee-45e9-95cc-31b4cbd817ca tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825210 Dec 21 03:54:55.643233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=081f3a22-0532-4780-80e3-e4a902de7cc7,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:55.696608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b930fd3-26c3-45f5-b529-e7f5317a04df req-7bebf7c3-8fb8-4821-9d14-7759d5b17370 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:55.698154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b930fd3-26c3-45f5-b529-e7f5317a04df req-7bebf7c3-8fb8-4821-9d14-7759d5b17370 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0544903 Dec 21 03:54:55.714362 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-a33c9d27-a175-4328-9f36-a7f57b662b19 service neutron] 10.222.0.54 "GET /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1323621 Dec 21 03:54:55.719474 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:55.755319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b930fd3-26c3-45f5-b529-e7f5317a04df req-4d744518-1685-40ea-853e-809e5a3f4c64 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495007 Dec 21 03:54:55.892375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['eaac8238-a002-4ebe-980e-8aa4a84f4e4e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:55.920275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['081f3a22-0532-4780-80e3-e4a902de7cc7'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:56.046233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3fd2c51-e71a-4444-b3aa-15f563b9eea4 req-7b34c76f-2d23-42d7-833a-853bbab8a7c4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:56.049295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3fd2c51-e71a-4444-b3aa-15f563b9eea4 req-7b34c76f-2d23-42d7-833a-853bbab8a7c4 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0622895 Dec 21 03:54:56.118447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3fd2c51-e71a-4444-b3aa-15f563b9eea4 req-c2156f00-9369-422d-89a6-fad635040e14 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610504 Dec 21 03:54:56.275376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a2374c-a25b-4e74-8bf6-377ffc2cd695 req-5b27e93c-d8e4-4a1b-ac34-225f35911c2f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:56.276931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10a2374c-a25b-4e74-8bf6-377ffc2cd695 req-5b27e93c-d8e4-4a1b-ac34-225f35911c2f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 945 time: 0.0624676 Dec 21 03:54:56.337732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10a2374c-a25b-4e74-8bf6-377ffc2cd695 req-78101252-1864-43fb-9d73-bfa61f73227f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519054 Dec 21 03:54:56.410336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-add1da62-e89e-44d0-82b8-d2fbdee807bf tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:56.411876 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-add1da62-e89e-44d0-82b8-d2fbdee807bf tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea&tenant_id=e49c9575c393446a904ba5840d68746b&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1096 time: 0.0438383 Dec 21 03:54:56.659857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-01934f48-f3ea-4815-be02-bbc6da5ce3fd service neutron] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:54:56.663115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-01934f48-f3ea-4815-be02-bbc6da5ce3fd service neutron] Publish callbacks [] for binding, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:56.664244 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-01934f48-f3ea-4815-be02-bbc6da5ce3fd service neutron] 10.222.0.54 "DELETE /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6/bindings/n-h2-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.2437723 Dec 21 03:54:56.727119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd250822-f0a6-4097-9880-cccdf113b46d req-b3e65c42-685a-4f9e-af8d-f22d0485dd7a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:56.728679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd250822-f0a6-4097-9880-cccdf113b46d req-b3e65c42-685a-4f9e-af8d-f22d0485dd7a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 945 time: 0.0832684 Dec 21 03:54:56.757504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e176bd81-b73c-48d6-9c80-640ddf808a57 req-171047e3-7180-486f-b55b-54cd413b909a tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:56.759743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e176bd81-b73c-48d6-9c80-640ddf808a57 req-171047e3-7180-486f-b55b-54cd413b909a tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 943 time: 0.0811498 Dec 21 03:54:56.803749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd250822-f0a6-4097-9880-cccdf113b46d req-4189484e-01bc-4ddf-9f57-02127a0db130 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680578 Dec 21 03:54:56.804119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device eaac8238-a002-4ebe-980e-8aa4a84f4e4e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:54:56.828974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e176bd81-b73c-48d6-9c80-640ddf808a57 req-d4d2a30e-1ea0-4829-a13a-62046eb27741 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626676 Dec 21 03:54:56.933175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afdec5f-1148-4ead-b3a1-f39f95fbe287 req-5f5528e8-bf9b-4653-a5dc-6746cfd8779d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:56.934654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8afdec5f-1148-4ead-b3a1-f39f95fbe287 req-5f5528e8-bf9b-4653-a5dc-6746cfd8779d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0493567 Dec 21 03:54:56.942312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port eaac8238-a002-4ebe-980e-8aa4a84f4e4e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:54:56.947470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port eaac8238-a002-4ebe-980e-8aa4a84f4e4e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:56.947470 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:56.984240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8afdec5f-1148-4ead-b3a1-f39f95fbe287 req-c229603b-1669-40ad-b200-35b1fdd63d19 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434928 Dec 21 03:54:57.030252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.052786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:57.055014 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c044892-75ed-452d-84a0-6814f4f87da7" -d '{"events": [{"server_uuid": "bef70845-39fe-4faf-a847-a2c9dd5b51c3", "name": "network-vif-plugged", "status": "completed", "tag": "eaac8238-a002-4ebe-980e-8aa4a84f4e4e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:57.067810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:57.092281 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcc452a5-ca5b-42d2-9744-9651635a1ab0 x-openstack-request-id: req-fcc452a5-ca5b-42d2-9744-9651635a1ab0 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:57.092645 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bef70845-39fe-4faf-a847-a2c9dd5b51c3", "name": "network-vif-plugged", "status": "completed", "tag": "eaac8238-a002-4ebe-980e-8aa4a84f4e4e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:57.092827 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fcc452a5-ca5b-42d2-9744-9651635a1ab0 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:57.093230 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e', 'code': 200} Dec 21 03:54:57.137117 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.137957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 081f3a22-0532-4780-80e3-e4a902de7cc7 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:54:57.196061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6ad28080-ec80-43e4-beda-22ada18e8b66 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:54:57.291085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4226e49d-0bc9-4f82-82fe-7bd2b8b33fc4 req-2f36bc8c-6ac0-44e4-b0ae-4772e2208144 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:57.299151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4226e49d-0bc9-4f82-82fe-7bd2b8b33fc4 req-2f36bc8c-6ac0-44e4-b0ae-4772e2208144 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0979304 Dec 21 03:54:57.342699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7baa37e-b510-4553-8262-f67a713eef9c req-ed1e2db7-3cf5-478f-9711-bbbf5844fc4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:57.344330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7baa37e-b510-4553-8262-f67a713eef9c req-ed1e2db7-3cf5-478f-9711-bbbf5844fc4f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 1098 time: 0.1118593 Dec 21 03:54:57.368168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4226e49d-0bc9-4f82-82fe-7bd2b8b33fc4 req-32a4f434-8d7d-41eb-9e74-3468542e50ca tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678537 Dec 21 03:54:57.452655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:57.495510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7baa37e-b510-4553-8262-f67a713eef9c req-fae0c888-23eb-4103-89f2-3dd5de7d518e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1198316 Dec 21 03:54:57.524744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6ad28080-ec80-43e4-beda-22ada18e8b66, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6ad28080-ec80-43e4-beda-22ada18e8b66,segment=NetworkSegment(8716391c-f24c-4bf6-8bf7-052a04f480c5),segment_id=8716391c-f24c-4bf6-8bf7-052a04f480c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:57.536579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '6ad28080-ec80-43e4-beda-22ada18e8b66', 'network_id': 'e59364d3-d6aa-4eba-a742-ae8caff077d9', 'port_id': '6ad28080-ec80-43e4-beda-22ada18e8b66', 'mac_address': 'fa:16:3e:7f:70:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 119, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f0bc6df9-47de-41a4-bc1d-a42cf219d093', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:54:57.539033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7d9874-c66c-4c5a-a3db-15637dd91d63 req-5fcfae17-7087-46a6-9f85-70c3885c4668 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:57.541192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b7d9874-c66c-4c5a-a3db-15637dd91d63 req-5fcfae17-7087-46a6-9f85-70c3885c4668 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 945 time: 0.0960746 Dec 21 03:54:57.572706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e66fbde-ed66-4ed0-b057-420aaec428d7 req-8c16328e-6b1a-46da-8663-bc0d9a09d94b tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:57.574249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e66fbde-ed66-4ed0-b057-420aaec428d7 req-8c16328e-6b1a-46da-8663-bc0d9a09d94b tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 1096 time: 0.0705616 Dec 21 03:54:57.574387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.591527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6ad28080-ec80-43e4-beda-22ada18e8b66 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:54:57.615339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b7d9874-c66c-4c5a-a3db-15637dd91d63 req-6d588739-b3fd-4dbc-b4ac-d74eca34bb8a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674136 Dec 21 03:54:57.622616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6ad28080-ec80-43e4-beda-22ada18e8b66, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6ad28080-ec80-43e4-beda-22ada18e8b66,segment=NetworkSegment(8716391c-f24c-4bf6-8bf7-052a04f480c5),segment_id=8716391c-f24c-4bf6-8bf7-052a04f480c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:57.624760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 081f3a22-0532-4780-80e3-e4a902de7cc7 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:54:57.629459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 081f3a22-0532-4780-80e3-e4a902de7cc7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:54:57.630076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.645438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e66fbde-ed66-4ed0-b057-420aaec428d7 req-c8672e6a-de2f-4b27-8cc4-4eb494244ab4 tempest-LiveMigrationTest-529948387 tempest-LiveMigrationTest-529948387-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634232 Dec 21 03:54:57.710221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.736858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.784538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6ad28080-ec80-43e4-beda-22ada18e8b66,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:57.789812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 081f3a22-0532-4780-80e3-e4a902de7cc7, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=081f3a22-0532-4780-80e3-e4a902de7cc7,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:57.891013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:57.946866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec58783b-b0f2-4e57-9e77-a36849c1af14 req-6fb9955a-0b28-4d0a-895c-a4afd8c6ce06 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:57.948579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec58783b-b0f2-4e57-9e77-a36849c1af14 req-6fb9955a-0b28-4d0a-895c-a4afd8c6ce06 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0553391 Dec 21 03:54:57.951996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=081f3a22-0532-4780-80e3-e4a902de7cc7,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:54:58.000182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec58783b-b0f2-4e57-9e77-a36849c1af14 req-25bb1adf-d292-4171-ac75-f5d835a27d31 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452807 Dec 21 03:54:58.123259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9335d8aa-2f86-4499-88fc-d5d61af8b4a9 req-5a4aa756-5e2b-47b9-beb6-1c3d713b5256 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:58.124739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9335d8aa-2f86-4499-88fc-d5d61af8b4a9 req-5a4aa756-5e2b-47b9-beb6-1c3d713b5256 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 944 time: 0.0583129 Dec 21 03:54:58.173321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9335d8aa-2f86-4499-88fc-d5d61af8b4a9 req-11c7a60d-6871-4fae-a7ce-f81108868984 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424955 Dec 21 03:54:58.203250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6ad28080-ec80-43e4-beda-22ada18e8b66'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:54:58.244929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36464bb5-2524-4e06-8ec3-e2b114f3d36d req-de1b7fb1-7355-4381-a070-da5d9c62c95f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:58.246463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36464bb5-2524-4e06-8ec3-e2b114f3d36d req-de1b7fb1-7355-4381-a070-da5d9c62c95f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0536261 Dec 21 03:54:58.331504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c3abfd-1ba0-4884-9697-a2fa623ac961 req-b8faffac-8e3e-4085-b419-c3bc0a21c165 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:58.333062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c3abfd-1ba0-4884-9697-a2fa623ac961 req-b8faffac-8e3e-4085-b419-c3bc0a21c165 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0856791 Dec 21 03:54:58.358065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36464bb5-2524-4e06-8ec3-e2b114f3d36d req-e35e0bd2-46fa-4aa5-8b7a-3e936940213d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869365 Dec 21 03:54:58.421886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c3abfd-1ba0-4884-9697-a2fa623ac961 req-37087398-660b-46c1-a8e4-18f48f3a9dbb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627778 Dec 21 03:54:58.748396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88ffa3e-de42-4524-84c8-f485294ac9b5 req-1ebb2fb7-f154-4458-8eef-a2f7d2d0764b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:58.750019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b88ffa3e-de42-4524-84c8-f485294ac9b5 req-1ebb2fb7-f154-4458-8eef-a2f7d2d0764b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0557175 Dec 21 03:54:58.797977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b88ffa3e-de42-4524-84c8-f485294ac9b5 req-b8cf3f3f-5739-4b5d-98ec-4e669ac46ccf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416443 Dec 21 03:54:59.094538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '081f3a22-0532-4780-80e3-e4a902de7cc7'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:54:59.096882 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-324dd77f-d238-43c5-bf04-c8fac833d84e" -d '{"events": [{"server_uuid": "d542aa73-2be9-4304-a336-dd58f34594b6", "name": "network-vif-plugged", "status": "completed", "tag": "081f3a22-0532-4780-80e3-e4a902de7cc7"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:54:59.139406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62acbdc-2298-4eec-bda9-820226a5a732 req-fd9cae0a-b598-4bd4-8053-8e198da54a53 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.141011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a62acbdc-2298-4eec-bda9-820226a5a732 req-fd9cae0a-b598-4bd4-8053-8e198da54a53 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0579450 Dec 21 03:54:59.147520 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:54:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e4164a7-2cae-491b-92f1-78337ec144d7 x-openstack-request-id: req-5e4164a7-2cae-491b-92f1-78337ec144d7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:54:59.147815 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d542aa73-2be9-4304-a336-dd58f34594b6", "name": "network-vif-plugged", "status": "completed", "tag": "081f3a22-0532-4780-80e3-e4a902de7cc7", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:54:59.148072 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5e4164a7-2cae-491b-92f1-78337ec144d7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:54:59.148458 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '081f3a22-0532-4780-80e3-e4a902de7cc7', 'code': 200} Dec 21 03:54:59.155691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-7fa40e5e-539a-4e00-9d45-0a594e6035a9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.157517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-7fa40e5e-539a-4e00-9d45-0a594e6035a9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0661013 Dec 21 03:54:59.200199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a62acbdc-2298-4eec-bda9-820226a5a732 req-c0db4a76-06ce-4e68-927d-466261dc50a4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513177 Dec 21 03:54:59.276489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Deleting port 68a76cd7-fffa-4866-9c53-87b552b1bde6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:54:59.276834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:59.324001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4457838a-267a-4d07-a72a-89ebeb5abf4a req-e5fd0eb0-cbdf-4e92-9f63-e6904a7bfdde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.325336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4457838a-267a-4d07-a72a-89ebeb5abf4a req-e5fd0eb0-cbdf-4e92-9f63-e6904a7bfdde service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 1098 time: 0.0759068 Dec 21 03:54:59.340534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511cfcc6-cff7-44cf-910c-92f0c1458e77 req-48b475a9-7b9e-4fc5-a31d-5922e7a8f3c7 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.342599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-511cfcc6-cff7-44cf-910c-92f0c1458e77 req-48b475a9-7b9e-4fc5-a31d-5922e7a8f3c7 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 944 time: 0.0813134 Dec 21 03:54:59.422670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4457838a-267a-4d07-a72a-89ebeb5abf4a req-096d70cf-0a8d-4988-841f-9cdc6528a843 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790045 Dec 21 03:54:59.427749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-511cfcc6-cff7-44cf-910c-92f0c1458e77 req-f3ef6fcd-c050-43a5-9c8f-2e711a8e568f tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780561 Dec 21 03:54:59.559520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec48324e-fefc-4208-aeb2-77bd89226c8f req-e47db9b4-49be-4dc0-a6d0-f0aa7721b92a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.562616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec48324e-fefc-4208-aeb2-77bd89226c8f req-e47db9b4-49be-4dc0-a6d0-f0aa7721b92a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0638592 Dec 21 03:54:59.640852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec48324e-fefc-4208-aeb2-77bd89226c8f req-93eceb94-20e4-4d68-8cc5-191da228f1a1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670724 Dec 21 03:54:59.649843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d963a9-ebe9-4f3b-ae6e-3752fb9a4e4e req-41d1957e-e36b-4459-97bf-f87f8accaaa3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.651430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10d963a9-ebe9-4f3b-ae6e-3752fb9a4e4e req-41d1957e-e36b-4459-97bf-f87f8accaaa3 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 944 time: 0.0874281 Dec 21 03:54:59.708854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10d963a9-ebe9-4f3b-ae6e-3752fb9a4e4e req-f9f1e9f3-a14c-4976-9055-557f41390cbf tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459316 Dec 21 03:54:59.711279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] For port 68a76cd7-fffa-4866-9c53-87b552b1bde6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=68a76cd7-fffa-4866-9c53-87b552b1bde6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:54:59.711640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:59.724020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Calling delete_port for 68a76cd7-fffa-4866-9c53-87b552b1bde6 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:54:59.819250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c622da54-a80a-4759-bbd9-1f3105aa6f08 req-490d3b5b-107e-43c9-b187-381f24e66d2d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.821474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c622da54-a80a-4759-bbd9-1f3105aa6f08 req-490d3b5b-107e-43c9-b187-381f24e66d2d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0509584 Dec 21 03:54:59.942423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c622da54-a80a-4759-bbd9-1f3105aa6f08 req-c00ac55e-6a37-49d3-a593-cf10ac7436c5 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128614 Dec 21 03:54:59.951699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-5d16a3e0-a0a9-4c31-9501-d66903d18edf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.953249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-5d16a3e0-a0a9-4c31-9501-d66903d18edf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 1098 time: 0.1084330 Dec 21 03:54:59.987886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:54:59.989084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40d67f1-8648-483e-99a8-60b66eb6012e req-2399ed82-6b1e-4ed1-9ed7-a42dcc651be0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:54:59.990564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e40d67f1-8648-483e-99a8-60b66eb6012e req-2399ed82-6b1e-4ed1-9ed7-a42dcc651be0 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0868545 Dec 21 03:55:00.020799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event deleted for resources: {'Port': ['ID=68a76cd7-fffa-4866-9c53-87b552b1bde6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:00.045902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['425b1a38-084b-43fc-ab16-7a0f86f2eb65', '68a76cd7-fffa-4866-9c53-87b552b1bde6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:00.073066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbfa62c2-2a6e-4bc9-bfa8-74adde9b7dea None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:00.082976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] No DVR routers for this DVR port 68a76cd7-fffa-4866-9c53-87b552b1bde6 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:00.105596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:00.105596 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-deeebfd2-f681-4608-a705-ddeb3e89a5e2 req-a7124b13-9698-4d7a-93c3-5058c5526069 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "DELETE /v2.0/ports/68a76cd7-fffa-4866-9c53-87b552b1bde6 HTTP/1.1" status: 204 len: 173 time: 0.9214554 Dec 21 03:55:00.105596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-deleted', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:00.105596 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e1b23da-0691-4566-b7a6-dfb0c13870b5" -d '{"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-deleted", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:00.107124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e40d67f1-8648-483e-99a8-60b66eb6012e req-ef383128-16d9-48c5-864d-37fd2ea4447e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933955 Dec 21 03:55:00.122842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-c451e62b-013a-44fe-8cf1-466576ce760a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:00.124778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-c451e62b-013a-44fe-8cf1-466576ce760a service neutron] 10.222.0.31 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 910 time: 0.1627018 Dec 21 03:55:00.156814 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-838c154f-83e5-4e55-abe1-29f22e98aaa7 x-openstack-request-id: req-838c154f-83e5-4e55-abe1-29f22e98aaa7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:00.156814 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd84809c-3528-4778-97d3-e64d2c7757ea", "name": "network-vif-deleted", "tag": "68a76cd7-fffa-4866-9c53-87b552b1bde6", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:00.156814 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-838c154f-83e5-4e55-abe1-29f22e98aaa7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:00.156814 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd84809c-3528-4778-97d3-e64d2c7757ea', 'name': 'network-vif-deleted', 'tag': '68a76cd7-fffa-4866-9c53-87b552b1bde6', 'status': 'completed', 'code': 200} Dec 21 03:55:00.180762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-34967d35-ea69-455d-b922-9302961dc927 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e HTTP/1.1" status: 200 len: 217 time: 0.0460029 Dec 21 03:55:00.237545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-726dbd1d-2aa2-4cd9-a73f-b766c32e4539 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:00.239228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-726dbd1d-2aa2-4cd9-a73f-b766c32e4539 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.0517693 Dec 21 03:55:00.279739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-c16d9fa6-960e-4d24-8476-38653e54c060 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0291564 Dec 21 03:55:00.381385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-7f180cd6-4f62-40d1-a7f5-fed612867df9 service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919862 Dec 21 03:55:00.598043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140c058c-8806-4563-8cd6-8cc66669398d req-b8a4baf1-0555-4251-9f35-3cffdde82cb7 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:00.599657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-140c058c-8806-4563-8cd6-8cc66669398d req-b8a4baf1-0555-4251-9f35-3cffdde82cb7 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 944 time: 0.0764678 Dec 21 03:55:00.601430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-694f64ec-1b6b-42d4-b578-61e335e63ed0 req-97c5ebee-8856-44b8-bf4e-868ea75f293f service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1730828 Dec 21 03:55:00.658129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-140c058c-8806-4563-8cd6-8cc66669398d req-565372b5-977b-48b9-8ad1-bdc19e29ee87 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510046 Dec 21 03:55:00.786154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bcaafdb-4438-4c19-9aea-d9c38b53f06e req-3102a652-f1d3-47e1-bf0a-4428e3b4bd95 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:00.788205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bcaafdb-4438-4c19-9aea-d9c38b53f06e req-3102a652-f1d3-47e1-bf0a-4428e3b4bd95 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0660913 Dec 21 03:55:00.844456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6c08803-e9d0-42a0-8fe7-a5023beee8d0 req-8c8d419d-f7b2-453d-a0ad-004fe037e136 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0390208 Dec 21 03:55:00.899350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bcaafdb-4438-4c19-9aea-d9c38b53f06e req-f350af08-84af-4b2e-80e6-1f3e345d3d56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977898 Dec 21 03:55:01.078314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1450973-e423-4ad1-b11f-13c4f1a76a98 req-2a07eebb-478d-4632-a58d-92b22a46f9bb tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:01.079877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1450973-e423-4ad1-b11f-13c4f1a76a98 req-2a07eebb-478d-4632-a58d-92b22a46f9bb tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0604100 Dec 21 03:55:01.132658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1450973-e423-4ad1-b11f-13c4f1a76a98 req-8455f2f8-aa97-4830-93c5-5116d6c74a57 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464046 Dec 21 03:55:01.220079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7304eee-e19e-4ae8-93dc-94a9d5ced8c8 req-25ddf768-3f47-4177-9974-a14d9caae3cb tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:01.220728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6ad28080-ec80-43e4-beda-22ada18e8b66 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:01.221619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7304eee-e19e-4ae8-93dc-94a9d5ced8c8 req-25ddf768-3f47-4177-9974-a14d9caae3cb tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0561144 Dec 21 03:55:01.274586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7304eee-e19e-4ae8-93dc-94a9d5ced8c8 req-062cc903-4a87-456d-960b-6969b8392874 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464036 Dec 21 03:55:01.343709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 6ad28080-ec80-43e4-beda-22ada18e8b66 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:55:01.348302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 6ad28080-ec80-43e4-beda-22ada18e8b66 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:01.348932 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:01.443669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:01.473714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ad28080-ec80-43e4-beda-22ada18e8b66'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:01.476115 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-beb8fb58-53ed-4b72-8e6c-cc8d6a97a14f" -d '{"events": [{"server_uuid": "7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b", "name": "network-vif-plugged", "status": "completed", "tag": "6ad28080-ec80-43e4-beda-22ada18e8b66"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:01.491087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6ad28080-ec80-43e4-beda-22ada18e8b66, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6ad28080-ec80-43e4-beda-22ada18e8b66,segment=NetworkSegment(8716391c-f24c-4bf6-8bf7-052a04f480c5),segment_id=8716391c-f24c-4bf6-8bf7-052a04f480c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:01.530203 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d8e8aee-cd26-480d-b3e7-8a71eca2634b x-openstack-request-id: req-1d8e8aee-cd26-480d-b3e7-8a71eca2634b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:01.530203 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b", "name": "network-vif-plugged", "status": "completed", "tag": "6ad28080-ec80-43e4-beda-22ada18e8b66", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:01.530203 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1d8e8aee-cd26-480d-b3e7-8a71eca2634b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:01.530203 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6ad28080-ec80-43e4-beda-22ada18e8b66', 'code': 200} Dec 21 03:55:01.582382 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:01.583696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:01.635807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 68a76cd7-fffa-4866-9c53-87b552b1bde6 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:01.636786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 68a76cd7-fffa-4866-9c53-87b552b1bde6 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:01.672014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6ad28080-ec80-43e4-beda-22ada18e8b66,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:01.770019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64aa14b-cb60-4d0f-98dc-1ac5cafca5ae req-5afeb028-a9f5-46b2-86fd-94088370d5c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:01.773248 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a64aa14b-cb60-4d0f-98dc-1ac5cafca5ae req-5afeb028-a9f5-46b2-86fd-94088370d5c2 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 1097 time: 0.0594535 Dec 21 03:55:01.830169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a64aa14b-cb60-4d0f-98dc-1ac5cafca5ae req-bc176d6d-6d70-48ad-a782-e5306c335d81 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460234 Dec 21 03:55:01.855297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fb5679b-9188-4814-95c6-c0a085c4fa21 req-857f105e-c581-455c-b178-d063999fcafe tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:01.864739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fb5679b-9188-4814-95c6-c0a085c4fa21 req-857f105e-c581-455c-b178-d063999fcafe tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1326041 Dec 21 03:55:01.901190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e990a6-6122-4dea-8e2a-9580e288973e req-51e00cf9-0405-4d15-93aa-347c8f75b39b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:01.902730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7e990a6-6122-4dea-8e2a-9580e288973e req-51e00cf9-0405-4d15-93aa-347c8f75b39b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.1174963 Dec 21 03:55:01.918838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f71f1bc-791d-4c1e-ba06-48b51faf84e9 req-a46ceee4-7a50-48c7-8017-dbaf444f1427 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:01.920419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f71f1bc-791d-4c1e-ba06-48b51faf84e9 req-a46ceee4-7a50-48c7-8017-dbaf444f1427 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 945 time: 0.1486061 Dec 21 03:55:01.979342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fb5679b-9188-4814-95c6-c0a085c4fa21 req-d72a0135-d28f-4fc7-b887-fd73110dffdf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088948 Dec 21 03:55:02.046111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7e990a6-6122-4dea-8e2a-9580e288973e req-61ca5734-693c-4033-b806-b44fe69d2adb service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244555 Dec 21 03:55:02.074370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f71f1bc-791d-4c1e-ba06-48b51faf84e9 req-0849f1e7-396a-4fb7-818a-13e1d9335dba tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1344934 Dec 21 03:55:02.133227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dc18345-de7c-4b99-8851-ef8d3802960d req-25c2df52-2e64-4677-b906-247551511d36 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0398374 Dec 21 03:55:02.236300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1766b88-f09b-4c28-a9c0-97cac1f21472 req-8625a5ee-d249-4f65-9567-ea1235a08c6a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:02.245703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1766b88-f09b-4c28-a9c0-97cac1f21472 req-8625a5ee-d249-4f65-9567-ea1235a08c6a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0664666 Dec 21 03:55:02.299639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1766b88-f09b-4c28-a9c0-97cac1f21472 req-a0da001c-6b38-4657-941e-35f59b36f55a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550866 Dec 21 03:55:02.421483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49c7dee-bcbb-4d0b-8aa4-1b5747f9c55a req-e0f97fe9-e7e2-460a-91db-f445e038e490 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:02.426954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49c7dee-bcbb-4d0b-8aa4-1b5747f9c55a req-e0f97fe9-e7e2-460a-91db-f445e038e490 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0528569 Dec 21 03:55:02.480414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49c7dee-bcbb-4d0b-8aa4-1b5747f9c55a req-69bb3ef5-408c-48f4-acdd-654eb06bcbfd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507298 Dec 21 03:55:03.109110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc785a9-2941-4e8a-975a-871c065823a9 req-15e324ff-58af-4c6e-bf44-8940281cd390 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:03.110672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fc785a9-2941-4e8a-975a-871c065823a9 req-15e324ff-58af-4c6e-bf44-8940281cd390 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0590918 Dec 21 03:55:03.170298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fc785a9-2941-4e8a-975a-871c065823a9 req-1266c033-97e6-411a-b2ca-67fc37f084b4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513184 Dec 21 03:55:03.268334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3502d4-f3a5-4b05-b971-ced0eeed897e req-a66794aa-6e13-40c9-9713-537814216fd4 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:03.270258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d3502d4-f3a5-4b05-b971-ced0eeed897e req-a66794aa-6e13-40c9-9713-537814216fd4 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 945 time: 0.0916615 Dec 21 03:55:03.351561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1739e628-d1c4-41ce-b46c-cfedeb966bee req-3bd9ecfb-543e-49f5-b0d9-acc52c44b91c tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0405667 Dec 21 03:55:03.376351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d3502d4-f3a5-4b05-b971-ced0eeed897e req-c5e7fc63-fbe2-45f3-8098-31dbf058849f tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851567 Dec 21 03:55:03.536031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a5a264-cd3d-4d41-9cca-ef5fb7c5f8a7 req-80dcde06-b0ed-4fef-bf92-69f1495d46c1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:03.537599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2a5a264-cd3d-4d41-9cca-ef5fb7c5f8a7 req-80dcde06-b0ed-4fef-bf92-69f1495d46c1 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1139655 Dec 21 03:55:03.635911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2a5a264-cd3d-4d41-9cca-ef5fb7c5f8a7 req-bc3de5bb-44c2-4a08-9752-063ea2199148 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770566 Dec 21 03:55:03.706171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cfd980-4a66-425b-8e0e-aee85444506f req-27e97ed6-5da6-4fc6-84a8-75687ee3dc10 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:03.752792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66cfd980-4a66-425b-8e0e-aee85444506f req-27e97ed6-5da6-4fc6-84a8-75687ee3dc10 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1302209 Dec 21 03:55:03.918383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66cfd980-4a66-425b-8e0e-aee85444506f req-ff80a5a2-c88a-423a-b4ea-0e9979b15e75 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1631632 Dec 21 03:55:04.181626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218836cb-3ee9-44a3-ab70-df3b231d6c92 req-21279a1c-716d-4b42-8faf-1b23e9a6a476 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:04.188982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-218836cb-3ee9-44a3-ab70-df3b231d6c92 req-21279a1c-716d-4b42-8faf-1b23e9a6a476 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0638566 Dec 21 03:55:04.347570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-218836cb-3ee9-44a3-ab70-df3b231d6c92 req-45c226c9-a65b-4f0b-b63c-d2887dc74a86 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1561294 Dec 21 03:55:04.382071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df93afb7-55ac-48ee-9735-928b80c42609 req-33c6c984-139a-465b-a87a-17404efb3dc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:04.384621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-33c6c984-139a-465b-a87a-17404efb3dc5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.1736431 Dec 21 03:55:04.393285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c86f3f6e-9e1d-4fa5-852b-fa93af849117 req-ffd3d58a-153b-4ce3-8706-9ddf4b8c9aff tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:04.401628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c86f3f6e-9e1d-4fa5-852b-fa93af849117 req-ffd3d58a-153b-4ce3-8706-9ddf4b8c9aff tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1191268 Dec 21 03:55:04.478735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-010ec104-d95d-457b-ae35-9448eef9a213 req-47d9e803-6419-404b-a0b8-5afb55b39363 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0515668 Dec 21 03:55:04.560919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c86f3f6e-9e1d-4fa5-852b-fa93af849117 req-1b55ccee-2020-42ef-b739-1afb9956a478 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1445317 Dec 21 03:55:04.581327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df93afb7-55ac-48ee-9735-928b80c42609 req-26035e56-6052-4ee1-a269-13dcc98c96d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:04.582980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-26035e56-6052-4ee1-a269-13dcc98c96d2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.1727872 Dec 21 03:55:04.671169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-778f255d-9ffe-4302-a9b1-a43150f674a4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0779231 Dec 21 03:55:04.700134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc56554-bcce-4945-9653-30291bb7ae54 req-6336a3fe-b08c-487a-9696-2e7c50641cc9 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:04.701825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bc56554-bcce-4945-9653-30291bb7ae54 req-6336a3fe-b08c-487a-9696-2e7c50641cc9 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 945 time: 0.1177115 Dec 21 03:55:04.785917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df93afb7-55ac-48ee-9735-928b80c42609 req-bd189f72-0f2a-4ec3-adff-9bf7018afd31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:04.787607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-bd189f72-0f2a-4ec3-adff-9bf7018afd31 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.1092701 Dec 21 03:55:04.792338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bc56554-bcce-4945-9653-30291bb7ae54 req-0e3470f0-1c97-45b3-a3df-391d5cbab93a tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612481 Dec 21 03:55:04.828310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-c348c6be-06eb-47f2-bf6d-1bdc8b193352 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331469 Dec 21 03:55:05.065654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-82fe4dc5-e83b-4669-b041-7aef67fb7332 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2281914 Dec 21 03:55:05.089137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb9953f-dde4-43fc-82ce-a4b32f4e449e req-02d2be94-d44a-41aa-a4ce-4b35c8dab113 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:05.097670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bb9953f-dde4-43fc-82ce-a4b32f4e449e req-02d2be94-d44a-41aa-a4ce-4b35c8dab113 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0867872 Dec 21 03:55:05.209580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bb9953f-dde4-43fc-82ce-a4b32f4e449e req-ce556266-0ab5-450e-8575-6f6363cbc2e4 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109288 Dec 21 03:55:05.227648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df93afb7-55ac-48ee-9735-928b80c42609 req-adcfe5b5-1d65-4933-9177-c9005433352e service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1531858 Dec 21 03:55:05.872115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d57272-fc2a-47b4-ab7d-1e3555acbeb2 req-c3dd7aec-d519-4f4c-a265-3b06aa123b05 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:05.874001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4d57272-fc2a-47b4-ab7d-1e3555acbeb2 req-c3dd7aec-d519-4f4c-a265-3b06aa123b05 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 945 time: 0.4401810 Dec 21 03:55:05.882423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8bb213-cfa1-4daf-a35e-9d7b28b8aa49 req-693ec57d-6b08-4ab1-9754-e99d5f8b4a3f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:05.887542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c8bb213-cfa1-4daf-a35e-9d7b28b8aa49 req-693ec57d-6b08-4ab1-9754-e99d5f8b4a3f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.4452527 Dec 21 03:55:06.003671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4d57272-fc2a-47b4-ab7d-1e3555acbeb2 req-eb1ff66a-5eea-4862-bc81-061c95bd29b5 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1149704 Dec 21 03:55:06.030725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c8bb213-cfa1-4daf-a35e-9d7b28b8aa49 req-2d760edc-c4d2-4cb5-8453-ec3ac0936f85 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1398873 Dec 21 03:55:06.168944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84d864a8-02e2-45df-9a8f-6c1ae88a08ad req-29652ed5-9812-41c0-a3a7-4cc4c704c540 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=bd84809c-3528-4778-97d3-e64d2c7757ea HTTP/1.1" status: 200 len: 210 time: 0.0506260 Dec 21 03:55:06.241293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d433ba-186d-4016-93fe-067a641f5d64 req-575babda-41b6-4ea1-8c34-6192e904aa5d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:06.245059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93d433ba-186d-4016-93fe-067a641f5d64 req-575babda-41b6-4ea1-8c34-6192e904aa5d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1148942 Dec 21 03:55:06.322083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93d433ba-186d-4016-93fe-067a641f5d64 req-171c9a00-748b-4172-b550-2146050de913 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676770 Dec 21 03:55:06.451125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf1108c-ac76-48f0-93c8-8319effb7535 req-f6668cf2-517a-4fe8-878f-06a9b51e9a73 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:06.454441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acf1108c-ac76-48f0-93c8-8319effb7535 req-f6668cf2-517a-4fe8-878f-06a9b51e9a73 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0570927 Dec 21 03:55:06.518112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acf1108c-ac76-48f0-93c8-8319effb7535 req-e247cf8f-4792-4b2d-8c17-76d4b6fa882d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562055 Dec 21 03:55:07.240339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c92395-9d1b-44d4-a648-86a0de199ecb req-914f8e1e-67b1-4a52-aafa-9986bfe237e6 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:07.259499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03c92395-9d1b-44d4-a648-86a0de199ecb req-914f8e1e-67b1-4a52-aafa-9986bfe237e6 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 945 time: 0.1344020 Dec 21 03:55:07.308042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979bb090-851d-4033-a1a0-87c864da5d30 req-ee4ea43f-fdcc-457b-8b52-7e0759e56e09 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:07.309727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-979bb090-851d-4033-a1a0-87c864da5d30 req-ee4ea43f-fdcc-457b-8b52-7e0759e56e09 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1140666 Dec 21 03:55:07.353106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03c92395-9d1b-44d4-a648-86a0de199ecb req-c0d592be-efb4-498a-9667-eb8c19075f63 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913162 Dec 21 03:55:07.454127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-979bb090-851d-4033-a1a0-87c864da5d30 req-4e10326f-a7ef-4e28-bb9a-35c1f00c946e tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177404 Dec 21 03:55:07.658727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664a8cfc-92a8-49b8-bbb9-47c500942894 req-d5e25c7a-dac0-4303-a176-d027d66b8d41 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:07.660911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-664a8cfc-92a8-49b8-bbb9-47c500942894 req-d5e25c7a-dac0-4303-a176-d027d66b8d41 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0902414 Dec 21 03:55:07.727000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-664a8cfc-92a8-49b8-bbb9-47c500942894 req-50612172-9156-49b1-a3f2-7efde2bfeed7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536799 Dec 21 03:55:07.808547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-405784b4-3232-411a-aa67-69fbc096f7fd tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:07.810700 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-405784b4-3232-411a-aa67-69fbc096f7fd tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.54 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 945 time: 0.1137187 Dec 21 03:55:07.992782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714f2d73-4337-47ba-8e7b-1187475ece0a req-0b9c6947-f60a-4983-85bc-46c08c6e02af tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:08.004914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714f2d73-4337-47ba-8e7b-1187475ece0a req-0b9c6947-f60a-4983-85bc-46c08c6e02af tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1291277 Dec 21 03:55:08.080324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Deleting port 6ad28080-ec80-43e4-beda-22ada18e8b66 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:08.080806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:08.107002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714f2d73-4337-47ba-8e7b-1187475ece0a req-664d3c2e-bdd4-4bb3-a9c7-e4bd5e0b79e0 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961974 Dec 21 03:55:08.245840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] For port 6ad28080-ec80-43e4-beda-22ada18e8b66, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6ad28080-ec80-43e4-beda-22ada18e8b66,segment=NetworkSegment(8716391c-f24c-4bf6-8bf7-052a04f480c5),segment_id=8716391c-f24c-4bf6-8bf7-052a04f480c5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:08.246435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:08.258859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Calling delete_port for 6ad28080-ec80-43e4-beda-22ada18e8b66 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:08.599295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:08.638872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6ad28080-ec80-43e4-beda-22ada18e8b66'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:08.653441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99797f2f-6c7d-4b9c-90b3-159a3d81d939 req-46ed8b71-7b58-4891-9429-1cadc78d5bc0 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:08.655553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99797f2f-6c7d-4b9c-90b3-159a3d81d939 req-46ed8b71-7b58-4891-9429-1cadc78d5bc0 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 867 time: 0.1210334 Dec 21 03:55:08.672392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401cd761-6691-472e-9d0b-3c334a4f8ff1 req-328b6434-ed91-4c00-8f0f-08cb1ecb6d4f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:08.674041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Pushing event deleted for resources: {'Port': ['ID=6ad28080-ec80-43e4-beda-22ada18e8b66,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:08.680981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-401cd761-6691-472e-9d0b-3c334a4f8ff1 req-328b6434-ed91-4c00-8f0f-08cb1ecb6d4f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0983183 Dec 21 03:55:08.755895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] No DVR routers for this DVR port 6ad28080-ec80-43e4-beda-22ada18e8b66 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:08.761440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:08.767952 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6eba0b76-3d45-430b-a689-de9aee6d0326 req-4a9ab598-7017-492f-aed5-9d501a8f8152 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.54 "DELETE /v2.0/ports/6ad28080-ec80-43e4-beda-22ada18e8b66 HTTP/1.1" status: 204 len: 173 time: 0.9450839 Dec 21 03:55:08.768749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'name': 'network-vif-deleted', 'tag': '6ad28080-ec80-43e4-beda-22ada18e8b66'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:08.771203 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b75b6ae5-e6ef-4711-a211-e4380b0050c2" -d '{"events": [{"server_uuid": "7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b", "name": "network-vif-deleted", "tag": "6ad28080-ec80-43e4-beda-22ada18e8b66"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:08.778244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-401cd761-6691-472e-9d0b-3c334a4f8ff1 req-29641dd8-fb2e-488d-ba44-0ce8f7cf6cb5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959740 Dec 21 03:55:08.799461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99797f2f-6c7d-4b9c-90b3-159a3d81d939 req-01d86ebd-74f9-4466-aa3e-6f3a6726bcf3 tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/security-groups?id=0d361e13-be23-4d7d-8f0e-4e3f47508683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1055777 Dec 21 03:55:09.083346 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92503ec9-a6e2-4d9c-a4f3-de8d2e169584 x-openstack-request-id: req-92503ec9-a6e2-4d9c-a4f3-de8d2e169584 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:09.084340 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b", "name": "network-vif-deleted", "tag": "6ad28080-ec80-43e4-beda-22ada18e8b66", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:09.084890 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-92503ec9-a6e2-4d9c-a4f3-de8d2e169584 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:09.085491 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b', 'name': 'network-vif-deleted', 'tag': '6ad28080-ec80-43e4-beda-22ada18e8b66', 'status': 'completed', 'code': 200} Dec 21 03:55:09.155189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57a279e-4f3f-4762-8fda-67a4a5ffb7ad req-8ee3e2e7-4b2c-4854-9b15-d6f84af7a137 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:09.157535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f57a279e-4f3f-4762-8fda-67a4a5ffb7ad req-8ee3e2e7-4b2c-4854-9b15-d6f84af7a137 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0820873 Dec 21 03:55:09.298093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f57a279e-4f3f-4762-8fda-67a4a5ffb7ad req-34f4f1a1-14ef-474d-b7dd-f6e16db93cc6 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1322227 Dec 21 03:55:09.343677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3c9fd3-6766-4ff9-a9ae-59f94bed452e req-ab3f2f7a-9db3-4f55-82a6-a3dbc91a1eb6 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:09.347769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad3c9fd3-6766-4ff9-a9ae-59f94bed452e req-ab3f2f7a-9db3-4f55-82a6-a3dbc91a1eb6 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.0951171 Dec 21 03:55:09.464082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad3c9fd3-6766-4ff9-a9ae-59f94bed452e req-582898fb-3fd3-40f7-98ac-5f28d216f9d5 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1045735 Dec 21 03:55:09.512814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba0d94d-3376-4dcf-bb21-e785ac27bb06 req-feb1315f-32a4-432f-be09-f914396f1b11 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:09.518504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ba0d94d-3376-4dcf-bb21-e785ac27bb06 req-feb1315f-32a4-432f-be09-f914396f1b11 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1450524 Dec 21 03:55:09.632691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ba0d94d-3376-4dcf-bb21-e785ac27bb06 req-69abeac9-8e40-4d41-9ec2-0cb6c149d6fa tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994558 Dec 21 03:55:09.928965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59d2a9d3-1320-4abb-ab1c-bb6ebf06bc9d req-8f61cefe-b7de-49c1-a96b-1d9e6c03c77a tempest-ServerGroupTestJSON-1892954728 tempest-ServerGroupTestJSON-1892954728-project] 10.222.0.18 "GET /v2.0/ports?device_id=7d1dfb41-1c9a-4637-b4cf-a673b2eeed5b HTTP/1.1" status: 200 len: 210 time: 0.0279467 Dec 21 03:55:10.528076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3980f8e6-20c2-48fd-a0df-89ca5d8c864a req-066f2cce-4ba9-42bb-9cdb-76aece9637df tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:10.546667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3980f8e6-20c2-48fd-a0df-89ca5d8c864a req-066f2cce-4ba9-42bb-9cdb-76aece9637df tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1164346 Dec 21 03:55:10.646649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3980f8e6-20c2-48fd-a0df-89ca5d8c864a req-b75c93ae-b5e4-4999-bbac-76979d2a622a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958884 Dec 21 03:55:10.810515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97bb1576-7375-4297-b1ae-0af00bf187d8 req-b42239a0-4a29-4e4c-8c33-889ce8657859 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:10.822040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97bb1576-7375-4297-b1ae-0af00bf187d8 req-b42239a0-4a29-4e4c-8c33-889ce8657859 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.1174223 Dec 21 03:55:10.912865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc1cb441-92ac-4841-ba0c-d4ea690b018a req-474be2c9-692f-43d9-9e0d-90550cd562c3 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:10.921840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc1cb441-92ac-4841-ba0c-d4ea690b018a req-474be2c9-692f-43d9-9e0d-90550cd562c3 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1828871 Dec 21 03:55:10.990686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97bb1576-7375-4297-b1ae-0af00bf187d8 req-53bf4869-9517-41c7-8e6b-82af3df077e7 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1676526 Dec 21 03:55:11.122908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc1cb441-92ac-4841-ba0c-d4ea690b018a req-bdf975fa-5dfb-44fe-9cf2-e43d2e2454a2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1882668 Dec 21 03:55:11.215089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6ad28080-ec80-43e4-beda-22ada18e8b66 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:11.293919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 6ad28080-ec80-43e4-beda-22ada18e8b66 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:11.299485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6ad28080-ec80-43e4-beda-22ada18e8b66 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:11.499896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58612) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:11.599195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Deleting subnet f0bc6df9-47de-41a4-bc1d-a42cf219d093 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:11.603326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:11.708680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:11.788880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:11.811229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59699d5-d001-47d8-82e5-80b96d874ace req-e9878386-26a9-4230-a56c-c761f816d3e3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:11.827488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f59699d5-d001-47d8-82e5-80b96d874ace req-e9878386-26a9-4230-a56c-c761f816d3e3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0909886 Dec 21 03:55:11.894557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f59699d5-d001-47d8-82e5-80b96d874ace req-4a21a8aa-ef9b-4232-a1ff-d3bcc8099928 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568843 Dec 21 03:55:11.944556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.008666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f0bc6df9-47de-41a4-bc1d-a42cf219d093,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:12.013122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.063492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58624) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:12.064738 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e8238213-b8a1-43a6-8fef-aaf820052ce9 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/f0bc6df9-47de-41a4-bc1d-a42cf219d093 HTTP/1.1" status: 204 len: 168 time: 0.5640540 Dec 21 03:55:12.201685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f5a186-bc54-4474-a54c-2da841bd1cee req-1312f3a3-1529-450d-ac09-8463ffeae170 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:12.209247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59f5a186-bc54-4474-a54c-2da841bd1cee req-1312f3a3-1529-450d-ac09-8463ffeae170 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1769867 Dec 21 03:55:12.252987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.262185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-494d9055-f34e-48b4-8e6d-8f14f544bae1 req-b3ac3383-75af-48e8-b762-6b94458fa641 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:12.269661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-494d9055-f34e-48b4-8e6d-8f14f544bae1 req-b3ac3383-75af-48e8-b762-6b94458fa641 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.1610918 Dec 21 03:55:12.370273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59f5a186-bc54-4474-a54c-2da841bd1cee req-e0359bc4-7be0-4a77-863f-cc77b6eb1ea5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601005 Dec 21 03:55:12.461991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-494d9055-f34e-48b4-8e6d-8f14f544bae1 req-8d5a76bb-eca6-4bfc-8307-3f29a2f7db2e tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1913817 Dec 21 03:55:12.488050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.517557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e59364d3-d6aa-4eba-a742-ae8caff077d9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:12.539961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8716391c-f24c-4bf6-8bf7-052a04f480c5') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:12.540246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8716391c-f24c-4bf6-8bf7-052a04f480c5') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:12.574778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad83eeb9-b0fa-4b91-83fd-23748f1ae85f req-cae73bcd-49a9-4d37-abc6-475410eea654 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:12.576415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad83eeb9-b0fa-4b91-83fd-23748f1ae85f req-cae73bcd-49a9-4d37-abc6-475410eea654 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1275139 Dec 21 03:55:12.583590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.633757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.648275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:12.649241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.651099 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:12.653134 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:12.676852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad83eeb9-b0fa-4b91-83fd-23748f1ae85f req-b0ba1103-139f-4719-ad87-40c654e5c584 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911088 Dec 21 03:55:12.787886 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.793816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:12.810858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] 10.222.0.18 "DELETE /v2.0/networks/e59364d3-d6aa-4eba-a742-ae8caff077d9 HTTP/1.1" status: 204 len: 168 time: 0.7440751 Dec 21 03:55:12.832337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df9ccbf-969c-4eb3-acc5-635bec29d0fe admin admin] Pushing event deleted for resources: {'Network': ['ID=e59364d3-d6aa-4eba-a742-ae8caff077d9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:13.024204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01583ac2-bc8a-4ddf-b44c-8b175a2f2797 req-187f94b7-5d59-4e1c-ae24-f615a58013b4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:13.032406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01583ac2-bc8a-4ddf-b44c-8b175a2f2797 req-187f94b7-5d59-4e1c-ae24-f615a58013b4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0616522 Dec 21 03:55:13.100166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01583ac2-bc8a-4ddf-b44c-8b175a2f2797 req-2222a162-a1e2-4851-9eac-88e44622b52d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663500 Dec 21 03:55:13.256536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58652) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:13.315030 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dfa018d8-e2ee-4ea2-b8be-8a60fe385ba7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2b04be31d9cd41a68c439cf66bc7acba&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0591466 Dec 21 03:55:13.317673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58654) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:13.379680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-314e92ea-e940-4fd8-97fa-672dd40f9f87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:13.404274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-314e92ea-e940-4fd8-97fa-672dd40f9f87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:13.598779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-314e92ea-e940-4fd8-97fa-672dd40f9f87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:13.604227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-314e92ea-e940-4fd8-97fa-672dd40f9f87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:13.614464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-314e92ea-e940-4fd8-97fa-672dd40f9f87 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0d361e13-be23-4d7d-8f0e-4e3f47508683 HTTP/1.1" status: 204 len: 168 time: 0.2951071 Dec 21 03:55:13.634252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314e92ea-e940-4fd8-97fa-672dd40f9f87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d361e13-be23-4d7d-8f0e-4e3f47508683,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:13.681818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e11bbb-be7a-4265-9e2f-1cfc07cc346b req-cd1753a6-53dd-440a-8cee-a8208b233d2a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:13.689962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6e11bbb-be7a-4265-9e2f-1cfc07cc346b req-cd1753a6-53dd-440a-8cee-a8208b233d2a tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.1289866 Dec 21 03:55:13.761273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6e11bbb-be7a-4265-9e2f-1cfc07cc346b req-a9627d16-b007-4f7a-8850-804b5a82dab0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595319 Dec 21 03:55:13.837577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f941713a-87f3-48e5-a183-5b9b71d6bfe4 req-cbdffded-05b8-462b-93c0-8ac9a618e70e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:13.839565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f941713a-87f3-48e5-a183-5b9b71d6bfe4 req-cbdffded-05b8-462b-93c0-8ac9a618e70e tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.0999856 Dec 21 03:55:13.907913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f941713a-87f3-48e5-a183-5b9b71d6bfe4 req-ac9e0118-d35c-4c16-a979-1358e8498c25 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577006 Dec 21 03:55:14.005479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-745d8769-3018-4989-9c67-76a8b88ae77f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:14.007776 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-745d8769-3018-4989-9c67-76a8b88ae77f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.54 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.0651481 Dec 21 03:55:14.015435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9184ae0e-6fef-4f81-9969-a8ace0a3d700 req-0e981238-2329-4f13-83fe-32fbc475449d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:14.016785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9184ae0e-6fef-4f81-9969-a8ace0a3d700 req-0e981238-2329-4f13-83fe-32fbc475449d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0706661 Dec 21 03:55:14.092022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9184ae0e-6fef-4f81-9969-a8ace0a3d700 req-9ce9f714-8c26-43bd-a7e8-0c8372917f51 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644236 Dec 21 03:55:14.200716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Deleting port d2acf96a-cb48-4985-bab5-901e7db33ffc {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:14.200716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:14.272633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0418e2d7-70c3-456b-834c-6b0da422b70b req-44ad2004-0e44-4778-b2c2-1417fcbdcfba tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:14.281748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0418e2d7-70c3-456b-834c-6b0da422b70b req-44ad2004-0e44-4778-b2c2-1417fcbdcfba tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0980127 Dec 21 03:55:14.340889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0418e2d7-70c3-456b-834c-6b0da422b70b req-66ef82f5-214c-43ff-b732-8b1c61cd59b7 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528872 Dec 21 03:55:14.383443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] For port d2acf96a-cb48-4985-bab5-901e7db33ffc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d2acf96a-cb48-4985-bab5-901e7db33ffc,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:14.384511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:14.636002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:14.637204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:14.637711 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Floating IP aa96c0f8-c87c-4f60-bc64-30c18fc3d78a disassociated. External IP: 172.25.5.134, port: d2acf96a-cb48-4985-bab5-901e7db33ffc. Dec 21 03:55:14.645070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Calling delete_port for d2acf96a-cb48-4985-bab5-901e7db33ffc owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:14.838090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4fabbe-9781-42de-9f88-8a933591833f req-96faffa4-c4b2-4864-b2a4-fffaa32bcdb7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:14.843209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de4fabbe-9781-42de-9f88-8a933591833f req-96faffa4-c4b2-4864-b2a4-fffaa32bcdb7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.3668385 Dec 21 03:55:14.893395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58696) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:14.925139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.009751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event deleted for resources: {'Port': ['ID=d2acf96a-cb48-4985-bab5-901e7db33ffc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:15.013994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc56e47-80fe-403f-914a-84f02a39c6e0 req-9376900b-3ba7-4455-80f3-e5519a6da83c tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:15.024374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fc56e47-80fe-403f-914a-84f02a39c6e0 req-9376900b-3ba7-4455-80f3-e5519a6da83c tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 945 time: 0.1797352 Dec 21 03:55:15.118340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fc56e47-80fe-403f-914a-84f02a39c6e0 req-21280ff5-779d-4578-880b-a299ef75d000 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups?id=27f4831e-56b2-42f0-925d-a97178be0500&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0913184 Dec 21 03:55:15.154628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Deleting port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:15.155662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.223738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73e7d13d-ed3b-4cee-90bd-e77398125784 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.363616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73e7d13d-ed3b-4cee-90bd-e77398125784 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.395051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a102dfe7-bb77-4f6d-8cb5-88b026dded02 req-92272dd3-7ec4-4c89-8a3d-0234024bee55 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:15.404042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a102dfe7-bb77-4f6d-8cb5-88b026dded02 req-92272dd3-7ec4-4c89-8a3d-0234024bee55 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1921539 Dec 21 03:55:15.411611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Router 0c5e87db-9278-4f74-91b4-8f821682e923 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:55:15.439822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab25cb72-c4d8-4adb-8378-86b0bec3c813 req-8d0cfdfe-2b94-47a5-b178-b1f8e1a162f8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:15.444100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab25cb72-c4d8-4adb-8378-86b0bec3c813 req-8d0cfdfe-2b94-47a5-b178-b1f8e1a162f8 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 945 time: 0.2512829 Dec 21 03:55:15.473374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-73e7d13d-ed3b-4cee-90bd-e77398125784 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.474897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] For port 425b1a38-084b-43fc-ab16-7a0f86f2eb65, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=425b1a38-084b-43fc-ab16-7a0f86f2eb65,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:15.475287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.497687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58714) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:15.534796 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73e7d13d-ed3b-4cee-90bd-e77398125784 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=cc2ae8a16cfc444fb84de81a9f61da34&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6399095 Dec 21 03:55:15.538351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58718) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:15.538562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e7d13d-ed3b-4cee-90bd-e77398125784 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc82b360-b61b-4ae1-b39b-60d6ba34b298,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:15.566113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Calling delete_port for 425b1a38-084b-43fc-ab16-7a0f86f2eb65 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:15.622370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab25cb72-c4d8-4adb-8378-86b0bec3c813 req-7f9b40dc-90f9-4875-b806-31541e4bea2c tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1496019 Dec 21 03:55:15.696092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a102dfe7-bb77-4f6d-8cb5-88b026dded02 req-e13da754-f542-4daa-8b4c-1e44e89612f5 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2828462 Dec 21 03:55:15.741481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-708d3fa0-e878-47ba-90eb-c2c6fe53f40a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.764712 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-708d3fa0-e878-47ba-90eb-c2c6fe53f40a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.796935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Request body: {'network': {'name': 'tempest-ServerMetadataNegativeTestJSON-1039102857-network', 'tenant_id': '0fff474ed0964fc58c2e3f7dbe139d37'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:15.830637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:55:15.846055 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] Sync routers for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:55:15.863929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:15.865261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:15.902468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] No DVR routers for this DVR port d2acf96a-cb48-4985-bab5-901e7db33ffc on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:15.905696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.908615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1372f4-894e-439d-ac3f-25753a1bdb17 req-235ebb9f-17f5-4d34-aa26-0cea01c3427b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:15.909588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f17e8f3c-773c-409f-9aa8-77d849d6de1b req-808836fc-bd25-4ca3-99b0-706842b7c5b0 tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.54 "DELETE /v2.0/ports/d2acf96a-cb48-4985-bab5-901e7db33ffc HTTP/1.1" status: 204 len: 173 time: 1.8851066 Dec 21 03:55:15.910127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'name': 'network-vif-deleted', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:15.912985 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ead7e0d-0cff-4491-86ec-a5e2bdcb150e" -d '{"events": [{"server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "name": "network-vif-deleted", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:15.918353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1372f4-894e-439d-ac3f-25753a1bdb17 req-235ebb9f-17f5-4d34-aa26-0cea01c3427b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1433134 Dec 21 03:55:15.927192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-708d3fa0-e878-47ba-90eb-c2c6fe53f40a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.929806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-708d3fa0-e878-47ba-90eb-c2c6fe53f40a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.933245 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-708d3fa0-e878-47ba-90eb-c2c6fe53f40a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fc82b360-b61b-4ae1-b39b-60d6ba34b298 HTTP/1.1" status: 204 len: 168 time: 0.3873127 Dec 21 03:55:15.956198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708d3fa0-e878-47ba-90eb-c2c6fe53f40a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc82b360-b61b-4ae1-b39b-60d6ba34b298,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:15.958823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Made reservation on behalf of 0fff474ed0964fc58c2e3f7dbe139d37 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:15.961673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:15.973902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.030800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1372f4-894e-439d-ac3f-25753a1bdb17 req-1f196e98-77b4-40f4-b935-0a3f7dab679b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114361 Dec 21 03:55:16.051699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.057103 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-faf8f223-de57-47c5-ae33-756b36bdf4d0 x-openstack-request-id: req-faf8f223-de57-47c5-ae33-756b36bdf4d0 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:16.057473 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51462fb8-ab83-44bf-93e6-23a908f29176", "name": "network-vif-deleted", "tag": "d2acf96a-cb48-4985-bab5-901e7db33ffc", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:16.058236 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-faf8f223-de57-47c5-ae33-756b36bdf4d0 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:16.058653 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51462fb8-ab83-44bf-93e6-23a908f29176', 'name': 'network-vif-deleted', 'tag': 'd2acf96a-cb48-4985-bab5-901e7db33ffc', 'status': 'completed', 'code': 200} Dec 21 03:55:16.066623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:16.113235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53dfbf8e-c3b8-4a54-bb09-83dbacbfa77e None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:16.122708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event deleted for resources: {'Port': ['ID=425b1a38-084b-43fc-ab16-7a0f86f2eb65,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:16.215139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] No DVR routers for this DVR port 425b1a38-084b-43fc-ab16-7a0f86f2eb65 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:16.220615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.224378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de4fabbe-9781-42de-9f88-8a933591833f req-7c0e8f55-e12a-42d6-b458-b60592bddad9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "DELETE /v2.0/ports/425b1a38-084b-43fc-ab16-7a0f86f2eb65 HTTP/1.1" status: 204 len: 173 time: 1.3662729 Dec 21 03:55:16.227610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-deleted', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:16.227610 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df0127ef-6b1c-4acb-9fc5-0c8bd3048a9c" -d '{"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-deleted", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:16.272531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.327729 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-451179b8-e47e-4758-9304-4712934855c1 x-openstack-request-id: req-451179b8-e47e-4758-9304-4712934855c1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:16.328183 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2876a6d6-9052-40da-a242-e2969b6d5399", "name": "network-vif-deleted", "tag": "425b1a38-084b-43fc-ab16-7a0f86f2eb65", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:16.328449 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-451179b8-e47e-4758-9304-4712934855c1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:16.328853 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2876a6d6-9052-40da-a242-e2969b6d5399', 'name': 'network-vif-deleted', 'tag': '425b1a38-084b-43fc-ab16-7a0f86f2eb65', 'status': 'completed', 'code': 200} Dec 21 03:55:16.337827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb3a1ed9-ef06-41c6-884f-8dba5ecf09d6 req-404ea157-c31e-41f4-8cdc-16dba81dfacb tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/ports?device_id=51462fb8-ab83-44bf-93e6-23a908f29176 HTTP/1.1" status: 200 len: 210 time: 0.0526640 Dec 21 03:55:16.356545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.380933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:55:16.396844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a29c11a-9d73-490f-bdc1-f30b9b101f1d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:16.422373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.423566 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Added segment 4fcf4357-86b6-4de9-891d-d332b0206eb5 of type vlan for network 49509403-dd5e-4f24-9cfa-d239e84b0349 Dec 21 03:55:16.430925 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:16.463980 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] Checking router: 0c5e87db-9278-4f74-91b4-8f821682e923 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:55:16.474723 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:16.475713 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:16.507557 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.585617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:16.586782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.588128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:16.588773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.653236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] Pushing event updated for resources: {'Network': ['ID=49509403-dd5e-4f24-9cfa-d239e84b0349,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:16.668117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 49509403-dd5e-4f24-9cfa-d239e84b0349 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:55:16.720219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58740) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:16.728502 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bb611151-3c05-40c8-8ccb-ae0fdbe87b70 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 1.2079871 Dec 21 03:55:16.729342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Request body: {'subnet': {'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerMetadataNegativeTestJSON-1039102857-subnet', 'tenant_id': '0fff474ed0964fc58c2e3f7dbe139d37', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:16.833093 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:16.845255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Made reservation on behalf of 0fff474ed0964fc58c2e3f7dbe139d37 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:16.857790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.866109 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e67fc538-001e-42fb-9f23-5a01c26fcb96 None None] The sync data for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 is: [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1c2f58b3-e233-4622-80bb-42a8ad99b338', 'name': '', 'network_id': '02e2ef7c-d00c-4471-ae34-58e2e22c435a', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'mac_address': 'fa:16:3e:ea:f3:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_interface', 'standard_attr_id': 1112, 'fixed_ips': [{'subnet_id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:51Z', 'updated_at': '2021-12-21T03:52:59Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'subnets': [{'id': '394148b6-6bdf-4aaa-94d7-be0fbbf6634e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:55:16.941956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58742) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:16.961987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f80983e-4e22-4141-a491-e8b978aeeeba req-375e2de8-a885-4a52-a798-c66a52d48049 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=2876a6d6-9052-40da-a242-e2969b6d5399 HTTP/1.1" status: 200 len: 210 time: 0.0793841 Dec 21 03:55:16.987560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7ddf43f5-6d33-4835-8b82-b55a3024c772 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:16.989140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a3fcdb-1427-45cc-a465-109d63c3987a req-17331de9-0280-4a19-ac7c-0fb915207153 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:16.990921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72a3fcdb-1427-45cc-a465-109d63c3987a req-17331de9-0280-4a19-ac7c-0fb915207153 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1762502 Dec 21 03:55:17.073148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72a3fcdb-1427-45cc-a465-109d63c3987a req-45fa0633-4130-4607-ad88-1196087593f2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604622 Dec 21 03:55:17.185149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7ddf43f5-6d33-4835-8b82-b55a3024c772 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.213450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e8e5b3-4913-42c7-b0a6-5dd6028295fb req-5b6e0298-4bad-4e1c-81ae-2d1718ea8433 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:17.223748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94e8e5b3-4913-42c7-b0a6-5dd6028295fb req-5b6e0298-4bad-4e1c-81ae-2d1718ea8433 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0851076 Dec 21 03:55:17.228100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.228292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:17.270226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 425b1a38-084b-43fc-ab16-7a0f86f2eb65 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:17.270858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 425b1a38-084b-43fc-ab16-7a0f86f2eb65 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:17.271708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d2acf96a-cb48-4985-bab5-901e7db33ffc no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:17.297306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7ddf43f5-6d33-4835-8b82-b55a3024c772 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.309354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: d2acf96a-cb48-4985-bab5-901e7db33ffc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:17.309714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d2acf96a-cb48-4985-bab5-901e7db33ffc not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:17.311103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94e8e5b3-4913-42c7-b0a6-5dd6028295fb req-61a2734b-d3e1-4f65-a6e6-268b943fdd3a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757177 Dec 21 03:55:17.329259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d68539ca-fd0a-4d8b-8777-0e81a51c7af7 None None] New status for floating IP aa96c0f8-c87c-4f60-bc64-30c18fc3d78a: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:55:17.368613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ddf43f5-6d33-4835-8b82-b55a3024c772 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67af3541-14a9-4ea7-a360-4d9493d4ff4d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:17.392424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7ddf43f5-6d33-4835-8b82-b55a3024c772 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=eaa272c3e3df44ce9847609b14f30107&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4443846 Dec 21 03:55:17.392424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Checking segment: {'id': '4fcf4357-86b6-4de9-891d-d332b0206eb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:17.392424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Network hostable DHCP agents. Network: 49509403-dd5e-4f24-9cfa-d239e84b0349, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:55:17.392884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58750) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:17.402814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Pushing event updated for resources: {'Subnet': ['ID=14bb4fe8-5273-40af-b73d-89810485325d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:17.482891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4848c66-7d97-408d-aad0-62162edb9eca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.504740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4848c66-7d97-408d-aad0-62162edb9eca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.513392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Network 49509403-dd5e-4f24-9cfa-d239e84b0349 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:55:17.578707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:17.640175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-732c302e-9bd2-4bf4-8657-8ad225a1579f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.666388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-732c302e-9bd2-4bf4-8657-8ad225a1579f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.673568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 49509403-dd5e-4f24-9cfa-d239e84b0349) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:17.678835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:17.688574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4848c66-7d97-408d-aad0-62162edb9eca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.688574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4848c66-7d97-408d-aad0-62162edb9eca admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.688574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a4848c66-7d97-408d-aad0-62162edb9eca admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/67af3541-14a9-4ea7-a360-4d9493d4ff4d HTTP/1.1" status: 204 len: 168 time: 0.2923098 Dec 21 03:55:17.688881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46e10590-1c8a-44ca-88a9-daffa94194c1 None None] Network 49509403-dd5e-4f24-9cfa-d239e84b0349 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:17.691485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.735734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4848c66-7d97-408d-aad0-62162edb9eca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67af3541-14a9-4ea7-a360-4d9493d4ff4d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:17.797800 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b08bde86-a6d5-4ca0-ac9e-4d5fa0cb5a78 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 1.0755038 Dec 21 03:55:17.868771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92f59826-2a52-4f7f-a172-0e49df8c5c1a None None] Network 49509403-dd5e-4f24-9cfa-d239e84b0349 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:17.879236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-732c302e-9bd2-4bf4-8657-8ad225a1579f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.883679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-732c302e-9bd2-4bf4-8657-8ad225a1579f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:17.887977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:17.895097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-732c302e-9bd2-4bf4-8657-8ad225a1579f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "DELETE /v2.0/security-groups/27f4831e-56b2-42f0-925d-a97178be0500 HTTP/1.1" status: 204 len: 168 time: 0.3147788 Dec 21 03:55:17.909019 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-37d3c505-e1af-4f3c-b46b-0b0567e345cf tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] show failed (client error): The resource could not be found. Dec 21 03:55:17.924503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58764) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:17.925312 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-37d3c505-e1af-4f3c-b46b-0b0567e345cf tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "GET /v2.0/security-groups/27f4831e-56b2-42f0-925d-a97178be0500 HTTP/1.1" status: 404 len: 347 time: 0.0362108 Dec 21 03:55:17.929144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732c302e-9bd2-4bf4-8657-8ad225a1579f tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=27f4831e-56b2-42f0-925d-a97178be0500,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:18.270063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11eb6bb5-b3b6-41ce-9402-96c20d99379a req-d7f411cd-95d6-422d-a49b-9b17ae03bfa6 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:18.271651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11eb6bb5-b3b6-41ce-9402-96c20d99379a req-d7f411cd-95d6-422d-a49b-9b17ae03bfa6 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0701149 Dec 21 03:55:18.279463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Deleting port 3ca8affe-a1ef-42a0-b658-e51c5bac251c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:18.279808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:18.397478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11eb6bb5-b3b6-41ce-9402-96c20d99379a req-b8c6fc77-f825-458c-9373-bc505197263d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048384 Dec 21 03:55:18.408522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:18.408861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:18.427381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Calling delete_port for 3ca8affe-a1ef-42a0-b658-e51c5bac251c owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:18.634813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:18.716271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Pushing event deleted for resources: {'Port': ['ID=3ca8affe-a1ef-42a0-b658-e51c5bac251c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:18.826487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199baed1-2d9e-46be-aa90-c36d70f1c4b7 req-7a09cb96-3b34-4bc1-8278-736f096c7465 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:18.828067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-199baed1-2d9e-46be-aa90-c36d70f1c4b7 req-7a09cb96-3b34-4bc1-8278-736f096c7465 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1944256 Dec 21 03:55:18.872068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:18.874607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:18.880939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58806) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:18.881379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4d798c04-9ccc-4dda-ac81-bf61e54634db tempest-ServersTestJSON-1659054768 tempest-ServersTestJSON-1659054768-project] 10.222.0.18 "DELETE /v2.0/floatingips/aa96c0f8-c87c-4f60-bc64-30c18fc3d78a HTTP/1.1" status: 204 len: 168 time: 0.9443913 Dec 21 03:55:18.918557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-ed377379-99de-4c01-ac11-5581e60f4d6e tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:18.926335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-ed377379-99de-4c01-ac11-5581e60f4d6e tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/networks?id=49509403-dd5e-4f24-9cfa-d239e84b0349 HTTP/1.1" status: 200 len: 821 time: 0.2227664 Dec 21 03:55:18.951012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-3475e991-74a1-492b-a32b-14e3ba195d79 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/quotas/0fff474ed0964fc58c2e3f7dbe139d37 HTTP/1.1" status: 200 len: 375 time: 0.0235302 Dec 21 03:55:18.970824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-199baed1-2d9e-46be-aa90-c36d70f1c4b7 req-e23c7d82-3eaf-4d5a-bb71-93def5bdef52 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359937 Dec 21 03:55:18.997542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-96a37d6d-96f4-49ee-b378-6fc1a2c84533 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=0fff474ed0964fc58c2e3f7dbe139d37&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0453629 Dec 21 03:55:19.161752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1364fe4c-3c9a-4df4-99be-19e0503fe3d3 req-d9907457-8f80-49f5-970b-8700a8c8044d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:19.162844 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1364fe4c-3c9a-4df4-99be-19e0503fe3d3 req-d9907457-8f80-49f5-970b-8700a8c8044d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.0677040 Dec 21 03:55:19.184512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-13650eae-b60a-45fa-9906-1a55fc48e34f service neutron] 10.222.0.18 "GET /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1859357 Dec 21 03:55:19.209670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58814) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:19.269683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-c6398e19-bb97-4dd3-8ac6-050aa35333bd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:19.271393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-c6398e19-bb97-4dd3-8ac6-050aa35333bd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 945 time: 0.1058679 Dec 21 03:55:19.332782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.381465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1364fe4c-3c9a-4df4-99be-19e0503fe3d3 req-600212fd-fb39-4b82-ab3e-d47aa83b8aeb tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2057374 Dec 21 03:55:19.383982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Request body: {'network': {'name': 'tempest-ImageQuotaTest-180269650-network', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:19.453497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-d85df792-b37a-4d0c-97bd-605bd6dd7af2 service neutron] 10.222.0.18 "GET /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2679405 Dec 21 03:55:19.488197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Deleting port 291446c0-79fe-4164-ba73-8b5de753da33 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:19.488785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.510809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Made reservation on behalf of 8977cb9c4d924ba2882a00a2149d3964 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:19.519612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.548284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.663105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] For port 291446c0-79fe-4164-ba73-8b5de753da33, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=291446c0-79fe-4164-ba73-8b5de753da33,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:19.663624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.684896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Calling delete_port for 291446c0-79fe-4164-ba73-8b5de753da33 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:19.695843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2358ed-8fa0-4200-a350-d1fbfd91fc90 req-5d315f4e-d02e-4fb2-bf6b-9171fe9665de tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:19.703369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d2358ed-8fa0-4200-a350-d1fbfd91fc90 req-5d315f4e-d02e-4fb2-bf6b-9171fe9665de tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1421466 Dec 21 03:55:19.725432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.810575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.824071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:55:19.827832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d9de3d6-5db1-4611-a924-ecb40f89dc03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.836537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.837320 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Added segment 574b1773-0a62-4e1a-989e-97e164cce959 of type vlan for network ac40f33d-d55c-46f8-9194-90fce2cc9364 Dec 21 03:55:19.874257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9daf7cee-a195-4e18-85ea-bc17cb096300 req-e07b4898-43f9-49d0-b45d-bb82e8bbe7e3 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 210 time: 0.0523834 Dec 21 03:55:19.896074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d2358ed-8fa0-4200-a350-d1fbfd91fc90 req-d97384f1-3b7a-43da-be09-e3156249c240 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1911161 Dec 21 03:55:19.907413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1015250-70eb-4507-a8ba-5d57fb382fc6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:19.920253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:19.924344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Deleting port 1c2f58b3-e233-4622-80bb-42a8ad99b338 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:19.924692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.030593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] For port 1c2f58b3-e233-4622-80bb-42a8ad99b338, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1c2f58b3-e233-4622-80bb-42a8ad99b338,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:20.031050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.045309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Calling delete_port for 1c2f58b3-e233-4622-80bb-42a8ad99b338 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:20.064259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.065642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:20.066458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.186950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] Pushing event updated for resources: {'Network': ['ID=ac40f33d-d55c-46f8-9194-90fce2cc9364,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:20.201043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:55:20.292693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b4edadc-808b-44aa-abd3-4d20aa4407b2 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 877 time: 1.0791447 Dec 21 03:55:20.298298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:20.326010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Request body: {'subnet': {'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImageQuotaTest-180269650-subnet', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:20.411095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.437427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event deleted for resources: {'Port': ['ID=291446c0-79fe-4164-ba73-8b5de753da33,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:20.440166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Made reservation on behalf of 8977cb9c4d924ba2882a00a2149d3964 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:20.452990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.464326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd2c9c29-17e7-4f1f-8233-866d3e05727d None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:20.502981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] No DVR routers for this DVR port 291446c0-79fe-4164-ba73-8b5de753da33 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:20.507027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.510766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.510916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1822cd65-6931-4eab-ae23-9f2d416dc751 req-661adff0-d7f3-45a5-ae9b-309080e55e9b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "DELETE /v2.0/ports/291446c0-79fe-4164-ba73-8b5de753da33 HTTP/1.1" status: 204 len: 173 time: 1.2120223 Dec 21 03:55:20.516994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'name': 'network-vif-deleted', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:20.518280 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c28b0b6-312e-43f8-98b6-befb8e6cdb80" -d '{"events": [{"server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "name": "network-vif-deleted", "tag": "291446c0-79fe-4164-ba73-8b5de753da33"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:20.554624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Pushing event deleted for resources: {'Port': ['ID=1c2f58b3-e233-4622-80bb-42a8ad99b338,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:20.571819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22e09451-4048-4459-b7b7-9151d878c0bd req-467c612e-a5ac-459a-9425-c0f32dca2f4d tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 210 time: 0.1002879 Dec 21 03:55:20.608937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dcc7d54-b717-4e25-af28-05cb28d4dcdc req-6bac8f48-1b3c-4b7a-b29d-63f47bff580c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:20.619691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dcc7d54-b717-4e25-af28-05cb28d4dcdc req-6bac8f48-1b3c-4b7a-b29d-63f47bff580c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.5624871 Dec 21 03:55:20.648416 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-817aeea3-0a19-4b7f-a9fa-8630ffa74938 x-openstack-request-id: req-817aeea3-0a19-4b7f-a9fa-8630ffa74938 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:20.648823 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e2c2a73-ffc5-4b66-9fde-0962b09cefdd", "name": "network-vif-deleted", "tag": "291446c0-79fe-4164-ba73-8b5de753da33", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:20.649227 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-817aeea3-0a19-4b7f-a9fa-8630ffa74938 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:20.649723 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e2c2a73-ffc5-4b66-9fde-0962b09cefdd', 'name': 'network-vif-deleted', 'tag': '291446c0-79fe-4164-ba73-8b5de753da33', 'status': 'completed', 'code': 200} Dec 21 03:55:20.685085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dcc7d54-b717-4e25-af28-05cb28d4dcdc req-3d5fd5ef-08e9-49f7-9ef8-b73ece5cfe45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644970 Dec 21 03:55:20.865466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.926278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:20.995941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08a9288a-2b9a-4c6f-aa9a-a2ad9f7fc206 req-12b1734c-e4f5-4fda-bd3f-d7ebaf018da0 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 210 time: 0.0387583 Dec 21 03:55:21.031349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Pushing event updated for resources: {'Subnet': ['ID=0b333084-3479-4cd5-9f0e-31e3d2ed1547,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:21.049306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672ee9d0-841d-403f-9121-1b72b57bf8d6 req-dfc4f56a-dfdc-40fb-be24-72c9cbd5513e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:21.057104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-672ee9d0-841d-403f-9121-1b72b57bf8d6 req-dfc4f56a-dfdc-40fb-be24-72c9cbd5513e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0640049 Dec 21 03:55:21.057469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Checking segment: {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:21.057832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Network hostable DHCP agents. Network: ac40f33d-d55c-46f8-9194-90fce2cc9364, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:55:21.119987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-672ee9d0-841d-403f-9121-1b72b57bf8d6 req-fbd3e2c6-e01b-4752-b802-76f0d4dba0f8 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561299 Dec 21 03:55:21.169790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:55:21.197918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Router 0c5e87db-9278-4f74-91b4-8f821682e923 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:55:21.255874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ac40f33d-d55c-46f8-9194-90fce2cc9364) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:21.264887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:21.264887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.265114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e7dc1bb-270c-48df-8f50-5ebe001ecc47 None None] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:21.315046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:55:21.322595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58850) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:21.322727 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2d184add-79c9-4a9f-a842-5b1abaf53bdd admin admin] 10.222.0.18 "PUT /v2.0/routers/0c5e87db-9278-4f74-91b4-8f821682e923/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4426713 Dec 21 03:55:21.337329 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] Sync routers for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:55:21.347636 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:21.348244 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:21.376547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-ac40f33d-d55c-46f8-9194-90fce2cc9364', 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364', 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'fixed_ips': [{'subnet_id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:55:21.378003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.393208 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5747634c-020f-4141-a227-58367c319d6a admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 1.0912361 Dec 21 03:55:21.393529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58852) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:21.398869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Request body: {'router': {'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:21.458208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.488499 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:21.543765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Allocated IP 172.20.0.2 (ac40f33d-d55c-46f8-9194-90fce2cc9364/0b333084-3479-4cd5-9f0e-31e3d2ed1547/ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:55:21.548151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.549700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.595614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.628500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.723618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13495f43-8980-4c09-b468-fb823b61d045 req-cf28caf5-6250-418c-b6ad-0d2092e4f5fd tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=9e2c2a73-ffc5-4b66-9fde-0962b09cefdd HTTP/1.1" status: 200 len: 210 time: 0.0316744 Dec 21 03:55:21.786985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Deleting port eb85ac69-ca96-44cf-913f-9589b9c050bc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:21.788158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.796890 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91'}], 'enable_snat': True}, 'gw_port_id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:55:20Z', 'revision_number': 5, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port': {'id': 'eb85ac69-ca96-44cf-913f-9589b9c050bc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:27:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1107, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:52:45Z', 'updated_at': '2021-12-21T03:52:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:21.799067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.825343 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] Checking router: 0c5e87db-9278-4f74-91b4-8f821682e923 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:55:21.833686 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] Routers {'0c5e87db-9278-4f74-91b4-8f821682e923'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:21.834369 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:54:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0c5e87db-9278-4f74-91b4-8f821682e923'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:21.906784 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.917647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.920295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] For port eb85ac69-ca96-44cf-913f-9589b9c050bc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=eb85ac69-ca96-44cf-913f-9589b9c050bc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:21.920625 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] Set router 0c5e87db-9278-4f74-91b4-8f821682e923 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:21.920772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:21.936965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ea88b3-d487-4326-a9eb-e6b5bbdafda0 req-7c46b66f-b5a7-4e2d-8d31-0ef2ad3c9b3a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:21.938518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19ea88b3-d487-4326-a9eb-e6b5bbdafda0 req-7c46b66f-b5a7-4e2d-8d31-0ef2ad3c9b3a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0940840 Dec 21 03:55:21.944799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Calling delete_port for eb85ac69-ca96-44cf-913f-9589b9c050bc owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:21.960512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:21.966456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:21.970624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:55:21.977961 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:55:21Z', 'revision_number': 6, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:22.007172 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b8534f6-ab9c-4925-add7-dee0ccc415b4 None None] The sync data for ids ['0c5e87db-9278-4f74-91b4-8f821682e923'] in n-d-822053-11 is: [{'id': '0c5e87db-9278-4f74-91b4-8f821682e923', 'name': 'tempest-ServersTestJSON-1113571856-router', 'tenant_id': 'c6efab45cf074755a485f41e201aa464', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:52:44Z', 'updated_at': '2021-12-21T03:55:21Z', 'revision_number': 6, 'project_id': 'c6efab45cf074755a485f41e201aa464', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:55:22.019512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Pushing event updated for resources: {'Port': ['ID=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:22.048280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19ea88b3-d487-4326-a9eb-e6b5bbdafda0 req-a2cf2dc1-4bc4-4f5c-83db-1e7aab4b9c20 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986755 Dec 21 03:55:22.056476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Attempting to bind port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:55:22.056955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Attempting to bind port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:55:22.057564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Attempting to bind port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf on network ac40f33d-d55c-46f8-9194-90fce2cc9364 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:22.063657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 54, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:55:22.064036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Checking segment: {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:22.064677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.065254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Bound using segment: {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:55:22.066079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Bound port: ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:55:22.066785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.157184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e70faa2-e2c6-4805-a4ba-1a35a3937a6d req-20baeac5-5c50-4907-af5c-87de33407737 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 210 time: 0.0295219 Dec 21 03:55:22.157383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] For port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:55:22.185279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] For port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:55:22.277925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfdbfd0-c2a0-4dfb-b44b-4b655b8020d1 req-2d9b5e2f-b6f2-434f-9785-c94b278648a7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:22.279574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddfdbfd0-c2a0-4dfb-b44b-4b655b8020d1 req-2d9b5e2f-b6f2-434f-9785-c94b278648a7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0493295 Dec 21 03:55:22.279874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.303213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.309869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.331563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.334700 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e85d9015-a079-47ef-95c9-c786d2b47c13 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.373847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Pushing event deleted for resources: {'Port': ['ID=eb85ac69-ca96-44cf-913f-9589b9c050bc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:22.375370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ef8a7e-2a42-4ca2-be75-e2a5d7cf4d4c None None] Pushing event updated for resources: {'Port': ['ID=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:22.400242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddfdbfd0-c2a0-4dfb-b44b-4b655b8020d1 req-d41016c7-7d3a-4ba1-aa78-30231093c050 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132238 Dec 21 03:55:22.407577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5001d26d-3802-4be9-812d-60108f5d63a4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:22.506660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Allocated IP 172.25.5.2 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/830fef27-5f5c-4940-9df2-2ab7228c8900) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:55:22.525253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.637590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-1b404169-80a8-4122-ab98-cd5d62ef35b4 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:22.639089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-1b404169-80a8-4122-ab98-cd5d62ef35b4 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.54 "GET /v2.0/networks?id=49509403-dd5e-4f24-9cfa-d239e84b0349 HTTP/1.1" status: 200 len: 821 time: 0.2774446 Dec 21 03:55:22.645794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.647489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.656296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.657469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.693931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Request body: {'port': {'device_id': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349', 'admin_state_up': True, 'tenant_id': '0fff474ed0964fc58c2e3f7dbe139d37'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:22.725541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.761561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:22.770072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:22.781508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:55:22.785466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75dc61f9-6f49-4284-ae86-4752b3248833 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:22.791380 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.791917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0c5e87db-9278-4f74-91b4-8f821682e923 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:55:22.799920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.801443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8e2d152a-4b62-40e8-929e-3de300d7f091 admin admin] 10.222.0.18 "DELETE /v2.0/routers/0c5e87db-9278-4f74-91b4-8f821682e923 HTTP/1.1" status: 204 len: 168 time: 1.4771557 Dec 21 03:55:22.808309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58868) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:22.812904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Pushing event updated for resources: {'Port': ['ID=830fef27-5f5c-4940-9df2-2ab7228c8900,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:22.857641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1029ac09-3d4e-40b1-9879-0fe0eab3803b None None] Provisioning complete for port 830fef27-5f5c-4940-9df2-2ab7228c8900 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:22.858729 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1029ac09-3d4e-40b1-9879-0fe0eab3803b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.877233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Deleting subnet 394148b6-6bdf-4aaa-94d7-be0fbbf6634e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:22.885067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:22.969253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Made reservation on behalf of 0fff474ed0964fc58c2e3f7dbe139d37 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:22.980462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1029ac09-3d4e-40b1-9879-0fe0eab3803b None None] Port 830fef27-5f5c-4940-9df2-2ab7228c8900 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:55:22.981932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.007549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.194177 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.200281 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.229075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:23.253306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Allocated IP 172.20.0.11 (49509403-dd5e-4f24-9cfa-d239e84b0349/14bb4fe8-5273-40af-b73d-89810485325d/be859151-213e-42b8-9a33-fd8709503481) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:55:23.269180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:23.311354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 291446c0-79fe-4164-ba73-8b5de753da33 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:23.312018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 291446c0-79fe-4164-ba73-8b5de753da33 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:23.324169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.341597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:23.346599 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.367201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a966197-5f38-4bdd-9810-bc5919cd126a req-4201bc21-7794-407f-ae99-ac6a5c18a637 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:23.374505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a966197-5f38-4bdd-9810-bc5919cd126a req-4201bc21-7794-407f-ae99-ac6a5c18a637 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1699383 Dec 21 03:55:23.436437 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.475805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:23.501090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.537135 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.548404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=394148b6-6bdf-4aaa-94d7-be0fbbf6634e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:23.559745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e14e082-4286-4eb1-a4bb-651921e67bfe req-f900d3a0-6996-44be-9d9d-9f14d13f2480 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 210 time: 0.0989573 Dec 21 03:55:23.587210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a966197-5f38-4bdd-9810-bc5919cd126a req-5ea48eb1-6437-437e-aba5-6b061ef528b3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2117679 Dec 21 03:55:23.628510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.631945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69e95056-0d69-4c58-b58e-4e2a80e43ede None None] Network 02e2ef7c-d00c-4471-ae34-58e2e22c435a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:23.638062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-348c1e42-daf0-4db3-9cad-c88cbcfd3155 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/394148b6-6bdf-4aaa-94d7-be0fbbf6634e HTTP/1.1" status: 204 len: 168 time: 0.8265219 Dec 21 03:55:23.651319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58884) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:23.668410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.694870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1c2f58b3-e233-4622-80bb-42a8ad99b338 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:23.698325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.725412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1c2f58b3-e233-4622-80bb-42a8ad99b338 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:23.731210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1c2f58b3-e233-4622-80bb-42a8ad99b338 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:23.731904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device eb85ac69-ca96-44cf-913f-9589b9c050bc no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:23.791828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.813733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: eb85ac69-ca96-44cf-913f-9589b9c050bc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:23.814084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device eb85ac69-ca96-44cf-913f-9589b9c050bc not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:23.828151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:23.882175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:23.931504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Network 49509403-dd5e-4f24-9cfa-d239e84b0349 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:23.933975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Pushing event updated for resources: {'Port': ['ID=be859151-213e-42b8-9a33-fd8709503481,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:23.946913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7950ab4-820a-4786-b38a-d5dee2b6af1a req-f30f124b-8c83-4c29-a9f9-98cac20c945b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:23.955003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7950ab4-820a-4786-b38a-d5dee2b6af1a req-f30f124b-8c83-4c29-a9f9-98cac20c945b tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.2373288 Dec 21 03:55:23.959368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:23.963473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:55:24.033819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] DHCP port deletion for 02e2ef7c-d00c-4471-ae34-58e2e22c435a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:24.038262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e8aa02-a869-4e89-bbab-d4c17b40f812 req-2b4f442e-0d02-4b89-a217-e5433ee80afd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:24.039994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78e8aa02-a869-4e89-bbab-d4c17b40f812 req-2b4f442e-0d02-4b89-a217-e5433ee80afd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.2806273 Dec 21 03:55:24.043815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fc7dedf-1174-4b8e-91a1-0e1943557d5d None None] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:24.101064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:24.101786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.118447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7950ab4-820a-4786-b38a-d5dee2b6af1a req-437c7840-d206-4f84-a582-674c700a4bae tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1624625 Dec 21 03:55:24.166583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e173c43a-da05-4037-bd03-2450f8057ac2 None None] Provisioning complete for port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:24.167104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e173c43a-da05-4037-bd03-2450f8057ac2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.167770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78e8aa02-a869-4e89-bbab-d4c17b40f812 req-acf1a37f-e526-4082-851e-2d5496b897c5 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1162751 Dec 21 03:55:24.212538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-0184dd3c-f2d6-4389-a85d-4f5ac47bbc07 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5228570 Dec 21 03:55:24.234742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] Deleting port f40c716e-2578-4560-85ad-7ffd1f002677 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:24.235169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.254716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Request body: {'port': {'device_id': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:24.318681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.331953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-7c253203-9eee-4aa0-b781-b6d463e79e68 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:24.333292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-7c253203-9eee-4aa0-b781-b6d463e79e68 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 944 time: 0.0755928 Dec 21 03:55:24.377015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Deleting port f40c716e-2578-4560-85ad-7ffd1f002677 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:24.377398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.463356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Router b95319b3-5707-489d-81f2-7f067ddfa657 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:55:24.491221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] For port f40c716e-2578-4560-85ad-7ffd1f002677, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f40c716e-2578-4560-85ad-7ffd1f002677,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:24.491594 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.496697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] For port f40c716e-2578-4560-85ad-7ffd1f002677, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f40c716e-2578-4560-85ad-7ffd1f002677,segment=NetworkSegment(eb1f5276-15a6-4cd0-b282-ce3fce035c1e),segment_id=eb1f5276-15a6-4cd0-b282-ce3fce035c1e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:24.497274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.519358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] Calling delete_port for f40c716e-2578-4560-85ad-7ffd1f002677 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:24.549124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Calling delete_port for f40c716e-2578-4560-85ad-7ffd1f002677 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:24.691970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Deleting port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:24.692416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.712641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.750687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] No DVR routers for this DVR port f40c716e-2578-4560-85ad-7ffd1f002677 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:24.753181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8816ea56-35f1-4f82-960e-41042c95927e None None] Pushing event deleted for resources: {'Port': ['ID=f40c716e-2578-4560-85ad-7ffd1f002677,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:24.764120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be859151-213e-42b8-9a33-fd8709503481 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:55:24.777940 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.782474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:55:24.795450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Sync routers for ids ['b95319b3-5707-489d-81f2-7f067ddfa657'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:55:24.809597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Routers {'b95319b3-5707-489d-81f2-7f067ddfa657'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:24.810576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b95319b3-5707-489d-81f2-7f067ddfa657'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:24.819284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d556cc50-e36b-4eae-84b5-c686df3e8722 req-a6426311-d204-4f36-b012-f2f5c856d517 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:24.821942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d556cc50-e36b-4eae-84b5-c686df3e8722 req-a6426311-d204-4f36-b012-f2f5c856d517 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 932 time: 0.1326232 Dec 21 03:55:24.835836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63d357d-f8db-43b2-bc59-78aaed38aff7 req-88a55197-b0bb-490d-82e0-2b13ba5ba7fd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:24.839174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d63d357d-f8db-43b2-bc59-78aaed38aff7 req-88a55197-b0bb-490d-82e0-2b13ba5ba7fd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1506331 Dec 21 03:55:24.839174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Transition to ACTIVE for port object be859151-213e-42b8-9a33-fd8709503481 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:55:24.851849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.862086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] For port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,segment=NetworkSegment(a7e04703-d86d-45a9-b1f8-027f2f6defdb),segment_id=a7e04703-d86d-45a9-b1f8-027f2f6defdb)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:24.862330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.862432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.901411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Pushing event deleted for resources: {'Port': ['ID=f40c716e-2578-4560-85ad-7ffd1f002677,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:24.908024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d556cc50-e36b-4eae-84b5-c686df3e8722 req-d22db9ff-d4c5-4f98-bdae-9d1fd7be1566 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679834 Dec 21 03:55:24.917701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.919127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-85b59fa8-dc74-41ba-b728-ee7c585054ca admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 914 time: 3.5245898 Dec 21 03:55:24.922616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58894) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:24.927286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] No DVR routers for this DVR port f40c716e-2578-4560-85ad-7ffd1f002677 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:24.933794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-78026949-7a19-4d88-b3a7-a1dd11f13cc6 None None] Provisioning complete for port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:24.933968 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78026949-7a19-4d88-b3a7-a1dd11f13cc6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.934117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Calling delete_port for 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:24.986327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Set router b95319b3-5707-489d-81f2-7f067ddfa657 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:24.989679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:24.995465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d63d357d-f8db-43b2-bc59-78aaed38aff7 req-377b409e-13e1-40e7-841a-7590bb2df65d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1372483 Dec 21 03:55:25.046510 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.051258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.091154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['02e2ef7c-d00c-4471-ae34-58e2e22c435a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:25.105181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:25.105365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eb1f5276-15a6-4cd0-b282-ce3fce035c1e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:25.108461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Pushing event updated for resources: {'Port': ['ID=be859151-213e-42b8-9a33-fd8709503481,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:25.123922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.155479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.166003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:25.166658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:25.168251 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:25.170887 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:25.225001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:22Z', 'revision_number': 3, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:25.264941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:25.267377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Checking router: b95319b3-5707-489d-81f2-7f067ddfa657 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:55:25.267727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Updating router b95319b3-5707-489d-81f2-7f067ddfa657 port 830fef27-5f5c-4940-9df2-2ab7228c8900 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:55:25.327894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.364052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.379216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Attempting to bind port be859151-213e-42b8-9a33-fd8709503481 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:55:25.379569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Attempting to bind port be859151-213e-42b8-9a33-fd8709503481 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4fcf4357-86b6-4de9-891d-d332b0206eb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:55:25.379905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Attempting to bind port be859151-213e-42b8-9a33-fd8709503481 on network 49509403-dd5e-4f24-9cfa-d239e84b0349 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:25.385915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.399601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] 10.222.0.18 "DELETE /v2.0/networks/02e2ef7c-d00c-4471-ae34-58e2e22c435a HTTP/1.1" status: 204 len: 168 time: 1.7465599 Dec 21 03:55:25.400598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e38b7c-5966-46d1-b91d-fc8714ab5ff7 admin admin] Pushing event deleted for resources: {'Network': ['ID=02e2ef7c-d00c-4471-ae34-58e2e22c435a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:25.403449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.450018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Pushing event deleted for resources: {'Port': ['ID=9e909a4e-75c1-4fe8-8139-ff2546a86bf6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:25.458738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:25.459134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.491139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eaa1104a-5d20-44da-a16c-76c736790fe9 None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:25.515240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] No DVR routers for this DVR port 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:25.519524 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.524734 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ec5e34cd-2ca0-4ace-84c5-28ba71f47283 req-8beb8248-757c-43f2-ab35-80e2c1e5d3b7 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.54 "DELETE /v2.0/ports/9e909a4e-75c1-4fe8-8139-ff2546a86bf6 HTTP/1.1" status: 204 len: 173 time: 1.1837521 Dec 21 03:55:25.525242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'name': 'network-vif-deleted', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:25.528624 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b24b53c-3655-4637-a081-43caf49db09a" -d '{"events": [{"server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "name": "network-vif-deleted", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:25.756795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.768678 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.771347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f40c716e-2578-4560-85ad-7ffd1f002677 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:25.794219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f40c716e-2578-4560-85ad-7ffd1f002677 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:25.794592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f40c716e-2578-4560-85ad-7ffd1f002677 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:25.808173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:25.814505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Port be859151-213e-42b8-9a33-fd8709503481 on network 49509403-dd5e-4f24-9cfa-d239e84b0349 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:55:25.814505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Attempting to bind port be859151-213e-42b8-9a33-fd8709503481 on network 49509403-dd5e-4f24-9cfa-d239e84b0349 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:25.855007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d0bb28bf-b6c6-4331-8e21-d92e4a5dd23d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c6efab45cf074755a485f41e201aa464&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0456352 Dec 21 03:55:25.856827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.857479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:25.859995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:55:25.860484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Checking segment: {'id': '4fcf4357-86b6-4de9-891d-d332b0206eb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:25.860867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Bound using segment: {'id': '4fcf4357-86b6-4de9-891d-d332b0206eb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:55:25.861316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Bound port: be859151-213e-42b8-9a33-fd8709503481, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4fcf4357-86b6-4de9-891d-d332b0206eb5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:55:25.862052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.871750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e51a15f-322b-4d29-9af7-3e76672a326f req-275b2f85-5bcb-4725-b7d0-88399f3136c9 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:25.873337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e51a15f-322b-4d29-9af7-3e76672a326f req-275b2f85-5bcb-4725-b7d0-88399f3136c9 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.5916648 Dec 21 03:55:25.880938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbecd566-4598-4fc5-bf46-15d1a33a33f7 req-c47a7b6d-2ade-4e5f-9923-b787ecbee4b9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:25.882382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbecd566-4598-4fc5-bf46-15d1a33a33f7 req-c47a7b6d-2ade-4e5f-9923-b787ecbee4b9 tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/ports?device_id=b0ef0609-d589-4bf8-9e29-dda59e1cbb9d HTTP/1.1" status: 200 len: 866 time: 0.6153789 Dec 21 03:55:25.920568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c570e2-c802-4842-8a02-4ff643c64f66 None None] Pushing event updated for resources: {'Port': ['ID=830fef27-5f5c-4940-9df2-2ab7228c8900,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:25.941236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b6ea8bd-d653-458b-8220-ae3a7ce6ceed None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:25.943073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-626879bb-c785-4a22-b99d-d163eaaa516c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.950756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Attempting to bind port 830fef27-5f5c-4940-9df2-2ab7228c8900 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:55:25.952325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Attempting to bind port 830fef27-5f5c-4940-9df2-2ab7228c8900 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:55:25.952811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Attempting to bind port 830fef27-5f5c-4940-9df2-2ab7228c8900 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:25.963633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:55:25.964171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:25.964671 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.965312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:55:25.966740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Bound port: 830fef27-5f5c-4940-9df2-2ab7228c8900, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:55:25.967258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:25.990483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-626879bb-c785-4a22-b99d-d163eaaa516c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.026288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-43d375a4-5cad-4115-b716-d61c6ac151d1 None None] Provisioning complete for port 830fef27-5f5c-4940-9df2-2ab7228c8900 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:26.026675 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-43d375a4-5cad-4115-b716-d61c6ac151d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.059280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] For port 830fef27-5f5c-4940-9df2-2ab7228c8900, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:55:26.075104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e51a15f-322b-4d29-9af7-3e76672a326f req-8147760e-13bb-4b00-8856-99d07a7f1285 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1916566 Dec 21 03:55:26.086631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] For port 830fef27-5f5c-4940-9df2-2ab7228c8900, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=830fef27-5f5c-4940-9df2-2ab7228c8900,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:55:26.087772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-43d375a4-5cad-4115-b716-d61c6ac151d1 None None] Port 830fef27-5f5c-4940-9df2-2ab7228c8900 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:55:26.099613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbecd566-4598-4fc5-bf46-15d1a33a33f7 req-9b658cb0-4369-4645-bdca-ed09bbd0911f tempest-LiveMigrationTest-1257412219 tempest-LiveMigrationTest-1257412219-project] 10.222.0.18 "GET /v2.0/security-groups?id=e2c471e6-8d60-4cbd-b863-2cb8acac8120&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1970382 Dec 21 03:55:26.102823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] For port be859151-213e-42b8-9a33-fd8709503481, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:55:26.112501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] For port be859151-213e-42b8-9a33-fd8709503481, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=be859151-213e-42b8-9a33-fd8709503481,segment=NetworkSegment(4fcf4357-86b6-4de9-891d-d332b0206eb5),segment_id=4fcf4357-86b6-4de9-891d-d332b0206eb5)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:55:26.135580 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-626879bb-c785-4a22-b99d-d163eaaa516c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.140758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-626879bb-c785-4a22-b99d-d163eaaa516c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.144335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-626879bb-c785-4a22-b99d-d163eaaa516c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/76391693-2944-40fa-8b49-94638d94173f HTTP/1.1" status: 204 len: 168 time: 0.2835391 Dec 21 03:55:26.145198 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b3bdc9a-981e-4587-9f24-694dd5c9d16c x-openstack-request-id: req-0b3bdc9a-981e-4587-9f24-694dd5c9d16c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:26.145811 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0ef0609-d589-4bf8-9e29-dda59e1cbb9d", "name": "network-vif-deleted", "tag": "9e909a4e-75c1-4fe8-8139-ff2546a86bf6", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:26.145811 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0b3bdc9a-981e-4587-9f24-694dd5c9d16c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:26.146140 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0ef0609-d589-4bf8-9e29-dda59e1cbb9d', 'name': 'network-vif-deleted', 'tag': '9e909a4e-75c1-4fe8-8139-ff2546a86bf6', 'status': 'completed', 'code': 200} Dec 21 03:55:26.159074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626879bb-c785-4a22-b99d-d163eaaa516c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76391693-2944-40fa-8b49-94638d94173f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:26.187284 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.211541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.260628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb550735-080a-46ab-a5e7-31c7c961588b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:26.272432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c570e2-c802-4842-8a02-4ff643c64f66 None None] Pushing event updated for resources: {'Port': ['ID=830fef27-5f5c-4940-9df2-2ab7228c8900,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:26.278689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Routers {'b95319b3-5707-489d-81f2-7f067ddfa657'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:26.279224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b95319b3-5707-489d-81f2-7f067ddfa657'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:26.343884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:26.344579 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.345989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] 10.222.0.54 "PUT /v2.0/ports/be859151-213e-42b8-9a33-fd8709503481 HTTP/1.1" status: 200 len: 1093 time: 2.0963213 Dec 21 03:55:26.347302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'tag': 'be859151-213e-42b8-9a33-fd8709503481'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:26.349547 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0" -d '{"events": [{"name": "network-changed", "server_uuid": "9a750098-4236-4f5e-9a01-55aab2cc757d", "tag": "be859151-213e-42b8-9a33-fd8709503481"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:26.378371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.393795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7b948767-df4b-4a81-8a7b-f349babd055f None None] Provisioning complete for port 830fef27-5f5c-4940-9df2-2ab7228c8900 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:26.394168 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b948767-df4b-4a81-8a7b-f349babd055f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.395360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b738c0-7c24-4973-8c8b-73e5cd160cbf service neutron] Pushing event updated for resources: {'Port': ['ID=be859151-213e-42b8-9a33-fd8709503481,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:26.419729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e1513c-79eb-492a-9e26-99aae7c51032 req-878de6b6-d946-4370-a549-1c85919af87a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:26.421032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32e1513c-79eb-492a-9e26-99aae7c51032 req-878de6b6-d946-4370-a549-1c85919af87a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1517591 Dec 21 03:55:26.428627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80c0daf-c0e0-4a9a-8369-b76145d106f7 req-305cbbef-f892-4706-aadc-e2052af65dc3 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:26.430729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c80c0daf-c0e0-4a9a-8369-b76145d106f7 req-305cbbef-f892-4706-aadc-e2052af65dc3 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 944 time: 0.1664977 Dec 21 03:55:26.444755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] Set router b95319b3-5707-489d-81f2-7f067ddfa657 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:26.565322 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b948767-df4b-4a81-8a7b-f349babd055f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.639728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7b948767-df4b-4a81-8a7b-f349babd055f None None] For port 830fef27-5f5c-4940-9df2-2ab7228c8900, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=830fef27-5f5c-4940-9df2-2ab7228c8900,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:26.644910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32e1513c-79eb-492a-9e26-99aae7c51032 req-ddb768bc-1497-4346-9a84-9f88d2a36e5d tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2080550 Dec 21 03:55:26.667689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c80c0daf-c0e0-4a9a-8369-b76145d106f7 req-ce086f6a-f525-4924-84d2-b40bf4b908fd tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2296286 Dec 21 03:55:26.694102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-b7694657-5599-40a0-a9fe-afebcd859da5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:26.695688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-b7694657-5599-40a0-a9fe-afebcd859da5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=0fff474ed0964fc58c2e3f7dbe139d37&device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 1096 time: 0.2023304 Dec 21 03:55:26.714924 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb32ed18-21c5-4e48-828b-83fb795d2c6a x-openstack-request-id: req-bb32ed18-21c5-4e48-828b-83fb795d2c6a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:26.715450 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9a750098-4236-4f5e-9a01-55aab2cc757d", "tag": "be859151-213e-42b8-9a33-fd8709503481", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:26.717536 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bb32ed18-21c5-4e48-828b-83fb795d2c6a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:26.717536 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'tag': 'be859151-213e-42b8-9a33-fd8709503481', 'status': 'completed', 'code': 200} Dec 21 03:55:26.717722 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b948767-df4b-4a81-8a7b-f349babd055f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:26.726871 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:55:26.776403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b948767-df4b-4a81-8a7b-f349babd055f None None] Pushing event updated for resources: {'Port': ['ID=830fef27-5f5c-4940-9df2-2ab7228c8900,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:26.790342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:22Z', 'revision_number': 3, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:26.793153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-23fe23a1-4377-4f82-8e4a-7455ab61a78f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be859151-213e-42b8-9a33-fd8709503481 HTTP/1.1" status: 200 len: 217 time: 0.0507379 Dec 21 03:55:26.807321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Allocated IP 172.20.0.1 (ac40f33d-d55c-46f8-9194-90fce2cc9364/0b333084-3479-4cd5-9f0e-31e3d2ed1547/7d8e628e-903e-499f-af99-3ee4472fe44c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:55:26.818148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5042f696-b4a6-4f36-aa34-b4e61aa27025 None None] The sync data for ids ['b95319b3-5707-489d-81f2-7f067ddfa657'] in n-d-822053-11 is: [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:22Z', 'revision_number': 3, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:55:26.894916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-46721284-0205-4cc0-abdc-e34b14905421 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:26.896456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-46721284-0205-4cc0-abdc-e34b14905421 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=14bb4fe8-5273-40af-b73d-89810485325d HTTP/1.1" status: 200 len: 861 time: 0.0870700 Dec 21 03:55:26.956048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-1051bfb3-dbae-47c2-a01e-e88baedf5ef3 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=49509403-dd5e-4f24-9cfa-d239e84b0349&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331466 Dec 21 03:55:27.046569 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.133440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-10036920-49a6-4418-b607-a40d17d13dfe service neutron] 10.222.0.54 "GET /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1681211 Dec 21 03:55:27.160398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58936) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:27.260081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.276601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:27.323320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:27.323689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e909a4e-75c1-4fe8-8139-ff2546a86bf6 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:27.325041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:27.339747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91e64f7-7db4-4a20-a0d0-e8e848163e62 req-4c9d091e-1e9f-48ae-a506-a2c5668f4794 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:27.341304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e91e64f7-7db4-4a20-a0d0-e8e848163e62 req-4c9d091e-1e9f-48ae-a506-a2c5668f4794 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1635907 Dec 21 03:55:27.342261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:27.347582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4a873f4-ea13-4bc4-9e70-486234aeb5d8 req-d0f0bf85-e72b-49ac-aecf-2ff66daf7622 service neutron] 10.222.0.54 "GET /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2056968 Dec 21 03:55:27.348443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:55:27.386757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Pushing event updated for resources: {'Port': ['ID=7d8e628e-903e-499f-af99-3ee4472fe44c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:27.396367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Deleting subnet 13099c8a-54c1-41b2-a4f4-664d17e69495 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:27.401240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.447368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.456744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.519165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.597869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e91e64f7-7db4-4a20-a0d0-e8e848163e62 req-b8f03088-4e1a-4e2c-8229-812fad4c3bc0 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2427363 Dec 21 03:55:27.654319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-5cb25df9-7e17-48bc-b6b8-1af822dcbf45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:27.656189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-5cb25df9-7e17-48bc-b6b8-1af822dcbf45 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=0fff474ed0964fc58c2e3f7dbe139d37&device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 1096 time: 0.1085861 Dec 21 03:55:27.657601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ccc1da19-da71-4247-92e9-ae3049d33896 None None] Provisioning complete for port 7d8e628e-903e-499f-af99-3ee4472fe44c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:27.657981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ccc1da19-da71-4247-92e9-ae3049d33896 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.673355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.730418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:27.753397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=13099c8a-54c1-41b2-a4f4-664d17e69495,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:27.773515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.778008 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e6405546-de93-40f7-9dc9-1cbc353b7fe8 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/13099c8a-54c1-41b2-a4f4-664d17e69495 HTTP/1.1" status: 204 len: 168 time: 0.6165648 Dec 21 03:55:27.780549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d30922a7-07af-4b8a-8866-b311d398ce07 None None] Network 5fd01e07-75a4-4745-ad05-8ade1a021605 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:27.785073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58962) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:27.803871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-25c4bf7a-8087-44ca-a3d6-28fd58ee0e49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:27.805807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-25c4bf7a-8087-44ca-a3d6-28fd58ee0e49 service neutron] 10.222.0.54 "GET /v2.0/networks?id=49509403-dd5e-4f24-9cfa-d239e84b0349 HTTP/1.1" status: 200 len: 922 time: 0.1409705 Dec 21 03:55:27.858363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ccc1da19-da71-4247-92e9-ae3049d33896 None None] Port 7d8e628e-903e-499f-af99-3ee4472fe44c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:55:27.904991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-2efccc54-83d6-4016-8cfb-3eb84e663ee2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be859151-213e-42b8-9a33-fd8709503481 HTTP/1.1" status: 200 len: 217 time: 0.0823753 Dec 21 03:55:27.913191 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:27.962604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsNegativeTestJSON-1177647559-network', 'tenant_id': '69e683945f44413f943d010be27d930d'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:27.969686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9bd3f62-a443-4e47-b904-c25f46a77dd5 None None] DHCP port deletion for 5fd01e07-75a4-4745-ad05-8ade1a021605 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:28.026390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.047579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-425a226a-459c-46c6-aee1-7124a09ca579 req-24a2ffb3-40a3-4134-89a0-cf4c8900ad48 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:28.049230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-425a226a-459c-46c6-aee1-7124a09ca579 req-24a2ffb3-40a3-4134-89a0-cf4c8900ad48 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.2424860 Dec 21 03:55:28.051729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5fd01e07-75a4-4745-ad05-8ade1a021605']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:28.056113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.061702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-64e23740-9b79-43d0-afc7-7d1fd0f4f91e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:28.062882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a7e04703-d86d-45a9-b1f8-027f2f6defdb') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:28.063215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a7e04703-d86d-45a9-b1f8-027f2f6defdb') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:28.063327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-64e23740-9b79-43d0-afc7-7d1fd0f4f91e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=14bb4fe8-5273-40af-b73d-89810485325d HTTP/1.1" status: 200 len: 861 time: 0.1192276 Dec 21 03:55:28.077049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.088063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.098068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Releasing vlan 103 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:28.098722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:28.100762 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:28.107554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ab06e1-bd3f-4319-b9c3-08badbfe71fe req-3efbefc8-4a69-4096-aa20-c1044fd7005a tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:28.107554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8ab06e1-bd3f-4319-b9c3-08badbfe71fe req-3efbefc8-4a69-4096-aa20-c1044fd7005a tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 944 time: 0.2509809 Dec 21 03:55:28.128885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-70ae33f9-1a71-4375-af55-766c0d660770 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=49509403-dd5e-4f24-9cfa-d239e84b0349&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0486302 Dec 21 03:55:28.147091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Made reservation on behalf of 69e683945f44413f943d010be27d930d for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:28.149866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.164487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.239666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.260122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.262142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-425a226a-459c-46c6-aee1-7124a09ca579 req-711042be-aeb9-4cae-aacc-ae971b84e866 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2027681 Dec 21 03:55:28.265899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.272108 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] 10.222.0.18 "DELETE /v2.0/networks/5fd01e07-75a4-4745-ad05-8ade1a021605 HTTP/1.1" status: 204 len: 168 time: 0.4812386 Dec 21 03:55:28.272637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:28.294784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2bc8bfe-0437-4a12-9abe-3b8aa70bf678 admin admin] Pushing event deleted for resources: {'Network': ['ID=5fd01e07-75a4-4745-ad05-8ade1a021605,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:28.320810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8ab06e1-bd3f-4319-b9c3-08badbfe71fe req-cf8a9de4-3d2b-4166-b909-cf38c653fb19 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1956861 Dec 21 03:55:28.337332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.360665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Deleting subnet c499b151-e14a-4090-8dc0-bbb3e129fdec {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:28.364138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.381280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-f956a4da-36f0-4507-aa4c-33e3215c1bb2 service neutron] 10.222.0.54 "GET /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2300305 Dec 21 03:55:28.399974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.443949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:55:28.460398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.462987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98a9c7cb-bf58-418e-ad59-2a2818e8f27c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:28.490996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.491355 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Added segment 501a0aa0-0a17-408f-b524-edab1997e16d of type vlan for network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 Dec 21 03:55:28.494280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.514031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd1c3ef3-d1ec-4482-8c1a-a9a9edcd77d0 req-7c602572-f79f-4563-a9c1-434f0f1a81e3 service neutron] 10.222.0.54 "GET /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1235642 Dec 21 03:55:28.552081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.572240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.620853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.648115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Pushing event updated for resources: {'Port': ['ID=7d8e628e-903e-499f-af99-3ee4472fe44c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:28.648936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c499b151-e14a-4090-8dc0-bbb3e129fdec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:28.651130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.652834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.654271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:28.654861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.659391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.662377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae4b4c21-bd00-411d-a2f9-58c45577b208 None None] Network 3f120346-c5f7-4563-898a-43b3922a09f6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:28.663855 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-886046a6-b940-467d-a84c-ac9eefcf0dcb admin admin] 10.222.0.18 "DELETE /v2.0/subnets/c499b151-e14a-4090-8dc0-bbb3e129fdec HTTP/1.1" status: 204 len: 168 time: 0.3896649 Dec 21 03:55:28.668721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:28.789674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0e7d435-e2aa-48e2-9a44-87017f8b445c None None] DHCP port deletion for 3f120346-c5f7-4563-898a-43b3922a09f6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:28.813445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 895 time: 1.0768502 Dec 21 03:55:28.815838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58978) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:28.816850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0d72f6-c7b0-4898-b9b9-18f920ad531c admin admin] Pushing event updated for resources: {'Network': ['ID=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:28.828007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85bbe59e-b780-41be-8eab-305422acf37d req-e9cc8ee4-f73c-4360-b7d1-013c2da0f36b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:28.829878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:55:28.831172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.836415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85bbe59e-b780-41be-8eab-305422acf37d req-e9cc8ee4-f73c-4360-b7d1-013c2da0f36b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0929387 Dec 21 03:55:28.841366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Request body: {'subnet': {'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsNegativeTestJSON-1177647559-subnet', 'tenant_id': '69e683945f44413f943d010be27d930d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:28.858281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:28.862047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:28.944132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:28.975118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f120346-c5f7-4563-898a-43b3922a09f6']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:28.990007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5b8f9651-08e1-4f94-9bf2-9c0c825b5138') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:28.990337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5b8f9651-08e1-4f94-9bf2-9c0c825b5138') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:29.009928 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.027707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.037515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Releasing vlan 104 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:29.037515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:29.038265 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:29.053860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85bbe59e-b780-41be-8eab-305422acf37d req-b797ead9-5915-4356-a22c-e187b7e4b908 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2102575 Dec 21 03:55:29.096627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Made reservation on behalf of 69e683945f44413f943d010be27d930d for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:29.099877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.127371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e33308b2-269f-49de-b2c1-f98847489c29 req-f047b792-0ccc-4093-96e4-30e86bd4c64d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:29.128986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e33308b2-269f-49de-b2c1-f98847489c29 req-f047b792-0ccc-4093-96e4-30e86bd4c64d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.2680674 Dec 21 03:55:29.152241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95031f3-58be-4767-9bba-693461652fda req-385d6cfb-0899-4f67-9263-60ff0583c581 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:29.153756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-385d6cfb-0899-4f67-9263-60ff0583c581 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.2383008 Dec 21 03:55:29.165517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.174001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.181517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] 10.222.0.18 "DELETE /v2.0/networks/3f120346-c5f7-4563-898a-43b3922a09f6 HTTP/1.1" status: 204 len: 168 time: 0.5089223 Dec 21 03:55:29.201025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 830fef27-5f5c-4940-9df2-2ab7228c8900 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:29.206852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-457b5a14-8d5e-47de-beb9-33517d2c9706 admin admin] Pushing event deleted for resources: {'Network': ['ID=3f120346-c5f7-4563-898a-43b3922a09f6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:29.249956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dadb11dc-2ebc-4b7a-8d94-c7281b766c4e None None] Provisioning complete for port 7d8e628e-903e-499f-af99-3ee4472fe44c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:29.250415 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dadb11dc-2ebc-4b7a-8d94-c7281b766c4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.296524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Router b95319b3-5707-489d-81f2-7f067ddfa657 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:55:29.335393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e33308b2-269f-49de-b2c1-f98847489c29 req-f8d48252-6938-4d33-af32-429e43dc1693 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1926298 Dec 21 03:55:29.455794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95031f3-58be-4767-9bba-693461652fda req-5303a86a-4192-4542-9619-11ee54c514f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:29.457321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-5303a86a-4192-4542-9619-11ee54c514f3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.2898035 Dec 21 03:55:29.460405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device be859151-213e-42b8-9a33-fd8709503481 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:55:29.480252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dadb11dc-2ebc-4b7a-8d94-c7281b766c4e None None] Port 7d8e628e-903e-499f-af99-3ee4472fe44c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:55:29.507938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 830fef27-5f5c-4940-9df2-2ab7228c8900 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:29.508305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.584563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58988) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:29.609292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port be859151-213e-42b8-9a33-fd8709503481, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=be859151-213e-42b8-9a33-fd8709503481,segment=NetworkSegment(4fcf4357-86b6-4de9-891d-d332b0206eb5),segment_id=4fcf4357-86b6-4de9-891d-d332b0206eb5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:29.650180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b2c04887-7563-4564-b5fb-5d098b708023 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e49c9575c393446a904ba5840d68746b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0636621 Dec 21 03:55:29.651159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'be859151-213e-42b8-9a33-fd8709503481', 'network_id': '49509403-dd5e-4f24-9cfa-d239e84b0349', 'port_id': 'be859151-213e-42b8-9a33-fd8709503481', 'mac_address': 'fa:16:3e:99:bd:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '14bb4fe8-5273-40af-b73d-89810485325d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:55:29.652719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58990) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:29.701533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.705479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b4d362-acd7-44e2-b469-4c07a0e60e15 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.716313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be859151-213e-42b8-9a33-fd8709503481 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:55:29.729470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b4d362-acd7-44e2-b469-4c07a0e60e15 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.738016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port be859151-213e-42b8-9a33-fd8709503481, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=be859151-213e-42b8-9a33-fd8709503481,segment=NetworkSegment(4fcf4357-86b6-4de9-891d-d332b0206eb5),segment_id=4fcf4357-86b6-4de9-891d-d332b0206eb5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:29.804911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.825722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b4d362-acd7-44e2-b469-4c07a0e60e15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.828829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b4d362-acd7-44e2-b469-4c07a0e60e15 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:29.832457 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76b4d362-acd7-44e2-b469-4c07a0e60e15 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e2c471e6-8d60-4cbd-b863-2cb8acac8120 HTTP/1.1" status: 204 len: 168 time: 0.1757369 Dec 21 03:55:29.844339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b4d362-acd7-44e2-b469-4c07a0e60e15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2c471e6-8d60-4cbd-b863-2cb8acac8120,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:29.878579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-081c6ff5-6eff-4443-8f64-fbb24382a945 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0692191 Dec 21 03:55:29.881596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=be859151-213e-42b8-9a33-fd8709503481,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:29.999845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e295a216-f9e1-4f71-a7a8-844b37d851db req-4b040a28-3280-4bc3-8964-71c22836c272 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:30.001337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e295a216-f9e1-4f71-a7a8-844b37d851db req-4b040a28-3280-4bc3-8964-71c22836c272 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.5778909 Dec 21 03:55:30.033028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1ae721-4056-45fe-8eb3-f7c36a59aa2f req-f53f54bc-2120-4222-9d27-3fbacf5e5b29 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:30.034506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b1ae721-4056-45fe-8eb3-f7c36a59aa2f req-f53f54bc-2120-4222-9d27-3fbacf5e5b29 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 945 time: 0.5803094 Dec 21 03:55:30.049255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:55:30.059133 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Sync routers for ids ['b95319b3-5707-489d-81f2-7f067ddfa657'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:55:30.059834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-55aa061b-c1d2-4f9f-af7b-60293c8572e2 admin admin] 10.222.0.18 "PUT /v2.0/routers/b95319b3-5707-489d-81f2-7f067ddfa657/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1355474 Dec 21 03:55:30.067326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95031f3-58be-4767-9bba-693461652fda req-1dabc278-205f-4438-bd49-dd6b6cf0bd0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:30.069029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-1dabc278-205f-4438-bd49-dd6b6cf0bd0d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.1419065 Dec 21 03:55:30.071606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Routers {'b95319b3-5707-489d-81f2-7f067ddfa657'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:30.072215 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b95319b3-5707-489d-81f2-7f067ddfa657'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:30.084710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:30.162222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-34832436-0d6a-4898-93a1-31b28e3d4f17 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0747180 Dec 21 03:55:30.172779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['be859151-213e-42b8-9a33-fd8709503481'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:30.188392 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Set router b95319b3-5707-489d-81f2-7f067ddfa657 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:30.197801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e295a216-f9e1-4f71-a7a8-844b37d851db req-b2c22067-0dc5-4d3b-99f6-99f01067aa40 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1889474 Dec 21 03:55:30.322031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b1ae721-4056-45fe-8eb3-f7c36a59aa2f req-015255a2-dbe5-4a91-9de2-d2dc3854e6aa tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2741163 Dec 21 03:55:30.333108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=accd44c9-1ee0-4627-8939-46f36f376a1d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:30.427640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Checking segment: {'id': '501a0aa0-0a17-408f-b524-edab1997e16d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:30.428006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Network hostable DHCP agents. Network: f4e9353f-6ab3-4e5b-86cb-eb1710ed1853, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:55:30.434104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-5b1f7084-7620-41fc-ac75-e29779c6d610 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2623744 Dec 21 03:55:30.494412 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:27Z', 'revision_number': 4, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7d8e628e-903e-499f-af99-3ee4472fe44c', 'name': '', 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'mac_address': 'fa:16:3e:83:b9:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:26Z', 'updated_at': '2021-12-21T03:55:28Z', 'revision_number': 2, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'subnets': [{'id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:30.521658 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Checking router: b95319b3-5707-489d-81f2-7f067ddfa657 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:55:30.523190 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Updating router b95319b3-5707-489d-81f2-7f067ddfa657 port 7d8e628e-903e-499f-af99-3ee4472fe44c binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:55:30.547770 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:30.584951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c740dd-95de-4709-a0b3-56ef97361d8d req-9d890d5d-5265-445c-9c63-3b74bfb53553 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:30.586574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c740dd-95de-4709-a0b3-56ef97361d8d req-9d890d5d-5265-445c-9c63-3b74bfb53553 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1446521 Dec 21 03:55:30.603680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d87858-85c3-4e22-b3a7-4e8a4daf2ad6 req-21fae8ed-ed74-486f-ac02-29632e9e10b2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:30.605661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20d87858-85c3-4e22-b3a7-4e8a4daf2ad6 req-21fae8ed-ed74-486f-ac02-29632e9e10b2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1800566 Dec 21 03:55:30.662686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95031f3-58be-4767-9bba-693461652fda req-f48ad7f5-795d-4093-969e-a8e7893d75a8 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2157395 Dec 21 03:55:30.676988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:55:30.709111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59010) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:30.734717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c740dd-95de-4709-a0b3-56ef97361d8d req-bd71c031-d4f1-49f0-803b-e16071dac6f0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276817 Dec 21 03:55:30.744399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20d87858-85c3-4e22-b3a7-4e8a4daf2ad6 req-b9501e2e-665b-432f-8e43-79bb4cd83894 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1234827 Dec 21 03:55:30.779493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f4e9353f-6ab3-4e5b-86cb-eb1710ed1853) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:30.782705 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ef8c3ab5-8b1a-45b6-bfd0-9d45a544fcc2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9332531de7d447ff93976e70d1e5a307&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0720918 Dec 21 03:55:30.784942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59018) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:30.786894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:30.789706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:30.796678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65b6cbc5-12db-4e96-b118-70fd8fdf44b2 None None] Network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:30.877436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a46986ae-5bcd-45d3-8374-573829dc7844 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:30.942427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a46986ae-5bcd-45d3-8374-573829dc7844 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:30.944294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4618248d-1bcf-4d11-9658-340207a4c955 None None] Network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:30.977400 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.043261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3ababcc0-836c-4f96-8933-05e021a912a1 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 859 time: 2.2194507 Dec 21 03:55:31.113445 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.114047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a46986ae-5bcd-45d3-8374-573829dc7844 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.118813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a46986ae-5bcd-45d3-8374-573829dc7844 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.120294 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a46986ae-5bcd-45d3-8374-573829dc7844 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7880b47d-91f0-4079-9950-f0e9428f0132 HTTP/1.1" status: 204 len: 168 time: 0.3337891 Dec 21 03:55:31.133914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46986ae-5bcd-45d3-8374-573829dc7844 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7880b47d-91f0-4079-9950-f0e9428f0132,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:31.218084 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Pushing event updated for resources: {'Port': ['ID=7d8e628e-903e-499f-af99-3ee4472fe44c,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:31.254747 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.255395 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.255822 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.256220 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.256612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.257163 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.257734 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.258382 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.258895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.259458 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.260070 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.260599 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.261081 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:31.272631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Attempting to bind port 7d8e628e-903e-499f-af99-3ee4472fe44c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:55:31.274068 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Attempting to bind port 7d8e628e-903e-499f-af99-3ee4472fe44c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:55:31.274435 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Attempting to bind port 7d8e628e-903e-499f-af99-3ee4472fe44c on network ac40f33d-d55c-46f8-9194-90fce2cc9364 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:31.281724 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:55:31.282095 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Checking segment: {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:31.282490 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.282874 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Bound using segment: {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:55:31.283520 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Bound port: 7d8e628e-903e-499f-af99-3ee4472fe44c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '574b1773-0a62-4e1a-989e-97e164cce959', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:55:31.283890 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.294867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device be859151-213e-42b8-9a33-fd8709503481 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:31.371623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df78a3d2-ee17-476d-bfa5-e30f4d88e74a req-2f756e26-0d13-41ef-a9dc-5a7995dc962f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:31.379065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df78a3d2-ee17-476d-bfa5-e30f4d88e74a req-2f756e26-0d13-41ef-a9dc-5a7995dc962f tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0823221 Dec 21 03:55:31.403337 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] For port 7d8e628e-903e-499f-af99-3ee4472fe44c, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:55:31.409407 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] For port 7d8e628e-903e-499f-af99-3ee4472fe44c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d8e628e-903e-499f-af99-3ee4472fe44c,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:55:31.425592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df78a3d2-ee17-476d-bfa5-e30f4d88e74a req-96793a82-0d14-485c-95c9-782c74a6a44c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456269 Dec 21 03:55:31.439115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port be859151-213e-42b8-9a33-fd8709503481 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:55:31.451518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port be859151-213e-42b8-9a33-fd8709503481 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:31.451518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.495636 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.548531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.558618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1bd16bcb-0ab3-4924-b573-baf161c3a61e None None] Provisioning complete for port 7d8e628e-903e-499f-af99-3ee4472fe44c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:31.559011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1bd16bcb-0ab3-4924-b573-baf161c3a61e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.588847 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Routers {'b95319b3-5707-489d-81f2-7f067ddfa657'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:31.589487 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b95319b3-5707-489d-81f2-7f067ddfa657'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:31.654999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be859151-213e-42b8-9a33-fd8709503481'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:31.657564 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdf7b9bb-6a61-4d79-a8ec-ccdcd9d46168" -d '{"events": [{"server_uuid": "9a750098-4236-4f5e-9a01-55aab2cc757d", "name": "network-vif-plugged", "status": "completed", "tag": "be859151-213e-42b8-9a33-fd8709503481"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:31.677949 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ed637c-73b7-4d25-9a1a-eaece7aeb527 None None] Pushing event updated for resources: {'Port': ['ID=7d8e628e-903e-499f-af99-3ee4472fe44c,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:31.691935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port be859151-213e-42b8-9a33-fd8709503481, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=be859151-213e-42b8-9a33-fd8709503481,segment=NetworkSegment(4fcf4357-86b6-4de9-891d-d332b0206eb5),segment_id=4fcf4357-86b6-4de9-891d-d332b0206eb5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:31.718021 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] Set router b95319b3-5707-489d-81f2-7f067ddfa657 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:31.758466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9940a5f-e012-4d20-b40f-618fb5bc0fe9 req-b2a943fb-ba6c-4c0a-9c95-cffa5bc2403b tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:31.769127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9940a5f-e012-4d20-b40f-618fb5bc0fe9 req-b2a943fb-ba6c-4c0a-9c95-cffa5bc2403b tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 945 time: 0.1210184 Dec 21 03:55:31.836263 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.838692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1bd16bcb-0ab3-4924-b573-baf161c3a61e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:31.864784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9940a5f-e012-4d20-b40f-618fb5bc0fe9 req-9d5eb26b-f219-4692-9041-224756ea8154 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940170 Dec 21 03:55:31.918235 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c7395cb-2652-4755-a15e-ff3aa9db7028 x-openstack-request-id: req-4c7395cb-2652-4755-a15e-ff3aa9db7028 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:31.918950 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9a750098-4236-4f5e-9a01-55aab2cc757d", "name": "network-vif-plugged", "status": "completed", "tag": "be859151-213e-42b8-9a33-fd8709503481", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:31.919221 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4c7395cb-2652-4755-a15e-ff3aa9db7028 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:31.919621 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be859151-213e-42b8-9a33-fd8709503481', 'code': 200} Dec 21 03:55:31.943671 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:27Z', 'revision_number': 4, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7d8e628e-903e-499f-af99-3ee4472fe44c', 'name': '', 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'mac_address': 'fa:16:3e:83:b9:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:26Z', 'updated_at': '2021-12-21T03:55:31Z', 'revision_number': 4, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'subnets': [{'id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:31.955902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1bd16bcb-0ab3-4924-b573-baf161c3a61e None None] For port 7d8e628e-903e-499f-af99-3ee4472fe44c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d8e628e-903e-499f-af99-3ee4472fe44c,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:31.988009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=be859151-213e-42b8-9a33-fd8709503481,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:32.017812 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1bd16bcb-0ab3-4924-b573-baf161c3a61e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:32.074609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59058) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:32.086259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d21ae4-79f1-46dd-8e37-afeb00d4afdd req-14524426-cda3-41cd-806d-d1fb26a48ba8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:32.087962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d21ae4-79f1-46dd-8e37-afeb00d4afdd req-14524426-cda3-41cd-806d-d1fb26a48ba8 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1189373 Dec 21 03:55:32.109595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885bf68f-73dd-48e3-a384-2d85692adaff req-b48d3e9f-31b8-4c91-89c2-4d4186b7dbb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:32.116374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-885bf68f-73dd-48e3-a384-2d85692adaff req-b48d3e9f-31b8-4c91-89c2-4d4186b7dbb1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 1098 time: 0.0924530 Dec 21 03:55:32.136251 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61b9a923-08a1-476f-8c2d-68ffa73f7ecf None None] The sync data for ids ['b95319b3-5707-489d-81f2-7f067ddfa657'] in n-d-822053-11 is: [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:27Z', 'revision_number': 4, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '7d8e628e-903e-499f-af99-3ee4472fe44c', 'name': '', 'network_id': 'ac40f33d-d55c-46f8-9194-90fce2cc9364', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'mac_address': 'fa:16:3e:83:b9:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_interface', 'standard_attr_id': 1278, 'fixed_ips': [{'subnet_id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:26Z', 'updated_at': '2021-12-21T03:55:31Z', 'revision_number': 4, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'subnets': [{'id': '0b333084-3479-4cd5-9f0e-31e3d2ed1547', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:55:32.172158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bd16bcb-0ab3-4924-b573-baf161c3a61e None None] Pushing event updated for resources: {'Port': ['ID=7d8e628e-903e-499f-af99-3ee4472fe44c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:32.220041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-875a2503-735e-444b-a8c2-255e5297abd8 None None] Provisioning complete for port 7d8e628e-903e-499f-af99-3ee4472fe44c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:32.220774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-875a2503-735e-444b-a8c2-255e5297abd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:32.436540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d21ae4-79f1-46dd-8e37-afeb00d4afdd req-20993d5f-4dc4-4b99-abc0-c6bb82bb11b0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3334928 Dec 21 03:55:32.448827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-885bf68f-73dd-48e3-a384-2d85692adaff req-610a9b74-d6c2-44a1-961b-cc841309251e service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2982488 Dec 21 03:55:32.470103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5096a49-a373-4a35-98b6-94bf9cac9bf5 req-5e9957fb-8a75-45b0-b40f-504de166a916 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:32.470482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5096a49-a373-4a35-98b6-94bf9cac9bf5 req-5e9957fb-8a75-45b0-b40f-504de166a916 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 1098 time: 0.1681199 Dec 21 03:55:32.479950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-d8684d3d-6dd7-4c69-9eb3-4c95138ee6ae tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:32.481503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-d8684d3d-6dd7-4c69-9eb3-4c95138ee6ae tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/networks?id=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 HTTP/1.1" status: 200 len: 822 time: 0.3636203 Dec 21 03:55:32.518724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-0e5f7ee9-efce-4c01-b595-ce13b3f8a4cf tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/quotas/69e683945f44413f943d010be27d930d HTTP/1.1" status: 200 len: 375 time: 0.0305827 Dec 21 03:55:32.595504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-682caf72-0f8a-4c3d-b3fb-089c60f38d36 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=69e683945f44413f943d010be27d930d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0611036 Dec 21 03:55:32.627126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5096a49-a373-4a35-98b6-94bf9cac9bf5 req-edf97049-6e33-4617-97c7-b1dcddf1b0ab service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1446118 Dec 21 03:55:32.666149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:32.712619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b05019-a31d-4b6a-859d-92ac8ad16ab6 req-c4cae14f-1292-4919-a8d4-f8eba2c5bdcb tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:32.715463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71b05019-a31d-4b6a-859d-92ac8ad16ab6 req-c4cae14f-1292-4919-a8d4-f8eba2c5bdcb tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1536179 Dec 21 03:55:32.781100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-d5bfb398-e157-4701-9ca4-31195923329b service neutron] 10.222.0.18 "GET /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1498783 Dec 21 03:55:32.844494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71b05019-a31d-4b6a-859d-92ac8ad16ab6 req-3229d3b4-1d42-4343-9be8-713e26e8d940 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1239767 Dec 21 03:55:32.954689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-8ef53f8e-70b7-4cfd-8b45-9ef7ace70237 service neutron] 10.222.0.18 "GET /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1725986 Dec 21 03:55:32.972626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Deleting port 7d8e628e-903e-499f-af99-3ee4472fe44c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:32.972962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:33.009940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b3587f-bb5a-4583-a8bd-79a78fdf375b req-c5778601-7e1f-464c-aef8-15cff4a3e5c2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:33.011673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2b3587f-bb5a-4583-a8bd-79a78fdf375b req-c5778601-7e1f-464c-aef8-15cff4a3e5c2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.0921392 Dec 21 03:55:33.090870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2b3587f-bb5a-4583-a8bd-79a78fdf375b req-c50aa045-6f5e-4322-b804-f0a46ff3ad93 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717094 Dec 21 03:55:33.112069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] For port 7d8e628e-903e-499f-af99-3ee4472fe44c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d8e628e-903e-499f-af99-3ee4472fe44c,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:33.114552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:33.149696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Calling delete_port for 7d8e628e-903e-499f-af99-3ee4472fe44c owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:33.247884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d8e628e-903e-499f-af99-3ee4472fe44c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:33.354563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2bea6a1-44ee-455f-bc3a-fb4149370838 req-08decb6f-1226-4996-b854-bc17eb37e375 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:33.356811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2bea6a1-44ee-455f-bc3a-fb4149370838 req-08decb6f-1226-4996-b854-bc17eb37e375 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 946 time: 0.1392639 Dec 21 03:55:33.364018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7d8e628e-903e-499f-af99-3ee4472fe44c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:33.364517 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:33.478977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2bea6a1-44ee-455f-bc3a-fb4149370838 req-522e1117-abd9-421d-864d-e56930053c38 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114342 Dec 21 03:55:33.566841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ae199ea-c18d-4d56-919b-954207b71242 req-0aa56f6a-b08b-4bf5-b8e2-f1bf451fd7ad tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 210 time: 0.0370107 Dec 21 03:55:33.615596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:33.645094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Pushing event deleted for resources: {'Port': ['ID=7d8e628e-903e-499f-af99-3ee4472fe44c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:33.734288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8eae421-4fe5-48a8-b5b2-5d014b855a84 req-2f2c3054-9552-4291-aa33-96ce6a9312a3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:33.737175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8eae421-4fe5-48a8-b5b2-5d014b855a84 req-2f2c3054-9552-4291-aa33-96ce6a9312a3 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0845504 Dec 21 03:55:33.883677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8eae421-4fe5-48a8-b5b2-5d014b855a84 req-0d7380d6-a13e-488a-af7f-4968a1619661 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352875 Dec 21 03:55:33.955530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:34.058433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f26b7f-92c9-49b4-86c0-b08521158755 req-3d4dab30-0dfa-4ad0-90ba-2c69fa1eaecf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:34.060144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5f26b7f-92c9-49b4-86c0-b08521158755 req-3d4dab30-0dfa-4ad0-90ba-2c69fa1eaecf tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.1396089 Dec 21 03:55:34.082153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407f517b-0c60-47a4-a248-80b40fd395b4 req-78e74652-8e4b-4763-b00d-bda849dcda0d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:34.083645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-407f517b-0c60-47a4-a248-80b40fd395b4 req-78e74652-8e4b-4763-b00d-bda849dcda0d tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0875111 Dec 21 03:55:34.152298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5f26b7f-92c9-49b4-86c0-b08521158755 req-cc7e160b-9dd3-4289-833b-46dc248b5310 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835855 Dec 21 03:55:34.156144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-407f517b-0c60-47a4-a248-80b40fd395b4 req-e8600712-1765-4c3f-a81d-798e10f2e85a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636380 Dec 21 03:55:34.218364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Router b95319b3-5707-489d-81f2-7f067ddfa657 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:55:34.337432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:55:34.345056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8778b355-72a5-4e27-a253-3613d450987b admin admin] 10.222.0.18 "PUT /v2.0/routers/b95319b3-5707-489d-81f2-7f067ddfa657/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2663684 Dec 21 03:55:34.345252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59116) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:34.348439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] Sync routers for ids ['b95319b3-5707-489d-81f2-7f067ddfa657'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:55:34.362621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] Routers {'b95319b3-5707-489d-81f2-7f067ddfa657'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:34.363289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b95319b3-5707-489d-81f2-7f067ddfa657'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:34.485706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] Set router b95319b3-5707-489d-81f2-7f067ddfa657 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:34.488195 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:34.693716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:33Z', 'revision_number': 5, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:34.724688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] Checking router: b95319b3-5707-489d-81f2-7f067ddfa657 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:55:34.734017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] Routers {'b95319b3-5707-489d-81f2-7f067ddfa657'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:34.734632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b95319b3-5707-489d-81f2-7f067ddfa657'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:34.735639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:34.752871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af48fefb-e16a-49f3-b1ef-f424f38fdf30 req-7562cd1c-ecb7-4d74-8f9b-664a02ce8e17 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:34.754337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af48fefb-e16a-49f3-b1ef-f424f38fdf30 req-7562cd1c-ecb7-4d74-8f9b-664a02ce8e17 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1453168 Dec 21 03:55:34.764583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e2ecf7-8964-4552-a103-c4143e6825b8 req-97f79302-99ab-42ec-92ae-9e4b0aa4bd36 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:34.770732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75e2ecf7-8964-4552-a103-c4143e6825b8 req-97f79302-99ab-42ec-92ae-9e4b0aa4bd36 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 946 time: 0.1580682 Dec 21 03:55:34.770732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-37d66511-1f56-423c-a285-23be6a86e55d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:34.771683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-37d66511-1f56-423c-a285-23be6a86e55d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 1098 time: 0.1302323 Dec 21 03:55:34.840276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] Set router b95319b3-5707-489d-81f2-7f067ddfa657 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:34.931908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af48fefb-e16a-49f3-b1ef-f424f38fdf30 req-9433fd43-3fb1-476c-b91c-ca01e4e11da7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1642907 Dec 21 03:55:34.940750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75e2ecf7-8964-4552-a103-c4143e6825b8 req-e7d175af-1eb8-4d9b-a92c-32bdd8a223f2 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1634951 Dec 21 03:55:34.963945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-8e0dd757-75b7-4d50-9151-a4c494bbb0f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:34.965443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-8e0dd757-75b7-4d50-9151-a4c494bbb0f6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 200 len: 910 time: 0.1796319 Dec 21 03:55:34.978601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Deleting port 830fef27-5f5c-4940-9df2-2ab7228c8900 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:34.978601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:35.071901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:33Z', 'revision_number': 5, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:35.115400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-95f410ca-527e-484f-8c0f-5781698f233c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e HTTP/1.1" status: 200 len: 217 time: 0.1401577 Dec 21 03:55:35.138984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3789f767-3662-43df-bce8-6d44656edf39 None None] The sync data for ids ['b95319b3-5707-489d-81f2-7f067ddfa657'] in n-d-822053-11 is: [{'id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'name': 'tempest-ImageQuotaTest-180269650-router', 'tenant_id': '8977cb9c4d924ba2882a00a2149d3964', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2'}], 'enable_snat': True}, 'gw_port_id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:55:21Z', 'updated_at': '2021-12-21T03:55:33Z', 'revision_number': 5, 'project_id': '8977cb9c4d924ba2882a00a2149d3964', 'gw_port': {'id': '830fef27-5f5c-4940-9df2-2ab7228c8900', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:44:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b95319b3-5707-489d-81f2-7f067ddfa657', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1276, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:55:22Z', 'updated_at': '2021-12-21T03:55:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:55:35.162872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9ab7f8d-365d-416c-9ecf-078a3801b5f8 req-e6a88458-20ef-4a09-83fe-395b44dee750 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 210 time: 0.1070979 Dec 21 03:55:35.210152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] For port 830fef27-5f5c-4940-9df2-2ab7228c8900, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=830fef27-5f5c-4940-9df2-2ab7228c8900,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:35.210152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:35.243835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Calling delete_port for 830fef27-5f5c-4940-9df2-2ab7228c8900 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:35.333532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-26dabf6b-5d06-4b87-bdf9-a3f0b79c2c3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:35.334920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-26dabf6b-5d06-4b87-bdf9-a3f0b79c2c3a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 200 len: 849 time: 0.2042739 Dec 21 03:55:35.404769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-11fd92a5-d567-44e2-8892-07f83a44634e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ee3304b6-e18e-45c8-93c6-239041d697ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0607779 Dec 21 03:55:35.416716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c25de9b-6f76-49e2-99e7-dd87a8d04ed4 req-fb7b583c-794f-4b72-b720-0d7741b6a189 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:35.418088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c25de9b-6f76-49e2-99e7-dd87a8d04ed4 req-fb7b583c-794f-4b72-b720-0d7741b6a189 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1661806 Dec 21 03:55:35.498623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58391cc5-f423-4415-890e-90ccf2e4bbe4 req-eda3e234-1090-4110-8a60-a4aafcd7f7ac tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:35.500104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58391cc5-f423-4415-890e-90ccf2e4bbe4 req-eda3e234-1090-4110-8a60-a4aafcd7f7ac tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.2121420 Dec 21 03:55:36.024031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c25de9b-6f76-49e2-99e7-dd87a8d04ed4 req-99331cc4-0322-4f38-9409-272d6bf740da tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5982981 Dec 21 03:55:36.053371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-9367b9f9-1276-4445-872e-8344bfbfcd0e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:36.058193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-9367b9f9-1276-4445-872e-8344bfbfcd0e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 946 time: 0.5883341 Dec 21 03:55:36.071717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58391cc5-f423-4415-890e-90ccf2e4bbe4 req-28163ff1-7b54-4572-ab41-84591c0e1782 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5386431 Dec 21 03:55:36.090428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-8752d7ca-55c0-475d-aa45-848a45ca0300 service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6252356 Dec 21 03:55:36.251084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.322317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Pushing event deleted for resources: {'Port': ['ID=830fef27-5f5c-4940-9df2-2ab7228c8900,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:36.334164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8162af51-9951-4285-a06e-cd26f7ff5f15 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:36.336536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-dc068662-e47e-428a-9784-7b55d62827b2 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:36.338146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-dc068662-e47e-428a-9784-7b55d62827b2 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.54 "GET /v2.0/networks?id=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 HTTP/1.1" status: 200 len: 822 time: 0.3761199 Dec 21 03:55:36.378845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Request body: {'port': {'device_id': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853', 'admin_state_up': True, 'tenant_id': '69e683945f44413f943d010be27d930d'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:36.436722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a442c42-6a9d-47c5-8e51-a93cdaada82d req-468c575d-5cf3-45a0-a2c6-da5c015affc4 service neutron] 10.222.0.31 "GET /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3147676 Dec 21 03:55:36.495070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440a7ebb-1f00-4ef8-bfeb-c778d7cb3f15 req-5100486e-703f-432c-9d68-06b26bce872b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:36.496630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-440a7ebb-1f00-4ef8-bfeb-c778d7cb3f15 req-5100486e-703f-432c-9d68-06b26bce872b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.2513933 Dec 21 03:55:36.501582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Deleting port 081f3a22-0532-4780-80e3-e4a902de7cc7 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:36.502252 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.528600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.678537 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.684944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.769491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-440a7ebb-1f00-4ef8-bfeb-c778d7cb3f15 req-7a406a04-83e9-471f-b87e-896b025cd9b2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2634323 Dec 21 03:55:36.786403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] For port 081f3a22-0532-4780-80e3-e4a902de7cc7, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=081f3a22-0532-4780-80e3-e4a902de7cc7,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:36.786781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.815916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Calling delete_port for 081f3a22-0532-4780-80e3-e4a902de7cc7 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:36.865046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.865571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b95319b3-5707-489d-81f2-7f067ddfa657 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:55:36.878362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.879536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ce3d7159-2d41-45ad-ba33-c035621ff896 admin admin] 10.222.0.18 "DELETE /v2.0/routers/b95319b3-5707-489d-81f2-7f067ddfa657 HTTP/1.1" status: 204 len: 168 time: 2.5332994 Dec 21 03:55:36.884079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59156) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:36.897383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55db8b1d-d109-402d-854b-53020eb0ae90 req-6f0dda9f-9dda-40b0-a590-42b6c24000b5 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 210 time: 0.0353637 Dec 21 03:55:36.917673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Made reservation on behalf of 69e683945f44413f943d010be27d930d for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:36.917673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:36.965247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Deleting subnet 0b333084-3479-4cd5-9f0e-31e3d2ed1547 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:36.971962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.013364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.157741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.204100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Allocated IP 172.20.0.7 (f4e9353f-6ab3-4e5b-86cb-eb1710ed1853/accd44c9-1ee0-4627-8939-46f36f376a1d/9e62595e-7d69-43e9-8aed-15460480c2fc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:55:37.213449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.258962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event deleted for resources: {'Port': ['ID=081f3a22-0532-4780-80e3-e4a902de7cc7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:37.284867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7705d7df-6629-434a-a91a-650b1e6bdef5 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:37.290191 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.310378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c773d5b-19f4-4793-93aa-b8ce432e90ed req-65a962ec-858c-4bab-b5c8-1921a0c16e91 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:37.311930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c773d5b-19f4-4793-93aa-b8ce432e90ed req-65a962ec-858c-4bab-b5c8-1921a0c16e91 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1398654 Dec 21 03:55:37.317176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-639bcfcc-3e97-427c-bd35-aa9d73b5c5e9 req-1b699bda-da4d-491a-b6c5-387127cc7a60 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 210 time: 0.0643766 Dec 21 03:55:37.317801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0b333084-3479-4cd5-9f0e-31e3d2ed1547,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:37.322250 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.326326 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c16b73d-527f-4abb-ae7a-f957ea2b4f74 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/0b333084-3479-4cd5-9f0e-31e3d2ed1547 HTTP/1.1" status: 204 len: 168 time: 0.4405036 Dec 21 03:55:37.328528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59174) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:37.336585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31714080-9561-4341-8317-30a5ed183e5e None None] Network ac40f33d-d55c-46f8-9194-90fce2cc9364 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:37.392326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] No DVR routers for this DVR port 081f3a22-0532-4780-80e3-e4a902de7cc7 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:37.396995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.401937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b852f44-fd05-41be-a95a-c3a0fc7f7a8e req-62504580-c675-4d95-95c6-fdc99ebb7159 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "DELETE /v2.0/ports/081f3a22-0532-4780-80e3-e4a902de7cc7 HTTP/1.1" status: 204 len: 173 time: 1.3262148 Dec 21 03:55:37.405898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'name': 'network-vif-deleted', 'tag': '081f3a22-0532-4780-80e3-e4a902de7cc7'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:37.408209 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4335636-8649-4548-b196-391d379c2665" -d '{"events": [{"server_uuid": "d542aa73-2be9-4304-a336-dd58f34594b6", "name": "network-vif-deleted", "tag": "081f3a22-0532-4780-80e3-e4a902de7cc7"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:37.437825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.539728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Deleting port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:37.540098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.544803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d8e628e-903e-499f-af99-3ee4472fe44c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:37.571707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c773d5b-19f4-4793-93aa-b8ce432e90ed req-72c3dfae-6736-4eb5-b2cf-89113e0ff628 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2241089 Dec 21 03:55:37.572769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] DHCP port deletion for ac40f33d-d55c-46f8-9194-90fce2cc9364 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:37.578421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7d8e628e-903e-499f-af99-3ee4472fe44c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:37.579031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d8e628e-903e-499f-af99-3ee4472fe44c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:37.641824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] For port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:37.641824 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.647354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] Deleting port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:37.648538 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.655741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Calling delete_port for ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:37.659459 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-142da332-97ff-40ae-9f4f-97d8997ee6a2 x-openstack-request-id: req-142da332-97ff-40ae-9f4f-97d8997ee6a2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:37.660227 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d542aa73-2be9-4304-a336-dd58f34594b6", "name": "network-vif-deleted", "tag": "081f3a22-0532-4780-80e3-e4a902de7cc7", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:37.660557 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-142da332-97ff-40ae-9f4f-97d8997ee6a2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:37.661108 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd542aa73-2be9-4304-a336-dd58f34594b6', 'name': 'network-vif-deleted', 'tag': '081f3a22-0532-4780-80e3-e4a902de7cc7', 'status': 'completed', 'code': 200} Dec 21 03:55:37.665861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.725569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] For port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,segment=NetworkSegment(574b1773-0a62-4e1a-989e-97e164cce959),segment_id=574b1773-0a62-4e1a-989e-97e164cce959)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:37.726491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.741518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] Calling delete_port for ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:37.788394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.836057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:37.839240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:37.841920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:55:37.881493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Pushing event updated for resources: {'Port': ['ID=9e62595e-7d69-43e9-8aed-15460480c2fc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:37.898469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.914987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:37.919687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:37.938330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Pushing event deleted for resources: {'Port': ['ID=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:37.941970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] No DVR routers for this DVR port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:37.981537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.012400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] Pushing event deleted for resources: {'Port': ['ID=ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:38.017406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53bb2e67-6bfe-4467-8b7e-578228e7e2a9 None None] No DVR routers for this DVR port ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:38.021687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.043601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-e8478e7f-c9bb-4f4f-ae93-d07a4065948a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6718185 Dec 21 03:55:38.046645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac40f33d-d55c-46f8-9194-90fce2cc9364']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:38.057024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '574b1773-0a62-4e1a-989e-97e164cce959') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:38.057666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '574b1773-0a62-4e1a-989e-97e164cce959') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:38.065181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Request body: {'port': {'device_id': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:38.067429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.081133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.087832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:38.088217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:38.089908 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:38.125118 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.210976 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.216899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.222403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] 10.222.0.18 "DELETE /v2.0/networks/ac40f33d-d55c-46f8-9194-90fce2cc9364 HTTP/1.1" status: 204 len: 168 time: 0.8887177 Dec 21 03:55:38.242785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b126b0-2a61-4ce0-8899-c0e52223d80e admin admin] Pushing event deleted for resources: {'Network': ['ID=ac40f33d-d55c-46f8-9194-90fce2cc9364,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:38.316658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c1b82d6-3cbf-47e6-813d-10e8e89ccc4d req-3dfab1a4-cdc3-4c83-8ffc-58b8e02338ac tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:38.318172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c1b82d6-3cbf-47e6-813d-10e8e89ccc4d req-3dfab1a4-cdc3-4c83-8ffc-58b8e02338ac tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0870771 Dec 21 03:55:38.427764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c1b82d6-3cbf-47e6-813d-10e8e89ccc4d req-d24ea3bb-98ea-4256-92a8-ce9099fdbc9b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799780 Dec 21 03:55:38.497253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e62595e-7d69-43e9-8aed-15460480c2fc {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:55:38.506091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.536330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Transition to ACTIVE for port object 9e62595e-7d69-43e9-8aed-15460480c2fc will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:55:38.552623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5645174-846e-4b1b-b424-04e926e7afcd req-53d731d4-4e07-4492-b999-7e52681a95ef tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:38.556542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5645174-846e-4b1b-b424-04e926e7afcd req-53d731d4-4e07-4492-b999-7e52681a95ef tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 931 time: 0.0686038 Dec 21 03:55:38.607898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5645174-846e-4b1b-b424-04e926e7afcd req-b3365a00-ae0c-41c7-9a4c-183ad0ce8597 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476718 Dec 21 03:55:38.654794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.686526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59198) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:38.763139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6197f4e7-42ea-466e-9c6c-12358cfce2f7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8977cb9c4d924ba2882a00a2149d3964&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0750096 Dec 21 03:55:38.764010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59202) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:38.774791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Pushing event updated for resources: {'Port': ['ID=9e62595e-7d69-43e9-8aed-15460480c2fc,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:38.844174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59a1169d-4c34-415f-bb4f-e821c6570270 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.848021 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:38.850609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4548756d-55d6-4cad-a527-c69a3d641d4f req-ce6de911-1e2c-4363-b5b3-1881ae853db6 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:38.857772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4548756d-55d6-4cad-a527-c69a3d641d4f req-ce6de911-1e2c-4363-b5b3-1881ae853db6 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 946 time: 0.1702616 Dec 21 03:55:38.874131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59a1169d-4c34-415f-bb4f-e821c6570270 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.907298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-845cd6ed-fd71-4a65-be61-ade7bad9bcc1 req-604e9de6-55c2-406f-9fa4-92e49d935053 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=d542aa73-2be9-4304-a336-dd58f34594b6 HTTP/1.1" status: 200 len: 210 time: 0.0684538 Dec 21 03:55:38.936264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Attempting to bind port 9e62595e-7d69-43e9-8aed-15460480c2fc on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:55:38.936734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Attempting to bind port 9e62595e-7d69-43e9-8aed-15460480c2fc by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '501a0aa0-0a17-408f-b524-edab1997e16d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:55:38.937306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Attempting to bind port 9e62595e-7d69-43e9-8aed-15460480c2fc on network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:38.949296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-f524fc6f-5755-422a-bb46-95f84f5c6e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:38.950129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-f524fc6f-5755-422a-bb46-95f84f5c6e11 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.1510859 Dec 21 03:55:38.953840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Port 9e62595e-7d69-43e9-8aed-15460480c2fc on network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:55:38.954181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Attempting to bind port 9e62595e-7d69-43e9-8aed-15460480c2fc on network f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:38.966795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:55:38.967246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Checking segment: {'id': '501a0aa0-0a17-408f-b524-edab1997e16d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:38.967637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Bound using segment: {'id': '501a0aa0-0a17-408f-b524-edab1997e16d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:55:38.968195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Bound port: 9e62595e-7d69-43e9-8aed-15460480c2fc, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '501a0aa0-0a17-408f-b524-edab1997e16d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:55:38.968428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:38.973401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4548756d-55d6-4cad-a527-c69a3d641d4f req-94341e1a-c40a-4be0-b597-1fb00ee2d394 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148193 Dec 21 03:55:38.995715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 081f3a22-0532-4780-80e3-e4a902de7cc7 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:39.005185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59a1169d-4c34-415f-bb4f-e821c6570270 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.008175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59a1169d-4c34-415f-bb4f-e821c6570270 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.012629 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-59a1169d-4c34-415f-bb4f-e821c6570270 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f1015250-70eb-4507-a8ba-5d57fb382fc6 HTTP/1.1" status: 204 len: 168 time: 0.2474265 Dec 21 03:55:39.023494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a1169d-4c34-415f-bb4f-e821c6570270 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1015250-70eb-4507-a8ba-5d57fb382fc6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:39.091835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 081f3a22-0532-4780-80e3-e4a902de7cc7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:39.093434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 081f3a22-0532-4780-80e3-e4a902de7cc7 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:39.147375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] For port 9e62595e-7d69-43e9-8aed-15460480c2fc, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:55:39.176115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-f6b8e557-c966-42fa-8cf8-e312681d2ba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:39.177631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-f6b8e557-c966-42fa-8cf8-e312681d2ba0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.2024360 Dec 21 03:55:39.183619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] For port 9e62595e-7d69-43e9-8aed-15460480c2fc, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e62595e-7d69-43e9-8aed-15460480c2fc,segment=NetworkSegment(501a0aa0-0a17-408f-b524-edab1997e16d),segment_id=501a0aa0-0a17-408f-b524-edab1997e16d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:55:39.192295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:39.213555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:39.213981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ddbc2b79-e05e-4cc1-a3ea-1ce33d37b3bf not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:39.214348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 830fef27-5f5c-4940-9df2-2ab7228c8900 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:39.230500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-72de857b-62cd-4fda-8429-61faf733f6b2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0449269 Dec 21 03:55:39.235034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 830fef27-5f5c-4940-9df2-2ab7228c8900 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:39.235595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 830fef27-5f5c-4940-9df2-2ab7228c8900 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:39.242559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4cdf4a-27a4-45b0-a8b7-0a2e8ca56d54 req-cadc1aab-5219-448d-abe7-45433c0aea7c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:39.244141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f4cdf4a-27a4-45b0-a8b7-0a2e8ca56d54 req-cadc1aab-5219-448d-abe7-45433c0aea7c tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1166718 Dec 21 03:55:39.309873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.331192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-bb52ff11-f5a0-4ae4-9f01-e3f797ccbc56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:39.332691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-bb52ff11-f5a0-4ae4-9f01-e3f797ccbc56 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.0876658 Dec 21 03:55:39.334733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:39.370869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f4cdf4a-27a4-45b0-a8b7-0a2e8ca56d54 req-8ddb5299-8d5e-46f0-b2de-905838472ec0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1180637 Dec 21 03:55:39.376834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:39.377466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.378879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-08792620-d406-40ac-b03c-8000634e3663 service neutron] 10.222.0.54 "PUT /v2.0/ports/9e62595e-7d69-43e9-8aed-15460480c2fc HTTP/1.1" status: 200 len: 1092 time: 1.3204567 Dec 21 03:55:39.402712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-578588e7-8ae5-4abb-a748-e85cd72838fa service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0515394 Dec 21 03:55:39.449608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08792620-d406-40ac-b03c-8000634e3663 service neutron] Pushing event updated for resources: {'Port': ['ID=9e62595e-7d69-43e9-8aed-15460480c2fc,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:39.518506 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f44ecd8-a742-4bc7-9118-1a7d9f366828 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.551951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-c5de26cf-f253-4443-b7ca-1d1449b0b704 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1406898 Dec 21 03:55:39.600743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f44ecd8-a742-4bc7-9118-1a7d9f366828 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.626527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c59f13-eba4-4339-b8d2-46ee9ed55f9d req-bc0b76b8-f462-4c4f-8029-99bee2e89f99 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:39.628100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44c59f13-eba4-4339-b8d2-46ee9ed55f9d req-bc0b76b8-f462-4c4f-8029-99bee2e89f99 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1189139 Dec 21 03:55:39.669891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'tag': '9e62595e-7d69-43e9-8aed-15460480c2fc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:39.672397 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed46ff88-6fa5-4263-99d7-f70684f06f0b" -d '{"events": [{"name": "network-changed", "server_uuid": "fa853ba3-e1a7-4a23-a7d9-b062129fdb3f", "tag": "9e62595e-7d69-43e9-8aed-15460480c2fc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:39.770463 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f44ecd8-a742-4bc7-9118-1a7d9f366828 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.838695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f44ecd8-a742-4bc7-9118-1a7d9f366828 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2b4fdad-a08f-4972-9013-48237f2a7bb9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:39.845797 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f44ecd8-a742-4bc7-9118-1a7d9f366828 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=081d4d0571334fa4b01c8ad1e2ad583a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5069766 Dec 21 03:55:39.847042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59220) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:39.885438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-a02d5650-8f48-4a7e-9359-7c8c84be6432 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:39.887037 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-a02d5650-8f48-4a7e-9359-7c8c84be6432 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.54 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 946 time: 0.1115265 Dec 21 03:55:39.906754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:39.952213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-250ee752-d299-448d-b6b0-9cd2ca0495ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:39.977741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d0a2813-b4ba-4fc1-b5de-aea1722c50c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.037289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d0a2813-b4ba-4fc1-b5de-aea1722c50c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.128819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-05a54090-6801-4ce5-895c-b4e446aeccd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:40.130350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-05a54090-6801-4ce5-895c-b4e446aeccd3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=69e683945f44413f943d010be27d930d&device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 1095 time: 0.5253541 Dec 21 03:55:40.137603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863fd5c7-bb95-4fb4-99cf-b5bf534be409 req-669143b2-7b62-4376-b97f-919dd7a64a24 service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5778141 Dec 21 03:55:40.143604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44c59f13-eba4-4339-b8d2-46ee9ed55f9d req-1b04da34-1603-4ee4-9a7a-66245a6f5957 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4991825 Dec 21 03:55:40.193743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243e7559-a138-4911-86bd-92170fda07a6 req-dd67db43-a83b-4025-85a9-cc53326ea37d tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:40.195377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-243e7559-a138-4911-86bd-92170fda07a6 req-dd67db43-a83b-4025-85a9-cc53326ea37d tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 943 time: 0.5112658 Dec 21 03:55:40.197224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-fec25520-4b5f-4c45-83e4-47a9579b6baf service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9e62595e-7d69-43e9-8aed-15460480c2fc HTTP/1.1" status: 200 len: 217 time: 0.0506568 Dec 21 03:55:40.252289 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ffa944c-3f14-4dcf-9c66-b7d032142c07 x-openstack-request-id: req-2ffa944c-3f14-4dcf-9c66-b7d032142c07 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:40.252583 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fa853ba3-e1a7-4a23-a7d9-b062129fdb3f", "tag": "9e62595e-7d69-43e9-8aed-15460480c2fc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:40.253007 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2ffa944c-3f14-4dcf-9c66-b7d032142c07 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:40.253400 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'tag': '9e62595e-7d69-43e9-8aed-15460480c2fc', 'status': 'completed', 'code': 200} Dec 21 03:55:40.292346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-2d0ce2b9-f5e6-4093-bf30-df04aefc8133 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:40.292346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-2d0ce2b9-f5e6-4093-bf30-df04aefc8133 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=accd44c9-1ee0-4627-8939-46f36f376a1d HTTP/1.1" status: 200 len: 862 time: 0.0868552 Dec 21 03:55:40.331296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-243e7559-a138-4911-86bd-92170fda07a6 req-563d2803-1764-4b6a-9c0f-5297597764ec tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1118116 Dec 21 03:55:40.358505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-78f1b4ce-238d-4ec3-82a3-5b9a332a1a78 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0585127 Dec 21 03:55:40.505773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-2a8ee8ed-14b0-40e0-b5eb-df3a29f1db66 service neutron] 10.222.0.54 "GET /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1369414 Dec 21 03:55:40.515403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d2c3a6-98c6-4120-8763-6fa09185f953 req-bc5b3f00-801c-4e65-be69-205bb63cc8e7 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:40.516864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86d2c3a6-98c6-4120-8763-6fa09185f953 req-bc5b3f00-801c-4e65-be69-205bb63cc8e7 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 946 time: 0.1238196 Dec 21 03:55:40.517166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Deleting port be859151-213e-42b8-9a33-fd8709503481 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:40.517753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.600998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-250ee752-d299-448d-b6b0-9cd2ca0495ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.621177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86d2c3a6-98c6-4120-8763-6fa09185f953 req-65ff2413-601d-48be-9331-33e815c29a8d tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/security-groups?id=5a29c11a-9d73-490f-bdc1-f30b9b101f1d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942917 Dec 21 03:55:40.642855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d55483ef-9440-4ca4-830c-5f9c56b4bdd9 req-be835143-9d0d-4b85-8f4a-224013d727b1 service neutron] 10.222.0.54 "GET /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245985 Dec 21 03:55:40.653158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d0a2813-b4ba-4fc1-b5de-aea1722c50c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.661919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d0a2813-b4ba-4fc1-b5de-aea1722c50c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.661919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5d0a2813-b4ba-4fc1-b5de-aea1722c50c0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d2b4fdad-a08f-4972-9013-48237f2a7bb9 HTTP/1.1" status: 204 len: 168 time: 0.8091521 Dec 21 03:55:40.661919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] For port be859151-213e-42b8-9a33-fd8709503481, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=be859151-213e-42b8-9a33-fd8709503481,segment=NetworkSegment(4fcf4357-86b6-4de9-891d-d332b0206eb5),segment_id=4fcf4357-86b6-4de9-891d-d332b0206eb5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:40.661919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.691340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Calling delete_port for be859151-213e-42b8-9a33-fd8709503481 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:40.696545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0a2813-b4ba-4fc1-b5de-aea1722c50c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2b4fdad-a08f-4972-9013-48237f2a7bb9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:40.726033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-250ee752-d299-448d-b6b0-9cd2ca0495ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:40.749505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea9c797-82d4-40df-ac71-cc98cc53b86a req-5d9ae15e-a5c1-4d43-aa5d-6eb28c2d7f81 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:40.751263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea9c797-82d4-40df-ac71-cc98cc53b86a req-5d9ae15e-a5c1-4d43-aa5d-6eb28c2d7f81 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0589166 Dec 21 03:55:40.815121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cea9c797-82d4-40df-ac71-cc98cc53b86a req-36d62381-3ba6-4fdb-bc91-19d0e2af1ef5 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563533 Dec 21 03:55:40.843178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59240) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:40.845283 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-250ee752-d299-448d-b6b0-9cd2ca0495ae admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=None&name=default HTTP/1.1" status: 200 len: 2720 time: 0.9361749 Dec 21 03:55:40.846368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250ee752-d299-448d-b6b0-9cd2ca0495ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bce6c223-24ac-4853-9bff-6aaa822a9983,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:40.926273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-2e53e68c-3ab8-4836-9882-8d9724ed60ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:40.926273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-2e53e68c-3ab8-4836-9882-8d9724ed60ac service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=69e683945f44413f943d010be27d930d&device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 1095 time: 0.0946212 Dec 21 03:55:41.033547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.066341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Pushing event deleted for resources: {'Port': ['ID=be859151-213e-42b8-9a33-fd8709503481,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:41.067955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['be859151-213e-42b8-9a33-fd8709503481'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:41.101492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff6c7b0-f795-4976-8f86-0d441a08ce05 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.125709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] No DVR routers for this DVR port be859151-213e-42b8-9a33-fd8709503481 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:41.128369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.131949 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d1652e87-0475-4ee9-8d24-0f054ae953ed req-9b6bd04f-bd8b-408d-b011-817b18258232 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.54 "DELETE /v2.0/ports/be859151-213e-42b8-9a33-fd8709503481 HTTP/1.1" status: 204 len: 173 time: 1.2351432 Dec 21 03:55:41.133435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'name': 'network-vif-deleted', 'tag': 'be859151-213e-42b8-9a33-fd8709503481'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:41.135392 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc331d94-0337-4c9a-92ed-b1551ff4146b" -d '{"events": [{"server_uuid": "9a750098-4236-4f5e-9a01-55aab2cc757d", "name": "network-vif-deleted", "tag": "be859151-213e-42b8-9a33-fd8709503481"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:41.153423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1cbf946-6806-4507-b7d3-b1302cecae0e req-eb008608-4187-4a86-9b4b-1cf175509d99 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:41.154921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1cbf946-6806-4507-b7d3-b1302cecae0e req-eb008608-4187-4a86-9b4b-1cf175509d99 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.2159243 Dec 21 03:55:41.192825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff6c7b0-f795-4976-8f86-0d441a08ce05 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.206651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-5e54ea6c-9d8c-4a01-8b1b-2bee8d9c2a9e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:41.208204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-5e54ea6c-9d8c-4a01-8b1b-2bee8d9c2a9e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.2826452 Dec 21 03:55:41.216276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-d2515563-02b5-4979-a136-03b0328a83aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:41.219293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-d2515563-02b5-4979-a136-03b0328a83aa service neutron] 10.222.0.54 "GET /v2.0/networks?id=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 HTTP/1.1" status: 200 len: 923 time: 0.2776818 Dec 21 03:55:41.293426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-4d4c26dd-28b1-4dcf-b616-e152c760267b tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/quotas/cb6e434168cc48daa3e991310cb6da73 HTTP/1.1" status: 200 len: 375 time: 0.0747664 Dec 21 03:55:41.308084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-9fd99a4d-941b-4f44-94ea-ff33185f94de service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9e62595e-7d69-43e9-8aed-15460480c2fc HTTP/1.1" status: 200 len: 217 time: 0.0747960 Dec 21 03:55:41.347333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1cbf946-6806-4507-b7d3-b1302cecae0e req-dd66452e-04e6-46ab-ad90-c8c8350e0cf2 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1753304 Dec 21 03:55:41.368171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-4118accc-ce9c-4ada-90f6-137ccced1127 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0662038 Dec 21 03:55:41.396450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-3d3b1b65-7de5-4bf9-a5ac-38173847362b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:41.398002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-3d3b1b65-7de5-4bf9-a5ac-38173847362b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=accd44c9-1ee0-4627-8939-46f36f376a1d HTTP/1.1" status: 200 len: 862 time: 0.0775383 Dec 21 03:55:41.406738 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40448104-946e-4e8b-835e-0181819abd2b x-openstack-request-id: req-40448104-946e-4e8b-835e-0181819abd2b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:41.407101 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9a750098-4236-4f5e-9a01-55aab2cc757d", "name": "network-vif-deleted", "tag": "be859151-213e-42b8-9a33-fd8709503481", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:41.407798 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-40448104-946e-4e8b-835e-0181819abd2b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:41.408533 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9a750098-4236-4f5e-9a01-55aab2cc757d', 'name': 'network-vif-deleted', 'tag': 'be859151-213e-42b8-9a33-fd8709503481', 'status': 'completed', 'code': 200} Dec 21 03:55:41.475776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-0adf5915-635e-4a53-a1ae-3bb75c5d07d7 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0580063 Dec 21 03:55:41.479204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff6c7b0-f795-4976-8f86-0d441a08ce05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.481707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ff6c7b0-f795-4976-8f86-0d441a08ce05 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.482736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5ff6c7b0-f795-4976-8f86-0d441a08ce05 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bce6c223-24ac-4853-9bff-6aaa822a9983 HTTP/1.1" status: 204 len: 168 time: 0.6384196 Dec 21 03:55:41.522137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59262) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:41.532687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a52ed81-2152-439d-ad0f-ce0c00f22e64 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.547060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff6c7b0-f795-4976-8f86-0d441a08ce05 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bce6c223-24ac-4853-9bff-6aaa822a9983,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:41.633142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a52ed81-2152-439d-ad0f-ce0c00f22e64 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.635411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df2b562-c9e6-4a55-babf-b79481d220db req-c5d54a88-8139-4112-8e6f-ac751f3363f1 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:41.637047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3df2b562-c9e6-4a55-babf-b79481d220db req-c5d54a88-8139-4112-8e6f-ac751f3363f1 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 943 time: 0.1638584 Dec 21 03:55:41.643003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-1bd1a5aa-53b4-41d5-9912-2079508aabac service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2548633 Dec 21 03:55:41.705957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-6f168223-fdfd-4146-a140-077b7bed8eec service neutron] 10.222.0.54 "GET /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2069631 Dec 21 03:55:41.708350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a52ed81-2152-439d-ad0f-ce0c00f22e64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.755921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1a52ed81-2152-439d-ad0f-ce0c00f22e64 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e2fc8f74f07b415da21f9cc37b9cfb84&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2361238 Dec 21 03:55:41.757080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a52ed81-2152-439d-ad0f-ce0c00f22e64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c560f590-c5f0-41fa-8861-2daefb2c9743,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:41.758992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59268) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:41.816762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3df2b562-c9e6-4a55-babf-b79481d220db req-37cb4b0c-f70a-4c70-8268-7fa6186324cc tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1706202 Dec 21 03:55:41.898524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-04ab377f-58ee-4c81-9a6f-58e86274db48 service neutron] 10.222.0.18 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2373571 Dec 21 03:55:41.931982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed46ff88-6fa5-4263-99d7-f70684f06f0b req-e80be8f5-cc59-40d5-81e1-ddf07e2ac753 service neutron] 10.222.0.54 "GET /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2169714 Dec 21 03:55:41.952416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4ebd5cb8-ed76-4874-a6f6-d1a2dc2ddd6d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:41.980788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4ebd5cb8-ed76-4874-a6f6-d1a2dc2ddd6d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:42.011365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220e15e3-e972-48ef-ad46-9524970488da req-a220ff0d-9cca-4201-8ef5-da2982a0c44f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:42.012840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-220e15e3-e972-48ef-ad46-9524970488da req-a220ff0d-9cca-4201-8ef5-da2982a0c44f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.0958779 Dec 21 03:55:42.033900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fdcf5b1-3091-4823-99be-f214f5f83a58 req-84c6e465-f33b-45e5-8084-45fbeefc3809 tempest-ServerMetadataNegativeTestJSON-590626787 tempest-ServerMetadataNegativeTestJSON-590626787-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a750098-4236-4f5e-9a01-55aab2cc757d HTTP/1.1" status: 200 len: 210 time: 0.0431635 Dec 21 03:55:42.099509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-220e15e3-e972-48ef-ad46-9524970488da req-c0c82f9d-bbd7-4561-ab68-5d07cd9ed33f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464544 Dec 21 03:55:42.136360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb342dba-d140-44dc-b52d-8c8f5b8c7797 req-e8f183c3-b78c-47bf-9cad-c4c8424320a9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:42.137880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb342dba-d140-44dc-b52d-8c8f5b8c7797 req-e8f183c3-b78c-47bf-9cad-c4c8424320a9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0484066 Dec 21 03:55:42.180833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4ebd5cb8-ed76-4874-a6f6-d1a2dc2ddd6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:42.188294 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4ebd5cb8-ed76-4874-a6f6-d1a2dc2ddd6d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:42.188294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4ebd5cb8-ed76-4874-a6f6-d1a2dc2ddd6d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c560f590-c5f0-41fa-8861-2daefb2c9743 HTTP/1.1" status: 204 len: 168 time: 0.4246187 Dec 21 03:55:42.209043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ebd5cb8-ed76-4874-a6f6-d1a2dc2ddd6d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c560f590-c5f0-41fa-8861-2daefb2c9743,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:42.234341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb342dba-d140-44dc-b52d-8c8f5b8c7797 req-68239b90-87a0-47c4-8c6a-ceb763677248 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898993 Dec 21 03:55:42.275014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4274df5f-c41b-4bef-a075-77e169742289 req-27c1a21d-2409-4769-8ebc-e76657353298 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 210 time: 0.0393853 Dec 21 03:55:42.466986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7a2a7c-4e53-46e4-83bf-2b20d2aa395a req-2423d3d5-bae1-4282-bba8-6f4624967836 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:42.468362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7a2a7c-4e53-46e4-83bf-2b20d2aa395a req-2423d3d5-bae1-4282-bba8-6f4624967836 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0523076 Dec 21 03:55:42.520967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7a2a7c-4e53-46e4-83bf-2b20d2aa395a req-491e4673-dde4-4ada-bcf8-0b62e230e250 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459573 Dec 21 03:55:42.950149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5b41eb-bb76-49d1-8cf5-898139e65246 req-8a2d42af-8b2c-40cb-b5c0-3a387ff14f7d tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:42.952165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf5b41eb-bb76-49d1-8cf5-898139e65246 req-8a2d42af-8b2c-40cb-b5c0-3a387ff14f7d tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 943 time: 0.0519485 Dec 21 03:55:43.014653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf5b41eb-bb76-49d1-8cf5-898139e65246 req-76ca9504-e45b-49ac-8703-ee03d07aa1e1 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552680 Dec 21 03:55:43.091361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:43.141306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Deleting subnet 14bb4fe8-5273-40af-b73d-89810485325d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:43.147535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.183988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.229151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.348411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee932a0-e37a-4987-90bb-3383887a3351 req-1eef0456-75fe-477b-b840-172b184a33e9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:43.351464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e62595e-7d69-43e9-8aed-15460480c2fc details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:55:43.357523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ee932a0-e37a-4987-90bb-3383887a3351 req-1eef0456-75fe-477b-b840-172b184a33e9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0616574 Dec 21 03:55:43.368632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device be859151-213e-42b8-9a33-fd8709503481 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:43.391542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.396887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1528f028-9784-46a6-8704-3cd0df1a863f req-435d3b4b-8a25-41a7-bcb7-705678c67a03 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 210 time: 0.0367141 Dec 21 03:55:43.445992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ee932a0-e37a-4987-90bb-3383887a3351 req-180cd120-2b50-4fe5-87bb-382f75493cbd tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770473 Dec 21 03:55:43.457820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=14bb4fe8-5273-40af-b73d-89810485325d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:43.457820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.457820 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9c78a16c-18ef-4d3d-bcd8-6f444894a4ee admin admin] 10.222.0.18 "DELETE /v2.0/subnets/14bb4fe8-5273-40af-b73d-89810485325d HTTP/1.1" status: 204 len: 168 time: 0.3645837 Dec 21 03:55:43.459718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59320) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:43.503602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: be859151-213e-42b8-9a33-fd8709503481 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:43.506384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device be859151-213e-42b8-9a33-fd8709503481 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:43.558117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9e62595e-7d69-43e9-8aed-15460480c2fc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e62595e-7d69-43e9-8aed-15460480c2fc,segment=NetworkSegment(501a0aa0-0a17-408f-b524-edab1997e16d),segment_id=501a0aa0-0a17-408f-b524-edab1997e16d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:43.589818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9e62595e-7d69-43e9-8aed-15460480c2fc', 'network_id': 'f4e9353f-6ab3-4e5b-86cb-eb1710ed1853', 'port_id': '9e62595e-7d69-43e9-8aed-15460480c2fc', 'mac_address': 'fa:16:3e:bb:76:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'accd44c9-1ee0-4627-8939-46f36f376a1d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:55:43.639384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.662721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.677777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e62595e-7d69-43e9-8aed-15460480c2fc {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:55:43.705095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9e62595e-7d69-43e9-8aed-15460480c2fc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e62595e-7d69-43e9-8aed-15460480c2fc,segment=NetworkSegment(501a0aa0-0a17-408f-b524-edab1997e16d),segment_id=501a0aa0-0a17-408f-b524-edab1997e16d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:43.732505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9016e7f-0ab2-404e-b7ed-6fc65396c14f req-8af46dae-193b-4755-9573-f96162445efd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:43.734006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9016e7f-0ab2-404e-b7ed-6fc65396c14f req-8af46dae-193b-4755-9573-f96162445efd tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1036150 Dec 21 03:55:43.776417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.788142 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.808872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['49509403-dd5e-4f24-9cfa-d239e84b0349']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:43.828526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4fcf4357-86b6-4de9-891d-d332b0206eb5') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:43.828829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4fcf4357-86b6-4de9-891d-d332b0206eb5') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:43.846201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.851230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9016e7f-0ab2-404e-b7ed-6fc65396c14f req-72584117-e66a-4da7-8920-2d40814e6129 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841310 Dec 21 03:55:43.857485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9e62595e-7d69-43e9-8aed-15460480c2fc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:43.863902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.870828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:43.871266 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:43.873241 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:43.983280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a38a3b-3392-49d2-96eb-c4350bc6b477 req-cef7ec10-c356-49a1-8f40-742f57f51693 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:43.984816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73a38a3b-3392-49d2-96eb-c4350bc6b477 req-cef7ec10-c356-49a1-8f40-742f57f51693 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0702755 Dec 21 03:55:44.032035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:44.037130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:44.043279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] 10.222.0.18 "DELETE /v2.0/networks/49509403-dd5e-4f24-9cfa-d239e84b0349 HTTP/1.1" status: 204 len: 168 time: 0.5828001 Dec 21 03:55:44.078568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c18d19c0-2f2e-40b2-9ba5-f11dba46ebdc admin admin] Pushing event deleted for resources: {'Network': ['ID=49509403-dd5e-4f24-9cfa-d239e84b0349,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:44.100835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-9a46b328-3f83-4aeb-834e-9a5822194567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:44.102574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-9a46b328-3f83-4aeb-834e-9a5822194567 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 1097 time: 0.1134915 Dec 21 03:55:44.106568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73a38a3b-3392-49d2-96eb-c4350bc6b477 req-48a0eef1-9cdb-4a44-8754-7f925a73b569 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066744 Dec 21 03:55:44.147274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9e62595e-7d69-43e9-8aed-15460480c2fc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:44.277490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6c8231-b3f2-4ced-8d74-294b1d4c7c67 req-c254e3b4-9a4d-4574-847e-2f643032a9b8 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:44.279149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d6c8231-b3f2-4ced-8d74-294b1d4c7c67 req-c254e3b4-9a4d-4574-847e-2f643032a9b8 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 944 time: 0.0769567 Dec 21 03:55:44.280917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-a8337417-dd75-46d7-a447-12e332c985a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:44.285312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-a8337417-dd75-46d7-a447-12e332c985a8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 200 len: 919 time: 0.1705892 Dec 21 03:55:44.348088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-0619aad5-db68-40e5-aac2-6d20a14d79ba service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 200 len: 217 time: 0.0418890 Dec 21 03:55:44.371613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d6c8231-b3f2-4ced-8d74-294b1d4c7c67 req-7cc854b2-dd35-4a17-a9f1-c5b0ce10c35e tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861170 Dec 21 03:55:44.442184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-1f0255ca-f34b-4ce7-a0fb-2d284a93612b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:44.443874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-1f0255ca-f34b-4ce7-a0fb-2d284a93612b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 200 len: 858 time: 0.0564506 Dec 21 03:55:44.482518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-369f8b82-3e3b-4574-9b5d-7cb5a0d12166 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fdf5929d-4a6d-4141-a192-66db327cd55e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0283525 Dec 21 03:55:44.514518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09222ebb-da30-42b5-afd9-202eb0fbdf88 req-8244b28b-a508-4472-a5e4-33e20865d55e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 210 time: 0.0343068 Dec 21 03:55:44.524932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59358) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:44.577844 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ecea2746-e4ac-459e-9440-b51e5203852c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0fff474ed0964fc58c2e3f7dbe139d37&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0492864 Dec 21 03:55:44.578109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59360) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:44.599649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-2246088f-edce-48f1-a6de-b9fb78afac4c service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1068995 Dec 21 03:55:44.638697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74f83d20-fb0b-4e14-a044-8b6f39ccd89a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:44.661764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74f83d20-fb0b-4e14-a044-8b6f39ccd89a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:44.704717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ef0cc4-7f50-4968-a66d-d847c9a4fbf9 req-e22499c2-a61c-4760-82be-c0c7f9a4caaf service neutron] 10.222.0.31 "GET /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896409 Dec 21 03:55:44.770173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74f83d20-fb0b-4e14-a044-8b6f39ccd89a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:44.773821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74f83d20-fb0b-4e14-a044-8b6f39ccd89a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:44.778033 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74f83d20-fb0b-4e14-a044-8b6f39ccd89a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5a29c11a-9d73-490f-bdc1-f30b9b101f1d HTTP/1.1" status: 204 len: 168 time: 0.1987691 Dec 21 03:55:44.788044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f83d20-fb0b-4e14-a044-8b6f39ccd89a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a29c11a-9d73-490f-bdc1-f30b9b101f1d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:44.925188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-b53951d0-1891-4817-ae25-19b8a6ebc5de tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:44.926752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-b53951d0-1891-4817-ae25-19b8a6ebc5de tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.31 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.0594258 Dec 21 03:55:45.083526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c4acaa-9841-4ee7-ae21-532d7c86b621 req-85633c3b-b983-419e-b6ac-2dc1fe012043 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:45.085026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91c4acaa-9841-4ee7-ae21-532d7c86b621 req-85633c3b-b983-419e-b6ac-2dc1fe012043 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 946 time: 0.1409397 Dec 21 03:55:45.213767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-d09f82c3-0001-4f90-8f39-88b247ff5873 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:45.215275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-d09f82c3-0001-4f90-8f39-88b247ff5873 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 812 time: 0.2060566 Dec 21 03:55:45.218861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91c4acaa-9841-4ee7-ae21-532d7c86b621 req-7af15ed6-58bc-43c7-82a6-71b09f56d72e tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989408 Dec 21 03:55:45.221022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Deleting port eaac8238-a002-4ebe-980e-8aa4a84f4e4e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:45.221364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.246175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Request body: {'port': {'device_id': '4b89e072-3518-4e8d-b762-d012782a38e9', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'admin_state_up': True, 'tenant_id': 'cb6e434168cc48daa3e991310cb6da73'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:45.383586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e62595e-7d69-43e9-8aed-15460480c2fc up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:45.419990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] For port eaac8238-a002-4ebe-980e-8aa4a84f4e4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:45.420372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.438814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Calling delete_port for eaac8238-a002-4ebe-980e-8aa4a84f4e4e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:45.536417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 9e62595e-7d69-43e9-8aed-15460480c2fc completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:55:45.542113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9e62595e-7d69-43e9-8aed-15460480c2fc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:45.542490 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.596007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae241bf-7cd7-4658-a438-19f488ec79ba req-7ffba538-2c39-4ef5-85c3-875e6c29d999 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:45.597529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ae241bf-7cd7-4658-a438-19f488ec79ba req-7ffba538-2c39-4ef5-85c3-875e6c29d999 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1454825 Dec 21 03:55:45.607071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Made reservation on behalf of cb6e434168cc48daa3e991310cb6da73 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:45.610716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.633275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.670592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e62595e-7d69-43e9-8aed-15460480c2fc'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:45.673729 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-76ae2d8b-122c-46fc-87cf-46728c430a55" -d '{"events": [{"server_uuid": "fa853ba3-e1a7-4a23-a7d9-b062129fdb3f", "name": "network-vif-plugged", "status": "completed", "tag": "9e62595e-7d69-43e9-8aed-15460480c2fc"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:45.682513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef094994-31df-4a66-9e52-1d02695bcca4 req-a790ed0d-085e-4027-912d-52aad44b5cae tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:45.685748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef094994-31df-4a66-9e52-1d02695bcca4 req-a790ed0d-085e-4027-912d-52aad44b5cae tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 944 time: 0.1465240 Dec 21 03:55:45.692276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9e62595e-7d69-43e9-8aed-15460480c2fc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e62595e-7d69-43e9-8aed-15460480c2fc,segment=NetworkSegment(501a0aa0-0a17-408f-b524-edab1997e16d),segment_id=501a0aa0-0a17-408f-b524-edab1997e16d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:45.769529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.810786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ae241bf-7cd7-4658-a438-19f488ec79ba req-b20aef2b-a532-4f01-810d-6604368e84e7 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1961396 Dec 21 03:55:45.826423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9e62595e-7d69-43e9-8aed-15460480c2fc,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:45.871155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef094994-31df-4a66-9e52-1d02695bcca4 req-9e32437c-1438-4820-8dd3-7f24cfa130d7 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1734018 Dec 21 03:55:45.880174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:45.914242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:45.917169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Allocated IP 172.20.0.9 (a0e5eeee-a736-4bd3-bdf6-679e8da99022/0937a3b1-7f54-409b-bba0-29fa72617a82/d7b539c2-9961-474f-b399-13370afd884b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:55:45.922222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Pushing event deleted for resources: {'Port': ['ID=eaac8238-a002-4ebe-980e-8aa4a84f4e4e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:45.966787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['eaac8238-a002-4ebe-980e-8aa4a84f4e4e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:46.004860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] No DVR routers for this DVR port eaac8238-a002-4ebe-980e-8aa4a84f4e4e on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:46.010574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.011809 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d845d3ba-376d-4574-9da4-4c34edaa46e9 x-openstack-request-id: req-d845d3ba-376d-4574-9da4-4c34edaa46e9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:46.012110 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa853ba3-e1a7-4a23-a7d9-b062129fdb3f", "name": "network-vif-plugged", "status": "completed", "tag": "9e62595e-7d69-43e9-8aed-15460480c2fc", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:46.012368 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d845d3ba-376d-4574-9da4-4c34edaa46e9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:46.012766 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e62595e-7d69-43e9-8aed-15460480c2fc', 'code': 200} Dec 21 03:55:46.017118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e5f6d67-0f48-4cb1-b9c1-3f01b13a0777 req-63c0bfdf-98dd-45f6-aee3-a1e271b5ad58 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.31 "DELETE /v2.0/ports/eaac8238-a002-4ebe-980e-8aa4a84f4e4e HTTP/1.1" status: 204 len: 173 time: 1.0743704 Dec 21 03:55:46.017612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'name': 'network-vif-deleted', 'tag': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:46.020040 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca021294-aa06-410b-9b65-3b1b41c30316" -d '{"events": [{"server_uuid": "bef70845-39fe-4faf-a847-a2c9dd5b51c3", "name": "network-vif-deleted", "tag": "eaac8238-a002-4ebe-980e-8aa4a84f4e4e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:46.050322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-143217ec-2965-45ad-98eb-65088c4b9e13 req-0508f3db-2dd7-46d6-b010-ed5e2d1899c4 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 210 time: 0.0795131 Dec 21 03:55:46.239378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59420) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:46.377986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Request body: {'network': {'name': 'tempest-VirtualInterfacesTestJSON-1737724473-network', 'tenant_id': '74ee344aeceb45dfb7e9c956bcfd01c6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:46.467805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Made reservation on behalf of 74ee344aeceb45dfb7e9c956bcfd01c6 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:46.470104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.482904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.489569 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e196c614-7ea0-4953-abb5-5f79ca135d9b x-openstack-request-id: req-e196c614-7ea0-4953-abb5-5f79ca135d9b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:46.490171 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bef70845-39fe-4faf-a847-a2c9dd5b51c3", "name": "network-vif-deleted", "tag": "eaac8238-a002-4ebe-980e-8aa4a84f4e4e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:46.490171 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e196c614-7ea0-4953-abb5-5f79ca135d9b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:46.490500 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bef70845-39fe-4faf-a847-a2c9dd5b51c3', 'name': 'network-vif-deleted', 'tag': 'eaac8238-a002-4ebe-980e-8aa4a84f4e4e', 'status': 'completed', 'code': 200} Dec 21 03:55:46.550500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4fd88e9-147f-47f5-b30d-05994aea8450 req-6c44598e-8bbd-44cf-af2e-12c3fcfd783a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=bef70845-39fe-4faf-a847-a2c9dd5b51c3 HTTP/1.1" status: 200 len: 210 time: 0.0591769 Dec 21 03:55:46.578192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.588063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db80fbc-6a16-45e5-a80b-2c8a50b723b7 req-749190f6-f660-400f-8e69-2709eeaacb2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:46.589557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5db80fbc-6a16-45e5-a80b-2c8a50b723b7 req-749190f6-f660-400f-8e69-2709eeaacb2a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 1097 time: 0.1017611 Dec 21 03:55:46.599105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.659883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5db80fbc-6a16-45e5-a80b-2c8a50b723b7 req-bf5e978e-e1f9-4218-a3f0-836c60ee4946 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589194 Dec 21 03:55:46.684350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.705407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:55:46.719909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fce9f51e-e3b8-4175-bca6-16905adfe697,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:46.722140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.722472 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Added segment 92333fb5-d614-4b6c-9480-39ebe1c14db4 of type vlan for network 6f53479b-9f41-4f1d-9f15-e4a733953bcf Dec 21 03:55:46.735358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.735831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.736050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.736357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.736703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.737001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.737321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.737645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.737964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.738548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.738643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.738892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.739242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:46.753777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.796154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.800857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:55:46.804841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:46.808777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:55:46.820339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cadc2dd-e3f1-46dc-80c5-a1608ac4b90d None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:46.837941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event updated for resources: {'Port': ['ID=d7b539c2-9961-474f-b399-13370afd884b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:46.865332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:46.865963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.901630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.902639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:46.903272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.908089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-428808db-8812-48ac-b1ad-7ae9b7909179 None None] Provisioning complete for port d7b539c2-9961-474f-b399-13370afd884b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:46.908772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-428808db-8812-48ac-b1ad-7ae9b7909179 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:46.934001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-ae57d5a8-9756-4421-8269-30e10560fcae tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6980062 Dec 21 03:55:46.947415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-428808db-8812-48ac-b1ad-7ae9b7909179 None None] Port d7b539c2-9961-474f-b399-13370afd884b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:55:46.953453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae86da3c-9836-470e-bb99-1c08eefca03b req-558ffe3b-1cf3-4546-b37e-878b83cce76d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:46.955039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae86da3c-9836-470e-bb99-1c08eefca03b req-558ffe3b-1cf3-4546-b37e-878b83cce76d tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0710678 Dec 21 03:55:46.987719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Request body: {'port': {'device_id': '4b89e072-3518-4e8d-b762-d012782a38e9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:46.998676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.7574656 Dec 21 03:55:46.999732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e3f6d3-7efb-403f-acf4-cf697d5994c5 admin admin] Pushing event updated for resources: {'Network': ['ID=6f53479b-9f41-4f1d-9f15-e4a733953bcf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:47.002437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59440) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:47.008326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Request body: {'subnet': {'network_id': '6f53479b-9f41-4f1d-9f15-e4a733953bcf', 'cidr': '172.20.0.0/28', 'name': 'tempest-VirtualInterfacesTestJSON-1737724473-subnet', 'tenant_id': '74ee344aeceb45dfb7e9c956bcfd01c6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:47.012814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6f53479b-9f41-4f1d-9f15-e4a733953bcf details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:55:47.101355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae86da3c-9836-470e-bb99-1c08eefca03b req-1ac8a961-f591-4f89-838b-58e0fb39b3db tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1321347 Dec 21 03:55:47.125786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Made reservation on behalf of 74ee344aeceb45dfb7e9c956bcfd01c6 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:47.128680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:47.144599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:47.206298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05fca90-f3cb-46b8-ad25-4316f8df96a9 req-f1f0a02e-825c-40dc-9734-14e284f4bdf7 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:47.207885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c05fca90-f3cb-46b8-ad25-4316f8df96a9 req-f1f0a02e-825c-40dc-9734-14e284f4bdf7 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 945 time: 0.1027009 Dec 21 03:55:47.293210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf3c874-7e99-4227-adb6-0013e9faa33b req-b1961e06-7949-446c-84ac-8116dd185aef tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:47.300589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf3c874-7e99-4227-adb6-0013e9faa33b req-b1961e06-7949-446c-84ac-8116dd185aef tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 931 time: 0.1322968 Dec 21 03:55:47.401148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c05fca90-f3cb-46b8-ad25-4316f8df96a9 req-b1d9b10a-fedd-4ebc-8052-176a5e97ee7a tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1764128 Dec 21 03:55:47.434457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf3c874-7e99-4227-adb6-0013e9faa33b req-36895fc2-9816-4f4d-b35e-0ce82814da7e tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1319263 Dec 21 03:55:47.456592 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:47.533533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b3639c2-6639-40e3-afa2-168608a4e8af,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:47.540898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Checking segment: {'id': '92333fb5-d614-4b6c-9480-39ebe1c14db4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '6f53479b-9f41-4f1d-9f15-e4a733953bcf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:47.541268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Network hostable DHCP agents. Network: 6f53479b-9f41-4f1d-9f15-e4a733953bcf, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:55:47.583716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7b539c2-9961-474f-b399-13370afd884b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:55:47.592749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:47.605102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Transition to ACTIVE for port object d7b539c2-9961-474f-b399-13370afd884b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:55:47.616079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Network 6f53479b-9f41-4f1d-9f15-e4a733953bcf is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:55:47.684521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6f53479b-9f41-4f1d-9f15-e4a733953bcf) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:47.684689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:47.688961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:47.690886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:47.693317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60989422-668d-4d98-a11a-d5daa158a39c None None] Network 6f53479b-9f41-4f1d-9f15-e4a733953bcf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:47.765524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1968ad89-e058-44ad-85a3-ee358f5b67bb None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:47.788123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Pushing event updated for resources: {'Port': ['ID=d7b539c2-9961-474f-b399-13370afd884b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:47.793040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f14bfe4-3815-4825-994e-e7017c905e8a admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.7898204 Dec 21 03:55:47.822482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f3abac3-356c-4cb2-8a22-d3515536432f None None] Network 6f53479b-9f41-4f1d-9f15-e4a733953bcf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:47.919479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Attempting to bind port d7b539c2-9961-474f-b399-13370afd884b on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:55:47.919879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Attempting to bind port d7b539c2-9961-474f-b399-13370afd884b by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:55:47.920225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Attempting to bind port d7b539c2-9961-474f-b399-13370afd884b on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:47.935985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Port d7b539c2-9961-474f-b399-13370afd884b on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:55:47.935985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Attempting to bind port d7b539c2-9961-474f-b399-13370afd884b on network a0e5eeee-a736-4bd3-bdf6-679e8da99022 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:55:47.967804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:55:47.968692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Checking segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:47.970222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Bound using segment: {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:55:47.972144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Bound port: d7b539c2-9961-474f-b399-13370afd884b, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fafae862-c9cf-4d93-83f4-6f5447ca2985', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:55:47.973670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.040072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59486) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:48.080001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] For port d7b539c2-9961-474f-b399-13370afd884b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:55:48.083056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] For port d7b539c2-9961-474f-b399-13370afd884b, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d7b539c2-9961-474f-b399-13370afd884b,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:55:48.099494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Deleting subnet 4b3639c2-6639-40e3-afa2-168608a4e8af {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:48.103272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.137264 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.175513 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.185886 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.231698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:48.232196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.235376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] 10.222.0.31 "PUT /v2.0/ports/d7b539c2-9961-474f-b399-13370afd884b HTTP/1.1" status: 200 len: 1092 time: 1.2627649 Dec 21 03:55:48.243871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50b08c90-9941-48fd-b87b-1af2f2e596e0 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:48.255096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c72005-d523-4a2f-b819-9f9d31cdc197 service neutron] Pushing event updated for resources: {'Port': ['ID=d7b539c2-9961-474f-b399-13370afd884b,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:48.307034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.333784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b3639c2-6639-40e3-afa2-168608a4e8af,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:48.349972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.354972 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4af430ba-1ce9-4efc-9222-a706cfb10688 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/4b3639c2-6639-40e3-afa2-168608a4e8af HTTP/1.1" status: 204 len: 168 time: 0.3137870 Dec 21 03:55:48.362355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:48.495188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b89e072-3518-4e8d-b762-d012782a38e9', 'tag': 'd7b539c2-9961-474f-b399-13370afd884b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:48.496186 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b16ecbd-185c-46e6-acdb-07f012f8c12a" -d '{"events": [{"name": "network-changed", "server_uuid": "4b89e072-3518-4e8d-b762-d012782a38e9", "tag": "d7b539c2-9961-474f-b399-13370afd884b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:48.508913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.523543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-4d45b4b9-4fc8-4eda-8196-f37064835c11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:48.525370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-4d45b4b9-4fc8-4eda-8196-f37064835c11 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 1095 time: 0.1354842 Dec 21 03:55:48.540437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94732734-3cb2-47f7-a99f-b105bcb2c1cb req-dbe4fced-a0b5-45dd-a619-87d09cc41268 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:48.542013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94732734-3cb2-47f7-a99f-b105bcb2c1cb req-dbe4fced-a0b5-45dd-a619-87d09cc41268 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1346762 Dec 21 03:55:48.585489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-a5f72d23-69f7-4a04-8c8e-f69cdc00128f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7b539c2-9961-474f-b399-13370afd884b HTTP/1.1" status: 200 len: 217 time: 0.0424893 Dec 21 03:55:48.734436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.767078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-f2a47ca6-e970-46d3-a799-052a31588771 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:48.768427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-f2a47ca6-e970-46d3-a799-052a31588771 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.1558456 Dec 21 03:55:48.776065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f53479b-9f41-4f1d-9f15-e4a733953bcf']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:48.783876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94732734-3cb2-47f7-a99f-b105bcb2c1cb req-0dff333a-54c9-4c7b-91a1-0f4d2ab1f3d7 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2031593 Dec 21 03:55:48.807493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf8a1af-523f-4db6-a4c9-79c4fa097ea6 req-3e2f15a1-d35a-4a71-ba92-749dc9b9f5c7 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:48.808985 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf8a1af-523f-4db6-a4c9-79c4fa097ea6 req-3e2f15a1-d35a-4a71-ba92-749dc9b9f5c7 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 945 time: 0.2272460 Dec 21 03:55:48.823071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92333fb5-d614-4b6c-9480-39ebe1c14db4') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:48.823384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92333fb5-d614-4b6c-9480-39ebe1c14db4') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:48.827868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-86182c5e-afcb-4229-82a9-c884085a51f4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0493183 Dec 21 03:55:48.842578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.911489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.930248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Releasing vlan 147 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:48.930772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:48.934366 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:49.017959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf8a1af-523f-4db6-a4c9-79c4fa097ea6 req-f880a581-89b8-4bf0-912f-ce259cea125e tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1922355 Dec 21 03:55:49.052834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28be0cea-ae1d-4d81-88e3-7987f00d5ad8 req-0740f60b-bca7-4b14-affb-e42647f33543 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:49.053311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device eaac8238-a002-4ebe-980e-8aa4a84f4e4e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:49.054371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28be0cea-ae1d-4d81-88e3-7987f00d5ad8 req-0740f60b-bca7-4b14-affb-e42647f33543 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 943 time: 0.1934428 Dec 21 03:55:49.072837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-cb4c52fb-0889-4913-94d3-ddaf1a9379fa service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2327659 Dec 21 03:55:49.074747 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-643d393d-2dfd-4202-b8a4-62be3944bf16 x-openstack-request-id: req-643d393d-2dfd-4202-b8a4-62be3944bf16 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:49.075265 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b89e072-3518-4e8d-b762-d012782a38e9", "tag": "d7b539c2-9961-474f-b399-13370afd884b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:49.075724 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-643d393d-2dfd-4202-b8a4-62be3944bf16 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:49.076295 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b89e072-3518-4e8d-b762-d012782a38e9', 'tag': 'd7b539c2-9961-474f-b399-13370afd884b', 'status': 'completed', 'code': 200} Dec 21 03:55:49.089008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: eaac8238-a002-4ebe-980e-8aa4a84f4e4e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:49.089739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device eaac8238-a002-4ebe-980e-8aa4a84f4e4e not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:49.119164 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:49.133096 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:49.136249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] 10.222.0.18 "DELETE /v2.0/networks/6f53479b-9f41-4f1d-9f15-e4a733953bcf HTTP/1.1" status: 204 len: 168 time: 0.7726879 Dec 21 03:55:49.158324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d5ae6c-e661-4ec2-ae16-86e73d1ed337 admin admin] Pushing event deleted for resources: {'Network': ['ID=6f53479b-9f41-4f1d-9f15-e4a733953bcf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:49.203420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28be0cea-ae1d-4d81-88e3-7987f00d5ad8 req-d6253468-7c10-4835-b22b-17e4f26046bd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1395063 Dec 21 03:55:49.233295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed57685e-7bb6-4de2-9adc-74a5d48cc234 req-e645a832-fa20-472f-9c76-970ab82944ca service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1345918 Dec 21 03:55:49.436343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-63814c69-52e9-428f-b9da-f8750b3385e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:49.438289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-63814c69-52e9-428f-b9da-f8750b3385e2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=cb6e434168cc48daa3e991310cb6da73&device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 1095 time: 0.0673928 Dec 21 03:55:49.547298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-e33eb20a-dc2e-454a-9df3-eb578a5d1a9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:49.565034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-e33eb20a-dc2e-454a-9df3-eb578a5d1a9f service neutron] 10.222.0.31 "GET /v2.0/networks?id=a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 200 len: 913 time: 0.1016817 Dec 21 03:55:49.607304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-6703fc63-ac73-43f0-b9ec-dbe4d46a586d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d7b539c2-9961-474f-b399-13370afd884b HTTP/1.1" status: 200 len: 217 time: 0.0412328 Dec 21 03:55:49.640567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59528) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:49.663118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-f5f78ce1-e214-4bcc-b09a-de12a6ca9f5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:49.665782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-f5f78ce1-e214-4bcc-b09a-de12a6ca9f5e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 200 len: 852 time: 0.0496595 Dec 21 03:55:49.702090 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-55ee2848-00bb-4e6b-b157-0a8d5ed2c446 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=74ee344aeceb45dfb7e9c956bcfd01c6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0596945 Dec 21 03:55:49.705014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59530) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:49.717067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-10a24f65-51e7-4654-a71d-4a65c498ec6b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a0e5eeee-a736-4bd3-bdf6-679e8da99022&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0402193 Dec 21 03:55:49.768831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4d92997-21b2-4dcb-806b-57b6f0b1d588 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:49.821874 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4d92997-21b2-4dcb-806b-57b6f0b1d588 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:49.839174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-962d1b77-ab57-4dfa-b5ca-3f6a7cd9e4d2 service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1122348 Dec 21 03:55:49.848107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c86af4cc-19ca-47d3-a944-a49fdfdf4547 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:49.987519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f619fc-ed63-4f69-819b-8cae500cb3be req-ebb615a5-7cc8-4f31-ae3e-243f3c42f6ad tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:49.989020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f619fc-ed63-4f69-819b-8cae500cb3be req-ebb615a5-7cc8-4f31-ae3e-243f3c42f6ad tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 945 time: 0.1489065 Dec 21 03:55:50.010393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4d92997-21b2-4dcb-806b-57b6f0b1d588 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:50.013618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4d92997-21b2-4dcb-806b-57b6f0b1d588 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:50.017342 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b4d92997-21b2-4dcb-806b-57b6f0b1d588 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fce9f51e-e3b8-4175-bca6-16905adfe697 HTTP/1.1" status: 204 len: 168 time: 0.3090324 Dec 21 03:55:50.030997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a8c0b3-8dc7-49ab-880c-f0df85b18555 req-7c0afc80-5442-47a4-8953-cf05ad2a67e9 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:50.032528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a8c0b3-8dc7-49ab-880c-f0df85b18555 req-7c0afc80-5442-47a4-8953-cf05ad2a67e9 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.1542525 Dec 21 03:55:50.039255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d92997-21b2-4dcb-806b-57b6f0b1d588 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fce9f51e-e3b8-4175-bca6-16905adfe697,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:50.081506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b16ecbd-185c-46e6-acdb-07f012f8c12a req-1950138c-badd-46fb-8e1d-4ef4964b885a service neutron] 10.222.0.31 "GET /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2223408 Dec 21 03:55:50.107475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1f619fc-ed63-4f69-819b-8cae500cb3be req-7cab7acb-6372-4e99-9928-39b22ac7cfbb tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092360 Dec 21 03:55:50.161031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a8c0b3-8dc7-49ab-880c-f0df85b18555 req-51fe4ae5-1068-4a85-a1bc-d7de7fbf844a tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/security-groups?id=399c538d-6c76-4c14-93bc-cec9279ae868&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076193 Dec 21 03:55:50.357962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78816f90-010c-4249-89ce-b4ab69f799f0 req-c3e894d8-8fc5-457a-97b0-1ed04aee5ca2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:50.366499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78816f90-010c-4249-89ce-b4ab69f799f0 req-c3e894d8-8fc5-457a-97b0-1ed04aee5ca2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 943 time: 0.0778878 Dec 21 03:55:50.412886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78816f90-010c-4249-89ce-b4ab69f799f0 req-326ade9d-7359-4059-a85d-88cb17651620 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454385 Dec 21 03:55:50.804889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc478ee-9893-4b46-aa62-34773467da11 req-74da9866-b259-46da-887b-d82f4bea0fcc tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:50.806639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbc478ee-9893-4b46-aa62-34773467da11 req-74da9866-b259-46da-887b-d82f4bea0fcc tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.54 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 945 time: 0.0638185 Dec 21 03:55:50.905831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Deleting port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:50.906136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:51.010113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] For port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:51.010113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:51.022237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Calling delete_port for 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:51.246419 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:51.272127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df1afc4c-476d-4588-bc82-20f4a7f0ecba req-13087d17-0fe5-47c9-a6af-ba414d850096 tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 210 time: 0.0385375 Dec 21 03:55:51.282711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:51.296146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Pushing event deleted for resources: {'Port': ['ID=9ab62435-cf06-4e36-9ac7-82fc6f3c22f7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:51.347728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] No DVR routers for this DVR port 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:51.350275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:51.354568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbc478ee-9893-4b46-aa62-34773467da11 req-ca555d0d-3559-415b-a889-1aecdcf3760b tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.54 "DELETE /v2.0/ports/9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 HTTP/1.1" status: 204 len: 173 time: 0.5411785 Dec 21 03:55:51.355131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'name': 'network-vif-deleted', 'tag': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:51.357454 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6295884c-02bc-4074-a458-9468f162dc17" -d '{"events": [{"server_uuid": "397c6d65-d795-4261-b5a8-84dfa0b55171", "name": "network-vif-deleted", "tag": "9ab62435-cf06-4e36-9ac7-82fc6f3c22f7"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:51.409396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc5c15c1-ee62-4d91-84fd-9f3e29a4a554 req-258bb3cf-5d10-4d1b-9ee7-b61e915e9937 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:51.410896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc5c15c1-ee62-4d91-84fd-9f3e29a4a554 req-258bb3cf-5d10-4d1b-9ee7-b61e915e9937 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 945 time: 0.0498049 Dec 21 03:55:51.464013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc5c15c1-ee62-4d91-84fd-9f3e29a4a554 req-6b5effff-85b6-4fc7-a870-4d92b63b5332 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/security-groups?id=98a9c7cb-bf58-418e-ad59-2a2818e8f27c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463440 Dec 21 03:55:51.529540 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3221c000-4f1a-49c7-9230-8ae25c6dfe4e x-openstack-request-id: req-3221c000-4f1a-49c7-9230-8ae25c6dfe4e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:51.529901 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "397c6d65-d795-4261-b5a8-84dfa0b55171", "name": "network-vif-deleted", "tag": "9ab62435-cf06-4e36-9ac7-82fc6f3c22f7", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:51.530213 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3221c000-4f1a-49c7-9230-8ae25c6dfe4e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:51.530954 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '397c6d65-d795-4261-b5a8-84dfa0b55171', 'name': 'network-vif-deleted', 'tag': '9ab62435-cf06-4e36-9ac7-82fc6f3c22f7', 'status': 'completed', 'code': 200} Dec 21 03:55:51.556309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-101b0130-3d2b-46fd-9905-278d52b94561 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:51.557853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-101b0130-3d2b-46fd-9905-278d52b94561 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.54 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 945 time: 0.0694380 Dec 21 03:55:51.677062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Deleting port 9e62595e-7d69-43e9-8aed-15460480c2fc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:51.677713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:51.805822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d4c012b-a427-41a2-a2a9-2fc36c8f5948 req-2030873a-ab09-40f2-ac60-fb8166ab49f2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:51.807329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d4c012b-a427-41a2-a2a9-2fc36c8f5948 req-2030873a-ab09-40f2-ac60-fb8166ab49f2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 943 time: 0.0999260 Dec 21 03:55:51.812748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] For port 9e62595e-7d69-43e9-8aed-15460480c2fc, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9e62595e-7d69-43e9-8aed-15460480c2fc,segment=NetworkSegment(501a0aa0-0a17-408f-b524-edab1997e16d),segment_id=501a0aa0-0a17-408f-b524-edab1997e16d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:51.813202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:51.839737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Calling delete_port for 9e62595e-7d69-43e9-8aed-15460480c2fc owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:51.911821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d4c012b-a427-41a2-a2a9-2fc36c8f5948 req-8498661d-b09a-4a35-822e-ec917bad16d5 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0901184 Dec 21 03:55:52.081337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:52.088780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.123842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9e62595e-7d69-43e9-8aed-15460480c2fc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:52.129197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Pushing event deleted for resources: {'Port': ['ID=9e62595e-7d69-43e9-8aed-15460480c2fc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:52.198594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6390a9d2-a7a2-4695-860a-af5a9b06b994 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.217225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-701d8bbd-9871-49a1-825d-a4a231dbdce3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.235470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] No DVR routers for this DVR port 9e62595e-7d69-43e9-8aed-15460480c2fc on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:55:52.240805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.244760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fccf58b-140c-4e54-9c37-ccc20ff7f52a req-9d7896fe-8268-40a7-a51a-2d64aa808440 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.54 "DELETE /v2.0/ports/9e62595e-7d69-43e9-8aed-15460480c2fc HTTP/1.1" status: 204 len: 173 time: 0.6792023 Dec 21 03:55:52.304591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-701d8bbd-9871-49a1-825d-a4a231dbdce3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.389246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1905c954-79b0-4201-8cf5-55a8cb5c27f1 req-f9106e38-6994-4531-aac2-b5f6488d3ece tempest-ServerRescueTestJSON-1342482699 tempest-ServerRescueTestJSON-1342482699-project] 10.222.0.18 "GET /v2.0/ports?device_id=397c6d65-d795-4261-b5a8-84dfa0b55171 HTTP/1.1" status: 200 len: 210 time: 0.0263112 Dec 21 03:55:52.399243 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-701d8bbd-9871-49a1-825d-a4a231dbdce3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.451914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-701d8bbd-9871-49a1-825d-a4a231dbdce3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e39d87a4cec24e088a4dc87859f124d2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3692648 Dec 21 03:55:52.452795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-701d8bbd-9871-49a1-825d-a4a231dbdce3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7406599-1574-45c1-8eea-ab4d51418d24,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:52.454469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59606) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:52.536705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717447a2-1180-4efe-ad93-d0d5f7fec842 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.574731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717447a2-1180-4efe-ad93-d0d5f7fec842 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.599501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c77845c6-7dcd-4cdb-b12c-08c8dc379cfd req-a5f16b57-13e8-40c1-a7c0-c382bc83f5c1 tempest-InstanceActionsNegativeTestJSON-2056867725 tempest-InstanceActionsNegativeTestJSON-2056867725-project] 10.222.0.18 "GET /v2.0/ports?device_id=fa853ba3-e1a7-4a23-a7d9-b062129fdb3f HTTP/1.1" status: 200 len: 210 time: 0.0415227 Dec 21 03:55:52.605960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.747442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717447a2-1180-4efe-ad93-d0d5f7fec842 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.750208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717447a2-1180-4efe-ad93-d0d5f7fec842 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:52.751435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-717447a2-1180-4efe-ad93-d0d5f7fec842 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b7406599-1574-45c1-8eea-ab4d51418d24 HTTP/1.1" status: 204 len: 168 time: 0.2942271 Dec 21 03:55:52.763788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717447a2-1180-4efe-ad93-d0d5f7fec842 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7406599-1574-45c1-8eea-ab4d51418d24,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:53.048783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2af21a-9d06-43b9-bfbb-274b7f0bb678 req-54372a0d-b2d6-4fbc-b8da-8b104d8442bd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:53.050417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa2af21a-9d06-43b9-bfbb-274b7f0bb678 req-54372a0d-b2d6-4fbc-b8da-8b104d8442bd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 943 time: 0.0612984 Dec 21 03:55:53.077271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d7b539c2-9961-474f-b399-13370afd884b details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:55:53.129939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa2af21a-9d06-43b9-bfbb-274b7f0bb678 req-ee13946e-62d7-48ef-99ea-07ecdd17ad95 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671237 Dec 21 03:55:53.252307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d7b539c2-9961-474f-b399-13370afd884b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d7b539c2-9961-474f-b399-13370afd884b,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:53.254680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:53.263860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'd7b539c2-9961-474f-b399-13370afd884b', 'network_id': 'a0e5eeee-a736-4bd3-bdf6-679e8da99022', 'port_id': 'd7b539c2-9961-474f-b399-13370afd884b', 'mac_address': 'fa:16:3e:da:51:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0937a3b1-7f54-409b-bba0-29fa72617a82', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:55:53.306720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:53.320089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7b539c2-9961-474f-b399-13370afd884b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:55:53.340754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d7b539c2-9961-474f-b399-13370afd884b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d7b539c2-9961-474f-b399-13370afd884b,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:53.419829 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:53.448897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e62595e-7d69-43e9-8aed-15460480c2fc no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:53.449556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59630) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:53.494091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 9e62595e-7d69-43e9-8aed-15460480c2fc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:53.494450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9e62595e-7d69-43e9-8aed-15460480c2fc not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:53.494882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:53.518290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d7b539c2-9961-474f-b399-13370afd884b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:53.522583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:53.523888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9ab62435-cf06-4e36-9ac7-82fc6f3c22f7 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:53.667692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59634) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:53.731396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d7b539c2-9961-474f-b399-13370afd884b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:55:53.736707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Deleting subnet accd44c9-1ee0-4627-8939-46f36f376a1d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:53.746672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:53.818648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:53.872251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'name': 'network-vif-deleted', 'tag': '9e62595e-7d69-43e9-8aed-15460480c2fc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:53.874623 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3ee4745-de82-4053-9c3e-686c130b8bf9" -d '{"events": [{"server_uuid": "fa853ba3-e1a7-4a23-a7d9-b062129fdb3f", "name": "network-vif-deleted", "tag": "9e62595e-7d69-43e9-8aed-15460480c2fc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:53.876469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:53.935343 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b34ab645-c3af-4381-a7b6-e7b358c3afaf x-openstack-request-id: req-b34ab645-c3af-4381-a7b6-e7b358c3afaf {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:53.935343 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa853ba3-e1a7-4a23-a7d9-b062129fdb3f", "name": "network-vif-deleted", "tag": "9e62595e-7d69-43e9-8aed-15460480c2fc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:53.935343 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b34ab645-c3af-4381-a7b6-e7b358c3afaf {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:53.935343 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa853ba3-e1a7-4a23-a7d9-b062129fdb3f', 'name': 'network-vif-deleted', 'tag': '9e62595e-7d69-43e9-8aed-15460480c2fc', 'status': 'completed', 'code': 200} Dec 21 03:55:54.004742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.041097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.044540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/accd44c9-1ee0-4627-8939-46f36f376a1d HTTP/1.1" status: 204 len: 168 time: 0.3758347 Dec 21 03:55:54.046212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc3e3a0-9d03-4438-a1ec-2a24df45e1b4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=accd44c9-1ee0-4627-8939-46f36f376a1d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:54.049395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:54.129058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.206372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.217527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.240677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f4e9353f-6ab3-4e5b-86cb-eb1710ed1853']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:54.251146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '501a0aa0-0a17-408f-b524-edab1997e16d') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:54.255358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '501a0aa0-0a17-408f-b524-edab1997e16d') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:54.262917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.279248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:54.289755 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:54.427921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.435194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.438292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] 10.222.0.18 "DELETE /v2.0/networks/f4e9353f-6ab3-4e5b-86cb-eb1710ed1853 HTTP/1.1" status: 204 len: 168 time: 0.3876743 Dec 21 03:55:54.448377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3a7362-e1ce-4285-8e5e-4e6ee3234368 admin admin] Pushing event deleted for resources: {'Network': ['ID=f4e9353f-6ab3-4e5b-86cb-eb1710ed1853,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:54.469195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Deleting port 3f22db30-4385-410e-ab0d-8f6c7358038f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:54.469428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.603376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] For port 3f22db30-4385-410e-ab0d-8f6c7358038f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3f22db30-4385-410e-ab0d-8f6c7358038f,segment=NetworkSegment(3daad6e7-a55c-43a2-addf-68e15a0b841f),segment_id=3daad6e7-a55c-43a2-addf-68e15a0b841f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:54.603376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.614170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Calling delete_port for 3f22db30-4385-410e-ab0d-8f6c7358038f owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:54.623706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-021c5ed2-b6c0-474c-9fe1-3bdbb5339137 req-b6afc28d-1afc-42f1-bc63-77b1fb8a6c1a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:54.625577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-021c5ed2-b6c0-474c-9fe1-3bdbb5339137 req-b6afc28d-1afc-42f1-bc63-77b1fb8a6c1a tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 944 time: 0.0876729 Dec 21 03:55:54.729732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-021c5ed2-b6c0-474c-9fe1-3bdbb5339137 req-64b858f4-4422-4fcb-858f-5724229e2aa1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927937 Dec 21 03:55:54.873000 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.931427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.959033 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:54.972114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Pushing event deleted for resources: {'Port': ['ID=3f22db30-4385-410e-ab0d-8f6c7358038f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:54.977694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:54.991094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.991094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.992010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.992150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.992451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.992794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.993104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.993431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.993759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.994086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.994429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.994738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:54.995091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.080332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d7b539c2-9961-474f-b399-13370afd884b up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:55:55.096595 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e618439e-23d7-406f-82e8-e1d5d0a63320 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=69e683945f44413f943d010be27d930d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1172116 Dec 21 03:55:55.097192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59682) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:55.166083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59688) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:55.242053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e0a9a36-1a0c-49b1-b761-40ba83f45295 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.266045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e0a9a36-1a0c-49b1-b761-40ba83f45295 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.270887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.284251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port d7b539c2-9961-474f-b399-13370afd884b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:55:55.289807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port d7b539c2-9961-474f-b399-13370afd884b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:55:55.291201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.344086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-926b0406-c418-475d-836a-60730104a45b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.397189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.409854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e0a9a36-1a0c-49b1-b761-40ba83f45295 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.412997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e0a9a36-1a0c-49b1-b761-40ba83f45295 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.415493 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e0a9a36-1a0c-49b1-b761-40ba83f45295 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/98a9c7cb-bf58-418e-ad59-2a2818e8f27c HTTP/1.1" status: 204 len: 168 time: 0.3159902 Dec 21 03:55:55.423654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e0a9a36-1a0c-49b1-b761-40ba83f45295 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98a9c7cb-bf58-418e-ad59-2a2818e8f27c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:55.431852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d7b539c2-9961-474f-b399-13370afd884b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d7b539c2-9961-474f-b399-13370afd884b,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:55.432794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b89e072-3518-4e8d-b762-d012782a38e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7b539c2-9961-474f-b399-13370afd884b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:55:55.435199 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa53702d-59bf-4a0b-8883-8dba8159b92e" -d '{"events": [{"server_uuid": "4b89e072-3518-4e8d-b762-d012782a38e9", "name": "network-vif-plugged", "status": "completed", "tag": "d7b539c2-9961-474f-b399-13370afd884b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:55:55.496347 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:55:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6cf1e3be-592a-44cb-9208-008e3138ad55 x-openstack-request-id: req-6cf1e3be-592a-44cb-9208-008e3138ad55 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:55:55.496700 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b89e072-3518-4e8d-b762-d012782a38e9", "name": "network-vif-plugged", "status": "completed", "tag": "d7b539c2-9961-474f-b399-13370afd884b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:55:55.496969 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6cf1e3be-592a-44cb-9208-008e3138ad55 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:55:55.497376 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b89e072-3518-4e8d-b762-d012782a38e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7b539c2-9961-474f-b399-13370afd884b', 'code': 200} Dec 21 03:55:55.535631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.577482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-926b0406-c418-475d-836a-60730104a45b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.628632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d7b539c2-9961-474f-b399-13370afd884b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:55.637849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.638425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.639030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.639538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.640023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.640504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.640989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.641465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.641956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.642733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.643445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.648401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.648401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:55:55.700317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-926b0406-c418-475d-836a-60730104a45b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.727619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318f96f8-8d1b-4eb6-8c5c-cca16431437c req-d9a9c075-105b-4e9b-9b6e-944cfcf82d43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:55.729137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-318f96f8-8d1b-4eb6-8c5c-cca16431437c req-d9a9c075-105b-4e9b-9b6e-944cfcf82d43 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 1097 time: 0.0912888 Dec 21 03:55:55.742604 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.785029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Router 08658061-802f-4cd3-bf36-1f9ac84208e7 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:55:55.793442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-926b0406-c418-475d-836a-60730104a45b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f0ec94a587e54f97ae5db369c3d44e68&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6266315 Dec 21 03:55:55.793566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59706) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:55.796083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-926b0406-c418-475d-836a-60730104a45b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51630216-ff36-424d-9157-c2788314ef68,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:55.864735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-318f96f8-8d1b-4eb6-8c5c-cca16431437c req-4c7dc086-98c7-450c-813a-c05050ff05bf service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1260979 Dec 21 03:55:55.892398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa079fa-a4ef-4126-9551-f71794efa98b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:55.941872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa079fa-a4ef-4126-9551-f71794efa98b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.076683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71faf3dd-58f3-4803-a121-2ca39ed4b7c7 req-ec1935a6-83de-4a0d-a7b7-5ac9a6498fa1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:56.084359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71faf3dd-58f3-4803-a121-2ca39ed4b7c7 req-ec1935a6-83de-4a0d-a7b7-5ac9a6498fa1 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.2253864 Dec 21 03:55:56.109747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:55:56.118977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6fa312e8-7858-435e-b5f0-374621eb1680 admin admin] 10.222.0.18 "PUT /v2.0/routers/08658061-802f-4cd3-bf36-1f9ac84208e7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6664777 Dec 21 03:55:56.120328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:56.134720 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] Sync routers for ids ['08658061-802f-4cd3-bf36-1f9ac84208e7'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:55:56.159662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71faf3dd-58f3-4803-a121-2ca39ed4b7c7 req-d0cc092c-0f3b-49c2-887a-24903c4ac4ea tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742030 Dec 21 03:55:56.178488 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] Routers {'08658061-802f-4cd3-bf36-1f9ac84208e7'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:56.179786 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['08658061-802f-4cd3-bf36-1f9ac84208e7'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:56.183675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa079fa-a4ef-4126-9551-f71794efa98b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.186329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa079fa-a4ef-4126-9551-f71794efa98b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.190206 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6fa079fa-a4ef-4126-9551-f71794efa98b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/51630216-ff36-424d-9157-c2788314ef68 HTTP/1.1" status: 204 len: 168 time: 0.3956666 Dec 21 03:55:56.208218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa079fa-a4ef-4126-9551-f71794efa98b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51630216-ff36-424d-9157-c2788314ef68,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:56.296066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.335942 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] Set router 08658061-802f-4cd3-bf36-1f9ac84208e7 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:56.508025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.618173 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242'}], 'enable_snat': True}, 'gw_port_id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:55:54Z', 'revision_number': 5, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port': {'id': 'd2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:2d:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1188, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:51Z', 'updated_at': '2021-12-21T03:53:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:56.656021 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] Checking router: 08658061-802f-4cd3-bf36-1f9ac84208e7 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:55:56.667691 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] Routers {'08658061-802f-4cd3-bf36-1f9ac84208e7'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:55:56.669123 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['08658061-802f-4cd3-bf36-1f9ac84208e7'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:56.700111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Deleting port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:55:56.700759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.777223 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] Set router 08658061-802f-4cd3-bf36-1f9ac84208e7 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:55:56.809415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] For port d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:55:56.809789 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:56.823151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Calling delete_port for d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:55:56.835907 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:55:56Z', 'revision_number': 6, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:56.879887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc933bf-f7ef-4f2b-b636-ad632ef572ac None None] The sync data for ids ['08658061-802f-4cd3-bf36-1f9ac84208e7'] in n-d-822053-11 is: [{'id': '08658061-802f-4cd3-bf36-1f9ac84208e7', 'name': 'tempest-ServerRescueTestJSON-34383565-router', 'tenant_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:49Z', 'updated_at': '2021-12-21T03:55:56Z', 'revision_number': 6, 'project_id': '0eca6fe3fe274d1abd1d5ce62d18e44d', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:55:56.981265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59738) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:57.093852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Request body: {'network': {'name': 'tempest-MultipleCreateTestJSON-976321098-network', 'tenant_id': '5aa4830586124e6a8a42b9502b0fc7c2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:57.113584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.146303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Pushing event deleted for resources: {'Port': ['ID=d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:57.162406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68dce35d-d22c-4ff0-b6e7-fc2a0fb3caf2 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:55:57.228339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.232604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:57.265203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e5a1fdf-6d16-4012-afec-fbfff1852c49 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.284263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Made reservation on behalf of 5aa4830586124e6a8a42b9502b0fc7c2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:57.286872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.316331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.373533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3f22db30-4385-410e-ab0d-8f6c7358038f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:57.378398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.383805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.403094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 3f22db30-4385-410e-ab0d-8f6c7358038f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:57.404331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 3f22db30-4385-410e-ab0d-8f6c7358038f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:57.430420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae06f31-1fe1-4ac5-9048-4567811dc4c5 req-9ae95c40-91ff-488e-881b-4e77b52a53e3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:57.438187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ae06f31-1fe1-4ac5-9048-4567811dc4c5 req-9ae95c40-91ff-488e-881b-4e77b52a53e3 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.1602564 Dec 21 03:55:57.547669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.549167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 08658061-802f-4cd3-bf36-1f9ac84208e7 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:55:57.554805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.563074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ae06f31-1fe1-4ac5-9048-4567811dc4c5 req-4a8b336a-9053-46d6-9d8f-c50aa7759831 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109042 Dec 21 03:55:57.568839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1184585b-6578-4a70-a390-ea825a13981d admin admin] 10.222.0.18 "DELETE /v2.0/routers/08658061-802f-4cd3-bf36-1f9ac84208e7 HTTP/1.1" status: 204 len: 168 time: 1.4385393 Dec 21 03:55:57.569892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59762) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:57.595185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e5a1fdf-6d16-4012-afec-fbfff1852c49 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.632973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.645719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Deleting subnet b082405b-1cdc-4188-a989-d408accdc4d2 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:55:57.648884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.679148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e5a1fdf-6d16-4012-afec-fbfff1852c49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.693466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.739522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.766586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8e5a1fdf-6d16-4012-afec-fbfff1852c49 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5e1530b0925c4f2981a3da40320dabf7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5330584 Dec 21 03:55:57.769174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59764) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:57.771777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5a1fdf-6d16-4012-afec-fbfff1852c49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cc01846-ae40-4558-b96f-4580f781a665,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:57.801301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4f95788-ae64-484e-808e-13d6137c228c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:57.805450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:55:57.834377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1b3fe60-6112-4d03-8995-561edf155f53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.862796 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.884209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1b3fe60-6112-4d03-8995-561edf155f53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.915257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:57.915767 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Added segment 5601a3fe-5cce-43a8-9085-a8fef024cc6d of type vlan for network 1bfeb879-d5e1-4651-ae97-290a586eba8e Dec 21 03:55:57.976423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.037175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1b3fe60-6112-4d03-8995-561edf155f53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.040721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1b3fe60-6112-4d03-8995-561edf155f53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.042026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1b3fe60-6112-4d03-8995-561edf155f53 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7cc01846-ae40-4558-b96f-4580f781a665 HTTP/1.1" status: 204 len: 168 time: 0.2718401 Dec 21 03:55:58.051629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b3fe60-6112-4d03-8995-561edf155f53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cc01846-ae40-4558-b96f-4580f781a665,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:58.082829 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.112717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b082405b-1cdc-4188-a989-d408accdc4d2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:58.116655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.118245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:58.119206 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.129597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.133391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8369d7c4-94bb-4760-b7ca-49c797b4897a admin admin] 10.222.0.18 "DELETE /v2.0/subnets/b082405b-1cdc-4188-a989-d408accdc4d2 HTTP/1.1" status: 204 len: 168 time: 0.5625305 Dec 21 03:55:58.136771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59772) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:58.207906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] Pushing event updated for resources: {'Network': ['ID=1bfeb879-d5e1-4651-ae97-290a586eba8e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:58.220823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:55:58.233771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6e6cdfa6-403a-4db7-83e4-bce3570b4140 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.2492654 Dec 21 03:55:58.236202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59776) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:58.244464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Request body: {'subnet': {'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'cidr': '172.20.0.0/28', 'name': 'tempest-MultipleCreateTestJSON-976321098-subnet', 'tenant_id': '5aa4830586124e6a8a42b9502b0fc7c2', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:55:58.263392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.347666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Made reservation on behalf of 5aa4830586124e6a8a42b9502b0fc7c2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:55:58.353417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.424056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.453249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ee3304b6-e18e-45c8-93c6-239041d697ca']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:58.465944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3daad6e7-a55c-43a2-addf-68e15a0b841f') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:58.466245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3daad6e7-a55c-43a2-addf-68e15a0b841f') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:55:58.488776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.537999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.553480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:55:58.555269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:55:58.584191 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:55:58.791312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b434bdcf-b72f-4757-a656-c75cd263ea8b req-a4d554b3-4e0c-49cd-944d-04d2ad101420 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:58.791312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b434bdcf-b72f-4757-a656-c75cd263ea8b req-a4d554b3-4e0c-49cd-944d-04d2ad101420 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.0680602 Dec 21 03:55:58.866066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b434bdcf-b72f-4757-a656-c75cd263ea8b req-f8175340-04f9-4ed2-8d3f-18151fdfd422 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677018 Dec 21 03:55:58.866066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.870499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.879764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:58.885787 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] 10.222.0.18 "DELETE /v2.0/networks/ee3304b6-e18e-45c8-93c6-239041d697ca HTTP/1.1" status: 204 len: 168 time: 0.7476339 Dec 21 03:55:58.912031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be8becc3-8ac7-4643-8771-8afd805c2054 admin admin] Pushing event deleted for resources: {'Network': ['ID=ee3304b6-e18e-45c8-93c6-239041d697ca,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:58.962647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bb3135ec-e693-4805-af80-f05f5d44e73c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:55:58.977930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Checking segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:55:58.978562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Network hostable DHCP agents. Network: 1bfeb879-d5e1-4651-ae97-290a586eba8e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:55:59.062601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:55:59.125007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:55:59.146202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:55:59.146555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a64d7b-b3d2-42e5-a5bd-d3a5fe25f0e0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:55:59.196580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1bfeb879-d5e1-4651-ae97-290a586eba8e) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:55:59.200629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:59.203623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:59.207548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bc037d6-4361-4512-93d1-d690af7152f6 None None] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:59.309080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c965e2cf-95e6-4a9d-8d46-f83f57fbcd91 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.0699191 Dec 21 03:55:59.340685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e89d100c-7cb8-4e5a-a444-d3bbc0098d9a None None] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:55:59.425758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59810) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:59.461273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a23bda-e9de-496e-bdfe-6a95215368ae req-a5be61a0-d4dc-4c98-b72a-d7c84aecc005 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:55:59.472735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2a23bda-e9de-496e-bdfe-6a95215368ae req-a5be61a0-d4dc-4c98-b72a-d7c84aecc005 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.0972962 Dec 21 03:55:59.516583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59812) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:55:59.517126 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aeead027-3f3a-424d-83be-b569df04b0a9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0eca6fe3fe274d1abd1d5ce62d18e44d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0892146 Dec 21 03:55:59.584455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2a23bda-e9de-496e-bdfe-6a95215368ae req-6a03c589-5f5c-4a3c-87a4-2943af395985 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932906 Dec 21 03:55:59.638669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2bc8aee-7aeb-4986-a3c5-e33caff900a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:59.668235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2bc8aee-7aeb-4986-a3c5-e33caff900a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:59.851186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2bc8aee-7aeb-4986-a3c5-e33caff900a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:59.855333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2bc8aee-7aeb-4986-a3c5-e33caff900a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:55:59.859689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b2bc8aee-7aeb-4986-a3c5-e33caff900a8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/399c538d-6c76-4c14-93bc-cec9279ae868 HTTP/1.1" status: 204 len: 168 time: 0.3407972 Dec 21 03:55:59.871360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2bc8aee-7aeb-4986-a3c5-e33caff900a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=399c538d-6c76-4c14-93bc-cec9279ae868,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:00.437468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-053952fe-e8ff-4888-b0b4-8bee2b7024f4 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:00.445370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-053952fe-e8ff-4888-b0b4-8bee2b7024f4 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 812 time: 0.1916816 Dec 21 03:56:00.469241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-097e4058-b75e-4c46-818a-5a32fbe9d685 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/quotas/5aa4830586124e6a8a42b9502b0fc7c2 HTTP/1.1" status: 200 len: 375 time: 0.0228839 Dec 21 03:56:00.512349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-28a15beb-18f4-46ae-b143-7db63aa2e961 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0364294 Dec 21 03:56:00.647499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-3780d290-5ea8-4776-bc06-4fcdd22b5613 service neutron] 10.222.0.18 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1191392 Dec 21 03:56:00.789269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-20c1e213-bb01-40f1-ba0f-b1ea816360e4 service neutron] 10.222.0.18 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1357763 Dec 21 03:56:00.812070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc74172-e4ae-47cd-975e-f6099a962a35 req-0a7dcea1-a8e4-4a0b-a327-83d7672588bd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:00.813639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1fc74172-e4ae-47cd-975e-f6099a962a35 req-0a7dcea1-a8e4-4a0b-a327-83d7672588bd tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.0711524 Dec 21 03:56:00.929547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1fc74172-e4ae-47cd-975e-f6099a962a35 req-a43b5dc8-5a40-4cc1-8e53-570c74b902cc tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065707 Dec 21 03:56:01.679368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9cd49a-2548-4a0f-97ff-46e142d82859 req-7e416c58-9e6f-4958-85cf-c981223630de tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:01.689474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf9cd49a-2548-4a0f-97ff-46e142d82859 req-7e416c58-9e6f-4958-85cf-c981223630de tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.0851398 Dec 21 03:56:01.777711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eaadee6b-eac5-46fd-a1f6-1cea3d247aef req-114f67ce-18ac-4bd7-87c2-e6c1137d2eed tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 210 time: 0.0495465 Dec 21 03:56:01.826273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf9cd49a-2548-4a0f-97ff-46e142d82859 req-a9e97d6d-1569-47d7-afe4-f82fd94d059c tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358120 Dec 21 03:56:01.927643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59916) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:02.276267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d87fc50-18f2-46d7-9dff-974d63d74139 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.423529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d87fc50-18f2-46d7-9dff-974d63d74139 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.489151 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d87fc50-18f2-46d7-9dff-974d63d74139 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.542515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6d87fc50-18f2-46d7-9dff-974d63d74139 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=369404f9992949ca9bd84a658a122d4f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6129050 Dec 21 03:56:02.545126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:02.623078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d87fc50-18f2-46d7-9dff-974d63d74139 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d35d87e-07a8-4949-b196-6ad3594b7f8b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:02.661162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e73005d-2b78-4e1a-926c-6cba75f18006 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.724737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e73005d-2b78-4e1a-926c-6cba75f18006 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.882457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e73005d-2b78-4e1a-926c-6cba75f18006 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.897049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5e73005d-2b78-4e1a-926c-6cba75f18006 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:02.903114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5e73005d-2b78-4e1a-926c-6cba75f18006 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6d35d87e-07a8-4949-b196-6ad3594b7f8b HTTP/1.1" status: 204 len: 168 time: 0.3519528 Dec 21 03:56:02.935823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dd4ba5c-828a-44cf-bf28-1c62ef6a054e req-0a21cc36-37c2-43b6-8c0d-0bd2b59c4af5 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 210 time: 0.0678823 Dec 21 03:56:02.947474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e73005d-2b78-4e1a-926c-6cba75f18006 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d35d87e-07a8-4949-b196-6ad3594b7f8b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:03.109498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc076ae-e344-4839-8e80-48e35e73758b req-22f7e662-afa7-4475-bcfa-f14fa5399068 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:03.111598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bc076ae-e344-4839-8e80-48e35e73758b req-22f7e662-afa7-4475-bcfa-f14fa5399068 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.0803754 Dec 21 03:56:03.162802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bc076ae-e344-4839-8e80-48e35e73758b req-b2a972fb-4208-4486-9fe2-c72e287d83dc tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/security-groups?id=b078e631-a51a-4efd-887f-6f8872cf6b3b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456061 Dec 21 03:56:03.289197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910acf21-ac29-402b-9ec5-d899aad12939 req-47faa6f9-ddae-4958-bd21-fd5ab3ad9cb2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:03.290669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-910acf21-ac29-402b-9ec5-d899aad12939 req-47faa6f9-ddae-4958-bd21-fd5ab3ad9cb2 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 945 time: 0.0559113 Dec 21 03:56:03.396299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Deleting port d7b539c2-9961-474f-b399-13370afd884b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:03.396645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.417602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60002) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:03.465453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:03.558244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] For port d7b539c2-9961-474f-b399-13370afd884b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d7b539c2-9961-474f-b399-13370afd884b,segment=NetworkSegment(fafae862-c9cf-4d93-83f4-6f5447ca2985),segment_id=fafae862-c9cf-4d93-83f4-6f5447ca2985)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:03.558620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.575258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Calling delete_port for d7b539c2-9961-474f-b399-13370afd884b owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:03.611321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de5b210a-28ec-4d4f-9763-dad6553c5d85 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.727344 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:56:03.768200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de5b210a-28ec-4d4f-9763-dad6553c5d85 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.779088 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0932565-32ae-4650-90fa-8f4ce3eefab5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.799326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.839543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Pushing event deleted for resources: {'Port': ['ID=d7b539c2-9961-474f-b399-13370afd884b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:03.845442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d7b539c2-9961-474f-b399-13370afd884b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:03.876350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-163a8d20-a74f-44e1-9a71-3f00a2f72030 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:03.881665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de5b210a-28ec-4d4f-9763-dad6553c5d85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.929748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de5b210a-28ec-4d4f-9763-dad6553c5d85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d683eb8-d28d-4b25-9e02-b46ec33befaa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:03.935107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0932565-32ae-4650-90fa-8f4ce3eefab5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.936688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] No DVR routers for this DVR port d7b539c2-9961-474f-b399-13370afd884b on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:03.940913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:03.945399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-910acf21-ac29-402b-9ec5-d899aad12939 req-97bc55c5-290d-4475-8ede-35121aa49d45 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.31 "DELETE /v2.0/ports/d7b539c2-9961-474f-b399-13370afd884b HTTP/1.1" status: 204 len: 173 time: 0.6477754 Dec 21 03:56:03.945923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b89e072-3518-4e8d-b762-d012782a38e9', 'name': 'network-vif-deleted', 'tag': 'd7b539c2-9961-474f-b399-13370afd884b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:03.948745 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-987848e2-5ea1-4539-8de3-d132e2da0472" -d '{"events": [{"server_uuid": "4b89e072-3518-4e8d-b762-d012782a38e9", "name": "network-vif-deleted", "tag": "d7b539c2-9961-474f-b399-13370afd884b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:03.955697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de5b210a-28ec-4d4f-9763-dad6553c5d85 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1a5218e63652479294c22c718c8a13dd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5369849 Dec 21 03:56:03.958916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60022) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:04.030160 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd8d7a67-c671-4e8e-80f1-6ac337f14b9d x-openstack-request-id: req-fd8d7a67-c671-4e8e-80f1-6ac337f14b9d {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:04.030709 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b89e072-3518-4e8d-b762-d012782a38e9", "name": "network-vif-deleted", "tag": "d7b539c2-9961-474f-b399-13370afd884b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:04.031001 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fd8d7a67-c671-4e8e-80f1-6ac337f14b9d {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:04.031417 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b89e072-3518-4e8d-b762-d012782a38e9', 'name': 'network-vif-deleted', 'tag': 'd7b539c2-9961-474f-b399-13370afd884b', 'status': 'completed', 'code': 200} Dec 21 03:56:04.033048 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0932565-32ae-4650-90fa-8f4ce3eefab5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.039877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-662db869-577b-4250-8d96-cc3e89060bbe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.099040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e0932565-32ae-4650-90fa-8f4ce3eefab5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e0193791ec4f41b7a485d3c20c2589a6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6325507 Dec 21 03:56:04.102341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60028) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:04.103598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0932565-32ae-4650-90fa-8f4ce3eefab5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64d92437-b3c1-42ad-8f93-b676bb789b55,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:04.107803 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-662db869-577b-4250-8d96-cc3e89060bbe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.136466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5e31ae7-6fd0-4901-9ffb-f2886a77da47 req-58f9e9ef-5838-4bd0-a0c3-260cf27ea8b2 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 210 time: 0.0775964 Dec 21 03:56:04.228118 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a085a2e5-d593-4323-be86-7e2f5a45f0c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.267083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a085a2e5-d593-4323-be86-7e2f5a45f0c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.267675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-662db869-577b-4250-8d96-cc3e89060bbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.270781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-662db869-577b-4250-8d96-cc3e89060bbe admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.273904 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-662db869-577b-4250-8d96-cc3e89060bbe admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4d683eb8-d28d-4b25-9e02-b46ec33befaa HTTP/1.1" status: 204 len: 168 time: 0.3132484 Dec 21 03:56:04.295731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-662db869-577b-4250-8d96-cc3e89060bbe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d683eb8-d28d-4b25-9e02-b46ec33befaa,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:04.386494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efc25204-385f-4a0f-a555-2b0416f78788 req-62ed7e78-2ffb-4b7a-89b8-25e854018764 tempest-DeleteServersTestJSON-780662058 tempest-DeleteServersTestJSON-780662058-project] 10.222.0.18 "GET /v2.0/ports?device_id=4b89e072-3518-4e8d-b762-d012782a38e9 HTTP/1.1" status: 200 len: 210 time: 0.0489035 Dec 21 03:56:04.524822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a085a2e5-d593-4323-be86-7e2f5a45f0c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.527319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a085a2e5-d593-4323-be86-7e2f5a45f0c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:04.528699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a085a2e5-d593-4323-be86-7e2f5a45f0c1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/64d92437-b3c1-42ad-8f93-b676bb789b55 HTTP/1.1" status: 204 len: 168 time: 0.4231715 Dec 21 03:56:04.546544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a085a2e5-d593-4323-be86-7e2f5a45f0c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64d92437-b3c1-42ad-8f93-b676bb789b55,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:04.960392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e4cfc1-f5d5-4b73-80fc-08480d322f71 req-edbe63d5-2734-4f17-b0a1-f5ca94ca5f2b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:04.969257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12e4cfc1-f5d5-4b73-80fc-08480d322f71 req-edbe63d5-2734-4f17-b0a1-f5ca94ca5f2b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0729392 Dec 21 03:56:05.091377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12e4cfc1-f5d5-4b73-80fc-08480d322f71 req-92a5d1e9-bc73-45e8-86fb-f260e3d57029 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1208990 Dec 21 03:56:05.130113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-f63f0753-1872-4b5f-855f-887c9c56a3b1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:05.132522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-f63f0753-1872-4b5f-855f-887c9c56a3b1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 812 time: 0.1548617 Dec 21 03:56:05.156090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Request body: {'port': {'device_id': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'admin_state_up': True, 'tenant_id': '5aa4830586124e6a8a42b9502b0fc7c2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:05.345018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15ca2a3a-2069-44c0-bcbf-f75d2b8728da req-b9cf97c3-438d-40a6-a3ce-6c80d4074a9e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 210 time: 0.0460758 Dec 21 03:56:05.367548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60068) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:05.385805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f03a3296-31aa-4364-bfdf-ae954a9a420d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.457596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Made reservation on behalf of 5aa4830586124e6a8a42b9502b0fc7c2 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:05.465142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.482832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f03a3296-31aa-4364-bfdf-ae954a9a420d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.574668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f03a3296-31aa-4364-bfdf-ae954a9a420d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.649700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f03a3296-31aa-4364-bfdf-ae954a9a420d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=013df47dbf19441a810c9646aa56a525&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2809100 Dec 21 03:56:05.652416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60084) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:05.658295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Allocated IP 172.20.0.11 (1bfeb879-d5e1-4651-ae97-290a586eba8e/bb3135ec-e693-4805-af80-f05f5d44e73c/47429b75-9803-4e69-b90b-a4c02786130d) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:05.671363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03a3296-31aa-4364-bfdf-ae954a9a420d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33b07a31-b169-4dd2-823b-d45a4c402f11,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:05.732450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8422e1d-f5af-4335-8246-0259a93f90c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.758855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8422e1d-f5af-4335-8246-0259a93f90c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.842268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.877708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8422e1d-f5af-4335-8246-0259a93f90c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.881079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8422e1d-f5af-4335-8246-0259a93f90c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.882973 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a8422e1d-f5af-4335-8246-0259a93f90c1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/33b07a31-b169-4dd2-823b-d45a4c402f11 HTTP/1.1" status: 204 len: 168 time: 0.2291358 Dec 21 03:56:05.986334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:05.996115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8422e1d-f5af-4335-8246-0259a93f90c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33b07a31-b169-4dd2-823b-d45a4c402f11,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:06.049709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-35c86466-1304-4ec7-8a82-76db737ae30b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:06.049884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:06.051286 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-35c86466-1304-4ec7-8a82-76db737ae30b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 812 time: 0.1593683 Dec 21 03:56:06.054129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:06.056590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:06.073606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Request body: {'port': {'device_id': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'admin_state_up': True, 'tenant_id': '5aa4830586124e6a8a42b9502b0fc7c2'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:06.106515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event updated for resources: {'Port': ['ID=47429b75-9803-4e69-b90b-a4c02786130d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:06.190342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:06.193179 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:06.290130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983e7441-472e-4b77-b8fd-40e24c63a577 req-785e5116-8e18-4201-b911-b162b85dd42b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:06.291853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-983e7441-472e-4b77-b8fd-40e24c63a577 req-785e5116-8e18-4201-b911-b162b85dd42b tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0635507 Dec 21 03:56:06.297132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-cdfcd34e-9226-4528-a0b4-c3dca9df1512 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1467900 Dec 21 03:56:06.398572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Request body: {'port': {'device_id': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:06.398756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Made reservation on behalf of 5aa4830586124e6a8a42b9502b0fc7c2 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:06.403367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:06.448375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-983e7441-472e-4b77-b8fd-40e24c63a577 req-cc8ace64-e4e7-44dc-a71c-139fb4a25045 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1454234 Dec 21 03:56:06.491538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:06.786428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Allocated IP 172.20.0.12 (1bfeb879-d5e1-4651-ae97-290a586eba8e/bb3135ec-e693-4805-af80-f05f5d44e73c/d1348383-efeb-4256-b656-d6dd1d710c28) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:06.995820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.053291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f91a8f8-ad63-43b6-acea-1574bfb26b21 req-9a2a7c00-07c8-49ea-85eb-bc0768169921 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 210 time: 0.4829476 Dec 21 03:56:07.109968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d7b539c2-9961-474f-b399-13370afd884b no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:07.114352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.151153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: d7b539c2-9961-474f-b399-13370afd884b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:07.151423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d7b539c2-9961-474f-b399-13370afd884b not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:07.227520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:07.233293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:07.238533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:07.291052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event updated for resources: {'Port': ['ID=d1348383-efeb-4256-b656-d6dd1d710c28,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:07.367825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:07.368024 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.400777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-38fde701-dab3-4344-b5b0-af5b6130796a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:07.402381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-38fde701-dab3-4344-b5b0-af5b6130796a tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.54 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.0764718 Dec 21 03:56:07.404179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 47429b75-9803-4e69-b90b-a4c02786130d {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:07.424389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.495858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Transition to ACTIVE for port object 47429b75-9803-4e69-b90b-a4c02786130d will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:56:07.498363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-43d08bcc-9ab6-4766-b2c4-5b75d4c4a9ad tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4296935 Dec 21 03:56:07.526983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Request body: {'port': {'device_id': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:07.572237 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.624932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Deleting port 06503167-02c9-4376-803a-36730accf460 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:07.625525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.678713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:07.760658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Pushing event updated for resources: {'Port': ['ID=47429b75-9803-4e69-b90b-a4c02786130d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:07.858505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3267635-fa0b-4cc7-81af-b3e3a3bf674f req-3b69cb58-d5dd-4af1-9ac4-8a287dd0a403 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:07.865847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3267635-fa0b-4cc7-81af-b3e3a3bf674f req-3b69cb58-d5dd-4af1-9ac4-8a287dd0a403 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 945 time: 0.1732991 Dec 21 03:56:07.916527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Attempting to bind port 47429b75-9803-4e69-b90b-a4c02786130d on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:07.916898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Attempting to bind port 47429b75-9803-4e69-b90b-a4c02786130d by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:07.917227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Attempting to bind port 47429b75-9803-4e69-b90b-a4c02786130d on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:07.931847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Port 47429b75-9803-4e69-b90b-a4c02786130d on network 1bfeb879-d5e1-4651-ae97-290a586eba8e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:56:07.931847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Attempting to bind port 47429b75-9803-4e69-b90b-a4c02786130d on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:07.952088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3267635-fa0b-4cc7-81af-b3e3a3bf674f req-11b7998e-5c09-48b6-93d7-8fa236d204b9 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847447 Dec 21 03:56:07.962318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:07.963384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Checking segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:07.965788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Bound using segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:07.966901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Bound port: 47429b75-9803-4e69-b90b-a4c02786130d, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:07.967747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.054651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] For port 47429b75-9803-4e69-b90b-a4c02786130d, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:08.057917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] For port 06503167-02c9-4376-803a-36730accf460, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=06503167-02c9-4376-803a-36730accf460,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:08.058436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.059633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] For port 47429b75-9803-4e69-b90b-a4c02786130d, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47429b75-9803-4e69-b90b-a4c02786130d,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:08.111388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Calling delete_port for 06503167-02c9-4376-803a-36730accf460 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:08.154073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.235783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:08.236651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.238347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] 10.222.0.54 "PUT /v2.0/ports/47429b75-9803-4e69-b90b-a4c02786130d HTTP/1.1" status: 200 len: 1093 time: 1.8445730 Dec 21 03:56:08.242155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'tag': '47429b75-9803-4e69-b90b-a4c02786130d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:08.242556 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac969354-e53b-46ac-b571-69913ed75443" -d '{"events": [{"name": "network-changed", "server_uuid": "9eee2b26-fb4b-4dc0-b932-c6b857957ad7", "tag": "47429b75-9803-4e69-b90b-a4c02786130d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:08.305245 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-881e2898-df72-49ef-b438-61e485bd9b8b x-openstack-request-id: req-881e2898-df72-49ef-b438-61e485bd9b8b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:08.305530 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9eee2b26-fb4b-4dc0-b932-c6b857957ad7", "tag": "47429b75-9803-4e69-b90b-a4c02786130d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:08.305791 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-881e2898-df72-49ef-b438-61e485bd9b8b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:08.306198 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'tag': '47429b75-9803-4e69-b90b-a4c02786130d', 'status': 'completed', 'code': 200} Dec 21 03:56:08.312893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065963e3-b40e-46a5-9bc8-55dd3633110e service neutron] Pushing event updated for resources: {'Port': ['ID=47429b75-9803-4e69-b90b-a4c02786130d,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:08.348030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b7a22f-a3f5-4aec-916d-579394da0306 req-c2c6520b-6eb2-4976-8428-6e0877c74d8c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:08.361314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30b7a22f-a3f5-4aec-916d-579394da0306 req-c2c6520b-6eb2-4976-8428-6e0877c74d8c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 932 time: 0.1377041 Dec 21 03:56:08.436350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d1348383-efeb-4256-b656-d6dd1d710c28 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:08.454366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30b7a22f-a3f5-4aec-916d-579394da0306 req-76ba6cfb-3d8f-416a-9ec8-7c21704f477a tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955868 Dec 21 03:56:08.458568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac969354-e53b-46ac-b571-69913ed75443 req-eb1560b8-bb59-4cf2-aa92-f03bd645cda1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:08.460261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.460434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac969354-e53b-46ac-b571-69913ed75443 req-eb1560b8-bb59-4cf2-aa92-f03bd645cda1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=9eee2b26-fb4b-4dc0-b932-c6b857957ad7 HTTP/1.1" status: 200 len: 1096 time: 0.0998073 Dec 21 03:56:08.478700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Transition to ACTIVE for port object d1348383-efeb-4256-b656-d6dd1d710c28 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:56:08.501790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.535145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['06503167-02c9-4376-803a-36730accf460'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:08.539281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:08.543190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Pushing event deleted for resources: {'Port': ['ID=06503167-02c9-4376-803a-36730accf460,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:08.574118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.637166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] No DVR routers for this DVR port 06503167-02c9-4376-803a-36730accf460 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:08.643876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.648467 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b649c41d-0235-4549-a7ed-20a33c5ea8c6 req-c7bd75f6-281f-4379-9cdc-da2f9aa39dea tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.54 "DELETE /v2.0/ports/06503167-02c9-4376-803a-36730accf460 HTTP/1.1" status: 204 len: 173 time: 1.2374296 Dec 21 03:56:08.654404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75442211-1ded-4d5a-8085-f754879d03c7', 'name': 'network-vif-deleted', 'tag': '06503167-02c9-4376-803a-36730accf460'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:08.658321 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4505429c-9467-484d-8c50-9efddb48bd13" -d '{"events": [{"server_uuid": "75442211-1ded-4d5a-8085-f754879d03c7", "name": "network-vif-deleted", "tag": "06503167-02c9-4376-803a-36730accf460"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:08.661458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac969354-e53b-46ac-b571-69913ed75443 req-4a148a80-47a1-41cc-b25a-01eaf5624a63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:08.666599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac969354-e53b-46ac-b571-69913ed75443 req-4a148a80-47a1-41cc-b25a-01eaf5624a63 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1896751 Dec 21 03:56:08.711131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Pushing event updated for resources: {'Port': ['ID=d1348383-efeb-4256-b656-d6dd1d710c28,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:08.783776 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c4fcf31-f360-40ea-b473-d2f5afb9cb9b x-openstack-request-id: req-6c4fcf31-f360-40ea-b473-d2f5afb9cb9b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:08.784074 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75442211-1ded-4d5a-8085-f754879d03c7", "name": "network-vif-deleted", "tag": "06503167-02c9-4376-803a-36730accf460", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:08.784335 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6c4fcf31-f360-40ea-b473-d2f5afb9cb9b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:08.784874 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75442211-1ded-4d5a-8085-f754879d03c7', 'name': 'network-vif-deleted', 'tag': '06503167-02c9-4376-803a-36730accf460', 'status': 'completed', 'code': 200} Dec 21 03:56:08.868052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Attempting to bind port d1348383-efeb-4256-b656-d6dd1d710c28 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:08.870085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Attempting to bind port d1348383-efeb-4256-b656-d6dd1d710c28 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:08.870490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Attempting to bind port d1348383-efeb-4256-b656-d6dd1d710c28 on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:08.876213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac969354-e53b-46ac-b571-69913ed75443 req-651d0d44-eafe-4bfd-b915-ce1fcc575a3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:08.880118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Port d1348383-efeb-4256-b656-d6dd1d710c28 on network 1bfeb879-d5e1-4651-ae97-290a586eba8e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:56:08.884646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac969354-e53b-46ac-b571-69913ed75443 req-651d0d44-eafe-4bfd-b915-ce1fcc575a3a service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2032187 Dec 21 03:56:08.884779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Attempting to bind port d1348383-efeb-4256-b656-d6dd1d710c28 on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:08.886508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:08.887200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Checking segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:08.887674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Bound using segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:08.888146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Bound port: d1348383-efeb-4256-b656-d6dd1d710c28, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:08.888660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:08.998072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] For port d1348383-efeb-4256-b656-d6dd1d710c28, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:09.003209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] For port d1348383-efeb-4256-b656-d6dd1d710c28, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d1348383-efeb-4256-b656-d6dd1d710c28,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:09.022043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-9fc6b850-cd8b-4b88-b4ef-b3ab993de3b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:09.025165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-9fc6b850-cd8b-4b88-b4ef-b3ab993de3b1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=9eee2b26-fb4b-4dc0-b932-c6b857957ad7 HTTP/1.1" status: 200 len: 1096 time: 0.0574958 Dec 21 03:56:09.094505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:09.112222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-4db53259-b9a4-486b-b892-67d5adaaf590 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=47429b75-9803-4e69-b90b-a4c02786130d HTTP/1.1" status: 200 len: 217 time: 0.0712135 Dec 21 03:56:09.146307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:09.147291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:09.149002 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] 10.222.0.54 "PUT /v2.0/ports/d1348383-efeb-4256-b656-d6dd1d710c28 HTTP/1.1" status: 200 len: 1093 time: 1.6352582 Dec 21 03:56:09.184469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ab84d3c-7580-463a-8987-805199514f93 req-6de0d597-aa97-4c51-b91b-cf3b51fb4ad2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=75442211-1ded-4d5a-8085-f754879d03c7 HTTP/1.1" status: 200 len: 210 time: 0.0708444 Dec 21 03:56:09.199658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b18e2f-c087-4fe8-8391-ab5701385b62 service neutron] Pushing event updated for resources: {'Port': ['ID=d1348383-efeb-4256-b656-d6dd1d710c28,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:09.216241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-65505cf8-dcf4-485c-a51c-7b0e0677c589 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:09.219095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-65505cf8-dcf4-485c-a51c-7b0e0677c589 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 200 len: 852 time: 0.0812054 Dec 21 03:56:09.270287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-ec55797e-f521-4585-8a36-d16308a6940a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1bfeb879-d5e1-4651-ae97-290a586eba8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0375910 Dec 21 03:56:09.388955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-a7a35864-8444-414c-8dbd-f0ae5c61db49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:09.390817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-a7a35864-8444-414c-8dbd-f0ae5c61db49 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 1096 time: 0.0716252 Dec 21 03:56:09.431029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-212468e9-0358-4702-8904-fc4259e1f97d service neutron] 10.222.0.54 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517873 Dec 21 03:56:09.475266 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-84671559-18bb-4a99-be17-b49f8d637ed7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d1348383-efeb-4256-b656-d6dd1d710c28 HTTP/1.1" status: 200 len: 217 time: 0.0674140 Dec 21 03:56:09.613466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7063c5c-899a-4b51-8106-1393e458b644 req-34828bef-1967-4d05-9c5f-2363dcb82c4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:09.621636 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-34828bef-1967-4d05-9c5f-2363dcb82c4b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 200 len: 852 time: 0.1179416 Dec 21 03:56:09.656218 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-8072f0ae-61a2-4afa-9e18-6fce6acdc2e3 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1bfeb879-d5e1-4651-ae97-290a586eba8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271513 Dec 21 03:56:09.680112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-ad934dbd-0316-44a7-b8b3-eb751cf6dd64 service neutron] 10.222.0.54 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2290370 Dec 21 03:56:09.716358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4ddc8f-e819-4f2e-b1a6-a3e2c137821b req-d6697e28-9682-4b4e-99ef-6370b9411884 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:09.725006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c4ddc8f-e819-4f2e-b1a6-a3e2c137821b req-d6697e28-9682-4b4e-99ef-6370b9411884 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 944 time: 0.1024227 Dec 21 03:56:09.782489 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-40669887-1df0-4c51-a111-9b605e6a95e5 service neutron] 10.222.0.54 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1178253 Dec 21 03:56:09.790306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c4ddc8f-e819-4f2e-b1a6-a3e2c137821b req-4bd471da-5aff-4f74-a8e3-171d9f66081e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643299 Dec 21 03:56:09.915335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7063c5c-899a-4b51-8106-1393e458b644 req-0d74efc0-f9e0-4d6b-a552-efad38800814 service neutron] 10.222.0.54 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237822 Dec 21 03:56:10.069725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60244) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:10.242888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21b72da8-05ba-4548-9cf4-e16fdf73ac2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.322487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21b72da8-05ba-4548-9cf4-e16fdf73ac2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.432848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21b72da8-05ba-4548-9cf4-e16fdf73ac2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.477806 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21b72da8-05ba-4548-9cf4-e16fdf73ac2f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d0fe13043d8747a39cda03f0ffc3dcdd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4067714 Dec 21 03:56:10.479347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b72da8-05ba-4548-9cf4-e16fdf73ac2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2615ad23-66b3-4a38-ac35-1ad65afd96ba,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:10.487115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60270) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:10.547492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3a89d314-b3ed-4997-8537-794038ecebe4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.570322 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3a89d314-b3ed-4997-8537-794038ecebe4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.762522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3a89d314-b3ed-4997-8537-794038ecebe4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.765532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3a89d314-b3ed-4997-8537-794038ecebe4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:10.769111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3a89d314-b3ed-4997-8537-794038ecebe4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2615ad23-66b3-4a38-ac35-1ad65afd96ba HTTP/1.1" status: 204 len: 168 time: 0.2789767 Dec 21 03:56:10.786500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'tag': 'd1348383-efeb-4256-b656-d6dd1d710c28'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:10.790606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a89d314-b3ed-4997-8537-794038ecebe4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2615ad23-66b3-4a38-ac35-1ad65afd96ba,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:10.791107 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-555de010-4af1-4626-9e77-5c717a76cb8b" -d '{"events": [{"name": "network-changed", "server_uuid": "b10a139b-2939-4b09-90cf-e3dc8e628bb2", "tag": "d1348383-efeb-4256-b656-d6dd1d710c28"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:10.867869 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85d705ee-0939-453c-878f-48a663bc4131 x-openstack-request-id: req-85d705ee-0939-453c-878f-48a663bc4131 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:10.868344 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b10a139b-2939-4b09-90cf-e3dc8e628bb2", "tag": "d1348383-efeb-4256-b656-d6dd1d710c28", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:10.868779 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-85d705ee-0939-453c-878f-48a663bc4131 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:10.869504 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'tag': 'd1348383-efeb-4256-b656-d6dd1d710c28', 'status': 'completed', 'code': 200} Dec 21 03:56:10.911212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172c085b-3134-48a2-8c75-09c26532b0ec req-dd2b7749-6618-44d3-b65d-12ad666363d4 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:10.919354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-172c085b-3134-48a2-8c75-09c26532b0ec req-dd2b7749-6618-44d3-b65d-12ad666363d4 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0787065 Dec 21 03:56:11.008856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555de010-4af1-4626-9e77-5c717a76cb8b req-a43600a1-f41f-4aa5-8adb-bb297b143de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:11.011097 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-a43600a1-f41f-4aa5-8adb-bb297b143de3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 1096 time: 0.0952692 Dec 21 03:56:11.043874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-172c085b-3134-48a2-8c75-09c26532b0ec req-2659a151-1300-4f9f-8b0f-5f4115f59b42 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214743 Dec 21 03:56:11.102527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067dc875-d50c-4b07-8cf3-f43ff49d6ef7 req-75d6f66f-23ca-4d22-98ce-aad679993d98 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:11.114358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-067dc875-d50c-4b07-8cf3-f43ff49d6ef7 req-75d6f66f-23ca-4d22-98ce-aad679993d98 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 944 time: 0.1595037 Dec 21 03:56:11.133633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555de010-4af1-4626-9e77-5c717a76cb8b req-3d26e97a-ee1b-459b-afe9-0fc0cbe7ba05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:11.135945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-3d26e97a-ee1b-459b-afe9-0fc0cbe7ba05 service neutron] 10.222.0.54 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 913 time: 0.1149335 Dec 21 03:56:11.193061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-fb5c83fa-0068-4d3e-aef8-d8726ccd7b32 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d1348383-efeb-4256-b656-d6dd1d710c28 HTTP/1.1" status: 200 len: 217 time: 0.0485561 Dec 21 03:56:11.198321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-067dc875-d50c-4b07-8cf3-f43ff49d6ef7 req-f4d5c2c8-064b-4144-8781-4e3985712db3 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830562 Dec 21 03:56:11.253606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555de010-4af1-4626-9e77-5c717a76cb8b req-893fc48b-011f-4e82-b7c4-531c7aa4105b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:11.255218 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-893fc48b-011f-4e82-b7c4-531c7aa4105b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 200 len: 852 time: 0.0542436 Dec 21 03:56:11.293837 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-d63a319f-eec0-4caf-b815-4fc3aa7c828c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1bfeb879-d5e1-4651-ae97-290a586eba8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309482 Dec 21 03:56:11.487967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-5a998b6b-3af2-482a-917f-8e918877c065 service neutron] 10.222.0.54 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1844668 Dec 21 03:56:11.507345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d1348383-efeb-4256-b656-d6dd1d710c28 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:56:11.519319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 06503167-02c9-4376-803a-36730accf460 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:11.551661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 06503167-02c9-4376-803a-36730accf460 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:11.552080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 06503167-02c9-4376-803a-36730accf460 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:11.666557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d1348383-efeb-4256-b656-d6dd1d710c28, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d1348383-efeb-4256-b656-d6dd1d710c28,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:11.683979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'd1348383-efeb-4256-b656-d6dd1d710c28', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'port_id': 'd1348383-efeb-4256-b656-d6dd1d710c28', 'mac_address': 'fa:16:3e:77:4a:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bb3135ec-e693-4805-af80-f05f5d44e73c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:56:11.736892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:11.749156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60314) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:11.757059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d1348383-efeb-4256-b656-d6dd1d710c28 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:11.782726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d1348383-efeb-4256-b656-d6dd1d710c28, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d1348383-efeb-4256-b656-d6dd1d710c28,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:11.801955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Deleting subnet 0937a3b1-7f54-409b-bba0-29fa72617a82 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:56:11.812544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:11.812544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60316) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:11.849014 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f885c1e-4fb4-4d47-9b87-77248a3a75a3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:11.861783 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:11.862474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47429b75-9803-4e69-b90b-a4c02786130d details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:56:11.883793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:11.922583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d1348383-efeb-4256-b656-d6dd1d710c28,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:11.954539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 47429b75-9803-4e69-b90b-a4c02786130d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47429b75-9803-4e69-b90b-a4c02786130d,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:11.975965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '47429b75-9803-4e69-b90b-a4c02786130d', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'port_id': '47429b75-9803-4e69-b90b-a4c02786130d', 'mac_address': 'fa:16:3e:37:6f:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bb3135ec-e693-4805-af80-f05f5d44e73c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:56:12.021686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.036261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 47429b75-9803-4e69-b90b-a4c02786130d {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:12.043351 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-555de010-4af1-4626-9e77-5c717a76cb8b req-d1c6f1c3-b182-4696-a742-badbb8713a53 service neutron] 10.222.0.54 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5467544 Dec 21 03:56:12.049231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f885c1e-4fb4-4d47-9b87-77248a3a75a3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.053997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.065004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 47429b75-9803-4e69-b90b-a4c02786130d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47429b75-9803-4e69-b90b-a4c02786130d,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:12.130522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f885c1e-4fb4-4d47-9b87-77248a3a75a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.141310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.204884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=47429b75-9803-4e69-b90b-a4c02786130d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:12.217900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f885c1e-4fb4-4d47-9b87-77248a3a75a3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9ee67ded496c4932812887a216da28c0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4060137 Dec 21 03:56:12.218726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f885c1e-4fb4-4d47-9b87-77248a3a75a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15f0d755-158f-481a-94e2-b29399d5231a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:12.220340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60328) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:12.240333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.298292 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8efc82a-4c94-44d7-aec4-6d896572d184 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.310913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0937a3b1-7f54-409b-bba0-29fa72617a82,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:12.316604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.322293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c686fa50-5479-48ef-b27e-0da5a76f8ae4 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/0937a3b1-7f54-409b-bba0-29fa72617a82 HTTP/1.1" status: 204 len: 168 time: 0.5691488 Dec 21 03:56:12.324280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60336) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:12.325803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9f58138-6cd9-4028-817c-55778ad3c966 None None] Network a0e5eeee-a736-4bd3-bdf6-679e8da99022 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:12.332221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f441c6e2-35bf-4ab3-a9e4-e5778764ed6b req-98ff20f2-0fe5-44b0-82b3-ea9bc58214ed tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:12.335262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f441c6e2-35bf-4ab3-a9e4-e5778764ed6b req-98ff20f2-0fe5-44b0-82b3-ea9bc58214ed tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.2143123 Dec 21 03:56:12.400292 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8efc82a-4c94-44d7-aec4-6d896572d184 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.473980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.492293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f441c6e2-35bf-4ab3-a9e4-e5778764ed6b req-498fb7a7-37bc-4ac8-a662-2dc6831cfe25 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1481781 Dec 21 03:56:12.512576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568d534e-fccb-4fc5-baa2-99e02933737c req-8e347f0d-0f1e-49cf-9941-62b4bd7941a6 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:12.521328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-568d534e-fccb-4fc5-baa2-99e02933737c req-8e347f0d-0f1e-49cf-9941-62b4bd7941a6 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 945 time: 0.1242211 Dec 21 03:56:12.635558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-568d534e-fccb-4fc5-baa2-99e02933737c req-3de202cc-df0e-4fab-a3ed-2de57d35cbdd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124518 Dec 21 03:56:12.662161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['47429b75-9803-4e69-b90b-a4c02786130d'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:12.667249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.667249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8efc82a-4c94-44d7-aec4-6d896572d184 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.669148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8efc82a-4c94-44d7-aec4-6d896572d184 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.670274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8efc82a-4c94-44d7-aec4-6d896572d184 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/15f0d755-158f-481a-94e2-b29399d5231a HTTP/1.1" status: 204 len: 168 time: 0.4486985 Dec 21 03:56:12.701984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8efc82a-4c94-44d7-aec4-6d896572d184 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15f0d755-158f-481a-94e2-b29399d5231a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:12.703204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d1348383-efeb-4256-b656-d6dd1d710c28'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:12.708000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a0e5eeee-a736-4bd3-bdf6-679e8da99022']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:12.715938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53a852ad-566d-4319-a94b-1ed42d2c74a6 None None] DHCP port deletion for a0e5eeee-a736-4bd3-bdf6-679e8da99022 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:12.741661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fafae862-c9cf-4d93-83f4-6f5447ca2985') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:12.741971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fafae862-c9cf-4d93-83f4-6f5447ca2985') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:12.776116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.804454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.817366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:56:12.821096 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:56:12.996723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:13.002012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:13.007841 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] 10.222.0.18 "DELETE /v2.0/networks/a0e5eeee-a736-4bd3-bdf6-679e8da99022 HTTP/1.1" status: 204 len: 168 time: 0.6824098 Dec 21 03:56:13.018330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ceb21d-d7db-4711-aab6-40bc99f369e1 admin admin] Pushing event deleted for resources: {'Network': ['ID=a0e5eeee-a736-4bd3-bdf6-679e8da99022,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:13.464711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60368) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:13.510974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60372) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:13.512327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b68c8ba-511f-468f-9bdb-9cd594cb5d40 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=cb6e434168cc48daa3e991310cb6da73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0453749 Dec 21 03:56:13.622572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6966d203-591c-43be-bdcd-cd595bb3d99d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:13.648654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6966d203-591c-43be-bdcd-cd595bb3d99d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:13.675300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f0d26c-071c-4acb-8cff-168b48114e85 req-247fe249-0fa1-475b-be67-f810f94b246f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:13.676830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4f0d26c-071c-4acb-8cff-168b48114e85 req-247fe249-0fa1-475b-be67-f810f94b246f tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1174948 Dec 21 03:56:13.734885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4f0d26c-071c-4acb-8cff-168b48114e85 req-2de1d0a0-76c1-40bf-a298-f673686eb826 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518603 Dec 21 03:56:13.830554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6966d203-591c-43be-bdcd-cd595bb3d99d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:13.835456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6966d203-591c-43be-bdcd-cd595bb3d99d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:13.837620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6966d203-591c-43be-bdcd-cd595bb3d99d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b078e631-a51a-4efd-887f-6f8872cf6b3b HTTP/1.1" status: 204 len: 168 time: 0.3247979 Dec 21 03:56:13.850608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:13.854490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6966d203-591c-43be-bdcd-cd595bb3d99d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b078e631-a51a-4efd-887f-6f8872cf6b3b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:13.887586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0dc236d-65ba-4b64-ac73-371f3e4db159 req-0cd8b399-a5ab-4449-99da-5fc8973ca467 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:13.889598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0dc236d-65ba-4b64-ac73-371f3e4db159 req-0cd8b399-a5ab-4449-99da-5fc8973ca467 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 945 time: 0.1019049 Dec 21 03:56:13.944884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0dc236d-65ba-4b64-ac73-371f3e4db159 req-23390fee-514d-43e1-9237-61bced36920c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447218 Dec 21 03:56:14.071857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bb47277-9760-43ad-b747-2270e913f8b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.156593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bb47277-9760-43ad-b747-2270e913f8b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.230874 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bb47277-9760-43ad-b747-2270e913f8b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.285159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb47277-9760-43ad-b747-2270e913f8b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f09c617-75cf-44b5-b08d-030e474387a4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:14.290243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1bb47277-9760-43ad-b747-2270e913f8b7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e27eab155d4147c69b66efd9a7a02d4e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4384725 Dec 21 03:56:14.293184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60408) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:14.374121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53878eb9-a13d-4ec9-8d9a-27c059ad4711 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.401561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53878eb9-a13d-4ec9-8d9a-27c059ad4711 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.456847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60414) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:14.530298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53878eb9-a13d-4ec9-8d9a-27c059ad4711 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.533310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53878eb9-a13d-4ec9-8d9a-27c059ad4711 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.534488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-53878eb9-a13d-4ec9-8d9a-27c059ad4711 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4f09c617-75cf-44b5-b08d-030e474387a4 HTTP/1.1" status: 204 len: 168 time: 0.2403028 Dec 21 03:56:14.546260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53878eb9-a13d-4ec9-8d9a-27c059ad4711 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f09c617-75cf-44b5-b08d-030e474387a4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:14.622446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Request body: {'network': {'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-network', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:14.699130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Made reservation on behalf of c5b2145a02404e39a8488c84d609fc52 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:14.701418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.711007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.796635 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.868364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bff746-c379-4231-826a-0bcc95381e4f req-3de05725-b91c-4176-bf7c-19d8a42011c2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:14.875102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10bff746-c379-4231-826a-0bcc95381e4f req-3de05725-b91c-4176-bf7c-19d8a42011c2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.0604968 Dec 21 03:56:14.891056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.927678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:56:14.946907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d85886a8-64d0-487b-9d1a-304a22c93857,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:14.952642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:14.952983 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Added segment aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461 of type vlan for network 45ff9d95-f609-4ed5-9517-1125b7d4496f Dec 21 03:56:14.957624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10bff746-c379-4231-826a-0bcc95381e4f req-0ce6be81-534c-4489-9a5b-5738075d3e13 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816853 Dec 21 03:56:15.002027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.052290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:15.077152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2237a5-3997-4c43-b105-8cde5ab1685f req-2caadb90-8294-42a3-9f3b-5d15e05fc044 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:15.078732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec2237a5-3997-4c43-b105-8cde5ab1685f req-2caadb90-8294-42a3-9f3b-5d15e05fc044 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 945 time: 0.0541232 Dec 21 03:56:15.130538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.130538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:15.130538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.164618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest_v242-663268317-network', 'tenant_id': '2e28414564544bb283304990bb7b8542'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:15.174794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec2237a5-3997-4c43-b105-8cde5ab1685f req-a3d80adf-66c3-4c3c-90b2-e0e37c73356c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871243 Dec 21 03:56:15.177701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60440) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:15.196106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12381adf-539f-4127-bdd9-94d828f38b30 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.213764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] Pushing event updated for resources: {'Network': ['ID=45ff9d95-f609-4ed5-9517-1125b7d4496f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:15.224715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:56:15.250019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e4e239c3-e007-4acb-93ec-0ad58ff7f8d0 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7920609 Dec 21 03:56:15.252855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60442) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:15.258320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Request body: {'subnet': {'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-subnet', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:15.272410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12381adf-539f-4127-bdd9-94d828f38b30 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.344899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:15.347648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.359992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.390987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12381adf-539f-4127-bdd9-94d828f38b30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.433536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Made reservation on behalf of c5b2145a02404e39a8488c84d609fc52 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:15.436594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.446775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12381adf-539f-4127-bdd9-94d828f38b30 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e78e88eb1f8343aca467abb775573527&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2672625 Dec 21 03:56:15.449953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60454) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:15.463097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12381adf-539f-4127-bdd9-94d828f38b30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48a91a51-ea75-41a8-b9aa-b5dac5960832,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:15.528593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47429b75-9803-4e69-b90b-a4c02786130d up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:15.530211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.543058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10000663-cdb2-4779-b48a-c8f918d23659 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.570963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10000663-cdb2-4779-b48a-c8f918d23659 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.609518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.640319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:56:15.651099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccd453dc-aa16-4aa6-836a-b6ef27489378,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:15.701515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 47429b75-9803-4e69-b90b-a4c02786130d completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:56:15.705835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 47429b75-9803-4e69-b90b-a4c02786130d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:15.706209 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.730401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.738370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.738719 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Added segment 127c42f2-9c42-4f96-a788-402d23fe8d05 of type vlan for network 4915ee69-a87c-4f15-b553-d1750c9a5a88 Dec 21 03:56:15.740131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10000663-cdb2-4779-b48a-c8f918d23659 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.742953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10000663-cdb2-4779-b48a-c8f918d23659 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.744301 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10000663-cdb2-4779-b48a-c8f918d23659 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/48a91a51-ea75-41a8-b9aa-b5dac5960832 HTTP/1.1" status: 204 len: 168 time: 0.2934389 Dec 21 03:56:15.783992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10000663-cdb2-4779-b48a-c8f918d23659 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48a91a51-ea75-41a8-b9aa-b5dac5960832,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:15.809330 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.831878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.854803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dcd56809-69ac-49ac-96ed-ba3b364103dd,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:15.859956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47429b75-9803-4e69-b90b-a4c02786130d'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:15.862435 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-21341ea9-78ba-4d56-a858-9f89904b45d0" -d '{"events": [{"server_uuid": "9eee2b26-fb4b-4dc0-b932-c6b857957ad7", "name": "network-vif-plugged", "status": "completed", "tag": "47429b75-9803-4e69-b90b-a4c02786130d"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:15.868594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Checking segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:15.868594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Network hostable DHCP agents. Network: 45ff9d95-f609-4ed5-9517-1125b7d4496f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:56:15.878851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 47429b75-9803-4e69-b90b-a4c02786130d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47429b75-9803-4e69-b90b-a4c02786130d,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:15.912072 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4f034a3-02ab-4907-9f4b-d342a9f3a5af x-openstack-request-id: req-a4f034a3-02ab-4907-9f4b-d342a9f3a5af {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:15.912421 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9eee2b26-fb4b-4dc0-b932-c6b857957ad7", "name": "network-vif-plugged", "status": "completed", "tag": "47429b75-9803-4e69-b90b-a4c02786130d", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:15.912734 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a4f034a3-02ab-4907-9f4b-d342a9f3a5af {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:15.913134 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47429b75-9803-4e69-b90b-a4c02786130d', 'code': 200} Dec 21 03:56:15.953077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.954384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d1348383-efeb-4256-b656-d6dd1d710c28 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:15.988846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:56:15.995312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:15.995312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:15.995312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.056737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=47429b75-9803-4e69-b90b-a4c02786130d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:16.099552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 45ff9d95-f609-4ed5-9517-1125b7d4496f) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:16.104838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.105873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.119652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2a9f8ab-338a-4174-a0f6-bfd283d383be None None] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:16.132226 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.0782232 Dec 21 03:56:16.133038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:16.135785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500ee94f-decb-400d-96a8-0e6b617f7b62 admin admin] Pushing event updated for resources: {'Network': ['ID=4915ee69-a87c-4f15-b553-d1750c9a5a88,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:16.140615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Request body: {'subnet': {'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-subnet', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:16.144220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aeeaebe-7353-4159-b56a-eb34b59b3170 req-3ad78831-398a-4ffb-823d-6ca102258073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.151472 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4aeeaebe-7353-4159-b56a-eb34b59b3170 req-3ad78831-398a-4ffb-823d-6ca102258073 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9eee2b26-fb4b-4dc0-b932-c6b857957ad7 HTTP/1.1" status: 200 len: 1098 time: 0.1368561 Dec 21 03:56:16.157677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:56:16.161546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f924123-1841-4387-8a4b-650f9f6f51d5 req-a60a886a-6427-480e-9791-f7ec82ea98e0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.163878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f924123-1841-4387-8a4b-650f9f6f51d5 req-a60a886a-6427-480e-9791-f7ec82ea98e0 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1050529 Dec 21 03:56:16.171322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port d1348383-efeb-4256-b656-d6dd1d710c28 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:56:16.199354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ffaad46f-09fd-4121-9bd7-1608038be092 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9428685 Dec 21 03:56:16.202969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60494) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:16.210312 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4aeeaebe-7353-4159-b56a-eb34b59b3170 req-489f8c4b-eb57-48fe-8ca9-2563761fa2d9 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430813 Dec 21 03:56:16.210734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Request body: {'router': {'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:16.264052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port d1348383-efeb-4256-b656-d6dd1d710c28 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:16.264782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.278415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f924123-1841-4387-8a4b-650f9f6f51d5 req-22e754ed-0307-4305-8f94-9cf0ee1d8a50 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1080811 Dec 21 03:56:16.311335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.312563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.419340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:16.421704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.435109 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.438137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-45ff9d95-f609-4ed5-9517-1125b7d4496f', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:56:16.440040 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.455944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.527512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32604263-2558-42ec-ba62-5450cff71dd4 req-e249b91c-d152-4abc-a474-5eae8e54a02e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.534892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32604263-2558-42ec-ba62-5450cff71dd4 req-e249b91c-d152-4abc-a474-5eae8e54a02e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 945 time: 0.1474164 Dec 21 03:56:16.540692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d1348383-efeb-4256-b656-d6dd1d710c28, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d1348383-efeb-4256-b656-d6dd1d710c28,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:16.634049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Allocated IP 172.20.0.2 (45ff9d95-f609-4ed5-9517-1125b7d4496f/dcd56809-69ac-49ac-96ed-ba3b364103dd/b32cc5c5-5bb2-453a-9579-862bddcf93cf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:16.645189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.757678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32604263-2558-42ec-ba62-5450cff71dd4 req-c8402850-1a51-48a5-a35f-811980265774 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2161722 Dec 21 03:56:16.765036 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.782313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d1348383-efeb-4256-b656-d6dd1d710c28,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:16.871292 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.962662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:16.967134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.973353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.979937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.986032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.992189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:16.998259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.004570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.006574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-c141a990-1594-470d-a2d0-b72068664cb7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.1623662 Dec 21 03:56:17.011914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.024555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-3baf66d7-42d3-4d0b-b9f7-13543ae3ad91 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.025674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-3baf66d7-42d3-4d0b-b9f7-13543ae3ad91 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.31 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1413634 Dec 21 03:56:17.038399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:17.041397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:17.055532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:17.063575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Pushing event updated for resources: {'Port': ['ID=b32cc5c5-5bb2-453a-9579-862bddcf93cf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:17.127446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Attempting to bind port b32cc5c5-5bb2-453a-9579-862bddcf93cf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:17.128078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Attempting to bind port b32cc5c5-5bb2-453a-9579-862bddcf93cf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:17.128817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Attempting to bind port b32cc5c5-5bb2-453a-9579-862bddcf93cf on network 45ff9d95-f609-4ed5-9517-1125b7d4496f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:17.135757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:17.137252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Checking segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:17.138369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.139317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Bound using segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:17.139984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Bound port: b32cc5c5-5bb2-453a-9579-862bddcf93cf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:17.140549 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.169859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Pushing event updated for resources: {'Subnet': ['ID=35ca07d8-d162-4205-9aec-69a6c9b94f03,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:17.249556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] For port b32cc5c5-5bb2-453a-9579-862bddcf93cf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:17.256020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] For port b32cc5c5-5bb2-453a-9579-862bddcf93cf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b32cc5c5-5bb2-453a-9579-862bddcf93cf,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:17.263711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c42b4ae-7821-44ce-ab39-4430670e0581 req-ca5e96a2-8a13-4a4f-addc-63a5b9eb80d7 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2068775 Dec 21 03:56:17.268626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Checking segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:17.268626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Network hostable DHCP agents. Network: 4915ee69-a87c-4f15-b553-d1750c9a5a88, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:56:17.329122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Deleting port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:17.329364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.357079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.417924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:56:17.457408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d09f30c-889d-4ad1-bf6f-e0c4280ee36f None None] Pushing event updated for resources: {'Port': ['ID=b32cc5c5-5bb2-453a-9579-862bddcf93cf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:17.585559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4915ee69-a87c-4f15-b553-d1750c9a5a88) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:17.594327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-936ef898-6f8b-425c-a931-eb9174c59ae2 None None] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:17.611590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70de8b72-20fa-4175-a074-bb6bc23d7d34 req-30d0d85b-93b7-418d-9658-a6c8e10f37b2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.611786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70de8b72-20fa-4175-a074-bb6bc23d7d34 req-30d0d85b-93b7-418d-9658-a6c8e10f37b2 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 945 time: 0.1913748 Dec 21 03:56:17.619027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.619598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.652591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] For port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:17.652918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.664220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.739360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.754870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.774865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.782845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.790876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.800476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.808302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:17.810231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccc43fc0-1f38-4f69-bc0b-16fec8a1b2d9 req-59aa49da-9143-4d89-a3a7-817d7f0f7575 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.3177540 Dec 21 03:56:17.811950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Calling delete_port for 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:17.841529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4915ee69-a87c-4f15-b553-d1750c9a5a88', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'project_id': '2e28414564544bb283304990bb7b8542', 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:56:17.842549 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.879964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:17.889496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:17.894429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:17.899632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e396c1ec-52c0-47a4-8289-0bdc73a32861 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.7653890 Dec 21 03:56:17.960412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd1348383-efeb-4256-b656-d6dd1d710c28'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:17.963246 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb3c13d7-4903-4fb8-adac-18a33eb127d8" -d '{"events": [{"server_uuid": "b10a139b-2939-4b09-90cf-e3dc8e628bb2", "name": "network-vif-plugged", "status": "completed", "tag": "d1348383-efeb-4256-b656-d6dd1d710c28"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:18.027528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.029075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.062827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Allocated IP 172.20.0.2 (4915ee69-a87c-4f15-b553-d1750c9a5a88/35ca07d8-d162-4205-9aec-69a6c9b94f03/24c1f54d-a869-4a6c-9fb2-d52fe3ce828e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:18.085885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70de8b72-20fa-4175-a074-bb6bc23d7d34 req-f7b52be9-84e9-47fe-9fb6-ada243614583 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/security-groups?id=b886fb02-2b89-4ef5-b70d-e3425d3cb003&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4494917 Dec 21 03:56:18.127731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.180156 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cfe3d08c-8626-4562-8101-022e8ff5818a x-openstack-request-id: req-cfe3d08c-8626-4562-8101-022e8ff5818a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:18.180549 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b10a139b-2939-4b09-90cf-e3dc8e628bb2", "name": "network-vif-plugged", "status": "completed", "tag": "d1348383-efeb-4256-b656-d6dd1d710c28", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:18.180905 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cfe3d08c-8626-4562-8101-022e8ff5818a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:18.181402 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd1348383-efeb-4256-b656-d6dd1d710c28', 'code': 200} Dec 21 03:56:18.193553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560ed867-acdb-4632-bdf4-6563ce50e684 req-71bda20e-f188-424c-a333-5c0d845778cf tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:18.197721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-560ed867-acdb-4632-bdf4-6563ce50e684 req-71bda20e-f188-424c-a333-5c0d845778cf tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 946 time: 0.2933080 Dec 21 03:56:18.300849 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.305763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Allocated IP 172.25.5.8 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/87363837-739a-400f-9637-a8af925500ea) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:18.456294 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.529647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-560ed867-acdb-4632-bdf4-6563ce50e684 req-24fef1a9-e2da-4809-89da-a84c5ac0b44c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3172436 Dec 21 03:56:18.550212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Pushing event updated for resources: {'Port': ['ID=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:18.571084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:18.572444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:18.575679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:18.603520 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.645698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Pushing event deleted for resources: {'Port': ['ID=38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:18.662402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:18.680989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.719411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Attempting to bind port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:18.720340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Attempting to bind port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:18.721108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Attempting to bind port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e on network 4915ee69-a87c-4f15-b553-d1750c9a5a88 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:18.726730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92abdf2-7670-4d37-b20d-446c584866ae req-f9fadc8f-b067-4d68-aa01-dfa6749780bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:18.728703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:18.729224 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b92abdf2-7670-4d37-b20d-446c584866ae req-f9fadc8f-b067-4d68-aa01-dfa6749780bc service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 1098 time: 0.4444044 Dec 21 03:56:18.729658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Checking segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:18.730559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.730672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] No DVR routers for this DVR port 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:18.731340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Bound using segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:18.733033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Bound port: 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:18.734572 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.734767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.749080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e79d1f08-b26b-422c-9777-bb4b4003c7f8 req-35b7b5a2-8b9c-40f7-a29f-d97b8d7a2a56 tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.31 "DELETE /v2.0/ports/38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a HTTP/1.1" status: 204 len: 173 time: 1.6906030 Dec 21 03:56:18.749580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'name': 'network-vif-deleted', 'tag': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:18.751975 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91338746-946f-439e-822e-4877a2e564a1" -d '{"events": [{"server_uuid": "6f2192b8-7c6e-420f-93a8-57849ce29b3f", "name": "network-vif-deleted", "tag": "38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:18.784606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.861443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] For port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:18.866781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] For port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:18.897724 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a8f2691-6ccd-439b-87a2-8515ecb1e61c x-openstack-request-id: req-7a8f2691-6ccd-439b-87a2-8515ecb1e61c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:18.898127 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6f2192b8-7c6e-420f-93a8-57849ce29b3f", "name": "network-vif-deleted", "tag": "38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:18.898408 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7a8f2691-6ccd-439b-87a2-8515ecb1e61c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:18.898894 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6f2192b8-7c6e-420f-93a8-57849ce29b3f', 'name': 'network-vif-deleted', 'tag': '38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a', 'status': 'completed', 'code': 200} Dec 21 03:56:18.924513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b92abdf2-7670-4d37-b20d-446c584866ae req-d7c7cb89-f02b-494e-a380-a8075e36f0c1 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1882637 Dec 21 03:56:18.925190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:18.953649 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:19.060360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66a4e860-863a-4fe0-8f45-4e2bfbbfa8d3 None None] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:19.073074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Pushing event updated for resources: {'Port': ['ID=87363837-739a-400f-9637-a8af925500ea,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:19.105999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:19.106820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:19.111000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:19.194539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d111f8b-50ff-4422-9c77-e353d10c60a3 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:19.212981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:19.264246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:19.282741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-053e4a3e-7990-4e17-917b-81757c94cbff None None] Provisioning complete for port b32cc5c5-5bb2-453a-9579-862bddcf93cf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:19.285396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-053e4a3e-7990-4e17-917b-81757c94cbff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:19.298768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c3daf54-9f47-432f-9769-ee3efc9e2bef req-cbb420a9-1d38-40fb-9635-a7768ac5c5ba tempest-ServerRescueNegativeTestJSON-1221855057 tempest-ServerRescueNegativeTestJSON-1221855057-project] 10.222.0.18 "GET /v2.0/ports?device_id=6f2192b8-7c6e-420f-93a8-57849ce29b3f HTTP/1.1" status: 200 len: 210 time: 0.0381093 Dec 21 03:56:19.423125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b32cc5c5-5bb2-453a-9579-862bddcf93cf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:19.544766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Allocated IP 172.25.5.74 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/704e5770-5155-4bfd-9735-40b18e6e5e89) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:19.807632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:19.883488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c4582b-4168-4ef6-a386-44049b69b04d None None] Pushing event updated for resources: {'Port': ['ID=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:19.932612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.022493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:20.024119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Pushing event updated for resources: {'Port': ['ID=704e5770-5155-4bfd-9735-40b18e6e5e89,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:20.027367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:20.037613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:20.110430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e68ea03-8aac-4b8b-a815-36372b0a84d5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:20.138640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84b3a5fa-6e97-4f6d-a444-665eb745eb7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.139831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b32cc5c5-5bb2-453a-9579-862bddcf93cf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:20.140199 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.215421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2145a601-9a11-483b-8b04-fe0e7e543be5 req-1558257a-7c17-44f7-acef-683a713fcf6e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:20.218518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2145a601-9a11-483b-8b04-fe0e7e543be5 req-1558257a-7c17-44f7-acef-683a713fcf6e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 946 time: 0.2311077 Dec 21 03:56:20.235659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-053e4a3e-7990-4e17-917b-81757c94cbff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.313523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-053e4a3e-7990-4e17-917b-81757c94cbff None None] For port b32cc5c5-5bb2-453a-9579-862bddcf93cf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b32cc5c5-5bb2-453a-9579-862bddcf93cf,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:20.314996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.406288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:20.439939 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-053e4a3e-7990-4e17-917b-81757c94cbff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.521149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:56:20.526118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2145a601-9a11-483b-8b04-fe0e7e543be5 req-d8f1ac1d-a21b-4375-b0d3-3004e3215a8a tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2707164 Dec 21 03:56:20.526283 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:56:20.564445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.589521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053e4a3e-7990-4e17-917b-81757c94cbff None None] Pushing event updated for resources: {'Port': ['ID=b32cc5c5-5bb2-453a-9579-862bddcf93cf,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:20.653235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8f5cad54-389c-44d1-8d78-6f9c7e9e3368 None None] Provisioning complete for port 704e5770-5155-4bfd-9735-40b18e6e5e89 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:20.653235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f5cad54-389c-44d1-8d78-6f9c7e9e3368 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.717590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8f5cad54-389c-44d1-8d78-6f9c7e9e3368 None None] Port 704e5770-5155-4bfd-9735-40b18e6e5e89 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:20.738158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8f5cad54-389c-44d1-8d78-6f9c7e9e3368 None None] Provisioning complete for port 87363837-739a-400f-9637-a8af925500ea triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:20.740332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f5cad54-389c-44d1-8d78-6f9c7e9e3368 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.797807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8f5cad54-389c-44d1-8d78-6f9c7e9e3368 None None] Port 87363837-739a-400f-9637-a8af925500ea cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:20.866885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60602) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:20.904976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:20.936642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5f8671f-4914-453b-8d91-55e8d8ea0673 None None] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:20.988994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6b43e6d2-44d6-4d4c-8a6a-f9a16f884edf None None] Provisioning complete for port b32cc5c5-5bb2-453a-9579-862bddcf93cf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:20.989373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b43e6d2-44d6-4d4c-8a6a-f9a16f884edf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.074137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.167153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:21.187682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.188307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.188958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.189521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.190050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.190843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.191115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.194375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-c103b5b5-fcb3-4fc9-b211-4ecf5e23cfcc service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6497 time: 0.3260725 Dec 21 03:56:21.201963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:21.202231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 38d393a3-dd6e-4fc6-86b8-2e7c441a9e7a not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:21.301392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Router 51cca181-9cee-4e4e-bf00-02cc46bb1724 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:56:21.406043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-a1b3f8f9-5295-498f-9e3c-0146b264cbf6 service neutron] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2023671 Dec 21 03:56:21.481326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-96450b7f-fe5a-4aa0-b7d2-d5f1217ce1ff None None] Provisioning complete for port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:21.482467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-96450b7f-fe5a-4aa0-b7d2-d5f1217ce1ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.494115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:21.564588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.666735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:21.688140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Sync routers for ids ['51cca181-9cee-4e4e-bf00-02cc46bb1724'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:21.697525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.715022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Routers {'51cca181-9cee-4e4e-bf00-02cc46bb1724'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:21.715735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['51cca181-9cee-4e4e-bf00-02cc46bb1724'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:21.766532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eee84db-858f-4e78-8c25-5761fb923a4a req-a1520b7c-22a2-437e-b5cc-ee62f3ce16f7 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:21.774519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4eee84db-858f-4e78-8c25-5761fb923a4a req-a1520b7c-22a2-437e-b5cc-ee62f3ce16f7 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 946 time: 0.1296506 Dec 21 03:56:21.794358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.795651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5eef3272-de28-4ce2-b35d-90eab46c3933 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 5.5917432 Dec 21 03:56:21.796786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-96450b7f-fe5a-4aa0-b7d2-d5f1217ce1ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.798922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:21.799413 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:21.802692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60620) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:21.902735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-96450b7f-fe5a-4aa0-b7d2-d5f1217ce1ff None None] For port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:21.977739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4eee84db-858f-4e78-8c25-5761fb923a4a req-d788b01d-5d40-4234-8c5c-ee7104e3b29b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1974747 Dec 21 03:56:21.989273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-96450b7f-fe5a-4aa0-b7d2-d5f1217ce1ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.080422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Set router 51cca181-9cee-4e4e-bf00-02cc46bb1724 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:22.111005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Router 1cfcc743-8714-4e30-ac55-8bea218057cc is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:56:22.186806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60626) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:22.250388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96450b7f-fe5a-4aa0-b7d2-d5f1217ce1ff None None] Pushing event updated for resources: {'Port': ['ID=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:22.336601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:22.349467 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Sync routers for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:22.366649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Deleting port 396f6baa-46b9-4358-9644-14bb8ef20cc4 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:22.366869 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:22.390209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.390369 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:55:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:22.435608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b32cc5c5-5bb2-453a-9579-862bddcf93cf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:22.472056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d47474a-d1cd-4903-bb6b-56a85bb3c021 req-74ca053d-c8e3-481c-a133-e45006bde5e2 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:22.482760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d47474a-d1cd-4903-bb6b-56a85bb3c021 req-74ca053d-c8e3-481c-a133-e45006bde5e2 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=9eee2b26-fb4b-4dc0-b932-c6b857957ad7 HTTP/1.1" status: 200 len: 946 time: 0.2999058 Dec 21 03:56:22.512307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] For port 396f6baa-46b9-4358-9644-14bb8ef20cc4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=396f6baa-46b9-4358-9644-14bb8ef20cc4,segment=NetworkSegment(05af4aed-43f0-4344-9587-0a147eb02792),segment_id=05af4aed-43f0-4344-9587-0a147eb02792)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:22.512307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.513469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.517801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-860733cf-a93b-4ad2-896c-949afeadfd19 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 4.6272564 Dec 21 03:56:22.529127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60632) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:22.538976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Calling delete_port for 396f6baa-46b9-4358-9644-14bb8ef20cc4 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:22.605578 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:22.607864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d47474a-d1cd-4903-bb6b-56a85bb3c021 req-e037e8a3-2481-4c95-b764-45861de80798 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164706 Dec 21 03:56:22.619181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bae20cf-73ab-4662-b0b4-1c509c91db06 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.630802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e8ac9339-e07b-47fd-8ff5-ac792ccc195f None None] Provisioning complete for port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:22.631254 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8ac9339-e07b-47fd-8ff5-ac792ccc195f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.690614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07010cbc-fabd-408a-bb93-6d697f60086d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.710862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b32cc5c5-5bb2-453a-9579-862bddcf93cf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:22.711281 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.743238 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:22.755541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:56:20Z', 'revision_number': 3, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:22.940810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:20Z', 'revision_number': 3, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:22.999002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.015336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Checking router: 51cca181-9cee-4e4e-bf00-02cc46bb1724 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:23.015870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Updating router 51cca181-9cee-4e4e-bf00-02cc46bb1724 port 87363837-739a-400f-9637-a8af925500ea binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:23.042658 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Checking router: 1cfcc743-8714-4e30-ac55-8bea218057cc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:23.048094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Updating router 1cfcc743-8714-4e30-ac55-8bea218057cc port 704e5770-5155-4bfd-9735-40b18e6e5e89 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:23.077641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.106592 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.162019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bae20cf-73ab-4662-b0b4-1c509c91db06 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.263586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.276689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bae20cf-73ab-4662-b0b4-1c509c91db06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.328209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:23.376912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4bae20cf-73ab-4662-b0b4-1c509c91db06 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a10704b4c5934581974e9a8eb1f1bf53&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1890366 Dec 21 03:56:23.377545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60638) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:23.416713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bae20cf-73ab-4662-b0b4-1c509c91db06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7edb9514-e022-4f91-ab12-67259d897f81,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:23.463409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Allocated IP 172.20.0.1 (45ff9d95-f609-4ed5-9517-1125b7d4496f/dcd56809-69ac-49ac-96ed-ba3b364103dd/0b60559b-cb0f-4c3d-b6d3-97e08d4d523a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:23.509606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42089174-7843-4a89-a15b-69cd84ed2323 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.604013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.625297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:23.625482 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.633868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.711896 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.719850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42089174-7843-4a89-a15b-69cd84ed2323 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.741989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.762585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7eb6ee-fa6e-4f7c-bd52-1109fd60f072 None None] Pushing event updated for resources: {'Port': ['ID=87363837-739a-400f-9637-a8af925500ea,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:23.847928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4144df1d-7aa8-4ea5-b897-9c656c723b3d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:23.879841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Attempting to bind port 87363837-739a-400f-9637-a8af925500ea on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:23.880379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Attempting to bind port 87363837-739a-400f-9637-a8af925500ea by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:23.880780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Attempting to bind port 87363837-739a-400f-9637-a8af925500ea on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:23.881059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:23.891321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:23.896508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:23.896508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.896508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:23.897364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:23.897755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Bound port: 87363837-739a-400f-9637-a8af925500ea, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:23.903907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:23.906998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.921105 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.925392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.967859 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:23.974910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Pushing event deleted for resources: {'Port': ['ID=396f6baa-46b9-4358-9644-14bb8ef20cc4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:23.997703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] For port 87363837-739a-400f-9637-a8af925500ea, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:24.008256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] For port 87363837-739a-400f-9637-a8af925500ea, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87363837-739a-400f-9637-a8af925500ea,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:24.025085 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.054255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-728b87df-03e4-44d3-8488-7bc06a0691a9 None None] Provisioning complete for port 87363837-739a-400f-9637-a8af925500ea triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:24.055780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-728b87df-03e4-44d3-8488-7bc06a0691a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.124110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Pushing event updated for resources: {'Port': ['ID=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:24.151509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Attempting to bind port 704e5770-5155-4bfd-9735-40b18e6e5e89 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:24.151509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Attempting to bind port 704e5770-5155-4bfd-9735-40b18e6e5e89 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:24.151509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Attempting to bind port 704e5770-5155-4bfd-9735-40b18e6e5e89 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:24.152648 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7a467e-b15c-4726-b436-2c62941b5c2b None None] Pushing event updated for resources: {'Port': ['ID=704e5770-5155-4bfd-9735-40b18e6e5e89,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:24.162344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a0154e0-bcf0-446a-82a4-6e3e4bfa40fa None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:24.166746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-728b87df-03e4-44d3-8488-7bc06a0691a9 None None] Port 87363837-739a-400f-9637-a8af925500ea cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:24.173336 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.174971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 55, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:24.180032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:24.180032 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.180032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:24.180032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Bound port: 704e5770-5155-4bfd-9735-40b18e6e5e89, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:24.180032 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.258397 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] For port 704e5770-5155-4bfd-9735-40b18e6e5e89, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:24.266406 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] For port 704e5770-5155-4bfd-9735-40b18e6e5e89, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=704e5770-5155-4bfd-9735-40b18e6e5e89,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:24.272914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8a73b15-a8a9-4223-9fd5-0cf93224b57a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:24.287940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-5436ff0a-8d72-4127-ac53-f572f1ed337d tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:24.289589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-5436ff0a-8d72-4127-ac53-f572f1ed337d tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 812 time: 0.1912382 Dec 21 03:56:24.291462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42089174-7843-4a89-a15b-69cd84ed2323 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.294018 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-42089174-7843-4a89-a15b-69cd84ed2323 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.295257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-42089174-7843-4a89-a15b-69cd84ed2323 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7edb9514-e022-4f91-ab12-67259d897f81 HTTP/1.1" status: 204 len: 168 time: 0.9127581 Dec 21 03:56:24.335610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.357967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42089174-7843-4a89-a15b-69cd84ed2323 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7edb9514-e022-4f91-ab12-67259d897f81,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:24.362021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Routers {'51cca181-9cee-4e4e-bf00-02cc46bb1724'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:24.364496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['51cca181-9cee-4e4e-bf00-02cc46bb1724'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:24.364639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-64b2718f-3216-4fbc-9f09-caae10676e3e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/quotas/5aa4830586124e6a8a42b9502b0fc7c2 HTTP/1.1" status: 200 len: 375 time: 0.0374391 Dec 21 03:56:24.368341 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.373765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.452927 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:24.456477 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:24.528497 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7a467e-b15c-4726-b436-2c62941b5c2b None None] Pushing event updated for resources: {'Port': ['ID=704e5770-5155-4bfd-9735-40b18e6e5e89,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:24.568200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.602639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7eb6ee-fa6e-4f7c-bd52-1109fd60f072 None None] Pushing event updated for resources: {'Port': ['ID=87363837-739a-400f-9637-a8af925500ea,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:24.621398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e4e5407-e1dc-47cb-9e6c-95bba0374686 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:24.625483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] Set router 51cca181-9cee-4e4e-bf00-02cc46bb1724 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:24.629451 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.638145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a259d026-bcb9-4260-b21d-26bd6067e71e None None] Provisioning complete for port 704e5770-5155-4bfd-9735-40b18e6e5e89 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:24.640170 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a259d026-bcb9-4260-b21d-26bd6067e71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.663756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-3178f833-d432-4b4a-a6f9-ba5ca37d1728 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0909543 Dec 21 03:56:24.665166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.743729 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:24.783866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Allocated IP 172.20.0.1 (4915ee69-a87c-4f15-b553-d1750c9a5a88/35ca07d8-d162-4205-9aec-69a6c9b94f03/8e8edf66-71e6-4265-b442-7de4ff8867d4) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:24.865082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.900124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:24.914721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Pushing event updated for resources: {'Port': ['ID=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:24.953303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.036425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-3f06a61a-e5f3-4253-8115-c02fb4ed5ada service neutron] 10.222.0.18 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3222363 Dec 21 03:56:25.080319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.125591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-03f312c8-3c37-4ac7-871f-069c7d109296 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:25.127350 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-03f312c8-3c37-4ac7-871f-069c7d109296 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "GET /v2.0/ports?device_id=9eee2b26-fb4b-4dc0-b932-c6b857957ad7 HTTP/1.1" status: 200 len: 946 time: 0.1278031 Dec 21 03:56:25.147727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a259d026-bcb9-4260-b21d-26bd6067e71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.176259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.182161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4693e946-bef4-4215-a034-2d875c340974 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:20Z', 'revision_number': 3, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:25.219332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:25.226370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:25.228286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60660) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:25.260243 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4693e946-bef4-4215-a034-2d875c340974 None None] The sync data for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 is: [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:20Z', 'revision_number': 3, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:25.296229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:25.312318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a259d026-bcb9-4260-b21d-26bd6067e71e None None] For port 704e5770-5155-4bfd-9735-40b18e6e5e89, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=704e5770-5155-4bfd-9735-40b18e6e5e89,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:25.339486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:25.343608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:25.348861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Pushing event updated for resources: {'Port': ['ID=8e8edf66-71e6-4265-b442-7de4ff8867d4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:25.357799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0b60559b-cb0f-4c3d-b6d3-97e08d4d523a', 'name': '', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'mac_address': 'fa:16:3e:a8:23:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_interface', 'standard_attr_id': 1404, 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:23Z', 'updated_at': '2021-12-21T03:56:23Z', 'revision_number': 1, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'subnets': [{'id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:25.367709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-c9ed7c0c-caa3-4929-be07-739fbc884bd5 service neutron] 10.222.0.18 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3300216 Dec 21 03:56:25.368532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cadfee4-8110-4ff5-b9ad-ad2aa0f196a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.447035 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a259d026-bcb9-4260-b21d-26bd6067e71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.574282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35a6e058-b1a9-47ac-9265-86e1fcc2e081 None None] The sync data for ids ['51cca181-9cee-4e4e-bf00-02cc46bb1724'] in n-d-822053-11 is: [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0b60559b-cb0f-4c3d-b6d3-97e08d4d523a', 'name': '', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'mac_address': 'fa:16:3e:a8:23:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_interface', 'standard_attr_id': 1404, 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:23Z', 'updated_at': '2021-12-21T03:56:23Z', 'revision_number': 1, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'subnets': [{'id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:25.585270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a259d026-bcb9-4260-b21d-26bd6067e71e None None] Pushing event updated for resources: {'Port': ['ID=704e5770-5155-4bfd-9735-40b18e6e5e89,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:25.614627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Provisioning complete for port 704e5770-5155-4bfd-9735-40b18e6e5e89 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:25.615184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.723169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-44b045b3-2cdd-4cae-b770-70881b4df61d tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:25.724715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-44b045b3-2cdd-4cae-b770-70881b4df61d tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "GET /v2.0/ports?device_id=b10a139b-2939-4b09-90cf-e3dc8e628bb2 HTTP/1.1" status: 200 len: 946 time: 0.2503459 Dec 21 03:56:25.757664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Provisioning complete for port 87363837-739a-400f-9637-a8af925500ea triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:25.757664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.788686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.835398 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.899165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Router 51cca181-9cee-4e4e-bf00-02cc46bb1724 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:56:25.923299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Deleting port 47429b75-9803-4e69-b90b-a4c02786130d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:25.923641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:25.968001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.004262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] For port 87363837-739a-400f-9637-a8af925500ea, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87363837-739a-400f-9637-a8af925500ea,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:26.033570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cadfee4-8110-4ff5-b9ad-ad2aa0f196a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.073539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.092044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Router e40244a3-af5e-4667-8b35-411bfa38392f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:56:26.212184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Provisioning complete for port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:26.212184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.271506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] For port 47429b75-9803-4e69-b90b-a4c02786130d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=47429b75-9803-4e69-b90b-a4c02786130d,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:26.272365 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.317387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:26.339159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30f01acc-74ab-4712-9700-52f5f4304a77 None None] Pushing event updated for resources: {'Port': ['ID=87363837-739a-400f-9637-a8af925500ea,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:26.425564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7a787062-c988-4e55-b6dd-1203fbf8edb6 None None] Provisioning complete for port 8e8edf66-71e6-4265-b442-7de4ff8867d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:26.425936 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7a787062-c988-4e55-b6dd-1203fbf8edb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.517925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Calling delete_port for 47429b75-9803-4e69-b90b-a4c02786130d owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:26.527923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7a787062-c988-4e55-b6dd-1203fbf8edb6 None None] Port 8e8edf66-71e6-4265-b442-7de4ff8867d4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:26.542006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7a787062-c988-4e55-b6dd-1203fbf8edb6 None None] Provisioning complete for port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:26.544621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7a787062-c988-4e55-b6dd-1203fbf8edb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.607692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7a787062-c988-4e55-b6dd-1203fbf8edb6 None None] Port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:26.733606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:26.744439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-41317b3a-91de-4f0e-8a0f-4894c5c9d86f admin admin] 10.222.0.18 "PUT /v2.0/routers/e40244a3-af5e-4667-8b35-411bfa38392f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3317351 Dec 21 03:56:26.746575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] Sync routers for ids ['e40244a3-af5e-4667-8b35-411bfa38392f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:26.754925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60682) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:26.768809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] Routers {'e40244a3-af5e-4667-8b35-411bfa38392f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:26.769900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e40244a3-af5e-4667-8b35-411bfa38392f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:26.858590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:26.935550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event deleted for resources: {'Port': ['ID=47429b75-9803-4e69-b90b-a4c02786130d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:26.939079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d1348383-efeb-4256-b656-d6dd1d710c28'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:27.049328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f6cb067-7e60-463e-96ac-5053c17497a3 req-e9847d48-290f-4d6e-b072-2d9c69783a24 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 210 time: 0.0916684 Dec 21 03:56:27.054106 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cadfee4-8110-4ff5-b9ad-ad2aa0f196a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.203895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8cadfee4-8110-4ff5-b9ad-ad2aa0f196a6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a631ad5785544b94a1d91724aa8481c9&name=default HTTP/1.1" status: 200 len: 3000 time: 1.9745343 Dec 21 03:56:27.243549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60686) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:27.244402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cadfee4-8110-4ff5-b9ad-ad2aa0f196a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3ff9b03-a1b5-4641-b852-b82735d856e6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:27.313328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] No DVR routers for this DVR port 47429b75-9803-4e69-b90b-a4c02786130d on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:27.338259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.349303 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-92f9d47e-26bc-41f6-823d-4b1fe0a2f749 req-89e499b4-fab5-43db-a0bb-9503d5268c4e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "DELETE /v2.0/ports/47429b75-9803-4e69-b90b-a4c02786130d HTTP/1.1" status: 204 len: 173 time: 2.1869793 Dec 21 03:56:27.350253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'name': 'network-vif-deleted', 'tag': '47429b75-9803-4e69-b90b-a4c02786130d'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:27.354039 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-063ac01f-8de0-416b-a2b6-9c66fa07d135" -d '{"events": [{"server_uuid": "9eee2b26-fb4b-4dc0-b932-c6b857957ad7", "name": "network-vif-deleted", "tag": "47429b75-9803-4e69-b90b-a4c02786130d"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:27.381792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.445051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-48c1aa66-a71e-4897-8086-5990142c896e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.469508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.504299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-48c1aa66-a71e-4897-8086-5990142c896e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.557360 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db6cf266-e1d7-436d-9600-c3d1d11098c3 x-openstack-request-id: req-db6cf266-e1d7-436d-9600-c3d1d11098c3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:27.557673 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9eee2b26-fb4b-4dc0-b932-c6b857957ad7", "name": "network-vif-deleted", "tag": "47429b75-9803-4e69-b90b-a4c02786130d", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:27.566034 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-db6cf266-e1d7-436d-9600-c3d1d11098c3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:27.566524 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9eee2b26-fb4b-4dc0-b932-c6b857957ad7', 'name': 'network-vif-deleted', 'tag': '47429b75-9803-4e69-b90b-a4c02786130d', 'status': 'completed', 'code': 200} Dec 21 03:56:27.670637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 87363837-739a-400f-9637-a8af925500ea up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:27.681153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Deleting port d1348383-efeb-4256-b656-d6dd1d710c28 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:27.681585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.685500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47429b75-9803-4e69-b90b-a4c02786130d no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:27.876938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] For port d1348383-efeb-4256-b656-d6dd1d710c28, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d1348383-efeb-4256-b656-d6dd1d710c28,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:27.877895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:27.901630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Calling delete_port for d1348383-efeb-4256-b656-d6dd1d710c28 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:27.955028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.122717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.195850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Deleting port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:28.196774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.233499 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-48c1aa66-a71e-4897-8086-5990142c896e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.236810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-48c1aa66-a71e-4897-8086-5990142c896e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.238892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-48c1aa66-a71e-4897-8086-5990142c896e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b3ff9b03-a1b5-4641-b852-b82735d856e6 HTTP/1.1" status: 204 len: 168 time: 0.9555757 Dec 21 03:56:28.262685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a273dac4-7a23-4ff8-a86f-1617b4b80af4 req-3004ef3d-ad65-4d53-ab51-5ee648d0a1ab tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 210 time: 0.0952537 Dec 21 03:56:28.298787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.334249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] Set router e40244a3-af5e-4667-8b35-411bfa38392f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:28.337877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 47429b75-9803-4e69-b90b-a4c02786130d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:28.338270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 47429b75-9803-4e69-b90b-a4c02786130d not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:28.340641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d1348383-efeb-4256-b656-d6dd1d710c28 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:28.425494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event deleted for resources: {'Port': ['ID=d1348383-efeb-4256-b656-d6dd1d710c28,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:28.437403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c1aa66-a71e-4897-8086-5990142c896e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3ff9b03-a1b5-4641-b852-b82735d856e6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:28.525738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] For port 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:28.526316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.549896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] No DVR routers for this DVR port d1348383-efeb-4256-b656-d6dd1d710c28 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:28.554780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.558574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d49f147b-35d2-43d0-bf18-e889b7fc99fd req-94ce4fb9-69cc-484d-bff3-1adde8d749e1 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.54 "DELETE /v2.0/ports/d1348383-efeb-4256-b656-d6dd1d710c28 HTTP/1.1" status: 204 len: 173 time: 2.6979024 Dec 21 03:56:28.558751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Calling delete_port for 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:28.559628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'name': 'network-vif-deleted', 'tag': 'd1348383-efeb-4256-b656-d6dd1d710c28'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:28.562196 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32ba5ce7-4ffa-40af-8ce9-544cd1acbc48" -d '{"events": [{"server_uuid": "b10a139b-2939-4b09-90cf-e3dc8e628bb2", "name": "network-vif-deleted", "tag": "d1348383-efeb-4256-b656-d6dd1d710c28"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:28.583012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:28.599152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e499fdda-9b9f-4a7f-af50-6b45d2ed6612 admin admin] 10.222.0.18 "PUT /v2.0/routers/51cca181-9cee-4e4e-bf00-02cc46bb1724/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7912149 Dec 21 03:56:28.690251 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-951940cd-2b6c-4dfd-8cff-e3e99b6395ef x-openstack-request-id: req-951940cd-2b6c-4dfd-8cff-e3e99b6395ef {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:28.691062 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b10a139b-2939-4b09-90cf-e3dc8e628bb2", "name": "network-vif-deleted", "tag": "d1348383-efeb-4256-b656-d6dd1d710c28", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:28.691570 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-951940cd-2b6c-4dfd-8cff-e3e99b6395ef {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:28.692245 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b10a139b-2939-4b09-90cf-e3dc8e628bb2', 'name': 'network-vif-deleted', 'tag': 'd1348383-efeb-4256-b656-d6dd1d710c28', 'status': 'completed', 'code': 200} Dec 21 03:56:28.692585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: d1348383-efeb-4256-b656-d6dd1d710c28 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:28.692990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d1348383-efeb-4256-b656-d6dd1d710c28 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:28.738673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 87363837-739a-400f-9637-a8af925500ea triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:28.738965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.809935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:28.934462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 704e5770-5155-4bfd-9735-40b18e6e5e89 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:29.009875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:29.012197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Pushing event updated for resources: {'Port': ['ID=8e8edf66-71e6-4265-b442-7de4ff8867d4,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:29.017362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50'}], 'enable_snat': True}, 'gw_port_id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:56:23Z', 'revision_number': 5, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port': {'id': '157b9f6f-10d7-4b32-8b9e-0d9302d2f49a', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:59:7f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1149, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:53:27Z', 'updated_at': '2021-12-21T03:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:29.065375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] Checking router: e40244a3-af5e-4667-8b35-411bfa38392f for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:29.080164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 704e5770-5155-4bfd-9735-40b18e6e5e89 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:29.080614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:29.106512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] Routers {'e40244a3-af5e-4667-8b35-411bfa38392f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:29.107200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e40244a3-af5e-4667-8b35-411bfa38392f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:29.255088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] Set router e40244a3-af5e-4667-8b35-411bfa38392f gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:29.279603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:29.317048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:29.330266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 6, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:29.381230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b239dbe-da8b-41b8-87f2-a11c9ec9be09 None None] The sync data for ids ['e40244a3-af5e-4667-8b35-411bfa38392f'] in n-d-822053-11 is: [{'id': 'e40244a3-af5e-4667-8b35-411bfa38392f', 'name': 'tempest-ServerRescueNegativeTestJSON-413193271-router', 'tenant_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:53:26Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 6, 'project_id': '811cd4c8ce3c40c69d5b84fba08dd2ce', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:29.502278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:29.514692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f261ac64-ad0f-4a38-8c1b-3ab51fd142c2 req-4df7a1a0-2e42-4c19-a9a4-b959b5fe7b3b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 210 time: 0.1000087 Dec 21 03:56:29.643696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Pushing event deleted for resources: {'Port': ['ID=157b9f6f-10d7-4b32-8b9e-0d9302d2f49a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:29.667146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-748aaf4c-8a38-4a23-bed5-e4a02a04d40c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:29.779665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-18b2aa9b-ba45-4ce1-a1c1-333b0091959a tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:29.791893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-18b2aa9b-ba45-4ce1-a1c1-333b0091959a tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 812 time: 0.2557895 Dec 21 03:56:29.836977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Request body: {'port': {'device_id': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'admin_state_up': True, 'tenant_id': '5aa4830586124e6a8a42b9502b0fc7c2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:29.882073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cd8e37fc-3e74-4598-b2c6-176ac4f348a1 None None] Provisioning complete for port 8e8edf66-71e6-4265-b442-7de4ff8867d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:29.884293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd8e37fc-3e74-4598-b2c6-176ac4f348a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:29.925829 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Sync routers for ids ['51cca181-9cee-4e4e-bf00-02cc46bb1724'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:29.953696 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Routers {'51cca181-9cee-4e4e-bf00-02cc46bb1724'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:29.960173 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['51cca181-9cee-4e4e-bf00-02cc46bb1724'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:30.001476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 396f6baa-46b9-4358-9644-14bb8ef20cc4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:30.128735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cd8e37fc-3e74-4598-b2c6-176ac4f348a1 None None] Port 8e8edf66-71e6-4265-b442-7de4ff8867d4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:30.143978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 396f6baa-46b9-4358-9644-14bb8ef20cc4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:30.144575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 396f6baa-46b9-4358-9644-14bb8ef20cc4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:30.180548 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Set router 51cca181-9cee-4e4e-bf00-02cc46bb1724 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:30.187032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Made reservation on behalf of 5aa4830586124e6a8a42b9502b0fc7c2 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:30.192219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.299303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.393330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60736) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:30.400241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Request body: {'network': {'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-network', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:30.459161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.462353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Router 1cfcc743-8714-4e30-ac55-8bea218057cc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:56:30.465025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.527029 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0b60559b-cb0f-4c3d-b6d3-97e08d4d523a', 'name': '', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'mac_address': 'fa:16:3e:a8:23:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_interface', 'standard_attr_id': 1404, 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:23Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 2, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'subnets': [{'id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:30.543388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Allocated IP 172.20.0.9 (1bfeb879-d5e1-4651-ae97-290a586eba8e/bb3135ec-e693-4805-af80-f05f5d44e73c/e7dfd89c-f813-486c-abd8-a7763ecccf4e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:30.574764 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Checking router: 51cca181-9cee-4e4e-bf00-02cc46bb1724 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:30.574764 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Updating router 51cca181-9cee-4e4e-bf00-02cc46bb1724 port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:30.612516 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.651263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Made reservation on behalf of 7d3d7b72cbb3443392bc9a612c74511c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:30.653992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.673964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.680461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.681053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e40244a3-af5e-4667-8b35-411bfa38392f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:56:30.698543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.699850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f1ec66e-22c0-4f41-b272-7b6e71d7c955 admin admin] 10.222.0.18 "DELETE /v2.0/routers/e40244a3-af5e-4667-8b35-411bfa38392f HTTP/1.1" status: 204 len: 168 time: 3.9444776 Dec 21 03:56:30.708205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60744) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:30.770807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:30.925385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d912fa5b-bfda-44d3-a761-1642d2c8f3af req-6857673d-4322-4d11-9a43-93ebbd2e9acf tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 210 time: 0.1342852 Dec 21 03:56:30.957408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Deleting subnet 6a24f048-2859-4842-aab3-8ca7a2232eab {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:56:30.960020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:30.973685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Sync routers for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:30.978799 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42fb3923-45f9-4105-9b6e-fd2903ee9a28 admin admin] 10.222.0.18 "PUT /v2.0/routers/1cfcc743-8714-4e30-ac55-8bea218057cc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.4486377 Dec 21 03:56:30.980736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.004736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:31.005365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:31.047708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.072874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.100823 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.124275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.167533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:31.174273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:31.175640 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.179297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:31.182788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.223034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:56:31.241488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.279032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c461f6e9-47f2-428e-90e1-50631f1d7179,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:31.279815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:31.280476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.303186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.303546 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Added segment 107d90a9-660d-4174-a56c-6bd9f4371d67 of type vlan for network 21911ef5-8ca7-4129-bc39-61ca0f42e46e Dec 21 03:56:31.323024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event updated for resources: {'Port': ['ID=e7dfd89c-f813-486c-abd8-a7763ecccf4e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:31.366192 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Pushing event updated for resources: {'Port': ['ID=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:31.381351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:31.382557 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.382905 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.383269 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.383662 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.383934 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.384276 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.391664 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.392003 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.392339 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.392670 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.393003 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.393587 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.393719 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:31.395745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.407119 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Attempting to bind port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:31.407250 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Attempting to bind port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:31.413504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1e182ffd-b4aa-4efe-a717-8ef1c33fbdc0 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5809555 Dec 21 03:56:31.416784 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Attempting to bind port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a on network 45ff9d95-f609-4ed5-9517-1125b7d4496f {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:31.423521 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:31.424384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Checking segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:31.424792 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.425365 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Bound using segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:31.425636 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Bound port: 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:31.426340 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.451790 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:31.454882 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:56:31.458904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1df3edca-4307-4af3-9178-64172b18e83b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:31.465148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-1df3edca-4307-4af3-9178-64172b18e83b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 812 time: 0.6757407 Dec 21 03:56:31.486078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Request body: {'port': {'device_id': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:31.501490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.564385 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] For port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:31.569930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6a24f048-2859-4842-aab3-8ca7a2232eab,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:31.576193 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] For port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:31.576725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.576725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:31.577372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Request body: {'port': {'device_id': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'admin_state_up': True, 'tenant_id': '5aa4830586124e6a8a42b9502b0fc7c2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:31.587186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.621760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:31.648483 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.684962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.688723 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6a9438c4-8fc6-490d-9b58-d3c69af67cfd admin admin] 10.222.0.18 "DELETE /v2.0/subnets/6a24f048-2859-4842-aab3-8ca7a2232eab HTTP/1.1" status: 204 len: 168 time: 0.9711614 Dec 21 03:56:31.688723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] Pushing event updated for resources: {'Network': ['ID=21911ef5-8ca7-4129-bc39-61ca0f42e46e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:31.692872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:31.711025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:56:31.741945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:31.742310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 157b9f6f-10d7-4b32-8b9e-0d9302d2f49a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:31.785612 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.808789 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Routers {'51cca181-9cee-4e4e-bf00-02cc46bb1724'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:31.809667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['51cca181-9cee-4e4e-bf00-02cc46bb1724'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:31.864072 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3881d0e1-0131-4213-b84f-36408545e743 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.4654186 Dec 21 03:56:31.869286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60770) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:31.880877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Request body: {'subnet': {'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-subnet', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:31.908663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:31.957290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8e4077fa-aaaf-4778-9259-2f00e4ef42a7 None None] Provisioning complete for port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:31.958144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e4077fa-aaaf-4778-9259-2f00e4ef42a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.054627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.076942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Made reservation on behalf of 7d3d7b72cbb3443392bc9a612c74511c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:32.084318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.105684 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] Set router 51cca181-9cee-4e4e-bf00-02cc46bb1724 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:32.107838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fdf5929d-4a6d-4141-a192-66db327cd55e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:32.132353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '05af4aed-43f0-4344-9587-0a147eb02792') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:32.132648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '05af4aed-43f0-4344-9587-0a147eb02792') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:32.190094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.217812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.220575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32ed90b1-2d6f-493d-bcf8-5c9365e1d36d req-75bea362-97cd-4bf7-bf44-6d9459eae1aa tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 210 time: 0.0731511 Dec 21 03:56:32.245508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:56:32.246069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.254384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eec0ef1-8470-4c79-9bfe-4ee09ba1c1a3 None None] Pushing event updated for resources: {'Port': ['ID=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:32.322332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e4077fa-aaaf-4778-9259-2f00e4ef42a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:56:32.369120 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:56:32.386607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Made reservation on behalf of 5aa4830586124e6a8a42b9502b0fc7c2 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:32.398980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 2, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:32.399135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.450057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Checking router: 1cfcc743-8714-4e30-ac55-8bea218057cc for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:32.450880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Updating router 1cfcc743-8714-4e30-ac55-8bea218057cc port 8e8edf66-71e6-4265-b442-7de4ff8867d4 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:32.492823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.509718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.521977 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] 10.222.0.18 "DELETE /v2.0/networks/fdf5929d-4a6d-4141-a192-66db327cd55e HTTP/1.1" status: 204 len: 168 time: 0.8191750 Dec 21 03:56:32.527617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8e4077fa-aaaf-4778-9259-2f00e4ef42a7 None None] For port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:32.546232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.581770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60786) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:32.603571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452d3191-d3ee-460a-9169-7f5d48812bec admin admin] Pushing event deleted for resources: {'Network': ['ID=fdf5929d-4a6d-4141-a192-66db327cd55e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:32.614950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest_v242-835603900-network', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:32.735914 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0b60559b-cb0f-4c3d-b6d3-97e08d4d523a', 'name': '', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'mac_address': 'fa:16:3e:a8:23:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_interface', 'standard_attr_id': 1404, 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:23Z', 'updated_at': '2021-12-21T03:56:31Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'subnets': [{'id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:32.774088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-127003f3-e31f-4fc9-a2dd-3bbdd7d6bccf None None] The sync data for ids ['51cca181-9cee-4e4e-bf00-02cc46bb1724'] in n-d-822053-11 is: [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:56:24Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0b60559b-cb0f-4c3d-b6d3-97e08d4d523a', 'name': '', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'mac_address': 'fa:16:3e:a8:23:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_interface', 'standard_attr_id': 1404, 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:23Z', 'updated_at': '2021-12-21T03:56:31Z', 'revision_number': 4, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'subnets': [{'id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:32.783179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e7dfd89c-f813-486c-abd8-a7763ecccf4e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:32.793166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.811032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e4077fa-aaaf-4778-9259-2f00e4ef42a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.811400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Transition to ACTIVE for port object e7dfd89c-f813-486c-abd8-a7763ecccf4e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:56:32.863736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.865329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Made reservation on behalf of a5404da396354872bc7c319caf0d4bb2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:32.868052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.898753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.900095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e4077fa-aaaf-4778-9259-2f00e4ef42a7 None None] Pushing event updated for resources: {'Port': ['ID=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:32.917540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:32.954215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Pushing event updated for resources: {'Subnet': ['ID=cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:32.995041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Checking segment: {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:32.995560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Network hostable DHCP agents. Network: 21911ef5-8ca7-4129-bc39-61ca0f42e46e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:56:33.002970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b4b6f9cb-e317-4a9c-ab3c-93ecc53cafa0 None None] Provisioning complete for port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:33.003760 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4b6f9cb-e317-4a9c-ab3c-93ecc53cafa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.112866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:56:33.126840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Pushing event updated for resources: {'Port': ['ID=e7dfd89c-f813-486c-abd8-a7763ecccf4e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:33.184183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Allocated IP 172.20.0.11 (1bfeb879-d5e1-4651-ae97-290a586eba8e/bb3135ec-e693-4805-af80-f05f5d44e73c/1f79ae95-425a-4afe-b09d-4ffd986b72d0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:33.201501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 21911ef5-8ca7-4129-bc39-61ca0f42e46e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:33.206673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:33.211363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.211507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.219443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60f688b2-8f4c-4a12-9bcd-f9884d7904d1 None None] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:33.223491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:33.359319 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a36e38a8-3448-41f1-9b23-d761b31d5e7d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=811cd4c8ce3c40c69d5b84fba08dd2ce&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1302562 Dec 21 03:56:33.360621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60800) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:33.375537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.412979 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4300921f-9a3c-4c50-b056-0f339bc5c53f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.5367489 Dec 21 03:56:33.414456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.416045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60802) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:33.422768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Request body: {'router': {'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:33.452163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Attempting to bind port e7dfd89c-f813-486c-abd8-a7763ecccf4e on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:33.452829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Attempting to bind port e7dfd89c-f813-486c-abd8-a7763ecccf4e by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:33.453335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Attempting to bind port e7dfd89c-f813-486c-abd8-a7763ecccf4e on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:33.478228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60804) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:33.487793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Port e7dfd89c-f813-486c-abd8-a7763ecccf4e on network 1bfeb879-d5e1-4651-ae97-290a586eba8e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:56:33.488120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Attempting to bind port e7dfd89c-f813-486c-abd8-a7763ecccf4e on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:33.507740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:33.510101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Checking segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:33.510101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Bound using segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:33.510101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Bound port: e7dfd89c-f813-486c-abd8-a7763ecccf4e, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:33.510101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.517989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cba9839a-3664-4fd7-81d7-8e369ee1b66a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.545151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8666508b-bac0-4830-ace5-f666b407ea03 None None] Pushing event updated for resources: {'Port': ['ID=8e8edf66-71e6-4265-b442-7de4ff8867d4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:33.569760 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cba9839a-3664-4fd7-81d7-8e369ee1b66a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.585854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.612528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.615508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.636970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54436c13-40ad-4aa1-85f1-6aeaeca64a2d req-7459d6f5-a7a5-4aac-95cd-621a60412be3 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 210 time: 0.2073014 Dec 21 03:56:33.740983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:33.740983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-21911ef5-8ca7-4129-bc39-61ca0f42e46e', 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e', 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'fixed_ips': [{'subnet_id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:56:33.740983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.798332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] For port e7dfd89c-f813-486c-abd8-a7763ecccf4e, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:33.800528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] For port e7dfd89c-f813-486c-abd8-a7763ecccf4e, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e7dfd89c-f813-486c-abd8-a7763ecccf4e,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:33.801845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:56:33.852935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ddb42404-38d6-4056-9ca8-7fe3442a76f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.870323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.919598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.947211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:33.948240 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Added segment 72d09991-5ece-42f1-a216-688cf52e3396 of type vlan for network 96d6a39e-5317-4fc0-b645-87386d7cd358 Dec 21 03:56:33.993230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34f2080a-73d1-4ee0-9546-10a960d63321,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.007461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:34.010076 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.010076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] 10.222.0.31 "PUT /v2.0/ports/e7dfd89c-f813-486c-abd8-a7763ecccf4e HTTP/1.1" status: 200 len: 1092 time: 2.5423901 Dec 21 03:56:34.010076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'tag': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:34.012295 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6" -d '{"events": [{"name": "network-changed", "server_uuid": "f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e", "tag": "e7dfd89c-f813-486c-abd8-a7763ecccf4e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:34.033666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cba9839a-3664-4fd7-81d7-8e369ee1b66a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.048665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cba9839a-3664-4fd7-81d7-8e369ee1b66a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.054083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cba9839a-3664-4fd7-81d7-8e369ee1b66a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b886fb02-2b89-4ef5-b70d-e3425d3cb003 HTTP/1.1" status: 204 len: 168 time: 0.6890941 Dec 21 03:56:34.078546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.113878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55e289e-556d-404a-8dc4-d8270dca5647 service neutron] Pushing event updated for resources: {'Port': ['ID=e7dfd89c-f813-486c-abd8-a7763ecccf4e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.125766 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34befd89-1307-4a9b-b9a3-82ded907eaf7 x-openstack-request-id: req-34befd89-1307-4a9b-b9a3-82ded907eaf7 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:34.126068 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e", "tag": "e7dfd89c-f813-486c-abd8-a7763ecccf4e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:34.126349 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-34befd89-1307-4a9b-b9a3-82ded907eaf7 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:34.126957 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'tag': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e', 'status': 'completed', 'code': 200} Dec 21 03:56:34.151862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.215742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba9839a-3664-4fd7-81d7-8e369ee1b66a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b886fb02-2b89-4ef5-b70d-e3425d3cb003,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.251311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.253754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:34.254743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.322802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Allocated IP 172.20.0.2 (21911ef5-8ca7-4129-bc39-61ca0f42e46e/cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a/60c5cd47-4d47-4015-8362-00f246c0c3e6) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:34.329154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.334962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ddb42404-38d6-4056-9ca8-7fe3442a76f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.353690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Attempting to bind port 8e8edf66-71e6-4265-b442-7de4ff8867d4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:34.354068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Attempting to bind port 8e8edf66-71e6-4265-b442-7de4ff8867d4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:34.354620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Attempting to bind port 8e8edf66-71e6-4265-b442-7de4ff8867d4 on network 4915ee69-a87c-4f15-b553-d1750c9a5a88 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:34.371401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:34.371817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Checking segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:34.372224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.372621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Bound using segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:34.373101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Bound port: 8e8edf66-71e6-4265-b442-7de4ff8867d4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:34.373485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.402281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] Pushing event updated for resources: {'Network': ['ID=96d6a39e-5317-4fc0-b645-87386d7cd358,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.411305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-827e897f-0bd2-409b-b572-5be5124ba883 None None] Provisioning complete for port 8e8edf66-71e6-4265-b442-7de4ff8867d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:34.411826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-827e897f-0bd2-409b-b572-5be5124ba883 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.411918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bbca2d40-43a1-4b0f-99ac-b1a02249e1d7 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.8249359 Dec 21 03:56:34.415973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60824) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:34.422879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Request body: {'subnet': {'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-subnet', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:34.430304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6 req-87073dc7-31e7-4fb0-90d1-511846fdeb40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:34.431777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6 req-87073dc7-31e7-4fb0-90d1-511846fdeb40 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 1095 time: 0.2532973 Dec 21 03:56:34.439574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ddb42404-38d6-4056-9ca8-7fe3442a76f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.463955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:56:34.527540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.542392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] For port 8e8edf66-71e6-4265-b442-7de4ff8867d4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:34.545674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] For port 8e8edf66-71e6-4265-b442-7de4ff8867d4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8e8edf66-71e6-4265-b442-7de4ff8867d4,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:34.571768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb42404-38d6-4056-9ca8-7fe3442a76f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f89b383-417f-49b0-a769-3c5092a994a6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.573958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Made reservation on behalf of a5404da396354872bc7c319caf0d4bb2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:56:34.578519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.599262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Network 1bfeb879-d5e1-4651-ae97-290a586eba8e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:34.611525 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ddb42404-38d6-4056-9ca8-7fe3442a76f0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4bd50d500a924e44914f5abdf59f97e6&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1205263 Dec 21 03:56:34.616248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:34.637917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:34.649218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:34.649441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-827e897f-0bd2-409b-b572-5be5124ba883 None None] Port 8e8edf66-71e6-4265-b442-7de4ff8867d4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:34.657250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:34.657697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.670401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.750914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f18b595c-0333-4923-b2b6-1874a9bb79f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.776950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event updated for resources: {'Port': ['ID=1f79ae95-425a-4afe-b09d-4ffd986b72d0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.810229 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f18b595c-0333-4923-b2b6-1874a9bb79f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:34.884513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8666508b-bac0-4830-ace5-f666b407ea03 None None] Pushing event updated for resources: {'Port': ['ID=8e8edf66-71e6-4265-b442-7de4ff8867d4,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:34.889685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:34.890325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:35.000312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:35.001302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.005722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f18b595c-0333-4923-b2b6-1874a9bb79f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.013364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f18b595c-0333-4923-b2b6-1874a9bb79f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.014454 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f18b595c-0333-4923-b2b6-1874a9bb79f1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0f89b383-417f-49b0-a769-3c5092a994a6 HTTP/1.1" status: 204 len: 168 time: 0.3932116 Dec 21 03:56:35.018641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6 req-89c6243e-21f7-40df-bf58-fe26a2624305 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:35.020847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6 req-89c6243e-21f7-40df-bf58-fe26a2624305 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&shared=False HTTP/1.1" status: 200 len: 913 time: 0.5671892 Dec 21 03:56:35.050133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.080576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18b595c-0333-4923-b2b6-1874a9bb79f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f89b383-417f-49b0-a769-3c5092a994a6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:35.126988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.153972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.171161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.207884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-2a9ba2aa-07fc-4de7-a754-105d79932594 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.6390278 Dec 21 03:56:35.250413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:35.255829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:35.259201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4845daef-196c-42ac-9e1f-462a936d6c69 req-592763e5-0598-4814-ac7a-a95e6ce4955f tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:35.259368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:35.260306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4845daef-196c-42ac-9e1f-462a936d6c69 req-592763e5-0598-4814-ac7a-a95e6ce4955f tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 932 time: 0.4795599 Dec 21 03:56:35.275343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Request body: {'port': {'device_id': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:35.295605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Allocated IP 172.25.5.56 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/760d1620-100f-4e39-9b47-360f0f3306ff) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:35.296837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:35.303661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Pushing event updated for resources: {'Port': ['ID=60c5cd47-4d47-4015-8362-00f246c0c3e6,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:35.380364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-18361513-e135-49a9-9865-9f6f08843da5 None None] Provisioning complete for port 8e8edf66-71e6-4265-b442-7de4ff8867d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:35.380724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18361513-e135-49a9-9865-9f6f08843da5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.386066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4845daef-196c-42ac-9e1f-462a936d6c69 req-32c353da-ec3f-4345-a6ee-19916e53c169 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034226 Dec 21 03:56:35.453278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.454973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.461143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6 req-0f5b3078-036b-46fa-ad50-5fd26bd72157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:35.461143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dadd76a-dde7-4ff8-a946-9be684aa7fa6 req-0f5b3078-036b-46fa-ad50-5fd26bd72157 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4128683 Dec 21 03:56:35.505785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Attempting to bind port 60c5cd47-4d47-4015-8362-00f246c0c3e6 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:35.507386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Attempting to bind port 60c5cd47-4d47-4015-8362-00f246c0c3e6 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:35.507972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Attempting to bind port 60c5cd47-4d47-4015-8362-00f246c0c3e6 on network 21911ef5-8ca7-4129-bc39-61ca0f42e46e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:35.553989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:35.554382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Checking segment: {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:35.554784 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.555348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Bound using segment: {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:35.555786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Bound port: 60c5cd47-4d47-4015-8362-00f246c0c3e6, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:35.556113 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.608742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.619829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.706597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] For port 60c5cd47-4d47-4015-8362-00f246c0c3e6, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:35.713252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] For port 60c5cd47-4d47-4015-8362-00f246c0c3e6, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=60c5cd47-4d47-4015-8362-00f246c0c3e6,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:35.714766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18361513-e135-49a9-9865-9f6f08843da5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.725498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:35.757626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Pushing event updated for resources: {'Port': ['ID=760d1620-100f-4e39-9b47-360f0f3306ff,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:35.762211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:35.767075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-18361513-e135-49a9-9865-9f6f08843da5 None None] For port 8e8edf66-71e6-4265-b442-7de4ff8867d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8e8edf66-71e6-4265-b442-7de4ff8867d4,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:35.767277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:35.773659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:34Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:35.778579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc95ba4d-c49d-4d0b-aa53-7bce182d58ea None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:35.808181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.810383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3169d770-3baf-4c4f-8c38-e159167cccce None None] The sync data for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 is: [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:34Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:35.929317 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18361513-e135-49a9-9865-9f6f08843da5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:35.992414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64b3be7-bf8c-482c-b8fe-940ca6767b99 None None] Pushing event updated for resources: {'Port': ['ID=60c5cd47-4d47-4015-8362-00f246c0c3e6,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:36.111015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18361513-e135-49a9-9865-9f6f08843da5 None None] Pushing event updated for resources: {'Port': ['ID=8e8edf66-71e6-4265-b442-7de4ff8867d4,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:36.116359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b2926bae-1e72-413d-b716-414220a1454b None None] Provisioning complete for port 760d1620-100f-4e39-9b47-360f0f3306ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:36.116935 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2926bae-1e72-413d-b716-414220a1454b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.173031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b2926bae-1e72-413d-b716-414220a1454b None None] Port 760d1620-100f-4e39-9b47-360f0f3306ff cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:36.183233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f84907c1-819c-4ef4-9637-ca8b601c71e2,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:36.190724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-21bb9e1e-3fbf-4d7a-8c0b-d8c7f3ad9bf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:36.192602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-21bb9e1e-3fbf-4d7a-8c0b-d8c7f3ad9bf4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 1095 time: 0.6555917 Dec 21 03:56:36.326443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Checking segment: {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:36.327097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Network hostable DHCP agents. Network: 96d6a39e-5317-4fc0-b645-87386d7cd358, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:56:36.332789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-c7a7fd84-7aa3-40da-9d00-4fff6c4f7786 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e7dfd89c-f813-486c-abd8-a7763ecccf4e HTTP/1.1" status: 200 len: 217 time: 0.1028490 Dec 21 03:56:36.396056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.483346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:56:36.493605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-3b04aa1b-31d5-4db1-a8c4-b870f7efe37d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:36.495282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-3b04aa1b-31d5-4db1-a8c4-b870f7efe37d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 200 len: 852 time: 0.1476455 Dec 21 03:56:36.589483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ee08df9b-f4f8-49d7-9635-502fc79e6556 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1bfeb879-d5e1-4651-ae97-290a586eba8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0809197 Dec 21 03:56:36.684106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f79ae95-425a-4afe-b09d-4ffd986b72d0 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:36.689389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 96d6a39e-5317-4fc0-b645-87386d7cd358) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:36.695570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:36.696316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.699667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5da06fe0-f2c2-482d-9ef7-2dc6486d78d6 None None] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:36.708318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.752189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-413f0e75-d15f-4d93-a5a2-c8726f24f835 req-04bbbc16-234a-4b6e-93e5-9922cbf7ee23 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:36.760358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-413f0e75-d15f-4d93-a5a2-c8726f24f835 req-04bbbc16-234a-4b6e-93e5-9922cbf7ee23 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 932 time: 0.2515969 Dec 21 03:56:36.770988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Transition to ACTIVE for port object 1f79ae95-425a-4afe-b09d-4ffd986b72d0 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:56:36.774229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-baf32447-d4e4-420e-a952-b428066a0ddb service neutron] 10.222.0.31 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1712127 Dec 21 03:56:36.801395 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.843216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.854287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-56d05dc7-7227-4da1-a8a9-0f9ac265c3e4 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.4308138 Dec 21 03:56:36.857657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60872) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:36.861873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:56:36.892655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-96d6a39e-5317-4fc0-b645-87386d7cd358', 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'fixed_ips': [{'subnet_id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:56:36.893817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:36.902006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-413f0e75-d15f-4d93-a5a2-c8726f24f835 req-1d70565e-9ec5-4840-b85b-015a66e3b08f tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1407011 Dec 21 03:56:36.981667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Pushing event updated for resources: {'Port': ['ID=1f79ae95-425a-4afe-b09d-4ffd986b72d0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:37.009829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-e22fe3c3-cf1f-41f2-9b6f-f3a2dd3aa5da service neutron] 10.222.0.31 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2227914 Dec 21 03:56:37.032892 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.034109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.067094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Attempting to bind port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:37.067583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Attempting to bind port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:37.067925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Attempting to bind port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:37.074334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 on network 1bfeb879-d5e1-4651-ae97-290a586eba8e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:56:37.074674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Attempting to bind port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 on network 1bfeb879-d5e1-4651-ae97-290a586eba8e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:37.080792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:37.081143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Checking segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:37.082117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Bound using segment: {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:37.082635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Bound port: 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5601a3fe-5cce-43a8-9085-a8fef024cc6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:37.083029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.095609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.106970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Allocated IP 172.20.0.2 (96d6a39e-5317-4fc0-b645-87386d7cd358/f84907c1-819c-4ef4-9637-ca8b601c71e2/523be078-57d7-4932-a770-82f71107ba1a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:37.141152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:56:37.189962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] For port 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:37.189962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] For port 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:37.278310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.336858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.370790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:37.375708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.377326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] 10.222.0.31 "PUT /v2.0/ports/1f79ae95-425a-4afe-b09d-4ffd986b72d0 HTTP/1.1" status: 200 len: 1093 time: 2.1129489 Dec 21 03:56:37.386299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'tag': '1f79ae95-425a-4afe-b09d-4ffd986b72d0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:37.394296 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb13f649-cd59-4706-abcf-c24a3aba7917" -d '{"events": [{"name": "network-changed", "server_uuid": "480fd09f-0036-4e38-b2f7-2f0ab1983531", "tag": "1f79ae95-425a-4afe-b09d-4ffd986b72d0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:37.423455 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.508317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:37.519911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:37.525650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:37.530557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:37.546447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1dd508-2190-434e-9e70-a67ade00f112 service neutron] Pushing event updated for resources: {'Port': ['ID=1f79ae95-425a-4afe-b09d-4ffd986b72d0,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:37.572585 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30bf0214-ac4a-4cd9-ac9a-761d4dda0850 x-openstack-request-id: req-30bf0214-ac4a-4cd9-ac9a-761d4dda0850 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:37.573845 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "480fd09f-0036-4e38-b2f7-2f0ab1983531", "tag": "1f79ae95-425a-4afe-b09d-4ffd986b72d0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:37.575292 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-30bf0214-ac4a-4cd9-ac9a-761d4dda0850 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:37.577980 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'tag': '1f79ae95-425a-4afe-b09d-4ffd986b72d0', 'status': 'completed', 'code': 200} Dec 21 03:56:37.622453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e159463d-9058-4465-82b6-bcd143d57dee None None] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:37.680629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ecce1e11-53fd-421f-a62f-04e565b09464 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:37.680629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ecce1e11-53fd-421f-a62f-04e565b09464 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 1096 time: 0.1144173 Dec 21 03:56:37.761452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-7ed34707-bbcc-4857-b6f6-001c59ffd5cd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0 HTTP/1.1" status: 200 len: 217 time: 0.0610111 Dec 21 03:56:37.766013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Pushing event updated for resources: {'Port': ['ID=523be078-57d7-4932-a770-82f71107ba1a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:37.777861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Attempting to bind port 523be078-57d7-4932-a770-82f71107ba1a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:37.778542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Attempting to bind port 523be078-57d7-4932-a770-82f71107ba1a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:37.779101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Attempting to bind port 523be078-57d7-4932-a770-82f71107ba1a on network 96d6a39e-5317-4fc0-b645-87386d7cd358 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:37.791065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:37.792000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Checking segment: {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:37.792582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.793221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Bound using segment: {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:37.793852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Bound port: 523be078-57d7-4932-a770-82f71107ba1a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:37.794484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.900636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6026cfb-87a7-4a80-8f8d-6865069f5048 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:37.945792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-986ce52f-36af-4cff-a65b-5d1f586ff2ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:37.947556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-986ce52f-36af-4cff-a65b-5d1f586ff2ec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 200 len: 852 time: 0.1721401 Dec 21 03:56:37.998676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-43e8f7d2-c30b-4c61-979a-5b41dcd4af76 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1bfeb879-d5e1-4651-ae97-290a586eba8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0374074 Dec 21 03:56:38.183313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c59e856-23c3-4b91-8a32-40f123c543fb req-8ba1f57e-e54f-4b7c-abd4-40e494d05b86 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:38.187947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c59e856-23c3-4b91-8a32-40f123c543fb req-8ba1f57e-e54f-4b7c-abd4-40e494d05b86 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 944 time: 0.1688490 Dec 21 03:56:38.255502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] For port 523be078-57d7-4932-a770-82f71107ba1a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:38.258699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] For port 523be078-57d7-4932-a770-82f71107ba1a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=523be078-57d7-4932-a770-82f71107ba1a,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:38.271079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.279943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8e8edf66-71e6-4265-b442-7de4ff8867d4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:38.286922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d553ceb-44c1-41ea-a114-0798a711f6fa None None] Provisioning complete for port 60c5cd47-4d47-4015-8362-00f246c0c3e6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:38.286922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d553ceb-44c1-41ea-a114-0798a711f6fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.310234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-ab3ce83c-3fc2-48f3-9957-0f818b876eae service neutron] 10.222.0.31 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3015935 Dec 21 03:56:38.315678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:38.327673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6026cfb-87a7-4a80-8f8d-6865069f5048 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.329965 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Sync routers for ids ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:38.351432 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Routers {'4a95ea4a-ece9-4a91-8ca0-6054160833e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:38.356946 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:38.380143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c59e856-23c3-4b91-8a32-40f123c543fb req-b0f0be61-da79-4b36-8ca4-5cea0c4aead4 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1774652 Dec 21 03:56:38.390595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.444080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc9e12bf-cb6a-4adf-ac51-c84de1910476 req-265dd56f-b297-4665-9858-c16c84505717 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0468109 Dec 21 03:56:38.448524 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6026cfb-87a7-4a80-8f8d-6865069f5048 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.463996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.469952 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-601e7f0f-2c71-439d-a461-ca94d5829cbf admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 5.0527372 Dec 21 03:56:38.471951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60912) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:38.497585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c6026cfb-87a7-4a80-8f8d-6865069f5048 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f8ab10ed60f147eeaa912b66dcf5e011&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9719663 Dec 21 03:56:38.499010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60914) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:38.533492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3dfde8-11e9-4947-862f-6568eb32f993 None None] Pushing event updated for resources: {'Port': ['ID=523be078-57d7-4932-a770-82f71107ba1a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:38.636895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8e8edf66-71e6-4265-b442-7de4ff8867d4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:38.637329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.650078 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Set router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:38.676403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6026cfb-87a7-4a80-8f8d-6865069f5048 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91a7716e-63c0-4535-89ce-46f6978e4d12,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:38.770663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f4385de-3a65-4f00-82f1-a5501296bce9 req-b5baf4cd-1929-4205-8541-d42f947dba44 service neutron] 10.222.0.31 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4375350 Dec 21 03:56:38.772060 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d553ceb-44c1-41ea-a114-0798a711f6fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.776270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ade6d6-19c9-47cb-a730-9d9520f0b2c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.814003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ade6d6-19c9-47cb-a730-9d9520f0b2c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.858739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2d553ceb-44c1-41ea-a114-0798a711f6fa None None] For port 60c5cd47-4d47-4015-8362-00f246c0c3e6, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=60c5cd47-4d47-4015-8362-00f246c0c3e6,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:38.902910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 60c5cd47-4d47-4015-8362-00f246c0c3e6 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:38.976306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ade6d6-19c9-47cb-a730-9d9520f0b2c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.981127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d553ceb-44c1-41ea-a114-0798a711f6fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.985726 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ade6d6-19c9-47cb-a730-9d9520f0b2c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:38.985726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-35ade6d6-19c9-47cb-a730-9d9520f0b2c7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/91a7716e-63c0-4535-89ce-46f6978e4d12 HTTP/1.1" status: 204 len: 168 time: 0.4752018 Dec 21 03:56:38.995737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ade6d6-19c9-47cb-a730-9d9520f0b2c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91a7716e-63c0-4535-89ce-46f6978e4d12,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:39.172311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d553ceb-44c1-41ea-a114-0798a711f6fa None None] Pushing event updated for resources: {'Port': ['ID=60c5cd47-4d47-4015-8362-00f246c0c3e6,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:39.215385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a359310b-93db-499b-a844-861deeabe948 None None] Provisioning complete for port 60c5cd47-4d47-4015-8362-00f246c0c3e6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:39.215764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a359310b-93db-499b-a844-861deeabe948 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:39.216189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-5191f143-89c7-4a65-b1e6-923e051278f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:39.220834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-5191f143-89c7-4a65-b1e6-923e051278f9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 1096 time: 0.1846073 Dec 21 03:56:39.309545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e7dfd89c-f813-486c-abd8-a7763ecccf4e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:56:39.360925 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:56:36Z', 'revision_number': 3, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:39.376558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 60c5cd47-4d47-4015-8362-00f246c0c3e6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:39.379453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:39.418908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:39.454259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:39.473848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-1e58f8ac-f66c-4613-80cb-34707f52b326 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:39.482619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-1e58f8ac-f66c-4613-80cb-34707f52b326 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 200 len: 913 time: 0.2533333 Dec 21 03:56:39.488161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Checking router: 4a95ea4a-ece9-4a91-8ca0-6054160833e8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:39.488728 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Updating router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 port 760d1620-100f-4e39-9b47-360f0f3306ff binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:39.546661 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:39.632123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-ac46063e-79f0-4132-98fc-37184e33bc4c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0 HTTP/1.1" status: 200 len: 217 time: 0.1275241 Dec 21 03:56:39.684847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Allocated IP 172.25.5.240 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/24bebfec-6e4b-4f6f-a32a-ae160e20a465) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:39.734863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port e7dfd89c-f813-486c-abd8-a7763ecccf4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e7dfd89c-f813-486c-abd8-a7763ecccf4e,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:39.758247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'port_id': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e', 'mac_address': 'fa:16:3e:b9:8b:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bb3135ec-e693-4805-af80-f05f5d44e73c', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:56:39.872612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-6a3ed5e4-349c-460f-bcb1-38537d1a1096 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:39.875065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-6a3ed5e4-349c-460f-bcb1-38537d1a1096 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 200 len: 852 time: 0.1205430 Dec 21 03:56:39.886263 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:39.923797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e7dfd89c-f813-486c-abd8-a7763ecccf4e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:39.963474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb939f07-67bd-4e70-b3dc-5e0ed5e78ead req-09422850-f4b1-43c6-afba-3613f2c570b5 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.3248391 Dec 21 03:56:39.996722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port e7dfd89c-f813-486c-abd8-a7763ecccf4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e7dfd89c-f813-486c-abd8-a7763ecccf4e,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:40.017578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-631da2ef-f84b-4c6a-baf2-fd478aacd5ed service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1bfeb879-d5e1-4651-ae97-290a586eba8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0910027 Dec 21 03:56:40.032439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23010ca1-8539-4825-903e-51726ec9efdf req-ff08b9a5-1ced-4fe3-9c01-c58649937e62 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:40.035800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23010ca1-8539-4825-903e-51726ec9efdf req-ff08b9a5-1ced-4fe3-9c01-c58649937e62 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 944 time: 0.3781848 Dec 21 03:56:40.047312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.074062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.095545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.149943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60944) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:40.151645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 523be078-57d7-4932-a770-82f71107ba1a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:40.196484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d5ad55c-510a-426b-98ab-666b9e559b48 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.205246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.212055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23010ca1-8539-4825-903e-51726ec9efdf req-8156fbc2-e3a8-4d6e-9442-ed919f9bd887 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938213 Dec 21 03:56:40.217892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-c2396ca0-1497-4a7a-b629-646201a8ba7e service neutron] 10.222.0.31 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1827974 Dec 21 03:56:40.262598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=e7dfd89c-f813-486c-abd8-a7763ecccf4e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:40.321321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 523be078-57d7-4932-a770-82f71107ba1a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:40.321321 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.328221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:40.422452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb13f649-cd59-4706-abcf-c24a3aba7917 req-cb465652-7553-443b-9132-d7bce04fe3c6 service neutron] 10.222.0.31 "GET /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1938066 Dec 21 03:56:40.440420 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d5ad55c-510a-426b-98ab-666b9e559b48 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.454703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:40.463208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:40.463486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58e829cd-2d53-4c49-adac-34b4ae4e641e None None] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:56:40.470527 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.518431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2d5ad55c-510a-426b-98ab-666b9e559b48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.570151 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.571179 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.582321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2d5ad55c-510a-426b-98ab-666b9e559b48 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e48156a1f11b439f97892f7533a2234e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4282601 Dec 21 03:56:40.583510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d5ad55c-510a-426b-98ab-666b9e559b48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b76bfa27-dafa-4dd1-9e66-f394ba742703,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:40.587711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['e7dfd89c-f813-486c-abd8-a7763ecccf4e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:40.591127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae6ea07f-fd97-4e1c-a517-d0f2c7365172 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:40.598654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60950) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:40.640124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dcc02fc4-c83c-4bfa-a650-88eb2f91daa5 None None] Provisioning complete for port 523be078-57d7-4932-a770-82f71107ba1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:40.640499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dcc02fc4-c83c-4bfa-a650-88eb2f91daa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.642533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Pushing event updated for resources: {'Port': ['ID=24bebfec-6e4b-4f6f-a32a-ae160e20a465,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:40.655337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Allocated IP 172.20.0.1 (21911ef5-8ca7-4129-bc39-61ca0f42e46e/cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a/088ea98c-12cd-4d33-ae1a-65da3f7daaf5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:40.666741 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Attempting to bind port 760d1620-100f-4e39-9b47-360f0f3306ff on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:40.667494 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Attempting to bind port 760d1620-100f-4e39-9b47-360f0f3306ff by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:40.668080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Attempting to bind port 760d1620-100f-4e39-9b47-360f0f3306ff on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:40.670692 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8006b436-9492-4988-b480-9db6ddc88a2d None None] Pushing event updated for resources: {'Port': ['ID=760d1620-100f-4e39-9b47-360f0f3306ff,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:40.679579 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:40.680168 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:40.680805 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.681546 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:40.683478 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Bound port: 760d1620-100f-4e39-9b47-360f0f3306ff, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:40.684367 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.743846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6e0aeb6-142c-4846-8883-091e0eaab670 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:40.756566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 523be078-57d7-4932-a770-82f71107ba1a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=523be078-57d7-4932-a770-82f71107ba1a,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:40.766335 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:56:40.814578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55983a3b-8d55-4d9d-a93c-002632b617a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.824205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] For port 760d1620-100f-4e39-9b47-360f0f3306ff, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:40.837543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] For port 760d1620-100f-4e39-9b47-360f0f3306ff, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=760d1620-100f-4e39-9b47-360f0f3306ff,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:40.870027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55983a3b-8d55-4d9d-a93c-002632b617a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.877675 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.878471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 60c5cd47-4d47-4015-8362-00f246c0c3e6 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:40.897498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.909815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.936085 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:40.992535 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55983a3b-8d55-4d9d-a93c-002632b617a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.000925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55983a3b-8d55-4d9d-a93c-002632b617a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.009078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-55983a3b-8d55-4d9d-a93c-002632b617a8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b76bfa27-dafa-4dd1-9e66-f394ba742703 HTTP/1.1" status: 204 len: 168 time: 0.4142814 Dec 21 03:56:41.034468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55983a3b-8d55-4d9d-a93c-002632b617a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b76bfa27-dafa-4dd1-9e66-f394ba742703,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:41.067933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73b41e86-a3d0-43fb-a210-c5701844420e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:41.093059 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Routers {'4a95ea4a-ece9-4a91-8ca0-6054160833e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:41.093947 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:41.107257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8006b436-9492-4988-b480-9db6ddc88a2d None None] Pushing event updated for resources: {'Port': ['ID=760d1620-100f-4e39-9b47-360f0f3306ff,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:41.134810 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.185363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:41.193280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:41.227761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75a0360d-20e7-414d-997b-68dd9f93283c req-6c613fa5-2192-4b25-9f3c-62f571c5e0ad tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0868402 Dec 21 03:56:41.263020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:41.284272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f79ae95-425a-4afe-b09d-4ffd986b72d0 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:56:41.330460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=523be078-57d7-4932-a770-82f71107ba1a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:41.359620 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] Set router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:41.377418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Provisioning complete for port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:41.377797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.495990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Pushing event updated for resources: {'Port': ['ID=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:41.501232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.517554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3232270-c147-4424-9990-fee8d35705d3 req-6114de6b-8a09-4e03-8981-4d62deb9b17b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:41.519893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3232270-c147-4424-9990-fee8d35705d3 req-6114de6b-8a09-4e03-8981-4d62deb9b17b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 944 time: 0.1567237 Dec 21 03:56:41.557477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 60c5cd47-4d47-4015-8362-00f246c0c3e6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:41.557857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.585510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3232270-c147-4424-9990-fee8d35705d3 req-1f5203dc-92b1-4338-9dca-3367d8584596 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594933 Dec 21 03:56:41.592928 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.721686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:41.724307 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:56:36Z', 'revision_number': 3, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:41.783921 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d47c68-af9f-4133-a177-9ed14170634f None None] The sync data for ids ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'] in n-d-822053-11 is: [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:56:36Z', 'revision_number': 3, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:41.809546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:41.826832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.833581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Provisioning complete for port 760d1620-100f-4e39-9b47-360f0f3306ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:41.834923 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:41.850334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '1f79ae95-425a-4afe-b09d-4ffd986b72d0', 'network_id': '1bfeb879-d5e1-4651-ae97-290a586eba8e', 'port_id': '1f79ae95-425a-4afe-b09d-4ffd986b72d0', 'mac_address': 'fa:16:3e:dc:25:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bb3135ec-e693-4805-af80-f05f5d44e73c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:56:41.911208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Router 615492c6-acfa-4198-96eb-9577071a4255 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:56:42.030129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.079324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f79ae95-425a-4afe-b09d-4ffd986b72d0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:56:42.163698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:42.170788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.171135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 523be078-57d7-4932-a770-82f71107ba1a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:42.210834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:42.216100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Sync routers for ids ['615492c6-acfa-4198-96eb-9577071a4255'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:42.224085 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.244734 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.272113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.277054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.281087 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c9ba6449-d166-4977-aa98-c49f57f8c9e0 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 5.4197669 Dec 21 03:56:42.281470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60978) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:42.317586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.323657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Routers {'615492c6-acfa-4198-96eb-9577071a4255'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:42.324301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['615492c6-acfa-4198-96eb-9577071a4255'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:42.332194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] For port 760d1620-100f-4e39-9b47-360f0f3306ff, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=760d1620-100f-4e39-9b47-360f0f3306ff,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:42.359428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Pushing event updated for resources: {'Port': ['ID=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:42.479534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:42.481037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:42.721685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:56:42.885217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.893561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 523be078-57d7-4932-a770-82f71107ba1a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:42.893933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:42.915591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8554891f-c805-4697-8c9e-3c4a04e39975 req-805a2ff5-ba8e-42c9-a621-01ff5d9a20e2 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.2293367 Dec 21 03:56:42.959472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2dbc0c-8684-40be-9a40-e5716c8cf46e req-9ba02223-8647-478f-8005-c6dc6908c293 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:42.961664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd2dbc0c-8684-40be-9a40-e5716c8cf46e req-9ba02223-8647-478f-8005-c6dc6908c293 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 945 time: 0.1876035 Dec 21 03:56:43.035642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:43.045986 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80e1d652-3530-459a-84ed-c373d420a3f3 admin admin] 10.222.0.18 "PUT /v2.0/routers/4a95ea4a-ece9-4a91-8ca0-6054160833e8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5716128 Dec 21 03:56:43.058503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1f79ae95-425a-4afe-b09d-4ffd986b72d0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:43.069684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60994) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:43.096169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd2dbc0c-8684-40be-9a40-e5716c8cf46e req-5920675d-f2fb-4179-802a-ce6f514f1287 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264653 Dec 21 03:56:43.205636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fd04c31-07e3-4820-b8f0-c2640b9a4580 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.211248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f79ae95-425a-4afe-b09d-4ffd986b72d0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:43.243345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87bac4c3-9821-4380-a254-d21460e09640 req-dedda538-5c60-48fa-843d-07b2b7c9a309 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0927267 Dec 21 03:56:43.257617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.267827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Set router 615492c6-acfa-4198-96eb-9577071a4255 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:43.331650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e7dfd89c-f813-486c-abd8-a7763ecccf4e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:43.343275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fd04c31-07e3-4820-b8f0-c2640b9a4580 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.398301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fd04c31-07e3-4820-b8f0-c2640b9a4580 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.462234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd04c31-07e3-4820-b8f0-c2640b9a4580 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94f77f6d-5983-48b5-891d-0cbcaf25bf5e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:43.472463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6fd04c31-07e3-4820-b8f0-c2640b9a4580 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9e251dd31deb4dc3a8ab87381e383f72&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4016659 Dec 21 03:56:43.473258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32776) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:43.533895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62c831e6-73f2-4c44-b29a-0015a66b47f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.563857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62c831e6-73f2-4c44-b29a-0015a66b47f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.588826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Allocated IP 172.20.0.1 (96d6a39e-5317-4fc0-b645-87386d7cd358/f84907c1-819c-4ef4-9637-ca8b601c71e2/8ed4a0fb-cadd-405a-b52d-e0154cea65e0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:56:43.616804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Provisioning complete for port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:43.617181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.703532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d608ba38-3b64-40d6-b60a-e6848a97349b None None] Pushing event updated for resources: {'Port': ['ID=760d1620-100f-4e39-9b47-360f0f3306ff,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:43.712763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62c831e6-73f2-4c44-b29a-0015a66b47f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.715684 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-62c831e6-73f2-4c44-b29a-0015a66b47f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.720358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-62c831e6-73f2-4c44-b29a-0015a66b47f6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/94f77f6d-5983-48b5-891d-0cbcaf25bf5e HTTP/1.1" status: 204 len: 168 time: 0.2459507 Dec 21 03:56:43.729690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:43.739832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62c831e6-73f2-4c44-b29a-0015a66b47f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94f77f6d-5983-48b5-891d-0cbcaf25bf5e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:43.766642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T03:56:40Z', 'revision_number': 3, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:43.769960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-b5f13844-2a6f-4142-8100-70d09eccce68 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.1399179 Dec 21 03:56:43.774804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Provisioning complete for port 523be078-57d7-4932-a770-82f71107ba1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:43.775455 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.818835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.855480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port e7dfd89c-f813-486c-abd8-a7763ecccf4e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:56:43.872044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Checking router: 615492c6-acfa-4198-96eb-9577071a4255 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:43.872413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Updating router 615492c6-acfa-4198-96eb-9577071a4255 port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:43.908824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port e7dfd89c-f813-486c-abd8-a7763ecccf4e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:43.909210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:43.997591 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:44.018737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:44.265609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21553492-58e4-4327-8599-7c05d49fa69f req-2a3ea9eb-71d1-4ff1-8cc1-b589e3abfa28 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.2344551 Dec 21 03:56:44.297042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:44.338074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:44.365782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:56:44.570854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 760d1620-100f-4e39-9b47-360f0f3306ff up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:44.603692 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Sync routers for ids ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:44.622717 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Routers {'4a95ea4a-ece9-4a91-8ca0-6054160833e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:44.622717 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:44.696624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.703986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.706798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.706954 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:44.708717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.711754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.713685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.715144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.720685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-74874a0d-b396-49df-afc7-58c8445d9471 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6497 time: 0.7504904 Dec 21 03:56:44.740797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:44.861562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port e7dfd89c-f813-486c-abd8-a7763ecccf4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e7dfd89c-f813-486c-abd8-a7763ecccf4e,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:44.878411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:44.880738 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28abb5f8-d073-4624-874e-c921df0034f8" -d '{"events": [{"server_uuid": "f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e", "name": "network-vif-plugged", "status": "completed", "tag": "e7dfd89c-f813-486c-abd8-a7763ecccf4e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:44.887955 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Set router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:44.893073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Pushing event updated for resources: {'Port': ['ID=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:44.940764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Provisioning complete for port 760d1620-100f-4e39-9b47-360f0f3306ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:44.940991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e18cfcc-ea65-44e3-8b53-2760574328f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:44.990090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e0c7df-6d85-439e-8013-d57589514f8c req-238a7964-f582-4a6c-8083-8fb15bdd753f tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:44.990343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:44.992283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15e0c7df-6d85-439e-8013-d57589514f8c req-238a7964-f582-4a6c-8083-8fb15bdd753f tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 945 time: 0.6557012 Dec 21 03:56:45.003433 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a2652ac-24a6-478a-b3f9-6ee5697dbd3e x-openstack-request-id: req-5a2652ac-24a6-478a-b3f9-6ee5697dbd3e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:45.003767 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e", "name": "network-vif-plugged", "status": "completed", "tag": "e7dfd89c-f813-486c-abd8-a7763ecccf4e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:45.004018 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5a2652ac-24a6-478a-b3f9-6ee5697dbd3e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:45.004426 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e', 'code': 200} Dec 21 03:56:45.018432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 760d1620-100f-4e39-9b47-360f0f3306ff triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:45.018818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.133604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32806) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:45.144865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=e7dfd89c-f813-486c-abd8-a7763ecccf4e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:45.164804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8bc242f-b14b-4dd7-91e8-9b876fee096e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.268392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.274527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f79ae95-425a-4afe-b09d-4ffd986b72d0 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:45.370422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.439176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe438017-5401-484d-8074-5dcca184bcda None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:45.455885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8ba7a843-f2f9-477f-8b50-48108b4dee76 None None] Provisioning complete for port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:45.456740 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ba7a843-f2f9-477f-8b50-48108b4dee76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.457989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Attempting to bind port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:45.458371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Attempting to bind port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:45.459284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Attempting to bind port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:45.462216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93dbaeee-c227-4629-9352-c79dab0f0ea4 None None] Pushing event updated for resources: {'Port': ['ID=24bebfec-6e4b-4f6f-a32a-ae160e20a465,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:45.466380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8bc242f-b14b-4dd7-91e8-9b876fee096e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.495626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:45.495626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:45.496220 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.496449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:45.496936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Bound port: 24bebfec-6e4b-4f6f-a32a-ae160e20a465, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:45.497321 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.534977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8ba7a843-f2f9-477f-8b50-48108b4dee76 None None] Port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:45.544326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:56:45.550373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:45.551029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.567675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8bc242f-b14b-4dd7-91e8-9b876fee096e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.611305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] For port 24bebfec-6e4b-4f6f-a32a-ae160e20a465, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:45.625721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] For port 24bebfec-6e4b-4f6f-a32a-ae160e20a465, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24bebfec-6e4b-4f6f-a32a-ae160e20a465,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:45.629517 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:56:41Z', 'revision_number': 4, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '088ea98c-12cd-4d33-ae1a-65da3f7daaf5', 'name': '', 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'mac_address': 'fa:16:3e:d0:98:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1445, 'fixed_ips': [{'subnet_id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:40Z', 'updated_at': '2021-12-21T03:56:41Z', 'revision_number': 2, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'subnets': [{'id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:45.644388 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b8bc242f-b14b-4dd7-91e8-9b876fee096e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1b696c4ac6094c02af0d6fa3ac2cc0d8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5072997 Dec 21 03:56:45.647785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32814) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:45.657399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8bc242f-b14b-4dd7-91e8-9b876fee096e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9181879e-8fc3-46c8-99b8-4d6917a5bbf9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:45.732519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f587fb1-f21a-41fd-9c79-12247e17ed68 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.732752 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.735909 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Checking router: 4a95ea4a-ece9-4a91-8ca0-6054160833e8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:45.740144 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Updating router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:45.774016 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f587fb1-f21a-41fd-9c79-12247e17ed68 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.828731 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.929452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d077f944-415e-4072-ab44-531dac320979 None None] Provisioning complete for port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:45.931403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d077f944-415e-4072-ab44-531dac320979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.935287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f587fb1-f21a-41fd-9c79-12247e17ed68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.944204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f587fb1-f21a-41fd-9c79-12247e17ed68 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:45.946470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f587fb1-f21a-41fd-9c79-12247e17ed68 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9181879e-8fc3-46c8-99b8-4d6917a5bbf9 HTTP/1.1" status: 204 len: 168 time: 0.2967267 Dec 21 03:56:45.957851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd39675e-ec02-4ca4-8e5d-261ba337ae55 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:56:45.963027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f587fb1-f21a-41fd-9c79-12247e17ed68 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9181879e-8fc3-46c8-99b8-4d6917a5bbf9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:46.081558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1713064-0586-4ff7-bb41-2d9fdbbff35a req-003b39a0-ad00-48dd-97a0-86446173592a tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.1774840 Dec 21 03:56:46.257930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15e0c7df-6d85-439e-8013-d57589514f8c req-9059055c-7e23-4398-a226-a2fcd8c3a6e4 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.2475176 Dec 21 03:56:46.263148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-59a464c6-18b2-4e4c-b47f-090a2c618000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:46.275689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-59a464c6-18b2-4e4c-b47f-090a2c618000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:46.276163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-59a464c6-18b2-4e4c-b47f-090a2c618000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:46.277883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-59a464c6-18b2-4e4c-b47f-090a2c618000 service neutron] 10.222.0.54 "GET /v2.0/networks?id=04ed2fa2-4e59-410d-9778-4535a349c6b9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=19393033-2861-465d-ab20-b8ec53781acb&id=19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 200 len: 2293 time: 1.4002182 Dec 21 03:56:46.281212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ea65b4-879c-45aa-bff7-9fa2f113c4ef req-8ccc7464-83a5-4f23-8ff1-d29582302338 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:46.292722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23ea65b4-879c-45aa-bff7-9fa2f113c4ef req-8ccc7464-83a5-4f23-8ff1-d29582302338 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 1097 time: 1.1232376 Dec 21 03:56:46.345116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93dbaeee-c227-4629-9352-c79dab0f0ea4 None None] Pushing event updated for resources: {'Port': ['ID=24bebfec-6e4b-4f6f-a32a-ae160e20a465,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:46.352773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Routers {'615492c6-acfa-4198-96eb-9577071a4255'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:46.353286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['615492c6-acfa-4198-96eb-9577071a4255'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:46.405535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.465116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d077f944-415e-4072-ab44-531dac320979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.496840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d077f944-415e-4072-ab44-531dac320979 None None] For port 24bebfec-6e4b-4f6f-a32a-ae160e20a465, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24bebfec-6e4b-4f6f-a32a-ae160e20a465,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:46.591898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23ea65b4-879c-45aa-bff7-9fa2f113c4ef req-926798a6-e9cb-410a-9bce-a9a96cc179d1 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2781858 Dec 21 03:56:46.616060 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.625476 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.634348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-26a138d2-27e0-4d2f-935d-d8d5b4d8488a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 200 len: 1000 time: 0.3404753 Dec 21 03:56:46.636135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:46.637839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d077f944-415e-4072-ab44-531dac320979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.709918 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.721996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d077f944-415e-4072-ab44-531dac320979 None None] Pushing event updated for resources: {'Port': ['ID=24bebfec-6e4b-4f6f-a32a-ae160e20a465,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:46.746817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] Set router 615492c6-acfa-4198-96eb-9577071a4255 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:46.790295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-ae9d28f0-4e98-4d41-8e6c-543880642f82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:46.792129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-ae9d28f0-4e98-4d41-8e6c-543880642f82 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c714b82d-d957-4fc4-96b0-f175d6a234f5 HTTP/1.1" status: 200 len: 851 time: 0.1486423 Dec 21 03:56:46.881819 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cafac1c-6ecb-46ee-8e82-272ab63c724a None None] Pushing event updated for resources: {'Port': ['ID=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:46.903896 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.955816 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Attempting to bind port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:46.956184 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Attempting to bind port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:46.957846 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Attempting to bind port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 on network 21911ef5-8ca7-4129-bc39-61ca0f42e46e {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:46.965880 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:46.966310 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Checking segment: {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:46.966917 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:46.967496 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Bound using segment: {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:46.968166 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Bound port: 088ea98c-12cd-4d33-ae1a-65da3f7daaf5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '107d90a9-660d-4174-a56c-6bd9f4371d67', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:46.968712 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:47.029565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f79ae95-425a-4afe-b09d-4ffd986b72d0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:47.063201 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-543d55bb-27fb-4709-8949-0e2894ee3321" -d '{"events": [{"server_uuid": "480fd09f-0036-4e38-b2f7-2f0ab1983531", "name": "network-vif-plugged", "status": "completed", "tag": "1f79ae95-425a-4afe-b09d-4ffd986b72d0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:47.103606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:47.121108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-9b53d9a0-6476-4ad4-8a4d-2d4caa3d0299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:47.126096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-9b53d9a0-6476-4ad4-8a4d-2d4caa3d0299 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=04ed2fa2-4e59-410d-9778-4535a349c6b9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3107846 Dec 21 03:56:47.190010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] For port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:47.197529 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] For port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:47.210060 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:47.215823 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-243343b9-339e-4e1b-81c5-128dc09efb32 x-openstack-request-id: req-243343b9-339e-4e1b-81c5-128dc09efb32 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:47.216348 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "480fd09f-0036-4e38-b2f7-2f0ab1983531", "name": "network-vif-plugged", "status": "completed", "tag": "1f79ae95-425a-4afe-b09d-4ffd986b72d0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:47.216743 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-243343b9-339e-4e1b-81c5-128dc09efb32 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:47.217283 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f79ae95-425a-4afe-b09d-4ffd986b72d0', 'code': 200} Dec 21 03:56:47.224797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-de9392c2-21aa-4454-bb9f-7b52a484ad61 None None] Provisioning complete for port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:47.225415 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-de9392c2-21aa-4454-bb9f-7b52a484ad61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:47.273556 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:47.441813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1f79ae95-425a-4afe-b09d-4ffd986b72d0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:47.492088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Pushing event updated for resources: {'Port': ['ID=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:47.533610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:47.640151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b3401e-ec5d-4ba9-8ef3-9b66c66a33ef req-87be1569-b944-482d-8870-f61087d35d40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:47.643086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37b3401e-ec5d-4ba9-8ef3-9b66c66a33ef req-87be1569-b944-482d-8870-f61087d35d40 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 1098 time: 0.3045228 Dec 21 03:56:47.646817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-40db3887-1826-46f1-98f5-2fcce1dd5892 service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5121622 Dec 21 03:56:47.922877 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Routers {'4a95ea4a-ece9-4a91-8ca0-6054160833e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:47.931896 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:47.975886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8ed4a0fb-cadd-405a-b52d-e0154cea65e0', 'name': '', 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'mac_address': 'fa:16:3e:9a:1b:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:43Z', 'updated_at': '2021-12-21T03:56:43Z', 'revision_number': 1, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'subnets': [{'id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:47.998685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813bd3f0-2457-474d-9e0e-54632d40e4a5 req-13d5f091-ac0f-4e39-b69e-6c9bbdaca602 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:48.010158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-813bd3f0-2457-474d-9e0e-54632d40e4a5 req-13d5f091-ac0f-4e39-b69e-6c9bbdaca602 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 946 time: 0.5604408 Dec 21 03:56:48.017631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03fdd780-4132-4da1-891e-c18a5d7ce8ec None None] The sync data for ids ['615492c6-acfa-4198-96eb-9577071a4255'] in n-d-822053-11 is: [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8ed4a0fb-cadd-405a-b52d-e0154cea65e0', 'name': '', 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'mac_address': 'fa:16:3e:9a:1b:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:43Z', 'updated_at': '2021-12-21T03:56:43Z', 'revision_number': 1, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'subnets': [{'id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:48.156929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-db30d3c1-c82f-4e3f-8ece-7a5f57b96831 None None] Provisioning complete for port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:48.158089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db30d3c1-c82f-4e3f-8ece-7a5f57b96831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:48.338588 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] Set router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:48.379609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:48.439284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8993c4cb-3940-48ca-977b-130cf112e703 req-4aec20c4-c327-48b3-8c63-8fdc9c730e25 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.4116099 Dec 21 03:56:48.456898 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db30d3c1-c82f-4e3f-8ece-7a5f57b96831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:48.506924 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cafac1c-6ecb-46ee-8e82-272ab63c724a None None] Pushing event updated for resources: {'Port': ['ID=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:48.548693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-db30d3c1-c82f-4e3f-8ece-7a5f57b96831 None None] For port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:48.613545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db30d3c1-c82f-4e3f-8ece-7a5f57b96831 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:48.671619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37b3401e-ec5d-4ba9-8ef3-9b66c66a33ef req-dfd8d0cc-3c60-4b2a-a042-fb2bc454e302 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9563870 Dec 21 03:56:48.675499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-c0917435-8840-4d42-a77b-2f5663048354 service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0177190 Dec 21 03:56:48.706894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-813bd3f0-2457-474d-9e0e-54632d40e4a5 req-cc174079-6e48-4585-b980-8123cb867dbf tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6957283 Dec 21 03:56:48.713673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:56:48.735695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:56:48.768859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9c703697-2f1e-4975-8e71-38e46235d21a None None] Provisioning complete for port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:48.769713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9c703697-2f1e-4975-8e71-38e46235d21a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:48.785087 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:48.839390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db30d3c1-c82f-4e3f-8ece-7a5f57b96831 None None] Pushing event updated for resources: {'Port': ['ID=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:48.906807 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:56:41Z', 'revision_number': 4, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '088ea98c-12cd-4d33-ae1a-65da3f7daaf5', 'name': '', 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'mac_address': 'fa:16:3e:d0:98:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1445, 'fixed_ips': [{'subnet_id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:40Z', 'updated_at': '2021-12-21T03:56:47Z', 'revision_number': 4, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'subnets': [{'id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:49.027604 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a805420-206f-4086-b2c4-d8fbc09e2f26 None None] The sync data for ids ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'] in n-d-822053-11 is: [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:56:41Z', 'revision_number': 4, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '088ea98c-12cd-4d33-ae1a-65da3f7daaf5', 'name': '', 'network_id': '21911ef5-8ca7-4129-bc39-61ca0f42e46e', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'mac_address': 'fa:16:3e:d0:98:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1445, 'fixed_ips': [{'subnet_id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:40Z', 'updated_at': '2021-12-21T03:56:47Z', 'revision_number': 4, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'subnets': [{'id': 'cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:49.070379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.107446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-e77e4e7d-d20c-45dd-8620-ea57d5728713 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.34&port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 217 time: 0.3916805 Dec 21 03:56:49.114591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Router 615492c6-acfa-4198-96eb-9577071a4255 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:56:49.171855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.281612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-88c2b6dd-f4df-4fa1-b00a-a8f583466cb9 None None] Provisioning complete for port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:49.282195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88c2b6dd-f4df-4fa1-b00a-a8f583466cb9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.297541 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ca943a896b68407f8e5ef844e5f9fbff&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9128904 Dec 21 03:56:49.300879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32886) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:49.318031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-21f8441e-0fde-404d-bf5d-9dfa0375f5d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:49.322964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b05c4791-0049-4cd4-9486-c80a847ee9bb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:49.339167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.340961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.341412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.341851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.342284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.342836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.343268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.343687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.344109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.344528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.344952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.345372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.345789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45a5d4da-cd10-4e0c-908d-ee4bed04daac admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:49.348175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-21f8441e-0fde-404d-bf5d-9dfa0375f5d1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.2261448 Dec 21 03:56:49.413233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-88c2b6dd-f4df-4fa1-b00a-a8f583466cb9 None None] Port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:49.445997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f1b7c-6ee2-49cd-991a-a4102f3d318c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.516658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f1b7c-6ee2-49cd-991a-a4102f3d318c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.547063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-2387e4b5-7986-4fd4-ba3f-b21a14e14258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:49.548667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-2387e4b5-7986-4fd4-ba3f-b21a14e14258 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1196504 Dec 21 03:56:49.558451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:56:49.638338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e1c34030-8010-4a19-8188-08cdef2b95b5 admin admin] 10.222.0.18 "PUT /v2.0/routers/615492c6-acfa-4198-96eb-9577071a4255/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3551440 Dec 21 03:56:49.693670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f1b7c-6ee2-49cd-991a-a4102f3d318c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.696578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f1b7c-6ee2-49cd-991a-a4102f3d318c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.698164 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e1f1b7c-6ee2-49cd-991a-a4102f3d318c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b05c4791-0049-4cd4-9486-c80a847ee9bb HTTP/1.1" status: 204 len: 168 time: 0.3882945 Dec 21 03:56:49.716148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1f1b7c-6ee2-49cd-991a-a4102f3d318c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b05c4791-0049-4cd4-9486-c80a847ee9bb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:49.914573 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0386e140-c478-4cc6-8c13-6b5ac92ae288 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:49.929004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf066fa-0838-4541-9c49-6b7abb9d5ecb req-0a72bcc6-c98b-4059-a662-f98f5f398505 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0953522 Dec 21 03:56:50.093097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-700261e1-dfa7-412b-a508-be4ee44d7335 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5361664 Dec 21 03:56:50.337712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-372156f9-fbfa-475f-8545-e0a1ac9c5678 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2246814 Dec 21 03:56:50.338387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bebfec-6e4b-4f6f-a32a-ae160e20a465 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:50.355875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda8588e-6125-410b-90dc-6b6167e5a896 req-d9d5ba14-40a5-42fd-ad03-8a1ec5c1b17b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:50.367786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cda8588e-6125-410b-90dc-6b6167e5a896 req-d9d5ba14-40a5-42fd-ad03-8a1ec5c1b17b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 946 time: 0.3871408 Dec 21 03:56:50.444839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-fc645ffb-0995-4fcc-b277-5b3e1d725b8c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.198&port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 217 time: 0.0982392 Dec 21 03:56:50.501465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:50.503856 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:50.663116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cda8588e-6125-410b-90dc-6b6167e5a896 req-18a86533-d86c-48ca-adcf-7e55e3dd7d6b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2901695 Dec 21 03:56:50.707189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-578e2bd2-cdbb-4c34-bee9-9505a8da4e6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:50.715759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-578e2bd2-cdbb-4c34-bee9-9505a8da4e6c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.2503805 Dec 21 03:56:50.756117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:50.892771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-8ef260d9-b029-48d5-a049-6fef8179495b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:50.894412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-8ef260d9-b029-48d5-a049-6fef8179495b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1623070 Dec 21 03:56:50.913209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:50.915777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:51.217349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20064f77-314d-42d3-a8d9-2d991f5f66c9 req-0c26ecf7-b5a8-480c-856c-146f0e2ca735 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0605693 Dec 21 03:56:51.279586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-0b6d6a37-cfe2-43db-b758-9c13a8653bf9 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3719552 Dec 21 03:56:51.441896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-fc8fc0c5-90c3-4faa-941f-7cf6c9d5e9d3 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1533396 Dec 21 03:56:51.494388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32960) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:51.508649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-105893d9-ed5a-465a-9836-7a731e5ce80f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.95&port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d HTTP/1.1" status: 200 len: 217 time: 0.0588593 Dec 21 03:56:51.509877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57574c71-86f7-4a7f-8561-5b9a340aecd3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:51.567188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-4479feed-5da2-4c55-9c66-d964e1c3b208 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:51.569249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-4479feed-5da2-4c55-9c66-d964e1c3b208 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0541339 Dec 21 03:56:51.615875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57574c71-86f7-4a7f-8561-5b9a340aecd3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:51.635493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-5cce3dd9-e2fa-4bbd-a4fc-653745961d90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:51.637148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-5cce3dd9-e2fa-4bbd-a4fc-653745961d90 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0609059 Dec 21 03:56:51.709574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57574c71-86f7-4a7f-8561-5b9a340aecd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:51.761558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-ae0a8db1-0c59-4b87-a581-b17212135870 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1166985 Dec 21 03:56:51.773631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-57574c71-86f7-4a7f-8561-5b9a340aecd3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=630a09ebec364180b30810934101c380&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2778513 Dec 21 03:56:51.777556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:52.004717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ef767ca-1101-4f35-9bc0-a4dd25c322ff req-17c918ca-af32-4ff3-b601-6da5168a3d7c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:52.013154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ef767ca-1101-4f35-9bc0-a4dd25c322ff req-17c918ca-af32-4ff3-b601-6da5168a3d7c tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 946 time: 0.1984332 Dec 21 03:56:52.068277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-71dd810a-0266-4edb-bc5b-3d285756fd41 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2981374 Dec 21 03:56:52.147340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-91935ef6-dcff-40fd-9fb7-990c24b16419 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.123&port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e HTTP/1.1" status: 200 len: 217 time: 0.0548596 Dec 21 03:56:52.151720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ef767ca-1101-4f35-9bc0-a4dd25c322ff req-5bccdadb-cdce-4998-95d6-1fcc6158bffe tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1376524 Dec 21 03:56:52.178642 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33b4c050-6834-4bac-8253-e7f556c6e37e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:52.250251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-7ef452ee-7b70-41c4-9d48-222702087d72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:52.251818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-7ef452ee-7b70-41c4-9d48-222702087d72 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0978832 Dec 21 03:56:52.323661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57574c71-86f7-4a7f-8561-5b9a340aecd3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34db741e-7d6f-44db-aad6-94dd8f275b97,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:52.362133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1525ccce-dd5e-4f84-b1eb-c61607bfa31d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:52.428275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1525ccce-dd5e-4f84-b1eb-c61607bfa31d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:52.475681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8c48465-ca72-4ee9-82e4-2dd02f0055a8 req-b3778659-025e-4b86-9b85-5ca4f62f21af tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0949383 Dec 21 03:56:52.541268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c2e5ab-0440-4073-ad14-fe48529c5124 req-7d680fcb-5af8-4e38-a650-2e95547b4750 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:52.543151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41c2e5ab-0440-4073-ad14-fe48529c5124 req-7d680fcb-5af8-4e38-a650-2e95547b4750 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 945 time: 0.2023206 Dec 21 03:56:52.545245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-c361adc7-e8ca-4460-b6a2-5ab7fa0052c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:52.546689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-c361adc7-e8ca-4460-b6a2-5ab7fa0052c1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2858291 Dec 21 03:56:52.648021 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:52.695558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1525ccce-dd5e-4f84-b1eb-c61607bfa31d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:52.700367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1525ccce-dd5e-4f84-b1eb-c61607bfa31d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:52.700520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41c2e5ab-0440-4073-ad14-fe48529c5124 req-d4254ab3-ba38-4f0b-b96a-a5b8d9f701e6 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423035 Dec 21 03:56:52.705220 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1525ccce-dd5e-4f84-b1eb-c61607bfa31d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/34db741e-7d6f-44db-aad6-94dd8f275b97 HTTP/1.1" status: 204 len: 168 time: 0.9210837 Dec 21 03:56:52.728032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1525ccce-dd5e-4f84-b1eb-c61607bfa31d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34db741e-7d6f-44db-aad6-94dd8f275b97,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:52.733234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-59eb1541-6687-491e-a67d-f68ab2b0c25b service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1723475 Dec 21 03:56:52.977833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-4057ebd0-4e7f-46b1-aac3-c8749347d1cb service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2369969 Dec 21 03:56:53.066635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-7a3313a0-5741-4273-95fd-4f3aaa299ded service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=3136aa12-8de7-43c2-8cde-55879999fd27 HTTP/1.1" status: 200 len: 217 time: 0.0790641 Dec 21 03:56:53.154831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-8df4e7cc-3bbe-4a99-8d1d-d4b8ec30d86e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:53.156620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-8df4e7cc-3bbe-4a99-8d1d-d4b8ec30d86e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.0829968 Dec 21 03:56:53.241155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:53.279224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-d4185f02-35c5-4e8c-aafb-5cf99bdda20b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:53.281676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-d4185f02-35c5-4e8c-aafb-5cf99bdda20b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1170571 Dec 21 03:56:53.452266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-60e25eb6-de0b-462a-914c-a7ab152707db service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1520927 Dec 21 03:56:53.665857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-7e115f6c-7e93-45e6-912a-09f537bec691 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2050700 Dec 21 03:56:53.784816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Sync routers for ids ['615492c6-acfa-4198-96eb-9577071a4255'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:56:53.804738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Routers {'615492c6-acfa-4198-96eb-9577071a4255'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:53.806040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['615492c6-acfa-4198-96eb-9577071a4255'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:54.091536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Set router 615492c6-acfa-4198-96eb-9577071a4255 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:54.290792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-f83d0f7d-da70-4a7f-ba82-ecdc5a1b9db3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 200 len: 217 time: 0.6168556 Dec 21 03:56:54.341454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ad32dc9-558a-4b87-8aa4-ba2e0aa8f604 req-f94aefd5-0c9d-415b-a3da-136988bf5bcc tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0553849 Dec 21 03:56:54.434982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-03136703-901e-4956-8184-b8152545b4b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:54.437149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-03136703-901e-4956-8184-b8152545b4b0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.1011264 Dec 21 03:56:54.494876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8ed4a0fb-cadd-405a-b52d-e0154cea65e0', 'name': '', 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'mac_address': 'fa:16:3e:9a:1b:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:43Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 2, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'subnets': [{'id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:54.528876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Checking router: 615492c6-acfa-4198-96eb-9577071a4255 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:56:54.531269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Updating router 615492c6-acfa-4198-96eb-9577071a4255 port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:56:54.532015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1969e4-1bb8-426e-8b1f-ce1d0e358716 req-1442cd15-766e-453e-a339-b43c26e8b87d tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:54.533924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be1969e4-1bb8-426e-8b1f-ce1d0e358716 req-1442cd15-766e-453e-a339-b43c26e8b87d tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 945 time: 0.2462645 Dec 21 03:56:54.575566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:54.638857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-dea8a5ab-d0bf-4d3e-9846-26425ef239c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:54.640653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-dea8a5ab-d0bf-4d3e-9846-26425ef239c9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1887751 Dec 21 03:56:54.700516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be1969e4-1bb8-426e-8b1f-ce1d0e358716 req-079cd1b7-2e2b-4cbd-8d1a-f7c9d3d5242b tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543226 Dec 21 03:56:54.856335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-ae89e631-d880-4b44-81ce-383dc495737d service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2058065 Dec 21 03:56:54.949125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.093008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dde8b7e3-a827-455d-b34b-2e359ee69c22 req-d1b51f28-58ff-493b-b2d0-2d0f4cdd1e6d service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2277148 Dec 21 03:56:55.102794 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.139638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33066) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:55.223681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.263695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-8fd0b6d1-7a42-46ab-a2c1-074f25acb147 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:55.266639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-8fd0b6d1-7a42-46ab-a2c1-074f25acb147 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "GET /v2.0/ports?device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 945 time: 0.1727116 Dec 21 03:56:55.306552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.489835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9f28375-57cc-4c23-b0da-60616db17fbd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.532581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Deleting port e7dfd89c-f813-486c-abd8-a7763ecccf4e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:55.533146 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.677040 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9f28375-57cc-4c23-b0da-60616db17fbd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.687733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Pushing event updated for resources: {'Port': ['ID=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:55.704700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Attempting to bind port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:56:55.704700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Attempting to bind port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:56:55.704700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Attempting to bind port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 on network 96d6a39e-5317-4fc0-b645-87386d7cd358 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:56:55.706184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66c5b1de-cfa0-4872-bb7e-14e9412497cf req-6b677de0-66b6-44ac-a6ee-4b4e5f47961a tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.1143682 Dec 21 03:56:55.734688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:56:55.734688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Checking segment: {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:56:55.734688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.734688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Bound using segment: {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:56:55.734688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Bound port: 8ed4a0fb-cadd-405a-b52d-e0154cea65e0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '72d09991-5ece-42f1-a216-688cf52e3396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:56:55.734688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.752539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9f28375-57cc-4c23-b0da-60616db17fbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.757119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.762908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.764374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.764805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.768019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.768460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.770434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.770653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.787153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.787153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.787153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.787153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.787153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:55.847259 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.911017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] For port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:56:55.913177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b9f28375-57cc-4c23-b0da-60616db17fbd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=575b3c32a437401c9fd8967334bb62d6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7718675 Dec 21 03:56:55.914642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f28375-57cc-4c23-b0da-60616db17fbd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c4255df-b703-436a-9d8c-a0c25ce121d3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:55.920244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33080) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:55.938416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be30cc0d-d359-48a4-8acd-6b94d45d75df None None] Provisioning complete for port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:55.939143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be30cc0d-d359-48a4-8acd-6b94d45d75df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:55.950022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] For port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:56:56.024715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.085750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6391cffe-0ccc-49c2-912c-8e073d266a4f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.134287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6391cffe-0ccc-49c2-912c-8e073d266a4f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.189001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-e53e830a-b73a-44e3-a75a-cdd87d061249 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:56.197386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-e53e830a-b73a-44e3-a75a-cdd87d061249 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "GET /v2.0/ports?device_id=480fd09f-0036-4e38-b2f7-2f0ab1983531 HTTP/1.1" status: 200 len: 946 time: 0.2955577 Dec 21 03:56:56.213561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] For port e7dfd89c-f813-486c-abd8-a7763ecccf4e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=e7dfd89c-f813-486c-abd8-a7763ecccf4e,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:56.214760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.244185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Calling delete_port for e7dfd89c-f813-486c-abd8-a7763ecccf4e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:56.304729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6391cffe-0ccc-49c2-912c-8e073d266a4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.320417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6391cffe-0ccc-49c2-912c-8e073d266a4f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.330401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6391cffe-0ccc-49c2-912c-8e073d266a4f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6c4255df-b703-436a-9d8c-a0c25ce121d3 HTTP/1.1" status: 204 len: 168 time: 0.4087079 Dec 21 03:56:56.358553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6391cffe-0ccc-49c2-912c-8e073d266a4f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c4255df-b703-436a-9d8c-a0c25ce121d3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:56.554346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6ca8d6-73c6-42e5-9458-58ae14c63ac2 req-a3ff4f92-df08-4863-aaa4-eb4dc3e76c60 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:56:56.570188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f6ca8d6-73c6-42e5-9458-58ae14c63ac2 req-a3ff4f92-df08-4863-aaa4-eb4dc3e76c60 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 945 time: 0.6673908 Dec 21 03:56:56.614993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc672cec-88bb-44d9-adab-121d31e953a3 None None] Pushing event updated for resources: {'Port': ['ID=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:56.652076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-be30cc0d-d359-48a4-8acd-6b94d45d75df None None] Port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:56:56.707616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Routers {'615492c6-acfa-4198-96eb-9577071a4255'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:56:56.710790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:56.711619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['615492c6-acfa-4198-96eb-9577071a4255'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:56.794926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event deleted for resources: {'Port': ['ID=e7dfd89c-f813-486c-abd8-a7763ecccf4e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:56.873938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.874397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.874835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.875287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.875843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.876257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.876664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.877072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.877478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.877918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.878337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.878742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.879165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:56:56.961671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['e7dfd89c-f813-486c-abd8-a7763ecccf4e', '1f79ae95-425a-4afe-b09d-4ffd986b72d0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:56:56.979423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f6ca8d6-73c6-42e5-9458-58ae14c63ac2 req-459aee89-11c8-4028-9ee2-e613c007b9e5 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/security-groups?id=b4f95788-ae64-484e-808e-13d6137c228c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3960261 Dec 21 03:56:56.987134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0cdeb147-a8d0-4e2c-8fe6-6cabdb1a0e1d req-298dc564-59ad-4a15-ac89-ec907f1761c0 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0985727 Dec 21 03:56:56.988062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] No DVR routers for this DVR port e7dfd89c-f813-486c-abd8-a7763ecccf4e on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:56.993202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.000885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-759d9e42-02a1-41f9-bdfb-93bc9e6f56c2 req-06368e1e-11ea-43f4-9dfa-5f5753d79ecd tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "DELETE /v2.0/ports/e7dfd89c-f813-486c-abd8-a7763ecccf4e HTTP/1.1" status: 204 len: 173 time: 1.7267179 Dec 21 03:56:57.001679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'name': 'network-vif-deleted', 'tag': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:57.004267 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7dd96ac0-f41a-46cf-95f7-ed43b63a1042" -d '{"events": [{"server_uuid": "f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e", "name": "network-vif-deleted", "tag": "e7dfd89c-f813-486c-abd8-a7763ecccf4e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:57.063480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Deleting port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:56:57.064221 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.066735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] Set router 615492c6-acfa-4198-96eb-9577071a4255 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:56:57.124008 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f30be0ff-42ac-4490-95a3-daa1241f43ae x-openstack-request-id: req-f30be0ff-42ac-4490-95a3-daa1241f43ae {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:57.124315 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e", "name": "network-vif-deleted", "tag": "e7dfd89c-f813-486c-abd8-a7763ecccf4e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:57.124580 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f30be0ff-42ac-4490-95a3-daa1241f43ae {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:57.125002 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e', 'name': 'network-vif-deleted', 'tag': 'e7dfd89c-f813-486c-abd8-a7763ecccf4e', 'status': 'completed', 'code': 200} Dec 21 03:56:57.239544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d41b513f-d2cb-4435-ae43-9bb818cddcca None None] Provisioning complete for port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:57.240390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d41b513f-d2cb-4435-ae43-9bb818cddcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.291634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] For port 1f79ae95-425a-4afe-b09d-4ffd986b72d0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1f79ae95-425a-4afe-b09d-4ffd986b72d0,segment=NetworkSegment(5601a3fe-5cce-43a8-9085-a8fef024cc6d),segment_id=5601a3fe-5cce-43a8-9085-a8fef024cc6d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:57.292192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.311511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Calling delete_port for 1f79ae95-425a-4afe-b09d-4ffd986b72d0 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:56:57.494116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d41b513f-d2cb-4435-ae43-9bb818cddcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.563056 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8ed4a0fb-cadd-405a-b52d-e0154cea65e0', 'name': '', 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'mac_address': 'fa:16:3e:9a:1b:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:43Z', 'updated_at': '2021-12-21T03:56:55Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'subnets': [{'id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:56:57.606584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-035d0e0e-fac2-453d-9356-194c271f81b6 None None] The sync data for ids ['615492c6-acfa-4198-96eb-9577071a4255'] in n-d-822053-11 is: [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8ed4a0fb-cadd-405a-b52d-e0154cea65e0', 'name': '', 'network_id': '96d6a39e-5317-4fc0-b645-87386d7cd358', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'mac_address': 'fa:16:3e:9a:1b:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_interface', 'standard_attr_id': 1455, 'fixed_ips': [{'subnet_id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:43Z', 'updated_at': '2021-12-21T03:56:55Z', 'revision_number': 4, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'subnets': [{'id': 'f84907c1-819c-4ef4-9637-ca8b601c71e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:56:57.616302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d41b513f-d2cb-4435-ae43-9bb818cddcca None None] For port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:56:57.643760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.690794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Pushing event deleted for resources: {'Port': ['ID=1f79ae95-425a-4afe-b09d-4ffd986b72d0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:57.710427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d41b513f-d2cb-4435-ae43-9bb818cddcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.726648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:57.743575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78b457c8-22bd-4143-b4de-89f5e569c705 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.766596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] No DVR routers for this DVR port 1f79ae95-425a-4afe-b09d-4ffd986b72d0 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:56:57.769157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.774436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d92a25ac-3ba6-46ac-8e8f-4320e9f2556f req-69021690-2386-4876-ab04-c3e483be200e tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.31 "DELETE /v2.0/ports/1f79ae95-425a-4afe-b09d-4ffd986b72d0 HTTP/1.1" status: 204 len: 173 time: 1.2489810 Dec 21 03:56:57.832070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d41b513f-d2cb-4435-ae43-9bb818cddcca None None] Pushing event updated for resources: {'Port': ['ID=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:57.873708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78b457c8-22bd-4143-b4de-89f5e569c705 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:57.986756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78b457c8-22bd-4143-b4de-89f5e569c705 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:58.061570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b457c8-22bd-4143-b4de-89f5e569c705 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dec66615-812a-4d7f-a712-7afc9008bc1a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:58.134108 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-78b457c8-22bd-4143-b4de-89f5e569c705 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=72b074c58bae45ce83120ad77fad27a4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4052470 Dec 21 03:56:58.140957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:58.271893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:56:58.315977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a457676-dfe5-4fa5-a66b-8e844d126247 req-c741adb7-6b84-4fb6-a83b-d75b76f97fe8 tempest-MultipleCreateTestJSON-49100724 tempest-MultipleCreateTestJSON-49100724-project] 10.222.0.18 "GET /v2.0/ports?device_id=f3e648e3-a9a6-4c6f-b9ee-3fc3af84012e HTTP/1.1" status: 200 len: 210 time: 0.1326175 Dec 21 03:56:58.339606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2877cb32-e332-4fed-b23f-2cb004eed235 req-273704c1-9f23-43c3-85d8-e772088380bf tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.1505244 Dec 21 03:56:58.358287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-590959dc-7dd9-4cb2-9630-b53dedb4062c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:58.398293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-590959dc-7dd9-4cb2-9630-b53dedb4062c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:58.464434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:56:58.464434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:58.546786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-590959dc-7dd9-4cb2-9630-b53dedb4062c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:58.550295 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-590959dc-7dd9-4cb2-9630-b53dedb4062c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:58.551696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-590959dc-7dd9-4cb2-9630-b53dedb4062c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dec66615-812a-4d7f-a712-7afc9008bc1a HTTP/1.1" status: 204 len: 168 time: 0.4132550 Dec 21 03:56:58.595599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590959dc-7dd9-4cb2-9630-b53dedb4062c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dec66615-812a-4d7f-a712-7afc9008bc1a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:56:59.125916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'name': 'network-vif-deleted', 'tag': '1f79ae95-425a-4afe-b09d-4ffd986b72d0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:56:59.131688 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6dee5156-d525-4ef8-b8b1-5bf0a830ee64" -d '{"events": [{"server_uuid": "480fd09f-0036-4e38-b2f7-2f0ab1983531", "name": "network-vif-deleted", "tag": "1f79ae95-425a-4afe-b09d-4ffd986b72d0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:56:59.184841 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:56:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9bee982c-e35f-418d-adb1-3b40d5340aab x-openstack-request-id: req-9bee982c-e35f-418d-adb1-3b40d5340aab {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:56:59.184841 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "480fd09f-0036-4e38-b2f7-2f0ab1983531", "name": "network-vif-deleted", "tag": "1f79ae95-425a-4afe-b09d-4ffd986b72d0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:56:59.184841 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9bee982c-e35f-418d-adb1-3b40d5340aab {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:56:59.184841 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '480fd09f-0036-4e38-b2f7-2f0ab1983531', 'name': 'network-vif-deleted', 'tag': '1f79ae95-425a-4afe-b09d-4ffd986b72d0', 'status': 'completed', 'code': 200} Dec 21 03:56:59.362435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f79ae95-425a-4afe-b09d-4ffd986b72d0 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:59.419790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 1f79ae95-425a-4afe-b09d-4ffd986b72d0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:59.420148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1f79ae95-425a-4afe-b09d-4ffd986b72d0 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:59.421452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e7dfd89c-f813-486c-abd8-a7763ecccf4e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:56:59.445857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:59.462708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: e7dfd89c-f813-486c-abd8-a7763ecccf4e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:56:59.463129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device e7dfd89c-f813-486c-abd8-a7763ecccf4e not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:56:59.511922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Deleting subnet bb3135ec-e693-4805-af80-f05f5d44e73c {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:56:59.587928 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:59.595549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0dc6a00-0487-42bd-b57c-eeeb36594ecf req-c331011f-d572-46c2-b428-111f7bdd4805 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0656579 Dec 21 03:56:59.661483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:59.735114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:59.884706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33184) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:59.898581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:59.924973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:56:59.929663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] 10.222.0.18 "DELETE /v2.0/subnets/bb3135ec-e693-4805-af80-f05f5d44e73c HTTP/1.1" status: 204 len: 168 time: 0.4821808 Dec 21 03:56:59.932593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:56:59.958343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-890df40b-2b10-44fc-a76c-474adfafd3fd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bb3135ec-e693-4805-af80-f05f5d44e73c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:00.100192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.129486 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cffea859-bc4d-4aa8-8235-817eaf0cfe3b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.237614 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.257112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cffea859-bc4d-4aa8-8235-817eaf0cfe3b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.266448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1bfeb879-d5e1-4651-ae97-290a586eba8e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:00.276943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5601a3fe-5cce-43a8-9085-a8fef024cc6d') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:00.277570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5601a3fe-5cce-43a8-9085-a8fef024cc6d') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:00.298501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.325651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.339729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:57:00.340868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:57:00.343035 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:57:00.348707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cffea859-bc4d-4aa8-8235-817eaf0cfe3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.413288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cffea859-bc4d-4aa8-8235-817eaf0cfe3b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3a25c1af7a8b4d0095b4f722f8b8e3df&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5245090 Dec 21 03:57:00.414107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33198) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:00.444873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cffea859-bc4d-4aa8-8235-817eaf0cfe3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1427268f-e37a-4fb1-9e32-417ca36a9153,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:00.488793 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a5f0d6a-fa40-454d-91de-19ef36c7f0a9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.517751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a5f0d6a-fa40-454d-91de-19ef36c7f0a9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.561799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.576454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.584508 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] 10.222.0.18 "DELETE /v2.0/networks/1bfeb879-d5e1-4651-ae97-290a586eba8e HTTP/1.1" status: 204 len: 168 time: 0.6489522 Dec 21 03:57:00.607653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8242d739-5ad0-4234-b73f-75eda24c2631 admin admin] Pushing event deleted for resources: {'Network': ['ID=1bfeb879-d5e1-4651-ae97-290a586eba8e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:00.727178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a5f0d6a-fa40-454d-91de-19ef36c7f0a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.730085 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a5f0d6a-fa40-454d-91de-19ef36c7f0a9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:00.735230 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4a5f0d6a-fa40-454d-91de-19ef36c7f0a9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1427268f-e37a-4fb1-9e32-417ca36a9153 HTTP/1.1" status: 204 len: 168 time: 0.3159082 Dec 21 03:57:00.754537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5f0d6a-fa40-454d-91de-19ef36c7f0a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1427268f-e37a-4fb1-9e32-417ca36a9153,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:00.797036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b0bde62-6b2e-4368-bd70-13841a8efe4b req-b01fa596-0189-4a9d-b51e-e0785114f7d3 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0846107 Dec 21 03:57:01.053304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33214) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:01.118101 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c5571bf6-1fb0-4c92-a767-e4e8d004a8c0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5aa4830586124e6a8a42b9502b0fc7c2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0615273 Dec 21 03:57:01.120422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:01.188249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e08f543e-9c3c-4614-9a89-f0dac6a881e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:01.221457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e08f543e-9c3c-4614-9a89-f0dac6a881e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:01.383766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e08f543e-9c3c-4614-9a89-f0dac6a881e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:01.387580 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e08f543e-9c3c-4614-9a89-f0dac6a881e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:01.392563 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e08f543e-9c3c-4614-9a89-f0dac6a881e9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b4f95788-ae64-484e-808e-13d6137c228c HTTP/1.1" status: 204 len: 168 time: 0.2704363 Dec 21 03:57:01.402752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08f543e-9c3c-4614-9a89-f0dac6a881e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4f95788-ae64-484e-808e-13d6137c228c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:01.801303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33226) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:01.821029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c92dc80f-b833-46d1-ba1b-25bd0590a9ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:01.996779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d38c882-3c58-49a1-8c14-e7a670fab830 req-0df5948b-1674-420a-ab61-5885cefa5557 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0502839 Dec 21 03:57:02.045456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c92dc80f-b833-46d1-ba1b-25bd0590a9ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:02.132299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c92dc80f-b833-46d1-ba1b-25bd0590a9ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:02.257521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c92dc80f-b833-46d1-ba1b-25bd0590a9ac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7c2c6f713be745099da00f1e08ad2a9b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4548810 Dec 21 03:57:02.258405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92dc80f-b833-46d1-ba1b-25bd0590a9ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbca8494-33a7-4321-89de-28a1b208879a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:02.262784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33244) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:02.354242 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd338840-3c75-476a-a37f-55dd1ce5ae2d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:02.388638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd338840-3c75-476a-a37f-55dd1ce5ae2d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:03.182230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4f3ccc-e582-4fdf-93a6-2bd030196f6c req-6862cb64-1d44-499e-86a3-6337a9f96ad0 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0276651 Dec 21 03:57:03.377853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd338840-3c75-476a-a37f-55dd1ce5ae2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:03.382286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd338840-3c75-476a-a37f-55dd1ce5ae2d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:03.384768 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd338840-3c75-476a-a37f-55dd1ce5ae2d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fbca8494-33a7-4321-89de-28a1b208879a HTTP/1.1" status: 204 len: 168 time: 1.1206231 Dec 21 03:57:03.402217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd338840-3c75-476a-a37f-55dd1ce5ae2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbca8494-33a7-4321-89de-28a1b208879a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:04.331470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3325268-0689-476a-af8c-5bdf5d64d929 req-6a7051c1-62d1-43ce-9520-1867a90425b2 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0558755 Dec 21 03:57:04.779299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33294) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:05.084872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1104506998-network', 'tenant_id': '2d46b810d87943059c90ba895934ed3b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:05.183596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:05.188390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.204975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.306833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.381716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.423445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:57:05.460413 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.460957 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Added segment c01f3ee8-68b8-46bf-9e7f-2ef589a822de of type vlan for network adb6972f-1a1d-4ca4-855c-5e5faf88030a Dec 21 03:57:05.556305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7fef7014-1f10-4c7e-a44d-672309b98023 req-1e12c7c7-58e8-4e3b-842a-0852c9b77d26 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0711882 Dec 21 03:57:05.589123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.593709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18f408dc-942e-4fe3-add4-37566364635e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:05.680859 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.685295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:05.685295 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:05.760700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] Pushing event updated for resources: {'Network': ['ID=adb6972f-1a1d-4ca4-855c-5e5faf88030a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:05.773548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:57:05.826330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5416ea77-4132-493d-845f-49d7856203b7 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.0452094 Dec 21 03:57:05.832532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33324) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:05.850545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Request body: {'subnet': {'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1104506998-subnet', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:05.973147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:05.976842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:06.270224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:06.323872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Pushing event updated for resources: {'Subnet': ['ID=5101716e-6720-4ed1-b6cc-a5ad262b61c1,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:06.367317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:06.367714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Network hostable DHCP agents. Network: adb6972f-1a1d-4ca4-855c-5e5faf88030a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:57:06.677723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf0e3cbd-cd59-4b85-80fe-ff3910420675 req-bb0b76cf-725f-40b3-b5e2-5a82e2ad5124 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0430913 Dec 21 03:57:06.920159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:57:06.999086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, adb6972f-1a1d-4ca4-855c-5e5faf88030a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:07.002844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:07.003470 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.021626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d67c197d-212f-4882-a9e4-b045f81b5bba None None] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:57:07.111769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33342) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:07.112366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7981ab48-96f7-4adc-b763-dfa6e1f2714f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2775822 Dec 21 03:57:07.116925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:07.238134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.239246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.248502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'project_id': '2d46b810d87943059c90ba895934ed3b', 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:57:07.248502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.318786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.474468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Allocated IP 172.20.0.2 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/6167aa29-943c-4c92-aae1-3c9325112b6a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:07.612114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.685315 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.795009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-734934c2-40d5-4bfa-b41d-16dbf92c0292 req-8c1567d9-5fa8-4a94-8156-3d3e222811a8 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0262291 Dec 21 03:57:07.886911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:07.931932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:07.935560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:07.938965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:07.944886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Pushing event updated for resources: {'Port': ['ID=6167aa29-943c-4c92-aae1-3c9325112b6a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:08.011639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Attempting to bind port 6167aa29-943c-4c92-aae1-3c9325112b6a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:08.012029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Attempting to bind port 6167aa29-943c-4c92-aae1-3c9325112b6a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:08.012692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Attempting to bind port 6167aa29-943c-4c92-aae1-3c9325112b6a on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:08.019140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:08.019525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:08.019939 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.020338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:08.021674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Bound port: 6167aa29-943c-4c92-aae1-3c9325112b6a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:08.022255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.145130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] For port 6167aa29-943c-4c92-aae1-3c9325112b6a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:08.148779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] For port 6167aa29-943c-4c92-aae1-3c9325112b6a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6167aa29-943c-4c92-aae1-3c9325112b6a,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:08.197596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.223943 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.273531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.382968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38aba58-6c26-4af4-98e3-b36e3df34b43 None None] Pushing event updated for resources: {'Port': ['ID=6167aa29-943c-4c92-aae1-3c9325112b6a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:08.462279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Allocated IP 172.25.5.238 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/9b5905a1-fcc1-4d24-91e4-3b04c6766205) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:08.715014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.867076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:08.966099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:08.969711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:08.973564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:08.987049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8e7963b-34af-499a-98ce-5bf155119718 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:57:09.032269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b52cacbd-1b3c-420b-b6c7-0eaa4cd99709 req-374a5e49-087a-4cdf-a631-e061747fe6d9 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.1009150 Dec 21 03:57:09.033469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d8ca6b5-8db1-4d40-b699-ece564d6d7e3 None None] Provisioning complete for port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:09.033867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d8ca6b5-8db1-4d40-b699-ece564d6d7e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:09.061065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Pushing event updated for resources: {'Port': ['ID=9b5905a1-fcc1-4d24-91e4-3b04c6766205,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:09.104922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4d8ca6b5-8db1-4d40-b699-ece564d6d7e3 None None] Port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:09.503989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:09.788525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:09.950079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9d96f93-beee-42f3-90bc-8ec0b750c27e None None] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:57:10.046463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2abea710-1106-42c4-b639-252b4b11b746 None None] Provisioning complete for port 6167aa29-943c-4c92-aae1-3c9325112b6a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:10.047155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2abea710-1106-42c4-b639-252b4b11b746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.094911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Router a1333542-4121-47e8-a7de-92405f045a9e is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:57:10.194815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-908aa52c-4069-40b2-95e6-833763133051 req-deeb02bb-7da1-46d9-8f07-07415d8adff4 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0592017 Dec 21 03:57:10.254318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6167aa29-943c-4c92-aae1-3c9325112b6a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:10.329853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2abea710-1106-42c4-b639-252b4b11b746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.340917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:57:10.350763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6167aa29-943c-4c92-aae1-3c9325112b6a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:10.353655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.353835 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Sync routers for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:57:10.374246 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:57:10.375152 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:10.418452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.420144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf9806e2-7a6b-4951-8b78-534e22544b08 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.3066335 Dec 21 03:57:10.422866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33402) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:10.465062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2abea710-1106-42c4-b639-252b4b11b746 None None] For port 6167aa29-943c-4c92-aae1-3c9325112b6a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6167aa29-943c-4c92-aae1-3c9325112b6a,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:10.545412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2abea710-1106-42c4-b639-252b4b11b746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.652538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2abea710-1106-42c4-b639-252b4b11b746 None None] Pushing event updated for resources: {'Port': ['ID=6167aa29-943c-4c92-aae1-3c9325112b6a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:10.666077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.695513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f94e2cbc-b8f8-46dc-98a5-b5ea3670ace2 None None] Provisioning complete for port 6167aa29-943c-4c92-aae1-3c9325112b6a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:10.695895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f94e2cbc-b8f8-46dc-98a5-b5ea3670ace2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:10.767680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:57:10.773589 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:57:10.847407 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:57:11.135908 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:09Z', 'revision_number': 3, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:11.160878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.180605 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Checking router: a1333542-4121-47e8-a7de-92405f045a9e for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:57:11.180962 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Updating router a1333542-4121-47e8-a7de-92405f045a9e port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:57:11.209772 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.398429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88f3070a-9716-4233-ba1a-faa4b6dcef3c req-61d451be-51bd-4971-9c36-0122155452ee tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0717781 Dec 21 03:57:11.413172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Allocated IP 172.20.0.1 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/9e4008ef-0c0f-40b4-99d7-d2e320a16713) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:11.594650 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.712857 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.718607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.769534 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.771620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:11.775258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:11.778370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:11.835606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Pushing event updated for resources: {'Port': ['ID=9e4008ef-0c0f-40b4-99d7-d2e320a16713,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:11.867925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.875109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e0cd831-242c-4cea-bc62-f11c075740b0 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:57:11.964376 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Attempting to bind port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:11.964751 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Attempting to bind port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:11.965120 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Attempting to bind port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:11.967693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-791a4adc-7396-40d3-b117-f8f24db39855 None None] Provisioning complete for port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:11.968547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-791a4adc-7396-40d3-b117-f8f24db39855 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:11.973629 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4503f026-2600-4187-bb3a-1b830e999e54 None None] Pushing event updated for resources: {'Port': ['ID=9b5905a1-fcc1-4d24-91e4-3b04c6766205,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:11.993896 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:11.994281 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:11.994682 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.008824 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:12.020333 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Bound port: 9b5905a1-fcc1-4d24-91e4-3b04c6766205, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:12.022288 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.037137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-791a4adc-7396-40d3-b117-f8f24db39855 None None] Port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:12.182354 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] For port 9b5905a1-fcc1-4d24-91e4-3b04c6766205, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:12.204892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6167aa29-943c-4c92-aae1-3c9325112b6a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:12.213474 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] For port 9b5905a1-fcc1-4d24-91e4-3b04c6766205, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b5905a1-fcc1-4d24-91e4-3b04c6766205,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:12.265538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.271806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-45336f6e-1157-4bd5-bd6e-051c86635dba None None] Provisioning complete for port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:12.272417 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-45336f6e-1157-4bd5-bd6e-051c86635dba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.279082 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.323602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-45336f6e-1157-4bd5-bd6e-051c86635dba None None] Port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:12.325470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6167aa29-943c-4c92-aae1-3c9325112b6a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:12.326009 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.375892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94a14d66-cc78-441b-b0f4-bf4e2c9cff47 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:57:12.460705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-90d1f7d8-3154-4c1d-b17d-f13b51db80ee None None] Provisioning complete for port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:12.460705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90d1f7d8-3154-4c1d-b17d-f13b51db80ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.486643 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:57:12.493354 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:12.511820 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4503f026-2600-4187-bb3a-1b830e999e54 None None] Pushing event updated for resources: {'Port': ['ID=9b5905a1-fcc1-4d24-91e4-3b04c6766205,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:12.579764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0c7e7fe-6c3d-4328-853d-8ba07cb7f8cb req-47479263-27f9-4f62-9c48-735413575bc5 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0457985 Dec 21 03:57:12.589326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90d1f7d8-3154-4c1d-b17d-f13b51db80ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.635786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-90d1f7d8-3154-4c1d-b17d-f13b51db80ee None None] For port 9b5905a1-fcc1-4d24-91e4-3b04c6766205, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b5905a1-fcc1-4d24-91e4-3b04c6766205,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:12.760959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90d1f7d8-3154-4c1d-b17d-f13b51db80ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.765346 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:57:12.778139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.836085 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.862264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d1f7d8-3154-4c1d-b17d-f13b51db80ee None None] Pushing event updated for resources: {'Port': ['ID=9b5905a1-fcc1-4d24-91e4-3b04c6766205,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:12.929406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:12.944985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Pushing event updated for resources: {'Port': ['ID=9e4008ef-0c0f-40b4-99d7-d2e320a16713,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:13.080603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:13.085337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:13.182793 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:11Z', 'revision_number': 1, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:13.219664 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-970ec610-9e41-40d7-a4b7-7fa3b3439488 None None] The sync data for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 is: [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:11Z', 'revision_number': 1, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:57:13.398548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Router a1333542-4121-47e8-a7de-92405f045a9e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:57:13.632605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d39567d4-7be1-4dc8-8232-6db226fef6b4 None None] Provisioning complete for port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:13.647383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d39567d4-7be1-4dc8-8232-6db226fef6b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:13.730133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d39567d4-7be1-4dc8-8232-6db226fef6b4 None None] Port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:13.775649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6821703-f920-4256-8ca6-8c677e85aba5 req-0666e715-dab1-4c84-9308-54f393e0cf76 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0693805 Dec 21 03:57:14.147999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:57:14.156027 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b19bca81-ae13-4d28-9897-7090f058ebbb admin admin] 10.222.0.18 "PUT /v2.0/routers/a1333542-4121-47e8-a7de-92405f045a9e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7320073 Dec 21 03:57:14.934413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54081415-24e6-43a5-a7c0-c38f961b7271 req-b7bcf880-b0bc-4191-b8a4-439b0fe0779d tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0403450 Dec 21 03:57:15.208277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33510) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:15.215309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'security_group': {'name': 'tempest-securitygroup--122823268', 'description': 'tempest-description--853856100'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:15.381360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:15.486185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:15.666888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:15.711668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b06ebcf5-fc98-400f-8125-465d9153af92,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:15.777358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:15.778769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ef57d362-fa2f-4b28-8267-191b0d797f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.5694439 Dec 21 03:57:15.786346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33532) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:15.787090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'security_group_rule': {'security_group_id': 'b06ebcf5-fc98-400f-8125-465d9153af92', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:15.892609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:15.956710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.015808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Sync routers for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:57:16.028216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:57:16.029069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:16.067053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.071394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abbb3faf-4856-4397-904d-54f550f837ee req-ab51cfa6-375f-469f-86a6-e2e7e7057665 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0309331 Dec 21 03:57:16.108369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=894f78cf-29ee-4a19-9ffc-65ed8b762994,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:16.229754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.231914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5592417e-f70b-48ac-bcf4-0dcd0af8e0f5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4486544 Dec 21 03:57:16.234479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33552) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:16.241980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'security_group_rule': {'security_group_id': 'b06ebcf5-fc98-400f-8125-465d9153af92', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:16.357988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.371317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33560) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:16.437582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:57:16.477645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.515596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9b5905a1-fcc1-4d24-91e4-3b04c6766205 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:16.521982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c51fbb3-9a58-42b9-9c9b-7ca81ca50266 req-d4d24387-c601-4cf1-b581-70efbb1bf6cd service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0423391 Dec 21 03:57:16.598132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.618101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5b359d85-9166-4303-b503-cbf1f963e5dc,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:16.620395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:16.623974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.670010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591b1635-6bc4-4975-9629-43003f8f4906 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.702834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.707342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f6710ab7-7087-4d25-981e-eb1878c69bab tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4714897 Dec 21 03:57:16.709700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:16.734609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:16.802423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 2, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:16.838202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Checking router: a1333542-4121-47e8-a7de-92405f045a9e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:57:16.838202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Updating router a1333542-4121-47e8-a7de-92405f045a9e port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:57:16.847786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591b1635-6bc4-4975-9629-43003f8f4906 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.872297 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.894776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.930228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-591b1635-6bc4-4975-9629-43003f8f4906 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:16.980914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-591b1635-6bc4-4975-9629-43003f8f4906 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c1c6b49105bf4665b848ca0465d88d18&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6056945 Dec 21 03:57:16.983735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:17.004138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-46736ad3-3650-4912-872a-1213b748fb63 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:17.005705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-46736ad3-3650-4912-872a-1213b748fb63 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/networks?id=45ff9d95-f609-4ed5-9517-1125b7d4496f HTTP/1.1" status: 200 len: 814 time: 0.1362503 Dec 21 03:57:17.024996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591b1635-6bc4-4975-9629-43003f8f4906 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3aa6de6a-bf40-422c-a4b2-68d862b2ee8a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:17.029680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-4d7ba685-42a3-41ba-a61a-4217e0d79bb2 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/quotas/c5b2145a02404e39a8488c84d609fc52 HTTP/1.1" status: 200 len: 375 time: 0.0179915 Dec 21 03:57:17.090603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-baadf75a-65a5-4cbf-80f4-b3d15835ed9f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c5b2145a02404e39a8488c84d609fc52&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0596354 Dec 21 03:57:17.224550 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe7414b-9e8a-47e7-ad00-8a62bab884f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.250287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-8ad17921-df28-498b-b518-04ffcc69224b service neutron] 10.222.0.18 "GET /v2.0/networks/45ff9d95-f609-4ed5-9517-1125b7d4496f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1582534 Dec 21 03:57:17.254436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.261690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba8a4544-3825-4d50-b54a-3271eede3fe9 req-fb346164-fcdc-4080-a35a-a8a07b0cc8cb tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0501397 Dec 21 03:57:17.284617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe7414b-9e8a-47e7-ad00-8a62bab884f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.354896 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.361116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.376980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c558120f-1563-41ba-a824-2d5b4ac84550 service neutron] 10.222.0.18 "GET /v2.0/networks/45ff9d95-f609-4ed5-9517-1125b7d4496f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260736 Dec 21 03:57:17.432993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1cf0b27-1599-4dc3-9e83-3c281487952d None None] Pushing event updated for resources: {'Port': ['ID=9e4008ef-0c0f-40b4-99d7-d2e320a16713,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:17.447387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe7414b-9e8a-47e7-ad00-8a62bab884f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.449257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efe7414b-9e8a-47e7-ad00-8a62bab884f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.454266 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-efe7414b-9e8a-47e7-ad00-8a62bab884f2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3aa6de6a-bf40-422c-a4b2-68d862b2ee8a HTTP/1.1" status: 204 len: 168 time: 0.4619915 Dec 21 03:57:17.542897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Attempting to bind port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:17.543582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Attempting to bind port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:17.544757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Attempting to bind port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:17.558260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efe7414b-9e8a-47e7-ad00-8a62bab884f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3aa6de6a-bf40-422c-a4b2-68d862b2ee8a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:17.562634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:17.562634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:17.562634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.564419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:17.564927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Bound port: 9e4008ef-0c0f-40b4-99d7-d2e320a16713, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:17.565332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.717818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Allocated IP 172.25.5.220 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/b1ce5786-70bc-484f-ab8b-ab5d344a7ecf) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:17.746647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] For port 9e4008ef-0c0f-40b4-99d7-d2e320a16713, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:17.749282 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:57:17.767292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] For port 9e4008ef-0c0f-40b4-99d7-d2e320a16713, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9e4008ef-0c0f-40b4-99d7-d2e320a16713,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:17.804341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0dbaa6c3-29f7-494c-9119-7fdfe7b870e3 req-d69236d8-7831-4d39-abee-322ba3c10b85 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 210 time: 0.0349483 Dec 21 03:57:17.838109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-06924098-16cd-4adf-b0a6-57d497b767d2 None None] Provisioning complete for port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:17.838490 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06924098-16cd-4adf-b0a6-57d497b767d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.869267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.871124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:17.926433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-06924098-16cd-4adf-b0a6-57d497b767d2 None None] Port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:17.947402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:57:17.948157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:56:52Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:18.057385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1cf0b27-1599-4dc3-9e83-3c281487952d None None] Pushing event updated for resources: {'Port': ['ID=9e4008ef-0c0f-40b4-99d7-d2e320a16713,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:18.096326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.238383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=b1ce5786-70bc-484f-ab8b-ab5d344a7ecf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:18.242207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:57:18.277633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:18.280477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:18.285056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:18.327415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9e4008ef-0c0f-40b4-99d7-d2e320a16713 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:18.413628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.465335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:18.465535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.479606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42b0b528-e0a5-4f41-b835-6ee09b16b2b2 req-b5e96dbe-4163-4af7-8b0d-ffe5aa8ce516 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0495837 Dec 21 03:57:18.589044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.622345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8c5cf229-0b92-4e45-bab2-d11cd099d82b None None] Provisioning complete for port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:18.622718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c5cf229-0b92-4e45-bab2-d11cd099d82b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.713114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33624) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:18.719864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.730187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c110b836-c82d-46c9-bab0-fad0232df610 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.782829 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c5cf229-0b92-4e45-bab2-d11cd099d82b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.821105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 9e4008ef-0c0f-40b4-99d7-d2e320a16713, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9e4008ef-0c0f-40b4-99d7-d2e320a16713,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:18.869671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:17Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:18.876563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.889915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c110b836-c82d-46c9-bab0-fad0232df610 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.904307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:18.938305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cd65d1a-371d-49ad-a34c-fb4883634d1f req-bfcec57f-678f-4b95-bed9-5cda9f0aab3d tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 210 time: 0.0582514 Dec 21 03:57:18.949342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c6f9c49-cf1f-4098-9a4b-052b766a42e0 None None] The sync data for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 is: [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:17Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:57:18.976382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.006958 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c110b836-c82d-46c9-bab0-fad0232df610 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.033278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=9e4008ef-0c0f-40b4-99d7-d2e320a16713,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:19.058105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c110b836-c82d-46c9-bab0-fad0232df610 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f946076-e1e3-4ea7-9b87-e04b5050325e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:19.076304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-8c5cf229-0b92-4e45-bab2-d11cd099d82b None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:57:19.076304 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-8c5cf229-0b92-4e45-bab2-d11cd099d82b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:57:19.129770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=b1ce5786-70bc-484f-ab8b-ab5d344a7ecf,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:19.144716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33630) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:19.144901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c110b836-c82d-46c9-bab0-fad0232df610 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0595c4375b55438d860b3dd4709ddd80&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4202988 Dec 21 03:57:19.220911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.285019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7a6494f-9067-42a2-a56f-bd4777a361c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.331997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.342556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a011b4e1-e181-431e-9605-c4a5a6e66753 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.6301453 Dec 21 03:57:19.345199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7a6494f-9067-42a2-a56f-bd4777a361c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.345826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ea35f1-d216-4ee3-afcc-133d039cd5ce req-11b35d43-7031-49c2-87d6-167047592a97 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=bd945098160f4caab48204cf6fa7c286&device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.1134255 Dec 21 03:57:19.430329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a67966c-9fa3-4ffe-b907-bec74b605b11 req-be431110-7c66-4fec-a97f-2911d9d37c5d tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0706866 Dec 21 03:57:19.443634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ea35f1-d216-4ee3-afcc-133d039cd5ce req-539a4f1a-4cdb-4930-981a-bf8a9fcd83bf service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=bd945098160f4caab48204cf6fa7c286&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0571361 Dec 21 03:57:19.490533 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7a6494f-9067-42a2-a56f-bd4777a361c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.493332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7a6494f-9067-42a2-a56f-bd4777a361c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.497041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a7a6494f-9067-42a2-a56f-bd4777a361c0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3f946076-e1e3-4ea7-9b87-e04b5050325e HTTP/1.1" status: 204 len: 168 time: 0.3516443 Dec 21 03:57:19.515380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7a6494f-9067-42a2-a56f-bd4777a361c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f946076-e1e3-4ea7-9b87-e04b5050325e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:19.769801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-f10d183b-4d5b-4773-945b-9d1b942838e8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--122823268&fields=id&tenant_id=2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 267 time: 0.0829456 Dec 21 03:57:19.797946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27ee766e-5c67-471a-9c81-b5a931f484d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:19.877308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ea35f1-d216-4ee3-afcc-133d039cd5ce req-94b07920-1514-452b-83e9-44f14624ab77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:19.878887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ea35f1-d216-4ee3-afcc-133d039cd5ce req-94b07920-1514-452b-83e9-44f14624ab77 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4263892 Dec 21 03:57:19.952754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-ebf41b22-4bad-4998-8982-990b22a5800c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:19.954306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-ebf41b22-4bad-4998-8982-990b22a5800c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.1836565 Dec 21 03:57:19.981412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-029d387c-24ed-4528-bbbf-4af728cb142a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/quotas/2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 375 time: 0.0178170 Dec 21 03:57:20.047794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-518d2a01-cb8a-4d58-a34a-325d3b898bc0 req-3ba60982-a265-4ad6-bb88-0eb00f049e26 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 210 time: 0.0324230 Dec 21 03:57:20.104510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-51e3c51d-590c-458a-ae0b-837f8148b4bc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1185174 Dec 21 03:57:20.220745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9e4008ef-0c0f-40b4-99d7-d2e320a16713 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:20.287744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:20.288514 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:20.318894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-728fecc1-f805-424d-9b93-e610a362dfae service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2116537 Dec 21 03:57:20.434217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-27fb93b9-7eb4-4d58-990d-3fc80e0bdde7 service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1124375 Dec 21 03:57:20.574909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afc7ef8e-54fb-49bf-8d3c-1d94adacbe89 req-854337a6-9a26-4d85-b766-ca1edc8492ca tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0363653 Dec 21 03:57:20.827933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bace6292-c841-49c2-ab1d-6418d3aab72f req-5964f035-1708-4cf5-b5ef-43c95d9b61c1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0486400 Dec 21 03:57:21.053175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-58acc388-321b-4318-92a3-c9d647dfd920 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:21.056042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-58acc388-321b-4318-92a3-c9d647dfd920 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.31 "GET /v2.0/networks?id=45ff9d95-f609-4ed5-9517-1125b7d4496f HTTP/1.1" status: 200 len: 814 time: 0.1567690 Dec 21 03:57:21.109641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Request body: {'port': {'device_id': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'admin_state_up': True, 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:21.314339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ea35f1-d216-4ee3-afcc-133d039cd5ce req-cf191f1e-233e-499e-8a8e-043cb15b5c15 tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.54 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0532818 Dec 21 03:57:21.346636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1754824d-fc26-478f-b7af-113bed587320 req-9e3c936e-120c-48b1-8533-be6d03bcb86e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 210 time: 0.0925078 Dec 21 03:57:21.486445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Made reservation on behalf of c5b2145a02404e39a8488c84d609fc52 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:21.488972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:21.658166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Allocated IP 172.20.0.5 (45ff9d95-f609-4ed5-9517-1125b7d4496f/dcd56809-69ac-49ac-96ed-ba3b364103dd/de198a05-275c-45cd-ae12-f18353267421) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:21.816635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a393de5-5760-4113-96be-b10ea806a518 req-d9ee9bcf-1d54-4d45-ab0a-9fa610521a4f tempest-ServerShowV254Test-1808296698 tempest-ServerShowV254Test-1808296698-project] 10.222.0.18 "GET /v2.0/ports?device_id=72893dcf-d10c-4e5d-862a-02cecd5f4f21 HTTP/1.1" status: 200 len: 210 time: 0.0583117 Dec 21 03:57:21.914438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-632c9c1c-6528-4a53-8a67-faaa8fe36744 req-1fb13b8f-dd7d-46b9-83ae-6e05e5031084 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0401263 Dec 21 03:57:21.928043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.067097 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.106701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:22.111925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:22.115905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:22.153634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Pushing event updated for resources: {'Port': ['ID=de198a05-275c-45cd-ae12-f18353267421,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:22.177677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:22.178344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.312024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-86f46c4d-b292-4b22-890b-941e8c61779c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.347771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-c47b3004-4e0d-4cda-951b-cd504417b7d9 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2584450 Dec 21 03:57:22.439800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Request body: {'port': {'device_id': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:22.445177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7f75976b-0ba6-40e6-b47b-aeca60b913d0 None None] Provisioning complete for port de198a05-275c-45cd-ae12-f18353267421 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:22.445849 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f75976b-0ba6-40e6-b47b-aeca60b913d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.585071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-862e1546-9be1-478b-aac7-6aa64e8ac087 req-4b173b3f-756e-4996-b477-16a82195b538 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:22.595957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-862e1546-9be1-478b-aac7-6aa64e8ac087 req-4b173b3f-756e-4996-b477-16a82195b538 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 931 time: 0.1528709 Dec 21 03:57:22.621023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7f75976b-0ba6-40e6-b47b-aeca60b913d0 None None] Port de198a05-275c-45cd-ae12-f18353267421 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:22.665298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.666421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:22.732765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-862e1546-9be1-478b-aac7-6aa64e8ac087 req-65fee24d-6c77-408d-a167-73de7db74168 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1354640 Dec 21 03:57:23.055731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b9ce0f9-1bc2-4cc2-9e83-6eac867515be req-31403f8a-58bf-46fa-a5ac-ac6d90f12bc6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0451326 Dec 21 03:57:23.132187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id de198a05-275c-45cd-ae12-f18353267421 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:57:23.141740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:23.163861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Transition to ACTIVE for port object de198a05-275c-45cd-ae12-f18353267421 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:57:23.192940 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:23.249138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:23.317747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Pushing event updated for resources: {'Port': ['ID=de198a05-275c-45cd-ae12-f18353267421,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:23.431378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Attempting to bind port de198a05-275c-45cd-ae12-f18353267421 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:23.433048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Attempting to bind port de198a05-275c-45cd-ae12-f18353267421 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:23.433490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Attempting to bind port de198a05-275c-45cd-ae12-f18353267421 on network 45ff9d95-f609-4ed5-9517-1125b7d4496f {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:23.449902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Port de198a05-275c-45cd-ae12-f18353267421 on network 45ff9d95-f609-4ed5-9517-1125b7d4496f not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:57:23.450292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Attempting to bind port de198a05-275c-45cd-ae12-f18353267421 on network 45ff9d95-f609-4ed5-9517-1125b7d4496f {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:23.459226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 56, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:23.459589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Checking segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:23.459970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Bound using segment: {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:23.460405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Bound port: de198a05-275c-45cd-ae12-f18353267421, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:23.464212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:23.563335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] For port de198a05-275c-45cd-ae12-f18353267421, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:23.569140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] For port de198a05-275c-45cd-ae12-f18353267421, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=de198a05-275c-45cd-ae12-f18353267421,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:23.675621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:23.729960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:23.730589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:23.732370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] 10.222.0.31 "PUT /v2.0/ports/de198a05-275c-45cd-ae12-f18353267421 HTTP/1.1" status: 200 len: 1092 time: 1.3054869 Dec 21 03:57:23.733731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'tag': 'de198a05-275c-45cd-ae12-f18353267421'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:57:23.736162 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad" -d '{"events": [{"name": "network-changed", "server_uuid": "6391fca4-0a89-4dab-8c0e-57f2e8d9895c", "tag": "de198a05-275c-45cd-ae12-f18353267421"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:57:23.768893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a42692-6d38-4510-b3f6-2def9f2725a3 service neutron] Pushing event updated for resources: {'Port': ['ID=de198a05-275c-45cd-ae12-f18353267421,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:23.811211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:57:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8249b6b-04c3-4910-a808-1bb63f71ea60 x-openstack-request-id: req-d8249b6b-04c3-4910-a808-1bb63f71ea60 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:57:23.811512 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6391fca4-0a89-4dab-8c0e-57f2e8d9895c", "tag": "de198a05-275c-45cd-ae12-f18353267421", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:57:23.811773 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d8249b6b-04c3-4910-a808-1bb63f71ea60 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:57:23.812185 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'tag': 'de198a05-275c-45cd-ae12-f18353267421', 'status': 'completed', 'code': 200} Dec 21 03:57:23.967179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d916c43-7002-4df6-a8a5-c10435fd5824 req-b847c538-4111-40b2-adbd-d4f0c65f42fc tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:23.968796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d916c43-7002-4df6-a8a5-c10435fd5824 req-b847c538-4111-40b2-adbd-d4f0c65f42fc tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.1075335 Dec 21 03:57:24.087531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:24.115453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d916c43-7002-4df6-a8a5-c10435fd5824 req-60aa16cb-7c35-46e8-9006-e701e88dd7df tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1284821 Dec 21 03:57:24.295801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b20d959d-47a4-413c-8cf0-1382a3f3d78a req-9d919049-ff90-4d54-bfac-d67cc914bff6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0898767 Dec 21 03:57:24.374964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad req-65c2bf5d-f69e-4afc-af55-67e14906edcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:24.379798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad req-65c2bf5d-f69e-4afc-af55-67e14906edcb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c5b2145a02404e39a8488c84d609fc52&device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 1095 time: 0.1504803 Dec 21 03:57:24.567552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64721f82-5ccd-4f87-89fa-6eab1ed0ecbc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:24.751150 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64721f82-5ccd-4f87-89fa-6eab1ed0ecbc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:24.831927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64721f82-5ccd-4f87-89fa-6eab1ed0ecbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:24.882641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-64721f82-5ccd-4f87-89fa-6eab1ed0ecbc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bd945098160f4caab48204cf6fa7c286&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7932568 Dec 21 03:57:24.883824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64721f82-5ccd-4f87-89fa-6eab1ed0ecbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19f82350-f2c5-4a95-b5be-53b9c62710fe,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:24.885335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33830) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:24.926297 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:24.961995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-931264ae-a71d-419b-a370-dadb5c4385c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:24.987432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-931264ae-a71d-419b-a370-dadb5c4385c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:25.011846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:25.126439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-931264ae-a71d-419b-a370-dadb5c4385c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:25.131654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-931264ae-a71d-419b-a370-dadb5c4385c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:25.133039 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-931264ae-a71d-419b-a370-dadb5c4385c4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/19f82350-f2c5-4a95-b5be-53b9c62710fe HTTP/1.1" status: 204 len: 168 time: 0.2458084 Dec 21 03:57:25.156113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931264ae-a71d-419b-a370-dadb5c4385c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19f82350-f2c5-4a95-b5be-53b9c62710fe,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:25.340601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a673bfbd-76c8-4708-b6a8-14c114aca2b6 req-8c09cdaa-8876-4750-a1e6-0abf9bbf5563 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:25.342181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a673bfbd-76c8-4708-b6a8-14c114aca2b6 req-8c09cdaa-8876-4750-a1e6-0abf9bbf5563 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.1101618 Dec 21 03:57:25.457495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a673bfbd-76c8-4708-b6a8-14c114aca2b6 req-7ae5ad04-819f-4e61-965c-e930764f3295 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041062 Dec 21 03:57:25.488707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8940259-d1c1-4c62-a8b9-5be5ead16090 req-4fd9af06-f04e-4c2b-86f8-39fc4315c69a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0489721 Dec 21 03:57:25.804161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:26.636795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04c30f5-20fb-499b-8920-ee13227dea71 req-47b7a1c5-6e59-49fb-852e-301c819687b4 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:26.639211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a04c30f5-20fb-499b-8920-ee13227dea71 req-47b7a1c5-6e59-49fb-852e-301c819687b4 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.0866058 Dec 21 03:57:26.924479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33916) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:27.014544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57f2acf5-65e4-4416-a334-fddf3bc159b1 req-6cde9f25-e76d-403f-b78e-278bf3775eac tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.4061463 Dec 21 03:57:27.107904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a04c30f5-20fb-499b-8920-ee13227dea71 req-bd7ba6aa-b669-4a69-95b3-eef4de841071 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968082 Dec 21 03:57:27.175146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0ce3595-4bb7-4e06-8832-9395bb22356f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.292143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0ce3595-4bb7-4e06-8832-9395bb22356f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.435256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0ce3595-4bb7-4e06-8832-9395bb22356f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.483418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a0ce3595-4bb7-4e06-8832-9395bb22356f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5c7ec79b427f4bf982346544959c3393&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5574458 Dec 21 03:57:27.487448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33928) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:27.503923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ce3595-4bb7-4e06-8832-9395bb22356f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=518e3a6e-97e3-461c-8439-21d279c27437,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:27.575927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7637899a-8e45-4c56-b401-f12e0c3de6da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.599216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7637899a-8e45-4c56-b401-f12e0c3de6da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.886088 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7637899a-8e45-4c56-b401-f12e0c3de6da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.891646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7637899a-8e45-4c56-b401-f12e0c3de6da admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:27.893192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7637899a-8e45-4c56-b401-f12e0c3de6da admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/518e3a6e-97e3-461c-8439-21d279c27437 HTTP/1.1" status: 204 len: 168 time: 0.4041541 Dec 21 03:57:27.903293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7637899a-8e45-4c56-b401-f12e0c3de6da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=518e3a6e-97e3-461c-8439-21d279c27437,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:28.214503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34603df7-68e0-4291-a4de-48c76e518cb8 req-a9cd479a-520c-4f78-8cee-1e97d54cb2af tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0912311 Dec 21 03:57:28.312624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f61a0e2-1c7d-4fa5-a0af-faf7424b56f4 req-9edca44e-d7a3-4d75-ae79-378d71f2699f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:28.319664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f61a0e2-1c7d-4fa5-a0af-faf7424b56f4 req-9edca44e-d7a3-4d75-ae79-378d71f2699f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.0804045 Dec 21 03:57:28.402384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f61a0e2-1c7d-4fa5-a0af-faf7424b56f4 req-cad17c6c-f37d-455d-b54f-24894651923d tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780349 Dec 21 03:57:29.010119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33954) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:29.031762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bea36be-66cb-4c06-bc6f-c4411398b817 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.117376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bea36be-66cb-4c06-bc6f-c4411398b817 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.185999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bea36be-66cb-4c06-bc6f-c4411398b817 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.241048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1bea36be-66cb-4c06-bc6f-c4411398b817 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=47b5b4b6d5e242d89ae53f7f3c3d2dac&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2266247 Dec 21 03:57:29.241048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bea36be-66cb-4c06-bc6f-c4411398b817 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54a82b5f-e77c-486b-b93e-f29033dd2768,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:29.242427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33960) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:29.356458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d289b67-bee1-4f85-8c90-f10f8caad5f8 req-1e97f854-d576-4724-ac63-d6c3215e536c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0474827 Dec 21 03:57:29.364946 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22b5758b-daa6-4f1c-9c31-55cae52414e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.414749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22b5758b-daa6-4f1c-9c31-55cae52414e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.581536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22b5758b-daa6-4f1c-9c31-55cae52414e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.586901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22b5758b-daa6-4f1c-9c31-55cae52414e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:29.588294 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-22b5758b-daa6-4f1c-9c31-55cae52414e2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/54a82b5f-e77c-486b-b93e-f29033dd2768 HTTP/1.1" status: 204 len: 168 time: 0.3443737 Dec 21 03:57:29.603215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22b5758b-daa6-4f1c-9c31-55cae52414e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54a82b5f-e77c-486b-b93e-f29033dd2768,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:29.621674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8874357-294e-47fe-88c1-8ad62190b87a req-45317338-9401-4d45-a8db-acbb73fb7340 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:29.626546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8874357-294e-47fe-88c1-8ad62190b87a req-45317338-9401-4d45-a8db-acbb73fb7340 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.1107786 Dec 21 03:57:29.694493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8874357-294e-47fe-88c1-8ad62190b87a req-2bce977e-87e6-4a3d-b394-2d904d032bcf tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605257 Dec 21 03:57:30.467225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f791317b-ef08-4f3e-9764-7fb7d403240f req-7530e15c-3c9b-498b-a1d4-f4392bf81bd0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0267260 Dec 21 03:57:30.825960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d274e01a-57be-41f4-b4e2-497c987d27e3 req-bc5da6e0-cc6c-463d-8979-2fc7dfce65b6 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:30.827923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d274e01a-57be-41f4-b4e2-497c987d27e3 req-bc5da6e0-cc6c-463d-8979-2fc7dfce65b6 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.0533369 Dec 21 03:57:30.906583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d274e01a-57be-41f4-b4e2-497c987d27e3 req-82680190-097d-4dc6-a934-373c672efb47 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702939 Dec 21 03:57:31.542090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34018) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:31.620187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cafa6ea9-06f5-46c4-b86e-e82a885cd6ed req-980d3bd7-aa13-4e91-bb5b-39142e555564 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0669682 Dec 21 03:57:31.753791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0c5d09-4a18-4cbb-88a6-e1e522bd1066 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:31.918698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0c5d09-4a18-4cbb-88a6-e1e522bd1066 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:31.986796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a0c5d09-4a18-4cbb-88a6-e1e522bd1066 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:32.054555 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6a0c5d09-4a18-4cbb-88a6-e1e522bd1066 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b9bb4e5f16374849a17791575cf67893&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5103936 Dec 21 03:57:32.055750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0c5d09-4a18-4cbb-88a6-e1e522bd1066 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a961f27-29b8-4571-8781-51d1e2add715,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:32.058271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34042) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:32.144998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7362730-005c-4935-9396-ed21e2387799 req-fb378d65-a26f-458f-acc0-e857a3f52fe5 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:32.144998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7362730-005c-4935-9396-ed21e2387799 req-fb378d65-a26f-458f-acc0-e857a3f52fe5 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.1125796 Dec 21 03:57:32.171383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78e27663-7baa-4ab9-9e8a-8868b309ad48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:32.230019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7362730-005c-4935-9396-ed21e2387799 req-2d3b0be2-7415-43db-b66e-1b03664d1c3f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786560 Dec 21 03:57:32.235766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78e27663-7baa-4ab9-9e8a-8868b309ad48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:32.626574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78e27663-7baa-4ab9-9e8a-8868b309ad48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:32.630714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78e27663-7baa-4ab9-9e8a-8868b309ad48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:32.635921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-78e27663-7baa-4ab9-9e8a-8868b309ad48 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2a961f27-29b8-4571-8781-51d1e2add715 HTTP/1.1" status: 204 len: 168 time: 0.5762208 Dec 21 03:57:32.646151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e27663-7baa-4ab9-9e8a-8868b309ad48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a961f27-29b8-4571-8781-51d1e2add715,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:32.736182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e44673b6-da5c-43bc-9ce7-a53d60692350 req-f13ed11c-8792-4e37-b7ed-430e4cacd449 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0344694 Dec 21 03:57:33.273236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad req-75a5f784-c476-4db8-815f-cccbb0e408e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:33.278499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad req-75a5f784-c476-4db8-815f-cccbb0e408e1 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=c5b2145a02404e39a8488c84d609fc52&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1220870 Dec 21 03:57:33.389003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad req-4d9d3f78-3b34-4d25-985a-3e44f5f3f061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:33.390345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b1641db-03dd-4e0c-a24b-f4cad9e950ad req-4d9d3f78-3b34-4d25-985a-3e44f5f3f061 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1015632 Dec 21 03:57:33.515120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-f0719a33-ba00-4970-a94d-ee7c54f416a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:33.518412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-f0719a33-ba00-4970-a94d-ee7c54f416a6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c5b2145a02404e39a8488c84d609fc52&device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 1095 time: 0.0478244 Dec 21 03:57:33.576642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-7cc9a47b-5b64-447f-b43d-093a05ece493 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=de198a05-275c-45cd-ae12-f18353267421 HTTP/1.1" status: 200 len: 217 time: 0.0368237 Dec 21 03:57:33.589833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34082) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:33.620602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afbd7b69-cc20-424b-b689-9b703c828b0f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:33.634323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-2e7ec7e9-b0a8-4d9f-a3da-9c55c136b2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:33.635850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-2e7ec7e9-b0a8-4d9f-a3da-9c55c136b2d8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=dcd56809-69ac-49ac-96ed-ba3b364103dd HTTP/1.1" status: 200 len: 853 time: 0.0516582 Dec 21 03:57:33.714340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-3acfe7fc-c5bd-4937-b825-62844ebea224 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:33.717214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-3acfe7fc-c5bd-4937-b825-62844ebea224 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=45ff9d95-f609-4ed5-9517-1125b7d4496f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0573075 Dec 21 03:57:33.748251 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afbd7b69-cc20-424b-b689-9b703c828b0f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:33.832020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afbd7b69-cc20-424b-b689-9b703c828b0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:33.890494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afbd7b69-cc20-424b-b689-9b703c828b0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c6afa42-adf5-43b9-bd5c-aa077ee0997c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:33.903635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-3f22c8c6-9d95-4925-a06d-70e0a429ad30 service neutron] 10.222.0.31 "GET /v2.0/networks/45ff9d95-f609-4ed5-9517-1125b7d4496f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1738756 Dec 21 03:57:33.911214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-afbd7b69-cc20-424b-b689-9b703c828b0f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=acc5a343bf6a4d258446069e49bdc842&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3192151 Dec 21 03:57:33.913822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34092) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:33.924535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae31a1e8-7bd1-4370-8686-044378fe3d3c req-e354abf5-3f12-4c4c-b2d5-145c43464473 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0416598 Dec 21 03:57:33.940709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a5a26a-384c-4b42-a332-921ba953c56c req-6cf7470a-7c61-47e9-8443-47c0d41ba965 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:33.956948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a5a26a-384c-4b42-a332-921ba953c56c req-6cf7470a-7c61-47e9-8443-47c0d41ba965 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.6431472 Dec 21 03:57:33.976405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af4c683e-194f-4457-a736-09fdc57d3d37 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:34.007042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af4c683e-194f-4457-a736-09fdc57d3d37 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:34.132097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af4c683e-194f-4457-a736-09fdc57d3d37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:34.136094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af4c683e-194f-4457-a736-09fdc57d3d37 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:34.140681 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-af4c683e-194f-4457-a736-09fdc57d3d37 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5c6afa42-adf5-43b9-bd5c-aa077ee0997c HTTP/1.1" status: 204 len: 168 time: 0.2258468 Dec 21 03:57:34.140818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27a5a26a-384c-4b42-a332-921ba953c56c req-6edded0c-9b60-4604-b39b-5c7e9b237bcc tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1826820 Dec 21 03:57:34.153751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af4c683e-194f-4457-a736-09fdc57d3d37 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c6afa42-adf5-43b9-bd5c-aa077ee0997c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:34.168904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b98e96-1b19-4ffa-be6a-8357dfef241a req-27711efa-aef0-493b-b453-c9385f04efb5 service neutron] 10.222.0.31 "GET /v2.0/networks/45ff9d95-f609-4ed5-9517-1125b7d4496f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2465982 Dec 21 03:57:34.195534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-0ac8c1a3-e15f-4812-8c40-a435dcb108dc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:34.197577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-0ac8c1a3-e15f-4812-8c40-a435dcb108dc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.2309897 Dec 21 03:57:34.288262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-3873a3e5-99f6-4156-9c10-c96313777bc9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 379 time: 0.0738842 Dec 21 03:57:34.340616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'port': {'device_id': '310d006f-a51c-4bee-adac-4f0f1281690e', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'admin_state_up': True, 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'security_groups': ['b06ebcf5-fc98-400f-8125-465d9153af92']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:34.599864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:34.603842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:34.743977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Allocated IP 172.20.0.4 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/643a3827-c0d5-4377-893a-3bf71f16b0e8) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:34.861292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34124) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:34.932585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.019119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55125001-7747-48a8-b942-386a182a57a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.047000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecfdad81-f32b-4dbc-ba1f-0cb612331c4d req-a5ca4705-49f1-4da5-9df5-bf298335b85e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0323870 Dec 21 03:57:35.066672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.135607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55125001-7747-48a8-b942-386a182a57a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.141592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:35.144998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:35.151512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:35.156006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.210851 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:35.216734 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:35.219265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:35.220275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.232449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55125001-7747-48a8-b942-386a182a57a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.279783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55125001-7747-48a8-b942-386a182a57a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d41cad9a-bbf6-4faf-8da3-962fb22cb9fc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:35.292700 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-55125001-7747-48a8-b942-386a182a57a6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=24b8d0acd2a04544ac2a505c4ebdc2b2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4302430 Dec 21 03:57:35.293322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:35.362969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-6459dee3-0282-44a8-850b-1bd7e978e372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0268304 Dec 21 03:57:35.384082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777706a0-fc2f-46a1-9e3c-59cc209045a0 req-ea430ee1-7cf0-4384-8bd5-13af641ad805 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:35.386717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11c1725a-9c74-4b5d-b74f-3ec93066ca18 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.389201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-777706a0-fc2f-46a1-9e3c-59cc209045a0 req-ea430ee1-7cf0-4384-8bd5-13af641ad805 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.1283085 Dec 21 03:57:35.401227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Request body: {'port': {'device_id': '310d006f-a51c-4bee-adac-4f0f1281690e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:35.414662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11c1725a-9c74-4b5d-b74f-3ec93066ca18 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.518381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.538984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-777706a0-fc2f-46a1-9e3c-59cc209045a0 req-b1ce558f-c370-4eec-a6be-0738572cbdf7 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984066 Dec 21 03:57:35.567282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c8b17233-dfaf-4c1e-bf79-4c394f90ed1b None None] Provisioning complete for port 643a3827-c0d5-4377-893a-3bf71f16b0e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:35.577004 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c8b17233-dfaf-4c1e-bf79-4c394f90ed1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.596650 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11c1725a-9c74-4b5d-b74f-3ec93066ca18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.601454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11c1725a-9c74-4b5d-b74f-3ec93066ca18 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.602903 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-11c1725a-9c74-4b5d-b74f-3ec93066ca18 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d41cad9a-bbf6-4faf-8da3-962fb22cb9fc HTTP/1.1" status: 204 len: 168 time: 0.3086512 Dec 21 03:57:35.609282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c8b17233-dfaf-4c1e-bf79-4c394f90ed1b None None] Port 643a3827-c0d5-4377-893a-3bf71f16b0e8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:35.613707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c1725a-9c74-4b5d-b74f-3ec93066ca18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d41cad9a-bbf6-4faf-8da3-962fb22cb9fc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:35.815925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:57:35.824911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.837780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Transition to ACTIVE for port object 643a3827-c0d5-4377-893a-3bf71f16b0e8 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:57:35.917269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:35.967181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:36.050355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Attempting to bind port 643a3827-c0d5-4377-893a-3bf71f16b0e8 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:36.050703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Attempting to bind port 643a3827-c0d5-4377-893a-3bf71f16b0e8 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:36.051077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Attempting to bind port 643a3827-c0d5-4377-893a-3bf71f16b0e8 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:36.056700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Port 643a3827-c0d5-4377-893a-3bf71f16b0e8 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:57:36.057034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Attempting to bind port 643a3827-c0d5-4377-893a-3bf71f16b0e8 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:36.061902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:36.064716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:36.064716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:36.064716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Bound port: 643a3827-c0d5-4377-893a-3bf71f16b0e8, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:36.064716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.186738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:36.210707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:36.227819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba87571-b6d5-44a3-ad08-65f17117f602 req-a2f47a68-fe55-4e8c-b1f5-3a56636066df tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:36.235925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ba87571-b6d5-44a3-ad08-65f17117f602 req-a2f47a68-fe55-4e8c-b1f5-3a56636066df tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 943 time: 0.0898955 Dec 21 03:57:36.253646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34184) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:36.258899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'network': {'name': 'tempest-device-tagging-net1-275425673'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:36.278438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.292880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ba87571-b6d5-44a3-ad08-65f17117f602 req-18e62002-ab34-40fb-9679-14a9f436af5f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558469 Dec 21 03:57:36.317846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:36.318307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.319582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] 10.222.0.31 "PUT /v2.0/ports/643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 1092 time: 0.9282744 Dec 21 03:57:36.320028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:57:36.322415 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a" -d '{"events": [{"name": "network-changed", "server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:57:36.352621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47878cc-6fa3-433c-b854-bb9654b1142a service neutron] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:36.370203 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:57:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18dbbe4c-c757-4418-ad53-9fe5ec00a0e1 x-openstack-request-id: req-18dbbe4c-c757-4418-ad53-9fe5ec00a0e1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:57:36.370527 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:57:36.370762 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-18dbbe4c-c757-4418-ad53-9fe5ec00a0e1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:57:36.371209 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'status': 'completed', 'code': 200} Dec 21 03:57:36.377109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:36.381305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.391195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34188) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:36.411972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:57:36.429905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.430674 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Added segment 95ba2a4f-5934-40bc-93f6-2d408e4d50cd of type vlan for network 8d559823-2509-427a-8bd4-77cf5a81095a Dec 21 03:57:36.453477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5125dad6-7526-4caa-9785-692fb13b1e5d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.491199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a req-87dc9452-842f-469c-b587-2c37270f9881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:36.492760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a req-87dc9452-842f-469c-b587-2c37270f9881 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1095 time: 0.0728815 Dec 21 03:57:36.502516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.594555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.602523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:36.603445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.660732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5125dad6-7526-4caa-9785-692fb13b1e5d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.690327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a req-2af24570-0d28-429e-8f38-b9ff209125f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:36.692579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a req-2af24570-0d28-429e-8f38-b9ff209125f2 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=2d46b810d87943059c90ba895934ed3b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1748452 Dec 21 03:57:36.694550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Network': ['ID=8d559823-2509-427a-8bd4-77cf5a81095a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:36.714883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8d559823-2509-427a-8bd4-77cf5a81095a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:57:36.739505 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f66f10af-7c94-41af-8c22-4f54a47ef025 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.4845507 Dec 21 03:57:36.741865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34202) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:36.746703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5125dad6-7526-4caa-9785-692fb13b1e5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.750387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'network': {'name': 'tempest-device-tagging-net2-1977640793'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:36.845635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5125dad6-7526-4caa-9785-692fb13b1e5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1d82da0-a49d-49ec-96c6-6cc6879fe02d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:36.854694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:36.855324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5125dad6-7526-4caa-9785-692fb13b1e5d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9b102eb676fd458da2d80e04f8b7010f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4619801 Dec 21 03:57:36.877553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a req-5e4af7b8-fe08-4698-9775-a8a2ce6e471b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:36.880240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f26b1cba-2be2-4e2c-8dae-ca0e74dd577a req-5e4af7b8-fe08-4698-9775-a8a2ce6e471b service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1762033 Dec 21 03:57:36.883466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:36.886970 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.932928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:57:36.948830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:36.949385 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Added segment ed5c034b-3532-410c-a7e9-aabd119ea3a2 of type vlan for network 42bfeccc-af8e-4aab-801c-72e8e8caa439 Dec 21 03:57:36.993887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c23ec712-7a17-4050-bd79-e505f6f5ad96 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.015860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.032608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c23ec712-7a17-4050-bd79-e505f6f5ad96 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.059753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-65e4b953-5499-46e1-9b87-523d553457b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:37.059753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-65e4b953-5499-46e1-9b87-523d553457b6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1095 time: 0.0829151 Dec 21 03:57:37.066521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd816b3-77a7-43e0-8cbf-437217f66f1d req-473d125b-6040-46b8-9c5e-c340acc13e9d tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:37.068562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddd816b3-77a7-43e0-8cbf-437217f66f1d req-473d125b-6040-46b8-9c5e-c340acc13e9d tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.4059489 Dec 21 03:57:37.127986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-da475ffc-7fe8-480d-bcce-c2404e18cd99 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 217 time: 0.0529151 Dec 21 03:57:37.137303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.143734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:37.145525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.188516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c23ec712-7a17-4050-bd79-e505f6f5ad96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.191320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c23ec712-7a17-4050-bd79-e505f6f5ad96 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.195358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c23ec712-7a17-4050-bd79-e505f6f5ad96 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c1d82da0-a49d-49ec-96c6-6cc6879fe02d HTTP/1.1" status: 204 len: 168 time: 0.3372455 Dec 21 03:57:37.201874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddd816b3-77a7-43e0-8cbf-437217f66f1d req-d26775fd-49b7-421a-bd2c-2625437b9eca tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1205111 Dec 21 03:57:37.209362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-466885a7-4d51-4a3f-a033-4a3e7ee08008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:37.210912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-466885a7-4d51-4a3f-a033-4a3e7ee08008 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0693538 Dec 21 03:57:37.239520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c23ec712-7a17-4050-bd79-e505f6f5ad96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1d82da0-a49d-49ec-96c6-6cc6879fe02d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:37.264548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Network': ['ID=42bfeccc-af8e-4aab-801c-72e8e8caa439,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:37.272097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-4ba8df04-a631-4019-acd6-8aea3668b039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:37.275467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-4ba8df04-a631-4019-acd6-8aea3668b039 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0529528 Dec 21 03:57:37.275599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:57:37.284850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8192cdb5-95f8-436f-b70f-472b819098cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.5395024 Dec 21 03:57:37.285064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:37.290144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'subnet': {'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'cidr': '10.1.1.0/24', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:37.419322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-77911b33-e404-4277-96b6-3a3f44ba08e3 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1318660 Dec 21 03:57:37.492692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device de198a05-275c-45cd-ae12-f18353267421 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:57:37.543261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febf2249-9a94-4b72-b6bd-90ba011ebca6 req-eada0c4e-2b4b-4b69-9e1c-d554c83e5e2d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:37.543261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-febf2249-9a94-4b72-b6bd-90ba011ebca6 req-eada0c4e-2b4b-4b69-9e1c-d554c83e5e2d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 943 time: 0.1206696 Dec 21 03:57:37.602686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4de5c4d0-1c7e-4399-9e51-66b95f483cf3 req-c698d08c-7ee6-4f04-8720-ed229cd47c56 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1707425 Dec 21 03:57:37.654068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-febf2249-9a94-4b72-b6bd-90ba011ebca6 req-35e5e61e-8e54-4f00-a4ab-8baff44e2dd2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0768776 Dec 21 03:57:37.774217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port de198a05-275c-45cd-ae12-f18353267421, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=de198a05-275c-45cd-ae12-f18353267421,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:37.786802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'de198a05-275c-45cd-ae12-f18353267421', 'network_id': '45ff9d95-f609-4ed5-9517-1125b7d4496f', 'port_id': 'de198a05-275c-45cd-ae12-f18353267421', 'mac_address': 'fa:16:3e:93:45:16', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dcd56809-69ac-49ac-96ed-ba3b364103dd', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:57:37.827239 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:37.840181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id de198a05-275c-45cd-ae12-f18353267421 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:57:37.859025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port de198a05-275c-45cd-ae12-f18353267421, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=de198a05-275c-45cd-ae12-f18353267421,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:38.320786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e84f4d-631c-4a91-8f86-6c11a6901d3a req-04f8684f-0134-42ba-aabb-41b9569d4c8e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:38.322286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7e84f4d-631c-4a91-8f86-6c11a6901d3a req-04f8684f-0134-42ba-aabb-41b9569d4c8e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 943 time: 0.0529511 Dec 21 03:57:38.371401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7e84f4d-631c-4a91-8f86-6c11a6901d3a req-31e197ae-12eb-4511-a8b5-818eeb264172 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431006 Dec 21 03:57:38.425993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:38.430222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:38.464133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:38.525021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=de198a05-275c-45cd-ae12-f18353267421,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:38.710166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:38.776531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['de198a05-275c-45cd-ae12-f18353267421'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:57:38.787484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bf3ca5-690e-444c-ad89-2b9258ce0029 req-796f717d-59d0-40df-a65d-fba1b730eb53 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:38.787484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72bf3ca5-690e-444c-ad89-2b9258ce0029 req-796f717d-59d0-40df-a65d-fba1b730eb53 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 943 time: 0.0745924 Dec 21 03:57:38.820054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Subnet': ['ID=966929b7-7c93-4802-a83d-62484be430ce,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:38.850798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Checking segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:38.851202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network hostable DHCP agents. Network: 8d559823-2509-427a-8bd4-77cf5a81095a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:57:38.884935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72bf3ca5-690e-444c-ad89-2b9258ce0029 req-1aa7c746-519c-4e58-b93b-253fabf05734 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878305 Dec 21 03:57:38.998015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 8d559823-2509-427a-8bd4-77cf5a81095a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:57:39.106158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8d559823-2509-427a-8bd4-77cf5a81095a) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:39.110405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:39.111078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.116366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29e30e9c-d5bf-4c6a-b7c9-f667f6a7709d None None] Network 8d559823-2509-427a-8bd4-77cf5a81095a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:57:39.196801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-07595a80-a6f8-4dcc-9c34-c22f8116b60d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.9106166 Dec 21 03:57:39.199968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:39.204870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'subnet': {'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439', 'cidr': '10.2.2.0/24', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:39.257023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-8d559823-2509-427a-8bd4-77cf5a81095a', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'project_id': '2e28414564544bb283304990bb7b8542', 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:57:39.257914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.386437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:39.390130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.398113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Allocated IP 10.1.1.2 (8d559823-2509-427a-8bd4-77cf5a81095a/966929b7-7c93-4802-a83d-62484be430ce/400e6f56-e946-4c33-8745-f1a3be28db2c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:39.515614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device de198a05-275c-45cd-ae12-f18353267421 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:39.525032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f9dc25c-18bd-4ea9-bfdc-229a0a4d84ec req-d9a4d11e-e0e8-431b-9590-700a35f0459e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:39.534788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f9dc25c-18bd-4ea9-bfdc-229a0a4d84ec req-d9a4d11e-e0e8-431b-9590-700a35f0459e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 944 time: 0.0802176 Dec 21 03:57:39.602733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f9dc25c-18bd-4ea9-bfdc-229a0a4d84ec req-9a1e618d-efec-4798-a4b6-9cd8f64349f1 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636961 Dec 21 03:57:39.656068 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.778012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.780364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port de198a05-275c-45cd-ae12-f18353267421 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:57:39.812447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.820175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port de198a05-275c-45cd-ae12-f18353267421 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:39.820551 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.862399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Network 8d559823-2509-427a-8bd4-77cf5a81095a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:39.865604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:39.873533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:39.887856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Pushing event updated for resources: {'Port': ['ID=400e6f56-e946-4c33-8745-f1a3be28db2c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:39.911015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Subnet': ['ID=73b86b05-b093-4acf-bae3-cf60f26838b3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:39.914977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Checking segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:39.914977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network hostable DHCP agents. Network: 42bfeccc-af8e-4aab-801c-72e8e8caa439, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:57:39.967392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Attempting to bind port 400e6f56-e946-4c33-8745-f1a3be28db2c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:39.967788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Attempting to bind port 400e6f56-e946-4c33-8745-f1a3be28db2c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:39.968519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Attempting to bind port 400e6f56-e946-4c33-8745-f1a3be28db2c on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:39.992599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:39.992992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Checking segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:39.993401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:39.993797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Bound using segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:39.994473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Bound port: 400e6f56-e946-4c33-8745-f1a3be28db2c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:39.994863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.006175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:57:40.035178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b82e3dcd-448b-4e0e-8859-234012d14370 req-bac5060e-bfc2-4c7f-ac50-052a2bd0a55a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:40.040571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b82e3dcd-448b-4e0e-8859-234012d14370 req-bac5060e-bfc2-4c7f-ac50-052a2bd0a55a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 943 time: 0.0654235 Dec 21 03:57:40.043029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.078402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de198a05-275c-45cd-ae12-f18353267421'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:57:40.079869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 42bfeccc-af8e-4aab-801c-72e8e8caa439) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:40.081198 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-feb83b8a-bc3c-4d5a-8b38-61e816a37546" -d '{"events": [{"server_uuid": "6391fca4-0a89-4dab-8c0e-57f2e8d9895c", "name": "network-vif-plugged", "status": "completed", "tag": "de198a05-275c-45cd-ae12-f18353267421"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:57:40.092928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:40.093688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.099805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02f04372-99dd-4008-9377-e7875d96692f None None] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:57:40.125667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b82e3dcd-448b-4e0e-8859-234012d14370 req-a7c83b25-9727-42ef-ab78-350005ea0553 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0759075 Dec 21 03:57:40.126783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port de198a05-275c-45cd-ae12-f18353267421, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=de198a05-275c-45cd-ae12-f18353267421,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:40.139873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] For port 400e6f56-e946-4c33-8745-f1a3be28db2c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:40.139873 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:57:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b90f46dc-cf17-417e-8c6c-e92b361c393e x-openstack-request-id: req-b90f46dc-cf17-417e-8c6c-e92b361c393e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:57:40.139873 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6391fca4-0a89-4dab-8c0e-57f2e8d9895c", "name": "network-vif-plugged", "status": "completed", "tag": "de198a05-275c-45cd-ae12-f18353267421", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:57:40.140340 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b90f46dc-cf17-417e-8c6c-e92b361c393e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:57:40.140435 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de198a05-275c-45cd-ae12-f18353267421', 'code': 200} Dec 21 03:57:40.154380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] For port 400e6f56-e946-4c33-8745-f1a3be28db2c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=400e6f56-e946-4c33-8745-f1a3be28db2c,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:40.247321 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.247658 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a72d1287-6743-4b72-acb5-05bb98e7bd05 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.0434430 Dec 21 03:57:40.247658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34320) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:40.250250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-42bfeccc-af8e-4aab-801c-72e8e8caa439', 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439', 'project_id': '2e28414564544bb283304990bb7b8542', 'fixed_ips': [{'subnet_id': '73b86b05-b093-4acf-bae3-cf60f26838b3'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:57:40.251341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.254170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'name': 'tempest-TaggedBootDevicesTest_v242-1922043984', 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:40.298027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.363542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2efa3d9-4309-474f-bdf1-d2a7d8d43252 req-1418fe20-1fe4-4657-8f49-de58fcda9739 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:40.366573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2efa3d9-4309-474f-bdf1-d2a7d8d43252 req-1418fe20-1fe4-4657-8f49-de58fcda9739 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 1097 time: 0.0960777 Dec 21 03:57:40.432905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2efa3d9-4309-474f-bdf1-d2a7d8d43252 req-a6c2cac3-8c69-48ac-8d48-9785f68e0d35 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524149 Dec 21 03:57:40.462738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=de198a05-275c-45cd-ae12-f18353267421,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:40.506292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:40.568137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Allocated IP 10.2.2.2 (42bfeccc-af8e-4aab-801c-72e8e8caa439/73b86b05-b093-4acf-bae3-cf60f26838b3/82003059-5a14-4a1a-bee8-857f8a365353) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:40.570211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3615d6d4-8880-474d-92eb-c5fdac054330 None None] Pushing event updated for resources: {'Port': ['ID=400e6f56-e946-4c33-8745-f1a3be28db2c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:40.678857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.751013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] device_id is not set on port bf55164f-f3e6-47de-9335-4f151942a1c5 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:57:40.808412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57f0d68-72e6-4ee1-b3c5-8828ed8fcb61 req-daf45d07-ac79-4d02-aa0b-5a5e2822c3e1 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:40.810213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f57f0d68-72e6-4ee1-b3c5-8828ed8fcb61 req-daf45d07-ac79-4d02-aa0b-5a5e2822c3e1 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.0768433 Dec 21 03:57:40.857351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.877466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f57f0d68-72e6-4ee1-b3c5-8828ed8fcb61 req-5306d1e5-b7c7-4674-a3fc-cb80d135a6f1 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595651 Dec 21 03:57:40.937939 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:40.981813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:40.985419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:40.989284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:40.996574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 10.1.1.83 (8d559823-2509-427a-8bd4-77cf5a81095a/966929b7-7c93-4802-a83d-62484be430ce/bf55164f-f3e6-47de-9335-4f151942a1c5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:40.999136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Pushing event updated for resources: {'Port': ['ID=82003059-5a14-4a1a-bee8-857f8a365353,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:41.076614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Attempting to bind port 82003059-5a14-4a1a-bee8-857f8a365353 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:57:41.076994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Attempting to bind port 82003059-5a14-4a1a-bee8-857f8a365353 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:57:41.077360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Attempting to bind port 82003059-5a14-4a1a-bee8-857f8a365353 on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:57:41.082842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:57:41.083252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Checking segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:57:41.083656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.084087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Bound using segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:57:41.084755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Bound port: 82003059-5a14-4a1a-bee8-857f8a365353, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:57:41.085127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.159465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] For port 82003059-5a14-4a1a-bee8-857f8a365353, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:57:41.164090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] For port 82003059-5a14-4a1a-bee8-857f8a365353, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=82003059-5a14-4a1a-bee8-857f8a365353,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:57:41.249127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.263539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.342060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d7c24f-2862-4a81-9dbf-f3d3ef8f4bc1 req-40fc94c7-673a-4cf4-82c8-2f2346b0fc97 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:41.351151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da249df-fa9d-4d22-a625-f0cb7f857131 None None] Pushing event updated for resources: {'Port': ['ID=82003059-5a14-4a1a-bee8-857f8a365353,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:41.351532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09d7c24f-2862-4a81-9dbf-f3d3ef8f4bc1 req-40fc94c7-673a-4cf4-82c8-2f2346b0fc97 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 943 time: 0.1098642 Dec 21 03:57:41.369799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.414892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09d7c24f-2862-4a81-9dbf-f3d3ef8f4bc1 req-65ec957b-42ca-47b4-90b7-0553bb086b96 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609045 Dec 21 03:57:41.467648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 8d559823-2509-427a-8bd4-77cf5a81095a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:41.468913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:41.472332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:41.475361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:41.522915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:57:41.590787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:41.591866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.686888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:41.714187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:57:41.767924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a2e3799d-cd08-4f37-9737-c6b38b730b43 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.5157335 Dec 21 03:57:41.768398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34368) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:41.775031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'name': 'tempest-TaggedBootDevicesTest_v242-695220961', 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:41.790658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:41.822488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:57:41.847368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:41.925077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5b9cb1d-b937-4b10-8935-a8698dd7c4c5 None None] Network 8d559823-2509-427a-8bd4-77cf5a81095a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:57:41.988070 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.039860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:42.075639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c6a042d9-241d-4b92-acc3-656930144905 None None] Provisioning complete for port 400e6f56-e946-4c33-8745-f1a3be28db2c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:42.076006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6a042d9-241d-4b92-acc3-656930144905 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.093549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff52826-9405-4eef-8235-9f2ddf2c37e2 req-5263b1a1-faa8-4383-8bc9-2f5c628b3c91 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:42.095994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ff52826-9405-4eef-8235-9f2ddf2c37e2 req-5263b1a1-faa8-4383-8bc9-2f5c628b3c91 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.1210136 Dec 21 03:57:42.164529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:42.212430 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6a042d9-241d-4b92-acc3-656930144905 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.267690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c6a042d9-241d-4b92-acc3-656930144905 None None] For port 400e6f56-e946-4c33-8745-f1a3be28db2c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=400e6f56-e946-4c33-8745-f1a3be28db2c,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:42.300145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['643a3827-c0d5-4377-893a-3bf71f16b0e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:57:42.356322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ff52826-9405-4eef-8235-9f2ddf2c37e2 req-d9e02dca-b603-4331-bda7-2085ca80cfb4 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2526305 Dec 21 03:57:42.372679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.386680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 82003059-5a14-4a1a-bee8-857f8a365353 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:42.456182 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6a042d9-241d-4b92-acc3-656930144905 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.493508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] device_id is not set on port c52f2e0e-5f59-462b-97c5-d88f03894186 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:57:42.565849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 82003059-5a14-4a1a-bee8-857f8a365353 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:42.566484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.638810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a042d9-241d-4b92-acc3-656930144905 None None] Pushing event updated for resources: {'Port': ['ID=400e6f56-e946-4c33-8745-f1a3be28db2c,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:42.765731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2dc41679-9a61-4404-80b6-21ea555de644 None None] Provisioning complete for port 400e6f56-e946-4c33-8745-f1a3be28db2c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:42.766105 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2dc41679-9a61-4404-80b6-21ea555de644 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:42.833418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285819ed-1b99-41de-8f43-14c54f5f3f67 req-e03b4ed3-acad-4fda-9c32-dd74c8a5f84a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:42.847207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-285819ed-1b99-41de-8f43-14c54f5f3f67 req-e03b4ed3-acad-4fda-9c32-dd74c8a5f84a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.2578473 Dec 21 03:57:43.052261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-285819ed-1b99-41de-8f43-14c54f5f3f67 req-c3b7e14b-7b9c-4392-a484-bfa3406b743d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2040236 Dec 21 03:57:43.119232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 10.1.1.54 (8d559823-2509-427a-8bd4-77cf5a81095a/966929b7-7c93-4802-a83d-62484be430ce/c52f2e0e-5f59-462b-97c5-d88f03894186) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:43.132279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8cec16e-d2b0-4e54-9b5d-c674a77260c6 None None] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:57:43.250902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.352027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 82003059-5a14-4a1a-bee8-857f8a365353, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=82003059-5a14-4a1a-bee8-857f8a365353,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:43.356897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.372559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2dc41679-9a61-4404-80b6-21ea555de644 None None] Provisioning complete for port bf55164f-f3e6-47de-9335-4f151942a1c5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:43.372932 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2dc41679-9a61-4404-80b6-21ea555de644 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.433488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.434873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 400e6f56-e946-4c33-8745-f1a3be28db2c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:43.436954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2dc41679-9a61-4404-80b6-21ea555de644 None None] Port bf55164f-f3e6-47de-9335-4f151942a1c5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:43.532889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.607496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d54413-ed8b-4ea5-81e8-fba6dd1bbe8d req-91a25326-795a-4ae7-b78f-b1d6b389ca89 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:43.618292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d54413-ed8b-4ea5-81e8-fba6dd1bbe8d req-91a25326-795a-4ae7-b78f-b1d6b389ca89 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.1320746 Dec 21 03:57:43.638684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 8d559823-2509-427a-8bd4-77cf5a81095a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:43.641022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 400e6f56-e946-4c33-8745-f1a3be28db2c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:43.641925 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.650758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:43.654144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:43.656939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:43.719087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:43.719087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.722910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a069ccf-cffe-492d-a81b-412fab40a523 None None] Provisioning complete for port 82003059-5a14-4a1a-bee8-857f8a365353 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:43.724313 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a069ccf-cffe-492d-a81b-412fab40a523 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:43.774648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d54413-ed8b-4ea5-81e8-fba6dd1bbe8d req-eaf43faf-659e-4f27-ad8f-5946d00b2c8f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1552703 Dec 21 03:57:43.811918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=82003059-5a14-4a1a-bee8-857f8a365353,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:43.830036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-308499e1-a875-4c0c-9d05-ac5bcef90611 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 2.0602472 Dec 21 03:57:44.055754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a069ccf-cffe-492d-a81b-412fab40a523 None None] Provisioning complete for port bf55164f-f3e6-47de-9335-4f151942a1c5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:44.056134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a069ccf-cffe-492d-a81b-412fab40a523 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.163619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0a069ccf-cffe-492d-a81b-412fab40a523 None None] Port bf55164f-f3e6-47de-9335-4f151942a1c5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:44.242331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed26d1bb-e1d2-4e51-bdaf-ae8e2123e645 req-cfa9425d-5a6d-4d7b-8d8a-a2d7bacf754d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.244070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed26d1bb-e1d2-4e51-bdaf-ae8e2123e645 req-cfa9425d-5a6d-4d7b-8d8a-a2d7bacf754d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0813882 Dec 21 03:57:44.245016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 82003059-5a14-4a1a-bee8-857f8a365353 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:44.288687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34498) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:44.294784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1469886402', 'description': 'tempest-description--1715970531'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:44.299936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-59709c4f-83a3-4b1e-a10b-2bc142a2c80b None None] Provisioning complete for port 82003059-5a14-4a1a-bee8-857f8a365353 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:44.300306 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59709c4f-83a3-4b1e-a10b-2bc142a2c80b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.321462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed26d1bb-e1d2-4e51-bdaf-ae8e2123e645 req-887f25a1-4d8c-4d03-a579-2b7b78f7d63c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709918 Dec 21 03:57:44.338382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 82003059-5a14-4a1a-bee8-857f8a365353 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:44.338801 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.458993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 400e6f56-e946-4c33-8745-f1a3be28db2c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:44.461052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.512395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-59709c4f-83a3-4b1e-a10b-2bc142a2c80b None None] Provisioning complete for port c52f2e0e-5f59-462b-97c5-d88f03894186 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:44.512774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59709c4f-83a3-4b1e-a10b-2bc142a2c80b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.546917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 400e6f56-e946-4c33-8745-f1a3be28db2c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:44.547330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.551120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-03fb60dd-3927-4194-ba53-895fea8d715f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.0681190 Dec 21 03:57:44.583891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-59709c4f-83a3-4b1e-a10b-2bc142a2c80b None None] Port c52f2e0e-5f59-462b-97c5-d88f03894186 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:44.599269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.706122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.706639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.707143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.708180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.712070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.712070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.712070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.712070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6fce50de-2c4b-4e31-b09c-d3ec83cd0bf1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6d65cc45e25946eeb479e45c44089cf7&device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 6497 time: 0.0511181 Dec 21 03:57:44.731819 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.761901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b589cf28-c5b6-430c-8d6b-954231e2ed7a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:44.830633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:44.831949 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-495b3d2a-efd7-44ec-9da2-33d9de909f63 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.5418954 Dec 21 03:57:44.835507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34514) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:44.840095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'security_group_rule': {'security_group_id': 'b589cf28-c5b6-430c-8d6b-954231e2ed7a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:44.857608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6f4a5a5f-1dc2-42bb-a87a-d04c51e73c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.858081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6f4a5a5f-1dc2-42bb-a87a-d04c51e73c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.858542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6f4a5a5f-1dc2-42bb-a87a-d04c51e73c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:44.860174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6f4a5a5f-1dc2-42bb-a87a-d04c51e73c2d service neutron] 10.222.0.54 "GET /v2.0/networks?id=04ed2fa2-4e59-410d-9778-4535a349c6b9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=48839244-4ebd-4f7e-a6df-11292c1938d9&id=19393033-2861-465d-ab20-b8ec53781acb&id=19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 200 len: 2293 time: 0.1236591 Dec 21 03:57:44.928601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-cad95e48-764b-47da-9077-ff0a77c755ec service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 200 len: 1000 time: 0.0609398 Dec 21 03:57:44.999803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-54bb2c54-3d46-46ae-8553-669ed864381e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:45.001384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-54bb2c54-3d46-46ae-8553-669ed864381e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c714b82d-d957-4fc4-96b0-f175d6a234f5 HTTP/1.1" status: 200 len: 851 time: 0.0655696 Dec 21 03:57:45.009708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.057691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-9f217862-7cf2-4eea-9f73-bf4ddea65a1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:45.059284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-9f217862-7cf2-4eea-9f73-bf4ddea65a1a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=04ed2fa2-4e59-410d-9778-4535a349c6b9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0496728 Dec 21 03:57:45.107785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.119838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34526) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:45.186224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-eaed2b34-74d8-4609-831a-50c4e3f71e96 service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1197340 Dec 21 03:57:45.199039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.227604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c4a7e5fc-a0dc-49b5-bfae-3d1be98a7e2d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:45.271582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cee4de76-8066-4122-bdfe-8eaf27f906e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.304879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.308777 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3513d7ff-0ace-4fd6-b966-6e740f0cde6d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4694324 Dec 21 03:57:45.310005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34534) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:45.314752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'security_group_rule': {'security_group_id': 'b589cf28-c5b6-430c-8d6b-954231e2ed7a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:45.326925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-de8b86ee-7f90-41ac-94fb-62654c469d7a service neutron] 10.222.0.54 "GET /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1337252 Dec 21 03:57:45.398436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cee4de76-8066-4122-bdfe-8eaf27f906e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.409903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-68216291-03d0-4fff-b6d9-77699ffe5362 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.34&port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 217 time: 0.0748496 Dec 21 03:57:45.427663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.503290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-ce2fb590-31ba-4331-9e7a-e209d64bf8bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:45.506052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-ce2fb590-31ba-4331-9e7a-e209d64bf8bd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.0892370 Dec 21 03:57:45.509258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.513670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cee4de76-8066-4122-bdfe-8eaf27f906e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.531694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe5c5ee-ea09-48de-9a41-85fceb21edc4 req-05f8d85b-fb9e-4373-9baa-0a8026947b81 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:45.539985 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe5c5ee-ea09-48de-9a41-85fceb21edc4 req-05f8d85b-fb9e-4373-9baa-0a8026947b81 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0899727 Dec 21 03:57:45.549631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:57:45.557453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee4de76-8066-4122-bdfe-8eaf27f906e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee98a7c7-3cd4-4e5d-9e92-062d772b52ae,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:45.581265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.614078 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cee4de76-8066-4122-bdfe-8eaf27f906e0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=aea3624e808043918b7e82d8b931dc47&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4922996 Dec 21 03:57:45.617354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34550) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:45.658596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-a05f2afc-62ce-4aa5-ad7e-2baa5bb19c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:45.661287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0494b35d-bf70-4f6f-a659-d2b2d32f3015,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:45.661856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-a05f2afc-62ce-4aa5-ad7e-2baa5bb19c5f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1489484 Dec 21 03:57:45.712765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-639b4b8b-555b-4a27-aba7-a9ebc7807618 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.729522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fe5c5ee-ea09-48de-9a41-85fceb21edc4 req-9de257ca-5a33-4e2d-b031-4bab40eeb2d9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1875250 Dec 21 03:57:45.752118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-639b4b8b-555b-4a27-aba7-a9ebc7807618 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.763189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 643a3827-c0d5-4377-893a-3bf71f16b0e8 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:57:45.786513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 643a3827-c0d5-4377-893a-3bf71f16b0e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:45.787836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.815840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-6c4762e4-9718-4cff-8367-378ab3ab87bf service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1445374 Dec 21 03:57:45.871029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.876361 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cd54cb6c-f652-42fe-a182-d93b926f1530 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5652890 Dec 21 03:57:45.877134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34558) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:45.882651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:45.891881 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.920060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-639b4b8b-555b-4a27-aba7-a9ebc7807618 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.923914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-639b4b8b-555b-4a27-aba7-a9ebc7807618 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:45.929207 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-639b4b8b-555b-4a27-aba7-a9ebc7807618 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ee98a7c7-3cd4-4e5d-9e92-062d772b52ae HTTP/1.1" status: 204 len: 168 time: 0.3080659 Dec 21 03:57:45.941529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:57:45.945296 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4531e747-e993-4682-83ec-a0edab2a6952" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:57:45.974613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:57:45.986974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-639b4b8b-555b-4a27-aba7-a9ebc7807618 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee98a7c7-3cd4-4e5d-9e92-062d772b52ae,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:45.994200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-5a20bacb-477c-4a87-9473-d87909038122 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1715941 Dec 21 03:57:46.012186 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:57:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-411d15d1-2d68-4675-a176-053e0eac6117 x-openstack-request-id: req-411d15d1-2d68-4675-a176-053e0eac6117 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:57:46.012997 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:57:46.012997 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-411d15d1-2d68-4675-a176-053e0eac6117 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:57:46.013185 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 03:57:46.033634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:46.064406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:46.106395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-f169f94a-0757-40cc-bbba-d213cf54d058 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.198&port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 217 time: 0.1044021 Dec 21 03:57:46.146757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:46.232191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-f10c27f2-015f-47e5-9010-da2ff68e3d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:46.235689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-f10c27f2-015f-47e5-9010-da2ff68e3d6c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.1195602 Dec 21 03:57:46.246969 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:46.265600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27370675-7546-4127-9046-021998fb06ee req-b4a15590-9c67-431d-9333-f348b93a5646 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:46.267182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27370675-7546-4127-9046-021998fb06ee req-b4a15590-9c67-431d-9333-f348b93a5646 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1097 time: 0.0976119 Dec 21 03:57:46.315500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-db4219aa-507b-4c7b-8aa0-742f2a90de8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:46.317124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-db4219aa-507b-4c7b-8aa0-742f2a90de8a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0733807 Dec 21 03:57:46.360485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27370675-7546-4127-9046-021998fb06ee req-5fa64c6f-bd25-4284-8d9b-d1879f6eb9ed service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790608 Dec 21 03:57:46.397750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 172.25.5.254 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/60960c82-1c00-40ad-bcae-ba9bc86a0e3d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:46.424422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-a5a70602-dace-499c-8dd4-962d32a65721 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0970862 Dec 21 03:57:46.507572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:46.538201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-83ac1c89-0d93-4de3-8c1d-4afa62ab4bba service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1056046 Dec 21 03:57:46.585906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-41aba7b0-9844-424c-9b9c-9d02b00d438c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.95&port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d HTTP/1.1" status: 200 len: 217 time: 0.0400703 Dec 21 03:57:46.647806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:46.698120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:46.698120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:46.701141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:46.708281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=60960c82-1c00-40ad-bcae-ba9bc86a0e3d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:46.812013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:46.999924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.008302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-e9e394b8-011f-4884-83b9-a270521b22cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.009852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-e9e394b8-011f-4884-83b9-a270521b22cd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.4170384 Dec 21 03:57:47.034022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0864e9-04f7-421a-a6ec-59fdd2cd2cdc req-2c0edbd8-0092-4961-a615-c4154742d598 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.035559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c0864e9-04f7-421a-a6ec-59fdd2cd2cdc req-2c0edbd8-0092-4961-a615-c4154742d598 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.0756340 Dec 21 03:57:47.110855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-faeba17b-1a0e-44dd-aee9-386f207b3cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.112411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-faeba17b-1a0e-44dd-aee9-386f207b3cbe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0947101 Dec 21 03:57:47.117365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c0864e9-04f7-421a-a6ec-59fdd2cd2cdc req-e34d915d-6edb-4244-b5db-8877a77f13ad tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678442 Dec 21 03:57:47.119278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34602) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:47.155291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f05576c7-b935-4c19-8d3e-8e09de4808a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.176888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.245966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.272953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-fd7a65cf-efd8-4505-b7ad-2e216923b462 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1460552 Dec 21 03:57:47.328501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=60960c82-1c00-40ad-bcae-ba9bc86a0e3d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:47.343529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.375738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f05576c7-b935-4c19-8d3e-8e09de4808a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.400918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-f6799418-1bfe-4c0e-8082-b1ebe7847cf0 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1159074 Dec 21 03:57:47.445878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-13dff3fd-cdca-4cea-8087-af1b76f9d466 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.123&port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e HTTP/1.1" status: 200 len: 217 time: 0.0374992 Dec 21 03:57:47.464012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f05576c7-b935-4c19-8d3e-8e09de4808a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.464881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.466373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ed8b4797-1d56-48f0-8d48-4b4348038b4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.5881991 Dec 21 03:57:47.542888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f05576c7-b935-4c19-8d3e-8e09de4808a2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e2eb215432bb4d2189559ea973224aa2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4223859 Dec 21 03:57:47.543961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05576c7-b935-4c19-8d3e-8e09de4808a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70761a6f-f040-4bd7-83d2-f540e2e21f19,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:47.545535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34616) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:47.566050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-cf9110cf-fdba-43dd-a059-e22147038cbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.568383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-cf9110cf-fdba-43dd-a059-e22147038cbb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 200 len: 797 time: 0.1146443 Dec 21 03:57:47.620716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1730ae4b-965f-4837-b81e-74fac255fb47 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.661001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-d2606ed3-e17d-4545-8314-503a2e8ae7a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.661704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1730ae4b-965f-4837-b81e-74fac255fb47 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.663553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-d2606ed3-e17d-4545-8314-503a2e8ae7a8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48839244-4ebd-4f7e-a6df-11292c1938d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0873859 Dec 21 03:57:47.780604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-53887c40-6fcf-4e41-a617-160dcabd4d70 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1469886402&fields=id&tenant_id=2e28414564544bb283304990bb7b8542 HTTP/1.1" status: 200 len: 267 time: 0.0530438 Dec 21 03:57:47.863317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-ffc6f230-8429-4a77-b07a-c5186e6ca1ed tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.865376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-ffc6f230-8429-4a77-b07a-c5186e6ca1ed tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 936 time: 0.0772927 Dec 21 03:57:47.885868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1730ae4b-965f-4837-b81e-74fac255fb47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.898326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1730ae4b-965f-4837-b81e-74fac255fb47 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:47.898326 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1730ae4b-965f-4837-b81e-74fac255fb47 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/70761a6f-f040-4bd7-83d2-f540e2e21f19 HTTP/1.1" status: 204 len: 168 time: 0.3468785 Dec 21 03:57:47.903785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1730ae4b-965f-4837-b81e-74fac255fb47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70761a6f-f040-4bd7-83d2-f540e2e21f19,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:47.944643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3d8c4a79-eec5-4d1e-98bd-ddb8317b1ee4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:47.946021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3d8c4a79-eec5-4d1e-98bd-ddb8317b1ee4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 935 time: 0.0550725 Dec 21 03:57:48.016327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8343c528-a41c-41b4-8d89-7a167f1bbccb tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&fixed_ips=ip_address%3D10.2.2.100&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0596220 Dec 21 03:57:48.020917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-def051b4-6b04-40d6-b2a6-b4c71727b2ca service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3498008 Dec 21 03:57:48.128527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-16ceef17-ad58-4afd-be2d-8824987ee7c7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&fixed_ips=ip_address%3D10.2.2.200&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0988400 Dec 21 03:57:48.198513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-55ed8f83-8173-4d2a-9ae5-18e1602a5967 service neutron] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1675897 Dec 21 03:57:48.299544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-561c4d8c-42f9-4aae-946d-5eef50d92658 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=3136aa12-8de7-43c2-8cde-55879999fd27 HTTP/1.1" status: 200 len: 217 time: 0.0710959 Dec 21 03:57:48.374542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-e1439e80-9abe-4086-ab23-c7127a0e04cc tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.381100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-e1439e80-9abe-4086-ab23-c7127a0e04cc tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.386975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-e1439e80-9abe-4086-ab23-c7127a0e04cc tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.388724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-e1439e80-9abe-4086-ab23-c7127a0e04cc tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 1994 time: 0.2518122 Dec 21 03:57:48.398490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffe1d14-5814-4616-8bfa-a7d28bf08f83 req-5021d6da-f009-4568-af4e-b8577748445e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.399996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ffe1d14-5814-4616-8bfa-a7d28bf08f83 req-5021d6da-f009-4568-af4e-b8577748445e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.1705647 Dec 21 03:57:48.420850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-fb1c7895-b7e1-4afc-b81f-9ba6782bda93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.422292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-fb1c7895-b7e1-4afc-b81f-9ba6782bda93 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.1155591 Dec 21 03:57:48.432313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-ddd6e402-983e-4b9f-a1a1-d95917ef2500 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/quotas/2e28414564544bb283304990bb7b8542 HTTP/1.1" status: 200 len: 375 time: 0.0313427 Dec 21 03:57:48.539811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ffe1d14-5814-4616-8bfa-a7d28bf08f83 req-0909141a-204f-4c06-8b67-472bc4e46440 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1202695 Dec 21 03:57:48.558763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-a076698a-e464-472a-b09f-79c2b6480a66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.561947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-a076698a-e464-472a-b09f-79c2b6480a66 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1313150 Dec 21 03:57:48.597466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-6412286d-fdb5-461f-881d-401f89200eca tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&fields=id HTTP/1.1" status: 200 len: 486 time: 0.1532798 Dec 21 03:57:48.788668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-df2d0be2-15f0-45a3-8908-5a31f660ced1 service neutron] 10.222.0.18 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1803339 Dec 21 03:57:48.886406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583ddf71-6d13-49ef-bba6-615091e665e4 req-6922d614-9600-4ef4-83eb-83594638313f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:48.887931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-583ddf71-6d13-49ef-bba6-615091e665e4 req-6922d614-9600-4ef4-83eb-83594638313f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.1858802 Dec 21 03:57:48.900579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34678) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:48.905275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-769a3cb4-705e-40f7-9b26-0c13b222faf5 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2134864 Dec 21 03:57:48.906305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'floatingip': {'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:48.987899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:49.030440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f59d44eb-d460-4597-b9a5-f2e65b931850 service neutron] 10.222.0.18 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2355204 Dec 21 03:57:49.036650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-138136ec-3c8a-47d7-a0c1-69b94d840833 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237543 Dec 21 03:57:49.127664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-cce68c0d-21f5-48f7-a95a-a301ca46f693 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 200 len: 217 time: 0.0780213 Dec 21 03:57:49.177750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f47e4dd3-da10-4ba5-be9f-09374a3f3142 service neutron] 10.222.0.18 "GET /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.1397092 Dec 21 03:57:49.185020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-618fe9f1-6a82-475b-b9cd-5daffd54e775 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:49.186569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-618fe9f1-6a82-475b-b9cd-5daffd54e775 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 200 len: 797 time: 0.0516770 Dec 21 03:57:49.293925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-83c436aa-df86-4697-8f95-3a531d0a895d service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1063552 Dec 21 03:57:49.418958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-b5806c62-dd2a-4907-b599-fe98b0793dd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:49.420852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-b5806c62-dd2a-4907-b599-fe98b0793dd2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=19393033-2861-465d-ab20-b8ec53781acb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1259737 Dec 21 03:57:49.499596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d3d5783-995b-4d05-be44-96ee5d2d419d service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1887567 Dec 21 03:57:49.553927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-fea8cac7-8ebe-4db6-895b-faff2c35b023 service neutron] 10.222.0.18 "GET /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0463400 Dec 21 03:57:49.641227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-b8d45a33-eebf-4923-bfd0-09be5123ac5d service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2132318 Dec 21 03:57:49.702308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69634eb2-abfe-40c1-8fdb-b22574748fa1 service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1474648 Dec 21 03:57:49.740325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:49.834899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a8729f9-11a2-4783-a592-db8fc081af63 req-a3d65842-1d54-43be-af83-57a4551c7702 service neutron] 10.222.0.54 "GET /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1858251 Dec 21 03:57:49.838965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:49.839115 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-710e9713-e254-4e0e-b62e-b43fa1b6a2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:49.876058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8e203092-d519-4526-b78b-980910536f07 service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1727147 Dec 21 03:57:50.008098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-6927bc04-7ed8-4853-8613-e82bfc68efa5 service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311877 Dec 21 03:57:50.085179 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Floating IP e9728672-8e1f-4f6b-a0de-8b72ea22ced5 associated. External IP: 172.25.5.220, port: 643a3827-c0d5-4377-893a-3bf71f16b0e8. Dec 21 03:57:50.130511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-bdc02ace-1518-496b-a4c0-04f6363ba27a service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1049004 Dec 21 03:57:50.246138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4caf8667-d584-434f-9cf4-0aa1262bb495 service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1050797 Dec 21 03:57:50.411003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-324f660a-915a-4fee-8796-449cfc645255 service neutron] 10.222.0.18 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1567492 Dec 21 03:57:50.555026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0d3144ca-d078-43ea-b265-2984dc10011f service neutron] 10.222.0.18 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1371822 Dec 21 03:57:50.745439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-eda62bf5-fbda-4a31-aa9e-0549c8a44d1a service neutron] 10.222.0.18 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1889651 Dec 21 03:57:50.858721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Router a1333542-4121-47e8-a7de-92405f045a9e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:57:50.866976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-df90c4d0-b38a-45db-9d66-0c6826412765 service neutron] 10.222.0.18 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1141331 Dec 21 03:57:50.998365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3a24ca93-57d8-447f-8b4d-d569eb4ecabc service neutron] 10.222.0.18 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250420 Dec 21 03:57:51.052834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:57:51.079435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:51.083720 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] Sync routers for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:57:51.107209 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:57:51.113207 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:57:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:51.114275 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98d16f89-a079-4b2e-b655-b82d0e82358d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "PUT /v2.0/floatingips/e9728672-8e1f-4f6b-a0de-8b72ea22ced5 HTTP/1.1" status: 200 len: 991 time: 2.2115269 Dec 21 03:57:51.115479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:57:51.129999 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8" -d '{"events": [{"name": "network-changed", "server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:57:51.280864 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:57:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2968a8f-8c78-41de-970e-ba81185a9715 x-openstack-request-id: req-a2968a8f-8c78-41de-970e-ba81185a9715 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:57:51.281162 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:57:51.281420 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a2968a8f-8c78-41de-970e-ba81185a9715 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:57:51.282066 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'status': 'completed', 'code': 200} Dec 21 03:57:51.304515 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:57:51.436546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-a6a8a01c-9943-4ad6-9ebb-a4a6093e0de7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:51.447882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-a6a8a01c-9943-4ad6-9ebb-a4a6093e0de7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1097 time: 0.0989611 Dec 21 03:57:51.669512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-f134659d-f6b4-4c9d-9d43-bc6d32879b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:51.671237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-f134659d-f6b4-4c9d-9d43-bc6d32879b19 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.2091947 Dec 21 03:57:51.710211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e9728672-8e1f-4f6b-a0de-8b72ea22ced5', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'floating_ip_address': '172.25.5.220', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1515, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '310d006f-a51c-4bee-adac-4f0f1281690e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:57:18Z', 'updated_at': '2021-12-21T03:57:49Z', 'revision_number': 1, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:18Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:51.741040 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] Checking router: a1333542-4121-47e8-a7de-92405f045a9e for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:57:51.749716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:57:51.750321 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:57:22Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:51.766802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-5256785e-2da9-4183-aedc-f6e288b6d15c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.0875113 Dec 21 03:57:51.829822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-7fce71a6-3296-46cf-aa9f-e56b8f4ba737 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:51.833013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-7fce71a6-3296-46cf-aa9f-e56b8f4ba737 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0583718 Dec 21 03:57:51.870973 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:57:51.899643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-77521a8e-a4b5-4fd0-8402-27fa65f4383e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:51.901421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-77521a8e-a4b5-4fd0-8402-27fa65f4383e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0614245 Dec 21 03:57:52.009189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-2097d3c3-e2c9-4d87-901f-3bc30cc9a3e4 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1007292 Dec 21 03:57:52.160012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9bbe3bb4-60c4-4bf9-9317-617316fd8e23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:52.179571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34788) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:52.214273 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e9728672-8e1f-4f6b-a0de-8b72ea22ced5', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'floating_ip_address': '172.25.5.220', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1515, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '310d006f-a51c-4bee-adac-4f0f1281690e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:57:18Z', 'updated_at': '2021-12-21T03:57:49Z', 'revision_number': 1, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:18Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:57:52.280447 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f963ede-26fb-40f0-ba48-53dc9d7c2e05 None None] The sync data for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 is: [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'e9728672-8e1f-4f6b-a0de-8b72ea22ced5', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'floating_ip_address': '172.25.5.220', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1515, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '310d006f-a51c-4bee-adac-4f0f1281690e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:57:18Z', 'updated_at': '2021-12-21T03:57:49Z', 'revision_number': 1, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:18Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:57:52.596910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e38e0cab-6766-44b9-ac2b-b6a78d1b0dd8 req-e8eaa972-6bde-42a1-9b74-35ec80db4132 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5798166 Dec 21 03:57:52.607669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:52.634206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:52.668733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31f60128-0b56-401d-afcd-dc494709e411 None None] New status for floating IP e9728672-8e1f-4f6b-a0de-8b72ea22ced5: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:57:52.748571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:52.899228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:53.025783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80f82f70-314b-4734-83a5-26b118caefca req-9effe8fc-5d89-48b7-b2fe-df62fb7fd151 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0487342 Dec 21 03:57:53.038846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34820) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:53.039740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b28305df7ee84cc9b712ae067d23bbf5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8625462 Dec 21 03:57:53.043734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ae83d37-de2c-4ef6-86ef-2952172ec11d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:53.058227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.060071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.060635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.067152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.071712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.073023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.074457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.090955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.093070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.094146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.096750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.097182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.097590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d04f5167-229f-4566-a1b3-3d68e7e645d0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:53.122312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c35be63-c3b9-4238-acda-465d9b1f19d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:53.149840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c35be63-c3b9-4238-acda-465d9b1f19d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:53.211184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:53.308021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c35be63-c3b9-4238-acda-465d9b1f19d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:53.312861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c35be63-c3b9-4238-acda-465d9b1f19d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:53.314438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1c35be63-c3b9-4238-acda-465d9b1f19d3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9ae83d37-de2c-4ef6-86ef-2952172ec11d HTTP/1.1" status: 204 len: 168 time: 0.2742012 Dec 21 03:57:53.329976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c35be63-c3b9-4238-acda-465d9b1f19d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ae83d37-de2c-4ef6-86ef-2952172ec11d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:54.117486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0406cad8-6192-49a0-909e-da57ce5d997b req-95e06c66-d67b-4082-9da7-c00f1d30fc9a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0290601 Dec 21 03:57:54.749832 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:57:54.856837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:54.963729 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:55.222989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a383869a-a69e-40b1-9294-8b9293fed67d req-f3e43b72-47dc-48cb-a27e-c99cb1123a22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0292556 Dec 21 03:57:55.619275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-82455a5c-fac2-4b6f-aba9-2a946f82b3b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:55.620729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-82455a5c-fac2-4b6f-aba9-2a946f82b3b4 service neutron] 10.222.0.54 "GET /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 1032 time: 0.0485003 Dec 21 03:57:55.667423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-09cdd0a3-d0df-4548-aa40-ef4b3e85d449 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:55.670471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-09cdd0a3-d0df-4548-aa40-ef4b3e85d449 service neutron] 10.222.0.54 "GET /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 1031 time: 0.0414619 Dec 21 03:57:55.719368 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:55.732339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:55.807556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0d9097dd-8071-49a1-9956-1d62d38f3bb1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:55.814012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0d9097dd-8071-49a1-9956-1d62d38f3bb1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:55.819945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0d9097dd-8071-49a1-9956-1d62d38f3bb1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:55.821587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0d9097dd-8071-49a1-9956-1d62d38f3bb1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 1994 time: 0.1395986 Dec 21 03:57:55.900277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bbae55c-20b1-4d85-9dae-d3ed6bec4d39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:55.905201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f0f140cf-9789-4aa1-a59a-745a448b6d32 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2e28414564544bb283304990bb7b8542 HTTP/1.1" status: 200 len: 380 time: 0.0553491 Dec 21 03:57:55.915661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'admin_state_up': True, 'tenant_id': '2e28414564544bb283304990bb7b8542', 'security_groups': ['b589cf28-c5b6-430c-8d6b-954231e2ed7a']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:55.986309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bbae55c-20b1-4d85-9dae-d3ed6bec4d39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.100470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bbae55c-20b1-4d85-9dae-d3ed6bec4d39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.132798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:56.136771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.143770 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6bbae55c-20b1-4d85-9dae-d3ed6bec4d39 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e2f3ca57f43d489d8eb6b0d0e50be654&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4096031 Dec 21 03:57:56.146769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bbae55c-20b1-4d85-9dae-d3ed6bec4d39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e045ca27-d007-44c3-bf6a-2480b1679070,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:56.149099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:56.290223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbe6d60d-b8da-4c4d-a278-a077bdc513df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.354410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbe6d60d-b8da-4c4d-a278-a077bdc513df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.394139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71942b5f-75e6-4da5-8a1a-b1d3c8ad099e req-b74dfb77-a16e-4994-b2e5-5dca51acda98 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0468311 Dec 21 03:57:56.429469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 172.20.0.5 (4915ee69-a87c-4f15-b553-d1750c9a5a88/35ca07d8-d162-4205-9aec-69a6c9b94f03/1626b9fe-82dc-4958-a0d0-4436a98fe01f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:56.567130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbe6d60d-b8da-4c4d-a278-a077bdc513df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.569785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbe6d60d-b8da-4c4d-a278-a077bdc513df admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.574995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dbe6d60d-b8da-4c4d-a278-a077bdc513df admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e045ca27-d007-44c3-bf6a-2480b1679070 HTTP/1.1" status: 204 len: 168 time: 0.4071403 Dec 21 03:57:56.583845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbe6d60d-b8da-4c4d-a278-a077bdc513df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e045ca27-d007-44c3-bf6a-2480b1679070,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:56.606179 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.743414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.791571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:56.794885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:56.807738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:56.849011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:56.875556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:56.876357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:56.996863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5ea84f34-93c5-409d-8620-ac84fe747536 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0849912 Dec 21 03:57:57.015504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'admin_state_up': True, 'tenant_id': '2e28414564544bb283304990bb7b8542', 'security_groups': ['b589cf28-c5b6-430c-8d6b-954231e2ed7a']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:57.108358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-66e8c8fe-f3b8-4170-af60-8fe4ed6a8b61 None None] Provisioning complete for port 1626b9fe-82dc-4958-a0d0-4436a98fe01f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:57.108932 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-66e8c8fe-f3b8-4170-af60-8fe4ed6a8b61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.185378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-66e8c8fe-f3b8-4170-af60-8fe4ed6a8b61 None None] Port 1626b9fe-82dc-4958-a0d0-4436a98fe01f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:57.279861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:57.284213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.415200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 10.1.1.84 (8d559823-2509-427a-8bd4-77cf5a81095a/966929b7-7c93-4802-a83d-62484be430ce/3f68184f-d3c6-4097-8eb2-ecb1bd1713b7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:57.658110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34968) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:57.661889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21be295-78b7-4749-8fda-19bd1832fab2 req-f1dbfd0d-2181-4a64-a98d-c40ff0bddd8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:57.663695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d21be295-78b7-4749-8fda-19bd1832fab2 req-f1dbfd0d-2181-4a64-a98d-c40ff0bddd8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 931 time: 0.1568975 Dec 21 03:57:57.675653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39f21dc9-921b-426a-a411-571f2b939042 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.742704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.758322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d21be295-78b7-4749-8fda-19bd1832fab2 req-161076a9-6526-4f3b-be2d-c43ebe494cae tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0878561 Dec 21 03:57:57.768359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39f21dc9-921b-426a-a411-571f2b939042 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.913778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39f21dc9-921b-426a-a411-571f2b939042 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.917632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:57.963366 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-39f21dc9-921b-426a-a411-571f2b939042 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=46c602de59d14ca9b2839f9726c3ec78&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3040020 Dec 21 03:57:57.964266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34978) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:57.980973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:57.996854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f21dc9-921b-426a-a411-571f2b939042 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a65dc0e2-d3c1-4603-9969-d157b5fe5bf3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:58.003643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 8d559823-2509-427a-8bd4-77cf5a81095a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:58.010791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:58.027133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:58.036613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.036979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.039202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.039202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.039202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.043654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.043982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9af2f957-0ad6-43c8-ae1b-ae5a5862f045 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.044123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.044473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.044919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.045331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.045791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.046208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.046640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:57:58.079168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9af2f957-0ad6-43c8-ae1b-ae5a5862f045 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.105914 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:57:58.108815 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:57:58.112840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:58.113747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.230586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0cb771c9-ba40-44b4-b072-fe5ce34a0440 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 1.2193649 Dec 21 03:57:58.249235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'admin_state_up': True, 'tenant_id': '2e28414564544bb283304990bb7b8542', 'security_groups': ['b589cf28-c5b6-430c-8d6b-954231e2ed7a']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:58.256645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34986) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:58.287653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9af2f957-0ad6-43c8-ae1b-ae5a5862f045 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.303845 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9af2f957-0ad6-43c8-ae1b-ae5a5862f045 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.303845 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9af2f957-0ad6-43c8-ae1b-ae5a5862f045 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a65dc0e2-d3c1-4603-9969-d157b5fe5bf3 HTTP/1.1" status: 204 len: 168 time: 0.3355992 Dec 21 03:57:58.313837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af2f957-0ad6-43c8-ae1b-ae5a5862f045 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a65dc0e2-d3c1-4603-9969-d157b5fe5bf3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:58.324198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-410bec35-505b-4a44-a7a0-f882e7d10485 None None] Provisioning complete for port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:58.324738 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-410bec35-505b-4a44-a7a0-f882e7d10485 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.376977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-410bec35-505b-4a44-a7a0-f882e7d10485 None None] Port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:58.444281 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c949d65-c39c-472e-b568-51545cf3caa4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.528757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:58.534578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c949d65-c39c-472e-b568-51545cf3caa4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.539216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.622524 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c949d65-c39c-472e-b568-51545cf3caa4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.674826 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0c949d65-c39c-472e-b568-51545cf3caa4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6aecf92ef14440468194f129eb30eb11&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4145188 Dec 21 03:57:58.684904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35018) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:58.727051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c949d65-c39c-472e-b568-51545cf3caa4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7962c0ec-0778-4e4e-aa03-317989010c8b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:58.759327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e91e2a4-f722-4022-a235-a7f114652e91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.777394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 10.1.1.56 (8d559823-2509-427a-8bd4-77cf5a81095a/966929b7-7c93-4802-a83d-62484be430ce/f21e2d88-8221-4926-95ac-3ed4e081cd85) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:57:58.786712 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e91e2a4-f722-4022-a235-a7f114652e91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.968546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e91e2a4-f722-4022-a235-a7f114652e91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.971410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e91e2a4-f722-4022-a235-a7f114652e91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:58.975295 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3e91e2a4-f722-4022-a235-a7f114652e91 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7962c0ec-0778-4e4e-aa03-317989010c8b HTTP/1.1" status: 204 len: 168 time: 0.2862227 Dec 21 03:57:58.997364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e91e2a4-f722-4022-a235-a7f114652e91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7962c0ec-0778-4e4e-aa03-317989010c8b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:59.035494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2390541-503a-4581-8b07-041dc25b615d req-3e874f8b-615b-408c-bd41-7ea389db8c11 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:59.041699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2390541-503a-4581-8b07-041dc25b615d req-3e874f8b-615b-408c-bd41-7ea389db8c11 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:59.043410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2390541-503a-4581-8b07-041dc25b615d req-3e874f8b-615b-408c-bd41-7ea389db8c11 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 1652 time: 0.1054301 Dec 21 03:57:59.087653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.130614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2390541-503a-4581-8b07-041dc25b615d req-578bb49d-fac6-4506-b8f3-2a1f2b80c4b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0776544 Dec 21 03:57:59.232007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.277549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 8d559823-2509-427a-8bd4-77cf5a81095a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:57:59.282531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:57:59.288620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:57:59.297688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:57:59.362584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:57:59.364043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.430449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-64006c11-029b-42f9-996d-9afa8a3a2e7f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 1.1856856 Dec 21 03:57:59.448039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'fixed_ips': [{'ip_address': '10.2.2.100'}], 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439', 'admin_state_up': True, 'tenant_id': '2e28414564544bb283304990bb7b8542', 'security_groups': ['b589cf28-c5b6-430c-8d6b-954231e2ed7a']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:57:59.595442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35042) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:57:59.637864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1dc97f98-48bd-4169-9203-d992de080bcb None None] Provisioning complete for port f21e2d88-8221-4926-95ac-3ed4e081cd85 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:57:59.638391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dc97f98-48bd-4169-9203-d992de080bcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.685144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1dc97f98-48bd-4169-9203-d992de080bcb None None] Port f21e2d88-8221-4926-95ac-3ed4e081cd85 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:57:59.706259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:57:59.744121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab69cc8c-55dc-4cb6-82eb-83cc7c6a1c93 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.825205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.867492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab69cc8c-55dc-4cb6-82eb-83cc7c6a1c93 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:57:59.982470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab69cc8c-55dc-4cb6-82eb-83cc7c6a1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.056326 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ab69cc8c-55dc-4cb6-82eb-83cc7c6a1c93 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b07e3f342112416087e961ec9e7fb742&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4597967 Dec 21 03:58:00.057877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab69cc8c-55dc-4cb6-82eb-83cc7c6a1c93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a56b161a-498a-4431-8219-890c120c780a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:00.063738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35058) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:00.064772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35060) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:00.079594 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d1c57e-3ac7-4ef0-bcb8-195608018be8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.118175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 10.2.2.100 (42bfeccc-af8e-4aab-801c-72e8e8caa439/73b86b05-b093-4acf-bae3-cf60f26838b3/c204c117-523f-49b5-9420-dc05e685d6de) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:00.146223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05520563-3506-4fa9-875e-d5d2519f4f6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.178033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d1c57e-3ac7-4ef0-bcb8-195608018be8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.198328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05520563-3506-4fa9-875e-d5d2519f4f6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.251248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d1c57e-3ac7-4ef0-bcb8-195608018be8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.298536 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-00d1c57e-3ac7-4ef0-bcb8-195608018be8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a9631804eaaa4149bc650b7f69fd671b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2327273 Dec 21 03:58:00.300213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d1c57e-3ac7-4ef0-bcb8-195608018be8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9e62e1a-fcf9-41e5-9c50-92b5e56404c5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:00.303266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35066) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:00.357593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a5ef26-6a4a-41bf-b33e-6be66de6f59f req-e8b8009a-a81f-45d2-a21f-461e5bcd3cad tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:00.364007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a5ef26-6a4a-41bf-b33e-6be66de6f59f req-e8b8009a-a81f-45d2-a21f-461e5bcd3cad tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:00.369980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a5ef26-6a4a-41bf-b33e-6be66de6f59f req-e8b8009a-a81f-45d2-a21f-461e5bcd3cad tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:00.372241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7a5ef26-6a4a-41bf-b33e-6be66de6f59f req-e8b8009a-a81f-45d2-a21f-461e5bcd3cad tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 2372 time: 0.1329770 Dec 21 03:58:00.385880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4ef5026-64cb-48ac-9888-dc8478ca494e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.398307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.417172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4ef5026-64cb-48ac-9888-dc8478ca494e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.455466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7a5ef26-6a4a-41bf-b33e-6be66de6f59f req-7109bbff-8d8a-4743-b7cd-be6098dfcfc6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740371 Dec 21 03:58:00.463825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05520563-3506-4fa9-875e-d5d2519f4f6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.466571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05520563-3506-4fa9-875e-d5d2519f4f6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.472946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-05520563-3506-4fa9-875e-d5d2519f4f6f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a56b161a-498a-4431-8219-890c120c780a HTTP/1.1" status: 204 len: 168 time: 0.4056354 Dec 21 03:58:00.481466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05520563-3506-4fa9-875e-d5d2519f4f6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a56b161a-498a-4431-8219-890c120c780a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:00.554229 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4ef5026-64cb-48ac-9888-dc8478ca494e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.555283 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.559267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4ef5026-64cb-48ac-9888-dc8478ca494e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.560700 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4ef5026-64cb-48ac-9888-dc8478ca494e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d9e62e1a-fcf9-41e5-9c50-92b5e56404c5 HTTP/1.1" status: 204 len: 168 time: 0.2411594 Dec 21 03:58:00.575637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ef5026-64cb-48ac-9888-dc8478ca494e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9e62e1a-fcf9-41e5-9c50-92b5e56404c5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:00.632403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:00.635704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:00.640473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:00.644819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:00.706226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:00.706883 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:00.780000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1d633f12-abb2-4bfd-89c5-3def7faf0e34 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3357575 Dec 21 03:58:00.799157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'fixed_ips': [{'ip_address': '10.2.2.200'}], 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439', 'admin_state_up': True, 'tenant_id': '2e28414564544bb283304990bb7b8542', 'security_groups': ['b589cf28-c5b6-430c-8d6b-954231e2ed7a']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:01.014721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2280971e-ac48-4603-86f5-257d9931525a None None] Provisioning complete for port c204c117-523f-49b5-9420-dc05e685d6de triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:01.015769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2280971e-ac48-4603-86f5-257d9931525a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.054219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Made reservation on behalf of 2e28414564544bb283304990bb7b8542 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:01.059687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.089038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2280971e-ac48-4603-86f5-257d9931525a None None] Port c204c117-523f-49b5-9420-dc05e685d6de cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:01.369712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Allocated IP 10.2.2.200 (42bfeccc-af8e-4aab-801c-72e8e8caa439/73b86b05-b093-4acf-bae3-cf60f26838b3/29c72524-1fd4-42e5-a743-56e89cdcd6eb) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:01.520298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.562242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35102) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:01.590501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de6bc468-d4c3-4415-9959-711c6316b2d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.716629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35104) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:01.717749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.748486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-93ebd3d4-aae9-4922-bdec-1f888437f674 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.776769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:01.787106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100ae308-05cb-4d52-b2d0-217fcfe9799a req-b1ed9165-3845-433a-9c69-87dec8ebc09e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:01.793199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100ae308-05cb-4d52-b2d0-217fcfe9799a req-b1ed9165-3845-433a-9c69-87dec8ebc09e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:01.799267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100ae308-05cb-4d52-b2d0-217fcfe9799a req-b1ed9165-3845-433a-9c69-87dec8ebc09e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:01.803750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de6bc468-d4c3-4415-9959-711c6316b2d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.805351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100ae308-05cb-4d52-b2d0-217fcfe9799a req-b1ed9165-3845-433a-9c69-87dec8ebc09e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:01.807139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-100ae308-05cb-4d52-b2d0-217fcfe9799a req-b1ed9165-3845-433a-9c69-87dec8ebc09e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 3093 time: 0.1785247 Dec 21 03:58:01.813002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:01.819082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:01.877476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-93ebd3d4-aae9-4922-bdec-1f888437f674 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.884391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event updated for resources: {'Port': ['ID=29c72524-1fd4-42e5-a743-56e89cdcd6eb,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:01.896339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de6bc468-d4c3-4415-9959-711c6316b2d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.922915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:01.923494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.939952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-100ae308-05cb-4d52-b2d0-217fcfe9799a req-7075d598-deef-4263-81d7-6acfacf62a3f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1219654 Dec 21 03:58:01.979033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-93ebd3d4-aae9-4922-bdec-1f888437f674 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:01.996440 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de6bc468-d4c3-4415-9959-711c6316b2d2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=af2ecca7cb3e4265b72da10baa63559f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4345946 Dec 21 03:58:02.000594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6bc468-d4c3-4415-9959-711c6316b2d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c96a0ab-41ea-45c4-b419-1efe4d5385fc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:02.002179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:02.024503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-8baddd9e-97bb-4eb2-83be-7aaa37e0f3b7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2312317 Dec 21 03:58:02.032189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ebd3d4-aae9-4922-bdec-1f888437f674 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70e7a0c4-e1ba-4840-bd7c-7478cf443653,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:02.050083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-93ebd3d4-aae9-4922-bdec-1f888437f674 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f52b80fe8c1f41169bb7c4be3d7df041&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3318195 Dec 21 03:58:02.051957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:02.055292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:02.120044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-071a4b47-a178-4e7f-ace8-d5f420892d23 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.133948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-010d881c-782f-42ef-8ce4-03e593f099b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.163944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-010d881c-782f-42ef-8ce4-03e593f099b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.170475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.230864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-071a4b47-a178-4e7f-ace8-d5f420892d23 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.321418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-df4668d1-7038-4a68-8cd7-e3eb0185dcd2 None None] Provisioning complete for port 29c72524-1fd4-42e5-a743-56e89cdcd6eb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:02.322386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df4668d1-7038-4a68-8cd7-e3eb0185dcd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.341927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-010d881c-782f-42ef-8ce4-03e593f099b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.344592 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-010d881c-782f-42ef-8ce4-03e593f099b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.359325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-010d881c-782f-42ef-8ce4-03e593f099b4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/70e7a0c4-e1ba-4840-bd7c-7478cf443653 HTTP/1.1" status: 204 len: 168 time: 0.3062208 Dec 21 03:58:02.361073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-df4668d1-7038-4a68-8cd7-e3eb0185dcd2 None None] Port 29c72524-1fd4-42e5-a743-56e89cdcd6eb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:02.368000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-010d881c-782f-42ef-8ce4-03e593f099b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70e7a0c4-e1ba-4840-bd7c-7478cf443653,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:02.462568 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-071a4b47-a178-4e7f-ace8-d5f420892d23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.466713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-071a4b47-a178-4e7f-ace8-d5f420892d23 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.472228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-071a4b47-a178-4e7f-ace8-d5f420892d23 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3c96a0ab-41ea-45c4-b419-1efe4d5385fc HTTP/1.1" status: 204 len: 168 time: 0.4681642 Dec 21 03:58:02.496053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-071a4b47-a178-4e7f-ace8-d5f420892d23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c96a0ab-41ea-45c4-b419-1efe4d5385fc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:02.563336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1626b9fe-82dc-4958-a0d0-4436a98fe01f {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:02.580880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.595009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Transition to ACTIVE for port object 1626b9fe-82dc-4958-a0d0-4436a98fe01f will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:02.729616 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:02.796626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Pushing event updated for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:02.985928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Attempting to bind port 1626b9fe-82dc-4958-a0d0-4436a98fe01f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:02.986498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Attempting to bind port 1626b9fe-82dc-4958-a0d0-4436a98fe01f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:02.987055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Attempting to bind port 1626b9fe-82dc-4958-a0d0-4436a98fe01f on network 4915ee69-a87c-4f15-b553-d1750c9a5a88 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:03.005910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Port 1626b9fe-82dc-4958-a0d0-4436a98fe01f on network 4915ee69-a87c-4f15-b553-d1750c9a5a88 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:03.007517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Attempting to bind port 1626b9fe-82dc-4958-a0d0-4436a98fe01f on network 4915ee69-a87c-4f15-b553-d1750c9a5a88 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:03.030284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:03.032016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Checking segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:03.033898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Bound using segment: {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:03.041200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Bound port: 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '127c42f2-9c42-4f96-a788-402d23fe8d05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:03.042676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:03.371139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767e0fdb-2908-49bd-81af-977898b522a3 req-f66879eb-2979-4eac-b39f-a210b173e9d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:03.397876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767e0fdb-2908-49bd-81af-977898b522a3 req-f66879eb-2979-4eac-b39f-a210b173e9d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:03.424180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767e0fdb-2908-49bd-81af-977898b522a3 req-f66879eb-2979-4eac-b39f-a210b173e9d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:03.444521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767e0fdb-2908-49bd-81af-977898b522a3 req-f66879eb-2979-4eac-b39f-a210b173e9d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:03.454232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767e0fdb-2908-49bd-81af-977898b522a3 req-f66879eb-2979-4eac-b39f-a210b173e9d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:03.456204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-767e0fdb-2908-49bd-81af-977898b522a3 req-f66879eb-2979-4eac-b39f-a210b173e9d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 3826 time: 0.3549917 Dec 21 03:58:03.479162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:03.484259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:03.556219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-767e0fdb-2908-49bd-81af-977898b522a3 req-b5709466-5529-4ff8-b406-5cd0b4bb09ee tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0695863 Dec 21 03:58:03.560461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:03.639381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:03.639381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:03.639381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] 10.222.0.54 "PUT /v2.0/ports/1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 1092 time: 1.5939100 Dec 21 03:58:03.671845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:03.679396 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1518d7bd-0a9d-451e-8a01-efd898065843" -d '{"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:03.695604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac1bbed-3ae8-4678-a090-67dce287aa31 service neutron] Pushing event updated for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:03.980857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:04.140449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:04.148905 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd7591cc-4c50-4d71-9eb3-1d07b53d2808 x-openstack-request-id: req-fd7591cc-4c50-4d71-9eb3-1d07b53d2808 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:04.149406 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:04.149837 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fd7591cc-4c50-4d71-9eb3-1d07b53d2808 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:04.150530 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'status': 'completed', 'code': 200} Dec 21 03:58:04.272690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-47a991a6-ed87-4b30-8fb5-7a2c480d69a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.274195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-47a991a6-ed87-4b30-8fb5-7a2c480d69a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.275963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-47a991a6-ed87-4b30-8fb5-7a2c480d69a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.276872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-47a991a6-ed87-4b30-8fb5-7a2c480d69a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.277569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-47a991a6-ed87-4b30-8fb5-7a2c480d69a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.279849 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-47a991a6-ed87-4b30-8fb5-7a2c480d69a3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 4362 time: 0.1014764 Dec 21 03:58:04.498823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-a95ddf5e-fda6-482d-8cc6-f4a422d0a7c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.499368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-a95ddf5e-fda6-482d-8cc6-f4a422d0a7c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.506288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-a95ddf5e-fda6-482d-8cc6-f4a422d0a7c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.514127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-a95ddf5e-fda6-482d-8cc6-f4a422d0a7c4 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2e28414564544bb283304990bb7b8542&shared=False HTTP/1.1" status: 200 len: 2297 time: 0.2099938 Dec 21 03:58:04.684897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-fd425abf-e061-4c8e-8649-05045bf48c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.685334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf55164f-f3e6-47de-9335-4f151942a1c5 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:04.686363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1518d7bd-0a9d-451e-8a01-efd898065843 req-fd425abf-e061-4c8e-8649-05045bf48c28 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1531813 Dec 21 03:58:04.704497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:04.747790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Transition to ACTIVE for port object bf55164f-f3e6-47de-9335-4f151942a1c5 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:04.773371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-3a2e197b-e544-4fe9-bb05-b2c3479f86b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.780772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-3a2e197b-e544-4fe9-bb05-b2c3479f86b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.788960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-3a2e197b-e544-4fe9-bb05-b2c3479f86b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.796053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-3a2e197b-e544-4fe9-bb05-b2c3479f86b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.803530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-3a2e197b-e544-4fe9-bb05-b2c3479f86b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:04.807382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-3a2e197b-e544-4fe9-bb05-b2c3479f86b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 3826 time: 0.1129329 Dec 21 03:58:04.810463 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:04.892818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Pushing event updated for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:04.956425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94b0d93e-d809-4c89-b595-2882ff5aba36 req-8f305c8c-cc16-45f4-87de-aa895da6153a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1412270 Dec 21 03:58:05.026095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Attempting to bind port bf55164f-f3e6-47de-9335-4f151942a1c5 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:05.026702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Attempting to bind port bf55164f-f3e6-47de-9335-4f151942a1c5 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:05.026958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Attempting to bind port bf55164f-f3e6-47de-9335-4f151942a1c5 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:05.032100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Port bf55164f-f3e6-47de-9335-4f151942a1c5 on network 8d559823-2509-427a-8bd4-77cf5a81095a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:05.032585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Attempting to bind port bf55164f-f3e6-47de-9335-4f151942a1c5 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:05.038259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:05.038717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Checking segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:05.039246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Bound using segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:05.039825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Bound port: bf55164f-f3e6-47de-9335-4f151942a1c5, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:05.040588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.153716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:05.153716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf55164f-f3e6-47de-9335-4f151942a1c5,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:05.243392 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.281372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35194) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:05.296705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:05.297339 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.298738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] 10.222.0.54 "PUT /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 1136 time: 1.3238649 Dec 21 03:58:05.330213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3479dfd3-0d23-420c-8f77-99bee5e1e7fa service neutron] Pushing event updated for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:05.408070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:05.505993 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.620061 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8600e6fb-d96e-41d0-a964-959684d7c1c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.740596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8600e6fb-d96e-41d0-a964-959684d7c1c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.845316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8600e6fb-d96e-41d0-a964-959684d7c1c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.869315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c52f2e0e-5f59-462b-97c5-d88f03894186 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:05.877352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.891219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8600e6fb-d96e-41d0-a964-959684d7c1c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8c9c23d-a7b8-4a8e-b2ca-273936fed3dc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:05.897351 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8600e6fb-d96e-41d0-a964-959684d7c1c7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6f07d0370aa94a3a8575fd64fdd13f23&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6142414 Dec 21 03:58:05.903419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35210) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:05.936456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Transition to ACTIVE for port object c52f2e0e-5f59-462b-97c5-d88f03894186 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:05.966263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5105fce9-87af-4ac2-b80e-1a1573aa2357 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:05.996695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5105fce9-87af-4ac2-b80e-1a1573aa2357 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.031212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.133396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Pushing event updated for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:06.159776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'bf55164f-f3e6-47de-9335-4f151942a1c5'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:06.162551 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1db30bf6-487e-4d5d-addd-b57833086b9b" -d '{"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "bf55164f-f3e6-47de-9335-4f151942a1c5"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.235809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:06.238829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.245093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.253734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.259994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.275403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.286745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.293395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.295341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-895ea5a9-4a33-4598-b023-c43ac803897b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5379 time: 0.2320836 Dec 21 03:58:06.298848 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5682a97f-53cd-408e-9bd3-8f6b5190a7cb x-openstack-request-id: req-5682a97f-53cd-408e-9bd3-8f6b5190a7cb {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:06.299191 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "bf55164f-f3e6-47de-9335-4f151942a1c5", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:06.299417 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5682a97f-53cd-408e-9bd3-8f6b5190a7cb {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:06.299800 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'bf55164f-f3e6-47de-9335-4f151942a1c5', 'status': 'completed', 'code': 200} Dec 21 03:58:06.306714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5105fce9-87af-4ac2-b80e-1a1573aa2357 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.309485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5105fce9-87af-4ac2-b80e-1a1573aa2357 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.313070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5105fce9-87af-4ac2-b80e-1a1573aa2357 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b8c9c23d-a7b8-4a8e-b2ca-273936fed3dc HTTP/1.1" status: 204 len: 168 time: 0.4063103 Dec 21 03:58:06.416528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.416528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.416528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.416528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.416528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.417375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.418052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.421464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-6e4ddeec-7db4-41eb-83f6-18965fa9ce4f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6177 time: 0.1400158 Dec 21 03:58:06.467162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0cd73129-830a-4ae8-a90c-1d97b9b365de req-55d2240e-aba8-4492-91ed-bb72d206c022 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1530695 Dec 21 03:58:06.467912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5105fce9-87af-4ac2-b80e-1a1573aa2357 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8c9c23d-a7b8-4a8e-b2ca-273936fed3dc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:06.491805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Attempting to bind port c52f2e0e-5f59-462b-97c5-d88f03894186 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:06.495364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Attempting to bind port c52f2e0e-5f59-462b-97c5-d88f03894186 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:06.495730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Attempting to bind port c52f2e0e-5f59-462b-97c5-d88f03894186 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:06.513287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Port c52f2e0e-5f59-462b-97c5-d88f03894186 on network 8d559823-2509-427a-8bd4-77cf5a81095a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:06.514008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Attempting to bind port c52f2e0e-5f59-462b-97c5-d88f03894186 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:06.543827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:06.543827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Checking segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:06.544164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Bound using segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:06.546773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Bound port: c52f2e0e-5f59-462b-97c5-d88f03894186, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:06.547318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.650070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-4fa673b5-ff37-493c-bb04-8e1dee8b7dab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.650803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-4fa673b5-ff37-493c-bb04-8e1dee8b7dab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.651316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-4fa673b5-ff37-493c-bb04-8e1dee8b7dab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.652934 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-4fa673b5-ff37-493c-bb04-8e1dee8b7dab service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2e28414564544bb283304990bb7b8542&shared=False HTTP/1.1" status: 200 len: 2297 time: 0.2142498 Dec 21 03:58:06.686110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:06.692583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c52f2e0e-5f59-462b-97c5-d88f03894186,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:06.772486 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.796201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-0c57fda0-7097-41f2-9163-3837d146a920 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.797706 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1db30bf6-487e-4d5d-addd-b57833086b9b req-0c57fda0-7097-41f2-9163-3837d146a920 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1368206 Dec 21 03:58:06.830581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:06.832423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:06.834036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] 10.222.0.54 "PUT /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 1135 time: 1.4305944 Dec 21 03:58:06.858095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03743d68-3728-4bf7-8e6f-146a6f7fbd82 service neutron] Pushing event updated for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:06.984682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:07.048998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.227508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35268) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:07.243425 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96433033-a99d-4b19-bed9-3b0d74842e91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.356458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96433033-a99d-4b19-bed9-3b0d74842e91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.426957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96433033-a99d-4b19-bed9-3b0d74842e91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.514162 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-96433033-a99d-4b19-bed9-3b0d74842e91 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=772ae4bdc32c410cb69f346ceadb1efb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2851324 Dec 21 03:58:07.515464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96433033-a99d-4b19-bed9-3b0d74842e91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cccbee0-f9f6-44d3-bb4e-8e2ec64bfc92,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:07.517976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35272) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:07.603017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35276) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:07.627706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7fb9132-517c-45a2-bdbe-71bf1ee8b47e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.655869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7fb9132-517c-45a2-bdbe-71bf1ee8b47e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.779601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e72339-1d0b-4bc7-b79a-b697d7715f9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.799253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7fb9132-517c-45a2-bdbe-71bf1ee8b47e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.801856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7fb9132-517c-45a2-bdbe-71bf1ee8b47e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.803051 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7fb9132-517c-45a2-bdbe-71bf1ee8b47e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7cccbee0-f9f6-44d3-bb4e-8e2ec64bfc92 HTTP/1.1" status: 204 len: 168 time: 0.2839239 Dec 21 03:58:07.818744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7fb9132-517c-45a2-bdbe-71bf1ee8b47e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cccbee0-f9f6-44d3-bb4e-8e2ec64bfc92,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:07.893586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.900486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.906030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e72339-1d0b-4bc7-b79a-b697d7715f9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.907128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.913130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.919177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.925119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.931537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:07.933451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-cdc1710f-5c7f-47ea-b67e-37eb80cd3792 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5379 time: 0.1878288 Dec 21 03:58:07.939951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:07.956807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:07.986259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Transition to ACTIVE for port object 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:08.009957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e72339-1d0b-4bc7-b79a-b697d7715f9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.017256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16e5f2b1-d715-4f6b-a0cb-8fd5ca1a8724 req-b8e779b1-7b19-4b7f-b960-18f1e152cd6b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0713930 Dec 21 03:58:08.055803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04e72339-1d0b-4bc7-b79a-b697d7715f9e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1e95dc980c5f440d93da8269073d5a65&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4487362 Dec 21 03:58:08.055803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04e72339-1d0b-4bc7-b79a-b697d7715f9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eeefbce8-67a8-4d94-9185-31194fa588d1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:08.056199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35290) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:08.092498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.172631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-244fb21f-ec37-4102-93e4-d283e750968f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.213470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Pushing event updated for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:08.252527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-244fb21f-ec37-4102-93e4-d283e750968f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.309297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'c52f2e0e-5f59-462b-97c5-d88f03894186'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:08.309297 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-393a6161-c2b1-4972-8b5e-fd9d84dde25f" -d '{"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "c52f2e0e-5f59-462b-97c5-d88f03894186"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:08.334133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Attempting to bind port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:08.334718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Attempting to bind port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:08.335254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Attempting to bind port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:08.340352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 on network 8d559823-2509-427a-8bd4-77cf5a81095a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:08.340885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Attempting to bind port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:08.348192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:08.348718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Checking segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:08.349334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Bound using segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:08.349965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Bound port: 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:08.350560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.416045 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e289cb44-c50e-480e-b6d3-79386fa721f1 x-openstack-request-id: req-e289cb44-c50e-480e-b6d3-79386fa721f1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:08.418187 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "c52f2e0e-5f59-462b-97c5-d88f03894186", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:08.418720 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e289cb44-c50e-480e-b6d3-79386fa721f1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:08.419966 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'c52f2e0e-5f59-462b-97c5-d88f03894186', 'status': 'completed', 'code': 200} Dec 21 03:58:08.471674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-244fb21f-ec37-4102-93e4-d283e750968f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.484268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-244fb21f-ec37-4102-93e4-d283e750968f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.489060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-244fb21f-ec37-4102-93e4-d283e750968f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/eeefbce8-67a8-4d94-9185-31194fa588d1 HTTP/1.1" status: 204 len: 168 time: 0.4317751 Dec 21 03:58:08.540794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244fb21f-ec37-4102-93e4-d283e750968f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eeefbce8-67a8-4d94-9185-31194fa588d1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:08.558062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:08.561759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.563459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.564013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.567747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.567747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.579659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.586791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.596453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e136a9b8-7084-407f-8947-ecdd2e8a4af5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6245 time: 0.1397550 Dec 21 03:58:08.603699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:08.679884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.731842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.732988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:08.736588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] 10.222.0.54 "PUT /v2.0/ports/3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 1091 time: 1.7561843 Dec 21 03:58:08.788180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7dbc2b6-be85-4caa-bf73-3557ba658c9f service neutron] Pushing event updated for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:08.810851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-bb552bf2-fe5d-4ec0-9548-b144b220de3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.811345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-bb552bf2-fe5d-4ec0-9548-b144b220de3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.811820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-bb552bf2-fe5d-4ec0-9548-b144b220de3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:08.813466 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-bb552bf2-fe5d-4ec0-9548-b144b220de3b service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2e28414564544bb283304990bb7b8542&shared=False HTTP/1.1" status: 200 len: 2297 time: 0.2054472 Dec 21 03:58:08.840454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:08.935272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:09.016979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e7ca1314-5c1a-4913-9744-8e1cc10062e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.018751 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-393a6161-c2b1-4972-8b5e-fd9d84dde25f req-e7ca1314-5c1a-4913-9744-8e1cc10062e9 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1951804 Dec 21 03:58:09.297551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.304287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.311340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.318087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.324571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.330962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.338024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.340021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-aee7e54d-7e73-4571-be3e-9f2770bcc479 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5391 time: 0.1731868 Dec 21 03:58:09.464399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f21e2d88-8221-4926-95ac-3ed4e081cd85 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:09.473546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:09.480983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47a38a55-8390-47e5-981a-2fbf02cb2e1b req-d6feb185-35db-4f16-8d75-4988ff19abe6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1298075 Dec 21 03:58:09.494542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Transition to ACTIVE for port object f21e2d88-8221-4926-95ac-3ed4e081cd85 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:09.572161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5330a605-3827-4003-adb1-d1fca79a4732 req-f5584162-52ee-4266-ab17-930a75623acc tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:09.573900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5330a605-3827-4003-adb1-d1fca79a4732 req-f5584162-52ee-4266-ab17-930a75623acc tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.0662727 Dec 21 03:58:09.587601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:09.706671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Pushing event updated for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:09.743754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5330a605-3827-4003-adb1-d1fca79a4732 req-ded9b228-9929-4942-878f-f4d4551de78e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1629093 Dec 21 03:58:09.780646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Attempting to bind port f21e2d88-8221-4926-95ac-3ed4e081cd85 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:09.781089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Attempting to bind port f21e2d88-8221-4926-95ac-3ed4e081cd85 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:09.781490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Attempting to bind port f21e2d88-8221-4926-95ac-3ed4e081cd85 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:09.787262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Port f21e2d88-8221-4926-95ac-3ed4e081cd85 on network 8d559823-2509-427a-8bd4-77cf5a81095a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:09.787593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Attempting to bind port f21e2d88-8221-4926-95ac-3ed4e081cd85 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:09.793411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:09.793759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Checking segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:09.794149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Bound using segment: {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:09.794846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Bound port: f21e2d88-8221-4926-95ac-3ed4e081cd85, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '95ba2a4f-5934-40bc-93f6-2d408e4d50cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:09.795235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:09.920979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:09.925052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:09.997500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:10.056682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.057302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:10.058713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] 10.222.0.54 "PUT /v2.0/ports/f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 1091 time: 1.2231915 Dec 21 03:58:10.087821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4beabe55-c497-4d25-ae6e-822019ad9e14 service neutron] Pushing event updated for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:10.164506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:10.230455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:10.421448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7'}, {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:10.423878 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a2b267c-6c30-4598-9166-b67ba5af59f8" -d '{"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7"}, {"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:10.498180 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f22bfb96-a705-4dfc-94c3-7ccf87f6e55b x-openstack-request-id: req-f22bfb96-a705-4dfc-94c3-7ccf87f6e55b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:10.498537 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:10.498828 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f22bfb96-a705-4dfc-94c3-7ccf87f6e55b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:10.499274 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7', 'status': 'completed', 'code': 200} Dec 21 03:58:10.499637 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85', 'status': 'completed', 'code': 200} Dec 21 03:58:10.613623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.614611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.615239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.615764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.616284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.616804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.617459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.619510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-5748e9bf-1d5f-40cc-aeca-065d2089167b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6355 time: 0.0765984 Dec 21 03:58:10.662060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c204c117-523f-49b5-9420-dc05e685d6de {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:10.672189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:10.689827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Transition to ACTIVE for port object c204c117-523f-49b5-9420-dc05e685d6de will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:10.763873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.772303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.778678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.788689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.795474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.803740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-bde296ae-bb88-4b75-a861-039b89108b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.804607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.805305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-bde296ae-bb88-4b75-a861-039b89108b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.807432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-bde296ae-bb88-4b75-a861-039b89108b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.813102 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-bde296ae-bb88-4b75-a861-039b89108b0d service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2e28414564544bb283304990bb7b8542&shared=False HTTP/1.1" status: 200 len: 2297 time: 0.1793053 Dec 21 03:58:10.814462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:10.816966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-178acc7a-1408-4048-b127-914eee11a4be req-6f39fd8f-46f8-4fcf-b598-f670210cccc4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5403 time: 0.1257622 Dec 21 03:58:10.818349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:10.868428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Pushing event updated for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:11.047375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Attempting to bind port c204c117-523f-49b5-9420-dc05e685d6de on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:11.047755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Attempting to bind port c204c117-523f-49b5-9420-dc05e685d6de by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:11.048092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Attempting to bind port c204c117-523f-49b5-9420-dc05e685d6de on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:11.063970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-c0010147-621a-45d2-8f2c-338fe6653480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.064161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-178acc7a-1408-4048-b127-914eee11a4be req-6df092ab-dffa-483f-b520-7b22c2327aa6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1976371 Dec 21 03:58:11.064284 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-c0010147-621a-45d2-8f2c-338fe6653480 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2419112 Dec 21 03:58:11.071690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd19fe3b-e524-4f09-9cc9-845980e2932b req-a251ab77-481a-4870-8e19-7a68dd428616 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.073248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd19fe3b-e524-4f09-9cc9-845980e2932b req-a251ab77-481a-4870-8e19-7a68dd428616 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.1721530 Dec 21 03:58:11.073974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Port c204c117-523f-49b5-9420-dc05e685d6de on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:11.074353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Attempting to bind port c204c117-523f-49b5-9420-dc05e685d6de on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:11.096941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:11.098350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Checking segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:11.098350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Bound using segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:11.098690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Bound port: c204c117-523f-49b5-9420-dc05e685d6de, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:11.111353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:11.209986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd19fe3b-e524-4f09-9cc9-845980e2932b req-956a3993-baa9-413b-83e7-1b03e77d440f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1288095 Dec 21 03:58:11.248113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:11.248970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.249455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.251649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.252139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.253340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.254374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.254846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.261871 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-9d979796-1eb6-42f0-9e83-2c4704c5a9ec service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6381 time: 0.1200781 Dec 21 03:58:11.263921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c204c117-523f-49b5-9420-dc05e685d6de,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:11.352099 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:11.403654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.405092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:11.406049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-7d780031-cca3-40a7-9c01-551c3bd992ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.407764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-7d780031-cca3-40a7-9c01-551c3bd992ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.407764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-7d780031-cca3-40a7-9c01-551c3bd992ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.409023 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-7d780031-cca3-40a7-9c01-551c3bd992ff service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2e28414564544bb283304990bb7b8542&shared=False HTTP/1.1" status: 200 len: 2297 time: 0.1328003 Dec 21 03:58:11.409844 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] 10.222.0.54 "PUT /v2.0/ports/c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 1092 time: 1.2511957 Dec 21 03:58:11.452955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c6cd5e-a4c5-47ce-844a-e18f9bc6c1b9 service neutron] Pushing event updated for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:11.530189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Request body: {'port': {'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:11.575603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-416a4252-8b4c-4b0f-a5b4-907e8229e081 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.577211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3a2b267c-6c30-4598-9166-b67ba5af59f8 req-416a4252-8b4c-4b0f-a5b4-907e8229e081 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1513193 Dec 21 03:58:11.651339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-2e88e909-44a2-4374-928e-1f8f60334567 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:11.653263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-2e88e909-44a2-4374-928e-1f8f60334567 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.31 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.1529245 Dec 21 03:58:11.668617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:11.914307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Deleting port de198a05-275c-45cd-ae12-f18353267421 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:11.914648 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.065002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] For port de198a05-275c-45cd-ae12-f18353267421, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=de198a05-275c-45cd-ae12-f18353267421,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:12.065369 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.087355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Calling delete_port for de198a05-275c-45cd-ae12-f18353267421 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:12.162956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 29c72524-1fd4-42e5-a743-56e89cdcd6eb {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:12.172842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.198426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Transition to ACTIVE for port object 29c72524-1fd4-42e5-a743-56e89cdcd6eb will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:12.314729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.321205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.327489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.334492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.340824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.347037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.353666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.355677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee2a78b-a052-4562-8981-560b1805fa0c req-8751a1a7-1df3-405f-a77a-1d732c77900b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5415 time: 0.1560662 Dec 21 03:58:12.360219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.483863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Pushing event updated for resources: {'Port': ['ID=29c72524-1fd4-42e5-a743-56e89cdcd6eb,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:12.510074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:12.512400 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4" -d '{"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "c204c117-523f-49b5-9420-dc05e685d6de"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.529381 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:12.532239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf797ff-0e09-45c8-a1fd-90fe55d2f701 req-9701e3a0-2ccf-4fcc-9a4e-c1c27f542061 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:12.533523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cf797ff-0e09-45c8-a1fd-90fe55d2f701 req-9701e3a0-2ccf-4fcc-9a4e-c1c27f542061 tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 945 time: 0.1769114 Dec 21 03:58:12.540511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.591575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['de198a05-275c-45cd-ae12-f18353267421'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:12.619474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee2a78b-a052-4562-8981-560b1805fa0c req-67802714-05af-4ea0-abd6-801c081a1430 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2460058 Dec 21 03:58:12.634993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Pushing event deleted for resources: {'Port': ['ID=de198a05-275c-45cd-ae12-f18353267421,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:12.738753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] No DVR routers for this DVR port de198a05-275c-45cd-ae12-f18353267421 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:12.749836 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.756835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec7a46cd-c82f-4bc3-a259-e7bff79e2375 req-e0c0f5ec-473d-4d84-835f-fcda2b9aae6e tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.31 "DELETE /v2.0/ports/de198a05-275c-45cd-ae12-f18353267421 HTTP/1.1" status: 204 len: 173 time: 1.0949688 Dec 21 03:58:12.759433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Attempting to bind port 29c72524-1fd4-42e5-a743-56e89cdcd6eb on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:12.759777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Attempting to bind port 29c72524-1fd4-42e5-a743-56e89cdcd6eb by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:12.760611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Attempting to bind port 29c72524-1fd4-42e5-a743-56e89cdcd6eb on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:12.765859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cf797ff-0e09-45c8-a1fd-90fe55d2f701 req-f3241bd2-8224-4de0-b917-223b19b7d69f tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/security-groups?id=d85886a8-64d0-487b-9d1a-304a22c93857&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2006798 Dec 21 03:58:12.775265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Port 29c72524-1fd4-42e5-a743-56e89cdcd6eb on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:12.775595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Attempting to bind port 29c72524-1fd4-42e5-a743-56e89cdcd6eb on network 42bfeccc-af8e-4aab-801c-72e8e8caa439 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:12.790386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:12.795910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Checking segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:12.796329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Bound using segment: {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:12.796809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Bound port: 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ed5c034b-3532-410c-a7e9-aabd119ea3a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:12.797178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:12.864858 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e853e07-4e2b-4329-bdaa-fa281cadeb78 x-openstack-request-id: req-1e853e07-4e2b-4329-bdaa-fa281cadeb78 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:12.865164 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "c204c117-523f-49b5-9420-dc05e685d6de", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:12.865423 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1e853e07-4e2b-4329-bdaa-fa281cadeb78 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:12.865818 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de', 'status': 'completed', 'code': 200} Dec 21 03:58:12.962645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] For port 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:12.972763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] For port 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:13.011225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.013203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.014097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.014758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.015254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.015718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.016174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.018197 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-d92c55a9-636c-4f6e-a241-99f4b88d602f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6449 time: 0.1156096 Dec 21 03:58:13.049299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.052426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35426) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:13.073158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.074860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.078817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] 10.222.0.54 "PUT /v2.0/ports/29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 1092 time: 1.5587258 Dec 21 03:58:13.193385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb2cca6-927d-4cd7-a17d-8e9b903732a6 service neutron] Pushing event updated for resources: {'Port': ['ID=29c72524-1fd4-42e5-a743-56e89cdcd6eb,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:13.279579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-32d60764-8009-4639-8dd1-38c55c5b7f8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.280076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-32d60764-8009-4639-8dd1-38c55c5b7f8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.280789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-32d60764-8009-4639-8dd1-38c55c5b7f8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.282696 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-32d60764-8009-4639-8dd1-38c55c5b7f8e service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2e28414564544bb283304990bb7b8542&shared=False HTTP/1.1" status: 200 len: 2297 time: 0.2487984 Dec 21 03:58:13.382556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35434) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:13.434240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-ad66f487-aa2b-4fee-ae28-5296088f7139 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.436005 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df6a3bef-b7ec-4ea4-8058-8e5591b3e9a4 req-ad66f487-aa2b-4fee-ae28-5296088f7139 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1459510 Dec 21 03:58:13.555289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea992bee-2cc7-4c71-a775-b2c0d0c780f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.590232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.590792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.591432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.591907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.592363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.592829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.593473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.595590 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f95e2514-c56d-4131-bbab-de4c4a61d8ed service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6491 time: 0.0926108 Dec 21 03:58:13.662869 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-abefde52-f4d6-4351-8799-e69d6b94bf4e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 217 time: 0.0476649 Dec 21 03:58:13.676499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-381292857'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:13.764130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f1276f3c-9c7a-45b1-a4f7-457214acacdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.764878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f1276f3c-9c7a-45b1-a4f7-457214acacdb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.0920484 Dec 21 03:58:13.782229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Made reservation on behalf of 20379aea4ab0448b999f5459bffe8650 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:13.786721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.818480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea992bee-2cc7-4c71-a775-b2c0d0c780f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.823796 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.836250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-243eb421-f347-4f06-831e-488c960ac681 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.837850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-243eb421-f347-4f06-831e-488c960ac681 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0662911 Dec 21 03:58:13.861247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.869995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.880434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.887834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.895166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.902502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.909680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:13.912948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-c29e69cf-d5f0-4e98-a8e3-304b0ee036b2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1730881 Dec 21 03:58:13.920150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea992bee-2cc7-4c71-a775-b2c0d0c780f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:13.955652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c21eb98f-b090-45e1-b340-095e36e34d46 req-4e268cd0-c771-4dc9-ba46-c22792d1705c tempest-AttachSCSIVolumeTestJSON-1199303432 tempest-AttachSCSIVolumeTestJSON-1199303432-project] 10.222.0.18 "GET /v2.0/ports?device_id=6391fca4-0a89-4dab-8c0e-57f2e8d9895c HTTP/1.1" status: 200 len: 210 time: 0.0386767 Dec 21 03:58:13.973864 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ea992bee-2cc7-4c71-a775-b2c0d0c780f0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2c47fe01e8b046db87cc0a0a57a0476f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9198601 Dec 21 03:58:13.978948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea992bee-2cc7-4c71-a775-b2c0d0c780f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0831f13f-7770-44e0-8bf4-fba99a73bcd3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:13.979966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35448) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:14.015333 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-c2753ced-67b4-4745-87ca-ed7373394504 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1695490 Dec 21 03:58:14.082220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e519501-d56f-40b0-9ca0-d6999de109f8 req-27290365-ef36-4785-90a5-676256dcd379 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1112063 Dec 21 03:58:14.127296 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9664071e-4b8a-4cb8-9940-cf137222f6c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.176576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9664071e-4b8a-4cb8-9940-cf137222f6c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.181129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-aa63b28b-d25e-4296-9771-387a2272481c service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1585073 Dec 21 03:58:14.201221 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.232560 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-c7fba62d-af08-4594-b2be-d5559565b58d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.83&port_id=bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 217 time: 0.0443769 Dec 21 03:58:14.286405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-6530c3ae-ae5c-4b7e-8c08-168b41230826 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:14.287959 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-6530c3ae-ae5c-4b7e-8c08-168b41230826 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0483027 Dec 21 03:58:14.313431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.336970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4c63facf-7f25-4351-8264-a7a620789e0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:14.338468 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4c63facf-7f25-4351-8264-a7a620789e0b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0430152 Dec 21 03:58:14.345902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7244a8f8-f33d-4e34-bd0a-f2705e8b0837,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:14.366705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9664071e-4b8a-4cb8-9940-cf137222f6c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.369336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9664071e-4b8a-4cb8-9940-cf137222f6c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.370672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9664071e-4b8a-4cb8-9940-cf137222f6c3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0831f13f-7770-44e0-8bf4-fba99a73bcd3 HTTP/1.1" status: 204 len: 168 time: 0.3873112 Dec 21 03:58:14.380110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:14.386565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9664071e-4b8a-4cb8-9940-cf137222f6c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0831f13f-7770-44e0-8bf4-fba99a73bcd3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:14.391990 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.392349 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Added segment 8ca5c898-7a30-4fcb-b7a3-9b8ee17c05c7 of type vlan for network d507371d-d762-4fcb-a8ad-15e2a0870395 Dec 21 03:58:14.445824 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-332a3152-f441-44b8-83dc-9b1af19460da service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0994997 Dec 21 03:58:14.491462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.549833 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0a4700db-7ea9-4ddc-8b03-33fdd84359bf service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0959558 Dec 21 03:58:14.583106 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.589885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:14.590492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:14.608211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-f1126f04-654a-433f-baec-76bab89be332 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.54&port_id=c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 217 time: 0.0513511 Dec 21 03:58:14.660518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-b8659567-2621-438c-bbee-4c69407d0ea0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:14.662547 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-b8659567-2621-438c-bbee-4c69407d0ea0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0480013 Dec 21 03:58:14.678179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Pushing event updated for resources: {'Network': ['ID=d507371d-d762-4fcb-a8ad-15e2a0870395,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:14.691642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d507371d-d762-4fcb-a8ad-15e2a0870395 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:14.699658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8d8e9033-c741-452a-9a3e-42af9cd759df tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 1.3156266 Dec 21 03:58:14.702359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35460) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:14.758134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-c749a6c6-8e50-4b4f-807b-cb3708e2d66b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:14.759867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-c749a6c6-8e50-4b4f-807b-cb3708e2d66b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0902987 Dec 21 03:58:14.866681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'name': 'network-vif-deleted', 'tag': 'de198a05-275c-45cd-ae12-f18353267421'}, {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '29c72524-1fd4-42e5-a743-56e89cdcd6eb'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:14.870141 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-a337b5ec-4424-4810-bcf6-3a9258790de1 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1019616 Dec 21 03:58:14.870853 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1982d078-05ce-4c30-936a-22062fefd81b" -d '{"events": [{"server_uuid": "6391fca4-0a89-4dab-8c0e-57f2e8d9895c", "name": "network-vif-deleted", "tag": "de198a05-275c-45cd-ae12-f18353267421"}, {"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "29c72524-1fd4-42e5-a743-56e89cdcd6eb"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:14.929062 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d8d64fa-72e2-4967-bbec-a5391df21a0f x-openstack-request-id: req-9d8d64fa-72e2-4967-bbec-a5391df21a0f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:14.929599 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6391fca4-0a89-4dab-8c0e-57f2e8d9895c", "name": "network-vif-deleted", "tag": "de198a05-275c-45cd-ae12-f18353267421", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "29c72524-1fd4-42e5-a743-56e89cdcd6eb", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:14.930246 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9d8d64fa-72e2-4967-bbec-a5391df21a0f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:14.931047 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6391fca4-0a89-4dab-8c0e-57f2e8d9895c', 'name': 'network-vif-deleted', 'tag': 'de198a05-275c-45cd-ae12-f18353267421', 'status': 'completed', 'code': 200} Dec 21 03:58:14.931522 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '29c72524-1fd4-42e5-a743-56e89cdcd6eb', 'status': 'completed', 'code': 200} Dec 21 03:58:15.000142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-9359e399-2675-45e9-b941-3410cc1c75f1 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1171689 Dec 21 03:58:15.009128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'network': {'name': 'tempest-network--300063841', 'router:external': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:15.072233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-29a09401-8440-448f-9df8-f28a146ba8e6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.84&port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 217 time: 0.0639665 Dec 21 03:58:15.129868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Made reservation on behalf of 3d4c483700194e17a51de37e657c0655 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:15.132787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.148139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-2b662af0-b1fa-44f1-9325-cbd060ba0cf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.150041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-2b662af0-b1fa-44f1-9325-cbd060ba0cf4 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0704825 Dec 21 03:58:15.152056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.221470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-57eb3d68-1240-4044-bcf9-8fee68ab3db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.223902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-57eb3d68-1240-4044-bcf9-8fee68ab3db6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0653460 Dec 21 03:58:15.273321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.279328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.286394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.292615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.299524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.306497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.317964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.317964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10d79cf5-7385-4504-be45-61eacb028f26 req-1f7e2ef4-5c46-4a50-9f1a-09cb255f3f84 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1227541 Dec 21 03:58:15.344108 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-7b00eb13-12d7-4fb8-bd4b-c0f37ac5b686 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1116378 Dec 21 03:58:15.360625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.467346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10d79cf5-7385-4504-be45-61eacb028f26 req-173993a8-5f60-41d0-8cd9-f9adec3d6155 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1279976 Dec 21 03:58:15.468826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.475908 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-9d498115-44c2-41ed-8c15-f4edd5d1e26a service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1082439 Dec 21 03:58:15.492217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:15.508687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c991dee-473a-4d31-82c6-fad6adfa46c2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:15.514967 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.514967 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Added segment 3df31aa6-32d9-4821-a5b5-bf1f99d7a6fe of type vlan for network fcfff7b6-3539-45c5-894e-ca27d9b8e9c4 Dec 21 03:58:15.528646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35494) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:15.554316 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-5e559efc-5c64-4daf-a4b3-73f35c9a453b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.56&port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 217 time: 0.0688307 Dec 21 03:58:15.572368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9f8924a-ed75-4b39-9ca6-1feffc2af262 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.615464 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.635632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-6f76dba9-9103-44e2-8e2b-c06eb57d75ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.638015 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-6f76dba9-9103-44e2-8e2b-c06eb57d75ff service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0770276 Dec 21 03:58:15.684871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device de198a05-275c-45cd-ae12-f18353267421 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:15.711708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-cd09106c-4648-4e38-8ff4-110281a2522d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.712948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9f8924a-ed75-4b39-9ca6-1feffc2af262 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.713841 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-cd09106c-4648-4e38-8ff4-110281a2522d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0680721 Dec 21 03:58:15.718428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: de198a05-275c-45cd-ae12-f18353267421 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:58:15.718878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device de198a05-275c-45cd-ae12-f18353267421 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:15.782230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.783413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:15.784090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.821794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-e5f1194a-1f7f-49a2-b288-99a0eedd42b1 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990219 Dec 21 03:58:15.846845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9f8924a-ed75-4b39-9ca6-1feffc2af262 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:15.859261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Network': ['ID=fcfff7b6-3539-45c5-894e-ca27d9b8e9c4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:15.897593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network fcfff7b6-3539-45c5-894e-ca27d9b8e9c4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:15.926499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35506) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:15.928330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e13fac63-c3c0-483f-8789-6cd7049827c9 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 1.2247968 Dec 21 03:58:15.937477 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d9f8924a-ed75-4b39-9ca6-1feffc2af262 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=cf7770b916404a998fcbd68c36886910&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4055789 Dec 21 03:58:15.937964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35510) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:15.945385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9f8924a-ed75-4b39-9ca6-1feffc2af262 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e290868-7608-4cdd-817f-526ecb27eae9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:15.994853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32af1bd7-94e8-46e4-a2ca-17ba9a336ca7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.018697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.048670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32af1bd7-94e8-46e4-a2ca-17ba9a336ca7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.053070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4eb88f0c-5d28-4a73-842e-23ece7cb4944 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2225165 Dec 21 03:58:16.144140 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-74659dcf-6f9e-40f7-af4c-ad4f265c42f1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 217 time: 0.0688574 Dec 21 03:58:16.183076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.211224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32af1bd7-94e8-46e4-a2ca-17ba9a336ca7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.213868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32af1bd7-94e8-46e4-a2ca-17ba9a336ca7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.215107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-32af1bd7-94e8-46e4-a2ca-17ba9a336ca7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3e290868-7608-4cdd-817f-526ecb27eae9 HTTP/1.1" status: 204 len: 168 time: 0.2763791 Dec 21 03:58:16.223789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32af1bd7-94e8-46e4-a2ca-17ba9a336ca7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e290868-7608-4cdd-817f-526ecb27eae9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:16.226668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fcfff7b6-3539-45c5-894e-ca27d9b8e9c4']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:16.253447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3df31aa6-32d9-4821-a5b5-bf1f99d7a6fe') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:16.253990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3df31aa6-32d9-4821-a5b5-bf1f99d7a6fe') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:16.263028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-60793bc4-e211-4dd6-a12c-bf561c6704de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.264521 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-60793bc4-e211-4dd6-a12c-bf561c6704de service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0919571 Dec 21 03:58:16.268937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.326629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.337902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:16.337902 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:16.338390 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:16.357559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4203bff5-8ada-4c9b-a097-fa529ecf2cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.359118 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-4203bff5-8ada-4c9b-a097-fa529ecf2cc1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0868888 Dec 21 03:58:16.502675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-aa38705e-f506-4404-82ef-bd6ca522ffec service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1341851 Dec 21 03:58:16.542965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.549073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network fcfff7b6-3539-45c5-894e-ca27d9b8e9c4 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 03:58:16.554242 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.562507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35538) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:16.567977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'network': {'router:external': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:16.571247 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/networks/fcfff7b6-3539-45c5-894e-ca27d9b8e9c4 HTTP/1.1" status: 204 len: 168 time: 0.6432548 Dec 21 03:58:16.640770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa5be9d-2b10-4b63-b4fa-ef4d7069129c tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Network': ['ID=fcfff7b6-3539-45c5-894e-ca27d9b8e9c4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:16.685990 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-7804ee5f-c0bb-47ba-8b0e-0be7e559a076 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1764400 Dec 21 03:58:16.704951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.712499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.720351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.728432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.740909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.749715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.758145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.766797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-338ffc17-ab6e-49ca-98fc-21e604a0acf0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1912432 Dec 21 03:58:16.776890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Made reservation on behalf of 3d4c483700194e17a51de37e657c0655 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:16.778716 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-957617f0-d239-462a-82f8-11bf25e8df57 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0823636 Dec 21 03:58:16.780422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.857907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-046e08ba-bf35-46c7-bbd9-2de26fb41b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.862024 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-046e08ba-bf35-46c7-bbd9-2de26fb41b4a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0776000 Dec 21 03:58:16.862565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:16.875075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5588c18a-028c-44f4-acbc-3aa1a7340182 req-7af3d4fa-32af-4b85-ae13-2dd83451350f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1065843 Dec 21 03:58:16.881757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.882167 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Added segment ab365c76-7c85-4ac9-9e91-6ffef56502fe of type vlan for network 79938bca-390b-46e3-bb83-63ec5ad4232d Dec 21 03:58:16.953421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:16.965655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-39f265b2-d9ec-463b-a85d-351550f55d0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:16.967227 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-39f265b2-d9ec-463b-a85d-351550f55d0a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0971663 Dec 21 03:58:17.089487 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-797de25d-d99b-486c-9f62-e41a70ab417b service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1122861 Dec 21 03:58:17.111138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:17.115440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.115440 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:17.218200 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6568934d-0c8c-4f60-aff3-d372b070b1a4 req-0184ec8e-34a1-4cb6-82d8-6affbf96ed5c service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229863 Dec 21 03:58:17.221051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Network': ['ID=79938bca-390b-46e3-bb83-63ec5ad4232d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:17.233236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 79938bca-390b-46e3-bb83-63ec5ad4232d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:17.235851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7f754807-fe21-4cbf-ae41-366e16e2e57d tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 0.6722381 Dec 21 03:58:17.239294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35550) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:17.244871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'subnet': {'network_id': '79938bca-390b-46e3-bb83-63ec5ad4232d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:17.342212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Made reservation on behalf of 3d4c483700194e17a51de37e657c0655 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:17.345230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:17.478565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.479072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.479599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.479972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.480649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.480870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.481463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.484773 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-d6afc024-13b0-4b9d-96f0-992e9bf00fe2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6491 time: 0.1136677 Dec 21 03:58:17.688070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-d288a793-a725-4e07-b48c-4cedac264e07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.690197 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-d288a793-a725-4e07-b48c-4cedac264e07 service neutron] 10.222.0.54 "GET /v2.0/networks?id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 903 time: 0.1982934 Dec 21 03:58:17.734854 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-776524c8-75a8-4c0d-ba98-7b8b9f5ad049 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0374086 Dec 21 03:58:17.806109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-cd033bfd-26de-45d6-9d49-cc76cba20482 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.807657 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-cd033bfd-26de-45d6-9d49-cc76cba20482 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0666022 Dec 21 03:58:17.836546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 03:58:17.837131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:17.872648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1982d078-05ce-4c30-936a-22062fefd81b req-89854c0f-235c-4191-9c77-d5ef90a82d6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:17.876877 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-89854c0f-235c-4191-9c77-d5ef90a82d6e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0612512 Dec 21 03:58:17.892866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Subnet': ['ID=4e64cd7b-b558-45dc-a47e-8d987e93b543,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:17.902527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Checking segment: {'id': 'ab365c76-7c85-4ac9-9e91-6ffef56502fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '79938bca-390b-46e3-bb83-63ec5ad4232d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:17.902904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Network hostable DHCP agents. Network: 79938bca-390b-46e3-bb83-63ec5ad4232d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:58:17.987794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Network 79938bca-390b-46e3-bb83-63ec5ad4232d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:58:18.024889 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-eeabeb42-c72a-4408-a05b-13e534e076ab service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391790 Dec 21 03:58:18.086129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.093835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.101491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.109080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.116069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.123021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.130624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.132960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-26dd8d8a-46dc-4325-b054-cc051f712e2b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1253166 Dec 21 03:58:18.135521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 79938bca-390b-46e3-bb83-63ec5ad4232d) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:18.147535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c760d319-df66-4084-b062-3fb045bde5c7 None None] Network 79938bca-390b-46e3-bb83-63ec5ad4232d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:18.155894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:18.158119 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:18.161552 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1982d078-05ce-4c30-936a-22062fefd81b req-2bb7074e-723b-4b9f-b31a-6838cba8553c service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1262941 Dec 21 03:58:18.244964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36d20ef5-4eab-45b4-9731-5fd03c29d967 req-499308d1-49d7-482d-8844-3839338460cd tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0838466 Dec 21 03:58:18.249218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-82053afa-8aaa-4732-a1df-ad69b1a5540b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 1.0084043 Dec 21 03:58:18.252159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:18.257591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'floatingip': {'floating_network_id': '79938bca-390b-46e3-bb83-63ec5ad4232d'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:18.307208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c38b20a0-36b6-40ba-9f3a-cb94a8abeae0 None None] Network 79938bca-390b-46e3-bb83-63ec5ad4232d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:18.388072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:18.811690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:18.932868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Allocated IP 172.20.0.4 (79938bca-390b-46e3-bb83-63ec5ad4232d/4e64cd7b-b558-45dc-a47e-8d987e93b543/2729b647-c3ec-41c6-9ce1-4933f2ad0ef4) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:19.055409 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.162858 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.217173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Network 79938bca-390b-46e3-bb83-63ec5ad4232d is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:19.218446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Port': ['ID=2729b647-c3ec-41c6-9ce1-4933f2ad0ef4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:19.221136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:19.224033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:19.328688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.438313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.444068 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.446405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.460564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.471213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.480968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.494525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.504900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:19.514015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-a68632f1-e27c-4804-96c5-d0131ec89994 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1701481 Dec 21 03:58:19.590726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bd87352-f79e-4569-9db2-22a55cc4983a req-16fb8e5e-507c-49c2-9e22-593f8af6cba5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0753193 Dec 21 03:58:19.787096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.810173 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba460d5b-7ec5-4e15-b7f8-d246cb26dac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.871230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:19.955058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Port': ['ID=2729b647-c3ec-41c6-9ce1-4933f2ad0ef4,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:19.972802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.041378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.045797 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-002ffc35-10f3-4b7e-b948-004d8191b44a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 1.7895932 Dec 21 03:58:20.046061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35660) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:20.122979 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d56b97a7-8424-4efa-9e67-8771f1db84f0 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "GET /v2.0/floatingips?floating_network_id=79938bca-390b-46e3-bb83-63ec5ad4232d HTTP/1.1" status: 200 len: 689 time: 0.0747921 Dec 21 03:58:20.124623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35670) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:20.215872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.351933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Deleting port 2729b647-c3ec-41c6-9ce1-4933f2ad0ef4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:20.352273 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.435234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.435618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.450576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Calling delete_port for 2729b647-c3ec-41c6-9ce1-4933f2ad0ef4 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:20.667400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:20.703425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Port': ['ID=2729b647-c3ec-41c6-9ce1-4933f2ad0ef4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:21.090363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35702) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:21.194501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.201070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.207734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.214753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.220910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.227141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.233302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:21.235261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-76f69a25-09ee-4ebc-b5af-0f87c9736ec6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.5655029 Dec 21 03:58:21.243172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.247420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19cd704-7e3e-414d-acf6-f9865b0dab12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.334569 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.370465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19cd704-7e3e-414d-acf6-f9865b0dab12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.380782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59126c6f-1e20-48fa-a172-ee762cd08d86 req-2c2da2f7-190d-4845-945b-65b4d47fb70d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1386774 Dec 21 03:58:21.449248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b19cd704-7e3e-414d-acf6-f9865b0dab12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.483137 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.499925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19cd704-7e3e-414d-acf6-f9865b0dab12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68390f29-2c99-4a70-968f-935769b14a22,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:21.507129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b19cd704-7e3e-414d-acf6-f9865b0dab12 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9e57d4068e9940c1a2e511ee02d4c2c8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4154866 Dec 21 03:58:21.509669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35708) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:21.525851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=4e64cd7b-b558-45dc-a47e-8d987e93b543,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:21.567809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd9c7b4e-5f96-4b8a-bd36-f60721e9d9f0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.600266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd9c7b4e-5f96-4b8a-bd36-f60721e9d9f0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.629224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.653407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['79938bca-390b-46e3-bb83-63ec5ad4232d']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:21.663637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ab365c76-7c85-4ac9-9e91-6ffef56502fe') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:21.663967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ab365c76-7c85-4ac9-9e91-6ffef56502fe') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:21.673907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.688061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.698462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:21.699763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:21.717290 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:21.850231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd9c7b4e-5f96-4b8a-bd36-f60721e9d9f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.852978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd9c7b4e-5f96-4b8a-bd36-f60721e9d9f0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.856505 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cd9c7b4e-5f96-4b8a-bd36-f60721e9d9f0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/68390f29-2c99-4a70-968f-935769b14a22 HTTP/1.1" status: 204 len: 168 time: 0.3426952 Dec 21 03:58:21.865706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.868777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9c7b4e-5f96-4b8a-bd36-f60721e9d9f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68390f29-2c99-4a70-968f-935769b14a22,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:21.889549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 79938bca-390b-46e3-bb83-63ec5ad4232d {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 03:58:21.891310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Network': ['ID=79938bca-390b-46e3-bb83-63ec5ad4232d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:21.894386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:21.896687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e85f20ba-f232-43a2-bb65-7f13499c69b4 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/networks/79938bca-390b-46e3-bb83-63ec5ad4232d HTTP/1.1" status: 204 len: 168 time: 1.7710552 Dec 21 03:58:21.899429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35714) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:22.127927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35720) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:22.128154 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e578c138-2fd0-4e49-90f0-5ba123c6454e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 2261 time: 0.2274668 Dec 21 03:58:22.330114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.331063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.332293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.332926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.333846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.337338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.339663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.340728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.341196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.341650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.342099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.342546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.343042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.343635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.346047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8de6fdf3-76c5-4147-8fb6-368b0e45e569 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 8930 time: 0.2166870 Dec 21 03:58:22.350337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35724) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:22.478924 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-dbee7f02-423d-405c-90d2-392022f2f1d0 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] delete failed (client error): The resource could not be found. Dec 21 03:58:22.487936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35732) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:22.488435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dbee7f02-423d-405c-90d2-392022f2f1d0 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/floatingips/905b537e-0d17-4a2b-84c3-0bae53aa3785 HTTP/1.1" status: 404 len: 345 time: 0.1361575 Dec 21 03:58:22.521367 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-3501f155-a835-49ff-84e4-b01cc7b4740f tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] DELETE failed (client error): The resource could not be found. Dec 21 03:58:22.522223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3501f155-a835-49ff-84e4-b01cc7b4740f tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:58:22.525457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3501f155-a835-49ff-84e4-b01cc7b4740f tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/networks/79938bca-390b-46e3-bb83-63ec5ad4232d HTTP/1.1" status: 404 len: 339 time: 0.0357127 Dec 21 03:58:22.530068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35734) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:22.536598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'network': {'name': 'tempest-network--849878371', 'router:external': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:22.670972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.688437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Made reservation on behalf of 3d4c483700194e17a51de37e657c0655 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:22.689065 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.693047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9aef04fa-1a44-430b-bf0e-78c874bc2cc1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.693180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.705233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.725501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:22.727631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.735452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.736800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.737158 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Added segment aeee5d72-5eb8-4b36-b73b-12ae13a892fc of type vlan for network 892b78f1-47e4-45ea-8ba9-fb489397b188 Dec 21 03:58:22.742181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.749196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.756685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.759285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-daeae15c-5a69-4181-bfda-f879ee889bb9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.2178340 Dec 21 03:58:22.797123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.844395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3478826-c598-4e90-85e8-b67ee6a9c111 req-3146bc56-d4b8-4d97-a782-458902ca50d2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0746007 Dec 21 03:58:22.922777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.923748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:22.924338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:22.988040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Network': ['ID=892b78f1-47e4-45ea-8ba9-fb489397b188,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:22.999829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 892b78f1-47e4-45ea-8ba9-fb489397b188 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:23.052283 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-69ca8821-3c47-4c3a-ab56-ab2981b39d8b tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 0.5210962 Dec 21 03:58:23.054872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35744) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:23.060803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:23.076607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eed8689b-4dff-489f-9cea-e34aabcca565 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.215622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eed8689b-4dff-489f-9cea-e34aabcca565 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.237908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.293559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d6fcdec-caae-4b8d-a37e-a973434b7766 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:23.300251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d6fcdec-caae-4b8d-a37e-a973434b7766 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:23.306325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d6fcdec-caae-4b8d-a37e-a973434b7766 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:23.312168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d6fcdec-caae-4b8d-a37e-a973434b7766 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:23.314125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d6fcdec-caae-4b8d-a37e-a973434b7766 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2452 time: 0.2576029 Dec 21 03:58:23.317819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:23.327874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eed8689b-4dff-489f-9cea-e34aabcca565 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.426248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eed8689b-4dff-489f-9cea-e34aabcca565 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9b37c012ce4545809fb461135b7647a6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3643935 Dec 21 03:58:23.427277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed8689b-4dff-489f-9cea-e34aabcca565 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=332b4f4f-66e4-4c87-a503-3f942cb9cc4e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:23.428964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:23.431562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.478808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daff8ca9-fc1c-41c6-b910-024b89b4c1be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.506221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daff8ca9-fc1c-41c6-b910-024b89b4c1be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.522134 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.545627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['892b78f1-47e4-45ea-8ba9-fb489397b188']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:23.555854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aeee5d72-5eb8-4b36-b73b-12ae13a892fc') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:23.556296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aeee5d72-5eb8-4b36-b73b-12ae13a892fc') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:23.567906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.582289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.591198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:23.591835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:23.594055 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:23.725036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daff8ca9-fc1c-41c6-b910-024b89b4c1be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.728889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-daff8ca9-fc1c-41c6-b910-024b89b4c1be admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.730510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-daff8ca9-fc1c-41c6-b910-024b89b4c1be admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/332b4f4f-66e4-4c87-a503-3f942cb9cc4e HTTP/1.1" status: 204 len: 168 time: 0.2998185 Dec 21 03:58:23.741246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daff8ca9-fc1c-41c6-b910-024b89b4c1be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=332b4f4f-66e4-4c87-a503-3f942cb9cc4e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:23.754011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.760558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 892b78f1-47e4-45ea-8ba9-fb489397b188 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 03:58:23.776205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:23.781032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/networks/892b78f1-47e4-45ea-8ba9-fb489397b188 HTTP/1.1" status: 204 len: 168 time: 0.4621313 Dec 21 03:58:23.783270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f080943-dfcb-48e7-a37d-1eb141b9c385 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Network': ['ID=892b78f1-47e4-45ea-8ba9-fb489397b188,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:23.785880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35766) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:23.810595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'network': {'name': 'tempest-network--1745967487', 'router:external': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:23.934401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Made reservation on behalf of 3d4c483700194e17a51de37e657c0655 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:23.937613 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:24.030340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:24.104230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:24.104628 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Added segment c4eb7c6f-e821-4246-893e-f2350cc01ca0 of type vlan for network 3fdbedaa-9161-4e23-b6bc-debe9a3db620 Dec 21 03:58:24.175830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.183653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.199051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.205646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.211872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.217948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.224777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.226805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-05dbaabc-e430-4bce-9d96-52c0ffc7ebc0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.2401519 Dec 21 03:58:24.231519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:24.333751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2572cdec-7c2d-41bf-8a57-bdc5cb7ef442 req-ea33b62c-1b44-4a0c-8f23-d6b473a8ffc5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0926158 Dec 21 03:58:24.415936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:24.417038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.417723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:24.507975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35792) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:24.557607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.7652912 Dec 21 03:58:24.570336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:24.579965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a548c25d-1958-4808-9827-81044fc55868 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Network': ['ID=3fdbedaa-9161-4e23-b6bc-debe9a3db620,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:24.595734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3fdbedaa-9161-4e23-b6bc-debe9a3db620 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:24.718208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f8cfab2-56b2-4f2e-bc9f-691e93bbfd22 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.720401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f8cfab2-56b2-4f2e-bc9f-691e93bbfd22 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] 10.222.0.18 "GET /v2.0/networks/3fdbedaa-9161-4e23-b6bc-debe9a3db620 HTTP/1.1" status: 200 len: 757 time: 0.1489162 Dec 21 03:58:24.723119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35800) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:24.780083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.788661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.794813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.801185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.808192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.814263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.821097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.829653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2025cc3e-4078-439c-9fa9-5874d42df610 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.2352054 Dec 21 03:58:24.854117 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:24.943654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f432cb83-e360-44a9-81a4-cf35220c41f9 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:24.945100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f432cb83-e360-44a9-81a4-cf35220c41f9 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] 10.222.0.18 "GET /v2.0/networks/d507371d-d762-4fcb-a8ad-15e2a0870395 HTTP/1.1" status: 200 len: 767 time: 0.2156126 Dec 21 03:58:24.950628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35806) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:24.965462 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.059170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5de20f6-d53d-4cd3-8cfb-48863172a360 req-2edc1998-25af-4991-8c03-283bf3ecce0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2286313 Dec 21 03:58:25.075616 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.175037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.200170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3fdbedaa-9161-4e23-b6bc-debe9a3db620']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:25.203568 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.217710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c4eb7c6f-e821-4246-893e-f2350cc01ca0') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:25.218014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c4eb7c6f-e821-4246-893e-f2350cc01ca0') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:25.230192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.255962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.262458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Releasing vlan 113 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:25.262899 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:25.264776 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:25.400031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.414833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 3fdbedaa-9161-4e23-b6bc-debe9a3db620 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 03:58:25.432124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.445299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/networks/3fdbedaa-9161-4e23-b6bc-debe9a3db620 HTTP/1.1" status: 204 len: 168 time: 0.4893668 Dec 21 03:58:25.446031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35818) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:25.485700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'network': {'name': 'tempest-network--1974540235'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:25.491541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a303a2c4-5a35-49a6-974e-4d493acbc254 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Network': ['ID=3fdbedaa-9161-4e23-b6bc-debe9a3db620,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:25.516082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Deleting port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:25.517075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.558677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.566003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.574096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.580925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.587620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.594010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.601047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.610190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7340ce8-a112-4959-900e-297e157bdab2 req-8df5f799-cbe3-4542-ac7c-581a21b02def tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1284592 Dec 21 03:58:25.659202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] For port 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:25.660242 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.689225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Calling delete_port for 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:25.693080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7340ce8-a112-4959-900e-297e157bdab2 req-5ff0cfab-863a-4283-8a89-c6fc7ffe728c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0780954 Dec 21 03:58:25.715805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Made reservation on behalf of 3d4c483700194e17a51de37e657c0655 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:25.715947 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.716420 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.747637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:25.760218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.760773 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Added segment e5ed9140-52da-4edf-8940-428b5e01f090 of type vlan for network 952e7c3e-31ed-47af-a70b-b7acb08377b2 Dec 21 03:58:25.830437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.909266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.916410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.923424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.930088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.936840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.944842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.958775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.958775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-972d98c2-87f9-44fc-951c-edfffe91449d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.1362376 Dec 21 03:58:25.975684 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:25.976673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:25.977258 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.033830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-cd19ac3f-d593-460f-98ba-a688f2200563 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.036065 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-cd19ac3f-d593-460f-98ba-a688f2200563 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "GET /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0742214 Dec 21 03:58:26.040070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Network': ['ID=952e7c3e-31ed-47af-a70b-b7acb08377b2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:26.052058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 952e7c3e-31ed-47af-a70b-b7acb08377b2 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:26.110088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d221b650-47e5-4314-912d-38f9fb42c1d8 tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 0.6270442 Dec 21 03:58:26.110864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35834) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:26.118621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Request body: {'network': {'router:external': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:26.177085 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-41f3c919-3398-462d-81ec-9d76a659162d tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "GET /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1328425 Dec 21 03:58:26.178294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.203729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:26.237573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Pushing event deleted for resources: {'Port': ['ID=0b60559b-cb0f-4c3d-b6d3-97e08d4d523a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:26.297509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.303651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.309725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.319820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.326045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.333236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.337111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.339635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.342146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-4ae25d59-a02b-4522-a661-8f04358aaad8 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 5433 time: 0.1466951 Dec 21 03:58:26.455824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.485181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea4fc2bb-1304-45f1-8308-8eb1711cc17c req-ae8aee0b-c1a6-44d5-8df6-af3b2941ed8f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1129737 Dec 21 03:58:26.547372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.564100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Network 952e7c3e-31ed-47af-a70b-b7acb08377b2 is not hosted by any dhcp agent {{(pid=110310) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 03:58:26.564981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.565621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.571098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "PUT /v2.0/networks/952e7c3e-31ed-47af-a70b-b7acb08377b2 HTTP/1.1" status: 200 len: 858 time: 0.4566734 Dec 21 03:58:26.574031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35844) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:26.603544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.620880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6b7345-d367-4c48-a8f5-45a862f51d6a tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event updated for resources: {'Network': ['ID=952e7c3e-31ed-47af-a70b-b7acb08377b2,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:26.635205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1a539edc-6061-4a94-a9d0-3e97bd54fe56,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:26.740604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:26.898679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.909236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.915909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.922467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.929763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.936205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.943805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:26.946126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9a323d3-df7b-44aa-838b-3debffec015c req-e6b48c4f-8bb7-4908-98b5-d71dea60f303 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1420500 Dec 21 03:58:27.038384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9a323d3-df7b-44aa-838b-3debffec015c req-c81b2933-7bae-4a48-b656-1d0aa6862655 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0733566 Dec 21 03:58:27.094095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35864) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:27.095573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] For port 1a539edc-6061-4a94-a9d0-3e97bd54fe56, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:27.200758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] device_id is not set on port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:58:27.213922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-666693569', 'router:external': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:27.217374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.332239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.335393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.336057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Made reservation on behalf of 3ac74c038ad149e39cb78a7657542c0c for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:27.339617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.349160 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.427331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['952e7c3e-31ed-47af-a70b-b7acb08377b2']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:27.436338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.450538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5ed9140-52da-4edf-8940-428b5e01f090') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:27.450842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5ed9140-52da-4edf-8940-428b5e01f090') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:27.480277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] No DVR routers for this DVR port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:27.482176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Pushing event updated for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:27.490780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.522704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.530713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.550350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:27.550597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:27.552208 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:27.570033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af18c905-b9f2-43a0-b212-8d65604d8d14,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:27.572608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] In _notify_port_updated(), no bound segment for port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 03:58:27.574119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.579640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.581849 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-1f11a1d7-25aa-43fe-92ba-e75bbaa49c5a service neutron] 10.222.0.54 "PUT /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 200 len: 1027 time: 1.3929636 Dec 21 03:58:27.583809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Router 51cca181-9cee-4e4e-bf00-02cc46bb1724 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:58:27.676593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.683811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.689743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.696282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.707543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-bea5d699-23d6-4100-afe6-7d54a9a55652 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.718228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.718741 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-bea5d699-23d6-4100-afe6-7d54a9a55652 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "GET /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.1201189 Dec 21 03:58:27.719070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:27.719070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-4bd8de91-c926-42ba-a44f-aa11b3408f10 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 4659 time: 0.0951700 Dec 21 03:58:27.726478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:27.736260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27224935-809f-4216-830c-19763616ef35 None None] Provisioning complete for port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:27.737234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27224935-809f-4216-830c-19763616ef35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.767814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:27.790218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.792730 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Added segment a20f658d-1a94-4037-977b-48b806750d2b of type vlan for network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f Dec 21 03:58:27.796927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-27224935-809f-4216-830c-19763616ef35 None None] Port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:27.800853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.806208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 952e7c3e-31ed-47af-a70b-b7acb08377b2 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 03:58:27.808732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.812349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] 10.222.0.18 "DELETE /v2.0/networks/952e7c3e-31ed-47af-a70b-b7acb08377b2 HTTP/1.1" status: 204 len: 168 time: 1.2373292 Dec 21 03:58:27.815191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b380010-c673-45ea-b992-cb07de5d1d39 req-5e19ace5-018b-4841-8fbe-cbff6d8a8cca tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=e7e08fd5-b884-449b-bda4-3e7982fc9b69&id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0859029 Dec 21 03:58:27.816309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:27.849915 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-9b11a71a-64c2-4a86-83e1-232ab33508b2 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] DELETE failed (client error): The resource could not be found. Dec 21 03:58:27.850470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9b11a71a-64c2-4a86-83e1-232ab33508b2 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:58:27.863678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9b11a71a-64c2-4a86-83e1-232ab33508b2 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] 10.222.0.18 "DELETE /v2.0/subnets/4e64cd7b-b558-45dc-a47e-8d987e93b543 HTTP/1.1" status: 404 len: 337 time: 0.0440166 Dec 21 03:58:27.887605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ad14e6-6cf9-4b87-82f1-16c282b02e3e tempest-ExternalNetworksTestJSON-405720492 tempest-ExternalNetworksTestJSON-405720492-project-admin] Pushing event deleted for resources: {'Network': ['ID=952e7c3e-31ed-47af-a70b-b7acb08377b2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:27.891068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35892) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:27.929594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.938487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:27.941537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:27.950451 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ce43a714-ae68-42aa-91f5-7e61cbdae496 admin admin] 10.222.0.18 "PUT /v2.0/routers/51cca181-9cee-4e4e-bf00-02cc46bb1724/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4410636 Dec 21 03:58:27.961395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:28.033455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.034496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.035114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.086985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.107286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Network': ['ID=9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:28.118095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:28.144613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db3be45a-0005-479d-85c6-f1d73ee4a422 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 874 time: 1.0492158 Dec 21 03:58:28.147916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:28.152938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'subnet': {'network_id': '9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:28.225089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d826c2ac-b9f5-444f-bb74-8ff9a966c08d no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:28.284232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.290365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.297103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.303842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.308362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:28.311266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.316663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.319078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.322642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.324630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-61c4b8cf-d133-4f2c-a008-a94d5e5561d4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1782813 Dec 21 03:58:28.355897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] For port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:28.364955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:28.366051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:28.368940 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7cc61385-47a9-4a7d-80bc-8285abde3407" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:28.400900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] device_id is not set on port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:58:28.412141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.424697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.425915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.429712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:28.442203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89ecf8f8-8626-454e-9e16-34b1012596f4 req-8db443a2-bd17-4f5f-88fd-68551ba6437b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0851474 Dec 21 03:58:28.481316 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] Sync routers for ids ['51cca181-9cee-4e4e-bf00-02cc46bb1724'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:28.496924 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] Routers {'51cca181-9cee-4e4e-bf00-02cc46bb1724'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:28.497868 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['51cca181-9cee-4e4e-bf00-02cc46bb1724'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:28.520388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.537258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:28.549638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.551786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.555954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:28.565058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 host ! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:58:28.565780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:28.566382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1a539edc-6061-4a94-a9d0-3e97bd54fe56 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:28.635794 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.660488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 host ! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 03:58:28.661048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1a539edc-6061-4a94-a9d0-3e97bd54fe56 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:28.661615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3a3dc231-a27a-4c00-a859-1a62de02e991 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:28.709776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] No DVR routers for this DVR port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:28.719549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Made reservation on behalf of 3ac74c038ad149e39cb78a7657542c0c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:28.722447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.730524 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] Set router 51cca181-9cee-4e4e-bf00-02cc46bb1724 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:28.752867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Pushing event updated for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:28.767367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d507371d-d762-4fcb-a8ad-15e2a0870395']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:28.817273 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7148bf5-93b4-4e76-bc86-bb4185ab79ac x-openstack-request-id: req-c7148bf5-93b4-4e76-bc86-bb4185ab79ac {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:28.818320 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:28.819929 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c7148bf5-93b4-4e76-bc86-bb4185ab79ac {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:28.823716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8ca5c898-7a30-4fcb-b7a3-9b8ee17c05c7') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:28.824015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8ca5c898-7a30-4fcb-b7a3-9b8ee17c05c7') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:28.828276 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d', 'code': 200} Dec 21 03:58:28.829364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.887515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3a3dc231-a27a-4c00-a859-1a62de02e991,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:28.895378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.921722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.924610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] In _notify_port_updated(), no bound segment for port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 on network 48839244-4ebd-4f7e-a6df-11292c1938d9 {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 03:58:28.925521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:28.926130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.927471 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-ef834b6f-2930-4edb-aa65-6e57205794a6 service neutron] 10.222.0.54 "PUT /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 200 len: 1027 time: 1.2074223 Dec 21 03:58:28.935792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.943796 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '87363837-739a-400f-9637-a8af925500ea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:58:25Z', 'revision_number': 5, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port': {'id': '87363837-739a-400f-9637-a8af925500ea', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:f5:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1396, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:17Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:28.955201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:28.955607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.959647 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:28.960441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:29.021566 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:29.055798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83372e38-1d0e-4e02-ae71-af548a43405f req-bcb5bc34-d005-4360-87f3-c8500ca591e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.064551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83372e38-1d0e-4e02-ae71-af548a43405f req-bcb5bc34-d005-4360-87f3-c8500ca591e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.074509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83372e38-1d0e-4e02-ae71-af548a43405f req-bcb5bc34-d005-4360-87f3-c8500ca591e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.085323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83372e38-1d0e-4e02-ae71-af548a43405f req-bcb5bc34-d005-4360-87f3-c8500ca591e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.093402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:29.095423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83372e38-1d0e-4e02-ae71-af548a43405f req-bcb5bc34-d005-4360-87f3-c8500ca591e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.098423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83372e38-1d0e-4e02-ae71-af548a43405f req-bcb5bc34-d005-4360-87f3-c8500ca591e4 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 3881 time: 0.1437867 Dec 21 03:58:29.110429 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] Checking router: 51cca181-9cee-4e4e-bf00-02cc46bb1724 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:58:29.119472 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] Routers {'51cca181-9cee-4e4e-bf00-02cc46bb1724'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:29.121182 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['51cca181-9cee-4e4e-bf00-02cc46bb1724'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:29.148249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.164108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b6b9f188-7439-4c9c-98ce-8ad9b443a639 None None] Provisioning complete for port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:29.164479 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6b9f188-7439-4c9c-98ce-8ad9b443a639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.203226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b6b9f188-7439-4c9c-98ce-8ad9b443a639 None None] Port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:29.234771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83372e38-1d0e-4e02-ae71-af548a43405f req-7ed5d632-460f-472b-8fe3-58a8872f97c3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1221294 Dec 21 03:58:29.235908 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] Set router 51cca181-9cee-4e4e-bf00-02cc46bb1724 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:29.239569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:29.255395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Deleting port 87363837-739a-400f-9637-a8af925500ea {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:29.255847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.287443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.294105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port 3136aa12-8de7-43c2-8cde-55879999fd27 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:29.294658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.303974 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:58:28Z', 'revision_number': 6, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:29.308902 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.313415 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.314159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:29.324825 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] 10.222.0.18 "DELETE /v2.0/networks/d507371d-d762-4fcb-a8ad-15e2a0870395 HTTP/1.1" status: 204 len: 168 time: 1.4172490 Dec 21 03:58:29.331146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1bbc17e-78cc-4d71-ad7a-72404e828851 None None] The sync data for ids ['51cca181-9cee-4e4e-bf00-02cc46bb1724'] in n-d-822053-11 is: [{'id': '51cca181-9cee-4e4e-bf00-02cc46bb1724', 'name': 'tempest-AttachSCSIVolumeTestJSON-336981649-router', 'tenant_id': 'c5b2145a02404e39a8488c84d609fc52', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:16Z', 'updated_at': '2021-12-21T03:58:28Z', 'revision_number': 6, 'project_id': 'c5b2145a02404e39a8488c84d609fc52', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:58:29.422082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c576d47-cd47-4638-9c91-a9bf23a83161 tempest-ExternalNetworksTestJSON-1614206056 tempest-ExternalNetworksTestJSON-1614206056-project] Pushing event deleted for resources: {'Network': ['ID=d507371d-d762-4fcb-a8ad-15e2a0870395,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:29.428359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:29.467535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.506206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:29.600484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.610149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.616637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.623048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.632691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.639357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.645782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.645991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:29.647006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3136aa12-8de7-43c2-8cde-55879999fd27 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:29.647957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-3066b1cc-dceb-4584-a396-1b8991866591 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1196334 Dec 21 03:58:29.753694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a386a937-9635-4ac5-90ce-8d8bc0ced250 req-58302f81-f3fa-4e69-8a53-530dadaa2ecb tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0932226 Dec 21 03:58:29.777446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:29.862327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] For port 87363837-739a-400f-9637-a8af925500ea, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87363837-739a-400f-9637-a8af925500ea,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:29.863693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.873520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.917127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3136aa12-8de7-43c2-8cde-55879999fd27,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:29.917127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:29.917351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3136aa12-8de7-43c2-8cde-55879999fd27, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3136aa12-8de7-43c2-8cde-55879999fd27,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:29.918544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Calling delete_port for 87363837-739a-400f-9637-a8af925500ea owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:29.974804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for 3136aa12-8de7-43c2-8cde-55879999fd27 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:29.998897 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.009382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35926) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:30.073922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:30.305366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:30.346898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:58:30.347931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0b60559b-cb0f-4c3d-b6d3-97e08d4d523a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:30.348467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 87363837-739a-400f-9637-a8af925500ea no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:30.395452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 03:58:30.396383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.448575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881558d3-052d-46fc-91ec-de1e084627bc req-5fb8ea29-8d5f-4223-b0d9-144ffb7f70cd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.454649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881558d3-052d-46fc-91ec-de1e084627bc req-5fb8ea29-8d5f-4223-b0d9-144ffb7f70cd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.459178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.461234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881558d3-052d-46fc-91ec-de1e084627bc req-5fb8ea29-8d5f-4223-b0d9-144ffb7f70cd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.463191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Subnet': ['ID=c832c73d-cc9e-46ff-b517-4b217d53b5a5,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:30.464782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.468671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.468839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881558d3-052d-46fc-91ec-de1e084627bc req-5fb8ea29-8d5f-4223-b0d9-144ffb7f70cd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.475230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881558d3-052d-46fc-91ec-de1e084627bc req-5fb8ea29-8d5f-4223-b0d9-144ffb7f70cd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.478371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-881558d3-052d-46fc-91ec-de1e084627bc req-5fb8ea29-8d5f-4223-b0d9-144ffb7f70cd tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 3875 time: 0.1203229 Dec 21 03:58:30.481732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-396e0ff9-46da-4919-86d6-c0e6b16ac73f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=20379aea4ab0448b999f5459bffe8650&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4694977 Dec 21 03:58:30.484588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35940) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:30.520698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=3136aa12-8de7-43c2-8cde-55879999fd27,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:30.533355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20eea9e7-e63c-444c-a8ef-3da2aae53847 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:30.539941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Checking segment: {'id': 'a20f658d-1a94-4037-977b-48b806750d2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:30.540507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network hostable DHCP agents. Network: 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:58:30.585321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-881558d3-052d-46fc-91ec-de1e084627bc req-b5d5ff97-c770-44ca-a7e7-6c8ac19b80a3 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0985556 Dec 21 03:58:30.602034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Pushing event deleted for resources: {'Port': ['ID=87363837-739a-400f-9637-a8af925500ea,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:30.658218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] No DVR routers for this DVR port 3136aa12-8de7-43c2-8cde-55879999fd27 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:30.666993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.670272 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-e5ee516a-5edb-4533-91e6-8ff345d07f99 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "DELETE /v2.0/ports/3136aa12-8de7-43c2-8cde-55879999fd27 HTTP/1.1" status: 204 len: 173 time: 1.7270169 Dec 21 03:58:30.670636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:30.672930 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-777cd395-1980-454d-bc4d-05f37dbffec9" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:30.728813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.794960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:58:30.802059 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb8e4020-11b7-4e95-8b5c-e1212e36e875 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.830111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:30.832646 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-010e5212-ea9c-45a2-9b7b-52451ea7f2d9" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:30.857596 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce9fde8b-5daa-4368-928b-7e425292ecf9 x-openstack-request-id: req-ce9fde8b-5daa-4368-928b-7e425292ecf9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:30.857851 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:30.858111 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ce9fde8b-5daa-4368-928b-7e425292ecf9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:30.858514 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27', 'status': 'completed', 'code': 200} Dec 21 03:58:30.863754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.870021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.921823 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 704 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5eda9c43-c005-4bf1-bdb5-1fe20525536c x-openstack-request-id: req-5eda9c43-c005-4bf1-bdb5-1fe20525536c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:30.922324 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-unplugged", "status": "completed", "tag": "3136aa12-8de7-43c2-8cde-55879999fd27", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:30.922434 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5eda9c43-c005-4bf1-bdb5-1fe20525536c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:30.923181 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'code': 200} Dec 21 03:58:30.923453 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e', 'code': 200} Dec 21 03:58:30.923714 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5', 'code': 200} Dec 21 03:58:30.924654 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3136aa12-8de7-43c2-8cde-55879999fd27', 'code': 200} Dec 21 03:58:30.931143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb8e4020-11b7-4e95-8b5c-e1212e36e875 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.933725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:30.942788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea0acbf6-58cb-46b4-8e20-8e6b4089c861 None None] Network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:30.951042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.954493 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:30.972657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.982106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.989973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:30.996742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.003350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.012382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.018550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.020562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-6b0cc731-5656-4533-bb81-c80afaef921d tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1681089 Dec 21 03:58:31.040020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port d826c2ac-b9f5-444f-bb74-8ff9a966c08d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:31.040300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.084026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.084652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 51cca181-9cee-4e4e-bf00-02cc46bb1724 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:58:31.132764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2c801f3-a832-4b85-9e26-0ffb2c4719a4 None None] Network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:31.139347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-821f7d83-5c3d-4157-9d02-9cc2bc1a7e28 req-894f2b53-aa96-45bb-957a-1af32153129a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1056917 Dec 21 03:58:31.140529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.152150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35958) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:31.153747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-397aeea0-55d8-4aef-b39b-5b291d902a66 admin admin] 10.222.0.18 "DELETE /v2.0/routers/51cca181-9cee-4e4e-bf00-02cc46bb1724 HTTP/1.1" status: 204 len: 168 time: 3.1911869 Dec 21 03:58:31.168282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb8e4020-11b7-4e95-8b5c-e1212e36e875 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.171080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb8e4020-11b7-4e95-8b5c-e1212e36e875 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.172287 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bb8e4020-11b7-4e95-8b5c-e1212e36e875 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7244a8f8-f33d-4e34-bd0a-f2705e8b0837 HTTP/1.1" status: 204 len: 168 time: 0.6624479 Dec 21 03:58:31.177071 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-923c8d08-e1d6-4466-b73c-9e110dc79567 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 3.0281081 Dec 21 03:58:31.180178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35962) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:31.194008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8e4020-11b7-4e95-8b5c-e1212e36e875 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7244a8f8-f33d-4e34-bd0a-f2705e8b0837,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:31.195143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-191812252', 'network_id': '9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:31.284712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] For port d826c2ac-b9f5-444f-bb74-8ff9a966c08d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:31.285089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.302411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for d826c2ac-b9f5-444f-bb74-8ff9a966c08d owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:31.319189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Deleting subnet dcd56809-69ac-49ac-96ed-ba3b364103dd {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:58:31.325712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.368109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.398645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Made reservation on behalf of 3ac74c038ad149e39cb78a7657542c0c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:31.401168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.427073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] device_id is not set on port 10c0c46c-83cf-47b2-bd50-8803b6f12155 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:58:31.510491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.576302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.615292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=d826c2ac-b9f5-444f-bb74-8ff9a966c08d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:31.629756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Allocated IP 2001:db8::2b1 (9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f/c832c73d-cc9e-46ff-b517-4b217d53b5a5/10c0c46c-83cf-47b2-bd50-8803b6f12155) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:31.674268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] No DVR routers for this DVR port d826c2ac-b9f5-444f-bb74-8ff9a966c08d on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:31.678265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.681454 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-b32bb8a0-cfb3-420b-a9ea-88428ca1c6ab tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "DELETE /v2.0/ports/d826c2ac-b9f5-444f-bb74-8ff9a966c08d HTTP/1.1" status: 204 len: 173 time: 1.0008314 Dec 21 03:58:31.754180 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:58:31.808001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:31.808148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.835115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138e5b67-7966-4f04-87bd-3e65ce4b8f0d req-324f51c4-8c1f-465e-a30a-4bf726286b7e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.841181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138e5b67-7966-4f04-87bd-3e65ce4b8f0d req-324f51c4-8c1f-465e-a30a-4bf726286b7e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.847845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138e5b67-7966-4f04-87bd-3e65ce4b8f0d req-324f51c4-8c1f-465e-a30a-4bf726286b7e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:31.849516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-138e5b67-7966-4f04-87bd-3e65ce4b8f0d req-324f51c4-8c1f-465e-a30a-4bf726286b7e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 2410 time: 0.1279082 Dec 21 03:58:31.852871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.891511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.909347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dcd56809-69ac-49ac-96ed-ba3b364103dd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:31.916169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] For port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:31.916665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.925255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:31.925978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae06d020-859d-4ee5-8573-503140178bd2 None None] Network 45ff9d95-f609-4ed5-9517-1125b7d4496f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:31.929966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9ade2581-67d3-48e6-b3eb-589e979a10ee admin admin] 10.222.0.18 "DELETE /v2.0/subnets/dcd56809-69ac-49ac-96ed-ba3b364103dd HTTP/1.1" status: 204 len: 168 time: 0.7766247 Dec 21 03:58:31.933391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35984) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:31.936242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:32.063187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-138e5b67-7966-4f04-87bd-3e65ce4b8f0d req-95449dc2-945d-412a-a4cf-96d48ca271b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1968212 Dec 21 03:58:32.096371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.098552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:32.171216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-53f66d8e-659e-40bc-babc-19f79bdf8407 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3d4c483700194e17a51de37e657c0655&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0687349 Dec 21 03:58:32.171866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35992) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:32.172029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.197142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] DHCP port deletion for 45ff9d95-f609-4ed5-9517-1125b7d4496f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:32.247892 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0142d6df-0277-4ba0-b513-af6157b8d232 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.275288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Port': ['ID=10c0c46c-83cf-47b2-bd50-8803b6f12155,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:32.290044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.305106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0142d6df-0277-4ba0-b513-af6157b8d232 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.319583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b32cc5c5-5bb2-453a-9579-862bddcf93cf no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:32.348637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] Deleting port b32cc5c5-5bb2-453a-9579-862bddcf93cf {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:32.349024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.365166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:32.385284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.396490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.402826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.404722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:32.409632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.416203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.422209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.424750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] No DVR routers for this DVR port aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:32.428982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.430369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] For port b32cc5c5-5bb2-453a-9579-862bddcf93cf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b32cc5c5-5bb2-453a-9579-862bddcf93cf,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:32.430779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.431066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-9ed76f00-3d77-496e-804e-3a3d696d9589 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1568913 Dec 21 03:58:32.433951 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.434548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:32.437671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:32.437962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-d3c39e24-220b-47dd-8020-809f05ec3877 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "DELETE /v2.0/ports/aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e HTTP/1.1" status: 204 len: 173 time: 0.7425399 Dec 21 03:58:32.438642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:32.439262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.447517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] Calling delete_port for b32cc5c5-5bb2-453a-9579-862bddcf93cf owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:32.459909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Deleting port b32cc5c5-5bb2-453a-9579-862bddcf93cf {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:32.460604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.528407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-35d02fdd-b374-46e1-94e6-c7743833fa08 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 1.3435447 Dec 21 03:58:32.550535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36000) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:32.595586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c140fbb-ffc4-48b4-9203-7969a7063475 req-ff6e6c3f-32b8-47da-93ee-ac608ea7c71c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1312706 Dec 21 03:58:32.613403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.625790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] For port b32cc5c5-5bb2-453a-9579-862bddcf93cf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b32cc5c5-5bb2-453a-9579-862bddcf93cf,segment=NetworkSegment(aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461),segment_id=aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:32.626117 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.631649 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.641386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Calling delete_port for b32cc5c5-5bb2-453a-9579-862bddcf93cf owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:32.647445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0142d6df-0277-4ba0-b513-af6157b8d232 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.650315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0142d6df-0277-4ba0-b513-af6157b8d232 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.655389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0142d6df-0277-4ba0-b513-af6157b8d232 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1c991dee-473a-4d31-82c6-fad6adfa46c2 HTTP/1.1" status: 204 len: 168 time: 0.4820099 Dec 21 03:58:32.671105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0142d6df-0277-4ba0-b513-af6157b8d232 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c991dee-473a-4d31-82c6-fad6adfa46c2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:32.676690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:32.677124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.714797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] Pushing event deleted for resources: {'Port': ['ID=b32cc5c5-5bb2-453a-9579-862bddcf93cf,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:32.762264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03930a3f-7e99-4e08-971b-be3d708366b1 None None] No DVR routers for this DVR port b32cc5c5-5bb2-453a-9579-862bddcf93cf on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:32.799238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.824793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Deleting port 10c0c46c-83cf-47b2-bd50-8803b6f12155 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:32.824793 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.845246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Pushing event deleted for resources: {'Port': ['ID=b32cc5c5-5bb2-453a-9579-862bddcf93cf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:32.849669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] No DVR routers for this DVR port b32cc5c5-5bb2-453a-9579-862bddcf93cf on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:32.860154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d'}, {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:32.863157 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f1a0267-fc00-49ff-89e0-9a7187ec205f" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d"}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:32.926049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] For port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:32.926722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.929876 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5367e247-5ca9-4679-97f8-f1d0ef98b360 x-openstack-request-id: req-5367e247-5ca9-4679-97f8-f1d0ef98b360 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:32.930175 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "d826c2ac-b9f5-444f-bb74-8ff9a966c08d", "status": "completed", "code": 200}, {"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:32.930429 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5367e247-5ca9-4679-97f8-f1d0ef98b360 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:32.930826 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': 'd826c2ac-b9f5-444f-bb74-8ff9a966c08d', 'status': 'completed', 'code': 200} Dec 21 03:58:32.931150 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': 'aa6e4fa8-4ddb-4fa8-85e5-d1650ed3527e', 'status': 'completed', 'code': 200} Dec 21 03:58:32.963382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.965891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:32.973745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:32.983510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Calling delete_port for 10c0c46c-83cf-47b2-bd50-8803b6f12155 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:33.008803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['45ff9d95-f609-4ed5-9517-1125b7d4496f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:33.018840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:33.019181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aeaee5fc-c5fa-4cb1-a436-1dd24dbdd461') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:33.029259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.044591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.052058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:33.054754 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:33.180323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.185715 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.188875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] 10.222.0.18 "DELETE /v2.0/networks/45ff9d95-f609-4ed5-9517-1125b7d4496f HTTP/1.1" status: 204 len: 168 time: 1.2541521 Dec 21 03:58:33.192217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36014) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:33.243022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6e0ee1-a8a2-47d8-b618-2f74bd73a898 admin admin] Pushing event deleted for resources: {'Network': ['ID=45ff9d95-f609-4ed5-9517-1125b7d4496f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:33.264756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b4bf3d-e1c4-4c87-bc08-e9fdb9c73e50 req-787b9037-3dde-480b-ad62-0be97677989b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:33.270805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b4bf3d-e1c4-4c87-bc08-e9fdb9c73e50 req-787b9037-3dde-480b-ad62-0be97677989b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:33.272455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2b4bf3d-e1c4-4c87-bc08-e9fdb9c73e50 req-787b9037-3dde-480b-ad62-0be97677989b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 1677 time: 0.1263099 Dec 21 03:58:33.322528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.324363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.361829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event deleted for resources: {'Port': ['ID=10c0c46c-83cf-47b2-bd50-8803b6f12155,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:33.418375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2b4bf3d-e1c4-4c87-bc08-e9fdb9c73e50 req-b90532bf-544a-421d-9bab-24d99ce12900 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1225102 Dec 21 03:58:33.429950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=8288eff7-b10c-4c94-a0c7-0e3894ee03f5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:33.442270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] No DVR routers for this DVR port 8288eff7-b10c-4c94-a0c7-0e3894ee03f5 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:33.462122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.465513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-78691ffa-96ab-4ce6-aebb-140295ecad0a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "DELETE /v2.0/ports/8288eff7-b10c-4c94-a0c7-0e3894ee03f5 HTTP/1.1" status: 204 len: 173 time: 1.0210781 Dec 21 03:58:33.468576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.471674 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5785f743-af28-49c5-b259-c34592d4d76c tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/ports/10c0c46c-83cf-47b2-bd50-8803b6f12155 HTTP/1.1" status: 204 len: 168 time: 0.9162133 Dec 21 03:58:33.480377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36024) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:33.501779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f', 'external_fixed_ips': [{'subnet_id': 'c832c73d-cc9e-46ff-b517-4b217d53b5a5', 'ip_address': '2001:db8::2b1'}]}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:33.611730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port 3a3dc231-a27a-4c00-a859-1a62de02e991 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:33.612107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.637903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.639141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.656663 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.754677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:33.777706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] For port 3a3dc231-a27a-4c00-a859-1a62de02e991, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3a3dc231-a27a-4c00-a859-1a62de02e991,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:33.778084 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.204884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.211314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.217422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.223654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.229927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.236236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.243141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.251534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-809c2f75-703e-403f-bdd6-b308ecfb5b19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1667280 Dec 21 03:58:34.373150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc9356bb-629c-40cb-a2d8-408a31a03401 req-4a85af3d-cc8e-46ef-b7ce-a77071744242 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1206653 Dec 21 03:58:34.434324 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.438349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.438715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.439062 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Floating IP 7b75aeab-4063-4bcf-904d-54f363b49069 disassociated. External IP: 172.25.5.36, port: 3a3dc231-a27a-4c00-a859-1a62de02e991. Dec 21 03:58:34.439412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for 3a3dc231-a27a-4c00-a859-1a62de02e991 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:34.481846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Deleting port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:34.483026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.598190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36052) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:34.606406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f84af93-7417-4570-8b0d-9a7a35dd3035 req-53f51eb2-1849-4026-8d7d-5375f41d8198 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:34.608117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f84af93-7417-4570-8b0d-9a7a35dd3035 req-53f51eb2-1849-4026-8d7d-5375f41d8198 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 943 time: 0.0722275 Dec 21 03:58:34.734235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] For port 088ea98c-12cd-4d33-ae1a-65da3f7daaf5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:34.734235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.734235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Calling delete_port for 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:34.734235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f84af93-7417-4570-8b0d-9a7a35dd3035 req-72ffc79d-f251-4daa-9ed6-e5db14ab1056 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups?id=23bc1696-ad98-4340-b8bf-f563caa89a24&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0934675 Dec 21 03:58:34.778777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-478885b6-fad7-486f-a88b-77011a028b07 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.782270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.821123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.918161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.936529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-478885b6-fad7-486f-a88b-77011a028b07 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:34.946534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:34.948845 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4bcbc4d-f9e2-4a89-861c-c976a9eefd66" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:34.959322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=3a3dc231-a27a-4c00-a859-1a62de02e991,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:35.007748 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0598df0-1ca8-4939-ac74-85fbd1ce9619 x-openstack-request-id: req-c0598df0-1ca8-4939-ac74-85fbd1ce9619 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:35.019412 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "8288eff7-b10c-4c94-a0c7-0e3894ee03f5", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:35.019412 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c0598df0-1ca8-4939-ac74-85fbd1ce9619 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:35.019412 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': '8288eff7-b10c-4c94-a0c7-0e3894ee03f5', 'status': 'completed', 'code': 200} Dec 21 03:58:35.062322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Allocated IP 2001:db8::2b1 (9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f/c832c73d-cc9e-46ff-b517-4b217d53b5a5/c7f9878e-7d37-471e-9152-1cd861380bb0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:35.161432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.164012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-478885b6-fad7-486f-a88b-77011a028b07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.181778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Router 2376a5de-876f-4295-bee4-f95526e6331c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:58:35.231838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Pushing event deleted for resources: {'Port': ['ID=088ea98c-12cd-4d33-ae1a-65da3f7daaf5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:35.313397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:35.319568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478885b6-fad7-486f-a88b-77011a028b07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79e41347-e7d6-4efe-ac1b-676b48239c92,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:35.329647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-478885b6-fad7-486f-a88b-77011a028b07 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=63a0004f6d514b1fb0ef22d0649eac22&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7181637 Dec 21 03:58:35.330948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36070) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:35.344302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] Sync routers for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:35.369919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:35.370549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:35.423769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.425852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] No DVR routers for this DVR port 3a3dc231-a27a-4c00-a859-1a62de02e991 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:35.430477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.433875 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9ff413b5-767b-4cec-9874-9ccdeb6a4c7d req-c48b7401-cf99-495d-892e-58738fc90b04 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.54 "DELETE /v2.0/ports/3a3dc231-a27a-4c00-a859-1a62de02e991 HTTP/1.1" status: 204 len: 173 time: 1.9606485 Dec 21 03:58:35.578071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:35.616702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.634428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.670771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4dfee1e-34a9-4de5-86f2-7eb89bf9ab15 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.682732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:35.688783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:35.693002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:35.741696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Port': ['ID=c7f9878e-7d37-471e-9152-1cd861380bb0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:35.777573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.785420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.791293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.797415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.804209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.815064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.821954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:35.824185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-8d421590-a1b9-4854-8bd7-f9f04cd214e4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.2838907 Dec 21 03:58:35.857917 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4dfee1e-34a9-4de5-86f2-7eb89bf9ab15 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:35.954265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:35.990612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] Checking router: 2376a5de-876f-4295-bee4-f95526e6331c for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:58:36.000769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:36.004549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:36.011888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09f54372-4268-46f5-84d1-67e6b46ad897 req-9275d8af-af70-460d-b23e-30808f7db4d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1746638 Dec 21 03:58:36.013908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36084) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:36.128795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.145511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4dfee1e-34a9-4de5-86f2-7eb89bf9ab15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.152283 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4dfee1e-34a9-4de5-86f2-7eb89bf9ab15 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.157981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f4dfee1e-34a9-4de5-86f2-7eb89bf9ab15 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/79e41347-e7d6-4efe-ac1b-676b48239c92 HTTP/1.1" status: 204 len: 168 time: 0.8246870 Dec 21 03:58:36.337250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76d5ebdd-5429-41fc-915d-11365120f6b7 req-cb13fcb2-db7a-4fd2-8c9f-7f490c9d594e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.2401149 Dec 21 03:58:36.353038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:36.369990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b28c2376-5dde-45e3-b6b0-a1664daf59cb tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Request body: {'quota': {'network': 2}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:36.373606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:58:36.377553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4dfee1e-34a9-4de5-86f2-7eb89bf9ab15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79e41347-e7d6-4efe-ac1b-676b48239c92,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:36.394895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.516401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b28c2376-5dde-45e3-b6b0-a1664daf59cb tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "PUT /v2.0/quotas/07ab94f0d59b4d7e93b7b356f9dd35de HTTP/1.1" status: 200 len: 368 time: 0.5011673 Dec 21 03:58:36.517025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36090) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:36.526491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Request body: {'network': {'project_id': '07ab94f0d59b4d7e93b7b356f9dd35de'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:36.553652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:36.564307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-32567eb7-409a-4243-832b-b5bc3bbf28f1 admin admin] 10.222.0.18 "PUT /v2.0/routers/4a95ea4a-ece9-4a91-8ca0-6054160833e8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3670387 Dec 21 03:58:36.564307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36092) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:36.564596 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] Sync routers for ids ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:36.576580 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] Routers {'4a95ea4a-ece9-4a91-8ca0-6054160833e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:36.577482 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:36.631702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:36.661674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Router 8785d013-857f-420e-9b74-3a2a5aefc534 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:58:36.667057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e71eedc-7dfb-4cb6-ac19-f0342fbcd18d None None] The sync data for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 is: [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:47:18Z', 'revision_number': 4, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '97ca28df-516e-42ca-a7be-46ce5c12dab9', 'name': '', 'network_id': '04ed2fa2-4e59-410d-9778-4535a349c6b9', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'mac_address': 'fa:16:3e:92:30:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_interface', 'standard_attr_id': 651, 'fixed_ips': [{'subnet_id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:17Z', 'updated_at': '2021-12-21T03:47:27Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'subnets': [{'id': 'c714b82d-d957-4fc4-96b0-f175d6a234f5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:58:36.716196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.718602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Made reservation on behalf of 07ab94f0d59b4d7e93b7b356f9dd35de for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:36.721122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.759311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.764422 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] Set router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:36.862795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:36.874801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Sync routers for ids ['8785d013-857f-420e-9b74-3a2a5aefc534'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:36.893418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Routers {'8785d013-857f-420e-9b74-3a2a5aefc534'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:36.897112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8785d013-857f-420e-9b74-3a2a5aefc534'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:36.932355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:36.997543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.004544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.004858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5daad6b4-daa0-4ac3-9711-4a1691da84f4 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 3.5210812 Dec 21 03:58:37.004858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:37.022036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:37.025286 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52136443-c017-49c7-ac4b-37aa26082423" -d '{"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:37.111075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.148943 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8995238-4a0e-421d-9f74-98db1d237cab x-openstack-request-id: req-e8995238-4a0e-421d-9f74-98db1d237cab {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:37.150437 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c0b3364-e5b1-4cb8-be4f-793e764450ca", "name": "network-vif-deleted", "tag": "3a3dc231-a27a-4c00-a859-1a62de02e991", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:37.150719 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e8995238-4a0e-421d-9f74-98db1d237cab {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:37.151358 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c0b3364-e5b1-4cb8-be4f-793e764450ca', 'name': 'network-vif-deleted', 'tag': '3a3dc231-a27a-4c00-a859-1a62de02e991', 'status': 'completed', 'code': 200} Dec 21 03:58:37.158417 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56'}], 'enable_snat': True}, 'gw_port_id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:58:34Z', 'revision_number': 5, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port': {'id': '760d1620-100f-4e39-9b47-360f0f3306ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:96:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1436, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.56', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:35Z', 'updated_at': '2021-12-21T03:56:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:37.163227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Set router 8785d013-857f-420e-9b74-3a2a5aefc534 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:37.202712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9883bbcf-251e-458d-aa32-3694f7546222,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:37.210522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36104) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:37.229642 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb69312f-3ee6-4903-a94d-6eb6eca66157 None None] New status for floating IP 7b75aeab-4063-4bcf-904d-54f363b49069: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:58:37.232240 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] Checking router: 4a95ea4a-ece9-4a91-8ca0-6054160833e8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:58:37.254023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:37.256418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ccbf328d-baa5-4180-a512-fd5266f97467 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.263562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.292172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Deleting port 760d1620-100f-4e39-9b47-360f0f3306ff {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:37.293081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.303879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.308031 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Added segment c8be150e-dfba-4282-a537-1df9b1640abe of type vlan for network 059d7466-decd-40d7-88b2-81b2da2d9720 Dec 21 03:58:37.340541 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] Routers {'4a95ea4a-ece9-4a91-8ca0-6054160833e8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:37.340999 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:37.358891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.376971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.384545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.392155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.399808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.404658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.406381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.414825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.416850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-d83040af-f759-4992-808f-455f0e1a6683 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.2336986 Dec 21 03:58:37.495042 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] Set router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:37.530863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Deleting port c7f9878e-7d37-471e-9152-1cd861380bb0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:37.533256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.544260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c2a1d87-bffa-4401-95d1-05b0ed0ae029 req-acb0b682-4192-4917-9e77-d2aeb11954aa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0567772 Dec 21 03:58:37.547335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.569378 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:58:36Z', 'revision_number': 6, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:37.621522 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-497d0658-985d-482f-890c-b54ef1306b6f None None] The sync data for ids ['4a95ea4a-ece9-4a91-8ca0-6054160833e8'] in n-d-822053-11 is: [{'id': '4a95ea4a-ece9-4a91-8ca0-6054160833e8', 'name': 'tempest-AttachSCSIVolumeTestJSON-731961382-router', 'tenant_id': '7d3d7b72cbb3443392bc9a612c74511c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:33Z', 'updated_at': '2021-12-21T03:58:36Z', 'revision_number': 6, 'project_id': '7d3d7b72cbb3443392bc9a612c74511c', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:58:37.634816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8785d013-857f-420e-9b74-3a2a5aefc534', 'name': '', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f', 'external_fixed_ips': [{'subnet_id': 'c832c73d-cc9e-46ff-b517-4b217d53b5a5', 'ip_address': '2001:db8::2b1'}], 'enable_snat': True}, 'gw_port_id': 'c7f9878e-7d37-471e-9152-1cd861380bb0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:33Z', 'updated_at': '2021-12-21T03:58:35Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': 'c7f9878e-7d37-471e-9152-1cd861380bb0', 'name': '', 'network_id': '9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:e5:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8785d013-857f-420e-9b74-3a2a5aefc534', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': 'c832c73d-cc9e-46ff-b517-4b217d53b5a5', 'ip_address': '2001:db8::2b1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:34Z', 'updated_at': '2021-12-21T03:58:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'c832c73d-cc9e-46ff-b517-4b217d53b5a5', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:37.643211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] For port 760d1620-100f-4e39-9b47-360f0f3306ff, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=760d1620-100f-4e39-9b47-360f0f3306ff,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:37.644238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.664199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Calling delete_port for 760d1620-100f-4e39-9b47-360f0f3306ff owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:37.679586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Checking router: 8785d013-857f-420e-9b74-3a2a5aefc534 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:58:37.679890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Updating router 8785d013-857f-420e-9b74-3a2a5aefc534 port c7f9878e-7d37-471e-9152-1cd861380bb0 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:58:37.706911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.715328 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.740675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Calling delete_port for c7f9878e-7d37-471e-9152-1cd861380bb0 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:37.769940 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.774539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:37.774539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.813089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b0592c6-8cfb-4eeb-a8b9-16fd8b0a6bf5 req-cb1f2a7d-6938-436b-8233-1d587edfcdb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3824615 Dec 21 03:58:37.849604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ccbf328d-baa5-4180-a512-fd5266f97467 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.902795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Pushing event updated for resources: {'Network': ['ID=059d7466-decd-40d7-88b2-81b2da2d9720,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:37.921661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 059d7466-decd-40d7-88b2-81b2da2d9720 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:37.964544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ccbf328d-baa5-4180-a512-fd5266f97467 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:37.993155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.016016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccbf328d-baa5-4180-a512-fd5266f97467 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c926a89d-7476-4755-ba7e-35b9ffbe5287,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:38.047357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-74e24701-2fde-4bb9-8085-ce0221c3c499 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.5242684 Dec 21 03:58:38.054980 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 03:58:38.059045 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 03:58:38.073693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:38.085372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Request body: {'network': {'project_id': '07ab94f0d59b4d7e93b7b356f9dd35de'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:38.092915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event deleted for resources: {'Port': ['ID=c7f9878e-7d37-471e-9152-1cd861380bb0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:38.133469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.138492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ccbf328d-baa5-4180-a512-fd5266f97467 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=79902c19cbda42a3bf30400847e81fd4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9254611 Dec 21 03:58:38.138807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36112) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:38.229485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.231849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.236390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0170935f-324d-4877-8e0b-2e6a0358b9fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.249053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Made reservation on behalf of 07ab94f0d59b4d7e93b7b356f9dd35de for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:38.258053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.278780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0170935f-324d-4877-8e0b-2e6a0358b9fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.295207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:38.321317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.321672 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Added segment 1debd554-e98f-41b5-9d3a-96b9bfd338a6 of type vlan for network 10312186-9529-4ae9-8383-43d35cee715e Dec 21 03:58:38.330809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.369906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.370467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 8785d013-857f-420e-9b74-3a2a5aefc534 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:58:38.375249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.379356 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d824f77d-a345-4e46-b385-0baa8f38afcd tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/routers/8785d013-857f-420e-9b74-3a2a5aefc534 HTTP/1.1" status: 204 len: 168 time: 1.3736761 Dec 21 03:58:38.381874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:38.387713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Pushing event deleted for resources: {'Port': ['ID=760d1620-100f-4e39-9b47-360f0f3306ff,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:38.405491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ba4b9af-5f39-4719-877e-5c08a26fbf84 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:38.430543 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.465884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Deleting subnet c832c73d-cc9e-46ff-b517-4b217d53b5a5 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:58:38.473804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.488505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.528253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.552084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 760d1620-100f-4e39-9b47-360f0f3306ff no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:38.578826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 760d1620-100f-4e39-9b47-360f0f3306ff {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:58:38.579337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 760d1620-100f-4e39-9b47-360f0f3306ff not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:38.580066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:38.585687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.597379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.597379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.650574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Port c7f9878e-7d37-471e-9152-1cd861380bb0 not found while updating agent binding for router 8785d013-857f-420e-9b74-3a2a5aefc534. {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Dec 21 03:58:38.657784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:58:38.662358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 088ea98c-12cd-4d33-ae1a-65da3f7daaf5 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:38.673166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Routers set() bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:38.676083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Router IDs set() for agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 21 03:58:38.677530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_agentschedulers_db [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'8785d013-857f-420e-9b74-3a2a5aefc534'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent'). {{(pid=110312) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 21 03:58:38.679445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3045b82f-0300-4033-ad0a-f051d51f95f7 None None] The sync data for ids ['8785d013-857f-420e-9b74-3a2a5aefc534'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:58:38.683503 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.688455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:38.688455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.688455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0170935f-324d-4877-8e0b-2e6a0358b9fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.690814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0170935f-324d-4877-8e0b-2e6a0358b9fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.694281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0170935f-324d-4877-8e0b-2e6a0358b9fb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c926a89d-7476-4755-ba7e-35b9ffbe5287 HTTP/1.1" status: 204 len: 168 time: 0.5513239 Dec 21 03:58:38.754109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-287667dc-8175-4b53-b00d-dc871f21811a req-36c5972c-c4f7-490c-96bd-a3c290ff8f3f tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0541072 Dec 21 03:58:38.756601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0170935f-324d-4877-8e0b-2e6a0358b9fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c926a89d-7476-4755-ba7e-35b9ffbe5287,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:38.789678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.790251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4a95ea4a-ece9-4a91-8ca0-6054160833e8 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:58:38.795804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.796997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e9b86710-65df-4dc1-8d9a-546b61f8e9a0 admin admin] 10.222.0.18 "DELETE /v2.0/routers/4a95ea4a-ece9-4a91-8ca0-6054160833e8 HTTP/1.1" status: 204 len: 168 time: 2.2323611 Dec 21 03:58:38.799586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36120) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:38.801261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Pushing event updated for resources: {'Network': ['ID=10312186-9529-4ae9-8383-43d35cee715e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:38.826851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 10312186-9529-4ae9-8383-43d35cee715e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:38.862016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-096f1b5b-f032-4ee2-8790-3eff5906dcd2 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.7816992 Dec 21 03:58:38.866735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:38.872951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4744031a-5897-43fe-b32b-168fa29688a4 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Request body: {'network': {'project_id': '07ab94f0d59b4d7e93b7b356f9dd35de'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:38.874364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.900206 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-4744031a-5897-43fe-b32b-168fa29688a4 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Dec 21 03:58:38.900881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4744031a-5897-43fe-b32b-168fa29688a4 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:58:38.907351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4744031a-5897-43fe-b32b-168fa29688a4 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.0408609 Dec 21 03:58:38.908935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36126) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:38.970179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=c832c73d-cc9e-46ff-b517-4b217d53b5a5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:38.978239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:38.984374 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e625da94-3581-4376-b325-1414e3ef2a1e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/subnets/c832c73d-cc9e-46ff-b517-4b217d53b5a5 HTTP/1.1" status: 204 len: 168 time: 0.6014233 Dec 21 03:58:38.985394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:39.016886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Deleting subnet cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:58:39.028477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.050476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a3493cb1-af96-406d-b534-c817f34ce5fd tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=07ab94f0d59b4d7e93b7b356f9dd35de&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1395493 Dec 21 03:58:39.061746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36130) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:39.118610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.124667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.130166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.131268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.137546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.140722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.143485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.150381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.156763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:39.158979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-da33c9fd-d7d3-42c3-a265-06f513cca78a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.2042542 Dec 21 03:58:39.197840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8fb7308-0f5f-4952-9713-0d7ce1a87d55 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.236768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8fb7308-0f5f-4952-9713-0d7ce1a87d55 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.294084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4fbd696-1085-4b20-820f-7e30545f7909 req-ddca2a73-b635-4c6a-883d-bad91aac20ed tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1246054 Dec 21 03:58:39.381519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8fb7308-0f5f-4952-9713-0d7ce1a87d55 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.384129 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8fb7308-0f5f-4952-9713-0d7ce1a87d55 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.389445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8fb7308-0f5f-4952-9713-0d7ce1a87d55 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "DELETE /v2.0/security-groups/9883bbcf-251e-458d-aa32-3694f7546222 HTTP/1.1" status: 204 len: 168 time: 0.3216426 Dec 21 03:58:39.389445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:39.402124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8fb7308-0f5f-4952-9713-0d7ce1a87d55 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9883bbcf-251e-458d-aa32-3694f7546222,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:39.622223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.669438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:39.678636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.702322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a20f658d-1a94-4037-977b-48b806750d2b') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:39.702563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a20f658d-1a94-4037-977b-48b806750d2b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:39.720100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.742329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.749633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:39.750037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:39.751907 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:39.874736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.901765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.932938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.936055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:39.938498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.941749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-edec8bbb-4185-4900-beb1-04b2543fadb7 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/cfc50ccd-fbd7-49e9-90ce-54c74edd4a7a HTTP/1.1" status: 204 len: 168 time: 1.1402519 Dec 21 03:58:39.945919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:39.947950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddab76c6-eb62-4499-9e9f-2b0c365a0869 req-451b69cc-99d0-41e9-8d67-32f1e320067e tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0441666 Dec 21 03:58:39.950747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-473664d8-29b7-4862-bf54-eecd9a6955bf None None] Network 21911ef5-8ca7-4129-bc39-61ca0f42e46e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:39.975867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 03:58:39.977789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event deleted for resources: {'Network': ['ID=9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:39.979754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:39.983117 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-029b772c-227e-41bf-af9b-27d6bdb05fb8 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/networks/9edd7c07-3cb0-43b8-b49d-f6a0ee614c1f HTTP/1.1" status: 204 len: 168 time: 0.9966431 Dec 21 03:58:40.033118 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.093677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['10312186-9529-4ae9-8383-43d35cee715e']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:40.108425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1debd554-e98f-41b5-9d3a-96b9bfd338a6') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:40.108728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1debd554-e98f-41b5-9d3a-96b9bfd338a6') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:40.112616 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.124227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.163788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.252516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] DHCP port deletion for 21911ef5-8ca7-4129-bc39-61ca0f42e46e request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:40.255969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:40.256382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:40.277290 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:40.353635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Deleting port 60c5cd47-4d47-4015-8362-00f246c0c3e6 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:40.353981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.389538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] Deleting port 60c5cd47-4d47-4015-8362-00f246c0c3e6 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:40.390190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.472608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.492772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.498570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "DELETE /v2.0/networks/10312186-9529-4ae9-8383-43d35cee715e HTTP/1.1" status: 204 len: 168 time: 1.1068125 Dec 21 03:58:40.499063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36172) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:40.527259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] For port 60c5cd47-4d47-4015-8362-00f246c0c3e6, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=60c5cd47-4d47-4015-8362-00f246c0c3e6,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:40.527259 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.539880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] Calling delete_port for 60c5cd47-4d47-4015-8362-00f246c0c3e6 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:40.594271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efdba739-532b-4be4-8099-e472a3410145 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Pushing event deleted for resources: {'Network': ['ID=10312186-9529-4ae9-8383-43d35cee715e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:40.625613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] For port 60c5cd47-4d47-4015-8362-00f246c0c3e6, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=60c5cd47-4d47-4015-8362-00f246c0c3e6,segment=NetworkSegment(107d90a9-660d-4174-a56c-6bd9f4371d67),segment_id=107d90a9-660d-4174-a56c-6bd9f4371d67)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:40.626403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.649037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Calling delete_port for 60c5cd47-4d47-4015-8362-00f246c0c3e6 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:40.666349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.672469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.674375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36176) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:40.677487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.679458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'name': 'tempest-router--947316766', 'project_id': 'a24591ea7d2b4fa1a42b9226e4ab5729'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:40.684534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.691568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.698611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.705301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.712369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:40.720732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-cdb1a447-ceed-4312-a386-bc9554dc7a1b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.2402594 Dec 21 03:58:40.742658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.786005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] No DVR routers for this DVR port 60c5cd47-4d47-4015-8362-00f246c0c3e6 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:40.793780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b688b0a-0173-490b-8675-8efc16fa0499 None None] Pushing event deleted for resources: {'Port': ['ID=60c5cd47-4d47-4015-8362-00f246c0c3e6,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:40.815127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.836032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.837256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.843921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['059d7466-decd-40d7-88b2-81b2da2d9720']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:40.855474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c8be150e-dfba-4282-a537-1df9b1640abe') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:40.855918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c8be150e-dfba-4282-a537-1df9b1640abe') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:40.863175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1561d1b9-2e8a-4df8-9960-e46eedecdb85 req-c18fc45e-4c1f-4330-9ac1-d5a76f028b09 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1408343 Dec 21 03:58:40.871057 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.879874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.923417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.928692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Pushing event deleted for resources: {'Port': ['ID=60c5cd47-4d47-4015-8362-00f246c0c3e6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:40.929661 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.935584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:40.936056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:40.938089 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:40.941100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] No DVR routers for this DVR port 60c5cd47-4d47-4015-8362-00f246c0c3e6 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:58:41.020013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.030257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.059570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['21911ef5-8ca7-4129-bc39-61ca0f42e46e']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:41.083670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02050411-e4e6-4909-8a2c-4796bf825619 req-39e815d9-8038-4503-b48c-d1caa6758c39 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0347593 Dec 21 03:58:41.086316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '107d90a9-660d-4174-a56c-6bd9f4371d67') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:41.086316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '107d90a9-660d-4174-a56c-6bd9f4371d67') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:41.095627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.110602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.110885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.116814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.118647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:58:41.121173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.122026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] 10.222.0.18 "DELETE /v2.0/networks/059d7466-decd-40d7-88b2-81b2da2d9720 HTTP/1.1" status: 204 len: 168 time: 0.6198518 Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:58:41.122129 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:58:41.135677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b449c292-2103-41b1-a1b9-494ef55a02d7 tempest-QuotasNegativeTest-1533015659 tempest-QuotasNegativeTest-1533015659-project-admin] Pushing event deleted for resources: {'Network': ['ID=059d7466-decd-40d7-88b2-81b2da2d9720,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:41.144690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.151401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10819422-630d-4b49-9d97-995bbfff0fee tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.4736392 Dec 21 03:58:41.153906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36188) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:41.282432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.401590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.441701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.444790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] 10.222.0.18 "DELETE /v2.0/networks/21911ef5-8ca7-4129-bc39-61ca0f42e46e HTTP/1.1" status: 204 len: 168 time: 1.4959469 Dec 21 03:58:41.482745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e277b702-cc5b-4815-a3fd-fa5056ea38af admin admin] Pushing event deleted for resources: {'Network': ['ID=21911ef5-8ca7-4129-bc39-61ca0f42e46e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:41.488025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.490259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.600439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.601943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 3a562d22-03fd-4b0d-a2fa-eec907477580 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:58:41.614309 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:41.616324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eaf96846-b430-4479-a757-c9a923e4e22f tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/routers/3a562d22-03fd-4b0d-a2fa-eec907477580 HTTP/1.1" status: 204 len: 168 time: 0.4611354 Dec 21 03:58:41.862837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:41.909684 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f350aa4d-9332-4d9c-8e3b-17971f21fd9c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c5b2145a02404e39a8488c84d609fc52&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0450499 Dec 21 03:58:41.912458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36210) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:42.025873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae06ad6d-a8f6-48c9-923e-57a323cec6eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.073452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae06ad6d-a8f6-48c9-923e-57a323cec6eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.096536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.103372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.109618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.118401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.124683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.131285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.137869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:42.141800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-e2573705-65a8-454a-93e5-07b45a6cc4c8 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5427 time: 0.1287627 Dec 21 03:58:42.242628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36220) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:42.250597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c204c117-523f-49b5-9420-dc05e685d6de details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:42.279552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6a53ded-a6c1-4971-804a-ebe8a497670d req-f196a5c6-9c29-45fb-af36-ca7a5118ee6a tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0724907 Dec 21 03:58:42.327916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3e42c4-bad8-4ea4-9b75-682aad6e741d req-788e18d6-5a7a-4d69-af8d-6aa493015250 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1780977 Dec 21 03:58:42.332774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36224) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:42.346284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 60c5cd47-4d47-4015-8362-00f246c0c3e6 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:58:42.373620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 60c5cd47-4d47-4015-8362-00f246c0c3e6 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:58:42.373975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 60c5cd47-4d47-4015-8362-00f246c0c3e6 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:58:42.391283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c204c117-523f-49b5-9420-dc05e685d6de,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:42.409594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'c204c117-523f-49b5-9420-dc05e685d6de', 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439', 'port_id': 'c204c117-523f-49b5-9420-dc05e685d6de', 'mac_address': 'fa:16:3e:96:53:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73b86b05-b093-4acf-bae3-cf60f26838b3', 'ip_address': '10.2.2.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:42.426807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae06ad6d-a8f6-48c9-923e-57a323cec6eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.429741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae06ad6d-a8f6-48c9-923e-57a323cec6eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.433938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ae06ad6d-a8f6-48c9-923e-57a323cec6eb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d85886a8-64d0-487b-9d1a-304a22c93857 HTTP/1.1" status: 204 len: 168 time: 0.5203602 Dec 21 03:58:42.450788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.453577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae06ad6d-a8f6-48c9-923e-57a323cec6eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d85886a8-64d0-487b-9d1a-304a22c93857,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:42.471591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c204c117-523f-49b5-9420-dc05e685d6de {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:42.502303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c204c117-523f-49b5-9420-dc05e685d6de,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:42.567090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-72c1c888-0f9a-47a9-bbcf-67afae4d5ab5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.571416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.575124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f21e2d88-8221-4926-95ac-3ed4e081cd85 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:42.596639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-2089943455', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:42.698875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:42.708811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-72c1c888-0f9a-47a9-bbcf-67afae4d5ab5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.732202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'f21e2d88-8221-4926-95ac-3ed4e081cd85', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'port_id': 'f21e2d88-8221-4926-95ac-3ed4e081cd85', 'mac_address': 'fa:16:3e:28:6f:6a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce', 'ip_address': '10.1.1.56'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:42.785505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:42.793299 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.802646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-72c1c888-0f9a-47a9-bbcf-67afae4d5ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.812546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f21e2d88-8221-4926-95ac-3ed4e081cd85 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:42.832660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:42.841569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-72c1c888-0f9a-47a9-bbcf-67afae4d5ab5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2017a2ed9b7945df8819e069578fc3f3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5976923 Dec 21 03:58:42.842544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72c1c888-0f9a-47a9-bbcf-67afae4d5ab5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e477ce2b-7e12-4ecb-bad4-2789e5bbc05d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:42.844329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36236) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:42.865510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.866779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.902515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3b9c3a6-7bbf-4823-bc4f-8716e12bc9be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.931278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3b9c3a6-7bbf-4823-bc4f-8716e12bc9be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.936079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.964143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:42.964938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 29c72524-1fd4-42e5-a743-56e89cdcd6eb details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:43.043676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:43.046214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:43.058819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '29c72524-1fd4-42e5-a743-56e89cdcd6eb', 'network_id': '42bfeccc-af8e-4aab-801c-72e8e8caa439', 'port_id': '29c72524-1fd4-42e5-a743-56e89cdcd6eb', 'mac_address': 'fa:16:3e:c0:87:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73b86b05-b093-4acf-bae3-cf60f26838b3', 'ip_address': '10.2.2.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:43.084406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3b9c3a6-7bbf-4823-bc4f-8716e12bc9be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.087578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3b9c3a6-7bbf-4823-bc4f-8716e12bc9be admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.089545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3b9c3a6-7bbf-4823-bc4f-8716e12bc9be admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e477ce2b-7e12-4ecb-bad4-2789e5bbc05d HTTP/1.1" status: 204 len: 168 time: 0.2435412 Dec 21 03:58:43.100198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b9c3a6-7bbf-4823-bc4f-8716e12bc9be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e477ce2b-7e12-4ecb-bad4-2789e5bbc05d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:43.100909 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.126633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 29c72524-1fd4-42e5-a743-56e89cdcd6eb {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:43.148781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:43.194890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.199189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.200110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf55164f-f3e6-47de-9335-4f151942a1c5 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:43.284733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf55164f-f3e6-47de-9335-4f151942a1c5,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:43.292045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=29c72524-1fd4-42e5-a743-56e89cdcd6eb,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:43.299576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'bf55164f-f3e6-47de-9335-4f151942a1c5', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'port_id': 'bf55164f-f3e6-47de-9335-4f151942a1c5', 'mac_address': 'fa:16:3e:8b:df:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce', 'ip_address': '10.1.1.83'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:43.339361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.364140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf55164f-f3e6-47de-9335-4f151942a1c5 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:43.387555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36248) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:43.436010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf55164f-f3e6-47de-9335-4f151942a1c5,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:43.466059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0cb5a14e-c87d-457a-b740-f5cc89e363b0 req-af42edc8-fe32-4b93-98e1-24650a8ad6aa tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0532014 Dec 21 03:58:43.468872 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fed7dd10-2761-4efa-aed7-b50dcbb91760 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7d3d7b72cbb3443392bc9a612c74511c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0795856 Dec 21 03:58:43.471309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36250) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:43.496399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.497191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c52f2e0e-5f59-462b-97c5-d88f03894186 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:43.552639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36252) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:43.571345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b4838b3-eec5-4a17-bd54-c2c70279ab0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.611572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b4838b3-eec5-4a17-bd54-c2c70279ab0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.627151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:43.687038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c52f2e0e-5f59-462b-97c5-d88f03894186,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:43.694650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.700206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'c52f2e0e-5f59-462b-97c5-d88f03894186', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'port_id': 'c52f2e0e-5f59-462b-97c5-d88f03894186', 'mac_address': 'fa:16:3e:9c:3f:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce', 'ip_address': '10.1.1.54'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:43.721029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.730458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.739296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.747201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.748955 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.754964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.758016 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efd535f9-b5f3-4982-b4f4-812b8a078b31 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.761741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.770108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:43.772047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b4838b3-eec5-4a17-bd54-c2c70279ab0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.774849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b4838b3-eec5-4a17-bd54-c2c70279ab0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.776148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3edc4c97-3738-4caa-86da-280b937cfead req-7c34f51e-b358-457b-9afa-c240921474cf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5430 time: 0.3021924 Dec 21 03:58:43.783134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c52f2e0e-5f59-462b-97c5-d88f03894186 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:43.783312 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b4838b3-eec5-4a17-bd54-c2c70279ab0b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c461f6e9-47f2-428e-90e1-50631f1d7179 HTTP/1.1" status: 204 len: 168 time: 0.3051164 Dec 21 03:58:43.804297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4838b3-eec5-4a17-bd54-c2c70279ab0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c461f6e9-47f2-428e-90e1-50631f1d7179,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:43.815102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c52f2e0e-5f59-462b-97c5-d88f03894186,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:43.828231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.890152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.891031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1626b9fe-82dc-4958-a0d0-4436a98fe01f details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:43.896288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efd535f9-b5f3-4982-b4f4-812b8a078b31 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.959724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3edc4c97-3738-4caa-86da-280b937cfead req-827ae1a1-2adb-4ebd-8f2a-a25df767d14e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1353114 Dec 21 03:58:43.976294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efd535f9-b5f3-4982-b4f4-812b8a078b31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:43.998044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36264) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:44.020671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e23fa3f-ba8d-4e96-8f9f-b062b9525812 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.063048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Allocated IP 172.25.5.53 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/e0e2b465-fc29-447b-9d80-3c54f4f93dd1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:44.074557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efd535f9-b5f3-4982-b4f4-812b8a078b31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cb53361-e83a-4f08-91e8-2329409310b5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.095144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-efd535f9-b5f3-4982-b4f4-812b8a078b31 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f11424962b9247fda1ba57a1d8e63f86&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5409086 Dec 21 03:58:44.098185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:44.142231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.165078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:44.181118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'port_id': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'mac_address': 'fa:16:3e:77:8d:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 131, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:44.197871 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3abee53-dd17-4ed9-916e-2fad89bc29c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.247769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3abee53-dd17-4ed9-916e-2fad89bc29c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.271057 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e23fa3f-ba8d-4e96-8f9f-b062b9525812 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.274966 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.286602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-fdca742a-fd9d-4245-9c82-96feca69d276 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.5864580 Dec 21 03:58:44.298895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1626b9fe-82dc-4958-a0d0-4436a98fe01f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:44.303479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.346177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:44.352495 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e23fa3f-ba8d-4e96-8f9f-b062b9525812 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.408811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2e23fa3f-ba8d-4e96-8f9f-b062b9525812 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a4fdd99694004fdb9d4710fd658dd78b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4030108 Dec 21 03:58:44.409148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36274) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:44.416878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3abee53-dd17-4ed9-916e-2fad89bc29c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.419406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3abee53-dd17-4ed9-916e-2fad89bc29c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.420493 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3abee53-dd17-4ed9-916e-2fad89bc29c6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8cb53361-e83a-4f08-91e8-2329409310b5 HTTP/1.1" status: 204 len: 168 time: 0.3213956 Dec 21 03:58:44.422276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e23fa3f-ba8d-4e96-8f9f-b062b9525812 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=518a47fc-085b-4904-a7c0-f6cc36c9a4e7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.444260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.445392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:58:44.461912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3abee53-dd17-4ed9-916e-2fad89bc29c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cb53361-e83a-4f08-91e8-2329409310b5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.464379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.557153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41f557d4-7a7d-4d7c-ad32-277121b8ad06 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.561821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event updated for resources: {'Port': ['ID=e0e2b465-fc29-447b-9d80-3c54f4f93dd1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.583828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-7267b6f3-3dda-450d-8856-81729f521a37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:44.586248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41f557d4-7a7d-4d7c-ad32-277121b8ad06 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.590623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-7267b6f3-3dda-450d-8856-81729f521a37 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1097 time: 0.2013233 Dec 21 03:58:44.603701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:44.604871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:44.608210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:44.629156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.660953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-442246fc-53e1-4a3e-b9a3-a9fca3b97a1e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:44.667356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:44.693350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74d6706e-b35f-4e89-92c5-03d19371b173 req-bdea29d5-f1d1-4187-a954-462ca3b07b44 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0813684 Dec 21 03:58:44.703957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7', 'network_id': '8d559823-2509-427a-8bd4-77cf5a81095a', 'port_id': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7', 'mac_address': 'fa:16:3e:e5:a6:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '966929b7-7c93-4802-a83d-62484be430ce', 'ip_address': '10.1.1.84'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:58:44.771231 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.778385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-024e2907-ce24-4e26-b384-9637c2a0cfb7 None None] Provisioning complete for port e0e2b465-fc29-447b-9d80-3c54f4f93dd1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:44.779097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-024e2907-ce24-4e26-b384-9637c2a0cfb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.785652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41f557d4-7a7d-4d7c-ad32-277121b8ad06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.788890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41f557d4-7a7d-4d7c-ad32-277121b8ad06 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:44.793640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-41f557d4-7a7d-4d7c-ad32-277121b8ad06 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/518a47fc-085b-4904-a7c0-f6cc36c9a4e7 HTTP/1.1" status: 204 len: 168 time: 0.3799047 Dec 21 03:58:44.809874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41f557d4-7a7d-4d7c-ad32-277121b8ad06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=518a47fc-085b-4904-a7c0-f6cc36c9a4e7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:44.846872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-024e2907-ce24-4e26-b384-9637c2a0cfb7 None None] Port e0e2b465-fc29-447b-9d80-3c54f4f93dd1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:44.883491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:44.917052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:44.923689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-fdbb8dd5-9869-4b19-b136-ed30e51b068e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:44.925898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-fdbb8dd5-9869-4b19-b136-ed30e51b068e service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.2502136 Dec 21 03:58:44.981645 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:45.038336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-d2ffb765-7102-4e84-b3fb-4951597cddd2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 1001 time: 0.0962939 Dec 21 03:58:45.067187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:45.217788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-b00fe4a1-45e5-44bd-b5bd-397c8797f0e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.219217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-b00fe4a1-45e5-44bd-b5bd-397c8797f0e0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.1672995 Dec 21 03:58:45.353484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.362031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.369545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.376799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.384018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.390301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.397067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.399090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-ab2286cb-2b2f-43dd-b70a-626d6a795241 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5434 time: 0.2993443 Dec 21 03:58:45.425246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-add92974-6d87-41f2-a5df-96d015ae991a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:45.426687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-add92974-6d87-41f2-a5df-96d015ae991a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1917982 Dec 21 03:58:45.433551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:45.877222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['f21e2d88-8221-4926-95ac-3ed4e081cd85'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:45.935447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['bf55164f-f3e6-47de-9335-4f151942a1c5'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:45.938335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca6e957b-0891-461f-a4b0-2bfded330753 req-2c24d9e3-399a-478c-8040-602eacbd7245 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.1183379 Dec 21 03:58:45.968778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['c52f2e0e-5f59-462b-97c5-d88f03894186'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:45.973091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['29c72524-1fd4-42e5-a743-56e89cdcd6eb'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:45.989407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['1626b9fe-82dc-4958-a0d0-4436a98fe01f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:46.020024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-235fa88d-0a38-4f7e-9c1b-789ed083970f req-d6d25bab-95b8-4de4-96da-b7bb63ac8976 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.6076648 Dec 21 03:58:46.062234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-4b9a44e7-0544-4d0c-8624-fbe24b2b4d50 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6209977 Dec 21 03:58:46.227144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['3f68184f-d3c6-4097-8eb2-ecb1bd1713b7'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:46.408444 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:46.523069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6446bdf-57be-46cb-93ec-ccfced17bf7d req-dc878a3d-db1c-4464-ba45-3e0869750c58 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4455333 Dec 21 03:58:46.574614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-e330675c-b62f-4ff7-b40c-62545d121a01 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=029528ffc12a421282c1eeef88e2b8bd&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0348730 Dec 21 03:58:46.795225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['c204c117-523f-49b5-9420-dc05e685d6de'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:58:46.845756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36362) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:46.939774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-cb9d9c5e-791e-4d38-b00c-b5c13148a7b2 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:46.941637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-cb9d9c5e-791e-4d38-b00c-b5c13148a7b2 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3058228 Dec 21 03:58:46.967560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-d92e40fd-0b72-46d4-85d1-1c84d9bef238 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/quotas/029528ffc12a421282c1eeef88e2b8bd HTTP/1.1" status: 200 len: 375 time: 0.0200472 Dec 21 03:58:46.993411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Router 5b75e0b5-0642-45bc-a34d-732b7786b43c is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:58:47.045815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d3ca4b54-25a9-4f8f-856b-468add430c04 tempest-AgentManagementNegativeTest-1367435725 tempest-AgentManagementNegativeTest-1367435725-project] 10.222.0.18 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.1950638 Dec 21 03:58:47.053505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-a7c693ba-d3d6-48f4-8e52-f02426c6c1f4 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=029528ffc12a421282c1eeef88e2b8bd&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0797083 Dec 21 03:58:47.217428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb39bcbf-4474-401a-92ee-9eeeb385a0a3 req-6a143eec-d3fd-4e57-b0a9-3fe5ea99069c tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0712419 Dec 21 03:58:47.294499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:47.306068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] Sync routers for ids ['5b75e0b5-0642-45bc-a34d-732b7786b43c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:47.345267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] Routers {'5b75e0b5-0642-45bc-a34d-732b7786b43c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:47.346106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5b75e0b5-0642-45bc-a34d-732b7786b43c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:47.412029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:47.422908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] Routers {'5b75e0b5-0642-45bc-a34d-732b7786b43c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:47.423561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5b75e0b5-0642-45bc-a34d-732b7786b43c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:47.429365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.435365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.441970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.458357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:47.458987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-109f1d09-c353-4bf0-aa9f-93792a0e2522 None None] The sync data for ids ['5b75e0b5-0642-45bc-a34d-732b7786b43c'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:58:47.461987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.469745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.477329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.483851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:47.485882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a525190b-f2a1-476e-b423-24f4f48f810b req-4772f777-d348-4591-9fbd-9af7c95866ac tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5434 time: 0.1459031 Dec 21 03:58:47.489710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:47.490922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fe201550-4596-46e2-aee6-0a5f0eec546c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 5.1563530 Dec 21 03:58:47.493912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:47.556874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a525190b-f2a1-476e-b423-24f4f48f810b req-31264416-673e-49b6-9d65-1fc5eea3173f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0641501 Dec 21 03:58:47.589356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c72ba3de-77d8-41df-a8f7-859a3dcfd7a0 req-a663a411-8d64-4b42-9a6a-53aa97a8db49 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 210 time: 0.0303662 Dec 21 03:58:47.642576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4dd30947-935e-463a-8160-5839b6bba1d5 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/5b75e0b5-0642-45bc-a34d-732b7786b43c HTTP/1.1" status: 200 len: 924 time: 0.1475158 Dec 21 03:58:47.645655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36396) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:47.676695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c30c5504-5bd5-49d1-869c-d1ce8ce717e9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b75e0b5-0642-45bc-a34d-732b7786b43c HTTP/1.1" status: 200 len: 205 time: 0.0297401 Dec 21 03:58:47.679147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36398) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:47.765796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36400) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:47.848557 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:47.918408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57d10c6d-21dd-4739-bebd-2843a870f35d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:47.970524 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:47.996766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57d10c6d-21dd-4739-bebd-2843a870f35d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.078375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-57d10c6d-21dd-4739-bebd-2843a870f35d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.108375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Deleting port e0e2b465-fc29-447b-9d80-3c54f4f93dd1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:48.108814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.130513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-57d10c6d-21dd-4739-bebd-2843a870f35d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0f2a0826ce71492589123c676f6493a6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3635802 Dec 21 03:58:48.135058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d10c6d-21dd-4739-bebd-2843a870f35d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b45f260d-4dd0-4c88-b84b-cde481f57b76,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:48.135058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36426) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:48.188507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e00031f5-c07f-4997-ac2b-cde3f70d3f9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.217262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e00031f5-c07f-4997-ac2b-cde3f70d3f9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.226559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.256970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Calling delete_port for e0e2b465-fc29-447b-9d80-3c54f4f93dd1 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:48.350753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e65989a-fe3d-4e7b-b090-5f32a072a8ff req-904fa701-9f95-4e27-87d5-763fe8a040e9 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0346293 Dec 21 03:58:48.370039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e00031f5-c07f-4997-ac2b-cde3f70d3f9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.372853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e00031f5-c07f-4997-ac2b-cde3f70d3f9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.377435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e00031f5-c07f-4997-ac2b-cde3f70d3f9c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b45f260d-4dd0-4c88-b84b-cde481f57b76 HTTP/1.1" status: 204 len: 168 time: 0.2425497 Dec 21 03:58:48.386374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e00031f5-c07f-4997-ac2b-cde3f70d3f9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b45f260d-4dd0-4c88-b84b-cde481f57b76,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:48.692344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:48.720418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23fa3650-4bf6-4853-8ccf-55b426208be8 req-a550278e-bf3e-459c-ab42-6ea25ceda5a4 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 210 time: 0.0521939 Dec 21 03:58:48.752212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event deleted for resources: {'Port': ['ID=e0e2b465-fc29-447b-9d80-3c54f4f93dd1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:48.770900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb06a2a9-b843-4b9a-b24b-203b68b737c4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:48.816531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.816808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.822809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.828849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.835839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.841962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.847987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:48.849888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6e953916-54ae-4247-86d6-531bb8b1442a tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5434 time: 0.1936381 Dec 21 03:58:48.905228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.020347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.024772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.035726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6fe73e4-7bcd-4d3c-9869-ae0ac3caa462 req-6723193a-f659-404b-9b69-5234bab4cc89 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1759608 Dec 21 03:58:49.117483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c204c117-523f-49b5-9420-dc05e685d6de up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:49.168598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.169395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Fanout notify agent at l3_agent the message router_deleted on router 5b75e0b5-0642-45bc-a34d-732b7786b43c {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:58:49.178377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.182813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0fb691f5-d37e-45f7-9a34-d65a65d2b194 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/5b75e0b5-0642-45bc-a34d-732b7786b43c HTTP/1.1" status: 204 len: 168 time: 1.4993339 Dec 21 03:58:49.183213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36484) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:49.189074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1425613436', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': False}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:49.272718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port c204c117-523f-49b5-9420-dc05e685d6de completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:49.277262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port c204c117-523f-49b5-9420-dc05e685d6de triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:49.277635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.329906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.331571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.379343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.423220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c204c117-523f-49b5-9420-dc05e685d6de,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:49.425037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:49.428456 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18b17310-88d2-4ee4-b740-70a43c3480b2" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "c204c117-523f-49b5-9420-dc05e685d6de"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:49.445539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.490178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.491278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f21e2d88-8221-4926-95ac-3ed4e081cd85 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:49.508278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aa53611-db20-4452-87b4-9017fdc433b7 req-182d0e48-3a08-40c6-9d62-30910de3eee2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0347171 Dec 21 03:58:49.547123 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9152f5e5-0ad6-4df1-8ed8-af1e7f02fd65 x-openstack-request-id: req-9152f5e5-0ad6-4df1-8ed8-af1e7f02fd65 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:49.548031 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "c204c117-523f-49b5-9420-dc05e685d6de", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:49.548501 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9152f5e5-0ad6-4df1-8ed8-af1e7f02fd65 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:49.549236 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de', 'code': 200} Dec 21 03:58:49.694623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:49.728987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.821473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36520) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:49.826513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-734fb980-0647-4665-a469-8022581bb14c req-a3531540-5609-4b9a-a165-e6d4f5616377 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 210 time: 0.0314236 Dec 21 03:58:49.870016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port f21e2d88-8221-4926-95ac-3ed4e081cd85 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:49.880846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port f21e2d88-8221-4926-95ac-3ed4e081cd85 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:49.889211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.935103 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d2569fc-2421-4fa1-b71d-3008306548ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:49.960949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-249955831'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:50.013927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.050837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:50.081657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:50.086505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.122697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.124417 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.125320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf55164f-f3e6-47de-9335-4f151942a1c5 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:50.152514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.229609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.242599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:50.243266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.314203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.318187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.321947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.328359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.335182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.341355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.342822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port bf55164f-f3e6-47de-9335-4f151942a1c5 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:50.347222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:58:50.351636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.351764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port bf55164f-f3e6-47de-9335-4f151942a1c5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:50.351764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.356127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.357924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0cee9157-2e40-4297-b941-0892af2d7616,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:50.358283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-29f9b27d-0d85-4b10-a312-b07b027485b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5436 time: 0.2014163 Dec 21 03:58:50.365820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.366412 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Added segment 42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb of type vlan for network ef210d11-9dbc-4951-a05a-ecb9e2edf31f Dec 21 03:58:50.418508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.487543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.511014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.512699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Allocated IP 172.25.5.12 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/35195e45-decb-4398-bad0-0163f038d5ff) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:50.516699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:50.517426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.545844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf55164f-f3e6-47de-9335-4f151942a1c5,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:50.559160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-60b583ed-0e5c-45a5-b264-dd8aae3aaf2f tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=029528ffc12a421282c1eeef88e2b8bd&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0851271 Dec 21 03:58:50.628748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Network': ['ID=ef210d11-9dbc-4951-a05a-ecb9e2edf31f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:50.642368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:58:50.721536 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3f8c5b4a-f996-4f8a-800d-1655e10965b5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 797 time: 0.8972738 Dec 21 03:58:50.723977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36550) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:50.729477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'subnet': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:50.738413 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.739709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c52f2e0e-5f59-462b-97c5-d88f03894186 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:50.868491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:50.987733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port c52f2e0e-5f59-462b-97c5-d88f03894186 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:50.998736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:50.999283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port c52f2e0e-5f59-462b-97c5-d88f03894186 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:50.999283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:50.999872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.123155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.131882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f028b663-cff7-452b-acc7-64cd30f1778b req-a70517cb-396e-467a-b660-57ad1c4a269b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.0614798 Dec 21 03:58:51.187619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0aaad87-1feb-4497-b7cd-46afbb00208f req-be9e2bb3-932a-47c9-a8bf-8dbe0a012db4 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.8186450 Dec 21 03:58:51.195131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c52f2e0e-5f59-462b-97c5-d88f03894186,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:51.267242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.268077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1626b9fe-82dc-4958-a0d0-4436a98fe01f up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:51.361237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:51.373788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cd792bb-fdac-448d-8fbb-41d417dc5cf5 req-58ed65f7-2cd1-4df5-89b2-381140ffa4e3 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 210 time: 0.0543923 Dec 21 03:58:51.376730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.382652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.437609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 1626b9fe-82dc-4958-a0d0-4436a98fe01f completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:51.447302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 1626b9fe-82dc-4958-a0d0-4436a98fe01f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:51.447896 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.448887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-13bc57da-6744-4a39-9da1-0319dc0a8b33 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:51.450187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-13bc57da-6744-4a39-9da1-0319dc0a8b33 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.8759975 Dec 21 03:58:51.464248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Subnet': ['ID=98c87d1b-7603-4a9d-96ab-b95a101c8b67,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:51.470293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Checking segment: {'id': '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:51.470765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network hostable DHCP agents. Network: ef210d11-9dbc-4951-a05a-ecb9e2edf31f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:58:51.493608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Request body: {'port': {'device_id': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '029528ffc12a421282c1eeef88e2b8bd'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:51.551247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85'}, {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf55164f-f3e6-47de-9335-4f151942a1c5'}, {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c52f2e0e-5f59-462b-97c5-d88f03894186'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:51.554024 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52aafda7-2c6d-4bc7-900c-d58f2f8deba7" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85"}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "bf55164f-f3e6-47de-9335-4f151942a1c5"}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "c52f2e0e-5f59-462b-97c5-d88f03894186"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:51.562259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:58:51.569300 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.617262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.631402 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b48651aa-f7ca-4838-9cbf-5db2d4f5adc9 x-openstack-request-id: req-b48651aa-f7ca-4838-9cbf-5db2d4f5adc9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:51.631949 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85", "code": 200}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "bf55164f-f3e6-47de-9335-4f151942a1c5", "code": 200}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "c52f2e0e-5f59-462b-97c5-d88f03894186", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:51.632267 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b48651aa-f7ca-4838-9cbf-5db2d4f5adc9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:51.632671 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85', 'code': 200} Dec 21 03:58:51.632930 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf55164f-f3e6-47de-9335-4f151942a1c5', 'code': 200} Dec 21 03:58:51.633199 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c52f2e0e-5f59-462b-97c5-d88f03894186', 'code': 200} Dec 21 03:58:51.656558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:51.661543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ef210d11-9dbc-4951-a05a-ecb9e2edf31f) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:51.665943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:51.666372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.680991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:51.682810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-995b7f9a-2724-488a-8ed6-88ed600b16fe None None] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:51.687767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:51.691936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:51.698792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Port': ['ID=35195e45-decb-4398-bad0-0163f038d5ff,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:51.720048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-668e6e6d-5344-4ab5-8457-c244b26ab9ea None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:51.761696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.762719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:51.784044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bed6d44c-ca56-4972-9557-e6b336b3f109 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0587258 Dec 21 03:58:51.786578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:51.791836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1095107395'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:51.926843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:51.931031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d1b10b9a-1e1c-4ac0-9789-f792a304ddbd None None] Provisioning complete for port 35195e45-decb-4398-bad0-0163f038d5ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:51.931412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b10b9a-1e1c-4ac0-9789-f792a304ddbd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.954490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Made reservation on behalf of 029528ffc12a421282c1eeef88e2b8bd for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:51.961901 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:51.975980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'project_id': '92bacc7261014451a5c5c84e47a29116', 'fixed_ips': [{'subnet_id': '98c87d1b-7603-4a9d-96ab-b95a101c8b67'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:58:51.976826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.004705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.013489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:52.018797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d1b10b9a-1e1c-4ac0-9789-f792a304ddbd None None] Port 35195e45-decb-4398-bad0-0163f038d5ff cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:52.067970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:52.068396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.097857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:52.111393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.121703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.157814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] device_id is not set on port 3f4c9cca-ade2-42d8-a467-13dd3649de15 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:58:52.206811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.209015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Allocated IP 2001:db8::2 (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/7d7759c7-9183-4350-8dc5-c1d52ee1bf3a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:52.235009 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.333846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.396967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:52.468382 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.469629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 29c72524-1fd4-42e5-a743-56e89cdcd6eb up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:52.475207 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.479722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8f169bf-178e-4dcb-91b1-f1fc233d76ef,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:52.529815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca4222ea-6bc4-442e-8600-4580e565f243 req-648bcb13-105c-4b5d-aaa7-a366b5baafd5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.1973634 Dec 21 03:58:52.573020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.621201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Allocated IP 192.168.233.236 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/78818bea-9135-439f-ba14-ea0f3224b16d) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:52.640005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:52.652451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:52.658978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.660548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Allocated IP 2001:db8::55 (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/3f4c9cca-ade2-42d8-a467-13dd3649de15) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:52.664893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:52.665245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.672000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.675196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:52.678884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.686224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.693236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.700233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:52.702428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-840bbec1-2de9-48e7-a54a-9a6edc7b15d9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5440 time: 0.2965100 Dec 21 03:58:52.706910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.773769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.779816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cc53be64-f810-4d2d-873f-da9a6c59b17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.800630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Pushing event updated for resources: {'Port': ['ID=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:52.803721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Attempting to bind port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:52.804101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Attempting to bind port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:52.804466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Attempting to bind port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a on network ef210d11-9dbc-4951-a05a-ecb9e2edf31f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:52.810384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:52.810776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Checking segment: {'id': '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:52.811212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.811779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Bound using segment: {'id': '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:52.812535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Bound port: 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:52.813212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.977736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:52.991260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f211fc40-2338-43ab-9301-541f1cc1735c req-34e12740-3b49-42d0-a572-cc9f146e557d tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 210 time: 0.1325343 Dec 21 03:58:53.002459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17cb5cf1-20d7-4a44-bc4b-b3da2abbe780 req-1806d4f5-ae84-4b17-ae55-ae65b1e27659 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2888544 Dec 21 03:58:53.012253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 29c72524-1fd4-42e5-a743-56e89cdcd6eb completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:58:53.037337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 29c72524-1fd4-42e5-a743-56e89cdcd6eb triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:53.037970 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.082643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.101673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.112916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] For port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:53.138044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] For port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,segment=NetworkSegment(42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb),segment_id=42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:53.177711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Router 550fd073-2717-4560-bc47-9cbe868004b5 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:58:53.177981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.188859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:53.205011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:53.207024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=3f4c9cca-ade2-42d8-a467-13dd3649de15,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:53.207964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.209246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:53.209437 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.230310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:53.230910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.235103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:53.251592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.261590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.262176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.262272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.262587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.262869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.263234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:53.295544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.303975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef5ab85-2691-4bfa-baff-a8ed2e428039 None None] Pushing event updated for resources: {'Port': ['ID=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:53.311713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.358117 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4d2de6f-0a52-4c0b-badf-3f9ce60cf47f tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 1.5701652 Dec 21 03:58:53.359029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36638) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:53.365133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-617565198', 'allowed_address_pairs': [{'ip_address': '2001:db8::55', 'mac_address': 'fa:16:3e:70:b5:0c'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:53.379905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:53.386282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:53.388752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:53.390888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:53.399193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=29c72524-1fd4-42e5-a743-56e89cdcd6eb,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:53.399989 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Sync routers for ids ['550fd073-2717-4560-bc47-9cbe868004b5'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:53.403031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Pushing event updated for resources: {'Port': ['ID=78818bea-9135-439f-ba14-ea0f3224b16d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:53.418085 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Routers {'550fd073-2717-4560-bc47-9cbe868004b5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:53.419186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['550fd073-2717-4560-bc47-9cbe868004b5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:53.493180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:53.496276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.518049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.519682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-879031ff-cf18-4b2f-9f38-eb6f52ed27de tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 4.3344936 Dec 21 03:58:53.522667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36640) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:53.635731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f'}, {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7'}, {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29c72524-1fd4-42e5-a743-56e89cdcd6eb'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:53.645891 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Set router 550fd073-2717-4560-bc47-9cbe868004b5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:53.645998 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfda67b6-ae61-4e41-9338-fa2b5bc91dc4" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f"}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7"}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "29c72524-1fd4-42e5-a743-56e89cdcd6eb"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:53.703621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:53.782553 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e5873aa-136b-491c-8de0-8e84be9b0f85 x-openstack-request-id: req-0e5873aa-136b-491c-8de0-8e84be9b0f85 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:53.783022 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f", "code": 200}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7", "code": 200}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-plugged", "status": "completed", "tag": "29c72524-1fd4-42e5-a743-56e89cdcd6eb", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:53.783330 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0e5873aa-136b-491c-8de0-8e84be9b0f85 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:53.784454 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'code': 200} Dec 21 03:58:53.784947 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7', 'code': 200} Dec 21 03:58:53.784947 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29c72524-1fd4-42e5-a743-56e89cdcd6eb', 'code': 200} Dec 21 03:58:53.840275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-18e5be68-54b2-4f81-a046-f678f98d25a0 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.3628676 Dec 21 03:58:53.915399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36650) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:53.929107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Request body: {'port': {'device_id': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:53.968642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-72bdc462-0973-4425-884b-b276be90a3a1 None None] Provisioning complete for port 78818bea-9135-439f-ba14-ea0f3224b16d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:53.969030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72bdc462-0973-4425-884b-b276be90a3a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:53.977332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aef1cbb-0958-4d94-bba1-dea0467f2a8d req-249feaec-1ac7-4cd3-a0a5-5d83bb6df979 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.1579652 Dec 21 03:58:54.057295 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '550fd073-2717-4560-bc47-9cbe868004b5', 'name': 'tempest-snat-router-1425613436', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.12'}], 'enable_snat': False}, 'gw_port_id': '35195e45-decb-4398-bad0-0163f038d5ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:49Z', 'updated_at': '2021-12-21T03:58:51Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': '35195e45-decb-4398-bad0-0163f038d5ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:14:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '550fd073-2717-4560-bc47-9cbe868004b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1749, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:50Z', 'updated_at': '2021-12-21T03:58:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:54.071098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f85f8888-7cec-423c-bc5e-b573d7603b3d tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/550fd073-2717-4560-bc47-9cbe868004b5 HTTP/1.1" status: 200 len: 908 time: 0.5458841 Dec 21 03:58:54.077391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36658) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:54.082721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1425613436', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': True}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:54.082893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.097362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-72bdc462-0973-4425-884b-b276be90a3a1 None None] Port 78818bea-9135-439f-ba14-ea0f3224b16d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:54.104189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.138206 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Checking router: 550fd073-2717-4560-bc47-9cbe868004b5 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:58:54.138206 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Updating router 550fd073-2717-4560-bc47-9cbe868004b5 port 35195e45-decb-4398-bad0-0163f038d5ff binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:58:54.175864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] device_id is not set on port 78026c94-fdb9-46fb-9327-cd127ddc695d yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:58:54.177538 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.216222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1599b9cd-ee27-409f-9aeb-9c19953e9966 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.254403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.255877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.353713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:54.389716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.396123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.402579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.410056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.417818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.427453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.431530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Allocated IP 2001:db8::26d (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/78026c94-fdb9-46fb-9327-cd127ddc695d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:54.435050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.444442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-8e4d5da6-09fc-44a5-9171-6a9ecab3aa33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.2692766 Dec 21 03:58:54.465772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:54.467826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.489673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1802593b-136a-4e84-a9e2-69718fb185af req-c7ff4d08-5417-4cdc-8f77-bbfec9a43de5 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.491272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1802593b-136a-4e84-a9e2-69718fb185af req-c7ff4d08-5417-4cdc-8f77-bbfec9a43de5 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 936 time: 0.2985039 Dec 21 03:58:54.573110 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.575406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.623774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.661689 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.702830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,segment=NetworkSegment(42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb),segment_id=42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:54.705358 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.734662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca828c0e-e915-4555-b7d5-287b87621dbd None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:54.764780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1599b9cd-ee27-409f-9aeb-9c19953e9966 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.768380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.787011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.792298 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Attempting to bind port 35195e45-decb-4398-bad0-0163f038d5ff on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:54.793760 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Attempting to bind port 35195e45-decb-4398-bad0-0163f038d5ff by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:54.794324 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Attempting to bind port 35195e45-decb-4398-bad0-0163f038d5ff on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:54.817473 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:54.818294 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:54.826958 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.827893 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:54.830531 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Bound port: 35195e45-decb-4398-bad0-0163f038d5ff, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:54.830531 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.835492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1802593b-136a-4e84-a9e2-69718fb185af req-ea55700f-1601-4f7d-b69b-6802bb1393e5 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3238678 Dec 21 03:58:54.867868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=78026c94-fdb9-46fb-9327-cd127ddc695d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:54.881792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4154b52a-560a-42c2-a572-13c701872509 None None] Provisioning complete for port 35195e45-decb-4398-bad0-0163f038d5ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:54.882297 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4154b52a-560a-42c2-a572-13c701872509 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.887719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ffb7114-def4-4908-b12a-f92defb781c3 req-106acb1a-b336-43d0-a3fd-81831b01d213 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.4374626 Dec 21 03:58:54.888731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1599b9cd-ee27-409f-9aeb-9c19953e9966 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.906186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Pushing event updated for resources: {'Port': ['ID=35195e45-decb-4398-bad0-0163f038d5ff,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:54.931282 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.931628 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.938448 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.939206 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.939792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.940781 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.941363 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.941856 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.942342 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.943130 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.943632 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.944116 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.944600 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:58:54.954693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:54.957787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.960003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.962642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.963329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.964794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.965457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.966461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:54.969233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a44ec465-c3a1-4d1c-85a7-13b0a2b11021 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 1.0064323 Dec 21 03:58:54.970852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:55.014981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4154b52a-560a-42c2-a572-13c701872509 None None] Port 35195e45-decb-4398-bad0-0163f038d5ff cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:55.018088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] For port 35195e45-decb-4398-bad0-0163f038d5ff, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:55.025191 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] For port 35195e45-decb-4398-bad0-0163f038d5ff, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=35195e45-decb-4398-bad0-0163f038d5ff,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:55.026249 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1599b9cd-ee27-409f-9aeb-9c19953e9966 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9150d858c07d4c6692970b9d9466b8e2&name=default HTTP/1.1" status: 200 len: 3000 time: 1.0979695 Dec 21 03:58:55.026957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:55.029008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1599b9cd-ee27-409f-9aeb-9c19953e9966 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76e90440-8683-416a-ae43-40d44f3a0e37,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:55.038367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.098418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7dba98c-c692-4a13-959d-386bcc85de11 None None] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:58:55.103204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.106630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:55.115495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:55.122640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:55.124567 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.129432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:55.133561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.175214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-67b0bccb-a990-4563-861a-9580d1430259 None None] Provisioning complete for port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:55.175490 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67b0bccb-a990-4563-861a-9580d1430259 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.203041 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d55a0c7-3094-495e-bfa9-f57622252866 None None] Pushing event updated for resources: {'Port': ['ID=35195e45-decb-4398-bad0-0163f038d5ff,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:55.213775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1d5c1f4b-6a57-4223-97f0-53738a70276a req-a1d51dbe-a307-4896-9aaf-fdbcf7b2d17e service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1858265 Dec 21 03:58:55.217254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6169e380-6540-4138-848d-17116131f963 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.232498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69c8d36f-fd02-4991-8698-3b6428099eb6 req-5e17094d-ddc0-4c05-aeff-9d4595ad9c28 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/ports?device_id=1c0b3364-e5b1-4cb8-be4f-793e764450ca HTTP/1.1" status: 200 len: 210 time: 0.1241734 Dec 21 03:58:55.235172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 78818bea-9135-439f-ba14-ea0f3224b16d {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:58:55.258667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Routers {'550fd073-2717-4560-bc47-9cbe868004b5'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:55.260128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ce0bc22-02bf-428c-a45b-3f15626ce1a5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:55.262889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.263261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['550fd073-2717-4560-bc47-9cbe868004b5'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:55.273924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f42cf9e-fa7f-476d-bfef-22c504895450 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1006 time: 1.9136441 Dec 21 03:58:55.279435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36668) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:55.293351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6169e380-6540-4138-848d-17116131f963 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.353869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Transition to ACTIVE for port object 78818bea-9135-439f-ba14-ea0f3224b16d will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:58:55.418333 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] Set router 550fd073-2717-4560-bc47-9cbe868004b5 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:55.425688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fa787b0-1a50-446a-a483-82b7bd62d732 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:55.432845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fa787b0-1a50-446a-a483-82b7bd62d732 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:55.437933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fa787b0-1a50-446a-a483-82b7bd62d732 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:55.442618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5fa787b0-1a50-446a-a483-82b7bd62d732 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2481 time: 0.1580784 Dec 21 03:58:55.443364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36670) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:55.449302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.460010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6169e380-6540-4138-848d-17116131f963 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.466085 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6169e380-6540-4138-848d-17116131f963 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.468273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6169e380-6540-4138-848d-17116131f963 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/76e90440-8683-416a-ae43-40d44f3a0e37 HTTP/1.1" status: 204 len: 168 time: 0.4311163 Dec 21 03:58:55.516882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9c82c824-e569-414e-a9c5-718d267be18b None None] Provisioning complete for port 35195e45-decb-4398-bad0-0163f038d5ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:55.522865 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9c82c824-e569-414e-a9c5-718d267be18b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.547786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Pushing event updated for resources: {'Port': ['ID=78818bea-9135-439f-ba14-ea0f3224b16d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:55.686665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6169e380-6540-4138-848d-17116131f963 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76e90440-8683-416a-ae43-40d44f3a0e37,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:55.722637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Attempting to bind port 78818bea-9135-439f-ba14-ea0f3224b16d on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:58:55.723186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Attempting to bind port 78818bea-9135-439f-ba14-ea0f3224b16d by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:58:55.723644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Attempting to bind port 78818bea-9135-439f-ba14-ea0f3224b16d on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:55.735040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port 78026c94-fdb9-46fb-9327-cd127ddc695d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:55.735397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.753037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Port 78818bea-9135-439f-ba14-ea0f3224b16d on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:58:55.753523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Attempting to bind port 78818bea-9135-439f-ba14-ea0f3224b16d on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:58:55.762484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.774469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 58, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:58:55.776458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:58:55.776801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:58:55.778842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Bound port: 78818bea-9135-439f-ba14-ea0f3224b16d, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:58:55.779799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.787253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9c82c824-e569-414e-a9c5-718d267be18b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.813947 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '550fd073-2717-4560-bc47-9cbe868004b5', 'name': 'tempest-snat-router-1425613436', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.12'}], 'enable_snat': False}, 'gw_port_id': '35195e45-decb-4398-bad0-0163f038d5ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:49Z', 'updated_at': '2021-12-21T03:58:51Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': '35195e45-decb-4398-bad0-0163f038d5ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:14:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '550fd073-2717-4560-bc47-9cbe868004b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1749, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:50Z', 'updated_at': '2021-12-21T03:58:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:55.825625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.842823 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-789346e3-d0a0-401c-83b1-028509ffe19d None None] The sync data for ids ['550fd073-2717-4560-bc47-9cbe868004b5'] in n-d-822053-11 is: [{'id': '550fd073-2717-4560-bc47-9cbe868004b5', 'name': 'tempest-snat-router-1425613436', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.12'}], 'enable_snat': False}, 'gw_port_id': '35195e45-decb-4398-bad0-0163f038d5ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:49Z', 'updated_at': '2021-12-21T03:58:51Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': '35195e45-decb-4398-bad0-0163f038d5ff', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:14:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '550fd073-2717-4560-bc47-9cbe868004b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1749, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:50Z', 'updated_at': '2021-12-21T03:58:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:58:55.853699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9c82c824-e569-414e-a9c5-718d267be18b None None] For port 35195e45-decb-4398-bad0-0163f038d5ff, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=35195e45-decb-4398-bad0-0163f038d5ff,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:58:55.917112 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9c82c824-e569-414e-a9c5-718d267be18b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:55.976669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.004809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.045584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] For port 78818bea-9135-439f-ba14-ea0f3224b16d, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:58:56.054769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for 78026c94-fdb9-46fb-9327-cd127ddc695d owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:56.166008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c82c824-e569-414e-a9c5-718d267be18b None None] Pushing event updated for resources: {'Port': ['ID=35195e45-decb-4398-bad0-0163f038d5ff,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:56.181482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d5b0018c-2a8e-4c50-bf3c-55fb9da5b8c5 None None] Provisioning complete for port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:56.181910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5b0018c-2a8e-4c50-bf3c-55fb9da5b8c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.230256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Allocated IP 172.25.5.3 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/d2a7ae9e-78ce-4425-ba70-83528da006c3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:56.412458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d5b0018c-2a8e-4c50-bf3c-55fb9da5b8c5 None None] Provisioning complete for port 3f4c9cca-ade2-42d8-a467-13dd3649de15 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:56.412989 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5b0018c-2a8e-4c50-bf3c-55fb9da5b8c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.518133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.531366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d5b0018c-2a8e-4c50-bf3c-55fb9da5b8c5 None None] Port 3f4c9cca-ade2-42d8-a467-13dd3649de15 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:56.541461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:56.563975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d5b0018c-2a8e-4c50-bf3c-55fb9da5b8c5 None None] Could not find standard attr ID for object 78026c94-fdb9-46fb-9327-cd127ddc695d. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:58:56.595997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=78026c94-fdb9-46fb-9327-cd127ddc695d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:56.664253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:56.664966 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.812612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ae624510-69c0-4ff5-9e25-49ca323ebe43 None None] Provisioning complete for port 3f4c9cca-ade2-42d8-a467-13dd3649de15 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:56.818461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ae624510-69c0-4ff5-9e25-49ca323ebe43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.831463 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:56.835087 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b4f29998-626f-425f-a2c8-7cb1ee3ef338 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/ports/78026c94-fdb9-46fb-9327-cd127ddc695d HTTP/1.1" status: 204 len: 168 time: 1.3904967 Dec 21 03:58:56.841694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36698) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:56.905170 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-301c2d17-33ee-404c-a154-9c6949fcd864 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] GET failed (client error): The resource could not be found. Dec 21 03:58:56.906738 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-301c2d17-33ee-404c-a154-9c6949fcd864 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "GET /v2.0/ports/78026c94-fdb9-46fb-9327-cd127ddc695d HTTP/1.1" status: 404 len: 333 time: 0.0638428 Dec 21 03:58:56.911780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36700) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:56.918524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1436269532'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:56.939786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ae624510-69c0-4ff5-9e25-49ca323ebe43 None None] Port 3f4c9cca-ade2-42d8-a467-13dd3649de15 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:56.947842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ae624510-69c0-4ff5-9e25-49ca323ebe43 None None] Could not find standard attr ID for object 78026c94-fdb9-46fb-9327-cd127ddc695d. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:58:57.058002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] For port 78818bea-9135-439f-ba14-ea0f3224b16d, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=78818bea-9135-439f-ba14-ea0f3224b16d,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:58:57.118222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.124382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.130993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.136975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.143132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.149623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.155825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.158151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a01668af-3616-4a04-a07d-d2900769edd9 req-9904c06c-a347-4f87-9010-a6e04bd1ccd2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 1.1098619 Dec 21 03:58:57.164710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.184171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:58:57.188298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.218296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] device_id is not set on port 06b9685b-436e-48da-b931-a04c316d184c yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:58:57.229870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b981f61-49c6-4f87-b9fc-2c89c2240717 req-2f166988-3cce-4bc4-aee7-aacca51e2975 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.231576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b981f61-49c6-4f87-b9fc-2c89c2240717 req-2f166988-3cce-4bc4-aee7-aacca51e2975 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 948 time: 1.1417246 Dec 21 03:58:57.304073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.350713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.351451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.353132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] 10.222.0.31 "PUT /v2.0/ports/78818bea-9135-439f-ba14-ea0f3224b16d HTTP/1.1" status: 200 len: 1097 time: 3.4861948 Dec 21 03:58:57.356680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'tag': '78818bea-9135-439f-ba14-ea0f3224b16d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:58:57.359061 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0db2c150-a051-4238-8634-4cffc0a7e277" -d '{"events": [{"name": "network-changed", "server_uuid": "40743738-7ec9-41a6-9b98-309630a3fcbb", "tag": "78818bea-9135-439f-ba14-ea0f3224b16d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:58:57.377351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6020b4-bfe7-448f-b436-eb4e3bce2f0a service neutron] Pushing event updated for resources: {'Port': ['ID=78818bea-9135-439f-ba14-ea0f3224b16d,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:57.393267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Allocated IP 2001:db8::18 (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/06b9685b-436e-48da-b931-a04c316d184c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:58:57.443581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b981f61-49c6-4f87-b9fc-2c89c2240717 req-1c0e76a2-4967-4be9-a76b-7d511629d7db tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1731818 Dec 21 03:58:57.451987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a01668af-3616-4a04-a07d-d2900769edd9 req-b4990ee3-0855-496e-bf32-e755a1cc22cb tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2769015 Dec 21 03:58:57.473308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.597740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Port': ['ID=d2a7ae9e-78ce-4425-ba70-83528da006c3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:57.611468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:57.613883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:57.616741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:57.632705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ba2754b-bd1a-4079-b193-3996879d132b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:57.671350 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:58:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79ab5f1c-0c1a-413d-a69d-885e7892390d x-openstack-request-id: req-79ab5f1c-0c1a-413d-a69d-885e7892390d {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:58:57.675027 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "40743738-7ec9-41a6-9b98-309630a3fcbb", "tag": "78818bea-9135-439f-ba14-ea0f3224b16d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:58:57.675027 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-79ab5f1c-0c1a-413d-a69d-885e7892390d {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:58:57.675027 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'tag': '78818bea-9135-439f-ba14-ea0f3224b16d', 'status': 'completed', 'code': 200} Dec 21 03:58:57.685070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4ca09dbd-0885-4617-81ff-8dd6ea75c163 None None] Provisioning complete for port d2a7ae9e-78ce-4425-ba70-83528da006c3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:57.685547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4ca09dbd-0885-4617-81ff-8dd6ea75c163 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.688571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.699489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:57.702993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-23f1f3bb-ac10-47b1-a059-b2bc1a7bba18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.704721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-23f1f3bb-ac10-47b1-a059-b2bc1a7bba18 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029528ffc12a421282c1eeef88e2b8bd&device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 1100 time: 0.2061462 Dec 21 03:58:57.726292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4ca09dbd-0885-4617-81ff-8dd6ea75c163 None None] Port d2a7ae9e-78ce-4425-ba70-83528da006c3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:57.776309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7d53a41-c40b-402c-9768-90f66c8f8f03 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.802380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7d53a41-c40b-402c-9768-90f66c8f8f03 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.813942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-f5cd7093-50ce-46fe-bf17-261d3d763a3a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.236&port_id=78818bea-9135-439f-ba14-ea0f3224b16d HTTP/1.1" status: 200 len: 217 time: 0.0711379 Dec 21 03:58:57.832125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.886749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:58:57.887080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:58:57.893060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:58:57.899247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.899917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.903700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=06b9685b-436e-48da-b931-a04c316d184c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:57.910422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-815552d8-7b2c-462d-a8ef-e738f6b85d0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.915836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-815552d8-7b2c-462d-a8ef-e738f6b85d0a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0739696 Dec 21 03:58:57.969355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7d53a41-c40b-402c-9768-90f66c8f8f03 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.973102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7d53a41-c40b-402c-9768-90f66c8f8f03 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:57.977020 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7d53a41-c40b-402c-9768-90f66c8f8f03 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/security-groups/23bc1696-ad98-4340-b8bf-f563caa89a24 HTTP/1.1" status: 204 len: 168 time: 0.2739329 Dec 21 03:58:57.977305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36744) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:57.985175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7d53a41-c40b-402c-9768-90f66c8f8f03 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=23bc1696-ad98-4340-b8bf-f563caa89a24,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:57.985991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-48c06b62-af57-44e5-ba61-62f1e4cc5032 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:57.989532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-48c06b62-af57-44e5-ba61-62f1e4cc5032 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0579054 Dec 21 03:58:58.002983 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-a0a5a1b5-9824-4df1-a161-1c07299327f2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] show failed (client error): The resource could not be found. Dec 21 03:58:58.012030 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e528363d-a799-4ebf-bcc1-27551164ca82 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 1.0985148 Dec 21 03:58:58.012927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36750) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:58.013329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36752) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:58.020389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a0a5a1b5-9824-4df1-a161-1c07299327f2 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "GET /v2.0/security-groups/23bc1696-ad98-4340-b8bf-f563caa89a24 HTTP/1.1" status: 404 len: 347 time: 0.0395074 Dec 21 03:58:58.028978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::55', 'mac_address': 'fa:16:3e:70:b5:0c'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:58.150659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.263219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2db58d5a-df96-4bf3-87b6-075affc80674 None None] Provisioning complete for port 06b9685b-436e-48da-b931-a04c316d184c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:58.263842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2db58d5a-df96-4bf3-87b6-075affc80674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.345181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 35195e45-decb-4398-bad0-0163f038d5ff up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:58:58.382810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-2b845a95-c3e9-4bd3-97b1-8bd5f25e09fb service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3637536 Dec 21 03:58:58.390390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2db58d5a-df96-4bf3-87b6-075affc80674 None None] Port 06b9685b-436e-48da-b931-a04c316d184c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:58.425538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 35195e45-decb-4398-bad0-0163f038d5ff triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:58.425909 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.568369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.638871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port 38c1e6b4-a01b-45a9-9a05-d4bdede43e0f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:58.639240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.657628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d06f03e-cacd-4838-bae3-ccea90009a35 req-1eeaa9a2-c10f-4011-9868-6bec43a54d31 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2553101 Dec 21 03:58:58.663184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.717221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2f68a8-5f62-4cb5-927d-e2e0dbe3f968 req-840ade66-ff27-45a4-b746-0bfd12d81077 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.718704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf2f68a8-5f62-4cb5-927d-e2e0dbe3f968 req-840ade66-ff27-45a4-b746-0bfd12d81077 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 948 time: 0.1582618 Dec 21 03:58:58.738470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.744544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.750442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.757069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.762958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.769566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.775608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.777404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd7c250-e858-49f4-9691-897b92837304 req-e2ffb325-3dcb-4996-a78c-dd2c597a26db tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.1995299 Dec 21 03:58:58.788784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.789662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.811307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for 38c1e6b4-a01b-45a9-9a05-d4bdede43e0f owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:58.896740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.948888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf2f68a8-5f62-4cb5-927d-e2e0dbe3f968 req-4c103b46-7535-4d6f-808f-c2fe117f90a3 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1703176 Dec 21 03:58:58.972809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:58.988792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd7c250-e858-49f4-9691-897b92837304 req-6f32d201-aac7-48ef-bdef-8753e23f791c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1633153 Dec 21 03:58:58.991126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-e3883cd2-747d-4d24-8414-5692d4c88d95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:58.992546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-e3883cd2-747d-4d24-8414-5692d4c88d95 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029528ffc12a421282c1eeef88e2b8bd&device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 1100 time: 0.1572540 Dec 21 03:58:59.024546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] In _notify_port_updated(), no bound segment for port 06b9685b-436e-48da-b931-a04c316d184c on network ef210d11-9dbc-4951-a05a-ecb9e2edf31f {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 03:58:59.032955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.033699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.037970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "PUT /v2.0/ports/06b9685b-436e-48da-b931-a04c316d184c HTTP/1.1" status: 200 len: 1001 time: 1.0200441 Dec 21 03:58:59.038721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36812) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:59.066960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503a56c1-c193-4939-be64-6af939eca944 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=06b9685b-436e-48da-b931-a04c316d184c,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:59.101684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Router 6a3e47ce-0e18-4c80-8742-b3c3091f78f3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:58:59.130705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.165216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=38c1e6b4-a01b-45a9-9a05-d4bdede43e0f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:58:59.185259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ba84a26-8bfe-4c69-87fc-fa4bf8daba0a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:58:59.247947 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.250842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.254704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f3c7f03c-e763-44d7-832f-1a3d9942d25b tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/floatingips/7b75aeab-4063-4bcf-904d-54f363b49069 HTTP/1.1" status: 204 len: 168 time: 1.2378163 Dec 21 03:58:59.255209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36816) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:59.294474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.303882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.310495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.318853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.325189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.331315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.338587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.339357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-705f0312-68a7-44b2-ab1d-fe0b8d1d1c62 req-c3ba606c-6fbc-4660-983b-6f7fb12893fe tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.2428269 Dec 21 03:58:59.340301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36818) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:59.340451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-f9bf2844-00ac-49d2-989b-e975d579f4a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.341755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-f9bf2844-00ac-49d2-989b-e975d579f4a7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bfd89982-1206-47e5-b884-d7d59ce490d8 HTTP/1.1" status: 200 len: 870 time: 0.3361611 Dec 21 03:58:59.352423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36822) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:59.356520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Request body: {'floatingip': {'port_id': '1626b9fe-82dc-4958-a0d0-4436a98fe01f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:58:59.402598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.427315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-3e2298c3-df85-4900-9d81-c98c15e7bba6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.236&port_id=78818bea-9135-439f-ba14-ea0f3224b16d HTTP/1.1" status: 200 len: 217 time: 0.0719857 Dec 21 03:58:59.427519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bffd63ec-1f35-4d82-ac02-843f9a2afb43 None None] Provisioning complete for port 06b9685b-436e-48da-b931-a04c316d184c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:58:59.427717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bffd63ec-1f35-4d82-ac02-843f9a2afb43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.466586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port 06b9685b-436e-48da-b931-a04c316d184c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:59.467001 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.468471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bffd63ec-1f35-4d82-ac02-843f9a2afb43 None None] Port 06b9685b-436e-48da-b931-a04c316d184c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:58:59.477090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:58:59.477432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.507881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:58:59.518044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Sync routers for ids ['6a3e47ce-0e18-4c80-8742-b3c3091f78f3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:58:59.527379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Routers {'6a3e47ce-0e18-4c80-8742-b3c3091f78f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:58:59.527995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6a3e47ce-0e18-4c80-8742-b3c3091f78f3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:59.541513 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f5b9ea-8061-4ce3-b6a1-465a96d2e0e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.552239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-c2ec2197-00d4-47b0-a353-c6ffd4cf66fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.553727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-c2ec2197-00d4-47b0-a353-c6ffd4cf66fa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.1191275 Dec 21 03:58:59.636021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.644107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Set router 6a3e47ce-0e18-4c80-8742-b3c3091f78f3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:58:59.656988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.661890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4cce6dd0-1036-4ff3-a66a-0b90c8c81b00 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 905 time: 5.5801525 Dec 21 03:58:59.661890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for 06b9685b-436e-48da-b931-a04c316d184c owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:59.664064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-8876a071-0112-4532-a4e0-87422f358d25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:58:59.664748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36824) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:58:59.665524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-8876a071-0112-4532-a4e0-87422f358d25 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1020527 Dec 21 03:58:59.690707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.760861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for 1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:58:59.818763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-0aaa0f53-7f4b-480a-9e83-ee04db548f97 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1452651 Dec 21 03:58:59.842831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a3e47ce-0e18-4c80-8742-b3c3091f78f3', 'name': 'tempest-snat-router-1425613436', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': 'd2a7ae9e-78ce-4425-ba70-83528da006c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:54Z', 'updated_at': '2021-12-21T03:58:57Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': 'd2a7ae9e-78ce-4425-ba70-83528da006c3', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:62:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a3e47ce-0e18-4c80-8742-b3c3091f78f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1768, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:56Z', 'updated_at': '2021-12-21T03:58:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:58:59.869829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Checking router: 6a3e47ce-0e18-4c80-8742-b3c3091f78f3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:58:59.870195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Updating router 6a3e47ce-0e18-4c80-8742-b3c3091f78f3 port d2a7ae9e-78ce-4425-ba70-83528da006c3 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 03:58:59.899943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:58:59.953450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db2c150-a051-4238-8634-4cffc0a7e277 req-73798e53-7021-4a0b-a6fc-6e8138a9f5d4 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254268 Dec 21 03:58:59.984170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f5b9ea-8061-4ce3-b6a1-465a96d2e0e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.004380 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.023514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1454a45-86ef-4e4e-b5c5-a708329c2766 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/6a3e47ce-0e18-4c80-8742-b3c3091f78f3 HTTP/1.1" status: 200 len: 906 time: 0.3529909 Dec 21 03:59:00.030467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:00.039912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=06b9685b-436e-48da-b931-a04c316d184c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:00.086834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f5b9ea-8061-4ce3-b6a1-465a96d2e0e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.113544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.117928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.119752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.121674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.123783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.123783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.126368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.126368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.126814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.127821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.130621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.130621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.132860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:00.248868 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4f5b9ea-8061-4ce3-b6a1-465a96d2e0e4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=01ea6864e65842e99978a6a5b70e31f1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9072762 Dec 21 03:59:00.253526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36832) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:00.260270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4f5b9ea-8061-4ce3-b6a1-465a96d2e0e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3af4d01-66e8-4555-846b-92f64820640d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:00.289359 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.301647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a62507-3a8a-43f1-86fa-be7b57ae4380 req-63119040-f408-4e96-983e-3551d9b639ec tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:00.320521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3a62507-3a8a-43f1-86fa-be7b57ae4380 req-63119040-f408-4e96-983e-3551d9b639ec tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 948 time: 0.2041929 Dec 21 03:59:00.320521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.320521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-572f4f9f-ae5d-483a-9d87-97d06e2346fb tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/ports/06b9685b-436e-48da-b931-a04c316d184c HTTP/1.1" status: 204 len: 168 time: 1.2701252 Dec 21 03:59:00.321062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:00.360537 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d8f72ec-02bf-4d28-9683-80b1464b5a77 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] GET failed (client error): The resource could not be found. Dec 21 03:59:00.365795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d8f72ec-02bf-4d28-9683-80b1464b5a77 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "GET /v2.0/ports/06b9685b-436e-48da-b931-a04c316d184c HTTP/1.1" status: 404 len: 333 time: 0.0421069 Dec 21 03:59:00.367354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.369352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:00.386599 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.389308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3a62507-3a8a-43f1-86fa-be7b57ae4380 req-90aa34f8-b438-47f0-9c3d-691152ef6318 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775478 Dec 21 03:59:00.401160 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152569f1-a476-4a6d-b8f4-3703818941e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.417247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-509331752'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:00.445564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee20c05-ba26-4393-a649-a7633d0e5b41 None None] Pushing event updated for resources: {'Port': ['ID=d2a7ae9e-78ce-4425-ba70-83528da006c3,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:00.450232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Attempting to bind port d2a7ae9e-78ce-4425-ba70-83528da006c3 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:59:00.450232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Attempting to bind port d2a7ae9e-78ce-4425-ba70-83528da006c3 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:59:00.450232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Attempting to bind port d2a7ae9e-78ce-4425-ba70-83528da006c3 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:00.457746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 58, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:59:00.458769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:00.459528 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.460105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:59:00.460775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Bound port: d2a7ae9e-78ce-4425-ba70-83528da006c3, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:59:00.461341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.497455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-618674bc-8039-4e8f-950f-9e818a8957a9 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:00.523756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] For port d2a7ae9e-78ce-4425-ba70-83528da006c3, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:59:00.527392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] For port d2a7ae9e-78ce-4425-ba70-83528da006c3, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2a7ae9e-78ce-4425-ba70-83528da006c3,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:59:00.538975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.610984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.624909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-83e6445a-4fd6-4693-aece-9442cfe9698b None None] Provisioning complete for port d2a7ae9e-78ce-4425-ba70-83528da006c3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:00.625365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-83e6445a-4fd6-4693-aece-9442cfe9698b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.680264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c33986a8-f97f-49f1-8ba4-0871ca1453b8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:00.727376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Routers {'6a3e47ce-0e18-4c80-8742-b3c3091f78f3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:00.728229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6a3e47ce-0e18-4c80-8742-b3c3091f78f3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:00.736374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee20c05-ba26-4393-a649-a7633d0e5b41 None None] Pushing event updated for resources: {'Port': ['ID=d2a7ae9e-78ce-4425-ba70-83528da006c3,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:00.808174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152569f1-a476-4a6d-b8f4-3703818941e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.856555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:00.861448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.resource_extend [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] It took 0.35 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 03:59:00.869172 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-83e6445a-4fd6-4693-aece-9442cfe9698b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.886747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] Set router 6a3e47ce-0e18-4c80-8742-b3c3091f78f3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:00.972533 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.985254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152569f1-a476-4a6d-b8f4-3703818941e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.988939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-152569f1-a476-4a6d-b8f4-3703818941e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:00.992726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-152569f1-a476-4a6d-b8f4-3703818941e2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e3af4d01-66e8-4555-846b-92f64820640d HTTP/1.1" status: 204 len: 168 time: 0.7084782 Dec 21 03:59:00.996147 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.001945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-152569f1-a476-4a6d-b8f4-3703818941e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3af4d01-66e8-4555-846b-92f64820640d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:01.025106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.030745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c3c1048-fc69-4222-9a27-b6c04ad13b08 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/ports/1cb9a904-91ff-482b-9ca2-0b3b9aa67ad3 HTTP/1.1" status: 204 len: 168 time: 1.7722228 Dec 21 03:59:01.032029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36840) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:01.114139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-83e6445a-4fd6-4693-aece-9442cfe9698b None None] For port d2a7ae9e-78ce-4425-ba70-83528da006c3, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2a7ae9e-78ce-4425-ba70-83528da006c3,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:01.114388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.132249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting port 1a539edc-6061-4a94-a9d0-3e97bd54fe56 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:01.132741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.159569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:01.163828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.168826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Deleting port d2a7ae9e-78ce-4425-ba70-83528da006c3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:01.169172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.180870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-83e6445a-4fd6-4693-aece-9442cfe9698b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.262547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] device_id is not set on port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:01.275921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e6445a-4fd6-4693-aece-9442cfe9698b None None] Pushing event updated for resources: {'Port': ['ID=d2a7ae9e-78ce-4425-ba70-83528da006c3,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:01.284274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.303274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Calling delete_port for 1a539edc-6061-4a94-a9d0-3e97bd54fe56 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:01.335670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0967ec74-c0ce-4bec-b8d9-3b2109d67fef None None] Provisioning complete for port d2a7ae9e-78ce-4425-ba70-83528da006c3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:01.336213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0967ec74-c0ce-4bec-b8d9-3b2109d67fef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.400782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a3e47ce-0e18-4c80-8742-b3c3091f78f3', 'name': 'tempest-snat-router-1425613436', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': 'd2a7ae9e-78ce-4425-ba70-83528da006c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:54Z', 'updated_at': '2021-12-21T03:58:57Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': 'd2a7ae9e-78ce-4425-ba70-83528da006c3', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:62:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a3e47ce-0e18-4c80-8742-b3c3091f78f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1768, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:56Z', 'updated_at': '2021-12-21T03:59:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:01.459933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e311204f-8ac6-409c-adfe-63d13aa8f94c None None] The sync data for ids ['6a3e47ce-0e18-4c80-8742-b3c3091f78f3'] in n-d-822053-11 is: [{'id': '6a3e47ce-0e18-4c80-8742-b3c3091f78f3', 'name': 'tempest-snat-router-1425613436', 'tenant_id': '3ac74c038ad149e39cb78a7657542c0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3'}], 'enable_snat': True}, 'gw_port_id': 'd2a7ae9e-78ce-4425-ba70-83528da006c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:58:54Z', 'updated_at': '2021-12-21T03:58:57Z', 'revision_number': 3, 'project_id': '3ac74c038ad149e39cb78a7657542c0c', 'gw_port': {'id': 'd2a7ae9e-78ce-4425-ba70-83528da006c3', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:62:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a3e47ce-0e18-4c80-8742-b3c3091f78f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1768, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:58:56Z', 'updated_at': '2021-12-21T03:59:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:01.482017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] For port d2a7ae9e-78ce-4425-ba70-83528da006c3, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2a7ae9e-78ce-4425-ba70-83528da006c3,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:01.482393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.520521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Calling delete_port for d2a7ae9e-78ce-4425-ba70-83528da006c3 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:01.526094 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Floating IP 84fa031d-e041-4fd4-9017-c432e03f800f associated. External IP: 172.25.5.254, port: 1626b9fe-82dc-4958-a0d0-4436a98fe01f. Dec 21 03:59:01.637055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efca212-05be-4271-ad2b-610716547b4a req-286d38bf-7e43-4fb1-884c-9d933e9c0af8 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:01.638605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5efca212-05be-4271-ad2b-610716547b4a req-286d38bf-7e43-4fb1-884c-9d933e9c0af8 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 948 time: 0.1104980 Dec 21 03:59:01.672039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Allocated IP 2001:db8::131 (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:01.692555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5efca212-05be-4271-ad2b-610716547b4a req-2aea70a4-b751-448f-8716-5665d455a7c8 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471191 Dec 21 03:59:01.707900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.739637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Port': ['ID=1a539edc-6061-4a94-a9d0-3e97bd54fe56,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:01.855086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:01.862752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-77191a67-e5a4-41d6-baa0-a411ad076ce5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/ports/1a539edc-6061-4a94-a9d0-3e97bd54fe56 HTTP/1.1" status: 204 len: 168 time: 0.8293917 Dec 21 03:59:01.863720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36856) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:01.890682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 78818bea-9135-439f-ba14-ea0f3224b16d details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:59:01.946715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting subnet 8e39c1be-57b7-471e-a252-0b9469588d52 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:01.951141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.003363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.030369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 78818bea-9135-439f-ba14-ea0f3224b16d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=78818bea-9135-439f-ba14-ea0f3224b16d,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:02.048576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '78818bea-9135-439f-ba14-ea0f3224b16d', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '78818bea-9135-439f-ba14-ea0f3224b16d', 'mac_address': 'fa:16:3e:b0:16:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.236'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:59:02.132044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.143163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Router 1cfcc743-8714-4e30-ac55-8bea218057cc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:02.145975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.175101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 78818bea-9135-439f-ba14-ea0f3224b16d {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:59:02.222466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.230186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.262144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 78818bea-9135-439f-ba14-ea0f3224b16d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=78818bea-9135-439f-ba14-ea0f3224b16d,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:02.265722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event deleted for resources: {'Port': ['ID=d2a7ae9e-78ce-4425-ba70-83528da006c3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:02.293248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-538e15e2-60b6-47be-a13c-0e0f90a6d67f None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:02.340589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.372737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.447691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=78818bea-9135-439f-ba14-ea0f3224b16d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:02.450977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18fec269-5af4-48f6-ae68-91daa79cbd7a None None] Network 19393033-2861-465d-ab20-b8ec53781acb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:02.454863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.460590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/subnets/8e39c1be-57b7-471e-a252-0b9469588d52 HTTP/1.1" status: 204 len: 168 time: 0.5956028 Dec 21 03:59:02.464672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:02.469161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1d8c61b-abd5-4a88-ab89-efbe22e605b5 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Subnet': ['ID=8e39c1be-57b7-471e-a252-0b9469588d52,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:02.524600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a7ae9e-78ce-4425-ba70-83528da006c3 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:59:02.541853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.547435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:02.555248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.558207 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] Sync routers for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:02.577847 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:02.578479 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:02.591687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Deleting subnet fdb8123e-5581-4093-99c4-63d41dd3436d {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:02.605073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.624987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d2a7ae9e-78ce-4425-ba70-83528da006c3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:02.625236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a7ae9e-78ce-4425-ba70-83528da006c3 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 21 03:59:02.655291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1238a4ba-b193-402a-a33a-68e37c341c55 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "PUT /v2.0/floatingips/84fa031d-e041-4fd4-9017-c432e03f800f HTTP/1.1" status: 200 len: 991 time: 3.3020954 Dec 21 03:59:02.695311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:59:02.698105 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a19fe9d3-3129-4621-b634-44759848225e" -d '{"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:59:02.702689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Port d2a7ae9e-78ce-4425-ba70-83528da006c3 not found, will not notify nova. {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 21 03:59:02.729816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.737782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.763323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['78818bea-9135-439f-ba14-ea0f3224b16d'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:59:02.852837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] DHCP port deletion for 19393033-2861-465d-ab20-b8ec53781acb request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:02.925493 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:02.968295 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:59:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ada909ca-d3bb-4093-93d6-9e43e5df2412 x-openstack-request-id: req-ada909ca-d3bb-4093-93d6-9e43e5df2412 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:59:02.970268 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:59:02.970538 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ada909ca-d3bb-4093-93d6-9e43e5df2412 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:59:02.970967 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'status': 'completed', 'code': 200} Dec 21 03:59:02.979804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:02.996168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:03.019132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.064522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.104815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:03.117864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] Deleting port fa2f395b-5d54-49d2-bd99-243f0bbabadf {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:03.118392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.129304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:03.148407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:03.164126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.167011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.199002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.256997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] For port fa2f395b-5d54-49d2-bd99-243f0bbabadf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fa2f395b-5d54-49d2-bd99-243f0bbabadf,segment=NetworkSegment(e638ba70-0b52-4055-af99-ba8a9035d3f8),segment_id=e638ba70-0b52-4055-af99-ba8a9035d3f8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:03.259699 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.273456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Subnet': ['ID=fdb8123e-5581-4093-99c4-63d41dd3436d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:03.281084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.281675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.282478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.283245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.284245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.284788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.285319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.287566 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-9a26ea46-b971-42f5-ae8a-ade709c4844e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.3114605 Dec 21 03:59:03.294757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] Calling delete_port for fa2f395b-5d54-49d2-bd99-243f0bbabadf owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:03.345805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.363131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-10fa6ad9-c5aa-4cab-b653-49904864d808 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/subnets/fdb8123e-5581-4093-99c4-63d41dd3436d HTTP/1.1" status: 204 len: 168 time: 0.8900571 Dec 21 03:59:03.364131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36886) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:03.385913 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10e3b6cb-14f3-4e0e-9384-ad1e7596e58e tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 3.0138948 Dec 21 03:59:03.389096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:03.415996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.416972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 6a3e47ce-0e18-4c80-8742-b3c3091f78f3 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:03.444291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:70:b5:0c'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:03.452602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-757fbbc6-9eb3-4844-baba-9861446e7d86 None None] Network 48839244-4ebd-4f7e-a6df-11292c1938d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:03.466137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36890) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:03.479072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.480270 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9603d3e8-8ce9-480f-b174-9f6ff41da2ef tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/routers/6a3e47ce-0e18-4c80-8742-b3c3091f78f3 HTTP/1.1" status: 204 len: 168 time: 3.4488506 Dec 21 03:59:03.491344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36894) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:03.511893 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '84fa031d-e041-4fd4-9017-c432e03f800f', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'floating_ip_address': '172.25.5.254', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'port_id': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1579, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'mac_address': 'fa:16:3e:77:8d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:57:46Z', 'updated_at': '2021-12-21T03:59:00Z', 'revision_number': 1, 'project_id': '2e28414564544bb283304990bb7b8542', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:03.576801 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.587536 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] Checking router: 1cfcc743-8714-4e30-ac55-8bea218057cc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:59:03.624279 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:03.626704 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:03.664214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] Pushing event deleted for resources: {'Port': ['ID=fa2f395b-5d54-49d2-bd99-243f0bbabadf,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:03.753929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b5294f1-6ac1-4e7c-80ea-c34992e6803f None None] No DVR routers for this DVR port fa2f395b-5d54-49d2-bd99-243f0bbabadf on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:03.798337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90f4c4a1-25af-4aae-8b4c-c8fc8324ffaa admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.809457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-272bf6e1-8cf6-4aa1-9786-a094a5f38cf6 None None] Provisioning complete for port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:03.809834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-272bf6e1-8cf6-4aa1-9786-a094a5f38cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.826419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:03.850891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-272bf6e1-8cf6-4aa1-9786-a094a5f38cf6 None None] Port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:03.852963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.933826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:03.937686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-edb48275-8212-45e5-ba04-8531fc8d57e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.939481 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-edb48275-8212-45e5-ba04-8531fc8d57e1 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88 HTTP/1.1" status: 200 len: 917 time: 0.6427524 Dec 21 03:59:03.985490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e33abc51-2755-4967-9345-7b77ef8a1a91 req-70637786-535b-4259-99e3-a9021c6defbf tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:03.993637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e33abc51-2755-4967-9345-7b77ef8a1a91 req-70637786-535b-4259-99e3-a9021c6defbf tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 949 time: 0.3739223 Dec 21 03:59:04.016002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] DHCP port deletion for 48839244-4ebd-4f7e-a6df-11292c1938d9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:04.121833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] Deleting port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:04.123976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.170970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.223316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['19393033-2861-465d-ab20-b8ec53781acb']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:04.232509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.239164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e638ba70-0b52-4055-af99-ba8a9035d3f8') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:04.239466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e638ba70-0b52-4055-af99-ba8a9035d3f8') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:04.253841 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.269485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.279324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] For port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,segment=NetworkSegment(246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8),segment_id=246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:04.279739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.283235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:04.284214 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.305428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] Calling delete_port for e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:04.327581 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '84fa031d-e041-4fd4-9017-c432e03f800f', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'floating_ip_address': '172.25.5.254', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'port_id': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1579, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'mac_address': 'fa:16:3e:77:8d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:57:46Z', 'updated_at': '2021-12-21T03:59:00Z', 'revision_number': 1, 'project_id': '2e28414564544bb283304990bb7b8542', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:04.370451 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:04.385108 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:04.388321 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:04.433029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e33abc51-2755-4967-9345-7b77ef8a1a91 req-5ec74263-21a8-4481-a654-4db64aff5a2b tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4327443 Dec 21 03:59:04.436023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.446158 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb3772a-6abe-44a6-bebe-311a7b9c9ac6 None None] The sync data for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 is: [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '84fa031d-e041-4fd4-9017-c432e03f800f', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'floating_ip_address': '172.25.5.254', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'port_id': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1579, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'mac_address': 'fa:16:3e:77:8d:70', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '692cadc7-8f56-4705-bdb5-42df91c65def', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T03:57:46Z', 'updated_at': '2021-12-21T03:59:00Z', 'revision_number': 1, 'project_id': '2e28414564544bb283304990bb7b8542', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:04.463691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.478266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.491315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:04.551827 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-57365ae8-84c4-45c1-80f2-cefb3e3ee2a6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 999 time: 0.3041980 Dec 21 03:59:04.553911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.557939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/networks/19393033-2861-465d-ab20-b8ec53781acb HTTP/1.1" status: 204 len: 168 time: 1.1926973 Dec 21 03:59:04.561726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3225d8-b1d2-46fd-844a-b867d20e2892 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Network': ['ID=19393033-2861-465d-ab20-b8ec53781acb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:04.565689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36900) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:04.586849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] In _notify_port_updated(), no bound segment for port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 on network ef210d11-9dbc-4951-a05a-ecb9e2edf31f {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 03:59:04.594551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:04.595358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.597007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "PUT /v2.0/ports/fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 HTTP/1.1" status: 200 len: 1002 time: 1.1697900 Dec 21 03:59:04.601420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:04.634502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:04.634787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:04.635260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa2f395b-5d54-49d2-bd99-243f0bbabadf no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:04.676586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e113989c-be7d-4c92-8364-40afc63c525c tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:04.684786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] No DVR routers for this DVR port e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:04.688430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: fa2f395b-5d54-49d2-bd99-243f0bbabadf {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:04.688898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa2f395b-5d54-49d2-bd99-243f0bbabadf not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:04.693689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-cccc3012-778a-4e39-815f-34853bf0a830 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:04.697956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b16cebd-02a6-42fd-b808-9e0cd5921f8e None None] Pushing event deleted for resources: {'Port': ['ID=e19e3ea3-0a6e-4174-8c42-ee9b1d15c1e4,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:04.707621 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-cccc3012-778a-4e39-815f-34853bf0a830 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.1482990 Dec 21 03:59:04.742515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90f4c4a1-25af-4aae-8b4c-c8fc8324ffaa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.779591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19fe9d3-3129-4621-b634-44759848225e req-fc996e61-ef12-4eb7-825a-82e7ff460381 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:04.790119 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-fc996e61-ef12-4eb7-825a-82e7ff460381 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0737920 Dec 21 03:59:04.845272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824778ce-d098-42b6-8aaf-a2100ef7d21b None None] New status for floating IP 84fa031d-e041-4fd4-9017-c432e03f800f: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 03:59:04.868564 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90f4c4a1-25af-4aae-8b4c-c8fc8324ffaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:04.936829 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-e0442351-d733-4059-8993-5f03a590dfc8 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1386595 Dec 21 03:59:04.988442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.011975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3b9e6905-5170-4b38-a419-5594368729fd None None] Provisioning complete for port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:05.012404 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b9e6905-5170-4b38-a419-5594368729fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.048083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-90f4c4a1-25af-4aae-8b4c-c8fc8324ffaa admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e0f93985e7b944bb9efb19e64e847dc2&name=default HTTP/1.1" status: 200 len: 3000 time: 1.5788386 Dec 21 03:59:05.064491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36908) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:05.077907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f4c4a1-25af-4aae-8b4c-c8fc8324ffaa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cec48ec-e29c-4ec6-8ede-221217cca4f6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:05.095459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:05.095812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.104443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.109688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a19fe9d3-3129-4621-b634-44759848225e req-b83b54bf-6de2-4415-adc1-63052dd82b24 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1652591 Dec 21 03:59:05.111159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b9e6905-5170-4b38-a419-5594368729fd None None] Port fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:05.270411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.322196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfef2db2-9f08-4e51-92ed-9fa7d7df76f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.330062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.342517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48839244-4ebd-4f7e-a6df-11292c1938d9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:05.373082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:05.378180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:05.378488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '246bd2fe-9642-4ec0-91ec-0dc3e7dc26d8') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:05.387873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfef2db2-9f08-4e51-92ed-9fa7d7df76f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.398782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.464766 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.485215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:05.485624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:05.489258 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:05.506465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Deleting port 35195e45-decb-4398-bad0-0163f038d5ff {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:05.506809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.671448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a16ee3a7-ea0c-40db-977b-a9e3cbdd2885 req-fd2fd67a-0858-4423-aea6-a32c024695e8 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:05.672958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a16ee3a7-ea0c-40db-977b-a9e3cbdd2885 req-fd2fd67a-0858-4423-aea6-a32c024695e8 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 949 time: 0.1802237 Dec 21 03:59:05.741474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] For port 35195e45-decb-4398-bad0-0163f038d5ff, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=35195e45-decb-4398-bad0-0163f038d5ff,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:05.741474 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.761456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Calling delete_port for 35195e45-decb-4398-bad0-0163f038d5ff owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:05.796300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a16ee3a7-ea0c-40db-977b-a9e3cbdd2885 req-2656beab-2da1-4b20-9caf-555eeb7dec4d tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148617 Dec 21 03:59:05.901889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 78818bea-9135-439f-ba14-ea0f3224b16d up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:59:05.907893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfef2db2-9f08-4e51-92ed-9fa7d7df76f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.911040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfef2db2-9f08-4e51-92ed-9fa7d7df76f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.912244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dfef2db2-9f08-4e51-92ed-9fa7d7df76f8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7cec48ec-e29c-4ec6-8ede-221217cca4f6 HTTP/1.1" status: 204 len: 168 time: 0.8423450 Dec 21 03:59:05.928008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfef2db2-9f08-4e51-92ed-9fa7d7df76f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cec48ec-e29c-4ec6-8ede-221217cca4f6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:05.951234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.952455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.971671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:05.974832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] 10.222.0.18 "DELETE /v2.0/networks/48839244-4ebd-4f7e-a6df-11292c1938d9 HTTP/1.1" status: 204 len: 168 time: 1.4062819 Dec 21 03:59:06.012285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:06.015130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85d1b63-42a5-4b83-82d0-e35976412601 tempest-TaggedBootDevicesTest-1398711144 tempest-TaggedBootDevicesTest-1398711144-project] Pushing event deleted for resources: {'Network': ['ID=48839244-4ebd-4f7e-a6df-11292c1938d9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:06.044907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 78818bea-9135-439f-ba14-ea0f3224b16d completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 03:59:06.048922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 78818bea-9135-439f-ba14-ea0f3224b16d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:06.056443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.056598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.058557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fbd5d11d-a682-49bd-bf6b-80ac91f637f5 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/ports/fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 HTTP/1.1" status: 204 len: 168 time: 1.4474335 Dec 21 03:59:06.060424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36916) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:06.089255 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-8902306c-60d8-4870-9cb4-45170a21f801 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] GET failed (client error): The resource could not be found. Dec 21 03:59:06.094725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:06.100963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-687218466'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:06.105484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8902306c-60d8-4870-9cb4-45170a21f801 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "GET /v2.0/ports/fc3e0dcf-b833-4c27-99c8-aeead0c1c6f6 HTTP/1.1" status: 404 len: 333 time: 0.0296612 Dec 21 03:59:06.130863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.199038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event deleted for resources: {'Port': ['ID=35195e45-decb-4398-bad0-0163f038d5ff,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:06.227747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.227747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-741e0252-9449-410b-ae00-645affb73281 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:06.333141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '78818bea-9135-439f-ba14-ea0f3224b16d'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:59:06.338356 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ea94f0b-8b9a-4d8b-b8f8-1fd725019fe7" -d '{"events": [{"server_uuid": "40743738-7ec9-41a6-9b98-309630a3fcbb", "name": "network-vif-plugged", "status": "completed", "tag": "78818bea-9135-439f-ba14-ea0f3224b16d"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:59:06.368504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.388940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a7ae9e-78ce-4425-ba70-83528da006c3 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:06.403507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 78818bea-9135-439f-ba14-ea0f3224b16d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=78818bea-9135-439f-ba14-ea0f3224b16d,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:06.414856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:06.418995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.431490 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:59:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e314a2da-e0d7-4bf7-9dfa-5aa0ac01a998 x-openstack-request-id: req-e314a2da-e0d7-4bf7-9dfa-5aa0ac01a998 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:59:06.432070 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40743738-7ec9-41a6-9b98-309630a3fcbb", "name": "network-vif-plugged", "status": "completed", "tag": "78818bea-9135-439f-ba14-ea0f3224b16d", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:59:06.432507 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e314a2da-e0d7-4bf7-9dfa-5aa0ac01a998 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:59:06.433066 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '78818bea-9135-439f-ba14-ea0f3224b16d', 'code': 200} Dec 21 03:59:06.434121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d2a7ae9e-78ce-4425-ba70-83528da006c3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:06.434633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2a7ae9e-78ce-4425-ba70-83528da006c3 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:06.443960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] device_id is not set on port 76ea610b-7c0a-46bb-be42-e855260a695f yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:06.495366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.511927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.517020 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.567947 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=78818bea-9135-439f-ba14-ea0f3224b16d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:06.630149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe2c4a9-98f8-45ad-be2a-65a068b605f3 req-4331f158-c5ea-4bee-8b3e-aa2990d11225 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:06.631746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fe2c4a9-98f8-45ad-be2a-65a068b605f3 req-4331f158-c5ea-4bee-8b3e-aa2990d11225 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 1102 time: 0.0540268 Dec 21 03:59:06.656253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Allocated IP 2001:db8::16 (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/76ea610b-7c0a-46bb-be42-e855260a695f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:06.684208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fe2c4a9-98f8-45ad-be2a-65a068b605f3 req-ec8acbca-bae0-48d4-9bfe-43862d52474b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402529 Dec 21 03:59:06.694880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.695465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 550fd073-2717-4560-bc47-9cbe868004b5 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:06.700222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.705479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9c485ce6-ea4f-4838-9fbc-7d02487502ab tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "DELETE /v2.0/routers/550fd073-2717-4560-bc47-9cbe868004b5 HTTP/1.1" status: 204 len: 168 time: 3.2039523 Dec 21 03:59:06.705479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:06.710330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-40258596', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:06.809509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.810728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.831220 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:06.913384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.261971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.278820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8307802-96ae-4b05-84b5-8110e257d9ea req-3136750c-07ae-4e4a-b42e-4e72b60a8b96 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:07.284236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8307802-96ae-4b05-84b5-8110e257d9ea req-3136750c-07ae-4e4a-b42e-4e72b60a8b96 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 950 time: 0.3227637 Dec 21 03:59:07.284981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.341386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=76ea610b-7c0a-46bb-be42-e855260a695f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:07.354719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:07.356578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:07.357046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8307802-96ae-4b05-84b5-8110e257d9ea req-8b4e86a9-3b61-4085-abc6-73095d9db3fd tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665016 Dec 21 03:59:07.359586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:07.368255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:07.369072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.470056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76f2f86c-2689-4cfd-bc2f-153b6d40eaa0 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 942 time: 1.3734412 Dec 21 03:59:07.472954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:07.483482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'network_id': 'ef210d11-9dbc-4951-a05a-ecb9e2edf31f', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1724519023'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:07.726721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.735549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Made reservation on behalf of 92bacc7261014451a5c5c84e47a29116 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:07.739689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.741187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.766746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] device_id is not set on port 417d3635-56d3-4c93-be04-53e154fce289 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:07.820512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a3ac6384-10f9-4df9-95ea-07ab82f1ed9e None None] Provisioning complete for port 76ea610b-7c0a-46bb-be42-e855260a695f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:07.836254 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a3ac6384-10f9-4df9-95ea-07ab82f1ed9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:07.869311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Allocated IP 172.25.5.41 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/3c929d25-d336-486f-b3b8-0d8d47b5c0f8) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:07.933268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a3ac6384-10f9-4df9-95ea-07ab82f1ed9e None None] Port 76ea610b-7c0a-46bb-be42-e855260a695f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:07.952087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Allocated IP 2001:db8::26e (ef210d11-9dbc-4951-a05a-ecb9e2edf31f/98c87d1b-7603-4a9d-96ab-b95a101c8b67/417d3635-56d3-4c93-be04-53e154fce289) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:08.055119 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.171957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.186837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.233465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:08.241771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:08.245193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:08.256432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fb42e2a-ff97-468f-bebb-db94b866380c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:08.277648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 35195e45-decb-4398-bad0-0163f038d5ff no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:08.296013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.313153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 35195e45-decb-4398-bad0-0163f038d5ff {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:08.314402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 35195e45-decb-4398-bad0-0163f038d5ff not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:08.335046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event updated for resources: {'Port': ['ID=3c929d25-d336-486f-b3b8-0d8d47b5c0f8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:08.370087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b4dabdc6-442c-4a49-aa0f-2cdc1ab3299e None None] Provisioning complete for port 3c929d25-d336-486f-b3b8-0d8d47b5c0f8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:08.370835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4dabdc6-442c-4a49-aa0f-2cdc1ab3299e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.434789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=417d3635-56d3-4c93-be04-53e154fce289,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:08.455125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:08.456744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:08.459740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_agent failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.470214 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:08.473968 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:08.481470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:08.481470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.502685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b4dabdc6-442c-4a49-aa0f-2cdc1ab3299e None None] Port 3c929d25-d336-486f-b3b8-0d8d47b5c0f8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:08.609167 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bd6092b0-8d5f-48bf-8d84-0efd5a0e7820 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 1.1321926 Dec 21 03:59:08.610518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:08.615400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::55', 'mac_address': 'fa:16:3e:70:b5:0c'}, {'ip_address': '2001:db8::16', 'mac_address': 'fa:16:3e:09:21:f1'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:08.627294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a76c87d-81f6-4d21-86d6-842997d8bbad req-d03ca33b-419d-4476-b740-8d97113ea86f tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:08.635907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a76c87d-81f6-4d21-86d6-842997d8bbad req-d03ca33b-419d-4476-b740-8d97113ea86f tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 950 time: 0.1156669 Dec 21 03:59:08.661544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36984) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:08.751775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:08.759638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a76c87d-81f6-4d21-86d6-842997d8bbad req-59565640-7173-4cdf-82ed-f8fd9e0047b8 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1228657 Dec 21 03:59:08.760146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:59:08.949652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3b5d9cf6-3bab-44ad-ac84-e61aa9265a9d None None] Provisioning complete for port 417d3635-56d3-4c93-be04-53e154fce289 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:08.950679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b5d9cf6-3bab-44ad-ac84-e61aa9265a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.029502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b5d9cf6-3bab-44ad-ac84-e61aa9265a9d None None] Port 417d3635-56d3-4c93-be04-53e154fce289 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:09.079024 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.088518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-236570242'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:09.125482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.159013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] In _notify_port_updated(), no bound segment for port 417d3635-56d3-4c93-be04-53e154fce289 on network ef210d11-9dbc-4951-a05a-ecb9e2edf31f {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 03:59:09.186517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:09.186517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.191183 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "PUT /v2.0/ports/417d3635-56d3-4c93-be04-53e154fce289 HTTP/1.1" status: 200 len: 1066 time: 0.5773563 Dec 21 03:59:09.198071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36996) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:09.259055 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.262811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Made reservation on behalf of c6bd15b1a97c48988675651221b1407c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:09.266354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.288996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.299090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d68e321-ffc9-4cb0-a61f-9847a3701559 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event updated for resources: {'Port': ['ID=417d3635-56d3-4c93-be04-53e154fce289,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:09.399578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port 417d3635-56d3-4c93-be04-53e154fce289 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:09.399994 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.470395 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.511105 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.526761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for 417d3635-56d3-4c93-be04-53e154fce289 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:09.543116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.559706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a72c59e5-8224-46cf-b545-b344f5fa8595 req-5b0359bb-453b-430d-a171-355fdb054c28 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:09.561957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a72c59e5-8224-46cf-b545-b344f5fa8595 req-5b0359bb-453b-430d-a171-355fdb054c28 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 950 time: 0.1592731 Dec 21 03:59:09.563065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6cfc2282-2d93-4e40-89fd-24e66a695945 None None] Provisioning complete for port 417d3635-56d3-4c93-be04-53e154fce289 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:09.563685 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6cfc2282-2d93-4e40-89fd-24e66a695945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.588791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.604867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:09.612176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6cfc2282-2d93-4e40-89fd-24e66a695945 None None] Port 417d3635-56d3-4c93-be04-53e154fce289 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:09.622455 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.626341 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Added segment b43067af-b0bb-401c-a4fc-de60e951e1f0 of type vlan for network bf4eb920-cb2a-4d07-8465-04e04e08ddcf Dec 21 03:59:09.705382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a72c59e5-8224-46cf-b545-b344f5fa8595 req-4f182439-eff3-4031-874e-37f08352f6fe tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076930 Dec 21 03:59:09.710260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1ea8d685-43d3-408c-b7e5-9138d34ed341,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:09.718158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.837644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.845252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:09.846457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.860307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Router e4acbac3-e425-4325-87b9-3631c022a618 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:59:09.914182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:09.932544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event updated for resources: {'Network': ['ID=bf4eb920-cb2a-4d07-8465-04e04e08ddcf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:09.946588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:09.963420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=417d3635-56d3-4c93-be04-53e154fce289,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:09.967688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de4d3520-2cd1-422f-b1b0-68b28da66e54 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.3050334 Dec 21 03:59:09.974903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37002) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:09.981946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Request body: {'subnet': {'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:09.990021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:10.006662 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] Sync routers for ids ['e4acbac3-e425-4325-87b9-3631c022a618'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:10.027921 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] Routers {'e4acbac3-e425-4325-87b9-3631c022a618'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:10.028544 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e4acbac3-e425-4325-87b9-3631c022a618'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:10.114481 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:10.135195 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] Routers {'e4acbac3-e425-4325-87b9-3631c022a618'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:10.137124 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e4acbac3-e425-4325-87b9-3631c022a618'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:10.177687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.181241 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b6763eaf-7218-4eb4-befe-0c7a090ea00d tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/ports/417d3635-56d3-4c93-be04-53e154fce289 HTTP/1.1" status: 204 len: 168 time: 0.9721365 Dec 21 03:59:10.183950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37004) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:10.187337 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:10.187980 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8a0e92-0cf1-4e80-95e8-3faffa368a38 None None] The sync data for ids ['e4acbac3-e425-4325-87b9-3631c022a618'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:10.199583 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.200792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c2a9143-a5ae-4b94-b282-a36ad3e32f54 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.4948516 Dec 21 03:59:10.203705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37006) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:10.209144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': False}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:10.259273 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f60c5fe-f221-4de0-8e22-891656ece491 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] GET failed (client error): The resource could not be found. Dec 21 03:59:10.263364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f60c5fe-f221-4de0-8e22-891656ece491 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "GET /v2.0/ports/417d3635-56d3-4c93-be04-53e154fce289 HTTP/1.1" status: 404 len: 333 time: 0.0757301 Dec 21 03:59:10.266661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:10.356172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Made reservation on behalf of c6bd15b1a97c48988675651221b1407c for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:10.359963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.450778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port 76ea610b-7c0a-46bb-be42-e855260a695f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:10.451417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.620923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.631859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.673030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for 76ea610b-7c0a-46bb-be42-e855260a695f owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:10.688596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event updated for resources: {'Subnet': ['ID=23df6c36-6730-42b9-8b4c-bcaa439e8abc,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:10.696829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Checking segment: {'id': 'b43067af-b0bb-401c-a4fc-de60e951e1f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:10.697561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Network hostable DHCP agents. Network: bf4eb920-cb2a-4d07-8465-04e04e08ddcf, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:59:10.731208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.752204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:10.836734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, bf4eb920-cb2a-4d07-8465-04e04e08ddcf) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:10.854204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:10.854683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6323a4b2-609d-41e5-a7b3-1e9ec0a9cce3 None None] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:10.855188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:10.928485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-f9c8ba4a-5150-4565-8555-1d2fd0434781 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:10.930454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-f9c8ba4a-5150-4565-8555-1d2fd0434781 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.31 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 950 time: 0.0897357 Dec 21 03:59:10.964636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.005318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=76ea610b-7c0a-46bb-be42-e855260a695f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:11.038865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.042225 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-06e4f765-31f0-4ed6-b8ac-10c5b63108ca tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/ports/76ea610b-7c0a-46bb-be42-e855260a695f HTTP/1.1" status: 204 len: 168 time: 0.7775569 Dec 21 03:59:11.044843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37020) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:11.047234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8fc7418-1c37-42d6-9a80-4c6130c4ee22 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0714033 Dec 21 03:59:11.053878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37022) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:11.067202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Request body: {'port': {'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf', 'name': 'tempest-DHCPAgentSchedulersTestJSON-1933070885'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:11.078071 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-7228302c-867b-498c-9854-5ec1b70cabb8 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] GET failed (client error): The resource could not be found. Dec 21 03:59:11.083794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7228302c-867b-498c-9854-5ec1b70cabb8 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "GET /v2.0/ports/76ea610b-7c0a-46bb-be42-e855260a695f HTTP/1.1" status: 404 len: 333 time: 0.0337722 Dec 21 03:59:11.085564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37024) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:11.151270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-bf4eb920-cb2a-4d07-8465-04e04e08ddcf', 'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf', 'project_id': 'c6bd15b1a97c48988675651221b1407c', 'fixed_ips': [{'subnet_id': '23df6c36-6730-42b9-8b4c-bcaa439e8abc'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:59:11.152664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.308014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e82e2d8-bef9-4ae1-9262-1739f02082dd req-b5671778-a2f4-47f3-aea5-83f5c3d25ce9 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:11.309593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e82e2d8-bef9-4ae1-9262-1739f02082dd req-b5671778-a2f4-47f3-aea5-83f5c3d25ce9 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 950 time: 0.2567906 Dec 21 03:59:11.427739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Allocated IP 172.20.0.2 (bf4eb920-cb2a-4d07-8465-04e04e08ddcf/23df6c36-6730-42b9-8b4c-bcaa439e8abc/bfeba399-2e99-4985-8c0e-77f0ffe647a2) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:11.472462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port 3f4c9cca-ade2-42d8-a467-13dd3649de15 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:11.473056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.503987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e82e2d8-bef9-4ae1-9262-1739f02082dd req-2310c55a-2025-4d9a-aaf4-85b625ea08e6 tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/security-groups?id=e8f169bf-178e-4dcb-91b1-f1fc233d76ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1781254 Dec 21 03:59:11.512547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Deleting port 78818bea-9135-439f-ba14-ea0f3224b16d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:11.513062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.615968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Made reservation on behalf of c6bd15b1a97c48988675651221b1407c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:11.619871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.659329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.682325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] device_id is not set on port b5edbe1f-2771-49e7-875c-cf731e382ac3 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:11.696773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] For port 78818bea-9135-439f-ba14-ea0f3224b16d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=78818bea-9135-439f-ba14-ea0f3224b16d,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:11.697084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.746709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Calling delete_port for 78818bea-9135-439f-ba14-ea0f3224b16d owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:11.757944 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.814216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:11.822359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:11.826393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:11.840797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Pushing event updated for resources: {'Port': ['ID=bfeba399-2e99-4985-8c0e-77f0ffe647a2,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:11.879445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Allocated IP 172.20.0.8 (bf4eb920-cb2a-4d07-8465-04e04e08ddcf/23df6c36-6730-42b9-8b4c-bcaa439e8abc/b5edbe1f-2771-49e7-875c-cf731e382ac3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:11.892989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Attempting to bind port bfeba399-2e99-4985-8c0e-77f0ffe647a2 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:59:11.893574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Attempting to bind port bfeba399-2e99-4985-8c0e-77f0ffe647a2 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b43067af-b0bb-401c-a4fc-de60e951e1f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:59:11.894469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Attempting to bind port bfeba399-2e99-4985-8c0e-77f0ffe647a2 on network bf4eb920-cb2a-4d07-8465-04e04e08ddcf {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:11.901650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 58, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:59:11.902095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Checking segment: {'id': 'b43067af-b0bb-401c-a4fc-de60e951e1f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:11.902513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.903599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Bound using segment: {'id': 'b43067af-b0bb-401c-a4fc-de60e951e1f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:59:11.904112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Bound port: bfeba399-2e99-4985-8c0e-77f0ffe647a2, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b43067af-b0bb-401c-a4fc-de60e951e1f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'bf4eb920-cb2a-4d07-8465-04e04e08ddcf'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:59:11.904829 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:11.993044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] For port bfeba399-2e99-4985-8c0e-77f0ffe647a2, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:59:11.996193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] For port bfeba399-2e99-4985-8c0e-77f0ffe647a2, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bfeba399-2e99-4985-8c0e-77f0ffe647a2,segment=NetworkSegment(b43067af-b0bb-401c-a4fc-de60e951e1f0),segment_id=b43067af-b0bb-401c-a4fc-de60e951e1f0)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:59:12.046603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.083930 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.103267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Pushing event deleted for resources: {'Port': ['ID=78818bea-9135-439f-ba14-ea0f3224b16d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:12.227395 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.242063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for 3f4c9cca-ade2-42d8-a467-13dd3649de15 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:12.243830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84aa5c8a-e534-49ab-bfb7-ee9301d99bb7 None None] Pushing event updated for resources: {'Port': ['ID=bfeba399-2e99-4985-8c0e-77f0ffe647a2,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:12.284392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] No DVR routers for this DVR port 78818bea-9135-439f-ba14-ea0f3224b16d on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:12.288302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.293508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dc86b69-e1bd-4075-8305-d737d7f95fd4 req-575761dd-3f87-4250-a968-18fe18eba1da tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.31 "DELETE /v2.0/ports/78818bea-9135-439f-ba14-ea0f3224b16d HTTP/1.1" status: 204 len: 173 time: 1.3516335 Dec 21 03:59:12.297235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'name': 'network-vif-deleted', 'tag': '78818bea-9135-439f-ba14-ea0f3224b16d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:59:12.300795 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a40c88bc-663d-43a7-93bf-5e8b6d053e84" -d '{"events": [{"server_uuid": "40743738-7ec9-41a6-9b98-309630a3fcbb", "name": "network-vif-deleted", "tag": "78818bea-9135-439f-ba14-ea0f3224b16d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:59:12.377615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.384642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.400952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.482973 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:59:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0579d16e-14a5-437d-b5d3-8f9e6ab8f5e0 x-openstack-request-id: req-0579d16e-14a5-437d-b5d3-8f9e6ab8f5e0 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:59:12.485879 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40743738-7ec9-41a6-9b98-309630a3fcbb", "name": "network-vif-deleted", "tag": "78818bea-9135-439f-ba14-ea0f3224b16d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:59:12.485879 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0579d16e-14a5-437d-b5d3-8f9e6ab8f5e0 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:59:12.489946 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40743738-7ec9-41a6-9b98-309630a3fcbb', 'name': 'network-vif-deleted', 'tag': '78818bea-9135-439f-ba14-ea0f3224b16d', 'status': 'completed', 'code': 200} Dec 21 03:59:12.553263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.629932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:12.639444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:12.644887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:12.732096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6121a768-ff32-4648-bc0d-0f1c24b8c9bb req-80d3ed32-c57e-4620-9e21-3c66626fa47b tempest-ImagesNegativeTestJSON-931311001 tempest-ImagesNegativeTestJSON-931311001-project] 10.222.0.18 "GET /v2.0/ports?device_id=40743738-7ec9-41a6-9b98-309630a3fcbb HTTP/1.1" status: 200 len: 210 time: 0.0781207 Dec 21 03:59:12.732666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event updated for resources: {'Port': ['ID=b5edbe1f-2771-49e7-875c-cf731e382ac3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:12.769469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Router e4acbac3-e425-4325-87b9-3631c022a618 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:12.780903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:12.781622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.882228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.914909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5103710d-7726-4a2b-8a6b-ac22c23f2645 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.8537529 Dec 21 03:59:12.918270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37042) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:12.935937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=3f4c9cca-ade2-42d8-a467-13dd3649de15,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:12.964037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:12.967340 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8fa7e7e8-bd0f-4004-9c19-80365ea574a2 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/ports/3f4c9cca-ade2-42d8-a467-13dd3649de15 HTTP/1.1" status: 204 len: 168 time: 1.8815928 Dec 21 03:59:12.969870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37044) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:12.982234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:12.992021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] Sync routers for ids ['e4acbac3-e425-4325-87b9-3631c022a618'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:13.012116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] Routers {'e4acbac3-e425-4325-87b9-3631c022a618'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:13.012868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e4acbac3-e425-4325-87b9-3631c022a618'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:13.016459 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.018410 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b15f15bf-0011-45d6-98b2-8094b1200a22 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "PUT /v2.0/routers/e4acbac3-e425-4325-87b9-3631c022a618 HTTP/1.1" status: 200 len: 923 time: 2.8129873 Dec 21 03:59:13.022721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37046) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:13.062164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:13.078574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] Routers {'e4acbac3-e425-4325-87b9-3631c022a618'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:13.079538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e4acbac3-e425-4325-87b9-3631c022a618'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:13.108912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Deleting port b5edbe1f-2771-49e7-875c-cf731e382ac3 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:13.109499 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.160274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b98711ee-2e08-4c63-afd5-06e54b78d055 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/e4acbac3-e425-4325-87b9-3631c022a618 HTTP/1.1" status: 200 len: 923 time: 0.1329207 Dec 21 03:59:13.163224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:13.203921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting subnet 98c87d1b-7603-4a9d-96ab-b95a101c8b67 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:13.208708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.276095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.344228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:13.345257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecbb3b35-316e-4a41-bad7-36378e6c1621 None None] The sync data for ids ['e4acbac3-e425-4325-87b9-3631c022a618'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:13.378035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.402889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Calling delete_port for b5edbe1f-2771-49e7-875c-cf731e382ac3 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:13.522630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20a4b36a-29c7-46e9-9d95-e0771ca695b0 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:13.527659 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-20a4b36a-29c7-46e9-9d95-e0771ca695b0 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=e4acbac3-e425-4325-87b9-3631c022a618&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.3634038 Dec 21 03:59:13.530663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37052) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:13.624707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.692910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdf5f5af-19b4-4852-a898-b59faf43d45b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:13.697541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37054) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:13.697751 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cdf5f5af-19b4-4852-a898-b59faf43d45b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.1657181 Dec 21 03:59:13.708795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.726245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-596dc931-c62a-45c4-a227-157b25ffc95b None None] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:13.734550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-696600d4-c4ad-4309-86e0-f530fba7d376 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4acbac3-e425-4325-87b9-3631c022a618 HTTP/1.1" status: 200 len: 205 time: 0.0357211 Dec 21 03:59:13.738165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:13.765476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event deleted for resources: {'Port': ['ID=b5edbe1f-2771-49e7-875c-cf731e382ac3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:13.860504 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.867916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bd4afe4e-02b6-44cd-b62c-742c84256085 None None] Provisioning complete for port bfeba399-2e99-4985-8c0e-77f0ffe647a2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:13.868420 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd4afe4e-02b6-44cd-b62c-742c84256085 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.907517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:13.911846 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/subnets/98c87d1b-7603-4a9d-96ab-b95a101c8b67 HTTP/1.1" status: 204 len: 168 time: 0.9410064 Dec 21 03:59:13.922997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37066) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:13.954639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f215fcce-a515-43c3-96a1-ca672c45a4d7 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Subnet': ['ID=98c87d1b-7603-4a9d-96ab-b95a101c8b67,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:13.958379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e80cfca-45a4-4205-9011-b899a2bcedd0 None None] Network ef210d11-9dbc-4951-a05a-ecb9e2edf31f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:13.963381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 78818bea-9135-439f-ba14-ea0f3224b16d no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:14.009794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.013188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-96dd0152-ad73-4e9b-9710-9cb9e521b4a9 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "DELETE /v2.0/ports/b5edbe1f-2771-49e7-875c-cf731e382ac3 HTTP/1.1" status: 204 len: 168 time: 1.0939178 Dec 21 03:59:14.018356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.021183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37076) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:14.021344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 78818bea-9135-439f-ba14-ea0f3224b16d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:14.023394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 78818bea-9135-439f-ba14-ea0f3224b16d not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:14.136589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.146325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4853351e-c1f3-4559-a771-28253f9eb233 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4937 time: 0.1215215 Dec 21 03:59:14.148290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37082) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:14.153204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1059312746'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:14.212229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Deleting port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:14.212570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.276366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd4afe4e-02b6-44cd-b62c-742c84256085 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.313243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bd4afe4e-02b6-44cd-b62c-742c84256085 None None] For port bfeba399-2e99-4985-8c0e-77f0ffe647a2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bfeba399-2e99-4985-8c0e-77f0ffe647a2,segment=NetworkSegment(b43067af-b0bb-401c-a4fc-de60e951e1f0),segment_id=b43067af-b0bb-401c-a4fc-de60e951e1f0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:14.370598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.380207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] DHCP port deletion for ef210d11-9dbc-4951-a05a-ecb9e2edf31f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:14.393370 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd4afe4e-02b6-44cd-b62c-742c84256085 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.424675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] For port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,segment=NetworkSegment(42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb),segment_id=42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:14.424675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.448315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Calling delete_port for 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:14.507834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd4afe4e-02b6-44cd-b62c-742c84256085 None None] Pushing event updated for resources: {'Port': ['ID=bfeba399-2e99-4985-8c0e-77f0ffe647a2,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:14.517590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bfeba399-2e99-4985-8c0e-77f0ffe647a2 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:59:14.542630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Deleting port 3c929d25-d336-486f-b3b8-0d8d47b5c0f8 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:14.542630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.559906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Made reservation on behalf of c6bd15b1a97c48988675651221b1407c for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:14.570101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.605486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] Deleting port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:14.605867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.646407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:14.679389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.679748 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Added segment 80639ff2-d4cf-44b4-982e-8509a0d1b4e5 of type vlan for network 2b94183f-1c04-40b8-9559-1f5d3c28e49c Dec 21 03:59:14.685023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e11080f9-dbd7-4acb-bc05-4ba26229106f None None] Provisioning complete for port bfeba399-2e99-4985-8c0e-77f0ffe647a2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:14.685398 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e11080f9-dbd7-4acb-bc05-4ba26229106f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.727267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.751240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bfeba399-2e99-4985-8c0e-77f0ffe647a2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:14.753360 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.771294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.772039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.788687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Calling delete_port for 3c929d25-d336-486f-b3b8-0d8d47b5c0f8 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:14.831360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] For port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,segment=NetworkSegment(42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb),segment_id=42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:14.831904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.857924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Port': ['ID=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:14.857924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] No DVR routers for this DVR port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:14.875618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] Calling delete_port for 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:14.880748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.888606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:14.891706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:14.965990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37092) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:15.168766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.194472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] No DVR routers for this DVR port 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:15.197674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.0456669 Dec 21 03:59:15.198417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:15.203502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa2c4731-fe40-4303-9469-40ebd8025139 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event updated for resources: {'Network': ['ID=2b94183f-1c04-40b8-9559-1f5d3c28e49c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:15.251190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.256082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d5b6921-3494-41c8-acfa-203411c71553 None None] Pushing event deleted for resources: {'Port': ['ID=7d7759c7-9183-4350-8dc5-c1d52ee1bf3a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:15.262874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 2b94183f-1c04-40b8-9559-1f5d3c28e49c details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:15.289372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7820e26c-c5c8-43f8-a771-17d4219c44b2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=029528ffc12a421282c1eeef88e2b8bd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3197875 Dec 21 03:59:15.290774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37100) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:15.293220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b1e8f87f-8f26-4543-bb98-688206e2df03 None None] Could not find standard attr ID for object b5edbe1f-2771-49e7-875c-cf731e382ac3. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 03:59:15.297784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.301344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ef210d11-9dbc-4951-a05a-ecb9e2edf31f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:15.346965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:15.347356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42c5f5c7-a8d4-4e3d-80d6-0c9995b4a6cb') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:15.359552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.365083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event deleted for resources: {'Port': ['ID=3c929d25-d336-486f-b3b8-0d8d47b5c0f8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:15.386969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cab89c6e-a4b8-45ea-b28a-5862950a5791 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:15.387861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.398521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:15.399508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:15.403274 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:15.446153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.481357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd39a03f-e9ea-4020-b960-7af805b4ff12 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.507019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd39a03f-e9ea-4020-b960-7af805b4ff12 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.540757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.548544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.552440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] 10.222.0.18 "DELETE /v2.0/networks/ef210d11-9dbc-4951-a05a-ecb9e2edf31f HTTP/1.1" status: 204 len: 168 time: 1.6269646 Dec 21 03:59:15.566994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4722bb-4f43-4d95-a5c6-c618f4d6bb71 tempest-AllowedAddressPairIpV6TestJSON-1229468662 tempest-AllowedAddressPairIpV6TestJSON-1229468662-project] Pushing event deleted for resources: {'Network': ['ID=ef210d11-9dbc-4951-a05a-ecb9e2edf31f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:15.659570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd39a03f-e9ea-4020-b960-7af805b4ff12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.662293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd39a03f-e9ea-4020-b960-7af805b4ff12 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.666210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd39a03f-e9ea-4020-b960-7af805b4ff12 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e8f169bf-178e-4dcb-91b1-f1fc233d76ef HTTP/1.1" status: 204 len: 168 time: 0.3722081 Dec 21 03:59:15.676724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd39a03f-e9ea-4020-b960-7af805b4ff12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8f169bf-178e-4dcb-91b1-f1fc233d76ef,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:15.889843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.894119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:15.956901 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7523d959-5bbf-4a8e-b689-c5737e67f6fa tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/agents/0e7efdb6-b734-456d-b1f1-e0d11b32e01e/dhcp-networks HTTP/1.1" status: 200 len: 9642 time: 0.7530334 Dec 21 03:59:15.957260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37108) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.061060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ae41578-6416-4939-a3ef-6cba2a8f39c3 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] Network 2b94183f-1c04-40b8-9559-1f5d3c28e49c is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:16.063120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.063637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Fanout notify agent at l3_agent the message router_deleted on router e4acbac3-e425-4325-87b9-3631c022a618 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:16.074694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.079745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7923c89c-3eba-48ea-b183-a258482b1311 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/e4acbac3-e425-4325-87b9-3631c022a618 HTTP/1.1" status: 204 len: 168 time: 2.3354161 Dec 21 03:59:16.080801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.083331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37118) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.085655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1103999628', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:16.166840 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ae41578-6416-4939-a3ef-6cba2a8f39c3 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "POST /v2.0/agents/0e7efdb6-b734-456d-b1f1-e0d11b32e01e/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.2062948 Dec 21 03:59:16.167336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.169884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c009c67a-5799-4747-92aa-b7aa455e5dbd None None] Network 2b94183f-1c04-40b8-9559-1f5d3c28e49c requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:16.197856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.200456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.273424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.340606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.370095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bfeba399-2e99-4985-8c0e-77f0ffe647a2 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:59:16.423647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bfeba399-2e99-4985-8c0e-77f0ffe647a2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:16.424737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.463597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-795dfbdf-de2f-44ee-a10f-c368485858e8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=92bacc7261014451a5c5c84e47a29116&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3790343 Dec 21 03:59:16.466352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.469267 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-128d5ffb-508f-41b3-960d-ed549fa905a5 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/agents/0e7efdb6-b734-456d-b1f1-e0d11b32e01e/dhcp-networks HTTP/1.1" status: 200 len: 9640 time: 0.3003888 Dec 21 03:59:16.471253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37136) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.476123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.483601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04daa64b-1765-48e1-b203-489b366a572e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.3991110 Dec 21 03:59:16.484575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.492489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:16.623434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:16.646966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:16.647345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7d7759c7-9183-4350-8dc5-c1d52ee1bf3a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:16.698193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c2edf34b-ae13-4cb9-9c65-0b00ae292879 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "DELETE /v2.0/agents/0e7efdb6-b734-456d-b1f1-e0d11b32e01e/dhcp-networks/2b94183f-1c04-40b8-9559-1f5d3c28e49c HTTP/1.1" status: 204 len: 168 time: 0.2247653 Dec 21 03:59:16.699005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.853202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f71874b-155b-446f-90fb-fbc2e4645790 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.864527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29b53cb5-de71-4814-b4de-58d8d00cd373 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/agents/0e7efdb6-b734-456d-b1f1-e0d11b32e01e/dhcp-networks HTTP/1.1" status: 200 len: 8869 time: 0.1642499 Dec 21 03:59:16.868131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.869472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.885443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f71874b-155b-446f-90fb-fbc2e4645790 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:16.893202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b0a1fe8c-01b8-421c-add5-9ca60a3191cb tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/networks/bf4eb920-cb2a-4d07-8465-04e04e08ddcf/dhcp-agents HTTP/1.1" status: 200 len: 798 time: 0.0183978 Dec 21 03:59:16.895678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:16.913466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f23569c1-baf7-4074-a92e-e0cfd06b5d9a tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/networks/bf4eb920-cb2a-4d07-8465-04e04e08ddcf/dhcp-agents HTTP/1.1" status: 200 len: 798 time: 0.0167301 Dec 21 03:59:16.918347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:17.032992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f71874b-155b-446f-90fb-fbc2e4645790 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.036218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f71874b-155b-446f-90fb-fbc2e4645790 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.038307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f71874b-155b-446f-90fb-fbc2e4645790 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0cee9157-2e40-4297-b941-0892af2d7616 HTTP/1.1" status: 204 len: 168 time: 0.5692770 Dec 21 03:59:17.051509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f71874b-155b-446f-90fb-fbc2e4645790 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cee9157-2e40-4297-b941-0892af2d7616,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:17.069675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-92bc26d0-1675-4f8a-bebe-f28954fc5b26 tempest-DHCPAgentSchedulersTestJSON-1818486049 tempest-DHCPAgentSchedulersTestJSON-1818486049-project-admin] 10.222.0.18 "GET /v2.0/agents/0e7efdb6-b734-456d-b1f1-e0d11b32e01e/dhcp-networks HTTP/1.1" status: 200 len: 8869 time: 0.1500263 Dec 21 03:59:17.075055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37164) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:17.278729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.532510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.611113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2b94183f-1c04-40b8-9559-1f5d3c28e49c']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:17.613958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.643381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '80639ff2-d4cf-44b4-982e-8509a0d1b4e5') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:17.643683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '80639ff2-d4cf-44b4-982e-8509a0d1b4e5') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:17.651714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.656910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.718102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.733061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:17.733487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:17.736710 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:17.855353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Allocated IP 172.25.5.160 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/d03f084b-d510-4a39-9935-d3108a06ffd5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:17.934501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.940475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:17.946288 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "DELETE /v2.0/networks/2b94183f-1c04-40b8-9559-1f5d3c28e49c HTTP/1.1" status: 204 len: 168 time: 0.8654122 Dec 21 03:59:17.946403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37184) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:17.974742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e18a489-7c70-424b-9659-8e1e5dfc64f0 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event deleted for resources: {'Network': ['ID=2b94183f-1c04-40b8-9559-1f5d3c28e49c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:17.988728 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d1c3e106-ac0c-485f-a9a4-342015248024 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] DELETE failed (client error): The resource could not be found. Dec 21 03:59:17.989300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d1c3e106-ac0c-485f-a9a4-342015248024 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:59:18.001741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d1c3e106-ac0c-485f-a9a4-342015248024 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "DELETE /v2.0/ports/b5edbe1f-2771-49e7-875c-cf731e382ac3 HTTP/1.1" status: 404 len: 333 time: 0.0542517 Dec 21 03:59:18.004839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37186) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:18.091038 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.113640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Deleting subnet 23df6c36-6730-42b9-8b4c-bcaa439e8abc {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:18.118219 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.208593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.336358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.342117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.417174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:18.425878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:18.434758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:18.453520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7aac82ce-dd7b-4200-9f98-1f0cfb9b94d7 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:18.461389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event updated for resources: {'Port': ['ID=d03f084b-d510-4a39-9935-d3108a06ffd5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:18.500396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37208) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:18.545192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-675373d8-3aab-4d5b-be1e-0378adc80646 None None] Provisioning complete for port d03f084b-d510-4a39-9935-d3108a06ffd5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:18.547846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-675373d8-3aab-4d5b-be1e-0378adc80646 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.556503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.619543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-675373d8-3aab-4d5b-be1e-0378adc80646 None None] Port d03f084b-d510-4a39-9935-d3108a06ffd5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:18.666540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-1876842828'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:18.676759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event deleted for resources: {'Subnet': ['ID=23df6c36-6730-42b9-8b4c-bcaa439e8abc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:18.678922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.686115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d5679e8-ee49-43de-aa44-4f03d648aad3 None None] Network bf4eb920-cb2a-4d07-8465-04e04e08ddcf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:18.686234 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d0afc3d-b280-41ad-80bf-e1ae150ae702 tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "DELETE /v2.0/subnets/23df6c36-6730-42b9-8b4c-bcaa439e8abc HTTP/1.1" status: 204 len: 168 time: 0.6778269 Dec 21 03:59:18.686986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:18.786727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:18.790635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.793291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.817388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.906399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] DHCP port deletion for bf4eb920-cb2a-4d07-8465-04e04e08ddcf request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:18.935445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.963753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] Deleting port bfeba399-2e99-4985-8c0e-77f0ffe647a2 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:18.964490 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.984687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:18.997530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.014108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:19.030719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.031261 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Added segment 2f379871-dbca-4507-9277-511a25d54bce of type vlan for network b672c264-59db-4f56-873d-1e399cb0cd1a Dec 21 03:59:19.040309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] For port bfeba399-2e99-4985-8c0e-77f0ffe647a2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bfeba399-2e99-4985-8c0e-77f0ffe647a2,segment=NetworkSegment(b43067af-b0bb-401c-a4fc-de60e951e1f0),segment_id=b43067af-b0bb-401c-a4fc-de60e951e1f0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:19.040888 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.058914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] Calling delete_port for bfeba399-2e99-4985-8c0e-77f0ffe647a2 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:19.093386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Deleting port bfeba399-2e99-4985-8c0e-77f0ffe647a2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:19.093732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.185111 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.213203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ad9bf3b4-caff-4459-92b9-2263e7c61a06,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:19.239543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] For port bfeba399-2e99-4985-8c0e-77f0ffe647a2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bfeba399-2e99-4985-8c0e-77f0ffe647a2,segment=NetworkSegment(b43067af-b0bb-401c-a4fc-de60e951e1f0),segment_id=b43067af-b0bb-401c-a4fc-de60e951e1f0)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:19.240222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.265891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.289349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Calling delete_port for bfeba399-2e99-4985-8c0e-77f0ffe647a2 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:19.300472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.309403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:19.310371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.324647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] Pushing event deleted for resources: {'Port': ['ID=bfeba399-2e99-4985-8c0e-77f0ffe647a2,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:19.326771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdcbcbfb-fc5d-4b23-a734-9980d0a0d31d None None] No DVR routers for this DVR port bfeba399-2e99-4985-8c0e-77f0ffe647a2 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:19.356169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.364204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.415990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Network': ['ID=b672c264-59db-4f56-873d-1e399cb0cd1a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:19.441673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b672c264-59db-4f56-873d-1e399cb0cd1a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:19.461994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2dd2a58d-2b5b-434b-b061-8e136c645452 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.9546227 Dec 21 03:59:19.461994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37226) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:19.463748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'subnet': {'network_id': 'b672c264-59db-4f56-873d-1e399cb0cd1a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:19.528441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.600144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event deleted for resources: {'Port': ['ID=bfeba399-2e99-4985-8c0e-77f0ffe647a2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:19.607021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] No DVR routers for this DVR port bfeba399-2e99-4985-8c0e-77f0ffe647a2 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:19.684132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:19.688858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.714566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.751755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bf4eb920-cb2a-4d07-8465-04e04e08ddcf']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:19.769001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b43067af-b0bb-401c-a4fc-de60e951e1f0') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:19.769358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b43067af-b0bb-401c-a4fc-de60e951e1f0') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:19.781067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.799246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.806567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:19.806979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:19.810234 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:19.855191 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ccc7c88e-3f46-43c4-ab15-0b6c0b744604 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.862994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Router e06663d1-9648-4977-b7b9-701aa19434ab is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:59:19.976611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.991094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:19.994484 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] 10.222.0.18 "DELETE /v2.0/networks/bf4eb920-cb2a-4d07-8465-04e04e08ddcf HTTP/1.1" status: 204 len: 168 time: 1.3063164 Dec 21 03:59:20.052245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfbb9fe5-20c7-4d51-9440-5f8f2490ce2b tempest-DHCPAgentSchedulersTestJSON-1456952228 tempest-DHCPAgentSchedulersTestJSON-1456952228-project] Pushing event deleted for resources: {'Network': ['ID=bf4eb920-cb2a-4d07-8465-04e04e08ddcf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:20.068322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:20.083936 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] Sync routers for ids ['e06663d1-9648-4977-b7b9-701aa19434ab'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:20.098632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:20.101337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3adab540-906b-4a69-bd49-6823f6f9566d tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "PUT /v2.0/routers/e06663d1-9648-4977-b7b9-701aa19434ab HTTP/1.1" status: 200 len: 884 time: 3.6161041 Dec 21 03:59:20.104153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37244) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:20.114414 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] Routers {'e06663d1-9648-4977-b7b9-701aa19434ab'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:20.114982 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e06663d1-9648-4977-b7b9-701aa19434ab'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:20.191109 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:20.213413 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] Routers {'e06663d1-9648-4977-b7b9-701aa19434ab'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:20.214288 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:58:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['e06663d1-9648-4977-b7b9-701aa19434ab'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:20.280305 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:20.284256 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05b3d237-2473-421f-b162-6a988a6530e6 None None] The sync data for ids ['e06663d1-9648-4977-b7b9-701aa19434ab'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:20.351999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:20.397864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bfeba399-2e99-4985-8c0e-77f0ffe647a2 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:20.431098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Subnet': ['ID=76bec629-6735-4479-9cb2-edaf6be1f8e5,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:20.440368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Checking segment: {'id': '2f379871-dbca-4507-9277-511a25d54bce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'b672c264-59db-4f56-873d-1e399cb0cd1a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:20.441132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network hostable DHCP agents. Network: b672c264-59db-4f56-873d-1e399cb0cd1a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:59:20.448667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: bfeba399-2e99-4985-8c0e-77f0ffe647a2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:20.449547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bfeba399-2e99-4985-8c0e-77f0ffe647a2 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:20.550947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:20.671718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b672c264-59db-4f56-873d-1e399cb0cd1a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:20.681119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:20.681731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:20.687696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06cb9720-8a03-4f33-8980-7188bd1c3af5 None None] Network b672c264-59db-4f56-873d-1e399cb0cd1a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:20.726726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37254) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:20.761392 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7a6e7369-fc41-4287-878e-efd120632aff tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/e06663d1-9648-4977-b7b9-701aa19434ab HTTP/1.1" status: 200 len: 925 time: 0.6528647 Dec 21 03:59:20.764221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37262) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:20.822330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b4cbe49c-eeae-4115-b1d1-e41f13e10e54 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 1.3638186 Dec 21 03:59:20.825200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37264) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:20.833827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-191037257', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:20.853057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:20.876003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c3f4dad-0050-473c-9497-4c4b826d5721 None None] Network b672c264-59db-4f56-873d-1e399cb0cd1a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:20.932369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a881571-49d8-43a6-9301-c56089ac2ade tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:20.934164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a881571-49d8-43a6-9301-c56089ac2ade tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=e06663d1-9648-4977-b7b9-701aa19434ab&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1689253 Dec 21 03:59:20.937208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37270) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:20.983713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:20.984597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.055724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f64a08b-9487-4654-9308-30e4beaec2f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.088069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a0def004-3f58-4b9e-ab12-0a1c9fb7979d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c6bd15b1a97c48988675651221b1407c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3598726 Dec 21 03:59:21.091279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37272) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:21.119554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.137693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f170f70-7e05-4b70-bd28-a808726f3ee6 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:21.139173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f170f70-7e05-4b70-bd28-a808726f3ee6 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.2009268 Dec 21 03:59:21.142244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37274) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:21.147324 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ceecb1-e8fd-4414-9f8d-29c627da00e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.181580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e633776-fd2b-45fa-aba5-e2efe659ac9e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=e06663d1-9648-4977-b7b9-701aa19434ab HTTP/1.1" status: 200 len: 205 time: 0.0357933 Dec 21 03:59:21.181983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37276) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:21.363192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37280) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:21.467384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f64a08b-9487-4654-9308-30e4beaec2f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.470081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.486200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.534250 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f64a08b-9487-4654-9308-30e4beaec2f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.577001 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ceecb1-e8fd-4414-9f8d-29c627da00e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.680549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f64a08b-9487-4654-9308-30e4beaec2f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efc86966-7e5b-4b99-a16f-ca5271edad6e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:21.724469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8f64a08b-9487-4654-9308-30e4beaec2f9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bec84b0c3b4f449b94f9b9a83edca62c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8672678 Dec 21 03:59:21.727922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37284) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:21.746298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ceecb1-e8fd-4414-9f8d-29c627da00e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.749158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ceecb1-e8fd-4414-9f8d-29c627da00e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.755138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5ceecb1-e8fd-4414-9f8d-29c627da00e4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1ea8d685-43d3-408c-b7e5-9138d34ed341 HTTP/1.1" status: 204 len: 168 time: 0.6631656 Dec 21 03:59:21.771054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ceecb1-e8fd-4414-9f8d-29c627da00e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ea8d685-43d3-408c-b7e5-9138d34ed341,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:21.815768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14a4cae4-82ba-4089-add7-cac25f570e35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.834135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:21.845404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14a4cae4-82ba-4089-add7-cac25f570e35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.031946 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14a4cae4-82ba-4089-add7-cac25f570e35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.034830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14a4cae4-82ba-4089-add7-cac25f570e35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.036031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-14a4cae4-82ba-4089-add7-cac25f570e35 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/efc86966-7e5b-4b99-a16f-ca5271edad6e HTTP/1.1" status: 204 len: 168 time: 0.3062010 Dec 21 03:59:22.044793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a4cae4-82ba-4089-add7-cac25f570e35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efc86966-7e5b-4b99-a16f-ca5271edad6e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:22.126576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.155986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.228080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Deleting port d03f084b-d510-4a39-9935-d3108a06ffd5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:22.228424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.388485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.57 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/02c36e98-2bb6-4566-9018-cef4e07bfa56) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:22.393971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.415290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Calling delete_port for d03f084b-d510-4a39-9935-d3108a06ffd5 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:22.524602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.727933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37304) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:22.743512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2604b52-cd09-448a-b9ba-db1db455deb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.751397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6c72d7e-fe10-4e09-b4c8-088453d8d4d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.751397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.841754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2604b52-cd09-448a-b9ba-db1db455deb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.888908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f2604b52-cd09-448a-b9ba-db1db455deb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:22.933520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f2604b52-cd09-448a-b9ba-db1db455deb1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0a1b71736e514887bc91edfbbc55571f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2044261 Dec 21 03:59:22.934740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2604b52-cd09-448a-b9ba-db1db455deb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dca2e320-3ace-47c2-9bf8-5a9036537b69,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:22.937472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37310) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:22.982981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.022422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2545093-bfe2-46cc-a928-d5e1a0bf58c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.047579 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2545093-bfe2-46cc-a928-d5e1a0bf58c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.220792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Deleting port 97ca28df-516e-42ca-a7be-46ce5c12dab9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:23.221136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.221472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2545093-bfe2-46cc-a928-d5e1a0bf58c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.224198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2545093-bfe2-46cc-a928-d5e1a0bf58c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.227843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d2545093-bfe2-46cc-a928-d5e1a0bf58c6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dca2e320-3ace-47c2-9bf8-5a9036537b69 HTTP/1.1" status: 204 len: 168 time: 0.2763417 Dec 21 03:59:23.235027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2545093-bfe2-46cc-a928-d5e1a0bf58c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dca2e320-3ace-47c2-9bf8-5a9036537b69,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:23.295291 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.300669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.310506 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.381322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72b0d8dd-8813-4376-87cd-cc3af83de576 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:23.401261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37324) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:23.402406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] For port 97ca28df-516e-42ca-a7be-46ce5c12dab9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=97ca28df-516e-42ca-a7be-46ce5c12dab9,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:23.402848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.414975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:23.422761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:23.437753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a2a3e14-0476-449e-8c6c-cca4188ac06d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:23.448111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:23.450404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Calling delete_port for 97ca28df-516e-42ca-a7be-46ce5c12dab9 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:23.490447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=02c36e98-2bb6-4566-9018-cef4e07bfa56,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:23.507055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d8a3cb0e-9f22-47f4-b3d0-2130f83a396e None None] Provisioning complete for port 02c36e98-2bb6-4566-9018-cef4e07bfa56 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:23.510721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a3cb0e-9f22-47f4-b3d0-2130f83a396e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.555021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d8a3cb0e-9f22-47f4-b3d0-2130f83a396e None None] Port 02c36e98-2bb6-4566-9018-cef4e07bfa56 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:23.573138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event deleted for resources: {'Port': ['ID=d03f084b-d510-4a39-9935-d3108a06ffd5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:23.587185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.687366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupRulesTestJSON-1650015096-network', 'tenant_id': '6a0b27fbd0d7479d80dde5acc2cf0587'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:23.758586 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.768729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Made reservation on behalf of 6a0b27fbd0d7479d80dde5acc2cf0587 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:23.771295 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.778540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.780275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.854981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.939023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.960923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:23.964934 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.965482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Fanout notify agent at l3_agent the message router_deleted on router e06663d1-9648-4977-b7b9-701aa19434ab {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:23.973200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.977808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1800ca96-35c5-48ed-a5a0-1f20fc963aeb,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:23.978026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-320f2bbe-4332-4809-971d-69ef737b6708 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/e06663d1-9648-4977-b7b9-701aa19434ab HTTP/1.1" status: 204 len: 168 time: 2.7950094 Dec 21 03:59:23.978683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37338) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:23.982147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:23.982499 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Added segment 304a8347-f0be-403b-8e64-c0c9317c7f4b of type vlan for network 3f59317a-85a3-4e33-993f-7690ec6b520a Dec 21 03:59:24.013772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1382827098', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:24.028664 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.084117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.134832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.136842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:24.137815 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.145902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Pushing event deleted for resources: {'Port': ['ID=97ca28df-516e-42ca-a7be-46ce5c12dab9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:24.188985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.190043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.207645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.229309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] Pushing event updated for resources: {'Network': ['ID=3f59317a-85a3-4e33-993f-7690ec6b520a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:24.255272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3f59317a-85a3-4e33-993f-7690ec6b520a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:24.267405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c14fc4b7-9c6b-48ae-8c43-472b8c86990e admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.8648467 Dec 21 03:59:24.273780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37350) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:24.274733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Request body: {'subnet': {'network_id': '3f59317a-85a3-4e33-993f-7690ec6b520a', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupRulesTestJSON-1650015096-subnet', 'tenant_id': '6a0b27fbd0d7479d80dde5acc2cf0587', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:24.401862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Made reservation on behalf of 6a0b27fbd0d7479d80dde5acc2cf0587 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:24.405377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.405527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.444888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37354) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:24.466063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.527100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.573943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-2093487685'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:24.625247 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.627189 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9777f010-2360-44b6-95d7-757ac5977fce tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6172304 Dec 21 03:59:24.629335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37358) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:24.634888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': True}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:24.653635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.676726 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.756376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Made reservation on behalf of bee33d9b5dd44524a5ca42938688ae55 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:24.759933 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.803075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.820067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Pushing event updated for resources: {'Subnet': ['ID=5817e346-c7b0-47c7-a6b5-16734a1a9318,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:24.831758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.909859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Checking segment: {'id': '304a8347-f0be-403b-8e64-c0c9317c7f4b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '3f59317a-85a3-4e33-993f-7690ec6b520a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:24.910589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Network hostable DHCP agents. Network: 3f59317a-85a3-4e33-993f-7690ec6b520a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:59:24.914335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:24.974221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.020428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Network 3f59317a-85a3-4e33-993f-7690ec6b520a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:25.096585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 3f59317a-85a3-4e33-993f-7690ec6b520a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:25.101244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:25.101855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.112940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-755b8b56-25c0-4439-87a4-464a413e3240 None None] Network 3f59317a-85a3-4e33-993f-7690ec6b520a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:25.248397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d6616715-0535-4c31-83a8-255ae1f0facf admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.9702551 Dec 21 03:59:25.277484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Router 2376a5de-876f-4295-bee4-f95526e6331c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:25.290156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eccfff3-e951-4d0d-b420-bbe319a5da00 None None] Network 3f59317a-85a3-4e33-993f-7690ec6b520a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:25.322005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.327121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.346869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.360240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:59:25.444440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.470001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Allocated IP 172.25.5.118 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/04f9fc65-dab4-4097-b640-8c08311d7d1c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:25.494578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:25.541036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:25.545597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98694348-a8cd-49da-86d9-d30839b406c2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:25.555244 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9e4dfcc4-f651-4e75-aa55-9121031aefcf admin admin] 10.222.0.18 "PUT /v2.0/routers/2376a5de-876f-4295-bee4-f95526e6331c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1894794 Dec 21 03:59:25.558578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37370) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:25.560860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.562686 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Added segment 71fe19a3-c08d-4874-a279-4728bf2f2259 of type vlan for network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 Dec 21 03:59:25.565156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] Sync routers for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:25.593844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:25.596381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:25.605235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:25.617529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c5f58b46-d056-44ae-9835-625e687220d2 req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1039305433', 'description': 'tempest-description-131565525'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:25.622603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.628874 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:25.641472 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:25.642426 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:25.679122 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:25.688020 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:25.688620 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:25.712278 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.731786 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:25.732877 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72bddd03-6de4-4e56-be33-436a636cc743 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:25.746206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.750373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.750547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:25.753175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:25.753175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.772113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.776243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05d8e4e8-4bdb-4770-8d12-f02991d6706f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 4.9467402 Dec 21 03:59:25.780847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:25.828697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.878722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event updated for resources: {'Network': ['ID=1a941802-6d1c-42c3-ab61-9ed82a89c8e0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:25.900394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.918078 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.967266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:25.968186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5f58b46-d056-44ae-9835-625e687220d2 req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:25.977263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:25.985969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Port': ['ID=04f9fc65-dab4-4097-b640-8c08311d7d1c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:25.988620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:26.010095 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-730c3fa7-3e63-4d9e-904d-5e43c6a994c2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 1.5601816 Dec 21 03:59:26.010095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37374) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:26.016235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Request body: {'subnet': {'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:26.026571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:26.028417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ea46ea5-3a15-4a30-b159-b3d6c2d88bb4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:26.146137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-610f7b67-b13c-481c-b050-0513e05f560e None None] Provisioning complete for port 04f9fc65-dab4-4097-b640-8c08311d7d1c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:26.146513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-610f7b67-b13c-481c-b050-0513e05f560e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.208856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-610f7b67-b13c-481c-b050-0513e05f560e None None] Port 04f9fc65-dab4-4097-b640-8c08311d7d1c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:26.222339 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5f58b46-d056-44ae-9835-625e687220d2 req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.227486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208'}], 'enable_snat': True}, 'gw_port_id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:59:23Z', 'revision_number': 5, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port': {'id': 'ed63a46c-413e-4dc5-a3f2-93a3a6e4330d', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:55:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2376a5de-876f-4295-bee4-f95526e6331c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:13Z', 'updated_at': '2021-12-21T03:47:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:26.231355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Deleting port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:26.231697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.252136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Made reservation on behalf of bee33d9b5dd44524a5ca42938688ae55 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:26.255738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.261345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] Checking router: 2376a5de-876f-4295-bee4-f95526e6331c for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:59:26.267942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] Routers {'2376a5de-876f-4295-bee4-f95526e6331c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:26.268677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2376a5de-876f-4295-bee4-f95526e6331c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:26.310665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5f58b46-d056-44ae-9835-625e687220d2 req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.371626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] Set router 2376a5de-876f-4295-bee4-f95526e6331c gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:26.413791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:26.447586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:59:25Z', 'revision_number': 6, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:26.465183 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c5f58b46-d056-44ae-9835-625e687220d2 req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.466431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5f58b46-d056-44ae-9835-625e687220d2 req-538c27df-6540-421e-88c1-9d5918c92cc5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1828 time: 0.8581147 Dec 21 03:59:26.476881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b60848aa-a544-4a2f-9b48-218016fc94f9 None None] The sync data for ids ['2376a5de-876f-4295-bee4-f95526e6331c'] in n-d-822053-11 is: [{'id': '2376a5de-876f-4295-bee4-f95526e6331c', 'name': 'tempest-TaggedBootDevicesTest-1984839539-router', 'tenant_id': '6d65cc45e25946eeb479e45c44089cf7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:12Z', 'updated_at': '2021-12-21T03:59:25Z', 'revision_number': 6, 'project_id': '6d65cc45e25946eeb479e45c44089cf7', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:26.490236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] For port ed63a46c-413e-4dc5-a3f2-93a3a6e4330d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:26.490620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.510859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Calling delete_port for ed63a46c-413e-4dc5-a3f2-93a3a6e4330d owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:26.536912 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.561720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.708233 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:26.826083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event updated for resources: {'Subnet': ['ID=8890af33-1cc9-4802-b4f0-cfedacdff654,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:26.847731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Checking segment: {'id': '71fe19a3-c08d-4874-a279-4728bf2f2259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:26.847960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Network hostable DHCP agents. Network: 1a941802-6d1c-42c3-ab61-9ed82a89c8e0, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:59:26.921016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-c7c9063c-2526-45ac-8abb-2630ff788e3a tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2 HTTP/1.1" status: 200 len: 1823 time: 0.4114296 Dec 21 03:59:26.969821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:26.972383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.1 (b672c264-59db-4f56-873d-1e399cb0cd1a/76bec629-6735-4479-9cb2-edaf6be1f8e5/e7652f44-2059-44fc-b35e-4bbb0850befc) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:26.977500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:26.977826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:27.063139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1a941802-6d1c-42c3-ab61-9ed82a89c8e0) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:27.072955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8692e733-15d3-479e-81cd-e133e52eca59 None None] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:27.075155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:27.076163 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.150631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.163421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-69f478fe-26d4-4171-8810-30e64f3c08a2 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1498237 Dec 21 03:59:27.163627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.163777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:27.169881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Request body: {'port': {'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1793228903'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:27.186262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-1a941802-6d1c-42c3-ab61-9ed82a89c8e0', 'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0', 'project_id': 'bee33d9b5dd44524a5ca42938688ae55', 'fixed_ips': [{'subnet_id': '8890af33-1cc9-4802-b4f0-cfedacdff654'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 03:59:27.186262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.222205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.245766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.259060 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.274402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Pushing event deleted for resources: {'Port': ['ID=ed63a46c-413e-4dc5-a3f2-93a3a6e4330d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:27.323604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dea79981-52e3-4bc3-9541-707a010a9b6c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:27.354282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Allocated IP 172.20.0.2 (1a941802-6d1c-42c3-ab61-9ed82a89c8e0/8890af33-1cc9-4802-b4f0-cfedacdff654/5b15e793-24d6-4571-8d9a-6223ce22ebe8) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:27.390505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.392395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Made reservation on behalf of bee33d9b5dd44524a5ca42938688ae55 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:27.399423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.419311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.426956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.480823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.482322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=e7652f44-2059-44fc-b35e-4bbb0850befc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:27.498315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] device_id is not set on port b2a3237b-a1d0-4e93-a027-d06690842a75 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:27.520011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:27.540828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.545922 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.549117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cff95741-8a91-4e88-828e-18019c93a933,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:27.557460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:27.563281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:27.572745 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.631301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.666877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.668223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a50255f0-3b30-426b-8972-9f3283c976c3 req-800b2df2-0ac1-4927-a8cc-0268a863c35d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.7343748 Dec 21 03:59:27.697240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-020e3c3d-26bc-4bbe-9377-2cfc122e0bb5 req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1887895183', 'description': 'tempest-description-1990685696'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:27.729425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.740824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.741484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2376a5de-876f-4295-bee4-f95526e6331c {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:27.743066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Router 0a9690f5-219e-481f-a14d-74a46bc88323 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:59:27.750540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.753998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d839c3b1-30ff-4732-bb3a-d9dd50042b84 admin admin] 10.222.0.18 "DELETE /v2.0/routers/2376a5de-876f-4295-bee4-f95526e6331c HTTP/1.1" status: 204 len: 168 time: 2.1920915 Dec 21 03:59:27.755027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37390) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:27.793371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Allocated IP 172.20.0.5 (1a941802-6d1c-42c3-ab61-9ed82a89c8e0/8890af33-1cc9-4802-b4f0-cfedacdff654/b2a3237b-a1d0-4e93-a027-d06690842a75) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:27.800132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:27.804733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:27.808568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:27.819489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Pushing event updated for resources: {'Port': ['ID=5b15e793-24d6-4571-8d9a-6223ce22ebe8,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:27.831376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-020e3c3d-26bc-4bbe-9377-2cfc122e0bb5 req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.875498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Attempting to bind port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:59:27.876091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Attempting to bind port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71fe19a3-c08d-4874-a279-4728bf2f2259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:59:27.876583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Attempting to bind port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 on network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:27.883963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:59:27.884569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Checking segment: {'id': '71fe19a3-c08d-4874-a279-4728bf2f2259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:27.885142 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.885754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Bound using segment: {'id': '71fe19a3-c08d-4874-a279-4728bf2f2259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:59:27.886497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Bound port: 5b15e793-24d6-4571-8d9a-6223ce22ebe8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71fe19a3-c08d-4874-a279-4728bf2f2259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:59:27.887002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.925510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.949636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Deleting subnet c714b82d-d957-4fc4-96b0-f175d6a234f5 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:27.959737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] For port 5b15e793-24d6-4571-8d9a-6223ce22ebe8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:59:27.962575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:27.963416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] For port 5b15e793-24d6-4571-8d9a-6223ce22ebe8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5b15e793-24d6-4571-8d9a-6223ce22ebe8,segment=NetworkSegment(71fe19a3-c08d-4874-a279-4728bf2f2259),segment_id=71fe19a3-c08d-4874-a279-4728bf2f2259)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:59:27.999633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:28.009819 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.013416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d88c0743-8b47-40d7-afd9-436ea7962d9b tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "PUT /v2.0/routers/0a9690f5-219e-481f-a14d-74a46bc88323 HTTP/1.1" status: 200 len: 919 time: 3.3804550 Dec 21 03:59:28.013614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] Sync routers for ids ['0a9690f5-219e-481f-a14d-74a46bc88323'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:28.014798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37392) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.023869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.026748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] Routers {'0a9690f5-219e-481f-a14d-74a46bc88323'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:28.027565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0a9690f5-219e-481f-a14d-74a46bc88323'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:28.063241 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.065575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:28.106726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] Routers {'0a9690f5-219e-481f-a14d-74a46bc88323'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:28.107385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0a9690f5-219e-481f-a14d-74a46bc88323'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:28.119718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-020e3c3d-26bc-4bbe-9377-2cfc122e0bb5 req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.155012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:28.155638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ddd20d4-014c-4f4e-9d98-02c0d3157cbd None None] The sync data for ids ['0a9690f5-219e-481f-a14d-74a46bc88323'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:28.157003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.168287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.178206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0dbeb58-5f41-43eb-84ae-bd2e00d9ba5e None None] Pushing event updated for resources: {'Port': ['ID=5b15e793-24d6-4571-8d9a-6223ce22ebe8,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:28.224899 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-020e3c3d-26bc-4bbe-9377-2cfc122e0bb5 req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.260609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=756c1b92-84e2-4d2b-a96d-14b15889ecb0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:28.297375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-636da55e-10dd-459d-bc4f-7f93fe17640e tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/0a9690f5-219e-481f-a14d-74a46bc88323 HTTP/1.1" status: 200 len: 925 time: 0.2779717 Dec 21 03:59:28.301221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37394) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.316605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed63a46c-413e-4dc5-a3f2-93a3a6e4330d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:28.343462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ed63a46c-413e-4dc5-a3f2-93a3a6e4330d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:28.343814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed63a46c-413e-4dc5-a3f2-93a3a6e4330d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:28.344318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 97ca28df-516e-42ca-a7be-46ce5c12dab9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:28.366715 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-020e3c3d-26bc-4bbe-9377-2cfc122e0bb5 req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.378756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-020e3c3d-26bc-4bbe-9377-2cfc122e0bb5 req-33dc4acd-5f68-4312-b296-c6e14e277b51 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1829 time: 0.6847007 Dec 21 03:59:28.383007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.409950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 97ca28df-516e-42ca-a7be-46ce5c12dab9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:28.410744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 97ca28df-516e-42ca-a7be-46ce5c12dab9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:28.425677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.460396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c714b82d-d957-4fc4-96b0-f175d6a234f5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:28.464264 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.469684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4c6a4ca8-9d60-4692-82f0-eb4c54dd525a admin admin] 10.222.0.18 "DELETE /v2.0/subnets/c714b82d-d957-4fc4-96b0-f175d6a234f5 HTTP/1.1" status: 204 len: 168 time: 0.7113636 Dec 21 03:59:28.471815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbb343f7-55bc-42ca-ad33-0004a129ed62 None None] Network 04ed2fa2-4e59-410d-9778-4535a349c6b9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:28.478622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-047e0250-62eb-4517-93d0-154ff38dc667 req-9b538b19-3747-41f7-832e-077e6758b0df tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/756c1b92-84e2-4d2b-a96d-14b15889ecb0 HTTP/1.1" status: 200 len: 1824 time: 0.0615878 Dec 21 03:59:28.479331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37398) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.502652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70c36ed4-ce9c-4651-a632-7604964a2d96 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:28.507135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-70c36ed4-ce9c-4651-a632-7604964a2d96 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=0a9690f5-219e-481f-a14d-74a46bc88323&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2018988 Dec 21 03:59:28.510567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37402) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.517950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '10.2.3.124/24', 'security_group_id': '756c1b92-84e2-4d2b-a96d-14b15889ecb0', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:28.518307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '10.2.3.124/24', 'security_group_id': '756c1b92-84e2-4d2b-a96d-14b15889ecb0', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:28.613410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.619049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:28.630207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:28.638187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:28.693889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Deleting port 096bbe5b-b9c8-4d19-aa19-4fe410665822 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:28.696754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.699876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event updated for resources: {'Port': ['ID=b2a3237b-a1d0-4e93-a027-d06690842a75,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:28.717316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] DHCP port deletion for 04ed2fa2-4e59-410d-9778-4535a349c6b9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:28.755153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12a38a7a-412e-445b-b93b-d9d6b131e91a tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:28.759503 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12a38a7a-412e-445b-b93b-d9d6b131e91a tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.2398007 Dec 21 03:59:28.762202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37406) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.763474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.770597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:28.771701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.783684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Deleting port 096bbe5b-b9c8-4d19-aa19-4fe410665822 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:28.784058 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.796115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8f90a8b-c8e9-4b1a-b6d3-e3bf11515eca tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=0a9690f5-219e-481f-a14d-74a46bc88323 HTTP/1.1" status: 200 len: 205 time: 0.0327158 Dec 21 03:59:28.800058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37408) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.817353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] For port 096bbe5b-b9c8-4d19-aa19-4fe410665822, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=096bbe5b-b9c8-4d19-aa19-4fe410665822,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:28.817719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.820852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.846278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Calling delete_port for 096bbe5b-b9c8-4d19-aa19-4fe410665822 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:28.857535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] For port 096bbe5b-b9c8-4d19-aa19-4fe410665822, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=096bbe5b-b9c8-4d19-aa19-4fe410665822,segment=NetworkSegment(df1c8e1e-6e63-47c0-b048-9d0ec8ca1792),segment_id=df1c8e1e-6e63-47c0-b048-9d0ec8ca1792)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:28.858143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.864474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.869072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:28.872797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Calling delete_port for 096bbe5b-b9c8-4d19-aa19-4fe410665822 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:28.901425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d05170e7-e857-4d6b-a166-6618c4df68d9 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 1.7338753 Dec 21 03:59:28.902139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37410) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:28.907182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Request body: {'port': {'network_id': '1a941802-6d1c-42c3-ab61-9ed82a89c8e0', 'name': 'tempest-ExtraDHCPOptionsTestJSON-810553545', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:28.908550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] bootfile-name is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 03:59:28.908896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] tftp-server is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 03:59:28.909228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] server-ip-address is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 03:59:28.947548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.014333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be85b46c-e20c-4cfa-85e8-f4c34a7b5f81,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:29.036874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.055572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.081636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Pushing event deleted for resources: {'Port': ['ID=096bbe5b-b9c8-4d19-aa19-4fe410665822,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:29.085758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] No DVR routers for this DVR port 096bbe5b-b9c8-4d19-aa19-4fe410665822 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:29.087724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Pushing event deleted for resources: {'Port': ['ID=096bbe5b-b9c8-4d19-aa19-4fe410665822,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:29.089459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] No DVR routers for this DVR port 096bbe5b-b9c8-4d19-aa19-4fe410665822 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:29.114915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.115293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.115943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.116317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.117225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.117584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.117919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.118813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.119190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.120286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.120286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.120286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.120667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61aaf304-dbd2-46d5-8328-a96e3a921ecc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:29.144479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.145708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-047e0250-62eb-4517-93d0-154ff38dc667 req-ffb806c1-f4bc-42f1-807a-acdffc7609f0 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 792 time: 0.6335635 Dec 21 03:59:29.311180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.317810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=e7652f44-2059-44fc-b35e-4bbb0850befc,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:29.359366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.428521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-11e74a04-cbfd-4ecb-8e7e-36683e3557a2 req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-509913534', 'description': 'tempest-description-496853336'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:29.434116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.441515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f797bc6-36b9-4981-9b1c-a1f5db1f35bf None None] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:29.469237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['04ed2fa2-4e59-410d-9778-4535a349c6b9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:29.484738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:29.485058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'df1c8e1e-6e63-47c0-b048-9d0ec8ca1792') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:29.498147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.511397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.515134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:29.515581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fc9137b5-3605-47ca-b623-ba61fcd43544 None None] Provisioning complete for port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:29.516100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc9137b5-3605-47ca-b623-ba61fcd43544 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.518834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:29.526905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Releasing vlan 111 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:29.527178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:29.529301 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:29.532792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.551369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Made reservation on behalf of bee33d9b5dd44524a5ca42938688ae55 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:29.555505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.599404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-11e74a04-cbfd-4ecb-8e7e-36683e3557a2 req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.619594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] device_id is not set on port d88ea15f-8a45-4243-bba9-2a264254e7f4 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:29.636720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc9137b5-3605-47ca-b623-ba61fcd43544 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.665992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:29.699942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fc9137b5-3605-47ca-b623-ba61fcd43544 None None] For port 5b15e793-24d6-4571-8d9a-6223ce22ebe8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5b15e793-24d6-4571-8d9a-6223ce22ebe8,segment=NetworkSegment(71fe19a3-c08d-4874-a279-4728bf2f2259),segment_id=71fe19a3-c08d-4874-a279-4728bf2f2259)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:29.760050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.785966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.785966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] 10.222.0.18 "DELETE /v2.0/networks/04ed2fa2-4e59-410d-9778-4535a349c6b9 HTTP/1.1" status: 204 len: 168 time: 1.2996030 Dec 21 03:59:29.787457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37418) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:29.806638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-11e74a04-cbfd-4ecb-8e7e-36683e3557a2 req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.808474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Allocated IP 172.20.0.13 (1a941802-6d1c-42c3-ab61-9ed82a89c8e0/8890af33-1cc9-4802-b4f0-cfedacdff654/d88ea15f-8a45-4243-bba9-2a264254e7f4) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:29.811179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cefb6de-dd04-4d25-a055-67ce98f57e1e admin admin] Pushing event deleted for resources: {'Network': ['ID=04ed2fa2-4e59-410d-9778-4535a349c6b9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:29.815648 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc9137b5-3605-47ca-b623-ba61fcd43544 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.880100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Deleting port 04f9fc65-dab4-4097-b640-8c08311d7d1c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:29.880340 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.889243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc9137b5-3605-47ca-b623-ba61fcd43544 None None] Pushing event updated for resources: {'Port': ['ID=5b15e793-24d6-4571-8d9a-6223ce22ebe8,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:29.931504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-11e74a04-cbfd-4ecb-8e7e-36683e3557a2 req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:29.990236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bf23b9f5-1ef5-41b2-a642-99ac9a6b4385,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:30.001126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:30.013905 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-23dd55a3-18db-47b4-b28c-79d2e077c5a8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/routers/7352f41a-a815-4f0a-80d2-9706c21ac387/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2288110 Dec 21 03:59:30.014206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37420) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:30.016185 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:30.018451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'port': {'network_id': 'b672c264-59db-4f56-873d-1e399cb0cd1a', 'name': 'tempest-FloatingIPTestJSON-135123487'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:30.030646 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:30.031608 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:30.038580 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.049640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.078698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-63dc2b64-b219-445b-8fab-8bb11df80572 None None] Provisioning complete for port b2a3237b-a1d0-4e93-a027-d06690842a75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:30.079136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-63dc2b64-b219-445b-8fab-8bb11df80572 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.083593 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:30.093235 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:30.094141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:30.109065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-11e74a04-cbfd-4ecb-8e7e-36683e3557a2 req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.109293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Calling delete_port for 04f9fc65-dab4-4097-b640-8c08311d7d1c owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:30.110366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11e74a04-cbfd-4ecb-8e7e-36683e3557a2 req-f76f9fc3-fd67-41b8-a32a-27e4e2867337 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1827 time: 0.6903374 Dec 21 03:59:30.136860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-63dc2b64-b219-445b-8fab-8bb11df80572 None None] Port b2a3237b-a1d0-4e93-a027-d06690842a75 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:30.153297 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:30.154889 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b00503b1-03a9-4651-a055-ff491f6a592e None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:30.167432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bd0f8e56-1957-4820-9d9a-0aae6cc8e497 req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1375678259', 'description': 'tempest-description-1070649292'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:30.171728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-63dc2b64-b219-445b-8fab-8bb11df80572 None None] Provisioning complete for port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:30.172144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-63dc2b64-b219-445b-8fab-8bb11df80572 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.370352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5b15e793-24d6-4571-8d9a-6223ce22ebe8 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:59:30.376036 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.424561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd0f8e56-1957-4820-9d9a-0aae6cc8e497 req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.434757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-46e7e7d4-e5c9-461e-8377-5f364b5c13c6 None None] Provisioning complete for port b2a3237b-a1d0-4e93-a027-d06690842a75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:30.435421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46e7e7d4-e5c9-461e-8377-5f364b5c13c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.481055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:30.481913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:30.482135 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.485101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event updated for resources: {'Port': ['ID=d88ea15f-8a45-4243-bba9-2a264254e7f4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:30.489921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:30.493643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:30.546716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.554785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.567572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:30.568042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.568754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-46e7e7d4-e5c9-461e-8377-5f364b5c13c6 None None] Port b2a3237b-a1d0-4e93-a027-d06690842a75 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:30.580201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:30.584035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.628336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd0f8e56-1957-4820-9d9a-0aae6cc8e497 req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.634043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] device_id is not set on port 8724c5e8-a356-400c-98e3-ca3d4f7b5252 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:30.634340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event deleted for resources: {'Port': ['ID=04f9fc65-dab4-4097-b640-8c08311d7d1c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:30.686387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28c0bedd-3999-4823-a8d2-4db7df2eae59 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:30.706985 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d3891b20-d61d-41ab-b78f-f0d72b87d101 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1152 time: 1.8014805 Dec 21 03:59:30.708647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:30.765193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 096bbe5b-b9c8-4d19-aa19-4fe410665822 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:30.783937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.799181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 096bbe5b-b9c8-4d19-aa19-4fe410665822 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:30.799678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 096bbe5b-b9c8-4d19-aa19-4fe410665822 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:30.804476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd0f8e56-1957-4820-9d9a-0aae6cc8e497 req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.899682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-77e743a6-49bc-4738-a2ba-163e4ea473bf None None] Provisioning complete for port d88ea15f-8a45-4243-bba9-2a264254e7f4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:30.900282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-77e743a6-49bc-4738-a2ba-163e4ea473bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.939091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.8 (b672c264-59db-4f56-873d-1e399cb0cd1a/76bec629-6735-4479-9cb2-edaf6be1f8e5/8724c5e8-a356-400c-98e3-ca3d4f7b5252) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:30.947493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-77e743a6-49bc-4738-a2ba-163e4ea473bf None None] Port d88ea15f-8a45-4243-bba9-2a264254e7f4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:30.960356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bd0f8e56-1957-4820-9d9a-0aae6cc8e497 req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.961484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.963766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd0f8e56-1957-4820-9d9a-0aae6cc8e497 req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1829 time: 0.8055921 Dec 21 03:59:30.975149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:30.985304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e98b9d0-31d4-4e5f-a69d-f4c837842b78 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:30.992351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e98b9d0-31d4-4e5f-a69d-f4c837842b78 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:30.998502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e98b9d0-31d4-4e5f-a69d-f4c837842b78 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:31.000684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8e98b9d0-31d4-4e5f-a69d-f4c837842b78 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2618 time: 0.2913291 Dec 21 03:59:31.005161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e9408d3-a896-4a99-b887-a58254fd1f66 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f1308f67-7472-44b2-a4d2-9d7cbb14d3ea,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:31.007332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37432) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:31.089186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.089735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Fanout notify agent at l3_agent the message router_deleted on router 0a9690f5-219e-481f-a14d-74a46bc88323 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:31.097501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.103041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cfca5f89-d27f-4dae-9e3e-b81d7f736ebf tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/0a9690f5-219e-481f-a14d-74a46bc88323 HTTP/1.1" status: 204 len: 168 time: 2.2977450 Dec 21 03:59:31.103041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37434) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:31.106790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1276059694', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:31.149493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Deleting port 48ed0705-b46c-42de-9f83-231addc73f4e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:31.149848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.187747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-76f86928-5643-429d-8f83-be716a74042a tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/bf23b9f5-1ef5-41b2-a642-99ac9a6b4385 HTTP/1.1" status: 200 len: 1822 time: 0.1859193 Dec 21 03:59:31.238434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] For port 48ed0705-b46c-42de-9f83-231addc73f4e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=48ed0705-b46c-42de-9f83-231addc73f4e,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:31.238974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.246351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.247406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.257942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Calling delete_port for 48ed0705-b46c-42de-9f83-231addc73f4e owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:31.284923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-72bc5218-1a3b-4646-9cb3-6e0f00db0188 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/f1308f67-7472-44b2-a4d2-9d7cbb14d3ea HTTP/1.1" status: 200 len: 1824 time: 0.0860603 Dec 21 03:59:31.291842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Deleting port d88ea15f-8a45-4243-bba9-2a264254e7f4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:31.292184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.301881 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.305717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': 'bf23b9f5-1ef5-41b2-a642-99ac9a6b4385', 'remote_group_id': 'f1308f67-7472-44b2-a4d2-9d7cbb14d3ea', 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:31.306037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': 'bf23b9f5-1ef5-41b2-a642-99ac9a6b4385', 'remote_group_id': 'f1308f67-7472-44b2-a4d2-9d7cbb14d3ea', 'port_range_min': 22, 'port_range_max': 22}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:31.345736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.426403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.438844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Calling delete_port for d88ea15f-8a45-4243-bba9-2a264254e7f4 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:31.461736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.587201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.588336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.588519 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0510727c-440d-4b58-aaac-0a70fd0224e3 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4848437 Dec 21 03:59:31.589298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.591261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:31.602555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': False}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:31.624861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Pushing event deleted for resources: {'Port': ['ID=48ed0705-b46c-42de-9f83-231addc73f4e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:31.631043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.663010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:31.663247 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.686326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:31.697832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:31.705663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=8724c5e8-a356-400c-98e3-ca3d4f7b5252,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:31.740450 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.775422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event deleted for resources: {'Port': ['ID=d88ea15f-8a45-4243-bba9-2a264254e7f4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:31.809542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:31.810209 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.836792 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.873670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9388ba91-e966-4b88-9863-91a5cc99901b,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:31.884474 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.893310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f5a9a3c9-962c-4cae-b476-75cd8055d376 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "DELETE /v2.0/ports/d88ea15f-8a45-4243-bba9-2a264254e7f4 HTTP/1.1" status: 204 len: 168 time: 0.8819985 Dec 21 03:59:31.894225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37440) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:31.900199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Request body: {'port': {'name': 'tempest-new-port-name-169966672', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:31.900772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] bootfile-name is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 03:59:31.901300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] tftp-server is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 03:59:31.901638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] server-ip-address is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 03:59:31.936931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4dcba5a0-cc49-4920-a375-42070808bacb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.9225698 Dec 21 03:59:31.937574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37442) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:31.948614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'port': {'network_id': 'b672c264-59db-4f56-873d-1e399cb0cd1a', 'name': 'tempest-FloatingIPTestJSON-1913308412'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:31.983184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:31.984464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10cca181-0e23-4dcf-bc4e-f42cec36fe69 req-85dcb8ea-c994-4ce0-a5b4-c2b5fe76f27f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 806 time: 0.6878846 Dec 21 03:59:32.022643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.038588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-eb8029e6-2781-4bc2-ad8d-7c112c6b4707 req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1421709197', 'description': 'tempest-description-11122225'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:32.052387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.077631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.296563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e32b374-1dc8-4fa1-9ab4-7ac9caca42e9 req-64a47602-8e2d-47e0-bf4d-844c5a0c4c5c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:32.298164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e32b374-1dc8-4fa1-9ab4-7ac9caca42e9 req-64a47602-8e2d-47e0-bf4d-844c5a0c4c5c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.1343968 Dec 21 03:59:32.315485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8029e6-2781-4bc2-ad8d-7c112c6b4707 req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.427421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e32b374-1dc8-4fa1-9ab4-7ac9caca42e9 req-7a8886e4-41fa-45f2-a901-4a4eac491ea9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1182904 Dec 21 03:59:32.485512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.488411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8029e6-2781-4bc2-ad8d-7c112c6b4707 req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.489434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:32.493015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.511532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] device_id is not set on port 4621144f-6a4e-4ade-9095-b7670b2a7c5e yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:32.642611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.672179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.6 (b672c264-59db-4f56-873d-1e399cb0cd1a/76bec629-6735-4479-9cb2-edaf6be1f8e5/4621144f-6a4e-4ade-9095-b7670b2a7c5e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:32.719560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Router d77e5fe8-df91-4709-bd5f-2eb276d9f270 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:32.734261 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8029e6-2781-4bc2-ad8d-7c112c6b4707 req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.766642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event updated for resources: {'Port': ['ID=b2a3237b-a1d0-4e93-a027-d06690842a75,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:32.806097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] In _notify_port_updated(), no bound segment for port b2a3237b-a1d0-4e93-a027-d06690842a75 on network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 03:59:32.811947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:32.813194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.817651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-24256f79-ba59-403c-8bd3-c8edd0025f11 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "PUT /v2.0/ports/b2a3237b-a1d0-4e93-a027-d06690842a75 HTTP/1.1" status: 200 len: 1135 time: 0.9197743 Dec 21 03:59:32.817847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.820828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37460) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:32.838089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7089c496-0a3a-476c-92d0-f6c5ef6dd4f1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:32.851633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.896760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-eb8029e6-2781-4bc2-ad8d-7c112c6b4707 req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.898595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb8029e6-2781-4bc2-ad8d-7c112c6b4707 req-7a9e41d8-3fb0-4912-a8e2-488cfff126cb tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1827 time: 0.8726182 Dec 21 03:59:32.907665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5b835a2-7e88-467e-b688-f3b5270f3f9c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:32.912278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e5b835a2-7e88-467e-b688-f3b5270f3f9c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "GET /v2.0/ports/b2a3237b-a1d0-4e93-a027-d06690842a75 HTTP/1.1" status: 200 len: 1135 time: 0.0865798 Dec 21 03:59:32.917911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37464) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:32.967349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3c7ddbe0-68b3-4896-8efe-55332ade8472 req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-707049626', 'description': 'tempest-description-1415031450'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:32.988827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7c8a038a-b7f4-41fe-b58a-0b5e34c8d39c None None] Provisioning complete for port b2a3237b-a1d0-4e93-a027-d06690842a75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:32.990068 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c8a038a-b7f4-41fe-b58a-0b5e34c8d39c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:32.997195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:33.005693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9f478ddf-d05d-4368-9db1-aa03fc76ebf4 admin admin] 10.222.0.18 "PUT /v2.0/routers/d77e5fe8-df91-4709-bd5f-2eb276d9f270/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2172291 Dec 21 03:59:33.008405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37466) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:33.020273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] Sync routers for ids ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:33.042626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] Routers {'d77e5fe8-df91-4709-bd5f-2eb276d9f270'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:33.043743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:33.081284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.084178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Allocated IP 172.25.5.8 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/e7250d59-3675-4113-bbf1-2473870d5529) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:33.106674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7c8a038a-b7f4-41fe-b58a-0b5e34c8d39c None None] Port b2a3237b-a1d0-4e93-a027-d06690842a75 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:33.131898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Deleting port b2a3237b-a1d0-4e93-a027-d06690842a75 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:33.132246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.164923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3c7ddbe0-68b3-4896-8efe-55332ade8472 req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.188638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] Set router d77e5fe8-df91-4709-bd5f-2eb276d9f270 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:33.226537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.258681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.261556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.306243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Calling delete_port for b2a3237b-a1d0-4e93-a027-d06690842a75 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:33.340600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:33.348558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:33.350647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.355425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:33.373071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.396255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:59:31Z', 'revision_number': 5, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:33.422926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=4621144f-6a4e-4ade-9095-b7670b2a7c5e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:33.428181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] Checking router: d77e5fe8-df91-4709-bd5f-2eb276d9f270 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 03:59:33.436927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] Routers {'d77e5fe8-df91-4709-bd5f-2eb276d9f270'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:33.437548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:33.473759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3c7ddbe0-68b3-4896-8efe-55332ade8472 req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.480283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:33.480943 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.501532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.548876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:33.553046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:33.560432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:33.580410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3c7ddbe0-68b3-4896-8efe-55332ade8472 req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.602640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Pushing event updated for resources: {'Port': ['ID=e7250d59-3675-4113-bbf1-2473870d5529,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:33.610977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Deleting port 40cff15a-139d-47bc-b79f-04e33eca7b3f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:33.611916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.630872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ea1e2005-17f4-4041-b0f2-ca835bfa0160 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.6897728 Dec 21 03:59:33.631551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:33.639335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '4621144f-6a4e-4ade-9095-b7670b2a7c5e', 'fixed_ip_address': '172.20.0.6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:33.645743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8c490bdc-c1b2-4525-bc14-91a30d8cadf4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:33.660442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.697726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event deleted for resources: {'Port': ['ID=b2a3237b-a1d0-4e93-a027-d06690842a75,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:33.703523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6417ef15-5ec5-44e0-98bd-d59e4c2bc87b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:33.747684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] Set router d77e5fe8-df91-4709-bd5f-2eb276d9f270 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 03:59:33.770035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3c7ddbe0-68b3-4896-8efe-55332ade8472 req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.771400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c7ddbe0-68b3-4896-8efe-55332ade8472 req-51193719-e2d4-4ff9-ab43-a138567594ec tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1828 time: 0.8149095 Dec 21 03:59:33.795224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.801513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-922b9075-1ee7-4387-8c6c-7efba73c496c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "DELETE /v2.0/ports/b2a3237b-a1d0-4e93-a027-d06690842a75 HTTP/1.1" status: 204 len: 168 time: 0.8516161 Dec 21 03:59:33.802061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37478) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:33.826432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] For port 40cff15a-139d-47bc-b79f-04e33eca7b3f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=40cff15a-139d-47bc-b79f-04e33eca7b3f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:33.826805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.843682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Calling delete_port for 40cff15a-139d-47bc-b79f-04e33eca7b3f owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:33.910053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Deleting subnet 8890af33-1cc9-4802-b4f0-cfedacdff654 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:33.914424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.922023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-004caf01-1618-4fe1-88f3-a5f3a5da323f None None] Provisioning complete for port e7250d59-3675-4113-bbf1-2473870d5529 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:33.924847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-004caf01-1618-4fe1-88f3-a5f3a5da323f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.968406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.971095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:33.999812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-5996bd79-4903-4e4b-82cb-404bb6b8d2c2 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/7089c496-0a3a-476c-92d0-f6c5ef6dd4f1 HTTP/1.1" status: 200 len: 1822 time: 0.1967120 Dec 21 03:59:34.003142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-004caf01-1618-4fe1-88f3-a5f3a5da323f None None] Port e7250d59-3675-4113-bbf1-2473870d5529 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:34.036866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:59:31Z', 'revision_number': 5, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:34.069272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43a5b2ef-f6f0-4adc-8af7-8ea654f20031 None None] The sync data for ids ['d77e5fe8-df91-4709-bd5f-2eb276d9f270'] in n-d-822053-11 is: [{'id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'name': 'tempest-TaggedBootDevicesTest-1378558027-router', 'tenant_id': 'f7e825d467974290b733e78d9d0bbb49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13'}], 'enable_snat': True}, 'gw_port_id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:47:25Z', 'updated_at': '2021-12-21T03:59:31Z', 'revision_number': 5, 'project_id': 'f7e825d467974290b733e78d9d0bbb49', 'gw_port': {'id': '40cff15a-139d-47bc-b79f-04e33eca7b3f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:46:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd77e5fe8-df91-4709-bd5f-2eb276d9f270', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:47:27Z', 'updated_at': '2021-12-21T03:47:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:34.228253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.268532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Pushing event deleted for resources: {'Port': ['ID=40cff15a-139d-47bc-b79f-04e33eca7b3f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:34.287471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4967a17-1282-458a-a2c0-0b67cee7f671 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:34.305005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.388150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-b8df33f2-3900-4756-b5f5-b0fb80570b16 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/8c490bdc-c1b2-4525-bc14-91a30d8cadf4 HTTP/1.1" status: 200 len: 1823 time: 0.3759367 Dec 21 03:59:34.395620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.413844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.420540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': '7089c496-0a3a-476c-92d0-f6c5ef6dd4f1', 'remote_group_id': '8c490bdc-c1b2-4525-bc14-91a30d8cadf4', 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:34.420860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': '7089c496-0a3a-476c-92d0-f6c5ef6dd4f1', 'remote_group_id': '8c490bdc-c1b2-4525-bc14-91a30d8cadf4', 'port_range_min': 22, 'port_range_max': 22}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:34.501136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.512576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.518551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.558496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 48ed0705-b46c-42de-9f83-231addc73f4e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:34.580103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 48ed0705-b46c-42de-9f83-231addc73f4e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:34.580461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 48ed0705-b46c-42de-9f83-231addc73f4e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:34.639860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.639860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d77e5fe8-df91-4709-bd5f-2eb276d9f270 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:34.641131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.644284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.645752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-742012dc-e967-4c6e-bdff-f3506fad87d1 admin admin] 10.222.0.18 "DELETE /v2.0/routers/d77e5fe8-df91-4709-bd5f-2eb276d9f270 HTTP/1.1" status: 204 len: 168 time: 1.6358802 Dec 21 03:59:34.647141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.219 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/d657bf23-03fc-4c38-8bd9-4686761d66a0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:34.648763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37486) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:34.695729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event deleted for resources: {'Subnet': ['ID=8890af33-1cc9-4802-b4f0-cfedacdff654,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:34.698509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.701872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0c163847-c54b-4158-ae59-d6d9fb3763c7 tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "DELETE /v2.0/subnets/8890af33-1cc9-4802-b4f0-cfedacdff654 HTTP/1.1" status: 204 len: 168 time: 0.8964150 Dec 21 03:59:34.706829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ed4746d-4bcd-4e0e-943e-3b962553c9b7 None None] Network 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:34.709359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37488) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:34.724710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.868723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.874828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.962314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.963876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:34.989063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] DHCP port deletion for 1a941802-6d1c-42c3-ab61-9ed82a89c8e0 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:35.012033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e8c0cb85-fbc8-4ec7-8ac1-032245051889,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:35.046452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Deleting port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:35.046802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.052087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Deleting subnet 4b881d58-71d9-4f25-ae52-9da80d5e2920 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:35.056289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] Deleting port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:35.056867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.057795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.059851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.082071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.112461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.113735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9baec76-e6dd-4f54-953f-21a3cb3f4eb9 req-62790aea-4f88-4eea-9aa6-2cda6eaf1f0d tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 806 time: 0.7149913 Dec 21 03:59:35.119259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] For port 5b15e793-24d6-4571-8d9a-6223ce22ebe8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5b15e793-24d6-4571-8d9a-6223ce22ebe8,segment=NetworkSegment(71fe19a3-c08d-4874-a279-4728bf2f2259),segment_id=71fe19a3-c08d-4874-a279-4728bf2f2259)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:35.119259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.130641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.144966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] For port 5b15e793-24d6-4571-8d9a-6223ce22ebe8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5b15e793-24d6-4571-8d9a-6223ce22ebe8,segment=NetworkSegment(71fe19a3-c08d-4874-a279-4728bf2f2259),segment_id=71fe19a3-c08d-4874-a279-4728bf2f2259)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:35.145433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.150422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Calling delete_port for 5b15e793-24d6-4571-8d9a-6223ce22ebe8 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:35.161411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] Calling delete_port for 5b15e793-24d6-4571-8d9a-6223ce22ebe8 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:35.167860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.273525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.276843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:35.289393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:35.321674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=d657bf23-03fc-4c38-8bd9-4686761d66a0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:35.331597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:35.357176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.376162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] No DVR routers for this DVR port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:35.382553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb691d51-5f53-4de6-8063-ebef2c80280a req-de65d904-642f-4b4b-9d0b-ba30f4d2d777 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/8c490bdc-c1b2-4525-bc14-91a30d8cadf4 HTTP/1.1" status: 200 len: 1823 time: 0.2289262 Dec 21 03:59:35.400984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-251ec9ff-63fc-4819-98aa-e97bee8e0e72 None None] Pushing event deleted for resources: {'Port': ['ID=5b15e793-24d6-4571-8d9a-6223ce22ebe8,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:35.411480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Router 26c17ba7-87e8-413b-8111-933cd73e63f4 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:59:35.460128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.475611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.491361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b881d58-71d9-4f25-ae52-9da80d5e2920,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:35.498237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.502581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2065b69d-2a04-42d8-a241-99112716968f admin admin] 10.222.0.18 "DELETE /v2.0/subnets/4b881d58-71d9-4f25-ae52-9da80d5e2920 HTTP/1.1" status: 204 len: 168 time: 0.8530529 Dec 21 03:59:35.505090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37498) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:35.505538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb0751c9-18e9-40ae-9d6c-3f3f3581f9e0 None None] Network db71f3b3-7195-4c4a-b30b-67dc14f350a1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:35.541203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event deleted for resources: {'Port': ['ID=5b15e793-24d6-4571-8d9a-6223ce22ebe8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:35.546972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] No DVR routers for this DVR port 5b15e793-24d6-4571-8d9a-6223ce22ebe8 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:35.625757 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.629567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:35.634349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.639050 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3579d84f-57da-48db-a2ac-5cbcb2c5dfdb tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "PUT /v2.0/routers/26c17ba7-87e8-413b-8111-933cd73e63f4 HTTP/1.1" status: 200 len: 918 time: 4.0442183 Dec 21 03:59:35.639853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:35.643008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] Sync routers for ids ['26c17ba7-87e8-413b-8111-933cd73e63f4'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:35.659826 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] Routers {'26c17ba7-87e8-413b-8111-933cd73e63f4'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:35.659826 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['26c17ba7-87e8-413b-8111-933cd73e63f4'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.660969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb691d51-5f53-4de6-8063-ebef2c80280a req-c154962d-3635-4d0c-afbe-ae393e560c18 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.698565 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.712168 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] Routers {'26c17ba7-87e8-413b-8111-933cd73e63f4'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:35.713216 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['26c17ba7-87e8-413b-8111-933cd73e63f4'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.726358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] DHCP port deletion for db71f3b3-7195-4c4a-b30b-67dc14f350a1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:35.742196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.763858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb691d51-5f53-4de6-8063-ebef2c80280a req-c154962d-3635-4d0c-afbe-ae393e560c18 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.769750 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.770691 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-147a4726-9247-41f5-99cc-b7f002f1cb64 None None] The sync data for ids ['26c17ba7-87e8-413b-8111-933cd73e63f4'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:35.785641 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4c2006b1-a2eb-40c4-9825-ee20deeff541 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/26c17ba7-87e8-413b-8111-933cd73e63f4 HTTP/1.1" status: 200 len: 924 time: 0.1440904 Dec 21 03:59:35.789206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37502) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:35.796034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] Deleting port 8cfa8526-a054-4aa9-89b9-350cec538e00 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:35.796422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.803856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1a941802-6d1c-42c3-ab61-9ed82a89c8e0']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.823339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Deleting port 8cfa8526-a054-4aa9-89b9-350cec538e00 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:35.823765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.834236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71fe19a3-c08d-4874-a279-4728bf2f2259') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.834560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71fe19a3-c08d-4874-a279-4728bf2f2259') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:35.856960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.864370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] For port 8cfa8526-a054-4aa9-89b9-350cec538e00, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8cfa8526-a054-4aa9-89b9-350cec538e00,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:35.864978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.877927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] Calling delete_port for 8cfa8526-a054-4aa9-89b9-350cec538e00 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:35.892701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7f427e0-914e-4020-a30d-0d3477b20980 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:35.896646 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b7f427e0-914e-4020-a30d-0d3477b20980 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=26c17ba7-87e8-413b-8111-933cd73e63f4&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 943 time: 0.1039650 Dec 21 03:59:35.899882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37504) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:35.918409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] For port 8cfa8526-a054-4aa9-89b9-350cec538e00, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8cfa8526-a054-4aa9-89b9-350cec538e00,segment=NetworkSegment(9cac79f9-2a11-44fa-be96-df9a5374778e),segment_id=9cac79f9-2a11-44fa-be96-df9a5374778e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:35.918409 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.943836 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.946639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Calling delete_port for 8cfa8526-a054-4aa9-89b9-350cec538e00 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:35.968149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:35.969629 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:35.971661 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: timer() Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:35.974087 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:36.009683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 03:59:36.040196 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.061815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e286eab-2d90-4567-b11a-1578106f3570 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:36.066400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6e286eab-2d90-4567-b11a-1578106f3570 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.1624260 Dec 21 03:59:36.066615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37506) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:36.086968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] No DVR routers for this DVR port 8cfa8526-a054-4aa9-89b9-350cec538e00 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:36.105391 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a7e583e-300a-49b5-837a-fa18a5792439 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=26c17ba7-87e8-413b-8111-933cd73e63f4 HTTP/1.1" status: 200 len: 205 time: 0.0374613 Dec 21 03:59:36.111919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37508) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:36.116983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e93d9294-cf09-4a77-b9d6-82b54e644c9e None None] Pushing event deleted for resources: {'Port': ['ID=8cfa8526-a054-4aa9-89b9-350cec538e00,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:36.124180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb691d51-5f53-4de6-8063-ebef2c80280a req-c154962d-3635-4d0c-afbe-ae393e560c18 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.127735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb691d51-5f53-4de6-8063-ebef2c80280a req-c154962d-3635-4d0c-afbe-ae393e560c18 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.129115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb691d51-5f53-4de6-8063-ebef2c80280a req-c154962d-3635-4d0c-afbe-ae393e560c18 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/8c490bdc-c1b2-4525-bc14-91a30d8cadf4 HTTP/1.1" status: 204 len: 173 time: 0.7327213 Dec 21 03:59:36.135937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.174436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] No DVR routers for this DVR port 8cfa8526-a054-4aa9-89b9-350cec538e00 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 03:59:36.179803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Pushing event deleted for resources: {'Port': ['ID=8cfa8526-a054-4aa9-89b9-350cec538e00,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:36.198353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:36.211167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c154962d-3635-4d0c-afbe-ae393e560c18 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c490bdc-c1b2-4525-bc14-91a30d8cadf4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:36.227538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 03:59:36.275602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.279945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.287804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.306901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:59:36.316951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['db71f3b3-7195-4c4a-b30b-67dc14f350a1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:36.327688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9cac79f9-2a11-44fa-be96-df9a5374778e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:36.327998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9cac79f9-2a11-44fa-be96-df9a5374778e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:36.329221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:36.339252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.353742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.354778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.356987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] 10.222.0.18 "DELETE /v2.0/networks/1a941802-6d1c-42c3-ab61-9ed82a89c8e0 HTTP/1.1" status: 204 len: 168 time: 1.6466627 Dec 21 03:59:36.358337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8cfa8526-a054-4aa9-89b9-350cec538e00 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:36.362469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Releasing vlan 140 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:36.362591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:36.364622 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:36.385408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a1c130-7a74-4be1-82b9-839240b3400c tempest-ExtraDHCPOptionsTestJSON-1136512681 tempest-ExtraDHCPOptionsTestJSON-1136512681-project] Pushing event deleted for resources: {'Network': ['ID=1a941802-6d1c-42c3-ab61-9ed82a89c8e0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:36.393196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.401263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8cfa8526-a054-4aa9-89b9-350cec538e00 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:36.401788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8cfa8526-a054-4aa9-89b9-350cec538e00 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:36.402577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 40cff15a-139d-47bc-b79f-04e33eca7b3f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:36.433375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 40cff15a-139d-47bc-b79f-04e33eca7b3f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:36.434050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 40cff15a-139d-47bc-b79f-04e33eca7b3f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:36.435129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5b15e793-24d6-4571-8d9a-6223ce22ebe8 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 03:59:36.446344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f070ed11-0cab-467f-baa2-eddb2a7a2f02 req-03c35d90-72fb-4ea2-9eb0-0ee43afde6c1 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/7089c496-0a3a-476c-92d0-f6c5ef6dd4f1 HTTP/1.1" status: 200 len: 1822 time: 0.2547355 Dec 21 03:59:36.464426 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.488876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b0fcfaa6-f8a7-4b6a-8d3a-078adaada842 req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-97854451', 'description': 'tempest-description-225899833'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:36.504831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 5b15e793-24d6-4571-8d9a-6223ce22ebe8 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 03:59:36.505220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.505344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5b15e793-24d6-4571-8d9a-6223ce22ebe8 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 03:59:36.531337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:36.535486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.539962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.545717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] 10.222.0.18 "DELETE /v2.0/networks/db71f3b3-7195-4c4a-b30b-67dc14f350a1 HTTP/1.1" status: 204 len: 168 time: 1.0370615 Dec 21 03:59:36.561645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbfffb0-c43d-46ce-85b6-6f80e5618542 admin admin] Pushing event deleted for resources: {'Network': ['ID=db71f3b3-7195-4c4a-b30b-67dc14f350a1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:36.651795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['643a3827-c0d5-4377-893a-3bf71f16b0e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 03:59:36.873434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.877427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0fcfaa6-f8a7-4b6a-8d3a-078adaada842 req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:36.946978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.073706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:37.084843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0fcfaa6-f8a7-4b6a-8d3a-078adaada842 req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.134988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.140434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Deleting port e7250d59-3675-4113-bbf1-2473870d5529 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:37.140774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.161291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0fcfaa6-f8a7-4b6a-8d3a-078adaada842 req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.192337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:37.212382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.259796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroup': ['ID=88a5b226-666c-424a-bdd2-6d77b0f21308,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:37.264184 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-69726273-0b9e-4673-8c6f-e2ca83229a4d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bee33d9b5dd44524a5ca42938688ae55&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1867433 Dec 21 03:59:37.264348 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-17d15a59-8f3f-4a6f-a1be-a80f12f7a9f5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6d65cc45e25946eeb479e45c44089cf7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0706961 Dec 21 03:59:37.264861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37544) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:37.269513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37546) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:37.318216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eb5dfc4-2b14-4542-b8e3-117d25ad4b40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.342362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=d657bf23-03fc-4c38-8bd9-4686761d66a0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:37.348042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b0fcfaa6-f8a7-4b6a-8d3a-078adaada842 req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.349278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0fcfaa6-f8a7-4b6a-8d3a-078adaada842 req-77c7a06c-8ad9-411b-849d-11246e0a1192 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1826 time: 0.8713975 Dec 21 03:59:37.350261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eb5dfc4-2b14-4542-b8e3-117d25ad4b40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.367846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.404589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Calling delete_port for e7250d59-3675-4113-bbf1-2473870d5529 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:37.408635 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.494084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-769813d6-ce78-4ad3-a823-d4617922cdfb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.502130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eb5dfc4-2b14-4542-b8e3-117d25ad4b40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.502130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eb5dfc4-2b14-4542-b8e3-117d25ad4b40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.502130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3eb5dfc4-2b14-4542-b8e3-117d25ad4b40 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/98694348-a8cd-49da-86d9-d30839b406c2 HTTP/1.1" status: 204 len: 168 time: 0.2331598 Dec 21 03:59:37.509722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb5dfc4-2b14-4542-b8e3-117d25ad4b40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98694348-a8cd-49da-86d9-d30839b406c2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:37.575407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-d1583317-d8b5-47b5-bf76-f47989fbede6 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/88a5b226-666c-424a-bdd2-6d77b0f21308 HTTP/1.1" status: 200 len: 1821 time: 0.1982574 Dec 21 03:59:37.597542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '88a5b226-666c-424a-bdd2-6d77b0f21308', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:37.597915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '88a5b226-666c-424a-bdd2-6d77b0f21308', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:37.624085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-769813d6-ce78-4ad3-a823-d4617922cdfb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.645696 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 15a0df86-0738-4d6c-91f1-1d06ae5642fe associated. External IP: 172.25.5.219, port: 4621144f-6a4e-4ade-9095-b7670b2a7c5e. Dec 21 03:59:37.947238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-769813d6-ce78-4ad3-a823-d4617922cdfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.956743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-769813d6-ce78-4ad3-a823-d4617922cdfb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:37.956743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-769813d6-ce78-4ad3-a823-d4617922cdfb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e7e08fd5-b884-449b-bda4-3e7982fc9b69 HTTP/1.1" status: 204 len: 168 time: 0.6799777 Dec 21 03:59:37.983681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769813d6-ce78-4ad3-a823-d4617922cdfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7e08fd5-b884-449b-bda4-3e7982fc9b69,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:38.012784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:38.023625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.023966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.029258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 03:59:38.071607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event deleted for resources: {'Port': ['ID=e7250d59-3675-4113-bbf1-2473870d5529,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:38.081850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.089513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5c78495-e853-4e58-b035-a5f796f14c44 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:38.133276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 643a3827-c0d5-4377-893a-3bf71f16b0e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:38.133871 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.174236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.245251 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.278922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:59:38.287581 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ec9d50d-587c-462a-8b3e-e220d249e9cc" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:59:38.306977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.312597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8f97d9f9-682b-496d-8720-c20c6e3b92dc,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:38.348894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 03:59:38.369961 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 03:59:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a57f429-c33e-4e7a-b5b1-d5e418e0fe7a x-openstack-request-id: req-9a57f429-c33e-4e7a-b5b1-d5e418e0fe7a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:59:38.372281 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:59:38.372281 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9a57f429-c33e-4e7a-b5b1-d5e418e0fe7a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:59:38.372281 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 03:59:38.426340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.427521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b741be5b-9c76-4c99-9d8a-318be36ef2cc req-097a15ea-d24a-484f-8739-4d63fb53ffe5 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.8409956 Dec 21 03:59:38.465444 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.528091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.528666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:38.531509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.542645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:38.569046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:38.596803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:38.598292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:38.632328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-c117c845-be91-4dba-b0a4-70ba7af4cf7f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/88a5b226-666c-424a-bdd2-6d77b0f21308 HTTP/1.1" status: 200 len: 2415 time: 0.1279104 Dec 21 03:59:38.648849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '88a5b226-666c-424a-bdd2-6d77b0f21308', 'remote_group_id': None}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:38.649167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '88a5b226-666c-424a-bdd2-6d77b0f21308', 'remote_group_id': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:38.654559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:38.671767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:38.672964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:38.702808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.707456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.707949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Fanout notify agent at l3_agent the message router_deleted on router 26c17ba7-87e8-413b-8111-933cd73e63f4 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:38.719372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:38.720030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5da21bf9-3af3-4253-932a-388fe30e9867 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:38.735258 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.738814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c48474a5-334c-49cc-b7dd-d1f02cf5ddd9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/26c17ba7-87e8-413b-8111-933cd73e63f4 HTTP/1.1" status: 204 len: 168 time: 2.6258740 Dec 21 03:59:38.742577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:38.750445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1458125423', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:38.756301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-41c52b46-6b00-4b2f-84a1-56edc5fada40 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 5.1213984 Dec 21 03:59:38.761450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37596) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:38.766299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'port_id': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:38.914361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:38.985442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:39.004803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.021355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.023334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.082963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.091089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42055f53-9c74-4c7f-808c-887805c9efdc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f7e825d467974290b733e78d9d0bbb49&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1025417 Dec 21 03:59:39.095244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37606) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:39.139443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.158043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.169992 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.196567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80858f86-3c48-4a95-9f64-165b5df5075d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:39.215452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.215452 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 15a0df86-0738-4d6c-91f1-1d06ae5642fe disassociated. External IP: 172.25.5.219, port: 4621144f-6a4e-4ade-9095-b7670b2a7c5e. Dec 21 03:59:39.283143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85952095-5610-4f33-b216-9b3dfa1f4197 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.290703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.291647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58063f83-e261-4e88-a8e5-2a40ba9b21a2 req-906aca32-fdc5-43aa-a1ee-56e65f2544ee tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 791 time: 0.6584766 Dec 21 03:59:39.333458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85952095-5610-4f33-b216-9b3dfa1f4197 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.436038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37616) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:39.478194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.526830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85952095-5610-4f33-b216-9b3dfa1f4197 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.529395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85952095-5610-4f33-b216-9b3dfa1f4197 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.530676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-85952095-5610-4f33-b216-9b3dfa1f4197 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/566c6b7f-b7f4-464d-9c23-cd6e583d9def HTTP/1.1" status: 204 len: 168 time: 0.4026027 Dec 21 03:59:39.550347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbc39300-9609-49e4-8336-a7d2e804f8ce req-f91cf73b-1bd1-4913-9c11-18f306a75196 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/88a5b226-666c-424a-bdd2-6d77b0f21308 HTTP/1.1" status: 200 len: 3014 time: 0.1155612 Dec 21 03:59:39.551146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85952095-5610-4f33-b216-9b3dfa1f4197 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=566c6b7f-b7f4-464d-9c23-cd6e583d9def,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:39.872245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.904851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:39.977259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-01da8baa-eee6-4a3e-aa99-747a78297f00 tempest-ServiceProvidersTest-1259301910 tempest-ServiceProvidersTest-1259301910-project] 10.222.0.18 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.5381782 Dec 21 03:59:40.007333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-d672edf6-6f7f-46ba-b819-3d74e2319f26 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-group-rules/80858f86-3c48-4a95-9f64-165b5df5075d HTTP/1.1" status: 200 len: 783 time: 0.4200969 Dec 21 03:59:40.082720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Allocated IP 172.25.5.155 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/8062e307-5e56-4a72-937d-3bb58502d21a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:40.122543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:40.145153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-f9a9ca3f-c534-4df5-b1ca-0774619b9b59 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/88a5b226-666c-424a-bdd2-6d77b0f21308 HTTP/1.1" status: 200 len: 3014 time: 0.1217201 Dec 21 03:59:40.300511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-9e6cb3b0-e430-4335-9070-317bf8f0625f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.323729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-9e6cb3b0-e430-4335-9070-317bf8f0625f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.341982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:40.348834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.355439 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:40.367469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.371786 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:40.384955 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:40.425943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-06fa21b7-d0c3-483d-897c-e9774bb7019d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/floatingips/15a0df86-0738-4d6c-91f1-1d06ae5642fe HTTP/1.1" status: 200 len: 688 time: 1.6600969 Dec 21 03:59:40.426162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37640) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:40.456957 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:40.469841 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:40.470511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:40.488617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-9e6cb3b0-e430-4335-9070-317bf8f0625f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.501148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-9e6cb3b0-e430-4335-9070-317bf8f0625f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.504656 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:40.505503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2dd680b-711f-4630-a663-39269dcdb2c0 req-9e6cb3b0-e430-4335-9070-317bf8f0625f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/80858f86-3c48-4a95-9f64-165b5df5075d HTTP/1.1" status: 204 len: 173 time: 0.3585587 Dec 21 03:59:40.505757 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe1e2d1f-fe88-4088-995e-9e06eb9f1279 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:40.519974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6cb3b0-e430-4335-9070-317bf8f0625f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=80858f86-3c48-4a95-9f64-165b5df5075d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:40.527382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.596610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:40.611016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:40.615214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:40.617190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event updated for resources: {'Port': ['ID=8062e307-5e56-4a72-937d-3bb58502d21a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:40.637393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8911f71b-eac2-484a-bfcb-983d49f378ec None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:40.667875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port d657bf23-03fc-4c38-8bd9-4686761d66a0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:40.668713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.700238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5123ecb2-ca0f-4edd-a991-409bdf84889d req-77c14b8b-4d79-4547-830e-148b632c84da tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/88a5b226-666c-424a-bdd2-6d77b0f21308 HTTP/1.1" status: 200 len: 2415 time: 0.1368284 Dec 21 03:59:40.709027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bfa5a5d3-c952-4f07-942d-37cf28040c1a None None] Provisioning complete for port 8062e307-5e56-4a72-937d-3bb58502d21a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 03:59:40.709491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfa5a5d3-c952-4f07-942d-37cf28040c1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.760506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:40.812331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bfa5a5d3-c952-4f07-942d-37cf28040c1a None None] Port 8062e307-5e56-4a72-937d-3bb58502d21a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 03:59:40.862288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.862619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.879881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for d657bf23-03fc-4c38-8bd9-4686761d66a0 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:40.914727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5123ecb2-ca0f-4edd-a991-409bdf84889d req-141dfe94-f17b-43fa-828e-fd8a31205837 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:40.952246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5123ecb2-ca0f-4edd-a991-409bdf84889d req-141dfe94-f17b-43fa-828e-fd8a31205837 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.108572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd91c00b-3ba5-4e68-8f9f-36ee51897462 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.117019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5123ecb2-ca0f-4edd-a991-409bdf84889d req-141dfe94-f17b-43fa-828e-fd8a31205837 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.120719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5123ecb2-ca0f-4edd-a991-409bdf84889d req-141dfe94-f17b-43fa-828e-fd8a31205837 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.126163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5123ecb2-ca0f-4edd-a991-409bdf84889d req-141dfe94-f17b-43fa-828e-fd8a31205837 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/88a5b226-666c-424a-bdd2-6d77b0f21308 HTTP/1.1" status: 204 len: 173 time: 0.3998427 Dec 21 03:59:41.133115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141dfe94-f17b-43fa-828e-fd8a31205837 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=88a5b226-666c-424a-bdd2-6d77b0f21308,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:41.181358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.185784 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-4f547f7e-a82c-4e28-a139-5efa6659c6f4 req-a36cc18c-af03-46bc-a4a9-63fd1d6349c7 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] show failed (client error): The resource could not be found. Dec 21 03:59:41.188367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f547f7e-a82c-4e28-a139-5efa6659c6f4 req-a36cc18c-af03-46bc-a4a9-63fd1d6349c7 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/8c490bdc-c1b2-4525-bc14-91a30d8cadf4 HTTP/1.1" status: 404 len: 352 time: 0.0270340 Dec 21 03:59:41.265675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e152826f-9bb1-4695-9939-9d798d7d343c req-2cc678fa-b90f-4d19-83c7-f0e87d770e83 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/7089c496-0a3a-476c-92d0-f6c5ef6dd4f1 HTTP/1.1" status: 200 len: 1822 time: 0.0521400 Dec 21 03:59:41.351054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e152826f-9bb1-4695-9939-9d798d7d343c req-0feb75a8-a478-4f3b-9c6f-f5448703e0b8 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.392517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e152826f-9bb1-4695-9939-9d798d7d343c req-0feb75a8-a478-4f3b-9c6f-f5448703e0b8 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.471651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37670) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:41.512238 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd91c00b-3ba5-4e68-8f9f-36ee51897462 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.513894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.551702 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e152826f-9bb1-4695-9939-9d798d7d343c req-0feb75a8-a478-4f3b-9c6f-f5448703e0b8 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.555224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e152826f-9bb1-4695-9939-9d798d7d343c req-0feb75a8-a478-4f3b-9c6f-f5448703e0b8 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.561920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e152826f-9bb1-4695-9939-9d798d7d343c req-0feb75a8-a478-4f3b-9c6f-f5448703e0b8 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/7089c496-0a3a-476c-92d0-f6c5ef6dd4f1 HTTP/1.1" status: 204 len: 173 time: 0.2832439 Dec 21 03:59:41.576494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0feb75a8-a478-4f3b-9c6f-f5448703e0b8 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7089c496-0a3a-476c-92d0-f6c5ef6dd4f1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:41.639779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Request body: {'network': {'name': 'tempest-ListServersNegativeTestJSON-2067007329-network', 'tenant_id': '25e602d8faa04cc58318214eb632f2d3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:41.726887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dcae454-f71a-46e2-bc26-ad462dac2434 req-99e28b67-e75b-4621-9f02-5bb15e9d62f4 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/f1308f67-7472-44b2-a4d2-9d7cbb14d3ea HTTP/1.1" status: 200 len: 1824 time: 0.0790768 Dec 21 03:59:41.797906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcae454-f71a-46e2-bc26-ad462dac2434 req-9d90badb-ab04-4504-9fc4-5f4866475605 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.810778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Made reservation on behalf of 25e602d8faa04cc58318214eb632f2d3 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:41.813294 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.834238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.840303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcae454-f71a-46e2-bc26-ad462dac2434 req-9d90badb-ab04-4504-9fc4-5f4866475605 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.875152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd91c00b-3ba5-4e68-8f9f-36ee51897462 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.882990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=d657bf23-03fc-4c38-8bd9-4686761d66a0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:41.905497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:41.964911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.009208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcae454-f71a-46e2-bc26-ad462dac2434 req-9d90badb-ab04-4504-9fc4-5f4866475605 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.010675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd91c00b-3ba5-4e68-8f9f-36ee51897462 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ddccda3-aa03-4446-942b-61c8638efbec,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:42.015034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcae454-f71a-46e2-bc26-ad462dac2434 req-9d90badb-ab04-4504-9fc4-5f4866475605 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.023263 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd91c00b-3ba5-4e68-8f9f-36ee51897462 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a28894b769744703835fdd7d01b1a258&name=default HTTP/1.1" status: 200 len: 3000 time: 1.2332656 Dec 21 03:59:42.031503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37678) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:42.032250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dcae454-f71a-46e2-bc26-ad462dac2434 req-9d90badb-ab04-4504-9fc4-5f4866475605 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/f1308f67-7472-44b2-a4d2-9d7cbb14d3ea HTTP/1.1" status: 204 len: 173 time: 0.2984087 Dec 21 03:59:42.089213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.092097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.097494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ef218568-b2b0-491b-a215-9e927a682f47 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/floatingips/15a0df86-0738-4d6c-91f1-1d06ae5642fe HTTP/1.1" status: 204 len: 168 time: 1.6644444 Dec 21 03:59:42.109693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d90badb-ab04-4504-9fc4-5f4866475605 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1308f67-7472-44b2-a4d2-9d7cbb14d3ea,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:42.123370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37682) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:42.130492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '8724c5e8-a356-400c-98e3-ca3d4f7b5252'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:42.143153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.170510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4081acb6-32d6-413d-aaea-e10f9a781cdb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.195273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe57f86b-e128-460e-9d7d-b08821079a67 req-1f0f422b-c491-4ff2-97f9-d7988be5d436 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/bf23b9f5-1ef5-41b2-a642-99ac9a6b4385 HTTP/1.1" status: 200 len: 1822 time: 0.1264579 Dec 21 03:59:42.205563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4081acb6-32d6-413d-aaea-e10f9a781cdb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.228267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] vlan segment allocate from pool success with {'vlan_id': 114, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:42.232768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:42.258738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.259232 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Added segment 49474f33-27a4-446a-878e-592b242e9a89 of type vlan for network 9a2e3cff-df9f-4d8c-a079-72779b83430e Dec 21 03:59:42.305876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Router 1e5c30b1-0993-4853-a109-b2606a8bf9e3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 03:59:42.321148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.324144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fe57f86b-e128-460e-9d7d-b08821079a67 req-16ceb943-a761-48a0-aab4-72358da83360 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.338954 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.370167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fe57f86b-e128-460e-9d7d-b08821079a67 req-16ceb943-a761-48a0-aab4-72358da83360 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.370549 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4081acb6-32d6-413d-aaea-e10f9a781cdb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.373690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4081acb6-32d6-413d-aaea-e10f9a781cdb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.377696 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4081acb6-32d6-413d-aaea-e10f9a781cdb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2ddccda3-aa03-4446-942b-61c8638efbec HTTP/1.1" status: 204 len: 168 time: 0.3423893 Dec 21 03:59:42.394387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4081acb6-32d6-413d-aaea-e10f9a781cdb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ddccda3-aa03-4446-942b-61c8638efbec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:42.470652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.470652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:42.470652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.510473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:42.522806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] Sync routers for ids ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:42.564576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] Routers {'1e5c30b1-0993-4853-a109-b2606a8bf9e3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:42.566608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:42.566746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fe57f86b-e128-460e-9d7d-b08821079a67 req-16ceb943-a761-48a0-aab4-72358da83360 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.569242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-fe57f86b-e128-460e-9d7d-b08821079a67 req-16ceb943-a761-48a0-aab4-72358da83360 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.570401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe57f86b-e128-460e-9d7d-b08821079a67 req-16ceb943-a761-48a0-aab4-72358da83360 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/bf23b9f5-1ef5-41b2-a642-99ac9a6b4385 HTTP/1.1" status: 204 len: 173 time: 0.3740954 Dec 21 03:59:42.593613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] Pushing event updated for resources: {'Network': ['ID=9a2e3cff-df9f-4d8c-a079-72779b83430e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:42.615260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a245a31-63f5-4a57-aa11-2cd70fb24589 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.1398778 Dec 21 03:59:42.618514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37692) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:42.621919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:42.628675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:42.629410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Request body: {'subnet': {'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ListServersNegativeTestJSON-2067007329-subnet', 'tenant_id': '25e602d8faa04cc58318214eb632f2d3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:42.635187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ceb943-a761-48a0-aab4-72358da83360 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf23b9f5-1ef5-41b2-a642-99ac9a6b4385,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:42.653498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:42.657336 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-89d65500-8838-4430-af54-331992809819 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 3.9108372 Dec 21 03:59:42.658892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] Routers {'1e5c30b1-0993-4853-a109-b2606a8bf9e3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:42.659084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37694) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:42.660685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:42.670507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:42.720664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:42.721593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e14cb7e-bbbb-4569-9660-0c352e0d100f None None] The sync data for ids ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:42.781948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a9b57c-5aa2-4a37-8699-7b1dbe2ed37e req-ca5938bd-8361-4b2f-b048-d3b95761ff9f tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/756c1b92-84e2-4d2b-a96d-14b15889ecb0 HTTP/1.1" status: 200 len: 2424 time: 0.1825199 Dec 21 03:59:42.816238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.030362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a9b57c-5aa2-4a37-8699-7b1dbe2ed37e req-ed912fda-4f40-4f90-bdd8-a9e6572fe003 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.059595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Made reservation on behalf of 25e602d8faa04cc58318214eb632f2d3 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:43.063694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.087337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a9b57c-5aa2-4a37-8699-7b1dbe2ed37e req-ed912fda-4f40-4f90-bdd8-a9e6572fe003 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.097576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.64 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/cc975bce-bc2f-4a7a-8343-e343afabec4a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:43.333027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.390342 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.428996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a9b57c-5aa2-4a37-8699-7b1dbe2ed37e req-ed912fda-4f40-4f90-bdd8-a9e6572fe003 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.431810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-99a9b57c-5aa2-4a37-8699-7b1dbe2ed37e req-ed912fda-4f40-4f90-bdd8-a9e6572fe003 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.436415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99a9b57c-5aa2-4a37-8699-7b1dbe2ed37e req-ed912fda-4f40-4f90-bdd8-a9e6572fe003 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/756c1b92-84e2-4d2b-a96d-14b15889ecb0 HTTP/1.1" status: 204 len: 173 time: 0.6236801 Dec 21 03:59:43.454071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.468074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed912fda-4f40-4f90-bdd8-a9e6572fe003 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=756c1b92-84e2-4d2b-a96d-14b15889ecb0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:43.482507 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.530578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5171574b-003f-41b9-b776-7fab52ec460b req-d8cd3533-f63a-48a3-8f9b-f26e350bc056 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "GET /v2.0/security-groups/1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2 HTTP/1.1" status: 200 len: 2417 time: 0.0757172 Dec 21 03:59:43.547596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Pushing event updated for resources: {'Subnet': ['ID=e1d5c205-3eca-47e7-8219-52c4df788a19,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:43.617123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Checking segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:43.617301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Network hostable DHCP agents. Network: 9a2e3cff-df9f-4d8c-a079-72779b83430e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:59:43.627898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.698390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:43.711819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:43.714242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:43.722189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:43.724535 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5171574b-003f-41b9-b776-7fab52ec460b req-38a1ea2a-1450-4d44-b858-39594f3d9be9 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.726643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=cc975bce-bc2f-4a7a-8343-e343afabec4a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:43.791801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9a2e3cff-df9f-4d8c-a079-72779b83430e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:43.802548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3ffa421-143d-4145-b322-715a7845edb9 None None] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:43.809108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:43.810008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.814811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Deleting port 8062e307-5e56-4a72-937d-3bb58502d21a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:43.815428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.850706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5171574b-003f-41b9-b776-7fab52ec460b req-38a1ea2a-1450-4d44-b858-39594f3d9be9 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:43.936363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bcb13f4d-9315-453c-9d81-305c7e53c69c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.3164992 Dec 21 03:59:44.023525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc1c4345-790f-4aab-9eba-145984976333 None None] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:44.396204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.420026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Calling delete_port for 8062e307-5e56-4a72-937d-3bb58502d21a owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:44.510003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5171574b-003f-41b9-b776-7fab52ec460b req-38a1ea2a-1450-4d44-b858-39594f3d9be9 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.512761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5171574b-003f-41b9-b776-7fab52ec460b req-38a1ea2a-1450-4d44-b858-39594f3d9be9 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.513889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5171574b-003f-41b9-b776-7fab52ec460b req-38a1ea2a-1450-4d44-b858-39594f3d9be9 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] 10.222.0.18 "DELETE /v2.0/security-groups/1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2 HTTP/1.1" status: 204 len: 173 time: 0.9761682 Dec 21 03:59:44.520720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37748) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:44.577637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Deleting subnet 5817e346-c7b0-47c7-a6b5-16734a1a9318 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:44.583480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.592309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a1ea2a-1450-4d44-b858-39594f3d9be9 tempest-SecurityGroupRulesTestJSON-1660965836 tempest-SecurityGroupRulesTestJSON-1660965836-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1046decf-5ac1-40d6-86c6-a4d0d3c6a9b2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:44.597858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.642488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.690035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.854543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.893996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5817e346-c7b0-47c7-a6b5-16734a1a9318,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:44.902542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:44.906879 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7966711b-169e-4c30-a4f7-c6932955c117 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/5817e346-c7b0-47c7-a6b5-16734a1a9318 HTTP/1.1" status: 204 len: 168 time: 0.3850424 Dec 21 03:59:44.910389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37758) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:45.000920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.103361 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.168583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f59317a-85a3-4e33-993f-7690ec6b520a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:45.196339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '304a8347-f0be-403b-8e64-c0c9317c7f4b') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:45.196655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '304a8347-f0be-403b-8e64-c0c9317c7f4b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:45.208680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.227158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.230113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.236065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-b9b662d0-b79f-43a1-bd7c-c6b2b00907f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:45.237462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Releasing vlan 118 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:45.237596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-b9b662d0-b79f-43a1-bd7c-c6b2b00907f0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1097 time: 0.2139709 Dec 21 03:59:45.237699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:45.241005 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:45.289507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-bf7dda1e-04fb-47e9-bc2a-0b3617f0de5c tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:45.291084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-bf7dda1e-04fb-47e9-bc2a-0b3617f0de5c tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/networks?id=9a2e3cff-df9f-4d8c-a079-72779b83430e HTTP/1.1" status: 200 len: 818 time: 0.7857943 Dec 21 03:59:45.401555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-96dee96c-9bff-49d5-962f-51514f82549f tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/quotas/25e602d8faa04cc58318214eb632f2d3 HTTP/1.1" status: 200 len: 375 time: 0.0642126 Dec 21 03:59:45.401953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.413608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.420341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] 10.222.0.18 "DELETE /v2.0/networks/3f59317a-85a3-4e33-993f-7690ec6b520a HTTP/1.1" status: 204 len: 168 time: 0.5072765 Dec 21 03:59:45.433740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ec980e-832c-48a2-b6bb-2134eff9fc48 admin admin] Pushing event deleted for resources: {'Network': ['ID=3f59317a-85a3-4e33-993f-7690ec6b520a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:45.514330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-e0ec89b9-bf13-4e5c-afe9-2b740021c09b tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0529385 Dec 21 03:59:45.616108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-de531165-f9c7-4691-b195-dab658fb3fbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:45.617933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-de531165-f9c7-4691-b195-dab658fb3fbf service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.3369627 Dec 21 03:59:45.710000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.770440 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 03:59:45.772539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Pushing event deleted for resources: {'Port': ['ID=8062e307-5e56-4a72-937d-3bb58502d21a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:45.788625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5d39c09-85f3-488a-b20e-6807d429850c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 03:59:45.851188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-5c1c2b16-1c8b-4dcf-932e-0db6412514f5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 1001 time: 0.2137551 Dec 21 03:59:45.868953 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.941605 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:45.962963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37780) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:46.019775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.036605 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-86410096-8d88-4c17-a7fd-21266fa13208 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6a0b27fbd0d7479d80dde5acc2cf0587&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0715351 Dec 21 03:59:46.042070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37782) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:46.057581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-1f682efd-8b97-449b-98b1-a00abf0650c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:46.059121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-1f682efd-8b97-449b-98b1-a00abf0650c8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.1855774 Dec 21 03:59:46.109007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37784) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:46.133628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98dc6a0e-a17d-4766-a9be-ba88ed1cf6f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.200211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98dc6a0e-a17d-4766-a9be-ba88ed1cf6f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.297097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f3dccd9-c62d-497e-90d6-beb4b825c9a7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.344377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=cc975bce-bc2f-4a7a-8343-e343afabec4a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:46.359107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98dc6a0e-a17d-4766-a9be-ba88ed1cf6f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.363114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98dc6a0e-a17d-4766-a9be-ba88ed1cf6f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.366925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98dc6a0e-a17d-4766-a9be-ba88ed1cf6f3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1800ca96-35c5-48ed-a5a0-1f20fc963aeb HTTP/1.1" status: 204 len: 168 time: 0.3211808 Dec 21 03:59:46.378197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dc6a0e-a17d-4766-a9be-ba88ed1cf6f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1800ca96-35c5-48ed-a5a0-1f20fc963aeb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:46.382719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.468008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f3dccd9-c62d-497e-90d6-beb4b825c9a7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.546551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-3ded7b60-cf6c-429a-8e31-563945e1da78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:46.548861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-3ded7b60-cf6c-429a-8e31-563945e1da78 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.4711924 Dec 21 03:59:46.551073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.551521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f3dccd9-c62d-497e-90d6-beb4b825c9a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.558207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-e5bfd712-9d5d-43d1-ac7d-b5bdb2d69b76 service neutron] 10.222.0.18 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0235958 Dec 21 03:59:46.574542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.662885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6f3dccd9-c62d-497e-90d6-beb4b825c9a7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d944f157da3348d49af2a1321d938f77&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5434761 Dec 21 03:59:46.664905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:46.668060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3dccd9-c62d-497e-90d6-beb4b825c9a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=792d1e41-283c-4561-95e8-e480a4a7e0c8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:46.768719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ad42aa1a-4225-4f26-a9dc-d66c7b84f859 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.808362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ad42aa1a-4225-4f26-a9dc-d66c7b84f859 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.939632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ad42aa1a-4225-4f26-a9dc-d66c7b84f859 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.942227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ad42aa1a-4225-4f26-a9dc-d66c7b84f859 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:46.944266 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ad42aa1a-4225-4f26-a9dc-d66c7b84f859 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/792d1e41-283c-4561-95e8-e480a4a7e0c8 HTTP/1.1" status: 204 len: 168 time: 0.2575877 Dec 21 03:59:46.956483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad42aa1a-4225-4f26-a9dc-d66c7b84f859 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=792d1e41-283c-4561-95e8-e480a4a7e0c8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:46.982076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-0f8bd723-3cca-45f5-8040-e980d91b5fa5 service neutron] 10.222.0.18 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4096596 Dec 21 03:59:46.983292 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 75954dca-13dc-40c4-8f6c-989b7e53d3ed associated. External IP: 172.25.5.64, port: 8724c5e8-a356-400c-98e3-ca3d4f7b5252. Dec 21 03:59:46.993896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Router 1e5c30b1-0993-4853-a109-b2606a8bf9e3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:47.063929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-37ca0d21-3039-43e1-b837-f5ba318c7990 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5021746 Dec 21 03:59:47.597003 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-97192bcb-27d3-4ac6-9298-0193da6cc85b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.0694590 Dec 21 03:59:47.680234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:47.709705 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] Sync routers for ids ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:47.724675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:47.728136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-82461253-be86-4d37-af9d-0727605ee237 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "PUT /v2.0/routers/1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 200 len: 710 time: 5.0657895 Dec 21 03:59:47.728577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:47.741597 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] Routers {'1e5c30b1-0993-4853-a109-b2606a8bf9e3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:47.742246 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:47.795773 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:47.949918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] Routers {'1e5c30b1-0993-4853-a109-b2606a8bf9e3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:47.949918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:47.949918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:47.949918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2658a37-2d43-464f-8410-475d1a28b567 None None] The sync data for ids ['1e5c30b1-0993-4853-a109-b2606a8bf9e3'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ed0de1cc-3f2f-4573-b878-89209cca837a tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/routers/1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 200 len: 745 time: 0.1330185 Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:47.952373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-96d6fd3c-4f1b-4e6a-a96a-38e6a53454d3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.0939879 Dec 21 03:59:47.953509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae13a9f-9d5b-4512-8dbf-097cdbae8de7 req-a8c48036-eaed-48da-8026-373186c512c2 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.1429639 Dec 21 03:59:47.958272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37836) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.031543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0ef58e0a-b9ec-44c6-9e01-e76630a6bc65 tempest-RoutersIpV6AdminTest-1074121308 tempest-RoutersIpV6AdminTest-1074121308-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 200 len: 205 time: 0.0719736 Dec 21 03:59:48.034947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-45386664-9cf2-4281-a82c-4d359bd7eb2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:48.037163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-45386664-9cf2-4281-a82c-4d359bd7eb2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:48.037644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-45386664-9cf2-4281-a82c-4d359bd7eb2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:48.038785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4dbc8c9-055c-428e-9def-46ab926a6dc7 req-82addcd9-2ffd-4a61-9387-7b76dc767cda service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5874522 Dec 21 03:59:48.039366 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-45386664-9cf2-4281-a82c-4d359bd7eb2f service neutron] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 2297 time: 0.1336675 Dec 21 03:59:48.039552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37838) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.055180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:48.072164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b47f0213-a026-44c9-8aa3-658e0686871a tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 200 len: 205 time: 0.0283952 Dec 21 03:59:48.073297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37842) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.120189 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-1a77b71f-059c-4a08-ab06-30362365c8a7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 1001 time: 0.0729063 Dec 21 03:59:48.166874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.189917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37844) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.199155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-aff8e77a-0e6a-4468-b334-81f446279691 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:48.201148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-aff8e77a-0e6a-4468-b334-81f446279691 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.0730655 Dec 21 03:59:48.210543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cffca68-6190-4286-8252-8a48cd984f68 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.222254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37848) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.324171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:48.340938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:48.363574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:48.364643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:48.405645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cffca68-6190-4286-8252-8a48cd984f68 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.408369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-7318f69b-e16c-4ee3-9b59-74f36bd627e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:48.409963 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-7318f69b-e16c-4ee3-9b59-74f36bd627e1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2009542 Dec 21 03:59:48.416391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:48.428931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:48.430808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:48.501470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:48.502413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdd7d357-7ea8-4ce2-ab9e-4c5a51f07f9c None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:48.518383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.538983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupsNegativeTestJSON-363175347-network', 'tenant_id': '30df159eba4443658de26a2bb74a9bb5'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:48.544269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cffca68-6190-4286-8252-8a48cd984f68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.574270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.579143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.589718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1934090f-29ed-4168-ac7c-2d2b178c484e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 981 time: 6.4636924 Dec 21 03:59:48.590825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37858) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.605230 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3cffca68-6190-4286-8252-8a48cd984f68 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9ff70d1a2e334f3187688c71cd9cfbb4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4139292 Dec 21 03:59:48.616011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37860) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.645001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cffca68-6190-4286-8252-8a48cd984f68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71a925d6-cc63-486b-8ac0-84bc9e2ec8ce,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:48.651915 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-38040e82-8ab8-4d30-9067-b1e8cb51d1cb service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2303894 Dec 21 03:59:48.722470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7d7ee343-1fbb-47da-9b70-026a62dfdae9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/floatingips/75954dca-13dc-40c4-8f6c-989b7e53d3ed HTTP/1.1" status: 200 len: 976 time: 0.1264446 Dec 21 03:59:48.723158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37866) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.758013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Made reservation on behalf of 30df159eba4443658de26a2bb74a9bb5 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:48.760590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.779516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.783966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6685fbb7-befc-4c38-a1f9-538776f7920b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.810514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.812417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Fanout notify agent at l3_agent the message router_deleted on router 1e5c30b1-0993-4853-a109-b2606a8bf9e3 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 03:59:48.841022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6685fbb7-befc-4c38-a1f9-538776f7920b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.846371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:48.851650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1b43f4aa-8885-43ce-88f9-7f64aa0ee1cb tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 204 len: 168 time: 0.7773740 Dec 21 03:59:48.852408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.861490 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-3e2a6cff-c569-4654-ac93-373e364ee8f9 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1995037 Dec 21 03:59:48.922496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-676337d0-5a2d-47ce-be24-bd3b49cc9d3e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 200 len: 205 time: 0.0589662 Dec 21 03:59:48.925292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37874) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.937754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-99332be1-dc79-42af-9587-f0ade0431960 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 979 time: 0.2105107 Dec 21 03:59:48.939217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37876) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:48.945297 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-9ec62bc4-e152-4780-ae74-e4a5a2fbcfd8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.83&port_id=bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 217 time: 0.0688117 Dec 21 03:59:48.945465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'port_id': '4621144f-6a4e-4ade-9095-b7670b2a7c5e'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:49.021636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-d0bf27a7-a1ac-46fd-8259-b946c098e7a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:49.023290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-d0bf27a7-a1ac-46fd-8259-b946c098e7a1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0729725 Dec 21 03:59:49.035436 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-2885dfa3-b8bb-4db4-9399-6d676db1512e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] delete failed (client error): The resource could not be found. Dec 21 03:59:49.038161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.039500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2885dfa3-b8bb-4db4-9399-6d676db1512e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/1e5c30b1-0993-4853-a109-b2606a8bf9e3 HTTP/1.1" status: 404 len: 336 time: 0.1131098 Dec 21 03:59:49.040179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37882) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.076563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6685fbb7-befc-4c38-a1f9-538776f7920b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.080526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6685fbb7-befc-4c38-a1f9-538776f7920b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.081835 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6685fbb7-befc-4c38-a1f9-538776f7920b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/71a925d6-cc63-486b-8ac0-84bc9e2ec8ce HTTP/1.1" status: 204 len: 168 time: 0.4647450 Dec 21 03:59:49.098357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6685fbb7-befc-4c38-a1f9-538776f7920b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71a925d6-cc63-486b-8ac0-84bc9e2ec8ce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:49.102366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.118840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 03:59:49.135033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.135444 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Added segment 262723ae-e2b9-4f10-92ad-ded9112a2b66 of type vlan for network d86903fb-61a0-41c0-a0c2-b1ff237c79d9 Dec 21 03:59:49.168771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-a6c2142b-3b18-43a2-988d-4b07bd4d6430 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:49.168771 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-a6c2142b-3b18-43a2-988d-4b07bd4d6430 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1320181 Dec 21 03:59:49.172053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-efe304f5-00c3-41d3-b408-5d9e2b919572 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=26c17ba7-87e8-413b-8111-933cd73e63f4 HTTP/1.1" status: 200 len: 205 time: 0.1277399 Dec 21 03:59:49.174215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37886) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.179184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.191622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01c6a7ad-e4c2-4020-bb58-2428101f9378 req-1ac5cc8e-ae04-415b-9da6-980e74742a1c tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.1311076 Dec 21 03:59:49.271890 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-761ad463-83cf-4a2e-a749-ed66a7ee3bc9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] delete failed (client error): The resource could not be found. Dec 21 03:59:49.272979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-761ad463-83cf-4a2e-a749-ed66a7ee3bc9 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/26c17ba7-87e8-413b-8111-933cd73e63f4 HTTP/1.1" status: 404 len: 336 time: 0.0895309 Dec 21 03:59:49.277989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.286249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d660f1fd-c800-44e3-9e5d-203e5ea8718b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:49.304678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.328664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37890) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.328802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0059f375-7f3f-454d-b95c-f093031292fa tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=0a9690f5-219e-481f-a14d-74a46bc88323 HTTP/1.1" status: 200 len: 205 time: 0.0439034 Dec 21 03:59:49.393954 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-425be043-38e4-4a52-9e8c-f42ff11f4aca tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] delete failed (client error): The resource could not be found. Dec 21 03:59:49.397764 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-425be043-38e4-4a52-9e8c-f42ff11f4aca tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/0a9690f5-219e-481f-a14d-74a46bc88323 HTTP/1.1" status: 404 len: 336 time: 0.0628462 Dec 21 03:59:49.398621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37892) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.439832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-02b14024-0109-4150-98e3-304ac29bba1a service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2533724 Dec 21 03:59:49.441628 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6f24e204-fd98-42fd-8346-e6fd9fb22e64 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=e06663d1-9648-4977-b7b9-701aa19434ab HTTP/1.1" status: 200 len: 205 time: 0.0421133 Dec 21 03:59:49.446369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37896) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.488969 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-6ba89713-aa5c-4bc9-bd3e-aa0b042f34bc tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] delete failed (client error): The resource could not be found. Dec 21 03:59:49.490315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ba89713-aa5c-4bc9-bd3e-aa0b042f34bc tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/e06663d1-9648-4977-b7b9-701aa19434ab HTTP/1.1" status: 404 len: 336 time: 0.0427113 Dec 21 03:59:49.493249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37900) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.528547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b03f6b2a-20e4-4f17-a448-0584eb2cf5f7 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4acbac3-e425-4325-87b9-3631c022a618 HTTP/1.1" status: 200 len: 205 time: 0.0342207 Dec 21 03:59:49.563534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.574952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.574952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:49.574952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:49.619917 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-c68c0b91-bf66-4b37-9a95-732cc7d10480 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] delete failed (client error): The resource could not be found. Dec 21 03:59:49.620044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c68c0b91-bf66-4b37-9a95-732cc7d10480 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/e4acbac3-e425-4325-87b9-3631c022a618 HTTP/1.1" status: 404 len: 336 time: 0.0555084 Dec 21 03:59:49.624719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37906) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.770676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a66c8cb6-aaa1-4f13-9262-625c519ec828 tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "GET /v2.0/ports?device_id=5b75e0b5-0642-45bc-a34d-732b7786b43c HTTP/1.1" status: 200 len: 205 time: 0.1414413 Dec 21 03:59:49.772805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37916) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.787893 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.5646634 Dec 21 03:59:49.793750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37918) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.801132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Request body: {'subnet': {'network_id': 'd86903fb-61a0-41c0-a0c2-b1ff237c79d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupsNegativeTestJSON-363175347-subnet', 'tenant_id': '30df159eba4443658de26a2bb74a9bb5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:49.811309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5affca2d-aaa9-415e-af0c-05209f021b9d admin admin] Pushing event updated for resources: {'Network': ['ID=d86903fb-61a0-41c0-a0c2-b1ff237c79d9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:49.815244 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-e7caad96-f3e4-4a25-88ad-b55445373f80 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3725445 Dec 21 03:59:49.822716 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-942f9883-7c7c-447a-9a19-150162bc074c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] delete failed (client error): The resource could not be found. Dec 21 03:59:49.822716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-942f9883-7c7c-447a-9a19-150162bc074c tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/routers/5b75e0b5-0642-45bc-a34d-732b7786b43c HTTP/1.1" status: 404 len: 336 time: 0.0470979 Dec 21 03:59:49.826188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:49.828415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d86903fb-61a0-41c0-a0c2-b1ff237c79d9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 03:59:49.946549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-1eef5a49-fca7-43ba-83ff-29d8ffc6d661 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.54&port_id=c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 217 time: 0.1192470 Dec 21 03:59:49.961168 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-47ae49e8-ccfb-414d-93c7-4c412205b7ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:50.018106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Made reservation on behalf of 30df159eba4443658de26a2bb74a9bb5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:50.021006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:50.061894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-7d68c1f5-5753-4084-b3b0-8703ca69aa15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:50.064152 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-7d68c1f5-5753-4084-b3b0-8703ca69aa15 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.1079767 Dec 21 03:59:50.180742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-ffd3abe4-01d8-4552-b72f-999081cc79e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:50.182812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-ffd3abe4-01d8-4552-b72f-999081cc79e8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0792003 Dec 21 03:59:50.217048 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-0cea7e10-3c17-4782-b97c-e76302f0674e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] DELETE failed (client error): The resource could not be found. Dec 21 03:59:50.217691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0cea7e10-3c17-4782-b97c-e76302f0674e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 03:59:50.220955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0cea7e10-3c17-4782-b97c-e76302f0674e tempest-RoutersIpV6AdminTest-1516622181 tempest-RoutersIpV6AdminTest-1516622181-project] 10.222.0.18 "DELETE /v2.0/subnets/c832c73d-cc9e-46ff-b517-4b217d53b5a5 HTTP/1.1" status: 404 len: 337 time: 0.3936062 Dec 21 03:59:50.345756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2911c9e-d51b-4208-9348-03462f404e3f req-c7dd1b0c-3612-4b07-ad23-1a908308ab4a tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.0413520 Dec 21 03:59:50.406634 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-1b449821-9b3c-4c61-96d9-0697d4274b6a service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2158804 Dec 21 03:59:50.522167 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-5dbcf73d-f02c-4d5e-becc-bbc124e8ec76 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1076641 Dec 21 03:59:50.537599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:50.636654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-4171756a-a2c3-4fe1-97f1-554d7973fa91 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.84&port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 217 time: 0.0864666 Dec 21 03:59:50.649897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:50.728760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:50.753747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Pushing event updated for resources: {'Subnet': ['ID=dbffc757-5bb1-4c3f-a9dd-491c55fabad9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:50.761750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-489854c1-bd40-44f3-8d64-0ca42fbe5761 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:50.763343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-489854c1-bd40-44f3-8d64-0ca42fbe5761 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.1024275 Dec 21 03:59:50.764290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Checking segment: {'id': '262723ae-e2b9-4f10-92ad-ded9112a2b66', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'd86903fb-61a0-41c0-a0c2-b1ff237c79d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:50.764664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Network hostable DHCP agents. Network: d86903fb-61a0-41c0-a0c2-b1ff237c79d9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 03:59:50.862078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-5ed27f35-04e0-4074-b56f-5da591b09f62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:50.864874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-5ed27f35-04e0-4074-b56f-5da591b09f62 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0932364 Dec 21 03:59:50.943681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Network d86903fb-61a0-41c0-a0c2-b1ff237c79d9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 03:59:50.995247 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 75954dca-13dc-40c4-8f6c-989b7e53d3ed associated. External IP: 172.25.5.64, port: 8724c5e8-a356-400c-98e3-ca3d4f7b5252. Dec 21 03:59:51.005270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37946) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:51.036929 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-5591ece5-ddf2-40cf-ad29-c2502e4df9bd service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1638427 Dec 21 03:59:51.122024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d86903fb-61a0-41c0-a0c2-b1ff237c79d9) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:51.126905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:51.127767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:51.133398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-373823ac-9797-4b49-912c-098f0c0ac45e None None] Network d86903fb-61a0-41c0-a0c2-b1ff237c79d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:51.253127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-05be754a-c388-4ef2-9cdb-c2d1ea5994f8 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2083688 Dec 21 03:59:51.325321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70eabdf2-5589-492f-8144-7d0ed5fb314b None None] Network d86903fb-61a0-41c0-a0c2-b1ff237c79d9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 03:59:51.429347 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4edde22d-f394-4ea4-8b5a-4f14e24f957c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.6253245 Dec 21 03:59:51.448831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-725ca5cf-1a8d-4b22-aed3-e709096e4ff8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.56&port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 217 time: 0.1807652 Dec 21 03:59:51.543488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a9e7ddc-d584-4f3e-b530-034d7e947924 req-ddeeda13-4e30-4838-9fd7-8b93bf212b36 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.0795336 Dec 21 03:59:51.548975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-baeca849-9d59-495b-b3ba-10bf4ac41beb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:51.550259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-14fd2a3a-db04-403e-a170-258ed6bc1d92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:51.552578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-14fd2a3a-db04-403e-a170-258ed6bc1d92 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0790286 Dec 21 03:59:51.592641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:51.682778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-204f949e-2821-4113-b4da-dbd0a1f824b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:51.685860 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-204f949e-2821-4113-b4da-dbd0a1f824b9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1242566 Dec 21 03:59:51.821955 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-baeca849-9d59-495b-b3ba-10bf4ac41beb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:51.824506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:51.838496 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:51.866279 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:51.867225 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:51.906289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-baeca849-9d59-495b-b3ba-10bf4ac41beb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:51.980579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-fc332dc0-7847-4cc4-ba6a-66e4d5377791 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2864137 Dec 21 03:59:51.981998 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:52.011983 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:52.013161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:52.021731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baeca849-9d59-495b-b3ba-10bf4ac41beb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5f2b595-b14e-4651-980e-156e44436b71,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:52.112377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-baeca849-9d59-495b-b3ba-10bf4ac41beb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a0dd45c2286a486ca0df9221975c10d8&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1056056 Dec 21 03:59:52.136366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:52.145261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:52.148202 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f711dae2-cfb1-4dd3-99c0-14f796b252cd None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:52.334437 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-04bf3cc4-ab22-439f-9959-2e1e6c766bf7 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3453870 Dec 21 03:59:52.337079 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-4b8a4123-ac96-4922-aebe-0ecc275ff3bd req-d3cbe463-7ac7-4fca-bdb5-fc0a7a1f374d tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] show failed (client error): The resource could not be found. Dec 21 03:59:52.339333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b8a4123-ac96-4922-aebe-0ecc275ff3bd req-d3cbe463-7ac7-4fca-bdb5-fc0a7a1f374d tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups/182bf146-71d7-42d1-ab1e-dc66d7e6b27e HTTP/1.1" status: 404 len: 352 time: 0.0469496 Dec 21 03:59:52.391502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-0abdf4aa-b215-46ea-bbb1-adfbe7abdb66 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:52.394865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-0abdf4aa-b215-46ea-bbb1-adfbe7abdb66 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "GET /v2.0/networks?id=9a2e3cff-df9f-4d8c-a079-72779b83430e HTTP/1.1" status: 200 len: 818 time: 0.4891050 Dec 21 03:59:52.442233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-e001c479-37c4-44eb-9c28-89c81d7c4c63 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 217 time: 0.0963013 Dec 21 03:59:52.443871 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74ee49f9-6688-4be8-adf3-53e7376eacfb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:52.456506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Request body: {'port': {'device_id': '0c270495-f454-48a9-b572-af531f212cec', 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'admin_state_up': True, 'tenant_id': '25e602d8faa04cc58318214eb632f2d3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:52.536244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74ee49f9-6688-4be8-adf3-53e7376eacfb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:52.671624 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aaa2183b-1305-455c-bad8-c39543c65796 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:52.719641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:52.760125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bf8fbca-8f30-4983-b096-f73c757b5bd9 req-34977ace-332b-4dc0-9589-ad7bccc58a95 tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=30df159eba4443658de26a2bb74a9bb5 HTTP/1.1" status: 200 len: 3005 time: 0.3638000 Dec 21 03:59:52.772382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74ee49f9-6688-4be8-adf3-53e7376eacfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:52.784604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74ee49f9-6688-4be8-adf3-53e7376eacfb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:52.789232 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74ee49f9-6688-4be8-adf3-53e7376eacfb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f5f2b595-b14e-4651-980e-156e44436b71 HTTP/1.1" status: 204 len: 168 time: 0.6499472 Dec 21 03:59:52.828710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-ba30c018-159b-4bab-8222-39957d4acf02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:52.831044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-ba30c018-159b-4bab-8222-39957d4acf02 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.1867220 Dec 21 03:59:52.831903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74ee49f9-6688-4be8-adf3-53e7376eacfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5f2b595-b14e-4651-980e-156e44436b71,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:52.856337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-161ae7de-a9b6-4ec3-b04a-8bc29d77561f req-b12482d5-843e-48ab-ad1f-a5eaf886033f tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.0498390 Dec 21 03:59:52.941171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-479362b0-2d04-41b2-a588-73d88d9717db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:52.942789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-479362b0-2d04-41b2-a588-73d88d9717db service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1039886 Dec 21 03:59:53.022462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bf8fbca-8f30-4983-b096-f73c757b5bd9 req-3cec2a7c-baa7-4d26-98c8-f6a3e2021adc tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups/d660f1fd-c800-44e3-9e5d-203e5ea8718b HTTP/1.1" status: 200 len: 3002 time: 0.2613702 Dec 21 03:59:53.040394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-9f4fcd9d-7622-4a55-b770-44a6578b8b39 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:53.041941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-9f4fcd9d-7622-4a55-b770-44a6578b8b39 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.31 "GET /v2.0/networks?id=9a2e3cff-df9f-4d8c-a079-72779b83430e HTTP/1.1" status: 200 len: 818 time: 0.5831718 Dec 21 03:59:53.075918 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-2e67df24-480e-42e7-a866-5006850a081c service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1253450 Dec 21 03:59:53.077740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Request body: {'port': {'device_id': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'admin_state_up': True, 'tenant_id': '25e602d8faa04cc58318214eb632f2d3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:53.179213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:53.201704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:53.211593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bf8fbca-8f30-4983-b096-f73c757b5bd9 req-9b3437dc-09ff-433c-8761-9c3d25fab0b6 tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups/d660f1fd-c800-44e3-9e5d-203e5ea8718b HTTP/1.1" status: 200 len: 3002 time: 0.1842368 Dec 21 03:59:53.346532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Made reservation on behalf of 25e602d8faa04cc58318214eb632f2d3 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:53.351816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:53.506254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-def1737f-ceaf-40e4-b0bf-075eb780df81 req-0bb9ec62-a5bb-4a7d-946e-2e63c8d4fb2d tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups/d660f1fd-c800-44e3-9e5d-203e5ea8718b HTTP/1.1" status: 200 len: 3002 time: 0.2587485 Dec 21 03:59:53.558805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Made reservation on behalf of 25e602d8faa04cc58318214eb632f2d3 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:53.563238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:53.649029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:53.661789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:53.674300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:53.679256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:53.680608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:53.743371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:53.765639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:53.766840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:53.947896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-c827ce05-47a0-4b27-b18f-de36bcb0285d service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8642294 Dec 21 03:59:54.002703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-c11088a1-c3af-4530-8c82-2a9541a23780 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:54.004557 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-c11088a1-c3af-4530-8c82-2a9541a23780 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "GET /v2.0/networks?id=9a2e3cff-df9f-4d8c-a079-72779b83430e HTTP/1.1" status: 200 len: 818 time: 0.4680531 Dec 21 03:59:54.055721 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-89149b9c-6c9f-48f5-9745-7e3370e1c7e7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0498064 Dec 21 03:59:54.056721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38020) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:54.069103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Request body: {'port': {'device_id': '236ee84c-147e-46f1-82ef-6527b966171d', 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'admin_state_up': True, 'tenant_id': '25e602d8faa04cc58318214eb632f2d3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:54.131029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:54.131714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f774885e-b4ca-44db-a54a-9da2443bd523 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:54.272228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38024) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:54.285319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69339225-6356-447d-ab66-d1017160358e req-2ea703a4-a055-43f8-904a-4178ad9f367e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.0630407 Dec 21 03:59:54.290859 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-def1737f-ceaf-40e4-b0bf-075eb780df81 req-57b5d88e-3399-44b3-a50d-e0f15b231be0 tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 21 03:59:54.291954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-def1737f-ceaf-40e4-b0bf-075eb780df81 req-57b5d88e-3399-44b3-a50d-e0f15b231be0 tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "DELETE /v2.0/security-groups/d660f1fd-c800-44e3-9e5d-203e5ea8718b HTTP/1.1" status: 409 len: 352 time: 0.7408979 Dec 21 03:59:54.331848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-752105f0-d292-438b-bc7e-fd8671b93cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:54.332121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e066ce2d-0dc7-4d1a-b016-060740d9350b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/floatingips/75954dca-13dc-40c4-8f6c-989b7e53d3ed HTTP/1.1" status: 200 len: 977 time: 5.3903441 Dec 21 03:59:54.333942 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-752105f0-d292-438b-bc7e-fd8671b93cd6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.1189334 Dec 21 03:59:54.334735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Allocated IP 172.20.0.6 (9a2e3cff-df9f-4d8c-a079-72779b83430e/e1d5c205-3eca-47e7-8219-52c4df788a19/7ef63f5e-ff78-41e5-aca9-9dbc5044f5de) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:54.339923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38030) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:54.347052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'port_id': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:54.373958 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-4910388f-b7d5-41a7-9cde-6fb7da5c59c6 req-3ad6ac94-0058-43e1-834e-2cc2f2820e6e tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] show failed (client error): The resource could not be found. Dec 21 03:59:54.375045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4910388f-b7d5-41a7-9cde-6fb7da5c59c6 req-3ad6ac94-0058-43e1-834e-2cc2f2820e6e tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups/2911c816-9348-42fa-99b1-44ee241bf269 HTTP/1.1" status: 404 len: 352 time: 0.0171628 Dec 21 03:59:54.427685 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-b2e5188b-d611-4cbd-9dd1-38817fc7bf6c req-32956ad3-d901-4d2c-8d06-eadde84819cf tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] show failed (client error): The resource could not be found. Dec 21 03:59:54.428354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c5bf6e6f-1f53-46f6-85e1-e9cb52302483 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3ac74c038ad149e39cb78a7657542c0c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3687665 Dec 21 03:59:54.429144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2e5188b-d611-4cbd-9dd1-38817fc7bf6c req-32956ad3-d901-4d2c-8d06-eadde84819cf tempest-SecurityGroupsNegativeTestJSON-2061818270 tempest-SecurityGroupsNegativeTestJSON-2061818270-project] 10.222.0.18 "GET /v2.0/security-groups/cf9608fd-287a-4664-89c7-5d28b016f4b9 HTTP/1.1" status: 404 len: 352 time: 0.0259209 Dec 21 03:59:54.434120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38034) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:54.445601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38036) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:54.451595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Made reservation on behalf of 25e602d8faa04cc58318214eb632f2d3 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:54.455689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.509342 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.548541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.559399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-1fcc3232-5823-4c72-be36-352fdfcea44b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:54.561204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-1fcc3232-5823-4c72-be36-352fdfcea44b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2178886 Dec 21 03:59:54.595114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Deleting subnet dbffc757-5bb1-4c3f-a9dd-491c55fabad9 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 03:59:54.602406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.649094 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91e85df-fd80-457b-809b-c301bfe1cac1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.740565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91e85df-fd80-457b-809b-c301bfe1cac1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.770952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.818758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-7e309e9b-bb60-4d33-ace3-b3a35b278e4a service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2480330 Dec 21 03:59:54.821450 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.883761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.890082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.962381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.963460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.986746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:54.987133 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 75954dca-13dc-40c4-8f6c-989b7e53d3ed disassociated. External IP: 172.25.5.64, port: 4621144f-6a4e-4ade-9095-b7670b2a7c5e. Dec 21 03:59:54.991610 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-817bb0f4-af01-41fb-a720-5edc0ae20451 req-dd27406b-cd3d-4b60-ad23-f21e57bf9abb service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348133 Dec 21 03:59:55.202859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 03:59:55.226356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.300177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91e85df-fd80-457b-809b-c301bfe1cac1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.300177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c91e85df-fd80-457b-809b-c301bfe1cac1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.300177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c91e85df-fd80-457b-809b-c301bfe1cac1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/af18c905-b9f2-43a0-b212-8d65604d8d14 HTTP/1.1" status: 204 len: 168 time: 0.8012557 Dec 21 03:59:55.300177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.300177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.301766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.337775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dbffc757-5bb1-4c3f-a9dd-491c55fabad9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:55.339662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91e85df-fd80-457b-809b-c301bfe1cac1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af18c905-b9f2-43a0-b212-8d65604d8d14,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:55.351517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.357546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-282cda32-325d-4014-a3e1-c10ed79e66f1 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/dbffc757-5bb1-4c3f-a9dd-491c55fabad9 HTTP/1.1" status: 204 len: 168 time: 0.9084466 Dec 21 03:59:55.363384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:55.365624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b23e2a4-44fb-4953-b9a5-e05e7bbecf51,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:55.377316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:55.383336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Pushing event updated for resources: {'Port': ['ID=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:55.383977 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f73422880e044771a21691e579872a07&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1071997 Dec 21 03:59:55.386357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:55.390922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38050) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:55.394069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Allocated IP 172.20.0.7 (9a2e3cff-df9f-4d8c-a079-72779b83430e/e1d5c205-3eca-47e7-8219-52c4df788a19/d817f625-9ed3-48ad-bce2-e997d275f853) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:55.400966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:55.417012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.417366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.417712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.418147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.418675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.419113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.419461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.419826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.420158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.420482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.420846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.421177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.421646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b47f70e-1bfc-4a75-a262-67936a5e88e8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 03:59:55.481876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 03:59:55.488408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.504106 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 03:59:55.520101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.523518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-445a1ee6-33b8-4c92-b813-f7ef41e4d217 req-953c48e9-4cd5-44f6-9353-67fe36733511 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.0676618 Dec 21 03:59:55.536092 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-576996cc-032f-44c8-a424-9a24df67991f tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/floatingips/75954dca-13dc-40c4-8f6c-989b7e53d3ed HTTP/1.1" status: 200 len: 687 time: 1.1902306 Dec 21 03:59:55.536092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:55.559261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:55.560563 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.564648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:55.571085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.613058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfd727fd-0d22-4264-9538-3348cea49221 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.641310 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.661929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 03:59:55.662888 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.702270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ebcfd5c1-8dd4-4d07-945f-478d6a3d84c1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2564888 Dec 21 03:59:55.716463 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.717943 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-740f2d0e-37d4-4cc1-add1-768b10eb8da9 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 03:59:55.721866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfd727fd-0d22-4264-9538-3348cea49221 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.728894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Request body: {'port': {'device_id': '0c270495-f454-48a9-b572-af531f212cec', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:55.734618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.743236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.766219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d86903fb-61a0-41c0-a0c2-b1ff237c79d9']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.785662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '262723ae-e2b9-4f10-92ad-ded9112a2b66') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.786457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '262723ae-e2b9-4f10-92ad-ded9112a2b66') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 03:59:55.798452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.820123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port cc975bce-bc2f-4a7a-8343-e343afabec4a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 03:59:55.820740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.827601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.852778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 03:59:55.852778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: timer() Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 03:59:55.858630 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 03:59:55.941678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:55.971706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.007299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.012159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.041843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for cc975bce-bc2f-4a7a-8343-e343afabec4a owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 03:59:56.102656 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.117717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.125027 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] 10.222.0.18 "DELETE /v2.0/networks/d86903fb-61a0-41c0-a0c2-b1ff237c79d9 HTTP/1.1" status: 204 len: 168 time: 0.7600584 Dec 21 03:59:56.164378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a4e455-56d7-46da-8ab7-83b71b70d2f6 admin admin] Pushing event deleted for resources: {'Network': ['ID=d86903fb-61a0-41c0-a0c2-b1ff237c79d9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:56.233844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfd727fd-0d22-4264-9538-3348cea49221 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.237328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfd727fd-0d22-4264-9538-3348cea49221 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.242241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cfd727fd-0d22-4264-9538-3348cea49221 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1b23e2a4-44fb-4953-b9a5-e05e7bbecf51 HTTP/1.1" status: 204 len: 168 time: 0.8497419 Dec 21 03:59:56.243667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.323682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Allocated IP 172.20.0.8 (9a2e3cff-df9f-4d8c-a079-72779b83430e/e1d5c205-3eca-47e7-8219-52c4df788a19/2efceb72-a55b-415d-8362-853328770af0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:56.332469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd727fd-0d22-4264-9538-3348cea49221 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b23e2a4-44fb-4953-b9a5-e05e7bbecf51,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:56.351805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:56.355528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:56.361281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:56.411119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Pushing event updated for resources: {'Port': ['ID=d817f625-9ed3-48ad-bce2-e997d275f853,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:56.461413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:56.462058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.615587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.645998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-534a53f5-9269-47ee-9016-95113f26d3f5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.5723124 Dec 21 03:59:56.667090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5e17f1f-1e70-4e0b-b7b2-a6427f62f85e req-d192020a-580b-48ac-bd40-f9ba25372102 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 210 time: 0.0362761 Dec 21 03:59:56.673391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Request body: {'port': {'device_id': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:56.742083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.762552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.790978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38082) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:56.805392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:56.808125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=cc975bce-bc2f-4a7a-8343-e343afabec4a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:56.977946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Network 9a2e3cff-df9f-4d8c-a079-72779b83430e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:56.991052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:57.016032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:57.049578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cb8f3119-7e6a-40df-93e6-fe74e2b705f1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=30df159eba4443658de26a2bb74a9bb5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2542667 Dec 21 03:59:57.055365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38100) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.078049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:59:57.083326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Pushing event updated for resources: {'Port': ['ID=2efceb72-a55b-415d-8362-853328770af0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:57.087940 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.095860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.098476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.102415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1cd85e9-ad64-4acf-832c-9cbaa3615a2c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/floatingips/75954dca-13dc-40c4-8f6c-989b7e53d3ed HTTP/1.1" status: 204 len: 168 time: 1.5633132 Dec 21 03:59:57.102570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Transition to ACTIVE for port object 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:59:57.102570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38104) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.120893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:57.121500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.143124 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-a6a36f10-239d-4d03-8f1f-72edf89a0533 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] delete failed (client error): The resource could not be found. Dec 21 03:59:57.144300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a6a36f10-239d-4d03-8f1f-72edf89a0533 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/floatingips/75954dca-13dc-40c4-8f6c-989b7e53d3ed HTTP/1.1" status: 404 len: 345 time: 0.0405030 Dec 21 03:59:57.150448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38106) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.182402 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd616f67-cf32-454f-83a3-8b4d7be3a42d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.327291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.378828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38116) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.381086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Pushing event updated for resources: {'Port': ['ID=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:57.420932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3dc25ee3-2157-4a91-a856-87009699c4f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.507124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-429aa9e5-0d20-4872-af1d-594dfa8c7aed tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4491050 Dec 21 03:59:57.529194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Request body: {'port': {'device_id': '236ee84c-147e-46f1-82ef-6527b966171d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:57.560517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd616f67-cf32-454f-83a3-8b4d7be3a42d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.561097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d817f625-9ed3-48ad-bce2-e997d275f853 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:59:57.578566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.588803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86ec6adb-e5fe-48eb-8ecc-894d05f30583 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:57.592049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Attempting to bind port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:59:57.592393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Attempting to bind port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:59:57.592721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Attempting to bind port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de on network 9a2e3cff-df9f-4d8c-a079-72779b83430e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:57.594996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86ec6adb-e5fe-48eb-8ecc-894d05f30583 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:57.603088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86ec6adb-e5fe-48eb-8ecc-894d05f30583 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:57.607376 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-86ec6adb-e5fe-48eb-8ecc-894d05f30583 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/ports?network_id=b672c264-59db-4f56-873d-1e399cb0cd1a HTTP/1.1" status: 200 len: 2357 time: 0.4561791 Dec 21 03:59:57.607769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de on network 9a2e3cff-df9f-4d8c-a079-72779b83430e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:59:57.608122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Attempting to bind port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de on network 9a2e3cff-df9f-4d8c-a079-72779b83430e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:57.609884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38118) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.612355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Transition to ACTIVE for port object d817f625-9ed3-48ad-bce2-e997d275f853 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:59:57.621327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:59:57.621677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Checking segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:57.622071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Bound using segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:59:57.622506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Bound port: 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:59:57.622865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.678044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3dc25ee3-2157-4a91-a856-87009699c4f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.700058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.720843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] For port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:59:57.725559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ffa5654-3956-483f-a840-f90c263e0e99 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:57.727132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7ffa5654-3956-483f-a840-f90c263e0e99 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/subnets/76bec629-6735-4479-9cb2-edaf6be1f8e5 HTTP/1.1" status: 200 len: 797 time: 0.1129801 Dec 21 03:59:57.732553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38124) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.733631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] For port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:59:57.745131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.756810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'port': {'network_id': 'b672c264-59db-4f56-873d-1e399cb0cd1a', 'name': 'tempest-FloatingIPTestJSON-1521967688', 'fixed_ips': [{'ip_address': '172.20.0.14'}, {'ip_address': '172.20.0.13'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:57.797386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3dc25ee3-2157-4a91-a856-87009699c4f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.860048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.893212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Pushing event updated for resources: {'Port': ['ID=d817f625-9ed3-48ad-bce2-e997d275f853,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:57.900117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc25ee3-2157-4a91-a856-87009699c4f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0aaf878d-02ea-4ab8-a2c5-a935fbe02143,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:57.904759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3dc25ee3-2157-4a91-a856-87009699c4f3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6494e630ebca4d91a2b81ea78037182f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5243583 Dec 21 03:59:57.916979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:57.949009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd616f67-cf32-454f-83a3-8b4d7be3a42d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.949244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:57.949766 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.951188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] 10.222.0.54 "PUT /v2.0/ports/7ef63f5e-ff78-41e5-aca9-9dbc5044f5de HTTP/1.1" status: 200 len: 1092 time: 2.2316451 Dec 21 03:59:57.951583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd616f67-cf32-454f-83a3-8b4d7be3a42d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:57.955692 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bd616f67-cf32-454f-83a3-8b4d7be3a42d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d660f1fd-c800-44e3-9e5d-203e5ea8718b HTTP/1.1" status: 204 len: 168 time: 0.8916266 Dec 21 03:59:57.969975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c270495-f454-48a9-b572-af531f212cec', 'tag': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:59:57.972241 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-814f4852-e131-496b-bf16-71b39968091d" -d '{"events": [{"name": "network-changed", "server_uuid": "0c270495-f454-48a9-b572-af531f212cec", "tag": "7ef63f5e-ff78-41e5-aca9-9dbc5044f5de"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:59:58.030292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be1b620-bdd0-421d-b9cd-a7854a362ee0 req-e5411a08-0392-4c59-afd5-a38dafc733b6 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:58.032306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1be1b620-bdd0-421d-b9cd-a7854a362ee0 req-e5411a08-0392-4c59-afd5-a38dafc733b6 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 931 time: 0.2380397 Dec 21 03:59:58.071019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd616f67-cf32-454f-83a3-8b4d7be3a42d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d660f1fd-c800-44e3-9e5d-203e5ea8718b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:58.087480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9dd10c7-e536-47d2-a81a-8530b99d1443 service neutron] Pushing event updated for resources: {'Port': ['ID=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:58.093483 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:59:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5727ee83-2025-45a9-ad56-dd55f3c03301 x-openstack-request-id: req-5727ee83-2025-45a9-ad56-dd55f3c03301 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:59:58.094091 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0c270495-f454-48a9-b572-af531f212cec", "tag": "7ef63f5e-ff78-41e5-aca9-9dbc5044f5de", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:59:58.094594 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5727ee83-2025-45a9-ad56-dd55f3c03301 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:59:58.095266 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c270495-f454-48a9-b572-af531f212cec', 'tag': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de', 'status': 'completed', 'code': 200} Dec 21 03:59:58.103452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Attempting to bind port d817f625-9ed3-48ad-bce2-e997d275f853 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:59:58.104546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Attempting to bind port d817f625-9ed3-48ad-bce2-e997d275f853 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:59:58.105136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Attempting to bind port d817f625-9ed3-48ad-bce2-e997d275f853 on network 9a2e3cff-df9f-4d8c-a079-72779b83430e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:58.127171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Port d817f625-9ed3-48ad-bce2-e997d275f853 on network 9a2e3cff-df9f-4d8c-a079-72779b83430e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:59:58.127808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Attempting to bind port d817f625-9ed3-48ad-bce2-e997d275f853 on network 9a2e3cff-df9f-4d8c-a079-72779b83430e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:58.172279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 59, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:59:58.173654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Checking segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:58.174302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Bound using segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:59:58.175049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Bound port: d817f625-9ed3-48ad-bce2-e997d275f853, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:59:58.175719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.184501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1be1b620-bdd0-421d-b9cd-a7854a362ee0 req-737be6ea-771c-4aa1-8fb9-4858516a0b1f tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431696 Dec 21 03:59:58.231989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4347b9-5784-478e-9247-eee13e8d4d41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.290667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814f4852-e131-496b-bf16-71b39968091d req-ae7ace2d-58e2-49dc-9ad6-77bf9c23ff59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:58.292289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-814f4852-e131-496b-bf16-71b39968091d req-ae7ace2d-58e2-49dc-9ad6-77bf9c23ff59 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 1095 time: 0.1620028 Dec 21 03:59:58.296931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4347b9-5784-478e-9247-eee13e8d4d41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.338327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144e16cb-9199-420e-b769-661c5a4833da req-c0aa7647-45c2-4cef-9724-f12db6384078 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:58.339913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-144e16cb-9199-420e-b769-661c5a4833da req-c0aa7647-45c2-4cef-9724-f12db6384078 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.1461263 Dec 21 03:59:58.365430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:58.399355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2efceb72-a55b-415d-8362-853328770af0 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 03:59:58.418565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] For port d817f625-9ed3-48ad-bce2-e997d275f853, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:59:58.448703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.479946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] For port d817f625-9ed3-48ad-bce2-e997d275f853, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d817f625-9ed3-48ad-bce2-e997d275f853,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:59:58.497752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.515874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-144e16cb-9199-420e-b769-661c5a4833da req-739bba04-c6fc-4598-af62-9775d08118a9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1489384 Dec 21 03:59:58.528094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] device_id is not set on port 020644e3-5cd1-44b5-b800-3d0c1c6c2b4e yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 03:59:58.556593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Transition to ACTIVE for port object 2efceb72-a55b-415d-8362-853328770af0 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 03:59:58.592368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814f4852-e131-496b-bf16-71b39968091d req-d8c1ea68-9f47-4491-ab66-9cb6ca558de6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:58.593872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-814f4852-e131-496b-bf16-71b39968091d req-d8c1ea68-9f47-4491-ab66-9cb6ca558de6 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=25e602d8faa04cc58318214eb632f2d3&shared=False HTTP/1.1" status: 200 len: 919 time: 0.2838657 Dec 21 03:59:58.624510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4347b9-5784-478e-9247-eee13e8d4d41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.628775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4347b9-5784-478e-9247-eee13e8d4d41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.631403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d4347b9-5784-478e-9247-eee13e8d4d41 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0aaf878d-02ea-4ab8-a2c5-a935fbe02143 HTTP/1.1" status: 204 len: 168 time: 0.7139719 Dec 21 03:59:58.635958 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.699616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38170) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 03:59:58.719275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4347b9-5784-478e-9247-eee13e8d4d41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0aaf878d-02ea-4ab8-a2c5-a935fbe02143,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:58.756928 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.777056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:58.780472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:58.781080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] 10.222.0.31 "PUT /v2.0/ports/d817f625-9ed3-48ad-bce2-e997d275f853 HTTP/1.1" status: 200 len: 1092 time: 2.1120086 Dec 21 03:59:58.862808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5caf96-7212-4f88-a84a-6abaf3d38890 service neutron] Pushing event updated for resources: {'Port': ['ID=d817f625-9ed3-48ad-bce2-e997d275f853,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:58.874634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814f4852-e131-496b-bf16-71b39968091d req-28809cd8-f484-465a-b819-aa7993202955 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:58.876792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-814f4852-e131-496b-bf16-71b39968091d req-28809cd8-f484-465a-b819-aa7993202955 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2735238 Dec 21 03:59:58.887299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de17520-77d9-40bf-8254-852840303383 service neutron] Pushing event updated for resources: {'Port': ['ID=2efceb72-a55b-415d-8362-853328770af0,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:59.037890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ea383367-27e3-4dfe-838e-72a9053edccb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.039465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-ea383367-27e3-4dfe-838e-72a9053edccb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 1095 time: 0.0971923 Dec 21 03:59:59.041467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-bb3180fd-af81-40b1-b4c2-dff2cd7ecc33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.042839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-bb3180fd-af81-40b1-b4c2-dff2cd7ecc33 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 1095 time: 0.0544517 Dec 21 03:59:59.047522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Attempting to bind port 2efceb72-a55b-415d-8362-853328770af0 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 03:59:59.047897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Attempting to bind port 2efceb72-a55b-415d-8362-853328770af0 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 03:59:59.048230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Attempting to bind port 2efceb72-a55b-415d-8362-853328770af0 on network 9a2e3cff-df9f-4d8c-a079-72779b83430e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:59.054827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Port 2efceb72-a55b-415d-8362-853328770af0 on network 9a2e3cff-df9f-4d8c-a079-72779b83430e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 03:59:59.055181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Attempting to bind port 2efceb72-a55b-415d-8362-853328770af0 on network 9a2e3cff-df9f-4d8c-a079-72779b83430e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 03:59:59.067447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 03:59:59.067795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Checking segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 03:59:59.068193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Bound using segment: {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 03:59:59.068634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Bound port: 2efceb72-a55b-415d-8362-853328770af0, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '49474f33-27a4-446a-878e-592b242e9a89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 03:59:59.068999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.185142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.14 (b672c264-59db-4f56-873d-1e399cb0cd1a/76bec629-6735-4479-9cb2-edaf6be1f8e5/020644e3-5cd1-44b5-b800-3d0c1c6c2b4e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:59.192302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] For port 2efceb72-a55b-415d-8362-853328770af0, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 03:59:59.197086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] For port 2efceb72-a55b-415d-8362-853328770af0, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2efceb72-a55b-415d-8362-853328770af0,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 03:59:59.199084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.13 (b672c264-59db-4f56-873d-1e399cb0cd1a/76bec629-6735-4479-9cb2-edaf6be1f8e5/020644e3-5cd1-44b5-b800-3d0c1c6c2b4e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 03:59:59.316200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.434880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.436189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.437276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-7de17520-77d9-40bf-8254-852840303383 service neutron] 10.222.0.54 "PUT /v2.0/ports/2efceb72-a55b-415d-8362-853328770af0 HTTP/1.1" status: 200 len: 1092 time: 1.9136376 Dec 21 03:59:59.440565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '236ee84c-147e-46f1-82ef-6527b966171d', 'tag': '2efceb72-a55b-415d-8362-853328770af0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 03:59:59.455734 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbd2586f-5c70-41af-88f0-a8dfe0771393" -d '{"events": [{"name": "network-changed", "server_uuid": "236ee84c-147e-46f1-82ef-6527b966171d", "tag": "2efceb72-a55b-415d-8362-853328770af0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 03:59:59.566141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.568622 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 03:59:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd412642-a1ee-407b-8256-024d40d85239 x-openstack-request-id: req-dd412642-a1ee-407b-8256-024d40d85239 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 03:59:59.568917 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "236ee84c-147e-46f1-82ef-6527b966171d", "tag": "2efceb72-a55b-415d-8362-853328770af0", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 03:59:59.579645 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dd412642-a1ee-407b-8256-024d40d85239 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 03:59:59.579645 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '236ee84c-147e-46f1-82ef-6527b966171d', 'tag': '2efceb72-a55b-415d-8362-853328770af0', 'status': 'completed', 'code': 200} Dec 21 03:59:59.585547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de17520-77d9-40bf-8254-852840303383 service neutron] Pushing event updated for resources: {'Port': ['ID=2efceb72-a55b-415d-8362-853328770af0,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:59.593174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-74526174', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 03:59:59.598315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-68c64b57-7b95-42c8-abc1-a315aa42dcf1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d817f625-9ed3-48ad-bce2-e997d275f853 HTTP/1.1" status: 200 len: 217 time: 0.0565195 Dec 21 03:59:59.599757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-c07c715f-5d0b-4c0e-b1bd-8233307ef114 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de HTTP/1.1" status: 200 len: 217 time: 0.5462070 Dec 21 03:59:59.644112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd2586f-5c70-41af-88f0-a8dfe0771393 req-19a01f36-3a4d-4289-b2a1-b5c43bb83069 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.646095 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bbd2586f-5c70-41af-88f0-a8dfe0771393 req-19a01f36-3a4d-4289-b2a1-b5c43bb83069 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 1095 time: 0.0705330 Dec 21 03:59:59.745708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.748768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-49ed46d0-2d09-4a45-9b69-6857e6606671 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.750421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-49ed46d0-2d09-4a45-9b69-6857e6606671 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e1d5c205-3eca-47e7-8219-52c4df788a19 HTTP/1.1" status: 200 len: 858 time: 0.1396520 Dec 21 03:59:59.752904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-4b42bd3c-b26c-47d0-bfda-11284e7f5ed7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.754334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-4b42bd3c-b26c-47d0-bfda-11284e7f5ed7 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1d5c205-3eca-47e7-8219-52c4df788a19 HTTP/1.1" status: 200 len: 858 time: 0.1412494 Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.762265 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0ac55f-d8bb-432f-9f23-d00c5e5a5554 req-89859f1f-7673-4bf0-8232-e84cded2f206 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.765519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab0ac55f-d8bb-432f-9f23-d00c5e5a5554 req-89859f1f-7673-4bf0-8232-e84cded2f206 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 943 time: 0.2220328 Dec 21 03:59:59.835252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 03:59:59.836583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-9634e8fb-5ab4-4617-8651-a3f1e222bbd1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9a2e3cff-df9f-4d8c-a079-72779b83430e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0687206 Dec 21 03:59:59.841615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 03:59:59.842526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-0804a583-93ed-4a0d-8cdf-53a89dce721c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9a2e3cff-df9f-4d8c-a079-72779b83430e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0765209 Dec 21 03:59:59.848122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 03:59:59.849672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Made reservation on behalf of 8a9a0decf8c04abbb44a5429ac89c005 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 03:59:59.852126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.899410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.900158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.903204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 03:59:59.903384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd2586f-5c70-41af-88f0-a8dfe0771393 req-a1487fa3-466b-41cc-abd0-05bf193694d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 03:59:59.904931 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bbd2586f-5c70-41af-88f0-a8dfe0771393 req-a1487fa3-466b-41cc-abd0-05bf193694d1 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=25e602d8faa04cc58318214eb632f2d3&shared=False HTTP/1.1" status: 200 len: 919 time: 0.2435596 Dec 21 03:59:59.914911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=020644e3-5cd1-44b5-b800-3d0c1c6c2b4e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 03:59:59.937956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab0ac55f-d8bb-432f-9f23-d00c5e5a5554 req-6fa44f00-b433-4011-8313-bdc38d04aee1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1514633 Dec 21 04:00:00.045232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd2586f-5c70-41af-88f0-a8dfe0771393 req-e8aaf2c4-8a74-430c-9710-5f84f9b11681 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:00.045232 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bbd2586f-5c70-41af-88f0-a8dfe0771393 req-e8aaf2c4-8a74-430c-9710-5f84f9b11681 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1289909 Dec 21 04:00:00.047387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a086767a-8d56-400c-b245-1cfb633cd963 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1010 time: 2.2953534 Dec 21 04:00:00.050399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38218) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:00.054765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '020644e3-5cd1-44b5-b800-3d0c1c6c2b4e', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:00.098540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'tag': 'd817f625-9ed3-48ad-bce2-e997d275f853'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:00.101066 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc541cd3-9c26-4c38-8838-2e67503e55bc" -d '{"events": [{"name": "network-changed", "server_uuid": "2256f673-4608-4b6a-8dce-c9d48bd4bb4f", "tag": "d817f625-9ed3-48ad-bce2-e997d275f853"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:00.119130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-5071b0b9-e13a-4a84-a79f-c1d478ed2287 service neutron] 10.222.0.54 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2617776 Dec 21 04:00:00.137386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.141069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-165cdab5-3c6d-452a-b2e1-c581368812a6 service neutron] 10.222.0.31 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2827199 Dec 21 04:00:00.164900 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-120562a2-3abd-4f31-9f1d-ca47cc3273b2 x-openstack-request-id: req-120562a2-3abd-4f31-9f1d-ca47cc3273b2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:00.165224 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2256f673-4608-4b6a-8dce-c9d48bd4bb4f", "tag": "d817f625-9ed3-48ad-bce2-e997d275f853", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:00.165457 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-120562a2-3abd-4f31-9f1d-ca47cc3273b2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:00.165860 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'tag': 'd817f625-9ed3-48ad-bce2-e997d275f853', 'status': 'completed', 'code': 200} Dec 21 04:00:00.177805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-1965ea9d-829c-4a90-b1a9-0f50e70a153a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:00.180031 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-1965ea9d-829c-4a90-b1a9-0f50e70a153a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 1095 time: 0.0730591 Dec 21 04:00:00.180805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.248609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-320f1ba8-cc2c-4c89-8a2a-55a94e921279 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2efceb72-a55b-415d-8362-853328770af0 HTTP/1.1" status: 200 len: 217 time: 0.0510921 Dec 21 04:00:00.261957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.277137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] device_id is not set on port 5c6f3172-64b3-437c-a967-d8eaa6fffb5a yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:00:00.353962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fdefde-8952-45a8-b407-54b617f70e40 req-efbda1a7-a71c-4a84-b38b-29b1ea9aadf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:00.355436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-efbda1a7-a71c-4a84-b38b-29b1ea9aadf3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1d5c205-3eca-47e7-8219-52c4df788a19 HTTP/1.1" status: 200 len: 858 time: 0.0954404 Dec 21 04:00:00.367777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2ff3f17-8caf-44c5-945c-67996dd6ca4d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:00.391159 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-b2702404-8680-4a09-a9f2-ec8962679997 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9a2e3cff-df9f-4d8c-a079-72779b83430e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262582 Dec 21 04:00:00.402965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.403251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.403593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.403938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.404281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.404619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.404958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.405415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.405754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.406095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.406427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.406752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.407233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:00.424702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-6bf73462-038b-49c7-aecd-5bcd194330a8 service neutron] 10.222.0.54 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2908874 Dec 21 04:00:00.424702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-b6f50bf6-8a5a-459f-b3a1-c54ba5178127 service neutron] 10.222.0.31 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2599115 Dec 21 04:00:00.436751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.477700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Allocated IP 172.25.5.15 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/5c6f3172-64b3-437c-a967-d8eaa6fffb5a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:00.543391 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-8193c223-e8b8-46df-956c-76e1c9cc1f04 service neutron] 10.222.0.54 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1429074 Dec 21 04:00:00.653010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.656932 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-43fdefde-8952-45a8-b407-54b617f70e40 req-b00fe123-ab65-48ac-990e-9fdfc89db688 service neutron] 10.222.0.54 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010251 Dec 21 04:00:00.733340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-f489fcda-3d14-41c3-99a2-0f1471881b86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:00.735856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-f489fcda-3d14-41c3-99a2-0f1471881b86 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=25e602d8faa04cc58318214eb632f2d3&device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 1095 time: 0.0740275 Dec 21 04:00:00.742426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38242) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:00.837273 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.840063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-9fd6e13c-e09b-4bc8-b293-032c69e2f91b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:00.841996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-9fd6e13c-e09b-4bc8-b293-032c69e2f91b service neutron] 10.222.0.31 "GET /v2.0/networks?id=9a2e3cff-df9f-4d8c-a079-72779b83430e HTTP/1.1" status: 200 len: 919 time: 0.0994177 Dec 21 04:00:00.877135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fbf296a2-d9c5-4bf0-a464-5d3c40f556e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:00.914974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.129 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/39c9c67c-00c8-4801-851b-256517e54a72) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:00.921828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:00.926255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-b8dc83c4-ac5f-4cbb-baa6-cfcf0cf77331 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d817f625-9ed3-48ad-bce2-e997d275f853 HTTP/1.1" status: 200 len: 217 time: 0.0535550 Dec 21 04:00:00.928816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:00.932412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:00.951682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-267610c5-55dd-4d9b-9800-0ea25c06b594 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:01.020350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:01.021256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.025374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Pushing event updated for resources: {'Port': ['ID=5c6f3172-64b3-437c-a967-d8eaa6fffb5a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:01.057806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f387fba-7f47-4235-bbe5-9b509e916161 None None] Provisioning complete for port 5c6f3172-64b3-437c-a967-d8eaa6fffb5a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:01.058687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-b8239d03-0fab-4a37-9e2e-79d225087c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:01.059364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f387fba-7f47-4235-bbe5-9b509e916161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.060011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-b8239d03-0fab-4a37-9e2e-79d225087c06 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e1d5c205-3eca-47e7-8219-52c4df788a19 HTTP/1.1" status: 200 len: 858 time: 0.0918932 Dec 21 04:00:01.066364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fbf296a2-d9c5-4bf0-a464-5d3c40f556e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.080098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.103997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2ed59bf2-0d34-49c3-b5b8-8fa0a74c47fa tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1030 time: 2.4029622 Dec 21 04:00:01.110676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38254) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:01.116866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.15'}]}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:01.118752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2f387fba-7f47-4235-bbe5-9b509e916161 None None] Port 5c6f3172-64b3-437c-a967-d8eaa6fffb5a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:01.120638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-df93e420-a29e-43b7-b370-697487775698 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9a2e3cff-df9f-4d8c-a079-72779b83430e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0478375 Dec 21 04:00:01.123659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fbf296a2-d9c5-4bf0-a464-5d3c40f556e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.170031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1041a9d-7d41-4e59-b8b5-0cb14126865a req-7d142613-fcf5-4ddd-8337-60f154c29bc1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:01.171699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1041a9d-7d41-4e59-b8b5-0cb14126865a req-7d142613-fcf5-4ddd-8337-60f154c29bc1 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 943 time: 0.1107440 Dec 21 04:00:01.182259 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fbf296a2-d9c5-4bf0-a464-5d3c40f556e4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4010cd88120241338aeddf3351d5d625&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4387178 Dec 21 04:00:01.184502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf296a2-d9c5-4bf0-a464-5d3c40f556e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a176a55-962c-468c-b98f-d48715607b2e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:01.186802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38256) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:01.243221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb16ab75-6ed4-4cb6-9168-4baea20e58d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.270744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb16ab75-6ed4-4cb6-9168-4baea20e58d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.285754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1041a9d-7d41-4e59-b8b5-0cb14126865a req-10a89bf5-e1a1-40a7-b41b-52ea0f76607b tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736947 Dec 21 04:00:01.287933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-e9d2e0b0-7926-4847-9134-ca9b3c0c6d66 service neutron] 10.222.0.31 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1582503 Dec 21 04:00:01.374628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.388914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc541cd3-9c26-4c38-8838-2e67503e55bc req-226c30a7-b738-4aaf-a6f1-7d20e64040df service neutron] 10.222.0.31 "GET /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916586 Dec 21 04:00:01.419427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:01.424755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.424755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.427241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb16ab75-6ed4-4cb6-9168-4baea20e58d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.429553 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb16ab75-6ed4-4cb6-9168-4baea20e58d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:01.430704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cb16ab75-6ed4-4cb6-9168-4baea20e58d5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0a176a55-962c-468c-b98f-d48715607b2e HTTP/1.1" status: 204 len: 168 time: 0.2410064 Dec 21 04:00:01.438991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:01.450140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:01.473723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=39c9c67c-00c8-4801-851b-256517e54a72,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:01.476128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb16ab75-6ed4-4cb6-9168-4baea20e58d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a176a55-962c-468c-b98f-d48715607b2e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:01.534686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.101962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.141249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:02.232086 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.255603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:02.258095 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48fa9756-f0e3-477a-80c5-1ec4e3e8f9bd" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-unplugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:02.274094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:02.320666 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7de10677-7404-4e00-8cc8-3de95f4c2541 x-openstack-request-id: req-7de10677-7404-4e00-8cc8-3de95f4c2541 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:02.321157 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-unplugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:02.321725 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7de10677-7404-4e00-8cc8-3de95f4c2541 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:02.322669 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 04:00:02.338263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.345278 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.444785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e15bf3-2b99-4b3b-9e38-00e5cbf2c5c9 req-c94e044f-72c2-43a0-8783-20e9e20b3301 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:02.456767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9e15bf3-2b99-4b3b-9e38-00e5cbf2c5c9 req-c94e044f-72c2-43a0-8783-20e9e20b3301 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 943 time: 0.0764096 Dec 21 04:00:02.461775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:02.505529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9e15bf3-2b99-4b3b-9e38-00e5cbf2c5c9 req-640143a5-0137-48c1-bda6-cc536b0758bf tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475509 Dec 21 04:00:02.509384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.582422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.614216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.741656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38322) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:02.865222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsTestJSON-1062062628-network', 'tenant_id': 'c82f9e49f19f46738135f46f20ba1250'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:02.874200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:02.973122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.006295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.018138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Made reservation on behalf of c82f9e49f19f46738135f46f20ba1250 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:03.024982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.029205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.117653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.181909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=39c9c67c-00c8-4801-851b-256517e54a72,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:03.235861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.240649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.243437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.253534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.299164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:03.320417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.320821 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Added segment b673eb42-6d7a-401b-8a71-e499dbff8232 of type vlan for network efd58aa7-1c72-4652-9ba8-beaf117a1e6b Dec 21 04:00:03.322224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc698d81-1881-4e13-a825-56c971cdc44b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:03.377219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.392328 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 89564193-617f-4224-8814-db6bff15a47f associated. External IP: 172.25.5.129, port: 020644e3-5cd1-44b5-b800-3d0c1c6c2b4e. Dec 21 04:00:03.431032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.431571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Fanout notify agent at l3_agent the message router_deleted on router debdd6b4-5360-47a6-b59b-15eecc2b637f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:00:03.466115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2efceb72-a55b-415d-8362-853328770af0 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:03.522112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.523412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:03.524079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.555899 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] create failed (client error): There was a conflict when trying to complete your request. Dec 21 04:00:03.559635 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-71d9a432-26cf-49a6-b812-11e1fe20c446 tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 2.4452384 Dec 21 04:00:03.561175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38356) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:03.569472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2efceb72-a55b-415d-8362-853328770af0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2efceb72-a55b-415d-8362-853328770af0,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:03.583992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '2efceb72-a55b-415d-8362-853328770af0', 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'port_id': '2efceb72-a55b-415d-8362-853328770af0', 'mac_address': 'fa:16:3e:7c:2e:9b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1d5c205-3eca-47e7-8219-52c4df788a19', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:03.662557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.680073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2efceb72-a55b-415d-8362-853328770af0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:03.743326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] Pushing event updated for resources: {'Network': ['ID=efd58aa7-1c72-4652-9ba8-beaf117a1e6b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:03.779874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network efd58aa7-1c72-4652-9ba8-beaf117a1e6b details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:03.797348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aa96445c-5232-4081-af0e-56abc9e9f18c admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.0542338 Dec 21 04:00:03.800253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38366) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:03.802969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:03.812384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Request body: {'subnet': {'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsTestJSON-1062062628-subnet', 'tenant_id': 'c82f9e49f19f46738135f46f20ba1250', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:03.840574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2efceb72-a55b-415d-8362-853328770af0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2efceb72-a55b-415d-8362-853328770af0,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:03.928774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:03.930191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:03.940408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c727d0-998e-45bd-89c5-2531d51bad1b req-9420e95b-3c5b-4505-a8eb-edd1a67fd41e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:03.943609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46c727d0-998e-45bd-89c5-2531d51bad1b req-9420e95b-3c5b-4505-a8eb-edd1a67fd41e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 943 time: 0.2774241 Dec 21 04:00:03.982282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:03.997437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:04.009705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de', 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'port_id': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de', 'mac_address': 'fa:16:3e:64:c9:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1d5c205-3eca-47e7-8219-52c4df788a19', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:04.013978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:04.017513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Made reservation on behalf of c82f9e49f19f46738135f46f20ba1250 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:04.020918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.062314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Deleting port 5c6f3172-64b3-437c-a967-d8eaa6fffb5a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:04.062666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.062925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:04.064131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:04.121308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.122703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:04.143105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46c727d0-998e-45bd-89c5-2531d51bad1b req-6e61cad7-ea19-4ddb-b865-8bd1e762036d tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1814528 Dec 21 04:00:04.162546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d817f625-9ed3-48ad-bce2-e997d275f853 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:04.192535 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cebb5115-5d69-4936-b887-7959a70b34c8 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 984 time: 4.1416264 Dec 21 04:00:04.196897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38386) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:04.202442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'port_id': '020644e3-5cd1-44b5-b800-3d0c1c6c2b4e', 'fixed_ip_address': '172.20.0.13'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:04.208804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2efceb72-a55b-415d-8362-853328770af0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:04.236142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:04.239740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:04.256568 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.287264 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.305470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.315266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Calling delete_port for 5c6f3172-64b3-437c-a967-d8eaa6fffb5a owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:04.317722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:04.326226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:04.326884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1762a02-7131-40b4-b9d6-a63c4f3f21e0 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:04.361840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:04.445746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d817f625-9ed3-48ad-bce2-e997d275f853, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d817f625-9ed3-48ad-bce2-e997d275f853,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:04.471052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.517620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'd817f625-9ed3-48ad-bce2-e997d275f853', 'network_id': '9a2e3cff-df9f-4d8c-a079-72779b83430e', 'port_id': 'd817f625-9ed3-48ad-bce2-e997d275f853', 'mac_address': 'fa:16:3e:e2:02:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1d5c205-3eca-47e7-8219-52c4df788a19', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:04.543651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.585107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:04.602614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.633968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d817f625-9ed3-48ad-bce2-e997d275f853 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:04.640211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.663303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d817f625-9ed3-48ad-bce2-e997d275f853, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d817f625-9ed3-48ad-bce2-e997d275f853,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:04.672034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=749eed8f-1884-4400-ae3c-14e64dd7b748,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:04.676970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Pushing event deleted for resources: {'Port': ['ID=5c6f3172-64b3-437c-a967-d8eaa6fffb5a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:04.678744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Checking segment: {'id': 'b673eb42-6d7a-401b-8a71-e499dbff8232', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:04.679148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Network hostable DHCP agents. Network: efd58aa7-1c72-4652-9ba8-beaf117a1e6b, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:04.703909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aed26947-6df0-433f-b6a2-943c8d7d6ff8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:04.764079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.768391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e1291bb4-f7c0-4feb-a1dd-5cca8f88710f tempest-RoutersAdminNegativeTest-1268399086 tempest-RoutersAdminNegativeTest-1268399086-project-admin] 10.222.0.18 "DELETE /v2.0/ports/5c6f3172-64b3-437c-a967-d8eaa6fffb5a HTTP/1.1" status: 204 len: 168 time: 1.1806536 Dec 21 04:00:04.802122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Network efd58aa7-1c72-4652-9ba8-beaf117a1e6b is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:04.802677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.803569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:04.876769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, efd58aa7-1c72-4652-9ba8-beaf117a1e6b) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:04.881063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:04.882175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:04.992698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2bd564e7-da4d-4cda-a61c-8a7a15e916ee admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.1863160 Dec 21 04:00:05.058247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7ef63f5e-ff78-41e5-aca9-9dbc5044f5de'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:05.060382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['2efceb72-a55b-415d-8362-853328770af0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:05.062225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31f675b0-d601-4686-bb16-2bf1069e937a None None] Network efd58aa7-1c72-4652-9ba8-beaf117a1e6b requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:05.069170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d817f625-9ed3-48ad-bce2-e997d275f853,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:05.214964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:05.249314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:05.266336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:05.270502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:05.442842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5de3b566-766f-4ecf-a0c4-790925b0ca0e req-93b14642-50fb-4e19-a800-f55234c04442 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:05.447835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38456) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:05.458098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5de3b566-766f-4ecf-a0c4-790925b0ca0e req-93b14642-50fb-4e19-a800-f55234c04442 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 944 time: 0.1368096 Dec 21 04:00:05.542451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-663247d4-299a-4180-b5fd-fd8c75603af2 None None] Network efd58aa7-1c72-4652-9ba8-beaf117a1e6b requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:05.552336 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:05.563959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5de3b566-766f-4ecf-a0c4-790925b0ca0e req-09a46517-7f2c-4d8b-b0d9-efab40353c4a tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989497 Dec 21 04:00:05.660961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:05.743395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:05.794984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:05.927970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:05.934867 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:05.941092 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:05.962309 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:05.964114 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:05.967156 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:05.989991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-8556d3e8-9773-4d63-b4ba-ead24e9b490e tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:05.992384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-8556d3e8-9773-4d63-b4ba-ead24e9b490e tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/networks?id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b HTTP/1.1" status: 200 len: 814 time: 0.2159131 Dec 21 04:00:06.012371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-37666205-fa01-41cb-9037-c9950ae37f68 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/quotas/c82f9e49f19f46738135f46f20ba1250 HTTP/1.1" status: 200 len: 375 time: 0.0139961 Dec 21 04:00:06.035372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cad7088c-2bf7-4654-b7f8-df90e643442f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.051415 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:06.071101 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:06.072137 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:06.113087 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aff955e6-5cfe-4924-9ef7-6179f6fc41f0 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/floatingips/89564193-617f-4224-8814-db6bff15a47f HTTP/1.1" status: 200 len: 979 time: 1.9154086 Dec 21 04:00:06.122666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:06.123244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38474) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:06.126681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-27ffd65f-b065-4292-a5be-fbf6c63bdf8a tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c82f9e49f19f46738135f46f20ba1250&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1062150 Dec 21 04:00:06.151039 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:06.153895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b01342b-590e-42b5-9984-61720b29cbf3 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:06.208058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:06.225648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['643a3827-c0d5-4377-893a-3bf71f16b0e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:06.323448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf57cc37-ec65-43b2-bb05-89d8c8c24821 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.356773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-57248aed-3f68-4cce-9dc4-fb29d047c4f8 service neutron] 10.222.0.18 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1981587 Dec 21 04:00:06.435021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d817f625-9ed3-48ad-bce2-e997d275f853'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:06.441389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cad7088c-2bf7-4654-b7f8-df90e643442f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.451312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 39c9c67c-00c8-4801-851b-256517e54a72 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:06.451799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.497542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-832c2e67-0993-4b65-a27d-9f72fc28bd14 service neutron] 10.222.0.18 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1314406 Dec 21 04:00:06.537098 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf57cc37-ec65-43b2-bb05-89d8c8c24821 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.537452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cad7088c-2bf7-4654-b7f8-df90e643442f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.607089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.607429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.613222 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cad7088c-2bf7-4654-b7f8-df90e643442f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=967635d03d324577aec5b2a4b864e325&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1611390 Dec 21 04:00:06.616046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf57cc37-ec65-43b2-bb05-89d8c8c24821 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.619374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:06.621640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad7088c-2bf7-4654-b7f8-df90e643442f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e650f0b-d276-46e2-ba87-6d181d8edb2b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:06.661197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 39c9c67c-00c8-4801-851b-256517e54a72 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:06.667826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf57cc37-ec65-43b2-bb05-89d8c8c24821 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d898c989-8c57-4e93-b071-a71b6eb10f43,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:06.677494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cf57cc37-ec65-43b2-bb05-89d8c8c24821 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7fa68721d41f4986a345df5cfe865eb4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5481956 Dec 21 04:00:06.678249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:06.768987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86666c13-d891-47f2-8d21-a6f3df02b463 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.781649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16b4d2b-c758-410c-853a-ee5ad528bf09 req-6c8b36d1-ec0a-4f7d-aa13-0e0951ba8ed3 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:06.789169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e16b4d2b-c758-410c-853a-ee5ad528bf09 req-6c8b36d1-ec0a-4f7d-aa13-0e0951ba8ed3 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 944 time: 0.0861573 Dec 21 04:00:06.820210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3787c5d-7997-4135-b94d-6f6fe4ca1a55 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.833178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86666c13-d891-47f2-8d21-a6f3df02b463 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.858453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3787c5d-7997-4135-b94d-6f6fe4ca1a55 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:06.882046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e16b4d2b-c758-410c-853a-ee5ad528bf09 req-50471fbb-004f-4465-9f70-376f84b1d64d tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786483 Dec 21 04:00:07.036345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3787c5d-7997-4135-b94d-6f6fe4ca1a55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.039212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3787c5d-7997-4135-b94d-6f6fe4ca1a55 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.041307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d3787c5d-7997-4135-b94d-6f6fe4ca1a55 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5e650f0b-d276-46e2-ba87-6d181d8edb2b HTTP/1.1" status: 204 len: 168 time: 0.4199216 Dec 21 04:00:07.049395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3787c5d-7997-4135-b94d-6f6fe4ca1a55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e650f0b-d276-46e2-ba87-6d181d8edb2b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:07.084876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5155a7fc-6d25-4fbc-83d5-98ed13b08abb req-9fc3f144-740d-4a23-9633-866aa0685f9d tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 210 time: 0.0882611 Dec 21 04:00:07.087189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86666c13-d891-47f2-8d21-a6f3df02b463 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.089851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86666c13-d891-47f2-8d21-a6f3df02b463 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.093690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.119545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-86666c13-d891-47f2-8d21-a6f3df02b463 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d898c989-8c57-4e93-b071-a71b6eb10f43 HTTP/1.1" status: 204 len: 168 time: 0.4400208 Dec 21 04:00:07.144215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86666c13-d891-47f2-8d21-a6f3df02b463 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d898c989-8c57-4e93-b071-a71b6eb10f43,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:07.146357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=39c9c67c-00c8-4801-851b-256517e54a72,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:07.257917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.259171 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 89564193-617f-4224-8814-db6bff15a47f disassociated (deleted). External IP: 172.25.5.129, port: 020644e3-5cd1-44b5-b800-3d0c1c6c2b4e. Dec 21 04:00:07.484310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2efceb72-a55b-415d-8362-853328770af0 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:07.548867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:07.725707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:07.736459 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.742113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:07.757064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:07.758375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:07.796783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38510) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:07.797286 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d56f8b67-bdb5-4c86-889c-9f6f592b1c22 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/floatingips/89564193-617f-4224-8814-db6bff15a47f HTTP/1.1" status: 204 len: 168 time: 1.6725454 Dec 21 04:00:07.806394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:07.818657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:07.819472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:07.871127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:07.871805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5914c66b-c1e1-41c2-8502-bdc18ee20948 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:07.874766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 2efceb72-a55b-415d-8362-853328770af0 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:00:07.880801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 2efceb72-a55b-415d-8362-853328770af0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:07.881190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.949739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 020644e3-5cd1-44b5-b800-3d0c1c6c2b4e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:07.950570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:07.976638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.007122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236ee84c-147e-46f1-82ef-6527b966171d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2efceb72-a55b-415d-8362-853328770af0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:08.009679 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f58e8ce5-3b94-486d-b6d0-40cfd9ed4a34" -d '{"events": [{"server_uuid": "236ee84c-147e-46f1-82ef-6527b966171d", "name": "network-vif-plugged", "status": "completed", "tag": "2efceb72-a55b-415d-8362-853328770af0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:08.061568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2efceb72-a55b-415d-8362-853328770af0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2efceb72-a55b-415d-8362-853328770af0,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:08.113285 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc902e30-1c73-41aa-b079-39fbd8af9cdd x-openstack-request-id: req-fc902e30-1c73-41aa-b079-39fbd8af9cdd {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:08.113285 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236ee84c-147e-46f1-82ef-6527b966171d", "name": "network-vif-plugged", "status": "completed", "tag": "2efceb72-a55b-415d-8362-853328770af0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:08.113285 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fc902e30-1c73-41aa-b079-39fbd8af9cdd {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:08.113285 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236ee84c-147e-46f1-82ef-6527b966171d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2efceb72-a55b-415d-8362-853328770af0', 'code': 200} Dec 21 04:00:08.129389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d04cc82-1e8e-4ce6-bfe7-5bc1982f44d9 req-48ba016d-7bd6-441c-89d1-279e0d5d9c06 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:08.131438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d04cc82-1e8e-4ce6-bfe7-5bc1982f44d9 req-48ba016d-7bd6-441c-89d1-279e0d5d9c06 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 944 time: 0.1853895 Dec 21 04:00:08.180916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d817f625-9ed3-48ad-bce2-e997d275f853 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:08.231407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a014baaf-5202-4583-aa03-75896e519071 req-3a973b6c-23b9-484b-89f3-ce78302fc32f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:08.233096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a014baaf-5202-4583-aa03-75896e519071 req-3a973b6c-23b9-484b-89f3-ce78302fc32f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 1096 time: 0.0619802 Dec 21 04:00:08.249956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f913cd8-351b-4618-aa2b-bb7af5d4746a req-db24f8b6-0106-4b95-a0b3-04fdd65fb0e9 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 210 time: 0.0688748 Dec 21 04:00:08.283594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.291697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.292510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:08.336404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38520) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:08.339144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a014baaf-5202-4583-aa03-75896e519071 req-639d1736-7806-4dd7-952a-34bbdf16d43d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982444 Dec 21 04:00:08.350337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38524) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:08.365770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d04cc82-1e8e-4ce6-bfe7-5bc1982f44d9 req-469dc2c1-eee7-44f5-acad-d4eadebd77cb tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2233520 Dec 21 04:00:08.366836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 020644e3-5cd1-44b5-b800-3d0c1c6c2b4e owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:08.427401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d18f404-16fd-4aa5-b22f-a2a6937919cb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.471482 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6a1917a2-1dce-46ec-98be-fe23cc7be50c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8a9a0decf8c04abbb44a5429ac89c005&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1312289 Dec 21 04:00:08.476219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38526) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:08.511005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2efceb72-a55b-415d-8362-853328770af0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:08.568309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d18f404-16fd-4aa5-b22f-a2a6937919cb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.574079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf882bf4-9402-4e95-b223-78c697ee6f53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.613606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port d817f625-9ed3-48ad-bce2-e997d275f853 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:00:08.620763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port d817f625-9ed3-48ad-bce2-e997d275f853 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:08.621154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.626456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:00:08.630039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf882bf4-9402-4e95-b223-78c697ee6f53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.659211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:08.659615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.693716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d18f404-16fd-4aa5-b22f-a2a6937919cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.776885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d18f404-16fd-4aa5-b22f-a2a6937919cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc1efa1e-8cdb-4472-b2f5-fc7fc2f04b7f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:08.795520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.797412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.810465 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d18f404-16fd-4aa5-b22f-a2a6937919cb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d0a588f7f5d94768b95a3f4ee658063c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4590592 Dec 21 04:00:08.813015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:08.824863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf882bf4-9402-4e95-b223-78c697ee6f53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.827576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf882bf4-9402-4e95-b223-78c697ee6f53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.829941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bf882bf4-9402-4e95-b223-78c697ee6f53 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a2ff3f17-8caf-44c5-945c-67996dd6ca4d HTTP/1.1" status: 204 len: 168 time: 0.3419921 Dec 21 04:00:08.851661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf882bf4-9402-4e95-b223-78c697ee6f53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2ff3f17-8caf-44c5-945c-67996dd6ca4d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:08.857054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.893094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baa14503-d5d6-41d7-afe6-4711e302d5fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.951376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baa14503-d5d6-41d7-afe6-4711e302d5fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:08.955759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=020644e3-5cd1-44b5-b800-3d0c1c6c2b4e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:09.075511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:09.123527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d817f625-9ed3-48ad-bce2-e997d275f853, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d817f625-9ed3-48ad-bce2-e997d275f853,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:09.148302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.156540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-73cf9cac-c4a0-4376-b6c2-49258cbbdee2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/ports/020644e3-5cd1-44b5-b800-3d0c1c6c2b4e HTTP/1.1" status: 204 len: 168 time: 1.3583004 Dec 21 04:00:09.157232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38536) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:09.162874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:09.196531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.200982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.201812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:09.276401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.399871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:09.498507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 643a3827-c0d5-4377-893a-3bf71f16b0e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:09.499055 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.532326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd0258b7-00fa-458c-adfd-e2e45d3bc680 req-53432a62-be9a-4ec1-ac4b-bab6927f5799 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 210 time: 0.0657184 Dec 21 04:00:09.628300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeeb8f0d-b513-4b23-b440-908315ff306f req-67c7f432-001c-4f90-ac8f-ca6f8a31e7e5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:09.630140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aeeb8f0d-b513-4b23-b440-908315ff306f req-67c7f432-001c-4f90-ac8f-ca6f8a31e7e5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 945 time: 0.0966473 Dec 21 04:00:09.648032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baa14503-d5d6-41d7-afe6-4711e302d5fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.651461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-baa14503-d5d6-41d7-afe6-4711e302d5fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.653343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-baa14503-d5d6-41d7-afe6-4711e302d5fb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fc1efa1e-8cdb-4472-b2f5-fc7fc2f04b7f HTTP/1.1" status: 204 len: 168 time: 0.8384945 Dec 21 04:00:09.660248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.679530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baa14503-d5d6-41d7-afe6-4711e302d5fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc1efa1e-8cdb-4472-b2f5-fc7fc2f04b7f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:09.745775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:09.814896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.122 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/cf905d52-1ddb-4fec-81d4-40e7b5546226) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:09.871830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d817f625-9ed3-48ad-bce2-e997d275f853,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:09.880102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:09.985563 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:10.060502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:10.098576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c270495-f454-48a9-b572-af531f212cec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de'}, {'server_uuid': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd817f625-9ed3-48ad-bce2-e997d275f853'}, {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:10.101917 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fbb8eb6-7074-400b-a2f5-7bbec07464fa" -d '{"events": [{"server_uuid": "0c270495-f454-48a9-b572-af531f212cec", "name": "network-vif-plugged", "status": "completed", "tag": "7ef63f5e-ff78-41e5-aca9-9dbc5044f5de"}, {"server_uuid": "2256f673-4608-4b6a-8dce-c9d48bd4bb4f", "name": "network-vif-plugged", "status": "completed", "tag": "d817f625-9ed3-48ad-bce2-e997d275f853"}, {"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:10.214464 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad59eaf8-23c6-499a-abe9-8e2dd27cfca5 x-openstack-request-id: req-ad59eaf8-23c6-499a-abe9-8e2dd27cfca5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:10.214464 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c270495-f454-48a9-b572-af531f212cec", "name": "network-vif-plugged", "status": "completed", "tag": "7ef63f5e-ff78-41e5-aca9-9dbc5044f5de", "code": 200}, {"server_uuid": "2256f673-4608-4b6a-8dce-c9d48bd4bb4f", "name": "network-vif-plugged", "status": "completed", "tag": "d817f625-9ed3-48ad-bce2-e997d275f853", "code": 200}, {"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:10.214464 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ad59eaf8-23c6-499a-abe9-8e2dd27cfca5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:10.214464 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c270495-f454-48a9-b572-af531f212cec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de', 'code': 200} Dec 21 04:00:10.214464 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd817f625-9ed3-48ad-bce2-e997d275f853', 'code': 200} Dec 21 04:00:10.214464 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 04:00:10.444483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a075ecdd-873c-4401-ba76-9e35dc550602 req-a2ad7c81-7954-447e-ab82-3dfd6ae8f78d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:10.446310 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a075ecdd-873c-4401-ba76-9e35dc550602 req-a2ad7c81-7954-447e-ab82-3dfd6ae8f78d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 1097 time: 0.0825901 Dec 21 04:00:10.496766 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a075ecdd-873c-4401-ba76-9e35dc550602 req-3c6231af-84fd-4037-9ad5-97320c029255 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434728 Dec 21 04:00:10.498743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aeeb8f0d-b513-4b23-b440-908315ff306f req-e45d6b18-9f37-495c-94b7-7220566672e9 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8540771 Dec 21 04:00:10.578399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50daf7b-2fc7-4013-b9f4-8a881b205184 req-a11bbf9a-e4b8-446a-a009-8d6d72ce2166 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:10.580526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b50daf7b-2fc7-4013-b9f4-8a881b205184 req-a11bbf9a-e4b8-446a-a009-8d6d72ce2166 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 1097 time: 0.1479340 Dec 21 04:00:10.604660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:10.623096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-faccbf9f-7f92-457f-8273-afae354ca061 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:10.624745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-faccbf9f-7f92-457f-8273-afae354ca061 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.31 "GET /v2.0/networks?id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b HTTP/1.1" status: 200 len: 814 time: 0.2152748 Dec 21 04:00:10.673006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Request body: {'port': {'device_id': '62b630eb-0376-4860-a576-579116ccf3ea', 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b', 'admin_state_up': True, 'tenant_id': 'c82f9e49f19f46738135f46f20ba1250'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:10.683642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37450c7b-02ac-4eb3-8ceb-61c3b21a5424 req-7bf5d728-944b-478c-acdc-5455adce0445 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 210 time: 0.0522168 Dec 21 04:00:10.731230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b50daf7b-2fc7-4013-b9f4-8a881b205184 req-8814e792-ac99-417b-803d-ecbd883c0aba service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1366873 Dec 21 04:00:10.846851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:10.918251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=cf905d52-1ddb-4fec-81d4-40e7b5546226,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:10.926082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:10.944213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:10.946007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:10.954098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:11.023390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Made reservation on behalf of c82f9e49f19f46738135f46f20ba1250 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:11.026303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.089881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-604970846'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:11.158388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.234295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Allocated IP 172.20.0.11 (efd58aa7-1c72-4652-9ba8-beaf117a1e6b/749eed8f-1884-4400-ae3c-14e64dd7b748/36957a73-39a0-4a98-9c0c-a9907cb8da0c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:11.264771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Made reservation on behalf of f33eacd81ada4e12bc1ed3adb3dc1f67 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:11.268739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.283198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.396580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.437240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.482989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.517240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.561689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:11.564219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1e27a646-5f92-4ddf-9910-f5e7c0bd7184,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:11.595795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.599095 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Added segment bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9 of type vlan for network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf Dec 21 04:00:11.677613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.768141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863c88c2-15ab-46c1-a737-22960ce7c5c7 req-d9753f36-c095-42d0-a402-82380072ed99 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:11.768141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863c88c2-15ab-46c1-a737-22960ce7c5c7 req-d9753f36-c095-42d0-a402-82380072ed99 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 945 time: 0.1046698 Dec 21 04:00:11.768141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.832436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.840400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863c88c2-15ab-46c1-a737-22960ce7c5c7 req-b5f25579-233a-4fdb-b45a-104b25a3660d tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767689 Dec 21 04:00:11.849051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.861797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:11.861797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:11.935621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Network efd58aa7-1c72-4652-9ba8-beaf117a1e6b is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:11.951425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:11.975303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:12.003021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Pushing event updated for resources: {'Port': ['ID=36957a73-39a0-4a98-9c0c-a9907cb8da0c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:12.005443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.012354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event updated for resources: {'Network': ['ID=5a4166bb-360a-4e8a-aa01-bf8d96eaacaf,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:12.025086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:12.087141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d769fb-f804-4851-901e-dbf20573c8ef req-1a35c42e-dfb0-4109-9b8b-2f0bc965453f tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:12.096635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3d769fb-f804-4851-901e-dbf20573c8ef req-1a35c42e-dfb0-4109-9b8b-2f0bc965453f tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 932 time: 0.2659411 Dec 21 04:00:12.142032 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1bd17b7-e561-44aa-8b85-c3317903489e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.2093184 Dec 21 04:00:12.142910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38624) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:12.166040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Request body: {'subnet': {'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:12.182586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:12.183325 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.196696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=cf905d52-1ddb-4fec-81d4-40e7b5546226,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:12.268820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.281457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35534b8d-000e-45e0-8da7-836753f1ce22 req-a8b0a2e7-0f43-4c07-af30-833450103d7e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:12.287402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35534b8d-000e-45e0-8da7-836753f1ce22 req-a8b0a2e7-0f43-4c07-af30-833450103d7e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 945 time: 0.3098264 Dec 21 04:00:12.307662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3d769fb-f804-4851-901e-dbf20573c8ef req-98e7e455-9876-4750-83cd-dd2fa9d862cc tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2099345 Dec 21 04:00:12.338388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-360a6db6-fe37-4d13-b3ab-efb627c9a884 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6887300 Dec 21 04:00:12.364066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Request body: {'port': {'device_id': '62b630eb-0376-4860-a576-579116ccf3ea', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:12.422064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35534b8d-000e-45e0-8da7-836753f1ce22 req-c7127dc3-4b5b-403e-a0c9-600dd9939bbb tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1078186 Dec 21 04:00:12.427021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.428307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0dd16e15-4617-44df-bc2c-a72e0177cc07 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.2697575 Dec 21 04:00:12.434609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38628) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:12.448332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'port': {'network_id': 'b672c264-59db-4f56-873d-1e399cb0cd1a', 'name': 'tempest-FloatingIPTestJSON-1407070227'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:12.470587 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.613917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Made reservation on behalf of f33eacd81ada4e12bc1ed3adb3dc1f67 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:12.618414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.845416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:12.849761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.854434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 36957a73-39a0-4a98-9c0c-a9907cb8da0c {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:12.865316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:12.880010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Transition to ACTIVE for port object 36957a73-39a0-4a98-9c0c-a9907cb8da0c will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:00:12.910230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] device_id is not set on port e9e00f3d-162c-447c-b888-13440d71e9a6 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:00:12.996208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.037285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.083827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Pushing event updated for resources: {'Port': ['ID=36957a73-39a0-4a98-9c0c-a9907cb8da0c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:13.124702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.4 (b672c264-59db-4f56-873d-1e399cb0cd1a/76bec629-6735-4479-9cb2-edaf6be1f8e5/e9e00f3d-162c-447c-b888-13440d71e9a6) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:13.179945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event updated for resources: {'Subnet': ['ID=1de8e16b-5c01-4ca8-9cb3-d39db876710d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:13.187202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Attempting to bind port 36957a73-39a0-4a98-9c0c-a9907cb8da0c on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:00:13.187642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Attempting to bind port 36957a73-39a0-4a98-9c0c-a9907cb8da0c by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'b673eb42-6d7a-401b-8a71-e499dbff8232', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:00:13.188086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Attempting to bind port 36957a73-39a0-4a98-9c0c-a9907cb8da0c on network efd58aa7-1c72-4652-9ba8-beaf117a1e6b {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:13.193321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Port 36957a73-39a0-4a98-9c0c-a9907cb8da0c on network efd58aa7-1c72-4652-9ba8-beaf117a1e6b not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:00:13.197621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Attempting to bind port 36957a73-39a0-4a98-9c0c-a9907cb8da0c on network efd58aa7-1c72-4652-9ba8-beaf117a1e6b {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:13.200895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 59, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:00:13.201424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Checking segment: {'id': 'b673eb42-6d7a-401b-8a71-e499dbff8232', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:13.201918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Bound using segment: {'id': 'b673eb42-6d7a-401b-8a71-e499dbff8232', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:00:13.202463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Bound port: 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b673eb42-6d7a-401b-8a71-e499dbff8232', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:00:13.202944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.222359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Checking segment: {'id': 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:13.223068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Network hostable DHCP agents. Network: 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:13.304053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] For port 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:00:13.307584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] For port 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c,segment=NetworkSegment(b673eb42-6d7a-401b-8a71-e499dbff8232),segment_id=b673eb42-6d7a-401b-8a71-e499dbff8232)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:00:13.371565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:13.433108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.443222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.472625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:13.477284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:13.478754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.480540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f1cebf0-7c11-404c-9a25-d63fca5bb795 None None] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:13.529084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:13.529980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.531701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] 10.222.0.31 "PUT /v2.0/ports/36957a73-39a0-4a98-9c0c-a9907cb8da0c HTTP/1.1" status: 200 len: 1093 time: 1.1738505 Dec 21 04:00:13.539608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62b630eb-0376-4860-a576-579116ccf3ea', 'tag': '36957a73-39a0-4a98-9c0c-a9907cb8da0c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:13.543035 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b" -d '{"events": [{"name": "network-changed", "server_uuid": "62b630eb-0376-4860-a576-579116ccf3ea", "tag": "36957a73-39a0-4a98-9c0c-a9907cb8da0c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:13.578579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55e05a-6d27-4582-b944-8a3821af2feb req-27ffe18e-aae6-4e57-ad32-df34b707ddf9 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:13.586668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac55e05a-6d27-4582-b944-8a3821af2feb req-27ffe18e-aae6-4e57-ad32-df34b707ddf9 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 944 time: 0.2033520 Dec 21 04:00:13.621103 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74fb86f3-01df-4b31-b356-d1f6a9a3d977 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4760423 Dec 21 04:00:13.623860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38650) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:13.629260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00e3c25-4485-47ee-966a-c57a2937e52a service neutron] Pushing event updated for resources: {'Port': ['ID=36957a73-39a0-4a98-9c0c-a9907cb8da0c,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:13.644752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Request body: {'port': {'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1239655568'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:13.692175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac55e05a-6d27-4582-b944-8a3821af2feb req-5384d8fd-3734-4d6f-8e0f-ac8e6b1304b4 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042049 Dec 21 04:00:13.807856 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9a0fe60-414c-4b98-96ce-b12456c2ceda x-openstack-request-id: req-f9a0fe60-414c-4b98-96ce-b12456c2ceda {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:13.810822 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "62b630eb-0376-4860-a576-579116ccf3ea", "tag": "36957a73-39a0-4a98-9c0c-a9907cb8da0c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:13.810822 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f9a0fe60-414c-4b98-96ce-b12456c2ceda {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:13.810822 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '62b630eb-0376-4860-a576-579116ccf3ea', 'tag': '36957a73-39a0-4a98-9c0c-a9907cb8da0c', 'status': 'completed', 'code': 200} Dec 21 04:00:13.815574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5a4166bb-360a-4e8a-aa01-bf8d96eaacaf', 'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf', 'project_id': 'f33eacd81ada4e12bc1ed3adb3dc1f67', 'fixed_ips': [{'subnet_id': '1de8e16b-5c01-4ca8-9cb3-d39db876710d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:00:13.818570 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.851055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:13.876905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-eda946a9-43fa-40a8-9e70-8b92d144c98e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:13.888632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-eda946a9-43fa-40a8-9e70-8b92d144c98e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c82f9e49f19f46738135f46f20ba1250&device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 1096 time: 0.1869035 Dec 21 04:00:13.923780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=e9e00f3d-162c-447c-b888-13440d71e9a6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:13.945268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network b672c264-59db-4f56-873d-1e399cb0cd1a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:13.948666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-52a81d15-8419-4639-abbb-e0fd2d163090 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c HTTP/1.1" status: 200 len: 217 time: 0.0437534 Dec 21 04:00:13.950284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:13.957342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556bb899-7791-4492-aeab-bf82dc348227 req-69191dfc-ccb0-4b16-b277-b1f91890db76 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:13.957730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:13.958883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-556bb899-7791-4492-aeab-bf82dc348227 req-69191dfc-ccb0-4b16-b277-b1f91890db76 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 945 time: 0.1656818 Dec 21 04:00:14.036884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:14.036884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.037107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-22482bec-d9cc-4840-aa4e-a48d35b1aa59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:14.037704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-22482bec-d9cc-4840-aa4e-a48d35b1aa59 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=749eed8f-1884-4400-ae3c-14e64dd7b748 HTTP/1.1" status: 200 len: 854 time: 0.0778818 Dec 21 04:00:14.065363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Allocated IP 2001:db8::2 (5a4166bb-360a-4e8a-aa01-bf8d96eaacaf/1de8e16b-5c01-4ca8-9cb3-d39db876710d/89311ed4-7144-4758-b563-07ddc3d5e8bf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:14.076109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-556bb899-7791-4492-aeab-bf82dc348227 req-b33619f1-ac90-41c8-b7bc-bbe276d80705 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076245 Dec 21 04:00:14.094348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-d610ffb7-078e-48bf-a4f8-048b80071c37 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0472183 Dec 21 04:00:14.127888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Made reservation on behalf of f33eacd81ada4e12bc1ed3adb3dc1f67 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:14.132340 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.164532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ae6aafe-dd75-48a8-94bf-12f22bcbe5bb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.7121832 Dec 21 04:00:14.171986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:14.182791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'port_id': 'e9e00f3d-162c-447c-b888-13440d71e9a6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:14.208834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] device_id is not set on port dfb066de-109a-4284-b18c-439666b645d1 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:00:14.298664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-6d4918b6-31c9-442e-9287-a137f94e8143 service neutron] 10.222.0.31 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1965475 Dec 21 04:00:14.310350 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.312283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd357e0-02a7-4bb0-a33c-7ddcf4dcfcf6 req-0ade27e0-fb9e-41ae-9814-fadd87ee6d37 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:14.314294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbd357e0-02a7-4bb0-a33c-7ddcf4dcfcf6 req-0ade27e0-fb9e-41ae-9814-fadd87ee6d37 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 945 time: 0.1312060 Dec 21 04:00:14.388944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.419870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.432569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbd357e0-02a7-4bb0-a33c-7ddcf4dcfcf6 req-fc9aa85c-13cd-4ff5-b45a-bf28a50162e5 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936191 Dec 21 04:00:14.502349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7434fc17-7b99-4daf-a476-68b1e8c5f575 req-cfa60d9c-1cf1-4c48-ba12-79c5ef28deb3 service neutron] 10.222.0.31 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1867080 Dec 21 04:00:14.513517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:14.520122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:14.523920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:14.540807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Pushing event updated for resources: {'Port': ['ID=89311ed4-7144-4758-b563-07ddc3d5e8bf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:14.618150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Attempting to bind port 89311ed4-7144-4758-b563-07ddc3d5e8bf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:00:14.618537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Attempting to bind port 89311ed4-7144-4758-b563-07ddc3d5e8bf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:00:14.619091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Attempting to bind port 89311ed4-7144-4758-b563-07ddc3d5e8bf on network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:14.624730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 3, 59, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:00:14.625116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Checking segment: {'id': 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:14.626653 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.627104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Bound using segment: {'id': 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:00:14.627796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Bound port: 89311ed4-7144-4758-b563-07ddc3d5e8bf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:00:14.628422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:14.773901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] For port 89311ed4-7144-4758-b563-07ddc3d5e8bf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:00:14.786230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] For port 89311ed4-7144-4758-b563-07ddc3d5e8bf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89311ed4-7144-4758-b563-07ddc3d5e8bf,segment=NetworkSegment(bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9),segment_id=bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:00:14.816551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-ea4a4165-8fb1-472c-b77d-65d8da777649 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:14.821915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-ea4a4165-8fb1-472c-b77d-65d8da777649 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c82f9e49f19f46738135f46f20ba1250&device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 1096 time: 0.1208735 Dec 21 04:00:14.933371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Allocated IP 2001:db8::fc (5a4166bb-360a-4e8a-aa01-bf8d96eaacaf/1de8e16b-5c01-4ca8-9cb3-d39db876710d/dfb066de-109a-4284-b18c-439666b645d1) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:14.952452 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:15.008644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-5fa07a79-f4fb-4a9a-a530-22c6b2f65490 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:15.010802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-5fa07a79-f4fb-4a9a-a530-22c6b2f65490 service neutron] 10.222.0.31 "GET /v2.0/networks?id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b HTTP/1.1" status: 200 len: 915 time: 0.1723425 Dec 21 04:00:15.104003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18516202-0fcb-4f1e-a953-bbddddb87ceb None None] Pushing event updated for resources: {'Port': ['ID=89311ed4-7144-4758-b563-07ddc3d5e8bf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:15.111361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-fd46417e-1170-406b-9364-dd7496b4f012 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c HTTP/1.1" status: 200 len: 217 time: 0.0922246 Dec 21 04:00:15.137497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3f1026-3104-41c7-90a7-5505d3b29316 req-b683da59-a34a-4471-ba3a-ce07a4245b37 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:15.145122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e3f1026-3104-41c7-90a7-5505d3b29316 req-b683da59-a34a-4471-ba3a-ce07a4245b37 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 944 time: 0.3221545 Dec 21 04:00:15.295337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e3f1026-3104-41c7-90a7-5505d3b29316 req-f9e2ac99-7816-48b1-a5b4-68937577c8a8 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444738 Dec 21 04:00:15.302821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-886ce6e7-7f9a-48e6-a145-1c8be80e7e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:15.304374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-886ce6e7-7f9a-48e6-a145-1c8be80e7e1a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=749eed8f-1884-4400-ae3c-14e64dd7b748 HTTP/1.1" status: 200 len: 854 time: 0.1845901 Dec 21 04:00:15.375025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-fc2e2029-6744-4fd6-9e37-a54604e1a80e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0593922 Dec 21 04:00:15.387815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242cc718-81bc-44d3-bb0e-5bb7be07c6b6 req-a1f924ff-de34-44c2-8c00-a36f5385417b tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:15.389593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-242cc718-81bc-44d3-bb0e-5bb7be07c6b6 req-a1f924ff-de34-44c2-8c00-a36f5385417b tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 945 time: 0.1665339 Dec 21 04:00:15.426484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:15.490029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.resource_extend [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 04:00:15.571399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-242cc718-81bc-44d3-bb0e-5bb7be07c6b6 req-208a6fcb-6e2e-456e-8b7a-8f9a9541bb79 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732687 Dec 21 04:00:15.587407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:15.605353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-ba03e2cb-cc35-4ae6-b677-cae9d95b06a6 service neutron] 10.222.0.31 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2120652 Dec 21 04:00:15.664681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:15.757735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-551ab1c9-e287-44df-af7b-f8ea9a4a7e6b req-747c2120-a977-42d6-a402-c8195299bf69 service neutron] 10.222.0.31 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1445000 Dec 21 04:00:15.761131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:15.858183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:15.868375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:15.871194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:15.877989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:15.878725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:15.903969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event updated for resources: {'Port': ['ID=dfb066de-109a-4284-b18c-439666b645d1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:15.915171 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP be762563-bcdf-44c4-862d-11b200de8eda associated. External IP: 172.25.5.122, port: e9e00f3d-162c-447c-b888-13440d71e9a6. Dec 21 04:00:16.025635 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-16c44f5f-d40a-4de9-a3fd-dafe13617e52 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 941 time: 2.4004586 Dec 21 04:00:16.030035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38690) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:16.038867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Request body: {'port': {'network_id': '5a4166bb-360a-4e8a-aa01-bf8d96eaacaf', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-212229216', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:16.039504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] bootfile-name is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 04:00:16.039879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] tftp-server is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 04:00:16.228007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] server-ip-address is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 04:00:16.228114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:16.287028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:16.291551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.304118 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:16.328475 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81ab3f30-406f-414f-ad46-5cc8bb0eb031 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/floatingips/be762563-bcdf-44c4-862d-11b200de8eda HTTP/1.1" status: 200 len: 978 time: 2.1548786 Dec 21 04:00:16.330887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38694) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:16.336669 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:16.351467 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:16.424875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Made reservation on behalf of f33eacd81ada4e12bc1ed3adb3dc1f67 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:16.431321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.433607 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:16.444888 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:16.445754 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:16.454151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 89311ed4-7144-4758-b563-07ddc3d5e8bf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:16.486265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port e9e00f3d-162c-447c-b888-13440d71e9a6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:16.486265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.487023 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:16.487543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33383837-a9ee-4898-ac2d-11a4d5d8c2d3 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:16.514360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] device_id is not set on port a76191d6-74bf-42b9-9ac3-b6ce03b4eecd yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:00:16.549787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 89311ed4-7144-4758-b563-07ddc3d5e8bf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:16.550214 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.662024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7782f5bc-6f50-41ec-b40d-0d839a8bd659 req-5267e706-10fa-4d17-9b87-abc87d322e24 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:16.666681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7782f5bc-6f50-41ec-b40d-0d839a8bd659 req-5267e706-10fa-4d17-9b87-abc87d322e24 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 944 time: 0.1899300 Dec 21 04:00:16.723302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.753632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df125cd1-e9e8-4033-82ec-f9f3714e6c1e None None] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:16.786663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.821536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-8631901b-bef4-4b7c-a00a-b008661142b7 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:16.823220 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-8631901b-bef4-4b7c-a00a-b008661142b7 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "GET /v2.0/ports?device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 945 time: 0.2067931 Dec 21 04:00:16.854583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Allocated IP 2001:db8::2fc (5a4166bb-360a-4e8a-aa01-bf8d96eaacaf/1de8e16b-5c01-4ca8-9cb3-d39db876710d/a76191d6-74bf-42b9-9ac3-b6ce03b4eecd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:16.867182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0c8da5c4-554c-4bae-90b0-7be9f95c30b7 None None] Provisioning complete for port 89311ed4-7144-4758-b563-07ddc3d5e8bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:16.867789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c8da5c4-554c-4bae-90b0-7be9f95c30b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:16.910413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 89311ed4-7144-4758-b563-07ddc3d5e8bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89311ed4-7144-4758-b563-07ddc3d5e8bf,segment=NetworkSegment(bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9),segment_id=bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:17.016802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.073212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.074698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c8da5c4-554c-4bae-90b0-7be9f95c30b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.179736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=89311ed4-7144-4758-b563-07ddc3d5e8bf,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:17.193674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7782f5bc-6f50-41ec-b40d-0d839a8bd659 req-1851d68c-47d3-48d1-bf67-dd6153448e98 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5127943 Dec 21 04:00:17.203080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.254667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-0c8da5c4-554c-4bae-90b0-7be9f95c30b7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:00:17.255040 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-0c8da5c4-554c-4bae-90b0-7be9f95c30b7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:00:17.256374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.256740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.257196 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP be762563-bcdf-44c4-862d-11b200de8eda disassociated. External IP: 172.25.5.122, port: e9e00f3d-162c-447c-b888-13440d71e9a6. Dec 21 04:00:17.257610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for e9e00f3d-162c-447c-b888-13440d71e9a6 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:17.278053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Deleting port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:17.278397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.327852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e7194cc-0bb0-4baa-95f3-5e31e8b5954a req-27f7ddec-8dc2-4d33-91af-05439471333b tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:17.336606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e7194cc-0bb0-4baa-95f3-5e31e8b5954a req-27f7ddec-8dc2-4d33-91af-05439471333b tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 945 time: 0.6087475 Dec 21 04:00:17.393350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:17.405192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:17.410232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event updated for resources: {'Port': ['ID=a76191d6-74bf-42b9-9ac3-b6ce03b4eecd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:17.425319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:17.428421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:17.429283 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.458094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e7194cc-0bb0-4baa-95f3-5e31e8b5954a req-625c52b8-8c56-4d7f-94d8-61a31081261c tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1204054 Dec 21 04:00:17.492158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] For port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:17.501575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.512509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Calling delete_port for 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:17.554858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b93979c6-ae5c-440b-932d-b316f8183791 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1149 time: 1.5224130 Dec 21 04:00:17.557618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38712) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:17.697771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3139b16b-3dcb-4974-be44-bb970650594e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:17.710158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3139b16b-3dcb-4974-be44-bb970650594e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:17.717279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3139b16b-3dcb-4974-be44-bb970650594e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:17.723049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3139b16b-3dcb-4974-be44-bb970650594e tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2622 time: 0.1642659 Dec 21 04:00:17.723987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38714) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:17.917102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.952350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['2efceb72-a55b-415d-8362-853328770af0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:17.957553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d817f625-9ed3-48ad-bce2-e997d275f853'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:17.959574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Deleting port a76191d6-74bf-42b9-9ac3-b6ce03b4eecd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:17.964034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:17.980150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:18.051355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Pushing event deleted for resources: {'Port': ['ID=7ef63f5e-ff78-41e5-aca9-9dbc5044f5de,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:18.098651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] No DVR routers for this DVR port 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:18.101830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=e9e00f3d-162c-447c-b888-13440d71e9a6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:18.104952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:18.109320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-105501b7-6ee3-4633-bae2-24a0704f93e3 req-39f17092-9917-4823-a15f-297415e6875e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "DELETE /v2.0/ports/7ef63f5e-ff78-41e5-aca9-9dbc5044f5de HTTP/1.1" status: 204 len: 173 time: 1.2791586 Dec 21 04:00:18.109533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c270495-f454-48a9-b572-af531f212cec', 'name': 'network-vif-deleted', 'tag': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:18.111892 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f787131d-9c01-41c8-9fba-ec8098d5952a" -d '{"events": [{"server_uuid": "0c270495-f454-48a9-b572-af531f212cec", "name": "network-vif-deleted", "tag": "7ef63f5e-ff78-41e5-aca9-9dbc5044f5de"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:18.205064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 36957a73-39a0-4a98-9c0c-a9907cb8da0c details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:18.246902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:18.305880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Calling delete_port for a76191d6-74bf-42b9-9ac3-b6ce03b4eecd owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:18.395230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:18.416959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bdb6c19-5ecd-4341-84d1-c06c3c215575 req-bcb09281-d4b8-41a6-a503-685f26e2112d tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:18.434480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bdb6c19-5ecd-4341-84d1-c06c3c215575 req-bcb09281-d4b8-41a6-a503-685f26e2112d tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 944 time: 0.1382458 Dec 21 04:00:18.521341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 89311ed4-7144-4758-b563-07ddc3d5e8bf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:18.530980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bdb6c19-5ecd-4341-84d1-c06c3c215575 req-808d98d7-12a7-4ebf-b8b6-22e50cbd7899 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981884 Dec 21 04:00:18.635797 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-febec6f8-b63f-4df8-866a-fa19b74a0ae8 x-openstack-request-id: req-febec6f8-b63f-4df8-866a-fa19b74a0ae8 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:18.636378 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c270495-f454-48a9-b572-af531f212cec", "name": "network-vif-deleted", "tag": "7ef63f5e-ff78-41e5-aca9-9dbc5044f5de", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:18.636378 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-febec6f8-b63f-4df8-866a-fa19b74a0ae8 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:18.637193 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c270495-f454-48a9-b572-af531f212cec', 'name': 'network-vif-deleted', 'tag': '7ef63f5e-ff78-41e5-aca9-9dbc5044f5de', 'status': 'completed', 'code': 200} Dec 21 04:00:18.660749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:18.675059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-decdaa2b-462e-42f5-b2a7-3c02da980460 None None] Provisioning complete for port dfb066de-109a-4284-b18c-439666b645d1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:18.678622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-decdaa2b-462e-42f5-b2a7-3c02da980460 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:18.712756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:18.794636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99616a1d-097d-45d5-aead-9f74c20dd01f req-e943e305-0b25-4260-8cb3-e779ce38e28a tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=0c270495-f454-48a9-b572-af531f212cec HTTP/1.1" status: 200 len: 210 time: 0.0657074 Dec 21 04:00:18.795778 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:18.978688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c,segment=NetworkSegment(b673eb42-6d7a-401b-8a71-e499dbff8232),segment_id=b673eb42-6d7a-401b-8a71-e499dbff8232)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:18.997425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:19.004019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:19.004252 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.011409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "DELETE /v2.0/ports/a76191d6-74bf-42b9-9ac3-b6ce03b4eecd HTTP/1.1" status: 204 len: 168 time: 1.2861741 Dec 21 04:00:19.012720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38734) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:19.021114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Request body: {'port': {'name': 'tempest-new-port-name-676397616', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:19.021773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] bootfile-name is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 04:00:19.022315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] tftp-server is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 04:00:19.024884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.api.validators [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] server-ip-address is not in valid_values {{(pid=110310) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 21 04:00:19.030143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52348bb-ac43-4cfe-820e-54fd150dd224 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event deleted for resources: {'Port': ['ID=a76191d6-74bf-42b9-9ac3-b6ce03b4eecd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:19.128950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-decdaa2b-462e-42f5-b2a7-3c02da980460 None None] Port dfb066de-109a-4284-b18c-439666b645d1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:19.182329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.184253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.193617 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7905977d-1a65-420b-b740-056d53829de2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/ports/e9e00f3d-162c-447c-b888-13440d71e9a6 HTTP/1.1" status: 204 len: 168 time: 2.8595221 Dec 21 04:00:19.195419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38736) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:19.255531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '36957a73-39a0-4a98-9c0c-a9907cb8da0c', 'network_id': 'efd58aa7-1c72-4652-9ba8-beaf117a1e6b', 'port_id': '36957a73-39a0-4a98-9c0c-a9907cb8da0c', 'mac_address': 'fa:16:3e:97:c2:94', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 104, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '749eed8f-1884-4400-ae3c-14e64dd7b748', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:19.291625 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5d5fcab9-7976-47ab-88b8-79aa208f85ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/floatingips/be762563-bcdf-44c4-862d-11b200de8eda HTTP/1.1" status: 200 len: 688 time: 0.0920568 Dec 21 04:00:19.292969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:19.336294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:19.422213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:19.422858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T03:59:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:19.471119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-decdaa2b-462e-42f5-b2a7-3c02da980460 None None] Provisioning complete for port 89311ed4-7144-4758-b563-07ddc3d5e8bf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:19.471880 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-decdaa2b-462e-42f5-b2a7-3c02da980460 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.527341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.530297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:19.530516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79615208-d84d-4c59-bf45-77ce9860188c None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:19.532316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.569232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 89311ed4-7144-4758-b563-07ddc3d5e8bf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:19.570266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.571445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:19.601386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36957a73-39a0-4a98-9c0c-a9907cb8da0c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:19.618538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.622047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c,segment=NetworkSegment(b673eb42-6d7a-401b-8a71-e499dbff8232),segment_id=b673eb42-6d7a-401b-8a71-e499dbff8232)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:19.647734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port cf905d52-1ddb-4fec-81d4-40e7b5546226 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:19.648371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.665241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:00:19.665588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7ef63f5e-ff78-41e5-aca9-9dbc5044f5de not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:00:19.742390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.775979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] In _notify_port_updated(), no bound segment for port dfb066de-109a-4284-b18c-439666b645d1 on network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:00:19.784086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:19.784960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.788715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "PUT /v2.0/ports/dfb066de-109a-4284-b18c-439666b645d1 HTTP/1.1" status: 200 len: 1128 time: 0.7717595 Dec 21 04:00:19.797081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:19.809037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.809502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.834680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for cf905d52-1ddb-4fec-81d4-40e7b5546226 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:19.877053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=36957a73-39a0-4a98-9c0c-a9907cb8da0c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:19.895982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0b53869-8e75-4ed4-84ec-704240344eae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:19.913487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd668e70-98c7-47b4-a23b-07c0f59ec4b1 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event updated for resources: {'Port': ['ID=dfb066de-109a-4284-b18c-439666b645d1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.936797 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:19.943212 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:19.944493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da40a746-d339-401d-901c-5b56fe2fde0f tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:19.947258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-da40a746-d339-401d-901c-5b56fe2fde0f tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "GET /v2.0/ports/dfb066de-109a-4284-b18c-439666b645d1 HTTP/1.1" status: 200 len: 1128 time: 0.1537993 Dec 21 04:00:19.949597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:19.987337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7e9b8a4d-b4d9-455e-8aae-f4d2b1945e08 None None] Could not find standard attr ID for object a76191d6-74bf-42b9-9ac3-b6ce03b4eecd. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:00:20.005851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a81d29-5ad8-46ea-86d6-062ffa1d1ec4 req-8380cb7e-3423-4460-af51-86f570a8fc1c tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:20.010756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06a81d29-5ad8-46ea-86d6-062ffa1d1ec4 req-8380cb7e-3423-4460-af51-86f570a8fc1c tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 945 time: 0.2520924 Dec 21 04:00:20.073540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['36957a73-39a0-4a98-9c0c-a9907cb8da0c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:20.169411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06a81d29-5ad8-46ea-86d6-062ffa1d1ec4 req-6b7e6d7c-47e7-433b-a9fa-61a8f22466cf tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1519539 Dec 21 04:00:20.229979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.247600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Deleting port dfb066de-109a-4284-b18c-439666b645d1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:20.259147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.287624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=cf905d52-1ddb-4fec-81d4-40e7b5546226,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:20.400033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-884818cf-a876-4d1d-8ee9-4c9a29c5c73e None None] Provisioning complete for port dfb066de-109a-4284-b18c-439666b645d1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:20.400418 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-884818cf-a876-4d1d-8ee9-4c9a29c5c73e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.435932 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.438713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.440245 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-11765a66-1b30-46d1-accf-260fe5a73ca9 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/floatingips/be762563-bcdf-44c4-862d-11b200de8eda HTTP/1.1" status: 204 len: 168 time: 1.1472886 Dec 21 04:00:20.443685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:20.450165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '4621144f-6a4e-4ade-9095-b7670b2a7c5e'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:20.521185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.524719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-884818cf-a876-4d1d-8ee9-4c9a29c5c73e None None] Port dfb066de-109a-4284-b18c-439666b645d1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:20.549801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Calling delete_port for dfb066de-109a-4284-b18c-439666b645d1 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:20.574122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.742399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.881731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:20.958577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event deleted for resources: {'Port': ['ID=dfb066de-109a-4284-b18c-439666b645d1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:21.008957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.015971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b9b1231-2f72-4098-a729-89b6f15adbbe tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "DELETE /v2.0/ports/dfb066de-109a-4284-b18c-439666b645d1 HTTP/1.1" status: 204 len: 168 time: 1.0652623 Dec 21 04:00:21.017625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38780) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:21.097354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Deleting subnet 1de8e16b-5c01-4ca8-9cb3-d39db876710d {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:00:21.103081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.120600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.50 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/3947bd5c-ff8f-4f37-93a5-319542a6d285) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:21.171574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.434376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.459750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.564187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218796cb-2575-4794-a6b3-b29d99e36dff req-390178ff-7e13-445b-8734-6f1627bad377 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:21.570630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-218796cb-2575-4794-a6b3-b29d99e36dff req-390178ff-7e13-445b-8734-6f1627bad377 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 945 time: 0.2307427 Dec 21 04:00:21.584702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.629356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98bd0f8-1175-439e-add4-eee4c9200e2d req-bd5fccd5-c082-40c6-b7b6-2e3983f9405a tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:21.636033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:21.638898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98bd0f8-1175-439e-add4-eee4c9200e2d req-bd5fccd5-c082-40c6-b7b6-2e3983f9405a tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:21.644622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:21.647396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:21.649431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c98bd0f8-1175-439e-add4-eee4c9200e2d req-bd5fccd5-c082-40c6-b7b6-2e3983f9405a tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f&device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 1681 time: 0.1780806 Dec 21 04:00:21.673049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.702486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=3947bd5c-ff8f-4f37-93a5-319542a6d285,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:21.770834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c98bd0f8-1175-439e-add4-eee4c9200e2d req-e276ff03-4e78-4d5e-8d30-024d76a61cb4 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099298 Dec 21 04:00:21.773149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event deleted for resources: {'Subnet': ['ID=1de8e16b-5c01-4ca8-9cb3-d39db876710d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:21.778979 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:21.783447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ac44529a-f621-441b-a15c-b31140c57330 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "DELETE /v2.0/subnets/1de8e16b-5c01-4ca8-9cb3-d39db876710d HTTP/1.1" status: 204 len: 168 time: 0.7646048 Dec 21 04:00:21.785814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:21.794780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-455439b6-4a1f-41f3-9a17-6d993e90fa59 None None] Network 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:21.801394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-218796cb-2575-4794-a6b3-b29d99e36dff req-dc62cd45-794a-4436-9177-1aa8ce1c7649 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2201176 Dec 21 04:00:22.095529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.110840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] DHCP port deletion for 5a4166bb-360a-4e8a-aa01-bf8d96eaacaf request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:22.191773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 36957a73-39a0-4a98-9c0c-a9907cb8da0c up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:22.220219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] Deleting port 89311ed4-7144-4758-b563-07ddc3d5e8bf {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:22.220882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.301916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Deleting port 89311ed4-7144-4758-b563-07ddc3d5e8bf {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:22.302317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.428695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] For port 89311ed4-7144-4758-b563-07ddc3d5e8bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89311ed4-7144-4758-b563-07ddc3d5e8bf,segment=NetworkSegment(bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9),segment_id=bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:22.429254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.451214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Calling delete_port for 89311ed4-7144-4758-b563-07ddc3d5e8bf owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:22.464980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 89311ed4-7144-4758-b563-07ddc3d5e8bf no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:22.465788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.558849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] For port 89311ed4-7144-4758-b563-07ddc3d5e8bf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89311ed4-7144-4758-b563-07ddc3d5e8bf,segment=NetworkSegment(bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9),segment_id=bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:22.559338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.586237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] Calling delete_port for 89311ed4-7144-4758-b563-07ddc3d5e8bf owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:22.712628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d9b4e0e7-ec7f-4008-8458-e799bf998dca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.728694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.756002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.759277 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:00:22.762439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 36957a73-39a0-4a98-9c0c-a9907cb8da0c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:00:22.769627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 36957a73-39a0-4a98-9c0c-a9907cb8da0c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:22.769891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.780436 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:00:22.797249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event deleted for resources: {'Port': ['ID=89311ed4-7144-4758-b563-07ddc3d5e8bf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:22.805316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] No DVR routers for this DVR port 89311ed4-7144-4758-b563-07ddc3d5e8bf on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:22.833791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.928176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:22.936846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] Pushing event deleted for resources: {'Port': ['ID=89311ed4-7144-4758-b563-07ddc3d5e8bf,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:22.950459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faa623eb-80cf-4d47-adbb-e3dcadc8d4dc None None] No DVR routers for this DVR port 89311ed4-7144-4758-b563-07ddc3d5e8bf on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:22.955526 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.012713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9debc01-46b5-4519-985a-08172ed7f1a7 req-79123529-e214-47c6-bf0b-f76e9eef4161 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:23.014335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9debc01-46b5-4519-985a-08172ed7f1a7 req-79123529-e214-47c6-bf0b-f76e9eef4161 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 945 time: 0.1051853 Dec 21 04:00:23.027137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.062718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5a4166bb-360a-4e8a-aa01-bf8d96eaacaf']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:23.067569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.087388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:23.087975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bddc3e00-4cf0-4c8e-b4a0-53d045d7a4f9') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:23.100788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9debc01-46b5-4519-985a-08172ed7f1a7 req-1400e710-1998-41bc-8f21-f0c38bd2c289 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744188 Dec 21 04:00:23.105633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.120448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62b630eb-0376-4860-a576-579116ccf3ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36957a73-39a0-4a98-9c0c-a9907cb8da0c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:23.122735 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f740ce0-a0d1-4a86-bafd-aeed84dc060d" -d '{"events": [{"server_uuid": "62b630eb-0376-4860-a576-579116ccf3ea", "name": "network-vif-plugged", "status": "completed", "tag": "36957a73-39a0-4a98-9c0c-a9907cb8da0c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:23.151646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.179265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c,segment=NetworkSegment(b673eb42-6d7a-401b-8a71-e499dbff8232),segment_id=b673eb42-6d7a-401b-8a71-e499dbff8232)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:23.209433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:00:23.210096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.218333 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:00:23.222561 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:00:23.284017 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-181a3295-4314-4717-a669-8d5ab2676249 x-openstack-request-id: req-181a3295-4314-4717-a669-8d5ab2676249 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:23.284570 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62b630eb-0376-4860-a576-579116ccf3ea", "name": "network-vif-plugged", "status": "completed", "tag": "36957a73-39a0-4a98-9c0c-a9907cb8da0c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:23.285002 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-181a3295-4314-4717-a669-8d5ab2676249 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:23.285630 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62b630eb-0376-4860-a576-579116ccf3ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36957a73-39a0-4a98-9c0c-a9907cb8da0c', 'code': 200} Dec 21 04:00:23.289565 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.291297 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.380710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.385529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=36957a73-39a0-4a98-9c0c-a9907cb8da0c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:23.416490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.437310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.451060 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] 10.222.0.18 "DELETE /v2.0/networks/5a4166bb-360a-4e8a-aa01-bf8d96eaacaf HTTP/1.1" status: 204 len: 168 time: 1.6558924 Dec 21 04:00:23.458999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.463285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646823f9-f9d2-4c54-a389-9a519816c667 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923 tempest-ExtraDHCPOptionsIpV6TestJSON-972200923-project] Pushing event deleted for resources: {'Network': ['ID=5a4166bb-360a-4e8a-aa01-bf8d96eaacaf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:23.463577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cdc5a66-96bf-490b-b484-c81c4c668173 req-ecee4b60-691a-450b-ab03-0ec243b89fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:23.465377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2cdc5a66-96bf-490b-b484-c81c4c668173 req-ecee4b60-691a-450b-ab03-0ec243b89fbe service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 1098 time: 0.0775483 Dec 21 04:00:23.473949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b782830-3af9-4b10-97fc-ddf283ef1bfe req-f918646a-8465-4bc2-b92f-3c5fc463eb56 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:23.481869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b782830-3af9-4b10-97fc-ddf283ef1bfe req-f918646a-8465-4bc2-b92f-3c5fc463eb56 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 945 time: 0.1112523 Dec 21 04:00:23.567589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=3947bd5c-ff8f-4f37-93a5-319542a6d285,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:23.586111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2cdc5a66-96bf-490b-b484-c81c4c668173 req-2089cb2d-fe87-4139-aab1-cbb7f29fc869 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017981 Dec 21 04:00:23.589100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:23.593697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b782830-3af9-4b10-97fc-ddf283ef1bfe req-f6442833-cd77-4512-96cd-e56b740792f8 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106658 Dec 21 04:00:23.711853 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 5659ccfb-9459-4024-a870-5fc2ef6ef204 associated. External IP: 172.25.5.50, port: 4621144f-6a4e-4ade-9095-b7670b2a7c5e. Dec 21 04:00:23.921249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:24.028229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:24.041548 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:24.050408 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:24.051035 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:24.096624 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:24.105156 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:24.105757 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:24.118735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:24.163694 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d792a914-6378-46e9-9f6a-3165f1aa460b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 3.7177413 Dec 21 04:00:24.163950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38846) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:24.169065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-1104058346'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:24.181559 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:24.182403 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93bc62e7-ed87-4e29-9c12-07117ec0a4bf None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:24.265213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153e2cfb-48c1-4dd2-b260-97a05b2276fb req-6e0adf14-cf68-4b85-8801-a34bf2f60445 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:24.272606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-153e2cfb-48c1-4dd2-b260-97a05b2276fb req-6e0adf14-cf68-4b85-8801-a34bf2f60445 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.0879209 Dec 21 04:00:24.329232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:24.332960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:24.363462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-153e2cfb-48c1-4dd2-b260-97a05b2276fb req-247ec494-a999-454f-887f-b62e03e3f5a9 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897660 Dec 21 04:00:24.413567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:24.439448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38856) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:24.453909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:24.453909 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Added segment 2b457473-707a-4333-a961-9622371d5192 of type vlan for network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 Dec 21 04:00:24.515577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:24.625903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:24.634897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:24.634897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:24.727317 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-32185af6-dee0-4f4d-8be3-c032900a84cf admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f33eacd81ada4e12bc1ed3adb3dc1f67&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2850404 Dec 21 04:00:24.733984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38864) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:24.795125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Network': ['ID=cfbd9fb5-0ac1-4ccd-943f-03a73276db45,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:24.805432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-b024101e-688d-451b-99e7-ea8b943e5bbe tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:24.808757 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-b024101e-688d-451b-99e7-ea8b943e5bbe tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "GET /v2.0/ports?device_id=236ee84c-147e-46f1-82ef-6527b966171d HTTP/1.1" status: 200 len: 945 time: 0.1283875 Dec 21 04:00:24.816814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:24.984488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.064899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.105769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-99a4f4fc-819a-40b7-a1c9-09b192c6088b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.165149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-99a4f4fc-819a-40b7-a1c9-09b192c6088b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.190131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Deleting port 2efceb72-a55b-415d-8362-853328770af0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:25.190131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.357260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] For port 2efceb72-a55b-415d-8362-853328770af0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2efceb72-a55b-415d-8362-853328770af0,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:25.357639 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.374320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Calling delete_port for 2efceb72-a55b-415d-8362-853328770af0 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:25.399355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5ebcb6ee-aecb-48c1-8c07-5898860660ec tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 1.2322056 Dec 21 04:00:25.402690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38872) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:25.409820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'subnet': {'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:25.470725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-99a4f4fc-819a-40b7-a1c9-09b192c6088b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.472551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-99a4f4fc-819a-40b7-a1c9-09b192c6088b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.476400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-99a4f4fc-819a-40b7-a1c9-09b192c6088b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1e27a646-5f92-4ddf-9910-f5e7c0bd7184 HTTP/1.1" status: 204 len: 168 time: 0.7394347 Dec 21 04:00:25.489092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a4f4fc-819a-40b7-a1c9-09b192c6088b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e27a646-5f92-4ddf-9910-f5e7c0bd7184,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:25.498862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48bb9b3-09ce-4199-ad8a-4d5deea64dd0 req-3f001b4b-c6dc-4087-8711-ff2df9d95587 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:25.500612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e48bb9b3-09ce-4199-ad8a-4d5deea64dd0 req-3f001b4b-c6dc-4087-8711-ff2df9d95587 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 945 time: 0.7752070 Dec 21 04:00:25.526537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4063c24-474d-451f-869c-ccfebd29b179 req-3dac0491-0e06-4c14-9835-64b7bd049126 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:25.528692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4063c24-474d-451f-869c-ccfebd29b179 req-3dac0491-0e06-4c14-9835-64b7bd049126 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.31 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 945 time: 0.7865014 Dec 21 04:00:25.696075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e48bb9b3-09ce-4199-ad8a-4d5deea64dd0 req-b0d6075d-d972-46eb-8302-9fc145c1999e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/security-groups?id=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1616797 Dec 21 04:00:25.704639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560465ab-dadd-45bc-8a37-5ad62145723c req-19ffdbed-4297-48ef-8dfd-8908cdab2afc tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:25.706103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-560465ab-dadd-45bc-8a37-5ad62145723c req-19ffdbed-4297-48ef-8dfd-8908cdab2afc tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.2213573 Dec 21 04:00:25.729473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.753979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Deleting port d817f625-9ed3-48ad-bce2-e997d275f853 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:25.754349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.795934 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.826359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:25.830477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.832829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d817f625-9ed3-48ad-bce2-e997d275f853'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:25.856554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Pushing event deleted for resources: {'Port': ['ID=2efceb72-a55b-415d-8362-853328770af0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:25.875635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-560465ab-dadd-45bc-8a37-5ad62145723c req-94c93d70-2711-4491-9bb9-51e24b165310 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1466110 Dec 21 04:00:25.958253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] For port d817f625-9ed3-48ad-bce2-e997d275f853, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d817f625-9ed3-48ad-bce2-e997d275f853,segment=NetworkSegment(49474f33-27a4-446a-878e-592b242e9a89),segment_id=49474f33-27a4-446a-878e-592b242e9a89)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:25.958753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.967901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] No DVR routers for this DVR port 2efceb72-a55b-415d-8362-853328770af0 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:25.971269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:25.976193 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3032cf3-77bd-4c9b-a4b1-7b1d42613cc9 req-0f398389-9cd1-44b1-a09c-994e03c02540 tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.54 "DELETE /v2.0/ports/2efceb72-a55b-415d-8362-853328770af0 HTTP/1.1" status: 204 len: 173 time: 1.1560464 Dec 21 04:00:25.976838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236ee84c-147e-46f1-82ef-6527b966171d', 'name': 'network-vif-deleted', 'tag': '2efceb72-a55b-415d-8362-853328770af0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:25.980545 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff0b23ef-26b1-469b-9962-96a88c0c03a5" -d '{"events": [{"server_uuid": "236ee84c-147e-46f1-82ef-6527b966171d", "name": "network-vif-deleted", "tag": "2efceb72-a55b-415d-8362-853328770af0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:25.984105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Calling delete_port for d817f625-9ed3-48ad-bce2-e997d275f853 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:26.053548 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a247287-faef-41b3-9993-6070ed0e01a4 x-openstack-request-id: req-2a247287-faef-41b3-9993-6070ed0e01a4 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:26.053902 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236ee84c-147e-46f1-82ef-6527b966171d", "name": "network-vif-deleted", "tag": "2efceb72-a55b-415d-8362-853328770af0", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:26.054191 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2a247287-faef-41b3-9993-6070ed0e01a4 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:26.054789 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236ee84c-147e-46f1-82ef-6527b966171d', 'name': 'network-vif-deleted', 'tag': '2efceb72-a55b-415d-8362-853328770af0', 'status': 'completed', 'code': 200} Dec 21 04:00:26.236710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:26.311391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Subnet': ['ID=8e31861c-cb69-47e1-85ed-50d0c1d47157,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:26.319477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Checking segment: {'id': '2b457473-707a-4333-a961-9622371d5192', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:26.319851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network hostable DHCP agents. Network: cfbd9fb5-0ac1-4ccd-943f-03a73276db45, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:26.323245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:26.371986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Pushing event deleted for resources: {'Port': ['ID=d817f625-9ed3-48ad-bce2-e997d275f853,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:26.460737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] No DVR routers for this DVR port d817f625-9ed3-48ad-bce2-e997d275f853 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:26.463693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:26.467484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4063c24-474d-451f-869c-ccfebd29b179 req-238f0b61-3723-4334-8a5b-b3c0ca559d2e tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.31 "DELETE /v2.0/ports/d817f625-9ed3-48ad-bce2-e997d275f853 HTTP/1.1" status: 204 len: 173 time: 0.9278524 Dec 21 04:00:26.468059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'name': 'network-vif-deleted', 'tag': 'd817f625-9ed3-48ad-bce2-e997d275f853'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:26.471133 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2deed61c-0ea9-44ea-a11d-bbe626bd9a7f" -d '{"events": [{"server_uuid": "2256f673-4608-4b6a-8dce-c9d48bd4bb4f", "name": "network-vif-deleted", "tag": "d817f625-9ed3-48ad-bce2-e997d275f853"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:26.491805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:26.534196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc24098-5718-4bcc-97d9-e7282d307d95 req-2ced851b-f900-4c41-9b5d-3ce890835329 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:26.535948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebc24098-5718-4bcc-97d9-e7282d307d95 req-2ced851b-f900-4c41-9b5d-3ce890835329 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.0596404 Dec 21 04:00:26.655410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97fddaa7-60b3-4372-bb85-8edddb8d2925 req-fce7be82-e458-4327-b3f9-8cd652701535 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:26.656983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97fddaa7-60b3-4372-bb85-8edddb8d2925 req-fce7be82-e458-4327-b3f9-8cd652701535 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1200707 Dec 21 04:00:26.662475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebc24098-5718-4bcc-97d9-e7282d307d95 req-c6004951-87bd-4b0c-a80a-e8fccb310d1e tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095321 Dec 21 04:00:26.667015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-3db52aa7-2168-4f81-bba9-e0c806952e8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:26.668694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-3db52aa7-2168-4f81-bba9-e0c806952e8a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c82f9e49f19f46738135f46f20ba1250&device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 1098 time: 0.1182394 Dec 21 04:00:26.675636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, cfbd9fb5-0ac1-4ccd-943f-03a73276db45) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:26.683248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c414933d-ad5f-4633-a97e-b9d66a739b7f None None] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:26.809393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-cfbd9fb5-0ac1-4ccd-943f-03a73276db45', 'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45', 'project_id': 'de1d55e58f2f4ea3b43e98928dfd75f7', 'fixed_ips': [{'subnet_id': '8e31861c-cb69-47e1-85ed-50d0c1d47157'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:00:26.811230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:26.812466 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a963501a-ba16-4099-87e7-7f517630440e x-openstack-request-id: req-a963501a-ba16-4099-87e7-7f517630440e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:26.813672 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2256f673-4608-4b6a-8dce-c9d48bd4bb4f", "name": "network-vif-deleted", "tag": "d817f625-9ed3-48ad-bce2-e997d275f853", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:26.814137 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a963501a-ba16-4099-87e7-7f517630440e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:26.814609 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2256f673-4608-4b6a-8dce-c9d48bd4bb4f', 'name': 'network-vif-deleted', 'tag': 'd817f625-9ed3-48ad-bce2-e997d275f853', 'status': 'completed', 'code': 200} Dec 21 04:00:26.821342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:26.822072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:26.957519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab0ed601-23af-4159-b776-10ace5cdd936 req-6bde02cc-e5ab-4a4a-91e1-366afe183b7f tempest-ListServersNegativeTestJSON-36342672 tempest-ListServersNegativeTestJSON-36342672-project] 10.222.0.18 "GET /v2.0/ports?device_id=2256f673-4608-4b6a-8dce-c9d48bd4bb4f HTTP/1.1" status: 200 len: 210 time: 0.0661955 Dec 21 04:00:26.965505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-d6e38cec-1b7a-4bc3-a164-52cca7cf63ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:26.977966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-d6e38cec-1b7a-4bc3-a164-52cca7cf63ec service neutron] 10.222.0.31 "GET /v2.0/networks?id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b HTTP/1.1" status: 200 len: 915 time: 0.3004405 Dec 21 04:00:26.999458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-13771832-e028-4807-af72-cbdfc7ee36ed tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5906978 Dec 21 04:00:26.999969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97fddaa7-60b3-4372-bb85-8edddb8d2925 req-6b24b075-6289-4b31-863d-234797f65521 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3357620 Dec 21 04:00:27.001839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38934) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:27.016865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1324895763', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:27.037057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Allocated IP 172.20.0.2 (cfbd9fb5-0ac1-4ccd-943f-03a73276db45/8e31861c-cb69-47e1-85ed-50d0c1d47157/89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:27.103865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-46321b9c-17bb-4101-9e11-a8e5b1793457 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c HTTP/1.1" status: 200 len: 217 time: 0.1024601 Dec 21 04:00:27.206634 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.208880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.220240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-e119e283-1f0c-4703-912b-df9219b64e22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:27.221724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-e119e283-1f0c-4703-912b-df9219b64e22 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=749eed8f-1884-4400-ae3c-14e64dd7b748 HTTP/1.1" status: 200 len: 854 time: 0.1101127 Dec 21 04:00:27.268859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.288694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-b135d2b6-05e5-4785-95c2-f4969f63b7d1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=efd58aa7-1c72-4652-9ba8-beaf117a1e6b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0522227 Dec 21 04:00:27.298949 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.390135 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.455227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38950) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:27.490777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:27.495268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-2adf4255-e146-49c7-80f4-7a59ecfafcac service neutron] 10.222.0.31 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1915972 Dec 21 04:00:27.497069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:27.501487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:27.518439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Pushing event updated for resources: {'Port': ['ID=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:27.546753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2efceb72-a55b-415d-8362-853328770af0 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:27.591724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.647960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 2efceb72-a55b-415d-8362-853328770af0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:00:27.648318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2efceb72-a55b-415d-8362-853328770af0 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:00:27.649982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Attempting to bind port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:00:27.650342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Attempting to bind port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '2b457473-707a-4333-a961-9622371d5192', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:00:27.650725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Attempting to bind port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc on network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:27.657044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:00:27.657431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Checking segment: {'id': '2b457473-707a-4333-a961-9622371d5192', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:27.658484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.658484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Bound using segment: {'id': '2b457473-707a-4333-a961-9622371d5192', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:00:27.659121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Bound port: 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2b457473-707a-4333-a961-9622371d5192', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:00:27.659508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.661623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-475621260'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:27.703170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e71b2761-70c0-4be1-869d-96ae5e7e06af req-c6874b81-f7cf-47e1-8192-753978cc22f0 service neutron] 10.222.0.31 "GET /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1991994 Dec 21 04:00:27.742253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] For port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:00:27.748449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] For port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,segment=NetworkSegment(2b457473-707a-4333-a961-9622371d5192),segment_id=2b457473-707a-4333-a961-9622371d5192)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:00:27.848834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c56e325-7868-4c71-858b-459c72dab37a req-75223a75-e2c7-4f2a-8ab5-3defbfb3f3f3 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:27.850662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c56e325-7868-4c71-858b-459c72dab37a req-75223a75-e2c7-4f2a-8ab5-3defbfb3f3f3 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.0757718 Dec 21 04:00:27.851927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Made reservation on behalf of a9aa6792b34747699c1b2a69d01b881f for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:27.855873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.872943 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.893801 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:27.939491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c56e325-7868-4c71-858b-459c72dab37a req-2713b925-388a-4ed6-a8b4-c77dfd6c79e2 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0777199 Dec 21 04:00:28.033852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.102895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b62cdcb-1152-4dc2-8c14-341c5714f343 None None] Pushing event updated for resources: {'Port': ['ID=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:28.143523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38964) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:28.146984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.221952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Deleting subnet e1d5c205-3eca-47e7-8219-52c4df788a19 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:00:28.227291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.234707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:28.243381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.245246 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Added segment a1cfb818-f14c-4bb9-9764-1c8f0752cc08 of type vlan for network 100c2ed1-1a24-401c-bc8a-983d93f68d17 Dec 21 04:00:28.281231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.311060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9a5dd363-b9d7-4978-b177-d22111c35034,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:28.322080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.329381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfc0b4d-7c3d-4662-baa8-dacd705a22ca req-759327a0-6bd4-4e28-8148-9979dc3c568b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:28.335439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbfc0b4d-7c3d-4662-baa8-dacd705a22ca req-759327a0-6bd4-4e28-8148-9979dc3c568b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.2364435 Dec 21 04:00:28.451005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbfc0b4d-7c3d-4662-baa8-dacd705a22ca req-1295c4dd-23a9-4677-a10e-97a85e1694b5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0835614 Dec 21 04:00:28.459192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.466970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:28.467679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.488086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.492046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.528064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.548540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Network': ['ID=100c2ed1-1a24-401c-bc8a-983d93f68d17,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:28.565151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:28.606109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-19664525-82c1-46a4-9fe6-7d309abaf43f tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 793 time: 1.1460402 Dec 21 04:00:28.613981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38968) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:28.624313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'subnet': {'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:28.681784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.25.5.68 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/72ffcd8d-1ec9-4e31-9299-9387879ead92) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:28.754010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.787805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e1d5c205-3eca-47e7-8219-52c4df788a19,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:28.793517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.798057 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4fa17646-2a5d-427b-9089-a76add6b9e2d admin admin] 10.222.0.18 "DELETE /v2.0/subnets/e1d5c205-3eca-47e7-8219-52c4df788a19 HTTP/1.1" status: 204 len: 168 time: 0.6509116 Dec 21 04:00:28.800682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38970) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:28.835613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.893648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Made reservation on behalf of a9aa6792b34747699c1b2a69d01b881f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:28.897220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.937300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:28.973865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.022490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:29.029730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:29.036844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:29.050595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-904335d2-ec96-4eb7-8b6a-2603deac4468 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:29.105151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=72ffcd8d-1ec9-4e31-9299-9387879ead92,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:29.136566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-29f09776-0672-4aa4-b70d-da652eb84551 None None] Provisioning complete for port 72ffcd8d-1ec9-4e31-9299-9387879ead92 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:29.137185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-29f09776-0672-4aa4-b70d-da652eb84551 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.145367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.192634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-29f09776-0672-4aa4-b70d-da652eb84551 None None] Port 72ffcd8d-1ec9-4e31-9299-9387879ead92 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:29.228448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a2e3cff-df9f-4d8c-a079-72779b83430e']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:29.249046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '49474f33-27a4-446a-878e-592b242e9a89') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:29.249609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '49474f33-27a4-446a-878e-592b242e9a89') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:29.269949 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.313010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af1f2c9-5488-4ca9-a041-0bdb995827e8 req-890d4209-d0e1-41c3-bf7f-042f81b22f7a tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:29.316533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2af1f2c9-5488-4ca9-a041-0bdb995827e8 req-890d4209-d0e1-41c3-bf7f-042f81b22f7a tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.1927028 Dec 21 04:00:29.332026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.357792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Releasing vlan 114 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:00:29.358205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:00:29.360687 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:00:29.456291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2af1f2c9-5488-4ca9-a041-0bdb995827e8 req-a5266d02-1303-4c6d-87b8-b8c34cb11f9f tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1335332 Dec 21 04:00:29.458291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.509905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.527707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Subnet': ['ID=f50ae046-3f9a-49cd-bcee-16ad67535f64,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:29.537521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.539946 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.546374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] 10.222.0.18 "DELETE /v2.0/networks/9a2e3cff-df9f-4d8c-a079-72779b83430e HTTP/1.1" status: 204 len: 168 time: 0.7433512 Dec 21 04:00:29.562710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8abf727-06cd-47ca-89e5-4fd8b952224c admin admin] Pushing event deleted for resources: {'Network': ['ID=9a2e3cff-df9f-4d8c-a079-72779b83430e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:29.566320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Checking segment: {'id': 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:29.566753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network hostable DHCP agents. Network: 100c2ed1-1a24-401c-bc8a-983d93f68d17, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:29.588821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90327047-afff-4d70-b8fa-308511e76ac6 None None] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:29.683588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:29.757170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbab78dd-6153-4fd3-861b-6336322f676c req-8ce0ddfc-1d18-4c5e-82c0-69379918d4de tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:29.758756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbab78dd-6153-4fd3-861b-6336322f676c req-8ce0ddfc-1d18-4c5e-82c0-69379918d4de tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1049354 Dec 21 04:00:29.808642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Provisioning complete for port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:29.808888 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.816910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 100c2ed1-1a24-401c-bc8a-983d93f68d17) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:29.827732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:29.828884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.839670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbab78dd-6153-4fd3-861b-6336322f676c req-e0122d86-3afc-446c-9ee4-a8b3f6e3abb8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0721092 Dec 21 04:00:29.852006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8aae560-0975-4f87-99e5-da47163e1c26 None None] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:29.927060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:29.947666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4fcc7306-51ea-4518-83a5-646f97741db4 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3325143 Dec 21 04:00:29.950236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38988) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:29.956298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-1688803997', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:30.029188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.042896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-100c2ed1-1a24-401c-bc8a-983d93f68d17', 'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17', 'project_id': 'a9aa6792b34747699c1b2a69d01b881f', 'fixed_ips': [{'subnet_id': 'f50ae046-3f9a-49cd-bcee-16ad67535f64'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:00:30.043779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.071075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.073821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.138383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] For port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,segment=NetworkSegment(2b457473-707a-4333-a961-9622371d5192),segment_id=2b457473-707a-4333-a961-9622371d5192)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:30.157588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38992) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:30.189440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 649b6604-2a69-4e76-b8c4-46c6a60f8234 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:00:30.193917 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.204759 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.222194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:30.251657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecaf8c34-e7e1-4867-a6d9-9128c20167ad req-e72e9980-c065-40ed-9375-b5b1ab4106a0 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:30.253735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecaf8c34-e7e1-4867-a6d9-9128c20167ad req-e72e9980-c065-40ed-9375-b5b1ab4106a0 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.1087923 Dec 21 04:00:30.259703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.264257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0809ce1b-398f-481b-8af2-c4060b602c70 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=25e602d8faa04cc58318214eb632f2d3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1043208 Dec 21 04:00:30.267487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38994) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:30.338848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Allocated IP 172.20.0.2 (100c2ed1-1a24-401c-bc8a-983d93f68d17/f50ae046-3f9a-49cd-bcee-16ad67535f64/c0cbe881-926c-4b7f-9aa2-16aa1cee8e65) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:30.358441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecaf8c34-e7e1-4867-a6d9-9128c20167ad req-3a237be2-fd1e-4c9e-9cd7-f0fb110f94b4 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891976 Dec 21 04:00:30.368541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:30.375732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.385135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38996) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:30.386093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b794a6f-9842-425c-b99e-5d8be5ba5a52 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 715 time: 0.4344664 Dec 21 04:00:30.405741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] Sync routers for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:30.415146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Pushing event updated for resources: {'Port': ['ID=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:30.423620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3882-de65-4b70-9867-746867f321af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.456363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3882-de65-4b70-9867-746867f321af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.460146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d7ab683-a7dc-411b-95cc-b6693e088db4 None None] Provisioning complete for port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:30.460529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d7ab683-a7dc-411b-95cc-b6693e088db4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.519190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.519547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.519893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.520235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.520576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.520910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.521245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.521586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.521906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.522238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.522569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.522894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.523245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40d143bd-204b-4c88-97f0-09605127baa9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:30.543984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.545226 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-febd8877-0d11-4a17-a414-65bc18a5edd2 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.5413077 Dec 21 04:00:30.549027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39000) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:30.561083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3882-de65-4b70-9867-746867f321af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.564758 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3882-de65-4b70-9867-746867f321af admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.568660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3bcc3882-de65-4b70-9867-746867f321af admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/05ac403a-e2cc-47e5-8956-eb2ebefe8c3d HTTP/1.1" status: 204 len: 168 time: 0.2957106 Dec 21 04:00:30.576249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bcc3882-de65-4b70-9867-746867f321af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05ac403a-e2cc-47e5-8956-eb2ebefe8c3d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:30.710564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:30.754724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:30.755405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:30.792914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.843692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:30.857681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:30.892849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:30.895127 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ebe31a1-78f0-4673-a278-8df4f1e34ffc" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-unplugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:30.924953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:30.931544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:30.934080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:31.028882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:31.029554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-534a0c1c-caee-488d-8522-8ff8ce3fcd76 None None] The sync data for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:31.040784 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.041606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d817f625-9ed3-48ad-bce2-e997d275f853 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:31.055273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:31.055273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.130462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c046a8-639d-4d4a-8dbb-168bcf6d9081 req-eda6453c-aadd-41c9-b466-8dce7c61ca85 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:31.132812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15c046a8-639d-4d4a-8dbb-168bcf6d9081 req-eda6453c-aadd-41c9-b466-8dce7c61ca85 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1426957 Dec 21 04:00:31.174841 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7da4fc59-dc26-4378-88dd-6e8b377d941c x-openstack-request-id: req-7da4fc59-dc26-4378-88dd-6e8b377d941c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:31.175457 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-unplugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:31.175457 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7da4fc59-dc26-4378-88dd-6e8b377d941c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:31.175774 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 04:00:31.185902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: d817f625-9ed3-48ad-bce2-e997d275f853 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:00:31.186455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d817f625-9ed3-48ad-bce2-e997d275f853 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:00:31.210190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15c046a8-639d-4d4a-8dbb-168bcf6d9081 req-b86f410a-3e5d-4b18-83ca-f408259dce69 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0707695 Dec 21 04:00:31.214285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.251178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:31.322011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.365362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:31.370340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:31.375600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:31.377689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.378111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Pushing event updated for resources: {'Port': ['ID=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:31.440916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Allocated IP 172.20.0.1 (100c2ed1-1a24-401c-bc8a-983d93f68d17/f50ae046-3f9a-49cd-bcee-16ad67535f64/b9170a60-ea33-47a3-bdb2-3f7182bf92af) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:31.449105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Attempting to bind port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:00:31.449487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Attempting to bind port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:00:31.449901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Attempting to bind port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 on network 100c2ed1-1a24-401c-bc8a-983d93f68d17 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:31.456454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:00:31.456854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Checking segment: {'id': 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:31.457501 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.457987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Bound using segment: {'id': 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:00:31.458476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Bound port: c0cbe881-926c-4b7f-9aa2-16aa1cee8e65, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:00:31.458865 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.546833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a04f525-9755-4b3b-8bb9-81b792e7f36c req-8f6ebed7-98c6-4949-ac56-a3749d795523 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:31.555893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a04f525-9755-4b3b-8bb9-81b792e7f36c req-8f6ebed7-98c6-4949-ac56-a3749d795523 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.0718448 Dec 21 04:00:31.557697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] For port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:00:31.562347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] For port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,segment=NetworkSegment(a1cfb818-f14c-4bb9-9764-1c8f0752cc08),segment_id=a1cfb818-f14c-4bb9-9764-1c8f0752cc08)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:00:31.622506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a04f525-9755-4b3b-8bb9-81b792e7f36c req-f401afb6-fd4d-4d73-ad11-2e10a65b6667 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655737 Dec 21 04:00:31.661497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:31.744769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6bd770-47d9-43f3-9c42-a8cb5f3a4589 None None] Pushing event updated for resources: {'Port': ['ID=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:32.086525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-2ae5dc5f-dea6-47bc-a4aa-339835d5aa85 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:32.088164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-2ae5dc5f-dea6-47bc-a4aa-339835d5aa85 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.31 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.0782461 Dec 21 04:00:32.202135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.242075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:32.299628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Deleting port 36957a73-39a0-4a98-9c0c-a9907cb8da0c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:32.301850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.458748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.1 (cfbd9fb5-0ac1-4ccd-943f-03a73276db45/8e31861c-cb69-47e1-85ed-50d0c1d47157/ca553f44-1f3e-43ba-8256-7491070887fe) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:32.489035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.504765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] For port 36957a73-39a0-4a98-9c0c-a9907cb8da0c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=36957a73-39a0-4a98-9c0c-a9907cb8da0c,segment=NetworkSegment(b673eb42-6d7a-401b-8a71-e499dbff8232),segment_id=b673eb42-6d7a-401b-8a71-e499dbff8232)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:32.504978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.531556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e339f3-5f8d-401c-8587-ba0ed9f7622b req-6a9dfbcd-b257-4803-a772-ee8bc90f8849 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:32.553338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04e339f3-5f8d-401c-8587-ba0ed9f7622b req-6a9dfbcd-b257-4803-a772-ee8bc90f8849 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1245584 Dec 21 04:00:32.567020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Calling delete_port for 36957a73-39a0-4a98-9c0c-a9907cb8da0c owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:32.591346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:32.619980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'mac_address': 'fa:16:3e:b1:88:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:32.629683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:32.666405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:32.675621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:32.705396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04e339f3-5f8d-401c-8587-ba0ed9f7622b req-aa716ade-0289-4070-a3f2-d05e0363938b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1510572 Dec 21 04:00:32.725860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:32.802155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.814828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Port': ['ID=b9170a60-ea33-47a3-bdb2-3f7182bf92af,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:32.825731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:32.849886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.857181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:32.857536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.863169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:32.950611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.976642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:32.990293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cf33da-b817-4ea5-9d86-877dd46b8869 req-2ea9c127-4aca-4461-9cc1-f5418cb2266a tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:33.023720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14cf33da-b817-4ea5-9d86-877dd46b8869 req-2ea9c127-4aca-4461-9cc1-f5418cb2266a tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 946 time: 0.2552915 Dec 21 04:00:33.064271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:33.105787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.122917 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.144448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['643a3827-c0d5-4377-893a-3bf71f16b0e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:33.172812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14cf33da-b817-4ea5-9d86-877dd46b8869 req-f0921678-094e-4441-96a1-d1665cbef120 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/security-groups?id=dc698d81-1881-4e13-a825-56c971cdc44b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1448472 Dec 21 04:00:33.195245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,segment=NetworkSegment(a1cfb818-f14c-4bb9-9764-1c8f0752cc08),segment_id=a1cfb818-f14c-4bb9-9764-1c8f0752cc08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:33.198531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:33.216471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:33.222277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:33.259361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.272694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.284324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.286441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:33.323021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=ca553f44-1f3e-43ba-8256-7491070887fe,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:33.398791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.443496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Pushing event deleted for resources: {'Port': ['ID=36957a73-39a0-4a98-9c0c-a9907cb8da0c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:33.519464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] No DVR routers for this DVR port 36957a73-39a0-4a98-9c0c-a9907cb8da0c on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:33.525263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.529829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3b6cc4b-cae3-4cae-a599-eb4540764918 req-d8d08a68-e9e1-4c1d-b0c4-cbd0b60f1112 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.31 "DELETE /v2.0/ports/36957a73-39a0-4a98-9c0c-a9907cb8da0c HTTP/1.1" status: 204 len: 173 time: 1.4326258 Dec 21 04:00:33.530683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62b630eb-0376-4860-a576-579116ccf3ea', 'name': 'network-vif-deleted', 'tag': '36957a73-39a0-4a98-9c0c-a9907cb8da0c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:33.535382 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed6691d4-a9c6-4584-a496-5e0d10aa40ff" -d '{"events": [{"server_uuid": "62b630eb-0376-4860-a576-579116ccf3ea", "name": "network-vif-deleted", "tag": "36957a73-39a0-4a98-9c0c-a9907cb8da0c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:33.602417 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9f94a87-fc4f-4ee7-bf02-085f5bfb523b x-openstack-request-id: req-d9f94a87-fc4f-4ee7-bf02-085f5bfb523b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:33.602727 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62b630eb-0376-4860-a576-579116ccf3ea", "name": "network-vif-deleted", "tag": "36957a73-39a0-4a98-9c0c-a9907cb8da0c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:33.603033 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d9f94a87-fc4f-4ee7-bf02-085f5bfb523b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:33.603450 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62b630eb-0376-4860-a576-579116ccf3ea', 'name': 'network-vif-deleted', 'tag': '36957a73-39a0-4a98-9c0c-a9907cb8da0c', 'status': 'completed', 'code': 200} Dec 21 04:00:33.619392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:33.728093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:33.728093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.784815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-406d5eb3-a95e-40f6-b500-a8f5c49e5c62 None None] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:33.945623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0cd55d6f-b98d-4fc6-8734-7f98049f4e05 None None] Provisioning complete for port ca553f44-1f3e-43ba-8256-7491070887fe triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:33.945981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0cd55d6f-b98d-4fc6-8734-7f98049f4e05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:33.965693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13eab39-b5e6-4d5d-afb0-94de47686154 req-6c4fef2d-9054-4328-88c0-e41d426716ac tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:33.977523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13eab39-b5e6-4d5d-afb0-94de47686154 req-6c4fef2d-9054-4328-88c0-e41d426716ac tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.1360569 Dec 21 04:00:34.074898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13eab39-b5e6-4d5d-afb0-94de47686154 req-9e31c109-dff0-4551-bd4f-0bf2698f163e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0906107 Dec 21 04:00:34.076563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39102) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:34.087153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.167056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.198082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0cd55d6f-b98d-4fc6-8734-7f98049f4e05 None None] Port ca553f44-1f3e-43ba-8256-7491070887fe cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:34.280516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:34.362843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8dc7933-c673-49fb-b707-1537943b6f82 req-a262b5ab-685c-4e0a-afe4-ae87ff8458f3 tempest-InstanceActionsTestJSON-813625467 tempest-InstanceActionsTestJSON-813625467-project] 10.222.0.18 "GET /v2.0/ports?device_id=62b630eb-0376-4860-a576-579116ccf3ea HTTP/1.1" status: 200 len: 210 time: 0.0564220 Dec 21 04:00:34.386642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Port': ['ID=b9170a60-ea33-47a3-bdb2-3f7182bf92af,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:34.397321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f503ea64-f06f-4818-8daa-6d9bfc933ffd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.421179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.462346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.549883 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f503ea64-f06f-4818-8daa-6d9bfc933ffd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.566513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d1d7c079-6823-4eaa-8fc8-072345d0bc6f None None] Provisioning complete for port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:34.566513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1d7c079-6823-4eaa-8fc8-072345d0bc6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.603003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 643a3827-c0d5-4377-893a-3bf71f16b0e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:34.603393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.681315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f503ea64-f06f-4818-8daa-6d9bfc933ffd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.698884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:34.754232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f503ea64-f06f-4818-8daa-6d9bfc933ffd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dac7dfea-4ba5-4485-80a1-5c7f32acb73b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:34.772837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:34.775874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:34.809895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f503ea64-f06f-4818-8daa-6d9bfc933ffd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=21d25061fbea4e9db9ea4cbadeb7a1cf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7283144 Dec 21 04:00:34.811944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:34.898230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:34.936795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b65c674-e707-4927-9b4b-ff328d0ec587 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.000727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b65c674-e707-4927-9b4b-ff328d0ec587 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.010576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:35.012890 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c396f20f-208d-44ca-8a78-5f09f149e3fc" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:35.071663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:35.072041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.072975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.092322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:35.095347 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4072335-e544-495b-aec1-90244c1d6dcf x-openstack-request-id: req-f4072335-e544-495b-aec1-90244c1d6dcf {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:35.095740 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-plugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:35.096281 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f4072335-e544-495b-aec1-90244c1d6dcf {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:35.096825 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 04:00:35.097522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0db03768-480d-4a32-9c44-a81d581d73d0 None None] Provisioning complete for port b9170a60-ea33-47a3-bdb2-3f7182bf92af triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:35.098071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0db03768-480d-4a32-9c44-a81d581d73d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.144849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Router f88d9c66-ce7e-4778-9634-764e233532a0 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:00:35.177543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0db03768-480d-4a32-9c44-a81d581d73d0 None None] Port b9170a60-ea33-47a3-bdb2-3f7182bf92af cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:35.200029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0db03768-480d-4a32-9c44-a81d581d73d0 None None] Provisioning complete for port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:35.200676 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0db03768-480d-4a32-9c44-a81d581d73d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.241685 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.242748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 36957a73-39a0-4a98-9c0c-a9907cb8da0c no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:35.255938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.258456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50bcea27-64bb-40dc-806e-6b294546defe req-808d4ffc-376f-4edf-bac9-7520d6b2b480 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:35.260313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50bcea27-64bb-40dc-806e-6b294546defe req-808d4ffc-376f-4edf-bac9-7520d6b2b480 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 945 time: 0.1098840 Dec 21 04:00:35.293213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 36957a73-39a0-4a98-9c0c-a9907cb8da0c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:00:35.293829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 36957a73-39a0-4a98-9c0c-a9907cb8da0c not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:00:35.306455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b65c674-e707-4927-9b4b-ff328d0ec587 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.310127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b65c674-e707-4927-9b4b-ff328d0ec587 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.314970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b65c674-e707-4927-9b4b-ff328d0ec587 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dac7dfea-4ba5-4485-80a1-5c7f32acb73b HTTP/1.1" status: 204 len: 168 time: 0.4960856 Dec 21 04:00:35.356296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b65c674-e707-4927-9b4b-ff328d0ec587 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dac7dfea-4ba5-4485-80a1-5c7f32acb73b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:35.429867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50bcea27-64bb-40dc-806e-6b294546defe req-10e82e04-d083-4486-a3eb-565809a5add4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1611748 Dec 21 04:00:35.457711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39122) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:35.483933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:35.499729 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c19b2e2f-cf7a-48ab-a376-5b2e32868d9b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "PUT /v2.0/routers/f88d9c66-ce7e-4778-9634-764e233532a0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1134071 Dec 21 04:00:35.503735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:35.506054 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] Sync routers for ids ['f88d9c66-ce7e-4778-9634-764e233532a0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:35.511566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'port': {'network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17', 'name': 'tempest-FloatingIPNegativeTestJSON-882224090'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:35.520279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.522184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=ca553f44-1f3e-43ba-8256-7491070887fe,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:35.548075 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] Routers {'f88d9c66-ce7e-4778-9634-764e233532a0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:35.550253 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f88d9c66-ce7e-4778-9634-764e233532a0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:35.564481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Deleting subnet 749eed8f-1884-4400-ae3c-14e64dd7b748 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:00:35.572860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.633518 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:35.648050 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] Routers {'f88d9c66-ce7e-4778-9634-764e233532a0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:35.649047 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f88d9c66-ce7e-4778-9634-764e233532a0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:35.650600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.718949 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.758288 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:35.760879 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b80055dd-872e-4519-bb73-118ebe172318 None None] The sync data for ids ['f88d9c66-ce7e-4778-9634-764e233532a0'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:35.774304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=13']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:35.800860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:35.805281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:35.900744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.930227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Made reservation on behalf of a9aa6792b34747699c1b2a69d01b881f for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:35.934288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.986013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=749eed8f-1884-4400-ae3c-14e64dd7b748,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:35.993343 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:35.999749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] device_id is not set on port 8c54b0ba-daf9-4d56-87c8-8eb5083bd340 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:00:36.002280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0ab532a0-d4b1-4565-9b8b-72e7defab45b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/749eed8f-1884-4400-ae3c-14e64dd7b748 HTTP/1.1" status: 204 len: 168 time: 0.5434544 Dec 21 04:00:36.008353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:36.096603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7e93181e-bea8-45e5-9c12-d67ba655a531 None None] Provisioning complete for port b9170a60-ea33-47a3-bdb2-3f7182bf92af triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:36.103542 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7e93181e-bea8-45e5-9c12-d67ba655a531 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:36.163789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7e93181e-bea8-45e5-9c12-d67ba655a531 None None] Port b9170a60-ea33-47a3-bdb2-3f7182bf92af cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:36.221850 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:36.285218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Allocated IP 172.20.0.14 (100c2ed1-1a24-401c-bc8a-983d93f68d17/f50ae046-3f9a-49cd-bcee-16ad67535f64/8c54b0ba-daf9-4d56-87c8-8eb5083bd340) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:36.400641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-396117d6-ce05-4d8f-a7ec-940fe35769ba None None] Provisioning complete for port ca553f44-1f3e-43ba-8256-7491070887fe triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:36.400946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-396117d6-ce05-4d8f-a7ec-940fe35769ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:36.494901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-396117d6-ce05-4d8f-a7ec-940fe35769ba None None] Port ca553f44-1f3e-43ba-8256-7491070887fe cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:36.545503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:36.557099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 649b6604-2a69-4e76-b8c4-46c6a60f8234 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:36.636968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3002d7bf-d897-487c-8dbe-9e41940cbc46 req-3a6285e3-68bf-489d-9fba-967efad00ae5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:36.638406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3002d7bf-d897-487c-8dbe-9e41940cbc46 req-3a6285e3-68bf-489d-9fba-967efad00ae5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1123850 Dec 21 04:00:36.745808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:36.756947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3002d7bf-d897-487c-8dbe-9e41940cbc46 req-77668620-bf2b-4141-8906-50b0565f1dd1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1069055 Dec 21 04:00:36.831360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['efd58aa7-1c72-4652-9ba8-beaf117a1e6b']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.143657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39160) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:37.244842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b673eb42-6d7a-401b-8a71-e499dbff8232') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.245381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b673eb42-6d7a-401b-8a71-e499dbff8232') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.249276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.302414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Request body: {'network': {'name': 'tempest-ServerAddressesTestJSON-2063980682-network', 'tenant_id': 'b71c4b09f0c646bd944ad36662648bd8'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:37.305880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.333032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Port': ['ID=8c54b0ba-daf9-4d56-87c8-8eb5083bd340,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:37.337692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.340145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:37.351940 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e95cea44-6281-4bbf-8ab1-0cafd44a983c tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/routers/649b6604-2a69-4e76-b8c4-46c6a60f8234/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7990851 Dec 21 04:00:37.353445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Releasing vlan 104 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:00:37.353845 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:00:37.355669 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:00:37.358867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:37.368919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39164) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:37.384477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] Sync routers for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:37.385069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'port': {'network_id': 'cfbd9fb5-0ac1-4ccd-943f-03a73276db45', 'name': 'tempest-FloatingIPTestJSON-1332448793'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:37.389231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:37.415054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:37.416595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.435349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Made reservation on behalf of b71c4b09f0c646bd944ad36662648bd8 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:37.438472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.458774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.462039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:37.517689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.538756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:37.539539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.621967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:37.622648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e8e0bd-4181-405e-a3df-ba7c28b8daae None None] The sync data for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:37.643330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.684578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:37.685304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.718020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.725302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.729842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] 10.222.0.18 "DELETE /v2.0/networks/efd58aa7-1c72-4652-9ba8-beaf117a1e6b HTTP/1.1" status: 204 len: 168 time: 1.7203701 Dec 21 04:00:37.744314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.763384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79cfb498-6226-44f5-8d52-0e75287ce338 admin admin] Pushing event deleted for resources: {'Network': ['ID=efd58aa7-1c72-4652-9ba8-beaf117a1e6b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:37.779288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:37.790071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dccd9196-94e1-4422-afe7-0a0fb5768ad2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:37.795595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.796109 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Added segment 8cb67e3a-d3f0-4c65-9e90-a7ae948c636c of type vlan for network dd139785-bf85-4780-9c0a-38b01e520a12 Dec 21 04:00:37.816743 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98195072-f8f0-4d53-a503-319c87f34314 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.3097258 Dec 21 04:00:37.833415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39172) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:37.839221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b9b12e95-955d-491a-882a-ade805f4a8bc None None] Provisioning complete for port 8c54b0ba-daf9-4d56-87c8-8eb5083bd340 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:37.841265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:37.842108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b9b12e95-955d-491a-882a-ade805f4a8bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.858551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.917536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b9b12e95-955d-491a-882a-ade805f4a8bc None None] Port 8c54b0ba-daf9-4d56-87c8-8eb5083bd340 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:37.966708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-625ca15a-73f5-471f-b8fd-0e0162b525d8 req-793120f3-2cc2-41ea-b159-bac9df071a2b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:37.968516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-625ca15a-73f5-471f-b8fd-0e0162b525d8 req-793120f3-2cc2-41ea-b159-bac9df071a2b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.0751464 Dec 21 04:00:37.984112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Made reservation on behalf of de1d55e58f2f4ea3b43e98928dfd75f7 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:37.986847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.988283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:37.988897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:37.989022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.008612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] device_id is not set on port 5a58b8a4-59bc-40c9-9ab4-f19631577201 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:00:38.119044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-625ca15a-73f5-471f-b8fd-0e0162b525d8 req-b2ae00bb-7c68-4923-86aa-21e7c9ba06fe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1436286 Dec 21 04:00:38.175352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.0273063 Dec 21 04:00:38.176169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39176) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:38.183578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Request body: {'subnet': {'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerAddressesTestJSON-2063980682-subnet', 'tenant_id': 'b71c4b09f0c646bd944ad36662648bd8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:38.190210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8af587b-a67a-41bd-beb5-5c42e2b50e23 admin admin] Pushing event updated for resources: {'Network': ['ID=dd139785-bf85-4780-9c0a-38b01e520a12,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:38.205146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network dd139785-bf85-4780-9c0a-38b01e520a12 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:38.214945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Allocated IP 172.20.0.12 (cfbd9fb5-0ac1-4ccd-943f-03a73276db45/8e31861c-cb69-47e1-85ed-50d0c1d47157/5a58b8a4-59bc-40c9-9ab4-f19631577201) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:38.229670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.275406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39178) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:38.384884 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d18e707e-7b9f-4db5-9f62-82f672744c10 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c82f9e49f19f46738135f46f20ba1250&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1081922 Dec 21 04:00:38.388722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39180) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:38.431499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Made reservation on behalf of b71c4b09f0c646bd944ad36662648bd8 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:38.434081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.481830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.599516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.655930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Allocated IP 172.25.5.25 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/c7356be1-6e64-498e-94d7-9c3f8142d237) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:38.821621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.902662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:38.922518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:38.927997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:38.938014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event updated for resources: {'Port': ['ID=5a58b8a4-59bc-40c9-9ab4-f19631577201,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:38.951867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:39.083791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=60c316de-0ab1-4b9b-a7f3-c62190d2ec1a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:39.106322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:39.107036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.120578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Checking segment: {'id': '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:39.120980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Network hostable DHCP agents. Network: dd139785-bf85-4780-9c0a-38b01e520a12, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:39.184913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41159b-d14d-420a-a0c1-74256f51fe78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.232815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc7b508c-78c7-494d-b595-84a137e7d4f1 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.8513625 Dec 21 04:00:39.233056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:39.237960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Request body: {'floatingip': {'port_id': '5a58b8a4-59bc-40c9-9ab4-f19631577201'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:39.240355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41159b-d14d-420a-a0c1-74256f51fe78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.267017 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.291754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Network dd139785-bf85-4780-9c0a-38b01e520a12 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:39.319290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-766355e5-b1a2-4358-aa21-d35ea29bc2e2 req-b3f61572-c9b7-4a9a-9a5a-aa1d8ee46534 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:39.327006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-766355e5-b1a2-4358-aa21-d35ea29bc2e2 req-b3f61572-c9b7-4a9a-9a5a-aa1d8ee46534 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.0731363 Dec 21 04:00:39.356348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-949af873-bce4-4945-aa80-2d220830a8d5 None None] Provisioning complete for port 5a58b8a4-59bc-40c9-9ab4-f19631577201 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:39.360758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-949af873-bce4-4945-aa80-2d220830a8d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.398358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.442293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-949af873-bce4-4945-aa80-2d220830a8d5 None None] Port 5a58b8a4-59bc-40c9-9ab4-f19631577201 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:00:39.458466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-766355e5-b1a2-4358-aa21-d35ea29bc2e2 req-14bc66e6-b65b-469e-beb5-76bfbac8da01 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1305282 Dec 21 04:00:39.464785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, dd139785-bf85-4780-9c0a-38b01e520a12) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:39.483357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:39.483357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.483728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2213a14c-13f2-4ca1-8665-42a685e7e73f None None] Network dd139785-bf85-4780-9c0a-38b01e520a12 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:39.516898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.518908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41159b-d14d-420a-a0c1-74256f51fe78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.521354 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41159b-d14d-420a-a0c1-74256f51fe78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:39.524727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aa41159b-d14d-420a-a0c1-74256f51fe78 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dc698d81-1881-4e13-a825-56c971cdc44b HTTP/1.1" status: 204 len: 168 time: 1.1324594 Dec 21 04:00:39.616417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:39.628489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:39.630466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa41159b-d14d-420a-a0c1-74256f51fe78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc698d81-1881-4e13-a825-56c971cdc44b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:39.637821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:39.647270 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a3a85e00-07fb-40b2-9470-f3d874741cf9 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.4699075 Dec 21 04:00:39.705775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbe8e060-9b6c-47e4-8054-7237597f3b75 None None] Network dd139785-bf85-4780-9c0a-38b01e520a12 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:39.818707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Port': ['ID=c7356be1-6e64-498e-94d7-9c3f8142d237,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:39.944436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:40.052589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:40.356447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:40.417774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:40.672409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8bdcf5-433e-4c86-9cfd-5603aa9efe78 req-4a5af80f-a650-48dc-a5f2-fc3a12eba3c7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:40.674086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc8bdcf5-433e-4c86-9cfd-5603aa9efe78 req-4a5af80f-a650-48dc-a5f2-fc3a12eba3c7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1092417 Dec 21 04:00:40.682827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-57cc3c2b-e5ea-42fe-a400-d2808bcf8aa5 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:40.684345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-57cc3c2b-e5ea-42fe-a400-d2808bcf8aa5 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/networks?id=dd139785-bf85-4780-9c0a-38b01e520a12 HTTP/1.1" status: 200 len: 814 time: 0.1631901 Dec 21 04:00:40.710468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-2114baf5-9e69-4b3b-a443-45145b19b856 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/quotas/b71c4b09f0c646bd944ad36662648bd8 HTTP/1.1" status: 200 len: 375 time: 0.0180871 Dec 21 04:00:40.753271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-feb6891a-e446-4b76-bb01-1c0c264408f7 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=b71c4b09f0c646bd944ad36662648bd8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0367146 Dec 21 04:00:40.761023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc8bdcf5-433e-4c86-9cfd-5603aa9efe78 req-30ac46be-6bc9-4765-8e3d-de16b72a906c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0757406 Dec 21 04:00:40.860462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-a3b94ea5-55b2-4601-9b1e-495a050c1bf3 service neutron] 10.222.0.18 "GET /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0984216 Dec 21 04:00:40.878619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:40.898183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:41.022578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Port': ['ID=c7356be1-6e64-498e-94d7-9c3f8142d237,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:41.053466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:41.073468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-d918f972-8477-400d-a82f-ddca106abd40 service neutron] 10.222.0.18 "GET /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2050350 Dec 21 04:00:41.175416 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 5659ccfb-9459-4024-a870-5fc2ef6ef204 associated. External IP: 172.25.5.50, port: 4621144f-6a4e-4ade-9095-b7670b2a7c5e. Dec 21 04:00:41.191534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:41.192755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-469614e5-bd83-4f78-8e28-a992f7025a07 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.3580091 Dec 21 04:00:41.195522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39234) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:41.199997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3677ff3b-c125-40c1-8146-9e773add136a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'floatingip': {'port_id': '8c54b0ba-daf9-4d56-87c8-8eb5083bd340', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:41.255302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3677ff3b-c125-40c1-8146-9e773add136a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:41.515927 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-3677ff3b-c125-40c1-8146-9e773add136a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] update failed (client error): The resource could not be found. Dec 21 04:00:41.517468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3677ff3b-c125-40c1-8146-9e773add136a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "PUT /v2.0/floatingips/b52e3890-1725-45f9-9dd6-ef090248defb HTTP/1.1" status: 404 len: 507 time: 0.3208044 Dec 21 04:00:41.520455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39246) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:41.639764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:41.642741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b891133b-f48a-4c6d-84d8-81ca36702fcf req-d2200633-3327-4e5b-b0a1-9dff9fc11b94 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.0480304 Dec 21 04:00:41.694893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39250) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:41.845283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:41.850296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Deleting port c7356be1-6e64-498e-94d7-9c3f8142d237 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:41.850637 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:41.870399 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:41.884499 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:41.885139 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:41.987437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:41.987785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.004230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Calling delete_port for c7356be1-6e64-498e-94d7-9c3f8142d237 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:42.041432 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.084884 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:42.090503 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.137766 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.138476 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c4aba46-3f26-40f0-82ed-46cd4f530fcc None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:42.142328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39264) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:42.243078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 649b6604-2a69-4e76-b8c4-46c6a60f8234 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:42.256876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsV221TestJSON-1331016315-network', 'tenant_id': '3d5a6f8a2e664539a37470e2d2eb3477'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:42.269948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6148636-0312-45a1-babd-3ffe34895970 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.337154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200a8a0-a53f-4626-bfa6-e30715f21e00 req-3e046e0a-80aa-43ed-b7ec-c6132b8dba53 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:42.339284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b200a8a0-a53f-4626-bfa6-e30715f21e00 req-3e046e0a-80aa-43ed-b7ec-c6132b8dba53 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1961164 Dec 21 04:00:42.397855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:42.404278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b200a8a0-a53f-4626-bfa6-e30715f21e00 req-d48d48b2-48f1-42ae-8d39-641de977b5d2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0556474 Dec 21 04:00:42.412314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] Sync routers for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:42.414136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.448627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Made reservation on behalf of 3d5a6f8a2e664539a37470e2d2eb3477 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:42.451795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.456639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.461691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:42.471401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.498483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.514619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Port': ['ID=c7356be1-6e64-498e-94d7-9c3f8142d237,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:42.551718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.583372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:42.584308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.595487 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7dcf4742-c0c7-4a15-bea4-b789710ea577 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/floatingips/5659ccfb-9459-4024-a870-5fc2ef6ef204 HTTP/1.1" status: 200 len: 978 time: 3.3583481 Dec 21 04:00:42.595946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39270) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:42.633619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:42.635889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d813325-7fda-4545-9ba7-95e2ce3e010a None None] The sync data for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:42.689840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6148636-0312-45a1-babd-3ffe34895970 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.694517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.697542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.702684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-90ba955e-1911-46f9-829d-ac70354ab060 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "DELETE /v2.0/floatingips/b52e3890-1725-45f9-9dd6-ef090248defb HTTP/1.1" status: 204 len: 168 time: 1.1810179 Dec 21 04:00:42.703466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:42.710190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9b875f49-8f6d-4311-ad2a-540e4424259c tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'floatingip': {'floating_network_id': '100c2ed1-1a24-401c-bc8a-983d93f68d17', 'port_id': '8c54b0ba-daf9-4d56-87c8-8eb5083bd340', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:42.785022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5a6b6ca-5476-4621-817f-dbd1e368c62d req-99040486-67a7-49f8-8112-5749d9457b58 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.0407488 Dec 21 04:00:42.801494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.806558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 5a58b8a4-59bc-40c9-9ab4-f19631577201 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:42.807119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.825536 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6148636-0312-45a1-babd-3ffe34895970 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.891877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f6148636-0312-45a1-babd-3ffe34895970 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0cd704908d7e4450ad81be2aa334254a&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1928954 Dec 21 04:00:42.891877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6148636-0312-45a1-babd-3ffe34895970 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afdee7c5-d5f7-4c2a-9045-5563d812b270,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:42.892189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39278) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:42.899045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b875f49-8f6d-4311-ad2a-540e4424259c tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.956894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:42.999393 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.018219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:43.043537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f961a123-88eb-4721-b535-2c6bfc9ed43a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.047902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.048266 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Added segment 9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4 of type vlan for network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 Dec 21 04:00:43.094408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a82789bc-2b38-4445-a730-65e2a8ec8a7c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:43.118995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.123359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f961a123-88eb-4721-b535-2c6bfc9ed43a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.258781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.259188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.259528 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Floating IP 5659ccfb-9459-4024-a870-5fc2ef6ef204 disassociated. External IP: 172.25.5.50, port: 5a58b8a4-59bc-40c9-9ab4-f19631577201. Dec 21 04:00:43.259864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 5a58b8a4-59bc-40c9-9ab4-f19631577201 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:43.270453 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-9b875f49-8f6d-4311-ad2a-540e4424259c tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:00:43.272212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9b875f49-8f6d-4311-ad2a-540e4424259c tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 0.5660348 Dec 21 04:00:43.278483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39282) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:43.284442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '8c54b0ba-daf9-4d56-87c8-8eb5083bd340', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:43.332311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.333944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:43.335081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.411853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f961a123-88eb-4721-b535-2c6bfc9ed43a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.414835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f961a123-88eb-4721-b535-2c6bfc9ed43a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.416234 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f961a123-88eb-4721-b535-2c6bfc9ed43a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/afdee7c5-d5f7-4c2a-9045-5563d812b270 HTTP/1.1" status: 204 len: 168 time: 0.5232627 Dec 21 04:00:43.442490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f961a123-88eb-4721-b535-2c6bfc9ed43a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afdee7c5-d5f7-4c2a-9045-5563d812b270,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:43.444035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.458803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] Pushing event updated for resources: {'Network': ['ID=9b632d49-bc8a-4f7d-b433-7c4b707a95a5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:43.475133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:43.475643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.517725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6bda52ab-3760-4f58-a2f9-6b064198bb59 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.3704317 Dec 21 04:00:43.520520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39288) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:43.527769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Request body: {'subnet': {'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsV221TestJSON-1331016315-subnet', 'tenant_id': '3d5a6f8a2e664539a37470e2d2eb3477', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:43.550005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=5a58b8a4-59bc-40c9-9ab4-f19631577201,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:43.716519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Made reservation on behalf of 3d5a6f8a2e664539a37470e2d2eb3477 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:43.724874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.762083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca7b79b-fbfa-47df-b202-f22506241161 req-300a2517-a456-4b83-b062-9536c324557b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:43.763843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ca7b79b-fbfa-47df-b202-f22506241161 req-300a2517-a456-4b83-b062-9536c324557b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1367211 Dec 21 04:00:43.786405 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:43.873481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 649b6604-2a69-4e76-b8c4-46c6a60f8234 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:44.033965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Allocated IP 172.25.5.20 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/eb3478f5-4e96-4d75-8c48-cca2cc29c7ec) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:44.140512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:44.153411 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] Sync routers for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:44.174179 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:44.175255 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:44.247553 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:44.261080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:44.261971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:44.300254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:44.300718 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:44.302016 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2b8c167-bebd-4032-bbde-6de801b82361 None None] The sync data for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:44.303851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-307f3209-a430-4ffb-8b4a-67f41bcc8ff4 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/ports/5a58b8a4-59bc-40c9-9ab4-f19631577201 HTTP/1.1" status: 204 len: 168 time: 1.7055666 Dec 21 04:00:44.306530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:44.331139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:44.396078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-504396cd-d0a5-4262-96ff-38c9034a7dd1 req-395f70cd-70e9-4351-8445-3acb4699f504 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.2114968 Dec 21 04:00:44.476276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ca7b79b-fbfa-47df-b202-f22506241161 req-f4b91b47-74f8-4b91-a112-57091d8b2ce4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2903993 Dec 21 04:00:44.560217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39298) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:44.577562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc28c23-d118-4cae-aa6e-0fa060c4518e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:44.596340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:44.664278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:44.673706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:44.679958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:44.724640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event updated for resources: {'Port': ['ID=eb3478f5-4e96-4d75-8c48-cca2cc29c7ec,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:44.769762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:44.906669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e06ba303-a715-4bb3-b025-83150e545fdd,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:44.913710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Checking segment: {'id': '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:44.914102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Network hostable DHCP agents. Network: 9b632d49-bc8a-4f7d-b433-7c4b707a95a5, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:44.991212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Deleting port eb3478f5-4e96-4d75-8c48-cca2cc29c7ec {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:44.991565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.083237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:45.144585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.144894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.163878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Calling delete_port for eb3478f5-4e96-4d75-8c48-cca2cc29c7ec owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:45.244853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-19513d95-9aff-4509-b25e-1e08da54a608 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:45.246498 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-19513d95-9aff-4509-b25e-1e08da54a608 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.54 "GET /v2.0/networks?id=dd139785-bf85-4780-9c0a-38b01e520a12 HTTP/1.1" status: 200 len: 814 time: 0.2004075 Dec 21 04:00:45.278537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9b632d49-bc8a-4f7d-b433-7c4b707a95a5) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:45.285105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:45.285700 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.287400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Request body: {'port': {'device_id': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12', 'admin_state_up': True, 'tenant_id': 'b71c4b09f0c646bd944ad36662648bd8'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:45.296558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a8e4c54-ba18-47df-999b-d6689cd00deb None None] Network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:45.402143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc28c23-d118-4cae-aa6e-0fa060c4518e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.429127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-df81c9ff-9525-4884-872d-ac90eb5453e4 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.9060526 Dec 21 04:00:45.491501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfc28c23-d118-4cae-aa6e-0fa060c4518e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.495025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83813217-d25d-4b98-bbf3-5bf01e185424 None None] Network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:45.581236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ecf5915-804a-48b1-92ac-a04cd3b5d0ff req-6a5d17ea-c676-4292-91eb-2850a069318e tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.0518897 Dec 21 04:00:45.582868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.632414 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfc28c23-d118-4cae-aa6e-0fa060c4518e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=aa66026067ba40cabfc120f6a2fbefd3&name=default HTTP/1.1" status: 200 len: 3000 time: 1.0711782 Dec 21 04:00:45.633279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc28c23-d118-4cae-aa6e-0fa060c4518e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2674e956-dc0d-4653-a55a-dacaea21ff92,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:45.642757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39308) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:45.676212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Made reservation on behalf of b71c4b09f0c646bd944ad36662648bd8 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:45.679893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.709969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Port': ['ID=eb3478f5-4e96-4d75-8c48-cca2cc29c7ec,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:45.780321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c89e898-1ef0-4dee-9b94-fd332c10759e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.810421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c89e898-1ef0-4dee-9b94-fd332c10759e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.816501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81f2da6-68ce-49b6-b33c-b797180c1b62 req-a225de3d-bb2f-426a-99f6-a3f0ec7c3454 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:45.818925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c81f2da6-68ce-49b6-b33c-b797180c1b62 req-a225de3d-bb2f-426a-99f6-a3f0ec7c3454 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1221263 Dec 21 04:00:45.923865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c81f2da6-68ce-49b6-b33c-b797180c1b62 req-eb4494df-4e86-43c4-82cb-524decb158d3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0799148 Dec 21 04:00:45.967464 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] create failed (client error): The resource could not be found. Dec 21 04:00:45.974790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aea414e0-7e13-4066-89ae-22515f9eaa9a tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 2.6949928 Dec 21 04:00:45.975387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:45.980455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39316) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:46.063415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c89e898-1ef0-4dee-9b94-fd332c10759e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.065990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c89e898-1ef0-4dee-9b94-fd332c10759e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.069535 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9c89e898-1ef0-4dee-9b94-fd332c10759e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2674e956-dc0d-4653-a55a-dacaea21ff92 HTTP/1.1" status: 204 len: 168 time: 0.4234140 Dec 21 04:00:46.089118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Allocated IP 172.20.0.7 (dd139785-bf85-4780-9c0a-38b01e520a12/60c316de-0ab1-4b9b-a7f3-c62190d2ec1a/15378e61-cd11-4e9a-bac6-eb958f62a16e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:46.139873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c89e898-1ef0-4dee-9b94-fd332c10759e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2674e956-dc0d-4653-a55a-dacaea21ff92,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:46.365258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-8d2139dd-af61-4c27-86bb-20957324adf0 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:46.368090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-8d2139dd-af61-4c27-86bb-20957324adf0 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/networks?id=9b632d49-bc8a-4f7d-b433-7c4b707a95a5 HTTP/1.1" status: 200 len: 818 time: 0.2306054 Dec 21 04:00:46.392522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-5ca89550-9c74-4458-a174-56581a6fc158 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/quotas/3d5a6f8a2e664539a37470e2d2eb3477 HTTP/1.1" status: 200 len: 375 time: 0.0162945 Dec 21 04:00:46.444356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Deleting port 8c54b0ba-daf9-4d56-87c8-8eb5083bd340 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:46.444949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.501821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-aee3e949-ee57-453d-b0bb-b6158dba252c tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=3d5a6f8a2e664539a37470e2d2eb3477&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1015644 Dec 21 04:00:46.554054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.710535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.710535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Calling delete_port for 8c54b0ba-daf9-4d56-87c8-8eb5083bd340 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:46.712752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01dda688-5bae-4c6f-9707-d6a8ea96e640 req-6ce7b6e3-e54f-4f04-89d8-caf36998f857 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.0387175 Dec 21 04:00:46.869798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-2ebeafc1-5339-4cac-bd3b-92248dfc3fd5 service neutron] 10.222.0.18 "GET /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3661563 Dec 21 04:00:46.878301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port ca553f44-1f3e-43ba-8256-7491070887fe {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:46.878652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.914417 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:46.918660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-3bd314a4-512d-4b0c-a230-95f485c4f698 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:46.918660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-3bd314a4-512d-4b0c-a230-95f485c4f698 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1098 time: 0.0975459 Dec 21 04:00:47.029408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Network dd139785-bf85-4780-9c0a-38b01e520a12 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:47.038541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:47.046128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:47.057268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:47.064658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Pushing event updated for resources: {'Port': ['ID=15378e61-cd11-4e9a-bac6-eb958f62a16e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:47.099970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-30797fd4-4589-4a86-a059-f8a9f4d48363 service neutron] 10.222.0.18 "GET /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2292924 Dec 21 04:00:47.181304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Port': ['ID=8c54b0ba-daf9-4d56-87c8-8eb5083bd340,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:47.183015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-3747ae11-8b6e-4f8f-9be7-ff095831d1e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:47.184698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-3747ae11-8b6e-4f8f-9be7-ff095831d1e2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.2344477 Dec 21 04:00:47.259435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:47.272787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:47.273609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:47.284092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e899f5b9-3f96-4539-86e0-c136a7b695c7 req-a9c9cc45-228c-4ae7-86bc-e6e853569d9c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:47.285936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e899f5b9-3f96-4539-86e0-c136a7b695c7 req-a9c9cc45-228c-4ae7-86bc-e6e853569d9c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1914983 Dec 21 04:00:47.300458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-e096a326-335e-4b3a-a7b1-b47a1ae46df0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 1001 time: 0.0991600 Dec 21 04:00:47.338619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for ca553f44-1f3e-43ba-8256-7491070887fe owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:47.408314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-8a145177-d92e-4409-bea3-b0f477a83901 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:47.410838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-8a145177-d92e-4409-bea3-b0f477a83901 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0608728 Dec 21 04:00:47.423664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:47.429856 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ec69d78-3cb7-4b15-982e-31b93e9d30ea tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "DELETE /v2.0/ports/8c54b0ba-daf9-4d56-87c8-8eb5083bd340 HTTP/1.1" status: 204 len: 168 time: 1.4449618 Dec 21 04:00:47.432627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39352) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:47.452665 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-8ed57303-fcd6-4d3b-ae89-3d7e21a55e97 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1695712 Dec 21 04:00:47.513032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Request body: {'port': {'device_id': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:47.535076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e899f5b9-3f96-4539-86e0-c136a7b695c7 req-0efe301d-c76e-4ff0-8c9c-f3eed2e9788f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2315648 Dec 21 04:00:47.586426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-501c1a4d-48ce-4758-8bec-9ebc2d7cbb44 req-cade45a6-a9f0-402c-ba02-4efe0b875e58 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.1165137 Dec 21 04:00:47.625354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-ddb38b63-87ed-4c93-99fb-f8a810e9efe7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:47.627132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-ddb38b63-87ed-4c93-99fb-f8a810e9efe7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1561477 Dec 21 04:00:47.661280 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:47.707811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10db415f-7101-492b-9d7d-341813e7642b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:47.709368 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10db415f-7101-492b-9d7d-341813e7642b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "GET /v2.0/ports?device_id=f88d9c66-ce7e-4778-9634-764e233532a0 HTTP/1.1" status: 200 len: 913 time: 0.2744615 Dec 21 04:00:47.802926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39360) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:48.203986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:48.247414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=ca553f44-1f3e-43ba-8256-7491070887fe,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:48.362493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 15378e61-cd11-4e9a-bac6-eb958f62a16e {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:48.399743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:48.419902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Transition to ACTIVE for port object 15378e61-cd11-4e9a-bac6-eb958f62a16e will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:00:48.523707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:48.638080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28dfd4a6-fb44-4821-9862-55a896149533 req-e90d6d0a-2e9e-47cd-bce2-fc2f2a4f86ea tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:48.639694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28dfd4a6-fb44-4821-9862-55a896149533 req-e90d6d0a-2e9e-47cd-bce2-fc2f2a4f86ea tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 931 time: 0.8357816 Dec 21 04:00:48.646165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-9d556f77-2b2c-44a4-9ff4-de8576b528bc service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0099871 Dec 21 04:00:48.661547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Pushing event updated for resources: {'Port': ['ID=15378e61-cd11-4e9a-bac6-eb958f62a16e,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:48.841223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:48.888674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28dfd4a6-fb44-4821-9862-55a896149533 req-acc34545-22fc-4753-9fe8-1ae7b4d89f1a tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2348058 Dec 21 04:00:48.920506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d603fe45-1d67-4f6d-ae61-d1f7f711f659 req-705e77df-d45a-4a03-86e9-faff337ac03d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:48.922708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d603fe45-1d67-4f6d-ae61-d1f7f711f659 req-705e77df-d45a-4a03-86e9-faff337ac03d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1980381 Dec 21 04:00:48.966544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Attempting to bind port 15378e61-cd11-4e9a-bac6-eb958f62a16e on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:00:48.966946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Attempting to bind port 15378e61-cd11-4e9a-bac6-eb958f62a16e by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:00:48.967246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Attempting to bind port 15378e61-cd11-4e9a-bac6-eb958f62a16e on network dd139785-bf85-4780-9c0a-38b01e520a12 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:48.976755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Port 15378e61-cd11-4e9a-bac6-eb958f62a16e on network dd139785-bf85-4780-9c0a-38b01e520a12 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:00:48.977082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Attempting to bind port 15378e61-cd11-4e9a-bac6-eb958f62a16e on network dd139785-bf85-4780-9c0a-38b01e520a12 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:49.075705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aa6168d-6327-4fa4-8c42-0d5eaef23b45 req-921bedd2-58ea-42e1-aeb4-10d7f75ee83e tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.0743604 Dec 21 04:00:49.080636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b116ac8f-9fa0-48ef-a78e-3fe49f5cc18c req-9a3924e4-dba6-461c-8447-1d4fee2f1a97 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3971200 Dec 21 04:00:49.143662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d603fe45-1d67-4f6d-ae61-d1f7f711f659 req-5bc2fd6b-ee20-46b6-8438-db3298029efb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1977067 Dec 21 04:00:49.192525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:00:49.192865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Checking segment: {'id': '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:49.193258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Bound using segment: {'id': '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:00:49.194017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Bound port: 15378e61-cd11-4e9a-bac6-eb958f62a16e, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:00:49.194158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:49.319459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:49.419422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] For port 15378e61-cd11-4e9a-bac6-eb958f62a16e, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:00:49.424547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] For port 15378e61-cd11-4e9a-bac6-eb958f62a16e, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e,segment=NetworkSegment(8cb67e3a-d3f0-4c65-9e90-a7ae948c636c),segment_id=8cb67e3a-d3f0-4c65-9e90-a7ae948c636c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:00:49.426720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 649b6604-2a69-4e76-b8c4-46c6a60f8234 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:49.496174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:49.516571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-cf8dec25-afeb-4c3c-912a-0a8b164451a5 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.1414411 Dec 21 04:00:49.624171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:49.624171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:49.624171 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] 10.222.0.54 "PUT /v2.0/ports/15378e61-cd11-4e9a-bac6-eb958f62a16e HTTP/1.1" status: 200 len: 1092 time: 2.1106496 Dec 21 04:00:49.624171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'tag': '15378e61-cd11-4e9a-bac6-eb958f62a16e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:49.629043 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-988422fc-18b5-40ac-ac5f-9dfc16f96299" -d '{"events": [{"name": "network-changed", "server_uuid": "f6292bbc-0c60-428c-b64e-7c5838063968", "tag": "15378e61-cd11-4e9a-bac6-eb958f62a16e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:49.751791 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e6fa680-1dc4-4444-b1a6-10d6a3b551fd x-openstack-request-id: req-6e6fa680-1dc4-4444-b1a6-10d6a3b551fd {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:49.752923 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f6292bbc-0c60-428c-b64e-7c5838063968", "tag": "15378e61-cd11-4e9a-bac6-eb958f62a16e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:49.755800 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6e6fa680-1dc4-4444-b1a6-10d6a3b551fd {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:49.756424 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'tag': '15378e61-cd11-4e9a-bac6-eb958f62a16e', 'status': 'completed', 'code': 200} Dec 21 04:00:49.796895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Deleting port b9170a60-ea33-47a3-bdb2-3f7182bf92af {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:49.798736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:49.844919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e8ecf29-fa81-4c2e-b02e-23273b0148d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:49.857247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:49.872559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] Sync routers for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:49.876057 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-315d8d37-e1f4-448e-886c-d1a224603f56 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/routers/649b6604-2a69-4e76-b8c4-46c6a60f8234/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5628934 Dec 21 04:00:49.879455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39406) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:49.885215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:49.887342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:49.912951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcc135e-2cf0-4d49-9990-ecd1a9082109 service neutron] Pushing event updated for resources: {'Port': ['ID=15378e61-cd11-4e9a-bac6-eb958f62a16e,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:50.001033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:50.005317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:50.017358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] Routers {'649b6604-2a69-4e76-b8c4-46c6a60f8234'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:50.018443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['649b6604-2a69-4e76-b8c4-46c6a60f8234'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:50.062701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:50.063850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af0e2fb4-c1c6-4b34-872d-158a3e8a8452 None None] The sync data for ids ['649b6604-2a69-4e76-b8c4-46c6a60f8234'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:50.090665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Calling delete_port for b9170a60-ea33-47a3-bdb2-3f7182bf92af owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:50.300035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-f09485f2-dec4-40d6-8bc2-e8901cd3be2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.315357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-f09485f2-dec4-40d6-8bc2-e8901cd3be2e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=b71c4b09f0c646bd944ad36662648bd8&device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 1095 time: 0.3198266 Dec 21 04:00:50.317648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efe1ca57-4dae-49ec-a24f-666b5173a4c9 req-d7ff319f-d38b-4af9-9530-ad54473b14f6 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.1102057 Dec 21 04:00:50.501787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a7b331-f9b1-4b63-a88b-397bc0ed7a85 req-50fa1b05-1e5b-41c0-82f6-af6b2a9e6f4c tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.510731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00a7b331-f9b1-4b63-a88b-397bc0ed7a85 req-50fa1b05-1e5b-41c0-82f6-af6b2a9e6f4c tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 943 time: 0.4327872 Dec 21 04:00:50.548488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-88c993e7-eb31-4a01-9c61-9560f14e2dd5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e HTTP/1.1" status: 200 len: 217 time: 0.1732340 Dec 21 04:00:50.619381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.620391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.620981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.621479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.621949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.622628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.623267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.625448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-807a29f6-63da-403d-acc1-4744c8a10b67 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.8471358 Dec 21 04:00:50.712823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:50.756829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-893c2a70-d2f3-47b6-a81a-30db77af09fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.758493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-893c2a70-d2f3-47b6-a81a-30db77af09fd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=60c316de-0ab1-4b9b-a7f3-c62190d2ec1a HTTP/1.1" status: 200 len: 854 time: 0.1830680 Dec 21 04:00:50.768998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00a7b331-f9b1-4b63-a88b-397bc0ed7a85 req-caf6df39-b768-4d2c-bb7b-cc3c87f677ac tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2571554 Dec 21 04:00:50.790400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39422) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:50.876269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae1abf1c-d960-4c7e-b458-94390c671f75 req-9679e601-c6a6-4156-a5a1-e872b3197e16 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:50.883542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae1abf1c-d960-4c7e-b458-94390c671f75 req-9679e601-c6a6-4156-a5a1-e872b3197e16 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.3612685 Dec 21 04:00:50.891720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-d89cc230-3a62-40a3-be5a-2b6a810295ac service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=dd139785-bf85-4780-9c0a-38b01e520a12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0870724 Dec 21 04:00:50.973410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.001203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da6de815-e50e-45c3-92c8-629c86e168ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.043360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae1abf1c-d960-4c7e-b458-94390c671f75 req-1f40b346-3389-4d30-9da7-242b54a32607 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1588130 Dec 21 04:00:51.046513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.088710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Port': ['ID=b9170a60-ea33-47a3-bdb2-3f7182bf92af,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:51.136601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-49a4e9f0-cb69-4ad9-9ae7-ec3476b1b1d2 service neutron] 10.222.0.54 "GET /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2266026 Dec 21 04:00:51.143178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-4e2bba8b-ba26-4c9f-8dd8-f7471a873604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.143674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-4e2bba8b-ba26-4c9f-8dd8-f7471a873604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.144135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-4e2bba8b-ba26-4c9f-8dd8-f7471a873604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.145760 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-4e2bba8b-ba26-4c9f-8dd8-f7471a873604 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 2297 time: 0.3545170 Dec 21 04:00:51.230651 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-b12bbe47-c801-46e9-8888-3a16037bd0eb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 1001 time: 0.0748351 Dec 21 04:00:51.313143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a980bfaa-c205-4c32-ac18-d1dd7aedefdd req-cae9bfeb-baff-4790-92c0-32bd3dac2193 service neutron] 10.222.0.54 "GET /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1756144 Dec 21 04:00:51.355077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-3c970243-453e-43da-ad02-b8564ad24411 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.357233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-3c970243-453e-43da-ad02-b8564ad24411 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.1049547 Dec 21 04:00:51.362750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 72ffcd8d-1ec9-4e31-9299-9387879ead92 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:51.363125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.376978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da6de815-e50e-45c3-92c8-629c86e168ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.478108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da6de815-e50e-45c3-92c8-629c86e168ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.509738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-c61280dd-d1b7-4ad0-bd5a-3fdde6c0166c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.511303 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-c61280dd-d1b7-4ad0-bd5a-3fdde6c0166c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1447294 Dec 21 04:00:51.561477 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba386e2b-0699-4cc5-a3f8-edc9bca22ae0 req-cb541fed-4af6-4c33-9aa8-0edfb254c3c2 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.0753286 Dec 21 04:00:51.630144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-da6de815-e50e-45c3-92c8-629c86e168ba admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d7c742f69063460780489ce528591d77&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8375401 Dec 21 04:00:51.630918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:51.642263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6de815-e50e-45c3-92c8-629c86e168ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=445f86aa-aaeb-4ed9-ab43-3c2787eec6b7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:51.660749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.698582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 72ffcd8d-1ec9-4e31-9299-9387879ead92 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:51.704932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-5fff2fe7-d518-4b3d-9524-a0bbf49344b4 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.706501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-5fff2fe7-d518-4b3d-9524-a0bbf49344b4 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.31 "GET /v2.0/networks?id=9b632d49-bc8a-4f7d-b433-7c4b707a95a5 HTTP/1.1" status: 200 len: 818 time: 0.1413534 Dec 21 04:00:51.709040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.804361 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-28d6135b-bf63-47ef-aa19-35d33287b476 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2719157 Dec 21 04:00:51.805108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Request body: {'port': {'device_id': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5', 'admin_state_up': True, 'tenant_id': '3d5a6f8a2e664539a37470e2d2eb3477'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:51.838672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-f0a7df26-750c-478e-8ae0-74cf873dde2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:51.839906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-f0a7df26-750c-478e-8ae0-74cf873dde2a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=b71c4b09f0c646bd944ad36662648bd8&device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 1095 time: 0.3554077 Dec 21 04:00:51.943962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aebe7e1e-5d4f-40f4-b9c9-81bd7334bf26 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:51.989698 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-c3078716-317f-4882-990c-c3fc39d8c970 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1732440 Dec 21 04:00:52.031664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aebe7e1e-5d4f-40f4-b9c9-81bd7334bf26 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.106347 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-216e4bec-cb2e-4c74-8077-ead3ac2dd152 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.83&port_id=bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 217 time: 0.0790246 Dec 21 04:00:52.225564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-db7526cc-39b6-4f18-bb5e-73759377dc50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:52.227112 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-db7526cc-39b6-4f18-bb5e-73759377dc50 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.1130605 Dec 21 04:00:52.286602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aebe7e1e-5d4f-40f4-b9c9-81bd7334bf26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.289258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aebe7e1e-5d4f-40f4-b9c9-81bd7334bf26 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.290955 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aebe7e1e-5d4f-40f4-b9c9-81bd7334bf26 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/445f86aa-aaeb-4ed9-ab43-3c2787eec6b7 HTTP/1.1" status: 204 len: 168 time: 0.6547806 Dec 21 04:00:52.300168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-24cf41c7-66e7-4263-9646-90e9cb826195 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:52.301700 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-24cf41c7-66e7-4263-9646-90e9cb826195 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0650249 Dec 21 04:00:52.307340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aebe7e1e-5d4f-40f4-b9c9-81bd7334bf26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=445f86aa-aaeb-4ed9-ab43-3c2787eec6b7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:52.341468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.415715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=72ffcd8d-1ec9-4e31-9299-9387879ead92,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:52.430896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a841984a-67ab-43ac-9f07-b3c04bb59458 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:52.505708 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-6c0adf97-6990-4928-90c8-35c68fd94a61 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1958292 Dec 21 04:00:52.512364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.668354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a614f6f1-798e-414f-a8bf-08c5d7441bc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.682189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.691609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.693115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Router f88d9c66-ce7e-4778-9634-764e233532a0 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:00:52.709182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87fb75e3-78fc-4b99-9f38-5147cb12a76e req-e6918c30-7450-4011-a45c-828ef8dfbebe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:52.717711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87fb75e3-78fc-4b99-9f38-5147cb12a76e req-e6918c30-7450-4011-a45c-828ef8dfbebe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.3058670 Dec 21 04:00:52.736464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-fc38bed1-f132-430b-803e-fb9c20c91826 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:52.738027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-fc38bed1-f132-430b-803e-fb9c20c91826 service neutron] 10.222.0.54 "GET /v2.0/networks?id=dd139785-bf85-4780-9c0a-38b01e520a12 HTTP/1.1" status: 200 len: 915 time: 0.8663135 Dec 21 04:00:52.762107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1aa636-e74f-406c-b7a0-367a02c5f549 req-7982b5df-dedb-4a08-8d46-808de4bb335b tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:52.769816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1aa636-e74f-406c-b7a0-367a02c5f549 req-7982b5df-dedb-4a08-8d46-808de4bb335b tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 943 time: 0.8517261 Dec 21 04:00:52.771852 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.781709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-abef7db5-8245-4898-bbd2-6f1d2cb9d1b4 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2652407 Dec 21 04:00:52.839065 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-a37dc8f2-8ca4-4f10-8562-09073c9ce996 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.54&port_id=c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 217 time: 0.0502670 Dec 21 04:00:52.840555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.841181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Fanout notify agent at l3_agent the message router_deleted on router 649b6604-2a69-4e76-b8c4-46c6a60f8234 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:00:52.851795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:52.855503 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7daf4ba-b2db-4894-a736-9e593726f842 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/routers/649b6604-2a69-4e76-b8c4-46c6a60f8234 HTTP/1.1" status: 204 len: 168 time: 2.9660423 Dec 21 04:00:52.863852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39442) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:52.874339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-81799b5e-875d-4225-bbeb-bab70d568d5a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e HTTP/1.1" status: 200 len: 217 time: 0.1255264 Dec 21 04:00:52.924224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87fb75e3-78fc-4b99-9f38-5147cb12a76e req-938bf797-e4c1-4a5b-9f48-fe0267aea264 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2048512 Dec 21 04:00:52.950225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-730c19e7-e82f-469f-8242-85cdf7208748 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:52.951952 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-730c19e7-e82f-469f-8242-85cdf7208748 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0959778 Dec 21 04:00:52.976152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting subnet 8e31861c-cb69-47e1-85ed-50d0c1d47157 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:00:52.993952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.021015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:00:53.027191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cb5494cd-253d-4e29-8505-03cff82a2ae6 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "PUT /v2.0/routers/f88d9c66-ce7e-4778-9634-764e233532a0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2213688 Dec 21 04:00:53.030568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39446) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:53.034052 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] Sync routers for ids ['f88d9c66-ce7e-4778-9634-764e233532a0'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:00:53.045543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] Routers {'f88d9c66-ce7e-4778-9634-764e233532a0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:53.047373 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f88d9c66-ce7e-4778-9634-764e233532a0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:53.070449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59baa146-23df-4e7d-a0a0-0a97d56f00be req-6eba96e8-2594-4858-b387-0676180b45a1 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.0638812 Dec 21 04:00:53.081235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1aa636-e74f-406c-b7a0-367a02c5f549 req-29a174bc-d87a-4cdd-b44e-889ea13f7c1d tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3104453 Dec 21 04:00:53.098115 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:53.098343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.102429 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] Routers {'f88d9c66-ce7e-4778-9634-764e233532a0'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:00:53.103062 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f88d9c66-ce7e-4778-9634-764e233532a0'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:53.108735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-7a951b90-83d6-4666-be07-a2936254a7e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:53.111181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-7a951b90-83d6-4666-be07-a2936254a7e8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=60c316de-0ab1-4b9b-a7f3-c62190d2ec1a HTTP/1.1" status: 200 len: 854 time: 0.1924376 Dec 21 04:00:53.129024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-1eb41e2e-9456-4fdf-bf12-44e0f7ce830b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:53.130576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-1eb41e2e-9456-4fdf-bf12-44e0f7ce830b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1704409 Dec 21 04:00:53.150452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-cadbce26-ffdd-4ea0-8ee2-0de0a6cead5c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=dd139785-bf85-4780-9c0a-38b01e520a12&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0321102 Dec 21 04:00:53.152167 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:53.152869 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e192a53-2e14-427a-b203-55502bac0436 None None] The sync data for ids ['f88d9c66-ce7e-4778-9634-764e233532a0'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:00:53.199064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.252275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-6261f12d-e4a5-4949-9277-90031b1fa2e7 service neutron] 10.222.0.54 "GET /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931087 Dec 21 04:00:53.358455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988422fc-18b5-40ac-ac5f-9dfc16f96299 req-29ffc8b4-e343-4821-a59f-b2e2d81d21e0 service neutron] 10.222.0.54 "GET /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971217 Dec 21 04:00:53.446024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Made reservation on behalf of 3d5a6f8a2e664539a37470e2d2eb3477 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:53.449643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.463344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.497096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.502252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.504264 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.533470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-f588d24f-bb93-42db-a7e4-616eb2cef8f1 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3657458 Dec 21 04:00:53.641366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:53.663554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7ae0b58-fc28-425f-b089-bd870fc51379 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.705725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Allocated IP 172.20.0.12 (9b632d49-bc8a-4f7d-b433-7c4b707a95a5/e06ba303-a715-4bb3-b025-83150e545fdd/408499a9-a6b4-445d-96c5-773432a9bd6d) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:00:53.731479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 15378e61-cd11-4e9a-bac6-eb958f62a16e details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:00:53.855662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 15378e61-cd11-4e9a-bac6-eb958f62a16e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e,segment=NetworkSegment(8cb67e3a-d3f0-4c65-9e90-a7ae948c636c),segment_id=8cb67e3a-d3f0-4c65-9e90-a7ae948c636c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:53.862692 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7ae0b58-fc28-425f-b089-bd870fc51379 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.871317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '15378e61-cd11-4e9a-bac6-eb958f62a16e', 'network_id': 'dd139785-bf85-4780-9c0a-38b01e520a12', 'port_id': '15378e61-cd11-4e9a-bac6-eb958f62a16e', 'mac_address': 'fa:16:3e:36:e1:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '60c316de-0ab1-4b9b-a7f3-c62190d2ec1a', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:00:53.917868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.934921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15378e61-cd11-4e9a-bac6-eb958f62a16e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:53.941869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7ae0b58-fc28-425f-b089-bd870fc51379 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:53.961810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 15378e61-cd11-4e9a-bac6-eb958f62a16e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e,segment=NetworkSegment(8cb67e3a-d3f0-4c65-9e90-a7ae948c636c),segment_id=8cb67e3a-d3f0-4c65-9e90-a7ae948c636c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:54.012073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.015168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.028608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e7ae0b58-fc28-425f-b089-bd870fc51379 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7b0732ab36cd466787d83c53d9602d87&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3857915 Dec 21 04:00:54.029718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39456) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:54.074604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=15378e61-cd11-4e9a-bac6-eb958f62a16e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:54.125737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7ae0b58-fc28-425f-b089-bd870fc51379 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a51b5a4c-c747-45a5-a438-ff698925720e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:54.159347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.159966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Fanout notify agent at l3_agent the message router_deleted on router f88d9c66-ce7e-4778-9634-764e233532a0 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:00:54.178895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.178895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e21e4be-dfbf-49ab-884e-5cfad86c2202 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "DELETE /v2.0/routers/f88d9c66-ce7e-4778-9634-764e233532a0 HTTP/1.1" status: 204 len: 168 time: 1.1414270 Dec 21 04:00:54.180188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39462) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:54.207838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d74f090d-2da8-456c-83e9-59584e995f7f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.213358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-e0636b0d-fb56-4edf-bf9c-2b27d81501bc service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6447737 Dec 21 04:00:54.243109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d74f090d-2da8-456c-83e9-59584e995f7f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.282329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-aa111eb6-c6aa-4dc9-8f8c-87e4896e0060 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.84&port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 217 time: 0.0576065 Dec 21 04:00:54.284056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.322639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a968fb8f-6a19-4340-b4d9-9b95a92508ab req-08ca2a3a-baec-4320-9399-88c44e3daeff tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:54.324244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a968fb8f-6a19-4340-b4d9-9b95a92508ab req-08ca2a3a-baec-4320-9399-88c44e3daeff tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.2273195 Dec 21 04:00:54.339778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['15378e61-cd11-4e9a-bac6-eb958f62a16e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:00:54.342842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.356613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.360290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/subnets/8e31861c-cb69-47e1-85ed-50d0c1d47157 HTTP/1.1" status: 204 len: 168 time: 1.4953177 Dec 21 04:00:54.363371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c913af6-5776-4152-8ead-6b9e58b567aa tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Subnet': ['ID=8e31861c-cb69-47e1-85ed-50d0c1d47157,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:54.365517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce6e5429-0ed3-4945-9640-ba5f779d674d None None] Network cfbd9fb5-0ac1-4ccd-943f-03a73276db45 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:54.368852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39466) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:54.446423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:00:54.455274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-ed0b4265-beba-46d4-83e8-befe30d38391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:54.457064 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-ed0b4265-beba-46d4-83e8-befe30d38391 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.1665773 Dec 21 04:00:54.461323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:54.475869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:00:54.484711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Deleting subnet f50ae046-3f9a-49cd-bcee-16ad67535f64 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:00:54.487152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.500650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d74f090d-2da8-456c-83e9-59584e995f7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.504019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d74f090d-2da8-456c-83e9-59584e995f7f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.505464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d74f090d-2da8-456c-83e9-59584e995f7f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a51b5a4c-c747-45a5-a438-ff698925720e HTTP/1.1" status: 204 len: 168 time: 0.4681699 Dec 21 04:00:54.510016 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.573821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-2c856648-112a-498d-873e-16132eb84d27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:54.575511 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-2c856648-112a-498d-873e-16132eb84d27 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1054327 Dec 21 04:00:54.610714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585c78ef-b85b-4c0c-b567-2d7ce229c11b req-7dc6b3de-82bb-4b84-8610-fa3529c9d9ac tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:54.618739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-585c78ef-b85b-4c0c-b567-2d7ce229c11b req-7dc6b3de-82bb-4b84-8610-fa3529c9d9ac tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 944 time: 0.4420416 Dec 21 04:00:54.633674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] DHCP port deletion for cfbd9fb5-0ac1-4ccd-943f-03a73276db45 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:54.702131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Pushing event updated for resources: {'Port': ['ID=408499a9-a6b4-445d-96c5-773432a9bd6d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:54.714540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d74f090d-2da8-456c-83e9-59584e995f7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a51b5a4c-c747-45a5-a438-ff698925720e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:54.715238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] Deleting port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:54.715631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.717810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:54.729622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a968fb8f-6a19-4340-b4d9-9b95a92508ab req-7c4f59c7-4747-44b0-b7c9-3c6f46b86528 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3928063 Dec 21 04:00:54.760657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.763601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:54.764332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.832897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-585c78ef-b85b-4c0c-b567-2d7ce229c11b req-c7d58879-5cdb-4ca5-bd86-ac68c727cc4d tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2073059 Dec 21 04:00:54.846926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:54.847765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.877850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-3d2cafc7-28a6-496a-8ec4-ef1355d94497 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.0771623 Dec 21 04:00:54.896245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] For port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,segment=NetworkSegment(2b457473-707a-4333-a961-9622371d5192),segment_id=2b457473-707a-4333-a961-9622371d5192)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:54.897370 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.906533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.920800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] Calling delete_port for 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:54.977471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,segment=NetworkSegment(2b457473-707a-4333-a961-9622371d5192),segment_id=2b457473-707a-4333-a961-9622371d5192)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:54.979991 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-d856773b-52d4-490e-af6b-707c6c08f707 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3927019 Dec 21 04:00:54.982309 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:54.989970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Request body: {'port': {'device_id': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:54.990764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] For port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,segment=NetworkSegment(2b457473-707a-4333-a961-9622371d5192),segment_id=2b457473-707a-4333-a961-9622371d5192)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:54.991178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.029957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:55.076108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.130631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.152481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4139258f-cc4c-4256-ba0c-958908d2fc43 req-2d46ca9e-b02b-46e9-8a0d-45faa88d67ab tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:55.153995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4139258f-cc4c-4256-ba0c-958908d2fc43 req-2d46ca9e-b02b-46e9-8a0d-45faa88d67ab tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 932 time: 0.1612244 Dec 21 04:00:55.159028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-5b9277a6-8adb-424b-acfd-51d16ceb91e4 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1705899 Dec 21 04:00:55.166635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.206363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-db02e74a-985b-45e8-9109-8cc3f71e3a8b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.56&port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 217 time: 0.0358629 Dec 21 04:00:55.225713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.253092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4139258f-cc4c-4256-ba0c-958908d2fc43 req-c91e14b5-393f-48fe-b889-5113c271a7eb tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900311 Dec 21 04:00:55.277926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-5382f76d-915c-40ff-a621-ed0dc98da097 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:55.279699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-5382f76d-915c-40ff-a621-ed0dc98da097 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0668185 Dec 21 04:00:55.290365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:55.302065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.341624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-cacf1dca-6e36-48a9-87cc-dd6319c271c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:55.344231 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.344641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Subnet': ['ID=f50ae046-3f9a-49cd-bcee-16ad67535f64,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:55.356568 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.363525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-81dda2c0-ef49-4f19-8622-ad4ca365d32b tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "DELETE /v2.0/subnets/f50ae046-3f9a-49cd-bcee-16ad67535f64 HTTP/1.1" status: 204 len: 168 time: 1.1764784 Dec 21 04:00:55.363782 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-cacf1dca-6e36-48a9-87cc-dd6319c271c5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0758853 Dec 21 04:00:55.366835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:55.376840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.392018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] Pushing event deleted for resources: {'Port': ['ID=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:55.399815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] No DVR routers for this DVR port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:55.407750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9365e58d-ad0f-49af-855f-8ed80da57033 None None] Network 100c2ed1-1a24-401c-bc8a-983d93f68d17 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:55.439406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4acc19d8-1c18-4d1e-b084-315eb811e445 None None] No DVR routers for this DVR port 89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:55.440557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=89b67f9f-10ed-4ac5-b6ac-cca1e56e36cc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:55.520906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.540951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.541328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.541600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.541939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.542268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.542599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.542948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.543284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.543615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.543942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.544267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.544595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.544919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:00:55.603102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.630493 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-e5c56f85-9e99-4958-8245-19aa82384e7e service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2447453 Dec 21 04:00:55.634261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cfbd9fb5-0ac1-4ccd-943f-03a73276db45']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:55.668189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 408499a9-a6b4-445d-96c5-773432a9bd6d {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:00:55.673506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b457473-707a-4333-a961-9622371d5192') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:55.673817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b457473-707a-4333-a961-9622371d5192') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:55.677920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.687449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Deleting port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:55.687449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.696615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.700724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] DHCP port deletion for 100c2ed1-1a24-401c-bc8a-983d93f68d17 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:00:55.715094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Transition to ACTIVE for port object 408499a9-a6b4-445d-96c5-773432a9bd6d will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:00:55.733420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 15378e61-cd11-4e9a-bac6-eb958f62a16e up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:00:55.740735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.750418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:00:55.750814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:55.754314 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:00:55.757421 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:00:55.769450 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.780365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] For port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,segment=NetworkSegment(a1cfb818-f14c-4bb9-9764-1c8f0752cc08),segment_id=a1cfb818-f14c-4bb9-9764-1c8f0752cc08)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:55.781587 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.802724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Calling delete_port for c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:55.824604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.825874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-1f963d36-1e14-4708-85a4-48a1fc8f3c94 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1842310 Dec 21 04:00:55.830725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] Deleting port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:55.830725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.899567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.902730 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-f696b1a7-73bc-4fae-b74d-d8eec7524e09 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 217 time: 0.0694053 Dec 21 04:00:55.910905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.916561 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/networks/cfbd9fb5-0ac1-4ccd-943f-03a73276db45 HTTP/1.1" status: 204 len: 168 time: 1.5404215 Dec 21 04:00:55.931132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39496) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:55.931307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] For port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,segment=NetworkSegment(a1cfb818-f14c-4bb9-9764-1c8f0752cc08),segment_id=a1cfb818-f14c-4bb9-9764-1c8f0752cc08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:55.931792 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:55.938997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affa12fa-108c-4cbb-b855-90f14482d8ef tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Network': ['ID=cfbd9fb5-0ac1-4ccd-943f-03a73276db45,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:55.951635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] Calling delete_port for c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:55.954080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 15378e61-cd11-4e9a-bac6-eb958f62a16e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:00:55.965898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 15378e61-cd11-4e9a-bac6-eb958f62a16e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:00:55.966511 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.059412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-37a17bf7-f2ad-4d28-aa0e-ae382cd01edb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.060895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-37a17bf7-f2ad-4d28-aa0e-ae382cd01edb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.1372516 Dec 21 04:00:56.137447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Pushing event updated for resources: {'Port': ['ID=408499a9-a6b4-445d-96c5-773432a9bd6d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:56.157809 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.161502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-56c806a8-3a55-4648-a9ae-70f168e62ab8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.163447 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-56c806a8-3a55-4648-a9ae-70f168e62ab8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0807455 Dec 21 04:00:56.166537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 3947bd5c-ff8f-4f37-93a5-319542a6d285 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:56.167359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.178130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd217508-cc12-433f-a80c-eeead8c24461 req-4d85ee1a-0809-45e7-ab9e-70967c2bd19a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.185539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd217508-cc12-433f-a80c-eeead8c24461 req-4d85ee1a-0809-45e7-ab9e-70967c2bd19a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.3177557 Dec 21 04:00:56.215801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa03085-09da-4efc-9015-31477bb0f772 req-6d7d1715-7d02-45f9-821b-57473c600781 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.217400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2aa03085-09da-4efc-9015-31477bb0f772 req-6d7d1715-7d02-45f9-821b-57473c600781 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 944 time: 0.2608061 Dec 21 04:00:56.218163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Attempting to bind port 408499a9-a6b4-445d-96c5-773432a9bd6d on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:00:56.218508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Attempting to bind port 408499a9-a6b4-445d-96c5-773432a9bd6d by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:00:56.218835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Attempting to bind port 408499a9-a6b4-445d-96c5-773432a9bd6d on network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:56.236986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] Pushing event deleted for resources: {'Port': ['ID=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:56.238959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.251992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Port 408499a9-a6b4-445d-96c5-773432a9bd6d on network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:00:56.252320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Attempting to bind port 408499a9-a6b4-445d-96c5-773432a9bd6d on network 9b632d49-bc8a-4f7d-b433-7c4b707a95a5 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:00:56.258768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea1784cb-652e-4c7e-b131-282ee71508e3 None None] No DVR routers for this DVR port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:56.259002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.280355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:00:56.280744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Checking segment: {'id': '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:56.281466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Bound using segment: {'id': '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:00:56.281723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Bound port: 408499a9-a6b4-445d-96c5-773432a9bd6d, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:00:56.281914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.328633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.328633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.346902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-9c170ebd-5f4e-4a67-93c8-2125ae5fdee0 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1755409 Dec 21 04:00:56.350910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 3947bd5c-ff8f-4f37-93a5-319542a6d285 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:56.352419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15378e61-cd11-4e9a-bac6-eb958f62a16e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:56.354838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] No DVR routers for this DVR port c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:00:56.364129 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b12a0a1a-b75c-4ee9-8e1c-82c7607e8641" -d '{"events": [{"server_uuid": "f6292bbc-0c60-428c-b64e-7c5838063968", "name": "network-vif-plugged", "status": "completed", "tag": "15378e61-cd11-4e9a-bac6-eb958f62a16e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:56.368375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Port': ['ID=c0cbe881-926c-4b7f-9aa2-16aa1cee8e65,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:56.375375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 15378e61-cd11-4e9a-bac6-eb958f62a16e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e,segment=NetworkSegment(8cb67e3a-d3f0-4c65-9e90-a7ae948c636c),segment_id=8cb67e3a-d3f0-4c65-9e90-a7ae948c636c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:00:56.407497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd217508-cc12-433f-a80c-eeead8c24461 req-6369d23a-f6a5-499d-b311-2577a1a04fb3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2210383 Dec 21 04:00:56.413352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:56.426814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2aa03085-09da-4efc-9015-31477bb0f772 req-5c5fdefb-becf-43b0-aa79-427444885304 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1915076 Dec 21 04:00:56.435938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.532382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.546104 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-11950f6b-bba6-4835-bf59-82fd7e1cec14 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1814411 Dec 21 04:00:56.570802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['100c2ed1-1a24-401c-bc8a-983d93f68d17']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:56.574484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] For port 408499a9-a6b4-445d-96c5-773432a9bd6d, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:00:56.575137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=15378e61-cd11-4e9a-bac6-eb958f62a16e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:56.603528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] For port 408499a9-a6b4-445d-96c5-773432a9bd6d, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=408499a9-a6b4-445d-96c5-773432a9bd6d,segment=NetworkSegment(9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4),segment_id=9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:00:56.641655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:56.641655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a1cfb818-f14c-4bb9-9764-1c8f0752cc08') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:00:56.655422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.665381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-5ca5aa34-b3c4-4c06-9fd5-246b147ab97b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0889916 Dec 21 04:00:56.671904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1721612854-network', 'tenant_id': '890fa4dd6439485583f4cba0fdc68fad'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:56.695952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.718952 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1c0198c8-eff1-40f8-9a08-78abdb06bd41 x-openstack-request-id: req-1c0198c8-eff1-40f8-9a08-78abdb06bd41 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:56.720253 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f6292bbc-0c60-428c-b64e-7c5838063968", "name": "network-vif-plugged", "status": "completed", "tag": "15378e61-cd11-4e9a-bac6-eb958f62a16e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:56.720846 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1c0198c8-eff1-40f8-9a08-78abdb06bd41 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:56.721531 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15378e61-cd11-4e9a-bac6-eb958f62a16e', 'code': 200} Dec 21 04:00:56.735120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-6e956886-0feb-4781-ae55-198e57e8c9fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.736966 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-6e956886-0feb-4781-ae55-198e57e8c9fe service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0639603 Dec 21 04:00:56.737255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.745278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.745922 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.748109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] 10.222.0.31 "PUT /v2.0/ports/408499a9-a6b4-445d-96c5-773432a9bd6d HTTP/1.1" status: 200 len: 1093 time: 1.7641582 Dec 21 04:00:56.757563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:00:56.780428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'tag': '408499a9-a6b4-445d-96c5-773432a9bd6d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:00:56.783257 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-961bcf77-54ab-4dd8-a596-cc10d6f17b92" -d '{"events": [{"name": "network-changed", "server_uuid": "0bafc7e8-8562-442e-952d-0820fcd0efbc", "tag": "408499a9-a6b4-445d-96c5-773432a9bd6d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:00:56.787932 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.804565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Releasing vlan 117 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:00:56.804994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.806440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:00:56.806803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0cbe881-926c-4b7f-9aa2-16aa1cee8e65 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:00:56.823256 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:00:56.827842 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:00:56.836954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=3947bd5c-ff8f-4f37-93a5-319542a6d285,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:56.848866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5f4829-85c6-4f44-af7d-571c9db170b1 req-105c3376-787c-4163-b965-69f4c7f75645 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.850535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f5f4829-85c6-4f44-af7d-571c9db170b1 req-105c3376-787c-4163-b965-69f4c7f75645 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 944 time: 0.2519536 Dec 21 04:00:56.853179 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:00:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d670cc2-6535-4a30-aec1-424bdd43a7ea x-openstack-request-id: req-7d670cc2-6535-4a30-aec1-424bdd43a7ea {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:00:56.853468 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0bafc7e8-8562-442e-952d-0820fcd0efbc", "tag": "408499a9-a6b4-445d-96c5-773432a9bd6d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:00:56.853722 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7d670cc2-6535-4a30-aec1-424bdd43a7ea {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:00:56.854105 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'tag': '408499a9-a6b4-445d-96c5-773432a9bd6d', 'status': 'completed', 'code': 200} Dec 21 04:00:56.889392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-f5b6a093-30b6-471b-8edb-537d4861675b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:56.890501 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-f5b6a093-30b6-471b-8edb-537d4861675b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1348314 Dec 21 04:00:56.935660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.938831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:56.944202 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc687fa9-2710-42fb-b533-ea567419ae27 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/floatingips/5659ccfb-9459-4024-a870-5fc2ef6ef204 HTTP/1.1" status: 204 len: 168 time: 1.0079651 Dec 21 04:00:56.968995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39530) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.005901 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-036bee39-d428-448d-83ee-469f572aad5b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] DELETE failed (client error): The resource could not be found. Dec 21 04:00:57.006295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-036bee39-d428-448d-83ee-469f572aad5b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:00:57.009904 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-036bee39-d428-448d-83ee-469f572aad5b tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/ports/5a58b8a4-59bc-40c9-9ab4-f19631577201 HTTP/1.1" status: 404 len: 333 time: 0.0395193 Dec 21 04:00:57.010114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Made reservation on behalf of 890fa4dd6439485583f4cba0fdc68fad for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:57.012166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39536) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.012339 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.036301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c0a587-a2c4-4f47-b3a0-52d4629e86c0 service neutron] Pushing event updated for resources: {'Port': ['ID=408499a9-a6b4-445d-96c5-773432a9bd6d,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:57.047487 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-03cb26b8-e044-4a9e-83db-f01524ee5f3d tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/ports?device_id=649b6604-2a69-4e76-b8c4-46c6a60f8234 HTTP/1.1" status: 200 len: 205 time: 0.0306952 Dec 21 04:00:57.047487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39538) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.056272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.079400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145e2611-079d-40b8-8d0a-46d9d1449a02 req-37fb9f9f-0206-422a-ac71-8584d6819688 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:57.080931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145e2611-079d-40b8-8d0a-46d9d1449a02 req-37fb9f9f-0206-422a-ac71-8584d6819688 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 1097 time: 0.2294180 Dec 21 04:00:57.086198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f5f4829-85c6-4f44-af7d-571c9db170b1 req-0c4aa534-8d12-4826-84c1-b379bf467a96 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2074625 Dec 21 04:00:57.090869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-8d91d84b-4e77-4962-a04e-ee3d75512f7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:57.091027 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-97fece46-5a4d-41f1-bab4-24f06f2052ff tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] delete failed (client error): The resource could not be found. Dec 21 04:00:57.092181 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-97fece46-5a4d-41f1-bab4-24f06f2052ff tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/routers/649b6604-2a69-4e76-b8c4-46c6a60f8234 HTTP/1.1" status: 404 len: 336 time: 0.0440888 Dec 21 04:00:57.093723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-8d91d84b-4e77-4962-a04e-ee3d75512f7b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3d5a6f8a2e664539a37470e2d2eb3477&device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 1096 time: 0.2013292 Dec 21 04:00:57.093723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.099937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39540) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.107194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.116479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-4f4281a6-6049-4709-b696-348ee0a46cc9 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2174623 Dec 21 04:00:57.119517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] 10.222.0.18 "DELETE /v2.0/networks/100c2ed1-1a24-401c-bc8a-983d93f68d17 HTTP/1.1" status: 204 len: 168 time: 1.7430644 Dec 21 04:00:57.216938 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f2b4c54-ec39-44e9-bfb0-e69f2ce97d03 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] DELETE failed (client error): The resource could not be found. Dec 21 04:00:57.217414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f2b4c54-ec39-44e9-bfb0-e69f2ce97d03 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:00:57.219395 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9df324e3-8b77-4b07-972b-44a6371d43d0 req-cc21fd9e-eeec-4423-b5e8-17731eeddd29 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955770 Dec 21 04:00:57.221016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f2b4c54-ec39-44e9-bfb0-e69f2ce97d03 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/subnets/8e31861c-cb69-47e1-85ed-50d0c1d47157 HTTP/1.1" status: 404 len: 337 time: 0.0996523 Dec 21 04:00:57.223741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39550) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.225256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f548491d-4b72-4726-b921-6d203cc4ed39 tempest-FloatingIPNegativeTestJSON-298780137 tempest-FloatingIPNegativeTestJSON-298780137-project] Pushing event deleted for resources: {'Network': ['ID=100c2ed1-1a24-401c-bc8a-983d93f68d17,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:57.237646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-d99ff5e4-5eab-470d-959d-c3d283fb62b1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=408499a9-a6b4-445d-96c5-773432a9bd6d HTTP/1.1" status: 200 len: 217 time: 0.0996373 Dec 21 04:00:57.305704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-145e2611-079d-40b8-8d0a-46d9d1449a02 req-d6058678-87cd-4253-997c-f1339442c0a0 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2069049 Dec 21 04:00:57.320167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 4621144f-6a4e-4ade-9095-b7670b2a7c5e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:57.320556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.323575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf192791-254f-430c-82d3-12c377f29e2e req-e1271343-18ad-4f15-8086-93ee14196ab6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:57.325690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-e1271343-18ad-4f15-8086-93ee14196ab6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e06ba303-a715-4bb3-b025-83150e545fdd HTTP/1.1" status: 200 len: 858 time: 0.0773549 Dec 21 04:00:57.353230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.372116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-1400c741-b75a-4764-a46d-7489cf6891c5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b632d49-bc8a-4f7d-b433-7c4b707a95a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316207 Dec 21 04:00:57.419206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.433182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 4621144f-6a4e-4ade-9095-b7670b2a7c5e owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:57.607944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39574) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.663729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.697627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=4621144f-6a4e-4ade-9095-b7670b2a7c5e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:57.770872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.789971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.793210 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6cf724d5-3811-41f3-99d9-a2c0a035f1d7 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/ports/4621144f-6a4e-4ade-9095-b7670b2a7c5e HTTP/1.1" status: 204 len: 168 time: 0.5686083 Dec 21 04:00:57.797829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.814220 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f3dc622e-1f1f-4acc-94c3-57a693ebe56f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a9aa6792b34747699c1b2a69d01b881f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2021182 Dec 21 04:00:57.819868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39582) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:57.851415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:00:57.903264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0902178c-4996-4a9f-bda7-965644083eb2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:57.909002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.909320 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Added segment 8250d715-d626-4ee8-89bc-d342f729f8bf of type vlan for network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 Dec 21 04:00:57.909779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 8724c5e8-a356-400c-98e3-ca3d4f7b5252 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:57.912092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:57.939134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-b03bd130-df67-48a4-a3a9-23e769fed930 service neutron] 10.222.0.31 "GET /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5558326 Dec 21 04:00:57.975757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d791f3-3618-41d5-9c62-0cf6e17d8330 req-5cd37469-90cf-475c-9238-d5eee741de39 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:57.977233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63d791f3-3618-41d5-9c62-0cf6e17d8330 req-5cd37469-90cf-475c-9238-d5eee741de39 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.2134836 Dec 21 04:00:57.994420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae2df8e8-bfae-4c15-aa3a-53301abcd628 req-370bb263-0035-42bc-a463-e1d578b9879b tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:57.995977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae2df8e8-bfae-4c15-aa3a-53301abcd628 req-370bb263-0035-42bc-a463-e1d578b9879b tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 945 time: 0.2353857 Dec 21 04:00:58.001984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.017226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 8724c5e8-a356-400c-98e3-ca3d4f7b5252 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:58.037395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.101319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be997944-69e4-4f51-9a87-9e89a4737150 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.186660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be997944-69e4-4f51-9a87-9e89a4737150 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.199801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae2df8e8-bfae-4c15-aa3a-53301abcd628 req-35bd7448-b01c-41ab-864d-8142626c2df8 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1929903 Dec 21 04:00:58.211077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63d791f3-3618-41d5-9c62-0cf6e17d8330 req-f049d5d7-88d2-4b18-8c1d-fb4ccc3f86b1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2053592 Dec 21 04:00:58.221054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.227153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf192791-254f-430c-82d3-12c377f29e2e req-c38cafe4-dd91-454c-b468-e2655298f022 service neutron] 10.222.0.31 "GET /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2602477 Dec 21 04:00:58.257402 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.257402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.257402 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.263295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=8724c5e8-a356-400c-98e3-ca3d4f7b5252,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:58.360093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.365964 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ba6e1c54-c438-4b43-b3ef-f5fdacca0d23 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/ports/8724c5e8-a356-400c-98e3-ca3d4f7b5252 HTTP/1.1" status: 204 len: 168 time: 0.5665698 Dec 21 04:00:58.370703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39596) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:58.376836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] Pushing event updated for resources: {'Network': ['ID=0294b34c-30ec-4139-9cf8-4180cbf6aee4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:58.386988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:00:58.431500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e774d9a-ab54-41f8-ade2-bb2f7f450809 req-8a50379c-423c-4327-a6e0-943b8b5ee9f1 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.442157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e774d9a-ab54-41f8-ade2-bb2f7f450809 req-8a50379c-423c-4327-a6e0-943b8b5ee9f1 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 944 time: 0.0972328 Dec 21 04:00:58.444970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e2bc2a8-7769-4150-b519-d5a3a55cd831 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.446557 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7e2bc2a8-7769-4150-b519-d5a3a55cd831 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "GET /v2.0/ports?device_id=7352f41a-a815-4f0a-80d2-9706c21ac387 HTTP/1.1" status: 200 len: 913 time: 0.0747242 Dec 21 04:00:58.449201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39598) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:58.492797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3430acba-17d3-40a1-a205-3b3832d4e10d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 2.0772021 Dec 21 04:00:58.496684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:00:58.503484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Request body: {'subnet': {'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1721612854-subnet', 'tenant_id': '890fa4dd6439485583f4cba0fdc68fad', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:00:58.532012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be997944-69e4-4f51-9a87-9e89a4737150 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.534861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be997944-69e4-4f51-9a87-9e89a4737150 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.538330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-be997944-69e4-4f51-9a87-9e89a4737150 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9a5dd363-b9d7-4978-b177-d22111c35034 HTTP/1.1" status: 204 len: 168 time: 0.6981418 Dec 21 04:00:58.575417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e774d9a-ab54-41f8-ade2-bb2f7f450809 req-5853e7d3-d1fe-4459-8a9b-9b3b7f3fe1bd tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1322958 Dec 21 04:00:58.581120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be997944-69e4-4f51-9a87-9e89a4737150 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a5dd363-b9d7-4978-b177-d22111c35034,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:58.606167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d119158a-41c2-43c1-8733-4376d0b6be5f req-f21a0e4a-526b-4d45-82aa-a06ee1f0d081 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.606167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d119158a-41c2-43c1-8733-4376d0b6be5f req-f21a0e4a-526b-4d45-82aa-a06ee1f0d081 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 946 time: 0.1402946 Dec 21 04:00:58.791943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-10abcb93-01e8-4065-a34e-85279e08ff2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.791943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-10abcb93-01e8-4065-a34e-85279e08ff2f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3d5a6f8a2e664539a37470e2d2eb3477&device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 1096 time: 0.1826940 Dec 21 04:00:58.796027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Made reservation on behalf of 890fa4dd6439485583f4cba0fdc68fad for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:00:58.796027 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:58.799540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d119158a-41c2-43c1-8733-4376d0b6be5f req-e082cf41-b9b4-45ad-8b00-1cbdcd3dc669 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1001642 Dec 21 04:00:58.799540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-60ecea07-ec50-40be-84c6-e8cf860b1640 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.799540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-60ecea07-ec50-40be-84c6-e8cf860b1640 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b632d49-bc8a-4f7d-b433-7c4b707a95a5 HTTP/1.1" status: 200 len: 919 time: 0.1222341 Dec 21 04:00:58.838969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-943a570c-045c-4953-8b0b-548aed6cda7a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=408499a9-a6b4-445d-96c5-773432a9bd6d HTTP/1.1" status: 200 len: 217 time: 0.0518384 Dec 21 04:00:58.901324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-1a2773a0-1ea7-48be-8b10-aa77ca55a52c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:58.903204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-1a2773a0-1ea7-48be-8b10-aa77ca55a52c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e06ba303-a715-4bb3-b025-83150e545fdd HTTP/1.1" status: 200 len: 858 time: 0.0555220 Dec 21 04:00:58.951222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-f1fcc554-fa35-458d-9f7b-9e1cd4380fb0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b632d49-bc8a-4f7d-b433-7c4b707a95a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0366402 Dec 21 04:00:59.021240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:59.025128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:59.105328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-ccedea1e-498a-4824-88b8-fd3063390dc2 service neutron] 10.222.0.31 "GET /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1331043 Dec 21 04:00:59.241917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-961bcf77-54ab-4dd8-a596-cc10d6f17b92 req-4d202bdd-ac95-40b5-89fe-1f978e5aea17 service neutron] 10.222.0.31 "GET /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220398 Dec 21 04:00:59.368481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d73017-b57a-4352-9e4a-8b762a72e317 req-9fa17685-eb0f-484d-91fa-ab08945c34b9 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:59.370203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60d73017-b57a-4352-9e4a-8b762a72e317 req-9fa17685-eb0f-484d-91fa-ab08945c34b9 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 945 time: 0.0614531 Dec 21 04:00:59.446581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60d73017-b57a-4352-9e4a-8b762a72e317 req-5818f2ed-0e5c-4e6b-95c5-40246e08a625 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696955 Dec 21 04:00:59.502229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Pushing event updated for resources: {'Subnet': ['ID=ccaea876-d935-4c88-9da6-3335d0dadf82,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:00:59.536399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Checking segment: {'id': '8250d715-d626-4ee8-89bc-d342f729f8bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:00:59.536807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Network hostable DHCP agents. Network: 0294b34c-30ec-4139-9cf8-4180cbf6aee4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:00:59.730823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:00:59.734386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32952be6-531a-4f71-a2ee-6f019fcf791e req-8e1c48ff-178f-4cac-9031-183b2dc7837a tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:59.743542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32952be6-531a-4f71-a2ee-6f019fcf791e req-8e1c48ff-178f-4cac-9031-183b2dc7837a tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 944 time: 0.0795965 Dec 21 04:00:59.772913 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:00:59.795158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port e7652f44-2059-44fc-b35e-4bbb0850befc {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:00:59.802631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:59.807654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32952be6-531a-4f71-a2ee-6f019fcf791e req-bc9f1be2-9783-4bf3-89cc-133f2cb6713f tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632341 Dec 21 04:00:59.856650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 0294b34c-30ec-4139-9cf8-4180cbf6aee4) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:00:59.861398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:00:59.863330 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:59.864168 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ead37d4e-1614-4fed-a968-8311cb07f1da None None] Network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:59.905171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:00:59.918220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for e7652f44-2059-44fc-b35e-4bbb0850befc owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:00:59.969587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d731cf07-73f6-4bc3-93c2-f0a227cd78ca None None] Network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:00:59.992874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ccd60c9-d35f-4dc7-a2dd-797350deefaf admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.4950290 Dec 21 04:01:00.157101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39676) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:00.208679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc1833e-9d78-426a-b923-9c8eb7f8e9be req-ccefe413-6c37-452f-b10e-1e8994fdecd4 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:00.210694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cfc1833e-9d78-426a-b923-9c8eb7f8e9be req-ccefe413-6c37-452f-b10e-1e8994fdecd4 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 945 time: 0.0659275 Dec 21 04:01:00.274456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.282112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cfc1833e-9d78-426a-b923-9c8eb7f8e9be req-2e3d70d7-a4b0-482c-871c-8fb320eb0eef tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648754 Dec 21 04:01:00.305167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=e7652f44-2059-44fc-b35e-4bbb0850befc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:00.319275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--1619234025'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:00.355899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:00.391214 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.402647 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.458022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.487100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:00.492934 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7f57098-4a82-4fb8-b3c2-438226f45265" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-unplugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:00.516924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:00.553569 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8dafe91-51ad-496e-b1cf-f1e17eaab61e x-openstack-request-id: req-d8dafe91-51ad-496e-b1cf-f1e17eaab61e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:00.554562 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-unplugged", "status": "completed", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:00.555053 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d8dafe91-51ad-496e-b1cf-f1e17eaab61e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:00.555844 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'code': 200} Dec 21 04:01:00.558318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.579090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.589107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.714904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.800610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5292a7fd-1b5c-4f1b-a4a6-46f93b1f6ecd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:00.812360 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.814603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.815061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.815475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.815886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.816294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.816725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.817103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.817509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.817921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.818318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.819358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.819702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.820038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:00.839623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=14']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:00.862401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Router 7352f41a-a815-4f0a-80d2-9706c21ac387 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:01:00.928037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:00.966071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be8e391c-9596-44a1-9d91-9a5c4c90705a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:00.980075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30678fad-b0ee-4cbd-91f5-752ee4e5c500 req-ab050ec6-ec6f-48ad-900e-bd63bf6d9328 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:00.988102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30678fad-b0ee-4cbd-91f5-752ee4e5c500 req-ab050ec6-ec6f-48ad-900e-bd63bf6d9328 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 944 time: 0.0969439 Dec 21 04:01:00.989324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:01:00.997032 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3bdf529f-8576-4cb4-934c-c044c868074e tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "PUT /v2.0/routers/7352f41a-a815-4f0a-80d2-9706c21ac387/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5467312 Dec 21 04:01:00.999859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.014410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.016174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aac35462-2633-4d93-ad5f-274c4decbfd9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.8575666 Dec 21 04:01:01.018221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] Sync routers for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:01:01.019546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39720) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.040779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:01:01.042056 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:01.071745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39724) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.083235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:01.090799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-555041217-network', 'tenant_id': '8f0baf6b9a444bba84d0cc973cfa2ab6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:01.094351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] Routers {'7352f41a-a815-4f0a-80d2-9706c21ac387'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:01:01.095181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:00:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7352f41a-a815-4f0a-80d2-9706c21ac387'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:01.109136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30678fad-b0ee-4cbd-91f5-752ee4e5c500 req-1b533009-3e1a-43af-88b0-d759fca4e522 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202550 Dec 21 04:01:01.133506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:01.134159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9849c967-2dde-4a7b-98d1-e04ebf5baf03 None None] The sync data for ids ['7352f41a-a815-4f0a-80d2-9706c21ac387'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:01:01.148575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.160123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-733fe804-9811-4f33-83a8-45c7d36fd273 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1363409 Dec 21 04:01:01.160317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39730) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.165505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-security--1121168964', 'description': 'tempest-security-description-1762637410'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:01.199718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.214603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Made reservation on behalf of 8f0baf6b9a444bba84d0cc973cfa2ab6 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:01.217197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.235870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.262076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.268095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.335131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.354704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.357540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.358901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "PUT /v2.0/security-groups/be8e391c-9596-44a1-9d91-9a5c4c90705a HTTP/1.1" status: 200 len: 1797 time: 0.1976728 Dec 21 04:01:01.361678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39744) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.393812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.411588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting port 02c36e98-2bb6-4566-9018-cef4e07bfa56 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:01.411922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.417000 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2859d42e-29a3-43d4-81c5-794d333def24 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups/be8e391c-9596-44a1-9d91-9a5c4c90705a HTTP/1.1" status: 200 len: 1797 time: 0.0543127 Dec 21 04:01:01.420105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e439dc-6e6b-4e1b-9822-58d354b5fdc3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be8e391c-9596-44a1-9d91-9a5c4c90705a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:01.423138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.423870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:01.481854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.482210 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Added segment f48ee540-0b83-4687-be9d-9424db3d1a5f of type vlan for network b9053c12-d631-4f2d-a48d-3fd6262009b4 Dec 21 04:01:01.493591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d73f71d-cefd-4aba-b414-cdce2bac09d0 req-f0e09e1f-c1be-4709-a504-4a7e303f93d7 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:01.495516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d73f71d-cefd-4aba-b414-cdce2bac09d0 req-f0e09e1f-c1be-4709-a504-4a7e303f93d7 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 945 time: 0.1351814 Dec 21 04:01:01.502853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.516495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Calling delete_port for 02c36e98-2bb6-4566-9018-cef4e07bfa56 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:01.546034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9074f6f2-224c-48dd-8e27-20c035e74288,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:01.594501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.637843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6133200e-9048-42fd-9c40-4dccaccd1265 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.688963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d73f71d-cefd-4aba-b414-cdce2bac09d0 req-60f5d61c-48fe-4e3c-ac23-04a3e75876a6 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/security-groups?id=dccd9196-94e1-4422-afe7-0a0fb5768ad2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1798899 Dec 21 04:01:01.701057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-54887655-156b-4a4c-a678-36d4b37cdc12 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:01.703378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-54887655-156b-4a4c-a678-36d4b37cdc12 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.54 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 945 time: 0.1583922 Dec 21 04:01:01.709121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6133200e-9048-42fd-9c40-4dccaccd1265 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.754065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.755278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:01.755636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.760750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.788907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Port': ['ID=02c36e98-2bb6-4566-9018-cef4e07bfa56,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:01.799177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-021f434e-6494-47da-9c4d-171cf2f554bb None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:01:01.853883 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.901267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] Pushing event updated for resources: {'Network': ['ID=b9053c12-d631-4f2d-a48d-3fd6262009b4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:01.914435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b9053c12-d631-4f2d-a48d-3fd6262009b4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:01.929419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0899d8-1700-4042-8d28-6a2ddbc2f6c7 req-ec181545-5ef5-4dbf-9857-6f07b94096b4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:01.931012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c0899d8-1700-4042-8d28-6a2ddbc2f6c7 req-ec181545-5ef5-4dbf-9857-6f07b94096b4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1866617 Dec 21 04:01:01.938897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4da61fcb-74b6-4508-b38a-c0c72b86bdc5 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.8547392 Dec 21 04:01:01.939547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:01.946584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.948856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:01.949913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Request body: {'subnet': {'network_id': 'b9053c12-d631-4f2d-a48d-3fd6262009b4', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-555041217-subnet', 'tenant_id': '8f0baf6b9a444bba84d0cc973cfa2ab6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:01.983437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Deleting port 15378e61-cd11-4e9a-bac6-eb958f62a16e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:01.986055 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.015603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6133200e-9048-42fd-9c40-4dccaccd1265 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.018149 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6133200e-9048-42fd-9c40-4dccaccd1265 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.019312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6133200e-9048-42fd-9c40-4dccaccd1265 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/be8e391c-9596-44a1-9d91-9a5c4c90705a HTTP/1.1" status: 204 len: 168 time: 0.5931747 Dec 21 04:01:02.022143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:02.055412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.055964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Fanout notify agent at l3_agent the message router_deleted on router 7352f41a-a815-4f0a-80d2-9706c21ac387 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:01:02.063848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.064961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6f83be38-9c21-4ceb-9e03-52701ecc1163 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/routers/7352f41a-a815-4f0a-80d2-9706c21ac387 HTTP/1.1" status: 204 len: 168 time: 1.0638421 Dec 21 04:01:02.070199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39756) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:02.082441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6133200e-9048-42fd-9c40-4dccaccd1265 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be8e391c-9596-44a1-9d91-9a5c4c90705a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:02.094098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c0899d8-1700-4042-8d28-6a2ddbc2f6c7 req-f5b7f32d-b436-4012-92b0-54c7082f37d6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1405821 Dec 21 04:01:02.127420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fdb43198-7079-4f0a-b818-36c1a80a71a8 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1040556 Dec 21 04:01:02.132856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39760) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:02.136779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Made reservation on behalf of 8f0baf6b9a444bba84d0cc973cfa2ab6 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:02.143282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.143282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] For port 15378e61-cd11-4e9a-bac6-eb958f62a16e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=15378e61-cd11-4e9a-bac6-eb958f62a16e,segment=NetworkSegment(8cb67e3a-d3f0-4c65-9e90-a7ae948c636c),segment_id=8cb67e3a-d3f0-4c65-9e90-a7ae948c636c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:02.143626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.152515 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-6cade57c-519c-4b37-9b1f-71eca6732dbd tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] delete failed (client error): The resource could not be found. Dec 21 04:01:02.153934 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6cade57c-519c-4b37-9b1f-71eca6732dbd tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/be8e391c-9596-44a1-9d91-9a5c4c90705a HTTP/1.1" status: 404 len: 347 time: 0.0198150 Dec 21 04:01:02.159715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39764) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:02.164719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--154406247'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:02.173107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Deleting subnet 76bec629-6735-4479-9cb2-edaf6be1f8e5 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:02.175637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Calling delete_port for 15378e61-cd11-4e9a-bac6-eb958f62a16e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:02.177337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.235742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.281529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.321787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.338571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30615748-02dd-4444-851a-1ead21c1b40d req-8afd0d7e-f284-49cc-90ff-24c7c0f736aa tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:02.340163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30615748-02dd-4444-851a-1ead21c1b40d req-8afd0d7e-f284-49cc-90ff-24c7c0f736aa tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 944 time: 0.1225367 Dec 21 04:01:02.356450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 408499a9-a6b4-445d-96c5-773432a9bd6d details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:01:02.417404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.422016 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.474681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.480379 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/subnets/76bec629-6735-4479-9cb2-edaf6be1f8e5 HTTP/1.1" status: 204 len: 168 time: 0.4069605 Dec 21 04:01:02.480655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c064581f-430a-4cc5-9778-26b2d540bdcb tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Subnet': ['ID=76bec629-6735-4479-9cb2-edaf6be1f8e5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:02.484318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39768) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:02.493622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 408499a9-a6b4-445d-96c5-773432a9bd6d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=408499a9-a6b4-445d-96c5-773432a9bd6d,segment=NetworkSegment(9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4),segment_id=9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:02.496015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.497578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30615748-02dd-4444-851a-1ead21c1b40d req-2c93cb52-9460-47f4-805c-aec5d6c1afa8 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1424806 Dec 21 04:01:02.508506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '408499a9-a6b4-445d-96c5-773432a9bd6d', 'network_id': '9b632d49-bc8a-4f7d-b433-7c4b707a95a5', 'port_id': '408499a9-a6b4-445d-96c5-773432a9bd6d', 'mac_address': 'fa:16:3e:c2:50:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 140, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e06ba303-a715-4bb3-b025-83150e545fdd', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:01:02.557747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.565566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b9980aa-c9b8-4d4f-a007-83c68f11444a req-9b176088-75fd-4219-9a28-9ab29245144a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:02.567612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b9980aa-c9b8-4d4f-a007-83c68f11444a req-9b176088-75fd-4219-9a28-9ab29245144a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1039908 Dec 21 04:01:02.575250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 408499a9-a6b4-445d-96c5-773432a9bd6d {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:01:02.593837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 408499a9-a6b4-445d-96c5-773432a9bd6d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=408499a9-a6b4-445d-96c5-773432a9bd6d,segment=NetworkSegment(9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4),segment_id=9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:02.645456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0a1011c2-e4e1-404a-ae55-18a8ab30a857,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:02.645456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.687475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b9980aa-c9b8-4d4f-a007-83c68f11444a req-6a53aea4-7629-4bb1-9327-56bcdb4056ef tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1138878 Dec 21 04:01:02.713404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-68fbd180-9aed-4cb6-ad6b-c8324bf66d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:02.715095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-68fbd180-9aed-4cb6-ad6b-c8324bf66d6a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.0760818 Dec 21 04:01:02.719142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.751730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.761690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.762688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.766150 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-28f80d2b-db7a-4bb0-8992-ef7bd67700c6 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6052139 Dec 21 04:01:02.774042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39774) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:02.786329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': '0a1011c2-e4e1-404a-ae55-18a8ab30a857', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:02.801218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.817960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b672c264-59db-4f56-873d-1e399cb0cd1a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:02.853693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=408499a9-a6b4-445d-96c5-773432a9bd6d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:02.856057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2f379871-dbca-4507-9277-511a25d54bce') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:02.856421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2f379871-dbca-4507-9277-511a25d54bce') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:02.869101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.872353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['15378e61-cd11-4e9a-bac6-eb958f62a16e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:02.884647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.893131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:02.893602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:02.898044 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:02.907233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Pushing event deleted for resources: {'Port': ['ID=15378e61-cd11-4e9a-bac6-eb958f62a16e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:02.935266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Pushing event updated for resources: {'Subnet': ['ID=e5cc317c-4419-4f49-bc7a-1beb6a5bf222,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:02.938491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.956351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2db44457-2b6b-40d6-9cda-2d949e97e420 req-8e2f2c3e-7048-406a-8899-95704efb3085 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.0954742 Dec 21 04:01:02.986208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] No DVR routers for this DVR port 15378e61-cd11-4e9a-bac6-eb958f62a16e on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:02.995210 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:02.999734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae5aca3c-c0f3-4cc1-b371-6e3e5334a86c req-e7d6b9b8-e8d5-40d9-8bd4-d70771ec1353 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.54 "DELETE /v2.0/ports/15378e61-cd11-4e9a-bac6-eb958f62a16e HTTP/1.1" status: 204 len: 173 time: 1.2881374 Dec 21 04:01:03.000210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'name': 'network-vif-deleted', 'tag': '15378e61-cd11-4e9a-bac6-eb958f62a16e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:03.002516 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd6f71fc-10ea-45c0-b91a-6affb5f3babd" -d '{"events": [{"server_uuid": "f6292bbc-0c60-428c-b64e-7c5838063968", "name": "network-vif-deleted", "tag": "15378e61-cd11-4e9a-bac6-eb958f62a16e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:03.021003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-c47896bf-6022-403c-af20-1a96a201f024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:03.026812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-c47896bf-6022-403c-af20-1a96a201f024 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.2918499 Dec 21 04:01:03.029919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Checking segment: {'id': 'f48ee540-0b83-4687-be9d-9424db3d1a5f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'b9053c12-d631-4f2d-a48d-3fd6262009b4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:03.030293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Network hostable DHCP agents. Network: b9053c12-d631-4f2d-a48d-3fd6262009b4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:03.070914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.081479 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00bf8bf3-7e10-465e-8781-1a641976dacb x-openstack-request-id: req-00bf8bf3-7e10-465e-8781-1a641976dacb {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:03.081818 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f6292bbc-0c60-428c-b64e-7c5838063968", "name": "network-vif-deleted", "tag": "15378e61-cd11-4e9a-bac6-eb958f62a16e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:03.082077 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-00bf8bf3-7e10-465e-8781-1a641976dacb {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:03.082479 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6292bbc-0c60-428c-b64e-7c5838063968', 'name': 'network-vif-deleted', 'tag': '15378e61-cd11-4e9a-bac6-eb958f62a16e', 'status': 'completed', 'code': 200} Dec 21 04:01:03.109732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-2e066ee2-ed7e-4f53-92e3-e40d538edd4c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.0719926 Dec 21 04:01:03.130752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['408499a9-a6b4-445d-96c5-773432a9bd6d'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:03.132375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.140808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.145212 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] 10.222.0.18 "DELETE /v2.0/networks/b672c264-59db-4f56-873d-1e399cb0cd1a HTTP/1.1" status: 204 len: 168 time: 0.6594613 Dec 21 04:01:03.168836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-a297237c-b07d-4eaa-9c86-c0fce629ebb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:03.171251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-a297237c-b07d-4eaa-9c86-c0fce629ebb9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0535376 Dec 21 04:01:03.173292 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.174916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-735125d4-ff26-46ff-b040-711899329c11 tempest-FloatingIPTestJSON-213985260 tempest-FloatingIPTestJSON-213985260-project] Pushing event deleted for resources: {'Network': ['ID=b672c264-59db-4f56-873d-1e399cb0cd1a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:03.205622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dcb65732-4c28-41c4-b9b5-60ca8683d526,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:03.236707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Network b9053c12-d631-4f2d-a48d-3fd6262009b4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:03.256629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-53f0322b-5c76-4485-9e31-77487abb7922 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:03.258559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-53f0322b-5c76-4485-9e31-77487abb7922 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0784819 Dec 21 04:01:03.299778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.301021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4497593-d182-4e7b-9b38-9ef5de1288b9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5260506 Dec 21 04:01:03.304127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39780) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:03.359388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a3da37b-faaa-4c33-b280-b7dc416833ca tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.360357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b9053c12-d631-4f2d-a48d-3fd6262009b4) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:03.367220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:03.368156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.368900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4720fa3-87cd-4fe5-b117-b14999ba3beb None None] Network b9053c12-d631-4f2d-a48d-3fd6262009b4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:03.389117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a3da37b-faaa-4c33-b280-b7dc416833ca tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.431194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-46a374e5-95e4-4d85-945c-31c33856dbec service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1591914 Dec 21 04:01:03.475519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3dc96987-e749-44c1-9f16-5cecbbab9c3f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.5291023 Dec 21 04:01:03.480910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a3da37b-faaa-4c33-b280-b7dc416833ca tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.489393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a3da37b-faaa-4c33-b280-b7dc416833ca tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.498892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39784) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:03.501029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9a3da37b-faaa-4c33-b280-b7dc416833ca tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/dcb65732-4c28-41c4-b9b5-60ca8683d526 HTTP/1.1" status: 204 len: 168 time: 0.1959395 Dec 21 04:01:03.508630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a3da37b-faaa-4c33-b280-b7dc416833ca tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=dcb65732-4c28-41c4-b9b5-60ca8683d526,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:03.519557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b50f4a10-13fe-4a90-bb0b-cad8c02671a9 None None] Network b9053c12-d631-4f2d-a48d-3fd6262009b4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:03.667596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-25ec1e04-4674-490d-8637-0c35976e3592 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1554673 Dec 21 04:01:03.670321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39788) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:03.785378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e04ca541-8c9c-43fa-a2b0-f81eb9a3953a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.804864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c29f9579-dc25-4192-a268-97f23d0eb63c req-612bfeea-2c0a-46a4-a2da-027cf02d4991 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3662255 Dec 21 04:01:03.820212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e4b6b3-521e-4c9d-a32d-d124ff7ae3e0 req-e6daaa90-b4fb-4ede-9833-7a14c2d232d4 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:03.833648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e04ca541-8c9c-43fa-a2b0-f81eb9a3953a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.836567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06e4b6b3-521e-4c9d-a32d-d124ff7ae3e0 req-e6daaa90-b4fb-4ede-9833-7a14c2d232d4 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 945 time: 0.1965678 Dec 21 04:01:03.876793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39802) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:03.918245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06e4b6b3-521e-4c9d-a32d-d124ff7ae3e0 req-bc2d7984-20d1-41ee-9c3e-2fc8c1da0a47 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800009 Dec 21 04:01:03.926943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a52059-dc02-4be3-a822-a7056f4c9e09 req-92437ee9-0bbb-41c2-b64f-b3710f555245 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:03.934621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71a52059-dc02-4be3-a822-a7056f4c9e09 req-92437ee9-0bbb-41c2-b64f-b3710f555245 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1277785 Dec 21 04:01:03.962772 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e04ca541-8c9c-43fa-a2b0-f81eb9a3953a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.966214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e04ca541-8c9c-43fa-a2b0-f81eb9a3953a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:03.969465 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e04ca541-8c9c-43fa-a2b0-f81eb9a3953a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/0a1011c2-e4e1-404a-ae55-18a8ab30a857 HTTP/1.1" status: 204 len: 168 time: 0.2981050 Dec 21 04:01:03.987696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39806) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:03.993135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71a52059-dc02-4be3-a822-a7056f4c9e09 req-acce9d7b-01d3-4a04-9ab2-26cfd0c8f311 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0575635 Dec 21 04:01:04.000540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04ca541-8c9c-43fa-a2b0-f81eb9a3953a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a1011c2-e4e1-404a-ae55-18a8ab30a857,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:04.078994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-73dccfce-20c2-4517-8f14-583a64639687 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0845718 Dec 21 04:01:04.083450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39812) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:04.088017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--2123818585'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:04.135995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-00ece7ab-57f8-42a8-9593-a29bd19f36d0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=de1d55e58f2f4ea3b43e98928dfd75f7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2580838 Dec 21 04:01:04.138636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39814) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:04.177746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.197053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2aab8fca-7e81-43da-b2b2-30a4c75b0da0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.226458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2aab8fca-7e81-43da-b2b2-30a4c75b0da0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.269016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67c4f7ab-ce32-4b91-ba71-46e49ad91191 req-9b6d9ec9-63b6-4616-84f8-7c1e20874154 tempest-ServerAddressesTestJSON-933435313 tempest-ServerAddressesTestJSON-933435313-project] 10.222.0.18 "GET /v2.0/ports?device_id=f6292bbc-0c60-428c-b64e-7c5838063968 HTTP/1.1" status: 200 len: 210 time: 0.0314779 Dec 21 04:01:04.310440 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.331698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2aab8fca-7e81-43da-b2b2-30a4c75b0da0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.334338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2aab8fca-7e81-43da-b2b2-30a4c75b0da0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.335538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2aab8fca-7e81-43da-b2b2-30a4c75b0da0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ad9bf3b4-caff-4459-92b9-2263e7c61a06 HTTP/1.1" status: 204 len: 168 time: 0.1959944 Dec 21 04:01:04.343973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aab8fca-7e81-43da-b2b2-30a4c75b0da0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad9bf3b4-caff-4459-92b9-2263e7c61a06,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:04.362364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.368534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 408499a9-a6b4-445d-96c5-773432a9bd6d up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:04.407510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a3008d46-49ae-4658-b710-7c25382519c7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:04.432278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-d31d86e1-eadc-4693-8a84-91db2533e92c tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:04.433822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-d31d86e1-eadc-4693-8a84-91db2533e92c tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/networks?id=0294b34c-30ec-4139-9cf8-4180cbf6aee4 HTTP/1.1" status: 200 len: 809 time: 0.1407347 Dec 21 04:01:04.450348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-e7bb37aa-0eed-4f41-9d0c-9c93e07adaa8 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/quotas/890fa4dd6439485583f4cba0fdc68fad HTTP/1.1" status: 200 len: 375 time: 0.0092413 Dec 21 04:01:04.467569 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.468801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c3f6f8fa-b9af-42c0-84d6-2feffba6002f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3844013 Dec 21 04:01:04.471721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:04.476402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'a3008d46-49ae-4658-b710-7c25382519c7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:04.485182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-ec58d76a-bb52-4698-9e96-fc12e9735beb tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=890fa4dd6439485583f4cba0fdc68fad&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0283177 Dec 21 04:01:04.486462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 408499a9-a6b4-445d-96c5-773432a9bd6d completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:01:04.490773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 408499a9-a6b4-445d-96c5-773432a9bd6d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:04.491365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.578895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.581724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.584209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-b024362e-c70a-44cb-82a4-d58f2c885f77 service neutron] 10.222.0.18 "GET /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901244 Dec 21 04:01:04.614613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '408499a9-a6b4-445d-96c5-773432a9bd6d'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:04.617290 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9137f548-d57f-4a07-bdb6-df138ff35f0a" -d '{"events": [{"server_uuid": "0bafc7e8-8562-442e-952d-0820fcd0efbc", "name": "network-vif-plugged", "status": "completed", "tag": "408499a9-a6b4-445d-96c5-773432a9bd6d"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:04.650894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 408499a9-a6b4-445d-96c5-773432a9bd6d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=408499a9-a6b4-445d-96c5-773432a9bd6d,segment=NetworkSegment(9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4),segment_id=9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:04.653491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.697817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.720796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.734033 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-500a8b72-87b3-4a40-a923-79f2e1ee96b8 x-openstack-request-id: req-500a8b72-87b3-4a40-a923-79f2e1ee96b8 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:04.734328 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0bafc7e8-8562-442e-952d-0820fcd0efbc", "name": "network-vif-plugged", "status": "completed", "tag": "408499a9-a6b4-445d-96c5-773432a9bd6d", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:04.734583 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-500a8b72-87b3-4a40-a923-79f2e1ee96b8 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:04.735018 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '408499a9-a6b4-445d-96c5-773432a9bd6d', 'code': 200} Dec 21 04:01:04.768204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=408499a9-a6b4-445d-96c5-773432a9bd6d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:04.769649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e7496ef5-9c6e-4c7d-96a8-a25490aade14,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:04.896046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:04.896046 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-29086648-1d95-4e64-a8fe-fbbf04a584c3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4226716 Dec 21 04:01:04.898141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39838) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:04.905228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'a3008d46-49ae-4658-b710-7c25382519c7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:05.006009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.054517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebcd6045-ffc6-4d94-828f-ee5e9d2a053d req-17e1cd32-ce17-4aad-ae46-6be681884afb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:05.056867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebcd6045-ffc6-4d94-828f-ee5e9d2a053d req-17e1cd32-ce17-4aad-ae46-6be681884afb service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 1098 time: 0.1143398 Dec 21 04:01:05.071552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-bab49c0a-95f2-4338-9f8a-91c7a6e3d0c6 service neutron] 10.222.0.18 "GET /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4795222 Dec 21 04:01:05.074891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.129578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a46dab-0fde-4ec3-9966-d1ea12618d76 req-f9189a97-e1c8-4800-b475-42ebdbb4bf41 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:05.131584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72a46dab-0fde-4ec3-9966-d1ea12618d76 req-f9189a97-e1c8-4800-b475-42ebdbb4bf41 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 946 time: 0.1212764 Dec 21 04:01:05.143401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.166160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8047bca2-e4fa-42cd-9eda-d595837256c5,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:05.170860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebcd6045-ffc6-4d94-828f-ee5e9d2a053d req-f1bfc1cf-329c-457d-b55a-0dc0fb881be8 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967364 Dec 21 04:01:05.199071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72a46dab-0fde-4ec3-9966-d1ea12618d76 req-b512a6d5-7f6f-4035-8509-221a218ede9e tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545733 Dec 21 04:01:05.265768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.266995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-378ecd21-8d55-4941-a108-67ffbc38d9ef tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3678145 Dec 21 04:01:05.270878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39850) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:05.276583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'a3008d46-49ae-4658-b710-7c25382519c7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:05.348397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f62362-6e5c-4bc5-959a-da9aa9b9615d req-e5eb29f7-be35-4e5e-a3db-ba4afa19e35a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:05.350029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04f62362-6e5c-4bc5-959a-da9aa9b9615d req-e5eb29f7-be35-4e5e-a3db-ba4afa19e35a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0929737 Dec 21 04:01:05.426620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04f62362-6e5c-4bc5-959a-da9aa9b9615d req-51939ab3-f051-4f3f-a754-28368720104e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0631833 Dec 21 04:01:05.461155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cef521b-cdeb-405a-a268-c25d1ba62fd9 req-6a5912df-8964-4390-a5cd-e8fb1ceefa15 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 210 time: 0.0466697 Dec 21 04:01:05.463198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.476718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:05.533411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.535557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Deleting subnet 60c316de-0ab1-4b9b-a7f3-c62190d2ec1a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:05.539167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.584847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.600619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.633138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.644838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f99cbfe-66e2-4395-a943-453ad937b946,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:05.657523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39874) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:05.689661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac4079-94ef-40a1-a023-a26d84a48c6c req-d1ba94a3-dc50-4639-ab58-97b7f1523a13 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:05.691526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47ac4079-94ef-40a1-a023-a26d84a48c6c req-d1ba94a3-dc50-4639-ab58-97b7f1523a13 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0632770 Dec 21 04:01:05.738849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.740099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bce8ce0d-29ba-43a1-9707-44b8e3d383eb tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4670095 Dec 21 04:01:05.743103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:05.747666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'a3008d46-49ae-4658-b710-7c25382519c7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:05.757339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47ac4079-94ef-40a1-a023-a26d84a48c6c req-80a8e2ea-336b-4549-95c5-a7e8b199430b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0564392 Dec 21 04:01:05.770460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 15378e61-cd11-4e9a-bac6-eb958f62a16e no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:05.779437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-182207648'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:05.790299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.805192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 15378e61-cd11-4e9a-bac6-eb958f62a16e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:01:05.805571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 15378e61-cd11-4e9a-bac6-eb958f62a16e not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:01:05.820510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=60c316de-0ab1-4b9b-a7f3-c62190d2ec1a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:05.822827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.826417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-af71afb5-5775-4380-92e4-5ee65de7840c admin admin] 10.222.0.18 "DELETE /v2.0/subnets/60c316de-0ab1-4b9b-a7f3-c62190d2ec1a HTTP/1.1" status: 204 len: 168 time: 0.3484926 Dec 21 04:01:05.829133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39882) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:05.901272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.906430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77285933-cb1e-4c1e-8ef0-58edc064227f req-0fdf6885-59ba-4c99-8cd5-d05ccfdf882c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:05.907945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77285933-cb1e-4c1e-8ef0-58edc064227f req-0fdf6885-59ba-4c99-8cd5-d05ccfdf882c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0553586 Dec 21 04:01:05.916166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:05.963407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77285933-cb1e-4c1e-8ef0-58edc064227f req-49f231e4-0ad1-403b-a611-c35d1a1e7bbf tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483720 Dec 21 04:01:06.036430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:06.039756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.050901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.067714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.068521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.091681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dd139785-bf85-4780-9c0a-38b01e520a12']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:06.108122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:06.112861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8cb67e3a-d3f0-4c65-9e90-a7ae948c636c') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:06.121305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.142207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.159725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.176275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Releasing vlan 135 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:06.176674 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:06.179910 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:06.190176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=08e668e6-c7b7-41de-a621-a6d8165a2707,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:06.239978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.241203 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5d3b6bf-17a7-46f6-9b4d-2936bf4fb524 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4970999 Dec 21 04:01:06.243937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:06.250558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'a3008d46-49ae-4658-b710-7c25382519c7', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:06.276428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.281669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-980d7843-e363-414a-8c85-a95366b69c01 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:06.284957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-980d7843-e363-414a-8c85-a95366b69c01 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.1292346 Dec 21 04:01:06.308839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.318021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-246394b2-f1ac-40ea-8d74-48e75c916a3c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/quotas/2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 375 time: 0.0262361 Dec 21 04:01:06.319279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.322535 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] 10.222.0.18 "DELETE /v2.0/networks/dd139785-bf85-4780-9c0a-38b01e520a12 HTTP/1.1" status: 204 len: 168 time: 0.4924314 Dec 21 04:01:06.342348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.350909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86bc7daf-c780-4d10-9b50-8a31cc973c4f admin admin] Pushing event deleted for resources: {'Network': ['ID=dd139785-bf85-4780-9c0a-38b01e520a12,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:06.380691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:06.388456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.409944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.415692 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Added segment 202e560e-e265-475f-965a-459f8b2def0e of type vlan for network 6981d75a-c75c-46dc-8336-a01225378aa5 Dec 21 04:01:06.415692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dc40c631-4023-47c2-bd79-50629e8e9e72,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:06.416035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56dd5dad-c4fe-4a50-a4f9-20c09bd4abe0 req-efb41ef2-1e62-4106-bd6a-1bc05803cd51 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:06.416035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56dd5dad-c4fe-4a50-a4f9-20c09bd4abe0 req-efb41ef2-1e62-4106-bd6a-1bc05803cd51 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 946 time: 0.1127608 Dec 21 04:01:06.429750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-e9e4d8a0-7eb9-40b7-9bde-e63c9b9658ee tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0891356 Dec 21 04:01:06.488293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.523177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.531930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56dd5dad-c4fe-4a50-a4f9-20c09bd4abe0 req-1bbaaa39-822e-45a0-80ef-63f5cf8afa77 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011081 Dec 21 04:01:06.566433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-b2494a28-e244-4394-a609-cc40963f50a5 service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213770 Dec 21 04:01:06.624239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.629501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.635468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:06.636054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.670672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-d8486635-4e26-468e-998d-641b57133488 service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0975857 Dec 21 04:01:06.685425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=72c9dba3-eb30-418a-ba9e-3c0100c7ba80,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:06.735004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.736839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f16fa77-b3c4-4837-bee0-c1bcfc2df4ee tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.4897661 Dec 21 04:01:06.740432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:06.747244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Network': ['ID=6981d75a-c75c-46dc-8336-a01225378aa5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:06.763199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6981d75a-c75c-46dc-8336-a01225378aa5 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:06.772815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89e6d3d3-635e-4437-8205-0208c33c1692 req-0620a382-7db2-463f-a849-c2aab9ab048f tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 210 time: 0.0583673 Dec 21 04:01:06.788785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-686982b4-e6ba-4ce3-9180-08e8ec7ecb11 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.797843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-686982b4-e6ba-4ce3-9180-08e8ec7ecb11 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.807439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-83042447-4e42-41e9-8d4b-47835c232977 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.1485684 Dec 21 04:01:06.861178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39910) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:06.925742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2880684d-c78b-4c86-ac2b-5c196013945d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b71c4b09f0c646bd944ad36662648bd8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0625124 Dec 21 04:01:06.927648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39914) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:06.943514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-686982b4-e6ba-4ce3-9180-08e8ec7ecb11 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.981130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-686982b4-e6ba-4ce3-9180-08e8ec7ecb11 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:06.992670 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-686982b4-e6ba-4ce3-9180-08e8ec7ecb11 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/72c9dba3-eb30-418a-ba9e-3c0100c7ba80 HTTP/1.1" status: 204 len: 168 time: 0.2505538 Dec 21 04:01:06.993544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39918) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.005372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-686982b4-e6ba-4ce3-9180-08e8ec7ecb11 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=72c9dba3-eb30-418a-ba9e-3c0100c7ba80,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:07.068333 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d6986e8-5708-4ba6-94b0-323851829c41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.068902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa98a14-c918-4524-8e47-20f9c0c03a4f req-5a107e62-ec9e-4ca6-b976-dcc7738d036b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 210 time: 0.0949094 Dec 21 04:01:07.112456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d6986e8-5708-4ba6-94b0-323851829c41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.176195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-012eeffe-3807-4705-b961-a1e128997513 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.1426396 Dec 21 04:01:07.179502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.207520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c58715-ed22-472c-b1d2-5a667e13491b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.215073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c58715-ed22-472c-b1d2-5a667e13491b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.245539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d6986e8-5708-4ba6-94b0-323851829c41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.248236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d6986e8-5708-4ba6-94b0-323851829c41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.249999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d6986e8-5708-4ba6-94b0-323851829c41 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dccd9196-94e1-4422-afe7-0a0fb5768ad2 HTTP/1.1" status: 204 len: 168 time: 0.3199246 Dec 21 04:01:07.257621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6986e8-5708-4ba6-94b0-323851829c41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dccd9196-94e1-4422-afe7-0a0fb5768ad2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:07.286822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c58715-ed22-472c-b1d2-5a667e13491b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.295707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c58715-ed22-472c-b1d2-5a667e13491b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.300048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39928) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.302038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0c58715-ed22-472c-b1d2-5a667e13491b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/08e668e6-c7b7-41de-a621-a6d8165a2707 HTTP/1.1" status: 204 len: 168 time: 0.1134889 Dec 21 04:01:07.310744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0c58715-ed22-472c-b1d2-5a667e13491b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=08e668e6-c7b7-41de-a621-a6d8165a2707,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:07.407040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-716e0798-8bb8-47ed-b20a-98392349fcc9 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.1013963 Dec 21 04:01:07.407347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39930) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.443410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a35252b6-693c-4330-8dd7-e9dbbb616886 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.455594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a35252b6-693c-4330-8dd7-e9dbbb616886 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.554639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a35252b6-693c-4330-8dd7-e9dbbb616886 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.568466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a35252b6-693c-4330-8dd7-e9dbbb616886 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.571735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39936) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.579289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a35252b6-693c-4330-8dd7-e9dbbb616886 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/6f99cbfe-66e2-4395-a943-453ad937b946 HTTP/1.1" status: 204 len: 168 time: 0.1704135 Dec 21 04:01:07.583424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35252b6-693c-4330-8dd7-e9dbbb616886 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=6f99cbfe-66e2-4395-a943-453ad937b946,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:07.652082 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2685a2c-14a4-442c-9337-66c47f83447f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.0765951 Dec 21 04:01:07.661129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39942) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.719026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59d0d3c1-9299-4224-9d48-08ba30c2d5bf tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.723358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b30a72-5265-4e75-890e-300a8fc8cbee req-a3289ba8-1987-49e6-a09b-577483b6103f tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:07.728452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59d0d3c1-9299-4224-9d48-08ba30c2d5bf tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.738305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82b30a72-5265-4e75-890e-300a8fc8cbee req-a3289ba8-1987-49e6-a09b-577483b6103f tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 946 time: 0.1071179 Dec 21 04:01:07.805540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82b30a72-5265-4e75-890e-300a8fc8cbee req-a7fb9bc8-40ad-4021-bcf2-95a590586824 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649314 Dec 21 04:01:07.835256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59d0d3c1-9299-4224-9d48-08ba30c2d5bf tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.844270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59d0d3c1-9299-4224-9d48-08ba30c2d5bf tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:07.845840 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-59d0d3c1-9299-4224-9d48-08ba30c2d5bf tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/8047bca2-e4fa-42cd-9eda-d595837256c5 HTTP/1.1" status: 204 len: 168 time: 0.1726122 Dec 21 04:01:07.848627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39950) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.881991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d0d3c1-9299-4224-9d48-08ba30c2d5bf tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=8047bca2-e4fa-42cd-9eda-d595837256c5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:07.929081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-169229ce-24c5-4e4e-a90d-3e337e682262 req-30733c93-29e3-47a3-9dc5-33becbb3b8cb tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 210 time: 0.0313263 Dec 21 04:01:07.960586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39954) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:07.962486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-12437576-7324-4190-8da4-1c373b0c4338 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.1111984 Dec 21 04:01:07.991357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc29a28a-d209-41ad-82c0-dcdec194ab16 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.009288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc29a28a-d209-41ad-82c0-dcdec194ab16 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.105130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc29a28a-d209-41ad-82c0-dcdec194ab16 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.118328 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc29a28a-d209-41ad-82c0-dcdec194ab16 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.119537 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc29a28a-d209-41ad-82c0-dcdec194ab16 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/e7496ef5-9c6e-4c7d-96a8-a25490aade14 HTTP/1.1" status: 204 len: 168 time: 0.1583471 Dec 21 04:01:08.150135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39962) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:08.225728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99629bc7-7bf3-4b7b-a1e3-236b414ed826 req-c0771cb0-1282-48c2-9518-a57fb2deace1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 210 time: 0.0702553 Dec 21 04:01:08.255703 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7ad0abe4-23e1-4a1d-8cfb-a95b24735815 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1045048 Dec 21 04:01:08.256629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc29a28a-d209-41ad-82c0-dcdec194ab16 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e7496ef5-9c6e-4c7d-96a8-a25490aade14,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:08.259162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39964) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:08.273477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-e0c42ea2-d67a-4f97-bfb2-4f38f209eea0 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:08.275536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-e0c42ea2-d67a-4f97-bfb2-4f38f209eea0 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.54 "GET /v2.0/networks?id=0294b34c-30ec-4139-9cf8-4180cbf6aee4 HTTP/1.1" status: 200 len: 809 time: 0.2281632 Dec 21 04:01:08.297565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Request body: {'port': {'device_id': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4', 'admin_state_up': True, 'tenant_id': '890fa4dd6439485583f4cba0fdc68fad'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:08.342285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb04c7fa-ae56-46f8-85a9-8bd032ac942e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.379195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb04c7fa-ae56-46f8-85a9-8bd032ac942e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.499736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b027e0-e261-459e-b5b4-b9450948d32a req-50c8e50b-bcf4-4784-be77-37744a4af3a1 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:08.501274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50b027e0-e261-459e-b5b4-b9450948d32a req-50c8e50b-bcf4-4784-be77-37744a4af3a1 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 946 time: 0.1559095 Dec 21 04:01:08.520911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb04c7fa-ae56-46f8-85a9-8bd032ac942e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.524461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb04c7fa-ae56-46f8-85a9-8bd032ac942e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.527740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb04c7fa-ae56-46f8-85a9-8bd032ac942e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/a3008d46-49ae-4658-b710-7c25382519c7 HTTP/1.1" status: 204 len: 168 time: 0.2669449 Dec 21 04:01:08.530592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39974) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:08.539769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb04c7fa-ae56-46f8-85a9-8bd032ac942e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3008d46-49ae-4658-b710-7c25382519c7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:08.644618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50b027e0-e261-459e-b5b4-b9450948d32a req-e226d502-6dcf-4b26-b5fc-fe6e0ed36e38 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304276 Dec 21 04:01:08.672486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e82666d8-e7b5-4454-b60c-bb3be59a6e8e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1397521 Dec 21 04:01:08.681018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39978) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:08.687897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--691147608'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:08.721075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Made reservation on behalf of 890fa4dd6439485583f4cba0fdc68fad for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:08.725140 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.877064 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:08.917699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Allocated IP 172.20.0.12 (0294b34c-30ec-4139-9cf8-4180cbf6aee4/ccaea876-d935-4c88-9da6-3335d0dadf82/0fec7ad4-449b-4560-adaa-725add20128e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:08.985633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:09.070523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ead1be31-07e8-4d45-9478-efba14e72814 req-b756b3bd-eb18-40b2-a5b6-c85fb77a04b3 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 210 time: 0.0309348 Dec 21 04:01:09.102578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:09.147633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ae827e3f-d431-4719-92e9-5ecdf98b5fa9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:09.180698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:09.225025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:09.229220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:09.229770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-075e23b7-81da-4c2a-8b25-89dc441d954b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5471404 Dec 21 04:01:09.235435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'ae827e3f-d431-4719-92e9-5ecdf98b5fa9', 'direction': 'ingress', 'protocol': 17}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:09.257825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:09.331737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:09.336543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:09.338868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Pushing event updated for resources: {'Port': ['ID=0fec7ad4-449b-4560-adaa-725add20128e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:09.341131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:09.423336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29f4be2d-4f86-4f27-8e2b-5aa3b03af139 req-cd815e96-1017-4693-83a3-83bee4c7569b tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.0570748 Dec 21 04:01:09.471463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9763a019-73bd-4c64-a62f-10f328a6f9d9 req-c025c772-a8be-4916-a7cc-9b4615fc5a8e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 210 time: 0.0752492 Dec 21 04:01:09.489708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:09.490713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:09.599020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-13756fb3-6fa9-4e41-a286-8de8200d1c24 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:09.602992 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-13756fb3-6fa9-4e41-a286-8de8200d1c24 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.3581378 Dec 21 04:01:09.622329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'port': {'device_id': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'admin_state_up': True, 'tenant_id': '2d46b810d87943059c90ba895934ed3b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:09.793047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f99399a0-2996-4255-b971-03107e239b54 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5015662 Dec 21 04:01:09.822438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Request body: {'port': {'device_id': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:09.866846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d215a143-9d0c-4c4a-b807-658c56b20147 req-e9a7a216-efee-4f0f-8dcf-174aa4806a2c tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:09.875478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d215a143-9d0c-4c4a-b807-658c56b20147 req-e9a7a216-efee-4f0f-8dcf-174aa4806a2c tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 946 time: 0.1298296 Dec 21 04:01:09.941081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-9d9959c6-13be-4cfd-a9b4-e93d23aea72a tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:09.942540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-9d9959c6-13be-4cfd-a9b4-e93d23aea72a tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.31 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 946 time: 0.1663542 Dec 21 04:01:10.011035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40030) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:10.013083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.021921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'subnet': {'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:10.088548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.196101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.198021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d215a143-9d0c-4c4a-b807-658c56b20147 req-caa3018f-b074-4c13-931b-d61c42dddcdc tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/security-groups?id=a82789bc-2b38-4445-a730-65e2a8ec8a7c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3212237 Dec 21 04:01:10.245739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb89986d-f025-4ea7-97f3-bb61a6571bb5 req-2ac9fde6-7607-4369-a670-14ec073b2d08 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0758650 Dec 21 04:01:10.258318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.287852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:10.291376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.294408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aff6f3e6-6c92-4d1f-90a7-fd1a46e5d9e3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:10.375120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.376324 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c86959ad-bb90-4a49-90dd-7bad49b1122d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 1.1452208 Dec 21 04:01:10.382097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Deleting port 408499a9-a6b4-445d-96c5-773432a9bd6d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:10.383384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.386893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40040) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:10.510386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a26292-dca8-4a07-9744-cf41d5b34678 req-12c8a06e-479b-4267-8ba0-7d2e929a9d82 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:10.510690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cde9583-1817-4319-9aa8-3a126eb00baa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.511960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95a26292-dca8-4a07-9744-cf41d5b34678 req-12c8a06e-479b-4267-8ba0-7d2e929a9d82 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 932 time: 0.1962268 Dec 21 04:01:10.512978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Allocated IP 172.20.0.5 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/5f182293-8d1b-4f6b-8248-4b78e1bf55c3) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:10.573847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] For port 408499a9-a6b4-445d-96c5-773432a9bd6d, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=408499a9-a6b4-445d-96c5-773432a9bd6d,segment=NetworkSegment(9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4),segment_id=9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:10.574222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.599776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:10.603553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.624739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Calling delete_port for 408499a9-a6b4-445d-96c5-773432a9bd6d owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:10.653780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cde9583-1817-4319-9aa8-3a126eb00baa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.685693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95a26292-dca8-4a07-9744-cf41d5b34678 req-c7ae5a19-4bf8-4ee4-a976-7910f07d11f1 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1615930 Dec 21 04:01:10.688118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a7380c5-046f-427a-80db-52911af8a594 req-180cd369-d4a4-43f5-ac09-fa247de01fc1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 210 time: 0.0757537 Dec 21 04:01:10.743197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.840085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0fec7ad4-449b-4560-adaa-725add20128e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:01:10.853838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.863787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cde9583-1817-4319-9aa8-3a126eb00baa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.866552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3cde9583-1817-4319-9aa8-3a126eb00baa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.869592 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3cde9583-1817-4319-9aa8-3a126eb00baa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/ae827e3f-d431-4719-92e9-5ecdf98b5fa9 HTTP/1.1" status: 204 len: 168 time: 0.4822071 Dec 21 04:01:10.872945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.872945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:10.875484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Transition to ACTIVE for port object 0fec7ad4-449b-4560-adaa-725add20128e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:01:10.922580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cde9583-1817-4319-9aa8-3a126eb00baa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae827e3f-d431-4719-92e9-5ecdf98b5fa9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:10.953570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:10.964653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:10.970558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:10.978654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0ffb96cc-41ae-4b78-8beb-82dba89cef3a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1010349 Dec 21 04:01:10.982209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:10.984397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:10.986445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40050) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:11.021541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--771735286'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:11.030162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:11.032842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.056681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.090123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['408499a9-a6b4-445d-96c5-773432a9bd6d'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:11.114490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Pushing event updated for resources: {'Port': ['ID=0fec7ad4-449b-4560-adaa-725add20128e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:11.134999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-a0261c57-211e-444d-9f72-65a60ec6c7ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5191367 Dec 21 04:01:11.170668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Request body: {'port': {'device_id': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:11.191514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Pushing event deleted for resources: {'Port': ['ID=408499a9-a6b4-445d-96c5-773432a9bd6d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:11.193547 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.239119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] No DVR routers for this DVR port 408499a9-a6b4-445d-96c5-773432a9bd6d on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:11.251740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.271102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.271963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a850db9-42b7-4d5f-a7bd-624bf1d088ae req-cdb67c9d-0a21-41e1-a987-5d046b84dfc3 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.31 "DELETE /v2.0/ports/408499a9-a6b4-445d-96c5-773432a9bd6d HTTP/1.1" status: 204 len: 173 time: 1.3106029 Dec 21 04:01:11.272451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'name': 'network-vif-deleted', 'tag': '408499a9-a6b4-445d-96c5-773432a9bd6d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:11.275303 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f200b416-3e49-4ea4-a7c5-523428318f80" -d '{"events": [{"server_uuid": "0bafc7e8-8562-442e-952d-0820fcd0efbc", "name": "network-vif-deleted", "tag": "408499a9-a6b4-445d-96c5-773432a9bd6d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:11.288435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.315043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2a440e23-640b-475b-a421-699c7a8f8e87 None None] Provisioning complete for port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:11.315525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2a440e23-640b-475b-a421-699c7a8f8e87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.331783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Subnet': ['ID=8c5bfce9-51b9-4cc3-be48-24da4d76de25,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:11.389643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eea6c68a-3403-431b-bdd7-e077e609fbd4 req-a2bf8e99-cd1a-41e6-8cef-3c34ef1234f8 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.0439038 Dec 21 04:01:11.393181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Attempting to bind port 0fec7ad4-449b-4560-adaa-725add20128e on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:11.393519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Attempting to bind port 0fec7ad4-449b-4560-adaa-725add20128e by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '8250d715-d626-4ee8-89bc-d342f729f8bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:11.393850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Attempting to bind port 0fec7ad4-449b-4560-adaa-725add20128e on network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:11.401588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2a440e23-640b-475b-a421-699c7a8f8e87 None None] Port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:01:11.407943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Port 0fec7ad4-449b-4560-adaa-725add20128e on network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:01:11.408653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Attempting to bind port 0fec7ad4-449b-4560-adaa-725add20128e on network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:11.415735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Checking segment: {'id': '202e560e-e265-475f-965a-459f8b2def0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:11.416101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network hostable DHCP agents. Network: 6981d75a-c75c-46dc-8336-a01225378aa5, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:11.435126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:11.435481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Checking segment: {'id': '8250d715-d626-4ee8-89bc-d342f729f8bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:11.435859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Bound using segment: {'id': '8250d715-d626-4ee8-89bc-d342f729f8bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:11.436305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Bound port: 0fec7ad4-449b-4560-adaa-725add20128e, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8250d715-d626-4ee8-89bc-d342f729f8bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:11.436689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.459983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18d95301-64f8-4d91-aaed-7c17c1c3cc43 req-3a0e6ed1-b992-4c52-af18-27af51d5e60a tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0482752 Dec 21 04:01:11.466741 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9e57833-8be0-466c-a1aa-da8dabfd7bd2 x-openstack-request-id: req-d9e57833-8be0-466c-a1aa-da8dabfd7bd2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:11.467110 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0bafc7e8-8562-442e-952d-0820fcd0efbc", "name": "network-vif-deleted", "tag": "408499a9-a6b4-445d-96c5-773432a9bd6d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:11.467375 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d9e57833-8be0-466c-a1aa-da8dabfd7bd2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:11.468312 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0bafc7e8-8562-442e-952d-0820fcd0efbc', 'name': 'network-vif-deleted', 'tag': '408499a9-a6b4-445d-96c5-773432a9bd6d', 'status': 'completed', 'code': 200} Dec 21 04:01:11.528680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.555728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] For port 0fec7ad4-449b-4560-adaa-725add20128e, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:11.559437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] For port 0fec7ad4-449b-4560-adaa-725add20128e, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0fec7ad4-449b-4560-adaa-725add20128e,segment=NetworkSegment(8250d715-d626-4ee8-89bc-d342f729f8bf),segment_id=8250d715-d626-4ee8-89bc-d342f729f8bf)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:11.560906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 6981d75a-c75c-46dc-8336-a01225378aa5 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:11.640656 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.645179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:01:11.652602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.666103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Transition to ACTIVE for port object 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:01:11.670630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f16c9e29-7aeb-4440-8e1c-869488043dd1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:11.686651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.688710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6981d75a-c75c-46dc-8336-a01225378aa5) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:11.698042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:11.698621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.701149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-604f0ddf-c635-4443-8451-046d50bf7498 None None] Network 6981d75a-c75c-46dc-8336-a01225378aa5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:11.741459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:11.742172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.743758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] 10.222.0.54 "PUT /v2.0/ports/0fec7ad4-449b-4560-adaa-725add20128e HTTP/1.1" status: 200 len: 1093 time: 1.9318886 Dec 21 04:01:11.761546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4dea23e-cc04-470f-820e-a8c938003696 service neutron] Pushing event updated for resources: {'Port': ['ID=0fec7ad4-449b-4560-adaa-725add20128e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:11.783853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.795915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.797510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c649f6f8-cf10-4bf8-a8dd-6922bdbf1829 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7849426 Dec 21 04:01:11.811770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40064) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:11.819971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--1927988968'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:11.858127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c2caf134-610a-43eb-82c3-c7b0144f8d96 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.8458445 Dec 21 04:01:11.861335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40066) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:11.870121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-128377171'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:11.882132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Pushing event updated for resources: {'Port': ['ID=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:11.884811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab983e7-4038-4c78-998a-9f5b3b61b447 req-75e783fe-261d-45b8-958b-9ba3fc48993b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:11.887146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cab983e7-4038-4c78-998a-9f5b3b61b447 req-75e783fe-261d-45b8-958b-9ba3fc48993b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 943 time: 0.1072283 Dec 21 04:01:11.893544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-6981d75a-c75c-46dc-8336-a01225378aa5', 'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5', 'project_id': '88059222e23e4ffe964b06da62041a8f', 'fixed_ips': [{'subnet_id': '8c5bfce9-51b9-4cc3-be48-24da4d76de25'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:11.894979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:11.903898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b58faee6-8c17-4df9-b224-2c35e09f3cb2 req-09ae8bca-069a-432d-80d6-72f1940725a1 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:11.906443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b58faee6-8c17-4df9-b224-2c35e09f3cb2 req-09ae8bca-069a-432d-80d6-72f1940725a1 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 944 time: 0.0911043 Dec 21 04:01:12.003618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Attempting to bind port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:12.003986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Attempting to bind port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:12.004293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Attempting to bind port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:12.025008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:01:12.025410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Attempting to bind port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:12.045578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.062762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:12.063180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:12.063523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:12.066214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Bound port: 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:12.066563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.077082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Allocated IP 2001:db8:0:ffff::2 (6981d75a-c75c-46dc-8336-a01225378aa5/8c5bfce9-51b9-4cc3-be48-24da4d76de25/6472c600-12fc-4e07-b038-3ebd979eda8a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:12.088658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:12.098701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.214777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:12.250206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.250442 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Added segment 6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0 of type vlan for network 039e2e71-3afc-438b-a266-b2d98c0ed5eb Dec 21 04:01:12.306812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] For port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:12.320523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.335916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.346886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] For port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:12.355039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.389330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.389616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cab983e7-4038-4c78-998a-9f5b3b61b447 req-318d051f-33d7-4e96-9a10-c6c9ae9eb6c0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4815919 Dec 21 04:01:12.400166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b58faee6-8c17-4df9-b224-2c35e09f3cb2 req-98adc6df-1820-4040-a93b-ea488e079a8d tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4772644 Dec 21 04:01:12.407891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-51455f7e-a27b-4e5d-a004-87f5ae01a28c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:12.409296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-51455f7e-a27b-4e5d-a004-87f5ae01a28c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=890fa4dd6439485583f4cba0fdc68fad&device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 1096 time: 0.4678030 Dec 21 04:01:12.433871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Network 6981d75a-c75c-46dc-8336-a01225378aa5 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:12.439798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:12.447584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:12.463829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.468288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-d9dd0868-b201-4513-a5b4-31d0bce62b4e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0fec7ad4-449b-4560-adaa-725add20128e HTTP/1.1" status: 200 len: 217 time: 0.0399489 Dec 21 04:01:12.469274 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.522187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Pushing event updated for resources: {'Port': ['ID=6472c600-12fc-4e07-b038-3ebd979eda8a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:12.527469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee54866-a7c5-4273-b62e-ada53636d900 req-5968431d-974e-491e-a24a-641df0d94de8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:12.529640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-5968431d-974e-491e-a24a-641df0d94de8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ccaea876-d935-4c88-9da6-3335d0dadf82 HTTP/1.1" status: 200 len: 849 time: 0.0541077 Dec 21 04:01:12.536244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:12.536639 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.539038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] 10.222.0.54 "PUT /v2.0/ports/5f182293-8d1b-4f6b-8248-4b78e1bf55c3 HTTP/1.1" status: 200 len: 1092 time: 1.3726389 Dec 21 04:01:12.552147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'tag': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:12.553860 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-230eb623-95bb-4a99-b135-df31f72f0d34" -d '{"events": [{"name": "network-changed", "server_uuid": "314db627-a3fc-4d84-ae0e-a2b0ebb8aecb", "tag": "5f182293-8d1b-4f6b-8248-4b78e1bf55c3"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:12.556581 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.565400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:12.566047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.580098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Attempting to bind port 6472c600-12fc-4e07-b038-3ebd979eda8a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:12.592899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-04fe58fd-a006-4fff-934d-7e567d4df98e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0294b34c-30ec-4139-9cf8-4180cbf6aee4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0352592 Dec 21 04:01:12.593739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Attempting to bind port 6472c600-12fc-4e07-b038-3ebd979eda8a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '202e560e-e265-475f-965a-459f8b2def0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:12.593739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Attempting to bind port 6472c600-12fc-4e07-b038-3ebd979eda8a on network 6981d75a-c75c-46dc-8336-a01225378aa5 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:12.620940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:12.625531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Checking segment: {'id': '202e560e-e265-475f-965a-459f8b2def0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:12.627519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.628595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Bound using segment: {'id': '202e560e-e265-475f-965a-459f8b2def0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:12.629816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Bound port: 6472c600-12fc-4e07-b038-3ebd979eda8a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '202e560e-e265-475f-965a-459f8b2def0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '6981d75a-c75c-46dc-8336-a01225378aa5'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:12.633646 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.669074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8ae6ec0-de13-484b-8797-51cc72889128 req-f7ebf3c0-45ab-44a9-8d9e-e1f2f0d384e2 tempest-InstanceActionsV221TestJSON-352792582 tempest-InstanceActionsV221TestJSON-352792582-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bafc7e8-8562-442e-952d-0820fcd0efbc HTTP/1.1" status: 200 len: 210 time: 0.1230683 Dec 21 04:01:12.671325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Network': ['ID=039e2e71-3afc-438b-a266-b2d98c0ed5eb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:12.713613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7755a7af-9091-4809-a70d-7d42be3ceda7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:12.721903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51521b3d-2349-45e7-88f8-9410b7c0bfe6 service neutron] Pushing event updated for resources: {'Port': ['ID=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:12.726730 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5a0ca3b-d4c7-4509-b080-33ec3ccd4551 x-openstack-request-id: req-c5a0ca3b-d4c7-4509-b080-33ec3ccd4551 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:12.727213 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "314db627-a3fc-4d84-ae0e-a2b0ebb8aecb", "tag": "5f182293-8d1b-4f6b-8248-4b78e1bf55c3", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:12.727485 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c5a0ca3b-d4c7-4509-b080-33ec3ccd4551 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:12.728016 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'tag': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'status': 'completed', 'code': 200} Dec 21 04:01:12.732318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 039e2e71-3afc-438b-a266-b2d98c0ed5eb details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:12.746220 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e2f73d9-b4a5-451a-9821-a9b4ca2769d5 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.8778079 Dec 21 04:01:12.751422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40076) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:12.756904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'subnet': {'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:12.786730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:12.791363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b67931ac-b901-4fa4-8dc3-01156553d66a tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.9784951 Dec 21 04:01:12.792023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40078) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:12.803550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'f16c9e29-7aeb-4440-8e1c-869488043dd1', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '7755a7af-9091-4809-a70d-7d42be3ceda7', 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:12.833191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-b7f5bacf-7b20-494f-95e3-4f835fddca55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:12.833191 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-b7f5bacf-7b20-494f-95e3-4f835fddca55 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 1095 time: 0.0842745 Dec 21 04:01:12.858917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb5592fd-8829-4961-884e-ca78d633f232 req-cca55760-a605-4d78-8553-6ea5bbc63df8 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.2146335 Dec 21 04:01:12.887524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-5dc10340-f748-4059-80d8-ba53f0f9b556 service neutron] 10.222.0.54 "GET /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2946630 Dec 21 04:01:12.903703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] For port 6472c600-12fc-4e07-b038-3ebd979eda8a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:12.918915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] For port 6472c600-12fc-4e07-b038-3ebd979eda8a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6472c600-12fc-4e07-b038-3ebd979eda8a,segment=NetworkSegment(202e560e-e265-475f-965a-459f8b2def0e),segment_id=202e560e-e265-475f-965a-459f8b2def0e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:12.928793 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-393c2de1-f7ce-47ec-be64-c1b880f6b056 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3 HTTP/1.1" status: 200 len: 217 time: 0.0844095 Dec 21 04:01:12.982964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.000630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-9ca8a874-c244-4218-86a2-cf738d6336c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.001742 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-9ca8a874-c244-4218-86a2-cf738d6336c9 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0659664 Dec 21 04:01:13.006328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bee54866-a7c5-4273-b62e-ada53636d900 req-f66cf998-c2ab-4702-9fd9-be9dc7a9af31 service neutron] 10.222.0.54 "GET /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1110463 Dec 21 04:01:13.069342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.094813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-059964f7-a6d0-45c5-877f-d5a4686a8f97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.096467 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-059964f7-a6d0-45c5-877f-d5a4686a8f97 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0769176 Dec 21 04:01:13.098017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:13.102324 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.107576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.148645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8412d660-1e4f-46bb-a171-f44d5ee6c65b None None] Pushing event updated for resources: {'Port': ['ID=6472c600-12fc-4e07-b038-3ebd979eda8a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:13.195817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.230911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=93b415c3-0cf3-46d1-97f1-5bae5b308232,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:13.235834 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-165d93fb-fedb-41ce-851b-fb42d8377e24 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1281090 Dec 21 04:01:13.318262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.318262 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-239a55b0-71ab-4eda-8f36-4c491224e2c5 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.5233672 Dec 21 04:01:13.323454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40080) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:13.376338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4074a3a1-cf75-4444-bd0d-3b4afc027a66 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.391329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4074a3a1-cf75-4444-bd0d-3b4afc027a66 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.417699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d90b3ff1-bd12-4c97-8121-f6b80813cc22 req-35e7e405-694f-4f82-a9b4-528bd5f0cca3 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1742642 Dec 21 04:01:13.469113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'tag': '0fec7ad4-449b-4560-adaa-725add20128e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:13.471436 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-901be820-9cd2-4ef6-8ff9-950729139211" -d '{"events": [{"name": "network-changed", "server_uuid": "0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b", "tag": "0fec7ad4-449b-4560-adaa-725add20128e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:13.491721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4074a3a1-cf75-4444-bd0d-3b4afc027a66 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.501802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4074a3a1-cf75-4444-bd0d-3b4afc027a66 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.506513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4074a3a1-cf75-4444-bd0d-3b4afc027a66 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/93b415c3-0cf3-46d1-97f1-5bae5b308232 HTTP/1.1" status: 204 len: 168 time: 0.1749747 Dec 21 04:01:13.507175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40088) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:13.528719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4074a3a1-cf75-4444-bd0d-3b4afc027a66 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=93b415c3-0cf3-46d1-97f1-5bae5b308232,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:13.539938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:01:13.554781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.581792 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2396e062-400c-411a-952d-c324cc3e63a0 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0676954 Dec 21 04:01:13.592277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40092) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:13.668095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-b63eab67-5713-43bb-919f-0303f5c9b214 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.669732 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-b63eab67-5713-43bb-919f-0303f5c9b214 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 1095 time: 0.0876818 Dec 21 04:01:13.699053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c188e842-30e6-411a-8d0e-f136bcf11f96 req-74edc862-a61e-4874-92e3-2bf39db149da tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.700637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c188e842-30e6-411a-8d0e-f136bcf11f96 req-74edc862-a61e-4874-92e3-2bf39db149da tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 944 time: 0.1801786 Dec 21 04:01:13.701298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Subnet': ['ID=2b629a2f-be46-4af9-b010-cc41474aae62,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:13.713950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd0c4d86-acc6-4c61-a9d2-9aa7e4602602 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.716968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facb3f8f-7641-487f-90e8-a997e89bfcea req-59655968-2392-444e-a467-ad81a84fe74c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.718575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-facb3f8f-7641-487f-90e8-a997e89bfcea req-59655968-2392-444e-a467-ad81a84fe74c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 943 time: 0.1662571 Dec 21 04:01:13.748803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Checking segment: {'id': '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:13.749733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network hostable DHCP agents. Network: 039e2e71-3afc-438b-a266-b2d98c0ed5eb, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:13.774283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd0c4d86-acc6-4c61-a9d2-9aa7e4602602 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.817751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c188e842-30e6-411a-8d0e-f136bcf11f96 req-d10a331f-403c-4822-9450-d99d1fc0e742 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981052 Dec 21 04:01:13.820051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-598832c5-dde7-4a27-9532-041b4da78e77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.821837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-facb3f8f-7641-487f-90e8-a997e89bfcea req-14299350-992c-4943-8079-cd82919997af tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912635 Dec 21 04:01:13.821961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-598832c5-dde7-4a27-9532-041b4da78e77 service neutron] 10.222.0.54 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.1428158 Dec 21 04:01:13.869020 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-d15445e8-2e90-4f54-aaa2-9882aeb0b7a3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3 HTTP/1.1" status: 200 len: 217 time: 0.0381551 Dec 21 04:01:13.880733 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ce0f01c-7289-4af0-b335-3f50ec7e666a x-openstack-request-id: req-4ce0f01c-7289-4af0-b335-3f50ec7e666a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:13.881254 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b", "tag": "0fec7ad4-449b-4560-adaa-725add20128e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:13.881401 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4ce0f01c-7289-4af0-b335-3f50ec7e666a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:13.881904 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'tag': '0fec7ad4-449b-4560-adaa-725add20128e', 'status': 'completed', 'code': 200} Dec 21 04:01:13.891492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 039e2e71-3afc-438b-a266-b2d98c0ed5eb is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:13.925257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd0c4d86-acc6-4c61-a9d2-9aa7e4602602 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.928122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd0c4d86-acc6-4c61-a9d2-9aa7e4602602 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:13.929024 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dd0c4d86-acc6-4c61-a9d2-9aa7e4602602 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/7755a7af-9091-4809-a70d-7d42be3ceda7 HTTP/1.1" status: 204 len: 168 time: 0.3383636 Dec 21 04:01:13.931824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40100) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:13.949092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0c4d86-acc6-4c61-a9d2-9aa7e4602602 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7755a7af-9091-4809-a70d-7d42be3ceda7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:13.957778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-dd763e8c-8a73-43ef-a187-f85c121d4196 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:13.960132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-dd763e8c-8a73-43ef-a187-f85c121d4196 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0834565 Dec 21 04:01:14.023390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 039e2e71-3afc-438b-a266-b2d98c0ed5eb) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:14.034255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f5e238a-52cb-4a85-a25e-8be4f46da850 None None] Network 039e2e71-3afc-438b-a266-b2d98c0ed5eb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:14.049118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:14.049714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.055104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a71dbd2-645f-4387-be5f-ab7b73ca6f92 req-493444a2-8ee1-49cb-a899-b1c90ad70e20 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0583413 Dec 21 04:01:14.056464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-07fc8315-6c6c-4db6-a74b-9190376443dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:14.070883 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-07fc8315-6c6c-4db6-a74b-9190376443dc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0950401 Dec 21 04:01:14.134283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6d503cbd-a01e-4b97-bfbe-7e9b97177b7f tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.2012103 Dec 21 04:01:14.137698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901be820-9cd2-4ef6-8ff9-950729139211 req-7740b37e-5861-4f3e-8898-7d8bc40446b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:14.139257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-7740b37e-5861-4f3e-8898-7d8bc40446b5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=890fa4dd6439485583f4cba0fdc68fad&device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 1096 time: 0.1940343 Dec 21 04:01:14.139780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40106) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:14.185472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:14.226213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a7062e6-1639-4639-864b-80f36a620318 req-7aa3f61a-874c-45fc-af35-2613a670b4f8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.0842414 Dec 21 04:01:14.232835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-039e2e71-3afc-438b-a266-b2d98c0ed5eb', 'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb', 'project_id': '88059222e23e4ffe964b06da62041a8f', 'fixed_ips': [{'subnet_id': '2b629a2f-be46-4af9-b010-cc41474aae62'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:14.234665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.239446 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-1f734870-07d7-4bc8-95d2-6da3e44f3dc7 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1433702 Dec 21 04:01:14.258540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aeb68633-caf7-409c-bb14-cddca37fd03e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.5034559 Dec 21 04:01:14.266398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:14.275521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'port': {'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb', 'name': 'tempest-NetworksIpV6TestAttrs-1539773484'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:14.353422 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-230eb623-95bb-4a99-b135-df31f72f0d34 req-dcbefc82-4e3f-4ca3-be27-558fe3acf8eb service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1051641 Dec 21 04:01:14.391922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Deleting subnet e06ba303-a715-4bb3-b025-83150e545fdd {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:14.400963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.418131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 408499a9-a6b4-445d-96c5-773432a9bd6d no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:14.423264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Allocated IP 2001:db8::f816:3eff:fe0c:6b2 (039e2e71-3afc-438b-a266-b2d98c0ed5eb/2b629a2f-be46-4af9-b010-cc41474aae62/a3f0a5f7-5413-4352-bb95-1897d3fcd21f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:14.445602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 408499a9-a6b4-445d-96c5-773432a9bd6d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:01:14.446019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 408499a9-a6b4-445d-96c5-773432a9bd6d not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:01:14.461633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404c9280-5fb5-45d7-b7b6-14dd4d99a1ab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.468515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901be820-9cd2-4ef6-8ff9-950729139211 req-108efd49-1f1f-49f6-9d1d-1d991a1c822b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:14.470018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-108efd49-1f1f-49f6-9d1d-1d991a1c822b service neutron] 10.222.0.54 "GET /v2.0/networks?id=0294b34c-30ec-4139-9cf8-4180cbf6aee4 HTTP/1.1" status: 200 len: 910 time: 0.3088830 Dec 21 04:01:14.488137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f72d529-c19f-49f8-a378-a1e60ca6567d None None] Network 6981d75a-c75c-46dc-8336-a01225378aa5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:14.495753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.576459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404c9280-5fb5-45d7-b7b6-14dd4d99a1ab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.582639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-4a731841-00ac-4d1b-8cac-1502bfd52ad4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0fec7ad4-449b-4560-adaa-725add20128e HTTP/1.1" status: 200 len: 217 time: 0.1018662 Dec 21 04:01:14.615268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3d37ef58-2e16-407e-8a9c-3e3cdb1a2123 None None] Provisioning complete for port 6472c600-12fc-4e07-b038-3ebd979eda8a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:14.615268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d37ef58-2e16-407e-8a9c-3e3cdb1a2123 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.672918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.715098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901be820-9cd2-4ef6-8ff9-950729139211 req-c84b20f2-ee72-4959-824f-5a06683646eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:14.716587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-c84b20f2-ee72-4959-824f-5a06683646eb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ccaea876-d935-4c88-9da6-3335d0dadf82 HTTP/1.1" status: 200 len: 849 time: 0.1205530 Dec 21 04:01:14.748681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6472c600-12fc-4e07-b038-3ebd979eda8a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:14.752590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.758211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-e91da4ba-f577-441f-98e0-a044e231c090 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0294b34c-30ec-4139-9cf8-4180cbf6aee4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315804 Dec 21 04:01:14.822069 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d37ef58-2e16-407e-8a9c-3e3cdb1a2123 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.830032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404c9280-5fb5-45d7-b7b6-14dd4d99a1ab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.832729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404c9280-5fb5-45d7-b7b6-14dd4d99a1ab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.834008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-404c9280-5fb5-45d7-b7b6-14dd4d99a1ab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/f16c9e29-7aeb-4440-8e1c-869488043dd1 HTTP/1.1" status: 204 len: 168 time: 0.6932898 Dec 21 04:01:14.836616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40112) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:14.870353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3d37ef58-2e16-407e-8a9c-3e3cdb1a2123 None None] For port 6472c600-12fc-4e07-b038-3ebd979eda8a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6472c600-12fc-4e07-b038-3ebd979eda8a,segment=NetworkSegment(202e560e-e265-475f-965a-459f8b2def0e),segment_id=202e560e-e265-475f-965a-459f8b2def0e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:14.872256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6472c600-12fc-4e07-b038-3ebd979eda8a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:14.872635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.891334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:14.895056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.905966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404c9280-5fb5-45d7-b7b6-14dd4d99a1ab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f16c9e29-7aeb-4440-8e1c-869488043dd1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:14.907357 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-40ba6620-4e85-4c95-bd2a-3afac8bc145c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0688510 Dec 21 04:01:14.912560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40118) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:14.918974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--1093065402'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:14.947661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:14.956925 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.001899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d37ef58-2e16-407e-8a9c-3e3cdb1a2123 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.009110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e06ba303-a715-4bb3-b025-83150e545fdd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.011938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] device_id is not set on port abafce24-40aa-42d5-a2f4-06223cba835a yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:01:15.037369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Pushing event updated for resources: {'Port': ['ID=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.040145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.048305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Network 039e2e71-3afc-438b-a266-b2d98c0ed5eb is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:15.050724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:15.085598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:15.134562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.137832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fd97f53f-7b59-4a2c-8d52-e762444b1e21 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/e06ba303-a715-4bb3-b025-83150e545fdd HTTP/1.1" status: 204 len: 168 time: 0.9331214 Dec 21 04:01:15.146607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-7f69183d-5745-477f-86c5-2555ef17d6c6 service neutron] 10.222.0.54 "GET /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3787131 Dec 21 04:01:15.153412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:15.156864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.177561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d37ef58-2e16-407e-8a9c-3e3cdb1a2123 None None] Pushing event updated for resources: {'Port': ['ID=6472c600-12fc-4e07-b038-3ebd979eda8a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.216522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5b562f75-7c26-4c98-a602-27fe4b916a4a None None] Provisioning complete for port 6472c600-12fc-4e07-b038-3ebd979eda8a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:15.220540 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b562f75-7c26-4c98-a602-27fe4b916a4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.220692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.220813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Attempting to bind port a3f0a5f7-5413-4352-bb95-1897d3fcd21f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:15.220813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Attempting to bind port a3f0a5f7-5413-4352-bb95-1897d3fcd21f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:15.220813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Attempting to bind port a3f0a5f7-5413-4352-bb95-1897d3fcd21f on network 039e2e71-3afc-438b-a266-b2d98c0ed5eb {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:15.244729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:15.249569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Checking segment: {'id': '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:15.249569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.249569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Bound using segment: {'id': '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:15.249569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Bound port: a3f0a5f7-5413-4352-bb95-1897d3fcd21f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '039e2e71-3afc-438b-a266-b2d98c0ed5eb'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:15.249569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.268090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47641dc9-fd78-45bf-9ea9-704bb59863c6 req-297d638a-8557-49ca-8d36-8bfb199ff3f6 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:15.270072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3d7f9e8-3481-4cc3-b22a-5977721a402a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.271417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47641dc9-fd78-45bf-9ea9-704bb59863c6 req-297d638a-8557-49ca-8d36-8bfb199ff3f6 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 944 time: 0.2703581 Dec 21 04:01:15.274872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-769366ad-9a47-43a7-ab7b-daea747c23fc req-b60fbd4b-c5d4-44b9-abcb-962ace0f4a0b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0787446 Dec 21 04:01:15.328934 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.333424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4f3877c0-456f-4c27-9baa-b7f265bef0fa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4197240 Dec 21 04:01:15.334247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:15.338755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'f3d7f9e8-3481-4cc3-b22a-5977721a402a', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:15.368389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] For port a3f0a5f7-5413-4352-bb95-1897d3fcd21f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:15.372908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] For port a3f0a5f7-5413-4352-bb95-1897d3fcd21f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,segment=NetworkSegment(6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0),segment_id=6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:15.398282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-087fba86-648f-48d2-90b6-dc5f4d26014d req-fb72f158-5e38-488b-8cd2-2bffad7edbc6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:15.399719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-087fba86-648f-48d2-90b6-dc5f4d26014d req-fb72f158-5e38-488b-8cd2-2bffad7edbc6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 943 time: 0.3918583 Dec 21 04:01:15.428539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.436344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.446417 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.473117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Allocated IP 2001:db8::f816:3eff:fe80:cb2f (039e2e71-3afc-438b-a266-b2d98c0ed5eb/2b629a2f-be46-4af9-b010-cc41474aae62/abafce24-40aa-42d5-a2f4-06223cba835a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:15.492427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.513597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4f2791-662d-4b58-9ea6-e81a7b0f0031 None None] Pushing event updated for resources: {'Port': ['ID=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.517532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901be820-9cd2-4ef6-8ff9-950729139211 req-d19b1619-12f6-4b62-96fe-a6130bbc943a service neutron] 10.222.0.54 "GET /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3563049 Dec 21 04:01:15.524071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47641dc9-fd78-45bf-9ea9-704bb59863c6 req-e92fe112-9c79-41c7-8bf3-eb035b8830ed tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2482188 Dec 21 04:01:15.565918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-087fba86-648f-48d2-90b6-dc5f4d26014d req-c138a539-37df-41eb-86e8-54d5fb4a8c77 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1524460 Dec 21 04:01:15.571708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.603799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc16bdd2-21b3-4783-883e-9a4c68f757a0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.642392 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.664761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.666967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-765ecbe1-001a-4143-99c8-751e1df0343d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3308306 Dec 21 04:01:15.668991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:15.710804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b632d49-bc8a-4f7d-b433-7c4b707a95a5']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:15.712871 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa199cb-a897-44a3-92e3-b91c4dbcd6a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.721882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa199cb-a897-44a3-92e3-b91c4dbcd6a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.750147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:15.750401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9c8d89a1-9b6c-4801-8cd9-3e44fa08fae4') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:15.758049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0bfcf4e-2ceb-478f-b87c-dea4825a88e8 req-9150a158-70e9-4690-af9a-87931cec0d76 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0698335 Dec 21 04:01:15.812206 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.824137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0fec7ad4-449b-4560-adaa-725add20128e details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:01:15.833908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.835038 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa199cb-a897-44a3-92e3-b91c4dbcd6a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.847426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa199cb-a897-44a3-92e3-b91c4dbcd6a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.849888 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4fa199cb-a897-44a3-92e3-b91c4dbcd6a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/bc16bdd2-21b3-4783-883e-9a4c68f757a0 HTTP/1.1" status: 204 len: 168 time: 0.1785707 Dec 21 04:01:15.849888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa199cb-a897-44a3-92e3-b91c4dbcd6a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=bc16bdd2-21b3-4783-883e-9a4c68f757a0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:15.850748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Releasing vlan 140 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:15.851805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40130) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:15.852387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:15.854857 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:15.859655 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:15.907538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa432dfe-c4ee-449e-a111-0eab4bd0e65d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0491993 Dec 21 04:01:15.910281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40132) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:15.932276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.967283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a2315cb-d394-430a-a65f-8deeaa33ab83 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:15.973719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0fec7ad4-449b-4560-adaa-725add20128e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0fec7ad4-449b-4560-adaa-725add20128e,segment=NetworkSegment(8250d715-d626-4ee8-89bc-d342f729f8bf),segment_id=8250d715-d626-4ee8-89bc-d342f729f8bf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:15.986909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '0fec7ad4-449b-4560-adaa-725add20128e', 'network_id': '0294b34c-30ec-4139-9cf8-4180cbf6aee4', 'port_id': '0fec7ad4-449b-4560-adaa-725add20128e', 'mac_address': 'fa:16:3e:38:aa:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ccaea876-d935-4c88-9da6-3335d0dadf82', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:01:15.999017 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a2315cb-d394-430a-a65f-8deeaa33ab83 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.017897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.033631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.039504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] 10.222.0.18 "DELETE /v2.0/networks/9b632d49-bc8a-4f7d-b433-7c4b707a95a5 HTTP/1.1" status: 204 len: 168 time: 0.8825703 Dec 21 04:01:16.052992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6271fa29-1dbd-416c-9b12-10d5d8ee2231 admin admin] Pushing event deleted for resources: {'Network': ['ID=9b632d49-bc8a-4f7d-b433-7c4b707a95a5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:16.058340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.092124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a2315cb-d394-430a-a65f-8deeaa33ab83 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.095472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a2315cb-d394-430a-a65f-8deeaa33ab83 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.096693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4a2315cb-d394-430a-a65f-8deeaa33ab83 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/f3d7f9e8-3481-4cc3-b22a-5977721a402a HTTP/1.1" status: 204 len: 168 time: 0.1852579 Dec 21 04:01:16.101029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40136) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.135061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 039e2e71-3afc-438b-a266-b2d98c0ed5eb is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:16.147328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:16.151278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:16.159000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a2315cb-d394-430a-a65f-8deeaa33ab83 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3d7f9e8-3481-4cc3-b22a-5977721a402a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:16.166869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:16.167559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.174319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Port': ['ID=abafce24-40aa-42d5-a2f4-06223cba835a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:16.207264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1ccd39bb-0fd9-47ef-a681-3f553ae4670d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1037834 Dec 21 04:01:16.210735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40138) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.215406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--139407079'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:16.219384 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.233127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0fec7ad4-449b-4560-adaa-725add20128e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:01:16.254006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0fec7ad4-449b-4560-adaa-725add20128e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0fec7ad4-449b-4560-adaa-725add20128e,segment=NetworkSegment(8250d715-d626-4ee8-89bc-d342f729f8bf),segment_id=8250d715-d626-4ee8-89bc-d342f729f8bf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:16.272101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f3e1d216-b20e-4e7c-8151-e7b09fb1c4a7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 2.0046005 Dec 21 04:01:16.278289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.333616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting subnet 2b629a2f-be46-4af9-b010-cc41474aae62 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:16.337118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.364123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.365225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:01:16.380059 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.391674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.431680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.449315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0fec7ad4-449b-4560-adaa-725add20128e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:16.531213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-faa1a2bf-6c8f-4eb8-91e8-591c9a2756ae admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3d5a6f8a2e664539a37470e2d2eb3477&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0965784 Dec 21 04:01:16.533703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40144) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.559438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.588171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:16.617894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.641730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'mac_address': 'fa:16:3e:87:a4:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:01:16.672663 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e2934922-1f6c-49b1-8bf0-261bbfc4082d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.723037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.730830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.752888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:01:16.766775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.773149 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e2934922-1f6c-49b1-8bf0-261bbfc4082d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.782257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:16.803309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Subnet': ['ID=2b629a2f-be46-4af9-b010-cc41474aae62,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:16.807935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.818983 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-35809c25-e13f-4a4d-b2d8-44228b6d6516 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/2b629a2f-be46-4af9-b010-cc41474aae62 HTTP/1.1" status: 204 len: 168 time: 0.5376096 Dec 21 04:01:16.819524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40154) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.844749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b0f1b30c-71b5-41ce-9d47-180d283c7e8f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:16.854493 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.872590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6643e623-1896-49e6-b162-b8f8812e0c76 req-03638a76-f97a-4d4a-a467-2751711f0e50 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:16.882780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6643e623-1896-49e6-b162-b8f8812e0c76 req-03638a76-f97a-4d4a-a467-2751711f0e50 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 945 time: 0.2025306 Dec 21 04:01:16.893573 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:16.894834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4e8ca1c7-34dc-4ac7-87d2-cb49a2dd370d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6830039 Dec 21 04:01:16.898167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40156) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.899055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80fa71f5-b73f-4b0d-bc6b-0cf7a5b5293d None None] Network 039e2e71-3afc-438b-a266-b2d98c0ed5eb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:16.901621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a3f0a5f7-5413-4352-bb95-1897d3fcd21f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:16.911334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'b0f1b30c-71b5-41ce-9d47-180d283c7e8f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:16.918394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25134c09-8e8b-4e94-9647-7deffa23ae41 req-b6b58e00-b1c3-4464-a0c0-a9e2f811628b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:16.920258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25134c09-8e8b-4e94-9647-7deffa23ae41 req-b6b58e00-b1c3-4464-a0c0-a9e2f811628b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 943 time: 0.1959612 Dec 21 04:01:16.952347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fc24207-8b4c-433b-9c44-3d386beaaf9d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:16.954140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fc24207-8b4c-433b-9c44-3d386beaaf9d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:16.955732 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5fc24207-8b4c-433b-9c44-3d386beaaf9d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1351764 Dec 21 04:01:16.959165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40158) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:16.969061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6643e623-1896-49e6-b162-b8f8812e0c76 req-eb171161-9427-4678-bc09-fabc4c5c62b3 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852928 Dec 21 04:01:17.027609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25134c09-8e8b-4e94-9647-7deffa23ae41 req-c740170b-5a93-4380-a9e3-e63908dc44fa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948353 Dec 21 04:01:17.028984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e2934922-1f6c-49b1-8bf0-261bbfc4082d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.032566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e2934922-1f6c-49b1-8bf0-261bbfc4082d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.038514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e2934922-1f6c-49b1-8bf0-261bbfc4082d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a82789bc-2b38-4445-a730-65e2a8ec8a7c HTTP/1.1" status: 204 len: 168 time: 0.4993315 Dec 21 04:01:17.043083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2934922-1f6c-49b1-8bf0-261bbfc4082d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a82789bc-2b38-4445-a730-65e2a8ec8a7c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:17.048557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4445e4e7-446d-4f65-a6b7-70ba75e4cbe0 None None] Provisioning complete for port a3f0a5f7-5413-4352-bb95-1897d3fcd21f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:17.048894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4445e4e7-446d-4f65-a6b7-70ba75e4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.078982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.115567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:17.128368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-885e6479-2073-4826-81c3-0f51b092387c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.145563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d622613-9db0-4c06-9fe8-6609b1791ecc req-fe623057-2ed6-4ffa-af81-578219202423 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0359023 Dec 21 04:01:17.157900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a3f0a5f7-5413-4352-bb95-1897d3fcd21f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:17.158584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.177160 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-885e6479-2073-4826-81c3-0f51b092387c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): There was a conflict when trying to complete your request. Dec 21 04:01:17.177622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-885e6479-2073-4826-81c3-0f51b092387c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:17.182994 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-885e6479-2073-4826-81c3-0f51b092387c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/039e2e71-3afc-438b-a266-b2d98c0ed5eb HTTP/1.1" status: 409 len: 466 time: 0.2205958 Dec 21 04:01:17.184516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.191702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-77118044'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:17.216936 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.245527 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4445e4e7-446d-4f65-a6b7-70ba75e4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.274436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:17.289624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.289964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0fec7ad4-449b-4560-adaa-725add20128e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:17.314494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:17.318715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.323458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3543209-52c1-4661-bca8-fcfc7b8de5e5,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:17.348076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:17.349167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] DHCP port deletion for 039e2e71-3afc-438b-a266-b2d98c0ed5eb request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:01:17.357799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.358851 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Added segment 57c75d15-2579-461a-89fc-bb7b08ffd070 of type vlan for network 5dd629d7-a995-496a-9399-8430de7984d6 Dec 21 04:01:17.359710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4445e4e7-446d-4f65-a6b7-70ba75e4cbe0 None None] For port a3f0a5f7-5413-4352-bb95-1897d3fcd21f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,segment=NetworkSegment(6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0),segment_id=6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:17.397390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.444012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.447162 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f803df88-e7c5-4278-b353-d398febfb32c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5476587 Dec 21 04:01:17.447311 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4445e4e7-446d-4f65-a6b7-70ba75e4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.452069 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.452245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.476631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fc02f82f-874a-4b51-861b-4cabe5da0e1c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules/f3543209-52c1-4661-bca8-fcfc7b8de5e5 HTTP/1.1" status: 200 len: 763 time: 0.0233848 Dec 21 04:01:17.480581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40178) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.497612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.507904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:17.509043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.528332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78b8e430-3642-428e-b0dd-b4cf1f06a58b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0464470 Dec 21 04:01:17.534467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40180) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.558718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6bf60cc-8b32-4497-ac62-8940bda856a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.568054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6bf60cc-8b32-4497-ac62-8940bda856a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.622861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4445e4e7-446d-4f65-a6b7-70ba75e4cbe0 None None] Pushing event updated for resources: {'Port': ['ID=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:17.644918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Network': ['ID=5dd629d7-a995-496a-9399-8430de7984d6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:17.659920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] Deleting port a3f0a5f7-5413-4352-bb95-1897d3fcd21f {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:17.660301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.678107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5dd629d7-a995-496a-9399-8430de7984d6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:17.691313 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:01:17.691701 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:01:17.757229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ffa3b05-7c47-4f57-8b6f-8816800d3ff2 req-11b6d963-6745-4cf9-9787-6f71d2de0d06 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0324979 Dec 21 04:01:17.758876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6bf60cc-8b32-4497-ac62-8940bda856a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.766743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d6bf60cc-8b32-4497-ac62-8940bda856a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.770011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d6bf60cc-8b32-4497-ac62-8940bda856a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/f3543209-52c1-4661-bca8-fcfc7b8de5e5 HTTP/1.1" status: 204 len: 168 time: 0.2356157 Dec 21 04:01:17.770141 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81491f28-c3c1-4ac4-8f40-4075697a7246 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.5828681 Dec 21 04:01:17.770256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40190) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.770346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40192) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.776581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'subnet': {'network_id': '5dd629d7-a995-496a-9399-8430de7984d6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:17.803184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6bf60cc-8b32-4497-ac62-8940bda856a4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f3543209-52c1-4661-bca8-fcfc7b8de5e5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:17.833693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-06c4f54c-ed4b-474e-93c5-9467b299fcfe tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0594873 Dec 21 04:01:17.833929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40194) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:17.839682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'b0f1b30c-71b5-41ce-9d47-180d283c7e8f', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:17.858783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] For port a3f0a5f7-5413-4352-bb95-1897d3fcd21f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,segment=NetworkSegment(6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0),segment_id=6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:17.859303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:17.892851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] Calling delete_port for a3f0a5f7-5413-4352-bb95-1897d3fcd21f owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:17.945387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.025173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.029598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:18.035050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.086236 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.120369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.125166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] Pushing event deleted for resources: {'Port': ['ID=a3f0a5f7-5413-4352-bb95-1897d3fcd21f,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:18.140919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d948a1f7-d648-4ead-b796-003bba7069bb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:18.152203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc1db59f-9a45-4525-8f1c-7e3a60503334 None None] No DVR routers for this DVR port a3f0a5f7-5413-4352-bb95-1897d3fcd21f on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:18.202691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.204492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-094aa7a5-d018-448c-a4fb-8da2b6a6d5a2 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3695710 Dec 21 04:01:18.207078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40214) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:18.233761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Port a3f0a5f7-5413-4352-bb95-1897d3fcd21f update to ACTIVE by agent not found {{(pid=110312) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 21 04:01:18.234134 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b5df7547-e441-4afc-87a2-12f5f601ae49 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules/d948a1f7-d648-4ead-b796-003bba7069bb HTTP/1.1" status: 200 len: 763 time: 0.0241871 Dec 21 04:01:18.235164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6472c600-12fc-4e07-b038-3ebd979eda8a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:18.235876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:18.252027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5c6992-0e64-49c0-9f85-dd25168c2bd4 req-d191609c-0863-44c6-acf0-ed4266369315 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:18.254174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e5c6992-0e64-49c0-9f85-dd25168c2bd4 req-d191609c-0863-44c6-acf0-ed4266369315 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 945 time: 0.2007945 Dec 21 04:01:18.285499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbba488b-4a37-4f4c-a96e-c54362034913 req-6a2eae26-71ab-413c-8728-e17f1ae2b929 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:18.287119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbba488b-4a37-4f4c-a96e-c54362034913 req-6a2eae26-71ab-413c-8728-e17f1ae2b929 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 944 time: 0.1693716 Dec 21 04:01:18.292702 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4106760d-8482-48d0-b88b-aab0c1e17865 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0534878 Dec 21 04:01:18.295166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40220) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:18.318053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6472c600-12fc-4e07-b038-3ebd979eda8a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:18.319229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.328372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-782a6ac6-fa8d-44da-9647-9107a77b2545 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.337331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-782a6ac6-fa8d-44da-9647-9107a77b2545 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.391572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e5c6992-0e64-49c0-9f85-dd25168c2bd4 req-77e2e409-b5db-4167-b226-499efa8d69e5 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1306882 Dec 21 04:01:18.444312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbba488b-4a37-4f4c-a96e-c54362034913 req-9426bfd3-cfea-410c-ac2a-f0cc87d5c132 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334736 Dec 21 04:01:18.480619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-782a6ac6-fa8d-44da-9647-9107a77b2545 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.490457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-782a6ac6-fa8d-44da-9647-9107a77b2545 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.491786 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-782a6ac6-fa8d-44da-9647-9107a77b2545 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/d948a1f7-d648-4ead-b796-003bba7069bb HTTP/1.1" status: 204 len: 168 time: 0.1954892 Dec 21 04:01:18.495710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40228) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:18.496932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-782a6ac6-fa8d-44da-9647-9107a77b2545 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d948a1f7-d648-4ead-b796-003bba7069bb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:18.537404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eb6c865c-de4e-49f6-857b-d820c6f7b37d tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0403650 Dec 21 04:01:18.539946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40230) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:18.544277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': 'b0f1b30c-71b5-41ce-9d47-180d283c7e8f', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:18.682832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a3f0a5f7-5413-4352-bb95-1897d3fcd21f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:18.703990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a3f0a5f7-5413-4352-bb95-1897d3fcd21f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:01:18.704345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a3f0a5f7-5413-4352-bb95-1897d3fcd21f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:01:18.956268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:18.999388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6fc102a-aeb0-4cb0-9adc-d0a5f46ce6a9 req-b1b89357-1c37-44cf-9177-a6e82a30db5e tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0744123 Dec 21 04:01:19.001169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51842349-b9f9-45cf-b27e-50d06c351a4b req-17d86509-5fc1-40b5-b34f-622bd30fd2d6 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0754709 Dec 21 04:01:19.043439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:01:19.045865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.122207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Subnet': ['ID=f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:19.128248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.143623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Checking segment: {'id': '57c75d15-2579-461a-89fc-bb7b08ffd070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '5dd629d7-a995-496a-9399-8430de7984d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:19.145715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network hostable DHCP agents. Network: 5dd629d7-a995-496a-9399-8430de7984d6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:19.193813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.212640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1ac2aa2-6517-4836-920e-5d27b8197bdb,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:19.251302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 5dd629d7-a995-496a-9399-8430de7984d6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:19.281865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.283389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-35ba8ccf-3dc0-4f04-b742-240bec5c0b13 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7422276 Dec 21 04:01:19.285974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40250) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.302843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-06bc0468-12c8-425f-ad2f-9b82505ea4ba tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules/e1ac2aa2-6517-4836-920e-5d27b8197bdb HTTP/1.1" status: 200 len: 764 time: 0.0157900 Dec 21 04:01:19.305430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40252) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.327329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5dd629d7-a995-496a-9399-8430de7984d6) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:19.335529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:19.336170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.337177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5522b93-f889-49b1-b609-b4f9fe9cba7e None None] Network 5dd629d7-a995-496a-9399-8430de7984d6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:19.356409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6bf1c2b1-d56a-4b60-b086-db3112878381 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.0476789 Dec 21 04:01:19.356793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40254) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.388027 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f15f65-357f-4387-b5a9-635b8995587c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.398730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f15f65-357f-4387-b5a9-635b8995587c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.437635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-34b4ea64-1fa5-4d0b-8647-e2f3f18bb34d tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.6654088 Dec 21 04:01:19.440207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40258) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.446501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'port': {'network_id': '5dd629d7-a995-496a-9399-8430de7984d6', 'name': 'tempest-NetworksIpV6TestAttrs-1604607348'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:19.450877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5dd629d7-a995-496a-9399-8430de7984d6', 'network_id': '5dd629d7-a995-496a-9399-8430de7984d6', 'project_id': '88059222e23e4ffe964b06da62041a8f', 'fixed_ips': [{'subnet_id': 'f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:19.452139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.502945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f15f65-357f-4387-b5a9-635b8995587c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.517449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f15f65-357f-4387-b5a9-635b8995587c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.518575 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-31f15f65-357f-4387-b5a9-635b8995587c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/e1ac2aa2-6517-4836-920e-5d27b8197bdb HTTP/1.1" status: 204 len: 168 time: 0.1608105 Dec 21 04:01:19.519633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f15f65-357f-4387-b5a9-635b8995587c tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e1ac2aa2-6517-4836-920e-5d27b8197bdb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:19.521712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40264) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.566058 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0c343f1f-5adf-4a56-91d1-566555556eab tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0432901 Dec 21 04:01:19.569481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40268) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.637582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f4806c-1e9e-4606-93d9-ab74cd65b68f req-0a2eb8c4-af05-47a2-8e99-8e0195fcfb53 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:19.642755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3f4806c-1e9e-4606-93d9-ab74cd65b68f req-0a2eb8c4-af05-47a2-8e99-8e0195fcfb53 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 945 time: 0.1581538 Dec 21 04:01:19.642974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8aa5da1f-988f-42e2-bdb7-727d5cba17be tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.649472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Allocated IP 2001:db8::f816:3eff:feb9:213c (5dd629d7-a995-496a-9399-8430de7984d6/f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a/3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:19.667384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8aa5da1f-988f-42e2-bdb7-727d5cba17be tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.685989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d73aad-9a4c-4b2d-a8d8-3c4ab72831d6 req-864e9a72-18cf-48b1-a22a-64ad144b966e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:19.687575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03d73aad-9a4c-4b2d-a8d8-3c4ab72831d6 req-864e9a72-18cf-48b1-a22a-64ad144b966e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 944 time: 0.1707399 Dec 21 04:01:19.745715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3f4806c-1e9e-4606-93d9-ab74cd65b68f req-8a6445cc-3864-45d0-808e-a1f03a35348c tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967035 Dec 21 04:01:19.771544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03d73aad-9a4c-4b2d-a8d8-3c4ab72831d6 req-18cb15c3-ddc9-4495-b3c5-fdb568d8b75c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761654 Dec 21 04:01:19.783467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8aa5da1f-988f-42e2-bdb7-727d5cba17be tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.784352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:19.788139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8aa5da1f-988f-42e2-bdb7-727d5cba17be tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.788139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8aa5da1f-988f-42e2-bdb7-727d5cba17be tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/b0f1b30c-71b5-41ce-9d47-180d283c7e8f HTTP/1.1" status: 204 len: 168 time: 0.2168612 Dec 21 04:01:19.788376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.791436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40270) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.812221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] device_id is not set on port b1fbc036-fe30-4b77-ad87-76305aab32c6 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:01:19.812669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa5da1f-988f-42e2-bdb7-727d5cba17be tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0f1b30c-71b5-41ce-9d47-180d283c7e8f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:19.848029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2426ab60-994c-4b29-9c3c-e0a7bfe9a215 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0542133 Dec 21 04:01:19.853752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40272) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:19.861818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group': {'name': 'tempest-secgroup--494302601'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:19.869433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d14edf5b-5614-4ab9-84da-a7eb44e66d5b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.877062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:19.977184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:19.998816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.058845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.074666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:01:20.079804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:20.080184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.104811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.115039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2553e3d9-dfa1-40a4-a237-df97694977ec req-653f7632-6851-4049-afa1-f13bc9d68066 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0332127 Dec 21 04:01:20.158448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Network 5dd629d7-a995-496a-9399-8430de7984d6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:20.166063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:20.169027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-474e50f9-a721-494e-beed-18bbbbe10ea0 req-aba58334-e558-45cc-9f01-38dead089864 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0562611 Dec 21 04:01:20.170163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:20.172207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Pushing event updated for resources: {'Port': ['ID=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.173655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.221065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Allocated IP 2001:db8::f816:3eff:fe41:d78 (5dd629d7-a995-496a-9399-8430de7984d6/f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a/b1fbc036-fe30-4b77-ad87-76305aab32c6) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:20.223162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroup': ['ID=772420a3-c85a-42f6-813a-d3286fd1e41e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.264138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Attempting to bind port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:20.265054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Attempting to bind port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '57c75d15-2579-461a-89fc-bb7b08ffd070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '5dd629d7-a995-496a-9399-8430de7984d6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:20.265612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Attempting to bind port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf on network 5dd629d7-a995-496a-9399-8430de7984d6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:20.273529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.277265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:20.277643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Checking segment: {'id': '57c75d15-2579-461a-89fc-bb7b08ffd070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '5dd629d7-a995-496a-9399-8430de7984d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:20.278035 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.278468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Bound using segment: {'id': '57c75d15-2579-461a-89fc-bb7b08ffd070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '5dd629d7-a995-496a-9399-8430de7984d6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:20.279095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Bound port: 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '57c75d15-2579-461a-89fc-bb7b08ffd070', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '5dd629d7-a995-496a-9399-8430de7984d6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:20.279597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.338586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.342356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1edca815-06a6-4528-bb1c-36daaee71ac4 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4866502 Dec 21 04:01:20.342673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40278) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:20.343340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:20.346074 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a535857c-9de0-4d19-9598-c41d9a13abc2" -d '{"events": [{"server_uuid": "314db627-a3fc-4d84-ae0e-a2b0ebb8aecb", "name": "network-vif-plugged", "status": "completed", "tag": "5f182293-8d1b-4f6b-8248-4b78e1bf55c3"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:20.346886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Request body: {'security_group_rule': {'security_group_id': '772420a3-c85a-42f6-813a-d3286fd1e41e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:20.372578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:20.399691 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b9879409-18a6-4119-a514-00a564504e80 x-openstack-request-id: req-b9879409-18a6-4119-a514-00a564504e80 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:20.400004 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "314db627-a3fc-4d84-ae0e-a2b0ebb8aecb", "name": "network-vif-plugged", "status": "completed", "tag": "5f182293-8d1b-4f6b-8248-4b78e1bf55c3", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:20.400262 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b9879409-18a6-4119-a514-00a564504e80 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:20.400652 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'code': 200} Dec 21 04:01:20.416196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] For port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:20.417915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.419399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] For port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,segment=NetworkSegment(57c75d15-2579-461a-89fc-bb7b08ffd070),segment_id=57c75d15-2579-461a-89fc-bb7b08ffd070)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:20.434169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.435203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0fec7ad4-449b-4560-adaa-725add20128e up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:20.473398 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.524918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.529140 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.552875 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.569444 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.592129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b98b13-9b5c-43d9-a085-784bc2cb5ad9 None None] Pushing event updated for resources: {'Port': ['ID=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.607664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a994b9-deba-4631-a200-913ea8b2f84b req-60c45ac9-15f7-4497-8ac2-428621351769 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:20.609831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5a994b9-deba-4631-a200-913ea8b2f84b req-60c45ac9-15f7-4497-8ac2-428621351769 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 1097 time: 0.1046894 Dec 21 04:01:20.634577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 0fec7ad4-449b-4560-adaa-725add20128e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:01:20.639791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 0fec7ad4-449b-4560-adaa-725add20128e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:20.640266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.647120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 5dd629d7-a995-496a-9399-8430de7984d6 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:20.653761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.656174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:20.661922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Port': ['ID=b1fbc036-fe30-4b77-ad87-76305aab32c6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.670200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:20.678679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:20.679391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.709609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5eab49a4-c704-49e6-8669-f69e5e8a9f84,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.726274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5a994b9-deba-4631-a200-913ea8b2f84b req-1da66dad-fc02-4f6e-a195-8a1f256831ad service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064684 Dec 21 04:01:20.726886 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.768681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0fec7ad4-449b-4560-adaa-725add20128e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0fec7ad4-449b-4560-adaa-725add20128e,segment=NetworkSegment(8250d715-d626-4ee8-89bc-d342f729f8bf),segment_id=8250d715-d626-4ee8-89bc-d342f729f8bf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:20.787414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a7f236bb-4a2f-4a9a-919d-f8143cde2b94 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 1.3454628 Dec 21 04:01:20.796138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40284) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:20.814565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.827506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-648f39a6-00a9-40a4-9c57-33b174389403 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4815295 Dec 21 04:01:20.830217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40288) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:20.857531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.865904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting subnet f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:20.874449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.915835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0fec7ad4-449b-4560-adaa-725add20128e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:20.951058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:20.998637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e836774-6e5b-4fc6-bc46-bca828884299 req-ff1f01d1-dd06-40e1-a6b2-1a89a2644c73 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:21.000221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e836774-6e5b-4fc6-bc46-bca828884299 req-ff1f01d1-dd06-40e1-a6b2-1a89a2644c73 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0892599 Dec 21 04:01:21.014879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b6c4dd-9d19-49cc-bf6f-c96b46ce821b req-c1302a6f-aa78-44e3-8dc3-32e232203b77 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:21.022828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14b6c4dd-9d19-49cc-bf6f-c96b46ce821b req-c1302a6f-aa78-44e3-8dc3-32e232203b77 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.1670117 Dec 21 04:01:21.040798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-046c7798-5b14-48f7-a0cc-9d33bd3d47a3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.106556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-046c7798-5b14-48f7-a0cc-9d33bd3d47a3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.115344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.149823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14b6c4dd-9d19-49cc-bf6f-c96b46ce821b req-122651ea-8006-4ad4-9790-dea1f9a8de2b tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257963 Dec 21 04:01:21.199340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e836774-6e5b-4fc6-bc46-bca828884299 req-a52c3199-6ad0-4541-ac63-27a52d029444 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1608648 Dec 21 04:01:21.288592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0db9a1b4-c55b-44e9-97f9-da1a98ee43e6 req-70c75109-ace6-4281-b31b-3e7edfdbe361 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0312536 Dec 21 04:01:21.315762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.316378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-046c7798-5b14-48f7-a0cc-9d33bd3d47a3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.322497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-046c7798-5b14-48f7-a0cc-9d33bd3d47a3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.324171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-046c7798-5b14-48f7-a0cc-9d33bd3d47a3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/772420a3-c85a-42f6-813a-d3286fd1e41e HTTP/1.1" status: 204 len: 168 time: 0.4796393 Dec 21 04:01:21.330381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40296) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.349152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-046c7798-5b14-48f7-a0cc-9d33bd3d47a3 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=772420a3-c85a-42f6-813a-d3286fd1e41e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:21.386361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Subnet': ['ID=f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:21.395979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.399970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f70a770-bb70-40fd-80ca-1b13a5f4c819 req-af185ebe-f18c-45c6-a955-f601e1984c23 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0423551 Dec 21 04:01:21.408036 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-50c1050c-0b6b-49aa-b7f5-9a22de849537 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a HTTP/1.1" status: 204 len: 168 time: 0.6097729 Dec 21 04:01:21.409918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6e7d0cb0-50c0-4afc-bf33-5af3f4d3523b tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0778503 Dec 21 04:01:21.411198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40298) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.412063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40300) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.466023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c68fc0f-27e3-4d1c-8c53-887fe48df50e tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.0526564 Dec 21 04:01:21.469272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.483226 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-29ce7048-9b58-424d-b176-cd21bdd5a741 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] delete failed (client error): The resource could not be found. Dec 21 04:01:21.484244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29ce7048-9b58-424d-b176-cd21bdd5a741 tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "DELETE /v2.0/security-groups/772420a3-c85a-42f6-813a-d3286fd1e41e HTTP/1.1" status: 404 len: 347 time: 0.0140290 Dec 21 04:01:21.488310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40304) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.493753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d76acf63-52e5-432a-8065-e3c645223b54 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:21.495428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d76acf63-52e5-432a-8065-e3c645223b54 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:21.497665 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d76acf63-52e5-432a-8065-e3c645223b54 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.0848467 Dec 21 04:01:21.503212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.535432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f59a2b44-feb3-4743-967d-9fa60cfbe1aa tempest-SecGroupTest-901152152 tempest-SecGroupTest-901152152-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0464370 Dec 21 04:01:21.603271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-634a1b30-1eb3-410e-a906-72ae0645c254 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.614757 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-634a1b30-1eb3-410e-a906-72ae0645c254 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): There was a conflict when trying to complete your request. Dec 21 04:01:21.615261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-634a1b30-1eb3-410e-a906-72ae0645c254 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:21.622029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-634a1b30-1eb3-410e-a906-72ae0645c254 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/5dd629d7-a995-496a-9399-8430de7984d6 HTTP/1.1" status: 409 len: 466 time: 0.1165259 Dec 21 04:01:21.626491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40310) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:21.631914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-567604209'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:21.743066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:21.747739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.772940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:21.782326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.782680 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Added segment 19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08 of type vlan for network 7e987f43-9497-4e8f-bf74-930f1880c2fe Dec 21 04:01:21.784799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45249ea1-613b-485d-857c-3cdcb77d91da None None] Network 5dd629d7-a995-496a-9399-8430de7984d6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:21.824436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.848566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9947bd1d-3571-4257-9f15-6a37830ea6eb None None] Provisioning complete for port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:21.848944 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9947bd1d-3571-4257-9f15-6a37830ea6eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.965726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:21.971522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:21.972157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.040846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Network': ['ID=7e987f43-9497-4e8f-bf74-930f1880c2fe,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:22.059261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7e987f43-9497-4e8f-bf74-930f1880c2fe details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:22.095094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d8f9b3d-1afe-444f-819c-9a2ec537e61f tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.4668915 Dec 21 04:01:22.097676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40314) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:22.103565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'subnet': {'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:22.144079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40316) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:22.191858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9947bd1d-3571-4257-9f15-6a37830ea6eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.234359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9947bd1d-3571-4257-9f15-6a37830ea6eb None None] For port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,segment=NetworkSegment(57c75d15-2579-461a-89fc-bb7b08ffd070),segment_id=57c75d15-2579-461a-89fc-bb7b08ffd070)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:22.254280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] DHCP port deletion for 5dd629d7-a995-496a-9399-8430de7984d6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:01:22.308555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] Deleting port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:22.308932 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.313998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:22.317587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.327410 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9947bd1d-3571-4257-9f15-6a37830ea6eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.377341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c32eb5-565d-4f9a-b6b7-4e906bc426ec req-792d0730-abc4-4ca7-8173-e7b7f74fccc7 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:22.378858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73c32eb5-565d-4f9a-b6b7-4e906bc426ec req-792d0730-abc4-4ca7-8173-e7b7f74fccc7 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.1158922 Dec 21 04:01:22.391894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee6c50e-818b-4057-9ef9-7060b9839e19 req-53ea4d82-4950-4ff9-bdad-5014999bdca2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:22.395622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fee6c50e-818b-4057-9ef9-7060b9839e19 req-53ea4d82-4950-4ff9-bdad-5014999bdca2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1232164 Dec 21 04:01:22.402528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0fec7ad4-449b-4560-adaa-725add20128e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:22.405488 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b8e8151-bf13-4ff1-a801-5ff9daed6e2a" -d '{"events": [{"server_uuid": "0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b", "name": "network-vif-plugged", "status": "completed", "tag": "0fec7ad4-449b-4560-adaa-725add20128e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:22.418800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] For port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,segment=NetworkSegment(57c75d15-2579-461a-89fc-bb7b08ffd070),segment_id=57c75d15-2579-461a-89fc-bb7b08ffd070)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:22.419226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.420412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8b7a8566-90be-4646-acfd-7159006aacbb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3509e0f4df464db1b0f2bbc77ddc28a7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2750325 Dec 21 04:01:22.424510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40330) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:22.443740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] Calling delete_port for 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:22.444316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9947bd1d-3571-4257-9f15-6a37830ea6eb None None] Pushing event updated for resources: {'Port': ['ID=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:22.486482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73c32eb5-565d-4f9a-b6b7-4e906bc426ec req-c5cc94cb-6bf5-4fc4-9ace-fe1636923cfb tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848389 Dec 21 04:01:22.497132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fee6c50e-818b-4057-9ef9-7060b9839e19 req-eebbf11b-4e4e-4e62-bb88-8c74830da2c7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0924423 Dec 21 04:01:22.563063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-351dd666-70a5-4a05-8c2c-84f11acca1f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.585987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-351dd666-70a5-4a05-8c2c-84f11acca1f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.606524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.616711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fc4fb43-7279-4e2d-b9ef-392e804c98d6 req-ebd2a7b1-2d0b-4bf3-a012-28462a1df197 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0341775 Dec 21 04:01:22.661873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] No DVR routers for this DVR port 3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:22.664598 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b408d78-e47e-402f-b9ee-1f60c0d2025e x-openstack-request-id: req-5b408d78-e47e-402f-b9ee-1f60c0d2025e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:22.671424 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b", "name": "network-vif-plugged", "status": "completed", "tag": "0fec7ad4-449b-4560-adaa-725add20128e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:22.671424 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5b408d78-e47e-402f-b9ee-1f60c0d2025e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:22.671424 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0fec7ad4-449b-4560-adaa-725add20128e', 'code': 200} Dec 21 04:01:22.671424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31a82dc3-2a42-4d27-9e8d-162b053a8eb2 None None] Pushing event deleted for resources: {'Port': ['ID=3a8cdd7d-fa1c-4a5a-8bc3-1ca24d51a1cf,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:22.674164 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-927e3846-4c5c-410b-8247-6c7908720ef9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.766128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.777385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:01:22.779460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.785085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4aa3911-a8f1-4c5e-be27-dabbc7d57cb2 req-936afd74-e401-41ff-9f65-e470f20ed7b6 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0452085 Dec 21 04:01:22.801528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d431f5a5-f081-4972-aede-f26917b6580d req-9a766c0e-f3fb-4a2b-9297-0c3f963aadf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:22.803084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d431f5a5-f081-4972-aede-f26917b6580d req-9a766c0e-f3fb-4a2b-9297-0c3f963aadf8 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 1098 time: 0.0529904 Dec 21 04:01:22.809842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-351dd666-70a5-4a05-8c2c-84f11acca1f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.812651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-351dd666-70a5-4a05-8c2c-84f11acca1f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:22.816395 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-351dd666-70a5-4a05-8c2c-84f11acca1f9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5292a7fd-1b5c-4f1b-a4a6-46f93b1f6ecd HTTP/1.1" status: 204 len: 168 time: 0.3637033 Dec 21 04:01:22.838213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351dd666-70a5-4a05-8c2c-84f11acca1f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5292a7fd-1b5c-4f1b-a4a6-46f93b1f6ecd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:22.849974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Subnet': ['ID=00cf12fa-537f-4965-b43c-fd364cd2d5d8,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:22.865505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Checking segment: {'id': '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:22.865872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network hostable DHCP agents. Network: 7e987f43-9497-4e8f-bf74-930f1880c2fe, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:22.888734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d431f5a5-f081-4972-aede-f26917b6580d req-d3448e8d-4377-4661-883a-fd3aee11576a service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756769 Dec 21 04:01:22.931435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 7e987f43-9497-4e8f-bf74-930f1880c2fe is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:22.982479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ae4f5f-394e-4e7d-baf1-3c1568c9dce1 req-3686ac95-745a-4c6d-9f81-c63cb017fb49 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:22.984010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65ae4f5f-394e-4e7d-baf1-3c1568c9dce1 req-3686ac95-745a-4c6d-9f81-c63cb017fb49 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0500562 Dec 21 04:01:23.005654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7e987f43-9497-4e8f-bf74-930f1880c2fe) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:23.010494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:23.011117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.017259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efeb45fe-9c44-4b42-8738-88041ac4a4e7 None None] Network 7e987f43-9497-4e8f-bf74-930f1880c2fe requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:23.034636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65ae4f5f-394e-4e7d-baf1-3c1568c9dce1 req-fb9ca4f6-7828-4920-830c-140b1b6bbfcf tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445204 Dec 21 04:01:23.100410 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8fc7f5f9-8b69-46cb-b9f5-1a4bb602c05b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 1.0015178 Dec 21 04:01:23.103081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40342) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:23.137933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-7e987f43-9497-4e8f-bf74-930f1880c2fe', 'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe', 'project_id': '88059222e23e4ffe964b06da62041a8f', 'fixed_ips': [{'subnet_id': '00cf12fa-537f-4965-b43c-fd364cd2d5d8'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:23.141642 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.211679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.219658 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.280435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.286165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Allocated IP 2001:db8::f816:3eff:fe35:dc1b (7e987f43-9497-4e8f-bf74-930f1880c2fe/00cf12fa-537f-4965-b43c-fd364cd2d5d8/d5d673a7-79a8-46b5-aad3-9d78d3571aaf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:23.438591 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.471025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7fbd8fa-4ac9-4f32-b118-180e0c9ad67b req-02d42f53-7188-4316-8d92-a731e5e5be39 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0256751 Dec 21 04:01:23.524992 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.573818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Network 7e987f43-9497-4e8f-bf74-930f1880c2fe is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:23.580148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:23.584068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:23.600448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Pushing event updated for resources: {'Port': ['ID=d5d673a7-79a8-46b5-aad3-9d78d3571aaf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:23.642142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.654792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Attempting to bind port d5d673a7-79a8-46b5-aad3-9d78d3571aaf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:23.656960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Attempting to bind port d5d673a7-79a8-46b5-aad3-9d78d3571aaf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:23.657400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Attempting to bind port d5d673a7-79a8-46b5-aad3-9d78d3571aaf on network 7e987f43-9497-4e8f-bf74-930f1880c2fe {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:23.663245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 0, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:23.663773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Checking segment: {'id': '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:23.664214 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.664680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Bound using segment: {'id': '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:23.665225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Bound port: d5d673a7-79a8-46b5-aad3-9d78d3571aaf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '7e987f43-9497-4e8f-bf74-930f1880c2fe'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:23.665686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.681821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Subnet': ['ID=00cf12fa-537f-4965-b43c-fd364cd2d5d8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:23.718488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec8ddf9-a833-4ece-a41f-db4675809ac2 req-a3e99692-e849-4a7c-892e-028587d31233 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:23.720090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ec8ddf9-a833-4ece-a41f-db4675809ac2 req-a3e99692-e849-4a7c-892e-028587d31233 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.1484685 Dec 21 04:01:23.751421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.754474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] For port d5d673a7-79a8-46b5-aad3-9d78d3571aaf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:23.761895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] For port d5d673a7-79a8-46b5-aad3-9d78d3571aaf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d5d673a7-79a8-46b5-aad3-9d78d3571aaf,segment=NetworkSegment(19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08),segment_id=19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:23.783731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e987f43-9497-4e8f-bf74-930f1880c2fe']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:23.802115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:23.802415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:23.840501 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.845144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.850576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a31cd2a0-9796-4d17-b1aa-6b3126aac7cc req-b99a6a43-53bf-4a18-b3aa-c65d5f8e126d tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0504036 Dec 21 04:01:23.867780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ec8ddf9-a833-4ece-a41f-db4675809ac2 req-26039c78-5276-4241-86cb-c2b01c1ba336 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1204934 Dec 21 04:01:23.882020 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.890510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:23.890510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:23.924944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3ed1dc-0af5-4b4f-8bcc-12cd6624d601 None None] Pushing event updated for resources: {'Port': ['ID=d5d673a7-79a8-46b5-aad3-9d78d3571aaf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:23.949754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-675d9108-bbfd-4cda-b5fd-46909f1de7af None None] Network 7e987f43-9497-4e8f-bf74-930f1880c2fe requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:23.958372 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:23.992351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ed8c240-650b-421d-a31f-8e81102871fd req-dcf928b8-b01a-4ddd-a4d4-209859bd2d91 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0285695 Dec 21 04:01:24.023571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.api [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:01:24.023571 n-d-822053-11 neutron-server[110310]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:01:24.023571 n-d-822053-11 neutron-server[110310]: [parameters: {'id': '7e987f43-9497-4e8f-bf74-930f1880c2fe'}] Dec 21 04:01:24.023571 n-d-822053-11 neutron-server[110310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110310) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:01:24.024451 n-d-822053-11 neutron-server[110310]: DEBUG oslo_db.api [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:01:24.054801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3eb45a0-3e59-4627-9f50-ff7c02416aad None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:01:24.161353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8c6653-a9ec-4297-a545-e688e5d49a3c req-5a177d82-61b4-41bf-a93f-9bf710427f8c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:24.162871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a8c6653-a9ec-4297-a545-e688e5d49a3c req-5a177d82-61b4-41bf-a93f-9bf710427f8c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0579422 Dec 21 04:01:24.168331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3eb45a0-3e59-4627-9f50-ff7c02416aad None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:01:24.213927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a8c6653-a9ec-4297-a545-e688e5d49a3c req-b4c113b5-4916-4e97-9031-a7b699a8adf8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447156 Dec 21 04:01:24.468369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e87f2458-e30a-4fcd-8f51-aecec0e7ec22 None None] Provisioning complete for port 0fec7ad4-449b-4560-adaa-725add20128e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:24.468369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e87f2458-e30a-4fcd-8f51-aecec0e7ec22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:24.525932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:24.585317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting port d5d673a7-79a8-46b5-aad3-9d78d3571aaf {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:24.588376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:24.669414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] For port d5d673a7-79a8-46b5-aad3-9d78d3571aaf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d5d673a7-79a8-46b5-aad3-9d78d3571aaf,segment=NetworkSegment(19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08),segment_id=19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:24.669775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:24.682818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Calling delete_port for d5d673a7-79a8-46b5-aad3-9d78d3571aaf owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:24.845631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:24.871899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Port': ['ID=d5d673a7-79a8-46b5-aad3-9d78d3571aaf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:24.874240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No DVR routers for this DVR port d5d673a7-79a8-46b5-aad3-9d78d3571aaf on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:24.876424 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:24.991894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.038731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbb8e47c-18ca-405c-a776-274e17954f83 req-43ff4a43-9f00-4dbf-9de4-f4c63a5c73e4 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0598602 Dec 21 04:01:25.056115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e987f43-9497-4e8f-bf74-930f1880c2fe']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:25.070195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:25.070454 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.070966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19cd4b95-b7fc-4dcf-b8e2-f4ed565b3d08') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:25.082748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.091738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fdbcef4-c3d7-4095-96d2-32c982281f9a req-5943ef5c-53ae-4536-b7cf-94c2b6b34ebd tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:25.093288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fdbcef4-c3d7-4095-96d2-32c982281f9a req-5943ef5c-53ae-4536-b7cf-94c2b6b34ebd tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.1270826 Dec 21 04:01:25.126110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.149078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b50374fe-0481-4aa7-902e-61a31bd8ea6d req-8abca14e-beae-4e20-8efc-596e21f2f885 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0442483 Dec 21 04:01:25.152218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:25.152558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:25.156141 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:25.231286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fdbcef4-c3d7-4095-96d2-32c982281f9a req-cf6b867e-ad95-4ab5-bbf4-ac9e6e8a521e tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304314 Dec 21 04:01:25.329898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.338454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.341672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/7e987f43-9497-4e8f-bf74-930f1880c2fe HTTP/1.1" status: 204 len: 168 time: 2.2376003 Dec 21 04:01:25.348290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40424) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:25.352936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8648eb5-812a-4ce2-b1e3-59b429e40267 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Network': ['ID=7e987f43-9497-4e8f-bf74-930f1880c2fe,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:25.364062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1711218750'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:25.382002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e594010-8948-4703-a1ea-38c3d761b99e req-200fc296-0060-46f2-bc00-335711434936 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:25.384208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e594010-8948-4703-a1ea-38c3d761b99e req-200fc296-0060-46f2-bc00-335711434936 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0866067 Dec 21 04:01:25.443783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e594010-8948-4703-a1ea-38c3d761b99e req-84e17a41-c3e2-4c73-a446-4cb1c590398c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519025 Dec 21 04:01:25.497310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:25.500811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.525761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:25.537029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.537584 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Added segment 6afce8e7-2883-4c02-9831-4078597e3f92 of type vlan for network 07963fb4-e6f1-454a-a44a-2640f98e7da6 Dec 21 04:01:25.578303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.629010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0237d3e8-7037-4438-aeff-e0c62a8dd971 req-551c08dc-fc00-4a9f-8bbd-89f9f8480f88 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0490801 Dec 21 04:01:25.674146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.708439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.714153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:25.714764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:25.779440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Network': ['ID=07963fb4-e6f1-454a-a44a-2640f98e7da6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:25.789892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 07963fb4-e6f1-454a-a44a-2640f98e7da6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:25.907044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b9abd067-105a-4512-87dd-ea700d239096 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.5499775 Dec 21 04:01:25.907187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40440) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:25.908625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'subnet': {'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:26.096874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:26.100433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.163054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40448) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:26.287802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-158256b7-1948-4c94-8ff0-47dadea29178 req-3247637b-42b0-400c-8504-3841f2a95b07 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0420306 Dec 21 04:01:26.335095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-959448ad-3426-4e5e-9f0a-d913d6e563df admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.410642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.424192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-959448ad-3426-4e5e-9f0a-d913d6e563df admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.478895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Subnet': ['ID=d6721f05-2c9a-464f-ab6a-7e3a2bafa899,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:26.489939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Checking segment: {'id': '6afce8e7-2883-4c02-9831-4078597e3f92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:26.490991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network hostable DHCP agents. Network: 07963fb4-e6f1-454a-a44a-2640f98e7da6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:26.501373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-959448ad-3426-4e5e-9f0a-d913d6e563df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.568104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-959448ad-3426-4e5e-9f0a-d913d6e563df admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=eff8dfa81e7f4624bcfb3cae4274aee5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4039197 Dec 21 04:01:26.570912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:26.572233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-959448ad-3426-4e5e-9f0a-d913d6e563df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44df61b9-0427-45db-9361-ba5b55a65242,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:26.602055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2958421e-75bd-49c1-96e3-f7a3db10b632 req-ea7c30b3-9ccb-4494-8cc2-923e710ccc53 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:26.610382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2958421e-75bd-49c1-96e3-f7a3db10b632 req-ea7c30b3-9ccb-4494-8cc2-923e710ccc53 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0840318 Dec 21 04:01:26.612650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 07963fb4-e6f1-454a-a44a-2640f98e7da6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:26.650193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ab44447-3388-48cd-821b-932e28889cad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.675176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ab44447-3388-48cd-821b-932e28889cad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.681558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2958421e-75bd-49c1-96e3-f7a3db10b632 req-d49f9a9b-e077-4033-b892-7c1c32ca0778 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699515 Dec 21 04:01:26.692802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 07963fb4-e6f1-454a-a44a-2640f98e7da6) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:26.705462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a90fa1a1-db48-4ea8-a7e1-5590a013ba39 None None] Network 07963fb4-e6f1-454a-a44a-2640f98e7da6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:26.711500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:26.713565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.762348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f33bf6d3-07c3-4994-b6f4-4affd3b38873 req-38b367c5-4c5c-4fd1-8f1f-2c9f2a52e273 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0266681 Dec 21 04:01:26.822959 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ab44447-3388-48cd-821b-932e28889cad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.825942 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ab44447-3388-48cd-821b-932e28889cad admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.827966 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5ab44447-3388-48cd-821b-932e28889cad admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/44df61b9-0427-45db-9361-ba5b55a65242 HTTP/1.1" status: 204 len: 168 time: 0.2553055 Dec 21 04:01:26.837326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab44447-3388-48cd-821b-932e28889cad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44df61b9-0427-45db-9361-ba5b55a65242,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:26.839862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-35fefe6a-5dab-45f1-abda-ae8cab469489 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9359360 Dec 21 04:01:26.845867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-07963fb4-e6f1-454a-a44a-2640f98e7da6', 'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6', 'project_id': '88059222e23e4ffe964b06da62041a8f', 'fixed_ips': [{'subnet_id': 'd6721f05-2c9a-464f-ab6a-7e3a2bafa899'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:26.845867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:26.848305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40464) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:26.975894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.010397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Allocated IP 2001:db8::2 (07963fb4-e6f1-454a-a44a-2640f98e7da6/d6721f05-2c9a-464f-ab6a-7e3a2bafa899/f38060e0-13ba-44e0-a0e4-bc84f8da2c7d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:27.031815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.175506 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.235260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.276953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Network 07963fb4-e6f1-454a-a44a-2640f98e7da6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:27.281801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:27.286428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:27.289445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Pushing event updated for resources: {'Port': ['ID=f38060e0-13ba-44e0-a0e4-bc84f8da2c7d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:27.302816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.335788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Subnet': ['ID=d6721f05-2c9a-464f-ab6a-7e3a2bafa899,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:27.344183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Attempting to bind port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:27.344604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Attempting to bind port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6afce8e7-2883-4c02-9831-4078597e3f92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:27.345895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Attempting to bind port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d on network 07963fb4-e6f1-454a-a44a-2640f98e7da6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:27.351715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:27.351715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Checking segment: {'id': '6afce8e7-2883-4c02-9831-4078597e3f92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:27.351715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.352138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Bound using segment: {'id': '6afce8e7-2883-4c02-9831-4078597e3f92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:27.352443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Bound port: f38060e0-13ba-44e0-a0e4-bc84f8da2c7d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6afce8e7-2883-4c02-9831-4078597e3f92', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '07963fb4-e6f1-454a-a44a-2640f98e7da6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:27.352710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.414992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb4a3439-d455-4629-84e4-ffa1e521f9c4 req-fa205097-015c-4da4-a766-1b8fd4be4c17 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0413547 Dec 21 04:01:27.422358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.427555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] For port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:27.432681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] For port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f38060e0-13ba-44e0-a0e4-bc84f8da2c7d,segment=NetworkSegment(6afce8e7-2883-4c02-9831-4078597e3f92),segment_id=6afce8e7-2883-4c02-9831-4078597e3f92)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:27.450284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07963fb4-e6f1-454a-a44a-2640f98e7da6']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:27.459926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6afce8e7-2883-4c02-9831-4078597e3f92') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:27.460227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6afce8e7-2883-4c02-9831-4078597e3f92') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:27.469897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.506845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40474) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:27.515270 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.521715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.524537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04c1219f-fe84-4939-9ff2-27a4c5ea9fed admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.541487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 102 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:27.541896 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:27.545000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:27.548924 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:27.548924 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:27.548924 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:27.548924 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:27.548924 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:27.548924 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:27.589152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed66acb-e42e-4a74-aa78-6204adadd9cc None None] Pushing event updated for resources: {'Port': ['ID=f38060e0-13ba-44e0-a0e4-bc84f8da2c7d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:27.615971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dac0b0f-1197-4b7a-8e7a-30a6816f4bfe None None] Network 07963fb4-e6f1-454a-a44a-2640f98e7da6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:27.643501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:01:27.643501 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:01:27.643501 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '07963fb4-e6f1-454a-a44a-2640f98e7da6'}] Dec 21 04:01:27.643501 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:01:27.644336 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:01:27.672813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04c1219f-fe84-4939-9ff2-27a4c5ea9fed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.732210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04c1219f-fe84-4939-9ff2-27a4c5ea9fed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.741143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77240206-d078-42f8-aa8d-c1ec4c0f9ad7 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:01:27.774194 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04c1219f-fe84-4939-9ff2-27a4c5ea9fed admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=734d3c11ca504ea299c8c478b1e1f87d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2662964 Dec 21 04:01:27.775077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c1219f-fe84-4939-9ff2-27a4c5ea9fed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd46da63-8738-4e51-b184-0b8df7f1952c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:27.777336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40478) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:27.831189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230c6530-133b-4e3c-a44e-c3fc9acbe3c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.835744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67162490-3bd9-4478-809c-0d7a5bda527c req-d5460c93-cbd7-4c08-9d08-f6f8ecd6ffba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:27.837634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67162490-3bd9-4478-809c-0d7a5bda527c req-d5460c93-cbd7-4c08-9d08-f6f8ecd6ffba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0893309 Dec 21 04:01:27.862552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77240206-d078-42f8-aa8d-c1ec4c0f9ad7 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:01:27.865156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230c6530-133b-4e3c-a44e-c3fc9acbe3c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.893498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9331afba-4e07-47d8-9f62-4f889b7fbfe1 req-91abd769-434f-4897-b7e1-21d444a58ad7 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0356727 Dec 21 04:01:27.924774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67162490-3bd9-4478-809c-0d7a5bda527c req-6cfb220b-9870-4350-9bef-45c916205d6d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748460 Dec 21 04:01:27.977306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230c6530-133b-4e3c-a44e-c3fc9acbe3c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.979996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230c6530-133b-4e3c-a44e-c3fc9acbe3c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:27.981204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-230c6530-133b-4e3c-a44e-c3fc9acbe3c7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bd46da63-8738-4e51-b184-0b8df7f1952c HTTP/1.1" status: 204 len: 168 time: 0.2029691 Dec 21 04:01:27.989601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-230c6530-133b-4e3c-a44e-c3fc9acbe3c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd46da63-8738-4e51-b184-0b8df7f1952c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:28.145079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.211800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:28.212149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.277197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] For port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f38060e0-13ba-44e0-a0e4-bc84f8da2c7d,segment=NetworkSegment(6afce8e7-2883-4c02-9831-4078597e3f92),segment_id=6afce8e7-2883-4c02-9831-4078597e3f92)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:28.277555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.290197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Calling delete_port for f38060e0-13ba-44e0-a0e4-bc84f8da2c7d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:28.416962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.444523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Port': ['ID=f38060e0-13ba-44e0-a0e4-bc84f8da2c7d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:28.449440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No DVR routers for this DVR port f38060e0-13ba-44e0-a0e4-bc84f8da2c7d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:28.535770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34e96094-1683-4a39-b568-701c0dd81cb6 req-8d382e44-5c3f-45d8-a361-0f673f7d9b45 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0278442 Dec 21 04:01:28.854326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.874814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07963fb4-e6f1-454a-a44a-2640f98e7da6']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:28.884714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6afce8e7-2883-4c02-9831-4078597e3f92') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:28.885121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6afce8e7-2883-4c02-9831-4078597e3f92') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:28.896095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.912477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.919687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 102 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:28.920082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:28.923099 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:29.049197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cadde64-2253-48fe-825b-a9273673f287 req-8784e059-3ca0-455f-bf0f-6e51f63575e1 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0468879 Dec 21 04:01:29.069054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.082889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ef576c-6b88-4abb-9930-e0558e16adae req-cb544e47-0387-4140-889b-be5b5c720832 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:29.084747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67ef576c-6b88-4abb-9930-e0558e16adae req-cb544e47-0387-4140-889b-be5b5c720832 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0921383 Dec 21 04:01:29.088494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.091997 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/07963fb4-e6f1-454a-a44a-2640f98e7da6 HTTP/1.1" status: 204 len: 168 time: 2.2422960 Dec 21 04:01:29.094113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05df5996-6a1c-4c03-a022-0cece5e137ed tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Network': ['ID=07963fb4-e6f1-454a-a44a-2640f98e7da6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:29.098508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40522) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:29.108632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-770321193'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:29.172651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67ef576c-6b88-4abb-9930-e0558e16adae req-5515bbbf-5f86-4e3a-b6b9-cc88f8eebb1e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654151 Dec 21 04:01:29.194151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:29.197831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.227915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:29.237693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.238067 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Added segment 6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1 of type vlan for network 429d2b39-e771-473f-bca8-75a4950f8431 Dec 21 04:01:29.282663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.365627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.371220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:29.371790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:29.449290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Network': ['ID=429d2b39-e771-473f-bca8-75a4950f8431,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:29.461452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 429d2b39-e771-473f-bca8-75a4950f8431 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:29.491522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40536) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:29.491738 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6db72a15-247c-475d-9410-c876d54a127e tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.3919044 Dec 21 04:01:29.501078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Request body: {'subnet': {'network_id': '429d2b39-e771-473f-bca8-75a4950f8431', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:29.649967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd048c60-3e7b-4b33-8a3c-556f8b88b12a req-2cc235e0-43a4-43f1-a09c-830fbc3a7c08 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0319233 Dec 21 04:01:29.685472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Made reservation on behalf of 88059222e23e4ffe964b06da62041a8f for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:29.689693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.008845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:01:30.010246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.072113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event updated for resources: {'Subnet': ['ID=ce9dd794-0efa-4f2b-af1c-63baa8024006,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:30.079192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Checking segment: {'id': '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '429d2b39-e771-473f-bca8-75a4950f8431'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:30.079565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network hostable DHCP agents. Network: 429d2b39-e771-473f-bca8-75a4950f8431, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:30.169323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c97ed85a-1207-4f13-b411-54566b7e233e req-e492cf7b-a0f8-4955-a9bd-0c2e70ee8217 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0367362 Dec 21 04:01:30.176928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Network 429d2b39-e771-473f-bca8-75a4950f8431 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:30.264235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36802b98-1211-433c-907b-0497f1d922bf req-f99486bf-dab0-4193-91f8-35e6fc153f73 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:30.267414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36802b98-1211-433c-907b-0497f1d922bf req-f99486bf-dab0-4193-91f8-35e6fc153f73 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.0650952 Dec 21 04:01:30.286239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 429d2b39-e771-473f-bca8-75a4950f8431) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:30.291767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:30.292028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.296394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b8f08ea-c8a6-4665-80c6-3ed0ab6b7a10 None None] Network 429d2b39-e771-473f-bca8-75a4950f8431 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:30.348497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116bc8da-066f-4c88-8364-266a14d318f5 req-827026a5-cb8c-4d5c-8244-5a10b90e025c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:30.350547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-116bc8da-066f-4c88-8364-266a14d318f5 req-827026a5-cb8c-4d5c-8244-5a10b90e025c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1116767 Dec 21 04:01:30.394380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36802b98-1211-433c-907b-0497f1d922bf req-22e22d17-204c-4155-b925-555f74ad1c57 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1127164 Dec 21 04:01:30.410317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4eca2c41-a2f1-4b71-901b-a317f3c648ea tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.9166574 Dec 21 04:01:30.410478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40576) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:30.430438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-429d2b39-e771-473f-bca8-75a4950f8431', 'network_id': '429d2b39-e771-473f-bca8-75a4950f8431', 'project_id': '88059222e23e4ffe964b06da62041a8f', 'fixed_ips': [{'subnet_id': 'ce9dd794-0efa-4f2b-af1c-63baa8024006'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:30.431687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.446448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-116bc8da-066f-4c88-8364-266a14d318f5 req-f3b7b193-7d00-4188-a60a-e9507127bdbf tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840604 Dec 21 04:01:30.554174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.609300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Allocated IP 2001:db8::f816:3eff:fe41:d8ef (429d2b39-e771-473f-bca8-75a4950f8431/ce9dd794-0efa-4f2b-af1c-63baa8024006/536acc82-853d-4ee8-b492-e17622fc524d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:30.613135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.765835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.769611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a531450-f818-4c2d-b119-7dbde7f9627b req-d9811a2f-cb9c-45c0-ac0c-fbfa29543cb7 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0301340 Dec 21 04:01:30.829192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.869882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Network 429d2b39-e771-473f-bca8-75a4950f8431 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:30.872732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:30.876788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:30.880234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.885006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Pushing event updated for resources: {'Port': ['ID=536acc82-853d-4ee8-b492-e17622fc524d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:30.911495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.911854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.912201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.913607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.913607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.913607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.913607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.913978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.914146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.914662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.915025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.917171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.917171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:30.934324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Subnet': ['ID=ce9dd794-0efa-4f2b-af1c-63baa8024006,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:30.968953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Attempting to bind port 536acc82-853d-4ee8-b492-e17622fc524d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:30.969365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Attempting to bind port 536acc82-853d-4ee8-b492-e17622fc524d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '429d2b39-e771-473f-bca8-75a4950f8431'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:30.969736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Attempting to bind port 536acc82-853d-4ee8-b492-e17622fc524d on network 429d2b39-e771-473f-bca8-75a4950f8431 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:30.975178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:30.975561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Checking segment: {'id': '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '429d2b39-e771-473f-bca8-75a4950f8431'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:30.975967 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:30.976373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Bound using segment: {'id': '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '429d2b39-e771-473f-bca8-75a4950f8431'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:30.976903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Bound port: 536acc82-853d-4ee8-b492-e17622fc524d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '429d2b39-e771-473f-bca8-75a4950f8431'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:30.977288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.018842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.042876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] For port 536acc82-853d-4ee8-b492-e17622fc524d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:31.045160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['429d2b39-e771-473f-bca8-75a4950f8431']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:31.046632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] For port 536acc82-853d-4ee8-b492-e17622fc524d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=536acc82-853d-4ee8-b492-e17622fc524d,segment=NetworkSegment(6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1),segment_id=6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:31.055543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:31.055950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:31.065654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.097410 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.099299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.105793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:31.106200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:31.109489 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:31.181123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99c92fa-668d-4c70-97b4-1d64566ee0f3 None None] Pushing event updated for resources: {'Port': ['ID=536acc82-853d-4ee8-b492-e17622fc524d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:31.189920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:01:31.189920 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:01:31.189920 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '429d2b39-e771-473f-bca8-75a4950f8431'}] Dec 21 04:01:31.189920 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:01:31.190338 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:01:31.190652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35d9c1d1-83db-4512-a14d-d17fb0f49295 None None] Network 429d2b39-e771-473f-bca8-75a4950f8431 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:31.274571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8baeae36-4ef1-453d-82f0-6dc3c13582b0 req-1b5caf0d-e0d3-4104-913b-dc72081dc298 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0266018 Dec 21 04:01:31.281951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dce2ea1d-238d-44cf-8b78-0c3a85a7b4fd None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:01:31.382191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dce2ea1d-238d-44cf-8b78-0c3a85a7b4fd None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:01:31.509931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54a0827-b826-463f-8e5d-3a2f13d7bff2 req-546c85cf-1207-46bb-ad06-0586c036b82e tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:31.511646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c54a0827-b826-463f-8e5d-3a2f13d7bff2 req-546c85cf-1207-46bb-ad06-0586c036b82e tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.0500586 Dec 21 04:01:31.592780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275674f1-9af5-4745-b868-3853337dd0aa req-deefb0b3-8b59-4c59-b5b6-61243f6cb73d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:31.594170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-275674f1-9af5-4745-b868-3853337dd0aa req-deefb0b3-8b59-4c59-b5b6-61243f6cb73d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0741441 Dec 21 04:01:31.598910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c54a0827-b826-463f-8e5d-3a2f13d7bff2 req-7f926090-24b4-45f7-91c7-8bd90614868d tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/security-groups?id=0902178c-4996-4a9f-bda7-965644083eb2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788236 Dec 21 04:01:31.651283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-275674f1-9af5-4745-b868-3853337dd0aa req-ce1b83c9-3757-4107-b687-a9df94d81da3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507977 Dec 21 04:01:31.691777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.746804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting port 536acc82-853d-4ee8-b492-e17622fc524d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:31.747100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.812637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] For port 536acc82-853d-4ee8-b492-e17622fc524d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=536acc82-853d-4ee8-b492-e17622fc524d,segment=NetworkSegment(6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1),segment_id=6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:31.813100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.830792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Calling delete_port for 536acc82-853d-4ee8-b492-e17622fc524d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:31.839457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-a7dcc7aa-d11c-4ef7-97c6-8387b2e0d9d8 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:31.840986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-a7dcc7aa-d11c-4ef7-97c6-8387b2e0d9d8 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.54 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 946 time: 0.0538213 Dec 21 04:01:31.897231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26a39ec4-a412-43c8-a793-2150e4a2c257 req-381e7451-e2a9-48b3-ab2a-dce55ee6adeb tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0431409 Dec 21 04:01:31.959612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.962409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Deleting port 0fec7ad4-449b-4560-adaa-725add20128e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:31.962748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:31.985476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Port': ['ID=536acc82-853d-4ee8-b492-e17622fc524d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:31.990440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No DVR routers for this DVR port 536acc82-853d-4ee8-b492-e17622fc524d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:32.058918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] For port 0fec7ad4-449b-4560-adaa-725add20128e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0fec7ad4-449b-4560-adaa-725add20128e,segment=NetworkSegment(8250d715-d626-4ee8-89bc-d342f729f8bf),segment_id=8250d715-d626-4ee8-89bc-d342f729f8bf)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:32.059333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.072445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Calling delete_port for 0fec7ad4-449b-4560-adaa-725add20128e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:32.075318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.097432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['429d2b39-e771-473f-bca8-75a4950f8431']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:32.107147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:32.107458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f6cf292-3a37-4fa6-a60a-16d1f8a7ccd1') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:32.117665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.131932 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.138109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:32.138611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:32.141733 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:32.262916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.263170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.271865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.274908 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/429d2b39-e771-473f-bca8-75a4950f8431 HTTP/1.1" status: 204 len: 168 time: 1.8628483 Dec 21 04:01:32.278274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40596) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.292695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Pushing event deleted for resources: {'Port': ['ID=0fec7ad4-449b-4560-adaa-725add20128e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:32.313456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9029e3-e108-4a69-8029-fb266a6d86e7 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Network': ['ID=429d2b39-e771-473f-bca8-75a4950f8431,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:32.315575 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-398d481e-1403-4eb5-a2b2-3fbd31d76ec2 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.316183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42b69cc3-f6c7-46b5-9f15-965e17308f15 None None] DHCP port deletion for 0294b34c-30ec-4139-9cf8-4180cbf6aee4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:01:32.316858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-398d481e-1403-4eb5-a2b2-3fbd31d76ec2 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.319060 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-398d481e-1403-4eb5-a2b2-3fbd31d76ec2 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/ce9dd794-0efa-4f2b-af1c-63baa8024006 HTTP/1.1" status: 404 len: 337 time: 0.0397644 Dec 21 04:01:32.321592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.332164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0fec7ad4-449b-4560-adaa-725add20128e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:32.346121 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6dc6f37-ecc8-4b82-9c46-9ae0269e8e77 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.346633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a6dc6f37-ecc8-4b82-9c46-9ae0269e8e77 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.352069 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a6dc6f37-ecc8-4b82-9c46-9ae0269e8e77 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/429d2b39-e771-473f-bca8-75a4950f8431 HTTP/1.1" status: 404 len: 339 time: 0.0252132 Dec 21 04:01:32.353391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40602) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.377694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] No DVR routers for this DVR port 0fec7ad4-449b-4560-adaa-725add20128e on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:32.380262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.383617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a494e8fe-82dd-4f7f-8529-7280671c0bdb req-92cbc506-a810-4a4e-a6aa-ac386a346134 tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.54 "DELETE /v2.0/ports/0fec7ad4-449b-4560-adaa-725add20128e HTTP/1.1" status: 204 len: 173 time: 0.5358229 Dec 21 04:01:32.384073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'name': 'network-vif-deleted', 'tag': '0fec7ad4-449b-4560-adaa-725add20128e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:01:32.386361 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc6b617b-72c2-4021-863b-2b94c553c29a" -d '{"events": [{"server_uuid": "0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b", "name": "network-vif-deleted", "tag": "0fec7ad4-449b-4560-adaa-725add20128e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:01:32.408794 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-aafc5412-26f2-4511-bcd2-781c558ffd81 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.409365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aafc5412-26f2-4511-bcd2-781c558ffd81 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.412663 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aafc5412-26f2-4511-bcd2-781c558ffd81 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/d6721f05-2c9a-464f-ab6a-7e3a2bafa899 HTTP/1.1" status: 404 len: 337 time: 0.0583344 Dec 21 04:01:32.415269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40606) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.418591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dcd08f4-b5e4-4146-a83e-e1d7b220c650 req-1f84ae83-acf7-427c-8b2f-58d07a2ef6e2 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0293415 Dec 21 04:01:32.431971 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:01:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df9e9e27-38b9-4d41-97cf-95795c68b844 x-openstack-request-id: req-df9e9e27-38b9-4d41-97cf-95795c68b844 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:01:32.432374 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b", "name": "network-vif-deleted", "tag": "0fec7ad4-449b-4560-adaa-725add20128e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:01:32.432517 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-df9e9e27-38b9-4d41-97cf-95795c68b844 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:01:32.432941 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b', 'name': 'network-vif-deleted', 'tag': '0fec7ad4-449b-4560-adaa-725add20128e', 'status': 'completed', 'code': 200} Dec 21 04:01:32.434496 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-34a01933-6c5d-42b8-b24f-11cf76f49421 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.435069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-34a01933-6c5d-42b8-b24f-11cf76f49421 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.439142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34a01933-6c5d-42b8-b24f-11cf76f49421 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/07963fb4-e6f1-454a-a44a-2640f98e7da6 HTTP/1.1" status: 404 len: 339 time: 0.0217443 Dec 21 04:01:32.440617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40608) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.465819 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ebda1f22-807b-40ea-b661-3b43d2c116fb tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.466268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ebda1f22-807b-40ea-b661-3b43d2c116fb tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.469888 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ebda1f22-807b-40ea-b661-3b43d2c116fb tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/00cf12fa-537f-4965-b43c-fd364cd2d5d8 HTTP/1.1" status: 404 len: 337 time: 0.0282931 Dec 21 04:01:32.472389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40610) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.497814 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-4087a91f-d188-45c0-ba13-0b34df1110e1 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.498324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4087a91f-d188-45c0-ba13-0b34df1110e1 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.501375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4087a91f-d188-45c0-ba13-0b34df1110e1 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/7e987f43-9497-4e8f-bf74-930f1880c2fe HTTP/1.1" status: 404 len: 339 time: 0.0280712 Dec 21 04:01:32.503844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40612) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.605738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting port b1fbc036-fe30-4b77-ad87-76305aab32c6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:32.605738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.703944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.707365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2f18b7d-8729-41d6-b8ae-60fce1375239 req-751de931-edf2-4cd9-837d-1b239a61a9ba tempest-VolumesActionsTest-1415765197 tempest-VolumesActionsTest-1415765197-project] 10.222.0.18 "GET /v2.0/ports?device_id=0bb21a53-1fb7-4b6c-af7c-67fa431e1c7b HTTP/1.1" status: 200 len: 210 time: 0.0321538 Dec 21 04:01:32.724176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Calling delete_port for b1fbc036-fe30-4b77-ad87-76305aab32c6 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:32.789958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f09fc76-b1b1-4b1c-8c71-10afd9677c6a req-2f7fe9f6-f306-43cc-a5a8-31dae68319e6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:32.798323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f09fc76-b1b1-4b1c-8c71-10afd9677c6a req-2f7fe9f6-f306-43cc-a5a8-31dae68319e6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0656242 Dec 21 04:01:32.843360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f09fc76-b1b1-4b1c-8c71-10afd9677c6a req-3694a263-2abb-4cab-a487-cf1ed2bd203f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441132 Dec 21 04:01:32.919627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.949822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Port': ['ID=b1fbc036-fe30-4b77-ad87-76305aab32c6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:32.954049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:32.959378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0744263d-1acd-4572-b259-6a6810bffaf4 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/ports/b1fbc036-fe30-4b77-ad87-76305aab32c6 HTTP/1.1" status: 204 len: 168 time: 0.4529660 Dec 21 04:01:32.960582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40630) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:32.992668 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-03f4146e-5e17-4711-864d-cbcc0cf91f9c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:32.993124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-03f4146e-5e17-4711-864d-cbcc0cf91f9c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:32.996096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-03f4146e-5e17-4711-864d-cbcc0cf91f9c tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/f68a9c74-620b-4efe-b5cf-5d2c60bf2f5a HTTP/1.1" status: 404 len: 337 time: 0.0342262 Dec 21 04:01:32.999343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40634) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:33.021790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2340fb41-8219-47aa-a980-d08878d49013 req-13f59c5e-5ebb-4dc4-96a3-a6bb1a74484c tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0313234 Dec 21 04:01:33.082771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.180068 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.209621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5dd629d7-a995-496a-9399-8430de7984d6']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:33.219499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '57c75d15-2579-461a-89fc-bb7b08ffd070') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:33.219804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '57c75d15-2579-461a-89fc-bb7b08ffd070') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:33.229066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.242122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.248140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:33.249053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:33.252040 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:33.360313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.374418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.377892 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/5dd629d7-a995-496a-9399-8430de7984d6 HTTP/1.1" status: 204 len: 168 time: 0.3753536 Dec 21 04:01:33.378882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40636) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:33.412129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197a4181-575e-4e93-a9ca-0fb7784e9881 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Network': ['ID=5dd629d7-a995-496a-9399-8430de7984d6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:33.484394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting port abafce24-40aa-42d5-a2f4-06223cba835a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:33.484761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.531967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a73371f1-986a-408f-aa06-2997fb5935dd req-3b7ea45c-50da-40e4-85fe-1279a1c52905 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0289109 Dec 21 04:01:33.554436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.567656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Calling delete_port for abafce24-40aa-42d5-a2f4-06223cba835a owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:33.703753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.736850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Port': ['ID=abafce24-40aa-42d5-a2f4-06223cba835a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:33.749778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.753890 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b221b3b9-3e5f-4292-94c9-b6e2cf9358c3 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/ports/abafce24-40aa-42d5-a2f4-06223cba835a HTTP/1.1" status: 204 len: 168 time: 0.3747349 Dec 21 04:01:33.756642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:33.788755 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb83e4d6-2ed5-406f-89b7-cc720643be71 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] DELETE failed (client error): The resource could not be found. Dec 21 04:01:33.788755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb83e4d6-2ed5-406f-89b7-cc720643be71 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:01:33.791116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb83e4d6-2ed5-406f-89b7-cc720643be71 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/2b629a2f-be46-4af9-b010-cc41474aae62 HTTP/1.1" status: 404 len: 337 time: 0.0331099 Dec 21 04:01:33.795341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:33.889145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:33.965167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-103494a0-d32e-4efe-a6d9-9c005854869f req-1042528d-fcaa-4e34-867d-3f32ce9e8694 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:33.967931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-103494a0-d32e-4efe-a6d9-9c005854869f req-1042528d-fcaa-4e34-867d-3f32ce9e8694 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0521181 Dec 21 04:01:33.982583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.003634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['039e2e71-3afc-438b-a266-b2d98c0ed5eb']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:34.014459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:34.014764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6a32aab0-9f4e-42c6-ae0c-42c0389fe4d0') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:34.015072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-103494a0-d32e-4efe-a6d9-9c005854869f req-b30ea8c9-e179-4a82-9ccf-803851856e68 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420041 Dec 21 04:01:34.025055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.039426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.046099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:34.046483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:34.049460 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:34.129360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d49814-e43d-4d96-96b2-4b684436e120 req-a2cf6020-cc24-463a-9ecb-c58282e11131 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0249867 Dec 21 04:01:34.194168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.200965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.204200 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/039e2e71-3afc-438b-a266-b2d98c0ed5eb HTTP/1.1" status: 204 len: 168 time: 0.4074066 Dec 21 04:01:34.206615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:34.223945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b05d375-f95e-4027-bf4f-d264623cf2a9 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Network': ['ID=039e2e71-3afc-438b-a266-b2d98c0ed5eb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:34.267860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting subnet 8c5bfce9-51b9-4cc3-be48-24da4d76de25 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:34.271024 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.317252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.399741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.503282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.535397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Subnet': ['ID=8c5bfce9-51b9-4cc3-be48-24da4d76de25,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:34.540756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.544620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-53e6b33f-1014-4efb-8c0a-3bceefc42b3b tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/subnets/8c5bfce9-51b9-4cc3-be48-24da4d76de25 HTTP/1.1" status: 204 len: 168 time: 0.3367586 Dec 21 04:01:34.547432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:34.547905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ec34c84-11df-4f2b-a733-5a99e55a5514 None None] Network 6981d75a-c75c-46dc-8336-a01225378aa5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:34.653124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.722037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Deleting port 6472c600-12fc-4e07-b038-3ebd979eda8a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:34.722371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.730739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] DHCP port deletion for 6981d75a-c75c-46dc-8336-a01225378aa5 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:01:34.803404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] For port 6472c600-12fc-4e07-b038-3ebd979eda8a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6472c600-12fc-4e07-b038-3ebd979eda8a,segment=NetworkSegment(202e560e-e265-475f-965a-459f8b2def0e),segment_id=202e560e-e265-475f-965a-459f8b2def0e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:34.804421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.819217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Calling delete_port for 6472c600-12fc-4e07-b038-3ebd979eda8a owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:34.822762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] Deleting port 6472c600-12fc-4e07-b038-3ebd979eda8a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:34.827251 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.948197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] For port 6472c600-12fc-4e07-b038-3ebd979eda8a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6472c600-12fc-4e07-b038-3ebd979eda8a,segment=NetworkSegment(202e560e-e265-475f-965a-459f8b2def0e),segment_id=202e560e-e265-475f-965a-459f8b2def0e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:34.948909 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:34.965106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] Calling delete_port for 6472c600-12fc-4e07-b038-3ebd979eda8a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:35.012249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.031624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] No DVR routers for this DVR port 6472c600-12fc-4e07-b038-3ebd979eda8a on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:35.077118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Port': ['ID=6472c600-12fc-4e07-b038-3ebd979eda8a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:35.083368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c24aec5-2c11-4380-82a6-769083200f9c req-f4463267-6275-44ae-8e2f-cdf27b8b1d6c tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.4243495 Dec 21 04:01:35.124067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.155297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] Pushing event deleted for resources: {'Port': ['ID=6472c600-12fc-4e07-b038-3ebd979eda8a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:35.165877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11584f7f-6940-483f-a464-9eb212a4c557 None None] No DVR routers for this DVR port 6472c600-12fc-4e07-b038-3ebd979eda8a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:35.178223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.209979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6981d75a-c75c-46dc-8336-a01225378aa5']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:35.222552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '202e560e-e265-475f-965a-459f8b2def0e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:35.222855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '202e560e-e265-475f-965a-459f8b2def0e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:35.229064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd5649a-d2f9-41bd-b53d-74ac25bd7d9c req-c8f314e7-51bc-476e-b563-b717fef9b6cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:35.231328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afd5649a-d2f9-41bd-b53d-74ac25bd7d9c req-c8f314e7-51bc-476e-b563-b717fef9b6cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0765791 Dec 21 04:01:35.233248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.250006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.256709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:35.257108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:35.260423 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:35.271198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b19d4e21-7ad5-4382-bd73-88fb432409b2 req-92b6e818-198a-4cec-9c61-63182cdb2c37 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0386293 Dec 21 04:01:35.313268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afd5649a-d2f9-41bd-b53d-74ac25bd7d9c req-9734c3e8-975e-4dc4-8682-73ed9c175773 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713911 Dec 21 04:01:35.380087 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.400522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:35.403735 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] 10.222.0.18 "DELETE /v2.0/networks/6981d75a-c75c-46dc-8336-a01225378aa5 HTTP/1.1" status: 204 len: 168 time: 0.8550858 Dec 21 04:01:35.404657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8c1ac7-198c-4ded-80e2-e4a7c494d1c0 tempest-NetworksIpV6TestAttrs-1055016233 tempest-NetworksIpV6TestAttrs-1055016233-project] Pushing event deleted for resources: {'Network': ['ID=6981d75a-c75c-46dc-8336-a01225378aa5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:35.929006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40694) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:35.972119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0fec7ad4-449b-4560-adaa-725add20128e no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:35.987598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 0fec7ad4-449b-4560-adaa-725add20128e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:01:35.988033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0fec7ad4-449b-4560-adaa-725add20128e not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:01:36.102239 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98d4c64c-68c1-44e4-95c1-24332b578f2c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=88059222e23e4ffe964b06da62041a8f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1719234 Dec 21 04:01:36.104642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40706) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:36.167512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e745dd7b-ab6e-450d-a376-67889b1df53a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:36.200563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ac7b398-1d6d-4817-862b-e7fac62f2d23 req-d73be192-e950-4d35-9f2c-a479ab3672b5 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0263398 Dec 21 04:01:36.201376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e745dd7b-ab6e-450d-a376-67889b1df53a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:36.314336 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e745dd7b-ab6e-450d-a376-67889b1df53a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:36.316962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e745dd7b-ab6e-450d-a376-67889b1df53a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:36.318103 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e745dd7b-ab6e-450d-a376-67889b1df53a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dc40c631-4023-47c2-bd79-50629e8e9e72 HTTP/1.1" status: 204 len: 168 time: 0.2123227 Dec 21 04:01:36.326111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e745dd7b-ab6e-450d-a376-67889b1df53a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc40c631-4023-47c2-bd79-50629e8e9e72,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:36.431221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce09de81-8c72-42b8-9ff9-e01f75b4224d req-da9ea027-50df-49cf-83f6-9aa4980c2e26 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0341291 Dec 21 04:01:36.481082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f3c821-a070-4399-aff0-f4c830f91bd9 req-e598bf4f-683f-41ba-9d80-b3bc9dfda9fe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:36.482577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98f3c821-a070-4399-aff0-f4c830f91bd9 req-e598bf4f-683f-41ba-9d80-b3bc9dfda9fe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0559843 Dec 21 04:01:36.538006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98f3c821-a070-4399-aff0-f4c830f91bd9 req-8c6d3972-2418-4faa-a972-9b7735a64938 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477917 Dec 21 04:01:36.682849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6472c600-12fc-4e07-b038-3ebd979eda8a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:36.710101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6472c600-12fc-4e07-b038-3ebd979eda8a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:01:36.710712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6472c600-12fc-4e07-b038-3ebd979eda8a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:01:36.772700 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:01:37.380902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f18b9c8-d0c9-400a-8c63-2dc222e8fac9 req-6485df66-8a8f-46c6-8f3d-075932bb729f tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0846882 Dec 21 04:01:37.546150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:37.577666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d42d7d4f-3384-484f-bec1-ad38d72cd8eb req-0bba56f8-d066-4665-acfe-6b7e18fafa7f tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0418761 Dec 21 04:01:37.670703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-371c0907-3744-48a0-b48d-ccb31b2fb19c tempest-DvrRoutersNegativeTest-1073711597 tempest-DvrRoutersNegativeTest-1073711597-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-1838374632', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:37.673790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.policy [None req-371c0907-3744-48a0-b48d-ccb31b2fb19c tempest-DvrRoutersNegativeTest-1073711597 tempest-DvrRoutersNegativeTest-1073711597-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=110311) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Dec 21 04:01:37.674321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.policy [None req-371c0907-3744-48a0-b48d-ccb31b2fb19c tempest-DvrRoutersNegativeTest-1073711597 tempest-DvrRoutersNegativeTest-1073711597-project] Failed policy check for 'create_router' {{(pid=110311) enforce /opt/stack/neutron/neutron/policy.py:524}} Dec 21 04:01:37.674858 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-371c0907-3744-48a0-b48d-ccb31b2fb19c tempest-DvrRoutersNegativeTest-1073711597 tempest-DvrRoutersNegativeTest-1073711597-project] create failed (client error): Access was denied to this resource. Dec 21 04:01:37.675876 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-371c0907-3744-48a0-b48d-ccb31b2fb19c tempest-DvrRoutersNegativeTest-1073711597 tempest-DvrRoutersNegativeTest-1073711597-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.1283691 Dec 21 04:01:37.691612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9640f7-0859-44be-807d-aeed2aa51f80 req-15f11342-3f78-49b5-bd80-4d87663653ae tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:37.693521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe9640f7-0859-44be-807d-aeed2aa51f80 req-15f11342-3f78-49b5-bd80-4d87663653ae tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0583479 Dec 21 04:01:37.751548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe9640f7-0859-44be-807d-aeed2aa51f80 req-d704b679-bd83-43bb-a35d-184b7908738b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517974 Dec 21 04:01:38.140500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:38.271199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e39ab225-5273-4f72-b69f-29757ff19fc1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.361562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e39ab225-5273-4f72-b69f-29757ff19fc1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.422512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e39ab225-5273-4f72-b69f-29757ff19fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.476275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40778) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:38.476909 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e39ab225-5273-4f72-b69f-29757ff19fc1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5d5951b1ba454a7ab4c1ff8e9d1b734d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3310623 Dec 21 04:01:38.477461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39ab225-5273-4f72-b69f-29757ff19fc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98ea90cc-1355-404b-aa4a-9391bab30861,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:38.536106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b3029b6-7621-45d5-8ed5-0d82d12aff7d req-f1c4999c-995c-483c-a503-34d5f407e734 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0360193 Dec 21 04:01:38.564145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fcfaf26-dbcb-4671-9ef4-05136c0a07a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.589460 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fcfaf26-dbcb-4671-9ef4-05136c0a07a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.701914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72915393-437f-4079-9eaf-51f2f6b17ece req-54cc2a04-b671-419b-bca8-f783f869839f tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0310752 Dec 21 04:01:38.731281 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fcfaf26-dbcb-4671-9ef4-05136c0a07a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.734245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fcfaf26-dbcb-4671-9ef4-05136c0a07a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:38.736356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3fcfaf26-dbcb-4671-9ef4-05136c0a07a3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/98ea90cc-1355-404b-aa4a-9391bab30861 HTTP/1.1" status: 204 len: 168 time: 0.2590501 Dec 21 04:01:38.747251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fcfaf26-dbcb-4671-9ef4-05136c0a07a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98ea90cc-1355-404b-aa4a-9391bab30861,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:38.883642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb8f6a3-c495-4fb5-b7a7-44eb47fbf1fa req-94a8e5a1-794e-4cf1-8331-5f559f147f84 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:38.885113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8eb8f6a3-c495-4fb5-b7a7-44eb47fbf1fa req-94a8e5a1-794e-4cf1-8331-5f559f147f84 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0507452 Dec 21 04:01:38.955568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8eb8f6a3-c495-4fb5-b7a7-44eb47fbf1fa req-a0838bcc-4961-4280-a941-00088f33ce63 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630014 Dec 21 04:01:39.687033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54bc9502-1bfd-4af4-ba72-c4d9f833dcf2 req-4e4f16b1-3670-40da-bdbe-c3f71afa2477 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0279539 Dec 21 04:01:39.851342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d221b1f-ffb0-42e5-8ea0-01eb5388588e req-610cbfec-789a-4fc0-8d49-dc7ab91cd33c tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0264556 Dec 21 04:01:39.870192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40816) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:39.974303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-1922378069'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:40.095031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366cf041-7eaa-46e0-8b1c-957b556d8bcf req-8a39665d-8b4a-448c-bbe9-fd3345ee9de6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:40.096551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-366cf041-7eaa-46e0-8b1c-957b556d8bcf req-8a39665d-8b4a-448c-bbe9-fd3345ee9de6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0556583 Dec 21 04:01:40.108551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Made reservation on behalf of 25d1e2cbc12340bc840dcf6113ca48b5 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:40.112736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.142373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.153666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-366cf041-7eaa-46e0-8b1c-957b556d8bcf req-e8f83ca9-5c31-4c62-a4d4-296443016720 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505922 Dec 21 04:01:40.256122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.359761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.387745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:01:40.418633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.418633 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Added segment 0c11cb50-4817-4d0b-996c-3d6ef5a81df8 of type vlan for network 91acf04a-9d98-4506-b44e-064b0a9d1f57 Dec 21 04:01:40.425612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2d3259ba-8d95-4b6f-b4e4-b9dd37d8fa4f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:40.494052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.715722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.734380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:40.735907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:40.802200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63718fdb-bd4f-43d9-83e8-657059b1eeb5 req-35af8c37-5ccc-4bab-b2d4-10af28e39ad1 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0313942 Dec 21 04:01:40.828583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event updated for resources: {'Network': ['ID=91acf04a-9d98-4506-b44e-064b0a9d1f57,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:40.838273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:01:40.851468 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de035648-6271-48ea-9728-3aff5aa655b8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.9776726 Dec 21 04:01:40.851903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40834) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:40.857410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Request body: {'subnet': {'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:41.016797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-109da27f-9b88-4965-9787-82626300c3f2 req-fbba08b9-5969-4fce-a5eb-65328b760ead tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0409124 Dec 21 04:01:41.067676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Made reservation on behalf of 25d1e2cbc12340bc840dcf6113ca48b5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:41.071640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:41.299743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a497014-1698-4eab-9feb-d5984ce8d922 req-6013a704-82e7-43d0-9fed-4d24d8e1f41e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:41.301286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a497014-1698-4eab-9feb-d5984ce8d922 req-6013a704-82e7-43d0-9fed-4d24d8e1f41e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0652421 Dec 21 04:01:41.343927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:41.361249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a497014-1698-4eab-9feb-d5984ce8d922 req-4a6d0e7a-4bb9-46c7-a629-f2d8c99f314f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536788 Dec 21 04:01:41.410644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event updated for resources: {'Subnet': ['ID=1a047cd6-9afc-414c-a979-8288457bdbb6,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:41.427343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Checking segment: {'id': '0c11cb50-4817-4d0b-996c-3d6ef5a81df8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:41.427711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Network hostable DHCP agents. Network: 91acf04a-9d98-4506-b44e-064b0a9d1f57, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:01:41.535089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:01:41.622406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 91acf04a-9d98-4506-b44e-064b0a9d1f57) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:41.628110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:41.628687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:41.636881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8e837d7-d024-4eea-9f1d-901322063919 None None] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:41.735032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2904c1bd-8915-4d2f-bae8-4632dc7dbe61 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8818302 Dec 21 04:01:41.737549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40852) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:41.744361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Request body: {'port': {'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57', 'name': 'tempest-TagsExtTest-324443965'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:41.767939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-91acf04a-9d98-4506-b44e-064b0a9d1f57', 'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57', 'project_id': '25d1e2cbc12340bc840dcf6113ca48b5', 'fixed_ips': [{'subnet_id': '1a047cd6-9afc-414c-a979-8288457bdbb6'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:01:41.770595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:41.923626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40b59b38-a86d-4f4b-9f13-55f257a8375f req-cb89f58a-2bde-4dda-a694-3af1b418b1b0 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0299432 Dec 21 04:01:41.944313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Made reservation on behalf of 25d1e2cbc12340bc840dcf6113ca48b5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:41.944313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:41.959626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Allocated IP 172.20.0.2 (91acf04a-9d98-4506-b44e-064b0a9d1f57/1a047cd6-9afc-414c-a979-8288457bdbb6/9a37ba04-24c1-42cc-87df-740024de0985) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:41.960322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] device_id is not set on port 8681b6e1-bec0-4949-8f30-7203d39c3578 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:01:42.132039 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.170152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a80c402c-41ed-4fbe-b4af-a5f7f5cadcb2 req-e39ed658-2920-4c97-b8e6-0b7256e815b0 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0455601 Dec 21 04:01:42.200271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.243193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:42.246067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:42.251161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:42.254322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Pushing event updated for resources: {'Port': ['ID=9a37ba04-24c1-42cc-87df-740024de0985,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:42.260023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Allocated IP 172.20.0.3 (91acf04a-9d98-4506-b44e-064b0a9d1f57/1a047cd6-9afc-414c-a979-8288457bdbb6/8681b6e1-bec0-4949-8f30-7203d39c3578) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:42.308417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Attempting to bind port 9a37ba04-24c1-42cc-87df-740024de0985 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:01:42.308794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Attempting to bind port 9a37ba04-24c1-42cc-87df-740024de0985 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0c11cb50-4817-4d0b-996c-3d6ef5a81df8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:01:42.309184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Attempting to bind port 9a37ba04-24c1-42cc-87df-740024de0985 on network 91acf04a-9d98-4506-b44e-064b0a9d1f57 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:01:42.315620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:01:42.316034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Checking segment: {'id': '0c11cb50-4817-4d0b-996c-3d6ef5a81df8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:01:42.316435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.316822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Bound using segment: {'id': '0c11cb50-4817-4d0b-996c-3d6ef5a81df8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:01:42.317497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Bound port: 9a37ba04-24c1-42cc-87df-740024de0985, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c11cb50-4817-4d0b-996c-3d6ef5a81df8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '91acf04a-9d98-4506-b44e-064b0a9d1f57'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:01:42.317880 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.389633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] For port 9a37ba04-24c1-42cc-87df-740024de0985, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:01:42.392821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] For port 9a37ba04-24c1-42cc-87df-740024de0985, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9a37ba04-24c1-42cc-87df-740024de0985,segment=NetworkSegment(0c11cb50-4817-4d0b-996c-3d6ef5a81df8),segment_id=0c11cb50-4817-4d0b-996c-3d6ef5a81df8)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:01:42.413731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.468929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.483386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6afafd18-9ddb-4f24-9fce-309851a78a70 req-b17501fe-5b89-4b02-9485-f6d982b8ad16 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:42.485008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6afafd18-9ddb-4f24-9fce-309851a78a70 req-b17501fe-5b89-4b02-9485-f6d982b8ad16 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0506761 Dec 21 04:01:42.527472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493b373d-788d-4060-a3f9-14db82d882eb None None] Pushing event updated for resources: {'Port': ['ID=9a37ba04-24c1-42cc-87df-740024de0985,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:42.544051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6afafd18-9ddb-4f24-9fce-309851a78a70 req-193f1d90-25c6-4d8e-9143-bf40d44f02f3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515609 Dec 21 04:01:42.555607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.624989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:42.627432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:42.632371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:01:42.636049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event updated for resources: {'Port': ['ID=8681b6e1-bec0-4949-8f30-7203d39c3578,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:42.688564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:42.689193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.781044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4cd3b206-cc95-4435-a5f0-f486ce1447d4 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 1.0418699 Dec 21 04:01:42.783534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40868) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:42.788583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-2097488178', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:42.907947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.909309 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:42.964853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.031600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c950907f-c26f-4ddd-8ad0-e11ee0997516 req-d015ba05-484b-4063-ba0e-0637c4df54e0 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0271597 Dec 21 04:01:43.057028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.184741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.186617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3bd6e850-a0e3-4c66-aeae-2021e237e3cf tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.4014838 Dec 21 04:01:43.189214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40876) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:43.194426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bc9ee0c7-926a-4308-ae54-7df9264698d1 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-170443813', 'prefixes': ['172.20.0.0/16']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:43.289041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-914615fd-919d-448f-aff6-ecddc81931a7 req-dae9c59c-71a2-49b2-affd-bcc4c7dad69a tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0313618 Dec 21 04:01:43.520398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b7f6bf2-0662-4347-946d-9015f8644407 None None] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:43.608372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc9ee0c7-926a-4308-ae54-7df9264698d1 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for subnetpool, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.608533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6b50134f-ea7e-4b98-952d-28a0dac022e5 None None] Provisioning complete for port 9a37ba04-24c1-42cc-87df-740024de0985 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:43.608533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b50134f-ea7e-4b98-952d-28a0dac022e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.608720 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bc9ee0c7-926a-4308-ae54-7df9264698d1 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 747 time: 0.4047225 Dec 21 04:01:43.608811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:43.613022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-b526be41-8363-49f7-9318-b78aabf5161d tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-947030226') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:43.761240 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b50134f-ea7e-4b98-952d-28a0dac022e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.804420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6b50134f-ea7e-4b98-952d-28a0dac022e5 None None] For port 9a37ba04-24c1-42cc-87df-740024de0985, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9a37ba04-24c1-42cc-87df-740024de0985,segment=NetworkSegment(0c11cb50-4817-4d0b-996c-3d6ef5a81df8),segment_id=0c11cb50-4817-4d0b-996c-3d6ef5a81df8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:43.811565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d875df-744e-43a1-bea3-65163ac4465a req-9f736a93-c64f-4c8c-9aab-422ea84ee850 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:43.813143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42d875df-744e-43a1-bea3-65163ac4465a req-9f736a93-c64f-4c8c-9aab-422ea84ee850 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1299491 Dec 21 04:01:43.882195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42d875df-744e-43a1-bea3-65163ac4465a req-e37767a2-fbbe-4794-a673-27c5c3e39ee4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610104 Dec 21 04:01:43.942977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b50134f-ea7e-4b98-952d-28a0dac022e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:43.967256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b526be41-8363-49f7-9318-b78aabf5161d tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-947030226 HTTP/1.1" status: 201 len: 201 time: 0.3664508 Dec 21 04:01:43.975128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40896) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:43.975128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-8d8a1f77-455e-43fd-80c2-dc5e1d76df80 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-255976305') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.029343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b50134f-ea7e-4b98-952d-28a0dac022e5 None None] Pushing event updated for resources: {'Port': ['ID=9a37ba04-24c1-42cc-87df-740024de0985,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:44.077403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40f43ab7-1db9-4283-9909-11238ddd175d None None] Provisioning complete for port 9a37ba04-24c1-42cc-87df-740024de0985 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:44.077814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40f43ab7-1db9-4283-9909-11238ddd175d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:44.175203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23bc2fba-cdb2-4ba3-a853-574d955a1026 req-428421cf-151d-49d6-8bc2-63c0c3af10d1 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0445850 Dec 21 04:01:44.183650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8d8a1f77-455e-43fd-80c2-dc5e1d76df80 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-255976305 HTTP/1.1" status: 201 len: 201 time: 0.2129180 Dec 21 04:01:44.188659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40900) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:44.195014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40f43ab7-1db9-4283-9909-11238ddd175d None None] Provisioning complete for port 8681b6e1-bec0-4949-8f30-7203d39c3578 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:44.195401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40f43ab7-1db9-4283-9909-11238ddd175d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:44.198644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-aef22b3f-77f1-43da-b573-124f1d064584 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-1812576124') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.243788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-40f43ab7-1db9-4283-9909-11238ddd175d None None] Port 8681b6e1-bec0-4949-8f30-7203d39c3578 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:01:44.363162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-39a738e1-1785-4bc6-b453-71742ec56903 None None] Provisioning complete for port 8681b6e1-bec0-4949-8f30-7203d39c3578 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:44.363521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-39a738e1-1785-4bc6-b453-71742ec56903 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:44.372599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aef22b3f-77f1-43da-b573-124f1d064584 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-1812576124 HTTP/1.1" status: 201 len: 201 time: 0.1846964 Dec 21 04:01:44.383252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:44.383252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-2a5d4424-9c45-4243-a4d5-078ffe552775 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-1111098506') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.404220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-39a738e1-1785-4bc6-b453-71742ec56903 None None] Port 8681b6e1-bec0-4949-8f30-7203d39c3578 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:01:44.424620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9db5034-bfca-4cc3-bc8b-0adb9c8ba47c req-a8e91857-27c2-414c-9662-b030ebadbbb6 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0426733 Dec 21 04:01:44.537290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2a5d4424-9c45-4243-a4d5-078ffe552775 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-1111098506 HTTP/1.1" status: 201 len: 201 time: 0.1606772 Dec 21 04:01:44.539904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40906) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:44.544117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-b3c17ba5-74d5-438a-ad69-d784c90074e0 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.634613 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3c17ba5-74d5-438a-ad69-d784c90074e0 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags HTTP/1.1" status: 200 len: 240 time: 0.0909393 Dec 21 04:01:44.635169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:44.640653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-6019fb1b-c812-433f-a73c-3b5744c24b5b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-947030226') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.708674 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6019fb1b-c812-433f-a73c-3b5744c24b5b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-947030226 HTTP/1.1" status: 204 len: 168 time: 0.0686178 Dec 21 04:01:44.708798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40912) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:44.712888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-6f2db1e0-96fa-420f-a4cd-869dadfa77b2 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-947030226') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.762793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9a37ba04-24c1-42cc-87df-740024de0985 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:01:44.838772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9a37ba04-24c1-42cc-87df-740024de0985 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:01:44.839181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:44.917178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6f2db1e0-96fa-420f-a4cd-869dadfa77b2 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-947030226 HTTP/1.1" status: 204 len: 168 time: 0.2062821 Dec 21 04:01:44.917636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:44.921969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-2f5856d8-c849-4402-a58c-c672f4bc35a6 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:44.995527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f5856d8-c849-4402-a58c-c672f4bc35a6 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags HTTP/1.1" status: 200 len: 205 time: 0.0766687 Dec 21 04:01:44.997993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40924) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.002826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-0f8ff360-e2d5-4443-821f-86cd3718adf9 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.028665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad73fcd-1c67-40d3-8810-e6e0150a966f req-46be1dcd-975c-4b26-9433-50004318412f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:45.032274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dad73fcd-1c67-40d3-8810-e6e0150a966f req-46be1dcd-975c-4b26-9433-50004318412f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0652492 Dec 21 04:01:45.063975 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f8ff360-e2d5-4443-821f-86cd3718adf9 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags HTTP/1.1" status: 200 len: 240 time: 0.0641818 Dec 21 04:01:45.066563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40926) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.077519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-8ea1e9c5-c1f3-4939-b2a8-7e23fe8547d8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-255976305') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.090578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dad73fcd-1c67-40d3-8810-e6e0150a966f req-171be6fa-b2d0-4480-89e4-3435ef721463 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524251 Dec 21 04:01:45.140902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8ea1e9c5-c1f3-4939-b2a8-7e23fe8547d8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-255976305 HTTP/1.1" status: 204 len: 168 time: 0.0730393 Dec 21 04:01:45.143400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40928) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.149741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-3fb75084-92c3-42ea-9754-e8efc75549ef tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-255976305') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.290164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2be5ba19-2e91-43ef-b454-08889e69efe9 req-ee069ffd-f468-4a3e-97ce-153887669b7b tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0300882 Dec 21 04:01:45.309427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3fb75084-92c3-42ea-9754-e8efc75549ef tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-255976305 HTTP/1.1" status: 204 len: 168 time: 0.1635756 Dec 21 04:01:45.312312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40932) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.317082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-2e2e8a18-29eb-42ad-a342-6b15860d343f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.371613 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e2e8a18-29eb-42ad-a342-6b15860d343f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags HTTP/1.1" status: 200 len: 205 time: 0.0580859 Dec 21 04:01:45.371860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40934) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.379249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-31f05f18-a498-49b3-9c36-d9adc80164ad tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.466231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-31f05f18-a498-49b3-9c36-d9adc80164ad tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags HTTP/1.1" status: 200 len: 241 time: 0.0910187 Dec 21 04:01:45.466399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40938) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.472299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-b328b6b7-0a33-45e7-9d81-0b9ac8eec7a3 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-1812576124') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.574236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f8f6361-d8c2-49e0-872c-62420ee5531e req-f915c243-3702-4629-9f09-fec10b852cf9 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0320590 Dec 21 04:01:45.579767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b328b6b7-0a33-45e7-9d81-0b9ac8eec7a3 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-1812576124 HTTP/1.1" status: 204 len: 168 time: 0.1113698 Dec 21 04:01:45.582122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.586922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-ddb82a66-c4d1-401e-8812-fa7970fe40c0 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-1812576124') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.761535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ddb82a66-c4d1-401e-8812-fa7970fe40c0 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-1812576124 HTTP/1.1" status: 204 len: 168 time: 0.1779790 Dec 21 04:01:45.763488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40942) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.768477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-00a42f70-4387-4f43-811e-d91ee602918a tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.848181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-00a42f70-4387-4f43-811e-d91ee602918a tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags HTTP/1.1" status: 200 len: 205 time: 0.0836062 Dec 21 04:01:45.848399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40948) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.867998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-c810630c-aa11-4612-b65d-d24f7a07a616 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.899447 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c810630c-aa11-4612-b65d-d24f7a07a616 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags HTTP/1.1" status: 200 len: 241 time: 0.0494521 Dec 21 04:01:45.928204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40952) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.929945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-4ec564c8-427e-4b8c-9e5b-915694f2a8b7 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-1111098506') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:45.959212 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ec564c8-427e-4b8c-9e5b-915694f2a8b7 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-1111098506 HTTP/1.1" status: 204 len: 168 time: 0.0326664 Dec 21 04:01:45.962017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40954) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:45.966325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-52465154-7bc9-44d1-80ff-8857b5b555b2 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-1111098506') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.080674 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-52465154-7bc9-44d1-80ff-8857b5b555b2 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-1111098506 HTTP/1.1" status: 204 len: 168 time: 0.1176522 Dec 21 04:01:46.085496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.087418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-bdc83cde-7cff-419d-9cf8-5e559d1ef1af tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.108684 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bdc83cde-7cff-419d-9cf8-5e559d1ef1af tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags HTTP/1.1" status: 200 len: 205 time: 0.0245655 Dec 21 04:01:46.111131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40960) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.115349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-d7641ec2-bf26-4c0f-b398-22eb35fb4775 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.146837 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7641ec2-bf26-4c0f-b398-22eb35fb4775 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags HTTP/1.1" status: 204 len: 168 time: 0.0346835 Dec 21 04:01:46.166842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40964) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.171438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-4587b688-f06f-4b86-98f3-9bcdc8349d0c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.213794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ef98c4-d450-43de-9689-9aadf32557c5 req-73dfb008-3298-4b57-b4cc-24d5ea1a3d34 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:46.215439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5ef98c4-d450-43de-9689-9aadf32557c5 req-73dfb008-3298-4b57-b4cc-24d5ea1a3d34 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0519729 Dec 21 04:01:46.249850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4587b688-f06f-4b86-98f3-9bcdc8349d0c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags HTTP/1.1" status: 204 len: 168 time: 0.0819182 Dec 21 04:01:46.252568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.256981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-669b9395-94c5-41a6-b23d-74a423acc339 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.270358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5ef98c4-d450-43de-9689-9aadf32557c5 req-5c166c19-4a09-44b8-850a-73895b92de49 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477517 Dec 21 04:01:46.312823 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-669b9395-94c5-41a6-b23d-74a423acc339 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags HTTP/1.1" status: 204 len: 168 time: 0.0591915 Dec 21 04:01:46.315462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40968) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.319979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-ad4050af-733f-4d10-aaf9-3c352201e361 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.387372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad4050af-733f-4d10-aaf9-3c352201e361 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags HTTP/1.1" status: 204 len: 168 time: 0.0707746 Dec 21 04:01:46.392124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.396653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-fde04e00-b7fd-4972-9c81-00a0852bb407 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-928601216') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.415872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915cb775-4b21-44fb-a9b9-7c22c9ca0bc0 req-9f142eea-0e73-4abe-b788-5f9464d7d33c tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0273309 Dec 21 04:01:46.568488 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fde04e00-b7fd-4972-9c81-00a0852bb407 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-928601216 HTTP/1.1" status: 201 len: 201 time: 0.1728773 Dec 21 04:01:46.568728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40974) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.573160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-91a83baf-c084-40e3-9546-455b907c30a1 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-2026468558') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.695131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-087abd59-8a85-4dfe-9c28-fbc8de096f68 req-80b4030e-5955-445b-bb20-8ab84574fdbe tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0262713 Dec 21 04:01:46.758017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-91a83baf-c084-40e3-9546-455b907c30a1 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-2026468558 HTTP/1.1" status: 201 len: 201 time: 0.1859128 Dec 21 04:01:46.759709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40978) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.765549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-bb071d7f-ab9e-4d71-8145-9ea5448874e6 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-1743821718') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:46.786572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-ce6fe321-71a5-439d-a98c-addbb304ec12 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0465925 Dec 21 04:01:46.904107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-10af9712-5557-4b20-849f-78610481762a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:46.905689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-10af9712-5557-4b20-849f-78610481762a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.0498207 Dec 21 04:01:46.950181 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bb071d7f-ab9e-4d71-8145-9ea5448874e6 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-1743821718 HTTP/1.1" status: 201 len: 201 time: 0.1888080 Dec 21 04:01:46.952787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40986) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:46.960766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-fcc64ff2-d492-4afb-baab-59316b397837 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-552432309') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.043241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-ffc69216-f1ff-40f2-8b93-20efee766ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:47.046065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-ffc69216-f1ff-40f2-8b93-20efee766ec8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.1175163 Dec 21 04:01:47.087594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fcc64ff2-d492-4afb-baab-59316b397837 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-552432309 HTTP/1.1" status: 201 len: 201 time: 0.1322424 Dec 21 04:01:47.094756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40990) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.102959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-baa98047-5984-4594-8d22-c14d38d1f2f8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', {'tags': ['tempest-TagsExtTest-Tag-205293363', 'tempest-TagsExtTest-Tag-1686721974', 'tempest-TagsExtTest-Tag-2117591488']}) {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.153198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-8f1d96f0-7ceb-4135-ba7f-d0d66991389e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.0992792 Dec 21 04:01:47.225133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-599c7b76-4cc3-4015-89aa-468ec40cff54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:47.226771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-599c7b76-4cc3-4015-89aa-468ec40cff54 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0650113 Dec 21 04:01:47.275029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-baa98047-5984-4594-8d22-c14d38d1f2f8 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags HTTP/1.1" status: 200 len: 317 time: 0.1757622 Dec 21 04:01:47.277361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40994) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.282154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-7f3e32c8-ffbe-49bc-af6f-f721b0c02c38 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.283707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-8a286b53-52c4-42e6-87e6-4620608662e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:47.286047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-8a286b53-52c4-42e6-87e6-4620608662e9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0515740 Dec 21 04:01:47.449371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-2576edc1-58ae-4c06-8794-3f827d66c8d1 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1529541 Dec 21 04:01:47.476408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6f9440-c418-4317-bd40-c5e87707c541 req-558e09f1-ea29-4209-996b-f2d36e7bdfaa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:47.478035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e6f9440-c418-4317-bd40-c5e87707c541 req-558e09f1-ea29-4209-996b-f2d36e7bdfaa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0943105 Dec 21 04:01:47.486291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f3e32c8-ffbe-49bc-af6f-f721b0c02c38 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags HTTP/1.1" status: 204 len: 168 time: 0.2078798 Dec 21 04:01:47.493624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41000) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.493624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-faf272b0-d188-4d69-93bf-d70d72611d54 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-205293363') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.541231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd7be49e-4580-46f9-8be4-505dd495446f req-f5ab6750-8bde-4001-92c9-49e6354796af tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0307765 Dec 21 04:01:47.586671 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-faf272b0-d188-4d69-93bf-d70d72611d54 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:47.588549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-faf272b0-d188-4d69-93bf-d70d72611d54 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-205293363 HTTP/1.1" status: 404 len: 328 time: 0.0984190 Dec 21 04:01:47.607731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41004) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.627419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-9510842b-dc58-4c6a-8e32-41641498629b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-1686721974') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.642964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e6f9440-c418-4317-bd40-c5e87707c541 req-6046c824-1cef-4579-99f0-e822763998d2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531217 Dec 21 04:01:47.680924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8262e579-4de9-4f3b-8828-437ef3c8275d req-a824a103-c013-4045-a8a0-50f29e69e969 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2225606 Dec 21 04:01:47.683847 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-9510842b-dc58-4c6a-8e32-41641498629b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:47.685070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9510842b-dc58-4c6a-8e32-41641498629b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-1686721974 HTTP/1.1" status: 404 len: 329 time: 0.0761027 Dec 21 04:01:47.687775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.692167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-c6c52a90-66f6-4aa0-8912-6f9466c9641f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6', 'tempest-TagsExtTest-Tag-2117591488') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.749793 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-c6c52a90-66f6-4aa0-8912-6f9466c9641f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:47.753467 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c6c52a90-66f6-4aa0-8912-6f9466c9641f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags/tempest-TagsExtTest-Tag-2117591488 HTTP/1.1" status: 404 len: 329 time: 0.0621123 Dec 21 04:01:47.753671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.758499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-019ef913-2268-425d-901b-f3a5674076c5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', {'tags': ['tempest-TagsExtTest-Tag-1550232686', 'tempest-TagsExtTest-Tag-1318459604', 'tempest-TagsExtTest-Tag-1863314067']}) {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:47.812431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c62a1d95-9975-414d-b7c1-2cd8215ee813 req-02cc8d91-0a0e-480c-bbf7-67e47b1876f2 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0302680 Dec 21 04:01:47.955859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-019ef913-2268-425d-901b-f3a5674076c5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags HTTP/1.1" status: 200 len: 318 time: 0.2009199 Dec 21 04:01:47.966206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41016) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:47.966206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-1c73182a-083c-4dd3-afc3-f0bd67a288c0 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.101719 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c73182a-083c-4dd3-afc3-f0bd67a288c0 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags HTTP/1.1" status: 204 len: 168 time: 0.1425042 Dec 21 04:01:48.104687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41022) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:48.108921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-ebda4d2c-a3fb-4463-875f-2373faa31e2f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-1550232686') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.165179 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-ebda4d2c-a3fb-4463-875f-2373faa31e2f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:48.168825 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ebda4d2c-a3fb-4463-875f-2373faa31e2f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-1550232686 HTTP/1.1" status: 404 len: 329 time: 0.0631976 Dec 21 04:01:48.172120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41024) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:48.176735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-931d2298-8e47-4f7e-9fbb-9b7ae26bd426 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-1318459604') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.229509 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-931d2298-8e47-4f7e-9fbb-9b7ae26bd426 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:48.229509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-931d2298-8e47-4f7e-9fbb-9b7ae26bd426 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-1318459604 HTTP/1.1" status: 404 len: 329 time: 0.0560517 Dec 21 04:01:48.232156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41026) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:48.236408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-293ba8e4-d113-40af-8e22-dbd90c9eee31 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578', 'tempest-TagsExtTest-Tag-1863314067') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.292856 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-293ba8e4-d113-40af-8e22-dbd90c9eee31 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:48.296475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-293ba8e4-d113-40af-8e22-dbd90c9eee31 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags/tempest-TagsExtTest-Tag-1863314067 HTTP/1.1" status: 404 len: 329 time: 0.0607729 Dec 21 04:01:48.296760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41030) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:48.301715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-e5293422-4269-48c5-84a3-8f6fa8a79de3 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', {'tags': ['tempest-TagsExtTest-Tag-1542474433', 'tempest-TagsExtTest-Tag-1706426629', 'tempest-TagsExtTest-Tag-938976751']}) {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.509172 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e5293422-4269-48c5-84a3-8f6fa8a79de3 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags HTTP/1.1" status: 200 len: 317 time: 0.2111337 Dec 21 04:01:48.511455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41032) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:48.516157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-2a962ab1-5e85-41b7-9423-23e45bf6a97b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.556317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-b1dffffa-489e-47ca-8fb3-0e91d45340aa service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.0515389 Dec 21 04:01:48.701804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a6afe9c-318e-4e37-9115-1a29ce29a9cc req-ab05539e-7e82-4cb0-9d4f-8dac8e6aef17 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0401356 Dec 21 04:01:48.715401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.716365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.716365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.717350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.718222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.718464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.718746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.723141 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2a962ab1-5e85-41b7-9423-23e45bf6a97b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags HTTP/1.1" status: 204 len: 168 time: 0.2081068 Dec 21 04:01:48.723303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-84852f70-3ef8-4360-8af9-fed17be960f5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.0868258 Dec 21 04:01:48.723417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41040) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:48.727890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-18b57a6a-b723-4f07-9c08-a4b36efbd07b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-1542474433') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:48.876561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc1a6487-6429-422c-9358-388835755e6a req-db1666a1-3682-4a38-8ca0-cdda4723610d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:48.878553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc1a6487-6429-422c-9358-388835755e6a req-db1666a1-3682-4a38-8ca0-cdda4723610d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1339529 Dec 21 04:01:49.020025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65bb85e5-7196-4b69-bc2b-16a4f9027cd6 req-e27a7c3d-ea2c-4b2b-95fe-c70ea10761e4 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0606885 Dec 21 04:01:49.021383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-a07b0b07-bac1-40ca-b315-d1f0cbae47ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.021856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-a07b0b07-bac1-40ca-b315-d1f0cbae47ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.022319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-a07b0b07-bac1-40ca-b315-d1f0cbae47ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.024734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-a07b0b07-bac1-40ca-b315-d1f0cbae47ca service neutron] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 2297 time: 0.2706385 Dec 21 04:01:49.028024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc1a6487-6429-422c-9358-388835755e6a req-24cdd450-49f5-45de-92b4-acb56ad4196f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1420631 Dec 21 04:01:49.106959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-0d1868af-6e5e-4d13-bf7f-910aea9345d1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 1001 time: 0.0656853 Dec 21 04:01:49.148790 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-18b57a6a-b723-4f07-9c08-a4b36efbd07b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:49.151387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-18b57a6a-b723-4f07-9c08-a4b36efbd07b tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-1542474433 HTTP/1.1" status: 404 len: 329 time: 0.4269373 Dec 21 04:01:49.153062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.159933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-f2f4d787-acb7-4072-8241-c7079c36722a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.161445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-f2f4d787-acb7-4072-8241-c7079c36722a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.0474603 Dec 21 04:01:49.163463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-d8a3adc7-dbda-4f14-88ad-6fb6a67033f7 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-1706426629') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.213033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-98b0f3af-9667-4fed-ba7b-2b3c5e2fbdb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.214624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-98b0f3af-9667-4fed-ba7b-2b3c5e2fbdb8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0456376 Dec 21 04:01:49.240164 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-d8a3adc7-dbda-4f14-88ad-6fb6a67033f7 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:49.241115 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8a3adc7-dbda-4f14-88ad-6fb6a67033f7 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-1706426629 HTTP/1.1" status: 404 len: 329 time: 0.0854256 Dec 21 04:01:49.244000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41050) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.248540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-7c20ee14-3911-4572-a5a1-ff68370b5b59 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b', 'tempest-TagsExtTest-Tag-938976751') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.313058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-2c92ab5e-4cea-4902-a18e-bcca3a2a725d service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852749 Dec 21 04:01:49.321743 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-7c20ee14-3911-4572-a5a1-ff68370b5b59 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:49.322759 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c20ee14-3911-4572-a5a1-ff68370b5b59 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags/tempest-TagsExtTest-Tag-938976751 HTTP/1.1" status: 404 len: 328 time: 0.0777967 Dec 21 04:01:49.325443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41052) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.330488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-3c3e384b-fb8b-42fa-9572-c25942478198 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', {'tags': ['tempest-TagsExtTest-Tag-367366977', 'tempest-TagsExtTest-Tag-2097653138', 'tempest-TagsExtTest-Tag-836419541']}) {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.410425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-68bc3d0a-1abd-4fa9-97f0-2f3a440331e7 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903323 Dec 21 04:01:49.452957 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3c3e384b-fb8b-42fa-9572-c25942478198 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "PUT /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags HTTP/1.1" status: 200 len: 316 time: 0.1264956 Dec 21 04:01:49.455460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.459746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-6918f4c1-a84b-4423-8094-5b557b9def10 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.469330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-c9364f2b-b1cf-4ac9-bf21-e98eb9a493a3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.83&port_id=bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 217 time: 0.0360522 Dec 21 04:01:49.522432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-f7239ad0-5c06-4111-b136-e8861da55528 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.523937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-f7239ad0-5c06-4111-b136-e8861da55528 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0438781 Dec 21 04:01:49.575051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-ed24bc68-6b61-4f9e-9c36-895a9ef39fd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:49.577167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-ed24bc68-6b61-4f9e-9c36-895a9ef39fd1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0455763 Dec 21 04:01:49.578609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6918f4c1-a84b-4423-8094-5b557b9def10 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags HTTP/1.1" status: 204 len: 168 time: 0.1221051 Dec 21 04:01:49.581031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41058) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.585888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-0e454cf1-accf-4a46-9129-757dcda14698 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-367366977') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.610351 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-0e454cf1-accf-4a46-9129-757dcda14698 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:49.610351 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0e454cf1-accf-4a46-9129-757dcda14698 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-367366977 HTTP/1.1" status: 404 len: 328 time: 0.0282094 Dec 21 04:01:49.613012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41060) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.617291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-b61e76fa-0b7c-4720-9567-fbe31ae75536 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-2097653138') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.639483 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-b61e76fa-0b7c-4720-9567-fbe31ae75536 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:49.640769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b61e76fa-0b7c-4720-9567-fbe31ae75536 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-2097653138 HTTP/1.1" status: 404 len: 329 time: 0.0268793 Dec 21 04:01:49.643519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41062) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.648459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-4cecc2f5-ce6b-457c-88df-62840f71e2af tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489', 'tempest-TagsExtTest-Tag-836419541') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.670835 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-4cecc2f5-ce6b-457c-88df-62840f71e2af tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] show failed (client error): The resource could not be found. Dec 21 04:01:49.671771 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4cecc2f5-ce6b-457c-88df-62840f71e2af tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags/tempest-TagsExtTest-Tag-836419541 HTTP/1.1" status: 404 len: 328 time: 0.0273492 Dec 21 04:01:49.674452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41064) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.678722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-9fb9a7fa-4fb2-432e-b98d-190c3faf8986 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '8bdaac0b-320b-47aa-aaed-38853fec1489') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.687151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-734de17c-d127-49be-85a6-dfdc715de7be service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0962567 Dec 21 04:01:49.706013 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9fb9a7fa-4fb2-432e-b98d-190c3faf8986 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489/tags HTTP/1.1" status: 204 len: 168 time: 0.0305512 Dec 21 04:01:49.711735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41068) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.717609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-2ac8a1df-199d-46f1-93b1-557c7eed0f07 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '9dad6403-b1d9-4d72-8a6b-e7a50d4b955b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.815486 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ac8a1df-199d-46f1-93b1-557c7eed0f07 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b/tags HTTP/1.1" status: 204 len: 168 time: 0.1023176 Dec 21 04:01:49.817447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41074) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:49.822260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.tag.tag_plugin [None req-aaba2a24-99d8-4b8b-8f11-7c1d5554386f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '8681b6e1-bec0-4949-8f30-7203d39c3578') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:49.873718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-167679e4-750f-4a47-9385-b8907195a5c4 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1766956 Dec 21 04:01:49.889473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b305ee8-3e2b-4e6b-b399-a92b7940a22d req-b7837424-6db6-441d-aa03-e1988eeb62f0 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0563753 Dec 21 04:01:49.937981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-77ce9175-54c2-428c-bb10-f915bba08809 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.54&port_id=c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 217 time: 0.0465953 Dec 21 04:01:49.942802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eac8ccab-612e-4ee8-bd64-66097f9fe41e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:50.005008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aaba2a24-99d8-4b8b-8f11-7c1d5554386f tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578/tags HTTP/1.1" status: 204 len: 168 time: 0.1864936 Dec 21 04:01:50.007091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41078) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:50.007906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-68c22be3-17cc-404f-8c4e-90db45dcdb8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:50.009370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-68c22be3-17cc-404f-8c4e-90db45dcdb8f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0612888 Dec 21 04:01:50.017768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-baf42865-2f98-41fc-a39d-a8193674a3b6 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '1a047cd6-9afc-414c-a979-8288457bdbb6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:50.084659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-e388f218-bc3f-4e37-8e8e-841076d26f88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:50.087499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-e388f218-bc3f-4e37-8e8e-841076d26f88 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0487077 Dec 21 04:01:50.135528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-baf42865-2f98-41fc-a39d-a8193674a3b6 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6/tags HTTP/1.1" status: 204 len: 168 time: 0.1267622 Dec 21 04:01:50.136991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41086) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:50.247400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72d368b0-bc3b-462e-9229-92307787e298 req-591038e7-8e86-44d5-8de3-fc1571e23ea9 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0892451 Dec 21 04:01:50.657670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64050a64-64a1-4e0b-89b0-584770428512 req-43164ded-8995-44ce-94db-205c9347c850 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:50.659378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64050a64-64a1-4e0b-89b0-584770428512 req-43164ded-8995-44ce-94db-205c9347c850 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.5077822 Dec 21 04:01:50.670076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-c2d9c0d1-75be-4489-aca8-a761ba239faf service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5682669 Dec 21 04:01:50.753409 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4ae22f4-dd75-4635-9145-53651ef36468 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for subnetpool, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:50.758387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b4ae22f4-dd75-4635-9145-53651ef36468 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnetpools/8bdaac0b-320b-47aa-aaed-38853fec1489 HTTP/1.1" status: 204 len: 168 time: 0.6164200 Dec 21 04:01:50.773787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:50.775952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64050a64-64a1-4e0b-89b0-584770428512 req-9404ff20-6460-4ebf-9dec-65a69c4d8d3b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026509 Dec 21 04:01:50.806417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ff3e234d-d097-4b71-8700-04dacf14997a tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "GET /v2.0/ports?device_id=9dad6403-b1d9-4d72-8a6b-e7a50d4b955b HTTP/1.1" status: 200 len: 205 time: 0.0450010 Dec 21 04:01:50.806791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41100) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:50.820656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-2094c9c1-54e5-477b-8642-748b7edb49c0 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1466250 Dec 21 04:01:50.883314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-425e34bf-cbd7-433a-a3b7-85e025c4279e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.84&port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 217 time: 0.0519400 Dec 21 04:01:50.895702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:50.951995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-015d6fd8-6628-4296-92f9-9b6d1441c776 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:50.965092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-015d6fd8-6628-4296-92f9-9b6d1441c776 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0747526 Dec 21 04:01:51.042055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-067a4d69-086b-43bd-8dfe-987d91ec365e req-515a0232-a2c4-4bce-9da9-b5b3aabebf86 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0335340 Dec 21 04:01:51.057660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-6cd16466-c063-48df-92e8-ec9af5c07eec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:51.059379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-6cd16466-c063-48df-92e8-ec9af5c07eec service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0848985 Dec 21 04:01:51.097680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.099798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.156777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-e4290806-b3d6-4394-83cd-5660b47dae49 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894625 Dec 21 04:01:51.217226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.217772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Fanout notify agent at l3_agent the message router_deleted on router 9dad6403-b1d9-4d72-8a6b-e7a50d4b955b {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:01:51.225537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.230961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fc3dc45f-5f7d-4823-be69-81528e170866 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/routers/9dad6403-b1d9-4d72-8a6b-e7a50d4b955b HTTP/1.1" status: 204 len: 168 time: 0.4230306 Dec 21 04:01:51.231624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41104) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:51.289646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-d029330f-d41b-479f-8b22-0354a3ccc4dd service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247475 Dec 21 04:01:51.344543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-8a670cad-d2f9-42d6-8bee-b033932091ef service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.56&port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 217 time: 0.0456786 Dec 21 04:01:51.362912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Deleting port 8681b6e1-bec0-4949-8f30-7203d39c3578 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:51.365719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.430069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96e4401d-08cc-419d-8809-ac7a719fa78f req-80e1040a-d652-46f1-98cb-ae6a3dd2688b tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0599551 Dec 21 04:01:51.438526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-8dbfb108-f53c-4d51-a7d1-1b893b2cb3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:51.443075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-8dbfb108-f53c-4d51-a7d1-1b893b2cb3c0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0884442 Dec 21 04:01:51.468433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.481866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Calling delete_port for 8681b6e1-bec0-4949-8f30-7203d39c3578 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:51.510060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-0fdb0a7a-96ee-47c9-b355-2a3159218c93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:51.512042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-0fdb0a7a-96ee-47c9-b355-2a3159218c93 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0599501 Dec 21 04:01:51.633010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-1863aff1-490c-4d33-b37d-13f49278d5f8 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113462 Dec 21 04:01:51.731439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-8efbf24c-e159-4c29-b71f-b02a2d31e497 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908599 Dec 21 04:01:51.754367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.784428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event deleted for resources: {'Port': ['ID=8681b6e1-bec0-4949-8f30-7203d39c3578,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:51.790512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-91763bd8-3536-4732-b782-e6e1c6d5ff85 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 217 time: 0.0514421 Dec 21 04:01:51.864897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-d5f389d0-efe2-4dc7-a44d-905e9eceff01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:51.866636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-d5f389d0-efe2-4dc7-a44d-905e9eceff01 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0679924 Dec 21 04:01:51.926864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:51.936995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8de9d85e-341e-47ff-a1be-f40501735452 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/ports/8681b6e1-bec0-4949-8f30-7203d39c3578 HTTP/1.1" status: 204 len: 168 time: 0.7025375 Dec 21 04:01:51.937675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41118) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:51.950215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21d0e3c8-7b30-4e43-99fb-5f8d2ae23132 req-d3d1a62c-d3b9-4fe1-aa9a-a65d54a47070 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0388880 Dec 21 04:01:52.001314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-b63b5668-df86-411b-bd7c-7870bf76c649 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:52.001314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-b63b5668-df86-411b-bd7c-7870bf76c649 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1187420 Dec 21 04:01:52.016914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Deleting subnet 1a047cd6-9afc-414c-a979-8288457bdbb6 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:01:52.022258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.081536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.100753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c73c4f6e-6449-4f46-aedd-db7edb7b82fb req-8732647b-e44f-4f00-9322-dab3d9528171 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:52.102297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c73c4f6e-6449-4f46-aedd-db7edb7b82fb req-8732647b-e44f-4f00-9322-dab3d9528171 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1507223 Dec 21 04:01:52.164268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c73c4f6e-6449-4f46-aedd-db7edb7b82fb req-581fe8f6-1230-4c92-bc0e-0aa56dd30c58 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528185 Dec 21 04:01:52.200665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.201903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4123b971-43c9-44f6-896b-2c653206d012 req-1f85d2fd-24a4-496f-8e0b-0d0c5f1451a5 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0410364 Dec 21 04:01:52.218962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-53196413-d999-439d-8e1a-5ec827165fdc service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2008617 Dec 21 04:01:52.322135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-45a9bbd6-15bc-4b66-acc3-4c29c02e5ce2 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951018 Dec 21 04:01:52.365535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-e6daf7c1-074d-4e74-b24b-0027068ed039 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0359490 Dec 21 04:01:52.394224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.419300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-529a3a0d-802e-45d3-a4d2-c2ba322e7181 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:52.421086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-529a3a0d-802e-45d3-a4d2-c2ba322e7181 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0481660 Dec 21 04:01:52.431117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event deleted for resources: {'Subnet': ['ID=1a047cd6-9afc-414c-a979-8288457bdbb6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:52.438766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.442383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8ef2f0c8-2c86-41fc-a41e-ae403214466c tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/subnets/1a047cd6-9afc-414c-a979-8288457bdbb6 HTTP/1.1" status: 204 len: 168 time: 0.5036676 Dec 21 04:01:52.447364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:52.448017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c8c9064-1438-498e-8df3-63b510513ca5 None None] Network 91acf04a-9d98-4506-b44e-064b0a9d1f57 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:01:52.494623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-67ed0be8-c1cf-48de-84b0-58c882a94f60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:52.499694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-67ed0be8-c1cf-48de-84b0-58c882a94f60 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0679941 Dec 21 04:01:52.637104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6897835-938c-4e52-a468-bc37de46b3b4 req-c6a50afb-67d6-4b9c-b858-cde4d8052c78 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0326936 Dec 21 04:01:52.646778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.695972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-1c5a454a-fa18-47d9-86d1-a5863e839857 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1921000 Dec 21 04:01:52.727910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Deleting port 9a37ba04-24c1-42cc-87df-740024de0985 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:52.728977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.802522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] For port 9a37ba04-24c1-42cc-87df-740024de0985, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9a37ba04-24c1-42cc-87df-740024de0985,segment=NetworkSegment(0c11cb50-4817-4d0b-996c-3d6ef5a81df8),segment_id=0c11cb50-4817-4d0b-996c-3d6ef5a81df8)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:52.803221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.822884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Calling delete_port for 9a37ba04-24c1-42cc-87df-740024de0985 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:52.830577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59fb797a-15e9-4bd0-98f5-2164078b8231 req-b46cfb43-f38d-41fc-9500-d9b522d532a5 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269157 Dec 21 04:01:52.838606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-585abe8f-9175-4c87-97e1-efe4d2013987 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.920427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] DHCP port deletion for 91acf04a-9d98-4506-b44e-064b0a9d1f57 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:01:52.947457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.971873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] Deleting port 9a37ba04-24c1-42cc-87df-740024de0985 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:01:52.972510 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:52.988544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.019316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event deleted for resources: {'Port': ['ID=9a37ba04-24c1-42cc-87df-740024de0985,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:53.023318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] No DVR routers for this DVR port 9a37ba04-24c1-42cc-87df-740024de0985 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:53.059754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] For port 9a37ba04-24c1-42cc-87df-740024de0985, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9a37ba04-24c1-42cc-87df-740024de0985,segment=NetworkSegment(0c11cb50-4817-4d0b-996c-3d6ef5a81df8),segment_id=0c11cb50-4817-4d0b-996c-3d6ef5a81df8)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:01:53.061077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.079416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] Calling delete_port for 9a37ba04-24c1-42cc-87df-740024de0985 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:01:53.126169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.148652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['91acf04a-9d98-4506-b44e-064b0a9d1f57']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:53.160001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c11cb50-4817-4d0b-996c-3d6ef5a81df8') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:53.160546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c11cb50-4817-4d0b-996c-3d6ef5a81df8') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:01:53.166740 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.171386 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.187043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.201166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Releasing vlan 106 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:01:53.201166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.204282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] Pushing event deleted for resources: {'Port': ['ID=9a37ba04-24c1-42cc-87df-740024de0985,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:53.206215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49796c9a-18ec-4ed6-b53d-ca1760ef6f41 None None] No DVR routers for this DVR port 9a37ba04-24c1-42cc-87df-740024de0985 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:01:53.206475 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:01:53.281284 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.336135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24898ce-b560-4eea-8052-ebc24217692b req-79fe84f0-e06d-4529-bb66-0a21747ac643 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:53.338212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24898ce-b560-4eea-8052-ebc24217692b req-79fe84f0-e06d-4529-bb66-0a21747ac643 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0807345 Dec 21 04:01:53.340333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c68116de-3914-4d84-a2a2-f5f5e24f7379 req-c04b9ddf-592b-4900-b14b-22e8fdb1442a tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0452266 Dec 21 04:01:53.365152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.373348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:53.378309 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] 10.222.0.18 "DELETE /v2.0/networks/91acf04a-9d98-4506-b44e-064b0a9d1f57 HTTP/1.1" status: 204 len: 168 time: 0.9297986 Dec 21 04:01:53.390651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5f20b23-94fc-44c6-a05e-95155b4542a5 tempest-TagsExtTest-1842824370 tempest-TagsExtTest-1842824370-project] Pushing event deleted for resources: {'Network': ['ID=91acf04a-9d98-4506-b44e-064b0a9d1f57,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:53.415397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24898ce-b560-4eea-8052-ebc24217692b req-acb449d8-239b-4e22-9c7e-4e0935471665 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692983 Dec 21 04:01:53.766304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93c628be-c497-476e-94a9-3bd9ecbd95c8 req-eef5f4d2-27a6-4336-b741-b98d3033608a tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0379181 Dec 21 04:01:53.942308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41154) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:54.077897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d8f5d2d-f158-477f-b21e-1ec06aca3135 req-1380a52d-e096-4331-bd7e-fe1cf35ef560 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e&device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0313008 Dec 21 04:01:54.130327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73793587-8883-40d5-bf6a-770c71079860 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=25d1e2cbc12340bc840dcf6113ca48b5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1802235 Dec 21 04:01:54.132762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41162) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:54.206516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-176dfaf1-5acd-4179-bc6d-4d8b0234d9e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:54.229593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-176dfaf1-5acd-4179-bc6d-4d8b0234d9e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:54.400660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-176dfaf1-5acd-4179-bc6d-4d8b0234d9e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:54.403872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-176dfaf1-5acd-4179-bc6d-4d8b0234d9e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:54.406733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-176dfaf1-5acd-4179-bc6d-4d8b0234d9e5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2d3259ba-8d95-4b6f-b4e4-b9dd37d8fa4f HTTP/1.1" status: 204 len: 168 time: 0.2711740 Dec 21 04:01:54.432332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176dfaf1-5acd-4179-bc6d-4d8b0234d9e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d3259ba-8d95-4b6f-b4e4-b9dd37d8fa4f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:54.527984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c679aa48-6b1d-42fc-8004-0abb60d4ffe7 req-8e696a22-bb0e-485d-b20e-0b889517868b tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0867302 Dec 21 04:01:54.740573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4149fade-8c68-4767-a08f-f097c366ead5 req-feb493cf-5d81-4c2d-a35e-7508a840ca08 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3dfc5c3b7716407e99e5a34d4d89ac7b&device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0459049 Dec 21 04:01:54.761940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cddebc-9c8a-4a05-a656-202978c0f0d1 req-517f7b8c-5fcc-45c7-bfec-6afc6456a3d6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:54.764034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67cddebc-9c8a-4a05-a656-202978c0f0d1 req-517f7b8c-5fcc-45c7-bfec-6afc6456a3d6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1461680 Dec 21 04:01:54.775883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9a37ba04-24c1-42cc-87df-740024de0985 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:01:54.786997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4149fade-8c68-4767-a08f-f097c366ead5 req-1f02df21-1b1c-48aa-9fac-18f825d64e77 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=3dfc5c3b7716407e99e5a34d4d89ac7b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0222642 Dec 21 04:01:54.801612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9a37ba04-24c1-42cc-87df-740024de0985 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:01:54.801968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9a37ba04-24c1-42cc-87df-740024de0985 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:01:54.845098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-427f18f5-b681-4b8f-b2be-03b5ea01a089 req-9b51c503-4e96-41da-bb25-308466ec8e29 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0791700 Dec 21 04:01:54.897177 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:54.938319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67cddebc-9c8a-4a05-a656-202978c0f0d1 req-f147b5c6-759f-418f-a545-a309b8205eb2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1502962 Dec 21 04:01:54.999743 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:55.024226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4149fade-8c68-4767-a08f-f097c366ead5 req-1a9ec501-9c03-4023-afdc-32505378579a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:55.026788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4149fade-8c68-4767-a08f-f097c366ead5 req-1a9ec501-9c03-4023-afdc-32505378579a service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2304409 Dec 21 04:01:55.225644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc606070-2ae3-4006-b1b9-621c306f223e req-ca11e716-fa7f-4841-807e-d2113e871c01 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:55.227300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc606070-2ae3-4006-b1b9-621c306f223e req-ca11e716-fa7f-4841-807e-d2113e871c01 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0604167 Dec 21 04:01:55.291486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc606070-2ae3-4006-b1b9-621c306f223e req-5b211f86-e98f-4370-9ff4-d23a67452a95 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490236 Dec 21 04:01:55.430760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ef90c2-e3c8-43e2-aab0-3a6550d086c7 req-dc746fb3-7ff3-437a-a0b0-cecfe7081e9d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:55.439052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5ef90c2-e3c8-43e2-aab0-3a6550d086c7 req-dc746fb3-7ff3-437a-a0b0-cecfe7081e9d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0671780 Dec 21 04:01:55.483690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5ef90c2-e3c8-43e2-aab0-3a6550d086c7 req-d1203726-4a80-45e5-8201-17d6f8ad9426 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437615 Dec 21 04:01:55.665878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eebf5d49-0e61-49f2-a57b-2b63c25858a2 req-8f678dc8-e0f6-4b09-af2e-2fd556d7efb0 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0525444 Dec 21 04:01:55.709246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:55.858004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-c138f28e-4c69-4273-9190-356c9eec8f8a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:55.859518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-c138f28e-4c69-4273-9190-356c9eec8f8a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.1338208 Dec 21 04:01:55.877610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-52cf7b5e-4d21-4f01-94dd-1f613a9c395c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/quotas/2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 375 time: 0.0114565 Dec 21 04:01:55.941388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41232) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:55.945136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [-] 10.222.0.18 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0026321 Dec 21 04:01:55.949694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41234) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:55.949855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-3ba9ede2-647e-4892-a8bb-7e5b26f05d2d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0657151 Dec 21 04:01:55.981140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42434dc9-2412-48d7-a0d9-10ab72644ba2 req-96ab9c3f-ae25-4e36-8c4e-bcf68cd4b095 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0503006 Dec 21 04:01:56.065320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34cdb4de-18ce-4506-8a94-cb3b62011c15 tempest-NetworksApiDiscovery-380208934 tempest-NetworksApiDiscovery-380208934-project] 10.222.0.18 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.1144433 Dec 21 04:01:56.070711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-4775c00d-d142-4fb0-94e2-5ab3de5e108b service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1106675 Dec 21 04:01:56.167548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-a8c10979-0c16-48c4-a226-9c39601a29dc service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909328 Dec 21 04:01:56.468448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2269dbe-7d88-4d85-b069-028476cd0872 req-0835e59f-1a38-4f8e-a192-a9a115df3dcf tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 210 time: 0.0286746 Dec 21 04:01:56.590555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4149fade-8c68-4767-a08f-f097c366ead5 req-5d18128f-ba9d-48dd-8c62-d8db4b1d34d2 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.31 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0314763 Dec 21 04:01:56.654632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41256) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:56.799778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:56.831853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7698005d-3f76-42f3-8b19-175370968ef1 req-db6636a0-f395-4323-ba8b-aef090197bd9 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0393150 Dec 21 04:01:56.918499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:57.086232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:57.103780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7553078a-3cf6-4d57-840f-fea1b6f3cb37 req-543dae6a-3329-4e6a-b2d0-ec6c7ea80a37 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=6e56fabd-b074-4dfe-bc94-7f67af7dd60d HTTP/1.1" status: 200 len: 210 time: 0.0330443 Dec 21 04:01:57.146828 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=956e9d870ded4924add25be88cab2f5f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4906850 Dec 21 04:01:57.156294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41276) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:01:57.160055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=214fe1cc-fd9c-4182-be9f-c6c36b412d0f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:57.167464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.167811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.168151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.168487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.168817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.169215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.169511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.169866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.170510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.170812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.171166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.171493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.171815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d901cf38-6a85-4b7a-a634-4c7c513c1930 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:01:57.214595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3df7f26c-bf1c-4960-a589-edfee4579f60 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:57.245936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3df7f26c-bf1c-4960-a589-edfee4579f60 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:57.417141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3df7f26c-bf1c-4960-a589-edfee4579f60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:57.421427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3df7f26c-bf1c-4960-a589-edfee4579f60 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:57.422867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3df7f26c-bf1c-4960-a589-edfee4579f60 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/214fe1cc-fd9c-4182-be9f-c6c36b412d0f HTTP/1.1" status: 204 len: 168 time: 0.2655804 Dec 21 04:01:57.436954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df7f26c-bf1c-4960-a589-edfee4579f60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=214fe1cc-fd9c-4182-be9f-c6c36b412d0f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:01:57.587736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65319a8b-a0bc-488e-a2b4-4e4ebea5c36e req-d8fe8d72-2ffc-4ddc-8940-935e136d46d4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 210 time: 0.0329096 Dec 21 04:01:58.008299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a67d50fa-41a5-41f3-9e42-f5574ca20463 req-987fd3c8-78f7-4cdb-afec-451009926d28 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0607655 Dec 21 04:01:58.629205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05113533-df69-43ee-bc7e-fc3e9489ec7e req-54dd2840-58f3-4c83-9761-292e64ec9098 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.0427458 Dec 21 04:01:58.697577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb6969fd-803b-49cd-a04d-2e35484bb8b7 req-3654b6e3-0bf1-44a3-84e8-e9047b4ebd5e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3dfc5c3b7716407e99e5a34d4d89ac7b&device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.0487573 Dec 21 04:01:58.731614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86834de0-1b59-4d6f-b211-ce20f34ccfa7 req-430e9009-c8bf-4453-acbe-8719b19512b6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 210 time: 0.0328810 Dec 21 04:01:58.757148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb6969fd-803b-49cd-a04d-2e35484bb8b7 req-9be971c1-3d73-4730-b0ad-4797ee6edefb service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=3dfc5c3b7716407e99e5a34d4d89ac7b&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0323424 Dec 21 04:01:58.902584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6969fd-803b-49cd-a04d-2e35484bb8b7 req-b34781b8-c4ee-4331-a906-8664c952cda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:58.904632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb6969fd-803b-49cd-a04d-2e35484bb8b7 req-b34781b8-c4ee-4331-a906-8664c952cda0 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1388042 Dec 21 04:01:59.105014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-db389892-f45b-4520-8cea-69fd7d31cde1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:01:59.106514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-db389892-f45b-4520-8cea-69fd7d31cde1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.1429365 Dec 21 04:01:59.136940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f62675-3a1c-451a-8fcc-ffeb59a78927 req-5f417a99-5189-4146-a9d7-cb750bfa3e26 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0400732 Dec 21 04:01:59.141195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'port': {'device_id': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'admin_state_up': True, 'tenant_id': '2d46b810d87943059c90ba895934ed3b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:01:59.399598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:01:59.403257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:59.471000 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3058012e-0388-4698-bd91-3e64d0966e2f req-abd03ee9-76b6-4862-b5bc-103b8af4cfec service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0344822 Dec 21 04:01:59.562635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Allocated IP 172.20.0.11 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/cee69311-8acd-4064-a7b4-06c97526b389) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:01:59.724373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:59.774428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe1067d1-b4eb-45e0-98ab-59e93b8f0581 req-c96ba1d6-94ad-4f0a-bf54-fef2f8f14a35 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.0407178 Dec 21 04:01:59.866049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bb0a668-ea88-4c1b-abc4-1163f5f99cc4 req-566ac758-d30d-4799-9c81-f03d6d309f3b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 210 time: 0.0289969 Dec 21 04:01:59.892352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:01:59.934645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:01:59.942410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:01:59.945645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:01:59.949656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:00.006195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:00.006841 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:00.017011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=cee69311-8acd-4064-a7b4-06c97526b389,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:00.113250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-26b2ac9e-ca28-42f4-906f-bf1fda102ed7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9786062 Dec 21 04:02:00.134191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Request body: {'port': {'device_id': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:00.265129 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:00.345156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1698091-0dc5-497f-b247-6659be3a6b98 req-ef886ad0-ceb0-425c-82cc-5211236cca70 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0560291 Dec 21 04:02:00.365340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a9c96bb0-358f-42c6-a6a1-095f3de6cd95 None None] Provisioning complete for port cee69311-8acd-4064-a7b4-06c97526b389 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:00.367761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9c96bb0-358f-42c6-a6a1-095f3de6cd95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:00.449219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a9c96bb0-358f-42c6-a6a1-095f3de6cd95 None None] Port cee69311-8acd-4064-a7b4-06c97526b389 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:00.487020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb6969fd-803b-49cd-a04d-2e35484bb8b7 req-4769402b-586d-4e12-831a-f2ff6b6a1e47 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.31 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.0414939 Dec 21 04:02:00.697883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cee69311-8acd-4064-a7b4-06c97526b389 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:00.707848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:00.725358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Transition to ACTIVE for port object cee69311-8acd-4064-a7b4-06c97526b389 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:02:00.764612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:00.799804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:00.937526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Pushing event updated for resources: {'Port': ['ID=cee69311-8acd-4064-a7b4-06c97526b389,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:00.958222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.958634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.958958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.959304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.959644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.960069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.960351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.960594 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-905c8508-b764-4fa7-b216-d61605a3d5ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:00.960724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.961008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.961341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.961695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.962026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:00.962355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:01.137414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-905c8508-b764-4fa7-b216-d61605a3d5ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.150242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8b79376-e675-4a17-9e9c-35839e7436d1 req-d00d79f2-6eb1-4c80-ac8b-ea88721471e9 tempest-ServerShowV247Test-1140635229 tempest-ServerShowV247Test-1140635229-project] 10.222.0.18 "GET /v2.0/ports?device_id=010db628-a4e4-4455-b884-53784eeceb1e HTTP/1.1" status: 200 len: 210 time: 0.1426835 Dec 21 04:02:01.213552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-905c8508-b764-4fa7-b216-d61605a3d5ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.293180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ceb06d2-66d6-4bb0-bace-73e3850aed1f req-4e2c5343-86ff-4718-a497-f3e91dd5f11f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:01.309896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ceb06d2-66d6-4bb0-bace-73e3850aed1f req-4e2c5343-86ff-4718-a497-f3e91dd5f11f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 944 time: 0.2202494 Dec 21 04:02:01.320395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905c8508-b764-4fa7-b216-d61605a3d5ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7598a376-f71a-420e-9251-4bd8f9f550d6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:01.345459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41390) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:01.346534 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-905c8508-b764-4fa7-b216-d61605a3d5ff admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7ddd89936dd9481990ad50960c48dba7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5784853 Dec 21 04:02:01.409927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Attempting to bind port cee69311-8acd-4064-a7b4-06c97526b389 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:01.410338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Attempting to bind port cee69311-8acd-4064-a7b4-06c97526b389 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:01.410744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Attempting to bind port cee69311-8acd-4064-a7b4-06c97526b389 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:01.415673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ceb06d2-66d6-4bb0-bace-73e3850aed1f req-b1db3e8e-1367-47b2-8434-db46c2bda510 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041415 Dec 21 04:02:01.424828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Port cee69311-8acd-4064-a7b4-06c97526b389 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:02:01.425221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Attempting to bind port cee69311-8acd-4064-a7b4-06c97526b389 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:01.431313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:01.431802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:01.432266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:01.432767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Bound port: cee69311-8acd-4064-a7b4-06c97526b389, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:01.433192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.500918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c145404-9fba-43eb-b533-ebf2e949a180 req-06de71d5-ee02-43c9-aeb2-58775b695e42 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0511944 Dec 21 04:02:01.519660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-851b48f1-9ce0-4aab-a6c4-6552e217b7be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.555932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] For port cee69311-8acd-4064-a7b4-06c97526b389, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:01.564066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] For port cee69311-8acd-4064-a7b4-06c97526b389, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cee69311-8acd-4064-a7b4-06c97526b389,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:01.569746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-851b48f1-9ce0-4aab-a6c4-6552e217b7be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.655424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.707335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:01.707335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.707335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] 10.222.0.54 "PUT /v2.0/ports/cee69311-8acd-4064-a7b4-06c97526b389 HTTP/1.1" status: 200 len: 1093 time: 1.5682259 Dec 21 04:02:01.707335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'tag': 'cee69311-8acd-4064-a7b4-06c97526b389'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:01.707335 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b2a5080-f336-49db-9a01-6b75831eeb18" -d '{"events": [{"name": "network-changed", "server_uuid": "6b8ca15e-50cd-4c0c-8410-0dbe80abeb61", "tag": "cee69311-8acd-4064-a7b4-06c97526b389"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:01.740869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f33b384-65a7-4490-8c5f-8d3d98a0e08e service neutron] Pushing event updated for resources: {'Port': ['ID=cee69311-8acd-4064-a7b4-06c97526b389,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:01.754656 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-851b48f1-9ce0-4aab-a6c4-6552e217b7be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.758071 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-851b48f1-9ce0-4aab-a6c4-6552e217b7be admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:01.762678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-851b48f1-9ce0-4aab-a6c4-6552e217b7be admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7598a376-f71a-420e-9251-4bd8f9f550d6 HTTP/1.1" status: 204 len: 168 time: 0.4132650 Dec 21 04:02:01.775313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851b48f1-9ce0-4aab-a6c4-6552e217b7be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7598a376-f71a-420e-9251-4bd8f9f550d6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:01.799951 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73779857-0cd0-4062-9ce9-466dd653a7dd x-openstack-request-id: req-73779857-0cd0-4062-9ce9-466dd653a7dd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:01.800247 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b8ca15e-50cd-4c0c-8410-0dbe80abeb61", "tag": "cee69311-8acd-4064-a7b4-06c97526b389", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:01.800779 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-73779857-0cd0-4062-9ce9-466dd653a7dd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:01.801203 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'tag': 'cee69311-8acd-4064-a7b4-06c97526b389', 'status': 'completed', 'code': 200} Dec 21 04:02:01.912625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2a5080-f336-49db-9a01-6b75831eeb18 req-8802b639-c36a-43a9-947c-f42ec7026ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:01.914314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b2a5080-f336-49db-9a01-6b75831eeb18 req-8802b639-c36a-43a9-947c-f42ec7026ca4 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 1096 time: 0.0662467 Dec 21 04:02:02.083710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2a5080-f336-49db-9a01-6b75831eeb18 req-87dd5a83-b1ff-4ad2-b5a2-6811052d22a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:02.085209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b2a5080-f336-49db-9a01-6b75831eeb18 req-87dd5a83-b1ff-4ad2-b5a2-6811052d22a8 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2d46b810d87943059c90ba895934ed3b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1561923 Dec 21 04:02:02.233223 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f2923e46-93ca-42ee-ae57-0d84bb34c1fc req-7f4a89a3-f18d-4931-b00b-f069b574a13d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9fa60f0632f04cffbb3ed408e54ba444&device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0620430 Dec 21 04:02:02.236129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd89c90a-a35d-4c4f-8dbe-93ccaa7889e3 req-bbacd842-a3dc-477e-b306-935df6367c2a tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0290771 Dec 21 04:02:02.299384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2a5080-f336-49db-9a01-6b75831eeb18 req-477184b0-8b9c-45ec-8410-4085734482c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:02.302143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b2a5080-f336-49db-9a01-6b75831eeb18 req-477184b0-8b9c-45ec-8410-4085734482c0 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2090416 Dec 21 04:02:02.312937 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f2923e46-93ca-42ee-ae57-0d84bb34c1fc req-3e290643-88eb-444d-992e-28669c22bf0f service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=9fa60f0632f04cffbb3ed408e54ba444&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0631402 Dec 21 04:02:02.424651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-e75b4075-bfe0-4786-88cf-4bba56b5c067 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:02.426065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-e75b4075-bfe0-4786-88cf-4bba56b5c067 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 1096 time: 0.0531321 Dec 21 04:02:02.438986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2923e46-93ca-42ee-ae57-0d84bb34c1fc req-f433d28a-4b7e-4fe1-b47f-df2d41b50be0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:02.440493 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f2923e46-93ca-42ee-ae57-0d84bb34c1fc req-f433d28a-4b7e-4fe1-b47f-df2d41b50be0 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1202824 Dec 21 04:02:02.485015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-6df7de08-1e8f-420b-9732-b625e092ae56 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=cee69311-8acd-4064-a7b4-06c97526b389 HTTP/1.1" status: 200 len: 217 time: 0.0448909 Dec 21 04:02:02.572238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-894b2fa6-2a56-465f-b422-ee0fdf23c1a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:02.573741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-894b2fa6-2a56-465f-b422-ee0fdf23c1a6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0738454 Dec 21 04:02:02.676357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4872a3f-c53c-483e-926b-c1a035b1353d req-3b769276-99bc-44d5-bcf4-511e96fb5588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:02.683897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4872a3f-c53c-483e-926b-c1a035b1353d req-3b769276-99bc-44d5-bcf4-511e96fb5588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 944 time: 0.1408403 Dec 21 04:02:02.698868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41420) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:02.720809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-56033cd0-d7e2-434d-bf88-d99458736111 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:02.869381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-56033cd0-d7e2-434d-bf88-d99458736111 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:02.969211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41424) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:02.978536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-56033cd0-d7e2-434d-bf88-d99458736111 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.065433 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-56033cd0-d7e2-434d-bf88-d99458736111 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2baa5c164f484fc291f40a7aec1e29ad&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3654110 Dec 21 04:02:03.066785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:03.079182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56033cd0-d7e2-434d-bf88-d99458736111 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aaafa7ea-7677-4cda-88b7-416666a4759d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:03.081151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4872a3f-c53c-483e-926b-c1a035b1353d req-c10be732-2402-4710-9b78-b9db99c24468 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3914423 Dec 21 04:02:03.098004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e127b344-076e-4755-8da1-608fade2a00d req-806d56af-4669-402d-b9c5-085e51e9d2e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:03.101002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-806d56af-4669-402d-b9c5-085e51e9d2e5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.5182731 Dec 21 04:02:03.180708 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00ed9daa-2e53-4400-93d6-a4045955b238 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.185523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb38d73-22ff-4114-9538-2a55e2a8ec41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.224911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-b4ead0bd-be75-4c1a-aa91-26c0da03c2e6 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1143987 Dec 21 04:02:03.228619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb38d73-22ff-4114-9538-2a55e2a8ec41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.339897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e127b344-076e-4755-8da1-608fade2a00d req-d19ade87-1718-4b31-8472-e9a366568bac service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1078088 Dec 21 04:02:03.376225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00ed9daa-2e53-4400-93d6-a4045955b238 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.408954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93a076d3-866b-4f34-b36c-da4427e40a04 req-d255908a-1551-4d45-a7ab-2b251075aa5a tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0359774 Dec 21 04:02:03.429608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb38d73-22ff-4114-9538-2a55e2a8ec41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.433075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb38d73-22ff-4114-9538-2a55e2a8ec41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.439213 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5cb38d73-22ff-4114-9538-2a55e2a8ec41 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/aaafa7ea-7677-4cda-88b7-416666a4759d HTTP/1.1" status: 204 len: 168 time: 0.3658834 Dec 21 04:02:03.470122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cb38d73-22ff-4114-9538-2a55e2a8ec41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aaafa7ea-7677-4cda-88b7-416666a4759d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:03.471587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00ed9daa-2e53-4400-93d6-a4045955b238 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.551804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ed9daa-2e53-4400-93d6-a4045955b238 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de38ebd6-a8fb-4cf3-924a-90e0199dbca1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:03.603029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-00ed9daa-2e53-4400-93d6-a4045955b238 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3dfc5c3b7716407e99e5a34d4d89ac7b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6318903 Dec 21 04:02:03.605718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41446) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:03.677395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61ac1c5d-9f5d-44f0-9ca0-1c94622d5fea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.706551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61ac1c5d-9f5d-44f0-9ca0-1c94622d5fea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.816540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61ac1c5d-9f5d-44f0-9ca0-1c94622d5fea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.819691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61ac1c5d-9f5d-44f0-9ca0-1c94622d5fea admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:03.821566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-61ac1c5d-9f5d-44f0-9ca0-1c94622d5fea admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/de38ebd6-a8fb-4cf3-924a-90e0199dbca1 HTTP/1.1" status: 204 len: 168 time: 0.2145586 Dec 21 04:02:03.894114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2923e46-93ca-42ee-ae57-0d84bb34c1fc req-09a14e29-8bf6-41ac-a94b-2da133dffd50 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.54 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0711668 Dec 21 04:02:03.917025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ac1c5d-9f5d-44f0-9ca0-1c94622d5fea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de38ebd6-a8fb-4cf3-924a-90e0199dbca1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:04.280639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85e7bc7-c80d-4700-a941-ebd4e358032b req-5a1ee697-6f15-44bf-9ad8-f5c7c64eedfd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:04.282555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d85e7bc7-c80d-4700-a941-ebd4e358032b req-5a1ee697-6f15-44bf-9ad8-f5c7c64eedfd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 944 time: 0.0581007 Dec 21 04:02:04.344420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d85e7bc7-c80d-4700-a941-ebd4e358032b req-04300740-b662-4f22-8c9b-12b60fc9f59c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546150 Dec 21 04:02:04.569673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-536e1f16-2c03-41ab-8d32-f6eda3f1ba70 req-ada5413c-a982-4345-a2fc-9a816384c536 tempest-ServerShowV257Test-1518521011 tempest-ServerShowV257Test-1518521011-project] 10.222.0.18 "GET /v2.0/ports?device_id=cb4326c5-9edd-4eca-814b-46c85d8673e8 HTTP/1.1" status: 200 len: 210 time: 0.0366073 Dec 21 04:02:05.434517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41524) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:05.485765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e7e094-a1e9-46fb-9c60-7b98a7699f09 req-c7d18dad-bdab-4c32-a6e6-0e6c92f51d9f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:05.487400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44e7e094-a1e9-46fb-9c60-7b98a7699f09 req-c7d18dad-bdab-4c32-a6e6-0e6c92f51d9f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 944 time: 0.0629938 Dec 21 04:02:05.552338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44e7e094-a1e9-46fb-9c60-7b98a7699f09 req-86afee4f-d91a-4815-9826-fb221797cd81 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540559 Dec 21 04:02:05.554910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-1588163153-network', 'tenant_id': '9be1447e894c4d89ae0d884935aafca9'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:05.707455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Made reservation on behalf of 9be1447e894c4d89ae0d884935aafca9 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:05.707455 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:05.721330 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:05.829540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:05.919168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:05.960653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:02:05.977936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52097dff-d468-4a2b-8853-72ce92660ada,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:05.988190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:05.989008 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Added segment 16c2409c-2ec9-4dc7-ad77-ede3d74ad33d of type vlan for network 1d34dd2a-275c-4073-aad9-16b29c6ef929 Dec 21 04:02:06.045880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.144600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cee69311-8acd-4064-a7b4-06c97526b389 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:02:06.182671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.183716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:06.184517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.252264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] Pushing event updated for resources: {'Network': ['ID=1d34dd2a-275c-4073-aad9-16b29c6ef929,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:06.270026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1d34dd2a-275c-4073-aad9-16b29c6ef929 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:02:06.274750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41566) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:06.338846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cee69311-8acd-4064-a7b4-06c97526b389, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cee69311-8acd-4064-a7b4-06c97526b389,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:06.340484 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2537433d-557e-44d9-8b8c-6ab378dfab6c admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.9029853 Dec 21 04:02:06.343176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41572) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:06.349060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Request body: {'subnet': {'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-1588163153-subnet', 'tenant_id': '9be1447e894c4d89ae0d884935aafca9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:06.362399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'cee69311-8acd-4064-a7b4-06c97526b389', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': 'cee69311-8acd-4064-a7b4-06c97526b389', 'mac_address': 'fa:16:3e:fe:51:38', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:02:06.410751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.430762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cee69311-8acd-4064-a7b4-06c97526b389 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:06.452274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cee69311-8acd-4064-a7b4-06c97526b389, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cee69311-8acd-4064-a7b4-06c97526b389,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:06.488012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-785ad8d2-23b2-4658-bfbc-35a9ac69eeda admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.520628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.608478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-785ad8d2-23b2-4658-bfbc-35a9ac69eeda admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.610807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Made reservation on behalf of 9be1447e894c4d89ae0d884935aafca9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:06.614210 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.617012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cee69311-8acd-4064-a7b4-06c97526b389,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:06.675377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-785ad8d2-23b2-4658-bfbc-35a9ac69eeda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.799269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-785ad8d2-23b2-4658-bfbc-35a9ac69eeda admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9fa60f0632f04cffbb3ed408e54ba444&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5233519 Dec 21 04:02:06.802485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:06.803028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-785ad8d2-23b2-4658-bfbc-35a9ac69eeda admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=446cdfeb-c00b-438f-ad84-bcf51d25c25c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:06.853983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cee69311-8acd-4064-a7b4-06c97526b389'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:02:06.865785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edde3522-f62f-4f22-b6a8-575dfba8960f req-a92aecb3-3e1a-456f-bd8d-18d595dafb2c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:06.868041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edde3522-f62f-4f22-b6a8-575dfba8960f req-a92aecb3-3e1a-456f-bd8d-18d595dafb2c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 945 time: 0.1417582 Dec 21 04:02:06.891261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5d26517-1b43-4a0b-a1ef-b183f7f482d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:06.929131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5d26517-1b43-4a0b-a1ef-b183f7f482d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:07.003438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edde3522-f62f-4f22-b6a8-575dfba8960f req-c834e41b-656f-4f3b-a83a-d494d8ca1a8a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546904 Dec 21 04:02:07.022562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:07.100621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:07.102635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5d26517-1b43-4a0b-a1ef-b183f7f482d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:07.105651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d5d26517-1b43-4a0b-a1ef-b183f7f482d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:07.106815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d5d26517-1b43-4a0b-a1ef-b183f7f482d5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/446cdfeb-c00b-438f-ad84-bcf51d25c25c HTTP/1.1" status: 204 len: 168 time: 0.3023839 Dec 21 04:02:07.138412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d26517-1b43-4a0b-a1ef-b183f7f482d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=446cdfeb-c00b-438f-ad84-bcf51d25c25c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:07.149842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Checking segment: {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:07.150376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Network hostable DHCP agents. Network: 1d34dd2a-275c-4073-aad9-16b29c6ef929, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:02:07.244071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Network 1d34dd2a-275c-4073-aad9-16b29c6ef929 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:02:07.307519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1d34dd2a-275c-4073-aad9-16b29c6ef929) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:07.313352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:07.314553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:07.321389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1a72c37-1d7a-4a1f-87c5-b37bc8cecf31 None None] Network 1d34dd2a-275c-4073-aad9-16b29c6ef929 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:02:07.425269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-975e6a5a-5080-48e8-a228-2167095a23c0 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.0807290 Dec 21 04:02:07.445224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62bf21df-c89f-449d-aab3-f3ed367d82b0 None None] Network 1d34dd2a-275c-4073-aad9-16b29c6ef929 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:02:08.068969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4a2f8e6a-0b1d-4934-b1da-b3602691ff66 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:08.071451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4a2f8e6a-0b1d-4934-b1da-b3602691ff66 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 814 time: 0.1409569 Dec 21 04:02:08.088452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-fb459ac8-f06b-4c85-bae3-5019dab41f35 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/quotas/9be1447e894c4d89ae0d884935aafca9 HTTP/1.1" status: 200 len: 375 time: 0.0103691 Dec 21 04:02:08.143131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-3effeec6-3d02-4373-af3e-d2c3b3bae432 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0436096 Dec 21 04:02:08.168172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cee69311-8acd-4064-a7b4-06c97526b389 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:08.315557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f320c08f-c6ef-4401-9080-9eb3a40da57a req-39b46457-49d2-4cdf-8fc5-c9fe871fa90c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:08.319413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f320c08f-c6ef-4401-9080-9eb3a40da57a req-39b46457-49d2-4cdf-8fc5-c9fe871fa90c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 945 time: 0.1798606 Dec 21 04:02:08.370260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port cee69311-8acd-4064-a7b4-06c97526b389 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:02:08.384772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port cee69311-8acd-4064-a7b4-06c97526b389 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:08.385150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:08.414393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-8c105a63-7eb7-4710-a311-f0cde49de0ef service neutron] 10.222.0.18 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2569287 Dec 21 04:02:08.506748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:08.512840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f320c08f-c6ef-4401-9080-9eb3a40da57a req-9b68476f-7433-479f-a005-322e186d9fdb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1799293 Dec 21 04:02:08.534160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cee69311-8acd-4064-a7b4-06c97526b389'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:08.537004 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f05e6e0-1e97-454d-a9e8-ec42e6034597" -d '{"events": [{"server_uuid": "6b8ca15e-50cd-4c0c-8410-0dbe80abeb61", "name": "network-vif-plugged", "status": "completed", "tag": "cee69311-8acd-4064-a7b4-06c97526b389"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:08.551764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cee69311-8acd-4064-a7b4-06c97526b389, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cee69311-8acd-4064-a7b4-06c97526b389,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:08.616929 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fbf8a1c-e118-4662-a235-5f2190733dce x-openstack-request-id: req-1fbf8a1c-e118-4662-a235-5f2190733dce {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:08.617424 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b8ca15e-50cd-4c0c-8410-0dbe80abeb61", "name": "network-vif-plugged", "status": "completed", "tag": "cee69311-8acd-4064-a7b4-06c97526b389", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:08.617775 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1fbf8a1c-e118-4662-a235-5f2190733dce {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:08.618475 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cee69311-8acd-4064-a7b4-06c97526b389', 'code': 200} Dec 21 04:02:08.619785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:08.660276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-76093136-7579-40fe-aedf-94ba691fb47e service neutron] 10.222.0.18 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2462518 Dec 21 04:02:08.704241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41664) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:08.726972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cee69311-8acd-4064-a7b4-06c97526b389,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:08.891118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06049a6f-ad10-4570-92ca-e84f3f631eba req-ee09cc4b-d474-49c4-b11d-8f1ebe650144 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:08.897427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06049a6f-ad10-4570-92ca-e84f3f631eba req-ee09cc4b-d474-49c4-b11d-8f1ebe650144 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 1098 time: 0.1407406 Dec 21 04:02:08.936518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1775238349-network', 'tenant_id': '3f578ba291d54826a6db2accb249f808'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:08.978169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06049a6f-ad10-4570-92ca-e84f3f631eba req-19a7121a-3fc8-45de-9267-e2d78c35cd9d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717952 Dec 21 04:02:09.079691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Made reservation on behalf of 3f578ba291d54826a6db2accb249f808 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:09.083885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.097285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.283012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.349381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3a00d3a-90d2-42aa-a547-b54ad55dc57d req-65936a05-3f77-403d-9494-313f9939d145 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.1573484 Dec 21 04:02:09.354294 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.397666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:02:09.412106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a36f8400-b925-4328-a7ef-88ff5cb8343a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:09.417202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.417476 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Added segment 6f1cb001-1e6d-4abe-b607-9270a6c39719 of type vlan for network e94ae2ca-4e3f-4500-90fd-ec494b399bda Dec 21 04:02:09.460445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.553775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.554784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:09.555416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.657306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] Pushing event updated for resources: {'Network': ['ID=e94ae2ca-4e3f-4500-90fd-ec494b399bda,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:09.668523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:02:09.669560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ede05ff-ec7f-403e-9283-c7bc452dd8f0 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.9639933 Dec 21 04:02:09.672281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41696) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:09.677282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Request body: {'subnet': {'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1775238349-subnet', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:09.711811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11714fa-ea96-4a5f-8a16-89d3f81cf2bc req-b138b034-9977-4730-b545-265dc011c9cf tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:09.723568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a11714fa-ea96-4a5f-8a16-89d3f81cf2bc req-b138b034-9977-4730-b545-265dc011c9cf tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 946 time: 0.1376977 Dec 21 04:02:09.776674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Made reservation on behalf of 3f578ba291d54826a6db2accb249f808 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:09.779159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:09.803430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a11714fa-ea96-4a5f-8a16-89d3f81cf2bc req-75eeed18-be4a-4a6e-adf4-9d523d9eb980 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788662 Dec 21 04:02:10.057596 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:10.112154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Pushing event updated for resources: {'Subnet': ['ID=a102645d-c1b2-4824-aff9-56e0558bab2d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:10.159384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Checking segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:10.159848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Network hostable DHCP agents. Network: e94ae2ca-4e3f-4500-90fd-ec494b399bda, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:02:10.260169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:02:10.336616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e94ae2ca-4e3f-4500-90fd-ec494b399bda) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:10.343641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:10.344591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:10.348156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7e54198-ed6b-4eea-80b0-3c02a3bf30dd None None] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:02:10.454362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f31dacb4-3685-4ae9-accb-db55f0d23bde admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7758305 Dec 21 04:02:10.454741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41710) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:10.457635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:10.535800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08cf1d03-db82-4b93-b7e0-6f7e24a613c7 req-f1c25593-a5c3-4463-821c-fd784a2e06cb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.0700278 Dec 21 04:02:10.547184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:02:10.547184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:10.596940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:10.598178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:10.720651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:10.765796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Allocated IP 172.20.0.2 (e94ae2ca-4e3f-4500-90fd-ec494b399bda/a102645d-c1b2-4824-aff9-56e0558bab2d/1182479a-6580-4470-ac4c-ca6e5ae9b565) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:11.120980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378198ce-c8a1-4618-8b3c-67ba3225eccb req-9da75900-1137-4e3a-a73e-b6bcd306b97b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:11.123190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-378198ce-c8a1-4618-8b3c-67ba3225eccb req-9da75900-1137-4e3a-a73e-b6bcd306b97b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 946 time: 0.1494446 Dec 21 04:02:11.132985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.183067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.212886 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.226053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-378198ce-c8a1-4618-8b3c-67ba3225eccb req-9613c55c-c73a-4911-af80-53ae2f60b19b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920653 Dec 21 04:02:11.323865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Pushing event updated for resources: {'Port': ['ID=1182479a-6580-4470-ac4c-ca6e5ae9b565,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:11.355661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:11.360592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:11.364250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:11.440287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Attempting to bind port 1182479a-6580-4470-ac4c-ca6e5ae9b565 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:11.440730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Attempting to bind port 1182479a-6580-4470-ac4c-ca6e5ae9b565 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:11.441109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Attempting to bind port 1182479a-6580-4470-ac4c-ca6e5ae9b565 on network e94ae2ca-4e3f-4500-90fd-ec494b399bda {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:11.450320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:11.451591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Checking segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:11.452023 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.452438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Bound using segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:11.452950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Bound port: 1182479a-6580-4470-ac4c-ca6e5ae9b565, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:11.453346 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.553233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] For port 1182479a-6580-4470-ac4c-ca6e5ae9b565, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:11.553394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41744) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:11.557792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] For port 1182479a-6580-4470-ac4c-ca6e5ae9b565, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1182479a-6580-4470-ac4c-ca6e5ae9b565,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:11.648884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.675373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.676826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bab0a232-0270-4484-964e-343ced51b323 req-25243b13-d307-4273-bbd7-94bed0b2d539 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.0572631 Dec 21 04:02:11.772066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a347aa40-52e1-4320-9cc5-ef0a0dd768da admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.860430 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.879636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a347aa40-52e1-4320-9cc5-ef0a0dd768da admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.894497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Allocated IP 172.25.5.144 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/299ed012-5300-4afc-af12-c5766a47a8eb) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:11.942632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a347aa40-52e1-4320-9cc5-ef0a0dd768da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:11.965545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41e79cd-23df-4d63-a891-789a4bb76f3f None None] Pushing event updated for resources: {'Port': ['ID=1182479a-6580-4470-ac4c-ca6e5ae9b565,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:11.983397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a347aa40-52e1-4320-9cc5-ef0a0dd768da admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=38c3226040044b8baafabf75b8786f1e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4288776 Dec 21 04:02:11.989142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:12.047174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a347aa40-52e1-4320-9cc5-ef0a0dd768da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf157896-cdd3-4f1a-8e03-d5c54614860e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:12.097367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.202239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed005e5d-b929-44e5-b126-8e564f12b753 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.261713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.263682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed005e5d-b929-44e5-b126-8e564f12b753 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.287293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-7a3591e7-68d7-48d5-a509-e3c0830c941a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:12.288861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-7a3591e7-68d7-48d5-a509-e3c0830c941a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.31 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 814 time: 0.2319806 Dec 21 04:02:12.344540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Request body: {'port': {'device_id': '082b4e20-36d4-4f1d-bab1-732629652f89', 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'admin_state_up': True, 'tenant_id': '9be1447e894c4d89ae0d884935aafca9'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:12.378696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:12.390046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:12.394145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:12.414773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Pushing event updated for resources: {'Port': ['ID=299ed012-5300-4afc-af12-c5766a47a8eb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:12.422252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cb3a00d-c646-49d6-93ec-cd10d197aba4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:02:12.468522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41760) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:12.513432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f9072a74-17f4-42bc-852c-c26c483f9f6f None None] Provisioning complete for port 299ed012-5300-4afc-af12-c5766a47a8eb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:12.515695 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f9072a74-17f4-42bc-852c-c26c483f9f6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.596467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f9072a74-17f4-42bc-852c-c26c483f9f6f None None] Port 299ed012-5300-4afc-af12-c5766a47a8eb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:12.649223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Deleting subnet ccaea876-d935-4c88-9da6-3335d0dadf82 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:02:12.651534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.700737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.750496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.814551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed005e5d-b929-44e5-b126-8e564f12b753 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.817947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed005e5d-b929-44e5-b126-8e564f12b753 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.822716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ed005e5d-b929-44e5-b126-8e564f12b753 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bf157896-cdd3-4f1a-8e03-d5c54614860e HTTP/1.1" status: 204 len: 168 time: 0.8322179 Dec 21 04:02:12.836999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed005e5d-b929-44e5-b126-8e564f12b753 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf157896-cdd3-4f1a-8e03-d5c54614860e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:12.885077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cb2e9da-2ba9-41db-9ec3-91a4e56cc8ef req-1f62609c-a932-4e6c-a87b-1d2c28e240ba tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.0361679 Dec 21 04:02:12.890010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1182479a-6580-4470-ac4c-ca6e5ae9b565 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:12.931480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.965288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ccaea876-d935-4c88-9da6-3335d0dadf82,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:12.992150 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:12.998164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d73be7a2-c292-4d3e-a7b9-e880ac68a848 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/ccaea876-d935-4c88-9da6-3335d0dadf82 HTTP/1.1" status: 204 len: 168 time: 0.5073080 Dec 21 04:02:12.999309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41770) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:13.015372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f6af793-9a32-435d-bea3-75fe6372192c None None] Network 0294b34c-30ec-4139-9cf8-4180cbf6aee4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:02:13.096187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Made reservation on behalf of 9be1447e894c4d89ae0d884935aafca9 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:13.100343 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.119300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.162366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.166789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1182479a-6580-4470-ac4c-ca6e5ae9b565 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:13.168137 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.229112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07e93cfb-d52d-453a-bc81-127423d3fd50 None None] DHCP port deletion for 0294b34c-30ec-4139-9cf8-4180cbf6aee4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:02:13.357651 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.418549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Allocated IP 172.20.0.3 (1d34dd2a-275c-4073-aad9-16b29c6ef929/af597cc9-d6ea-4007-b8f3-5cbc38b23a3a/22270d5e-6f54-41c2-a9eb-fd2c24aef262) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:13.442806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 1182479a-6580-4470-ac4c-ca6e5ae9b565, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1182479a-6580-4470-ac4c-ca6e5ae9b565,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:13.531323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.642403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=1182479a-6580-4470-ac4c-ca6e5ae9b565,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:13.703713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d2015ad-35ee-40b0-ac3b-d0cadf31f606 None None] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:02:13.772568 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:02:13.800013 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:13.901602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41780) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:13.927694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3c87c2fd-5063-4fa6-ae05-1d44fc922b14 None None] Provisioning complete for port 1182479a-6580-4470-ac4c-ca6e5ae9b565 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:13.928335 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c87c2fd-5063-4fa6-ae05-1d44fc922b14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.000973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.049816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8799172-ab82-47d5-955d-7b91d43e950a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.096072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0294b34c-30ec-4139-9cf8-4180cbf6aee4']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:14.165662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53fab441-d7a5-4fea-82c5-fc4e0288c1e8 req-f5e39f7c-e3de-495d-8102-afdb33d7fb69 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.1007497 Dec 21 04:02:14.178486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8250d715-d626-4ee8-89bc-d342f729f8bf') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:14.179123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8250d715-d626-4ee8-89bc-d342f729f8bf') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:14.197224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.208353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.262625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.284395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:14.301772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Network 1d34dd2a-275c-4073-aad9-16b29c6ef929 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:14.306843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.311328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:14.320318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:14.327491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:02:14.327902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:02:14.331224 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:02:14.334596 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:02:14.411718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f8fb7f41-e00f-4729-ba71-21531de40b53 None None] Provisioning complete for port 1182479a-6580-4470-ac4c-ca6e5ae9b565 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:14.412115 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8fb7f41-e00f-4729-ba71-21531de40b53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.459903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:14.460483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.481449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.493141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.496364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] 10.222.0.18 "DELETE /v2.0/networks/0294b34c-30ec-4139-9cf8-4180cbf6aee4 HTTP/1.1" status: 204 len: 168 time: 1.4950507 Dec 21 04:02:14.499397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41790) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:14.513534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda6d320-b2fd-409d-a82b-3ffe642f9b27 admin admin] Pushing event deleted for resources: {'Network': ['ID=0294b34c-30ec-4139-9cf8-4180cbf6aee4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:14.526894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8799172-ab82-47d5-955d-7b91d43e950a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.537297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:02:14.563262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-1b13f867-c431-4457-85ee-51a86a930156 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2346051 Dec 21 04:02:14.591694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Request body: {'port': {'device_id': '082b4e20-36d4-4f1d-bab1-732629652f89', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:14.596349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8799172-ab82-47d5-955d-7b91d43e950a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.597276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Deleting subnet e5cc317c-4419-4f49-bc7a-1beb6a5bf222 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:02:14.605609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.669820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8799172-ab82-47d5-955d-7b91d43e950a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f06e2a3ce5414ade9569668b19a8fac6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7237186 Dec 21 04:02:14.675020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41792) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:14.684934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8799172-ab82-47d5-955d-7b91d43e950a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fd04f2e-2944-4f4a-9b54-c03285a4af4f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:14.686373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.696582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.757336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1182479a-6580-4470-ac4c-ca6e5ae9b565 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:14.761358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:02:14.774296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:02:14.776800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.788213 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:02:14.788838 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:14.822241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1182479a-6580-4470-ac4c-ca6e5ae9b565 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:14.823218 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.823990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0984a14-7298-4848-9bc0-4151f1288349 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.855383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0984a14-7298-4848-9bc0-4151f1288349 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.879189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.880444 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0c874dd-35c6-473e-8984-175ac78a4243 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.4274092 Dec 21 04:02:14.884972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:14.932764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.958226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8ef3d33-653a-46d7-b8bc-b36dd4b671f7 None None] Network b9053c12-d631-4f2d-a48d-3fd6262009b4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:02:14.988322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e5cc317c-4419-4f49-bc7a-1beb6a5bf222,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:14.992503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:14.999804 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6403a879-165b-4130-896d-1dfbfc8f478e admin admin] 10.222.0.18 "DELETE /v2.0/subnets/e5cc317c-4419-4f49-bc7a-1beb6a5bf222 HTTP/1.1" status: 204 len: 168 time: 0.4982047 Dec 21 04:02:15.000842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0984a14-7298-4848-9bc0-4151f1288349 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.004912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0984a14-7298-4848-9bc0-4151f1288349 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.006387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a0984a14-7298-4848-9bc0-4151f1288349 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4fd04f2e-2944-4f4a-9b54-c03285a4af4f HTTP/1.1" status: 204 len: 168 time: 0.3303089 Dec 21 04:02:15.007390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41798) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:15.023101 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:02:15.136341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-985e82b9-e37c-4acc-beac-f394496f4411 None None] DHCP port deletion for b9053c12-d631-4f2d-a48d-3fd6262009b4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:02:15.171741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.182663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0984a14-7298-4848-9bc0-4151f1288349 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fd04f2e-2944-4f4a-9b54-c03285a4af4f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:15.326015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.340743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 22270d5e-6f54-41c2-a9eb-fd2c24aef262 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:15.341555 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:12Z', 'revision_number': 3, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:15.351937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b9053c12-d631-4f2d-a48d-3fd6262009b4']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:15.367848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f48ee540-0b83-4687-be9d-9424db3d1a5f') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:15.369783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f48ee540-0b83-4687-be9d-9424db3d1a5f') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:15.380030 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:02:15.380373 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Updating router 7d365f1f-98f8-4e87-86ca-895a2b2163fc port 299ed012-5300-4afc-af12-c5766a47a8eb binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:02:15.381269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.396221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.404835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.405021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:02:15.405021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:02:15.405560 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:02:15.418409 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.466288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b74e9d-2d54-45fc-a59e-b0c93aaff982 req-ca03e4d0-5db1-4706-bdeb-50fff3683e63 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:15.467929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01b74e9d-2d54-45fc-a59e-b0c93aaff982 req-ca03e4d0-5db1-4706-bdeb-50fff3683e63 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 931 time: 0.1818092 Dec 21 04:02:15.567504 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.582503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.590738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Transition to ACTIVE for port object 22270d5e-6f54-41c2-a9eb-fd2c24aef262 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:02:15.601518 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] 10.222.0.18 "DELETE /v2.0/networks/b9053c12-d631-4f2d-a48d-3fd6262009b4 HTTP/1.1" status: 204 len: 168 time: 0.5895884 Dec 21 04:02:15.632471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01b74e9d-2d54-45fc-a59e-b0c93aaff982 req-67b88554-39d7-414f-b9cb-7a66c9b247b9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1501412 Dec 21 04:02:15.652961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7dea372-6f79-4c3a-8d4c-0ef41e01e3df admin admin] Pushing event deleted for resources: {'Network': ['ID=b9053c12-d631-4f2d-a48d-3fd6262009b4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:15.680290 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.752729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.801542 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.808368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:15.891005 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:15.937088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06840d9e-6de7-4b1e-b5a6-2071bc49b489 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:02:16.000147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41822) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:16.003352 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Attempting to bind port 299ed012-5300-4afc-af12-c5766a47a8eb on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:16.003805 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Attempting to bind port 299ed012-5300-4afc-af12-c5766a47a8eb by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:16.004178 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Attempting to bind port 299ed012-5300-4afc-af12-c5766a47a8eb on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:16.011703 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:16.012993 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:16.013762 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.014307 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:16.015448 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Bound port: 299ed012-5300-4afc-af12-c5766a47a8eb, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:16.016064 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.071032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7ff6dec5-0353-41dd-b7fb-4e405f76d41e None None] Provisioning complete for port 299ed012-5300-4afc-af12-c5766a47a8eb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:16.072145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ff6dec5-0353-41dd-b7fb-4e405f76d41e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.074523 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] For port 299ed012-5300-4afc-af12-c5766a47a8eb, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:16.078581 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] For port 299ed012-5300-4afc-af12-c5766a47a8eb, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=299ed012-5300-4afc-af12-c5766a47a8eb,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:16.085349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e2a802b4-1403-424c-a013-6a974d33d1e0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=890fa4dd6439485583f4cba0fdc68fad&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0837488 Dec 21 04:02:16.087890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:16.103798 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Pushing event updated for resources: {'Port': ['ID=299ed012-5300-4afc-af12-c5766a47a8eb,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:16.120594 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.120952 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.121300 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.121642 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.121981 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.122341 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.122668 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.123041 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.123564 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.127423 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.128063 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.128620 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.129289 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:16.166251 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.177872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7ff6dec5-0353-41dd-b7fb-4e405f76d41e None None] Port 299ed012-5300-4afc-af12-c5766a47a8eb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:16.187008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bec923d7-392e-4898-8580-ba0722ec26d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.221903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bec923d7-392e-4898-8580-ba0722ec26d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.247031 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac84150-f4ea-49a9-af59-55016601469f None None] Pushing event updated for resources: {'Port': ['ID=299ed012-5300-4afc-af12-c5766a47a8eb,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:16.271288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6ab2e02-bab5-4c25-9f99-ff9fad9643d0 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:02:16.295159 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:02:16.295159 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:16.335615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e118192d-0692-488c-8523-8861b08101e0 None None] Provisioning complete for port 299ed012-5300-4afc-af12-c5766a47a8eb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:16.335996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e118192d-0692-488c-8523-8861b08101e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.381523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bec923d7-392e-4898-8580-ba0722ec26d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.384556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bec923d7-392e-4898-8580-ba0722ec26d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.386360 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bec923d7-392e-4898-8580-ba0722ec26d4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0902178c-4996-4a9f-bda7-965644083eb2 HTTP/1.1" status: 204 len: 168 time: 0.2966638 Dec 21 04:02:16.402508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec923d7-392e-4898-8580-ba0722ec26d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0902178c-4996-4a9f-bda7-965644083eb2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:16.498352 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e118192d-0692-488c-8523-8861b08101e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.513493 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:02:16.530521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e118192d-0692-488c-8523-8861b08101e0 None None] For port 299ed012-5300-4afc-af12-c5766a47a8eb, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=299ed012-5300-4afc-af12-c5766a47a8eb,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:16.622150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Attempting to bind port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:16.622150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Attempting to bind port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:16.622150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Attempting to bind port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 on network 1d34dd2a-275c-4073-aad9-16b29c6ef929 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:16.640259 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e118192d-0692-488c-8523-8861b08101e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.735455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e118192d-0692-488c-8523-8861b08101e0 None None] Pushing event updated for resources: {'Port': ['ID=299ed012-5300-4afc-af12-c5766a47a8eb,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:16.776993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Allocated IP 172.20.0.1 (e94ae2ca-4e3f-4500-90fd-ec494b399bda/a102645d-c1b2-4824-aff9-56e0558bab2d/ffe8e39b-678a-4e86-878d-6207b5a5bcfd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:16.857156 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:12Z', 'revision_number': 3, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:16.887263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.915101 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-964bb72b-dcd9-4575-adf4-d8c171f57448 None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:12Z', 'revision_number': 3, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:02:16.925294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 on network 1d34dd2a-275c-4073-aad9-16b29c6ef929 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:02:16.925629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Attempting to bind port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 on network 1d34dd2a-275c-4073-aad9-16b29c6ef929 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:16.976502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:16.977882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Checking segment: {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:16.977882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Bound using segment: {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:16.977882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Bound port: 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:16.978322 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:16.987205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.075304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547276e3-44bf-45b9-8e0d-69a32a4f1084 req-05236683-72e8-4544-9b8c-a85d2bb60448 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:17.076871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-547276e3-44bf-45b9-8e0d-69a32a4f1084 req-05236683-72e8-4544-9b8c-a85d2bb60448 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1534846 Dec 21 04:02:17.081956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:17.090292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:17.096833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:17.115556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Pushing event updated for resources: {'Port': ['ID=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:17.200880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:17.209428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-547276e3-44bf-45b9-8e0d-69a32a4f1084 req-2d843a7a-bd3b-431f-8b13-5c22cac4a9df tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1152265 Dec 21 04:02:17.210170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.228131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:17.301382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.411891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:17.412633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.415442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] 10.222.0.31 "PUT /v2.0/ports/22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 200 len: 1092 time: 2.8294461 Dec 21 04:02:17.422514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:17.424954 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a" -d '{"events": [{"name": "network-changed", "server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:17.443822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:17.449934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4734df3d-5e0a-47d4-b390-fea528c40347 service neutron] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:17.550375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3f7b3f6a-61d7-462e-bdb8-746e42666b3e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8f0baf6b9a444bba84d0cc973cfa2ab6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0907381 Dec 21 04:02:17.551278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41868) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:17.578719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ea5d2e7a-d3fc-448e-8837-542f4e5eec25 None None] Provisioning complete for port ffe8e39b-678a-4e86-878d-6207b5a5bcfd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:17.582033 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ea5d2e7a-d3fc-448e-8837-542f4e5eec25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.588562 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19ac8575-3c28-462b-ae5e-404d73bdf89a x-openstack-request-id: req-19ac8575-3c28-462b-ae5e-404d73bdf89a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:17.589785 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:17.594949 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-19ac8575-3c28-462b-ae5e-404d73bdf89a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:17.595952 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'status': 'completed', 'code': 200} Dec 21 04:02:17.655914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26dd63a5-9731-4666-9455-04eb0fd2c1f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.666822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:17.691364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26dd63a5-9731-4666-9455-04eb0fd2c1f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.699727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ea5d2e7a-d3fc-448e-8837-542f4e5eec25 None None] Port ffe8e39b-678a-4e86-878d-6207b5a5bcfd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:17.744834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-869eab94-e0fb-41ba-916b-0fd12acb881e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:17.748292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-869eab94-e0fb-41ba-916b-0fd12acb881e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1095 time: 0.1773207 Dec 21 04:02:17.822197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-013de275-aa18-4da3-af8b-7cb3f994d41a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 200 len: 217 time: 0.0505896 Dec 21 04:02:17.833556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26dd63a5-9731-4666-9455-04eb0fd2c1f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.836744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26dd63a5-9731-4666-9455-04eb0fd2c1f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.838131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26dd63a5-9731-4666-9455-04eb0fd2c1f4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9074f6f2-224c-48dd-8e27-20c035e74288 HTTP/1.1" status: 204 len: 168 time: 0.2857707 Dec 21 04:02:17.857183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26dd63a5-9731-4666-9455-04eb0fd2c1f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9074f6f2-224c-48dd-8e27-20c035e74288,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:17.916240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.971697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d95e50d-1ebe-4570-82ab-821008af883d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:17.996875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-103f7e04-5e4e-47d7-bb0b-106a7931eef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:17.998888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-103f7e04-5e4e-47d7-bb0b-106a7931eef8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.1336329 Dec 21 04:02:18.052025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-b845a743-2a49-42f2-ada5-b467873c8bb9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0368476 Dec 21 04:02:18.266795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-773f705e-8a3e-4e67-a13d-36309842dcf9 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2026882 Dec 21 04:02:18.270026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d95e50d-1ebe-4570-82ab-821008af883d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.363185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d95e50d-1ebe-4570-82ab-821008af883d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.393064 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.447566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba22a57-eabb-42b1-9bbb-66b304a1a3e0 req-cbf1488b-448c-476c-8f46-976b2890ff99 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1687269 Dec 21 04:02:18.449633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6d95e50d-1ebe-4570-82ab-821008af883d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bc677d119d8b426abeee5ccc6898cb4c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7462277 Dec 21 04:02:18.452865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:18.454441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d95e50d-1ebe-4570-82ab-821008af883d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8878c1eb-75ad-4521-bcae-a31d8a74c51e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:18.458606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.528081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decddc80-179b-409e-88ed-4e7303233d64 req-e9b02f08-a700-41ae-af45-b597d84867b8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:18.532522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-decddc80-179b-409e-88ed-4e7303233d64 req-e9b02f08-a700-41ae-af45-b597d84867b8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1754296 Dec 21 04:02:18.548613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9c69d7a-ef44-409f-8af4-e716dbfa4a8a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.552836 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.554464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Pushing event updated for resources: {'Port': ['ID=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:18.588502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9c69d7a-ef44-409f-8af4-e716dbfa4a8a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.649672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-decddc80-179b-409e-88ed-4e7303233d64 req-db430afd-f48c-4f9c-9ed5-e006250165e7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1125829 Dec 21 04:02:18.734281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-37c569cc-0d81-4822-a9b1-bd7b9af641e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:18.735893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-37c569cc-0d81-4822-a9b1-bd7b9af641e2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1095 time: 0.0904639 Dec 21 04:02:18.737999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:18.739870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:18.742558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9c69d7a-ef44-409f-8af4-e716dbfa4a8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.749409 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9c69d7a-ef44-409f-8af4-e716dbfa4a8a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:18.749409 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e9c69d7a-ef44-409f-8af4-e716dbfa4a8a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8878c1eb-75ad-4521-bcae-a31d8a74c51e HTTP/1.1" status: 204 len: 168 time: 0.2920084 Dec 21 04:02:18.761587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9c69d7a-ef44-409f-8af4-e716dbfa4a8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8878c1eb-75ad-4521-bcae-a31d8a74c51e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:18.825304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 299ed012-5300-4afc-af12-c5766a47a8eb up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:18.917155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 299ed012-5300-4afc-af12-c5766a47a8eb triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:18.918696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:19.053893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-83290a47-111c-4028-a870-755743c745c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:19.053893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-83290a47-111c-4028-a870-755743c745c9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 915 time: 0.2948651 Dec 21 04:02:19.116651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-d661e5e6-f042-4565-b0e2-01bfec14e602 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 200 len: 217 time: 0.0537574 Dec 21 04:02:19.134649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c5052f55-74fd-4c44-98d6-1673202bd1b5 None None] Provisioning complete for port ffe8e39b-678a-4e86-878d-6207b5a5bcfd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:19.137149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c5052f55-74fd-4c44-98d6-1673202bd1b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:19.176644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:02:19.178231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c5052f55-74fd-4c44-98d6-1673202bd1b5 None None] Port ffe8e39b-678a-4e86-878d-6207b5a5bcfd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:19.192147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-6bc909f1-25dd-407b-9f3c-40691118172b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:19.193639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-6bc909f1-25dd-407b-9f3c-40691118172b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.0620663 Dec 21 04:02:19.266094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-c3ba879c-12fd-44a1-973e-c58f0c7c5357 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309441 Dec 21 04:02:19.396561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:02:19.402819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b23ce5b2-a82e-4a00-9a22-8fd4f4478e0e admin admin] 10.222.0.18 "PUT /v2.0/routers/7d365f1f-98f8-4e87-86ca-895a2b2163fc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4982538 Dec 21 04:02:19.413626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:02:19.423109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:02:19.423906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:19.446157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-4318dec5-8f8b-4993-8ff1-086c0ba953c3 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1676586 Dec 21 04:02:19.591069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e6f1e4a-59e2-4b43-85f1-d345ef59422a req-a20656bd-b89a-42bc-bc89-80f816c8916c service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1381128 Dec 21 04:02:19.608383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:02:19.810497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-395039b3-b327-4d79-a641-3eb8b824681d req-b489f15e-9c67-40a3-98d9-ff58a3aa6fe9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:19.812084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-395039b3-b327-4d79-a641-3eb8b824681d req-b489f15e-9c67-40a3-98d9-ff58a3aa6fe9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0597217 Dec 21 04:02:19.861759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-395039b3-b327-4d79-a641-3eb8b824681d req-d0804542-8ff7-4500-8d8f-4753d20eebe0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429499 Dec 21 04:02:19.921422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89381a19-32de-4b4b-8aa0-e3b2efbdb3e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:19.928594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41958) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:19.957519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f96d2a61-d7c8-4ad9-8daa-4240dc3619c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.019563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:18Z', 'revision_number': 2, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:20.050013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:02:20.052499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Updating router 7d365f1f-98f8-4e87-86ca-895a2b2163fc port ffe8e39b-678a-4e86-878d-6207b5a5bcfd binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:02:20.065282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f96d2a61-d7c8-4ad9-8daa-4240dc3619c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.087986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.114120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f96d2a61-d7c8-4ad9-8daa-4240dc3619c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.157310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f96d2a61-d7c8-4ad9-8daa-4240dc3619c9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6476fceedc6e48278f04f0fb4801f63a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2276218 Dec 21 04:02:20.160193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:20.181549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41972) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:20.219508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96d2a61-d7c8-4ad9-8daa-4240dc3619c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6efa5ef9-2215-4b28-a3fa-8fc831ad1ae1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:20.272077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cc459bf-d6ad-42c6-b133-a306e7d1d130 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.298206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cc459bf-d6ad-42c6-b133-a306e7d1d130 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.389304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-49db254c-696f-4d7f-9e4a-e62b510a0533 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.427248 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.432416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cc459bf-d6ad-42c6-b133-a306e7d1d130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.435072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cc459bf-d6ad-42c6-b133-a306e7d1d130 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.436351 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8cc459bf-d6ad-42c6-b133-a306e7d1d130 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6efa5ef9-2215-4b28-a3fa-8fc831ad1ae1 HTTP/1.1" status: 204 len: 168 time: 0.2745290 Dec 21 04:02:20.446542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cc459bf-d6ad-42c6-b133-a306e7d1d130 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6efa5ef9-2215-4b28-a3fa-8fc831ad1ae1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:20.498089 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-49db254c-696f-4d7f-9e4a-e62b510a0533 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.523715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.546556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-49db254c-696f-4d7f-9e4a-e62b510a0533 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.593996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-49db254c-696f-4d7f-9e4a-e62b510a0533 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9fcfffd765f341dc8b73ea9472c4bc87&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4083445 Dec 21 04:02:20.595251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:20.595600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49db254c-696f-4d7f-9e4a-e62b510a0533 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84d4c48f-1514-4927-9eae-5dd453f9dfe5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:20.638467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d50ded9-8cd2-4600-8aed-d4819c077e3e None None] Pushing event updated for resources: {'Port': ['ID=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:20.679019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c57bcf5-7a74-4b54-ace0-c4778321c1bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.680186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Attempting to bind port ffe8e39b-678a-4e86-878d-6207b5a5bcfd on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:20.680625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Attempting to bind port ffe8e39b-678a-4e86-878d-6207b5a5bcfd by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:20.681234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Attempting to bind port ffe8e39b-678a-4e86-878d-6207b5a5bcfd on network e94ae2ca-4e3f-4500-90fd-ec494b399bda {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:20.686745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 1, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:20.687162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Checking segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:20.687569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.687967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Bound using segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:20.688439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Bound port: ffe8e39b-678a-4e86-878d-6207b5a5bcfd, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:20.689153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.714220 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c57bcf5-7a74-4b54-ace0-c4778321c1bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.768300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] For port ffe8e39b-678a-4e86-878d-6207b5a5bcfd, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:20.771771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] For port ffe8e39b-678a-4e86-878d-6207b5a5bcfd, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:20.835818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:20.838922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c57bcf5-7a74-4b54-ace0-c4778321c1bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.842362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c57bcf5-7a74-4b54-ace0-c4778321c1bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.843854 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2c57bcf5-7a74-4b54-ace0-c4778321c1bd admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/84d4c48f-1514-4927-9eae-5dd453f9dfe5 HTTP/1.1" status: 204 len: 168 time: 0.2472332 Dec 21 04:02:20.850778 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:20.852026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c57bcf5-7a74-4b54-ace0-c4778321c1bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84d4c48f-1514-4927-9eae-5dd453f9dfe5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:20.970905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-85926d3a-ca54-4147-9400-3be48d1900ae None None] Provisioning complete for port ffe8e39b-678a-4e86-878d-6207b5a5bcfd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:20.971506 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-85926d3a-ca54-4147-9400-3be48d1900ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.006684 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5dac515-0dbf-499f-88ae-90afb32b0be4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.010453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d50ded9-8cd2-4600-8aed-d4819c077e3e None None] Pushing event updated for resources: {'Port': ['ID=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:21.013881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:02:21.014859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:21.103416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5109a6-2794-48c2-b728-d0fbdff3de3c req-f64452c8-3e41-421b-bdd6-8bf695f8df8d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:21.105489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a5109a6-2794-48c2-b728-d0fbdff3de3c req-f64452c8-3e41-421b-bdd6-8bf695f8df8d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0889547 Dec 21 04:02:21.168636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:02:21.185214 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5dac515-0dbf-499f-88ae-90afb32b0be4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.192866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a5109a6-2794-48c2-b728-d0fbdff3de3c req-6e7ddfbe-3e86-457f-bb8f-a0890f4c8cd5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787489 Dec 21 04:02:21.273421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5dac515-0dbf-499f-88ae-90afb32b0be4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.348271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5dac515-0dbf-499f-88ae-90afb32b0be4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e0f2c5f56c8f4297ac8fb9439da53eaf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5109866 Dec 21 04:02:21.350534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42016) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:21.361089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5dac515-0dbf-499f-88ae-90afb32b0be4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=933f2036-3dbf-4417-b230-d41124ebe1ff,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:21.381227 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-85926d3a-ca54-4147-9400-3be48d1900ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.455622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3330e9-69e8-4dff-8ba4-d66c9f676b0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.484256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3330e9-69e8-4dff-8ba4-d66c9f676b0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.505826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-85926d3a-ca54-4147-9400-3be48d1900ae None None] For port ffe8e39b-678a-4e86-878d-6207b5a5bcfd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:21.573635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42020) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:21.576103 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-85926d3a-ca54-4147-9400-3be48d1900ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.578735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1098329806', 'description': 'tempest-description--1894929634'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:21.582124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:20Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:21.605775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3330e9-69e8-4dff-8ba4-d66c9f676b0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.609632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b3330e9-69e8-4dff-8ba4-d66c9f676b0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.611124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b3330e9-69e8-4dff-8ba4-d66c9f676b0b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/933f2036-3dbf-4417-b230-d41124ebe1ff HTTP/1.1" status: 204 len: 168 time: 0.2594604 Dec 21 04:02:21.624997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3330e9-69e8-4dff-8ba4-d66c9f676b0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=933f2036-3dbf-4417-b230-d41124ebe1ff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:21.658900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d06e9924-f091-4559-aa2d-65ddf3d1418c None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:20Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:02:21.697091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85926d3a-ca54-4147-9400-3be48d1900ae None None] Pushing event updated for resources: {'Port': ['ID=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:21.703433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.785498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-080cfe8a-afbe-4a16-a8f0-9fa2920ca844 None None] Provisioning complete for port ffe8e39b-678a-4e86-878d-6207b5a5bcfd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:21.785879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-080cfe8a-afbe-4a16-a8f0-9fa2920ca844 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.870130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.936648 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:21.969952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'SecurityGroup': ['ID=30e72850-7e2a-4b10-8d48-9837964c9ad9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:22.018642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.020813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a17f0cfe-475e-4307-be4e-9cde0a8eaa70 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.4454350 Dec 21 04:02:22.023451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42038) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:22.029021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'security_group_rule': {'security_group_id': '30e72850-7e2a-4b10-8d48-9837964c9ad9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:22.147605 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.207146 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.284897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.330003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37780489-5be9-42e0-8545-25eff471988c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:22.355343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c230ca96-fd11-42de-9a68-4ddb31ff6fb1 req-0cdf28f7-03dc-4ccc-a204-95054f44e6d8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:22.363810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c230ca96-fd11-42de-9a68-4ddb31ff6fb1 req-0cdf28f7-03dc-4ccc-a204-95054f44e6d8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0766087 Dec 21 04:02:22.399929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:22.405188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.406576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-30ca8e9f-89bf-4a0e-96d0-7560ed7cb40d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3820815 Dec 21 04:02:22.410595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42050) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:22.415332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'security_group_rule': {'security_group_id': '30e72850-7e2a-4b10-8d48-9837964c9ad9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:22.417928 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8681749-cf69-42e0-af0c-6971e4b480dc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.440857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c230ca96-fd11-42de-9a68-4ddb31ff6fb1 req-3c11c79c-9194-4845-b506-98e1ad7ce708 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757704 Dec 21 04:02:22.514083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.565534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8681749-cf69-42e0-af0c-6971e4b480dc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.588337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.639988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8681749-cf69-42e0-af0c-6971e4b480dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.649477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:02:22.668500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.669275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e0cff7e1-b6d5-4be5-9c38-84e6b83fa783 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.673427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8681749-cf69-42e0-af0c-6971e4b480dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b562325e-2fb9-4b3d-9d97-6b715597d8c6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:22.691451 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f8681749-cf69-42e0-af0c-6971e4b480dc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=cfe866340f9e4be2831afdc05392e0ab&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2904198 Dec 21 04:02:22.693918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42058) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:22.704828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76f283d4-ac1a-447f-a24b-fe31c75e83c5,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:22.780155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.787539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-526c764b-d675-477c-8acb-419f96f5685a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3711581 Dec 21 04:02:22.787539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42064) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:22.795608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:22.799440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.799948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f1bfb7e-2485-4c9a-820a-bb2ac416de25 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.848476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f1bfb7e-2485-4c9a-820a-bb2ac416de25 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.866321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:22.885504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'port_id': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'mac_address': 'fa:16:3e:52:07:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'af597cc9-d6ea-4007-b8f3-5cbc38b23a3a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:02:22.891136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ffe8e39b-678a-4e86-878d-6207b5a5bcfd up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:22.919642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:22.999331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f1bfb7e-2485-4c9a-820a-bb2ac416de25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.002156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f1bfb7e-2485-4c9a-820a-bb2ac416de25 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.003546 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f1bfb7e-2485-4c9a-820a-bb2ac416de25 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b562325e-2fb9-4b3d-9d97-6b715597d8c6 HTTP/1.1" status: 204 len: 168 time: 0.3084183 Dec 21 04:02:23.011503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.016358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1bfb7e-2485-4c9a-820a-bb2ac416de25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b562325e-2fb9-4b3d-9d97-6b715597d8c6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:23.024659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ffe8e39b-678a-4e86-878d-6207b5a5bcfd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:23.025032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.085022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 22270d5e-6f54-41c2-a9eb-fd2c24aef262 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:23.105654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:23.153627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.172306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.238129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.250816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17ebea9-c3e4-4609-80a4-25b6f1d181cd req-4ea6d409-3b4f-4a0a-9edb-5c8dbdebe79f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:23.258971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17ebea9-c3e4-4609-80a4-25b6f1d181cd req-4ea6d409-3b4f-4a0a-9edb-5c8dbdebe79f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1527171 Dec 21 04:02:23.287832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:23.355486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17ebea9-c3e4-4609-80a4-25b6f1d181cd req-2e3b5860-d45e-4175-b551-540a388042fb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0939896 Dec 21 04:02:23.355486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Allocated IP 172.25.5.162 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/2b0500e5-9320-4897-9e88-bbccfdff1197) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:23.527874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['22270d5e-6f54-41c2-a9eb-fd2c24aef262'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:02:23.566355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.632550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1665720d-3d9a-4f29-a31d-94768eb19382 req-8b9d4028-fb06-4a1a-b3cc-0f797d5e2912 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:23.634093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1665720d-3d9a-4f29-a31d-94768eb19382 req-8b9d4028-fb06-4a1a-b3cc-0f797d5e2912 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1288412 Dec 21 04:02:23.657781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ecbe0b-1319-4361-b446-d20237d36a3c req-b5b4b7b2-a116-41f2-bdaf-cb000d91b7b8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:23.659556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ecbe0b-1319-4361-b446-d20237d36a3c req-b5b4b7b2-a116-41f2-bdaf-cb000d91b7b8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 944 time: 0.1187789 Dec 21 04:02:23.744049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1665720d-3d9a-4f29-a31d-94768eb19382 req-7ee26e6d-3209-4481-8ffb-af66cbfd45ef tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1026695 Dec 21 04:02:23.748594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:23.760659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29ecbe0b-1319-4361-b446-d20237d36a3c req-a43c5fd7-08a1-4300-a364-52a206240422 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915546 Dec 21 04:02:23.805499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:23.808773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:23.815600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:23.822925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'Port': ['ID=2b0500e5-9320-4897-9e88-bbccfdff1197,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:23.913650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.060361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.223104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.279708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.422205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01496ab7-1c5a-4a3e-8d53-89b3ff005b73 req-c7fc8465-1b1f-4776-b0c4-44b8f02261d4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:24.423885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01496ab7-1c5a-4a3e-8d53-89b3ff005b73 req-c7fc8465-1b1f-4776-b0c4-44b8f02261d4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1322095 Dec 21 04:02:24.424622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'Port': ['ID=2b0500e5-9320-4897-9e88-bbccfdff1197,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:24.457723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.495274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01496ab7-1c5a-4a3e-8d53-89b3ff005b73 req-91be7e6c-722a-4c65-ba96-54299287c585 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0589259 Dec 21 04:02:24.618597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.619866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38ce3b06-ee80-49f6-b189-15e85ffdea5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.8324981 Dec 21 04:02:24.673586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:24.841763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:02:24.853670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:24.853933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.870727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-0cd06766-2131-4379-9596-ffa03ea03e6b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1098329806&fields=id&tenant_id=3f578ba291d54826a6db2accb249f808 HTTP/1.1" status: 200 len: 267 time: 0.0948398 Dec 21 04:02:24.949423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:24.965659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:25.017021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:25.018764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:25.021289 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5229d5d-b39e-4ccb-93ae-ab222cfa86ce" -d '{"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-plugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:25.033467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:25.121046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:25.197803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:25.384719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-315e36a9-8a73-453b-978b-7d5ee4120894 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:25.386315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-315e36a9-8a73-453b-978b-7d5ee4120894 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 811 time: 0.5146532 Dec 21 04:02:25.395420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040b4fc8-b05e-4f90-b0c0-ff7bba4f7f19 req-8d0196dc-3cbe-438b-a004-dc7c790c1342 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:25.396838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-040b4fc8-b05e-4f90-b0c0-ff7bba4f7f19 req-8d0196dc-3cbe-438b-a004-dc7c790c1342 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0853803 Dec 21 04:02:25.418811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-2d36d80f-e09d-4b3a-ba7b-a8547aea597f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/quotas/3f578ba291d54826a6db2accb249f808 HTTP/1.1" status: 200 len: 375 time: 0.0193174 Dec 21 04:02:25.489141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-040b4fc8-b05e-4f90-b0c0-ff7bba4f7f19 req-8d382e70-b268-4a23-8368-88fd94c2e6e2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810246 Dec 21 04:02:25.500674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-490e4332-06f8-422c-891d-438259ec8774 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0743556 Dec 21 04:02:25.626146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-bc2ec72e-8c75-4759-8976-79af5ddf8fe6 service neutron] 10.222.0.18 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1121805 Dec 21 04:02:25.661326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:25.705328 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0639e4db-5786-400c-90e1-ca0233ea0dbc x-openstack-request-id: req-0639e4db-5786-400c-90e1-ca0233ea0dbc {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:25.706301 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-plugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:25.706759 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0639e4db-5786-400c-90e1-ca0233ea0dbc {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:25.707544 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'code': 200} Dec 21 04:02:25.793674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-76ddc116-9c9d-4997-a76f-fb9b0c345507 service neutron] 10.222.0.18 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1609681 Dec 21 04:02:25.883384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5735a4a3-8330-4422-8389-c3aa37e4051b req-80846286-3034-4362-beea-8e6d91f39ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:25.884920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5735a4a3-8330-4422-8389-c3aa37e4051b req-80846286-3034-4362-beea-8e6d91f39ca1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1097 time: 0.0434635 Dec 21 04:02:25.955467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5735a4a3-8330-4422-8389-c3aa37e4051b req-7c1c5bfa-c5a0-4954-9604-cff54f5209e1 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571234 Dec 21 04:02:26.087025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f454ad2-4570-4174-b359-c87c7c68476f req-29767533-a8db-4133-a510-98dfcd04044e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 210 time: 0.0464644 Dec 21 04:02:26.113501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276e4525-eeaa-44a4-a08c-2717eef6a6f5 req-6d2cfa8a-0b5b-4e82-9a32-4db78905d3c9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:26.124614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-276e4525-eeaa-44a4-a08c-2717eef6a6f5 req-6d2cfa8a-0b5b-4e82-9a32-4db78905d3c9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1339712 Dec 21 04:02:26.183521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-276e4525-eeaa-44a4-a08c-2717eef6a6f5 req-58ef2e4b-ad2a-4e99-94cd-e7345aaa443a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0552180 Dec 21 04:02:26.630692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104c9333-d9fd-474c-ab89-4905dccefbc5 req-34a823d8-3f55-480d-9575-26a5c1572c6b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:26.633633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-104c9333-d9fd-474c-ab89-4905dccefbc5 req-34a823d8-3f55-480d-9575-26a5c1572c6b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0691266 Dec 21 04:02:26.688105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-104c9333-d9fd-474c-ab89-4905dccefbc5 req-e780bab5-cdbd-4fc7-86a7-2b16cbe33863 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465906 Dec 21 04:02:27.168752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41a2aa5e-2f62-4fac-a4e2-7c2d0938cd93 req-8d58aed3-f164-4b5d-9c08-65c63c9e1732 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 210 time: 0.0268168 Dec 21 04:02:27.298913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020dfd29-2e4a-47ab-8667-194bb8641664 req-cc71fa2c-355c-4074-b255-2168e629a177 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:27.300469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-020dfd29-2e4a-47ab-8667-194bb8641664 req-cc71fa2c-355c-4074-b255-2168e629a177 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0543475 Dec 21 04:02:27.380629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-020dfd29-2e4a-47ab-8667-194bb8641664 req-4336b4ab-897d-42e3-bcff-617b3459009f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0683105 Dec 21 04:02:27.816225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a3e5796-5e3e-41c1-9e45-f97356ad338d req-de87e8ab-c698-4987-af64-1118415bedab tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:27.817846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a3e5796-5e3e-41c1-9e45-f97356ad338d req-de87e8ab-c698-4987-af64-1118415bedab tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0603356 Dec 21 04:02:27.872034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a3e5796-5e3e-41c1-9e45-f97356ad338d req-132a329e-ee34-4882-81c3-7011fc31fc52 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482736 Dec 21 04:02:28.161016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-8a16e03e-e0b1-4568-bd77-54ab2ed48a10 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:28.162590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-8a16e03e-e0b1-4568-bd77-54ab2ed48a10 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 814 time: 0.1191075 Dec 21 04:02:28.178230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-4fb16fb4-f60b-4d7c-9c49-8e6ed738d469 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/quotas/9be1447e894c4d89ae0d884935aafca9 HTTP/1.1" status: 200 len: 375 time: 0.0097547 Dec 21 04:02:28.239492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-265acd20-d19c-4fb6-9f23-5519d71a0fc1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0551140 Dec 21 04:02:28.303034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1013cfc3-ecad-46e8-b099-76077119673a req-f466180a-0478-45af-89fd-5782a94c8756 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 210 time: 0.0539310 Dec 21 04:02:28.360007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-865cd0f3-606a-4ed3-ace3-a8377e6fd66a service neutron] 10.222.0.18 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1191206 Dec 21 04:02:28.595821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-997e2447-5721-4bad-b07c-70184c7867c3 service neutron] 10.222.0.18 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2279975 Dec 21 04:02:28.611674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d089bf49-3718-4ef4-bc5a-b31c6e5ed2f5 req-957ddc43-0572-4113-a400-97e71c7bc306 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:28.613521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d089bf49-3718-4ef4-bc5a-b31c6e5ed2f5 req-957ddc43-0572-4113-a400-97e71c7bc306 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1543777 Dec 21 04:02:28.663186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-748a5d23-4c44-4900-81b2-c77eed301273 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:28.665691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-748a5d23-4c44-4900-81b2-c77eed301273 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 811 time: 0.2257855 Dec 21 04:02:28.722245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d089bf49-3718-4ef4-bc5a-b31c6e5ed2f5 req-33b09128-2e60-4a74-aead-71f57db4e7e0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1007233 Dec 21 04:02:28.797979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-c5a9c698-ba4d-4e4a-9c5d-a0d39b4c0a35 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3f578ba291d54826a6db2accb249f808 HTTP/1.1" status: 200 len: 380 time: 0.1132281 Dec 21 04:02:28.813292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'port': {'device_id': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'admin_state_up': True, 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'security_groups': ['30e72850-7e2a-4b10-8d48-9837964c9ad9']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:28.967116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96d76c1-b2b5-4bf3-bd40-f1307b1ce7a0 req-e78cf165-3b47-46f5-9ea2-067f61ae07e8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 210 time: 0.0849524 Dec 21 04:02:29.250695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Made reservation on behalf of 3f578ba291d54826a6db2accb249f808 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:29.254253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:29.479143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7c7f4fc-cbb4-4865-af12-8365fbee62c8 req-998d070a-ead2-470b-9c19-08de4c373ade tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 210 time: 0.0530667 Dec 21 04:02:29.485823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Allocated IP 172.20.0.9 (e94ae2ca-4e3f-4500-90fd-ec494b399bda/a102645d-c1b2-4824-aff9-56e0558bab2d/8a331e5a-3daa-4e31-9faf-aec4f4caa8e1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:29.655212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:29.777742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:29.865159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:29.872574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:29.877958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:29.907468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'Port': ['ID=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:29.944184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16d8db8-0477-4686-8e70-f5a34a941e12 req-98757882-ff52-4854-98f2-2c3145b526cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:29.945927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f16d8db8-0477-4686-8e70-f5a34a941e12 req-98757882-ff52-4854-98f2-2c3145b526cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1198027 Dec 21 04:02:29.972992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:29.973668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:30.058430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f16d8db8-0477-4686-8e70-f5a34a941e12 req-adc8f093-668a-4cf4-b4ea-2e0f48224ae2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1043327 Dec 21 04:02:30.110610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-b777ce6f-2ffc-411b-bd25-f1060f1356df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3033447 Dec 21 04:02:30.147827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Request body: {'port': {'device_id': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:30.215034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5128020-07ab-4b0b-a3e3-5c4a7f460bd3 req-88dd91fe-6ff2-4b74-95d7-4d01b6cfff79 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 210 time: 0.0422177 Dec 21 04:02:30.217611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f3a5f373-ca1c-4baf-9c7c-13a799d31514 None None] Provisioning complete for port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:30.218779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3a5f373-ca1c-4baf-9c7c-13a799d31514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:30.244843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:30.281383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f3a5f373-ca1c-4baf-9c7c-13a799d31514 None None] Port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:30.701907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ff38b2-72e6-4b88-b120-c9a00c587313 req-8ff9cfb8-5487-4a49-8eb3-54cdc827af3d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:30.709285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9ff38b2-72e6-4b88-b120-c9a00c587313 req-8ff9cfb8-5487-4a49-8eb3-54cdc827af3d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 931 time: 0.1130929 Dec 21 04:02:30.748796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:30.760550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:30.779051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9ff38b2-72e6-4b88-b120-c9a00c587313 req-68d4b648-99dd-4a9f-9273-be8f22486a1b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0688710 Dec 21 04:02:30.784441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Transition to ACTIVE for port object 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:02:30.906476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:30.972271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Pushing event updated for resources: {'Port': ['ID=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:31.077529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Attempting to bind port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:31.078197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Attempting to bind port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:31.078197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Attempting to bind port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 on network e94ae2ca-4e3f-4500-90fd-ec494b399bda {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:31.085066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 on network e94ae2ca-4e3f-4500-90fd-ec494b399bda not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:02:31.085333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Attempting to bind port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 on network e94ae2ca-4e3f-4500-90fd-ec494b399bda {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:31.090737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 2, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:31.091184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Checking segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:31.091503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Bound using segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:31.091982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Bound port: 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:31.092348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:31.233742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] For port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:31.237201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] For port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:31.285393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a017dea3-3ade-4bac-81fd-22afb8f3e153 req-aa7c8a98-20c1-454a-96cf-b415a8ea1e43 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:31.289361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a017dea3-3ade-4bac-81fd-22afb8f3e153 req-aa7c8a98-20c1-454a-96cf-b415a8ea1e43 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1252983 Dec 21 04:02:31.323745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:31.391352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b4f3c3f-6089-4dea-b48d-badc66c935e0 req-fe01f429-db98-4c17-b035-012320f904ad tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 210 time: 0.0712440 Dec 21 04:02:31.409281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:31.411859 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:31.412251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] 10.222.0.31 "PUT /v2.0/ports/8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 200 len: 1092 time: 1.2695062 Dec 21 04:02:31.412724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:31.416136 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5" -d '{"events": [{"name": "network-changed", "server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:31.475573 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8abe12d-bee7-4bcb-b0c4-81c7112b1fa7 x-openstack-request-id: req-a8abe12d-bee7-4bcb-b0c4-81c7112b1fa7 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:31.476165 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:31.476654 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a8abe12d-bee7-4bcb-b0c4-81c7112b1fa7 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:31.477642 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'status': 'completed', 'code': 200} Dec 21 04:02:31.502284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a017dea3-3ade-4bac-81fd-22afb8f3e153 req-e5b68ed7-7c98-4640-b6b8-7f9499e63713 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1974249 Dec 21 04:02:31.613549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee017f0-73ee-420a-922c-be090c99bcd8 service neutron] Pushing event updated for resources: {'Port': ['ID=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:31.671508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5 req-42f8dfe0-02d9-4f6e-89d4-b15a988178bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:31.673206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5 req-42f8dfe0-02d9-4f6e-89d4-b15a988178bc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1095 time: 0.1227500 Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.684958 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:31.688267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-693a269c-4cfb-44d4-ba9b-9bf8fa481b35 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:31.689650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-693a269c-4cfb-44d4-ba9b-9bf8fa481b35 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.54 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 814 time: 0.2062461 Dec 21 04:02:31.740876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Request body: {'port': {'device_id': '6239db5b-27cc-4337-94cb-75a15300521e', 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'admin_state_up': True, 'tenant_id': '9be1447e894c4d89ae0d884935aafca9'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:31.979202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5 req-4b24c507-91f5-4119-8fbd-d7d6fbae3104 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:31.980811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5 req-4b24c507-91f5-4119-8fbd-d7d6fbae3104 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=3f578ba291d54826a6db2accb249f808&shared=False HTTP/1.1" status: 200 len: 912 time: 0.2902856 Dec 21 04:02:31.991798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be8bcd74-3ac7-402c-97b2-5f88858b1781 req-ebc427dc-9461-43c7-8c68-9e788b0c626c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:31.993262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be8bcd74-3ac7-402c-97b2-5f88858b1781 req-ebc427dc-9461-43c7-8c68-9e788b0c626c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 943 time: 0.1060748 Dec 21 04:02:32.124953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be8bcd74-3ac7-402c-97b2-5f88858b1781 req-5709a6a7-e21b-448a-9735-cd500a0e228b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1213295 Dec 21 04:02:32.151023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5 req-88c159f1-3bc8-4f58-bd10-498d690d4ce3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:32.152516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f7f3fa6-6c6a-485c-b6f6-09df91f779b5 req-88c159f1-3bc8-4f58-bd10-498d690d4ce3 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1575923 Dec 21 04:02:32.159179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Made reservation on behalf of 9be1447e894c4d89ae0d884935aafca9 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:32.162748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:32.350492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-673f3043-697d-415d-b44d-224719b7da2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:32.352035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-673f3043-697d-415d-b44d-224719b7da2b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1095 time: 0.1039464 Dec 21 04:02:32.376246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Allocated IP 172.20.0.5 (1d34dd2a-275c-4073-aad9-16b29c6ef929/af597cc9-d6ea-4007-b8f3-5cbc38b23a3a/5dea0ba1-f39e-4e5f-9a5d-e68097c71e64) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:32.417430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-5ef1e776-e625-43e9-a8ce-dd0778472409 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 200 len: 217 time: 0.0482416 Dec 21 04:02:32.482999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-328dbdd1-c54a-445a-8b16-dbe6b90ba022 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:32.484856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-328dbdd1-c54a-445a-8b16-dbe6b90ba022 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.0562072 Dec 21 04:02:32.553607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50d95ff3-6c9d-4ad1-95bc-b16513be92c8 req-a95c4302-8728-4305-abd6-e010aa8a6726 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 210 time: 0.0635378 Dec 21 04:02:32.648316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-a4ebba65-2af4-49f9-bcb1-0381e8e826a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:32.648316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-a4ebba65-2af4-49f9-bcb1-0381e8e826a0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1508639 Dec 21 04:02:32.789427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:32.799479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f23cafcd-cfde-4972-bf12-96461a2559f0 req-bb5c3540-cb26-43e0-a1f0-821308c0d969 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:32.801112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f23cafcd-cfde-4972-bf12-96461a2559f0 req-bb5c3540-cb26-43e0-a1f0-821308c0d969 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1661842 Dec 21 04:02:32.844711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-6942c201-7cbf-4450-acb1-fe91953445f4 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1848335 Dec 21 04:02:33.307030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f23cafcd-cfde-4972-bf12-96461a2559f0 req-8782d81f-ca79-4cdd-b18b-e18ca493a1a3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4878058 Dec 21 04:02:33.340749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:33.388653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['22270d5e-6f54-41c2-a9eb-fd2c24aef262'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:02:33.466751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c0ddf6-9118-41b6-b3e2-ac5a8449920c req-4df47c66-8b2f-4d69-adf4-aedc148fd5b1 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6116781 Dec 21 04:02:33.480065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee741d1-798d-4968-be56-84a7e0e6bd19 req-6984a442-f0b4-4565-8356-1fd7b6d50864 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:33.488476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee741d1-798d-4968-be56-84a7e0e6bd19 req-6984a442-f0b4-4565-8356-1fd7b6d50864 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 943 time: 0.2183723 Dec 21 04:02:33.492895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Network 1d34dd2a-275c-4073-aad9-16b29c6ef929 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:33.505220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:33.514366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:33.517089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Pushing event updated for resources: {'Port': ['ID=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:33.612339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee741d1-798d-4968-be56-84a7e0e6bd19 req-be31a770-3a77-46ef-ac9e-43bc0e0db3dc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1152985 Dec 21 04:02:33.631182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:33.632052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:33.722717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-60bf60e7-7700-49a2-a59f-26de3b59de49 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0016332 Dec 21 04:02:33.737121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18067727-3b84-4513-a274-f10ac6fd8b4a req-9eaad652-a186-4a9e-8306-66590aef628c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:33.745112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18067727-3b84-4513-a274-f10ac6fd8b4a req-9eaad652-a186-4a9e-8306-66590aef628c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 931 time: 0.0726917 Dec 21 04:02:33.751834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Request body: {'port': {'device_id': '6239db5b-27cc-4337-94cb-75a15300521e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:33.841674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18067727-3b84-4513-a274-f10ac6fd8b4a req-1648c61c-5214-439a-925c-cd69300dae91 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0952833 Dec 21 04:02:33.842589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:34.145031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:34.154349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:34.187659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Transition to ACTIVE for port object 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:02:34.249310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:34.365320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Pushing event updated for resources: {'Port': ['ID=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:34.518320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Attempting to bind port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:34.518320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Attempting to bind port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:34.518320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Attempting to bind port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 on network 1d34dd2a-275c-4073-aad9-16b29c6ef929 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:34.518320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 on network 1d34dd2a-275c-4073-aad9-16b29c6ef929 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:02:34.518694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Attempting to bind port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 on network 1d34dd2a-275c-4073-aad9-16b29c6ef929 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:34.523784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 2, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:34.524227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Checking segment: {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:34.524674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Bound using segment: {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:34.525098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Bound port: 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:34.525447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:34.606244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] For port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:34.617452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] For port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:34.680439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:34.782567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:34.782567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:34.784112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] 10.222.0.54 "PUT /v2.0/ports/5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 HTTP/1.1" status: 200 len: 1092 time: 1.0357106 Dec 21 04:02:34.784544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6239db5b-27cc-4337-94cb-75a15300521e', 'tag': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:34.786987 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58da1c36-3bf1-415c-9288-a201fcd4398b" -d '{"events": [{"name": "network-changed", "server_uuid": "6239db5b-27cc-4337-94cb-75a15300521e", "tag": "5dea0ba1-f39e-4e5f-9a5d-e68097c71e64"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:34.861267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d0d721e-850d-431b-9929-b4af8907e9e0 service neutron] Pushing event updated for resources: {'Port': ['ID=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:34.880931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81904818-8814-461b-8278-d1b781205e22 req-ed858d61-da01-425b-86f4-5641a6095b46 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:34.882471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81904818-8814-461b-8278-d1b781205e22 req-ed858d61-da01-425b-86f4-5641a6095b46 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.4670408 Dec 21 04:02:34.890098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ced8e9f-31cf-4220-99a3-742e9d352f53 req-f8f5cb38-d59e-41f0-a431-bd8a08c7b8ba tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:34.891574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ced8e9f-31cf-4220-99a3-742e9d352f53 req-f8f5cb38-d59e-41f0-a431-bd8a08c7b8ba tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 943 time: 0.1732709 Dec 21 04:02:35.011714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-9a0c1023-3f29-4e97-b214-524673075acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:35.015298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-9a0c1023-3f29-4e97-b214-524673075acf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 1095 time: 0.1070220 Dec 21 04:02:35.020977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ced8e9f-31cf-4220-99a3-742e9d352f53 req-253f864e-e56b-4642-af83-81a8b5733754 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1145053 Dec 21 04:02:35.024490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81904818-8814-461b-8278-d1b781205e22 req-2d51b92c-b0fe-40f6-aa64-8d228441aba5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1319592 Dec 21 04:02:35.092171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-642bf78f-1383-4e39-b755-6e11182f1f9a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 HTTP/1.1" status: 200 len: 217 time: 0.0612350 Dec 21 04:02:35.101232 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7bd80e05-2f3a-46c7-9e0d-4143861c10fe x-openstack-request-id: req-7bd80e05-2f3a-46c7-9e0d-4143861c10fe {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:35.101232 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6239db5b-27cc-4337-94cb-75a15300521e", "tag": "5dea0ba1-f39e-4e5f-9a5d-e68097c71e64", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:35.101232 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7bd80e05-2f3a-46c7-9e0d-4143861c10fe {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:35.101232 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6239db5b-27cc-4337-94cb-75a15300521e', 'tag': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64', 'status': 'completed', 'code': 200} Dec 21 04:02:35.192039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-4e6e9bf8-eccb-4766-af33-258049ffae16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:35.193576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-4e6e9bf8-eccb-4766-af33-258049ffae16 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.0918174 Dec 21 04:02:35.226216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f799fa73-51d4-434b-9c6d-3e564a18e223 req-33a79dae-363a-48c4-b214-b94b60c89dcb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:35.227953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f799fa73-51d4-434b-9c6d-3e564a18e223 req-33a79dae-363a-48c4-b214-b94b60c89dcb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 943 time: 0.0915785 Dec 21 04:02:35.255305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-612a1d4c-453b-472e-9c76-9c76b2fe5894 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0483344 Dec 21 04:02:35.354698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f799fa73-51d4-434b-9c6d-3e564a18e223 req-197c25af-546a-48a1-b946-7e2b11884b63 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067111 Dec 21 04:02:35.402304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-c9d0372f-e484-4932-92fb-c209ca90a0e6 service neutron] 10.222.0.54 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1393735 Dec 21 04:02:35.539384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1508947a-dc0f-4288-bc74-54ea22f3c8b4 req-ad6e964a-5b2e-45a2-9fa0-a86d96bf10cf service neutron] 10.222.0.54 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1270401 Dec 21 04:02:35.812772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-74fd1fd6-5cd9-425f-a25e-b64e52ccd59c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:35.814384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-74fd1fd6-5cd9-425f-a25e-b64e52ccd59c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 1095 time: 0.0567677 Dec 21 04:02:35.973228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-7fcac1f2-c4f7-4f1e-8a1f-e0f037ca10c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:35.975035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-7fcac1f2-c4f7-4f1e-8a1f-e0f037ca10c5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 915 time: 0.1531031 Dec 21 04:02:36.031555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-24f0a3b7-7f08-4458-9ae8-27b7c9b7fac7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 HTTP/1.1" status: 200 len: 217 time: 0.0466599 Dec 21 04:02:36.115336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-94a99599-195c-4f20-8cae-2c4d3f9ea858 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:36.118686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-94a99599-195c-4f20-8cae-2c4d3f9ea858 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.0768163 Dec 21 04:02:36.213233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-2258b34c-8b80-469a-988b-bc82cbc0f525 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0789323 Dec 21 04:02:36.277316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ef1bab-f728-4c97-8c9e-c8122c80da02 req-d2310211-b597-4cab-a131-6f52c940edfc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:36.279478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6ef1bab-f728-4c97-8c9e-c8122c80da02 req-d2310211-b597-4cab-a131-6f52c940edfc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 943 time: 0.1579394 Dec 21 04:02:36.291200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d96600-789c-4f89-a8c4-f78ca97993f2 req-f117aaab-dc84-4aaf-bae3-0624c071ea04 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:36.293095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42d96600-789c-4f89-a8c4-f78ca97993f2 req-f117aaab-dc84-4aaf-bae3-0624c071ea04 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1602032 Dec 21 04:02:36.462055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6ef1bab-f728-4c97-8c9e-c8122c80da02 req-56175ecd-32ee-4cd8-a9c2-8647fb07ed84 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1642830 Dec 21 04:02:36.494458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42d96600-789c-4f89-a8c4-f78ca97993f2 req-1a26d565-6c17-4c3a-b5e2-7138bdf6379e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1518712 Dec 21 04:02:36.497062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-e004b2e6-3dd6-4e2c-9a87-39df8c13aa3e service neutron] 10.222.0.54 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2742100 Dec 21 04:02:36.687121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58da1c36-3bf1-415c-9288-a201fcd4398b req-792ba7b8-8b04-4025-b500-b0468241942e service neutron] 10.222.0.54 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1804402 Dec 21 04:02:36.710041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49a7635-9781-4f63-9fcd-1a29084eb3d9 req-8ad667b1-93b3-46eb-bdad-9fd54ca20736 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:36.715494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c49a7635-9781-4f63-9fcd-1a29084eb3d9 req-8ad667b1-93b3-46eb-bdad-9fd54ca20736 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 943 time: 0.1141336 Dec 21 04:02:36.724358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:02:36.789034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c49a7635-9781-4f63-9fcd-1a29084eb3d9 req-0e16076c-f451-4b59-8529-355cc7568b80 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597942 Dec 21 04:02:36.851283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:36.876894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'port_id': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'mac_address': 'fa:16:3e:68:02:b2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:02:36.918206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:36.930857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:36.952403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:37.027982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.079126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:37.088580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.089977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.089977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.090435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.090990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.091631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.092173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.092532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.092857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.093194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.093639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.094161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.094718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:02:37.098909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:37.211709 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb171b4d-4971-4288-952c-db83bd7596af admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.293132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb171b4d-4971-4288-952c-db83bd7596af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.352969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fb171b4d-4971-4288-952c-db83bd7596af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.372387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['8a331e5a-3daa-4e31-9faf-aec4f4caa8e1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:02:37.401232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb171b4d-4971-4288-952c-db83bd7596af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=433e4925-5ab2-4954-ac9b-7222c55e5672,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:37.410202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fb171b4d-4971-4288-952c-db83bd7596af admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=09ffe90a84764bfcaf4816479925a7a2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3099084 Dec 21 04:02:37.412700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42432) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:37.521245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93479352-4c4a-4582-be26-5bb651c3303b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.557828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93479352-4c4a-4582-be26-5bb651c3303b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.692273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6274be51-f168-43b9-9e3b-d755801f59db req-5098fe04-84bd-4c75-ba18-844d66e7a744 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:37.701420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6274be51-f168-43b9-9e3b-d755801f59db req-5098fe04-84bd-4c75-ba18-844d66e7a744 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0747612 Dec 21 04:02:37.763127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93479352-4c4a-4582-be26-5bb651c3303b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.765803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93479352-4c4a-4582-be26-5bb651c3303b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:37.767007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-93479352-4c4a-4582-be26-5bb651c3303b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/433e4925-5ab2-4954-ac9b-7222c55e5672 HTTP/1.1" status: 204 len: 168 time: 0.3531132 Dec 21 04:02:37.855996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93479352-4c4a-4582-be26-5bb651c3303b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=433e4925-5ab2-4954-ac9b-7222c55e5672,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:37.880489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6274be51-f168-43b9-9e3b-d755801f59db req-2ad1b4f4-4d94-4c43-8e62-5ec9581707bd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1795368 Dec 21 04:02:37.940398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cb2687-4d0e-4ff3-a3e6-27405fc195c3 req-03b3e7ec-3c1a-46e5-aefe-ab97013e742e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:37.942035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cb2687-4d0e-4ff3-a3e6-27405fc195c3 req-03b3e7ec-3c1a-46e5-aefe-ab97013e742e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 944 time: 0.3627343 Dec 21 04:02:38.030022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cb2687-4d0e-4ff3-a3e6-27405fc195c3 req-c6e960a4-f800-452b-8f29-3a55d656a19d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0811598 Dec 21 04:02:38.047881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8899b48-27a0-4ae4-9ee1-0bd2fcd86487 req-4057dfba-7701-4fbd-8258-63023da18969 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:38.049521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8899b48-27a0-4ae4-9ee1-0bd2fcd86487 req-4057dfba-7701-4fbd-8258-63023da18969 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 943 time: 0.0720980 Dec 21 04:02:38.115602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8899b48-27a0-4ae4-9ee1-0bd2fcd86487 req-77d8731f-0611-46db-883e-b3c127841edc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547726 Dec 21 04:02:38.319828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:02:38.494907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243af2fd-b705-45d3-b380-f06dd1a3eab1 req-3c663500-f6f1-41a1-85af-5155f03a6992 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:38.496281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:38.497307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-243af2fd-b705-45d3-b380-f06dd1a3eab1 req-3c663500-f6f1-41a1-85af-5155f03a6992 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0570383 Dec 21 04:02:38.536341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64', 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'port_id': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64', 'mac_address': 'fa:16:3e:fb:ea:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'af597cc9-d6ea-4007-b8f3-5cbc38b23a3a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:02:38.580452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42470) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:38.596847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52148203-8dec-45c8-9cc9-98830c23af70 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:38.604311 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:38.608059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-243af2fd-b705-45d3-b380-f06dd1a3eab1 req-3b0e0815-d9a8-4a91-919b-124261355c32 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1032329 Dec 21 04:02:38.619899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:38.642990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:38.674288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-95adca6d-1abf-4d77-ba78-21a1e9e34605 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:38.676395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-95adca6d-1abf-4d77-ba78-21a1e9e34605 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.0958643 Dec 21 04:02:38.719212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52148203-8dec-45c8-9cc9-98830c23af70 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:38.725780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:38.763646 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:38.790032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-12ef9961-8160-4dfd-bef9-516355d0eab5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:38.790032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-12ef9961-8160-4dfd-bef9-516355d0eab5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.1036472 Dec 21 04:02:38.810626 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52148203-8dec-45c8-9cc9-98830c23af70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:38.851259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:38.877192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52148203-8dec-45c8-9cc9-98830c23af70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b72804be-435c-46d1-9f71-623cd4d0ba90,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:38.882791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-52148203-8dec-45c8-9cc9-98830c23af70 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c5ee351bffc64035bbbfdd95c4161cea&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3012025 Dec 21 04:02:38.886714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:38.898617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-451af616-cbd3-49da-ba76-2761560b3c76 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.1011062 Dec 21 04:02:38.901375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:02:38.907372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:38.909280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.023379 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.027050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-6e04b590-0bb2-4c18-9732-261387926287 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:39.030921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-6e04b590-0bb2-4c18-9732-261387926287 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.1226997 Dec 21 04:02:39.066191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:39.069265 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f79321c-aad9-49b5-800b-5335349899cb" -d '{"events": [{"server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "name": "network-vif-plugged", "status": "completed", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:39.089956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:39.105078 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec1294d8-6264-4400-9408-d1ea9b4b5a07 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.128583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-06122e3f-e288-4cf3-9392-fb62aa44985b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:39.130579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-06122e3f-e288-4cf3-9392-fb62aa44985b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0894325 Dec 21 04:02:39.141087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5dea0ba1-f39e-4e5f-9a5d-e68097c71e64'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:02:39.149585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec1294d8-6264-4400-9408-d1ea9b4b5a07 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.169320 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-21609a94-e423-4477-b83a-3436c0c51705 x-openstack-request-id: req-21609a94-e423-4477-b83a-3436c0c51705 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:39.169621 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "name": "network-vif-plugged", "status": "completed", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:39.169900 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-21609a94-e423-4477-b83a-3436c0c51705 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:39.170506 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'code': 200} Dec 21 04:02:39.171766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.327392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:39.393507 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec1294d8-6264-4400-9408-d1ea9b4b5a07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.396161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec1294d8-6264-4400-9408-d1ea9b4b5a07 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:39.397399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ec1294d8-6264-4400-9408-d1ea9b4b5a07 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b72804be-435c-46d1-9f71-623cd4d0ba90 HTTP/1.1" status: 204 len: 168 time: 0.5086443 Dec 21 04:02:39.429978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec1294d8-6264-4400-9408-d1ea9b4b5a07 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b72804be-435c-46d1-9f71-623cd4d0ba90,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:39.443748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a8fce3-8af1-4295-8cda-9e0edb2169e4 req-0164fd16-18e6-4b03-a222-e4eeb3ecf087 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:39.451598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04a8fce3-8af1-4295-8cda-9e0edb2169e4 req-0164fd16-18e6-4b03-a222-e4eeb3ecf087 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2262533 Dec 21 04:02:39.490075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7530ed-ab9f-49dd-8d7e-3bfeb7cabdb1 req-4f8d570b-ca6e-4bf4-929d-b791577bbd5e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:39.507956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e7530ed-ab9f-49dd-8d7e-3bfeb7cabdb1 req-4f8d570b-ca6e-4bf4-929d-b791577bbd5e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 944 time: 0.2259812 Dec 21 04:02:39.529147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24117d3-99f8-4171-a056-aa63a2b40abd req-54347bfa-1ba5-455d-8f27-f82c8ce03fe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:39.530605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c24117d3-99f8-4171-a056-aa63a2b40abd req-54347bfa-1ba5-455d-8f27-f82c8ce03fe1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1097 time: 0.2555468 Dec 21 04:02:39.556239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-80746eaf-46aa-406a-954f-0b382179fa71 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3266256 Dec 21 04:02:39.644629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04a8fce3-8af1-4295-8cda-9e0edb2169e4 req-65308243-a349-4263-b646-a5ed615a2540 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1920791 Dec 21 04:02:39.693303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e7530ed-ab9f-49dd-8d7e-3bfeb7cabdb1 req-9bd067d4-0793-4e9b-a6f1-eef8de42fa6a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1920848 Dec 21 04:02:39.698327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c24117d3-99f8-4171-a056-aa63a2b40abd req-5a85758c-6bfc-4c20-af21-9fb8b289a6a7 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1504405 Dec 21 04:02:39.771300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfd54c1b-e992-49d8-9a9d-bc8eaae503e5 req-8e600355-00d2-4c04-a09f-dc3349a38b71 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1981401 Dec 21 04:02:39.872101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd447df9-ee1f-4d0a-8319-2727b9816809 req-c75d2c0a-47e3-4f68-9c99-9771630db5f1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:39.873687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd447df9-ee1f-4d0a-8319-2727b9816809 req-c75d2c0a-47e3-4f68-9c99-9771630db5f1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0677261 Dec 21 04:02:39.947462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd447df9-ee1f-4d0a-8319-2727b9816809 req-ff942c8e-1a26-487f-b733-2d6734f80974 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0611472 Dec 21 04:02:40.323229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:02:40.421753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:02:40.428010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:40.429153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:40.530837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:40.578530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:40.657059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:40.729119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:40.830512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2032ddec-603b-4bdc-80cb-4a34bdc6874e req-b8a6dc4c-d43f-4932-8518-2715425e816e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:40.832107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2032ddec-603b-4bdc-80cb-4a34bdc6874e req-b8a6dc4c-d43f-4932-8518-2715425e816e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0734308 Dec 21 04:02:40.903837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca97aba-eb0d-42e9-8943-d2090a262add req-d8b975b6-9705-4ee2-9bb3-0a743868c1f1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:40.905407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca97aba-eb0d-42e9-8943-d2090a262add req-d8b975b6-9705-4ee2-9bb3-0a743868c1f1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 945 time: 0.0936081 Dec 21 04:02:40.929417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2032ddec-603b-4bdc-80cb-4a34bdc6874e req-18140c14-647d-4960-933b-fab13027a2a9 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834310 Dec 21 04:02:40.997401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ca97aba-eb0d-42e9-8943-d2090a262add req-ef3f8857-46a9-4949-b77a-ae5d5eebbe4c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0833888 Dec 21 04:02:41.138961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f7abde-a7b1-40ec-941d-7fc2920fc540 req-d05c16f1-7184-45b2-afea-793924d37406 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:41.140529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31f7abde-a7b1-40ec-941d-7fc2920fc540 req-d05c16f1-7184-45b2-afea-793924d37406 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0677528 Dec 21 04:02:41.171408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6239db5b-27cc-4337-94cb-75a15300521e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:41.174262 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dbbdea30-4417-427e-aa06-91e0a1de5977" -d '{"events": [{"server_uuid": "6239db5b-27cc-4337-94cb-75a15300521e", "name": "network-vif-plugged", "status": "completed", "tag": "5dea0ba1-f39e-4e5f-9a5d-e68097c71e64"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:41.202276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31f7abde-a7b1-40ec-941d-7fc2920fc540 req-fd613bd5-e524-4eaf-8aee-df31f119d10e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0550008 Dec 21 04:02:41.236914 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22948daa-7479-419e-99b7-9780dd68b42b x-openstack-request-id: req-22948daa-7479-419e-99b7-9780dd68b42b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:41.237215 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6239db5b-27cc-4337-94cb-75a15300521e", "name": "network-vif-plugged", "status": "completed", "tag": "5dea0ba1-f39e-4e5f-9a5d-e68097c71e64", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:41.237475 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-22948daa-7479-419e-99b7-9780dd68b42b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:41.237877 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6239db5b-27cc-4337-94cb-75a15300521e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64', 'code': 200} Dec 21 04:02:41.360684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b4cafe-1de5-4f2c-a2ef-a5a3525b6e36 req-2ef5bdf4-914b-4fef-9d51-0b31efb1d179 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:41.362191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43b4cafe-1de5-4f2c-a2ef-a5a3525b6e36 req-2ef5bdf4-914b-4fef-9d51-0b31efb1d179 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0729709 Dec 21 04:02:41.428608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99138dee-22be-4914-a2ad-713c168bbcfc req-2eaaeeae-6e2b-49ef-af28-d201684300e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:41.430109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99138dee-22be-4914-a2ad-713c168bbcfc req-2eaaeeae-6e2b-49ef-af28-d201684300e6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 1097 time: 0.0859327 Dec 21 04:02:41.434010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43b4cafe-1de5-4f2c-a2ef-a5a3525b6e36 req-0732be1f-9f82-4f1b-8044-f2fd1ca5ed39 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577691 Dec 21 04:02:41.502379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99138dee-22be-4914-a2ad-713c168bbcfc req-863e7fef-b7be-484f-8234-30148c9a68a3 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641205 Dec 21 04:02:42.003109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac037a6-24ed-4907-9ed7-b81a32eab003 req-b186069b-4bbb-4f07-87f3-bf00b9854156 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:42.004639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ac037a6-24ed-4907-9ed7-b81a32eab003 req-b186069b-4bbb-4f07-87f3-bf00b9854156 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0542696 Dec 21 04:02:42.103571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8650c04d-abd2-4c74-8177-5b931c096268 req-13d6eadc-5e7c-4606-9009-14cdaf8c1b1c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:42.112203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8650c04d-abd2-4c74-8177-5b931c096268 req-13d6eadc-5e7c-4606-9009-14cdaf8c1b1c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1061857 Dec 21 04:02:42.142159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ac037a6-24ed-4907-9ed7-b81a32eab003 req-ffc2ce60-c905-48b0-aa9a-d19fcf170899 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1266229 Dec 21 04:02:42.239868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:42.254838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8650c04d-abd2-4c74-8177-5b931c096268 req-381316d9-197b-4bd1-87ab-c0a537f5c2d9 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1415439 Dec 21 04:02:42.355853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c7ba03-9ba5-4c9f-884d-d1bf1d5ce5d1 req-9863d4a8-5688-4b1b-80eb-c828eb150ab8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:42.357567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45c7ba03-9ba5-4c9f-884d-d1bf1d5ce5d1 req-9863d4a8-5688-4b1b-80eb-c828eb150ab8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 945 time: 0.1010194 Dec 21 04:02:42.424395 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a9a9d1be-d0c6-446a-af2c-ec440c831109 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:42.492867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45c7ba03-9ba5-4c9f-884d-d1bf1d5ce5d1 req-bf3de30f-c58c-484d-b10f-a17a4c3ac2e4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247425 Dec 21 04:02:42.617785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a9a9d1be-d0c6-446a-af2c-ec440c831109 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:42.686538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a0a2ef4-6a50-472b-b5f5-ba47bbddac9c req-9c984eaf-0d1b-42f8-9bfe-534dd9a545e9 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:42.688353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a0a2ef4-6a50-472b-b5f5-ba47bbddac9c req-9c984eaf-0d1b-42f8-9bfe-534dd9a545e9 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0899832 Dec 21 04:02:42.698208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:42.702941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'floatingip': {'port_id': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:42.752943 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:42.808941 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a9a9d1be-d0c6-446a-af2c-ec440c831109 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:42.896447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a9d1be-d0c6-446a-af2c-ec440c831109 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66ef30ce-15bd-4b50-b3a6-218db9682095,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:42.903984 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a9a9d1be-d0c6-446a-af2c-ec440c831109 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5b932ce37c4f4cd990dc746590307452&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6629939 Dec 21 04:02:42.910224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42590) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:42.959868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4fae418-9a7b-412f-91a6-850c9cd7cae8 req-baae75ec-a7a4-446e-9f1d-f681df0a5455 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:42.973229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4fae418-9a7b-412f-91a6-850c9cd7cae8 req-baae75ec-a7a4-446e-9f1d-f681df0a5455 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0852797 Dec 21 04:02:43.040693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4fae418-9a7b-412f-91a6-850c9cd7cae8 req-53c5dca4-f1d8-48eb-9176-cd19129d7857 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661366 Dec 21 04:02:43.089436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fef39ed4-e8ed-481d-a5b1-3a612aa8ef26 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:43.152363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fef39ed4-e8ed-481d-a5b1-3a612aa8ef26 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:43.488545 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:43.506425 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fef39ed4-e8ed-481d-a5b1-3a612aa8ef26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:43.511142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fef39ed4-e8ed-481d-a5b1-3a612aa8ef26 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:43.513096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fef39ed4-e8ed-481d-a5b1-3a612aa8ef26 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/66ef30ce-15bd-4b50-b3a6-218db9682095 HTTP/1.1" status: 204 len: 168 time: 0.6013768 Dec 21 04:02:43.523730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef39ed4-e8ed-481d-a5b1-3a612aa8ef26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66ef30ce-15bd-4b50-b3a6-218db9682095,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:43.638487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a63604-a3fb-4329-b278-34eee7df1280 req-b7069ee6-6798-4856-879d-5cbda7c39868 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:43.648160 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:43.649020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1a63604-a3fb-4329-b278-34eee7df1280 req-b7069ee6-6798-4856-879d-5cbda7c39868 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 945 time: 0.0616410 Dec 21 04:02:43.708154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1a63604-a3fb-4329-b278-34eee7df1280 req-91cf5b9e-a72c-46a8-ac6a-410ebe654dd9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617988 Dec 21 04:02:43.764343 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Floating IP 467f703f-0f38-48fb-8711-3429d6cde40b associated. External IP: 172.25.5.162, port: 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1. Dec 21 04:02:44.045500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:02:44.257560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:02:44.263628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:44.270177 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:02:44.288159 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:02:44.288867 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:02:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:44.302055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-625c46ed-96c7-4946-8606-686ee67f141b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "PUT /v2.0/floatingips/467f703f-0f38-48fb-8711-3429d6cde40b HTTP/1.1" status: 200 len: 991 time: 1.6027188 Dec 21 04:02:44.307159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:44.307321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb49cb4a-308c-43fa-b20a-07af1107bf92 req-eeb0ecc8-4353-4be2-bea3-4c0c33d26d1c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:44.307321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb49cb4a-308c-43fa-b20a-07af1107bf92 req-eeb0ecc8-4353-4be2-bea3-4c0c33d26d1c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 945 time: 0.0783982 Dec 21 04:02:44.313192 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9" -d '{"events": [{"name": "network-changed", "server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:44.313381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c0728c-578f-44cc-b08b-dbdab8202a1d req-337dfcfe-53de-4e08-87a5-657aa3602e76 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:44.319592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18c0728c-578f-44cc-b08b-dbdab8202a1d req-337dfcfe-53de-4e08-87a5-657aa3602e76 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1334360 Dec 21 04:02:44.441657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb49cb4a-308c-43fa-b20a-07af1107bf92 req-3a70f8de-c0f7-490e-b45a-2802d14b8252 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164017 Dec 21 04:02:44.441810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:02:44.482595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18c0728c-578f-44cc-b08b-dbdab8202a1d req-27f693d6-6d37-4827-b499-2d3b00e7636b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1518531 Dec 21 04:02:44.509742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:44.545780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18b89934-0dad-4a03-b837-d0ed613ec8bb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:44.605170 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab670a50-b5e9-450f-bc9d-05466d016048 x-openstack-request-id: req-ab670a50-b5e9-450f-bc9d-05466d016048 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:44.605820 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:44.606347 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ab670a50-b5e9-450f-bc9d-05466d016048 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:44.607005 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'status': 'completed', 'code': 200} Dec 21 04:02:44.780215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-0d4dec46-025c-431c-8f7d-5c4ae5e153d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:44.782467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-0d4dec46-025c-431c-8f7d-5c4ae5e153d7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1097 time: 0.1214576 Dec 21 04:02:44.831439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18b89934-0dad-4a03-b837-d0ed613ec8bb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:44.879755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '467f703f-0f38-48fb-8711-3429d6cde40b', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'floating_ip_address': '172.25.5.162', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'port_id': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 2258, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'mac_address': 'fa:16:3e:68:02:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:02:23Z', 'updated_at': '2021-12-21T04:02:43Z', 'revision_number': 1, 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:44.916918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:02:44.924635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-18b89934-0dad-4a03-b837-d0ed613ec8bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:44.924889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-6079f4e7-8811-416d-a75c-f1d52d0ee480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:44.926988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-6079f4e7-8811-416d-a75c-f1d52d0ee480 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 912 time: 0.1356735 Dec 21 04:02:44.992968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:02:44.995778 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:02:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:44.998515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-18b89934-0dad-4a03-b837-d0ed613ec8bb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0f3aeda46a6f42cb83da0d0522a5108a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4875085 Dec 21 04:02:44.999409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b89934-0dad-4a03-b837-d0ed613ec8bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b6c73de-d982-49e0-97d1-106a1e7bbea7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:45.015438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:45.084528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c0483e4-f17b-4b60-a309-e594b82abf8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:45.100905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-f4a082e1-9498-41f8-a42b-247efa5100a8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 200 len: 999 time: 0.1648977 Dec 21 04:02:45.117896 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c0483e4-f17b-4b60-a309-e594b82abf8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:45.216954 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:02:45.251069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c92baf-6670-4bdc-813a-1257fada81fd req-8cb56c43-09e8-484f-a747-940b5dda99aa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:45.259400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9c92baf-6670-4bdc-813a-1257fada81fd req-8cb56c43-09e8-484f-a747-940b5dda99aa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1575406 Dec 21 04:02:45.273277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c0483e4-f17b-4b60-a309-e594b82abf8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:45.274072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-06255ae6-1b98-4340-8302-fbabe9b92b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:45.275940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c0483e4-f17b-4b60-a309-e594b82abf8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:45.277945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-06255ae6-1b98-4340-8302-fbabe9b92b67 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.1247439 Dec 21 04:02:45.278108 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c0483e4-f17b-4b60-a309-e594b82abf8d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1b6c73de-d982-49e0-97d1-106a1e7bbea7 HTTP/1.1" status: 204 len: 168 time: 0.2604744 Dec 21 04:02:45.296660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0483e4-f17b-4b60-a309-e594b82abf8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b6c73de-d982-49e0-97d1-106a1e7bbea7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:45.369848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9c92baf-6670-4bdc-813a-1257fada81fd req-8e6741ef-e2a1-4d11-bd03-dbbceb4145f7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1046922 Dec 21 04:02:45.372806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-e97d90cc-0296-44d7-b3b3-465a5be7c660 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:45.374629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-e97d90cc-0296-44d7-b3b3-465a5be7c660 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0843332 Dec 21 04:02:45.595253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-aba48a7d-a01b-4e3a-9e7b-483ac3c63d34 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2083175 Dec 21 04:02:45.627005 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '467f703f-0f38-48fb-8711-3429d6cde40b', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'floating_ip_address': '172.25.5.162', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'port_id': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 2258, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'mac_address': 'fa:16:3e:68:02:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:02:23Z', 'updated_at': '2021-12-21T04:02:43Z', 'revision_number': 1, 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:02:45.679385 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10ed21c8-6392-4489-917e-e6190ebaec8f None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '467f703f-0f38-48fb-8711-3429d6cde40b', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'floating_ip_address': '172.25.5.162', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'port_id': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 2258, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'mac_address': 'fa:16:3e:68:02:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:02:23Z', 'updated_at': '2021-12-21T04:02:43Z', 'revision_number': 1, 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:02:45.967392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fa8d615-79b0-475a-b761-7e4917eeabba None None] New status for floating IP 467f703f-0f38-48fb-8711-3429d6cde40b: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:02:46.145627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e69533-d018-4270-911a-c6c4471bee2c req-322a62a3-8cd6-407b-94a4-7cfb5a797d3d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:46.147132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9e69533-d018-4270-911a-c6c4471bee2c req-322a62a3-8cd6-407b-94a4-7cfb5a797d3d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 945 time: 0.5059884 Dec 21 04:02:46.179956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc482a20-04f9-4bba-b7e4-76b9d2b3fbf9 req-6ccd3ab1-e252-4993-8a2c-ade1e9dee040 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5583210 Dec 21 04:02:46.190846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-24bc0fa9-f9b1-4138-947f-df8c4150250f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:46.192310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-24bc0fa9-f9b1-4138-947f-df8c4150250f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.54 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 945 time: 0.4377527 Dec 21 04:02:46.216484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:46.229490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9e69533-d018-4270-911a-c6c4471bee2c req-71fcdfa9-6775-40fe-bee7-c092a453e26b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721838 Dec 21 04:02:46.261797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c5c7821-b763-463c-b27c-9d44091e25af admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.341384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Deleting port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:02:46.341834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.371341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c5c7821-b763-463c-b27c-9d44091e25af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.444608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c5c7821-b763-463c-b27c-9d44091e25af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.499249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] For port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:02:46.499833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.504363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5c7821-b763-463c-b27c-9d44091e25af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f56bc6a4-f980-41f3-9976-a01fd687d42c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:46.509504 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c5c7821-b763-463c-b27c-9d44091e25af admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d841f22eaa704294a4a4b867930d2f04&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2858193 Dec 21 04:02:46.512890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:02:46.518060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Calling delete_port for 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:02:46.538790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8746f0e-18b7-4920-bb4f-393d30382881 req-55d07246-e940-4fe1-9f50-f8ccff56ef7b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:46.540467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8746f0e-18b7-4920-bb4f-393d30382881 req-55d07246-e940-4fe1-9f50-f8ccff56ef7b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0882354 Dec 21 04:02:46.569643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-734da2c7-b5d1-4442-bbaa-a023d9ff4d56 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.594575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-734da2c7-b5d1-4442-bbaa-a023d9ff4d56 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.643491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8746f0e-18b7-4920-bb4f-393d30382881 req-1af622a7-e9b1-4768-bc17-9c8cf457cf32 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0652082 Dec 21 04:02:46.754225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-734da2c7-b5d1-4442-bbaa-a023d9ff4d56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.757032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-734da2c7-b5d1-4442-bbaa-a023d9ff4d56 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.758261 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-734da2c7-b5d1-4442-bbaa-a023d9ff4d56 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f56bc6a4-f980-41f3-9976-a01fd687d42c HTTP/1.1" status: 204 len: 168 time: 0.2445681 Dec 21 04:02:46.792223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-734da2c7-b5d1-4442-bbaa-a023d9ff4d56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f56bc6a4-f980-41f3-9976-a01fd687d42c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:46.890058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:46.924836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['22270d5e-6f54-41c2-a9eb-fd2c24aef262'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:02:46.946393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Pushing event deleted for resources: {'Port': ['ID=5dea0ba1-f39e-4e5f-9a5d-e68097c71e64,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:46.978142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de801db-2fe1-4184-9a35-9afdd4dbc0d5 req-bd688117-360b-4dc3-baa1-b9a29b135144 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:46.987924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0de801db-2fe1-4184-9a35-9afdd4dbc0d5 req-bd688117-360b-4dc3-baa1-b9a29b135144 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1453230 Dec 21 04:02:47.052772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] No DVR routers for this DVR port 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:02:47.060153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:47.063766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85beb3d6-b03a-4eca-91c4-90d8e606303a req-e1ad574e-7985-4ed9-b029-3c78928837fa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.54 "DELETE /v2.0/ports/5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 HTTP/1.1" status: 204 len: 173 time: 0.8602264 Dec 21 04:02:47.064297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6239db5b-27cc-4337-94cb-75a15300521e', 'name': 'network-vif-deleted', 'tag': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:47.071639 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e367139e-82ae-48c7-98af-8533307cb84c" -d '{"events": [{"server_uuid": "6239db5b-27cc-4337-94cb-75a15300521e", "name": "network-vif-deleted", "tag": "5dea0ba1-f39e-4e5f-9a5d-e68097c71e64"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:47.125544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0de801db-2fe1-4184-9a35-9afdd4dbc0d5 req-ff00ee3f-989e-4978-a5ce-0463d05a39e3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1357286 Dec 21 04:02:47.127163 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ab16d7d-5953-4c7b-bc26-d2c89d7f5862 x-openstack-request-id: req-7ab16d7d-5953-4c7b-bc26-d2c89d7f5862 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:47.135482 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6239db5b-27cc-4337-94cb-75a15300521e", "name": "network-vif-deleted", "tag": "5dea0ba1-f39e-4e5f-9a5d-e68097c71e64", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:47.135482 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7ab16d7d-5953-4c7b-bc26-d2c89d7f5862 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:47.135482 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6239db5b-27cc-4337-94cb-75a15300521e', 'name': 'network-vif-deleted', 'tag': '5dea0ba1-f39e-4e5f-9a5d-e68097c71e64', 'status': 'completed', 'code': 200} Dec 21 04:02:47.253681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95723fc-070d-40c8-8b65-7f9060b215f0 req-1d08cdce-2666-4727-af3e-c4171c95c587 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:47.256128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b95723fc-070d-40c8-8b65-7f9060b215f0 req-1d08cdce-2666-4727-af3e-c4171c95c587 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0573831 Dec 21 04:02:47.344425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b95723fc-070d-40c8-8b65-7f9060b215f0 req-2d7af540-f69c-4f42-a5e2-313a22af034d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0747516 Dec 21 04:02:47.361563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3244a7cf-7cbd-4fa7-95d4-4953c6200891 req-3d92a144-4a23-46ba-842c-22c523d402d9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=6239db5b-27cc-4337-94cb-75a15300521e HTTP/1.1" status: 200 len: 210 time: 0.0313795 Dec 21 04:02:47.484168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1af618-b8ea-4c41-925a-4b7fb5ae1359 req-ce6da658-a24b-4147-be83-02d402d9230c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:47.485866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb1af618-b8ea-4c41-925a-4b7fb5ae1359 req-ce6da658-a24b-4147-be83-02d402d9230c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0569205 Dec 21 04:02:47.533499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb1af618-b8ea-4c41-925a-4b7fb5ae1359 req-97dd4635-269c-4082-af91-3e8ad370a4db tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414934 Dec 21 04:02:48.381176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:02:48.408166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:02:48.419916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5dea0ba1-f39e-4e5f-9a5d-e68097c71e64 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:02:48.618688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bd9ac8-4be3-4fe6-a419-30e38774c990 req-3a31ddcf-6c50-445c-8ba3-7178aa9caa43 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:48.620420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16bd9ac8-4be3-4fe6-a419-30e38774c990 req-3a31ddcf-6c50-445c-8ba3-7178aa9caa43 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0800264 Dec 21 04:02:48.675318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16bd9ac8-4be3-4fe6-a419-30e38774c990 req-27d325fd-1243-4b05-ac06-36b5cb53d24d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479591 Dec 21 04:02:48.932046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82662d40-909d-4ec8-9d86-9e367d3ab769 req-21f48aea-4fd7-4f0e-a7d5-2e941b6f1985 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:48.932046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82662d40-909d-4ec8-9d86-9e367d3ab769 req-21f48aea-4fd7-4f0e-a7d5-2e941b6f1985 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0626168 Dec 21 04:02:48.979024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82662d40-909d-4ec8-9d86-9e367d3ab769 req-af94a07f-e158-48e4-89d6-8f2e7178c8d0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425169 Dec 21 04:02:49.152323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bbce3d4-30ad-4f2c-89f2-8400d8fa83a9 req-aabb7b2e-6dbd-424f-9005-ef4e2b398b7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:49.154703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bbce3d4-30ad-4f2c-89f2-8400d8fa83a9 req-aabb7b2e-6dbd-424f-9005-ef4e2b398b7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0733588 Dec 21 04:02:49.205772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bbce3d4-30ad-4f2c-89f2-8400d8fa83a9 req-26809490-2e77-4ad1-9cf9-efbd2b7c6a89 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447710 Dec 21 04:02:49.838403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48d833e3-df63-4b7f-bbab-bd5e731ccd86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:50.643115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-39596473-d44f-4c52-a0d4-c61c6d939656 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1581018 Dec 21 04:02:50.722924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-e00c89df-1fa0-41cf-a4ab-09a926022561 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:50.725101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-e00c89df-1fa0-41cf-a4ab-09a926022561 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 1097 time: 0.0481663 Dec 21 04:02:50.772561 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:02:50.835748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-31e29573-0d2c-4b36-bd13-88674312d0a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:50.837287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-31e29573-0d2c-4b36-bd13-88674312d0a5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.0906994 Dec 21 04:02:50.884587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-581ee373-951b-487e-8863-236ed0acb64b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3 HTTP/1.1" status: 200 len: 217 time: 0.0394895 Dec 21 04:02:50.942682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-2229a38a-2082-4cda-82cd-94de7d02b563 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:50.944174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-2229a38a-2082-4cda-82cd-94de7d02b563 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0518076 Dec 21 04:02:51.004962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-bb455be4-d67f-4a2b-86b6-824d158bbe74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:51.004962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-bb455be4-d67f-4a2b-86b6-824d158bbe74 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0529587 Dec 21 04:02:51.017077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-7aab0888-f925-4145-bb3d-8e4723c752bd service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:02:51.018194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-7aab0888-f925-4145-bb3d-8e4723c752bd service neutron] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0069439 Dec 21 04:02:51.252815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-ead1a705-aeba-40e8-88ed-2b96b0d6f4da service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2260220 Dec 21 04:02:51.412878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-31a2698b-0936-4764-8dfc-f517170498db tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0318244 Dec 21 04:02:51.508978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e81033ae-bbad-4bc7-beb4-f309d173eeb6 req-58aca65e-edee-46a8-88a9-aff0d3619189 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2453046 Dec 21 04:02:51.560045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-70d3944c-dc81-456c-8e6f-f395a311bf8f tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:51.578628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-70d3944c-dc81-456c-8e6f-f395a311bf8f tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1573002 Dec 21 04:02:51.602285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-eddfb68f-97e9-4629-a894-40f00ccb7f49 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/quotas/4a7dada2843b4b8ebc5bf3ad0d1ca323 HTTP/1.1" status: 200 len: 375 time: 0.0127649 Dec 21 04:02:51.650554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-e04352a7-3f7b-4e88-aab9-fa59762f1d53 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0298297 Dec 21 04:02:52.007015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a72b1d74-69cf-4b47-a603-0b1bd531c777 req-c1d9d2f7-fbd7-4235-a11b-f1a2a281a487 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 210 time: 0.0483782 Dec 21 04:02:52.644649 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12200988-058a-4373-ad50-c507b2c7f976 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:52.667748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4466d3f-7c76-4cd4-96c8-efe39950d5c4 req-6b1d393b-9dda-456b-a2d8-9096809933c4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:52.670739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4466d3f-7c76-4cd4-96c8-efe39950d5c4 req-6b1d393b-9dda-456b-a2d8-9096809933c4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0852561 Dec 21 04:02:52.712834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:52.732368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4466d3f-7c76-4cd4-96c8-efe39950d5c4 req-03113688-d798-4fa5-9b9a-a0656bccbd4a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525422 Dec 21 04:02:52.863209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65a8c64-4135-4b2e-9b80-789dd8070f1a req-acf3ed2c-8370-4ce1-a377-b0be18970249 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:52.864744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b65a8c64-4135-4b2e-9b80-789dd8070f1a req-acf3ed2c-8370-4ce1-a377-b0be18970249 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0571392 Dec 21 04:02:52.914357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b65a8c64-4135-4b2e-9b80-789dd8070f1a req-86c150a0-6a59-44e2-aea5-7be79db70354 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436242 Dec 21 04:02:53.108523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e95677be-ead8-4c11-812e-3b94da0bbe21 req-eb7d69b6-d4a8-4845-b49d-39b6db124aa7 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 210 time: 0.0432312 Dec 21 04:02:53.233066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:54.247748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba5e2cf2-c0e8-4031-a126-d11306b6bf96 req-a2f3844d-48d8-4a4f-97b3-160b719aeeb8 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 210 time: 0.0412340 Dec 21 04:02:54.412896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-89f0a150-9ada-496f-96ed-439c0f0e83ef tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0228610 Dec 21 04:02:54.542015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-c9550b9f-3e2e-4f96-a0b5-6d85264afa35 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:54.547097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-c9550b9f-3e2e-4f96-a0b5-6d85264afa35 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1272984 Dec 21 04:02:54.567637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Request body: {'port': {'device_id': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '4a7dada2843b4b8ebc5bf3ad0d1ca323'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:54.833062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Made reservation on behalf of 4a7dada2843b4b8ebc5bf3ad0d1ca323 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:02:54.837416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:54.852302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:54.937244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:54.941150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.020361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.020606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.086199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Pushing event updated for resources: {'SecurityGroup': ['ID=30573428-f065-4528-acff-5fd7f7833238,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:55.172402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Allocated IP 192.168.233.177 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/a761ad76-7a71-4f42-bf0b-abda41f2df0e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:02:55.337891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.359327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82093339-8178-438b-adef-e5ecb1bba461 req-d5f019a6-a419-45d8-b107-62a8300ceb19 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 210 time: 0.0401688 Dec 21 04:02:55.517794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.566749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:02:55.570010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:02:55.573695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:02:55.580839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Pushing event updated for resources: {'Port': ['ID=a761ad76-7a71-4f42-bf0b-abda41f2df0e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:55.652944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:55.653639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.717389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.778848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-b04c03d6-40a8-4b7f-a898-262d4d9b3aae tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.2162197 Dec 21 04:02:55.805629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Request body: {'port': {'device_id': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:02:55.891546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d5b1f4ea-f75e-42e8-9460-edb2559df504 None None] Provisioning complete for port a761ad76-7a71-4f42-bf0b-abda41f2df0e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:02:55.892195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5b1f4ea-f75e-42e8-9460-edb2559df504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.914861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb0e040-4995-4427-a63f-ea1ac4504269 req-9601bbea-9704-41ee-83ef-d1ee1e9ab038 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:55.916390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6cb0e040-4995-4427-a63f-ea1ac4504269 req-9601bbea-9704-41ee-83ef-d1ee1e9ab038 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1256154 Dec 21 04:02:55.919761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:55.936910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d5b1f4ea-f75e-42e8-9460-edb2559df504 None None] Port a761ad76-7a71-4f42-bf0b-abda41f2df0e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:02:56.009682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6cb0e040-4995-4427-a63f-ea1ac4504269 req-56157e5e-a377-48ec-9bb0-bfd51ef21487 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804260 Dec 21 04:02:56.202494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e364ab47-bbdb-4763-8268-bc058055b275 req-decbef11-bbeb-48f9-bb17-210e99f84200 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:56.204019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e364ab47-bbdb-4763-8268-bc058055b275 req-decbef11-bbeb-48f9-bb17-210e99f84200 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1086683 Dec 21 04:02:56.292446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e364ab47-bbdb-4763-8268-bc058055b275 req-91fed196-f61f-4cc1-9d70-d8a631506732 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783160 Dec 21 04:02:56.303766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a761ad76-7a71-4f42-bf0b-abda41f2df0e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:02:56.311674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:56.330000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Transition to ACTIVE for port object a761ad76-7a71-4f42-bf0b-abda41f2df0e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:02:56.421839 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:56.546445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Pushing event updated for resources: {'Port': ['ID=a761ad76-7a71-4f42-bf0b-abda41f2df0e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.600604 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:02:56.603666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d46aac-262d-4ce6-a2f1-69319bd63b46 req-b2507ca0-ea7e-420b-a859-12f66ad9384f tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:56.608915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57d46aac-262d-4ce6-a2f1-69319bd63b46 req-b2507ca0-ea7e-420b-a859-12f66ad9384f tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 948 time: 0.1621478 Dec 21 04:02:56.640221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09c7af6f-a5a3-46bd-ab5e-768332f0e947 req-f639ef9b-cb97-4265-b88b-8e641b5bab27 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:56.641378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09c7af6f-a5a3-46bd-ab5e-768332f0e947 req-f639ef9b-cb97-4265-b88b-8e641b5bab27 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1779869 Dec 21 04:02:56.706112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Attempting to bind port a761ad76-7a71-4f42-bf0b-abda41f2df0e on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:02:56.706454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Attempting to bind port a761ad76-7a71-4f42-bf0b-abda41f2df0e by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:02:56.706787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Attempting to bind port a761ad76-7a71-4f42-bf0b-abda41f2df0e on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:56.727983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57d46aac-262d-4ce6-a2f1-69319bd63b46 req-044795ca-1650-41ff-af20-6b9bb37fb937 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1130421 Dec 21 04:02:56.731776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Port a761ad76-7a71-4f42-bf0b-abda41f2df0e on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:02:56.732103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Attempting to bind port a761ad76-7a71-4f42-bf0b-abda41f2df0e on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:02:56.749061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 2, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:02:56.749463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:02:56.749860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:02:56.750343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Bound port: a761ad76-7a71-4f42-bf0b-abda41f2df0e, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:02:56.750741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:56.758303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09c7af6f-a5a3-46bd-ab5e-768332f0e947 req-2b268498-c091-48fa-aa2e-b1ef450293d6 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1090074 Dec 21 04:02:56.837643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] For port a761ad76-7a71-4f42-bf0b-abda41f2df0e, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:02:56.842716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] For port a761ad76-7a71-4f42-bf0b-abda41f2df0e, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a761ad76-7a71-4f42-bf0b-abda41f2df0e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:02:56.890225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e8c584-46fa-4cec-a107-4902fa46d5d7 req-2b75c58f-021f-42bf-a502-0706696d004f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:56.891835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45e8c584-46fa-4cec-a107-4902fa46d5d7 req-2b75c58f-021f-42bf-a502-0706696d004f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0516078 Dec 21 04:02:56.931428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:57.000118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45e8c584-46fa-4cec-a107-4902fa46d5d7 req-a1057b0e-7480-4d04-8e84-c8d8e7979c17 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002665 Dec 21 04:02:57.013202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.017462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:02:57.017462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] 10.222.0.54 "PUT /v2.0/ports/a761ad76-7a71-4f42-bf0b-abda41f2df0e HTTP/1.1" status: 200 len: 1097 time: 1.2147686 Dec 21 04:02:57.017462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'tag': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:02:57.022756 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebd470d2-9486-4db6-9370-3e929db53061" -d '{"events": [{"name": "network-changed", "server_uuid": "11d142e7-fdae-4da8-9df0-a2aa0495170b", "tag": "a761ad76-7a71-4f42-bf0b-abda41f2df0e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:02:57.057617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99497664-c817-4f1d-9a0e-27ab21ee7f87 service neutron] Pushing event updated for resources: {'Port': ['ID=a761ad76-7a71-4f42-bf0b-abda41f2df0e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:02:57.082334 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:02:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bb2f368-b697-4be4-aece-add914247f87 x-openstack-request-id: req-4bb2f368-b697-4be4-aece-add914247f87 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:02:57.082658 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "11d142e7-fdae-4da8-9df0-a2aa0495170b", "tag": "a761ad76-7a71-4f42-bf0b-abda41f2df0e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:02:57.082975 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4bb2f368-b697-4be4-aece-add914247f87 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:02:57.083388 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'tag': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e', 'status': 'completed', 'code': 200} Dec 21 04:02:57.217458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd470d2-9486-4db6-9370-3e929db53061 req-ba1bfcdf-9385-4b66-9c21-03e1fd80c530 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.218443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebd470d2-9486-4db6-9370-3e929db53061 req-ba1bfcdf-9385-4b66-9c21-03e1fd80c530 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 1100 time: 0.0890825 Dec 21 04:02:57.235661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e82dd6-7a04-483d-ad9a-5400ec0e6eb2 req-38b5ad0a-b4f0-488e-9239-42e7a141952d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.237213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01e82dd6-7a04-483d-ad9a-5400ec0e6eb2 req-38b5ad0a-b4f0-488e-9239-42e7a141952d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0657837 Dec 21 04:02:57.270274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebd470d2-9486-4db6-9370-3e929db53061 req-4099ef8b-63e0-4de2-9b91-60dae540d68e service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0320687 Dec 21 04:02:57.365908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01e82dd6-7a04-483d-ad9a-5400ec0e6eb2 req-77df787c-39fc-4387-a986-e5c35140b510 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1167147 Dec 21 04:02:57.397973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd470d2-9486-4db6-9370-3e929db53061 req-e0fbd9c8-412d-4716-8326-1bfe19f84b37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.399612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebd470d2-9486-4db6-9370-3e929db53061 req-e0fbd9c8-412d-4716-8326-1bfe19f84b37 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1197248 Dec 21 04:02:57.541506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d57288e-878e-499b-9e52-c6dc3fbba1b8 req-a9603ec8-2e77-42ec-bb53-ae05b91b30fe tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.544395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d57288e-878e-499b-9e52-c6dc3fbba1b8 req-a9603ec8-2e77-42ec-bb53-ae05b91b30fe tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0877497 Dec 21 04:02:57.546493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-4850c3eb-5a3a-4896-9d66-749811ed7ea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.547949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-4850c3eb-5a3a-4896-9d66-749811ed7ea8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 1100 time: 0.0820913 Dec 21 04:02:57.602915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-5a352462-7686-465b-b020-f11fc6ffb371 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.177&port_id=a761ad76-7a71-4f42-bf0b-abda41f2df0e HTTP/1.1" status: 200 len: 217 time: 0.0378060 Dec 21 04:02:57.663371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d57288e-878e-499b-9e52-c6dc3fbba1b8 req-d6f2e7b3-956f-462a-b24d-3324c25db16c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1123803 Dec 21 04:02:57.673485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-0f55788f-ccc0-4805-8df4-a3380dd96376 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.675169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-0f55788f-ccc0-4805-8df4-a3380dd96376 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0633008 Dec 21 04:02:57.742228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-f146e9e3-6103-44ab-b6c8-f0b93adcc5c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.744524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-f146e9e3-6103-44ab-b6c8-f0b93adcc5c6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0606272 Dec 21 04:02:57.923695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8af272-959c-4627-92b5-66c59033e5e5 req-e7e96e7b-6719-4661-83d0-b4c4bca81c25 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.925184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d8af272-959c-4627-92b5-66c59033e5e5 req-e7e96e7b-6719-4661-83d0-b4c4bca81c25 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1024680 Dec 21 04:02:57.927057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-c2f73794-bebe-4f33-91d0-de8fe1aa52c7 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1760025 Dec 21 04:02:57.961846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a2625b-3e6d-4677-8dd2-9d92c0a548c4 req-5994b812-caa7-4a91-ae62-52b5bbf287eb tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:57.963307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1a2625b-3e6d-4677-8dd2-9d92c0a548c4 req-5994b812-caa7-4a91-ae62-52b5bbf287eb tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 948 time: 0.1394970 Dec 21 04:02:58.071380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d8af272-959c-4627-92b5-66c59033e5e5 req-c08f1db6-9cfd-4e5a-b78e-786fa2a34837 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1401668 Dec 21 04:02:58.104723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1a2625b-3e6d-4677-8dd2-9d92c0a548c4 req-b0dd3651-8c43-454d-a748-2cf1390b1aa4 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1301870 Dec 21 04:02:58.137821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-471a47b4-9f15-4339-a7e0-ab954b55e6e0 req-0fb6f479-a7a2-4d7e-9f51-dc3ace084a41 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2021589 Dec 21 04:02:58.300462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc08ce55-3a7a-43ad-8c44-bb916f3fc38c req-b7be445e-e7dd-4b20-90cb-be6469f68ef8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:58.302062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc08ce55-3a7a-43ad-8c44-bb916f3fc38c req-b7be445e-e7dd-4b20-90cb-be6469f68ef8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0513022 Dec 21 04:02:58.349812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc08ce55-3a7a-43ad-8c44-bb916f3fc38c req-a8225f1c-f9f9-4b8e-a28f-912b22cc093e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414650 Dec 21 04:02:58.521326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d893f66-7fad-446e-81ca-f62abd515018 req-d77d81ed-df12-4c7c-b115-a8a2aa6a2f30 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:58.522785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d893f66-7fad-446e-81ca-f62abd515018 req-d77d81ed-df12-4c7c-b115-a8a2aa6a2f30 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0508838 Dec 21 04:02:58.575822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d893f66-7fad-446e-81ca-f62abd515018 req-29832256-9d48-4375-8289-f1a6b8f34e48 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435591 Dec 21 04:02:58.709078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c934516d-8d0e-4726-a19e-5804c3de3e2f req-d58f2370-fb0a-432e-89ad-f944d95fc965 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:58.710683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c934516d-8d0e-4726-a19e-5804c3de3e2f req-d58f2370-fb0a-432e-89ad-f944d95fc965 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0552385 Dec 21 04:02:58.762442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c934516d-8d0e-4726-a19e-5804c3de3e2f req-579453f1-8554-4753-b888-b9c6a9642f53 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443640 Dec 21 04:02:59.094612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ffa73f-5838-4f28-9eff-fe313a718a22 req-43ace6fb-b2e9-48b2-b6f0-e09e522f4c25 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:59.094612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ffa73f-5838-4f28-9eff-fe313a718a22 req-43ace6fb-b2e9-48b2-b6f0-e09e522f4c25 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0539138 Dec 21 04:02:59.094612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ffa73f-5838-4f28-9eff-fe313a718a22 req-52473200-157e-4f70-90c9-c4047998ffce tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481689 Dec 21 04:02:59.121489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf606e1c-3750-40d0-b81d-c776a81af649 req-64a002c1-e333-4370-98e1-3abee55bb60c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:59.122782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf606e1c-3750-40d0-b81d-c776a81af649 req-64a002c1-e333-4370-98e1-3abee55bb60c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0581377 Dec 21 04:02:59.212132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf606e1c-3750-40d0-b81d-c776a81af649 req-d2fd5aa4-0c80-4c32-955e-ca9b775f35b3 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822511 Dec 21 04:02:59.258179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6533f2c4-408c-4cc4-8ec4-d6b3cce66f9f req-bd2b1d4d-6e27-4420-a06b-1d2d09cfd4fe tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:59.259745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6533f2c4-408c-4cc4-8ec4-d6b3cce66f9f req-bd2b1d4d-6e27-4420-a06b-1d2d09cfd4fe tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 948 time: 0.0625184 Dec 21 04:02:59.315558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6533f2c4-408c-4cc4-8ec4-d6b3cce66f9f req-081a8d35-0f94-4f25-b02d-475f9a91dc86 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477197 Dec 21 04:02:59.497686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a649a8-8451-4ef3-b922-bfd2cf65c783 req-ed852c3c-d68c-4be3-9683-a2fc061c5b7f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:59.499152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1a649a8-8451-4ef3-b922-bfd2cf65c783 req-ed852c3c-d68c-4be3-9683-a2fc061c5b7f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 814 time: 0.1089709 Dec 21 04:02:59.515660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1a649a8-8451-4ef3-b922-bfd2cf65c783 req-763cf8bc-2661-4aab-827f-5ba818c20062 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/quotas/9be1447e894c4d89ae0d884935aafca9 HTTP/1.1" status: 200 len: 375 time: 0.0097668 Dec 21 04:02:59.564450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1a649a8-8451-4ef3-b922-bfd2cf65c783 req-87e04921-c572-40da-ae84-41bb84572c96 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0427957 Dec 21 04:02:59.676630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff5d71d3-3f01-4595-86d5-6007530f5a10 req-a76499ca-4a91-4a97-aee4-7a9818d77110 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:59.678151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff5d71d3-3f01-4595-86d5-6007530f5a10 req-a76499ca-4a91-4a97-aee4-7a9818d77110 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0516789 Dec 21 04:02:59.728705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff5d71d3-3f01-4595-86d5-6007530f5a10 req-bac0ff25-92aa-43f5-a6d9-8d6441d0c9fc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425165 Dec 21 04:02:59.856154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50564cd3-4165-4e9c-9613-7549cf4fe45c req-f45b4fb9-9f81-4f9b-8ec5-15d769430cc2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:02:59.857904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50564cd3-4165-4e9c-9613-7549cf4fe45c req-f45b4fb9-9f81-4f9b-8ec5-15d769430cc2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0560975 Dec 21 04:02:59.906566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50564cd3-4165-4e9c-9613-7549cf4fe45c req-bfbf464c-a004-48ef-b1bd-8fc516bf9601 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422742 Dec 21 04:03:00.060897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f913c9dd-df6f-4975-850a-6e85269137fe req-3fea3356-66fc-4d37-a52c-19a8d14d4726 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?name=does_not_exist&fields=id&tenant_id=9be1447e894c4d89ae0d884935aafca9 HTTP/1.1" status: 200 len: 221 time: 0.0258982 Dec 21 04:03:00.173356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a744e1eb-a322-4b91-acc8-43311f0b1ecc req-356b531b-fac8-4ef8-91bb-0039e7f9a96d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:00.175521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a744e1eb-a322-4b91-acc8-43311f0b1ecc req-356b531b-fac8-4ef8-91bb-0039e7f9a96d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0508213 Dec 21 04:03:00.245201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a744e1eb-a322-4b91-acc8-43311f0b1ecc req-a7652e3d-c678-4c6d-aad8-d4adafcf80ca tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531499 Dec 21 04:03:00.389161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de40d5aa-1c17-4a58-a24c-33c71ae39364 req-19f31471-c44d-4c7a-9f92-162ac0824b74 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:00.390789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de40d5aa-1c17-4a58-a24c-33c71ae39364 req-19f31471-c44d-4c7a-9f92-162ac0824b74 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0676556 Dec 21 04:03:00.413467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a761ad76-7a71-4f42-bf0b-abda41f2df0e details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:03:00.594051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port a761ad76-7a71-4f42-bf0b-abda41f2df0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a761ad76-7a71-4f42-bf0b-abda41f2df0e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:00.607681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e', 'mac_address': 'fa:16:3e:3c:0c:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.177'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:03:00.655165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:00.685082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a761ad76-7a71-4f42-bf0b-abda41f2df0e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:03:00.708438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port a761ad76-7a71-4f42-bf0b-abda41f2df0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a761ad76-7a71-4f42-bf0b-abda41f2df0e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:00.781444 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:00.813835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de40d5aa-1c17-4a58-a24c-33c71ae39364 req-ccc835e6-ee33-4a4b-a8ed-4f25b24d85e5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4163790 Dec 21 04:03:00.838811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f058af9-a05e-4633-bf87-2bf543aab814 req-31c46292-0ef4-4936-a8d5-f308e40a1f47 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:00.840302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f058af9-a05e-4633-bf87-2bf543aab814 req-31c46292-0ef4-4936-a8d5-f308e40a1f47 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 948 time: 0.0890741 Dec 21 04:03:00.865259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=a761ad76-7a71-4f42-bf0b-abda41f2df0e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:00.917461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f058af9-a05e-4633-bf87-2bf543aab814 req-7ebb3d40-bc68-4ae0-bf0a-3e62154ef88b tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617034 Dec 21 04:03:01.061144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea281131-584e-402b-b697-283f80340988 req-fc199369-6913-4412-91e8-311f4736ae7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:01.062868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea281131-584e-402b-b697-283f80340988 req-fc199369-6913-4412-91e8-311f4736ae7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0549088 Dec 21 04:03:01.114099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea281131-584e-402b-b697-283f80340988 req-71a032ff-c20d-4931-b99e-4b9e83b6b915 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450544 Dec 21 04:03:01.150722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['a761ad76-7a71-4f42-bf0b-abda41f2df0e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:03:01.237221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d3791e2-ff0f-41da-8b73-eb04d25f8240 req-08e70ffb-e970-4182-98ee-d697dbb5a5cc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:01.238783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d3791e2-ff0f-41da-8b73-eb04d25f8240 req-08e70ffb-e970-4182-98ee-d697dbb5a5cc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0518434 Dec 21 04:03:01.287711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d3791e2-ff0f-41da-8b73-eb04d25f8240 req-e5e4eeea-b554-4bc2-b966-d4271b47774f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427439 Dec 21 04:03:01.438481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd61af1-45fc-429a-b432-fcab08b50eac req-9d8f9fc9-f826-46b1-945a-7fbd7245a2f1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:01.440104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdd61af1-45fc-429a-b432-fcab08b50eac req-9d8f9fc9-f826-46b1-945a-7fbd7245a2f1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0635607 Dec 21 04:03:01.499434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdd61af1-45fc-429a-b432-fcab08b50eac req-bc21ac27-68fe-4e9b-8034-f05b2c45c9b5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506847 Dec 21 04:03:01.628500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1f78c7-bd63-472b-9229-8745f8ff7539 req-55e961a0-c748-47d2-aaf8-003993f1fa20 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:01.629971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c1f78c7-bd63-472b-9229-8745f8ff7539 req-55e961a0-c748-47d2-aaf8-003993f1fa20 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0550978 Dec 21 04:03:01.677025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c1f78c7-bd63-472b-9229-8745f8ff7539 req-e6f87ffd-2528-4f6d-b582-bfee6527f463 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412004 Dec 21 04:03:01.803289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2c6ad5-0930-435f-b706-cb9b426283dc req-f8d63599-525b-4035-b2ab-350a3bdabb7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:01.805012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d2c6ad5-0930-435f-b706-cb9b426283dc req-f8d63599-525b-4035-b2ab-350a3bdabb7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0490932 Dec 21 04:03:01.856669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d2c6ad5-0930-435f-b706-cb9b426283dc req-6c1dd3cb-3d6e-4016-a5b1-a86df5159779 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455010 Dec 21 04:03:01.980504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a97a9e-e114-4f9a-a0a6-2e4a4c6a9223 req-09ecd2eb-790b-4da6-b70d-989be80e30ab tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:01.983026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90a97a9e-e114-4f9a-a0a6-2e4a4c6a9223 req-09ecd2eb-790b-4da6-b70d-989be80e30ab tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0565548 Dec 21 04:03:02.057199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90a97a9e-e114-4f9a-a0a6-2e4a4c6a9223 req-88fc8a92-9c33-4823-aaf6-8c5c0e995e53 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684335 Dec 21 04:03:02.059925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:02.085874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-095c3dad-4fcb-4e44-b943-c453fa288b76 req-7a2d1707-98c8-4536-b159-f846391104ba tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:02.087651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-095c3dad-4fcb-4e44-b943-c453fa288b76 req-7a2d1707-98c8-4536-b159-f846391104ba tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 949 time: 0.0855315 Dec 21 04:03:02.154428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-095c3dad-4fcb-4e44-b943-c453fa288b76 req-8761958c-b734-473b-9020-c381b8157811 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468106 Dec 21 04:03:02.263624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.296383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b8e970-3afa-4baf-858d-8cd4322361f9 req-2bd604af-5494-4be7-b156-6b2950629d8b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:02.297879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38b8e970-3afa-4baf-858d-8cd4322361f9 req-2bd604af-5494-4be7-b156-6b2950629d8b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0645173 Dec 21 04:03:02.341065 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.349098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38b8e970-3afa-4baf-858d-8cd4322361f9 req-d74b3a52-7802-4cc9-b4ac-df55a4b7323a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447745 Dec 21 04:03:02.421191 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.424206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a761ad76-7a71-4f42-bf0b-abda41f2df0e up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:03:02.472692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093dd976-19a0-477b-81a0-d8b126ef8522 req-244b4a0b-ad5c-40f8-9093-03b72d6c7cfb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:02.473233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6bbca7d387304f7e995b805e65d7a4d5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4106858 Dec 21 04:03:02.474016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:02.474290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-093dd976-19a0-477b-81a0-d8b126ef8522 req-244b4a0b-ad5c-40f8-9093-03b72d6c7cfb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0518751 Dec 21 04:03:02.474652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9561b6b-4ce9-4f96-a433-0be21c0a4a39,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:02.488390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.488743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.496558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d769ee-24ae-4493-a734-70a7ff2c7554 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:02.539562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-093dd976-19a0-477b-81a0-d8b126ef8522 req-ced5cd14-4c19-4993-8182-4544d11fafb3 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561666 Dec 21 04:03:02.541114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port a761ad76-7a71-4f42-bf0b-abda41f2df0e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:03:02.544110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a2144c-f5d3-4251-98c9-adca05511031 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.545460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port a761ad76-7a71-4f42-bf0b-abda41f2df0e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:03:02.546078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.588925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a2144c-f5d3-4251-98c9-adca05511031 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.679082 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.709527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5dd472-cedb-492f-b492-27b86b8928a8 req-6ae40344-e370-4c42-9f6f-61fd5b70c9c5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:02.714859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:03:02.717300 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-deb0c0a0-f7e7-49a2-b126-6bc899d1d564" -d '{"events": [{"server_uuid": "11d142e7-fdae-4da8-9df0-a2aa0495170b", "name": "network-vif-plugged", "status": "completed", "tag": "a761ad76-7a71-4f42-bf0b-abda41f2df0e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:03:02.717720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc5dd472-cedb-492f-b492-27b86b8928a8 req-6ae40344-e370-4c42-9f6f-61fd5b70c9c5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0602865 Dec 21 04:03:02.731942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port a761ad76-7a71-4f42-bf0b-abda41f2df0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a761ad76-7a71-4f42-bf0b-abda41f2df0e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:02.748268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a2144c-f5d3-4251-98c9-adca05511031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.752530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a2144c-f5d3-4251-98c9-adca05511031 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.753816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98a2144c-f5d3-4251-98c9-adca05511031 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e9561b6b-4ce9-4f96-a433-0be21c0a4a39 HTTP/1.1" status: 204 len: 168 time: 0.2721813 Dec 21 04:03:02.766801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a2144c-f5d3-4251-98c9-adca05511031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9561b6b-4ce9-4f96-a433-0be21c0a4a39,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:02.785826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc5dd472-cedb-492f-b492-27b86b8928a8 req-b795f356-35b9-4f12-a0f0-befe63f81c24 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668590 Dec 21 04:03:02.806046 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:03:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45afd46d-bb77-422f-a3d7-20e550037dbc x-openstack-request-id: req-45afd46d-bb77-422f-a3d7-20e550037dbc {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:03:02.806619 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "11d142e7-fdae-4da8-9df0-a2aa0495170b", "name": "network-vif-plugged", "status": "completed", "tag": "a761ad76-7a71-4f42-bf0b-abda41f2df0e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:03:02.807069 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-45afd46d-bb77-422f-a3d7-20e550037dbc {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:03:02.807590 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e', 'code': 200} Dec 21 04:03:02.827090 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:02.884985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=a761ad76-7a71-4f42-bf0b-abda41f2df0e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:02.976881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92453082-cf32-4345-b3cf-5c809be0381c req-65af4590-66a7-42a5-ad8d-0706cc25c90f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:02.978399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92453082-cf32-4345-b3cf-5c809be0381c req-65af4590-66a7-42a5-ad8d-0706cc25c90f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0872352 Dec 21 04:03:03.018145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876d4a1c-69fd-4ce9-a22c-f2eeccd46693 req-b40d2e01-2f13-4c74-bb70-9897411f890b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:03.019808 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876d4a1c-69fd-4ce9-a22c-f2eeccd46693 req-b40d2e01-2f13-4c74-bb70-9897411f890b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 1102 time: 0.0802782 Dec 21 04:03:03.056356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92453082-cf32-4345-b3cf-5c809be0381c req-35b07ad4-3a9f-426b-8568-3710c6cf9eab tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700788 Dec 21 04:03:03.088234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876d4a1c-69fd-4ce9-a22c-f2eeccd46693 req-b227a627-d9a9-46af-875f-13ef0e6312e8 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598662 Dec 21 04:03:03.209121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467b439c-1221-4298-a319-a4ef226ab33a req-425ec6bd-1ebb-4b4f-95dc-a7eab8ac717c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:03.210997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-467b439c-1221-4298-a319-a4ef226ab33a req-425ec6bd-1ebb-4b4f-95dc-a7eab8ac717c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0585933 Dec 21 04:03:03.284226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-467b439c-1221-4298-a319-a4ef226ab33a req-ce9dd2e7-eace-4e08-98b6-e9ebd2ac08d1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664897 Dec 21 04:03:03.425531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c73fbc3c-f596-4316-b4e9-bc786d0653a7 req-ae8654b4-73b2-4987-9646-5a6152ddb130 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:03.427296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c73fbc3c-f596-4316-b4e9-bc786d0653a7 req-ae8654b4-73b2-4987-9646-5a6152ddb130 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 950 time: 0.0804586 Dec 21 04:03:03.519321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda41073-7187-4617-a329-731065552c2a req-906cbd9b-8173-41c9-ad13-70cafb276190 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:03.520828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bda41073-7187-4617-a329-731065552c2a req-906cbd9b-8173-41c9-ad13-70cafb276190 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0826707 Dec 21 04:03:03.528441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c73fbc3c-f596-4316-b4e9-bc786d0653a7 req-b12786a8-908a-4462-8e1c-3bac5e936966 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887327 Dec 21 04:03:03.578765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bda41073-7187-4617-a329-731065552c2a req-3fdb6379-893d-4898-93b7-40b1462f82e9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457404 Dec 21 04:03:03.608212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:03.636312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7045d9e5-ec31-4809-9495-940d839e53fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:03.766116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7045d9e5-ec31-4809-9495-940d839e53fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:03.832344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715e4bcd-bcf7-446b-95b4-c0a952091388 req-60791352-b3d7-4da5-a08b-1646b5c11d4e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:03.833812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-715e4bcd-bcf7-446b-95b4-c0a952091388 req-60791352-b3d7-4da5-a08b-1646b5c11d4e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0541193 Dec 21 04:03:03.867026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7045d9e5-ec31-4809-9495-940d839e53fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:03.883860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-715e4bcd-bcf7-446b-95b4-c0a952091388 req-399b91a7-32e3-4464-9b0b-72f61048bf1d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428903 Dec 21 04:03:03.917277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7045d9e5-ec31-4809-9495-940d839e53fd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8ee9d503c9444235bab39c7a7507d9ec&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3079395 Dec 21 04:03:03.920138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7045d9e5-ec31-4809-9495-940d839e53fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d49db641-e5af-4c0b-b3b5-425dcbf9ca6a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:03.926019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43150) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:04.011301 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:04.036628 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:04.075188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1368c4-9da3-44bc-932f-50c712663c8d req-b2671f4d-bb0b-4829-85dd-284377f7714f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:04.076677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a1368c4-9da3-44bc-932f-50c712663c8d req-b2671f4d-bb0b-4829-85dd-284377f7714f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0966980 Dec 21 04:03:04.132497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a1368c4-9da3-44bc-932f-50c712663c8d req-60438475-83d0-4182-9a56-6c6734a6028a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482779 Dec 21 04:03:04.221545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:04.224552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:04.228583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d49db641-e5af-4c0b-b3b5-425dcbf9ca6a HTTP/1.1" status: 204 len: 168 time: 0.2987578 Dec 21 04:03:04.236926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d49db641-e5af-4c0b-b3b5-425dcbf9ca6a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:04.245563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.246665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.247369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.247369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.247548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.247891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.248247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.248944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.248944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.249641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.249641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.249856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.250290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47c8b3bd-a403-4e5b-8b5d-20f10b98bf07 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:04.342106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be96278b-8dec-4f21-9a25-d1cd5085d742 req-0b4c547d-7aa6-4f2f-8452-225cb444cf18 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:04.347427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be96278b-8dec-4f21-9a25-d1cd5085d742 req-0b4c547d-7aa6-4f2f-8452-225cb444cf18 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0759947 Dec 21 04:03:04.420809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be96278b-8dec-4f21-9a25-d1cd5085d742 req-bab6897f-ca5d-4cfd-b1e3-2f0079588f6a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709631 Dec 21 04:03:04.551199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fb5c62-2b4a-4822-8c3b-dd9a7e982cb9 req-a4830b4e-81fc-4799-80a5-d55da3a0ee78 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:04.552730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54fb5c62-2b4a-4822-8c3b-dd9a7e982cb9 req-a4830b4e-81fc-4799-80a5-d55da3a0ee78 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0582471 Dec 21 04:03:04.613297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54fb5c62-2b4a-4822-8c3b-dd9a7e982cb9 req-98352522-445f-4b3d-b2f3-b3a8538136a9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522680 Dec 21 04:03:04.667747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2149f934-8ced-40e3-afcf-285087fe8e52 req-9870614e-4a38-46eb-89e3-4b1683893869 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:04.669988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2149f934-8ced-40e3-afcf-285087fe8e52 req-9870614e-4a38-46eb-89e3-4b1683893869 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 950 time: 0.0555973 Dec 21 04:03:04.775226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2149f934-8ced-40e3-afcf-285087fe8e52 req-82515a4f-2cef-469b-b9a8-4e2e46fee1eb tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985534 Dec 21 04:03:04.792537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089b764f-3c9f-4a44-8217-a54ce402fccc req-cac64a93-f652-4d26-960f-5c6e8dad36b9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:04.794841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089b764f-3c9f-4a44-8217-a54ce402fccc req-cac64a93-f652-4d26-960f-5c6e8dad36b9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0764582 Dec 21 04:03:04.856324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089b764f-3c9f-4a44-8217-a54ce402fccc req-bafcc4e6-f624-439f-8cce-abf42c504290 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496578 Dec 21 04:03:04.988393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb232f3-b8a8-4cfe-9391-eed635ba5e44 req-db603697-49b4-4f66-b1b4-81d8c71830b8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:04.989935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aeb232f3-b8a8-4cfe-9391-eed635ba5e44 req-db603697-49b4-4f66-b1b4-81d8c71830b8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0599668 Dec 21 04:03:05.051633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aeb232f3-b8a8-4cfe-9391-eed635ba5e44 req-a2a31c8c-b8c8-4ae2-8137-275c3a9e12b0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494986 Dec 21 04:03:05.206545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43184) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:05.220551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d65b9379-33ab-48b1-8adf-317b483669e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.298675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d65b9379-33ab-48b1-8adf-317b483669e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.437362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d65b9379-33ab-48b1-8adf-317b483669e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.507421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d65b9379-33ab-48b1-8adf-317b483669e8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e7433145bc684a2a9ef0b559398cb2f0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2971890 Dec 21 04:03:05.508476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43196) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:05.520870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d65b9379-33ab-48b1-8adf-317b483669e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d10de44d-b9d8-4d2d-966b-c2bfab789ce1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:05.545378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0093fee4-c78e-40bc-afa8-f7f546aa2762 req-e8227a66-e065-4c59-afcf-49694a1a821c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:05.547007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0093fee4-c78e-40bc-afa8-f7f546aa2762 req-e8227a66-e065-4c59-afcf-49694a1a821c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0871501 Dec 21 04:03:05.580258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d95bd7b-a55a-4d38-9ca5-41b5fd6a022d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.613004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0093fee4-c78e-40bc-afa8-f7f546aa2762 req-09b1e172-bfa6-4f16-8304-6bca7a0db734 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601749 Dec 21 04:03:05.620421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d95bd7b-a55a-4d38-9ca5-41b5fd6a022d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.804535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d95bd7b-a55a-4d38-9ca5-41b5fd6a022d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.807430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d95bd7b-a55a-4d38-9ca5-41b5fd6a022d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:05.809191 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d95bd7b-a55a-4d38-9ca5-41b5fd6a022d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d10de44d-b9d8-4d2d-966b-c2bfab789ce1 HTTP/1.1" status: 204 len: 168 time: 0.2991693 Dec 21 04:03:05.819435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d95bd7b-a55a-4d38-9ca5-41b5fd6a022d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d10de44d-b9d8-4d2d-966b-c2bfab789ce1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:06.779923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9516db37-40e4-49cf-92a0-ed5034db8bca req-4887f938-e9ce-49ac-8688-104284ebdf0d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:06.781436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9516db37-40e4-49cf-92a0-ed5034db8bca req-4887f938-e9ce-49ac-8688-104284ebdf0d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0862799 Dec 21 04:03:06.842915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9516db37-40e4-49cf-92a0-ed5034db8bca req-349c0034-215b-4108-8088-6a734ec8a313 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511966 Dec 21 04:03:07.339206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260302d9-dcc8-41c6-a72f-660c5c797f2e req-895bf1af-aaf1-4dc6-8dc5-78119bbb35a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:07.341233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-260302d9-dcc8-41c6-a72f-660c5c797f2e req-895bf1af-aaf1-4dc6-8dc5-78119bbb35a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0694072 Dec 21 04:03:07.404799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-260302d9-dcc8-41c6-a72f-660c5c797f2e req-322f060d-c73c-4a61-adc5-c7b6de9f00b1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566788 Dec 21 04:03:08.570404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4d8614d-796b-41f2-b782-1711b41135dd req-50a755c3-19d5-4045-b61d-5cc54f1b8ef0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:08.571908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4d8614d-796b-41f2-b782-1711b41135dd req-50a755c3-19d5-4045-b61d-5cc54f1b8ef0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0666170 Dec 21 04:03:08.629632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4d8614d-796b-41f2-b782-1711b41135dd req-89f0ed6a-6c20-4af8-a83c-bddb6107e634 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507963 Dec 21 04:03:08.740699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43290) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:08.792104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33133c13-1846-4b58-96cb-9d396f3ab3d7 req-2fac8e93-b49c-4acc-95bb-79bf95573c81 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:08.794470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33133c13-1846-4b58-96cb-9d396f3ab3d7 req-2fac8e93-b49c-4acc-95bb-79bf95573c81 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0616291 Dec 21 04:03:08.848504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33133c13-1846-4b58-96cb-9d396f3ab3d7 req-9fc2b4b3-651a-4e8b-b28d-b8aecda467c2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469613 Dec 21 04:03:08.893467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b9207f4-ae4b-4ed7-8168-3dd4e6fe9fe9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:08.978970 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b9207f4-ae4b-4ed7-8168-3dd4e6fe9fe9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:09.029667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85f35b5-7626-415d-bd12-2b4bb1c2af72 req-5d4866a5-7167-48d7-b859-bd24a158b741 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:09.031346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b85f35b5-7626-415d-bd12-2b4bb1c2af72 req-5d4866a5-7167-48d7-b859-bd24a158b741 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0673597 Dec 21 04:03:09.054236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b9207f4-ae4b-4ed7-8168-3dd4e6fe9fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:09.092857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b85f35b5-7626-415d-bd12-2b4bb1c2af72 req-3383c6b6-021f-478f-affb-23a19eef5e18 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546429 Dec 21 04:03:09.118003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:09.118970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b9207f4-ae4b-4ed7-8168-3dd4e6fe9fe9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f349a6a126cd47d78d7d5c763d1e0bcf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3765953 Dec 21 04:03:09.119936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9207f4-ae4b-4ed7-8168-3dd4e6fe9fe9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e966eb74-0b19-4dca-8205-9353260c20c6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:09.232813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79ca6717-57f7-43c7-a216-178c652c0d67 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:09.276162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79ca6717-57f7-43c7-a216-178c652c0d67 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:09.303977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249cbf37-14fd-4112-89c6-b358a2847520 req-dc92c84b-3d78-4f02-8ec3-3124df95a123 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:09.305493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-249cbf37-14fd-4112-89c6-b358a2847520 req-dc92c84b-3d78-4f02-8ec3-3124df95a123 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1055272 Dec 21 04:03:09.366578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-249cbf37-14fd-4112-89c6-b358a2847520 req-d94ed8c2-1c07-4650-a665-be8bedbad926 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517471 Dec 21 04:03:09.443787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79ca6717-57f7-43c7-a216-178c652c0d67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:09.447024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79ca6717-57f7-43c7-a216-178c652c0d67 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:09.452429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-79ca6717-57f7-43c7-a216-178c652c0d67 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e966eb74-0b19-4dca-8205-9353260c20c6 HTTP/1.1" status: 204 len: 168 time: 0.3336775 Dec 21 04:03:09.464827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79ca6717-57f7-43c7-a216-178c652c0d67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e966eb74-0b19-4dca-8205-9353260c20c6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:09.530221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f0328bc-cfe8-4677-9842-44a037ae1f73 req-207f93bb-40b6-42fb-b1fb-6bec70ed688e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:09.532077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f0328bc-cfe8-4677-9842-44a037ae1f73 req-207f93bb-40b6-42fb-b1fb-6bec70ed688e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0698397 Dec 21 04:03:09.588658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f0328bc-cfe8-4677-9842-44a037ae1f73 req-568cf6f5-b5a7-4fb6-9188-a06a0e67bf72 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498517 Dec 21 04:03:09.718000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc05c67-5c9f-45d0-9103-944f7a627e03 req-11da541e-794a-4f63-91c9-3c14cb050b44 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:09.719798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bc05c67-5c9f-45d0-9103-944f7a627e03 req-11da541e-794a-4f63-91c9-3c14cb050b44 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0523393 Dec 21 04:03:09.785530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bc05c67-5c9f-45d0-9103-944f7a627e03 req-71298436-3eb2-4a93-a6e9-a6d2b741aafc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569828 Dec 21 04:03:09.944743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1717c62-1c77-4ccb-815b-71ab510e5e47 req-aefc74b4-2dca-4714-a762-25dfef65e61e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:09.946276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1717c62-1c77-4ccb-815b-71ab510e5e47 req-aefc74b4-2dca-4714-a762-25dfef65e61e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0508487 Dec 21 04:03:10.000916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1717c62-1c77-4ccb-815b-71ab510e5e47 req-dd7df0b5-6d7e-4d2c-b06a-1e2d68e00ca3 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483029 Dec 21 04:03:10.148801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43328) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:10.163432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1442c89-1bb6-4de5-9c57-8fc130267877 req-20694c1e-9fc9-43d4-9764-cc9848aaa9f9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:10.164882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1442c89-1bb6-4de5-9c57-8fc130267877 req-20694c1e-9fc9-43d4-9764-cc9848aaa9f9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0643289 Dec 21 04:03:10.171975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d72c6195-6b79-4039-bf27-059caea7600f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.247151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1442c89-1bb6-4de5-9c57-8fc130267877 req-767d18b1-10d3-4ab2-83ff-745507564e2d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722706 Dec 21 04:03:10.313374 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d72c6195-6b79-4039-bf27-059caea7600f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.412236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d72c6195-6b79-4039-bf27-059caea7600f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.446385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558382d8-97d4-47f8-bbc9-a3070a7553f8 req-af700a04-8b0f-4a72-87e2-c398c0e414fc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:10.447933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-558382d8-97d4-47f8-bbc9-a3070a7553f8 req-af700a04-8b0f-4a72-87e2-c398c0e414fc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0801415 Dec 21 04:03:10.467640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d72c6195-6b79-4039-bf27-059caea7600f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=36219d5841114f1abd563cc7e10ddf70&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3179593 Dec 21 04:03:10.470296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43340) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:10.481064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72c6195-6b79-4039-bf27-059caea7600f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc88e221-c625-4c16-9892-4bae2d755353,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:10.512841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-558382d8-97d4-47f8-bbc9-a3070a7553f8 req-6c8823d0-a193-4601-90fa-742aecd3b0d0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570829 Dec 21 04:03:10.528679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-def7da73-4cc4-474e-bbaa-785cb5d4d45e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.551377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-def7da73-4cc4-474e-bbaa-785cb5d4d45e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.676635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36498df7-7a79-4a2a-b7a3-b8c6fa8f4e3d req-9f67c4a7-5d32-4704-828a-1d6edc315606 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:10.678729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36498df7-7a79-4a2a-b7a3-b8c6fa8f4e3d req-9f67c4a7-5d32-4704-828a-1d6edc315606 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0533786 Dec 21 04:03:10.695980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-def7da73-4cc4-474e-bbaa-785cb5d4d45e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.700312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-def7da73-4cc4-474e-bbaa-785cb5d4d45e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:10.702013 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-def7da73-4cc4-474e-bbaa-785cb5d4d45e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/fc88e221-c625-4c16-9892-4bae2d755353 HTTP/1.1" status: 204 len: 168 time: 0.2291205 Dec 21 04:03:10.732355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def7da73-4cc4-474e-bbaa-785cb5d4d45e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc88e221-c625-4c16-9892-4bae2d755353,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:10.756194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36498df7-7a79-4a2a-b7a3-b8c6fa8f4e3d req-cb53705e-8a28-411a-9631-6b27380b3da0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687566 Dec 21 04:03:10.909827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25cbdc5-cb2c-499f-9b87-3c79971a4fb9 req-742ac96a-c31b-4ef6-b3c9-f6539b9e118a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:10.911483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e25cbdc5-cb2c-499f-9b87-3c79971a4fb9 req-742ac96a-c31b-4ef6-b3c9-f6539b9e118a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0566471 Dec 21 04:03:10.972366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e25cbdc5-cb2c-499f-9b87-3c79971a4fb9 req-b6550333-255b-4688-8713-f6d77ffdd857 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546837 Dec 21 04:03:11.115547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ea4b5b-8263-4f28-84c9-b4726c565f03 req-2d5301bb-c397-4c08-a6fc-448832e4daa2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:11.124158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40ea4b5b-8263-4f28-84c9-b4726c565f03 req-2d5301bb-c397-4c08-a6fc-448832e4daa2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0659840 Dec 21 04:03:11.187712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40ea4b5b-8263-4f28-84c9-b4726c565f03 req-a46e581b-d269-4413-a8b0-1c9d3a862a27 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625098 Dec 21 04:03:11.411216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d268b7d5-1efa-4bde-ac1b-e3ab87ffee89 req-9a4f4659-84c3-4dc4-84d1-93161b0da296 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:11.412982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d268b7d5-1efa-4bde-ac1b-e3ab87ffee89 req-9a4f4659-84c3-4dc4-84d1-93161b0da296 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0781429 Dec 21 04:03:11.502972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d268b7d5-1efa-4bde-ac1b-e3ab87ffee89 req-df868cfa-b339-4f1a-b20c-30b61aff0286 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758021 Dec 21 04:03:11.635193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a2aa924-c184-43d8-8a49-1e3c83cf2003 req-8424063a-4efb-4485-a71b-71d91adab8aa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:11.640178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a2aa924-c184-43d8-8a49-1e3c83cf2003 req-8424063a-4efb-4485-a71b-71d91adab8aa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0592690 Dec 21 04:03:11.705223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a2aa924-c184-43d8-8a49-1e3c83cf2003 req-bb12a250-5797-4e3b-91ff-0bd028ef65ea tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575676 Dec 21 04:03:11.847199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88cb369e-dac5-4d7c-a69d-0fa58c2af0d1 req-9104ffe6-176c-436f-8193-20a0c0f8aee4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:11.848744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88cb369e-dac5-4d7c-a69d-0fa58c2af0d1 req-9104ffe6-176c-436f-8193-20a0c0f8aee4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0556207 Dec 21 04:03:11.923620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88cb369e-dac5-4d7c-a69d-0fa58c2af0d1 req-08e75764-fc84-4de6-add4-76d4357384e4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632186 Dec 21 04:03:12.063163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acee826d-d511-4944-8864-b4956c8426c3 req-fba65b0a-67e6-4fa2-803d-7fd1f1c09e2d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:12.070991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acee826d-d511-4944-8864-b4956c8426c3 req-fba65b0a-67e6-4fa2-803d-7fd1f1c09e2d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0576389 Dec 21 04:03:12.118076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acee826d-d511-4944-8864-b4956c8426c3 req-bf454fad-c10f-4769-b5a7-42389ecc9a03 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461502 Dec 21 04:03:12.291967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f00504c1-c15f-4c40-961f-50285d572607 req-595864e2-73d4-4669-b032-a07b60da0c2f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:12.294092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f00504c1-c15f-4c40-961f-50285d572607 req-595864e2-73d4-4669-b032-a07b60da0c2f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0528848 Dec 21 04:03:12.369637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f00504c1-c15f-4c40-961f-50285d572607 req-957bda36-dcd6-4a4e-a214-74e1b2fab280 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573168 Dec 21 04:03:12.518214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39edde37-69bb-4c2e-933f-2378f6911d69 req-5988eebb-2657-419f-810c-50d9b1894e89 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:12.521102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39edde37-69bb-4c2e-933f-2378f6911d69 req-5988eebb-2657-419f-810c-50d9b1894e89 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0691233 Dec 21 04:03:12.583485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39edde37-69bb-4c2e-933f-2378f6911d69 req-a4af9b5e-f900-4624-9444-3cb16df70ce5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572839 Dec 21 04:03:12.853572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9e15769-9701-4b5a-9b22-c28f704a3894 req-9848ffb2-81e4-4ee6-bad8-04f064e2cbc8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:12.864144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9e15769-9701-4b5a-9b22-c28f704a3894 req-9848ffb2-81e4-4ee6-bad8-04f064e2cbc8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0754015 Dec 21 04:03:12.936320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9e15769-9701-4b5a-9b22-c28f704a3894 req-51d4f25d-d7e4-44da-a922-d5a11eb60dd5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663011 Dec 21 04:03:13.054375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609695b4-c733-46fb-8c50-3ee8aa920f6e req-3882ae42-f53e-41e5-8d95-31d91174adfa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:13.061960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-609695b4-c733-46fb-8c50-3ee8aa920f6e req-3882ae42-f53e-41e5-8d95-31d91174adfa tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0614929 Dec 21 04:03:13.117660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-609695b4-c733-46fb-8c50-3ee8aa920f6e req-ac1c1b52-8241-425a-807f-9f39bad7bd29 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546017 Dec 21 04:03:13.255420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d88a68-48a9-4e42-a50f-72c04bec7676 req-126af51b-27a1-45e5-bf9d-129ead417e99 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:13.257170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4d88a68-48a9-4e42-a50f-72c04bec7676 req-126af51b-27a1-45e5-bf9d-129ead417e99 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0581813 Dec 21 04:03:13.309308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4d88a68-48a9-4e42-a50f-72c04bec7676 req-34eac65d-90ac-4fea-b614-64102470f395 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413840 Dec 21 04:03:13.431513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-843dbf2e-ade9-4907-acc6-236c63c715c0 req-2949fb38-5600-476c-885d-ddad35886154 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:13.433111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-843dbf2e-ade9-4907-acc6-236c63c715c0 req-2949fb38-5600-476c-885d-ddad35886154 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0546269 Dec 21 04:03:13.486742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-843dbf2e-ade9-4907-acc6-236c63c715c0 req-8eb4612e-8d04-4aad-972e-95ad343a5b8a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467393 Dec 21 04:03:14.209478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc43c43-ae18-42b3-9d96-71b25d550a3a req-9ad32770-ecc2-4e2c-bf9e-80ee530f82b7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:14.212432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dc43c43-ae18-42b3-9d96-71b25d550a3a req-9ad32770-ecc2-4e2c-bf9e-80ee530f82b7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0597975 Dec 21 04:03:14.270155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dc43c43-ae18-42b3-9d96-71b25d550a3a req-caeaf3b6-dead-42a4-9737-cfb18fe1ebf9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505443 Dec 21 04:03:15.390693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a253f95f-5167-4bc5-afa0-32fd993c7ea7 req-d3b0dd92-9918-4766-a901-8289b5a6219b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:15.392197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a253f95f-5167-4bc5-afa0-32fd993c7ea7 req-d3b0dd92-9918-4766-a901-8289b5a6219b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0493526 Dec 21 04:03:15.439143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a253f95f-5167-4bc5-afa0-32fd993c7ea7 req-e5d42e4f-30cd-416f-b084-ef0b9c72dfa8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409601 Dec 21 04:03:16.376761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43518) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:16.511001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ddcdf6ce-0f47-4b10-a4ab-462250d75749 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.577184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e35c3-233e-4542-80ad-94063860d83c req-f2538fbe-b85c-49f8-a0ab-792c7899c05d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:16.578873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-525e35c3-233e-4542-80ad-94063860d83c req-f2538fbe-b85c-49f8-a0ab-792c7899c05d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0500028 Dec 21 04:03:16.596885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ddcdf6ce-0f47-4b10-a4ab-462250d75749 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.628589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-525e35c3-233e-4542-80ad-94063860d83c req-b933e5ed-611c-4ae4-9b20-7298d8de0533 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429451 Dec 21 04:03:16.655654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ddcdf6ce-0f47-4b10-a4ab-462250d75749 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.684047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcdf6ce-0f47-4b10-a4ab-462250d75749 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d20395d-e674-4ca9-aee5-4326c6c7bdf4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:16.702111 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ddcdf6ce-0f47-4b10-a4ab-462250d75749 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e69acd9f9333448a9aacaf691b51544f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3237326 Dec 21 04:03:16.705687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43528) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:16.763404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6a46f58-7870-42f3-919f-799bc89b8d1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.785193 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6a46f58-7870-42f3-919f-799bc89b8d1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.913552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6a46f58-7870-42f3-919f-799bc89b8d1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.916270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6a46f58-7870-42f3-919f-799bc89b8d1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:16.917428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c6a46f58-7870-42f3-919f-799bc89b8d1e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3d20395d-e674-4ca9-aee5-4326c6c7bdf4 HTTP/1.1" status: 204 len: 168 time: 0.2107558 Dec 21 04:03:16.925269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a46f58-7870-42f3-919f-799bc89b8d1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d20395d-e674-4ca9-aee5-4326c6c7bdf4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:17.756317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5ad294-0bb4-4db6-9f97-14aa63d37052 req-bd285f46-c83b-4f6e-9cc2-c17cfe1695d6 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:17.765425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c5ad294-0bb4-4db6-9f97-14aa63d37052 req-bd285f46-c83b-4f6e-9cc2-c17cfe1695d6 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0612628 Dec 21 04:03:17.844090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c5ad294-0bb4-4db6-9f97-14aa63d37052 req-7ec515ba-f5bb-42be-8972-f74468ae236f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0777879 Dec 21 04:03:19.008808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4799a4ee-f19a-415d-a734-90cfb8600e6d req-d7cbf8af-08f1-4a02-87be-77844cdd5df1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:19.010217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4799a4ee-f19a-415d-a734-90cfb8600e6d req-d7cbf8af-08f1-4a02-87be-77844cdd5df1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0529239 Dec 21 04:03:19.065482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4799a4ee-f19a-415d-a734-90cfb8600e6d req-7a2a8662-863b-4908-b1b9-1941afd42339 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483670 Dec 21 04:03:19.808920 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ad0d68e-2d75-432e-b6ea-3983e12507d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:19.828357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43592) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:20.074282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3fa6443-8995-45d7-be79-29cd72fbed96 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.213930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32b3ca9-d2ca-4a19-954f-f8f52533fc3b req-318c4349-bb6f-46c2-8b68-0e0f215abd7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:20.215558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b32b3ca9-d2ca-4a19-954f-f8f52533fc3b req-318c4349-bb6f-46c2-8b68-0e0f215abd7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0708869 Dec 21 04:03:20.249082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3fa6443-8995-45d7-be79-29cd72fbed96 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.276278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b32b3ca9-d2ca-4a19-954f-f8f52533fc3b req-b59718c5-8048-4511-a851-bc7bcf6e2b7a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525043 Dec 21 04:03:20.317978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3fa6443-8995-45d7-be79-29cd72fbed96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.356935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c3fa6443-8995-45d7-be79-29cd72fbed96 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c44074b85c964c39b9d6a5a94d8afbb7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5274923 Dec 21 04:03:20.357917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fa6443-8995-45d7-be79-29cd72fbed96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e134bd6b-9359-49cb-af4e-29fdea9ad545,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:20.359767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:20.412585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1964cee-0266-4e5d-a520-35bbe968ff08 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.433698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1964cee-0266-4e5d-a520-35bbe968ff08 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.552623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1964cee-0266-4e5d-a520-35bbe968ff08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.555246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1964cee-0266-4e5d-a520-35bbe968ff08 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:20.556401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1964cee-0266-4e5d-a520-35bbe968ff08 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e134bd6b-9359-49cb-af4e-29fdea9ad545 HTTP/1.1" status: 204 len: 168 time: 0.1954694 Dec 21 04:03:20.564973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1964cee-0266-4e5d-a520-35bbe968ff08 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e134bd6b-9359-49cb-af4e-29fdea9ad545,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:21.174118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43620) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:21.189705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08342373-a242-4040-bc16-79c42293b94b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.282598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08342373-a242-4040-bc16-79c42293b94b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.352178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08342373-a242-4040-bc16-79c42293b94b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.391158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08342373-a242-4040-bc16-79c42293b94b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4134bf50-6f7d-4562-89f9-eb761a68d843,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:21.398349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43628) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:21.398815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-08342373-a242-4040-bc16-79c42293b94b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=997681705bc74c9b992221f439f5d585&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2231994 Dec 21 04:03:21.415073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0f9191-85c6-45e4-8c62-f424046ff864 req-dec3f0c9-48f3-4a0e-b44b-4e9e2c8aea41 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:21.416584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c0f9191-85c6-45e4-8c62-f424046ff864 req-dec3f0c9-48f3-4a0e-b44b-4e9e2c8aea41 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0646164 Dec 21 04:03:21.496237 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46d9f091-cf35-4d8e-8d7f-493a071797bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.519335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c0f9191-85c6-45e4-8c62-f424046ff864 req-b5d719e4-b072-472b-9c49-c379b5b4b059 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894938 Dec 21 04:03:21.530863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46d9f091-cf35-4d8e-8d7f-493a071797bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.638083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46d9f091-cf35-4d8e-8d7f-493a071797bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.640713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46d9f091-cf35-4d8e-8d7f-493a071797bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:21.641855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-46d9f091-cf35-4d8e-8d7f-493a071797bb admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4134bf50-6f7d-4562-89f9-eb761a68d843 HTTP/1.1" status: 204 len: 168 time: 0.2418213 Dec 21 04:03:21.649584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d9f091-cf35-4d8e-8d7f-493a071797bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4134bf50-6f7d-4562-89f9-eb761a68d843,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:22.625751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-77be14f5-2cf3-4c9d-9bda-19462f2579e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:22.698515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e69adc5-375b-46e6-b5e6-fcf385c9a946 req-f5b1001a-96d9-4325-8cac-a6455e461e0d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:22.707863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e69adc5-375b-46e6-b5e6-fcf385c9a946 req-f5b1001a-96d9-4325-8cac-a6455e461e0d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0996962 Dec 21 04:03:22.716583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:22.763007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e69adc5-375b-46e6-b5e6-fcf385c9a946 req-ba94fe3d-75d7-40de-b11d-fae7cc1b0f2d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538490 Dec 21 04:03:23.322740 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:23.961900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3758a4a-f180-4310-8b64-9622513a4bfb req-6c8b2f0f-215d-4aa7-88e7-00251c1df729 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:23.965417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3758a4a-f180-4310-8b64-9622513a4bfb req-6c8b2f0f-215d-4aa7-88e7-00251c1df729 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1040170 Dec 21 04:03:24.028971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a7d1f99-add6-4ea0-95b4-4cb6b3e40b89 req-34229589-c0a4-4216-9654-bcaddbd40696 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:24.031054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a7d1f99-add6-4ea0-95b4-4cb6b3e40b89 req-34229589-c0a4-4216-9654-bcaddbd40696 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1553771 Dec 21 04:03:24.065992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-353ebf38-5cdb-4ad9-976f-814a7741049c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:24.067517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-353ebf38-5cdb-4ad9-976f-814a7741049c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.1008444 Dec 21 04:03:24.088934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3758a4a-f180-4310-8b64-9622513a4bfb req-50a37395-21fd-4b1a-9b42-fa8b82283db6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1074555 Dec 21 04:03:24.131705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a7d1f99-add6-4ea0-95b4-4cb6b3e40b89 req-37d16db5-747f-4182-968e-71cf7efe4918 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799587 Dec 21 04:03:24.319959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-1f5d1aae-5b80-48f7-9e25-48fe9b7490a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:24.322026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-1f5d1aae-5b80-48f7-9e25-48fe9b7490a5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.1082287 Dec 21 04:03:24.458507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-2c9eaa57-e912-453c-989b-9e5dba0ee79c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.1225879 Dec 21 04:03:24.548543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-93c744eb-9e68-4d88-a372-3cee24aec5f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:24.550322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-93c744eb-9e68-4d88-a372-3cee24aec5f0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0835121 Dec 21 04:03:24.631779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-375463d5-32d0-4beb-8e55-fc6a59bca21f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:24.634468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-375463d5-32d0-4beb-8e55-fc6a59bca21f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0737154 Dec 21 04:03:24.655087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-e018a650-e22c-4f87-880f-04accf5358f3 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:03:24.656703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-e018a650-e22c-4f87-880f-04accf5358f3 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0114467 Dec 21 04:03:24.772196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-3b1dbf2c-07dc-4489-a1b2-dbc8c1789f40 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1062887 Dec 21 04:03:24.904542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b6ee3c1-9945-4dd9-a5cc-862fffb96188 req-b7435e24-b408-449e-8102-a844709ecf66 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1207178 Dec 21 04:03:24.918283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:24.998446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:25.266955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af06bf73-b6aa-4ee1-8830-ef5be501fe32 req-eb9fc876-ef1d-45a7-9a0a-13433590e793 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:25.268527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af06bf73-b6aa-4ee1-8830-ef5be501fe32 req-eb9fc876-ef1d-45a7-9a0a-13433590e793 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0911586 Dec 21 04:03:25.302729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b3de4e-bfda-4c3e-b73a-6154b0a4e977 req-04f1fbd2-9848-4c77-a696-daf636a83a46 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:25.304254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8b3de4e-bfda-4c3e-b73a-6154b0a4e977 req-04f1fbd2-9848-4c77-a696-daf636a83a46 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0898688 Dec 21 04:03:25.353765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af06bf73-b6aa-4ee1-8830-ef5be501fe32 req-bf32fa15-9161-41c0-af9c-0ebe62431f39 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0752046 Dec 21 04:03:25.384681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8b3de4e-bfda-4c3e-b73a-6154b0a4e977 req-0bddf340-b105-4449-8508-ca83757fb213 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719798 Dec 21 04:03:25.719327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:26.191767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43750) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:26.323537 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b09b2b5f-c3ae-4549-a585-a0d6e2081c17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:26.488329 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b09b2b5f-c3ae-4549-a585-a0d6e2081c17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:26.569040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b09b2b5f-c3ae-4549-a585-a0d6e2081c17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:26.624321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8dc3d6-5905-4f57-bd40-40a80fb2358a req-52fba9bb-9cb9-4e0e-bfda-4773baa0b2aa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:26.625967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e8dc3d6-5905-4f57-bd40-40a80fb2358a req-52fba9bb-9cb9-4e0e-bfda-4773baa0b2aa tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1350911 Dec 21 04:03:26.636390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b09b2b5f-c3ae-4549-a585-a0d6e2081c17 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4272068281d84d93ae0c902f6d683fd1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4435456 Dec 21 04:03:26.639298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:26.640412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09b2b5f-c3ae-4549-a585-a0d6e2081c17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=732933ab-6efb-45cc-b189-9a9af706f382,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:26.650302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af583812-859e-47a7-b149-128546be56f1 req-a610ff7a-b022-4d4e-b700-d809ae9e3670 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:26.652158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af583812-859e-47a7-b149-128546be56f1 req-a610ff7a-b022-4d4e-b700-d809ae9e3670 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1424232 Dec 21 04:03:26.744912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-604cdbb5-efb9-4547-844c-622bb2ed8773 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:26.759372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e8dc3d6-5905-4f57-bd40-40a80fb2358a req-189acc5c-f333-429e-bd7e-e8d002295e86 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1208107 Dec 21 04:03:26.790891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af583812-859e-47a7-b149-128546be56f1 req-21c164f3-3698-4d3c-9f16-b968c51ad216 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181424 Dec 21 04:03:26.878081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-604cdbb5-efb9-4547-844c-622bb2ed8773 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:27.000748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:03:27.020978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-604cdbb5-efb9-4547-844c-622bb2ed8773 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:27.023627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-604cdbb5-efb9-4547-844c-622bb2ed8773 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:27.025116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-604cdbb5-efb9-4547-844c-622bb2ed8773 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/732933ab-6efb-45cc-b189-9a9af706f382 HTTP/1.1" status: 204 len: 168 time: 0.3847442 Dec 21 04:03:27.034665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604cdbb5-efb9-4547-844c-622bb2ed8773 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=732933ab-6efb-45cc-b189-9a9af706f382,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:27.111323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:27.130243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'port_id': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'mac_address': 'fa:16:3e:52:07:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'af597cc9-d6ea-4007-b8f3-5cbc38b23a3a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:03:27.205361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:27.242798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 22270d5e-6f54-41c2-a9eb-fd2c24aef262 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:03:27.274237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:27.340798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:27.430666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:27.527480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['22270d5e-6f54-41c2-a9eb-fd2c24aef262'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:03:27.771506 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:03:27.975981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-044989dd-6963-4e83-ba42-f642822847c0 req-6e174dc6-5938-499f-a037-c27356561717 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:27.986404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-044989dd-6963-4e83-ba42-f642822847c0 req-6e174dc6-5938-499f-a037-c27356561717 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 944 time: 0.1084218 Dec 21 04:03:28.119561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-044989dd-6963-4e83-ba42-f642822847c0 req-4a40d86c-a354-4854-9b36-93a7694b02e7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1027119 Dec 21 04:03:29.021785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:03:29.303072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:03:29.303488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:29.417974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bac59bbb-183e-4627-8b09-17611ffecbca req-f719eab7-9381-46ea-804a-babf76a26d84 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:29.439602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bac59bbb-183e-4627-8b09-17611ffecbca req-f719eab7-9381-46ea-804a-babf76a26d84 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 944 time: 0.1666033 Dec 21 04:03:29.539123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bac59bbb-183e-4627-8b09-17611ffecbca req-ff679ced-c94d-49eb-9128-01a0fca62ab9 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986187 Dec 21 04:03:29.588693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:29.650523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:29.651545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:03:29.653871 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9953b57e-12e2-4039-a4da-9fb2d4ac9b2d" -d '{"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-plugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:03:29.785718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:29.991481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:30.040523 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:03:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04c08934-74ac-42e4-8992-dcfe075ce70c x-openstack-request-id: req-04c08934-74ac-42e4-8992-dcfe075ce70c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:03:30.041126 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-plugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:03:30.041126 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-04c08934-74ac-42e4-8992-dcfe075ce70c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:03:30.041613 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'code': 200} Dec 21 04:03:30.715490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b660f1a-3473-46fd-9be4-79825eef70ab req-e2ecf62f-69b1-4871-89ce-a38b87d3085c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:30.738397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b660f1a-3473-46fd-9be4-79825eef70ab req-e2ecf62f-69b1-4871-89ce-a38b87d3085c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1001794 Dec 21 04:03:30.810396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b660f1a-3473-46fd-9be4-79825eef70ab req-93f74a7f-ce52-4c88-8a88-934cd32726a1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671487 Dec 21 04:03:32.006102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48188101-1cc0-421e-9371-f49248d71dc6 req-c9bd459b-e4e9-4a14-b189-95af79272fed tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:32.007639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48188101-1cc0-421e-9371-f49248d71dc6 req-c9bd459b-e4e9-4a14-b189-95af79272fed tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0711319 Dec 21 04:03:32.123254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48188101-1cc0-421e-9371-f49248d71dc6 req-e80926a0-e78a-4f43-ac7e-edd096b0f3d1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780141 Dec 21 04:03:33.298523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d46385ea-2fa6-4940-8959-9e8842a75d05 req-ee38eda6-5d19-4dc3-9296-ea7d3d982ad0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:33.307732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d46385ea-2fa6-4940-8959-9e8842a75d05 req-ee38eda6-5d19-4dc3-9296-ea7d3d982ad0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0895731 Dec 21 04:03:33.440454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d46385ea-2fa6-4940-8959-9e8842a75d05 req-d9c5e541-434c-4490-bcbb-44c26b88b7c3 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1315131 Dec 21 04:03:34.637964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1bc038c-5b98-41b8-8dda-65ba33cf3759 req-670c1e73-c397-4fc0-96ab-86848722a65a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:34.648668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1bc038c-5b98-41b8-8dda-65ba33cf3759 req-670c1e73-c397-4fc0-96ab-86848722a65a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1081872 Dec 21 04:03:34.739437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1bc038c-5b98-41b8-8dda-65ba33cf3759 req-a98d1ebf-ab9a-445a-bc87-a4ad5b3c2780 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904524 Dec 21 04:03:35.915003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c53ffe-30c0-4239-98e6-a574737a6827 req-60b99ae2-56ff-4904-a057-cdef6a9af320 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:35.924038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96c53ffe-30c0-4239-98e6-a574737a6827 req-60b99ae2-56ff-4904-a057-cdef6a9af320 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0830719 Dec 21 04:03:35.998458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96c53ffe-30c0-4239-98e6-a574737a6827 req-3cb07f11-77d6-48ec-9943-b56da363892e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730138 Dec 21 04:03:37.167586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96413fa6-089d-4425-a30c-18d9f47863ca req-7dbc1142-ceaf-4153-b660-749ccef9cb98 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:37.167586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96413fa6-089d-4425-a30c-18d9f47863ca req-7dbc1142-ceaf-4153-b660-749ccef9cb98 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0802865 Dec 21 04:03:37.243341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96413fa6-089d-4425-a30c-18d9f47863ca req-32098432-1c6a-4233-9098-b85502ccaf98 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518692 Dec 21 04:03:38.542366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9e14dd-0c30-4fa8-9526-526cfb101b49 req-5a67a7e2-c133-4de3-a5d2-f87d92e2f854 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:38.551341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee9e14dd-0c30-4fa8-9526-526cfb101b49 req-5a67a7e2-c133-4de3-a5d2-f87d92e2f854 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0700676 Dec 21 04:03:38.611673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee9e14dd-0c30-4fa8-9526-526cfb101b49 req-bb43db57-3ad9-4297-a98c-a2c93886d491 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570869 Dec 21 04:03:39.788488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e0ee2a8-a2a8-44ef-a949-4f0f49f513f5 req-6ac894bf-65fa-47d9-8138-1e2ab1de4905 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:39.799788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e0ee2a8-a2a8-44ef-a949-4f0f49f513f5 req-6ac894bf-65fa-47d9-8138-1e2ab1de4905 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0743053 Dec 21 04:03:39.877077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e0ee2a8-a2a8-44ef-a949-4f0f49f513f5 req-102a3e04-d8b0-4dcb-be7a-177717072fb1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723641 Dec 21 04:03:41.091277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b167d1-6d89-4183-b1e1-e1512867e55a req-97fb0077-1909-4038-959c-ce09db88a82e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:41.093601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72b167d1-6d89-4183-b1e1-e1512867e55a req-97fb0077-1909-4038-959c-ce09db88a82e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1138783 Dec 21 04:03:41.193937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72b167d1-6d89-4183-b1e1-e1512867e55a req-02d13f7d-e99c-4701-986c-40cc4157027e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940771 Dec 21 04:03:42.444091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32b17935-ad55-46cb-8072-176b5c54a17c req-6bcf11f8-1a1e-4129-9f88-8eb4529c4599 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:42.460031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32b17935-ad55-46cb-8072-176b5c54a17c req-6bcf11f8-1a1e-4129-9f88-8eb4529c4599 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.1215990 Dec 21 04:03:42.529240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32b17935-ad55-46cb-8072-176b5c54a17c req-28315cfe-fac3-49dc-855a-a2dbc01ac1dc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638072 Dec 21 04:03:43.666066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d59a3d2d-c81e-431d-b688-a089d799eff8 req-a7cc9375-54fe-4461-92ee-91106fe3a75b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:43.673921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d59a3d2d-c81e-431d-b688-a089d799eff8 req-a7cc9375-54fe-4461-92ee-91106fe3a75b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0634720 Dec 21 04:03:43.717329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d59a3d2d-c81e-431d-b688-a089d799eff8 req-3f81a75b-39a4-4e18-90b4-0c043989ade0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425477 Dec 21 04:03:44.625589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-1f47ad01-80c7-443f-be88-372b215f4118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:44.627144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-1f47ad01-80c7-443f-be88-372b215f4118 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1097 time: 0.1622522 Dec 21 04:03:44.731682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-61f44788-620e-4d9d-8138-e1d863d8618b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:44.733329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-61f44788-620e-4d9d-8138-e1d863d8618b service neutron] 10.222.0.31 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 915 time: 0.0972383 Dec 21 04:03:44.802443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-cfbdba26-f49d-4a4e-a8c0-151ffa22dce9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 200 len: 217 time: 0.0612848 Dec 21 04:03:44.895666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-e5a15b50-c338-4bad-9ff3-933e41c83cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:44.897413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-e5a15b50-c338-4bad-9ff3-933e41c83cc1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.0857761 Dec 21 04:03:44.914445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-175b86a2-ce84-428a-92dc-be06b7791f7d req-befb7c0d-a274-4ffa-9bbd-eb116e5f318c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:44.917295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-175b86a2-ce84-428a-92dc-be06b7791f7d req-befb7c0d-a274-4ffa-9bbd-eb116e5f318c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0676656 Dec 21 04:03:44.951368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-c9e40ce7-9b40-4507-a1fc-a4a238a36ce3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0334415 Dec 21 04:03:45.051385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-175b86a2-ce84-428a-92dc-be06b7791f7d req-992d115b-b77f-4099-b691-213351a1a330 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233625 Dec 21 04:03:45.086452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-62c2818e-e0d2-416e-9ec8-f32f08cb4aa9 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273749 Dec 21 04:03:45.185805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f73dc-026b-465e-a584-c3f3faecd2f0 req-0a4cf483-d12b-4e96-95f8-65ae85a36d10 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885680 Dec 21 04:03:46.215221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6770ed0-034c-45b7-ab8e-3e404877b82b req-faf2a9bf-0946-49fe-a40a-a325d371f4e4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:46.225824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6770ed0-034c-45b7-ab8e-3e404877b82b req-faf2a9bf-0946-49fe-a40a-a325d371f4e4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 945 time: 0.0874357 Dec 21 04:03:46.290445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6770ed0-034c-45b7-ab8e-3e404877b82b req-dc7bbf58-ab65-4366-b433-24be274685e4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470195 Dec 21 04:03:47.095363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:03:47.188412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:47.213231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:03:47.215767 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4cef614-0d4d-4c10-9309-1826c37a7f02" -d '{"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-unplugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:03:47.227754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:03:47.257768 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:03:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb1f1b95-f506-4498-940f-27260f5ce480 x-openstack-request-id: req-fb1f1b95-f506-4498-940f-27260f5ce480 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:03:47.258059 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-unplugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:03:47.258315 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fb1f1b95-f506-4498-940f-27260f5ce480 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:03:47.258710 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'code': 200} Dec 21 04:03:47.289757 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:47.377818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:47.389005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.389756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.390507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.391680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.392224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.392813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.393353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.394030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.394583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.395186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.395763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.396303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.396919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:03:47.522488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5198efd7-9f2e-4219-a86f-b84a68c323de req-528ead12-36dc-4a23-9319-ee2cfe9e88c1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:47.524589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5198efd7-9f2e-4219-a86f-b84a68c323de req-528ead12-36dc-4a23-9319-ee2cfe9e88c1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0639067 Dec 21 04:03:47.621591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5198efd7-9f2e-4219-a86f-b84a68c323de req-78095cb3-b4f5-41a5-8dc0-2c83b55c7958 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903180 Dec 21 04:03:47.976011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-2e59cea9-2e7f-453b-85da-639bf750a5b1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0441434 Dec 21 04:03:48.087792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-455cc273-6b86-40e2-8cba-a5adfd1900be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:48.089853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-455cc273-6b86-40e2-8cba-a5adfd1900be service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.0464787 Dec 21 04:03:48.204955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-984280d1-d765-40ad-8693-99f009e65a5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:48.207083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-984280d1-d765-40ad-8693-99f009e65a5f service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.0951691 Dec 21 04:03:48.300131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-2c1f081b-262b-4041-b04e-3819955335b9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.0814848 Dec 21 04:03:48.367720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-a679718d-ec35-4785-b5a4-c65685ccb9a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:48.369466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-a679718d-ec35-4785-b5a4-c65685ccb9a3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0597427 Dec 21 04:03:48.453399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-e5f8e560-350f-43b0-9c0e-7ae4895e56a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:48.455325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-e5f8e560-350f-43b0-9c0e-7ae4895e56a2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0714631 Dec 21 04:03:49.018454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-f52fc398-5b69-49ee-ae7d-3d26f4cad5db service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5551500 Dec 21 04:03:49.029133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f54f465-922b-4f70-a083-de574227aed0 req-8143642f-d292-4e1e-980c-a117aa6fecac tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:49.030485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f54f465-922b-4f70-a083-de574227aed0 req-8143642f-d292-4e1e-980c-a117aa6fecac tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0711930 Dec 21 04:03:49.129291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f54f465-922b-4f70-a083-de574227aed0 req-9db6c70d-5ba5-4e0e-965d-7340d3fc85f7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908794 Dec 21 04:03:49.149705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4337f8f-dfe8-4498-bdde-6e29680b99d0 req-82aaff2b-88ad-4505-9dca-2da7455a3252 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1181760 Dec 21 04:03:49.272878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d6fb97e-0c21-4c63-8235-6a70c5b50e40 req-f0ff1b29-b2e9-462f-bf47-295b791e941a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:49.274505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d6fb97e-0c21-4c63-8235-6a70c5b50e40 req-f0ff1b29-b2e9-462f-bf47-295b791e941a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0520594 Dec 21 04:03:49.332941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d6fb97e-0c21-4c63-8235-6a70c5b50e40 req-059f514e-4001-4739-80cd-c6a458fb5151 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509484 Dec 21 04:03:49.529629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-f5e6b761-456a-45a7-b4b3-1a0539772718 req-02c15ec8-8b88-4e5d-9eb1-4a6e5a918e3d service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:03:49.530665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5e6b761-456a-45a7-b4b3-1a0539772718 req-02c15ec8-8b88-4e5d-9eb1-4a6e5a918e3d service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0061994 Dec 21 04:03:49.902391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d489623c-2665-4cab-a5b5-e703d46ac876 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:49.968361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ceb52e-1c1f-458b-93b7-a3dfbcf53c41 req-e4db8098-b77c-488f-af2c-f182c68f224e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:49.971422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96ceb52e-1c1f-458b-93b7-a3dfbcf53c41 req-e4db8098-b77c-488f-af2c-f182c68f224e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0594065 Dec 21 04:03:50.021539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96ceb52e-1c1f-458b-93b7-a3dfbcf53c41 req-b81532ac-9d67-47f0-aa6d-fdc7d1a51f99 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448680 Dec 21 04:03:50.498721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-c9aa0f97-2ce5-4730-b1d4-cc2134f3e4e8 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1635005 Dec 21 04:03:50.503597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-b42e8a37-6aea-4cd3-b6ab-21794759e7e7 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:03:50.515911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-b42e8a37-6aea-4cd3-b6ab-21794759e7e7 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0163205 Dec 21 04:03:51.113616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:03:51.212943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8861bd-2bff-4de9-b4d7-0ebbbb63875f req-5a427453-72fe-40cf-88eb-82d04e0f110b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:51.224942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb8861bd-2bff-4de9-b4d7-0ebbbb63875f req-5a427453-72fe-40cf-88eb-82d04e0f110b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1254146 Dec 21 04:03:51.317747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb8861bd-2bff-4de9-b4d7-0ebbbb63875f req-ec281c31-5a1c-4f4d-801b-f3b4ea892dac tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0889018 Dec 21 04:03:52.531122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eff091d-f915-49bf-9eb2-c057545470c8 req-7e8c25c1-641c-41b9-8289-e85176d38290 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:52.532644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5eff091d-f915-49bf-9eb2-c057545470c8 req-7e8c25c1-641c-41b9-8289-e85176d38290 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1202555 Dec 21 04:03:52.534905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-d8b42f56-43bc-4782-8698-ed9cae933bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:52.536324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-d8b42f56-43bc-4782-8698-ed9cae933bd2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89&tenant_id=9be1447e894c4d89ae0d884935aafca9 HTTP/1.1" status: 200 len: 1095 time: 0.1144953 Dec 21 04:03:52.655761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5eff091d-f915-49bf-9eb2-c057545470c8 req-aeaaab5b-ce29-48a5-9577-6c6d32a7fe60 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163952 Dec 21 04:03:52.669068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-62144a8d-a78e-45fb-bf7f-bc0fb5329ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:52.670574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-62144a8d-a78e-45fb-bf7f-bc0fb5329ea6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1095 time: 0.0610964 Dec 21 04:03:52.680593 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48f63944-6350-49b4-ba75-dee6656c87a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:52.721934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:52.776823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-c12fbc79-5830-4d98-a2a2-85f5428c4c02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:52.786995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-c12fbc79-5830-4d98-a2a2-85f5428c4c02 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 915 time: 0.1001761 Dec 21 04:03:52.831312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-bf8afa8e-0bcb-4e88-a6d1-049d368914d0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 200 len: 217 time: 0.0432675 Dec 21 04:03:52.892496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-deaf428f-8a7f-41ed-9a6e-13dbc7c9556c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:52.894104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-deaf428f-8a7f-41ed-9a6e-13dbc7c9556c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.0543191 Dec 21 04:03:52.933266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-0842ae2e-6a32-418a-bc6f-fc0796608215 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304379 Dec 21 04:03:53.146751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-575afc92-7cff-43a0-acbd-8410acc0eec5 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1986346 Dec 21 04:03:53.249057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:53.266974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93493ad3-29cf-438e-b7d9-9c24511e6f89 req-c53ab107-0da1-4ad0-a761-b01b582546dc service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1033287 Dec 21 04:03:53.823359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63976026-fb64-45f9-95fd-1c0dbda4f795 req-7942642f-a623-4162-a459-80b9800d6cb3 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:53.835564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63976026-fb64-45f9-95fd-1c0dbda4f795 req-7942642f-a623-4162-a459-80b9800d6cb3 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0938118 Dec 21 04:03:53.918366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44522) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:53.925747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63976026-fb64-45f9-95fd-1c0dbda4f795 req-9b8b26f5-cd7b-4f05-8f6a-b1a1be35ee29 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887475 Dec 21 04:03:54.099411 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0ceea64-a7d7-44a6-b279-d0ffaca676b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.268199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0ceea64-a7d7-44a6-b279-d0ffaca676b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.339776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a0ceea64-a7d7-44a6-b279-d0ffaca676b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.392643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ceea64-a7d7-44a6-b279-d0ffaca676b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=137a973e-d438-45ff-86ed-41ba98b1587d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:54.403302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a0ceea64-a7d7-44a6-b279-d0ffaca676b3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a032cd1dbdc94e11bde3f2ffc91aa306&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4827740 Dec 21 04:03:54.413718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44540) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:54.486256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa4b74bb-ba45-4194-bb97-7bb636c36d34 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.535200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa4b74bb-ba45-4194-bb97-7bb636c36d34 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.723793 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa4b74bb-ba45-4194-bb97-7bb636c36d34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.726396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa4b74bb-ba45-4194-bb97-7bb636c36d34 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:54.730342 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aa4b74bb-ba45-4194-bb97-7bb636c36d34 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/137a973e-d438-45ff-86ed-41ba98b1587d HTTP/1.1" status: 204 len: 168 time: 0.3128479 Dec 21 04:03:54.742861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa4b74bb-ba45-4194-bb97-7bb636c36d34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=137a973e-d438-45ff-86ed-41ba98b1587d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:54.941066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:55.031866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:55.045202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e219dc59-98b5-43c1-8ba9-f2e725c59c0e req-df2455c4-b717-451a-bf15-7fb56230bb54 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:55.046699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e219dc59-98b5-43c1-8ba9-f2e725c59c0e req-df2455c4-b717-451a-bf15-7fb56230bb54 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0525064 Dec 21 04:03:55.109495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e219dc59-98b5-43c1-8ba9-f2e725c59c0e req-5008cf6a-6571-43f1-bec6-651a912a7f77 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562282 Dec 21 04:03:55.717393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.173938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44596) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:56.364803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e29a84-3f64-4bab-a48b-d19594860fb9 req-d81a0b7e-4be9-4698-a252-6d82486d0270 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:56.366703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35e29a84-3f64-4bab-a48b-d19594860fb9 req-d81a0b7e-4be9-4698-a252-6d82486d0270 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0725029 Dec 21 04:03:56.388950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Request body: {'network': {'name': 'tempest-TestAggregatesBasicOps-1223744327-network', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:03:56.459094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35e29a84-3f64-4bab-a48b-d19594860fb9 req-6ba91e1a-6d9f-4e62-916a-005e1da5bbbf tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843954 Dec 21 04:03:56.567598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Made reservation on behalf of b1e8484654c440d2bf1bc712e679d1f7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:03:56.570595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.580216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.682225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.751875 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.765598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:03:56.798167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.799784 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Added segment 4885589c-7e5e-40ba-a556-47be2c1aff8e of type vlan for network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 Dec 21 04:03:56.848663 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.889638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce62e01a-6a85-491a-8391-304ba778ed19,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:56.973926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:56.975054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:56.975713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:57.073918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] Pushing event updated for resources: {'Network': ['ID=321f8864-f58a-48da-8bb4-e8a8c77b97c4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:57.086219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:03:57.132079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f302eb3-f37b-46e3-8f0b-e846ac8eaa4c admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.9570432 Dec 21 04:03:57.171250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44620) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:57.171594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Request body: {'subnet': {'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestAggregatesBasicOps-1223744327-subnet', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:03:57.602535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce46597-a2b7-49e5-85a4-4b7e7331c1d7 req-fc9596ac-9898-4d98-a58f-821b2b33c5ff tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:57.604822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ce46597-a2b7-49e5-85a4-4b7e7331c1d7 req-fc9596ac-9898-4d98-a58f-821b2b33c5ff tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0645893 Dec 21 04:03:57.660362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ce46597-a2b7-49e5-85a4-4b7e7331c1d7 req-765ec477-2fce-47ef-97d1-9ee2df0b968e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492613 Dec 21 04:03:57.723314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Made reservation on behalf of b1e8484654c440d2bf1bc712e679d1f7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:03:57.726689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:57.964423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.079214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Checking segment: {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:03:58.079625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Network hostable DHCP agents. Network: 321f8864-f58a-48da-8bb4-e8a8c77b97c4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:03:58.086176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Pushing event updated for resources: {'Subnet': ['ID=397ad12d-9cc5-4569-8929-f632b4af0a7b,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:58.218798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:03:58.324151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 321f8864-f58a-48da-8bb4-e8a8c77b97c4) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:03:58.329808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:58.330600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.336437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d289792-9f58-44e2-889d-311132e211b7 None None] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:03:58.435183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44644) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:03:58.435692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1f586c04-9047-488f-824c-dd995118ca8c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2682519 Dec 21 04:03:58.441189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-321f8864-f58a-48da-8bb4-e8a8c77b97c4', 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4', 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'fixed_ips': [{'subnet_id': '397ad12d-9cc5-4569-8929-f632b4af0a7b'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:03:58.442241 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.444143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Request body: {'router': {'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:03:58.533049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.534746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.597707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.610026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Allocated IP 172.20.0.2 (321f8864-f58a-48da-8bb4-e8a8c77b97c4/397ad12d-9cc5-4569-8929-f632b4af0a7b/68d1efc8-7662-4199-8b5e-995e8fbe81f4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:03:58.910993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:58.956142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9f7d30-c177-434a-bff8-101f44e38c39 req-54a2d3ee-da04-443b-9fba-76abba3c054a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:03:58.962481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b9f7d30-c177-434a-bff8-101f44e38c39 req-54a2d3ee-da04-443b-9fba-76abba3c054a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1088185 Dec 21 04:03:58.969956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.040849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b9f7d30-c177-434a-bff8-101f44e38c39 req-43b8f0f0-ea18-4120-8fc9-0aaf8d01745a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728745 Dec 21 04:03:59.055099 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.101149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:03:59.105942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:03:59.108765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:03:59.125179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Pushing event updated for resources: {'Port': ['ID=68d1efc8-7662-4199-8b5e-995e8fbe81f4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:59.203128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Attempting to bind port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:03:59.203513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Attempting to bind port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:03:59.203881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Attempting to bind port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 on network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:03:59.217185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:03:59.217185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Checking segment: {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:03:59.217185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.217185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Bound using segment: {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:03:59.217185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Bound port: 68d1efc8-7662-4199-8b5e-995e8fbe81f4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:03:59.217185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.357275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] For port 68d1efc8-7662-4199-8b5e-995e8fbe81f4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:03:59.362522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] For port 68d1efc8-7662-4199-8b5e-995e8fbe81f4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=68d1efc8-7662-4199-8b5e-995e8fbe81f4,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:03:59.476883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.584719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4312b57-ad78-4816-83f1-ab92a305086b None None] Pushing event updated for resources: {'Port': ['ID=68d1efc8-7662-4199-8b5e-995e8fbe81f4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:03:59.710530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.735531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:03:59.917674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Allocated IP 172.25.5.135 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/411987a8-0aa9-41f1-b0ad-519ee8c2382f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:00.082897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:00.221119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:00.236231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-364cfaa5-b736-43b4-bca6-bb75281f3a0d req-d281ec09-cd38-4ab5-b031-3cfc815905ca tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:00.239244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-364cfaa5-b736-43b4-bca6-bb75281f3a0d req-d281ec09-cd38-4ab5-b031-3cfc815905ca tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0830173 Dec 21 04:04:00.268865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:00.272287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:00.280613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:00.288975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c8115e3-4bd1-46c5-bdfc-6026f95a03c5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:00.321506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Pushing event updated for resources: {'Port': ['ID=411987a8-0aa9-41f1-b0ad-519ee8c2382f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:00.330831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-364cfaa5-b736-43b4-bca6-bb75281f3a0d req-4ce3a6bb-a3da-4a98-8936-255570a0f1e1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0849090 Dec 21 04:04:00.399588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eb3249d2-884c-4696-9d19-b44b317e00b3 None None] Provisioning complete for port 411987a8-0aa9-41f1-b0ad-519ee8c2382f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:00.400130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb3249d2-884c-4696-9d19-b44b317e00b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:00.705772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eb3249d2-884c-4696-9d19-b44b317e00b3 None None] Port 411987a8-0aa9-41f1-b0ad-519ee8c2382f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:00.861093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:00.940160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 68d1efc8-7662-4199-8b5e-995e8fbe81f4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:01.004193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:01.007569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.171626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40f2670d-54c2-4a1e-9330-ffa63c461146 None None] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:01.204656 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.251021 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.396490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d7902629-0266-4ca9-a362-280833ffaab6 None None] Provisioning complete for port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:01.396950 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7902629-0266-4ca9-a362-280833ffaab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.481451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b576fd6-75f4-4147-aa53-e7ddc1e39225 req-35bc8d70-77aa-40b6-a563-b2a65c6295f2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:01.482533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b576fd6-75f4-4147-aa53-e7ddc1e39225 req-35bc8d70-77aa-40b6-a563-b2a65c6295f2 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0609016 Dec 21 04:04:01.486257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 68d1efc8-7662-4199-8b5e-995e8fbe81f4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=68d1efc8-7662-4199-8b5e-995e8fbe81f4,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:01.528765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Router f098413b-b9c2-497a-9a5c-427101a1dba9 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:04:01.545101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b576fd6-75f4-4147-aa53-e7ddc1e39225 req-a7ff4660-053e-4d15-82fe-429cfebf8b20 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559547 Dec 21 04:04:01.574624 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7902629-0266-4ca9-a362-280833ffaab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.597580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.687312 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-d7902629-0266-4ca9-a362-280833ffaab6 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:04:01.687693 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-d7902629-0266-4ca9-a362-280833ffaab6 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:04:01.735281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:01.739131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=68d1efc8-7662-4199-8b5e-995e8fbe81f4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:01.748843 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Sync routers for ids ['f098413b-b9c2-497a-9a5c-427101a1dba9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:01.772929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Routers {'f098413b-b9c2-497a-9a5c-427101a1dba9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:01.774181 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f098413b-b9c2-497a-9a5c-427101a1dba9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:01.845584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:01.850609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d0a563c-4d03-48c7-ac46-985f03bbf459 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 3.4141581 Dec 21 04:04:01.851209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44710) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:02.035272 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Set router f098413b-b9c2-497a-9a5c-427101a1dba9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:02.377407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c2e7bab6-2d22-4edb-a5b0-fac5ac3e2a63 None None] Provisioning complete for port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:02.377787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c2e7bab6-2d22-4edb-a5b0-fac5ac3e2a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:02.480011 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:00Z', 'revision_number': 3, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:03:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:02.536853 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Checking router: f098413b-b9c2-497a-9a5c-427101a1dba9 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:02.538553 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Updating router f098413b-b9c2-497a-9a5c-427101a1dba9 port 411987a8-0aa9-41f1-b0ad-519ee8c2382f binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:04:02.634108 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:02.668656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91891e62-c375-4ed4-9c9c-31c15bbce5e1 req-cec688b4-349e-4532-a606-6ba684a9847d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:02.689842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91891e62-c375-4ed4-9c9c-31c15bbce5e1 req-cec688b4-349e-4532-a606-6ba684a9847d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.2116170 Dec 21 04:04:02.908543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 68d1efc8-7662-4199-8b5e-995e8fbe81f4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:03.035872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:03.036250 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.173771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91891e62-c375-4ed4-9c9c-31c15bbce5e1 req-ec5098a8-6f4a-4021-a880-301c4cdb0c38 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4829230 Dec 21 04:04:03.179140 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.245004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c823402-e86c-474a-a25b-ae99e1ff8fcb req-e67143af-6c3b-4d6b-a00f-0aeb05d6eb77 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:03.253761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c823402-e86c-474a-a25b-ae99e1ff8fcb req-e67143af-6c3b-4d6b-a00f-0aeb05d6eb77 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.4876566 Dec 21 04:04:03.513707 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.578189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c823402-e86c-474a-a25b-ae99e1ff8fcb req-743b843f-6d70-415a-b88c-8be0c0f5a4f8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3046560 Dec 21 04:04:03.608003 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.720398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78523f7c-4074-4cca-9c3e-19d1381f59ce None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:03.752359 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Pushing event updated for resources: {'Port': ['ID=411987a8-0aa9-41f1-b0ad-519ee8c2382f,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:03.756141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Attempting to bind port 411987a8-0aa9-41f1-b0ad-519ee8c2382f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:03.756600 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Attempting to bind port 411987a8-0aa9-41f1-b0ad-519ee8c2382f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:03.757255 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Attempting to bind port 411987a8-0aa9-41f1-b0ad-519ee8c2382f on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:03.765966 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.766411 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.766831 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.767511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.767962 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.768403 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.768805 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.769332 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.769784 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.770229 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.770622 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.771061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.771476 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:03.786632 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:03.787827 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:03.788369 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.788833 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:03.789865 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Bound port: 411987a8-0aa9-41f1-b0ad-519ee8c2382f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:03.790322 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.860021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b8bf51c6-fabb-4a0e-b4f5-df7773e42920 None None] Provisioning complete for port 411987a8-0aa9-41f1-b0ad-519ee8c2382f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:03.862431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8bf51c6-fabb-4a0e-b4f5-df7773e42920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:03.878368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Allocated IP 172.20.0.1 (321f8864-f58a-48da-8bb4-e8a8c77b97c4/397ad12d-9cc5-4569-8929-f632b4af0a7b/b416c77d-b501-4abe-8da0-404332f3b7e8) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:03.906136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4599195-14fc-4240-b2ca-c759928029bc req-08df7fbe-2c48-46c8-b3e3-e143d28a3155 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:03.908493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4599195-14fc-4240-b2ca-c759928029bc req-08df7fbe-2c48-46c8-b3e3-e143d28a3155 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1423414 Dec 21 04:04:03.932842 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] For port 411987a8-0aa9-41f1-b0ad-519ee8c2382f, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:03.936747 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] For port 411987a8-0aa9-41f1-b0ad-519ee8c2382f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=411987a8-0aa9-41f1-b0ad-519ee8c2382f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:03.956366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b8bf51c6-fabb-4a0e-b4f5-df7773e42920 None None] Port 411987a8-0aa9-41f1-b0ad-519ee8c2382f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:04.001684 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.059046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4599195-14fc-4240-b2ca-c759928029bc req-41595f9d-ebd4-41c3-adce-d6d44140d777 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1085248 Dec 21 04:04:04.069425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-782f726a-379f-496d-9cb1-9b57d9bc89c4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:04.086515 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408cf9bc-82e7-47cc-a334-27c8c403d7c7 None None] Pushing event updated for resources: {'Port': ['ID=411987a8-0aa9-41f1-b0ad-519ee8c2382f,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:04.089275 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Routers {'f098413b-b9c2-497a-9a5c-427101a1dba9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:04.089881 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f098413b-b9c2-497a-9a5c-427101a1dba9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:04.121677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.198491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-761e613a-4cac-4993-9c33-2caeb1850d99 None None] Provisioning complete for port 411987a8-0aa9-41f1-b0ad-519ee8c2382f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:04.198968 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-761e613a-4cac-4993-9c33-2caeb1850d99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.262353 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] Set router f098413b-b9c2-497a-9a5c-427101a1dba9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:04.290968 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.400713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:04.411696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:04.412157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:04.456435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.467824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-761e613a-4cac-4993-9c33-2caeb1850d99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.554785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Pushing event updated for resources: {'Port': ['ID=b416c77d-b501-4abe-8da0-404332f3b7e8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:04.565954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-761e613a-4cac-4993-9c33-2caeb1850d99 None None] For port 411987a8-0aa9-41f1-b0ad-519ee8c2382f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=411987a8-0aa9-41f1-b0ad-519ee8c2382f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:04.629202 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-761e613a-4cac-4993-9c33-2caeb1850d99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:04.644932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.660724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.661562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.662201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.662910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.663811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.665634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.667627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.672394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.672394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.672394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.672394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.672394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:04.814303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-761e613a-4cac-4993-9c33-2caeb1850d99 None None] Pushing event updated for resources: {'Port': ['ID=411987a8-0aa9-41f1-b0ad-519ee8c2382f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:04.881879 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:04:04.976357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-501b124e-e12f-4126-bfc9-4dbbdf6a7dc1 None None] Provisioning complete for port b416c77d-b501-4abe-8da0-404332f3b7e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:04.977079 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:00Z', 'revision_number': 3, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:04:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:04.977234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-501b124e-e12f-4126-bfc9-4dbbdf6a7dc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:05.021351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c009df88-20b9-4834-a970-ab043beb74fd req-bb6f2910-bd99-49bb-ab81-e868a3e3a740 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:05.031434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c009df88-20b9-4834-a970-ab043beb74fd req-bb6f2910-bd99-49bb-ab81-e868a3e3a740 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.2128620 Dec 21 04:04:05.050863 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-695b6a55-6d9f-4388-8891-626189f6912a None None] The sync data for ids ['f098413b-b9c2-497a-9a5c-427101a1dba9'] in n-d-822053-11 is: [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:00Z', 'revision_number': 3, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:04:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:05.072982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-501b124e-e12f-4126-bfc9-4dbbdf6a7dc1 None None] Port b416c77d-b501-4abe-8da0-404332f3b7e8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:05.119221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-07167c22-238c-4f89-8a8c-3a6ad5a7b517 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:05.128963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-07167c22-238c-4f89-8a8c-3a6ad5a7b517 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.5465550 Dec 21 04:04:05.199079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-e4da70b6-1049-41b7-bec5-d3e793118637 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/quotas/2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 375 time: 0.0690353 Dec 21 04:04:05.259108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c009df88-20b9-4834-a970-ab043beb74fd req-f178e7ff-7d61-41fe-9dce-2faa775ddb50 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2264528 Dec 21 04:04:05.262248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:05.326106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-7ccc6980-4747-4f44-a061-66042f665858 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1216421 Dec 21 04:04:05.429980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-358be0b7-58d1-4ddd-800b-8724bca6a56f service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:04:05.452074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-358be0b7-58d1-4ddd-800b-8724bca6a56f service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0412705 Dec 21 04:04:05.883504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-7e5c0d78-3a04-4561-b90f-19a6eb5a5adf service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4299886 Dec 21 04:04:05.945478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:05.987845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:06.174586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:06.285055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-83b3f6ba-a8e4-49fe-bf51-951df1241883 service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3888397 Dec 21 04:04:06.286468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Pushing event updated for resources: {'Port': ['ID=b416c77d-b501-4abe-8da0-404332f3b7e8,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:06.522052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:06.523694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:06.671092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Router f098413b-b9c2-497a-9a5c-427101a1dba9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:04:06.814895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5da30a35-11cb-47af-bc06-88a6ea4296a4 None None] Provisioning complete for port b416c77d-b501-4abe-8da0-404332f3b7e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:06.814895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5da30a35-11cb-47af-bc06-88a6ea4296a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:06.838608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ea0f45-d070-4c3f-a267-56b4a0666594 req-1035a5c7-8f7c-4662-80e7-932339e3580a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:06.840148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78ea0f45-d070-4c3f-a267-56b4a0666594 req-1035a5c7-8f7c-4662-80e7-932339e3580a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1038866 Dec 21 04:04:06.848625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5da30a35-11cb-47af-bc06-88a6ea4296a4 None None] Port b416c77d-b501-4abe-8da0-404332f3b7e8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:06.857516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 411987a8-0aa9-41f1-b0ad-519ee8c2382f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:06.867891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:06.873946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b46ce1c-6175-48ed-a930-a01a00e42f82 admin admin] 10.222.0.18 "PUT /v2.0/routers/f098413b-b9c2-497a-9a5c-427101a1dba9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0183313 Dec 21 04:04:06.909911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 411987a8-0aa9-41f1-b0ad-519ee8c2382f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:06.910431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:06.913257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78ea0f45-d070-4c3f-a267-56b4a0666594 req-a162c1a7-56cc-412a-bee3-1980d8684f50 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660367 Dec 21 04:04:07.046377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78d0250b-3d63-409f-bffa-3cf285ad9bb1 req-cdb5bdbd-0360-4c4a-b701-1f323488d602 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 210 time: 0.0344300 Dec 21 04:04:07.546316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Sync routers for ids ['f098413b-b9c2-497a-9a5c-427101a1dba9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:07.557690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Routers {'f098413b-b9c2-497a-9a5c-427101a1dba9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:07.558383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f098413b-b9c2-497a-9a5c-427101a1dba9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:07.751739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Set router f098413b-b9c2-497a-9a5c-427101a1dba9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:07.823415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44852) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:07.828353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Request body: {'network': {'name': 'tempest-TestAggregatesBasicOps-1474782712-network', 'tenant_id': 'd0265404445c475c91c044c23135c8e8'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:07.981828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Made reservation on behalf of d0265404445c475c91c044c23135c8e8 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:07.981828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:07.984386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:05Z', 'revision_number': 4, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:04:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b416c77d-b501-4abe-8da0-404332f3b7e8', 'name': '', 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'mac_address': 'fa:16:3e:1f:56:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2353, 'fixed_ips': [{'subnet_id': '397ad12d-9cc5-4569-8929-f632b4af0a7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:03Z', 'updated_at': '2021-12-21T04:04:05Z', 'revision_number': 2, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'subnets': [{'id': '397ad12d-9cc5-4569-8929-f632b4af0a7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:07.990726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.022791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Checking router: f098413b-b9c2-497a-9a5c-427101a1dba9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:08.023422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Updating router f098413b-b9c2-497a-9a5c-427101a1dba9 port b416c77d-b501-4abe-8da0-404332f3b7e8 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:04:08.047922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e2b5ed-6b62-4d00-befa-d710d4074222 req-ba17f26b-75e5-47a5-b064-0bb4e926e187 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:08.050505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01e2b5ed-6b62-4d00-befa-d710d4074222 req-ba17f26b-75e5-47a5-b064-0bb4e926e187 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0561993 Dec 21 04:04:08.065634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.112041 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.148911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01e2b5ed-6b62-4d00-befa-d710d4074222 req-8d89f199-8556-4625-9527-d5a2a2256548 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0910592 Dec 21 04:04:08.217449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.222959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc438045-1aa3-4d2c-9484-0b4611236ddc req-5ee78fd9-b424-40c9-a8e6-3f48f7b78e34 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 210 time: 0.0471370 Dec 21 04:04:08.263431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c59cea18-a9c8-4ea0-9778-3a0ee9a6951a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:08.272942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:04:08.281214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.281718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.282141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.282561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.283012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.284049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.284731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.285145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.288048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.288476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.290300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.290300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.290300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:08.310143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.310577 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Added segment 96752b4d-aeb4-4613-9b7c-f909e68a6e7a of type vlan for network 9364af8e-592c-4593-8248-b0d7a642feca Dec 21 04:04:08.377643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.453777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.498370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.499404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:08.499985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.557633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.570908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] Pushing event updated for resources: {'Network': ['ID=9364af8e-592c-4593-8248-b0d7a642feca,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:08.593836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9364af8e-592c-4593-8248-b0d7a642feca details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:04:08.619040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d59e9468-9f81-421f-8b77-e313e6e2789e admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.7931707 Dec 21 04:04:08.620657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44878) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:08.625463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Request body: {'subnet': {'network_id': '9364af8e-592c-4593-8248-b0d7a642feca', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestAggregatesBasicOps-1474782712-subnet', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:08.707458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5195cc1-04dc-4f64-8351-4c7092d79c39 None None] Pushing event updated for resources: {'Port': ['ID=b416c77d-b501-4abe-8da0-404332f3b7e8,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:08.723411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Made reservation on behalf of d0265404445c475c91c044c23135c8e8 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:08.733937 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.790096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Attempting to bind port b416c77d-b501-4abe-8da0-404332f3b7e8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:08.790580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Attempting to bind port b416c77d-b501-4abe-8da0-404332f3b7e8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:08.791533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Attempting to bind port b416c77d-b501-4abe-8da0-404332f3b7e8 on network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:08.825225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:08.826571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Checking segment: {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:08.828836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.829858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Bound using segment: {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:08.831406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Bound port: b416c77d-b501-4abe-8da0-404332f3b7e8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4885589c-7e5e-40ba-a556-47be2c1aff8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:08.832438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:08.963825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] For port b416c77d-b501-4abe-8da0-404332f3b7e8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:08.968992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] For port b416c77d-b501-4abe-8da0-404332f3b7e8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b416c77d-b501-4abe-8da0-404332f3b7e8,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:08.991702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2a32352a-b46f-4fb6-8ddf-b5a404149ef7 None None] Provisioning complete for port b416c77d-b501-4abe-8da0-404332f3b7e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:08.995702 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2a32352a-b46f-4fb6-8ddf-b5a404149ef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:09.036388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2a32352a-b46f-4fb6-8ddf-b5a404149ef7 None None] Port b416c77d-b501-4abe-8da0-404332f3b7e8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:09.047487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:09.116904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Routers {'f098413b-b9c2-497a-9a5c-427101a1dba9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:09.116904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f098413b-b9c2-497a-9a5c-427101a1dba9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:09.154449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5195cc1-04dc-4f64-8351-4c7092d79c39 None None] Pushing event updated for resources: {'Port': ['ID=b416c77d-b501-4abe-8da0-404332f3b7e8,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:09.245610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] Set router f098413b-b9c2-497a-9a5c-427101a1dba9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:09.456833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad85507-b61a-4368-b689-189f528be3c9 req-81f1859d-650d-45f2-97b0-1efb8840a5af tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:09.460324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ad85507-b61a-4368-b689-189f528be3c9 req-81f1859d-650d-45f2-97b0-1efb8840a5af tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1596413 Dec 21 04:04:09.503206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74d5ad34-a98a-4e2a-b440-5ced3a0c7a21 req-2b83e179-8d51-4f40-8629-c0c2b922f254 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 210 time: 0.0885973 Dec 21 04:04:09.568762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-06af00b9-c3e5-4b1c-bf3f-5edc66537cc9 None None] Provisioning complete for port b416c77d-b501-4abe-8da0-404332f3b7e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:09.569136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06af00b9-c3e5-4b1c-bf3f-5edc66537cc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:09.585364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ad85507-b61a-4368-b689-189f528be3c9 req-198f94e2-bfe0-4c92-a83c-84e3f549f941 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076088 Dec 21 04:04:09.592940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:05Z', 'revision_number': 4, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:04:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b416c77d-b501-4abe-8da0-404332f3b7e8', 'name': '', 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'mac_address': 'fa:16:3e:1f:56:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2353, 'fixed_ips': [{'subnet_id': '397ad12d-9cc5-4569-8929-f632b4af0a7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:03Z', 'updated_at': '2021-12-21T04:04:08Z', 'revision_number': 4, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'subnets': [{'id': '397ad12d-9cc5-4569-8929-f632b4af0a7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:09.712813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-b6701ac3-0312-4622-b735-883a9b349180 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:09.715194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-b6701ac3-0312-4622-b735-883a9b349180 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.1557798 Dec 21 04:04:09.742764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'port': {'device_id': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'admin_state_up': True, 'tenant_id': '2d46b810d87943059c90ba895934ed3b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:09.777427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:09.806748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1400ec73-6f67-4e5f-a1e1-4adfcebf7fba None None] The sync data for ids ['f098413b-b9c2-497a-9a5c-427101a1dba9'] in n-d-822053-11 is: [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:05Z', 'revision_number': 4, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:04:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b416c77d-b501-4abe-8da0-404332f3b7e8', 'name': '', 'network_id': '321f8864-f58a-48da-8bb4-e8a8c77b97c4', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'mac_address': 'fa:16:3e:1f:56:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2353, 'fixed_ips': [{'subnet_id': '397ad12d-9cc5-4569-8929-f632b4af0a7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:03Z', 'updated_at': '2021-12-21T04:04:08Z', 'revision_number': 4, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'subnets': [{'id': '397ad12d-9cc5-4569-8929-f632b4af0a7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:09.967393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06af00b9-c3e5-4b1c-bf3f-5edc66537cc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.007275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Checking segment: {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:10.007275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Network hostable DHCP agents. Network: 9364af8e-592c-4593-8248-b0d7a642feca, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:04:10.031162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-06af00b9-c3e5-4b1c-bf3f-5edc66537cc9 None None] For port b416c77d-b501-4abe-8da0-404332f3b7e8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b416c77d-b501-4abe-8da0-404332f3b7e8,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:10.051163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Pushing event updated for resources: {'Subnet': ['ID=12320615-c838-4018-a838-1f5ae3fc2f45,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:10.128213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06af00b9-c3e5-4b1c-bf3f-5edc66537cc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.177182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06af00b9-c3e5-4b1c-bf3f-5edc66537cc9 None None] Pushing event updated for resources: {'Port': ['ID=b416c77d-b501-4abe-8da0-404332f3b7e8,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:10.249390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Network 9364af8e-592c-4593-8248-b0d7a642feca is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:04:10.251578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:10.255518 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.319031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9364af8e-592c-4593-8248-b0d7a642feca) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:10.325489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:10.326199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.327589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-720b4755-f9e2-4a9c-a51a-1485946486a6 None None] Network 9364af8e-592c-4593-8248-b0d7a642feca requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:10.442094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-47928fb0-b0b2-42f4-8257-2fc407a57b66 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.8203304 Dec 21 04:04:10.444691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:10.451391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Request body: {'router': {'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:10.512532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Allocated IP 172.20.0.10 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/fbc9f75a-3bde-4d88-896d-2cf1f9f48d27) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:10.515453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9364af8e-592c-4593-8248-b0d7a642feca', 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca', 'project_id': 'd0265404445c475c91c044c23135c8e8', 'fixed_ips': [{'subnet_id': '12320615-c838-4018-a838-1f5ae3fc2f45'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:04:10.517911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.586475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.588444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.729855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Allocated IP 172.20.0.2 (9364af8e-592c-4593-8248-b0d7a642feca/12320615-c838-4018-a838-1f5ae3fc2f45/b3af100c-fb35-4ba2-ad34-9fa7557bc975) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:10.758575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.882829 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:10.905162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24da21c9-5f55-4e4b-a276-3512c0bc3eae req-0a30b780-3fe8-45da-9e64-64b99aff5c3c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 210 time: 0.1149313 Dec 21 04:04:10.952333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab8404a-3829-4f56-95ac-41409b892e91 req-316f2a9e-0412-47b3-8c3e-ef4c87a812c5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:10.954215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ab8404a-3829-4f56-95ac-41409b892e91 req-316f2a9e-0412-47b3-8c3e-ef4c87a812c5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.1751533 Dec 21 04:04:10.986245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.000371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b416c77d-b501-4abe-8da0-404332f3b7e8 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:11.090651 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.099219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b416c77d-b501-4abe-8da0-404332f3b7e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:11.099585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.114315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.126862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ab8404a-3829-4f56-95ac-41409b892e91 req-16bb54d3-d5be-46a8-bf82-bb320281e6ec tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1641467 Dec 21 04:04:11.130835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.217842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:04:11.220366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'cee69311-8acd-4064-a7b4-06c97526b389'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:11.246176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:11.274055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Network 9364af8e-592c-4593-8248-b0d7a642feca is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:11.288718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:11.290551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:11.296983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:11.315874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:11.332375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:11.345193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Pushing event updated for resources: {'Port': ['ID=b3af100c-fb35-4ba2-ad34-9fa7557bc975,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:11.397999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:11.410173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.556297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-bd32c465-d708-43e8-bb28-92964814c588 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8195822 Dec 21 04:04:11.562743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.594800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.609755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Request body: {'port': {'device_id': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:11.648048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Attempting to bind port b3af100c-fb35-4ba2-ad34-9fa7557bc975 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:11.648455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Attempting to bind port b3af100c-fb35-4ba2-ad34-9fa7557bc975 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:11.648819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Attempting to bind port b3af100c-fb35-4ba2-ad34-9fa7557bc975 on network 9364af8e-592c-4593-8248-b0d7a642feca {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:11.685089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:11.685537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Checking segment: {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:11.685905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.686313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Bound using segment: {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:11.686843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Bound port: b3af100c-fb35-4ba2-ad34-9fa7557bc975, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:11.687397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.714595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.774796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Allocated IP 172.25.5.33 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/1db082eb-9ece-4146-81d6-68e67c486908) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:11.803069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:11.831191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2dad5af3-2493-4ee8-9ed5-b1d23685d9db None None] Provisioning complete for port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:11.831191 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2dad5af3-2493-4ee8-9ed5-b1d23685d9db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.882514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'network_id': '1d34dd2a-275c-4073-aad9-16b29c6ef929', 'port_id': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'mac_address': 'fa:16:3e:52:07:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'af597cc9-d6ea-4007-b8f3-5cbc38b23a3a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:04:11.904828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:11.953670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2dad5af3-2493-4ee8-9ed5-b1d23685d9db None None] Port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:11.959545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] For port b3af100c-fb35-4ba2-ad34-9fa7557bc975, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:11.991312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] For port b3af100c-fb35-4ba2-ad34-9fa7557bc975, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b3af100c-fb35-4ba2-ad34-9fa7557bc975,segment=NetworkSegment(96752b4d-aeb4-4613-9b7c-f909e68a6e7a),segment_id=96752b4d-aeb4-4613-9b7c-f909e68a6e7a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:12.008326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.044423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 22270d5e-6f54-41c2-a9eb-fd2c24aef262 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:04:12.083018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:04:12.088693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:12.094737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52a3b76-1f12-44f7-910e-c419b71053f0 req-b90a6bc7-62b0-476b-a937-7cd84f0fae3b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:12.096272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c52a3b76-1f12-44f7-910e-c419b71053f0 req-b90a6bc7-62b0-476b-a937-7cd84f0fae3b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 932 time: 0.1055727 Dec 21 04:04:12.100808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.128228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Transition to ACTIVE for port object fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:04:12.154320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c52a3b76-1f12-44f7-910e-c419b71053f0 req-9d1d6a29-fb86-4484-ae97-62ace20d3089 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504982 Dec 21 04:04:12.249110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c175b5-7c22-4290-a4df-2b1f8ff3dd8d req-08e4759f-5d71-43cf-bc19-a7486d2d2472 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:12.249660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.250852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1c175b5-7c22-4290-a4df-2b1f8ff3dd8d req-08e4759f-5d71-43cf-bc19-a7486d2d2472 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 943 time: 0.0507402 Dec 21 04:04:12.262273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.265528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.278518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.297682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:12.307183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:12.314111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:12.319767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Pushing event updated for resources: {'Port': ['ID=1db082eb-9ece-4146-81d6-68e67c486908,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:12.362284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba8fea4c-fefa-4847-a223-8c2d4d4b14bf None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:12.380420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Pushing event updated for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:12.422998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:12.428932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1c175b5-7c22-4290-a4df-2b1f8ff3dd8d req-a74cd448-9a02-47bd-8b52-6d95d7aabb8e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1712995 Dec 21 04:04:12.537684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec566fa2-abce-4ad6-97ad-40013e84ab06 None None] Pushing event updated for resources: {'Port': ['ID=b3af100c-fb35-4ba2-ad34-9fa7557bc975,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:12.544888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-af5061b0-7f97-4235-928f-2d82b7c6663c None None] Provisioning complete for port 1db082eb-9ece-4146-81d6-68e67c486908 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:12.545684 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af5061b0-7f97-4235-928f-2d82b7c6663c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.604216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-af5061b0-7f97-4235-928f-2d82b7c6663c None None] Port 1db082eb-9ece-4146-81d6-68e67c486908 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:12.610417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Attempting to bind port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:12.611584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Attempting to bind port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:12.611584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Attempting to bind port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:12.623372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:04:12.623711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Attempting to bind port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:12.629961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:12.629961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:12.630241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:12.630448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Bound port: fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:12.630812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.715561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['22270d5e-6f54-41c2-a9eb-fd2c24aef262'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:12.787457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:12.793095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:12.957669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:12.990108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:13.028444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:13.029079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:13.030595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] 10.222.0.31 "PUT /v2.0/ports/fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 HTTP/1.1" status: 200 len: 1093 time: 1.4462497 Dec 21 04:04:13.031765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:13.060295 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0afd4394-3875-4f8e-9741-da2cb829f0f7" -d '{"events": [{"name": "network-changed", "server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:13.122318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c76da8-8d05-404f-b1ec-ce8cd46a0385 service neutron] Pushing event updated for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:13.263239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:13.325202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-25e89a30-5a97-4835-a59b-f7e86ef81e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:13.327169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-25e89a30-5a97-4835-a59b-f7e86ef81e8c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 1096 time: 0.1750302 Dec 21 04:04:13.404321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed2c154-1b7c-44a4-9466-a902b76a3a62 req-e4956a40-1850-4423-8bcf-bfd9cd0ad2b9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:13.412046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ed2c154-1b7c-44a4-9466-a902b76a3a62 req-e4956a40-1850-4423-8bcf-bfd9cd0ad2b9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 944 time: 0.1320965 Dec 21 04:04:13.415289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-af88ae0a-ffbf-485f-979b-4583124b1208 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 HTTP/1.1" status: 200 len: 217 time: 0.0617268 Dec 21 04:04:13.508224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ed2c154-1b7c-44a4-9466-a902b76a3a62 req-a0f7caaa-cfd8-407e-9a94-6e3789dc90f7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950370 Dec 21 04:04:13.510024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-1c2df2e4-5919-4b2a-ba06-57ddb6edf8b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:13.511610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-1c2df2e4-5919-4b2a-ba06-57ddb6edf8b2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0822072 Dec 21 04:04:13.550717 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01a3f3bf-ddbe-4868-8ea6-eacb23025dcc x-openstack-request-id: req-01a3f3bf-ddbe-4868-8ea6-eacb23025dcc {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:13.550717 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:13.550717 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-01a3f3bf-ddbe-4868-8ea6-eacb23025dcc {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:13.550717 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27', 'status': 'completed', 'code': 200} Dec 21 04:04:13.569465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-afd19eb1-0432-4344-9706-a27948fd3002 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:13.573889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-afd19eb1-0432-4344-9706-a27948fd3002 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0505099 Dec 21 04:04:13.595049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Router 11cafb16-8ca6-482d-8bb6-31ace33fd760 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:04:13.805372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:13.819420 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Sync routers for ids ['11cafb16-8ca6-482d-8bb6-31ace33fd760'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:13.834336 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Routers {'11cafb16-8ca6-482d-8bb6-31ace33fd760'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:13.837474 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['11cafb16-8ca6-482d-8bb6-31ace33fd760'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:13.856319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad78f40-62a8-487c-8c74-60c2adb0427e req-896bdfa6-e652-4046-b400-140dacbfff96 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:13.877254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aad78f40-62a8-487c-8c74-60c2adb0427e req-896bdfa6-e652-4046-b400-140dacbfff96 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 944 time: 0.2504232 Dec 21 04:04:13.889799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:13.891697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e50885c9-9023-47cc-a860-4f7548cfc75e admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.4458332 Dec 21 04:04:13.893936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:13.904402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-af99e21b-d921-460f-8e97-e8bfafd1022e service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3241172 Dec 21 04:04:13.964194 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Set router 11cafb16-8ca6-482d-8bb6-31ace33fd760 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:13.965309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aad78f40-62a8-487c-8c74-60c2adb0427e req-461aa66a-020b-4fd1-b7e7-142e1a13b4a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870931 Dec 21 04:04:13.967298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10c5363e-7960-4ba8-9680-2fe797a4d931 None None] Network 9364af8e-592c-4593-8248-b0d7a642feca requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:14.079075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b6331773-8814-4a36-a460-6f2cd228d802 None None] Provisioning complete for port b3af100c-fb35-4ba2-ad34-9fa7557bc975 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:14.080063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6331773-8814-4a36-a460-6f2cd228d802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.112289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e293bdd8-da77-41af-a6e4-ee71d22827ef req-8e2437e0-e198-47b4-a3a4-f19b7863738d service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1696105 Dec 21 04:04:14.205416 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:12Z', 'revision_number': 3, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:14.228862 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6331773-8814-4a36-a460-6f2cd228d802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.246707 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Checking router: 11cafb16-8ca6-482d-8bb6-31ace33fd760 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:14.247080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Updating router 11cafb16-8ca6-482d-8bb6-31ace33fd760 port 1db082eb-9ece-4146-81d6-68e67c486908 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:04:14.278395 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.295612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b6331773-8814-4a36-a460-6f2cd228d802 None None] For port b3af100c-fb35-4ba2-ad34-9fa7557bc975, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b3af100c-fb35-4ba2-ad34-9fa7557bc975,segment=NetworkSegment(96752b4d-aeb4-4613-9b7c-f909e68a6e7a),segment_id=96752b4d-aeb4-4613-9b7c-f909e68a6e7a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:14.403889 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6331773-8814-4a36-a460-6f2cd228d802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.454623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-bb3b9968-f9cc-4a4d-b556-4bd195387c85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:14.456252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-bb3b9968-f9cc-4a4d-b556-4bd195387c85 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 1096 time: 0.0819254 Dec 21 04:04:14.518878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6331773-8814-4a36-a460-6f2cd228d802 None None] Pushing event updated for resources: {'Port': ['ID=b3af100c-fb35-4ba2-ad34-9fa7557bc975,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:14.648755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-db18670c-9ddd-4796-b9f5-59a80dce7e79 None None] Provisioning complete for port b3af100c-fb35-4ba2-ad34-9fa7557bc975 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:14.649128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db18670c-9ddd-4796-b9f5-59a80dce7e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.733635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-2dc0bfb5-a6ea-4f98-8792-d620050d385d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:14.735516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-2dc0bfb5-a6ea-4f98-8792-d620050d385d service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.2702346 Dec 21 04:04:14.776551 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.828870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b9fe4-0ffc-4d45-b041-b09b04a23a3a req-7c1a460a-1d77-4465-a756-9be1c960ca3b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:14.836739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-174b9fe4-0ffc-4d45-b041-b09b04a23a3a req-7c1a460a-1d77-4465-a756-9be1c960ca3b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 944 time: 0.2024775 Dec 21 04:04:14.843036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-65cdb311-b2f8-4c4a-b810-1c4b91e5101e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 HTTP/1.1" status: 200 len: 217 time: 0.0930893 Dec 21 04:04:14.871783 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.896348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3af100c-fb35-4ba2-ad34-9fa7557bc975 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:14.953808 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Attempting to bind port 1db082eb-9ece-4146-81d6-68e67c486908 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:14.954190 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Attempting to bind port 1db082eb-9ece-4146-81d6-68e67c486908 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:14.954403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-3a8fe042-788d-4296-baa6-49a0ac41a657 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:14.954877 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Attempting to bind port 1db082eb-9ece-4146-81d6-68e67c486908 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:14.955916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-3a8fe042-788d-4296-baa6-49a0ac41a657 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.1008930 Dec 21 04:04:14.956674 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd6a3cf-9d1d-4e5d-b2f2-f7fa2951f5b4 None None] Pushing event updated for resources: {'Port': ['ID=1db082eb-9ece-4146-81d6-68e67c486908,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:14.959435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-174b9fe4-0ffc-4d45-b041-b09b04a23a3a req-a9527bec-b968-49aa-a26b-c602a072cc77 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1218939 Dec 21 04:04:14.982463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b66f118-7ace-4a7e-89c0-9e108e559382 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:14.994527 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:14.995455 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:14.996064 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:14.996759 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:14.997559 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Bound port: 1db082eb-9ece-4146-81d6-68e67c486908, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:14.998290 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.088499 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] For port 1db082eb-9ece-4146-81d6-68e67c486908, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:15.094249 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] For port 1db082eb-9ece-4146-81d6-68e67c486908, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1db082eb-9ece-4146-81d6-68e67c486908,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:15.094593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b3af100c-fb35-4ba2-ad34-9fa7557bc975 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:15.095076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.119805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5c2ef0be-57d4-425f-af6c-89c07cb26ce5 None None] Provisioning complete for port 1db082eb-9ece-4146-81d6-68e67c486908 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:15.120349 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c2ef0be-57d4-425f-af6c-89c07cb26ce5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.130211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-7fe9b177-d11b-48fd-b1bb-9a321857390d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:15.131982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-7fe9b177-d11b-48fd-b1bb-9a321857390d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1635590 Dec 21 04:04:15.152290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:15.170116 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.194131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf93f80e-6e5c-46f5-a1d1-937512c88008 req-2f988e06-12e8-4242-8fff-b7ee533092d7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:15.201297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf93f80e-6e5c-46f5-a1d1-937512c88008 req-2f988e06-12e8-4242-8fff-b7ee533092d7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 944 time: 0.1057312 Dec 21 04:04:15.208969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5c2ef0be-57d4-425f-af6c-89c07cb26ce5 None None] Port 1db082eb-9ece-4146-81d6-68e67c486908 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:15.214419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20ac45d4-c61f-44c8-9a34-904f9a55a292 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:15.270313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.279362 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Routers {'11cafb16-8ca6-482d-8bb6-31ace33fd760'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:15.280336 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['11cafb16-8ca6-482d-8bb6-31ace33fd760'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:15.281788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:15.282165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.321635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf93f80e-6e5c-46f5-a1d1-937512c88008 req-04e537ea-8cdc-4c75-8ab3-02fdcd01a59e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1193986 Dec 21 04:04:15.351480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-9a6f83f4-5889-4201-9a4e-fcc6cecf8a8d service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2075715 Dec 21 04:04:15.355518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c369c65f-48e5-4b6c-8cac-e9998233fe4a None None] Provisioning complete for port 1db082eb-9ece-4146-81d6-68e67c486908 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:15.355899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c369c65f-48e5-4b6c-8cac-e9998233fe4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.454000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd6a3cf-9d1d-4e5d-b2f2-f7fa2951f5b4 None None] Pushing event updated for resources: {'Port': ['ID=1db082eb-9ece-4146-81d6-68e67c486908,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:15.477426 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.483872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0afd4394-3875-4f8e-9741-da2cb829f0f7 req-58814a6b-0e5c-440b-b667-0710309885eb service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238844 Dec 21 04:04:15.499445 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] Set router 11cafb16-8ca6-482d-8bb6-31ace33fd760 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:15.529639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:15.533347 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4116b46b-1908-44c3-b623-6a59f168dbcb" -d '{"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-plugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:15.553342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:15.572628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Allocated IP 172.20.0.1 (9364af8e-592c-4593-8248-b0d7a642feca/12320615-c838-4018-a838-1f5ae3fc2f45/8a790eab-7037-47d2-bc40-f27b57315c6d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:15.595242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cebb20e6-ea85-4dee-a21e-9c776d536ccf x-openstack-request-id: req-cebb20e6-ea85-4dee-a21e-9c776d536ccf {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:15.595681 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-plugged", "status": "completed", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:15.596082 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cebb20e6-ea85-4dee-a21e-9c776d536ccf {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:15.596545 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'code': 200} Dec 21 04:04:15.615371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c369c65f-48e5-4b6c-8cac-e9998233fe4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.638891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.642243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c369c65f-48e5-4b6c-8cac-e9998233fe4a None None] For port 1db082eb-9ece-4146-81d6-68e67c486908, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1db082eb-9ece-4146-81d6-68e67c486908,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:15.725721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.750693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c369c65f-48e5-4b6c-8cac-e9998233fe4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.761731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:15.859676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:15.879903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Network 9364af8e-592c-4593-8248-b0d7a642feca is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:15.883548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c369c65f-48e5-4b6c-8cac-e9998233fe4a None None] Pushing event updated for resources: {'Port': ['ID=1db082eb-9ece-4146-81d6-68e67c486908,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:15.902698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:15.907410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:15.988725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Pushing event updated for resources: {'Port': ['ID=8a790eab-7037-47d2-bc40-f27b57315c6d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:16.005329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:16.053391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30515439-8b9b-45a0-a6fd-41b3be34ab45 req-e5f35e9c-3e89-439a-9be8-0966516800c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:16.054903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30515439-8b9b-45a0-a6fd-41b3be34ab45 req-e5f35e9c-3e89-439a-9be8-0966516800c4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1098 time: 0.1040161 Dec 21 04:04:16.084597 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:12Z', 'revision_number': 3, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:16.121750 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc4c02d7-ef96-4ccf-97df-6530bfffa9b6 None None] The sync data for ids ['11cafb16-8ca6-482d-8bb6-31ace33fd760'] in n-d-822053-11 is: [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:12Z', 'revision_number': 3, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:16.159023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30515439-8b9b-45a0-a6fd-41b3be34ab45 req-1842e7d4-c2b6-4b4d-bfa4-0bc5fd8dddfd service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930889 Dec 21 04:04:16.182537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bada9c8-1c70-4f20-9017-f28820e1e090 req-d71ea99e-3956-4fab-a7b9-e46e64594fe6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:16.184791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bada9c8-1c70-4f20-9017-f28820e1e090 req-d71ea99e-3956-4fab-a7b9-e46e64594fe6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 944 time: 0.0803857 Dec 21 04:04:16.239433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bada9c8-1c70-4f20-9017-f28820e1e090 req-967778b9-6321-4d87-a720-25af8cb59618 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483701 Dec 21 04:04:16.274822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:16.283905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-73618ce6-9cd2-467c-8a5f-2f0f09a1863a None None] Provisioning complete for port 8a790eab-7037-47d2-bc40-f27b57315c6d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:16.285208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-73618ce6-9cd2-467c-8a5f-2f0f09a1863a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:16.343630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-73618ce6-9cd2-467c-8a5f-2f0f09a1863a None None] Port 8a790eab-7037-47d2-bc40-f27b57315c6d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:16.518652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:16.556130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950a2a63-100b-47ac-9142-538bc07276c5 req-bcb87fc4-030f-4d62-bd18-df28d5b28140 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:16.558187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950a2a63-100b-47ac-9142-538bc07276c5 req-bcb87fc4-030f-4d62-bd18-df28d5b28140 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1090834 Dec 21 04:04:16.605605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:16.646104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950a2a63-100b-47ac-9142-538bc07276c5 req-4e6ca202-c380-47c6-a1a2-ddb92ad3b1cf tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746560 Dec 21 04:04:16.681029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:16.698519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Pushing event updated for resources: {'Port': ['ID=8a790eab-7037-47d2-bc40-f27b57315c6d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:16.829084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Network 9364af8e-592c-4593-8248-b0d7a642feca is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:16.830728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:16.882756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1db082eb-9ece-4146-81d6-68e67c486908 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:16.968747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1db082eb-9ece-4146-81d6-68e67c486908 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:16.969133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:17.050425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Router 11cafb16-8ca6-482d-8bb6-31ace33fd760 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:04:17.153735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:04:17.271209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:17.293573 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2187f0ab-fe41-432c-9a9d-b1e78a62924a admin admin] 10.222.0.18 "PUT /v2.0/routers/11cafb16-8ca6-482d-8bb6-31ace33fd760/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3976748 Dec 21 04:04:17.422212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4896e52d-64b9-4a88-9b90-563a1791291b req-4bf201d3-a2d5-4774-bfba-fd20b7a8ac02 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:17.435480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4896e52d-64b9-4a88-9b90-563a1791291b req-4bf201d3-a2d5-4774-bfba-fd20b7a8ac02 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 944 time: 0.0966172 Dec 21 04:04:17.494232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dc4bc1f0-e63a-4176-b1b3-462a2a0a0fc9 None None] Provisioning complete for port 8a790eab-7037-47d2-bc40-f27b57315c6d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:17.495369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dc4bc1f0-e63a-4176-b1b3-462a2a0a0fc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:17.544456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4896e52d-64b9-4a88-9b90-563a1791291b req-a3e1488e-c044-4a9f-a4c3-2a5850707dc5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069920 Dec 21 04:04:17.575947 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:17.615030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dc4bc1f0-e63a-4176-b1b3-462a2a0a0fc9 None None] Port 8a790eab-7037-47d2-bc40-f27b57315c6d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:17.620255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27', 'mac_address': 'fa:16:3e:62:d3:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:04:17.666530 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:17.684846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:04:17.766753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:17.799054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10f256f-0083-422d-9b3a-4ca1450ecda4 req-4f7f4154-0b0b-4483-989e-e48543bbd1ee tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:17.800964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d10f256f-0083-422d-9b3a-4ca1450ecda4 req-4f7f4154-0b0b-4483-989e-e48543bbd1ee tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0676787 Dec 21 04:04:17.875719 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:17.880136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d10f256f-0083-422d-9b3a-4ca1450ecda4 req-205792ad-6530-4f07-a954-72ddb3a6843d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655620 Dec 21 04:04:17.937369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:18.200056 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:18.582545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Sync routers for ids ['11cafb16-8ca6-482d-8bb6-31ace33fd760'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:18.599483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Routers {'11cafb16-8ca6-482d-8bb6-31ace33fd760'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:18.600406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['11cafb16-8ca6-482d-8bb6-31ace33fd760'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:18.793117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Set router 11cafb16-8ca6-482d-8bb6-31ace33fd760 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:18.803689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4ee80c-05c7-4aca-8382-fe62d26c583e req-0b8b21e4-3b70-4c08-89f3-651d5ae67f1d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:18.805249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f4ee80c-05c7-4aca-8382-fe62d26c583e req-0b8b21e4-3b70-4c08-89f3-651d5ae67f1d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 945 time: 0.0692339 Dec 21 04:04:18.867482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f4ee80c-05c7-4aca-8382-fe62d26c583e req-7f8ff1b3-ba3a-4dc8-858e-d7462249b520 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554695 Dec 21 04:04:19.028474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7d98b6-7672-4fdc-8d35-d6fa2f9734a2 req-4fe2b8e2-17b9-4bab-ad79-475442ca1dd4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:19.037708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc7d98b6-7672-4fdc-8d35-d6fa2f9734a2 req-4fe2b8e2-17b9-4bab-ad79-475442ca1dd4 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0841448 Dec 21 04:04:19.055307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:16Z', 'revision_number': 4, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8a790eab-7037-47d2-bc40-f27b57315c6d', 'name': '', 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'mac_address': 'fa:16:3e:4a:21:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_interface', 'standard_attr_id': 2366, 'fixed_ips': [{'subnet_id': '12320615-c838-4018-a838-1f5ae3fc2f45', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:15Z', 'updated_at': '2021-12-21T04:04:16Z', 'revision_number': 2, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'subnets': [{'id': '12320615-c838-4018-a838-1f5ae3fc2f45', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:19.101482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Checking router: 11cafb16-8ca6-482d-8bb6-31ace33fd760 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:19.101898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Updating router 11cafb16-8ca6-482d-8bb6-31ace33fd760 port 8a790eab-7037-47d2-bc40-f27b57315c6d binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:04:19.113210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc7d98b6-7672-4fdc-8d35-d6fa2f9734a2 req-05d65512-612d-4c37-a6c9-33983c38ab2c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575423 Dec 21 04:04:19.132954 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:19.174364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:19.497177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:19.557517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:04:19.562830 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:19.564366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:19.564722 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:19.662250 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:19.690326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:19.693449 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d75ca7fa-9c5c-47eb-bb7d-48dca819c363" -d '{"events": [{"server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:19.708726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:19.717551 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:19.810025 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2a366b8-71b1-4225-8661-ba48c04fe92c x-openstack-request-id: req-b2a366b8-71b1-4225-8661-ba48c04fe92c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:19.810321 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:19.810572 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b2a366b8-71b1-4225-8661-ba48c04fe92c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:19.810990 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27', 'code': 200} Dec 21 04:04:19.813742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:19.834747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b291e26b-3be8-4c7a-872b-3cb5c25954c2 None None] Pushing event updated for resources: {'Port': ['ID=8a790eab-7037-47d2-bc40-f27b57315c6d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:19.930208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-358a99c7-cf8b-4f51-b4ca-79f5df1b6d49 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.019784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b915e1-1af0-43f6-a968-0477d4c6928b req-e16df700-ffac-42cc-ade2-a000805f4bbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:20.022877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74b915e1-1af0-43f6-a968-0477d4c6928b req-e16df700-ffac-42cc-ade2-a000805f4bbe service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 1098 time: 0.1148200 Dec 21 04:04:20.074806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:20.082493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Attempting to bind port 8a790eab-7037-47d2-bc40-f27b57315c6d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:20.082871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Attempting to bind port 8a790eab-7037-47d2-bc40-f27b57315c6d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:20.083266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Attempting to bind port 8a790eab-7037-47d2-bc40-f27b57315c6d on network 9364af8e-592c-4593-8248-b0d7a642feca {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:20.104229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 3, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:20.104833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Checking segment: {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:20.105210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.105683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Bound using segment: {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:20.106238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Bound port: 8a790eab-7037-47d2-bc40-f27b57315c6d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96752b4d-aeb4-4613-9b7c-f909e68a6e7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:20.106640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.145603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.173111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74b915e1-1af0-43f6-a968-0477d4c6928b req-58f807d4-a14e-4b38-8c93-41bc1e28ecb7 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1412959 Dec 21 04:04:20.202250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b80d71-717b-4fe8-ad0a-91d5f0df9dce req-65edf3ca-3e91-49e5-b3f8-02d3c3d492f6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:20.218364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62b80d71-717b-4fe8-ad0a-91d5f0df9dce req-65edf3ca-3e91-49e5-b3f8-02d3c3d492f6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 946 time: 0.1789279 Dec 21 04:04:20.297730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] For port 8a790eab-7037-47d2-bc40-f27b57315c6d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:20.303655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] For port 8a790eab-7037-47d2-bc40-f27b57315c6d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a790eab-7037-47d2-bc40-f27b57315c6d,segment=NetworkSegment(96752b4d-aeb4-4613-9b7c-f909e68a6e7a),segment_id=96752b4d-aeb4-4613-9b7c-f909e68a6e7a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:20.306842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be3f6567-60cd-437f-bf7a-c74d9ff2eb8c None None] Provisioning complete for port 8a790eab-7037-47d2-bc40-f27b57315c6d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:20.307172 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be3f6567-60cd-437f-bf7a-c74d9ff2eb8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.317656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62b80d71-717b-4fe8-ad0a-91d5f0df9dce req-5360e1e8-58cd-4007-801b-1415166c6499 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0980616 Dec 21 04:04:20.340692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f978869-a9ea-46e4-a5cc-23401af3b8e0 req-2a92fd64-6803-4224-bcf2-09d0d449a03c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:20.342453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f978869-a9ea-46e4-a5cc-23401af3b8e0 req-2a92fd64-6803-4224-bcf2-09d0d449a03c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1151958 Dec 21 04:04:20.361156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-be3f6567-60cd-437f-bf7a-c74d9ff2eb8c None None] Port 8a790eab-7037-47d2-bc40-f27b57315c6d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:20.411786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f978869-a9ea-46e4-a5cc-23401af3b8e0 req-c28bd38c-0552-4887-b5b1-056d279581eb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625658 Dec 21 04:04:20.415401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.482694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Routers {'11cafb16-8ca6-482d-8bb6-31ace33fd760'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:20.483453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['11cafb16-8ca6-482d-8bb6-31ace33fd760'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:20.574573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b291e26b-3be8-4c7a-872b-3cb5c25954c2 None None] Pushing event updated for resources: {'Port': ['ID=8a790eab-7037-47d2-bc40-f27b57315c6d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:20.577384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Deleting port b416c77d-b501-4abe-8da0-404332f3b7e8 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:20.577384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.656248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c06d1a50-371d-481f-8a20-ded39ba5942a req-8ec82da1-a7a9-4f22-90ae-528739aab208 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:20.657903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c06d1a50-371d-481f-8a20-ded39ba5942a req-8ec82da1-a7a9-4f22-90ae-528739aab208 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1033425 Dec 21 04:04:20.745553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] For port b416c77d-b501-4abe-8da0-404332f3b7e8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b416c77d-b501-4abe-8da0-404332f3b7e8,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:20.745919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.754550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] Set router 11cafb16-8ca6-482d-8bb6-31ace33fd760 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:20.760577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Calling delete_port for b416c77d-b501-4abe-8da0-404332f3b7e8 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:20.783648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c06d1a50-371d-481f-8a20-ded39ba5942a req-5b47ba5e-aacd-4e8a-9a41-f0b7b255b8e7 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191874 Dec 21 04:04:20.971356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-16d518ea-0344-491a-bb5e-40aa6777bfb6 None None] Provisioning complete for port 8a790eab-7037-47d2-bc40-f27b57315c6d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:20.972140 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-16d518ea-0344-491a-bb5e-40aa6777bfb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:20.984101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fddcfa-f678-4667-8cad-664de323b8ed req-f9a8f68b-b9be-4b85-a6ef-6646ab3ef472 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:20.986251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66fddcfa-f678-4667-8cad-664de323b8ed req-f9a8f68b-b9be-4b85-a6ef-6646ab3ef472 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0937023 Dec 21 04:04:21.039054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66fddcfa-f678-4667-8cad-664de323b8ed req-db436005-176d-4d04-be8a-ee6ea18bf17b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464180 Dec 21 04:04:21.069686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:21.104375 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-16d518ea-0344-491a-bb5e-40aa6777bfb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:21.110584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=b416c77d-b501-4abe-8da0-404332f3b7e8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:21.155138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:16Z', 'revision_number': 4, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8a790eab-7037-47d2-bc40-f27b57315c6d', 'name': '', 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'mac_address': 'fa:16:3e:4a:21:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_interface', 'standard_attr_id': 2366, 'fixed_ips': [{'subnet_id': '12320615-c838-4018-a838-1f5ae3fc2f45', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:15Z', 'updated_at': '2021-12-21T04:04:20Z', 'revision_number': 4, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'subnets': [{'id': '12320615-c838-4018-a838-1f5ae3fc2f45', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:21.158155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-16d518ea-0344-491a-bb5e-40aa6777bfb6 None None] For port 8a790eab-7037-47d2-bc40-f27b57315c6d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a790eab-7037-47d2-bc40-f27b57315c6d,segment=NetworkSegment(96752b4d-aeb4-4613-9b7c-f909e68a6e7a),segment_id=96752b4d-aeb4-4613-9b7c-f909e68a6e7a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:21.190957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-438388ca-5714-4cab-aa11-ef593cdd0393 None None] The sync data for ids ['11cafb16-8ca6-482d-8bb6-31ace33fd760'] in n-d-822053-11 is: [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:16Z', 'revision_number': 4, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8a790eab-7037-47d2-bc40-f27b57315c6d', 'name': '', 'network_id': '9364af8e-592c-4593-8248-b0d7a642feca', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'mac_address': 'fa:16:3e:4a:21:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_interface', 'standard_attr_id': 2366, 'fixed_ips': [{'subnet_id': '12320615-c838-4018-a838-1f5ae3fc2f45', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:15Z', 'updated_at': '2021-12-21T04:04:20Z', 'revision_number': 4, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'subnets': [{'id': '12320615-c838-4018-a838-1f5ae3fc2f45', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:21.226417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7826bff8-5ee2-48e5-a2ca-2457ee113a66 req-25c28271-5a1f-4678-a71b-0a154176e669 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:21.226653 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-16d518ea-0344-491a-bb5e-40aa6777bfb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:21.253113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7826bff8-5ee2-48e5-a2ca-2457ee113a66 req-25c28271-5a1f-4678-a71b-0a154176e669 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1149280 Dec 21 04:04:21.374006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d518ea-0344-491a-bb5e-40aa6777bfb6 None None] Pushing event updated for resources: {'Port': ['ID=8a790eab-7037-47d2-bc40-f27b57315c6d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:21.422775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7826bff8-5ee2-48e5-a2ca-2457ee113a66 req-f153cd71-8026-48d8-8252-dcf3b962dbd0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1707006 Dec 21 04:04:21.482590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:21.625004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ef202e-9c29-4ae7-9e8b-c3aa34cce745 req-fb407207-14be-46cf-9307-d68bbbacab5e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:21.635040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58ef202e-9c29-4ae7-9e8b-c3aa34cce745 req-fb407207-14be-46cf-9307-d68bbbacab5e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 946 time: 0.1764843 Dec 21 04:04:21.746514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b2ae54c-8796-4c40-9b05-ce98ca012945 req-3c175b6a-8650-486a-8161-d4eaee914157 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:21.748154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b2ae54c-8796-4c40-9b05-ce98ca012945 req-3c175b6a-8650-486a-8161-d4eaee914157 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1100750 Dec 21 04:04:21.752237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58ef202e-9c29-4ae7-9e8b-c3aa34cce745 req-135121a8-2217-429c-9caa-403e2e2230b5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164341 Dec 21 04:04:21.823305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b2ae54c-8796-4c40-9b05-ce98ca012945 req-abae0d45-b8c2-4be7-add9-2d8fdb5f94fb tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659080 Dec 21 04:04:21.844115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Router f098413b-b9c2-497a-9a5c-427101a1dba9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:04:22.022799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:22.028908 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4a9cbdeb-92c2-433b-ac76-849a16e9e2d3 admin admin] 10.222.0.18 "PUT /v2.0/routers/f098413b-b9c2-497a-9a5c-427101a1dba9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5306432 Dec 21 04:04:22.029281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05102e22-affb-49b2-93a2-cd45015a7a60 req-37a559df-e4c6-4e14-b6e3-028a320cfe16 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:22.030837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05102e22-affb-49b2-93a2-cd45015a7a60 req-37a559df-e4c6-4e14-b6e3-028a320cfe16 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0828817 Dec 21 04:04:22.031438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45294) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:22.065940 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] Sync routers for ids ['f098413b-b9c2-497a-9a5c-427101a1dba9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:22.076945 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] Routers {'f098413b-b9c2-497a-9a5c-427101a1dba9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:22.077558 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:03:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f098413b-b9c2-497a-9a5c-427101a1dba9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:22.130186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05102e22-affb-49b2-93a2-cd45015a7a60 req-8bff1d65-3d3c-4df3-a963-b70767b96334 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839126 Dec 21 04:04:22.188758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:22.267054 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] Set router f098413b-b9c2-497a-9a5c-427101a1dba9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:22.376954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb279d8-a0bf-445c-beb9-e721354b8fb7 req-a6a455e6-28bb-449c-a5e4-e204dbe6162b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:22.379663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:22.387434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbb279d8-a0bf-445c-beb9-e721354b8fb7 req-a6a455e6-28bb-449c-a5e4-e204dbe6162b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0758274 Dec 21 04:04:22.448606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbb279d8-a0bf-445c-beb9-e721354b8fb7 req-513c2c2b-c32c-455b-b247-b02f60aa52e6 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586498 Dec 21 04:04:22.609996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Deleting port 411987a8-0aa9-41f1-b0ad-519ee8c2382f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:22.610347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:22.657806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135'}], 'enable_snat': True}, 'gw_port_id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:20Z', 'revision_number': 5, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port': {'id': '411987a8-0aa9-41f1-b0ad-519ee8c2382f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:e3:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2352, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.135', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:03:59Z', 'updated_at': '2021-12-21T04:04:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:22.677862 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d9353ce-a648-42fb-a228-14d937c793a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:22.704217 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] Checking router: f098413b-b9c2-497a-9a5c-427101a1dba9 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:22.714765 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] Routers {'f098413b-b9c2-497a-9a5c-427101a1dba9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:22.715412 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f098413b-b9c2-497a-9a5c-427101a1dba9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:22.728295 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:22.798591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] For port 411987a8-0aa9-41f1-b0ad-519ee8c2382f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=411987a8-0aa9-41f1-b0ad-519ee8c2382f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:22.801953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:22.836820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Calling delete_port for 411987a8-0aa9-41f1-b0ad-519ee8c2382f owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:22.863028 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] Set router f098413b-b9c2-497a-9a5c-427101a1dba9 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:22.923756 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:22Z', 'revision_number': 6, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:22.962437 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbc721bf-4085-4ff9-9dfd-c1bc303fc0a5 None None] The sync data for ids ['f098413b-b9c2-497a-9a5c-427101a1dba9'] in n-d-822053-11 is: [{'id': 'f098413b-b9c2-497a-9a5c-427101a1dba9', 'name': 'tempest-TestAggregatesBasicOps-1223744327-router', 'tenant_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:03:58Z', 'updated_at': '2021-12-21T04:04:22Z', 'revision_number': 6, 'project_id': 'b1e8484654c440d2bf1bc712e679d1f7', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:23.023355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1804f9c-838f-4f47-ae88-4dab0940f033 req-1ea60254-5ecc-43d0-b0f6-61d3ac2b2998 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:23.032520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1804f9c-838f-4f47-ae88-4dab0940f033 req-1ea60254-5ecc-43d0-b0f6-61d3ac2b2998 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 946 time: 0.1351182 Dec 21 04:04:23.084939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1804f9c-838f-4f47-ae88-4dab0940f033 req-ab639283-5042-44c2-ae8b-91c3ebf4f5ef tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519142 Dec 21 04:04:23.210340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803e0343-37e2-4725-8a91-6572448df80d req-9c955366-44f2-468b-9004-af3499c5471e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:23.211968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-803e0343-37e2-4725-8a91-6572448df80d req-9c955366-44f2-468b-9004-af3499c5471e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0945821 Dec 21 04:04:23.244290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.271750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.316319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Pushing event deleted for resources: {'Port': ['ID=411987a8-0aa9-41f1-b0ad-519ee8c2382f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:23.326804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-152191e8-5839-4e6d-a758-085ebfb5ecb7 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:23.360609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-b3aa068c-9706-40b8-b547-cc93e9380d1a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?name=default&fields=id&tenant_id=2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 267 time: 0.0776460 Dec 21 04:04:23.375347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a790eab-7037-47d2-bc40-f27b57315c6d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:23.430275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.435866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-803e0343-37e2-4725-8a91-6572448df80d req-f5c60fc4-781a-45aa-a9dc-ae3ed91bb2a1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2110562 Dec 21 04:04:23.478903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-cd8b010e-b3c6-4bea-9567-f4006678388d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:23.481408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-cd8b010e-b3c6-4bea-9567-f4006678388d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 946 time: 0.1193018 Dec 21 04:04:23.496380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'port': {'security_groups': []}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:23.528305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8a790eab-7037-47d2-bc40-f27b57315c6d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:23.528684 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.550855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.555218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.606654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.754605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.755175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Fanout notify agent at l3_agent the message router_deleted on router f098413b-b9c2-497a-9a5c-427101a1dba9 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:04:23.760927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.762886 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c72f5f8-d3d5-4151-925e-518d430944fa admin admin] 10.222.0.18 "DELETE /v2.0/routers/f098413b-b9c2-497a-9a5c-427101a1dba9 HTTP/1.1" status: 204 len: 168 time: 1.7301359 Dec 21 04:04:23.765706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45338) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:23.853571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Deleting subnet 397ad12d-9cc5-4569-8929-f632b4af0a7b {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:04:23.864417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.895373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:23.923319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:23.959050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.011823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.038227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.074382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'cee69311-8acd-4064-a7b4-06c97526b389'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:24.077220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:24.130218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:24.130890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.136386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a9be70e-e7c1-45b0-b037-8428a7ac099e req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "PUT /v2.0/ports/fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 HTTP/1.1" status: 200 len: 905 time: 0.6489305 Dec 21 04:04:24.136885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:24.148130 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0" -d '{"events": [{"name": "network-changed", "server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:24.210761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0c1214a-1b93-4776-83ed-c81bc180931c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:24.301324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:24.342759 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f789cd7-b11a-4717-97ab-417caacf2832 x-openstack-request-id: req-6f789cd7-b11a-4717-97ab-417caacf2832 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:24.343173 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:24.343431 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6f789cd7-b11a-4717-97ab-417caacf2832 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:24.343909 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27', 'status': 'completed', 'code': 200} Dec 21 04:04:24.345065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.426803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=397ad12d-9cc5-4569-8929-f632b4af0a7b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:24.491086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.495483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-adb8e0e1-8f85-4ec8-8d9d-6a9e98ac1139 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/397ad12d-9cc5-4569-8929-f632b4af0a7b HTTP/1.1" status: 204 len: 168 time: 0.7283387 Dec 21 04:04:24.496430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2dec9e29-b9d1-4f77-87a2-ff083f1c43b8 None None] Network 321f8864-f58a-48da-8bb4-e8a8c77b97c4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:24.498542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45362) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:24.523163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37994d68-ecd5-454e-ad9b-639972ae8efb req-efb0ee62-75b5-4ecf-81ae-47b97c257c6b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:24.540422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37994d68-ecd5-454e-ad9b-639972ae8efb req-efb0ee62-75b5-4ecf-81ae-47b97c257c6b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 908 time: 0.2641699 Dec 21 04:04:24.654888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-42f29184-6a8e-4d48-a1a8-996d7f6e1f34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:24.656638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-42f29184-6a8e-4d48-a1a8-996d7f6e1f34 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 1060 time: 0.2421720 Dec 21 04:04:24.674769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.682186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a8e503-de8a-4915-956a-d02877087b40 req-acb16d3c-235d-44f7-84e0-661c035def34 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:24.687441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5a8e503-de8a-4915-956a-d02877087b40 req-acb16d3c-235d-44f7-84e0-661c035def34 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1348655 Dec 21 04:04:24.713666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b8152853-d99a-41e4-bd70-6f910adc791f None None] Provisioning complete for port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:24.714051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8152853-d99a-41e4-bd70-6f910adc791f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.788645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Deleting port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:24.789170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:24.931858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] DHCP port deletion for 321f8864-f58a-48da-8bb4-e8a8c77b97c4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:25.005753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 411987a8-0aa9-41f1-b0ad-519ee8c2382f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:25.082583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 411987a8-0aa9-41f1-b0ad-519ee8c2382f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:25.083242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 411987a8-0aa9-41f1-b0ad-519ee8c2382f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:25.083678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b416c77d-b501-4abe-8da0-404332f3b7e8 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:25.139802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b416c77d-b501-4abe-8da0-404332f3b7e8 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:25.140295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b416c77d-b501-4abe-8da0-404332f3b7e8 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:25.180154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.194550 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.222814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] Deleting port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:25.223317 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.284925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7475fb4-2564-44a2-a21b-1fd005aff3c7 req-359a0a84-9cc1-4dee-8f82-d129c51d0e7f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:25.286504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7475fb4-2564-44a2-a21b-1fd005aff3c7 req-359a0a84-9cc1-4dee-8f82-d129c51d0e7f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.6214731 Dec 21 04:04:25.319959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] For port 68d1efc8-7662-4199-8b5e-995e8fbe81f4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=68d1efc8-7662-4199-8b5e-995e8fbe81f4,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:25.320321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.327615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5a8e503-de8a-4915-956a-d02877087b40 req-d34e02d4-a2e5-49a3-9606-119afc93bf6b tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6061652 Dec 21 04:04:25.360248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Calling delete_port for 68d1efc8-7662-4199-8b5e-995e8fbe81f4 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:25.377890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-8b3796eb-a8f8-4ea0-ad51-1392d9332d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:25.394035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-8b3796eb-a8f8-4ea0-ad51-1392d9332d88 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.6921926 Dec 21 04:04:25.464943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7475fb4-2564-44a2-a21b-1fd005aff3c7 req-318fbbee-62bb-4575-a6d2-e22ee51e49de tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1570842 Dec 21 04:04:25.477420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] For port 68d1efc8-7662-4199-8b5e-995e8fbe81f4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=68d1efc8-7662-4199-8b5e-995e8fbe81f4,segment=NetworkSegment(4885589c-7e5e-40ba-a556-47be2c1aff8e),segment_id=4885589c-7e5e-40ba-a556-47be2c1aff8e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:25.478058 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.496645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] Calling delete_port for 68d1efc8-7662-4199-8b5e-995e8fbe81f4 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:25.519193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-a4c10092-3824-4284-b62b-442426de7386 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 HTTP/1.1" status: 200 len: 217 time: 0.0975513 Dec 21 04:04:25.569711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.596132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-d9e6d443-556a-4f2f-85ea-5f403b593067 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:25.597360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-d9e6d443-556a-4f2f-85ea-5f403b593067 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0741968 Dec 21 04:04:25.629789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.630609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Pushing event deleted for resources: {'Port': ['ID=68d1efc8-7662-4199-8b5e-995e8fbe81f4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:25.658334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] No DVR routers for this DVR port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:04:25.676023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] Pushing event deleted for resources: {'Port': ['ID=68d1efc8-7662-4199-8b5e-995e8fbe81f4,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:25.681538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79066f62-2b13-49bd-9156-c9b1b5415475 None None] No DVR routers for this DVR port 68d1efc8-7662-4199-8b5e-995e8fbe81f4 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:04:25.706954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-a698ef0e-c45c-48b8-af6e-4d49db15b270 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:25.709543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-a698ef0e-c45c-48b8-af6e-4d49db15b270 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1040878 Dec 21 04:04:25.768461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.826722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.861736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['321f8864-f58a-48da-8bb4-e8a8c77b97c4']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:25.866002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4885589c-7e5e-40ba-a556-47be2c1aff8e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:25.866302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4885589c-7e5e-40ba-a556-47be2c1aff8e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:25.875595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.877005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-38ee6823-4f72-4367-b600-0a9ec5335fc2 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1559088 Dec 21 04:04:25.887988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06ed1b8-4b42-434b-93c4-82e4437f278a req-fba29f01-c548-47c3-8c17-e795b2ab62a5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:25.890792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d06ed1b8-4b42-434b-93c4-82e4437f278a req-fba29f01-c548-47c3-8c17-e795b2ab62a5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0778658 Dec 21 04:04:25.890904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.897163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:04:25.897555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:04:25.899292 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:04:26.007615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d06ed1b8-4b42-434b-93c4-82e4437f278a req-488f0e26-90d1-4667-84c9-44aaaef5c141 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1090131 Dec 21 04:04:26.034862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d82c3fe8-84e7-4be6-8c9f-b11b01d38de0 req-9d132811-c059-40a8-baae-0b463e587e16 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1439805 Dec 21 04:04:26.040376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:26.053685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:26.077770 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] 10.222.0.18 "DELETE /v2.0/networks/321f8864-f58a-48da-8bb4-e8a8c77b97c4 HTTP/1.1" status: 204 len: 168 time: 1.5754879 Dec 21 04:04:26.078327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45410) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:26.118908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a5c1eed-8d9f-47f6-9501-9433322fc707 admin admin] Pushing event deleted for resources: {'Network': ['ID=321f8864-f58a-48da-8bb4-e8a8c77b97c4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:26.151722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f0c8bd-b053-4d84-b416-9532a0db526c req-22e07951-8258-4057-ad49-738b626c9239 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:26.164967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56f0c8bd-b053-4d84-b416-9532a0db526c req-22e07951-8258-4057-ad49-738b626c9239 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1052997 Dec 21 04:04:26.286574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56f0c8bd-b053-4d84-b416-9532a0db526c req-967c38c4-7d33-4a34-8ccb-fd60762ca910 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1152647 Dec 21 04:04:26.298470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-fa5eedf0-e3c6-4416-97b5-06ea1a99e3e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:26.298470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-fa5eedf0-e3c6-4416-97b5-06ea1a99e3e0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 1098 time: 0.0868323 Dec 21 04:04:26.465467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-42c2ca7c-da6c-4e1c-ad38-16286aeb36ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:26.467647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-42c2ca7c-da6c-4e1c-ad38-16286aeb36ce service neutron] 10.222.0.31 "GET /v2.0/networks?id=1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 200 len: 915 time: 0.1614716 Dec 21 04:04:26.539130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-dcbc3ed8-2d44-4ea2-8112-3d47d2df5be8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 200 len: 217 time: 0.0604062 Dec 21 04:04:26.562168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-b47eda0e-b160-4536-82ea-255521ba16a1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:26.570370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-b47eda0e-b160-4536-82ea-255521ba16a1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.2049813 Dec 21 04:04:26.623600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-f8cc55bc-388e-4ba7-a0e5-0d5664d6b89e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/quotas/2d46b810d87943059c90ba895934ed3b HTTP/1.1" status: 200 len: 375 time: 0.0522795 Dec 21 04:04:26.668648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-16ced199-8abb-4082-b755-7ed6896447ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:26.670141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-16ced199-8abb-4082-b755-7ed6896447ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 200 len: 854 time: 0.0918038 Dec 21 04:04:26.680150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:26.722907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-33926e32-c5fd-43d0-9526-d777b0f82f3d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1d34dd2a-275c-4073-aad9-16b29c6ef929&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0431857 Dec 21 04:04:26.753625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-dc5ad843-0b41-4137-8ea3-af65228fecae tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&fields=id HTTP/1.1" status: 200 len: 486 time: 0.1241591 Dec 21 04:04:26.809102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-ead31aad-ab33-4903-b668-6bc433a129b2 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:04:26.810019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-ead31aad-ab33-4903-b668-6bc433a129b2 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0135500 Dec 21 04:04:26.884352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 68d1efc8-7662-4199-8b5e-995e8fbe81f4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:26.907094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 68d1efc8-7662-4199-8b5e-995e8fbe81f4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:26.907570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 68d1efc8-7662-4199-8b5e-995e8fbe81f4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:26.994829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-74a4d776-69aa-4d35-a4c4-868232413b69 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2401695 Dec 21 04:04:26.999138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-ed7c70bd-39a3-4832-9aec-099f7ed94f00 service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1693308 Dec 21 04:04:27.115629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Deleting port 8a790eab-7037-47d2-bc40-f27b57315c6d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:27.115629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:27.210216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c64afe6-b97b-48ef-bb94-7568b8b245be req-4bb7eb84-3811-46ba-a1ca-14be17c3acb4 service neutron] 10.222.0.31 "GET /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2064996 Dec 21 04:04:27.219963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] For port 8a790eab-7037-47d2-bc40-f27b57315c6d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a790eab-7037-47d2-bc40-f27b57315c6d,segment=NetworkSegment(96752b4d-aeb4-4613-9b7c-f909e68a6e7a),segment_id=96752b4d-aeb4-4613-9b7c-f909e68a6e7a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:27.220406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:27.220770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-493e9a53-0005-4908-adbb-89518fd1ebde service neutron] 10.222.0.18 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2089751 Dec 21 04:04:27.235431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Calling delete_port for 8a790eab-7037-47d2-bc40-f27b57315c6d owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:27.423321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d7d8cc-c9f6-47f3-8ebd-fd2551e612b6 req-b07b9ea2-bdc0-4c14-9ba7-d4abf7478ee8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:27.425019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2d7d8cc-c9f6-47f3-8ebd-fd2551e612b6 req-b07b9ea2-bdc0-4c14-9ba7-d4abf7478ee8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0568674 Dec 21 04:04:27.507095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ba77ab0-4d23-4666-ae70-9d9ef8e51c88 req-7f72c774-e1c3-4868-ad39-2c73c2729a29 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 210 time: 0.0396636 Dec 21 04:04:27.528386 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:27.563230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2d7d8cc-c9f6-47f3-8ebd-fd2551e612b6 req-3741a063-2499-4326-9007-e41566f97023 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1296427 Dec 21 04:04:27.588330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Pushing event deleted for resources: {'Port': ['ID=8a790eab-7037-47d2-bc40-f27b57315c6d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:27.910711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:28.164811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Router 11cafb16-8ca6-482d-8bb6-31ace33fd760 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:04:28.287482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:28.296500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45490) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:28.300869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] Sync routers for ids ['11cafb16-8ca6-482d-8bb6-31ace33fd760'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:28.303397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2f79c94-2042-4dac-8809-24ea11a1061b admin admin] 10.222.0.18 "PUT /v2.0/routers/11cafb16-8ca6-482d-8bb6-31ace33fd760/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2238927 Dec 21 04:04:28.317905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] Routers {'11cafb16-8ca6-482d-8bb6-31ace33fd760'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:28.319437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['11cafb16-8ca6-482d-8bb6-31ace33fd760'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:28.445527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:28.456861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] Set router 11cafb16-8ca6-482d-8bb6-31ace33fd760 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:28.566126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:28.630420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b591132-0f95-425c-91d9-7857ecb946bb req-dfbe5240-eee6-49a3-968a-3033dc7ab33f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 210 time: 0.0468621 Dec 21 04:04:28.692182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33'}], 'enable_snat': True}, 'gw_port_id': '1db082eb-9ece-4146-81d6-68e67c486908', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:27Z', 'revision_number': 5, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port': {'id': '1db082eb-9ece-4146-81d6-68e67c486908', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:08:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2365, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.33', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:11Z', 'updated_at': '2021-12-21T04:04:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:28.738127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] Checking router: 11cafb16-8ca6-482d-8bb6-31ace33fd760 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:28.749582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] Routers {'11cafb16-8ca6-482d-8bb6-31ace33fd760'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:28.751090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['11cafb16-8ca6-482d-8bb6-31ace33fd760'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:28.776748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c19f7df-e293-4f98-b68a-5f59e1edc72e req-c2d056a9-ba83-44f5-8330-861e864f7913 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:28.779740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c19f7df-e293-4f98-b68a-5f59e1edc72e req-c2d056a9-ba83-44f5-8330-861e864f7913 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0721626 Dec 21 04:04:28.806981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Deleting port 1db082eb-9ece-4146-81d6-68e67c486908 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:28.806981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:28.900128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c19f7df-e293-4f98-b68a-5f59e1edc72e req-3fbbfcba-34a8-48e4-894c-05f5957702b1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1081057 Dec 21 04:04:28.925413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] For port 1db082eb-9ece-4146-81d6-68e67c486908, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1db082eb-9ece-4146-81d6-68e67c486908,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:28.925787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:28.956883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Calling delete_port for 1db082eb-9ece-4146-81d6-68e67c486908 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:28.962144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] Set router 11cafb16-8ca6-482d-8bb6-31ace33fd760 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:29.045991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:28Z', 'revision_number': 6, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:29.083837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab44e44-423d-4433-9085-40a7b6f10aef None None] The sync data for ids ['11cafb16-8ca6-482d-8bb6-31ace33fd760'] in n-d-822053-11 is: [{'id': '11cafb16-8ca6-482d-8bb6-31ace33fd760', 'name': 'tempest-TestAggregatesBasicOps-1474782712-router', 'tenant_id': 'd0265404445c475c91c044c23135c8e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:10Z', 'updated_at': '2021-12-21T04:04:28Z', 'revision_number': 6, 'project_id': 'd0265404445c475c91c044c23135c8e8', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:29.133328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478c45e0-ffd4-4fe8-b03c-28a9bbcd2de6 req-fea078e0-b679-4406-b1a8-c38d8dca82a1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:29.135643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-478c45e0-ffd4-4fe8-b03c-28a9bbcd2de6 req-fea078e0-b679-4406-b1a8-c38d8dca82a1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1103065 Dec 21 04:04:29.276739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-478c45e0-ffd4-4fe8-b03c-28a9bbcd2de6 req-0aace57e-dbd5-4c52-9b73-ee2da3926e0a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989285 Dec 21 04:04:29.367284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:29.418300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Pushing event deleted for resources: {'Port': ['ID=1db082eb-9ece-4146-81d6-68e67c486908,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:29.429981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ff444df-b358-4f68-a506-5454624da12b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:29.620245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:29.631180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c1e536-bbd2-4b52-ab51-9e1a892e5e74 req-2d92afc9-e594-4244-a3d6-461cef002a34 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:29.638741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2c1e536-bbd2-4b52-ab51-9e1a892e5e74 req-2d92afc9-e594-4244-a3d6-461cef002a34 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.2309630 Dec 21 04:04:29.769423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:29.772938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4561d155-ad85-47e0-961c-b664b15273cc req-536b936b-8a07-44cc-b5cf-72b222f62c40 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 210 time: 0.0630682 Dec 21 04:04:29.782864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:29.847702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2c1e536-bbd2-4b52-ab51-9e1a892e5e74 req-35360d0f-dcef-408f-8252-c78c5b5abe80 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2077470 Dec 21 04:04:29.963287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:29.963864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 11cafb16-8ca6-482d-8bb6-31ace33fd760 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:04:29.974734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:29.975689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cf127ce8-1ff7-42fd-892a-dab8aa1f1260 admin admin] 10.222.0.18 "DELETE /v2.0/routers/11cafb16-8ca6-482d-8bb6-31ace33fd760 HTTP/1.1" status: 204 len: 168 time: 1.6778376 Dec 21 04:04:29.978621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:30.093037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Deleting subnet 12320615-c838-4018-a838-1f5ae3fc2f45 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:04:30.099508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.157461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.162025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a455203d-683c-47b6-b8db-c8233431859f req-f7325ac0-3f1e-4cb8-919f-2009ce69383e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:30.173683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a455203d-683c-47b6-b8db-c8233431859f req-f7325ac0-3f1e-4cb8-919f-2009ce69383e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.2333634 Dec 21 04:04:30.279839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-3c572b4b-7792-470c-a981-444cb4ecd237 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:30.279839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-3c572b4b-7792-470c-a981-444cb4ecd237 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 812 time: 0.2806065 Dec 21 04:04:30.302836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Request body: {'port': {'device_id': '6740513a-11e0-4557-84f1-e19548c91e14', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'admin_state_up': True, 'tenant_id': '2d46b810d87943059c90ba895934ed3b'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:30.386352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.496890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a455203d-683c-47b6-b8db-c8233431859f req-1bd685e7-468d-43e8-8ca0-86ac4f24fc58 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3219883 Dec 21 04:04:30.594422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Made reservation on behalf of 2d46b810d87943059c90ba895934ed3b for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:30.595618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.604022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.649104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12320615-c838-4018-a838-1f5ae3fc2f45,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:30.652744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.658990 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7a7d9f1-2c32-41a8-99f9-47495946bca7 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/12320615-c838-4018-a838-1f5ae3fc2f45 HTTP/1.1" status: 204 len: 168 time: 0.6770341 Dec 21 04:04:30.659130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-026e0e82-5ceb-47c2-8fc8-8e1e10c04795 None None] Network 9364af8e-592c-4593-8248-b0d7a642feca requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:30.660542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:30.758133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.792520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21beb896-0928-4421-80fb-ef1167b96d27 req-ba274cf1-885e-4753-a58f-317f52aa2198 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:30.800656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21beb896-0928-4421-80fb-ef1167b96d27 req-ba274cf1-885e-4753-a58f-317f52aa2198 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1140609 Dec 21 04:04:30.834774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Deleting port b3af100c-fb35-4ba2-ad34-9fa7557bc975 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:30.835329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.884106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Allocated IP 172.20.0.12 (adb6972f-1a1d-4ca4-855c-5e5faf88030a/5101716e-6720-4ed1-b6cc-a5ad262b61c1/9af4ef3c-d48b-437e-8852-f063d225dc37) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:30.919876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] For port b3af100c-fb35-4ba2-ad34-9fa7557bc975, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b3af100c-fb35-4ba2-ad34-9fa7557bc975,segment=NetworkSegment(96752b4d-aeb4-4613-9b7c-f909e68a6e7a),segment_id=96752b4d-aeb4-4613-9b7c-f909e68a6e7a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:30.920585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:30.935705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Calling delete_port for b3af100c-fb35-4ba2-ad34-9fa7557bc975 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:30.975194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1db082eb-9ece-4146-81d6-68e67c486908 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:31.016613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1db082eb-9ece-4146-81d6-68e67c486908 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:31.016968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1db082eb-9ece-4146-81d6-68e67c486908 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:31.017388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a790eab-7037-47d2-bc40-f27b57315c6d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:31.061873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8a790eab-7037-47d2-bc40-f27b57315c6d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:31.062332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a790eab-7037-47d2-bc40-f27b57315c6d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:31.069816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-274512de-b501-46ed-864d-1b6276c16824 None None] DHCP port deletion for 9364af8e-592c-4593-8248-b0d7a642feca request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:31.092236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21beb896-0928-4421-80fb-ef1167b96d27 req-ad60b2fc-f7b5-48ac-ad0a-c142b3c00034 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2904618 Dec 21 04:04:31.106183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.176675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] No DVR routers for this DVR port b3af100c-fb35-4ba2-ad34-9fa7557bc975 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:04:31.177432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Deleting port b3af100c-fb35-4ba2-ad34-9fa7557bc975 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:31.178302 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.186517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Pushing event deleted for resources: {'Port': ['ID=b3af100c-fb35-4ba2-ad34-9fa7557bc975,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:31.209590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c34e735-414e-4b7c-beed-1d8f3aa4063d req-d60b8eb0-0d65-4a7b-8eef-3b93455060b8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 210 time: 0.0425432 Dec 21 04:04:31.220343 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.283727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-274512de-b501-46ed-864d-1b6276c16824 None None] For port b3af100c-fb35-4ba2-ad34-9fa7557bc975, host n-d-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:31.284611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.297835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Calling delete_port for b3af100c-fb35-4ba2-ad34-9fa7557bc975 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:31.301056 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.ipam_backend_mixin [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Port b3af100c-fb35-4ba2-ad34-9fa7557bc975 was not found and therefore no delete operation was performed {{(pid=110312) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:04:31.303059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.306690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.330196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-274512de-b501-46ed-864d-1b6276c16824 None None] No DVR routers for this DVR port b3af100c-fb35-4ba2-ad34-9fa7557bc975 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:04:31.336975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-274512de-b501-46ed-864d-1b6276c16824 None None] Pushing event deleted for resources: {'Port': ['ID=b3af100c-fb35-4ba2-ad34-9fa7557bc975,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:31.365356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9364af8e-592c-4593-8248-b0d7a642feca']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:31.367122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d26992-ace0-4947-a331-f12b6a3bf282 req-852d1f27-2294-4ca9-bc62-64c58d504d24 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:31.369851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57d26992-ace0-4947-a331-f12b6a3bf282 req-852d1f27-2294-4ca9-bc62-64c58d504d24 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0745902 Dec 21 04:04:31.373140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '96752b4d-aeb4-4613-9b7c-f909e68a6e7a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:31.373497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '96752b4d-aeb4-4613-9b7c-f909e68a6e7a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:31.390558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.402379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.405403 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.429829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:04:31.429829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.443182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'cee69311-8acd-4064-a7b4-06c97526b389'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:31.494312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:31.505291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:31.511333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:04:31.516802 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:04:31.525660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:31.598452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.599662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:31.605051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.609694 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.617190 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] 10.222.0.18 "DELETE /v2.0/networks/9364af8e-592c-4593-8248-b0d7a642feca HTTP/1.1" status: 204 len: 168 time: 0.9510534 Dec 21 04:04:31.630391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57d26992-ace0-4947-a331-f12b6a3bf282 req-829cb0d3-99f9-4b7c-aa85-14e076b58ead tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2529061 Dec 21 04:04:31.645590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44041491-429e-419e-94b7-573c98572a1c admin admin] Pushing event deleted for resources: {'Network': ['ID=9364af8e-592c-4593-8248-b0d7a642feca,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:31.768107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-33b57cc1-b2a3-4526-9fed-35acc4137de7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4797866 Dec 21 04:04:31.787672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Request body: {'port': {'device_id': '6740513a-11e0-4557-84f1-e19548c91e14', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:31.924432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:31.979168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d953ff7-0fad-4545-b9c7-854663f143a4 req-e03b7522-1fd5-421a-8120-a18c0215cd1d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:31.980744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d953ff7-0fad-4545-b9c7-854663f143a4 req-e03b7522-1fd5-421a-8120-a18c0215cd1d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1299748 Dec 21 04:04:32.008018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3bb66d2c-995c-4aec-9bcb-1c8334287322 None None] Provisioning complete for port 9af4ef3c-d48b-437e-8852-f063d225dc37 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:32.008539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3bb66d2c-995c-4aec-9bcb-1c8334287322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.048214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3bb66d2c-995c-4aec-9bcb-1c8334287322 None None] Port 9af4ef3c-d48b-437e-8852-f063d225dc37 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:32.233074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45620) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:32.311355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f406bda5-600f-4b9e-84fc-c07126f513c3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b1e8484654c440d2bf1bc712e679d1f7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0770881 Dec 21 04:04:32.311950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45624) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:32.389945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17218ee5-6529-4b64-92c5-8520a6001a3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.393920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9af4ef3c-d48b-437e-8852-f063d225dc37 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:04:32.402711 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.413692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17218ee5-6529-4b64-92c5-8520a6001a3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.417485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Transition to ACTIVE for port object 9af4ef3c-d48b-437e-8852-f063d225dc37 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:04:32.459630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d953ff7-0fad-4545-b9c7-854663f143a4 req-737c000c-3fcb-4f3e-8737-c5d0c549d0e5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4714725 Dec 21 04:04:32.495547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b4fe87-c64d-491f-8904-4c6e4dff580e req-1f9fc8f5-a27c-4e5b-95b0-932e46cc13fe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:32.495547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8b4fe87-c64d-491f-8904-4c6e4dff580e req-1f9fc8f5-a27c-4e5b-95b0-932e46cc13fe tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 932 time: 0.0759819 Dec 21 04:04:32.496274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.558401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17218ee5-6529-4b64-92c5-8520a6001a3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.558401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17218ee5-6529-4b64-92c5-8520a6001a3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.559675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-17218ee5-6529-4b64-92c5-8520a6001a3f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ce62e01a-6a85-491a-8391-304ba778ed19 HTTP/1.1" status: 204 len: 168 time: 0.2465143 Dec 21 04:04:32.579816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:32.594469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17218ee5-6529-4b64-92c5-8520a6001a3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce62e01a-6a85-491a-8391-304ba778ed19,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:32.695816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8b4fe87-c64d-491f-8904-4c6e4dff580e req-52012f24-99bb-4520-92a3-d6a3d161f3ad tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1707742 Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.787109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:32.796135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2619b458-259b-41e3-9cb9-34b5f4bd1e4c req-b56ab4c5-e3e3-48c3-867a-c04dc3d5aff8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:32.803688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2619b458-259b-41e3-9cb9-34b5f4bd1e4c req-b56ab4c5-e3e3-48c3-867a-c04dc3d5aff8 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1417277 Dec 21 04:04:32.817803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Attempting to bind port 9af4ef3c-d48b-437e-8852-f063d225dc37 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:32.818606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Attempting to bind port 9af4ef3c-d48b-437e-8852-f063d225dc37 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:32.819371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Attempting to bind port 9af4ef3c-d48b-437e-8852-f063d225dc37 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:32.835764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Port 9af4ef3c-d48b-437e-8852-f063d225dc37 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:04:32.836307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Attempting to bind port 9af4ef3c-d48b-437e-8852-f063d225dc37 on network adb6972f-1a1d-4ca4-855c-5e5faf88030a {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:32.849027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:32.849577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Checking segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:32.850265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Bound using segment: {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:32.850863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Bound port: 9af4ef3c-d48b-437e-8852-f063d225dc37, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:32.851407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:32.894337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2619b458-259b-41e3-9cb9-34b5f4bd1e4c req-ffa151c5-f6bc-48fd-9457-60aff059bffc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0895834 Dec 21 04:04:32.967859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3af100c-fb35-4ba2-ad34-9fa7557bc975 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:33.000332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:33.008479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:33.018248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b3af100c-fb35-4ba2-ad34-9fa7557bc975 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:33.019373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b3af100c-fb35-4ba2-ad34-9fa7557bc975 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:33.049247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-df483586-6574-49f7-9bca-27d00b920188 req-968a48e7-35f7-4d16-8e89-dd7c8d5704f5 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:04:33.049247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df483586-6574-49f7-9bca-27d00b920188 req-968a48e7-35f7-4d16-8e89-dd7c8d5704f5 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0063369 Dec 21 04:04:33.133999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:33.198780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:33.198780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:33.198780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] 10.222.0.54 "PUT /v2.0/ports/9af4ef3c-d48b-437e-8852-f063d225dc37 HTTP/1.1" status: 200 len: 1093 time: 1.4047165 Dec 21 04:04:33.198780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:33.198780 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7862661-d1b6-456d-b606-228ffa021ee2" -d '{"events": [{"name": "network-changed", "server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:33.248335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81d67c1-a59b-484f-a71b-f8abf55d9e61 req-1d5903c3-7e7e-460f-9c92-69f62ac8c02c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:33.271161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d81d67c1-a59b-484f-a71b-f8abf55d9e61 req-1d5903c3-7e7e-460f-9c92-69f62ac8c02c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1569662 Dec 21 04:04:33.275211 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-daeaae8f-1ab1-461f-bf8d-f41081612dca x-openstack-request-id: req-daeaae8f-1ab1-461f-bf8d-f41081612dca {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:33.275495 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:33.275754 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-daeaae8f-1ab1-461f-bf8d-f41081612dca {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:33.276156 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'status': 'completed', 'code': 200} Dec 21 04:04:33.285690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd84ad8d-6cd0-410c-adee-b351931de841 service neutron] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:33.354331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d81d67c1-a59b-484f-a71b-f8abf55d9e61 req-7db11488-b814-4620-a058-70667e020e11 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821800 Dec 21 04:04:33.514397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7862661-d1b6-456d-b606-228ffa021ee2 req-4b845dbd-8c9d-4a55-a65f-f6716c1d5dd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:33.521928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7862661-d1b6-456d-b606-228ffa021ee2 req-4b845dbd-8c9d-4a55-a65f-f6716c1d5dd8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 1096 time: 0.1791515 Dec 21 04:04:33.721847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc6b9dc-0947-4ae1-82a1-2b863c8dc159 req-58909e2a-c728-4c73-a67b-574dc9f83c45 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:33.723894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dc6b9dc-0947-4ae1-82a1-2b863c8dc159 req-58909e2a-c728-4c73-a67b-574dc9f83c45 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1477113 Dec 21 04:04:33.748089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7862661-d1b6-456d-b606-228ffa021ee2 req-91c9d6a9-5af4-48d2-8db7-bf6ddbf8f3f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:33.750146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7862661-d1b6-456d-b606-228ffa021ee2 req-91c9d6a9-5af4-48d2-8db7-bf6ddbf8f3f2 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2d46b810d87943059c90ba895934ed3b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.2126012 Dec 21 04:04:33.955648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7dc6b9dc-0947-4ae1-82a1-2b863c8dc159 req-5d0277cb-280a-4f1f-a59c-aa15b1ff59bc tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2036092 Dec 21 04:04:33.987635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29af68b8-0a4b-40e5-9cb8-483ba6de3a51 req-0bf611a2-beb0-4164-b921-49f434420fc0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:33.989271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29af68b8-0a4b-40e5-9cb8-483ba6de3a51 req-0bf611a2-beb0-4164-b921-49f434420fc0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.1806705 Dec 21 04:04:34.034172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:34.100989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29af68b8-0a4b-40e5-9cb8-483ba6de3a51 req-e4798842-ea51-4feb-bd63-9404ece54fc8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967543 Dec 21 04:04:34.122385 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-104e5b22-cd40-42e8-97e5-63a3e6f3183a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d0265404445c475c91c044c23135c8e8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0866845 Dec 21 04:04:34.130407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45686) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:34.141765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7862661-d1b6-456d-b606-228ffa021ee2 req-67793857-3abd-4aff-9a73-5e1e2fea7320 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:34.143497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7862661-d1b6-456d-b606-228ffa021ee2 req-67793857-3abd-4aff-9a73-5e1e2fea7320 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3609741 Dec 21 04:04:34.201866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b81d1228-9a38-4ab4-8122-1aacc8054272 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:34.228195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b81d1228-9a38-4ab4-8122-1aacc8054272 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:34.333490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b92810-f206-4ea1-8eed-a2fd649c695a req-72e72684-94b3-4ef9-bd62-b83cb61a0028 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:34.335063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05b92810-f206-4ea1-8eed-a2fd649c695a req-72e72684-94b3-4ef9-bd62-b83cb61a0028 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1146939 Dec 21 04:04:34.337043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-60cc9057-8fb6-4a47-b661-6507f2408b00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:34.339058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-60cc9057-8fb6-4a47-b661-6507f2408b00 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 1096 time: 0.1093593 Dec 21 04:04:34.345670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b81d1228-9a38-4ab4-8122-1aacc8054272 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:34.349033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b81d1228-9a38-4ab4-8122-1aacc8054272 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:34.353274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b81d1228-9a38-4ab4-8122-1aacc8054272 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c59cea18-a9c8-4ea0-9778-3a0ee9a6951a HTTP/1.1" status: 204 len: 168 time: 0.2187278 Dec 21 04:04:34.360564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b81d1228-9a38-4ab4-8122-1aacc8054272 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c59cea18-a9c8-4ea0-9778-3a0ee9a6951a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:34.402306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-eccf0182-5d5f-45c2-bf45-a62da4641413 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9af4ef3c-d48b-437e-8852-f063d225dc37 HTTP/1.1" status: 200 len: 217 time: 0.0461628 Dec 21 04:04:34.432233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05b92810-f206-4ea1-8eed-a2fd649c695a req-bd924440-cc91-4010-b845-82c3ab4010fe tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903323 Dec 21 04:04:34.523288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-2768c94a-c54d-4af3-851b-0eba630152c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:34.524905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-2768c94a-c54d-4af3-851b-0eba630152c3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0970805 Dec 21 04:04:34.653046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-5a17c9a3-1ea2-4ff2-bb8d-fe51bbf5c921 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:34.654590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-5a17c9a3-1ea2-4ff2-bb8d-fe51bbf5c921 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1218145 Dec 21 04:04:34.667145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c0031f-b3a0-4c2a-a986-c00c3fd2fbfa req-e166bbe6-31c1-4e8a-9d7a-56fa733d86f1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:34.674429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c0031f-b3a0-4c2a-a986-c00c3fd2fbfa req-e166bbe6-31c1-4e8a-9d7a-56fa733d86f1 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0739295 Dec 21 04:04:34.789799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c0031f-b3a0-4c2a-a986-c00c3fd2fbfa req-904dd8d1-b6d3-478b-ba09-81d58ebc054e tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1144710 Dec 21 04:04:34.852141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-af74f3c8-08d7-462b-97af-f43a6f8f1560 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1756682 Dec 21 04:04:35.448788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e0d507f-b7b9-4d40-8f1d-2312920fd070 req-636f64d3-7b7a-48d7-aa30-36ea14d392c7 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5823510 Dec 21 04:04:35.457270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a6dbcf-a131-4f4a-ae0e-cb84e8bca028 req-6e1c7dde-e292-4217-897a-19ad17c6da95 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:35.459690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44a6dbcf-a131-4f4a-ae0e-cb84e8bca028 req-6e1c7dde-e292-4217-897a-19ad17c6da95 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.5599771 Dec 21 04:04:35.477436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dd32d5-9757-4a52-a87f-0ff4860aad82 req-509fcbb0-ad4a-4429-932d-d6496bb115cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:35.479023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03dd32d5-9757-4a52-a87f-0ff4860aad82 req-509fcbb0-ad4a-4429-932d-d6496bb115cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.1287904 Dec 21 04:04:35.640190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03dd32d5-9757-4a52-a87f-0ff4860aad82 req-1bd277fa-b437-4dcf-9102-0b36c742e2c8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1499104 Dec 21 04:04:35.655543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44a6dbcf-a131-4f4a-ae0e-cb84e8bca028 req-6c89c6d5-bcd7-4807-a7e4-41244f33f732 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1722119 Dec 21 04:04:35.835512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233610b4-0f67-4444-a027-4a7044147231 req-b61cd51e-80cb-4220-a963-f997189313ff tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:35.855000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-233610b4-0f67-4444-a027-4a7044147231 req-b61cd51e-80cb-4220-a963-f997189313ff tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0997939 Dec 21 04:04:35.926641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-233610b4-0f67-4444-a027-4a7044147231 req-4dbe2e5d-8834-43bd-9664-fc58ba7ddf7d tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707257 Dec 21 04:04:36.101090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1582f5-ae77-4939-a975-3fe5aa6c7ff2 req-908523c3-968c-4531-a97a-47c936d7590f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:36.106989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba1582f5-ae77-4939-a975-3fe5aa6c7ff2 req-908523c3-968c-4531-a97a-47c936d7590f tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0687535 Dec 21 04:04:36.219510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba1582f5-ae77-4939-a975-3fe5aa6c7ff2 req-8b1bfafc-e2ac-4dc1-937e-f617a62b7268 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034517 Dec 21 04:04:36.923789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2849af7-f902-4d1d-b69d-c0467c11ba1c req-8e4ac10e-71c5-4fcc-bf5c-346b796fc2a1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:36.925374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2849af7-f902-4d1d-b69d-c0467c11ba1c req-8e4ac10e-71c5-4fcc-bf5c-346b796fc2a1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.1333804 Dec 21 04:04:37.022562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2849af7-f902-4d1d-b69d-c0467c11ba1c req-9cc8cbf4-bd25-4bc3-8e36-33e820c6fd4e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820436 Dec 21 04:04:37.072622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45814) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:37.261748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'network': {'name': 'tempest-network-smoke--615459176', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:37.386224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:37.390072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.414131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.501547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.582727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.608230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:04:37.618328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroup': ['ID=67c541de-eafd-4df7-96f6-875b2eefb965,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:37.624080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.624740 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Added segment 83aaa8ca-8514-4594-bc3f-241858877cc6 of type vlan for network 21c72edc-8844-45a3-93c7-94b865615264 Dec 21 04:04:37.775464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.900316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.907267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:37.907267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:37.985737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Network': ['ID=21c72edc-8844-45a3-93c7-94b865615264,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:37.998251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 21c72edc-8844-45a3-93c7-94b865615264 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:04:38.150087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82f349a-b32f-445e-9583-308a5916bdba req-71a176e9-3fb9-438c-b1c6-fae9ba5c4c95 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:38.151644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e82f349a-b32f-445e-9583-308a5916bdba req-71a176e9-3fb9-438c-b1c6-fae9ba5c4c95 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.0545964 Dec 21 04:04:38.213856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e82f349a-b32f-445e-9583-308a5916bdba req-f973975c-390a-44a8-b527-fda0f0afde5c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551913 Dec 21 04:04:38.232218 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e27cb14d-9c94-42fa-b447-156bcede2ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.1556132 Dec 21 04:04:38.235362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45848) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:38.240494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'admin_state_up': True, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:38.345678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:38.347074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:38.422688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:38.713459 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:38.942141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9af4ef3c-d48b-437e-8852-f063d225dc37 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:04:39.012342 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.038372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.130571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:39.159850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'mac_address': 'fa:16:3e:9a:ea:53', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:04:39.177206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.25.5.165 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/80c7350a-da12-43ca-98fa-cd03001717ae) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:39.203439 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.224893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9af4ef3c-d48b-437e-8852-f063d225dc37 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:04:39.277158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:39.348869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.376932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.436084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4ab260-95b3-4c62-b383-46ab755cd8c9 req-2014606c-00c5-4ba3-a981-6795da2b123e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:39.437936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df4ab260-95b3-4c62-b383-46ab755cd8c9 req-2014606c-00c5-4ba3-a981-6795da2b123e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.1169021 Dec 21 04:04:39.453133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:39.494857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df4ab260-95b3-4c62-b383-46ab755cd8c9 req-40d386eb-f677-4b18-9373-92bd4bbefe2b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506642 Dec 21 04:04:39.495970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.514494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:39.517351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:39.531657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67f6daeb-7b35-4c03-9b30-2cb5942c40ce None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:39.538500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:39.592051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=80c7350a-da12-43ca-98fa-cd03001717ae,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:39.655801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dae6a672-03a5-4a58-9fe4-3755e1bd6332 None None] Provisioning complete for port 80c7350a-da12-43ca-98fa-cd03001717ae triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:39.656174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dae6a672-03a5-4a58-9fe4-3755e1bd6332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:39.718697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9af4ef3c-d48b-437e-8852-f063d225dc37'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:39.757725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dae6a672-03a5-4a58-9fe4-3755e1bd6332 None None] Port 80c7350a-da12-43ca-98fa-cd03001717ae cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:40.011499 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:40.314205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:40.583331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:04:40.746134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:40.759557 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:40.791789 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:40.792334 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:40.847217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26c5c0a2-f660-4cd1-8e35-35bea8d55b76 req-72d366cd-fb09-47d2-9c98-8cfc58755eb7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:40.849888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c5c0a2-f660-4cd1-8e35-35bea8d55b76 req-72d366cd-fb09-47d2-9c98-8cfc58755eb7 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 945 time: 0.1049511 Dec 21 04:04:40.875982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:40.880537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-05022be0-55b6-49a5-b2bc-f0feb6350494 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 2.6408603 Dec 21 04:04:40.880767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45912) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:40.919746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26c5c0a2-f660-4cd1-8e35-35bea8d55b76 req-52241e39-18a0-4063-8b55-eae0e295e09c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636113 Dec 21 04:04:40.960418 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:40.977218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9af4ef3c-d48b-437e-8852-f063d225dc37 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:41.089415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f31ae304-a3a1-4c9b-aeaa-2ac665999286 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=ec158f7f7c994dacb4d1785b3b8f2ff1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2044845 Dec 21 04:04:41.089789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:41.185353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 9af4ef3c-d48b-437e-8852-f063d225dc37 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:04:41.189297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9af4ef3c-d48b-437e-8852-f063d225dc37 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:41.189668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.260442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:39Z', 'revision_number': 3, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:41.293409 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:41.293926 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Updating router 2191bc86-3ede-4925-a826-67ac34d6fe52 port 80c7350a-da12-43ca-98fa-cd03001717ae binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:04:41.297270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3ccab66-f60a-4f9a-8aea-b20173d998e3 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:41.299322 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3ccab66-f60a-4f9a-8aea-b20173d998e3 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2085457 Dec 21 04:04:41.302108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45924) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:41.331031 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.379403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.386124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45930) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:41.388656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f9241906-57ce-46dd-9e7d-6c24e947441d tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0849838 Dec 21 04:04:41.391989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2107928303', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:41.430040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:41.431749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:41.434242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d886e45-5f9a-4002-8175-f700cfada651" -d '{"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-plugged", "status": "completed", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:41.481278 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fba3740a-7b89-43a5-b6a2-10d2dc4481c7 x-openstack-request-id: req-fba3740a-7b89-43a5-b6a2-10d2dc4481c7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:41.481675 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-plugged", "status": "completed", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:41.481787 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fba3740a-7b89-43a5-b6a2-10d2dc4481c7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:41.482195 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'code': 200} Dec 21 04:04:41.534904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.589022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:41.595542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:41.618325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.716167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d669c12a-570c-45a2-855e-2f176d62ec84 req-91222614-b1a5-4bb5-8312-abb4f010857a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:41.718567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d669c12a-570c-45a2-855e-2f176d62ec84 req-91222614-b1a5-4bb5-8312-abb4f010857a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 1098 time: 0.1157987 Dec 21 04:04:41.785523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d669c12a-570c-45a2-855e-2f176d62ec84 req-d0f8c9de-aa74-4884-9115-68ab1dd55a58 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588455 Dec 21 04:04:41.838785 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.849949 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:04:41.902695 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:41.958171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6474c610-a4f9-43ab-9863-3b765ae1db2b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:41.977039 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Attempting to bind port 80c7350a-da12-43ca-98fa-cd03001717ae on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:41.985229 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Attempting to bind port 80c7350a-da12-43ca-98fa-cd03001717ae by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:41.985229 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Attempting to bind port 80c7350a-da12-43ca-98fa-cd03001717ae on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:42.006733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6f64f9ca-3e97-44f9-800f-d975b375a16a None None] Provisioning complete for port 80c7350a-da12-43ca-98fa-cd03001717ae triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:42.006733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f64f9ca-3e97-44f9-800f-d975b375a16a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.013318 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:42.013927 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:42.014507 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.015098 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:42.015770 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Bound port: 80c7350a-da12-43ca-98fa-cd03001717ae, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:42.016314 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.056003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6f64f9ca-3e97-44f9-800f-d975b375a16a None None] Port 80c7350a-da12-43ca-98fa-cd03001717ae cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:42.076872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.082648 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] For port 80c7350a-da12-43ca-98fa-cd03001717ae, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:42.088166 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] For port 80c7350a-da12-43ca-98fa-cd03001717ae, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=80c7350a-da12-43ca-98fa-cd03001717ae,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:42.093060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be29eac9-852c-4d38-ae91-d99d18057dbd None None] Pushing event updated for resources: {'Port': ['ID=80c7350a-da12-43ca-98fa-cd03001717ae,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:42.146463 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.178331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Subnet': ['ID=16163aab-7fce-4449-a3d4-4b3d03e00005,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:42.205791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Checking segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:42.205791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network hostable DHCP agents. Network: 21c72edc-8844-45a3-93c7-94b865615264, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:04:42.206211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ebd0a0f-dd16-456e-b7eb-e06a4b27b539 req-04fd9f0a-dc34-4909-a99e-d420ea3fa49d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:42.217767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ebd0a0f-dd16-456e-b7eb-e06a4b27b539 req-04fd9f0a-dc34-4909-a99e-d420ea3fa49d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1499403 Dec 21 04:04:42.244816 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be29eac9-852c-4d38-ae91-d99d18057dbd None None] Pushing event updated for resources: {'Port': ['ID=80c7350a-da12-43ca-98fa-cd03001717ae,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:42.257639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6d727df-1b32-4b53-83c2-1ed0b80d2d12 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:04:42.264718 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:42.265821 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:42.312363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 21c72edc-8844-45a3-93c7-94b865615264 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:04:42.379836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ebd0a0f-dd16-456e-b7eb-e06a4b27b539 req-28e83f93-70aa-49e7-b2bf-49a05b4897c9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1503294 Dec 21 04:04:42.386186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 21c72edc-8844-45a3-93c7-94b865615264) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:42.390092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a886a47c-1973-488b-a98c-c98630a9d682 None None] Provisioning complete for port 80c7350a-da12-43ca-98fa-cd03001717ae triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:42.390092 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a886a47c-1973-488b-a98c-c98630a9d682 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.399365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:42.401801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.440606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74282940-abe8-4d86-aa00-c7d4cdee0f0e None None] Network 21c72edc-8844-45a3-93c7-94b865615264 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:42.506242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c5bb3ff4-1df1-4a99-adc5-901a2b834ef4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.1182301 Dec 21 04:04:42.507666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45954) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:42.632694 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:42.728042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a886a47c-1973-488b-a98c-c98630a9d682 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.735582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-21c72edc-8844-45a3-93c7-94b865615264', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:04:42.736660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:42.764935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a886a47c-1973-488b-a98c-c98630a9d682 None None] For port 80c7350a-da12-43ca-98fa-cd03001717ae, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=80c7350a-da12-43ca-98fa-cd03001717ae,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:42.902296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:39Z', 'revision_number': 3, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:42.951132 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ce53f3-af93-4679-bf27-e62c4373ba99 None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:39Z', 'revision_number': 3, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:43.007603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a886a47c-1973-488b-a98c-c98630a9d682 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:43.124022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a886a47c-1973-488b-a98c-c98630a9d682 None None] Pushing event updated for resources: {'Port': ['ID=80c7350a-da12-43ca-98fa-cd03001717ae,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:43.232099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Allocated IP 172.20.0.2 (21c72edc-8844-45a3-93c7-94b865615264/16163aab-7fce-4449-a3d4-4b3d03e00005/ccf69444-e380-4346-8ed0-dfaef2bb42e4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:43.328385 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:43.681816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52fd87f-d5c1-4a46-9de0-440d84e95eb9 req-466ebedd-5c2d-4aa5-be05-7ed2ef947955 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:43.683422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a52fd87f-d5c1-4a46-9de0-440d84e95eb9 req-466ebedd-5c2d-4aa5-be05-7ed2ef947955 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1558826 Dec 21 04:04:43.917548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:43.945851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a52fd87f-d5c1-4a46-9de0-440d84e95eb9 req-47c6eede-2516-43e3-990d-ab1a8771dfe5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2527971 Dec 21 04:04:44.008769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:44.106530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Network 21c72edc-8844-45a3-93c7-94b865615264 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:44.121591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:44.126745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:44.149122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Pushing event updated for resources: {'Port': ['ID=ccf69444-e380-4346-8ed0-dfaef2bb42e4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:44.203323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.20.0.1 (21c72edc-8844-45a3-93c7-94b865615264/16163aab-7fce-4449-a3d4-4b3d03e00005/c2c5190e-bf97-41ff-b40e-009d2b00c746) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:04:44.244420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Attempting to bind port ccf69444-e380-4346-8ed0-dfaef2bb42e4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:44.244778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Attempting to bind port ccf69444-e380-4346-8ed0-dfaef2bb42e4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:44.245190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Attempting to bind port ccf69444-e380-4346-8ed0-dfaef2bb42e4 on network 21c72edc-8844-45a3-93c7-94b865615264 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:44.261112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:44.261498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Checking segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:44.261908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:44.262515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Bound using segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:44.262842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Bound port: ccf69444-e380-4346-8ed0-dfaef2bb42e4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:44.263254 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:44.391603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] For port ccf69444-e380-4346-8ed0-dfaef2bb42e4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:44.395019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] For port ccf69444-e380-4346-8ed0-dfaef2bb42e4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ccf69444-e380-4346-8ed0-dfaef2bb42e4,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:44.471536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:44.501576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f515ad9f-7c5c-4eec-9d8d-8a5b0a2fa429 req-0fb00508-8212-484a-8950-46d7132dd148 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:44.506777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f515ad9f-7c5c-4eec-9d8d-8a5b0a2fa429 req-0fb00508-8212-484a-8950-46d7132dd148 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1136334 Dec 21 04:04:44.531246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:44.578253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82032097-62be-40ba-ac2d-4c71115db24d None None] Pushing event updated for resources: {'Port': ['ID=ccf69444-e380-4346-8ed0-dfaef2bb42e4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:44.755171 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:44.933259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 21c72edc-8844-45a3-93c7-94b865615264 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:44.942992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:44.950069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:04:45.123989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:45.131645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f515ad9f-7c5c-4eec-9d8d-8a5b0a2fa429 req-38f5b1fb-26ea-4cd0-8046-4feacbd86121 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5008023 Dec 21 04:04:45.157895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ccf69444-e380-4346-8ed0-dfaef2bb42e4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:45.193329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=c2c5190e-bf97-41ff-b40e-009d2b00c746,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:45.273746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ccf69444-e380-4346-8ed0-dfaef2bb42e4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:45.274128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:45.374700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845a9b95-8039-4261-bd73-086ebcb32631 req-4b834373-ea0f-4cfd-99d4-3a0bca32a00a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:45.376582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-845a9b95-8039-4261-bd73-086ebcb32631 req-4b834373-ea0f-4cfd-99d4-3a0bca32a00a tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.0814545 Dec 21 04:04:45.424258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:45.463741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port ccf69444-e380-4346-8ed0-dfaef2bb42e4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ccf69444-e380-4346-8ed0-dfaef2bb42e4,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:45.500275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:45.545371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:45.546202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 80c7350a-da12-43ca-98fa-cd03001717ae up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:45.596978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-845a9b95-8039-4261-bd73-086ebcb32631 req-7b26a2bc-16fd-42ba-8fff-4041e4fa1c40 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2093723 Dec 21 04:04:45.671877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 80c7350a-da12-43ca-98fa-cd03001717ae triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:45.672260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:45.673686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ccf69444-e380-4346-8ed0-dfaef2bb42e4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:45.953987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:46.029703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:46.172862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=c2c5190e-bf97-41ff-b40e-009d2b00c746,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:46.177560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:46.310953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 21c72edc-8844-45a3-93c7-94b865615264 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:04:46.313032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:46.437139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d20375f-7f89-45a6-a4df-682dd83a1e98 req-c85d65a5-dfc8-4c0a-abc0-5b397913cfa4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:46.445429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d20375f-7f89-45a6-a4df-682dd83a1e98 req-c85d65a5-dfc8-4c0a-abc0-5b397913cfa4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1173518 Dec 21 04:04:46.533073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbd4bd7b-a838-4b23-90d0-00cf9d82c7cf None None] Network 21c72edc-8844-45a3-93c7-94b865615264 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:46.608497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c7653c35-7e7c-4fcc-8f36-fa4f7cf1bb97 None None] Provisioning complete for port ccf69444-e380-4346-8ed0-dfaef2bb42e4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:46.608789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c7653c35-7e7c-4fcc-8f36-fa4f7cf1bb97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:46.878021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ccf69444-e380-4346-8ed0-dfaef2bb42e4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:46.933185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ccf69444-e380-4346-8ed0-dfaef2bb42e4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:46.933841 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:47.029346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d20375f-7f89-45a6-a4df-682dd83a1e98 req-90ceba11-840e-43a8-8fb0-54f227a96d09 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5830064 Dec 21 04:04:47.035953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:04:47.057440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74db1cb4-295f-433a-bf37-5672f172b36d req-916ec5dd-e7c6-49bb-8288-654a19c1cce4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:47.058986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74db1cb4-295f-433a-bf37-5672f172b36d req-916ec5dd-e7c6-49bb-8288-654a19c1cce4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1422358 Dec 21 04:04:47.119665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5dbaf828-98f0-4f43-96a2-f94fc912b2a0 None None] Provisioning complete for port ccf69444-e380-4346-8ed0-dfaef2bb42e4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:47.120357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dbaf828-98f0-4f43-96a2-f94fc912b2a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:47.230645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5dbaf828-98f0-4f43-96a2-f94fc912b2a0 None None] Provisioning complete for port c2c5190e-bf97-41ff-b40e-009d2b00c746 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:47.231233 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dbaf828-98f0-4f43-96a2-f94fc912b2a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:47.276757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74db1cb4-295f-433a-bf37-5672f172b36d req-5dc3441c-9108-4f71-84e4-a14a1838def0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2056882 Dec 21 04:04:47.288321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5dbaf828-98f0-4f43-96a2-f94fc912b2a0 None None] Port c2c5190e-bf97-41ff-b40e-009d2b00c746 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:47.323371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94fd0bf9-060e-475d-92dd-c80befb725c9 req-4fab2c79-058f-4f6e-84fc-4ddcc74198da tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:47.325026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94fd0bf9-060e-475d-92dd-c80befb725c9 req-4fab2c79-058f-4f6e-84fc-4ddcc74198da tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1557896 Dec 21 04:04:47.331363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:04:47.340066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1e2c7466-3f96-431b-b677-37bf0674bf40 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "PUT /v2.0/routers/2191bc86-3ede-4925-a826-67ac34d6fe52/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8298423 Dec 21 04:04:47.342678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46060) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:47.345495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:04:47.374900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:47.374900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:47.437154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94fd0bf9-060e-475d-92dd-c80befb725c9 req-0eab7100-1ce8-42ba-824c-801448cf4050 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/security-groups?id=52097dff-d468-4a2b-8853-72ce92660ada&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959079 Dec 21 04:04:47.478905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-1bcbcff9-326c-4abc-be5d-20c0dee3b8c0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:47.481556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-1bcbcff9-326c-4abc-be5d-20c0dee3b8c0 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.31 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 946 time: 0.1123679 Dec 21 04:04:47.535267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-26a97543-ea13-4c23-9757-204a761c8e0a None None] Provisioning complete for port c2c5190e-bf97-41ff-b40e-009d2b00c746 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:47.535935 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26a97543-ea13-4c23-9757-204a761c8e0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:47.639950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-26a97543-ea13-4c23-9757-204a761c8e0a None None] Port c2c5190e-bf97-41ff-b40e-009d2b00c746 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:47.682957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Deleting port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:04:47.683529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:47.687950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:47.862500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] For port 22270d5e-6f54-41c2-a9eb-fd2c24aef262, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=22270d5e-6f54-41c2-a9eb-fd2c24aef262,segment=NetworkSegment(16c2409c-2ec9-4dc7-ad77-ede3d74ad33d),segment_id=16c2409c-2ec9-4dc7-ad77-ede3d74ad33d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:47.862884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:47.891372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Calling delete_port for 22270d5e-6f54-41c2-a9eb-fd2c24aef262 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:04:48.008401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fbf5ea85-a0f9-4edd-96ab-54388ed697b1 None None] Provisioning complete for port c2c5190e-bf97-41ff-b40e-009d2b00c746 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:48.009594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fbf5ea85-a0f9-4edd-96ab-54388ed697b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.048208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 2, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:48.091047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:04:48.091418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Updating router 2191bc86-3ede-4925-a826-67ac34d6fe52 port c2c5190e-bf97-41ff-b40e-009d2b00c746 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:04:48.138782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fbf5ea85-a0f9-4edd-96ab-54388ed697b1 None None] Port c2c5190e-bf97-41ff-b40e-009d2b00c746 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:48.149682 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.166344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.166887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.167448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.168080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.168718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.169559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.170163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.170816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.171435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.172040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.172686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.174972 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-436461aa-c2fa-4ad7-afab-ef07c5c4d363 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 7773 time: 0.8281977 Dec 21 04:04:48.182307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46078) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:48.221880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.263888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['22270d5e-6f54-41c2-a9eb-fd2c24aef262'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:48.333470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Pushing event deleted for resources: {'Port': ['ID=22270d5e-6f54-41c2-a9eb-fd2c24aef262,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:48.345197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.345857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.346813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.347351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.347888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.349209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.349666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.350173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.350628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.351212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.351658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.358015 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b6d024f-6476-47d6-a6c8-25c25e3d8bc0 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 7103 time: 0.1737163 Dec 21 04:04:48.358700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46084) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:48.379370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] No DVR routers for this DVR port 22270d5e-6f54-41c2-a9eb-fd2c24aef262 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:04:48.382738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.386794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42b8f307-5fb3-488d-8af0-9a36bb34e82e req-e678c76b-9e27-42cd-851c-f8bc92fe32a5 tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.31 "DELETE /v2.0/ports/22270d5e-6f54-41c2-a9eb-fd2c24aef262 HTTP/1.1" status: 204 len: 173 time: 0.8978879 Dec 21 04:04:48.387329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-deleted', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:48.390076 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-916504ea-0dc8-4714-ad71-be6901844f8b" -d '{"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-deleted", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:48.418828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1519294-cfc5-42fc-986b-900c5a09e75d req-ae564850-65cb-4bb9-862a-8d549fb86fb6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.426197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1519294-cfc5-42fc-986b-900c5a09e75d req-ae564850-65cb-4bb9-862a-8d549fb86fb6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.0873189 Dec 21 04:04:48.528458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1519294-cfc5-42fc-986b-900c5a09e75d req-2ca9e0f9-06f5-4ac6-a0f0-0dfff81698a9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878477 Dec 21 04:04:48.528458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-746774b4-f7b9-4347-a75c-7e667153831f req-d2f15647-96b2-4301-a457-91dc411fb0fa tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:48.535742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-746774b4-f7b9-4347-a75c-7e667153831f req-d2f15647-96b2-4301-a457-91dc411fb0fa tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1010199 Dec 21 04:04:48.558347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.590979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-746774b4-f7b9-4347-a75c-7e667153831f req-90dbc240-c489-4f39-8c2f-d659293e9d0e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534503 Dec 21 04:04:48.622893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.657501 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6c78d2f-bb52-4bcb-bc99-6cd512bd3b9e x-openstack-request-id: req-b6c78d2f-bb52-4bcb-bc99-6cd512bd3b9e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:48.657896 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "082b4e20-36d4-4f1d-bab1-732629652f89", "name": "network-vif-deleted", "tag": "22270d5e-6f54-41c2-a9eb-fd2c24aef262", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:48.658686 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b6c78d2f-bb52-4bcb-bc99-6cd512bd3b9e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:48.658686 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '082b4e20-36d4-4f1d-bab1-732629652f89', 'name': 'network-vif-deleted', 'tag': '22270d5e-6f54-41c2-a9eb-fd2c24aef262', 'status': 'completed', 'code': 200} Dec 21 04:04:48.753298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Pushing event updated for resources: {'Port': ['ID=c2c5190e-bf97-41ff-b40e-009d2b00c746,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:48.769604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1ee375a-bd38-431c-9689-5a0c255649c0 req-63ee067f-2fc3-454e-afab-40691986b26c tempest-ServersNegativeTestJSON-1457324073 tempest-ServersNegativeTestJSON-1457324073-project] 10.222.0.18 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.0847187 Dec 21 04:04:48.788741 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4aff55ee-4d65-49f2-b1e9-7c7e89ec6698 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 4498 time: 0.4287076 Dec 21 04:04:48.809290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.809663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.810018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.810367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.810715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.811139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.811482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.812051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.812396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.812731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.813126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.813461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.813793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:04:48.868245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Attempting to bind port c2c5190e-bf97-41ff-b40e-009d2b00c746 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:04:48.872776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Attempting to bind port c2c5190e-bf97-41ff-b40e-009d2b00c746 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:04:48.873337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Attempting to bind port c2c5190e-bf97-41ff-b40e-009d2b00c746 on network 21c72edc-8844-45a3-93c7-94b865615264 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:04:48.879922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:04:48.881953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Checking segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:48.882422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.883159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Bound using segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:04:48.884336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Bound port: c2c5190e-bf97-41ff-b40e-009d2b00c746, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:04:48.884821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:48.943961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17a01f08-ed36-44ba-a64b-cfa719555a31 req-6cd93a1e-eb03-4ce8-a957-7fa30d9aff59 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=082b4e20-36d4-4f1d-bab1-732629652f89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0606959 Dec 21 04:04:49.009138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] For port c2c5190e-bf97-41ff-b40e-009d2b00c746, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:04:49.022802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] For port c2c5190e-bf97-41ff-b40e-009d2b00c746, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c2c5190e-bf97-41ff-b40e-009d2b00c746,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:04:49.035484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17a01f08-ed36-44ba-a64b-cfa719555a31 req-916decf0-b04c-4c46-b3e3-4527d4665b5c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9be1447e894c4d89ae0d884935aafca9&device_id=082b4e20-36d4-4f1d-bab1-732629652f89 HTTP/1.1" status: 200 len: 210 time: 0.0541654 Dec 21 04:04:49.080879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5f5e7241-d762-4a04-a35a-59cb1d199bbd None None] Provisioning complete for port c2c5190e-bf97-41ff-b40e-009d2b00c746 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:49.080879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f5e7241-d762-4a04-a35a-59cb1d199bbd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.104525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.165389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5f5e7241-d762-4a04-a35a-59cb1d199bbd None None] Port c2c5190e-bf97-41ff-b40e-009d2b00c746 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:04:49.202543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:04:49.203232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:49.208697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e49533-65b4-4126-91d6-30bf6de26b9c None None] Pushing event updated for resources: {'Port': ['ID=c2c5190e-bf97-41ff-b40e-009d2b00c746,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:49.225296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a01f08-ed36-44ba-a64b-cfa719555a31 req-59ecf2c3-47be-4db8-8436-761bf451d436 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:49.227593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17a01f08-ed36-44ba-a64b-cfa719555a31 req-59ecf2c3-47be-4db8-8436-761bf451d436 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=9be1447e894c4d89ae0d884935aafca9&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1628265 Dec 21 04:04:49.369556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:49.375820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1138725281', 'description': 'tempest-secgroup-smoke-1138725281 description', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:49.402368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a01f08-ed36-44ba-a64b-cfa719555a31 req-9d23c4fc-9799-4113-af8c-f60d05be142b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:49.403950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17a01f08-ed36-44ba-a64b-cfa719555a31 req-9d23c4fc-9799-4113-af8c-f60d05be142b service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1684809 Dec 21 04:04:49.407527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:04:49.493681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.553971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-06a7f96f-c4a6-411f-9e8b-68d7c6a362ce None None] Provisioning complete for port c2c5190e-bf97-41ff-b40e-009d2b00c746 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:49.554375 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06a7f96f-c4a6-411f-9e8b-68d7c6a362ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.677127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.774162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.796270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911b248c-bbdb-47d1-855f-65637a24c56b req-88adb665-a7bd-4837-be3a-eb3bcba7128d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:49.800787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-911b248c-bbdb-47d1-855f-65637a24c56b req-88adb665-a7bd-4837-be3a-eb3bcba7128d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1190326 Dec 21 04:04:49.808298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d566f66d-6216-4613-b66c-027f51395f51,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:49.821123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21bf1291-7882-4cfc-be23-557276b9eef6 req-e5f7129b-892f-45a3-92a1-40c26afbbf33 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:49.823768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21bf1291-7882-4cfc-be23-557276b9eef6 req-e5f7129b-892f-45a3-92a1-40c26afbbf33 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1061392 Dec 21 04:04:49.897189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-911b248c-bbdb-47d1-855f-65637a24c56b req-a58a6f25-96cc-40aa-9dc5-56e01e4ac0ea tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723460 Dec 21 04:04:49.907489 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.912268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bee34806-591e-46aa-ab02-c597f1efcef5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.5371308 Dec 21 04:04:49.912268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:49.917442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'd566f66d-6216-4613-b66c-027f51395f51', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:49.928921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21bf1291-7882-4cfc-be23-557276b9eef6 req-9d2dc416-4ccd-4f50-89fd-e50ff5a26ac3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0963428 Dec 21 04:04:49.937249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06a7f96f-c4a6-411f-9e8b-68d7c6a362ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:49.988380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-06a7f96f-c4a6-411f-9e8b-68d7c6a362ce None None] For port c2c5190e-bf97-41ff-b40e-009d2b00c746, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c2c5190e-bf97-41ff-b40e-009d2b00c746,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:49.997735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc5779c7-57de-49ae-a49c-198a3309992b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.002921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:48Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:50.008353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:50.051211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc7ce0d-3b02-421f-86f6-8d8498a5520a None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:48Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:04:50.054597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.094963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Deleting subnet af597cc9-d6ea-4007-b8f3-5cbc38b23a3a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:04:50.099569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06a7f96f-c4a6-411f-9e8b-68d7c6a362ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.101796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.176164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a7f96f-c4a6-411f-9e8b-68d7c6a362ce None None] Pushing event updated for resources: {'Port': ['ID=c2c5190e-bf97-41ff-b40e-009d2b00c746,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:50.224211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.246239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.290908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.320034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.354814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22c6c57c-9120-443e-9efe-4df2777afa31,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:50.420294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.421842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-983e2067-ebe1-437a-8249-d764fed0ff84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5083306 Dec 21 04:04:50.427311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46170) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:50.429345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'd566f66d-6216-4613-b66c-027f51395f51', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:50.452783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.494554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=af597cc9-d6ea-4007-b8f3-5cbc38b23a3a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:50.500505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.505066 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1408730-01f9-421e-b4b3-3c439fe12fc0 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/af597cc9-d6ea-4007-b8f3-5cbc38b23a3a HTTP/1.1" status: 204 len: 168 time: 0.4923556 Dec 21 04:04:50.507930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:50.544511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.630617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.644720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.722690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.755085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.766572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a680dce6-755f-4c4d-b8ee-7edc2c4eb6cd,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:50.810642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1d34dd2a-275c-4073-aad9-16b29c6ef929']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:50.825406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:50.825887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16c2409c-2ec9-4dc7-ad77-ede3d74ad33d') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:04:50.838864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.855983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.866633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:04:50.867358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:04:50.873428 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:04:50.888398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:50.892581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ab46467c-2dec-441b-9904-848bbe1686f3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4671845 Dec 21 04:04:50.893249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46200) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:50.897693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'd566f66d-6216-4613-b66c-027f51395f51', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:51.000182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c2c5190e-bf97-41ff-b40e-009d2b00c746 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:51.012864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.040277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9af4ef3c-d48b-437e-8852-f063d225dc37 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:04:51.120402 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.147208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.167433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.175766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] 10.222.0.18 "DELETE /v2.0/networks/1d34dd2a-275c-4073-aad9-16b29c6ef929 HTTP/1.1" status: 204 len: 168 time: 0.6667171 Dec 21 04:04:51.213011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcad5fab-a21b-41ea-a02d-8f8188dab1dd admin admin] Pushing event deleted for resources: {'Network': ['ID=1d34dd2a-275c-4073-aad9-16b29c6ef929,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:51.220389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.239102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36068a1-abf8-4d8e-b592-2c3008d32d70 req-073b0e02-f5c3-4ee9-8436-2237ce86a9bc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:51.248550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d36068a1-abf8-4d8e-b592-2c3008d32d70 req-073b0e02-f5c3-4ee9-8436-2237ce86a9bc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1443386 Dec 21 04:04:51.270863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bbcb227-db4f-48e7-abe0-325b9b1306e6 req-3bf90928-db13-4b0c-90c9-52c32313dbd3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:51.291479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bbcb227-db4f-48e7-abe0-325b9b1306e6 req-3bf90928-db13-4b0c-90c9-52c32313dbd3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2316642 Dec 21 04:04:51.301801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c2c5190e-bf97-41ff-b40e-009d2b00c746 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:51.303191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed5f0786-edaa-4858-bb59-faa41f137896,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:51.304525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.381944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.383403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de11825c-ce4b-4681-b9f2-0678383d27d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4891980 Dec 21 04:04:51.385624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:04:51.386253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46236) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:51.392286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'd566f66d-6216-4613-b66c-027f51395f51', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:51.409079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d36068a1-abf8-4d8e-b592-2c3008d32d70 req-5c9fd2c9-7121-4ae3-91f8-bf8bc901d927 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1594093 Dec 21 04:04:51.470844 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bbcb227-db4f-48e7-abe0-325b9b1306e6 req-18b8c86b-c49d-4f2a-8ef9-0006f94cfb72 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1746812 Dec 21 04:04:51.495139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:51.509076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 22270d5e-6f54-41c2-a9eb-fd2c24aef262 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:04:51.510282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 22270d5e-6f54-41c2-a9eb-fd2c24aef262 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:04:51.517890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.521730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'port_id': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'mac_address': 'fa:16:3e:9a:ea:53', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 127, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:04:51.620892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.640052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 9af4ef3c-d48b-437e-8852-f063d225dc37 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:04:51.676551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.678587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:51.751245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.783330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.794128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5504bd38-3121-40bb-8f12-e4560fd7ac24,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:51.817862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46262) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:51.854858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:51.891443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46268) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:51.893508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9a03d8bd-8aca-42a4-bc8d-ffc969039cb1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9be1447e894c4d89ae0d884935aafca9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0734789 Dec 21 04:04:51.908586 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:51.910089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7bb920cc-c2ea-4c06-bb5f-5471f6a99cbe tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5228200 Dec 21 04:04:51.913061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46272) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:51.918163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'd566f66d-6216-4613-b66c-027f51395f51', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:51.972784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9af4ef3c-d48b-437e-8852-f063d225dc37'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:04:51.983514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ed2d554-52bf-465e-91dc-66cb9ab9d4d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.008301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ed2d554-52bf-465e-91dc-66cb9ab9d4d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.063370 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Project ec158f7f7c994dacb4d1785b3b8f2ff1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:04:52.072754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.162842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.194408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ed2d554-52bf-465e-91dc-66cb9ab9d4d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.197636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ed2d554-52bf-465e-91dc-66cb9ab9d4d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.205768 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8ed2d554-52bf-465e-91dc-66cb9ab9d4d4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/52097dff-d468-4a2b-8853-72ce92660ada HTTP/1.1" status: 204 len: 168 time: 0.3125751 Dec 21 04:04:52.221175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ed2d554-52bf-465e-91dc-66cb9ab9d4d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52097dff-d468-4a2b-8853-72ce92660ada,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:52.249668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.270564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ec75587d-85d6-4570-8301-e56df14fbd5f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:52.353347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.354889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-373cddef-f8cf-4b19-9d0f-bf231a6d9446 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4408300 Dec 21 04:04:52.358438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 46294) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:52.363618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'd566f66d-6216-4613-b66c-027f51395f51', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:52.483231 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Project ec158f7f7c994dacb4d1785b3b8f2ff1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:04:52.491666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.592359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-e577a554-e433-4b72-af98-6612b2167273 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.1654606 Dec 21 04:04:52.649049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.668647 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b11ccca7-f3e2-49f2-8627-785813a048c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.685840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a1864e-cc59-4920-999a-9d8050f44417 req-fad06840-8200-4a48-803e-c1a1f73aafd9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.693073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42a1864e-cc59-4920-999a-9d8050f44417 req-fad06840-8200-4a48-803e-c1a1f73aafd9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 945 time: 0.1552341 Dec 21 04:04:52.771074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.776509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:52.835298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42a1864e-cc59-4920-999a-9d8050f44417 req-08eb0c10-d13b-41bf-a4eb-69c76ae1e5f9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1411443 Dec 21 04:04:52.869476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ac5046d8-7184-4d66-a67e-50578e295811,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:52.908570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c27bb16-ba6d-4391-9b9b-3ddf0407dad8 req-bece3d1f-fa93-4a22-8f43-14f1b5d06ac2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.918870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c27bb16-ba6d-4391-9b9b-3ddf0407dad8 req-bece3d1f-fa93-4a22-8f43-14f1b5d06ac2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2173235 Dec 21 04:04:52.967907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.970874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.973587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.976583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.976583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.976583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.976583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:52.985680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-48c7406c-e707-480d-8960-ebbf26d30471 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.2712057 Dec 21 04:04:53.004572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:53.005946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b1c78611-283f-4953-999d-378367e07426 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.6461835 Dec 21 04:04:53.065824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9af4ef3c-d48b-437e-8852-f063d225dc37 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:04:53.241523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9af4ef3c-d48b-437e-8852-f063d225dc37 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:04:53.244064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:53.244294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c27bb16-ba6d-4391-9b9b-3ddf0407dad8 req-fbac272f-40ba-450e-9664-9660a8737c02 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3202569 Dec 21 04:04:53.306277 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:53.341321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-3e00443e-a70a-45d1-a454-2d405eaa92ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:53.354498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-3e00443e-a70a-45d1-a454-2d405eaa92ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:53.361174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-3e00443e-a70a-45d1-a454-2d405eaa92ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:53.362915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-3e00443e-a70a-45d1-a454-2d405eaa92ba service neutron] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 2297 time: 0.3232539 Dec 21 04:04:53.378598 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:53.403620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-1f148e73-567c-4e8e-a3d4-015d1010bc5c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1138725281&fields=id&tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 267 time: 0.1399691 Dec 21 04:04:53.414714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:04:53.417395 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47514703-5d92-4dca-8160-0dedc9ac605a" -d '{"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-plugged", "status": "completed", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:04:53.433888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:04:53.496619 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:53.496619 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:04:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef37da14-74e0-41e6-8ee6-56c810b76546 x-openstack-request-id: req-ef37da14-74e0-41e6-8ee6-56c810b76546 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:04:53.496619 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-plugged", "status": "completed", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:04:53.496619 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ef37da14-74e0-41e6-8ee6-56c810b76546 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:04:53.496619 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'code': 200} Dec 21 04:04:53.566409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:53.718667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-b998d1f5-2ccc-4b5f-804f-bd2ca9528a72 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 1001 time: 0.3439007 Dec 21 04:04:53.815008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-c31739b0-85ea-4c31-baeb-33217b51eeda tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:53.822059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-c31739b0-85ea-4c31-baeb-33217b51eeda tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/networks?id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 796 time: 0.4175618 Dec 21 04:04:53.847440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f3896f84-25cb-43c2-b13f-41493f9cce48 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/quotas/ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 375 time: 0.0243800 Dec 21 04:04:53.858506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-44dabce9-e004-44a8-90fd-e6ac0b4a435b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:53.859883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-44dabce9-e004-44a8-90fd-e6ac0b4a435b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.1212149 Dec 21 04:04:53.990446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-367c8eee-4b2a-42d8-bead-4fbf0cb20e6e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1421597 Dec 21 04:04:53.997833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-4a9317eb-4a82-40f7-831d-69e28ab87c80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:53.999656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-4a9317eb-4a82-40f7-831d-69e28ab87c80 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1128726 Dec 21 04:04:54.007661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8809bc-27b8-4d8d-aeae-7d3a7537a69d req-70760efd-be3c-4660-a902-6a782a1265a9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:54.009413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db8809bc-27b8-4d8d-aeae-7d3a7537a69d req-70760efd-be3c-4660-a902-6a782a1265a9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.0877743 Dec 21 04:04:54.099874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46390) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:54.192377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db8809bc-27b8-4d8d-aeae-7d3a7537a69d req-ecda941b-bcef-4d3c-a9ef-578ce7f12847 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1625733 Dec 21 04:04:54.251120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-18099c4f-b0be-43cc-99e2-1ef645925aa4 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2376359 Dec 21 04:04:54.268810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-428c878e-4a44-40cb-a98e-b136876d97a6 service neutron] 10.222.0.18 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2507169 Dec 21 04:04:54.332949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-342251525-network', 'tenant_id': 'f1fac7a4fc324e6fb3703b0fcb612ed1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:54.480063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Made reservation on behalf of f1fac7a4fc324e6fb3703b0fcb612ed1 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:54.488297 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:54.499560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:54.607130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-f872868f-9692-45af-a797-6c98a1b7961f service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3338194 Dec 21 04:04:54.636131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:54.642533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-bff46b5e-31c5-4a36-affc-88bc4e434e9c service neutron] 10.222.0.18 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3534691 Dec 21 04:04:54.707782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:54.747057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7439c569-f3fa-40db-88bb-a05128374422,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:54.750549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:04:54.768699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef11630b-c7fe-4b74-acaf-21d2e8b929ed req-558f1037-9fc6-45ae-8e98-c18b998dcfcd tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:54.777513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef11630b-c7fe-4b74-acaf-21d2e8b929ed req-558f1037-9fc6-45ae-8e98-c18b998dcfcd tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2656717 Dec 21 04:04:54.777976 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:54.778543 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Added segment aebf5ea6-eb2c-4e32-abdc-14ec77f8651f of type vlan for network ad9aecbc-826b-47f6-aade-ea0859ed2141 Dec 21 04:04:54.792254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-eda3d4af-4e82-43ae-9a1e-c79cc5185318 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.83&port_id=bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 217 time: 0.1466031 Dec 21 04:04:54.863157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:54.914970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef11630b-c7fe-4b74-acaf-21d2e8b929ed req-eb8442c8-6ef7-4ce6-84d7-6b305b422e5b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1363363 Dec 21 04:04:54.937577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-fc491b0c-b7ab-49bb-8a25-bd9a61b043fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:54.939739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-fc491b0c-b7ab-49bb-8a25-bd9a61b043fe service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.1317976 Dec 21 04:04:54.970397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.029653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-85d3e44d-587c-432d-86ae-7fa143add23d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:55.036811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.041450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:55.042066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.049111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-85d3e44d-587c-432d-86ae-7fa143add23d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1013489 Dec 21 04:04:55.071012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.105113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed5b51ff-2fb9-42fc-9910-8c26cf962c10 req-05ad3e6c-f4ae-45ac-bb14-d4a707b4117c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 210 time: 0.0871825 Dec 21 04:04:55.168763 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.0675995 Dec 21 04:04:55.169485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:55.175064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Request body: {'subnet': {'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestMultiTenantJSON-342251525-subnet', 'tenant_id': 'f1fac7a4fc324e6fb3703b0fcb612ed1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:55.181134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a554ae-a5dd-4f9e-a633-a85db54c69c3 admin admin] Pushing event updated for resources: {'Network': ['ID=ad9aecbc-826b-47f6-aade-ea0859ed2141,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:55.193131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ad9aecbc-826b-47f6-aade-ea0859ed2141 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:04:55.263064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-216b6490-ffb8-4e8c-a1b6-af6c876bd1c2 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1814973 Dec 21 04:04:55.299722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Made reservation on behalf of f1fac7a4fc324e6fb3703b0fcb612ed1 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:55.302079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.511091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13c4f23-6085-4aaa-aa19-0450f911a850 req-342c3d08-620d-4fae-abfd-b6a873b197df tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:55.518851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b13c4f23-6085-4aaa-aa19-0450f911a850 req-342c3d08-620d-4fae-abfd-b6a873b197df tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1748657 Dec 21 04:04:55.604283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-458d3951-0f57-42be-9300-1d7e31933bb3 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3318620 Dec 21 04:04:55.624194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b13c4f23-6085-4aaa-aa19-0450f911a850 req-d1053a1b-ee92-408b-8999-b685423a371a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990484 Dec 21 04:04:55.674484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-bc0c76cc-345d-4c7c-bd4c-be5fedd0517b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.54&port_id=c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 217 time: 0.0491171 Dec 21 04:04:55.758402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-0b45aec1-2fa9-4507-9211-2c60348a19b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:55.760314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-0b45aec1-2fa9-4507-9211-2c60348a19b8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0757308 Dec 21 04:04:55.802795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.836446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-8fbb9db5-0860-4cc8-8e33-fd9c7a3e7565 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:55.843338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-8fbb9db5-0860-4cc8-8e33-fd9c7a3e7565 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0676992 Dec 21 04:04:55.863387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:55.945181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Pushing event updated for resources: {'Subnet': ['ID=4e533b27-3e12-489d-b723-8d8a798bf017,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:55.985274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-9acdd72d-c1e1-4126-8e47-7ef07f4461d6 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1386852 Dec 21 04:04:56.038525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Checking segment: {'id': 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:56.039333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Network hostable DHCP agents. Network: ad9aecbc-826b-47f6-aade-ea0859ed2141, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:04:56.185111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Network ad9aecbc-826b-47f6-aade-ea0859ed2141 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:04:56.221079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef6470f-2f84-45c1-b45b-cac7b0cc20d0 req-140cde82-81fb-4eec-bff8-f1310321a0f2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:56.222824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ef6470f-2f84-45c1-b45b-cac7b0cc20d0 req-140cde82-81fb-4eec-bff8-f1310321a0f2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1028209 Dec 21 04:04:56.255065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bca4262-397e-413a-adc4-e4c1d1ae1380 req-c8555af1-8e45-4497-8518-9ff86e27a166 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 210 time: 0.0310750 Dec 21 04:04:56.291726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-d7530d21-1ee3-40e8-b2bb-2f84c7eecb85 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2913594 Dec 21 04:04:56.295739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ad9aecbc-826b-47f6-aade-ea0859ed2141) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:56.304781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:56.307685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:56.314981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93ef1810-9967-42dd-ad2d-2363e0f4c2bf None None] Network ad9aecbc-826b-47f6-aade-ea0859ed2141 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:56.427244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fc8514e-ae8b-41d3-b7ce-f3e6ce21958a None None] Network ad9aecbc-826b-47f6-aade-ea0859ed2141 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:56.443649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ef6470f-2f84-45c1-b45b-cac7b0cc20d0 req-c2bd4b7f-1471-49c0-aca2-593a5f5e8a81 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1872127 Dec 21 04:04:56.445665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-84801828-bb4c-4cc6-a7ce-7b16beb8c5f2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.84&port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 217 time: 0.0962400 Dec 21 04:04:56.469904 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-93f24f5b-d374-42f6-bb18-aecd4f1dda7f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.2908292 Dec 21 04:04:56.625176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-1c27b43b-d5d3-4000-9835-92372f60d7fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:56.626817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-1c27b43b-d5d3-4000-9835-92372f60d7fd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.1721098 Dec 21 04:04:56.734181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-0ff3311e-6576-4cab-a46f-3403060ff98a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:56.735792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-0ff3311e-6576-4cab-a46f-3403060ff98a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0981348 Dec 21 04:04:56.876194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c4b7dc-d9cd-4c94-a67b-203516dc7116 req-ac2c342e-ee75-4915-9947-c8f9a955f6e5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:56.877870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3c4b7dc-d9cd-4c94-a67b-203516dc7116 req-ac2c342e-ee75-4915-9947-c8f9a955f6e5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1208889 Dec 21 04:04:56.936006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-fbfb16fc-ae88-467c-b721-8320bb8a7495 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1912308 Dec 21 04:04:57.008681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3c4b7dc-d9cd-4c94-a67b-203516dc7116 req-9204b7b1-6276-46f5-b729-5b3f708176fd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146910 Dec 21 04:04:57.167320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-01a9a2d7-0aee-4d78-9a48-55bf7223336b service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2166727 Dec 21 04:04:57.233505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-d344a2c4-a7f1-4260-9393-922d32ae77ae service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.56&port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 217 time: 0.0588002 Dec 21 04:04:57.287274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-fd3e7e0d-676b-4af4-ada8-93d3d0821486 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:57.288873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-fd3e7e0d-676b-4af4-ada8-93d3d0821486 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0485671 Dec 21 04:04:57.388030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-4bcf4873-de43-4525-8610-26970b1f297c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:57.389810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-4bcf4873-de43-4525-8610-26970b1f297c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0766542 Dec 21 04:04:57.422863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8956a21a-563a-43b0-8d78-66e83af9ac42 req-339f1763-975b-450e-b801-35da47c4cdca tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 210 time: 0.0460372 Dec 21 04:04:57.535368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-3ffc8db3-d0af-4b4f-a737-cb93519f53d6 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1264017 Dec 21 04:04:57.653460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab15f248-c8a9-4a5f-be42-07b3bd128915 req-a4b6fc34-8fde-4021-8431-96535dd67e4b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:57.655106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab15f248-c8a9-4a5f-be42-07b3bd128915 req-a4b6fc34-8fde-4021-8431-96535dd67e4b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1185539 Dec 21 04:04:57.656278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:57.661592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-78554218-network', 'tenant_id': '7dd24810992140f690031b203d28026f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:57.707298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-84bdd002-e716-415a-8b28-15d1ac5b20c5 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1621561 Dec 21 04:04:57.770241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-d311d010-fb6d-44ae-954d-2a8fac5c16b9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 217 time: 0.0564096 Dec 21 04:04:57.788818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Made reservation on behalf of 7dd24810992140f690031b203d28026f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:57.793604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:57.819814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:57.898383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab15f248-c8a9-4a5f-be42-07b3bd128915 req-ab7072b9-6d47-4af6-936e-acc697a297b8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1933823 Dec 21 04:04:57.922549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-263324d9-c94e-4e64-8194-8d2ffaaf7240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:57.942597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-263324d9-c94e-4e64-8194-8d2ffaaf7240 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.1633942 Dec 21 04:04:57.997814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.010421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-1ffd6c37-94ba-45c7-8233-95d5f852a048 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:58.012071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-1ffd6c37-94ba-45c7-8233-95d5f852a048 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0685344 Dec 21 04:04:58.113799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.159304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] vlan segment allocate from pool success with {'vlan_id': 121, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:04:58.171548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.172050 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Added segment 5e55a309-95e7-4df1-a650-4dcc344f79ef of type vlan for network 5de31087-eb88-4cbc-9534-3e3772d385fe Dec 21 04:04:58.219849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.277492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=985a2829-c276-498d-9a0c-aa49a9ecf58c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:58.379183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.380386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:58.381289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.585942 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 896 time: 0.9284625 Dec 21 04:04:58.589801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:04:58.594625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Request body: {'subnet': {'network_id': '5de31087-eb88-4cbc-9534-3e3772d385fe', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestMultiTenantJSON-78554218-subnet', 'tenant_id': '7dd24810992140f690031b203d28026f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:58.612320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04185f49-d708-474b-9bf2-63be236b9aaa admin admin] Pushing event updated for resources: {'Network': ['ID=5de31087-eb88-4cbc-9534-3e3772d385fe,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:58.626108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5de31087-eb88-4cbc-9534-3e3772d385fe details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:04:58.729535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58faebee-6a61-4bf1-a923-be51f9c2f192 req-fc2488d7-4e59-4db5-94d8-f25b164939f8 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 210 time: 0.1067362 Dec 21 04:04:58.739666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Made reservation on behalf of 7dd24810992140f690031b203d28026f for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:58.746315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:58.804496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d68c00e-a49a-40d8-9f6d-83a84614d363 req-79ee4ae0-7a16-49f6-bffc-c730579986ed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:58.811789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d68c00e-a49a-40d8-9f6d-83a84614d363 req-79ee4ae0-7a16-49f6-bffc-c730579986ed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.2684746 Dec 21 04:04:58.902689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d68c00e-a49a-40d8-9f6d-83a84614d363 req-17a53136-0b35-42bc-ad9e-0be23c674f72 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843434 Dec 21 04:04:58.912319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-fb223cfd-1e79-441d-9f95-7fd6e1ee0a73 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8927422 Dec 21 04:04:59.013054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-762bc3a6-fbab-48ff-8edb-acadc348b4e1 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:59.014618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-762bc3a6-fbab-48ff-8edb-acadc348b4e1 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/networks?id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 796 time: 0.4630296 Dec 21 04:04:59.172199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba4a923-5355-431f-8273-0b9400bdbea7 req-34ef838d-1b15-418a-9cc5-e7e99937bea8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:59.179684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bba4a923-5355-431f-8273-0b9400bdbea7 req-34ef838d-1b15-418a-9cc5-e7e99937bea8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1640644 Dec 21 04:04:59.193080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-72bcb70e-f131-4ef4-90bc-d04dea665105 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 380 time: 0.1491196 Dec 21 04:04:59.212970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'port': {'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'admin_state_up': True, 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'security_groups': ['d566f66d-6216-4613-b66c-027f51395f51']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:04:59.239950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:59.248505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-f1717821-ad99-4bc3-956f-46a39bdefd8c service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3159335 Dec 21 04:04:59.303190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-a194d2de-85ea-4a0d-9449-757ff44bf6fc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0425067 Dec 21 04:04:59.369543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4fe1502-2074-4fad-b9ef-2cf24127b140,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:04:59.372855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Checking segment: {'id': '5e55a309-95e7-4df1-a650-4dcc344f79ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '5de31087-eb88-4cbc-9534-3e3772d385fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:04:59.373454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Network hostable DHCP agents. Network: 5de31087-eb88-4cbc-9534-3e3772d385fe, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:04:59.391863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bba4a923-5355-431f-8273-0b9400bdbea7 req-1f8a2b52-dafe-4a00-bf78-14d189b527f7 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2100637 Dec 21 04:04:59.450428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-ccab7b78-99b3-4077-943f-e5fb3f0759b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:59.450428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-ccab7b78-99b3-4077-943f-e5fb3f0759b6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.1337097 Dec 21 04:04:59.485262 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Network 5de31087-eb88-4cbc-9534-3e3772d385fe is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:04:59.511779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-2efeb04f-b155-4864-838d-3ac53f444202 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:59.513384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-2efeb04f-b155-4864-838d-3ac53f444202 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0577683 Dec 21 04:04:59.585538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5de31087-eb88-4cbc-9534-3e3772d385fe) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:04:59.590864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:04:59.591354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:59.598014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15b5e0fb-1848-4a6d-9cdf-595ca0f4bdc0 None None] Network 5de31087-eb88-4cbc-9534-3e3772d385fe requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:04:59.603547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:04:59.610818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:04:59.719821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-109d55ba-e1e1-48dd-b6dd-e4bac0cdbaab admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 1.1286292 Dec 21 04:04:59.737431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-65028a96-8162-4be6-b725-f65b1f6d048d service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2145603 Dec 21 04:04:59.853064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19d0c5de-527a-4afb-a4ab-8c9e93e64d7f None None] Network 5de31087-eb88-4cbc-9534-3e3772d385fe requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:05:00.029335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.20.0.6 (21c72edc-8844-45a3-93c7-94b865615264/16163aab-7fce-4449-a3d4-4b3d03e00005/b797276e-67e7-4d1b-a6ce-b9461293532b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:00.068287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f3e424c-12b8-4cda-91ca-b4ef26b08993 req-9fe740aa-2e1f-48ec-bf5d-34039954d6fc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 210 time: 0.0835311 Dec 21 04:05:00.088813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d216b17b-84e0-40e4-93b0-a02d50a025c7 req-a2ed2206-2fe2-4940-bc4b-dcb11493830b service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3286719 Dec 21 04:05:00.256081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-038f4674-ff9c-4a35-802d-9469aa118ac7 req-ebb98012-088f-44d4-b9c9-8117babdb61b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:00.257873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-038f4674-ff9c-4a35-802d-9469aa118ac7 req-ebb98012-088f-44d4-b9c9-8117babdb61b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1978631 Dec 21 04:05:00.415053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-038f4674-ff9c-4a35-802d-9469aa118ac7 req-b31048d4-89be-4894-804d-0780aed22119 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1491146 Dec 21 04:05:00.446493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:00.594396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed42936-e1cb-49d7-81d6-ec0e39b0985a req-88d4590d-4cbd-4344-ba1e-a33f468726f9 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:00.621288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ed42936-e1cb-49d7-81d6-ec0e39b0985a req-88d4590d-4cbd-4344-ba1e-a33f468726f9 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0958841 Dec 21 04:05:00.643292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:00.788455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 21c72edc-8844-45a3-93c7-94b865615264 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:00.798247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:00.815864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ed42936-e1cb-49d7-81d6-ec0e39b0985a req-a3531b98-87d9-4b49-ab1b-6bf4f9c148df tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1889210 Dec 21 04:05:00.817721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:00.871739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=b797276e-67e7-4d1b-a6ce-b9461293532b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:00.917979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-1297f223-7dc4-44ca-a3b9-b9f1c3d0d81b tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:00.925264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-1297f223-7dc4-44ca-a3b9-b9f1c3d0d81b tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/networks?id=ad9aecbc-826b-47f6-aade-ea0859ed2141 HTTP/1.1" status: 200 len: 824 time: 0.3011057 Dec 21 04:05:00.944964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:00.949130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:00.965187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-7293cef0-4c11-49f5-ad7f-78480a141d2a tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/quotas/f1fac7a4fc324e6fb3703b0fcb612ed1 HTTP/1.1" status: 200 len: 375 time: 0.0390313 Dec 21 04:05:01.028374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-896fcacc-12e4-4a19-8445-390f28591287 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f1fac7a4fc324e6fb3703b0fcb612ed1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0521770 Dec 21 04:05:01.140837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-f870960f-c148-406d-8a5c-206e66a23cf4 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9307530 Dec 21 04:05:01.152965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b61a00aa-f924-4ead-bc01-f161a615a545 None None] Provisioning complete for port b797276e-67e7-4d1b-a6ce-b9461293532b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:01.153921 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b61a00aa-f924-4ead-bc01-f161a615a545 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:01.171352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Request body: {'port': {'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:01.271068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b61a00aa-f924-4ead-bc01-f161a615a545 None None] Port b797276e-67e7-4d1b-a6ce-b9461293532b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:05:01.344089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63da0b26-d235-49cb-9998-f1a93f588cf8 req-16aa30aa-0298-4c06-9a75-4af734a93600 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:01.345684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63da0b26-d235-49cb-9998-f1a93f588cf8 req-16aa30aa-0298-4c06-9a75-4af734a93600 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 931 time: 0.1346807 Dec 21 04:05:01.377521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:01.505698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63da0b26-d235-49cb-9998-f1a93f588cf8 req-87a2948f-9686-4c5b-a7fd-eb3d86118a5d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1491957 Dec 21 04:05:01.623149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-d5519277-c0b9-4ecf-8139-483980f0188d service neutron] 10.222.0.18 "GET /v2.0/networks/ad9aecbc-826b-47f6-aade-ea0859ed2141?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5889809 Dec 21 04:05:01.857175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0575e54-63d7-46a6-8963-19b9755179af service neutron] 10.222.0.18 "GET /v2.0/networks/ad9aecbc-826b-47f6-aade-ea0859ed2141?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2107775 Dec 21 04:05:01.882860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90abccd-c391-411c-934d-a15df6d3ba21 req-80bb1b7a-94b2-409c-947a-d78b390e3b15 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:01.891359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b90abccd-c391-411c-934d-a15df6d3ba21 req-80bb1b7a-94b2-409c-947a-d78b390e3b15 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1669867 Dec 21 04:05:01.987857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b797276e-67e7-4d1b-a6ce-b9461293532b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:01.995871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b90abccd-c391-411c-934d-a15df6d3ba21 req-c8a38713-ec27-44b1-9e77-6626a035bf7c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1029754 Dec 21 04:05:02.001305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:02.041382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Transition to ACTIVE for port object b797276e-67e7-4d1b-a6ce-b9461293532b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:05:02.148516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058c6bd1-eb27-4b31-8dab-a58323619c9b req-e9b10301-72a2-4ee5-b990-929a04c2ab2e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:02.150882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-058c6bd1-eb27-4b31-8dab-a58323619c9b req-e9b10301-72a2-4ee5-b990-929a04c2ab2e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0682952 Dec 21 04:05:02.172821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:02.270240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc8b686f-0fcc-4945-8f7c-07f6f101cea5 req-3db38bc9-d654-4e6a-aa52-42f4d093d494 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 210 time: 0.0490835 Dec 21 04:05:02.279591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Pushing event updated for resources: {'Port': ['ID=b797276e-67e7-4d1b-a6ce-b9461293532b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:02.341246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-058c6bd1-eb27-4b31-8dab-a58323619c9b req-df8d13fb-def4-492f-9907-836eac82fc0f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1820142 Dec 21 04:05:02.455813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Attempting to bind port b797276e-67e7-4d1b-a6ce-b9461293532b on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:05:02.456153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Attempting to bind port b797276e-67e7-4d1b-a6ce-b9461293532b by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:05:02.456502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Attempting to bind port b797276e-67e7-4d1b-a6ce-b9461293532b on network 21c72edc-8844-45a3-93c7-94b865615264 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:02.461272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Port b797276e-67e7-4d1b-a6ce-b9461293532b on network 21c72edc-8844-45a3-93c7-94b865615264 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:05:02.461669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Attempting to bind port b797276e-67e7-4d1b-a6ce-b9461293532b on network 21c72edc-8844-45a3-93c7-94b865615264 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:02.466998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:05:02.467314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Checking segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:02.467748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Bound using segment: {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:05:02.468176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Bound port: b797276e-67e7-4d1b-a6ce-b9461293532b, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83aaa8ca-8514-4594-bc3f-241858877cc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '21c72edc-8844-45a3-93c7-94b865615264'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:05:02.468533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:02.537157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] For port b797276e-67e7-4d1b-a6ce-b9461293532b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:05:02.540481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] For port b797276e-67e7-4d1b-a6ce-b9461293532b, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b797276e-67e7-4d1b-a6ce-b9461293532b,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:05:02.639023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8879b8fc-1f84-418a-8312-d1d3dbd08b3c req-24d3a8f4-81df-4b68-8473-b542fc69b62a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:02.640663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8879b8fc-1f84-418a-8312-d1d3dbd08b3c req-24d3a8f4-81df-4b68-8473-b542fc69b62a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 943 time: 0.0562325 Dec 21 04:05:02.713046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8879b8fc-1f84-418a-8312-d1d3dbd08b3c req-234d598d-2298-4072-bf35-ee29c4aec31f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0661461 Dec 21 04:05:02.780137 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:02.837959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:02.838612 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:02.839990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] 10.222.0.31 "PUT /v2.0/ports/b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 200 len: 1092 time: 1.6742585 Dec 21 04:05:02.840446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:02.842692 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4" -d '{"events": [{"name": "network-changed", "server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:02.890710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a23cbc6-c2b0-4af9-bb9e-97fc02760808 service neutron] Pushing event updated for resources: {'Port': ['ID=b797276e-67e7-4d1b-a6ce-b9461293532b,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:02.978565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:02.985744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:02.993349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.010405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.020772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.042355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.056442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.070006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1191233d-3208-4058-a725-597bef9d7a15 req-e6e8e4b5-cd9e-46dc-9e2c-6e6f8513389b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.1661332 Dec 21 04:05:03.072721 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ebf3688-f39b-4d16-968b-74f79b6de7b5 x-openstack-request-id: req-4ebf3688-f39b-4d16-968b-74f79b6de7b5 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:03.074620 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:03.075494 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4ebf3688-f39b-4d16-968b-74f79b6de7b5 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:03.075899 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'status': 'completed', 'code': 200} Dec 21 04:05:03.298202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8ef3420a-c32f-49d5-b423-890564de9983 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.300243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-8ef3420a-c32f-49d5-b423-890564de9983 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1095 time: 0.2235723 Dec 21 04:05:03.324394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1191233d-3208-4058-a725-597bef9d7a15 req-67d316a6-2794-40a1-8f44-7fcfb45e9d5c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2498381 Dec 21 04:05:03.445481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a88c0e-baee-49bd-a974-661d55a83915 req-00dc418b-1119-44ec-96a2-b82043e51b34 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.453155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3a88c0e-baee-49bd-a974-661d55a83915 req-00dc418b-1119-44ec-96a2-b82043e51b34 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.3664632 Dec 21 04:05:03.455765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-dd9a64fa-c6e0-44f5-a1ca-11a62079b8f9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 200 len: 217 time: 0.1280510 Dec 21 04:05:03.472079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-5e126a70-2401-4db4-8daf-78c069cc8fe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.473472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-5e126a70-2401-4db4-8daf-78c069cc8fe6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1097 time: 0.2715604 Dec 21 04:05:03.544708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-97d7d672-6aa7-4c53-8e71-a365104bf3ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.546199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-97d7d672-6aa7-4c53-8e71-a365104bf3ec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16163aab-7fce-4449-a3d4-4b3d03e00005 HTTP/1.1" status: 200 len: 835 time: 0.0695932 Dec 21 04:05:03.705818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-b36bdf23-0f8a-47eb-b716-f1ab6c800634 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.707595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-b36bdf23-0f8a-47eb-b716-f1ab6c800634 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=21c72edc-8844-45a3-93c7-94b865615264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1460006 Dec 21 04:05:03.725180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca2d31d-7898-4346-802f-0f32fce9b4c3 req-e7242791-63d6-4b0a-b081-f4a839181100 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.733964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fca2d31d-7898-4346-802f-0f32fce9b4c3 req-e7242791-63d6-4b0a-b081-f4a839181100 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.2770658 Dec 21 04:05:03.776695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3a88c0e-baee-49bd-a974-661d55a83915 req-db988c36-c97b-456c-8a65-bc7becdf8532 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3195519 Dec 21 04:05:03.949859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0885898d-aa26-4b82-808e-abaebd821510 req-72e8a5df-c5c6-4917-a6c6-af930d6ba4ad tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 210 time: 0.0879159 Dec 21 04:05:03.968681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-0a2cbd97-b563-44ce-b77e-842973097bc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:03.970171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-0a2cbd97-b563-44ce-b77e-842973097bc0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 912 time: 0.4213169 Dec 21 04:05:04.047185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fca2d31d-7898-4346-802f-0f32fce9b4c3 req-59766c53-c80a-4856-92b2-05b772bba943 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3098390 Dec 21 04:05:04.526047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-6ae00b58-2ec7-4bac-902d-05d89baa8261 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7863681 Dec 21 04:05:04.545772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-6f9e956e-06ab-4e65-9131-5df617b56ff1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 200 len: 1001 time: 0.5647357 Dec 21 04:05:04.662013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0324e60-92fa-4f01-8731-3279385fa101 req-0121bfc4-fd6f-43cd-ad85-3d0b9bedded0 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.667707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0324e60-92fa-4f01-8731-3279385fa101 req-0121bfc4-fd6f-43cd-ad85-3d0b9bedded0 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 943 time: 0.2027278 Dec 21 04:05:04.689918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.698315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.705106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.711192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.717302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.725767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.732318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.734282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee39d82c-69e2-4e15-a084-a9d13cf2a2ee req-198aa5e0-56ac-4d0a-8c76-cd6298973b94 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.7030900 Dec 21 04:05:04.767092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-de8a6c95-8738-4ff3-80c9-5f6055b22cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.768641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-de8a6c95-8738-4ff3-80c9-5f6055b22cd6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.2091308 Dec 21 04:05:04.912372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ef03461-0dc0-41c0-89f0-b4fdddbe871a req-9addcab6-d75b-4e1c-a94c-d298ca23680a service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3697543 Dec 21 04:05:04.967891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0324e60-92fa-4f01-8731-3279385fa101 req-005c6c7c-9a69-4186-b155-7e303066f222 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2901821 Dec 21 04:05:04.970001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-354dd72d-4e54-4718-902e-1256805f057b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:04.978895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-354dd72d-4e54-4718-902e-1256805f057b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1876583 Dec 21 04:05:05.074283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201b4f11-7d31-4525-8e0f-a0f9e776b2c7 req-46d281f3-1247-4729-b08f-e9ac32e31066 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.075913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-201b4f11-7d31-4525-8e0f-a0f9e776b2c7 req-46d281f3-1247-4729-b08f-e9ac32e31066 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1941895 Dec 21 04:05:05.210989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b0e336f-e509-4398-8099-ba29ff858ff5 req-3df7ac51-66a3-4413-950d-ee74d58e35ed tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 210 time: 0.1339564 Dec 21 04:05:05.313225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-201b4f11-7d31-4525-8e0f-a0f9e776b2c7 req-78609dfd-2392-4c97-b9b8-66acde6d1a93 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1989591 Dec 21 04:05:05.315122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-1ce70689-5888-4ee1-93a7-cef0821a4e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.317002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-1ce70689-5888-4ee1-93a7-cef0821a4e7f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1095 time: 0.2262115 Dec 21 04:05:05.318804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-872bd9a2-1b39-4dba-8bf2-6e82fead9f28 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3272943 Dec 21 04:05:05.588589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba93b77-072d-4b88-89a2-abd0abfc989c req-ed0e30ae-17c2-4733-90ae-4bc5335ec23e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.590068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eba93b77-072d-4b88-89a2-abd0abfc989c req-ed0e30ae-17c2-4733-90ae-4bc5335ec23e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.2989230 Dec 21 04:05:05.642596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-fdd294a5-68b4-4c6d-905d-ac9e3808f102 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.644118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-fdd294a5-68b4-4c6d-905d-ac9e3808f102 service neutron] 10.222.0.31 "GET /v2.0/networks?id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 897 time: 0.3039570 Dec 21 04:05:05.694047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-2028384b-2dc3-4deb-a5d8-530c41902d16 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.695505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-2028384b-2dc3-4deb-a5d8-530c41902d16 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.54 "GET /v2.0/networks?id=ad9aecbc-826b-47f6-aade-ea0859ed2141 HTTP/1.1" status: 200 len: 824 time: 0.3541481 Dec 21 04:05:05.740094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Request body: {'port': {'device_id': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141', 'admin_state_up': True, 'tenant_id': 'f1fac7a4fc324e6fb3703b0fcb612ed1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:05.749351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-972bbef4-5cdf-47ce-9d49-4eded21b8533 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 200 len: 217 time: 0.0906219 Dec 21 04:05:05.761578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fd3800c-893c-4846-8bbf-21989acd9c57 req-6877f426-a34c-4de9-b7fc-97dc062acf33 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4300163 Dec 21 04:05:05.818242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eba93b77-072d-4b88-89a2-abd0abfc989c req-2af4a4a3-9346-4abe-9ca4-75c60580a60d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1701269 Dec 21 04:05:05.920726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-1bf48103-1dc0-4e9c-86bd-a855f0c38245 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.922210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-1bf48103-1dc0-4e9c-86bd-a855f0c38245 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16163aab-7fce-4449-a3d4-4b3d03e00005 HTTP/1.1" status: 200 len: 835 time: 0.1538188 Dec 21 04:05:05.996740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-85d599d6-4ea7-446a-ae6c-23f8ac892715 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:05.998338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-85d599d6-4ea7-446a-ae6c-23f8ac892715 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=21c72edc-8844-45a3-93c7-94b865615264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0650325 Dec 21 04:05:06.092365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Made reservation on behalf of f1fac7a4fc324e6fb3703b0fcb612ed1 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:06.096110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:06.182876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36970e1-9929-453e-930e-1a17e815b48b req-ec73c1dd-5cdc-4b80-b85b-15cb69623d29 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:06.184632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e36970e1-9929-453e-930e-1a17e815b48b req-ec73c1dd-5cdc-4b80-b85b-15cb69623d29 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 943 time: 0.1124442 Dec 21 04:05:06.220029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-715322d7-d12b-495c-92fe-d023e90f8789 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2089520 Dec 21 04:05:06.401556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-03361876-b2de-46d4-bb15-d19f9cafdedb req-50fb8922-a72f-469b-94e3-f920417989f5 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 210 time: 0.0540037 Dec 21 04:05:06.437884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e36970e1-9929-453e-930e-1a17e815b48b req-71d3ed86-f637-442b-a7dd-0988f47f3fc9 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2232690 Dec 21 04:05:06.479301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Allocated IP 172.20.0.8 (ad9aecbc-826b-47f6-aade-ea0859ed2141/4e533b27-3e12-489d-b723-8d8a798bf017/7dafe965-8e09-4d5a-9d86-14e23d12340c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:06.512858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23126fb6-e5e6-44c8-a1ce-da7c841e92b4 req-946ecf81-99d1-432f-a2d8-8412de43bd97 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2706931 Dec 21 04:05:06.718213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aae50e8-1752-41bc-ba13-7a60649602d8 req-aa8fdfb8-18ec-4bc5-a9b6-f5a049338bf8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:06.719863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aae50e8-1752-41bc-ba13-7a60649602d8 req-aa8fdfb8-18ec-4bc5-a9b6-f5a049338bf8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1555107 Dec 21 04:05:06.766223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:06.819418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aae50e8-1752-41bc-ba13-7a60649602d8 req-03675e3f-9759-4fe6-b99b-504a6ee2d0d2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858095 Dec 21 04:05:06.959752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47042) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:06.963976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d4212d-3a20-4fac-bc49-9667e1f8b33d req-a2426157-238f-4ae6-9d57-594c66349a89 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:06.965617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8d4212d-3a20-4fac-bc49-9667e1f8b33d req-a2426157-238f-4ae6-9d57-594c66349a89 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.0796664 Dec 21 04:05:07.038368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8d4212d-3a20-4fac-bc49-9667e1f8b33d req-4b41aaf4-d35c-4821-9cc0-80350ef37aa0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657523 Dec 21 04:05:07.069386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:07.096930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.097421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.097896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.098365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.098830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.099336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.099801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.102328 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c35169c4-a383-4acf-8288-795d4e55d242 req-8d6c308b-5ed5-4fa1-9f01-fcb9cb0f9e56 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.1394665 Dec 21 04:05:07.117469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Network ad9aecbc-826b-47f6-aade-ea0859ed2141 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:07.120558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:07.127146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:07.152666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Pushing event updated for resources: {'Port': ['ID=7dafe965-8e09-4d5a-9d86-14e23d12340c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:07.175796 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c35169c4-a383-4acf-8288-795d4e55d242 req-b49fe9fc-2485-4b73-adf2-f5efb874f977 service neutron] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&id=ccd453dc-aa16-4aa6-836a-b6ef27489378&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0653439 Dec 21 04:05:07.183860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.184229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.184746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.185007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.185412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.185815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.186221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.186640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.187208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.187555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.187943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.188225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.188557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.210284 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.213263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:07.308485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-3a868937-c567-46cb-b065-5a581d8b7ce4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5721362 Dec 21 04:05:07.330619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Request body: {'port': {'device_id': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:07.391084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:07.421582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b797276e-67e7-4d1b-a6ce-b9461293532b details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:05:07.552199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b797276e-67e7-4d1b-a6ce-b9461293532b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b797276e-67e7-4d1b-a6ce-b9461293532b,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:07.568388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:05:07.630745 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:07.653226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b797276e-67e7-4d1b-a6ce-b9461293532b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:07.677664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b797276e-67e7-4d1b-a6ce-b9461293532b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b797276e-67e7-4d1b-a6ce-b9461293532b,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:07.800500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6303bd6-39d9-4424-9f93-cb88ceffca89 req-fc809dd7-b3db-4dd9-a3d7-80145ec18536 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.802825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:07.803106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6303bd6-39d9-4424-9f93-cb88ceffca89 req-fc809dd7-b3db-4dd9-a3d7-80145ec18536 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 931 time: 0.1401129 Dec 21 04:05:07.828867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7810e6-eaa7-4e76-871a-25c74c07f092 req-76203441-c126-4ea9-b850-9a9575585b02 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:07.830407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db7810e6-eaa7-4e76-871a-25c74c07f092 req-76203441-c126-4ea9-b850-9a9575585b02 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 943 time: 0.1659391 Dec 21 04:05:07.852982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b797276e-67e7-4d1b-a6ce-b9461293532b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:07.933409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6303bd6-39d9-4424-9f93-cb88ceffca89 req-b36bd7ba-82ca-4053-b2df-318501543e3c tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1231618 Dec 21 04:05:07.942991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db7810e6-eaa7-4e76-871a-25c74c07f092 req-c1d45917-9b12-4001-bdec-dce43bbacdce tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0993738 Dec 21 04:05:07.984362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7dafe965-8e09-4d5a-9d86-14e23d12340c {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:07.992390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:08.006205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Transition to ACTIVE for port object 7dafe965-8e09-4d5a-9d86-14e23d12340c will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:05:08.081772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbafe943-a8a1-4c85-a63a-57659132ba1d req-18d4c6e9-cfac-44eb-ad89-58de39048a6f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:08.083335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbafe943-a8a1-4c85-a63a-57659132ba1d req-18d4c6e9-cfac-44eb-ad89-58de39048a6f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0571382 Dec 21 04:05:08.107057 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:08.131700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b797276e-67e7-4d1b-a6ce-b9461293532b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:08.255860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbafe943-a8a1-4c85-a63a-57659132ba1d req-8a54780c-0d88-4a44-a0ef-e769e8bf28ab tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1646371 Dec 21 04:05:08.256480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Pushing event updated for resources: {'Port': ['ID=7dafe965-8e09-4d5a-9d86-14e23d12340c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:08.320009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc5938c-7a25-4649-be21-477115fb3863 req-050f04f8-ede0-4e9c-846d-9dfa578ac466 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:08.322245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcc5938c-7a25-4649-be21-477115fb3863 req-050f04f8-ede0-4e9c-846d-9dfa578ac466 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1932702 Dec 21 04:05:08.384484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Attempting to bind port 7dafe965-8e09-4d5a-9d86-14e23d12340c on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:05:08.385424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Attempting to bind port 7dafe965-8e09-4d5a-9d86-14e23d12340c by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:05:08.385826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Attempting to bind port 7dafe965-8e09-4d5a-9d86-14e23d12340c on network ad9aecbc-826b-47f6-aade-ea0859ed2141 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:08.392335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Port 7dafe965-8e09-4d5a-9d86-14e23d12340c on network ad9aecbc-826b-47f6-aade-ea0859ed2141 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:05:08.392658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Attempting to bind port 7dafe965-8e09-4d5a-9d86-14e23d12340c on network ad9aecbc-826b-47f6-aade-ea0859ed2141 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:08.406199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:05:08.406567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Checking segment: {'id': 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:08.407012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Bound using segment: {'id': 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:05:08.407447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Bound port: 7dafe965-8e09-4d5a-9d86-14e23d12340c, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:05:08.407983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:08.436757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcc5938c-7a25-4649-be21-477115fb3863 req-f31cb692-d65d-41c2-bea8-0056466e5201 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041880 Dec 21 04:05:08.486539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] For port 7dafe965-8e09-4d5a-9d86-14e23d12340c, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:05:08.489487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] For port 7dafe965-8e09-4d5a-9d86-14e23d12340c, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7dafe965-8e09-4d5a-9d86-14e23d12340c,segment=NetworkSegment(aebf5ea6-eb2c-4e32-abdc-14ec77f8651f),segment_id=aebf5ea6-eb2c-4e32-abdc-14ec77f8651f)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:05:08.585711 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:08.647640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:08.648356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:08.650383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] 10.222.0.54 "PUT /v2.0/ports/7dafe965-8e09-4d5a-9d86-14e23d12340c HTTP/1.1" status: 200 len: 1092 time: 1.3248239 Dec 21 04:05:08.653343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'tag': '7dafe965-8e09-4d5a-9d86-14e23d12340c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:08.656812 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a" -d '{"events": [{"name": "network-changed", "server_uuid": "2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4", "tag": "7dafe965-8e09-4d5a-9d86-14e23d12340c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:08.676296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f61553-19ad-4efe-a12b-6a0546264f04 service neutron] Pushing event updated for resources: {'Port': ['ID=7dafe965-8e09-4d5a-9d86-14e23d12340c,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:08.702181 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cc3ed5f-4a4e-492e-9ae2-905be33e34fd x-openstack-request-id: req-3cc3ed5f-4a4e-492e-9ae2-905be33e34fd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:08.702483 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4", "tag": "7dafe965-8e09-4d5a-9d86-14e23d12340c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:08.702747 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3cc3ed5f-4a4e-492e-9ae2-905be33e34fd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:08.703317 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'tag': '7dafe965-8e09-4d5a-9d86-14e23d12340c', 'status': 'completed', 'code': 200} Dec 21 04:05:08.787462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a req-ba2cce53-797c-42a1-8035-b6f15e439d77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:08.788891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a req-ba2cce53-797c-42a1-8035-b6f15e439d77 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f1fac7a4fc324e6fb3703b0fcb612ed1&device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 1095 time: 0.0425436 Dec 21 04:05:08.896745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a req-61a38592-858b-45fe-a7f5-3e07b0bfd5b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:08.898291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a req-61a38592-858b-45fe-a7f5-3e07b0bfd5b8 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=f1fac7a4fc324e6fb3703b0fcb612ed1&shared=False HTTP/1.1" status: 200 len: 925 time: 0.0954263 Dec 21 04:05:09.028691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a req-b8bad89b-491f-4e7e-aacd-019a4e5f7986 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.030571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8a5cce6-ed7e-4f52-9656-b12c65994f5a req-b8bad89b-491f-4e7e-aacd-019a4e5f7986 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1217937 Dec 21 04:05:09.176877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0ff04-270d-4943-9afc-34c5fb8fac66 req-68fa2ba8-1577-4286-a1ab-1f5890e1c895 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.176877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95a0ff04-270d-4943-9afc-34c5fb8fac66 req-68fa2ba8-1577-4286-a1ab-1f5890e1c895 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 943 time: 0.1259940 Dec 21 04:05:09.176877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35cde787-11de-4457-aae3-ffc386fb8972 req-3a317c62-b144-4c72-be09-abfb1b2e0ab3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.177231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-41673fed-2105-4ddd-a860-384db2b43cf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.177684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35cde787-11de-4457-aae3-ffc386fb8972 req-3a317c62-b144-4c72-be09-abfb1b2e0ab3 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 944 time: 0.1094236 Dec 21 04:05:09.177782 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-41673fed-2105-4ddd-a860-384db2b43cf1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f1fac7a4fc324e6fb3703b0fcb612ed1&device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 1095 time: 0.0647972 Dec 21 04:05:09.177881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-c631a499-06a5-4c54-9327-742c244c20d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.177881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-c631a499-06a5-4c54-9327-742c244c20d9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 1098 time: 0.1105604 Dec 21 04:05:09.251244 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-5438d14e-bb83-41f3-b47b-d4a0a0322489 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7dafe965-8e09-4d5a-9d86-14e23d12340c HTTP/1.1" status: 200 len: 217 time: 0.0604792 Dec 21 04:05:09.310020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-0240282a-e6dd-418a-a068-71bf5232a90f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.311658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-0240282a-e6dd-418a-a068-71bf5232a90f service neutron] 10.222.0.54 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.1201000 Dec 21 04:05:09.314970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-d7480862-7d9d-4719-8c2a-b222dce06a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.316451 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-d7480862-7d9d-4719-8c2a-b222dce06a7e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4e533b27-3e12-489d-b723-8d8a798bf017 HTTP/1.1" status: 200 len: 864 time: 0.0573730 Dec 21 04:05:09.372909 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-8d6d3022-a42f-46fa-b05d-229d90d4df43 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ad9aecbc-826b-47f6-aade-ea0859ed2141&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0452671 Dec 21 04:05:09.386347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-6aeb91ae-5dc4-4e98-9d32-50b296cd86fe service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9af4ef3c-d48b-437e-8852-f063d225dc37 HTTP/1.1" status: 200 len: 217 time: 0.0566249 Dec 21 04:05:09.393549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-35cde787-11de-4457-aae3-ffc386fb8972 req-4410cf91-72ac-4c65-b828-bb00447d241e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2179987 Dec 21 04:05:09.423186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b797276e-67e7-4d1b-a6ce-b9461293532b up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:05:09.458472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95a0ff04-270d-4943-9afc-34c5fb8fac66 req-3710dda9-2d59-4a0d-8f19-c2deedfb0f1f tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2828066 Dec 21 04:05:09.465562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-c8f34b92-2d6b-4922-84e6-57368f1ecf57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.465562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-c8f34b92-2d6b-4922-84e6-57368f1ecf57 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0671847 Dec 21 04:05:09.499641 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-ec923bad-6453-40ca-8845-8b55da791d4f service neutron] 10.222.0.54 "GET /v2.0/networks/ad9aecbc-826b-47f6-aade-ea0859ed2141?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1188354 Dec 21 04:05:09.552195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-4df42abf-820c-4453-9777-f1b9a3da5ada service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.553653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port b797276e-67e7-4d1b-a6ce-b9461293532b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:05:09.554139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-4df42abf-820c-4453-9777-f1b9a3da5ada service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0792754 Dec 21 04:05:09.558337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b797276e-67e7-4d1b-a6ce-b9461293532b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:09.558848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:09.602222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c56e7ffd-d7ba-4e88-a2cc-8dfa0b0d0a14 req-1122d3f0-3e26-48e5-9e86-ead33ecf9f72 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:09.603609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c56e7ffd-d7ba-4e88-a2cc-8dfa0b0d0a14 req-1122d3f0-3e26-48e5-9e86-ead33ecf9f72 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.0872469 Dec 21 04:05:09.641425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b40955e-6995-4da6-82b2-a22cf8442bd5 req-74d2bc34-1ec8-4100-8be4-a91ba6ceef9e service neutron] 10.222.0.54 "GET /v2.0/networks/ad9aecbc-826b-47f6-aade-ea0859ed2141?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1339829 Dec 21 04:05:09.683692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:09.707970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:09.710225 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-61a0f667-7f4a-4cfe-8144-8a69a4e0dac2" -d '{"events": [{"server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "name": "network-vif-plugged", "status": "completed", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:09.725067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b797276e-67e7-4d1b-a6ce-b9461293532b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b797276e-67e7-4d1b-a6ce-b9461293532b,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:09.757355 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73b9f5a3-dbef-4ec9-9841-5ddb4d8c7e80 x-openstack-request-id: req-73b9f5a3-dbef-4ec9-9841-5ddb4d8c7e80 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:09.757720 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "name": "network-vif-plugged", "status": "completed", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:09.758154 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-73b9f5a3-dbef-4ec9-9841-5ddb4d8c7e80 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:09.759228 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'code': 200} Dec 21 04:05:09.797856 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:09.877505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b797276e-67e7-4d1b-a6ce-b9461293532b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:10.092367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c56e7ffd-d7ba-4e88-a2cc-8dfa0b0d0a14 req-c92dc3cf-c135-4a57-a143-18486418de7a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4555242 Dec 21 04:05:10.112269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-09947c08-4451-49c9-82a7-c60bd14ddf46 service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5481720 Dec 21 04:05:10.189847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6e66fa-98f7-42f1-9157-8a03a050b75e req-de50bb5c-05c8-4965-b4b7-301ddd5e019e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:10.191327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca6e66fa-98f7-42f1-9157-8a03a050b75e req-de50bb5c-05c8-4965-b4b7-301ddd5e019e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1097 time: 0.1122248 Dec 21 04:05:10.248001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8232d09-a530-4119-94d9-826b0db3dc93 req-67b13505-ac39-4674-9437-2e8a0523e6fa service neutron] 10.222.0.54 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1282053 Dec 21 04:05:10.261218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca6e66fa-98f7-42f1-9157-8a03a050b75e req-be552b0b-4329-41e7-afbc-c8aeff955a6f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0612843 Dec 21 04:05:10.521199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ce103b-c62a-4dfd-a075-14d15468c7f7 req-10828776-0532-4fed-829f-243599dd0706 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:10.522827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11ce103b-c62a-4dfd-a075-14d15468c7f7 req-10828776-0532-4fed-829f-243599dd0706 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 945 time: 0.0544729 Dec 21 04:05:10.609958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11ce103b-c62a-4dfd-a075-14d15468c7f7 req-f1b27437-ecaa-417e-b3b4-190039308e4f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754964 Dec 21 04:05:10.618220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6442a331-c400-46d8-8e2f-52b6684f9cb2 req-92e598e6-f259-4d9c-870b-83bb55592f14 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:10.619743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6442a331-c400-46d8-8e2f-52b6684f9cb2 req-92e598e6-f259-4d9c-870b-83bb55592f14 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 943 time: 0.0958951 Dec 21 04:05:10.676390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6442a331-c400-46d8-8e2f-52b6684f9cb2 req-568ed66f-21ac-4ed5-95b9-e1f8f87ce70d tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501239 Dec 21 04:05:11.217413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c501ebb1-6fa9-4bd2-beef-52a0287abe60 req-e56cb3a3-4bce-4b8e-b0ad-3c22a013138a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:11.218925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c501ebb1-6fa9-4bd2-beef-52a0287abe60 req-e56cb3a3-4bce-4b8e-b0ad-3c22a013138a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.0497184 Dec 21 04:05:11.267244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c501ebb1-6fa9-4bd2-beef-52a0287abe60 req-84285a5a-dd07-48ca-8514-9fce9d680482 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420933 Dec 21 04:05:11.748093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95dc0629-bc9f-4922-b8bb-b5f4db76488a req-9e5909a9-ae61-4427-af00-8deec8c98ebc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:11.756764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95dc0629-bc9f-4922-b8bb-b5f4db76488a req-9e5909a9-ae61-4427-af00-8deec8c98ebc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 945 time: 0.0619292 Dec 21 04:05:11.840797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8c584b-3109-4cb7-9555-6f8b233538a3 req-5591a4e5-b1de-490b-b5bd-671fcfd59d33 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:11.842281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e8c584b-3109-4cb7-9555-6f8b233538a3 req-5591a4e5-b1de-490b-b5bd-671fcfd59d33 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 943 time: 0.0835044 Dec 21 04:05:11.846109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95dc0629-bc9f-4922-b8bb-b5f4db76488a req-88813af9-0c80-4697-9791-ffc3543027f9 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0885627 Dec 21 04:05:11.894135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e8c584b-3109-4cb7-9555-6f8b233538a3 req-46894069-a716-4164-b219-bfdf684658b5 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444870 Dec 21 04:05:11.974208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9057f04f-b350-418b-9b8f-ba5a7b422285 req-57a52a50-1bd3-4aad-99d2-9805cafd28bb tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:11.975726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9057f04f-b350-418b-9b8f-ba5a7b422285 req-57a52a50-1bd3-4aad-99d2-9805cafd28bb tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 945 time: 0.0511045 Dec 21 04:05:12.025912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9057f04f-b350-418b-9b8f-ba5a7b422285 req-6ce1bbb7-0204-42ac-864a-a5e1fadcf528 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436914 Dec 21 04:05:12.048573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47308) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:12.099444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5f5d71e-ed85-4cbf-8d35-625af97ce1a4 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:12.100989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a5f5d71e-ed85-4cbf-8d35-625af97ce1a4 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1092 time: 0.0514474 Dec 21 04:05:12.104511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47314) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:12.108732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address': '172.20.0.6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:12.199716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:12.307786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:12.473320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d8d850b-cf6b-43a2-99ec-9a81c2d491d4 req-3cb05e5f-5b12-4be4-a564-e9504c7517b3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:12.474897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d8d850b-cf6b-43a2-99ec-9a81c2d491d4 req-3cb05e5f-5b12-4be4-a564-e9504c7517b3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 946 time: 0.1064720 Dec 21 04:05:12.504121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.25.5.84 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/5404e845-d0b3-44bd-b399-10c70e090367) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:12.567220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d8d850b-cf6b-43a2-99ec-9a81c2d491d4 req-534d59c6-ed08-4b93-b40e-0930ebe45eed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826859 Dec 21 04:05:12.656015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:12.791303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:12.832920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:12.836669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:12.839530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:12.869271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=5404e845-d0b3-44bd-b399-10c70e090367,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:13.027014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47364) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:13.112079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fdcfb2-6f80-48c6-81ae-26a757bb1f2b req-25e7207e-f6a0-4560-95cd-a65b851cebf1 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:13.113612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58fdcfb2-6f80-48c6-81ae-26a757bb1f2b req-25e7207e-f6a0-4560-95cd-a65b851cebf1 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 943 time: 0.1257274 Dec 21 04:05:13.144009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7dafe965-8e09-4d5a-9d86-14e23d12340c details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:05:13.145700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.154672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9af4ef3c-d48b-437e-8852-f063d225dc37 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:13.219968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58fdcfb2-6f80-48c6-81ae-26a757bb1f2b req-d2c4b45f-d423-42ef-bead-6cd9d94e2c90 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968502 Dec 21 04:05:13.248602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.315566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.316689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7dafe965-8e09-4d5a-9d86-14e23d12340c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7dafe965-8e09-4d5a-9d86-14e23d12340c,segment=NetworkSegment(aebf5ea6-eb2c-4e32-abdc-14ec77f8651f),segment_id=aebf5ea6-eb2c-4e32-abdc-14ec77f8651f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:13.319601 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.339366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '7dafe965-8e09-4d5a-9d86-14e23d12340c', 'network_id': 'ad9aecbc-826b-47f6-aade-ea0859ed2141', 'port_id': '7dafe965-8e09-4d5a-9d86-14e23d12340c', 'mac_address': 'fa:16:3e:c4:18:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4e533b27-3e12-489d-b723-8d8a798bf017', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:05:13.339837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.356398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:13.361095 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06682ae3-e256-4ff5-ac2a-7ab74c12106a" -d '{"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-unplugged", "status": "completed", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:13.376136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=046c2bde9cee448cbaa907982312d0f2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3478699 Dec 21 04:05:13.377056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2565d4b-a5b1-4e4b-967c-7f6b9f16ef3f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:13.381603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47384) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:13.398868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.403560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.404345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.404345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.404345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.404669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cda9500e-56fd-49c7-9953-aeb645648f40 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:13.416974 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7803fd6-d6ee-4413-be4c-4290d818143e x-openstack-request-id: req-f7803fd6-d6ee-4413-be4c-4290d818143e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:13.417694 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-unplugged", "status": "failed", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37", "code": 422}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:13.417694 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f7803fd6-d6ee-4413-be4c-4290d818143e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:13.417901 n-d-822053-11 neutron-server[110312]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'code': 422} returned with failed status Dec 21 04:05:13.422067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.438815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7dafe965-8e09-4d5a-9d86-14e23d12340c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:13.444967 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-910f4418-437c-474e-b350-5c9d1d1159d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.458276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7dafe965-8e09-4d5a-9d86-14e23d12340c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7dafe965-8e09-4d5a-9d86-14e23d12340c,segment=NetworkSegment(aebf5ea6-eb2c-4e32-abdc-14ec77f8651f),segment_id=aebf5ea6-eb2c-4e32-abdc-14ec77f8651f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:13.483522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-910f4418-437c-474e-b350-5c9d1d1159d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.496036 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.498616 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.527881 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.556017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:13.620889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7dafe965-8e09-4d5a-9d86-14e23d12340c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:13.641829 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-910f4418-437c-474e-b350-5c9d1d1159d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.644623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-910f4418-437c-474e-b350-5c9d1d1159d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.645903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-910f4418-437c-474e-b350-5c9d1d1159d6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e2565d4b-a5b1-4e4b-967c-7f6b9f16ef3f HTTP/1.1" status: 204 len: 168 time: 0.2632854 Dec 21 04:05:13.682063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-910f4418-437c-474e-b350-5c9d1d1159d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2565d4b-a5b1-4e4b-967c-7f6b9f16ef3f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:13.726011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.746341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5555c78-cb7b-485a-93ad-35a631fca1d3 req-c1236be2-5c83-4e48-9aad-5e5fa064a942 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:13.751813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5555c78-cb7b-485a-93ad-35a631fca1d3 req-c1236be2-5c83-4e48-9aad-5e5fa064a942 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.0934291 Dec 21 04:05:13.801205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5555c78-cb7b-485a-93ad-35a631fca1d3 req-623f1c93-b83a-4826-b0d6-5d69f72e04a6 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453451 Dec 21 04:05:13.802705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.885398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=5404e845-d0b3-44bd-b399-10c70e090367,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:13.901406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7dafe965-8e09-4d5a-9d86-14e23d12340c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:13.902189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:13.985016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09472c3-ab04-411f-8dce-d54b2ece2bf9 req-15196622-9334-45d6-9d18-65246119e239 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:13.986606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d09472c3-ab04-411f-8dce-d54b2ece2bf9 req-15196622-9334-45d6-9d18-65246119e239 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1029053 Dec 21 04:05:14.067355 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Floating IP a2d88347-0fc8-4148-a28b-cbb31674935d associated. External IP: 172.25.5.84, port: b797276e-67e7-4d1b-a6ce-b9461293532b. Dec 21 04:05:14.072923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d09472c3-ab04-411f-8dce-d54b2ece2bf9 req-1a9d3c9e-e793-43ec-870d-66497f56972f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0601873 Dec 21 04:05:14.266299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ace1c5e-a193-43a2-a892-11f50bee7897 req-f525421d-cf4a-41a4-84a9-38ecb95b9690 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:14.266843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ace1c5e-a193-43a2-a892-11f50bee7897 req-f525421d-cf4a-41a4-84a9-38ecb95b9690 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0944982 Dec 21 04:05:14.389319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ace1c5e-a193-43a2-a892-11f50bee7897 req-d7f81341-9315-4620-bd0f-749a440eb94e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1143155 Dec 21 04:05:14.409172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:05:14.434611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870b0873-85bb-41fb-bf15-5b01364f86fe req-5cdfdaa2-01e5-4fb5-a78a-9778d9e1306c tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:14.443444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-870b0873-85bb-41fb-bf15-5b01364f86fe req-5cdfdaa2-01e5-4fb5-a78a-9778d9e1306c tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 944 time: 0.1106696 Dec 21 04:05:14.530235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-870b0873-85bb-41fb-bf15-5b01364f86fe req-dd7107f8-4614-4f77-9f48-ce851339bd29 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0857415 Dec 21 04:05:14.583635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:05:14.595535 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:05:14.613769 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:05:14.614462 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:14.669786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:14.712972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d148d52e-f2af-47f0-b3c8-cfe1ec9f0b4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.6073966 Dec 21 04:05:14.714058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:14.715799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47452) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:14.716447 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4828e1ca-9536-4376-8aef-5a31e562ca28" -d '{"events": [{"name": "network-changed", "server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:14.762141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:05:14.780473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b795fe79-197a-4188-b0a1-0f6d3745ac7f req-204df753-529b-4b4e-a8a2-7919eb37e7d4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:14.782018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b795fe79-197a-4188-b0a1-0f6d3745ac7f req-204df753-529b-4b4e-a8a2-7919eb37e7d4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0595922 Dec 21 04:05:14.791831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ad8367f-30d7-4375-abc9-6160064c7bf9 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/a2d88347-0fc8-4148-a28b-cbb31674935d HTTP/1.1" status: 200 len: 990 time: 0.0745840 Dec 21 04:05:14.842407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b795fe79-197a-4188-b0a1-0f6d3745ac7f req-557afc2c-ba5d-4efe-a236-50cb7bb58bec tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506289 Dec 21 04:05:14.900253 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59edb849-ec93-4df3-8a0f-242d699b380e x-openstack-request-id: req-59edb849-ec93-4df3-8a0f-242d699b380e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:14.900489 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:14.900746 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-59edb849-ec93-4df3-8a0f-242d699b380e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:14.901153 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'status': 'completed', 'code': 200} Dec 21 04:05:14.999287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-72426df6-02ad-403e-a382-d65481b66a0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.001239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-72426df6-02ad-403e-a382-d65481b66a0c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1097 time: 0.0450857 Dec 21 04:05:15.036002 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:13Z', 'revision_number': 0, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:15.070439 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:05:15.081875 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:05:15.082522 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:04:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:15.118521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-bf2a56f3-7c5c-4af5-852c-e09d68e84e1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.120032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-bf2a56f3-7c5c-4af5-852c-e09d68e84e1b service neutron] 10.222.0.31 "GET /v2.0/networks?id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 897 time: 0.1046550 Dec 21 04:05:15.164200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7dafe965-8e09-4d5a-9d86-14e23d12340c up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:05:15.191171 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:05:15.206257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-4dc976ee-fe73-430d-8e08-cba0595953f6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 200 len: 998 time: 0.0784621 Dec 21 04:05:15.255916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-9a9c0d96-a118-4e2f-8c70-ee78405af3e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.257425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-9a9c0d96-a118-4e2f-8c70-ee78405af3e7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16163aab-7fce-4449-a3d4-4b3d03e00005 HTTP/1.1" status: 200 len: 835 time: 0.0443168 Dec 21 04:05:15.310505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-a518a231-0944-49f9-9a1c-a8101b8c8c7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.312146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-a518a231-0944-49f9-9a1c-a8101b8c8c7b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=21c72edc-8844-45a3-93c7-94b865615264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0410743 Dec 21 04:05:15.313997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 7dafe965-8e09-4d5a-9d86-14e23d12340c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:05:15.318472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 7dafe965-8e09-4d5a-9d86-14e23d12340c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:15.321768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:15.420355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-3b4ddbe5-790f-4ece-8a5d-4751d890f976 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0971737 Dec 21 04:05:15.423664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:15.436516 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:13Z', 'revision_number': 0, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:15.448033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7dafe965-8e09-4d5a-9d86-14e23d12340c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:15.450266 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29445120-1223-4be2-9d6c-921b54bd38c2" -d '{"events": [{"server_uuid": "2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4", "name": "network-vif-plugged", "status": "completed", "tag": "7dafe965-8e09-4d5a-9d86-14e23d12340c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:15.464848 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a30cf8de-b2fe-4531-8f6e-2d3e1f2415bf None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:04:45Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:13Z', 'revision_number': 0, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:05:15.465247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7dafe965-8e09-4d5a-9d86-14e23d12340c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7dafe965-8e09-4d5a-9d86-14e23d12340c,segment=NetworkSegment(aebf5ea6-eb2c-4e32-abdc-14ec77f8651f),segment_id=aebf5ea6-eb2c-4e32-abdc-14ec77f8651f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:15.505228 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94f28132-7b6c-4863-8504-0842571d72d5 x-openstack-request-id: req-94f28132-7b6c-4863-8504-0842571d72d5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:15.505726 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4", "name": "network-vif-plugged", "status": "completed", "tag": "7dafe965-8e09-4d5a-9d86-14e23d12340c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:15.506032 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-94f28132-7b6c-4863-8504-0842571d72d5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:15.507649 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7dafe965-8e09-4d5a-9d86-14e23d12340c', 'code': 200} Dec 21 04:05:15.527566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4828e1ca-9536-4376-8aef-5a31e562ca28 req-705c0218-804a-4581-b600-41356f53c2a6 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0982189 Dec 21 04:05:15.548074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:15.548915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9af4ef3c-d48b-437e-8852-f063d225dc37 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:15.657649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7dafe965-8e09-4d5a-9d86-14e23d12340c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:15.697492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d108abbc-97e8-4c55-bfc2-1ed444adf0bf req-349efed3-cee0-442b-b0ee-61864d7c1faf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.711006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d108abbc-97e8-4c55-bfc2-1ed444adf0bf req-349efed3-cee0-442b-b0ee-61864d7c1faf service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 1097 time: 0.0633037 Dec 21 04:05:15.786555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1faa3d84-0336-4137-856a-6fecbe900093 req-fb57cf9f-fbe8-43df-b1fa-aa1f3fd79ba4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.788249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1faa3d84-0336-4137-856a-6fecbe900093 req-fb57cf9f-fbe8-43df-b1fa-aa1f3fd79ba4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0819027 Dec 21 04:05:15.795515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47470) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:15.800247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d108abbc-97e8-4c55-bfc2-1ed444adf0bf req-38551489-0884-4859-89e8-21f925c69945 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845447 Dec 21 04:05:15.835707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f13bf765-accf-48b3-8cef-09d449574d36 None None] New status for floating IP a2d88347-0fc8-4148-a28b-cbb31674935d: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:05:15.856930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1faa3d84-0336-4137-856a-6fecbe900093 req-b187b40d-8083-417b-9ccd-2ab587395779 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556047 Dec 21 04:05:15.865647 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-83cd40fa-0fff-4258-9f6e-6077cd2188d2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/a2d88347-0fc8-4148-a28b-cbb31674935d HTTP/1.1" status: 200 len: 990 time: 0.0679839 Dec 21 04:05:15.984542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45489afb-d89b-4528-9368-ef04913a2884 req-4254fe8d-cc31-4ece-a0da-7aafa85809f4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:15.986351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45489afb-d89b-4528-9368-ef04913a2884 req-4254fe8d-cc31-4ece-a0da-7aafa85809f4 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0640650 Dec 21 04:05:16.042627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45489afb-d89b-4528-9368-ef04913a2884 req-83cc6eb8-f1d1-46f3-8de2-eac752a8584b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0498197 Dec 21 04:05:16.867824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:16.957760 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e79d8325-5c77-494b-9363-e681a3151dda tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/a2d88347-0fc8-4148-a28b-cbb31674935d HTTP/1.1" status: 200 len: 992 time: 0.0881288 Dec 21 04:05:17.009237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb1e8c7-7c65-4dd7-a534-d85549ea1f14 req-225275a8-72d3-40fd-b8d3-38547ec781d8 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:17.010820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bb1e8c7-7c65-4dd7-a534-d85549ea1f14 req-225275a8-72d3-40fd-b8d3-38547ec781d8 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0556159 Dec 21 04:05:17.098028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bb1e8c7-7c65-4dd7-a534-d85549ea1f14 req-c4a33ad9-c64d-404f-bd3c-2a249b66145e tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651493 Dec 21 04:05:17.182496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac4f1e9-163e-4d51-9cdf-bc2a7c7baf86 req-3496fb0c-a6d7-40c4-865f-66c0b8156d6a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:17.184054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac4f1e9-163e-4d51-9cdf-bc2a7c7baf86 req-3496fb0c-a6d7-40c4-865f-66c0b8156d6a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0502477 Dec 21 04:05:17.231834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac4f1e9-163e-4d51-9cdf-bc2a7c7baf86 req-86494e83-2d9d-45d6-9dcf-530290504712 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416000 Dec 21 04:05:17.933164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-b0f63d36-ce40-43b7-bbb5-16f83484fd08 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0223787 Dec 21 04:05:18.404342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-52938ca0-5493-4f42-9c31-e20911a04307 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:18.406063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-52938ca0-5493-4f42-9c31-e20911a04307 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4674747 Dec 21 04:05:18.418115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de78fb25-840a-4fc2-9ffa-cde73b232424 req-0c5b450e-d223-43df-89d2-26b299e4c9d7 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:18.419563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de78fb25-840a-4fc2-9ffa-cde73b232424 req-0c5b450e-d223-43df-89d2-26b299e4c9d7 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0841644 Dec 21 04:05:18.441171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-62f74e59-d006-4268-907a-7dca7a1a4067 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/quotas/77bdbb8cf85f439a9e6ec1bf7f2f4843 HTTP/1.1" status: 200 len: 375 time: 0.0206687 Dec 21 04:05:18.487632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-03e5ab75-fb48-4968-ac22-fbd53991c907 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0386527 Dec 21 04:05:18.495069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de78fb25-840a-4fc2-9ffa-cde73b232424 req-ffb2971e-aa29-4fa1-b2d9-873c8f40066d tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684111 Dec 21 04:05:18.605949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c0e379-d84c-4753-887a-8fb2e58aa76f req-f09fbb95-b65c-4d57-9dd1-4b3bf09cf7fc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:18.607779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50c0e379-d84c-4753-887a-8fb2e58aa76f req-f09fbb95-b65c-4d57-9dd1-4b3bf09cf7fc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0514858 Dec 21 04:05:18.657197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50c0e379-d84c-4753-887a-8fb2e58aa76f req-8947395f-f40e-4dfc-8eea-99ed267fa27b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427845 Dec 21 04:05:18.763744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b2e8983-8f18-4564-9e69-61391818b736 req-2e20116f-8220-4d93-be03-257b172e1d25 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 210 time: 0.0355432 Dec 21 04:05:18.828189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-494ad021-877e-4a1a-bfaa-80fcdfb94155 req-0fe0f805-7dd5-4504-847f-347b7dc772b4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:18.829793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-494ad021-877e-4a1a-bfaa-80fcdfb94155 req-0fe0f805-7dd5-4504-847f-347b7dc772b4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0724511 Dec 21 04:05:18.849530 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:05:18.882232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-494ad021-877e-4a1a-bfaa-80fcdfb94155 req-6fe1f138-47f7-479a-8776-6dedef6cc421 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452349 Dec 21 04:05:19.212156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4e3e06-d296-4901-9e60-d075e65f5dbe req-694eb9e6-0daa-41a4-bef5-e49b68796f6d tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:19.213938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d4e3e06-d296-4901-9e60-d075e65f5dbe req-694eb9e6-0daa-41a4-bef5-e49b68796f6d tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0639408 Dec 21 04:05:19.264246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d4e3e06-d296-4901-9e60-d075e65f5dbe req-fbd5fbee-902f-456c-99dc-f0d6001880bb tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437560 Dec 21 04:05:19.704991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1d8714-c9ab-490a-8d14-050892c401a1 req-5401e36f-1312-4ec1-ac04-7f625f10d3db tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:19.706629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e1d8714-c9ab-490a-8d14-050892c401a1 req-5401e36f-1312-4ec1-ac04-7f625f10d3db tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0513744 Dec 21 04:05:19.806157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e1d8714-c9ab-490a-8d14-050892c401a1 req-cd8b86d2-d5e9-4b0a-a060-bc7b9e4c1425 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918016 Dec 21 04:05:19.816376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad367c93-d4df-47eb-8173-da12b7e57fd0 req-99d2f3cb-062d-4136-a6f0-c9e5ec0c7711 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:19.819465 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-93f26716-5331-4a1a-96da-18d914fa08dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:19.831260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad367c93-d4df-47eb-8173-da12b7e57fd0 req-99d2f3cb-062d-4136-a6f0-c9e5ec0c7711 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0911427 Dec 21 04:05:19.898374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad367c93-d4df-47eb-8173-da12b7e57fd0 req-35202533-c643-4df5-9a99-cabda9c86b60 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0703290 Dec 21 04:05:19.917054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd5dbb51-dd86-487e-8187-9e7346202c70 req-30521f80-0fdc-4c44-aa7b-755858bb6f56 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 210 time: 0.0359321 Dec 21 04:05:20.928712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee651ce1-e8cc-4bd9-b2c1-1ca668407334 req-f129d0f8-79b5-453d-868b-fec6580f1c38 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:20.930235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee651ce1-e8cc-4bd9-b2c1-1ca668407334 req-f129d0f8-79b5-453d-868b-fec6580f1c38 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.0505848 Dec 21 04:05:20.997619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee651ce1-e8cc-4bd9-b2c1-1ca668407334 req-67fd4a8b-3a43-41da-a5af-a7742d01362a tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/security-groups?id=7439c569-f3fa-40db-88bb-a05128374422&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605373 Dec 21 04:05:21.039356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bc16e2-4113-430b-a811-c7cd145fd104 req-0de81628-d8a0-4374-bb69-9d1fe3bf04cb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:21.041158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9bc16e2-4113-430b-a811-c7cd145fd104 req-0de81628-d8a0-4374-bb69-9d1fe3bf04cb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0603356 Dec 21 04:05:21.113076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-eaad32e5-5c9c-4b4a-850e-8fe8396cdac6 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0565901 Dec 21 04:05:21.136820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c49bebc5-14bf-4183-bd04-7633ae845034 req-b92d4d84-b119-4f8f-b045-13e862c2f549 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 210 time: 0.0706077 Dec 21 04:05:21.200651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-761ba3ea-ea1d-422c-bb78-48f6dc3083e4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:21.202035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-761ba3ea-ea1d-422c-bb78-48f6dc3083e4 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.54 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 945 time: 0.1566315 Dec 21 04:05:21.238290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9bc16e2-4113-430b-a811-c7cd145fd104 req-77c148b8-fc81-40f2-8723-a2de936291d1 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1845689 Dec 21 04:05:21.336076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-c98eb58b-aafa-43e8-9bd1-0c539051e85d tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:21.337555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-c98eb58b-aafa-43e8-9bd1-0c539051e85d tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2055984 Dec 21 04:05:21.361444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Deleting port 7dafe965-8e09-4d5a-9d86-14e23d12340c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:21.361791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.387402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Request body: {'port': {'device_id': 'a59ee707-284f-4193-87d2-6c4806c81621', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': '77bdbb8cf85f439a9e6ec1bf7f2f4843'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:21.523155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] For port 7dafe965-8e09-4d5a-9d86-14e23d12340c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7dafe965-8e09-4d5a-9d86-14e23d12340c,segment=NetworkSegment(aebf5ea6-eb2c-4e32-abdc-14ec77f8651f),segment_id=aebf5ea6-eb2c-4e32-abdc-14ec77f8651f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:21.523438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.544163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Calling delete_port for 7dafe965-8e09-4d5a-9d86-14e23d12340c owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:21.693593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Made reservation on behalf of 77bdbb8cf85f439a9e6ec1bf7f2f4843 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:21.697091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.730821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.765537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a982017-d972-442d-a239-50e9a0ffab90 req-0df80914-e418-47f8-8eb3-ae08d80801d7 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:21.767065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a982017-d972-442d-a239-50e9a0ffab90 req-0df80914-e418-47f8-8eb3-ae08d80801d7 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 950 time: 0.0928698 Dec 21 04:05:21.790772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.823911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7dafe965-8e09-4d5a-9d86-14e23d12340c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:21.841733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Pushing event deleted for resources: {'Port': ['ID=7dafe965-8e09-4d5a-9d86-14e23d12340c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:21.890794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a982017-d972-442d-a239-50e9a0ffab90 req-975e97ba-95db-4fe0-83a6-0458761a2db2 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1175711 Dec 21 04:05:21.908784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] No DVR routers for this DVR port 7dafe965-8e09-4d5a-9d86-14e23d12340c on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:21.912203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.916073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d4f6fd3-9308-4d9c-999d-0847967bcf9c req-9c77e69d-cfc2-4f1e-8574-903a6f15aa72 tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.54 "DELETE /v2.0/ports/7dafe965-8e09-4d5a-9d86-14e23d12340c HTTP/1.1" status: 204 len: 173 time: 0.6889277 Dec 21 04:05:21.916521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'name': 'network-vif-deleted', 'tag': '7dafe965-8e09-4d5a-9d86-14e23d12340c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:21.918730 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-690477a6-083e-494c-8d07-4773c975b85e" -d '{"events": [{"server_uuid": "2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4", "name": "network-vif-deleted", "tag": "7dafe965-8e09-4d5a-9d86-14e23d12340c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:21.948113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:21.957213 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-830fab78-3246-41d7-8242-395d88f67703 x-openstack-request-id: req-830fab78-3246-41d7-8242-395d88f67703 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:21.957515 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4", "name": "network-vif-deleted", "tag": "7dafe965-8e09-4d5a-9d86-14e23d12340c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:21.957777 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-830fab78-3246-41d7-8242-395d88f67703 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:21.958184 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4', 'name': 'network-vif-deleted', 'tag': '7dafe965-8e09-4d5a-9d86-14e23d12340c', 'status': 'completed', 'code': 200} Dec 21 04:05:22.013454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.095343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:22.115191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22b6948d-8916-4d14-8406-61bd9ad202a9 req-ae930989-50e8-4d28-b5b3-a3bbc9699b1e tempest-ServersNegativeTestMultiTenantJSON-2131538023 tempest-ServersNegativeTestMultiTenantJSON-2131538023-project] 10.222.0.18 "GET /v2.0/ports?device_id=2e0c6bbb-ae54-4c98-8ec2-d98cf56ab5c4 HTTP/1.1" status: 200 len: 210 time: 0.0416815 Dec 21 04:05:22.182407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Allocated IP 192.168.233.19 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/1a8ed2f5-0531-4522-b456-2041300b46be) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:22.246812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95e1c97d-9770-4fcd-8415-088fc42dd16a req-ec65d9d8-2146-4be1-8da4-bec1c6dd8df0 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 210 time: 0.0356197 Dec 21 04:05:22.384954 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.395437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d5422b-7532-4946-adee-059e93ea66e7 req-ada111b6-149c-4ade-9cc1-bcd841376365 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:22.396938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00d5422b-7532-4946-adee-059e93ea66e7 req-ada111b6-149c-4ade-9cc1-bcd841376365 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0847461 Dec 21 04:05:22.464446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00d5422b-7532-4946-adee-059e93ea66e7 req-4657f701-1e54-41a0-aed9-4e93c3ae7e0f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0607719 Dec 21 04:05:22.524858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.570210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:22.574232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:22.578519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:22.585652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Pushing event updated for resources: {'Port': ['ID=1a8ed2f5-0531-4522-b456-2041300b46be,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:22.647095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:22.647697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.818802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-8b730e2e-e7f6-4d85-8d98-d127e7320105 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4417973 Dec 21 04:05:22.829571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7549efa1-58cb-495b-a75c-40299309b72e None None] Provisioning complete for port 1a8ed2f5-0531-4522-b456-2041300b46be triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:22.830030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7549efa1-58cb-495b-a75c-40299309b72e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.844464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Request body: {'port': {'device_id': 'a59ee707-284f-4193-87d2-6c4806c81621', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:22.864772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7549efa1-58cb-495b-a75c-40299309b72e None None] Port 1a8ed2f5-0531-4522-b456-2041300b46be cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:05:22.873525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f88591f-d351-4711-a0df-c7b5e0bbe894 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.875310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:22.907776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.096395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62768da-855d-4b81-bd7c-6805673a5ca2 req-950fcca6-24ed-4e82-add9-cdac3dbd6d7b tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:23.097866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f62768da-855d-4b81-bd7c-6805673a5ca2 req-950fcca6-24ed-4e82-add9-cdac3dbd6d7b tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 950 time: 0.0846171 Dec 21 04:05:23.195124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47564) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:23.197498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f62768da-855d-4b81-bd7c-6805673a5ca2 req-34086569-bf59-402f-bf83-a8d8239c59e3 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714374 Dec 21 04:05:23.235937 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.245953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Deleting subnet 4e533b27-3e12-489d-b723-8d8a798bf017 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:05:23.249196 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.259442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1a8ed2f5-0531-4522-b456-2041300b46be {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:23.266867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.279936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Transition to ACTIVE for port object 1a8ed2f5-0531-4522-b456-2041300b46be will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:05:23.285690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.328954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.349072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.443741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed57eb4-977c-421b-8488-27bd0a5d400f req-a382911d-86bb-46f6-8e61-a93f17fe1afe tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:23.445210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fed57eb4-977c-421b-8488-27bd0a5d400f req-a382911d-86bb-46f6-8e61-a93f17fe1afe tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 935 time: 0.1270831 Dec 21 04:05:23.453268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Pushing event updated for resources: {'Port': ['ID=1a8ed2f5-0531-4522-b456-2041300b46be,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:23.465520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.499427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4e533b27-3e12-489d-b723-8d8a798bf017,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:23.500375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-6b07004c-d8d4-481b-8591-5deebcfa7f77 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:23.501999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-6b07004c-d8d4-481b-8591-5deebcfa7f77 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.54 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 950 time: 0.1225679 Dec 21 04:05:23.510222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.517281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7a4eadc-0246-48cc-97bf-757b2f8aca1a admin admin] 10.222.0.18 "DELETE /v2.0/subnets/4e533b27-3e12-489d-b723-8d8a798bf017 HTTP/1.1" status: 204 len: 168 time: 0.3209977 Dec 21 04:05:23.518136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:23.595727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.624422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fed57eb4-977c-421b-8488-27bd0a5d400f req-ff006e5f-7b56-4cf6-b8ff-a913390fdcc0 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1664240 Dec 21 04:05:23.668451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Attempting to bind port 1a8ed2f5-0531-4522-b456-2041300b46be on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:05:23.668858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Attempting to bind port 1a8ed2f5-0531-4522-b456-2041300b46be by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:05:23.669123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Attempting to bind port 1a8ed2f5-0531-4522-b456-2041300b46be on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:23.680426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Port 1a8ed2f5-0531-4522-b456-2041300b46be on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:05:23.680756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Attempting to bind port 1a8ed2f5-0531-4522-b456-2041300b46be on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:23.686609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.695223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 4, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:05:23.695437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:23.695791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:05:23.696781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Bound port: 1a8ed2f5-0531-4522-b456-2041300b46be, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:05:23.697144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.707529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e27e0a4-6bf2-44e7-8ba5-02eb2ccebae0 req-24d44098-f5d6-4e36-9d9d-e8826bf4166c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:23.708863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ad9aecbc-826b-47f6-aade-ea0859ed2141']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:23.709009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e27e0a4-6bf2-44e7-8ba5-02eb2ccebae0 req-24d44098-f5d6-4e36-9d9d-e8826bf4166c tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1460140 Dec 21 04:05:23.720000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:23.720297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aebf5ea6-eb2c-4e32-abdc-14ec77f8651f') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:23.730502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.745932 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.751906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:05:23.752289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:05:23.754055 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:05:23.773624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Deleting port a761ad76-7a71-4f42-bf0b-abda41f2df0e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:23.773964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.835767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e27e0a4-6bf2-44e7-8ba5-02eb2ccebae0 req-d1a84fa8-4d6e-4977-ac40-82ed7bc992ed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1165144 Dec 21 04:05:23.879863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] For port 1a8ed2f5-0531-4522-b456-2041300b46be, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:05:23.881904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.897592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] For port 1a8ed2f5-0531-4522-b456-2041300b46be, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1a8ed2f5-0531-4522-b456-2041300b46be,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:05:23.898404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.902190 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] 10.222.0.18 "DELETE /v2.0/networks/ad9aecbc-826b-47f6-aade-ea0859ed2141 HTTP/1.1" status: 204 len: 168 time: 0.3829644 Dec 21 04:05:23.903213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-143f10a1-75ed-4325-b08d-877f62337d5a admin admin] Pushing event deleted for resources: {'Network': ['ID=ad9aecbc-826b-47f6-aade-ea0859ed2141,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:23.905231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47572) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:23.953043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] For port a761ad76-7a71-4f42-bf0b-abda41f2df0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a761ad76-7a71-4f42-bf0b-abda41f2df0e,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:23.953330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.972204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Calling delete_port for a761ad76-7a71-4f42-bf0b-abda41f2df0e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:23.974286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:23.984531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Deleting subnet a4fe1502-2074-4fad-b9ef-2cf24127b140 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:05:24.014600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.084389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.085010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.086417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] 10.222.0.31 "PUT /v2.0/ports/1a8ed2f5-0531-4522-b456-2041300b46be HTTP/1.1" status: 200 len: 1096 time: 1.2463400 Dec 21 04:05:24.089917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a59ee707-284f-4193-87d2-6c4806c81621', 'tag': '1a8ed2f5-0531-4522-b456-2041300b46be'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:24.092212 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce3341e3-d88c-42b4-b615-ef9d410676fe" -d '{"events": [{"name": "network-changed", "server_uuid": "a59ee707-284f-4193-87d2-6c4806c81621", "tag": "1a8ed2f5-0531-4522-b456-2041300b46be"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:24.125458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.156869 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26d93f0c-77dd-4a50-a981-79b63bf66b39 x-openstack-request-id: req-26d93f0c-77dd-4a50-a981-79b63bf66b39 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:24.157176 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a59ee707-284f-4193-87d2-6c4806c81621", "tag": "1a8ed2f5-0531-4522-b456-2041300b46be", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:24.157542 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-26d93f0c-77dd-4a50-a981-79b63bf66b39 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:24.157835 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a59ee707-284f-4193-87d2-6c4806c81621', 'tag': '1a8ed2f5-0531-4522-b456-2041300b46be', 'status': 'completed', 'code': 200} Dec 21 04:05:24.160797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e4f19ca-44b2-46e7-b84f-1c11a342027e service neutron] Pushing event updated for resources: {'Port': ['ID=1a8ed2f5-0531-4522-b456-2041300b46be,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:24.205347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.321652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce3341e3-d88c-42b4-b615-ef9d410676fe req-fe640726-cf47-4310-881b-137f2ac75dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.323103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce3341e3-d88c-42b4-b615-ef9d410676fe req-fe640726-cf47-4310-881b-137f2ac75dc9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 1099 time: 0.1320636 Dec 21 04:05:24.370626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce3341e3-d88c-42b4-b615-ef9d410676fe req-ea48a3f2-8b5d-4b38-bf4f-8f7117804bf6 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0216734 Dec 21 04:05:24.382448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a3ebd85-a588-4900-9be6-326dea96a973 req-2d6b5b65-d30a-4be7-8a8a-e46d3a2c56c4 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.383911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a3ebd85-a588-4900-9be6-326dea96a973 req-2d6b5b65-d30a-4be7-8a8a-e46d3a2c56c4 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 950 time: 0.0961552 Dec 21 04:05:24.421026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.429126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.454434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['a761ad76-7a71-4f42-bf0b-abda41f2df0e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:24.516244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Pushing event deleted for resources: {'Port': ['ID=a761ad76-7a71-4f42-bf0b-abda41f2df0e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:24.525471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a4fe1502-2074-4fad-b9ef-2cf24127b140,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:24.533311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.536742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f5697457-79ba-44d2-bee3-cfe58963a7c3 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/a4fe1502-2074-4fad-b9ef-2cf24127b140 HTTP/1.1" status: 204 len: 168 time: 0.6305530 Dec 21 04:05:24.539369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47578) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:24.574855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a3ebd85-a588-4900-9be6-326dea96a973 req-ba027616-2610-46c2-bda2-f84c24be02b6 tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/security-groups?id=30573428-f065-4528-acff-5fd7f7833238&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1827633 Dec 21 04:05:24.596882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] No DVR routers for this DVR port a761ad76-7a71-4f42-bf0b-abda41f2df0e on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:24.605931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.609367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-987c6fa6-cc4d-4f4c-9c6d-b4fb36619b40 req-7c6a455d-396b-420a-bae9-0bec1920d5df tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.54 "DELETE /v2.0/ports/a761ad76-7a71-4f42-bf0b-abda41f2df0e HTTP/1.1" status: 204 len: 173 time: 1.0853508 Dec 21 04:05:24.611749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.612314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce3341e3-d88c-42b4-b615-ef9d410676fe req-7ca1b115-db7e-4b29-8d1b-9bedf6aeacc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.614054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce3341e3-d88c-42b4-b615-ef9d410676fe req-7ca1b115-db7e-4b29-8d1b-9bedf6aeacc5 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2289932 Dec 21 04:05:24.700373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.722418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5de31087-eb88-4cbc-9534-3e3772d385fe']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:24.734654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e55a309-95e7-4df1-a650-4dcc344f79ef') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:24.735039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e55a309-95e7-4df1-a650-4dcc344f79ef') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:24.744649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.757983 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.758972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-c5a86d60-8d01-45be-9729-709085351128 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.760574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-c5a86d60-8d01-45be-9729-709085351128 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 1099 time: 0.0768142 Dec 21 04:05:24.764780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Releasing vlan 121 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:05:24.765170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:05:24.766870 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:05:24.772295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad253b75-1054-48e7-9a47-89708d327963 req-925d1bc7-eb54-49ad-b788-fab56aff481a tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.773750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad253b75-1054-48e7-9a47-89708d327963 req-925d1bc7-eb54-49ad-b788-fab56aff481a tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 947 time: 0.0606985 Dec 21 04:05:24.816607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-32bc1cf0-98a2-4ea6-a8d7-fe1a84368145 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.19&port_id=1a8ed2f5-0531-4522-b456-2041300b46be HTTP/1.1" status: 200 len: 217 time: 0.0401049 Dec 21 04:05:24.890613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad253b75-1054-48e7-9a47-89708d327963 req-fc16d870-0e4e-4dc5-9967-2bb539409445 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083481 Dec 21 04:05:24.894528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-621f3043-4434-4073-af57-e8b424481332 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:24.896255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-621f3043-4434-4073-af57-e8b424481332 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0719736 Dec 21 04:05:24.912620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.922753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.933585 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] 10.222.0.18 "DELETE /v2.0/networks/5de31087-eb88-4cbc-9534-3e3772d385fe HTTP/1.1" status: 204 len: 168 time: 0.3890204 Dec 21 04:05:24.934124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:24.974048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f716ac8e-6942-49d4-9a9a-bc54e51aaef9 admin admin] Pushing event deleted for resources: {'Network': ['ID=5de31087-eb88-4cbc-9534-3e3772d385fe,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:24.995109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2091ba-423a-4329-82c9-6eb747857cf3 req-09e81b34-f4bb-4df6-b8d1-0345eb81e7de tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:25.003135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b2091ba-423a-4329-82c9-6eb747857cf3 req-09e81b34-f4bb-4df6-b8d1-0345eb81e7de tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0677910 Dec 21 04:05:25.007137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-67d3d0ee-4178-40d2-8640-ae9dc27b5d0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:25.009472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-67d3d0ee-4178-40d2-8640-ae9dc27b5d0a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1041958 Dec 21 04:05:25.059671 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:25.127778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b2091ba-423a-4329-82c9-6eb747857cf3 req-4ad74a2d-bd96-4710-8589-5a535f085f06 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1237173 Dec 21 04:05:25.152926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-94527e8e-6df7-43cb-8d16-77a0fd20617f service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288121 Dec 21 04:05:25.234863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7dafe965-8e09-4d5a-9d86-14e23d12340c no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:25.256022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 7dafe965-8e09-4d5a-9d86-14e23d12340c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:25.256381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7dafe965-8e09-4d5a-9d86-14e23d12340c not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:25.440808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47586) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:25.483224 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19041eb0-de63-4258-b85e-2b2da938f670 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f1fac7a4fc324e6fb3703b0fcb612ed1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0409124 Dec 21 04:05:25.485844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:25.537880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ad097a-27fa-4358-8dd8-8964befb990e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:25.574500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ad097a-27fa-4358-8dd8-8964befb990e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:25.609669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6773bd9d-406c-4b2e-914d-5e7301978953 req-f5d7c18b-6608-4a1f-81fe-6f89dc0d12c4 service neutron] 10.222.0.31 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4483087 Dec 21 04:05:25.718837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2967c7c1-9afb-4e83-aae8-f74033cecb91 req-df03a7d0-af2f-48d2-8106-3133f7b3f40a tempest-VolumesBackupsTest-338814817 tempest-VolumesBackupsTest-338814817-project] 10.222.0.18 "GET /v2.0/ports?device_id=11d142e7-fdae-4da8-9df0-a2aa0495170b HTTP/1.1" status: 200 len: 210 time: 0.0259285 Dec 21 04:05:25.767691 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:25.768234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ad097a-27fa-4358-8dd8-8964befb990e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:25.770525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ad097a-27fa-4358-8dd8-8964befb990e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:25.772235 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80ad097a-27fa-4358-8dd8-8964befb990e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7439c569-f3fa-40db-88bb-a05128374422 HTTP/1.1" status: 204 len: 168 time: 0.2849588 Dec 21 04:05:25.780116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ad097a-27fa-4358-8dd8-8964befb990e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7439c569-f3fa-40db-88bb-a05128374422,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:26.008036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3b2c58-0a91-4f29-ac6b-4826108bf873 req-d6447ddc-4048-46db-8f00-9f2d67612372 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:26.009533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de3b2c58-0a91-4f29-ac6b-4826108bf873 req-d6447ddc-4048-46db-8f00-9f2d67612372 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 947 time: 0.0489218 Dec 21 04:05:26.057662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de3b2c58-0a91-4f29-ac6b-4826108bf873 req-fb21db04-5944-4f8d-8010-2464835fdc1b tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420403 Dec 21 04:05:26.158964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'name': 'network-vif-deleted', 'tag': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:26.161599 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e898fb16-df08-402b-b29c-2bfc94292521" -d '{"events": [{"server_uuid": "11d142e7-fdae-4da8-9df0-a2aa0495170b", "name": "network-vif-deleted", "tag": "a761ad76-7a71-4f42-bf0b-abda41f2df0e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:26.199682 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c621605-afa2-408b-9ea7-35f5765db6d3 x-openstack-request-id: req-6c621605-afa2-408b-9ea7-35f5765db6d3 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:26.199982 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "11d142e7-fdae-4da8-9df0-a2aa0495170b", "name": "network-vif-deleted", "tag": "a761ad76-7a71-4f42-bf0b-abda41f2df0e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:26.200236 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6c621605-afa2-408b-9ea7-35f5765db6d3 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:26.200724 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '11d142e7-fdae-4da8-9df0-a2aa0495170b', 'name': 'network-vif-deleted', 'tag': 'a761ad76-7a71-4f42-bf0b-abda41f2df0e', 'status': 'completed', 'code': 200} Dec 21 04:05:26.249292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed019455-acb1-4632-b4e9-7fd30368fac0 req-31829d5a-0ef7-4667-83f9-46398b131f20 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:26.250824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed019455-acb1-4632-b4e9-7fd30368fac0 req-31829d5a-0ef7-4667-83f9-46398b131f20 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0493336 Dec 21 04:05:26.301213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed019455-acb1-4632-b4e9-7fd30368fac0 req-7e7d9136-adea-4526-b4c9-88808c8219bb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444167 Dec 21 04:05:26.421950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:26.463155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bd3e63f3-fd60-443c-89d8-a8846e46b2a4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7dd24810992140f690031b203d28026f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0399570 Dec 21 04:05:26.465603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47606) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:26.515570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83bbb9c4-ec85-46af-a2a2-1a01fff942ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:26.536585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83bbb9c4-ec85-46af-a2a2-1a01fff942ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:26.644560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac8c9eb-8810-417b-9351-59937cfcf4b0 req-fb31d0ac-6009-4eb2-b7ff-de8c079118b5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:26.646057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ac8c9eb-8810-417b-9351-59937cfcf4b0 req-fb31d0ac-6009-4eb2-b7ff-de8c079118b5 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0487602 Dec 21 04:05:26.673211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83bbb9c4-ec85-46af-a2a2-1a01fff942ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:26.676090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83bbb9c4-ec85-46af-a2a2-1a01fff942ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:26.677265 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-83bbb9c4-ec85-46af-a2a2-1a01fff942ac admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/985a2829-c276-498d-9a0c-aa49a9ecf58c HTTP/1.1" status: 204 len: 168 time: 0.2107348 Dec 21 04:05:26.685144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83bbb9c4-ec85-46af-a2a2-1a01fff942ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=985a2829-c276-498d-9a0c-aa49a9ecf58c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:26.694778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ac8c9eb-8810-417b-9351-59937cfcf4b0 req-4debc5ad-338f-4619-9914-32de04c060ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419450 Dec 21 04:05:26.792397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-ab5eaced-3e90-4a23-b77a-ca46d4d361cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:26.793975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-ab5eaced-3e90-4a23-b77a-ca46d4d361cf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.0482898 Dec 21 04:05:26.890713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-edd767fe-4bb9-43f1-af5e-5ffe2eee6bd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:26.892592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-edd767fe-4bb9-43f1-af5e-5ffe2eee6bd4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.0907574 Dec 21 04:05:26.960559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-980cd432-76ae-4c00-8f8e-3cd8acea849f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.0587592 Dec 21 04:05:27.015222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-6cb73688-863f-4f83-be3c-476e62e372a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:27.017076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-6cb73688-863f-4f83-be3c-476e62e372a6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0483117 Dec 21 04:05:27.066667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-99a64da7-d4b1-447a-86ec-c277af92c1d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:27.068584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-99a64da7-d4b1-447a-86ec-c277af92c1d9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0430164 Dec 21 04:05:27.218977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-9a6c06c6-845f-4d18-aefb-2ff7f122c42a service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1426716 Dec 21 04:05:27.227967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34aacba5-7fb6-4aa8-bb26-1b4ca9810060 req-e31756e4-f469-4596-a01e-03b8396030f0 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:27.229577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34aacba5-7fb6-4aa8-bb26-1b4ca9810060 req-e31756e4-f469-4596-a01e-03b8396030f0 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 947 time: 0.0872443 Dec 21 04:05:27.236716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a761ad76-7a71-4f42-bf0b-abda41f2df0e no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:27.266374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: a761ad76-7a71-4f42-bf0b-abda41f2df0e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:27.266819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a761ad76-7a71-4f42-bf0b-abda41f2df0e not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:27.341468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34aacba5-7fb6-4aa8-bb26-1b4ca9810060 req-4111738f-2c54-48f8-89e5-edf61f0f8c84 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922747 Dec 21 04:05:27.362089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d01785-1f14-492e-857a-4eb1394b2a88 req-8d98ea56-471e-40f2-ae6e-cd4be7c32bf6 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1276052 Dec 21 04:05:27.533761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1a8ed2f5-0531-4522-b456-2041300b46be details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:05:27.634496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1a8ed2f5-0531-4522-b456-2041300b46be, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1a8ed2f5-0531-4522-b456-2041300b46be,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:27.646742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '1a8ed2f5-0531-4522-b456-2041300b46be', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': '1a8ed2f5-0531-4522-b456-2041300b46be', 'mac_address': 'fa:16:3e:00:b0:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.19'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:05:27.690167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:27.702878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1a8ed2f5-0531-4522-b456-2041300b46be {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:27.722068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1a8ed2f5-0531-4522-b456-2041300b46be, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1a8ed2f5-0531-4522-b456-2041300b46be,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:27.824225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86aaf4d8-bf27-4196-9773-996530b61f44 req-0a17b2a7-e676-40f1-b2bd-e37c2f8393be tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:27.825923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86aaf4d8-bf27-4196-9773-996530b61f44 req-0a17b2a7-e676-40f1-b2bd-e37c2f8393be tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0557349 Dec 21 04:05:27.844733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:27.886256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86aaf4d8-bf27-4196-9773-996530b61f44 req-d0ec6143-b06a-449a-988b-cdc0580a0e74 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483787 Dec 21 04:05:27.911845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1a8ed2f5-0531-4522-b456-2041300b46be,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:28.224965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1a8ed2f5-0531-4522-b456-2041300b46be'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:28.460723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b232f764-b158-4469-afcb-ddf108ef8a5b req-5cec0189-bc82-44ff-a4c9-e5ec8518257b tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:28.462372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b232f764-b158-4469-afcb-ddf108ef8a5b req-5cec0189-bc82-44ff-a4c9-e5ec8518257b tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 948 time: 0.0499558 Dec 21 04:05:28.514276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b232f764-b158-4469-afcb-ddf108ef8a5b req-9d2fcc7a-54c6-42e1-9597-7d258aebcd52 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444686 Dec 21 04:05:28.562269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:28.676763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0760d0f-c4e0-49a9-9d06-4f8d7e93dab3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:28.750901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0760d0f-c4e0-49a9-9d06-4f8d7e93dab3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:28.821268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0760d0f-c4e0-49a9-9d06-4f8d7e93dab3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:28.862400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e0760d0f-c4e0-49a9-9d06-4f8d7e93dab3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=979ef0be370344ad91cd39b8d23615f4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2989905 Dec 21 04:05:28.865024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:28.878070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0760d0f-c4e0-49a9-9d06-4f8d7e93dab3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c30c2a71-d0c8-45cc-b397-8d044fca0a58,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:28.916450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d662dc-7925-4615-818e-f90dbece63d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:28.938514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d662dc-7925-4615-818e-f90dbece63d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:29.020376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66638772-421d-4d61-a34a-4961172f6de0 req-3a7a3620-8a78-432b-8e92-657c4b2cd852 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:29.021938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66638772-421d-4d61-a34a-4961172f6de0 req-3a7a3620-8a78-432b-8e92-657c4b2cd852 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0605111 Dec 21 04:05:29.074166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66638772-421d-4d61-a34a-4961172f6de0 req-5d63b67f-45a5-4546-b1df-a1671455d7f0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457098 Dec 21 04:05:29.078685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d662dc-7925-4615-818e-f90dbece63d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:29.081961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00d662dc-7925-4615-818e-f90dbece63d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:29.086978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-00d662dc-7925-4615-818e-f90dbece63d4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c30c2a71-d0c8-45cc-b397-8d044fca0a58 HTTP/1.1" status: 204 len: 168 time: 0.2198353 Dec 21 04:05:29.094666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d662dc-7925-4615-818e-f90dbece63d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c30c2a71-d0c8-45cc-b397-8d044fca0a58,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:29.213044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3b57b3-a5eb-4907-b94d-5fb4a5a1705e req-a00f08ea-1389-4f76-a0ba-dd627671e122 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:29.214496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c3b57b3-a5eb-4907-b94d-5fb4a5a1705e req-a00f08ea-1389-4f76-a0ba-dd627671e122 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0538814 Dec 21 04:05:29.274731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c3b57b3-a5eb-4907-b94d-5fb4a5a1705e req-1a8a6db3-4a5b-47ea-a8eb-b941b4f13077 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512919 Dec 21 04:05:29.391309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64bdb2b-84a4-4c84-b255-629e5af7ea14 req-792417d8-06a0-43e4-91f3-8853bfbac0cb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:29.392856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e64bdb2b-84a4-4c84-b255-629e5af7ea14 req-792417d8-06a0-43e4-91f3-8853bfbac0cb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0496187 Dec 21 04:05:29.449422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e64bdb2b-84a4-4c84-b255-629e5af7ea14 req-51e0f505-0f4a-489b-9a09-cc9bf04c784e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503390 Dec 21 04:05:29.554697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1a8ed2f5-0531-4522-b456-2041300b46be up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:05:29.638285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b16a974-52fd-4b71-909d-598d89707968 req-4e97001b-bd45-4e58-97f7-e94acd63e055 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:29.639950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b16a974-52fd-4b71-909d-598d89707968 req-4e97001b-bd45-4e58-97f7-e94acd63e055 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 948 time: 0.0506458 Dec 21 04:05:29.691275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b16a974-52fd-4b71-909d-598d89707968 req-f4c67a7d-74d4-45e0-a48a-a2edb462b6c6 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451839 Dec 21 04:05:29.714155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 1a8ed2f5-0531-4522-b456-2041300b46be completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:05:29.718177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 1a8ed2f5-0531-4522-b456-2041300b46be triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:29.718777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:29.798276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:29.827737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59ee707-284f-4193-87d2-6c4806c81621', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a8ed2f5-0531-4522-b456-2041300b46be'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:29.829999 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88da352e-f11e-4f51-abc0-e23041b07331" -d '{"events": [{"server_uuid": "a59ee707-284f-4193-87d2-6c4806c81621", "name": "network-vif-plugged", "status": "completed", "tag": "1a8ed2f5-0531-4522-b456-2041300b46be"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:29.844244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1a8ed2f5-0531-4522-b456-2041300b46be, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1a8ed2f5-0531-4522-b456-2041300b46be,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:29.880064 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69cb3572-343a-4130-bc48-ebf353fd2869 x-openstack-request-id: req-69cb3572-343a-4130-bc48-ebf353fd2869 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:29.880362 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59ee707-284f-4193-87d2-6c4806c81621", "name": "network-vif-plugged", "status": "completed", "tag": "1a8ed2f5-0531-4522-b456-2041300b46be", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:29.880615 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-69cb3572-343a-4130-bc48-ebf353fd2869 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:29.881018 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a59ee707-284f-4193-87d2-6c4806c81621', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a8ed2f5-0531-4522-b456-2041300b46be', 'code': 200} Dec 21 04:05:29.912443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:29.971557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1508693-aef5-40bc-9a16-0e28a90deeba req-d1bf9ffa-376d-470e-8c7d-bc71893f884f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:29.971557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1508693-aef5-40bc-9a16-0e28a90deeba req-d1bf9ffa-376d-470e-8c7d-bc71893f884f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0574462 Dec 21 04:05:29.987428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1a8ed2f5-0531-4522-b456-2041300b46be,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:30.063576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1508693-aef5-40bc-9a16-0e28a90deeba req-0c986303-069a-4380-9351-fc1f29e24fca tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0818300 Dec 21 04:05:30.073228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7378adda-c16e-4083-9317-f940019e481b req-294b921d-1bb1-4ccb-b37a-6be42b0821ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:30.074765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7378adda-c16e-4083-9317-f940019e481b req-294b921d-1bb1-4ccb-b37a-6be42b0821ad service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 1101 time: 0.0748949 Dec 21 04:05:30.126862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7378adda-c16e-4083-9317-f940019e481b req-7785d137-6a58-49e4-8edc-7985bcd5440c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437338 Dec 21 04:05:30.693650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47712) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:30.804840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-933e3ced-eba0-471e-8f1d-eac697268796 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:30.824397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3136b8bf-7568-4019-9c4c-8dc6e0bdd3a9 req-f56f7ed1-edf1-427b-a078-afe1f981fd16 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:30.826029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3136b8bf-7568-4019-9c4c-8dc6e0bdd3a9 req-f56f7ed1-edf1-427b-a078-afe1f981fd16 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 949 time: 0.0603776 Dec 21 04:05:30.890654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3136b8bf-7568-4019-9c4c-8dc6e0bdd3a9 req-d6119d38-07e0-4786-8aba-9600dac7eb66 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484715 Dec 21 04:05:30.902229 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-933e3ced-eba0-471e-8f1d-eac697268796 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:30.973492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-933e3ced-eba0-471e-8f1d-eac697268796 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:31.010355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-933e3ced-eba0-471e-8f1d-eac697268796 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=583b1df4-c66c-43d8-95c4-fa49f4c49bb1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:31.016387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-933e3ced-eba0-471e-8f1d-eac697268796 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b7b473ad3a334572b3720d4e801e49df&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3198955 Dec 21 04:05:31.017466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47718) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:31.072957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f897e5-b629-4cfa-82b3-9800eb7c561d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:31.096207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f897e5-b629-4cfa-82b3-9800eb7c561d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:31.193107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd632359-36a3-4e2f-a37e-100b683a1b44 req-99a397c9-897a-46b2-88f4-c5df8a283b80 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:31.194616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd632359-36a3-4e2f-a37e-100b683a1b44 req-99a397c9-897a-46b2-88f4-c5df8a283b80 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0537643 Dec 21 04:05:31.218807 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f897e5-b629-4cfa-82b3-9800eb7c561d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:31.221419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4f897e5-b629-4cfa-82b3-9800eb7c561d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:31.225311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4f897e5-b629-4cfa-82b3-9800eb7c561d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/583b1df4-c66c-43d8-95c4-fa49f4c49bb1 HTTP/1.1" status: 204 len: 168 time: 0.2041640 Dec 21 04:05:31.231006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4f897e5-b629-4cfa-82b3-9800eb7c561d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=583b1df4-c66c-43d8-95c4-fa49f4c49bb1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:31.264902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd632359-36a3-4e2f-a37e-100b683a1b44 req-43776fa7-ace0-441d-9953-c7d54348a075 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632570 Dec 21 04:05:31.694171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6336768c-ec9f-4f33-9dd5-084ecc84a97f req-0bb62d09-5af1-4fda-a2ab-c9634f2c15db tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:31.700102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6336768c-ec9f-4f33-9dd5-084ecc84a97f req-0bb62d09-5af1-4fda-a2ab-c9634f2c15db tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0550630 Dec 21 04:05:31.766316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6336768c-ec9f-4f33-9dd5-084ecc84a97f req-4dba8001-2174-466b-b2f9-6d07a7ab927d tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0571167 Dec 21 04:05:31.855563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00812b97-04db-47a6-943e-38b54502cc07 req-70bc8177-01fb-473d-b055-c617fa8c46df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:31.857133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-70bc8177-01fb-473d-b055-c617fa8c46df service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2d46b810d87943059c90ba895934ed3b&device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 1096 time: 0.0521283 Dec 21 04:05:31.958156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00812b97-04db-47a6-943e-38b54502cc07 req-56ceea20-8348-491f-82a9-c93bd2afcf68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:31.964394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-56ceea20-8348-491f-82a9-c93bd2afcf68 service neutron] 10.222.0.31 "GET /v2.0/networks?id=adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 200 len: 913 time: 0.0941715 Dec 21 04:05:32.067430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-c0fff285-2865-4a29-b9f7-367d5a82b88c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 200 len: 999 time: 0.0956788 Dec 21 04:05:32.075904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8854c6bf-e151-4b2f-853f-9dd8744d99f0 req-9440c769-e043-4334-b7f1-e19b1059875b tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:32.077432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8854c6bf-e151-4b2f-853f-9dd8744d99f0 req-9440c769-e043-4334-b7f1-e19b1059875b tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 949 time: 0.1069355 Dec 21 04:05:32.150418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00812b97-04db-47a6-943e-38b54502cc07 req-6616780f-676d-44e0-90dd-6a05c7c3fc6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:32.151903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-6616780f-676d-44e0-90dd-6a05c7c3fc6c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 200 len: 851 time: 0.0736165 Dec 21 04:05:32.160344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8854c6bf-e151-4b2f-853f-9dd8744d99f0 req-17b680e0-e82d-4c1e-ad8a-3dfffa677241 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744970 Dec 21 04:05:32.225215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00812b97-04db-47a6-943e-38b54502cc07 req-49399b87-58b3-45f4-a82e-36216fdcb3af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:32.227625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-49399b87-58b3-45f4-a82e-36216fdcb3af service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=adb6972f-1a1d-4ca4-855c-5e5faf88030a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0655124 Dec 21 04:05:32.321955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-b2a29759-f2e7-4bed-a1d1-5e418791d0fe service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872171 Dec 21 04:05:32.427224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00812b97-04db-47a6-943e-38b54502cc07 req-cc7cad79-a2ae-4929-b1d5-2f484d8eaef0 service neutron] 10.222.0.31 "GET /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928195 Dec 21 04:05:32.479953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47808) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:32.592443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1672534947-network', 'tenant_id': 'c24fe956f7434054805a2322d25507fa'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:32.707947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f04575c-602e-4519-926a-95123d919fb0 req-55d995ac-99c2-4d98-868f-e84e850fadd5 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:32.709816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f04575c-602e-4519-926a-95123d919fb0 req-55d995ac-99c2-4d98-868f-e84e850fadd5 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 949 time: 0.0654423 Dec 21 04:05:32.712152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Made reservation on behalf of c24fe956f7434054805a2322d25507fa for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:32.715816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:32.727991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:32.796331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f04575c-602e-4519-926a-95123d919fb0 req-a310bc92-0ee9-4b3a-84a3-9dc8de30304f tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701501 Dec 21 04:05:32.861163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:32.906042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1bdec4-8f38-42e7-8f84-c966a76d1217 req-2b3bca66-f251-4553-985d-927582c397ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:32.907695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf1bdec4-8f38-42e7-8f84-c966a76d1217 req-2b3bca66-f251-4553-985d-927582c397ba tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0589516 Dec 21 04:05:32.936036 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:32.973578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:05:32.982303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf1bdec4-8f38-42e7-8f84-c966a76d1217 req-fa6ea216-f180-438b-a7c8-e964ff862525 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0682700 Dec 21 04:05:32.993543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=263b6fe6-c124-4b9f-898a-5bbe82f435fd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:33.003699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.003699 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Added segment 14fbbca6-7072-4909-b9a3-3ca17b26245e of type vlan for network 13d79d25-d791-421e-bee1-93ce620f5704 Dec 21 04:05:33.040205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.124353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.125481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:33.126065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.192032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] Pushing event updated for resources: {'Network': ['ID=13d79d25-d791-421e-bee1-93ce620f5704,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:33.203571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 13d79d25-d791-421e-bee1-93ce620f5704 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:05:33.230146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4745a7a3-0ffe-4bd5-8143-36240527943b admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.7469490 Dec 21 04:05:33.230610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47838) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:33.235617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Request body: {'subnet': {'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1672534947-subnet', 'tenant_id': 'c24fe956f7434054805a2322d25507fa', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:33.368124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Made reservation on behalf of c24fe956f7434054805a2322d25507fa for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:33.371678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.627585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.683380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=f6eb37b9-316b-4d85-9044-455f8831b074,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:33.695327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Checking segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:33.695728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Network hostable DHCP agents. Network: 13d79d25-d791-421e-bee1-93ce620f5704, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:05:33.782053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Network 13d79d25-d791-421e-bee1-93ce620f5704 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:05:33.884253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 13d79d25-d791-421e-bee1-93ce620f5704) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:33.888258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:33.888849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:33.894651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9718a8c-22c2-4dd7-8abc-c6d5917ce163 None None] Network 13d79d25-d791-421e-bee1-93ce620f5704 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:05:33.948661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48648b3c-4091-43c9-a71d-a7c6c14d279f req-6ce3946e-b342-4452-9be0-0d0bc12b05ab tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:33.951515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48648b3c-4091-43c9-a71d-a7c6c14d279f req-6ce3946e-b342-4452-9be0-0d0bc12b05ab tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 949 time: 0.0751884 Dec 21 04:05:34.010090 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2a892481-718b-41cd-9453-fa50eacf36fc admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.7691636 Dec 21 04:05:34.010415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48648b3c-4091-43c9-a71d-a7c6c14d279f req-f33f0b42-3971-44ef-87d7-7f0d0f77591b tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/security-groups?id=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538404 Dec 21 04:05:34.021919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c595cddc-8065-4534-af42-5a3432aca82b None None] Network 13d79d25-d791-421e-bee1-93ce620f5704 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:05:34.137850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69558fa-ecf5-4dab-9060-41b8ed651384 req-f273d4ab-9c36-4cb8-a854-b9e65789b4b8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:34.139467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f69558fa-ecf5-4dab-9060-41b8ed651384 req-f273d4ab-9c36-4cb8-a854-b9e65789b4b8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0580087 Dec 21 04:05:34.204562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f69558fa-ecf5-4dab-9060-41b8ed651384 req-aa8f53bc-6363-4fb5-a4c7-b66d90403bdd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582144 Dec 21 04:05:34.342200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ea67bb-764c-4aa9-8078-a2cc79ca9437 req-5a643dc4-ddb9-4419-a173-7ff7a1b325e0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:34.343722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17ea67bb-764c-4aa9-8078-a2cc79ca9437 req-5a643dc4-ddb9-4419-a173-7ff7a1b325e0 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.0560844 Dec 21 04:05:34.403815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17ea67bb-764c-4aa9-8078-a2cc79ca9437 req-b3ee6825-819d-4969-86c9-4e579dbf69c8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490835 Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.514645 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:05:34.517325 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:05:34.518343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-3c3020de-d441-440a-b5a2-06e08fe9ee1a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:34.525439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-3c3020de-d441-440a-b5a2-06e08fe9ee1a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.1250403 Dec 21 04:05:34.536350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-7ff80eeb-93bd-4d7e-a95b-de6581fca951 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/quotas/c24fe956f7434054805a2322d25507fa HTTP/1.1" status: 200 len: 375 time: 0.0100458 Dec 21 04:05:34.572128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-79b427b7-9221-4557-b490-36580d5ca063 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0299387 Dec 21 04:05:34.698251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-a67eeca9-5761-4019-9d18-481c805112c5 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:34.699763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-a67eeca9-5761-4019-9d18-481c805112c5 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.31 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 949 time: 0.0643084 Dec 21 04:05:34.748058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-5e2e7888-b172-413a-a5ba-ae2841fbbb40 service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1681836 Dec 21 04:05:34.878146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Deleting port 1a8ed2f5-0531-4522-b456-2041300b46be {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:34.878599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:34.884448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-5f4237f5-27de-4493-8e73-944fbf7fcca9 service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295257 Dec 21 04:05:34.981759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] For port 1a8ed2f5-0531-4522-b456-2041300b46be, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1a8ed2f5-0531-4522-b456-2041300b46be,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:34.982388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:34.994863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Calling delete_port for 1a8ed2f5-0531-4522-b456-2041300b46be owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:35.230133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:35.257242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdb58dba-6e5c-42c7-a3fa-1fe1853e52b3 req-783e9ddb-44d4-4544-bb6d-448aa4b78e11 tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 210 time: 0.0443470 Dec 21 04:05:35.263831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1a8ed2f5-0531-4522-b456-2041300b46be'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:35.319659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Pushing event deleted for resources: {'Port': ['ID=1a8ed2f5-0531-4522-b456-2041300b46be,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:35.393950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87dc5cda-7bb4-48eb-8a49-8fb836b78a5b req-2e0504d8-f235-44bf-a13e-0e77c8f87049 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 210 time: 0.0503547 Dec 21 04:05:35.416909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] No DVR routers for this DVR port 1a8ed2f5-0531-4522-b456-2041300b46be on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:35.419022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:35.422640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f301f6ce-8de3-47e9-a82a-f2a0e38e602f req-5cc9cb86-701a-49c6-aa3d-488d5fe0a64c tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.31 "DELETE /v2.0/ports/1a8ed2f5-0531-4522-b456-2041300b46be HTTP/1.1" status: 204 len: 173 time: 0.7133062 Dec 21 04:05:35.423139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59ee707-284f-4193-87d2-6c4806c81621', 'name': 'network-vif-deleted', 'tag': '1a8ed2f5-0531-4522-b456-2041300b46be'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:35.426101 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-115d739b-a830-4b21-83a8-a4c03e806805" -d '{"events": [{"server_uuid": "a59ee707-284f-4193-87d2-6c4806c81621", "name": "network-vif-deleted", "tag": "1a8ed2f5-0531-4522-b456-2041300b46be"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:35.469851 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69ce0eda-f204-472c-8dab-04c2d3432764 x-openstack-request-id: req-69ce0eda-f204-472c-8dab-04c2d3432764 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:35.470148 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59ee707-284f-4193-87d2-6c4806c81621", "name": "network-vif-deleted", "tag": "1a8ed2f5-0531-4522-b456-2041300b46be", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:35.470428 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-69ce0eda-f204-472c-8dab-04c2d3432764 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:35.470858 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a59ee707-284f-4193-87d2-6c4806c81621', 'name': 'network-vif-deleted', 'tag': '1a8ed2f5-0531-4522-b456-2041300b46be', 'status': 'completed', 'code': 200} Dec 21 04:05:36.049200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f250f74-de64-4165-affc-2dbc3964649f req-9023122e-461d-44cd-8e1d-dfa5d37ab881 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:36.050878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f250f74-de64-4165-affc-2dbc3964649f req-9023122e-461d-44cd-8e1d-dfa5d37ab881 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6740513a-11e0-4557-84f1-e19548c91e14 HTTP/1.1" status: 200 len: 944 time: 0.0496469 Dec 21 04:05:36.157987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Deleting port 9af4ef3c-d48b-437e-8852-f063d225dc37 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:36.158332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:36.254874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] For port 9af4ef3c-d48b-437e-8852-f063d225dc37, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9af4ef3c-d48b-437e-8852-f063d225dc37,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:36.255306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:36.268604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Calling delete_port for 9af4ef3c-d48b-437e-8852-f063d225dc37 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:36.393772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e7538fc-b099-4d0f-91eb-4c6e62b730c8 req-6d0c32cf-3c35-4796-8e7d-0c1956217bba tempest-VolumesNegativeTest-1181537998 tempest-VolumesNegativeTest-1181537998-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59ee707-284f-4193-87d2-6c4806c81621 HTTP/1.1" status: 200 len: 210 time: 0.0294273 Dec 21 04:05:36.505401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a8c0b1b-f79c-47a2-88f5-0e0f4ce30337 req-9d5c6676-c256-4633-a735-1940cd748fb1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 210 time: 0.0336559 Dec 21 04:05:36.533161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:36.564831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'Port': ['ID=9af4ef3c-d48b-437e-8852-f063d225dc37,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:36.573478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'cee69311-8acd-4064-a7b4-06c97526b389'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:36.610970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] No DVR routers for this DVR port 9af4ef3c-d48b-437e-8852-f063d225dc37 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:36.614606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:36.620637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f250f74-de64-4165-affc-2dbc3964649f req-d9835f64-17b1-471d-8622-728900235bed tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "DELETE /v2.0/ports/9af4ef3c-d48b-437e-8852-f063d225dc37 HTTP/1.1" status: 204 len: 173 time: 0.5622284 Dec 21 04:05:37.472284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-deleted', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:37.474645 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f654252-b862-48d4-8500-d318e0ba024f" -d '{"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-deleted", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:37.536752 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68f9068a-d16f-40cb-a2a7-be36ada5b74e x-openstack-request-id: req-68f9068a-d16f-40cb-a2a7-be36ada5b74e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:37.537049 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6740513a-11e0-4557-84f1-e19548c91e14", "name": "network-vif-deleted", "tag": "9af4ef3c-d48b-437e-8852-f063d225dc37", "status": "failed", "code": 422}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:37.537304 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-68f9068a-d16f-40cb-a2a7-be36ada5b74e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:37.537716 n-d-822053-11 neutron-server[110310]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '6740513a-11e0-4557-84f1-e19548c91e14', 'name': 'network-vif-deleted', 'tag': '9af4ef3c-d48b-437e-8852-f063d225dc37', 'status': 'failed', 'code': 422} returned with failed status Dec 21 04:05:37.599465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1a8ed2f5-0531-4522-b456-2041300b46be no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:37.624938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 1a8ed2f5-0531-4522-b456-2041300b46be {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:37.625293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1a8ed2f5-0531-4522-b456-2041300b46be not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:37.653079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eebc5524-20a7-432e-9df2-d0b0fbd94a44 req-5d10ed95-decf-49cb-abc6-89ae81b78b84 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 210 time: 0.0668662 Dec 21 04:05:37.765752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-59fce0e7-7b6e-4c74-80d3-45dd671ecc73 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:37.767531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-59fce0e7-7b6e-4c74-80d3-45dd671ecc73 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.1452000 Dec 21 04:05:37.790650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Request body: {'port': {'device_id': '6dfba92b-f125-4060-8fa6-204454367110', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'admin_state_up': True, 'tenant_id': 'c24fe956f7434054805a2322d25507fa'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:38.045866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2453ffb-1dba-4314-921d-bcd64ae744bf req-c3b49522-6f67-4546-ad96-12eb1355abc3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:38.047686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2453ffb-1dba-4314-921d-bcd64ae744bf req-c3b49522-6f67-4546-ad96-12eb1355abc3 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 908 time: 0.0575149 Dec 21 04:05:38.066299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Made reservation on behalf of c24fe956f7434054805a2322d25507fa for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:38.069809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:38.207992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Allocated IP 172.20.0.6 (13d79d25-d791-421e-bee1-93ce620f5704/f6eb37b9-316b-4d85-9044-455f8831b074/524a3677-f175-4542-a3c6-7039ad8256ba) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:38.374813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:38.541977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:38.594552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Network 13d79d25-d791-421e-bee1-93ce620f5704 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:38.598090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:38.602685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:38.627976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event updated for resources: {'Port': ['ID=524a3677-f175-4542-a3c6-7039ad8256ba,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:38.660207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:38.660816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:38.779191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-70a361ff-e1e1-4d29-8763-c86a697c8e87 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9930658 Dec 21 04:05:38.801242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c74af3e-d377-44e7-b515-17fdb48d529c req-10d98d1a-9dfc-4ba3-9e77-5746caa7f855 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:38.802922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c74af3e-d377-44e7-b515-17fdb48d529c req-10d98d1a-9dfc-4ba3-9e77-5746caa7f855 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 931 time: 0.0618553 Dec 21 04:05:38.809088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Request body: {'port': {'device_id': '6dfba92b-f125-4060-8fa6-204454367110', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:38.896325 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:38.903552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c74af3e-d377-44e7-b515-17fdb48d529c req-742175ff-1076-4928-954b-bc0b44d78228 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0916100 Dec 21 04:05:39.221045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51e3fda9-aeff-4d02-9e60-4070b28d66a6 req-8992a74f-b2e9-4f43-9025-40823706dabb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:39.222569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51e3fda9-aeff-4d02-9e60-4070b28d66a6 req-8992a74f-b2e9-4f43-9025-40823706dabb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 908 time: 0.0890484 Dec 21 04:05:39.226708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 524a3677-f175-4542-a3c6-7039ad8256ba {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:39.235130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:39.251634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Transition to ACTIVE for port object 524a3677-f175-4542-a3c6-7039ad8256ba will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:05:39.327489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:39.378334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Pushing event updated for resources: {'Port': ['ID=524a3677-f175-4542-a3c6-7039ad8256ba,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:39.455650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Attempting to bind port 524a3677-f175-4542-a3c6-7039ad8256ba on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:05:39.456003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Attempting to bind port 524a3677-f175-4542-a3c6-7039ad8256ba by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:05:39.456339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Attempting to bind port 524a3677-f175-4542-a3c6-7039ad8256ba on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:39.462146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Port 524a3677-f175-4542-a3c6-7039ad8256ba on network 13d79d25-d791-421e-bee1-93ce620f5704 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:05:39.462475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Attempting to bind port 524a3677-f175-4542-a3c6-7039ad8256ba on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:39.467806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:05:39.468156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Checking segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:39.468571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Bound using segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:05:39.468998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Bound port: 524a3677-f175-4542-a3c6-7039ad8256ba, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:05:39.469358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:39.536459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] For port 524a3677-f175-4542-a3c6-7039ad8256ba, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:05:39.539872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] For port 524a3677-f175-4542-a3c6-7039ad8256ba, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=524a3677-f175-4542-a3c6-7039ad8256ba,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:05:39.645960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:40.061852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-a2a609d6-dc11-460e-a95d-4c8c9a74b910 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.063443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-a2a609d6-dc11-460e-a95d-4c8c9a74b910 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 908 time: 0.4603190 Dec 21 04:05:40.067136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.069147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:40.069147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] 10.222.0.54 "PUT /v2.0/ports/524a3677-f175-4542-a3c6-7039ad8256ba HTTP/1.1" status: 200 len: 1092 time: 1.2651618 Dec 21 04:05:40.070587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6dfba92b-f125-4060-8fa6-204454367110', 'tag': '524a3677-f175-4542-a3c6-7039ad8256ba'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:40.072899 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1bc18ef2-ac99-4c2d-8d31-69926b730d73" -d '{"events": [{"name": "network-changed", "server_uuid": "6dfba92b-f125-4060-8fa6-204454367110", "tag": "524a3677-f175-4542-a3c6-7039ad8256ba"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:40.132204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d564d2-a3aa-4e6a-8833-0727bbfeecf9 service neutron] Pushing event updated for resources: {'Port': ['ID=524a3677-f175-4542-a3c6-7039ad8256ba,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:40.135844 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abcbd1a6-b744-4080-9157-6e25c92be5c9 x-openstack-request-id: req-abcbd1a6-b744-4080-9157-6e25c92be5c9 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:40.136139 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6dfba92b-f125-4060-8fa6-204454367110", "tag": "524a3677-f175-4542-a3c6-7039ad8256ba", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:40.136392 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-abcbd1a6-b744-4080-9157-6e25c92be5c9 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:40.136786 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6dfba92b-f125-4060-8fa6-204454367110', 'tag': '524a3677-f175-4542-a3c6-7039ad8256ba', 'status': 'completed', 'code': 200} Dec 21 04:05:40.155291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ec0260-bd42-422a-ab67-5d4fe11ffaa0 req-15ddb98e-3e1c-4932-89f5-0459ea1c35d1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.156384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87ec0260-bd42-422a-ab67-5d4fe11ffaa0 req-15ddb98e-3e1c-4932-89f5-0459ea1c35d1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 943 time: 0.1382656 Dec 21 04:05:40.277051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Deleting port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:40.277407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:40.282717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc18ef2-ac99-4c2d-8d31-69926b730d73 req-a8a9bf23-3cfa-4670-b6bd-fbaa938e2bdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.284272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bc18ef2-ac99-4c2d-8d31-69926b730d73 req-a8a9bf23-3cfa-4670-b6bd-fbaa938e2bdb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 1095 time: 0.0961523 Dec 21 04:05:40.298260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87ec0260-bd42-422a-ab67-5d4fe11ffaa0 req-66954233-c965-4af5-b337-51fc79ed6f28 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1199815 Dec 21 04:05:40.483685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa578098-a197-4cc1-af03-cc042609318a req-4c1e19af-3aaf-40bd-a872-09fabe6a4ff2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.485275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa578098-a197-4cc1-af03-cc042609318a req-4c1e19af-3aaf-40bd-a872-09fabe6a4ff2 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 908 time: 0.1860645 Dec 21 04:05:40.490025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] For port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:40.490025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:40.513706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Calling delete_port for fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:40.519981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc18ef2-ac99-4c2d-8d31-69926b730d73 req-dc434b45-02c7-4ae2-a1aa-bbd052dff377 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.521767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bc18ef2-ac99-4c2d-8d31-69926b730d73 req-dc434b45-02c7-4ae2-a1aa-bbd052dff377 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=c24fe956f7434054805a2322d25507fa&shared=False HTTP/1.1" status: 200 len: 916 time: 0.2137823 Dec 21 04:05:40.675989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc18ef2-ac99-4c2d-8d31-69926b730d73 req-4273186f-06f1-4f7e-99ec-854cd4f161eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.677597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bc18ef2-ac99-4c2d-8d31-69926b730d73 req-4273186f-06f1-4f7e-99ec-854cd4f161eb service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1469407 Dec 21 04:05:40.783793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-fcca4ffc-14da-425f-8a22-3cbb1437344f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.785676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-fcca4ffc-14da-425f-8a22-3cbb1437344f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 1095 time: 0.0457726 Dec 21 04:05:40.809938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:40.853395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-d664cd96-0687-4665-bcdf-80045ad4dcaf service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=524a3677-f175-4542-a3c6-7039ad8256ba HTTP/1.1" status: 200 len: 217 time: 0.0532000 Dec 21 04:05:40.886337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'Port': ['ID=fbc9f75a-3bde-4d88-896d-2cf1f9f48d27,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:40.953507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] No DVR routers for this DVR port fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:40.956161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:40.960105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bf342dd-f5f6-4bdf-b3ee-6f14e9f0e9bb req-b7434c5d-1d02-4bb9-9816-55abc37dfa6f tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "DELETE /v2.0/ports/fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 HTTP/1.1" status: 204 len: 173 time: 0.8805611 Dec 21 04:05:40.975595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-554bc767-b721-4b91-b4df-27eb4c969b4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:40.977254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-554bc767-b721-4b91-b4df-27eb4c969b4c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f6eb37b9-316b-4d85-9044-455f8831b074 HTTP/1.1" status: 200 len: 855 time: 0.1028593 Dec 21 04:05:41.019680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-228dde01-bcfb-4c43-933c-9552a2c245be service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=13d79d25-d791-421e-bee1-93ce620f5704&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0347927 Dec 21 04:05:41.137869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-54001937-0581-4365-9c0b-1585d21cbfaa service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1079171 Dec 21 04:05:41.247427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e316a47-f4f6-4da8-a6d9-d43b59c6db38 req-befa1c75-abcb-4db8-b6e2-950037b4da3b service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045334 Dec 21 04:05:41.426893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a42ff96-98ed-4add-9340-0a4445859ff7 req-54cd7b5e-bab4-4acd-bf91-716ae94cf066 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:41.428812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a42ff96-98ed-4add-9340-0a4445859ff7 req-54cd7b5e-bab4-4acd-bf91-716ae94cf066 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 943 time: 0.0527124 Dec 21 04:05:41.485632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a42ff96-98ed-4add-9340-0a4445859ff7 req-2cdc13ff-cf66-47b6-859f-a51354311674 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478582 Dec 21 04:05:41.659450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-377e31d2-5fee-4323-9cd1-a478d8e7847f req-f32368da-362d-47c1-bd61-d927057a2dad tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=5e4877af-33ca-4fad-8dfd-7f7551b2ddf6 HTTP/1.1" status: 200 len: 210 time: 0.0333767 Dec 21 04:05:42.138271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'name': 'network-vif-deleted', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:42.140891 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-559ed68a-ce57-496c-bbc7-e15b74312b4b" -d '{"events": [{"server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "name": "network-vif-deleted", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:42.180991 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02472946-64e0-4f07-a30c-08fcddc288ce x-openstack-request-id: req-02472946-64e0-4f07-a30c-08fcddc288ce {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:42.181290 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e4877af-33ca-4fad-8dfd-7f7551b2ddf6", "name": "network-vif-deleted", "tag": "fbc9f75a-3bde-4d88-896d-2cf1f9f48d27", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:42.181544 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-02472946-64e0-4f07-a30c-08fcddc288ce {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:42.181941 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e4877af-33ca-4fad-8dfd-7f7551b2ddf6', 'name': 'network-vif-deleted', 'tag': 'fbc9f75a-3bde-4d88-896d-2cf1f9f48d27', 'status': 'completed', 'code': 200} Dec 21 04:05:42.623085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1284be-50bb-4aab-b30b-11b43fac45f0 req-9c5b399d-b259-4c9f-8948-17c3c1cb5279 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:42.624655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d1284be-50bb-4aab-b30b-11b43fac45f0 req-9c5b399d-b259-4c9f-8948-17c3c1cb5279 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 943 time: 0.0513153 Dec 21 04:05:42.690787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d1284be-50bb-4aab-b30b-11b43fac45f0 req-b6796820-80af-4b32-bf94-48eea6211ed0 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602043 Dec 21 04:05:43.241098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d3b8d2-cf79-4a87-945d-5340916e39de req-43ae8f94-e174-4ca5-8827-9a91fda036d9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:43.244294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05d3b8d2-cf79-4a87-945d-5340916e39de req-43ae8f94-e174-4ca5-8827-9a91fda036d9 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 946 time: 0.0526452 Dec 21 04:05:43.308177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05d3b8d2-cf79-4a87-945d-5340916e39de req-f0d9ebe0-b78a-41be-a2fc-046aba5d47a8 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575449 Dec 21 04:05:43.627871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:43.653579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:43.654588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device fbc9f75a-3bde-4d88-896d-2cf1f9f48d27 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:43.839438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb00af1a-18e9-4d01-b49b-cf742d00fb7c req-54f2ea1f-660c-48e2-9dd1-5108c450a311 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:43.847271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb00af1a-18e9-4d01-b49b-cf742d00fb7c req-54f2ea1f-660c-48e2-9dd1-5108c450a311 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 943 time: 0.0687916 Dec 21 04:05:43.906179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb00af1a-18e9-4d01-b49b-cf742d00fb7c req-c6e072ad-fecf-49e9-997d-c0ce2cbcbe68 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581331 Dec 21 04:05:44.453700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a13b8c04-9808-4d43-b5fb-1dede829b518 req-45addf67-be2e-4bf4-805a-b96fadd3d004 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:44.455345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a13b8c04-9808-4d43-b5fb-1dede829b518 req-45addf67-be2e-4bf4-805a-b96fadd3d004 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 946 time: 0.0601137 Dec 21 04:05:44.506358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a13b8c04-9808-4d43-b5fb-1dede829b518 req-653dc67a-0d26-4435-bbe4-2920068392bc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442600 Dec 21 04:05:44.641581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-5fbf0762-dab3-48d4-8a0c-40b49462db6a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:44.643145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-5fbf0762-dab3-48d4-8a0c-40b49462db6a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 946 time: 0.0635986 Dec 21 04:05:44.761553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Deleting port cee69311-8acd-4064-a7b4-06c97526b389 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:44.761553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:44.859968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] For port cee69311-8acd-4064-a7b4-06c97526b389, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cee69311-8acd-4064-a7b4-06c97526b389,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:44.860347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:44.874644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Calling delete_port for cee69311-8acd-4064-a7b4-06c97526b389 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:45.065355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1162cc63-6775-40ed-a3bf-51dfebc70aec req-add34bda-fa1d-473e-9a35-6879311ac44f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:45.066953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1162cc63-6775-40ed-a3bf-51dfebc70aec req-add34bda-fa1d-473e-9a35-6879311ac44f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 943 time: 0.0661950 Dec 21 04:05:45.115917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1162cc63-6775-40ed-a3bf-51dfebc70aec req-e1ed4e87-db23-4740-be72-efaae2ea70cb tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420718 Dec 21 04:05:45.167671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:45.199979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'cee69311-8acd-4064-a7b4-06c97526b389'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:45.201703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'Port': ['ID=cee69311-8acd-4064-a7b4-06c97526b389,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:45.244674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] No DVR routers for this DVR port cee69311-8acd-4064-a7b4-06c97526b389 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:45.247288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:45.250689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f76c6db1-ef3e-43f7-9577-277aed1d4f9c req-dd2f3042-3182-4508-9155-c90dac61667a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "DELETE /v2.0/ports/cee69311-8acd-4064-a7b4-06c97526b389 HTTP/1.1" status: 204 len: 173 time: 0.6006432 Dec 21 04:05:45.251164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'name': 'network-vif-deleted', 'tag': 'cee69311-8acd-4064-a7b4-06c97526b389'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:45.253480 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4234a6b6-e814-4ecb-b87d-3cb4cc0a02b7" -d '{"events": [{"server_uuid": "6b8ca15e-50cd-4c0c-8410-0dbe80abeb61", "name": "network-vif-deleted", "tag": "cee69311-8acd-4064-a7b4-06c97526b389"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:45.286195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 524a3677-f175-4542-a3c6-7039ad8256ba details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:05:45.309997 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3de10d2d-f659-4667-bb17-aab62a9a74b3 x-openstack-request-id: req-3de10d2d-f659-4667-bb17-aab62a9a74b3 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:45.309997 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b8ca15e-50cd-4c0c-8410-0dbe80abeb61", "name": "network-vif-deleted", "tag": "cee69311-8acd-4064-a7b4-06c97526b389", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:45.309997 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3de10d2d-f659-4667-bb17-aab62a9a74b3 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:45.309997 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b8ca15e-50cd-4c0c-8410-0dbe80abeb61', 'name': 'network-vif-deleted', 'tag': 'cee69311-8acd-4064-a7b4-06c97526b389', 'status': 'completed', 'code': 200} Dec 21 04:05:45.465658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 524a3677-f175-4542-a3c6-7039ad8256ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=524a3677-f175-4542-a3c6-7039ad8256ba,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:45.489492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '524a3677-f175-4542-a3c6-7039ad8256ba', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'port_id': '524a3677-f175-4542-a3c6-7039ad8256ba', 'mac_address': 'fa:16:3e:99:6a:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6eb37b9-316b-4d85-9044-455f8831b074', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:05:45.538667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:45.554176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 524a3677-f175-4542-a3c6-7039ad8256ba {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:05:45.578638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 524a3677-f175-4542-a3c6-7039ad8256ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=524a3677-f175-4542-a3c6-7039ad8256ba,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:45.770617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a262f1c-cecd-4d2e-a13f-7ec9132cb2a7 req-fef19631-7a71-4f25-a271-8d742a791beb tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 210 time: 0.0394874 Dec 21 04:05:46.254616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-858d2702-8af8-406e-b6cd-61a0ca20175e req-4b232deb-952b-4cdf-b28a-c39a3ae69fd3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:46.256407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-858d2702-8af8-406e-b6cd-61a0ca20175e req-4b232deb-952b-4cdf-b28a-c39a3ae69fd3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 943 time: 0.0559578 Dec 21 04:05:46.320501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-858d2702-8af8-406e-b6cd-61a0ca20175e req-cbbfdd70-5ab9-467c-b29d-d9680f0ec7a9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488176 Dec 21 04:05:46.347105 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:46.403994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=524a3677-f175-4542-a3c6-7039ad8256ba,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:46.725928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:46.813208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48272) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:46.850292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2eecfe8b-4920-4f11-aec9-bd6467e93172 req-447f3871-d78d-4424-9b8c-e1b59c8c317a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=6b8ca15e-50cd-4c0c-8410-0dbe80abeb61 HTTP/1.1" status: 200 len: 210 time: 0.0480371 Dec 21 04:05:47.026470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-14ac11cd-ebe2-4564-a39d-694cbeadd9a0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=77bdbb8cf85f439a9e6ec1bf7f2f4843&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2119398 Dec 21 04:05:47.028878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48280) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:47.077276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39de119c-249d-4f2a-8b40-6ac1361cac8c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:47.100127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39de119c-249d-4f2a-8b40-6ac1361cac8c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:47.207438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39de119c-249d-4f2a-8b40-6ac1361cac8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:47.210423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39de119c-249d-4f2a-8b40-6ac1361cac8c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:47.213980 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-39de119c-249d-4f2a-8b40-6ac1361cac8c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f69f4a96-c64d-41a8-9e4e-98e81ffd4f97 HTTP/1.1" status: 204 len: 168 time: 0.1819644 Dec 21 04:05:47.224836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39de119c-249d-4f2a-8b40-6ac1361cac8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f69f4a96-c64d-41a8-9e4e-98e81ffd4f97,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:47.281083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cee69311-8acd-4064-a7b4-06c97526b389 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:47.303814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: cee69311-8acd-4064-a7b4-06c97526b389 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:47.304035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cee69311-8acd-4064-a7b4-06c97526b389 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:47.454125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79881dc5-ea90-44f0-8c0c-1a034bb7f207 req-ecd643ee-85dd-459a-be80-7afd659d84b5 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:47.455824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79881dc5-ea90-44f0-8c0c-1a034bb7f207 req-ecd643ee-85dd-459a-be80-7afd659d84b5 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 944 time: 0.0610497 Dec 21 04:05:47.506413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79881dc5-ea90-44f0-8c0c-1a034bb7f207 req-fb1a4b3b-7ffb-424d-8641-c184fc0097ba tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446045 Dec 21 04:05:48.452588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c77e48-cbcb-4e00-929e-263afb411132 req-f10ee558-eba5-4ba0-b587-9d9eaa3b16dd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:48.459869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c77e48-cbcb-4e00-929e-263afb411132 req-f10ee558-eba5-4ba0-b587-9d9eaa3b16dd tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.0603659 Dec 21 04:05:48.510232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c77e48-cbcb-4e00-929e-263afb411132 req-a563d02e-2cf8-4654-86ed-c965e9ab9f5a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493796 Dec 21 04:05:48.683185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-68e028be-e3b4-4324-bc5c-210f814d451b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0909379 Dec 21 04:05:48.701846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7a1be4-598c-4f4b-921c-95b147f134a0 req-297b0b9f-144e-4fe7-aeda-11104e4c84f9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:48.701846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee7a1be4-598c-4f4b-921c-95b147f134a0 req-297b0b9f-144e-4fe7-aeda-11104e4c84f9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 944 time: 0.0980263 Dec 21 04:05:48.784373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee7a1be4-598c-4f4b-921c-95b147f134a0 req-97908916-c987-47e4-b3d3-7c34a45ca9b2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773425 Dec 21 04:05:48.797937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-52152de2-071f-4fc6-89de-6c8a885d13eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:48.799706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-52152de2-071f-4fc6-89de-6c8a885d13eb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1097 time: 0.0619123 Dec 21 04:05:48.959836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-651b3467-2414-4eb3-88ea-329192680ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:48.959836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-651b3467-2414-4eb3-88ea-329192680ecf service neutron] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 912 time: 0.1275666 Dec 21 04:05:49.041300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-0e736d35-e9c9-4917-aae6-dcbd5dd61d53 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 200 len: 1001 time: 0.0748324 Dec 21 04:05:49.106789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-fc6c290f-3211-4aae-9b3d-157a4e41515f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:49.108927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-fc6c290f-3211-4aae-9b3d-157a4e41515f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.0636382 Dec 21 04:05:49.175399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-6a40c97a-5f33-42d5-98bb-2faa2e48d4e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:49.177053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-6a40c97a-5f33-42d5-98bb-2faa2e48d4e9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0583780 Dec 21 04:05:49.298301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 524a3677-f175-4542-a3c6-7039ad8256ba up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:05:49.308257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-20a5777a-6c8a-438c-b6c2-571393605065 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1223869 Dec 21 04:05:49.427209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 524a3677-f175-4542-a3c6-7039ad8256ba completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:05:49.431402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 524a3677-f175-4542-a3c6-7039ad8256ba triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:49.431967 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:49.449173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f59794-1c7b-4b83-8518-653dc9e3665b req-ffbafe79-6571-4c7c-bd3d-a2341b5064dd service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1326349 Dec 21 04:05:49.531930 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:49.625206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 524a3677-f175-4542-a3c6-7039ad8256ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=524a3677-f175-4542-a3c6-7039ad8256ba,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:49.630150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6dfba92b-f125-4060-8fa6-204454367110', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '524a3677-f175-4542-a3c6-7039ad8256ba'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:49.636668 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fc0ee89-e206-4e79-9aa4-6c54db246fbe" -d '{"events": [{"server_uuid": "6dfba92b-f125-4060-8fa6-204454367110", "name": "network-vif-plugged", "status": "completed", "tag": "524a3677-f175-4542-a3c6-7039ad8256ba"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:49.702758 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e5fbe4c4-6242-40ec-a336-ae0c56c35248 x-openstack-request-id: req-e5fbe4c4-6242-40ec-a336-ae0c56c35248 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:49.703149 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6dfba92b-f125-4060-8fa6-204454367110", "name": "network-vif-plugged", "status": "completed", "tag": "524a3677-f175-4542-a3c6-7039ad8256ba", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:49.703395 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e5fbe4c4-6242-40ec-a336-ae0c56c35248 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:49.703793 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6dfba92b-f125-4060-8fa6-204454367110', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '524a3677-f175-4542-a3c6-7039ad8256ba', 'code': 200} Dec 21 04:05:49.718214 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:49.744177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-843880cf-5055-460b-b8eb-9df628431680 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:49.747042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-843880cf-5055-460b-b8eb-9df628431680 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1322024 Dec 21 04:05:49.757757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506b9bf5-e203-42fc-992d-b40fa4dfb459 req-f5aad7b0-91c3-4084-8c6a-87ac849fda73 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:49.765519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-506b9bf5-e203-42fc-992d-b40fa4dfb459 req-f5aad7b0-91c3-4084-8c6a-87ac849fda73 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 945 time: 0.1619284 Dec 21 04:05:49.805752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=524a3677-f175-4542-a3c6-7039ad8256ba,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:49.822402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.823285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.823803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.824486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.825391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.826222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.826722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.827299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.827798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.828544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.829020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.829513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.829999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:49.859123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-506b9bf5-e203-42fc-992d-b40fa4dfb459 req-1b5cc56a-aa35-499e-a8a5-f8de7d23b372 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=18f408dc-942e-4fe3-add4-37566364635e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877042 Dec 21 04:05:49.872660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6cb45d9c-e2c2-459f-8b85-59c38fc2f969 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:49.904743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae63b7d7-c558-4bad-babe-21d21ca32c30 req-cc312e0a-ad82-4e6f-86b7-27a2efc0ddf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:49.906288 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ae63b7d7-c558-4bad-babe-21d21ca32c30 req-cc312e0a-ad82-4e6f-86b7-27a2efc0ddf1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 1097 time: 0.1142659 Dec 21 04:05:49.985219 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ae63b7d7-c558-4bad-babe-21d21ca32c30 req-6787f107-9c99-4ea6-bd5a-e64e66cccdf2 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708535 Dec 21 04:05:49.988492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Deleting port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:49.999049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:50.086718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af170540-32a7-461a-9e7f-bb69a38f9c15 req-6bd5ff1e-1786-40d0-8a00-f38991e6a42a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:50.089201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af170540-32a7-461a-9e7f-bb69a38f9c15 req-6bd5ff1e-1786-40d0-8a00-f38991e6a42a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 945 time: 0.1530812 Dec 21 04:05:50.168790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] For port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:50.169156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:50.175100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af170540-32a7-461a-9e7f-bb69a38f9c15 req-e1561d1e-f7ca-4482-ad6d-5d6002e4c723 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699947 Dec 21 04:05:50.187515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Calling delete_port for 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:50.391331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:50.425600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5f182293-8d1b-4f6b-8248-4b78e1bf55c3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:05:50.434010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'Port': ['ID=5f182293-8d1b-4f6b-8248-4b78e1bf55c3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:50.501074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] No DVR routers for this DVR port 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:50.504022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:50.508284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18dffa3a-9648-40d8-a5ac-7a04449afecd req-622c09ba-7ae5-4046-9a5b-727525aeca51 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.54 "DELETE /v2.0/ports/5f182293-8d1b-4f6b-8248-4b78e1bf55c3 HTTP/1.1" status: 204 len: 173 time: 0.7400773 Dec 21 04:05:50.508969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'name': 'network-vif-deleted', 'tag': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:50.519181 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e22f3bb-6a44-4290-8202-8f8f73f09620" -d '{"events": [{"server_uuid": "314db627-a3fc-4d84-ae0e-a2b0ebb8aecb", "name": "network-vif-deleted", "tag": "5f182293-8d1b-4f6b-8248-4b78e1bf55c3"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:50.568557 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-513375a7-da0c-476d-a99d-aadf8261233c x-openstack-request-id: req-513375a7-da0c-476d-a99d-aadf8261233c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:50.568978 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "314db627-a3fc-4d84-ae0e-a2b0ebb8aecb", "name": "network-vif-deleted", "tag": "5f182293-8d1b-4f6b-8248-4b78e1bf55c3", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:50.569333 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-513375a7-da0c-476d-a99d-aadf8261233c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:50.569844 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '314db627-a3fc-4d84-ae0e-a2b0ebb8aecb', 'name': 'network-vif-deleted', 'tag': '5f182293-8d1b-4f6b-8248-4b78e1bf55c3', 'status': 'completed', 'code': 200} Dec 21 04:05:50.847423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48376) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:50.854003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'network': {'name': 'tempest-network-smoke--637339270', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'port_security_enabled': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:50.944260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Made reservation on behalf of e4be3566d3c34a19a30558795061b823 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:50.947824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:50.972978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.003362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29847ec7-b239-4fa8-a313-e26a335c3cb3 req-ba10b49a-b074-4af5-88ff-c489322d6942 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=314db627-a3fc-4d84-ae0e-a2b0ebb8aecb HTTP/1.1" status: 200 len: 210 time: 0.0473897 Dec 21 04:05:51.086555 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.175193 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.210642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:05:51.222269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.222852 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Added segment 3776c03c-8264-4376-8d05-0d4023c31e08 of type vlan for network 7676bcbc-538f-4f82-a6a5-13d33001856e Dec 21 04:05:51.292379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.316891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'SecurityGroup': ['ID=942ba84a-722f-4040-9c6c-19f85c3224ea,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:51.395055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0ddb763-cd7f-47e1-82c5-565ff958ee78 req-e98c1a43-0204-441e-a324-ad2ae000bf67 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:51.396970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0ddb763-cd7f-47e1-82c5-565ff958ee78 req-e98c1a43-0204-441e-a324-ad2ae000bf67 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 945 time: 0.0945792 Dec 21 04:05:51.448298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.454035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:51.454610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.511900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0ddb763-cd7f-47e1-82c5-565ff958ee78 req-fee9a3b7-d64b-4333-8d3a-61d10445ceff tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075692 Dec 21 04:05:51.572406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Network': ['ID=7676bcbc-538f-4f82-a6a5-13d33001856e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:51.584539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7676bcbc-538f-4f82-a6a5-13d33001856e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:05:51.624469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38f65379-2565-4dd8-99c8-af779bf7e31a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7749884 Dec 21 04:05:51.627843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48386) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:51.631919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'router': {'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'admin_state_up': True, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:51.802288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.803683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:51.860367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.109958 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.160478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48394) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:52.262337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b06546b6-5c00-46e0-89e1-4ef3e6435ec5 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:52.262912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b06546b6-5c00-46e0-89e1-4ef3e6435ec5 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:52.263697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b06546b6-5c00-46e0-89e1-4ef3e6435ec5 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:52.273957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b06546b6-5c00-46e0-89e1-4ef3e6435ec5 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/ports?project_id=ec158f7f7c994dacb4d1785b3b8f2ff1&network_id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 2972 time: 0.1036437 Dec 21 04:05:52.435680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.455229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.579395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.25.5.228 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/55d16698-d3ae-409d-8947-9f93799670dd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:52.682044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-476c597d-0fa0-41b3-ade9-3f74cf1c8b96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.744915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.770231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d9f91f-d591-4bdb-abd9-0368820dbac1 req-0187ce3a-b3da-491f-b6dc-83a8089d06e3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:52.771832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34d9f91f-d591-4bdb-abd9-0368820dbac1 req-0187ce3a-b3da-491f-b6dc-83a8089d06e3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 945 time: 0.1457481 Dec 21 04:05:52.803222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc67c99-c9f0-4775-9040-abf0cada1156 req-e2f67ba2-1b84-4c62-9d0c-2f1081022f76 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:52.804725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dc67c99-c9f0-4775-9040-abf0cada1156 req-e2f67ba2-1b84-4c62-9d0c-2f1081022f76 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1118562 Dec 21 04:05:52.807732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:52.896959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34d9f91f-d591-4bdb-abd9-0368820dbac1 req-b92209e0-f72a-4c63-b441-35b652ae3913 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1166992 Dec 21 04:05:52.904036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dc67c99-c9f0-4775-9040-abf0cada1156 req-3edd7212-ed6f-4af9-a761-a8784cd30b52 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0882449 Dec 21 04:05:52.998868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:53.043384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:53.046445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:53.050146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:53.066488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ad71f38-3e37-4191-bf52-c0c4dffeb2b5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:05:53.082613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=55d16698-d3ae-409d-8947-9f93799670dd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:53.106250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ee691489-2d23-49b7-8953-6277f32435df None None] Provisioning complete for port 55d16698-d3ae-409d-8947-9f93799670dd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:53.107461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee691489-2d23-49b7-8953-6277f32435df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:53.142049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ee691489-2d23-49b7-8953-6277f32435df None None] Port 55d16698-d3ae-409d-8947-9f93799670dd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:05:53.289558 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:53.331545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:53.359799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:53.359799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5f182293-8d1b-4f6b-8248-4b78e1bf55c3 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:53.422775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:53.965338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:54.121919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462240bb-d913-4ee8-8320-22d5abaaebc7 req-52eadc48-b212-4331-879f-ef22fc670d76 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:54.123460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-462240bb-d913-4ee8-8320-22d5abaaebc7 req-52eadc48-b212-4331-879f-ef22fc670d76 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1201222 Dec 21 04:05:54.201221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c39c7f-9940-4836-8715-e627a7b5f5f0 req-199242ec-a6b3-4552-a960-aba5eb828d4f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:54.202568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01c39c7f-9940-4836-8715-e627a7b5f5f0 req-199242ec-a6b3-4552-a960-aba5eb828d4f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1226833 Dec 21 04:05:54.211314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-462240bb-d913-4ee8-8320-22d5abaaebc7 req-0c50eca8-885c-4023-91b6-ca8da5c9ab84 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0782456 Dec 21 04:05:54.274186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01c39c7f-9940-4836-8715-e627a7b5f5f0 req-f654d9ab-e36d-4a0e-9e22-eeb03dfc17dd tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596864 Dec 21 04:05:54.447100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 028fa46c-cc11-488f-bfda-28719307241e is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:05:54.557809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:05:54.568618 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Sync routers for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:05:54.589687 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:05:54.590288 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:54.689246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:54.690734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c3cebb2-1292-4520-a69d-31f679c6f0b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 893 time: 3.0628176 Dec 21 04:05:54.694044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48430) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:54.787835 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:05:54.848841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-83bfa386-874f-486b-bb5b-e056f5c8cd28 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=e4be3566d3c34a19a30558795061b823&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1535251 Dec 21 04:05:54.851806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:54.878980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5069b6af-eb67-4702-9934-15901c205c69 req-b594159f-77f6-48c4-a7fc-53cfae9dab20 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:54.881272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5069b6af-eb67-4702-9934-15901c205c69 req-b594159f-77f6-48c4-a7fc-53cfae9dab20 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1063578 Dec 21 04:05:55.002853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.013119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faaac24a-88e3-4278-b655-2173f55fd297 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:55.013119 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-faaac24a-88e3-4278-b655-2173f55fd297 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1555948 Dec 21 04:05:55.013477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:55.036585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Deleting port 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:05:55.037357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.049538 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:53Z', 'revision_number': 3, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:55.078867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ad922745-35c5-444f-afd6-0a0bd6be51d1 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0641685 Dec 21 04:05:55.079492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48442) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:55.084504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-834943529', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:55.090223 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Checking router: 028fa46c-cc11-488f-bfda-28719307241e for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:05:55.090710 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Updating router 028fa46c-cc11-488f-bfda-28719307241e port 55d16698-d3ae-409d-8947-9f93799670dd binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:05:55.098591 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.117890 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.143571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] For port 643a3827-c0d5-4377-893a-3bf71f16b0e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=643a3827-c0d5-4377-893a-3bf71f16b0e8,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:55.143941 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.284715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Made reservation on behalf of e4be3566d3c34a19a30558795061b823 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:55.290628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.405259 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.457661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.458024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.458344 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Floating IP e9728672-8e1f-4f6b-a0de-8b72ea22ced5 disassociated. External IP: 172.25.5.220, port: 643a3827-c0d5-4377-893a-3bf71f16b0e8. Dec 21 04:05:55.458691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Calling delete_port for 643a3827-c0d5-4377-893a-3bf71f16b0e8 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:05:55.473089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4417fbe-6104-440d-b5ef-a139f731b108 req-3f3141fc-f894-4e33-9140-d2f45f73e580 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:55.474596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4417fbe-6104-440d-b5ef-a139f731b108 req-3f3141fc-f894-4e33-9140-d2f45f73e580 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 944 time: 0.1604064 Dec 21 04:05:55.487249 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.492763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5533e81e-9325-4a15-9c1a-4f8bd0388242 req-bc2981a1-810a-4e01-b45c-181b46d1121c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:55.501448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5533e81e-9325-4a15-9c1a-4f8bd0388242 req-bc2981a1-810a-4e01-b45c-181b46d1121c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1081207 Dec 21 04:05:55.530899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0162259-d717-4e06-81bb-3c1463240c96 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:05:55.537768 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Attempting to bind port 55d16698-d3ae-409d-8947-9f93799670dd on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:05:55.538148 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Attempting to bind port 55d16698-d3ae-409d-8947-9f93799670dd by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:05:55.538510 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Attempting to bind port 55d16698-d3ae-409d-8947-9f93799670dd on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:55.547640 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:05:55.548021 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:55.548424 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.548888 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:05:55.549746 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Bound port: 55d16698-d3ae-409d-8947-9f93799670dd, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:05:55.550104 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.575515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3a6a30ff-7ca4-4c58-9050-05b71f4ee2b5 None None] Provisioning complete for port 55d16698-d3ae-409d-8947-9f93799670dd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:55.576141 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3a6a30ff-7ca4-4c58-9050-05b71f4ee2b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.579318 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Pushing event updated for resources: {'Port': ['ID=55d16698-d3ae-409d-8947-9f93799670dd,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:55.581717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.595797 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.596937 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.596937 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.598109 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.599191 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.599698 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.600694 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.601205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.602260 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.602795 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.603338 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.603971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.604464 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:05:55.638856 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] For port 55d16698-d3ae-409d-8947-9f93799670dd, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:05:55.642452 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] For port 55d16698-d3ae-409d-8947-9f93799670dd, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=55d16698-d3ae-409d-8947-9f93799670dd,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:05:55.645440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5533e81e-9325-4a15-9c1a-4f8bd0388242 req-dc9f486c-ad90-4846-8232-deff4ac5f87a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1427982 Dec 21 04:05:55.653097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4417fbe-6104-440d-b5ef-a139f731b108 req-c6f93d2b-447a-4d0b-a24c-61595252180e tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups?id=b06ebcf5-fc98-400f-8125-465d9153af92&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1704764 Dec 21 04:05:55.667254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3a6a30ff-7ca4-4c58-9050-05b71f4ee2b5 None None] Port 55d16698-d3ae-409d-8947-9f93799670dd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:05:55.707441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Subnet': ['ID=51cbe5f4-3d45-4b4f-a219-d8b88c9871e3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:55.716908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Checking segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:55.717271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network hostable DHCP agents. Network: 7676bcbc-538f-4f82-a6a5-13d33001856e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:05:55.735963 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.763386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.782151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-517bb1b9-b999-4b65-8d21-7481498dae62 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:05:55.795463 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:05:55.796142 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:55.800800 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6541b026-7b22-4c91-9957-147b9e55eef8 None None] Pushing event updated for resources: {'Port': ['ID=55d16698-d3ae-409d-8947-9f93799670dd,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:55.836530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 7676bcbc-538f-4f82-a6a5-13d33001856e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:05:55.856408 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:05:55.865024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.897779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'Port': ['ID=643a3827-c0d5-4377-893a-3bf71f16b0e8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:55.917280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f91f26df-14b3-4927-be5a-42bfea248344 None None] Provisioning complete for port 55d16698-d3ae-409d-8947-9f93799670dd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:55.917280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f91f26df-14b3-4927-be5a-42bfea248344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.943496 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:05:55.947478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7676bcbc-538f-4f82-a6a5-13d33001856e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:55.958021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:55.958623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:55.976094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f87ba0dc-8059-44d2-9b6d-75b27cbd4ce4 None None] Network 7676bcbc-538f-4f82-a6a5-13d33001856e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:05:56.064370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c3c9d9e-2133-427f-a787-4c8af1abd45b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.9836800 Dec 21 04:05:56.065288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:56.112803 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f91f26df-14b3-4927-be5a-42bfea248344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:56.157169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-7676bcbc-538f-4f82-a6a5-13d33001856e', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:05:56.159098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:56.162039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Router a1333542-4121-47e8-a7de-92405f045a9e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:05:56.166514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f91f26df-14b3-4927-be5a-42bfea248344 None None] For port 55d16698-d3ae-409d-8947-9f93799670dd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=55d16698-d3ae-409d-8947-9f93799670dd,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:56.277000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:53Z', 'revision_number': 3, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:56.312721 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99602956-9985-4413-b0ef-a6b6c9c66737 None None] The sync data for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 is: [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:53Z', 'revision_number': 3, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:05:56.316830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Allocated IP 172.20.0.2 (7676bcbc-538f-4f82-a6a5-13d33001856e/51cbe5f4-3d45-4b4f-a219-d8b88c9871e3/bac0af49-cb96-4448-b384-2a8a3f169ef5) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:56.322977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f91f26df-14b3-4927-be5a-42bfea248344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:56.382302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48464) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:56.416587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f91f26df-14b3-4927-be5a-42bfea248344 None None] Pushing event updated for resources: {'Port': ['ID=55d16698-d3ae-409d-8947-9f93799670dd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:56.430760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:05:56.466143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] Sync routers for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:05:56.485203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] No DVR routers for this DVR port 643a3827-c0d5-4377-893a-3bf71f16b0e8 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:05:56.490441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:56.495649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5069b6af-eb67-4702-9934-15901c205c69 req-a9a41c50-5026-4076-923c-878e801e4103 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.31 "DELETE /v2.0/ports/643a3827-c0d5-4377-893a-3bf71f16b0e8 HTTP/1.1" status: 204 len: 173 time: 1.6079211 Dec 21 04:05:56.496163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:05:56.496513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-deleted', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:05:56.496864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:56.499220 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e57671b4-f998-45ba-836e-e53a6bc203f8" -d '{"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-deleted", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:05:56.506830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-354e331e-048e-4472-a9c6-6dd320344eb6 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:56.509313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-354e331e-048e-4472-a9c6-6dd320344eb6 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 814 time: 0.1253388 Dec 21 04:05:56.580110 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:05:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2f9a638-6595-4944-bcd6-fc4038340e35 x-openstack-request-id: req-e2f9a638-6595-4944-bcd6-fc4038340e35 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:05:56.580501 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "310d006f-a51c-4bee-adac-4f0f1281690e", "name": "network-vif-deleted", "tag": "643a3827-c0d5-4377-893a-3bf71f16b0e8", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:05:56.580834 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e2f9a638-6595-4944-bcd6-fc4038340e35 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:05:56.581319 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '310d006f-a51c-4bee-adac-4f0f1281690e', 'name': 'network-vif-deleted', 'tag': '643a3827-c0d5-4377-893a-3bf71f16b0e8', 'status': 'completed', 'code': 200} Dec 21 04:05:56.850906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8f756d-4373-41e7-b3df-c750ad7dc741 req-c9c18aac-3fb4-43cc-b5e8-d38fbb3a43f8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:56.853335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae8f756d-4373-41e7-b3df-c750ad7dc741 req-c9c18aac-3fb4-43cc-b5e8-d38fbb3a43f8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0876601 Dec 21 04:05:56.968032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:56.987143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae8f756d-4373-41e7-b3df-c750ad7dc741 req-0863e6d5-1bb2-4672-909e-f35e5d94b661 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1143878 Dec 21 04:05:57.015591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:05:57.125903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 55d16698-d3ae-409d-8947-9f93799670dd up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:05:57.154053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5452b59-acb9-440d-8c28-78961446ec1c req-264f4764-048e-4177-8fa2-61e4700d827a tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.0319967 Dec 21 04:05:57.157821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.286602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.295163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Network 7676bcbc-538f-4f82-a6a5-13d33001856e is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:57.310973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:57.313868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:57.323473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Pushing event updated for resources: {'Port': ['ID=bac0af49-cb96-4448-b384-2a8a3f169ef5,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:57.446311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 55d16698-d3ae-409d-8947-9f93799670dd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:57.446891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.449059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Attempting to bind port bac0af49-cb96-4448-b384-2a8a3f169ef5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:05:57.449603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Attempting to bind port bac0af49-cb96-4448-b384-2a8a3f169ef5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:05:57.450314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Attempting to bind port bac0af49-cb96-4448-b384-2a8a3f169ef5 on network 7676bcbc-538f-4f82-a6a5-13d33001856e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:05:57.468335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48482) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:57.476570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'network': {'name': 'tempest-network-smoke--872080429', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'port_security_enabled': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:57.489322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:05:57.489707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Checking segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:57.490116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.490518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Bound using segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:05:57.491032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Bound port: bac0af49-cb96-4448-b384-2a8a3f169ef5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:05:57.491421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.589215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] For port bac0af49-cb96-4448-b384-2a8a3f169ef5, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:05:57.593416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] For port bac0af49-cb96-4448-b384-2a8a3f169ef5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bac0af49-cb96-4448-b384-2a8a3f169ef5,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:05:57.631570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:18Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:57.638031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:57.641731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.664703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] Checking router: a1333542-4121-47e8-a7de-92405f045a9e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:05:57.676005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:05:57.709245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 643a3827-c0d5-4377-893a-3bf71f16b0e8 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:05:57.715435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 643a3827-c0d5-4377-893a-3bf71f16b0e8 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:05:57.715435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.719814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:05:57.720764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:57.723360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:05:57.747257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.749827 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Added segment dbf60732-7b9f-43e5-a156-27425418435d of type vlan for network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 Dec 21 04:05:57.828853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.902146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57936cc6-6900-443f-bac9-4712c1bb5797 None None] Pushing event updated for resources: {'Port': ['ID=bac0af49-cb96-4448-b384-2a8a3f169ef5,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:57.902363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.20.0.1 (7676bcbc-538f-4f82-a6a5-13d33001856e/51cbe5f4-3d45-4b4f-a219-d8b88c9871e3/fa5c3dd5-c437-4b36-b4ac-26355e71eb85) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:05:57.941361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:05:57.992293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:57.998372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:57.999225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:58.082630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:58.173882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7013416 Dec 21 04:05:58.174244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.241688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca5c2e8b-b1cd-4f8c-869f-6519b28b8dc7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Network': ['ID=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:58.259640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:05:58.306373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f67fe3-1de7-49e9-8466-8897f429eeba req-c9fce41a-6762-45eb-a5f1-ddb92b075b60 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:58.318434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26f67fe3-1de7-49e9-8466-8897f429eeba req-c9fce41a-6762-45eb-a5f1-ddb92b075b60 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1363778 Dec 21 04:05:58.359761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07c89300-e82a-4b10-b68e-790f356b6f9e tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:58.361429 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-07c89300-e82a-4b10-b68e-790f356b6f9e tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=ec158f7f7c994dacb4d1785b3b8f2ff1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.1853065 Dec 21 04:05:58.365454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48494) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.400253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b338a770-da76-4443-a087-f9eba194ab6e req-44071c61-b470-4bce-87f8-16712511c010 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/ports?device_id=310d006f-a51c-4bee-adac-4f0f1281690e HTTP/1.1" status: 200 len: 210 time: 0.1069677 Dec 21 04:05:58.442216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26f67fe3-1de7-49e9-8466-8897f429eeba req-be71a3da-7a9b-436d-b81c-ea7967cb297b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1143303 Dec 21 04:05:58.529718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:18Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:05:58.553362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-548c0379-46f8-4318-b018-d5ff3c6a8563 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:58.556779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-548c0379-46f8-4318-b018-d5ff3c6a8563 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1892076 Dec 21 04:05:58.559589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2dccb7b-d382-439e-a77b-f2bee66f796b None None] The sync data for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 is: [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9e4008ef-0c0f-40b4-99d7-d2e320a16713', 'name': '', 'network_id': 'adb6972f-1a1d-4ca4-855c-5e5faf88030a', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'mac_address': 'fa:16:3e:a7:3e:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1503, 'fixed_ips': [{'subnet_id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:11Z', 'updated_at': '2021-12-21T03:57:18Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'subnets': [{'id': '5101716e-6720-4ed1-b6cc-a5ad262b61c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:05:58.565012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48496) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.599463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-48c6738c-5d74-4285-a782-787e2aa41f90 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0332618 Dec 21 04:05:58.602470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.607026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:58.654635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-51fb9d7d-b93f-4d8e-b6cd-df9a528e9d9d tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=ec158f7f7c994dacb4d1785b3b8f2ff1&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0483201 Dec 21 04:05:58.855411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48500) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.856282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 7676bcbc-538f-4f82-a6a5-13d33001856e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:05:58.856282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:05:58.856282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:05:58.856282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:58.856282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:58.865550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-749603af-0f10-4583-b8b2-2fba665dc602 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:58.869929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-749603af-0f10-4583-b8b2-2fba665dc602 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2081683 Dec 21 04:05:58.871043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48504) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.914598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8c98edc-bc2c-4cd8-a7b3-283981b57172 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0420008 Dec 21 04:05:58.918007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48506) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:58.922989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1806967771', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:05:59.024292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bac0af49-cb96-4448-b384-2a8a3f169ef5 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:05:59.133100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.144263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bac0af49-cb96-4448-b384-2a8a3f169ef5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:59.144655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.198028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:05:59.201864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.296438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.318013 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18be3140-b58f-4163-9490-deec16cf826e None None] New status for floating IP e9728672-8e1f-4f6b-a0de-8b72ea22ced5: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:05:59.391423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port bac0af49-cb96-4448-b384-2a8a3f169ef5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bac0af49-cb96-4448-b384-2a8a3f169ef5,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:05:59.522445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.577950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b553e6e5-6c87-4846-a93f-2e37ee0cee64 None None] Network 7676bcbc-538f-4f82-a6a5-13d33001856e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:05:59.636166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.641237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=bac0af49-cb96-4448-b384-2a8a3f169ef5,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:59.661207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.672619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5de8919a-827c-4547-890e-d868439de86e None None] Provisioning complete for port bac0af49-cb96-4448-b384-2a8a3f169ef5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:05:59.673140 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5de8919a-827c-4547-890e-d868439de86e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.730284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69e2567-1e4a-4620-be5e-03a74d4ed22a req-84c50ab4-8945-4cef-8a77-b524aeb8b17a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:05:59.732165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b69e2567-1e4a-4620-be5e-03a74d4ed22a req-84c50ab4-8945-4cef-8a77-b524aeb8b17a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1447086 Dec 21 04:05:59.735121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Subnet': ['ID=75097d59-9114-4d6a-ab49-443c57e1f8de,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:05:59.740289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48516) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:05:59.861940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Checking segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:05:59.862650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network hostable DHCP agents. Network: aa9d5090-f8cc-472f-a4a3-d525f12a8bf8, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:05:59.870966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-062ab69b-8829-400c-a070-e721752a158b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.891476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b69e2567-1e4a-4620-be5e-03a74d4ed22a req-f5c62727-f2bd-4725-83dd-661dd92d74de tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1376989 Dec 21 04:05:59.902058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-062ab69b-8829-400c-a070-e721752a158b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.911509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:05:59.998018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:06:00.005841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.018487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:00.136539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 7676bcbc-538f-4f82-a6a5-13d33001856e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:00.138414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:00.141816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, aa9d5090-f8cc-472f-a4a3-d525f12a8bf8) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:00.148582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:00.148582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.166575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7564caa-fd92-4f8a-afe8-51ea084f7305 None None] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:06:00.207866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-062ab69b-8829-400c-a070-e721752a158b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.211588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-062ab69b-8829-400c-a070-e721752a158b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.212816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-062ab69b-8829-400c-a070-e721752a158b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "DELETE /v2.0/security-groups/b06ebcf5-fc98-400f-8125-465d9153af92 HTTP/1.1" status: 204 len: 168 time: 0.4698417 Dec 21 04:06:00.216125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48520) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:00.228729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062ab69b-8829-400c-a070-e721752a158b tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b06ebcf5-fc98-400f-8125-465d9153af92,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:00.247672 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-6279d064-f0b0-4ded-8c0e-3e5e07939931 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] show failed (client error): The resource could not be found. Dec 21 04:06:00.248738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6279d064-f0b0-4ded-8c0e-3e5e07939931 tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "GET /v2.0/security-groups/b06ebcf5-fc98-400f-8125-465d9153af92 HTTP/1.1" status: 404 len: 347 time: 0.0311739 Dec 21 04:06:00.252725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bb440468-8b2e-4628-bed3-d6845fd73475 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.3335581 Dec 21 04:06:00.253122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48522) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:00.286302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2745f77b-b79b-4e38-887e-ed2347a013a1 None None] Provisioning complete for port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:00.289523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2745f77b-b79b-4e38-887e-ed2347a013a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.396600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 028fa46c-cc11-488f-bfda-28719307241e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:06:00.522422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Deleting port b1ce5786-70bc-484f-ab8b-ab5d344a7ecf {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:00.523795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.574768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:06:00.580176 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a20dcd42-fbc1-49eb-8a98-b208ced24ab3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "PUT /v2.0/routers/028fa46c-cc11-488f-bfda-28719307241e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5137286 Dec 21 04:06:00.582849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48528) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:00.588296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'security_group': {'name': 'tempest-secgroup_access--558467074', 'description': 'tempest-secgroup_access--558467074 description', 'project_id': 'e4be3566d3c34a19a30558795061b823'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:00.662399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Sync routers for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:06:00.689883 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.690861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.702293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2745f77b-b79b-4e38-887e-ed2347a013a1 None None] Port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:06:00.713204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:00.713204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:00.713415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Calling delete_port for b1ce5786-70bc-484f-ab8b-ab5d344a7ecf owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:00.713525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ips': [{'subnet_id': '75097d59-9114-4d6a-ab49-443c57e1f8de'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:06:00.713525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.789891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.793408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2745f77b-b79b-4e38-887e-ed2347a013a1 None None] Provisioning complete for port bac0af49-cb96-4448-b384-2a8a3f169ef5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:00.808188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2745f77b-b79b-4e38-887e-ed2347a013a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:00.908368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:00.991052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48534) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:00.997525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1847379184', 'description': 'tempest-secgroup-smoke-1847379184 description', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:01.023688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.068079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bac0af49-cb96-4448-b384-2a8a3f169ef5 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:01.074041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42aeebe6-3e3d-434b-bb35-5eceb1338ce7 req-ed3028c7-a00b-47fb-897a-b9154d176a8b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:01.075439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42aeebe6-3e3d-434b-bb35-5eceb1338ce7 req-ed3028c7-a00b-47fb-897a-b9154d176a8b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0631802 Dec 21 04:06:01.124392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.139677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.186662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'SecurityGroup': ['ID=07b6c0f7-21be-49f9-9bcd-5f474bdb8030,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:01.189046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42aeebe6-3e3d-434b-bb35-5eceb1338ce7 req-b962ea2f-b3e4-4e96-b913-51d65964a8a6 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1032372 Dec 21 04:06:01.192554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Pushing event deleted for resources: {'Port': ['ID=b1ce5786-70bc-484f-ab8b-ab5d344a7ecf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:01.202376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.246241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.256110 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-df178648-564b-4552-9c46-38fe36cbdfcc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1815 time: 0.6717691 Dec 21 04:06:01.261594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48536) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:01.268348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'security_group': {'name': 'tempest-secgroup_general--1967264497', 'description': 'tempest-secgroup_general--1967264497 description', 'project_id': 'e4be3566d3c34a19a30558795061b823'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:01.346208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Allocated IP 172.20.0.18 (aa9d5090-f8cc-472f-a4a3-d525f12a8bf8/75097d59-9114-4d6a-ab49-443c57e1f8de/8a1e87ec-8827-4f1f-824a-c9ba50238f2e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:01.375198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bac0af49-cb96-4448-b384-2a8a3f169ef5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:01.375575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.404008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.540241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d8c3f99c-e213-40d7-b1bd-e7f566931bf7 None None] Provisioning complete for port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:01.540618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8c3f99c-e213-40d7-b1bd-e7f566931bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.571225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.636509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.705289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d8c3f99c-e213-40d7-b1bd-e7f566931bf7 None None] Port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:06:01.721755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6287e2c2-d00e-49cd-8bf8-6465cee94f44,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:01.776891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:05:59Z', 'revision_number': 2, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:01.816531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.819630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Checking router: 028fa46c-cc11-488f-bfda-28719307241e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:06:01.820611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Updating router 028fa46c-cc11-488f-bfda-28719307241e port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:06:01.821705 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7a1efc7-1b96-4456-a849-76954ef6b206 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1819 time: 0.5576344 Dec 21 04:06:01.823307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.825058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48540) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:01.829433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.832010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.835017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-274751ad-b665-4ffa-b7e8-118202f943cc tempest-ServerActionsTestJSON-107001673 tempest-ServerActionsTestJSON-107001673-project] 10.222.0.18 "DELETE /v2.0/floatingips/e9728672-8e1f-4f6b-a0de-8b72ea22ced5 HTTP/1.1" status: 204 len: 168 time: 1.5791628 Dec 21 04:06:01.835143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'security_group_rule': {'security_group_id': '07b6c0f7-21be-49f9-9bcd-5f474bdb8030', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:01.839104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48542) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:01.896847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.902647 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.940343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.978622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:01.987893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.032322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:02.045044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:02.101817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.122736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:02.178205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:02.185210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Pushing event updated for resources: {'Port': ['ID=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:02.187536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.190209 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.194536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a79ee86d-a1b9-499e-a49b-639cc6cc021e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 1.1988518 Dec 21 04:06:02.197617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48548) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:02.203118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:02.207624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=30bf4d5a-d34e-4ee6-af7a-1f4601b27ff3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:02.301331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.303358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b5beee3-0525-4082-8cbe-2c124c98d5dc tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4775341 Dec 21 04:06:02.362873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Attempting to bind port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:02.367765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Attempting to bind port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:02.368144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Attempting to bind port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e on network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:02.378916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:02.379549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Checking segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:02.380107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.380954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Bound using segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:02.381680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Bound port: 8a1e87ec-8827-4f1f-824a-c9ba50238f2e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:02.382323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.451203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.530678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] For port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:02.542487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] For port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:02.544732 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.551935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae0837d-a6c8-4439-883d-ba6ee529f38c req-7882bbba-ddde-4009-a950-c69d18a70c89 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:02.553491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ae0837d-a6c8-4439-883d-ba6ee529f38c req-7882bbba-ddde-4009-a950-c69d18a70c89 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1530025 Dec 21 04:06:02.625276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.634760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-aeb60065-b89f-4a4e-a872-dd7432f6a987 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup_access--558467074&fields=id&tenant_id=e4be3566d3c34a19a30558795061b823 HTTP/1.1" status: 200 len: 267 time: 0.1355219 Dec 21 04:06:02.653902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.700971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.711263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2240c91d-6023-4ce1-9190-c1f1a98cfd29 None None] Pushing event updated for resources: {'Port': ['ID=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:02.743064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ae0837d-a6c8-4439-883d-ba6ee529f38c req-cfbd4f1a-0df3-4808-8fc5-e62a3f553edd tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1735904 Dec 21 04:06:02.779222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-fdd63dd2-7372-40c4-8f2f-d3d74677a17d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup_general--1967264497&fields=id&tenant_id=e4be3566d3c34a19a30558795061b823 HTTP/1.1" status: 200 len: 267 time: 0.1348350 Dec 21 04:06:02.799799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.898123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7569bf3e-c02d-4737-9351-2396f315fc94 None None] Pushing event updated for resources: {'Port': ['ID=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:02.919632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Attempting to bind port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:02.920005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Attempting to bind port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:02.920368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Attempting to bind port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 on network 7676bcbc-538f-4f82-a6a5-13d33001856e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:02.929874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:02.931992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Checking segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:02.931992 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.931992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Bound using segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:02.931992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Bound port: fa5c3dd5-c437-4b36-b4ac-26355e71eb85, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:02.931992 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:02.936845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb68c248-0017-4713-b7c8-74fa7123f6ba,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:03.123505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] For port fa5c3dd5-c437-4b36-b4ac-26355e71eb85, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:03.124354 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.130831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d8be9f5f-5e67-499b-9bdf-4947d579d363 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9321203 Dec 21 04:06:03.133070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:03.135106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] For port fa5c3dd5-c437-4b36-b4ac-26355e71eb85, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:03.142026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:03.188183 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.210250 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.241163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-988f6491-8669-4594-94d4-0f77fc6b2a6c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:03.242783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-988f6491-8669-4594-94d4-0f77fc6b2a6c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/networks?id=7676bcbc-538f-4f82-a6a5-13d33001856e HTTP/1.1" status: 200 len: 796 time: 0.4299166 Dec 21 04:06:03.278525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-fcf2183a-de49-43bd-8661-499c16484d76 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/quotas/e4be3566d3c34a19a30558795061b823 HTTP/1.1" status: 200 len: 375 time: 0.0232446 Dec 21 04:06:03.298828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.376357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a08a2837-9453-49fd-bac8-640144846372 None None] Provisioning complete for port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:03.379354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a08a2837-9453-49fd-bac8-640144846372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.424949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-f0157d6e-9839-4ed2-9de5-a5e9fda053a2 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1396444 Dec 21 04:06:03.439545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7569bf3e-c02d-4737-9351-2396f315fc94 None None] Pushing event updated for resources: {'Port': ['ID=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:03.446014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:03.446791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:03.450924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.529483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.595520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c51b2b2-6af9-4e20-9a86-01859b6009f9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:03.660998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:03.674129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.675550 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-23ea1730-8d4b-4d6a-ade8-bb72d4583813 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5432484 Dec 21 04:06:03.678300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48578) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:03.684688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:03.717508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a08a2837-9453-49fd-bac8-640144846372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.792635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.864473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-54b04af2-3108-489f-a326-ec2f33e8e35e service neutron] 10.222.0.18 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3484118 Dec 21 04:06:03.932647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Deleting port 9e4008ef-0c0f-40b4-99d7-d2e320a16713 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:03.932989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:03.975541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.060816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.111872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dd181baf-ce49-4cc9-a947-c546faf0b7d9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:04.174667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ec1fbb-427c-405d-ba8c-a4f2c6dad9ed req-ad907788-74bc-4813-813f-bdcf92e6370c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:04.176258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48ec1fbb-427c-405d-ba8c-a4f2c6dad9ed req-ad907788-74bc-4813-813f-bdcf92e6370c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2607312 Dec 21 04:06:04.178204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-da951140-c085-410d-b447-57bab4e9ffa6 service neutron] 10.222.0.18 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2976105 Dec 21 04:06:04.187472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.192307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3bc9b9e8-f077-4be2-8a2e-1c19d40a3653 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5101416 Dec 21 04:06:04.193016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48584) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:04.205738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:04.240674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] For port 9e4008ef-0c0f-40b4-99d7-d2e320a16713, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9e4008ef-0c0f-40b4-99d7-d2e320a16713,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:04.241053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.274392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Calling delete_port for 9e4008ef-0c0f-40b4-99d7-d2e320a16713 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:04.326892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48ec1fbb-427c-405d-ba8c-a4f2c6dad9ed req-f666580c-1368-49be-91eb-a49baad02eaa tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1327856 Dec 21 04:06:04.373165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.489579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a4a5338-e9fb-4b1f-83c5-a5018dedbd09 None None] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:06:04.499814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a08a2837-9453-49fd-bac8-640144846372 None None] For port fa5c3dd5-c437-4b36-b4ac-26355e71eb85, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:04.543570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.683358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-add00780-9838-4a79-8dfd-0fa4ca709128 req-0f51d70e-c5e3-4283-9206-4f0e21076a85 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 210 time: 0.0288448 Dec 21 04:06:04.689434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.733535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a08a2837-9453-49fd-bac8-640144846372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.743952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa3277b2-a3e5-4209-b26f-ec7c68c8b8a1,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:04.797536 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.852092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:04.857636 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-28ff6578-588d-4bac-93fe-c701a8c9d27d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6611991 Dec 21 04:06:04.857830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:04.876648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=9e4008ef-0c0f-40b4-99d7-d2e320a16713,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:04.911418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:04.981016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08a2837-9453-49fd-bac8-640144846372 None None] Pushing event updated for resources: {'Port': ['ID=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:04.989051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Provisioning complete for port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:04.989431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.030033 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Project ec158f7f7c994dacb4d1785b3b8f2ff1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:06:05.039298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.130424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:03Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:05.229269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-860f87a1-1697-400f-abff-f4994508cab6 None None] The sync data for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 is: [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:03Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:06:05.239713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.336673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.347236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a1e87ec-8827-4f1f-824a-c9ba50238f2e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:05.440450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a12c39b2-6473-4ec5-abf6-636d147fdedb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:05.475679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.514404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Provisioning complete for port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:05.514910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.553846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.555785 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-202533bf-1a3a-4f49-9a46-1ec1b358e540 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6967626 Dec 21 04:06:05.558612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48602) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:05.563442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': 'f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:05.667599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:05.668398 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.739188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24914e00-99b1-4e49-bd45-e8b3f6e92a4b req-c84b381c-8907-452c-8f6e-32d61de29496 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:05.741712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24914e00-99b1-4e49-bd45-e8b3f6e92a4b req-c84b381c-8907-452c-8f6e-32d61de29496 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2413311 Dec 21 04:06:05.754246 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Project ec158f7f7c994dacb4d1785b3b8f2ff1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:06:05.762531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.819230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.910153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:05.948051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] For port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:05.948781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9144f051-2284-4ef1-a915-3e585d91d221 req-7f7e3a7f-1aab-4a15-a583-d86b5da9f081 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 210 time: 0.1582053 Dec 21 04:06:05.960454 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:06.024948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:06.029394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:06.031595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24914e00-99b1-4e49-bd45-e8b3f6e92a4b req-059119c5-528e-44ab-92e5-2f6cc8d95e67 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2421284 Dec 21 04:06:06.063444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd9df19d-47e7-4968-9269-57acd33d5516,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:06.072491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Router a1333542-4121-47e8-a7de-92405f045a9e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:06:06.146433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:06.147797 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a358ebb-f2f9-4d6e-abd5-bfa087635266 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5880783 Dec 21 04:06:06.208470 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:06:06.208470 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:06:06.212089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-20fd80e4-484e-47e0-9925-2e0304b3552f None None] Provisioning complete for port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:06.212603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20fd80e4-484e-47e0-9925-2e0304b3552f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:06.257145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:06:06.268803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-529f3eb6-3004-4999-ae4a-be29290979e8 admin admin] 10.222.0.18 "PUT /v2.0/routers/a1333542-4121-47e8-a7de-92405f045a9e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4274006 Dec 21 04:06:06.273700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48616) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:06.277412 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] Sync routers for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:06:06.313681 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:06.316227 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:06.334386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bae9679-310d-4444-8601-e65e969619f5 None None] Pushing event updated for resources: {'Port': ['ID=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:06.639855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-2590bbac-1fe6-4d88-bc0c-b2d3157a8793 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1847379184&fields=id&tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 267 time: 0.0985460 Dec 21 04:06:06.662713 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:06.896634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795d7de4-9857-4777-a25e-e9672bb8735e req-e53e7d24-987c-4ee6-a70a-8a78fc361944 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:06.904573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-795d7de4-9857-4777-a25e-e9672bb8735e req-e53e7d24-987c-4ee6-a70a-8a78fc361944 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.2635767 Dec 21 04:06:06.953670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-277e3ce4-f132-4454-bef1-0aacc145df07 req-4c79cf6c-8afa-48f0-be04-47830397fab3 service neutron] (110311) timed out ('10.222.0.31', 52055) {{(pid=110311) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:06:06.977158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:07.043873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-2869574b-76d9-4ebd-9ace-e58687db62cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:07.045164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-2869574b-76d9-4ebd-9ace-e58687db62cf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 1097 time: 0.3107686 Dec 21 04:06:07.053518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-5380c308-20f8-45f4-aa6f-523de6b0eb20 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:07.055218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-5380c308-20f8-45f4-aa6f-523de6b0eb20 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/networks?id=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 HTTP/1.1" status: 200 len: 796 time: 0.3855102 Dec 21 04:06:07.072526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-795d7de4-9857-4777-a25e-e9672bb8735e req-779eefd7-15c4-4185-b7fe-9ee7cdd683a2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1670148 Dec 21 04:06:07.135326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-9111de27-d80b-4946-9fa4-9651b478c31c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/quotas/ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 375 time: 0.0426316 Dec 21 04:06:07.212167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:07.287785 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238'}], 'enable_snat': True}, 'gw_port_id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port': {'id': '9b5905a1-fcc1-4d24-91e4-3b04c6766205', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d6:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1502, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:57:08Z', 'updated_at': '2021-12-21T03:57:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:07.299700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a1e87ec-8827-4f1f-824a-c9ba50238f2e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:07.413768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:07.414402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:07.418845 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] Checking router: a1333542-4121-47e8-a7de-92405f045a9e for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:06:07.426621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-158521d1-86f0-4b86-b1a4-35798257d3f1 req-67814ac5-898b-425f-baba-38564d2f53ac tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 210 time: 0.2256367 Dec 21 04:06:07.443702 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] Routers {'a1333542-4121-47e8-a7de-92405f045a9e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:07.445646 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:05:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1333542-4121-47e8-a7de-92405f045a9e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:07.463597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Deleting port 9b5905a1-fcc1-4d24-91e4-3b04c6766205 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:07.464151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:07.478480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-d2e8b94e-c1f0-4f49-bfa3-03c12b6417a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:07.480685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-d2e8b94e-c1f0-4f49-bfa3-03c12b6417a5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 912 time: 0.4070780 Dec 21 04:06:07.521015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-4e6b4c7b-0e68-4c1c-94cd-a67814adb4ec tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&fields=id HTTP/1.1" status: 200 len: 394 time: 0.3588164 Dec 21 04:06:07.556157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa5c3dd5-c437-4b36-b4ac-26355e71eb85 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:07.637252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] For port 9b5905a1-fcc1-4d24-91e4-3b04c6766205, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b5905a1-fcc1-4d24-91e4-3b04c6766205,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:07.637626 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:07.656670 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] Set router a1333542-4121-47e8-a7de-92405f045a9e gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:07.669616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Calling delete_port for 9b5905a1-fcc1-4d24-91e4-3b04c6766205 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:07.683323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:07.685249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:07.710417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-bacadf9b-98f4-41ea-80cb-4aadf3920dd6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 200 len: 1001 time: 0.1843357 Dec 21 04:06:07.753968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T04:06:07Z', 'revision_number': 6, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:07.782453 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-773c0c04-445e-4812-bb21-9f4e5bcccd0b None None] The sync data for ids ['a1333542-4121-47e8-a7de-92405f045a9e'] in n-d-822053-11 is: [{'id': 'a1333542-4121-47e8-a7de-92405f045a9e', 'name': 'tempest-ServerActionsTestJSON-1104506998-router', 'tenant_id': '2d46b810d87943059c90ba895934ed3b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:57:07Z', 'updated_at': '2021-12-21T04:06:07Z', 'revision_number': 6, 'project_id': '2d46b810d87943059c90ba895934ed3b', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:06:07.796714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-372e9ebc-2d3e-4e83-b0e1-ef2e1bd49ca7 service neutron] 10.222.0.18 "GET /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2019839 Dec 21 04:06:07.907547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-98e90fe5-e388-41a0-97f9-cbc0a21eb226 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:07.909019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-98e90fe5-e388-41a0-97f9-cbc0a21eb226 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.1874053 Dec 21 04:06:07.986379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.011622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-f63a44a7-34e4-4cec-b3fa-753545bfcde1 service neutron] 10.222.0.18 "GET /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2138767 Dec 21 04:06:08.022849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Pushing event deleted for resources: {'Port': ['ID=9b5905a1-fcc1-4d24-91e4-3b04c6766205,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:08.041196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8ff83dd-35af-4cb8-831c-a00031566cef None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:06:08.084485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-cbc6f1bb-aa2f-4cee-aede-cfa90ea6cc61 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:08.084485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-cbc6f1bb-aa2f-4cee-aede-cfa90ea6cc61 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.54 "GET /v2.0/networks?id=7676bcbc-538f-4f82-a6a5-13d33001856e HTTP/1.1" status: 200 len: 796 time: 0.2106485 Dec 21 04:06:08.090717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-bbea37a8-b7dc-4416-a039-55d198a23787 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:08.092758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-bbea37a8-b7dc-4416-a039-55d198a23787 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1456220 Dec 21 04:06:08.130467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.262030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.264377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.295111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-a0d1208e-a43f-4fa9-a44f-caf1067c4ab7 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1904633 Dec 21 04:06:08.324785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-afad0c03-e223-45b1-8870-a9b89c0658d9 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e4be3566d3c34a19a30558795061b823 HTTP/1.1" status: 200 len: 477 time: 0.2103164 Dec 21 04:06:08.348268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'port': {'device_id': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'admin_state_up': True, 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'security_groups': ['07b6c0f7-21be-49f9-9bcd-5f474bdb8030', '6287e2c2-d00e-49cd-8bf8-6465cee94f44']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:08.404860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66162a92-75e8-45e6-8f8d-c0bc38afda3e req-eb5f9615-98ca-40c6-a8ea-5295419fa8eb tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:08.407598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.408614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a1333542-4121-47e8-a7de-92405f045a9e {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:06:08.415058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66162a92-75e8-45e6-8f8d-c0bc38afda3e req-eb5f9615-98ca-40c6-a8ea-5295419fa8eb tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1833193 Dec 21 04:06:08.424577 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.427760 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fc7815ee-41b0-4c2f-aadd-b7fd1bbc34b4 admin admin] 10.222.0.18 "DELETE /v2.0/routers/a1333542-4121-47e8-a7de-92405f045a9e HTTP/1.1" status: 204 len: 168 time: 2.1545858 Dec 21 04:06:08.431096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48650) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:08.516331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Deleting subnet 5101716e-6720-4ed1-b6cc-a5ad262b61c1 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:06:08.519791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.573408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.693045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.838537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.870695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5101716e-6720-4ed1-b6cc-a5ad262b61c1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:08.872793 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:08.879407 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-093361eb-7421-44a4-aed7-3cb56aa6b091 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/5101716e-6720-4ed1-b6cc-a5ad262b61c1 HTTP/1.1" status: 204 len: 168 time: 0.4476504 Dec 21 04:06:08.880041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:08.883038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be28e10d-9ecc-412a-8e7a-8898ddb78d57 None None] Network adb6972f-1a1d-4ca4-855c-5e5faf88030a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:06:08.895757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-788fb4b5-629b-4673-bda0-e1afef9a42ae req-8151bdb0-dcbe-4203-bcc1-4084ffdd77ce tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 210 time: 0.5088570 Dec 21 04:06:09.017176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.037218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9b5905a1-fcc1-4d24-91e4-3b04c6766205 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:06:09.075614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9b5905a1-fcc1-4d24-91e4-3b04c6766205 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:06:09.075614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9b5905a1-fcc1-4d24-91e4-3b04c6766205 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:06:09.075614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9e4008ef-0c0f-40b4-99d7-d2e320a16713 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:06:09.134125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Deleting port 6167aa29-943c-4c92-aae1-3c9325112b6a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:09.134480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bb141c6-fad3-45d2-b7e6-987c58bfebe0 req-3d2f7c56-b291-413d-b313-236644a44511 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 210 time: 0.0895870 Dec 21 04:06:09.136392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.141758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9e4008ef-0c0f-40b4-99d7-d2e320a16713 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:06:09.142115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9e4008ef-0c0f-40b4-99d7-d2e320a16713 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:06:09.158760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] DHCP port deletion for adb6972f-1a1d-4ca4-855c-5e5faf88030a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:06:09.173783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66162a92-75e8-45e6-8f8d-c0bc38afda3e req-4c8c9cc1-3f1c-4601-a33d-24a55febe64e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7564316 Dec 21 04:06:09.183476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-863225c5-0889-4eff-a0e7-6517b3a2831e req-b174a9ca-0c82-4bb5-b828-7db1a91b828e service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8562560 Dec 21 04:06:09.243813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] Deleting port 6167aa29-943c-4c92-aae1-3c9325112b6a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:09.244201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.264546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] For port 6167aa29-943c-4c92-aae1-3c9325112b6a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6167aa29-943c-4c92-aae1-3c9325112b6a,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:09.265381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.279169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Calling delete_port for 6167aa29-943c-4c92-aae1-3c9325112b6a owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:09.317225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Made reservation on behalf of e4be3566d3c34a19a30558795061b823 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:09.321799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.333778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] For port 6167aa29-943c-4c92-aae1-3c9325112b6a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6167aa29-943c-4c92-aae1-3c9325112b6a,segment=NetworkSegment(c01f3ee8-68b8-46bf-9e7f-2ef589a822de),segment_id=c01f3ee8-68b8-46bf-9e7f-2ef589a822de)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:09.334255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.350246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] Calling delete_port for 6167aa29-943c-4c92-aae1-3c9325112b6a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:09.449636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.456946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.477604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] No DVR routers for this DVR port 6167aa29-943c-4c92-aae1-3c9325112b6a on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:06:09.487074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] Pushing event deleted for resources: {'Port': ['ID=6167aa29-943c-4c92-aae1-3c9325112b6a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:09.493442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41bd3b82-0155-4916-b3a6-0340cdabd32a None None] No DVR routers for this DVR port 6167aa29-943c-4c92-aae1-3c9325112b6a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:06:09.501749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.20.0.7 (7676bcbc-538f-4f82-a6a5-13d33001856e/51cbe5f4-3d45-4b4f-a219-d8b88c9871e3/2d618554-ce8e-426e-a17d-9f52e0c87be9) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:09.591675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Pushing event deleted for resources: {'Port': ['ID=6167aa29-943c-4c92-aae1-3c9325112b6a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:09.596965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.628015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['adb6972f-1a1d-4ca4-855c-5e5faf88030a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:09.643346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:09.644046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c01f3ee8-68b8-46bf-9e7f-2ef589a822de') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:09.657486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.681285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.687619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:06:09.688130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:06:09.689829 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:06:09.731822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.832123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.837649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.840870 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] 10.222.0.18 "DELETE /v2.0/networks/adb6972f-1a1d-4ca4-855c-5e5faf88030a HTTP/1.1" status: 204 len: 168 time: 0.9598022 Dec 21 04:06:09.852151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76eef36e-3e6d-48ac-8de2-4d97e430ba84 admin admin] Pushing event deleted for resources: {'Network': ['ID=adb6972f-1a1d-4ca4-855c-5e5faf88030a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:09.858792 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:09.917208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 7676bcbc-538f-4f82-a6a5-13d33001856e is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:09.920218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:09.922831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:09.970094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=2d618554-ce8e-426e-a17d-9f52e0c87be9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:09.989569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:09.989965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:09.990307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:09.996856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:09.997458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.001755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:10.052326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8c9aa10-19bb-4073-920e-77eae52da687 req-e2107b15-0aab-4c7b-89ef-39f972e7f3ae tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 210 time: 0.0468831 Dec 21 04:06:10.067807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:10.068449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.189225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-13df6c06-d2c0-4b48-b1ef-9a3f275773a1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 972 time: 1.8474205 Dec 21 04:06:10.209491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Request body: {'port': {'device_id': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:10.225600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-92b8c26e-bdf1-4e66-9b24-d0fa8d4fc9c6 None None] Provisioning complete for port 2d618554-ce8e-426e-a17d-9f52e0c87be9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:10.231030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92b8c26e-bdf1-4e66-9b24-d0fa8d4fc9c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.276385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:10.285899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-92b8c26e-bdf1-4e66-9b24-d0fa8d4fc9c6 None None] Port 2d618554-ce8e-426e-a17d-9f52e0c87be9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:06:10.327021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-64c877ef-e8de-4297-8757-838d434ff318 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2d46b810d87943059c90ba895934ed3b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0488093 Dec 21 04:06:10.328781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:10.376925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.381640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3f1b623-4d20-4933-a268-4b1282a0bd6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.397023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a77fb98-77be-435f-83df-67a883639e05 req-bd3167bf-2236-452d-9607-6244789036f6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:10.398568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a77fb98-77be-435f-83df-67a883639e05 req-bd3167bf-2236-452d-9607-6244789036f6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 970 time: 0.1630080 Dec 21 04:06:10.404298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3f1b623-4d20-4933-a268-4b1282a0bd6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.414084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535c4c8-eea2-4358-8956-26e287a86575 req-b8bf8ad8-3eee-411d-bb30-64a02850c2c2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:10.415669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c535c4c8-eea2-4358-8956-26e287a86575 req-b8bf8ad8-3eee-411d-bb30-64a02850c2c2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1504562 Dec 21 04:06:10.538405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3f1b623-4d20-4933-a268-4b1282a0bd6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.543325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3f1b623-4d20-4933-a268-4b1282a0bd6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.546887 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e3f1b623-4d20-4933-a268-4b1282a0bd6a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/18f408dc-942e-4fe3-add4-37566364635e HTTP/1.1" status: 204 len: 168 time: 0.2148154 Dec 21 04:06:10.558828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3f1b623-4d20-4933-a268-4b1282a0bd6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18f408dc-942e-4fe3-add4-37566364635e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:10.595407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c535c4c8-eea2-4358-8956-26e287a86575 req-6b9b5b19-0233-4d1d-a46a-791dfcf60a19 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1540527 Dec 21 04:06:10.636067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a77fb98-77be-435f-83df-67a883639e05 req-21163543-28bd-4976-9354-75b5090d993b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.2183526 Dec 21 04:06:10.853034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2d618554-ce8e-426e-a17d-9f52e0c87be9 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:10.865204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:10.947899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Transition to ACTIVE for port object 2d618554-ce8e-426e-a17d-9f52e0c87be9 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:06:10.967983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6167aa29-943c-4c92-aae1-3c9325112b6a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.980922 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:10.984193 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:10.985333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-6555f5ef-efbd-4e59-9239-e3b8071aa961 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:10.986804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-6555f5ef-efbd-4e59-9239-e3b8071aa961 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/networks?id=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 HTTP/1.1" status: 200 len: 796 time: 0.1672702 Dec 21 04:06:10.998312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6167aa29-943c-4c92-aae1-3c9325112b6a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:06:10.998662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6167aa29-943c-4c92-aae1-3c9325112b6a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:06:11.020733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:11.124908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Pushing event updated for resources: {'Port': ['ID=2d618554-ce8e-426e-a17d-9f52e0c87be9,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:11.228486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-90a7ad0a-896d-4377-b839-eb94fb42d444 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 473 time: 0.2241235 Dec 21 04:06:11.230838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ddce9a9-7a20-465b-9763-62046d0660c8 req-a3842b2e-dfc6-4b8a-a173-e9bd9f189fb6 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 210 time: 0.0529249 Dec 21 04:06:11.261740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'port': {'device_id': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'admin_state_up': True, 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'security_groups': ['f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:11.265182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Attempting to bind port 2d618554-ce8e-426e-a17d-9f52e0c87be9 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:11.265652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Attempting to bind port 2d618554-ce8e-426e-a17d-9f52e0c87be9 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:11.266072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Attempting to bind port 2d618554-ce8e-426e-a17d-9f52e0c87be9 on network 7676bcbc-538f-4f82-a6a5-13d33001856e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:11.292897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Port 2d618554-ce8e-426e-a17d-9f52e0c87be9 on network 7676bcbc-538f-4f82-a6a5-13d33001856e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:06:11.293252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Attempting to bind port 2d618554-ce8e-426e-a17d-9f52e0c87be9 on network 7676bcbc-538f-4f82-a6a5-13d33001856e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:11.309865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:11.310215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Checking segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:11.310612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Bound using segment: {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:11.311084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Bound port: 2d618554-ce8e-426e-a17d-9f52e0c87be9, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3776c03c-8264-4376-8d05-0d4023c31e08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:11.311448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:11.445318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] For port 2d618554-ce8e-426e-a17d-9f52e0c87be9, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:11.450051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] For port 2d618554-ce8e-426e-a17d-9f52e0c87be9, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:11.539676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:11.569774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:11.573761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:11.604651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:11.604651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:11.604651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] 10.222.0.54 "PUT /v2.0/ports/2d618554-ce8e-426e-a17d-9f52e0c87be9 HTTP/1.1" status: 200 len: 1131 time: 1.3950925 Dec 21 04:06:11.604651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:11.604651 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0c0727e-07bc-451d-8f0d-b01b86635cf9" -d '{"events": [{"name": "network-changed", "server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:11.637682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95692d1b-577a-4396-805b-4a58d9e6e1e9 service neutron] Pushing event updated for resources: {'Port': ['ID=2d618554-ce8e-426e-a17d-9f52e0c87be9,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:11.675323 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eeb4c707-b752-4c99-a378-62b5845b6c96 x-openstack-request-id: req-eeb4c707-b752-4c99-a378-62b5845b6c96 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:11.677279 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:11.677279 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eeb4c707-b752-4c99-a378-62b5845b6c96 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:11.677279 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'status': 'completed', 'code': 200} Dec 21 04:06:11.834078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.20.0.19 (aa9d5090-f8cc-472f-a4a3-d525f12a8bf8/75097d59-9114-4d6a-ab49-443c57e1f8de/cb722c74-363a-414e-b4a1-b8ed8d175d24) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:11.880726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48714) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:11.882330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c0727e-07bc-451d-8f0d-b01b86635cf9 req-f173a613-9868-4039-83b8-ce50911d2347 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:11.883972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c0727e-07bc-451d-8f0d-b01b86635cf9 req-f173a613-9868-4039-83b8-ce50911d2347 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1134 time: 0.0944414 Dec 21 04:06:11.932893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b9df72c-55eb-495d-895d-095e8c09b220 req-eef4c9ac-180f-49f3-8426-9932191d3ddf tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:11.940932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b9df72c-55eb-495d-895d-095e8c09b220 req-eef4c9ac-180f-49f3-8426-9932191d3ddf tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 982 time: 0.1501703 Dec 21 04:06:12.018275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Request body: {'network': {'name': 'tempest-ServerPasswordTestJSON-782850246-network', 'tenant_id': '5abdaf3416b648eba07ab305383a44a4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:12.100218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Made reservation on behalf of 5abdaf3416b648eba07ab305383a44a4 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:12.103862 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.113387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.135558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b9df72c-55eb-495d-895d-095e8c09b220 req-5ec5ec80-1043-4059-be66-d86fbb4fef9c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1937518 Dec 21 04:06:12.167751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c0727e-07bc-451d-8f0d-b01b86635cf9 req-8dfa57c7-7ce4-4b9a-bfef-b61824b09f77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.167751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c0727e-07bc-451d-8f0d-b01b86635cf9 req-8dfa57c7-7ce4-4b9a-bfef-b61824b09f77 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=e4be3566d3c34a19a30558795061b823&shared=False HTTP/1.1" status: 200 len: 897 time: 0.2649996 Dec 21 04:06:12.188787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.203843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.292672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.303926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c0727e-07bc-451d-8f0d-b01b86635cf9 req-ee2a7dd5-bfb7-4b8d-a803-8f8297ce96ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.303926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c0727e-07bc-451d-8f0d-b01b86635cf9 req-ee2a7dd5-bfb7-4b8d-a803-8f8297ce96ab service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1267533 Dec 21 04:06:12.306542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:06:12.330887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.331267 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Added segment 6427c177-442d-45ff-a6ce-8dc6c7a3bb24 of type vlan for network 9a233b83-beaa-465e-8182-8018ddcd60b2 Dec 21 04:06:12.345451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1ea097b-3476-4816-9825-b6fc157739ea,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:12.361974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba30e1e0-1c04-4f96-9c62-4f2077c3cabb req-4f32438a-9bc2-4816-8ec5-97a04b890fdc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 210 time: 0.0364895 Dec 21 04:06:12.390701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.402571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.470302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:12.476991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:12.480612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-92d33a95-9f88-48e0-ab77-c5dbc280a6ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.482155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-92d33a95-9f88-48e0-ab77-c5dbc280a6ab service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1134 time: 0.1060724 Dec 21 04:06:12.482972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:12.520534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=cb722c74-363a-414e-b4a1-b8ed8d175d24,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:12.528839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.529841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.530427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.600459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.601146 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.607552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] Pushing event updated for resources: {'Network': ['ID=9a233b83-beaa-465e-8182-8018ddcd60b2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:12.613342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-0aa44216-efaa-4c21-a371-b637a8a5e37e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9 HTTP/1.1" status: 200 len: 217 time: 0.1039739 Dec 21 04:06:12.621261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9a233b83-beaa-465e-8182-8018ddcd60b2 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:06:12.643434 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d3530b3-18ac-40fa-b98c-975ee0522897 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7582786 Dec 21 04:06:12.645931 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48724) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:12.652464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Request body: {'subnet': {'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerPasswordTestJSON-782850246-subnet', 'tenant_id': '5abdaf3416b648eba07ab305383a44a4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:12.678640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-7b672ea3-5c48-434a-998e-59b67a294b23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.681364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-7b672ea3-5c48-434a-998e-59b67a294b23 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=51cbe5f4-3d45-4b4f-a219-d8b88c9871e3 HTTP/1.1" status: 200 len: 834 time: 0.0594485 Dec 21 04:06:12.730399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-a8ee28a5-c659-4c43-a969-8fb04eab599c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4734452 Dec 21 04:06:12.754044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Request body: {'port': {'device_id': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:12.758628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-24c591d7-164a-4386-9c65-ba28ba8df599 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:12.760154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-24c591d7-164a-4386-9c65-ba28ba8df599 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=7676bcbc-538f-4f82-a6a5-13d33001856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0701172 Dec 21 04:06:12.816346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Made reservation on behalf of 5abdaf3416b648eba07ab305383a44a4 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:12.819108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.880391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.903426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e93e2cf1-2a5d-4f9b-b73e-0e921b4a8609 None None] Provisioning complete for port cb722c74-363a-414e-b4a1-b8ed8d175d24 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:12.905965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e93e2cf1-2a5d-4f9b-b73e-0e921b4a8609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:12.947550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-1c47dfbc-c536-40bc-8b45-d2ae61641755 service neutron] 10.222.0.54 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1633470 Dec 21 04:06:12.961816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e93e2cf1-2a5d-4f9b-b73e-0e921b4a8609 None None] Port cb722c74-363a-414e-b4a1-b8ed8d175d24 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:06:13.118552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:13.145990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a6f9773-9b2f-45fc-bb39-fea906408b52 req-3a6acfc6-0b77-4010-a194-9234a3ab612c service neutron] 10.222.0.54 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1868672 Dec 21 04:06:13.165911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d38fb055-4fe9-4247-a9d0-c3f177acaee2,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:13.191283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Checking segment: {'id': '6427c177-442d-45ff-a6ce-8dc6c7a3bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:13.191283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Network hostable DHCP agents. Network: 9a233b83-beaa-465e-8182-8018ddcd60b2, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:06:13.243681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Network 9a233b83-beaa-465e-8182-8018ddcd60b2 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:06:13.314344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-5449849e-04ac-4534-bfbb-732cccf5899f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:13.315848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-5449849e-04ac-4534-bfbb-732cccf5899f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.2094717 Dec 21 04:06:13.323059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9a233b83-beaa-465e-8182-8018ddcd60b2) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:13.327797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:13.328568 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:13.332354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ddd10ed-c4e1-4ab7-8b6e-b9813a36fecb None None] Network 9a233b83-beaa-465e-8182-8018ddcd60b2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:06:13.347057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0211c1b8-e100-4faa-8ddd-b4d309c10ae9 req-d07ffd99-d7a6-495d-8493-cfc6aeadefe1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:13.349623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0211c1b8-e100-4faa-8ddd-b4d309c10ae9 req-d07ffd99-d7a6-495d-8493-cfc6aeadefe1 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 982 time: 0.1250441 Dec 21 04:06:13.358044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-b93120d2-7ec9-4eae-825f-05743f006665 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/quotas/c24fe956f7434054805a2322d25507fa HTTP/1.1" status: 200 len: 375 time: 0.0360892 Dec 21 04:06:13.432389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e3d0a3f8-4b47-419c-9235-8b54d82c1f08 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7849457 Dec 21 04:06:13.439779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbc2479d-a8b0-45ac-89bf-03ce2370fb92 None None] Network 9a233b83-beaa-465e-8182-8018ddcd60b2 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:06:13.452375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb722c74-363a-414e-b4a1-b8ed8d175d24 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:13.463799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:13.490842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Transition to ACTIVE for port object cb722c74-363a-414e-b4a1-b8ed8d175d24 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:06:13.499487 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-ba4fd98a-eb72-46ef-ac71-9c9d99780dd8 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1348648 Dec 21 04:06:13.508417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0211c1b8-e100-4faa-8ddd-b4d309c10ae9 req-f2050b85-4981-45b9-9f10-5a6e97f07089 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1521940 Dec 21 04:06:13.596332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:13.697941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Pushing event updated for resources: {'Port': ['ID=cb722c74-363a-414e-b4a1-b8ed8d175d24,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:13.728127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-dbd360d4-e979-486a-8030-3d4dbd921d03 service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2163858 Dec 21 04:06:13.785969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07064fa7-c11d-4488-a12d-1212cd4bd6c4 req-ba96af27-e7d1-4ebe-906c-c69baa1de4bf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:13.787763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07064fa7-c11d-4488-a12d-1212cd4bd6c4 req-ba96af27-e7d1-4ebe-906c-c69baa1de4bf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 944 time: 0.1950736 Dec 21 04:06:13.879435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Attempting to bind port cb722c74-363a-414e-b4a1-b8ed8d175d24 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:13.879820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Attempting to bind port cb722c74-363a-414e-b4a1-b8ed8d175d24 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:13.880092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Attempting to bind port cb722c74-363a-414e-b4a1-b8ed8d175d24 on network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:13.905300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Port cb722c74-363a-414e-b4a1-b8ed8d175d24 on network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:06:13.905629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Attempting to bind port cb722c74-363a-414e-b4a1-b8ed8d175d24 on network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:13.926541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:13.926876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Checking segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:13.927331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Bound using segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:13.927711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Bound port: cb722c74-363a-414e-b4a1-b8ed8d175d24, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:13.928058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:13.931265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-caeb6078-9e79-4029-89e6-70f39685d28a service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1847353 Dec 21 04:06:13.936359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07064fa7-c11d-4488-a12d-1212cd4bd6c4 req-32f7c129-0b43-44f1-bef2-1d1895ec7375 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1341004 Dec 21 04:06:14.043333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] For port cb722c74-363a-414e-b4a1-b8ed8d175d24, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:14.045482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] For port cb722c74-363a-414e-b4a1-b8ed8d175d24, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:14.173453 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:14.653677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95140d68-c87c-41a8-a51d-6a26aac54b67 req-95394879-7fc4-469e-9ff7-6a17c6b69281 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 210 time: 0.4304974 Dec 21 04:06:14.657423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:14.658054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:14.659472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] 10.222.0.31 "PUT /v2.0/ports/cb722c74-363a-414e-b4a1-b8ed8d175d24 HTTP/1.1" status: 200 len: 1093 time: 1.9117539 Dec 21 04:06:14.662401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'tag': 'cb722c74-363a-414e-b4a1-b8ed8d175d24'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:14.665651 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389" -d '{"events": [{"name": "network-changed", "server_uuid": "36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4", "tag": "cb722c74-363a-414e-b4a1-b8ed8d175d24"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:14.712417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-72051c1f-c96c-4db8-91b8-2a5d15b6edd6 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:14.719529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-72051c1f-c96c-4db8-91b8-2a5d15b6edd6 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/networks?id=9a233b83-beaa-465e-8182-8018ddcd60b2 HTTP/1.1" status: 200 len: 812 time: 0.5853293 Dec 21 04:06:14.721393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a44cb6d-f07d-489d-b18f-e200b861278c service neutron] Pushing event updated for resources: {'Port': ['ID=cb722c74-363a-414e-b4a1-b8ed8d175d24,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:14.759946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-cee7679c-f0b4-43df-81d3-043800d07213 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/quotas/5abdaf3416b648eba07ab305383a44a4 HTTP/1.1" status: 200 len: 375 time: 0.0292222 Dec 21 04:06:14.839398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-88c93011-0536-41f0-9ae7-daa219b7cca6 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=5abdaf3416b648eba07ab305383a44a4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0457227 Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.864515 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:14.867521 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:14.877569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe0eb405-5b7f-4b73-bc94-b07f6e756296 req-94075081-c7c4-47f3-bf2e-685792550031 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:14.879419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe0eb405-5b7f-4b73-bc94-b07f6e756296 req-94075081-c7c4-47f3-bf2e-685792550031 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 982 time: 0.1264253 Dec 21 04:06:14.997707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-457496f5-5def-4d42-9551-25c92826df0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:14.998627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-457496f5-5def-4d42-9551-25c92826df0b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 1096 time: 0.1693637 Dec 21 04:06:15.027255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-d3266d61-f40c-46eb-808a-01a7630492d6 service neutron] 10.222.0.18 "GET /v2.0/networks/9a233b83-beaa-465e-8182-8018ddcd60b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1465020 Dec 21 04:06:15.076124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-857dfd78-0f6f-4116-b502-d4835f641a9d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24 HTTP/1.1" status: 200 len: 217 time: 0.0597742 Dec 21 04:06:15.081875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe0eb405-5b7f-4b73-bc94-b07f6e756296 req-3ea9e526-f929-44b1-b92d-97335ad67cd2 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1665044 Dec 21 04:06:15.160574 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac942635-a534-4e82-a648-831c5de229cd x-openstack-request-id: req-ac942635-a534-4e82-a648-831c5de229cd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:15.160879 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4", "tag": "cb722c74-363a-414e-b4a1-b8ed8d175d24", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:15.161136 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ac942635-a534-4e82-a648-831c5de229cd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:15.161533 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'tag': 'cb722c74-363a-414e-b4a1-b8ed8d175d24', 'status': 'completed', 'code': 200} Dec 21 04:06:15.185631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-3cb2cac9-b795-401f-98b8-d31a5ac026f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:15.187113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-3cb2cac9-b795-401f-98b8-d31a5ac026f4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=75097d59-9114-4d6a-ab49-443c57e1f8de HTTP/1.1" status: 200 len: 838 time: 0.0950141 Dec 21 04:06:15.255377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-1b042a93-3a71-4426-bd4b-ca4b51dbd105 service neutron] 10.222.0.18 "GET /v2.0/networks/9a233b83-beaa-465e-8182-8018ddcd60b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1901507 Dec 21 04:06:15.280588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ddac4aa-5b65-4974-95ee-d1f2815d7ba2 req-a5b35219-decb-4806-b277-bc490b49a154 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:15.282098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ddac4aa-5b65-4974-95ee-d1f2815d7ba2 req-a5b35219-decb-4806-b277-bc490b49a154 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 944 time: 0.1004272 Dec 21 04:06:15.285505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-aa478515-bd76-4525-89bc-549e9ee04845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:15.286924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-aa478515-bd76-4525-89bc-549e9ee04845 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0911934 Dec 21 04:06:15.411669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ddac4aa-5b65-4974-95ee-d1f2815d7ba2 req-c0903abc-731a-4c76-b9a0-f211345f7892 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1037552 Dec 21 04:06:15.441810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-fe83b8c9-6522-409d-a346-efabbe41c5ce service neutron] 10.222.0.31 "GET /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1465235 Dec 21 04:06:15.553019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-88f9a61a-27eb-4b93-b41f-58e5d19fc497 req-e8ad6ed2-4cca-45f4-9554-ee8097bb64d4 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 210 time: 0.0600488 Dec 21 04:06:15.587768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728ebca1-109c-41be-a364-cbd624a3cca2 req-487312bc-4efa-4e0e-bb16-4eaab854bd3e service neutron] 10.222.0.31 "GET /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1389122 Dec 21 04:06:15.764242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3da76f1-fab8-487b-8c22-4edf36a4ab63 req-527b9999-fb2f-402f-9fd5-0948071de940 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 210 time: 0.0287859 Dec 21 04:06:15.825385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-708256fe-c29a-4b00-a207-27483e88b3b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:15.827001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-708256fe-c29a-4b00-a207-27483e88b3b7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 1096 time: 0.0442553 Dec 21 04:06:15.923842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-52551a26-213b-4f8c-890a-71d671c57615 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:15.925320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-52551a26-213b-4f8c-890a-71d671c57615 service neutron] 10.222.0.31 "GET /v2.0/networks?id=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 HTTP/1.1" status: 200 len: 897 time: 0.0891254 Dec 21 04:06:15.972818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-f59d974b-1b28-4e8b-ac9f-f6bca78bf27f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24 HTTP/1.1" status: 200 len: 217 time: 0.0398524 Dec 21 04:06:16.031190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-e3a4a2dd-8e04-41cc-a731-37ce4c6e849f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:16.032681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-e3a4a2dd-8e04-41cc-a731-37ce4c6e849f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=75097d59-9114-4d6a-ab49-443c57e1f8de HTTP/1.1" status: 200 len: 838 time: 0.0524373 Dec 21 04:06:16.085927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-7544ba84-0f77-4bce-a18c-8fbe5becbf47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:16.087887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-7544ba84-0f77-4bce-a18c-8fbe5becbf47 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0459492 Dec 21 04:06:16.223095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-e62395c8-e1a9-407a-8673-7c449fac0c3a service neutron] 10.222.0.31 "GET /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266587 Dec 21 04:06:16.235350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89ab13b-1738-4ec6-a158-b7d4359683f8 req-583e479f-dcf8-4dd3-a0e0-3fb797b338b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:16.236750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d89ab13b-1738-4ec6-a158-b7d4359683f8 req-583e479f-dcf8-4dd3-a0e0-3fb797b338b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 982 time: 0.0740237 Dec 21 04:06:16.369794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d89ab13b-1738-4ec6-a158-b7d4359683f8 req-423afd68-7aa8-4a84-87a9-5c12fb3ed049 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1142743 Dec 21 04:06:16.375614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e76f27ee-b7e5-4155-aa2f-37c8a9c19389 req-83b0df01-dabf-4015-9490-cc6a504a28df service neutron] 10.222.0.31 "GET /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1379907 Dec 21 04:06:16.555956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295406ee-b8bb-4abb-8cb2-49a63ec38f7b req-bd6ff09b-fbe8-46a6-8c19-b5161530571b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:16.557543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-295406ee-b8bb-4abb-8cb2-49a63ec38f7b req-bd6ff09b-fbe8-46a6-8c19-b5161530571b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 944 time: 0.0658867 Dec 21 04:06:16.625358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-295406ee-b8bb-4abb-8cb2-49a63ec38f7b req-2b215d27-cd38-4a6a-9915-30f1012e637f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0608661 Dec 21 04:06:16.643018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-661ec974-6f1a-497e-a146-34cfd49fac3b req-987cad2d-8c7c-4905-b802-8ee9429564f4 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 210 time: 0.0357974 Dec 21 04:06:16.883442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bb52b2d-f1f8-46c3-aaa7-6c2a6272c144 req-da16ca10-2a90-40f9-a23f-9c7f9468cc05 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 210 time: 0.0320024 Dec 21 04:06:16.908320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-4600237b-b773-4229-94f2-fd17725a623f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:16.909805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-4600237b-b773-4229-94f2-fd17725a623f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.1375875 Dec 21 04:06:16.934603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Request body: {'port': {'device_id': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'admin_state_up': True, 'tenant_id': 'c24fe956f7434054805a2322d25507fa'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:17.149769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Made reservation on behalf of c24fe956f7434054805a2322d25507fa for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:17.153320 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.282232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Allocated IP 172.20.0.3 (13d79d25-d791-421e-bee1-93ce620f5704/f6eb37b9-316b-4d85-9044-455f8831b074/b5ef7827-00e7-4327-b7b1-fdbfa2289064) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:17.430634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2d618554-ce8e-426e-a17d-9f52e0c87be9 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:06:17.437125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.513898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5ba991-7b47-4dca-a575-1fb7220604ea req-d813cc46-4313-4900-b162-b7d3d8e9063c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:17.515451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a5ba991-7b47-4dca-a575-1fb7220604ea req-d813cc46-4313-4900-b162-b7d3d8e9063c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 982 time: 0.0721226 Dec 21 04:06:17.534712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2d618554-ce8e-426e-a17d-9f52e0c87be9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:17.547323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'port_id': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'mac_address': 'fa:16:3e:e3:50:18', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 105, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:06:17.572999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a5ba991-7b47-4dca-a575-1fb7220604ea req-45ebbea9-0538-4fec-b442-46f0ad08b181 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0510812 Dec 21 04:06:17.589160 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.597790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.605182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2d618554-ce8e-426e-a17d-9f52e0c87be9 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:17.627550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2d618554-ce8e-426e-a17d-9f52e0c87be9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:17.631507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:17.645488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Network 13d79d25-d791-421e-bee1-93ce620f5704 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:17.653421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:17.656504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:17.688786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event updated for resources: {'Port': ['ID=b5ef7827-00e7-4327-b7b1-fdbfa2289064,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:17.707622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.719116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:17.720229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.783031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fd0603c-6ece-4181-b253-afe9b2f615fe req-3400effc-5299-4bcf-8610-18cf83c02a56 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 210 time: 0.0356801 Dec 21 04:06:17.792487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cb722c74-363a-414e-b4a1-b8ed8d175d24 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:06:17.829268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-db5a58e5-03dd-4c93-93f4-1d446c43a834 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8986113 Dec 21 04:06:17.845424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc03a1e5-3a66-4bd1-91a7-6159b4ce7124 req-c421431b-cfd0-4b00-911a-518ae9683a50 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:17.846902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc03a1e5-3a66-4bd1-91a7-6159b4ce7124 req-c421431b-cfd0-4b00-911a-518ae9683a50 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 944 time: 0.0566103 Dec 21 04:06:17.849066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2d618554-ce8e-426e-a17d-9f52e0c87be9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:17.852508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Request body: {'port': {'device_id': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:17.943143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:17.960857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc03a1e5-3a66-4bd1-91a7-6159b4ce7124 req-51fca77c-e376-4c56-8932-5dc44b95048a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1039505 Dec 21 04:06:18.020934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cb722c74-363a-414e-b4a1-b8ed8d175d24, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:18.033665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'cb722c74-363a-414e-b4a1-b8ed8d175d24', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'port_id': 'cb722c74-363a-414e-b4a1-b8ed8d175d24', 'mac_address': 'fa:16:3e:e0:32:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'ip_address': '172.20.0.19'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:06:18.075019 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.093705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb722c74-363a-414e-b4a1-b8ed8d175d24 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:18.114223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cb722c74-363a-414e-b4a1-b8ed8d175d24, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:18.131728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['2d618554-ce8e-426e-a17d-9f52e0c87be9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:18.185841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f2cdfd-800a-41d6-b135-8c2bb6b000b4 req-a39bff97-d0e1-486f-b756-2318eb49ca00 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:18.192607 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.195377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0f2cdfd-800a-41d6-b135-8c2bb6b000b4 req-a39bff97-d0e1-486f-b756-2318eb49ca00 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 931 time: 0.1484232 Dec 21 04:06:18.227486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-4cecc6c5-6e6b-4492-a035-66a036baab58 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:18.231867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-4cecc6c5-6e6b-4492-a035-66a036baab58 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.54 "GET /v2.0/networks?id=9a233b83-beaa-465e-8182-8018ddcd60b2 HTTP/1.1" status: 200 len: 812 time: 0.2426696 Dec 21 04:06:18.265223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=cb722c74-363a-414e-b4a1-b8ed8d175d24,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:18.276699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Request body: {'port': {'device_id': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2', 'admin_state_up': True, 'tenant_id': '5abdaf3416b648eba07ab305383a44a4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:18.320929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0f2cdfd-800a-41d6-b135-8c2bb6b000b4 req-f05c93d7-81f3-408d-97ea-20dbc8f02bcd tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245673 Dec 21 04:06:18.443122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b5ef7827-00e7-4327-b7b1-fdbfa2289064 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:18.450822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.462706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Transition to ACTIVE for port object b5ef7827-00e7-4327-b7b1-fdbfa2289064 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:06:18.500966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['cb722c74-363a-414e-b4a1-b8ed8d175d24'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:18.511713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Made reservation on behalf of 5abdaf3416b648eba07ab305383a44a4 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:18.515570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.523854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.671619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Pushing event updated for resources: {'Port': ['ID=b5ef7827-00e7-4327-b7b1-fdbfa2289064,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:18.674568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Attempting to bind port b5ef7827-00e7-4327-b7b1-fdbfa2289064 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:18.675000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Attempting to bind port b5ef7827-00e7-4327-b7b1-fdbfa2289064 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:18.675355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Attempting to bind port b5ef7827-00e7-4327-b7b1-fdbfa2289064 on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:18.683200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Port b5ef7827-00e7-4327-b7b1-fdbfa2289064 on network 13d79d25-d791-421e-bee1-93ce620f5704 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:06:18.683897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Attempting to bind port b5ef7827-00e7-4327-b7b1-fdbfa2289064 on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:18.691777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Allocated IP 172.20.0.6 (9a233b83-beaa-465e-8182-8018ddcd60b2/d38fb055-4fe9-4247-a9d0-c3f177acaee2/fcfb0f49-b810-49cb-b540-11ba574daf44) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:18.725582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:18.726426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Checking segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:18.727011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Bound using segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:18.727774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Bound port: b5ef7827-00e7-4327-b7b1-fdbfa2289064, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:18.727996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.780599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3ac083-00b8-4aff-bdfc-1d8a84ae4ed8 req-029b4d91-eb85-4d1d-8a96-396c3250fbb5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:18.782303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a3ac083-00b8-4aff-bdfc-1d8a84ae4ed8 req-029b4d91-eb85-4d1d-8a96-396c3250fbb5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 983 time: 0.1000931 Dec 21 04:06:18.848183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] For port b5ef7827-00e7-4327-b7b1-fdbfa2289064, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:18.852753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] For port b5ef7827-00e7-4327-b7b1-fdbfa2289064, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b5ef7827-00e7-4327-b7b1-fdbfa2289064,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:18.866415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a3ac083-00b8-4aff-bdfc-1d8a84ae4ed8 req-06a0bfbf-55e5-4ba0-88e0-e73003dff884 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0755596 Dec 21 04:06:18.913200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.923617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ea6f3b3-8fb6-43db-b9a7-04d7fbfb8f11 req-b67c776d-ab51-416d-8b01-2da854c255ae tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 210 time: 0.0278654 Dec 21 04:06:18.934618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.974960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:18.976233 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:18.977546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] 10.222.0.54 "PUT /v2.0/ports/b5ef7827-00e7-4327-b7b1-fdbfa2289064 HTTP/1.1" status: 200 len: 1092 time: 1.1295209 Dec 21 04:06:18.987205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'tag': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:18.992405 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a819b66-b59d-450f-a843-6eea07bf65e7" -d '{"events": [{"name": "network-changed", "server_uuid": "c62a8e3a-359f-4a1f-92b2-6cfa85603fcf", "tag": "b5ef7827-00e7-4327-b7b1-fdbfa2289064"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:19.020797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ee5ed7-0484-4242-98c0-89351f929075 service neutron] Pushing event updated for resources: {'Port': ['ID=b5ef7827-00e7-4327-b7b1-fdbfa2289064,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:19.038029 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a15bf12-3f21-4f11-9072-8fe1d6bd0c38 x-openstack-request-id: req-5a15bf12-3f21-4f11-9072-8fe1d6bd0c38 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:19.039013 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c62a8e3a-359f-4a1f-92b2-6cfa85603fcf", "tag": "b5ef7827-00e7-4327-b7b1-fdbfa2289064", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:19.039341 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5a15bf12-3f21-4f11-9072-8fe1d6bd0c38 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:19.039823 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'tag': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064', 'status': 'completed', 'code': 200} Dec 21 04:06:19.043702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.088803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Network 9a233b83-beaa-465e-8182-8018ddcd60b2 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:19.091812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:19.095470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:19.118120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Pushing event updated for resources: {'Port': ['ID=fcfb0f49-b810-49cb-b540-11ba574daf44,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:19.120325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-043e0164-ae0d-4348-82d6-fd3c8a1b15b8 req-0af874c6-4185-422d-92b9-371ede1e6da2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.121864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-043e0164-ae0d-4348-82d6-fd3c8a1b15b8 req-0af874c6-4185-422d-92b9-371ede1e6da2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 945 time: 0.0793300 Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.142759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:06:19.148407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a819b66-b59d-450f-a843-6eea07bf65e7 req-495614c1-e10d-4249-8908-19dca555cddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.150399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a819b66-b59d-450f-a843-6eea07bf65e7 req-495614c1-e10d-4249-8908-19dca555cddb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 1095 time: 0.0636585 Dec 21 04:06:19.159825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.160700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.216256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-043e0164-ae0d-4348-82d6-fd3c8a1b15b8 req-c74540d7-c548-443b-976d-788cfc5c055c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803516 Dec 21 04:06:19.247201 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-05c73fb9-2935-448f-ade4-f205b9562933 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9931903 Dec 21 04:06:19.265783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Request body: {'port': {'device_id': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:19.285434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a819b66-b59d-450f-a843-6eea07bf65e7 req-52a5a307-e513-4411-8bc5-b6502c200d07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.287155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a819b66-b59d-450f-a843-6eea07bf65e7 req-52a5a307-e513-4411-8bc5-b6502c200d07 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=c24fe956f7434054805a2322d25507fa&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1161883 Dec 21 04:06:19.327568 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.392840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a819b66-b59d-450f-a843-6eea07bf65e7 req-54fb222e-704a-41ff-8c42-1662e9a910db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.394576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a819b66-b59d-450f-a843-6eea07bf65e7 req-54fb222e-704a-41ff-8c42-1662e9a910db service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0988407 Dec 21 04:06:19.441906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2d618554-ce8e-426e-a17d-9f52e0c87be9 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:19.457528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f12bf9-a54b-4207-aa31-8bd4af4fec8a req-79ef0114-2ea4-452f-ba15-744ed13ba8b7 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.459396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4f12bf9-a54b-4207-aa31-8bd4af4fec8a req-79ef0114-2ea4-452f-ba15-744ed13ba8b7 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 943 time: 0.0552101 Dec 21 04:06:19.537013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4f12bf9-a54b-4207-aa31-8bd4af4fec8a req-ae9238fb-4238-4f1c-9f67-483862c606ed tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664315 Dec 21 04:06:19.545096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-ffc9ca96-c656-4f4e-bd4a-d6aec1b91b69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.548175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-ffc9ca96-c656-4f4e-bd4a-d6aec1b91b69 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 1095 time: 0.0851564 Dec 21 04:06:19.566553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 2d618554-ce8e-426e-a17d-9f52e0c87be9 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:06:19.571685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 2d618554-ce8e-426e-a17d-9f52e0c87be9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:19.572136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.619934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-6a6e58cc-1182-47af-a8b5-84d246bbdde4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b5ef7827-00e7-4327-b7b1-fdbfa2289064 HTTP/1.1" status: 200 len: 217 time: 0.0576870 Dec 21 04:06:19.675547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.676778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-23daf248-c244-4209-8fd3-e83cdbcac6d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.679449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-23daf248-c244-4209-8fd3-e83cdbcac6d3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f6eb37b9-316b-4d85-9044-455f8831b074 HTTP/1.1" status: 200 len: 855 time: 0.0517421 Dec 21 04:06:19.686895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fcfb0f49-b810-49cb-b540-11ba574daf44 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:19.695699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.701363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:19.703993 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02c37043-5ecc-4d15-a2d3-eb1b0ecf1a88" -d '{"events": [{"server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "name": "network-vif-plugged", "status": "completed", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:19.714439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Transition to ACTIVE for port object fcfb0f49-b810-49cb-b540-11ba574daf44 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:06:19.724947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-c5f766e1-26c5-44a0-919f-d7dcc3e9f023 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=13d79d25-d791-421e-bee1-93ce620f5704&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381489 Dec 21 04:06:19.730985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 2d618554-ce8e-426e-a17d-9f52e0c87be9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:19.754373 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7fa4737-1e94-4b94-8855-57441d096815 x-openstack-request-id: req-b7fa4737-1e94-4b94-8855-57441d096815 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:19.754773 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "name": "network-vif-plugged", "status": "completed", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:19.755127 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b7fa4737-1e94-4b94-8855-57441d096815 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:19.755617 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'code': 200} Dec 21 04:06:19.790668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.803626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cb722c74-363a-414e-b4a1-b8ed8d175d24 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:19.837951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-10e1fd4c-c1a7-4039-9ce9-1ecd914efcf5 service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1039929 Dec 21 04:06:19.848019 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78da40ec-6e34-46a1-906c-6271915e3550 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.861728 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:19.903840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Pushing event updated for resources: {'Port': ['ID=fcfb0f49-b810-49cb-b540-11ba574daf44,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:19.955005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=2d618554-ce8e-426e-a17d-9f52e0c87be9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:19.977790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b94519-257c-4cbe-95e3-7010bf820233 req-f6499254-ef07-4235-86fd-acd4f1967b2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:19.979329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74b94519-257c-4cbe-95e3-7010bf820233 req-f6499254-ef07-4235-86fd-acd4f1967b2a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1136 time: 0.0969133 Dec 21 04:06:19.984058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bea29984-2ea8-4beb-985c-5e71e34fefbe req-028d862d-8313-48d3-8f2c-afd688a7eb34 service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1373966 Dec 21 04:06:19.993788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Attempting to bind port fcfb0f49-b810-49cb-b540-11ba574daf44 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:19.994215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Attempting to bind port fcfb0f49-b810-49cb-b540-11ba574daf44 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '6427c177-442d-45ff-a6ce-8dc6c7a3bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:19.994558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Attempting to bind port fcfb0f49-b810-49cb-b540-11ba574daf44 on network 9a233b83-beaa-465e-8182-8018ddcd60b2 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:19.999129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Port fcfb0f49-b810-49cb-b540-11ba574daf44 on network 9a233b83-beaa-465e-8182-8018ddcd60b2 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:06:20.001841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Attempting to bind port fcfb0f49-b810-49cb-b540-11ba574daf44 on network 9a233b83-beaa-465e-8182-8018ddcd60b2 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:20.022167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 5, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:20.022612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Checking segment: {'id': '6427c177-442d-45ff-a6ce-8dc6c7a3bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:20.023033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Bound using segment: {'id': '6427c177-442d-45ff-a6ce-8dc6c7a3bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:20.023476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Bound port: fcfb0f49-b810-49cb-b540-11ba574daf44, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6427c177-442d-45ff-a6ce-8dc6c7a3bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:20.023825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:20.028473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port cb722c74-363a-414e-b4a1-b8ed8d175d24 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:06:20.031102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89165024-a39d-426c-9745-06b535daa335 req-18710182-6a2e-470e-99be-7dbd1de3f8b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.033048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89165024-a39d-426c-9745-06b535daa335 req-18710182-6a2e-470e-99be-7dbd1de3f8b3 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.0689061 Dec 21 04:06:20.036070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port cb722c74-363a-414e-b4a1-b8ed8d175d24 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:20.036810 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:20.112127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74b94519-257c-4cbe-95e3-7010bf820233 req-cc75ab36-72b1-4551-aa14-bf5e8d781b24 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1094069 Dec 21 04:06:20.136118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-509622e4-664a-4876-8d18-8677f5f304d8 req-c460f848-546b-42fd-88e2-5fd3b1824520 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.138165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-509622e4-664a-4876-8d18-8677f5f304d8 req-c460f848-546b-42fd-88e2-5fd3b1824520 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 943 time: 0.1041343 Dec 21 04:06:20.144307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] For port fcfb0f49-b810-49cb-b540-11ba574daf44, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:20.147495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] For port fcfb0f49-b810-49cb-b540-11ba574daf44, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fcfb0f49-b810-49cb-b540-11ba574daf44,segment=NetworkSegment(6427c177-442d-45ff-a6ce-8dc6c7a3bb24),segment_id=6427c177-442d-45ff-a6ce-8dc6c7a3bb24)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:20.150155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:20.176008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89165024-a39d-426c-9745-06b535daa335 req-7115d1a3-142e-4265-985a-52ce4be80536 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1284299 Dec 21 04:06:20.188462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cb722c74-363a-414e-b4a1-b8ed8d175d24, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:20.211133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-509622e4-664a-4876-8d18-8677f5f304d8 req-6c213d7e-acd0-4fc9-8d43-086f159432ac tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631156 Dec 21 04:06:20.232397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:20.265817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:20.274376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.274376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:20.274376 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] 10.222.0.54 "PUT /v2.0/ports/fcfb0f49-b810-49cb-b540-11ba574daf44 HTTP/1.1" status: 200 len: 1092 time: 1.0120294 Dec 21 04:06:20.275043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'tag': 'fcfb0f49-b810-49cb-b540-11ba574daf44'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:20.277159 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3422b4a3-c8fd-4adf-9310-cb1507f08e90" -d '{"events": [{"name": "network-changed", "server_uuid": "b6521df8-cf97-46fe-b0e8-46b1dc793200", "tag": "fcfb0f49-b810-49cb-b540-11ba574daf44"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:20.313031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22af2116-3ef3-449d-b17b-f7eab627c256 service neutron] Pushing event updated for resources: {'Port': ['ID=fcfb0f49-b810-49cb-b540-11ba574daf44,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:20.344375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=cb722c74-363a-414e-b4a1-b8ed8d175d24,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:20.365137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06278f5f-792a-41c3-ab59-129665bf3288 req-4b14dd74-8a9d-4ff2-9f63-3625ead34262 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.366750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06278f5f-792a-41c3-ab59-129665bf3288 req-4b14dd74-8a9d-4ff2-9f63-3625ead34262 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.0634181 Dec 21 04:06:20.403666 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac9fff5b-a87d-4a9b-8c45-af5fc4dd114b x-openstack-request-id: req-ac9fff5b-a87d-4a9b-8c45-af5fc4dd114b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:20.403666 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6521df8-cf97-46fe-b0e8-46b1dc793200", "tag": "fcfb0f49-b810-49cb-b540-11ba574daf44", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:20.403666 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ac9fff5b-a87d-4a9b-8c45-af5fc4dd114b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:20.403666 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'tag': 'fcfb0f49-b810-49cb-b540-11ba574daf44', 'status': 'completed', 'code': 200} Dec 21 04:06:20.421995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06278f5f-792a-41c3-ab59-129665bf3288 req-eec082bd-55c8-4d1d-8bff-11fc58d7a6e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484653 Dec 21 04:06:20.539687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3422b4a3-c8fd-4adf-9310-cb1507f08e90 req-66db822c-f6ea-4459-bde2-97e071c5534e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.541188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3422b4a3-c8fd-4adf-9310-cb1507f08e90 req-66db822c-f6ea-4459-bde2-97e071c5534e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=5abdaf3416b648eba07ab305383a44a4&device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 1095 time: 0.0414484 Dec 21 04:06:20.672841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b75cae-399f-4e2b-8261-e78205b5953c req-0723a6a7-50f2-4bf1-9f92-6a3f28c627c5 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.674345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5b75cae-399f-4e2b-8261-e78205b5953c req-0723a6a7-50f2-4bf1-9f92-6a3f28c627c5 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 943 time: 0.0610228 Dec 21 04:06:20.723934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5b75cae-399f-4e2b-8261-e78205b5953c req-71572627-d642-4f4c-a522-ba6601c9c03a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433776 Dec 21 04:06:20.727799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3422b4a3-c8fd-4adf-9310-cb1507f08e90 req-44cad9b3-b2d9-4a2d-9f3c-e39507181e0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.729215 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3422b4a3-c8fd-4adf-9310-cb1507f08e90 req-44cad9b3-b2d9-4a2d-9f3c-e39507181e0c service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=5abdaf3416b648eba07ab305383a44a4&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1733866 Dec 21 04:06:20.827730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3422b4a3-c8fd-4adf-9310-cb1507f08e90 req-5cfb0e30-6b59-428d-b3af-03fc139c5696 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.829121 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3422b4a3-c8fd-4adf-9310-cb1507f08e90 req-5cfb0e30-6b59-428d-b3af-03fc139c5696 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0878479 Dec 21 04:06:20.956939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-0b42b306-f5a0-4083-bf5b-5521712ab9b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:20.958418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-0b42b306-f5a0-4083-bf5b-5521712ab9b6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=5abdaf3416b648eba07ab305383a44a4&device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 1095 time: 0.0474510 Dec 21 04:06:21.016631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-d09046fc-e999-4659-898c-2642a3a240f2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fcfb0f49-b810-49cb-b540-11ba574daf44 HTTP/1.1" status: 200 len: 217 time: 0.0352001 Dec 21 04:06:21.068124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-54ae3c1f-8ebf-4fa3-909d-923126703b6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:21.069560 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-54ae3c1f-8ebf-4fa3-909d-923126703b6c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=d38fb055-4fe9-4247-a9d0-c3f177acaee2 HTTP/1.1" status: 200 len: 852 time: 0.0427594 Dec 21 04:06:21.104093 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-6b9c58ff-171b-40c4-8296-d08b12e57448 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9a233b83-beaa-465e-8182-8018ddcd60b2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0255089 Dec 21 04:06:21.236220 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-d0a82266-39e6-4ca3-84c9-1a95bb10302c service neutron] 10.222.0.54 "GET /v2.0/networks/9a233b83-beaa-465e-8182-8018ddcd60b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901909 Dec 21 04:06:21.335751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cf7d87-a83b-4494-b010-1eed7b5b3227 req-8d0b5067-4b11-45ae-a2fb-f2bd28efe84e tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:21.337384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93cf7d87-a83b-4494-b010-1eed7b5b3227 req-8d0b5067-4b11-45ae-a2fb-f2bd28efe84e tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.0763772 Dec 21 04:06:21.368819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c15e90b-225b-41aa-b968-7d6af2c24685 req-b1fd4518-c5d0-4198-88ce-0dae36a19306 service neutron] 10.222.0.54 "GET /v2.0/networks/9a233b83-beaa-465e-8182-8018ddcd60b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1158509 Dec 21 04:06:21.396782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aeb12ef-a763-4227-8c08-866fa96f90ce req-ac372bd0-ef48-498e-a7a5-baca43a0f6a5 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:21.399644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aeb12ef-a763-4227-8c08-866fa96f90ce req-ac372bd0-ef48-498e-a7a5-baca43a0f6a5 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 943 time: 0.0843596 Dec 21 04:06:21.438343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93cf7d87-a83b-4494-b010-1eed7b5b3227 req-b2682d08-f027-4551-8b93-94de803c2f9d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0874441 Dec 21 04:06:21.474438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aeb12ef-a763-4227-8c08-866fa96f90ce req-f66ae042-0378-4430-9a31-ff2c55c666ea tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673401 Dec 21 04:06:21.553416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c777fd-f932-4d74-8cbc-463887ed1cf2 req-c173b46e-92d8-4731-8f5c-15449f64ac80 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:21.554951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2c777fd-f932-4d74-8cbc-463887ed1cf2 req-c173b46e-92d8-4731-8f5c-15449f64ac80 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.0532031 Dec 21 04:06:21.605880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2c777fd-f932-4d74-8cbc-463887ed1cf2 req-7d7d76fe-5dcb-4b41-8c06-19548a75d4dc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449286 Dec 21 04:06:21.757959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb722c74-363a-414e-b4a1-b8ed8d175d24'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:21.761244 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ac19f8e-edf4-4e1e-b94c-825707609805" -d '{"events": [{"server_uuid": "36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4", "name": "network-vif-plugged", "status": "completed", "tag": "cb722c74-363a-414e-b4a1-b8ed8d175d24"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:21.797859 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff7ed0f5-42f5-4d70-96f5-4ab86e12176f x-openstack-request-id: req-ff7ed0f5-42f5-4d70-96f5-4ab86e12176f {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:21.798393 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4", "name": "network-vif-plugged", "status": "completed", "tag": "cb722c74-363a-414e-b4a1-b8ed8d175d24", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:21.798720 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ff7ed0f5-42f5-4d70-96f5-4ab86e12176f {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:21.799213 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb722c74-363a-414e-b4a1-b8ed8d175d24', 'code': 200} Dec 21 04:06:21.845013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f86b5cf-7a85-472f-924c-047420b9c84b req-33cc4b35-275d-4f4e-a2ac-4f866ef5d4a0 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:21.846621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f86b5cf-7a85-472f-924c-047420b9c84b req-33cc4b35-275d-4f4e-a2ac-4f866ef5d4a0 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 943 time: 0.0492585 Dec 21 04:06:21.897567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f86b5cf-7a85-472f-924c-047420b9c84b req-6b8da628-ac46-4d0e-b8d3-89c268821b6f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444331 Dec 21 04:06:21.940947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e649176-a713-4bf7-8051-b516efcc55b5 req-148e6539-90cf-4fef-8892-992c68e71be9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:21.942340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e649176-a713-4bf7-8051-b516efcc55b5 req-148e6539-90cf-4fef-8892-992c68e71be9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 1098 time: 0.0386908 Dec 21 04:06:21.993181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e649176-a713-4bf7-8051-b516efcc55b5 req-c3c4484d-e3b0-4745-aeda-1bb350cb3d93 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417686 Dec 21 04:06:22.570422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9841b257-b511-4d90-a5ab-909ce7ed83c8 req-9b18f415-21dd-4db9-88d9-f2f90775f172 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:22.572007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9841b257-b511-4d90-a5ab-909ce7ed83c8 req-9b18f415-21dd-4db9-88d9-f2f90775f172 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.0621696 Dec 21 04:06:22.635294 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735a1b33-56a2-453a-83ee-df9faa1d79e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:22.645970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d16fa8-ab94-421c-8f04-0f3bab9af09b req-38c65763-00ee-408b-a70a-b7aee1eafb08 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:22.645970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49d16fa8-ab94-421c-8f04-0f3bab9af09b req-38c65763-00ee-408b-a70a-b7aee1eafb08 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 943 time: 0.0907598 Dec 21 04:06:22.677700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9841b257-b511-4d90-a5ab-909ce7ed83c8 req-fba641ef-cd4f-4435-9527-4bcdfd8ea41f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0912204 Dec 21 04:06:22.708666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49d16fa8-ab94-421c-8f04-0f3bab9af09b req-6b5eddec-c2f9-45cb-b7ba-6be02927c273 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584099 Dec 21 04:06:22.749746 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:22.813148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1e51c7-4453-47bb-9b35-aaaf9e3b01e3 req-ebbda3be-fcc9-478c-ab47-53e4204b0019 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:22.814762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff1e51c7-4453-47bb-9b35-aaaf9e3b01e3 req-ebbda3be-fcc9-478c-ab47-53e4204b0019 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.0775340 Dec 21 04:06:22.832127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3eaaa62-16c1-4030-a1b8-8a75c6c61fef req-67990edb-ee8c-4cae-b3b7-6c21cdae269d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:22.833690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3eaaa62-16c1-4030-a1b8-8a75c6c61fef req-67990edb-ee8c-4cae-b3b7-6c21cdae269d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.0675840 Dec 21 04:06:22.904726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff1e51c7-4453-47bb-9b35-aaaf9e3b01e3 req-4a4f0e2c-567d-4dc0-a432-7fb2becf574a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700419 Dec 21 04:06:22.921993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3eaaa62-16c1-4030-a1b8-8a75c6c61fef req-b1bcfd97-ce0d-4edf-803f-4e62ef163550 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0807295 Dec 21 04:06:23.070434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e5bb02-969e-480a-959c-63358608ace7 req-43fdc166-ec52-4384-928a-8e5bda0e3a1e tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:23.072151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3e5bb02-969e-480a-959c-63358608ace7 req-43fdc166-ec52-4384-928a-8e5bda0e3a1e tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 943 time: 0.0921376 Dec 21 04:06:23.074186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0139988-f7f5-4e65-ac75-4546bd12b1f7 req-46a857f2-a204-43ff-986c-771de2c32fae tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:23.075716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0139988-f7f5-4e65-ac75-4546bd12b1f7 req-46a857f2-a204-43ff-986c-771de2c32fae tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1136 time: 0.0844660 Dec 21 04:06:23.109156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0139988-f7f5-4e65-ac75-4546bd12b1f7 req-470f9ddd-fc94-436a-a5e7-ff4edba751c7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.153416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3e5bb02-969e-480a-959c-63358608ace7 req-b29b00cf-36b1-434c-b73b-6ea14b20cf0d tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701673 Dec 21 04:06:23.218857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0139988-f7f5-4e65-ac75-4546bd12b1f7 req-470f9ddd-fc94-436a-a5e7-ff4edba751c7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.254475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.304701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a0139988-f7f5-4e65-ac75-4546bd12b1f7 req-470f9ddd-fc94-436a-a5e7-ff4edba751c7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.352265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470f9ddd-fc94-436a-a5e7-ff4edba751c7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9feecb5f-c05f-466d-882e-5b4b440a2a04,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:23.367224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0139988-f7f5-4e65-ac75-4546bd12b1f7 req-470f9ddd-fc94-436a-a5e7-ff4edba751c7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.2833667 Dec 21 04:06:23.382862 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48934) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:23.429217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84b3ec8c-d53d-4e75-8929-e158bd1502cf tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:23.430893 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84b3ec8c-d53d-4e75-8929-e158bd1502cf tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1131 time: 0.0461507 Dec 21 04:06:23.433949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48936) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:23.438148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:23.461010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b5ef7827-00e7-4327-b7b1-fdbfa2289064 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:06:23.543734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.558015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b5ef7827-00e7-4327-b7b1-fdbfa2289064, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b5ef7827-00e7-4327-b7b1-fdbfa2289064,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:23.569081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'port_id': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064', 'mac_address': 'fa:16:3e:57:dd:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6eb37b9-316b-4d85-9044-455f8831b074', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:06:23.606887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.627945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b5ef7827-00e7-4327-b7b1-fdbfa2289064 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:23.644621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.655296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b5ef7827-00e7-4327-b7b1-fdbfa2289064, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b5ef7827-00e7-4327-b7b1-fdbfa2289064,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:23.732856 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.755739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.25.5.229 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/5a65f107-c78b-4f56-b677-80b71ec85ff9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:23.816471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=b5ef7827-00e7-4327-b7b1-fdbfa2289064,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:23.852818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b36710-28af-4f2f-a4cf-55ebdbd12477 req-476c8535-c4c9-4a7f-9c66-80e8d07bd212 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:23.854849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3b36710-28af-4f2f-a4cf-55ebdbd12477 req-476c8535-c4c9-4a7f-9c66-80e8d07bd212 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 943 time: 0.0633392 Dec 21 04:06:23.874240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:23.906020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3b36710-28af-4f2f-a4cf-55ebdbd12477 req-3aceb868-9e5d-45d9-af74-1f440affb0e3 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419741 Dec 21 04:06:23.955770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:24.002219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:24.005140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:24.008641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:24.014185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=5a65f107-c78b-4f56-b677-80b71ec85ff9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:24.037925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b3c3a47-2f71-4188-90ee-136375087511 req-5e59f197-75ff-489a-851d-d9bf78c650bf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:24.040631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b3c3a47-2f71-4188-90ee-136375087511 req-5e59f197-75ff-489a-851d-d9bf78c650bf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.0526319 Dec 21 04:06:24.093869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b3c3a47-2f71-4188-90ee-136375087511 req-1efece6c-d72a-4666-ab11-504c83faa2dd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465248 Dec 21 04:06:24.115015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['b5ef7827-00e7-4327-b7b1-fdbfa2289064'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:24.275256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03fea39-f448-4804-a1c6-920dd513f15b req-6bbd702d-3065-41e9-ae4b-8519e1011eb5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:24.283842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b03fea39-f448-4804-a1c6-920dd513f15b req-6bbd702d-3065-41e9-ae4b-8519e1011eb5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.1102731 Dec 21 04:06:24.367928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b03fea39-f448-4804-a1c6-920dd513f15b req-7eb80359-f489-415e-bff4-2f34b092945b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0827382 Dec 21 04:06:24.384410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1399e553-f89c-42de-95a7-cb302b3f53c1 req-832930c9-4230-41f5-a9b6-a2ad225271a4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:24.384410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1399e553-f89c-42de-95a7-cb302b3f53c1 req-832930c9-4230-41f5-a9b6-a2ad225271a4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 944 time: 0.0960596 Dec 21 04:06:24.438556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1399e553-f89c-42de-95a7-cb302b3f53c1 req-0b45f914-da20-4958-bd83-e2dec48c8685 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454047 Dec 21 04:06:24.715505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:24.832059 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:24.977282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:24.992522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:25.000991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:25.042684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d80267-c288-4c21-ae30-5a567b3013b7 req-90f6bd2f-ff37-4b2a-bddd-211f5990de4d tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.044404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79d80267-c288-4c21-ae30-5a567b3013b7 req-90f6bd2f-ff37-4b2a-bddd-211f5990de4d tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 943 time: 0.0572796 Dec 21 04:06:25.058925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:25.100768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-79d80267-c288-4c21-ae30-5a567b3013b7 req-60e72b69-e585-4ace-81d6-adcabf20ffe4 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497990 Dec 21 04:06:25.127945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=5a65f107-c78b-4f56-b677-80b71ec85ff9,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:25.147263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:25.248000 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Floating IP dae2c1c7-c756-4bb0-85f6-674d058305ae associated. External IP: 172.25.5.229, port: 2d618554-ce8e-426e-a17d-9f52e0c87be9. Dec 21 04:06:25.449170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 028fa46c-cc11-488f-bfda-28719307241e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:06:25.464127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fcfb0f49-b810-49cb-b540-11ba574daf44 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:06:25.473134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b5ef7827-00e7-4327-b7b1-fdbfa2289064 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:25.571497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:06:25.571858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-916a0b57-5679-483a-ae01-6c415510a093 req-21db6ca7-7a60-47bd-bd8e-d961bbfee7c2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.573527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-916a0b57-5679-483a-ae01-6c415510a093 req-21db6ca7-7a60-47bd-bd8e-d961bbfee7c2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 944 time: 0.0563602 Dec 21 04:06:25.601293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] Sync routers for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:06:25.625741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:25.626391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:25.661307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-916a0b57-5679-483a-ae01-6c415510a093 req-d7aa38ac-922c-443c-af39-1e521c507e09 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726318 Dec 21 04:06:25.688728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:25.718517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-71a5dbeb-937c-4419-9adb-bb2fc7b74005 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2835407 Dec 21 04:06:25.719324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:25.721250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48966) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:25.721750 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e229d4df-cbfa-473a-9837-409792d2383d" -d '{"events": [{"name": "network-changed", "server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:25.760102 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f66b1076-11d0-40fd-bd71-1c7f4d83efa2 x-openstack-request-id: req-f66b1076-11d0-40fd-bd71-1c7f4d83efa2 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:25.760403 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:25.760660 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f66b1076-11d0-40fd-bd71-1c7f4d83efa2 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:25.761074 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'status': 'completed', 'code': 200} Dec 21 04:06:25.841611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port b5ef7827-00e7-4327-b7b1-fdbfa2289064 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:06:25.856596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e229d4df-cbfa-473a-9837-409792d2383d req-8354aa65-1cc9-4fe1-bf33-3deaed595217 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.858371 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-8354aa65-1cc9-4fe1-bf33-3deaed595217 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1136 time: 0.0498450 Dec 21 04:06:25.873462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port b5ef7827-00e7-4327-b7b1-fdbfa2289064 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:25.873972 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:25.880897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port fcfb0f49-b810-49cb-b540-11ba574daf44, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fcfb0f49-b810-49cb-b540-11ba574daf44,segment=NetworkSegment(6427c177-442d-45ff-a6ce-8dc6c7a3bb24),segment_id=6427c177-442d-45ff-a6ce-8dc6c7a3bb24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:25.886669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:25.961603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'fcfb0f49-b810-49cb-b540-11ba574daf44', 'network_id': '9a233b83-beaa-465e-8182-8018ddcd60b2', 'port_id': 'fcfb0f49-b810-49cb-b540-11ba574daf44', 'mac_address': 'fa:16:3e:c8:53:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd38fb055-4fe9-4247-a9d0-c3f177acaee2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:06:25.963566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.964036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.964503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.965053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.965399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.965844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.966286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.967014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.967867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.968488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.968940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.969878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.969878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:25.975356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-57d28292-ddc9-4ffb-9f38-df2c4aa18624 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 9142 time: 0.2496984 Dec 21 04:06:25.977161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48972) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:25.991980 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:26.049613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:26.089923 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:26.148415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fcfb0f49-b810-49cb-b540-11ba574daf44 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:26.198890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e229d4df-cbfa-473a-9837-409792d2383d req-b67497ce-4c7b-41e1-b239-42b6a703ed53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.200450 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-b67497ce-4c7b-41e1-b239-42b6a703ed53 service neutron] 10.222.0.54 "GET /v2.0/networks?id=7676bcbc-538f-4f82-a6a5-13d33001856e HTTP/1.1" status: 200 len: 897 time: 0.3331826 Dec 21 04:06:26.227493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port fcfb0f49-b810-49cb-b540-11ba574daf44, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fcfb0f49-b810-49cb-b540-11ba574daf44,segment=NetworkSegment(6427c177-442d-45ff-a6ce-8dc6c7a3bb24),segment_id=6427c177-442d-45ff-a6ce-8dc6c7a3bb24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:26.229667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:26.263705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:26.266098 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ba6f81d-b606-4d82-a87e-71854b8373ad" -d '{"events": [{"server_uuid": "c62a8e3a-359f-4a1f-92b2-6cfa85603fcf", "name": "network-vif-plugged", "status": "completed", "tag": "b5ef7827-00e7-4327-b7b1-fdbfa2289064"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:26.305177 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:26.313780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b5ef7827-00e7-4327-b7b1-fdbfa2289064, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b5ef7827-00e7-4327-b7b1-fdbfa2289064,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:26.342662 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ebc4f15-6bd2-4323-8ff3-24dd28c3a77c x-openstack-request-id: req-1ebc4f15-6bd2-4323-8ff3-24dd28c3a77c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:26.343011 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c62a8e3a-359f-4a1f-92b2-6cfa85603fcf", "name": "network-vif-plugged", "status": "completed", "tag": "b5ef7827-00e7-4327-b7b1-fdbfa2289064", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:26.343242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1ebc4f15-6bd2-4323-8ff3-24dd28c3a77c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:26.343644 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064', 'code': 200} Dec 21 04:06:26.379439 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:26.419106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=fcfb0f49-b810-49cb-b540-11ba574daf44,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:26.427318 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-45ecd5cf-4a57-4b33-b579-a18b3cadfed7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9 HTTP/1.1" status: 200 len: 999 time: 0.2110753 Dec 21 04:06:26.532605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=b5ef7827-00e7-4327-b7b1-fdbfa2289064,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:26.558893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'dae2c1c7-c756-4bb0-85f6-674d058305ae', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'floating_ip_address': '172.25.5.229', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '028fa46c-cc11-488f-bfda-28719307241e', 'port_id': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 2489, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'mac_address': 'fa:16:3e:e3:50:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:06:24Z', 'updated_at': '2021-12-21T04:06:24Z', 'revision_number': 0, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:26.593079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e229d4df-cbfa-473a-9837-409792d2383d req-6159a155-5de3-4a4b-b983-c0910d44793f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.594344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.594948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.595809 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-6159a155-5de3-4a4b-b983-c0910d44793f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=51cbe5f4-3d45-4b4f-a219-d8b88c9871e3 HTTP/1.1" status: 200 len: 834 time: 0.1101758 Dec 21 04:06:26.596038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.596498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] Checking router: 028fa46c-cc11-488f-bfda-28719307241e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:06:26.596706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.597682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.604472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6931e43f-b868-48fe-bfa7-c6200027fe0b tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 8353 time: 0.6261454 Dec 21 04:06:26.607805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48984) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:26.611304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:26.618455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:26.649904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de82d7e-bbc5-431a-b11b-76f49f8ea3c3 req-eb82b81e-f553-4cbb-a53c-367967d2c6c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.651712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4de82d7e-bbc5-431a-b11b-76f49f8ea3c3 req-eb82b81e-f553-4cbb-a53c-367967d2c6c3 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 1097 time: 0.1565647 Dec 21 04:06:26.706878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1996afcc-a285-4990-b7ce-716013daca1e req-874fa81c-1d04-43c4-83e1-639185f4ba7b tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.708512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1996afcc-a285-4990-b7ce-716013daca1e req-874fa81c-1d04-43c4-83e1-639185f4ba7b tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 944 time: 0.1937962 Dec 21 04:06:26.792905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e229d4df-cbfa-473a-9837-409792d2383d req-052a59c4-2a7f-4602-a470-379009711ca2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.794283 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-052a59c4-2a7f-4602-a470-379009711ca2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=7676bcbc-538f-4f82-a6a5-13d33001856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1592784 Dec 21 04:06:26.818508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:26.828612 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4de82d7e-bbc5-431a-b11b-76f49f8ea3c3 req-bd6630ea-f1bc-4646-9356-9db31e1d0d53 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1548357 Dec 21 04:06:26.834007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1996afcc-a285-4990-b7ce-716013daca1e req-b88bc6e7-2a3a-4c34-a68f-6ec234a96da6 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182904 Dec 21 04:06:26.862600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['fcfb0f49-b810-49cb-b540-11ba574daf44'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:26.933007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af100b33-fe2e-41e4-82dc-dc2905698f3c req-9d5c1e26-fb74-49cc-b11f-140050ee77ff tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:26.934696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af100b33-fe2e-41e4-82dc-dc2905698f3c req-9d5c1e26-fb74-49cc-b11f-140050ee77ff tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 945 time: 0.1484592 Dec 21 04:06:26.996453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-73c55ca7-0b0f-4a5b-b9fa-4d42505e70b7 service neutron] 10.222.0.54 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1909862 Dec 21 04:06:27.035917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af100b33-fe2e-41e4-82dc-dc2905698f3c req-be8f201f-5ab3-4fa2-a0aa-4d7aab7b2205 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923836 Dec 21 04:06:27.065162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-604bb428-4b52-481d-afa8-9dd5e26ce0dc tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 4502 time: 0.4567919 Dec 21 04:06:27.068247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:27.095651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:27.115771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f0bbee8-2368-4c8f-ab07-1e8b502aeb43 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:27.117106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f0bbee8-2368-4c8f-ab07-1e8b502aeb43 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:27.119227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0f0bbee8-2368-4c8f-ab07-1e8b502aeb43 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=028fa46c-cc11-488f-bfda-28719307241e HTTP/1.1" status: 200 len: 1992 time: 0.0497420 Dec 21 04:06:27.297457 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e229d4df-cbfa-473a-9837-409792d2383d req-a3e0d941-8819-4ccd-8c71-654452342d35 service neutron] 10.222.0.54 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1466272 Dec 21 04:06:27.341947 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'dae2c1c7-c756-4bb0-85f6-674d058305ae', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'floating_ip_address': '172.25.5.229', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '028fa46c-cc11-488f-bfda-28719307241e', 'port_id': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 2489, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'mac_address': 'fa:16:3e:e3:50:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:06:24Z', 'updated_at': '2021-12-21T04:06:24Z', 'revision_number': 0, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:27.374720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-413906ee-80b8-4a10-8fcb-dc0f440be14b None None] The sync data for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 is: [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'dae2c1c7-c756-4bb0-85f6-674d058305ae', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'floating_ip_address': '172.25.5.229', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '028fa46c-cc11-488f-bfda-28719307241e', 'port_id': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 2489, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'mac_address': 'fa:16:3e:e3:50:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:06:24Z', 'updated_at': '2021-12-21T04:06:24Z', 'revision_number': 0, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:06:27.468260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.20.0.17 (aa9d5090-f8cc-472f-a4a3-d525f12a8bf8/75097d59-9114-4d6a-ab49-443c57e1f8de/6ad0d080-cd27-4f22-a04f-fcb471630f55) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:27.589750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:27.616902 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e70376eb-126e-44ab-a95b-bfe3a503330d None None] New status for floating IP dae2c1c7-c756-4bb0-85f6-674d058305ae: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:06:27.715725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:27.760348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:27.763567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:27.767371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:27.801618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=6ad0d080-cd27-4f22-a04f-fcb471630f55,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:27.824532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:28.007542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66746c3-25c5-4ce5-b925-6fa51fa8e7c0 req-68381ea9-b7af-4d40-95ab-44df9ef61ab9 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:28.009107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c66746c3-25c5-4ce5-b925-6fa51fa8e7c0 req-68381ea9-b7af-4d40-95ab-44df9ef61ab9 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 944 time: 0.0605156 Dec 21 04:06:28.066211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c66746c3-25c5-4ce5-b925-6fa51fa8e7c0 req-e1601add-7da8-4609-a22e-dd518bfddcb0 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510821 Dec 21 04:06:28.088295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:28.130171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5f483dce-453a-43b5-9211-e580410e6edc None None] Provisioning complete for port 6ad0d080-cd27-4f22-a04f-fcb471630f55 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:28.130708 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f483dce-453a-43b5-9211-e580410e6edc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:28.168354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5f483dce-453a-43b5-9211-e580410e6edc None None] Port 6ad0d080-cd27-4f22-a04f-fcb471630f55 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:06:28.241898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821100db-c98a-4680-92e9-9e9e948234b5 req-14de1319-e652-4221-b30c-5bbdbd545a9a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:28.243870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-821100db-c98a-4680-92e9-9e9e948234b5 req-14de1319-e652-4221-b30c-5bbdbd545a9a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 945 time: 0.0586650 Dec 21 04:06:28.297191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-821100db-c98a-4680-92e9-9e9e948234b5 req-ebc3cc02-279d-4b86-b836-0811efd17429 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468543 Dec 21 04:06:28.658357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:28.716872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:28.794872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=6ad0d080-cd27-4f22-a04f-fcb471630f55,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:28.798465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:28.888059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:28.890523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:29.017854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:06:29.146277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:06:29.154589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:06:29.155210 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-13be8afc-06ad-4ad6-b8b0-be7cd3ae3ac2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "PUT /v2.0/routers/2191bc86-3ede-4925-a826-67ac34d6fe52/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2667253 Dec 21 04:06:29.173581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:29.174236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:29.213253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae61d902-120e-4b84-ae5e-ff3bf7ce6e6d req-b04d0329-2d5e-4914-89cd-3b3aa06f45b7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:29.214870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae61d902-120e-4b84-ae5e-ff3bf7ce6e6d req-b04d0329-2d5e-4914-89cd-3b3aa06f45b7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 944 time: 0.0655775 Dec 21 04:06:29.263790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae61d902-120e-4b84-ae5e-ff3bf7ce6e6d req-b7cc0e92-be91-4f14-869c-f673265a6d4c tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430782 Dec 21 04:06:29.270562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8508b292-e1a3-4241-ae28-89f9ff8cbf9b None None] Provisioning complete for port 6ad0d080-cd27-4f22-a04f-fcb471630f55 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:29.270977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8508b292-e1a3-4241-ae28-89f9ff8cbf9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:29.324734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:29.327099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8508b292-e1a3-4241-ae28-89f9ff8cbf9b None None] Port 6ad0d080-cd27-4f22-a04f-fcb471630f55 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:06:29.425529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-043788ca-a697-4f5f-9b65-d15445d523b9 req-cc61706b-31b7-40a0-9ad0-3da5cba41241 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:29.429609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-043788ca-a697-4f5f-9b65-d15445d523b9 req-cc61706b-31b7-40a0-9ad0-3da5cba41241 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 945 time: 0.0553000 Dec 21 04:06:29.479128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-043788ca-a697-4f5f-9b65-d15445d523b9 req-afd1bbc4-25fe-4982-9160-664e2c2c583b tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445092 Dec 21 04:06:29.511946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fcfb0f49-b810-49cb-b540-11ba574daf44 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:29.695561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port fcfb0f49-b810-49cb-b540-11ba574daf44 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:06:29.705964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port fcfb0f49-b810-49cb-b540-11ba574daf44 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:29.706129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:29.828766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:27Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:15Z', 'revision_number': 1, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6ad0d080-cd27-4f22-a04f-fcb471630f55', 'name': '', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:51:f1:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2490, 'fixed_ips': [{'subnet_id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:06:27Z', 'updated_at': '2021-12-21T04:06:28Z', 'revision_number': 2, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:29.834028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:29.865868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:06:29.866233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Updating router 2191bc86-3ede-4925-a826-67ac34d6fe52 port 6ad0d080-cd27-4f22-a04f-fcb471630f55 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:06:29.899504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcfb0f49-b810-49cb-b540-11ba574daf44'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:29.901697 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68725703-bda7-4e59-87a3-aa968b4cec05" -d '{"events": [{"server_uuid": "b6521df8-cf97-46fe-b0e8-46b1dc793200", "name": "network-vif-plugged", "status": "completed", "tag": "fcfb0f49-b810-49cb-b540-11ba574daf44"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:29.918706 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:29.918706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port fcfb0f49-b810-49cb-b540-11ba574daf44, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fcfb0f49-b810-49cb-b540-11ba574daf44,segment=NetworkSegment(6427c177-442d-45ff-a6ce-8dc6c7a3bb24),segment_id=6427c177-442d-45ff-a6ce-8dc6c7a3bb24)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:29.951826 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcd4bda7-67ac-4b58-9f85-a27ed13af2a5 x-openstack-request-id: req-fcd4bda7-67ac-4b58-9f85-a27ed13af2a5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:29.952123 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6521df8-cf97-46fe-b0e8-46b1dc793200", "name": "network-vif-plugged", "status": "completed", "tag": "fcfb0f49-b810-49cb-b540-11ba574daf44", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:29.952385 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fcd4bda7-67ac-4b58-9f85-a27ed13af2a5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:29.952779 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcfb0f49-b810-49cb-b540-11ba574daf44', 'code': 200} Dec 21 04:06:30.043389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.132881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adabfa7e-e44c-4af0-beb4-7a7b77efb53f req-7bc5e961-9b18-4c4b-b35b-40f384cdac5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:30.135577 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adabfa7e-e44c-4af0-beb4-7a7b77efb53f req-7bc5e961-9b18-4c4b-b35b-40f384cdac5e service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 1097 time: 0.0549791 Dec 21 04:06:30.176202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=fcfb0f49-b810-49cb-b540-11ba574daf44,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:30.218322 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-adabfa7e-e44c-4af0-beb4-7a7b77efb53f req-f8faa872-0338-4be7-81bb-8020b712d585 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661523 Dec 21 04:06:30.274123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.333833 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.381198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fda35c-5f3c-4570-86c4-049a94e5061b None None] Pushing event updated for resources: {'Port': ['ID=6ad0d080-cd27-4f22-a04f-fcb471630f55,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:30.389502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2b284a-2b7c-4460-906d-e1857e2623d4 req-7578ad29-152a-4e23-8bff-9efdfbc65dbf tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:30.393180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f2b284a-2b7c-4460-906d-e1857e2623d4 req-7578ad29-152a-4e23-8bff-9efdfbc65dbf tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 945 time: 0.0599835 Dec 21 04:06:30.460782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Attempting to bind port 6ad0d080-cd27-4f22-a04f-fcb471630f55 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:30.461674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Attempting to bind port 6ad0d080-cd27-4f22-a04f-fcb471630f55 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:30.462058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Attempting to bind port 6ad0d080-cd27-4f22-a04f-fcb471630f55 on network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:30.468455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 6, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:30.469475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Checking segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:30.469475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.469693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Bound using segment: {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:30.470091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Bound port: 6ad0d080-cd27-4f22-a04f-fcb471630f55, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dbf60732-7b9f-43e5-a156-27425418435d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:30.470632 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.472503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f2b284a-2b7c-4460-906d-e1857e2623d4 req-d5ea08dd-e496-4b9b-8f83-8cfbbc783b86 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645249 Dec 21 04:06:30.550536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] For port 6ad0d080-cd27-4f22-a04f-fcb471630f55, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:30.554460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] For port 6ad0d080-cd27-4f22-a04f-fcb471630f55, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6ad0d080-cd27-4f22-a04f-fcb471630f55,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:30.635610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.703408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40cb1c9f-e5f9-4271-823a-0cb83ccd172d None None] Provisioning complete for port 6ad0d080-cd27-4f22-a04f-fcb471630f55 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:30.703702 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40cb1c9f-e5f9-4271-823a-0cb83ccd172d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:30.708338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fda35c-5f3c-4570-86c4-049a94e5061b None None] Pushing event updated for resources: {'Port': ['ID=6ad0d080-cd27-4f22-a04f-fcb471630f55,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:30.731655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:30.733425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:30.883887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:30.926079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40cb1c9f-e5f9-4271-823a-0cb83ccd172d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:31.006959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-40cb1c9f-e5f9-4271-823a-0cb83ccd172d None None] For port 6ad0d080-cd27-4f22-a04f-fcb471630f55, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6ad0d080-cd27-4f22-a04f-fcb471630f55,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:31.076223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40cb1c9f-e5f9-4271-823a-0cb83ccd172d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:31.170684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40cb1c9f-e5f9-4271-823a-0cb83ccd172d None None] Pushing event updated for resources: {'Port': ['ID=6ad0d080-cd27-4f22-a04f-fcb471630f55,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:31.204911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b333387f-b758-43e0-8b16-fd226c96d255 None None] Provisioning complete for port 6ad0d080-cd27-4f22-a04f-fcb471630f55 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:31.205960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b333387f-b758-43e0-8b16-fd226c96d255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:31.241330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:27Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:15Z', 'revision_number': 1, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6ad0d080-cd27-4f22-a04f-fcb471630f55', 'name': '', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:51:f1:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2490, 'fixed_ips': [{'subnet_id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:06:27Z', 'updated_at': '2021-12-21T04:06:30Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:31.274804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aacd0ab2-947c-418c-bec4-bb664a87a434 None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:27Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:15Z', 'revision_number': 1, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6ad0d080-cd27-4f22-a04f-fcb471630f55', 'name': '', 'network_id': 'aa9d5090-f8cc-472f-a4a3-d525f12a8bf8', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:51:f1:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2490, 'fixed_ips': [{'subnet_id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:06:27Z', 'updated_at': '2021-12-21T04:06:30Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '75097d59-9114-4d6a-ab49-443c57e1f8de', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:06:31.593981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336457d5-6090-4f0f-b242-604e23f8ee0d req-399c98fd-4788-4ad1-9413-13832345adc4 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:31.601983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-336457d5-6090-4f0f-b242-604e23f8ee0d req-399c98fd-4788-4ad1-9413-13832345adc4 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 945 time: 0.0588801 Dec 21 04:06:31.650707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-336457d5-6090-4f0f-b242-604e23f8ee0d req-8a23dc05-0e4c-480b-abe5-5b534981fe62 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477598 Dec 21 04:06:32.772249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de40c86b-fff8-4254-9600-cbf5a5d9aa41 req-5d91b529-c8ee-4497-b54e-91410e91ffe7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:32.773752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de40c86b-fff8-4254-9600-cbf5a5d9aa41 req-5d91b529-c8ee-4497-b54e-91410e91ffe7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 945 time: 0.0500495 Dec 21 04:06:32.820972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de40c86b-fff8-4254-9600-cbf5a5d9aa41 req-dbccaae8-c231-4f9c-baad-77a4e915ba32 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412102 Dec 21 04:06:32.855801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:06:33.021334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6ad0d080-cd27-4f22-a04f-fcb471630f55 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:33.130378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6ad0d080-cd27-4f22-a04f-fcb471630f55 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:33.130756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:33.580908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a6fd46-7975-4253-91ab-8b53702fa2e0 req-487caf54-0db8-45e3-9b02-159b26f2bfef tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:33.583575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2a6fd46-7975-4253-91ab-8b53702fa2e0 req-487caf54-0db8-45e3-9b02-159b26f2bfef tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 945 time: 0.0541809 Dec 21 04:06:33.633075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2a6fd46-7975-4253-91ab-8b53702fa2e0 req-f3225641-3f5f-4d3c-aa5a-390770936fa7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438583 Dec 21 04:06:34.755756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46fafeb4-72db-4e93-a909-1ed826ca63cd req-25838ca5-52f9-4273-bf23-5192b1902f8c tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:34.757281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46fafeb4-72db-4e93-a909-1ed826ca63cd req-25838ca5-52f9-4273-bf23-5192b1902f8c tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 945 time: 0.0503404 Dec 21 04:06:34.805020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-46fafeb4-72db-4e93-a909-1ed826ca63cd req-f60583e4-81fe-4cd9-bb5e-7873eb1b610b tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/security-groups?id=f1ea097b-3476-4816-9825-b6fc157739ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415189 Dec 21 04:06:35.192219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-b330716a-3b52-4d5b-ac3f-e870336a5a37 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:35.195475 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-b330716a-3b52-4d5b-ac3f-e870336a5a37 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.54 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 945 time: 0.0624804 Dec 21 04:06:35.294984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Deleting port fcfb0f49-b810-49cb-b540-11ba574daf44 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:35.295526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:35.412826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] For port fcfb0f49-b810-49cb-b540-11ba574daf44, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fcfb0f49-b810-49cb-b540-11ba574daf44,segment=NetworkSegment(6427c177-442d-45ff-a6ce-8dc6c7a3bb24),segment_id=6427c177-442d-45ff-a6ce-8dc6c7a3bb24)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:35.413422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:35.425535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Calling delete_port for fcfb0f49-b810-49cb-b540-11ba574daf44 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:35.618309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:35.647689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Pushing event deleted for resources: {'Port': ['ID=fcfb0f49-b810-49cb-b540-11ba574daf44,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:35.665246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['fcfb0f49-b810-49cb-b540-11ba574daf44'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:35.710464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] No DVR routers for this DVR port fcfb0f49-b810-49cb-b540-11ba574daf44 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:06:35.714375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:35.717784 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-008962b5-c51b-40f5-a66c-6861d7e264d8 req-9c5c6c8e-a33d-45b6-844d-3037e28790f7 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.54 "DELETE /v2.0/ports/fcfb0f49-b810-49cb-b540-11ba574daf44 HTTP/1.1" status: 204 len: 173 time: 0.5135007 Dec 21 04:06:35.718261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'name': 'network-vif-deleted', 'tag': 'fcfb0f49-b810-49cb-b540-11ba574daf44'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:35.721839 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e358565-dd5c-4303-bef4-dcc4296f601a" -d '{"events": [{"server_uuid": "b6521df8-cf97-46fe-b0e8-46b1dc793200", "name": "network-vif-deleted", "tag": "fcfb0f49-b810-49cb-b540-11ba574daf44"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:35.762227 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-310cc496-6bd6-4040-bf07-934e6292630f x-openstack-request-id: req-310cc496-6bd6-4040-bf07-934e6292630f {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:35.762513 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6521df8-cf97-46fe-b0e8-46b1dc793200", "name": "network-vif-deleted", "tag": "fcfb0f49-b810-49cb-b540-11ba574daf44", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:35.762769 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-310cc496-6bd6-4040-bf07-934e6292630f {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:35.763211 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6521df8-cf97-46fe-b0e8-46b1dc793200', 'name': 'network-vif-deleted', 'tag': 'fcfb0f49-b810-49cb-b540-11ba574daf44', 'status': 'completed', 'code': 200} Dec 21 04:06:35.904810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42e53419-f6fa-460e-8b8d-0d0a42b29869 req-7e3404de-9686-47df-86e0-bdc3e2710b71 tempest-ServerPasswordTestJSON-1307374309 tempest-ServerPasswordTestJSON-1307374309-project] 10.222.0.18 "GET /v2.0/ports?device_id=b6521df8-cf97-46fe-b0e8-46b1dc793200 HTTP/1.1" status: 200 len: 210 time: 0.0282431 Dec 21 04:06:36.702985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-d3f05b51-d8f1-4bc1-945a-65c68de0534e tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:36.704525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-d3f05b51-d8f1-4bc1-945a-65c68de0534e tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.1074538 Dec 21 04:06:36.721058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-fa828d81-4c39-4eac-84fc-7855b337c19c tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/quotas/c24fe956f7434054805a2322d25507fa HTTP/1.1" status: 200 len: 375 time: 0.0098178 Dec 21 04:06:36.775665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-9ecf5a2e-4919-439f-a93d-563806d46189 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0486932 Dec 21 04:06:36.876343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-50750d44-64ca-4c07-a8dc-780caa323e9e service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929961 Dec 21 04:06:36.963600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:36.967921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-6576268a-7ff5-4ad6-b2aa-93fea8558d02 service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847268 Dec 21 04:06:37.015857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Deleting subnet d38fb055-4fe9-4247-a9d0-c3f177acaee2 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:06:37.019196 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.055666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.094007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.214955 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.215316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae26e109-8f00-468f-bb9b-95b21b24093a req-2a1fd394-9f3a-4c06-9c91-650e181b2551 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 210 time: 0.0304441 Dec 21 04:06:37.228852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.234781 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/d38fb055-4fe9-4247-a9d0-c3f177acaee2 HTTP/1.1" status: 204 len: 168 time: 0.2695441 Dec 21 04:06:37.236106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:37.260807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b661edec-e8a3-418b-af38-d55fa8aa9bd8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d38fb055-4fe9-4247-a9d0-c3f177acaee2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:37.329966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.417192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.438150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a233b83-beaa-465e-8182-8018ddcd60b2']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:37.447420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6427c177-442d-45ff-a6ce-8dc6c7a3bb24') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:37.447721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6427c177-442d-45ff-a6ce-8dc6c7a3bb24') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:37.457056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.470401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.476963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:06:37.477345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:06:37.479119 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:06:37.619680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.625523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:37.628712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] 10.222.0.18 "DELETE /v2.0/networks/9a233b83-beaa-465e-8182-8018ddcd60b2 HTTP/1.1" status: 204 len: 168 time: 0.3751285 Dec 21 04:06:37.646801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a9e117-b011-4a25-ab65-916d725b210a admin admin] Pushing event deleted for resources: {'Network': ['ID=9a233b83-beaa-465e-8182-8018ddcd60b2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:37.889320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49160) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:37.926288 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-561ad8ce-a373-4f20-ac90-ccb94ac187ef admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5abdaf3416b648eba07ab305383a44a4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0386729 Dec 21 04:06:37.928851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:37.980152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9699fb5-0c73-4f95-9de5-5b56afd8d2d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:38.005034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9699fb5-0c73-4f95-9de5-5b56afd8d2d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:38.116623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9699fb5-0c73-4f95-9de5-5b56afd8d2d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:38.119473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9699fb5-0c73-4f95-9de5-5b56afd8d2d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:38.123076 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f9699fb5-0c73-4f95-9de5-5b56afd8d2d4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f1ea097b-3476-4816-9825-b6fc157739ea HTTP/1.1" status: 204 len: 168 time: 0.1908565 Dec 21 04:06:38.128974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9699fb5-0c73-4f95-9de5-5b56afd8d2d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1ea097b-3476-4816-9825-b6fc157739ea,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:38.318517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-186d1630-bafa-4083-af12-55d4a916af13 req-84f6335c-b8cc-433c-96a2-f5fc4c150645 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 210 time: 0.0268524 Dec 21 04:06:38.743378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-6951fd0d-b4a4-4179-98d1-8bd2b29f594e req-19fe0e2f-9cd2-4e81-a529-889636c51897 service neutron] (110310) timed out ('10.222.0.54', 58365) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:06:39.167696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49194) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:39.284864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Request body: {'network': {'name': 'tempest-ComputeTenantNetworksTest-2106768601-network', 'tenant_id': 'ee4efaaf977a4a419253e97fef5a840b'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:39.316077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-b50b8f7f-be41-4171-88f5-84cd028dd129 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:39.318683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-b50b8f7f-be41-4171-88f5-84cd028dd129 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.31 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.1435323 Dec 21 04:06:39.351457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Request body: {'port': {'device_id': '332bd612-9c55-494a-876c-f9d7186efd6b', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'admin_state_up': True, 'tenant_id': 'c24fe956f7434054805a2322d25507fa'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:39.380873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Made reservation on behalf of ee4efaaf977a4a419253e97fef5a840b for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:39.389172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.399505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.472129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01401bdd-0096-4147-9d07-eb2dc142be83 req-e58ea8e0-786c-47ba-abde-b25b35e9103a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 210 time: 0.0412018 Dec 21 04:06:39.526120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fcfb0f49-b810-49cb-b540-11ba574daf44 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:06:39.541497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.552223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: fcfb0f49-b810-49cb-b540-11ba574daf44 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:06:39.556774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fcfb0f49-b810-49cb-b540-11ba574daf44 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:06:39.631779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.657462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:06:39.667438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Made reservation on behalf of c24fe956f7434054805a2322d25507fa for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:06:39.667893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5300b27b-b53c-4a3e-9efe-3f757faef7e7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:39.673140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.673412 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Added segment 2eac457b-dee0-47c9-acd9-bf69711e440e of type vlan for network d8f0f9bb-405b-4f52-af62-ff12339ed02a Dec 21 04:06:39.693256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.718095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.831469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.832418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:39.832995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:39.845993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Allocated IP 172.20.0.8 (13d79d25-d791-421e-bee1-93ce620f5704/f6eb37b9-316b-4d85-9044-455f8831b074/adb2727a-4661-46f5-a1a9-b11045316c51) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:39.899367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] Pushing event updated for resources: {'Network': ['ID=d8f0f9bb-405b-4f52-af62-ff12339ed02a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:39.909529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d8f0f9bb-405b-4f52-af62-ff12339ed02a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:06:39.950384 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3c352df0-685e-4a8b-a6b4-b5a6f14648f1 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.7730148 Dec 21 04:06:40.030342 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:40.122960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:40.166245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba', 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:40.167527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Network 13d79d25-d791-421e-bee1-93ce620f5704 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:40.170881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:40.174986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:40.201295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event updated for resources: {'Port': ['ID=adb2727a-4661-46f5-a1a9-b11045316c51,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:40.232411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:40.233130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:40.343749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-8cb66cea-7c3e-4dc2-aba4-8d2d6e711420 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9969049 Dec 21 04:06:40.397758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Request body: {'port': {'device_id': '332bd612-9c55-494a-876c-f9d7186efd6b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:40.505003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:40.546825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aff7dc-1f2e-496e-9650-288ded5554d8 req-2571dc24-2945-48f1-b5a1-5c6386f780da tempest-ComputeTenantNetworksTest-1051695537 tempest-ComputeTenantNetworksTest-1051695537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:40.553038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aff7dc-1f2e-496e-9650-288ded5554d8 req-2571dc24-2945-48f1-b5a1-5c6386f780da tempest-ComputeTenantNetworksTest-1051695537 tempest-ComputeTenantNetworksTest-1051695537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:40.559132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aff7dc-1f2e-496e-9650-288ded5554d8 req-2571dc24-2945-48f1-b5a1-5c6386f780da tempest-ComputeTenantNetworksTest-1051695537 tempest-ComputeTenantNetworksTest-1051695537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:40.560791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92aff7dc-1f2e-496e-9650-288ded5554d8 req-2571dc24-2945-48f1-b5a1-5c6386f780da tempest-ComputeTenantNetworksTest-1051695537 tempest-ComputeTenantNetworksTest-1051695537-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1903 time: 0.2738948 Dec 21 04:06:41.016812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb2a5a8-1d5f-4d77-90da-15cdb44f2aea req-371dc0d6-e3ef-45d1-85dc-cc96174a30c0 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:41.018302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fb2a5a8-1d5f-4d77-90da-15cdb44f2aea req-371dc0d6-e3ef-45d1-85dc-cc96174a30c0 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 931 time: 0.4556839 Dec 21 04:06:41.024623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4500af9d-d362-44a4-8f42-fd8109d873d4 req-e08e6f9f-673c-4d50-b10c-d5e32afb0b3b tempest-ComputeTenantNetworksTest-1051695537 tempest-ComputeTenantNetworksTest-1051695537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:41.025825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4500af9d-d362-44a4-8f42-fd8109d873d4 req-e08e6f9f-673c-4d50-b10c-d5e32afb0b3b tempest-ComputeTenantNetworksTest-1051695537 tempest-ComputeTenantNetworksTest-1051695537-project] 10.222.0.18 "GET /v2.0/networks/d8f0f9bb-405b-4f52-af62-ff12339ed02a HTTP/1.1" status: 200 len: 769 time: 0.4311652 Dec 21 04:06:41.034952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49224) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:41.113927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.123792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fb2a5a8-1d5f-4d77-90da-15cdb44f2aea req-479c5b1b-0ed5-4d2d-b611-c5a20c485bc8 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0947490 Dec 21 04:06:41.199247 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.207916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id adb2727a-4661-46f5-a1a9-b11045316c51 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:41.216287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.220375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8f0f9bb-405b-4f52-af62-ff12339ed02a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:41.228881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Transition to ACTIVE for port object adb2727a-4661-46f5-a1a9-b11045316c51 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:06:41.230559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2eac457b-dee0-47c9-acd9-bf69711e440e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:41.230946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2eac457b-dee0-47c9-acd9-bf69711e440e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:41.241097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.254852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.260971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:06:41.261360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:06:41.263047 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:06:41.318607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.367170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Pushing event updated for resources: {'Port': ['ID=adb2727a-4661-46f5-a1a9-b11045316c51,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:41.389378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.394814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.401240 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] 10.222.0.18 "DELETE /v2.0/networks/d8f0f9bb-405b-4f52-af62-ff12339ed02a HTTP/1.1" status: 204 len: 168 time: 0.3624599 Dec 21 04:06:41.416646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b0429c-30b7-44fc-9a32-54b8c04ace5e admin admin] Pushing event deleted for resources: {'Network': ['ID=d8f0f9bb-405b-4f52-af62-ff12339ed02a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:41.445218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Attempting to bind port adb2727a-4661-46f5-a1a9-b11045316c51 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:06:41.445693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Attempting to bind port adb2727a-4661-46f5-a1a9-b11045316c51 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:06:41.446099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Attempting to bind port adb2727a-4661-46f5-a1a9-b11045316c51 on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:41.451515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Port adb2727a-4661-46f5-a1a9-b11045316c51 on network 13d79d25-d791-421e-bee1-93ce620f5704 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:06:41.451910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Attempting to bind port adb2727a-4661-46f5-a1a9-b11045316c51 on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:06:41.457397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 6, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:06:41.457758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Checking segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:06:41.458167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Bound using segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:06:41.458721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Bound port: adb2727a-4661-46f5-a1a9-b11045316c51, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:06:41.459110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.527342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] For port adb2727a-4661-46f5-a1a9-b11045316c51, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:06:41.530477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] For port adb2727a-4661-46f5-a1a9-b11045316c51, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=adb2727a-4661-46f5-a1a9-b11045316c51,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:06:41.660483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.690293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:41.691541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.692995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] 10.222.0.31 "PUT /v2.0/ports/adb2727a-4661-46f5-a1a9-b11045316c51 HTTP/1.1" status: 200 len: 1092 time: 1.3316708 Dec 21 04:06:41.695717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '332bd612-9c55-494a-876c-f9d7186efd6b', 'tag': 'adb2727a-4661-46f5-a1a9-b11045316c51'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:41.697875 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8dcb8c1b-5453-482a-ad04-652ab20bad7d" -d '{"events": [{"name": "network-changed", "server_uuid": "332bd612-9c55-494a-876c-f9d7186efd6b", "tag": "adb2727a-4661-46f5-a1a9-b11045316c51"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:41.729470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb40bc5e-6a22-45c8-acaf-fd2a9241044d service neutron] Pushing event updated for resources: {'Port': ['ID=adb2727a-4661-46f5-a1a9-b11045316c51,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:41.750689 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea264cc0-0743-42b5-a603-8b53cdad2617 x-openstack-request-id: req-ea264cc0-0743-42b5-a603-8b53cdad2617 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:41.751197 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "332bd612-9c55-494a-876c-f9d7186efd6b", "tag": "adb2727a-4661-46f5-a1a9-b11045316c51", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:41.751515 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ea264cc0-0743-42b5-a603-8b53cdad2617 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:41.754431 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '332bd612-9c55-494a-876c-f9d7186efd6b', 'tag': 'adb2727a-4661-46f5-a1a9-b11045316c51', 'status': 'completed', 'code': 200} Dec 21 04:06:41.798832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49236) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:41.842013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dcb8c1b-5453-482a-ad04-652ab20bad7d req-5cb259dd-5654-4c45-8740-0bdaf621ee99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:41.845047 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-444bddd7-7e1e-4237-ac5e-af7fb0cc20be admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ee4efaaf977a4a419253e97fef5a840b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0428741 Dec 21 04:06:41.845196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dcb8c1b-5453-482a-ad04-652ab20bad7d req-5cb259dd-5654-4c45-8740-0bdaf621ee99 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 1095 time: 0.0448420 Dec 21 04:06:41.845503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49238) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:41.953839 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f90c849-a07e-47f4-8f1d-9578f2462ed4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:41.985471 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f90c849-a07e-47f4-8f1d-9578f2462ed4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:42.003415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dcb8c1b-5453-482a-ad04-652ab20bad7d req-5ceb08f9-80d4-4ac8-8765-20d6ab201032 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:42.004890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dcb8c1b-5453-482a-ad04-652ab20bad7d req-5ceb08f9-80d4-4ac8-8765-20d6ab201032 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=c24fe956f7434054805a2322d25507fa&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1384912 Dec 21 04:06:42.124731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dcb8c1b-5453-482a-ad04-652ab20bad7d req-dc6319ab-db8b-46c1-b102-5ecca40880b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:42.126236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dcb8c1b-5453-482a-ad04-652ab20bad7d req-dc6319ab-db8b-46c1-b102-5ecca40880b8 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1121042 Dec 21 04:06:42.175898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f90c849-a07e-47f4-8f1d-9578f2462ed4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:42.179141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f90c849-a07e-47f4-8f1d-9578f2462ed4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:42.182948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f90c849-a07e-47f4-8f1d-9578f2462ed4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5300b27b-b53c-4a3e-9efe-3f757faef7e7 HTTP/1.1" status: 204 len: 168 time: 0.3340049 Dec 21 04:06:42.195174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f90c849-a07e-47f4-8f1d-9578f2462ed4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5300b27b-b53c-4a3e-9efe-3f757faef7e7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:42.284697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-e4911a1b-a309-4dca-90a8-6076e5a9ab72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:42.286582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-e4911a1b-a309-4dca-90a8-6076e5a9ab72 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 1095 time: 0.0876713 Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.295235 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:06:42.297938 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:06:42.298831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232e3fea-4f64-4a3b-be82-c6bfa99dfb2f req-64e6d550-4d10-473c-92a4-2828f113e04a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:42.300091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-232e3fea-4f64-4a3b-be82-c6bfa99dfb2f req-64e6d550-4d10-473c-92a4-2828f113e04a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 943 time: 0.0666792 Dec 21 04:06:42.355319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-b8336bc6-4831-48c0-a734-6a433b743e79 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=adb2727a-4661-46f5-a1a9-b11045316c51 HTTP/1.1" status: 200 len: 217 time: 0.0521691 Dec 21 04:06:42.419906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-232e3fea-4f64-4a3b-be82-c6bfa99dfb2f req-cb68333f-79e3-4a00-b394-ed2376279d40 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092081 Dec 21 04:06:42.427051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-d4a29540-c51f-4d61-a4ae-faf3d430de5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:42.429045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-d4a29540-c51f-4d61-a4ae-faf3d430de5a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f6eb37b9-316b-4d85-9044-455f8831b074 HTTP/1.1" status: 200 len: 855 time: 0.0643294 Dec 21 04:06:42.460785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-a60b43b4-9dd8-45fd-8995-c3fcff148aad service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=13d79d25-d791-421e-bee1-93ce620f5704&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242400 Dec 21 04:06:42.565932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-35fa398a-e54e-4449-98b7-ee8b0b67e962 service neutron] 10.222.0.31 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0979400 Dec 21 04:06:42.668648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81ced2e0-36e1-4c87-9f6c-7f1e877e7376 req-5460ec3f-6c17-4f02-98ad-14788a000275 service neutron] 10.222.0.31 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934234 Dec 21 04:06:43.556573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f3a446-8d84-4f8b-a8fc-095f5bd42709 req-9f35e63b-1bb3-4f6d-8b29-37088a275d91 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:43.558113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8f3a446-8d84-4f8b-a8fc-095f5bd42709 req-9f35e63b-1bb3-4f6d-8b29-37088a275d91 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 943 time: 0.0556936 Dec 21 04:06:43.623807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8f3a446-8d84-4f8b-a8fc-095f5bd42709 req-aafcbfbb-494b-49a9-9c0c-b4fb93425ef4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590498 Dec 21 04:06:44.752628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f8e78c-32ff-42de-9827-4e2d7c2b3c29 req-38f2b3c1-1573-45a9-a1f9-0d8a9b583cdc tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:44.754772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71f8e78c-32ff-42de-9827-4e2d7c2b3c29 req-38f2b3c1-1573-45a9-a1f9-0d8a9b583cdc tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 943 time: 0.0550041 Dec 21 04:06:44.803659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71f8e78c-32ff-42de-9827-4e2d7c2b3c29 req-904d3d7d-6208-4741-a8ef-6a19750ca15c tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428243 Dec 21 04:06:45.909428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device adb2727a-4661-46f5-a1a9-b11045316c51 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:06:45.924513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dddd1eb-c554-47fb-94b6-bb256337f4ae req-c577f13a-029b-40f2-bd8f-6ef7c436f862 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:45.927101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dddd1eb-c554-47fb-94b6-bb256337f4ae req-c577f13a-029b-40f2-bd8f-6ef7c436f862 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 943 time: 0.0540257 Dec 21 04:06:45.998354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dddd1eb-c554-47fb-94b6-bb256337f4ae req-2e0ec294-e626-4241-a1c0-1bad7e060fd3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655618 Dec 21 04:06:46.013631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port adb2727a-4661-46f5-a1a9-b11045316c51, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=adb2727a-4661-46f5-a1a9-b11045316c51,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:46.024831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'adb2727a-4661-46f5-a1a9-b11045316c51', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'port_id': 'adb2727a-4661-46f5-a1a9-b11045316c51', 'mac_address': 'fa:16:3e:c7:f7:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6eb37b9-316b-4d85-9044-455f8831b074', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:06:46.067109 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:46.081214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id adb2727a-4661-46f5-a1a9-b11045316c51 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:06:46.103849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port adb2727a-4661-46f5-a1a9-b11045316c51, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=adb2727a-4661-46f5-a1a9-b11045316c51,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:46.158404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9483a615-5050-47e6-b640-3615c5379804 req-67e2d38c-3e8e-4d57-a1c6-368403373890 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:46.160051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9483a615-5050-47e6-b640-3615c5379804 req-67e2d38c-3e8e-4d57-a1c6-368403373890 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0498388 Dec 21 04:06:46.179833 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:46.209949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9483a615-5050-47e6-b640-3615c5379804 req-91c72691-d8bd-47a7-b6fb-3dc1eeba73cb tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430367 Dec 21 04:06:46.230659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=adb2727a-4661-46f5-a1a9-b11045316c51,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:46.533687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['adb2727a-4661-46f5-a1a9-b11045316c51'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:06:47.124251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8899360-e7b0-4d6e-b8e3-730fe307f7c6 req-8b90796e-9a5e-4f7e-b545-035b9b396bc8 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:47.125676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8899360-e7b0-4d6e-b8e3-730fe307f7c6 req-8b90796e-9a5e-4f7e-b545-035b9b396bc8 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 944 time: 0.0495975 Dec 21 04:06:47.180593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8899360-e7b0-4d6e-b8e3-730fe307f7c6 req-bdb5e257-f66e-4a5a-967f-5c53f91b8f54 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483434 Dec 21 04:06:47.335011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162b95a6-650c-4428-b7e6-0acca16c936d req-d04b8cb1-edf9-4898-8ed2-bd93ffe5801a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:47.336633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-162b95a6-650c-4428-b7e6-0acca16c936d req-d04b8cb1-edf9-4898-8ed2-bd93ffe5801a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.0554988 Dec 21 04:06:47.385099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-162b95a6-650c-4428-b7e6-0acca16c936d req-73d7f18b-24b1-4c76-80a4-cb6b6e139c86 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417123 Dec 21 04:06:47.911837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device adb2727a-4661-46f5-a1a9-b11045316c51 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:06:48.063250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port adb2727a-4661-46f5-a1a9-b11045316c51 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:06:48.067523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port adb2727a-4661-46f5-a1a9-b11045316c51 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:06:48.067967 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:48.148493 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:48.175998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '332bd612-9c55-494a-876c-f9d7186efd6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adb2727a-4661-46f5-a1a9-b11045316c51'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:48.178866 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-114dfb62-d6e0-4116-b1de-f8e1348ee1f7" -d '{"events": [{"server_uuid": "332bd612-9c55-494a-876c-f9d7186efd6b", "name": "network-vif-plugged", "status": "completed", "tag": "adb2727a-4661-46f5-a1a9-b11045316c51"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:48.189659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port adb2727a-4661-46f5-a1a9-b11045316c51, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=adb2727a-4661-46f5-a1a9-b11045316c51,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:48.220720 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7cc3c93-5860-41a5-94a1-377ecb8099e4 x-openstack-request-id: req-d7cc3c93-5860-41a5-94a1-377ecb8099e4 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:48.221133 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "332bd612-9c55-494a-876c-f9d7186efd6b", "name": "network-vif-plugged", "status": "completed", "tag": "adb2727a-4661-46f5-a1a9-b11045316c51", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:48.221473 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d7cc3c93-5860-41a5-94a1-377ecb8099e4 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:48.221947 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '332bd612-9c55-494a-876c-f9d7186efd6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adb2727a-4661-46f5-a1a9-b11045316c51', 'code': 200} Dec 21 04:06:48.253548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:48.331408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a88f37-ccd6-49b8-a91d-cec51b9f431d req-28cb13c8-e655-432c-9455-09f04c2139f7 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:48.333040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93a88f37-ccd6-49b8-a91d-cec51b9f431d req-28cb13c8-e655-432c-9455-09f04c2139f7 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 945 time: 0.0801723 Dec 21 04:06:48.336516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=adb2727a-4661-46f5-a1a9-b11045316c51,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:48.418680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93a88f37-ccd6-49b8-a91d-cec51b9f431d req-29cd10ba-d9f1-41f5-a11e-3345fbfdfe51 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796080 Dec 21 04:06:48.439645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d698ebf5-a74b-41c6-a67e-8a005ce782d5 req-be3171bc-2508-42aa-9fad-514440031089 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:48.447305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d698ebf5-a74b-41c6-a67e-8a005ce782d5 req-be3171bc-2508-42aa-9fad-514440031089 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 1097 time: 0.1013074 Dec 21 04:06:48.581660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d698ebf5-a74b-41c6-a67e-8a005ce782d5 req-3c8c86a0-d04d-4976-a8e4-8b8cf48e446b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655816 Dec 21 04:06:48.624959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de546821-4458-4a7c-808f-ffb5370be4de req-99bfdd5a-1127-4bb3-b4f4-1eafba09e140 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:48.626618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de546821-4458-4a7c-808f-ffb5370be4de req-99bfdd5a-1127-4bb3-b4f4-1eafba09e140 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1471984 Dec 21 04:06:48.647202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-a204edc0-fe5a-4fe4-b703-9c748ac334dc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:48.648620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-a204edc0-fe5a-4fe4-b703-9c748ac334dc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 945 time: 0.1102026 Dec 21 04:06:48.689097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de546821-4458-4a7c-808f-ffb5370be4de req-77596cc1-eb3e-4570-9e84-dc946d752c36 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=30e72850-7e2a-4b10-8d48-9837964c9ad9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549808 Dec 21 04:06:48.950562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Deleting port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:48.950787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:49.041735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] For port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:49.042105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:49.234278 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:49.234676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:49.235031 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Floating IP 467f703f-0f38-48fb-8711-3429d6cde40b disassociated. External IP: 172.25.5.162, port: 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1. Dec 21 04:06:49.235380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Calling delete_port for 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:49.324255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-0333d07f-ff78-407b-b0b6-32f76b4af008 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1051702 Dec 21 04:06:49.447244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-d3564940-f59d-4c6d-9c1b-5553a46e9306 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:49.448964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-d3564940-f59d-4c6d-9c1b-5553a46e9306 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1097 time: 0.0441623 Dec 21 04:06:49.469121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:49.510817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event deleted for resources: {'Port': ['ID=8a331e5a-3daa-4e31-9faf-aec4f4caa8e1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:49.739412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4c4572-3b6c-4e64-8d6a-17eeed8a96c4 req-f272d18b-d574-40e2-97fc-1ddc81464f20 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:49.741439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e4c4572-3b6c-4e64-8d6a-17eeed8a96c4 req-f272d18b-d574-40e2-97fc-1ddc81464f20 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 945 time: 0.1822958 Dec 21 04:06:49.786958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-711bbcf2-2a93-4d06-8d0b-69507dd1221e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:49.790975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-711bbcf2-2a93-4d06-8d0b-69507dd1221e service neutron] 10.222.0.31 "GET /v2.0/networks?id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 897 time: 0.3074520 Dec 21 04:06:49.811986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-81e00b8c-5fb0-4f35-b4c6-fd346549f025 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:49.824602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:06:49.893588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e4c4572-3b6c-4e64-8d6a-17eeed8a96c4 req-fb14aeba-d875-4a61-ac8f-22ff6e707161 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307871 Dec 21 04:06:49.915761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d468f28c-e419-4de5-9636-e8babc10d420 req-b30587f8-aef9-4a64-9407-f4183b31cf5e tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 210 time: 0.0529807 Dec 21 04:06:49.927642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-6fb48bdc-827e-43b8-98b0-867f8a4ce141 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 200 len: 1000 time: 0.1185651 Dec 21 04:06:50.107489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:06:50.110615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-96b2b3ea-3743-4dff-9416-926d2005f791 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:50.118137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-96b2b3ea-3743-4dff-9416-926d2005f791 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16163aab-7fce-4449-a3d4-4b3d03e00005 HTTP/1.1" status: 200 len: 835 time: 0.1435437 Dec 21 04:06:50.119150 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:06:50.129670 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:50.130742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:50.191581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] No DVR routers for this DVR port 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:06:50.195409 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:50.198881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8641bbdf-b569-45a3-a954-d6bb1f4aee0e req-e4d81ae8-3b42-4b37-ae58-28f8e94119a8 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "DELETE /v2.0/ports/8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 HTTP/1.1" status: 204 len: 173 time: 1.3431380 Dec 21 04:06:50.200902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'name': 'network-vif-deleted', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:50.203341 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3354cbab-ed2d-4b24-b4ff-7a4e65de9431" -d '{"events": [{"server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "name": "network-vif-deleted", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:50.230432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-7230553b-1cc7-4361-abef-d367417acc4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:50.232069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-7230553b-1cc7-4361-abef-d367417acc4b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=21c72edc-8844-45a3-93c7-94b865615264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1053762 Dec 21 04:06:50.270492 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36587a62-4d21-4266-a381-bfe01b23e860 x-openstack-request-id: req-36587a62-4d21-4266-a381-bfe01b23e860 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:50.276590 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "38d6aa12-5415-46fc-b1ab-6734cf14832d", "name": "network-vif-deleted", "tag": "8a331e5a-3daa-4e31-9faf-aec4f4caa8e1", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:50.276590 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-36587a62-4d21-4266-a381-bfe01b23e860 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:50.276590 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '38d6aa12-5415-46fc-b1ab-6734cf14832d', 'name': 'network-vif-deleted', 'tag': '8a331e5a-3daa-4e31-9faf-aec4f4caa8e1', 'status': 'completed', 'code': 200} Dec 21 04:06:50.286347 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:50.407848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-30505e87-72b4-45bb-8da9-594948bc16c8 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1656132 Dec 21 04:06:50.543780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80cbe829-8a3a-4dff-ad7d-822677da1e6d req-b67e8aad-c9af-48dc-b6dc-1b44d82c7caf service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1138864 Dec 21 04:06:50.563818 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:50.593296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:06:50.602469 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:50.603108 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:50.735802 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:50.979749 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:51.027981 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e715121b-2a38-4ac9-bd06-a5dea334cb26 None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:06:51.039730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e0a46e-8a06-45fd-b5ee-7236e9c092d9 req-6ef1a282-03fd-4bf6-ae7c-42075159a115 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:51.041350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4e0a46e-8a06-45fd-b5ee-7236e9c092d9 req-6ef1a282-03fd-4bf6-ae7c-42075159a115 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 945 time: 0.0636251 Dec 21 04:06:51.076340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fb3b2be-0000-4451-9928-4a743747ada7 req-e22d7560-f774-4ef4-94ac-e136eb2db003 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=38d6aa12-5415-46fc-b1ab-6734cf14832d HTTP/1.1" status: 200 len: 210 time: 0.0456462 Dec 21 04:06:51.124881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4e0a46e-8a06-45fd-b5ee-7236e9c092d9 req-5423d32f-ba01-4d2c-8a1d-413f65c30fac tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753326 Dec 21 04:06:51.341425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f148aa1a-4aeb-4051-8d79-9849bfc69256 None None] New status for floating IP 467f703f-0f38-48fb-8711-3429d6cde40b: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:06:51.926280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:06:51.949616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:06:51.949968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8a331e5a-3daa-4e31-9faf-aec4f4caa8e1 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:06:52.220502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49456) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:52.255727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49460) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:52.358905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-908f1d59-c52d-42c8-863e-bbf6a84287a4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:52.408906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-908f1d59-c52d-42c8-863e-bbf6a84287a4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:52.596170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-908f1d59-c52d-42c8-863e-bbf6a84287a4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:52.599968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-908f1d59-c52d-42c8-863e-bbf6a84287a4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:52.605161 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-908f1d59-c52d-42c8-863e-bbf6a84287a4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "DELETE /v2.0/security-groups/30e72850-7e2a-4b10-8d48-9837964c9ad9 HTTP/1.1" status: 204 len: 168 time: 0.3475158 Dec 21 04:06:52.606178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49462) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:52.630788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908f1d59-c52d-42c8-863e-bbf6a84287a4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=30e72850-7e2a-4b10-8d48-9837964c9ad9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:52.645386 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-3b3b6318-16f9-49d4-beee-df58715ca2b3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] show failed (client error): The resource could not be found. Dec 21 04:06:52.645899 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b3b6318-16f9-49d4-beee-df58715ca2b3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups/30e72850-7e2a-4b10-8d48-9837964c9ad9 HTTP/1.1" status: 404 len: 347 time: 0.0333810 Dec 21 04:06:52.647422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49464) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:52.881696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:52.936507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Deleting port 2b0500e5-9320-4897-9e88-bbccfdff1197 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:52.936861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.077712 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.078177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.107233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Calling delete_port for 2b0500e5-9320-4897-9e88-bbccfdff1197 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:53.183937 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4b23e5b-f496-451c-86ec-4da55d22cb83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.206461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.272059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.402129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.441278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event deleted for resources: {'Port': ['ID=2b0500e5-9320-4897-9e88-bbccfdff1197,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:53.527816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.531630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.533380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ee3935d3-ae17-4a1f-a13a-7dd78be2dbde tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "DELETE /v2.0/floatingips/467f703f-0f38-48fb-8711-3429d6cde40b HTTP/1.1" status: 204 len: 168 time: 0.8838460 Dec 21 04:06:53.708951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 6ad0d080-cd27-4f22-a04f-fcb471630f55 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:53.709518 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.816378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port 6ad0d080-cd27-4f22-a04f-fcb471630f55, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6ad0d080-cd27-4f22-a04f-fcb471630f55,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:53.816966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:53.831943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 6ad0d080-cd27-4f22-a04f-fcb471630f55 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:53.897911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:53.902791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1391921148', 'description': 'tempest-description--41650769'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:54.002359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.170406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.208019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.223825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=6ad0d080-cd27-4f22-a04f-fcb471630f55,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:54.304441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.336125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'SecurityGroup': ['ID=252634e5-d5f3-4a6f-8e8b-29b829e821f9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:54.427112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.435067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.435067 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0eba6d26-a492-4c66-a5de-9b1297ca22c0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.5297265 Dec 21 04:06:54.435067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:54.442919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'security_group_rule': {'security_group_id': '252634e5-d5f3-4a6f-8e8b-29b829e821f9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:54.590910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.656528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.703717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:06:54.727336 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.747676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e03d54af-bc42-4923-8921-1303e229e0ff,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:54.808010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:54.812736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0cefa4fe-682d-4b6a-a26f-96ba0278b528 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3790765 Dec 21 04:06:54.813300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49506) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:54.820621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'security_group_rule': {'security_group_id': '252634e5-d5f3-4a6f-8e8b-29b829e821f9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:54.858153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:06:54.864407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-28a0e784-428f-4ea6-91e6-53913de5e688 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "PUT /v2.0/routers/2191bc86-3ede-4925-a826-67ac34d6fe52/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6428764 Dec 21 04:06:54.871580 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:06:54.883526 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:54.884165 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:54.974304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.034786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.058073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.082770 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.192569 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.225892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=42d64678-95b9-4e6f-9918-bc3dbd1cc476,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:55.230213 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:55.306580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.310806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6e983652-53be-467a-a632-6b101ca79460 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4935663 Dec 21 04:06:55.316366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49530) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:55.316366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:06:55.408907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.503258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d591430-3b2d-4925-872f-5c5ccb878359 req-6b93b812-ae51-4b61-b766-80102214d5ea tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:55.514577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d591430-3b2d-4925-872f-5c5ccb878359 req-6b93b812-ae51-4b61-b766-80102214d5ea tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.0942826 Dec 21 04:06:55.616661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d591430-3b2d-4925-872f-5c5ccb878359 req-a2c63138-ef1d-4567-9479-a879a6bcfd47 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1008978 Dec 21 04:06:55.687322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.702370 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:53Z', 'revision_number': 6, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:15Z', 'revision_number': 1, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:55.739104 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:06:55.739500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:55.750419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:06:55.751585 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:55.895903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Allocated IP 172.25.5.88 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/aa27223c-c3fa-495c-b0fb-6e52b1154884) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:06:55.926849 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:06:55.991911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49538) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:56.114567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.211373 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:53Z', 'revision_number': 6, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:15Z', 'revision_number': 1, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:06:56.235831 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d314565-8947-4350-a187-07c8fc7baf2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.245906 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d78d3415-394a-4aef-9ca1-d30651138092 None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:53Z', 'revision_number': 6, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a2d88347-0fc8-4148-a28b-cbb31674935d', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.84', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'port_id': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 2408, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'mac_address': 'fa:16:3e:cf:73:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:05:13Z', 'updated_at': '2021-12-21T04:05:15Z', 'revision_number': 1, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:06:56.292285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.333135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:06:56.338553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d314565-8947-4350-a187-07c8fc7baf2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.339100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:06:56.343172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:06:56.374640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'Port': ['ID=aa27223c-c3fa-495c-b0fb-6e52b1154884,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:56.396276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d314565-8947-4350-a187-07c8fc7baf2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.504346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d314565-8947-4350-a187-07c8fc7baf2f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f4bf3ccf19264d62bb9355569b988144&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5112860 Dec 21 04:06:56.505195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49546) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:56.506684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d314565-8947-4350-a187-07c8fc7baf2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05dd00e7-4a57-4185-88b8-a15866d4cd06,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:56.689988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a205aad-2281-4901-a294-e02b4eba46a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.717139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a205aad-2281-4901-a294-e02b4eba46a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.719512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.754369 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-94cf21c3-bf31-4cb7-a314-85b98e091ddc service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.2373002 Dec 21 04:06:56.847464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.850467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a6d213-35ed-47dc-87ca-ef0f076d968c req-4fc3edb6-1ffd-4e5d-963f-e99859ab4b9b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:56.853057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1a6d213-35ed-47dc-87ca-ef0f076d968c req-4fc3edb6-1ffd-4e5d-963f-e99859ab4b9b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.0880673 Dec 21 04:06:56.933843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a205aad-2281-4901-a294-e02b4eba46a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.936852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a205aad-2281-4901-a294-e02b4eba46a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:56.940440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5a205aad-2281-4901-a294-e02b4eba46a2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/05dd00e7-4a57-4185-88b8-a15866d4cd06 HTTP/1.1" status: 204 len: 168 time: 0.4127538 Dec 21 04:06:56.942678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6ad0d080-cd27-4f22-a04f-fcb471630f55 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:06:56.996761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6ad0d080-cd27-4f22-a04f-fcb471630f55 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:06:56.997249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6ad0d080-cd27-4f22-a04f-fcb471630f55 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:06:57.002212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a205aad-2281-4901-a294-e02b4eba46a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05dd00e7-4a57-4185-88b8-a15866d4cd06,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:57.011227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1a6d213-35ed-47dc-87ca-ef0f076d968c req-7072439e-b46a-4605-b37a-7319f9237aaa tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1479843 Dec 21 04:06:57.070292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.070821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.071317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.071778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.072301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.072749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.073200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.075202 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3f5cfd73-c53f-426d-98ad-f1fae37ed41b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2e28414564544bb283304990bb7b8542&device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 6505 time: 0.2157044 Dec 21 04:06:57.111178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-6903fdb5-5acf-4210-b9c9-b32d78a9a312 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.112717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-6903fdb5-5acf-4210-b9c9-b32d78a9a312 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 946 time: 0.1327293 Dec 21 04:06:57.214191 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.224499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port cb722c74-363a-414e-b4a1-b8ed8d175d24 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:06:57.225553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.298116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.400475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port cb722c74-363a-414e-b4a1-b8ed8d175d24, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cb722c74-363a-414e-b4a1-b8ed8d175d24,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:06:57.400933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.416090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for cb722c74-363a-414e-b4a1-b8ed8d175d24 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:06:57.416301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'Port': ['ID=aa27223c-c3fa-495c-b0fb-6e52b1154884,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:57.437769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-7d9e9f26-2f08-4431-adfc-9d281ecf058b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.438618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-7d9e9f26-2f08-4431-adfc-9d281ecf058b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.439293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-7d9e9f26-2f08-4431-adfc-9d281ecf058b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.441869 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-7d9e9f26-2f08-4431-adfc-9d281ecf058b service neutron] 10.222.0.54 "GET /v2.0/networks?id=4915ee69-a87c-4f15-b553-d1750c9a5a88&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=8d559823-2509-427a-8bd4-77cf5a81095a&id=42bfeccc-af8e-4aab-801c-72e8e8caa439&id=42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 200 len: 2297 time: 0.2243218 Dec 21 04:06:57.444224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.519488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.521290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1057bfc6-3045-4486-9eb3-427e15d1fa73 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.2089171 Dec 21 04:06:57.573654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-ad753016-1447-4e7e-bd4b-a6427e777bda service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 200 len: 1001 time: 0.1147189 Dec 21 04:06:57.679027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-cb063a0b-f637-4b02-b34e-59b28417f3f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.680577 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-cb063a0b-f637-4b02-b34e-59b28417f3f2 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 200 len: 855 time: 0.1004472 Dec 21 04:06:57.737671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.768468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-5b5d1629-98f1-431d-97db-1abef5cf71ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:57.768468 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-5b5d1629-98f1-431d-97db-1abef5cf71ff service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4915ee69-a87c-4f15-b553-d1750c9a5a88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0733459 Dec 21 04:06:57.835747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=cb722c74-363a-414e-b4a1-b8ed8d175d24,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:57.891473 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-809b79a4-3143-4f0e-a4bd-2f9ec88c91a2 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1131942 Dec 21 04:06:57.919337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] No DVR routers for this DVR port cb722c74-363a-414e-b4a1-b8ed8d175d24 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:06:57.922874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:57.928218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5836f38-6000-4aa7-a665-5fc5a8ea2e81 req-9760d077-e27d-48a6-8be3-a035b581dfbf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "DELETE /v2.0/ports/cb722c74-363a-414e-b4a1-b8ed8d175d24 HTTP/1.1" status: 204 len: 173 time: 0.8063178 Dec 21 04:06:57.933243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'name': 'network-vif-deleted', 'tag': 'cb722c74-363a-414e-b4a1-b8ed8d175d24'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:06:57.935566 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f93af27-dca5-410f-9324-c25f3b2468fa" -d '{"events": [{"server_uuid": "36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4", "name": "network-vif-deleted", "tag": "cb722c74-363a-414e-b4a1-b8ed8d175d24"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:06:57.952297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-b1c7d094-f5c9-411b-88e8-c5fa34da516d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1391921148&fields=id&tenant_id=3f578ba291d54826a6db2accb249f808 HTTP/1.1" status: 200 len: 267 time: 0.1000147 Dec 21 04:06:58.005162 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:06:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e5b2a16-f2ce-4800-8dcd-5a2ecb91388a x-openstack-request-id: req-8e5b2a16-f2ce-4800-8dcd-5a2ecb91388a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:06:58.005711 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4", "name": "network-vif-deleted", "tag": "cb722c74-363a-414e-b4a1-b8ed8d175d24", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:06:58.006560 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8e5b2a16-f2ce-4800-8dcd-5a2ecb91388a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:06:58.007159 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4', 'name': 'network-vif-deleted', 'tag': 'cb722c74-363a-414e-b4a1-b8ed8d175d24', 'status': 'completed', 'code': 200} Dec 21 04:06:58.097458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-67b4482d-90f2-4c09-a02e-13d95bc337a8 service neutron] 10.222.0.54 "GET /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1951199 Dec 21 04:06:58.164165 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-c29894a8-eca2-40e4-a1c6-71c271724d1a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.83&port_id=bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 217 time: 0.0567479 Dec 21 04:06:58.166423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-826deff3-e0ac-4640-9304-a12750846626 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:58.180941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-826deff3-e0ac-4640-9304-a12750846626 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 811 time: 0.2152233 Dec 21 04:06:58.258778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-5fddb3b9-3f52-4bf5-ae97-69f54100d02c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:58.260553 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-5fddb3b9-3f52-4bf5-ae97-69f54100d02c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0879810 Dec 21 04:06:58.261881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a3e17eb-6c54-4d50-a985-423f08ba020d req-b4391d84-3caa-4624-b454-3a1baa50013e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=36fc0d8a-6195-4bf0-ac33-dd9e2fed5ae4 HTTP/1.1" status: 200 len: 210 time: 0.0753989 Dec 21 04:06:58.266877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-70299561-ed95-432b-b83d-38f0b526c231 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/quotas/3f578ba291d54826a6db2accb249f808 HTTP/1.1" status: 200 len: 375 time: 0.0846837 Dec 21 04:06:58.355464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-7fc0b5e4-8207-4690-91f5-857f545e4027 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0802162 Dec 21 04:06:58.384560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-02d7352e-ab16-4f44-b940-e60733d9a615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:58.386368 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-02d7352e-ab16-4f44-b940-e60733d9a615 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1138613 Dec 21 04:06:58.506489 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3b5c9f83-e258-4aa0-859a-10cc998686c0 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1115668 Dec 21 04:06:58.551421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-ffba3b78-d1c1-4e2f-ad50-2337bd40efe8 service neutron] 10.222.0.18 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1776066 Dec 21 04:06:58.666027 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-d0d51a12-2e60-4719-915f-73872e142693 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1508260 Dec 21 04:06:58.712616 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-3fbcd0ba-f286-4e01-8a88-bf9521724bcb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.54&port_id=c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 217 time: 0.0381742 Dec 21 04:06:58.716964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-9d3ab301-70bc-4326-922a-edd65f043128 service neutron] 10.222.0.18 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1644847 Dec 21 04:06:58.800434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-690221ec-c6d8-4370-bcd5-11ac574973db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:58.804809 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-690221ec-c6d8-4370-bcd5-11ac574973db service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0814753 Dec 21 04:06:58.866621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-0c2dfd06-8c35-41f9-9f6b-5749840ae7fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:58.871502 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-0c2dfd06-8c35-41f9-9f6b-5749840ae7fc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0588610 Dec 21 04:06:58.981998 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-c7c77d50-3d10-4e39-b240-2d78e1b128a5 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1022840 Dec 21 04:06:59.125576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ffd80ad-f2b1-4de1-8b6f-18a035dc29d7 req-b70a6c42-257d-4aed-9577-238555b310bc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 210 time: 0.0855868 Dec 21 04:06:59.176275 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-979016e1-093a-4254-81a4-71bdc9db3dda service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1758616 Dec 21 04:06:59.265810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-7cafe0d9-ff7e-4921-ad2b-69e3d6271626 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.84&port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 200 len: 217 time: 0.0776308 Dec 21 04:06:59.333665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49640) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:59.355913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-617dc4a9-a429-4990-8a85-4a9fa57228fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:59.358348 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-617dc4a9-a429-4990-8a85-4a9fa57228fa service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0712700 Dec 21 04:06:59.407043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-125c87bd-90b5-4a2e-8499-ea763728108c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:59.439346 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-125c87bd-90b5-4a2e-8499-ea763728108c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:59.452194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-ef372209-8668-4e8a-bd65-b500d925cd74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:06:59.454311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-ef372209-8668-4e8a-bd65-b500d925cd74 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0818424 Dec 21 04:06:59.574654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-125c87bd-90b5-4a2e-8499-ea763728108c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:59.579705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-125c87bd-90b5-4a2e-8499-ea763728108c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:59.581294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-125c87bd-90b5-4a2e-8499-ea763728108c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/security-groups/f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4 HTTP/1.1" status: 204 len: 168 time: 0.2458279 Dec 21 04:06:59.602752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125c87bd-90b5-4a2e-8499-ea763728108c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3fc1dbb-17d3-409c-bb1b-1080d64cf8d4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:06:59.669843 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-b4e069eb-dc7b-4be4-b066-d4b8dc174917 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1940169 Dec 21 04:06:59.706578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49654) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:59.751270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49656) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:06:59.796506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting subnet 75097d59-9114-4d6a-ab49-443c57e1f8de {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:06:59.801743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:59.867650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:06:59.966518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cb722c74-363a-414e-b4a1-b8ed8d175d24 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:00.008921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: cb722c74-363a-414e-b4a1-b8ed8d175d24 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:00.009280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cb722c74-363a-414e-b4a1-b8ed8d175d24 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:00.054355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.144205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bf0d698-46b2-4494-bf79-11024eaf97ed admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.176177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-820e2aa0-122a-4039-a59f-16238375dbd7 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4959195 Dec 21 04:07:00.252185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.253680 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-0e9a4efa-b9ae-4190-851c-0b464ef7470c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.56&port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 200 len: 217 time: 0.0758481 Dec 21 04:07:00.303423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a0005b8-23b0-45f0-87f4-9e55a64c4bbd req-60d41946-0654-4351-9e40-b99947e961d7 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 210 time: 0.0676787 Dec 21 04:07:00.310541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Subnet': ['ID=75097d59-9114-4d6a-ab49-443c57e1f8de,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:00.319652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bf0d698-46b2-4494-bf79-11024eaf97ed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.330047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-c5abf32b-c827-4550-bd3f-422414a93c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:00.330047 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-c5abf32b-c827-4550-bd3f-422414a93c7d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 200 len: 797 time: 0.0642543 Dec 21 04:07:00.338398 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.340792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-564444bf-19e4-440b-a5ee-54fc474c1c24 None None] Network aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:00.348282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-afbfd309-418a-43c2-b66c-37c3f7271b7e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/subnets/75097d59-9114-4d6a-ab49-443c57e1f8de HTTP/1.1" status: 204 len: 168 time: 0.6381531 Dec 21 04:07:00.348828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49664) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:00.430088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-80638dc7-af08-45a5-b0b8-51cbdaf43219 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:00.433603 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-80638dc7-af08-45a5-b0b8-51cbdaf43219 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8d559823-2509-427a-8bd4-77cf5a81095a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0932333 Dec 21 04:07:00.458430 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8bf0d698-46b2-4494-bf79-11024eaf97ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.503441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf0d698-46b2-4494-bf79-11024eaf97ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8a27f5d-919c-43a5-b7ff-55a65982f404,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:00.522313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.550705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8bf0d698-46b2-4494-bf79-11024eaf97ed admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2a3bf9eee7b147c6bb21e7beb2f1c651&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7978873 Dec 21 04:07:00.551365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49670) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:00.621316 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-8b2c94dd-7ac2-47ef-bc29-5781e57e0f88 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1786187 Dec 21 04:07:00.637516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] DHCP port deletion for aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:00.669302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-787ac6f3-28a2-4691-91cd-a27b1a85bcca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.700865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-787ac6f3-28a2-4691-91cd-a27b1a85bcca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.703607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:00.703939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.748876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Deleting port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:00.748876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.749159 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-598b2b5c-c17b-4dba-8a64-568a5e926422 service neutron] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1140890 Dec 21 04:07:00.810583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:00.810583 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.816396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-cb9b6194-45de-4b0c-888c-b60726381636 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 200 len: 217 time: 0.0591626 Dec 21 04:07:00.822121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 8a1e87ec-8827-4f1f-824a-c9ba50238f2e owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:00.872586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] For port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,segment=NetworkSegment(dbf60732-7b9f-43e5-a156-27425418435d),segment_id=dbf60732-7b9f-43e5-a156-27425418435d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:00.875074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:00.899100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Calling delete_port for 8a1e87ec-8827-4f1f-824a-c9ba50238f2e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:00.918873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-30d491b5-aa2a-437e-b9f7-21d7b999b37a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:00.921053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-30d491b5-aa2a-437e-b9f7-21d7b999b37a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0962222 Dec 21 04:07:01.006469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-787ac6f3-28a2-4691-91cd-a27b1a85bcca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.009588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-787ac6f3-28a2-4691-91cd-a27b1a85bcca admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.011029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-787ac6f3-28a2-4691-91cd-a27b1a85bcca admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a8a27f5d-919c-43a5-b7ff-55a65982f404 HTTP/1.1" status: 204 len: 168 time: 0.4579213 Dec 21 04:07:01.015957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-5d38b3f5-25b4-4a65-99b4-3be509df99fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:01.031552 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-5d38b3f5-25b4-4a65-99b4-3be509df99fe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0892584 Dec 21 04:07:01.032687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787ac6f3-28a2-4691-91cd-a27b1a85bcca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8a27f5d-919c-43a5-b7ff-55a65982f404,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:01.041210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a1e87ec-8827-4f1f-824a-c9ba50238f2e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:01.087817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.159180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:01.164226 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-6a72c515-5e7c-4af8-9ed6-35f758f3fb22 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1155155 Dec 21 04:07:01.170550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] No DVR routers for this DVR port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:01.188372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No active binding found for port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e {{(pid=110312) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 21 04:07:01.189770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] The host n-d-822053-11 is not matching for port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e host None! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:07:01.189770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8a1e87ec-8827-4f1f-824a-c9ba50238f2e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:01.196098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.239705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Pushing event deleted for resources: {'Port': ['ID=8a1e87ec-8827-4f1f-824a-c9ba50238f2e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:01.253031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.253848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.254408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.254909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.255453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.256688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.257204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.257716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.258207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.258741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.259257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.259767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.260254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:01.275746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dc65918-ba24-40d5-97b2-a42a2d49613d None None] No DVR routers for this DVR port 8a1e87ec-8827-4f1f-824a-c9ba50238f2e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:01.349004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.367079 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-f97c278e-2d74-47cc-8f8c-9496ac8390c1 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1935384 Dec 21 04:07:01.378259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aa9d5090-f8cc-472f-a4a3-d525f12a8bf8']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:01.398807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dbf60732-7b9f-43e5-a156-27425418435d') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:01.399272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dbf60732-7b9f-43e5-a156-27425418435d') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:01.422540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-ae4bef56-48a7-4d04-8dfd-105f08697e97 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 200 len: 217 time: 0.0447321 Dec 21 04:07:01.431608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.481000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163873ff-791d-4900-b186-c71b4bde51f5 req-adc8df95-56be-4ce1-9759-06b2a6bb8c9c tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 210 time: 0.0519116 Dec 21 04:07:01.487415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.502019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:07:01.502434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:07:01.508474 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:07:01.525480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-b9b2e559-3fcf-462c-b73e-7dd7b2aa31b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:01.527523 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-b9b2e559-3fcf-462c-b73e-7dd7b2aa31b6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 200 len: 797 time: 0.0929606 Dec 21 04:07:01.629850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-e81534e5-a4bd-46af-a299-7e0f8bb43318 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:01.629850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-e81534e5-a4bd-46af-a299-7e0f8bb43318 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42bfeccc-af8e-4aab-801c-72e8e8caa439&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0935864 Dec 21 04:07:01.743425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-be99f2c7-a7ca-4e2b-b3a8-b239abf2c135 service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1050966 Dec 21 04:07:01.946902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d770743f-8e0b-4965-8436-e5f6caa5720d req-f397261c-edc4-4fb0-b640-0fee2d4ff19e service neutron] 10.222.0.54 "GET /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1950455 Dec 21 04:07:02.007846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49696) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:02.143032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.148951 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.155517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/networks/aa9d5090-f8cc-472f-a4a3-d525f12a8bf8 HTTP/1.1" status: 204 len: 168 time: 1.8049438 Dec 21 04:07:02.155858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49698) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:02.215624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b02ce574-c316-4013-bcd6-3a84fc33e97f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Network': ['ID=aa9d5090-f8cc-472f-a4a3-d525f12a8bf8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:02.221673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-9891f96b-b87e-4559-83d1-be553dc525b4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:02.224297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-9891f96b-b87e-4559-83d1-be553dc525b4 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 811 time: 0.2207704 Dec 21 04:07:02.252419 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b5ae248b-d16e-4bfe-af43-e89bf348cf43 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?fields=fixed_ips&fields=mac_address HTTP/1.1" status: 200 len: 4991 time: 0.2433136 Dec 21 04:07:02.255419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49706) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:02.260195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'network': {'name': 'tempest-network-smoke--1082982802', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'port_security_enabled': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:02.374219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-c92512f0-eef6-45ee-8bd9-a49ba94a7d72 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3f578ba291d54826a6db2accb249f808 HTTP/1.1" status: 200 len: 380 time: 0.1269960 Dec 21 04:07:02.394971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'port': {'device_id': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'admin_state_up': True, 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'security_groups': ['252634e5-d5f3-4a6f-8e8b-29b829e821f9']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:02.416495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Made reservation on behalf of e4be3566d3c34a19a30558795061b823 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:02.421619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.447516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 5404e845-d0b3-44bd-b399-10c70e090367 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:02.448014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.483197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] vlan segment allocate from pool success with {'vlan_id': 121, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:07:02.530015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.530469 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Added segment a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc of type vlan for network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 Dec 21 04:07:02.618597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Made reservation on behalf of 3f578ba291d54826a6db2accb249f808 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:02.622552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.667115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.673164 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.674331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74d170c-e00e-4bbd-aa0e-59e0e607579b req-f12ab6c4-5289-43a8-9925-3aa8e61d217f tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 210 time: 0.0890977 Dec 21 04:07:02.677855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.705953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 5404e845-d0b3-44bd-b399-10c70e090367 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:02.844156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.847061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Allocated IP 172.20.0.10 (e94ae2ca-4e3f-4500-90fd-ec494b399bda/a102645d-c1b2-4824-aff9-56e0558bab2d/89f97b5c-7b23-47f9-ab5f-a9e7349fdacd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:02.850796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:02.851531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:02.971577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Network': ['ID=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:03.007004 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-50e440b5-d9ff-4d8a-a81a-59e20278987b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.7479076 Dec 21 04:07:03.007441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:07:03.008933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49726) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:03.021703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'router': {'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'admin_state_up': True, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:03.220400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.223572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.224980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.280216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.283150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.309314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=5404e845-d0b3-44bd-b399-10c70e090367,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:03.374431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.374771 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Floating IP a2d88347-0fc8-4148-a28b-cbb31674935d disassociated (deleted). External IP: 172.25.5.84, port: b797276e-67e7-4d1b-a6ce-b9461293532b. Dec 21 04:07:03.414977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.529940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:03.533224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:03.538305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:03.569971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event updated for resources: {'Port': ['ID=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:03.611740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:03.612705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.661454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.695911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-05ec1656-0d8f-4ed8-86ed-79c3a58e27e3 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3141961 Dec 21 04:07:03.730355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Request body: {'port': {'device_id': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:03.838793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.936736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-22c8dbad-a594-4ee7-a425-0c2e2f5373d8 None None] Provisioning complete for port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:03.938249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22c8dbad-a594-4ee7-a425-0c2e2f5373d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:03.944621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:03.957452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c83e63-a6f3-443d-942e-f45de3abc644 req-87628a79-b151-4b9d-aadf-c6a731c5af9a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:03.963046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7c83e63-a6f3-443d-942e-f45de3abc644 req-87628a79-b151-4b9d-aadf-c6a731c5af9a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 932 time: 0.1184835 Dec 21 04:07:04.023534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-22c8dbad-a594-4ee7-a425-0c2e2f5373d8 None None] Port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:04.029819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7c83e63-a6f3-443d-942e-f45de3abc644 req-c68435b8-0097-48b7-9f56-f959e95b4d7b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580871 Dec 21 04:07:04.155147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:04.160715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.168520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:04.180232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:04.184084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:04.266509 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0cdea8ff-c1c0-4573-9c74-eca6228d17fd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/floatingips/a2d88347-0fc8-4148-a28b-cbb31674935d HTTP/1.1" status: 204 len: 168 time: 2.1059575 Dec 21 04:07:04.269529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:04.272381 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86343740-f5ad-492d-92e3-972d66c322ff" -d '{"events": [{"name": "network-changed", "server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:04.295574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.315729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.384036 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1eedef3-8bfa-4045-a983-44a047f2f6f6 x-openstack-request-id: req-a1eedef3-8bfa-4045-a983-44a047f2f6f6 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:04.384567 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:04.386245 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a1eedef3-8bfa-4045-a983-44a047f2f6f6 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:04.386813 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'status': 'completed', 'code': 200} Dec 21 04:07:04.418896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:04.438447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.442769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:04.461605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Transition to ACTIVE for port object 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:07:04.485355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.25.5.190 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:04.509933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86343740-f5ad-492d-92e3-972d66c322ff req-260d8bb8-2f18-47cf-9c45-b8cd361fb4ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:04.511494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-260d8bb8-2f18-47cf-9c45-b8cd361fb4ec service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 1097 time: 0.0483193 Dec 21 04:07:04.567224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.665644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.680907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86343740-f5ad-492d-92e3-972d66c322ff req-56c6ce0e-eb48-44f3-ac8c-f1fdf02ebc3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:04.682418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-56c6ce0e-eb48-44f3-ac8c-f1fdf02ebc3c service neutron] 10.222.0.31 "GET /v2.0/networks?id=21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 200 len: 897 time: 0.1599581 Dec 21 04:07:04.746623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Pushing event updated for resources: {'Port': ['ID=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:04.750100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-029e921e-d602-4ffd-9702-770e269245da service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 200 len: 217 time: 0.0537057 Dec 21 04:07:04.841042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:53Z', 'revision_number': 6, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:04.869817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:04.949728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86343740-f5ad-492d-92e3-972d66c322ff req-bf053f25-76b4-46f7-9185-282f9c5305a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:04.951564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-bf053f25-76b4-46f7-9185-282f9c5305a4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16163aab-7fce-4449-a3d4-4b3d03e00005 HTTP/1.1" status: 200 len: 835 time: 0.1686795 Dec 21 04:07:04.963101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:04.995567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:04.996213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:05.044348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Attempting to bind port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:05.044709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Attempting to bind port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:05.045053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Attempting to bind port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd on network e94ae2ca-4e3f-4500-90fd-ec494b399bda {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:05.090702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:05.093050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd on network e94ae2ca-4e3f-4500-90fd-ec494b399bda not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:07:05.093450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Attempting to bind port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd on network e94ae2ca-4e3f-4500-90fd-ec494b399bda {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:05.117509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:05.119972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:05.137831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:05.156935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa1ae5b6-61e2-4485-8f8f-e3dbcd7dce2a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:05.180773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 6, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:05.181135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Checking segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:05.181540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Bound using segment: {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:05.181996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Bound port: 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f1cb001-1e6d-4abe-b607-9270a6c39719', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:05.182411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:05.205231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:05.237022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86343740-f5ad-492d-92e3-972d66c322ff req-93a49037-d345-465c-85f8-7ea5ca548246 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:05.239514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-93a49037-d345-465c-85f8-7ea5ca548246 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=21c72edc-8844-45a3-93c7-94b865615264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2771459 Dec 21 04:07:05.432530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c33b117b-bb60-445b-b563-a3136f7defa6 None None] Provisioning complete for port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:05.432916 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c33b117b-bb60-445b-b563-a3136f7defa6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:05.477676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7715dc-de62-41e1-968e-7d53becae0bb req-a04fa226-71ba-4431-908b-1d9fe3effd41 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:05.478895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c33b117b-bb60-445b-b563-a3136f7defa6 None None] Port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:05.479986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a7715dc-de62-41e1-968e-7d53becae0bb req-a04fa226-71ba-4431-908b-1d9fe3effd41 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 945 time: 0.4212873 Dec 21 04:07:05.490015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-11cec687-08ac-45c5-81e4-62f94225af02 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2411919 Dec 21 04:07:05.576187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:53Z', 'revision_number': 6, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:05.602515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d429729-7f50-4f66-8548-72880273b570 req-5e338d81-5191-4a34-997a-05ca4ef72a31 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:05.604074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d429729-7f50-4f66-8548-72880273b570 req-5e338d81-5191-4a34-997a-05ca4ef72a31 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 944 time: 0.4314811 Dec 21 04:07:05.642476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c2531c9-8cab-47a5-915a-bbbf39758f5a None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:06:53Z', 'revision_number': 6, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c2c5190e-bf97-41ff-b40e-009d2b00c746', 'name': '', 'network_id': '21c72edc-8844-45a3-93c7-94b865615264', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:63:24:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_interface', 'standard_attr_id': 2379, 'fixed_ips': [{'subnet_id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:43Z', 'updated_at': '2021-12-21T04:04:49Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '16163aab-7fce-4449-a3d4-4b3d03e00005', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:05.655189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] For port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:05.699839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a7715dc-de62-41e1-968e-7d53becae0bb req-405ad0ff-2101-4bc9-b3bb-feb2718700c9 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2069645 Dec 21 04:07:05.705679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] For port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:05.713791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86343740-f5ad-492d-92e3-972d66c322ff req-aa9f7d02-1be2-4bfa-b472-354d7d2367e7 service neutron] 10.222.0.31 "GET /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2056768 Dec 21 04:07:05.759841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d429729-7f50-4f66-8548-72880273b570 req-8ce1bd8c-cf1f-4607-a8f4-a3868229bff5 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1291792 Dec 21 04:07:05.808271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:05.888499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:05.889220 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:05.892307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] 10.222.0.31 "PUT /v2.0/ports/89f97b5c-7b23-47f9-ab5f-a9e7349fdacd HTTP/1.1" status: 200 len: 1093 time: 2.1672845 Dec 21 04:07:05.892668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:05.895236 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59ae3345-4412-4fe1-914a-8d5b150a7f7c" -d '{"events": [{"name": "network-changed", "server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:05.913813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:05.942783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fe106b8-1ba3-474f-a45a-02e404990a1f service neutron] Pushing event updated for resources: {'Port': ['ID=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:05.975474 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5e91513-36a0-410a-a835-e6b7c129d8ae x-openstack-request-id: req-b5e91513-36a0-410a-a835-e6b7c129d8ae {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:05.975980 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:05.976477 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b5e91513-36a0-410a-a835-e6b7c129d8ae {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:05.976979 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'status': 'completed', 'code': 200} Dec 21 04:07:06.113919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ae3345-4412-4fe1-914a-8d5b150a7f7c req-9c0222c3-ec56-4c29-a775-2c6aa73a3135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.116188 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8256d053-1e05-4ea0-ac12-29827e7da41c None None] New status for floating IP a2d88347-0fc8-4148-a28b-cbb31674935d: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:07:06.120701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59ae3345-4412-4fe1-914a-8d5b150a7f7c req-9c0222c3-ec56-4c29-a775-2c6aa73a3135 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 1096 time: 0.0943675 Dec 21 04:07:06.237346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:06.322133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ae3345-4412-4fe1-914a-8d5b150a7f7c req-5df9aa9d-6e29-46a2-82f9-a6820bb80daa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.323633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59ae3345-4412-4fe1-914a-8d5b150a7f7c req-5df9aa9d-6e29-46a2-82f9-a6820bb80daa service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=3f578ba291d54826a6db2accb249f808&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1614425 Dec 21 04:07:06.458611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 5e6e374e-262e-40dd-bea9-2b2e820f8272 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:07:06.471573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ae3345-4412-4fe1-914a-8d5b150a7f7c req-56b28247-22aa-40ea-982e-74ef1b174d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.474142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59ae3345-4412-4fe1-914a-8d5b150a7f7c req-56b28247-22aa-40ea-982e-74ef1b174d9b service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1227899 Dec 21 04:07:06.583740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:06.593427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Sync routers for ids ['5e6e374e-262e-40dd-bea9-2b2e820f8272'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:06.597394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-c0eeabc1-a41d-45ea-a37f-a7cf6db9148e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.601179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-c0eeabc1-a41d-45ea-a37f-a7cf6db9148e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 1096 time: 0.0560868 Dec 21 04:07:06.606413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Routers {'5e6e374e-262e-40dd-bea9-2b2e820f8272'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:06.607052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5e6e374e-262e-40dd-bea9-2b2e820f8272'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:06.704742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:06.707228 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-07121817-e136-4b12-b0b1-7d6f240641ff tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 3.6933441 Dec 21 04:07:06.711174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49818) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:06.722262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Set router 5e6e374e-262e-40dd-bea9-2b2e820f8272 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:06.738963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-f767d2ce-c29e-4e54-873c-f48244bd95ac service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd HTTP/1.1" status: 200 len: 217 time: 0.0862787 Dec 21 04:07:06.816187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de129fc-d858-4213-8466-a07fee80442d req-6097bdf5-5974-4732-badb-593b847d6c03 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.817957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0de129fc-d858-4213-8466-a07fee80442d req-6097bdf5-5974-4732-badb-593b847d6c03 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 945 time: 0.1646991 Dec 21 04:07:06.864615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba88d867-522f-4721-a721-5312c805c632 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.875481 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ba88d867-522f-4721-a721-5312c805c632 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=e4be3566d3c34a19a30558795061b823&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 829 time: 0.1593246 Dec 21 04:07:06.876227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49824) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:06.907766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-d26cddea-4de8-4c33-89f6-626343ef740a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:06.909197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-d26cddea-4de8-4c33-89f6-626343ef740a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.1627812 Dec 21 04:07:07.040368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61925c8-d031-441d-9210-b39190ba1af4 req-a7f3028e-df78-4fd9-a8b1-8ff31e0754a6 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:07.047426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f97d49a-b7cf-4b17-9d2d-5228c3175766 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:07.047956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:05Z', 'revision_number': 3, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:07.053123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c61925c8-d031-441d-9210-b39190ba1af4 req-a7f3028e-df78-4fd9-a8b1-8ff31e0754a6 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 944 time: 0.1785126 Dec 21 04:07:07.053264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f97d49a-b7cf-4b17-9d2d-5228c3175766 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1730683 Dec 21 04:07:07.053264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:07.084621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-39a391b4-0bec-4f21-9b2e-b636d705b4d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:07.086135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-39a391b4-0bec-4f21-9b2e-b636d705b4d0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1537790 Dec 21 04:07:07.132688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ef847575-ce31-444d-a66e-3d32f03a41cf tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0750332 Dec 21 04:07:07.133277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49832) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:07.193570 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b999058-36ec-4a28-a0b7-5410985e688a tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=e4be3566d3c34a19a30558795061b823&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0556898 Dec 21 04:07:07.193768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:07.198976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c61925c8-d031-441d-9210-b39190ba1af4 req-0feede1b-71c1-451a-aeaa-57c17dec3fed tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1382310 Dec 21 04:07:07.235706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port b797276e-67e7-4d1b-a6ce-b9461293532b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:07.236425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.286992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a85d0e7-872f-4d1d-bd1f-bc44133f0d59 req-ba651b10-85f0-4b6a-9192-ee2264e9edef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:07.289681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a85d0e7-872f-4d1d-bd1f-bc44133f0d59 req-ba651b10-85f0-4b6a-9192-ee2264e9edef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 945 time: 0.3847473 Dec 21 04:07:07.331444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddb20168-6234-4ef8-862e-c0ea21ce4bb6 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:07.336299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ddb20168-6234-4ef8-862e-c0ea21ce4bb6 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1384084 Dec 21 04:07:07.336438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49838) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:07.362864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Checking router: 5e6e374e-262e-40dd-bea9-2b2e820f8272 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:07.363175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Updating router 5e6e374e-262e-40dd-bea9-2b2e820f8272 port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:07:07.373753 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b9aee16-6b1c-48da-852e-4dc7299b4948 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0339613 Dec 21 04:07:07.374014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49842) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:07.379615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1141878954', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:07.390891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.470052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a85d0e7-872f-4d1d-bd1f-bc44133f0d59 req-6f7700a7-4354-417b-9378-ca3d86211d4b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=d566f66d-6216-4613-b66c-027f51395f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1429198 Dec 21 04:07:07.471997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-8dbc4a8d-534a-4162-a0c3-0e7ef40149d9 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3075154 Dec 21 04:07:07.525204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port b797276e-67e7-4d1b-a6ce-b9461293532b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b797276e-67e7-4d1b-a6ce-b9461293532b,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:07.525552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.589200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for b797276e-67e7-4d1b-a6ce-b9461293532b owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:07.595903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Made reservation on behalf of e4be3566d3c34a19a30558795061b823 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:07.599195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.700490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38f7827d-1c53-40a9-8a9f-ad63c652e00e req-19ee3464-4366-4981-9d1a-ab2a88a510c5 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1979153 Dec 21 04:07:07.802435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.868797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.898800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.899202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:07.927194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=b797276e-67e7-4d1b-a6ce-b9461293532b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:07.954908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a8d89bd-4ac0-4968-9b79-d7011dae1156 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:07.982700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a297cd-f819-439f-b49f-034c00b46290 None None] Pushing event updated for resources: {'Port': ['ID=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:07.986020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Attempting to bind port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:07.991041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Attempting to bind port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:07.991041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Attempting to bind port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:07.993878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] No DVR routers for this DVR port b797276e-67e7-4d1b-a6ce-b9461293532b on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:07.996831 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.000750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0de129fc-d858-4213-8466-a07fee80442d req-f5747963-7875-40a6-8dab-bba7d2a952ed tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "DELETE /v2.0/ports/b797276e-67e7-4d1b-a6ce-b9461293532b HTTP/1.1" status: 204 len: 173 time: 1.1755073 Dec 21 04:07:08.001211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'name': 'network-vif-deleted', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:08.012235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 6, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:08.012613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:08.013025 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.013419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:08.013909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Bound port: 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:08.014280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.014872 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bef87609-fbcb-40c0-9496-64062fe712d5" -d '{"events": [{"server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "name": "network-vif-deleted", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:08.044855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Subnet': ['ID=25b2f88d-507b-4adc-b3d7-44bc89a66393,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:08.057875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Checking segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:08.058486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network hostable DHCP agents. Network: 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:07:08.078802 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed9e8448-8d06-478f-bc51-c0d92db1cd77 x-openstack-request-id: req-ed9e8448-8d06-478f-bc51-c0d92db1cd77 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:08.079576 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ee12f2c-1459-48ee-abd6-dd2c798c13eb", "name": "network-vif-deleted", "tag": "b797276e-67e7-4d1b-a6ce-b9461293532b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:08.079576 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ed9e8448-8d06-478f-bc51-c0d92db1cd77 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:08.080271 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ee12f2c-1459-48ee-abd6-dd2c798c13eb', 'name': 'network-vif-deleted', 'tag': 'b797276e-67e7-4d1b-a6ce-b9461293532b', 'status': 'completed', 'code': 200} Dec 21 04:07:08.108797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-16132bb2-214b-412e-aa6a-62c3a028e29a None None] Provisioning complete for port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:08.109404 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-16132bb2-214b-412e-aa6a-62c3a028e29a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.111459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] For port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:08.115646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] For port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:08.149165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-16132bb2-214b-412e-aa6a-62c3a028e29a None None] Port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:08.156029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:07:08.179273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.229218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:08.231148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Routers {'5e6e374e-262e-40dd-bea9-2b2e820f8272'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:08.231750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5e6e374e-262e-40dd-bea9-2b2e820f8272'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:08.239284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:08.240782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.317702 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc406214-bde0-48e7-961a-fddee4b51614 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.9424000 Dec 21 04:07:08.321125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49870) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:08.336295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e03909ff-9640-4348-84cf-a73dfd529390 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:08.347284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38fb3f20-577b-451f-a39c-994ef20d16f4 None None] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:08.397917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85cf493-d9a6-420d-acd7-1c02da23d9ff req-ae0a6889-70b2-4da8-b14e-f9f9caa09080 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:08.399970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85cf493-d9a6-420d-acd7-1c02da23d9ff req-ae0a6889-70b2-4da8-b14e-f9f9caa09080 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 944 time: 0.1143579 Dec 21 04:07:08.527963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a297cd-f819-439f-b49f-034c00b46290 None None] Pushing event updated for resources: {'Port': ['ID=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:08.553517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85cf493-d9a6-420d-acd7-1c02da23d9ff req-92f5347e-d3c6-4779-8438-c7f9e5fa0c11 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1441720 Dec 21 04:07:08.570173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] Set router 5e6e374e-262e-40dd-bea9-2b2e820f8272 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:08.657438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19d41bf8-71f6-4c7e-8594-0177bf6a9ac9 req-f372198a-f966-43b9-832c-cb423bb27c04 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=5ee12f2c-1459-48ee-abd6-dd2c798c13eb HTTP/1.1" status: 200 len: 210 time: 0.0367599 Dec 21 04:07:08.766325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7d4e021f-ae85-4af3-b505-5c4e40509966 None None] Provisioning complete for port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:08.767044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d4e021f-ae85-4af3-b505-5c4e40509966 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:08.831250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'project_id': 'e4be3566d3c34a19a30558795061b823', 'fixed_ips': [{'subnet_id': '25b2f88d-507b-4adc-b3d7-44bc89a66393'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:07:08.832287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.028899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.033914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Allocated IP 172.20.0.18 (647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0/25b2f88d-507b-4adc-b3d7-44bc89a66393/e2164628-05bd-418a-9b32-e2889d6764ba) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:09.226736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d4e021f-ae85-4af3-b505-5c4e40509966 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.251748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7d4e021f-ae85-4af3-b505-5c4e40509966 None None] For port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:09.279803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:05Z', 'revision_number': 3, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:09.320503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1063ea05-b9e9-4be9-a9d9-65f395be87a2 None None] The sync data for ids ['5e6e374e-262e-40dd-bea9-2b2e820f8272'] in n-d-822053-11 is: [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:05Z', 'revision_number': 3, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:09.324079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d4e021f-ae85-4af3-b505-5c4e40509966 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.438975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.448371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4e021f-ae85-4af3-b505-5c4e40509966 None None] Pushing event updated for resources: {'Port': ['ID=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:09.541963 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.597184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:09.617973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:09.643644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:09.671445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Pushing event updated for resources: {'Port': ['ID=e2164628-05bd-418a-9b32-e2889d6764ba,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:09.732135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.20.0.17 (647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0/25b2f88d-507b-4adc-b3d7-44bc89a66393/6595bc22-d041-4482-8249-86154b09e4b1) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:09.804783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Attempting to bind port e2164628-05bd-418a-9b32-e2889d6764ba on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:09.809687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Attempting to bind port e2164628-05bd-418a-9b32-e2889d6764ba by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:09.811740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Attempting to bind port e2164628-05bd-418a-9b32-e2889d6764ba on network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:09.815842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4838ca72-82c5-4ef9-b523-de519c57bf89 req-bc8d43f4-c689-4956-bc34-5bfff8241600 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:09.826007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4838ca72-82c5-4ef9-b523-de519c57bf89 req-bc8d43f4-c689-4956-bc34-5bfff8241600 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 944 time: 0.1744843 Dec 21 04:07:09.835904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 6, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:09.836523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Checking segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:09.837378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.837378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Bound using segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:09.844441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Bound port: e2164628-05bd-418a-9b32-e2889d6764ba, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:09.844926 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:09.858291 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:07:09.967286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] For port e2164628-05bd-418a-9b32-e2889d6764ba, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:09.971883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] For port e2164628-05bd-418a-9b32-e2889d6764ba, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e2164628-05bd-418a-9b32-e2889d6764ba,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:10.007683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.015219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:07:10.016734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4838ca72-82c5-4ef9-b523-de519c57bf89 req-061fc042-9114-43d2-a727-83915939e845 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1900587 Dec 21 04:07:10.050973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b797276e-67e7-4d1b-a6ce-b9461293532b no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:10.065518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.095132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.111881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.117727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49914) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:10.128331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.140074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.149625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: b797276e-67e7-4d1b-a6ce-b9461293532b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:10.149625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b797276e-67e7-4d1b-a6ce-b9461293532b not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:10.153027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.175043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.185717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.190669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:10.205486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-9b848aa7-dfe5-455d-9c3a-cdd0364337e7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.3652749 Dec 21 04:07:10.318243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=6595bc22-d041-4482-8249-86154b09e4b1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:10.368709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856dd45a-9be3-44bb-ad2d-f5b0067bad3d req-84a0819e-7358-46ad-9560-9d1c58ad76d0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1621704 Dec 21 04:07:10.384772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:10.388587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:10.393401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:10.431922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e53911d-8f41-4c43-a74a-6b60eec83cbb None None] Pushing event updated for resources: {'Port': ['ID=e2164628-05bd-418a-9b32-e2889d6764ba,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:10.437664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5fdf2d1-fb38-4d61-9063-7e841052fa3c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.472047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5fdf2d1-fb38-4d61-9063-7e841052fa3c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.487698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:10.533302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'port_id': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'mac_address': 'fa:16:3e:32:f6:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:07:10.601677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.648361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.689090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:10.724181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5fdf2d1-fb38-4d61-9063-7e841052fa3c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.728744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5fdf2d1-fb38-4d61-9063-7e841052fa3c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.733601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e5fdf2d1-fb38-4d61-9063-7e841052fa3c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/security-groups/d566f66d-6216-4613-b66c-027f51395f51 HTTP/1.1" status: 204 len: 168 time: 0.6147192 Dec 21 04:07:10.748984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:10.822268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:10.840855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5fdf2d1-fb38-4d61-9063-7e841052fa3c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d566f66d-6216-4613-b66c-027f51395f51,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:10.859884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 49940) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:11.009586 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:11.022085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:11.155179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['89f97b5c-7b23-47f9-ab5f-a9e7349fdacd'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:07:11.222278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18276be-12ca-4613-908f-6136edfd8969 req-f22b4bb4-fb36-44c7-8e67-2ea4b7c34c35 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.245056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f18276be-12ca-4613-908f-6136edfd8969 req-f22b4bb4-fb36-44c7-8e67-2ea4b7c34c35 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 945 time: 0.1373529 Dec 21 04:07:11.331077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.340710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:11.350245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.356359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.362320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.366918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f18276be-12ca-4613-908f-6136edfd8969 req-37f1f8b3-6083-4d54-928d-31fc5f068a3a tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1207850 Dec 21 04:07:11.385496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.391640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.397773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.401271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-5669ea7f-11b8-4ec2-89c2-dad21883774e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.4830298 Dec 21 04:07:11.562836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:11.563319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:11.668037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.678029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6325c71f-1a80-4f8d-b4b2-97bef176c96f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.678871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.679520 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6325c71f-1a80-4f8d-b4b2-97bef176c96f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "GET /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.2680447 Dec 21 04:07:11.695445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.702594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.711744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.719739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.728132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:11.738137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-49726016-f609-4266-8f5c-33ceafa67977 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.1854742 Dec 21 04:07:11.747040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e2164628-05bd-418a-9b32-e2889d6764ba up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:11.866955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e2164628-05bd-418a-9b32-e2889d6764ba triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:11.867343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:11.868246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d332a66d-04a1-4a1c-a0c6-c9cac9a77e05 req-231aca92-c61f-425a-944e-8e47dc79ba1f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1280272 Dec 21 04:07:11.937120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ada39ce-4964-4ad5-bd67-747c79488bbd None None] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:12.038687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d9672e83-18a8-4003-bba8-ca96f49e475b None None] Provisioning complete for port e2164628-05bd-418a-9b32-e2889d6764ba triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:12.039412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d9672e83-18a8-4003-bba8-ca96f49e475b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.323171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.404701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port e2164628-05bd-418a-9b32-e2889d6764ba, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e2164628-05bd-418a-9b32-e2889d6764ba,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:12.427178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d9672e83-18a8-4003-bba8-ca96f49e475b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.478459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.576284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9029718e-33b9-4bf1-9090-3a2d7be5b33e req-88bfc74f-ed04-42a1-bb1b-b77e3bca98ff tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:12.587708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9029718e-33b9-4bf1-9090-3a2d7be5b33e req-88bfc74f-ed04-42a1-bb1b-b77e3bca98ff tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 945 time: 0.0887401 Dec 21 04:07:12.608480 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-d9672e83-18a8-4003-bba8-ca96f49e475b None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:07:12.609546 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-d9672e83-18a8-4003-bba8-ca96f49e475b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:07:12.633026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=e2164628-05bd-418a-9b32-e2889d6764ba,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:12.676970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-94b0ade6-0c86-4428-b711-f05fe641780f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "GET /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.9831896 Dec 21 04:07:12.704982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.710269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:12.742022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9029718e-33b9-4bf1-9090-3a2d7be5b33e req-783b6989-6760-4a4a-b8c4-91ae6bbf9482 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1454694 Dec 21 04:07:12.795211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.868318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:12.940925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=6595bc22-d041-4482-8249-86154b09e4b1,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:12.965410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.097613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e2164628-05bd-418a-9b32-e2889d6764ba up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:13.171670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.185484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.195213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.217208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.230817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.241923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.252483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.267900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.278457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73357629-9291-463f-a5ae-27fc373a062c req-70778704-0cfd-48be-9fde-c89e682dec8c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 5441 time: 0.2390230 Dec 21 04:07:13.293494 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e2164628-05bd-418a-9b32-e2889d6764ba triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:13.294587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.316410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:13.318162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c52f2e0e-5f59-462b-97c5-d88f03894186,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:13.328062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:13.386648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73357629-9291-463f-a5ae-27fc373a062c req-d214def4-54d8-4f02-a531-893711e8797c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1064165 Dec 21 04:07:13.406543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ffce64d6-57c5-4cc9-bd68-d44b561dcbb8 None None] Provisioning complete for port e2164628-05bd-418a-9b32-e2889d6764ba triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:13.407220 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ffce64d6-57c5-4cc9-bd68-d44b561dcbb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.512976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] For port c52f2e0e-5f59-462b-97c5-d88f03894186, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:13.628075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c204c117-523f-49b5-9420-dc05e685d6de no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:13.685790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] device_id is not set on port c52f2e0e-5f59-462b-97c5-d88f03894186 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:07:13.694198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ffce64d6-57c5-4cc9-bd68-d44b561dcbb8 None None] Provisioning complete for port 6595bc22-d041-4482-8249-86154b09e4b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:13.694608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ffce64d6-57c5-4cc9-bd68-d44b561dcbb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.739224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.784436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 5e6e374e-262e-40dd-bea9-2b2e820f8272 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:13.828204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.928187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ffce64d6-57c5-4cc9-bd68-d44b561dcbb8 None None] Port 6595bc22-d041-4482-8249-86154b09e4b1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:13.940300 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:13.959862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c454ffe4-4a21-4ca5-9280-13f87ce31378 req-e2e4ac68-9476-4884-8602-bfe81cd269cc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:13.961479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c454ffe4-4a21-4ca5-9280-13f87ce31378 req-e2e4ac68-9476-4884-8602-bfe81cd269cc tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 945 time: 0.0779359 Dec 21 04:07:14.018711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:14.022392 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5979c961-86ea-4717-9d88-5f568efed46c" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "c204c117-523f-49b5-9420-dc05e685d6de"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:14.075692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:14.101587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c454ffe4-4a21-4ca5-9280-13f87ce31378 req-270e0779-df82-46f1-acbb-4ee8ce260af7 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1293380 Dec 21 04:07:14.123007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] No DVR routers for this DVR port c52f2e0e-5f59-462b-97c5-d88f03894186 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:14.127378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Pushing event updated for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:14.132177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c204c117-523f-49b5-9420-dc05e685d6de,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:14.151558 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26fb2883-871d-4000-a5d2-e0b4240fc8ec x-openstack-request-id: req-26fb2883-871d-4000-a5d2-e0b4240fc8ec {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:14.151800 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "c204c117-523f-49b5-9420-dc05e685d6de", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:14.152060 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-26fb2883-871d-4000-a5d2-e0b4240fc8ec {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:14.152457 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de', 'code': 200} Dec 21 04:07:14.190465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-03f35b45-2205-47d0-be98-e78e547c53b4 None None] Provisioning complete for port 6595bc22-d041-4482-8249-86154b09e4b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:14.191210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03f35b45-2205-47d0-be98-e78e547c53b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.234810 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.236796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f21e2d88-8221-4926-95ac-3ed4e081cd85 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:14.283495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:14.294699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Sync routers for ids ['5e6e374e-262e-40dd-bea9-2b2e820f8272'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:14.312281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7bc1eea-6f81-4e64-b4e6-28615dfddbe6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "PUT /v2.0/routers/5e6e374e-262e-40dd-bea9-2b2e820f8272/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9898252 Dec 21 04:07:14.316249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] In _notify_port_updated(), no bound segment for port c52f2e0e-5f59-462b-97c5-d88f03894186 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:07:14.326849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.326849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.326849 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a4bc3870-c5cf-4d47-b6e3-6f571fb37bd5 service neutron] 10.222.0.54 "PUT /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 200 len: 1031 time: 1.6194601 Dec 21 04:07:14.327493 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Routers {'5e6e374e-262e-40dd-bea9-2b2e820f8272'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:14.328303 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5e6e374e-262e-40dd-bea9-2b2e820f8272'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:14.424819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-40082bb9-a39a-423e-a652-1092a5a2530c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.427086 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-40082bb9-a39a-423e-a652-1092a5a2530c tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "GET /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0980473 Dec 21 04:07:14.434873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port c2c5190e-bf97-41ff-b40e-009d2b00c746 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:14.435273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.458612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:14.500765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:14.516899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:07:14.524730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:14.525325 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.641370 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Set router 5e6e374e-262e-40dd-bea9-2b2e820f8272 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:14.645073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.657432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.670660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-03f35b45-2205-47d0-be98-e78e547c53b4 None None] Port 6595bc22-d041-4482-8249-86154b09e4b1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:14.672904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.688511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.693505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port c2c5190e-bf97-41ff-b40e-009d2b00c746, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c2c5190e-bf97-41ff-b40e-009d2b00c746,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:14.694043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.707028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.717097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.740767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.747612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for c2c5190e-bf97-41ff-b40e-009d2b00c746 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:14.748988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-97e21c74-f6a7-45bf-91f2-ba7a4cfd7cb6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 4661 time: 0.2065814 Dec 21 04:07:14.823477 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:14.950084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba96be21-8516-41bc-9bfb-30f3d6c177b7 req-00cc7028-57ad-4578-9d2f-eaf70eb4f7c6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=ccd453dc-aa16-4aa6-836a-b6ef27489378&id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1926239 Dec 21 04:07:14.975268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-2fb90da6-0db0-4e94-b59a-045afc8ee61f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:14.975268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-2fb90da6-0db0-4e94-b59a-045afc8ee61f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/networks?id=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 HTTP/1.1" status: 200 len: 798 time: 0.3839886 Dec 21 04:07:15.000090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-33a542bf-3d45-41c9-b3b0-19b04e5909e6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/quotas/e4be3566d3c34a19a30558795061b823 HTTP/1.1" status: 200 len: 375 time: 0.0122726 Dec 21 04:07:15.033391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cef41d9d-dc9e-478d-a77c-ae84102cd6f4 None None] Provisioning complete for port c52f2e0e-5f59-462b-97c5-d88f03894186 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:15.034079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cef41d9d-dc9e-478d-a77c-ae84102cd6f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.041755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:10Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6595bc22-d041-4482-8249-86154b09e4b1', 'name': '', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:1a:a1:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_interface', 'standard_attr_id': 2523, 'fixed_ips': [{'subnet_id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:09Z', 'updated_at': '2021-12-21T04:07:11Z', 'revision_number': 2, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:15.085053 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Checking router: 5e6e374e-262e-40dd-bea9-2b2e820f8272 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:15.085435 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Updating router 5e6e374e-262e-40dd-bea9-2b2e820f8272 port 6595bc22-d041-4482-8249-86154b09e4b1 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:07:15.094247 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.145614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cef41d9d-dc9e-478d-a77c-ae84102cd6f4 None None] Port c52f2e0e-5f59-462b-97c5-d88f03894186 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:15.156474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:15.190091 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.210682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:15.226168 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.226444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf55164f-f3e6-47de-9335-4f151942a1c5,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:15.227405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf55164f-f3e6-47de-9335-4f151942a1c5 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:15.270301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-2a7a89de-a1ab-4033-b94d-ea4007160fa7 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&fields=id HTTP/1.1" status: 200 len: 440 time: 0.2479227 Dec 21 04:07:15.279913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] For port bf55164f-f3e6-47de-9335-4f151942a1c5, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:15.409273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.423232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] device_id is not set on port bf55164f-f3e6-47de-9335-4f151942a1c5 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:07:15.437965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.469616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caefc300-6d17-4c14-a78f-d989806c0b73 req-460ca114-44ab-4efe-89f8-e86db6da7901 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:15.482471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caefc300-6d17-4c14-a78f-d989806c0b73 req-460ca114-44ab-4efe-89f8-e86db6da7901 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.2722464 Dec 21 04:07:15.527616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.555873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.606166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:15.620183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.759789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] No DVR routers for this DVR port bf55164f-f3e6-47de-9335-4f151942a1c5 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:15.761700 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.809350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:15.816231 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:07:15.816595 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:07:15.835944 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.861033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] In _notify_port_updated(), no bound segment for port bf55164f-f3e6-47de-9335-4f151942a1c5 on network 8d559823-2509-427a-8bd4-77cf5a81095a {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:07:15.862813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:15.874923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:15.877249 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] 10.222.0.54 "PUT /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 200 len: 1032 time: 1.4360299 Dec 21 04:07:15.879182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be02622b-6ad9-48d8-9f35-d5686df27b53 service neutron] Pushing event updated for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:15.975884 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Pushing event updated for resources: {'Port': ['ID=6595bc22-d041-4482-8249-86154b09e4b1,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:16.040260 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.040648 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.040951 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.041275 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.041599 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.041922 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.042244 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.042561 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.042872 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.043223 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.043537 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.043851 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.044163 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:16.127267 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Attempting to bind port 6595bc22-d041-4482-8249-86154b09e4b1 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:16.127637 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Attempting to bind port 6595bc22-d041-4482-8249-86154b09e4b1 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:16.128000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Attempting to bind port 6595bc22-d041-4482-8249-86154b09e4b1 on network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:16.139505 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 6, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:16.143409 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Checking segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:16.143409 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.143409 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Bound using segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:16.143409 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Bound port: 6595bc22-d041-4482-8249-86154b09e4b1, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:16.143409 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.153682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85'}, {'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:16.156159 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9626ae35-2295-499d-a116-62525cd90a76" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85"}, {"server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "name": "network-vif-plugged", "status": "completed", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:16.226096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=c2c5190e-bf97-41ff-b40e-009d2b00c746,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:16.296198 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] For port 6595bc22-d041-4482-8249-86154b09e4b1, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:16.306078 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] For port 6595bc22-d041-4482-8249-86154b09e4b1, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6595bc22-d041-4482-8249-86154b09e4b1,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:16.312226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caefc300-6d17-4c14-a78f-d989806c0b73 req-d1cb4811-f983-4f21-82ed-aa12cbc749da tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8286538 Dec 21 04:07:16.349512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-7e09a823-9417-401c-8dc0-1ce16d1f0c66 service neutron] 10.222.0.18 "GET /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0783439 Dec 21 04:07:16.398347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c52f2e0e-5f59-462b-97c5-d88f03894186 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:16.402016 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.520571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.522502 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Routers {'5e6e374e-262e-40dd-bea9-2b2e820f8272'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:16.522502 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5e6e374e-262e-40dd-bea9-2b2e820f8272'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:16.537565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e05483de-ae5b-4ea8-bc66-80609bfd7f0d None None] Provisioning complete for port bf55164f-f3e6-47de-9335-4f151942a1c5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:16.543535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e05483de-ae5b-4ea8-bc66-80609bfd7f0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.588333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port 29c72524-1fd4-42e5-a743-56e89cdcd6eb {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:16.588671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.590888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port c52f2e0e-5f59-462b-97c5-d88f03894186 host ! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:07:16.591315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c52f2e0e-5f59-462b-97c5-d88f03894186 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:16.591749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1626b9fe-82dc-4958-a0d0-4436a98fe01f no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:16.671807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-14d305f7-c665-4585-a200-421e37633621 service neutron] 10.222.0.18 "GET /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3213804 Dec 21 04:07:16.709998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7ad833-21ba-4084-9d79-36918daf00fb req-5ee49dc4-9eb3-4283-8cc7-f5c60d9efb19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:16.723144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7ad833-21ba-4084-9d79-36918daf00fb req-5ee49dc4-9eb3-4283-8cc7-f5c60d9efb19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:16.737071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e05483de-ae5b-4ea8-bc66-80609bfd7f0d None None] Port bf55164f-f3e6-47de-9335-4f151942a1c5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:16.747890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7ad833-21ba-4084-9d79-36918daf00fb req-5ee49dc4-9eb3-4283-8cc7-f5c60d9efb19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:16.764366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7ad833-21ba-4084-9d79-36918daf00fb req-5ee49dc4-9eb3-4283-8cc7-f5c60d9efb19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:16.785075 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8cec68-ea6a-4cf6-b91d-c63f5f391f5d None None] Pushing event updated for resources: {'Port': ['ID=6595bc22-d041-4482-8249-86154b09e4b1,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:16.797797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7ad833-21ba-4084-9d79-36918daf00fb req-5ee49dc4-9eb3-4283-8cc7-f5c60d9efb19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:16.800417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da7ad833-21ba-4084-9d79-36918daf00fb req-5ee49dc4-9eb3-4283-8cc7-f5c60d9efb19 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 3880 time: 0.3108628 Dec 21 04:07:16.835110 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] Set router 5e6e374e-262e-40dd-bea9-2b2e820f8272 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:16.907829 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.912894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-24b091b7-5f0d-47f8-855d-db882a9af740 None None] Provisioning complete for port 6595bc22-d041-4482-8249-86154b09e4b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:16.913261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24b091b7-5f0d-47f8-855d-db882a9af740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:16.919647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da7ad833-21ba-4084-9d79-36918daf00fb req-a6bad7bc-d852-4cf3-985f-8dd8a0bb43f1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1078775 Dec 21 04:07:17.002275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] For port 29c72524-1fd4-42e5-a743-56e89cdcd6eb, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=29c72524-1fd4-42e5-a743-56e89cdcd6eb,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:17.002797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:17.096502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:17.130145 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d0eded7-ed1b-4557-815f-bb2b90badf1c x-openstack-request-id: req-9d0eded7-ed1b-4557-815f-bb2b90badf1c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:17.131204 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85", "code": 200}, {"server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "name": "network-vif-plugged", "status": "completed", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:17.131635 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9d0eded7-ed1b-4557-815f-bb2b90badf1c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:17.132275 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85', 'code': 200} Dec 21 04:07:17.132770 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'code': 200} Dec 21 04:07:17.166470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8538b95f-ed73-44ce-a81a-8c34e1a66d96 req-3cb786e8-93dd-455a-9fc7-92a9770eea9a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 210 time: 0.0678699 Dec 21 04:07:17.212686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:17.213396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:17.306803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a1127d-2cc6-47ba-b7c7-8ce24d4b743f req-38d1ba8b-0ab0-44ed-be9d-42da234631db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:17.311990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9a1127d-2cc6-47ba-b7c7-8ce24d4b743f req-38d1ba8b-0ab0-44ed-be9d-42da234631db service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 1098 time: 0.0924647 Dec 21 04:07:17.385201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24b091b7-5f0d-47f8-855d-db882a9af740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:17.442158 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:10Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6595bc22-d041-4482-8249-86154b09e4b1', 'name': '', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:1a:a1:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_interface', 'standard_attr_id': 2523, 'fixed_ips': [{'subnet_id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:09Z', 'updated_at': '2021-12-21T04:07:16Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:17.446697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:17.451642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9a1127d-2cc6-47ba-b7c7-8ce24d4b743f req-6d98005a-5e3c-45fc-a702-69d70b35e01a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1305482 Dec 21 04:07:17.493814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-336b232c-c0d9-4ac0-9cb3-1fec1e876fad None None] The sync data for ids ['5e6e374e-262e-40dd-bea9-2b2e820f8272'] in n-d-822053-11 is: [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:10Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '6595bc22-d041-4482-8249-86154b09e4b1', 'name': '', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:1a:a1:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_interface', 'standard_attr_id': 2523, 'fixed_ips': [{'subnet_id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:09Z', 'updated_at': '2021-12-21T04:07:16Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:17.544576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d050d6b-097a-46a0-a7f1-cf67e845a6a5 req-b9996829-fad9-44f4-bac0-31ae3f91f4f2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:17.575926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d050d6b-097a-46a0-a7f1-cf67e845a6a5 req-b9996829-fad9-44f4-bac0-31ae3f91f4f2 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.1539690 Dec 21 04:07:17.664911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:17.697083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24b091b7-5f0d-47f8-855d-db882a9af740 None None] For port 6595bc22-d041-4482-8249-86154b09e4b1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6595bc22-d041-4482-8249-86154b09e4b1,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:17.707338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d050d6b-097a-46a0-a7f1-cf67e845a6a5 req-862bbc64-76f0-4766-a9ce-66d28c76de62 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1278989 Dec 21 04:07:17.780164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:17.784767 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24b091b7-5f0d-47f8-855d-db882a9af740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:17.823732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for 29c72524-1fd4-42e5-a743-56e89cdcd6eb owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:17.850249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b091b7-5f0d-47f8-855d-db882a9af740 None None] Pushing event updated for resources: {'Port': ['ID=6595bc22-d041-4482-8249-86154b09e4b1,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:17.885407 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:17.886147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 29c72524-1fd4-42e5-a743-56e89cdcd6eb no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:18.143209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:18.168162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50086) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:18.171036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5c06f7fd-a6c3-448e-a821-e466c533f848 None None] Provisioning complete for port 6595bc22-d041-4482-8249-86154b09e4b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:18.175638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c06f7fd-a6c3-448e-a821-e466c533f848 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:18.175791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:18.223556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No active binding found for port 29c72524-1fd4-42e5-a743-56e89cdcd6eb {{(pid=110312) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 21 04:07:18.224743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 29c72524-1fd4-42e5-a743-56e89cdcd6eb host None! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:07:18.224907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 29c72524-1fd4-42e5-a743-56e89cdcd6eb not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:18.264693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-5788a4f8-d08d-496c-8d21-f47e4d63b4d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:18.278125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-5788a4f8-d08d-496c-8d21-f47e4d63b4d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:18.290990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=29c72524-1fd4-42e5-a743-56e89cdcd6eb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:18.300446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-5788a4f8-d08d-496c-8d21-f47e4d63b4d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:18.310734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-5788a4f8-d08d-496c-8d21-f47e4d63b4d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:18.329515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-5788a4f8-d08d-496c-8d21-f47e4d63b4d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:18.332811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-5788a4f8-d08d-496c-8d21-f47e4d63b4d7 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 3798 time: 0.2166767 Dec 21 04:07:18.378060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] No DVR routers for this DVR port 29c72524-1fd4-42e5-a743-56e89cdcd6eb on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:18.382519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:18.386510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-1cf674e2-a7a0-488d-8d2d-fdbc3cc9d42b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "DELETE /v2.0/ports/29c72524-1fd4-42e5-a743-56e89cdcd6eb HTTP/1.1" status: 204 len: 173 time: 2.4843552 Dec 21 04:07:18.387059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': '29c72524-1fd4-42e5-a743-56e89cdcd6eb'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:18.389808 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4549d2ab-94f7-48c2-a935-d43220e9aea9" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "29c72524-1fd4-42e5-a743-56e89cdcd6eb"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:18.449864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2346d9f-38bc-4c54-b744-da11d618bf27 req-09cf29d1-ccf4-4aed-bbc0-9914a3c14cf8 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 210 time: 0.1021044 Dec 21 04:07:18.489659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:18.532084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router 2191bc86-3ede-4925-a826-67ac34d6fe52 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:18.545951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2e2c61c-8f23-48d6-b286-afd0461e1670 req-27b64e02-723e-47d1-89e5-cb0f98507a4e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2035792 Dec 21 04:07:18.633013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:18.641891 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-147659e3-bffc-4ca5-a0d1-3048f39df5e2 x-openstack-request-id: req-147659e3-bffc-4ca5-a0d1-3048f39df5e2 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:18.642196 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "29c72524-1fd4-42e5-a743-56e89cdcd6eb", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:18.647148 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-147659e3-bffc-4ca5-a0d1-3048f39df5e2 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:18.647148 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': '29c72524-1fd4-42e5-a743-56e89cdcd6eb', 'status': 'completed', 'code': 200} Dec 21 04:07:18.838700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:18.941340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0319a31a-e94e-4b14-8c36-dec40138fbe7 req-e7d7cb30-ab6d-4ff4-bae4-88184bed4749 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:18.957931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0319a31a-e94e-4b14-8c36-dec40138fbe7 req-e7d7cb30-ab6d-4ff4-bae4-88184bed4749 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.1141384 Dec 21 04:07:19.004446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:19.004790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.043893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50098) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:19.058736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a5549fbeb8b44117ad81a3ea14ca7852&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8692796 Dec 21 04:07:19.128750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0319a31a-e94e-4b14-8c36-dec40138fbe7 req-52f847a1-e09c-429c-a744-c018025e3796 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1690502 Dec 21 04:07:19.134076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f'}, {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:19.136683 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3531ba6-6816-44c7-b488-5ca8818f0321" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f"}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:19.146282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6595bc22-d041-4482-8249-86154b09e4b1 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:19.180977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5abe793d-f2ba-42da-83cb-a9a015f0d65a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:19.221138 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 358 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a376ee9c-0d21-4f8a-9198-24ac8299acef x-openstack-request-id: req-a376ee9c-0d21-4f8a-9198-24ac8299acef {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:19.221691 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f", "code": 200}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-unplugged", "status": "completed", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:19.222157 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a376ee9c-0d21-4f8a-9198-24ac8299acef {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:19.222910 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'code': 200} Dec 21 04:07:19.223419 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7', 'code': 200} Dec 21 04:07:19.243192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.253775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.254281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.254637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.255480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.256281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.256709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.257242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.257715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.258064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.258400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.258736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.263321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.263834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b9601c7-acce-4325-af06-b16e15778c47 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.267956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6595bc22-d041-4482-8249-86154b09e4b1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:19.272197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.281721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.347465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] For port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:19.347821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.351847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:19.361876 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-36d00a6a-61c3-45a2-bbf9-070007933c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "PUT /v2.0/routers/2191bc86-3ede-4925-a826-67ac34d6fe52/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5005298 Dec 21 04:07:19.365344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:19.371888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] Sync routers for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:19.384750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:19.433802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.439980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.444221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5abe793d-f2ba-42da-83cb-a9a015f0d65a HTTP/1.1" status: 204 len: 168 time: 0.3968313 Dec 21 04:07:19.467193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:19.468157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:19.490361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5abe793d-f2ba-42da-83cb-a9a015f0d65a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:19.541037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.541468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.543626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.543992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.547501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.548091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.548196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.548509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.548849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.549181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.549510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.549837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.550162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f4066e3-f306-4bcc-9552-17674fbe891b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:07:19.580254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting subnet 16163aab-7fce-4449-a3d4-4b3d03e00005 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:07:19.587645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.740724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a90fcf3-18f8-4f29-8025-0bdc920ec76c req-c2762017-cfd7-4ee0-b853-cb9e4674a96e tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 210 time: 0.0932946 Dec 21 04:07:19.797304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.858506 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:19.884871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07a69ee-9723-48fa-aa4c-9f570ac6dff7 req-e5f814a4-31eb-4361-8cd0-cf63ba0858c1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:19.891330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07a69ee-9723-48fa-aa4c-9f570ac6dff7 req-e5f814a4-31eb-4361-8cd0-cf63ba0858c1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:19.898163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07a69ee-9723-48fa-aa4c-9f570ac6dff7 req-e5f814a4-31eb-4361-8cd0-cf63ba0858c1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:19.904481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07a69ee-9723-48fa-aa4c-9f570ac6dff7 req-e5f814a4-31eb-4361-8cd0-cf63ba0858c1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:19.906242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07a69ee-9723-48fa-aa4c-9f570ac6dff7 req-e5f814a4-31eb-4361-8cd0-cf63ba0858c1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 3141 time: 0.1931431 Dec 21 04:07:19.931119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=3f68184f-d3c6-4097-8eb2-ecb1bd1713b7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:20.048113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] No DVR routers for this DVR port 3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:20.050913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.055776 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-6b13ab79-6f0f-46a1-b665-dc1561ec7571 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "DELETE /v2.0/ports/3f68184f-d3c6-4097-8eb2-ecb1bd1713b7 HTTP/1.1" status: 204 len: 173 time: 1.6624985 Dec 21 04:07:20.100122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:20.152763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.202505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07a69ee-9723-48fa-aa4c-9f570ac6dff7 req-db4b58f5-1ab8-4972-81b0-04fbb8499275 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2830629 Dec 21 04:07:20.219682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-7e6f6511-2477-43ce-8bee-1b076c260141 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:20.221182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-7e6f6511-2477-43ce-8bee-1b076c260141 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.31 "GET /v2.0/networks?id=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 HTTP/1.1" status: 200 len: 798 time: 0.3823431 Dec 21 04:07:20.243989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Request body: {'port': {'device_id': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'admin_state_up': True, 'tenant_id': 'e4be3566d3c34a19a30558795061b823'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:20.299860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port c204c117-523f-49b5-9420-dc05e685d6de {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:20.303194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.452877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50130) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:20.454382 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-467d7741-c14d-48f5-8a14-ee95357f0b41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.514482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.520506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] For port c204c117-523f-49b5-9420-dc05e685d6de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c204c117-523f-49b5-9420-dc05e685d6de,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:20.520915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.551846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for c204c117-523f-49b5-9420-dc05e685d6de owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:20.553457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.559595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9863022b-2108-44ec-bdce-d42e9c75b959 None None] Network 21c72edc-8844-45a3-93c7-94b865615264 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:20.561867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/subnets/16163aab-7fce-4449-a3d4-4b3d03e00005 HTTP/1.1" status: 204 len: 168 time: 1.1952658 Dec 21 04:07:20.563896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50132) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:20.567932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-697a2038-8ec9-4572-b627-b8544e71460a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.659890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d507115c-3ba2-4a02-b076-ebda99a433d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Subnet': ['ID=16163aab-7fce-4449-a3d4-4b3d03e00005,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:20.747745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:07:15Z', 'revision_number': 7, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:20.797390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-697a2038-8ec9-4572-b627-b8544e71460a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.817274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] Checking router: 2191bc86-3ede-4925-a826-67ac34d6fe52 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:20.833451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Made reservation on behalf of e4be3566d3c34a19a30558795061b823 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:20.840789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:20.840903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.841016 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8914aae-16ba-4ab0-8aa0-e394d7818f52" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:20.843624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:20.844002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] Routers {'2191bc86-3ede-4925-a826-67ac34d6fe52'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:20.844659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['2191bc86-3ede-4925-a826-67ac34d6fe52'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:20.930340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] DHCP port deletion for 21c72edc-8844-45a3-93c7-94b865615264 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:20.941467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13c77083-c4b3-4b7b-b93f-8c9910fb32e3 req-50ef576c-a508-452e-9252-ddba28dec743 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 210 time: 0.0576656 Dec 21 04:07:20.963292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-697a2038-8ec9-4572-b627-b8544e71460a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.026585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ff43c3-41d1-44e7-94ed-41ab1155b5e5 req-0c691b85-a3a0-4b9e-af03-794d9dbf8d39 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:21.028225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90ff43c3-41d1-44e7-94ed-41ab1155b5e5 req-0c691b85-a3a0-4b9e-af03-794d9dbf8d39 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.2289820 Dec 21 04:07:21.056849 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ca477f2-daa0-42a9-9e28-91c9f6b0f5d9 x-openstack-request-id: req-3ca477f2-daa0-42a9-9e28-91c9f6b0f5d9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:21.059232 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "3f68184f-d3c6-4097-8eb2-ecb1bd1713b7", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:21.060224 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3ca477f2-daa0-42a9-9e28-91c9f6b0f5d9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:21.060752 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': '3f68184f-d3c6-4097-8eb2-ecb1bd1713b7', 'status': 'completed', 'code': 200} Dec 21 04:07:21.072287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ccf69444-e380-4346-8ed0-dfaef2bb42e4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:21.153972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-697a2038-8ec9-4572-b627-b8544e71460a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f3dab3afc30245ecb3af955e921987a9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7006967 Dec 21 04:07:21.156660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] Set router 2191bc86-3ede-4925-a826-67ac34d6fe52 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:21.157125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697a2038-8ec9-4572-b627-b8544e71460a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3123b8b0-f671-42e0-83ae-b9510de37859,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:21.163586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50144) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:21.247412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.299255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90ff43c3-41d1-44e7-94ed-41ab1155b5e5 req-100afac2-0d14-4c52-aaea-1b1e2c633924 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1831491 Dec 21 04:07:21.313401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3b7f10c-6316-489e-b642-7873cf924498 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.359651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.388895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Allocated IP 172.20.0.29 (647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0/25b2f88d-507b-4adc-b3d7-44bc89a66393/3cee2956-a3a8-4db5-bccc-63f63f7d076c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:21.394496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=c204c117-523f-49b5-9420-dc05e685d6de,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:21.412299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3b7f10c-6316-489e-b642-7873cf924498 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.494082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] Deleting port ccf69444-e380-4346-8ed0-dfaef2bb42e4 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:21.495396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.513789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed6c317-4e12-439a-abf5-3c6874c21804 req-b2517c82-86c1-4147-a7c3-9998512dbe65 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:21.519166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] No DVR routers for this DVR port c204c117-523f-49b5-9420-dc05e685d6de on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:21.520044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed6c317-4e12-439a-abf5-3c6874c21804 req-b2517c82-86c1-4147-a7c3-9998512dbe65 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:21.525051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.528994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ed6c317-4e12-439a-abf5-3c6874c21804 req-b2517c82-86c1-4147-a7c3-9998512dbe65 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 1676 time: 0.1864367 Dec 21 04:07:21.529316 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-da6febbe-4e71-4c97-a718-7c2ccd816f80 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "DELETE /v2.0/ports/c204c117-523f-49b5-9420-dc05e685d6de HTTP/1.1" status: 204 len: 173 time: 1.4666593 Dec 21 04:07:21.544290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.621408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:07:15Z', 'revision_number': 7, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:21.636576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 80c7350a-da12-43ca-98fa-cd03001717ae {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:21.636981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.675827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de212af8-a3bd-43f3-a176-523c769c2d3b req-0dfdee13-8039-468e-b777-8cae810eaec1 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:21.679105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de212af8-a3bd-43f3-a176-523c769c2d3b req-0dfdee13-8039-468e-b777-8cae810eaec1 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.2654312 Dec 21 04:07:21.679452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] For port ccf69444-e380-4346-8ed0-dfaef2bb42e4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ccf69444-e380-4346-8ed0-dfaef2bb42e4,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:21.679866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.683974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f89ce601-1c6f-41d5-8933-d18401abe25f None None] The sync data for ids ['2191bc86-3ede-4925-a826-67ac34d6fe52'] in n-d-822053-11 is: [{'id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'name': 'tempest-TestNetworkBasicOps-router-1803292681', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165'}], 'enable_snat': True}, 'gw_port_id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:04:38Z', 'updated_at': '2021-12-21T04:07:15Z', 'revision_number': 7, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '80c7350a-da12-43ca-98fa-cd03001717ae', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:86:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2191bc86-3ede-4925-a826-67ac34d6fe52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2376, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:04:39Z', 'updated_at': '2021-12-21T04:04:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:21.691786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:21.703502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Request body: {'floatingip': {'port_id': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:21.710089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] Calling delete_port for ccf69444-e380-4346-8ed0-dfaef2bb42e4 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:21.734629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port ccf69444-e380-4346-8ed0-dfaef2bb42e4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ccf69444-e380-4346-8ed0-dfaef2bb42e4,segment=NetworkSegment(83aaa8ca-8514-4594-bc3f-241858877cc6),segment_id=83aaa8ca-8514-4594-bc3f-241858877cc6)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:21.746787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ed6c317-4e12-439a-abf5-3c6874c21804 req-a1d11348-eb65-4fe2-b080-607dd4c7eecf tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2129028 Dec 21 04:07:21.790719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port 1626b9fe-82dc-4958-a0d0-4436a98fe01f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:21.791098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.824572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.834145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.852317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port 80c7350a-da12-43ca-98fa-cd03001717ae, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=80c7350a-da12-43ca-98fa-cd03001717ae,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:21.854103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:21.922154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ccf69444-e380-4346-8ed0-dfaef2bb42e4,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:21.935849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 80c7350a-da12-43ca-98fa-cd03001717ae owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:22.008224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.044163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] For port 1626b9fe-82dc-4958-a0d0-4436a98fe01f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1626b9fe-82dc-4958-a0d0-4436a98fe01f,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:22.044779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.070046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] Pushing event deleted for resources: {'Port': ['ID=ccf69444-e380-4346-8ed0-dfaef2bb42e4,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:22.080934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b57912b-402f-4aa7-b050-8c7f0bbaa356 None None] No DVR routers for this DVR port ccf69444-e380-4346-8ed0-dfaef2bb42e4 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:22.230146 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3b7f10c-6316-489e-b642-7873cf924498 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.233654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d3b7f10c-6316-489e-b642-7873cf924498 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.234782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d3b7f10c-6316-489e-b642-7873cf924498 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3123b8b0-f671-42e0-83ae-b9510de37859 HTTP/1.1" status: 204 len: 168 time: 1.0700154 Dec 21 04:07:22.338567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.367027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3b7f10c-6316-489e-b642-7873cf924498 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3123b8b0-f671-42e0-83ae-b9510de37859,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:22.405721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.437211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fe4df01-adfc-451c-a313-131dfc3ca432 req-5fe0a284-9df8-4a4a-9819-9f40e19befd0 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 210 time: 0.2029099 Dec 21 04:07:22.444967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=80c7350a-da12-43ca-98fa-cd03001717ae,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:22.461961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bf04cbb-4fdc-42ed-9f5c-cb8f54806e5a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:22.555739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.642348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db7f67eb-e4c6-4635-9313-485b4f647469 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.665801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.666005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.666957 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Floating IP 84fa031d-e041-4fd4-9017-c432e03f800f disassociated. External IP: 172.25.5.254, port: 1626b9fe-82dc-4958-a0d0-4436a98fe01f. Dec 21 04:07:22.666957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for 1626b9fe-82dc-4958-a0d0-4436a98fe01f owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:22.678181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.683479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.761139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.850214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.851468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Fanout notify agent at l3_agent the message router_deleted on router 2191bc86-3ede-4925-a826-67ac34d6fe52 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:07:22.871580 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:22.875816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-afd47c29-7d40-452f-bae7-f6bbabd996e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/routers/2191bc86-3ede-4925-a826-67ac34d6fe52 HTTP/1.1" status: 204 len: 168 time: 2.3106594 Dec 21 04:07:22.885699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50196) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:23.010713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.047655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c2c5190e-bf97-41ff-b40e-009d2b00c746 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:23.059764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.076526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: c2c5190e-bf97-41ff-b40e-009d2b00c746 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:23.076949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c2c5190e-bf97-41ff-b40e-009d2b00c746 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:23.105271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:23.107550 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2a391a08-c555-4309-9ab9-674ed59d73ca" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "c204c117-523f-49b5-9420-dc05e685d6de"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:23.117626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.151661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=1626b9fe-82dc-4958-a0d0-4436a98fe01f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:23.190074 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.260063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['21c72edc-8844-45a3-93c7-94b865615264']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:23.273909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '83aaa8ca-8514-4594-bc3f-241858877cc6') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:23.274254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '83aaa8ca-8514-4594-bc3f-241858877cc6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:23.288203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.315315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.321423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event updated for resources: {'Port': ['ID=3cee2956-a3a8-4db5-bccc-63f63f7d076c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:23.337593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.348582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:07:23.349556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:07:23.352681 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:07:23.386369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-68c19928-036b-484d-89dc-1c53fee943c3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:23.386369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-68c19928-036b-484d-89dc-1c53fee943c3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 1.1633236 Dec 21 04:07:23.401163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:23.435892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Router 1cfcc743-8714-4e30-ac55-8bea218057cc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:23.452900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe045f3-d3fd-4623-8360-5de12eb5bb81 req-c5de7e74-d5e3-498b-b213-4065d3252e33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:23.456086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbe045f3-d3fd-4623-8360-5de12eb5bb81 req-c5de7e74-d5e3-498b-b213-4065d3252e33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 942 time: 0.2862792 Dec 21 04:07:23.578805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.638153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.643076 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/networks/21c72edc-8844-45a3-93c7-94b865615264 HTTP/1.1" status: 204 len: 168 time: 0.7552645 Dec 21 04:07:23.686552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.resource_extend [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 04:07:23.757672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.759016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:23.770629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50222) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:23.776968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:23.799281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:23.801180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a60feb-5c61-4a42-a159-7898373ad974 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Network': ['ID=21c72edc-8844-45a3-93c7-94b865615264,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:23.815778 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] Sync routers for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:23.829344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'network': {'name': 'tempest-network-smoke--682343452', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'port_security_enabled': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:23.832236 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:23.833042 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:23.887485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] No DVR routers for this DVR port 1626b9fe-82dc-4958-a0d0-4436a98fe01f on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:23.890595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-44fe28bc-a601-4f31-9378-4944a0f86a44 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/quotas/c24fe956f7434054805a2322d25507fa HTTP/1.1" status: 200 len: 375 time: 0.4553537 Dec 21 04:07:23.892575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.895411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:23.900165 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-dfcf2006-ab9e-42b3-a2b3-bb2a66ade918 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "DELETE /v2.0/ports/1626b9fe-82dc-4958-a0d0-4436a98fe01f HTTP/1.1" status: 204 len: 173 time: 2.3633125 Dec 21 04:07:24.029051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port f21e2d88-8221-4926-95ac-3ed4e081cd85 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:24.029701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.062390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:24.091100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:24.091752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.159552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbe045f3-d3fd-4623-8360-5de12eb5bb81 req-fd01d6a6-62dd-4adf-bd45-3830eae57b33 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups?id=b589cf28-c5b6-430c-8d6b-954231e2ed7a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3797686 Dec 21 04:07:24.243769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:24.247230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.253088 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7fe91f8-75ae-4952-9b32-f1a03dbdf325 x-openstack-request-id: req-e7fe91f8-75ae-4952-9b32-f1a03dbdf325 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:24.253389 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "c204c117-523f-49b5-9420-dc05e685d6de", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:24.253784 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e7fe91f8-75ae-4952-9b32-f1a03dbdf325 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:24.254188 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': 'c204c117-523f-49b5-9420-dc05e685d6de', 'status': 'completed', 'code': 200} Dec 21 04:07:24.263790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-149f71ba-1210-4eec-841e-320c55684a4f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 897 time: 4.0221944 Dec 21 04:07:24.300881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] For port f21e2d88-8221-4926-95ac-3ed4e081cd85, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f21e2d88-8221-4926-95ac-3ed4e081cd85,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:24.301133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Request body: {'port': {'device_id': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:24.302972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.323694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6e88d2c7-fba4-4475-9b40-3e88c550cc24 None None] Provisioning complete for port 3cee2956-a3a8-4db5-bccc-63f63f7d076c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:24.324299 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e88d2c7-fba4-4475-9b40-3e88c550cc24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.330587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for f21e2d88-8221-4926-95ac-3ed4e081cd85 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:24.362516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-189fc72f-0f32-46ce-a259-0d48bcb6905c tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4433165 Dec 21 04:07:24.370534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6e88d2c7-fba4-4475-9b40-3e88c550cc24 None None] Port 3cee2956-a3a8-4db5-bccc-63f63f7d076c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:24.377117 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Floating IP 9e49db25-d7c7-4e17-99ca-7b693447a766 associated. External IP: 172.25.5.88, port: 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd. Dec 21 04:07:24.412196 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:24.440053 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] Checking router: 1cfcc743-8714-4e30-ac55-8bea218057cc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:24.449779 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:24.450590 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:24.476326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:07:24.541402 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.553861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.555736 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Added segment 5a3eef7f-2893-495e-99bf-8f252856a8c1 of type vlan for network f740899e-9cdc-4671-abdd-e69decd81dc4 Dec 21 04:07:24.601679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.653553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a92de6d-1a3f-4882-91e8-fe526d846f04 req-bea82fdf-49b2-49db-9660-7854c3c07d2b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:24.655174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a92de6d-1a3f-4882-91e8-fe526d846f04 req-bea82fdf-49b2-49db-9660-7854c3c07d2b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 895 time: 0.3061874 Dec 21 04:07:24.680300 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:24.735395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.779804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-041efb29-d73c-4819-b388-6956bb484ac8 service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4046049 Dec 21 04:07:24.957239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:24.963711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:24.964376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.007552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.042435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 80c7350a-da12-43ca-98fa-cd03001717ae no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:25.078597 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:25.093033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 80c7350a-da12-43ca-98fa-cd03001717ae {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:25.093397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 80c7350a-da12-43ca-98fa-cd03001717ae not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:25.139442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.141739 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1ad8d8d-00eb-4409-9eda-3345d422f4f6 None None] The sync data for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 is: [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T03:56:27Z', 'revision_number': 4, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '8e8edf66-71e6-4265-b442-7de4ff8867d4', 'name': '', 'network_id': '4915ee69-a87c-4f15-b553-d1750c9a5a88', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'mac_address': 'fa:16:3e:77:fb:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:24Z', 'updated_at': '2021-12-21T03:56:35Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'subnets': [{'id': '35ca07d8-d162-4205-9aec-69a6c9b94f03', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:25.319659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.5381031 Dec 21 04:07:25.323400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50260) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:25.324623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] No DVR routers for this DVR port f21e2d88-8221-4926-95ac-3ed4e081cd85 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:25.327271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.331153 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a2dba662-1c7a-46bf-b6d6-5435a4145d48 req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.54 "DELETE /v2.0/ports/f21e2d88-8221-4926-95ac-3ed4e081cd85 HTTP/1.1" status: 204 len: 173 time: 1.4235010 Dec 21 04:07:25.332168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8704837-b858-45d9-9302-fbe9910682d1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=f21e2d88-8221-4926-95ac-3ed4e081cd85,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:25.344062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'admin_state_up': True, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:25.351517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a9515a-5139-4fbc-9336-42d0f11d4a84 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Network': ['ID=f740899e-9cdc-4671-abdd-e69decd81dc4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:25.374875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f740899e-9cdc-4671-abdd-e69decd81dc4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:07:25.406425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-616cc062-af8c-4f60-934c-5489dbe6b463 req-531931aa-2223-4e44-9669-bf271048d9d0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.1021554 Dec 21 04:07:25.418727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-2f7889d0-2b94-431e-a69a-ff7e0f8ba61b service neutron] 10.222.0.18 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6246817 Dec 21 04:07:25.429326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:25.450113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.451548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.581017 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.676616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b4d0470-2da3-46be-9c67-b41ffbcdf0ae None None] New status for floating IP 84fa031d-e041-4fd4-9017-c432e03f800f: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:07:25.832924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:25.837712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.843358 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:25.862397 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:25.863030 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:25.909671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.916040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3cee2956-a3a8-4db5-bccc-63f63f7d076c {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:25.922400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:25.935738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Transition to ACTIVE for port object 3cee2956-a3a8-4db5-bccc-63f63f7d076c will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:07:26.001868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e60b34a1-d84f-4c7d-afb2-01fff2402b2a req-43162b4c-103c-4a9e-8add-aace9c58e547 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 210 time: 0.0634315 Dec 21 04:07:26.030192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:26.060267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:26.063185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-efdc925f-9efe-4382-9c62-8e7e85984ada tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "PUT /v2.0/floatingips/9e49db25-d7c7-4e17-99ca-7b693447a766 HTTP/1.1" status: 200 len: 991 time: 4.3673053 Dec 21 04:07:26.068334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:26.070694 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb71a10d-adef-46e0-942f-b14b92a10ad6" -d '{"events": [{"name": "network-changed", "server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:26.253365 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:26.287805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f'}, {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:26.292537 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f26acc4e-a679-4631-bd1f-6ba77a51f034" -d '{"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f"}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:26.469324 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-708c5aaf-7d9a-46cd-bacb-8dcc6823546c x-openstack-request-id: req-708c5aaf-7d9a-46cd-bacb-8dcc6823546c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:26.469642 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "1626b9fe-82dc-4958-a0d0-4436a98fe01f", "status": "completed", "code": 200}, {"server_uuid": "692cadc7-8f56-4705-bdb5-42df91c65def", "name": "network-vif-deleted", "tag": "f21e2d88-8221-4926-95ac-3ed4e081cd85", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:26.469863 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-708c5aaf-7d9a-46cd-bacb-8dcc6823546c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:26.470259 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': '1626b9fe-82dc-4958-a0d0-4436a98fe01f', 'status': 'completed', 'code': 200} Dec 21 04:07:26.477729 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '692cadc7-8f56-4705-bdb5-42df91c65def', 'name': 'network-vif-deleted', 'tag': 'f21e2d88-8221-4926-95ac-3ed4e081cd85', 'status': 'completed', 'code': 200} Dec 21 04:07:26.545838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:26.568759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:26.730853 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '9e49db25-d7c7-4e17-99ca-7b693447a766', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'floating_ip_address': '172.25.5.88', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'port_id': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 2510, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'mac_address': 'fa:16:3e:32:f6:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:06:56Z', 'updated_at': '2021-12-21T04:07:23Z', 'revision_number': 1, 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:26.773763 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:26.783468 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:26.784826 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:26.790882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.25.5.113 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/637d2ef4-6bee-49c3-8991-a6609aa7bbf4) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:26.824884 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b68f384a-5e15-40d7-a6bc-304e62fa6c12 x-openstack-request-id: req-b68f384a-5e15-40d7-a6bc-304e62fa6c12 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:26.825769 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:26.826138 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b68f384a-5e15-40d7-a6bc-304e62fa6c12 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:26.826630 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'status': 'completed', 'code': 200} Dec 21 04:07:26.887143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ff313f-cdab-456e-9bf7-b8f6ed6b4cf4 req-1035c52f-3327-4b61-bf51-52d268b35043 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:26.906363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40ff313f-cdab-456e-9bf7-b8f6ed6b4cf4 req-1035c52f-3327-4b61-bf51-52d268b35043 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 895 time: 0.9634345 Dec 21 04:07:26.934278 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:26.971599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b671acc6-2277-4748-aa0a-e9ed986b5141 req-4c167e22-dbd2-4f2e-9df4-6342940bb829 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.1867363 Dec 21 04:07:27.044100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.099136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Pushing event updated for resources: {'Port': ['ID=3cee2956-a3a8-4db5-bccc-63f63f7d076c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:27.151333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-315eea80-3d93-4aaa-98a8-6f43b75e8d7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:27.153569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-315eea80-3d93-4aaa-98a8-6f43b75e8d7f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 1098 time: 0.3673027 Dec 21 04:07:27.166514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.223272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0a0a58b-5dae-4bdf-9013-75dd7a879149 req-56085890-c628-4aa1-bf5e-ea3dc5e3b05a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 210 time: 0.0602415 Dec 21 04:07:27.316105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:27.331130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:27.333111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:27.338056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:27.368346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Attempting to bind port 3cee2956-a3a8-4db5-bccc-63f63f7d076c on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:27.369284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Attempting to bind port 3cee2956-a3a8-4db5-bccc-63f63f7d076c by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:27.370155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Attempting to bind port 3cee2956-a3a8-4db5-bccc-63f63f7d076c on network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:27.378195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a2215dc-fce9-4e80-9a4c-afaf944a93a1 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:27.383034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Port 3cee2956-a3a8-4db5-bccc-63f63f7d076c on network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:07:27.383593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Attempting to bind port 3cee2956-a3a8-4db5-bccc-63f63f7d076c on network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:27.392497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:27.401360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Checking segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:27.401360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Bound using segment: {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:27.401360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Bound port: 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:27.401360 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.435228 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '9e49db25-d7c7-4e17-99ca-7b693447a766', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'floating_ip_address': '172.25.5.88', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'port_id': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 2510, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'mac_address': 'fa:16:3e:32:f6:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:06:56Z', 'updated_at': '2021-12-21T04:07:23Z', 'revision_number': 1, 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:27.456759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-10c1500e-2fbd-4c05-842c-fd4bde2568b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:27.458292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-10c1500e-2fbd-4c05-842c-fd4bde2568b5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 912 time: 0.2873998 Dec 21 04:07:27.492596 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76442545-4972-46fd-9c8e-8332ba167d29 None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '9e49db25-d7c7-4e17-99ca-7b693447a766', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'floating_ip_address': '172.25.5.88', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'port_id': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 2510, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'mac_address': 'fa:16:3e:32:f6:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:06:56Z', 'updated_at': '2021-12-21T04:07:23Z', 'revision_number': 1, 'project_id': '3f578ba291d54826a6db2accb249f808', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:27.516735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f24fe4cb-6c2d-4bc2-abb4-36a76c8bf632 None None] Provisioning complete for port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:27.521916 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f24fe4cb-6c2d-4bc2-abb4-36a76c8bf632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.570674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] For port 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:27.617640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] For port 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:27.642708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-1496af96-754b-4f71-b881-29c102e8aba3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd HTTP/1.1" status: 200 len: 999 time: 0.1740427 Dec 21 04:07:27.653413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f24fe4cb-6c2d-4bc2-abb4-36a76c8bf632 None None] Port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:27.715350 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.754679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-405b9a2b-5fcb-4411-8a15-b392081095d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:27.756416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-405b9a2b-5fcb-4411-8a15-b392081095d1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.1013813 Dec 21 04:07:27.768375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:27.768996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.770413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] 10.222.0.31 "PUT /v2.0/ports/3cee2956-a3a8-4db5-bccc-63f63f7d076c HTTP/1.1" status: 200 len: 1056 time: 3.4866190 Dec 21 04:07:27.873444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:27.883775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6196998-aef5-4c82-8bf7-f9e8db25fcff service neutron] Pushing event updated for resources: {'Port': ['ID=3cee2956-a3a8-4db5-bccc-63f63f7d076c,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:27.921553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-c0001592-ecdd-43c6-bd26-fd10cded3cfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:27.923137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-c0001592-ecdd-43c6-bd26-fd10cded3cfc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1510575 Dec 21 04:07:27.948635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-364389e9-d098-45ff-b646-17b443375ce9 None None] New status for floating IP 9e49db25-d7c7-4e17-99ca-7b693447a766: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:07:28.284524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e94538d9-6bc0-48be-b764-48e39e795f03 req-2c475c0b-71ab-4555-9e08-5b2df0ee5101 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.1283092 Dec 21 04:07:28.306714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-c6e5c572-8a1c-4f08-8ea2-c4cd99995145 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:28.308522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-c6e5c572-8a1c-4f08-8ea2-c4cd99995145 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 1059 time: 0.3732314 Dec 21 04:07:28.309002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:28.512993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-ff07fa36-6d0e-4b9c-8512-bed42880c395 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.29&port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c HTTP/1.1" status: 200 len: 217 time: 0.1715393 Dec 21 04:07:28.515294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-35a06d7d-4180-4c53-a79a-97ca1ab91b11 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5787432 Dec 21 04:07:28.530142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6bf3fc-65e4-4cd4-abff-d2e4f026959e req-3ba31844-7e36-4be9-b51e-a2ace875dc73 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:28.544362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca6bf3fc-65e4-4cd4-abff-d2e4f026959e req-3ba31844-7e36-4be9-b51e-a2ace875dc73 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 907 time: 0.4317811 Dec 21 04:07:28.625230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2b33164-0265-43f3-9ce9-f2455f3a85bd req-721d0b37-b60b-4b4c-8250-27531fbcda40 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 210 time: 0.1172047 Dec 21 04:07:28.648665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router fb1fb678-be5b-4fff-abe6-343b84e37da9 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:07:28.784540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-e11b24d0-6802-43c0-a852-5eb00b268eeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:28.786857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-e11b24d0-6802-43c0-a852-5eb00b268eeb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=25b2f88d-507b-4adc-b3d7-44bc89a66393 HTTP/1.1" status: 200 len: 838 time: 0.2382569 Dec 21 04:07:28.806347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-78ca6e94-8546-4293-9f38-423723d490c6 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:28.807854 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-78ca6e94-8546-4293-9f38-423723d490c6 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 815 time: 0.2744331 Dec 21 04:07:28.820827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb71a10d-adef-46e0-942f-b14b92a10ad6 req-f2fcc4fb-2b37-4946-9928-b0a25106f834 service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2725928 Dec 21 04:07:28.829773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Request body: {'port': {'device_id': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'admin_state_up': True, 'tenant_id': 'c24fe956f7434054805a2322d25507fa'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:28.841163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'tag': '3cee2956-a3a8-4db5-bccc-63f63f7d076c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:28.855870 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7890e856-af44-40f7-b25d-039ce52d3a10" -d '{"events": [{"name": "network-changed", "server_uuid": "d0802f56-4138-40b6-a723-fba1f54ad0d5", "tag": "3cee2956-a3a8-4db5-bccc-63f63f7d076c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:28.865420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:28.876063 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Sync routers for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:28.891144 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:28.894668 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:28.899006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-d93f1a9b-46f8-42ff-82fb-e51f7c1932a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:28.901738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-d93f1a9b-46f8-42ff-82fb-e51f7c1932a9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0989356 Dec 21 04:07:28.948571 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e65bbe2d-6113-4603-a5dd-55016cc54424 x-openstack-request-id: req-e65bbe2d-6113-4603-a5dd-55016cc54424 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:28.948886 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0802f56-4138-40b6-a723-fba1f54ad0d5", "tag": "3cee2956-a3a8-4db5-bccc-63f63f7d076c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:28.949132 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e65bbe2d-6113-4603-a5dd-55016cc54424 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:28.951441 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'tag': '3cee2956-a3a8-4db5-bccc-63f63f7d076c', 'status': 'completed', 'code': 200} Dec 21 04:07:29.080419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50366) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:29.095816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.097063 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7297213-ba36-45be-a93f-db8ad375a3ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 3.7607892 Dec 21 04:07:29.101858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50370) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:29.139418 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:29.182785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:29.183759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8008b600-3e44-426d-b57a-78542ba04c7e tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=ec158f7f7c994dacb4d1785b3b8f2ff1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0759377 Dec 21 04:07:29.199630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-79396d4d-4740-4276-bd69-5829ea6aae0e service neutron] 10.222.0.31 "GET /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2745712 Dec 21 04:07:29.220543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Made reservation on behalf of c24fe956f7434054805a2322d25507fa for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:29.225292 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.311155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6577df11-fb7c-4c02-87d8-e1450ff89f12 req-f4143388-5d2e-4a7c-abd1-2c8a44424d35 service neutron] 10.222.0.31 "GET /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1009216 Dec 21 04:07:29.314623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa449378-0f3c-4ab5-940b-f8f7df0994b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.373164 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:27Z', 'revision_number': 3, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:29.404029 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Checking router: fb1fb678-be5b-4fff-abe6-343b84e37da9 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:29.404710 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Updating router fb1fb678-be5b-4fff-abe6-343b84e37da9 port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:07:29.439668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cc6e44e-59dd-41cf-aaac-0eef71077408 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:29.445850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8cc6e44e-59dd-41cf-aaac-0eef71077408 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2573197 Dec 21 04:07:29.446624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50382) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:29.455875 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.523362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Allocated IP 172.20.0.7 (13d79d25-d791-421e-bee1-93ce620f5704/f6eb37b9-316b-4d85-9044-455f8831b074/1f9f5bfd-3e00-4da8-8aad-fdf621afc682) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:29.545318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa449378-0f3c-4ab5-940b-f8f7df0994b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.577210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50386) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:29.581892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5366afce-eb91-4d63-b087-114cbde7d0e7 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1339819 Dec 21 04:07:29.589621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1851205987', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:29.622163 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa449378-0f3c-4ab5-940b-f8f7df0994b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.680330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa449378-0f3c-4ab5-940b-f8f7df0994b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0dd60eb2-8d49-4624-b164-b351223df0de,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:29.712663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e8c3ed6-b59b-451c-bc72-837979b482c2 req-022fac41-1cf2-4192-8f6d-33ffe244c7c5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.1620209 Dec 21 04:07:29.768114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aa449378-0f3c-4ab5-940b-f8f7df0994b6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=17112ed7d6614d288b73a54fa4587475&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6866078 Dec 21 04:07:29.772969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50392) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:29.885717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-b2915526-67e7-49ae-936a-fa3647786f36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:29.885961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.887245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-b2915526-67e7-49ae-936a-fa3647786f36 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 1059 time: 0.3317280 Dec 21 04:07:29.893617 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.919982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3262363d-31b3-44ff-94b0-e57fe9340a39 req-932f1c2c-8c45-48af-b7e1-cfecd1002664 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 210 time: 0.0456457 Dec 21 04:07:29.926378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:29.930956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.965407 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:29.969736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b4dfa1-fc1c-4dff-8e65-8601f14d08da req-da2d0e2e-de07-4878-90ca-5b4e6d99d2a6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:29.980841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83b4dfa1-fc1c-4dff-8e65-8601f14d08da req-da2d0e2e-de07-4878-90ca-5b4e6d99d2a6 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 907 time: 0.2462537 Dec 21 04:07:29.993238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2bf62f3-27d0-4da3-873d-98aaea21aa7d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:30.028143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.061749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba', 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:07:30.069112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['adb2727a-4661-46f5-a1a9-b11045316c51'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:07:30.071174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c93459fd-4229-464d-ac7b-e008893d6f0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.110365 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Attempting to bind port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:30.110768 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Attempting to bind port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:30.112960 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Attempting to bind port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:30.146862 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:30.146862 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:30.148813 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.149272 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:30.150312 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Bound port: 637d2ef4-6bee-49c3-8991-a6609aa7bbf4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:30.151260 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.152313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c93459fd-4229-464d-ac7b-e008893d6f0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.193928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Network 13d79d25-d791-421e-bee1-93ce620f5704 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:30.206349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-7eca3feb-36bc-4ac3-bc77-2562290a1786 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:30.207867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-7eca3feb-36bc-4ac3-bc77-2562290a1786 service neutron] 10.222.0.31 "GET /v2.0/networks?id=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 HTTP/1.1" status: 200 len: 899 time: 0.2973716 Dec 21 04:07:30.211122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bc30c3ce-3d8d-4e78-968d-c48a87392212 None None] Provisioning complete for port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:30.211580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc30c3ce-3d8d-4e78-968d-c48a87392212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.212712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:30.218586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:30.221229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event updated for resources: {'Port': ['ID=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:30.257791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bc30c3ce-3d8d-4e78-968d-c48a87392212 None None] Port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:30.278151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] For port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:30.282768 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] For port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:30.292747 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b73c50de-7055-4e72-bd9c-7a55d09b6b02 None None] Pushing event updated for resources: {'Port': ['ID=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:30.306486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-e55520d7-02bc-4df6-a858-13141b41214d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.29&port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c HTTP/1.1" status: 200 len: 217 time: 0.0766506 Dec 21 04:07:30.377953 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.400457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:30.401358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.408733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-97d37928-613f-482e-99a3-a255d82c76e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:30.411086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-97d37928-613f-482e-99a3-a255d82c76e3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=25b2f88d-507b-4adc-b3d7-44bc89a66393 HTTP/1.1" status: 200 len: 838 time: 0.0864146 Dec 21 04:07:30.469558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c93459fd-4229-464d-ac7b-e008893d6f0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.474641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c93459fd-4229-464d-ac7b-e008893d6f0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.477353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c93459fd-4229-464d-ac7b-e008893d6f0b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0dd60eb2-8d49-4624-b164-b351223df0de HTTP/1.1" status: 204 len: 168 time: 0.6543388 Dec 21 04:07:30.500757 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b73c50de-7055-4e72-bd9c-7a55d09b6b02 None None] Pushing event updated for resources: {'Port': ['ID=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:30.512141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:30.513068 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:30.518418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93459fd-4229-464d-ac7b-e008893d6f0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0dd60eb2-8d49-4624-b164-b351223df0de,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:30.532945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-550399c1-b8ad-4a26-a800-1fd7361d96e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:30.534827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-550399c1-b8ad-4a26-a800-1fd7361d96e0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.1150980 Dec 21 04:07:30.549130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-002b0642-6a12-4dd0-8a82-1acee3f4c1da tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7239108 Dec 21 04:07:30.639323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Request body: {'port': {'device_id': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:30.666058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2739189c-5486-4bfa-8197-1a57d069c73d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:30.766512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-4a2ec808-0da6-470d-b144-4cdb64e8e32e service neutron] 10.222.0.31 "GET /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2219880 Dec 21 04:07:30.821938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b4b501c5-e520-4a29-8931-e17fbfffeb2f None None] Provisioning complete for port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:30.822399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4b501c5-e520-4a29-8931-e17fbfffeb2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.836401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.918898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4609f77-cc97-4f1e-8c1f-86a458fc2db2 req-1550d9dd-1905-4f86-bf01-6774526856f1 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0732610 Dec 21 04:07:30.936588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:30.992194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4b501c5-e520-4a29-8931-e17fbfffeb2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.018973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7890e856-af44-40f7-b25d-039ce52d3a10 req-263d519b-48bc-43d2-975e-83a752ce38f8 service neutron] 10.222.0.31 "GET /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2373161 Dec 21 04:07:31.027912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b4b501c5-e520-4a29-8931-e17fbfffeb2f None None] For port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:31.031202 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:31.087212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b4b501c5-e520-4a29-8931-e17fbfffeb2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.115933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Checking segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:31.116340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network hostable DHCP agents. Network: f740899e-9cdc-4671-abdd-e69decd81dc4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:07:31.187296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Subnet': ['ID=0e2ee440-32ec-4001-87d7-31af9f807755,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:31.211094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b501c5-e520-4a29-8931-e17fbfffeb2f None None] Pushing event updated for resources: {'Port': ['ID=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:31.258267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0340e38f-3925-4835-b6ce-6258d4ab1ddf req-46fd5e6f-7537-4b52-a8e9-703a96152bf2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:31.275790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0340e38f-3925-4835-b6ce-6258d4ab1ddf req-46fd5e6f-7537-4b52-a8e9-703a96152bf2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 931 time: 0.2340705 Dec 21 04:07:31.304814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network f740899e-9cdc-4671-abdd-e69decd81dc4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:07:31.310050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a220cf1f-3c69-4417-8137-3b1222d24854 req-bd24e2e6-87ce-4cf0-b64d-591805206eda tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:31.311725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a220cf1f-3c69-4417-8137-3b1222d24854 req-bd24e2e6-87ce-4cf0-b64d-591805206eda tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 907 time: 0.2226536 Dec 21 04:07:31.363439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0340e38f-3925-4835-b6ce-6258d4ab1ddf req-cdab76b1-08bc-4ff1-a050-b2a918c243b3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866661 Dec 21 04:07:31.385628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f740899e-9cdc-4671-abdd-e69decd81dc4) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:31.393934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ea31362-78ac-45dd-b4d7-404712172268 None None] Network f740899e-9cdc-4671-abdd-e69decd81dc4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:31.395081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:31.397321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.425724 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:27Z', 'revision_number': 3, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:31.457874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:31.470405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.474216 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7055112e-94de-416e-984f-fc700768b3f5 None None] The sync data for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 is: [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:27Z', 'revision_number': 3, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:31.491924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Transition to ACTIVE for port object 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:07:31.505959 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-96c77566-2182-437b-946a-ca9cb161affd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.9267375 Dec 21 04:07:31.513306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50420) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:31.572804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-f740899e-9cdc-4671-abdd-e69decd81dc4', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:07:31.573836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.593519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:31.616314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82214958-0c68-43d1-bea7-9f551f1a45ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.621711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.760645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Pushing event updated for resources: {'Port': ['ID=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:31.803624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82214958-0c68-43d1-bea7-9f551f1a45ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.809984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Allocated IP 172.20.0.2 (f740899e-9cdc-4671-abdd-e69decd81dc4/0e2ee440-32ec-4001-87d7-31af9f807755/22ed0878-ccc5-4726-bbe9-507cefb3d4a8) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:31.868890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82214958-0c68-43d1-bea7-9f551f1a45ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:31.996117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-82214958-0c68-43d1-bea7-9f551f1a45ad admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3f33f4982f194a2b92337404c1a3b5e8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3989937 Dec 21 04:07:32.000143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50432) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:32.068265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Attempting to bind port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:32.068742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Attempting to bind port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:32.069084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Attempting to bind port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:32.070520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.080565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 on network 13d79d25-d791-421e-bee1-93ce620f5704 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:07:32.080897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Attempting to bind port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 on network 13d79d25-d791-421e-bee1-93ce620f5704 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:32.108440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 3cee2956-a3a8-4db5-bccc-63f63f7d076c details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:07:32.108913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:32.109259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Checking segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:32.109651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Bound using segment: {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:32.110084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Bound port: 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '14fbbca6-7072-4909-b9a3-3ca17b26245e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:32.110438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.122968 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cf34985-0107-47cf-a32e-bcf58dd88362 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.155203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cf34985-0107-47cf-a32e-bcf58dd88362 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.249936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:32.266436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '3cee2956-a3a8-4db5-bccc-63f63f7d076c', 'network_id': '647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0', 'port_id': '3cee2956-a3a8-4db5-bccc-63f63f7d076c', 'mac_address': 'fa:16:3e:3e:ea:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 121, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '25b2f88d-507b-4adc-b3d7-44bc89a66393', 'ip_address': '172.20.0.29'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:07:32.298711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82214958-0c68-43d1-bea7-9f551f1a45ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ef1cd0b-3f85-4869-92e0-86ae5ed9f0af,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:32.319596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd25e0eb-54fc-43b3-ad9a-205cf06a25e7 req-ea0d229d-6032-43a0-978c-dd936dfca07e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.2179859 Dec 21 04:07:32.320440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.325409 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cf34985-0107-47cf-a32e-bcf58dd88362 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.337697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.361553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8cf34985-0107-47cf-a32e-bcf58dd88362 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.361553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8cf34985-0107-47cf-a32e-bcf58dd88362 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1ef1cd0b-3f85-4869-92e0-86ae5ed9f0af HTTP/1.1" status: 204 len: 168 time: 0.3510504 Dec 21 04:07:32.403131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf34985-0107-47cf-a32e-bcf58dd88362 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ef1cd0b-3f85-4869-92e0-86ae5ed9f0af,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:32.493236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Pushing event updated for resources: {'Port': ['ID=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:32.506438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3cee2956-a3a8-4db5-bccc-63f63f7d076c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:32.541775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Network f740899e-9cdc-4671-abdd-e69decd81dc4 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:32.596142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e573936-8ddd-40dd-81c9-2bde9177e8e1 req-da23b623-5898-42d7-8d2d-ca0c3f9f28c9 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:32.598748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:32.609976 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:32.611371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:32.622522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e573936-8ddd-40dd-81c9-2bde9177e8e1 req-da23b623-5898-42d7-8d2d-ca0c3f9f28c9 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 907 time: 0.1938128 Dec 21 04:07:32.693759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f961f5-991d-49f5-9354-98e4a2627b31 req-341b1939-50e2-4045-b157-737355453586 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:32.698532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.717588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40f961f5-991d-49f5-9354-98e4a2627b31 req-341b1939-50e2-4045-b157-737355453586 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 943 time: 0.2062805 Dec 21 04:07:32.845271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40f961f5-991d-49f5-9354-98e4a2627b31 req-d6c62008-6866-4851-a6a3-043950bf8117 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1266952 Dec 21 04:07:32.857667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=3cee2956-a3a8-4db5-bccc-63f63f7d076c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:32.874432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Attempting to bind port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:32.874432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Attempting to bind port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:32.874432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Attempting to bind port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 on network f740899e-9cdc-4671-abdd-e69decd81dc4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:32.882226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:32.882910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Checking segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:32.883551 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.884107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Bound using segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:32.884765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Bound port: 22ed0878-ccc5-4726-bbe9-507cefb3d4a8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:32.886371 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:32.928430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] For port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:32.931340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] For port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:33.028475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:33.087732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] For port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:33.096882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] For port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:33.105227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['3cee2956-a3a8-4db5-bccc-63f63f7d076c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:07:33.189899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:33.198288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:33.207045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:33.207673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:33.212607 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] 10.222.0.54 "PUT /v2.0/ports/1f9f5bfd-3e00-4da8-8aad-fdf621afc682 HTTP/1.1" status: 200 len: 1092 time: 2.5927303 Dec 21 04:07:33.213166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'tag': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:33.215973 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13f1ca9a-813a-4207-9a68-9af3f8cc4138" -d '{"events": [{"name": "network-changed", "server_uuid": "87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf", "tag": "1f9f5bfd-3e00-4da8-8aad-fdf621afc682"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:33.236263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:33.261670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bfc7987-246c-4995-9a0a-21edfea21ffa service neutron] Pushing event updated for resources: {'Port': ['ID=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:33.359479 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2f1d14c-801c-4ec0-a3aa-8014efd9942c x-openstack-request-id: req-a2f1d14c-801c-4ec0-a3aa-8014efd9942c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:33.360018 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf", "tag": "1f9f5bfd-3e00-4da8-8aad-fdf621afc682", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:33.363490 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a2f1d14c-801c-4ec0-a3aa-8014efd9942c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:33.363490 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'tag': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682', 'status': 'completed', 'code': 200} Dec 21 04:07:33.424076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33d67ad1-2f53-4ff9-8a06-866baede7716 None None] Pushing event updated for resources: {'Port': ['ID=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:33.446422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f1ca9a-813a-4207-9a68-9af3f8cc4138 req-b4027235-d7a1-40c9-a5ed-c481234f925a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:33.448426 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-13f1ca9a-813a-4207-9a68-9af3f8cc4138 req-b4027235-d7a1-40c9-a5ed-c481234f925a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 1095 time: 0.0907848 Dec 21 04:07:33.463710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:33.464207 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:33.546981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1d7043b-18a3-4373-94fd-5d31ed15b6bf req-b5474b82-2297-496c-a67a-b1e1ffef4cce tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0645368 Dec 21 04:07:33.910295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83425a7f-a292-44b0-86fc-953f8a9b2d91 req-0501c137-39c1-4e4c-bccf-10d7379e8ea2 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:33.924023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f1ca9a-813a-4207-9a68-9af3f8cc4138 req-086c50ef-7c45-4511-85a6-8cdf7464c041 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:33.925945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-13f1ca9a-813a-4207-9a68-9af3f8cc4138 req-086c50ef-7c45-4511-85a6-8cdf7464c041 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=c24fe956f7434054805a2322d25507fa&shared=False HTTP/1.1" status: 200 len: 916 time: 0.4357588 Dec 21 04:07:33.927317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.20.0.1 (f740899e-9cdc-4671-abdd-e69decd81dc4/0e2ee440-32ec-4001-87d7-31af9f807755/a0751ded-47c2-4d5b-8743-170d5a27a3e7) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:33.929577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83425a7f-a292-44b0-86fc-953f8a9b2d91 req-0501c137-39c1-4e4c-bccf-10d7379e8ea2 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 908 time: 0.1185055 Dec 21 04:07:34.101730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa13521d-ee6d-45a3-adf3-8245d95e4bdb req-226ffd55-a177-443c-a65d-ad278f3ba647 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:34.105504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 3cee2956-a3a8-4db5-bccc-63f63f7d076c up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:34.112471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa13521d-ee6d-45a3-adf3-8245d95e4bdb req-226ffd55-a177-443c-a65d-ad278f3ba647 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 943 time: 0.0996726 Dec 21 04:07:34.197541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f1ca9a-813a-4207-9a68-9af3f8cc4138 req-d0cfc3ff-65fa-42ca-a356-7a23a35248c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:34.203102 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-13f1ca9a-813a-4207-9a68-9af3f8cc4138 req-d0cfc3ff-65fa-42ca-a356-7a23a35248c1 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2693183 Dec 21 04:07:34.241747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa13521d-ee6d-45a3-adf3-8245d95e4bdb req-d7ea6d5a-fa5a-4fbc-8bee-811fb9bc05e6 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1279564 Dec 21 04:07:34.281256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 3cee2956-a3a8-4db5-bccc-63f63f7d076c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:07:34.290129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 3cee2956-a3a8-4db5-bccc-63f63f7d076c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:34.290644 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:34.328362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:34.359986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-50121f02-ed62-45c7-85b3-edfa2878f25c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:34.362064 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-50121f02-ed62-45c7-85b3-edfa2878f25c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 1095 time: 0.0898774 Dec 21 04:07:34.440186 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:34.443808 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-9f5ef23a-07ef-4be3-9e46-9f0eb81996bb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1f9f5bfd-3e00-4da8-8aad-fdf621afc682 HTTP/1.1" status: 200 len: 217 time: 0.0510051 Dec 21 04:07:34.466381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3cee2956-a3a8-4db5-bccc-63f63f7d076c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:34.468842 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77dbe810-e4a1-446b-9b0d-3fa3e4889743" -d '{"events": [{"server_uuid": "d0802f56-4138-40b6-a723-fba1f54ad0d5", "name": "network-vif-plugged", "status": "completed", "tag": "3cee2956-a3a8-4db5-bccc-63f63f7d076c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:34.485429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:34.511423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-455e005f-27a2-47ec-a6de-48029de40b58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:34.512932 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-455e005f-27a2-47ec-a6de-48029de40b58 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f6eb37b9-316b-4d85-9044-455f8831b074 HTTP/1.1" status: 200 len: 855 time: 0.0615506 Dec 21 04:07:34.523540 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91be453c-9f38-45ec-84a0-517a645e0a93 x-openstack-request-id: req-91be453c-9f38-45ec-84a0-517a645e0a93 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:34.524089 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0802f56-4138-40b6-a723-fba1f54ad0d5", "name": "network-vif-plugged", "status": "completed", "tag": "3cee2956-a3a8-4db5-bccc-63f63f7d076c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:34.524536 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-91be453c-9f38-45ec-84a0-517a645e0a93 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:34.525153 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3cee2956-a3a8-4db5-bccc-63f63f7d076c', 'code': 200} Dec 21 04:07:34.546079 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-02b97811-4389-440e-b68c-33548164e4bc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=13d79d25-d791-421e-bee1-93ce620f5704&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261438 Dec 21 04:07:34.547267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:34.589884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:34.632296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network f740899e-9cdc-4671-abdd-e69decd81dc4 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:34.693357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:34.698752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:34.701742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=a0751ded-47c2-4d5b-8743-170d5a27a3e7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:34.755256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=3cee2956-a3a8-4db5-bccc-63f63f7d076c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:34.766185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2f35514a-b7be-4f15-8589-c3d56c22f08d req-c62f8896-8054-400f-8e30-993b21775111 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.1262732 Dec 21 04:07:34.789426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed1b493c-0f59-4b75-961a-47f1d67543c3 req-0681d832-a385-4822-bcd1-f342af5ec15e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:34.790821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-da75acf7-ed1f-4642-8d2b-48d8a4aa806d service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2165654 Dec 21 04:07:34.791741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed1b493c-0f59-4b75-961a-47f1d67543c3 req-0681d832-a385-4822-bcd1-f342af5ec15e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 1061 time: 0.1150534 Dec 21 04:07:34.794302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.055070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9587de78-509c-486d-b5cd-ea1f4532ab30 req-ed651c55-9c89-4c19-85e4-ac4e8a30cba6 service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2564619 Dec 21 04:07:35.188301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:35.291695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:35.292592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.302521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.398059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05ae03f2-aa06-4962-8541-3c947bcb6232 None None] Network f740899e-9cdc-4671-abdd-e69decd81dc4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:35.525718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c93bd74-f0ed-460a-93b2-e83ee657b33c req-3d740cb3-d39e-4da4-a8c3-d313cc6809df tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:35.530576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c93bd74-f0ed-460a-93b2-e83ee657b33c req-3d740cb3-d39e-4da4-a8c3-d313cc6809df tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 943 time: 0.1215065 Dec 21 04:07:35.595058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-318146ac-0348-4ed8-a43d-1ff58a185a0d None None] Provisioning complete for port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:35.595439 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-318146ac-0348-4ed8-a43d-1ff58a185a0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.699413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c93bd74-f0ed-460a-93b2-e83ee657b33c req-43d74560-6e60-44b5-ae34-f73808552398 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1616852 Dec 21 04:07:35.729985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.749074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a176292c-dad4-4610-bf98-c70247a564ea req-35b5aeef-7601-4958-a734-a54e9c80588e tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:35.766065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a176292c-dad4-4610-bf98-c70247a564ea req-35b5aeef-7601-4958-a734-a54e9c80588e tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 909 time: 0.6510217 Dec 21 04:07:35.799770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.878229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:35.885013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-318146ac-0348-4ed8-a43d-1ff58a185a0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.885761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:35.889642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f91a5ef1-17c0-4f99-bb02-d0d2b5ff0535 req-b9c239b7-d2a8-4a38-bbac-11af2e75fc2f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0313838 Dec 21 04:07:35.921688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:36.008464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-318146ac-0348-4ed8-a43d-1ff58a185a0d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:07:36.008881 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-318146ac-0348-4ed8-a43d-1ff58a185a0d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:07:36.025547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=a0751ded-47c2-4d5b-8743-170d5a27a3e7,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:36.059527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:36.062059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:36.261233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network f740899e-9cdc-4671-abdd-e69decd81dc4 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:36.262780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:36.409313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router fb1fb678-be5b-4fff-abe6-343b84e37da9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:36.562944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:36.568289 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b12f805-d3f0-4923-ac73-885fcba4e8e7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "PUT /v2.0/routers/fb1fb678-be5b-4fff-abe6-343b84e37da9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0539100 Dec 21 04:07:36.570622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50548) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:36.578429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Sync routers for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:36.596074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:36.596726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:36.748528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:36.850740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.852013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.852502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.853395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.853867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.854334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.854783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.857470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.857950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.858414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.858869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.863366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.868825 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4da99862-7cb1-4d1b-89d0-f23249688588 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 8444 time: 0.2942750 Dec 21 04:07:36.868981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50560) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:36.969013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49dbdba-528f-495f-b28f-d86d07470c95 req-f8fea559-a307-401c-9c6b-a187cb5d82fc tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.971753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49dbdba-528f-495f-b28f-d86d07470c95 req-f8fea559-a307-401c-9c6b-a187cb5d82fc tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 943 time: 0.1241429 Dec 21 04:07:36.988077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33673436-57ce-4a2d-916d-b5fdabc9d083 req-9c5d18d3-d500-4ad6-9b7b-58a90f9cadd0 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.988231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.988600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.994510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.995049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:36.998386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.001121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.001592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.002043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.002493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.002958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.003400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.003856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.015719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33673436-57ce-4a2d-916d-b5fdabc9d083 req-9c5d18d3-d500-4ad6-9b7b-58a90f9cadd0 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 909 time: 0.1151886 Dec 21 04:07:37.019881 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e30dcb1-5a45-458a-a447-bc32ffc0009c tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 7713 time: 0.1394320 Dec 21 04:07:37.022399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:37.116246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:37.134100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a49dbdba-528f-495f-b28f-d86d07470c95 req-75212a14-c55b-452d-a69f-fb0348ad41ef tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1528993 Dec 21 04:07:37.192485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-880bac17-8cc2-4ef7-8810-bbb59864ab7b None None] Provisioning complete for port a0751ded-47c2-4d5b-8743-170d5a27a3e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:37.193516 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-880bac17-8cc2-4ef7-8810-bbb59864ab7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:37.207937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be1b5e82-832e-44b9-b878-2510fd0a0ff1 req-7e88138e-fdd4-4f56-9741-bb3d7642bef0 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0680206 Dec 21 04:07:37.358554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ebf29330-fbae-4b8b-9720-c29097bf7216 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 5228 time: 0.3356431 Dec 21 04:07:37.366263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e05486-8150-4605-86ff-5ec63f805c0e req-36ad729c-15da-4300-b578-f292991ca468 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.370749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1e05486-8150-4605-86ff-5ec63f805c0e req-36ad729c-15da-4300-b578-f292991ca468 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 909 time: 0.1186950 Dec 21 04:07:37.510943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:37.511328 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:37.537554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-880bac17-8cc2-4ef7-8810-bbb59864ab7b None None] Port a0751ded-47c2-4d5b-8743-170d5a27a3e7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:37.574704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 2, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:37.580506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-880bac17-8cc2-4ef7-8810-bbb59864ab7b None None] Provisioning complete for port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:37.581141 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-880bac17-8cc2-4ef7-8810-bbb59864ab7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:37.594672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a943addc-4bd1-4eb9-ac38-7e135eba60b2 req-9ed7144d-4157-401c-a208-a246130fe9b7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.604665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a943addc-4bd1-4eb9-ac38-7e135eba60b2 req-9ed7144d-4157-401c-a208-a246130fe9b7 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 1061 time: 0.0929644 Dec 21 04:07:37.685686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Checking router: fb1fb678-be5b-4fff-abe6-343b84e37da9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:37.686048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Updating router fb1fb678-be5b-4fff-abe6-343b84e37da9 port a0751ded-47c2-4d5b-8743-170d5a27a3e7 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:07:37.737145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:37.737532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f8dd06-3497-42f4-a709-a36fdb7e7281 req-f5cbf94f-c9f8-4873-af0f-1de469d655a3 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.745850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65f8dd06-3497-42f4-a709-a36fdb7e7281 req-f5cbf94f-c9f8-4873-af0f-1de469d655a3 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1136 time: 0.0548007 Dec 21 04:07:37.808143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65f8dd06-3497-42f4-a709-a36fdb7e7281 req-91087561-935a-4506-8146-4ef0e37db2bc tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0609987 Dec 21 04:07:37.825894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:37.902285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61e63b12-9d3f-41a0-b8e0-9fe3c0f9a621 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:37.903764 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61e63b12-9d3f-41a0-b8e0-9fe3c0f9a621 tempest-TestSecurityGroupsBasicOps-327562130 tempest-TestSecurityGroupsBasicOps-327562130-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 1056 time: 0.0755479 Dec 21 04:07:37.908608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:07:38.019641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:38.108925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682', 'network_id': '13d79d25-d791-421e-bee1-93ce620f5704', 'port_id': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682', 'mac_address': 'fa:16:3e:f2:59:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f6eb37b9-316b-4d85-9044-455f8831b074', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:07:38.290048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:38.316208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:38.338051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:38.416125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:38.467390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:38.516615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:38.554637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb984800-d62d-42c6-b3f6-765ab0bba098 req-c101fc16-0521-4680-a7d5-9b8fa57de465 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:38.556345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb984800-d62d-42c6-b3f6-765ab0bba098 req-c101fc16-0521-4680-a7d5-9b8fa57de465 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 944 time: 0.0822239 Dec 21 04:07:38.589802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:38.598311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50616) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:38.634839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-88423922', 'description': 'tempest-secgroup-smoke-88423922 description', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:38.693419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb984800-d62d-42c6-b3f6-765ab0bba098 req-5364d648-1796-4cde-825e-3e21dced604c tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283810 Dec 21 04:07:38.735286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-350e7930-bcda-4c35-a518-121723ada162 None None] Pushing event updated for resources: {'Port': ['ID=a0751ded-47c2-4d5b-8743-170d5a27a3e7,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:38.767317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:38.808590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['1f9f5bfd-3e00-4da8-8aad-fdf621afc682'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:07:38.956882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:38.986633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d85b43d-9e17-4c04-b8f0-63fb3704bd74 req-8d353512-c9b0-41a7-a58a-30193b7ebeb8 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:38.989266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Attempting to bind port a0751ded-47c2-4d5b-8743-170d5a27a3e7 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:38.989600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Attempting to bind port a0751ded-47c2-4d5b-8743-170d5a27a3e7 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:38.989987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Attempting to bind port a0751ded-47c2-4d5b-8743-170d5a27a3e7 on network f740899e-9cdc-4671-abdd-e69decd81dc4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:39.003202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d85b43d-9e17-4c04-b8f0-63fb3704bd74 req-8d353512-c9b0-41a7-a58a-30193b7ebeb8 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 909 time: 0.1279464 Dec 21 04:07:39.046784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.095010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:39.095010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Checking segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:39.095323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.095736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Bound using segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:39.099259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Bound port: a0751ded-47c2-4d5b-8743-170d5a27a3e7, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:39.099725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.122238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroup': ['ID=78584b55-c6e0-45de-b709-b3a2ecd4ad06,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:39.162562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ab92fdd-260c-455a-be05-99bfaf28b93d req-e1822eb9-e60d-4bb3-bb26-922182479a79 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.4562688 Dec 21 04:07:39.180136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.181401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c59c570f-c645-4687-9f28-e6ca9396ed85 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.5610778 Dec 21 04:07:39.184545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50630) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:39.191069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': '78584b55-c6e0-45de-b709-b3a2ecd4ad06', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:39.205596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-97712db5-eafc-424e-ac07-c5e3ada45f05 None None] Provisioning complete for port a0751ded-47c2-4d5b-8743-170d5a27a3e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:39.205984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-97712db5-eafc-424e-ac07-c5e3ada45f05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.276619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] For port a0751ded-47c2-4d5b-8743-170d5a27a3e7, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:39.281714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] For port a0751ded-47c2-4d5b-8743-170d5a27a3e7, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0751ded-47c2-4d5b-8743-170d5a27a3e7,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:39.284436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-97712db5-eafc-424e-ac07-c5e3ada45f05 None None] Port a0751ded-47c2-4d5b-8743-170d5a27a3e7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:39.332181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.413556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.429896 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.500921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:39.501554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:39.526454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.553461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-350e7930-bcda-4c35-a518-121723ada162 None None] Pushing event updated for resources: {'Port': ['ID=a0751ded-47c2-4d5b-8743-170d5a27a3e7,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:39.553951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=90fa5cde-6553-4461-a083-9d73de9703f5,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:39.645964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.649240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b1ac624b-d924-4c87-9b8e-fdd13e34109a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4633100 Dec 21 04:07:39.651947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50646) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:39.662882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': '78584b55-c6e0-45de-b709-b3a2ecd4ad06', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:39.667353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:39.750984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.850264 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:39.938960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d6a225-6033-41ae-9c9b-b7df40336b3a req-c6f4d441-f4f3-4d8f-96f0-e3cdf711cff5 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:39.966424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d6a225-6033-41ae-9c9b-b7df40336b3a req-c6f4d441-f4f3-4d8f-96f0-e3cdf711cff5 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 944 time: 0.1018703 Dec 21 04:07:39.996168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.042465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-da395692-e438-4e93-8288-526714e02a20 None None] Provisioning complete for port a0751ded-47c2-4d5b-8743-170d5a27a3e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:40.046333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-da395692-e438-4e93-8288-526714e02a20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.059437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d9c33161-ae4a-4089-af08-35729c968e35,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:40.089885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5d6a225-6033-41ae-9c9b-b7df40336b3a req-089183b9-795f-435e-bcf5-f5b103d2062f tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1220076 Dec 21 04:07:40.099352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-086f1734-3de8-4bea-a1b6-dcfba8a34234 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:40.100855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-086f1734-3de8-4bea-a1b6-dcfba8a34234 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.31 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 909 time: 0.1371348 Dec 21 04:07:40.103909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.105005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0e42f09e-a428-4278-804f-1f5aad51832b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4518726 Dec 21 04:07:40.107870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:40.117118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': '78584b55-c6e0-45de-b709-b3a2ecd4ad06', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:40.257688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111f123a-3b14-4abe-bd59-12bef552c16f req-a9081f24-87e4-4209-9fb2-449987f923ab tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:40.259565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-111f123a-3b14-4abe-bd59-12bef552c16f req-a9081f24-87e4-4209-9fb2-449987f923ab tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 909 time: 0.1436441 Dec 21 04:07:40.264200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.269285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:39Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:40.284366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port 3cee2956-a3a8-4db5-bccc-63f63f7d076c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:40.284746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.350201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-da395692-e438-4e93-8288-526714e02a20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.370657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bab06591-ff68-42f0-bfac-b32105133303 None None] The sync data for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 is: [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:39Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:40.385513 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.434846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.443407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-da395692-e438-4e93-8288-526714e02a20 None None] For port a0751ded-47c2-4d5b-8743-170d5a27a3e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0751ded-47c2-4d5b-8743-170d5a27a3e7,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:40.448987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] For port 3cee2956-a3a8-4db5-bccc-63f63f7d076c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=3cee2956-a3a8-4db5-bccc-63f63f7d076c,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:40.448987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.468207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for 3cee2956-a3a8-4db5-bccc-63f63f7d076c owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:40.479402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c5c8d54-3491-4622-a319-16743e72f257,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:40.520905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-da395692-e438-4e93-8288-526714e02a20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.574154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.576096 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ce7de9b-c66b-4df2-8eeb-f0419c58ea6b tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4648571 Dec 21 04:07:40.578836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50668) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:40.583821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': '78584b55-c6e0-45de-b709-b3a2ecd4ad06', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:40.648654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da395692-e438-4e93-8288-526714e02a20 None None] Pushing event updated for resources: {'Port': ['ID=a0751ded-47c2-4d5b-8743-170d5a27a3e7,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:40.735946 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.745665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7a4b904-7e08-499e-95ec-d7a3180fea13 req-f5f82e31-3021-4f40-99ca-d2decf57144f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0440249 Dec 21 04:07:40.783974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.819204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.831250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=3cee2956-a3a8-4db5-bccc-63f63f7d076c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:40.909275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.924343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] No DVR routers for this DVR port 3cee2956-a3a8-4db5-bccc-63f63f7d076c on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:40.928126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:40.932183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee9d046f-10ec-45b8-b82c-c6fcf1e4763b req-f8cf3a71-7798-4e3b-9863-4d0a55fafe7b tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.31 "DELETE /v2.0/ports/3cee2956-a3a8-4db5-bccc-63f63f7d076c HTTP/1.1" status: 204 len: 173 time: 0.8240767 Dec 21 04:07:40.932622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'name': 'network-vif-deleted', 'tag': '3cee2956-a3a8-4db5-bccc-63f63f7d076c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:40.935369 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7a1ac41-3278-4cd4-ad21-b1c19e328de7" -d '{"events": [{"server_uuid": "d0802f56-4138-40b6-a723-fba1f54ad0d5", "name": "network-vif-deleted", "tag": "3cee2956-a3a8-4db5-bccc-63f63f7d076c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:40.951838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b5b7ce8-5c18-4da6-a6ed-d7c838da7803,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:41.020323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.021578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2615e9e-b9c6-4d15-863c-4af4c96064cd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4415634 Dec 21 04:07:41.024249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50678) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:41.028679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': '78584b55-c6e0-45de-b709-b3a2ecd4ad06', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:41.052794 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb462f29-3530-49db-a2c4-dc6bed605072 x-openstack-request-id: req-cb462f29-3530-49db-a2c4-dc6bed605072 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:41.053508 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0802f56-4138-40b6-a723-fba1f54ad0d5", "name": "network-vif-deleted", "tag": "3cee2956-a3a8-4db5-bccc-63f63f7d076c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:41.053966 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cb462f29-3530-49db-a2c4-dc6bed605072 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:41.054683 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0802f56-4138-40b6-a723-fba1f54ad0d5', 'name': 'network-vif-deleted', 'tag': '3cee2956-a3a8-4db5-bccc-63f63f7d076c', 'status': 'completed', 'code': 200} Dec 21 04:07:41.188514 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Project ec158f7f7c994dacb4d1785b3b8f2ff1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:07:41.196903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.222719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0751ded-47c2-4d5b-8743-170d5a27a3e7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:41.364589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.370223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a0751ded-47c2-4d5b-8743-170d5a27a3e7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:41.372561 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.389872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca316950-4921-4bbd-8d94-faabfea80a3c req-1988d6d2-c29a-4164-adba-ccd2af0e78ca tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:41.402720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca316950-4921-4bbd-8d94-faabfea80a3c req-1988d6d2-c29a-4164-adba-ccd2af0e78ca tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 944 time: 0.1515591 Dec 21 04:07:41.435528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.465025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b02466a6-37ca-4249-b493-6db59928fc34,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:41.473194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0f6333c-3fe0-4d86-b2c3-b7ff5d675e40 req-c5c65482-5419-4bf7-8d04-bfd098839b6a tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=d0802f56-4138-40b6-a723-fba1f54ad0d5 HTTP/1.1" status: 200 len: 210 time: 0.0572407 Dec 21 04:07:41.597577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca316950-4921-4bbd-8d94-faabfea80a3c req-763b0915-6f06-414a-ab9b-5e7634bd879c tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1939564 Dec 21 04:07:41.604971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.606219 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19fb723a-0d57-4a2a-9f0d-ab4722c0df55 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5810366 Dec 21 04:07:41.609005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50688) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:41.631018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'security_group_rule': {'security_group_id': '78584b55-c6e0-45de-b709-b3a2ecd4ad06', 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:41.789773 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Project ec158f7f7c994dacb4d1785b3b8f2ff1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:07:41.803877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.826903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:41.900350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:41.907619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7089f1a-2fea-47aa-b600-3ddaf009f02f req-1cff9465-a3db-4ca2-a854-0142c5ad029f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0524898 Dec 21 04:07:42.011210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:07:42.011588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:42.017254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:42.018308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:42.059480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=827ddfe8-2625-43fe-8a87-8071d2b96af9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:42.101697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:42.104939 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-300b83e1-5c80-4aa9-90e1-6e4f99d2718e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4867048 Dec 21 04:07:42.172922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:42.203473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:42.205841 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-304d2693-63f9-42aa-b79d-014c928e5596" -d '{"events": [{"server_uuid": "87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf", "name": "network-vif-plugged", "status": "completed", "tag": "1f9f5bfd-3e00-4da8-8aad-fdf621afc682"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:42.247890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:42.267714 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3d4dcf8-3801-4a65-ad6d-d0020a8fbf38 x-openstack-request-id: req-b3d4dcf8-3801-4a65-ad6d-d0020a8fbf38 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:42.268262 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf", "name": "network-vif-plugged", "status": "completed", "tag": "1f9f5bfd-3e00-4da8-8aad-fdf621afc682", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:42.268708 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b3d4dcf8-3801-4a65-ad6d-d0020a8fbf38 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:42.269338 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682', 'code': 200} Dec 21 04:07:42.332125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:42.399741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:42.447569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c8b6cd-3b92-46f7-a288-cd651c96fa97 req-7116b518-04c9-490a-b4b7-0c9acb92553b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:42.449116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c0c8b6cd-3b92-46f7-a288-cd651c96fa97 req-7116b518-04c9-490a-b4b7-0c9acb92553b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 1097 time: 0.0566173 Dec 21 04:07:42.467049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-e49b163e-2fff-4b8f-8cfa-2325c6eda15c tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-88423922&fields=id&tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 267 time: 0.0774662 Dec 21 04:07:42.528830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c0c8b6cd-3b92-46f7-a288-cd651c96fa97 req-d399aeff-8e2a-4c95-a79b-98e3a85453e0 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704608 Dec 21 04:07:42.555340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:42.983709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-968670c6-3161-49a3-bab9-93d65b7af98a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:42.987701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-968670c6-3161-49a3-bab9-93d65b7af98a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/networks?id=f740899e-9cdc-4671-abdd-e69decd81dc4 HTTP/1.1" status: 200 len: 796 time: 0.5090213 Dec 21 04:07:43.006458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99222509-1fe1-47fc-8eb5-a2e481865c5c req-e680306b-8aea-4d87-a167-cf6efe7548f4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:43.007987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99222509-1fe1-47fc-8eb5-a2e481865c5c req-e680306b-8aea-4d87-a167-cf6efe7548f4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 945 time: 0.0842292 Dec 21 04:07:43.018319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-50c623d4-5ffa-4c6a-8967-2daddf1790e2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/quotas/ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 375 time: 0.0261977 Dec 21 04:07:43.057063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:43.096392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99222509-1fe1-47fc-8eb5-a2e481865c5c req-17eea80c-95b7-41b4-9415-6529fec4dc32 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805140 Dec 21 04:07:43.123953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-5e59b176-f9a6-4dd9-8ff6-19bed3186079 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0926602 Dec 21 04:07:43.245894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f344de2-70b2-4a85-849e-efc7b148d12f req-3062a85c-f862-41af-82cf-38a242df3de6 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0310619 Dec 21 04:07:43.281918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-8cead0b9-f379-415c-b026-be9dd742bf13 service neutron] 10.222.0.18 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1454680 Dec 21 04:07:43.379350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-5fe4da58-f2c4-4b82-98ff-d48cbd056e2e service neutron] 10.222.0.18 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0964074 Dec 21 04:07:43.402273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port 6595bc22-d041-4482-8249-86154b09e4b1 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:43.402622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:43.512046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] For port 6595bc22-d041-4482-8249-86154b09e4b1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6595bc22-d041-4482-8249-86154b09e4b1,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:43.512771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:43.528105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for 6595bc22-d041-4482-8249-86154b09e4b1 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:43.742383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a42c2f0-0eeb-491c-b7f6-7480e51cb231 req-b45ae631-66c4-41ca-990a-fa3f4e4bc954 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 210 time: 0.0437076 Dec 21 04:07:43.858500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:43.895323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=6595bc22-d041-4482-8249-86154b09e4b1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:44.121151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:44.163880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 3cee2956-a3a8-4db5-bccc-63f63f7d076c no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:44.193227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 3cee2956-a3a8-4db5-bccc-63f63f7d076c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:44.207394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 3cee2956-a3a8-4db5-bccc-63f63f7d076c not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:44.275605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb470e1-6bbe-4cfa-b5aa-e1b873176931 req-42c13c28-acd1-42e7-9000-cbc9a52894a3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:44.284641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffb470e1-6bbe-4cfa-b5aa-e1b873176931 req-42c13c28-acd1-42e7-9000-cbc9a52894a3 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 945 time: 0.0662796 Dec 21 04:07:44.341115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffb470e1-6bbe-4cfa-b5aa-e1b873176931 req-cd7cbbc5-3df3-4c21-a827-9fd4ef6bb5f6 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528181 Dec 21 04:07:44.448349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0877edd-fa15-4a66-b686-e54aa0f59c0f req-c554cb97-6dde-4a47-b2bf-cfe5a8fc6f6b tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0324290 Dec 21 04:07:44.741967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 5e6e374e-262e-40dd-bea9-2b2e820f8272 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:44.887580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:44.899187 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21269337-aeec-48d7-88e1-0e26ff8a2a75 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "PUT /v2.0/routers/5e6e374e-262e-40dd-bea9-2b2e820f8272/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3427196 Dec 21 04:07:44.903885 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] Sync routers for ids ['5e6e374e-262e-40dd-bea9-2b2e820f8272'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:44.905328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50764) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:44.928283 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] Routers {'5e6e374e-262e-40dd-bea9-2b2e820f8272'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:44.928993 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5e6e374e-262e-40dd-bea9-2b2e820f8272'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:44.940123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a083f0e6-9391-4a8c-9e1c-cace51bb3e67 req-d41bfb4f-9ef0-4eea-82e9-ce9393886ecf tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 210 time: 0.0819376 Dec 21 04:07:45.000439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting subnet 25b2f88d-507b-4adc-b3d7-44bc89a66393 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:07:45.003873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.048704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.157976 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] Set router 5e6e374e-262e-40dd-bea9-2b2e820f8272 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:45.218854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.338181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.375932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Subnet': ['ID=25b2f88d-507b-4adc-b3d7-44bc89a66393,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:45.382551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.385594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31591224-dcd9-4c76-bcc9-8474a27a5007 None None] Network 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:45.387239 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-25ef4dbd-0101-4366-a97c-e5aae7c44514 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/subnets/25b2f88d-507b-4adc-b3d7-44bc89a66393 HTTP/1.1" status: 204 len: 168 time: 0.4809141 Dec 21 04:07:45.389832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50774) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:45.392599 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:43Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:45.429563 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] Checking router: 5e6e374e-262e-40dd-bea9-2b2e820f8272 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:45.439425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] Routers {'5e6e374e-262e-40dd-bea9-2b2e820f8272'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:45.440356 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5e6e374e-262e-40dd-bea9-2b2e820f8272'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:45.561317 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] Set router 5e6e374e-262e-40dd-bea9-2b2e820f8272 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:45.562584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.704719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b36a8ad-4883-4aab-b258-422d6bd881ee req-c89188a8-3ca7-45cb-839f-beb319eecabb tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0862179 Dec 21 04:07:45.808066 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:43Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:45.842094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76718b62-db0b-47be-a4b2-449df4421f75 None None] The sync data for ids ['5e6e374e-262e-40dd-bea9-2b2e820f8272'] in n-d-822053-11 is: [{'id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'name': 'tempest-TestSecurityGroupsBasicOps-router-1352353052', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190'}], 'enable_snat': True}, 'gw_port_id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:03Z', 'updated_at': '2021-12-21T04:07:43Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:97:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6e374e-262e-40dd-bea9-2b2e820f8272', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2520, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:04Z', 'updated_at': '2021-12-21T04:07:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:45.848918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] DHCP port deletion for 647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:45.912270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:45.938259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] Deleting port e2164628-05bd-418a-9b32-e2889d6764ba {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:45.938740 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.035275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] For port e2164628-05bd-418a-9b32-e2889d6764ba, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e2164628-05bd-418a-9b32-e2889d6764ba,segment=NetworkSegment(a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc),segment_id=a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:46.037043 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.055059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] Calling delete_port for e2164628-05bd-418a-9b32-e2889d6764ba owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:46.083170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0275c34d-aabb-4d5c-b2d6-dccd79a0b245 req-abfb5185-f915-4dde-acbd-863ea84306e0 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 210 time: 0.0683148 Dec 21 04:07:46.167929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:46.168971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.303278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] For port 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:46.303733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.319513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:46.342485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.394110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] No DVR routers for this DVR port e2164628-05bd-418a-9b32-e2889d6764ba on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:46.404583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a128b9ee-ee4c-456b-83ac-cf6a35962214 None None] Pushing event deleted for resources: {'Port': ['ID=e2164628-05bd-418a-9b32-e2889d6764ba,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:46.586753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-90e6763e-58b2-48ae-806c-dea133377e9e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:46.588522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-90e6763e-58b2-48ae-806c-dea133377e9e tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/networks?id=f740899e-9cdc-4671-abdd-e69decd81dc4 HTTP/1.1" status: 200 len: 796 time: 0.1585002 Dec 21 04:07:46.695498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-1e218abb-0bb5-42a0-96a6-e9109ba59c3f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1 HTTP/1.1" status: 200 len: 378 time: 0.0903473 Dec 21 04:07:46.706992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'port': {'device_id': '6da2216e-3241-4799-a038-75e352ad057d', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'admin_state_up': True, 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'security_groups': ['78584b55-c6e0-45de-b709-b3a2ecd4ad06']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:46.755657 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.786572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:46.815349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db9000df-abbf-42b9-b5c4-2c4d8b028bbc None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:46.860437 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:07:46.913534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:46.990315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab06789a-82a4-4db5-b491-a549beac7121 req-d9edb13a-ea0b-41d1-8525-0224c72620e2 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0483067 Dec 21 04:07:47.065563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.067911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.092113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Made reservation on behalf of ec158f7f7c994dacb4d1785b3b8f2ff1 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:07:47.096019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.164733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e2164628-05bd-418a-9b32-e2889d6764ba no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:47.189969 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.190749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Fanout notify agent at l3_agent the message router_deleted on router 5e6e374e-262e-40dd-bea9-2b2e820f8272 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:07:47.203549 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.208221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1604bc24-dd4c-4b53-80fa-0d3853d02eeb tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/routers/5e6e374e-262e-40dd-bea9-2b2e820f8272 HTTP/1.1" status: 204 len: 168 time: 1.8166308 Dec 21 04:07:47.210769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50808) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:47.222610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e2164628-05bd-418a-9b32-e2889d6764ba {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:47.225579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e2164628-05bd-418a-9b32-e2889d6764ba not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:47.230873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6595bc22-d041-4482-8249-86154b09e4b1 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:47.312194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6595bc22-d041-4482-8249-86154b09e4b1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:47.312551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6595bc22-d041-4482-8249-86154b09e4b1 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:47.387831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.430355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.20.0.7 (f740899e-9cdc-4671-abdd-e69decd81dc4/0e2ee440-32ec-4001-87d7-31af9f807755/7e7cb951-ad6d-4b75-b937-32af19dc55df) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:07:47.572200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ed06e83-a9c8-4deb-8837-e038246645af req-ce63885a-3e14-4750-8a11-cd0944e1d16d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 210 time: 0.0551794 Dec 21 04:07:47.572703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.572703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:47.575642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:47.575958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a3f91832-f546-41e6-a7f2-f6f8a6b0a1fc') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:47.589195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.639314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.639314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Releasing vlan 121 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:07:47.639314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:07:47.657926 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:07:47.681007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.800203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.846893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network f740899e-9cdc-4671-abdd-e69decd81dc4 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:07:47.850523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:07:47.853061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:07:47.888616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=7e7cb951-ad6d-4b75-b937-32af19dc55df,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:47.919199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:47.919881 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.964094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.967009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:47.970876 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/networks/647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0 HTTP/1.1" status: 204 len: 168 time: 0.7587612 Dec 21 04:07:47.974550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50820) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:47.987472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d4de8ec-7b24-4689-9f1f-858849555115 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Network': ['ID=647ab7ed-a0d7-4ae3-bfd7-bb168b7923a0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:48.056464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-24da73d9-85d3-4906-84fd-efddee369d06 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3527539 Dec 21 04:07:48.090408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Request body: {'port': {'device_id': '6da2216e-3241-4799-a038-75e352ad057d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:07:48.154392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-50c71814-0cae-4029-b97d-4ff695a0c877 None None] Provisioning complete for port 7e7cb951-ad6d-4b75-b937-32af19dc55df triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:48.155564 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50c71814-0cae-4029-b97d-4ff695a0c877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:48.167093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ace07a0a-c06e-48d9-abf6-476f0630a18e req-739d5d02-1848-4f7d-9184-ad0e7a6cee1e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0532830 Dec 21 04:07:48.217315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-50c71814-0cae-4029-b97d-4ff695a0c877 None None] Port 7e7cb951-ad6d-4b75-b937-32af19dc55df cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:07:48.247170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:48.405906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port 5a65f107-c78b-4f56-b677-80b71ec85ff9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:48.406151 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:48.642962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:48.643294 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:48.673249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for 5a65f107-c78b-4f56-b677-80b71ec85ff9 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:48.890021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491d699b-7f65-4714-9031-7fd2412e996d req-9668a924-b323-4788-991a-87b476fa6aac tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:48.900418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-491d699b-7f65-4714-9031-7fd2412e996d req-9668a924-b323-4788-991a-87b476fa6aac tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 931 time: 0.2356017 Dec 21 04:07:48.913545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7e7cb951-ad6d-4b75-b937-32af19dc55df {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:48.936327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:48.993535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:49.003994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-491d699b-7f65-4714-9031-7fd2412e996d req-4a047afb-2897-49e7-892f-f63561c90463 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1025233 Dec 21 04:07:49.025443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Transition to ACTIVE for port object 7e7cb951-ad6d-4b75-b937-32af19dc55df will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:07:49.025810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:49.026502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1020fca2-98dd-4ec2-b7f6-e3ce3badb4e0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:49.086969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.146529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Pushing event updated for resources: {'Port': ['ID=7e7cb951-ad6d-4b75-b937-32af19dc55df,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:49.202809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.250774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=5a65f107-c78b-4f56-b677-80b71ec85ff9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:49.360189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3df97e7-83af-4766-a4e4-eb165c8a93bb req-9c7d1f17-b9d5-4fbf-944a-45bcf01ad461 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0574217 Dec 21 04:07:49.366911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Attempting to bind port 7e7cb951-ad6d-4b75-b937-32af19dc55df on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:07:49.367255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Attempting to bind port 7e7cb951-ad6d-4b75-b937-32af19dc55df by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:07:49.367585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Attempting to bind port 7e7cb951-ad6d-4b75-b937-32af19dc55df on network f740899e-9cdc-4671-abdd-e69decd81dc4 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:49.387367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Port 7e7cb951-ad6d-4b75-b937-32af19dc55df on network f740899e-9cdc-4671-abdd-e69decd81dc4 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:07:49.387734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Attempting to bind port 7e7cb951-ad6d-4b75-b937-32af19dc55df on network f740899e-9cdc-4671-abdd-e69decd81dc4 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:07:49.393082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.393421 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Floating IP dae2c1c7-c756-4bb0-85f6-674d058305ae disassociated (deleted). External IP: 172.25.5.229, port: 2d618554-ce8e-426e-a17d-9f52e0c87be9. Dec 21 04:07:49.504127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:07:49.505092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Checking segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:07:49.505943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Bound using segment: {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:07:49.506653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Bound port: 7e7cb951-ad6d-4b75-b937-32af19dc55df, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5a3eef7f-2893-495e-99bf-8f252856a8c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:07:49.507304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.649291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] For port 7e7cb951-ad6d-4b75-b937-32af19dc55df, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:07:49.666834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] For port 7e7cb951-ad6d-4b75-b937-32af19dc55df, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:07:49.735483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 028fa46c-cc11-488f-bfda-28719307241e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:49.784281 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.852616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02afd9a6-ffaa-4e69-9af5-906e333389da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.897110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:49.897728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.899373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] 10.222.0.31 "PUT /v2.0/ports/7e7cb951-ad6d-4b75-b937-32af19dc55df HTTP/1.1" status: 200 len: 1092 time: 1.8183527 Dec 21 04:07:49.899843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:49.902098 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f988be99-218c-4264-811a-f2e8fe3798f3" -d '{"events": [{"name": "network-changed", "server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:49.976536 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a78680b7-9de9-4618-81f1-6917e1ef79ee x-openstack-request-id: req-a78680b7-9de9-4618-81f1-6917e1ef79ee {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:49.977032 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:49.977476 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a78680b7-9de9-4618-81f1-6917e1ef79ee {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:49.978035 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'status': 'completed', 'code': 200} Dec 21 04:07:49.983243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:49.990994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:49.995003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5b0d2d-41ed-4817-beb5-4097ee01bf78 service neutron] Pushing event updated for resources: {'Port': ['ID=7e7cb951-ad6d-4b75-b937-32af19dc55df,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:50.014891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] Sync routers for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:50.043747 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-79de497f-e7a7-4eee-a54e-bfba466dbbfe tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/floatingips/dae2c1c7-c756-4bb0-85f6-674d058305ae HTTP/1.1" status: 204 len: 168 time: 2.0651464 Dec 21 04:07:50.055345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:50.056255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:50.256920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f988be99-218c-4264-811a-f2e8fe3798f3 req-96caef68-54bf-498d-8d8f-2fe239c0c18e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:50.258570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f988be99-218c-4264-811a-f2e8fe3798f3 req-96caef68-54bf-498d-8d8f-2fe239c0c18e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 1095 time: 0.2027745 Dec 21 04:07:50.287000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f364acb-6451-4504-b2f3-d209b516cc88 req-10f9ce46-fb79-47fa-8ad5-059afc6adf95 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:50.295220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f364acb-6451-4504-b2f3-d209b516cc88 req-10f9ce46-fb79-47fa-8ad5-059afc6adf95 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 943 time: 0.1292067 Dec 21 04:07:50.447375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f364acb-6451-4504-b2f3-d209b516cc88 req-eb5bec3e-6390-4264-bf3f-3a2ab753d033 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1510763 Dec 21 04:07:50.463451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f988be99-218c-4264-811a-f2e8fe3798f3 req-f40e43af-f686-44dc-8049-ea496a7c6f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:50.467436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f988be99-218c-4264-811a-f2e8fe3798f3 req-f40e43af-f686-44dc-8049-ea496a7c6f15 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&shared=False HTTP/1.1" status: 200 len: 897 time: 0.1697187 Dec 21 04:07:50.496583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:50.669088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf31c8f3-28d9-45e6-82f4-839234586f25 req-00a99044-29ee-4dba-972d-de1f59f1c7b5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/ports?device_id=692cadc7-8f56-4705-bdb5-42df91c65def HTTP/1.1" status: 200 len: 210 time: 0.0699227 Dec 21 04:07:50.736516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f988be99-218c-4264-811a-f2e8fe3798f3 req-4d9d83db-1970-4415-9f13-95788c6b178d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:50.741624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f988be99-218c-4264-811a-f2e8fe3798f3 req-4d9d83db-1970-4415-9f13-95788c6b178d service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2620480 Dec 21 04:07:50.781749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd1c327-f71a-4662-a746-5f1dd75d88ba req-24fca5aa-1946-40bf-a8bb-1f58d26b5a6f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:50.792193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd1c327-f71a-4662-a746-5f1dd75d88ba req-24fca5aa-1946-40bf-a8bb-1f58d26b5a6f tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.1401575 Dec 21 04:07:50.804178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:50.835611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] Checking router: 028fa46c-cc11-488f-bfda-28719307241e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:50.848791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:50.849857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:50.874195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50882) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:50.903605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bbd1c327-f71a-4662-a746-5f1dd75d88ba req-60fc559a-ba70-4f6f-b412-0d54b1616ad2 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.1084938 Dec 21 04:07:50.917982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-6c743934-a934-4cfc-a63c-92741f4551ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:50.931643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-6c743934-a934-4cfc-a63c-92741f4551ff service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 1095 time: 0.0934341 Dec 21 04:07:51.003915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:51.013218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-962c208b-4dc7-42cb-ae64-ac7943f18723 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df HTTP/1.1" status: 200 len: 217 time: 0.0647588 Dec 21 04:07:51.052457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d5a6cd6-8061-4168-a478-89968695fdf5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.076607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-6d93f8db-9f7f-4ff1-8e1b-466fb7764df7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:51.078187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-6d93f8db-9f7f-4ff1-8e1b-466fb7764df7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0e2ee440-32ec-4001-87d7-31af9f807755 HTTP/1.1" status: 200 len: 835 time: 0.0562778 Dec 21 04:07:51.162453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d5a6cd6-8061-4168-a478-89968695fdf5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.169389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-8da556d4-4c58-40eb-948b-a7110e4f5769 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:51.170953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-8da556d4-4c58-40eb-948b-a7110e4f5769 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f740899e-9cdc-4671-abdd-e69decd81dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0838068 Dec 21 04:07:51.217394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d5a6cd6-8061-4168-a478-89968695fdf5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.247645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:51.263180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d5a6cd6-8061-4168-a478-89968695fdf5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=432e8919db1f44c28927bc2380ad20b8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3883834 Dec 21 04:07:51.264196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5a6cd6-8061-4168-a478-89968695fdf5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c079ac10-3ddb-412d-aa72-3ac6949cac2c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:51.266642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50890) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:51.282291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca597c5-8492-418e-ae24-afd9d1a62d6b None None] The sync data for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 is: [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:05:58Z', 'revision_number': 4, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'fa5c3dd5-c437-4b36-b4ac-26355e71eb85', 'name': '', 'network_id': '7676bcbc-538f-4f82-a6a5-13d33001856e', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'mac_address': 'fa:16:3e:66:68:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_interface', 'standard_attr_id': 2450, 'fixed_ips': [{'subnet_id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:57Z', 'updated_at': '2021-12-21T04:06:04Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'subnets': [{'id': '51cbe5f4-3d45-4b4f-a219-d8b88c9871e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:51.298425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-16ceaa22-9c7f-45b8-810f-8842ddfd7a48 service neutron] 10.222.0.31 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1183877 Dec 21 04:07:51.321487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c82e223-b0a7-43e5-9a21-e1015eb62b21 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.350695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c82e223-b0a7-43e5-9a21-e1015eb62b21 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.413547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81c07405-351b-4662-8d4e-6bf99c1bafd0 req-691c1421-4f5f-4c5a-b200-006e7665bfad service neutron] 10.222.0.31 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1070604 Dec 21 04:07:51.496646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c82e223-b0a7-43e5-9a21-e1015eb62b21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.501127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c82e223-b0a7-43e5-9a21-e1015eb62b21 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.505504 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c82e223-b0a7-43e5-9a21-e1015eb62b21 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c079ac10-3ddb-412d-aa72-3ac6949cac2c HTTP/1.1" status: 204 len: 168 time: 0.2349668 Dec 21 04:07:51.522191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c82e223-b0a7-43e5-9a21-e1015eb62b21 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c079ac10-3ddb-412d-aa72-3ac6949cac2c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:51.608831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb27a42-4e18-4be7-98f1-4c83c6606bd2 req-e7840ff3-c176-4c2b-8239-c4c4b9f724c5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:51.611223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2eb27a42-4e18-4be7-98f1-4c83c6606bd2 req-e7840ff3-c176-4c2b-8239-c4c4b9f724c5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 943 time: 0.0705712 Dec 21 04:07:51.630894 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-288d1ce3-0444-4e8f-822f-f9945a31381f None None] New status for floating IP dae2c1c7-c756-4bb0-85f6-674d058305ae: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:07:51.691737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2eb27a42-4e18-4be7-98f1-4c83c6606bd2 req-79662775-c086-4d06-bb06-5dc5b15894dd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0673561 Dec 21 04:07:51.854679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:51.937516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b6aec44-5e95-4870-b9c0-4841a0ad516e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.964291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b6aec44-5e95-4870-b9c0-4841a0ad516e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:51.979960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:51.984516 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7e3007a-5134-4d1f-b3df-1b29f350f192" -d '{"events": [{"name": "network-changed", "server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:52.051833 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68d00c3e-1bc3-43a2-bd1e-71aa47226a14 x-openstack-request-id: req-68d00c3e-1bc3-43a2-bd1e-71aa47226a14 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:52.052126 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:52.052384 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-68d00c3e-1bc3-43a2-bd1e-71aa47226a14 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:52.052775 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'status': 'completed', 'code': 200} Dec 21 04:07:52.079162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a293ceca-8b45-4124-afba-9cc55c94fd5b req-7769e5d6-6c13-4e32-8394-eb0cc229b638 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.080952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a293ceca-8b45-4124-afba-9cc55c94fd5b req-7769e5d6-6c13-4e32-8394-eb0cc229b638 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.0688508 Dec 21 04:07:52.099599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-d03db1ac-d650-4589-b66d-72863e0a8d02 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.101680 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-d03db1ac-d650-4589-b66d-72863e0a8d02 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.54 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 984 time: 0.0793812 Dec 21 04:07:52.151924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b6aec44-5e95-4870-b9c0-4841a0ad516e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.155253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b6aec44-5e95-4870-b9c0-4841a0ad516e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.156881 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b6aec44-5e95-4870-b9c0-4841a0ad516e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/security-groups/b589cf28-c5b6-430c-8d6b-954231e2ed7a HTTP/1.1" status: 204 len: 168 time: 0.3011978 Dec 21 04:07:52.161665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50914) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:52.178254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a293ceca-8b45-4124-afba-9cc55c94fd5b req-e98f92cf-20e0-48f1-a7d0-6d48f83d90ae tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/security-groups?id=07b6c0f7-21be-49f9-9bcd-5f474bdb8030&id=6287e2c2-d00e-49cd-8bf8-6465cee94f44&fields=id&fields=name HTTP/1.1" status: 200 len: 410 time: 0.0910580 Dec 21 04:07:52.187245 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-a8682817-e7a3-404a-a605-54d7beabcc5f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] show failed (client error): The resource could not be found. Dec 21 04:07:52.188288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a8682817-e7a3-404a-a605-54d7beabcc5f tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "GET /v2.0/security-groups/b589cf28-c5b6-430c-8d6b-954231e2ed7a HTTP/1.1" status: 404 len: 347 time: 0.0248177 Dec 21 04:07:52.191237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50918) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:52.214341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6aec44-5e95-4870-b9c0-4841a0ad516e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b589cf28-c5b6-430c-8d6b-954231e2ed7a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:52.258844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:52.282101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac5cf2fc-9216-4ef7-ba95-f410faf626de admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.340837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-bce46e6d-f997-4b38-9f26-60d9711c3ef7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.342155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-bce46e6d-f997-4b38-9f26-60d9711c3ef7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=e4be3566d3c34a19a30558795061b823&device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 1136 time: 0.2569270 Dec 21 04:07:52.350323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port 2d618554-ce8e-426e-a17d-9f52e0c87be9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:52.350668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.415034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port 60960c82-1c00-40ad-bcae-ba9bc86a0e3d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:52.415376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.458170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac5cf2fc-9216-4ef7-ba95-f410faf626de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.518628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-53972b44-8a1a-4018-9627-28175030a5b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.520596 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-53972b44-8a1a-4018-9627-28175030a5b9 service neutron] 10.222.0.54 "GET /v2.0/networks?id=7676bcbc-538f-4f82-a6a5-13d33001856e HTTP/1.1" status: 200 len: 897 time: 0.1664293 Dec 21 04:07:52.522467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] For port 2d618554-ce8e-426e-a17d-9f52e0c87be9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:52.522801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.544945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for 2d618554-ce8e-426e-a17d-9f52e0c87be9 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:52.579745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-cd5c0a3f-c815-4800-9abe-acb19793664c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2d618554-ce8e-426e-a17d-9f52e0c87be9 HTTP/1.1" status: 200 len: 217 time: 0.0483987 Dec 21 04:07:52.619012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09dc8109-3150-4441-b3f8-70415a162dfb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.677407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-54309c1b-9b73-48cb-888e-086e9c584593 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.678902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-54309c1b-9b73-48cb-888e-086e9c584593 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=51cbe5f4-3d45-4b4f-a219-d8b88c9871e3 HTTP/1.1" status: 200 len: 834 time: 0.0914822 Dec 21 04:07:52.778574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-6c6af266-847d-4aee-870b-c4288633c0a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.780280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-6c6af266-847d-4aee-870b-c4288633c0a7 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=7676bcbc-538f-4f82-a6a5-13d33001856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0886559 Dec 21 04:07:52.805855 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.810832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac5cf2fc-9216-4ef7-ba95-f410faf626de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.895875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ac5cf2fc-9216-4ef7-ba95-f410faf626de admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a0110cfdf0944c4abdb9bd98fbf12af2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6353059 Dec 21 04:07:52.898314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-40aa30d2-1ab0-46f2-a59e-33740d3363a6 service neutron] 10.222.0.54 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1064143 Dec 21 04:07:52.898541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50924) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:52.905281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac5cf2fc-9216-4ef7-ba95-f410faf626de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cd79fff-e3aa-4cd7-9abc-d30e393c7054,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:52.906492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.920773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.921104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:52.937716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for 60960c82-1c00-40ad-bcae-ba9bc86a0e3d owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:52.947528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9781899b-6a73-4543-9c1f-51cf16936aff req-3128101e-6c76-46c2-a420-e2b9fa1d0e4f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:52.949130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9781899b-6a73-4543-9c1f-51cf16936aff req-3128101e-6c76-46c2-a420-e2b9fa1d0e4f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 943 time: 0.1419513 Dec 21 04:07:53.053308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=2d618554-ce8e-426e-a17d-9f52e0c87be9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:53.070317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9781899b-6a73-4543-9c1f-51cf16936aff req-1ff1b304-e210-442d-a34a-19a11daaf1a2 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1086297 Dec 21 04:07:53.134754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33b77a41-c60a-41cf-a181-91f1f46b8a2b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.151879 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7e3007a-5134-4d1f-b3df-1b29f350f192 req-564b9961-5e9d-4c1f-b2b8-3f6e34a7d1cd service neutron] 10.222.0.54 "GET /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2373967 Dec 21 04:07:53.171580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] No DVR routers for this DVR port 2d618554-ce8e-426e-a17d-9f52e0c87be9 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:53.177485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.181527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6dfbda86-e560-4120-8f15-1a210f7659ca req-254a496f-3601-47ff-8429-03ad8e792c1c tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.54 "DELETE /v2.0/ports/2d618554-ce8e-426e-a17d-9f52e0c87be9 HTTP/1.1" status: 204 len: 173 time: 1.0712135 Dec 21 04:07:53.181997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'name': 'network-vif-deleted', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:53.184288 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9251c940-8d38-4aa1-aa1f-3fda42cd6f5e" -d '{"events": [{"server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "name": "network-vif-deleted", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:53.197936 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33b77a41-c60a-41cf-a181-91f1f46b8a2b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.219900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.254870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.256218 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a72f812-2341-4f1b-9413-fcff03b95241 x-openstack-request-id: req-9a72f812-2341-4f1b-9413-fcff03b95241 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:53.256580 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5d28bed2-6aec-4b06-b318-ae4783f8d051", "name": "network-vif-deleted", "tag": "2d618554-ce8e-426e-a17d-9f52e0c87be9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:53.259031 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9a72f812-2341-4f1b-9413-fcff03b95241 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:53.259031 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5d28bed2-6aec-4b06-b318-ae4783f8d051', 'name': 'network-vif-deleted', 'tag': '2d618554-ce8e-426e-a17d-9f52e0c87be9', 'status': 'completed', 'code': 200} Dec 21 04:07:53.294557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=60960c82-1c00-40ad-bcae-ba9bc86a0e3d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:53.337758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33b77a41-c60a-41cf-a181-91f1f46b8a2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.341796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33b77a41-c60a-41cf-a181-91f1f46b8a2b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.344709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-33b77a41-c60a-41cf-a181-91f1f46b8a2b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5cd79fff-e3aa-4cd7-9abc-d30e393c7054 HTTP/1.1" status: 204 len: 168 time: 0.4452412 Dec 21 04:07:53.347257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-590fc765-f194-4d61-9aa3-4309d0101e91 req-aa105bdc-aadb-4f3d-b771-ef7916416659 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d28bed2-6aec-4b06-b318-ae4783f8d051 HTTP/1.1" status: 200 len: 210 time: 0.0528848 Dec 21 04:07:53.359288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b77a41-c60a-41cf-a181-91f1f46b8a2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cd79fff-e3aa-4cd7-9abc-d30e393c7054,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:53.375708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.378852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.381296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-46825cba-d1c5-48fe-b613-2789aca90239 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/floatingips/84fa031d-e041-4fd4-9017-c432e03f800f HTTP/1.1" status: 204 len: 168 time: 1.1888521 Dec 21 04:07:53.384015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50938) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:53.499692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port c52f2e0e-5f59-462b-97c5-d88f03894186 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:53.500216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.625856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.638019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for c52f2e0e-5f59-462b-97c5-d88f03894186 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:53.825611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.857609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=c52f2e0e-5f59-462b-97c5-d88f03894186,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:53.953266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:53.957900 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-587fb027-2222-4668-ab0d-2917017dff7e tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/ports/c52f2e0e-5f59-462b-97c5-d88f03894186 HTTP/1.1" status: 204 len: 168 time: 0.5722425 Dec 21 04:07:53.960716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50948) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:54.059333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting port bf55164f-f3e6-47de-9335-4f151942a1c5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:54.062466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.190598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.225149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Calling delete_port for bf55164f-f3e6-47de-9335-4f151942a1c5 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:54.230851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7e7cb951-ad6d-4b75-b937-32af19dc55df details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:07:54.417011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc834526-2d93-4697-a492-641f2260294f req-16c142ac-a0ad-44c3-bc69-3351a181742d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:54.425594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc834526-2d93-4697-a492-641f2260294f req-16c142ac-a0ad-44c3-bc69-3351a181742d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 943 time: 0.1123102 Dec 21 04:07:54.449782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7e7cb951-ad6d-4b75-b937-32af19dc55df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:54.454630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:54.480591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'port_id': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'mac_address': 'fa:16:3e:c5:47:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:07:54.558644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d809098-2e85-4d40-9ad3-cae816df24b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.566497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.588224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d809098-2e85-4d40-9ad3-cae816df24b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.619413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc834526-2d93-4697-a492-641f2260294f req-cb71fdf2-f5b3-413d-a258-b6d06aa1755a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1917884 Dec 21 04:07:54.634838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7e7cb951-ad6d-4b75-b937-32af19dc55df {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:07:54.688236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7e7cb951-ad6d-4b75-b937-32af19dc55df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:54.709285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.726367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d809098-2e85-4d40-9ad3-cae816df24b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.730253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d809098-2e85-4d40-9ad3-cae816df24b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.734411 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d809098-2e85-4d40-9ad3-cae816df24b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/security-groups/6287e2c2-d00e-49cd-8bf8-6465cee94f44 HTTP/1.1" status: 204 len: 168 time: 0.2755613 Dec 21 04:07:54.739784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50976) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:54.782766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.792273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d809098-2e85-4d40-9ad3-cae816df24b5 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6287e2c2-d00e-49cd-8bf8-6465cee94f44,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:54.840956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Port': ['ID=bf55164f-f3e6-47de-9335-4f151942a1c5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:54.845841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12246d3b-a9b8-4354-9976-6f86f0fa37ee tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.890254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12246d3b-a9b8-4354-9976-6f86f0fa37ee tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.972419 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:54.975916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cd2e6114-d016-433f-aee4-6460febde6d5 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/ports/bf55164f-f3e6-47de-9335-4f151942a1c5 HTTP/1.1" status: 204 len: 168 time: 1.0140867 Dec 21 04:07:54.979328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:54.981179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=7e7cb951-ad6d-4b75-b937-32af19dc55df,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:55.045177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting subnet 73b86b05-b093-4acf-bae3-cf60f26838b3 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:07:55.048852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.094053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.096225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.097097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12246d3b-a9b8-4354-9976-6f86f0fa37ee tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.100471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12246d3b-a9b8-4354-9976-6f86f0fa37ee tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.104138 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12246d3b-a9b8-4354-9976-6f86f0fa37ee tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/security-groups/07b6c0f7-21be-49f9-9bcd-5f474bdb8030 HTTP/1.1" status: 204 len: 168 time: 0.3432415 Dec 21 04:07:55.105852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50986) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:55.118562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.122176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12246d3b-a9b8-4354-9976-6f86f0fa37ee tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=07b6c0f7-21be-49f9-9bcd-5f474bdb8030,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:55.172096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['7e7cb951-ad6d-4b75-b937-32af19dc55df'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:07:55.288294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.504105 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.592961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.596457 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/subnets/73b86b05-b093-4acf-bae3-cf60f26838b3 HTTP/1.1" status: 204 len: 168 time: 0.6161029 Dec 21 04:07:55.599725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50998) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:55.600283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12cd55d0-12cd-4acc-bc9b-c2c0d341aed3 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Subnet': ['ID=73b86b05-b093-4acf-bae3-cf60f26838b3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:55.607845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4570269-66e5-4294-8e31-d14583a0dad3 None None] Network 42bfeccc-af8e-4aab-801c-72e8e8caa439 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:55.850826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2d618554-ce8e-426e-a17d-9f52e0c87be9 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:55.885629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Deleting subnet 966929b7-7c93-4802-a83d-62484be430ce {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:07:55.891451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.904736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 2d618554-ce8e-426e-a17d-9f52e0c87be9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:55.905094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 2d618554-ce8e-426e-a17d-9f52e0c87be9 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:55.919118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] DHCP port deletion for 42bfeccc-af8e-4aab-801c-72e8e8caa439 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:55.923672 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:55.945309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236ebceb-7006-4e26-b2de-57e336a321c3 req-f6b34c82-ff9a-4e24-97d6-1e40e23410a5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:55.952614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-236ebceb-7006-4e26-b2de-57e336a321c3 req-f6b34c82-ff9a-4e24-97d6-1e40e23410a5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 944 time: 0.1368599 Dec 21 04:07:55.994711 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.001504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] Deleting port 82003059-5a14-4a1a-bee8-857f8a365353 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:56.001937 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.106318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] For port 82003059-5a14-4a1a-bee8-857f8a365353, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=82003059-5a14-4a1a-bee8-857f8a365353,segment=NetworkSegment(ed5c034b-3532-410c-a7e9-aabd119ea3a2),segment_id=ed5c034b-3532-410c-a7e9-aabd119ea3a2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:56.107111 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.109323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-236ebceb-7006-4e26-b2de-57e336a321c3 req-4f75c843-c7fa-463d-a9c4-e7e70a9b2792 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1480114 Dec 21 04:07:56.130686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] Calling delete_port for 82003059-5a14-4a1a-bee8-857f8a365353 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:56.215161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.265165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.355042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.400731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] Pushing event deleted for resources: {'Port': ['ID=82003059-5a14-4a1a-bee8-857f8a365353,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:56.411754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2589a16-cbe8-4add-9268-3ad724616c17 None None] No DVR routers for this DVR port 82003059-5a14-4a1a-bee8-857f8a365353 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:56.454494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.512028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.517919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51014) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:56.518424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/subnets/966929b7-7c93-4802-a83d-62484be430ce HTTP/1.1" status: 204 len: 168 time: 0.9139750 Dec 21 04:07:56.520743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcd55d0-6bab-4854-828e-1840d34689b9 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Subnet': ['ID=966929b7-7c93-4802-a83d-62484be430ce,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:56.524149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b8d52e1-88c7-4105-a872-63d7ef53f76d None None] Network 8d559823-2509-427a-8bd4-77cf5a81095a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:56.646829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.716005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port fa5c3dd5-c437-4b36-b4ac-26355e71eb85 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:56.717575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.734896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] DHCP port deletion for 8d559823-2509-427a-8bd4-77cf5a81095a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:56.784276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.820903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] Deleting port 400e6f56-e946-4c33-8745-f1a3be28db2c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:56.822020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.827780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42bfeccc-af8e-4aab-801c-72e8e8caa439']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:56.837549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed5c034b-3532-410c-a7e9-aabd119ea3a2') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:56.837829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed5c034b-3532-410c-a7e9-aabd119ea3a2') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:56.849186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.855939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] For port fa5c3dd5-c437-4b36-b4ac-26355e71eb85, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:56.856316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.865101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.875837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Releasing vlan 107 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:07:56.876232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:07:56.879465 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:07:56.889782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for fa5c3dd5-c437-4b36-b4ac-26355e71eb85 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:56.920662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] For port 400e6f56-e946-4c33-8745-f1a3be28db2c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=400e6f56-e946-4c33-8745-f1a3be28db2c,segment=NetworkSegment(95ba2a4f-5934-40bc-93f6-2d408e4d50cd),segment_id=95ba2a4f-5934-40bc-93f6-2d408e4d50cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:56.921878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:56.948657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] Calling delete_port for 400e6f56-e946-4c33-8745-f1a3be28db2c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:07:57.051880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.066131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.070437 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/networks/42bfeccc-af8e-4aab-801c-72e8e8caa439 HTTP/1.1" status: 204 len: 168 time: 0.5512364 Dec 21 04:07:57.086003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51022) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:57.100570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 82003059-5a14-4a1a-bee8-857f8a365353 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:57.104415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d14c54b3-4773-47d0-96b3-3a00b4b38d52 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Network': ['ID=42bfeccc-af8e-4aab-801c-72e8e8caa439,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:57.147155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 82003059-5a14-4a1a-bee8-857f8a365353 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:57.147663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 82003059-5a14-4a1a-bee8-857f8a365353 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:57.148181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 400e6f56-e946-4c33-8745-f1a3be28db2c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:07:57.150779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.211283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 400e6f56-e946-4c33-8745-f1a3be28db2c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:07:57.211759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 400e6f56-e946-4c33-8745-f1a3be28db2c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:07:57.223582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] Pushing event deleted for resources: {'Port': ['ID=400e6f56-e946-4c33-8745-f1a3be28db2c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:57.236401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35c2af39-d05c-4d5b-a767-1fdc6fd45228 None None] No DVR routers for this DVR port 400e6f56-e946-4c33-8745-f1a3be28db2c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:07:57.328902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.394799 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-bc093bd4-192a-4e99-a943-6c257c4e0d9f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0862751 Dec 21 04:07:57.450709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c01cab2-006d-4c96-b01f-b4b40e4c838c req-53b25ae1-df7c-42bf-ba67-f6eeb01c0d94 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:57.453426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c01cab2-006d-4c96-b01f-b4b40e4c838c req-53b25ae1-df7c-42bf-ba67-f6eeb01c0d94 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 944 time: 0.1843915 Dec 21 04:07:57.529354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-3fd682ce-6eda-46d2-ba62-7fad9ee16cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:57.530885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-3fd682ce-6eda-46d2-ba62-7fad9ee16cf3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c24fe956f7434054805a2322d25507fa&device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 1097 time: 0.0877197 Dec 21 04:07:57.563333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.573316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.634367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=fa5c3dd5-c437-4b36-b4ac-26355e71eb85,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:57.675674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c01cab2-006d-4c96-b01f-b4b40e4c838c req-c3471278-4a1a-4c83-b010-2b9f78357251 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2144759 Dec 21 04:07:57.677936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d559823-2509-427a-8bd4-77cf5a81095a']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:57.724000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '95ba2a4f-5934-40bc-93f6-2d408e4d50cd') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:57.724703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '95ba2a4f-5934-40bc-93f6-2d408e4d50cd') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:57.746438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.748016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-e9c93deb-b0ac-40c6-8007-b028d000702f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:57.750460 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-e9c93deb-b0ac-40c6-8007-b028d000702f service neutron] 10.222.0.54 "GET /v2.0/networks?id=13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 200 len: 916 time: 0.1821506 Dec 21 04:07:57.770136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.808895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Releasing vlan 116 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:07:57.809208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.821425 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:07:57.825512 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:07:57.848715 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-0a542416-7404-4846-b659-5f69b86f5421 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=524a3677-f175-4542-a3c6-7039ad8256ba HTTP/1.1" status: 200 len: 217 time: 0.0876570 Dec 21 04:07:57.950564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-4b2e9975-c655-4761-8380-bea73423d7e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:57.952071 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-4b2e9975-c655-4761-8380-bea73423d7e9 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f6eb37b9-316b-4d85-9044-455f8831b074 HTTP/1.1" status: 200 len: 855 time: 0.0913701 Dec 21 04:07:57.994091 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-a61766dc-7f43-42b5-936f-52a7f9f61884 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=13d79d25-d791-421e-bee1-93ce620f5704&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0333118 Dec 21 04:07:58.046965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.101250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.106724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.124873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] 10.222.0.18 "DELETE /v2.0/networks/8d559823-2509-427a-8bd4-77cf5a81095a HTTP/1.1" status: 204 len: 168 time: 1.0379457 Dec 21 04:07:58.151747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb98adc0-ca7e-4b88-8761-0a8331055f22 tempest-TaggedBootDevicesTest_v242-110888809 tempest-TaggedBootDevicesTest_v242-110888809-project] Pushing event deleted for resources: {'Network': ['ID=8d559823-2509-427a-8bd4-77cf5a81095a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:58.170907 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-61d8bc0e-17a2-4a6d-b101-248ca18c30aa service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1647778 Dec 21 04:07:58.244458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7e7cb951-ad6d-4b75-b937-32af19dc55df up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:07:58.402317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 7e7cb951-ad6d-4b75-b937-32af19dc55df completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:07:58.406820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 7e7cb951-ad6d-4b75-b937-32af19dc55df triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:07:58.411344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.416250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d28f535-b741-4ceb-8134-af24ab9264b3 req-c2c8162f-9e1f-4c26-8cb5-e30d265afe84 service neutron] 10.222.0.54 "GET /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2237976 Dec 21 04:07:58.503912 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.536353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:07:58.539850 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b9c3c95-5500-4afb-9cad-64e52f0f240c" -d '{"events": [{"server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "name": "network-vif-plugged", "status": "completed", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:07:58.540270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Router 028fa46c-cc11-488f-bfda-28719307241e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:07:58.546857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7e7cb951-ad6d-4b75-b937-32af19dc55df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:58.605915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.694223 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:07:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0210c8a2-6cc4-406d-8eb3-5885c93082a0 x-openstack-request-id: req-0210c8a2-6cc4-406d-8eb3-5885c93082a0 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:07:58.694683 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "name": "network-vif-plugged", "status": "completed", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:07:58.695166 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0210c8a2-6cc4-406d-8eb3-5885c93082a0 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:07:58.695832 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'code': 200} Dec 21 04:07:58.696998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=7e7cb951-ad6d-4b75-b937-32af19dc55df,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:58.751843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:07:58.762377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f19c6432-54d0-407f-8997-47ea556781be tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "PUT /v2.0/routers/028fa46c-cc11-488f-bfda-28719307241e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6509686 Dec 21 04:07:58.762908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51072) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:58.768258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] Sync routers for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:07:58.779298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e069594a-efa7-4b67-b20d-6809b1e93700 req-58a2c544-2366-4038-a6f3-d5ffec2c405a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:58.782555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e069594a-efa7-4b67-b20d-6809b1e93700 req-58a2c544-2366-4038-a6f3-d5ffec2c405a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 1097 time: 0.0679970 Dec 21 04:07:58.791259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:58.795725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:58.859548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting subnet 51cbe5f4-3d45-4b4f-a219-d8b88c9871e3 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:07:58.869838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:58.872232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c3d2e-c39c-428f-91aa-5fd60d3cb810 req-93a4bc3c-4dba-414d-bcdc-4d1985bd1220 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:07:58.879898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950c3d2e-c39c-428f-91aa-5fd60d3cb810 req-93a4bc3c-4dba-414d-bcdc-4d1985bd1220 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.1031959 Dec 21 04:07:58.884923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e069594a-efa7-4b67-b20d-6809b1e93700 req-f9eccde8-61c7-44c2-8ef2-860ea6684736 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0917883 Dec 21 04:07:58.913031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:58.936457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-950c3d2e-c39c-428f-91aa-5fd60d3cb810 req-669309f2-f55e-4b09-9b09-58c9ed35ebb5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0555682 Dec 21 04:07:58.946654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.102620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51076) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:59.118885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.171769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:07:57Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:59.216258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] Checking router: 028fa46c-cc11-488f-bfda-28719307241e for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:07:59.225798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] Routers {'028fa46c-cc11-488f-bfda-28719307241e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:07:59.226515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['028fa46c-cc11-488f-bfda-28719307241e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:59.262168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43b1587c-388b-4d02-a96b-b771249131c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.287097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.333880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Subnet': ['ID=51cbe5f4-3d45-4b4f-a219-d8b88c9871e3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:59.346483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.354265 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4f3d3f7-e3bd-4962-9498-0a207794f137 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/subnets/51cbe5f4-3d45-4b4f-a219-d8b88c9871e3 HTTP/1.1" status: 204 len: 168 time: 0.5871024 Dec 21 04:07:59.360408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51082) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:59.397585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43b1587c-388b-4d02-a96b-b771249131c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.475549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43b1587c-388b-4d02-a96b-b771249131c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.510129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.514160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43b1587c-388b-4d02-a96b-b771249131c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5b44907-7823-4510-b4b0-8de6c95876be,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:59.518591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] Set router 028fa46c-cc11-488f-bfda-28719307241e gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:07:59.543255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-43b1587c-388b-4d02-a96b-b771249131c7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9140f21b61fb4bd28f867e489faaea2a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4393668 Dec 21 04:07:59.543910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51086) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:07:59.578236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0764f97-7ab2-4fa6-981b-4fcc8c40edee None None] Network 7676bcbc-538f-4f82-a6a5-13d33001856e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:07:59.598998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89442398-b6aa-4744-86c7-91567a86c68e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.627084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89442398-b6aa-4744-86c7-91567a86c68e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.634280 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.755243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89442398-b6aa-4744-86c7-91567a86c68e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.761885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89442398-b6aa-4744-86c7-91567a86c68e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.766380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89442398-b6aa-4744-86c7-91567a86c68e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e5b44907-7823-4510-b4b0-8de6c95876be HTTP/1.1" status: 204 len: 168 time: 0.2183867 Dec 21 04:07:59.786132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89442398-b6aa-4744-86c7-91567a86c68e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5b44907-7823-4510-b4b0-8de6c95876be,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:07:59.841125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:07:57Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:07:59.864220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Deleting port 55d16698-d3ae-409d-8947-9f93799670dd {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:59.865188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.899231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] DHCP port deletion for 7676bcbc-538f-4f82-a6a5-13d33001856e request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:07:59.905155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b5f13e6-bf08-42e7-88d2-9f7f642eb1a2 None None] The sync data for ids ['028fa46c-cc11-488f-bfda-28719307241e'] in n-d-822053-11 is: [{'id': '028fa46c-cc11-488f-bfda-28719307241e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-950412603', 'tenant_id': 'e4be3566d3c34a19a30558795061b823', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228'}], 'enable_snat': True}, 'gw_port_id': '55d16698-d3ae-409d-8947-9f93799670dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:05:51Z', 'updated_at': '2021-12-21T04:07:57Z', 'revision_number': 5, 'project_id': 'e4be3566d3c34a19a30558795061b823', 'gw_port': {'id': '55d16698-d3ae-409d-8947-9f93799670dd', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b8:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '028fa46c-cc11-488f-bfda-28719307241e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2447, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:05:52Z', 'updated_at': '2021-12-21T04:05:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:07:59.976811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] Deleting port bac0af49-cb96-4448-b384-2a8a3f169ef5 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:07:59.980883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:07:59.997369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] For port 55d16698-d3ae-409d-8947-9f93799670dd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=55d16698-d3ae-409d-8947-9f93799670dd,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:07:59.997749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.036705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Calling delete_port for 55d16698-d3ae-409d-8947-9f93799670dd owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:00.079499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] For port bac0af49-cb96-4448-b384-2a8a3f169ef5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bac0af49-cb96-4448-b384-2a8a3f169ef5,segment=NetworkSegment(3776c03c-8264-4376-8d05-0d4023c31e08),segment_id=3776c03c-8264-4376-8d05-0d4023c31e08)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:00.080028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.104297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] Calling delete_port for bac0af49-cb96-4448-b384-2a8a3f169ef5 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:00.202969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cdf519-86b2-4913-833e-dabca81fa2f9 req-6179a9f8-681b-491b-b6a4-afb7df798be7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:00.205195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36cdf519-86b2-4913-833e-dabca81fa2f9 req-6179a9f8-681b-491b-b6a4-afb7df798be7 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.1169953 Dec 21 04:08:00.284906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36cdf519-86b2-4913-833e-dabca81fa2f9 req-390021a9-fa54-4bc7-a0a8-651a45b27660 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0718763 Dec 21 04:08:00.287098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.367373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] No DVR routers for this DVR port bac0af49-cb96-4448-b384-2a8a3f169ef5 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:00.373719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f2200b-b912-4570-a0cc-3c77ee1e4c26 None None] Pushing event deleted for resources: {'Port': ['ID=bac0af49-cb96-4448-b384-2a8a3f169ef5,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:00.640656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51102) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:00.654818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404b4d76-e214-468d-b1a2-d04e74bfb13d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.674705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.702564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Port': ['ID=55d16698-d3ae-409d-8947-9f93799670dd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:00.724519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e309c97-9cda-49e9-84ad-9d5142339a0e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:00.752802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404b4d76-e214-468d-b1a2-d04e74bfb13d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.781316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.828662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-404b4d76-e214-468d-b1a2-d04e74bfb13d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.870103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-404b4d76-e214-468d-b1a2-d04e74bfb13d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=01550cc030a94f43b3e96aed93801816&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2283194 Dec 21 04:08:00.871417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404b4d76-e214-468d-b1a2-d04e74bfb13d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7c34c47-f782-48c7-8ea5-9e3de7e859f7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:00.872968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51104) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:00.883915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.890270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:00.970035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8a04f058-7c2f-4b31-b6d9-b9339b2237c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.012730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8a04f058-7c2f-4b31-b6d9-b9339b2237c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.030991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.031581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Fanout notify agent at l3_agent the message router_deleted on router 028fa46c-cc11-488f-bfda-28719307241e {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:08:01.043333 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.047174 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-114c2741-6cb8-4637-a3f9-d60b9cf88047 tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/routers/028fa46c-cc11-488f-bfda-28719307241e HTTP/1.1" status: 204 len: 168 time: 1.6853359 Dec 21 04:08:01.047340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:01.129823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bac0af49-cb96-4448-b384-2a8a3f169ef5 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:01.158030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: bac0af49-cb96-4448-b384-2a8a3f169ef5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:01.158687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bac0af49-cb96-4448-b384-2a8a3f169ef5 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:01.159316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa5c3dd5-c437-4b36-b4ac-26355e71eb85 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:01.171802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8a04f058-7c2f-4b31-b6d9-b9339b2237c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.175026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8a04f058-7c2f-4b31-b6d9-b9339b2237c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.179291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8a04f058-7c2f-4b31-b6d9-b9339b2237c6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f7c34c47-f782-48c7-8ea5-9e3de7e859f7 HTTP/1.1" status: 204 len: 168 time: 0.3016624 Dec 21 04:08:01.193358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: fa5c3dd5-c437-4b36-b4ac-26355e71eb85 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:01.194075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fa5c3dd5-c437-4b36-b4ac-26355e71eb85 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:01.201727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a04f058-7c2f-4b31-b6d9-b9339b2237c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7c34c47-f782-48c7-8ea5-9e3de7e859f7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:01.529251 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.559143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54855f3d-13ac-486e-acbe-835dca6060ad req-12ed3b4e-5d74-4667-9410-ee7aafe288a9 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:01.562141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54855f3d-13ac-486e-acbe-835dca6060ad req-12ed3b4e-5d74-4667-9410-ee7aafe288a9 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.0740380 Dec 21 04:08:01.672952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.710326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7676bcbc-538f-4f82-a6a5-13d33001856e']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:01.724795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54855f3d-13ac-486e-acbe-835dca6060ad req-5cb9f291-3d44-45b4-a9ca-8b85f4080451 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1326683 Dec 21 04:08:01.743648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3776c03c-8264-4376-8d05-0d4023c31e08') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:01.743648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3776c03c-8264-4376-8d05-0d4023c31e08') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:01.750279 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.777071 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.787860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:01.788245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:01.791508 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:01.888925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290c539f-a81d-4f15-867f-d942012331b7 req-a1a646d8-1fe8-4302-acf6-20d05375e108 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:01.890439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-290c539f-a81d-4f15-867f-d942012331b7 req-a1a646d8-1fe8-4302-acf6-20d05375e108 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.0886064 Dec 21 04:08:01.944051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.949825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-290c539f-a81d-4f15-867f-d942012331b7 req-c60a3954-8332-49e1-bd45-6d9962ae8e8f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0527186 Dec 21 04:08:01.966498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:01.974591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] 10.222.0.18 "DELETE /v2.0/networks/7676bcbc-538f-4f82-a6a5-13d33001856e HTTP/1.1" status: 204 len: 168 time: 0.9258807 Dec 21 04:08:01.975681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101bcc77-5a25-4d9e-9fb8-c203d5efa23d tempest-TestSecurityGroupsBasicOps-1915984362 tempest-TestSecurityGroupsBasicOps-1915984362-project] Pushing event deleted for resources: {'Network': ['ID=7676bcbc-538f-4f82-a6a5-13d33001856e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:01.989185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51136) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:02.043953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dd25a75-9ed0-4e2b-9cc3-142403e975e1 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:02.048274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9dd25a75-9ed0-4e2b-9cc3-142403e975e1 tempest-TestNetworkBasicOps-8402248 tempest-TestNetworkBasicOps-8402248-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 1092 time: 0.0542910 Dec 21 04:08:02.052951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:02.053642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:02.160311 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:02.265136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:02.384285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Allocated IP 172.25.5.35 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/1dc34ecd-7949-40c6-809a-18bdf936a79c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:02.506304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:02.509090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51158) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:02.622539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:02.687719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:02.698317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:02.705191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:02.711411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=1dc34ecd-7949-40c6-809a-18bdf936a79c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:02.748124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-51d577b9-75e7-4b33-854c-614a0c4ff8ab admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e4be3566d3c34a19a30558795061b823&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2378342 Dec 21 04:08:02.750622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51168) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:02.884060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-befdf56c-58e7-4e80-abff-9a82244b26af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:02.959945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-befdf56c-58e7-4e80-abff-9a82244b26af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:02.996121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 55d16698-d3ae-409d-8947-9f93799670dd no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:03.044657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 55d16698-d3ae-409d-8947-9f93799670dd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:03.045012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 55d16698-d3ae-409d-8947-9f93799670dd not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:03.262373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:03.326000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-befdf56c-58e7-4e80-abff-9a82244b26af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:03.332423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-befdf56c-58e7-4e80-abff-9a82244b26af admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:03.335712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-befdf56c-58e7-4e80-abff-9a82244b26af admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/942ba84a-722f-4040-9c6c-19f85c3224ea HTTP/1.1" status: 204 len: 168 time: 0.5831268 Dec 21 04:08:03.354235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-befdf56c-58e7-4e80-abff-9a82244b26af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=942ba84a-722f-4040-9c6c-19f85c3224ea,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:03.447299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:03.737190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:03.805722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:03.919864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event updated for resources: {'Port': ['ID=1dc34ecd-7949-40c6-809a-18bdf936a79c,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:03.929078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.075452 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Floating IP d888da9b-98ad-49bd-a5e9-3f31922bf8b1 associated. External IP: 172.25.5.35, port: 7e7cb951-ad6d-4b75-b937-32af19dc55df. Dec 21 04:08:04.287165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51200) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:04.310443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0daf8446-f14a-4d32-ab49-358a4da4354a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.476601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0daf8446-f14a-4d32-ab49-358a4da4354a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.477034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router fb1fb678-be5b-4fff-abe6-343b84e37da9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:08:04.516517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51206) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:04.554502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0daf8446-f14a-4d32-ab49-358a4da4354a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.602530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0daf8446-f14a-4d32-ab49-358a4da4354a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=cbe7b79b368245acbf88d6b91565131f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3136666 Dec 21 04:08:04.603445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51212) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:04.624727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0daf8446-f14a-4d32-ab49-358a4da4354a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e6a06ce-61f4-4b25-b44c-d830c9b42390,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:04.698667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:08:04.700947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2ee04ab-9a0d-43ab-bf4e-a8effabca9bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.711625 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] Sync routers for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:08:04.713304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df918faa-4697-4a98-9429-20899317d6e0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.751216 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:04.752159 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:04.775130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df918faa-4697-4a98-9429-20899317d6e0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.836572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.878295 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c895fef-3aed-45b8-9b3a-457aea6498bd tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.8283300 Dec 21 04:08:04.879141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:04.882707 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9dbd0a5b-f5d6-409e-bf60-231211054bdb" -d '{"events": [{"name": "network-changed", "server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:04.886233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51216) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:04.949583 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:04.971882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2ee04ab-9a0d-43ab-bf4e-a8effabca9bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.976021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df918faa-4697-4a98-9429-20899317d6e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.978551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-df918faa-4697-4a98-9429-20899317d6e0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:04.979731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-df918faa-4697-4a98-9429-20899317d6e0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9e6a06ce-61f4-4b25-b44c-d830c9b42390 HTTP/1.1" status: 204 len: 168 time: 0.3622582 Dec 21 04:08:04.985888 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b89f6e7-fca9-4a1d-904d-df712f9868d1 x-openstack-request-id: req-6b89f6e7-fca9-4a1d-904d-df712f9868d1 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:04.986314 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:04.986678 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6b89f6e7-fca9-4a1d-904d-df712f9868d1 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:04.987231 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'status': 'completed', 'code': 200} Dec 21 04:08:04.995587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-57b690c6-5764-464f-b03b-ea97b8f52bef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/d888da9b-98ad-49bd-a5e9-3f31922bf8b1 HTTP/1.1" status: 200 len: 990 time: 0.1080501 Dec 21 04:08:05.011229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df918faa-4697-4a98-9429-20899317d6e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e6a06ce-61f4-4b25-b44c-d830c9b42390,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:05.034811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2ee04ab-9a0d-43ab-bf4e-a8effabca9bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:05.169156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a2ee04ab-9a0d-43ab-bf4e-a8effabca9bf admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7b2c0b1e40384619b3a6e0e862883ca3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6514015 Dec 21 04:08:05.170303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ee04ab-9a0d-43ab-bf4e-a8effabca9bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1d182d0-b933-42f7-abb9-84561b9175ac,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:05.171924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:05.185925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-dc1e6e92-893a-4959-917f-712c9efd626e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:05.187674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-dc1e6e92-893a-4959-917f-712c9efd626e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 1097 time: 0.1145203 Dec 21 04:08:05.307909 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a04e936f-cb42-464c-82a2-3d7b9ce199d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:05.333409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-07c0b13f-3f21-4d4f-88b4-c105f3f72467 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:05.337169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-07c0b13f-3f21-4d4f-88b4-c105f3f72467 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f740899e-9cdc-4671-abdd-e69decd81dc4 HTTP/1.1" status: 200 len: 897 time: 0.1414394 Dec 21 04:08:05.387698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a04e936f-cb42-464c-82a2-3d7b9ce199d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:05.460151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd888da9b-98ad-49bd-a5e9-3f31922bf8b1', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.35', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'port_id': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 2584, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'mac_address': 'fa:16:3e:c5:47:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6da2216e-3241-4799-a038-75e352ad057d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:08:03Z', 'updated_at': '2021-12-21T04:08:03Z', 'revision_number': 0, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:40Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:05.478224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-86225046-329a-4ca0-82a8-c0feab9f8a4e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df HTTP/1.1" status: 200 len: 998 time: 0.1284003 Dec 21 04:08:05.513931 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] Checking router: fb1fb678-be5b-4fff-abe6-343b84e37da9 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:08:05.524612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:05.525221 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:05.548937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-279345fb-0691-49f2-a80c-24aec1816335 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:05.550705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-279345fb-0691-49f2-a80c-24aec1816335 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0e2ee440-32ec-4001-87d7-31af9f807755 HTTP/1.1" status: 200 len: 835 time: 0.0650539 Dec 21 04:08:05.571516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a04e936f-cb42-464c-82a2-3d7b9ce199d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:05.581693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a04e936f-cb42-464c-82a2-3d7b9ce199d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:05.588178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a04e936f-cb42-464c-82a2-3d7b9ce199d4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f1d182d0-b933-42f7-abb9-84561b9175ac HTTP/1.1" status: 204 len: 168 time: 0.4151528 Dec 21 04:08:05.615362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04e936f-cb42-464c-82a2-3d7b9ce199d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1d182d0-b933-42f7-abb9-84561b9175ac,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:05.660360 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:05.714192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-5c806a06-4311-4df8-aee1-4b1b317ec590 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:05.717455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-5c806a06-4311-4df8-aee1-4b1b317ec590 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f740899e-9cdc-4671-abdd-e69decd81dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1139853 Dec 21 04:08:05.888707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-63c13865-6a38-4a7b-bd59-475908588b32 service neutron] 10.222.0.31 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1634507 Dec 21 04:08:05.902273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51238) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:06.017588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51244) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:06.028775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f2c53e3-510b-49ca-99ad-dd42addcf932 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=805ec728ac554cb1a0d3611f9c506eec&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1251800 Dec 21 04:08:06.030797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51246) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:06.080463 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd888da9b-98ad-49bd-a5e9-3f31922bf8b1', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.35', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'port_id': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 2584, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'mac_address': 'fa:16:3e:c5:47:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6da2216e-3241-4799-a038-75e352ad057d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:08:03Z', 'updated_at': '2021-12-21T04:08:03Z', 'revision_number': 0, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:40Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:06.096540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dbd0a5b-f5d6-409e-bf60-231211054bdb req-d4154d1d-6a72-4316-bd08-c460ec46b4b4 service neutron] 10.222.0.31 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1994770 Dec 21 04:08:06.126126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c9d1bf16-41e7-4d5c-b55c-1adb2cb6bc11 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/d888da9b-98ad-49bd-a5e9-3f31922bf8b1 HTTP/1.1" status: 200 len: 990 time: 0.1073778 Dec 21 04:08:06.159735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af5686ad-4448-48c6-8e14-0f7540d5091b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:06.163448 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61085750-8513-404b-a2d1-3938655e6e99 None None] The sync data for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 is: [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd888da9b-98ad-49bd-a5e9-3f31922bf8b1', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'floating_ip_address': '172.25.5.35', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'port_id': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 2584, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'mac_address': 'fa:16:3e:c5:47:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6da2216e-3241-4799-a038-75e352ad057d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:08:03Z', 'updated_at': '2021-12-21T04:08:03Z', 'revision_number': 0, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:40Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:08:06.186721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af5686ad-4448-48c6-8e14-0f7540d5091b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:06.365629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af5686ad-4448-48c6-8e14-0f7540d5091b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:06.368769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-af5686ad-4448-48c6-8e14-0f7540d5091b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:06.370136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-af5686ad-4448-48c6-8e14-0f7540d5091b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9feecb5f-c05f-466d-882e-5b4b440a2a04 HTTP/1.1" status: 204 len: 168 time: 0.3383451 Dec 21 04:08:06.379649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5686ad-4448-48c6-8e14-0f7540d5091b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9feecb5f-c05f-466d-882e-5b4b440a2a04,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:06.457397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d30f9fe-0618-453c-9092-87ef43ae1701 None None] New status for floating IP d888da9b-98ad-49bd-a5e9-3f31922bf8b1: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:08:07.130667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51298) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:07.219129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e6507427-b252-4740-be87-1e2fe4a0d6aa tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/d888da9b-98ad-49bd-a5e9-3f31922bf8b1 HTTP/1.1" status: 200 len: 992 time: 0.0872133 Dec 21 04:08:07.985858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51334) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:08.093476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1195338066-network', 'tenant_id': '9ca297f0d1fc4afc92d93f30ddc5c61c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:08.303062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Made reservation on behalf of 9ca297f0d1fc4afc92d93f30ddc5c61c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:08.305499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.315456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.449020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.538787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.557028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:08.576640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.576907 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Added segment 5246b0d5-be51-4fbd-bd3d-5b858f316c8d of type vlan for network d720eb29-79ba-4dbb-9b4e-aadb9e658ede Dec 21 04:08:08.618097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce56e19f-28f0-4d2f-ad33-212cfeb535ca,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:08.639973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.782563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.783640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:08.784313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:08.864338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] Pushing event updated for resources: {'Network': ['ID=d720eb29-79ba-4dbb-9b4e-aadb9e658ede,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:08.875894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d720eb29-79ba-4dbb-9b4e-aadb9e658ede details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:08.899691 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81d49fcb-bef7-49b4-aa2d-c80357f47f1d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.9522948 Dec 21 04:08:08.904264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51376) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:08.905234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Request body: {'subnet': {'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1195338066-subnet', 'tenant_id': '9ca297f0d1fc4afc92d93f30ddc5c61c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:09.028634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Made reservation on behalf of 9ca297f0d1fc4afc92d93f30ddc5c61c for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:09.031111 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:09.354859 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:09.429694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Checking segment: {'id': '5246b0d5-be51-4fbd-bd3d-5b858f316c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:09.430067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Network hostable DHCP agents. Network: d720eb29-79ba-4dbb-9b4e-aadb9e658ede, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:09.444005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Pushing event updated for resources: {'Subnet': ['ID=c89d12e6-9dc6-46e4-be88-39773c8bf0e9,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:09.565412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Network d720eb29-79ba-4dbb-9b4e-aadb9e658ede is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:09.644682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d720eb29-79ba-4dbb-9b4e-aadb9e658ede) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:09.649367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:09.653904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:09.667355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05c7ff68-5d17-419e-b689-f0790ad621e9 None None] Network d720eb29-79ba-4dbb-9b4e-aadb9e658ede requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:09.795835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4d5ebc53-742d-4e90-a85b-8c4fa807842b admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8944192 Dec 21 04:08:09.834639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8dd364e-94d6-40e2-ada9-8b8c939a5e0b None None] Network d720eb29-79ba-4dbb-9b4e-aadb9e658ede requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:10.022419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51418) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:10.220763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d50cd5f-3b39-46c4-84be-4b3d043b8e8a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.359783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d50cd5f-3b39-46c4-84be-4b3d043b8e8a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.479437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d50cd5f-3b39-46c4-84be-4b3d043b8e8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.528069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8d50cd5f-3b39-46c4-84be-4b3d043b8e8a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4cea563a477a42aa81b1a7454cca79ad&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5050659 Dec 21 04:08:10.532128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:10.553507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d50cd5f-3b39-46c4-84be-4b3d043b8e8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a7fda08-20bd-413d-b1ec-dcda17d12f9d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:10.628808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-205fae7b-91f3-400f-b263-9b6530c3410a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.651004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-205fae7b-91f3-400f-b263-9b6530c3410a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.817097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-205fae7b-91f3-400f-b263-9b6530c3410a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.820822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-205fae7b-91f3-400f-b263-9b6530c3410a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:10.822205 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-205fae7b-91f3-400f-b263-9b6530c3410a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2a7fda08-20bd-413d-b1ec-dcda17d12f9d HTTP/1.1" status: 204 len: 168 time: 0.2888150 Dec 21 04:08:10.831227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205fae7b-91f3-400f-b263-9b6530c3410a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a7fda08-20bd-413d-b1ec-dcda17d12f9d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:10.893475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51450) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:10.898875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-2136268156-network', 'tenant_id': 'd611efd4b4d845dcadbd07905d29755c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:11.005379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Made reservation on behalf of d611efd4b4d845dcadbd07905d29755c for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:11.008193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.018784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.127165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.200159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.228851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:11.250875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.257269 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Added segment 777fdc6a-7c45-4185-b4b1-76bfc3ac777e of type vlan for network 7ca76ad8-41ea-47bf-9bea-1770bf30eec4 Dec 21 04:08:11.338904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.360733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=078a0b47-dc13-48ca-8cd9-41e5cb51cd04,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:11.520257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.520257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:11.520257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.600706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] Pushing event updated for resources: {'Network': ['ID=7ca76ad8-41ea-47bf-9bea-1770bf30eec4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:11.629543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7ca76ad8-41ea-47bf-9bea-1770bf30eec4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:11.662438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1a87219-d0f9-46b4-8aaf-61ce1225265d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7677481 Dec 21 04:08:11.665087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51468) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:11.672374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Request body: {'subnet': {'network_id': '7ca76ad8-41ea-47bf-9bea-1770bf30eec4', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-2136268156-subnet', 'tenant_id': 'd611efd4b4d845dcadbd07905d29755c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:11.788508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Made reservation on behalf of d611efd4b4d845dcadbd07905d29755c for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:11.791273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:11.882228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:11.901575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-766d7237-54a6-4680-9e9e-972b7d25d6ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.027163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-766d7237-54a6-4680-9e9e-972b7d25d6ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.068812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.096473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-766d7237-54a6-4680-9e9e-972b7d25d6ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.142831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Checking segment: {'id': '777fdc6a-7c45-4185-b4b1-76bfc3ac777e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '7ca76ad8-41ea-47bf-9bea-1770bf30eec4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:12.143633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Network hostable DHCP agents. Network: 7ca76ad8-41ea-47bf-9bea-1770bf30eec4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:12.159546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d3de5758-ad72-494f-a505-4655da315158,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:12.171418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-766d7237-54a6-4680-9e9e-972b7d25d6ac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=fc52b52565604aec9d15ae517e59f952&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2847617 Dec 21 04:08:12.178211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51478) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:12.200301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-766d7237-54a6-4680-9e9e-972b7d25d6ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f718a005-22b7-4dfb-9be8-e351ed461b67,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:12.281448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Network 7ca76ad8-41ea-47bf-9bea-1770bf30eec4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:12.297773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-232fc82e-d2f0-42bc-9b1c-558858960b1a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.332769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-232fc82e-d2f0-42bc-9b1c-558858960b1a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.373941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7ca76ad8-41ea-47bf-9bea-1770bf30eec4) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:12.379454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:12.380049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.384465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e3c6c38-c680-4935-82fb-318be439146c None None] Network 7ca76ad8-41ea-47bf-9bea-1770bf30eec4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:12.528252 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8dbb8922-f88b-4a0a-864b-65147983d227 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8554649 Dec 21 04:08:12.537498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d5309e0-0ef2-4b18-8373-8cc747c057af None None] Network 7ca76ad8-41ea-47bf-9bea-1770bf30eec4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:12.540462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-232fc82e-d2f0-42bc-9b1c-558858960b1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.553784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-232fc82e-d2f0-42bc-9b1c-558858960b1a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:12.560705 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-232fc82e-d2f0-42bc-9b1c-558858960b1a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f718a005-22b7-4dfb-9be8-e351ed461b67 HTTP/1.1" status: 204 len: 168 time: 0.3792646 Dec 21 04:08:12.580865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232fc82e-d2f0-42bc-9b1c-558858960b1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f718a005-22b7-4dfb-9be8-e351ed461b67,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:13.247909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-e47f3978-6b31-4d91-a40c-d6cb7bbb7eea tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:13.255257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-e47f3978-6b31-4d91-a40c-d6cb7bbb7eea tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/networks?id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede HTTP/1.1" status: 200 len: 812 time: 0.1383748 Dec 21 04:08:13.273325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-693fc9aa-3f77-4305-9022-a7598ceb9b1c tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/quotas/9ca297f0d1fc4afc92d93f30ddc5c61c HTTP/1.1" status: 200 len: 375 time: 0.0108807 Dec 21 04:08:13.323822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-d8fcac61-902d-4960-b34a-a3606ddb1b8c tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0378008 Dec 21 04:08:13.422403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-e0218748-904f-4c48-86f3-e27967390b84 service neutron] 10.222.0.18 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912950 Dec 21 04:08:13.513176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-84647f81-b6df-45a1-972e-d493cd7d6ac2 service neutron] 10.222.0.18 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838330 Dec 21 04:08:13.789635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ceed45e-26cd-49f5-9fe1-13400893667d req-6d5068ff-1ee1-43eb-b680-7519671e51f1 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 210 time: 0.0337434 Dec 21 04:08:14.907091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8922ac4c-b09c-4ee6-8e1c-8939ce901417 req-64b4bf7d-0c65-4794-aae1-0f3d41d78494 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 210 time: 0.0390463 Dec 21 04:08:15.402762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:15.589465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-4312684'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:15.742702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Made reservation on behalf of 7a6e131a586d439f9d365a9c455fdf85 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:15.746324 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:15.782805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:15.907263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:15.999949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.014863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:16.047847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.047847 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Added segment 9a4df6d9-819d-4c98-a684-c7d905e866fb of type vlan for network 5535d150-fd3c-44d2-960f-a9c7f9855bbb Dec 21 04:08:16.053587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a91f9973-ad80-4ae2-b6b8-7d3c903a6a67 req-66e009bf-259a-4c19-8616-30f3bb37765b tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 210 time: 0.0626297 Dec 21 04:08:16.087553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ea8f7522-588b-4eb4-8296-26f22a7536fc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:16.121802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.251182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.257610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:16.258293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.328474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Pushing event updated for resources: {'Network': ['ID=5535d150-fd3c-44d2-960f-a9c7f9855bbb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:16.339557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5535d150-fd3c-44d2-960f-a9c7f9855bbb details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:16.395221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e8400839-5cf5-4a15-b8f6-fc972f13fb4d tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 796 time: 0.9906027 Dec 21 04:08:16.656130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51632) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:16.660928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Request body: {'port': {'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb', 'binding:host_id': 'n-h1-822053-11', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-190469271'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:16.840370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Made reservation on behalf of 9d03b3f898704d25a8981baf46cf9354 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:16.844965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.854424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-e0207536-7687-4039-bc03-c59cf362cfaf tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:16.854981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:16.856687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-e0207536-7687-4039-bc03-c59cf362cfaf tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.54 "GET /v2.0/networks?id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede HTTP/1.1" status: 200 len: 812 time: 0.1946759 Dec 21 04:08:16.880533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Request body: {'port': {'device_id': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede', 'admin_state_up': True, 'tenant_id': '9ca297f0d1fc4afc92d93f30ddc5c61c'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:17.000597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.062682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.098795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d8655b0-4d36-424f-92b7-2cdb179c668c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:17.114665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:17.194134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Made reservation on behalf of 9ca297f0d1fc4afc92d93f30ddc5c61c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:17.198528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.266361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76891fc7-7fb1-4d59-8dad-e0406b909ad0 req-2fcbbe33-eb39-4b44-a387-67566c10e6e1 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 210 time: 0.0633111 Dec 21 04:08:17.392618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Allocated IP 172.20.0.2 (d720eb29-79ba-4dbb-9b4e-aadb9e658ede/c89d12e6-9dc6-46e4-be88-39773c8bf0e9/721def25-5a4e-4a17-8cc8-1cd9069fa724) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:17.474605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:17.485030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.562897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.606881 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.680638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=68a1c853-fa6b-4a29-a882-1e0e2db1ed0f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:17.691851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Checking segment: {'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:17.692217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Network hostable DHCP agents. Network: 5535d150-fd3c-44d2-960f-a9c7f9855bbb, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:17.701195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.744583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51652) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:17.782663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Network 5535d150-fd3c-44d2-960f-a9c7f9855bbb is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:17.783366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Network d720eb29-79ba-4dbb-9b4e-aadb9e658ede is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:17.792708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:17.801775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:17.885091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5535d150-fd3c-44d2-960f-a9c7f9855bbb) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:17.889316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:17.894604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-feff56d3-5ebe-4a22-98a0-c82c3661def5 None None] Network 5535d150-fd3c-44d2-960f-a9c7f9855bbb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:17.901294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:17.911318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:17.926152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:17.926388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:17.926636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:17.938355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Pushing event updated for resources: {'Port': ['ID=721def25-5a4e-4a17-8cc8-1cd9069fa724,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:17.953430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:17.953821 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:17.954174 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 2 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.001845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.002447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.002973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.008073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.008592 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.009146 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 3 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.060328 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4af89f83-ddf0-493b-a3b5-f757d3997fc9 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1856787 Dec 21 04:08:18.087883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Request body: {'port': {'device_id': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:18.188638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.210896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.211817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.212319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.220802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.221491 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.222051 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 4 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.272202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.273211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.273722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.296520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.298750 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.304816 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 5 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.379453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.379903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.380331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.420622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.421060 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.425002 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 6 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.445834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.446104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.446585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.464902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.464902 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.482428 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 7 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.513512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed17248c-fa49-4d60-8336-c4fc082192b2 req-f9547b80-c70a-4b06-a6b0-be9f39aa0b15 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:18.515059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed17248c-fa49-4d60-8336-c4fc082192b2 req-f9547b80-c70a-4b06-a6b0-be9f39aa0b15 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 931 time: 0.1320543 Dec 21 04:08:18.520156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.520493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.520826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.545695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.546054 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.548049 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 8 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.570236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.570577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.570916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.587772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 721def25-5a4e-4a17-8cc8-1cd9069fa724 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:18.591820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.592202 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.596023 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 9 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.597521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.623068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed17248c-fa49-4d60-8336-c4fc082192b2 req-e0daa144-ce2f-4a36-a8d5-b159f00dc936 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977757 Dec 21 04:08:18.626420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Transition to ACTIVE for port object 721def25-5a4e-4a17-8cc8-1cd9069fa724 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:08:18.630820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.630820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.630820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.636501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.636824 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.637857 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 10 to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f Dec 21 04:08:18.673113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.673462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.673798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.682440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.682773 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:18.683184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.747230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.788938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.809605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] For port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:18.809969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempted to set empty binding levels {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 21 04:08:18.840508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Pushing event updated for resources: {'Port': ['ID=721def25-5a4e-4a17-8cc8-1cd9069fa724,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:18.874685 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.923104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:18.924187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:18.939220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Attempting to bind port 721def25-5a4e-4a17-8cc8-1cd9069fa724 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:18.940140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Attempting to bind port 721def25-5a4e-4a17-8cc8-1cd9069fa724 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '5246b0d5-be51-4fbd-bd3d-5b858f316c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:18.940673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Attempting to bind port 721def25-5a4e-4a17-8cc8-1cd9069fa724 on network d720eb29-79ba-4dbb-9b4e-aadb9e658ede {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.946201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Port 721def25-5a4e-4a17-8cc8-1cd9069fa724 on network d720eb29-79ba-4dbb-9b4e-aadb9e658ede not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:18.947301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Attempting to bind port 721def25-5a4e-4a17-8cc8-1cd9069fa724 on network d720eb29-79ba-4dbb-9b4e-aadb9e658ede {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:18.952245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 7, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:18.952807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Checking segment: {'id': '5246b0d5-be51-4fbd-bd3d-5b858f316c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:18.953394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Bound using segment: {'id': '5246b0d5-be51-4fbd-bd3d-5b858f316c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:18.953989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Bound port: 721def25-5a4e-4a17-8cc8-1cd9069fa724, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5246b0d5-be51-4fbd-bd3d-5b858f316c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:18.954526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.068903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=68a1c853-fa6b-4a29-a882-1e0e2db1ed0f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:19.069635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] For port 721def25-5a4e-4a17-8cc8-1cd9069fa724, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:19.081007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] For port 721def25-5a4e-4a17-8cc8-1cd9069fa724, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724,segment=NetworkSegment(5246b0d5-be51-4fbd-bd3d-5b858f316c8d),segment_id=5246b0d5-be51-4fbd-bd3d-5b858f316c8d)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:19.112688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d8145680-56a0-4475-8619-49419ab9e884 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 980 time: 2.4568574 Dec 21 04:08:19.116004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:19.234710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.288246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Deleting port 8e8edf66-71e6-4265-b442-7de4ff8867d4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:19.288802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.320830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:19.322530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.329436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] 10.222.0.54 "PUT /v2.0/ports/721def25-5a4e-4a17-8cc8-1cd9069fa724 HTTP/1.1" status: 200 len: 1092 time: 1.2487319 Dec 21 04:08:19.337034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'tag': '721def25-5a4e-4a17-8cc8-1cd9069fa724'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:19.339687 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec6619ed-fd61-419d-bd64-28be6df59d79" -d '{"events": [{"name": "network-changed", "server_uuid": "aed7bec6-e3e9-4eba-a153-59ca6b3c3796", "tag": "721def25-5a4e-4a17-8cc8-1cd9069fa724"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:19.401415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] For port 8e8edf66-71e6-4265-b442-7de4ff8867d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8e8edf66-71e6-4265-b442-7de4ff8867d4,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:19.401878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.411338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Deleting port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:19.411960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.419393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Calling delete_port for 8e8edf66-71e6-4265-b442-7de4ff8867d4 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:19.513901 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18ac8454-6f07-4b5c-85e0-b44057f2f16c x-openstack-request-id: req-18ac8454-6f07-4b5c-85e0-b44057f2f16c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:19.514204 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aed7bec6-e3e9-4eba-a153-59ca6b3c3796", "tag": "721def25-5a4e-4a17-8cc8-1cd9069fa724", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:19.517050 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-18ac8454-6f07-4b5c-85e0-b44057f2f16c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:19.517050 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'tag': '721def25-5a4e-4a17-8cc8-1cd9069fa724', 'status': 'completed', 'code': 200} Dec 21 04:08:19.528243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Pushing event updated for resources: {'Port': ['ID=721def25-5a4e-4a17-8cc8-1cd9069fa724,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:19.576362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.577263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.577618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.578712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.579086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.579986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.580461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.580819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.581162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.581485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.582346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.582673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.583034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8e4b5b6-38c7-4c02-874b-aa56b09e3283 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.606042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] For port 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f, host n-h1-822053-11, got binding levels [] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:19.606466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.632606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6619ed-fd61-419d-bd64-28be6df59d79 req-6c08cd39-23a4-481b-a15f-45fcd5c6802e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:19.634141 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ec6619ed-fd61-419d-bd64-28be6df59d79 req-6c08cd39-23a4-481b-a15f-45fcd5c6802e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 1095 time: 0.1172104 Dec 21 04:08:19.635053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Calling delete_port for 68a1c853-fa6b-4a29-a882-1e0e2db1ed0f owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:19.777620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.820848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Pushing event deleted for resources: {'Port': ['ID=8e8edf66-71e6-4265-b442-7de4ff8867d4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:19.841978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b0d8d313-e9e3-4e79-897f-5be4318162fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:19.849342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6619ed-fd61-419d-bd64-28be6df59d79 req-6630f188-b6e1-4dab-b31e-d68ac4ddd649 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:19.850947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ec6619ed-fd61-419d-bd64-28be6df59d79 req-6630f188-b6e1-4dab-b31e-d68ac4ddd649 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1411912 Dec 21 04:08:19.877689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.878369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.879558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.880072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.880575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.885147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.885711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.886219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.887011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.887520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.890878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.890878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.890878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:19.962200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2480b9b0-56c5-4120-b8ce-fdd60a428072 req-8e5e01be-58d7-4b73-b8c3-fcc5ae73aebf tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:19.964649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2480b9b0-56c5-4120-b8ce-fdd60a428072 req-8e5e01be-58d7-4b73-b8c3-fcc5ae73aebf tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 943 time: 0.2296951 Dec 21 04:08:19.988468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6619ed-fd61-419d-bd64-28be6df59d79 req-43224a36-158f-4d6a-8392-0f7584c5664a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:19.992869 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ec6619ed-fd61-419d-bd64-28be6df59d79 req-43224a36-158f-4d6a-8392-0f7584c5664a service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1328962 Dec 21 04:08:19.994493 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:20.036041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event deleted for resources: {'Port': ['ID=68a1c853-fa6b-4a29-a882-1e0e2db1ed0f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:20.043628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:20.047913 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aabc14dd-0c3b-406e-bcc2-da471f6775d5 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "DELETE /v2.0/ports/68a1c853-fa6b-4a29-a882-1e0e2db1ed0f HTTP/1.1" status: 204 len: 168 time: 0.9306788 Dec 21 04:08:20.050074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51694) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:20.095019 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-97811841-a2fb-4b81-89dd-5854eab6cc1a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:08:20.096526 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-97811841-a2fb-4b81-89dd-5854eab6cc1a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "GET /v2.0/ports/68a1c853-fa6b-4a29-a882-1e0e2db1ed0f HTTP/1.1" status: 404 len: 333 time: 0.0452008 Dec 21 04:08:20.100201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51696) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:20.103030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d16d9c2-0701-4506-9c5b-477baabd332e req-92e41d0d-02e7-44c6-8c31-64a5e67177bb tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:20.104824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d16d9c2-0701-4506-9c5b-477baabd332e req-92e41d0d-02e7-44c6-8c31-64a5e67177bb tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 945 time: 0.2731194 Dec 21 04:08:20.105084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Request body: {'port': {'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1991938137'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:20.116859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2480b9b0-56c5-4120-b8ce-fdd60a428072 req-70715386-cbb5-4cc5-822a-2dfc2d83a7cd tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1449101 Dec 21 04:08:20.193478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-0e0e48ad-50d1-441a-8f4d-5151fbe63b7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:20.197050 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-0e0e48ad-50d1-441a-8f4d-5151fbe63b7e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 1095 time: 0.1109104 Dec 21 04:08:20.267432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-5f170a54-0f30-43d6-9243-c5e0f95f5c32 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724 HTTP/1.1" status: 200 len: 217 time: 0.0534570 Dec 21 04:08:20.268703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Made reservation on behalf of 9d03b3f898704d25a8981baf46cf9354 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:20.271308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:20.324026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d16d9c2-0701-4506-9c5b-477baabd332e req-01cfd82b-36ce-4d64-9ac2-4f12b5f7cc06 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2060599 Dec 21 04:08:20.326713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:20.331233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port d55e7adf-63aa-4a17-a613-0731c293ae01 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:20.396211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bee782-dd7e-417d-ae10-c5c548087436 req-60ad7b45-8042-4b92-a242-f63e2d8aab90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:20.397679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-60ad7b45-8042-4b92-a242-f63e2d8aab90 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c89d12e6-9dc6-46e4-be88-39773c8bf0e9 HTTP/1.1" status: 200 len: 852 time: 0.1206245 Dec 21 04:08:20.449494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-cbe3ccd8-a082-4cda-aafb-8ef190256215 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406122 Dec 21 04:08:20.611613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Router 1cfcc743-8714-4e30-ac55-8bea218057cc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:08:20.962076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:20.987335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-4b876381-5231-40b5-8ad6-fa9a1c92c162 service neutron] 10.222.0.54 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5192654 Dec 21 04:08:21.095386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:08:21.117031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-780709da-8750-44ca-8116-35c574492ff2 admin admin] 10.222.0.18 "PUT /v2.0/routers/1cfcc743-8714-4e30-ac55-8bea218057cc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3557906 Dec 21 04:08:21.117031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51712) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:21.117284 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] Sync routers for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:08:21.117758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-52bee782-dd7e-417d-ae10-c5c548087436 req-94de4080-f9da-4b0f-8672-7667db4f1b08 service neutron] 10.222.0.54 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1083405 Dec 21 04:08:21.120084 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:21.120628 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:21.145382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.228672 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:21.243933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Network 5535d150-fd3c-44d2-960f-a9c7f9855bbb is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:21.248750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=d55e7adf-63aa-4a17-a613-0731c293ae01,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:21.252014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:21.256099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:21.257244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:21.257939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.300408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.359738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d8437ab-1e60-4d81-af84-9b472e26e64e req-3edd09b3-4492-46f5-bbaf-1354ee7c13be tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:21.361586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d8437ab-1e60-4d81-af84-9b472e26e64e req-3edd09b3-4492-46f5-bbaf-1354ee7c13be tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 943 time: 0.1325972 Dec 21 04:08:21.363600 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9cf06b7d-ce8f-4f7d-ba3f-a3a055ff80ed tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.2621241 Dec 21 04:08:21.365852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51722) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:21.371892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:21.472884 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T04:08:19Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:21.489515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.495769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d8437ab-1e60-4d81-af84-9b472e26e64e req-bb5d034f-9177-46f1-84a8-4d9e2ebfea4c tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891922 Dec 21 04:08:21.514010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] Checking router: 1cfcc743-8714-4e30-ac55-8bea218057cc for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:08:21.522131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.530906 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] Routers {'1cfcc743-8714-4e30-ac55-8bea218057cc'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:21.531817 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:07:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1cfcc743-8714-4e30-ac55-8bea218057cc'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:21.540675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0463c418-ca76-4ba3-bc1d-e8de714f4388 req-22ee27aa-84cb-41cd-b23f-38441cc96c67 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:21.542469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0463c418-ca76-4ba3-bc1d-e8de714f4388 req-22ee27aa-84cb-41cd-b23f-38441cc96c67 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 945 time: 0.0964222 Dec 21 04:08:21.633856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0463c418-ca76-4ba3-bc1d-e8de714f4388 req-af6b3d47-108d-4d41-878e-d3c6756cea09 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759518 Dec 21 04:08:21.671098 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] Set router 1cfcc743-8714-4e30-ac55-8bea218057cc gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:21.697278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Deleting port 704e5770-5155-4bfd-9735-40b18e6e5e89 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:21.699143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.746562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-9bbb6604-9fab-4fcc-bf4e-5343706f6e3e tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:21.748158 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-9bbb6604-9fab-4fcc-bf4e-5343706f6e3e tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 945 time: 0.2074080 Dec 21 04:08:21.786677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port d55e7adf-63aa-4a17-a613-0731c293ae01 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:21.789063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] For port 704e5770-5155-4bfd-9735-40b18e6e5e89, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=704e5770-5155-4bfd-9735-40b18e6e5e89,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:21.790043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.798732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.806538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Calling delete_port for 704e5770-5155-4bfd-9735-40b18e6e5e89 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:21.851236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.901565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=d55e7adf-63aa-4a17-a613-0731c293ae01,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:21.921631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T04:08:19Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:21.944251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Deleting port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:21.944642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:21.952396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55e81540-72f7-4c44-8f0f-854efcc60010 None None] The sync data for ids ['1cfcc743-8714-4e30-ac55-8bea218057cc'] in n-d-822053-11 is: [{'id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'name': 'tempest-TaggedBootDevicesTest_v242-663268317-router', 'tenant_id': '2e28414564544bb283304990bb7b8542', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74'}], 'enable_snat': True}, 'gw_port_id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:18Z', 'updated_at': '2021-12-21T04:08:19Z', 'revision_number': 5, 'project_id': '2e28414564544bb283304990bb7b8542', 'gw_port': {'id': '704e5770-5155-4bfd-9735-40b18e6e5e89', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:f4:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1cfcc743-8714-4e30-ac55-8bea218057cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1398, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:19Z', 'updated_at': '2021-12-21T03:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:08:21.963266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:21.963486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:21.963822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:21.977933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:21.990346 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:21.990346 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 2 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.025059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.025396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.025790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.033312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.033644 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.036526 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 3 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.064690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.065027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.065360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.067931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.068314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] For port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:22.068672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.079064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.079403 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.082581 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 4 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.085277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Calling delete_port for 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:22.104623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Pushing event deleted for resources: {'Port': ['ID=704e5770-5155-4bfd-9735-40b18e6e5e89,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:22.105660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.106002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.106339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.115872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a951e402-b6e5-4d02-aaf1-bdf04cba1269 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:22.146868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.147480 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.149004 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 5 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.166531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.174516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.174849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.175210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.183874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.183874 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.185186 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 6 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.204811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.205145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.205476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.211182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.211495 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.211881 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 7 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.247607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.247949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.248282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.260203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.260536 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.262987 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 8 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.278280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.280392 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.291118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.291467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.291807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.299108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.299452 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.299850 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 9 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.314539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.315068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.315415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.320200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.320546 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.320949 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 10 to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 Dec 21 04:08:22.336266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:22.336603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:22.336937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:22.341729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:22.342067 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port d55e7adf-63aa-4a17-a613-0731c293ae01 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:22.342449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.356542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.389419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba', 'b5ef7827-00e7-4327-b7b1-fdbfa2289064', '1f9f5bfd-3e00-4da8-8aad-fdf621afc682'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:22.390696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event deleted for resources: {'Port': ['ID=1f9f5bfd-3e00-4da8-8aad-fdf621afc682,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:22.439243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['adb2727a-4661-46f5-a1a9-b11045316c51'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:22.465329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] No DVR routers for this DVR port 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:22.468632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.473923 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-30560fba-95b2-4e34-8961-520e46f3ce48 req-c02f6ecc-8cb7-493f-a509-8f79a23120c9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "DELETE /v2.0/ports/1f9f5bfd-3e00-4da8-8aad-fdf621afc682 HTTP/1.1" status: 204 len: 173 time: 0.7158718 Dec 21 04:08:22.495098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] For port d55e7adf-63aa-4a17-a613-0731c293ae01, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:22.495685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempted to set empty binding levels {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 21 04:08:22.496670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'name': 'network-vif-deleted', 'tag': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:22.499411 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f569b90-6501-4c4b-87a6-464fd5670ef0" -d '{"events": [{"server_uuid": "87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf", "name": "network-vif-deleted", "tag": "1f9f5bfd-3e00-4da8-8aad-fdf621afc682"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:22.502514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.503411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1cfcc743-8714-4e30-ac55-8bea218057cc {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:08:22.512847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.516354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ec77276-974f-46f0-8e07-e4bfc6c08c48 admin admin] 10.222.0.18 "DELETE /v2.0/routers/1cfcc743-8714-4e30-ac55-8bea218057cc HTTP/1.1" status: 204 len: 168 time: 1.4084892 Dec 21 04:08:22.516789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51742) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:22.578912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Deleting subnet 35ca07d8-d162-4205-9aec-69a6c9b94f03 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:22.583348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.618541 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81bc7b7c-f771-42b3-8446-9bc29a065c00 x-openstack-request-id: req-81bc7b7c-f771-42b3-8446-9bc29a065c00 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:22.618844 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf", "name": "network-vif-deleted", "tag": "1f9f5bfd-3e00-4da8-8aad-fdf621afc682", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:22.619146 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-81bc7b7c-f771-42b3-8446-9bc29a065c00 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:22.619531 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf', 'name': 'network-vif-deleted', 'tag': '1f9f5bfd-3e00-4da8-8aad-fdf621afc682', 'status': 'completed', 'code': 200} Dec 21 04:08:22.634425 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.655037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-584c711c-e28d-41d8-bc21-ec63dffadc96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.712837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] In _notify_port_updated(), no bound segment for port d55e7adf-63aa-4a17-a613-0731c293ae01 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:08:22.714138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.714832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.716277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "PUT /v2.0/ports/d55e7adf-63aa-4a17-a613-0731c293ae01 HTTP/1.1" status: 200 len: 976 time: 1.3494451 Dec 21 04:08:22.725654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51750) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:22.745756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.797609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0ddb329-3b9a-4354-a938-5a9e96dd46ef req-4ffc0a11-2144-4967-9e3a-680b9dd0a09c tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=87c5a3cf-6e7f-4a17-a33b-c23d9b25f1bf HTTP/1.1" status: 200 len: 210 time: 0.0434880 Dec 21 04:08:22.818772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dee71cb-d085-43ed-8bae-7ab59ca35b87 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=d55e7adf-63aa-4a17-a613-0731c293ae01,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:22.841361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf3e044-5c2f-4684-a0bd-eae9f2238d74 req-cea4a179-092b-4ed0-aa84-5bf5fc91cc2b tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.843014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cf3e044-5c2f-4684-a0bd-eae9f2238d74 req-cea4a179-092b-4ed0-aa84-5bf5fc91cc2b tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 943 time: 0.1590114 Dec 21 04:08:22.889874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:22.923510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cf3e044-5c2f-4684-a0bd-eae9f2238d74 req-3b070e39-bb45-42e4-b8b9-da682af9fede tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710826 Dec 21 04:08:22.957733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.958430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.958870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.959410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.959874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.960335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.963942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.964504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.965045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.965578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.966068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.966689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.967174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.967638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.968162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.968650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.969104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.969562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.970035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.970512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.971046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.971568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.972043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:22.975299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5029df33-656c-4621-9972-4f9917e53a4d tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 20641 time: 0.2484803 Dec 21 04:08:22.979943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:22.983865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.086185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8e8edf66-71e6-4265-b442-7de4ff8867d4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:23.107217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8e8edf66-71e6-4265-b442-7de4ff8867d4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:23.107570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8e8edf66-71e6-4265-b442-7de4ff8867d4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:23.108391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 704e5770-5155-4bfd-9735-40b18e6e5e89 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:23.117991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Deleting port d55e7adf-63aa-4a17-a613-0731c293ae01 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:23.118338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.127052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.128344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 704e5770-5155-4bfd-9735-40b18e6e5e89 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:23.129377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 704e5770-5155-4bfd-9735-40b18e6e5e89 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:23.166658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.170740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/35ca07d8-d162-4205-9aec-69a6c9b94f03 HTTP/1.1" status: 204 len: 168 time: 0.6530931 Dec 21 04:08:23.173189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51758) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:23.174945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eae1b840-8ada-48a7-bcde-2b8e0396c539 None None] Network 4915ee69-a87c-4f15-b553-d1750c9a5a88 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:23.181836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932eaeca-b708-4e95-8c03-29b09b40b279 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=35ca07d8-d162-4205-9aec-69a6c9b94f03,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:23.200828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] For port d55e7adf-63aa-4a17-a613-0731c293ae01, host n-h1-822053-11, got binding levels [] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:23.201187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.215572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Calling delete_port for d55e7adf-63aa-4a17-a613-0731c293ae01 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:23.253150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.289900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.331212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Deleting port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:23.331212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.370898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.399600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] DHCP port deletion for 4915ee69-a87c-4f15-b553-d1750c9a5a88 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:23.404585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event deleted for resources: {'Port': ['ID=d55e7adf-63aa-4a17-a613-0731c293ae01,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:23.411873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.416734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2a527e46-8705-4581-b3f2-947b2e81ef4a tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "DELETE /v2.0/ports/d55e7adf-63aa-4a17-a613-0731c293ae01 HTTP/1.1" status: 204 len: 168 time: 0.4354179 Dec 21 04:08:23.419476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] For port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:23.419857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.431579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51762) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:23.433491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Calling delete_port for 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:23.480872 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-40b37a28-8a1c-43ea-bdda-2c0aed153c14 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:08:23.481124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Deleting port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:23.481124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.481342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-40b37a28-8a1c-43ea-bdda-2c0aed153c14 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "GET /v2.0/ports/d55e7adf-63aa-4a17-a613-0731c293ae01 HTTP/1.1" status: 404 len: 333 time: 0.0286007 Dec 21 04:08:23.484112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51764) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:23.492328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1452709757', 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:23.546585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] For port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,segment=NetworkSegment(127c42f2-9c42-4f96-a788-402d23fe8d05),segment_id=127c42f2-9c42-4f96-a788-402d23fe8d05)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:23.547011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.560780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Calling delete_port for 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:23.667996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Made reservation on behalf of 9d03b3f898704d25a8981baf46cf9354 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:23.674012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.682456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.686839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.714740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Pushing event deleted for resources: {'Port': ['ID=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:23.716930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] No DVR routers for this DVR port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:23.723191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] No DVR routers for this DVR port 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:23.723602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port ba34390d-d9bf-4922-a829-2db9fb30c77b yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:23.726617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.727286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Pushing event deleted for resources: {'Port': ['ID=24c1f54d-a869-4a6c-9fb2-d52fe3ce828e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.731878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8925ef-0810-4db9-b211-9b7ed345248b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:08:23.855276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.866590 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:08:23.896733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4915ee69-a87c-4f15-b553-d1750c9a5a88']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:23.946514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '127c42f2-9c42-4f96-a788-402d23fe8d05') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:23.946819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '127c42f2-9c42-4f96-a788-402d23fe8d05') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:23.987514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:23.992879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 721def25-5a4e-4a17-8cc8-1cd9069fa724 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:08:24.020878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.030611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.035584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Releasing vlan 131 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:24.036255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:24.038000 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:24.136562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302c6ddd-83b6-45fe-9603-ef73994ede32 req-71d60ac5-bda8-429f-a1b5-4f7405a932ea tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:24.138157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-302c6ddd-83b6-45fe-9603-ef73994ede32 req-71d60ac5-bda8-429f-a1b5-4f7405a932ea tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 943 time: 0.1253934 Dec 21 04:08:24.162201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 721def25-5a4e-4a17-8cc8-1cd9069fa724, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724,segment=NetworkSegment(5246b0d5-be51-4fbd-bd3d-5b858f316c8d),segment_id=5246b0d5-be51-4fbd-bd3d-5b858f316c8d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:24.177056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.191693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.196244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '721def25-5a4e-4a17-8cc8-1cd9069fa724', 'network_id': 'd720eb29-79ba-4dbb-9b4e-aadb9e658ede', 'port_id': '721def25-5a4e-4a17-8cc8-1cd9069fa724', 'mac_address': 'fa:16:3e:3e:4d:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c89d12e6-9dc6-46e4-be88-39773c8bf0e9', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:08:24.202547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.207776 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] 10.222.0.18 "DELETE /v2.0/networks/4915ee69-a87c-4f15-b553-d1750c9a5a88 HTTP/1.1" status: 204 len: 168 time: 1.0312495 Dec 21 04:08:24.212412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51784) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:24.241096 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.258342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-302c6ddd-83b6-45fe-9603-ef73994ede32 req-d4b9ce9e-ee55-45e6-9dd1-1bb8879fe5fb tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092410 Dec 21 04:08:24.297417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 721def25-5a4e-4a17-8cc8-1cd9069fa724 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:24.319321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 721def25-5a4e-4a17-8cc8-1cd9069fa724, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724,segment=NetworkSegment(5246b0d5-be51-4fbd-bd3d-5b858f316c8d),segment_id=5246b0d5-be51-4fbd-bd3d-5b858f316c8d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:24.333901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34de6b90-d999-46ef-b28b-0917b3666f93 admin admin] Pushing event deleted for resources: {'Network': ['ID=4915ee69-a87c-4f15-b553-d1750c9a5a88,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:24.364460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Network 5535d150-fd3c-44d2-960f-a9c7f9855bbb is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:24.371668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:24.374111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:24.375315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:24.375919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.413971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=ba34390d-d9bf-4922-a829-2db9fb30c77b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:24.416662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.471235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=721def25-5a4e-4a17-8cc8-1cd9069fa724,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:24.508695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b22e1905-a80b-412f-ba5f-4754d1de5622 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.0204086 Dec 21 04:08:24.508896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51790) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:24.553113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c081dbc-829a-475f-8dbc-8b1edf5c31e2 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:24.554557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4c081dbc-829a-475f-8dbc-8b1edf5c31e2 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "GET /v2.0/ports/ba34390d-d9bf-4922-a829-2db9fb30c77b HTTP/1.1" status: 200 len: 955 time: 0.0446582 Dec 21 04:08:24.557656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51792) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:24.668634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Deleting port ba34390d-d9bf-4922-a829-2db9fb30c77b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:24.668964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.715452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['721def25-5a4e-4a17-8cc8-1cd9069fa724'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:24.755530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.772142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Calling delete_port for ba34390d-d9bf-4922-a829-2db9fb30c77b owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:24.827743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:24.968262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.051634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.054676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:25.076902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:25.077520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24c1f54d-a869-4a6c-9fb2-d52fe3ce828e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:25.082347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.116627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event deleted for resources: {'Port': ['ID=ba34390d-d9bf-4922-a829-2db9fb30c77b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:25.129990 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.135783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-282dee7c-b7e1-4de6-9f9c-9ed703271734 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "DELETE /v2.0/ports/ba34390d-d9bf-4922-a829-2db9fb30c77b HTTP/1.1" status: 204 len: 168 time: 0.5744801 Dec 21 04:08:25.136038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51802) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:25.161727 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-9dcfd2df-fd9f-4c56-af76-0aaa31879687 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:08:25.163998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9dcfd2df-fd9f-4c56-af76-0aaa31879687 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "GET /v2.0/ports/ba34390d-d9bf-4922-a829-2db9fb30c77b HTTP/1.1" status: 404 len: 333 time: 0.0268061 Dec 21 04:08:25.167696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51804) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:25.173074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Request body: {'port': {'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-715580845'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:25.213057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Deleting port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:25.213673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.300907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Made reservation on behalf of 9d03b3f898704d25a8981baf46cf9354 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:25.300907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.330551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:25.331514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] For port 8ed4a0fb-cadd-405a-b52d-e0154cea65e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:25.331883 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.345460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Calling delete_port for 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:25.493087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77cab5a-090f-472c-8d33-b4cd24a574dd req-30b4d6a1-6cbd-4e39-b999-0f55912075fe tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:25.494714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e77cab5a-090f-472c-8d33-b4cd24a574dd req-30b4d6a1-6cbd-4e39-b999-0f55912075fe tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 944 time: 0.1196048 Dec 21 04:08:25.637548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.652868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.667353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e77cab5a-090f-472c-8d33-b4cd24a574dd req-54e53573-b786-4ef4-903e-9f2e2a0815bf tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071095 Dec 21 04:08:25.700595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Pushing event deleted for resources: {'Port': ['ID=8ed4a0fb-cadd-405a-b52d-e0154cea65e0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:25.750249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.817893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.909498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Network 5535d150-fd3c-44d2-960f-a9c7f9855bbb is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:25.913182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:25.921267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:25.921851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:25.922461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.943459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:25.989624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:25.994205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 721def25-5a4e-4a17-8cc8-1cd9069fa724 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:08:26.006327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0c54c1a7-afb4-4eb3-9566-8a69cea2ab91 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 0.8342879 Dec 21 04:08:26.007073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51824) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:26.024890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:26.119534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 721def25-5a4e-4a17-8cc8-1cd9069fa724 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:08:26.119808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.125281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 721def25-5a4e-4a17-8cc8-1cd9069fa724 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:26.130006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.272132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.344707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '721def25-5a4e-4a17-8cc8-1cd9069fa724'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:26.349225 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7876f84e-7870-41cc-9af3-2b42c6f67316" -d '{"events": [{"server_uuid": "aed7bec6-e3e9-4eba-a153-59ca6b3c3796", "name": "network-vif-plugged", "status": "completed", "tag": "721def25-5a4e-4a17-8cc8-1cd9069fa724"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:26.357265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Router 615492c6-acfa-4198-96eb-9577071a4255 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:08:26.374568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 721def25-5a4e-4a17-8cc8-1cd9069fa724, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724,segment=NetworkSegment(5246b0d5-be51-4fbd-bd3d-5b858f316c8d),segment_id=5246b0d5-be51-4fbd-bd3d-5b858f316c8d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:26.375933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] device_id is not set on port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:26.388784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.422631 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f611737-e264-48dd-92de-57a22fee42cb x-openstack-request-id: req-0f611737-e264-48dd-92de-57a22fee42cb {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:26.422921 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aed7bec6-e3e9-4eba-a153-59ca6b3c3796", "name": "network-vif-plugged", "status": "completed", "tag": "721def25-5a4e-4a17-8cc8-1cd9069fa724", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:26.423204 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0f611737-e264-48dd-92de-57a22fee42cb {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:26.423603 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '721def25-5a4e-4a17-8cc8-1cd9069fa724', 'code': 200} Dec 21 04:08:26.503345 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.503345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:26.514919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:08:26.521369 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cd371cab-edbb-43b1-980d-b566b2c99899 admin admin] 10.222.0.18 "PUT /v2.0/routers/615492c6-acfa-4198-96eb-9577071a4255/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3059425 Dec 21 04:08:26.523701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51836) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:26.604023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:26.604427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1f9f5bfd-3e00-4da8-8aad-fdf621afc682 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:26.606698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] Sync routers for ids ['615492c6-acfa-4198-96eb-9577071a4255'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:08:26.616143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=721def25-5a4e-4a17-8cc8-1cd9069fa724,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:26.623703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f8d8c89-e578-42e1-ab33-273228eb4907 req-38f6c3ac-6b0d-4e37-8310-68b05c5a0a08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:26.625230 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9f8d8c89-e578-42e1-ab33-273228eb4907 req-38f6c3ac-6b0d-4e37-8310-68b05c5a0a08 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 1097 time: 0.0771902 Dec 21 04:08:26.626748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] Routers {'615492c6-acfa-4198-96eb-9577071a4255'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:26.627821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['615492c6-acfa-4198-96eb-9577071a4255'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:26.650950 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.714817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9f8d8c89-e578-42e1-ab33-273228eb4907 req-fbc3f24e-6f55-4a0b-a6c3-4f1e412bda6c service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824521 Dec 21 04:08:26.752434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:26.797439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] Set router 615492c6-acfa-4198-96eb-9577071a4255 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:26.812104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:26.866389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:26.866848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:26.867412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:26.929301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:26.929803 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:26.938783 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 2 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:26.965963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:26.965963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:26.965963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:26.976600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-445832d0-b8b4-493e-858d-53e1921fe7c6 req-0b6c4ee2-9c7b-4960-8d9f-ee30f8940edb tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:26.978124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-445832d0-b8b4-493e-858d-53e1921fe7c6 req-0b6c4ee2-9c7b-4960-8d9f-ee30f8940edb tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1793125 Dec 21 04:08:26.990375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:26.990691 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:26.992080 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 3 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.025885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.054399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.054746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.055119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.098888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-445832d0-b8b4-493e-858d-53e1921fe7c6 req-66f9ca31-a739-4d97-8924-5a117bc2ac7f tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1094062 Dec 21 04:08:27.099930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.100500 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.101284 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 4 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.161901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.162278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.162592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.169722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.170071 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.171260 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 5 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.192390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.192706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.192996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.199994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.200337 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.201852 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 6 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.216917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Deleting port 24bebfec-6e4b-4f6f-a32a-ae160e20a465 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:27.217274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.236198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.236540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.236874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.251712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.252025 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.275831 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 7 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.304727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.305573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.305573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.318964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.319309 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.321118 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 8 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.352880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.353321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.353529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.362196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] For port 24bebfec-6e4b-4f6f-a32a-ae160e20a465, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=24bebfec-6e4b-4f6f-a32a-ae160e20a465,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:27.362562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.371464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.372121 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.373629 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 9 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.380925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Calling delete_port for 24bebfec-6e4b-4f6f-a32a-ae160e20a465 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:27.421854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.422498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.422843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.478069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.478451 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.480546 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempt 10 to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 Dec 21 04:08:27.488509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240'}], 'enable_snat': True}, 'gw_port_id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T04:08:25Z', 'revision_number': 5, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port': {'id': '24bebfec-6e4b-4f6f-a32a-ae160e20a465', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:91:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615492c6-acfa-4198-96eb-9577071a4255', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1444, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.240', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T03:56:39Z', 'updated_at': '2021-12-21T03:56:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:27.510871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:27.510871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:27.510871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempting to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:27.520367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:27.520814 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Failed to bind port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on host n-h1-822053-11 for vnic_type normal using segments [{'id': '9a4df6d9-819d-4c98-a684-c7d905e866fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5535d150-fd3c-44d2-960f-a9c7f9855bbb'}] Dec 21 04:08:27.521401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.532278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] Checking router: 615492c6-acfa-4198-96eb-9577071a4255 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:08:27.553395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] Routers {'615492c6-acfa-4198-96eb-9577071a4255'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:27.553892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['615492c6-acfa-4198-96eb-9577071a4255'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:27.657702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] Set router 615492c6-acfa-4198-96eb-9577071a4255 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:27.671251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] For port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:27.671777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attempted to set empty binding levels {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 21 04:08:27.716040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T04:08:27Z', 'revision_number': 6, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:27.742384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8e90fbe-3d59-4455-b2bc-0f499be58956 None None] The sync data for ids ['615492c6-acfa-4198-96eb-9577071a4255'] in n-d-822053-11 is: [{'id': '615492c6-acfa-4198-96eb-9577071a4255', 'name': 'tempest-TaggedBootDevicesTest_v242-835603900-router', 'tenant_id': 'a5404da396354872bc7c319caf0d4bb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T03:56:37Z', 'updated_at': '2021-12-21T04:08:27Z', 'revision_number': 6, 'project_id': 'a5404da396354872bc7c319caf0d4bb2', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:08:27.780985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.827421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.834038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] In _notify_port_updated(), no bound segment for port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 on network 5535d150-fd3c-44d2-960f-a9c7f9855bbb {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:08:27.835256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:27.835964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.840713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:27.841368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "PUT /v2.0/ports/f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 HTTP/1.1" status: 200 len: 975 time: 1.8321419 Dec 21 04:08:27.880097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-199d48eb-ec8e-4097-a3fd-d7282d721f57 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:27.955205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b2bb37d-eda1-497a-8f03-4586ec41b497 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event updated for resources: {'Port': ['ID=f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:27.963636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:27.992072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Deleting port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:28.002283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.085178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Pushing event deleted for resources: {'Port': ['ID=24bebfec-6e4b-4f6f-a32a-ae160e20a465,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:28.095112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] For port f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8, host n-h1-822053-11, got binding levels [] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:28.095525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.109140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Calling delete_port for f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:28.131599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.133994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.246768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6269571-e11d-4d61-bfe2-93b03eca25b5 req-13aa5327-1e3e-47f3-8bde-445b155cb644 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:28.250070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6269571-e11d-4d61-bfe2-93b03eca25b5 req-13aa5327-1e3e-47f3-8bde-445b155cb644 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.0522211 Dec 21 04:08:28.286019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.286548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 615492c6-acfa-4198-96eb-9577071a4255 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:08:28.293201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.294381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d394ee3a-545e-4d6a-9207-6a42c4852dae admin admin] 10.222.0.18 "DELETE /v2.0/routers/615492c6-acfa-4198-96eb-9577071a4255 HTTP/1.1" status: 204 len: 168 time: 1.7695148 Dec 21 04:08:28.297345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:28.307160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6269571-e11d-4d61-bfe2-93b03eca25b5 req-bcb5c9a0-a44d-4226-ad22-0375622de7a6 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517199 Dec 21 04:08:28.347028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.379516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Pushing event deleted for resources: {'Port': ['ID=f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:28.385154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Deleting subnet f84907c1-819c-4ef4-9637-ca8b601c71e2 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:28.387404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.390540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-731d6097-464d-46d0-bd04-9f062f4b361f tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "DELETE /v2.0/ports/f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 HTTP/1.1" status: 204 len: 168 time: 0.5487790 Dec 21 04:08:28.393002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.393435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51884) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:28.442163 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.453195 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-2ae06161-b205-436e-ad44-91f2d7df9138 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:08:28.454659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2ae06161-b205-436e-ad44-91f2d7df9138 tempest-PortsAdminExtendedAttrsTestJSON-552174217 tempest-PortsAdminExtendedAttrsTestJSON-552174217-project-admin] 10.222.0.18 "GET /v2.0/ports/f1efbaf4-bb50-4ec3-aea5-1d4baf3beee8 HTTP/1.1" status: 404 len: 333 time: 0.0596507 Dec 21 04:08:28.458381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:28.549209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.580208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feae8126-a300-423c-80f7-d4b57fc0e8c5 req-938f6c0a-ddaa-43c9-9748-a333c5686905 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:28.590629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feae8126-a300-423c-80f7-d4b57fc0e8c5 req-938f6c0a-ddaa-43c9-9748-a333c5686905 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1860199 Dec 21 04:08:28.659254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.725779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.732798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feae8126-a300-423c-80f7-d4b57fc0e8c5 req-240e243b-92f5-4658-b576-85d1ada22aa3 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1404645 Dec 21 04:08:28.815634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f84907c1-819c-4ef4-9637-ca8b601c71e2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:28.817312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3410d74-0715-480e-9c23-f814aa4f4ca8 None None] Network 96d6a39e-5317-4fc0-b645-87386d7cd358 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:28.829552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.839681 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d50e5dc-0c3a-4434-b0f5-f100f05fb9b6 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/f84907c1-819c-4ef4-9637-ca8b601c71e2 HTTP/1.1" status: 204 len: 168 time: 0.5410414 Dec 21 04:08:28.841219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:28.874721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.911512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5535d150-fd3c-44d2-960f-a9c7f9855bbb']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:28.922473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a4df6d9-819d-4c98-a684-c7d905e866fb') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:28.922780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a4df6d9-819d-4c98-a684-c7d905e866fb') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:28.953408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:28.997588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.003482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.022452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:29.025321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.040008 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:29.043039 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:29.147484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:29.149002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Deleting port 523be078-57d7-4932-a770-82f71107ba1a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:29.149432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.191755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] DHCP port deletion for 96d6a39e-5317-4fc0-b645-87386d7cd358 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:29.195099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:29.195504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8ed4a0fb-cadd-405a-b52d-e0154cea65e0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:29.195946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bebfec-6e4b-4f6f-a32a-ae160e20a465 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:29.228435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] For port 523be078-57d7-4932-a770-82f71107ba1a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=523be078-57d7-4932-a770-82f71107ba1a,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:29.228914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.255509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72035237-dff9-49db-b71d-0a7667c555e2 req-c13bae16-bbfe-4604-879d-d4fe6a8e0292 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:29.262223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72035237-dff9-49db-b71d-0a7667c555e2 req-c13bae16-bbfe-4604-879d-d4fe6a8e0292 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 945 time: 0.0885155 Dec 21 04:08:29.262577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 24bebfec-6e4b-4f6f-a32a-ae160e20a465 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:29.262577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 24bebfec-6e4b-4f6f-a32a-ae160e20a465 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:29.272796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Calling delete_port for 523be078-57d7-4932-a770-82f71107ba1a owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:29.319319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72035237-dff9-49db-b71d-0a7667c555e2 req-15e2ea93-5119-46ef-8970-709e07cd71d9 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508819 Dec 21 04:08:29.320716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.328672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.336132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] 10.222.0.18 "DELETE /v2.0/networks/5535d150-fd3c-44d2-960f-a9c7f9855bbb HTTP/1.1" status: 204 len: 168 time: 0.8741732 Dec 21 04:08:29.351376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] Deleting port 523be078-57d7-4932-a770-82f71107ba1a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:29.352124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.365721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6afb7b6f-4955-4f88-b58b-60c573ae8821 tempest-PortsAdminExtendedAttrsTestJSON-544648580 tempest-PortsAdminExtendedAttrsTestJSON-544648580-project] Pushing event deleted for resources: {'Network': ['ID=5535d150-fd3c-44d2-960f-a9c7f9855bbb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:29.441965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] For port 523be078-57d7-4932-a770-82f71107ba1a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=523be078-57d7-4932-a770-82f71107ba1a,segment=NetworkSegment(72d09991-5ece-42f1-a216-688cf52e3396),segment_id=72d09991-5ece-42f1-a216-688cf52e3396)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:29.442709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.460023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] Calling delete_port for 523be078-57d7-4932-a770-82f71107ba1a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:29.500952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e85d8b-3aee-4535-a68a-d1a6a3fb46ec req-4abbb85a-1b8b-4203-8258-42443081d113 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:29.502737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4e85d8b-3aee-4535-a68a-d1a6a3fb46ec req-4abbb85a-1b8b-4203-8258-42443081d113 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.0881245 Dec 21 04:08:29.584739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4e85d8b-3aee-4535-a68a-d1a6a3fb46ec req-edfdd920-7731-4d01-b1ec-1a9ea70d94ae tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745766 Dec 21 04:08:29.696676 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.738130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] Pushing event deleted for resources: {'Port': ['ID=523be078-57d7-4932-a770-82f71107ba1a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:29.745556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-835afc28-1cd9-4d7a-9c26-85206864bfec None None] No DVR routers for this DVR port 523be078-57d7-4932-a770-82f71107ba1a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:29.838354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.866976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=523be078-57d7-4932-a770-82f71107ba1a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:29.867614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] No DVR routers for this DVR port 523be078-57d7-4932-a770-82f71107ba1a on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:29.959891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:29.989455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96d6a39e-5317-4fc0-b645-87386d7cd358']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:30.007454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '72d09991-5ece-42f1-a216-688cf52e3396') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:30.008155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '72d09991-5ece-42f1-a216-688cf52e3396') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:30.022916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.038136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.046378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:30.047341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:30.049273 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:30.077586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51930) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:30.216260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.222339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.229648 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] 10.222.0.18 "DELETE /v2.0/networks/96d6a39e-5317-4fc0-b645-87386d7cd358 HTTP/1.1" status: 204 len: 168 time: 1.3840270 Dec 21 04:08:30.249944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95533e2a-5b67-4998-bd8e-774c48d2d9f3 admin admin] Pushing event deleted for resources: {'Network': ['ID=96d6a39e-5317-4fc0-b645-87386d7cd358,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:30.277956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-32f42c34-2322-40c1-9e4e-9a78c93bc422 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7a6e131a586d439f9d365a9c455fdf85&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1986320 Dec 21 04:08:30.280176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51938) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:30.333328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-660dcdfa-1a8d-480c-af45-43a5e7813fc6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.354757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-660dcdfa-1a8d-480c-af45-43a5e7813fc6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.515776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca519027-32f7-485f-b0d8-a324a586863a req-7cab7893-1d19-4955-b4c5-e72cfa864ba1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:30.517503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca519027-32f7-485f-b0d8-a324a586863a req-7cab7893-1d19-4955-b4c5-e72cfa864ba1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 945 time: 0.0612514 Dec 21 04:08:30.518395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-660dcdfa-1a8d-480c-af45-43a5e7813fc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.521113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-660dcdfa-1a8d-480c-af45-43a5e7813fc6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.522245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-660dcdfa-1a8d-480c-af45-43a5e7813fc6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ea8f7522-588b-4eb4-8296-26f22a7536fc HTTP/1.1" status: 204 len: 168 time: 0.2406683 Dec 21 04:08:30.537197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660dcdfa-1a8d-480c-af45-43a5e7813fc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea8f7522-588b-4eb4-8296-26f22a7536fc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:30.591645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca519027-32f7-485f-b0d8-a324a586863a req-95cd3d72-d665-4bf6-843a-f955e67d780d tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0613539 Dec 21 04:08:30.629405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51952) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:30.681549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5a6417b6-aede-4987-b50f-5aba32e82b38 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2e28414564544bb283304990bb7b8542&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0507605 Dec 21 04:08:30.684208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51956) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:30.765786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8c586b-b6aa-4540-a6cd-2bb35e76d97f req-b4f8c642-d3b2-40c5-9e5c-a5decffef489 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:30.767883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a8c586b-b6aa-4540-a6cd-2bb35e76d97f req-b4f8c642-d3b2-40c5-9e5c-a5decffef489 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.0840771 Dec 21 04:08:30.780762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fd45954-c716-4b4b-8c4f-95ee9cbb5b92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.818213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fd45954-c716-4b4b-8c4f-95ee9cbb5b92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:30.861483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a8c586b-b6aa-4540-a6cd-2bb35e76d97f req-49c5a1ca-66a4-4de0-ae81-ec7f6a8c5f2d tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830655 Dec 21 04:08:30.935305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b094bdba-15cc-4873-8539-acab0522cbee req-4c4e28ec-c76f-45f1-93d8-692349ebfc1b tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:30.936790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b094bdba-15cc-4873-8539-acab0522cbee req-4c4e28ec-c76f-45f1-93d8-692349ebfc1b tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.31 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 945 time: 0.0744243 Dec 21 04:08:31.069489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fd45954-c716-4b4b-8c4f-95ee9cbb5b92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.075644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 523be078-57d7-4932-a770-82f71107ba1a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:31.076221 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fd45954-c716-4b4b-8c4f-95ee9cbb5b92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.077370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9fd45954-c716-4b4b-8c4f-95ee9cbb5b92 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ccd453dc-aa16-4aa6-836a-b6ef27489378 HTTP/1.1" status: 204 len: 168 time: 0.3913178 Dec 21 04:08:31.083079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Deleting port adb2727a-4661-46f5-a1a9-b11045316c51 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:31.083420 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.100735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 523be078-57d7-4932-a770-82f71107ba1a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:31.101826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 523be078-57d7-4932-a770-82f71107ba1a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:31.124928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd45954-c716-4b4b-8c4f-95ee9cbb5b92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccd453dc-aa16-4aa6-836a-b6ef27489378,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:31.202099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] For port adb2727a-4661-46f5-a1a9-b11045316c51, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=adb2727a-4661-46f5-a1a9-b11045316c51,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:31.202377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.215950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Calling delete_port for adb2727a-4661-46f5-a1a9-b11045316c51 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:31.383378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8599dd79-089f-4b05-a8c1-f244333f289e req-e2a336fe-eafb-4b0f-b9e5-0d4a4a459103 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:31.386884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8599dd79-089f-4b05-a8c1-f244333f289e req-e2a336fe-eafb-4b0f-b9e5-0d4a4a459103 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.0640054 Dec 21 04:08:31.432553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8599dd79-089f-4b05-a8c1-f244333f289e req-590ae920-b268-4e83-8d45-44dee7605cee tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417426 Dec 21 04:08:31.457003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.493740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event deleted for resources: {'Port': ['ID=adb2727a-4661-46f5-a1a9-b11045316c51,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:31.496026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba', 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:31.518324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['adb2727a-4661-46f5-a1a9-b11045316c51'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:31.526655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51976) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:31.548503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] No DVR routers for this DVR port adb2727a-4661-46f5-a1a9-b11045316c51 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:31.551494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.555796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-dd717c67-4e65-4968-b00f-0931102cc1f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:31.557332 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-dd717c67-4e65-4968-b00f-0931102cc1f6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 1097 time: 0.0680168 Dec 21 04:08:31.558491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b094bdba-15cc-4873-8539-acab0522cbee req-d2e269fc-e7d9-486f-abe7-822f5c789b8a tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.31 "DELETE /v2.0/ports/adb2727a-4661-46f5-a1a9-b11045316c51 HTTP/1.1" status: 204 len: 173 time: 0.6141331 Dec 21 04:08:31.559161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '332bd612-9c55-494a-876c-f9d7186efd6b', 'name': 'network-vif-deleted', 'tag': 'adb2727a-4661-46f5-a1a9-b11045316c51'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:31.561596 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d0b2966-a7fe-49e5-aa8d-a7ba6608d3a1" -d '{"events": [{"server_uuid": "332bd612-9c55-494a-876c-f9d7186efd6b", "name": "network-vif-deleted", "tag": "adb2727a-4661-46f5-a1a9-b11045316c51"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:31.605470 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a34fb84a-0ba9-4a94-b071-679a98b2ef85 x-openstack-request-id: req-a34fb84a-0ba9-4a94-b071-679a98b2ef85 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:31.605470 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "332bd612-9c55-494a-876c-f9d7186efd6b", "name": "network-vif-deleted", "tag": "adb2727a-4661-46f5-a1a9-b11045316c51", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:31.605470 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a34fb84a-0ba9-4a94-b071-679a98b2ef85 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:31.605470 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '332bd612-9c55-494a-876c-f9d7186efd6b', 'name': 'network-vif-deleted', 'tag': 'adb2727a-4661-46f5-a1a9-b11045316c51', 'status': 'completed', 'code': 200} Dec 21 04:08:31.671463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74df9087-6a73-4299-9443-5bb5845fa641 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9d03b3f898704d25a8981baf46cf9354&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1444354 Dec 21 04:08:31.673949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51984) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:31.722002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-9de1c438-79e7-45e3-9ec1-86d943eeba8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:31.723706 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-9de1c438-79e7-45e3-9ec1-86d943eeba8a service neutron] 10.222.0.54 "GET /v2.0/networks?id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede HTTP/1.1" status: 200 len: 913 time: 0.1578922 Dec 21 04:08:31.728246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9183e5c-21e4-405b-97dd-a96e263c95e3 req-a91650c8-9117-4c30-921c-6a5bce1d756b tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=332bd612-9c55-494a-876c-f9d7186efd6b HTTP/1.1" status: 200 len: 210 time: 0.0318935 Dec 21 04:08:31.750627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa3269f3-2bb0-482a-96f6-75dca030ec00 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.781857 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-35defa41-acb4-4e56-ae55-5ffcded67933 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724 HTTP/1.1" status: 200 len: 217 time: 0.0430176 Dec 21 04:08:31.835595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa3269f3-2bb0-482a-96f6-75dca030ec00 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:31.873849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-f8900b77-7e18-41e7-84ad-8b52a62e1c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:31.875334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-f8900b77-7e18-41e7-84ad-8b52a62e1c5f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c89d12e6-9dc6-46e4-be88-39773c8bf0e9 HTTP/1.1" status: 200 len: 852 time: 0.0848455 Dec 21 04:08:31.911899 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-67787204-1619-4ce2-9937-0a554e87bc70 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0295730 Dec 21 04:08:32.004728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa3269f3-2bb0-482a-96f6-75dca030ec00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:32.007104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fa3269f3-2bb0-482a-96f6-75dca030ec00 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:32.008223 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa3269f3-2bb0-482a-96f6-75dca030ec00 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9d8655b0-4d36-424f-92b7-2cdb179c668c HTTP/1.1" status: 204 len: 168 time: 0.3333762 Dec 21 04:08:32.014202 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-d68065a2-99ba-45c1-9e81-6748d954365b service neutron] 10.222.0.54 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952213 Dec 21 04:08:32.018948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa3269f3-2bb0-482a-96f6-75dca030ec00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d8655b0-4d36-424f-92b7-2cdb179c668c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:32.067400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:32.109420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0b4d720d-ea8d-410e-b596-daca680c23d5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a5404da396354872bc7c319caf0d4bb2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0394843 Dec 21 04:08:32.110564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51992) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:32.121152 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f9f5e226-5807-4964-b878-90fa14880ee8 req-453de26a-4e89-4102-b95b-21c852df2024 service neutron] 10.222.0.54 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991824 Dec 21 04:08:32.161071 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdef38e-fe3a-43f2-8714-d6d17f07cd52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:32.182835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdef38e-fe3a-43f2-8714-d6d17f07cd52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:32.307821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdef38e-fe3a-43f2-8714-d6d17f07cd52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:32.310552 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdef38e-fe3a-43f2-8714-d6d17f07cd52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:32.312638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-afdef38e-fe3a-43f2-8714-d6d17f07cd52 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/34f2080a-73d1-4ee0-9546-10a960d63321 HTTP/1.1" status: 204 len: 168 time: 0.2009315 Dec 21 04:08:32.320854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdef38e-fe3a-43f2-8714-d6d17f07cd52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34f2080a-73d1-4ee0-9546-10a960d63321,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:32.886019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829ee322-9c12-43db-9f5b-23966f773729 req-608c6ea6-d346-4eb4-a7f4-6a3666a42219 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:32.887674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-829ee322-9c12-43db-9f5b-23966f773729 req-608c6ea6-d346-4eb4-a7f4-6a3666a42219 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.3727624 Dec 21 04:08:32.983414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-829ee322-9c12-43db-9f5b-23966f773729 req-1cf22503-0b5d-47b6-b830-ea0382b5774a tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0895834 Dec 21 04:08:33.310442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52036) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.385211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7f413e-61b8-4254-ba61-cdd1f44c1d25 req-03658444-9fa3-4def-b00a-27538c4c6b01 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:33.387589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f413e-61b8-4254-ba61-cdd1f44c1d25 req-03658444-9fa3-4def-b00a-27538c4c6b01 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 945 time: 0.0543673 Dec 21 04:08:33.425371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-ddc285ea-b38a-49ef-ba7f-6d13b67d1788 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.426605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ddc285ea-b38a-49ef-ba7f-6d13b67d1788 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.1150644 Dec 21 04:08:33.429663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52042) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.435471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-8e9ce385-204f-41cb-98b2-5c5b9f6c24ff tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.436656 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e9ce385-204f-41cb-98b2-5c5b9f6c24ff tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0051706 Dec 21 04:08:33.439507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52046) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.444274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-b007e092-9006-496b-b8c2-870a3a537d82 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.445501 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b007e092-9006-496b-b8c2-870a3a537d82 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0051057 Dec 21 04:08:33.450034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.454101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-174b86b4-865b-4441-903a-27fc9fd7c6ad tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.455343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-174b86b4-865b-4441-903a-27fc9fd7c6ad tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0044246 Dec 21 04:08:33.459168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52050) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.461205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce7f413e-61b8-4254-ba61-cdd1f44c1d25 req-92feac52-aaa5-4b31-8255-b4d8fdd97a5d tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649805 Dec 21 04:08:33.463567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-b78a9511-9177-434a-99ce-3be515962fe5 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.464752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b78a9511-9177-434a-99ce-3be515962fe5 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0044570 Dec 21 04:08:33.466924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52052) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.471124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-19f7e194-1e3c-4abd-be8f-529f7a7bf31e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.472264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19f7e194-1e3c-4abd-be8f-529f7a7bf31e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0041790 Dec 21 04:08:33.479336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52054) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.484053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-c7f5fe65-ff52-4ddd-ba64-9a19f84fd6a5 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.485373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c7f5fe65-ff52-4ddd-ba64-9a19f84fd6a5 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0050516 Dec 21 04:08:33.488013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.492259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-cf2ddd1c-c154-4328-87d9-35dd81f87592 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.493282 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf2ddd1c-c154-4328-87d9-35dd81f87592 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0042510 Dec 21 04:08:33.496063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52058) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.502494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-e00ef699-8544-4a35-95a4-9efd769a9511 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.504094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e00ef699-8544-4a35-95a4-9efd769a9511 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0048854 Dec 21 04:08:33.506314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52062) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.510059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-abe6bacc-5943-4809-8970-03f7454a41d3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.511039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-abe6bacc-5943-4809-8970-03f7454a41d3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0038433 Dec 21 04:08:33.513081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52064) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.517670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-10805948-6ed0-4aaf-97df-5ca8ce76d4ea tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.520125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-10805948-6ed0-4aaf-97df-5ca8ce76d4ea tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0060613 Dec 21 04:08:33.522237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52066) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.526201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-7f1fa448-82d7-461e-b42a-5e3312b29784 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.527166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7f1fa448-82d7-461e-b42a-5e3312b29784 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0040643 Dec 21 04:08:33.529428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52068) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.533196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-3ca0359b-aea0-45ee-af5a-3be67e056a62 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.534103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3ca0359b-aea0-45ee-af5a-3be67e056a62 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0038497 Dec 21 04:08:33.536760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52070) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.541649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-d2266323-072f-4f3e-a055-ecbe8a38e8ca tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.542590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d2266323-072f-4f3e-a055-ecbe8a38e8ca tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0049701 Dec 21 04:08:33.545015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52072) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.550064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-677cfea1-b56a-4c51-b126-2e24ccdcc5d8 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.551084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-677cfea1-b56a-4c51-b126-2e24ccdcc5d8 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0047500 Dec 21 04:08:33.553928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52076) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.559796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-43e48da7-3d50-4657-b820-f9f4a8e62bd7 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.560850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-43e48da7-3d50-4657-b820-f9f4a8e62bd7 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0058768 Dec 21 04:08:33.563396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52078) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.568355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-4269435e-ce5a-462a-9fb7-1f6160f24a3b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.569241 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4269435e-ce5a-462a-9fb7-1f6160f24a3b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0048888 Dec 21 04:08:33.571654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52080) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.575694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-f24c9bdc-e736-4fe2-95f1-5b185acc0b2b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.576639 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f24c9bdc-e736-4fe2-95f1-5b185acc0b2b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0041146 Dec 21 04:08:33.579282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52082) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.584358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-a29e356c-35e6-4743-a3b3-e4eaafef5c16 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.585335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a29e356c-35e6-4743-a3b3-e4eaafef5c16 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0051074 Dec 21 04:08:33.587845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52084) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.592231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-e08d9272-0702-4e2e-98a4-8a497f43454e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.593181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e08d9272-0702-4e2e-98a4-8a497f43454e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0042555 Dec 21 04:08:33.595775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52086) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.600459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-7cc23c24-e620-43d0-b7bc-a9854973d947 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.604001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52088) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.606134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7cc23c24-e620-43d0-b7bc-a9854973d947 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0046625 Dec 21 04:08:33.608749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-8d7b6fd3-a497-476d-a9a0-35013d1bcff3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.610185 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d7b6fd3-a497-476d-a9a0-35013d1bcff3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0051529 Dec 21 04:08:33.615188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52092) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.620083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-ba220944-c786-4561-9622-4bf9f493e9e4 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.621101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ba220944-c786-4561-9622-4bf9f493e9e4 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0048258 Dec 21 04:08:33.623468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52094) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.629138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-b57f17e5-1cd3-45a4-bd76-a5d1d375bf0b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.632058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b57f17e5-1cd3-45a4-bd76-a5d1d375bf0b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0069566 Dec 21 04:08:33.632789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.638045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-5b97b2b9-71ce-4471-9516-a4fdc34633ee tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.641498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52100) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.641657 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b97b2b9-71ce-4471-9516-a4fdc34633ee tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0072601 Dec 21 04:08:33.649885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-e7728369-61ca-44b8-9d33-028b051b5aa8 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.653861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52102) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.654017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e7728369-61ca-44b8-9d33-028b051b5aa8 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0104728 Dec 21 04:08:33.659639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-1be7c967-1724-41f0-aa14-0900b0be3502 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.663398 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1be7c967-1724-41f0-aa14-0900b0be3502 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0082288 Dec 21 04:08:33.664041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52104) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.670118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-1268cfde-87c0-45f3-a42e-336d203361bb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.671330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1268cfde-87c0-45f3-a42e-336d203361bb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0061800 Dec 21 04:08:33.678763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52106) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.683361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-19e0981e-57d1-45a4-8949-84a7d13f5fa9 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.684460 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19e0981e-57d1-45a4-8949-84a7d13f5fa9 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0044384 Dec 21 04:08:33.686783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.692308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-6ff5a08a-ce94-443a-82e6-958cb62e90d8 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.695431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ff5a08a-ce94-443a-82e6-958cb62e90d8 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0073261 Dec 21 04:08:33.695994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.700608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-fd3275dd-53fc-423e-8415-c5bd590436a3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.703817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd3275dd-53fc-423e-8415-c5bd590436a3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0062389 Dec 21 04:08:33.708589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52112) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.711910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-5232e84b-ca29-4322-9b59-fd328fc76854 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.715773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52114) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.719098 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5232e84b-ca29-4322-9b59-fd328fc76854 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0087812 Dec 21 04:08:33.720073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-6ccee7d3-4c6c-4912-8bfb-8b6b52692a55 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.721023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ccee7d3-4c6c-4912-8bfb-8b6b52692a55 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0042965 Dec 21 04:08:33.724192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.728524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-38721161-279b-4578-8be5-e4ce29dd4528 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.730996 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38721161-279b-4578-8be5-e4ce29dd4528 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0043397 Dec 21 04:08:33.732807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52118) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.737235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-4e04936a-98dc-40b6-85bf-43508f5e23fb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.738738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4e04936a-98dc-40b6-85bf-43508f5e23fb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0048730 Dec 21 04:08:33.747043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52120) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.747460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52122) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.751616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-12a3fba4-ccb3-432a-b6f7-bfa989d839cf tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.752789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-12a3fba4-ccb3-432a-b6f7-bfa989d839cf tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0044227 Dec 21 04:08:33.755787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.761419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-779f9113-3d12-4e17-b445-e42dde2edf7a tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.762378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-779f9113-3d12-4e17-b445-e42dde2edf7a tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0042713 Dec 21 04:08:33.764786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.770281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-3248c9ce-7ce6-47ab-96e2-d63c3db3f4c3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.774760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52130) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.775535 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3248c9ce-7ce6-47ab-96e2-d63c3db3f4c3 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0094700 Dec 21 04:08:33.779033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-e59989f5-7e33-4bbf-9e89-9cf7f23fb4eb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.780005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e59989f5-7e33-4bbf-9e89-9cf7f23fb4eb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0042157 Dec 21 04:08:33.782217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52132) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.786524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-ad42c38c-237d-4375-a4a7-f7cb3a138966 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.787478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad42c38c-237d-4375-a4a7-f7cb3a138966 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0044315 Dec 21 04:08:33.789649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52134) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.793513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-c5b50778-f375-4392-afca-9e4b3fd63966 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.794579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5b50778-f375-4392-afca-9e4b3fd63966 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0039582 Dec 21 04:08:33.796889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52136) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.804704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-c20f4c64-a79f-4616-926f-ea6f37ed2a07 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.805699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c20f4c64-a79f-4616-926f-ea6f37ed2a07 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0079415 Dec 21 04:08:33.807928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52138) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.811708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-0b096a25-f046-4af8-9825-6524f6c56135 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.812618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0b096a25-f046-4af8-9825-6524f6c56135 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0038464 Dec 21 04:08:33.814909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.819933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-d50d3ae4-273f-4e09-82de-4f343d16da87 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.820970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d50d3ae4-273f-4e09-82de-4f343d16da87 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0042498 Dec 21 04:08:33.823053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52142) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.827615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-8f4e0dfd-19be-414c-8b3a-1039ab6c5cad tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.828569 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8f4e0dfd-19be-414c-8b3a-1039ab6c5cad tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0046613 Dec 21 04:08:33.830781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.834713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-50c6eda9-d0bf-4050-b76e-e12bae9ea0ad tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.836919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-50c6eda9-d0bf-4050-b76e-e12bae9ea0ad tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0039809 Dec 21 04:08:33.838675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52146) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.842913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-b1141e20-a423-4088-bb07-b7986b22b7b9 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.845911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b1141e20-a423-4088-bb07-b7986b22b7b9 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0042553 Dec 21 04:08:33.846331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52148) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.850751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-20075be8-14a8-434d-8962-47498a725f2d tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.851680 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-20075be8-14a8-434d-8962-47498a725f2d tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0042827 Dec 21 04:08:33.853905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.858203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-1c40bc9b-292f-41c5-baf7-df44572a4086 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.861646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.861791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c40bc9b-292f-41c5-baf7-df44572a4086 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0065994 Dec 21 04:08:33.867938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-70383f89-92b0-41ca-b746-313a27160791 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.869553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-70383f89-92b0-41ca-b746-313a27160791 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0053766 Dec 21 04:08:33.875658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Request body: {'network': {'name': 'tempest-ListServerFiltersTestJSON-1577030806-network', 'tenant_id': 'd1d48e3ff6704ed3be8064f88e36401f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:33.876968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.881584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-b7c772ad-a1aa-4759-bacc-ef23191414e7 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.882760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b7c772ad-a1aa-4759-bacc-ef23191414e7 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0046973 Dec 21 04:08:33.884933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.888772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-5e9b9cd7-65d1-4c40-944b-0978a4bfc04c tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.889706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5e9b9cd7-65d1-4c40-944b-0978a4bfc04c tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0039093 Dec 21 04:08:33.891813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52158) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.895883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-c1311580-92a7-4a58-8a26-2953d613c1f2 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.898974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1311580-92a7-4a58-8a26-2953d613c1f2 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0040836 Dec 21 04:08:33.899175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52160) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.903447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-b2bddaef-cb8a-457c-bb09-341a94a44ad1 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.904632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b2bddaef-cb8a-457c-bb09-341a94a44ad1 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0045128 Dec 21 04:08:33.912580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.917867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-d86b1007-3fa3-41c9-8eb2-fc7fe599bb18 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.921418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d86b1007-3fa3-41c9-8eb2-fc7fe599bb18 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0053959 Dec 21 04:08:33.921756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52164) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.926868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-e7693707-6d16-44c0-8c62-120ced1b3ed2 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.927869 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7693707-6d16-44c0-8c62-120ced1b3ed2 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0052257 Dec 21 04:08:33.930433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52166) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.936740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-4183735e-ae54-4460-b22a-116814baccb4 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.938006 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4183735e-ae54-4460-b22a-116814baccb4 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0062819 Dec 21 04:08:33.941752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52168) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.948009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-18ecfdbd-b583-4e4a-a9f2-9f34b15981ab tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.948009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-18ecfdbd-b583-4e4a-a9f2-9f34b15981ab tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0051067 Dec 21 04:08:33.950610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52170) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.954644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-19a686a5-7842-425e-9ae2-ba7d26d59891 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.955589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-19a686a5-7842-425e-9ae2-ba7d26d59891 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0040712 Dec 21 04:08:33.958311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52172) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.962383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-555933c0-6186-49b7-a9da-a5a4363e31ee tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.963313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-555933c0-6186-49b7-a9da-a5a4363e31ee tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0041962 Dec 21 04:08:33.965543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52174) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.969365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-e4f149af-9607-442c-b909-d0f8f6c77d4b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.970440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e4f149af-9607-442c-b909-d0f8f6c77d4b tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0039396 Dec 21 04:08:33.972854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.977002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-4bdd4f09-964b-43df-81de-bba9c1d076eb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.977938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4bdd4f09-964b-43df-81de-bba9c1d076eb tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0042107 Dec 21 04:08:33.980707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52178) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.984617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-1a811340-0080-4b92-a57f-4dfe6f22fc2a tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.985621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a811340-0080-4b92-a57f-4dfe6f22fc2a tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0039897 Dec 21 04:08:33.988943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52180) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:33.992552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-9a4f992b-d87b-4dbc-87fe-a2c8e68a2e8e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:33.993786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9a4f992b-d87b-4dbc-87fe-a2c8e68a2e8e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0039406 Dec 21 04:08:33.996112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52182) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.000077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-3a543f7d-0531-4e9b-9cab-47ed9fe90996 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.000998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3a543f7d-0531-4e9b-9cab-47ed9fe90996 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0039055 Dec 21 04:08:34.004433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52184) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.009049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-ce4ff9e4-d0dd-4759-9a92-9cc8e8b40a8e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.010008 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ce4ff9e4-d0dd-4759-9a92-9cc8e8b40a8e tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0046072 Dec 21 04:08:34.012307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52186) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.018564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-03f2689f-f9c3-4e1f-9c75-730b4b01d13f tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.022440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-03f2689f-f9c3-4e1f-9c75-730b4b01d13f tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0090954 Dec 21 04:08:34.022650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52190) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.032459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-3c8bb0aa-1d85-4b6f-a1d6-a63249b07420 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.032459 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3c8bb0aa-1d85-4b6f-a1d6-a63249b07420 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0063670 Dec 21 04:08:34.033270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52194) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.040743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [None req-8011b17d-5ac1-44cf-bfb6-9a69de3c312a tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.044547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8011b17d-5ac1-44cf-bfb6-9a69de3c312a tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0100915 Dec 21 04:08:34.044912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52196) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.049829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-2eaa25b2-e4c1-451f-a522-3fc07eb2d1d5 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.055880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2eaa25b2-e4c1-451f-a522-3fc07eb2d1d5 tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0098531 Dec 21 04:08:34.060053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52198) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.065955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [None req-8714744c-43c2-4c9f-ab6d-81490ca192bf tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] http://10.222.0.18:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:08:34.071380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8714744c-43c2-4c9f-ab6d-81490ca192bf tempest-ExtensionsTestJSON-477230758 tempest-ExtensionsTestJSON-477230758-project] 10.222.0.18 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0090334 Dec 21 04:08:34.115340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Made reservation on behalf of d1d48e3ff6704ed3be8064f88e36401f for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:34.119727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.130672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5233aeb7-6544-43c0-a1e5-c2dbfd8ae29d req-5c5cc528-32c1-4536-b262-7bcd99a91b88 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:34.132280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5233aeb7-6544-43c0-a1e5-c2dbfd8ae29d req-5c5cc528-32c1-4536-b262-7bcd99a91b88 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.0607300 Dec 21 04:08:34.135373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.187064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5233aeb7-6544-43c0-a1e5-c2dbfd8ae29d req-46b57d55-5aac-4b55-9a24-f76fde906c32 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445051 Dec 21 04:08:34.238207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.330179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.364166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:34.373680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.374073 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Added segment 38c210ca-73e5-429b-b74e-20455218ed07 of type vlan for network 5b94d88b-3288-4137-8290-856f86bd57aa Dec 21 04:08:34.384033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device adb2727a-4661-46f5-a1a9-b11045316c51 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:34.406443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: adb2727a-4661-46f5-a1a9-b11045316c51 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:34.406894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device adb2727a-4661-46f5-a1a9-b11045316c51 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:34.424720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a1b8842-0376-4577-9d7b-148e56f4d06e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:34.442339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.484832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52206) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.519631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.526784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:34.526784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.634673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] Pushing event updated for resources: {'Network': ['ID=5b94d88b-3288-4137-8290-856f86bd57aa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:34.646831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5b94d88b-3288-4137-8290-856f86bd57aa details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:34.664392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-867d4fa3-de64-4b72-888f-26a28b49f1e8 req-a4580ea3-b2e4-4dc6-805e-028ff68f4ba4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:34.666925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-867d4fa3-de64-4b72-888f-26a28b49f1e8 req-a4580ea3-b2e4-4dc6-805e-028ff68f4ba4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 945 time: 0.1023974 Dec 21 04:08:34.698166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8de5156f-15d9-41a8-bbe0-6f9350c624e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.731557 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7e3a3fff-ac9a-47e2-a721-2096e59feed3 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.9829621 Dec 21 04:08:34.733740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.748364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Request body: {'subnet': {'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'cidr': '172.20.0.0/28', 'name': 'tempest-ListServerFiltersTestJSON-1577030806-subnet', 'tenant_id': 'd1d48e3ff6704ed3be8064f88e36401f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:34.752857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-867d4fa3-de64-4b72-888f-26a28b49f1e8 req-b162ed22-9ea6-4be4-ae6d-a704aad5cdd4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758190 Dec 21 04:08:34.762915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12713cc4-ad99-40b4-9f21-2e7f84a31890 req-904b129e-b373-45e5-acfd-34967fec949b tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:34.764656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12713cc4-ad99-40b4-9f21-2e7f84a31890 req-904b129e-b373-45e5-acfd-34967fec949b tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1444530 Dec 21 04:08:34.807943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-7cf51ff8-f964-4d60-be2e-b952b0cf2077 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:34.809539 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-7cf51ff8-f964-4d60-be2e-b952b0cf2077 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 945 time: 0.0768936 Dec 21 04:08:34.851108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12713cc4-ad99-40b4-9f21-2e7f84a31890 req-fc48a108-e728-4c33-a10b-15664a213fde tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741954 Dec 21 04:08:34.875866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8de5156f-15d9-41a8-bbe0-6f9350c624e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.896339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Made reservation on behalf of d1d48e3ff6704ed3be8064f88e36401f for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:34.898677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.935741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8de5156f-15d9-41a8-bbe0-6f9350c624e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:34.983515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8de5156f-15d9-41a8-bbe0-6f9350c624e6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c59d8fa1a50f412fb33530c528342d91&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4946446 Dec 21 04:08:34.984341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52220) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:34.991258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de5156f-15d9-41a8-bbe0-6f9350c624e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a778ff21-b8e8-4d90-b27f-73663cbe2d45,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:34.992847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Deleting port b5ef7827-00e7-4327-b7b1-fdbfa2289064 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:34.993205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.049537 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7112b9e9-c5e3-4d1a-9701-60e3f4ac113d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.115432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7112b9e9-c5e3-4d1a-9701-60e3f4ac113d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.147573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] For port b5ef7827-00e7-4327-b7b1-fdbfa2289064, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b5ef7827-00e7-4327-b7b1-fdbfa2289064,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:35.147991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.188761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Calling delete_port for b5ef7827-00e7-4327-b7b1-fdbfa2289064 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:35.233673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7112b9e9-c5e3-4d1a-9701-60e3f4ac113d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.236603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7112b9e9-c5e3-4d1a-9701-60e3f4ac113d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.241357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7112b9e9-c5e3-4d1a-9701-60e3f4ac113d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a778ff21-b8e8-4d90-b27f-73663cbe2d45 HTTP/1.1" status: 204 len: 168 time: 0.2563865 Dec 21 04:08:35.251390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7112b9e9-c5e3-4d1a-9701-60e3f4ac113d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a778ff21-b8e8-4d90-b27f-73663cbe2d45,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:35.269216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.348446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Pushing event updated for resources: {'Subnet': ['ID=39078dda-bad6-4dd8-b1ea-bf27b6bdc389,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:35.359185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Checking segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:35.359549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Network hostable DHCP agents. Network: 5b94d88b-3288-4137-8290-856f86bd57aa, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:35.495944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Network 5b94d88b-3288-4137-8290-856f86bd57aa is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:35.524635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.557689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba', 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:35.562473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event deleted for resources: {'Port': ['ID=b5ef7827-00e7-4327-b7b1-fdbfa2289064,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:35.610261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] No DVR routers for this DVR port b5ef7827-00e7-4327-b7b1-fdbfa2289064 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:35.615160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5b94d88b-3288-4137-8290-856f86bd57aa) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:35.617309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.621202 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29457b26-dfd2-4491-8998-bef5eeb42780 req-94a3e661-26b1-4c1f-a443-b5c653adfd71 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "DELETE /v2.0/ports/b5ef7827-00e7-4327-b7b1-fdbfa2289064 HTTP/1.1" status: 204 len: 173 time: 0.8024700 Dec 21 04:08:35.621797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'name': 'network-vif-deleted', 'tag': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:35.622016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96bca0e9-7bd2-4577-b2af-a4d1700b32b3 None None] Network 5b94d88b-3288-4137-8290-856f86bd57aa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:35.624328 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5986e157-814a-4470-a3b6-4fde047eedcc" -d '{"events": [{"server_uuid": "c62a8e3a-359f-4a1f-92b2-6cfa85603fcf", "name": "network-vif-deleted", "tag": "b5ef7827-00e7-4327-b7b1-fdbfa2289064"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:35.644221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:35.645116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.677285 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-401d8ce0-05ce-4926-a0d9-23e5d10f0924 x-openstack-request-id: req-401d8ce0-05ce-4926-a0d9-23e5d10f0924 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:35.677618 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c62a8e3a-359f-4a1f-92b2-6cfa85603fcf", "name": "network-vif-deleted", "tag": "b5ef7827-00e7-4327-b7b1-fdbfa2289064", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:35.677932 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-401d8ce0-05ce-4926-a0d9-23e5d10f0924 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:35.678555 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c62a8e3a-359f-4a1f-92b2-6cfa85603fcf', 'name': 'network-vif-deleted', 'tag': 'b5ef7827-00e7-4327-b7b1-fdbfa2289064', 'status': 'completed', 'code': 200} Dec 21 04:08:35.758775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-880b902e-eaa7-4ebc-98ee-29526569a8ef admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.0240848 Dec 21 04:08:35.830077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5b94d88b-3288-4137-8290-856f86bd57aa', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'project_id': 'd1d48e3ff6704ed3be8064f88e36401f', 'fixed_ips': [{'subnet_id': '39078dda-bad6-4dd8-b1ea-bf27b6bdc389'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:08:35.831052 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:35.964580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd4cabf-fd5f-4b70-b5a2-73553ce13129 req-5410524a-19be-4c1f-bba3-e0376f29caf4 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=c62a8e3a-359f-4a1f-92b2-6cfa85603fcf HTTP/1.1" status: 200 len: 210 time: 0.0524566 Dec 21 04:08:36.074700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5cbe5e-c15e-4388-bdaf-d28ab8519690 req-20317884-7eb8-4f54-bef6-37fda8b63691 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:36.076468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e5cbe5e-c15e-4388-bdaf-d28ab8519690 req-20317884-7eb8-4f54-bef6-37fda8b63691 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1108339 Dec 21 04:08:36.149486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e5cbe5e-c15e-4388-bdaf-d28ab8519690 req-4b3282e7-8026-40f4-9f2a-974d417f8be2 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664608 Dec 21 04:08:36.162917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Allocated IP 172.20.0.2 (5b94d88b-3288-4137-8290-856f86bd57aa/39078dda-bad6-4dd8-b1ea-bf27b6bdc389/25763a72-aed3-4bd1-b448-7788360bd9db) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:36.370715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:36.468230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:36.507757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Network 5b94d88b-3288-4137-8290-856f86bd57aa is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:36.510972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:36.521166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:36.576907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Pushing event updated for resources: {'Port': ['ID=25763a72-aed3-4bd1-b448-7788360bd9db,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:36.666915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd25710e-a5cf-4eb3-885e-3ee66ee74d8c req-2416e4e0-6809-4533-9a7d-4370b33af52c tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:36.668953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd25710e-a5cf-4eb3-885e-3ee66ee74d8c req-2416e4e0-6809-4533-9a7d-4370b33af52c tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1344266 Dec 21 04:08:36.687975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Attempting to bind port 25763a72-aed3-4bd1-b448-7788360bd9db on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:36.692917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Attempting to bind port 25763a72-aed3-4bd1-b448-7788360bd9db by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:36.693365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Attempting to bind port 25763a72-aed3-4bd1-b448-7788360bd9db on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:36.709344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:36.709722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Checking segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:36.717504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:36.718161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Bound using segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:36.719607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Bound port: 25763a72-aed3-4bd1-b448-7788360bd9db, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:36.720190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:36.740705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52276) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:36.773278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-2f98c02c-f5e7-42e3-8299-9ea3d8dc3459 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:36.777014 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-2f98c02c-f5e7-42e3-8299-9ea3d8dc3459 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 1097 time: 0.1361239 Dec 21 04:08:36.788059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ca8d13b5-946b-41d2-91a5-8f4bbdb5555a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:36.790059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ca8d13b5-946b-41d2-91a5-8f4bbdb5555a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 816 time: 0.2305443 Dec 21 04:08:36.807547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd25710e-a5cf-4eb3-885e-3ee66ee74d8c req-fefc643a-f406-4b8d-ae75-cb21be6fad2f tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1294322 Dec 21 04:08:36.816890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] For port 25763a72-aed3-4bd1-b448-7788360bd9db, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:36.820977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] For port 25763a72-aed3-4bd1-b448-7788360bd9db, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=25763a72-aed3-4bd1-b448-7788360bd9db,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:36.833975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-1a6f2095-aad5-4b7d-99f0-a5e4d0077d4c tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/quotas/d1d48e3ff6704ed3be8064f88e36401f HTTP/1.1" status: 200 len: 375 time: 0.0253649 Dec 21 04:08:36.895152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'networks': [{'name': 'tempest-network--700095588'}, {'name': 'tempest-network--983182627'}]} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:36.895462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'network': {'name': 'tempest-network--700095588'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:36.895944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'network': {'name': 'tempest-network--983182627'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:36.903472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:36.904485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-714f4929-aaa7-43cf-aa88-3057f9161c4e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0644965 Dec 21 04:08:36.962571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-1b345470-9205-48b9-9a97-84b2ef6456fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:36.966290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-1b345470-9205-48b9-9a97-84b2ef6456fc service neutron] 10.222.0.54 "GET /v2.0/networks?id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede HTTP/1.1" status: 200 len: 913 time: 0.1797240 Dec 21 04:08:37.004390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22964080-0343-49e9-9a56-c4a9e14bb52c None None] Pushing event updated for resources: {'Port': ['ID=25763a72-aed3-4bd1-b448-7788360bd9db,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:37.045823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-5c12a376-9701-4535-809c-596bf4e00c23 service neutron] 10.222.0.18 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1403010 Dec 21 04:08:37.049451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'network': 2} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:37.054494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.069832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.079229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-881c4f6b-d00e-4972-96e4-7a127860adfa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724 HTTP/1.1" status: 200 len: 217 time: 0.0999691 Dec 21 04:08:37.182824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-91bf5914-3ae9-4610-a8aa-7e02a36fe04e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:37.184360 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-91bf5914-3ae9-4610-a8aa-7e02a36fe04e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=c89d12e6-9dc6-46e4-be88-39773c8bf0e9 HTTP/1.1" status: 200 len: 852 time: 0.0950305 Dec 21 04:08:37.189688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-1675ea13-5205-4f15-9cac-b95d7fe6f0b5 service neutron] 10.222.0.18 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1427255 Dec 21 04:08:37.233375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-c694a932-a13b-4203-834d-44a8e24243fe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d720eb29-79ba-4dbb-9b4e-aadb9e658ede&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406556 Dec 21 04:08:37.363199 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-7f89064d-6a3f-4926-9799-22b3241aad34 service neutron] 10.222.0.54 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218724 Dec 21 04:08:37.433174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.504276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.504785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.514970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25724c3b-65d2-4afc-96c7-0f1296becb5d req-31b18ce2-7c60-4fad-af51-1c3888cf83d4 service neutron] 10.222.0.54 "GET /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1322010 Dec 21 04:08:37.550495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:37.560531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.560945 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Added segment 3d7540be-aef7-4207-9b25-fb822a97bebd of type vlan for network 6f5f6325-6e74-4dc0-b84f-6e06b7047bb5 Dec 21 04:08:37.624606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.644824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'SecurityGroup': ['ID=498f835e-87e6-413d-a52e-f52fea8e8881,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:37.673615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:37.688451 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.689714 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Added segment de1f34aa-1a90-45aa-b802-e6452d3147df of type vlan for network 228afe15-f5af-4357-969b-34a61acd5787 Dec 21 04:08:37.743528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.805309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-4d9646de-ba81-4a2e-9f67-3658d01983b8 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:37.807035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-4d9646de-ba81-4a2e-9f67-3658d01983b8 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 816 time: 0.1127579 Dec 21 04:08:37.821985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.822922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.823291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-afbf3bfc-f404-4644-a3f7-82732b981501 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/quotas/d1d48e3ff6704ed3be8064f88e36401f HTTP/1.1" status: 200 len: 375 time: 0.0101273 Dec 21 04:08:37.829307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:37.835708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:37.836450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:37.939390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Network': ['ID=6f5f6325-6e74-4dc0-b84f-6e06b7047bb5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:37.949997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6f5f6325-6e74-4dc0-b84f-6e06b7047bb5 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:37.978303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-9a95d1df-2e5a-470a-be24-007765590c75 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1477618 Dec 21 04:08:38.002412 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1318 time: 1.2415001 Dec 21 04:08:38.004177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52310) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:38.046667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b5ef7827-00e7-4327-b7b1-fdbfa2289064 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:38.077876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a15e56d-4acb-4476-b517-633c4be5a4f7 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Network': ['ID=228afe15-f5af-4357-969b-34a61acd5787,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:38.085460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: b5ef7827-00e7-4327-b7b1-fdbfa2289064 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:38.085820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b5ef7827-00e7-4327-b7b1-fdbfa2289064 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:38.092284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 228afe15-f5af-4357-969b-34a61acd5787 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:38.131623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc1e543-0745-4df4-8ac9-4c9793100f46 req-2eedbf9b-502b-453f-8153-99fcc9eadc53 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:38.139264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bc1e543-0745-4df4-8ac9-4c9793100f46 req-2eedbf9b-502b-453f-8153-99fcc9eadc53 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.2393484 Dec 21 04:08:38.317906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-ebd75367-9450-4a4c-a846-26982deaf657 service neutron] 10.222.0.18 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3386252 Dec 21 04:08:38.332083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bc1e543-0745-4df4-8ac9-4c9793100f46 req-ffdd37e0-ad8a-4878-b348-e1138535b28a tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1912956 Dec 21 04:08:38.344344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f9752c6-ae9c-4b5d-ab58-5b5137f27fee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:38.354701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f9752c6-ae9c-4b5d-ab58-5b5137f27fee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:38.363713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f9752c6-ae9c-4b5d-ab58-5b5137f27fee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:38.371114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f9752c6-ae9c-4b5d-ab58-5b5137f27fee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:38.376039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52320) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:38.379434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f9752c6-ae9c-4b5d-ab58-5b5137f27fee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2405 time: 0.3682508 Dec 21 04:08:38.469605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52324) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:38.486427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38bda2fb-78ee-4a51-ba8d-c656718736f4 None None] Network 5b94d88b-3288-4137-8290-856f86bd57aa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:38.519257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.576738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9116fea1-a486-4cf4-8a90-83c653147f93 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/floatingips/d888da9b-98ad-49bd-a5e9-3f31922bf8b1 HTTP/1.1" status: 200 len: 992 time: 0.1059172 Dec 21 04:08:38.583352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-1c591e1f-f9c3-4fa6-9f16-8b830fceb807 service neutron] 10.222.0.18 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2489667 Dec 21 04:08:38.610709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-009136a1-a83f-42aa-8126-76adc5edd7b1 None None] Provisioning complete for port 25763a72-aed3-4bd1-b448-7788360bd9db triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:38.610709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-009136a1-a83f-42aa-8126-76adc5edd7b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.658921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.684379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f5f6325-6e74-4dc0-b84f-6e06b7047bb5']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:38.713134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d7540be-aef7-4207-9b25-fb822a97bebd') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:38.713446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d7540be-aef7-4207-9b25-fb822a97bebd') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:38.724919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.740896 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.749265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:38.757830 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:38.787054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-009136a1-a83f-42aa-8126-76adc5edd7b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.860910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-009136a1-a83f-42aa-8126-76adc5edd7b1 None None] For port 25763a72-aed3-4bd1-b448-7788360bd9db, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=25763a72-aed3-4bd1-b448-7788360bd9db,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:38.911494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52336) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:38.919290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-009136a1-a83f-42aa-8126-76adc5edd7b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.938977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.953704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:38.962754 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/networks/6f5f6325-6e74-4dc0-b84f-6e06b7047bb5 HTTP/1.1" status: 204 len: 168 time: 0.5854805 Dec 21 04:08:38.965257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52342) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:39.056452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-009136a1-a83f-42aa-8126-76adc5edd7b1 None None] Pushing event updated for resources: {'Port': ['ID=25763a72-aed3-4bd1-b448-7788360bd9db,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:39.076059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc77e55-fff3-4e02-ac63-b8a5874a35a0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Network': ['ID=6f5f6325-6e74-4dc0-b84f-6e06b7047bb5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:39.206086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25763a72-aed3-4bd1-b448-7788360bd9db up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:08:39.210873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.295581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-48d0818d-309b-4f58-b7b9-6ca1392ab475 None None] Provisioning complete for port 25763a72-aed3-4bd1-b448-7788360bd9db triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:39.296124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48d0818d-309b-4f58-b7b9-6ca1392ab475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.333905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.353380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 25763a72-aed3-4bd1-b448-7788360bd9db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:39.353756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.370159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['228afe15-f5af-4357-969b-34a61acd5787']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:39.385328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'de1f34aa-1a90-45aa-b802-e6452d3147df') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:39.385710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'de1f34aa-1a90-45aa-b802-e6452d3147df') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:39.401198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.417650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 1dc34ecd-7949-40c6-809a-18bdf936a79c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:39.418246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.419582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.427169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-93576124-4228-4531-9953-04f84b7ca4ee tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:39.427988 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:39.428405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.447919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-93576124-4228-4531-9953-04f84b7ca4ee tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 816 time: 0.3745961 Dec 21 04:08:39.542305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-a2eb22aa-4697-4acd-9e09-e3305ec65bbf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/quotas/d1d48e3ff6704ed3be8064f88e36401f HTTP/1.1" status: 200 len: 375 time: 0.0900078 Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:39.557509 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:39.638926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef25ca86-aeb0-4886-84f7-1cf8034b2a3d req-5671ea07-b857-415c-8de8-9a2b56eb807a tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:39.640440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef25ca86-aeb0-4886-84f7-1cf8034b2a3d req-5671ea07-b857-415c-8de8-9a2b56eb807a tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1905291 Dec 21 04:08:39.652652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.652982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.673907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.691985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:39.695037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-917dbee4-2f6e-49f7-a0cb-d2e0b50df5a2 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1527519 Dec 21 04:08:39.695351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 1dc34ecd-7949-40c6-809a-18bdf936a79c owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:39.704021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/networks/228afe15-f5af-4357-969b-34a61acd5787 HTTP/1.1" status: 204 len: 168 time: 0.7375190 Dec 21 04:08:39.718266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52362) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:39.734370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf0e828-b6bf-441d-8245-4b2d3b8e7e08 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Network': ['ID=228afe15-f5af-4357-969b-34a61acd5787,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:39.832994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef25ca86-aeb0-4886-84f7-1cf8034b2a3d req-c1d6cd4b-a03d-4fac-87eb-6d2d18ac42c4 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1843216 Dec 21 04:08:39.984043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64b19977-009c-483b-8afa-fbdf319e8cf6 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:39.990669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64b19977-009c-483b-8afa-fbdf319e8cf6 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:39.992468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-64b19977-009c-483b-8afa-fbdf319e8cf6 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.2747095 Dec 21 04:08:39.996460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52366) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:39.998474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-bc0d6261-b2bd-472a-ac44-cfcf4106d1f3 service neutron] 10.222.0.18 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2949908 Dec 21 04:08:40.005782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1171865552'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:40.165368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-8c8cad7d-dcf9-4399-94b9-d79724ba0d60 service neutron] 10.222.0.18 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1552832 Dec 21 04:08:40.171134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-880e35dd-cc5b-4cba-a024-e7bae4a2b32a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:40.172171 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-880e35dd-cc5b-4cba-a024-e7bae4a2b32a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 816 time: 0.1353335 Dec 21 04:08:40.195727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Request body: {'port': {'device_id': '06a3967a-a9a8-458f-a229-1510bc81f486', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'admin_state_up': True, 'tenant_id': 'd1d48e3ff6704ed3be8064f88e36401f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:40.233801 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.237173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:40.243626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.318133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=1dc34ecd-7949-40c6-809a-18bdf936a79c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:40.413655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:40.420832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Made reservation on behalf of d1d48e3ff6704ed3be8064f88e36401f for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:40.420832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.507038 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.507614 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Added segment 29cc7d26-f2a7-4080-bb37-2b846cbc1159 of type vlan for network 8e03317e-e56d-449f-8299-adb34404a030 Dec 21 04:08:40.562969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fed504fd-b690-4055-904d-2f4aa50445fd req-efd47b80-7500-4509-a685-113d4e6d8d6a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 210 time: 0.0681169 Dec 21 04:08:40.603947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.605618 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Floating IP d888da9b-98ad-49bd-a5e9-3f31922bf8b1 disassociated (deleted). External IP: 172.25.5.35, port: 7e7cb951-ad6d-4b75-b937-32af19dc55df. Dec 21 04:08:40.716929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Allocated IP 172.20.0.5 (5b94d88b-3288-4137-8290-856f86bd57aa/39078dda-bad6-4dd8-b1ea-bf27b6bdc389/5d271dd6-207e-4d03-a5e9-1b7dd220c01a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:40.732684 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.764062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec8e6bbd-6249-46c1-9a2a-2345e0f4566f req-212cd843-2ea1-4d38-a4a4-2edf71c47438 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:40.772873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec8e6bbd-6249-46c1-9a2a-2345e0f4566f req-212cd843-2ea1-4d38-a4a4-2edf71c47438 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.1972024 Dec 21 04:08:40.928680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec8e6bbd-6249-46c1-9a2a-2345e0f4566f req-c40e168c-48f2-48bf-bba4-de5152e3500c tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1555812 Dec 21 04:08:40.938293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.944502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:40.945121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:40.995490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:41.114335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:41.121487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25763a72-aed3-4bd1-b448-7788360bd9db up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:08:41.191071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Network 5b94d88b-3288-4137-8290-856f86bd57aa is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:41.194616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:41.207255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 25763a72-aed3-4bd1-b448-7788360bd9db triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:41.207636 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:41.212559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:41.273631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:41.274387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:41.316732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Pushing event updated for resources: {'Port': ['ID=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:41.415017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-ab6a112e-12f1-4707-ae41-2c1c5a9c0526 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2264280 Dec 21 04:08:41.436373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Request body: {'port': {'device_id': '06a3967a-a9a8-458f-a229-1510bc81f486', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:41.562284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:41.731834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d784de6-8813-4ef0-899c-90433d2cb5a5 None None] Provisioning complete for port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:41.732213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d784de6-8813-4ef0-899c-90433d2cb5a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:41.771934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4d784de6-8813-4ef0-899c-90433d2cb5a5 None None] Port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:08:41.856765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.8547690 Dec 21 04:08:41.866679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52400) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:41.877156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1631175018'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:41.983345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af1f1104-ec32-4695-8621-767d156958dc req-259509c4-d015-46cc-a483-82f45f9c09d6 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 210 time: 0.1249096 Dec 21 04:08:41.986898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a507b639-e80c-4e5c-b032-062051e577be tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Network': ['ID=8e03317e-e56d-449f-8299-adb34404a030,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:42.001910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8e03317e-e56d-449f-8299-adb34404a030 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:42.021842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router fb1fb678-be5b-4fff-abe6-343b84e37da9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:08:42.024285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-9a6f4fc5-46d5-420f-93b5-a7e9650eb178 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:42.025542 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-9a6f4fc5-46d5-420f-93b5-a7e9650eb178 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 816 time: 0.1959643 Dec 21 04:08:42.047627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Request body: {'port': {'device_id': '1a4912a6-b3aa-498a-98d0-c78532125599', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'admin_state_up': True, 'tenant_id': 'd1d48e3ff6704ed3be8064f88e36401f'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:42.270226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5d271dd6-207e-4d03-a5e9-1b7dd220c01a {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:42.278591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.308030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Transition to ACTIVE for port object 5d271dd6-207e-4d03-a5e9-1b7dd220c01a will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:08:42.310417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:42.313936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.362968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:08:42.370804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.376740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.377371 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] Sync routers for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:08:42.398186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:42.399448 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:42.416486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-44ec2641-d9e7-4e62-8477-2daef77db32f tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/floatingips/d888da9b-98ad-49bd-a5e9-3f31922bf8b1 HTTP/1.1" status: 204 len: 168 time: 3.5038669 Dec 21 04:08:42.419043 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:42.426667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Made reservation on behalf of d1d48e3ff6704ed3be8064f88e36401f for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:42.431927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.434107 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-027d887d-33c0-4d2f-ae97-56f42fa7745c" -d '{"events": [{"name": "network-changed", "server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:42.488413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] vlan segment allocate from pool success with {'vlan_id': 110, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:42.544032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Pushing event updated for resources: {'Port': ['ID=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:42.600684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0ae324-ddd1-4980-856a-0f26e813713d req-456aecca-3605-406d-b3e9-397e003539e5 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:42.602302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed0ae324-ddd1-4980-856a-0f26e813713d req-456aecca-3605-406d-b3e9-397e003539e5 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.2973399 Dec 21 04:08:42.654576 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:42.671803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.677333 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Added segment 75e87a02-5829-4752-961d-1b111349ae1c of type vlan for network f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad Dec 21 04:08:42.807353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Allocated IP 172.20.0.8 (5b94d88b-3288-4137-8290-856f86bd57aa/39078dda-bad6-4dd8-b1ea-bf27b6bdc389/5a96bb11-3aa8-4b71-8da6-aec36cb17cf6) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:42.853035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.970832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:42.989479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed0ae324-ddd1-4980-856a-0f26e813713d req-5a25c25f-815b-4e9f-8e80-da0295d1105d tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3253400 Dec 21 04:08:42.992668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.000111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:43.012464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Attempting to bind port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:43.012838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Attempting to bind port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:43.013183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Attempting to bind port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:43.015204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.028352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a on network 5b94d88b-3288-4137-8290-856f86bd57aa not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:43.030062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Attempting to bind port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:43.040333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:43.045551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Checking segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:43.045965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Bound using segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:43.046426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Bound port: 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:43.046793 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.071541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-3e6ed55a-d0b8-4eca-8a5c-ab80e606c7dc tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:43.077509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-3e6ed55a-d0b8-4eca-8a5c-ab80e606c7dc tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.54 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.5790415 Dec 21 04:08:43.099640 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1401d363-428a-444c-b2a6-2d5d6533fe25 x-openstack-request-id: req-1401d363-428a-444c-b2a6-2d5d6533fe25 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:43.099822 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:43.099924 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1401d363-428a-444c-b2a6-2d5d6533fe25 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:43.100362 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'status': 'completed', 'code': 200} Dec 21 04:08:43.147220 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.175904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.3035464 Dec 21 04:08:43.178387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52418) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:43.227631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:40Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:43.244950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'ports': [{'network_id': '8e03317e-e56d-449f-8299-adb34404a030', 'name': 'tempest-port--350156535', 'admin_state_up': True}, {'network_id': 'f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad', 'admin_state_up': False}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:43.245699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'port': {'network_id': '8e03317e-e56d-449f-8299-adb34404a030', 'name': 'tempest-port--350156535', 'admin_state_up': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:43.246820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'port': {'network_id': 'f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad', 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:43.257598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] For port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:43.261265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] For port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:43.297737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] Checking router: fb1fb678-be5b-4fff-abe6-343b84e37da9 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:08:43.303160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Network 5b94d88b-3288-4137-8290-856f86bd57aa is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:43.307628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:43.309561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Pushing event updated for resources: {'Port': ['ID=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:43.310784 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:43.311787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:43.312417 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:43.362908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.432433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:43.433067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.434523 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] 10.222.0.54 "PUT /v2.0/ports/5d271dd6-207e-4d03-a5e9-1b7dd220c01a HTTP/1.1" status: 200 len: 1092 time: 2.0029004 Dec 21 04:08:43.437709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '06a3967a-a9a8-458f-a229-1510bc81f486', 'tag': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:43.439912 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96b377c5-ec91-4228-bc1d-9dcc90c011d0" -d '{"events": [{"name": "network-changed", "server_uuid": "06a3967a-a9a8-458f-a229-1510bc81f486", "tag": "5d271dd6-207e-4d03-a5e9-1b7dd220c01a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:43.516993 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:43.523313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:43.524808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.679352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6434042-5d76-40d7-b9b5-0e5f58c97e71 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Network': ['ID=f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:43.689923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:43.695595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d5e5d5e-4b11-404e-b4b6-ffc3f2243e9f req-57b051b3-7f36-46d3-876a-d4c508dfa1f7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 210 time: 0.5158753 Dec 21 04:08:43.702690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-4ea9eaf5-4c3e-4b8f-a81e-0bc3ea8827b5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:43.718528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-4ea9eaf5-4c3e-4b8f-a81e-0bc3ea8827b5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.31 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 816 time: 0.5400999 Dec 21 04:08:43.847164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fceb48dc-f8ea-4eba-9921-abdd58a71ac5 None None] Provisioning complete for port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:43.847164 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fceb48dc-f8ea-4eba-9921-abdd58a71ac5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:43.878330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Request body: {'port': {'device_id': 'f165f769-565a-4128-b62b-0cccedb7404c', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'admin_state_up': True, 'tenant_id': 'd1d48e3ff6704ed3be8064f88e36401f'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:43.959534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fceb48dc-f8ea-4eba-9921-abdd58a71ac5 None None] Port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:08:44.148101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-c698acc1-dbef-4782-83ce-85a7a2214f2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.149621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-c698acc1-dbef-4782-83ce-85a7a2214f2e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 1097 time: 0.9489045 Dec 21 04:08:44.171317 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:40Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:44.196919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81098e4d-6c2e-45b2-82f4-7c71bafd3eab req-fbe0282c-5e95-4c50-95c2-39da4c050136 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.204379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81098e4d-6c2e-45b2-82f4-7c71bafd3eab req-fbe0282c-5e95-4c50-95c2-39da4c050136 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.8569229 Dec 21 04:08:44.208065 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a93fd90a-4eb5-4a70-9971-612706f7d0af None None] The sync data for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 is: [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:07:35Z', 'revision_number': 4, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'a0751ded-47c2-4d5b-8743-170d5a27a3e7', 'name': '', 'network_id': 'f740899e-9cdc-4671-abdd-e69decd81dc4', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'mac_address': 'fa:16:3e:89:ea:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_interface', 'standard_attr_id': 2552, 'fixed_ips': [{'subnet_id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:33Z', 'updated_at': '2021-12-21T04:07:40Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'subnets': [{'id': '0e2ee440-32ec-4001-87d7-31af9f807755', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:08:44.304019 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a17a772-aaf1-4737-8fd7-f0d00df85fb1 x-openstack-request-id: req-3a17a772-aaf1-4737-8fd7-f0d00df85fb1 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:44.304531 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "06a3967a-a9a8-458f-a229-1510bc81f486", "tag": "5d271dd6-207e-4d03-a5e9-1b7dd220c01a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:44.304531 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3a17a772-aaf1-4737-8fd7-f0d00df85fb1 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:44.304965 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '06a3967a-a9a8-458f-a229-1510bc81f486', 'tag': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a', 'status': 'completed', 'code': 200} Dec 21 04:08:44.320250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-d3a20df0-d789-4670-8a8b-0375d36f2f42 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2749908 Dec 21 04:08:44.345131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'port': 2} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:44.347853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Request body: {'port': {'device_id': '1a4912a6-b3aa-498a-98d0-c78532125599', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:44.350879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.383885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-d2b8ac9a-55b1-4489-93bb-5f7fa7f78c16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.384977 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-d2b8ac9a-55b1-4489-93bb-5f7fa7f78c16 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 1095 time: 0.8154047 Dec 21 04:08:44.387929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b49adc8b-203f-4ea0-8007-cb10545ab987 service neutron] Pushing event updated for resources: {'Port': ['ID=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:44.414128 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.417523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Deleting port 721def25-5a4e-4a17-8cc8-1cd9069fa724 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:44.417856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.435562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81098e4d-6c2e-45b2-82f4-7c71bafd3eab req-f66a1bce-00f0-43e9-8cb1-de589d288c36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2302032 Dec 21 04:08:44.473513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-f1ba7372-90f1-40f4-8585-d391e220bec7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a HTTP/1.1" status: 200 len: 217 time: 0.0716271 Dec 21 04:08:44.476158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.575939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] For port 721def25-5a4e-4a17-8cc8-1cd9069fa724, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=721def25-5a4e-4a17-8cc8-1cd9069fa724,segment=NetworkSegment(5246b0d5-be51-4fbd-bd3d-5b858f316c8d),segment_id=5246b0d5-be51-4fbd-bd3d-5b858f316c8d)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:44.576317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.592961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Calling delete_port for 721def25-5a4e-4a17-8cc8-1cd9069fa724 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:44.653174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da3b579e-cb9a-44a4-8982-0cf826de8a6c None None] New status for floating IP d888da9b-98ad-49bd-a5e9-3f31922bf8b1: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:08:44.672778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd41fca-ea1a-4458-afbb-78cd74469f3b req-3ffdf72e-8a82-4947-bc92-6116d73acf3a tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.674717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fd41fca-ea1a-4458-afbb-78cd74469f3b req-3ffdf72e-8a82-4947-bc92-6116d73acf3a tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 945 time: 0.4932671 Dec 21 04:08:44.683465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Made reservation on behalf of d1d48e3ff6704ed3be8064f88e36401f for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:44.687381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.709969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-a8179830-6bdf-4aee-863f-21de759aec2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.711741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-a8179830-6bdf-4aee-863f-21de759aec2c service neutron] 10.222.0.31 "GET /v2.0/networks?id=f740899e-9cdc-4671-abdd-e69decd81dc4 HTTP/1.1" status: 200 len: 897 time: 0.5468891 Dec 21 04:08:44.814867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:44.824111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.837818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Transition to ACTIVE for port object 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:08:44.841067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-d1a0e28b-18c1-45a4-bb6b-1da3ebec5c3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.845849 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-d1a0e28b-18c1-45a4-bb6b-1da3ebec5c3e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.3550739 Dec 21 04:08:44.918343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b17b552d-d1ee-43f2-b839-ea9ebc75d39e req-293f7642-ce78-4568-b0ee-1a90220fe7e5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 210 time: 0.1047320 Dec 21 04:08:44.959035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:44.978680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-1286c1c7-835e-440d-8fe0-a4f6bb69bb55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:44.980497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-1286c1c7-835e-440d-8fe0-a4f6bb69bb55 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1281157 Dec 21 04:08:45.032448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c65fbe17-1454-43b9-b94f-515ced6531d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:45.034291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c65fbe17-1454-43b9-b94f-515ced6531d5 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.1259992 Dec 21 04:08:45.211829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fd41fca-ea1a-4458-afbb-78cd74469f3b req-aab3e4b9-15de-4035-bef0-a274165d9adc tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/security-groups?id=ce56e19f-28f0-4d2f-ad33-212cfeb535ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5214901 Dec 21 04:08:45.217380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-30a17486-c563-4d39-8cbb-e1b026b8fff6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df HTTP/1.1" status: 200 len: 217 time: 0.4678571 Dec 21 04:08:45.302817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Pushing event updated for resources: {'Port': ['ID=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:45.320247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-21757152-8deb-471b-a32c-07ccdd4963fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:45.324823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-21757152-8deb-471b-a32c-07ccdd4963fd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0e2ee440-32ec-4001-87d7-31af9f807755 HTTP/1.1" status: 200 len: 835 time: 0.0922804 Dec 21 04:08:45.381870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] device_id is not set on port be306626-1c1b-42e4-a1ef-dcb5ee3443e0 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:45.404600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 7e7cb951-ad6d-4b75-b937-32af19dc55df {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:45.405166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:45.465408 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-7a157559-dbaf-4b38-bc9c-ba8efd0b9647 service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4505167 Dec 21 04:08:45.470505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Attempting to bind port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:45.470846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Attempting to bind port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:45.471301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Attempting to bind port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:45.524406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 on network 5b94d88b-3288-4137-8290-856f86bd57aa not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:45.524595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Attempting to bind port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:45.528002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Allocated IP 172.20.0.9 (5b94d88b-3288-4137-8290-856f86bd57aa/39078dda-bad6-4dd8-b1ea-bf27b6bdc389/0c919ed6-4d65-46fc-9b58-b09a5e3a5533) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:45.561988 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:45.562378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Checking segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:45.562632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Bound using segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:45.563223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Bound port: 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:45.563589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:45.695412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] For port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:45.698718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] For port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:45.711512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port 7e7cb951-ad6d-4b75-b937-32af19dc55df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7e7cb951-ad6d-4b75-b937-32af19dc55df,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:45.711881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:45.731592 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:45.736625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 7e7cb951-ad6d-4b75-b937-32af19dc55df owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:45.748944 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ca8e569b-e906-4a77-9b5e-da89680aab8f req-f2daef7c-53d6-4ddc-ba55-cfe1d8688e08 service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2417643 Dec 21 04:08:45.797871 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:45.841317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:45.842253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:45.844169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] 10.222.0.54 "PUT /v2.0/ports/5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 HTTP/1.1" status: 200 len: 1092 time: 1.5019774 Dec 21 04:08:45.899874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e9a9b14-ea3e-4233-8f4f-f111ede60722 service neutron] Pushing event updated for resources: {'Port': ['ID=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:45.924904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-e69aba78-c8a6-4e1c-916c-94d399c473b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:45.928865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-e69aba78-c8a6-4e1c-916c-94d399c473b2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f740899e-9cdc-4671-abdd-e69decd81dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.5856297 Dec 21 04:08:46.043034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.057173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 721def25-5a4e-4a17-8cc8-1cd9069fa724 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:46.083048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.084451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-e552d59f-589a-41d5-ac81-78303f89b4dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.085988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 721def25-5a4e-4a17-8cc8-1cd9069fa724 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:46.086559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 721def25-5a4e-4a17-8cc8-1cd9069fa724 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:46.087285 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-e552d59f-589a-41d5-ac81-78303f89b4dc service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 1095 time: 0.1437519 Dec 21 04:08:46.095812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-4c66e124-8fe0-4263-8d31-9c63359828d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.097420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-4c66e124-8fe0-4263-8d31-9c63359828d1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 1095 time: 0.0827007 Dec 21 04:08:46.127084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.172729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062c1d9b-6f3a-438b-9357-2fe8ea3c6d78 req-6dab8bdc-85a9-44be-9ef3-3f9e1dbdf806 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.174476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-062c1d9b-6f3a-438b-9357-2fe8ea3c6d78 req-6dab8bdc-85a9-44be-9ef3-3f9e1dbdf806 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 945 time: 0.4322236 Dec 21 04:08:46.186534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648dd232-5aa3-4d04-806f-cb6077e9ed21 req-6b361145-6aa7-4f0f-a32c-893e07b45bfc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.188852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-648dd232-5aa3-4d04-806f-cb6077e9ed21 req-6b361145-6aa7-4f0f-a32c-893e07b45bfc tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 945 time: 0.4491296 Dec 21 04:08:46.199740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-95c47e41-cf4a-461e-ad55-a86d47ca2898 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 HTTP/1.1" status: 200 len: 217 time: 0.0702243 Dec 21 04:08:46.208119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Pushing event deleted for resources: {'Port': ['ID=721def25-5a4e-4a17-8cc8-1cd9069fa724,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:46.214139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Network 5b94d88b-3288-4137-8290-856f86bd57aa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:46.239629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.305628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-9dd06c69-a244-4f18-a99a-f30646d866c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.307168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-9dd06c69-a244-4f18-a99a-f30646d866c8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.0594854 Dec 21 04:08:46.318423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a4912a6-b3aa-498a-98d0-c78532125599', 'tag': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:46.321675 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b751de3d-70ab-4526-832d-5a5f1a75b8c4" -d '{"events": [{"name": "network-changed", "server_uuid": "1a4912a6-b3aa-498a-98d0-c78532125599", "tag": "5a96bb11-3aa8-4b71-8da6-aec36cb17cf6"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:46.351194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Pushing event updated for resources: {'Port': ['ID=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:46.360488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=7e7cb951-ad6d-4b75-b937-32af19dc55df,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:46.370742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:46.436570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] No DVR routers for this DVR port 7e7cb951-ad6d-4b75-b937-32af19dc55df on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:46.439775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.463469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.31 "DELETE /v2.0/ports/7e7cb951-ad6d-4b75-b937-32af19dc55df HTTP/1.1" status: 204 len: 173 time: 1.4222088 Dec 21 04:08:46.490622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-611fc1ec-b6a3-4399-aad5-f5e5bb9ed953 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.490622 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-611fc1ec-b6a3-4399-aad5-f5e5bb9ed953 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 917 time: 0.3920527 Dec 21 04:08:46.496531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-dc9e8e37-40d5-4cce-b1a3-5ab62237fe4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:46.498129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-dc9e8e37-40d5-4cce-b1a3-5ab62237fe4a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1728971 Dec 21 04:08:46.515948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] device_id is not set on port 65c2b4c8-b3f8-4e7c-ba12-feea0ad680b5 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:08:46.620968 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-dbe35a93-2990-46af-9f4f-9487209ad7ef service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1128466 Dec 21 04:08:46.658178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:46.665931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-648dd232-5aa3-4d04-806f-cb6077e9ed21 req-7038f4fa-15ba-4e3e-8d35-07de32a84ded tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/security-groups?id=78584b55-c6e0-45de-b709-b3a2ecd4ad06&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.4057457 Dec 21 04:08:46.666708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] No DVR routers for this DVR port 721def25-5a4e-4a17-8cc8-1cd9069fa724 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:46.681939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.686002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.54 "DELETE /v2.0/ports/721def25-5a4e-4a17-8cc8-1cd9069fa724 HTTP/1.1" status: 204 len: 173 time: 3.5750120 Dec 21 04:08:46.686787 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-aef87257-b12c-4c1e-9fd9-a3a0cc9282d5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a HTTP/1.1" status: 200 len: 217 time: 0.1855185 Dec 21 04:08:46.713313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'name': 'network-vif-deleted', 'tag': '721def25-5a4e-4a17-8cc8-1cd9069fa724'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:46.715982 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-194df1b7-070e-47ce-b38f-bcc4091fe580" -d '{"events": [{"server_uuid": "aed7bec6-e3e9-4eba-a153-59ca6b3c3796", "name": "network-vif-deleted", "tag": "721def25-5a4e-4a17-8cc8-1cd9069fa724"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:46.742837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e5878096-dc7c-40db-b469-ea1c25a0b85c None None] Provisioning complete for port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:46.749739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e5878096-dc7c-40db-b469-ea1c25a0b85c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.775143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:46.816191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e5878096-dc7c-40db-b469-ea1c25a0b85c None None] Port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:08:46.868840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-509742f3-4e4b-4e3a-b02c-9d704a49f215 service neutron] 10.222.0.31 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8206515 Dec 21 04:08:46.885182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-062c1d9b-6f3a-438b-9357-2fe8ea3c6d78 req-02f37ca7-8f9d-47ed-bff5-c53a91bcc276 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6951857 Dec 21 04:08:47.016334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-1116c5cf-cc48-4736-84ef-6bd0d4c0ec9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.019384 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-1116c5cf-cc48-4736-84ef-6bd0d4c0ec9c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.3017309 Dec 21 04:08:47.120132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4ebc511-5e90-4268-99ed-7e3924f6a3cd req-82a264b8-6da6-4e09-addd-ef198ce59b5c service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4675078 Dec 21 04:08:47.147976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-34698628-4f72-4f3b-9a1d-7269ddb323a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.149825 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-34698628-4f72-4f3b-9a1d-7269ddb323a6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1055734 Dec 21 04:08:47.299910 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-6d4ce6e2-ad44-4994-90c7-76d3f85c770c service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391220 Dec 21 04:08:47.309933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-381edaee-4c1b-4d0f-9c58-1c693d1280a8 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.311677 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-381edaee-4c1b-4d0f-9c58-1c693d1280a8 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 945 time: 0.0806262 Dec 21 04:08:47.364215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.365717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:47.435466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80601627-e517-4d15-af05-5dde6b160c19 req-bf061fbd-ea26-4bc9-8744-21cd1d0fa2b4 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] 10.222.0.18 "GET /v2.0/ports?device_id=aed7bec6-e3e9-4eba-a153-59ca6b3c3796 HTTP/1.1" status: 200 len: 210 time: 0.0785315 Dec 21 04:08:47.492703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e13f32-741b-415c-bc8f-c7bc22db5282 req-8c19b2ed-c628-4a35-818e-3e371097b67e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.494481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68e13f32-741b-415c-bc8f-c7bc22db5282 req-8c19b2ed-c628-4a35-818e-3e371097b67e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 931 time: 0.6643763 Dec 21 04:08:47.500492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-c8c67f90-6657-4765-925d-d7a8af83eb3b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.6346383 Dec 21 04:08:47.502428 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-96b377c5-ec91-4228-bc1d-9dcc90c011d0 req-d428529a-49fa-4a0b-9271-9da3ba1a0356 service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1897769 Dec 21 04:08:47.521008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Deleting port 524a3677-f175-4542-a3c6-7039ad8256ba {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:47.521391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:47.562304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Request body: {'port': {'device_id': 'f165f769-565a-4128-b62b-0cccedb7404c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:47.570354 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30ff3d51-da63-4e97-8ac1-9281d8873d45 x-openstack-request-id: req-30ff3d51-da63-4e97-8ac1-9281d8873d45 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:47.570643 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a4912a6-b3aa-498a-98d0-c78532125599", "tag": "5a96bb11-3aa8-4b71-8da6-aec36cb17cf6", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:47.570898 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-30ff3d51-da63-4e97-8ac1-9281d8873d45 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:47.571307 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a4912a6-b3aa-498a-98d0-c78532125599', 'tag': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6', 'status': 'completed', 'code': 200} Dec 21 04:08:47.578878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:47.611990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-027d887d-33c0-4d2f-ae97-56f42fa7745c req-2f80f9dc-741c-494d-ad9d-c6f3db5496c2 service neutron] 10.222.0.31 "GET /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7225103 Dec 21 04:08:47.673672 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49c77cef-235a-4af5-8fab-bb8aba7d2f2f x-openstack-request-id: req-49c77cef-235a-4af5-8fab-bb8aba7d2f2f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:47.674026 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aed7bec6-e3e9-4eba-a153-59ca6b3c3796", "name": "network-vif-deleted", "tag": "721def25-5a4e-4a17-8cc8-1cd9069fa724", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:47.674228 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-49c77cef-235a-4af5-8fab-bb8aba7d2f2f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:47.674653 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aed7bec6-e3e9-4eba-a153-59ca6b3c3796', 'name': 'network-vif-deleted', 'tag': '721def25-5a4e-4a17-8cc8-1cd9069fa724', 'status': 'completed', 'code': 200} Dec 21 04:08:47.679278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Port': ['ID=be306626-1c1b-42e4-a1ef-dcb5ee3443e0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:47.718313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] For port 524a3677-f175-4542-a3c6-7039ad8256ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=524a3677-f175-4542-a3c6-7039ad8256ba,segment=NetworkSegment(14fbbca6-7072-4909-b9a3-3ca17b26245e),segment_id=14fbbca6-7072-4909-b9a3-3ca17b26245e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:47.718686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:47.723913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68e13f32-741b-415c-bc8f-c7bc22db5282 req-09f5aaf6-071a-435a-b259-e78ff910fc71 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1982734 Dec 21 04:08:47.754309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-9353b70b-2215-45b8-935c-8430239124f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.758676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-9353b70b-2215-45b8-935c-8430239124f2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 1095 time: 0.1182086 Dec 21 04:08:47.771772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Calling delete_port for 524a3677-f175-4542-a3c6-7039ad8256ba owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:47.846482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a48e6b3d-f2a3-4f5c-8f1a-6e876f7b38d4 req-6b9e6939-985b-4782-a79b-fd280a76e214 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "GET /v2.0/ports?device_id=6da2216e-3241-4799-a038-75e352ad057d HTTP/1.1" status: 200 len: 210 time: 0.0397983 Dec 21 04:08:47.848624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:47.865374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Checking segment: {'id': '29cc7d26-f2a7-4080-bb37-2b846cbc1159', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '8e03317e-e56d-449f-8299-adb34404a030'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:47.866344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network hostable DHCP agents. Network: 8e03317e-e56d-449f-8299-adb34404a030, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:47.903394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-27729c93-089d-4a5b-a52a-ba3f45cda0d8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1306291 Dec 21 04:08:47.929094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-3c4cdb8d-516d-4d3e-ae8b-3f1957c6f5c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:47.929094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-3c4cdb8d-516d-4d3e-ae8b-3f1957c6f5c5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 917 time: 0.1570077 Dec 21 04:08:48.000650 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-ab3a03d9-cd63-4279-a7c4-6bb02be52950 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 HTTP/1.1" status: 200 len: 217 time: 0.0644383 Dec 21 04:08:48.012704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network 8e03317e-e56d-449f-8299-adb34404a030 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:48.085729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5d271dd6-207e-4d03-a5e9-1b7dd220c01a details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:08:48.113596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-442700a3-6a9a-47b3-9547-28ef85d43db3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.114954 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-442700a3-6a9a-47b3-9547-28ef85d43db3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.1061611 Dec 21 04:08:48.143861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8e03317e-e56d-449f-8299-adb34404a030) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:48.155969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:48.156835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.185087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-99e4431a-205a-4143-af4c-1f7784a379a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.186955 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-99e4431a-205a-4143-af4c-1f7784a379a3 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0619640 Dec 21 04:08:48.187910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.213775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:48.229891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'port_id': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a', 'mac_address': 'fa:16:3e:17:f3:cc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '39078dda-bad6-4dd8-b1ea-bf27b6bdc389', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:08:48.232914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15b79e5b-324c-4eb2-8e40-69fbc0fae547 None None] Network 8e03317e-e56d-449f-8299-adb34404a030 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:48.234280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Pushing event deleted for resources: {'Port': ['ID=524a3677-f175-4542-a3c6-7039ad8256ba,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:48.235196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['524a3677-f175-4542-a3c6-7039ad8256ba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:48.247071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8168d943-822a-414e-b56f-def7ec67ea6b req-43c625aa-8df9-41d3-8473-c468c28f7c9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.248576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-43c625aa-8df9-41d3-8473-c468c28f7c9e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f578ba291d54826a6db2accb249f808&device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 1098 time: 0.2500179 Dec 21 04:08:48.278073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Port': ['ID=65c2b4c8-b3f8-4e7c-ba12-feea0ad680b5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:48.294502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6acfbda9-3de4-4f13-b485-b5befd1da5b2 req-dda354b2-1862-4664-a100-fc63925593c2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.296076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6acfbda9-3de4-4f13-b485-b5befd1da5b2 req-dda354b2-1862-4664-a100-fc63925593c2 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/ports?device_id=6dfba92b-f125-4060-8fa6-204454367110 HTTP/1.1" status: 200 len: 867 time: 0.2610264 Dec 21 04:08:48.385982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] No DVR routers for this DVR port 524a3677-f175-4542-a3c6-7039ad8256ba on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:48.388781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.391168 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.394851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d40a7c25-5815-48d5-8308-1ba5d7d4ef45 req-794ee8f6-e350-4189-b0eb-43085ef0fdd1 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.54 "DELETE /v2.0/ports/524a3677-f175-4542-a3c6-7039ad8256ba HTTP/1.1" status: 204 len: 173 time: 1.0626602 Dec 21 04:08:48.414082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5d271dd6-207e-4d03-a5e9-1b7dd220c01a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:48.426363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Checking segment: {'id': '75e87a02-5829-4752-961d-1b111349ae1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': 'f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:48.427033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network hostable DHCP agents. Network: f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:48.442066 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-ebb389ba-fc0e-4139-ab74-60479f10a244 service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2130532 Dec 21 04:08:48.449129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:48.485695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7e7cb951-ad6d-4b75-b937-32af19dc55df no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:48.505324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6acfbda9-3de4-4f13-b485-b5befd1da5b2 req-2fdce036-b0da-4757-a42a-e7278664a924 tempest-AttachVolumeNegativeTest-347883579 tempest-AttachVolumeNegativeTest-347883579-project] 10.222.0.18 "GET /v2.0/security-groups?id=263b6fe6-c124-4b9f-898a-5bbe82f435fd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1939118 Dec 21 04:08:48.514774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:48.529765 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.542849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52540) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:48.543468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8168d943-822a-414e-b56f-def7ec67ea6b req-4da1560e-1359-466e-8361-550bfa122fe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.543468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-4da1560e-1359-466e-8361-550bfa122fe5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 200 len: 912 time: 0.2393806 Dec 21 04:08:48.549295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Transition to ACTIVE for port object 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:08:48.552525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 7e7cb951-ad6d-4b75-b937-32af19dc55df {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:48.553073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7e7cb951-ad6d-4b75-b937-32af19dc55df not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:48.562764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.607679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b751de3d-70ab-4526-832d-5a5f1a75b8c4 req-efee9245-a140-4c15-9359-4ca4f762c6f5 service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1575975 Dec 21 04:08:48.615355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.619598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Deleting subnet c89d12e6-9dc6-46e4-be88-39773c8bf0e9 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:48.621194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:48.626429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.640904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:48.678482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.683431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-df5ef6a5-ebcc-4a7e-878c-1bd2e17424d5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd HTTP/1.1" status: 200 len: 1001 time: 0.1278088 Dec 21 04:08:48.703869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Pushing event updated for resources: {'Port': ['ID=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:48.734968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.750564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:48.764647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4a9efbc-fd01-455f-80fc-f6ac705ac49f None None] Network f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:48.777328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:48.783231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.789133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.789915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.835932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8168d943-822a-414e-b56f-def7ec67ea6b req-d04dee93-a7a6-4362-9933-cdec3fc29719 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:48.837482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-d04dee93-a7a6-4362-9933-cdec3fc29719 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 200 len: 850 time: 0.1414726 Dec 21 04:08:48.852333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5d271dd6-207e-4d03-a5e9-1b7dd220c01a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:48.910482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Attempting to bind port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:48.911047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Attempting to bind port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:48.911162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Attempting to bind port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:48.915211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.923029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 on network 5b94d88b-3288-4137-8290-856f86bd57aa not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:08:48.923462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Attempting to bind port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 on network 5b94d88b-3288-4137-8290-856f86bd57aa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:48.936348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:48.936634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Checking segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:48.937017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Bound using segment: {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:48.937460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Bound port: 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38c210ca-73e5-429b-b74e-20455218ed07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:48.937817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.963730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bf4cd0ad-416a-481e-801b-15a07adc1262 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1449 time: 5.7210073 Dec 21 04:08:48.972986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52562) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:48.978005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52564) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:48.989781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c89d12e6-9dc6-46e4-be88-39773c8bf0e9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:48.994652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:48.998497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d01852ed-2ed5-414e-aa28-f6afdfcecf94 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/c89d12e6-9dc6-46e4-be88-39773c8bf0e9 HTTP/1.1" status: 204 len: 168 time: 0.4607739 Dec 21 04:08:49.008006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:49.045939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8168d943-822a-414e-b56f-def7ec67ea6b req-4a003e46-3cf6-4617-a2c8-5190fc07547f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.047508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-4a003e46-3cf6-4617-a2c8-5190fc07547f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e94ae2ca-4e3f-4500-90fd-ec494b399bda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1979039 Dec 21 04:08:49.096348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1f8d2c-51e8-4c4d-81d5-c4ef63ba3a77 req-425d35c7-3f90-48c6-8d91-e189f88aed93 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.098369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c1f8d2c-51e8-4c4d-81d5-c4ef63ba3a77 req-425d35c7-3f90-48c6-8d91-e189f88aed93 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 943 time: 0.2385626 Dec 21 04:08:49.136837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.144120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80171805-853d-4f4a-a708-7ad23d6708ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.206196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f36532ae-4836-4a08-b6c4-5ed1d32137ee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.213732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f36532ae-4836-4a08-b6c4-5ed1d32137ee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.214666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80171805-853d-4f4a-a708-7ad23d6708ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.221029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f36532ae-4836-4a08-b6c4-5ed1d32137ee tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1444 time: 0.2413695 Dec 21 04:08:49.223291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:49.246967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] For port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:49.274840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] For port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:49.283673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c1f8d2c-51e8-4c4d-81d5-c4ef63ba3a77 req-24f24d5a-9f01-4acb-99d2-1988db0cf28d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1660209 Dec 21 04:08:49.290179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-2e957d2c-5b22-4daf-b9e4-6a87aa1f8a3b service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2120442 Dec 21 04:08:49.370952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.414881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.415545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.416992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] 10.222.0.31 "PUT /v2.0/ports/0c919ed6-4d65-46fc-9b58-b09a5e3a5533 HTTP/1.1" status: 200 len: 1092 time: 1.8929274 Dec 21 04:08:49.459827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8168d943-822a-414e-b56f-def7ec67ea6b req-6f6a89a1-d2aa-4698-acd3-62b240aa5d1a service neutron] 10.222.0.31 "GET /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1585126 Dec 21 04:08:49.460955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b6ea8e-9491-458a-b8e2-6985da5a7607 service neutron] Pushing event updated for resources: {'Port': ['ID=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:49.617078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-68dcbf58-0d11-42ec-9a97-0681babcc8a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.618767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-68dcbf58-0d11-42ec-9a97-0681babcc8a2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 1095 time: 0.0669596 Dec 21 04:08:49.632402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52604) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:49.675298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f165f769-565a-4128-b62b-0cccedb7404c', 'tag': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:49.678150 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54a77475-00c2-45dd-87eb-b148478ec81a" -d '{"events": [{"name": "network-changed", "server_uuid": "f165f769-565a-4128-b62b-0cccedb7404c", "tag": "0c919ed6-4d65-46fc-9b58-b09a5e3a5533"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:49.717663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-098bad61-7909-4244-bfd9-73704912e973 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533 HTTP/1.1" status: 200 len: 217 time: 0.0547843 Dec 21 04:08:49.729650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'name': 'network-vif-deleted', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df'}, {'server_uuid': '6dfba92b-f125-4060-8fa6-204454367110', 'name': 'network-vif-deleted', 'tag': '524a3677-f175-4542-a3c6-7039ad8256ba'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:49.730670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Deleting subnet f6eb37b9-316b-4d85-9044-455f8831b074 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:49.731919 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f39550d3-97ca-4691-a117-691e931912e2" -d '{"events": [{"server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "name": "network-vif-deleted", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df"}, {"server_uuid": "6dfba92b-f125-4060-8fa6-204454367110", "name": "network-vif-deleted", "tag": "524a3677-f175-4542-a3c6-7039ad8256ba"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:49.734305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.757007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.788612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d720eb29-79ba-4dbb-9b4e-aadb9e658ede']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:49.803780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5246b0d5-be51-4fbd-bd3d-5b858f316c8d') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:49.804424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5246b0d5-be51-4fbd-bd3d-5b858f316c8d') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:49.817625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.821881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.823080 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-352497c6-e44b-4c2a-948f-4ba908ab3492 x-openstack-request-id: req-352497c6-e44b-4c2a-948f-4ba908ab3492 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:49.823222 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32b25925-5754-4f01-b2a2-40b19c3a189d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.823663 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f165f769-565a-4128-b62b-0cccedb7404c", "tag": "0c919ed6-4d65-46fc-9b58-b09a5e3a5533", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:49.823663 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-352497c6-e44b-4c2a-948f-4ba908ab3492 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:49.823663 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f165f769-565a-4128-b62b-0cccedb7404c', 'tag': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533', 'status': 'completed', 'code': 200} Dec 21 04:08:49.843732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.848850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Deleting port be306626-1c1b-42e4-a1ef-dcb5ee3443e0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:49.849424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.855195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-0189b48d-a33a-4848-9119-ba5cb21181ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.856824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-0189b48d-a33a-4848-9119-ba5cb21181ae service neutron] 10.222.0.31 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.1019940 Dec 21 04:08:49.859140 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-326f6db0-1ec9-449b-9f3e-303ecedeae48 x-openstack-request-id: req-326f6db0-1ec9-449b-9f3e-303ecedeae48 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:49.863615 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6da2216e-3241-4799-a038-75e352ad057d", "name": "network-vif-deleted", "tag": "7e7cb951-ad6d-4b75-b937-32af19dc55df", "status": "completed", "code": 200}, {"server_uuid": "6dfba92b-f125-4060-8fa6-204454367110", "name": "network-vif-deleted", "tag": "524a3677-f175-4542-a3c6-7039ad8256ba", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:49.863615 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-326f6db0-1ec9-449b-9f3e-303ecedeae48 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:49.863615 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6da2216e-3241-4799-a038-75e352ad057d', 'name': 'network-vif-deleted', 'tag': '7e7cb951-ad6d-4b75-b937-32af19dc55df', 'status': 'completed', 'code': 200} Dec 21 04:08:49.863615 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6dfba92b-f125-4060-8fa6-204454367110', 'name': 'network-vif-deleted', 'tag': '524a3677-f175-4542-a3c6-7039ad8256ba', 'status': 'completed', 'code': 200} Dec 21 04:08:49.881035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.901480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:49.901917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:49.903653 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:49.906899 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:49.965692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-89626cf1-627a-4f2d-8907-10166a3336a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:49.967102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-89626cf1-627a-4f2d-8907-10166a3336a4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0836990 Dec 21 04:08:49.977441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80171805-853d-4f4a-a708-7ad23d6708ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.980051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80171805-853d-4f4a-a708-7ad23d6708ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:49.983612 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80171805-853d-4f4a-a708-7ad23d6708ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/security-groups/78584b55-c6e0-45de-b709-b3a2ecd4ad06 HTTP/1.1" status: 204 len: 168 time: 1.0015936 Dec 21 04:08:50.011600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.021357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80171805-853d-4f4a-a708-7ad23d6708ef tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=78584b55-c6e0-45de-b709-b3a2ecd4ad06,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.033491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Calling delete_port for be306626-1c1b-42e4-a1ef-dcb5ee3443e0 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:50.044300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.076325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52634) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:50.082995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f6eb37b9-316b-4d85-9044-455f8831b074,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.086749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:08:50.089607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.094795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-85918a01-abcb-4555-9f5c-210d74a9d1eb admin admin] 10.222.0.18 "DELETE /v2.0/subnets/f6eb37b9-316b-4d85-9044-455f8831b074 HTTP/1.1" status: 204 len: 168 time: 0.4642091 Dec 21 04:08:50.104354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52636) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:50.108700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.110307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5d271dd6-207e-4d03-a5e9-1b7dd220c01a up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:08:50.116215 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.123837 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] 10.222.0.18 "DELETE /v2.0/networks/d720eb29-79ba-4dbb-9b4e-aadb9e658ede HTTP/1.1" status: 204 len: 168 time: 1.1147811 Dec 21 04:08:50.127303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52640) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:50.169490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17a3cf5-6615-4d24-aa24-b89481a5688e admin admin] Pushing event deleted for resources: {'Network': ['ID=d720eb29-79ba-4dbb-9b4e-aadb9e658ede,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.215294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Deleting subnet d3de5758-ad72-494f-a505-4655da315158 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:50.223985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.267926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.273489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:50.285246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-375e0852-2d0a-49f7-83b0-264cc7843b00 service neutron] 10.222.0.31 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3054521 Dec 21 04:08:50.287282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'port_id': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6', 'mac_address': 'fa:16:3e:f1:ae:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '39078dda-bad6-4dd8-b1ea-bf27b6bdc389', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:08:50.327863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.332436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.336586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.342170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:08:50.351464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:50.358478 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.358478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:50.412010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.417291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:50.461809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.468832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/ports/be306626-1c1b-42e4-a1ef-dcb5ee3443e0 HTTP/1.1" status: 204 len: 168 time: 1.2418232 Dec 21 04:08:50.468832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da2dfc6a-2a96-486f-9de9-24c0998580eb tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Port': ['ID=be306626-1c1b-42e4-a1ef-dcb5ee3443e0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.479277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52660) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:50.479277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.480289 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.535286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.535521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d3de5758-ad72-494f-a505-4655da315158,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.537777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.543862 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5a1bc0cc-2bfc-4d25-bc24-426e86f8133c admin admin] 10.222.0.18 "DELETE /v2.0/subnets/d3de5758-ad72-494f-a505-4655da315158 HTTP/1.1" status: 204 len: 168 time: 0.4134624 Dec 21 04:08:50.546873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:50.582530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '06a3967a-a9a8-458f-a229-1510bc81f486', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:50.582873 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee6ad551-5e0c-4e90-b077-2c9e386c4277" -d '{"events": [{"server_uuid": "06a3967a-a9a8-458f-a229-1510bc81f486", "name": "network-vif-plugged", "status": "completed", "tag": "5d271dd6-207e-4d03-a5e9-1b7dd220c01a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:50.587714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.599730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:50.661686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.663691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 524a3677-f175-4542-a3c6-7039ad8256ba no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:50.693764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 524a3677-f175-4542-a3c6-7039ad8256ba {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:50.702860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 524a3677-f175-4542-a3c6-7039ad8256ba not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:50.703071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3279ad4e-6249-4f09-b38a-703a32495d39 req-9d20fc81-04e6-4b76-80c7-be2274c56753 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:50.703071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3279ad4e-6249-4f09-b38a-703a32495d39 req-9d20fc81-04e6-4b76-80c7-be2274c56753 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 943 time: 0.2615447 Dec 21 04:08:50.703071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a07f19b9-e544-46f3-b939-eb017a5e81f4 req-e366e4b1-0d0d-4144-ba1e-1c598d9c58f5 service neutron] 10.222.0.31 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3974092 Dec 21 04:08:50.745353 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.776825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.783317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5a96bb11-3aa8-4b71-8da6-aec36cb17cf6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:50.824593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Deleting port 65c2b4c8-b3f8-4e7c-ba12-feea0ad680b5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:50.824931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.832591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['13d79d25-d791-421e-bee1-93ce620f5704']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:50.855576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '14fbbca6-7072-4909-b9a3-3ca17b26245e') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:50.855870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '14fbbca6-7072-4909-b9a3-3ca17b26245e') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:50.881479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.882060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3279ad4e-6249-4f09-b38a-703a32495d39 req-a52c641d-8878-4fbb-8869-4cf293395d56 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1186054 Dec 21 04:08:50.885903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.912534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:50.951540 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5cf81977-7ddc-4b96-8dad-6f4078c11ba7 x-openstack-request-id: req-5cf81977-7ddc-4b96-8dad-6f4078c11ba7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:50.952273 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "06a3967a-a9a8-458f-a229-1510bc81f486", "name": "network-vif-plugged", "status": "completed", "tag": "5d271dd6-207e-4d03-a5e9-1b7dd220c01a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:50.952670 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5cf81977-7ddc-4b96-8dad-6f4078c11ba7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:50.953068 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '06a3967a-a9a8-458f-a229-1510bc81f486', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a', 'code': 200} Dec 21 04:08:50.965503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ca76ad8-41ea-47bf-9bea-1770bf30eec4']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:50.993885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:50.998415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '777fdc6a-7c45-4185-b4b1-76bfc3ac777e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:50.998720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '777fdc6a-7c45-4185-b4b1-76bfc3ac777e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:51.030758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.032822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Calling delete_port for 65c2b4c8-b3f8-4e7c-ba12-feea0ad680b5 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:51.087445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.126976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:51.127393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:51.130053 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:51.210056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5594a339-bbe4-4382-aebb-1ea2b9ab959f req-e5ed65b6-e77b-4315-b6c4-379ff2b40ed9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:51.211593 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5594a339-bbe4-4382-aebb-1ea2b9ab959f req-e5ed65b6-e77b-4315-b6c4-379ff2b40ed9 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 1097 time: 0.1717622 Dec 21 04:08:51.266398 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5594a339-bbe4-4382-aebb-1ea2b9ab959f req-501530ad-7cf1-4f3a-bf39-3f30224ea665 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424433 Dec 21 04:08:51.282637 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.296819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:51.297205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.298858 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:51.302181 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:51.305564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.306741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.310132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] 10.222.0.18 "DELETE /v2.0/networks/7ca76ad8-41ea-47bf-9bea-1770bf30eec4 HTTP/1.1" status: 204 len: 168 time: 0.7623172 Dec 21 04:08:51.326573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.328344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b12ddd8-cb22-4c89-9f64-f7a22432aaac admin admin] Pushing event deleted for resources: {'Network': ['ID=7ca76ad8-41ea-47bf-9bea-1770bf30eec4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:51.361539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Port': ['ID=65c2b4c8-b3f8-4e7c-ba12-feea0ad680b5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:51.371165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.373870 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf8d9043-97dc-414b-9502-f76a68e678e4 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/ports/65c2b4c8-b3f8-4e7c-ba12-feea0ad680b5 HTTP/1.1" status: 204 len: 168 time: 0.8937764 Dec 21 04:08:51.376318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52710) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:51.392474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a77475-00c2-45dd-87eb-b148478ec81a req-ba543bb4-805b-4b62-8fab-df0c523184d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:51.394374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-ba543bb4-805b-4b62-8fab-df0c523184d0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 1095 time: 0.4852855 Dec 21 04:08:51.434162 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6dc3ba5c-a114-42e7-b79d-f2a8faa84412 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0528655 Dec 21 04:08:51.435555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52714) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:51.441386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1742124828'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:51.445882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.474979 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.478318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] 10.222.0.18 "DELETE /v2.0/networks/13d79d25-d791-421e-bee1-93ce620f5704 HTTP/1.1" status: 204 len: 168 time: 1.3730159 Dec 21 04:08:51.534067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:51.538276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.549281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56267ab-f170-4afe-976c-b20fd97e6936 admin admin] Pushing event deleted for resources: {'Network': ['ID=13d79d25-d791-421e-bee1-93ce620f5704,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:51.568717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:51.577812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.578184 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Added segment 41d673c0-9955-4cd6-a0c5-5199cc2371da of type vlan for network 50ea6055-0609-43f2-a7b5-fe58067f2d3d Dec 21 04:08:51.607110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a77475-00c2-45dd-87eb-b148478ec81a req-0f13066b-3ecc-4d6d-9e79-75542a0f97e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:51.609031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-0f13066b-3ecc-4d6d-9e79-75542a0f97e7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 917 time: 0.2062082 Dec 21 04:08:51.634404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.656384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-b0e61153-7820-4b91-8a33-59412dc2ae99 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533 HTTP/1.1" status: 200 len: 217 time: 0.0400660 Dec 21 04:08:51.667629 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.783261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a77475-00c2-45dd-87eb-b148478ec81a req-14316ec1-ab28-479c-a577-726b1095a790 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:51.784666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-14316ec1-ab28-479c-a577-726b1095a790 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.1147809 Dec 21 04:08:51.787202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.793146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:51.793813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:51.838406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52736) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:51.847424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a77475-00c2-45dd-87eb-b148478ec81a req-bfc8b84b-c725-426e-a4c9-731b8d08d8ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:51.848877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-bfc8b84b-c725-426e-a4c9-731b8d08d8ea service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0556998 Dec 21 04:08:51.866148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Network': ['ID=50ea6055-0609-43f2-a7b5-fe58067f2d3d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:51.876999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 50ea6055-0609-43f2-a7b5-fe58067f2d3d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:51.888129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4a9d2250-227f-49c7-90a5-526444231a7c tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.4507709 Dec 21 04:08:51.889958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52742) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:51.897340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1026674657'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:51.913978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52746) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:51.988036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:51.991518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.007923 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4976922-d180-402b-bf9e-a662464e3475 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c24fe956f7434054805a2322d25507fa&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0917759 Dec 21 04:08:52.010491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52752) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:52.047203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-52aa73bc-c74d-49bf-ace1-dda14a0d0857 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9ca297f0d1fc4afc92d93f30ddc5c61c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2056048 Dec 21 04:08:52.048953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:52.051345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52758) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:52.066555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.066902 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Added segment b820ca77-23ea-48d3-86fa-85415de82234 of type vlan for network 8ca707ed-1714-4984-87d4-bdc113648ab6 Dec 21 04:08:52.087479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-c14144c9-485c-4702-8083-1ea13162145f service neutron] 10.222.0.31 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2301252 Dec 21 04:08:52.105497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e552cde3-8a46-4b8f-8b82-68c586df0d69 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.110845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:08:52.121562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a3a841-314c-4f4a-ae2a-b995e0165fbd req-44fa4a26-a001-4448-9914-6f444a57d766 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:52.123112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25a3a841-314c-4f4a-ae2a-b995e0165fbd req-44fa4a26-a001-4448-9914-6f444a57d766 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 943 time: 0.1383290 Dec 21 04:08:52.124749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.143618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e552cde3-8a46-4b8f-8b82-68c586df0d69 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.251156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.256936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:52.257520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.278726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:08:52.283741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:52.284938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.292054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c35a6781-e62a-4da9-83af-dac589bd7d40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.295352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e552cde3-8a46-4b8f-8b82-68c586df0d69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.299375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e552cde3-8a46-4b8f-8b82-68c586df0d69 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.301094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25a3a841-314c-4f4a-ae2a-b995e0165fbd req-f6981d42-ee93-4614-94e1-0f2fa5a776aa tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1638489 Dec 21 04:08:52.307168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e552cde3-8a46-4b8f-8b82-68c586df0d69 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/263b6fe6-c124-4b9f-898a-5bbe82f435fd HTTP/1.1" status: 204 len: 168 time: 0.2890534 Dec 21 04:08:52.353328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c35a6781-e62a-4da9-83af-dac589bd7d40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.359156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54a77475-00c2-45dd-87eb-b148478ec81a req-e353f942-218d-4c3e-aa72-ae1a1e63e170 service neutron] 10.222.0.31 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2585061 Dec 21 04:08:52.416007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.5098178 Dec 21 04:08:52.416007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e552cde3-8a46-4b8f-8b82-68c586df0d69 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=263b6fe6-c124-4b9f-898a-5bbe82f435fd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:52.416007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c9df035-4076-42da-9a77-53a02cfe6c88 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Network': ['ID=8ca707ed-1714-4984-87d4-bdc113648ab6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:52.418550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port a0751ded-47c2-4d5b-8743-170d5a27a3e7 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:52.419116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.428444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8ca707ed-1714-4984-87d4-bdc113648ab6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:52.458098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.523297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:08:52.590340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:52.618732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c35a6781-e62a-4da9-83af-dac589bd7d40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.622613 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c35a6781-e62a-4da9-83af-dac589bd7d40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.623799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c35a6781-e62a-4da9-83af-dac589bd7d40 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ce56e19f-28f0-4d2f-ad33-212cfeb535ca HTTP/1.1" status: 204 len: 168 time: 0.5659618 Dec 21 04:08:52.649217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c35a6781-e62a-4da9-83af-dac589bd7d40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce56e19f-28f0-4d2f-ad33-212cfeb535ca,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:52.687017 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.712815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port a0751ded-47c2-4d5b-8743-170d5a27a3e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0751ded-47c2-4d5b-8743-170d5a27a3e7,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:52.713198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.751111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for a0751ded-47c2-4d5b-8743-170d5a27a3e7 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:52.754458 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.resource_extend [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 04:08:52.758102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:52.797641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-132645b4-23fd-483f-84e1-e0e3a079128d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.891526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:52.914267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533', 'network_id': '5b94d88b-3288-4137-8290-856f86bd57aa', 'port_id': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533', 'mac_address': 'fa:16:3e:ca:5e:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '39078dda-bad6-4dd8-b1ea-bf27b6bdc389', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:08:52.960904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a4912a6-b3aa-498a-98d0-c78532125599', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:52.964304 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d97669af-34ab-4cc1-b00e-1ee94282e35d" -d '{"events": [{"server_uuid": "1a4912a6-b3aa-498a-98d0-c78532125599", "name": "network-vif-plugged", "status": "completed", "tag": "5a96bb11-3aa8-4b71-8da6-aec36cb17cf6"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:52.968475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:52.974077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:53.000701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:08:53.055338 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7eebe5ed-1147-4658-a6c6-1cef561b2c06 x-openstack-request-id: req-7eebe5ed-1147-4658-a6c6-1cef561b2c06 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:53.055636 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a4912a6-b3aa-498a-98d0-c78532125599", "name": "network-vif-plugged", "status": "completed", "tag": "5a96bb11-3aa8-4b71-8da6-aec36cb17cf6", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:53.055899 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7eebe5ed-1147-4658-a6c6-1cef561b2c06 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:53.056301 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a4912a6-b3aa-498a-98d0-c78532125599', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6', 'code': 200} Dec 21 04:08:53.064495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:53.082011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:53.126741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=a0751ded-47c2-4d5b-8743-170d5a27a3e7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:53.142303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:53.296449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:53.306960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:53.343881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b26c30d-475e-41b0-ba63-566b981ad990 req-9b092220-b326-4160-8d16-388bc14f9d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:53.346240 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b26c30d-475e-41b0-ba63-566b981ad990 req-9b092220-b326-4160-8d16-388bc14f9d15 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 1097 time: 0.1332581 Dec 21 04:08:53.495080 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b26c30d-475e-41b0-ba63-566b981ad990 req-a1c6d77b-8bec-4092-8d40-89a1d0c76b44 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1405959 Dec 21 04:08:53.500969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['0c919ed6-4d65-46fc-9b58-b09a5e3a5533'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:08:53.619941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfb24a3-7407-47ab-93ce-0132e2c3f429 req-a6170893-bf5f-4593-8d99-40e86c2d77ed tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:53.621105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dfb24a3-7407-47ab-93ce-0132e2c3f429 req-a6170893-bf5f-4593-8d99-40e86c2d77ed tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 944 time: 0.1610208 Dec 21 04:08:53.623543 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:53.755280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52852) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:53.816641 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-31ca4fb2-1af2-484d-9eeb-0928ffe70893 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d611efd4b4d845dcadbd07905d29755c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0598230 Dec 21 04:08:53.817527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dfb24a3-7407-47ab-93ce-0132e2c3f429 req-9533e27e-ac76-4b67-bde6-0aa167393e34 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1874032 Dec 21 04:08:53.819071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52854) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:53.887474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02934500-0ea0-4c17-8a63-e0e2eab18d5d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:53.955142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02934500-0ea0-4c17-8a63-e0e2eab18d5d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.018994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Router fb1fb678-be5b-4fff-abe6-343b84e37da9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:08:54.090252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02934500-0ea0-4c17-8a63-e0e2eab18d5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.094596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02934500-0ea0-4c17-8a63-e0e2eab18d5d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.096980 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-02934500-0ea0-4c17-8a63-e0e2eab18d5d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/078a0b47-dc13-48ca-8cd9-41e5cb51cd04 HTTP/1.1" status: 204 len: 168 time: 0.2759542 Dec 21 04:08:54.121047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02934500-0ea0-4c17-8a63-e0e2eab18d5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=078a0b47-dc13-48ca-8cd9-41e5cb51cd04,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:54.161747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:08:54.168679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07b3c273-38f4-49df-bb91-a16826facb0a tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "PUT /v2.0/routers/fb1fb678-be5b-4fff-abe6-343b84e37da9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0868292 Dec 21 04:08:54.171612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:54.178839 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] Sync routers for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:08:54.202662 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:54.203682 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:54.290908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting subnet 0e2ee440-32ec-4001-87d7-31af9f807755 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:54.294961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.357120 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:54.373120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.490393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.531701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:08:54.579789 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:08:52Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:54.620683 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] Checking router: fb1fb678-be5b-4fff-abe6-343b84e37da9 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:08:54.635165 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] Routers {'fb1fb678-be5b-4fff-abe6-343b84e37da9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:08:54.635780 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb1fb678-be5b-4fff-abe6-343b84e37da9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:54.701725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.731445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Subnet': ['ID=0e2ee440-32ec-4001-87d7-31af9f807755,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:54.734884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:54.738890 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-866f91eb-2afd-41dc-ab6e-2803321b1336 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/subnets/0e2ee440-32ec-4001-87d7-31af9f807755 HTTP/1.1" status: 204 len: 168 time: 0.5627880 Dec 21 04:08:54.741568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52898) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:54.753725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbb760d4-faf3-4d8e-a181-6c609972b729 None None] Network f740899e-9cdc-4671-abdd-e69decd81dc4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:54.851161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] Set router fb1fb678-be5b-4fff-abe6-343b84e37da9 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:08:54.936891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:08:55.004936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:08:55.005309 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.139598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.227552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df51a0d-bb14-438e-a0b7-3ada258b9bfd req-d05bafcc-b714-4ab5-abd2-318642b8c2ff tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:55.230204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0df51a0d-bb14-438e-a0b7-3ada258b9bfd req-d05bafcc-b714-4ab5-abd2-318642b8c2ff tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 944 time: 0.2300546 Dec 21 04:08:55.248515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.308485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.383381 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.383381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] DHCP port deletion for f740899e-9cdc-4671-abdd-e69decd81dc4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:55.385499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f165f769-565a-4128-b62b-0cccedb7404c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:08:55.388621 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7b4be9b-b529-4ec2-b3cc-75d376416ec7" -d '{"events": [{"server_uuid": "f165f769-565a-4128-b62b-0cccedb7404c", "name": "network-vif-plugged", "status": "completed", "tag": "0c919ed6-4d65-46fc-9b58-b09a5e3a5533"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:08:55.450472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:55.470038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0df51a0d-bb14-438e-a0b7-3ada258b9bfd req-5d59685a-15fe-4acd-91d5-b736ddb8795d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2307181 Dec 21 04:08:55.496106 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.501575 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:08:52Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:55.646097 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d302ed-0fad-43c4-bb54-d177978f4c51 None None] The sync data for ids ['fb1fb678-be5b-4fff-abe6-343b84e37da9'] in n-d-822053-11 is: [{'id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'name': 'tempest-TestNetworkBasicOps-router-1606127884', 'tenant_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113'}], 'enable_snat': True}, 'gw_port_id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:07:25Z', 'updated_at': '2021-12-21T04:08:52Z', 'revision_number': 5, 'project_id': 'ec158f7f7c994dacb4d1785b3b8f2ff1', 'gw_port': {'id': '637d2ef4-6bee-49c3-8991-a6609aa7bbf4', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:97:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb1fb678-be5b-4fff-abe6-343b84e37da9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2538, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:07:26Z', 'updated_at': '2021-12-21T04:07:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:08:55.681613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:55.686890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'subnets': [{'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--866847796', 'ip_version': 6}, {'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:55.687425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'subnet': {'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--866847796', 'ip_version': 6}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:55.688807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Request body: {'subnet': {'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:55.732484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Deleting port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:55.733093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.737015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9162b5f2-bfa5-47ff-9dae-f81adf78011c req-15fdf502-7280-4fc3-9e4d-aa383ff5cae7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:55.739147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9162b5f2-bfa5-47ff-9dae-f81adf78011c req-15fdf502-7280-4fc3-9e4d-aa383ff5cae7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 1097 time: 0.0751660 Dec 21 04:08:55.772242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:08:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56388b6e-62dd-4218-8478-d2049ca9e8f9 x-openstack-request-id: req-56388b6e-62dd-4218-8478-d2049ca9e8f9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:08:55.775118 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f165f769-565a-4128-b62b-0cccedb7404c", "name": "network-vif-plugged", "status": "completed", "tag": "0c919ed6-4d65-46fc-9b58-b09a5e3a5533", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:08:55.775386 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-56388b6e-62dd-4218-8478-d2049ca9e8f9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:08:55.775795 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f165f769-565a-4128-b62b-0cccedb7404c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533', 'code': 200} Dec 21 04:08:55.792928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.867718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9162b5f2-bfa5-47ff-9dae-f81adf78011c req-4818eeb7-9ed3-4788-8613-5404395c7c02 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1167002 Dec 21 04:08:55.887280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:55.887427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] For port 637d2ef4-6bee-49c3-8991-a6609aa7bbf4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:55.888173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.903680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Calling delete_port for 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:55.924555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] Deleting port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:08:55.927339 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:55.994341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.016078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] For port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,segment=NetworkSegment(5a3eef7f-2893-495e-99bf-8f252856a8c1),segment_id=5a3eef7f-2893-495e-99bf-8f252856a8c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:08:56.016618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.057989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] Calling delete_port for 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:08:56.101760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Made reservation on behalf of e5cffb54a3634af89a1d0642fb35f4fc for: {'subnet': 2} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:56.108168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.108763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.284709 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.287051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.328677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Port': ['ID=637d2ef4-6bee-49c3-8991-a6609aa7bbf4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:56.342972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3dabbb31-56f9-4ff3-bc4d-e1aa3e6270a9 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:08:56.345092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] Pushing event deleted for resources: {'Port': ['ID=22ed0878-ccc5-4726-bbe9-507cefb3d4a8,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:56.350406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efa8e0c6-ac89-4e0a-9675-f5b3680e4166 None None] No DVR routers for this DVR port 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:08:56.378301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:56.438295 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.553645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBackupRestore-1364449534-network', 'tenant_id': '620778ddaf44496aa625b5014155c9de'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:56.573650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.576975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.668739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaff6a4b-8146-422c-bf6f-b86cf5a2cd30 req-d1d1fb99-ac94-47c9-a1da-45263c7db217 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:56.670197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaff6a4b-8146-422c-bf6f-b86cf5a2cd30 req-d1d1fb99-ac94-47c9-a1da-45263c7db217 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.0914879 Dec 21 04:08:56.710875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Made reservation on behalf of 620778ddaf44496aa625b5014155c9de for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:56.713807 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.727153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaff6a4b-8146-422c-bf6f-b86cf5a2cd30 req-5dc9ddc6-e685-4bc9-aee8-f4e94049c8a6 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475254 Dec 21 04:08:56.731689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.748159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.752799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Fanout notify agent at l3_agent the message router_deleted on router fb1fb678-be5b-4fff-abe6-343b84e37da9 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:08:56.766209 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.773252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a7155b57-5d19-4413-bccb-bcaed4b9ac36 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/routers/fb1fb678-be5b-4fff-abe6-343b84e37da9 HTTP/1.1" status: 204 len: 168 time: 2.0303793 Dec 21 04:08:56.776445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53042) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:56.820800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.834166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.929970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.951039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:56.964385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Subnet': ['ID=18f0fa71-fbe4-49b4-b484-f65da4233fa0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:56.973406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Checking segment: {'id': '41d673c0-9955-4cd6-a0c5-5199cc2371da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:56.973766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network hostable DHCP agents. Network: 50ea6055-0609-43f2-a7b5-fe58067f2d3d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:57.001283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:08:57.016384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24b29fd1-f281-4787-b4d8-ed95c02c0e25,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:57.028701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.029114 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Added segment 45d2d62f-06f1-4722-95eb-827c5ff84c72 of type vlan for network 9e019c2c-b199-4210-baef-b6bda8c43e06 Dec 21 04:08:57.082804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.091294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network 50ea6055-0609-43f2-a7b5-fe58067f2d3d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:57.182687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.188608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:57.196213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.202082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 50ea6055-0609-43f2-a7b5-fe58067f2d3d) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:57.209525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.213573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a7b7903-42f2-42cb-813f-eacdbf1ae99e None None] Network 50ea6055-0609-43f2-a7b5-fe58067f2d3d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:57.338981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] Pushing event updated for resources: {'Network': ['ID=9e019c2c-b199-4210-baef-b6bda8c43e06,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:57.402153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event updated for resources: {'Subnet': ['ID=549cc9cd-a4bd-4619-98e2-52571ec925df,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:57.424949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:08:57.438831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-119ef764-35fb-4860-b904-ce3e2b8b9c8a admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.0581222 Dec 21 04:08:57.446762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Checking segment: {'id': 'b820ca77-23ea-48d3-86fa-85415de82234', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:57.447804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network hostable DHCP agents. Network: 8ca707ed-1714-4984-87d4-bdc113648ab6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:57.449927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53080) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:57.454720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Request body: {'subnet': {'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBackupRestore-1364449534-subnet', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:57.468270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.495692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f740899e-9cdc-4671-abdd-e69decd81dc4']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:57.508905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5a3eef7f-2893-495e-99bf-8f252856a8c1') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:57.510002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5a3eef7f-2893-495e-99bf-8f252856a8c1') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:08:57.519547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-50ea6055-0609-43f2-a7b5-fe58067f2d3d', 'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d', 'project_id': 'e5cffb54a3634af89a1d0642fb35f4fc', 'fixed_ips': [{'subnet_id': '18f0fa71-fbe4-49b4-b484-f65da4233fa0'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:08:57.521006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.522588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.527429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0751ded-47c2-4d5b-8743-170d5a27a3e7 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:57.541789 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.551068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:08:57.551463 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:08:57.554477 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:08:57.563204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a0751ded-47c2-4d5b-8743-170d5a27a3e7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:57.563550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0751ded-47c2-4d5b-8743-170d5a27a3e7 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:57.563977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:57.586973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:57.587364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 637d2ef4-6bee-49c3-8991-a6609aa7bbf4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:57.587798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:08:57.604369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Network 8ca707ed-1714-4984-87d4-bdc113648ab6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:57.617730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:08:57.618298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22ed0878-ccc5-4726-bbe9-507cefb3d4a8 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:08:57.628346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Made reservation on behalf of 620778ddaf44496aa625b5014155c9de for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:08:57.632319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.687425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8ca707ed-1714-4984-87d4-bdc113648ab6) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:57.697640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:57.697640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:57.697640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.697941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0973f7ea-c583-4db8-9134-2fce39c52ece None None] Network 8ca707ed-1714-4984-87d4-bdc113648ab6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:57.714186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.731893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:57.738008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] 10.222.0.18 "DELETE /v2.0/networks/f740899e-9cdc-4671-abdd-e69decd81dc4 HTTP/1.1" status: 204 len: 168 time: 0.9592116 Dec 21 04:08:57.795031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7db3811-41c4-47fe-bace-05f8e61a5b2d tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] Pushing event deleted for resources: {'Network': ['ID=f740899e-9cdc-4671-abdd-e69decd81dc4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:57.818619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5da89ca-bdba-40f1-8d33-5cca47dd4cb0 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1475 time: 2.1336372 Dec 21 04:08:57.819204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53098) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:57.850640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Allocated IP 2001:db8::1 (50ea6055-0609-43f2-a7b5-fe58067f2d3d/18f0fa71-fbe4-49b4-b484-f65da4233fa0/d1d5ee75-98b2-4618-b048-8399ac196b1d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:57.959899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcbf5589-b4ac-4eff-804b-26d3fb8db13f req-470c5c66-daf8-449c-96da-34137a14836e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:57.961812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcbf5589-b4ac-4eff-804b-26d3fb8db13f req-470c5c66-daf8-449c-96da-34137a14836e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.0781369 Dec 21 04:08:57.982537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-8ca707ed-1714-4984-87d4-bdc113648ab6', 'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6', 'project_id': 'e5cffb54a3634af89a1d0642fb35f4fc', 'fixed_ips': [{'subnet_id': '549cc9cd-a4bd-4619-98e2-52571ec925df'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:08:57.983966 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.016882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c62c26a3-a980-4090-8729-5534116351ff tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:58.018964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c62c26a3-a980-4090-8729-5534116351ff tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:58.019786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcbf5589-b4ac-4eff-804b-26d3fb8db13f req-51feec42-eec8-4274-8711-423fdc0bb819 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509207 Dec 21 04:08:58.021137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c62c26a3-a980-4090-8729-5534116351ff tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:58.021267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53112) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.023219 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c62c26a3-a980-4090-8729-5534116351ff tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2101 time: 0.2024162 Dec 21 04:08:58.025577 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.036950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.143971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d1e185a5-063a-405d-ae9d-3ac5d19302c8,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:58.189971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Deleting subnet 18f0fa71-fbe4-49b4-b484-f65da4233fa0 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:58.193662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Checking segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:58.194231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Network hostable DHCP agents. Network: 9e019c2c-b199-4210-baef-b6bda8c43e06, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:08:58.217867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6313c42-6dc6-4527-9b00-260c048d84cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.250246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0c8474-03fa-4df6-9cb1-16be8b70a624 req-903d2a95-c137-49a9-954b-74246d89ce1b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:58.251779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e0c8474-03fa-4df6-9cb1-16be8b70a624 req-903d2a95-c137-49a9-954b-74246d89ce1b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1110094 Dec 21 04:08:58.258806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Allocated IP 2001:db8:0:1::1 (8ca707ed-1714-4984-87d4-bdc113648ab6/549cc9cd-a4bd-4619-98e2-52571ec925df/45ba1e97-1bd3-46b1-b90b-6f72e9748eec) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:58.265206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.290484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:08:58.340770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.350458 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.352458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e0c8474-03fa-4df6-9cb1-16be8b70a624 req-ddb236d8-8d9f-4c2b-aae2-5cd4a5f45b9b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0924497 Dec 21 04:08:58.388947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9e019c2c-b199-4210-baef-b6bda8c43e06) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:58.407113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3857ddf-de12-4310-af3a-f4043760da07 None None] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:08:58.415244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:58.416075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.425821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Network 50ea6055-0609-43f2-a7b5-fe58067f2d3d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:58.433843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.441437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6313c42-6dc6-4527-9b00-260c048d84cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.450197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.498564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:58.504405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285a03e8-b9be-4bcd-af85-86fbf27a3ec5 req-1b6f1c38-2c83-4fd8-a1f5-891ef37df697 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:58.506621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-285a03e8-b9be-4bcd-af85-86fbf27a3ec5 req-1b6f1c38-2c83-4fd8-a1f5-891ef37df697 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 945 time: 0.0592937 Dec 21 04:08:58.508047 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6313c42-6dc6-4527-9b00-260c048d84cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.517310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:58.526794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Pushing event updated for resources: {'Port': ['ID=d1d5ee75-98b2-4618-b048-8399ac196b1d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:58.531765 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38d5e12a-7085-43f6-8af2-1ec46534b913 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.0806687 Dec 21 04:08:58.537201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53138) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.543007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a6313c42-6dc6-4527-9b00-260c048d84cd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4f353119c39742deabd51294e4a865d7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5208285 Dec 21 04:08:58.546336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.549286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:08:58.625536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.665820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6313c42-6dc6-4527-9b00-260c048d84cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e51120f8-79df-4eb9-956f-d2a4f3e71146,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:58.674332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.676792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Attempting to bind port d1d5ee75-98b2-4618-b048-8399ac196b1d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:58.677489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Attempting to bind port d1d5ee75-98b2-4618-b048-8399ac196b1d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '41d673c0-9955-4cd6-a0c5-5199cc2371da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:58.678037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Attempting to bind port d1d5ee75-98b2-4618-b048-8399ac196b1d on network 50ea6055-0609-43f2-a7b5-fe58067f2d3d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:58.678720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-285a03e8-b9be-4bcd-af85-86fbf27a3ec5 req-9b873be6-48e7-471f-98a7-376d16c5df93 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1404054 Dec 21 04:08:58.684600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.685520 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ca0e3f6-f673-4086-9501-d2fdcbdb29e5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ec158f7f7c994dacb4d1785b3b8f2ff1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2504461 Dec 21 04:08:58.697324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:58.698224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Checking segment: {'id': '41d673c0-9955-4cd6-a0c5-5199cc2371da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:58.698780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.699358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Bound using segment: {'id': '41d673c0-9955-4cd6-a0c5-5199cc2371da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:58.700413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Bound port: d1d5ee75-98b2-4618-b048-8399ac196b1d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41d673c0-9955-4cd6-a0c5-5199cc2371da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '50ea6055-0609-43f2-a7b5-fe58067f2d3d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:58.700985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.704678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9e019c2c-b199-4210-baef-b6bda8c43e06', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:08:58.706045 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.756159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d824cd4-1a81-4f94-9aad-63f076d0709f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.774502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.775622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.796050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d824cd4-1a81-4f94-9aad-63f076d0709f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.812207 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78166eea-cf44-4c57-971e-bd4267a9a136 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.818763 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.854345 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78166eea-cf44-4c57-971e-bd4267a9a136 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.858627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.888146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Subnet': ['ID=18f0fa71-fbe4-49b4-b484-f65da4233fa0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:58.898582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:58.899025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Network 8ca707ed-1714-4984-87d4-bdc113648ab6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:58.901788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] For port d1d5ee75-98b2-4618-b048-8399ac196b1d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:58.904624 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-754288ef-fbb6-4f88-acbf-ea01754b1772 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/subnets/18f0fa71-fbe4-49b4-b484-f65da4233fa0 HTTP/1.1" status: 204 len: 168 time: 0.8484831 Dec 21 04:08:58.909517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:58.919329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:58.923959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:58.949722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] For port d1d5ee75-98b2-4618-b048-8399ac196b1d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d1d5ee75-98b2-4618-b048-8399ac196b1d,segment=NetworkSegment(41d673c0-9955-4cd6-a0c5-5199cc2371da),segment_id=41d673c0-9955-4cd6-a0c5-5199cc2371da)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:58.958043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Pushing event updated for resources: {'Port': ['ID=45ba1e97-1bd3-46b1-b90b-6f72e9748eec,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:58.991758 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.025004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Allocated IP 172.20.0.2 (9e019c2c-b199-4210-baef-b6bda8c43e06/d1e185a5-063a-405d-ae9d-3ac5d19302c8/ab033bab-c07c-4e72-a7b9-a6213791e72a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:08:59.033255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.044260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Deleting subnet 549cc9cd-a4bd-4619-98e2-52571ec925df {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:08:59.049875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.109022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Attempting to bind port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:59.116596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.120750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Attempting to bind port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b820ca77-23ea-48d3-86fa-85415de82234', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:59.124533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Attempting to bind port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec on network 8ca707ed-1714-4984-87d4-bdc113648ab6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:59.142240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d824cd4-1a81-4f94-9aad-63f076d0709f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.146225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d824cd4-1a81-4f94-9aad-63f076d0709f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.146780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3d824cd4-1a81-4f94-9aad-63f076d0709f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e51120f8-79df-4eb9-956f-d2a4f3e71146 HTTP/1.1" status: 204 len: 168 time: 0.5901651 Dec 21 04:08:59.147691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78166eea-cf44-4c57-971e-bd4267a9a136 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.150922 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-78166eea-cf44-4c57-971e-bd4267a9a136 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.155377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78166eea-cf44-4c57-971e-bd4267a9a136 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/67c541de-eafd-4df7-96f6-875b2eefb965 HTTP/1.1" status: 204 len: 168 time: 0.4662061 Dec 21 04:08:59.155558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:59.156923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Checking segment: {'id': 'b820ca77-23ea-48d3-86fa-85415de82234', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:59.157347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.157755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Bound using segment: {'id': 'b820ca77-23ea-48d3-86fa-85415de82234', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:59.158243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Bound port: 45ba1e97-1bd3-46b1-b90b-6f72e9748eec, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b820ca77-23ea-48d3-86fa-85415de82234', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '8ca707ed-1714-4984-87d4-bdc113648ab6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:59.158658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.202086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61dab4b9-03d3-4860-b88c-b320783faa50 None None] Pushing event updated for resources: {'Port': ['ID=d1d5ee75-98b2-4618-b048-8399ac196b1d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:59.203365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d824cd4-1a81-4f94-9aad-63f076d0709f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e51120f8-79df-4eb9-956f-d2a4f3e71146,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:59.246585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-376d96ee-dc57-4f63-bdda-91dfc3b777fb req-9e1a472a-eefc-4d8f-82fc-eab49bac55ef tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:59.248235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-376d96ee-dc57-4f63-bdda-91dfc3b777fb req-9e1a472a-eefc-4d8f-82fc-eab49bac55ef tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.2215948 Dec 21 04:08:59.249122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78166eea-cf44-4c57-971e-bd4267a9a136 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67c541de-eafd-4df7-96f6-875b2eefb965,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:59.365297 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.421362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.463999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-376d96ee-dc57-4f63-bdda-91dfc3b777fb req-5c7557d9-46e1-4e4b-94cb-72d1da93a2bf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2050841 Dec 21 04:08:59.470239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.553499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.605633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.712185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Subnet': ['ID=549cc9cd-a4bd-4619-98e2-52571ec925df,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:59.715975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.728250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53166) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:08:59.731777 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c9fb3f5-42c6-4276-9826-35d9a95b6515 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/subnets/549cc9cd-a4bd-4619-98e2-52571ec925df HTTP/1.1" status: 204 len: 168 time: 0.7987761 Dec 21 04:08:59.880229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:08:59.886886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:08:59.889534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] For port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:08:59.893404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:08:59.917166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] For port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=45ba1e97-1bd3-46b1-b90b-6f72e9748eec,segment=NetworkSegment(b820ca77-23ea-48d3-86fa-85415de82234),segment_id=b820ca77-23ea-48d3-86fa-85415de82234)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:08:59.933085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Pushing event updated for resources: {'Port': ['ID=ab033bab-c07c-4e72-a7b9-a6213791e72a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:08:59.963536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Attempting to bind port ab033bab-c07c-4e72-a7b9-a6213791e72a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:08:59.963909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Attempting to bind port ab033bab-c07c-4e72-a7b9-a6213791e72a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:08:59.964275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Attempting to bind port ab033bab-c07c-4e72-a7b9-a6213791e72a on network 9e019c2c-b199-4210-baef-b6bda8c43e06 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:08:59.969158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:08:59.969534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Checking segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:08:59.969934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.970330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Bound using segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:08:59.970787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Bound port: ab033bab-c07c-4e72-a7b9-a6213791e72a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:08:59.971867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:08:59.990075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adec23af-9dd6-4c3e-b6e8-f7fff1488983 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:08:59.995523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-adec23af-9dd6-4c3e-b6e8-f7fff1488983 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2575586 Dec 21 04:08:59.995911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53170) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:00.005717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.073441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7429b908-e4f9-4004-a113-6c2c91f338c5 req-a09e989e-e6f5-4640-882b-5b4e59667ed7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:00.074984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429b908-e4f9-4004-a113-6c2c91f338c5 req-a09e989e-e6f5-4640-882b-5b4e59667ed7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1785905 Dec 21 04:09:00.081222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.094549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] For port ab033bab-c07c-4e72-a7b9-a6213791e72a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:00.099793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] For port ab033bab-c07c-4e72-a7b9-a6213791e72a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab033bab-c07c-4e72-a7b9-a6213791e72a,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:00.102956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d94e713-1ac2-4aa0-bd1a-6c57a969b886 None None] Pushing event updated for resources: {'Port': ['ID=45ba1e97-1bd3-46b1-b90b-6f72e9748eec,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:00.130072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.146185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.176698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.212139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Deleting port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:00.212820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.262257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7429b908-e4f9-4004-a113-6c2c91f338c5 req-05570a5a-f886-4ee0-adf5-b1a7d2029e1c tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1396973 Dec 21 04:09:00.313174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:00.346837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626b9e73-207f-40d0-a7c6-8bdab10badff None None] Pushing event updated for resources: {'Port': ['ID=ab033bab-c07c-4e72-a7b9-a6213791e72a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:00.369028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53178) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:00.392012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] For port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=45ba1e97-1bd3-46b1-b90b-6f72e9748eec,segment=NetworkSegment(b820ca77-23ea-48d3-86fa-85415de82234),segment_id=b820ca77-23ea-48d3-86fa-85415de82234)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:00.393782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.410586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Calling delete_port for 45ba1e97-1bd3-46b1-b90b-6f72e9748eec owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:00.424061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1816c0a-ec95-40a4-9042-7bd989776cfd admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.472603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c7f9a3e-873e-4a64-9a95-f8eeba11f832 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.678669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.735637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Port': ['ID=45ba1e97-1bd3-46b1-b90b-6f72e9748eec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:00.744512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] No DVR routers for this DVR port 45ba1e97-1bd3-46b1-b90b-6f72e9748eec on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:00.782842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c7f9a3e-873e-4a64-9a95-f8eeba11f832 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.865116 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:09:00.873200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c7f9a3e-873e-4a64-9a95-f8eeba11f832 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.886902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37859050-2315-423f-b056-b40992f8635c None None] Network 50ea6055-0609-43f2-a7b5-fe58067f2d3d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:00.909292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Allocated IP 172.25.5.20 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/6314beb6-1533-4c57-89b0-6f0b0e5661d0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:00.944244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:00.990863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6eddc66e-f3df-4f23-b214-00ab63e9f627 None None] Provisioning complete for port d1d5ee75-98b2-4618-b048-8399ac196b1d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:00.991372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6eddc66e-f3df-4f23-b214-00ab63e9f627 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.012621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ca707ed-1714-4984-87d4-bdc113648ab6']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:01.042170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b820ca77-23ea-48d3-86fa-85415de82234') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:01.042602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b820ca77-23ea-48d3-86fa-85415de82234') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:01.067098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.100766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.114273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:01.114613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:01.127073 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:01.186868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6eddc66e-f3df-4f23-b214-00ab63e9f627 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.198303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7c7f9a3e-873e-4a64-9a95-f8eeba11f832 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=33cf6c9d1cf649109c98efa006edd7cf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8820741 Dec 21 04:09:01.208887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] DHCP port deletion for 50ea6055-0609-43f2-a7b5-fe58067f2d3d request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:01.214201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53184) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:01.231991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7f9a3e-873e-4a64-9a95-f8eeba11f832 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9e5d158-8507-43f7-b97d-64accd9c4e81,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:01.268079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.272219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab033bab-c07c-4e72-a7b9-a6213791e72a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:01.279034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-607f5cc5-c93f-4cb2-8245-6b64dfda587d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.281784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1816c0a-ec95-40a4-9042-7bd989776cfd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.307732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-607f5cc5-c93f-4cb2-8245-6b64dfda587d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.319694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52d000b-2a3f-4a4a-8109-89f1819b68be req-5475f4df-fd8e-4fdf-8376-22602841b7cb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:01.327005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52d000b-2a3f-4a4a-8109-89f1819b68be req-5475f4df-fd8e-4fdf-8376-22602841b7cb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:01.334811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52d000b-2a3f-4a4a-8109-89f1819b68be req-5475f4df-fd8e-4fdf-8376-22602841b7cb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:01.335783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6eddc66e-f3df-4f23-b214-00ab63e9f627 None None] For port d1d5ee75-98b2-4618-b048-8399ac196b1d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d1d5ee75-98b2-4618-b048-8399ac196b1d,segment=NetworkSegment(41d673c0-9955-4cd6-a0c5-5199cc2371da),segment_id=41d673c0-9955-4cd6-a0c5-5199cc2371da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:01.341126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.342118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f52d000b-2a3f-4a4a-8109-89f1819b68be req-5475f4df-fd8e-4fdf-8376-22602841b7cb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c&device_id=1a4912a6-b3aa-498a-98d0-c78532125599&device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 2416 time: 0.3033788 Dec 21 04:09:01.356457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.359267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] Deleting port d1d5ee75-98b2-4618-b048-8399ac196b1d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:01.359877 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.364947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/networks/8ca707ed-1714-4984-87d4-bdc113648ab6 HTTP/1.1" status: 204 len: 168 time: 1.3658671 Dec 21 04:09:01.376786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53186) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:01.400802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d35d60d-48dc-47cb-a6cf-7d30ba6309b1 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Network': ['ID=8ca707ed-1714-4984-87d4-bdc113648ab6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:01.402538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1816c0a-ec95-40a4-9042-7bd989776cfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.446877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ab033bab-c07c-4e72-a7b9-a6213791e72a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:01.447543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.475114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f52d000b-2a3f-4a4a-8109-89f1819b68be req-767b7622-6a29-4f48-8ec5-14033b9df49d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1319566 Dec 21 04:09:01.512738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.520552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6eddc66e-f3df-4f23-b214-00ab63e9f627 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.545021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.548996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-607f5cc5-c93f-4cb2-8245-6b64dfda587d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.555656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] For port d1d5ee75-98b2-4618-b048-8399ac196b1d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d1d5ee75-98b2-4618-b048-8399ac196b1d,segment=NetworkSegment(41d673c0-9955-4cd6-a0c5-5199cc2371da),segment_id=41d673c0-9955-4cd6-a0c5-5199cc2371da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:01.556034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-607f5cc5-c93f-4cb2-8245-6b64dfda587d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.556034 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-607f5cc5-c93f-4cb2-8245-6b64dfda587d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d9e5d158-8507-43f7-b97d-64accd9c4e81 HTTP/1.1" status: 204 len: 168 time: 0.3379774 Dec 21 04:09:01.557314 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.560700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a1816c0a-ec95-40a4-9042-7bd989776cfd admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6cf9aa2100c9446e91f1b634e39d81eb&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1897464 Dec 21 04:09:01.561146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1816c0a-ec95-40a4-9042-7bd989776cfd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57daceae-afee-412a-980c-e3b904625682,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:01.564854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53192) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:01.592847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607f5cc5-c93f-4cb2-8245-6b64dfda587d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9e5d158-8507-43f7-b97d-64accd9c4e81,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:01.635965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] Calling delete_port for d1d5ee75-98b2-4618-b048-8399ac196b1d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:01.667827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Deleting port d1d5ee75-98b2-4618-b048-8399ac196b1d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:01.677023 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.771892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:01.835662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:01.851568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] For port d1d5ee75-98b2-4618-b048-8399ac196b1d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d1d5ee75-98b2-4618-b048-8399ac196b1d,segment=NetworkSegment(41d673c0-9955-4cd6-a0c5-5199cc2371da),segment_id=41d673c0-9955-4cd6-a0c5-5199cc2371da)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:01.851992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:01.857338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:01.862529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Pushing event updated for resources: {'Port': ['ID=6314beb6-1533-4c57-89b0-6f0b0e5661d0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:01.876310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc97ed2d-033a-4a02-bd72-bf9618704982 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:01.878503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Calling delete_port for d1d5ee75-98b2-4618-b048-8399ac196b1d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:01.920113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eddc66e-f3df-4f23-b214-00ab63e9f627 None None] Pushing event updated for resources: {'Port': ['ID=d1d5ee75-98b2-4618-b048-8399ac196b1d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:01.981447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1ed72eb4-9f0f-4f17-a23d-e948fbe8b767 None None] Provisioning complete for port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:01.982014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ed72eb4-9f0f-4f17-a23d-e948fbe8b767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.027035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e1d6baf-289c-43fc-b015-faeb8ae3f83e req-5d6504a6-47c9-49bd-b293-7ce9e35c62e5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:02.028973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e1d6baf-289c-43fc-b015-faeb8ae3f83e req-5d6504a6-47c9-49bd-b293-7ce9e35c62e5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.3632650 Dec 21 04:09:02.033823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb8a60c1-773d-4916-9ce7-93b7da72d93e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.056106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1ed72eb4-9f0f-4f17-a23d-e948fbe8b767 None None] Port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:02.091913 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.141836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.159253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb8a60c1-773d-4916-9ce7-93b7da72d93e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.187915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port ab033bab-c07c-4e72-a7b9-a6213791e72a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab033bab-c07c-4e72-a7b9-a6213791e72a,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:02.189289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] Pushing event deleted for resources: {'Port': ['ID=d1d5ee75-98b2-4618-b048-8399ac196b1d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:02.200285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4a513ee-5cd6-433a-94d8-e43a5aa7159f None None] No DVR routers for this DVR port d1d5ee75-98b2-4618-b048-8399ac196b1d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:02.215779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.246699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22a98801-b190-4a8b-94c7-42b1ea5f2714 None None] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:02.264136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Port': ['ID=d1d5ee75-98b2-4618-b048-8399ac196b1d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:02.264408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] No DVR routers for this DVR port d1d5ee75-98b2-4618-b048-8399ac196b1d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:02.285253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.314031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e1d6baf-289c-43fc-b015-faeb8ae3f83e req-79d95f26-f418-4713-8bb0-50d65817485e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2770083 Dec 21 04:09:02.402962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.408747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-270b8536-42c9-4bb3-8dd1-289f05984708 None None] Provisioning complete for port ab033bab-c07c-4e72-a7b9-a6213791e72a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:02.409483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-270b8536-42c9-4bb3-8dd1-289f05984708 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.444410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=ab033bab-c07c-4e72-a7b9-a6213791e72a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:02.472953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['50ea6055-0609-43f2-a7b5-fe58067f2d3d']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:02.513039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb8a60c1-773d-4916-9ce7-93b7da72d93e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.516231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bb8a60c1-773d-4916-9ce7-93b7da72d93e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.517024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41d673c0-9955-4cd6-a0c5-5199cc2371da') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:02.517656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bb8a60c1-773d-4916-9ce7-93b7da72d93e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/57daceae-afee-412a-980c-e3b904625682 HTTP/1.1" status: 204 len: 168 time: 0.9444134 Dec 21 04:09:02.537168 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93d0b107-514b-4a0c-ac42-bd0c4f206e4f None None] DHCP port deletion for 8ca707ed-1714-4984-87d4-bdc113648ab6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:02.544037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41d673c0-9955-4cd6-a0c5-5199cc2371da') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:02.563895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8a60c1-773d-4916-9ce7-93b7da72d93e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57daceae-afee-412a-980c-e3b904625682,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:02.611035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.627606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.642685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09e7647e-17d9-4656-a7fe-42a404c80944 None None] Network 8ca707ed-1714-4984-87d4-bdc113648ab6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:02.650772 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.664684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:02.666710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.676874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09e7647e-17d9-4656-a7fe-42a404c80944 None None] Network 8ca707ed-1714-4984-87d4-bdc113648ab6 could not be found, it might have been deleted concurrently. {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:02.686847 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:02.753844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5f38ca45-8efb-48bb-ad23-f218f0860ff0 None None] Could not find standard attr ID for object 45ba1e97-1bd3-46b1-b90b-6f72e9748eec. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:09:02.901291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.910659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:02.916192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/networks/50ea6055-0609-43f2-a7b5-fe58067f2d3d HTTP/1.1" status: 204 len: 168 time: 1.5345325 Dec 21 04:09:02.942097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53226) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:02.963170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1556235c-48c0-4f93-a74a-076cb844b736 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Network': ['ID=50ea6055-0609-43f2-a7b5-fe58067f2d3d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:02.984667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3d3ceef5-6cdf-4a26-b877-d498909f8573 None None] Provisioning complete for port ab033bab-c07c-4e72-a7b9-a6213791e72a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:02.985200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d3ceef5-6cdf-4a26-b877-d498909f8573 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.234190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.248017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab033bab-c07c-4e72-a7b9-a6213791e72a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:03.302823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.466731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ab033bab-c07c-4e72-a7b9-a6213791e72a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:03.471711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.572263 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.620622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:03.655592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75e87a02-5829-4752-961d-1b111349ae1c') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:03.655923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75e87a02-5829-4752-961d-1b111349ae1c') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:03.696804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.723655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.744447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Releasing vlan 110 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:03.746586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Router fb8045d1-7b4d-4398-bde2-94a619776157 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:09:03.751755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:03.755614 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:03.794527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d1d5ee75-98b2-4618-b048-8399ac196b1d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:03.844518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d1d5ee75-98b2-4618-b048-8399ac196b1d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:03.844886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d1d5ee75-98b2-4618-b048-8399ac196b1d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:03.845322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 45ba1e97-1bd3-46b1-b90b-6f72e9748eec no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:03.889139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 45ba1e97-1bd3-46b1-b90b-6f72e9748eec {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:03.890206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 45ba1e97-1bd3-46b1-b90b-6f72e9748eec not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:03.942552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.954569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:03.958974 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/networks/f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad HTTP/1.1" status: 204 len: 168 time: 1.0157807 Dec 21 04:09:03.963421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53250) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:04.015165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9b3396-554e-40a7-8331-2eaafd5406b2 tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Network': ['ID=f2b6359f-a7c7-46f7-8922-fbe2ef1c05ad,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:04.175227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.330214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.367821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e03317e-e56d-449f-8299-adb34404a030']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:04.371193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:09:04.379876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '29cc7d26-f2a7-4080-bb37-2b846cbc1159') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:04.380183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '29cc7d26-f2a7-4080-bb37-2b846cbc1159') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:04.385529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7ab034-491b-4f64-85bf-31f8fc163464 req-defa2acb-0ea6-4c62-b1ee-0f81017230bc tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:04.391582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-103b5107-c183-46b5-8300-874384b88092 None None] Sync routers for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:09:04.393086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.400532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db7ab034-491b-4f64-85bf-31f8fc163464 req-defa2acb-0ea6-4c62-b1ee-0f81017230bc tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0736907 Dec 21 04:09:04.409416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:04.410644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:04.434730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.444694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:04.445123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:04.448628 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:04.471785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db7ab034-491b-4f64-85bf-31f8fc163464 req-ee51ed60-239d-4c41-9343-7c3a4f9706c0 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715380 Dec 21 04:09:04.532821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.535291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-081c2a3b-22d5-4b86-88b9-8ede5fc939c8 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 5.9906442 Dec 21 04:09:04.537721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53268) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:04.607207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.624912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:04.636015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:04.653205 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] 10.222.0.18 "DELETE /v2.0/networks/8e03317e-e56d-449f-8299-adb34404a030 HTTP/1.1" status: 204 len: 168 time: 0.6885138 Dec 21 04:09:05.131081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:02Z', 'revision_number': 3, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:05.211934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-103b5107-c183-46b5-8300-874384b88092 None None] Checking router: fb8045d1-7b4d-4398-bde2-94a619776157 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:09:05.215813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-103b5107-c183-46b5-8300-874384b88092 None None] Updating router fb8045d1-7b4d-4398-bde2-94a619776157 port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:09:05.253981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-103b5107-c183-46b5-8300-874384b88092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:05.469166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53290) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:05.634838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769d81d0-e637-4483-9c7b-e2edf67a8a5e tempest-BulkNetworkOpsIpV6Test-1285737187 tempest-BulkNetworkOpsIpV6Test-1285737187-project] Pushing event deleted for resources: {'Network': ['ID=8e03317e-e56d-449f-8299-adb34404a030,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:05.665395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:05.772669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-103b5107-c183-46b5-8300-874384b88092 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:05.818837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-103b5107-c183-46b5-8300-874384b88092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:05.891700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-affe8585-31d3-405f-8004-5b54c24ece8f None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:05.931594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-103b5107-c183-46b5-8300-874384b88092 None None] Attempting to bind port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:05.932109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-103b5107-c183-46b5-8300-874384b88092 None None] Attempting to bind port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:05.932327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-103b5107-c183-46b5-8300-874384b88092 None None] Attempting to bind port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:05.932436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314d6766-de7d-4503-b722-ec3f65ad77fa req-902696bc-193c-4ce8-bf72-6ffecdb1a346 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:05.933941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-314d6766-de7d-4503-b722-ec3f65ad77fa req-902696bc-193c-4ce8-bf72-6ffecdb1a346 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.2708008 Dec 21 04:09:05.953773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-103b5107-c183-46b5-8300-874384b88092 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:05.960288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-103b5107-c183-46b5-8300-874384b88092 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:05.960288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-103b5107-c183-46b5-8300-874384b88092 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:05.960288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-103b5107-c183-46b5-8300-874384b88092 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:05.960288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-103b5107-c183-46b5-8300-874384b88092 None None] Bound port: 6314beb6-1533-4c57-89b0-6f0b0e5661d0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:05.960288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-103b5107-c183-46b5-8300-874384b88092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:05.960288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab07a86-03d6-4e66-975b-49d35f931532 None None] Pushing event updated for resources: {'Port': ['ID=6314beb6-1533-4c57-89b0-6f0b0e5661d0,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:06.024515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5b312836-d99d-4dc3-8dad-fba90639d04b None None] Provisioning complete for port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:06.025134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b312836-d99d-4dc3-8dad-fba90639d04b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.076711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-103b5107-c183-46b5-8300-874384b88092 None None] For port 6314beb6-1533-4c57-89b0-6f0b0e5661d0, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:06.089155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5b312836-d99d-4dc3-8dad-fba90639d04b None None] Port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:06.094328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-103b5107-c183-46b5-8300-874384b88092 None None] For port 6314beb6-1533-4c57-89b0-6f0b0e5661d0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6314beb6-1533-4c57-89b0-6f0b0e5661d0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:06.104638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-43aa0260-ac9b-49ad-a201-40b0a359b924 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e5cffb54a3634af89a1d0642fb35f4fc&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6319640 Dec 21 04:09:06.105054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53302) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:06.135181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-314d6766-de7d-4503-b722-ec3f65ad77fa req-6974821f-4744-4a49-a2e0-bd75e2ceb6fa tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1870766 Dec 21 04:09:06.177474 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-103b5107-c183-46b5-8300-874384b88092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.181809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-541a7df7-bb50-4434-a46d-6378ed4a1125 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.206072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-541a7df7-bb50-4434-a46d-6378ed4a1125 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.207828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Allocated IP 172.20.0.1 (9e019c2c-b199-4210-baef-b6bda8c43e06/d1e185a5-063a-405d-ae9d-3ac5d19302c8/594f295c-89df-4262-968f-a11a1037350c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:06.299195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab07a86-03d6-4e66-975b-49d35f931532 None None] Pushing event updated for resources: {'Port': ['ID=6314beb6-1533-4c57-89b0-6f0b0e5661d0,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:06.307087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a236210-0019-4e5b-a992-74d89b16c9c5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:06.320081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:06.320798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:06.387064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-541a7df7-bb50-4434-a46d-6378ed4a1125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.389956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-541a7df7-bb50-4434-a46d-6378ed4a1125 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.391471 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-541a7df7-bb50-4434-a46d-6378ed4a1125 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/498f835e-87e6-413d-a52e-f52fea8e8881 HTTP/1.1" status: 204 len: 168 time: 0.2853036 Dec 21 04:09:06.406827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541a7df7-bb50-4434-a46d-6378ed4a1125 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=498f835e-87e6-413d-a52e-f52fea8e8881,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:06.510320 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.668235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.689323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be9b8f8c-2a2f-48ac-b629-59c8c84014cb None None] Provisioning complete for port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:06.690427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be9b8f8c-2a2f-48ac-b629-59c8c84014cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:06.739848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:06.786595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Pushing event updated for resources: {'Port': ['ID=594f295c-89df-4262-968f-a11a1037350c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:06.804416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:06.806136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:06.809066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:06.863200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:07.005914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be9b8f8c-2a2f-48ac-b629-59c8c84014cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:07.057577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-be9b8f8c-2a2f-48ac-b629-59c8c84014cb None None] For port 6314beb6-1533-4c57-89b0-6f0b0e5661d0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6314beb6-1533-4c57-89b0-6f0b0e5661d0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:07.141330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be9b8f8c-2a2f-48ac-b629-59c8c84014cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:07.324197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:07.326318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9b8f8c-2a2f-48ac-b629-59c8c84014cb None None] Pushing event updated for resources: {'Port': ['ID=6314beb6-1533-4c57-89b0-6f0b0e5661d0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:07.351726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-05a2089c-3181-48af-922c-eb6b62b10d0d None None] Provisioning complete for port 594f295c-89df-4262-968f-a11a1037350c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:07.352225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05a2089c-3181-48af-922c-eb6b62b10d0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:07.404640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-103b5107-c183-46b5-8300-874384b88092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:02Z', 'revision_number': 3, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:07.414526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09af4160-683e-449c-810e-10ad63a6c1d7 req-b52cbec4-4810-4468-a6db-325357df0888 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:07.421901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09af4160-683e-449c-810e-10ad63a6c1d7 req-b52cbec4-4810-4468-a6db-325357df0888 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1753442 Dec 21 04:09:07.444365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-103b5107-c183-46b5-8300-874384b88092 None None] The sync data for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 is: [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:02Z', 'revision_number': 3, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:09:07.448001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-05a2089c-3181-48af-922c-eb6b62b10d0d None None] Port 594f295c-89df-4262-968f-a11a1037350c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:07.642595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09af4160-683e-449c-810e-10ad63a6c1d7 req-a54a2702-8b86-42d8-997b-9c3afb73f50e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2192230 Dec 21 04:09:07.782735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:07.861121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:08.028462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:08.036527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Pushing event updated for resources: {'Port': ['ID=594f295c-89df-4262-968f-a11a1037350c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:08.218287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:08.222964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:08.407808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53366) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:08.458126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Router fb8045d1-7b4d-4398-bde2-94a619776157 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:09:08.612168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-781908567'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:08.651221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:09:08.661672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cbf93a25-fb42-4e3a-a236-fcbb370e7c4f admin admin] 10.222.0.18 "PUT /v2.0/routers/fb8045d1-7b4d-4398-bde2-94a619776157/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1227338 Dec 21 04:09:08.690382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a863f3bb-41fd-4302-abbb-bef2ad3de056 None None] Provisioning complete for port 594f295c-89df-4262-968f-a11a1037350c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:08.691305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a863f3bb-41fd-4302-abbb-bef2ad3de056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:08.728613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a863f3bb-41fd-4302-abbb-bef2ad3de056 None None] Port 594f295c-89df-4262-968f-a11a1037350c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:08.734394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:08.734394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:08.747703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:08.824516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f33d9a-f88b-4ef0-b7d0-053d81dcb04a req-aade128d-206f-4482-a3c6-7fadfb888ed5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:08.833099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3f33d9a-f88b-4ef0-b7d0-053d81dcb04a req-aade128d-206f-4482-a3c6-7fadfb888ed5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0689006 Dec 21 04:09:08.882163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3f33d9a-f88b-4ef0-b7d0-053d81dcb04a req-ec268222-eec8-45cf-ba1f-f933849e6d68 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481396 Dec 21 04:09:08.940618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.010320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.060794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:09.069939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b523941-b0a1-44a8-82ed-2acce5b05285,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:09.084852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.086300 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment d914e185-72b4-44bf-8f4a-cf96505aef18 of type vlan for network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 Dec 21 04:09:09.149583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.168233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6314beb6-1533-4c57-89b0-6f0b0e5661d0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:09.227323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:09.227739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.249697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.256289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:09.257193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.349650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=4d7bf9bb-c744-49be-bfb6-28f1087deba3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:09.366919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:09.378206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53390) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:09.378763 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eab84ffa-ee4e-4a81-ae5a-760e041737b0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.9685042 Dec 21 04:09:09.385825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'name': 'tempest-PortsIpV6TestJSON-1824406719'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:09.598194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:09.602203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.628923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port da787046-7c07-4994-922f-d4afd6a3e498 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:09.819632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:09.898099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53406) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:09.904566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBackupRestore-2110630992-network', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:09.966306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.006758 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Sync routers for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:09:10.015747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Made reservation on behalf of 234f738ac38343e0a26b2868b4c339cf for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:10.016414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.022344 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:10.023246 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:10.057559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.077075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=da787046-7c07-4994-922f-d4afd6a3e498,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:10.118425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23e564c-dc2a-4fc0-9430-8900ef93fa15 req-dbc01a5b-c073-402a-ac0c-b2fb14c329d0 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:10.120092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a23e564c-dc2a-4fc0-9430-8900ef93fa15 req-dbc01a5b-c073-402a-ac0c-b2fb14c329d0 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1433704 Dec 21 04:09:10.124151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': 'd914e185-72b4-44bf-8f4a-cf96505aef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:10.124520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: 4d7bf9bb-c744-49be-bfb6-28f1087deba3, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:10.214126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a23e564c-dc2a-4fc0-9430-8900ef93fa15 req-0520e71f-2b64-4417-b658-c7d88cc1baef tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832067 Dec 21 04:09:10.227563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:10.241646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.249217 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:10.301133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4d7bf9bb-c744-49be-bfb6-28f1087deba3) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:10.305935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:10.312522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3d9b99c-5152-416f-a190-46f8386be287 None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:10.316869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:10.317618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.331363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.355363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:10.370172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca1f4688-d755-4dad-9d89-5caf66596f14,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:10.375540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.376016 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Added segment 1d4383a4-1d40-41a1-aed5-4816cb4f0ee0 of type vlan for network f4c77e9f-d236-48d1-a572-296b459350f9 Dec 21 04:09:10.414466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0e1fcdce-7067-4cf0-bd34-cb1dc89f7fd9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.0344160 Dec 21 04:09:10.417511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53412) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:10.426410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-343435409'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:10.429344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.512237 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 2, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:10.535446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.536757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:10.537418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.538471 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Checking router: fb8045d1-7b4d-4398-bde2-94a619776157 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:09:10.538833 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Updating router fb8045d1-7b4d-4398-bde2-94a619776157 port 594f295c-89df-4262-968f-a11a1037350c binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:09:10.560673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:10.567406 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.577833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.652586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:10.664344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.664816 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment d44f8b25-7617-4fa7-afd6-b6746df75162 of type vlan for network 0b66c1a9-cd12-4beb-84e5-e0e776f0348e Dec 21 04:09:10.673227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7711630 Dec 21 04:09:10.675182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53418) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:10.679885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Request body: {'subnet': {'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBackupRestore-2110630992-subnet', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:10.684089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40428a6d-6140-473a-bb58-161c2e18ad82 admin admin] Pushing event updated for resources: {'Network': ['ID=f4c77e9f-d236-48d1-a572-296b459350f9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:10.697057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f4c77e9f-d236-48d1-a572-296b459350f9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:10.728000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.798351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Made reservation on behalf of 234f738ac38343e0a26b2868b4c339cf for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:10.802791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.827258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.833802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:10.834412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.937086 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:10.945536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=0b66c1a9-cd12-4beb-84e5-e0e776f0348e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:10.957650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 0b66c1a9-cd12-4beb-84e5-e0e776f0348e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:10.960916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:10.961491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f190925f-0bb1-48f7-95b0-47be548f4eb4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.5422103 Dec 21 04:09:10.966628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'ports': [{'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'}, {'network_id': '0b66c1a9-cd12-4beb-84e5-e0e776f0348e'}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:10.967145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:10.967652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '0b66c1a9-cd12-4beb-84e5-e0e776f0348e'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:11.032394 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.151686 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Attempting to bind port 594f295c-89df-4262-968f-a11a1037350c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:11.152262 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Attempting to bind port 594f295c-89df-4262-968f-a11a1037350c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:11.152814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Attempting to bind port 594f295c-89df-4262-968f-a11a1037350c on network 9e019c2c-b199-4210-baef-b6bda8c43e06 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:11.156638 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Pushing event updated for resources: {'Port': ['ID=594f295c-89df-4262-968f-a11a1037350c,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:11.169460 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.170146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.170658 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.173293 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.173804 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.174858 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.178257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:11.182320 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:11.182986 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Checking segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:11.183636 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.184197 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Bound using segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:11.184735 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Bound port: 594f295c-89df-4262-968f-a11a1037350c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:11.185115 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.259991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] For port 594f295c-89df-4262-968f-a11a1037350c, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:11.269766 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] For port 594f295c-89df-4262-968f-a11a1037350c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=594f295c-89df-4262-968f-a11a1037350c,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:11.291297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.368361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 2} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:11.372845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.382481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Pushing event updated for resources: {'Subnet': ['ID=97bbd748-5025-4159-b697-b3060bf9cc6e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:11.384044 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.418858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.432592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Checking segment: {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:11.432973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Network hostable DHCP agents. Network: f4c77e9f-d236-48d1-a572-296b459350f9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:11.442431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad542f6-8146-49a4-bd88-5739fd33535e req-ace24d18-5707-4970-8d7d-72174213efce tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:11.444646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ad542f6-8146-49a4-bd88-5739fd33535e req-ace24d18-5707-4970-8d7d-72174213efce tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1278486 Dec 21 04:09:11.464887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:11.465600 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:11.492781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e8330458-04bc-4472-91d1-170a10e94299 None None] Provisioning complete for port 594f295c-89df-4262-968f-a11a1037350c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:11.495237 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8330458-04bc-4472-91d1-170a10e94299 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.506370 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf14cc63-9063-4c29-968f-b9f18139558d None None] Pushing event updated for resources: {'Port': ['ID=594f295c-89df-4262-968f-a11a1037350c,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:11.594412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Network f4c77e9f-d236-48d1-a572-296b459350f9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:11.646370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port d3d8dd3d-ec6c-443a-92a9-bb5f6b233240 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:11.675728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ad542f6-8146-49a4-bd88-5739fd33535e req-ec30d9c1-d028-42fc-b30b-16d9974c1cc4 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2205770 Dec 21 04:09:11.695384 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8330458-04bc-4472-91d1-170a10e94299 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.733977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f4c77e9f-d236-48d1-a572-296b459350f9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:11.737402 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:11.754460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bd3521c-f686-4e03-a192-7d88bc4837cc None None] Network f4c77e9f-d236-48d1-a572-296b459350f9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:11.760266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e8330458-04bc-4472-91d1-170a10e94299 None None] For port 594f295c-89df-4262-968f-a11a1037350c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=594f295c-89df-4262-968f-a11a1037350c,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:11.788426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:11.789028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.873394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8330458-04bc-4472-91d1-170a10e94299 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.904904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.945452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-f4c77e9f-d236-48d1-a572-296b459350f9', 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9', 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'fixed_ips': [{'subnet_id': '97bbd748-5025-4159-b697-b3060bf9cc6e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:09:11.946569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:11.996369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port c0d21506-61db-4715-9294-e24ce3963d82 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:12.018699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:12.030887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-14290bec-a442-4aa1-8c1a-40900702ab01 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.3524337 Dec 21 04:09:12.036602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:12.037530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:12.063887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8330458-04bc-4472-91d1-170a10e94299 None None] Pushing event updated for resources: {'Port': ['ID=594f295c-89df-4262-968f-a11a1037350c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:12.066667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efd00909-bf8b-439b-ae86-e5460ba378a4 None None] The sync data for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 is: [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:09:12.093108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d020ab7a-08c8-421b-bd09-ff4d357c0ad1 None None] Provisioning complete for port 594f295c-89df-4262-968f-a11a1037350c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:12.093491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d020ab7a-08c8-421b-bd09-ff4d357c0ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.164246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.167500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.248699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.253499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Allocated IP 172.20.0.2 (f4c77e9f-d236-48d1-a572-296b459350f9/97bbd748-5025-4159-b697-b3060bf9cc6e/b2ce3e56-61ff-4467-bd22-2ef217614e4a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:12.290640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.421549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.519752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:12.523854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:12.529573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:12.531972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.534232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=d3d8dd3d-ec6c-443a-92a9-bb5f6b233240,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:12.545572 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.594854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.622700 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.642529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=c0d21506-61db-4715-9294-e24ce3963d82,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:12.679248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': 'd44f8b25-7617-4fa7-afd6-b6746df75162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '0b66c1a9-cd12-4beb-84e5-e0e776f0348e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:12.680205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: 0b66c1a9-cd12-4beb-84e5-e0e776f0348e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:12.713708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Network f4c77e9f-d236-48d1-a572-296b459350f9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:12.721689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:12.753127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:12.765129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Pushing event updated for resources: {'Port': ['ID=b2ce3e56-61ff-4467-bd22-2ef217614e4a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:12.820489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 0b66c1a9-cd12-4beb-84e5-e0e776f0348e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:12.862843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Attempting to bind port b2ce3e56-61ff-4467-bd22-2ef217614e4a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:12.863394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Attempting to bind port b2ce3e56-61ff-4467-bd22-2ef217614e4a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:12.863857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Attempting to bind port b2ce3e56-61ff-4467-bd22-2ef217614e4a on network f4c77e9f-d236-48d1-a572-296b459350f9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:12.873781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:12.875544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Checking segment: {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:12.876277 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.876924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Bound using segment: {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:12.878233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Bound port: b2ce3e56-61ff-4467-bd22-2ef217614e4a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:12.878842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.919479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 0b66c1a9-cd12-4beb-84e5-e0e776f0348e) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:12.929633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:12.942673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:12.943146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6abecbaa-99ec-4cab-a846-2368fac70a48 None None] Network 0b66c1a9-cd12-4beb-84e5-e0e776f0348e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:12.955806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:12.956593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:12.990476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c4179b-c319-4eaa-9914-c1b4d0b1d33d req-edaf8586-2c7e-4707-8338-e8802e661cd8 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:13.001910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0c4179b-c319-4eaa-9914-c1b4d0b1d33d req-edaf8586-2c7e-4707-8338-e8802e661cd8 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1728251 Dec 21 04:09:13.074020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.100423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.105795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0c4179b-c319-4eaa-9914-c1b4d0b1d33d req-58c4cccd-a547-4cb8-a5ac-ae982de6f2bd tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023123 Dec 21 04:09:13.121161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b688284c-dfe2-4662-b372-3f563b1905a3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.1589816 Dec 21 04:09:13.129795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53454) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:13.138742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] For port b2ce3e56-61ff-4467-bd22-2ef217614e4a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:13.165245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] For port b2ce3e56-61ff-4467-bd22-2ef217614e4a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2ce3e56-61ff-4467-bd22-2ef217614e4a,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:13.212370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 594f295c-89df-4262-968f-a11a1037350c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:13.258367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.259050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port c0d21506-61db-4715-9294-e24ce3963d82 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:13.259630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.310831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Allocated IP 172.25.5.38 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/12ec6ed9-b708-4684-8b05-b0839520bbf5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:13.342513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd21160a-4853-4cb4-a334-96b4e79449c2 None None] Pushing event updated for resources: {'Port': ['ID=b2ce3e56-61ff-4467-bd22-2ef217614e4a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:13.389560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.393838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 594f295c-89df-4262-968f-a11a1037350c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:13.394215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.421759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for c0d21506-61db-4715-9294-e24ce3963d82 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:13.541276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.673125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.718901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.725132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.732050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/c0d21506-61db-4715-9294-e24ce3963d82 HTTP/1.1" status: 204 len: 168 time: 0.5977905 Dec 21 04:09:13.733023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53456) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:13.733572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8634da74-458e-4989-80e4-2bdded9b0e9f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=c0d21506-61db-4715-9294-e24ce3963d82,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:13.812443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:13.818671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:13.830336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:13.847499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-207c614e-6fa2-4f5b-a4b2-b712e1e58374 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:13.854280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Pushing event updated for resources: {'Port': ['ID=12ec6ed9-b708-4684-8b05-b0839520bbf5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:13.910807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b1be30eb-ed48-41f7-8e91-2e7776c18977 None None] Provisioning complete for port 12ec6ed9-b708-4684-8b05-b0839520bbf5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:13.913212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4978db6-ac2c-4996-8f13-4ff53fa33fcc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:13.914623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1be30eb-ed48-41f7-8e91-2e7776c18977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:13.922523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4978db6-ac2c-4996-8f13-4ff53fa33fcc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:13.925092 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4978db6-ac2c-4996-8f13-4ff53fa33fcc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1456 time: 0.1624372 Dec 21 04:09:13.927926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53460) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:13.999870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b1be30eb-ed48-41f7-8e91-2e7776c18977 None None] Port 12ec6ed9-b708-4684-8b05-b0839520bbf5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:14.075875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port d3d8dd3d-ec6c-443a-92a9-bb5f6b233240 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:14.076371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.176664 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.201677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for d3d8dd3d-ec6c-443a-92a9-bb5f6b233240 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:14.289893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.320501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-087cc7c0-b722-4067-92b7-d19aac463131 req-5f8f7939-c994-4031-a486-6acc0c1ef92d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:14.321980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-087cc7c0-b722-4067-92b7-d19aac463131 req-5f8f7939-c994-4031-a486-6acc0c1ef92d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0711894 Dec 21 04:09:14.391621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.437319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.444511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/d3d8dd3d-ec6c-443a-92a9-bb5f6b233240 HTTP/1.1" status: 204 len: 168 time: 0.5152481 Dec 21 04:09:14.445282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:14.446153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-916f3af8-56ac-4937-865b-23b07f6251f7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=d3d8dd3d-ec6c-443a-92a9-bb5f6b233240,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:14.459969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-087cc7c0-b722-4067-92b7-d19aac463131 req-e0b303d7-6140-451f-802a-e25747b0cb5c tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1281338 Dec 21 04:09:14.529064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f0cdff6-fa37-44dc-a302-3ddce4fb63f4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:14.530621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7f0cdff6-fa37-44dc-a302-3ddce4fb63f4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.0696530 Dec 21 04:09:14.533904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53476) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:14.544207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.558328 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-cdb48339-db7a-43a1-be00-2203a93c20bc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:14.560143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cdb48339-db7a-43a1-be00-2203a93c20bc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/c0d21506-61db-4715-9294-e24ce3963d82 HTTP/1.1" status: 404 len: 333 time: 0.0250032 Dec 21 04:09:14.563387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53478) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:14.612891 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-e659845d-397f-4a55-9fda-fa55caff2e73 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:14.612891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e659845d-397f-4a55-9fda-fa55caff2e73 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/d3d8dd3d-ec6c-443a-92a9-bb5f6b233240 HTTP/1.1" status: 404 len: 333 time: 0.0460613 Dec 21 04:09:14.614144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53482) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:14.775284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.921319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:14.962815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:09:14.989237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0b66c1a9-cd12-4beb-84e5-e0e776f0348e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:15.001039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97bca964-d617-46ca-9a79-1bfebc1b3c92 None None] Network f4c77e9f-d236-48d1-a572-296b459350f9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:15.016456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd44f8b25-7617-4fa7-afd6-b6746df75162') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:15.017309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd44f8b25-7617-4fa7-afd6-b6746df75162') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:15.124577 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.157778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.199736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:15.200705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:15.207173 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:15.216415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-38cd1cef-a0bf-4933-b28a-21fd13a0e37e None None] Provisioning complete for port b2ce3e56-61ff-4467-bd22-2ef217614e4a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:15.219405 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-38cd1cef-a0bf-4933-b28a-21fd13a0e37e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.264474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2ce3e56-61ff-4467-bd22-2ef217614e4a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:15.311124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:09:15.410255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.416019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.424545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/0b66c1a9-cd12-4beb-84e5-e0e776f0348e HTTP/1.1" status: 204 len: 168 time: 0.8054826 Dec 21 04:09:15.425349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53496) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:15.430809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-951434785'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:15.458414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.462769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-75c61f0f-a149-4baa-9a5b-6f850490486e admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 3.4300783 Dec 21 04:09:15.463694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:15.469851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Sync routers for ids ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:09:15.513211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Routers {'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:15.514116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:15.518370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:15.523423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.582192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715acde5-9012-42dd-8b56-fd873c61d6ee tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=0b66c1a9-cd12-4beb-84e5-e0e776f0348e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:15.625765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Set router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:15.631514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:15.700933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.701548 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f of type vlan for network 6bce8011-f9ac-4d60-89fb-d82fca478d5f Dec 21 04:09:15.798243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b2ce3e56-61ff-4467-bd22-2ef217614e4a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:15.798804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.880921 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-38cd1cef-a0bf-4933-b28a-21fd13a0e37e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:15.954268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.081114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b2ce3e56-61ff-4467-bd22-2ef217614e4a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2ce3e56-61ff-4467-bd22-2ef217614e4a,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:16.086415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.118795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:09:14Z', 'revision_number': 3, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:16.185657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Checking router: dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:09:16.186264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Updating router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f port 12ec6ed9-b708-4684-8b05-b0839520bbf5 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:09:16.190404 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.344322 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-38cd1cef-a0bf-4933-b28a-21fd13a0e37e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:09:16.345002 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-38cd1cef-a0bf-4933-b28a-21fd13a0e37e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:09:16.381822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b2ce3e56-61ff-4467-bd22-2ef217614e4a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:16.387235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Allocated IP 172.20.0.1 (f4c77e9f-d236-48d1-a572-296b459350f9/97bbd748-5025-4159-b697-b3060bf9cc6e/f7190364-498c-4f32-b3a4-9c317a663960) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:16.391806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.404585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.407666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db54607-017e-4c42-85a2-b9bb697011de req-186a37c3-08da-417e-a1ac-a85a18d01b07 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:16.409258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7db54607-017e-4c42-85a2-b9bb697011de req-186a37c3-08da-417e-a1ac-a85a18d01b07 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.8366416 Dec 21 04:09:16.480759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7db54607-017e-4c42-85a2-b9bb697011de req-b92b812f-5051-40b5-86f2-784d2d1f0d77 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609806 Dec 21 04:09:16.525058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.529810 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.532816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:16.533479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.649835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:16.696859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.2702501 Dec 21 04:09:16.704142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:16.706110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6386c20-ffe9-407d-872a-9c00bef082d3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=6bce8011-f9ac-4d60-89fb-d82fca478d5f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:16.728024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:16.728724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:16.768987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:16.812349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Network f4c77e9f-d236-48d1-a572-296b459350f9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:16.831403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:16.836405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:16.993640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04ff7ae1-eb4d-437d-8f2e-481868a6bf2b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.023303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.098555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5963bcd9-6653-4479-911a-2ea88a02d476 None None] Provisioning complete for port b2ce3e56-61ff-4467-bd22-2ef217614e4a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:17.099201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5963bcd9-6653-4479-911a-2ea88a02d476 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.153703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.174424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04ff7ae1-eb4d-437d-8f2e-481868a6bf2b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.176702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2ce3e56-61ff-4467-bd22-2ef217614e4a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:17.258952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e379a1e-625a-452e-b11c-86031544715e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:17.260776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04ff7ae1-eb4d-437d-8f2e-481868a6bf2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.296481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b6c3d8-3be1-42ed-9fd4-083de7bd0986 None None] Pushing event updated for resources: {'Port': ['ID=12ec6ed9-b708-4684-8b05-b0839520bbf5,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:17.299721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Attempting to bind port 12ec6ed9-b708-4684-8b05-b0839520bbf5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:17.301119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Attempting to bind port 12ec6ed9-b708-4684-8b05-b0839520bbf5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:17.301868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Attempting to bind port 12ec6ed9-b708-4684-8b05-b0839520bbf5 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:17.321373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:17.321802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:17.322344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.323883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:17.324432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Bound port: 12ec6ed9-b708-4684-8b05-b0839520bbf5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:17.324835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.382999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-04ff7ae1-eb4d-437d-8f2e-481868a6bf2b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a7ba32cab2e24a1c8e4655939b9fe921&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6128383 Dec 21 04:09:17.386854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53536) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:17.405217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] For port 12ec6ed9-b708-4684-8b05-b0839520bbf5, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:17.409207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] For port 12ec6ed9-b708-4684-8b05-b0839520bbf5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12ec6ed9-b708-4684-8b05-b0839520bbf5,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:17.428612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ff7ae1-eb4d-437d-8f2e-481868a6bf2b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6f2da1b-ef1a-4092-a919-ab3beef98659,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:17.458769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a68a2e7c-e72d-4daf-809e-8674cfb11aa1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.484910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a68a2e7c-e72d-4daf-809e-8674cfb11aa1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.487917 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.493516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b2ce3e56-61ff-4467-bd22-2ef217614e4a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:17.493885 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.542531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Pushing event updated for resources: {'Port': ['ID=f7190364-498c-4f32-b3a4-9c317a663960,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:17.554530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.586968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f1039f4-36a4-4c85-b9a5-0612181ec37c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:17.612187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Routers {'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:17.612823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:17.650410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a68a2e7c-e72d-4daf-809e-8674cfb11aa1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.654829 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a68a2e7c-e72d-4daf-809e-8674cfb11aa1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.656745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a68a2e7c-e72d-4daf-809e-8674cfb11aa1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e6f2da1b-ef1a-4092-a919-ab3beef98659 HTTP/1.1" status: 204 len: 168 time: 0.2687356 Dec 21 04:09:17.671822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bdeb9fb-b997-4cbf-8129-5c575e5d7eb5 req-b4943bf5-abb9-4fa7-aafd-5eed82adaed7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:17.680145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b6c3d8-3be1-42ed-9fd4-083de7bd0986 None None] Pushing event updated for resources: {'Port': ['ID=12ec6ed9-b708-4684-8b05-b0839520bbf5,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:17.683006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bdeb9fb-b997-4cbf-8129-5c575e5d7eb5 req-b4943bf5-abb9-4fa7-aafd-5eed82adaed7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0963988 Dec 21 04:09:17.699083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a68a2e7c-e72d-4daf-809e-8674cfb11aa1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6f2da1b-ef1a-4092-a919-ab3beef98659,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:17.757282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bdeb9fb-b997-4cbf-8129-5c575e5d7eb5 req-9f2bc3cd-bbb7-488f-9b2c-e12115f21010 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731721 Dec 21 04:09:17.817180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Provisioning complete for port 12ec6ed9-b708-4684-8b05-b0839520bbf5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:17.817559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.832568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:17.836437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.860495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] Set router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:17.920589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:17.924840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Performing IP validity checks on allocation pools {{(pid=110311) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 04:09:17.928746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110311) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 04:09:18.202471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.213570 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.244665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.246739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.260725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] For port 12ec6ed9-b708-4684-8b05-b0839520bbf5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12ec6ed9-b708-4684-8b05-b0839520bbf5,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:18.288906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:09:14Z', 'revision_number': 3, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:18.318575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df0deb7f-98e5-42a3-8d5e-db6ee3a75931 None None] The sync data for ids ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'] in n-d-822053-11 is: [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:09:14Z', 'revision_number': 3, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:09:18.325388 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.392024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Pushing event updated for resources: {'Port': ['ID=12ec6ed9-b708-4684-8b05-b0839520bbf5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:18.414102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Provisioning complete for port f7190364-498c-4f32-b3a4-9c317a663960 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:18.414102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.415734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.438080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Pushing event updated for resources: {'Port': ['ID=f7190364-498c-4f32-b3a4-9c317a663960,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:18.452955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53558) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:18.454625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=8069bf6d-f683-4bb4-a2ff-61b5579bc456,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:18.474012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1d546556-0ab5-461e-912a-d9b43b012426 None None] Port f7190364-498c-4f32-b3a4-9c317a663960 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:18.478625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-568d0343-3276-42c4-88dd-2b7bd8d3642f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.516730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:18.517609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: 6bce8011-f9ac-4d60-89fb-d82fca478d5f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:18.559919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-568d0343-3276-42c4-88dd-2b7bd8d3642f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.564566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Network f4c77e9f-d236-48d1-a572-296b459350f9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:18.566132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:18.627855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-568d0343-3276-42c4-88dd-2b7bd8d3642f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.672232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:18.681037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-568d0343-3276-42c4-88dd-2b7bd8d3642f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5c1dfa3f5b0f42d2946aaa3cdc0a3720&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2263083 Dec 21 04:09:18.681630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53562) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:18.683185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-568d0343-3276-42c4-88dd-2b7bd8d3642f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b221b470-0c48-4923-8d23-90a5a27bd0d8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:18.744788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:09:18.768968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6bce8011-f9ac-4d60-89fb-d82fca478d5f) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:18.774405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:18.775034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.779664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59b09673-469e-4dfe-9d64-d6a1f0dd2ea9 None None] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:18.780355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79f947c2-f0fb-4ba6-9214-2609475d0e75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.895444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79f947c2-f0fb-4ba6-9214-2609475d0e75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.900149 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a7f54660-552c-4791-8e87-9bb1f052649e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.1816926 Dec 21 04:09:18.905402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:18.939627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f', 'name': 'tempest-PortsIpV6TestJSON-453766979'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:18.989599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-6bce8011-f9ac-4d60-89fb-d82fca478d5f', 'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': '8069bf6d-f683-4bb4-a2ff-61b5579bc456'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:09:18.990490 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:18.994794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ac6e24-8d05-4072-b7fa-3ee2ec1b0fe4 req-246392e0-e145-43d1-9239-c2e2d02905da tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:18.996574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99ac6e24-8d05-4072-b7fa-3ee2ec1b0fe4 req-246392e0-e145-43d1-9239-c2e2d02905da tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1312766 Dec 21 04:09:19.063356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99ac6e24-8d05-4072-b7fa-3ee2ec1b0fe4 req-ab81d080-30d3-401a-8d20-94ff0d48ae4e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584784 Dec 21 04:09:19.110187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a9aba6fc-38b7-4b08-9f96-1e50c2d1208c None None] Provisioning complete for port f7190364-498c-4f32-b3a4-9c317a663960 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:19.110573 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9aba6fc-38b7-4b08-9f96-1e50c2d1208c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.136031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:09:19.146567 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19033336-f6cf-4fe6-92cb-2a16c194c5b8 admin admin] 10.222.0.18 "PUT /v2.0/routers/dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6815641 Dec 21 04:09:19.211712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a9aba6fc-38b7-4b08-9f96-1e50c2d1208c None None] Port f7190364-498c-4f32-b3a4-9c317a663960 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:19.222331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Allocated IP 2001:db8::2 (6bce8011-f9ac-4d60-89fb-d82fca478d5f/8069bf6d-f683-4bb4-a2ff-61b5579bc456/b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:19.237363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12ec6ed9-b708-4684-8b05-b0839520bbf5 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:19.327245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79f947c2-f0fb-4ba6-9214-2609475d0e75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.327245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79f947c2-f0fb-4ba6-9214-2609475d0e75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.327688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-79f947c2-f0fb-4ba6-9214-2609475d0e75 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b221b470-0c48-4923-8d23-90a5a27bd0d8 HTTP/1.1" status: 204 len: 168 time: 0.6431327 Dec 21 04:09:19.350317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f947c2-f0fb-4ba6-9214-2609475d0e75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b221b470-0c48-4923-8d23-90a5a27bd0d8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:19.369271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:19.373545 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.406482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 12ec6ed9-b708-4684-8b05-b0839520bbf5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:19.406858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.408991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 44026b7a-4841-4084-a474-972bcd64ec9e yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:19.631154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.721166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.780617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:19.784585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:19.789435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:19.798558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Pushing event updated for resources: {'Port': ['ID=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:19.799541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::6d (6bce8011-f9ac-4d60-89fb-d82fca478d5f/8069bf6d-f683-4bb4-a2ff-61b5579bc456/44026b7a-4841-4084-a474-972bcd64ec9e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:19.856181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61ddbcbd-3860-4516-91b7-9d1518994a99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.869489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Attempting to bind port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:19.869937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Attempting to bind port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:19.870371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Attempting to bind port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 on network 6bce8011-f9ac-4d60-89fb-d82fca478d5f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:19.877046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:19.878128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Checking segment: {'id': 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:19.878128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.878694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Bound using segment: {'id': 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:19.879397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Bound port: b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '6bce8011-f9ac-4d60-89fb-d82fca478d5f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:19.880493 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:19.988016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] For port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:19.992551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] For port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,segment=NetworkSegment(dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f),segment_id=dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:20.073342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:20.105432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:20.195209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db71ca6c-0f86-4394-95c8-7d878fc81c1d None None] Pushing event updated for resources: {'Port': ['ID=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:20.269684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651dfc71-b8d0-4c3c-aa14-4a8f6c34918e req-519329a9-bb89-4d86-8789-a79cac998522 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:20.271342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-651dfc71-b8d0-4c3c-aa14-4a8f6c34918e req-519329a9-bb89-4d86-8789-a79cac998522 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0770791 Dec 21 04:09:20.295876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:20.335562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-651dfc71-b8d0-4c3c-aa14-4a8f6c34918e req-9661f7a7-9775-4a73-b604-9bb066b02a9b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541070 Dec 21 04:09:20.422241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=44026b7a-4841-4084-a474-972bcd64ec9e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:20.426535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:20.435059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:20.442552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.442914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.443291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.443670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.443980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.444321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.446408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.446408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.446408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.446408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.446773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.450097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.450097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:20.451637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:20.463563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:20.467431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:20.593064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53654) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:20.599812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d708b18e-e45e-471f-a13a-aaf4bbe29461 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.6709428 Dec 21 04:09:20.749760 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Sync routers for ids ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:09:20.761703 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Routers {'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:20.762442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:20.765210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 44026b7a-4841-4084-a474-972bcd64ec9e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:20.765691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:20.880620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:20.904774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 44026b7a-4841-4084-a474-972bcd64ec9e owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:20.912298 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Set router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:21.135267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95cba71-62ee-4542-a80b-d09cc8d6267e req-400e345b-00b0-4880-a51a-3973d04d7abb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:21.143906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95cba71-62ee-4542-a80b-d09cc8d6267e req-400e345b-00b0-4880-a51a-3973d04d7abb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1847811 Dec 21 04:09:21.171964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-9651525b-75f9-4bc0-97d3-6575fe008277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:21.191401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-9651525b-75f9-4bc0-97d3-6575fe008277 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 1097 time: 0.1225240 Dec 21 04:09:21.248890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a95cba71-62ee-4542-a80b-d09cc8d6267e req-47ca6412-548b-42b9-9bf6-c24ac21f3fee tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948691 Dec 21 04:09:21.299263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:21.339494 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:09:17Z', 'revision_number': 4, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f7190364-498c-4f32-b3a4-9c317a663960', 'name': '', 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'mac_address': 'fa:16:3e:e4:49:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 2730, 'fixed_ips': [{'subnet_id': '97bbd748-5025-4159-b697-b3060bf9cc6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:16Z', 'updated_at': '2021-12-21T04:09:17Z', 'revision_number': 2, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'subnets': [{'id': '97bbd748-5025-4159-b697-b3060bf9cc6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:21.399269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:21.443145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-e724ca2b-1edb-439a-bfa1-d6071604c9b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:21.448477 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-e724ca2b-1edb-439a-bfa1-d6071604c9b2 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 200 len: 917 time: 0.2495155 Dec 21 04:09:21.455792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:21.457094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:21.491699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=44026b7a-4841-4084-a474-972bcd64ec9e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:21.516012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.516384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.516742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.517095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.517737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.517849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.526093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.526507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.526964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.527221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.527615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.527942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.536558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:21.596862 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-3e10c4bc-66fc-4573-9bd7-1585d38fbdea service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a HTTP/1.1" status: 200 len: 217 time: 0.1344404 Dec 21 04:09:21.616826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:21.619938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:21.629508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9d27fc7f-827e-42ab-8571-ddc998065f49 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/44026b7a-4841-4084-a474-972bcd64ec9e HTTP/1.1" status: 204 len: 168 time: 1.0330892 Dec 21 04:09:21.632054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53706) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:21.648122 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Checking router: dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:09:21.651655 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Updating router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f port f7190364-498c-4f32-b3a4-9c317a663960 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:09:21.691379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,segment=NetworkSegment(dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f),segment_id=dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:21.708120 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:21.748408 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d4df807a-98b3-45fe-bf18-9d7a080c227f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:09:21.750490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d4df807a-98b3-45fe-bf18-9d7a080c227f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:09:21.754001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d4df807a-98b3-45fe-bf18-9d7a080c227f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/44026b7a-4841-4084-a474-972bcd64ec9e HTTP/1.1" status: 404 len: 333 time: 0.1209254 Dec 21 04:09:21.759248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:21.784866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:21.859550 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-bf0c33ab-7fb9-4362-9b5b-5cc614d2052d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:21.861976 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bf0c33ab-7fb9-4362-9b5b-5cc614d2052d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/44026b7a-4841-4084-a474-972bcd64ec9e HTTP/1.1" status: 404 len: 333 time: 0.0934708 Dec 21 04:09:21.864423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53722) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:21.871028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-de10d6f2-c7c5-4ec7-b349-04d521b3b779 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:21.873619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-de10d6f2-c7c5-4ec7-b349-04d521b3b779 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 200 len: 855 time: 0.2677498 Dec 21 04:09:21.894494 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:21.942094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ced7820-1c8c-4f16-a728-481680292343 None None] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:21.964040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-b99441bb-3946-4284-934c-a489b3076f4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:21.968038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-b99441bb-3946-4284-934c-a489b3076f4a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5b94d88b-3288-4137-8290-856f86bd57aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0857925 Dec 21 04:09:22.002923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet 8069bf6d-f683-4bb4-a2ff-61b5579bc456 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:09:22.007375 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.081868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7acebaee-bab5-47df-90e8-8456ae5f4c0d None None] Provisioning complete for port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:22.082512 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7acebaee-bab5-47df-90e8-8456ae5f4c0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.105947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.118420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-9f2fb0d7-1538-4941-b023-ccf4efb1408c service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1423266 Dec 21 04:09:22.295132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.319826 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.380550 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.437458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-499dd0b5-302a-4d91-bac4-f4242ba3f44a req-0f4844ab-39df-443c-ba3a-494e0d86ce55 service neutron] 10.222.0.54 "GET /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3075166 Dec 21 04:09:22.528929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70862421-7e18-4947-92aa-e46115f5c4eb None None] Pushing event updated for resources: {'Port': ['ID=f7190364-498c-4f32-b3a4-9c317a663960,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:22.586885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.605090 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Attempting to bind port f7190364-498c-4f32-b3a4-9c317a663960 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:22.605543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Attempting to bind port f7190364-498c-4f32-b3a4-9c317a663960 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:22.605979 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Attempting to bind port f7190364-498c-4f32-b3a4-9c317a663960 on network f4c77e9f-d236-48d1-a572-296b459350f9 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:22.614488 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 8, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:22.616285 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Checking segment: {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:22.616776 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.617411 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Bound using segment: {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:22.618730 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Bound port: f7190364-498c-4f32-b3a4-9c317a663960, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:22.621896 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.653083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f13b50e-d3d0-4b6c-ad10-bee40883d838 None None] Network 6bce8011-f9ac-4d60-89fb-d82fca478d5f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:22.657893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fda7985f-7204-4438-a617-9b44c8133562 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.685359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=8069bf6d-f683-4bb4-a2ff-61b5579bc456,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:22.695234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.706274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0db42922-d812-4459-b346-2e5648bf65dd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/8069bf6d-f683-4bb4-a2ff-61b5579bc456 HTTP/1.1" status: 204 len: 168 time: 0.8405118 Dec 21 04:09:22.708653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53742) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:22.739155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab8a1f2-3b9f-4082-9f3c-62f96fdc7356 req-53bcddf5-ff1e-47ba-8f85-fde46c94ce6d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:22.749662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ab8a1f2-3b9f-4082-9f3c-62f96fdc7356 req-53bcddf5-ff1e-47ba-8f85-fde46c94ce6d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.3496451 Dec 21 04:09:22.753916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] For port f7190364-498c-4f32-b3a4-9c317a663960, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:22.758183 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] For port f7190364-498c-4f32-b3a4-9c317a663960, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f7190364-498c-4f32-b3a4-9c317a663960,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:22.874489 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.901740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ab26d0f1-c6fd-4d58-a0e1-df9d52e8c561 None None] Provisioning complete for port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:22.902428 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab26d0f1-c6fd-4d58-a0e1-df9d52e8c561 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:22.935822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ab8a1f2-3b9f-4082-9f3c-62f96fdc7356 req-4d624f81-6064-4e02-9dad-45cbcf19edc5 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1840968 Dec 21 04:09:22.956125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.032599 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.099480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:23.099820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.104913 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Routers {'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:09:23.105872 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:23.109438 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70862421-7e18-4947-92aa-e46115f5c4eb None None] Pushing event updated for resources: {'Port': ['ID=f7190364-498c-4f32-b3a4-9c317a663960,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:23.201543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] DHCP port deletion for 6bce8011-f9ac-4d60-89fb-d82fca478d5f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:23.217632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:23.248035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,segment=NetworkSegment(dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f),segment_id=dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:23.248514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.277879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:23.352238 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] Set router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:09:23.401518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Provisioning complete for port f7190364-498c-4f32-b3a4-9c317a663960 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:23.402175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.468135 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.521496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] Deleting port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:23.521868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.530976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.547234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.608199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:23.628935 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:23.639707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.746551 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:09:17Z', 'revision_number': 4, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f7190364-498c-4f32-b3a4-9c317a663960', 'name': '', 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'mac_address': 'fa:16:3e:e4:49:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 2730, 'fixed_ips': [{'subnet_id': '97bbd748-5025-4159-b697-b3060bf9cc6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:16Z', 'updated_at': '2021-12-21T04:09:22Z', 'revision_number': 4, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'subnets': [{'id': '97bbd748-5025-4159-b697-b3060bf9cc6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:23.757527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.772779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] For port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,segment=NetworkSegment(dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f),segment_id=dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:23.773379 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.788282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6bce8011-f9ac-4d60-89fb-d82fca478d5f']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:23.799652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] Calling delete_port for b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:23.807916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] For port f7190364-498c-4f32-b3a4-9c317a663960, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f7190364-498c-4f32-b3a4-9c317a663960,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:23.809344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:23.809785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dbb871e4-f2c4-4d49-ad2f-ce549dfb6d2f') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:23.827157 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-831f9ecf-6c92-49a5-ab7a-1e5fef0727e3 None None] The sync data for ids ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'] in n-d-822053-11 is: [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:09:17Z', 'revision_number': 4, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f7190364-498c-4f32-b3a4-9c317a663960', 'name': '', 'network_id': 'f4c77e9f-d236-48d1-a572-296b459350f9', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'mac_address': 'fa:16:3e:e4:49:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 2730, 'fixed_ips': [{'subnet_id': '97bbd748-5025-4159-b697-b3060bf9cc6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:16Z', 'updated_at': '2021-12-21T04:09:22Z', 'revision_number': 4, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'subnets': [{'id': '97bbd748-5025-4159-b697-b3060bf9cc6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:09:23.843893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.872059 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.880841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 117 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:23.883912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:23.888420 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:23.904987 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.027563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Pushing event updated for resources: {'Port': ['ID=f7190364-498c-4f32-b3a4-9c317a663960,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:24.039696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.075167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.075990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.076570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.077854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.078205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.078551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.078888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.079289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.081135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.081490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.081880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.082751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.083130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d071f25-fd56-499d-9fd3-5112002f6ec6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:09:24.157950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.175908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-de767e75-3d70-4719-9219-ec1060c9de9c None None] Provisioning complete for port f7190364-498c-4f32-b3a4-9c317a663960 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:24.176285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-de767e75-3d70-4719-9219-ec1060c9de9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.184564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.189816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/6bce8011-f9ac-4d60-89fb-d82fca478d5f HTTP/1.1" status: 204 len: 168 time: 1.4794335 Dec 21 04:09:24.190858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7631d9-a7ad-40cf-b2bb-c589aa332c41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=6bce8011-f9ac-4d60-89fb-d82fca478d5f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:24.193194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53780) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:24.201124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1397652418'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:24.229532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] Pushing event deleted for resources: {'Port': ['ID=b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:24.247796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cf0458c-85b9-47bd-9fde-ad5ffef21904 None None] No DVR routers for this DVR port b6bafdfb-e676-4fde-bf9a-a0d4c2d2c846 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:24.308290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9c28df-a09e-4925-811a-f35eb69f86cb req-4d3ca616-607d-48e9-b5dc-bcdc0172abef tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:24.313578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:24.318474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.324959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc9c28df-a09e-4925-811a-f35eb69f86cb req-4d3ca616-607d-48e9-b5dc-bcdc0172abef tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.2042685 Dec 21 04:09:24.376367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:24.414033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.414392 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment 74c0cd54-7880-4181-b4c6-a67b059e929f of type vlan for network fae3d8d5-cab6-400a-9963-22642b797781 Dec 21 04:09:24.477851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc9c28df-a09e-4925-811a-f35eb69f86cb req-8d8df8af-e1f1-4085-9460-7e2f5f8e23f6 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1470220 Dec 21 04:09:24.613353 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.797985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.798207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ee9fef-fcb1-4773-ab27-fd2b3ff6a415 req-e326a927-dba0-4ee9-a5dc-13bb595b8b83 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:24.804036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06ee9fef-fcb1-4773-ab27-fd2b3ff6a415 req-e326a927-dba0-4ee9-a5dc-13bb595b8b83 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1264493 Dec 21 04:09:24.807419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:24.808633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:24.887564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06ee9fef-fcb1-4773-ab27-fd2b3ff6a415 req-cac48121-8557-4244-bec3-f2c69ae44f33 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773213 Dec 21 04:09:24.952681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=fae3d8d5-cab6-400a-9963-22642b797781,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:24.968055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network fae3d8d5-cab6-400a-9963-22642b797781 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:25.042644 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e66ddca0-e508-492e-b8ab-60e54913852f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.8481257 Dec 21 04:09:25.045129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53804) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:25.051644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:25.115777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:25.211421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:25.269557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3648a0-c0f9-43ba-837f-258496077ef5 req-af044fba-aa39-4f59-a455-3347c7b1ccd2 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:25.278867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab3648a0-c0f9-43ba-837f-258496077ef5 req-af044fba-aa39-4f59-a455-3347c7b1ccd2 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 945 time: 0.2207780 Dec 21 04:09:25.291974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f7190364-498c-4f32-b3a4-9c317a663960 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:25.351624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f7190364-498c-4f32-b3a4-9c317a663960 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:25.352742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:25.355328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab3648a0-c0f9-43ba-837f-258496077ef5 req-dac7a0e2-9f69-4b7b-ad34-07d52d1794f7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681026 Dec 21 04:09:25.572096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d260d4-2850-4b37-9707-c03b69863afc req-4e9f5993-0ccc-4550-ad9e-eb48f93ab35b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:25.573582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3d260d4-2850-4b37-9707-c03b69863afc req-4e9f5993-0ccc-4550-ad9e-eb48f93ab35b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.0783336 Dec 21 04:09:25.630868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3d260d4-2850-4b37-9707-c03b69863afc req-600994bb-709d-4a87-8a54-9c46a5c75df9 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504944 Dec 21 04:09:25.678831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-92b17137-fbb0-45d4-86ab-92745383e770 req-0959ddc1-b9bc-4bf9-ad4c-ea09e5a6d6ba tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:09:25.684737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92b17137-fbb0-45d4-86ab-92745383e770 req-0959ddc1-b9bc-4bf9-ad4c-ea09e5a6d6ba tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0116093 Dec 21 04:09:25.712332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:25.716028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:25.787592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:25.820186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92b17137-fbb0-45d4-86ab-92745383e770 req-98443ff2-06db-4865-94e4-d73097c4d7a2 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.9&fields=device_id HTTP/1.1" status: 200 len: 262 time: 0.1329203 Dec 21 04:09:26.101538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:26.186334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': '74c0cd54-7880-4181-b4c6-a67b059e929f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:26.186707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: fae3d8d5-cab6-400a-9963-22642b797781, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:26.194952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=390f90eb-d3ad-47a8-865d-ff7cf6f3e775,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:26.201012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:26.245105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85975629-80fc-43e9-844e-84e6bd040b9e req-203dc241-324a-4380-a1bc-4bea0d042668 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:26.251516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85975629-80fc-43e9-844e-84e6bd040b9e req-203dc241-324a-4380-a1bc-4bea0d042668 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0945494 Dec 21 04:09:26.327594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network fae3d8d5-cab6-400a-9963-22642b797781 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:26.365432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85975629-80fc-43e9-844e-84e6bd040b9e req-886033e3-3cbf-4a20-ae5d-8e814ff7f210 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050966 Dec 21 04:09:26.410120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, fae3d8d5-cab6-400a-9963-22642b797781) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:26.421698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:26.422068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40f2e242-1d1a-485a-b287-170318cd89a0 None None] Network fae3d8d5-cab6-400a-9963-22642b797781 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:26.433051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:26.502949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e615508f-07d9-4661-92b8-2867cb4617e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:26.524391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd162e9-a109-4f8e-8d6b-a971a18702f7 req-53704c96-1865-46b7-924c-08b3c09551da tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:26.528407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fd162e9-a109-4f8e-8d6b-a971a18702f7 req-53704c96-1865-46b7-924c-08b3c09551da tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 945 time: 0.0868783 Dec 21 04:09:26.530016 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5c04873-f1d2-43a1-bc26-59de747d351a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4838183 Dec 21 04:09:26.532899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53848) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:26.551451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-1156643024'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:26.628435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-fae3d8d5-cab6-400a-9963-22642b797781', 'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': '390f90eb-d3ad-47a8-865d-ff7cf6f3e775'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:09:26.629291 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:26.693055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e615508f-07d9-4661-92b8-2867cb4617e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:26.752258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fd162e9-a109-4f8e-8d6b-a971a18702f7 req-8a77f3e8-4ff8-44af-937f-33f5e490abf1 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2140558 Dec 21 04:09:26.759829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e615508f-07d9-4661-92b8-2867cb4617e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:26.834830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Allocated IP 2001:db8::2 (fae3d8d5-cab6-400a-9963-22642b797781/390f90eb-d3ad-47a8-865d-ff7cf6f3e775/be67ae77-691a-4197-a540-9d637b68ee8e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:26.858550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53858) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:26.862786 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e615508f-07d9-4661-92b8-2867cb4617e7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1dbae70cbaf64facbe14554730505f97&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6596632 Dec 21 04:09:26.881375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e615508f-07d9-4661-92b8-2867cb4617e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f41763ca-a952-4ea7-adc6-ce4579e7f250,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:26.994649 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce26f055-5518-42fe-91f5-8b07fa3fe6ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.006495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ddc165-6d52-426e-8db9-3b09e35825b8 req-c2893d4d-1f41-4d1c-9e46-ee2efa410ab3 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:27.014057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ddc165-6d52-426e-8db9-3b09e35825b8 req-c2893d4d-1f41-4d1c-9e46-ee2efa410ab3 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.0984042 Dec 21 04:09:27.039585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:27.043234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.070344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.084712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce26f055-5518-42fe-91f5-8b07fa3fe6ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.086839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:27.158571 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.167154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ddc165-6d52-426e-8db9-3b09e35825b8 req-9eccb01f-c449-4a7a-8f99-f60af2aa2673 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520901 Dec 21 04:09:27.218137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Network fae3d8d5-cab6-400a-9963-22642b797781 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:27.223374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:27.225941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:27.233075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Pushing event updated for resources: {'Port': ['ID=be67ae77-691a-4197-a540-9d637b68ee8e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:27.343614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Attempting to bind port be67ae77-691a-4197-a540-9d637b68ee8e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:27.343996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Attempting to bind port be67ae77-691a-4197-a540-9d637b68ee8e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '74c0cd54-7880-4181-b4c6-a67b059e929f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:27.344363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Attempting to bind port be67ae77-691a-4197-a540-9d637b68ee8e on network fae3d8d5-cab6-400a-9963-22642b797781 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:27.351347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:27.351740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Checking segment: {'id': '74c0cd54-7880-4181-b4c6-a67b059e929f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:27.356602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.356602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Bound using segment: {'id': '74c0cd54-7880-4181-b4c6-a67b059e929f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:27.356602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Bound port: be67ae77-691a-4197-a540-9d637b68ee8e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74c0cd54-7880-4181-b4c6-a67b059e929f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'fae3d8d5-cab6-400a-9963-22642b797781'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:27.356602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.363546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::3df (fae3d8d5-cab6-400a-9963-22642b797781/390f90eb-d3ad-47a8-865d-ff7cf6f3e775/915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:27.382531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce26f055-5518-42fe-91f5-8b07fa3fe6ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.391113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce26f055-5518-42fe-91f5-8b07fa3fe6ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.391113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ce26f055-5518-42fe-91f5-8b07fa3fe6ee admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f41763ca-a952-4ea7-adc6-ce4579e7f250 HTTP/1.1" status: 204 len: 168 time: 0.5282097 Dec 21 04:09:27.446051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] For port be67ae77-691a-4197-a540-9d637b68ee8e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:27.449859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] For port be67ae77-691a-4197-a540-9d637b68ee8e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be67ae77-691a-4197-a540-9d637b68ee8e,segment=NetworkSegment(74c0cd54-7880-4181-b4c6-a67b059e929f),segment_id=74c0cd54-7880-4181-b4c6-a67b059e929f)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:27.454848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce26f055-5518-42fe-91f5-8b07fa3fe6ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f41763ca-a952-4ea7-adc6-ce4579e7f250,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:27.513968 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.530439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b4a4e5-aaf9-4634-befa-3f47e3065e4f req-ec781d4a-d815-41f7-9d3d-7c113f1ccdaa tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:27.538100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b4a4e5-aaf9-4634-befa-3f47e3065e4f req-ec781d4a-d815-41f7-9d3d-7c113f1ccdaa tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:27.544861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b4a4e5-aaf9-4634-befa-3f47e3065e4f req-ec781d4a-d815-41f7-9d3d-7c113f1ccdaa tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:27.555502 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1b4a4e5-aaf9-4634-befa-3f47e3065e4f req-ec781d4a-d815-41f7-9d3d-7c113f1ccdaa tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c&device_id=1a4912a6-b3aa-498a-98d0-c78532125599&device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 2416 time: 0.1676841 Dec 21 04:09:27.613960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2d14fe-574c-439c-ac33-7f2d2cf40f54 None None] Pushing event updated for resources: {'Port': ['ID=be67ae77-691a-4197-a540-9d637b68ee8e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:27.678401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1b4a4e5-aaf9-4634-befa-3f47e3065e4f req-93e957ee-8c6c-447d-9d28-4ed1915ff42b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1216168 Dec 21 04:09:27.700504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:27.839825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-836f0fa6-5b00-4e29-a6fd-f25145d6d032 req-d41a0921-e54b-4558-b270-5a8cf69e3535 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.&fields=device_id HTTP/1.1" status: 200 len: 463 time: 0.1231365 Dec 21 04:09:27.924487 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.042925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network fae3d8d5-cab6-400a-9963-22642b797781 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:28.046956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:28.077457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:28.081239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:28.087809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:28.089023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.203610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8fe6bffe-94b1-4744-b603-1afc4c1f1caf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 893 time: 1.6684780 Dec 21 04:09:28.206925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53894) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:28.336574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:28.336933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.376352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53898) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:28.393442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-548da681-3d31-4199-9900-798e8a4fc374 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.463959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.493301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:28.544288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-548da681-3d31-4199-9900-798e8a4fc374 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.643748 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-548da681-3d31-4199-9900-798e8a4fc374 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.708433 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-548da681-3d31-4199-9900-798e8a4fc374 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9daf6f90ff27417184d59e2e6b176c17&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3304257 Dec 21 04:09:28.712478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53908) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:28.718497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548da681-3d31-4199-9900-798e8a4fc374 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efed5512-bde8-495d-b9f6-a255efe37719,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:28.824574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4f7530b-b370-4385-81ac-039f25fe524d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.852343 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4f7530b-b370-4385-81ac-039f25fe524d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.902751 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:28.965039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:29.007014 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.017235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8bce45c-e8be-438a-b7f8-07b7bfcbe496 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3 HTTP/1.1" status: 204 len: 168 time: 0.8090723 Dec 21 04:09:29.019879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53916) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:29.077697 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-be19f543-8056-4372-ada6-74716d26ef3a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:29.080392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-be19f543-8056-4372-ada6-74716d26ef3a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3 HTTP/1.1" status: 404 len: 333 time: 0.0593388 Dec 21 04:09:29.083203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53918) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:29.096303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4f7530b-b370-4385-81ac-039f25fe524d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.102602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4f7530b-b370-4385-81ac-039f25fe524d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.112147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c4f7530b-b370-4385-81ac-039f25fe524d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/efed5512-bde8-495d-b9f6-a255efe37719 HTTP/1.1" status: 204 len: 168 time: 0.3879960 Dec 21 04:09:29.136325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f7530b-b370-4385-81ac-039f25fe524d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efed5512-bde8-495d-b9f6-a255efe37719,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:29.185607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68d7ba4a-a346-4702-8e33-5e8a04a3d3ad None None] Network fae3d8d5-cab6-400a-9963-22642b797781 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:29.254523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet 390f90eb-d3ad-47a8-865d-ff7cf6f3e775 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:09:29.258154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.265372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be67ae77-691a-4197-a540-9d637b68ee8e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:29.309834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.431709 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.649629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.746034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.754121 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/390f90eb-d3ad-47a8-865d-ff7cf6f3e775 HTTP/1.1" status: 204 len: 168 time: 0.6694651 Dec 21 04:09:29.756896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53934) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:29.758181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f29a6e-d9c6-4c6e-a278-4065a70a9847 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=390f90eb-d3ad-47a8-865d-ff7cf6f3e775,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:29.820623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c6557e61-2091-4ff1-889e-15fb28e6b044 None None] Provisioning complete for port be67ae77-691a-4197-a540-9d637b68ee8e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:29.822996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6557e61-2091-4ff1-889e-15fb28e6b044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.924702 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:29.978275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port be67ae77-691a-4197-a540-9d637b68ee8e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:29.982147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.058963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port be67ae77-691a-4197-a540-9d637b68ee8e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:30.060849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.203012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-3817e6d8-5769-4ef5-9bc6-2c390d7ac6a7 req-86c21ea6-44b8-4f16-9571-d75a34c0eaec service neutron] (110311) timed out ('10.222.0.18', 42164) {{(pid=110311) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:09:30.226989 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6557e61-2091-4ff1-889e-15fb28e6b044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.246844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port be67ae77-691a-4197-a540-9d637b68ee8e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be67ae77-691a-4197-a540-9d637b68ee8e,segment=NetworkSegment(74c0cd54-7880-4181-b4c6-a67b059e929f),segment_id=74c0cd54-7880-4181-b4c6-a67b059e929f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:30.247723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.276350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for be67ae77-691a-4197-a540-9d637b68ee8e owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:30.331794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c6557e61-2091-4ff1-889e-15fb28e6b044 None None] For port be67ae77-691a-4197-a540-9d637b68ee8e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be67ae77-691a-4197-a540-9d637b68ee8e,segment=NetworkSegment(74c0cd54-7880-4181-b4c6-a67b059e929f),segment_id=74c0cd54-7880-4181-b4c6-a67b059e929f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:30.336606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.424735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6557e61-2091-4ff1-889e-15fb28e6b044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.478682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.490882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67d5836a-2ecb-42bf-99bb-064837fe9a6d None None] Network fae3d8d5-cab6-400a-9963-22642b797781 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:30.516582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6557e61-2091-4ff1-889e-15fb28e6b044 None None] Pushing event deleted for resources: {'Port': ['ID=be67ae77-691a-4197-a540-9d637b68ee8e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:30.558662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=be67ae77-691a-4197-a540-9d637b68ee8e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:30.563179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port be67ae77-691a-4197-a540-9d637b68ee8e on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:30.587391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:09:30.587811 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:09:30.624195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6be9f6c4-df90-457f-a4f3-f3c6b25d6706 None None] Could not find standard attr ID for object be67ae77-691a-4197-a540-9d637b68ee8e. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:09:30.681437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.750085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fae3d8d5-cab6-400a-9963-22642b797781']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:30.783431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bad3a50-c8a9-4a86-9e56-1bdfcd3ab721 None None] DHCP port deletion for fae3d8d5-cab6-400a-9963-22642b797781 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:30.823749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '74c0cd54-7880-4181-b4c6-a67b059e929f') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:30.824331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '74c0cd54-7880-4181-b4c6-a67b059e929f') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:30.842085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.872594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e1c1bf-a033-4935-9974-948af84940a8 req-54ab9e36-77c1-4255-a0d6-5d9ff8093fa2 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:30.879460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53e1c1bf-a033-4935-9974-948af84940a8 req-54ab9e36-77c1-4255-a0d6-5d9ff8093fa2 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.1604872 Dec 21 04:09:30.880985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.938925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 117 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:30.939384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:30.943263 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:31.089030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53e1c1bf-a033-4935-9974-948af84940a8 req-4672fa9e-6d22-4c80-b46d-dfbee71542b4 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2035160 Dec 21 04:09:31.141944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Port be67ae77-691a-4197-a540-9d637b68ee8e update to ACTIVE by agent not found {{(pid=110312) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 21 04:09:31.158427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.165008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.173787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/fae3d8d5-cab6-400a-9963-22642b797781 HTTP/1.1" status: 204 len: 168 time: 1.4148211 Dec 21 04:09:31.177538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:31.183178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'name': 'tempest-PortsIpV6TestJSON-1537801611'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:31.227604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39cb3b1-aa71-45ec-82ce-baa27e676f1d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=fae3d8d5-cab6-400a-9963-22642b797781,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:31.282890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be67ae77-691a-4197-a540-9d637b68ee8e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:31.306025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: be67ae77-691a-4197-a540-9d637b68ee8e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:31.306380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be67ae77-691a-4197-a540-9d637b68ee8e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:31.449272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:31.453695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.475705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 5aec7188-36ae-4169-b49e-3a0ce46976ea yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:31.693820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.725861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53994) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:31.763816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.827121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:31.831637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:31.833680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=5aec7188-36ae-4169-b49e-3a0ce46976ea,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:31.835914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:31.860669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:31.861966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.904180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8529500b-3e7e-41c2-9b0f-30908d81d520 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:31.952914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eaf83cf1-c519-417c-ae3b-e778455c545e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 0.7739847 Dec 21 04:09:31.958240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54004) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:32.092789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 5aec7188-36ae-4169-b49e-3a0ce46976ea {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:32.093675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.116588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8529500b-3e7e-41c2-9b0f-30908d81d520 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.182859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.187787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8529500b-3e7e-41c2-9b0f-30908d81d520 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.200349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 5aec7188-36ae-4169-b49e-3a0ce46976ea owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:32.344506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8529500b-3e7e-41c2-9b0f-30908d81d520 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=55614b9a63294e63b58044595aa3e231&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6173372 Dec 21 04:09:32.348613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:32.349866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8529500b-3e7e-41c2-9b0f-30908d81d520 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8724dc2-38fc-43ed-929b-27a5220d15dc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:32.367379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-ff06bd18-10db-455e-9beb-058bd56def2a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:32.369054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-ff06bd18-10db-455e-9beb-058bd56def2a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.31 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.1334331 Dec 21 04:09:32.378623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af252422-1480-4275-a5f2-b4726e6810d3 req-3648b637-872f-4c85-986a-1d574e2e979a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:32.380253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af252422-1480-4275-a5f2-b4726e6810d3 req-3648b637-872f-4c85-986a-1d574e2e979a tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 945 time: 0.1887841 Dec 21 04:09:32.429276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.489416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af252422-1480-4275-a5f2-b4726e6810d3 req-c802b7a4-5bc9-4585-be1f-aad38066fe5e tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1016953 Dec 21 04:09:32.529699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=5aec7188-36ae-4169-b49e-3a0ce46976ea,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:32.535783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.541636 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-efa9849f-9d51-4aa0-a7d3-8be27ecc6800 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/5aec7188-36ae-4169-b49e-3a0ce46976ea HTTP/1.1" status: 204 len: 168 time: 0.5819311 Dec 21 04:09:32.543676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b075f191-b357-438a-9d99-e82f27ea9d21 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.545801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54014) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:32.548876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Deleting port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:32.548876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.557367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'mac_address': 'fa:16:3e:91:3a:b9', 'name': 'tempest-PortsIpV6TestJSON-1595457562'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:32.631433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b075f191-b357-438a-9d99-e82f27ea9d21 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.679028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] For port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:32.679400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.697080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Calling delete_port for 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:32.831933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:32.856325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b075f191-b357-438a-9d99-e82f27ea9d21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.860145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b075f191-b357-438a-9d99-e82f27ea9d21 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.863767 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b075f191-b357-438a-9d99-e82f27ea9d21 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f8724dc2-38fc-43ed-929b-27a5220d15dc HTTP/1.1" status: 204 len: 168 time: 0.5138307 Dec 21 04:09:32.900916 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.912377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b075f191-b357-438a-9d99-e82f27ea9d21 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8724dc2-38fc-43ed-929b-27a5220d15dc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:32.943968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5d271dd6-207e-4d03-a5e9-1b7dd220c01a', '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:09:32.958091 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:32.994218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Pushing event deleted for resources: {'Port': ['ID=0c919ed6-4d65-46fc-9b58-b09a5e3a5533,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:33.022526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port cfc160b3-0caf-4d82-8ab3-1aea5dfe794b yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:33.174951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] No DVR routers for this DVR port 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:33.191097 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:33.203569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e8e7ee6-5de1-4aa1-8fd0-22a78849997c req-9a9ed056-003a-4056-946a-4806d0676dcf tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.31 "DELETE /v2.0/ports/0c919ed6-4d65-46fc-9b58-b09a5e3a5533 HTTP/1.1" status: 204 len: 173 time: 0.8222420 Dec 21 04:09:33.206112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f165f769-565a-4128-b62b-0cccedb7404c', 'name': 'network-vif-deleted', 'tag': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:09:33.223832 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e8fd376-436a-4536-bca2-deefe6b3e413" -d '{"events": [{"server_uuid": "f165f769-565a-4128-b62b-0cccedb7404c", "name": "network-vif-deleted", "tag": "0c919ed6-4d65-46fc-9b58-b09a5e3a5533"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:09:33.341881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:33.478166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:33.603414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=cfc160b3-0caf-4d82-8ab3-1aea5dfe794b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:33.662032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:33.671242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:33.675591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:33.684093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:33.685666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:33.736972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac3d5236-da53-43aa-b58f-dde26995545c req-a7d5100f-adfb-4461-ac73-d9a94a709989 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=f165f769-565a-4128-b62b-0cccedb7404c HTTP/1.1" status: 200 len: 210 time: 0.0706048 Dec 21 04:09:33.783580 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:09:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e2895ec-af6e-4757-a421-ceb48165d897 x-openstack-request-id: req-7e2895ec-af6e-4757-a421-ceb48165d897 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:09:33.783981 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f165f769-565a-4128-b62b-0cccedb7404c", "name": "network-vif-deleted", "tag": "0c919ed6-4d65-46fc-9b58-b09a5e3a5533", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:09:33.783981 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7e2895ec-af6e-4757-a421-ceb48165d897 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:09:33.784471 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f165f769-565a-4128-b62b-0cccedb7404c', 'name': 'network-vif-deleted', 'tag': '0c919ed6-4d65-46fc-9b58-b09a5e3a5533', 'status': 'completed', 'code': 200} Dec 21 04:09:33.824061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8c753875-4c23-4d9e-8134-c6ac1a28d16c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.2719958 Dec 21 04:09:33.826701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54048) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:33.879592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3027532e-c689-4985-b051-78906f9ac779 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:33.884475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3027532e-c689-4985-b051-78906f9ac779 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/cfc160b3-0caf-4d82-8ab3-1aea5dfe794b HTTP/1.1" status: 200 len: 845 time: 0.0531497 Dec 21 04:09:33.884799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54052) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:34.008269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port cfc160b3-0caf-4d82-8ab3-1aea5dfe794b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:34.008616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:34.145532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:34.168585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for cfc160b3-0caf-4d82-8ab3-1aea5dfe794b owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:34.363482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:34.415675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:34.421383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/cfc160b3-0caf-4d82-8ab3-1aea5dfe794b HTTP/1.1" status: 204 len: 168 time: 0.5339599 Dec 21 04:09:34.421383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6caf95e9-640b-4d66-b2a4-4895fed15315 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=cfc160b3-0caf-4d82-8ab3-1aea5dfe794b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:34.424249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54070) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:34.478420 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7be729f-a7f7-4ef2-a41d-77c9dc09a9b4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:34.479915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e7be729f-a7f7-4ef2-a41d-77c9dc09a9b4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/cfc160b3-0caf-4d82-8ab3-1aea5dfe794b HTTP/1.1" status: 404 len: 333 time: 0.0572274 Dec 21 04:09:34.485663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54074) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:34.492084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'name': 'tempest-PortsIpV6TestJSON-741453603'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:34.749219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:34.787257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:34.787872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0c919ed6-4d65-46fc-9b58-b09a5e3a5533 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:34.792840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:34.796393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:34.829011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port d1478f2f-d33e-4aca-aecb-2c1b2f5162fe yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:35.163244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:35.305234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:35.362803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:35.369577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:35.382730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:35.414185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:35.414861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:35.445069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=d1478f2f-d33e-4aca-aecb-2c1b2f5162fe,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:35.498597 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d3d0a5b6-b69d-41cd-bf7e-15f55ac31b57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.0111053 Dec 21 04:09:35.500601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:35.507837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:35.527075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44861c9f-fcbc-4c8d-83cc-68194fdf1b42 req-702d8c53-32ac-46db-a2b6-9acf55592bdd tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:35.546787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44861c9f-fcbc-4c8d-83cc-68194fdf1b42 req-702d8c53-32ac-46db-a2b6-9acf55592bdd tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 945 time: 0.1156166 Dec 21 04:09:35.626219 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:35.671792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44861c9f-fcbc-4c8d-83cc-68194fdf1b42 req-40c355d1-0fbc-4405-b7b0-2943b2f4bf4d tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1213901 Dec 21 04:09:35.848390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.089523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.124443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] In _notify_port_updated(), no bound segment for port d1478f2f-d33e-4aca-aecb-2c1b2f5162fe on network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:09:36.130590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:36.131228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.135051 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/ports/d1478f2f-d33e-4aca-aecb-2c1b2f5162fe HTTP/1.1" status: 200 len: 818 time: 0.6309545 Dec 21 04:09:36.135381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54126) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:36.160686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f9b9bd-0942-48d3-b071-8308c0157fbd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=d1478f2f-d33e-4aca-aecb-2c1b2f5162fe,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:36.288371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port d1478f2f-d33e-4aca-aecb-2c1b2f5162fe {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:36.288739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.417727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.436245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for d1478f2f-d33e-4aca-aecb-2c1b2f5162fe owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:36.496633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:36.640613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8170cc7-0e3d-42c4-86e4-c81e2b312172 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.651365 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.682349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=d1478f2f-d33e-4aca-aecb-2c1b2f5162fe,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:36.690096 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.695848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c585647a-ad24-4fad-af39-06458e3af9d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/d1478f2f-d33e-4aca-aecb-2c1b2f5162fe HTTP/1.1" status: 204 len: 168 time: 0.5570502 Dec 21 04:09:36.696588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54148) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:36.744995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8170cc7-0e3d-42c4-86e4-c81e2b312172 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:36.759117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b55c136f-52b7-4032-9e4d-dcf209b795bd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:36.761305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b55c136f-52b7-4032-9e4d-dcf209b795bd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.0642552 Dec 21 04:09:36.764384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:36.820798 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-18721d9a-f103-40fb-aa7a-a9ff0c5c5212 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:36.820798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-18721d9a-f103-40fb-aa7a-a9ff0c5c5212 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/d1478f2f-d33e-4aca-aecb-2c1b2f5162fe HTTP/1.1" status: 404 len: 333 time: 0.0381978 Dec 21 04:09:36.820798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:36.840420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-969713874'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:36.883324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d728ae-3696-4ca3-8bd8-690f4b46a8fe req-244b1902-bede-4d37-aec7-d591e1f90859 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:36.885050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0d728ae-3696-4ca3-8bd8-690f4b46a8fe req-244b1902-bede-4d37-aec7-d591e1f90859 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 945 time: 0.0935163 Dec 21 04:09:36.949104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0d728ae-3696-4ca3-8bd8-690f4b46a8fe req-95bd2a63-1265-4077-a3b3-97e9c8eb0dd7 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534501 Dec 21 04:09:36.988799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-d30b6d7f-8c76-4429-b5fd-23fd1c0e3b44 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:36.990499 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-d30b6d7f-8c76-4429-b5fd-23fd1c0e3b44 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 945 time: 0.0973248 Dec 21 04:09:37.064907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8170cc7-0e3d-42c4-86e4-c81e2b312172 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.066499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:37.071198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.099123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:37.108671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.109316 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment 7094686b-8074-40ca-b97c-6eaa64409834 of type vlan for network 9063912f-b9c6-4939-9671-639e1aea6f7a Dec 21 04:09:37.160450 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.260814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.266576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:37.267784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.368135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=9063912f-b9c6-4939-9671-639e1aea6f7a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:37.380609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:37.406602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-83f8c6b5-a4ca-4093-aed6-555bff249385 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.5975156 Dec 21 04:09:37.409448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54162) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:37.417247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:37.572368 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b8170cc7-0e3d-42c4-86e4-c81e2b312172 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a65a252442114553abf9672578ce1ee6&name=default HTTP/1.1" status: 200 len: 3000 time: 1.0739655 Dec 21 04:09:37.575239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54170) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:37.580931 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8170cc7-0e3d-42c4-86e4-c81e2b312172 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7315410-c154-45eb-b3ff-da40d648f6a6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:37.605046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Deleting port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:37.605046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.622522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:37.636342 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.722201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] For port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:37.722608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.739958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Calling delete_port for 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:37.747554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cde39cb0-8ef6-442d-9d93-20f3f4f85e9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.786297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cde39cb0-8ef6-442d-9d93-20f3f4f85e9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.864261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:09:37.934862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cde39cb0-8ef6-442d-9d93-20f3f4f85e9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.937487 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cde39cb0-8ef6-442d-9d93-20f3f4f85e9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.938690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cde39cb0-8ef6-442d-9d93-20f3f4f85e9c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e7315410-c154-45eb-b3ff-da40d648f6a6 HTTP/1.1" status: 204 len: 168 time: 0.3624151 Dec 21 04:09:37.946905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde39cb0-8ef6-442d-9d93-20f3f4f85e9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7315410-c154-45eb-b3ff-da40d648f6a6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:37.958656 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:37.998737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Pushing event deleted for resources: {'Port': ['ID=5a96bb11-3aa8-4b71-8da6-aec36cb17cf6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:38.005927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['5d271dd6-207e-4d03-a5e9-1b7dd220c01a', '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:09:38.021226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:38.075508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] No DVR routers for this DVR port 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:38.079715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:38.088959 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e180f147-b4f7-40ad-afd7-e9549f212384 req-160a3aea-e3b9-4005-ae82-7b86bc437003 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "DELETE /v2.0/ports/5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 HTTP/1.1" status: 204 len: 173 time: 1.0889463 Dec 21 04:09:38.089668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a4912a6-b3aa-498a-98d0-c78532125599', 'name': 'network-vif-deleted', 'tag': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:09:38.092756 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3e816a7-39b9-4896-a0e6-7f07949495a9" -d '{"events": [{"server_uuid": "1a4912a6-b3aa-498a-98d0-c78532125599", "name": "network-vif-deleted", "tag": "5a96bb11-3aa8-4b71-8da6-aec36cb17cf6"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:09:38.145258 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:09:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0958eb3c-b094-4dda-b660-5fbc7ac2ae89 x-openstack-request-id: req-0958eb3c-b094-4dda-b660-5fbc7ac2ae89 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:09:38.145654 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a4912a6-b3aa-498a-98d0-c78532125599", "name": "network-vif-deleted", "tag": "5a96bb11-3aa8-4b71-8da6-aec36cb17cf6", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:09:38.146092 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0958eb3c-b094-4dda-b660-5fbc7ac2ae89 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:09:38.146719 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a4912a6-b3aa-498a-98d0-c78532125599', 'name': 'network-vif-deleted', 'tag': '5a96bb11-3aa8-4b71-8da6-aec36cb17cf6', 'status': 'completed', 'code': 200} Dec 21 04:09:38.149155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-550d797c-66ad-4b95-990f-5c91b6a47cb6 req-6bf33658-955f-49f2-b89c-ccb3d2f6a111 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=1a4912a6-b3aa-498a-98d0-c78532125599 HTTP/1.1" status: 200 len: 210 time: 0.0467923 Dec 21 04:09:38.189117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=ce363db3-6723-4603-8670-e5e6800dd170,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:38.201001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': '7094686b-8074-40ca-b97c-6eaa64409834', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:38.201001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: 9063912f-b9c6-4939-9671-639e1aea6f7a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:38.289312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 9063912f-b9c6-4939-9671-639e1aea6f7a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:38.374688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9063912f-b9c6-4939-9671-639e1aea6f7a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:38.379642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:38.382990 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:38.394436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90686ec4-6392-46a8-9acc-bbce5073a417 None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:38.468073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29f577ad-3d57-46b3-aa0f-ce041f309e91 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0558083 Dec 21 04:09:38.472381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54194) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:38.478494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:38.627604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9063912f-b9c6-4939-9671-639e1aea6f7a', 'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': 'ce363db3-6723-4603-8670-e5e6800dd170'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:09:38.628399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:38.815363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:38.819272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:38.850001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Allocated IP 2001:db8::2 (9063912f-b9c6-4939-9671-639e1aea6f7a/ce363db3-6723-4603-8670-e5e6800dd170/a0da1c16-9b45-4ffa-82a0-83b36c1a2116) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:38.929836 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet ce363db3-6723-4603-8670-e5e6800dd170 (CIDR: 2001:db8::/64) Dec 21 04:09:38.994411 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:09:38.994411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:09:39.035986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.098167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3e5d662b-f564-4a26-a243-e499996536b2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6247857 Dec 21 04:09:39.101046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54214) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:39.106907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:39.124540 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.173592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:39.180368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:39.184966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:39.198600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Pushing event updated for resources: {'Port': ['ID=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:39.256902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Attempting to bind port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:39.256902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Attempting to bind port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '7094686b-8074-40ca-b97c-6eaa64409834', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:39.257158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Attempting to bind port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 on network 9063912f-b9c6-4939-9671-639e1aea6f7a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:39.270106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:39.270864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Checking segment: {'id': '7094686b-8074-40ca-b97c-6eaa64409834', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:39.283380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.283380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Bound using segment: {'id': '7094686b-8074-40ca-b97c-6eaa64409834', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:39.283380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Bound port: a0da1c16-9b45-4ffa-82a0-83b36c1a2116, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7094686b-8074-40ca-b97c-6eaa64409834', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:39.283380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.358641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:39.361156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] For port a0da1c16-9b45-4ffa-82a0-83b36c1a2116, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:39.363734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.367162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] For port a0da1c16-9b45-4ffa-82a0-83b36c1a2116, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,segment=NetworkSegment(7094686b-8074-40ca-b97c-6eaa64409834),segment_id=7094686b-8074-40ca-b97c-6eaa64409834)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:39.448360 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.549142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af702fa1-1a85-42d6-b08f-60131c1e5b5b None None] Pushing event updated for resources: {'Port': ['ID=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:39.849970 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:39.929122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0c2850-c599-436f-a27a-a2a2ed32f1f1 req-9a4a4b46-ad09-4a41-acea-8b53924429e4 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:39.935762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=bf6daeea-75bc-4c98-8ce0-aeeacaf305cc,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:39.946471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 9063912f-b9c6-4939-9671-639e1aea6f7a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:39.946923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b0c2850-c599-436f-a27a-a2a2ed32f1f1 req-9a4a4b46-ad09-4a41-acea-8b53924429e4 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1157365 Dec 21 04:09:39.956666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:39.965297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:39.965297 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:40.035440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b0c2850-c599-436f-a27a-a2a2ed32f1f1 req-08d135b0-95c9-4563-86ea-679f723cad51 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554183 Dec 21 04:09:40.061685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6e73ca7f-ad9c-48a5-b0e7-56455fb2d97b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 0.9506726 Dec 21 04:09:40.061685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54246) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:40.061685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a', 'fixed_ips': [{'subnet_id': 'ce363db3-6723-4603-8670-e5e6800dd170'}, {'subnet_id': 'bf6daeea-75bc-4c98-8ce0-aeeacaf305cc'}], 'name': 'tempest-PortsIpV6TestJSON-2091273104'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:40.367314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:40.393249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:40.393249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5a96bb11-3aa8-4b71-8da6-aec36cb17cf6 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:40.484825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:40.642350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:40.664158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port ae9e69ae-0299-4d58-bb28-883fe265456a yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:40.868868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54266) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:40.881763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-774f4a8c-fd48-4fdd-8518-c892ddd8edaa None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:40.993263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d2a37d7-38f9-4808-9b6e-06b2bad955b9 None None] Provisioning complete for port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:40.993853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d2a37d7-38f9-4808-9b6e-06b2bad955b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.019942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::11f (9063912f-b9c6-4939-9671-639e1aea6f7a/ce363db3-6723-4603-8670-e5e6800dd170/ae9e69ae-0299-4d58-bb28-883fe265456a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:41.026720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8:0:1::317 (9063912f-b9c6-4939-9671-639e1aea6f7a/bf6daeea-75bc-4c98-8ce0-aeeacaf305cc/ae9e69ae-0299-4d58-bb28-883fe265456a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:41.032249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9e96aeed-ed31-4741-8ca0-a6dc45825cd4 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-184480938'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:41.033313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9e96aeed-ed31-4741-8ca0-a6dc45825cd4 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Unknown quota resources ['metering_label']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:09:41.176301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d2a37d7-38f9-4808-9b6e-06b2bad955b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.246163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9c2712-b705-445d-bbde-71cb983c73cd req-46ca0b02-4920-440e-aedb-bdff31dc3d54 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:41.251061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2d2a37d7-38f9-4808-9b6e-06b2bad955b9 None None] For port a0da1c16-9b45-4ffa-82a0-83b36c1a2116, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,segment=NetworkSegment(7094686b-8074-40ca-b97c-6eaa64409834),segment_id=7094686b-8074-40ca-b97c-6eaa64409834)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:41.253211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa9c2712-b705-445d-bbde-71cb983c73cd req-46ca0b02-4920-440e-aedb-bdff31dc3d54 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0935614 Dec 21 04:09:41.272367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] Update dhcp port {'port': {'network_id': '9063912f-b9c6-4939-9671-639e1aea6f7a', 'fixed_ips': [{'subnet_id': 'ce363db3-6723-4603-8670-e5e6800dd170', 'ip_address': '2001:db8::2'}, {'subnet_id': 'bf6daeea-75bc-4c98-8ce0-aeeacaf305cc'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'a0da1c16-9b45-4ffa-82a0-83b36c1a2116'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:09:41.301934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.348322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.405492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0da1c16-9b45-4ffa-82a0-83b36c1a2116 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:41.410225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d2a37d7-38f9-4808-9b6e-06b2bad955b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.464955 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.504794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e96aeed-ed31-4741-8ca0-a6dc45825cd4 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.506387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9e96aeed-ed31-4741-8ca0-a6dc45825cd4 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 477 time: 0.6365156 Dec 21 04:09:41.509628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54278) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:41.522503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5819d617-b994-4ffa-98e5-d7f4f4df497b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': '7191d8ec-e7a0-4a29-ad38-68fa10d9bdae'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:41.523330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5819d617-b994-4ffa-98e5-d7f4f4df497b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=110311) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:09:41.530779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa9c2712-b705-445d-bbde-71cb983c73cd req-59395368-7dd7-4d26-aa38-3a670d4876bb tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2219758 Dec 21 04:09:41.553237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 9063912f-b9c6-4939-9671-639e1aea6f7a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:41.556837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2a37d7-38f9-4808-9b6e-06b2bad955b9 None None] Pushing event updated for resources: {'Port': ['ID=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:41.572230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-f9335894-2204-4803-b777-80f20255ea50 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:41.573884 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-f9335894-2204-4803-b777-80f20255ea50 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.1587069 Dec 21 04:09:41.574823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:41.575591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:41.575974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.587992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:41.594745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:41.595966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.615638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] Allocated IP 2001:db8:0:1::2 (9063912f-b9c6-4939-9671-639e1aea6f7a/bf6daeea-75bc-4c98-8ce0-aeeacaf305cc/a0da1c16-9b45-4ffa-82a0-83b36c1a2116) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:41.734259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=ae9e69ae-0299-4d58-bb28-883fe265456a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:41.781180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] For port a0da1c16-9b45-4ffa-82a0-83b36c1a2116, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,segment=NetworkSegment(7094686b-8074-40ca-b97c-6eaa64409834),segment_id=7094686b-8074-40ca-b97c-6eaa64409834)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:41.791971 n-d-822053-11 neutron-server[110311]: WARNING neutron.services.metering.metering_plugin [None req-5819d617-b994-4ffa-98e5-d7f4f4df497b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 21 04:09:41.813615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.881230 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4186eb8d-2633-4756-b41c-70c7acd9912d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1017 time: 1.8244648 Dec 21 04:09:41.884029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54290) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:41.906714 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.908600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'ce363db3-6723-4603-8670-e5e6800dd170'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:41.974503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5819d617-b994-4ffa-98e5-d7f4f4df497b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:41.978509 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5819d617-b994-4ffa-98e5-d7f4f4df497b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.4617631 Dec 21 04:09:41.979564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54294) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:41.989209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4481126e-6f3f-4278-83ee-3b66abb6ba83 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': '7191d8ec-e7a0-4a29-ad38-68fa10d9bdae'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:41.990609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4481126e-6f3f-4278-83ee-3b66abb6ba83 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:09:42.022392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7144f09e-9c02-4381-b1f3-a2de35ac9a65 None None] Pushing event updated for resources: {'Port': ['ID=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:42.049918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:42.063308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Deleting port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:42.063771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:42.187862 n-d-822053-11 neutron-server[110310]: WARNING neutron.services.metering.metering_plugin [None req-4481126e-6f3f-4278-83ee-3b66abb6ba83 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 21 04:09:42.250085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] For port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:42.250450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:42.318324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Calling delete_port for 5d271dd6-207e-4d03-a5e9-1b7dd220c01a owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:42.369211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4481126e-6f3f-4278-83ee-3b66abb6ba83 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:42.373450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4481126e-6f3f-4278-83ee-3b66abb6ba83 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.3897941 Dec 21 04:09:42.373450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54298) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:42.386983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ea0af3eb-05f7-43a6-841f-dd3f38ef5b9d tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules?id=ad6e9f27-1d22-4158-a4a5-2e42dbeacae4 HTTP/1.1" status: 200 len: 464 time: 0.0102997 Dec 21 04:09:42.393354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54300) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:42.624871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Delete allocated IP 2001:db8:0:1::317 (9063912f-b9c6-4939-9671-639e1aea6f7a/bf6daeea-75bc-4c98-8ce0-aeeacaf305cc) {{(pid=110311) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 21 04:09:42.693194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fafbaaf-21aa-470c-9d31-849dc3483d45 req-682e1993-c07e-4c2a-bba5-83b5ac69c621 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:42.701038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fafbaaf-21aa-470c-9d31-849dc3483d45 req-682e1993-c07e-4c2a-bba5-83b5ac69c621 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 945 time: 0.0666842 Dec 21 04:09:43.003860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fafbaaf-21aa-470c-9d31-849dc3483d45 req-25ee8adc-58b9-4418-80e1-6f5384151b36 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/security-groups?id=7a1b8842-0376-4577-9d7b-148e56f4d06e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944536 Dec 21 04:09:43.006046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.065300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f7fde4a-8883-4ee2-ae7a-dcccd6d9e5cd tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.069469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f7fde4a-8883-4ee2-ae7a-dcccd6d9e5cd tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-label-rules/ad6e9f27-1d22-4158-a4a5-2e42dbeacae4 HTTP/1.1" status: 204 len: 168 time: 0.6766267 Dec 21 04:09:43.071757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54314) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:43.080523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a657c81-5348-4777-9d46-7cecf7ccbb25 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules?id=ad6e9f27-1d22-4158-a4a5-2e42dbeacae4 HTTP/1.1" status: 200 len: 221 time: 0.0077260 Dec 21 04:09:43.083608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54316) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:43.087446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-232a3b75-c776-45d2-bf20-d6fc5d787bb7 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--1683005718', 'description': 'label created by tempest'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:43.087894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-232a3b75-c776-45d2-bf20-d6fc5d787bb7 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Unknown quota resources ['metering_label']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:09:43.193768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcd1a68d-e2b8-4491-93b3-b1ecc1fc1b55 None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:43.403680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0da1c16-9b45-4ffa-82a0-83b36c1a2116 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:43.437822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.458723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2628f261-65fc-4821-b124-5050554aa022 None None] Provisioning complete for port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:43.459084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2628f261-65fc-4821-b124-5050554aa022 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.485071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Pushing event deleted for resources: {'Port': ['ID=5d271dd6-207e-4d03-a5e9-1b7dd220c01a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:43.542581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:43.543354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.544328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] No DVR routers for this DVR port 5d271dd6-207e-4d03-a5e9-1b7dd220c01a on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:43.548628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.553459 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7693b0-e39c-4f0d-85fe-87a28cf5a74a req-8a4b449b-865e-4ac2-993b-a8079ac9768b tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.54 "DELETE /v2.0/ports/5d271dd6-207e-4d03-a5e9-1b7dd220c01a HTTP/1.1" status: 204 len: 173 time: 1.9668040 Dec 21 04:09:43.554399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '06a3967a-a9a8-458f-a229-1510bc81f486', 'name': 'network-vif-deleted', 'tag': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:09:43.557109 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94d70a51-b7fe-4a54-b778-7548fb83b91c" -d '{"events": [{"server_uuid": "06a3967a-a9a8-458f-a229-1510bc81f486", "name": "network-vif-deleted", "tag": "5d271dd6-207e-4d03-a5e9-1b7dd220c01a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:09:43.621213 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:09:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-687fe5ae-3812-4ef5-b947-6e57efa75330 x-openstack-request-id: req-687fe5ae-3812-4ef5-b947-6e57efa75330 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:09:43.621514 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "06a3967a-a9a8-458f-a229-1510bc81f486", "name": "network-vif-deleted", "tag": "5d271dd6-207e-4d03-a5e9-1b7dd220c01a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:09:43.621770 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-687fe5ae-3812-4ef5-b947-6e57efa75330 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:09:43.622721 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '06a3967a-a9a8-458f-a229-1510bc81f486', 'name': 'network-vif-deleted', 'tag': '5d271dd6-207e-4d03-a5e9-1b7dd220c01a', 'status': 'completed', 'code': 200} Dec 21 04:09:43.677760 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.818694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] In _notify_port_updated(), no bound segment for port ae9e69ae-0299-4d58-bb28-883fe265456a on network 9063912f-b9c6-4939-9671-639e1aea6f7a {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:09:43.825113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:43.825827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:43.827265 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/ports/ae9e69ae-0299-4d58-bb28-883fe265456a HTTP/1.1" status: 200 len: 926 time: 1.9239109 Dec 21 04:09:43.830592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54330) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:43.837541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'ce363db3-6723-4603-8670-e5e6800dd170'}, {'subnet_id': 'bf6daeea-75bc-4c98-8ce0-aeeacaf305cc'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:43.956131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2195b46-e6d6-4c3a-ac63-8897c989281f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=ae9e69ae-0299-4d58-bb28-883fe265456a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:43.962148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:44.010336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-91eacdba-ff86-4403-9f99-4ff7f6d4f86a None None] Provisioning complete for port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:44.010716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-91eacdba-ff86-4403-9f99-4ff7f6d4f86a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:44.309485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-91eacdba-ff86-4403-9f99-4ff7f6d4f86a None None] Provisioning complete for port ae9e69ae-0299-4d58-bb28-883fe265456a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:44.310112 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-91eacdba-ff86-4403-9f99-4ff7f6d4f86a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:44.412034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-91eacdba-ff86-4403-9f99-4ff7f6d4f86a None None] Port ae9e69ae-0299-4d58-bb28-883fe265456a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:44.417958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5d271dd6-207e-4d03-a5e9-1b7dd220c01a no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:44.465619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 5d271dd6-207e-4d03-a5e9-1b7dd220c01a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:44.470806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 5d271dd6-207e-4d03-a5e9-1b7dd220c01a not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:44.540871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bf6be9b-1599-48d6-89a2-9f80553271f4 req-2a54cd75-566f-451c-b414-7f2ff6e6f717 tempest-ListServerFiltersTestJSON-1291593990 tempest-ListServerFiltersTestJSON-1291593990-project] 10.222.0.18 "GET /v2.0/ports?device_id=06a3967a-a9a8-458f-a229-1510bc81f486 HTTP/1.1" status: 200 len: 210 time: 0.0451329 Dec 21 04:09:44.554993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-95da97d3-182e-40fa-b687-710364100010 None None] Provisioning complete for port ae9e69ae-0299-4d58-bb28-883fe265456a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:44.554993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-95da97d3-182e-40fa-b687-710364100010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:44.629720 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-232a3b75-c776-45d2-bf20-d6fc5d787bb7 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:44.634653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54352) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:44.642354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-232a3b75-c776-45d2-bf20-d6fc5d787bb7 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 1.5464995 Dec 21 04:09:44.649863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-95da97d3-182e-40fa-b687-710364100010 None None] Port ae9e69ae-0299-4d58-bb28-883fe265456a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:44.670822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8:0:1::44 (9063912f-b9c6-4939-9671-639e1aea6f7a/bf6daeea-75bc-4c98-8ce0-aeeacaf305cc/ae9e69ae-0299-4d58-bb28-883fe265456a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:44.770041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-329dc48c-2472-4418-9ebd-2e5dcb96c0d6 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels?id=600a10db-84a6-41ae-8179-b341e10d3729 HTTP/1.1" status: 200 len: 468 time: 0.1317236 Dec 21 04:09:44.773053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54360) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:44.875964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-70739349-6a63-4949-80ef-5c139ebdeb19 None None] Provisioning complete for port ae9e69ae-0299-4d58-bb28-883fe265456a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:44.879350 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-70739349-6a63-4949-80ef-5c139ebdeb19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:44.921766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-70739349-6a63-4949-80ef-5c139ebdeb19 None None] Port ae9e69ae-0299-4d58-bb28-883fe265456a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:44.960790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.009377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.062481 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3310b5-3643-4bd8-a6a1-7544528bbf0b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.063725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3d3310b5-3643-4bd8-a6a1-7544528bbf0b tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-labels/600a10db-84a6-41ae-8179-b341e10d3729 HTTP/1.1" status: 204 len: 168 time: 0.2895918 Dec 21 04:09:45.068241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54374) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.091646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2bc0b6f3-0e47-486d-9ef6-f02802e5881e tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels?id=600a10db-84a6-41ae-8179-b341e10d3729 HTTP/1.1" status: 200 len: 216 time: 0.0235832 Dec 21 04:09:45.095599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54378) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.107251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-843ecb23-7d2a-4473-b896-37a68df6f95f tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0099065 Dec 21 04:09:45.110205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54380) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.125489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f139207b-2b58-47b4-a56b-1cda8db69f4e tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0137348 Dec 21 04:09:45.129341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54382) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.215910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] In _notify_port_updated(), no bound segment for port ae9e69ae-0299-4d58-bb28-883fe265456a on network 9063912f-b9c6-4939-9671-639e1aea6f7a {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.226477 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:45.229308 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:45.232152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aa430a42-2a86-40b2-be24-92c3f1508fac tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels/7191d8ec-e7a0-4a29-ad38-68fa10d9bdae HTTP/1.1" status: 200 len: 472 time: 0.0937271 Dec 21 04:09:45.233486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54388) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.237839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:45.238532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.240432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/ports/ae9e69ae-0299-4d58-bb28-883fe265456a HTTP/1.1" status: 200 len: 1011 time: 1.4087341 Dec 21 04:09:45.243221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54390) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.266215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7e60da2f-d54a-4a96-aa9a-36aea87ba19f tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules/40e8c4c4-bf5e-44e7-9d47-ad37548be526 HTTP/1.1" status: 200 len: 461 time: 0.0311420 Dec 21 04:09:45.269774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54392) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.309384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd7eaf69-ee26-41a4-8a25-1cc51e1a6217 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=ae9e69ae-0299-4d58-bb28-883fe265456a,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:45.405794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port ae9e69ae-0299-4d58-bb28-883fe265456a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:45.406515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.448348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-201602fd-7bcc-4c60-9160-e0d47f414147 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.449674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-201602fd-7bcc-4c60-9160-e0d47f414147 tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-label-rules/40e8c4c4-bf5e-44e7-9d47-ad37548be526 HTTP/1.1" status: 204 len: 168 time: 0.1789472 Dec 21 04:09:45.452167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54396) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.460795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-30a7accc-35a1-4c90-b254-43f51c675328 None None] Provisioning complete for port ae9e69ae-0299-4d58-bb28-883fe265456a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:45.460795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30a7accc-35a1-4c90-b254-43f51c675328 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.500248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-30a7accc-35a1-4c90-b254-43f51c675328 None None] Port ae9e69ae-0299-4d58-bb28-883fe265456a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:45.512910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.526288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for ae9e69ae-0299-4d58-bb28-883fe265456a owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:45.619185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54402) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:45.669050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Deleting subnet 39078dda-bad6-4dd8-b1ea-bf27b6bdc389 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:09:45.675556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.732009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.774213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d41253d2-eb7d-4e2b-802e-5da4ff88132c tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:45.776946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d41253d2-eb7d-4e2b-802e-5da4ff88132c tempest-MeteringTestJSON-1698353436 tempest-MeteringTestJSON-1698353436-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-labels/7191d8ec-e7a0-4a29-ad38-68fa10d9bdae HTTP/1.1" status: 204 len: 168 time: 0.3235812 Dec 21 04:09:45.898138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.021841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.128543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.186991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=39078dda-bad6-4dd8-b1ea-bf27b6bdc389,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:46.195569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=ae9e69ae-0299-4d58-bb28-883fe265456a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:46.202320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.216217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54412) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:46.220526 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bdbd19ad-3262-4fd7-abc2-b7f2f42fe425 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/ae9e69ae-0299-4d58-bb28-883fe265456a HTTP/1.1" status: 204 len: 168 time: 0.9688420 Dec 21 04:09:46.233121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.233836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ea1dc90-c21a-45b0-8f18-d42bfa345aff None None] Network 5b94d88b-3288-4137-8290-856f86bd57aa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:46.241388 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84e9d3db-40de-4962-aa07-da5b4eac6a39 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/39078dda-bad6-4dd8-b1ea-bf27b6bdc389 HTTP/1.1" status: 204 len: 168 time: 0.6211126 Dec 21 04:09:46.243590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54416) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:46.274808 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-e047343e-6caa-4b27-9ab1-dc16e2b2accf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:46.280862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e047343e-6caa-4b27-9ab1-dc16e2b2accf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/ae9e69ae-0299-4d58-bb28-883fe265456a HTTP/1.1" status: 404 len: 333 time: 0.0590384 Dec 21 04:09:46.281247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:46.426714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet bf6daeea-75bc-4c98-8ce0-aeeacaf305cc {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:09:46.431328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.512239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54428) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:46.514961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.636634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] DHCP port deletion for 5b94d88b-3288-4137-8290-856f86bd57aa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:46.676324 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.728573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] Deleting port 25763a72-aed3-4bd1-b448-7788360bd9db {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:46.729397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.833914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] For port 25763a72-aed3-4bd1-b448-7788360bd9db, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=25763a72-aed3-4bd1-b448-7788360bd9db,segment=NetworkSegment(38c210ca-73e5-429b-b74e-20455218ed07),segment_id=38c210ca-73e5-429b-b74e-20455218ed07)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:46.834175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bde93f3-45bb-4a7a-aa97-bbcb0af398d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.835084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.849954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] Calling delete_port for 25763a72-aed3-4bd1-b448-7788360bd9db owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:46.930718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.956717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:46.999816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea8055f0-0743-4a87-be3e-9237cf7abb4e None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:47.016173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.032089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/bf6daeea-75bc-4c98-8ce0-aeeacaf305cc HTTP/1.1" status: 204 len: 168 time: 0.7494829 Dec 21 04:09:47.034871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54436) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:47.058747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f8b64e-d5fc-4697-b40a-7db290bdc7fa tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=bf6daeea-75bc-4c98-8ce0-aeeacaf305cc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:47.066636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Deleting port 25763a72-aed3-4bd1-b448-7788360bd9db {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:47.067405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.084239 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.129461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] No DVR routers for this DVR port 25763a72-aed3-4bd1-b448-7788360bd9db on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:47.136586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b41aaad7-4755-49cd-8300-646761a75379 None None] Pushing event deleted for resources: {'Port': ['ID=25763a72-aed3-4bd1-b448-7788360bd9db,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:47.157189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bde93f3-45bb-4a7a-aa97-bbcb0af398d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.189615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet ce363db3-6723-4603-8670-e5e6800dd170 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:09:47.199895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.216026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] For port 25763a72-aed3-4bd1-b448-7788360bd9db, host n-d-822053-11, got binding levels [] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:47.216400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.242471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Calling delete_port for 25763a72-aed3-4bd1-b448-7788360bd9db owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:47.246236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Port 25763a72-aed3-4bd1-b448-7788360bd9db was not found and therefore no delete operation was performed {{(pid=110311) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:09:47.246965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.250650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bde93f3-45bb-4a7a-aa97-bbcb0af398d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.277791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=25763a72-aed3-4bd1-b448-7788360bd9db,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:47.283996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] No DVR routers for this DVR port 25763a72-aed3-4bd1-b448-7788360bd9db on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:47.317919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.327794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6bde93f3-45bb-4a7a-aa97-bbcb0af398d5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a477c7101f654d789a3e30f09e4c2599&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8021140 Dec 21 04:09:47.328271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25763a72-aed3-4bd1-b448-7788360bd9db no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:47.341123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:47.365859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 25763a72-aed3-4bd1-b448-7788360bd9db {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:47.366155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25763a72-aed3-4bd1-b448-7788360bd9db not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:47.386666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bde93f3-45bb-4a7a-aa97-bbcb0af398d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2885b01-37da-450b-bbaf-27fcc4f29794,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:47.439483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.476099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5b94d88b-3288-4137-8290-856f86bd57aa']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:47.499894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '38c210ca-73e5-429b-b74e-20455218ed07') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:47.500181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '38c210ca-73e5-429b-b74e-20455218ed07') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:47.510735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.544946 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.561624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:47.561624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.568821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:47.661641 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:47.694718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca910ca9-f5c0-4ba7-a9c8-62a330795480 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.722126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca910ca9-f5c0-4ba7-a9c8-62a330795480 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.770620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.777438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.783044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] 10.222.0.18 "DELETE /v2.0/networks/5b94d88b-3288-4137-8290-856f86bd57aa HTTP/1.1" status: 204 len: 168 time: 1.5375683 Dec 21 04:09:47.798972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678a4688-9e27-456d-9f42-13d0528562d3 admin admin] Pushing event deleted for resources: {'Network': ['ID=5b94d88b-3288-4137-8290-856f86bd57aa,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:47.804045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.860374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca910ca9-f5c0-4ba7-a9c8-62a330795480 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.865376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca910ca9-f5c0-4ba7-a9c8-62a330795480 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.871301 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ca910ca9-f5c0-4ba7-a9c8-62a330795480 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a2885b01-37da-450b-bbaf-27fcc4f29794 HTTP/1.1" status: 204 len: 168 time: 0.5284383 Dec 21 04:09:47.889471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca910ca9-f5c0-4ba7-a9c8-62a330795480 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2885b01-37da-450b-bbaf-27fcc4f29794,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:47.906718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:47.914798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/ce363db3-6723-4603-8670-e5e6800dd170 HTTP/1.1" status: 204 len: 168 time: 0.8765926 Dec 21 04:09:47.915277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54462) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:47.927589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a51742c-60fa-40c7-8b77-74f8bac3a13f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=ce363db3-6723-4603-8670-e5e6800dd170,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:48.027412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.169681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:48.169681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.197937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:48.307818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8d6608d3-dde4-4993-9c54-372ca6c8397a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d1d48e3ff6704ed3be8064f88e36401f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1061330 Dec 21 04:09:48.308325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:48.325684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port a0da1c16-9b45-4ffa-82a0-83b36c1a2116, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,segment=NetworkSegment(7094686b-8074-40ca-b97c-6eaa64409834),segment_id=7094686b-8074-40ca-b97c-6eaa64409834)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:48.326050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.340641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for a0da1c16-9b45-4ffa-82a0-83b36c1a2116 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:48.378680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a396b694-c1d4-443c-be18-56de3d11a98a None None] Network 9063912f-b9c6-4939-9671-639e1aea6f7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:48.429965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b5498f8-3bdb-4cbb-bb01-db9071230b71 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.461921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b5498f8-3bdb-4cbb-bb01-db9071230b71 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.524276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f444983d-f27f-4997-8839-bb53b198b3d5 None None] Provisioning complete for port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:48.524652 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f444983d-f27f-4997-8839-bb53b198b3d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.540584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.613495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port a0da1c16-9b45-4ffa-82a0-83b36c1a2116 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:48.625440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f444983d-f27f-4997-8839-bb53b198b3d5 None None] Could not find standard attr ID for object a0da1c16-9b45-4ffa-82a0-83b36c1a2116. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:09:48.629187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=a0da1c16-9b45-4ffa-82a0-83b36c1a2116,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:48.632497 n-d-822053-11 neutron-server[110312]: INFO neutron.plugins.ml2.db [None req-f444983d-f27f-4997-8839-bb53b198b3d5 None None] No ports have port_id starting with a0da1c16-9b45-4ffa-82a0-83b36c1a2116 Dec 21 04:09:48.637505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b5498f8-3bdb-4cbb-bb01-db9071230b71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.640416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8b5498f8-3bdb-4cbb-bb01-db9071230b71 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.644521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8b5498f8-3bdb-4cbb-bb01-db9071230b71 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7a1b8842-0376-4577-9d7b-148e56f4d06e HTTP/1.1" status: 204 len: 168 time: 0.3323097 Dec 21 04:09:48.653588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b5498f8-3bdb-4cbb-bb01-db9071230b71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a1b8842-0376-4577-9d7b-148e56f4d06e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:48.752826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5d6d947-9699-4f10-836f-3a5ad6f1255d None None] DHCP port deletion for 9063912f-b9c6-4939-9671-639e1aea6f7a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:48.832749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:48.851187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-54bce28c-154e-4322-ad07-968a8107821c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.859935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.884531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9063912f-b9c6-4939-9671-639e1aea6f7a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:48.895982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7094686b-8074-40ca-b97c-6eaa64409834') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:48.896709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7094686b-8074-40ca-b97c-6eaa64409834') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:48.908473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.929443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.936001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:48.936573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:48.940892 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:49.072352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.080538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.084448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/9063912f-b9c6-4939-9671-639e1aea6f7a HTTP/1.1" status: 204 len: 168 time: 1.1680262 Dec 21 04:09:49.101692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:49.150089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ff5545-0b40-4480-b42a-01dc5632e3e6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=9063912f-b9c6-4939-9671-639e1aea6f7a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:49.154086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-54bce28c-154e-4322-ad07-968a8107821c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.197519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-54bce28c-154e-4322-ad07-968a8107821c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.238691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bc05b3a-0139-45b5-a21f-9e42c7be7a15 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:49.247438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6bc05b3a-0139-45b5-a21f-9e42c7be7a15 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.1443825 Dec 21 04:09:49.248852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54496) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:49.270320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-54bce28c-154e-4322-ad07-968a8107821c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=38f9185e99a8491bab01d34fc498d124&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4363976 Dec 21 04:09:49.272911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54498) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:49.319702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54bce28c-154e-4322-ad07-968a8107821c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b420579e-00aa-429d-83b6-db8739422ef9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:49.322639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0da1c16-9b45-4ffa-82a0-83b36c1a2116 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:49.368091 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0844b116-a394-4054-af25-f9e18d699e57 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1168804 Dec 21 04:09:49.371217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54502) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:49.376336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a0da1c16-9b45-4ffa-82a0-83b36c1a2116 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:49.376497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-480576433'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:49.376683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a0da1c16-9b45-4ffa-82a0-83b36c1a2116 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:49.398468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7e81797-7f43-4b35-803a-81b89e81bc7e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.428496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7e81797-7f43-4b35-803a-81b89e81bc7e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.575038 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7e81797-7f43-4b35-803a-81b89e81bc7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.577830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7e81797-7f43-4b35-803a-81b89e81bc7e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.579897 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7e81797-7f43-4b35-803a-81b89e81bc7e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b420579e-00aa-429d-83b6-db8739422ef9 HTTP/1.1" status: 204 len: 168 time: 0.3054531 Dec 21 04:09:49.589390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e81797-7f43-4b35-803a-81b89e81bc7e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b420579e-00aa-429d-83b6-db8739422ef9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:49.632201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:49.636678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.715897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:49.741002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.741393 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment 8c72656a-1cc1-40c2-914e-60f24d8b6682 of type vlan for network 6441ede8-4262-4240-b987-6c0f5323256c Dec 21 04:09:49.849721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b23f618-f0fc-4ea6-92f8-8f97f210b972 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.850906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.966249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:49.986793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:49.987709 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:50.117563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=6441ede8-4262-4240-b987-6c0f5323256c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:50.137253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f8e103d-d8c1-4118-b965-50cb5ca4420d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.7638886 Dec 21 04:09:50.137498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6441ede8-4262-4240-b987-6c0f5323256c details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:50.139210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54532) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:50.147790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '6441ede8-4262-4240-b987-6c0f5323256c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:50.443253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:50.446876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:50.512492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:50.768011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Request body: {'network': {'name': 'tempest-ServerAddressesNegativeTestJSON-972386705-network', 'tenant_id': '3484fe5a05934f988251baa6c81d9a66'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:50.781256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:50.894102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Made reservation on behalf of 3484fe5a05934f988251baa6c81d9a66 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:50.896865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:50.914713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:50.950268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=bc134b15-bbee-46f8-b1d2-eb65311bcd63,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:50.975549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': '8c72656a-1cc1-40c2-914e-60f24d8b6682', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '6441ede8-4262-4240-b987-6c0f5323256c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:50.975935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: 6441ede8-4262-4240-b987-6c0f5323256c, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:51.048735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.105822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 6441ede8-4262-4240-b987-6c0f5323256c is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:51.115192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54570) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:51.151663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.203974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=476a19d1-6506-42c7-8a8b-6f3c91f880d6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:51.208869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:51.213125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6441ede8-4262-4240-b987-6c0f5323256c) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:51.221956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:51.222471 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.249637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb898772-4db8-40ed-ae1c-1fdcbb71765f None None] Network 6441ede8-4262-4240-b987-6c0f5323256c requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:51.253729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.257598 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Added segment be357cea-d63a-4916-a268-77c501ae12fe of type vlan for network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a Dec 21 04:09:51.330722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.368642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'networks': [{'name': 'tempest-network--55407598'}, {'name': 'tempest-network--99887227'}]} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:51.375809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'network': {'name': 'tempest-network--55407598'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:51.375809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'network': {'name': 'tempest-network--99887227'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:51.389466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-6441ede8-4262-4240-b987-6c0f5323256c', 'network_id': '6441ede8-4262-4240-b987-6c0f5323256c', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': 'bc134b15-bbee-46f8-b1d2-eb65311bcd63'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:09:51.390507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.451576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-00e03964-26b9-4faf-bcc5-3991c2096289 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3085611 Dec 21 04:09:51.452873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54578) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:51.458884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '6441ede8-4262-4240-b987-6c0f5323256c', 'name': 'tempest-PortsIpV6TestJSON-1533131984'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:51.493244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.494280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:51.494851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.552073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Allocated IP 2001:db8::2 (6441ede8-4262-4240-b987-6c0f5323256c/bc134b15-bbee-46f8-b1d2-eb65311bcd63/f4acf6ab-9e61-40e1-b118-9d33b801e6a4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:51.631789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] Pushing event updated for resources: {'Network': ['ID=203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:51.654926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:51.689673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'network': 2} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:51.689673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.701490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.722615 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a4d9e195-da23-4a52-8a50-63b9deba9edf admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 1.2068427 Dec 21 04:09:51.724105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:51.731885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Request body: {'subnet': {'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerAddressesNegativeTestJSON-972386705-subnet', 'tenant_id': '3484fe5a05934f988251baa6c81d9a66', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:51.780268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.838755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.901843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:51.910233 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.938072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:51.952500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:51.997305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Made reservation on behalf of 3484fe5a05934f988251baa6c81d9a66 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:51.997305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.010409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Network 6441ede8-4262-4240-b987-6c0f5323256c is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:52.017870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:52.023890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:52.055227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.060484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.082873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Pushing event updated for resources: {'Port': ['ID=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:52.113802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e21ef3d4-e4d6-4657-aee6-fe9ba4ba55d6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:52.116267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Attempting to bind port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:09:52.116649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Attempting to bind port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '8c72656a-1cc1-40c2-914e-60f24d8b6682', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '6441ede8-4262-4240-b987-6c0f5323256c'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:09:52.117019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Attempting to bind port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 on network 6441ede8-4262-4240-b987-6c0f5323256c {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:09:52.126145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:09:52.126145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Checking segment: {'id': '8c72656a-1cc1-40c2-914e-60f24d8b6682', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '6441ede8-4262-4240-b987-6c0f5323256c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:52.126145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.126145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Bound using segment: {'id': '8c72656a-1cc1-40c2-914e-60f24d8b6682', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '6441ede8-4262-4240-b987-6c0f5323256c'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:09:52.126145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Bound port: f4acf6ab-9e61-40e1-b118-9d33b801e6a4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8c72656a-1cc1-40c2-914e-60f24d8b6682', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '6441ede8-4262-4240-b987-6c0f5323256c'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:09:52.126145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.166658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:52.185472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::238 (6441ede8-4262-4240-b987-6c0f5323256c/bc134b15-bbee-46f8-b1d2-eb65311bcd63/4b9cda22-5ade-4a17-9e7e-168c5cc2e65f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:52.187936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.188399 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Added segment 827e0fef-7920-4766-a5b3-86597bef5cf7 of type vlan for network d20917e7-e9a6-4817-8f99-2b83729f1a5f Dec 21 04:09:52.226198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] For port f4acf6ab-9e61-40e1-b118-9d33b801e6a4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:09:52.230428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] For port f4acf6ab-9e61-40e1-b118-9d33b801e6a4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,segment=NetworkSegment(8c72656a-1cc1-40c2-914e-60f24d8b6682),segment_id=8c72656a-1cc1-40c2-914e-60f24d8b6682)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:09:52.268844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.312611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] vlan segment allocate from pool success with {'vlan_id': 132, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:52.338386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.339306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.339667 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Added segment a262fb3d-8dfb-4b25-8899-4312da2180b8 of type vlan for network bcc797f7-eb10-4081-9f7d-16dd2988c6b1 Dec 21 04:09:52.397224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.431890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa0986f-045d-4f49-b6a1-dd150b07e58a None None] Pushing event updated for resources: {'Port': ['ID=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:52.506145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.506782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.515971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:52.522279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:52.531124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.549813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.627791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Network': ['ID=d20917e7-e9a6-4817-8f99-2b83729f1a5f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:52.629769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.649613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d20917e7-e9a6-4817-8f99-2b83729f1a5f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:52.691774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Pushing event updated for resources: {'Subnet': ['ID=944187b7-8f03-4a9a-9440-b75bba35be80,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:52.751541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1316 time: 1.6347744 Dec 21 04:09:52.754791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54598) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:52.769541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Checking segment: {'id': 'be357cea-d63a-4916-a268-77c501ae12fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:52.769541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Network hostable DHCP agents. Network: 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:52.774471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24f92eb-f578-42d6-8cf0-a55c80c24c9d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Network': ['ID=bcc797f7-eb10-4081-9f7d-16dd2988c6b1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:52.798466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network bcc797f7-eb10-4081-9f7d-16dd2988c6b1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:52.850718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-603cc25e-44c5-43ae-a870-b688286f365f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.936307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:52.951933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:52.955710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bdbf165-5c4f-4654-85b3-d0fc2ab84bcb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:52.970968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bdbf165-5c4f-4654-85b3-d0fc2ab84bcb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:52.978820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bdbf165-5c4f-4654-85b3-d0fc2ab84bcb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:52.985528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bdbf165-5c4f-4654-85b3-d0fc2ab84bcb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:52.987283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7bdbf165-5c4f-4654-85b3-d0fc2ab84bcb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2403 time: 0.2318461 Dec 21 04:09:52.990631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54602) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:53.004124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.081360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:53.089934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29ac919b-ec4e-4514-8589-000410659bbb None None] Network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:53.116775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.117445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=4b9cda22-5ade-4a17-9e7e-168c5cc2e65f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:53.124740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:53.125457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.147758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 6441ede8-4262-4240-b987-6c0f5323256c is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:53.155048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:53.158394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:53.167736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:53.168963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.243579 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.259358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad4dc8a1-b8c3-49f1-be10-494db6fdd819 None None] Network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:53.270842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d20917e7-e9a6-4817-8f99-2b83729f1a5f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:53.276981 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9fe546b6-043c-4671-86e4-22f4a19534de admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 1.5513644 Dec 21 04:09:53.284835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '827e0fef-7920-4766-a5b3-86597bef5cf7') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:53.287169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '827e0fef-7920-4766-a5b3-86597bef5cf7') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:53.305101 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1d8ba9f-3414-431f-af77-51bc3be85604 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.8510969 Dec 21 04:09:53.312352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:53.327020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '6441ede8-4262-4240-b987-6c0f5323256c', 'name': 'tempest-PortsIpV6TestJSON-1884130344'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:53.336224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.339503 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.366623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f4acf6ab-9e61-40e1-b118-9d33b801e6a4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:53.385629 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.403213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:53.403632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:53.406914 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:53.464892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:53.465181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.625212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.666646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.672169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port f4acf6ab-9e61-40e1-b118-9d33b801e6a4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,segment=NetworkSegment(8c72656a-1cc1-40c2-914e-60f24d8b6682),segment_id=8c72656a-1cc1-40c2-914e-60f24d8b6682)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:53.688027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.694030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/networks/d20917e7-e9a6-4817-8f99-2b83729f1a5f HTTP/1.1" status: 204 len: 168 time: 0.7006648 Dec 21 04:09:53.694030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90351135-737d-4e7e-bb1d-575674305d24 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Network': ['ID=d20917e7-e9a6-4817-8f99-2b83729f1a5f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:53.695225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54622) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:53.740717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.802875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:53.806826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.834277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:53.836725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:53.848625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 48e9161a-3755-4138-a577-431a44607ede yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:53.920101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3e1acc9-8608-4f74-9b94-35e29e6a3bf4 None None] Network 6441ede8-4262-4240-b987-6c0f5323256c requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:53.925594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-28142c68-3c29-4111-a079-01ab83a21fe1 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:53.927188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-28142c68-3c29-4111-a079-01ab83a21fe1 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/networks?id=203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a HTTP/1.1" status: 200 len: 821 time: 0.1321573 Dec 21 04:09:53.943011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-d2626c70-3e26-4d38-9857-362a6ae1bbb0 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/quotas/3484fe5a05934f988251baa6c81d9a66 HTTP/1.1" status: 200 len: 375 time: 0.0098674 Dec 21 04:09:54.005337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-0125ee08-6128-47eb-8ddc-f4a347234c08 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=3484fe5a05934f988251baa6c81d9a66&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0536461 Dec 21 04:09:54.028201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.063920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bcc797f7-eb10-4081-9f7d-16dd2988c6b1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:54.067271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f7217fad-1593-4b54-bc73-4bbccc9c9acd None None] Provisioning complete for port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:54.067685 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f7217fad-1593-4b54-bc73-4bbccc9c9acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.125302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::b1 (6441ede8-4262-4240-b987-6c0f5323256c/bc134b15-bbee-46f8-b1d2-eb65311bcd63/48e9161a-3755-4138-a577-431a44607ede) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:54.130777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a262fb3d-8dfb-4b25-8899-4312da2180b8') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:54.131124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a262fb3d-8dfb-4b25-8899-4312da2180b8') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:54.202268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.211564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-a3b48005-7e61-4bf1-8f3b-76326a01707c service neutron] 10.222.0.18 "GET /v2.0/networks/203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1886828 Dec 21 04:09:54.283599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.308009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:54.308436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:54.311972 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:54.395653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-9b54b98d-007e-46c5-a2c4-0d10fd2b178a service neutron] 10.222.0.18 "GET /v2.0/networks/203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1807282 Dec 21 04:09:54.496885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.511683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-78702c42-939b-4536-97d8-8eb2f983abac None None] Provisioning complete for port 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:54.512720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78702c42-939b-4536-97d8-8eb2f983abac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.556253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-78702c42-939b-4536-97d8-8eb2f983abac None None] Port 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:54.567513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-78702c42-939b-4536-97d8-8eb2f983abac None None] Provisioning complete for port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:54.567513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78702c42-939b-4536-97d8-8eb2f983abac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.591177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.597500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.603163 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/networks/bcc797f7-eb10-4081-9f7d-16dd2988c6b1 HTTP/1.1" status: 204 len: 168 time: 0.9054179 Dec 21 04:09:54.603663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54652) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:54.618644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df275d61-9e3d-433b-ab9a-06c865e59610 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Network': ['ID=bcc797f7-eb10-4081-9f7d-16dd2988c6b1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:54.740303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52e48dfb-16cc-4747-a5be-0b99fd5e95a4 req-81c563c6-264d-4553-92be-82067270535f tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 210 time: 0.0378036 Dec 21 04:09:54.746190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.804439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efb9c31c-ac39-4cde-8a29-cb72b1f932d3 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:54.811404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efb9c31c-ac39-4cde-8a29-cb72b1f932d3 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:54.822322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-efb9c31c-ac39-4cde-8a29-cb72b1f932d3 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.2175324 Dec 21 04:09:54.823349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 6441ede8-4262-4240-b987-6c0f5323256c is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:54.826067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:54.833041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d57d749-611b-4e11-9872-89779e7c82f1 None None] Provisioning complete for port 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:54.833424 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d57d749-611b-4e11-9872-89779e7c82f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.836304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:54.841594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:54.862807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:54.863527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:54.871157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1282518373'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:54.909840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=48e9161a-3755-4138-a577-431a44607ede,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:54.937737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4d57d749-611b-4e11-9872-89779e7c82f1 None None] Port 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:55.105372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-385aa327-ef09-44d8-85f5-6998536a29dc tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.7919140 Dec 21 04:09:55.108370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54668) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:55.165563 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.166304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.177550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fd4f546f-10a4-42a4-b1ac-66684bd92599 None None] Provisioning complete for port 48e9161a-3755-4138-a577-431a44607ede triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:55.177985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd4f546f-10a4-42a4-b1ac-66684bd92599 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.205360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58b92b63-8d9f-45ff-a288-3d01111e198c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:55.206925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-58b92b63-8d9f-45ff-a288-3d01111e198c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A238 HTTP/1.1" status: 200 len: 929 time: 0.0971818 Dec 21 04:09:55.209936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54678) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:55.264049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fd4f546f-10a4-42a4-b1ac-66684bd92599 None None] Port 48e9161a-3755-4138-a577-431a44607ede cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:09:55.278535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f4acf6ab-9e61-40e1-b118-9d33b801e6a4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:09:55.312311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:55.319332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 48e9161a-3755-4138-a577-431a44607ede {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:55.319332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.321593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.348183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:55.357777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.365038 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Added segment f8b2190d-482c-4ce8-b4cb-1e776b6957aa of type vlan for network 9f03ff55-a4ee-4413-8bb2-5409055b23ea Dec 21 04:09:55.381007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:09:55.381574 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.406153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.450203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.465831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 48e9161a-3755-4138-a577-431a44607ede owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:55.559359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.566055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:55.566677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.640773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Network': ['ID=9f03ff55-a4ee-4413-8bb2-5409055b23ea,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:55.659882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9f03ff55-a4ee-4413-8bb2-5409055b23ea details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:55.679973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54686) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:55.684540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3c07bd8b-a738-469b-b990-eaf1a45f0fc9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.8417003 Dec 21 04:09:55.688778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1338428793'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:55.721765 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.793794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=48e9161a-3755-4138-a577-431a44607ede,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:55.820108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.873204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:55.873204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c99009af-82e4-4832-80e8-567e640fae11 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/48e9161a-3755-4138-a577-431a44607ede HTTP/1.1" status: 204 len: 168 time: 0.6581604 Dec 21 04:09:55.873493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54690) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:55.904464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5205dc6-6ac0-481c-8221-2b13043fef80 req-3e460500-038f-44a3-9494-feb85513ba23 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 210 time: 0.0561316 Dec 21 04:09:55.915799 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-10740157-ff30-432b-928b-d3f9859ce8a6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:55.920697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54696) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:55.921091 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10740157-ff30-432b-928b-d3f9859ce8a6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/48e9161a-3755-4138-a577-431a44607ede HTTP/1.1" status: 404 len: 333 time: 0.0503523 Dec 21 04:09:55.997211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:56.000109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.060297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:56.074893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.075511 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Added segment 06e6d928-c44f-4bed-bf95-77f94fe55955 of type vlan for network aedbd054-3efa-4080-b323-dcf03b334254 Dec 21 04:09:56.092208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:56.092588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.177849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.234121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.249274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 4b9cda22-5ade-4a17-9e7e-168c5cc2e65f owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:56.324639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.335198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:56.335198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.414050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Network': ['ID=aedbd054-3efa-4080-b323-dcf03b334254,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:56.430125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network aedbd054-3efa-4080-b323-dcf03b334254 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:56.484195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-755db739-21a3-4bc3-831e-b05093a1922e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.8004906 Dec 21 04:09:56.486069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54706) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:56.491983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'ports': [{'network_id': '9f03ff55-a4ee-4413-8bb2-5409055b23ea', 'name': 'tempest-port--1826480858', 'admin_state_up': True}, {'network_id': 'aedbd054-3efa-4080-b323-dcf03b334254', 'admin_state_up': False}]} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:56.492293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'port': {'network_id': '9f03ff55-a4ee-4413-8bb2-5409055b23ea', 'name': 'tempest-port--1826480858', 'admin_state_up': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:56.493102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'port': {'network_id': 'aedbd054-3efa-4080-b323-dcf03b334254', 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:56.589598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.639164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=4b9cda22-5ade-4a17-9e7e-168c5cc2e65f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:56.675736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.684490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d269b83c-beac-4074-8637-6430fe594a90 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/4b9cda22-5ade-4a17-9e7e-168c5cc2e65f HTTP/1.1" status: 204 len: 168 time: 0.7625415 Dec 21 04:09:56.687298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54710) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:56.723229 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-06f9f2e9-afa6-412f-b6b2-5808bb2cf6e4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:09:56.727521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-06f9f2e9-afa6-412f-b6b2-5808bb2cf6e4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/4b9cda22-5ade-4a17-9e7e-168c5cc2e65f HTTP/1.1" status: 404 len: 333 time: 0.0390034 Dec 21 04:09:56.729792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54712) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:56.806342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet bc134b15-bbee-46f8-b1d2-eb65311bcd63 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:09:56.811562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.868239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.900059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'port': 2} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:56.905655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.933990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:56.978308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.095412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a410d0a-c70a-4a54-8597-49ac7e503bf3 req-8227a283-beac-4f6a-af5f-517fb2f5cdc0 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 210 time: 0.0617702 Dec 21 04:09:57.140552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] device_id is not set on port be4a00e0-3ada-462d-ade8-0efc1207af93 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:57.261037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.274155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.276010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.281525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/bc134b15-bbee-46f8-b1d2-eb65311bcd63 HTTP/1.1" status: 204 len: 168 time: 0.5472403 Dec 21 04:09:57.284934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca13c16f-2d05-4542-95ac-069fdb3f9480 None None] Network 6441ede8-4262-4240-b987-6c0f5323256c requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:57.294839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54724) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:57.301897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee97a74-5c94-4084-9c11-3ec23d7cdded tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=bc134b15-bbee-46f8-b1d2-eb65311bcd63,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:57.469123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.476250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] device_id is not set on port cc6a3fe8-0342-475f-805f-58f4b4b35e8e yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:09:57.499336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] DHCP port deletion for 6441ede8-4262-4240-b987-6c0f5323256c request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:09:57.558629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] Deleting port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:57.559059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.649707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.655513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] For port f4acf6ab-9e61-40e1-b118-9d33b801e6a4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,segment=NetworkSegment(8c72656a-1cc1-40c2-914e-60f24d8b6682),segment_id=8c72656a-1cc1-40c2-914e-60f24d8b6682)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:57.656081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.664933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:57.665281 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.679095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] Calling delete_port for f4acf6ab-9e61-40e1-b118-9d33b801e6a4 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:57.761333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port f4acf6ab-9e61-40e1-b118-9d33b801e6a4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,segment=NetworkSegment(8c72656a-1cc1-40c2-914e-60f24d8b6682),segment_id=8c72656a-1cc1-40c2-914e-60f24d8b6682)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:09:57.761797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.774921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for f4acf6ab-9e61-40e1-b118-9d33b801e6a4 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:09:57.838226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.854467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.908502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] No DVR routers for this DVR port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:57.910699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Port': ['ID=be4a00e0-3ada-462d-ade8-0efc1207af93,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:57.925390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:57.925948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3687ae1-4953-44b1-b4ed-18ada4473841 None None] Pushing event deleted for resources: {'Port': ['ID=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:57.962655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port f4acf6ab-9e61-40e1-b118-9d33b801e6a4 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:09:57.964140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=f4acf6ab-9e61-40e1-b118-9d33b801e6a4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:57.989759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Checking segment: {'id': 'f8b2190d-482c-4ce8-b4cb-1e776b6957aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '9f03ff55-a4ee-4413-8bb2-5409055b23ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:57.990132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network hostable DHCP agents. Network: 9f03ff55-a4ee-4413-8bb2-5409055b23ea, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:58.086373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.157458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network 9f03ff55-a4ee-4413-8bb2-5409055b23ea is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:58.168084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6441ede8-4262-4240-b987-6c0f5323256c']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:58.190220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8c72656a-1cc1-40c2-914e-60f24d8b6682') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:58.190603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8c72656a-1cc1-40c2-914e-60f24d8b6682') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:09:58.206407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.237781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.240592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1723fd2a-f426-4696-b11c-d6e416b3d964 req-d2f8321f-b814-44da-9e24-63e67d507953 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 210 time: 0.0275342 Dec 21 04:09:58.256226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-3f150e9b-abb5-4094-b437-a37b618da582 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:58.257698 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-3f150e9b-abb5-4094-b437-a37b618da582 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.54 "GET /v2.0/networks?id=203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a HTTP/1.1" status: 200 len: 821 time: 0.1953478 Dec 21 04:09:58.258695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:09:58.259128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:09:58.262217 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:09:58.343033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Request body: {'port': {'device_id': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a', 'admin_state_up': True, 'tenant_id': '3484fe5a05934f988251baa6c81d9a66'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:58.352629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9f03ff55-a4ee-4413-8bb2-5409055b23ea) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:58.365798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9b3e9ba-649f-43ca-88d5-e1fec2669585 None None] Network 9f03ff55-a4ee-4413-8bb2-5409055b23ea requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:58.395641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:58.395641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.489866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.510797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.515588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/6441ede8-4262-4240-b987-6c0f5323256c HTTP/1.1" status: 204 len: 168 time: 1.2197440 Dec 21 04:09:58.519857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:58.529442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1407643152'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:58.564280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f387f8-08b5-4790-99f2-28e27ec535d7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=6441ede8-4262-4240-b987-6c0f5323256c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:58.600179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Port': ['ID=cc6a3fe8-0342-475f-805f-58f4b4b35e8e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:58.611017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Checking segment: {'id': '06e6d928-c44f-4bed-bf95-77f94fe55955', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'aedbd054-3efa-4080-b323-dcf03b334254'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:09:58.611379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network hostable DHCP agents. Network: aedbd054-3efa-4080-b323-dcf03b334254, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:09:58.637425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:58.643609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.683247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:09:58.697775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.698445 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment 068dda3c-cd2b-40df-bcf6-f8e4a9c86735 of type vlan for network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 Dec 21 04:09:58.745120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.757407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network aedbd054-3efa-4080-b323-dcf03b334254 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:09:58.819669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Made reservation on behalf of 3484fe5a05934f988251baa6c81d9a66 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:58.823382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.891198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, aedbd054-3efa-4080-b323-dcf03b334254) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:58.901754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:58.908802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:58.911907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1627142-d42b-427b-8416-8aa6e21f7b7e None None] Network aedbd054-3efa-4080-b323-dcf03b334254 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:09:58.914556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:58.915398 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.975571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:58.979854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Allocated IP 172.20.0.2 (203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a/944187b7-8f03-4a9a-9440-b75bba35be80/69fe4419-8e4e-4a92-a3ea-0f43538b9a08) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:09:58.986713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:58.987608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:59.073789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=c3e2f2c4-c736-476f-80e2-9d32c0f189f5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:59.086185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:09:59.102267 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-89a544e3-3520-4ed4-9a18-fa868b22b485 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 2.6149037 Dec 21 04:09:59.102766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:59.195607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3ad12b9-6447-463f-805b-d6d828719f1e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:59.203613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3ad12b9-6447-463f-805b-d6d828719f1e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:59.212288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c3ad12b9-6447-463f-805b-d6d828719f1e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.1046855 Dec 21 04:09:59.213622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54760) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:59.222717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-57e500ce-317e-4d76-a82f-933fb68b979a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7011945 Dec 21 04:09:59.224937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54762) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:09:59.230377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:59.249387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:59.307485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f4acf6ab-9e61-40e1-b118-9d33b801e6a4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:09:59.348618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f4acf6ab-9e61-40e1-b118-9d33b801e6a4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:09:59.349185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f4acf6ab-9e61-40e1-b118-9d33b801e6a4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:09:59.419820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:59.467742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:09:59.472379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:09:59.479497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:09:59.506731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4311a9f4-e8fe-4839-aa49-1c2d88fb9c8d req-5d51caaf-5dec-4a2c-9322-6a51d611cb19 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:59.508420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4311a9f4-e8fe-4839-aa49-1c2d88fb9c8d req-5d51caaf-5dec-4a2c-9322-6a51d611cb19 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 931 time: 0.1201203 Dec 21 04:09:59.520209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Pushing event updated for resources: {'Port': ['ID=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:09:59.546763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:09:59.547424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:59.552808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Deleting port be4a00e0-3ada-462d-ade8-0efc1207af93 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:09:59.553225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:59.588383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:09:59.591919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:09:59.639944 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-79148e1e-93a2-4957-879c-01f40c168db6 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3436568 Dec 21 04:09:59.668463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4311a9f4-e8fe-4839-aa49-1c2d88fb9c8d req-2a372633-e529-42a9-ac37-dc5f6f69f81d tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1485083 Dec 21 04:09:59.672870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Request body: {'port': {'device_id': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:09:59.749062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.065374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:10:00.074402 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.091399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Transition to ACTIVE for port object 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:10:00.116877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.138745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Calling delete_port for be4a00e0-3ada-462d-ade8-0efc1207af93 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:00.187156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.249492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Pushing event updated for resources: {'Port': ['ID=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:00.377087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Attempting to bind port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:00.377730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Attempting to bind port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'be357cea-d63a-4916-a268-77c501ae12fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:00.378132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Attempting to bind port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 on network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:00.383503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 on network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:10:00.383909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Attempting to bind port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 on network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:00.389150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:00.389718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Checking segment: {'id': 'be357cea-d63a-4916-a268-77c501ae12fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:00.393423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Bound using segment: {'id': 'be357cea-d63a-4916-a268-77c501ae12fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:00.393423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Bound port: 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'be357cea-d63a-4916-a268-77c501ae12fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:00.393423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.420262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.458580 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.461094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Port': ['ID=be4a00e0-3ada-462d-ade8-0efc1207af93,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:00.465571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] For port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:00.469049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] For port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,segment=NetworkSegment(be357cea-d63a-4916-a268-77c501ae12fe),segment_id=be357cea-d63a-4916-a268-77c501ae12fe)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:00.498045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.501319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e112e55a-0337-4b3b-889e-a18cf049f17e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/ports/be4a00e0-3ada-462d-ade8-0efc1207af93 HTTP/1.1" status: 204 len: 168 time: 1.2774417 Dec 21 04:10:00.504530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54784) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:00.538470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=aa3235bc-318f-4bca-946f-4446aee8c4c4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:00.550314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': '068dda3c-cd2b-40df-bcf6-f8e4a9c86735', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:00.550977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: c3e2f2c4-c736-476f-80e2-9d32c0f189f5, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:00.604438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Deleting port cc6a3fe8-0342-475f-805f-58f4b4b35e8e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:00.604898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.610834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.642979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:00.829034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6c57e0-ecda-46ee-854c-b534e178065d req-a09000ee-2eba-4d4f-a6dd-5615eae86b63 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:00.837375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f6c57e0-ecda-46ee-854c-b534e178065d req-a09000ee-2eba-4d4f-a6dd-5615eae86b63 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 943 time: 0.0749700 Dec 21 04:10:00.840358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, c3e2f2c4-c736-476f-80e2-9d32c0f189f5) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:00.847921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:00.848532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:00.849133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce15733b-38c0-4495-bcd3-cd7dd14d72da None None] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:00.920294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f6c57e0-ecda-46ee-854c-b534e178065d req-7473fa5e-d514-49a1-be21-cfbed98db065 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811203 Dec 21 04:10:00.993274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-c3e2f2c4-c736-476f-80e2-9d32c0f189f5', 'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': 'aa3235bc-318f-4bca-946f-4446aee8c4c4'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:00.994239 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.006341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a4cbb993-b853-4706-8146-c034196a74c4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7802403 Dec 21 04:10:01.009664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:01.015806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5', 'name': 'tempest-PortsIpV6TestJSON-901700678', 'fixed_ips': [{'subnet_id': 'aa3235bc-318f-4bca-946f-4446aee8c4c4', 'ip_address': '2001:db8::10'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:01.118333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:01.118980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.120334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] 10.222.0.54 "PUT /v2.0/ports/69fe4419-8e4e-4a92-a3ea-0f43538b9a08 HTTP/1.1" status: 200 len: 1092 time: 1.4647357 Dec 21 04:10:01.120815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'tag': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:01.124622 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a3756cd-390f-421f-ab87-413acb8ede3a" -d '{"events": [{"name": "network-changed", "server_uuid": "eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9", "tag": "69fe4419-8e4e-4a92-a3ea-0f43538b9a08"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:01.188377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32639f83-15a1-48c2-b7da-5831825c54fb service neutron] Pushing event updated for resources: {'Port': ['ID=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:01.201984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Allocated IP 2001:db8::2 (c3e2f2c4-c736-476f-80e2-9d32c0f189f5/aa3235bc-318f-4bca-946f-4446aee8c4c4/30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:01.202201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.220269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Calling delete_port for cc6a3fe8-0342-475f-805f-58f4b4b35e8e owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:01.223192 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b822b03-53fe-460f-a846-37162c362375 x-openstack-request-id: req-5b822b03-53fe-460f-a846-37162c362375 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:01.223427 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9", "tag": "69fe4419-8e4e-4a92-a3ea-0f43538b9a08", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:01.223689 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5b822b03-53fe-460f-a846-37162c362375 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:01.224085 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'tag': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08', 'status': 'completed', 'code': 200} Dec 21 04:10:01.351425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3756cd-390f-421f-ab87-413acb8ede3a req-97d3bf60-78d6-4dc7-9a52-e581c267ad39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:01.352865 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a3756cd-390f-421f-ab87-413acb8ede3a req-97d3bf60-78d6-4dc7-9a52-e581c267ad39 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3484fe5a05934f988251baa6c81d9a66&device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 1095 time: 0.0835400 Dec 21 04:10:01.374505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:01.393211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.482391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3756cd-390f-421f-ab87-413acb8ede3a req-b4e9f992-1398-4fc3-abfc-6f8b02872ca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:01.483911 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a3756cd-390f-421f-ab87-413acb8ede3a req-b4e9f992-1398-4fc3-abfc-6f8b02872ca6 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=3484fe5a05934f988251baa6c81d9a66&shared=False HTTP/1.1" status: 200 len: 922 time: 0.1155632 Dec 21 04:10:01.496557 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.515665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 2489e678-bbe5-42bb-aa12-cfadd65e9306 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:10:01.554804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.598110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.631943 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.637300 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/ports/cc6a3fe8-0342-475f-805f-58f4b4b35e8e HTTP/1.1" status: 204 len: 168 time: 1.1315565 Dec 21 04:10:01.643809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54816) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:01.649090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5b58f3-d7dc-42af-9021-a8cbecb50ce0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Port': ['ID=cc6a3fe8-0342-475f-805f-58f4b4b35e8e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:01.694805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Pushing event updated for resources: {'Port': ['ID=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:01.706278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-014ddcc1-5f1f-4d7c-8789-e7b3c18ecb26 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0611513 Dec 21 04:10:01.706945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54820) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:01.716421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-2107920917'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:01.723434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:01.727458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:01.737325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3756cd-390f-421f-ab87-413acb8ede3a req-17924276-44f1-4a79-9e7e-a71f394cfd4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:01.739529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:01.742257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a3756cd-390f-421f-ab87-413acb8ede3a req-17924276-44f1-4a79-9e7e-a71f394cfd4d service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2511740 Dec 21 04:10:01.823630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:01.827667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.839847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Attempting to bind port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:01.840379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Attempting to bind port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '068dda3c-cd2b-40df-bcf6-f8e4a9c86735', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:01.840855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Attempting to bind port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 on network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:01.846996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:01.847551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Checking segment: {'id': '068dda3c-cd2b-40df-bcf6-f8e4a9c86735', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:01.848110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.849208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Bound using segment: {'id': '068dda3c-cd2b-40df-bcf6-f8e4a9c86735', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:01.850373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Bound port: 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '068dda3c-cd2b-40df-bcf6-f8e4a9c86735', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:01.850866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.851535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::10 (c3e2f2c4-c736-476f-80e2-9d32c0f189f5/aa3235bc-318f-4bca-946f-4446aee8c4c4/2489e678-bbe5-42bb-aa12-cfadd65e9306) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:01.872288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:01.884277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-73c0e3fb-0a90-445b-bdd3-a60bbb4909f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:01.886731 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-73c0e3fb-0a90-445b-bdd3-a60bbb4909f5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3484fe5a05934f988251baa6c81d9a66&device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 1095 time: 0.0592899 Dec 21 04:10:01.895371 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.896083 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Added segment fea5dd56-cedb-4eae-ad4e-43e176a5f134 of type vlan for network 089af421-e3ea-4a66-9fc9-04c815d1a924 Dec 21 04:10:01.960329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] For port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:01.965381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] For port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,segment=NetworkSegment(068dda3c-cd2b-40df-bcf6-f8e4a9c86735),segment_id=068dda3c-cd2b-40df-bcf6-f8e4a9c86735)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:01.971254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:01.978112 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-eb200d5c-34ca-42c8-ae1c-cec0b0fe6ace service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=69fe4419-8e4e-4a92-a3ea-0f43538b9a08 HTTP/1.1" status: 200 len: 217 time: 0.0776186 Dec 21 04:10:02.034361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-c0224cdc-5823-4c7c-9033-7e7f8f6493dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:02.035901 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-c0224cdc-5823-4c7c-9033-7e7f8f6493dc service neutron] 10.222.0.54 "GET /v2.0/subnets?id=944187b7-8f03-4a9a-9440-b75bba35be80 HTTP/1.1" status: 200 len: 861 time: 0.0495896 Dec 21 04:10:02.069816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-17247694-63cf-4f5e-9fbf-77916d2d8eaa service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252838 Dec 21 04:10:02.093719 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.109585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.118348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8191e5da-b6bb-4c46-a18d-483ca5e83c11 req-46a8b798-9f50-4d4c-8004-093e4f90aafe tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:02.119980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8191e5da-b6bb-4c46-a18d-483ca5e83c11 req-46a8b798-9f50-4d4c-8004-093e4f90aafe tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 943 time: 0.0966401 Dec 21 04:10:02.177870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c512e9f-c2c0-4ef3-b467-4d4bb3b511cc None None] Pushing event updated for resources: {'Port': ['ID=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:02.196135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8191e5da-b6bb-4c46-a18d-483ca5e83c11 req-cb6c5066-0177-42dc-bb2c-623619c911f9 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662761 Dec 21 04:10:02.198799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.209931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:02.209931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.225874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-763119c4-c109-4f0d-a9aa-d15a078bd655 service neutron] 10.222.0.54 "GET /v2.0/networks/203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1481586 Dec 21 04:10:02.328139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.6156073 Dec 21 04:10:02.332541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.338754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54834) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:02.348178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-727577810'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:02.356867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f0ab4f5-555b-44b4-a2eb-381a8501f8e0 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Network': ['ID=089af421-e3ea-4a66-9fc9-04c815d1a924,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:02.363554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5bd9516b-d9e9-43f6-99eb-6539b7b43d6f req-85179036-4b89-45d8-b4e1-63a400b10981 service neutron] 10.222.0.54 "GET /v2.0/networks/203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1299186 Dec 21 04:10:02.368366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 089af421-e3ea-4a66-9fc9-04c815d1a924 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:02.421933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:02.426455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:02.433715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:02.440808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:02.441672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.482297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=2489e678-bbe5-42bb-aa12-cfadd65e9306,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:02.570088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c82c11-e093-49a9-b63b-faedfdbb2de7 req-604d7589-4736-4a51-ba81-9351024c348d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:02.580426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3c82c11-e093-49a9-b63b-faedfdbb2de7 req-604d7589-4736-4a51-ba81-9351024c348d tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.0721245 Dec 21 04:10:02.637902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3c82c11-e093-49a9-b63b-faedfdbb2de7 req-79a08124-db64-4e2a-8120-1762b942977b tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515931 Dec 21 04:10:02.657885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eeb43038-9a98-4eb8-bf66-af81390b6de6 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.6470096 Dec 21 04:10:02.660414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54842) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:02.665804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': 'c3e2f2c4-c736-476f-80e2-9d32c0f189f5', 'name': 'tempest-PortsIpV6TestJSON-1466061227', 'fixed_ips': [{'subnet_id': 'aa3235bc-318f-4bca-946f-4446aee8c4c4', 'ip_address': '2001:db8::f'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:02.681513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:02.684965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.754924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] vlan segment allocate from pool success with {'vlan_id': 114, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:02.795400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.795763 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Added segment f0551518-58bf-46b9-b32b-af151318e4dd of type vlan for network 6b535c76-b097-4817-9857-90be79b81415 Dec 21 04:10:02.864468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:02.980355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:02.986632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.005425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 87c92a28-a60b-48a0-8c9f-ed168aa648d5 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:10:03.011887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.018915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:03.019638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.136796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Network': ['ID=6b535c76-b097-4817-9857-90be79b81415,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:03.151120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6b535c76-b097-4817-9857-90be79b81415 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:03.210451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5329cb17-2236-4040-b2ac-767ff5a1336e tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.8682697 Dec 21 04:10:03.336972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::f (c3e2f2c4-c736-476f-80e2-9d32c0f189f5/aa3235bc-318f-4bca-946f-4446aee8c4c4/87c92a28-a60b-48a0-8c9f-ed168aa648d5) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:03.360940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54854) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:03.368680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'subnets': [{'network_id': '089af421-e3ea-4a66-9fc9-04c815d1a924', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1047244122', 'ip_version': 4}, {'network_id': '6b535c76-b097-4817-9857-90be79b81415', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:03.369361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'subnet': {'network_id': '089af421-e3ea-4a66-9fc9-04c815d1a924', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1047244122', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:03.370147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Request body: {'subnet': {'network_id': '6b535c76-b097-4817-9857-90be79b81415', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:03.429252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:03.533433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:03.536710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.573829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8a33b87-ced7-4903-8248-e5a313340efe None None] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:03.627424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feafb188-d73d-46e6-a0b0-96fa6304a923 req-91aff58b-ad63-487d-ad5b-267ecfd26e1b tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:03.629599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feafb188-d73d-46e6-a0b0-96fa6304a923 req-91aff58b-ad63-487d-ad5b-267ecfd26e1b tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 943 time: 0.2330706 Dec 21 04:10:03.705980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dd99eff6-5f63-4fd9-8262-b4064ebdf145 None None] Provisioning complete for port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:03.705980 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd99eff6-5f63-4fd9-8262-b4064ebdf145 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.706183 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.833056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feafb188-d73d-46e6-a0b0-96fa6304a923 req-1b4ce056-52de-4241-b24d-1cc0afb6cdc5 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1936018 Dec 21 04:10:03.866594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Made reservation on behalf of 40bea0be88dc4ed2ae1e446e887bdfa1 for: {'subnet': 2} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:03.869424 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.871649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.871990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.901349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:03.936304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,segment=NetworkSegment(068dda3c-cd2b-40df-bcf6-f8e4a9c86735),segment_id=068dda3c-cd2b-40df-bcf6-f8e4a9c86735)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:03.946848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd99eff6-5f63-4fd9-8262-b4064ebdf145 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.020907 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.081289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:04.086458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=87c92a28-a60b-48a0-8c9f-ed168aa648d5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:04.097408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:04.105287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:04.118580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.119695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.126613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-dd99eff6-5f63-4fd9-8262-b4064ebdf145 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:04.127267 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-dd99eff6-5f63-4fd9-8262-b4064ebdf145 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:04.190557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49abedab-2c85-4eea-aceb-fa2a86fcf00b req-757c2070-90a2-4dfd-ac2a-e89335b38032 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.197373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49abedab-2c85-4eea-aceb-fa2a86fcf00b req-757c2070-90a2-4dfd-ac2a-e89335b38032 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.3866100 Dec 21 04:10:04.240671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:04.281259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49abedab-2c85-4eea-aceb-fa2a86fcf00b req-dac4bb69-59a4-4132-ba36-eebd84525039 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0801718 Dec 21 04:10:04.289314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-82361be4-78dc-4a10-9d05-a2a0ad863623 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.6278811 Dec 21 04:10:04.301338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54868) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:04.372695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8c5fc40-204a-4739-aab0-38597e1daeb2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.377807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8c5fc40-204a-4739-aab0-38597e1daeb2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 927 time: 0.0868096 Dec 21 04:10:04.378597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:04.481870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:10:04.485595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39353cee-4273-4257-b7a6-3570fe5e7a15 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.493983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39353cee-4273-4257-b7a6-3570fe5e7a15 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.501288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39353cee-4273-4257-b7a6-3570fe5e7a15 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.519370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-39353cee-4273-4257-b7a6-3570fe5e7a15 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2390 time: 0.1389983 Dec 21 04:10:04.522187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54876) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:04.702186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-4fdd1c9b-dd7f-4a08-87d4-a280c99080e5 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:04.704475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-4fdd1c9b-dd7f-4a08-87d4-a280c99080e5 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.1249762 Dec 21 04:10:04.712517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 87c92a28-a60b-48a0-8c9f-ed168aa648d5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:04.713200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.788743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.849908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,segment=NetworkSegment(be357cea-d63a-4916-a268-77c501ae12fe),segment_id=be357cea-d63a-4916-a268-77c501ae12fe)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:04.865200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08', 'network_id': '203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a', 'port_id': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08', 'mac_address': 'fa:16:3e:8d:ac:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '944187b7-8f03-4a9a-9440-b75bba35be80', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:10:04.893675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Subnet': ['ID=745e5559-b434-41a1-a9bf-c2ffb0fe4227,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:04.906910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Checking segment: {'id': 'fea5dd56-cedb-4eae-ad4e-43e176a5f134', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '089af421-e3ea-4a66-9fc9-04c815d1a924'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:04.908871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network hostable DHCP agents. Network: 089af421-e3ea-4a66-9fc9-04c815d1a924, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:04.930061 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.957341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:10:04.973638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ba8264e4-0e33-45d2-ab06-9332643fd22c None None] Provisioning complete for port 2489e678-bbe5-42bb-aa12-cfadd65e9306 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:04.973638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba8264e4-0e33-45d2-ab06-9332643fd22c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:04.991725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network 089af421-e3ea-4a66-9fc9-04c815d1a924 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:05.003892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.013285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,segment=NetworkSegment(be357cea-d63a-4916-a268-77c501ae12fe),segment_id=be357cea-d63a-4916-a268-77c501ae12fe)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:05.036522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 87c92a28-a60b-48a0-8c9f-ed168aa648d5 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:05.044524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ba8264e4-0e33-45d2-ab06-9332643fd22c None None] Port 2489e678-bbe5-42bb-aa12-cfadd65e9306 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:05.066445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ba8264e4-0e33-45d2-ab06-9332643fd22c None None] Provisioning complete for port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:05.067156 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ba8264e4-0e33-45d2-ab06-9332643fd22c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.077036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 089af421-e3ea-4a66-9fc9-04c815d1a924) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:05.088353 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.145945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19872c04-53a1-4325-85c2-d299004d77d7 None None] Network 089af421-e3ea-4a66-9fc9-04c815d1a924 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:05.216507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event updated for resources: {'Subnet': ['ID=c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:05.220544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144dab14-0abc-498e-9b8e-e3dc1b217403 req-6e5fa42a-17b8-4f8a-907a-e8a13fe319dc tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.225002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Checking segment: {'id': 'f0551518-58bf-46b9-b32b-af151318e4dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '6b535c76-b097-4817-9857-90be79b81415'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:05.225002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network hostable DHCP agents. Network: 6b535c76-b097-4817-9857-90be79b81415, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:05.231194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-144dab14-0abc-498e-9b8e-e3dc1b217403 req-6e5fa42a-17b8-4f8a-907a-e8a13fe319dc tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 943 time: 0.2963555 Dec 21 04:10:05.270450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Deleting port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:05.270807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.288696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.295102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:05.340555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Network 6b535c76-b097-4817-9857-90be79b81415 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:05.416210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-144dab14-0abc-498e-9b8e-e3dc1b217403 req-eded90b2-a52d-47b0-a729-7570c380b686 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1841254 Dec 21 04:10:05.446481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6b535c76-b097-4817-9857-90be79b81415) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:05.455352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.455352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.455992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.499435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] For port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:05.499849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.529712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce5a9c1d-33db-4a50-9065-d55b523369c2 None None] Network 6b535c76-b097-4817-9857-90be79b81415 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:05.541526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-519a664e-9388-4622-8521-ebea4e3a553b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-089af421-e3ea-4a66-9fc9-04c815d1a924', 'network_id': '089af421-e3ea-4a66-9fc9-04c815d1a924', 'project_id': '40bea0be88dc4ed2ae1e446e887bdfa1', 'fixed_ips': [{'subnet_id': '745e5559-b434-41a1-a9bf-c2ffb0fe4227'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:05.542646 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-519a664e-9388-4622-8521-ebea4e3a553b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.549206 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d217bd8-9698-4b78-8a6d-fcd9d1d78df9 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 2.1848381 Dec 21 04:10:05.551157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:05.567005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077f9509-d770-4c10-b493-8ea0bf10d32b req-eb4608fc-ad71-4f50-8d20-71cac91e5129 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.568591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-077f9509-d770-4c10-b493-8ea0bf10d32b req-eb4608fc-ad71-4f50-8d20-71cac91e5129 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 946 time: 0.1828499 Dec 21 04:10:05.602635 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.640479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['69fe4419-8e4e-4a92-a3ea-0f43538b9a08'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:10:05.655420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=87c92a28-a60b-48a0-8c9f-ed168aa648d5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:05.666442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b86f001-7267-4632-9806-3c6c3e9b0bbb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.669166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b86f001-7267-4632-9806-3c6c3e9b0bbb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.670703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b86f001-7267-4632-9806-3c6c3e9b0bbb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:05.676538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b86f001-7267-4632-9806-3c6c3e9b0bbb tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.1233702 Dec 21 04:10:05.676844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:05.750569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:05.758653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.760946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Deleting subnet 745e5559-b434-41a1-a9bf-c2ffb0fe4227 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:05.762430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-da416ab2-91f6-4902-8407-50f7056f736b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/87c92a28-a60b-48a0-8c9f-ed168aa648d5 HTTP/1.1" status: 204 len: 168 time: 1.2369654 Dec 21 04:10:05.768807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:05.779904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.792335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-077f9509-d770-4c10-b493-8ea0bf10d32b req-158a2624-965c-44c0-9381-ed6ed20ff068 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups?id=252634e5-d5f3-4a6f-8e8b-29b829e821f9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2115090 Dec 21 04:10:05.812379 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4cbb91a-6051-4af0-bd1f-8695c4a84c7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:10:05.814138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e4cbb91a-6051-4af0-bd1f-8695c4a84c7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/87c92a28-a60b-48a0-8c9f-ed168aa648d5 HTTP/1.1" status: 404 len: 333 time: 0.0426214 Dec 21 04:10:05.816842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54906) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:05.882326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a090a89-e146-41b8-8898-7eebbbafb270 None None] Could not find standard attr ID for object 87c92a28-a60b-48a0-8c9f-ed168aa648d5. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:10:05.894972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.902392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:05.902773 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.914791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.915260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:05.915656 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Floating IP 9e49db25-d7c7-4e17-99ca-7b693447a766 disassociated. External IP: 172.25.5.88, port: 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd. Dec 21 04:10:05.916070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Calling delete_port for 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:05.952960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.000042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7349bd10-d8fc-4e9a-ac6c-e3072baf49fb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-6b535c76-b097-4817-9857-90be79b81415', 'network_id': '6b535c76-b097-4817-9857-90be79b81415', 'project_id': '40bea0be88dc4ed2ae1e446e887bdfa1', 'fixed_ips': [{'subnet_id': 'c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:06.000042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7349bd10-d8fc-4e9a-ac6c-e3072baf49fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.083406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.097710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.103669 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/subnets/745e5559-b434-41a1-a9bf-c2ffb0fe4227 HTTP/1.1" status: 204 len: 168 time: 0.4231861 Dec 21 04:10:06.104888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:06.175452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2555584-243d-4cd7-b810-0fd6ff27c840 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Subnet': ['ID=745e5559-b434-41a1-a9bf-c2ffb0fe4227,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:06.198218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 2489e678-bbe5-42bb-aa12-cfadd65e9306 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:06.198602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server [None req-519a664e-9388-4622-8521-ebea4e3a553b None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 745e5559-b434-41a1-a9bf-c2ffb0fe4227: This subnet is being modified by another concurrent operation. Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:10:06.218021 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1463, in create_port_db Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise exception Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 745e5559-b434-41a1-a9bf-c2ffb0fe4227: This subnet is being modified by another concurrent operation. Dec 21 04:10:06.228699 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Dec 21 04:10:06.232965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Deleting subnet c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:06.232965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.289615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e76ffb4-8d44-41a4-9cab-858eef0de18b None None] Network 089af421-e3ea-4a66-9fc9-04c815d1a924 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:06.292227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.316834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.356818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event deleted for resources: {'Port': ['ID=89f97b5c-7b23-47f9-ab5f-a9e7349fdacd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:06.380177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.397046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.445529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 2489e678-bbe5-42bb-aa12-cfadd65e9306 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:06.535140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server [None req-7349bd10-d8fc-4e9a-ac6c-e3072baf49fb None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19: This subnet is being modified by another concurrent operation. Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:10:06.565158 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1463, in create_port_db Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise exception Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19: This subnet is being modified by another concurrent operation. Dec 21 04:10:06.571560 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Dec 21 04:10:06.582610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Subnet': ['ID=c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:06.591801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4651d51b-4487-4540-a431-f3c1e5c8bcad None None] Network 6b535c76-b097-4817-9857-90be79b81415 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:06.605101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.619464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a92cdfcc-1d88-4aab-b755-6b2ad8711d5d tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/subnets/c1fd9d7e-c2d3-4012-9f58-dd6bbac84c19 HTTP/1.1" status: 204 len: 168 time: 0.4855924 Dec 21 04:10:06.619603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54926) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:06.685601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049288d6-4dbe-4728-8ac7-bbfc43197093 req-7e7c1137-3f36-456c-b62e-a6cf12eeb038 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:06.687583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-049288d6-4dbe-4728-8ac7-bbfc43197093 req-7e7c1137-3f36-456c-b62e-a6cf12eeb038 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 944 time: 0.1448824 Dec 21 04:10:06.696221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:10:06.697307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d1f46d6-bd07-47be-963e-c39f2ce0c9ec tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:06.698846 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d1f46d6-bd07-47be-963e-c39f2ce0c9ec tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0783579 Dec 21 04:10:06.702754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54930) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:06.811138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.812300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-049288d6-4dbe-4728-8ac7-bbfc43197093 req-ba7a4958-130d-4253-9a02-30c5181cb78d tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1180990 Dec 21 04:10:06.817494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.901958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=2489e678-bbe5-42bb-aa12-cfadd65e9306,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:06.943191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:06.947641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eaf94908-fb93-4271-9989-dab5585ff12e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/2489e678-bbe5-42bb-aa12-cfadd65e9306 HTTP/1.1" status: 204 len: 168 time: 1.1298447 Dec 21 04:10:06.961058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54936) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:07.008083 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f2cd6ff-0d3e-4262-8dff-6fb4100af48a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:10:07.009545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5f2cd6ff-0d3e-4262-8dff-6fb4100af48a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/2489e678-bbe5-42bb-aa12-cfadd65e9306 HTTP/1.1" status: 404 len: 333 time: 0.0468926 Dec 21 04:10:07.024325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:10:07.025931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:07.028318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a106a4ab-19c4-44de-ad45-8730a0f22e06 req-aa6b8778-9f85-459a-bfa2-5382964629a0 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 210 time: 0.0682924 Dec 21 04:10:07.044788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:10:07.069033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:07.069985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.070750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.108211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b535c76-b097-4817-9857-90be79b81415']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.126331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f0551518-58bf-46b9-b32b-af151318e4dd') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.129359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f0551518-58bf-46b9-b32b-af151318e4dd') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.134405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] No DVR routers for this DVR port 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:07.137415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.140784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07eff433-93b3-4690-8306-6527a9ab93f5 req-03c72136-90b4-4eae-a11f-36ad16786cdf tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.31 "DELETE /v2.0/ports/89f97b5c-7b23-47f9-ab5f-a9e7349fdacd HTTP/1.1" status: 204 len: 173 time: 2.4246347 Dec 21 04:10:07.143955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'name': 'network-vif-deleted', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:07.146482 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-206a7a3b-81e6-4b70-816f-36a4acc1c398" -d '{"events": [{"server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "name": "network-vif-deleted", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:07.157733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.172965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet aa3235bc-318f-4bca-946f-4446aee8c4c4 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:07.186642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.195961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:07.196467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:07.200710 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:07.205460 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.240158 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-765647a4-88ee-4d25-b1eb-a41c01f379c0 x-openstack-request-id: req-765647a4-88ee-4d25-b1eb-a41c01f379c0 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:07.240459 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2d0a760d-e1b6-47c3-afb2-545dfc775048", "name": "network-vif-deleted", "tag": "89f97b5c-7b23-47f9-ab5f-a9e7349fdacd", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:07.240718 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-765647a4-88ee-4d25-b1eb-a41c01f379c0 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:07.241120 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d0a760d-e1b6-47c3-afb2-545dfc775048', 'name': 'network-vif-deleted', 'tag': '89f97b5c-7b23-47f9-ab5f-a9e7349fdacd', 'status': 'completed', 'code': 200} Dec 21 04:10:07.261156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74f489df-fc6a-47dd-a84f-b10f441522db None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:07.271088 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.364810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:10:07.369127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.376694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.379883 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/networks/6b535c76-b097-4817-9857-90be79b81415 HTTP/1.1" status: 204 len: 168 time: 0.6761560 Dec 21 04:10:07.382336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54948) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:07.439807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6af551e5-a52f-4e9b-b813-e6fdbf9622f2 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Network': ['ID=6b535c76-b097-4817-9857-90be79b81415,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:07.474995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.477604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.626263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74f489df-fc6a-47dd-a84f-b10f441522db None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:07.630721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.663330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['089af421-e3ea-4a66-9fc9-04c815d1a924']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.680935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fea5dd56-cedb-4eae-ad4e-43e176a5f134') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.682468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fea5dd56-cedb-4eae-ad4e-43e176a5f134') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.695142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.714362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.722276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:07.723056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:07.756022 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:07.787447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.807841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.831828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=aa3235bc-318f-4bca-946f-4446aee8c4c4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:07.844895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.846489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:10:07.850400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:07.850745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-00c2c8ef-1598-4dc7-9c8f-ae86ec3b22d4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/aa3235bc-318f-4bca-946f-4446aee8c4c4 HTTP/1.1" status: 204 len: 168 time: 0.8216002 Dec 21 04:10:07.867348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:07.868274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:07.901235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.941599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:07.947848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/networks/089af421-e3ea-4a66-9fc9-04c815d1a924 HTTP/1.1" status: 204 len: 168 time: 0.5641170 Dec 21 04:10:07.950290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e793bcb-be03-4116-9f32-36cb3a0b03b5 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Network': ['ID=089af421-e3ea-4a66-9fc9-04c815d1a924,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:07.953687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54962) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:08.029463 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.039042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:10:08.092721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.174387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:08.175518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.289693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ffa968c-7a96-4ae5-ab17-c9ae233d8105 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:08.298185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,segment=NetworkSegment(068dda3c-cd2b-40df-bcf6-f8e4a9c86735),segment_id=068dda3c-cd2b-40df-bcf6-f8e4a9c86735)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:08.298854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.315775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:08.477635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.524832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:08.534023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:08.678366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:08.732065 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.746045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ffa968c-7a96-4ae5-ab17-c9ae233d8105 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:08.765314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d794eb9-bc4e-4e40-8ebf-09563fdf3e8f req-aae83b9a-a174-45f8-9455-2544f5cad2f1 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/ports?device_id=2d0a760d-e1b6-47c3-afb2-545dfc775048 HTTP/1.1" status: 200 len: 210 time: 0.0431421 Dec 21 04:10:08.773344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3e2f2c4-c736-476f-80e2-9d32c0f189f5']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.786922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '068dda3c-cd2b-40df-bcf6-f8e4a9c86735') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.787259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '068dda3c-cd2b-40df-bcf6-f8e4a9c86735') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.802890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.817972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.824453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 102 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:08.824961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:08.828271 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:08.856463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:08.862062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:10:08.867868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.871577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea93129-f809-4fd2-a9f8-e5feb2bd86e6 req-e88d42d1-ba04-4230-908b-df9863af8807 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:08.873196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aea93129-f809-4fd2-a9f8-e5feb2bd86e6 req-e88d42d1-ba04-4230-908b-df9863af8807 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 944 time: 0.9241972 Dec 21 04:10:08.875952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.903219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:08.903593 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.905816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b57f4fe-4826-4bb8-8c5e-06381c25f512 None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:02:17Z', 'revision_number': 4, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ffe8e39b-678a-4e86-878d-6207b5a5bcfd', 'name': '', 'network_id': 'e94ae2ca-4e3f-4500-90fd-ec494b399bda', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'mac_address': 'fa:16:3e:45:0f:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_interface', 'standard_attr_id': 2226, 'fixed_ips': [{'subnet_id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:15Z', 'updated_at': '2021-12-21T04:02:21Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'subnets': [{'id': 'a102645d-c1b2-4824-aff9-56e0558bab2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:10:08.931953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aedbd054-3efa-4080-b323-dcf03b334254']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.949631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '06e6d928-c44f-4bed-bf95-77f94fe55955') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.950920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '06e6d928-c44f-4bed-bf95-77f94fe55955') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:08.970392 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.986249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:08.994314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:08.994682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 89f97b5c-7b23-47f9-ab5f-a9e7349fdacd not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:08.995431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.004528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/c3e2f2c4-c736-476f-80e2-9d32c0f189f5 HTTP/1.1" status: 204 len: 168 time: 1.1529021 Dec 21 04:10:09.019282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aea93129-f809-4fd2-a9f8-e5feb2bd86e6 req-2f101da2-93db-4069-8a0e-b20301a98526 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1338539 Dec 21 04:10:09.023103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54978) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:09.048320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-635798489'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:09.069431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.079120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:09.080662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:09.089039 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:09.097064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5021e3d8-70ce-4a6e-8ba7-3b5fea55c3a1 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=c3e2f2c4-c736-476f-80e2-9d32c0f189f5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:09.256605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.265597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:09.270334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.293318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.305986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.309534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/networks/aedbd054-3efa-4080-b323-dcf03b334254 HTTP/1.1" status: 204 len: 168 time: 1.3564785 Dec 21 04:10:09.312288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54984) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:09.325024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,segment=NetworkSegment(be357cea-d63a-4916-a268-77c501ae12fe),segment_id=be357cea-d63a-4916-a268-77c501ae12fe)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:09.327037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:09.329326 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5835e86-93b1-438b-b78a-851db1c0a72e" -d '{"events": [{"server_uuid": "eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9", "name": "network-vif-plugged", "status": "completed", "tag": "69fe4419-8e4e-4a92-a3ea-0f43538b9a08"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:09.330180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:09.354972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.354972 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Added segment ee694074-f042-49d9-a381-0d8c7d82a493 of type vlan for network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 Dec 21 04:10:09.397627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.413199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.445325 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec29c21a-e1f1-4ee4-8ca2-699d39024605 None None] New status for floating IP 9e49db25-d7c7-4e17-99ca-7b693447a766: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:10:09.452328 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.470492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f613151-b008-4afb-a511-c95cb3882aa8 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Network': ['ID=aedbd054-3efa-4080-b323-dcf03b334254,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:09.500284 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-463e11b7-41f8-4994-a34e-a2c6430b034e x-openstack-request-id: req-463e11b7-41f8-4994-a34e-a2c6430b034e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:09.501110 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9", "name": "network-vif-plugged", "status": "completed", "tag": "69fe4419-8e4e-4a92-a3ea-0f43538b9a08", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:09.501911 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-463e11b7-41f8-4994-a34e-a2c6430b034e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:09.502993 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08', 'code': 200} Dec 21 04:10:09.510428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8675ccc6-47f0-481a-ac8f-e1b4db132291 None None] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:09.532941 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.539533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:09.540145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.569876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8675ccc6-47f0-481a-ac8f-e1b4db132291 None None] Network c3e2f2c4-c736-476f-80e2-9d32c0f189f5 could not be found, it might have been deleted concurrently. {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 21 04:10:09.609268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.620717 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:09.647223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f03ff55-a4ee-4413-8bb2-5409055b23ea']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:09.651957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faaa8534-15f3-4897-9f10-408f6db3ff4c req-55548929-2250-4065-9ef0-e6b589919ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:09.653962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-faaa8534-15f3-4897-9f10-408f6db3ff4c req-55548929-2250-4065-9ef0-e6b589919ba4 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 1097 time: 0.1167166 Dec 21 04:10:09.673505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f8b2190d-482c-4ce8-b4cb-1e776b6957aa') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:09.674080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f8b2190d-482c-4ce8-b4cb-1e776b6957aa') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:09.677534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97636402-60e9-4fb8-b862-a3fb32de06fd None None] DHCP port deletion for c3e2f2c4-c736-476f-80e2-9d32c0f189f5 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:09.680548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Network': ['ID=0c678fc3-c405-44cb-ac5c-5bfc4b68adc9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:09.689406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-30d1b5b9-22bc-4a0e-9cbe-f3ccba762a6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.6635475 Dec 21 04:10:09.690387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:09.696899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:09.698525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.740685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:09.757958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.773225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:09.773636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:09.776982 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:09.779786 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-faaa8534-15f3-4897-9f10-408f6db3ff4c req-651361a1-e7da-47cc-a575-17a51e51099c service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164217 Dec 21 04:10:09.971055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55000) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:09.986725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:09.986957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:09.990142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.002317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.005872 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] 10.222.0.18 "DELETE /v2.0/networks/9f03ff55-a4ee-4413-8bb2-5409055b23ea HTTP/1.1" status: 204 len: 168 time: 0.6918499 Dec 21 04:10:10.019252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c75668e-a57e-4d82-a77c-5a91544dc100 tempest-BulkNetworkOpsTest-443167820 tempest-BulkNetworkOpsTest-443167820-project] Pushing event deleted for resources: {'Network': ['ID=9f03ff55-a4ee-4413-8bb2-5409055b23ea,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:10.113807 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-510250a5-2ea8-4788-a4c5-183e935bb963 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.183040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-510250a5-2ea8-4788-a4c5-183e935bb963 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.281721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d814b6e-7817-4447-9d6b-d88d6f025f78 req-1ecc47f5-0c3d-44c3-badb-fc220f19b472 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:10.283263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d814b6e-7817-4447-9d6b-d88d6f025f78 req-1ecc47f5-0c3d-44c3-badb-fc220f19b472 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 945 time: 0.1271317 Dec 21 04:10:10.394218 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d814b6e-7817-4447-9d6b-d88d6f025f78 req-961fa8ee-1b7c-4d55-8a74-809a9e59d436 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1003144 Dec 21 04:10:10.408559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-510250a5-2ea8-4788-a4c5-183e935bb963 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.411710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-510250a5-2ea8-4788-a4c5-183e935bb963 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.415486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-510250a5-2ea8-4788-a4c5-183e935bb963 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "DELETE /v2.0/security-groups/252634e5-d5f3-4a6f-8e8b-29b829e821f9 HTTP/1.1" status: 204 len: 168 time: 0.4409468 Dec 21 04:10:10.415904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:10.427219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510250a5-2ea8-4788-a4c5-183e935bb963 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=252634e5-d5f3-4a6f-8e8b-29b829e821f9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:10.430303 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-5454d5f8-4b86-4c6d-8c3f-95582f9e48ef tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] show failed (client error): The resource could not be found. Dec 21 04:10:10.431430 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5454d5f8-4b86-4c6d-8c3f-95582f9e48ef tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "GET /v2.0/security-groups/252634e5-d5f3-4a6f-8e8b-29b829e821f9 HTTP/1.1" status: 404 len: 347 time: 0.0144477 Dec 21 04:10:10.436772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55014) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:10.501121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.586001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=751ffce1-99da-4983-a5c7-6fe8c9ab2d05,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:10.630272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Checking segment: {'id': 'ee694074-f042-49d9-a381-0d8c7d82a493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:10.630779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network hostable DHCP agents. Network: 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:10.646557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Deleting port aa27223c-c3fa-495c-b0fb-6e52b1154884 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:10.647367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.657408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55020) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:10.711273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:10.778285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.779343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.797948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:10.802247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:10.815486 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.816343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Calling delete_port for aa27223c-c3fa-495c-b0fb-6e52b1154884 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:10.816443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf17dd4a-4806-4c3e-8b32-13a90bfc6a93 None None] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:10.929028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-52200e2d-703f-403f-8a3a-fa140c57261f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2374735 Dec 21 04:10:10.931690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8a4b0465-ed59-463f-8c37-5833febdce2a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=40bea0be88dc4ed2ae1e446e887bdfa1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2732060 Dec 21 04:10:10.932360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55028) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:10.934438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55030) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:10.940594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-0c678fc3-c405-44cb-ac5c-5bfc4b68adc9', 'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': '751ffce1-99da-4983-a5c7-6fe8c9ab2d05'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:10.945282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:10.948459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-1182564784', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:11.028035 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-abd03649-07a3-47e2-8fd8-77778928342f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.061477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-abd03649-07a3-47e2-8fd8-77778928342f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.099711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.101128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.105448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.160595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Allocated IP 2001:db8::2 (0c678fc3-c405-44cb-ac5c-5bfc4b68adc9/751ffce1-99da-4983-a5c7-6fe8c9ab2d05/19402a2d-4982-440a-89d0-24417d670d8d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:11.162016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Pushing event deleted for resources: {'Port': ['ID=aa27223c-c3fa-495c-b0fb-6e52b1154884,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:11.232750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.235630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.238991 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e0da67cd-5689-4085-8a37-2998315ed327 tempest-AttachVolumeTestJSON-1900134856 tempest-AttachVolumeTestJSON-1900134856-project] 10.222.0.18 "DELETE /v2.0/floatingips/9e49db25-d7c7-4e17-99ca-7b693447a766 HTTP/1.1" status: 204 len: 168 time: 0.7991915 Dec 21 04:10:11.250177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:11.254334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-abd03649-07a3-47e2-8fd8-77778928342f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.262321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-abd03649-07a3-47e2-8fd8-77778928342f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.264292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-abd03649-07a3-47e2-8fd8-77778928342f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e21ef3d4-e4d6-4657-aee6-fe9ba4ba55d6 HTTP/1.1" status: 204 len: 168 time: 0.3289194 Dec 21 04:10:11.299236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd03649-07a3-47e2-8fd8-77778928342f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e21ef3d4-e4d6-4657-aee6-fe9ba4ba55d6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:11.353404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.355678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:11.356351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30f7de25-fb0b-4b4e-8d15-cf6d609ae2d6 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:11.461924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.474442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.541327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6267c124-52ac-488d-9c3b-5ece081f1d26 req-2ca5a084-dc8f-44a1-a41c-cbe4c8f1eb2e tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:11.549637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6267c124-52ac-488d-9c3b-5ece081f1d26 req-2ca5a084-dc8f-44a1-a41c-cbe4c8f1eb2e tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 945 time: 0.0689123 Dec 21 04:10:11.586070 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.600548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6267c124-52ac-488d-9c3b-5ece081f1d26 req-488a2937-ea5d-4702-a37d-4469f3b1ec6d tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496764 Dec 21 04:10:11.633300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.634654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-13acd444-0b3c-4148-90a9-c4e7a406f10d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.6995826 Dec 21 04:10:11.637174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:11.643027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9', 'name': 'tempest-PortsIpV6TestJSON-1150558291'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:11.646786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:11.655930 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:11.660148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:11.676398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Pushing event updated for resources: {'Port': ['ID=19402a2d-4982-440a-89d0-24417d670d8d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:11.756832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Attempting to bind port 19402a2d-4982-440a-89d0-24417d670d8d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:11.757499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Attempting to bind port 19402a2d-4982-440a-89d0-24417d670d8d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ee694074-f042-49d9-a381-0d8c7d82a493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:11.758222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Attempting to bind port 19402a2d-4982-440a-89d0-24417d670d8d on network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:11.764658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:11.765225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Checking segment: {'id': 'ee694074-f042-49d9-a381-0d8c7d82a493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:11.765854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.766905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Bound using segment: {'id': 'ee694074-f042-49d9-a381-0d8c7d82a493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:11.767641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Bound port: 19402a2d-4982-440a-89d0-24417d670d8d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ee694074-f042-49d9-a381-0d8c7d82a493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '0c678fc3-c405-44cb-ac5c-5bfc4b68adc9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:11.768071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.864133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] For port 19402a2d-4982-440a-89d0-24417d670d8d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:11.867637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] For port 19402a2d-4982-440a-89d0-24417d670d8d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19402a2d-4982-440a-89d0-24417d670d8d,segment=NetworkSegment(ee694074-f042-49d9-a381-0d8c7d82a493),segment_id=ee694074-f042-49d9-a381-0d8c7d82a493)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:11.936559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:11.980079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:11.984318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:12.022452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port 9258c836-566b-4c73-9c9e-633c01505710 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:10:12.047751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59841503-e6d4-4ca1-b76c-9eea087c31ab None None] Pushing event updated for resources: {'Port': ['ID=19402a2d-4982-440a-89d0-24417d670d8d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:12.233323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::f4 (0c678fc3-c405-44cb-ac5c-5bfc4b68adc9/751ffce1-99da-4983-a5c7-6fe8c9ab2d05/9258c836-566b-4c73-9c9e-633c01505710) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:12.354373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40719898-8e09-4713-b644-00e72bfb21ce req-c2c8af0b-f326-4d78-be81-a313e56e4387 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:12.359087 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40719898-8e09-4713-b644-00e72bfb21ce req-c2c8af0b-f326-4d78-be81-a313e56e4387 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 945 time: 0.1595726 Dec 21 04:10:12.452080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:12.463454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40719898-8e09-4713-b644-00e72bfb21ce req-d5d716f0-bcfb-4289-a635-0818780676dc tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965011 Dec 21 04:10:12.580534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:12.643605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:12.647984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:12.650807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:12.657635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:12.658275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:12.662732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=9258c836-566b-4c73-9c9e-633c01505710,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:12.746793 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-943297ee-5b1f-46e3-94af-97851379443a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.1082428 Dec 21 04:10:12.749006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55088) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:13.002759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55094) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:13.160486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1201894300'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:13.201420 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.266534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:13.270480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.296942 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.337452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19402a2d-4982-440a-89d0-24417d670d8d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:13.440781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 19402a2d-4982-440a-89d0-24417d670d8d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:13.441496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.488808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.505734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b738724-d2b5-4116-81c1-acb59b0040d0 None None] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:13.584564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.624706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:13.643361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d058c5ad-25d1-468f-88da-85dba3bc3fa1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:13.656929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-38ba2678-0e31-48f3-a856-d20ccecd4ec8 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:13.659159 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-38ba2678-0e31-48f3-a856-d20ccecd4ec8 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.54 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 945 time: 0.1091371 Dec 21 04:10:13.662227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0763ba5f-2e67-43f6-a084-288e47972068 None None] Provisioning complete for port 19402a2d-4982-440a-89d0-24417d670d8d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:13.662609 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0763ba5f-2e67-43f6-a084-288e47972068 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.666469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.666829 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 30fd6634-e2b9-4a11-ba0e-12e362e1fa25 of type vlan for network d7f1ce49-4162-4816-88d9-7892b1f1f54d Dec 21 04:10:13.755707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a608fc5-eaad-44fb-bac6-a9d959e03f43 req-63380099-9fc0-41f4-a48d-a28489893d99 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:13.758052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a608fc5-eaad-44fb-bac6-a9d959e03f43 req-63380099-9fc0-41f4-a48d-a28489893d99 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 945 time: 0.2082593 Dec 21 04:10:13.792126 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.795814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.822758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.855219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a608fc5-eaad-44fb-bac6-a9d959e03f43 req-d2b0c452-ed5c-4559-8971-9502efc35d3c tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/security-groups?id=476a19d1-6506-42c7-8a8b-6f3c91f880d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832379 Dec 21 04:10:13.877761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.917827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Deleting port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:13.918165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.931610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 19402a2d-4982-440a-89d0-24417d670d8d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19402a2d-4982-440a-89d0-24417d670d8d,segment=NetworkSegment(ee694074-f042-49d9-a381-0d8c7d82a493),segment_id=ee694074-f042-49d9-a381-0d8c7d82a493)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:13.970661 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.976325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:13.977008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:13.989441 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0763ba5f-2e67-43f6-a084-288e47972068 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.011798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.042688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=9258c836-566b-4c73-9c9e-633c01505710,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:14.121106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=d7f1ce49-4162-4816-88d9-7892b1f1f54d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:14.144443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d7f1ce49-4162-4816-88d9-7892b1f1f54d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:14.158557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] For port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,segment=NetworkSegment(be357cea-d63a-4916-a268-77c501ae12fe),segment_id=be357cea-d63a-4916-a268-77c501ae12fe)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:14.158913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.178358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-96b6ab6c-8d28-4cb5-a2d9-c8f266c80107 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.1727126 Dec 21 04:10:14.195571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Calling delete_port for 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:14.211996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-0763ba5f-2e67-43f6-a084-288e47972068 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:14.212474 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-0763ba5f-2e67-43f6-a084-288e47972068 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:14.256141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=19402a2d-4982-440a-89d0-24417d670d8d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:14.277356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.327225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55108) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:14.346791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:14.553571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.569538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:14.573855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.581965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.648240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Pushing event deleted for resources: {'Port': ['ID=69fe4419-8e4e-4a92-a3ea-0f43538b9a08,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:14.687482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa77419b-3242-45f3-8bbf-1f3d0f23bca6 None None] DHCP port deletion for 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:14.825404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] No DVR routers for this DVR port 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:14.831222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:14.834847 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b0b0a299-9ba4-4e62-bc78-57409dbd7da8 req-bfbdd86a-8d74-4709-a947-d6d8022f1605 tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.54 "DELETE /v2.0/ports/69fe4419-8e4e-4a92-a3ea-0f43538b9a08 HTTP/1.1" status: 204 len: 173 time: 1.1664357 Dec 21 04:10:14.835503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'name': 'network-vif-deleted', 'tag': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:14.837890 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9c0085a-a195-4e27-9f14-fa336e0e186c" -d '{"events": [{"server_uuid": "eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9", "name": "network-vif-deleted", "tag": "69fe4419-8e4e-4a92-a3ea-0f43538b9a08"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:14.865259 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:10:14.931292 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24881d92-0cbd-430a-a9f7-65ce4bde74be x-openstack-request-id: req-24881d92-0cbd-430a-a9f7-65ce4bde74be {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:14.931734 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9", "name": "network-vif-deleted", "tag": "69fe4419-8e4e-4a92-a3ea-0f43538b9a08", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:14.932227 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-24881d92-0cbd-430a-a9f7-65ce4bde74be {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:14.933421 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9', 'name': 'network-vif-deleted', 'tag': '69fe4419-8e4e-4a92-a3ea-0f43538b9a08', 'status': 'completed', 'code': 200} Dec 21 04:10:14.981148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6e8bdea6-4f8e-4cb9-8847-1192ea61f2dd None None] Provisioning complete for port 19402a2d-4982-440a-89d0-24417d670d8d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:14.981534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e8bdea6-4f8e-4cb9-8847-1192ea61f2dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.085317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c64279c-80fc-48db-b323-0fc5e79c7411 req-67231c86-a023-4c80-9775-8ed49a1d417e tempest-ServerAddressesNegativeTestJSON-1468742112 tempest-ServerAddressesNegativeTestJSON-1468742112-project] 10.222.0.18 "GET /v2.0/ports?device_id=eb7b38b9-2e7f-4f95-8df7-fdbe7ea37df9 HTTP/1.1" status: 200 len: 210 time: 0.0581760 Dec 21 04:10:15.157123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.166050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6e8bdea6-4f8e-4cb9-8847-1192ea61f2dd None None] Provisioning complete for port 9258c836-566b-4c73-9c9e-633c01505710 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:15.166477 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e8bdea6-4f8e-4cb9-8847-1192ea61f2dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.169987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.237519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6e8bdea6-4f8e-4cb9-8847-1192ea61f2dd None None] Port 9258c836-566b-4c73-9c9e-633c01505710 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:15.254104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.255116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.264770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=89c5e138-f670-4142-a03e-cdc4f57aeec7,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:15.281392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '30fd6634-e2b9-4a11-ba0e-12e362e1fa25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:15.283298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: d7f1ce49-4162-4816-88d9-7892b1f1f54d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:15.341304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19402a2d-4982-440a-89d0-24417d670d8d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:15.392019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network d7f1ce49-4162-4816-88d9-7892b1f1f54d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:15.415119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d82488c6-9a20-4448-b265-e0999e17cac8 None None] Provisioning complete for port 9258c836-566b-4c73-9c9e-633c01505710 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:15.415491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d82488c6-9a20-4448-b265-e0999e17cac8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.449615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:15.451429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:15.458456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 19402a2d-4982-440a-89d0-24417d670d8d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:15.459046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.475493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=9258c836-566b-4c73-9c9e-633c01505710,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:15.498126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d82488c6-9a20-4448-b265-e0999e17cac8 None None] Port 9258c836-566b-4c73-9c9e-633c01505710 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:15.506016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d7f1ce49-4162-4816-88d9-7892b1f1f54d) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:15.514517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:15.515277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.522141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ed2cbe5-90af-4cad-9c27-00f8039990f4 None None] Network d7f1ce49-4162-4816-88d9-7892b1f1f54d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:15.630543 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-51f51f7d-3857-46b0-a88b-c8f9cf40d780 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.2919133 Dec 21 04:10:15.633816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55120) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:15.644502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1093651187'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:15.736592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d7f1ce49-4162-4816-88d9-7892b1f1f54d', 'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '89c5e138-f670-4142-a03e-cdc4f57aeec7'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:15.737581 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.763419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Router b450a5c7-09d0-4139-b86c-da72d572e127 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:10:15.764843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:15.774116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.836966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:15.873636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:15.874539 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 260eefa1-5581-41ad-97b0-936123db78dc of type vlan for network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d Dec 21 04:10:15.950041 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.015568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:10:16.023919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:16.033748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d97990f3-2857-4712-bd75-f6d49fd24e6b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/routers/b450a5c7-09d0-4139-b86c-da72d572e127/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2826979 Dec 21 04:10:16.062307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.067984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:16.068601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.168443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55130) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:16.222743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaa06118-27e0-4327-a252-1d107b2b9cd8 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:16.240535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55132) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:16.247774 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eaa06118-27e0-4327-a252-1d107b2b9cd8 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports?device_id=b450a5c7-09d0-4139-b86c-da72d572e127 HTTP/1.1" status: 200 len: 988 time: 0.2225528 Dec 21 04:10:16.257452 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.6221895 Dec 21 04:10:16.263711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55134) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:16.274247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] Sync routers for ids ['b450a5c7-09d0-4139-b86c-da72d572e127'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:10:16.274775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52ddee8-8b80-4f52-97e4-79136b928fb1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=44bbd974-1ffb-49bd-8e79-fdbb40b8032d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:16.278322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:16.295157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d681bf9-8b94-49e5-9cd7-98536de6995c None None] Provisioning complete for port 9258c836-566b-4c73-9c9e-633c01505710 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:16.295537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d681bf9-8b94-49e5-9cd7-98536de6995c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.302919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:16.431636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Allocated IP 172.20.255.242 (d7f1ce49-4162-4816-88d9-7892b1f1f54d/89c5e138-f670-4142-a03e-cdc4f57aeec7/1930ef5a-f183-4a7b-a2bc-0c69e098c6bd) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:16.468836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Deleting subnet 944187b7-8f03-4a9a-9440-b75bba35be80 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:16.472002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] Routers {'b450a5c7-09d0-4139-b86c-da72d572e127'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:16.472710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b450a5c7-09d0-4139-b86c-da72d572e127'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:16.481490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.482683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:16.558905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:16.559143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.570434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:16.571836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 69fe4419-8e4e-4a92-a3ea-0f43538b9a08 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:16.589453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2d681bf9-8b94-49e5-9cd7-98536de6995c None None] Port 9258c836-566b-4c73-9c9e-633c01505710 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:16.609616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] Routers {'b450a5c7-09d0-4139-b86c-da72d572e127'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:16.610556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b450a5c7-09d0-4139-b86c-da72d572e127'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:16.688330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:16.691677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.696864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:16.698795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-313d2b2e-23d1-440c-b8f2-2a987f5b01e1 None None] The sync data for ids ['b450a5c7-09d0-4139-b86c-da72d572e127'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:10:16.799200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.823113 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.879787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:16.945687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Network d7f1ce49-4162-4816-88d9-7892b1f1f54d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:16.954343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:16.959494 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Pushing event updated for resources: {'Port': ['ID=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:16.965073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:17.047719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Attempting to bind port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:17.048219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Attempting to bind port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '30fd6634-e2b9-4a11-ba0e-12e362e1fa25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:17.049638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Attempting to bind port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd on network d7f1ce49-4162-4816-88d9-7892b1f1f54d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:17.050543 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.057377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:17.058607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Checking segment: {'id': '30fd6634-e2b9-4a11-ba0e-12e362e1fa25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:17.059657 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.060216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Bound using segment: {'id': '30fd6634-e2b9-4a11-ba0e-12e362e1fa25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:17.061123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Bound port: 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '30fd6634-e2b9-4a11-ba0e-12e362e1fa25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd7f1ce49-4162-4816-88d9-7892b1f1f54d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:17.061592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.128999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=944187b7-8f03-4a9a-9440-b75bba35be80,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:17.137419 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.144286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4040f76f-0139-4403-badf-e32a8047e181 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/944187b7-8f03-4a9a-9440-b75bba35be80 HTTP/1.1" status: 204 len: 168 time: 0.9747512 Dec 21 04:10:17.144492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:17.146143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55a9c843-19fe-4c9b-aa56-0a80b2365591 None None] Network 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:17.296923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] For port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:17.307949 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.314438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] For port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,segment=NetworkSegment(30fd6634-e2b9-4a11-ba0e-12e362e1fa25),segment_id=30fd6634-e2b9-4a11-ba0e-12e362e1fa25)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:17.318200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00daada8-fe84-430d-86c0-dce0534ec27f None None] DHCP port deletion for 203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:17.331025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.414900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.420611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.489019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.523676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:17.544642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'be357cea-d63a-4916-a268-77c501ae12fe') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:17.545301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'be357cea-d63a-4916-a268-77c501ae12fe') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:17.548074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d40382e-447a-41c4-a788-68ff44578c97 None None] Pushing event updated for resources: {'Port': ['ID=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:17.558304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.573764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.583493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Releasing vlan 116 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:17.584360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:17.586977 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:17.616812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=253cdad9-3831-4aba-abd0-91b9b0b2aa29,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:17.742454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '260eefa1-5581-41ad-97b0-936123db78dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:17.743144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 44bbd974-1ffb-49bd-8e79-fdbb40b8032d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:17.757751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.771272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:17.779349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] 10.222.0.18 "DELETE /v2.0/networks/203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a HTTP/1.1" status: 204 len: 168 time: 0.6329453 Dec 21 04:10:17.811752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d36080-9f79-4189-b1ff-beeeb12b97ed admin admin] Pushing event deleted for resources: {'Network': ['ID=203dfb10-d2e9-4ff9-a2bd-658d2aa4ae0a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:17.967725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 9258c836-566b-4c73-9c9e-633c01505710 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:17.968101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.003067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:18.107832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.121619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 44bbd974-1ffb-49bd-8e79-fdbb40b8032d) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:18.140395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e68b7dd6-a3d2-44e7-9226-a23ae0a24fb8 None None] Network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:18.161691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:18.163615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.166425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 9258c836-566b-4c73-9c9e-633c01505710 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:18.293147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-44bbd974-1ffb-49bd-8e79-fdbb40b8032d', 'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '253cdad9-3831-4aba-abd0-91b9b0b2aa29'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:18.296419 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.332413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55158) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:18.408946 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cbcca953-f5fc-4407-bc85-734495708b28 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3484fe5a05934f988251baa6c81d9a66&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0752182 Dec 21 04:10:18.413372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55160) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:18.416099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3d3e75c0-1bd5-486b-9862-f017bbd7b8e1 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 2.1509881 Dec 21 04:10:18.418790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55162) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:18.520219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Allocated IP 172.20.0.2 (44bbd974-1ffb-49bd-8e79-fdbb40b8032d/253cdad9-3831-4aba-abd0-91b9b0b2aa29/9fa13213-bae2-4ebc-9991-ff95021637a6) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:18.520691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67fe6eef-b43b-496b-b6fa-152c50c10860 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.564299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67fe6eef-b43b-496b-b6fa-152c50c10860 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.758351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67fe6eef-b43b-496b-b6fa-152c50c10860 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.760730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67fe6eef-b43b-496b-b6fa-152c50c10860 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:18.761915 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-67fe6eef-b43b-496b-b6fa-152c50c10860 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/476a19d1-6506-42c7-8a8b-6f3c91f880d6 HTTP/1.1" status: 204 len: 168 time: 0.3474243 Dec 21 04:10:18.774321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fe6eef-b43b-496b-b6fa-152c50c10860 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=476a19d1-6506-42c7-8a8b-6f3c91f880d6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:19.146010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b8601a0-8636-4916-a65a-1d14dd5510fa None None] Network d7f1ce49-4162-4816-88d9-7892b1f1f54d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:19.153010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.299407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.307025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.376739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=9258c836-566b-4c73-9c9e-633c01505710,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:19.385197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:19.462185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2bc059a0-bd3c-429e-aece-b5c053f2aa80 None None] Provisioning complete for port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:19.462185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc059a0-bd3c-429e-aece-b5c053f2aa80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.524747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.566170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.587353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:19.587353 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.689814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.834474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:19.839918 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc059a0-bd3c-429e-aece-b5c053f2aa80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.847088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:19.850531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:19.872648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Router b450a5c7-09d0-4139-b86c-da72d572e127 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:10:19.966656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:10:19.968898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:19.974075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4dc67337-27f4-4a52-acab-d18a0b67f86a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/routers/b450a5c7-09d0-4139-b86c-da72d572e127/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7350240 Dec 21 04:10:19.976833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55204) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:19.979475 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] Sync routers for ids ['b450a5c7-09d0-4139-b86c-da72d572e127'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:10:20.001596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=253cdad9-3831-4aba-abd0-91b9b0b2aa29,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:20.014288 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] Routers {'b450a5c7-09d0-4139-b86c-da72d572e127'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:20.015213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.016989 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b450a5c7-09d0-4139-b86c-da72d572e127'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.048750 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd0ad90f-707f-4626-a4c9-758d79ec791e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:10:20.050233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd0ad90f-707f-4626-a4c9-758d79ec791e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/9258c836-566b-4c73-9c9e-633c01505710 HTTP/1.1" status: 404 len: 333 time: 0.0714729 Dec 21 04:10:20.056416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55210) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:20.076937 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.090554 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] Routers {'b450a5c7-09d0-4139-b86c-da72d572e127'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:20.091601 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:09:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['b450a5c7-09d0-4139-b86c-da72d572e127'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.146408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.159661 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.160359 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75701f4a-d370-4044-b42e-79c42f40f99c None None] The sync data for ids ['b450a5c7-09d0-4139-b86c-da72d572e127'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:10:20.183906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2bc059a0-bd3c-429e-aece-b5c053f2aa80 None None] For port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,segment=NetworkSegment(30fd6634-e2b9-4a11-ba0e-12e362e1fa25),segment_id=30fd6634-e2b9-4a11-ba0e-12e362e1fa25)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:20.190734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Attempting to bind port 9fa13213-bae2-4ebc-9991-ff95021637a6 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:20.196108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Attempting to bind port 9fa13213-bae2-4ebc-9991-ff95021637a6 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '260eefa1-5581-41ad-97b0-936123db78dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:20.196108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Attempting to bind port 9fa13213-bae2-4ebc-9991-ff95021637a6 on network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:20.198315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Pushing event updated for resources: {'Port': ['ID=9fa13213-bae2-4ebc-9991-ff95021637a6,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:20.210854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 9, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:20.212034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Checking segment: {'id': '260eefa1-5581-41ad-97b0-936123db78dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:20.212921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['44bbd974-1ffb-49bd-8e79-fdbb40b8032d']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.213101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.213650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Bound using segment: {'id': '260eefa1-5581-41ad-97b0-936123db78dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:20.214730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Bound port: 9fa13213-bae2-4ebc-9991-ff95021637a6, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '260eefa1-5581-41ad-97b0-936123db78dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:20.215380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.234369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '260eefa1-5581-41ad-97b0-936123db78dc') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.234369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '260eefa1-5581-41ad-97b0-936123db78dc') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:20.240998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.254860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.263028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:20.263028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.277786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d3b17646-a893-467c-97ea-ec5dca860da3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:20.344057 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:20.357177 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bc059a0-bd3c-429e-aece-b5c053f2aa80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.401370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] For port 9fa13213-bae2-4ebc-9991-ff95021637a6, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:20.452783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.489687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] For port 9fa13213-bae2-4ebc-9991-ff95021637a6, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9fa13213-bae2-4ebc-9991-ff95021637a6,segment=NetworkSegment(260eefa1-5581-41ad-97b0-936123db78dc),segment_id=260eefa1-5581-41ad-97b0-936123db78dc)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:20.512131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc059a0-bd3c-429e-aece-b5c053f2aa80 None None] Pushing event updated for resources: {'Port': ['ID=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:20.523368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-588dca92-3e64-45e6-b3d6-8ec4a8300cfd None None] Provisioning complete for port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:20.523797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-588dca92-3e64-45e6-b3d6-8ec4a8300cfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.570248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.api [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:10:20.570248 n-d-822053-11 neutron-server[110310]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:10:20.570248 n-d-822053-11 neutron-server[110310]: [parameters: {'id': '44bbd974-1ffb-49bd-8e79-fdbb40b8032d'}] Dec 21 04:10:20.570248 n-d-822053-11 neutron-server[110310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110310) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:20.571106 n-d-822053-11 neutron-server[110310]: DEBUG oslo_db.api [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:20.578859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55224) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:20.597104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:20.597973 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:20.607114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.692558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c65938e2-d39b-44ec-af9e-b22dfc05ef62 None None] Pushing event updated for resources: {'Port': ['ID=9fa13213-bae2-4ebc-9991-ff95021637a6,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:20.798708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-656730931-network', 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:20.806582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0065880-d20d-44c4-9c7d-b94935fd6f23 None None] Network 44bbd974-1ffb-49bd-8e79-fdbb40b8032d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:20.849877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.852582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.940021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:20.942367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:20.963935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.003251 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.003762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Fanout notify agent at l3_agent the message router_deleted on router b450a5c7-09d0-4139-b86c-da72d572e127 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:10:21.017948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.022014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4adbf78a-5982-49c4-9a2f-49fbfa2e51a2 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/routers/b450a5c7-09d0-4139-b86c-da72d572e127 HTTP/1.1" status: 204 len: 168 time: 0.9505184 Dec 21 04:10:21.022014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55232) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:21.062443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4111a115-3f05-4412-92a5-871b64933201 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:21.076868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.093162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.150954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.183862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet 751ffce1-99da-4983-a5c7-6fe8c9ab2d05 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:21.187847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.201838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:21.215202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.219988 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Added segment d4018761-5441-4eba-87c7-cb96ec8da5a9 of type vlan for network 800834e6-2709-4cb2-81c2-4c16d3d000fa Dec 21 04:10:21.283167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.305144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.315348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c66accb0-bef4-4efd-8c64-1ac468371fd8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:21.336186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.336557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.340028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.340676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.341237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.341747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.349949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4111a115-3f05-4412-92a5-871b64933201 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:21.353079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.356554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.358006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.359840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.360504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.363116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.364335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:21.386267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.388587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:21.389785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.390467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port 9fa13213-bae2-4ebc-9991-ff95021637a6 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:21.391452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.479950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] Pushing event updated for resources: {'Network': ['ID=800834e6-2709-4cb2-81c2-4c16d3d000fa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:21.501838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:21.560504 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cb8cadd5-1cd4-4b66-8f40-79d7d0d8866d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 0.9801772 Dec 21 04:10:21.561100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55238) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:21.566486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:21.597805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Request body: {'subnet': {'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-656730931-subnet', 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:21.652311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port 9fa13213-bae2-4ebc-9991-ff95021637a6, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9fa13213-bae2-4ebc-9991-ff95021637a6,segment=NetworkSegment(260eefa1-5581-41ad-97b0-936123db78dc),segment_id=260eefa1-5581-41ad-97b0-936123db78dc)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:21.652728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.701068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.704475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for 9fa13213-bae2-4ebc-9991-ff95021637a6 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:21.761645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:21.762167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.856771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:21.860490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.891652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.966634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:21.996340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=9fa13213-bae2-4ebc-9991-ff95021637a6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:22.005602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=751ffce1-99da-4983-a5c7-6fe8c9ab2d05,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:22.016098 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.133364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55246) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/751ffce1-99da-4983-a5c7-6fe8c9ab2d05 HTTP/1.1" status: 204 len: 168 time: 1.0165648 Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.133817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.135009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb7fc168-be80-4de7-9611-fce6cbba2b0f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:22.136144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-321917b9-d292-4096-895b-960218414989 None None] Network 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:22.136264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port 9fa13213-bae2-4ebc-9991-ff95021637a6 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:22.244821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.269255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.301090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['44bbd974-1ffb-49bd-8e79-fdbb40b8032d']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:22.316823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '260eefa1-5581-41ad-97b0-936123db78dc') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:22.317301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '260eefa1-5581-41ad-97b0-936123db78dc') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:22.352232 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.377237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port 19402a2d-4982-440a-89d0-24417d670d8d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:22.377578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.378458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.396222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:22.396691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:22.399992 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:22.461364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port 19402a2d-4982-440a-89d0-24417d670d8d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19402a2d-4982-440a-89d0-24417d670d8d,segment=NetworkSegment(ee694074-f042-49d9-a381-0d8c7d82a493),segment_id=ee694074-f042-49d9-a381-0d8c7d82a493)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:22.462058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.510608 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.669513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.671397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Pushing event updated for resources: {'Subnet': ['ID=59294161-9bfc-416e-a51d-c4b1c78a016d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:22.675819 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-86ed003c-2403-4ae7-9d79-748285a9897d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.709455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.720292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/44bbd974-1ffb-49bd-8e79-fdbb40b8032d HTTP/1.1" status: 204 len: 168 time: 4.3003240 Dec 21 04:10:22.730782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55254) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:22.735470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:22.741192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Network hostable DHCP agents. Network: 800834e6-2709-4cb2-81c2-4c16d3d000fa, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:22.755180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-592449090'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:22.774390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] DHCP port deletion for 0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:22.780402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ebda8c-8aef-40e3-9f73-01820322aea0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=44bbd974-1ffb-49bd-8e79-fdbb40b8032d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:22.857277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] Deleting port 19402a2d-4982-440a-89d0-24417d670d8d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:22.857812 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.911510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:22.922683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:22.927554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.940282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.977304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] For port 19402a2d-4982-440a-89d0-24417d670d8d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=19402a2d-4982-440a-89d0-24417d670d8d,segment=NetworkSegment(ee694074-f042-49d9-a381-0d8c7d82a493),segment_id=ee694074-f042-49d9-a381-0d8c7d82a493)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:22.977713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:22.982784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:23.006925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.006925 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 1e313d43-8518-4c72-a436-46807e755910 of type vlan for network 3b358d03-5865-481d-8d07-19e609d89758 Dec 21 04:10:23.014511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] Calling delete_port for 19402a2d-4982-440a-89d0-24417d670d8d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:23.035635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for 19402a2d-4982-440a-89d0-24417d670d8d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:23.106234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.148935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 800834e6-2709-4cb2-81c2-4c16d3d000fa) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:23.154241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:23.154848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.167672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a7f6f54-8e30-4599-b579-27a4945fe43c None None] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:23.225796 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.231769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:23.232381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.316812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=3b358d03-5865-481d-8d07-19e609d89758,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:23.326846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-99da40ec-5f93-4388-a913-b19ef81e3c3f admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.7574024 Dec 21 04:10:23.327051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e17e426b-8097-4d17-b082-9992ab9a0dc4 None None] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:23.334257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.359134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=19402a2d-4982-440a-89d0-24417d670d8d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:23.359134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port 19402a2d-4982-440a-89d0-24417d670d8d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:23.445371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-502263c2-08f1-4b87-9950-d753eeaab78d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.7063520 Dec 21 04:10:23.445371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55264) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:23.449213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '3b358d03-5865-481d-8d07-19e609d89758', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:23.476300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3b358d03-5865-481d-8d07-19e609d89758 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:23.478344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.526867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0c678fc3-c405-44cb-ac5c-5bfc4b68adc9']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:23.556658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ee694074-f042-49d9-a381-0d8c7d82a493') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:23.564048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ee694074-f042-49d9-a381-0d8c7d82a493') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:23.585266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.635731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.647585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:23.648541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.656025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19402a2d-4982-440a-89d0-24417d670d8d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:23.658585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.706329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] No DVR routers for this DVR port 19402a2d-4982-440a-89d0-24417d670d8d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:23.711010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.738832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89d275f3-2b07-4213-9b34-a329007b8e19 None None] Pushing event deleted for resources: {'Port': ['ID=19402a2d-4982-440a-89d0-24417d670d8d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:23.740744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:23.744698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.753867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 19402a2d-4982-440a-89d0-24417d670d8d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:23.753867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 19402a2d-4982-440a-89d0-24417d670d8d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:23.835754 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:23.864176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing IP validity checks on allocation pools {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 04:10:23.869577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 04:10:23.918897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.952530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:23.960577 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/0c678fc3-c405-44cb-ac5c-5bfc4b68adc9 HTTP/1.1" status: 204 len: 168 time: 1.9259822 Dec 21 04:10:23.963707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acf135c-d7cb-461e-a43b-c85301a9999a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=0c678fc3-c405-44cb-ac5c-5bfc4b68adc9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:23.965532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55280) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:24.042585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d5ad1d4-0888-4ee3-8969-cf897314c419 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:24.047913 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d5ad1d4-0888-4ee3-8969-cf897314c419 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/da787046-7c07-4994-922f-d4afd6a3e498 HTTP/1.1" status: 200 len: 845 time: 0.0782282 Dec 21 04:10:24.048611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55286) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:24.114835 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90ba6dfd-f27e-413f-92ff-f84ab5ab4ef5 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/da787046-7c07-4994-922f-d4afd6a3e498?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0598655 Dec 21 04:10:24.115277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:24.120271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:24.178336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-dc1c09a5-bfc3-4fe1-b57d-e4d60e38e958 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:24.179894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-dc1c09a5-bfc3-4fe1-b57d-e4d60e38e958 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.1733928 Dec 21 04:10:24.198461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:24.254860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=529d88c2-55fa-46a5-be66-646863f5af38,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:24.267864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-17e49065-9585-4617-99fb-ab6522309f25 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0776520 Dec 21 04:10:24.330818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-61fe4381-c4df-4de7-b380-1c716d080bb5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0619774 Dec 21 04:10:24.373944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '1e313d43-8518-4c72-a436-46807e755910', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '3b358d03-5865-481d-8d07-19e609d89758'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:24.374602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 3b358d03-5865-481d-8d07-19e609d89758, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:24.379555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:24.383222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:24.457478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-1c00bd7e-d531-4e82-a651-b2a9f611eaef service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255248 Dec 21 04:10:24.483991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 3b358d03-5865-481d-8d07-19e609d89758 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:24.578657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 3b358d03-5865-481d-8d07-19e609d89758) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:24.594129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45c1b1ad-9e8f-4272-8063-74dae343da7a None None] Network 3b358d03-5865-481d-8d07-19e609d89758 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:24.608334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:24.616855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:24.621182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-05514f51-2080-4b41-b62e-0f0ca643356e service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1628954 Dec 21 04:10:24.708350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-017f4f25-b987-48da-8554-bf4fee584b9f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 1.2639911 Dec 21 04:10:24.710995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:24.735847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:24.759463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c79f1786-b33c-4422-b0fe-ce1431cbfad3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-3b358d03-5865-481d-8d07-19e609d89758', 'network_id': '3b358d03-5865-481d-8d07-19e609d89758', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '529d88c2-55fa-46a5-be66-646863f5af38'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:24.760393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c79f1786-b33c-4422-b0fe-ce1431cbfad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:24.823360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:24.847937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:24.848572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:24.849727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=15d2a74b-717d-4fcc-b76d-b617800ea5e5,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:24.867107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:24.867107 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.045417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-59e3bbfd-32b7-407c-be24-ba71e610d177 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.9285679 Dec 21 04:10:25.046155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:25.055294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4728874e-c87c-4da5-83aa-d5cd7fce621f None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:25.057550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'security_group': {'name': 'tempest-secgroup-420680985'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:25.066270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e507e8c9-9ec0-44ac-b59e-2e45e000e70e req-1916307e-cb4e-4c04-85b7-3cc95e5e9792 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 210 time: 0.1114941 Dec 21 04:10:25.115011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.251161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.278085 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.312113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.325749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.353506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'project_id': '37ca6abbbb0c481784292d1c539179ea', 'fixed_ips': [{'subnet_id': '15d2a74b-717d-4fcc-b76d-b617800ea5e5'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:25.354750 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.372453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=529d88c2-55fa-46a5-be66-646863f5af38,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server [None req-c79f1786-b33c-4422-b0fe-ce1431cbfad3 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 529d88c2-55fa-46a5-be66-646863f5af38: This subnet is being modified by another concurrent operation. Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:10:25.374446 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1463, in create_port_db Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise exception Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 529d88c2-55fa-46a5-be66-646863f5af38: This subnet is being modified by another concurrent operation. Dec 21 04:10:25.384099 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Dec 21 04:10:25.479086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.527796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17eb0112-6e9e-4dae-b64b-e5f3d71d08a9 None None] Network 3b358d03-5865-481d-8d07-19e609d89758 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:25.569240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.671427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b60f9e8-38a7-4009-af33-7d02f6fc69bd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:25.764181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Allocated IP 2001:db8::2 (4d7bf9bb-c744-49be-bfb6-28f1087deba3/15d2a74b-717d-4fcc-b76d-b617800ea5e5/aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:25.764669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.766330 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-510bebb9-8edb-43ae-9845-5a16b46c2d8c tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7186103 Dec 21 04:10:25.771652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55332) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:25.776454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'security_group': {'name': 'tempest-secgroup-463267486'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:25.850038 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.919434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.924099 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:25.969514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b358d03-5865-481d-8d07-19e609d89758']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:25.991962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e313d43-8518-4c72-a436-46807e755910') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:25.993521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e313d43-8518-4c72-a436-46807e755910') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:26.011830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.042843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.051386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 117 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:26.051780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.075126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:26.121618 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:26.145248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.174806 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.229488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2f119707-b1a6-4f2c-81cf-cf7ad931a5b7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:26.233127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e7c5eb8-a801-4b49-a42c-69b55528edea req-63af01a8-cc55-4eaa-bdf4-476f02a13b57 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 210 time: 0.0535131 Dec 21 04:10:26.236272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.260448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.263606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/3b358d03-5865-481d-8d07-19e609d89758 HTTP/1.1" status: 204 len: 168 time: 1.5510190 Dec 21 04:10:26.265004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e3aea4-1dd0-4fd7-902e-6353e43c451c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=3b358d03-5865-481d-8d07-19e609d89758,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:26.267310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55342) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:26.270383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.272262 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1479322326'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:26.319261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:26.324789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:26.328629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:26.336544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Pushing event updated for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:26.352412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.353118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.353701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.354265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.354813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.354967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.355528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.356074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.356209 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5d742697-886a-4b31-8340-de5bdbd110ab tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5832455 Dec 21 04:10:26.356738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.357330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.357873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.358407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.358950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.359076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55346) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:26.360116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:10:26.365105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1165352232', 'security_groups': ['2f119707-b1a6-4f2c-81cf-cf7ad931a5b7'], 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '15d2a74b-717d-4fcc-b76d-b617800ea5e5'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:26.419268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Attempting to bind port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:26.419657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Attempting to bind port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd914e185-72b4-44bf-8f4a-cf96505aef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:26.420028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Attempting to bind port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b on network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:26.425789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:26.426179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Checking segment: {'id': 'd914e185-72b4-44bf-8f4a-cf96505aef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:26.426580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.427015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Bound using segment: {'id': 'd914e185-72b4-44bf-8f4a-cf96505aef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:26.427494 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Bound port: aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd914e185-72b4-44bf-8f4a-cf96505aef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:26.427882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.476918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:26.480545 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.534355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:26.538290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:26.541454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:26.555316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.556617 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 022a52ba-c40e-454e-9b06-b3788fc1efea of type vlan for network 42dee1af-a012-4aca-9a2f-d60132aa5926 Dec 21 04:10:26.617875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.620332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.635927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:26.710046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c07460-0c2c-4520-b59f-0127f1f6acd3 None None] Pushing event updated for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:26.763175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.769258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:26.773668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.786053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:26.812732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port d75088c8-401e-4e03-8541-50db74b051c4 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:10:26.923516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=42dee1af-a012-4aca-9a2f-d60132aa5926,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:26.965696 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e1bc4846-d616-43b7-8347-1193c3df9807 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.6970837 Dec 21 04:10:26.971446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55358) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:26.976930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:27.037261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 42dee1af-a012-4aca-9a2f-d60132aa5926 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:27.243140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::18d (4d7bf9bb-c744-49be-bfb6-28f1087deba3/15d2a74b-717d-4fcc-b76d-b617800ea5e5/d75088c8-401e-4e03-8541-50db74b051c4) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:27.360647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:27.370780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.415788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.489024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:27.516681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e8f2a51-0ca2-44ce-97f8-da319416df2f req-752ed94f-5580-49cb-84ed-8408bfb8c3ef tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 210 time: 0.0639820 Dec 21 04:10:27.566597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.597509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:27.622600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:27.623323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.627315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:27.632074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:27.658406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:27.659116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.733658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=d75088c8-401e-4e03-8541-50db74b051c4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:27.796340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.817269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1fae31dd-d3b7-4068-9cbd-83a76a492845 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.4565165 Dec 21 04:10:27.820113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55368) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:27.825648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:27.836491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:27.843228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.923778 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:27.988707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=8efb4c46-d55f-49e0-960b-864dddcf16da,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:28.000742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:28.017653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '022a52ba-c40e-454e-9b06-b3788fc1efea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:28.018616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 42dee1af-a012-4aca-9a2f-d60132aa5926, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:28.145329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:28.149132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.240218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-401ceea0-7e22-4974-992c-65bdd8890068 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:28.241953 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-401ceea0-7e22-4974-992c-65bdd8890068 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2108712 Dec 21 04:10:28.264156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': '4e729315-fba6-48de-be23-a59b45172796', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:28.271113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 42dee1af-a012-4aca-9a2f-d60132aa5926 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:28.271371 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 15d2a74b-717d-4fcc-b76d-b617800ea5e5 (CIDR: 2001:db8::/64) Dec 21 04:10:28.341660 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:10:28.342756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:28.381478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 42dee1af-a012-4aca-9a2f-d60132aa5926) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:28.399013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-927d9835-3374-4cdb-89f6-8b084fb14882 None None] Network 42dee1af-a012-4aca-9a2f-d60132aa5926 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:28.419109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:28.419775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.461720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-201c63e9-a0ce-4bd6-b053-a33f3d52bb33 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6400666 Dec 21 04:10:28.471057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55376) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:28.471276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:28.556588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-17cbd23b-8472-4efa-8d09-0d517eb3221e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.5837049 Dec 21 04:10:28.559776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55378) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:28.651484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-baa826e3-d2d9-4d96-a93d-b38808421c92 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:28.652168 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-baa826e3-d2d9-4d96-a93d-b38808421c92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.752258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:28.758492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.759286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75a0f5e8-2013-4a86-9ffa-05b006eb4af5 req-0b1881f8-bae3-4165-b78b-ebbbd0d82dc9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 210 time: 0.0571165 Dec 21 04:10:28.770364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.786588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:28.786588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.788840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-42dee1af-a012-4aca-9a2f-d60132aa5926', 'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '8efb4c46-d55f-49e0-960b-864dddcf16da'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:28.790286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:28.969434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.087707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Allocated IP 172.20.0.1 (42dee1af-a012-4aca-9a2f-d60132aa5926/8efb4c46-d55f-49e0-960b-864dddcf16da/5bff58a2-6d21-4e27-b333-103134555dd3) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:29.093661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.5 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/cc520175-7567-482f-b183-4c12d93544ce) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:29.099605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-baa826e3-d2d9-4d96-a93d-b38808421c92 None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:29.100109 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-baa826e3-d2d9-4d96-a93d-b38808421c92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.195034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-baa826e3-d2d9-4d96-a93d-b38808421c92 None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:29.306554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.335032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.360680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:29.364967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bd5533a1-b58d-4c05-af43-fd66c65322df None None] Provisioning complete for port d75088c8-401e-4e03-8541-50db74b051c4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:29.365608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd5533a1-b58d-4c05-af43-fd66c65322df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.366715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.375484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:29.378579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:29.384148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:29.384830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.401907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:29.433373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92e403b3-edfa-41e5-a2ee-19ef88b75c6c None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:29.454603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.488397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bbb6fc6a-6b2e-48da-9936-37595faddd70 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.0187027 Dec 21 04:10:29.488397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55392) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:29.495853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1147788974', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049'}], 'security_groups': ['3b60f9e8-38a7-4009-af33-7d02f6fc69bd']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:29.518304 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.524477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.620827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=8efb4c46-d55f-49e0-960b-864dddcf16da,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:29.623501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:29.627364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.636360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:29.712986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.733064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:29.741319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42dee1af-a012-4aca-9a2f-d60132aa5926']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:29.764263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Network 42dee1af-a012-4aca-9a2f-d60132aa5926 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:29.764263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bd5533a1-b58d-4c05-af43-fd66c65322df None None] Port d75088c8-401e-4e03-8541-50db74b051c4 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:29.766516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:29.770235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:29.856209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Pushing event updated for resources: {'Port': ['ID=5bff58a2-6d21-4e27-b333-103134555dd3,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:29.889536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:29.890327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.897945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '022a52ba-c40e-454e-9b06-b3788fc1efea') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:29.899890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '022a52ba-c40e-454e-9b06-b3788fc1efea') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:29.912053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Attempting to bind port 5bff58a2-6d21-4e27-b333-103134555dd3 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:29.912719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Attempting to bind port 5bff58a2-6d21-4e27-b333-103134555dd3 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '022a52ba-c40e-454e-9b06-b3788fc1efea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:29.915512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Attempting to bind port 5bff58a2-6d21-4e27-b333-103134555dd3 on network 42dee1af-a012-4aca-9a2f-d60132aa5926 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:29.924047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=cc520175-7567-482f-b183-4c12d93544ce,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:29.928428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:29.928770 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.947689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:29.990665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.024286 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-71882477-a237-452e-9c37-30f7dcab0a02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7645843 Dec 21 04:10:30.032353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:30.032769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:30.046184 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:30.049752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:30.050443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Checking segment: {'id': '022a52ba-c40e-454e-9b06-b3788fc1efea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:30.050854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.051654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Bound using segment: {'id': '022a52ba-c40e-454e-9b06-b3788fc1efea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:30.053006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Bound port: 5bff58a2-6d21-4e27-b333-103134555dd3, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '022a52ba-c40e-454e-9b06-b3788fc1efea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '42dee1af-a012-4aca-9a2f-d60132aa5926'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:30.053544 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.060500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Request body: {'port': {'device_id': '4e729315-fba6-48de-be23-a59b45172796', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:30.097042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa7ef0d-1476-49e7-8e2a-d6081882bbb2 req-5410a2f0-babd-4ded-a52c-6aa8a64d93f7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:30.104538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfa7ef0d-1476-49e7-8e2a-d6081882bbb2 req-5410a2f0-babd-4ded-a52c-6aa8a64d93f7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 931 time: 0.1183512 Dec 21 04:10:30.147889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] For port 5bff58a2-6d21-4e27-b333-103134555dd3, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:30.250151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.289620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfa7ef0d-1476-49e7-8e2a-d6081882bbb2 req-cac9e31b-fc29-485f-b158-8277e4ac9279 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1838970 Dec 21 04:10:30.295859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] Update dhcp port {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'fixed_ips': [{'subnet_id': '15d2a74b-717d-4fcc-b76d-b617800ea5e5', 'ip_address': '2001:db8::2'}, {'subnet_id': 'cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:10:30.336613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.416173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Delete allocated IP 2001:db8::18d (4d7bf9bb-c744-49be-bfb6-28f1087deba3/15d2a74b-717d-4fcc-b76d-b617800ea5e5) {{(pid=110310) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 21 04:10:30.429033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8:0:1::22b (4d7bf9bb-c744-49be-bfb6-28f1087deba3/cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049/d75088c8-401e-4e03-8541-50db74b051c4) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:30.440298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] For port 5bff58a2-6d21-4e27-b333-103134555dd3, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5bff58a2-6d21-4e27-b333-103134555dd3,segment=NetworkSegment(022a52ba-c40e-454e-9b06-b3788fc1efea),segment_id=022a52ba-c40e-454e-9b06-b3788fc1efea)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:30.458905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:10:30.458905 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:10:30.458905 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '42dee1af-a012-4aca-9a2f-d60132aa5926'}] Dec 21 04:10:30.458905 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:30.460582 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:30.533815 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.680175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f619ba0-5b78-49a9-b3ae-60f1f5dba060 None None] Pushing event updated for resources: {'Port': ['ID=5bff58a2-6d21-4e27-b333-103134555dd3,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:30.713442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cc520175-7567-482f-b183-4c12d93544ce {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:10:30.713746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5a4ec40-f3b8-4d9a-a377-13d8f4836437 None None] Network 42dee1af-a012-4aca-9a2f-d60132aa5926 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:30.725304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.730551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.764335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Transition to ACTIVE for port object cc520175-7567-482f-b183-4c12d93544ce will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:10:30.809501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.885110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] Allocated IP 2001:db8:0:1::2 (4d7bf9bb-c744-49be-bfb6-28f1087deba3/cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049/aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:30.885749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] In _notify_port_updated(), no bound segment for port d75088c8-401e-4e03-8541-50db74b051c4 on network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:10:30.888460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.901919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:30.903655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:30.905105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/ports/d75088c8-401e-4e03-8541-50db74b051c4 HTTP/1.1" status: 200 len: 931 time: 1.4157445 Dec 21 04:10:30.906694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c164d0a-a121-410c-b58d-03cd5ce9da42 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=d75088c8-401e-4e03-8541-50db74b051c4,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:30.910023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55418) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:30.968514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.014883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Pushing event updated for resources: {'Port': ['ID=cc520175-7567-482f-b183-4c12d93544ce,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:31.069810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port d75088c8-401e-4e03-8541-50db74b051c4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:31.070201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.120647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:31.145942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port 5bff58a2-6d21-4e27-b333-103134555dd3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:31.147083 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.150532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Attempting to bind port cc520175-7567-482f-b183-4c12d93544ce on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:31.151146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Attempting to bind port cc520175-7567-482f-b183-4c12d93544ce by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:31.151673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Attempting to bind port cc520175-7567-482f-b183-4c12d93544ce on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:31.170371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Port cc520175-7567-482f-b183-4c12d93544ce on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:10:31.170741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Attempting to bind port cc520175-7567-482f-b183-4c12d93544ce on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:31.186889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:31.187343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:31.187736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:31.188162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Bound port: cc520175-7567-482f-b183-4c12d93544ce, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:31.188578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.202398 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.233928 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.252995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for d75088c8-401e-4e03-8541-50db74b051c4 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:31.269827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.311113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] For port cc520175-7567-482f-b183-4c12d93544ce, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:31.314564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] For port cc520175-7567-482f-b183-4c12d93544ce, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cc520175-7567-482f-b183-4c12d93544ce,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:31.327589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port 5bff58a2-6d21-4e27-b333-103134555dd3, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5bff58a2-6d21-4e27-b333-103134555dd3,segment=NetworkSegment(022a52ba-c40e-454e-9b06-b3788fc1efea),segment_id=022a52ba-c40e-454e-9b06-b3788fc1efea)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:31.327995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.351790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for 5bff58a2-6d21-4e27-b333-103134555dd3 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:31.370124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.420120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb59b25-1efd-4c34-bae1-55e9cb7b14b1 None None] Pushing event updated for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:31.523950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:31.524633 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.526107 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] 10.222.0.54 "PUT /v2.0/ports/cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 200 len: 1092 time: 1.4792428 Dec 21 04:10:31.527885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e729315-fba6-48de-be23-a59b45172796', 'tag': 'cc520175-7567-482f-b183-4c12d93544ce'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:31.543239 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42140ff2-e190-4ab1-8340-3b992d49b7f4" -d '{"events": [{"name": "network-changed", "server_uuid": "4e729315-fba6-48de-be23-a59b45172796", "tag": "cc520175-7567-482f-b183-4c12d93544ce"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:31.613212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e09d5c-273d-4d23-b495-cb313a3f5982 req-b97a56ff-0dd9-4ebf-8b68-5ab5df9fbb8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:31.623673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73e09d5c-273d-4d23-b495-cb313a3f5982 req-b97a56ff-0dd9-4ebf-8b68-5ab5df9fbb8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 943 time: 0.1571581 Dec 21 04:10:31.630055 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-affad1cf-f99b-403a-9d5d-02edc14147d8 x-openstack-request-id: req-affad1cf-f99b-403a-9d5d-02edc14147d8 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:31.630791 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e729315-fba6-48de-be23-a59b45172796", "tag": "cc520175-7567-482f-b183-4c12d93544ce", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:31.631479 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-affad1cf-f99b-403a-9d5d-02edc14147d8 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:31.632218 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e729315-fba6-48de-be23-a59b45172796', 'tag': 'cc520175-7567-482f-b183-4c12d93544ce', 'status': 'completed', 'code': 200} Dec 21 04:10:31.653905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d337b0-c556-4057-88b2-4c4b496b821a service neutron] Pushing event updated for resources: {'Port': ['ID=cc520175-7567-482f-b183-4c12d93544ce,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:31.722572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42140ff2-e190-4ab1-8340-3b992d49b7f4 req-f94d9a5a-3730-42e1-bb5a-cac5f96cb694 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:31.724539 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-42140ff2-e190-4ab1-8340-3b992d49b7f4 req-f94d9a5a-3730-42e1-bb5a-cac5f96cb694 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1095 time: 0.0586467 Dec 21 04:10:31.779191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73e09d5c-273d-4d23-b495-cb313a3f5982 req-66586614-a255-49e6-a810-26a0c37e38a7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1544545 Dec 21 04:10:31.803836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.842679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=5bff58a2-6d21-4e27-b333-103134555dd3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:31.864687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:31.917054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port 5bff58a2-6d21-4e27-b333-103134555dd3 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:31.934256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=d75088c8-401e-4e03-8541-50db74b051c4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:32.006134 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.006372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55430) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:32.006506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-01793ba4-d8c7-404c-b926-62a0a92f78ca tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/d75088c8-401e-4e03-8541-50db74b051c4 HTTP/1.1" status: 204 len: 168 time: 1.0919156 Dec 21 04:10:32.123458 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-eade0f2f-db7a-4078-a1c0-0dc806b8f390 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:10:32.124427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55438) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:32.125589 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eade0f2f-db7a-4078-a1c0-0dc806b8f390 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/d75088c8-401e-4e03-8541-50db74b051c4 HTTP/1.1" status: 404 len: 333 time: 0.1151533 Dec 21 04:10:32.131601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55440) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:32.214048 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.235834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e69c25c3-ddf8-4f6e-854b-529ed8772011 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.255112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42140ff2-e190-4ab1-8340-3b992d49b7f4 req-80570e55-98c9-419e-91ee-746a3645559d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:32.256670 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-42140ff2-e190-4ab1-8340-3b992d49b7f4 req-80570e55-98c9-419e-91ee-746a3645559d service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&shared=False HTTP/1.1" status: 200 len: 906 time: 0.5121057 Dec 21 04:10:32.293532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42dee1af-a012-4aca-9a2f-d60132aa5926']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:32.354040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e69c25c3-ddf8-4f6e-854b-529ed8772011 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.431199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42140ff2-e190-4ab1-8340-3b992d49b7f4 req-ca538bcd-51e6-4600-a316-55823717d102 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:32.439994 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-42140ff2-e190-4ab1-8340-3b992d49b7f4 req-ca538bcd-51e6-4600-a316-55823717d102 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1741157 Dec 21 04:10:32.447112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '022a52ba-c40e-454e-9b06-b3788fc1efea') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:32.447112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '022a52ba-c40e-454e-9b06-b3788fc1efea') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:32.477597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.496089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.504693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:32.505110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:32.527045 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:32.564405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eac6f5e8-d879-49f3-9b39-7f998d4a7469 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:32.564976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eac6f5e8-d879-49f3-9b39-7f998d4a7469 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.610348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e69c25c3-ddf8-4f6e-854b-529ed8772011 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.613038 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e69c25c3-ddf8-4f6e-854b-529ed8772011 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.625158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e69c25c3-ddf8-4f6e-854b-529ed8772011 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/security-groups/2f119707-b1a6-4f2c-81cf-cf7ad931a5b7 HTTP/1.1" status: 204 len: 168 time: 0.4925308 Dec 21 04:10:32.628859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55444) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:32.708167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e69c25c3-ddf8-4f6e-854b-529ed8772011 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f119707-b1a6-4f2c-81cf-cf7ad931a5b7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:32.728141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-0ce167ea-f459-4656-aa93-3b8d68d3a826 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:32.736050 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-0ce167ea-f459-4656-aa93-3b8d68d3a826 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1095 time: 0.2051041 Dec 21 04:10:32.739918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1d0c004-5832-4108-91cd-c215e2d4dc7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.810860 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-cd99aa55-87e4-4e27-ad53-a758e8e15b1b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 200 len: 217 time: 0.0581858 Dec 21 04:10:32.811817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.849588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.859778 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/42dee1af-a012-4aca-9a2f-d60132aa5926 HTTP/1.1" status: 204 len: 168 time: 4.2981479 Dec 21 04:10:32.860749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55450) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:32.860973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9417e7cb-b331-4ffe-bbdf-02cddeaf9774 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=42dee1af-a012-4aca-9a2f-d60132aa5926,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:32.861125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eac6f5e8-d879-49f3-9b39-7f998d4a7469 None None] Could not find standard attr ID for object d75088c8-401e-4e03-8541-50db74b051c4. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:10:32.881293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1d0c004-5832-4108-91cd-c215e2d4dc7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.896671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eac6f5e8-d879-49f3-9b39-7f998d4a7469 None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:32.897574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-638274404'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:32.899496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eac6f5e8-d879-49f3-9b39-7f998d4a7469 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:32.963256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eac6f5e8-d879-49f3-9b39-7f998d4a7469 None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:32.981439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-e9fa51f2-50a9-4ea1-bb6a-e8e02814b065 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:32.982992 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-e9fa51f2-50a9-4ea1-bb6a-e8e02814b065 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.1616101 Dec 21 04:10:33.022402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-ccceec3b-754b-471a-8fca-bf0c24b2eb97 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315299 Dec 21 04:10:33.076264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6680078a-32a0-4a03-b068-19dc6645e2a6 None None] Could not find standard attr ID for object d75088c8-401e-4e03-8541-50db74b051c4. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:10:33.083053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1d0c004-5832-4108-91cd-c215e2d4dc7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.085660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1d0c004-5832-4108-91cd-c215e2d4dc7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.089214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1d0c004-5832-4108-91cd-c215e2d4dc7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/security-groups/3b60f9e8-38a7-4009-af33-7d02f6fc69bd HTTP/1.1" status: 204 len: 168 time: 0.4548371 Dec 21 04:10:33.134116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55456) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:33.162405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d0c004-5832-4108-91cd-c215e2d4dc7a tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b60f9e8-38a7-4009-af33-7d02f6fc69bd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:33.198034 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-924e6aab-b93e-46cf-b25d-26ca0875a54f service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1679430 Dec 21 04:10:33.251934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet 15d2a74b-717d-4fcc-b76d-b617800ea5e5 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:33.261942 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.295348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-914bcef8-f6f2-426c-82d8-0fbf1ce405df None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:33.330234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:33.334215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.368211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5f0e6ee-58d0-4034-a2c4-0a9aa8f44595 req-90f45292-99b2-4f6a-8f80-7eb3cdd6d858 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1633158 Dec 21 04:10:33.368888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7652ff12-54cb-44f6-91e2-bb690b1d5a75 req-57936756-ca1d-4a40-99af-4b6afc5e0e3d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:33.370517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7652ff12-54cb-44f6-91e2-bb690b1d5a75 req-57936756-ca1d-4a40-99af-4b6afc5e0e3d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 943 time: 0.3901567 Dec 21 04:10:33.387652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.389538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:33.506111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:33.506440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.517483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.545668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-914bcef8-f6f2-426c-82d8-0fbf1ce405df None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:33.704766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:33.745982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.746468 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 54dbd7f6-66e5-4dc2-9166-37ece10fbc93 of type vlan for network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c Dec 21 04:10:33.843730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.861722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7652ff12-54cb-44f6-91e2-bb690b1d5a75 req-9a34cd14-9544-415a-974f-17d94c6983d3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2506442 Dec 21 04:10:33.925426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.938039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:33.960857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9c6353d-ad34-4638-bd3e-33bbd620c78c None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:33.992822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.001535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/15d2a74b-717d-4fcc-b76d-b617800ea5e5 HTTP/1.1" status: 204 len: 168 time: 0.8614581 Dec 21 04:10:34.002228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55464) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:34.009968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:34.038324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6ff616-820c-4d8c-9f59-f1263c9f9163 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=15d2a74b-717d-4fcc-b76d-b617800ea5e5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:34.049811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.055734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:34.056348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.089317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9c6353d-ad34-4638-bd3e-33bbd620c78c None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:34.339902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:34.344600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.429058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa4bc507-9552-4e62-b03a-ac4a5f899d58 None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:34.513640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=4c146368-5b6d-4fb2-bd8f-497a27bfb17c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:34.529837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-afcd72b3-c6c1-45a2-b9ea-501aa82170d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.6686387 Dec 21 04:10:34.533033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55470) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:34.538386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:34.602535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:34.808800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:34.812701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.820201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.904496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:34.908524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:34.913246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:34.913865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.927246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Deleting port ffe8e39b-678a-4e86-878d-6207b5a5bcfd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:34.927689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:34.994115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=e090503e-949d-472a-a80f-9fa4fef88113,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:35.052866 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-60f25ad1-c2df-4279-aa7e-54e13d02f789 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0486546 Dec 21 04:10:35.055492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55476) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:35.061912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'security_group': {'name': 'tempest-secgroup-603915186'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:35.163236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.244806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] For port ffe8e39b-678a-4e86-878d-6207b5a5bcfd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:35.245358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.263006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Calling delete_port for ffe8e39b-678a-4e86-878d-6207b5a5bcfd owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:35.317955 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.323890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.386366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.415896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6c457b-93dd-4e3a-aa82-3a5f355b045c req-74f6539a-07d7-4a7d-9d13-1f696648f0f3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:35.436552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc6c457b-93dd-4e3a-aa82-3a5f355b045c req-74f6539a-07d7-4a7d-9d13-1f696648f0f3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 943 time: 0.4135177 Dec 21 04:10:35.457146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0b3ff5d5-b540-44c6-91b8-426e856cde0d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:35.526487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=4976992e-0050-441e-976e-3ae785c7b9e0,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:35.551971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '54dbd7f6-66e5-4dc2-9166-37ece10fbc93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:35.552274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 4c146368-5b6d-4fb2-bd8f-497a27bfb17c, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:35.568708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85f75bf7-bd94-42c2-8b7d-a449e28622bd None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:35.575287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.575532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19031490-605f-480b-8ccf-bcadd9231299 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5182679 Dec 21 04:10:35.576367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:35.582462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'security_group': {'name': 'tempest-secgroup-1802139187'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:35.586570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc6c457b-93dd-4e3a-aa82-3a5f355b045c req-e234f0a1-cedb-43d4-b87a-c66617e7eb52 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1486173 Dec 21 04:10:35.659708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:35.683613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-37a476fc-6d49-4b8b-b458-ad6b39c12fde None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:35.683994 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-37a476fc-6d49-4b8b-b458-ad6b39c12fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.744182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.797345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4c146368-5b6d-4fb2-bd8f-497a27bfb17c) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:35.799447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.806983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-924e3452-c7df-4dd3-b74f-b432d2e5c98e None None] Network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:35.814192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:35.814825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.877642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.882038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Pushing event deleted for resources: {'Port': ['ID=ffe8e39b-678a-4e86-878d-6207b5a5bcfd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:35.939034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.970845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-37a476fc-6d49-4b8b-b458-ad6b39c12fde None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:35.971305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-37a476fc-6d49-4b8b-b458-ad6b39c12fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:35.995876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-216d80ef-5dfb-48c7-8a3c-18c1046ce8ac tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4615011 Dec 21 04:10:35.996754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:36.002735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4c146368-5b6d-4fb2-bd8f-497a27bfb17c', 'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '4976992e-0050-441e-976e-3ae785c7b9e0'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:36.003669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.009125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b11966a3-db0a-499c-90e9-72b4c0925018,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:36.044361 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.049160 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04878ba7-3a22-4db3-a94f-a24f762843fd tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4715962 Dec 21 04:10:36.049777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:36.056746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'security_group': {'name': 'tempest-secgroup-1435253325'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:36.102667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-37a476fc-6d49-4b8b-b458-ad6b39c12fde None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:36.178652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.214782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] Update dhcp port {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'fixed_ips': [{'subnet_id': 'cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'e090503e-949d-472a-a80f-9fa4fef88113'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:10:36.298235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.300872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.345816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.364833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.368831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Allocated IP 172.20.0.2 (4c146368-5b6d-4fb2-bd8f-497a27bfb17c/4976992e-0050-441e-976e-3ae785c7b9e0/490c6798-5f2d-462b-b3dc-b39e842ec6d8) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:36.378585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.434188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ec3bce7-ca6c-4082-8a13-a6efd6b17327,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:36.488906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.490333 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c5480db2-7c56-44d8-a9bc-aed6c9f75f35 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4396131 Dec 21 04:10:36.493010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55494) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:36.498365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-310443591', 'security_groups': ['4ec3bce7-ca6c-4082-8a13-a6efd6b17327'], 'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'e090503e-949d-472a-a80f-9fa4fef88113'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:36.564998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:36.620168 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cc520175-7567-482f-b183-4c12d93544ce details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:10:36.825243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:36.861482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-214d5e75-dc77-4e91-8be5-c097a86961b1 req-bf3e03d7-8487-4b33-ada2-c86d60aa12c5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:36.863866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-214d5e75-dc77-4e91-8be5-c097a86961b1 req-bf3e03d7-8487-4b33-ada2-c86d60aa12c5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 943 time: 0.1729858 Dec 21 04:10:36.918871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] Allocated IP 2001:db8::2 (4d7bf9bb-c744-49be-bfb6-28f1087deba3/e090503e-949d-472a-a80f-9fa4fef88113/aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:36.941327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Router 7d365f1f-98f8-4e87-86ca-895a2b2163fc has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:10:36.955179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-214d5e75-dc77-4e91-8be5-c097a86961b1 req-23409e54-d41d-4d4a-9d1d-ab5c116736f7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840926 Dec 21 04:10:37.010223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.011632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cc520175-7567-482f-b183-4c12d93544ce, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cc520175-7567-482f-b183-4c12d93544ce,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:37.051153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.056654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'cc520175-7567-482f-b183-4c12d93544ce', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': 'cc520175-7567-482f-b183-4c12d93544ce', 'mac_address': 'fa:16:3e:0e:03:65', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:10:37.059894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] device_id is not set on port aa0f5ad3-663e-4d6b-98c6-87e6525faf5d yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:10:37.167475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.169565 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.186516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:10:37.196012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-163783b4-5f84-4d70-92e7-79116f6e1c1b admin admin] 10.222.0.18 "PUT /v2.0/routers/7d365f1f-98f8-4e87-86ca-895a2b2163fc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0699317 Dec 21 04:10:37.198698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55502) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:37.224753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-676652e1-88e1-4355-b378-283e6629a616 None None] Sync routers for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:10:37.238838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:37.243881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cc520175-7567-482f-b183-4c12d93544ce {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:10:37.266124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.304883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:37.321471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=4976992e-0050-441e-976e-3ae785c7b9e0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:37.343522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:37.360937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:37.367084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Pushing event updated for resources: {'Port': ['ID=490c6798-5f2d-462b-b3dc-b39e842ec6d8,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:37.376399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cc520175-7567-482f-b183-4c12d93544ce, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cc520175-7567-482f-b183-4c12d93544ce,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:37.377293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:37.377986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:37.429077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.458845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.478601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.497032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.547700 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.557534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Attempting to bind port 490c6798-5f2d-462b-b3dc-b39e842ec6d8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:37.557923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Attempting to bind port 490c6798-5f2d-462b-b3dc-b39e842ec6d8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '54dbd7f6-66e5-4dc2-9166-37ece10fbc93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:37.558294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Attempting to bind port 490c6798-5f2d-462b-b3dc-b39e842ec6d8 on network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:37.582268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:37.582651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Checking segment: {'id': '54dbd7f6-66e5-4dc2-9166-37ece10fbc93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:37.583203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.583611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Bound using segment: {'id': '54dbd7f6-66e5-4dc2-9166-37ece10fbc93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:37.584100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Bound port: 490c6798-5f2d-462b-b3dc-b39e842ec6d8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '54dbd7f6-66e5-4dc2-9166-37ece10fbc93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:37.584483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.615049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:10:37.633417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.644897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8::319 (4d7bf9bb-c744-49be-bfb6-28f1087deba3/e090503e-949d-472a-a80f-9fa4fef88113/aa0f5ad3-663e-4d6b-98c6-87e6525faf5d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:37.649405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c146368-5b6d-4fb2-bd8f-497a27bfb17c']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:37.664009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54dbd7f6-66e5-4dc2-9166-37ece10fbc93') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:37.664264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54dbd7f6-66e5-4dc2-9166-37ece10fbc93') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:37.692141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.701685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cc520175-7567-482f-b183-4c12d93544ce,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:37.725425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.739577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:37.741344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:37.792997 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:37.797249 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:37.800661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:10:37.899048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Deleting port 299ed012-5300-4afc-af12-c5766a47a8eb {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:37.899657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.918146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:37.930526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.api [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:10:37.930526 n-d-822053-11 neutron-server[110310]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:10:37.930526 n-d-822053-11 neutron-server[110310]: [parameters: {'id': '4c146368-5b6d-4fb2-bd8f-497a27bfb17c'}] Dec 21 04:10:37.930526 n-d-822053-11 neutron-server[110310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110310) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:37.931477 n-d-822053-11 neutron-server[110310]: DEBUG oslo_db.api [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:37.932153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91689c9-9813-4ce8-b3e9-d10eb2d13b36 None None] Pushing event updated for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:37.949030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] For port 490c6798-5f2d-462b-b3dc-b39e842ec6d8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:37.961427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] For port 490c6798-5f2d-462b-b3dc-b39e842ec6d8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=490c6798-5f2d-462b-b3dc-b39e842ec6d8,segment=NetworkSegment(54dbd7f6-66e5-4dc2-9166-37ece10fbc93),segment_id=54dbd7f6-66e5-4dc2-9166-37ece10fbc93)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:38.020518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] For port 299ed012-5300-4afc-af12-c5766a47a8eb, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=299ed012-5300-4afc-af12-c5766a47a8eb,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:38.023609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.052662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Calling delete_port for 299ed012-5300-4afc-af12-c5766a47a8eb owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:38.081992 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.099119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.180796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=aa0f5ad3-663e-4d6b-98c6-87e6525faf5d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:38.209232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:38.211488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:38.216532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:38.225778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:38.226515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.248543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065aa81e-8fb7-4118-b23e-4ee4340f6b77 req-67896215-0c7a-447c-a28d-ab14819c0f24 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:38.250320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-065aa81e-8fb7-4118-b23e-4ee4340f6b77 req-67896215-0c7a-447c-a28d-ab14819c0f24 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 944 time: 0.1738670 Dec 21 04:10:38.307134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d395733-c97b-4315-b8e6-703ffac13cf0 None None] Pushing event updated for resources: {'Port': ['ID=490c6798-5f2d-462b-b3dc-b39e842ec6d8,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:38.321498 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-16cec5db-fe13-4dda-80e5-e77c1d12d0a4 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.8256664 Dec 21 04:10:38.322160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:38.347079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:38.355076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fe298cb-ab78-47f9-ac93-41544c2f82a8 None None] Network 4c146368-5b6d-4fb2-bd8f-497a27bfb17c requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:38.445112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.496975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144'}], 'enable_snat': True}, 'gw_port_id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:10:35Z', 'revision_number': 5, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port': {'id': '299ed012-5300-4afc-af12-c5766a47a8eb', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:66:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2214, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:02:11Z', 'updated_at': '2021-12-21T04:02:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:38.531376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-676652e1-88e1-4355-b378-283e6629a616 None None] Checking router: 7d365f1f-98f8-4e87-86ca-895a2b2163fc for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:10:38.586519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] Routers {'7d365f1f-98f8-4e87-86ca-895a2b2163fc'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:10:38.587506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:38.689478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:38.693104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.727611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] Set router 7d365f1f-98f8-4e87-86ca-895a2b2163fc gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:10:38.795866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-676652e1-88e1-4355-b378-283e6629a616 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:10:37Z', 'revision_number': 6, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:38.817117 n-d-822053-11 neutron-server[110311]: INFO neutron.db.ipam_backend_mixin [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet e090503e-949d-472a-a80f-9fa4fef88113 (CIDR: 2001:db8::/64) Dec 21 04:10:38.824511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-676652e1-88e1-4355-b378-283e6629a616 None None] The sync data for ids ['7d365f1f-98f8-4e87-86ca-895a2b2163fc'] in n-d-822053-11 is: [{'id': '7d365f1f-98f8-4e87-86ca-895a2b2163fc', 'name': 'tempest-AttachVolumeTestJSON-1775238349-router', 'tenant_id': '3f578ba291d54826a6db2accb249f808', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:02:10Z', 'updated_at': '2021-12-21T04:10:37Z', 'revision_number': 6, 'project_id': '3f578ba291d54826a6db2accb249f808', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:10:38.834994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b6599919-502d-4260-833e-1dbefdefe32b None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:38.835364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6599919-502d-4260-833e-1dbefdefe32b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.879058 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:10:38.879611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:38.886039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-065aa81e-8fb7-4118-b23e-4ee4340f6b77 req-3c74d10f-a485-4cac-8b27-564a3a78a120 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6271942 Dec 21 04:10:38.953698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b6599919-502d-4260-833e-1dbefdefe32b None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:38.954087 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6599919-502d-4260-833e-1dbefdefe32b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:38.979576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7cbb485-85da-4453-9c45-7ba19dd51856 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6557996 Dec 21 04:10:38.983573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55522) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:38.989335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:38.997216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port 490c6798-5f2d-462b-b3dc-b39e842ec6d8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:38.997565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.008787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b6599919-502d-4260-833e-1dbefdefe32b None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:39.100000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.116682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b84c2c1-2b7f-4f5a-88e3-38b5ec74c5e3 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:39.146818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Pushing event deleted for resources: {'Port': ['ID=299ed012-5300-4afc-af12-c5766a47a8eb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:39.153224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port 490c6798-5f2d-462b-b3dc-b39e842ec6d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=490c6798-5f2d-462b-b3dc-b39e842ec6d8,segment=NetworkSegment(54dbd7f6-66e5-4dc2-9166-37ece10fbc93),segment_id=54dbd7f6-66e5-4dc2-9166-37ece10fbc93)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:39.153601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.171210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f439bd93-e993-4557-a859-4e782e3db727 None None] Provisioning complete for port aa0f5ad3-663e-4d6b-98c6-87e6525faf5d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:39.172440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f439bd93-e993-4557-a859-4e782e3db727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.198101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for 490c6798-5f2d-462b-b3dc-b39e842ec6d8 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:39.312864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.431043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f439bd93-e993-4557-a859-4e782e3db727 None None] Port aa0f5ad3-663e-4d6b-98c6-87e6525faf5d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:39.433972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.436684 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.464348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b84c2c1-2b7f-4f5a-88e3-38b5ec74c5e3 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:39.485621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:39.489190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.562832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.581199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port 490c6798-5f2d-462b-b3dc-b39e842ec6d8 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:39.598387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.599173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7d365f1f-98f8-4e87-86ca-895a2b2163fc {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:10:39.608185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.609890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-94ae9b63-4713-4d33-9dbd-f4d61b9ddeb7 admin admin] 10.222.0.18 "DELETE /v2.0/routers/7d365f1f-98f8-4e87-86ca-895a2b2163fc HTTP/1.1" status: 204 len: 168 time: 2.4098413 Dec 21 04:10:39.613322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=490c6798-5f2d-462b-b3dc-b39e842ec6d8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:39.618647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55530) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:39.686708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Deleting subnet a102645d-c1b2-4824-aff9-56e0558bab2d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:39.690615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.699376 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049 (CIDR: 2001:db8:0:1::/64) Dec 21 04:10:39.772867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.773129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:39.773573 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:10:39.773573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:39.782736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.830268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c146368-5b6d-4fb2-bd8f-497a27bfb17c']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:39.845055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54dbd7f6-66e5-4dc2-9166-37ece10fbc93') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:39.845759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54dbd7f6-66e5-4dc2-9166-37ece10fbc93') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:39.861202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.879916 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.895804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6db7dfe2-36fe-4ac9-be6b-6f61f91cca6e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.9122856 Dec 21 04:10:39.897156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:39.897888 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:39.903531 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:39.921737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55534) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:39.921990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:39.922331 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.931232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'subnet': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:39.940563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:39.993694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c63c8fbd-bf16-416b-a4a1-6c9f22321055 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:40.094609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.126109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.129199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cef4c38b-2084-48c7-abce-ca55525fc1ca None None] Network e94ae2ca-4e3f-4500-90fd-ec494b399bda requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:40.141134 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] 10.222.0.18 "DELETE /v2.0/subnets/a102645d-c1b2-4824-aff9-56e0558bab2d HTTP/1.1" status: 204 len: 168 time: 0.5196221 Dec 21 04:10:40.151084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55538) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:40.174788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9bc543d-b731-4e07-8801-79e3a090751f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a102645d-c1b2-4824-aff9-56e0558bab2d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:40.243553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Made reservation on behalf of 37ca6abbbb0c481784292d1c539179ea for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:40.252607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.282990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ffe8e39b-678a-4e86-878d-6207b5a5bcfd no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:40.305357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ffe8e39b-678a-4e86-878d-6207b5a5bcfd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:40.305857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ffe8e39b-678a-4e86-878d-6207b5a5bcfd not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:40.364020 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.425308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.428819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/4c146368-5b6d-4fb2-bd8f-497a27bfb17c HTTP/1.1" status: 204 len: 168 time: 4.4263754 Dec 21 04:10:40.432261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55544) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:40.439093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-304231423'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:40.444637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] DHCP port deletion for e94ae2ca-4e3f-4500-90fd-ec494b399bda request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:40.468389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f458b70-3718-4459-86db-03ee4b9cf3b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=4c146368-5b6d-4fb2-bd8f-497a27bfb17c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:40.476387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.522080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] Deleting port 1182479a-6580-4470-ac4c-ca6e5ae9b565 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:40.522369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.585485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:40.588931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.589860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38d4130-6264-4ea6-9745-dbf6dd2f8987 req-7d431a6a-9185-4272-97bd-0ad823252e67 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:40.591405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c38d4130-6264-4ea6-9745-dbf6dd2f8987 req-7d431a6a-9185-4272-97bd-0ad823252e67 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 944 time: 0.0969949 Dec 21 04:10:40.608105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] For port 1182479a-6580-4470-ac4c-ca6e5ae9b565, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1182479a-6580-4470-ac4c-ca6e5ae9b565,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:40.609527 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.614802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 132, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:40.633458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] Calling delete_port for 1182479a-6580-4470-ac4c-ca6e5ae9b565 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:40.649407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.649841 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 90e70ab5-bc82-4f13-bb53-c513cd33ca79 of type vlan for network e14edd5f-4b76-4991-8253-54e4e839727e Dec 21 04:10:40.678544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Deleting port 1182479a-6580-4470-ac4c-ca6e5ae9b565 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:40.678888 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.708465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.732150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c38d4130-6264-4ea6-9745-dbf6dd2f8987 req-097c6f1a-76cf-4cbb-9eea-93472a404627 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146882 Dec 21 04:10:40.745246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cc520175-7567-482f-b183-4c12d93544ce up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:40.788952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] For port 1182479a-6580-4470-ac4c-ca6e5ae9b565, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1182479a-6580-4470-ac4c-ca6e5ae9b565,segment=NetworkSegment(6f1cb001-1e6d-4abe-b607-9270a6c39719),segment_id=6f1cb001-1e6d-4abe-b607-9270a6c39719)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:40.789480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.813816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:40.815625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Calling delete_port for 1182479a-6580-4470-ac4c-ca6e5ae9b565 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:40.820457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:40.821067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.002839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.139296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=e14edd5f-4b76-4991-8253-54e4e839727e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:41.144498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.144872 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c3a018b-f263-42b9-a8c2-73174b7f47bb tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.5214617 Dec 21 04:10:41.144872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55560) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:41.145192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.145419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:41.145652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] No DVR routers for this DVR port 1182479a-6580-4470-ac4c-ca6e5ae9b565 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:41.145875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:41.146094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e0ab2d-f172-48a2-aaf1-d819fa0bd199 None None] Pushing event deleted for resources: {'Port': ['ID=1182479a-6580-4470-ac4c-ca6e5ae9b565,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:41.146094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e14edd5f-4b76-4991-8253-54e4e839727e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:41.146094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port cc520175-7567-482f-b183-4c12d93544ce completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:10:41.146602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:41.146602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Pushing event deleted for resources: {'Port': ['ID=1182479a-6580-4470-ac4c-ca6e5ae9b565,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:41.146602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] No DVR routers for this DVR port 1182479a-6580-4470-ac4c-ca6e5ae9b565 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:41.146602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:41.146602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.147227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d463527-c17f-449c-8666-dc26ef987d2d None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:41.147227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port cc520175-7567-482f-b183-4c12d93544ce triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:41.147227 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.172142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Subnet': ['ID=c91ce7ad-ca02-43ec-97c0-05035554ccd2,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:41.253793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.295698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8f5bf5c-8aee-43c8-bfdd-a2bc77b7c5c7 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.3680217 Dec 21 04:10:41.295698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55570) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:41.301892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-15410217', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'c91ce7ad-ca02-43ec-97c0-05035554ccd2'}], 'security_groups': ['0b3ff5d5-b540-44c6-91b8-426e856cde0d', 'b11966a3-db0a-499c-90e9-72b4c0925018']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:41.306903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e94ae2ca-4e3f-4500-90fd-ec494b399bda']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:41.342016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f1cb001-1e6d-4abe-b607-9270a6c39719') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:41.342379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f1cb001-1e6d-4abe-b607-9270a6c39719') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:41.361511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.374209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:41.378585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 299ed012-5300-4afc-af12-c5766a47a8eb no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:41.380244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.410403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 299ed012-5300-4afc-af12-c5766a47a8eb {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:41.410764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 299ed012-5300-4afc-af12-c5766a47a8eb not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:41.411125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1182479a-6580-4470-ac4c-ca6e5ae9b565 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:41.420954 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.445786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.460915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Releasing vlan 136 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:41.461672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:41.463499 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:41.480225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1182479a-6580-4470-ac4c-ca6e5ae9b565 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:41.480587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1182479a-6580-4470-ac4c-ca6e5ae9b565 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:41.488220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing IP validity checks on allocation pools {{(pid=110311) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 04:10:41.488918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110311) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 04:10:41.490228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e729315-fba6-48de-be23-a59b45172796', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc520175-7567-482f-b183-4c12d93544ce'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:41.492540 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab6e6c68-01e1-44b6-877b-5415e2b13363" -d '{"events": [{"server_uuid": "4e729315-fba6-48de-be23-a59b45172796", "name": "network-vif-plugged", "status": "completed", "tag": "cc520175-7567-482f-b183-4c12d93544ce"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:41.517910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cc520175-7567-482f-b183-4c12d93544ce, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cc520175-7567-482f-b183-4c12d93544ce,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:41.580394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.584850 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec8a31c4-6902-4e93-b48f-a8cabc224f6c x-openstack-request-id: req-ec8a31c4-6902-4e93-b48f-a8cabc224f6c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:41.585157 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e729315-fba6-48de-be23-a59b45172796", "name": "network-vif-plugged", "status": "completed", "tag": "cc520175-7567-482f-b183-4c12d93544ce", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:41.585449 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ec8a31c4-6902-4e93-b48f-a8cabc224f6c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:41.585852 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e729315-fba6-48de-be23-a59b45172796', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc520175-7567-482f-b183-4c12d93544ce', 'code': 200} Dec 21 04:10:41.614347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.638043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.658894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af40742a-79df-4724-858c-37771280f988 None None] Update dhcp port {'port': {'network_id': '4d7bf9bb-c744-49be-bfb6-28f1087deba3', 'fixed_ips': [{'subnet_id': 'cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'e090503e-949d-472a-a80f-9fa4fef88113', 'ip_address': '2001:db8::2'}, {'subnet_id': 'c91ce7ad-ca02-43ec-97c0-05035554ccd2'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:10:41.667766 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.671472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] 10.222.0.18 "DELETE /v2.0/networks/e94ae2ca-4e3f-4500-90fd-ec494b399bda HTTP/1.1" status: 204 len: 168 time: 1.5178411 Dec 21 04:10:41.682298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcaa0bd-053f-4c09-ab5f-073626d5e69f admin admin] Pushing event deleted for resources: {'Network': ['ID=e94ae2ca-4e3f-4500-90fd-ec494b399bda,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:41.703849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cc520175-7567-482f-b183-4c12d93544ce,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:41.707509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af40742a-79df-4724-858c-37771280f988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:41.827447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71fd4f0a-c035-4fda-b74f-119bea56fc2a req-c1191a8d-23d2-4307-b52a-a8c25ea5c778 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:41.833097 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71fd4f0a-c035-4fda-b74f-119bea56fc2a req-c1191a8d-23d2-4307-b52a-a8c25ea5c778 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1097 time: 0.1014144 Dec 21 04:10:41.952365 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-71fd4f0a-c035-4fda-b74f-119bea56fc2a req-2e9bd32c-bf4c-4393-9760-c4da84692c50 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1093452 Dec 21 04:10:41.974036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae16954-c12c-4abe-911b-447f83964916 req-e43a88e0-8ed2-4f72-ab68-4bbddef5b228 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:41.975582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ae16954-c12c-4abe-911b-447f83964916 req-e43a88e0-8ed2-4f72-ab68-4bbddef5b228 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.1305890 Dec 21 04:10:42.031104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.089651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55592) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:42.094886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=8b63fcd2-b105-4bcf-a8ad-eda48f9ad21a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:42.136175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Delete allocated IP 2001:db8::319 (4d7bf9bb-c744-49be-bfb6-28f1087deba3/e090503e-949d-472a-a80f-9fa4fef88113) {{(pid=110310) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 21 04:10:42.141556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '90e70ab5-bc82-4f13-bb53-c513cd33ca79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:42.141913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: e14edd5f-4b76-4991-8253-54e4e839727e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:42.158550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ae16954-c12c-4abe-911b-447f83964916 req-7bdedaa4-d322-4caa-bfec-1d1ea4412300 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1561048 Dec 21 04:10:42.162847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Allocated IP 2001:db8:0:2::33c (4d7bf9bb-c744-49be-bfb6-28f1087deba3/c91ce7ad-ca02-43ec-97c0-05035554ccd2/aa0f5ad3-663e-4d6b-98c6-87e6525faf5d) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:42.199290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-71a865b7-677d-4145-9fe2-2d58b8382d8e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3f578ba291d54826a6db2accb249f808&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1060090 Dec 21 04:10:42.200580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55596) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:42.238151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network e14edd5f-4b76-4991-8253-54e4e839727e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:42.277647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ecfd5f6-fd5d-4270-9bf1-196bc252913e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.300118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ecfd5f6-fd5d-4270-9bf1-196bc252913e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.351081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e14edd5f-4b76-4991-8253-54e4e839727e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:42.356337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:42.357274 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.361519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-676445ea-e61f-454f-af2f-264b974a044c None None] Network e14edd5f-4b76-4991-8253-54e4e839727e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:42.432101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.436694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ecfd5f6-fd5d-4270-9bf1-196bc252913e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.441272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ecfd5f6-fd5d-4270-9bf1-196bc252913e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.441272 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6ecfd5f6-fd5d-4270-9bf1-196bc252913e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a36f8400-b925-4328-a7ef-88ff5cb8343a HTTP/1.1" status: 204 len: 168 time: 0.2390938 Dec 21 04:10:42.464110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ecfd5f6-fd5d-4270-9bf1-196bc252913e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a36f8400-b925-4328-a7ef-88ff5cb8343a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:42.480917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-e14edd5f-4b76-4991-8253-54e4e839727e', 'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '8b63fcd2-b105-4bcf-a8ad-eda48f9ad21a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:42.481768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.502231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e40e6c9-8754-4e57-a4bf-efd4b91d950d tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 1.5423672 Dec 21 04:10:42.505028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55610) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:42.585615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.663723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.690791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Allocated IP 172.20.0.3 (e14edd5f-4b76-4991-8253-54e4e839727e/8b63fcd2-b105-4bcf-a8ad-eda48f9ad21a/dd1f914a-296e-412e-a7d4-0a02c232ff35) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:42.693525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] In _notify_port_updated(), no bound segment for port aa0f5ad3-663e-4d6b-98c6-87e6525faf5d on network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:10:42.693785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-af40742a-79df-4724-858c-37771280f988 None None] Allocated IP 2001:db8:0:2::2 (4d7bf9bb-c744-49be-bfb6-28f1087deba3/c91ce7ad-ca02-43ec-97c0-05035554ccd2/aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:42.699691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:42.700047 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.704594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "PUT /v2.0/ports/aa0f5ad3-663e-4d6b-98c6-87e6525faf5d HTTP/1.1" status: 200 len: 968 time: 1.4054060 Dec 21 04:10:42.705794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55616) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:42.745102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3328f297-231e-4bbc-a401-172b63dc870e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event updated for resources: {'Port': ['ID=aa0f5ad3-663e-4d6b-98c6-87e6525faf5d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:42.895787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port aa0f5ad3-663e-4d6b-98c6-87e6525faf5d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:42.895787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:42.946692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-af40742a-79df-4724-858c-37771280f988 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:42.993969 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.028327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af40742a-79df-4724-858c-37771280f988 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.043357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.082583 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.115029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af40742a-79df-4724-858c-37771280f988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.115399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for aa0f5ad3-663e-4d6b-98c6-87e6525faf5d owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:43.133376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Network e14edd5f-4b76-4991-8253-54e4e839727e is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:43.174267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:43.193534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:43.243916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Pushing event updated for resources: {'Port': ['ID=dd1f914a-296e-412e-a7d4-0a02c232ff35,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:43.297229 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.427190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Attempting to bind port dd1f914a-296e-412e-a7d4-0a02c232ff35 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:43.428219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Attempting to bind port dd1f914a-296e-412e-a7d4-0a02c232ff35 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '90e70ab5-bc82-4f13-bb53-c513cd33ca79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:43.428804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Attempting to bind port dd1f914a-296e-412e-a7d4-0a02c232ff35 on network e14edd5f-4b76-4991-8253-54e4e839727e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:43.452791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a3a569-4186-4930-a32a-056e4692057f req-e1ce3c48-31b6-42cd-b941-94d885857eea tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:43.454366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5a3a569-4186-4930-a32a-056e4692057f req-e1ce3c48-31b6-42cd-b941-94d885857eea tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.1586325 Dec 21 04:10:43.467148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af40742a-79df-4724-858c-37771280f988 None None] Pushing event updated for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:43.471888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:43.472132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Checking segment: {'id': '90e70ab5-bc82-4f13-bb53-c513cd33ca79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:43.472537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.473350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Bound using segment: {'id': '90e70ab5-bc82-4f13-bb53-c513cd33ca79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:43.473840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Bound port: dd1f914a-296e-412e-a7d4-0a02c232ff35, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '90e70ab5-bc82-4f13-bb53-c513cd33ca79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': 'e14edd5f-4b76-4991-8253-54e4e839727e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:43.474227 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.534529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.602108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] For port dd1f914a-296e-412e-a7d4-0a02c232ff35, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:43.603366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5a3a569-4186-4930-a32a-056e4692057f req-397767b3-0e82-490a-a486-72402ef2c386 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1381893 Dec 21 04:10:43.634323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=8b63fcd2-b105-4bcf-a8ad-eda48f9ad21a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:43.637409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] For port dd1f914a-296e-412e-a7d4-0a02c232ff35, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dd1f914a-296e-412e-a7d4-0a02c232ff35,segment=NetworkSegment(90e70ab5-bc82-4f13-bb53-c513cd33ca79),segment_id=90e70ab5-bc82-4f13-bb53-c513cd33ca79)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:43.716101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.733773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.748090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e14edd5f-4b76-4991-8253-54e4e839727e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:43.757236 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.780013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90e70ab5-bc82-4f13-bb53-c513cd33ca79') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:43.780320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90e70ab5-bc82-4f13-bb53-c513cd33ca79') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:43.783306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=aa0f5ad3-663e-4d6b-98c6-87e6525faf5d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:43.814886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.843795 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.850920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.854268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:43.855083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-de8ddbd6-6ce5-45d4-b447-1a304d269afe tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/aa0f5ad3-663e-4d6b-98c6-87e6525faf5d HTTP/1.1" status: 204 len: 168 time: 1.1492064 Dec 21 04:10:43.859436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:43.863550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55648) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:43.866104 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:43.929644 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-4505d1ef-3746-4f72-ab51-d3389c008314 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] GET failed (client error): The resource could not be found. Dec 21 04:10:43.931334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4505d1ef-3746-4f72-ab51-d3389c008314 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports/aa0f5ad3-663e-4d6b-98c6-87e6525faf5d HTTP/1.1" status: 404 len: 333 time: 0.0666122 Dec 21 04:10:43.941448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55652) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:43.953907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8037b2f5-6af1-449f-8e1a-71f046355715 None None] Pushing event updated for resources: {'Port': ['ID=dd1f914a-296e-412e-a7d4-0a02c232ff35,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:44.038002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88bbd2d9-13a5-474c-9870-ad6b8e0335c9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.073347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:10:44.073347 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:10:44.073347 n-d-822053-11 neutron-server[110311]: [parameters: {'id': 'e14edd5f-4b76-4991-8253-54e4e839727e'}] Dec 21 04:10:44.073347 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:44.074966 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:44.083480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88bbd2d9-13a5-474c-9870-ad6b8e0335c9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.219734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88bbd2d9-13a5-474c-9870-ad6b8e0335c9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.222386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88bbd2d9-13a5-474c-9870-ad6b8e0335c9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.223608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-88bbd2d9-13a5-474c-9870-ad6b8e0335c9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/security-groups/4ec3bce7-ca6c-4082-8a13-a6efd6b17327 HTTP/1.1" status: 204 len: 168 time: 0.2811544 Dec 21 04:10:44.226313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55660) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:44.239656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88bbd2d9-13a5-474c-9870-ad6b8e0335c9 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ec3bce7-ca6c-4082-8a13-a6efd6b17327,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:44.345691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b37afd9-bb5f-4361-801d-8c5c377f013d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.403495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b37afd9-bb5f-4361-801d-8c5c377f013d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.550086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b37afd9-bb5f-4361-801d-8c5c377f013d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.552912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b37afd9-bb5f-4361-801d-8c5c377f013d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.554488 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8b37afd9-bb5f-4361-801d-8c5c377f013d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/security-groups/b11966a3-db0a-499c-90e9-72b4c0925018 HTTP/1.1" status: 204 len: 168 time: 0.3267796 Dec 21 04:10:44.561093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55672) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:44.570364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b37afd9-bb5f-4361-801d-8c5c377f013d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b11966a3-db0a-499c-90e9-72b4c0925018,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:44.577035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.651184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port dd1f914a-296e-412e-a7d4-0a02c232ff35 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:44.651184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.654701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8604c55f-2af2-4172-9efc-060f6167c122 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.699520 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8604c55f-2af2-4172-9efc-060f6167c122 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.828272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port dd1f914a-296e-412e-a7d4-0a02c232ff35, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dd1f914a-296e-412e-a7d4-0a02c232ff35,segment=NetworkSegment(90e70ab5-bc82-4f13-bb53-c513cd33ca79),segment_id=90e70ab5-bc82-4f13-bb53-c513cd33ca79)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:44.828272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.850003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for dd1f914a-296e-412e-a7d4-0a02c232ff35 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:44.864738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-265e0021-4ce7-4350-b119-7d3020786c23 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:44.865754 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-265e0021-4ce7-4350-b119-7d3020786c23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.874182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2e5d51-c48b-4d23-b765-246f246f66c0 req-ac2843be-7f0c-4523-b9f0-fdb118f86f24 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:44.876591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd2e5d51-c48b-4d23-b765-246f246f66c0 req-ac2843be-7f0c-4523-b9f0-fdb118f86f24 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.1349235 Dec 21 04:10:44.931456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8604c55f-2af2-4172-9efc-060f6167c122 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.939418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8604c55f-2af2-4172-9efc-060f6167c122 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:44.945249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8604c55f-2af2-4172-9efc-060f6167c122 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/security-groups/0b3ff5d5-b540-44c6-91b8-426e856cde0d HTTP/1.1" status: 204 len: 168 time: 0.3847318 Dec 21 04:10:44.951611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:44.997315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8604c55f-2af2-4172-9efc-060f6167c122 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b3ff5d5-b540-44c6-91b8-426e856cde0d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:45.050265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet e090503e-949d-472a-a80f-9fa4fef88113 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:45.071412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.098386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd2e5d51-c48b-4d23-b765-246f246f66c0 req-1d89dbb7-0011-4b9d-a50f-b7e696f84099 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2150834 Dec 21 04:10:45.150152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.176858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-265e0021-4ce7-4350-b119-7d3020786c23 None None] Could not find standard attr ID for object aa0f5ad3-663e-4d6b-98c6-87e6525faf5d. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:10:45.194985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-265e0021-4ce7-4350-b119-7d3020786c23 None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:45.195634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-265e0021-4ce7-4350-b119-7d3020786c23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.269038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-265e0021-4ce7-4350-b119-7d3020786c23 None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:45.313388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.386620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d4f3f154-2e49-469f-9e77-e86e1963a24a None None] Could not find standard attr ID for object aa0f5ad3-663e-4d6b-98c6-87e6525faf5d. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:10:45.402890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.580593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=dd1f914a-296e-412e-a7d4-0a02c232ff35,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:45.600191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port dd1f914a-296e-412e-a7d4-0a02c232ff35 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:45.648779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dd1f914a-296e-412e-a7d4-0a02c232ff35 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:45.676687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.729125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: dd1f914a-296e-412e-a7d4-0a02c232ff35 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:45.729482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dd1f914a-296e-412e-a7d4-0a02c232ff35 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Dec 21 04:10:45.753234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=e090503e-949d-472a-a80f-9fa4fef88113,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:45.828860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Port dd1f914a-296e-412e-a7d4-0a02c232ff35 not found, will not notify nova. {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Dec 21 04:10:45.830451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:10:45.892845 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.900478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f04c6b82-5ee6-4ef9-a1f3-7f56098ab03b None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:45.901055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-16853b8b-5a94-4fbf-9118-388e571a248e tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/e090503e-949d-472a-a80f-9fa4fef88113 HTTP/1.1" status: 204 len: 168 time: 0.9474547 Dec 21 04:10:45.904405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cadb8d5a-812a-4ae8-ae13-6a36d5ef18d8 req-22420888-1151-44a0-8900-26aa7aa143e5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:45.910305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55718) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:45.912911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cadb8d5a-812a-4ae8-ae13-6a36d5ef18d8 req-22420888-1151-44a0-8900-26aa7aa143e5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.3939919 Dec 21 04:10:45.925505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:45.930789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cadb8d5a-812a-4ae8-ae13-6a36d5ef18d8 req-44341f38-d1e2-4bd1-b519-eea40321f3d7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0116513 Dec 21 04:10:45.987299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17e0edc2-8b71-491a-aa3d-63e3c4b5318a None None] Network e14edd5f-4b76-4991-8253-54e4e839727e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:46.026329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e14edd5f-4b76-4991-8253-54e4e839727e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:46.050001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cadb8d5a-812a-4ae8-ae13-6a36d5ef18d8 req-1749c943-3c42-4008-9c7f-a9a01dc4be10 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1134343 Dec 21 04:10:46.075295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet c91ce7ad-ca02-43ec-97c0-05035554ccd2 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:46.089060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90e70ab5-bc82-4f13-bb53-c513cd33ca79') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:46.089060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90e70ab5-bc82-4f13-bb53-c513cd33ca79') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:46.089060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.176526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.291951 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.300654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:46.301109 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.321919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.343783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cf30af00-0bc3-4044-b03e-98bf2d153af8 None None] Could not find standard attr ID for object dd1f914a-296e-412e-a7d4-0a02c232ff35. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:10:46.372965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cadb8d5a-812a-4ae8-ae13-6a36d5ef18d8 req-a1ae588f-3bcf-4734-9955-26de7245a5a7 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2862408 Dec 21 04:10:46.385609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:46.385609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:46.391229 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:46.396963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.527916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cadb8d5a-812a-4ae8-ae13-6a36d5ef18d8 req-3d69f933-b2e3-49a5-9272-ba2c663478c0 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1538420 Dec 21 04:10:46.587364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c42adb81-9429-4da4-9065-d5d2113349c9 None None] DHCP port deletion for e14edd5f-4b76-4991-8253-54e4e839727e request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:46.696889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.710710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.719209 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/e14edd5f-4b76-4991-8253-54e4e839727e HTTP/1.1" status: 204 len: 168 time: 4.2075410 Dec 21 04:10:46.719209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.720826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:46.735389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1516897312'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:46.759368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55e61a2-a873-41dc-9252-9ddd943c14b3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=e14edd5f-4b76-4991-8253-54e4e839727e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:46.850518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=c91ce7ad-ca02-43ec-97c0-05035554ccd2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:46.854212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:46.859376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.867726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:46.879360 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-50406bea-1f15-4b79-8ab5-488c3b629211 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/c91ce7ad-ca02-43ec-97c0-05035554ccd2 HTTP/1.1" status: 204 len: 168 time: 0.9533217 Dec 21 04:10:46.880118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55756) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:46.909222 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-e3520d91-e32e-4f30-a0b7-a28be8cb30e3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:46.909686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e3520d91-e32e-4f30-a0b7-a28be8cb30e3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:46.913173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e3520d91-e32e-4f30-a0b7-a28be8cb30e3 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/e090503e-949d-472a-a80f-9fa4fef88113 HTTP/1.1" status: 404 len: 337 time: 0.0316334 Dec 21 04:10:46.920998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55758) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:46.987508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:47.018660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:47.019485 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 12e7513d-6edc-4311-b121-20223365d622 of type vlan for network baa3a525-fbfd-4a98-9b5c-786bb4f6931d Dec 21 04:10:47.055670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting subnet cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:10:47.418429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dd1f914a-296e-412e-a7d4-0a02c232ff35 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:47.471490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: dd1f914a-296e-412e-a7d4-0a02c232ff35 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:47.476432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dd1f914a-296e-412e-a7d4-0a02c232ff35 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:47.606921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:47.723604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:47.805384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:47.832382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67c5f3cf-9b7c-4d30-996e-13e0ca044583 None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:47.865642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:47.910201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8a0012fe-b0c2-410a-b7f0-beb6c88242fe None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:47.910577 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a0012fe-b0c2-410a-b7f0-beb6c88242fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.045844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-3edb26fb-e218-403d-90df-0fc336fee0ba tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:48.076773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-3edb26fb-e218-403d-90df-0fc336fee0ba tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.1378093 Dec 21 04:10:48.076773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.079089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:48.079724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.104615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8a0012fe-b0c2-410a-b7f0-beb6c88242fe None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:48.105811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a0012fe-b0c2-410a-b7f0-beb6c88242fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.116753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-e3ecd11a-7dc6-4edd-8a4e-3805a86a0125 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0618064 Dec 21 04:10:48.154736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8a0012fe-b0c2-410a-b7f0-beb6c88242fe None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:48.205826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=baa3a525-fbfd-4a98-9b5c-786bb4f6931d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:48.210826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a6b8b49-8069-4b0b-a777-a56d55935ba6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.4818611 Dec 21 04:10:48.214690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55818) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.218888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network baa3a525-fbfd-4a98-9b5c-786bb4f6931d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:48.222276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:48.239125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7b5d7d30-b663-4dc8-9ea0-2724789b78f9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1148005 Dec 21 04:10:48.345429 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.433128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Subnet': ['ID=cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:48.436259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.443084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f723e17-995e-4cd2-ac61-d83b19ac06ba tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/cf6e3397-6922-4e8c-8ab0-8f7aa9c1b049 HTTP/1.1" status: 204 len: 168 time: 1.5186355 Dec 21 04:10:48.444274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.475447 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-0096cd9c-5421-40ea-8378-b8d4e4dd90c0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.475922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0096cd9c-5421-40ea-8378-b8d4e4dd90c0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.480549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0096cd9c-5421-40ea-8378-b8d4e4dd90c0 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/15d2a74b-717d-4fcc-b76d-b617800ea5e5 HTTP/1.1" status: 404 len: 337 time: 0.0352049 Dec 21 04:10:48.482348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:48.484621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55828) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.488069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:48.529195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-a22fb01e-7779-494e-9c05-8045f096514d service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2733693 Dec 21 04:10:48.584905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55830) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.586395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8cc861df-7623-4df7-9a3d-dcbe79a0db3b tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "GET /v2.0/ports?device_id=b450a5c7-09d0-4139-b86c-da72d572e127 HTTP/1.1" status: 200 len: 205 time: 0.0927634 Dec 21 04:10:48.626864 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-025010dc-da6c-476e-94c6-0307bb1c0b93 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] delete failed (client error): The resource could not be found. Dec 21 04:10:48.631076 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-025010dc-da6c-476e-94c6-0307bb1c0b93 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/routers/b450a5c7-09d0-4139-b86c-da72d572e127 HTTP/1.1" status: 404 len: 336 time: 0.0463889 Dec 21 04:10:48.631319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.671063 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9694793d-226e-468b-9a7b-b26d1c63e205 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.672059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9694793d-226e-468b-9a7b-b26d1c63e205 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.678528 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9694793d-226e-468b-9a7b-b26d1c63e205 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/751ffce1-99da-4983-a5c7-6fe8c9ab2d05 HTTP/1.1" status: 404 len: 337 time: 0.0421576 Dec 21 04:10:48.679454 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.708391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-0a527ef4-fb7e-4390-b7e0-d8352f0b40d1 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1751771 Dec 21 04:10:48.761943 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f9b1a4a-44e6-4129-b2d5-1a98fcbfad0d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.767036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f9b1a4a-44e6-4129-b2d5-1a98fcbfad0d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.771317 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f9b1a4a-44e6-4129-b2d5-1a98fcbfad0d tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/aa3235bc-318f-4bca-946f-4446aee8c4c4 HTTP/1.1" status: 404 len: 337 time: 0.0843811 Dec 21 04:10:48.777267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55844) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.828565 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7d32116-5e21-4c72-a8e8-3aa66b55d2fb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.829733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a7d32116-5e21-4c72-a8e8-3aa66b55d2fb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.833114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a7d32116-5e21-4c72-a8e8-3aa66b55d2fb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/bc134b15-bbee-46f8-b1d2-eb65311bcd63 HTTP/1.1" status: 404 len: 337 time: 0.0545733 Dec 21 04:10:48.835704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55846) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.885163 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-639d599d-7a49-445a-b87e-5717c8038d74 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.885767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-639d599d-7a49-445a-b87e-5717c8038d74 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.889014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-639d599d-7a49-445a-b87e-5717c8038d74 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/ae9e69ae-0299-4d58-bb28-883fe265456a HTTP/1.1" status: 404 len: 333 time: 0.0523489 Dec 21 04:10:48.899022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55850) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.947393 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-d35acbe3-228c-483e-a090-9c199564f382 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.947393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d35acbe3-228c-483e-a090-9c199564f382 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.947890 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d35acbe3-228c-483e-a090-9c199564f382 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/bf6daeea-75bc-4c98-8ce0-aeeacaf305cc HTTP/1.1" status: 404 len: 337 time: 0.0472441 Dec 21 04:10:48.950682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55854) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:48.981608 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b1054e9-7952-47b5-997a-b52c2be6afaf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:48.982426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7b1054e9-7952-47b5-997a-b52c2be6afaf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:48.986498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7b1054e9-7952-47b5-997a-b52c2be6afaf tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/ce363db3-6723-4603-8670-e5e6800dd170 HTTP/1.1" status: 404 len: 337 time: 0.0347755 Dec 21 04:10:48.989036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55856) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:49.026230 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6d27038-c4c0-4384-99a0-49d2b2f3e57f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:49.027082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a6d27038-c4c0-4384-99a0-49d2b2f3e57f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:49.031184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a6d27038-c4c0-4384-99a0-49d2b2f3e57f tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/915ddfd2-ad16-49ba-8cbc-a9c22a3fddc3 HTTP/1.1" status: 404 len: 333 time: 0.0403614 Dec 21 04:10:49.034407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55862) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:49.050884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.090799 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac117211-efb6-4c1f-9abe-0d6d5b75d3f8 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:49.091686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac117211-efb6-4c1f-9abe-0d6d5b75d3f8 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:49.097824 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ac117211-efb6-4c1f-9abe-0d6d5b75d3f8 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/390f90eb-d3ad-47a8-865d-ff7cf6f3e775 HTTP/1.1" status: 404 len: 337 time: 0.0596144 Dec 21 04:10:49.098439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55866) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:49.124859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7966a62-2c8a-4c81-8379-cda7e68fbd69 None None] Network 4d7bf9bb-c744-49be-bfb6-28f1087deba3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:49.159634 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-c0ce1915-f1f4-456f-bad1-0974541f9f41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] DELETE failed (client error): The resource could not be found. Dec 21 04:10:49.160210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c0ce1915-f1f4-456f-bad1-0974541f9f41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:10:49.165960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0ce1915-f1f4-456f-bad1-0974541f9f41 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/subnets/8069bf6d-f683-4bb4-a2ff-61b5579bc456 HTTP/1.1" status: 404 len: 337 time: 0.0641828 Dec 21 04:10:49.166314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:49.243475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8f9bea1-fb27-456e-bdc3-de855e10b299 req-95465f18-418c-43c7-8e3a-4a9936fe8462 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 210 time: 0.0785327 Dec 21 04:10:49.249910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '12e7513d-6edc-4311-b121-20223365d622', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:49.250956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: baa3a525-fbfd-4a98-9b5c-786bb4f6931d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:49.255846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=f81702c6-5868-4b89-b010-4116d4ae25d0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:49.314389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c90e72ce-166e-4dd9-9c19-939751d06797 None None] Provisioning complete for port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:49.314764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c90e72ce-166e-4dd9-9c19-939751d06797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.331297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port da787046-7c07-4994-922f-d4afd6a3e498 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:49.331942 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.402150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network baa3a525-fbfd-4a98-9b5c-786bb4f6931d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:49.435485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.449774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for da787046-7c07-4994-922f-d4afd6a3e498 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:49.476502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c90e72ce-166e-4dd9-9c19-939751d06797 None None] Provisioning complete for port da787046-7c07-4994-922f-d4afd6a3e498 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:49.476869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c90e72ce-166e-4dd9-9c19-939751d06797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.513204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, baa3a525-fbfd-4a98-9b5c-786bb4f6931d) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:49.520787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:49.521461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.556755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef9c22f7-444a-422a-a838-461c20676a2a None None] Network baa3a525-fbfd-4a98-9b5c-786bb4f6931d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:49.569106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] DHCP port deletion for 4d7bf9bb-c744-49be-bfb6-28f1087deba3 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:49.630810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fe400b45-1bc7-48bf-8a56-32652ffc5963 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.4139135 Dec 21 04:10:49.668715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c90e72ce-166e-4dd9-9c19-939751d06797 None None] Port da787046-7c07-4994-922f-d4afd6a3e498 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:49.670242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55886) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:49.700722 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.801164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] Deleting port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:49.802217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.807822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=da787046-7c07-4994-922f-d4afd6a3e498,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:49.810570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.815505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-03e69bb2-2f8e-412f-a587-0f68fb752cbb tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/ports/da787046-7c07-4994-922f-d4afd6a3e498 HTTP/1.1" status: 204 len: 168 time: 0.6478102 Dec 21 04:10:49.817475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55894) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:49.819371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-baa3a525-fbfd-4a98-9b5c-786bb4f6931d', 'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': 'f81702c6-5868-4b89-b010-4116d4ae25d0'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:49.820235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.861811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.892630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b81c795d-5f75-4c27-803a-ba4df6f233fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.918068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.923788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:49.924433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.947136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:49.990360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] Calling delete_port for aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:50.028496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Deleting port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:50.028496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.117181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] For port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,segment=NetworkSegment(d914e185-72b4-44bf-8f4a-cf96505aef18),segment_id=d914e185-72b4-44bf-8f4a-cf96505aef18)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:50.117773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.118574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Allocated IP 172.20.0.1 (baa3a525-fbfd-4a98-9b5c-786bb4f6931d/f81702c6-5868-4b89-b010-4116d4ae25d0/d71d23bc-9265-4440-bb78-49da6a3325f5) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:50.159938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Calling delete_port for aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:50.264432 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.265256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.293922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:50.304739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] No DVR routers for this DVR port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:50.325685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] Pushing event deleted for resources: {'Port': ['ID=aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:50.370849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8146ffb-04c1-4181-9f1b-7612dc0c92d9 None None] No DVR routers for this DVR port aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:50.415431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9409d20f-a700-4fc5-b807-b7173d645c12 req-d038091b-a5bc-47a4-baef-ceb129a796d7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 210 time: 0.0710931 Dec 21 04:10:50.435780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.448967 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.470891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4d7bf9bb-c744-49be-bfb6-28f1087deba3']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:50.480632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd914e185-72b4-44bf-8f4a-cf96505aef18') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:50.481003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd914e185-72b4-44bf-8f4a-cf96505aef18') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:50.492522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.509522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.516245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:50.516698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:50.520206 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:50.537397 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.589458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Network baa3a525-fbfd-4a98-9b5c-786bb4f6931d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:50.593545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:50.597235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:50.606158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Pushing event updated for resources: {'Port': ['ID=d71d23bc-9265-4440-bb78-49da6a3325f5,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:50.619638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.654318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=f81702c6-5868-4b89-b010-4116d4ae25d0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:50.654710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.664002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.668396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] 10.222.0.18 "DELETE /v2.0/networks/4d7bf9bb-c744-49be-bfb6-28f1087deba3 HTTP/1.1" status: 204 len: 168 time: 0.8493903 Dec 21 04:10:50.714656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37cf9be5-fc22-4233-9d29-766742eac702 tempest-PortsIpV6TestJSON-1950799963 tempest-PortsIpV6TestJSON-1950799963-project] Pushing event deleted for resources: {'Network': ['ID=4d7bf9bb-c744-49be-bfb6-28f1087deba3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:50.730788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Attempting to bind port d71d23bc-9265-4440-bb78-49da6a3325f5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:50.731955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Attempting to bind port d71d23bc-9265-4440-bb78-49da6a3325f5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '12e7513d-6edc-4311-b121-20223365d622', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:50.734623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Attempting to bind port d71d23bc-9265-4440-bb78-49da6a3325f5 on network baa3a525-fbfd-4a98-9b5c-786bb4f6931d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:50.742846 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.745903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:50.745903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Checking segment: {'id': '12e7513d-6edc-4311-b121-20223365d622', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:50.745903 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.747493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Bound using segment: {'id': '12e7513d-6edc-4311-b121-20223365d622', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:50.748767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Bound port: d71d23bc-9265-4440-bb78-49da6a3325f5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12e7513d-6edc-4311-b121-20223365d622', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:50.749425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.795645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['baa3a525-fbfd-4a98-9b5c-786bb4f6931d']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:50.822339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '12e7513d-6edc-4311-b121-20223365d622') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:50.823594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '12e7513d-6edc-4311-b121-20223365d622') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:50.835880 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.858110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.866278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:50.866278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:50.869956 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:50.897576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] For port d71d23bc-9265-4440-bb78-49da6a3325f5, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:50.964442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] For port d71d23bc-9265-4440-bb78-49da6a3325f5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d71d23bc-9265-4440-bb78-49da6a3325f5,segment=NetworkSegment(12e7513d-6edc-4311-b121-20223365d622),segment_id=12e7513d-6edc-4311-b121-20223365d622)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:51.012984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:10:51.012984 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:10:51.012984 n-d-822053-11 neutron-server[110311]: [parameters: {'id': 'baa3a525-fbfd-4a98-9b5c-786bb4f6931d'}] Dec 21 04:10:51.012984 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:51.013406 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:51.042947 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:51.180722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af04d16-8b63-46ba-9082-3f337cfb00c8 None None] Pushing event updated for resources: {'Port': ['ID=d71d23bc-9265-4440-bb78-49da6a3325f5,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:51.198245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b59d8f6-ad83-4119-8539-e2c42192844d None None] Network baa3a525-fbfd-4a98-9b5c-786bb4f6931d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:51.294626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c12ecb6f-92f2-45a7-8f60-ace1c5e34c37 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:51.383055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:10:51.421984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:10:51.421984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa4a9f1c-ddc6-475e-ad4a-3b349ac0985b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:10:51.463129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55944) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:51.479827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c12ecb6f-92f2-45a7-8f60-ace1c5e34c37 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:51.516496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:51.578103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11b36aa8-861c-4fb1-90c1-04328d9758aa req-77f4d49c-12a2-44c9-bc53-59d96a24b355 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 210 time: 0.0569983 Dec 21 04:10:51.689772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port d71d23bc-9265-4440-bb78-49da6a3325f5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:51.690348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:51.829823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port d71d23bc-9265-4440-bb78-49da6a3325f5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d71d23bc-9265-4440-bb78-49da6a3325f5,segment=NetworkSegment(12e7513d-6edc-4311-b121-20223365d622),segment_id=12e7513d-6edc-4311-b121-20223365d622)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:51.830381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:51.838186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d6755664-3d72-4f3d-a936-7fc9f86c6b29 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=37ca6abbbb0c481784292d1c539179ea&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3686287 Dec 21 04:10:51.838186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 55952) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:51.867091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for d71d23bc-9265-4440-bb78-49da6a3325f5 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:51.871134 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:10:52.057374 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed0dd04-d790-4c6f-ae56-a9edfc99a3a7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.093962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed0dd04-d790-4c6f-ae56-a9edfc99a3a7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.100063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.187731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-bb45d134-a4cf-46e6-89be-3a801a4ee1bf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:52.189409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-bb45d134-a4cf-46e6-89be-3a801a4ee1bf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2190492 Dec 21 04:10:52.195801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=d71d23bc-9265-4440-bb78-49da6a3325f5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:52.202239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port d71d23bc-9265-4440-bb78-49da6a3325f5 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:52.242438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:52.268519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed0dd04-d790-4c6f-ae56-a9edfc99a3a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.274321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed0dd04-d790-4c6f-ae56-a9edfc99a3a7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.275678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9ed0dd04-d790-4c6f-ae56-a9edfc99a3a7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3b523941-b0a1-44a8-82ed-2acce5b05285 HTTP/1.1" status: 204 len: 168 time: 0.4375629 Dec 21 04:10:52.362253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.384180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['baa3a525-fbfd-4a98-9b5c-786bb4f6931d']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:52.406700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '12e7513d-6edc-4311-b121-20223365d622') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:52.407491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '12e7513d-6edc-4311-b121-20223365d622') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:52.436401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.455872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed0dd04-d790-4c6f-ae56-a9edfc99a3a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b523941-b0a1-44a8-82ed-2acce5b05285,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:52.462707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.467727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:52.468807 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:52.473648 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:52.629462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:52.633158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.696869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af806752-17dd-4f15-a76c-fd88e3c9813b req-e6e251ec-cec2-4afc-998c-05c53096a350 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 210 time: 0.0295372 Dec 21 04:10:52.722151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.722711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22283733-63fa-40e0-8803-9ec72abd7e1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.737108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.743892 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/baa3a525-fbfd-4a98-9b5c-786bb4f6931d HTTP/1.1" status: 204 len: 168 time: 3.0704732 Dec 21 04:10:52.753873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 55982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:52.759950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-426800162'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:52.766283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7378b847-926a-4558-b1bf-e7d99231ac14 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=baa3a525-fbfd-4a98-9b5c-786bb4f6931d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:52.871278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.4 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/79d0bdbe-6706-42aa-82a3-e013ef9c92b1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:52.900357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.948355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:52.955908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:52.988238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:53.002827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.003377 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment d4ce6abd-0dd8-410f-a941-88018cdc4db6 of type vlan for network 7f5e6763-89c5-487b-99ca-b8c08713f81e Dec 21 04:10:53.066908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.115897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.339378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.340548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.340963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.350308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:53.352948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.376915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:10:53.459646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:53.485669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:53.499064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:53.507848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:53.550786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44764b0b-7943-4100-8c65-6f2bb916bf58 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:53.576171 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.8204105 Dec 21 04:10:53.576747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56010) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:53.592439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:53.599457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84e5bc5f-c73f-46a8-8087-b79568afd8d4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=7f5e6763-89c5-487b-99ca-b8c08713f81e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:53.615710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7f5e6763-89c5-487b-99ca-b8c08713f81e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:53.650467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:53.651228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.754324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-57faa018-bcdf-49a4-a714-4e940acb221b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5163779 Dec 21 04:10:53.865520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:53.870832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:53.935210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Request body: {'port': {'device_id': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:53.966726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3cd4a9c9-0281-4d0a-acf4-31f92534f647 None None] Provisioning complete for port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:10:53.967306 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3cd4a9c9-0281-4d0a-acf4-31f92534f647 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.005191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3cd4a9c9-0281-4d0a-acf4-31f92534f647 None None] Port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:10:54.044298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-857557e0-8ea9-4a9c-8556-73eaad47791b req-f82ab570-c319-4725-8055-b456ef8b50b6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:54.049955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-857557e0-8ea9-4a9c-8556-73eaad47791b req-f82ab570-c319-4725-8055-b456ef8b50b6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 931 time: 0.2745495 Dec 21 04:10:54.146064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-857557e0-8ea9-4a9c-8556-73eaad47791b req-40034653-52a4-4931-8f38-840697516883 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804708 Dec 21 04:10:54.161088 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.403214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.509850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=eebb900a-42b9-4eda-b47e-d32c6c48eaec,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:54.534424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:10:54.542556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.552589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': 'd4ce6abd-0dd8-410f-a941-88018cdc4db6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:54.553188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 7f5e6763-89c5-487b-99ca-b8c08713f81e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:54.562707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Transition to ACTIVE for port object 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:10:54.605400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56046) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:54.655197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 7f5e6763-89c5-487b-99ca-b8c08713f81e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:54.655429 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.715270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Pushing event updated for resources: {'Port': ['ID=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:54.742130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba984784-ffd8-4cef-a9b1-8b1f9ec052af None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:54.770859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7f5e6763-89c5-487b-99ca-b8c08713f81e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:54.773326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:54.774035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.806559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7121f73a-9b45-4f05-b2e2-647f712f5f6b None None] Network 7f5e6763-89c5-487b-99ca-b8c08713f81e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:54.810966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-2086047201'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:54.837488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Attempting to bind port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:54.842061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Attempting to bind port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:54.842061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Attempting to bind port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:54.845959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:10:54.846619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Attempting to bind port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:54.852277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:54.852620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:54.853009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:54.853502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Bound port: 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:54.853868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:54.898816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-913810fd-3ea1-4a96-abac-0b5bedbe3eba tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 1.3124378 Dec 21 04:10:54.900894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56058) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:55.018283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] For port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:55.023938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] For port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:55.033456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-7f5e6763-89c5-487b-99ca-b8c08713f81e', 'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': 'eebb900a-42b9-4eda-b47e-d32c6c48eaec'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:55.034443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.039782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.086808 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.107287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.173502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:55.183142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.186579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.190835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.270617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.282085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Allocated IP 172.20.0.1 (7f5e6763-89c5-487b-99ca-b8c08713f81e/eebb900a-42b9-4eda-b47e-d32c6c48eaec/d2f53931-3e4e-4d80-bda0-98bc667352b5) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:55.311128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e07e167d-a264-46a4-a81c-7256128d53ce None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:10:55.417908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.477499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:55.478133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.479721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] 10.222.0.31 "PUT /v2.0/ports/79d0bdbe-6706-42aa-82a3-e013ef9c92b1 HTTP/1.1" status: 200 len: 1092 time: 1.5783200 Dec 21 04:10:55.480318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'tag': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:10:55.483067 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89a14c33-b698-445c-9663-3048fb5a1082" -d '{"events": [{"name": "network-changed", "server_uuid": "02062869-7c4a-4d36-b457-3485dbbeeb69", "tag": "79d0bdbe-6706-42aa-82a3-e013ef9c92b1"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:10:55.527650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.563723 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.613147 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:10:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42b31d4a-deec-4370-b1d4-4d90846dbb93 x-openstack-request-id: req-42b31d4a-deec-4370-b1d4-4d90846dbb93 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:10:55.613798 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02062869-7c4a-4d36-b457-3485dbbeeb69", "tag": "79d0bdbe-6706-42aa-82a3-e013ef9c92b1", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:10:55.615837 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-42b31d4a-deec-4370-b1d4-4d90846dbb93 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:10:55.616718 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'tag': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1', 'status': 'completed', 'code': 200} Dec 21 04:10:55.645110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9e52f6-3d0a-4140-92b3-a37dbe834f4f service neutron] Pushing event updated for resources: {'Port': ['ID=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:55.661073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:55.665661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.727986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Pushing event updated for resources: {'Port': ['ID=d2f53931-3e4e-4d80-bda0-98bc667352b5,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:55.734584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49969ad-9f88-4ed1-91d0-c7218841e40b req-38faa6f0-7f3c-4899-af4b-4639adaba4ee tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:55.737335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d49969ad-9f88-4ed1-91d0-c7218841e40b req-38faa6f0-7f3c-4899-af4b-4639adaba4ee tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 943 time: 0.4601624 Dec 21 04:10:55.744055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.745523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1d707fb9-dafd-472a-98d3-cd08816ea15a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:55.774448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Network 7f5e6763-89c5-487b-99ca-b8c08713f81e is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:10:55.779139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:55.787891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.790787 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment ed083fe5-54d3-48a4-b95d-bade9804847a of type vlan for network 3828f0e6-1936-4057-b560-3b5beb4045e1 Dec 21 04:10:55.790977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:10:55.814918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=eebb900a-42b9-4eda-b47e-d32c6c48eaec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:55.874779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a14c33-b698-445c-9663-3048fb5a1082 req-5ededf37-5a2d-442b-80d1-2d22a4e4f530 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:55.891598 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.893881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89a14c33-b698-445c-9663-3048fb5a1082 req-5ededf37-5a2d-442b-80d1-2d22a4e4f530 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 1095 time: 0.2169476 Dec 21 04:10:55.904468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.910377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Attempting to bind port d2f53931-3e4e-4d80-bda0-98bc667352b5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:10:55.912650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Attempting to bind port d2f53931-3e4e-4d80-bda0-98bc667352b5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd4ce6abd-0dd8-410f-a941-88018cdc4db6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:10:55.913648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Attempting to bind port d2f53931-3e4e-4d80-bda0-98bc667352b5 on network 7f5e6763-89c5-487b-99ca-b8c08713f81e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:10:55.919670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:10:55.920045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Checking segment: {'id': 'd4ce6abd-0dd8-410f-a941-88018cdc4db6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:55.920659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.921741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Bound using segment: {'id': 'd4ce6abd-0dd8-410f-a941-88018cdc4db6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:10:55.922395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Bound port: d2f53931-3e4e-4d80-bda0-98bc667352b5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd4ce6abd-0dd8-410f-a941-88018cdc4db6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '7f5e6763-89c5-487b-99ca-b8c08713f81e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:10:55.922991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.941132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7f5e6763-89c5-487b-99ca-b8c08713f81e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:55.951433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4ce6abd-0dd8-410f-a941-88018cdc4db6') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:55.951673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4ce6abd-0dd8-410f-a941-88018cdc4db6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:55.963322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.981332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:55.998370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:56.001923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:56.079234 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:56.109244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] For port d2f53931-3e4e-4d80-bda0-98bc667352b5, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:10:56.113160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] For port d2f53931-3e4e-4d80-bda0-98bc667352b5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2f53931-3e4e-4d80-bda0-98bc667352b5,segment=NetworkSegment(d4ce6abd-0dd8-410f-a941-88018cdc4db6),segment_id=d4ce6abd-0dd8-410f-a941-88018cdc4db6)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:10:56.116697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:10:56.116697 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:10:56.116697 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '7f5e6763-89c5-487b-99ca-b8c08713f81e'}] Dec 21 04:10:56.116697 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:10:56.117284 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:10:56.131361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d49969ad-9f88-4ed1-91d0-c7218841e40b req-f7b47e5a-c6e6-4001-81cf-ecd706657d8f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3801959 Dec 21 04:10:56.141089 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.197027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.261002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a14c33-b698-445c-9663-3048fb5a1082 req-99e526f4-2a53-471e-af32-a16171515567 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:56.262495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89a14c33-b698-445c-9663-3048fb5a1082 req-99e526f4-2a53-471e-af32-a16171515567 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&shared=False HTTP/1.1" status: 200 len: 906 time: 0.3626893 Dec 21 04:10:56.324424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34bbb6b-99ab-4823-856b-2658df2cf558 None None] Pushing event updated for resources: {'Port': ['ID=d2f53931-3e4e-4d80-bda0-98bc667352b5,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:56.349726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f046e024-409e-4b8f-a6b6-b27975d75245 None None] Network 7f5e6763-89c5-487b-99ca-b8c08713f81e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:56.373758 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.380158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:56.380768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.469185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da8ae4bb-6767-40f3-a23a-2514836ecd2c None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:10:56.572643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da8ae4bb-6767-40f3-a23a-2514836ecd2c None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:10:56.618405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.726016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port d2f53931-3e4e-4d80-bda0-98bc667352b5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:10:56.726522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.831477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port d2f53931-3e4e-4d80-bda0-98bc667352b5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2f53931-3e4e-4d80-bda0-98bc667352b5,segment=NetworkSegment(d4ce6abd-0dd8-410f-a941-88018cdc4db6),segment_id=d4ce6abd-0dd8-410f-a941-88018cdc4db6)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:10:56.831859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:56.852560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for d2f53931-3e4e-4d80-bda0-98bc667352b5 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:10:56.901563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=3828f0e6-1936-4057-b560-3b5beb4045e1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:56.918526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a14c33-b698-445c-9663-3048fb5a1082 req-c6234ddf-91df-419a-ae5f-a9c1d12f7d17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:56.920700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89a14c33-b698-445c-9663-3048fb5a1082 req-c6234ddf-91df-419a-ae5f-a9c1d12f7d17 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.6449745 Dec 21 04:10:56.938316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f85efbea-8587-4f8d-b920-e17553cf9578 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 2.3299236 Dec 21 04:10:56.943157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:56.953706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-1326993484'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:56.960854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:57.053787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.076070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-6da1f908-7cbe-4b34-823c-284bf4518f4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:57.080924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-6da1f908-7cbe-4b34-823c-284bf4518f4e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 1095 time: 0.0831745 Dec 21 04:10:57.105278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=d2f53931-3e4e-4d80-bda0-98bc667352b5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:57.107298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port d2f53931-3e4e-4d80-bda0-98bc667352b5 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:10:57.186717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:57.190726 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.194712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-519466c5-2b97-4f69-b8f3-5b8e5e75d037 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=79d0bdbe-6706-42aa-82a3-e013ef9c92b1 HTTP/1.1" status: 200 len: 217 time: 0.0930185 Dec 21 04:10:57.231713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.234060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:57.244581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.245101 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment 7136a056-c705-46da-b88b-c96144a10241 of type vlan for network f19fabbf-793d-46f4-84b3-8eda9c4c1813 Dec 21 04:10:57.277239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7f5e6763-89c5-487b-99ca-b8c08713f81e']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:57.289764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4ce6abd-0dd8-410f-a941-88018cdc4db6') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:57.290402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4ce6abd-0dd8-410f-a941-88018cdc4db6') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:10:57.303957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.322371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.326065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:10:57.326839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.335742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:10:57.352461 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:10:57.440792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.450078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.458041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/7f5e6763-89c5-487b-99ca-b8c08713f81e HTTP/1.1" status: 204 len: 168 time: 2.5525126 Dec 21 04:10:57.459608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56120) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:57.476035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8304a20e-922a-457c-af97-61bc2b2381b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=7f5e6763-89c5-487b-99ca-b8c08713f81e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:57.486350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1515842772'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:57.496306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.502637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:57.503249 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.506443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-065ba0f9-43d7-4407-bc8c-881a3aa705f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:57.507936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-065ba0f9-43d7-4407-bc8c-881a3aa705f7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.3009236 Dec 21 04:10:57.591546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47980248-b91b-45f0-ad2b-d20b8c8007a6 req-258fa6d1-0666-4adc-a6cd-eb44e47560b4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:57.598865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47980248-b91b-45f0-ad2b-d20b8c8007a6 req-258fa6d1-0666-4adc-a6cd-eb44e47560b4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 943 time: 0.1987736 Dec 21 04:10:57.631824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-9ff41216-bb40-4ff9-9e90-7a7d0b9cc8ad service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0879560 Dec 21 04:10:57.665230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.7243297 Dec 21 04:10:57.668173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:57.673825 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:57.724945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0930cb6-4710-451f-a6d7-4dbfbb8761e4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=f19fabbf-793d-46f4-84b3-8eda9c4c1813,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:57.741819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:57.794272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:57.799114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.815400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47980248-b91b-45f0-ad2b-d20b8c8007a6 req-050e20d8-da3d-4c68-8ba7-1b93f55ec344 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2149906 Dec 21 04:10:57.835989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:10:57.854383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.854737 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 1bf90448-93a4-4b87-9abe-4d76e331374a of type vlan for network b62b3c30-1c04-483b-a383-81d38024fd5a Dec 21 04:10:57.874945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-8d9c19df-45ac-4ad3-986b-52ff3af2a906 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2078633 Dec 21 04:10:57.923752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:57.928752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:57.940731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.060954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4cc29b5f-90a5-47cb-ae43-7cd01bb07842 req-41ceb457-d4a3-43fc-9e0e-6b876b01ba16 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1614063 Dec 21 04:10:58.093926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.099641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:58.100254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.178458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:58.235374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7752848 Dec 21 04:10:58.237163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:58.243757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762eb48f-f856-4f2c-b8c7-5c55e3054202 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=b62b3c30-1c04-483b-a383-81d38024fd5a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:58.244284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'New_network'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:58.256745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:58.359615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.407750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-086ace8c-2854-4c10-8596-7f30604264f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.517253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=fe4221c6-2b9e-4315-a77a-14834fb1e3ba,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:58.562561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': 'ed083fe5-54d3-48a4-b95d-bade9804847a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:58.562974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: 3828f0e6-1936-4057-b560-3b5beb4045e1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:58.575000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.643671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-086ace8c-2854-4c10-8596-7f30604264f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.802514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.802514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network b62b3c30-1c04-483b-a383-81d38024fd5a is not hosted by any dhcp agent {{(pid=110311) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 04:10:58.802514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:58.802514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.802514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "PUT /v2.0/networks/b62b3c30-1c04-483b-a383-81d38024fd5a HTTP/1.1" status: 200 len: 723 time: 0.5438499 Dec 21 04:10:58.804293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:58.804293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:58.862750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d37e5f6-e2c5-4d03-9cd0-faebc0bb74f0 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=b62b3c30-1c04-483b-a383-81d38024fd5a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:58.875285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:10:58.886886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:58.894331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-086ace8c-2854-4c10-8596-7f30604264f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:58.937190 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-086ace8c-2854-4c10-8596-7f30604264f2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2068b8412e6045fb8867fd2c0be60998&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7542663 Dec 21 04:10:58.937190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:58.994036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086ace8c-2854-4c10-8596-7f30604264f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d27c8aa-cab0-4fb8-9951-7aff45128334,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:59.008325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931c2dad-d2c2-463b-87b2-c01f91ef917b req-31edda68-8e08-4708-b30f-2d530ab1f5ea tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:59.009814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-931c2dad-d2c2-463b-87b2-c01f91ef917b req-31edda68-8e08-4708-b30f-2d530ab1f5ea tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 943 time: 0.0974917 Dec 21 04:10:59.050104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2284e42f-6c8d-4e69-b6fc-db51075ce3e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.070909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 3828f0e6-1936-4057-b560-3b5beb4045e1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:59.080446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2284e42f-6c8d-4e69-b6fc-db51075ce3e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.081245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:59.081463 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.081881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1378a57f-5062-453a-9dfb-316acded00e0 None None] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:59.097994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-931c2dad-d2c2-463b-87b2-c01f91ef917b req-d442ebb5-cf21-49fc-acfb-36afdc809906 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776143 Dec 21 04:10:59.100038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:59.104934 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.188931 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-20c47035-988d-4606-9867-ff5b6671b4e9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5189400 Dec 21 04:10:59.198703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56170) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:59.212957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:59.260556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-3828f0e6-1936-4057-b560-3b5beb4045e1', 'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': 'fe4221c6-2b9e-4315-a77a-14834fb1e3ba'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:59.261442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.354902 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2284e42f-6c8d-4e69-b6fc-db51075ce3e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.357765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2284e42f-6c8d-4e69-b6fc-db51075ce3e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.373739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2284e42f-6c8d-4e69-b6fc-db51075ce3e8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6d27c8aa-cab0-4fb8-9951-7aff45128334 HTTP/1.1" status: 204 len: 168 time: 0.4244926 Dec 21 04:10:59.448049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.459189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2284e42f-6c8d-4e69-b6fc-db51075ce3e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d27c8aa-cab0-4fb8-9951-7aff45128334,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:59.466011 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-b694bf0d-2e12-40d3-860a-c34e61a69b79 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1237905 Dec 21 04:10:59.495113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Allocated IP 172.20.0.2 (3828f0e6-1936-4057-b560-3b5beb4045e1/fe4221c6-2b9e-4315-a77a-14834fb1e3ba/cc0e086b-caa2-4c7d-a25d-d639330d662d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:10:59.515462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:10:59.519629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.559745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=6110bbab-8330-4770-8cb5-059af1d3027f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:10:59.587071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '1bf90448-93a4-4b87-9abe-4d76e331374a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:10:59.588328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: b62b3c30-1c04-483b-a383-81d38024fd5a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:10:59.686367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network b62b3c30-1c04-483b-a383-81d38024fd5a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:10:59.702263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-5c3530fa-8f6f-4ea5-b4b6-5b3b8effbc02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:59.711819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-5c3530fa-8f6f-4ea5-b4b6-5b3b8effbc02 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1097 time: 0.1258140 Dec 21 04:10:59.790310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b62b3c30-1c04-483b-a383-81d38024fd5a) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:10:59.794627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:59.795302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.805082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-575a3490-459b-4dcf-9a34-912b29682049 None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:10:59.904799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c774522-1174-4177-88be-22e73cf9b4dd tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1174572 Dec 21 04:10:59.904799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56184) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:10:59.911884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:10:59.939135 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:10:59.955353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-722897a3-102b-4fdd-8c20-08438fef10cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:10:59.958193 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-722897a3-102b-4fdd-8c20-08438fef10cf service neutron] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.2229226 Dec 21 04:10:59.975759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b62b3c30-1c04-483b-a383-81d38024fd5a', 'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '6110bbab-8330-4770-8cb5-059af1d3027f'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:10:59.977485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.016258 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-92d3f32c-19c2-4f56-bcdd-b21da995bc45 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 200 len: 217 time: 0.0468476 Dec 21 04:11:00.043155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-529437191'] for subnet, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.071065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-2b943873-d867-47a5-a227-7dca436c2b00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:00.072491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-2b943873-d867-47a5-a227-7dca436c2b00 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0487511 Dec 21 04:11:00.083567 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.106434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:00.115728 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-d30c9319-2353-4456-b6c3-c34c344cfaab service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0357330 Dec 21 04:11:00.140371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.152634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:00.161299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:00.245824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Allocated IP 172.20.0.2 (b62b3c30-1c04-483b-a383-81d38024fd5a/6110bbab-8330-4770-8cb5-059af1d3027f/f22093b8-a03b-46d6-81e8-67f80c7a4446) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:00.293800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Pushing event updated for resources: {'Port': ['ID=cc0e086b-caa2-4c7d-a25d-d639330d662d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:00.326133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Attempting to bind port cc0e086b-caa2-4c7d-a25d-d639330d662d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:00.326394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Attempting to bind port cc0e086b-caa2-4c7d-a25d-d639330d662d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ed083fe5-54d3-48a4-b95d-bade9804847a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:00.326727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Attempting to bind port cc0e086b-caa2-4c7d-a25d-d639330d662d on network 3828f0e6-1936-4057-b560-3b5beb4045e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:00.337836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98b5047f-5659-4d5d-a5d3-9515b8abb69d req-04bf1ece-f7d0-4a2f-970b-bd3936ae1d83 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:00.339874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98b5047f-5659-4d5d-a5d3-9515b8abb69d req-04bf1ece-f7d0-4a2f-970b-bd3936ae1d83 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 943 time: 0.1276684 Dec 21 04:11:00.340631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56200) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:00.359958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:00.360985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Checking segment: {'id': 'ed083fe5-54d3-48a4-b95d-bade9804847a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:00.361677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.362526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Bound using segment: {'id': 'ed083fe5-54d3-48a4-b95d-bade9804847a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:00.363546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=781d54cb-32cd-4268-9fed-8839d7a5c66a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:00.368486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': '7136a056-c705-46da-b88b-c96144a10241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:00.368986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: f19fabbf-793d-46f4-84b3-8eda9c4c1813, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:00.372467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Bound port: cc0e086b-caa2-4c7d-a25d-d639330d662d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed083fe5-54d3-48a4-b95d-bade9804847a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '3828f0e6-1936-4057-b560-3b5beb4045e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:00.373181 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-7f0f2b71-0d77-42eb-9ccd-7fd165589a64 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2485182 Dec 21 04:11:00.373655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.380006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3222959-b40b-4742-ac56-f80e6eabe601 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.436261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98b5047f-5659-4d5d-a5d3-9515b8abb69d req-d4f4d95d-33e5-4f08-b008-69dc36b3d4d3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718691 Dec 21 04:11:00.455142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:00.549713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] For port cc0e086b-caa2-4c7d-a25d-d639330d662d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:00.553375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] For port cc0e086b-caa2-4c7d-a25d-d639330d662d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cc0e086b-caa2-4c7d-a25d-d639330d662d,segment=NetworkSegment(ed083fe5-54d3-48a4-b95d-bade9804847a),segment_id=ed083fe5-54d3-48a4-b95d-bade9804847a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:00.554957 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3100ac3b-23c4-4301-b6bc-bae2eaef018d req-5ee599b4-c64e-430d-9f71-756a4ac1cc06 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1728871 Dec 21 04:11:00.575960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3222959-b40b-4742-ac56-f80e6eabe601 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.585919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f19fabbf-793d-46f4-84b3-8eda9c4c1813) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:00.593035 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:00.593703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.609553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.621117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9af6e7d8-0a54-43ce-8066-b79f1ab7f9e9 None None] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:00.646712 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.660265 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3222959-b40b-4742-ac56-f80e6eabe601 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.672625 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eba25cf9-5253-4d17-bc91-67a5f0c9d926 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4728365 Dec 21 04:11:00.674287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56206) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:00.693302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-611095207', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:00.724258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b3222959-b40b-4742-ac56-f80e6eabe601 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ae99ad8b8d50479385be0203aeca8f94&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3824050 Dec 21 04:11:00.726701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3222959-b40b-4742-ac56-f80e6eabe601 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78992e35-1bb9-4dc4-be5b-eadf15a9565a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:00.726923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:00.747499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.819999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.821063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.866439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c13d41e-919b-4eda-bb52-4bb22bb23af7 None None] Pushing event updated for resources: {'Port': ['ID=cc0e086b-caa2-4c7d-a25d-d639330d662d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:00.910742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bdc09c6-257f-4668-8c75-f164ce972098 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.948912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:00.965103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bdc09c6-257f-4668-8c75-f164ce972098 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.000683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8762542841402', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-529846482'] for subnet, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.099763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.107687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:01.109053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.111021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "PUT /v2.0/subnets/6110bbab-8330-4770-8cb5-059af1d3027f HTTP/1.1" status: 200 len: 806 time: 1.2054517 Dec 21 04:11:01.115846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56216) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:01.148266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:11:01.149813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bdc09c6-257f-4668-8c75-f164ce972098 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.158985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bdc09c6-257f-4668-8c75-f164ce972098 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.160121 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6bdc09c6-257f-4668-8c75-f164ce972098 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/78992e35-1bb9-4dc4-be5b-eadf15a9565a HTTP/1.1" status: 204 len: 168 time: 0.4320226 Dec 21 04:11:01.177415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bdc09c6-257f-4668-8c75-f164ce972098 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78992e35-1bb9-4dc4-be5b-eadf15a9565a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:01.239761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.241066 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a849808a-364f-436f-aea9-69c50f110078 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.5637991 Dec 21 04:11:01.245691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-f19fabbf-793d-46f4-84b3-8eda9c4c1813', 'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': '781d54cb-32cd-4268-9fed-8839d7a5c66a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:01.247075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:01.247416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.276415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89d84d91-693a-4de7-82a0-c22541ca0888 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=6110bbab-8330-4770-8cb5-059af1d3027f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:01.304112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:01.328505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:01.338647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:01.383101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.478896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Pushing event updated for resources: {'Port': ['ID=f22093b8-a03b-46d6-81e8-67f80c7a4446,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:01.525435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port f22093b8-a03b-46d6-81e8-67f80c7a4446 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:01.527050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.531345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Attempting to bind port f22093b8-a03b-46d6-81e8-67f80c7a4446 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:01.531999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Attempting to bind port f22093b8-a03b-46d6-81e8-67f80c7a4446 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1bf90448-93a4-4b87-9abe-4d76e331374a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:01.532555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Attempting to bind port f22093b8-a03b-46d6-81e8-67f80c7a4446 on network b62b3c30-1c04-483b-a383-81d38024fd5a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:01.552709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:01.555252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Checking segment: {'id': '1bf90448-93a4-4b87-9abe-4d76e331374a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:01.555870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.556442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Bound using segment: {'id': '1bf90448-93a4-4b87-9abe-4d76e331374a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:01.557462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Bound port: f22093b8-a03b-46d6-81e8-67f80c7a4446, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1bf90448-93a4-4b87-9abe-4d76e331374a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b62b3c30-1c04-483b-a383-81d38024fd5a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:01.559146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.631069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cc0e086b-caa2-4c7d-a25d-d639330d662d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:01.653676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:01.739015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9940948-b134-4de6-90ad-36ee156f5da0 req-34a16158-598e-4d71-b60c-157c18db9587 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:01.741344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1', 'mac_address': 'fa:16:3e:86:74:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:11:01.742472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9940948-b134-4de6-90ad-36ee156f5da0 req-34a16158-598e-4d71-b60c-157c18db9587 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 943 time: 0.1128700 Dec 21 04:11:01.743939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port f22093b8-a03b-46d6-81e8-67f80c7a4446, host n-d-822053-11, got binding levels [] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:01.744694 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.778168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for f22093b8-a03b-46d6-81e8-67f80c7a4446 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:01.841999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:01.857625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Allocated IP 172.21.0.2 (f19fabbf-793d-46f4-84b3-8eda9c4c1813/781d54cb-32cd-4268-9fed-8839d7a5c66a/4e55eca0-c769-4a38-b048-852fdf99945d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:01.864632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] For port f22093b8-a03b-46d6-81e8-67f80c7a4446, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:01.864632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:11:01.876317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9940948-b134-4de6-90ad-36ee156f5da0 req-4b6f991e-bd69-43a0-aa72-ce529de38381 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1198821 Dec 21 04:11:01.923745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] For port f22093b8-a03b-46d6-81e8-67f80c7a4446, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f22093b8-a03b-46d6-81e8-67f80c7a4446,segment=NetworkSegment(1bf90448-93a4-4b87-9abe-4d76e331374a),segment_id=1bf90448-93a4-4b87-9abe-4d76e331374a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:01.960454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:01.984552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port cc0e086b-caa2-4c7d-a25d-d639330d662d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:01.985292 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.226033 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.240198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.282621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.419717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port f22093b8-a03b-46d6-81e8-67f80c7a4446 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:02.512802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=f22093b8-a03b-46d6-81e8-67f80c7a4446,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:02.529654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.529800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88104942-2bdb-4069-ade0-b0aab155a97f None None] Pushing event updated for resources: {'Port': ['ID=f22093b8-a03b-46d6-81e8-67f80c7a4446,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:02.545344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.604591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.623089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.641119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fd2ba69-4eb9-4f19-a8bf-35f06debde17 None None] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:02.692512 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.754472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:02.793981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['79d0bdbe-6706-42aa-82a3-e013ef9c92b1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:02.835648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=6110bbab-8330-4770-8cb5-059af1d3027f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:03.073078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:03.098388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:03.102258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:03.112420 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.175605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27ae717e-1cb1-4595-a0dd-ab68d787def9 None None] Provisioning complete for port cc0e086b-caa2-4c7d-a25d-d639330d662d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:03.176504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27ae717e-1cb1-4595-a0dd-ab68d787def9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.185955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:03.196719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.20.0.1 (3828f0e6-1936-4057-b560-3b5beb4045e1/fe4221c6-2b9e-4315-a77a-14834fb1e3ba/06b0b22d-c54c-485b-897b-07e42da52e86) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:03.246008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b62b3c30-1c04-483b-a383-81d38024fd5a']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:03.278353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port cc0e086b-caa2-4c7d-a25d-d639330d662d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cc0e086b-caa2-4c7d-a25d-d639330d662d,segment=NetworkSegment(ed083fe5-54d3-48a4-b95d-bade9804847a),segment_id=ed083fe5-54d3-48a4-b95d-bade9804847a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:03.279190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1bf90448-93a4-4b87-9abe-4d76e331374a') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:03.279495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1bf90448-93a4-4b87-9abe-4d76e331374a') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:03.323438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.392380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8cb2af-0b5a-4275-b9bd-5b1c5874f0ad req-36a668ed-7008-4078-8142-e58f9535e915 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:03.410267 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a8cb2af-0b5a-4275-b9bd-5b1c5874f0ad req-36a668ed-7008-4078-8142-e58f9535e915 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 944 time: 0.3425677 Dec 21 04:11:03.452207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.459732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.470653 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.504638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:03.505048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:03.516201 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:03.613876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.632942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Attempting to bind port 4e55eca0-c769-4a38-b048-852fdf99945d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:03.633321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Attempting to bind port 4e55eca0-c769-4a38-b048-852fdf99945d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '7136a056-c705-46da-b88b-c96144a10241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:03.633689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Attempting to bind port 4e55eca0-c769-4a38-b048-852fdf99945d on network f19fabbf-793d-46f4-84b3-8eda9c4c1813 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:03.663890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a8cb2af-0b5a-4275-b9bd-5b1c5874f0ad req-78d25cbf-801f-482f-ab25-f2436c8edb8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2526646 Dec 21 04:11:03.713752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Pushing event updated for resources: {'Port': ['ID=4e55eca0-c769-4a38-b048-852fdf99945d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:03.726015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:03.732699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Checking segment: {'id': '7136a056-c705-46da-b88b-c96144a10241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:03.733261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.733765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Bound using segment: {'id': '7136a056-c705-46da-b88b-c96144a10241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:03.734372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Bound port: 4e55eca0-c769-4a38-b048-852fdf99945d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7136a056-c705-46da-b88b-c96144a10241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f19fabbf-793d-46f4-84b3-8eda9c4c1813'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:03.734876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.748864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:03.759321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:03.768949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:03.808249 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.816165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.821861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/b62b3c30-1c04-483b-a383-81d38024fd5a HTTP/1.1" status: 204 len: 168 time: 2.7045701 Dec 21 04:11:03.828266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:03.879784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=06b0b22d-c54c-485b-897b-07e42da52e86,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:03.880376 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-df8bafff-68fe-4791-b9bf-436bc63a4286 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:03.881012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-df8bafff-68fe-4791-b9bf-436bc63a4286 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:03.885625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-df8bafff-68fe-4791-b9bf-436bc63a4286 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/b62b3c30-1c04-483b-a383-81d38024fd5a HTTP/1.1" status: 404 len: 339 time: 0.0535352 Dec 21 04:11:03.889290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56294) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:03.891054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e588f115-d415-4597-82a1-1a2c0f6b51c7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=b62b3c30-1c04-483b-a383-81d38024fd5a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:03.897086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=cc0e086b-caa2-4c7d-a25d-d639330d662d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:03.899613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-520804808', 'description': 'd1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:03.950945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:03.991162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:03.994882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.047844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:04.065182 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.066676 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment b128860e-575e-437c-8619-c3b55f9663f1 of type vlan for network 29873c8e-da69-44cb-93db-c067f2be1392 Dec 21 04:11:04.185855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.188687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] For port 4e55eca0-c769-4a38-b048-852fdf99945d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:04.200294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] For port 4e55eca0-c769-4a38-b048-852fdf99945d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4e55eca0-c769-4a38-b048-852fdf99945d,segment=NetworkSegment(7136a056-c705-46da-b88b-c96144a10241),segment_id=7136a056-c705-46da-b88b-c96144a10241)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:04.287111 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.312271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.366637 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.372789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:04.373549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.388227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:04.533918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-23fe1e88-d485-41a1-98dd-30b9f6468b1c None None] Provisioning complete for port cc0e086b-caa2-4c7d-a25d-d639330d662d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:04.534839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23fe1e88-d485-41a1-98dd-30b9f6468b1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.537107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732325b5-bff9-4bc0-872c-3a48ace75cb8 None None] Pushing event updated for resources: {'Port': ['ID=4e55eca0-c769-4a38-b048-852fdf99945d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:04.606217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ed16210-5187-4473-919c-c0b74df90f3c None None] DHCP port deletion for b62b3c30-1c04-483b-a383-81d38024fd5a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:04.642287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4abf40d5-2d92-420b-b7de-3b4413b2eb61 None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:04.686060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 0.7912593 Dec 21 04:11:04.689667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56312) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:04.694723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4abf40d5-2d92-420b-b7de-3b4413b2eb61 None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a could not be found, it might have been deleted concurrently. {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 21 04:11:04.726876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00c2df7c-a590-436e-bc0e-aca7927e968d None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:04.749432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00c2df7c-a590-436e-bc0e-aca7927e968d None None] Network b62b3c30-1c04-483b-a383-81d38024fd5a could not be found, it might have been deleted concurrently. {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 21 04:11:04.778624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c60e5981-cb1a-4c91-9a74-d19aef4e97bc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:04.901579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ecffe74-9e3d-4557-9837-e0e651b1359a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:04.907330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1ecffe74-9e3d-4557-9837-e0e651b1359a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks?id=29873c8e-da69-44cb-93db-c067f2be1392 HTTP/1.1" status: 200 len: 760 time: 0.2081249 Dec 21 04:11:04.909512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfcd883-0026-4f05-9af4-ce8aa99cd08a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=29873c8e-da69-44cb-93db-c067f2be1392,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:04.920459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 29873c8e-da69-44cb-93db-c067f2be1392 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:04.939533 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56314) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:04.959916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'description': 'd2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:04.970661 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.038850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c532afcb-c03c-4caa-915f-fe6b6e110acb None None] Provisioning complete for port 06b0b22d-c54c-485b-897b-07e42da52e86 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:05.039678 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c532afcb-c03c-4caa-915f-fe6b6e110acb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.053602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.070323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:05.222406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.225982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c60e5981-cb1a-4c91-9a74-d19aef4e97bc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.245218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=06b0b22d-c54c-485b-897b-07e42da52e86,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:05.312116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c60e5981-cb1a-4c91-9a74-d19aef4e97bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.385224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c60e5981-cb1a-4c91-9a74-d19aef4e97bc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b157479954694e8086dc0fb49ccec6bb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9884827 Dec 21 04:11:05.386961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56318) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:05.393774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a67c39-9577-4048-8094-848ebcfccdf8 req-fe2b6dc5-7ecb-491e-8304-7665c84aa2ba tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:05.395649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32a67c39-9577-4048-8094-848ebcfccdf8 req-fe2b6dc5-7ecb-491e-8304-7665c84aa2ba tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 944 time: 0.5058382 Dec 21 04:11:05.401921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60e5981-cb1a-4c91-9a74-d19aef4e97bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d01d470-548b-417e-8ae9-5d50b465e539,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:05.458907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c532afcb-c03c-4caa-915f-fe6b6e110acb None None] Port 06b0b22d-c54c-485b-897b-07e42da52e86 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:05.464336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c532afcb-c03c-4caa-915f-fe6b6e110acb None None] Could not find standard attr ID for object f22093b8-a03b-46d6-81e8-67f80c7a4446. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:11:05.471290 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.499512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32a67c39-9577-4048-8094-848ebcfccdf8 req-fd8e08f9-daa8-410a-a4bd-75e0f1396ce8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848119 Dec 21 04:11:05.549927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:11:05.559172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:05.559892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.579211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.605699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ebaedd6-8cf3-4321-98e8-dc5569073e3e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.624435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:05.631628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:05.639055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 29873c8e-da69-44cb-93db-c067f2be1392 is not hosted by any dhcp agent {{(pid=110310) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 04:11:05.658332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:05.667940 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.674124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ebaedd6-8cf3-4321-98e8-dc5569073e3e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.677778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56322) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:05.678028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "PUT /v2.0/networks/29873c8e-da69-44cb-93db-c067f2be1392 HTTP/1.1" status: 200 len: 757 time: 0.7322793 Dec 21 04:11:05.821377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd50166-d6c8-49f7-bbf0-0be6fa37f70f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=29873c8e-da69-44cb-93db-c067f2be1392,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:05.825995 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:05.829841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e55eca0-c769-4a38-b048-852fdf99945d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:05.901454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 29873c8e-da69-44cb-93db-c067f2be1392 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:05.918962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a685f317-0e30-48ec-af8f-2d4370d53915 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:05.921396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a685f317-0e30-48ec-af8f-2d4370d53915 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks?id=29873c8e-da69-44cb-93db-c067f2be1392 HTTP/1.1" status: 200 len: 760 time: 0.2165101 Dec 21 04:11:05.925175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56324) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:05.936114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-272372045'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:06.009366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:06.014039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:11:06.016626 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d72e56a1-3a52-440b-ba35-80a41d4ed67d" -d '{"events": [{"server_uuid": "02062869-7c4a-4d36-b457-3485dbbeeb69", "name": "network-vif-plugged", "status": "completed", "tag": "79d0bdbe-6706-42aa-82a3-e013ef9c92b1"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:11:06.074654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4e55eca0-c769-4a38-b048-852fdf99945d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:06.075128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.088434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:06.098190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.133055 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:11:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b21b36d-8d26-424c-a4de-acab1e4307a9 x-openstack-request-id: req-9b21b36d-8d26-424c-a4de-acab1e4307a9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:11:06.133361 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02062869-7c4a-4d36-b457-3485dbbeeb69", "name": "network-vif-plugged", "status": "completed", "tag": "79d0bdbe-6706-42aa-82a3-e013ef9c92b1", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:11:06.133657 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9b21b36d-8d26-424c-a4de-acab1e4307a9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:11:06.134010 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1', 'code': 200} Dec 21 04:11:06.142524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.227095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e87bb93a-8031-4387-8271-53ceb7caa5b0 None None] Provisioning complete for port 06b0b22d-c54c-485b-897b-07e42da52e86 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:06.227496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e87bb93a-8031-4387-8271-53ceb7caa5b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.253334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ebaedd6-8cf3-4321-98e8-dc5569073e3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.257342 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ebaedd6-8cf3-4321-98e8-dc5569073e3e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.258834 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1ebaedd6-8cf3-4321-98e8-dc5569073e3e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0d01d470-548b-417e-8ae9-5d50b465e539 HTTP/1.1" status: 204 len: 168 time: 0.8709307 Dec 21 04:11:06.262673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:06.275973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebaedd6-8cf3-4321-98e8-dc5569073e3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d01d470-548b-417e-8ae9-5d50b465e539,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:06.282796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e87bb93a-8031-4387-8271-53ceb7caa5b0 None None] Port 06b0b22d-c54c-485b-897b-07e42da52e86 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:06.285248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.285619 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment ce315861-876b-47e2-9235-a61cf0344f22 of type vlan for network 41ee9db9-328f-4830-b572-0221865382e9 Dec 21 04:11:06.289813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c2caaeb-e826-4754-9f5b-95506404289a req-6f40f816-25b8-420e-a79a-d9451cef7d50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:06.291448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c2caaeb-e826-4754-9f5b-95506404289a req-6f40f816-25b8-420e-a79a-d9451cef7d50 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 1097 time: 0.0770891 Dec 21 04:11:06.312701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 1e5ca073-9ee5-4a7e-83ed-57fc750be120 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:11:06.327317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:06.363591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.377639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cf8a0c4-fac5-46f0-9054-ef1c97cf5313 None None] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:06.407029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c2caaeb-e826-4754-9f5b-95506404289a req-a6b1af42-099e-43ff-8890-fb7c3b1e3883 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065016 Dec 21 04:11:06.464553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.486609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:06.498192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56334) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:06.501405 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d60be5bb-53ba-46fb-afe2-acb2bef78929 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/1e5ca073-9ee5-4a7e-83ed-57fc750be120/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2510855 Dec 21 04:11:06.508199 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] Sync routers for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:06.513981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.524308 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:06.525902 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:06.527410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:06.528172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.573209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cb0688b2-3db6-4832-8018-89001618cf48 None None] Provisioning complete for port 4e55eca0-c769-4a38-b048-852fdf99945d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:06.573627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cb0688b2-3db6-4832-8018-89001618cf48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.579818 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:06.590739 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:06.592131 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:06.612509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc724d54-328f-499c-a950-94bd4464db30 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:06.616667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cc724d54-328f-499c-a950-94bd4464db30 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports/06b0b22d-c54c-485b-897b-07e42da52e86 HTTP/1.1" status: 200 len: 910 time: 0.1147335 Dec 21 04:11:06.619889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56340) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:06.637652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 4e55eca0-c769-4a38-b048-852fdf99945d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4e55eca0-c769-4a38-b048-852fdf99945d,segment=NetworkSegment(7136a056-c705-46da-b88b-c96144a10241),segment_id=7136a056-c705-46da-b88b-c96144a10241)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:06.672251 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:06.673310 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-123f1e44-2d70-46c7-8a6f-e16b986907a3 None None] The sync data for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:06.710709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:06.715386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cc0e086b-caa2-4c7d-a25d-d639330d662d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:06.753561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=41ee9db9-328f-4830-b572-0221865382e9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:06.812767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aae23c47-615d-451a-b2a5-8300718171e8 req-6d8791c4-634f-4f97-9e70-beb671ac4c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:06.824946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aae23c47-615d-451a-b2a5-8300718171e8 req-6d8791c4-634f-4f97-9e70-beb671ac4c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 945 time: 0.1153169 Dec 21 04:11:06.825167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 41ee9db9-328f-4830-b572-0221865382e9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:06.844083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8fa1acb2-5bce-4780-b458-680076cd8f75 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.9177697 Dec 21 04:11:06.845976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56348) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:06.860634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '41ee9db9-328f-4830-b572-0221865382e9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:07.021327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=4e55eca0-c769-4a38-b048-852fdf99945d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:07.051435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port cc0e086b-caa2-4c7d-a25d-d639330d662d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:07.051435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:07.106866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aae23c47-615d-451a-b2a5-8300718171e8 req-65e891ca-bd91-4245-8e54-33712c02f41c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2615721 Dec 21 04:11:07.232639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f22093b8-a03b-46d6-81e8-67f80c7a4446 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:07.240299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:07.244260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:07.266446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f22093b8-a03b-46d6-81e8-67f80c7a4446 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:07.266691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f22093b8-a03b-46d6-81e8-67f80c7a4446 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:07.388267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:07.396880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-63ce80a4-05c9-4f5d-8952-2790376a1ce7 None None] Provisioning complete for port 4e55eca0-c769-4a38-b048-852fdf99945d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:07.401580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-63ce80a4-05c9-4f5d-8952-2790376a1ce7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:07.522445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:07.646502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=07d70915-70ee-42fe-8294-aa03bd6ce56e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:07.657855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': 'ce315861-876b-47e2-9235-a61cf0344f22', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '41ee9db9-328f-4830-b572-0221865382e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:07.658249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 41ee9db9-328f-4830-b572-0221865382e9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:07.696277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e55eca0-c769-4a38-b048-852fdf99945d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:07.727960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 41ee9db9-328f-4830-b572-0221865382e9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:07.801713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 41ee9db9-328f-4830-b572-0221865382e9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:07.810402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-500d8694-4b36-4910-ae07-0b7978726937 None None] Network 41ee9db9-328f-4830-b572-0221865382e9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:07.810729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:07.813131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:07.892603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fce270be-872e-4eca-adb2-5f2371e6cb9c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0453608 Dec 21 04:11:07.895290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56368) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:07.953183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.21.0.1 (f19fabbf-793d-46f4-84b3-8eda9c4c1813/781d54cb-32cd-4268-9fed-8839d7a5c66a/b9ceba9e-f6e5-4359-a425-4ff858e570cb) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:07.968046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4e55eca0-c769-4a38-b048-852fdf99945d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:07.971714 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.027501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.112688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.137465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4f47651-e6c7-4b27-b539-ad5fefdb04b6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-41ee9db9-328f-4830-b572-0221865382e9', 'network_id': '41ee9db9-328f-4830-b572-0221865382e9', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': '07d70915-70ee-42fe-8294-aa03bd6ce56e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:08.138328 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4f47651-e6c7-4b27-b539-ad5fefdb04b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.154441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.325662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3ee430-1052-47d9-9c0f-1125cae98ba7 req-4a95c3a3-f6a7-42b5-a418-3720604707f6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:08.327358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec3ee430-1052-47d9-9c0f-1125cae98ba7 req-4a95c3a3-f6a7-42b5-a418-3720604707f6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 945 time: 0.0632238 Dec 21 04:11:08.328971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.346244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.373262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=07d70915-70ee-42fe-8294-aa03bd6ce56e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server [None req-f4f47651-e6c7-4b27-b539-ad5fefdb04b6 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 07d70915-70ee-42fe-8294-aa03bd6ce56e: This subnet is being modified by another concurrent operation. Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:11:08.376410 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1463, in create_port_db Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise exception Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 07d70915-70ee-42fe-8294-aa03bd6ce56e: This subnet is being modified by another concurrent operation. Dec 21 04:11:08.381218 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Dec 21 04:11:08.416280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88806289-7686-457e-9a92-2785608ed1d7 None None] Network 41ee9db9-328f-4830-b572-0221865382e9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:08.436097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec3ee430-1052-47d9-9c0f-1125cae98ba7 req-d5c25902-ba0b-4a09-b30f-f28dce4dce9d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819724 Dec 21 04:11:08.520886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:08.544721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:08.552456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:08.582776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=b9ceba9e-f6e5-4359-a425-4ff858e570cb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:08.719423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.778046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:08.947074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87f54cd1-547a-4a63-bdc5-9847eebc3897 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:11:08.973791 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:08.984499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.026187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41ee9db9-328f-4830-b572-0221865382e9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:09.042926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce315861-876b-47e2-9235-a61cf0344f22') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:09.043406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce315861-876b-47e2-9235-a61cf0344f22') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:09.047517 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c922a3f0-8782-4346-a272-61b0f01f88f8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.052688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343dd917-9235-403c-bfb8-56c85867165b req-94ac5482-882c-4f6b-9da5-8ddc04216ad6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:09.054337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-343dd917-9235-403c-bfb8-56c85867165b req-94ac5482-882c-4f6b-9da5-8ddc04216ad6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 945 time: 0.0948796 Dec 21 04:11:09.064716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.091934 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.098619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-72bcc161-9653-4ddd-93c2-2ada99387db6 None None] Provisioning complete for port b9ceba9e-f6e5-4359-a425-4ff858e570cb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:09.099009 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72bcc161-9653-4ddd-93c2-2ada99387db6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.105672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:09.106219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:09.112579 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:09.147677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87f54cd1-547a-4a63-bdc5-9847eebc3897 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:11:09.181283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-343dd917-9235-403c-bfb8-56c85867165b req-77b04068-a793-4931-8e43-5f0dfae009b1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191618 Dec 21 04:11:09.181566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-72bcc161-9653-4ddd-93c2-2ada99387db6 None None] Port b9ceba9e-f6e5-4359-a425-4ff858e570cb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:09.259164 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.266872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.277020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/41ee9db9-328f-4830-b572-0221865382e9 HTTP/1.1" status: 204 len: 168 time: 1.3805251 Dec 21 04:11:09.283345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56396) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:09.317411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b01f50-91d2-4305-9bf3-a9bd140166f3 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=41ee9db9-328f-4830-b572-0221865382e9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:09.349127 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-96b1a032-bb03-4036-904f-b0b3c38d9d1b tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] GET failed (client error): The resource could not be found. Dec 21 04:11:09.357476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-96b1a032-bb03-4036-904f-b0b3c38d9d1b tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/subnets/07d70915-70ee-42fe-8294-aa03bd6ce56e HTTP/1.1" status: 404 len: 337 time: 0.0690506 Dec 21 04:11:09.357476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56398) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:09.375046 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-02f21be6-fa15-4ab9-b0c8-6588a441e890 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:09.375461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-02f21be6-fa15-4ab9-b0c8-6588a441e890 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:09.386044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-02f21be6-fa15-4ab9-b0c8-6588a441e890 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/41ee9db9-328f-4830-b572-0221865382e9 HTTP/1.1" status: 404 len: 339 time: 0.0309393 Dec 21 04:11:09.386677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56400) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:09.621589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.638733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c922a3f0-8782-4346-a272-61b0f01f88f8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.671557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0219091-8a1c-48b9-a6b2-11a1138f5b8f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:09.676131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0219091-8a1c-48b9-a6b2-11a1138f5b8f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.2853827 Dec 21 04:11:09.676399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56408) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:09.719001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7ff0cb98-a30c-44a7-b8fd-676aff5fc525 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 207 time: 0.0378120 Dec 21 04:11:09.721775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56412) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:09.798260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.801352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c922a3f0-8782-4346-a272-61b0f01f88f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:09.830381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59555d00-4a5e-4265-b249-bbcbcaac1fb1 req-246bdba2-0b48-467e-88c7-be83c6e40dec tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:09.838221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59555d00-4a5e-4265-b249-bbcbcaac1fb1 req-246bdba2-0b48-467e-88c7-be83c6e40dec tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 945 time: 0.0677674 Dec 21 04:11:09.902302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59555d00-4a5e-4265-b249-bbcbcaac1fb1 req-70075fc1-0388-4035-af47-78a462908cc3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630310 Dec 21 04:11:10.014874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c922a3f0-8782-4346-a272-61b0f01f88f8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d4148d6102a545c183d2bdc735a321df&name=default HTTP/1.1" status: 200 len: 3000 time: 1.2333207 Dec 21 04:11:10.016367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56414) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.022988 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c922a3f0-8782-4346-a272-61b0f01f88f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=570440f3-c7d4-40f9-a254-70f035133303,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:10.026008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:10.056113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=b9ceba9e-f6e5-4359-a425-4ff858e570cb,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:10.121246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b12bab9e-b8e5-4f2a-989a-b2ba06f69b95 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:10.147976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b12bab9e-b8e5-4f2a-989a-b2ba06f69b95 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:10.167696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3225e32e-812a-4b5d-88d5-0613395d3edc tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.175234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3225e32e-812a-4b5d-88d5-0613395d3edc tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.181873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3225e32e-812a-4b5d-88d5-0613395d3edc tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.188996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3225e32e-812a-4b5d-88d5-0613395d3edc tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.195056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3225e32e-812a-4b5d-88d5-0613395d3edc tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2486 time: 0.4718523 Dec 21 04:11:10.195878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56416) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.226472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:10.228223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:10.311513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b12bab9e-b8e5-4f2a-989a-b2ba06f69b95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:10.314270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b12bab9e-b8e5-4f2a-989a-b2ba06f69b95 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:10.315687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b12bab9e-b8e5-4f2a-989a-b2ba06f69b95 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/570440f3-c7d4-40f9-a254-70f035133303 HTTP/1.1" status: 204 len: 168 time: 0.2976148 Dec 21 04:11:10.341248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12bab9e-b8e5-4f2a-989a-b2ba06f69b95 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=570440f3-c7d4-40f9-a254-70f035133303,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:10.368666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4d556c25-4b8c-48bf-96dc-13092f2b578e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 575 time: 0.1714337 Dec 21 04:11:10.373466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.433765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 1e5ca073-9ee5-4a7e-83ed-57fc750be120 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:10.443623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2592746d-d5d2-4505-a52c-e769570a6fb6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.446399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2592746d-d5d2-4505-a52c-e769570a6fb6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.452941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2592746d-d5d2-4505-a52c-e769570a6fb6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.0781145 Dec 21 04:11:10.453596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.539329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7a567a9-0eb0-4d97-84b8-7f18f8fc3470 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.541336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7a567a9-0eb0-4d97-84b8-7f18f8fc3470 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['shared'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.549957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.550430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a7a567a9-0eb0-4d97-84b8-7f18f8fc3470 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.0957305 Dec 21 04:11:10.626252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7e2fca4f-b4e5-4454-9f37-19276ce3669c None None] Provisioning complete for port b9ceba9e-f6e5-4359-a425-4ff858e570cb triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:10.628702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:10.629705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7e2fca4f-b4e5-4454-9f37-19276ce3669c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:10.634449 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8b9e60ce-da00-4023-9b7f-c9fd986077fa tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/1e5ca073-9ee5-4a7e-83ed-57fc750be120/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0129676 Dec 21 04:11:10.637138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56432) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.649575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] Sync routers for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:10.761855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc402a20-7bc8-4b48-a4fa-7f936571d5b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.768980 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fc402a20-7bc8-4b48-a4fa-7f936571d5b6 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks/d7f1ce49-4162-4816-88d9-7892b1f1f54d HTTP/1.1" status: 200 len: 800 time: 0.2115488 Dec 21 04:11:10.769199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65c55d40-a6cd-45a9-a5cf-1f128670a6e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:10.769305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.780886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56440) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:10.787129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-65c55d40-a6cd-45a9-a5cf-1f128670a6e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports/b9ceba9e-f6e5-4359-a425-4ff858e570cb HTTP/1.1" status: 200 len: 910 time: 0.1334844 Dec 21 04:11:11.114707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b63329e-959a-47f4-a82d-dbfc9269738e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/networks/d7f1ce49-4162-4816-88d9-7892b1f1f54d?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.3440599 Dec 21 04:11:11.124385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56450) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:11.139334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0902df44-bd59-4ffa-8281-ca0916cba68d req-30a5a74e-ad06-42dd-b951-362cdf9c639b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:11.151652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0902df44-bd59-4ffa-8281-ca0916cba68d req-30a5a74e-ad06-42dd-b951-362cdf9c639b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 945 time: 0.0970809 Dec 21 04:11:11.172042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:11.172682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:11.224950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-283e1687-82d8-4f07-bcc9-7a45a95a3207 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:11.227358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-283e1687-82d8-4f07-bcc9-7a45a95a3207 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/subnets/89c5e138-f670-4142-a03e-cdc4f57aeec7 HTTP/1.1" status: 200 len: 811 time: 0.0998621 Dec 21 04:11:11.232665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56454) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:11.249606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7e2fca4f-b4e5-4454-9f37-19276ce3669c None None] Port b9ceba9e-f6e5-4359-a425-4ff858e570cb cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:11.251594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:11.271466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:11.272076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:11.308699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0902df44-bd59-4ffa-8281-ca0916cba68d req-f3802cde-935b-42fd-8edf-c9f2ed2337ea tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1551299 Dec 21 04:11:11.341742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25bf0f2a-c17e-4be9-b96d-6bf78f566533 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['shared'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:11.342064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-6cf6841b-458f-4486-90c3-47d0dc0b0944 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:11.343562 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-25bf0f2a-c17e-4be9-b96d-6bf78f566533 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "GET /v2.0/subnets/89c5e138-f670-4142-a03e-cdc4f57aeec7?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.0936270 Dec 21 04:11:11.343864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-6cf6841b-458f-4486-90c3-47d0dc0b0944 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 945 time: 0.1323960 Dec 21 04:11:11.346461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:11.347151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82eb6660-b43a-4db7-95e7-fe58f0215f79 None None] The sync data for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:11.348634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56456) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:11.354275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1385965995'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:11.524681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:11.525058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.628776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:11.632292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.667884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.687056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] vlan segment allocate from pool success with {'vlan_id': 110, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:11.696296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:11.696711 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.713282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.714156 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Added segment 2eed4d09-eb47-4de0-95a0-2015313f19ac of type vlan for network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed Dec 21 04:11:11.733857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:11.834410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.945355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:11.954326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:11.957389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:12.056469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Network': ['ID=7dfd3397-4224-400a-aaa3-cc4d3ecb39ed,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:12.072757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:12.078337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b419a350-0435-43ab-8f79-82c73ad80e8e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7251449 Dec 21 04:11:12.078552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56478) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:12.084902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:12.092140 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:12.141619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:12.157295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=79d0bdbe-6706-42aa-82a3-e013ef9c92b1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:12.282008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:12.288541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:12.292806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37188028-59f6-49b1-a88f-3be5ff6ed57b req-3ab29616-364f-4e4d-ac54-f8500a0dd45a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "DELETE /v2.0/ports/79d0bdbe-6706-42aa-82a3-e013ef9c92b1 HTTP/1.1" status: 204 len: 173 time: 0.9348640 Dec 21 04:11:12.294582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'name': 'network-vif-deleted', 'tag': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:11:12.296659 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44445c8d-b9b5-4501-9aeb-75af79f772f5" -d '{"events": [{"server_uuid": "02062869-7c4a-4d36-b457-3485dbbeeb69", "name": "network-vif-deleted", "tag": "79d0bdbe-6706-42aa-82a3-e013ef9c92b1"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:11:12.301260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['79d0bdbe-6706-42aa-82a3-e013ef9c92b1'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:12.363341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d6a9b18-88db-4ccd-b6cc-5bb0a31b1233 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:12.420473 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:11:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-696b7244-0acc-4bb5-8704-4e68052f37cb x-openstack-request-id: req-696b7244-0acc-4bb5-8704-4e68052f37cb {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:11:12.421536 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02062869-7c4a-4d36-b457-3485dbbeeb69", "name": "network-vif-deleted", "tag": "79d0bdbe-6706-42aa-82a3-e013ef9c92b1", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:11:12.421895 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-696b7244-0acc-4bb5-8704-4e68052f37cb {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:11:12.422405 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02062869-7c4a-4d36-b457-3485dbbeeb69', 'name': 'network-vif-deleted', 'tag': '79d0bdbe-6706-42aa-82a3-e013ef9c92b1', 'status': 'completed', 'code': 200} Dec 21 04:11:12.436845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Made reservation on behalf of 06a9f38f04ae45689de096e588b0cdd2 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:12.441873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:12.657460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b58399b-6fc5-4126-b384-7c13e6d733b9 req-a7f8ef30-39d7-41c4-b691-c4aaf4d34dfc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 210 time: 0.1543541 Dec 21 04:11:12.662787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing IP validity checks on allocation pools {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 04:11:12.663503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 04:11:12.677436 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port b9ceba9e-f6e5-4359-a425-4ff858e570cb {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:12.678503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:12.868478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:12.882522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for b9ceba9e-f6e5-4359-a425-4ff858e570cb owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:12.950516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:13.063478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=c26a2f92-dc9b-4b7c-8097-7c1524be74be,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:13.088184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Checking segment: {'id': '2eed4d09-eb47-4de0-95a0-2015313f19ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:13.088601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network hostable DHCP agents. Network: 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:13.150835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:13.192079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=b9ceba9e-f6e5-4359-a425-4ff858e570cb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:13.208031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:13.316304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:13.321085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:13.322333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:13.326466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e309a232-2f9e-4048-b59a-aeb7f5ed1ddc None None] Network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:13.399050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f5fc09a2-2cd9-4afb-80bf-7464fcccf999 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 1.3191910 Dec 21 04:11:13.401829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:13.410307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:13.434852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:13.573664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-7dfd3397-4224-400a-aaa3-cc4d3ecb39ed', 'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed', 'project_id': '06a9f38f04ae45689de096e588b0cdd2', 'fixed_ips': [{'subnet_id': 'c26a2f92-dc9b-4b7c-8097-7c1524be74be'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:13.575285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:13.584125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-529437191'] for subnet, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:13.713798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 1e5ca073-9ee5-4a7e-83ed-57fc750be120 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:13.881263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77114fda-6d16-49d0-bc0a-361b6ed63a0e req-cc0a7077-bef6-47ec-8935-8d9f4a51c90b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=02062869-7c4a-4d36-b457-3485dbbeeb69 HTTP/1.1" status: 200 len: 210 time: 0.0561154 Dec 21 04:11:13.924047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:13.935976 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4a415d8b-d023-4023-abb2-65c632f1d9c0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/1e5ca073-9ee5-4a7e-83ed-57fc750be120/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1514895 Dec 21 04:11:13.938821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56532) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:13.939754 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] Sync routers for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:13.955429 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:13.956319 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:13.995809 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:14.007850 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:14.008735 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:14.041508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8762542841402', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-529846482'] for subnet, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.149718 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:14.150705 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9159934-06fd-45a5-bbf3-b398ebfbb87b None None] The sync data for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:14.162553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Allocated IP 172.20.0.3 (7dfd3397-4224-400a-aaa3-cc4d3ecb39ed/c26a2f92-dc9b-4b7c-8097-7c1524be74be/424b0cd8-e541-404e-8b1c-7cabc5fd8532) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:14.202173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:14.202806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.204374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "PUT /v2.0/subnets/c26a2f92-dc9b-4b7c-8097-7c1524be74be HTTP/1.1" status: 200 len: 877 time: 0.8016067 Dec 21 04:11:14.208103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56540) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:14.287129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c246aa-5899-424c-b2f0-3b54ee4b4094 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event updated for resources: {'Subnet': ['ID=c26a2f92-dc9b-4b7c-8097-7c1524be74be,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:14.408123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.512987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.518363 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.580379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.647174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.731428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.771531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:14.771531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:14.773688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:14.786065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Pushing event updated for resources: {'Port': ['ID=424b0cd8-e541-404e-8b1c-7cabc5fd8532,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:14.799030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=c26a2f92-dc9b-4b7c-8097-7c1524be74be,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:14.890203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.916119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7dfd3397-4224-400a-aaa3-cc4d3ecb39ed']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:14.929507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2eed4d09-eb47-4de0-95a0-2015313f19ac') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:14.930900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2eed4d09-eb47-4de0-95a0-2015313f19ac') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:14.940886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Attempting to bind port 424b0cd8-e541-404e-8b1c-7cabc5fd8532 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:14.940886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Attempting to bind port 424b0cd8-e541-404e-8b1c-7cabc5fd8532 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '2eed4d09-eb47-4de0-95a0-2015313f19ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:14.940886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Attempting to bind port 424b0cd8-e541-404e-8b1c-7cabc5fd8532 on network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:14.953758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:14.954150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Checking segment: {'id': '2eed4d09-eb47-4de0-95a0-2015313f19ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:14.954560 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.954979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Bound using segment: {'id': '2eed4d09-eb47-4de0-95a0-2015313f19ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:14.955625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Bound port: 424b0cd8-e541-404e-8b1c-7cabc5fd8532, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2eed4d09-eb47-4de0-95a0-2015313f19ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:14.955863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.959920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.975266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.982680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 110 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:14.983454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:14.988863 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:15.037771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 06b0b22d-c54c-485b-897b-07e42da52e86 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:15.037771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.077431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] For port 424b0cd8-e541-404e-8b1c-7cabc5fd8532, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:15.097766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] For port 424b0cd8-e541-404e-8b1c-7cabc5fd8532, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=424b0cd8-e541-404e-8b1c-7cabc5fd8532,segment=NetworkSegment(2eed4d09-eb47-4de0-95a0-2015313f19ac),segment_id=2eed4d09-eb47-4de0-95a0-2015313f19ac)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:15.103416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:15.128240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:11:15.128240 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:11:15.128240 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '7dfd3397-4224-400a-aaa3-cc4d3ecb39ed'}] Dec 21 04:11:15.128240 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:11:15.128831 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:11:15.153668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:15.154041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 79d0bdbe-6706-42aa-82a3-e013ef9c92b1 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:15.167991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.179459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.180665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 06b0b22d-c54c-485b-897b-07e42da52e86 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:15.299563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ed7f8d-8ea6-46ed-ab65-c5bfbe23d5e6 None None] Pushing event updated for resources: {'Port': ['ID=424b0cd8-e541-404e-8b1c-7cabc5fd8532,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:15.315147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-195c996b-6f2a-4b8e-8414-9e2ce75c00aa None None] Network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:15.442416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d05f4b6b-4ac2-443a-bd9a-950b187d3f21 None None] Network 7dfd3397-4224-400a-aaa3-cc4d3ecb39ed requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:15.552906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56578) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:15.626426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.629686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.652383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9f3cf03-cda2-4169-b242-091c6366d04f None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:11:15.725613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port 424b0cd8-e541-404e-8b1c-7cabc5fd8532 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:15.726314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.769950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=06b0b22d-c54c-485b-897b-07e42da52e86,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:15.813556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02b3ca8c-7d06-4fc3-9631-954c84bea938 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.815938 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9f3cf03-cda2-4169-b242-091c6366d04f None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:11:15.932969 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02b3ca8c-7d06-4fc3-9631-954c84bea938 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.952789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port 424b0cd8-e541-404e-8b1c-7cabc5fd8532, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=424b0cd8-e541-404e-8b1c-7cabc5fd8532,segment=NetworkSegment(2eed4d09-eb47-4de0-95a0-2015313f19ac),segment_id=2eed4d09-eb47-4de0-95a0-2015313f19ac)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:15.954245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:15.972372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for 424b0cd8-e541-404e-8b1c-7cabc5fd8532 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:16.003296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02b3ca8c-7d06-4fc3-9631-954c84bea938 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.082697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b3ca8c-7d06-4fc3-9631-954c84bea938 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=368047e7-eea0-481f-b06f-7e9417dc3fff,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:16.107132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.115844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-4cea8ba5-4346-4d31-a656-5887186d5615 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:16.124572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-4cea8ba5-4346-4d31-a656-5887186d5615 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2962489 Dec 21 04:11:16.141045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-3dee0f10-9de7-4f9d-9151-f98b99893110 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0151396 Dec 21 04:11:16.169933 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-02b3ca8c-7d06-4fc3-9631-954c84bea938 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b360a9cc6ed94790befd698772e2eae0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6158535 Dec 21 04:11:16.175355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56598) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:16.197794 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.300764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port 424b0cd8-e541-404e-8b1c-7cabc5fd8532 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:16.343325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=424b0cd8-e541-404e-8b1c-7cabc5fd8532,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:16.398870 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-333bf799-7d9e-4712-95b1-544e9c9fdd98 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.469058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.473966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-333bf799-7d9e-4712-95b1-544e9c9fdd98 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.511293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7dfd3397-4224-400a-aaa3-cc4d3ecb39ed']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:16.535291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2eed4d09-eb47-4de0-95a0-2015313f19ac') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:16.535691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2eed4d09-eb47-4de0-95a0-2015313f19ac') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:16.548370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.566981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.574740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 110 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:16.575197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:16.579749 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:16.669986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-333bf799-7d9e-4712-95b1-544e9c9fdd98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.673958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-333bf799-7d9e-4712-95b1-544e9c9fdd98 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.675925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-333bf799-7d9e-4712-95b1-544e9c9fdd98 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/368047e7-eea0-481f-b06f-7e9417dc3fff HTTP/1.1" status: 204 len: 168 time: 0.4990246 Dec 21 04:11:16.703307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333bf799-7d9e-4712-95b1-544e9c9fdd98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=368047e7-eea0-481f-b06f-7e9417dc3fff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:16.722459 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.738123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:16.748693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/7dfd3397-4224-400a-aaa3-cc4d3ecb39ed HTTP/1.1" status: 204 len: 168 time: 2.5358877 Dec 21 04:11:16.752419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:16.790807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0bd291f-bb8a-4465-a522-24e8ac05971f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=7dfd3397-4224-400a-aaa3-cc4d3ecb39ed,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:16.804911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-7246d708-cd39-4dbc-925e-d81ad2d17d32 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 255 time: 0.6440248 Dec 21 04:11:16.812530 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-8eb8463b-d6fd-4a89-957e-163d90109149 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:16.813001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8eb8463b-d6fd-4a89-957e-163d90109149 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:16.818559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8eb8463b-d6fd-4a89-957e-163d90109149 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/c26a2f92-dc9b-4b7c-8097-7c1524be74be HTTP/1.1" status: 404 len: 337 time: 0.0626729 Dec 21 04:11:16.819292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56606) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:16.836028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 1e5ca073-9ee5-4a7e-83ed-57fc750be120 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:16.850278 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-6825aef6-a77d-44f0-b2ef-40839f9e1c52 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:16.851816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6825aef6-a77d-44f0-b2ef-40839f9e1c52 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:16.857109 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6825aef6-a77d-44f0-b2ef-40839f9e1c52 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/7dfd3397-4224-400a-aaa3-cc4d3ecb39ed HTTP/1.1" status: 404 len: 339 time: 0.0352571 Dec 21 04:11:16.857389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56610) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:16.886550 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9bcc1181-71c1-4f30-9d86-1b8125a3ab8c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:16.887196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9bcc1181-71c1-4f30-9d86-1b8125a3ab8c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:16.896038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9bcc1181-71c1-4f30-9d86-1b8125a3ab8c tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/07d70915-70ee-42fe-8294-aa03bd6ce56e HTTP/1.1" status: 404 len: 337 time: 0.0354655 Dec 21 04:11:16.897112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:16.928469 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b4b2db75-621c-4ca4-a814-2d04f323ddec tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:16.928986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b4b2db75-621c-4ca4-a814-2d04f323ddec tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:16.934788 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b4b2db75-621c-4ca4-a814-2d04f323ddec tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/41ee9db9-328f-4830-b572-0221865382e9 HTTP/1.1" status: 404 len: 339 time: 0.0342917 Dec 21 04:11:16.935316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56616) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:16.986101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:16.995792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] Sync routers for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:17.009179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bc7bcd50-72d8-417c-93b7-5c5d3380005b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/1e5ca073-9ee5-4a7e-83ed-57fc750be120/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0692034 Dec 21 04:11:17.021253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56618) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.024463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:17.025100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.025391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.103448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.105867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2d541c9e-ce80-4b68-8e04-54f0fc1272b1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e5ca073-9ee5-4a7e-83ed-57fc750be120 HTTP/1.1" status: 200 len: 205 time: 0.0831404 Dec 21 04:11:17.109212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56622) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.128498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] Routers {'1e5ca073-9ee5-4a7e-83ed-57fc750be120'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:17.129246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.192458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.199182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.200151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b15d4fc-ba03-4916-9b13-f771581df333 None None] The sync data for ids ['1e5ca073-9ee5-4a7e-83ed-57fc750be120'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:17.217643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-cd1119df-1e39-4695-b6ab-ccdcc96510c1 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4015183 Dec 21 04:11:17.280849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29873c8e-da69-44cb-93db-c067f2be1392']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.292603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.339459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b128860e-575e-437c-8619-c3b55f9663f1') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.339762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b128860e-575e-437c-8619-c3b55f9663f1') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:17.379349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.379567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-0a1cf554-3f99-46cb-9c92-c2cf0dcc1049 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1533420 Dec 21 04:11:17.410352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.458707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 126 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:17.459139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:17.462274 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:17.510828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56628) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.527056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0201e5cb-69dc-4735-a89c-7ece101bf064 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.628888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.628888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.733826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02368bd0-0038-4308-a08e-259d1848f49f req-3e0c963a-6094-4609-9daf-8d9998f8a10b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 210 time: 0.0478096 Dec 21 04:11:17.742589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.761860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.761860 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/29873c8e-da69-44cb-93db-c067f2be1392 HTTP/1.1" status: 204 len: 168 time: 0.8165877 Dec 21 04:11:17.765741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56636) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.799720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215cb5c2-3b61-4219-bef3-412b386e8097 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=29873c8e-da69-44cb-93db-c067f2be1392,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:17.804586 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-590baf59-2335-4aa2-9fec-eaff421fbe5a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:17.805072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-590baf59-2335-4aa2-9fec-eaff421fbe5a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:17.812942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-590baf59-2335-4aa2-9fec-eaff421fbe5a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/6110bbab-8330-4770-8cb5-059af1d3027f HTTP/1.1" status: 404 len: 337 time: 0.0557928 Dec 21 04:11:17.815219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56638) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.838520 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e49ae79-c671-4db0-9eb5-e8ba1a3461b9 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:17.839351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e49ae79-c671-4db0-9eb5-e8ba1a3461b9 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:17.843710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5e49ae79-c671-4db0-9eb5-e8ba1a3461b9 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/b62b3c30-1c04-483b-a383-81d38024fd5a HTTP/1.1" status: 404 len: 339 time: 0.0274916 Dec 21 04:11:17.846326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56640) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.891359 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ed4e3b55-fc4a-4b27-9b6d-50290fb0106e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:17.891818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ed4e3b55-fc4a-4b27-9b6d-50290fb0106e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:17.900581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ed4e3b55-fc4a-4b27-9b6d-50290fb0106e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/eebb900a-42b9-4eda-b47e-d32c6c48eaec HTTP/1.1" status: 404 len: 337 time: 0.0531609 Dec 21 04:11:17.903229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.913114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.913613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router 1e5ca073-9ee5-4a7e-83ed-57fc750be120 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:11:17.922972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.932817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56648) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.936956 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8497b09b-863e-4779-95f3-50cb4ee146a9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/1e5ca073-9ee5-4a7e-83ed-57fc750be120 HTTP/1.1" status: 204 len: 168 time: 0.7453640 Dec 21 04:11:17.949780 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0201e5cb-69dc-4735-a89c-7ece101bf064 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:17.968603 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-17492bc4-727e-43ef-8621-eef64fa3617f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:17.969141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-17492bc4-727e-43ef-8621-eef64fa3617f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:17.974716 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-17492bc4-727e-43ef-8621-eef64fa3617f tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/7f5e6763-89c5-487b-99ca-b8c08713f81e HTTP/1.1" status: 404 len: 339 time: 0.0678844 Dec 21 04:11:17.975127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56652) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:17.999680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet 781d54cb-32cd-4268-9fed-8839d7a5c66a {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:18.003321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.035215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0201e5cb-69dc-4735-a89c-7ece101bf064 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.098915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.107365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0201e5cb-69dc-4735-a89c-7ece101bf064 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=db1b43495c814151af1e98bc4b86da94&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5913730 Dec 21 04:11:18.197759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56654) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.198558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0201e5cb-69dc-4735-a89c-7ece101bf064 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c9d603e-8320-4fb2-a904-c70d43fa0a10,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:18.281259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.323980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c498d81-4489-466b-896c-f9ed4dd64c0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.340492 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-42adceff-ed7c-4329-8477-4f5a488c3d1a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.342266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42adceff-ed7c-4329-8477-4f5a488c3d1a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.356400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42adceff-ed7c-4329-8477-4f5a488c3d1a tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/f81702c6-5868-4b89-b010-4116d4ae25d0 HTTP/1.1" status: 404 len: 337 time: 0.3782444 Dec 21 04:11:18.356793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.364864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c498d81-4489-466b-896c-f9ed4dd64c0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.383925 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-2cf03c02-33ec-4968-a22e-337bb02dbdef tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.384711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2cf03c02-33ec-4968-a22e-337bb02dbdef tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.388178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2cf03c02-33ec-4968-a22e-337bb02dbdef tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/baa3a525-fbfd-4a98-9b5c-786bb4f6931d HTTP/1.1" status: 404 len: 339 time: 0.0285964 Dec 21 04:11:18.391293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56660) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.424471 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-60654478-0eed-44f0-b196-ec33e2360a0e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.424943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60654478-0eed-44f0-b196-ec33e2360a0e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.428221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-60654478-0eed-44f0-b196-ec33e2360a0e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/8b63fcd2-b105-4bcf-a8ad-eda48f9ad21a HTTP/1.1" status: 404 len: 337 time: 0.0360215 Dec 21 04:11:18.430960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.448497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.451172 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-1c0f32da-5757-42f0-a2d4-da38c0121662 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.452960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1c0f32da-5757-42f0-a2d4-da38c0121662 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.456321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c0f32da-5757-42f0-a2d4-da38c0121662 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/e14edd5f-4b76-4991-8253-54e4e839727e HTTP/1.1" status: 404 len: 339 time: 0.0235481 Dec 21 04:11:18.466811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56666) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.470571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6396eff5-fe88-438c-bf3f-928d6d5a74bb None None] Network f19fabbf-793d-46f4-84b3-8eda9c4c1813 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:18.479590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.485559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/781d54cb-32cd-4268-9fed-8839d7a5c66a HTTP/1.1" status: 204 len: 168 time: 0.5490146 Dec 21 04:11:18.485559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63d3f6d-017c-40eb-bcc5-fffc322bdb40 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=781d54cb-32cd-4268-9fed-8839d7a5c66a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:18.485824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56668) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.493605 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-6d8abed8-bbe4-4b65-86aa-987f57948be4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.493605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6d8abed8-bbe4-4b65-86aa-987f57948be4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.496718 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d8abed8-bbe4-4b65-86aa-987f57948be4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/4976992e-0050-441e-976e-3ae785c7b9e0 HTTP/1.1" status: 404 len: 337 time: 0.0288341 Dec 21 04:11:18.499800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56670) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.524029 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-64b3d468-5736-40fd-92ac-4eeadfdf4929 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.535402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-64b3d468-5736-40fd-92ac-4eeadfdf4929 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.535402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-64b3d468-5736-40fd-92ac-4eeadfdf4929 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/4c146368-5b6d-4fb2-bd8f-497a27bfb17c HTTP/1.1" status: 404 len: 339 time: 0.0282567 Dec 21 04:11:18.535819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56674) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.585576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c498d81-4489-466b-896c-f9ed4dd64c0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.586695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c498d81-4489-466b-896c-f9ed4dd64c0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.590867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8c498d81-4489-466b-896c-f9ed4dd64c0f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6c9d603e-8320-4fb2-a904-c70d43fa0a10 HTTP/1.1" status: 204 len: 168 time: 0.3758965 Dec 21 04:11:18.594026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet fe4221c6-2b9e-4315-a77a-14834fb1e3ba {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:18.607643 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-ce9901d3-cc4e-403d-af82-a87eae1a4189 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.608018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ce9901d3-cc4e-403d-af82-a87eae1a4189 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.612337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ce9901d3-cc4e-403d-af82-a87eae1a4189 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/8efb4c46-d55f-49e0-960b-864dddcf16da HTTP/1.1" status: 404 len: 337 time: 0.0755060 Dec 21 04:11:18.616421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56680) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.632103 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.653114 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-99d1ed60-9b18-4ab3-b45f-86f5643dcbe4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.654316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-99d1ed60-9b18-4ab3-b45f-86f5643dcbe4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.659482 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-99d1ed60-9b18-4ab3-b45f-86f5643dcbe4 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/42dee1af-a012-4aca-9a2f-d60132aa5926 HTTP/1.1" status: 404 len: 339 time: 0.0419734 Dec 21 04:11:18.661913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c498d81-4489-466b-896c-f9ed4dd64c0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c9d603e-8320-4fb2-a904-c70d43fa0a10,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:18.662524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56682) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.692333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.699863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] DHCP port deletion for f19fabbf-793d-46f4-84b3-8eda9c4c1813 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:18.714112 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-8534d14e-4d36-4d22-afad-ff4093bd0dfa tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.714525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8534d14e-4d36-4d22-afad-ff4093bd0dfa tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.718991 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8534d14e-4d36-4d22-afad-ff4093bd0dfa tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/529d88c2-55fa-46a5-be66-646863f5af38 HTTP/1.1" status: 404 len: 337 time: 0.0506804 Dec 21 04:11:18.727283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.765002 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-dcf57fd3-0ae1-4195-bf3f-6e1c93142e84 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.765524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dcf57fd3-0ae1-4195-bf3f-6e1c93142e84 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.769021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dcf57fd3-0ae1-4195-bf3f-6e1c93142e84 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/3b358d03-5865-481d-8d07-19e609d89758 HTTP/1.1" status: 404 len: 339 time: 0.0407369 Dec 21 04:11:18.772319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56688) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.779906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] Deleting port 4e55eca0-c769-4a38-b048-852fdf99945d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:18.785640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.804546 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ffae7b22-e67b-49e0-89b1-659c763df3d7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.810806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ffae7b22-e67b-49e0-89b1-659c763df3d7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.810806 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ffae7b22-e67b-49e0-89b1-659c763df3d7 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/253cdad9-3831-4aba-abd0-91b9b0b2aa29 HTTP/1.1" status: 404 len: 337 time: 0.0348680 Dec 21 04:11:18.813180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56690) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.845727 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b398ba2e-e36f-4b25-bbf5-91d4f4967e65 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] DELETE failed (client error): The resource could not be found. Dec 21 04:11:18.847121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b398ba2e-e36f-4b25-bbf5-91d4f4967e65 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:18.856413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b398ba2e-e36f-4b25-bbf5-91d4f4967e65 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/44bbd974-1ffb-49bd-8e79-fdbb40b8032d HTTP/1.1" status: 404 len: 339 time: 0.0405788 Dec 21 04:11:18.856622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56692) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:18.907960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37727b80-b5c5-4012-ae8d-6f7db7292b8a req-3b7c52d2-eafb-40fb-a942-121c5531c37c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 210 time: 0.0371170 Dec 21 04:11:18.917332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.930295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] For port 4e55eca0-c769-4a38-b048-852fdf99945d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4e55eca0-c769-4a38-b048-852fdf99945d,segment=NetworkSegment(7136a056-c705-46da-b88b-c96144a10241),segment_id=7136a056-c705-46da-b88b-c96144a10241)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:18.931443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:18.952887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] Calling delete_port for 4e55eca0-c769-4a38-b048-852fdf99945d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:18.981351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting subnet 89c5e138-f670-4142-a03e-cdc4f57aeec7 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:18.995712 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.052603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.132701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.167504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.190274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] No DVR routers for this DVR port 4e55eca0-c769-4a38-b048-852fdf99945d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:19.204892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.213066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.216096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/fe4221c6-2b9e-4315-a77a-14834fb1e3ba HTTP/1.1" status: 204 len: 168 time: 0.7269111 Dec 21 04:11:19.216459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56702) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:19.217936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdeabe71-c258-43cd-b38d-f9f55801430b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=fe4221c6-2b9e-4315-a77a-14834fb1e3ba,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:19.232571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c66729e9-1275-4174-8a80-f6a7f5083aea None None] Pushing event deleted for resources: {'Port': ['ID=4e55eca0-c769-4a38-b048-852fdf99945d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:19.238235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce9f7a0b-8c59-4a09-925e-951214aa930c None None] Network 3828f0e6-1936-4057-b560-3b5beb4045e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:19.386862 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.431361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] DHCP port deletion for 3828f0e6-1936-4057-b560-3b5beb4045e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:19.501391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] Deleting port cc0e086b-caa2-4c7d-a25d-d639330d662d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:19.502519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.507390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.517420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.561593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Subnet': ['ID=89c5e138-f670-4142-a03e-cdc4f57aeec7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:19.566731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f19fabbf-793d-46f4-84b3-8eda9c4c1813']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:19.570812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.575704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d2bf83b-4f42-4840-a29d-4a28565dcc98 tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/subnets/89c5e138-f670-4142-a03e-cdc4f57aeec7 HTTP/1.1" status: 204 len: 168 time: 0.7138798 Dec 21 04:11:19.577154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56708) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:19.584500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7136a056-c705-46da-b88b-c96144a10241') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:19.584889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7136a056-c705-46da-b88b-c96144a10241') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:19.630556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.663101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.670176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 142 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:19.670739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:19.736031 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:19.742769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] For port cc0e086b-caa2-4c7d-a25d-d639330d662d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cc0e086b-caa2-4c7d-a25d-d639330d662d,segment=NetworkSegment(ed083fe5-54d3-48a4-b95d-bade9804847a),segment_id=ed083fe5-54d3-48a4-b95d-bade9804847a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:19.742769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.758998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-516bc438-5116-4675-947b-4fa0203523c0 None None] Network d7f1ce49-4162-4816-88d9-7892b1f1f54d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:19.761080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e55eca0-c769-4a38-b048-852fdf99945d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:19.769763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] Calling delete_port for cc0e086b-caa2-4c7d-a25d-d639330d662d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:19.772236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.824392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.837540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.848307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/f19fabbf-793d-46f4-84b3-8eda9c4c1813 HTTP/1.1" status: 204 len: 168 time: 0.6300178 Dec 21 04:11:19.872804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56720) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:19.896535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4e55eca0-c769-4a38-b048-852fdf99945d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:19.896889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e55eca0-c769-4a38-b048-852fdf99945d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:19.906648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Deleting port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:19.907030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:19.907662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cc0e086b-caa2-4c7d-a25d-d639330d662d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:19.990149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6577bef1-de70-4b46-a63c-17526319341b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.047974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.060440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31bd3fe6-1c20-4662-a35d-db836c3eac68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=f19fabbf-793d-46f4-84b3-8eda9c4c1813,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:20.082028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] For port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,segment=NetworkSegment(30fd6634-e2b9-4a11-ba0e-12e362e1fa25),segment_id=30fd6634-e2b9-4a11-ba0e-12e362e1fa25)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:20.082028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.131999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Calling delete_port for 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:20.138206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec9a943b-3b2c-4a09-9999-c60824687362 req-97800415-4eef-4a10-b56e-c8057512cd4a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 210 time: 0.0477760 Dec 21 04:11:20.144283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port cc0e086b-caa2-4c7d-a25d-d639330d662d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:20.144685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.242667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.252868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.290487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] Pushing event deleted for resources: {'Port': ['ID=cc0e086b-caa2-4c7d-a25d-d639330d662d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:20.296112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fc6d76a-b798-4135-81a4-5bb28c88034c None None] No DVR routers for this DVR port cc0e086b-caa2-4c7d-a25d-d639330d662d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:20.301523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port cc0e086b-caa2-4c7d-a25d-d639330d662d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cc0e086b-caa2-4c7d-a25d-d639330d662d,segment=NetworkSegment(ed083fe5-54d3-48a4-b95d-bade9804847a),segment_id=ed083fe5-54d3-48a4-b95d-bade9804847a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:20.321970 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.333409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07a95a5b-2a21-41bb-9bd4-ae6bdef1ae4d None None] DHCP port deletion for d7f1ce49-4162-4816-88d9-7892b1f1f54d request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:20.343572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.365198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for cc0e086b-caa2-4c7d-a25d-d639330d662d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:20.594719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ed1646c3-1582-4a74-9a01-738f89359eab tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:20.603424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.609082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ed1646c3-1582-4a74-9a01-738f89359eab tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2417867 Dec 21 04:11:20.610432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] No DVR routers for this DVR port 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:20.644468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=cc0e086b-caa2-4c7d-a25d-d639330d662d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:20.647662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port cc0e086b-caa2-4c7d-a25d-d639330d662d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:20.684762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': '298ccbff-718d-4893-8056-0dbaa2979734', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:20.706357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Port': ['ID=1930ef5a-f183-4a7b-a2bc-0c69e098c6bd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:20.786825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-07a95a5b-2a21-41bb-9bd4-ae6bdef1ae4d None None] The port '1930ef5a-f183-4a7b-a2bc-0c69e098c6bd' was deleted {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 21 04:11:20.812120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.845405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.939160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3828f0e6-1936-4057-b560-3b5beb4045e1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:20.963367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed083fe5-54d3-48a4-b95d-bade9804847a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:20.963367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed083fe5-54d3-48a4-b95d-bade9804847a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:20.973670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:20.993964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.001257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d7f1ce49-4162-4816-88d9-7892b1f1f54d']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:21.001486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:21.001745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.020677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '30fd6634-e2b9-4a11-ba0e-12e362e1fa25') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:21.021026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '30fd6634-e2b9-4a11-ba0e-12e362e1fa25') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:21.061576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:21.088520 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:21.094618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.108759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:21.109495 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:21.113153 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:21.176336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:21.179843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.202103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.210371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.216149 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/3828f0e6-1936-4057-b560-3b5beb4045e1 HTTP/1.1" status: 204 len: 168 time: 1.3373933 Dec 21 04:11:21.219596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56832) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:21.233748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-2100140885'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:21.246189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c62003-7292-4796-bdec-84626bd62a53 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=3828f0e6-1936-4057-b560-3b5beb4045e1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:21.303864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e038579-635b-4861-bd8c-2c7b3ec6e496 req-3e849d31-ed9e-4b4c-aadf-7ccf86a82e1e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 210 time: 0.0363305 Dec 21 04:11:21.306769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.317846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.320990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] 10.222.0.18 "DELETE /v2.0/networks/d7f1ce49-4162-4816-88d9-7892b1f1f54d HTTP/1.1" status: 204 len: 168 time: 1.7426159 Dec 21 04:11:21.338732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:21.342502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.354604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84068395-b5dd-4257-837c-c92b1ade067e tempest-NetworksTest-1857317135 tempest-NetworksTest-1857317135-project] Pushing event deleted for resources: {'Network': ['ID=d7f1ce49-4162-4816-88d9-7892b1f1f54d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:21.367407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:21.377401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.377713 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment ce2a1882-0f61-489e-b729-53fa0a2e2d1a of type vlan for network a35e3913-4b8e-4052-8403-db096c291f67 Dec 21 04:11:21.383894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.12 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/cd7d0c70-2e11-4c2f-be79-e58a8c17978c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:21.414448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-cf80ece0-f420-45e9-a7d7-5f25a77a9bd3 req-a1b3f8f9-5295-498f-9e3c-0146b264cbf6 service neutron] (110310) timed out ('10.222.0.18', 60602) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:11:21.419400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.533040 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.539202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:21.539977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.548856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.555940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:21.601831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:21.602198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1930ef5a-f183-4a7b-a2bc-0c69e098c6bd not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:21.622618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=a35e3913-4b8e-4052-8403-db096c291f67,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:21.631684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.632039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.632384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.632724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.633058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.633394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.633723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.634052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.634384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.634759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.635269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.635607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.635930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:21.648632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network a35e3913-4b8e-4052-8403-db096c291f67 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:21.651711 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1a3b5432-8ee2-4c59-b0bf-a7da94d923e0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4310107 Dec 21 04:11:21.665049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56854) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:21.672558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:21.697384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:21.727391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56858) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:21.747545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:21.855325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:21.870852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:21.871052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56868) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:21.879516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:21.893927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fe96dd5-e938-4ce8-b9f0-5a9147b9b057 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:21.931666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:21.977418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:21.978189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.011585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5bdcb61-8d01-4020-a170-4b4c2a98a01c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.030561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-22041ea3-7fcc-4a59-be7a-1a0df328e3fa None None] Provisioning complete for port cd7d0c70-2e11-4c2f-be79-e58a8c17978c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:22.031050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22041ea3-7fcc-4a59-be7a-1a0df328e3fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.048079 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8603e69-28e1-425a-ac72-5ae3699f0c9a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=06a9f38f04ae45689de096e588b0cdd2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1729107 Dec 21 04:11:22.048328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:22.055442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:22.063252 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.097597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-22041ea3-7fcc-4a59-be7a-1a0df328e3fa None None] Port cd7d0c70-2e11-4c2f-be79-e58a8c17978c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:22.104184 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-ae0c777b-cd02-4b55-a3ff-5d287e7d3298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4235322 Dec 21 04:11:22.131305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Request body: {'port': {'device_id': '298ccbff-718d-4893-8056-0dbaa2979734', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:22.154176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1219a13b-adc3-4c0a-b5c6-641e5cd9633d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.183161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1219a13b-adc3-4c0a-b5c6-641e5cd9633d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.193705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5bdcb61-8d01-4020-a170-4b4c2a98a01c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.244840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.270350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5bdcb61-8d01-4020-a170-4b4c2a98a01c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.311700 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e5bdcb61-8d01-4020-a170-4b4c2a98a01c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=553bede05db342aa862a4271fd1da4b9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5826302 Dec 21 04:11:22.312611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5bdcb61-8d01-4020-a170-4b4c2a98a01c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d081226d-320d-4f7f-97d3-470ca8d25347,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:22.315015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:22.350143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1219a13b-adc3-4c0a-b5c6-641e5cd9633d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.352862 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1219a13b-adc3-4c0a-b5c6-641e5cd9633d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.372028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1219a13b-adc3-4c0a-b5c6-641e5cd9633d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d058c5ad-25d1-468f-88da-85dba3bc3fa1 HTTP/1.1" status: 204 len: 168 time: 0.3072281 Dec 21 04:11:22.386129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1219a13b-adc3-4c0a-b5c6-641e5cd9633d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d058c5ad-25d1-468f-88da-85dba3bc3fa1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:22.407119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ec86e4e-ac2e-4b34-85ff-0683fe9214c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.434245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ec86e4e-ac2e-4b34-85ff-0683fe9214c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.539362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4972728d-166d-491e-bce5-4db8a964b7f1 req-645d204b-6b76-4965-a8ee-d24b0133e09a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:22.541138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4972728d-166d-491e-bce5-4db8a964b7f1 req-645d204b-6b76-4965-a8ee-d24b0133e09a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 932 time: 0.1091030 Dec 21 04:11:22.573304 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.580008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ec86e4e-ac2e-4b34-85ff-0683fe9214c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.587036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ec86e4e-ac2e-4b34-85ff-0683fe9214c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.590997 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ec86e4e-ac2e-4b34-85ff-0683fe9214c5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d081226d-320d-4f7f-97d3-470ca8d25347 HTTP/1.1" status: 204 len: 168 time: 0.2742023 Dec 21 04:11:22.625628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e435340-7393-45ec-a421-3920d0b938ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.636632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec86e4e-ac2e-4b34-85ff-0683fe9214c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d081226d-320d-4f7f-97d3-470ca8d25347,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:22.734991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4972728d-166d-491e-bce5-4db8a964b7f1 req-1a08355f-13b3-4be8-86d3-88dd5643d3e5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1649964 Dec 21 04:11:22.767725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=e3dc1ab4-c416-4896-8225-d9e2ebfcc58a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:22.796761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.797374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.797895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.798439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.799343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.800032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.800375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.800716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.801114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.801367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.801872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.802374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.803160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:22.808508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:22.811488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: a35e3913-4b8e-4052-8403-db096c291f67, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:22.865087 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.885923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd7d0c70-2e11-4c2f-be79-e58a8c17978c {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:11:22.895876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:22.911273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Transition to ACTIVE for port object cd7d0c70-2e11-4c2f-be79-e58a8c17978c will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:11:22.968797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network a35e3913-4b8e-4052-8403-db096c291f67 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:23.030287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.070010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, a35e3913-4b8e-4052-8403-db096c291f67) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:23.081586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ec51feb-c33b-4ada-865a-6510173d23c0 None None] Network a35e3913-4b8e-4052-8403-db096c291f67 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:23.101500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:23.102161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.114836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-762300e7-16a2-49ea-8c12-d36918bcedec None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:23.127555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Pushing event updated for resources: {'Port': ['ID=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:23.254285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-631721dc-afaa-4fac-a3a0-bb5c8c43554c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5879688 Dec 21 04:11:23.257654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 56958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:23.267683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1367643088', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:23.279989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72078e97-e935-456d-bd94-289753398608 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-a35e3913-4b8e-4052-8403-db096c291f67', 'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': 'e3dc1ab4-c416-4896-8225-d9e2ebfcc58a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:23.280973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72078e97-e935-456d-bd94-289753398608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.303262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.316637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Attempting to bind port cd7d0c70-2e11-4c2f-be79-e58a8c17978c on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:23.317803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Attempting to bind port cd7d0c70-2e11-4c2f-be79-e58a8c17978c by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:23.318185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Attempting to bind port cd7d0c70-2e11-4c2f-be79-e58a8c17978c on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:23.325047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Port cd7d0c70-2e11-4c2f-be79-e58a8c17978c on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:11:23.325744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Attempting to bind port cd7d0c70-2e11-4c2f-be79-e58a8c17978c on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:23.333815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:23.334397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:23.335266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:23.337146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Bound port: cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:23.338109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.378791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.382082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.432871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] For port cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:23.438441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] For port cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:23.484948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.497863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-72078e97-e935-456d-bd94-289753398608 None None] Allocated IP 172.20.0.2 (a35e3913-4b8e-4052-8403-db096c291f67/e3dc1ab4-c416-4896-8225-d9e2ebfcc58a/27e3e5da-9586-4baa-9911-71e2961e315b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:23.521978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.569838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:23.571572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.575245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] 10.222.0.31 "PUT /v2.0/ports/cd7d0c70-2e11-4c2f-be79-e58a8c17978c HTTP/1.1" status: 200 len: 1093 time: 1.4469118 Dec 21 04:11:23.579337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.579787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '298ccbff-718d-4893-8056-0dbaa2979734', 'tag': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:11:23.582337 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-041ece49-65e2-40a7-afa4-dd6bf4c9405c" -d '{"events": [{"name": "network-changed", "server_uuid": "298ccbff-718d-4893-8056-0dbaa2979734", "tag": "cd7d0c70-2e11-4c2f-be79-e58a8c17978c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:11:23.626108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49d32f8-b309-414a-bb4b-2e1dedc48fc9 service neutron] Pushing event updated for resources: {'Port': ['ID=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:23.647629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06f54c15-34c5-4c5f-bf27-7cb541064428 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:23.659133 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:11:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15b23b8a-f43d-49f1-a016-5512af7f0f4c x-openstack-request-id: req-15b23b8a-f43d-49f1-a016-5512af7f0f4c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:11:23.660931 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "298ccbff-718d-4893-8056-0dbaa2979734", "tag": "cd7d0c70-2e11-4c2f-be79-e58a8c17978c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:11:23.663044 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-15b23b8a-f43d-49f1-a016-5512af7f0f4c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:11:23.664099 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '298ccbff-718d-4893-8056-0dbaa2979734', 'tag': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c', 'status': 'completed', 'code': 200} Dec 21 04:11:23.701469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.705867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 56992) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:23.706317 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9f5c14d9-e1d6-4f82-8146-5a1acb9d6e36 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.4464984 Dec 21 04:11:23.712293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'port': {'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67', 'name': 'tempest-RoutersTest-2124090597'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:23.813477 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72078e97-e935-456d-bd94-289753398608 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.858815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041ece49-65e2-40a7-afa4-dd6bf4c9405c req-b50ee0ae-20cc-4f91-8d61-8ae2b6d9ba5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:23.860365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-041ece49-65e2-40a7-afa4-dd6bf4c9405c req-b50ee0ae-20cc-4f91-8d61-8ae2b6d9ba5a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 1096 time: 0.0728672 Dec 21 04:11:23.899494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72078e97-e935-456d-bd94-289753398608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:23.954583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57006) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:24.014651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72078e97-e935-456d-bd94-289753398608 None None] Pushing event updated for resources: {'Port': ['ID=27e3e5da-9586-4baa-9911-71e2961e315b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:24.019489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a00861d-8f33-4e7d-a084-62cdf5314da4 req-8c1d67e8-137a-4fea-8d1a-279c78ee2062 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:24.021279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a00861d-8f33-4e7d-a084-62cdf5314da4 req-8c1d67e8-137a-4fea-8d1a-279c78ee2062 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 944 time: 0.1571264 Dec 21 04:11:24.044540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72078e97-e935-456d-bd94-289753398608 None None] Network a35e3913-4b8e-4052-8403-db096c291f67 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:24.048416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-72078e97-e935-456d-bd94-289753398608 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:24.059188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72078e97-e935-456d-bd94-289753398608 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:24.082168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-1829482487', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:24.100937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041ece49-65e2-40a7-afa4-dd6bf4c9405c req-ea19919d-02c3-4700-bcee-c3127021ce01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:24.104035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-041ece49-65e2-40a7-afa4-dd6bf4c9405c req-ea19919d-02c3-4700-bcee-c3127021ce01 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&shared=False HTTP/1.1" status: 200 len: 906 time: 0.2094908 Dec 21 04:11:24.129870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a00861d-8f33-4e7d-a084-62cdf5314da4 req-6c0a9486-8593-4f02-b339-a2cbaeb3351a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982754 Dec 21 04:11:24.142614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-72078e97-e935-456d-bd94-289753398608 None None] Attempting to bind port 27e3e5da-9586-4baa-9911-71e2961e315b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:24.142614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-72078e97-e935-456d-bd94-289753398608 None None] Attempting to bind port 27e3e5da-9586-4baa-9911-71e2961e315b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:24.142614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72078e97-e935-456d-bd94-289753398608 None None] Attempting to bind port 27e3e5da-9586-4baa-9911-71e2961e315b on network a35e3913-4b8e-4052-8403-db096c291f67 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:24.146047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72078e97-e935-456d-bd94-289753398608 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:24.146426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72078e97-e935-456d-bd94-289753398608 None None] Checking segment: {'id': 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:24.146824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72078e97-e935-456d-bd94-289753398608 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.147237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72078e97-e935-456d-bd94-289753398608 None None] Bound using segment: {'id': 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:24.147929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-72078e97-e935-456d-bd94-289753398608 None None] Bound port: 27e3e5da-9586-4baa-9911-71e2961e315b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a35e3913-4b8e-4052-8403-db096c291f67'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:24.148504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72078e97-e935-456d-bd94-289753398608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.230789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041ece49-65e2-40a7-afa4-dd6bf4c9405c req-42867a02-eeda-423e-83d8-f37da45e82e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:24.233216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-041ece49-65e2-40a7-afa4-dd6bf4c9405c req-42867a02-eeda-423e-83d8-f37da45e82e3 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1180496 Dec 21 04:11:24.238081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-72078e97-e935-456d-bd94-289753398608 None None] For port 27e3e5da-9586-4baa-9911-71e2961e315b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:24.243402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:24.249080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.262669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-72078e97-e935-456d-bd94-289753398608 None None] For port 27e3e5da-9586-4baa-9911-71e2961e315b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27e3e5da-9586-4baa-9911-71e2961e315b,segment=NetworkSegment(ce2a1882-0f61-489e-b729-53fa0a2e2d1a),segment_id=ce2a1882-0f61-489e-b729-53fa0a2e2d1a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:24.279328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] device_id is not set on port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:11:24.389012 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.389585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-72078e97-e935-456d-bd94-289753398608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.390224 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.407874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-e947047b-88fb-4357-8f99-de732b43bab8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:24.409395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-e947047b-88fb-4357-8f99-de732b43bab8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 1096 time: 0.0866566 Dec 21 04:11:24.429861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.20.0.5 (a35e3913-4b8e-4052-8403-db096c291f67/e3dc1ab4-c416-4896-8225-d9e2ebfcc58a/d08f93cb-3a2c-4a52-abd2-a2e93cf4208c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:24.462955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72078e97-e935-456d-bd94-289753398608 None None] Pushing event updated for resources: {'Port': ['ID=27e3e5da-9586-4baa-9911-71e2961e315b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:24.470969 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.481205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-cd923b0d-a2dd-46b5-b220-50c30e95dd41 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cd7d0c70-2e11-4c2f-be79-e58a8c17978c HTTP/1.1" status: 200 len: 217 time: 0.0490015 Dec 21 04:11:24.559350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.650429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-8bf76dbc-298c-454b-bb0c-615ac4cd5794 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:24.652447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-8bf76dbc-298c-454b-bb0c-615ac4cd5794 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.1556084 Dec 21 04:11:24.670912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.670912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd3a0b4f-050e-4c4b-a9ce-4e9c11d1675f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 712 time: 0.7083406 Dec 21 04:11:24.670912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57044) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:24.675969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-606835223'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:24.707870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-bbabe2e7-62bf-45e4-8722-803b28cb5685 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435543 Dec 21 04:11:24.788587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:24.799373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.809867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.822089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:24.922171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-eeb86457-0bbe-489a-a000-98433cf3fa33 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2014751 Dec 21 04:11:25.000413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.031768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.036250 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.064774 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.065014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.109889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7fee7783-2ad2-49e1-93fb-c76ff6258547,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:25.110462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network a35e3913-4b8e-4052-8403-db096c291f67 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:25.121718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:25.127180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=d08f93cb-3a2c-4a52-abd2-a2e93cf4208c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:25.129503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:25.132012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:25.135194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c3783a-5b25-4431-84c6-fa1c395732e4 req-d1f1a39e-c75c-405b-ba0f-a7a9edfcbddf service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2001281 Dec 21 04:11:25.147853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.148490 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Added segment 240168e6-1db5-4ea6-be52-028b80f6fe48 of type vlan for network e7b09977-f166-4981-872a-dbaf0c6594ff Dec 21 04:11:25.215811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.233740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:25.234397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.324241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85d2ccb-fad4-4795-b38b-aa7d1d50e95f req-49f54584-ccca-416e-bf94-1eda67ec2e96 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:25.325777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a85d2ccb-fad4-4795-b38b-aa7d1d50e95f req-49f54584-ccca-416e-bf94-1eda67ec2e96 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 944 time: 0.0517025 Dec 21 04:11:25.331070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d112e198-8c81-438f-82aa-de2bf192150c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 1.6240172 Dec 21 04:11:25.334025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57080) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:25.414082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.419702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a85d2ccb-fad4-4795-b38b-aa7d1d50e95f req-321aca26-67ec-4aa9-b271-a5b7fa7a8f47 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837677 Dec 21 04:11:25.425855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:25.426637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.554658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Network': ['ID=e7b09977-f166-4981-872a-dbaf0c6594ff,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:25.580073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e7b09977-f166-4981-872a-dbaf0c6594ff details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:25.709603 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-961b2ffe-bd08-4db2-a22f-c8a37325d542 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.0374053 Dec 21 04:11:25.709868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57096) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:25.732215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'subnet': {'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:25.828507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27e3e5da-9586-4baa-9911-71e2961e315b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:25.945714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 27e3e5da-9586-4baa-9911-71e2961e315b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:25.946578 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:25.986378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:26.026221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:26.043027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.045326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.053476 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.074770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.118663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 27e3e5da-9586-4baa-9911-71e2961e315b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27e3e5da-9586-4baa-9911-71e2961e315b,segment=NetworkSegment(ce2a1882-0f61-489e-b729-53fa0a2e2d1a),segment_id=ce2a1882-0f61-489e-b729-53fa0a2e2d1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:26.178310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3f21245-2d93-4d77-8716-64ac9d5b0427 None None] Network a35e3913-4b8e-4052-8403-db096c291f67 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:26.219134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.231182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:26.346266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2465ef86-a900-420c-8d8f-b6800e5fa02f None None] Provisioning complete for port 27e3e5da-9586-4baa-9911-71e2961e315b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:26.346720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2465ef86-a900-420c-8d8f-b6800e5fa02f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.358550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.412650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=27e3e5da-9586-4baa-9911-71e2961e315b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:26.427723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.428072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.428755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.429388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.429919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.430427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.431004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.431562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.432107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.433133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.433690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.434240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.434781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:11:26.450152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.577253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.687440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=d08f93cb-3a2c-4a52-abd2-a2e93cf4208c,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:26.848275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b394a832-8c80-4c18-9235-d27ae4763f98 None None] Provisioning complete for port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:26.848855 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b394a832-8c80-4c18-9235-d27ae4763f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.855630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.908739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b394a832-8c80-4c18-9235-d27ae4763f98 None None] Port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:26.911333 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.928143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b394a832-8c80-4c18-9235-d27ae4763f98 None None] Provisioning complete for port 27e3e5da-9586-4baa-9911-71e2961e315b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:26.928746 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b394a832-8c80-4c18-9235-d27ae4763f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:26.993650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32cb4d2-b05b-49f6-89fb-152198b4b8a8 req-fa915ffc-a5bd-48c6-8caf-02a10a62dac8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:27.001154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d32cb4d2-b05b-49f6-89fb-152198b4b8a8 req-fa915ffc-a5bd-48c6-8caf-02a10a62dac8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 944 time: 0.1497235 Dec 21 04:11:27.027326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Checking segment: {'id': '240168e6-1db5-4ea6-be52-028b80f6fe48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:27.027702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network hostable DHCP agents. Network: e7b09977-f166-4981-872a-dbaf0c6594ff, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:27.032781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Subnet': ['ID=5c5511d1-b116-437a-bb3b-1348df155234,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:27.089923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d32cb4d2-b05b-49f6-89fb-152198b4b8a8 req-f0ee9870-09e9-420c-89b7-b8c3c87e1075 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878422 Dec 21 04:11:27.093010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.205878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a77f857c-8d0b-4a48-af06-f29bf008949f None None] Provisioning complete for port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:27.205878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a77f857c-8d0b-4a48-af06-f29bf008949f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.206753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network e7b09977-f166-4981-872a-dbaf0c6594ff is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:27.210902 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.215121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Allocated IP 172.25.5.67 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/726c1677-016b-4928-81e9-43ea33c5ab4a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:27.243741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a77f857c-8d0b-4a48-af06-f29bf008949f None None] Port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:27.340076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e7b09977-f166-4981-872a-dbaf0c6594ff) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:27.361110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28644246-511b-47a8-9ccd-4506cd4f236c None None] Network e7b09977-f166-4981-872a-dbaf0c6594ff requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:27.363454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:27.363454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.418313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.433295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0fb579cb-644a-4b1f-9ae6-a79b6637a212 None None] Provisioning complete for port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:27.433808 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fb579cb-644a-4b1f-9ae6-a79b6637a212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.513344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0fb579cb-644a-4b1f-9ae6-a79b6637a212 None None] Port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:27.519799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-e7b09977-f166-4981-872a-dbaf0c6594ff', 'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff', 'project_id': '2a0a2fa67b584339a471421a200c59ab', 'fixed_ips': [{'subnet_id': '5c5511d1-b116-437a-bb3b-1348df155234'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:27.520953 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.533789 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.556055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:27.574927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:27.584619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-91c56da2-34ca-486b-98e7-ee145cb18263 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8735597 Dec 21 04:11:27.585425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:27.587403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:27.598491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'network': {'name': 'tempest-router-network01--886830399'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:27.615217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.616500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27e3e5da-9586-4baa-9911-71e2961e315b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:27.641878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Pushing event updated for resources: {'Port': ['ID=726c1677-016b-4928-81e9-43ea33c5ab4a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:27.698869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.729928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 27e3e5da-9586-4baa-9911-71e2961e315b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:27.730714 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.746925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.752320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:27.756142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.756724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Allocated IP 2001:db8::2 (e7b09977-f166-4981-872a-dbaf0c6594ff/5c5511d1-b116-437a-bb3b-1348df155234/c6a81acf-7222-47d8-9389-a59918e0ce43) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:27.820497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=d08f93cb-3a2c-4a52-abd2-a2e93cf4208c,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:27.825649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.831610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:27.848442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:27.848820 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Added segment b757cab0-d989-4c8e-8717-d537a2376ecf of type vlan for network b0759faa-656e-4cee-b2de-b0e63e0b6b5b Dec 21 04:11:27.860759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.004908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.058583 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.084557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.130217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Network e7b09977-f166-4981-872a-dbaf0c6594ff is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:28.145330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:28.153595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:28.159988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.189122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Pushing event updated for resources: {'Port': ['ID=c6a81acf-7222-47d8-9389-a59918e0ce43,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:28.230297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Attempting to bind port c6a81acf-7222-47d8-9389-a59918e0ce43 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:28.231206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Attempting to bind port c6a81acf-7222-47d8-9389-a59918e0ce43 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '240168e6-1db5-4ea6-be52-028b80f6fe48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:28.231543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Attempting to bind port c6a81acf-7222-47d8-9389-a59918e0ce43 on network e7b09977-f166-4981-872a-dbaf0c6594ff {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:28.237823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:28.241127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Checking segment: {'id': '240168e6-1db5-4ea6-be52-028b80f6fe48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:28.241127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.241127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Bound using segment: {'id': '240168e6-1db5-4ea6-be52-028b80f6fe48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:28.241127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Bound port: c6a81acf-7222-47d8-9389-a59918e0ce43, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '240168e6-1db5-4ea6-be52-028b80f6fe48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'e7b09977-f166-4981-872a-dbaf0c6594ff'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:28.241127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.289476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.310105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] For port c6a81acf-7222-47d8-9389-a59918e0ce43, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:28.315575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] For port c6a81acf-7222-47d8-9389-a59918e0ce43, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c6a81acf-7222-47d8-9389-a59918e0ce43,segment=NetworkSegment(240168e6-1db5-4ea6-be52-028b80f6fe48),segment_id=240168e6-1db5-4ea6-be52-028b80f6fe48)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:28.321070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network a35e3913-4b8e-4052-8403-db096c291f67 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:28.324185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.324380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:28.329411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Pushing event updated for resources: {'Port': ['ID=726c1677-016b-4928-81e9-43ea33c5ab4a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:28.360903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf660a64-8a6e-4a38-9c84-f562e2813804 req-042de397-0cb2-4333-9ec6-88d1d2f7eeaa tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:28.380214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf660a64-8a6e-4a38-9c84-f562e2813804 req-042de397-0cb2-4333-9ec6-88d1d2f7eeaa tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 944 time: 0.1447279 Dec 21 04:11:28.407844 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.440175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf660a64-8a6e-4a38-9c84-f562e2813804 req-7aad4466-a163-4c14-a292-22656480cf4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577650 Dec 21 04:11:28.473962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.480981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.486442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bfc6b892-cc27-48ed-9577-09058d0901f2 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.4970317 Dec 21 04:11:28.488514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57228) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:28.492908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:28.494387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.499162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-1253481031', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'fixed_ips': [{'ip_address': '172.25.5.67'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:28.518329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40049ae-5665-481c-9797-cf229d9fb211 None None] Pushing event updated for resources: {'Port': ['ID=c6a81acf-7222-47d8-9389-a59918e0ce43,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:28.587892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Network': ['ID=b0759faa-656e-4cee-b2de-b0e63e0b6b5b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:28.599441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:28.625248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Made reservation on behalf of 98fb718ec009429db0675548ab730543 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:28.628482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.643307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.643913 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ae5cedad-9d66-4a32-a67b-f3277631e303 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.0561295 Dec 21 04:11:28.644809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3caca355-993b-4367-9dd9-23035ae8dd2f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:11:28.646669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57236) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:28.655921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'network': {'name': 'tempest-router-network02--1290677216'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:28.747814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d62d18b-1579-4782-adbb-8de6ffdf6b51 None None] Provisioning complete for port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:28.749231 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d62d18b-1579-4782-adbb-8de6ffdf6b51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.774689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.800803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:28.805168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.806455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2d62d18b-1579-4782-adbb-8de6ffdf6b51 None None] Port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:28.858328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:28.866330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:28.870346 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.874842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] device_id is not set on port f6c21b10-4042-4c1e-a702-0123b57d982d yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:11:28.883296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] Sync routers for ids ['3caca355-993b-4367-9dd9-23035ae8dd2f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:28.888046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:11:28.888257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b8e16ef5-a6d8-4dd2-8178-0b206695ec01 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3caca355-993b-4367-9dd9-23035ae8dd2f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5528479 Dec 21 04:11:28.897261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57248) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:28.900473 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] Routers {'3caca355-993b-4367-9dd9-23035ae8dd2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:28.901537 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3caca355-993b-4367-9dd9-23035ae8dd2f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:28.939612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:28.948986 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] Routers {'3caca355-993b-4367-9dd9-23035ae8dd2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:28.949886 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3caca355-993b-4367-9dd9-23035ae8dd2f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:28.952247 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:28.952611 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Added segment ba45e926-52dc-467c-82d8-33ee6baf568d of type vlan for network 9d398c06-308f-4617-89f1-52d90f5160f4 Dec 21 04:11:28.985306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:28.986248 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27a481ff-7e96-46ea-a9aa-4753c55f6739 None None] The sync data for ids ['3caca355-993b-4367-9dd9-23035ae8dd2f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:29.000288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16191500-39ac-49de-a085-91238773ca44 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:29.004247 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-16191500-39ac-49de-a085-91238773ca44 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports/d08f93cb-3a2c-4a52-abd2-a2e93cf4208c HTTP/1.1" status: 200 len: 977 time: 0.1035476 Dec 21 04:11:29.004975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57252) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:29.013758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.051352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c58d92d3-953e-4c9c-ae9f-628badd6ee3b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:29.165733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.173819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:29.174519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.213855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd7d0c70-2e11-4c2f-be79-e58a8c17978c details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:11:29.284970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Network': ['ID=9d398c06-308f-4617-89f1-52d90f5160f4,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:29.306970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9d398c06-308f-4617-89f1-52d90f5160f4 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:29.334803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3531ee5d-3434-4770-9b51-8e82d10f293e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6831629 Dec 21 04:11:29.335516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:29.343252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'subnet': {'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:29.364279 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Dec 21 04:11:29.367368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:11:29.447993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38c51182-89fb-440e-b35b-9f9d31ace817 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 409 len: 371 time: 0.9583969 Dec 21 04:11:29.452458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:29.659291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:29.663200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.666942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c6a81acf-7222-47d8-9389-a59918e0ce43 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:29.733325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:29.754489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.787560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c', 'mac_address': 'fa:16:3e:1d:24:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:11:29.898594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c6a81acf-7222-47d8-9389-a59918e0ce43 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:29.898988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.948286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:29.954357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0df5b95-65aa-4bd2-9139-a6e0178e219e req-8b216bd7-ace1-4800-abbb-83a8fdb2ef4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:29.955964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0df5b95-65aa-4bd2-9139-a6e0178e219e req-8b216bd7-ace1-4800-abbb-83a8fdb2ef4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 944 time: 0.3610749 Dec 21 04:11:29.968596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cd7d0c70-2e11-4c2f-be79-e58a8c17978c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:11:30.026443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:30.028083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.038155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Deleting port 726c1677-016b-4928-81e9-43ea33c5ab4a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:30.038496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.046039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0df5b95-65aa-4bd2-9139-a6e0178e219e req-213808dd-0122-42af-9466-fee3fc412d12 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815313 Dec 21 04:11:30.066898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.084594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port c6a81acf-7222-47d8-9389-a59918e0ce43, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c6a81acf-7222-47d8-9389-a59918e0ce43,segment=NetworkSegment(240168e6-1db5-4ea6-be52-028b80f6fe48),segment_id=240168e6-1db5-4ea6-be52-028b80f6fe48)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:30.090750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eca01bec-7197-4543-84aa-305d392978cf None None] Network e7b09977-f166-4981-872a-dbaf0c6594ff requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:30.112336 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.151321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Subnet': ['ID=ba4b7059-4da4-4952-a888-415865d2ed3a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:30.170817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Checking segment: {'id': 'b757cab0-d989-4c8e-8717-d537a2376ecf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:30.171766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network hostable DHCP agents. Network: b0759faa-656e-4cee-b2de-b0e63e0b6b5b, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:30.179469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.218422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.219083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.233839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5521e4c7-1b05-4464-a903-5130d9252ba5 None None] Provisioning complete for port c6a81acf-7222-47d8-9389-a59918e0ce43 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:30.235134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5521e4c7-1b05-4464-a903-5130d9252ba5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.239715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Calling delete_port for 726c1677-016b-4928-81e9-43ea33c5ab4a owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:30.242004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:30.252818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port d08f93cb-3a2c-4a52-abd2-a2e93cf4208c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:30.253307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.258876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:30.353893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b0759faa-656e-4cee-b2de-b0e63e0b6b5b) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:30.357169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=c6a81acf-7222-47d8-9389-a59918e0ce43,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:30.365274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:30.366348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.407884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8552bd2b-940c-40fe-bfce-9c2eb2b48da6 None None] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:30.471880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bb872b3a-c7a4-4c2a-a238-128c33f8fbe0 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1345642 Dec 21 04:11:30.474638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57324) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:30.480227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'subnet': {'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:30.483828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['cd7d0c70-2e11-4c2f-be79-e58a8c17978c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:30.570102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b0759faa-656e-4cee-b2de-b0e63e0b6b5b', 'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b', 'project_id': '2a0a2fa67b584339a471421a200c59ab', 'fixed_ips': [{'subnet_id': 'ba4b7059-4da4-4952-a888-415865d2ed3a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:30.570804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.571366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.594545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for d08f93cb-3a2c-4a52-abd2-a2e93cf4208c owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:30.659097 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.690840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Pushing event deleted for resources: {'Port': ['ID=726c1677-016b-4928-81e9-43ea33c5ab4a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:30.710610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:30.718383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.771134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f1265389-2b31-487d-b908-5478f51ab7bb None None] Provisioning complete for port c6a81acf-7222-47d8-9389-a59918e0ce43 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:30.771655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1265389-2b31-487d-b908-5478f51ab7bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.804639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.807884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:30.809294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-22ea3241-24b4-41ee-9002-49175059cc60 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515 tempest-ExternalNetworksAdminNegativeTestJSON-1139159515-project-admin] 10.222.0.18 "DELETE /v2.0/floatingips/d6aae6e6-bd80-4813-9cb2-16ff1e64670f HTTP/1.1" status: 204 len: 168 time: 1.3557093 Dec 21 04:11:30.947181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Allocated IP 2001:db8::2 (b0759faa-656e-4cee-b2de-b0e63e0b6b5b/ba4b7059-4da4-4952-a888-415865d2ed3a/a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:30.984737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.031113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=d08f93cb-3a2c-4a52-abd2-a2e93cf4208c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:31.132569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.240807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Subnet': ['ID=16d58093-787c-405c-8d25-98009e56ac08,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:31.254492 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.323581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Checking segment: {'id': 'ba45e926-52dc-467c-82d8-33ee6baf568d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:31.324218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network hostable DHCP agents. Network: 9d398c06-308f-4617-89f1-52d90f5160f4, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:31.332833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.344974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.395697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:31.399078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:31.401615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:31.416602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Pushing event updated for resources: {'Port': ['ID=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:31.436634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network 9d398c06-308f-4617-89f1-52d90f5160f4 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:31.439618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57374) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:31.469764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Attempting to bind port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:31.473622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Attempting to bind port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b757cab0-d989-4c8e-8717-d537a2376ecf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:31.473622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Attempting to bind port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 on network b0759faa-656e-4cee-b2de-b0e63e0b6b5b {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:31.478278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:31.478666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Checking segment: {'id': 'b757cab0-d989-4c8e-8717-d537a2376ecf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:31.479103 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.479501 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Bound using segment: {'id': 'b757cab0-d989-4c8e-8717-d537a2376ecf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:31.480034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Bound port: a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b757cab0-d989-4c8e-8717-d537a2376ecf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'b0759faa-656e-4cee-b2de-b0e63e0b6b5b'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:31.480416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.537712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9d398c06-308f-4617-89f1-52d90f5160f4) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:31.542861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:31.543531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.565818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] For port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:31.570596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] For port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,segment=NetworkSegment(b757cab0-d989-4c8e-8717-d537a2376ecf),segment_id=b757cab0-d989-4c8e-8717-d537a2376ecf)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:31.582974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f8610e5-a78e-4431-b9ef-a89eb310c209 None None] Network 9d398c06-308f-4617-89f1-52d90f5160f4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:31.620819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c6a81acf-7222-47d8-9389-a59918e0ce43 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:31.641595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446342-d53f-4e4b-ac2f-859065204f3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.708352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2c97a69a-46bf-4c65-ae82-0ceffd7b88ba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2311006 Dec 21 04:11:31.709114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:31.711108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.782011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced5ad68-751a-4e2f-a5b6-4b04ada8f0f6 None None] Pushing event updated for resources: {'Port': ['ID=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:31.857341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c6a81acf-7222-47d8-9389-a59918e0ce43 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:31.858392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.911361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9d398c06-308f-4617-89f1-52d90f5160f4', 'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4', 'project_id': '2a0a2fa67b584339a471421a200c59ab', 'fixed_ips': [{'subnet_id': '16d58093-787c-405c-8d25-98009e56ac08'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:31.912480 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.929362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446342-d53f-4e4b-ac2f-859065204f3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:31.982090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7840989a-e1ea-4144-8e0e-404daa1d5c92 req-c39cc2a8-635d-4ad4-9b14-ab2b571733e2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:31.990403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7840989a-e1ea-4144-8e0e-404daa1d5c92 req-c39cc2a8-635d-4ad4-9b14-ab2b571733e2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 945 time: 0.8286901 Dec 21 04:11:32.022739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446342-d53f-4e4b-ac2f-859065204f3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.130473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Allocated IP 2001:db8::2 (9d398c06-308f-4617-89f1-52d90f5160f4/16d58093-787c-405c-8d25-98009e56ac08/bb6823e4-bfb5-464a-9b15-4e76f6dc434a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:32.203745 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a3446342-d53f-4e4b-ac2f-859065204f3a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b0b2d53c68454156ae29fce4c25011d2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7629087 Dec 21 04:11:32.207339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3caca355-993b-4367-9dd9-23035ae8dd2f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:32.208402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57408) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:32.223997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3446342-d53f-4e4b-ac2f-859065204f3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86314e14-a677-43d4-9385-a069dd2fff98,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:32.228674 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.243586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7840989a-e1ea-4144-8e0e-404daa1d5c92 req-098288a1-6241-4412-aab0-456abb7945e2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2512090 Dec 21 04:11:32.401150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.420147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:32.437313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9069d430-2b64-4dd2-9d96-ef51e37e6016 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3caca355-993b-4367-9dd9-23035ae8dd2f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4232314 Dec 21 04:11:32.438679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57422) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:32.440112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] Sync routers for ids ['3caca355-993b-4367-9dd9-23035ae8dd2f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:32.464554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] Routers {'3caca355-993b-4367-9dd9-23035ae8dd2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:32.465245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3caca355-993b-4367-9dd9-23035ae8dd2f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:32.496340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3948040-c87d-44ac-895e-9298748d08ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.502038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:32.504744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.558733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Network 9d398c06-308f-4617-89f1-52d90f5160f4 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:32.562830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] Routers {'3caca355-993b-4367-9dd9-23035ae8dd2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:32.563513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3caca355-993b-4367-9dd9-23035ae8dd2f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:32.580142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:32.580937 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3948040-c87d-44ac-895e-9298748d08ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.586107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:32.626733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Allocated IP 2001:db8::1 (b0759faa-656e-4cee-b2de-b0e63e0b6b5b/ba4b7059-4da4-4952-a888-415865d2ed3a/c0a7fafc-11df-44f4-807b-185991efc770) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:32.654670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Pushing event updated for resources: {'Port': ['ID=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:32.664521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:32.665395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7fe101b-7e13-4f16-a3a4-4f08edb0abe2 None None] The sync data for ids ['3caca355-993b-4367-9dd9-23035ae8dd2f'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:32.743650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Attempting to bind port bb6823e4-bfb5-464a-9b15-4e76f6dc434a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:32.744315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Attempting to bind port bb6823e4-bfb5-464a-9b15-4e76f6dc434a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ba45e926-52dc-467c-82d8-33ee6baf568d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:32.744926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Attempting to bind port bb6823e4-bfb5-464a-9b15-4e76f6dc434a on network 9d398c06-308f-4617-89f1-52d90f5160f4 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:32.751859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:32.752549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Checking segment: {'id': 'ba45e926-52dc-467c-82d8-33ee6baf568d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:32.753198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.753768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Bound using segment: {'id': 'ba45e926-52dc-467c-82d8-33ee6baf568d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:32.754517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Bound port: bb6823e4-bfb5-464a-9b15-4e76f6dc434a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba45e926-52dc-467c-82d8-33ee6baf568d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '9d398c06-308f-4617-89f1-52d90f5160f4'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:32.755192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.797017 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-21135e2f-b117-4211-ac70-6db139774b21 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] remove_router_interface failed (client error): The resource could not be found. Dec 21 04:11:32.798371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-21135e2f-b117-4211-ac70-6db139774b21 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3caca355-993b-4367-9dd9-23035ae8dd2f/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.3580348 Dec 21 04:11:32.801085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57440) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:32.801464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.853618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-31be4ade-826a-49d7-b9e9-57fdaee54dee tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=3caca355-993b-4367-9dd9-23035ae8dd2f HTTP/1.1" status: 200 len: 205 time: 0.0495877 Dec 21 04:11:32.854896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57446) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:32.891717 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] For port bb6823e4-bfb5-464a-9b15-4e76f6dc434a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:32.895473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] For port bb6823e4-bfb5-464a-9b15-4e76f6dc434a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,segment=NetworkSegment(ba45e926-52dc-467c-82d8-33ee6baf568d),segment_id=ba45e926-52dc-467c-82d8-33ee6baf568d)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:32.945173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.946199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3948040-c87d-44ac-895e-9298748d08ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.951723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3948040-c87d-44ac-895e-9298748d08ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:32.954904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a3948040-c87d-44ac-895e-9298748d08ac admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/86314e14-a677-43d4-9385-a069dd2fff98 HTTP/1.1" status: 204 len: 168 time: 0.7411878 Dec 21 04:11:32.963082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3948040-c87d-44ac-895e-9298748d08ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86314e14-a677-43d4-9385-a069dd2fff98,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:32.981322 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.070475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50768ac8-e4e5-4fea-b9cd-ccecd04c7429 None None] Pushing event updated for resources: {'Port': ['ID=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:33.073047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.181804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.186190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.202283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:33.218763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd7d0c70-2e11-4c2f-be79-e58a8c17978c up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:33.241453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:33.247324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:33.247894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.252476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Port': ['ID=c0a7fafc-11df-44f4-807b-185991efc770,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:33.341483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6a21184-e2df-42e9-ab09-84d6841f1adf None None] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:33.441053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.441053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router 3caca355-993b-4367-9dd9-23035ae8dd2f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:11:33.505290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05616d0f-a20a-48be-b1ad-c499d1f7dd7a req-0a8d902c-212d-4dff-8f69-3f5631072c08 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:33.508288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05616d0f-a20a-48be-b1ad-c499d1f7dd7a req-0a8d902c-212d-4dff-8f69-3f5631072c08 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 945 time: 0.1105652 Dec 21 04:11:33.510155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port cd7d0c70-2e11-4c2f-be79-e58a8c17978c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:11:33.514782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.518125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26b7a940-ccfd-4928-8e41-0f76318d2626 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/3caca355-993b-4367-9dd9-23035ae8dd2f HTTP/1.1" status: 204 len: 168 time: 0.6622100 Dec 21 04:11:33.525195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:33.531443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-88553a81-d08d-4639-a2a0-03c554230894 None None] Provisioning complete for port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:33.535680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88553a81-d08d-4639-a2a0-03c554230894 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.595105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port cd7d0c70-2e11-4c2f-be79-e58a8c17978c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:33.598423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.702849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet e3dc1ab4-c416-4896-8225-d9e2ebfcc58a {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:33.720621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.727577 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.739838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bb6823e4-bfb5-464a-9b15-4e76f6dc434a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:33.781336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.819224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05616d0f-a20a-48be-b1ad-c499d1f7dd7a req-93be0661-5d4f-45ac-bbf6-da0aaf6c535e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2966797 Dec 21 04:11:33.875757 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88553a81-d08d-4639-a2a0-03c554230894 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.878437 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:33.996505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.107405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57476) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:34.143765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '298ccbff-718d-4893-8056-0dbaa2979734', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:11:34.148658 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b793107f-ba34-4df7-b8ad-5e2cc5c678aa" -d '{"events": [{"server_uuid": "298ccbff-718d-4893-8056-0dbaa2979734", "name": "network-vif-plugged", "status": "completed", "tag": "cd7d0c70-2e11-4c2f-be79-e58a8c17978c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:11:34.150410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.198285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=e3dc1ab4-c416-4896-8225-d9e2ebfcc58a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:34.200134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bb6823e4-bfb5-464a-9b15-4e76f6dc434a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:34.200570 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.220801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:34.229574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.236289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-88fe93f5-c5a1-4f74-b38f-483a83c5b9ab tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/e3dc1ab4-c416-4896-8225-d9e2ebfcc58a HTTP/1.1" status: 204 len: 168 time: 0.7019122 Dec 21 04:11:34.237973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57482) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:34.260342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e5e0f0e9-b214-4413-ac8f-0d26febc2e09 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=98fb718ec009429db0675548ab730543&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1511474 Dec 21 04:11:34.271895 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:11:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7bdba1e4-c702-4c71-83ad-aa5c09b38e63 x-openstack-request-id: req-7bdba1e4-c702-4c71-83ad-aa5c09b38e63 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:11:34.272368 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "298ccbff-718d-4893-8056-0dbaa2979734", "name": "network-vif-plugged", "status": "completed", "tag": "cd7d0c70-2e11-4c2f-be79-e58a8c17978c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:11:34.272629 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7bdba1e4-c702-4c71-83ad-aa5c09b38e63 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:11:34.273146 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '298ccbff-718d-4893-8056-0dbaa2979734', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c', 'code': 200} Dec 21 04:11:34.284157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3322e5ea-8481-43b4-a8ea-6e5dcd5c2dce None None] Network a35e3913-4b8e-4052-8403-db096c291f67 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:34.294213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-88553a81-d08d-4639-a2a0-03c554230894 None None] For port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,segment=NetworkSegment(b757cab0-d989-4c8e-8717-d537a2376ecf),segment_id=b757cab0-d989-4c8e-8717-d537a2376ecf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:34.298133 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.315773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57484) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:34.431863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-88553a81-d08d-4639-a2a0-03c554230894 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.607869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.623995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.634069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:34.681815 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f54d29ad-7160-434c-a369-e37e1f38d1fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.682701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.689740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.734276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a6064857-40e2-4713-b3fc-adbc00afb09b None None] Provisioning complete for port c0a7fafc-11df-44f4-807b-185991efc770 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:34.735523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6064857-40e2-4713-b3fc-adbc00afb09b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.740509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f54d29ad-7160-434c-a369-e37e1f38d1fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.742852 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:34.771338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb4e5795-15fa-458b-8834-85dbef2b0c37 req-9fe1db73-4be7-406f-9694-528a088b180e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:34.774999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb4e5795-15fa-458b-8834-85dbef2b0c37 req-9fe1db73-4be7-406f-9694-528a088b180e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 1098 time: 0.3280034 Dec 21 04:11:34.826137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88553a81-d08d-4639-a2a0-03c554230894 None None] Pushing event updated for resources: {'Port': ['ID=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:34.832073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] DHCP port deletion for a35e3913-4b8e-4052-8403-db096c291f67 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:34.862513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a6064857-40e2-4713-b3fc-adbc00afb09b None None] Port c0a7fafc-11df-44f4-807b-185991efc770 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:34.923440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port bb6823e4-bfb5-464a-9b15-4e76f6dc434a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,segment=NetworkSegment(ba45e926-52dc-467c-82d8-33ee6baf568d),segment_id=ba45e926-52dc-467c-82d8-33ee6baf568d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:34.926504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Port': ['ID=c0a7fafc-11df-44f4-807b-185991efc770,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:34.951957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb4e5795-15fa-458b-8834-85dbef2b0c37 req-c07d5c82-c4e9-4e74-bd06-6396cdba2bd4 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1478045 Dec 21 04:11:34.961794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a8b9036-07d6-472c-a3f8-f73e241f592d None None] Network 9d398c06-308f-4617-89f1-52d90f5160f4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:34.993159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:34.994662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:35.002767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 27e3e5da-9586-4baa-9911-71e2961e315b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:35.003227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.074804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f54d29ad-7160-434c-a369-e37e1f38d1fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.079759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f54d29ad-7160-434c-a369-e37e1f38d1fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.081806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f54d29ad-7160-434c-a369-e37e1f38d1fe admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c58d92d3-953e-4c9c-ae9f-628badd6ee3b HTTP/1.1" status: 204 len: 168 time: 0.7650628 Dec 21 04:11:35.114571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f62e0d3-ed70-4700-9c1a-55679845694d req-70d0857e-ed64-4fb5-9f39-8c4cb9565924 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:35.116228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f62e0d3-ed70-4700-9c1a-55679845694d req-70d0857e-ed64-4fb5-9f39-8c4cb9565924 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.1587944 Dec 21 04:11:35.137693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.139563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:35.143519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f54d29ad-7160-434c-a369-e37e1f38d1fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c58d92d3-953e-4c9c-ae9f-628badd6ee3b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:35.153778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port 27e3e5da-9586-4baa-9911-71e2961e315b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27e3e5da-9586-4baa-9911-71e2961e315b,segment=NetworkSegment(ce2a1882-0f61-489e-b729-53fa0a2e2d1a),segment_id=ce2a1882-0f61-489e-b729-53fa0a2e2d1a)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:35.167161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.200041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 27e3e5da-9586-4baa-9911-71e2961e315b owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:35.281530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Router 8af511c2-9792-4e36-a5d8-264de09dab07 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:11:35.324498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f62e0d3-ed70-4700-9c1a-55679845694d req-19f38311-8c82-4ee6-abbf-b4ef4bbb848b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1929865 Dec 21 04:11:35.332671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a6064857-40e2-4713-b3fc-adbc00afb09b None None] Provisioning complete for port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:35.333045 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6064857-40e2-4713-b3fc-adbc00afb09b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.473010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:35.475147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:35.484348 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] Sync routers for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:35.495873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] Deleting port 27e3e5da-9586-4baa-9911-71e2961e315b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:35.496350 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.502312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.506038 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:35.506038 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.506320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f69f6cae-a619-427e-9e0e-c95687833c7c tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7919288 Dec 21 04:11:35.511940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57502) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:35.557736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=27e3e5da-9586-4baa-9911-71e2961e315b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:35.591332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] For port 27e3e5da-9586-4baa-9911-71e2961e315b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=27e3e5da-9586-4baa-9911-71e2961e315b,segment=NetworkSegment(ce2a1882-0f61-489e-b729-53fa0a2e2d1a),segment_id=ce2a1882-0f61-489e-b729-53fa0a2e2d1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:35.591838 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.595910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port 27e3e5da-9586-4baa-9911-71e2961e315b on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:35.616560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] Calling delete_port for 27e3e5da-9586-4baa-9911-71e2961e315b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:35.641856 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.656596 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:35.657232 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.686705 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:11:35.690118 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:11:35.697697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.732013 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.732961 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2f11262-5b9f-4c1a-b974-3fe9873486f9 None None] The sync data for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:35.762308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:35.762308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.778719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.832927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a35e3913-4b8e-4052-8403-db096c291f67']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.834040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] Pushing event deleted for resources: {'Port': ['ID=27e3e5da-9586-4baa-9911-71e2961e315b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:35.852343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f44f72a-12b8-4bb0-9854-d0a26a8f6de8 None None] No DVR routers for this DVR port 27e3e5da-9586-4baa-9911-71e2961e315b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:35.866596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.867128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce2a1882-0f61-489e-b729-53fa0a2e2d1a') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:35.894005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.917645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.934669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 107 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:35.937991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:35.944334 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:35.947920 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:36.075199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f8064a60-7340-4d20-ab30-0c169dc3b236 None None] Provisioning complete for port bb6823e4-bfb5-464a-9b15-4e76f6dc434a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:36.076143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8064a60-7340-4d20-ab30-0c169dc3b236 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.136888 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.148037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.164439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/a35e3913-4b8e-4052-8403-db096c291f67 HTTP/1.1" status: 204 len: 168 time: 1.9218998 Dec 21 04:11:36.165361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57520) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:36.197444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-307445471'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:36.222977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bb6823e4-bfb5-464a-9b15-4e76f6dc434a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:36.236047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a12c798-1a97-4bc8-9492-942fb94b89d1 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=a35e3913-4b8e-4052-8403-db096c291f67,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:36.350036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bb6823e4-bfb5-464a-9b15-4e76f6dc434a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:36.350512 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.359464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:36.365110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.369722 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-625cd5af-19d8-4bba-8633-a67ef4a8ca90 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:11:36.378607 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-625cd5af-19d8-4bba-8633-a67ef4a8ca90 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.8666911 Dec 21 04:11:36.378607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57528) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:36.400743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f8064a60-7340-4d20-ab30-0c169dc3b236 None None] Provisioning complete for port c0a7fafc-11df-44f4-807b-185991efc770 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:36.401982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8064a60-7340-4d20-ab30-0c169dc3b236 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.438568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:36.470256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.471400 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment 2575e406-7220-433e-9bb1-126c68035ce7 of type vlan for network ccd465cf-fcb7-41e1-b88b-817a4dc0333f Dec 21 04:11:36.501763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f8064a60-7340-4d20-ab30-0c169dc3b236 None None] Port c0a7fafc-11df-44f4-807b-185991efc770 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:36.555199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:36.579581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.633241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1df8dffd-1148-4b2c-b61e-6ff65a2c6002 None None] Provisioning complete for port bb6823e4-bfb5-464a-9b15-4e76f6dc434a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:36.633626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1df8dffd-1148-4b2c-b61e-6ff65a2c6002 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.685939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f897-725f-43a5-ad38-28b516acda38 req-1354e51f-f32d-422a-82c6-86cbf41ce98d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:36.690035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:36.690569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.691135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d31f897-725f-43a5-ad38-28b516acda38 req-1354e51f-f32d-422a-82c6-86cbf41ce98d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.1169503 Dec 21 04:11:36.792950 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.806513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:36.813588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:36.956127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27e3e5da-9586-4baa-9911-71e2961e315b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:36.986419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d31f897-725f-43a5-ad38-28b516acda38 req-91125c00-b195-4f39-930e-556bcee7d4f2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2836397 Dec 21 04:11:36.996995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 27e3e5da-9586-4baa-9911-71e2961e315b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:36.999161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=ccd465cf-fcb7-41e1-b88b-817a4dc0333f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:36.999686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 27e3e5da-9586-4baa-9911-71e2961e315b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:37.023303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:37.026547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.065987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d69e457-4586-4b26-9278-99e7f723ac45 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8779008 Dec 21 04:11:37.068345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57548) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:37.081321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:37.268486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:37.271782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.365061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting port c0a7fafc-11df-44f4-807b-185991efc770 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:37.370058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.467476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.497269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Calling delete_port for c0a7fafc-11df-44f4-807b-185991efc770 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:37.578900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.649213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=d7072066-5fd5-470f-a626-6f627b54be37,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:37.695885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': '2575e406-7220-433e-9bb1-126c68035ce7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:37.696875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: ccd465cf-fcb7-41e1-b88b-817a4dc0333f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:37.794077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:37.847082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.879979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Port': ['ID=c0a7fafc-11df-44f4-807b-185991efc770,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:37.881966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ccd465cf-fcb7-41e1-b88b-817a4dc0333f) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:37.886693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:37.887610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:37.902230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8962e68-911f-47b9-a63c-08948986e789 None None] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:38.034557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-57207c40-f6e9-4c56-ad96-0e0ba7b0b419 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9649906 Dec 21 04:11:38.037373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57576) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:38.042393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1753555095', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:38.076153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.127833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.128996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.160391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-ccd465cf-fcb7-41e1-b88b-817a4dc0333f', 'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': 'd7072066-5fd5-470f-a626-6f627b54be37'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:38.161391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.254060 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.310296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a32541b-7933-4002-aea1-c7a615fba8f2 req-03a0be46-d252-4cad-9f92-07f3a7ce5b9d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:38.312507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a32541b-7933-4002-aea1-c7a615fba8f2 req-03a0be46-d252-4cad-9f92-07f3a7ce5b9d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.1617444 Dec 21 04:11:38.340478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.376903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Allocated IP 172.20.0.2 (ccd465cf-fcb7-41e1-b88b-817a4dc0333f/d7072066-5fd5-470f-a626-6f627b54be37/6cfff773-9112-40de-b0a8-51ca66877e9e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:38.406269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Router 8af511c2-9792-4e36-a5d8-264de09dab07 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:38.415909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a32541b-7933-4002-aea1-c7a615fba8f2 req-ed347b17-c8fb-41ca-8fec-338d45a5754c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0972769 Dec 21 04:11:38.460808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.464196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-33eb5ced-73a2-4d9e-8c61-283a4a875c64 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.4251673 Dec 21 04:11:38.469540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57588) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:38.527029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:38.534476 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90b4ddd9-60f5-4140-a897-39eb7b0f8e0f tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1548254 Dec 21 04:11:38.541993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:38.633414 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-250cfc09-301e-417e-bd85-c11cc57aface tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] delete failed (client error): The resource could not be found. Dec 21 04:11:38.634471 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-250cfc09-301e-417e-bd85-c11cc57aface tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/routers/tempest-non_exist_router-737948486 HTTP/1.1" status: 404 len: 334 time: 0.0906572 Dec 21 04:11:38.640860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:38.651923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] Sync routers for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:38.652563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f2df78a8-3e8a-46ed-83d1-0849d6de2a87 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'router': {'external_gateway_info': {'network_id': '8af511c2-9792-4e36-a5d8-264de09dab07'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:38.679726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:38.680728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:38.732218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:38.745403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.754592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:38.755549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:38.846808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:38.847684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7330dca-6b3c-41e4-a024-e7f3f7808524 None None] The sync data for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:38.847884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2bd466-de32-4c38-afe4-1b25ce952291 req-8ac5e61d-eed8-42a2-b52b-6d2a679cd04d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:38.850793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:38.865443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec2bd466-de32-4c38-afe4-1b25ce952291 req-8ac5e61d-eed8-42a2-b52b-6d2a679cd04d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.2159700 Dec 21 04:11:38.941871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Pushing event updated for resources: {'Port': ['ID=6cfff773-9112-40de-b0a8-51ca66877e9e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:38.954772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:38.956502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:38.959801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:39.023815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57602) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:39.035269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Attempting to bind port 6cfff773-9112-40de-b0a8-51ca66877e9e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:39.035991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Attempting to bind port 6cfff773-9112-40de-b0a8-51ca66877e9e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '2575e406-7220-433e-9bb1-126c68035ce7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:39.037833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Attempting to bind port 6cfff773-9112-40de-b0a8-51ca66877e9e on network ccd465cf-fcb7-41e1-b88b-817a4dc0333f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:39.043943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:39.044789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Checking segment: {'id': '2575e406-7220-433e-9bb1-126c68035ce7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:39.045430 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.046101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Bound using segment: {'id': '2575e406-7220-433e-9bb1-126c68035ce7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:39.046797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Bound port: 6cfff773-9112-40de-b0a8-51ca66877e9e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2575e406-7220-433e-9bb1-126c68035ce7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'ccd465cf-fcb7-41e1-b88b-817a4dc0333f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:39.047473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.106369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2df78a8-3e8a-46ed-83d1-0849d6de2a87 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.145124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec2bd466-de32-4c38-afe4-1b25ce952291 req-ea7fab5d-3e3e-48ad-b75a-6f93037497a5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2785850 Dec 21 04:11:39.183127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] For port 6cfff773-9112-40de-b0a8-51ca66877e9e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:39.187591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] For port 6cfff773-9112-40de-b0a8-51ca66877e9e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6cfff773-9112-40de-b0a8-51ca66877e9e,segment=NetworkSegment(2575e406-7220-433e-9bb1-126c68035ce7),segment_id=2575e406-7220-433e-9bb1-126c68035ce7)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:39.194351 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-f2df78a8-3e8a-46ed-83d1-0849d6de2a87 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] update failed (client error): The resource could not be found. Dec 21 04:11:39.195419 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2df78a8-3e8a-46ed-83d1-0849d6de2a87 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07 HTTP/1.1" status: 404 len: 339 time: 0.5536082 Dec 21 04:11:39.199535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57610) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:39.205298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-808361297'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:39.234508 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.254275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.309539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:39.314282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.339991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:39.365459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:39.371379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d51f33c-1767-4c7f-b78d-331f35471164 None None] Pushing event updated for resources: {'Port': ['ID=6cfff773-9112-40de-b0a8-51ca66877e9e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:39.395420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.396101 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Added segment aafc410f-f4d0-4b2b-a758-f28c590f6244 of type vlan for network 508a6e02-80a0-4b88-b222-6de128231bf9 Dec 21 04:11:39.442680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.571660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.591699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.20.0.1 (ccd465cf-fcb7-41e1-b88b-817a4dc0333f/d7072066-5fd5-470f-a626-6f627b54be37/9a6bc6f0-0e12-45df-a9fd-57937abc0ffc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:39.632124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.669620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:39.669620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.790850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.5876369 Dec 21 04:11:39.791353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57620) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:39.799892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'subnet': {'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:39.805302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38842250-79f5-45dd-97ad-321596042f09 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Network': ['ID=508a6e02-80a0-4b88-b222-6de128231bf9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:39.818828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 508a6e02-80a0-4b88-b222-6de128231bf9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:39.959624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.975395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ad91e7-5e92-4c1a-8723-98964b7bbdcb req-56eb6c40-67c7-488a-9be9-f9a3aae6f7ce tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:39.976900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6ad91e7-5e92-4c1a-8723-98964b7bbdcb req-56eb6c40-67c7-488a-9be9-f9a3aae6f7ce tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.1803203 Dec 21 04:11:39.979665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:39.982977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Made reservation on behalf of 2a0a2fa67b584339a471421a200c59ab for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:39.992371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.096159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6ad91e7-5e92-4c1a-8723-98964b7bbdcb req-779c53cd-26e4-4f1c-8043-9d9be3bbae1e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087880 Dec 21 04:11:40.228390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Allocated IP 172.25.5.98 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/403ac968-f129-4407-9043-dbe1d949edec) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:40.279779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6cfff773-9112-40de-b0a8-51ca66877e9e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:40.334863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.360567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.393483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6cfff773-9112-40de-b0a8-51ca66877e9e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:40.393862 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.418205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.493808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.538197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:40.540303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:40.542400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Checking segment: {'id': 'aafc410f-f4d0-4b2b-a758-f28c590f6244', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:40.543130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network hostable DHCP agents. Network: 508a6e02-80a0-4b88-b222-6de128231bf9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:40.549194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:40.553785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Subnet': ['ID=483e312d-587f-4a1e-8a30-4a486bb59312,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:40.559587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:40.559587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:40.560765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:40.599279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.639093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=9a6bc6f0-0e12-45df-a9fd-57937abc0ffc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:40.652565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network 508a6e02-80a0-4b88-b222-6de128231bf9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:40.654751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 6cfff773-9112-40de-b0a8-51ca66877e9e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6cfff773-9112-40de-b0a8-51ca66877e9e,segment=NetworkSegment(2575e406-7220-433e-9bb1-126c68035ce7),segment_id=2575e406-7220-433e-9bb1-126c68035ce7)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:40.713813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.749269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Port': ['ID=403ac968-f129-4407-9043-dbe1d949edec,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:40.753417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 508a6e02-80a0-4b88-b222-6de128231bf9) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:40.762829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:40.764000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.799499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d264e5a-e3f3-4d70-8688-4323ff39b1f5 None None] Network 508a6e02-80a0-4b88-b222-6de128231bf9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:40.872319 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b88295d-4539-4f82-aaef-e98ead11c4aa tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.0797899 Dec 21 04:11:40.875479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57632) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:40.880649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0f3fdc6f-04fb-4084-a094-6b8b76f73d12 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'router': {'external_gateway_info': {'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:40.984001 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:40.996787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:41.190737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:41.231537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f3fdc6f-04fb-4084-a094-6b8b76f73d12 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:41.345097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e57423d8-b592-40d6-bb4a-e4eca5e91c77 req-53727d3f-ce19-4a4b-bc4e-3fa58925af45 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:41.346619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e57423d8-b592-40d6-bb4a-e4eca5e91c77 req-53727d3f-ce19-4a4b-bc4e-3fa58925af45 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.1304610 Dec 21 04:11:41.363091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3e09736-6594-4b2e-a7ad-4045e57f0439 None None] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:41.363871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-51437d45-0f35-496d-b56f-916bd553dc4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:41.367343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-51437d45-0f35-496d-b56f-916bd553dc4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.1096601 Dec 21 04:11:41.458670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e57423d8-b592-40d6-bb4a-e4eca5e91c77 req-1d376372-44ea-41ba-9736-45c0a764fe83 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817459 Dec 21 04:11:41.513312 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-0f3fdc6f-04fb-4084-a094-6b8b76f73d12 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:11:41.519690 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f3fdc6f-04fb-4084-a094-6b8b76f73d12 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07 HTTP/1.1" status: 400 len: 364 time: 0.6429598 Dec 21 04:11:41.520313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57638) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:41.547371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=6cfff773-9112-40de-b0a8-51ca66877e9e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:41.600656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-643d5b9b-e719-435d-868b-d724ef0b0ede None None] Provisioning complete for port 6cfff773-9112-40de-b0a8-51ca66877e9e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:41.600960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-643d5b9b-e719-435d-868b-d724ef0b0ede None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:41.748428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-508a6e02-80a0-4b88-b222-6de128231bf9', 'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9', 'project_id': '2a0a2fa67b584339a471421a200c59ab', 'fixed_ips': [{'subnet_id': '483e312d-587f-4a1e-8a30-4a486bb59312'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:41.749314 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.168576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6cfff773-9112-40de-b0a8-51ca66877e9e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:42.230336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5056e202-154a-41b9-aeb3-d31477321b97 None None] Provisioning complete for port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:42.230818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5056e202-154a-41b9-aeb3-d31477321b97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.258827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Allocated IP 2001:db8:1::2 (508a6e02-80a0-4b88-b222-6de128231bf9/483e312d-587f-4a1e-8a30-4a486bb59312/87b7de11-56b4-4df1-ae25-6c72cb74391e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:42.351585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5056e202-154a-41b9-aeb3-d31477321b97 None None] Port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:42.364650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6cfff773-9112-40de-b0a8-51ca66877e9e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:42.365680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.436614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5056e202-154a-41b9-aeb3-d31477321b97 None None] Provisioning complete for port 6cfff773-9112-40de-b0a8-51ca66877e9e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:42.437278 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5056e202-154a-41b9-aeb3-d31477321b97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.521959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.532138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.570144 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.639364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.667108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port cd7d0c70-2e11-4c2f-be79-e58a8c17978c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:42.667468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.740175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.816491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-68268c5d-bb45-4b8b-8df5-4c00d7896e9e None None] Provisioning complete for port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:42.816869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-68268c5d-bb45-4b8b-8df5-4c00d7896e9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.921717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:42.966841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Port': ['ID=403ac968-f129-4407-9043-dbe1d949edec,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:42.994866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Network 508a6e02-80a0-4b88-b222-6de128231bf9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:43.000366 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.008390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:43.016891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:43.018302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Allocated IP 2001:db8::1 (e7b09977-f166-4981-872a-dbaf0c6594ff/5c5511d1-b116-437a-bb3b-1348df155234/297a9418-b775-4d06-bf31-88858945b229) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:43.045714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port cd7d0c70-2e11-4c2f-be79-e58a8c17978c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:43.046505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.060546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-68268c5d-bb45-4b8b-8df5-4c00d7896e9e None None] Port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:43.063257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2602613f-080e-4950-a42d-50a4f99f43c8 req-ce064870-c1ec-4aff-86ff-46061765c93b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:43.065141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2602613f-080e-4950-a42d-50a4f99f43c8 req-ce064870-c1ec-4aff-86ff-46061765c93b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 946 time: 0.3015499 Dec 21 04:11:43.076752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for cd7d0c70-2e11-4c2f-be79-e58a8c17978c owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:43.113995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Pushing event updated for resources: {'Port': ['ID=87b7de11-56b4-4df1-ae25-6c72cb74391e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:43.127822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.131775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-33ca40fc-e324-4521-b4fc-eeab4a740bb1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.0955973 Dec 21 04:11:43.134134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57658) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:43.148980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Attempting to bind port 87b7de11-56b4-4df1-ae25-6c72cb74391e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:43.149498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Attempting to bind port 87b7de11-56b4-4df1-ae25-6c72cb74391e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'aafc410f-f4d0-4b2b-a758-f28c590f6244', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:43.149963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Attempting to bind port 87b7de11-56b4-4df1-ae25-6c72cb74391e on network 508a6e02-80a0-4b88-b222-6de128231bf9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:43.155831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:43.156347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Checking segment: {'id': 'aafc410f-f4d0-4b2b-a758-f28c590f6244', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:43.156853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.157339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Bound using segment: {'id': 'aafc410f-f4d0-4b2b-a758-f28c590f6244', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:43.157903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Bound port: 87b7de11-56b4-4df1-ae25-6c72cb74391e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aafc410f-f4d0-4b2b-a758-f28c590f6244', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '508a6e02-80a0-4b88-b222-6de128231bf9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:43.158382 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.177185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-2104239420'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:43.190247 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.226277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] For port 87b7de11-56b4-4df1-ae25-6c72cb74391e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:43.230373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] For port 87b7de11-56b4-4df1-ae25-6c72cb74391e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87b7de11-56b4-4df1-ae25-6c72cb74391e,segment=NetworkSegment(aafc410f-f4d0-4b2b-a758-f28c590f6244),segment_id=aafc410f-f4d0-4b2b-a758-f28c590f6244)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:43.242283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2602613f-080e-4950-a42d-50a4f99f43c8 req-cc953aba-b9a6-4305-b68a-6938a4bd5b8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1673460 Dec 21 04:11:43.303434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.339818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.350492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.359287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network e7b09977-f166-4981-872a-dbaf0c6594ff is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:43.363578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:43.365779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Port': ['ID=297a9418-b775-4d06-bf31-88858945b229,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:43.368474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:43.372903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.382092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Made reservation on behalf of 0a05bb257a044d579207fa18fa0c4a24 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:43.385690 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.398127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.483234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182801f8-7f6e-4ccb-b709-76f498b6ab7b None None] Pushing event updated for resources: {'Port': ['ID=87b7de11-56b4-4df1-ae25-6c72cb74391e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:43.500046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.618385 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.642806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.644575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=9a6bc6f0-0e12-45df-a9fd-57937abc0ffc,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:43.729521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.746306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.791459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:43.878008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.893615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=cd7d0c70-2e11-4c2f-be79-e58a8c17978c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:43.909042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99f67973-3525-4fc8-b900-c6b9e1141ee9 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:43.944682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-01b1d06e-73ec-4e45-9f3c-bf27cdbb8233 None None] Provisioning complete for port 297a9418-b775-4d06-bf31-88858945b229 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:43.945056 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b1d06e-73ec-4e45-9f3c-bf27cdbb8233 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.983458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port cd7d0c70-2e11-4c2f-be79-e58a8c17978c on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:43.987003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:43.990864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b82839ff-8ef4-4f52-a612-db6cb74cad34 req-0c33e6eb-b6b6-4b76-9eb4-65d2c0e107e8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "DELETE /v2.0/ports/cd7d0c70-2e11-4c2f-be79-e58a8c17978c HTTP/1.1" status: 204 len: 173 time: 2.6125290 Dec 21 04:11:43.999068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '298ccbff-718d-4893-8056-0dbaa2979734', 'name': 'network-vif-deleted', 'tag': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:11:44.001748 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4be665b-6c8b-4561-8ba6-73c6ad7e9b14" -d '{"events": [{"server_uuid": "298ccbff-718d-4893-8056-0dbaa2979734", "name": "network-vif-deleted", "tag": "cd7d0c70-2e11-4c2f-be79-e58a8c17978c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:11:44.032614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:11:44.037561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-01b1d06e-73ec-4e45-9f3c-bf27cdbb8233 None None] Port 297a9418-b775-4d06-bf31-88858945b229 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:44.109438 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:11:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7bb5109-4c02-49b5-93fb-a1bd0f227f23 x-openstack-request-id: req-b7bb5109-4c02-49b5-93fb-a1bd0f227f23 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:11:44.110139 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "298ccbff-718d-4893-8056-0dbaa2979734", "name": "network-vif-deleted", "tag": "cd7d0c70-2e11-4c2f-be79-e58a8c17978c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:11:44.110633 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b7bb5109-4c02-49b5-93fb-a1bd0f227f23 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:11:44.112117 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '298ccbff-718d-4893-8056-0dbaa2979734', 'name': 'network-vif-deleted', 'tag': 'cd7d0c70-2e11-4c2f-be79-e58a8c17978c', 'status': 'completed', 'code': 200} Dec 21 04:11:44.116754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3286f61-c262-42ca-995e-8d0f237eb25e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:44.121898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.124132 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Added segment 773fff78-ab7e-470c-a294-55721ed9db6b of type vlan for network afe4c803-825e-400a-805d-d2c790175de5 Dec 21 04:11:44.155813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:44.159065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:44.314546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 87b7de11-56b4-4df1-ae25-6c72cb74391e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:44.338981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.393959 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.394988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.395249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.446352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 87b7de11-56b4-4df1-ae25-6c72cb74391e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:44.447004 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.484044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event updated for resources: {'Port': ['ID=297a9418-b775-4d06-bf31-88858945b229,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:44.499537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe90ea79-a87e-4be7-9275-aae7176d00a5 req-a231eba9-2aae-4c86-859e-ac9d7ef5fb6a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=298ccbff-718d-4893-8056-0dbaa2979734 HTTP/1.1" status: 200 len: 210 time: 0.0932398 Dec 21 04:11:44.566532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.583979 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.589966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:44.590599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.613807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 87b7de11-56b4-4df1-ae25-6c72cb74391e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87b7de11-56b4-4df1-ae25-6c72cb74391e,segment=NetworkSegment(aafc410f-f4d0-4b2b-a758-f28c590f6244),segment_id=aafc410f-f4d0-4b2b-a758-f28c590f6244)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:44.642166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Network e7b09977-f166-4981-872a-dbaf0c6594ff is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:44.642166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:44.663375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:11:44.674316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-773e3133-29b4-4f21-9dfd-a456dc3b55a4 None None] Provisioning complete for port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:44.674686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-773e3133-29b4-4f21-9dfd-a456dc3b55a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.707610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:44.747756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 1.5789225 Dec 21 04:11:44.751075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57680) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:44.765517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Request body: {'subnet': {'network_id': 'afe4c803-825e-400a-805d-d2c790175de5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:44.784371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=87b7de11-56b4-4df1-ae25-6c72cb74391e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:44.816996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-773e3133-29b4-4f21-9dfd-a456dc3b55a4 None None] Port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:44.915230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:44.927302 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] Sync routers for ids ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:44.936656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fcec5ab1-91f4-4d8c-b2b6-1d6e1bff4718 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4658794 Dec 21 04:11:44.937674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57686) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:44.941435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-051ce19c-620c-49c6-a8cd-75352220e860 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Network': ['ID=afe4c803-825e-400a-805d-d2c790175de5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:44.951782 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] Routers {'9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:44.952533 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:44.952783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network afe4c803-825e-400a-805d-d2c790175de5 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:11:45.071262 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.085134 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] Routers {'9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:45.086029 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.102656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db53b6b2-3d33-4321-93b8-2d9b35ba7e04 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:45.104173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-db53b6b2-3d33-4321-93b8-2d9b35ba7e04 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports/9a6bc6f0-0e12-45df-a9fd-57937abc0ffc HTTP/1.1" status: 200 len: 910 time: 0.1627021 Dec 21 04:11:45.107311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Made reservation on behalf of 0a05bb257a044d579207fa18fa0c4a24 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:45.111017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57690) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:45.111613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:45.165183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Router 8af511c2-9792-4e36-a5d8-264de09dab07 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:45.171332 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.172003 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f28ea9b-86cc-442c-a70e-576cefbc80de None None] The sync data for ids ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:45.251973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-49376b0e-71ca-4f53-a81a-609d9bc9a09d None None] Provisioning complete for port 297a9418-b775-4d06-bf31-88858945b229 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:45.252547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-49376b0e-71ca-4f53-a81a-609d9bc9a09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:45.310841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd7d0c70-2e11-4c2f-be79-e58a8c17978c no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:45.345897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: cd7d0c70-2e11-4c2f-be79-e58a8c17978c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:45.345897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device cd7d0c70-2e11-4c2f-be79-e58a8c17978c not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:45.355949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-49376b0e-71ca-4f53-a81a-609d9bc9a09d None None] Port 297a9418-b775-4d06-bf31-88858945b229 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:45.380336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf05ba38-6dbf-4b32-8b22-a9ea3d705e5d None None] Network 508a6e02-80a0-4b88-b222-6de128231bf9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:45.423216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:45.444161 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9e58429d-4097-4512-9daf-b416709ff4d5 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9204016 Dec 21 04:11:45.444896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57694) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:45.456837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] Sync routers for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:45.507343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:45.508340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.606715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bda15505-5f9d-44ac-af71-4e5b05652ba7 None None] Provisioning complete for port 87b7de11-56b4-4df1-ae25-6c72cb74391e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:45.607405 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bda15505-5f9d-44ac-af71-4e5b05652ba7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:45.634579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:45.636870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9e41c4a-69b8-41e9-b1e0-29520dcb1854 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:45.649178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.689008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:45.689510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.723085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Subnet': ['ID=19f235b3-88a3-4d45-a06a-92ac7f8a098a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:45.725213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Checking segment: {'id': '773fff78-ab7e-470c-a294-55721ed9db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'afe4c803-825e-400a-805d-d2c790175de5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:45.725571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network hostable DHCP agents. Network: afe4c803-825e-400a-805d-d2c790175de5, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:11:45.771600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:45.772508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c04fd66-8d88-4a24-acec-a81c88e2de7f None None] The sync data for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:45.823899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network afe4c803-825e-400a-805d-d2c790175de5 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:11:45.832531 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-a9e41c4a-69b8-41e9-b1e0-29520dcb1854 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 21 04:11:45.833605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a9e41c4a-69b8-41e9-b1e0-29520dcb1854 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07 HTTP/1.1" status: 409 len: 329 time: 0.3879564 Dec 21 04:11:45.838171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57704) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:45.925533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:45.961683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, afe4c803-825e-400a-805d-d2c790175de5) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:45.971488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:45.975363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07b779ee-abe1-4825-8c90-67451e7249b3 None None] Network afe4c803-825e-400a-805d-d2c790175de5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:46.002268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.191126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-afe4c803-825e-400a-805d-d2c790175de5', 'network_id': 'afe4c803-825e-400a-805d-d2c790175de5', 'project_id': '0a05bb257a044d579207fa18fa0c4a24', 'fixed_ips': [{'subnet_id': '19f235b3-88a3-4d45-a06a-92ac7f8a098a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:11:46.196878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.233236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 87b7de11-56b4-4df1-ae25-6c72cb74391e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:46.256386 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2a5827e1-d1fc-42f8-9184-a42c7be88936 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4983227 Dec 21 04:11:46.264750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57724) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:46.296069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-268125544', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:46.400140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-e2c4966d-4a1c-4306-a663-b7fa2d7fa8fc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:46.407758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-e2c4966d-4a1c-4306-a663-b7fa2d7fa8fc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.3807230 Dec 21 04:11:46.425083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.425978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.436606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-697481be-9b93-4fa1-9273-3616a8938e80 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0279529 Dec 21 04:11:46.438984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.447703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-89a3a555-2e05-446a-b30d-326c4b06e1fa None None] Provisioning complete for port 87b7de11-56b4-4df1-ae25-6c72cb74391e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:46.448026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89a3a555-2e05-446a-b30d-326c4b06e1fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.480621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 87b7de11-56b4-4df1-ae25-6c72cb74391e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:46.480983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.578598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.596694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Allocated IP 172.20.0.2 (afe4c803-825e-400a-805d-d2c790175de5/19f235b3-88a3-4d45-a06a-92ac7f8a098a/b97d9060-e34c-4fee-94a9-44c29baf2038) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:46.597594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-c6247d0a-cb44-4700-9dc5-9f8c6b33d010 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1601448 Dec 21 04:11:46.896927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:46.943670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting port 297a9418-b775-4d06-bf31-88858945b229 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:46.944267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.006366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.121721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Network afe4c803-825e-400a-805d-d2c790175de5 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:47.122682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Pushing event updated for resources: {'Port': ['ID=b97d9060-e34c-4fee-94a9-44c29baf2038,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:47.138869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:47.142575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:47.170546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.199589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Calling delete_port for 297a9418-b775-4d06-bf31-88858945b229 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:47.233821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Attempting to bind port b97d9060-e34c-4fee-94a9-44c29baf2038 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:47.234200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Attempting to bind port b97d9060-e34c-4fee-94a9-44c29baf2038 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '773fff78-ab7e-470c-a294-55721ed9db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'afe4c803-825e-400a-805d-d2c790175de5'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:47.234568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Attempting to bind port b97d9060-e34c-4fee-94a9-44c29baf2038 on network afe4c803-825e-400a-805d-d2c790175de5 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:47.241816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:47.242245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Checking segment: {'id': '773fff78-ab7e-470c-a294-55721ed9db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'afe4c803-825e-400a-805d-d2c790175de5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:47.242597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.243014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Bound using segment: {'id': '773fff78-ab7e-470c-a294-55721ed9db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'afe4c803-825e-400a-805d-d2c790175de5'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:47.243492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Bound port: b97d9060-e34c-4fee-94a9-44c29baf2038, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '773fff78-ab7e-470c-a294-55721ed9db6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'afe4c803-825e-400a-805d-d2c790175de5'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:47.243872 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.344285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] For port b97d9060-e34c-4fee-94a9-44c29baf2038, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:47.348755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] For port b97d9060-e34c-4fee-94a9-44c29baf2038, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b97d9060-e34c-4fee-94a9-44c29baf2038,segment=NetworkSegment(773fff78-ab7e-470c-a294-55721ed9db6b),segment_id=773fff78-ab7e-470c-a294-55721ed9db6b)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:47.430473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.448160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:47.448767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.482496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.498563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-d14db8e7-172f-47ff-bb8f-165353bb5ca0 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8734837 Dec 21 04:11:47.542537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b46e7167-4c45-4cc7-baef-5b90ba8fe14e None None] Pushing event updated for resources: {'Port': ['ID=b97d9060-e34c-4fee-94a9-44c29baf2038,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:47.565520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.613271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Port': ['ID=297a9418-b775-4d06-bf31-88858945b229,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:47.767360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-1b081334-7c29-4f4e-86fc-cfab8e898e33 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2039938 Dec 21 04:11:47.874635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57748) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:47.951966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:47.996878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.026544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 9a6bc6f0-0e12-45df-a9fd-57937abc0ffc owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:48.243526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84e691a1-5c8b-44b5-a04e-24578926ccee req-033b0c04-17b4-490d-b170-04b964d92f70 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 210 time: 0.0574479 Dec 21 04:11:48.285392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b97d9060-e34c-4fee-94a9-44c29baf2038 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:48.373575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Router 8af511c2-9792-4e36-a5d8-264de09dab07 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:48.386320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-53389b68-aaf8-4325-9e47-6d6da98b3de0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4a7dada2843b4b8ebc5bf3ad0d1ca323&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5097058 Dec 21 04:11:48.389408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:48.437483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b97d9060-e34c-4fee-94a9-44c29baf2038 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:48.437483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.557741 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.568997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:48.575038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4a39a54-3a21-4ff1-9c72-a09beb983d3e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7351701 Dec 21 04:11:48.580356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57770) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:48.587720 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] Sync routers for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:48.603012 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:48.611296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:48.614238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.633667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b97d9060-e34c-4fee-94a9-44c29baf2038, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b97d9060-e34c-4fee-94a9-44c29baf2038,segment=NetworkSegment(773fff78-ab7e-470c-a294-55721ed9db6b),segment_id=773fff78-ab7e-470c-a294-55721ed9db6b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:48.642498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.652130 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-64e7c760-4c44-4a90-951d-a8e91726c6f1 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] show failed (client error): The resource could not be found. Dec 21 04:11:48.663774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.663774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57774) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:48.664295 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-64e7c760-4c44-4a90-951d-a8e91726c6f1 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "GET /v2.0/routers/tempest-non_exist_router-1718861573 HTTP/1.1" status: 404 len: 335 time: 0.0790935 Dec 21 04:11:48.668412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29977c2b-5212-48db-9515-27787425eaf5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.670235 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:48.675311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2d759fba-0cf9-4f13-8479-a45863b7c48e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Request body: {'router': {'name': 'new_name'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:48.688123 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] Routers {'8af511c2-9792-4e36-a5d8-264de09dab07'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:48.688647 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8af511c2-9792-4e36-a5d8-264de09dab07'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:48.705148 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.716611 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-2d759fba-0cf9-4f13-8479-a45863b7c48e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] update failed (client error): The resource could not be found. Dec 21 04:11:48.718011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2d759fba-0cf9-4f13-8479-a45863b7c48e tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "PUT /v2.0/routers/tempest-non_exist_router-1855761201 HTTP/1.1" status: 404 len: 335 time: 0.0531187 Dec 21 04:11:48.734972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29977c2b-5212-48db-9515-27787425eaf5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.734972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57776) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:48.772857 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:48.775194 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1b01fd1-5175-4d79-986d-eb9b0956daa7 None None] The sync data for ids ['8af511c2-9792-4e36-a5d8-264de09dab07'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:48.844532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting subnet 483e312d-587f-4a1e-8a30-4a486bb59312 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:48.849939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.878867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=9a6bc6f0-0e12-45df-a9fd-57937abc0ffc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:48.904129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.975122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29977c2b-5212-48db-9515-27787425eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.977948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29977c2b-5212-48db-9515-27787425eaf5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:48.979143 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-29977c2b-5212-48db-9515-27787425eaf5 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/30573428-f065-4528-acff-5fd7f7833238 HTTP/1.1" status: 204 len: 168 time: 0.5886781 Dec 21 04:11:49.011659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29977c2b-5212-48db-9515-27787425eaf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30573428-f065-4528-acff-5fd7f7833238,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:49.063686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.186138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Allocated IP 172.25.5.238 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/91812046-0fc0-43ea-b1b3-ae568965aeaf) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:49.224128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b97d9060-e34c-4fee-94a9-44c29baf2038,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:49.282426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.327479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.372943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ee0b46e-828a-4285-a000-c055bda2b5fb None None] Network 508a6e02-80a0-4b88-b222-6de128231bf9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:49.373998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.379426 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/subnets/483e312d-587f-4a1e-8a30-4a486bb59312 HTTP/1.1" status: 204 len: 168 time: 0.6424744 Dec 21 04:11:49.379426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa2d73f-d5df-4100-8024-382f786afb19 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Subnet': ['ID=483e312d-587f-4a1e-8a30-4a486bb59312,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:49.382086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57790) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:49.484232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab9babb0-fd74-4927-9ac1-9aed3ab0c1e3 None None] Network afe4c803-825e-400a-805d-d2c790175de5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:49.506344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.528259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.562296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting port 87b7de11-56b4-4df1-ae25-6c72cb74391e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:49.562640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.563379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e65fd6b4-b757-4ac5-b7b4-e4cb3169163d req-08c7ee82-a63e-407c-a173-bbf3e3648186 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 210 time: 0.2179463 Dec 21 04:11:49.684285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b399d5c6-3f29-453e-98da-1c0334454f82 None None] Provisioning complete for port b97d9060-e34c-4fee-94a9-44c29baf2038 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:49.684606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b399d5c6-3f29-453e-98da-1c0334454f82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.711303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.744708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] For port 87b7de11-56b4-4df1-ae25-6c72cb74391e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87b7de11-56b4-4df1-ae25-6c72cb74391e,segment=NetworkSegment(aafc410f-f4d0-4b2b-a758-f28c590f6244),segment_id=aafc410f-f4d0-4b2b-a758-f28c590f6244)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:49.746373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:49.776425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Calling delete_port for 87b7de11-56b4-4df1-ae25-6c72cb74391e owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:49.789211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:49.815560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:49.820626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:49.824161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:49.942123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e40f6108-faa6-4157-ada6-c145f17e81fc None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:49.944475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] DHCP port deletion for 508a6e02-80a0-4b88-b222-6de128231bf9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:49.950146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f217622-8fd1-4c33-89f4-876486f97adf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.029641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Port': ['ID=91812046-0fc0-43ea-b1b3-ae568965aeaf,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:50.044245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] Deleting port 87b7de11-56b4-4df1-ae25-6c72cb74391e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:50.044245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.054383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.127823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Port': ['ID=87b7de11-56b4-4df1-ae25-6c72cb74391e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:50.135090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] No DVR routers for this DVR port 87b7de11-56b4-4df1-ae25-6c72cb74391e on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:50.194369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d852029f-71bc-424c-84ad-60945d008440 None None] Provisioning complete for port 91812046-0fc0-43ea-b1b3-ae568965aeaf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:50.195582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d852029f-71bc-424c-84ad-60945d008440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.198917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] For port 87b7de11-56b4-4df1-ae25-6c72cb74391e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=87b7de11-56b4-4df1-ae25-6c72cb74391e,segment=NetworkSegment(aafc410f-f4d0-4b2b-a758-f28c590f6244),segment_id=aafc410f-f4d0-4b2b-a758-f28c590f6244)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:50.199926 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.227570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:50.246767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f85ca4e8-3060-4c09-b86e-5673716b7623 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1366675 Dec 21 04:11:50.248189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57814) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:50.254746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] Calling delete_port for 87b7de11-56b4-4df1-ae25-6c72cb74391e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:50.291440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8893d2cd-3918-4f68-9f32-ce73b5c5b0a7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e HTTP/1.1" status: 200 len: 205 time: 0.0418606 Dec 21 04:11:50.293712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57816) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:50.317106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b97d9060-e34c-4fee-94a9-44c29baf2038 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:11:50.320293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] Sync routers for ids ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:50.397680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] Routers {'9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:50.398698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.465519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.480283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.483798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d852029f-71bc-424c-84ad-60945d008440 None None] Port 91812046-0fc0-43ea-b1b3-ae568965aeaf cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:50.507215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] Routers {'9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:50.507950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.551829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.552550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58a3f5a2-fa0c-49b9-bc17-ae5609e860c7 None None] The sync data for ids ['9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:50.570957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b97d9060-e34c-4fee-94a9-44c29baf2038 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:50.571327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.572439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.636142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.669418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['508a6e02-80a0-4b88-b222-6de128231bf9']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.690741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aafc410f-f4d0-4b2b-a758-f28c590f6244') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.691389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aafc410f-f4d0-4b2b-a758-f28c590f6244') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:50.710745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.742078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.758481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:50.759319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:50.763777 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:50.782577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4b83b54b-491a-47c0-94cb-ada1081e48de None None] Provisioning complete for port b97d9060-e34c-4fee-94a9-44c29baf2038 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:50.783215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b83b54b-491a-47c0-94cb-ada1081e48de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.834195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.888261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 87b7de11-56b4-4df1-ae25-6c72cb74391e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:50.909944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] No DVR routers for this DVR port 87b7de11-56b4-4df1-ae25-6c72cb74391e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:50.913314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 87b7de11-56b4-4df1-ae25-6c72cb74391e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:50.913677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 87b7de11-56b4-4df1-ae25-6c72cb74391e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:50.917575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a40c45-1fc6-43dc-aea4-5cab1fa2c968 None None] Pushing event deleted for resources: {'Port': ['ID=87b7de11-56b4-4df1-ae25-6c72cb74391e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:50.961938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.975623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecda3134-daec-414d-b8a7-4d128143ed81 req-264a0a73-2641-4be8-9ae8-504d10ca57a2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 210 time: 0.2558246 Dec 21 04:11:50.976724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:50.994908 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/networks/508a6e02-80a0-4b88-b222-6de128231bf9 HTTP/1.1" status: 204 len: 168 time: 1.6112518 Dec 21 04:11:50.997186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:51.017261 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.058614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61972a72-cd09-471a-a630-52049eae5d52 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Network': ['ID=508a6e02-80a0-4b88-b222-6de128231bf9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:51.073495 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.109834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting subnet 16d58093-787c-405c-8d25-98009e56ac08 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:51.114079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.186660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.207171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-b07393fd-b2a4-4c90-9e37-6d982b335ca2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:51.208687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-b07393fd-b2a4-4c90-9e37-6d982b335ca2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2298703 Dec 21 04:11:51.219666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.220902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router 9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:11:51.244863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.248958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ce77e22d-46cc-4ec1-931e-01e309ef95ce tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e HTTP/1.1" status: 204 len: 168 time: 0.9518919 Dec 21 04:11:51.252843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:51.253883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57872) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:51.356129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet d7072066-5fd5-470f-a626-6f627b54be37 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:51.359075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.362279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.428002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.433972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.546128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.574918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.624823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Subnet': ['ID=16d58093-787c-405c-8d25-98009e56ac08,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:51.627886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.639023 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-795436e0-1454-4aab-8a88-6e13688b6067 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/subnets/16d58093-787c-405c-8d25-98009e56ac08 HTTP/1.1" status: 204 len: 168 time: 0.6306870 Dec 21 04:11:51.639023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57884) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:51.647932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fca5fd33-bcbf-4173-ae69-ad961b82d1ef None None] Network 9d398c06-308f-4617-89f1-52d90f5160f4 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:51.703621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting subnet ba4b7059-4da4-4952-a888-415865d2ed3a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:51.708025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.798860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.876275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] DHCP port deletion for 9d398c06-308f-4617-89f1-52d90f5160f4 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:51.884743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.921243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=d7072066-5fd5-470f-a626-6f627b54be37,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:51.926296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.929825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:51.937109 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-54d3a186-364b-4ee1-9c51-cc01d3fb8fb2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/d7072066-5fd5-470f-a626-6f627b54be37 HTTP/1.1" status: 204 len: 168 time: 0.6818175 Dec 21 04:11:51.937750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:51.944177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ce1ac42-2082-4f3d-a34f-171db0a3d093 None None] Network ccd465cf-fcb7-41e1-b88b-817a4dc0333f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:52.030407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:52.034972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] Deleting port bb6823e4-bfb5-464a-9b15-4e76f6dc434a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:52.034972 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.037825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.073318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Router cf2225cf-4f0b-443b-9a3c-aa855d47746d is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:11:52.076695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.157092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] For port bb6823e4-bfb5-464a-9b15-4e76f6dc434a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,segment=NetworkSegment(ba45e926-52dc-467c-82d8-33ee6baf568d),segment_id=ba45e926-52dc-467c-82d8-33ee6baf568d)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:52.157648 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.180567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] Calling delete_port for bb6823e4-bfb5-464a-9b15-4e76f6dc434a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:52.187903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.234254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bb6823e4-bfb5-464a-9b15-4e76f6dc434a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:52.262401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Subnet': ['ID=ba4b7059-4da4-4952-a888-415865d2ed3a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:52.275008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.282590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] DHCP port deletion for ccd465cf-fcb7-41e1-b88b-817a4dc0333f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:52.283286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2252f5cd-d180-44c3-96bf-4271bd1c2024 req-fbfcadd3-f9cd-497c-9721-f2d1b9ffa3d2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 210 time: 0.1677928 Dec 21 04:11:52.283781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57898) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:52.292346 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1bfbe42f-53d5-4a3d-b1ce-e291f5080bba tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/subnets/ba4b7059-4da4-4952-a888-415865d2ed3a HTTP/1.1" status: 204 len: 168 time: 0.6493413 Dec 21 04:11:52.294376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d299fcb4-6292-4484-a410-4fe61babaebd None None] Network b0759faa-656e-4cee-b2de-b0e63e0b6b5b requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:52.326884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 6cfff773-9112-40de-b0a8-51ca66877e9e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:52.327273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.436623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port 6cfff773-9112-40de-b0a8-51ca66877e9e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6cfff773-9112-40de-b0a8-51ca66877e9e,segment=NetworkSegment(2575e406-7220-433e-9bb1-126c68035ce7),segment_id=2575e406-7220-433e-9bb1-126c68035ce7)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:52.437099 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.450108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] Deleting port 6cfff773-9112-40de-b0a8-51ca66877e9e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:52.451277 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.454739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 6cfff773-9112-40de-b0a8-51ca66877e9e owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:52.459197 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.551600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.563241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:52.576146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] Sync routers for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:52.576733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.12 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/bdd088da-f507-4663-8336-df5ac93e0140) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:52.593930 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:52.595449 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:52.606179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] For port 6cfff773-9112-40de-b0a8-51ca66877e9e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6cfff773-9112-40de-b0a8-51ca66877e9e,segment=NetworkSegment(2575e406-7220-433e-9bb1-126c68035ce7),segment_id=2575e406-7220-433e-9bb1-126c68035ce7)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:52.608900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.653150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.656546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.697693 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:52.732224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] Calling delete_port for 6cfff773-9112-40de-b0a8-51ca66877e9e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:52.740127 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:52.740919 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:52.756596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port 6cfff773-9112-40de-b0a8-51ca66877e9e on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:52.756596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=6cfff773-9112-40de-b0a8-51ca66877e9e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:52.757929 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.759377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4c985e29-88f3-475e-8aff-aa8a6d133680 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 891 time: 6.4676735 Dec 21 04:11:52.773449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 57928) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:52.788711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting port bb6823e4-bfb5-464a-9b15-4e76f6dc434a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:52.789438 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.829741 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:52.833379 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0485b799-7071-4e2d-bc5c-af2170c9c18f None None] The sync data for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:52.865532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.878305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] No DVR routers for this DVR port bb6823e4-bfb5-464a-9b15-4e76f6dc434a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:52.940645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] DHCP port deletion for b0759faa-656e-4cee-b2de-b0e63e0b6b5b request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:52.962821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:52.966305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca6948d8-3bc4-4689-93a9-5ff70b18639b None None] Pushing event deleted for resources: {'Port': ['ID=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:52.969508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-187dc466-7f5a-4202-8b1e-748474e7ed84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.008070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ccd465cf-fcb7-41e1-b88b-817a4dc0333f']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:53.024315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2575e406-7220-433e-9bb1-126c68035ce7') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:53.024619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2575e406-7220-433e-9bb1-126c68035ce7') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:53.037860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] No DVR routers for this DVR port 6cfff773-9112-40de-b0a8-51ca66877e9e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:53.040047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef1ca1b-f810-48e9-a225-3d60f36a10ac None None] Pushing event deleted for resources: {'Port': ['ID=6cfff773-9112-40de-b0a8-51ca66877e9e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:53.053095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.072859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.084008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] Deleting port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:53.084655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:53.085155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.085660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:53.090061 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:53.092755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] For port bb6823e4-bfb5-464a-9b15-4e76f6dc434a, host n-d-822053-11, got binding levels [] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:53.092755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.135391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.187915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Calling delete_port for bb6823e4-bfb5-464a-9b15-4e76f6dc434a owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:53.202679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Port bb6823e4-bfb5-464a-9b15-4e76f6dc434a was not found and therefore no delete operation was performed {{(pid=110310) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:11:53.214815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] For port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,segment=NetworkSegment(b757cab0-d989-4c8e-8717-d537a2376ecf),segment_id=b757cab0-d989-4c8e-8717-d537a2376ecf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:53.215941 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.219422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.235790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.254772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] Calling delete_port for a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:53.265003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Port': ['ID=bb6823e4-bfb5-464a-9b15-4e76f6dc434a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:53.273546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.280033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] No DVR routers for this DVR port bb6823e4-bfb5-464a-9b15-4e76f6dc434a on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:53.302787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.327269 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/ccd465cf-fcb7-41e1-b88b-817a4dc0333f HTTP/1.1" status: 204 len: 168 time: 1.3701663 Dec 21 04:11:53.330146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57944) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:53.350647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-368584805', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:53.360403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dce91ee-09b8-4113-80f5-f350b592171f tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=ccd465cf-fcb7-41e1-b88b-817a4dc0333f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:53.402334 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.481431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.484026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.513526 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.517038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fedb58a3-c015-46cd-a4ff-d26da76426fd req-f5f5b4b0-7be1-46cd-b336-8270ccd9f799 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 210 time: 0.1174996 Dec 21 04:11:53.527263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.545240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] Pushing event deleted for resources: {'Port': ['ID=a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:53.559759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac7025ce-ebe3-437f-b3a2-4b023d7e0c3e None None] No DVR routers for this DVR port a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:53.580629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.597913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d398c06-308f-4617-89f1-52d90f5160f4']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:53.610390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.613661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ba45e926-52dc-467c-82d8-33ee6baf568d') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:53.613965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ba45e926-52dc-467c-82d8-33ee6baf568d') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:53.647229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:11:53.659423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.730135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:53.737275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=bdd088da-f507-4663-8336-df5ac93e0140,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:53.741149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:53.745355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.749677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:53.784660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:53.785131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.786385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de41d9a8-b1b9-4b75-8810-029d7e7f065e None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:53.790603 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:53.895062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:53.895710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.907506 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:53.963611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c15a285c-8bf2-4d44-a286-dd65a524074b None None] Provisioning complete for port bdd088da-f507-4663-8336-df5ac93e0140 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:53.963993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c15a285c-8bf2-4d44-a286-dd65a524074b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.005645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-5aca0701-7776-4b2f-ba48-f4b60913e443 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.7675269 Dec 21 04:11:54.006655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.018623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c15a285c-8bf2-4d44-a286-dd65a524074b None None] Port bdd088da-f507-4663-8336-df5ac93e0140 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:54.027875 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.031769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/networks/9d398c06-308f-4617-89f1-52d90f5160f4 HTTP/1.1" status: 204 len: 168 time: 1.7437007 Dec 21 04:11:54.034353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57954) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:54.043232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Request body: {'port': {'device_id': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:54.046293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbaf1da8-4c4a-4688-8ac0-5ca5f5e05066 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Network': ['ID=9d398c06-308f-4617-89f1-52d90f5160f4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:54.069802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.173246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6cfff773-9112-40de-b0a8-51ca66877e9e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:54.188415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.198189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6cfff773-9112-40de-b0a8-51ca66877e9e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:54.202343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6cfff773-9112-40de-b0a8-51ca66877e9e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:54.202343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:54.225754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:11:54.226796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a7bcb5ca-44ad-4d80-8fe5-8fd20ee9c387 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:11:54.288240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.387536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.445828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b0759faa-656e-4cee-b2de-b0e63e0b6b5b']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:54.448430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.474033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.476816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b757cab0-d989-4c8e-8717-d537a2376ecf') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:54.477105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b757cab0-d989-4c8e-8717-d537a2376ecf') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:54.496872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.565176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.588307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:54.588805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:54.591922 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:54.710872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.25.5.17 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/401138ce-6342-4c5b-bfcc-c961a5dc93b9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:54.773371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Allocated IP 172.20.0.1 (afe4c803-825e-400a-805d-d2c790175de5/19f235b3-88a3-4d45-a06a-92ac7f8a098a/24111072-3254-4d00-936c-2605892074ee) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:54.787847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af7594f-144d-40fd-ab35-22f695bc0602 req-b0b64b5e-49b7-4e6c-84c9-80d312c4eb4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:54.789955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af7594f-144d-40fd-ab35-22f695bc0602 req-b0b64b5e-49b7-4e6c-84c9-80d312c4eb4f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 932 time: 0.1581726 Dec 21 04:11:54.800109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.830287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.833703 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/networks/b0759faa-656e-4cee-b2de-b0e63e0b6b5b HTTP/1.1" status: 204 len: 168 time: 0.7981441 Dec 21 04:11:54.836705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e3fb27e-8f81-4f6f-8d49-e7c64e2d5317 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Network': ['ID=b0759faa-656e-4cee-b2de-b0e63e0b6b5b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:54.838346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:54.881905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1af7594f-144d-40fd-ab35-22f695bc0602 req-01beba69-5e0f-4d8b-b3f8-9c05d41c6bdb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676253 Dec 21 04:11:54.901458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:54.958279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting subnet 5c5511d1-b116-437a-bb3b-1348df155234 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:11:54.968011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.026399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.045734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.137447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bdd088da-f507-4663-8336-df5ac93e0140 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:11:55.144163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.159743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Transition to ACTIVE for port object bdd088da-f507-4663-8336-df5ac93e0140 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:11:55.164539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.267844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.296039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.299997 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.301433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.308594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.309441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:55.312979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:55.315622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:55.344455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22ed179e-0c15-4b4b-b03c-021a0133d235 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:55.376256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network afe4c803-825e-400a-805d-d2c790175de5 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:55.376256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Pushing event updated for resources: {'Port': ['ID=bdd088da-f507-4663-8336-df5ac93e0140,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:55.385495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:55.391176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:11:55.395074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50f03685-c74b-4301-92d3-af61977534b7 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:55.489834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c4a9c149-2e68-4913-a2f5-bf4d429fdf73 None None] Provisioning complete for port 401138ce-6342-4c5b-bfcc-c961a5dc93b9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:55.490149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c4a9c149-2e68-4913-a2f5-bf4d429fdf73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.557313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c4a9c149-2e68-4913-a2f5-bf4d429fdf73 None None] Port 401138ce-6342-4c5b-bfcc-c961a5dc93b9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:55.572418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.589456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=401138ce-6342-4c5b-bfcc-c961a5dc93b9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:55.621527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Subnet': ['ID=5c5511d1-b116-437a-bb3b-1348df155234,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:55.637637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.638654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.646029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f9fc2bfb-98ce-4502-9ba6-2e7500027864 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/subnets/5c5511d1-b116-437a-bb3b-1348df155234 HTTP/1.1" status: 204 len: 168 time: 0.8009188 Dec 21 04:11:55.646833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 57982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:55.648187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70db9bc3-3172-4a27-bb4b-40f5385d028a None None] Network e7b09977-f166-4981-872a-dbaf0c6594ff requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:11:55.712000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Port': ['ID=24111072-3254-4d00-936c-2605892074ee,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:55.830160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Attempting to bind port bdd088da-f507-4663-8336-df5ac93e0140 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:11:55.831034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Attempting to bind port bdd088da-f507-4663-8336-df5ac93e0140 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:11:55.831660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Attempting to bind port bdd088da-f507-4663-8336-df5ac93e0140 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:55.847020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.852999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Port bdd088da-f507-4663-8336-df5ac93e0140 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:11:55.852999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Attempting to bind port bdd088da-f507-4663-8336-df5ac93e0140 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:11:55.862026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:11:55.862618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:11:55.863259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:11:55.864457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Bound port: bdd088da-f507-4663-8336-df5ac93e0140, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:11:55.865803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.895963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bee5d9af-c7d2-4869-91ba-a587a05ac220 None None] Provisioning complete for port 24111072-3254-4d00-936c-2605892074ee triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:55.896580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bee5d9af-c7d2-4869-91ba-a587a05ac220 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:55.955828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] DHCP port deletion for e7b09977-f166-4981-872a-dbaf0c6594ff request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:55.964066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.014977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bee5d9af-c7d2-4869-91ba-a587a05ac220 None None] Port 24111072-3254-4d00-936c-2605892074ee cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:56.021175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] For port bdd088da-f507-4663-8336-df5ac93e0140, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:11:56.072157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] For port bdd088da-f507-4663-8336-df5ac93e0140, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=bdd088da-f507-4663-8336-df5ac93e0140,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:11:56.075946 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.148188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.161590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] Deleting port c6a81acf-7222-47d8-9389-a59918e0ce43 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:56.162539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.166175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c6a81acf-7222-47d8-9389-a59918e0ce43 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:11:56.172963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e15acd1-2991-4666-a730-a989adc230ce req-2ffdd1b0-a603-4693-bcfc-9fa769ec87b6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:56.174669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e15acd1-2991-4666-a730-a989adc230ce req-2ffdd1b0-a603-4693-bcfc-9fa769ec87b6 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 944 time: 0.1510749 Dec 21 04:11:56.281825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e5e09d6-74e0-40bb-a84b-81e620f82140 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:11:56.292637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:56.293271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.294091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] For port c6a81acf-7222-47d8-9389-a59918e0ce43, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c6a81acf-7222-47d8-9389-a59918e0ce43,segment=NetworkSegment(240168e6-1db5-4ea6-be52-028b80f6fe48),segment_id=240168e6-1db5-4ea6-be52-028b80f6fe48)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:56.294803 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.295054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] 10.222.0.31 "PUT /v2.0/ports/bdd088da-f507-4663-8336-df5ac93e0140 HTTP/1.1" status: 200 len: 1093 time: 2.2619772 Dec 21 04:11:56.297695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'tag': 'bdd088da-f507-4663-8336-df5ac93e0140'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:11:56.300654 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2" -d '{"events": [{"name": "network-changed", "server_uuid": "56024bb9-3b76-4818-b87e-7d7da9b0dd68", "tag": "bdd088da-f507-4663-8336-df5ac93e0140"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:11:56.365679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.370305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] Calling delete_port for c6a81acf-7222-47d8-9389-a59918e0ce43 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:56.480456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.491611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port c6a81acf-7222-47d8-9389-a59918e0ce43, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c6a81acf-7222-47d8-9389-a59918e0ce43,segment=NetworkSegment(240168e6-1db5-4ea6-be52-028b80f6fe48),segment_id=240168e6-1db5-4ea6-be52-028b80f6fe48)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:56.567930 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.642254 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.664520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] No DVR routers for this DVR port c6a81acf-7222-47d8-9389-a59918e0ce43 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:56.667688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=c6a81acf-7222-47d8-9389-a59918e0ce43,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:56.678569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Deleting port c6a81acf-7222-47d8-9389-a59918e0ce43 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:11:56.678910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.710486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ebfc91-2e45-4095-a791-4fea75e0e133 None None] Pushing event deleted for resources: {'Port': ['ID=c6a81acf-7222-47d8-9389-a59918e0ce43,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:56.801977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] For port c6a81acf-7222-47d8-9389-a59918e0ce43, host n-d-822053-11, got binding levels [] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:11:56.802386 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.847230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Calling delete_port for c6a81acf-7222-47d8-9389-a59918e0ce43 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:11:56.851251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Port c6a81acf-7222-47d8-9389-a59918e0ce43 was not found and therefore no delete operation was performed {{(pid=110311) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:11:56.854047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.858429 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:11:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dedd3bfd-2134-476a-bb7b-862284874509 x-openstack-request-id: req-dedd3bfd-2134-476a-bb7b-862284874509 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:11:56.858793 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "56024bb9-3b76-4818-b87e-7d7da9b0dd68", "tag": "bdd088da-f507-4663-8336-df5ac93e0140", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:11:56.859154 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dedd3bfd-2134-476a-bb7b-862284874509 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:11:56.859618 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'tag': 'bdd088da-f507-4663-8336-df5ac93e0140', 'status': 'completed', 'code': 200} Dec 21 04:11:56.879454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e15acd1-2991-4666-a730-a989adc230ce req-7ae6e253-9426-4c16-b689-b1500b115688 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6454666 Dec 21 04:11:56.883650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a73223d-5fcf-43ca-9c0b-c07ac4559be4 service neutron] Pushing event updated for resources: {'Port': ['ID=bdd088da-f507-4663-8336-df5ac93e0140,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:56.893143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Port': ['ID=c6a81acf-7222-47d8-9389-a59918e0ce43,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:56.904425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] No DVR routers for this DVR port c6a81acf-7222-47d8-9389-a59918e0ce43 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:11:56.913275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:56.961522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-410b3960-e5f7-47c3-9775-363a9ffd65bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:56.961522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-410b3960-e5f7-47c3-9775-363a9ffd65bf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 1096 time: 0.0985389 Dec 21 04:11:57.037202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.042887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-696bd592-898c-405e-a01f-61e2c2c35aa2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bdd088da-f507-4663-8336-df5ac93e0140 HTTP/1.1" status: 200 len: 217 time: 0.0559995 Dec 21 04:11:57.090810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7b09977-f166-4981-872a-dbaf0c6594ff']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.107946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '240168e6-1db5-4ea6-be52-028b80f6fe48') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.108533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '240168e6-1db5-4ea6-be52-028b80f6fe48') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.122216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.123698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-afec07ff-4e08-4b9a-ad8c-0092b604f088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:57.125281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-afec07ff-4e08-4b9a-ad8c-0092b604f088 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0466728 Dec 21 04:11:57.145120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.168163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:11:57.168563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:11:57.172569 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:11:57.175508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-47673403-61fd-46b5-b818-2bc9fe3e6b13 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0340760 Dec 21 04:11:57.295794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.298891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router ef80e42a-1705-49b5-b699-c294920ad893 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:11:57.312407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-911dad4d-22a1-4b0e-8ec8-b0f52c927901 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1230154 Dec 21 04:11:57.313480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.351509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.354678 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/networks/e7b09977-f166-4981-872a-dbaf0c6594ff HTTP/1.1" status: 204 len: 168 time: 1.7069612 Dec 21 04:11:57.362827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:57.368846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.408416 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e0b44eb-c7ae-4e2b-9156-792230639711 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "GET /v2.0/ports?device_id=8af511c2-9792-4e36-a5d8-264de09dab07 HTTP/1.1" status: 200 len: 205 time: 0.0444720 Dec 21 04:11:57.409415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7810cc-1cf8-4108-bef4-5dceb6426f26 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Pushing event deleted for resources: {'Network': ['ID=e7b09977-f166-4981-872a-dbaf0c6594ff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:57.411169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58010) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:57.472387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.530619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.606285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Port': ['ID=24111072-3254-4d00-936c-2605892074ee,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:57.623323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6878f93e-4207-44a1-9e77-d19aeeec2198 req-45a6e355-cdb9-47a3-a59b-2397d6439828 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2984173 Dec 21 04:11:57.624189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:57.645081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] Sync routers for ids ['ef80e42a-1705-49b5-b699-c294920ad893'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:57.658671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] Routers {'ef80e42a-1705-49b5-b699-c294920ad893'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:57.659340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ef80e42a-1705-49b5-b699-c294920ad893'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.667980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network afe4c803-825e-400a-805d-d2c790175de5 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:11:57.670492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:11:57.732320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.744489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] Routers {'ef80e42a-1705-49b5-b699-c294920ad893'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:57.745465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ef80e42a-1705-49b5-b699-c294920ad893'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.788999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:57.789740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9747d7b-5f3a-43d7-815e-bfeb2c2d5614 None None] The sync data for ids ['ef80e42a-1705-49b5-b699-c294920ad893'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:57.826829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Router cf2225cf-4f0b-443b-9a3c-aa855d47746d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:11:57.838357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.842092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.886636 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:57.890790 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aecef6c5-2cc2-4625-98e5-a56cbbb8ada3 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 4.5432143 Dec 21 04:11:57.903196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58020) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:57.950291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-48ca8411-9d38-420d-b1d4-4fef46da05ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:57.952376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-48ca8411-9d38-420d-b1d4-4fef46da05ca service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 1096 time: 0.1157515 Dec 21 04:11:57.999960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:58.000505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Fanout notify agent at l3_agent the message router_deleted on router 8af511c2-9792-4e36-a5d8-264de09dab07 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:11:58.014089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:58.023382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f467cb1-4c73-4f63-a85f-89649df872a9 tempest-RoutersNegativeIpV6Test-1316959886 tempest-RoutersNegativeIpV6Test-1316959886-project] 10.222.0.18 "DELETE /v2.0/routers/8af511c2-9792-4e36-a5d8-264de09dab07 HTTP/1.1" status: 204 len: 168 time: 0.6012130 Dec 21 04:11:58.086890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3d1644b4-4759-4a3f-a835-b673c2bcb51a None None] Provisioning complete for port 24111072-3254-4d00-936c-2605892074ee triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:11:58.088475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d1644b4-4759-4a3f-a835-b673c2bcb51a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:58.102623 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b251fbe-eec8-4fdb-8c84-ff2ee771b04b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/routers/ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 200 len: 879 time: 0.2098303 Dec 21 04:11:58.104818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58026) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:58.168639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3d1644b4-4759-4a3f-a835-b673c2bcb51a None None] Port 24111072-3254-4d00-936c-2605892074ee cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:11:58.239285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:11:58.252617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4c6ea630-f5dd-4815-b96e-6c77c9916051 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "PUT /v2.0/routers/cf2225cf-4f0b-443b-9a3c-aa855d47746d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4685781 Dec 21 04:11:58.252617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-4ab563a2-cf81-4319-92c8-c25ed7eda969 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:58.252853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58030) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:58.252952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-4ab563a2-cf81-4319-92c8-c25ed7eda969 service neutron] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.2889063 Dec 21 04:11:58.255402 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] Sync routers for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:11:58.258517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Request body: {'port': {'network_id': 'afe4c803-825e-400a-805d-d2c790175de5', 'name': 'tempest-FloatingIPAdminTestJSON-902466426'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:58.266250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c00c001-a257-4687-a6e3-d29982a873eb req-c9a1a7d5-b10d-4e71-a515-360311a68247 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:58.267860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c00c001-a257-4687-a6e3-d29982a873eb req-c9a1a7d5-b10d-4e71-a515-360311a68247 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 944 time: 0.2380071 Dec 21 04:11:58.270401 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:58.271263 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:58.314962 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:58.324827 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:11:58.326321 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:58.328336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-2ff1b90b-5c0a-436d-85ad-24ea12613e63 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bdd088da-f507-4663-8336-df5ac93e0140 HTTP/1.1" status: 200 len: 217 time: 0.0593851 Dec 21 04:11:58.364297 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:11:58.365147 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13296921-2e1b-4c9a-885a-b97979b4ab63 None None] The sync data for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:11:58.422128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c00c001-a257-4687-a6e3-d29982a873eb req-43506e79-c456-4121-8fc3-0a7f9e89111d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1463542 Dec 21 04:11:58.431425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-eecaeacb-7a38-44e4-ada7-f829f86daeb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:58.433426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-eecaeacb-7a38-44e4-ada7-f829f86daeb0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0916214 Dec 21 04:11:58.486048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-e40f5b40-a735-4cd0-8372-da2abc770d21 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0442407 Dec 21 04:11:58.581420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-71b8e5ad-871c-4d31-8485-01d236cffcb9 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1236427 Dec 21 04:11:58.675490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-405738cd-668f-4f17-ac48-574ca385ef51 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1755946 Dec 21 04:11:58.696722 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eb6f3e29-2d61-47f3-b78c-14e319c32749 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 882 time: 0.5906565 Dec 21 04:11:58.699300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58040) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:58.704449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-368584805'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:11:58.709258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Made reservation on behalf of 0a05bb257a044d579207fa18fa0c4a24 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:11:58.713156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:58.777255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58044) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:58.821777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f59ae9c-c9eb-4a4d-b2a9-2ae338c448f2 req-c0ed2fe6-a4f0-498b-b9c9-105262a77374 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1367824 Dec 21 04:11:59.001005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bcdba523-e06f-4a70-aad8-55de65a3b22a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=2a0a2fa67b584339a471421a200c59ab&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2203453 Dec 21 04:11:59.001258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58050) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:11:59.055917 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec426adb-a1ea-45bc-9f8a-68b8f3918215 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:59.081539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec426adb-a1ea-45bc-9f8a-68b8f3918215 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:59.122910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] device_id is not set on port c6630949-90a2-4c1b-bfe4-1902459da935 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:11:59.163244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-cbddf16d-9ba6-48ec-856c-0cb5bad00b2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:59.165475 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-cbddf16d-9ba6-48ec-856c-0cb5bad00b2f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1097 time: 0.5069115 Dec 21 04:11:59.218521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec426adb-a1ea-45bc-9f8a-68b8f3918215 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:59.221729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ec426adb-a1ea-45bc-9f8a-68b8f3918215 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:59.224189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ec426adb-a1ea-45bc-9f8a-68b8f3918215 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7fee7783-2ad2-49e1-93fb-c76ff6258547 HTTP/1.1" status: 204 len: 168 time: 0.2216761 Dec 21 04:11:59.235136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec426adb-a1ea-45bc-9f8a-68b8f3918215 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fee7783-2ad2-49e1-93fb-c76ff6258547,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:11:59.527568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Allocated IP 172.20.0.13 (afe4c803-825e-400a-805d-d2c790175de5/19f235b3-88a3-4d45-a06a-92ac7f8a098a/c6630949-90a2-4c1b-bfe4-1902459da935) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:11:59.545776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-9e67e1aa-8e5d-4b20-b7f6-1a8f2e454514 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:59.547304 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-9e67e1aa-8e5d-4b20-b7f6-1a8f2e454514 service neutron] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.3421569 Dec 21 04:11:59.581497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed36bac-6ec5-4c20-82a7-88d4fb6226e6 req-c9c4e0ab-293c-4a9f-977d-63c166e4a75e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:59.583046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ed36bac-6ec5-4c20-82a7-88d4fb6226e6 req-c9c4e0ab-293c-4a9f-977d-63c166e4a75e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 944 time: 0.0591938 Dec 21 04:11:59.610629 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-bbb7d056-5789-4cc1-b2df-454f69be327a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 200 len: 217 time: 0.0532417 Dec 21 04:11:59.667225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ed36bac-6ec5-4c20-82a7-88d4fb6226e6 req-d8823ce0-7d3e-4830-951c-271bfc2e39b7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766191 Dec 21 04:11:59.869166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-9cf86409-d2b4-4ba1-8290-6033821d8860 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:11:59.870772 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-9cf86409-d2b4-4ba1-8290-6033821d8860 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.1889436 Dec 21 04:11:59.876466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:59.920907 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-65bc4bba-d8c7-4b1e-bee8-257131b87b1d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0383306 Dec 21 04:11:59.981468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:11:59.986808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:00.118837 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-3a2b9c0a-947a-410b-997f-c93dac5f4086 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1894913 Dec 21 04:12:00.213843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:00.315973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Network afe4c803-825e-400a-805d-d2c790175de5 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:00.327285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:00.333705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:00.336664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router ef80e42a-1705-49b5-b699-c294920ad893 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:00.337562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event updated for resources: {'Port': ['ID=c6630949-90a2-4c1b-bfe4-1902459da935,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:00.421280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6f780972-cd2c-44a6-8066-e4c3db732e5d req-ad8295b9-144f-449e-9768-7e589c8668bd service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2804425 Dec 21 04:12:00.489782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:00.490435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:00.550692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58096) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:00.601382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:00.615155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] Sync routers for ids ['ef80e42a-1705-49b5-b699-c294920ad893'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:00.618984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:00.623047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58100) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:00.624274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-07cc82a6-1ea9-46da-a838-7fae49e5b0d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 200 len: 886 time: 1.9233487 Dec 21 04:12:00.628669 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3a418c95-77fb-4356-aad0-af0b680aed06 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3767340 Dec 21 04:12:00.631745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58102) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:00.644018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] Routers {'ef80e42a-1705-49b5-b699-c294920ad893'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:00.650988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ef80e42a-1705-49b5-b699-c294920ad893'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:00.730486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:00.731923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a1300a3c-9a27-4ec7-97f1-c40e88c49345 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-1430934590', 'prefixes': ['172.20.0.0/16']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:00.748399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] Routers {'ef80e42a-1705-49b5-b699-c294920ad893'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:00.749586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ef80e42a-1705-49b5-b699-c294920ad893'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:00.787430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f8bf4d73-fa85-4576-988a-d26cdc570487 None None] Provisioning complete for port c6630949-90a2-4c1b-bfe4-1902459da935 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:00.787956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8bf4d73-fa85-4576-988a-d26cdc570487 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:00.809344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:00.810731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e98dd14-0c5b-4b77-a70a-fb9b64117883 None None] The sync data for ids ['ef80e42a-1705-49b5-b699-c294920ad893'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:00.846356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f8bf4d73-fa85-4576-988a-d26cdc570487 None None] Port c6630949-90a2-4c1b-bfe4-1902459da935 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:00.869775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ea53a641-252d-41ca-8653-59a4fc1ac3e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/routers/ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 200 len: 886 time: 0.2456722 Dec 21 04:12:00.872415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58118) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:00.873289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'project_id': '0a05bb257a044d579207fa18fa0c4a24', 'port_id': 'c6630949-90a2-4c1b-bfe4-1902459da935'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:00.914046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e9d92d52-098b-48e3-a7be-c2e8a4046ef0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 200 len: 205 time: 0.0402617 Dec 21 04:12:00.916441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58122) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:00.940298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a41b08-5eef-41d0-9919-2fa5a4c33d9d req-162b6dc1-ef09-42d0-a271-0d7aac87d191 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:00.942335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48a41b08-5eef-41d0-9919-2fa5a4c33d9d req-162b6dc1-ef09-42d0-a271-0d7aac87d191 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 944 time: 0.1682210 Dec 21 04:12:01.068031 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.113038 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.185640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.202526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48a41b08-5eef-41d0-9919-2fa5a4c33d9d req-13d1b18b-bbfd-410d-833e-6869ba4c6990 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2131274 Dec 21 04:12:01.302041 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1300a3c-9a27-4ec7-97f1-c40e88c49345 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] Publish callbacks [] for subnetpool, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.303958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a1300a3c-9a27-4ec7-97f1-c40e88c49345 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] 10.222.0.18 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 737 time: 0.7519562 Dec 21 04:12:01.306927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:01.341579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Allocated IP 172.25.5.72 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/68585ba8-704c-4ea2-b7b3-5e80d32c8fb9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:01.357302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-42abc031-af68-4328-abc2-f3fa9c005903 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] 10.222.0.18 "GET /v2.0/subnetpools/1f8b8333-996e-410a-99af-356af454a067 HTTP/1.1" status: 200 len: 732 time: 0.0493054 Dec 21 04:12:01.358795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.359957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:01.366891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c85f268a-f7f7-4878-9578-0d2e98a9bdb5 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-870953314'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:01.369857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device bdd088da-f507-4663-8336-df5ac93e0140 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:12:01.490911 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.501342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port bdd088da-f507-4663-8336-df5ac93e0140, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=bdd088da-f507-4663-8336-df5ac93e0140,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:01.516875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 401138ce-6342-4c5b-bfcc-c961a5dc93b9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:01.517187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'bdd088da-f507-4663-8336-df5ac93e0140', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': 'bdd088da-f507-4663-8336-df5ac93e0140', 'mac_address': 'fa:16:3e:50:c9:1b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:12:01.517367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.565976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.581378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bdd088da-f507-4663-8336-df5ac93e0140 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:12:01.624167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port bdd088da-f507-4663-8336-df5ac93e0140, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=bdd088da-f507-4663-8336-df5ac93e0140,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:01.629699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.642828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 401138ce-6342-4c5b-bfcc-c961a5dc93b9 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:01.704830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c85f268a-f7f7-4878-9578-0d2e98a9bdb5 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] Publish callbacks [] for subnetpool, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.708922 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c85f268a-f7f7-4878-9578-0d2e98a9bdb5 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] 10.222.0.18 "PUT /v2.0/subnetpools/1f8b8333-996e-410a-99af-356af454a067 HTTP/1.1" status: 200 len: 683 time: 0.3452871 Dec 21 04:12:01.710499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58128) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:01.730960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.732167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.812146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=bdd088da-f507-4663-8336-df5ac93e0140,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:01.816022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:01.819275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:01.824464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:01.886063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Pushing event updated for resources: {'Port': ['ID=68585ba8-704c-4ea2-b7b3-5e80d32c8fb9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:01.990204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8df78ec6-8b65-4a50-aac6-706dc027158d tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] Publish callbacks [] for subnetpool, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:01.993958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8df78ec6-8b65-4a50-aac6-706dc027158d tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] 10.222.0.18 "DELETE /v2.0/subnetpools/1f8b8333-996e-410a-99af-356af454a067 HTTP/1.1" status: 204 len: 168 time: 0.2796681 Dec 21 04:12:01.998115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58134) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:02.010861 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-7f4ecfdd-bf26-44d9-82dc-63c104853849 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] show failed (client error): The resource could not be found. Dec 21 04:12:02.015022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7f4ecfdd-bf26-44d9-82dc-63c104853849 tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] 10.222.0.18 "GET /v2.0/subnetpools/1f8b8333-996e-410a-99af-356af454a067 HTTP/1.1" status: 404 len: 346 time: 0.0174663 Dec 21 04:12:02.016377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58136) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:02.017181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:02.040618 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-6781e53d-3a35-4d0e-bf69-47fd148a2e1b tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] delete failed (client error): The resource could not be found. Dec 21 04:12:02.046377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6781e53d-3a35-4d0e-bf69-47fd148a2e1b tempest-SubnetPoolsTestJSON-1264020936 tempest-SubnetPoolsTestJSON-1264020936-project] 10.222.0.18 "DELETE /v2.0/subnetpools/1f8b8333-996e-410a-99af-356af454a067 HTTP/1.1" status: 404 len: 346 time: 0.0221000 Dec 21 04:12:02.062164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=401138ce-6342-4c5b-bfcc-c961a5dc93b9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:02.078459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b69c5ca3-0113-422f-894e-548aa0da50d4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:02.083210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['bdd088da-f507-4663-8336-df5ac93e0140'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:02.140504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:02.692313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58144) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:02.710603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:02.722585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:02.843099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6acfb7-9dc0-49dc-b8ce-2fb155697820 req-03aed2bc-1113-4fa1-a5ae-508992f8e3db tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:02.846562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a6acfb7-9dc0-49dc-b8ce-2fb155697820 req-03aed2bc-1113-4fa1-a5ae-508992f8e3db tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 945 time: 0.1649299 Dec 21 04:12:02.868673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:02.869115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router ef80e42a-1705-49b5-b699-c294920ad893 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:12:02.886157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:02.892108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-886865c8-55f4-4969-9dab-a60db3294669 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 204 len: 168 time: 1.9741352 Dec 21 04:12:02.924378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58150) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:02.936771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-1503607082'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:02.973225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f58bb2e-5012-46b9-a51b-8ad480e7228e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.083162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.089066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a6acfb7-9dc0-49dc-b8ce-2fb155697820 req-4834e825-82cb-4841-8037-71e32bbec6c0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2354131 Dec 21 04:12:03.162324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:03.166918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.212717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f58bb2e-5012-46b9-a51b-8ad480e7228e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.219835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:03.231103 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.232021 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment 47cf1262-24c6-4609-8908-50f772a00488 of type vlan for network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a Dec 21 04:12:03.292412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.296426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4f58bb2e-5012-46b9-a51b-8ad480e7228e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.301087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.331702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f58bb2e-5012-46b9-a51b-8ad480e7228e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5112533-8e95-4374-be65-a1e57c7f1735,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:03.365811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f58bb2e-5012-46b9-a51b-8ad480e7228e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a128c76672334e85893af960c5cf37b6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6699297 Dec 21 04:12:03.366289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58154) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:03.384059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device bdd088da-f507-4663-8336-df5ac93e0140 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:03.446825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.455879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:03.458019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.519388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f83e0cd2-fcc4-4ef7-9cbf-0efbb78a80a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.519902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port bdd088da-f507-4663-8336-df5ac93e0140 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:12:03.525839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port bdd088da-f507-4663-8336-df5ac93e0140 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:03.526308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.551088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=d0c4182a-d5d5-4819-b0ff-70aa95c06d7a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:03.571001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f83e0cd2-fcc4-4ef7-9cbf-0efbb78a80a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.578339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:03.579483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-475f80be-e029-414a-8ad6-c8ecac01eb18 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.6500933 Dec 21 04:12:03.582383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58156) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:03.588283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:03.656480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.739553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.761021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.799532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port bdd088da-f507-4663-8336-df5ac93e0140, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=bdd088da-f507-4663-8336-df5ac93e0140,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:03.806034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bdd088da-f507-4663-8336-df5ac93e0140'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:03.810444 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de94cab9-4a58-41ad-8a66-e91f45d3f1ee" -d '{"events": [{"server_uuid": "56024bb9-3b76-4818-b87e-7d7da9b0dd68", "name": "network-vif-plugged", "status": "completed", "tag": "bdd088da-f507-4663-8336-df5ac93e0140"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:03.842205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f83e0cd2-fcc4-4ef7-9cbf-0efbb78a80a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.844940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f83e0cd2-fcc4-4ef7-9cbf-0efbb78a80a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.851958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f83e0cd2-fcc4-4ef7-9cbf-0efbb78a80a1 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e5112533-8e95-4374-be65-a1e57c7f1735 HTTP/1.1" status: 204 len: 168 time: 0.4846027 Dec 21 04:12:03.872734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:03.877223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.890391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Pushing event updated for resources: {'Port': ['ID=68585ba8-704c-4ea2-b7b3-5e80d32c8fb9,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:03.912717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83e0cd2-fcc4-4ef7-9cbf-0efbb78a80a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5112533-8e95-4374-be65-a1e57c7f1735,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:03.922100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.927361 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:03.928258 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-daf3567e-d6e3-414c-8e3a-1555f9fbc9ff x-openstack-request-id: req-daf3567e-d6e3-414c-8e3a-1555f9fbc9ff {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:03.928772 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "56024bb9-3b76-4818-b87e-7d7da9b0dd68", "name": "network-vif-plugged", "status": "completed", "tag": "bdd088da-f507-4663-8336-df5ac93e0140", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:03.929204 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-daf3567e-d6e3-414c-8e3a-1555f9fbc9ff {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:03.929820 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bdd088da-f507-4663-8336-df5ac93e0140', 'code': 200} Dec 21 04:12:04.043121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=bdd088da-f507-4663-8336-df5ac93e0140,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:04.104155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592af136-4668-4597-8d57-63d0fec9a1c5 req-84d92515-5658-4d73-8b0c-e09f5fafe924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:04.108318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-592af136-4668-4597-8d57-63d0fec9a1c5 req-84d92515-5658-4d73-8b0c-e09f5fafe924 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 1098 time: 0.0793920 Dec 21 04:12:04.212678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-592af136-4668-4597-8d57-63d0fec9a1c5 req-8a13378b-2802-4fae-9083-6746a9c17c44 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917833 Dec 21 04:12:04.229528 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Floating IP d02771e2-5bc2-4049-8875-7a825e3ddb1d associated. External IP: 172.25.5.72, port: c6630949-90a2-4c1b-bfe4-1902459da935. Dec 21 04:12:04.327996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af96660-524f-4ccc-887a-8155ec85288b req-35c2836a-06dd-42da-82ff-decfbf97cd55 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:04.332408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4af96660-524f-4ccc-887a-8155ec85288b req-35c2836a-06dd-42da-82ff-decfbf97cd55 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.1141963 Dec 21 04:12:04.453138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4af96660-524f-4ccc-887a-8155ec85288b req-81139120-c4c2-42d1-b8a9-8dd24d7c6c66 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138096 Dec 21 04:12:04.576309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:04.714166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=e7de69a0-4f46-40a4-a48d-2a28c005f48e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:04.723025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': '47cf1262-24c6-4609-8908-50f772a00488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:04.723025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: d0c4182a-d5d5-4819-b0ff-70aa95c06d7a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:04.803687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Router cf2225cf-4f0b-443b-9a3c-aa855d47746d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:04.849423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:04.925388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:04.936486 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] Sync routers for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:04.944249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d0c4182a-d5d5-4819-b0ff-70aa95c06d7a) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:04.952305 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:04.952796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b22f9e76-3847-4cda-b518-6880cff31bd3 None None] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:04.953256 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:04.956630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:04.959307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.007882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.010411 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:05.020318 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:05.021285 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:05.096325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-acf0eb06-0395-4ab7-8f5f-1b932b9d52d8 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 987 time: 4.4361727 Dec 21 04:12:05.097583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58186) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:05.097792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:05.097792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75939f42-b182-454c-b5a1-a068e5c49ca3 None None] The sync data for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:05.097970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-173e572d-6900-466e-acd4-edd43a04762d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5048461 Dec 21 04:12:05.097970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:05.120798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1785176551', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:05.122673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d0c4182a-d5d5-4819-b0ff-70aa95c06d7a', 'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': 'e7de69a0-4f46-40a4-a48d-2a28c005f48e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:12:05.123908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.278019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b56aa074-0dd8-4bd4-9cc5-cd0e79ec2d54 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] 10.222.0.18 "GET /v2.0/floatingips/d02771e2-5bc2-4049-8875-7a825e3ddb1d HTTP/1.1" status: 200 len: 982 time: 0.2038364 Dec 21 04:12:05.280917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58192) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:05.335312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Allocated IP 172.20.0.2 (d0c4182a-d5d5-4819-b0ff-70aa95c06d7a/e7de69a0-4f46-40a4-a48d-2a28c005f48e/8f503b90-b51f-4523-881d-f759a54d719b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:05.428061 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.431225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.501934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.513787 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9febdf22-bf5f-4479-946e-db93120978cd tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] 10.222.0.18 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 1465 time: 0.2284646 Dec 21 04:12:05.516317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58198) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:05.578682 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.589839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.595951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58200) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:05.651912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Pushing event updated for resources: {'Port': ['ID=8f503b90-b51f-4523-881d-f759a54d719b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:05.662995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:05.664628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:05.667254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:05.707922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.734029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Attempting to bind port 8f503b90-b51f-4523-881d-f759a54d719b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:05.734617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Attempting to bind port 8f503b90-b51f-4523-881d-f759a54d719b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '47cf1262-24c6-4609-8908-50f772a00488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:05.735174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Attempting to bind port 8f503b90-b51f-4523-881d-f759a54d719b on network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:05.741883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:05.747629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Checking segment: {'id': '47cf1262-24c6-4609-8908-50f772a00488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:05.747629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.747629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Bound using segment: {'id': '47cf1262-24c6-4609-8908-50f772a00488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:05.747629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Bound port: 8f503b90-b51f-4523-881d-f759a54d719b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '47cf1262-24c6-4609-8908-50f772a00488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'd0c4182a-d5d5-4819-b0ff-70aa95c06d7a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:05.747629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.820238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-543807889-network', 'tenant_id': 'd2e30049129c4c3592deb360333de491'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:05.826893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53733698-1268-4c80-bc78-152dc75622e5 req-8b83767b-2629-4686-99ba-b0c6d28b9b87 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:05.828544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53733698-1268-4c80-bc78-152dc75622e5 req-8b83767b-2629-4686-99ba-b0c6d28b9b87 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.1795118 Dec 21 04:12:05.849826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] For port 8f503b90-b51f-4523-881d-f759a54d719b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:05.854561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] For port 8f503b90-b51f-4523-881d-f759a54d719b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8f503b90-b51f-4523-881d-f759a54d719b,segment=NetworkSegment(47cf1262-24c6-4609-8908-50f772a00488),segment_id=47cf1262-24c6-4609-8908-50f772a00488)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:05.868589 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:12:05.872511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.876755 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb1b5aba-2bf6-4ae5-b777-934c060e7a85 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.7807341 Dec 21 04:12:05.879027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58204) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:05.893314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting port 68585ba8-704c-4ea2-b7b3-5e80d32c8fb9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:05.893678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:05.914137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-53733698-1268-4c80-bc78-152dc75622e5 req-c432236a-8a7d-4c09-bd2c-6998a0121d02 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760763 Dec 21 04:12:05.927616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.015322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f2d842-8d16-4e1a-bca2-69e6424a3228 None None] Pushing event updated for resources: {'Port': ['ID=8f503b90-b51f-4523-881d-f759a54d719b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:06.027509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.029866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.049777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Calling delete_port for 68585ba8-704c-4ea2-b7b3-5e80d32c8fb9 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:06.091642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Made reservation on behalf of d2e30049129c4c3592deb360333de491 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:06.096647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.157564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.418168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.446691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.485119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Port': ['ID=68585ba8-704c-4ea2-b7b3-5e80d32c8fb9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:06.595431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.595741 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Floating IP d02771e2-5bc2-4049-8875-7a825e3ddb1d disassociated (deleted). External IP: 172.25.5.72, port: c6630949-90a2-4c1b-bfe4-1902459da935. Dec 21 04:12:06.728676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.785998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.20.0.1 (d0c4182a-d5d5-4819-b0ff-70aa95c06d7a/e7de69a0-4f46-40a4-a48d-2a28c005f48e/11146d77-62dd-43f6-898f-0822546bf348) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:06.816673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.861458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Router cf2225cf-4f0b-443b-9a3c-aa855d47746d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:06.896861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:06.917955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af6b7836-33ff-4b41-9bf5-b2e0ac6ef0f1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:06.938368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:06.939518 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Added segment bed42796-65f7-4de5-a18c-e067a8749346 of type vlan for network 40103928-b3fd-40ec-85fe-9344d00198cd Dec 21 04:12:07.078676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.088870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:07.096839 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.100330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] Sync routers for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:07.126020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.129395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:07.143167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:07.162890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-47c7bc1e-f746-471c-bc5e-b397acbce5f1 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "DELETE /v2.0/floatingips/d02771e2-5bc2-4049-8875-7a825e3ddb1d HTTP/1.1" status: 204 len: 168 time: 1.6453540 Dec 21 04:12:07.166303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58214) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:07.171498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:07.177769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.205115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51f83c2-ebfe-40c9-a25f-c716aa584c9d req-52a47b88-3579-4928-b392-fb573d956cd4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:07.216738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b51f83c2-ebfe-40c9-a25f-c716aa584c9d req-52a47b88-3579-4928-b392-fb573d956cd4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.1300910 Dec 21 04:12:07.226326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:07.228331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:07.230461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:07.237709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:07.244029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:07.247595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:07.296888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b51f83c2-ebfe-40c9-a25f-c716aa584c9d req-bdbac32d-9b87-4d3e-8bc6-17b1f57bd5b1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790207 Dec 21 04:12:07.321179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.322247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:07.323118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.323590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.334437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=11146d77-62dd-43f6-898f-0822546bf348,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:07.353266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:07.353949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a49d4786-036d-4fe0-8b6c-b655d51c0e0a None None] The sync data for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:07.385956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.470581 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.8645272 Dec 21 04:12:07.471280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58220) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:07.473311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Request body: {'subnet': {'network_id': '40103928-b3fd-40ec-85fe-9344d00198cd', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-543807889-subnet', 'tenant_id': 'd2e30049129c4c3592deb360333de491', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:07.519289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906b0ab2-4ed6-4c71-8963-9722b63c6182 admin admin] Pushing event updated for resources: {'Network': ['ID=40103928-b3fd-40ec-85fe-9344d00198cd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:07.532062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 40103928-b3fd-40ec-85fe-9344d00198cd details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:07.539327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.580225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24783595-d277-482f-8fc7-66eda8b68138 None None] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:07.614676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Made reservation on behalf of d2e30049129c4c3592deb360333de491 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:07.617672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.755604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d928c80f-ac34-4dbc-ad72-6c4e797ea2c2 None None] Provisioning complete for port 8f503b90-b51f-4523-881d-f759a54d719b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:07.755979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d928c80f-ac34-4dbc-ad72-6c4e797ea2c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:07.879435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Allocated IP 172.25.5.45 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/f5cba649-de04-423e-8931-54c7141daca3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:07.910671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-d69d8139-c8cd-4ee6-a829-b441e308bc2b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:07.912816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-d69d8139-c8cd-4ee6-a829-b441e308bc2b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.3086095 Dec 21 04:12:08.005002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-a929582f-b523-4e2a-bae5-8bf9660a4c9e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0800488 Dec 21 04:12:08.016178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d928c80f-ac34-4dbc-ad72-6c4e797ea2c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.047283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.076196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d928c80f-ac34-4dbc-ad72-6c4e797ea2c2 None None] For port 8f503b90-b51f-4523-881d-f759a54d719b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8f503b90-b51f-4523-881d-f759a54d719b,segment=NetworkSegment(47cf1262-24c6-4609-8908-50f772a00488),segment_id=47cf1262-24c6-4609-8908-50f772a00488)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:08.153707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d928c80f-ac34-4dbc-ad72-6c4e797ea2c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.235118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-9218533e-56f9-46ec-8d38-2aab363eafa7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1846635 Dec 21 04:12:08.239445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.283937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d928c80f-ac34-4dbc-ad72-6c4e797ea2c2 None None] Pushing event updated for resources: {'Port': ['ID=8f503b90-b51f-4523-881d-f759a54d719b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:08.291798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8f503b90-b51f-4523-881d-f759a54d719b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:08.299937 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.402493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f59ea53-d804-448f-8297-1b286689e33c None None] Provisioning complete for port 11146d77-62dd-43f6-898f-0822546bf348 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:08.402946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f59ea53-d804-448f-8297-1b286689e33c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.460773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2ca27221-053f-4d83-b4d1-6ef7f3f6e1f3,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:08.491881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2f59ea53-d804-448f-8297-1b286689e33c None None] Port 11146d77-62dd-43f6-898f-0822546bf348 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:08.508448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Checking segment: {'id': 'bed42796-65f7-4de5-a18c-e067a8749346', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '40103928-b3fd-40ec-85fe-9344d00198cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:08.509055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Network hostable DHCP agents. Network: 40103928-b3fd-40ec-85fe-9344d00198cd, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:08.514605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f59ea53-d804-448f-8297-1b286689e33c None None] Provisioning complete for port 8f503b90-b51f-4523-881d-f759a54d719b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:08.515291 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f59ea53-d804-448f-8297-1b286689e33c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.521498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-0df85824-9fb8-4b0b-a919-bdcf344dc422 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2717273 Dec 21 04:12:08.524197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8f503b90-b51f-4523-881d-f759a54d719b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:08.530547 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.590173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.675652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Pushing event updated for resources: {'Port': ['ID=f5cba649-de04-423e-8931-54c7141daca3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:08.707725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.721909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:08.725477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:08.729840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:08.759315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Network 40103928-b3fd-40ec-85fe-9344d00198cd is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:08.778806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.791232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-84aa23c8-1111-489b-a7ec-ca50b28bc4fd service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2613015 Dec 21 04:12:08.869667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.907556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 40103928-b3fd-40ec-85fe-9344d00198cd) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:08.920178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:08.921366 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.925370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dc2fd05-22db-4c78-a37c-c0ca57827e33 None None] Network 40103928-b3fd-40ec-85fe-9344d00198cd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:08.925732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:08.937248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=11146d77-62dd-43f6-898f-0822546bf348,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:09.018195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-57a89c2a-0418-45e7-9c2a-c45af572e734 None None] Provisioning complete for port 11146d77-62dd-43f6-898f-0822546bf348 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:09.018679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a89c2a-0418-45e7-9c2a-c45af572e734 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:09.052365 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:09.059272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:09.062027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:09.109798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-57a89c2a-0418-45e7-9c2a-c45af572e734 None None] Port 11146d77-62dd-43f6-898f-0822546bf348 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:09.130958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b3e54315-2faa-4322-90da-225e54d9c227 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.6637151 Dec 21 04:12:09.158179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-858ac858-983c-4c99-bc11-54cdfc15ba5e None None] Network 40103928-b3fd-40ec-85fe-9344d00198cd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:09.257425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c59533d-0edb-4eb0-8cf6-209992db40e8 req-1a8b8f45-7fae-4f08-b6f4-008e70d0ae74 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 210 time: 0.0686409 Dec 21 04:12:09.480942 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:09.549825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a3a4197b-6867-4c8d-bd55-012cefde82a0 None None] Provisioning complete for port 11146d77-62dd-43f6-898f-0822546bf348 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:09.550188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a3a4197b-6867-4c8d-bd55-012cefde82a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:09.590500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a3a4197b-6867-4c8d-bd55-012cefde82a0 None None] Port 11146d77-62dd-43f6-898f-0822546bf348 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:09.864018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router f0a495c9-2d29-4255-a4c1-56370cafce12 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:12:09.887377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:09.957227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Pushing event updated for resources: {'Port': ['ID=f5cba649-de04-423e-8931-54c7141daca3,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:09.997075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:10.001744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.015361 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a3525669-f9de-4ee8-97d3-8f09cb570dff tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/f0a495c9-2d29-4255-a4c1-56370cafce12/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1335025 Dec 21 04:12:10.015679 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] Sync routers for ids ['f0a495c9-2d29-4255-a4c1-56370cafce12'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:10.016158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58254) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:10.041652 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] Routers {'f0a495c9-2d29-4255-a4c1-56370cafce12'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:10.044844 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f0a495c9-2d29-4255-a4c1-56370cafce12'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:10.076096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35a91aef-7606-48ae-9bc7-1351c0d6b8d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:10.078517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-35a91aef-7606-48ae-9bc7-1351c0d6b8d4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports/11146d77-62dd-43f6-898f-0822546bf348 HTTP/1.1" status: 200 len: 910 time: 0.0609856 Dec 21 04:12:10.082031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58256) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:10.087277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'e7de69a0-4f46-40a4-a48d-2a28c005f48e'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:10.089483 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:10.099071 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] Routers {'f0a495c9-2d29-4255-a4c1-56370cafce12'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:10.099923 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f0a495c9-2d29-4255-a4c1-56370cafce12'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:10.128056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.139613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1df4193c-8e9f-4ed3-a0c9-73db4dd27395 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.9646761 Dec 21 04:12:10.139992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58260) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:10.156968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:10.157649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeab98e1-5fcb-42cd-b80a-33a67f616510 None None] The sync data for ids ['f0a495c9-2d29-4255-a4c1-56370cafce12'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:10.180358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8f503b90-b51f-4523-881d-f759a54d719b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:10.258431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8f503b90-b51f-4523-881d-f759a54d719b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:10.259285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.320150 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.461525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:10.516276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddc4f0f3-299c-4d5a-a8de-8cb8fcf52e44 req-5a9a601d-69e2-4bdb-9e1b-c70e9cc981ef tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 210 time: 0.0335636 Dec 21 04:12:10.557299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.701920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58282) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:10.708748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-97087855-network', 'tenant_id': '8a08eada91da4cfc9814ead779e65028'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:10.735743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.839143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.855857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Made reservation on behalf of 8a08eada91da4cfc9814ead779e65028 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:10.859053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.859374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Allocated IP 172.25.5.124 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/1ede12c8-898f-49ae-92b6-7747ef6ac71c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:10.881558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.915131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:10.990222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.021159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:11.025724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.025724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/ports/11146d77-62dd-43f6-898f-0822546bf348 HTTP/1.1" status: 200 len: 910 time: 0.9411998 Dec 21 04:12:11.030855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58286) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:11.039487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd9e1cd-3d5e-4f36-9d6a-c913510febf7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=11146d77-62dd-43f6-898f-0822546bf348,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:11.130689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.153989 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.214914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:11.220147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:11.222955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:11.225274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Pushing event updated for resources: {'Port': ['ID=1ede12c8-898f-49ae-92b6-7747ef6ac71c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:11.337329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.465415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.581589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.621065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:11.646012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09745d4c-ec8e-4665-94d1-65cfb7e2dacd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:11.656163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.656422 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Added segment d5bd6002-7c77-43c2-9ba4-afd05c49d48e of type vlan for network 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1 Dec 21 04:12:11.695938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62ffd684-203f-43d4-b74c-2055120747f2 req-f6d030a5-8861-4a3f-988b-46cf8d383521 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 210 time: 0.0617478 Dec 21 04:12:11.740075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.761549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.847505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.884682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.887176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:11.889721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.948439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Pushing event updated for resources: {'Port': ['ID=1ede12c8-898f-49ae-92b6-7747ef6ac71c,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:11.960547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] Pushing event updated for resources: {'Network': ['ID=2dc9122c-fb8b-4720-8eaa-4d72a1f787f1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:11.964257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.965053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:11.973304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:12.051557 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.056648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:12.057458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6166adb4-dffa-49a4-bf90-96fbb82f86a4 tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.9240255 Dec 21 04:12:12.145140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ae7bf509-f4ec-45fa-929e-490aab1063d9 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 896 time: 1.4421413 Dec 21 04:12:12.149741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:12.156539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Request body: {'subnet': {'network_id': '2dc9122c-fb8b-4720-8eaa-4d72a1f787f1', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-97087855-subnet', 'tenant_id': '8a08eada91da4cfc9814ead779e65028', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:12.158873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:12.159748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3e314f98-8867-40aa-b9a2-b1b4fa6ec1fb tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] 10.222.0.18 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 1650 time: 0.1024208 Dec 21 04:12:12.287787 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9eb828f4-5015-48c1-b632-d134601adffa tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.1249440 Dec 21 04:12:12.288743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58308) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:12.393890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 11146d77-62dd-43f6-898f-0822546bf348 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:12.394312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.449326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Made reservation on behalf of 8a08eada91da4cfc9814ead779e65028 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:12.451682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.501707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.516032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 11146d77-62dd-43f6-898f-0822546bf348 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:12.582513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-da5e5632-6869-426e-820a-b0c12186abc1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:12.583929 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-da5e5632-6869-426e-820a-b0c12186abc1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2438803 Dec 21 04:12:12.633650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': '66bd1716-5002-4609-b8aa-bf652142bb16', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:12.645096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Deleting port 1ede12c8-898f-49ae-92b6-7747ef6ac71c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:12.645096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.759406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.808854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=11146d77-62dd-43f6-898f-0822546bf348,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:12.852173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.852809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:12.870369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Calling delete_port for 1ede12c8-898f-49ae-92b6-7747ef6ac71c owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:12.898824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e04555aa-06ca-429e-bc19-ddea7d003ecc req-852cc4af-8d4c-4a64-97bb-591cbd297877 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 210 time: 0.0943837 Dec 21 04:12:12.933154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.020962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3922eef3-c925-416d-89ff-0f3f90fd37d9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:13.061400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Checking segment: {'id': 'd5bd6002-7c77-43c2-9ba4-afd05c49d48e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '2dc9122c-fb8b-4720-8eaa-4d72a1f787f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:13.061400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Network hostable DHCP agents. Network: 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:13.080065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.095687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:13.099181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.204307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Network 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:13.235236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.288948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router f0a495c9-2d29-4255-a4c1-56370cafce12 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:13.298053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Pushing event deleted for resources: {'Port': ['ID=1ede12c8-898f-49ae-92b6-7747ef6ac71c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:13.308260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:13.318794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4311e407-9380-4047-8bc6-509a532a4e9f None None] Network 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:13.365991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:13.366605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.408569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:13.422239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] Sync routers for ids ['f0a495c9-2d29-4255-a4c1-56370cafce12'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:13.426612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38712054-51b8-4515-9fff-aee41681bd7e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/f0a495c9-2d29-4255-a4c1-56370cafce12/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3946555 Dec 21 04:12:13.427397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58326) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:13.444183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] Routers {'f0a495c9-2d29-4255-a4c1-56370cafce12'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:13.444810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f0a495c9-2d29-4255-a4c1-56370cafce12'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:13.472339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dc1d0cce-f68f-4043-82f0-1894ed905e0e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0a495c9-2d29-4255-a4c1-56370cafce12 HTTP/1.1" status: 200 len: 205 time: 0.0388780 Dec 21 04:12:13.472976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58328) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:13.486548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:13.510980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.514094 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.518415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-159fd155-3a7c-410f-a05b-2a61ac7d9a4e tempest-FloatingIPAdminTestJSON-631265158 tempest-FloatingIPAdminTestJSON-631265158-project] 10.222.0.18 "DELETE /v2.0/floatingips/f019365d-fb6a-4670-97c5-d5c657317edb HTTP/1.1" status: 204 len: 168 time: 1.2258971 Dec 21 04:12:13.519688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] Routers {'f0a495c9-2d29-4255-a4c1-56370cafce12'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:13.520535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f0a495c9-2d29-4255-a4c1-56370cafce12'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:13.524999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58330) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:13.559545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5154c601-cf6e-4119-bb08-fe135266a610 None None] Network 2dc9122c-fb8b-4720-8eaa-4d72a1f787f1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:13.562483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:13.563366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ad52475-5d56-4b84-890f-a35266f5ec67 None None] The sync data for ids ['f0a495c9-2d29-4255-a4c1-56370cafce12'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:13.625879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.652795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c601a993-773d-4731-9ff0-2d3eaeecfa42 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 1.5019236 Dec 21 04:12:13.659283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.7 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/0d0c67f3-acef-494a-8eb8-fb6c9f131620) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:13.877235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.879472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:13.941716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58334) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:14.013754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a938ab9a-5c37-41f7-82d0-f3236167bdda req-9691facd-411a-4e5a-9b97-1603c4ca5891 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 210 time: 0.0275679 Dec 21 04:12:14.014853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.015699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router f0a495c9-2d29-4255-a4c1-56370cafce12 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:12:14.023008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.026376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ff9b2e34-df54-4203-869c-8cc2c6b81104 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/f0a495c9-2d29-4255-a4c1-56370cafce12 HTTP/1.1" status: 204 len: 168 time: 0.5499189 Dec 21 04:12:14.027066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58340) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:14.047313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.058972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Deleting subnet 2ca27221-053f-4d83-b4d1-6ef7f3f6e1f3 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:12:14.064130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.082284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet e7de69a0-4f46-40a4-a48d-2a28c005f48e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:12:14.085827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.130648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.133741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.166320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Deleting port f5cba649-de04-423e-8931-54c7141daca3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:14.166665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.236988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.272346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.277244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.306163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:14.362125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:14.364047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['bdd088da-f507-4663-8336-df5ac93e0140'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:14.364485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.364485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.377645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:14.386331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:14.390292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Calling delete_port for f5cba649-de04-423e-8931-54c7141daca3 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:14.391351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=0d0c67f3-acef-494a-8eb8-fb6c9f131620,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:14.407915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ab5013f-535e-4447-992a-efbc248b175f None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:14.457473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.467883 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.493433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=e7de69a0-4f46-40a4-a48d-2a28c005f48e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:14.496139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.503637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fd85e3df-aa78-40b2-b0a7-6718c9fb88b4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/e7de69a0-4f46-40a4-a48d-2a28c005f48e HTTP/1.1" status: 204 len: 168 time: 0.4759855 Dec 21 04:12:14.504344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58344) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:14.506522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cf765352-ec4e-48e3-9977-4d75e92a8fa0 None None] Provisioning complete for port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:14.507185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cf765352-ec4e-48e3-9977-4d75e92a8fa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.513783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3870676e-af93-4989-be68-ed3acabbaa9c None None] Network d0c4182a-d5d5-4819-b0ff-70aa95c06d7a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:14.517339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.524154 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/2ca27221-053f-4d83-b4d1-6ef7f3f6e1f3 HTTP/1.1" status: 204 len: 168 time: 0.5813818 Dec 21 04:12:14.531586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:14.532212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.538116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58346) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:14.586630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0105d794-7a2d-4672-b1e4-f4b6d7fdfd37 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2ca27221-053f-4d83-b4d1-6ef7f3f6e1f3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:14.640642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.702231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 8f503b90-b51f-4523-881d-f759a54d719b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:14.702893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.716847 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-95e9397d-03bc-4e39-93df-f4ff0dc562dd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1049926 Dec 21 04:12:14.722439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.738184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Request body: {'port': {'device_id': '66bd1716-5002-4609-b8aa-bf652142bb16', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:14.752690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cf765352-ec4e-48e3-9977-4d75e92a8fa0 None None] Port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:14.804761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port 8f503b90-b51f-4523-881d-f759a54d719b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8f503b90-b51f-4523-881d-f759a54d719b,segment=NetworkSegment(47cf1262-24c6-4609-8908-50f772a00488),segment_id=47cf1262-24c6-4609-8908-50f772a00488)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:14.807671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.848044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 8f503b90-b51f-4523-881d-f759a54d719b owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:14.864972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:14.874720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] DHCP port deletion for d0c4182a-d5d5-4819-b0ff-70aa95c06d7a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:14.906474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Pushing event deleted for resources: {'Port': ['ID=f5cba649-de04-423e-8931-54c7141daca3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:14.978334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] Deleting port 8f503b90-b51f-4523-881d-f759a54d719b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:14.979046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.019117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.042468 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.051568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] For port 8f503b90-b51f-4523-881d-f759a54d719b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8f503b90-b51f-4523-881d-f759a54d719b,segment=NetworkSegment(47cf1262-24c6-4609-8908-50f772a00488),segment_id=47cf1262-24c6-4609-8908-50f772a00488)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:15.053260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.063443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['40103928-b3fd-40ec-85fe-9344d00198cd']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:15.074726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] Calling delete_port for 8f503b90-b51f-4523-881d-f759a54d719b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:15.086659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bed42796-65f7-4de5-a18c-e067a8749346') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:15.087215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bed42796-65f7-4de5-a18c-e067a8749346') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:15.104405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=8f503b90-b51f-4523-881d-f759a54d719b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:15.108293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port 8f503b90-b51f-4523-881d-f759a54d719b on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:15.152031 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.163657 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.192300 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.216950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] Pushing event deleted for resources: {'Port': ['ID=8f503b90-b51f-4523-881d-f759a54d719b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:15.238821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1addda5-46f0-4b24-99dd-abf73df06817 None None] No DVR routers for this DVR port 8f503b90-b51f-4523-881d-f759a54d719b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:15.261495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.285520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.288555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.299759 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-45f354ea-7d8d-4e01-bec0-e2f59f552535 tempest-FloatingIPAdminTestJSON-1475305560 tempest-FloatingIPAdminTestJSON-1475305560-project-admin] 10.222.0.18 "DELETE /v2.0/floatingips/adf5ea32-f9fa-4ca4-9b1e-b0335dc4d929 HTTP/1.1" status: 204 len: 168 time: 1.7651250 Dec 21 04:12:15.299938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.300575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:15.300991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:15.303220 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:15.308188 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:15.308188 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:15.308188 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:15.308188 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:15.308188 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:15.308188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58362) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:15.331554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d0c4182a-d5d5-4819-b0ff-70aa95c06d7a']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:15.348378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94f25b7-2732-40be-ba93-c8a9b0a05ab2 req-eda6c81d-d45d-4461-a128-869ff0553dd4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:15.357007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a94f25b7-2732-40be-ba93-c8a9b0a05ab2 req-eda6c81d-d45d-4461-a128-869ff0553dd4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 931 time: 0.1921380 Dec 21 04:12:15.368541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '47cf1262-24c6-4609-8908-50f772a00488') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:15.369034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '47cf1262-24c6-4609-8908-50f772a00488') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:15.389965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.416947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.443366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:15.443983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:15.518405 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:15.522757 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:15.534866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a94f25b7-2732-40be-ba93-c8a9b0a05ab2 req-e6d6df77-7115-4395-be91-43275addce54 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1769640 Dec 21 04:12:15.542731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.557129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.560352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] 10.222.0.18 "DELETE /v2.0/networks/40103928-b3fd-40ec-85fe-9344d00198cd HTTP/1.1" status: 204 len: 168 time: 0.9985025 Dec 21 04:12:15.563942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58364) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:15.625384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.645346 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.650410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/d0c4182a-d5d5-4819-b0ff-70aa95c06d7a HTTP/1.1" status: 204 len: 168 time: 1.1439102 Dec 21 04:12:15.657275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58366) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:15.662252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1322227868', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:15.680362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Deleting subnet 3922eef3-c925-416d-89ff-0f3f90fd37d9 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:12:15.685455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3393688c-4a37-464a-b4cf-8a79e017d202 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=d0c4182a-d5d5-4819-b0ff-70aa95c06d7a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:15.687991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.743031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.795887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.822157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.823773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.907272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.932892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff615d9-9f81-4650-8e7c-1565794803fb admin admin] Pushing event deleted for resources: {'Network': ['ID=40103928-b3fd-40ec-85fe-9344d00198cd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:15.970762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:15.974381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting port c6630949-90a2-4c1b-bfe4-1902459da935 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:15.974731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.000005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.049126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3922eef3-c925-416d-89ff-0f3f90fd37d9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:16.065162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.076636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-57286063-1679-42b3-a779-c0e373c1ca25 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/3922eef3-c925-416d-89ff-0f3f90fd37d9 HTTP/1.1" status: 204 len: 168 time: 0.5091636 Dec 21 04:12:16.079631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58370) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:16.081270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.087152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5f0a19f2-0b4c-4ee9-b688-cad90e002910 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.4280522 Dec 21 04:12:16.089264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58372) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:16.098896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-180796448'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:16.148347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.204691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8f503b90-b51f-4523-881d-f759a54d719b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:16.229177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:16.233503 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.254583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8f503b90-b51f-4523-881d-f759a54d719b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:16.257865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8f503b90-b51f-4523-881d-f759a54d719b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:16.273813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Calling delete_port for c6630949-90a2-4c1b-bfe4-1902459da935 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:16.276552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:16.288412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.288583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.289268 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment 6d5412fb-6f7b-4f5e-befe-538f4e4cf136 of type vlan for network 4a466f04-c248-434e-bdc2-339c1c621793 Dec 21 04:12:16.308034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d0c67f3-acef-494a-8eb8-fb6c9f131620 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:12:16.319582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.338249 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.377222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Transition to ACTIVE for port object 0d0c67f3-acef-494a-8eb8-fb6c9f131620 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:12:16.426567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.432853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:16.434047 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.467575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.471699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.517064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10e2b0e6-f811-4bfd-9a05-080ef238ec1c None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:16.533210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2dc9122c-fb8b-4720-8eaa-4d72a1f787f1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:16.576596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd5bd6002-7c77-43c2-9ba4-afd05c49d48e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:16.576880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd5bd6002-7c77-43c2-9ba4-afd05c49d48e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:16.577548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=4a466f04-c248-434e-bdc2-339c1c621793,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:16.598846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d815e90d-2ded-4f9e-baf4-c51802688d3c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.5059531 Dec 21 04:12:16.601573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58380) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:16.604216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4a466f04-c248-434e-bdc2-339c1c621793 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:16.611303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:16.623899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Pushing event updated for resources: {'Port': ['ID=0d0c67f3-acef-494a-8eb8-fb6c9f131620,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:16.631526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.686244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.698009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Releasing vlan 140 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:16.698414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:16.700714 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:16.767384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.776542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Attempting to bind port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:16.776542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Attempting to bind port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:16.776542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Attempting to bind port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:16.804984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c25714a-dcfb-41dd-8166-5c5cacbd44c1 req-fbac95a1-0686-41c4-b22f-c194ea849551 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:16.809640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:16.809970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Attempting to bind port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:16.812535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c25714a-dcfb-41dd-8166-5c5cacbd44c1 req-fbac95a1-0686-41c4-b22f-c194ea849551 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 943 time: 0.1477182 Dec 21 04:12:16.812700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Port': ['ID=c6630949-90a2-4c1b-bfe4-1902459da935,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:16.824677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:16.824677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:16.824677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:16.824677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Bound port: 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:16.824677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.882020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c25714a-dcfb-41dd-8166-5c5cacbd44c1 req-280ca4b1-4976-4709-b139-5f335dbb6918 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684705 Dec 21 04:12:16.884206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.913670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.920162 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] 10.222.0.18 "DELETE /v2.0/networks/2dc9122c-fb8b-4720-8eaa-4d72a1f787f1 HTTP/1.1" status: 204 len: 168 time: 0.8361952 Dec 21 04:12:16.943997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:16.948308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:16.960774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7afa3ed1-32ea-4500-9cf0-82afd7a31021 admin admin] Pushing event deleted for resources: {'Network': ['ID=2dc9122c-fb8b-4720-8eaa-4d72a1f787f1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:16.991617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.000290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b50583e-2b6e-4109-bdbd-2dcea5e9c2b2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "DELETE /v2.0/ports/c6630949-90a2-4c1b-bfe4-1902459da935 HTTP/1.1" status: 204 len: 168 time: 1.6937556 Dec 21 04:12:17.004482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58384) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:17.041390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] For port 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:17.085576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] For port 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:17.106676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f3217c4-41a0-48d8-a53a-8f193dde75d2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:17.111247 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f3217c4-41a0-48d8-a53a-8f193dde75d2 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "GET /v2.0/ports?device_id=cf2225cf-4f0b-443b-9a3c-aa855d47746d HTTP/1.1" status: 200 len: 913 time: 0.1065674 Dec 21 04:12:17.112529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58386) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:17.178348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.263277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:17.264006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.265711 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] 10.222.0.54 "PUT /v2.0/ports/0d0c67f3-acef-494a-8eb8-fb6c9f131620 HTTP/1.1" status: 200 len: 1092 time: 2.5337551 Dec 21 04:12:17.270345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66bd1716-5002-4609-b8aa-bf652142bb16', 'tag': '0d0c67f3-acef-494a-8eb8-fb6c9f131620'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:17.272707 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2122ff6a-f014-4310-8cdc-f99121e2444a" -d '{"events": [{"name": "network-changed", "server_uuid": "66bd1716-5002-4609-b8aa-bf652142bb16", "tag": "0d0c67f3-acef-494a-8eb8-fb6c9f131620"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:17.273650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0223d642-1ab1-4712-9a75-af9695b06063 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:17.326363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6866a69c-b2fd-476a-b330-1d461f1cd489 service neutron] Pushing event updated for resources: {'Port': ['ID=0d0c67f3-acef-494a-8eb8-fb6c9f131620,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:17.486335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.493190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58396) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:17.589751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-11db1539-93f9-4cb7-8b98-13aed165d8d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:17.591620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-11db1539-93f9-4cb7-8b98-13aed165d8d7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 1095 time: 0.1230097 Dec 21 04:12:17.603555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=9b2363e5-033b-431f-bd9b-32df9784fb2e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:17.613503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3ce4a44d-b4ba-4ba9-bdb2-a9a26510aa65 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d2e30049129c4c3592deb360333de491&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1157572 Dec 21 04:12:17.613503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58398) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:17.620604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:17.621052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: 4a466f04-c248-434e-bdc2-339c1c621793, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:17.671588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-00fe4a0c-f3a0-4bde-ab2a-c3b6d08009b3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620 HTTP/1.1" status: 200 len: 217 time: 0.0634227 Dec 21 04:12:17.700865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cd8095d-1ff5-4a74-b95b-26efb007e2c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.721861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 4a466f04-c248-434e-bdc2-339c1c621793 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:17.739390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cd8095d-1ff5-4a74-b95b-26efb007e2c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.742228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-b9906986-7a1b-4fbc-a490-915524d81b84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:17.743556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-b9906986-7a1b-4fbc-a490-915524d81b84 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0612109 Dec 21 04:12:17.771183 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f642169b-c9d0-4ce6-a9a8-e5db8381a771 x-openstack-request-id: req-f642169b-c9d0-4ce6-a9a8-e5db8381a771 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:17.771617 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66bd1716-5002-4609-b8aa-bf652142bb16", "tag": "0d0c67f3-acef-494a-8eb8-fb6c9f131620", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:17.771990 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f642169b-c9d0-4ce6-a9a8-e5db8381a771 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:17.772493 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66bd1716-5002-4609-b8aa-bf652142bb16', 'tag': '0d0c67f3-acef-494a-8eb8-fb6c9f131620', 'status': 'completed', 'code': 200} Dec 21 04:12:17.809982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-ae4c8711-a5e8-4eb2-aa7b-344b2c9f6547 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0449355 Dec 21 04:12:17.817911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4a466f04-c248-434e-bdc2-339c1c621793) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:17.826558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:17.827730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.828336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dad4a16a-f2d4-443f-aa83-1e5228d26021 None None] Network 4a466f04-c248-434e-bdc2-339c1c621793 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:17.873548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cd8095d-1ff5-4a74-b95b-26efb007e2c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.876683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7cd8095d-1ff5-4a74-b95b-26efb007e2c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.878293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7cd8095d-1ff5-4a74-b95b-26efb007e2c9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/af6b7836-33ff-4b41-9bf5-b2e0ac6ef0f1 HTTP/1.1" status: 204 len: 168 time: 0.2646809 Dec 21 04:12:17.889150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd8095d-1ff5-4a74-b95b-26efb007e2c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af6b7836-33ff-4b41-9bf5-b2e0ac6ef0f1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:17.899860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:17.944596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b95b3b77-8ae6-4911-88d3-793a7b51f35d tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3416340 Dec 21 04:12:17.945831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58404) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:18.012211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-2b7b0795-37d4-487e-af48-a53cd031843d service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1938086 Dec 21 04:12:18.026308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4a466f04-c248-434e-bdc2-339c1c621793', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:12:18.027498 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.224188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-994db15a-0e4e-449c-8ad9-ed474375e8cf req-9e65b19d-9a64-4167-8fba-21fadb65a318 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2027528 Dec 21 04:12:18.229684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Allocated IP 172.20.0.2 (4a466f04-c248-434e-bdc2-339c1c621793/9b2363e5-033b-431f-bd9b-32df9784fb2e/d17a7100-5218-4cde-a8fb-673cdcd2d747) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:18.280955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46101d7-6507-4d42-b50c-328b8c1b08d0 req-8eb27572-ed12-4214-8b3c-e8e3f1a2fc6d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:18.282790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b46101d7-6507-4d42-b50c-328b8c1b08d0 req-8eb27572-ed12-4214-8b3c-e8e3f1a2fc6d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 943 time: 0.2017808 Dec 21 04:12:18.339580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting port 24111072-3254-4d00-936c-2605892074ee {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:18.340067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.407162 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.453065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b46101d7-6507-4d42-b50c-328b8c1b08d0 req-aadcc368-3f39-4504-be84-b33a2b566642 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1367784 Dec 21 04:12:18.478473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.509555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.532343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-da3324b5-a1fd-4117-9d1f-e117885f9aaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:18.534140 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-da3324b5-a1fd-4117-9d1f-e117885f9aaa service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 1095 time: 0.1066079 Dec 21 04:12:18.535266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Calling delete_port for 24111072-3254-4d00-936c-2605892074ee owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:18.552943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.578919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Network 4a466f04-c248-434e-bdc2-339c1c621793 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:18.643167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:18.651925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Pushing event updated for resources: {'Port': ['ID=d17a7100-5218-4cde-a8fb-673cdcd2d747,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:18.655554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:18.673373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-a5a810f6-9f04-4cb2-add5-bcd6a98bfcbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:18.673373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-a5a810f6-9f04-4cb2-add5-bcd6a98bfcbd service neutron] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.1255982 Dec 21 04:12:18.724880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Attempting to bind port d17a7100-5218-4cde-a8fb-673cdcd2d747 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:18.725839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Attempting to bind port d17a7100-5218-4cde-a8fb-673cdcd2d747 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:18.727169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Attempting to bind port d17a7100-5218-4cde-a8fb-673cdcd2d747 on network 4a466f04-c248-434e-bdc2-339c1c621793 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:18.734106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:18.734927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Checking segment: {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:18.735772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.736571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Bound using segment: {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:18.737493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Bound port: d17a7100-5218-4cde-a8fb-673cdcd2d747, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:18.738127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.817518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] For port d17a7100-5218-4cde-a8fb-673cdcd2d747, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:18.821865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] For port d17a7100-5218-4cde-a8fb-673cdcd2d747, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d17a7100-5218-4cde-a8fb-673cdcd2d747,segment=NetworkSegment(6d5412fb-6f7b-4f5e-befe-538f4e4cf136),segment_id=6d5412fb-6f7b-4f5e-befe-538f4e4cf136)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:18.829207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.20.0.1 (4a466f04-c248-434e-bdc2-339c1c621793/9b2363e5-033b-431f-bd9b-32df9784fb2e/ac29ae09-52b0-488f-b26d-192e6156b786) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:18.868169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-66e8f90a-010b-488b-a719-83371180eb65 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620 HTTP/1.1" status: 200 len: 217 time: 0.0439498 Dec 21 04:12:18.905056 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:18.985573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca115d2d-b50a-40e2-a691-c0149e05de37 None None] Pushing event updated for resources: {'Port': ['ID=d17a7100-5218-4cde-a8fb-673cdcd2d747,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:19.009347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-fd7aa700-63aa-41f8-9233-0dde68b70d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:19.011539 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-fd7aa700-63aa-41f8-9233-0dde68b70d23 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.1301205 Dec 21 04:12:19.051314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-a0820153-c848-4110-a923-8792e427f5b6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286202 Dec 21 04:12:19.071051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.151330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58412) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:19.198770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Port': ['ID=24111072-3254-4d00-936c-2605892074ee,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:19.700652 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e322953c-3ad1-4f6d-a4fc-d8af76cbc1f2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8a08eada91da4cfc9814ead779e65028&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2117126 Dec 21 04:12:19.704469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58414) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:19.704666 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-46922223-4ce1-4093-9171-4ecead583230 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3102760 Dec 21 04:12:19.706053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69790daf-e443-415a-9071-76fde856f9ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.706159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.706240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.706240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69790daf-e443-415a-9071-76fde856f9ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.706391 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2122ff6a-f014-4310-8cdc-f99121e2444a req-548b4d88-329d-4ca6-99e6-7d3b76334b32 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2859175 Dec 21 04:12:19.706471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17a2af5-8b85-465b-82b7-f1e528104b71 req-5b1fdaa8-9577-4986-8447-f4648aeb515e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:19.708872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17a2af5-8b85-465b-82b7-f1e528104b71 req-5b1fdaa8-9577-4986-8447-f4648aeb515e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 943 time: 0.1458490 Dec 21 04:12:19.789925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17a2af5-8b85-465b-82b7-f1e528104b71 req-3aecb757-6299-4e49-bb13-15d89ce1b098 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809727 Dec 21 04:12:19.921832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.960312 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9325d7d6-7595-47d6-a5cf-1888c30ae857 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.977178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69790daf-e443-415a-9071-76fde856f9ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.980101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69790daf-e443-415a-9071-76fde856f9ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:19.987239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-69790daf-e443-415a-9071-76fde856f9ee admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/09745d4c-ec8e-4665-94d1-65cfb7e2dacd HTTP/1.1" status: 204 len: 168 time: 0.6159310 Dec 21 04:12:20.011221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 4a466f04-c248-434e-bdc2-339c1c621793 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:20.022228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:20.026673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:20.035969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69790daf-e443-415a-9071-76fde856f9ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09745d4c-ec8e-4665-94d1-65cfb7e2dacd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:20.093854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=ac29ae09-52b0-488f-b26d-192e6156b786,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:20.136312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:20.275316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d17a7100-5218-4cde-a8fb-673cdcd2d747 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:20.358726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d17a7100-5218-4cde-a8fb-673cdcd2d747 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:20.359433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:20.370662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Router cf2225cf-4f0b-443b-9a3c-aa855d47746d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:20.416168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:20.520995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:20.534820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58428) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:20.536729 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ca2c943f-2c54-4825-ac01-5b6e875f693b tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "PUT /v2.0/routers/cf2225cf-4f0b-443b-9a3c-aa855d47746d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4229431 Dec 21 04:12:20.538217 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] Sync routers for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:20.560486 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:20.562377 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:20.563015 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:20.623895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port d17a7100-5218-4cde-a8fb-673cdcd2d747, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d17a7100-5218-4cde-a8fb-673cdcd2d747,segment=NetworkSegment(6d5412fb-6f7b-4f5e-befe-538f4e4cf136),segment_id=6d5412fb-6f7b-4f5e-befe-538f4e4cf136)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:20.630065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b61d45dd-cbb1-432b-914d-38c5a10497fe None None] Network 4a466f04-c248-434e-bdc2-339c1c621793 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:20.647801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:20.658535 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] Routers {'cf2225cf-4f0b-443b-9a3c-aa855d47746d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:20.659423 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:20.698631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:20.699556 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea8ffbcb-65af-4658-a882-fca26266904c None None] The sync data for ids ['cf2225cf-4f0b-443b-9a3c-aa855d47746d'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:20.731500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:20.747244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:20.790914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a4990ec-5349-4f3e-a796-b5bc54986930 None None] Provisioning complete for port d17a7100-5218-4cde-a8fb-673cdcd2d747 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:20.791281 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a4990ec-5349-4f3e-a796-b5bc54986930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.012652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.025476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b911387e-9175-428c-bc3c-59a6251f5ac9 req-d6210ef2-9fe7-4aed-9eca-be1c6ad89fdd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:21.027107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b911387e-9175-428c-bc3c-59a6251f5ac9 req-d6210ef2-9fe7-4aed-9eca-be1c6ad89fdd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 943 time: 0.1495943 Dec 21 04:12:21.032813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=d17a7100-5218-4cde-a8fb-673cdcd2d747,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:21.064848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.078431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0d0c67f3-acef-494a-8eb8-fb6c9f131620 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:12:21.096746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b911387e-9175-428c-bc3c-59a6251f5ac9 req-0289e15d-d6a4-447e-9039-676f599f8636 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601966 Dec 21 04:12:21.228873 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.239502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:21.255857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '0d0c67f3-acef-494a-8eb8-fb6c9f131620', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': '0d0c67f3-acef-494a-8eb8-fb6c9f131620', 'mac_address': 'fa:16:3e:f5:b0:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:12:21.307724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.338682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d0c67f3-acef-494a-8eb8-fb6c9f131620 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:12:21.377008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:21.407673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.416649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=ac29ae09-52b0-488f-b26d-192e6156b786,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:21.445581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting port 91812046-0fc0-43ea-b1b3-ae568965aeaf {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:21.446034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.487625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.587456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0d0c67f3-acef-494a-8eb8-fb6c9f131620,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:21.592857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-648ab3ce-8d65-4e7f-b769-73fb3f9b36ab None None] Provisioning complete for port d17a7100-5218-4cde-a8fb-673cdcd2d747 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:21.593363 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-648ab3ce-8d65-4e7f-b769-73fb3f9b36ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.623104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.642693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 4a466f04-c248-434e-bdc2-339c1c621793 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:21.643734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Calling delete_port for 91812046-0fc0-43ea-b1b3-ae568965aeaf owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:21.646096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:21.749063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-648ab3ce-8d65-4e7f-b769-73fb3f9b36ab None None] Provisioning complete for port ac29ae09-52b0-488f-b26d-192e6156b786 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:21.749265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-648ab3ce-8d65-4e7f-b769-73fb3f9b36ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:21.795954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-648ab3ce-8d65-4e7f-b769-73fb3f9b36ab None None] Port ac29ae09-52b0-488f-b26d-192e6156b786 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:21.832625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0d0c67f3-acef-494a-8eb8-fb6c9f131620'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:21.942457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2be897fb-0952-4001-b623-f12f5b3068ed None None] Provisioning complete for port ac29ae09-52b0-488f-b26d-192e6156b786 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:21.942831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2be897fb-0952-4001-b623-f12f5b3068ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.002419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2be897fb-0952-4001-b623-f12f5b3068ed None None] Port ac29ae09-52b0-488f-b26d-192e6156b786 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:22.017918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:12:22.080041 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.138471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e522c553-8072-4342-8415-05064d4589f4 None None] Provisioning complete for port ac29ae09-52b0-488f-b26d-192e6156b786 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:22.138975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e522c553-8072-4342-8415-05064d4589f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.146266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Port': ['ID=91812046-0fc0-43ea-b1b3-ae568965aeaf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:22.170755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d17a7100-5218-4cde-a8fb-673cdcd2d747 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:22.178219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9b4402a-a820-43af-a33b-aa88fdb6a33b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:22.215782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:22.222446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e522c553-8072-4342-8415-05064d4589f4 None None] Port ac29ae09-52b0-488f-b26d-192e6156b786 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:22.223658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-86c99510-d113-4cd7-b3c0-d9899b818a09 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2770097 Dec 21 04:12:22.230102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58466) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:22.238976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-1293724289'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:22.247299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:22.261676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d17a7100-5218-4cde-a8fb-673cdcd2d747 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:22.262032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.269988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:22.271204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:11:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:22.283119 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.320686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9d682b8-3736-4883-910b-644d876f4e4d req-dcd4a232-259b-4626-ae15-619db2d6850a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:22.322369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9d682b8-3736-4883-910b-644d876f4e4d req-dcd4a232-259b-4626-ae15-619db2d6850a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 944 time: 0.1352799 Dec 21 04:12:22.341496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:22.345625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.395004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:22.403972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.406566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.408298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.408453 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment 53dd575a-3634-44ba-afbc-03f91a4ad602 of type vlan for network 5fa7301d-285e-442e-a2d1-e29285bf70fd Dec 21 04:12:22.409007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:22.470744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.488281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9d682b8-3736-4883-910b-644d876f4e4d req-c4841d62-a833-4a01-ba74-6f0bf95693a4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1309977 Dec 21 04:12:22.583653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.584318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Fanout notify agent at l3_agent the message router_deleted on router cf2225cf-4f0b-443b-9a3c-aa855d47746d {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:12:22.599215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.599215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2838a9f7-8f2a-43de-ad1a-5cff0a5c1233 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "DELETE /v2.0/routers/cf2225cf-4f0b-443b-9a3c-aa855d47746d HTTP/1.1" status: 204 len: 168 time: 2.0594273 Dec 21 04:12:22.599215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:22.624579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.642963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:22.643649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.666302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting subnet 19f235b3-88a3-4d45-a06a-92ac7f8a098a {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:12:22.670904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.691663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac76d65f-031b-4431-b7b4-a4417ec7cb09 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.724025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.776314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=5fa7301d-285e-442e-a2d1-e29285bf70fd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:22.802419 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.5711441 Dec 21 04:12:22.805231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58482) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:22.812085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.814723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.815368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.815368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.815767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.816234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.816569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc7927b2-3112-44e3-ba75-1a61fbd89074 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:22.822305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:22.832352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:22.859296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:20Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:20Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:22.897758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:22.898118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Updating router 3629bfb8-c770-438f-a801-5c83107ae8bf port ac29ae09-52b0-488f-b26d-192e6156b786 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:12:22.929904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.966165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:22.973919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.089799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0d0c67f3-acef-494a-8eb8-fb6c9f131620 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:23.109676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:23.114684 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.217670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.265102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Subnet': ['ID=19f235b3-88a3-4d45-a06a-92ac7f8a098a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:23.273927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.280911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "DELETE /v2.0/subnets/19f235b3-88a3-4d45-a06a-92ac7f8a098a HTTP/1.1" status: 204 len: 168 time: 0.6809001 Dec 21 04:12:23.281196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:23.289890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34f9a756-0e0d-4864-83c6-1ff855e8db9b None None] Network afe4c803-825e-400a-805d-d2c790175de5 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:23.317327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.317931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.318471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.318969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.319884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.319884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.320066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:12:23.320148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.320148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.320479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.320809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.321152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.321475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.321958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15ef98e2-a89b-4eb5-9b83-ff7d2c19cddc tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:23.341326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:23.341691 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.382286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.443461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting port b97d9060-e34c-4fee-94a9-44c29baf2038 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:23.443997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.476630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.482415 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.588023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.588126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] For port b97d9060-e34c-4fee-94a9-44c29baf2038, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b97d9060-e34c-4fee-94a9-44c29baf2038,segment=NetworkSegment(773fff78-ab7e-470c-a294-55721ed9db6b),segment_id=773fff78-ab7e-470c-a294-55721ed9db6b)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:23.588126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.592734 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.694249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Calling delete_port for b97d9060-e34c-4fee-94a9-44c29baf2038 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:23.753508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] DHCP port deletion for afe4c803-825e-400a-805d-d2c790175de5 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:23.810807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=005dd663-df91-429f-a13b-31158a0a285c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:23.851399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:23.923186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:23.946230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66bd1716-5002-4609-b8aa-bf652142bb16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d0c67f3-acef-494a-8eb8-fb6c9f131620'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:23.949395 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62fea2b0-38cb-4672-b095-e7ee303ccd03" -d '{"events": [{"server_uuid": "66bd1716-5002-4609-b8aa-bf652142bb16", "name": "network-vif-plugged", "status": "completed", "tag": "0d0c67f3-acef-494a-8eb8-fb6c9f131620"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:23.964480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:23.965211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: 5fa7301d-285e-442e-a2d1-e29285bf70fd, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:23.978355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54aa727b-5395-4354-b8af-dd54fe194776 req-123928e1-bd13-4c65-85e4-79f42f20dc7e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:23.979954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54aa727b-5395-4354-b8af-dd54fe194776 req-123928e1-bd13-4c65-85e4-79f42f20dc7e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 944 time: 0.1583123 Dec 21 04:12:23.982639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d74963-f826-484c-97d8-86610554f7d8 None None] Pushing event updated for resources: {'Port': ['ID=ac29ae09-52b0-488f-b26d-192e6156b786,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:24.012693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58522) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:24.018014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.045473 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9609a299-5932-4379-9f45-07ecd008a760 x-openstack-request-id: req-9609a299-5932-4379-9f45-07ecd008a760 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:24.051433 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66bd1716-5002-4609-b8aa-bf652142bb16", "name": "network-vif-plugged", "status": "completed", "tag": "0d0c67f3-acef-494a-8eb8-fb6c9f131620", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:24.051784 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9609a299-5932-4379-9f45-07ecd008a760 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:24.052212 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66bd1716-5002-4609-b8aa-bf652142bb16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d0c67f3-acef-494a-8eb8-fb6c9f131620', 'code': 200} Dec 21 04:12:24.060290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54aa727b-5395-4354-b8af-dd54fe194776 req-aa4459f3-8306-4577-bc18-2642fc4817de tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712531 Dec 21 04:12:24.068548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Port': ['ID=b97d9060-e34c-4fee-94a9-44c29baf2038,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:24.072416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.083905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] No DVR routers for this DVR port b97d9060-e34c-4fee-94a9-44c29baf2038 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:24.090359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Attempting to bind port ac29ae09-52b0-488f-b26d-192e6156b786 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:24.091050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Attempting to bind port ac29ae09-52b0-488f-b26d-192e6156b786 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:24.091572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Attempting to bind port ac29ae09-52b0-488f-b26d-192e6156b786 on network 4a466f04-c248-434e-bdc2-339c1c621793 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:24.097795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:24.184626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5fa7301d-285e-442e-a2d1-e29285bf70fd) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:24.191047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:24.191659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.258749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0d0c67f3-acef-494a-8eb8-fb6c9f131620,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:24.269719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9557885d-216d-42dc-8a3b-c9888306bfa1 None None] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:24.272013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b97d9060-e34c-4fee-94a9-44c29baf2038 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:24.274772 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.296024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ce16113-5ad8-4519-938c-4287b10602c8 req-74122d0c-0507-4b0d-8948-39bb2797d676 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:24.297075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a7992f3-603e-44d6-b7b4-5c902b7e6066 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.298494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5ce16113-5ad8-4519-938c-4287b10602c8 req-74122d0c-0507-4b0d-8948-39bb2797d676 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 1097 time: 0.1431491 Dec 21 04:12:24.328884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['afe4c803-825e-400a-805d-d2c790175de5']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:24.345076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c347128f-90b8-425f-bec3-015c0cd5bed9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5363069 Dec 21 04:12:24.348010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58530) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:24.385031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '773fff78-ab7e-470c-a294-55721ed9db6b') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:24.386460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '773fff78-ab7e-470c-a294-55721ed9db6b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:24.389693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 11, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:24.390208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Checking segment: {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:24.390482 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.391025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Bound using segment: {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:24.391557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Bound port: ac29ae09-52b0-488f-b26d-192e6156b786, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d5412fb-6f7b-4f5e-befe-538f4e4cf136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:24.392597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.395640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Deleting port b97d9060-e34c-4fee-94a9-44c29baf2038 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:24.396007 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.425820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.468139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.479535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:24.480008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:24.484812 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:24.499332 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5ce16113-5ad8-4519-938c-4287b10602c8 req-19285b0a-c824-4e1c-9408-6cac90eeca88 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1922927 Dec 21 04:12:24.630351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b97d9060-e34c-4fee-94a9-44c29baf2038 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:24.630779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b97d9060-e34c-4fee-94a9-44c29baf2038 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:24.635581 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.650663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.656519 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "DELETE /v2.0/networks/afe4c803-825e-400a-805d-d2c790175de5 HTTP/1.1" status: 204 len: 168 time: 1.3737042 Dec 21 04:12:24.660089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58534) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:24.671916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e437b5d-ec3a-4033-b76b-ca508a5aca73 tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Network': ['ID=afe4c803-825e-400a-805d-d2c790175de5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:24.687638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a7992f3-603e-44d6-b7b4-5c902b7e6066 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.688292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d337eb55-d171-4ba9-8078-8944d0429f87 None None] Provisioning complete for port ac29ae09-52b0-488f-b26d-192e6156b786 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:24.688885 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d337eb55-d171-4ba9-8078-8944d0429f87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.740714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5fa7301d-285e-442e-a2d1-e29285bf70fd', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:12:24.741586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.819263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] For port b97d9060-e34c-4fee-94a9-44c29baf2038, host n-d-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:24.819717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.832509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a7992f3-603e-44d6-b7b4-5c902b7e6066 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.895777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d337eb55-d171-4ba9-8078-8944d0429f87 None None] Port ac29ae09-52b0-488f-b26d-192e6156b786 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:24.903625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Calling delete_port for b97d9060-e34c-4fee-94a9-44c29baf2038 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:24.919925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.ipam_backend_mixin [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Port b97d9060-e34c-4fee-94a9-44c29baf2038 was not found and therefore no delete operation was performed {{(pid=110312) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:12:24.930290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] For port ac29ae09-52b0-488f-b26d-192e6156b786, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:24.932800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:24.935939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] For port ac29ae09-52b0-488f-b26d-192e6156b786, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac29ae09-52b0-488f-b26d-192e6156b786,segment=NetworkSegment(6d5412fb-6f7b-4f5e-befe-538f4e4cf136),segment_id=6d5412fb-6f7b-4f5e-befe-538f4e4cf136)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:24.958970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:24.960376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4a7992f3-603e-44d6-b7b4-5c902b7e6066 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9e52f41489a344b9bac088214ff1a4f0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9424810 Dec 21 04:12:24.961447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7992f3-603e-44d6-b7b4-5c902b7e6066 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f382a273-837d-4a40-95b5-83844b47d0d4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:24.970225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Network afe4c803-825e-400a-805d-d2c790175de5 is not hosted by any dhcp agent {{(pid=110312) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 04:12:24.970225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] No DVR routers for this DVR port b97d9060-e34c-4fee-94a9-44c29baf2038 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:25.010629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.011720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba89bcd-0858-4862-9ef4-2288855c7c17 None None] Pushing event deleted for resources: {'Port': ['ID=b97d9060-e34c-4fee-94a9-44c29baf2038,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:25.032143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.049789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Allocated IP 172.21.0.2 (5fa7301d-285e-442e-a2d1-e29285bf70fd/005dd663-df91-429f-a13b-31158a0a285c/f08e14d5-abdd-4327-b679-b1f54050b201) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:25.053228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Deleting port 403ac968-f129-4407-9043-dbe1d949edec {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:25.053686 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.098386 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed09a54a-72ca-48c0-8101-b4eaa5e005e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.123565 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed09a54a-72ca-48c0-8101-b4eaa5e005e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.159667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.188549 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.244814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:25.245485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:25.284980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d74963-f826-484c-97d8-86610554f7d8 None None] Pushing event updated for resources: {'Port': ['ID=ac29ae09-52b0-488f-b26d-192e6156b786,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:25.331853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed09a54a-72ca-48c0-8101-b4eaa5e005e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.338233 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed09a54a-72ca-48c0-8101-b4eaa5e005e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.340633 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ed09a54a-72ca-48c0-8101-b4eaa5e005e3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f382a273-837d-4a40-95b5-83844b47d0d4 HTTP/1.1" status: 204 len: 168 time: 0.3804216 Dec 21 04:12:25.352438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed09a54a-72ca-48c0-8101-b4eaa5e005e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f382a273-837d-4a40-95b5-83844b47d0d4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:25.353071 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.353563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.404605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Calling delete_port for 403ac968-f129-4407-9043-dbe1d949edec owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:25.421718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:25.488167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.542452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d139f-4b1d-474d-ae51-32eda14997ee req-af9539fc-5088-4cd2-9cec-ba62f6919daa tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:25.544986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f0d139f-4b1d-474d-ae51-32eda14997ee req-af9539fc-5088-4cd2-9cec-ba62f6919daa tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 945 time: 0.3520255 Dec 21 04:12:25.568091 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.653195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-035a4680-fdc2-4d98-b4b9-07b1fe1f363a None None] Provisioning complete for port ac29ae09-52b0-488f-b26d-192e6156b786 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:25.653501 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035a4680-fdc2-4d98-b4b9-07b1fe1f363a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.725194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:25.750697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:25.757096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Pushing event updated for resources: {'Port': ['ID=f08e14d5-abdd-4327-b679-b1f54050b201,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:25.760505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:25.919792 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.930501 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Attempting to bind port f08e14d5-abdd-4327-b679-b1f54050b201 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:25.932160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Attempting to bind port f08e14d5-abdd-4327-b679-b1f54050b201 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:25.932619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Attempting to bind port f08e14d5-abdd-4327-b679-b1f54050b201 on network 5fa7301d-285e-442e-a2d1-e29285bf70fd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:25.946306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:25.946887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Checking segment: {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:25.947452 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.948655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Bound using segment: {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:25.948655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Bound port: f08e14d5-abdd-4327-b679-b1f54050b201, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:25.949010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:25.976515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035a4680-fdc2-4d98-b4b9-07b1fe1f363a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.084799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-035a4680-fdc2-4d98-b4b9-07b1fe1f363a None None] For port ac29ae09-52b0-488f-b26d-192e6156b786, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac29ae09-52b0-488f-b26d-192e6156b786,segment=NetworkSegment(6d5412fb-6f7b-4f5e-befe-538f4e4cf136),segment_id=6d5412fb-6f7b-4f5e-befe-538f4e4cf136)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:26.089155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:20Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:24Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:26.204464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-035a4680-fdc2-4d98-b4b9-07b1fe1f363a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.265476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b702b611-8e1f-4bac-b58f-1172be3e6bf3 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:20Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:24Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:26.278855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035a4680-fdc2-4d98-b4b9-07b1fe1f363a None None] Pushing event updated for resources: {'Port': ['ID=ac29ae09-52b0-488f-b26d-192e6156b786,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:26.284797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] For port f08e14d5-abdd-4327-b679-b1f54050b201, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:26.293650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.21.0.1 (5fa7301d-285e-442e-a2d1-e29285bf70fd/005dd663-df91-429f-a13b-31158a0a285c/baf6293a-aeab-4622-816d-b2c0b303bb91) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:26.302240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] For port f08e14d5-abdd-4327-b679-b1f54050b201, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f08e14d5-abdd-4327-b679-b1f54050b201,segment=NetworkSegment(53dd575a-3634-44ba-afbc-03f91a4ad602),segment_id=53dd575a-3634-44ba-afbc-03f91a4ad602)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:26.357995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:26.379495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-425bf752-d28b-40c6-af6e-396bcbeba1fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.384718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.441957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f0d139f-4b1d-474d-ae51-32eda14997ee req-ef4f04fc-8b48-437f-94dd-ff61a801ce00 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8875470 Dec 21 04:12:26.455509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Pushing event updated for resources: {'Port': ['ID=f08e14d5-abdd-4327-b679-b1f54050b201,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:26.467831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.468196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.468543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.468886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.469219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.469558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.470052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.470373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.470702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.471088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.471418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.471741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.472061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22697356-5778-48bb-894b-3dc024e0fcc0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:26.536401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.580644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-425bf752-d28b-40c6-af6e-396bcbeba1fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.610194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.666468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Pushing event deleted for resources: {'Port': ['ID=403ac968-f129-4407-9043-dbe1d949edec,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:26.691147 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-425bf752-d28b-40c6-af6e-396bcbeba1fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.723548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.774794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-425bf752-d28b-40c6-af6e-396bcbeba1fa admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=76160ee3d2b74ec6915780731af7febc&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4153752 Dec 21 04:12:26.778301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58576) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:26.812182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425bf752-d28b-40c6-af6e-396bcbeba1fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d37254b-f8a8-45d2-a013-85fd456f1a5c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:26.864687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=baf6293a-aeab-4622-816d-b2c0b303bb91,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:26.932745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:26.943430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:26.947552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:26.982799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2498e89f-6622-4cbf-9337-d4154346aebd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.989747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:26.992408 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.029746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2498e89f-6622-4cbf-9337-d4154346aebd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.038250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d4ab3134-983d-4666-aab7-0595ab178dde tempest-FloatingIPAdminTestJSON-935495528 tempest-FloatingIPAdminTestJSON-935495528-project] 10.222.0.18 "DELETE /v2.0/floatingips/c3f29fbe-f477-45cc-ad63-896c4413206b HTTP/1.1" status: 204 len: 168 time: 2.3736076 Dec 21 04:12:27.092729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.203707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2498e89f-6622-4cbf-9337-d4154346aebd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.209601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2498e89f-6622-4cbf-9337-d4154346aebd admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.213044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2498e89f-6622-4cbf-9337-d4154346aebd admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6d37254b-f8a8-45d2-a013-85fd456f1a5c HTTP/1.1" status: 204 len: 168 time: 0.4263353 Dec 21 04:12:27.277320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2498e89f-6622-4cbf-9337-d4154346aebd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d37254b-f8a8-45d2-a013-85fd456f1a5c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:27.353816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.692528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b6c121-0f60-4b4a-a255-8a079c8694d3 req-e920248d-63f7-4b3c-8df1-1486b56555ab tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:27.702172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4b6c121-0f60-4b4a-a255-8a079c8694d3 req-e920248d-63f7-4b3c-8df1-1486b56555ab tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 945 time: 0.1259487 Dec 21 04:12:27.848988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:27.866645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58602) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:27.918518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4b6c121-0f60-4b4a-a255-8a079c8694d3 req-5a15d982-d46d-41e8-b01e-b16a4cfe6058 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2150898 Dec 21 04:12:27.931725 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.143166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=baf6293a-aeab-4622-816d-b2c0b303bb91,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:28.168971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.181164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e02f5aa-9f2d-4617-9071-aac32c05baba None None] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:28.216173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7ce6cc12-e84b-4b2c-bd2c-10b5da9357e4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0a05bb257a044d579207fa18fa0c4a24&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3477168 Dec 21 04:12:28.216806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58616) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:28.335128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550d5203-ae9e-4844-9a1a-94120c8332a5 req-6fa78fe2-f808-40a0-bd2a-a22a0ffc8db0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:28.345162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b190458-766b-4e1f-8fae-09c1fcf5695f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.362626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-550d5203-ae9e-4844-9a1a-94120c8332a5 req-6fa78fe2-f808-40a0-bd2a-a22a0ffc8db0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.2887979 Dec 21 04:12:28.377394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b190458-766b-4e1f-8fae-09c1fcf5695f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.437774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-90008920-4075-4ca7-9480-7df222eb2569 None None] Provisioning complete for port f08e14d5-abdd-4327-b679-b1f54050b201 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:28.439560 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90008920-4075-4ca7-9480-7df222eb2569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.581384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:28.610127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-550d5203-ae9e-4844-9a1a-94120c8332a5 req-dbcc0a03-a519-43d9-a88e-c28ccea2f82b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2466116 Dec 21 04:12:28.611389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:28.617903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b190458-766b-4e1f-8fae-09c1fcf5695f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.625247 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b190458-766b-4e1f-8fae-09c1fcf5695f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:28.627459 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b190458-766b-4e1f-8fae-09c1fcf5695f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f3286f61-c262-42ca-995e-8d0f237eb25e HTTP/1.1" status: 204 len: 168 time: 0.4094191 Dec 21 04:12:28.654082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b190458-766b-4e1f-8fae-09c1fcf5695f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3286f61-c262-42ca-995e-8d0f237eb25e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:28.840337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac29ae09-52b0-488f-b26d-192e6156b786 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:28.869920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:28.903652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfe7429-49cd-49d3-ab79-a5039dd6c769 req-f838f83c-7746-40bf-bbc0-501de2da587b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:28.908534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bfe7429-49cd-49d3-ab79-a5039dd6c769 req-f838f83c-7746-40bf-bbc0-501de2da587b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 945 time: 0.1182797 Dec 21 04:12:29.103481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ac29ae09-52b0-488f-b26d-192e6156b786 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:29.103857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.119341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90008920-4075-4ca7-9480-7df222eb2569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.164542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6bfe7429-49cd-49d3-ab79-a5039dd6c769 req-3ea1c4b4-963f-43f4-9adc-4bec67e84e5a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2486520 Dec 21 04:12:29.166370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:29.176240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-40efa14f-6478-46d9-87aa-d1442165aec0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8268521 Dec 21 04:12:29.179428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:29.186788 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:29.194527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-554158933'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:29.232192 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:29.233059 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:29.254011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-90008920-4075-4ca7-9480-7df222eb2569 None None] For port f08e14d5-abdd-4327-b679-b1f54050b201, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f08e14d5-abdd-4327-b679-b1f54050b201,segment=NetworkSegment(53dd575a-3634-44ba-afbc-03f91a4ad602),segment_id=53dd575a-3634-44ba-afbc-03f91a4ad602)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:29.348998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90008920-4075-4ca7-9480-7df222eb2569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.366455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:29.370613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.425839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f08e14d5-abdd-4327-b679-b1f54050b201 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:29.435764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:29.450652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.473904 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment a07085e1-bc27-4287-9bad-f17ed98ccba4 of type vlan for network 859fbb50-1723-45c7-b0f5-30f550f70d94 Dec 21 04:12:29.503973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90008920-4075-4ca7-9480-7df222eb2569 None None] Pushing event updated for resources: {'Port': ['ID=f08e14d5-abdd-4327-b679-b1f54050b201,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:29.513284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-310dae85-00f0-4646-a0ef-b41de7f382e2 None None] Provisioning complete for port baf6293a-aeab-4622-816d-b2c0b303bb91 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:29.514625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-310dae85-00f0-4646-a0ef-b41de7f382e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.565538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-310dae85-00f0-4646-a0ef-b41de7f382e2 None None] Port baf6293a-aeab-4622-816d-b2c0b303bb91 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:29.569431 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:29.608337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f08e14d5-abdd-4327-b679-b1f54050b201 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:29.611670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.611811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.611998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-310dae85-00f0-4646-a0ef-b41de7f382e2 None None] Provisioning complete for port f08e14d5-abdd-4327-b679-b1f54050b201 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:29.612357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-310dae85-00f0-4646-a0ef-b41de7f382e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.758289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.771259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:29.772095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.870210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d9bd47-e607-45fb-ba62-ce0791f1aa28 req-e21bf1a8-0a13-42fd-882c-c7800a20cbe5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:29.879852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65d9bd47-e607-45fb-ba62-ce0791f1aa28 req-e21bf1a8-0a13-42fd-882c-c7800a20cbe5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 945 time: 0.1181595 Dec 21 04:12:29.906794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58662) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:29.954405 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-669e9081-6438-466a-b847-1d8666d975d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:29.970975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=859fbb50-1723-45c7-b0f5-30f550f70d94,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:29.995845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:30.013143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65d9bd47-e607-45fb-ba62-ce0791f1aa28 req-07ee00b7-26c8-4303-a888-7ec2f95e3baa tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1322811 Dec 21 04:12:30.015844 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:27Z', 'revision_number': 3, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:27Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:30.056766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0d241e20-c6b2-47bf-9b14-62e8e7113972 None None] Provisioning complete for port baf6293a-aeab-4622-816d-b2c0b303bb91 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:30.058965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d241e20-c6b2-47bf-9b14-62e8e7113972 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.070409 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-32ff06df-34fd-4e1e-8ef2-443788fe72a2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8832026 Dec 21 04:12:30.075837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:30.084014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:30.089516 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:30.090095 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Updating router 3629bfb8-c770-438f-a801-5c83107ae8bf port baf6293a-aeab-4622-816d-b2c0b303bb91 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:12:30.156164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0d241e20-c6b2-47bf-9b14-62e8e7113972 None None] Port baf6293a-aeab-4622-816d-b2c0b303bb91 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:30.187222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-669e9081-6438-466a-b847-1d8666d975d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.214239 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.261015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-669e9081-6438-466a-b847-1d8666d975d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.297394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f08e14d5-abdd-4327-b679-b1f54050b201 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:30.365375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669e9081-6438-466a-b847-1d8666d975d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=486a8bc9-c1bd-42df-b09b-ce4c5a7535a6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:30.411786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0748b823-3ca0-410e-9789-42c2ec9ea585 None None] Provisioning complete for port baf6293a-aeab-4622-816d-b2c0b303bb91 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:30.412429 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0748b823-3ca0-410e-9789-42c2ec9ea585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.440879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-669e9081-6438-466a-b847-1d8666d975d1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6a7e1c9d8f0c44679656d4ac24b4bf0f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5305538 Dec 21 04:12:30.442152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58682) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:30.455022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f08e14d5-abdd-4327-b679-b1f54050b201 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:30.455936 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.460423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0748b823-3ca0-410e-9789-42c2ec9ea585 None None] Port baf6293a-aeab-4622-816d-b2c0b303bb91 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:30.489653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:30.494034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.605279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5c5f652-2c77-49f8-a7f9-5726928446de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.646291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5c5f652-2c77-49f8-a7f9-5726928446de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.749840 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.914924 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:30.967060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Pushing event updated for resources: {'Port': ['ID=baf6293a-aeab-4622-816d-b2c0b303bb91,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:30.988054 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.988401 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.988742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.991330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.991330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.991330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.991330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.995035 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.995801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.996359 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.996906 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.997454 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:30.998361 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:12:31.011589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.014971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5c5f652-2c77-49f8-a7f9-5726928446de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.022458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5c5f652-2c77-49f8-a7f9-5726928446de admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.024620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e5c5f652-2c77-49f8-a7f9-5726928446de admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/486a8bc9-c1bd-42df-b09b-ce4c5a7535a6 HTTP/1.1" status: 204 len: 168 time: 0.5801477 Dec 21 04:12:31.085865 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Attempting to bind port baf6293a-aeab-4622-816d-b2c0b303bb91 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:31.086282 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Attempting to bind port baf6293a-aeab-4622-816d-b2c0b303bb91 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:31.088966 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Attempting to bind port baf6293a-aeab-4622-816d-b2c0b303bb91 on network 5fa7301d-285e-442e-a2d1-e29285bf70fd {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:31.094858 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:31.095617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Checking segment: {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:31.096164 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.096690 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Bound using segment: {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:31.097588 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Bound port: baf6293a-aeab-4622-816d-b2c0b303bb91, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '53dd575a-3634-44ba-afbc-03f91a4ad602', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:31.098296 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.195592 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] For port baf6293a-aeab-4622-816d-b2c0b303bb91, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:31.196408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=0fbde120-5987-49c0-b940-055555de26c4,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:31.201885 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] For port baf6293a-aeab-4622-816d-b2c0b303bb91, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=baf6293a-aeab-4622-816d-b2c0b303bb91,segment=NetworkSegment(53dd575a-3634-44ba-afbc-03f91a4ad602),segment_id=53dd575a-3634-44ba-afbc-03f91a4ad602)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:31.249934 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c5f652-2c77-49f8-a7f9-5726928446de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=486a8bc9-c1bd-42df-b09b-ce4c5a7535a6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:31.276787 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.282224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24c61ab-d79d-45c4-a93d-c31cea3d0078 req-0856ff6a-65fe-47b9-ac64-384d26514fbb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:31.295115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24c61ab-d79d-45c4-a93d-c31cea3d0078 req-0856ff6a-65fe-47b9-ac64-384d26514fbb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 945 time: 0.1187596 Dec 21 04:12:31.324253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:31.325468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: 859fbb50-1723-45c7-b0f5-30f550f70d94, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:31.357446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-8e758612-d03e-454d-add8-f6027e9cba01 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:31.360205 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-8e758612-d03e-454d-add8-f6027e9cba01 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 945 time: 0.1642542 Dec 21 04:12:31.390511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:31.396302 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:31.397638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e1189dd8-a07a-462b-bc82-48df1f43eb0f None None] Provisioning complete for port baf6293a-aeab-4622-816d-b2c0b303bb91 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:31.400627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e1189dd8-a07a-462b-bc82-48df1f43eb0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.465358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24c61ab-d79d-45c4-a93d-c31cea3d0078 req-41ad2cbb-fbad-4e6a-8af9-cfc471ff8608 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1648769 Dec 21 04:12:31.492507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:31.567211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e1189dd8-a07a-462b-bc82-48df1f43eb0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.579472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:31.580167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.583878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 859fbb50-1723-45c7-b0f5-30f550f70d94) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:31.607807 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:31.618101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d49d245b-a940-4756-9acd-e4cee5c4aced None None] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:31.633004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:31.633782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.716397 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75726c5-c004-49a8-9710-932435494fc7 None None] Pushing event updated for resources: {'Port': ['ID=baf6293a-aeab-4622-816d-b2c0b303bb91,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:31.755647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e1189dd8-a07a-462b-bc82-48df1f43eb0f None None] For port baf6293a-aeab-4622-816d-b2c0b303bb91, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=baf6293a-aeab-4622-816d-b2c0b303bb91,segment=NetworkSegment(53dd575a-3634-44ba-afbc-03f91a4ad602),segment_id=53dd575a-3634-44ba-afbc-03f91a4ad602)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:31.814826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e1189dd8-a07a-462b-bc82-48df1f43eb0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.816724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58720) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:31.832454 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-41813a21-d557-4823-9e80-71f316354c82 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7431986 Dec 21 04:12:31.888251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port 0d0c67f3-acef-494a-8eb8-fb6c9f131620, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0d0c67f3-acef-494a-8eb8-fb6c9f131620,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:31.889037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:31.908803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for 0d0c67f3-acef-494a-8eb8-fb6c9f131620 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:31.926758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1189dd8-a07a-462b-bc82-48df1f43eb0f None None] Pushing event updated for resources: {'Port': ['ID=baf6293a-aeab-4622-816d-b2c0b303bb91,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:31.984490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be641bda-2d86-46f0-8ba4-2a6b618fd1cf None None] Provisioning complete for port baf6293a-aeab-4622-816d-b2c0b303bb91 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:31.985041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be641bda-2d86-46f0-8ba4-2a6b618fd1cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.019679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-859fbb50-1723-45c7-b0f5-30f550f70d94', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:12:32.020965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.035893 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:27Z', 'revision_number': 3, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:32.096854 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4f61850-2d6c-409a-ad59-a0de8c92c962 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:27Z', 'revision_number': 3, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:32.278331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.341340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=0d0c67f3-acef-494a-8eb8-fb6c9f131620,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:32.354392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce', '0d0c67f3-acef-494a-8eb8-fb6c9f131620'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:32.357468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['bdd088da-f507-4663-8336-df5ac93e0140'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:32.432500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58730) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:32.463774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c35a7869-c503-4ec0-ad46-a55a9662fe83 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:32.466900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device baf6293a-aeab-4622-816d-b2c0b303bb91 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:32.479659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port 0d0c67f3-acef-494a-8eb8-fb6c9f131620 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:32.484140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.486956 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5888ffaf-fbd9-45ac-b186-fbbafd2f732e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.495670 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0823a481-da53-4bcf-8909-8acc5f0802d6 req-bfef4df1-8df1-4f3c-bc74-36872cebedbf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "DELETE /v2.0/ports/0d0c67f3-acef-494a-8eb8-fb6c9f131620 HTTP/1.1" status: 204 len: 173 time: 1.1289394 Dec 21 04:12:32.496200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66bd1716-5002-4609-b8aa-bf652142bb16', 'name': 'network-vif-deleted', 'tag': '0d0c67f3-acef-494a-8eb8-fb6c9f131620'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:32.498554 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ae1b8b9-b527-4022-8541-6f7698713272" -d '{"events": [{"server_uuid": "66bd1716-5002-4609-b8aa-bf652142bb16", "name": "network-vif-deleted", "tag": "0d0c67f3-acef-494a-8eb8-fb6c9f131620"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:32.609866 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-350bc86e-6f9d-4efe-b2c8-1287e9cd7bde x-openstack-request-id: req-350bc86e-6f9d-4efe-b2c8-1287e9cd7bde {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:32.611413 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66bd1716-5002-4609-b8aa-bf652142bb16", "name": "network-vif-deleted", "tag": "0d0c67f3-acef-494a-8eb8-fb6c9f131620", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:32.611813 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-350bc86e-6f9d-4efe-b2c8-1287e9cd7bde {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:32.612380 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66bd1716-5002-4609-b8aa-bf652142bb16', 'name': 'network-vif-deleted', 'tag': '0d0c67f3-acef-494a-8eb8-fb6c9f131620', 'status': 'completed', 'code': 200} Dec 21 04:12:32.681960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5888ffaf-fbd9-45ac-b186-fbbafd2f732e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.807822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15619a18-ec6f-40f1-8359-6b00e8610bfb req-52c95878-3084-4b8e-b198-0a0a7d3b52ab tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=66bd1716-5002-4609-b8aa-bf652142bb16 HTTP/1.1" status: 200 len: 210 time: 0.1041765 Dec 21 04:12:32.855905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5888ffaf-fbd9-45ac-b186-fbbafd2f732e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.890272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port baf6293a-aeab-4622-816d-b2c0b303bb91 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:32.890662 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:32.985006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Allocated IP 172.22.0.2 (859fbb50-1723-45c7-b0f5-30f550f70d94/0fbde120-5987-49c0-b940-055555de26c4/366763b6-3129-4d48-96a4-2161241da95b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:33.071111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5888ffaf-fbd9-45ac-b186-fbbafd2f732e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a48b31e-0b41-4312-9568-a1e077447758,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:33.084961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5888ffaf-fbd9-45ac-b186-fbbafd2f732e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d1b5c67e4e92414c9d9b9fc5aa295f1c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6485417 Dec 21 04:12:33.087184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58744) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:33.092340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.224474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da40402e-f29b-4750-9916-28143b932450 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.297950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da40402e-f29b-4750-9916-28143b932450 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.446474 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.515104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da40402e-f29b-4750-9916-28143b932450 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.523157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-da40402e-f29b-4750-9916-28143b932450 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.523157 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-da40402e-f29b-4750-9916-28143b932450 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2a48b31e-0b41-4312-9568-a1e077447758 HTTP/1.1" status: 204 len: 168 time: 0.4324112 Dec 21 04:12:33.532708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da40402e-f29b-4750-9916-28143b932450 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a48b31e-0b41-4312-9568-a1e077447758,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:33.583975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.682068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.22.0.1 (859fbb50-1723-45c7-b0f5-30f550f70d94/0fbde120-5987-49c0-b940-055555de26c4/7632db4c-82a1-4533-9a4b-648c31be7759) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:33.706909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:33.714052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:33.723846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:33.760897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Pushing event updated for resources: {'Port': ['ID=366763b6-3129-4d48-96a4-2161241da95b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:33.796962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Attempting to bind port 366763b6-3129-4d48-96a4-2161241da95b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:33.797340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Attempting to bind port 366763b6-3129-4d48-96a4-2161241da95b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:33.797720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Attempting to bind port 366763b6-3129-4d48-96a4-2161241da95b on network 859fbb50-1723-45c7-b0f5-30f550f70d94 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:33.807847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:33.808959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Checking segment: {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:33.809520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.809927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Bound using segment: {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:33.810411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Bound port: 366763b6-3129-4d48-96a4-2161241da95b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:33.810958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.837678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.911289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] For port 366763b6-3129-4d48-96a4-2161241da95b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:33.915157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] For port 366763b6-3129-4d48-96a4-2161241da95b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=366763b6-3129-4d48-96a4-2161241da95b,segment=NetworkSegment(a07085e1-bc27-4287-9bad-f17ed98ccba4),segment_id=a07085e1-bc27-4287-9bad-f17ed98ccba4)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:33.955159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:33.981269 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:34.019758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:34.023297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:34.029588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:34.058462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=7632db4c-82a1-4533-9a4b-648c31be7759,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:34.077352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01069bd6-b48c-4755-bc98-56507f9f8774 None None] Pushing event updated for resources: {'Port': ['ID=366763b6-3129-4d48-96a4-2161241da95b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:34.087503 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:34.395116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:34.660125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbff0932-320a-4dad-9cdf-7e5d901fc036 req-8d155f2d-765d-42c6-a6c6-9bd7691f1610 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:34.662228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbff0932-320a-4dad-9cdf-7e5d901fc036 req-8d155f2d-765d-42c6-a6c6-9bd7691f1610 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.1660097 Dec 21 04:12:34.804531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbff0932-320a-4dad-9cdf-7e5d901fc036 req-c2628dc4-001e-49e7-88c5-04f5b7fe9c94 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242785 Dec 21 04:12:34.870171 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:34.975087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.045782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=7632db4c-82a1-4533-9a4b-648c31be7759,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:35.050803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.098252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0d0c67f3-acef-494a-8eb8-fb6c9f131620 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:35.120826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 0d0c67f3-acef-494a-8eb8-fb6c9f131620 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:35.121878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0d0c67f3-acef-494a-8eb8-fb6c9f131620 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:35.227888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:35.227888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:35.261116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:35.262300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3897cdf6-4877-4ec2-9315-824db5f40013 None None] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:35.397330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:35.406525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8962213-174d-46cf-9523-f853fccc51f8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5862341 Dec 21 04:12:35.406787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58808) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:35.412400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'network': {'name': 'tempest-RoutersTest-1406429023'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:35.433491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:35.463321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8a5b9857-23db-47e7-a35e-7230702921ea None None] Provisioning complete for port 366763b6-3129-4d48-96a4-2161241da95b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:35.463696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a5b9857-23db-47e7-a35e-7230702921ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.501452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:35.502081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:35.608154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:35.615845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:35.626424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.678380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:35.697863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.698610 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added segment 0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38 of type vlan for network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc Dec 21 04:12:35.852906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.913669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a5b9857-23db-47e7-a35e-7230702921ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:35.989826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8a5b9857-23db-47e7-a35e-7230702921ea None None] For port 366763b6-3129-4d48-96a4-2161241da95b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=366763b6-3129-4d48-96a4-2161241da95b,segment=NetworkSegment(a07085e1-bc27-4287-9bad-f17ed98ccba4),segment_id=a07085e1-bc27-4287-9bad-f17ed98ccba4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:36.017969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:34Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:34Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:36.023738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:36.033402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:36.033833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:36.068901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:36.069380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Updating router 3629bfb8-c770-438f-a801-5c83107ae8bf port 7632db4c-82a1-4533-9a4b-648c31be7759 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:12:36.259606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-9b5ef76a-80f7-4094-97b1-520207b4abcd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:36.264296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-9b5ef76a-80f7-4094-97b1-520207b4abcd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.1234610 Dec 21 04:12:36.271901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Network': ['ID=4c270b79-e0d8-4e57-ba87-99a1e4ddaecc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:36.278852 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4b499793-cb8c-49e6-a034-44df50872387 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.8707938 Dec 21 04:12:36.283425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:36.295261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'subnet': {'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:36.592043 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:36.604330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:36.654637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Made reservation on behalf of d9899eda11e44c4bb33e28a84396d3d7 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:36.660340 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:36.718782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3a005d-71bc-4d03-bed0-6126e0be5d55 req-788a9b1f-ba74-4b1d-bef4-dcd9d8c0ac52 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:36.720266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e3a005d-71bc-4d03-bed0-6126e0be5d55 req-788a9b1f-ba74-4b1d-bef4-dcd9d8c0ac52 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 946 time: 0.7870309 Dec 21 04:12:36.782855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port bdd088da-f507-4663-8336-df5ac93e0140 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:36.783233 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:36.790219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 366763b6-3129-4d48-96a4-2161241da95b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:36.877930 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a5b9857-23db-47e7-a35e-7230702921ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.013889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e3a005d-71bc-4d03-bed0-6126e0be5d55 req-3e7f1f18-f5b9-4e95-9f9c-8aee283f5301 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2821970 Dec 21 04:12:37.030631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 366763b6-3129-4d48-96a4-2161241da95b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:37.031028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.042478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58848) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:37.093665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port bdd088da-f507-4663-8336-df5ac93e0140, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=bdd088da-f507-4663-8336-df5ac93e0140,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:37.094031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.108136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for bdd088da-f507-4663-8336-df5ac93e0140 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:37.234342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5b9857-23db-47e7-a35e-7230702921ea None None] Pushing event updated for resources: {'Port': ['ID=366763b6-3129-4d48-96a4-2161241da95b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:37.254507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-45e323b9-0275-4df2-8a80-e50aff72e5b1 None None] Provisioning complete for port 366763b6-3129-4d48-96a4-2161241da95b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:37.255106 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-45e323b9-0275-4df2-8a80-e50aff72e5b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.312685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.430854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Subnet': ['ID=a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:37.538645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Checking segment: {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:37.540075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network hostable DHCP agents. Network: 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:37.698642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:37.801617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:37.810048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-167233298'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:37.813471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:37.814222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.826978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f3dc597-8d74-4963-89a1-fa3d090b08d7 None None] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:37.871763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-45e323b9-0275-4df2-8a80-e50aff72e5b1 None None] Provisioning complete for port 7632db4c-82a1-4533-9a4b-648c31be7759 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:37.872328 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-45e323b9-0275-4df2-8a80-e50aff72e5b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:37.948701 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-13f39446-0083-4124-9901-5a41550acf81 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6630723 Dec 21 04:12:37.950448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:37.952558 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.034660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-45e323b9-0275-4df2-8a80-e50aff72e5b1 None None] Port 7632db4c-82a1-4533-9a4b-648c31be7759 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:38.084256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.108555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Made reservation on behalf of a607239f70a14364b789808afbcc8580 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:38.116138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.192376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.351402 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.393290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 366763b6-3129-4d48-96a4-2161241da95b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:38.436284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=bdd088da-f507-4663-8336-df5ac93e0140,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:38.470602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:12:38.471513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.529075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:38.569987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1a4f9dd-df43-471b-a881-5e4d39a34d05 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:38.576540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port bdd088da-f507-4663-8336-df5ac93e0140 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:38.589492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83cab08c-c6d0-45cd-92ad-eea2e9f97137 req-107f7921-1052-4f85-89e6-857b7e690016 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:38.591333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83cab08c-c6d0-45cd-92ad-eea2e9f97137 req-107f7921-1052-4f85-89e6-857b7e690016 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 867 time: 0.3391716 Dec 21 04:12:38.592510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.595942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b2cd033-e376-42c1-80d6-e79ae0b3c6a4 req-77989e7e-fd3e-472d-a680-4acc95da8c62 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "DELETE /v2.0/ports/bdd088da-f507-4663-8336-df5ac93e0140 HTTP/1.1" status: 204 len: 173 time: 2.3200080 Dec 21 04:12:38.597716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'name': 'network-vif-deleted', 'tag': 'bdd088da-f507-4663-8336-df5ac93e0140'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:38.600046 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5c314bb-7692-48a7-9cbf-9d769a464710" -d '{"events": [{"server_uuid": "56024bb9-3b76-4818-b87e-7d7da9b0dd68", "name": "network-vif-deleted", "tag": "bdd088da-f507-4663-8336-df5ac93e0140"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:38.727933 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efb899da-8312-4fd1-b35b-8fc30b6f2630 x-openstack-request-id: req-efb899da-8312-4fd1-b35b-8fc30b6f2630 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:38.727933 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "56024bb9-3b76-4818-b87e-7d7da9b0dd68", "name": "network-vif-deleted", "tag": "bdd088da-f507-4663-8336-df5ac93e0140", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:38.727933 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-efb899da-8312-4fd1-b35b-8fc30b6f2630 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:38.727933 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '56024bb9-3b76-4818-b87e-7d7da9b0dd68', 'name': 'network-vif-deleted', 'tag': 'bdd088da-f507-4663-8336-df5ac93e0140', 'status': 'completed', 'code': 200} Dec 21 04:12:38.732995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb6b4fa1-f68a-47bf-8754-bbada8ff0934 None None] Pushing event updated for resources: {'Port': ['ID=7632db4c-82a1-4533-9a4b-648c31be7759,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:38.785715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83cab08c-c6d0-45cd-92ad-eea2e9f97137 req-20edad54-f4dd-481e-9dfe-f70d1a62ad25 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1734185 Dec 21 04:12:38.834671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.871668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 366763b6-3129-4d48-96a4-2161241da95b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:38.872211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.904278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.924742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Attempting to bind port 7632db4c-82a1-4533-9a4b-648c31be7759 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:38.925141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Attempting to bind port 7632db4c-82a1-4533-9a4b-648c31be7759 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:38.925511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Attempting to bind port 7632db4c-82a1-4533-9a4b-648c31be7759 on network 859fbb50-1723-45c7-b0f5-30f550f70d94 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:38.935456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:38.935707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Checking segment: {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:38.936010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.936415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Bound using segment: {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:38.936915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Bound port: 7632db4c-82a1-4533-9a4b-648c31be7759, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a07085e1-bc27-4287-9bad-f17ed98ccba4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:38.937305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.960919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:38.974675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] vlan segment allocate from pool success with {'vlan_id': 132, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:12:39.010316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.011120 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Added segment f5087f4d-ae41-41bb-b5f4-eda8ba9ca281 of type vlan for network 633403af-786b-4534-a84c-278f36e235f3 Dec 21 04:12:39.117583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-65ef2c6b-c3ee-4b88-b922-0dc33eb3858e None None] Provisioning complete for port 7632db4c-82a1-4533-9a4b-648c31be7759 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:39.117583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-65ef2c6b-c3ee-4b88-b922-0dc33eb3858e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.143076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Allocated IP 172.23.0.2 (4c270b79-e0d8-4e57-ba87-99a1e4ddaecc/a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666/bda3933e-09e2-4129-9cdf-6478bf048b99) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:39.164543 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.170819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5dd927f-db52-4958-93cf-9134828bac32,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:39.280262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.286798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:39.287731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.369346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Pushing event updated for resources: {'Network': ['ID=633403af-786b-4534-a84c-278f36e235f3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:39.395641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 633403af-786b-4534-a84c-278f36e235f3 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:12:39.422053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] For port 7632db4c-82a1-4533-9a4b-648c31be7759, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:39.425702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8d9613b9-20f3-4748-ba44-453f1a71e4db tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 802 time: 2.3814974 Dec 21 04:12:39.497031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] For port 7632db4c-82a1-4533-9a4b-648c31be7759, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7632db4c-82a1-4533-9a4b-648c31be7759,segment=NetworkSegment(a07085e1-bc27-4287-9bad-f17ed98ccba4),segment_id=a07085e1-bc27-4287-9bad-f17ed98ccba4)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:39.501885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-65ef2c6b-c3ee-4b88-b922-0dc33eb3858e None None] Port 7632db4c-82a1-4533-9a4b-648c31be7759 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:39.532701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device bdd088da-f507-4663-8336-df5ac93e0140 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:39.579676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: bdd088da-f507-4663-8336-df5ac93e0140 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:39.585289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device bdd088da-f507-4663-8336-df5ac93e0140 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:39.588908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.621330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.686923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:39.692054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:39.754902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.784417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:39.791581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Request body: {'port': {'network_id': '633403af-786b-4534-a84c-278f36e235f3', 'binding:host_id': 'n-h1-822053-11', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-313231167'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:39.875719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb6b4fa1-f68a-47bf-8754-bbada8ff0934 None None] Pushing event updated for resources: {'Port': ['ID=7632db4c-82a1-4533-9a4b-648c31be7759,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:39.920000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:39.942528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Made reservation on behalf of a25c637b9d0d4f48be7c083f33aeb52c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:39.942528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.948711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Allocated IP 172.23.0.1 (4c270b79-e0d8-4e57-ba87-99a1e4ddaecc/a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666/1630c0d5-6021-4461-b8e4-96fc1f3a2418) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:39.954171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:39.955789 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:39.994405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:40.076160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:40.186376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.244454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1c216e2-e922-4bdf-8927-b9bd7d35f9f1 req-b6538335-ae07-4ad9-acad-69b7845ec079 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=56024bb9-3b76-4818-b87e-7d7da9b0dd68 HTTP/1.1" status: 200 len: 210 time: 0.2106557 Dec 21 04:12:40.257198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.264013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:40.265939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.385369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=299cdfb5-9a2e-4b4b-bbbc-76180cb124a0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:40.422916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Pushing event updated for resources: {'Port': ['ID=bda3933e-09e2-4129-9cdf-6478bf048b99,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:40.443760 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.474513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Attempting to bind port bda3933e-09e2-4129-9cdf-6478bf048b99 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:40.475194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Attempting to bind port bda3933e-09e2-4129-9cdf-6478bf048b99 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:40.475720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Attempting to bind port bda3933e-09e2-4129-9cdf-6478bf048b99 on network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:40.488719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:40.489347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Checking segment: {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:40.489929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.490471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Bound using segment: {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:40.491134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Bound port: bda3933e-09e2-4129-9cdf-6478bf048b99, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:40.491673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.531622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4cbb9167-3a3d-4f27-8a5a-72e566b727fb None None] Provisioning complete for port 7632db4c-82a1-4533-9a4b-648c31be7759 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:40.532224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cbb9167-3a3d-4f27-8a5a-72e566b727fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.543625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:40.559588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:40.608411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:40.629006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=1630c0d5-6021-4461-b8e4-96fc1f3a2418,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:40.715334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:40.733343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] For port bda3933e-09e2-4129-9cdf-6478bf048b99, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:40.744387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.754205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.762284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] For port bda3933e-09e2-4129-9cdf-6478bf048b99, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bda3933e-09e2-4129-9cdf-6478bf048b99,segment=NetworkSegment(0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38),segment_id=0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:40.827418 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cbb9167-3a3d-4f27-8a5a-72e566b727fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.847069 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.880137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cbb9167-3a3d-4f27-8a5a-72e566b727fb None None] For port 7632db4c-82a1-4533-9a4b-648c31be7759, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7632db4c-82a1-4533-9a4b-648c31be7759,segment=NetworkSegment(a07085e1-bc27-4287-9bad-f17ed98ccba4),segment_id=a07085e1-bc27-4287-9bad-f17ed98ccba4)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:40.882206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:40.887879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:34Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:39Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:40.960319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce320687-bcea-468a-99b6-3531d96adfab None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:34Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:39Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:40.967713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=37f93e7f-b9fc-4a68-9a15-9c5e826df90f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:41.010536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cbb9167-3a3d-4f27-8a5a-72e566b727fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:41.013082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad50436-840c-4145-89ad-d73ee38e6110 None None] Pushing event updated for resources: {'Port': ['ID=bda3933e-09e2-4129-9cdf-6478bf048b99,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:41.065115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Checking segment: {'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:41.066130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Network hostable DHCP agents. Network: 633403af-786b-4534-a84c-278f36e235f3, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:12:41.098842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:41.164977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cbb9167-3a3d-4f27-8a5a-72e566b727fb None None] Pushing event updated for resources: {'Port': ['ID=7632db4c-82a1-4533-9a4b-648c31be7759,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:41.185054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Network 633403af-786b-4534-a84c-278f36e235f3 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:12:41.313894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 633403af-786b-4534-a84c-278f36e235f3) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:41.329378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c71f3c57-9539-41d9-898f-58b06d75a413 None None] Network 633403af-786b-4534-a84c-278f36e235f3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:41.343096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:41.432725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.433367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.433937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.468825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.469314 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.469928 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 2 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:41.500253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.500783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.501502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.525814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.534018 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.535825 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 3 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:41.609184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.616201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.617235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.625492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.625919 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.626510 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 4 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:41.675241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.675710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.676254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.724865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.729279 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.732590 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 5 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:41.773174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.809849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.810699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.844327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:41.847211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.848401 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.862513 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 6 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:41.896775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.897117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.897466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.932274 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:41.937691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.937968 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.940321 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 7 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:41.961093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:41.961434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:41.961771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:41.974838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:41.975545 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:41.981675 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 8 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:42.029593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-1741df4e-7330-4fdb-8e16-518d28875d47 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:42.031458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-1741df4e-7330-4fdb-8e16-518d28875d47 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2045772 Dec 21 04:12:42.032747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:42.033141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:42.033487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:42.052412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:42.052412 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:42.052790 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 9 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:42.059505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-a0eef2c8-abbc-4251-9701-815e2abdd3e2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0203357 Dec 21 04:12:42.118124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event updated for resources: {'Port': ['ID=1630c0d5-6021-4461-b8e4-96fc1f3a2418,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:42.131916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:42.139834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:42.140199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:42.140530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:42.149799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:42.155687 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:42.158434 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 10 to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f Dec 21 04:12:42.182390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:42.183221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:42.184835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:42.197232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:42.197558 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:42.197984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:42.225970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-659c7e1c-9bfa-479f-aad1-5f64ae9c7b69 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1351483 Dec 21 04:12:42.423257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] For port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:42.426031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempted to set empty binding levels {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 21 04:12:42.462850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:42.478756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:42.566960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-c6cdfcb6-ca94-4e30-82bd-b1e3360b9569 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3275325 Dec 21 04:12:42.580410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:42.584479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7632db4c-82a1-4533-9a4b-648c31be7759 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:42.755796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:42.780500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7632db4c-82a1-4533-9a4b-648c31be7759 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:42.780702 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:42.782263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:42.783412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:42.874369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=37f93e7f-b9fc-4a68-9a15-9c5e826df90f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:42.925828 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:12:42.930770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-9657a452-410e-4d18-a9ab-f1056ca5b079 service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3468509 Dec 21 04:12:42.962391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:42.970343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b9a7c0b9-0625-4273-b98b-2f190fbe5f4a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0182414 Dec 21 04:12:42.973606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 58970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:42.977149 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:42.987081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bda3933e-09e2-4129-9cdf-6478bf048b99 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:42.987220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-91621569-db7e-470b-be6b-2e29d929570f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 984 time: 3.2014391 Dec 21 04:12:42.992172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58972) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:42.998716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:42.999392 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:43.001876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:43.128324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daf080ae-076d-4662-b410-bbc324d69f1f None None] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:43.152617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Deleting port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:43.161291 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.184093 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:43.219424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-566a1fc3-aec7-47fc-b7d3-0838c0410135 None None] Provisioning complete for port bda3933e-09e2-4129-9cdf-6478bf048b99 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:43.219721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-566a1fc3-aec7-47fc-b7d3-0838c0410135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.265906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] For port 37f93e7f-b9fc-4a68-9a15-9c5e826df90f, host n-h1-822053-11, got binding levels [] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:43.266587 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.300304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Calling delete_port for 37f93e7f-b9fc-4a68-9a15-9c5e826df90f owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:43.406226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a8afe58-f7e6-48f6-ba93-d241cbaefcf3 req-1e62fb25-6996-476d-8a44-7809f628dbbc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 210 time: 0.0944819 Dec 21 04:12:43.483545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bda3933e-09e2-4129-9cdf-6478bf048b99 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:43.484128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.583340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58986) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:43.626327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.655774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-566a1fc3-aec7-47fc-b7d3-0838c0410135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.709094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event deleted for resources: {'Port': ['ID=37f93e7f-b9fc-4a68-9a15-9c5e826df90f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:43.751703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.765315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bffd099d-abc2-46de-8419-58a13f1df841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "DELETE /v2.0/ports/37f93e7f-b9fc-4a68-9a15-9c5e826df90f HTTP/1.1" status: 204 len: 168 time: 0.7700908 Dec 21 04:12:43.768641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 58996) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:43.818518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-566a1fc3-aec7-47fc-b7d3-0838c0410135 None None] For port bda3933e-09e2-4129-9cdf-6478bf048b99, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bda3933e-09e2-4129-9cdf-6478bf048b99,segment=NetworkSegment(0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38),segment_id=0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:43.875661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c08358a-9cdf-4e89-be81-b2a8010a181c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.878042 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-1f245d83-5fca-4d3a-9c7c-b9ddf08cbb69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:12:43.880839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1f245d83-5fca-4d3a-9c7c-b9ddf08cbb69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "GET /v2.0/ports/37f93e7f-b9fc-4a68-9a15-9c5e826df90f HTTP/1.1" status: 404 len: 333 time: 0.1095359 Dec 21 04:12:43.883212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59000) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:43.889955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Request body: {'port': {'network_id': '633403af-786b-4534-a84c-278f36e235f3', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-62536396'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:43.906240 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-566a1fc3-aec7-47fc-b7d3-0838c0410135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:43.972891 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:41Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:44.057133 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:44.057793 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Updating router 3629bfb8-c770-438f-a801-5c83107ae8bf port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:12:44.109421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.166608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566a1fc3-aec7-47fc-b7d3-0838c0410135 None None] Pushing event updated for resources: {'Port': ['ID=bda3933e-09e2-4129-9cdf-6478bf048b99,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:44.178842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c08358a-9cdf-4e89-be81-b2a8010a181c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.208877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Made reservation on behalf of a25c637b9d0d4f48be7c083f33aeb52c for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:44.225380 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.275707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:12:44.276080 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:12:44.280384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c08358a-9cdf-4e89-be81-b2a8010a181c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.343211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2014f9bc-19a5-4b9a-bfb7-a50762563232 None None] Provisioning complete for port bda3933e-09e2-4129-9cdf-6478bf048b99 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:44.343588 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2014f9bc-19a5-4b9a-bfb7-a50762563232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.370314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 861079fc-3d03-4a69-ad4d-576411b27fc2 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:44.377052 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.382632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c08358a-9cdf-4e89-be81-b2a8010a181c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e4d7490-689c-4e3b-915b-56fe051b3399,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:44.554799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8c08358a-9cdf-4e89-be81-b2a8010a181c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d07b54eaa48d49de9ea5cea7f4bc9555&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9703581 Dec 21 04:12:44.559957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:44.591729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2014f9bc-19a5-4b9a-bfb7-a50762563232 None None] Provisioning complete for port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:44.592286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2014f9bc-19a5-4b9a-bfb7-a50762563232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.635616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b9220d4-d537-47b6-9975-f21ea8ade772 req-067f09b7-e2e1-4f45-9bd0-e983d78d2fa2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 210 time: 0.1014793 Dec 21 04:12:44.717797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2014f9bc-19a5-4b9a-bfb7-a50762563232 None None] Port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:44.719490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3517c9a8-581c-4c1a-86ad-cbbb65cfec33 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.744334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3517c9a8-581c-4c1a-86ad-cbbb65cfec33 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.918571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.923347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3517c9a8-581c-4c1a-86ad-cbbb65cfec33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.927464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3517c9a8-581c-4c1a-86ad-cbbb65cfec33 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:44.928896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3517c9a8-581c-4c1a-86ad-cbbb65cfec33 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5e4d7490-689c-4e3b-915b-56fe051b3399 HTTP/1.1" status: 204 len: 168 time: 0.3608177 Dec 21 04:12:44.948972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3517c9a8-581c-4c1a-86ad-cbbb65cfec33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e4d7490-689c-4e3b-915b-56fe051b3399,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:44.965587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-165d5170-9103-4431-a5d0-b90aff998452 None None] Provisioning complete for port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:44.966061 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-165d5170-9103-4431-a5d0-b90aff998452 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.083820 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.123472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-165d5170-9103-4431-a5d0-b90aff998452 None None] Port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:45.163959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.extraroute_db [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added routes are [{'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}] {{(pid=110311) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 21 04:12:45.182798 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.184903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.202819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.extraroute_db [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Removed routes are [] {{(pid=110311) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 21 04:12:45.203522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.252566 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e057a1da-b5cd-484a-8044-1d097c1b486a None None] Pushing event updated for resources: {'Port': ['ID=1630c0d5-6021-4461-b8e4-96fc1f3a2418,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:45.253881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-afe1e579-e4d0-43a3-8a50-eff28d5d30a9 None None] Provisioning complete for port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:45.256342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-afe1e579-e4d0-43a3-8a50-eff28d5d30a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.262365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bda3933e-09e2-4129-9cdf-6478bf048b99 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:45.344425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Network 633403af-786b-4534-a84c-278f36e235f3 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:45.348428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:45.365075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:45.366046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:45.366646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.371185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=861079fc-3d03-4a69-ad4d-576411b27fc2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:45.391873 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Attempting to bind port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:45.394340 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Attempting to bind port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:45.394973 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Attempting to bind port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 on network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:45.410996 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:45.411522 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Checking segment: {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:45.412547 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.413278 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Bound using segment: {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:45.413962 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Bound port: 1630c0d5-6021-4461-b8e4-96fc1f3a2418, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:45.419537 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.428171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-afe1e579-e4d0-43a3-8a50-eff28d5d30a9 None None] Port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:45.446721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port bda3933e-09e2-4129-9cdf-6478bf048b99 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:45.447460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.497079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6a157c7d-9309-4373-ac44-5738176e225e tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 962 time: 1.6117389 Dec 21 04:12:45.499745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59028) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:45.523942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:45.631763 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] For port 1630c0d5-6021-4461-b8e4-96fc1f3a2418, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:45.639797 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] For port 1630c0d5-6021-4461-b8e4-96fc1f3a2418, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1630c0d5-6021-4461-b8e4-96fc1f3a2418,segment=NetworkSegment(0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38),segment_id=0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:45.720803 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.733565 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.735022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.769847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.779028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3093177a-df39-44e0-ab46-f0e38d88f7e6 None None] Provisioning complete for port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:45.786401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3093177a-df39-44e0-ab46-f0e38d88f7e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:45.851312 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:45.852176 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:45.966341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6a30add-48ca-43b2-aa62-de949e05d777 req-d37d5388-a9c4-46ac-afa4-2b7e77eaa0b3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 210 time: 0.1974263 Dec 21 04:12:45.991709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:46.003877 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e057a1da-b5cd-484a-8044-1d097c1b486a None None] Pushing event updated for resources: {'Port': ['ID=1630c0d5-6021-4461-b8e4-96fc1f3a2418,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:46.023587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3093177a-df39-44e0-ab46-f0e38d88f7e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.066589 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:46.115656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59040) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:46.139964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3093177a-df39-44e0-ab46-f0e38d88f7e6 None None] For port 1630c0d5-6021-4461-b8e4-96fc1f3a2418, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1630c0d5-6021-4461-b8e4-96fc1f3a2418,segment=NetworkSegment(0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38),segment_id=0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:46.157590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17694889-2349-4038-a852-7bae6012896b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.197508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3093177a-df39-44e0-ab46-f0e38d88f7e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.238199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:46.256566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 861079fc-3d03-4a69-ad4d-576411b27fc2 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:46.269253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.292770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.295218 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ef25e9f-73f0-46ec-8c6d-c6622c2e08df tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 934 time: 3.3205969 Dec 21 04:12:46.296716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59044) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:46.317924 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17694889-2349-4038-a852-7bae6012896b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.345989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.346433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7b75cb5e-b91d-46d0-a324-e0c65780caaf None None] Provisioning complete for port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:46.347026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b75cb5e-b91d-46d0-a324-e0c65780caaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.348799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3093177a-df39-44e0-ab46-f0e38d88f7e6 None None] Pushing event updated for resources: {'Port': ['ID=1630c0d5-6021-4461-b8e4-96fc1f3a2418,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:46.446126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-17694889-2349-4038-a852-7bae6012896b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:46.456357 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:45Z', 'revision_number': 6, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:45Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:46.475607 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e148c6bd-df29-4563-af35-42692475d404 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 934 time: 0.1767585 Dec 21 04:12:46.478150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:46.483349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'routes': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:46.489471 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23e1e1ec-071e-4132-b791-d164f6b5503f None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:45Z', 'revision_number': 6, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:45Z', 'revision_number': 4, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:46.669859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-17694889-2349-4038-a852-7bae6012896b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ec403bf55606417c937d1176b4f1abeb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5528829 Dec 21 04:12:46.687680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17694889-2349-4038-a852-7bae6012896b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5213d0e3-1a39-4f3a-b0aa-da9aa45fd859,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:46.698079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59052) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:46.717690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=861079fc-3d03-4a69-ad4d-576411b27fc2,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:46.807313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:46.808177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:46.808642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:46.834122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:46.834666 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:46.842296 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 2 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:46.900576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:46.901138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:46.901750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:46.920900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:46.921485 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:46.925986 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 3 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:46.962520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-2a1665ea-be74-474a-9c05-36644a31dfc8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:46.964478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-2a1665ea-be74-474a-9c05-36644a31dfc8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.4267814 Dec 21 04:12:46.968300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:46.968849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:46.969412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:46.974832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:46.975439 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:46.976141 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 4 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:46.978921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6757f914-fd26-4933-b89d-75b118e9f98d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.001142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:47.040534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.040888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.041239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.078127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6757f914-fd26-4933-b89d-75b118e9f98d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.099253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.099597 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.106374 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 5 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:47.170197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.extraroute_db [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added routes are [] {{(pid=110311) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 21 04:12:47.170737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.extraroute_db [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Removed routes are [{'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}] {{(pid=110311) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 21 04:12:47.235609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.240471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1630c0d5-6021-4461-b8e4-96fc1f3a2418 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:47.256182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-127c0603-0e18-4749-9817-bcddd6e940ad req-935fd99f-73e8-42da-9feb-c10926db6895 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 210 time: 0.1319621 Dec 21 04:12:47.257392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.257932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.258345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.266192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.266633 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.269645 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 6 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:47.285463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.285768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.286117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.296010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.296354 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.299214 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 7 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:47.317209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.317553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.317896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.370344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:47.371806 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.417447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6757f914-fd26-4933-b89d-75b118e9f98d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.421799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6757f914-fd26-4933-b89d-75b118e9f98d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.431722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6757f914-fd26-4933-b89d-75b118e9f98d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5213d0e3-1a39-4f3a-b0aa-da9aa45fd859 HTTP/1.1" status: 204 len: 168 time: 0.7314785 Dec 21 04:12:47.479387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.479672 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.491987 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 8 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:47.533656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.534019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.534370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.536604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6757f914-fd26-4933-b89d-75b118e9f98d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5213d0e3-1a39-4f3a-b0aa-da9aa45fd859,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:47.565933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.566306 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.569747 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 9 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:47.622970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.623303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.623643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.648514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.648764 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.649161 n-d-822053-11 neutron-server[110310]: INFO neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 10 to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 Dec 21 04:12:47.665678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:47.666027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:47.666372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:47.682985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:47.683372 n-d-822053-11 neutron-server[110310]: ERROR neutron.plugins.ml2.managers [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 861079fc-3d03-4a69-ad4d-576411b27fc2 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:47.683844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.739720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:47.743911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.786322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.790509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.833346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] For port 861079fc-3d03-4a69-ad4d-576411b27fc2, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:47.834008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempted to set empty binding levels {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 21 04:12:47.885241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:47.908756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:47.909718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:47.931084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:47.935710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.994555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] In _notify_port_updated(), no bound segment for port 861079fc-3d03-4a69-ad4d-576411b27fc2 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:12:47.994555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:47.994555 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:47.994774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "PUT /v2.0/ports/861079fc-3d03-4a69-ad4d-576411b27fc2 HTTP/1.1" status: 200 len: 978 time: 2.4938025 Dec 21 04:12:47.999876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59080) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:48.011273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.8 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/f1f98bd2-0041-4af1-b848-d71ba5b1ad3e) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:12:48.028614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-029eb5e0-edb2-4618-811f-9f26cd2988e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=861079fc-3d03-4a69-ad4d-576411b27fc2,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:48.071420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:48.185350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.185833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.186289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.186962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.188131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.188532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.189162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.189753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.190268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.190730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.191244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.191698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.198544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.200033 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.203464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-842cfebb-82b3-4902-a59f-c7c8720a262c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 18561 time: 0.2024539 Dec 21 04:12:48.204101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59088) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:48.229187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:48.237319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.238266 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5cee494a-c884-44bc-98ba-67a70e2fb3d8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 700 time: 1.7590749 Dec 21 04:12:48.241010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59090) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:48.324856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.377045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:48.404523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:48.413646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:48.415358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59102) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:48.415978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bdcdafcb-7fc1-4108-a1fc-b647e6d0a873 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 700 time: 0.1736341 Dec 21 04:12:48.431623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:48.435299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:48.460269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-607678ba-eeb3-46c8-8438-22f6c6b23809 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:48.555214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Deleting port 861079fc-3d03-4a69-ad4d-576411b27fc2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:48.555839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.666767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02009607-a890-440c-8a81-1696a82748a6 req-c9c5b5e3-c827-4634-836a-a02c6c177103 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.669664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02009607-a890-440c-8a81-1696a82748a6 req-c9c5b5e3-c827-4634-836a-a02c6c177103 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 931 time: 0.2592304 Dec 21 04:12:48.681051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:48.681824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.686663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] For port 861079fc-3d03-4a69-ad4d-576411b27fc2, host n-h1-822053-11, got binding levels [] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:48.687578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.703182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Calling delete_port for 861079fc-3d03-4a69-ad4d-576411b27fc2 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:48.816509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-039c5086-51e5-42fe-9023-92776db54ad5 None None] Provisioning complete for port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:48.816979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-039c5086-51e5-42fe-9023-92776db54ad5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.824429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-e4875bf4-38d0-4593-887a-1c268cbf9ce9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8341537 Dec 21 04:12:48.865710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02009607-a890-440c-8a81-1696a82748a6 req-0b34e40d-34cb-45ad-957c-867b7be8a863 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1806576 Dec 21 04:12:48.871593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Request body: {'port': {'device_id': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:48.876860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-039c5086-51e5-42fe-9023-92776db54ad5 None None] Port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:12:48.924003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:47Z', 'revision_number': 7, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:46Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:48.943301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:48.965291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:48.984722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:48.985508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:49.030922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event deleted for resources: {'Port': ['ID=861079fc-3d03-4a69-ad4d-576411b27fc2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:49.072284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.088493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.096178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4d998db1-d7f0-48c6-b7c4-9f14c7a3ffc2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "DELETE /v2.0/ports/861079fc-3d03-4a69-ad4d-576411b27fc2 HTTP/1.1" status: 204 len: 168 time: 0.8900118 Dec 21 04:12:49.098983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59130) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:49.129158 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d7e9125-27ee-481d-868d-09f4dd3b9096 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:12:49.131311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4d7e9125-27ee-481d-868d-09f4dd3b9096 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "GET /v2.0/ports/861079fc-3d03-4a69-ad4d-576411b27fc2 HTTP/1.1" status: 404 len: 333 time: 0.0298381 Dec 21 04:12:49.135340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:49.140422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-2031370004', 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:49.188408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:49.282845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Made reservation on behalf of a25c637b9d0d4f48be7c083f33aeb52c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:49.291711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.333820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 31552890-ff65-4203-a850-6e8f88a8daa2 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:49.537860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.599036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:47Z', 'revision_number': 7, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:46Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:49.630917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5594754d-678b-453b-870c-c410fee2c9f0 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:47Z', 'revision_number': 7, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:46Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:49.722460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.806079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f1f98bd2-0041-4af1-b848-d71ba5b1ad3e {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:12:49.828933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c6d7e0c-e39a-47fd-8500-1c90ba55da2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.832350 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.832575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.850448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Transition to ACTIVE for port object f1f98bd2-0041-4af1-b848-d71ba5b1ad3e will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:12:49.948440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Network 633403af-786b-4534-a84c-278f36e235f3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:49.953867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:49.957490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:49.960340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:49.961372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:49.961976 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.000197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=31552890-ff65-4203-a850-6e8f88a8daa2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:50.086286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb33f833-c077-4fd3-acc1-6b5a107e7ba2 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:50.089720 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:50.111336 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:50.112181 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:50.119167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Pushing event updated for resources: {'Port': ['ID=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:50.126282 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6f7cab96-e9a4-4534-89e2-1f1630bfa2be tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 0.9894922 Dec 21 04:12:50.132052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:50.196741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59164) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:50.236706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcd53368-a608-498e-a03b-aba1a8a4aefe tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:50.240998 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dcd53368-a608-498e-a03b-aba1a8a4aefe tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "GET /v2.0/ports/31552890-ff65-4203-a850-6e8f88a8daa2 HTTP/1.1" status: 200 len: 959 time: 0.1089692 Dec 21 04:12:50.241178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e8922e-a309-4a57-8679-e053c8e40172 req-286af23e-c17d-4226-908c-3abd4cc7dd41 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:50.243912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59168) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:50.249653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1e8922e-a309-4a57-8679-e053c8e40172 req-286af23e-c17d-4226-908c-3abd4cc7dd41 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 943 time: 0.2286830 Dec 21 04:12:50.294135 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:50.410814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Deleting port 31552890-ff65-4203-a850-6e8f88a8daa2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:50.411728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.519341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.551857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Calling delete_port for 31552890-ff65-4203-a850-6e8f88a8daa2 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:50.569164 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-72556e31-45ca-4a80-ac4a-b0570a818052 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.599893 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:47Z', 'revision_number': 7, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:46Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:50.634585 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:50.644078 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:50.644917 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:50.760971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-72556e31-45ca-4a80-ac4a-b0570a818052 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.768851 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:50.886357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-72556e31-45ca-4a80-ac4a-b0570a818052 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.895511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1e8922e-a309-4a57-8679-e053c8e40172 req-4828c885-8a42-4c8a-a274-6a9875ec3aa5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6449163 Dec 21 04:12:50.897039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Attempting to bind port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:50.897391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Attempting to bind port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:50.897724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Attempting to bind port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:50.904071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:50.904478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Attempting to bind port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:50.910737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:12:50.915191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:12:50.915191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:12:50.915191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Bound port: f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:12:50.915191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:50.955827 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-72556e31-45ca-4a80-ac4a-b0570a818052 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=665124214cde42c7857de799edc85366&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7528877 Dec 21 04:12:50.956818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72556e31-45ca-4a80-ac4a-b0570a818052 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85b9011a-694c-46cb-900a-2ad51b5ad075,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:50.958775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59180) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:51.049594 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.083538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event deleted for resources: {'Port': ['ID=31552890-ff65-4203-a850-6e8f88a8daa2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:51.090868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 1630c0d5-6021-4461-b8e4-96fc1f3a2418 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:51.091235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.094906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.100999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d4d0ab8-d5b9-4504-8c75-ae70868dea0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "DELETE /v2.0/ports/31552890-ff65-4203-a850-6e8f88a8daa2 HTTP/1.1" status: 204 len: 168 time: 0.8513834 Dec 21 04:12:51.101840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59186) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:51.149821 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-64f818e1-8a97-47dc-976f-30e4d49bd47f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:12:51.150165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] For port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:51.153431 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-64f818e1-8a97-47dc-976f-30e4d49bd47f tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "GET /v2.0/ports/31552890-ff65-4203-a850-6e8f88a8daa2 HTTP/1.1" status: 404 len: 333 time: 0.0506692 Dec 21 04:12:51.154066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59190) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:51.159698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Request body: {'port': {'network_id': '633403af-786b-4534-a84c-278f36e235f3', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1157044249'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:51.179378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e659ae2-26d0-45e9-bd73-04ac40a3e63c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.205647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] For port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:12:51.225275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e659ae2-26d0-45e9-bd73-04ac40a3e63c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.267773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port 1630c0d5-6021-4461-b8e4-96fc1f3a2418, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1630c0d5-6021-4461-b8e4-96fc1f3a2418,segment=NetworkSegment(0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38),segment_id=0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:51.273840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.279869 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:47Z', 'revision_number': 7, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:46Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:51.286250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Made reservation on behalf of a25c637b9d0d4f48be7c083f33aeb52c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:12:51.289743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.322602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.328441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:51.347380 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f8a8cce-fee3-4f16-888b-31c44a336e10 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:47Z', 'revision_number': 7, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '1630c0d5-6021-4461-b8e4-96fc1f3a2418', 'name': '', 'network_id': '4c270b79-e0d8-4e57-ba87-99a1e4ddaecc', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:26:bc:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3122, 'fixed_ips': [{'subnet_id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:39Z', 'updated_at': '2021-12-21T04:12:46Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': 'a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:51.392018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 1630c0d5-6021-4461-b8e4-96fc1f3a2418 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:51.427601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60d371f2-06fc-4ad5-abad-38cc3a9766be None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:51.493374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:51.494169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.495664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] 10.222.0.31 "PUT /v2.0/ports/f1f98bd2-0041-4af1-b848-d71ba5b1ad3e HTTP/1.1" status: 200 len: 1092 time: 2.6489408 Dec 21 04:12:51.502214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'tag': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:51.507165 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26414b6e-bcbf-4196-9878-98a0514f19c7" -d '{"events": [{"name": "network-changed", "server_uuid": "5138ad65-5b25-43c1-be0e-1048b83a955e", "tag": "f1f98bd2-0041-4af1-b848-d71ba5b1ad3e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:51.512111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d355337f-b77d-4a7d-b5f5-beecbc03eba0 service neutron] Pushing event updated for resources: {'Port': ['ID=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:51.559113 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94a3d6c6-9ccb-4441-be92-874a5ec316be x-openstack-request-id: req-94a3d6c6-9ccb-4441-be92-874a5ec316be {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:51.559113 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5138ad65-5b25-43c1-be0e-1048b83a955e", "tag": "f1f98bd2-0041-4af1-b848-d71ba5b1ad3e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:51.559113 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-94a3d6c6-9ccb-4441-be92-874a5ec316be {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:51.559113 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'tag': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e', 'status': 'completed', 'code': 200} Dec 21 04:12:51.663310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e659ae2-26d0-45e9-bd73-04ac40a3e63c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.665989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5e659ae2-26d0-45e9-bd73-04ac40a3e63c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.667162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5e659ae2-26d0-45e9-bd73-04ac40a3e63c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/85b9011a-694c-46cb-900a-2ad51b5ad075 HTTP/1.1" status: 204 len: 168 time: 0.7073495 Dec 21 04:12:51.716381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e659ae2-26d0-45e9-bd73-04ac40a3e63c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85b9011a-694c-46cb-900a-2ad51b5ad075,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:51.748237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26414b6e-bcbf-4196-9878-98a0514f19c7 req-67f598b6-7ca7-4d29-8c09-713f5aaaa3bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:51.749783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26414b6e-bcbf-4196-9878-98a0514f19c7 req-67f598b6-7ca7-4d29-8c09-713f5aaaa3bb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 1095 time: 0.1245093 Dec 21 04:12:51.769115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.882311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26414b6e-bcbf-4196-9878-98a0514f19c7 req-fbf1d1f6-4549-4e70-842b-cf605de4f594 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:51.883796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26414b6e-bcbf-4196-9878-98a0514f19c7 req-fbf1d1f6-4549-4e70-842b-cf605de4f594 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&shared=False HTTP/1.1" status: 200 len: 906 time: 0.1065300 Dec 21 04:12:51.889262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.927815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Network 633403af-786b-4534-a84c-278f36e235f3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:12:51.931017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:12:51.934288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:12:51.935808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:51.936568 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:51.958657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:51.964012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.002200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=1630c0d5-6021-4461-b8e4-96fc1f3a2418,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:52.105001 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-285eb2fb-2622-4168-b8c1-bffbe3cce684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 0.9438803 Dec 21 04:12:52.105424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59210) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:52.111470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:12:52.113188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26414b6e-bcbf-4196-9878-98a0514f19c7 req-49268d03-96db-40a5-a415-840f696e19f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:52.116470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26414b6e-bcbf-4196-9878-98a0514f19c7 req-49268d03-96db-40a5-a415-840f696e19f2 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2237329 Dec 21 04:12:52.142529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e3eb00-2d5f-4b97-bc42-c979229a3772 req-8fd0d340-3a24-4ae8-85e6-f45ce6faf83f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:52.144327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97e3eb00-2d5f-4b97-bc42-c979229a3772 req-8fd0d340-3a24-4ae8-85e6-f45ce6faf83f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 943 time: 0.1503980 Dec 21 04:12:52.207313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.318288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.324559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97e3eb00-2d5f-4b97-bc42-c979229a3772 req-38fee3e9-5ce0-4ed5-b75e-ee8758d62e61 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639211 Dec 21 04:12:52.334912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-bb92a7f8-4775-46e9-ac5e-47fb098dc4cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:52.338553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-bb92a7f8-4775-46e9-ac5e-47fb098dc4cc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 1095 time: 0.0949013 Dec 21 04:12:52.428570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] device_id is not set on port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:12:52.437405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.448109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-9615bba6-2a39-43bc-966a-40727897628d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e HTTP/1.1" status: 200 len: 217 time: 0.0669763 Dec 21 04:12:52.500906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.515212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-f7537dba-6c4e-48c6-b2df-874f84837c17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:52.516692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-f7537dba-6c4e-48c6-b2df-874f84837c17 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0575142 Dec 21 04:12:52.574245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:52.578580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.582921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.582921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.585030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.585361 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.585753 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 2 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.599985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.599985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.600265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.604897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.605833 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.606233 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 3 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.619314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.619656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.619991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.623158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-92616d1f-7e23-4fd5-806d-b145b0dabd62 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0682068 Dec 21 04:12:52.625437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.626144 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.626144 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 4 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.639810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.640154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.640780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.644961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.645227 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.645623 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 5 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.651457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef7a98a8-4fb6-4105-b207-e4d30e412647 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.672014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.672747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.673489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.679902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.680239 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.680747 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 6 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.682665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:52.698061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.698402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.698736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.704055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.704378 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.704766 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 7 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.721574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.721574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.721832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.726808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.727186 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.727703 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 8 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.756066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.756336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.756717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.764480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.765035 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.765443 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 9 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.781540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.782168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.782463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.788080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.788545 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.789074 n-d-822053-11 neutron-server[110311]: INFO neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempt 10 to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 Dec 21 04:12:52.808667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:12:52.809093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:12:52.809554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempting to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:12:52.814330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:12:52.814658 n-d-822053-11 neutron-server[110311]: ERROR neutron.plugins.ml2.managers [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Failed to bind port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on host n-h1-822053-11 for vnic_type normal using segments [{'id': 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '633403af-786b-4534-a84c-278f36e235f3'}] Dec 21 04:12:52.815067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.830614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-9ab4658c-f028-4f74-9631-8a30f2b2a173 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1940060 Dec 21 04:12:52.914416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:52.916450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:52.926239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-70f3f579-901d-402d-8977-c7aa88d4b3f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5098908 Dec 21 04:12:52.928917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59234) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:52.935241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:52.968266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:52.968839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:53.013235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b694ab8f-2434-44e1-b6d9-da3acd81b6ca req-93e518a2-b2b3-4563-ad3e-7887a01ddc77 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1718929 Dec 21 04:12:53.017192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:12:53.020878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.095988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.159126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:53.326282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] For port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:12:53.326700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attempted to set empty binding levels {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 21 04:12:53.331731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.404133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.477241 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.481175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] In _notify_port_updated(), no bound segment for port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 on network 633403af-786b-4534-a84c-278f36e235f3 {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:12:53.482146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:53.482660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.484023 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "PUT /v2.0/ports/4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 HTTP/1.1" status: 200 len: 980 time: 1.3775070 Dec 21 04:12:53.489152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59248) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:53.565924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201a1e49-eb16-45c6-9d58-a5de6513e0f0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event updated for resources: {'Port': ['ID=4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:53.589999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.592088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Deleting port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:53.592509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.593436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:51Z', 'revision_number': 8, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:53.638802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:53.657532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:53.658639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:53.659936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:53.682716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.690298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d54fd2d1-aeed-401d-b49e-d08ca182b172 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666 HTTP/1.1" status: 204 len: 168 time: 0.7579210 Dec 21 04:12:53.690717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:53.734662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30684571-660b-4202-987e-2c1b7b213236 req-8423e674-d36b-4aa4-9435-064338a2902a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:53.736260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30684571-660b-4202-987e-2c1b7b213236 req-8423e674-d36b-4aa4-9435-064338a2902a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 943 time: 0.2729259 Dec 21 04:12:53.755701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] For port 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367, host n-h1-822053-11, got binding levels [] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:53.756073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.774120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:53.786175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Calling delete_port for 4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:53.852772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:53.891563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30684571-660b-4202-987e-2c1b7b213236 req-79437f59-3cbb-4ec2-8649-6634c60f3db1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1467850 Dec 21 04:12:53.945766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0ddf439-4302-49d7-8116-375205c19d51 None None] Network 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:53.948412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port bda3933e-09e2-4129-9cdf-6478bf048b99 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:53.948912 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.053280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port bda3933e-09e2-4129-9cdf-6478bf048b99, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bda3933e-09e2-4129-9cdf-6478bf048b99,segment=NetworkSegment(0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38),segment_id=0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:54.053898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.070794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for bda3933e-09e2-4129-9cdf-6478bf048b99 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:54.079766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.143949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Pushing event deleted for resources: {'Port': ['ID=4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:54.161407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.169924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4ed7603-dc7d-415f-9f77-43688307ea0a tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "DELETE /v2.0/ports/4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 HTTP/1.1" status: 204 len: 168 time: 0.6786923 Dec 21 04:12:54.174790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:54.216907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:51Z', 'revision_number': 8, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.254619 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ccf4ed66-874c-4b00-9552-f5e789630066 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] GET failed (client error): The resource could not be found. Dec 21 04:12:54.261224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59290) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:54.269404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00745e3b-9d23-4aa5-8f12-ab6913b97d45 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:51Z', 'revision_number': 8, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': '7632db4c-82a1-4533-9a4b-648c31be7759', 'name': '', 'network_id': '859fbb50-1723-45c7-b0f5-30f550f70d94', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:a9:97:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3110, 'fixed_ips': [{'subnet_id': '0fbde120-5987-49c0-b940-055555de26c4', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:33Z', 'updated_at': '2021-12-21T04:12:40Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '0fbde120-5987-49c0-b940-055555de26c4', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:54.274077 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ccf4ed66-874c-4b00-9552-f5e789630066 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-539114462-project-admin] 10.222.0.18 "GET /v2.0/ports/4150f5d7-9a9c-4e1e-a5e2-9c6bff2b4367 HTTP/1.1" status: 404 len: 333 time: 0.0978792 Dec 21 04:12:54.277550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] DHCP port deletion for 4c270b79-e0d8-4e57-ba87-99a1e4ddaecc request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:54.321826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.339919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Deleting port bda3933e-09e2-4129-9cdf-6478bf048b99 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:54.340544 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.413984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] For port bda3933e-09e2-4129-9cdf-6478bf048b99, host n-d-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:54.414616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.429656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Calling delete_port for bda3933e-09e2-4129-9cdf-6478bf048b99 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:54.435826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=bda3933e-09e2-4129-9cdf-6478bf048b99,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:54.442768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.ipam_backend_mixin [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Port bda3933e-09e2-4129-9cdf-6478bf048b99 was not found and therefore no delete operation was performed {{(pid=110312) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:12:54.445873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port bda3933e-09e2-4129-9cdf-6478bf048b99 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:54.448282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.455745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.479529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] Pushing event deleted for resources: {'Port': ['ID=bda3933e-09e2-4129-9cdf-6478bf048b99,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:54.486430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07edaf64-b3d5-439d-8f44-2b7d425ae185 None None] No DVR routers for this DVR port bda3933e-09e2-4129-9cdf-6478bf048b99 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:54.584897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.712562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c270b79-e0d8-4e57-ba87-99a1e4ddaecc']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.722659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.754429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['633403af-786b-4534-a84c-278f36e235f3']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.757775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.758071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0bb3d096-e7c6-4c3f-9f7e-19a775bc6e38') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.782316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.782616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f5087f4d-ae41-41bb-b5f4-eda8ba9ca281') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:54.789285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.808837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.822677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.828527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.834817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:54.835349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:54.838745 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:54.847031 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:55.005629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.050630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57822162-ce50-49fc-9fda-618eb6d8644a req-4a0b2ce2-01f6-4341-b2ea-25b309f233b4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:55.052482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57822162-ce50-49fc-9fda-618eb6d8644a req-4a0b2ce2-01f6-4341-b2ea-25b309f233b4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 943 time: 0.0554249 Dec 21 04:12:55.066157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.071560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.075439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/4c270b79-e0d8-4e57-ba87-99a1e4ddaecc HTTP/1.1" status: 204 len: 168 time: 1.3835838 Dec 21 04:12:55.076159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.078244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:55.080914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.085182 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.091738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] 10.222.0.18 "DELETE /v2.0/networks/633403af-786b-4534-a84c-278f36e235f3 HTTP/1.1" status: 204 len: 168 time: 0.8287449 Dec 21 04:12:55.122135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-336299f9-4beb-4c4a-a9e4-651f2099d001 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=4c270b79-e0d8-4e57-ba87-99a1e4ddaecc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:55.167153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57822162-ce50-49fc-9fda-618eb6d8644a req-c88da5c5-6534-40b1-87dd-df33f966df6e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1082695 Dec 21 04:12:55.182379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d26e17-1333-4317-a1ed-bc2920fafb9b tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595 tempest-PortsAdminExtendedAttrsIpV6TestJSON-300066595-project] Pushing event deleted for resources: {'Network': ['ID=633403af-786b-4534-a84c-278f36e235f3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:55.327327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1630c0d5-6021-4461-b8e4-96fc1f3a2418 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:55.363135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1630c0d5-6021-4461-b8e4-96fc1f3a2418 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:55.363880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1630c0d5-6021-4461-b8e4-96fc1f3a2418 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:55.364456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bda3933e-09e2-4129-9cdf-6478bf048b99 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:55.387217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: bda3933e-09e2-4129-9cdf-6478bf048b99 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:55.387807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device bda3933e-09e2-4129-9cdf-6478bf048b99 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:55.539528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f1f98bd2-0041-4af1-b848-d71ba5b1ad3e details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:12:55.652679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.811646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:55.844044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.852397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e', 'mac_address': 'fa:16:3e:cf:ee:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:12:55.947433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59340) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:55.948116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:55.966651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f1f98bd2-0041-4af1-b848-d71ba5b1ad3e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:12:55.994158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:56.106458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 7632db4c-82a1-4533-9a4b-648c31be7759 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:56.107035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.134302 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.171259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-92b16649-2acb-47b9-ad46-89419d00b6be admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a607239f70a14364b789808afbcc8580&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2246029 Dec 21 04:12:56.180309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59346) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:56.228234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port 7632db4c-82a1-4533-9a4b-648c31be7759, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7632db4c-82a1-4533-9a4b-648c31be7759,segment=NetworkSegment(a07085e1-bc27-4287-9bad-f17ed98ccba4),segment_id=a07085e1-bc27-4287-9bad-f17ed98ccba4)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:56.228601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.243181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 7632db4c-82a1-4533-9a4b-648c31be7759 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:56.270297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:56.279285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97f412a6-bc54-421d-a95c-8604795a3f1d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.336886 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97f412a6-bc54-421d-a95c-8604795a3f1d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.402217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5852c4-f1f1-4220-b0d4-d6f98524cb9c req-d357eafd-5a33-411a-99b4-e0c7a8ca696f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:56.403961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f5852c4-f1f1-4220-b0d4-d6f98524cb9c req-d357eafd-5a33-411a-99b4-e0c7a8ca696f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 944 time: 0.0931847 Dec 21 04:12:56.503303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['f1f98bd2-0041-4af1-b848-d71ba5b1ad3e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:12:56.525634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97f412a6-bc54-421d-a95c-8604795a3f1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.528835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-97f412a6-bc54-421d-a95c-8604795a3f1d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.537657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-97f412a6-bc54-421d-a95c-8604795a3f1d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d5dd927f-db52-4958-93cf-9134828bac32 HTTP/1.1" status: 204 len: 168 time: 0.3481059 Dec 21 04:12:56.545852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f5852c4-f1f1-4220-b0d4-d6f98524cb9c req-2dfe600e-c722-4993-b2c1-3ce87b9ce5bb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1051378 Dec 21 04:12:56.559112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f412a6-bc54-421d-a95c-8604795a3f1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5dd927f-db52-4958-93cf-9134828bac32,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:56.594528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:56.694789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=7632db4c-82a1-4533-9a4b-648c31be7759,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:56.890572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.201610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:12:57.332426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:12:57.340620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34575d7d-83c7-4361-85e2-22705c87c991 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2583826 Dec 21 04:12:57.340857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59364) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:57.353405 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:12:57.372805 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:57.374654 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:57.407366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet 0fbde120-5987-49c0-b940-055555de26c4 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:12:57.411931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.503448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.554326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f1f98bd2-0041-4af1-b848-d71ba5b1ad3e up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:12:57.613000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.640996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59370) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:57.771814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59372) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:57.779398 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.782115 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-02a5d07d-d73b-4511-b5eb-aae33bd14b34 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a25c637b9d0d4f48be7c083f33aeb52c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1372724 Dec 21 04:12:57.831964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:12:57.844186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:12:57.844186 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.845663 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:57.901576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=0fbde120-5987-49c0-b940-055555de26c4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:57.924803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:57.929506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef6736f8-e0bc-4651-987e-12593d2cea9a None None] Network 859fbb50-1723-45c7-b0f5-30f550f70d94 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:12:57.934689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d8e8ad43-f405-4e4b-bad1-9b721671ded9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/0fbde120-5987-49c0-b940-055555de26c4 HTTP/1.1" status: 204 len: 168 time: 0.5925412 Dec 21 04:12:57.937846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59376) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:58.065527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a873180-7c3a-48f3-941f-372541500ffa req-936b39ad-d164-4ac1-8258-41df6b6173d1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:58.075273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.077371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a873180-7c3a-48f3-941f-372541500ffa req-936b39ad-d164-4ac1-8258-41df6b6173d1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 944 time: 0.2966633 Dec 21 04:12:58.170278 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7e92f6d3-e29b-468c-820b-70c4c7c7feef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.211970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port 366763b6-3129-4d48-96a4-2161241da95b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:12:58.212432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.213060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a873180-7c3a-48f3-941f-372541500ffa req-c5bdb8d1-d92c-478b-ba2c-a6cabbc42539 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1294210 Dec 21 04:12:58.231845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7e92f6d3-e29b-468c-820b-70c4c7c7feef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.352638 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:56Z', 'revision_number': 9, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:58.418153 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:12:58.418822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port 366763b6-3129-4d48-96a4-2161241da95b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=366763b6-3129-4d48-96a4-2161241da95b,segment=NetworkSegment(a07085e1-bc27-4287-9bad-f17ed98ccba4),segment_id=a07085e1-bc27-4287-9bad-f17ed98ccba4)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:58.419120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.449334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7e92f6d3-e29b-468c-820b-70c4c7c7feef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.452496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7e92f6d3-e29b-468c-820b-70c4c7c7feef admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.456088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7e92f6d3-e29b-468c-820b-70c4c7c7feef admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/299cdfb5-9a2e-4b4b-bbbc-76180cb124a0 HTTP/1.1" status: 204 len: 168 time: 0.6811070 Dec 21 04:12:58.463865 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:12:58.467125 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:58.473450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e92f6d3-e29b-468c-820b-70c4c7c7feef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=299cdfb5-9a2e-4b4b-bbbc-76180cb124a0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:58.497159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for 366763b6-3129-4d48-96a4-2161241da95b owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:12:58.669336 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.738141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=366763b6-3129-4d48-96a4-2161241da95b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:58.753969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port 366763b6-3129-4d48-96a4-2161241da95b on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:12:58.785519 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:12:58.911871 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.919207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d08686c3-c46f-41bf-897f-3886cf44146d None None] DHCP port deletion for 859fbb50-1723-45c7-b0f5-30f550f70d94 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:12:58.958030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:58.986039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:12:58.991098 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce328002-211c-4756-876d-92b25f7ac8a0" -d '{"events": [{"server_uuid": "5138ad65-5b25-43c1-be0e-1048b83a955e", "name": "network-vif-plugged", "status": "completed", "tag": "f1f98bd2-0041-4af1-b848-d71ba5b1ad3e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:12:59.000989 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-de6a07ed-7a09-4fca-a244-1349928e47d8 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.5477171 Dec 21 04:12:59.010196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:12:59.034839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['859fbb50-1723-45c7-b0f5-30f550f70d94']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:59.069613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:59.119919 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:12:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eae0ac60-5474-48ee-89d3-70415efc19a4 x-openstack-request-id: req-eae0ac60-5474-48ee-89d3-70415efc19a4 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:12:59.130882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a07085e1-bc27-4287-9bad-f17ed98ccba4') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:59.130882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a07085e1-bc27-4287-9bad-f17ed98ccba4') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:59.131113 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5138ad65-5b25-43c1-be0e-1048b83a955e", "name": "network-vif-plugged", "status": "completed", "tag": "f1f98bd2-0041-4af1-b848-d71ba5b1ad3e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:12:59.131113 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eae0ac60-5474-48ee-89d3-70415efc19a4 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:12:59.131113 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e', 'code': 200} Dec 21 04:12:59.150522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:59.176337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:59.208864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:59.219065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:12:59.219675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:59.244594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-896311a9-10da-4623-bf8f-ca4993a1f344 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:59.253842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-896311a9-10da-4623-bf8f-ca4993a1f344 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1097 time: 0.1613419 Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:12:59.254566 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:12:59.297843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 366763b6-3129-4d48-96a4-2161241da95b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:12:59.347243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af64ac8-2c5b-48f3-92b2-a6bcb0eeb668 req-bfe899dc-91ec-40bf-abda-eaf5b0ea9be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:59.355127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3af64ac8-2c5b-48f3-92b2-a6bcb0eeb668 req-bfe899dc-91ec-40bf-abda-eaf5b0ea9be4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 1097 time: 0.1270645 Dec 21 04:12:59.401451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 366763b6-3129-4d48-96a4-2161241da95b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:12:59.404688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 366763b6-3129-4d48-96a4-2161241da95b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:12:59.531999 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:56Z', 'revision_number': 9, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:12:59.581042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3af64ac8-2c5b-48f3-92b2-a6bcb0eeb668 req-43016c00-3e1a-4e9e-b36e-22ce16e9dbe3 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2140765 Dec 21 04:12:59.601154 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1a1996-7670-408e-9e54-45f2421b942d None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:12:56Z', 'revision_number': 9, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'baf6293a-aeab-4622-816d-b2c0b303bb91', 'name': '', 'network_id': '5fa7301d-285e-442e-a2d1-e29285bf70fd', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:e6:12:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3090, 'fixed_ips': [{'subnet_id': '005dd663-df91-429f-a13b-31158a0a285c', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:25Z', 'updated_at': '2021-12-21T04:12:31Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '005dd663-df91-429f-a13b-31158a0a285c', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:12:59.651514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acbf019-567b-494f-9f39-0465def8e4f0 req-7258b530-e54e-4b51-854d-cf6837babe67 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:59.656584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1acbf019-567b-494f-9f39-0465def8e4f0 req-7258b530-e54e-4b51-854d-cf6837babe67 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.2350624 Dec 21 04:12:59.691951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-3a4f7958-5656-492a-b33f-9c0f040c380e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:59.693637 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-3a4f7958-5656-492a-b33f-9c0f040c380e service neutron] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.3981938 Dec 21 04:12:59.694373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:59.719608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:12:59.725226 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/859fbb50-1723-45c7-b0f5-30f550f70d94 HTTP/1.1" status: 204 len: 168 time: 1.7862940 Dec 21 04:12:59.726156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4226e711-5f62-4971-bb94-3b197edc3212 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=859fbb50-1723-45c7-b0f5-30f550f70d94,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:12:59.727694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1acbf019-567b-494f-9f39-0465def8e4f0 req-24112b82-4d5a-4454-82d3-9379253f64dc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615263 Dec 21 04:12:59.728332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59406) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:12:59.812329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-2762a299-b509-4105-93bf-47997872fc6a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 200 len: 217 time: 0.0946021 Dec 21 04:12:59.904795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-48e10e58-4b33-4128-879b-51328290827e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:12:59.906544 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-48e10e58-4b33-4128-879b-51328290827e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0865455 Dec 21 04:12:59.952061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-a6fe49ff-6143-4227-ac6f-cc3ee6e57ac5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0354295 Dec 21 04:12:59.971551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-e327963a-e1a9-4a32-be9c-608e0d0ff349 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:12:59.972554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-e327963a-e1a9-4a32-be9c-608e0d0ff349 service neutron] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0121439 Dec 21 04:13:00.167609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-e7fbeae1-64b0-478d-9d44-e22fe7a1e5fd service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1857567 Dec 21 04:13:00.327861 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7af9b49b-a8c5-4658-b16e-2af737e39e3d req-80763412-2adb-4d64-afa4-2c15eb349a72 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1524286 Dec 21 04:13:00.464574 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:00.915808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port baf6293a-aeab-4622-816d-b2c0b303bb91 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:00.916518 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:00.979523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-044c6b12-2290-446c-a32d-001cf3b63238 req-c3bc914a-ffb0-4e1b-b519-1d1293c98b94 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:00.983837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-044c6b12-2290-446c-a32d-001cf3b63238 req-c3bc914a-ffb0-4e1b-b519-1d1293c98b94 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.1328225 Dec 21 04:13:01.104254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port baf6293a-aeab-4622-816d-b2c0b303bb91, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=baf6293a-aeab-4622-816d-b2c0b303bb91,segment=NetworkSegment(53dd575a-3634-44ba-afbc-03f91a4ad602),segment_id=53dd575a-3634-44ba-afbc-03f91a4ad602)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:01.104605 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:01.111259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-044c6b12-2290-446c-a32d-001cf3b63238 req-df1658be-6465-492c-bf81-e5309fd9816d tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811508 Dec 21 04:13:01.130085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for baf6293a-aeab-4622-816d-b2c0b303bb91 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:01.153719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7632db4c-82a1-4533-9a4b-648c31be7759 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:01.195535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7632db4c-82a1-4533-9a4b-648c31be7759 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:01.198916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7632db4c-82a1-4533-9a4b-648c31be7759 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:01.484023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:01.718194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59442) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:01.895305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-378169438', 'router:external': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:01.955376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=baf6293a-aeab-4622-816d-b2c0b303bb91,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:02.034267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Made reservation on behalf of 67330cfb489a453f959b0551f63b990d for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:02.037610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.051178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.235079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.242372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.328579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.380511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:13:02.393984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e4c5e9b-c9f4-4721-9f67-62b82f8f5587,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:02.415563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.416278 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Added segment 092b7aad-70f1-4ce1-ab68-366e3f45cc2f of type vlan for network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 Dec 21 04:13:02.424764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a08eeb2-072c-4416-860e-f5fbb19366ae req-d3ab29c0-df20-44db-9f54-02a860a40ada tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:02.432141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a08eeb2-072c-4416-860e-f5fbb19366ae req-d3ab29c0-df20-44db-9f54-02a860a40ada tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.1358263 Dec 21 04:13:02.466431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59458) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:02.477675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.556463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a08eeb2-072c-4416-860e-f5fbb19366ae req-26584591-137b-4410-ad39-4d9a08fe4d7e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1183348 Dec 21 04:13:02.611683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.613029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:02.613816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.669426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:02.707881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Network': ['ID=4f1de5b4-1469-4aea-ac9f-b8faafbb90b3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:02.720415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:13:02.739920 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7451b3b-d7ff-40c5-8879-be888a7436cc tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 870 time: 1.0198357 Dec 21 04:13:02.743510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59470) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:02.752702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'subnet': {'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:02.815910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7d8107b-ff59-4433-98f6-8839df2ed7c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.903243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Made reservation on behalf of 67330cfb489a453f959b0551f63b990d for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:02.906216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:02.945502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:02.951660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-aa41648e-75ce-4e92-88d5-6b00c6c4e925 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2183444 Dec 21 04:13:02.956020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:02.957708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:02.978630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:02.979561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:03.071550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet 005dd663-df91-429f-a13b-31158a0a285c {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:13:03.080985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.141405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:03.181881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0ae203-1d77-455c-a2c1-bdb4d8dbe20f req-1d13f560-4ddf-402f-b1f0-2816700bbae5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:03.183841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da0ae203-1d77-455c-a2c1-bdb4d8dbe20f req-1d13f560-4ddf-402f-b1f0-2816700bbae5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.3217335 Dec 21 04:13:03.235319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.378202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7d8107b-ff59-4433-98f6-8839df2ed7c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.414680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da0ae203-1d77-455c-a2c1-bdb4d8dbe20f req-e33b0a50-bf00-467b-86c7-b84e64414688 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2196019 Dec 21 04:13:03.480901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:03.488368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7d8107b-ff59-4433-98f6-8839df2ed7c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.511783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1971124720', 'description': 'tempest-secgroup-smoke-1971124720 description', 'project_id': '620778ddaf44496aa625b5014155c9de'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:03.562225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d7d8107b-ff59-4433-98f6-8839df2ed7c6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3a570ffb5cd44088b883d3f77e3e3ea4&name=default HTTP/1.1" status: 200 len: 3000 time: 1.0911410 Dec 21 04:13:03.565278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59482) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:03.590367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:01Z', 'revision_number': 10, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:03.602674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.663564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:03.678524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d8107b-ff59-4433-98f6-8839df2ed7c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98174fb6-b554-40c0-b654-2926f550e098,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:03.698326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.712320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:03.713351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:03.725657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcbb3cc9-2b45-4bbf-9eab-bb4a87ca4675 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.759942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ae4e51-1fe9-4d66-b2a4-cbb26133f579 req-c555f4d5-a87f-473e-84f8-8c25f3f9e92a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:03.761587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97ae4e51-1fe9-4d66-b2a4-cbb26133f579 req-c555f4d5-a87f-473e-84f8-8c25f3f9e92a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.1340487 Dec 21 04:13:03.779033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:13:03.781418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.794627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcbb3cc9-2b45-4bbf-9eab-bb4a87ca4675 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.881392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Subnet': ['ID=bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:03.885567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97ae4e51-1fe9-4d66-b2a4-cbb26133f579 req-26bb9115-c2b5-4036-9aaf-b1660bf6dc94 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1145589 Dec 21 04:13:03.899052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Checking segment: {'id': '092b7aad-70f1-4ce1-ab68-366e3f45cc2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:03.899052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network hostable DHCP agents. Network: 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:13:03.911910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.945823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:03.958477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=005dd663-df91-429f-a13b-31158a0a285c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:03.968088 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.975286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-80d6dd14-1fda-4684-863c-0b839f2b677a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/005dd663-df91-429f-a13b-31158a0a285c HTTP/1.1" status: 204 len: 168 time: 1.0123589 Dec 21 04:13:03.975730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:03.989328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcbb3cc9-2b45-4bbf-9eab-bb4a87ca4675 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.993379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcbb3cc9-2b45-4bbf-9eab-bb4a87ca4675 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:03.993778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fcbb3cc9-2b45-4bbf-9eab-bb4a87ca4675 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/98174fb6-b554-40c0-b654-2926f550e098 HTTP/1.1" status: 204 len: 168 time: 0.4274695 Dec 21 04:13:04.001174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ccf3197-12e0-4566-b05e-63fbec8b802f None None] Network 5fa7301d-285e-442e-a2d1-e29285bf70fd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:04.008894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.030065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcbb3cc9-2b45-4bbf-9eab-bb4a87ca4675 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98174fb6-b554-40c0-b654-2926f550e098,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:04.074185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:13:04.120036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.124723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.156235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:04.166248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:04.169202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.187410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3549b741-8ac3-4c54-9db1-691842885eb8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:04.188986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port f08e14d5-abdd-4327-b679-b1f54050b201 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:04.188986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.225494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.229538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-30dec0a7-fa76-4d02-818c-2af92684daa8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.7326589 Dec 21 04:13:04.230959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:04.235450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group_rule': {'security_group_id': '3549b741-8ac3-4c54-9db1-691842885eb8', 'project_id': '620778ddaf44496aa625b5014155c9de', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:04.249397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-490b8a02-eb4a-4e8e-827d-f8138973abbf None None] Network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:04.292155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04b633ff-6c2b-41e1-b6c3-33346047e7f2 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 1.5471771 Dec 21 04:13:04.293926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59492) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:04.296326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port f08e14d5-abdd-4327-b679-b1f54050b201, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f08e14d5-abdd-4327-b679-b1f54050b201,segment=NetworkSegment(53dd575a-3634-44ba-afbc-03f91a4ad602),segment_id=53dd575a-3634-44ba-afbc-03f91a4ad602)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:04.296706 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.299275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-1064513177', 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:04.336126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for f08e14d5-abdd-4327-b679-b1f54050b201 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:04.451914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.541264 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.566826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff4d4ba7-ad8f-475c-ad83-073763c4aef5 None None] Network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:04.570872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port f08e14d5-abdd-4327-b679-b1f54050b201 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:13:04.571335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Made reservation on behalf of 67330cfb489a453f959b0551f63b990d for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:04.580742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.669698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] device_id is not set on port a6f6f941-7bfb-452b-a6e6-4b50f8bee666 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:13:04.671481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57294182-0623-403d-88b9-c472dc1e4241 None None] DHCP port deletion for 5fa7301d-285e-442e-a2d1-e29285bf70fd request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:04.713541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=f08e14d5-abdd-4327-b679-b1f54050b201,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:04.745754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:01Z', 'revision_number': 10, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:04.784499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45854ff7-ba94-4bcc-b900-6a068feb3fa3 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:01Z', 'revision_number': 10, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None, '_interfaces': [{'id': 'ac29ae09-52b0-488f-b26d-192e6156b786', 'name': '', 'network_id': '4a466f04-c248-434e-bdc2-339c1c621793', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'mac_address': 'fa:16:3e:72:44:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'device_owner': 'network:router_interface', 'standard_attr_id': 3080, 'fixed_ips': [{'subnet_id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:12:18Z', 'updated_at': '2021-12-21T04:12:26Z', 'revision_number': 5, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'subnets': [{'id': '9b2363e5-033b-431f-bd9b-32df9784fb2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:04.884626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.918154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.929700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5fa7301d-285e-442e-a2d1-e29285bf70fd']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:04.937892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Allocated IP 172.20.0.5 (4f1de5b4-1469-4aea-ac9f-b8faafbb90b3/bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7/a6f6f941-7bfb-452b-a6e6-4b50f8bee666) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:04.951609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f993a6-8223-4b5d-beae-8871c7c63b97 req-ecde27f3-9344-4086-bb0a-e7a0784d1b57 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:04.953550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20f993a6-8223-4b5d-beae-8871c7c63b97 req-ecde27f3-9344-4086-bb0a-e7a0784d1b57 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.2722769 Dec 21 04:13:04.977523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:04.993931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '53dd575a-3634-44ba-afbc-03f91a4ad602') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:04.994451 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '53dd575a-3634-44ba-afbc-03f91a4ad602') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:04.997995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e997bcc6-e9f8-42d6-8f54-dbaeeb5f3b79,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:05.032227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.074549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.084159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20f993a6-8223-4b5d-beae-8871c7c63b97 req-39fa5341-30c6-4fca-8c4e-fbc97c7a8035 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1238132 Dec 21 04:13:05.085190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 116 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:13:05.085609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:13:05.090102 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:13:05.121291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.122784 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1fe4280b-0ccb-489c-becc-79a8717afd14 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8913677 Dec 21 04:13:05.128395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:05.133689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group_rule': {'security_group_id': '3549b741-8ac3-4c54-9db1-691842885eb8', 'project_id': '620778ddaf44496aa625b5014155c9de', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:05.189854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.234361 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.257120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.260674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/5fa7301d-285e-442e-a2d1-e29285bf70fd HTTP/1.1" status: 204 len: 168 time: 1.2836592 Dec 21 04:13:05.261725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04310857-2130-4b28-a2f9-fb58d6a3745a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=5fa7301d-285e-442e-a2d1-e29285bf70fd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:05.263413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:05.276015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device baf6293a-aeab-4622-816d-b2c0b303bb91 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:05.286054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.315923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: baf6293a-aeab-4622-816d-b2c0b303bb91 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:05.316351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device baf6293a-aeab-4622-816d-b2c0b303bb91 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:05.317623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f08e14d5-abdd-4327-b679-b1f54050b201 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:05.341165 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.346790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f08e14d5-abdd-4327-b679-b1f54050b201 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:05.346790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f08e14d5-abdd-4327-b679-b1f54050b201 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:05.415280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:05.422633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:05.424443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Port': ['ID=a6f6f941-7bfb-452b-a6e6-4b50f8bee666,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:05.426607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:05.435007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.471582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:05.472191 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.507283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.540982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c93abf4-d44d-4160-8abe-4acf62759e4e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:05.568113 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c71e65df-4687-4a15-ab30-9fb645f73173 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1023 time: 1.2722750 Dec 21 04:13:05.577093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59522) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:05.654258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.655558 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a533ce75-b72f-4bf8-8d9f-b5a91da6c43b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5257256 Dec 21 04:13:05.658282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59528) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:05.665010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group_rule': {'security_group_id': '3549b741-8ac3-4c54-9db1-691842885eb8', 'project_id': '620778ddaf44496aa625b5014155c9de', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:05.685664 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.706753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Deleting port a6f6f941-7bfb-452b-a6e6-4b50f8bee666 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:05.707132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.808916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.813354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.843700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Calling delete_port for a6f6f941-7bfb-452b-a6e6-4b50f8bee666 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:05.952946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port ac29ae09-52b0-488f-b26d-192e6156b786 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:05.953384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:05.961830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.048125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.069844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6bbff5a5-d260-4806-8113-b8f71dbba4ed,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:06.081990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port ac29ae09-52b0-488f-b26d-192e6156b786, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac29ae09-52b0-488f-b26d-192e6156b786,segment=NetworkSegment(6d5412fb-6f7b-4f5e-befe-538f4e4cf136),segment_id=6d5412fb-6f7b-4f5e-befe-538f4e4cf136)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:06.082476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.098676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for ac29ae09-52b0-488f-b26d-192e6156b786 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:06.113496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-b0d9e03d-8338-4066-a3b2-ebdef3aeb920 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:06.115051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-b0d9e03d-8338-4066-a3b2-ebdef3aeb920 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.0766726 Dec 21 04:13:06.134233 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.181980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event deleted for resources: {'Port': ['ID=a6f6f941-7bfb-452b-a6e6-4b50f8bee666,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:06.193246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.194851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3e87f9b6-cc35-4290-b3ad-b23174be72fd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5354888 Dec 21 04:13:06.204871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:06.210616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group_rule': {'security_group_id': '3549b741-8ac3-4c54-9db1-691842885eb8', 'project_id': '620778ddaf44496aa625b5014155c9de', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:06.308638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd08339-df42-4b0c-8a77-8d6b1c16a274 req-253029f1-b759-48cd-a30a-f44a3fb03a2e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:06.310581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2cd08339-df42-4b0c-8a77-8d6b1c16a274 req-253029f1-b759-48cd-a30a-f44a3fb03a2e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 945 time: 0.1480596 Dec 21 04:13:06.429323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:06.429852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.463760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2cd08339-df42-4b0c-8a77-8d6b1c16a274 req-ce2521f2-c63e-424a-94fe-f245efd28280 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1450133 Dec 21 04:13:06.641122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:06.641122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.654136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for f1f98bd2-0041-4af1-b848-d71ba5b1ad3e owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:06.660975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.667034 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-406af324-5f2c-4dbf-88a0-aaddb87a7eef tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/ports/a6f6f941-7bfb-452b-a6e6-4b50f8bee666 HTTP/1.1" status: 204 len: 168 time: 1.0867147 Dec 21 04:13:06.668147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59540) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:06.672307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3', 'external_fixed_ips': [{'subnet_id': 'bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7', 'ip_address': '172.20.0.5'}]}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:06.951196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:06.978167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=ac29ae09-52b0-488f-b26d-192e6156b786,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:07.124569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.126539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.197711 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.228899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.232303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:13:07.259676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=f1f98bd2-0041-4af1-b848-d71ba5b1ad3e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:07.261616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['f1f98bd2-0041-4af1-b848-d71ba5b1ad3e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:13:07.271783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.274250 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.318557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b87dd35b-ce3e-4896-af92-12fd9207c3fa None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:07.374121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.375893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.399688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b3c74eb9-c3b5-4f33-8074-7982c0251dfe,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:07.410798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port f1f98bd2-0041-4af1-b848-d71ba5b1ad3e on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:13:07.422066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.426067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dce0b287-d0fe-41f6-971c-160f66c8278d req-8890e059-9738-4bcc-ba40-c689e48b74c2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "DELETE /v2.0/ports/f1f98bd2-0041-4af1-b848-d71ba5b1ad3e HTTP/1.1" status: 204 len: 173 time: 1.2623901 Dec 21 04:13:07.429657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'name': 'network-vif-deleted', 'tag': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:07.432312 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a70198f-13da-454a-b41a-c6791749fbe5" -d '{"events": [{"server_uuid": "5138ad65-5b25-43c1-be0e-1048b83a955e", "name": "network-vif-deleted", "tag": "f1f98bd2-0041-4af1-b848-d71ba5b1ad3e"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:07.452895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:07.487660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.491682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-beffaefe-cc0f-426c-b71a-6345f36c170c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.2831299 Dec 21 04:13:07.491989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59550) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:07.541938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group_rule': {'security_group_id': '3549b741-8ac3-4c54-9db1-691842885eb8', 'project_id': '620778ddaf44496aa625b5014155c9de', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:07.593150 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e15358c7-d23c-4a32-a434-0db791d3469e x-openstack-request-id: req-e15358c7-d23c-4a32-a434-0db791d3469e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:07.596240 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5138ad65-5b25-43c1-be0e-1048b83a955e", "name": "network-vif-deleted", "tag": "f1f98bd2-0041-4af1-b848-d71ba5b1ad3e", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:07.596240 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e15358c7-d23c-4a32-a434-0db791d3469e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:07.596240 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5138ad65-5b25-43c1-be0e-1048b83a955e', 'name': 'network-vif-deleted', 'tag': 'f1f98bd2-0041-4af1-b848-d71ba5b1ad3e', 'status': 'completed', 'code': 200} Dec 21 04:13:07.634203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec9ef09e-9d8f-4c24-89e7-5e72d363c6b7 req-23fff883-903b-4782-b427-a6c4a10d4da4 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 210 time: 0.0391898 Dec 21 04:13:07.635548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:07.641811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0b0fa694-6e5d-43f5-9230-158a374169be tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3774319 Dec 21 04:13:07.644548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59552) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:07.648251 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:07.664181 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Project 620778ddaf44496aa625b5014155c9de added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:07.668436 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:07.669062 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:07.723532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting subnet 9b2363e5-033b-431f-bd9b-32df9784fb2e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:13:07.727426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.745762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.775602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.792996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.852140 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:07.897665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.919482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:07.936749 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:06Z', 'revision_number': 11, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:07.973663 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:07.983100 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:07.983668 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:08.016582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.042424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f7b2adbd-b5c5-406e-ba84-e7206c63852c,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:08.060284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.088740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeb89f4b-de7d-4df8-9c5d-f55dfef69f1b None None] Network 4a466f04-c248-434e-bdc2-339c1c621793 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:08.095607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.098544 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:08.099221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/9b2363e5-033b-431f-bd9b-32df9784fb2e HTTP/1.1" status: 204 len: 168 time: 0.4534075 Dec 21 04:13:08.100865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd1eaa7-c89a-4758-9338-e3cb6b8124e8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Subnet': ['ID=9b2363e5-033b-431f-bd9b-32df9784fb2e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:08.102776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59556) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:08.204141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:06Z', 'revision_number': 11, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:08.209141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.235756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.236900 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d386df6f-654f-45a5-a39c-98eaabde0396 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.7439044 Dec 21 04:13:08.240820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59558) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:08.251855 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44700f1d-32b5-4d43-b71d-c93821237ba5 None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:06Z', 'revision_number': 11, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:08.264931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'security_group_rule': {'security_group_id': '3549b741-8ac3-4c54-9db1-691842885eb8', 'project_id': '620778ddaf44496aa625b5014155c9de', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:08.359203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.379558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.401088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Deleting port d17a7100-5218-4cde-a8fb-673cdcd2d747 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:08.401441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.470348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] For port d17a7100-5218-4cde-a8fb-673cdcd2d747, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d17a7100-5218-4cde-a8fb-673cdcd2d747,segment=NetworkSegment(6d5412fb-6f7b-4f5e-befe-538f4e4cf136),segment_id=6d5412fb-6f7b-4f5e-befe-538f4e4cf136)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:08.471005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.484457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Calling delete_port for d17a7100-5218-4cde-a8fb-673cdcd2d747 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:08.500437 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Project 620778ddaf44496aa625b5014155c9de added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:08.544369 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.599088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Allocated IP 172.20.0.5 (4f1de5b4-1469-4aea-ac9f-b8faafbb90b3/bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7/a6af202c-6e78-4a11-bb1b-baaed3a05d0f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:08.633424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] DHCP port deletion for 4a466f04-c248-434e-bdc2-339c1c621793 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:08.638041 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.714945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.760453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Deleting port d17a7100-5218-4cde-a8fb-673cdcd2d747 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:08.761837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.789897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Port': ['ID=d17a7100-5218-4cde-a8fb-673cdcd2d747,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:08.796623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:08.807383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No DVR routers for this DVR port d17a7100-5218-4cde-a8fb-673cdcd2d747 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:13:08.846895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.067202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.067660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] For port d17a7100-5218-4cde-a8fb-673cdcd2d747, host n-d-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:09.068125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.088462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Calling delete_port for d17a7100-5218-4cde-a8fb-673cdcd2d747 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:09.092881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.ipam_backend_mixin [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Port d17a7100-5218-4cde-a8fb-673cdcd2d747 was not found and therefore no delete operation was performed {{(pid=110312) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:13:09.095101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.114847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:09.120791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:09.125027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:09.129080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] Pushing event deleted for resources: {'Port': ['ID=d17a7100-5218-4cde-a8fb-673cdcd2d747,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:09.133783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdf12566-0967-4a8f-a9fa-6218e6531db2 None None] No DVR routers for this DVR port d17a7100-5218-4cde-a8fb-673cdcd2d747 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:13:09.174044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Port': ['ID=a6af202c-6e78-4a11-bb1b-baaed3a05d0f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:09.233709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d17a7100-5218-4cde-a8fb-673cdcd2d747 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:09.255327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d17a7100-5218-4cde-a8fb-673cdcd2d747 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:09.255966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d17a7100-5218-4cde-a8fb-673cdcd2d747 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:09.256755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac29ae09-52b0-488f-b26d-192e6156b786 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:09.282442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ac29ae09-52b0-488f-b26d-192e6156b786 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:09.282442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac29ae09-52b0-488f-b26d-192e6156b786 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:09.366041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=21159a2c-3522-4fa3-bac3-64a0cf31474a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:09.383557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58b4e406-b676-4151-afd6-48e2f4e7b2ab req-765c8baa-8987-45ea-a483-0fdc9315f6cc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=5138ad65-5b25-43c1-be0e-1048b83a955e HTTP/1.1" status: 200 len: 210 time: 0.4977438 Dec 21 04:13:09.424950 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.446047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4a466f04-c248-434e-bdc2-339c1c621793']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:09.456233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d5412fb-6f7b-4f5e-befe-538f4e4cf136') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:09.456541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d5412fb-6f7b-4f5e-befe-538f4e4cf136') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:09.460496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.467027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f84fbb93-393a-4eca-bd9d-00d4368a7ae6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 1.2113857 Dec 21 04:13:09.476021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.494052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.502214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:13:09.502620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:13:09.506147 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:13:09.562666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.642744 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.645538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f1f98bd2-0041-4af1-b848-d71ba5b1ad3e no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:09.658237 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.662346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/networks/4a466f04-c248-434e-bdc2-339c1c621793 HTTP/1.1" status: 204 len: 168 time: 1.5583615 Dec 21 04:13:09.671362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59576) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:09.676256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'routes': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:09.705106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4066d720-8587-4ef9-b23a-0eb0e8b378b2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Pushing event deleted for resources: {'Network': ['ID=4a466f04-c248-434e-bdc2-339c1c621793,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:09.707269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: f1f98bd2-0041-4af1-b848-d71ba5b1ad3e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:09.707850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device f1f98bd2-0041-4af1-b848-d71ba5b1ad3e not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:09.783488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-be0899d1-4a45-42b6-a8a9-ee36eea689db tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1971124720&fields=id&tenant_id=620778ddaf44496aa625b5014155c9de HTTP/1.1" status: 200 len: 267 time: 0.0827658 Dec 21 04:13:09.863770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.extraroute_db [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Added routes are [] {{(pid=110311) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 21 04:13:09.864056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.extraroute_db [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Removed routes are [] {{(pid=110311) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 21 04:13:09.864484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:09.939054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-7dd91d73-c5c5-48ee-ac59-887d7741239f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:09.940617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-7dd91d73-c5c5-48ee-ac59-887d7741239f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 814 time: 0.1552970 Dec 21 04:13:09.958827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-33f85c30-3e90-4862-b548-c80a67211fda tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/quotas/620778ddaf44496aa625b5014155c9de HTTP/1.1" status: 200 len: 375 time: 0.0106776 Dec 21 04:13:10.018857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-65f6eabe-a061-4df6-9da4-84a2d653f72b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0520391 Dec 21 04:13:10.097771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.104322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.149339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-ad5c69af-9304-4b4d-a744-4f25983f1ab1 service neutron] 10.222.0.18 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1157506 Dec 21 04:13:10.150147 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.238620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 3629bfb8-c770-438f-a801-5c83107ae8bf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:10.257723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-7f563417-1f42-4620-8b5f-3cff00ba6a1c service neutron] 10.222.0.18 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1008103 Dec 21 04:13:10.366563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:10.375253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.380657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59582) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:10.393188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6bc9ce03-733b-4e05-8c47-1bc6a4c005e6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 701 time: 0.7207198 Dec 21 04:13:10.398796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] Sync routers for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:10.444737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:10.445385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:10.458093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:10.461401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fd634c30-1504-4968-a026-c3dfc5779ea4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 205 time: 0.0794859 Dec 21 04:13:10.546498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.574004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:10.675289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:06Z', 'revision_number': 11, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:10.735411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] Checking router: 3629bfb8-c770-438f-a801-5c83107ae8bf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:10.747979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] Routers {'3629bfb8-c770-438f-a801-5c83107ae8bf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:10.748831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3629bfb8-c770-438f-a801-5c83107ae8bf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:10.782675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Router 977fe0e9-8a0a-404e-a73e-954fa21a98d6 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:10.793481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.796661 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:10.877291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] Set router 3629bfb8-c770-438f-a801-5c83107ae8bf gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:10.938490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:06Z', 'revision_number': 11, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:10.966819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e135ef2b-8005-400f-97a7-ba1793e92c6e None None] The sync data for ids ['3629bfb8-c770-438f-a801-5c83107ae8bf'] in n-d-822053-11 is: [{'id': '3629bfb8-c770-438f-a801-5c83107ae8bf', 'name': 'tempest-RoutersTest-router-1322227868', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:12:15Z', 'updated_at': '2021-12-21T04:13:06Z', 'revision_number': 11, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:11.052605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-8aebdb10-3920-4b32-9a6b-86999f43738a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:11.054997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-8aebdb10-3920-4b32-9a6b-86999f43738a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.2323952 Dec 21 04:13:11.080542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-800cf3de-43e1-43e9-95d6-039d3c533fe3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/quotas/4e189e2b3dc14c41a4d5a480b6c44355 HTTP/1.1" status: 200 len: 375 time: 0.0174646 Dec 21 04:13:11.253526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65f67a19-77fa-469c-b7f6-4dc46c59e2e4 req-5cb9a899-deb3-4276-a57f-79fe6cc2ea9e tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0517881 Dec 21 04:13:11.285057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-a7192d6c-991d-4ebe-a81e-68c718e5688e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2030957 Dec 21 04:13:11.400738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-0f227c98-854e-4259-b357-f10ed2be34ff service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1145396 Dec 21 04:13:11.538324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-84ccc7b3-4eb1-4624-ab58-14da807ea15b service neutron] 10.222.0.18 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300817 Dec 21 04:13:11.580672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:11.593326 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Sync routers for ids ['977fe0e9-8a0a-404e-a73e-954fa21a98d6'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:11.603445 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Routers {'977fe0e9-8a0a-404e-a73e-954fa21a98d6'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:11.604307 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['977fe0e9-8a0a-404e-a73e-954fa21a98d6'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:11.612738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:11.612738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router 3629bfb8-c770-438f-a801-5c83107ae8bf {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:11.619397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:11.624200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59618) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:11.628830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3803a842-e1cf-4d1a-b3e3-6ce558036f68 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 204 len: 168 time: 1.1736619 Dec 21 04:13:11.630135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-959186144', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:11.699437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:11.700873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-55b09fc9-0ee4-47f5-af3b-8c4f2b059a78 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 875 time: 5.0314994 Dec 21 04:13:11.703245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59620) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:11.773220 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Set router 977fe0e9-8a0a-404e-a73e-954fa21a98d6 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:11.865792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-138e19bf-5bee-4e63-9cd9-c068a93c741e req-fb5adaec-4faa-4c5b-85c5-a094e48c2412 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.0551019 Dec 21 04:13:11.871145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:11.881448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:11.956013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:11.975602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.101269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.348362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e65ac68-0582-4702-b50c-cac014a9ab55 req-5af84f7a-f607-4b1f-8b74-24a810449edb tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0338597 Dec 21 04:13:12.394732 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '977fe0e9-8a0a-404e-a73e-954fa21a98d6', 'name': '', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3', 'external_fixed_ips': [{'subnet_id': 'bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7', 'ip_address': '172.20.0.5'}], 'enable_snat': True}, 'gw_port_id': 'a6af202c-6e78-4a11-bb1b-baaed3a05d0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:07Z', 'updated_at': '2021-12-21T04:13:09Z', 'revision_number': 3, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port': {'id': 'a6af202c-6e78-4a11-bb1b-baaed3a05d0f', 'name': '', 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3', 'tenant_id': '', 'mac_address': 'fa:16:3e:28:e3:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '977fe0e9-8a0a-404e-a73e-954fa21a98d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3171, 'fixed_ips': [{'subnet_id': 'bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7', 'ip_address': '172.20.0.5', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:08Z', 'updated_at': '2021-12-21T04:13:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:12.422910 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Checking router: 977fe0e9-8a0a-404e-a73e-954fa21a98d6 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:12.422910 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Updating router 977fe0e9-8a0a-404e-a73e-954fa21a98d6 port a6af202c-6e78-4a11-bb1b-baaed3a05d0f binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:13:12.452466 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.626027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.691585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Deleting port a6af202c-6e78-4a11-bb1b-baaed3a05d0f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:12.692336 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.754728 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.755959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.757288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-171cb969-3129-414d-b23a-d13a4c05d53a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 1.1312399 Dec 21 04:13:12.760094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59640) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:12.765322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Request body: {'router': {'admin_state_up': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:12.795738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.810511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Calling delete_port for a6af202c-6e78-4a11-bb1b-baaed3a05d0f owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:12.856576 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.937100 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90076281-d22d-4e6d-80ed-99c6bcaa3052 None None] Pushing event updated for resources: {'Port': ['ID=a6af202c-6e78-4a11-bb1b-baaed3a05d0f,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:12.941953 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Attempting to bind port a6af202c-6e78-4a11-bb1b-baaed3a05d0f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:12.942606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Attempting to bind port a6af202c-6e78-4a11-bb1b-baaed3a05d0f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '092b7aad-70f1-4ce1-ab68-366e3f45cc2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:12.943257 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Attempting to bind port a6af202c-6e78-4a11-bb1b-baaed3a05d0f on network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:12.950161 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:12.950898 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Checking segment: {'id': '092b7aad-70f1-4ce1-ab68-366e3f45cc2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:12.951559 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:12.952164 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Bound using segment: {'id': '092b7aad-70f1-4ce1-ab68-366e3f45cc2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:12.953044 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Bound port: a6af202c-6e78-4a11-bb1b-baaed3a05d0f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '092b7aad-70f1-4ce1-ab68-366e3f45cc2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '4f1de5b4-1469-4aea-ac9f-b8faafbb90b3'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:12.954522 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.022354 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] For port a6af202c-6e78-4a11-bb1b-baaed3a05d0f, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:13.026135 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] For port a6af202c-6e78-4a11-bb1b-baaed3a05d0f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6af202c-6e78-4a11-bb1b-baaed3a05d0f,segment=NetworkSegment(092b7aad-70f1-4ce1-ab68-366e3f45cc2f),segment_id=092b7aad-70f1-4ce1-ab68-366e3f45cc2f)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:13.082274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2832d3b4-d53d-4a21-9c5a-3ed0b7c9ebb8 req-d97d10ed-8d03-4e49-9221-08489e61ed3b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.0943956 Dec 21 04:13:13.086482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.097273 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.162337 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Routers {'977fe0e9-8a0a-404e-a73e-954fa21a98d6'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:13.162972 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['977fe0e9-8a0a-404e-a73e-954fa21a98d6'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:13.167806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90076281-d22d-4e6d-80ed-99c6bcaa3052 None None] Pushing event updated for resources: {'Port': ['ID=a6af202c-6e78-4a11-bb1b-baaed3a05d0f,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:13.202012 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.234286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.275299 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event deleted for resources: {'Port': ['ID=a6af202c-6e78-4a11-bb1b-baaed3a05d0f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:13.299293 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] Set router 977fe0e9-8a0a-404e-a73e-954fa21a98d6 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:13.368586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '977fe0e9-8a0a-404e-a73e-954fa21a98d6', 'name': '', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:07Z', 'updated_at': '2021-12-21T04:13:12Z', 'revision_number': 4, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:13.423525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.430065 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1f3ae2-ab35-47f6-a132-9ed43cc1f71c None None] The sync data for ids ['977fe0e9-8a0a-404e-a73e-954fa21a98d6'] in n-d-822053-11 is: [{'id': '977fe0e9-8a0a-404e-a73e-954fa21a98d6', 'name': '', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:07Z', 'updated_at': '2021-12-21T04:13:12Z', 'revision_number': 4, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:13.531456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c64641f-4495-48d0-8bfa-5b50a8e02552 req-afe6511b-f8c1-4998-acec-e8efca8c24dd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0427983 Dec 21 04:13:13.540635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Router 633a12af-061c-47aa-b86c-0df5001cbf91 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:13.594324 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.597284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.662864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:13.679422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] Sync routers for ids ['633a12af-061c-47aa-b86c-0df5001cbf91'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:13.695567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.699156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0b7b8433-f497-4282-a615-7282c0a46885 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "PUT /v2.0/routers/633a12af-061c-47aa-b86c-0df5001cbf91 HTTP/1.1" status: 200 len: 693 time: 0.9357793 Dec 21 04:13:13.699479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59652) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:13.710891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] Routers {'633a12af-061c-47aa-b86c-0df5001cbf91'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:13.713734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633a12af-061c-47aa-b86c-0df5001cbf91'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:13.810914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-69c0375c-7a4b-4fd2-9c97-407782c13cd2 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/routers/633a12af-061c-47aa-b86c-0df5001cbf91 HTTP/1.1" status: 200 len: 699 time: 0.1077514 Dec 21 04:13:13.811295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:13.849089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] Set router 633a12af-061c-47aa-b86c-0df5001cbf91 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:13.850049 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eccba7be-adcd-4df9-b85c-b1b2c3d46976 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=633a12af-061c-47aa-b86c-0df5001cbf91 HTTP/1.1" status: 200 len: 205 time: 0.0373342 Dec 21 04:13:13.852396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59656) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:13.865596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.870408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 977fe0e9-8a0a-404e-a73e-954fa21a98d6 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:13.879693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.881250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b97d8b8-8d89-41d8-8c7a-9aecfba21b46 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/routers/977fe0e9-8a0a-404e-a73e-954fa21a98d6 HTTP/1.1" status: 204 len: 168 time: 2.1770718 Dec 21 04:13:13.884216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:13.941976 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '633a12af-061c-47aa-b86c-0df5001cbf91', 'name': 'tempest-RoutersTest-router-959186144', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:11Z', 'updated_at': '2021-12-21T04:13:13Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:13.947525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Deleting subnet bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:13:13.951271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.975197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:13.980720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] Checking router: 633a12af-061c-47aa-b86c-0df5001cbf91 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:14.000716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.007304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] Routers {'633a12af-061c-47aa-b86c-0df5001cbf91'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:14.009750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633a12af-061c-47aa-b86c-0df5001cbf91'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:14.060030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.123040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] Set router 633a12af-061c-47aa-b86c-0df5001cbf91 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:14.215685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '633a12af-061c-47aa-b86c-0df5001cbf91', 'name': 'tempest-RoutersTest-router-959186144', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:11Z', 'updated_at': '2021-12-21T04:13:13Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:14.231632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.255198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.256965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca6d4df9-5ed7-48c2-9224-b25731306608 None None] The sync data for ids ['633a12af-061c-47aa-b86c-0df5001cbf91'] in n-d-822053-11 is: [{'id': '633a12af-061c-47aa-b86c-0df5001cbf91', 'name': 'tempest-RoutersTest-router-959186144', 'tenant_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:11Z', 'updated_at': '2021-12-21T04:13:13Z', 'revision_number': 2, 'project_id': 'd9899eda11e44c4bb33e28a84396d3d7', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:14.274812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.291305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:14.293443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.299453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e77e26a2-51e9-4eed-99b9-d6020c7890ec tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/subnets/bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7 HTTP/1.1" status: 204 len: 168 time: 0.4115448 Dec 21 04:13:14.300460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59666) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.358892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-898de0f6-609c-49da-bdf9-f2b2edbc4a7e req-09267c0f-3be7-4247-a1b6-d9dbf53ed298 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.0964630 Dec 21 04:13:14.420316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.518751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.520031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.521691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Fanout notify agent at l3_agent the message router_deleted on router 633a12af-061c-47aa-b86c-0df5001cbf91 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:14.538619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.542949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c186f4b-d31f-4a71-97d6-ea281e2ed80c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/633a12af-061c-47aa-b86c-0df5001cbf91 HTTP/1.1" status: 204 len: 168 time: 0.6895115 Dec 21 04:13:14.546252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59668) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.564693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4f1de5b4-1469-4aea-ac9f-b8faafbb90b3']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:14.599682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '092b7aad-70f1-4ce1-ab68-366e3f45cc2f') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:14.600266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '092b7aad-70f1-4ce1-ab68-366e3f45cc2f') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:14.603499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-19a63559-ab5d-4b79-9337-35f296c6e880 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=633a12af-061c-47aa-b86c-0df5001cbf91 HTTP/1.1" status: 200 len: 205 time: 0.0523975 Dec 21 04:13:14.604013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59672) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.637410 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.669783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.678511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Releasing vlan 120 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:13:14.679049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: items = [ Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:13:14.681039 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:13:14.742360 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-10fdf746-7eb5-436b-a441-d44f9da0d69a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:14.743108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-10fdf746-7eb5-436b-a441-d44f9da0d69a tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/633a12af-061c-47aa-b86c-0df5001cbf91 HTTP/1.1" status: 404 len: 336 time: 0.1352515 Dec 21 04:13:14.748130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59674) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.807047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6c4f945-c429-478e-9277-c7c8761bf49c req-c1e1c52f-6969-456a-bcba-af0a6bcda763 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0892024 Dec 21 04:13:14.808958 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d1de0e0f-ac15-46af-8e98-5883708c1ef6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:14.809394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d1de0e0f-ac15-46af-8e98-5883708c1ef6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:14.815554 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.815694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d1de0e0f-ac15-46af-8e98-5883708c1ef6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/a5cd7b41-e5a0-48f2-89ea-c83cd0f0b666 HTTP/1.1" status: 404 len: 337 time: 0.0658069 Dec 21 04:13:14.856402 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b5bcf438-7492-42f6-ba17-b312a64d7a25 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:14.856867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b5bcf438-7492-42f6-ba17-b312a64d7a25 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:14.862068 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b5bcf438-7492-42f6-ba17-b312a64d7a25 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/0fbde120-5987-49c0-b940-055555de26c4 HTTP/1.1" status: 404 len: 337 time: 0.0438073 Dec 21 04:13:14.862297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59678) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.890695 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c70c27b-f328-4075-9f4e-e84a7524108c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:14.896443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3c70c27b-f328-4075-9f4e-e84a7524108c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:14.896443 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3c70c27b-f328-4075-9f4e-e84a7524108c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/005dd663-df91-429f-a13b-31158a0a285c HTTP/1.1" status: 404 len: 337 time: 0.0310235 Dec 21 04:13:14.897907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59680) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:14.899115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.906740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 21 04:13:14.920806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:14.924361 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/networks/4f1de5b4-1469-4aea-ac9f-b8faafbb90b3 HTTP/1.1" status: 204 len: 168 time: 0.6234145 Dec 21 04:13:14.930503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ecbd926-d8e1-4a00-b4e5-ded0da2c9774 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event deleted for resources: {'Network': ['ID=4f1de5b4-1469-4aea-ac9f-b8faafbb90b3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:14.968265 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-04cbccb8-64a0-4a9e-964d-2afd8b6072f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:14.970713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-04cbccb8-64a0-4a9e-964d-2afd8b6072f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:14.973468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-04cbccb8-64a0-4a9e-964d-2afd8b6072f6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/9b2363e5-033b-431f-bd9b-32df9784fb2e HTTP/1.1" status: 404 len: 337 time: 0.0745473 Dec 21 04:13:14.976501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.066444 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b5b4f4f-4c95-482a-9da7-5262de9a09a6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 200 len: 205 time: 0.0887196 Dec 21 04:13:15.073150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59688) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.217693 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-05b121ae-25e8-4248-a87e-36b0eb1bdc6e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:15.223665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-05b121ae-25e8-4248-a87e-36b0eb1bdc6e tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/3629bfb8-c770-438f-a801-5c83107ae8bf HTTP/1.1" status: 404 len: 336 time: 0.1490827 Dec 21 04:13:15.231015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59692) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.300614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-9248a899-acc3-426e-9a1d-b1113c214e23 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:15.313839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-9248a899-acc3-426e-9a1d-b1113c214e23 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 814 time: 0.4261651 Dec 21 04:13:15.323149 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-029a614d-15da-40c2-85d1-5189d6f137a0 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=f0a495c9-2d29-4255-a4c1-56370cafce12 HTTP/1.1" status: 200 len: 205 time: 0.0895283 Dec 21 04:13:15.326252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59696) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.398373 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-ff4c536f-dfa1-45fd-9d2b-24a49282928b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:15.399432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ff4c536f-dfa1-45fd-9d2b-24a49282928b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/f0a495c9-2d29-4255-a4c1-56370cafce12 HTTP/1.1" status: 404 len: 336 time: 0.0739338 Dec 21 04:13:15.403069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59700) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.507838 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-20edd824-7a7d-4e8c-9790-6dbfd9f0f953 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:15.511309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-c1742a9c-8d62-47a2-9df5-eb9301710fba tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=620778ddaf44496aa625b5014155c9de HTTP/1.1" status: 200 len: 380 time: 0.1792328 Dec 21 04:13:15.518479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-20edd824-7a7d-4e8c-9790-6dbfd9f0f953 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:15.522252 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-20edd824-7a7d-4e8c-9790-6dbfd9f0f953 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/e7de69a0-4f46-40a4-a48d-2a28c005f48e HTTP/1.1" status: 404 len: 337 time: 0.1178861 Dec 21 04:13:15.532055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59704) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.533765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'port': {'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'admin_state_up': True, 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'security_groups': ['3549b741-8ac3-4c54-9db1-691842885eb8']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:15.577478 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ddf7ae9d-7c79-484e-adc5-41c2a0fea6a7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 200 len: 205 time: 0.0439627 Dec 21 04:13:15.582282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59706) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.596113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9149fcf9-edbd-4597-901d-9783409d408f req-07ed901f-33ef-4e64-a6a3-ea44b969aee2 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.0449009 Dec 21 04:13:15.632574 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-e0bcee1d-a971-4ce3-87c4-e5a601c9108c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:15.633572 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e0bcee1d-a971-4ce3-87c4-e5a601c9108c tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/ef80e42a-1705-49b5-b699-c294920ad893 HTTP/1.1" status: 404 len: 336 time: 0.0503757 Dec 21 04:13:15.636379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59712) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.665803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.669492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e2ca441-264d-41e3-8b4b-da5c81ea35a6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e HTTP/1.1" status: 200 len: 205 time: 0.0320783 Dec 21 04:13:15.671929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59718) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.681814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'name': 'tempest-router--1676069636', 'project_id': 'd542caee01c944ee8f68a586aea07ee1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:15.743247 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-98e033d2-ad23-4bb6-8c56-377180e271bc tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:15.744387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98e033d2-ad23-4bb6-8c56-377180e271bc tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/9a8f8504-ff0b-4f9d-b2e8-23e7ea3cd48e HTTP/1.1" status: 404 len: 336 time: 0.0716295 Dec 21 04:13:15.747300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59726) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.782494 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-15c482a0-32d0-452a-ab83-33a2994899b7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:15.783118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-15c482a0-32d0-452a-ab83-33a2994899b7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:15.786564 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-15c482a0-32d0-452a-ab83-33a2994899b7 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/d7072066-5fd5-470f-a626-6f627b54be37 HTTP/1.1" status: 404 len: 337 time: 0.0379276 Dec 21 04:13:15.789161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59728) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.819422 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73baf49c-c8b1-4c53-9096-5850792e48f4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=3caca355-993b-4367-9dd9-23035ae8dd2f HTTP/1.1" status: 200 len: 205 time: 0.0288451 Dec 21 04:13:15.821551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59730) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.859562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Made reservation on behalf of 620778ddaf44496aa625b5014155c9de for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:15.863558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:15.908014 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-1d91926c-4d6a-4360-b0c7-c051e4bae3a8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:15.911452 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d91926c-4d6a-4360-b0c7-c051e4bae3a8 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/3caca355-993b-4367-9dd9-23035ae8dd2f HTTP/1.1" status: 404 len: 336 time: 0.0864785 Dec 21 04:13:15.911452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:15.911452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:15.916561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59734) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:15.951899 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f583684-3e99-4695-8a40-42834b1691b9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:15.952647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9f583684-3e99-4695-8a40-42834b1691b9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:15.960277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9f583684-3e99-4695-8a40-42834b1691b9 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/e3dc1ab4-c416-4896-8225-d9e2ebfcc58a HTTP/1.1" status: 404 len: 337 time: 0.0424240 Dec 21 04:13:15.962415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59736) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:16.002719 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-194788bc-3d5e-4dc4-9c0c-025d8935879b tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e5ca073-9ee5-4a7e-83ed-57fc750be120 HTTP/1.1" status: 200 len: 205 time: 0.0386293 Dec 21 04:13:16.003848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:16.020725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Allocated IP 172.20.0.14 (9e019c2c-b199-4210-baef-b6bda8c43e06/d1e185a5-063a-405d-ae9d-3ac5d19302c8/66e81b00-da04-499e-996a-ce50856ba3df) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:16.076364 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-4123f6ad-fb60-45e5-9fe3-087d819298c4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] delete failed (client error): The resource could not be found. Dec 21 04:13:16.081739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4123f6ad-fb60-45e5-9fe3-087d819298c4 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/routers/1e5ca073-9ee5-4a7e-83ed-57fc750be120 HTTP/1.1" status: 404 len: 336 time: 0.0741405 Dec 21 04:13:16.111845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59740) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:16.134025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.156268 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-74dd0bfd-501d-4c8b-9ebb-732123dc2f35 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:16.156739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-74dd0bfd-501d-4c8b-9ebb-732123dc2f35 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:16.167542 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74dd0bfd-501d-4c8b-9ebb-732123dc2f35 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/781d54cb-32cd-4268-9fed-8839d7a5c66a HTTP/1.1" status: 404 len: 337 time: 0.0543232 Dec 21 04:13:16.168256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59746) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:16.225974 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-252b49ed-ca9f-4389-badd-151d997a47d6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] DELETE failed (client error): The resource could not be found. Dec 21 04:13:16.226801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-252b49ed-ca9f-4389-badd-151d997a47d6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:13:16.234409 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-252b49ed-ca9f-4389-badd-151d997a47d6 tempest-RoutersTest-901373053 tempest-RoutersTest-901373053-project] 10.222.0.18 "DELETE /v2.0/subnets/fe4221c6-2b9e-4315-a77a-14834fb1e3ba HTTP/1.1" status: 404 len: 337 time: 0.0650949 Dec 21 04:13:16.237219 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.259646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.344763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.345994 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-750f02e9-08ef-4779-823a-ee9c54a03d8a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.6753280 Dec 21 04:13:16.348707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59750) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:16.358652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b8714fa-027b-4b52-962b-a39900d97d36 req-b797a75e-bfd2-455b-bc09-5747919febe2 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0722451 Dec 21 04:13:16.476467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b0986ac-e601-41c2-b0eb-2642cbf5ee49 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:16.478135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b0986ac-e601-41c2-b0eb-2642cbf5ee49 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 805 time: 0.1929393 Dec 21 04:13:16.489252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.498121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.510967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Request body: {'port': {'device_id': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'admin_state_up': True, 'tenant_id': '4e189e2b3dc14c41a4d5a480b6c44355'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:16.636567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:16.665734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:16.672455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:16.704036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'Port': ['ID=66e81b00-da04-499e-996a-ce50856ba3df,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:16.781840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.795716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.893725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:16.894907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.923827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-105a6286-4de3-4b1e-bf30-c456a963d077 req-435bf780-4469-41cd-9384-0577b1c2e6cb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.1577029 Dec 21 04:13:16.988745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:16.989270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 8c594b08-a0fb-47f8-89e3-0110bea6a715 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:16.999683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.003718 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f74b5270-be77-44a8-b532-8d844bfacd2e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/routers/8c594b08-a0fb-47f8-89e3-0110bea6a715 HTTP/1.1" status: 204 len: 168 time: 0.6541486 Dec 21 04:13:17.010280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59770) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:17.030594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-5e42e714-9946-41d0-8272-06c8f2091290 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5108922 Dec 21 04:13:17.062329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Request body: {'port': {'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:17.092393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d6858413-b465-4090-ba90-125fd8eb3983 None None] Provisioning complete for port 66e81b00-da04-499e-996a-ce50856ba3df triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:17.092962 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6858413-b465-4090-ba90-125fd8eb3983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.175241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d6858413-b465-4090-ba90-125fd8eb3983 None None] Port 66e81b00-da04-499e-996a-ce50856ba3df cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:17.190377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Made reservation on behalf of 4e189e2b3dc14c41a4d5a480b6c44355 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:17.194067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.253177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-537f782e-bbe3-4e5e-bada-3983b1023cc0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d9899eda11e44c4bb33e28a84396d3d7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2389150 Dec 21 04:13:17.253628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59774) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:17.255973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.327081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e779a5c3-fdf9-447e-8384-1ee40833521e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.363514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59776) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:17.382256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e779a5c3-fdf9-447e-8384-1ee40833521e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.580321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Allocated IP 172.20.0.7 (800834e6-2709-4cb2-81c2-4c16d3d000fa/59294161-9bfc-416e-a51d-c4b1c78a016d/757b9fc9-1d7b-47c6-b195-673ac7d7799b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:17.585731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e779a5c3-fdf9-447e-8384-1ee40833521e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.589789 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e779a5c3-fdf9-447e-8384-1ee40833521e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.593472 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e779a5c3-fdf9-447e-8384-1ee40833521e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1d707fb9-dafd-472a-98d3-cd08816ea15a HTTP/1.1" status: 204 len: 168 time: 0.3360646 Dec 21 04:13:17.621900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e779a5c3-fdf9-447e-8384-1ee40833521e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d707fb9-dafd-472a-98d3-cd08816ea15a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:17.711838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04774a2f-ef46-4b5d-8727-e6ea012ae546 req-f0b51d85-0b40-4856-bbc5-d504b8a75dd3 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:17.713483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04774a2f-ef46-4b5d-8727-e6ea012ae546 req-f0b51d85-0b40-4856-bbc5-d504b8a75dd3 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 932 time: 0.1954162 Dec 21 04:13:17.742704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-971339088', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:17.826737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04774a2f-ef46-4b5d-8727-e6ea012ae546 req-90499306-1906-4887-9103-b705415d2cc8 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1009579 Dec 21 04:13:17.902729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:17.904662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.030711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.371534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.426678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 66e81b00-da04-499e-996a-ce50856ba3df {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:13:18.434657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.447075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Transition to ACTIVE for port object 66e81b00-da04-499e-996a-ce50856ba3df will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:13:18.498009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.541007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.627780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcfe2fa3-65a6-4c61-8047-cfb6277beb40 req-9a9fdc1c-568c-4f3a-8fee-ae05dc274514 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.1789813 Dec 21 04:13:18.631509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.658822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:18.663954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:18.666559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:13:18.694645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:18.745905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06de90d7-393a-4680-9ffc-8f550b19a13f None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:18.814741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:18.818805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:18.821278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Pushing event updated for resources: {'Port': ['ID=66e81b00-da04-499e-996a-ce50856ba3df,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:18.991309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f3bf9a05-bebb-4484-9917-39db2a6ae821 None None] Provisioning complete for port 757b9fc9-1d7b-47c6-b195-673ac7d7799b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:18.991816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f3bf9a05-bebb-4484-9917-39db2a6ae821 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.036307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.061544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.142923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Attempting to bind port 66e81b00-da04-499e-996a-ce50856ba3df on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:19.143587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Attempting to bind port 66e81b00-da04-499e-996a-ce50856ba3df by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:19.144113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Attempting to bind port 66e81b00-da04-499e-996a-ce50856ba3df on network 9e019c2c-b199-4210-baef-b6bda8c43e06 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:19.157833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.6541846 Dec 21 04:13:19.165176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Port 66e81b00-da04-499e-996a-ce50856ba3df on network 9e019c2c-b199-4210-baef-b6bda8c43e06 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:13:19.165494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Attempting to bind port 66e81b00-da04-499e-996a-ce50856ba3df on network 9e019c2c-b199-4210-baef-b6bda8c43e06 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:19.168361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b599bf7-211f-436c-a66e-566d1e0db46f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event updated for resources: {'Port': ['ID=757b9fc9-1d7b-47c6-b195-673ac7d7799b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:19.180745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:19.181117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Checking segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:19.181486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Bound using segment: {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:19.181917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Bound port: 66e81b00-da04-499e-996a-ce50856ba3df, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45d2d62f-06f1-4722-95eb-827c5ff84c72', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:19.182282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.190781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Request body: {'port': {'device_id': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:19.202384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94208784-e4b4-4913-aebc-46b9c89200ac req-a85c56f1-130e-4045-8438-a7d3d79a00e5 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:19.204253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94208784-e4b4-4913-aebc-46b9c89200ac req-a85c56f1-130e-4045-8438-a7d3d79a00e5 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.1295056 Dec 21 04:13:19.204723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f3bf9a05-bebb-4484-9917-39db2a6ae821 None None] Port 757b9fc9-1d7b-47c6-b195-673ac7d7799b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:19.236331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Allocated IP 172.25.5.239 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/51ce6a10-a01f-4cd5-8b5e-0742a859757b) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:19.375110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94208784-e4b4-4913-aebc-46b9c89200ac req-32ddf5dd-fd85-4976-bcc1-8dc5a7449a28 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1430359 Dec 21 04:13:19.391489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.412865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59822) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:19.418698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] For port 66e81b00-da04-499e-996a-ce50856ba3df, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:19.444816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] For port 66e81b00-da04-499e-996a-ce50856ba3df, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=66e81b00-da04-499e-996a-ce50856ba3df,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:19.511730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.545113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.697605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:19.698318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.700152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] 10.222.0.31 "PUT /v2.0/ports/66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 1093 time: 2.6470063 Dec 21 04:13:19.700632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:19.704126 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3" -d '{"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:19.732078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.749628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14196256-e39d-4bd0-8bf2-2d5ffd3604bb service neutron] Pushing event updated for resources: {'Port': ['ID=66e81b00-da04-499e-996a-ce50856ba3df,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:19.829705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:19.837354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:19.841044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--1121117173'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:19.842071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:19.851239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e05930fe-4786-45a6-bbb2-8c3bc8ceca85 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:19.860084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34ee9223-c9cf-4834-9ecf-6bea38b82eb7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:19.864488 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:13:19.892247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event updated for resources: {'Port': ['ID=51ce6a10-a01f-4cd5-8b5e-0742a859757b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:19.913133 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-060e5e15-4366-40eb-80b1-f3391e0f99c2 x-openstack-request-id: req-060e5e15-4366-40eb-80b1-f3391e0f99c2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:19.913668 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:19.914066 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-060e5e15-4366-40eb-80b1-f3391e0f99c2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:19.914486 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'status': 'completed', 'code': 200} Dec 21 04:13:20.002613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e2da4f80-65e8-41ce-92b2-c03f94e7982a None None] Provisioning complete for port 51ce6a10-a01f-4cd5-8b5e-0742a859757b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:20.003002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2da4f80-65e8-41ce-92b2-c03f94e7982a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.028187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.091812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e2da4f80-65e8-41ce-92b2-c03f94e7982a None None] Port 51ce6a10-a01f-4cd5-8b5e-0742a859757b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:20.109745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.201421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80ca771-cc4d-42d4-a49f-dc0ed4195c94 req-eb1b14e1-cab2-47fa-ac84-3737e5d40b25 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:20.206520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c80ca771-cc4d-42d4-a49f-dc0ed4195c94 req-eb1b14e1-cab2-47fa-ac84-3737e5d40b25 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 931 time: 0.2698009 Dec 21 04:13:20.222898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-b5bd564d-30ce-4872-bb4a-c097f0f325cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:20.222898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-b5bd564d-30ce-4872-bb4a-c097f0f325cb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1096 time: 0.3048310 Dec 21 04:13:20.361673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 757b9fc9-1d7b-47c6-b195-673ac7d7799b {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:13:20.362021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.396917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c80ca771-cc4d-42d4-a49f-dc0ed4195c94 req-11bb5fe6-e79d-4da5-b61f-2e649d0d6c2c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1756508 Dec 21 04:13:20.398701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.405715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-ffc8f3be-de48-4a30-acfa-72c6b383edc4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 217 time: 0.1591210 Dec 21 04:13:20.475357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Transition to ACTIVE for port object 757b9fc9-1d7b-47c6-b195-673ac7d7799b will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:13:20.495298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-9b492e17-4162-448f-bc16-2a4c27597818 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:20.498128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-9b492e17-4162-448f-bc16-2a4c27597818 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.0804603 Dec 21 04:13:20.535533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.575316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.683622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Pushing event updated for resources: {'Port': ['ID=757b9fc9-1d7b-47c6-b195-673ac7d7799b,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:20.695482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.702738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27bbde27-a87b-44fb-92cc-7b9b73d7e18e None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:20.741304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e9961a41-7db2-4fcd-92c0-ea404df387c0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:20.864138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:20.991554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.018647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Attempting to bind port 757b9fc9-1d7b-47c6-b195-673ac7d7799b on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:21.024925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Attempting to bind port 757b9fc9-1d7b-47c6-b195-673ac7d7799b by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:21.024925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Attempting to bind port 757b9fc9-1d7b-47c6-b195-673ac7d7799b on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:21.055518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.067182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-9fbb763f-25a9-4cac-b25f-7c8410cdafeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:21.067182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-9fbb763f-25a9-4cac-b25f-7c8410cdafeb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.5559449 Dec 21 04:13:21.070671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Port 757b9fc9-1d7b-47c6-b195-673ac7d7799b on network 800834e6-2709-4cb2-81c2-4c16d3d000fa not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:13:21.071124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Attempting to bind port 757b9fc9-1d7b-47c6-b195-673ac7d7799b on network 800834e6-2709-4cb2-81c2-4c16d3d000fa {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:13:21.082404 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:13:21.085031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8abf4d59-8a61-4dd5-9d94-b74262eac210 req-17e05415-1806-4f33-99df-e24b61208f49 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:21.095912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8abf4d59-8a61-4dd5-9d94-b74262eac210 req-17e05415-1806-4f33-99df-e24b61208f49 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.5546248 Dec 21 04:13:21.229183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=062b5070-4a4b-454b-a69f-a93addb6f890,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:21.243647 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.248607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:21.249028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89c864c2-7786-438d-bbec-4db2c0640198 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 1.8357334 Dec 21 04:13:21.257023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 12, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:21.257516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Checking segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:21.262993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Bound using segment: {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:21.262993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Bound port: 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4018761-5441-4eba-87c7-cb96ec8da5a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:21.262993 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.290467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Router a1dc63ba-19ad-49f1-8ca5-d3867803ea90 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:21.296576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8abf4d59-8a61-4dd5-9d94-b74262eac210 req-ba6aebc5-7400-4f20-90e9-e9b3800ff725 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2040346 Dec 21 04:13:21.305242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-d4b7ab9b-d2ed-43b6-b328-f15126431033 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1897352 Dec 21 04:13:21.451366 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4bc88481-444d-44cb-a1e5-ca4655086746 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.2008917 Dec 21 04:13:21.456264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] For port 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:21.459992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59884) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:21.467846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] For port 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:21.509406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81f7ab92-0df1-4320-999b-4d536dca2f84 req-07e90eb5-ee4e-4cda-9390-940d4495de64 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1750600 Dec 21 04:13:21.530334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-security--669602510', 'description': 'tempest-security-description-1799382967'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:21.568719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.605664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-098e28e4-e07c-4820-96ad-9319335904a3 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:21.619184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.638654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:21.642611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:21.643266 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.644713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] 10.222.0.31 "PUT /v2.0/ports/757b9fc9-1d7b-47c6-b195-673ac7d7799b HTTP/1.1" status: 200 len: 1092 time: 2.4589441 Dec 21 04:13:21.655751 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] Sync routers for ids ['a1dc63ba-19ad-49f1-8ca5-d3867803ea90'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:21.679761 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] Routers {'a1dc63ba-19ad-49f1-8ca5-d3867803ea90'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:21.680659 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1dc63ba-19ad-49f1-8ca5-d3867803ea90'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:21.689407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2dad5b8-469b-4f5d-9519-01d5351f2e97 req-eaa12db1-93f3-43ee-b328-cd4f0fee189c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:21.691557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2dad5b8-469b-4f5d-9519-01d5351f2e97 req-eaa12db1-93f3-43ee-b328-cd4f0fee189c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 943 time: 0.1662440 Dec 21 04:13:21.745941 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc5610b-3a52-4897-87b0-64d5966ae1ba service neutron] Pushing event updated for resources: {'Port': ['ID=757b9fc9-1d7b-47c6-b195-673ac7d7799b,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:21.749643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.759960 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:21.775825 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] Routers {'a1dc63ba-19ad-49f1-8ca5-d3867803ea90'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:21.777202 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:12:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a1dc63ba-19ad-49f1-8ca5-d3867803ea90'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:21.817688 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:21.818356 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb5a8ad4-2d0d-4355-b8aa-df33a602de51 None None] The sync data for ids ['a1dc63ba-19ad-49f1-8ca5-d3867803ea90'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:21.844380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.848403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-67015892-a7d0-42cd-b09f-8902ea4bb1ff tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 4.4804103 Dec 21 04:13:21.848914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59886) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:21.872143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2dad5b8-469b-4f5d-9519-01d5351f2e97 req-bf419b43-3505-49d0-b29a-e640d563da2c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1501787 Dec 21 04:13:21.879916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-7a7f9475-9f4a-4cb8-8194-2563cb65fcce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:21.881522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-7a7f9475-9f4a-4cb8-8194-2563cb65fcce service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1096 time: 0.1561153 Dec 21 04:13:21.891479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-c462776f-0e80-4efc-a576-924eb721cd8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:21.894041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-c462776f-0e80-4efc-a576-924eb721cd8b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 1095 time: 0.1149359 Dec 21 04:13:21.910242 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.914152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:21.919522 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "PUT /v2.0/security-groups/062b5070-4a4b-454b-a69f-a93addb6f890 HTTP/1.1" status: 200 len: 1796 time: 0.4551091 Dec 21 04:13:21.932416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'tag': '757b9fc9-1d7b-47c6-b195-673ac7d7799b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:21.935817 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee73c9d4-8cad-4752-9b79-effaae2956c6" -d '{"events": [{"name": "network-changed", "server_uuid": "d38dd2ca-4899-4a5a-8f18-3bb66d5f1040", "tag": "757b9fc9-1d7b-47c6-b195-673ac7d7799b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:21.952399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:21.953318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-531d5912-8b00-48b3-bf45-6d74cd07c7e5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=062b5070-4a4b-454b-a69f-a93addb6f890,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:22.046413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1ee1ca1f-1f15-452e-b545-f4cfa5b9c3f2 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups/062b5070-4a4b-454b-a69f-a93addb6f890 HTTP/1.1" status: 200 len: 1796 time: 0.0902224 Dec 21 04:13:22.047206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59892) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:22.054448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-de5d92de-e8c8-4b02-a537-ee1364d6ac9a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b HTTP/1.1" status: 200 len: 217 time: 0.1034431 Dec 21 04:13:22.058876 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c3a433b-4f9a-49ca-b06a-d783231f8a30 x-openstack-request-id: req-5c3a433b-4f9a-49ca-b06a-d783231f8a30 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:22.059199 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d38dd2ca-4899-4a5a-8f18-3bb66d5f1040", "tag": "757b9fc9-1d7b-47c6-b195-673ac7d7799b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:22.059461 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5c3a433b-4f9a-49ca-b06a-d783231f8a30 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:22.059865 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'tag': '757b9fc9-1d7b-47c6-b195-673ac7d7799b', 'status': 'completed', 'code': 200} Dec 21 04:13:22.101383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2bc9d1f3-8aeb-45d8-8347-75c691e4f7ce tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/a1dc63ba-19ad-49f1-8ca5-d3867803ea90 HTTP/1.1" status: 200 len: 920 time: 0.2487099 Dec 21 04:13:22.103210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:22.139840 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b7b753ca-db36-4755-b829-6b93453abe95 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=a1dc63ba-19ad-49f1-8ca5-d3867803ea90 HTTP/1.1" status: 200 len: 205 time: 0.0331931 Dec 21 04:13:22.143566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59896) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:22.157193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-f01fcb15-5640-4876-b4d2-a6069692e30c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:22.158691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-f01fcb15-5640-4876-b4d2-a6069692e30c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0610271 Dec 21 04:13:22.188742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42bcf80a-8983-4974-8beb-e0ef6e23b215 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.209220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-ef312c9b-90d9-4a2f-bbca-8ac5638aebcc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0369353 Dec 21 04:13:22.225440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42bcf80a-8983-4974-8beb-e0ef6e23b215 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.311006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-e02a8587-32f3-48e7-9b8c-eb44aa728ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:22.314964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-e02a8587-32f3-48e7-9b8c-eb44aa728ed8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 915 time: 0.4197781 Dec 21 04:13:22.333527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.413512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-08e14a61-a1dd-480b-b265-90aa68ccd40f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 217 time: 0.0847330 Dec 21 04:13:22.504947 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.527583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42bcf80a-8983-4974-8beb-e0ef6e23b215 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.530529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-42bcf80a-8983-4974-8beb-e0ef6e23b215 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.531949 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-42bcf80a-8983-4974-8beb-e0ef6e23b215 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/062b5070-4a4b-454b-a69f-a93addb6f890 HTTP/1.1" status: 204 len: 168 time: 0.4821861 Dec 21 04:13:22.535411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:22.561867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-b9553df4-6f98-49e7-a3fa-7ef2feaebde7 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3383739 Dec 21 04:13:22.574870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b30daa9-0b0b-4097-9917-431713b54327 req-b09cc869-ac02-4b47-8cf2-6f82406c5145 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:22.576771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b30daa9-0b0b-4097-9917-431713b54327 req-b09cc869-ac02-4b47-8cf2-6f82406c5145 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.1653183 Dec 21 04:13:22.579619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42bcf80a-8983-4974-8beb-e0ef6e23b215 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=062b5070-4a4b-454b-a69f-a93addb6f890,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:22.581854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-2e8f90a0-40a6-4223-acfc-2001b6fc6e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:22.584129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-2e8f90a0-40a6-4223-acfc-2001b6fc6e6b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.1495883 Dec 21 04:13:22.694346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14beec6e-7de5-4f49-bfd8-ab7561e9763e req-ed3460fa-6a68-46b2-9438-b7dd8acfaea2 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1091218 Dec 21 04:13:22.696484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17ddb13e-0e4b-46dc-880d-03248df730fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.700408 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e8294f87-c131-4d84-8866-313e9882d3b9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1638751 Dec 21 04:13:22.707580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59906) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:22.738400 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-2e1893e2-092e-497a-86ae-e928e75a9bb5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] delete failed (client error): The resource could not be found. Dec 21 04:13:22.744039 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e1893e2-092e-497a-86ae-e928e75a9bb5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/062b5070-4a4b-454b-a69f-a93addb6f890 HTTP/1.1" status: 404 len: 347 time: 0.0343776 Dec 21 04:13:22.753607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:22.753607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--1571057326'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:22.758889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Deleting port 51ce6a10-a01f-4cd5-8b5e-0742a859757b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:22.759270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.775338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-f93afe01-0c56-4ca5-98ea-f81b983b9356 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:22.780497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-f93afe01-0c56-4ca5-98ea-f81b983b9356 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0805340 Dec 21 04:13:22.789702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b30daa9-0b0b-4097-9917-431713b54327 req-572f610d-c8e8-4815-a98c-358dd896ec2b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1029918 Dec 21 04:13:22.910464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.911988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:22.938379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Calling delete_port for 51ce6a10-a01f-4cd5-8b5e-0742a859757b owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:22.940856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.024524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-404b7b17-0329-460a-bb9b-6f2692443e40 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2271693 Dec 21 04:13:23.035381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-5c0f0a42-97e0-48b5-912d-9fc469589d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:23.036297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-5c0f0a42-97e0-48b5-912d-9fc469589d22 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 1095 time: 0.0951233 Dec 21 04:13:23.169852 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.234476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ad030d-8cc9-4ccb-9a8a-b1615333dfa5 req-0e2db0ce-1f83-46f5-a5e7-f950f0d9af8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:23.236116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ad030d-8cc9-4ccb-9a8a-b1615333dfa5 req-0e2db0ce-1f83-46f5-a5e7-f950f0d9af8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 943 time: 0.2035944 Dec 21 04:13:23.293645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-d39fb314-08ec-4334-96ee-f925cecc11fc service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2541165 Dec 21 04:13:23.300019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.304146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-db332867-9577-4972-9791-3ac3c2dfe8a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:23.313202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-db332867-9577-4972-9791-3ac3c2dfe8a9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.2537618 Dec 21 04:13:23.316693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.352239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1e21a3f5-26e6-417e-a83b-cd71239558aa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:23.360753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ad030d-8cc9-4ccb-9a8a-b1615333dfa5 req-05eebad0-ce15-4a43-9671-4632f8912938 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1081662 Dec 21 04:13:23.384121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.385333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.388048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.388048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.388048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.388048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.388048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.388711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.389055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.389447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.389917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.390300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.390641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:23.393307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-ac12969b-7629-446b-bff1-fcd4b1670a86 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b HTTP/1.1" status: 200 len: 217 time: 0.0644143 Dec 21 04:13:23.395329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.429722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.433698 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-670021a3-7162-4444-90fe-47e23cb7d3be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.6832473 Dec 21 04:13:23.434057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event deleted for resources: {'Port': ['ID=51ce6a10-a01f-4cd5-8b5e-0742a859757b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:23.437242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59914) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:23.456241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96c8d49d-13c7-4eb0-9f49-5cedb916892c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:23.482990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '1e21a3f5-26e6-417e-a83b-cd71239558aa', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:23.503889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-7421f608-cff1-4099-9caf-633213767afc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:23.506235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-7421f608-cff1-4099-9caf-633213767afc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.1020010 Dec 21 04:13:23.550895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-66fb0563-95f3-4928-9f06-87a6349e6925 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0277989 Dec 21 04:13:23.551115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.656643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.658892 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.671334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-483e607b-7759-4f66-b5e1-c27a1b888809 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1154542 Dec 21 04:13:23.720318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.793330 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.793955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Fanout notify agent at l3_agent the message router_deleted on router a1dc63ba-19ad-49f1-8ca5-d3867803ea90 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:23.817834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.819329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a068b8a6-6ade-4dd5-b41c-ebaf84cbb48a tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/a1dc63ba-19ad-49f1-8ca5-d3867803ea90 HTTP/1.1" status: 204 len: 168 time: 1.6748157 Dec 21 04:13:23.829360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:23.836107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1539473652', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': False}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:23.866238 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.933514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee73c9d4-8cad-4752-9b79-effaae2956c6 req-c184a8a9-0f1b-40b0-846b-c50972c47f91 service neutron] 10.222.0.31 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2508037 Dec 21 04:13:23.950654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.974115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f9e98b16-2dba-405d-b7ec-2ecc80214a2f,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:23.990287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1808f0e2-888b-4010-afd7-ad9feb6bc735 req-0ab5c8f7-053a-4f53-9221-929f228fc43f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:23.991887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:23.992047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1808f0e2-888b-4010-afd7-ad9feb6bc735 req-0ab5c8f7-053a-4f53-9221-929f228fc43f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0751841 Dec 21 04:13:23.993359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.051834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1808f0e2-888b-4010-afd7-ad9feb6bc735 req-3ee3cb08-a154-429c-a493-03fd1b7d69d7 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519836 Dec 21 04:13:24.057201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.078081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.079330 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b881b548-0fb9-4820-9ed8-5dcd5c4b1a09 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6009324 Dec 21 04:13:24.088040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:24.123483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad6e6e-6741-430c-90e3-b27c0fe23b4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.132794 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad6e6e-6741-430c-90e3-b27c0fe23b4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.323019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad6e6e-6741-430c-90e3-b27c0fe23b4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.330722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad6e6e-6741-430c-90e3-b27c0fe23b4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.334255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-08ad6e6e-6741-430c-90e3-b27c0fe23b4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/f9e98b16-2dba-405d-b7ec-2ecc80214a2f HTTP/1.1" status: 204 len: 168 time: 0.2429223 Dec 21 04:13:24.335384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59924) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:24.340065 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.343669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ad6e6e-6741-430c-90e3-b27c0fe23b4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f9e98b16-2dba-405d-b7ec-2ecc80214a2f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:24.399649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b085f68f-2f08-4262-8bf4-e7730b2d71e3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0620744 Dec 21 04:13:24.402193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59930) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:24.470161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.518378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.534609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5981f7a-9eea-44f8-95c8-cca3da797ced req-d6cc4ddc-c85a-43d2-ac46-c9dcbe7e2edf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:24.536549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5981f7a-9eea-44f8-95c8-cca3da797ced req-d6cc4ddc-c85a-43d2-ac46-c9dcbe7e2edf tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 943 time: 0.0798609 Dec 21 04:13:24.606138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5981f7a-9eea-44f8-95c8-cca3da797ced req-2cc4df04-6a33-4435-874b-69adde83f363 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592871 Dec 21 04:13:24.640270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.659289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.679545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.682956 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.686567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/1e21a3f5-26e6-417e-a83b-cd71239558aa HTTP/1.1" status: 204 len: 168 time: 0.2810273 Dec 21 04:13:24.687530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59936) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:24.707249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e21a3f5-26e6-417e-a83b-cd71239558aa,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:24.720750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.721333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.721578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.721786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.722128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.722497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.722784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.723478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.723478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.723823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.724151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.724540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.724875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffa5991b-3c49-452c-b3b5-177f1392ffc7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:24.783088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b034c9b5-d217-40c0-84bc-5ac4631d47ab tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0932598 Dec 21 04:13:24.791169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:24.796650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--466380349'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:24.816598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Allocated IP 172.25.5.176 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/035fc274-9293-46ee-aaa0-40b628ae3810) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:24.929481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:24.985066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.059267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.068495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.069034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.069580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.105717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:25.113590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:25.118023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:25.140758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fc4e5c0-b147-40c4-aec4-c03c4b9c43ab None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:25.152553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Port': ['ID=035fc274-9293-46ee-aaa0-40b628ae3810,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:25.190615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.233002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-843167ed-d8cc-4bc3-bf41-cc352602ced2 req-4d434bdb-6f0a-49de-b142-dc195629d973 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:25.234546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-843167ed-d8cc-4bc3-bf41-cc352602ced2 req-4d434bdb-6f0a-49de-b142-dc195629d973 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0979791 Dec 21 04:13:25.240627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7cc4971b-6998-432a-ad54-e8fe64399879,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:25.256764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-da369478-9643-470e-a315-6c2df4e6cf01 None None] Provisioning complete for port 035fc274-9293-46ee-aaa0-40b628ae3810 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:25.257064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-da369478-9643-470e-a315-6c2df4e6cf01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.303994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-da369478-9643-470e-a315-6c2df4e6cf01 None None] Port 035fc274-9293-46ee-aaa0-40b628ae3810 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:25.307231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-843167ed-d8cc-4bc3-bf41-cc352602ced2 req-243a20ca-82f4-408e-9f30-7bdd83462c5e tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503638 Dec 21 04:13:25.343190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.343190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7ecc3783-4822-406c-b044-9a0314bc5993 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5443757 Dec 21 04:13:25.345652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59944) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:25.350391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '7cc4971b-6998-432a-ad54-e8fe64399879', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:25.520635 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.552276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.602143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.704484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 757b9fc9-1d7b-47c6-b195-673ac7d7799b details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:13:25.708561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.756620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e14be13e-2555-460d-83aa-b2ba9360dd1a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:25.798212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e17ef31-0013-4c2e-8900-ed0470d7eb1a req-cfa62302-e5dd-4059-adce-25397554c87c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:25.800881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e17ef31-0013-4c2e-8900-ed0470d7eb1a req-cfa62302-e5dd-4059-adce-25397554c87c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 943 time: 0.1064615 Dec 21 04:13:25.829178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.849360 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.853918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f3a62811-66ee-41b0-9077-f4bfe501aea8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5038953 Dec 21 04:13:25.854244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59952) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:25.859808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '7cc4971b-6998-432a-ad54-e8fe64399879', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:25.862127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:25.876119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '757b9fc9-1d7b-47c6-b195-673ac7d7799b', 'network_id': '800834e6-2709-4cb2-81c2-4c16d3d000fa', 'port_id': '757b9fc9-1d7b-47c6-b195-673ac7d7799b', 'mac_address': 'fa:16:3e:9d:2c:df', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59294161-9bfc-416e-a51d-c4b1c78a016d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:13:25.896980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e17ef31-0013-4c2e-8900-ed0470d7eb1a req-e468ab0e-c67a-435c-8b7c-87dc3bf2914a tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0895712 Dec 21 04:13:25.927821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:25.944878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 757b9fc9-1d7b-47c6-b195-673ac7d7799b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:13:25.967541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:26.056051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.086009 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.143735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.147713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=757b9fc9-1d7b-47c6-b195-673ac7d7799b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:26.208678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.261880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.275961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1fd4fbe6-72f7-48ef-a55d-7aa4f1ffd458,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:26.387581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.391742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dcbba769-8be8-4d77-be00-d4833013ea71 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5339048 Dec 21 04:13:26.392705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:26.398162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '7cc4971b-6998-432a-ad54-e8fe64399879', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:26.416666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['757b9fc9-1d7b-47c6-b195-673ac7d7799b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:13:26.457625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111e12d0-80b8-48d0-a9c3-1afccba69f0e req-495d1911-6454-43ce-945c-e687018d4e6b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:26.460268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-111e12d0-80b8-48d0-a9c3-1afccba69f0e req-495d1911-6454-43ce-945c-e687018d4e6b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0675569 Dec 21 04:13:26.493705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Router 0cc15963-6bb0-4c64-a921-d67a43fe9fd3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:26.556719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-111e12d0-80b8-48d0-a9c3-1afccba69f0e req-f1a0edce-88f2-440a-a54d-0b31d64bc7aa tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0894828 Dec 21 04:13:26.596260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.690274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:26.702443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Sync routers for ids ['0cc15963-6bb0-4c64-a921-d67a43fe9fd3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:26.704457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.712214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Routers {'0cc15963-6bb0-4c64-a921-d67a43fe9fd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:26.712831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0cc15963-6bb0-4c64-a921-d67a43fe9fd3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:26.823611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Set router 0cc15963-6bb0-4c64-a921-d67a43fe9fd3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:26.825564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.844652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9a1ef5fe-770f-4879-9796-2e20ecbc69ce,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:26.886346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:26.886346 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bca46a94-7d5e-4324-bc2c-096a883dcfa5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 908 time: 3.0543144 Dec 21 04:13:26.889062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59964) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:26.996809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.000420 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-230e5c3a-6f4e-4434-b3c7-3437a816a3ec tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6036348 Dec 21 04:13:27.000951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59968) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:27.005389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '7cc4971b-6998-432a-ad54-e8fe64399879', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:27.010474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cc15963-6bb0-4c64-a921-d67a43fe9fd3', 'name': 'tempest-snat-router-1539473652', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': False}, 'gw_port_id': '035fc274-9293-46ee-aaa0-40b628ae3810', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:23Z', 'updated_at': '2021-12-21T04:13:25Z', 'revision_number': 3, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port': {'id': '035fc274-9293-46ee-aaa0-40b628ae3810', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:f2:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cc15963-6bb0-4c64-a921-d67a43fe9fd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3192, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:24Z', 'updated_at': '2021-12-21T04:13:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:27.029626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9c88f2f5-5d00-4f96-bf26-05418e428878 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/0cc15963-6bb0-4c64-a921-d67a43fe9fd3 HTTP/1.1" status: 200 len: 909 time: 0.1394045 Dec 21 04:13:27.032520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:27.036871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1539473652', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': True}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:27.040456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Checking router: 0cc15963-6bb0-4c64-a921-d67a43fe9fd3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:27.040590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60eb3115-a817-49cb-86e8-b526e4c94e69 req-e9fdfd4d-a58c-436d-96dc-2e0e47bdecbc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:27.042650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Updating router 0cc15963-6bb0-4c64-a921-d67a43fe9fd3 port 035fc274-9293-46ee-aaa0-40b628ae3810 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:13:27.047443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60eb3115-a817-49cb-86e8-b526e4c94e69 req-e9fdfd4d-a58c-436d-96dc-2e0e47bdecbc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 944 time: 0.0713151 Dec 21 04:13:27.072278 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.098556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60eb3115-a817-49cb-86e8-b526e4c94e69 req-d5db85df-2ce7-4121-ae76-365ae7e9899b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485897 Dec 21 04:13:27.176947 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.255274 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.294114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.295359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.330876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.350977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.357907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.372258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=217d619b-2150-45eb-afe7-399d22b4df02,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:27.450558 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.499543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fb9bcf5-b780-48b6-8863-b81366406384 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:27.511402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Attempting to bind port 035fc274-9293-46ee-aaa0-40b628ae3810 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:27.511700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Attempting to bind port 035fc274-9293-46ee-aaa0-40b628ae3810 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:27.512062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Attempting to bind port 035fc274-9293-46ee-aaa0-40b628ae3810 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:27.515493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Pushing event updated for resources: {'Port': ['ID=035fc274-9293-46ee-aaa0-40b628ae3810,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:27.520558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:27.520912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:27.521320 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.521721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:27.522192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Bound port: 035fc274-9293-46ee-aaa0-40b628ae3810, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:27.522586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.608731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.611422 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5fb3af27-074f-4c94-8e27-13b6797a80db tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6080573 Dec 21 04:13:27.613451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59978) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:27.643212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '7cc4971b-6998-432a-ad54-e8fe64399879', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:27.654259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.709507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60840408-28c5-40b6-b8a7-b4883e14d854 req-e6941bf6-afef-4a61-9076-53cdce303658 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:27.711572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60840408-28c5-40b6-b8a7-b4883e14d854 req-e6941bf6-afef-4a61-9076-53cdce303658 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0699472 Dec 21 04:13:27.753948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.754294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.754634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.754986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.755319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.755645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.755967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.756287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.756608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.756929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.757248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.757564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.757878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:27.765344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 757b9fc9-1d7b-47c6-b195-673ac7d7799b up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:27.773718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60840408-28c5-40b6-b8a7-b4883e14d854 req-71f57b05-b6ef-4d73-9bad-fd83ffbc383e tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534418 Dec 21 04:13:27.829774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-67c0010d-7eda-4b62-92fe-23b64459ada6 None None] Provisioning complete for port 035fc274-9293-46ee-aaa0-40b628ae3810 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:27.830155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67c0010d-7eda-4b62-92fe-23b64459ada6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.849946 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.860021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] For port 035fc274-9293-46ee-aaa0-40b628ae3810, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:27.878785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] For port 035fc274-9293-46ee-aaa0-40b628ae3810, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=035fc274-9293-46ee-aaa0-40b628ae3810,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:27.890769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-67c0010d-7eda-4b62-92fe-23b64459ada6 None None] Port 035fc274-9293-46ee-aaa0-40b628ae3810 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:27.939539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:27.974081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.034410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d87d6883-5f70-4378-a6c8-9670965366b7 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:28.047427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Routers {'0cc15963-6bb0-4c64-a921-d67a43fe9fd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:28.048067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0cc15963-6bb0-4c64-a921-d67a43fe9fd3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:28.050108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef54fdb4-9d37-42f6-98ae-3e48e19fab4a None None] Pushing event updated for resources: {'Port': ['ID=035fc274-9293-46ee-aaa0-40b628ae3810,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.063116 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.080865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.090457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 757b9fc9-1d7b-47c6-b195-673ac7d7799b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:13:28.104403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 757b9fc9-1d7b-47c6-b195-673ac7d7799b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:28.104775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.141526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.174152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a937202e-2191-477d-ac3e-b9e774ce8393,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.194453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1820a3d9-4b4d-43c9-99d7-0a966ee6eceb None None] Provisioning complete for port 035fc274-9293-46ee-aaa0-40b628ae3810 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:28.194453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1820a3d9-4b4d-43c9-99d7-0a966ee6eceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.251187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Allocated IP 172.25.5.222 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/6795f04a-b0ca-41d3-b003-1be3530b7bb8) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:28.289127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8158b7b6-0f06-4610-afbd-c19734973098 req-da184127-3547-42c0-9a51-f6ae616f042e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:28.290746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8158b7b6-0f06-4610-afbd-c19734973098 req-da184127-3547-42c0-9a51-f6ae616f042e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 944 time: 0.0621531 Dec 21 04:13:28.291326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] Set router 0cc15963-6bb0-4c64-a921-d67a43fe9fd3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:28.325315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.326573 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e4e8b48f-a652-4a68-ac4b-eb21b8ed1d45 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.7128847 Dec 21 04:13:28.329502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59984) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:28.362134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8158b7b6-0f06-4610-afbd-c19734973098 req-ed36570e-6cc8-49d4-9d76-288bd0ba5439 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611007 Dec 21 04:13:28.365828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc058a00-b022-443b-80e4-6489514e38dd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.379178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc058a00-b022-443b-80e4-6489514e38dd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.413520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.435449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.477961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1820a3d9-4b4d-43c9-99d7-0a966ee6eceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.496564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '757b9fc9-1d7b-47c6-b195-673ac7d7799b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:28.498798 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8c33279-0d0a-46e8-bc64-e440291dc1b2" -d '{"events": [{"server_uuid": "d38dd2ca-4899-4a5a-8f18-3bb66d5f1040", "name": "network-vif-plugged", "status": "completed", "tag": "757b9fc9-1d7b-47c6-b195-673ac7d7799b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:28.521660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:28.534812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc058a00-b022-443b-80e4-6489514e38dd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.542665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1820a3d9-4b4d-43c9-99d7-0a966ee6eceb None None] For port 035fc274-9293-46ee-aaa0-40b628ae3810, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=035fc274-9293-46ee-aaa0-40b628ae3810,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:28.543692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc058a00-b022-443b-80e4-6489514e38dd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.545146 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cc058a00-b022-443b-80e4-6489514e38dd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/a937202e-2191-477d-ac3e-b9e774ce8393 HTTP/1.1" status: 204 len: 168 time: 0.2145307 Dec 21 04:13:28.547657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59988) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:28.560737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc058a00-b022-443b-80e4-6489514e38dd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a937202e-2191-477d-ac3e-b9e774ce8393,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.565605 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53bfcee7-f5dc-4736-9ab2-170d58b39a2c x-openstack-request-id: req-53bfcee7-f5dc-4736-9ab2-170d58b39a2c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:28.565894 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d38dd2ca-4899-4a5a-8f18-3bb66d5f1040", "name": "network-vif-plugged", "status": "completed", "tag": "757b9fc9-1d7b-47c6-b195-673ac7d7799b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:28.566176 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-53bfcee7-f5dc-4736-9ab2-170d58b39a2c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:28.566533 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '757b9fc9-1d7b-47c6-b195-673ac7d7799b', 'code': 200} Dec 21 04:13:28.571956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.607801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bcbcbcca-42de-4368-b906-3bfe152427d8 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.0588479 Dec 21 04:13:28.614753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59992) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:28.625975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cc15963-6bb0-4c64-a921-d67a43fe9fd3', 'name': 'tempest-snat-router-1539473652', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': False}, 'gw_port_id': '035fc274-9293-46ee-aaa0-40b628ae3810', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:23Z', 'updated_at': '2021-12-21T04:13:25Z', 'revision_number': 3, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port': {'id': '035fc274-9293-46ee-aaa0-40b628ae3810', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:f2:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cc15963-6bb0-4c64-a921-d67a43fe9fd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3192, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:24Z', 'updated_at': '2021-12-21T04:13:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:28.655243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c7bf4c6-937c-4b8f-9fa9-a50d6e16def6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.668346 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c7bf4c6-937c-4b8f-9fa9-a50d6e16def6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.671900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5793b52-12fe-49bc-8981-ceefc6706887 None None] The sync data for ids ['0cc15963-6bb0-4c64-a921-d67a43fe9fd3'] in n-d-822053-11 is: [{'id': '0cc15963-6bb0-4c64-a921-d67a43fe9fd3', 'name': 'tempest-snat-router-1539473652', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': False}, 'gw_port_id': '035fc274-9293-46ee-aaa0-40b628ae3810', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:23Z', 'updated_at': '2021-12-21T04:13:25Z', 'revision_number': 3, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port': {'id': '035fc274-9293-46ee-aaa0-40b628ae3810', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:f2:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cc15963-6bb0-4c64-a921-d67a43fe9fd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3192, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:24Z', 'updated_at': '2021-12-21T04:13:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:28.674139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.685564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:28.686589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Port': ['ID=6795f04a-b0ca-41d3-b003-1be3530b7bb8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.690909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:28.706552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:28.723822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67b7fef0-e960-4cdd-bacd-76e26cededa3 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:28.729614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1820a3d9-4b4d-43c9-99d7-0a966ee6eceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.734070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=757b9fc9-1d7b-47c6-b195-673ac7d7799b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.744123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17360b61-7f09-4afa-a0a6-014f2f4cd4b1 req-6f9581fc-fae7-4467-8a49-06ffbee28d97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:28.746255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17360b61-7f09-4afa-a0a6-014f2f4cd4b1 req-6f9581fc-fae7-4467-8a49-06ffbee28d97 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 1097 time: 0.0689929 Dec 21 04:13:28.808512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1820a3d9-4b4d-43c9-99d7-0a966ee6eceb None None] Pushing event updated for resources: {'Port': ['ID=035fc274-9293-46ee-aaa0-40b628ae3810,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.846446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c7bf4c6-937c-4b8f-9fa9-a50d6e16def6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.857323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c7bf4c6-937c-4b8f-9fa9-a50d6e16def6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.860837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c7bf4c6-937c-4b8f-9fa9-a50d6e16def6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/217d619b-2150-45eb-afe7-399d22b4df02 HTTP/1.1" status: 204 len: 168 time: 0.2470040 Dec 21 04:13:28.869896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 59996) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:28.881432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17360b61-7f09-4afa-a0a6-014f2f4cd4b1 req-7eaf155c-534b-4da2-b06b-d38b8465b727 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212730 Dec 21 04:13:28.882552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dc7f46a3-1c21-47a4-9271-0f516d3970f4 None None] Provisioning complete for port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:28.883214 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dc7f46a3-1c21-47a4-9271-0f516d3970f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:28.914831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7bf4c6-937c-4b8f-9fa9-a50d6e16def6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=217d619b-2150-45eb-afe7-399d22b4df02,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:28.949083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dc7f46a3-1c21-47a4-9271-0f516d3970f4 None None] Port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:28.982231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fda63e0-a463-41f7-8ce6-0663468d7048 req-68c703a7-0377-4f4f-ac01-f35401e97381 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:28.984198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7fda63e0-a463-41f7-8ce6-0663468d7048 req-68c703a7-0377-4f4f-ac01-f35401e97381 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0871592 Dec 21 04:13:28.997118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7f170b18-3c03-4951-aa90-67bf37dc7da0 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.1145709 Dec 21 04:13:29.000023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 59998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.026735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a45d19e4-aecd-40d7-9c97-58ef2dbd1a21 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.034668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a45d19e4-aecd-40d7-9c97-58ef2dbd1a21 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.071848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7fda63e0-a463-41f7-8ce6-0663468d7048 req-0de971ce-9dee-4566-be19-0fef2b92423d tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733180 Dec 21 04:13:29.207569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a45d19e4-aecd-40d7-9c97-58ef2dbd1a21 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.218798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a45d19e4-aecd-40d7-9c97-58ef2dbd1a21 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.222380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a45d19e4-aecd-40d7-9c97-58ef2dbd1a21 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/9a1ef5fe-770f-4879-9796-2e20ecbc69ce HTTP/1.1" status: 204 len: 168 time: 0.2185607 Dec 21 04:13:29.222829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60002) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.233642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45d19e4-aecd-40d7-9c97-58ef2dbd1a21 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9a1ef5fe-770f-4879-9796-2e20ecbc69ce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:29.235295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.264841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 035fc274-9293-46ee-aaa0-40b628ae3810 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:29.323939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 035fc274-9293-46ee-aaa0-40b628ae3810 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:29.324412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.344565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-332465a3-3701-4907-941b-15ab955cad6b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.1152680 Dec 21 04:13:29.344939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60004) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.369692 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fe9abe8-9a0a-489a-923f-66e425cc4138 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.380332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fe9abe8-9a0a-489a-923f-66e425cc4138 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.504695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4a8f26-13cc-4b1a-9f50-bc18bbc4ba9a req-7a416fd3-2c5b-49e0-8e4c-87685bd82a68 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:29.506347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e4a8f26-13cc-4b1a-9f50-bc18bbc4ba9a req-7a416fd3-2c5b-49e0-8e4c-87685bd82a68 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0572405 Dec 21 04:13:29.521484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fe9abe8-9a0a-489a-923f-66e425cc4138 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.527259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0fe9abe8-9a0a-489a-923f-66e425cc4138 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.531229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0fe9abe8-9a0a-489a-923f-66e425cc4138 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/1fd4fbe6-72f7-48ef-a55d-7aa4f1ffd458 HTTP/1.1" status: 204 len: 168 time: 0.1851544 Dec 21 04:13:29.531871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60008) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.545230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.561658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe9abe8-9a0a-489a-923f-66e425cc4138 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1fd4fbe6-72f7-48ef-a55d-7aa4f1ffd458,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:29.612176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-726e6498-d6f3-4033-a728-dc3f305448a0 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0704794 Dec 21 04:13:29.612802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60010) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.628561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e4a8f26-13cc-4b1a-9f50-bc18bbc4ba9a req-95dd32ec-e7f8-434f-a1b7-793a8b89e28f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092231 Dec 21 04:13:29.645847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a0390a9-8b56-41c2-8b93-8a43f2aadad1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.654265 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a0390a9-8b56-41c2-8b93-8a43f2aadad1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.762988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a0390a9-8b56-41c2-8b93-8a43f2aadad1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.770236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a0390a9-8b56-41c2-8b93-8a43f2aadad1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.771435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2a0390a9-8b56-41c2-8b93-8a43f2aadad1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/e14be13e-2555-460d-83aa-b2ba9360dd1a HTTP/1.1" status: 204 len: 168 time: 0.1573865 Dec 21 04:13:29.774291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60014) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.777835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a0390a9-8b56-41c2-8b93-8a43f2aadad1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e14be13e-2555-460d-83aa-b2ba9360dd1a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:29.814007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f9420a5-6ed4-4577-98dd-ab2ec7b943ba tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0384800 Dec 21 04:13:29.816640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60016) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:29.831028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Router a4de3294-fe37-4f11-ad24-f486c07718d2 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:29.915427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29035abc-5c2f-4e68-aee5-ad1f64aef8fc tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:29.973131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29035abc-5c2f-4e68-aee5-ad1f64aef8fc tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.004746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:30.019458 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Sync routers for ids ['a4de3294-fe37-4f11-ad24-f486c07718d2'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:30.029072 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Routers {'a4de3294-fe37-4f11-ad24-f486c07718d2'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:30.029676 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a4de3294-fe37-4f11-ad24-f486c07718d2'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:30.141023 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Set router a4de3294-fe37-4f11-ad24-f486c07718d2 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:30.175187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.176552 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7155bafa-a269-4235-8e2b-1f90bffa2915 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 3.1429720 Dec 21 04:13:30.179228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60022) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:30.205247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0dc175-8962-419a-bbb0-16846c9432ce req-5a867c75-b7be-48d4-b173-070811d61192 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:30.213243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a0dc175-8962-419a-bbb0-16846c9432ce req-5a867c75-b7be-48d4-b173-070811d61192 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0682666 Dec 21 04:13:30.245608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29035abc-5c2f-4e68-aee5-ad1f64aef8fc tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.247876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-29035abc-5c2f-4e68-aee5-ad1f64aef8fc tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.251442 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-29035abc-5c2f-4e68-aee5-ad1f64aef8fc tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/7cc4971b-6998-432a-ad54-e8fe64399879 HTTP/1.1" status: 204 len: 168 time: 0.4315598 Dec 21 04:13:30.253177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60026) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:30.267071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29035abc-5c2f-4e68-aee5-ad1f64aef8fc tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cc4971b-6998-432a-ad54-e8fe64399879,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:30.340207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a0dc175-8962-419a-bbb0-16846c9432ce req-930ee929-0a6d-41af-bd21-94d67e08c33f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1160016 Dec 21 04:13:30.348553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-67754503-f01b-4a67-a9d5-52283c46c462 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0900347 Dec 21 04:13:30.349129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60028) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:30.353963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--1887419994'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:30.365079 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5ab45508-ddb6-4150-a476-eae6ae62f6f5 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/a4de3294-fe37-4f11-ad24-f486c07718d2 HTTP/1.1" status: 200 len: 908 time: 0.1844378 Dec 21 04:13:30.367792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60030) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:30.389091 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4de3294-fe37-4f11-ad24-f486c07718d2', 'name': 'tempest-snat-router-1539473652', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.222'}], 'enable_snat': True}, 'gw_port_id': '6795f04a-b0ca-41d3-b003-1be3530b7bb8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:27Z', 'updated_at': '2021-12-21T04:13:28Z', 'revision_number': 3, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port': {'id': '6795f04a-b0ca-41d3-b003-1be3530b7bb8', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:43:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4de3294-fe37-4f11-ad24-f486c07718d2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3202, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:28Z', 'updated_at': '2021-12-21T04:13:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:30.418087 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Checking router: a4de3294-fe37-4f11-ad24-f486c07718d2 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:30.418679 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Updating router a4de3294-fe37-4f11-ad24-f486c07718d2 port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:13:30.447033 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.497727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.591295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.714298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.763577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=326f56e4-4980-48f5-bce4-7c0834c691a3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:30.777611 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.884286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.886229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a3446067-d91f-4c43-8d5a-a1882c327014 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5365655 Dec 21 04:13:30.891404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60038) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:30.895964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '326f56e4-4980-48f5-bce4-7c0834c691a3', 'direction': 'ingress', 'protocol': 17}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:30.918162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.928136 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:30.977857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a4160a1-026a-4002-b7bd-7441009bb53c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:30.998777 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Pushing event updated for resources: {'Port': ['ID=6795f04a-b0ca-41d3-b003-1be3530b7bb8,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:31.005227 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Attempting to bind port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:31.005649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Attempting to bind port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:31.005948 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Attempting to bind port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:31.012117 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:31.012602 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:31.013015 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.013406 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:31.013887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Bound port: 6795f04a-b0ca-41d3-b003-1be3530b7bb8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:31.014245 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.020693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.033475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca85ce4-2b85-4d03-82ad-86313a619c81 req-d270a77d-af7e-4562-b9b1-e8280c71f9d9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:31.035446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bca85ce4-2b85-4d03-82ad-86313a619c81 req-d270a77d-af7e-4562-b9b1-e8280c71f9d9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1698363 Dec 21 04:13:31.091229 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] For port 6795f04a-b0ca-41d3-b003-1be3530b7bb8, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:31.096273 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] For port 6795f04a-b0ca-41d3-b003-1be3530b7bb8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6795f04a-b0ca-41d3-b003-1be3530b7bb8,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:31.103027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4336af03-10e8-41d9-8696-617064f75ddb None None] Provisioning complete for port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:31.104694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4336af03-10e8-41d9-8696-617064f75ddb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.110672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.122598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bca85ce4-2b85-4d03-82ad-86313a619c81 req-9ed61566-3a0e-4cee-a79e-484357393a69 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767963 Dec 21 04:13:31.139742 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.145879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4336af03-10e8-41d9-8696-617064f75ddb None None] Port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:31.205683 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.251342 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.268172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0442c30-ff5a-4bba-addc-b9bf59496b0e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:31.305099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Deleting port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:31.305442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.348366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb0bfff7-f9e4-47df-a922-5954056a1f88 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:31.352995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Routers {'a4de3294-fe37-4f11-ad24-f486c07718d2'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:31.362685 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a4de3294-fe37-4f11-ad24-f486c07718d2'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:31.391646 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Pushing event updated for resources: {'Port': ['ID=6795f04a-b0ca-41d3-b003-1be3530b7bb8,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:31.401412 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.402047 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.402673 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.403246 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.403868 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.404391 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.404899 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.405414 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.405915 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.406414 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.407134 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.407833 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.408376 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a6c673f-5bfe-419e-bd40-6a340966d609 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:13:31.411688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.420116 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-52a524c9-ed68-4479-9116-737c7f653621 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.5217290 Dec 21 04:13:31.424056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60046) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:31.476017 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] Set router a4de3294-fe37-4f11-ad24-f486c07718d2 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:31.493124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-908e9026-203c-47ce-a50d-21b4cf6840f8 None None] Provisioning complete for port 6795f04a-b0ca-41d3-b003-1be3530b7bb8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:31.493503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-908e9026-203c-47ce-a50d-21b4cf6840f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.511903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] For port 6795f04a-b0ca-41d3-b003-1be3530b7bb8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6795f04a-b0ca-41d3-b003-1be3530b7bb8,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:31.511903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.562920 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a4de3294-fe37-4f11-ad24-f486c07718d2', 'name': 'tempest-snat-router-1539473652', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:27Z', 'updated_at': '2021-12-21T04:13:31Z', 'revision_number': 4, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:31.576601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Calling delete_port for 6795f04a-b0ca-41d3-b003-1be3530b7bb8 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:31.584740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e37b9a92-3307-4e11-8383-b3a18e04b534 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.596690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-908e9026-203c-47ce-a50d-21b4cf6840f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.601059 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86e09205-ac5a-4825-9ea5-f6ea1b40533f None None] The sync data for ids ['a4de3294-fe37-4f11-ad24-f486c07718d2'] in n-d-822053-11 is: [{'id': 'a4de3294-fe37-4f11-ad24-f486c07718d2', 'name': 'tempest-snat-router-1539473652', 'tenant_id': '67330cfb489a453f959b0551f63b990d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:27Z', 'updated_at': '2021-12-21T04:13:31Z', 'revision_number': 4, 'project_id': '67330cfb489a453f959b0551f63b990d', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:31.632016 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e37b9a92-3307-4e11-8383-b3a18e04b534 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.648490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-908e9026-203c-47ce-a50d-21b4cf6840f8 None None] For port 6795f04a-b0ca-41d3-b003-1be3530b7bb8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6795f04a-b0ca-41d3-b003-1be3530b7bb8,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:31.725867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0445a699-bbcf-4b9f-a5fb-26cfe9608333 req-92a6ca68-128d-4216-ad08-9710089a1a80 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:31.727525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0445a699-bbcf-4b9f-a5fb-26cfe9608333 req-92a6ca68-128d-4216-ad08-9710089a1a80 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1997123 Dec 21 04:13:31.742968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2be026-b356-4804-99e0-e1436fd9792f req-1ad33cbc-783b-4fed-a444-46e03081fd09 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:31.744537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c2be026-b356-4804-99e0-e1436fd9792f req-1ad33cbc-783b-4fed-a444-46e03081fd09 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.2156050 Dec 21 04:13:31.771016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-908e9026-203c-47ce-a50d-21b4cf6840f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.816579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e37b9a92-3307-4e11-8383-b3a18e04b534 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.820452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e37b9a92-3307-4e11-8383-b3a18e04b534 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:31.822291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e37b9a92-3307-4e11-8383-b3a18e04b534 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/326f56e4-4980-48f5-bce4-7c0834c691a3 HTTP/1.1" status: 204 len: 168 time: 0.3964782 Dec 21 04:13:31.826812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0445a699-bbcf-4b9f-a5fb-26cfe9608333 req-65b2685a-fa5b-4bfd-9f42-ada424c24492 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772583 Dec 21 04:13:31.828142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60052) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:31.868498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908e9026-203c-47ce-a50d-21b4cf6840f8 None None] Pushing event updated for resources: {'Port': ['ID=6795f04a-b0ca-41d3-b003-1be3530b7bb8,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:31.870842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e37b9a92-3307-4e11-8383-b3a18e04b534 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=326f56e4-4980-48f5-bce4-7c0834c691a3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:31.911582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c2be026-b356-4804-99e0-e1436fd9792f req-556bf98f-2f43-425b-8d99-7c309dc80a84 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1561043 Dec 21 04:13:31.978147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60056) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:31.978456 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-053e8337-d1a7-4ef9-a498-151c9e44327a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1452832 Dec 21 04:13:31.984544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--1078839274'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:32.049356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fd401c-058e-4c17-a75c-8bf570cf24ab req-d6fbf3ec-7080-4072-916e-1bfb20849b79 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:32.050899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0fd401c-058e-4c17-a75c-8bf570cf24ab req-d6fbf3ec-7080-4072-916e-1bfb20849b79 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0933318 Dec 21 04:13:32.100610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0fd401c-058e-4c17-a75c-8bf570cf24ab req-a40ed131-4a01-401d-b05b-95dc4fe281a7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434883 Dec 21 04:13:32.136639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.169899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event deleted for resources: {'Port': ['ID=6795f04a-b0ca-41d3-b003-1be3530b7bb8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:32.191972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80ff89da-a969-424a-9a1b-7aca70c5f865 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:32.199627 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.253234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.382613 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.387280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.464926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.528667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a730946e-9e4c-4099-a1a5-6aa6c448a53f req-7aaae94d-b3be-4002-8763-958f10735da8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:32.537545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a730946e-9e4c-4099-a1a5-6aa6c448a53f req-7aaae94d-b3be-4002-8763-958f10735da8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0629437 Dec 21 04:13:32.546521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.547438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a4de3294-fe37-4f11-ad24-f486c07718d2 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:32.549441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.567309 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.570975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e012dc22-1a92-4e7c-a120-5a3d3c827cd8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/routers/a4de3294-fe37-4f11-ad24-f486c07718d2 HTTP/1.1" status: 204 len: 168 time: 2.1999240 Dec 21 04:13:32.571451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60062) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:32.632323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.633909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.6548312 Dec 21 04:13:32.642524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60064) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:32.656210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96d3f2e-9085-4dcd-8582-a1276796a63b tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=44da6f82-9956-496f-a217-4ea9a7437ef9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:32.670204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a730946e-9e4c-4099-a1a5-6aa6c448a53f req-22701e3a-dd86-4050-a46b-a3a999c64a43 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1314020 Dec 21 04:13:32.686603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--1086696989'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:32.778407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.859367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.913587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:32.992492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.059726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c71a487-ac7a-441a-bcb5-b237c140677d req-946d0eb8-3735-4d2a-84bc-3864e1d6d757 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:33.061439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c71a487-ac7a-441a-bcb5-b237c140677d req-946d0eb8-3735-4d2a-84bc-3864e1d6d757 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 944 time: 0.0654619 Dec 21 04:13:33.094444 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.120597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c71a487-ac7a-441a-bcb5-b237c140677d req-f77c5583-5afe-4f89-8868-7c2c573b1848 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519297 Dec 21 04:13:33.145307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=88b27671-82b6-4287-9a38-33b13383f960,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:33.163418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Deleting port 035fc274-9293-46ee-aaa0-40b628ae3810 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:33.163625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.507986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.509211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c708b226-4041-40fd-ae2e-46c5d0779706 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.8657186 Dec 21 04:13:33.512666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60072) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:33.517535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '44da6f82-9956-496f-a217-4ea9a7437ef9', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '88b27671-82b6-4287-9a38-33b13383f960', 'remote_ip_prefix': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:33.571093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] For port 035fc274-9293-46ee-aaa0-40b628ae3810, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=035fc274-9293-46ee-aaa0-40b628ae3810,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:33.571548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.585184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Calling delete_port for 035fc274-9293-46ee-aaa0-40b628ae3810 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:33.640404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.718312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.739467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 66e81b00-da04-499e-996a-ce50856ba3df details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:13:33.806573 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.865018 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.881735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a7b9223-714d-4d9c-a034-103780919164,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:33.899037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 66e81b00-da04-499e-996a-ce50856ba3df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=66e81b00-da04-499e-996a-ce50856ba3df,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:33.916182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '66e81b00-da04-499e-996a-ce50856ba3df', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:13:33.917311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event deleted for resources: {'Port': ['ID=035fc274-9293-46ee-aaa0-40b628ae3810,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:33.926271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1befed-ed5c-44b9-a20f-bd997652a1c1 req-f726978d-f56f-47f7-8cab-17e29e293025 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:33.927211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb1befed-ed5c-44b9-a20f-bd997652a1c1 req-f726978d-f56f-47f7-8cab-17e29e293025 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1173949 Dec 21 04:13:33.948502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19a7e42a-6ab9-4300-9af9-5b130fb6fa1c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:33.972687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.975770 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:33.983959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-200b411b-5371-4767-b8f2-78463ae7c894 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.4678259 Dec 21 04:13:33.984558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60080) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:33.988226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 66e81b00-da04-499e-996a-ce50856ba3df {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:13:34.017744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 66e81b00-da04-499e-996a-ce50856ba3df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=66e81b00-da04-499e-996a-ce50856ba3df,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:34.033659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.061019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cb1befed-ed5c-44b9-a20f-bd997652a1c1 req-529bc0ea-38cf-4ce2-aa1a-980afb241064 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1078026 Dec 21 04:13:34.069449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0f5a66b-8903-46b7-b976-6c329b2c57da tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.081422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0f5a66b-8903-46b7-b976-6c329b2c57da tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.093879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.155299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.157541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.158464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=66e81b00-da04-499e-996a-ce50856ba3df,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:34.188218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0f5a66b-8903-46b7-b976-6c329b2c57da tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.193475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0f5a66b-8903-46b7-b976-6c329b2c57da tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.198313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e0f5a66b-8903-46b7-b976-6c329b2c57da tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/7a7b9223-714d-4d9c-a034-103780919164 HTTP/1.1" status: 204 len: 168 time: 0.2126319 Dec 21 04:13:34.198520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60090) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.208403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f5a66b-8903-46b7-b976-6c329b2c57da tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7a7b9223-714d-4d9c-a034-103780919164,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:34.248365 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7ee70b3c-011c-4d71-9054-ad40377a3eb4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0487375 Dec 21 04:13:34.251048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60092) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.307414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d364f8a-de0f-4163-ac43-9e17fd376139 req-adaca4c9-b913-41b9-ad0a-26bb0edf581b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:34.307796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.308506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 0cc15963-6bb0-4c64-a921-d67a43fe9fd3 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:34.310050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d364f8a-de0f-4163-ac43-9e17fd376139 req-adaca4c9-b913-41b9-ad0a-26bb0edf581b tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 945 time: 0.0786681 Dec 21 04:13:34.321678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.329139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-871dbb9d-1528-4608-8f9a-1333faec6b62 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "DELETE /v2.0/routers/0cc15963-6bb0-4c64-a921-d67a43fe9fd3 HTTP/1.1" status: 204 len: 168 time: 1.7564707 Dec 21 04:13:34.333347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60098) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.347278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-916675877', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:34.349336 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf956cf8-2d46-4506-90f5-942fa9af2e1d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.384095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf956cf8-2d46-4506-90f5-942fa9af2e1d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.408358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['66e81b00-da04-499e-996a-ce50856ba3df'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:13:34.455816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d364f8a-de0f-4163-ac43-9e17fd376139 req-9274bf06-8a3b-48c7-ad10-1d2cd6649f85 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1386199 Dec 21 04:13:34.480519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.481614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.501959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60100) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.506070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf956cf8-2d46-4506-90f5-942fa9af2e1d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.514950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf956cf8-2d46-4506-90f5-942fa9af2e1d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.519164 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf956cf8-2d46-4506-90f5-942fa9af2e1d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/88b27671-82b6-4287-9a38-33b13383f960 HTTP/1.1" status: 204 len: 168 time: 0.2645593 Dec 21 04:13:34.520248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60106) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.559475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf956cf8-2d46-4506-90f5-942fa9af2e1d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=88b27671-82b6-4287-9a38-33b13383f960,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:34.630305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.647699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34b3edf4-3b63-4741-8744-2a1d60a2bfef tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1239007 Dec 21 04:13:34.647853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.714914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e688039c-cc38-42e7-9a03-ce3d4de4a875 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.723753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e5c172b-84c5-4453-bf01-e841493c9ea4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.756584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e5c172b-84c5-4453-bf01-e841493c9ea4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.871043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.885048 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e5c172b-84c5-4453-bf01-e841493c9ea4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.889362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e5c172b-84c5-4453-bf01-e841493c9ea4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.893413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e5c172b-84c5-4453-bf01-e841493c9ea4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/44da6f82-9956-496f-a217-4ea9a7437ef9 HTTP/1.1" status: 204 len: 168 time: 0.2387354 Dec 21 04:13:34.894010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:34.927176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5c172b-84c5-4453-bf01-e841493c9ea4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=44da6f82-9956-496f-a217-4ea9a7437ef9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:34.966731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e688039c-cc38-42e7-9a03-ce3d4de4a875 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:34.991515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a029dfaa-2ab1-4dc8-80ee-6096b3d1e8b7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0928962 Dec 21 04:13:34.992587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:35.002967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--478206731'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:35.059768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e688039c-cc38-42e7-9a03-ce3d4de4a875 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.110503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e688039c-cc38-42e7-9a03-ce3d4de4a875 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=452ad517fcb54fdea89430161e98b224&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6074107 Dec 21 04:13:35.113075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60120) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:35.122060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.122904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e688039c-cc38-42e7-9a03-ce3d4de4a875 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce138043-5eeb-4a97-965d-ed0df703fc62,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:35.251378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.274463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 035fc274-9293-46ee-aaa0-40b628ae3810 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:13:35.297888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f4ad94-6763-4441-a54e-61ab79990e1d req-a3bb10b7-0ec6-4b4d-9fb3-3db8caade8b7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:35.298921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 035fc274-9293-46ee-aaa0-40b628ae3810 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:13:35.299428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87f4ad94-6763-4441-a54e-61ab79990e1d req-a3bb10b7-0ec6-4b4d-9fb3-3db8caade8b7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1787417 Dec 21 04:13:35.305175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 035fc274-9293-46ee-aaa0-40b628ae3810 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:13:35.314268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbdac59d-f532-42c7-9db6-1d0a38b18a30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.327657 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.358544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=92b05209-50db-4f86-aa85-c75b9869816d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:35.417783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbdac59d-f532-42c7-9db6-1d0a38b18a30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.429739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.434565 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bb4cd78b-ba19-4160-8e2e-0c451b305b79 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4374065 Dec 21 04:13:35.434768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60122) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:35.439673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '92b05209-50db-4f86-aa85-c75b9869816d', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:35.456957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.467866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-87f4ad94-6763-4441-a54e-61ab79990e1d req-23cf20ed-8f27-43c5-ad70-e1a564fd855b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610210 Dec 21 04:13:35.496033 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.555617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.616143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.635341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8343bf-a320-491f-a743-630115ae5d3d req-4ab763c9-37ef-4a7c-9ec9-05315f2dbde6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:35.636848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d8343bf-a320-491f-a743-630115ae5d3d req-4ab763c9-37ef-4a7c-9ec9-05315f2dbde6 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 945 time: 0.0967374 Dec 21 04:13:35.668586 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbdac59d-f532-42c7-9db6-1d0a38b18a30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.671228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbdac59d-f532-42c7-9db6-1d0a38b18a30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.672410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cbdac59d-f532-42c7-9db6-1d0a38b18a30 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ce138043-5eeb-4a97-965d-ed0df703fc62 HTTP/1.1" status: 204 len: 168 time: 0.5584109 Dec 21 04:13:35.675549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Allocated IP 172.25.5.195 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/04f733f6-72d8-4a61-b0af-10509ac4340b) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:35.687974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.702071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d6b7ce41-f2b6-48ca-91d3-5d2728ef394c,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:35.722502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbdac59d-f532-42c7-9db6-1d0a38b18a30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce138043-5eeb-4a97-965d-ed0df703fc62,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:35.727399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d8343bf-a320-491f-a743-630115ae5d3d req-b26f77f2-4719-4238-ad61-fe87856cc652 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842586 Dec 21 04:13:35.758689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 66e81b00-da04-499e-996a-ce50856ba3df up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:35.797929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.801803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6a9b2246-295a-4ae2-893e-7bd8865c87f1 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3633566 Dec 21 04:13:35.802020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:35.832175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d9ae5db-4b86-4def-8315-9ed99c4d6acd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.842560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d9ae5db-4b86-4def-8315-9ed99c4d6acd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.854593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.900234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 66e81b00-da04-499e-996a-ce50856ba3df completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:13:35.907565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 66e81b00-da04-499e-996a-ce50856ba3df triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:35.908068 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.979027 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d9ae5db-4b86-4def-8315-9ed99c4d6acd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.979493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.987621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d9ae5db-4b86-4def-8315-9ed99c4d6acd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:35.992515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d9ae5db-4b86-4def-8315-9ed99c4d6acd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/d6b7ce41-f2b6-48ca-91d3-5d2728ef394c HTTP/1.1" status: 204 len: 168 time: 0.1889095 Dec 21 04:13:35.996201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:36.012559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.023615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:36.027402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:36.031766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:36.044861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90faecfb-5f4c-468f-8152-8005510c9dc7 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:36.058559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event updated for resources: {'Port': ['ID=04f733f6-72d8-4a61-b0af-10509ac4340b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:36.059711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:36.064368 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f898e75a-e4fd-465d-a92d-21c54c3acda0" -d '{"events": [{"server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "name": "network-vif-plugged", "status": "completed", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:36.065726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d9ae5db-4b86-4def-8315-9ed99c4d6acd tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d6b7ce41-f2b6-48ca-91d3-5d2728ef394c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:36.087464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 66e81b00-da04-499e-996a-ce50856ba3df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=66e81b00-da04-499e-996a-ce50856ba3df,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:36.121860 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f9520fb8-1cb2-4345-a26f-100de9d5add5 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1223066 Dec 21 04:13:36.125042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:36.160461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.170385 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1b0a937-b4ff-4375-84f0-a061486dcb8c x-openstack-request-id: req-e1b0a937-b4ff-4375-84f0-a061486dcb8c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:36.170690 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "name": "network-vif-plugged", "status": "completed", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:36.170969 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e1b0a937-b4ff-4375-84f0-a061486dcb8c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:36.171379 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'code': 200} Dec 21 04:13:36.253792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5447d4d1-025c-46b7-a487-1b79e62d7ff2 None None] Provisioning complete for port 04f733f6-72d8-4a61-b0af-10509ac4340b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:36.254176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5447d4d1-025c-46b7-a487-1b79e62d7ff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.286172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41e42f94-dd2b-4949-94be-271b951baf34 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.324150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7126dcf8-982c-4e4f-9f47-f20707ccd453 req-b6db60c3-f27b-4821-a5f5-1c1e2c1df403 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:36.326256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7126dcf8-982c-4e4f-9f47-f20707ccd453 req-b6db60c3-f27b-4821-a5f5-1c1e2c1df403 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1098 time: 0.0511258 Dec 21 04:13:36.327599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41e42f94-dd2b-4949-94be-271b951baf34 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.331291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=66e81b00-da04-499e-996a-ce50856ba3df,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:36.340466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5447d4d1-025c-46b7-a487-1b79e62d7ff2 None None] Port 04f733f6-72d8-4a61-b0af-10509ac4340b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:36.421326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7126dcf8-982c-4e4f-9f47-f20707ccd453 req-57ef6c85-2fe5-4853-9e95-ba157511d7ae service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0882108 Dec 21 04:13:36.447501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41e42f94-dd2b-4949-94be-271b951baf34 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.450655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-41e42f94-dd2b-4949-94be-271b951baf34 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.454349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-41e42f94-dd2b-4949-94be-271b951baf34 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/92b05209-50db-4f86-aa85-c75b9869816d HTTP/1.1" status: 204 len: 168 time: 0.3257608 Dec 21 04:13:36.455372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60146) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:36.488966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e42f94-dd2b-4949-94be-271b951baf34 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=92b05209-50db-4f86-aa85-c75b9869816d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:36.489166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.527395 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ce62e67-79f1-4028-b774-19a5910532be tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0709116 Dec 21 04:13:36.533565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60152) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:36.539864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--258340547'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:36.637318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.664134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae52cc8-0fb0-4cfa-9ec8-d57bab59577d req-f4c2d353-7394-4ecc-98ef-d89596b19a80 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:36.665650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ae52cc8-0fb0-4cfa-9ec8-d57bab59577d req-f4c2d353-7394-4ecc-98ef-d89596b19a80 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0971987 Dec 21 04:13:36.723168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.811091 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.854378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c8e3dc52-bd62-4091-ad3a-097a114e908c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:36.986161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:36.991268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-031372b5-c8fd-485b-aba1-00b28adbaa4d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4563482 Dec 21 04:13:36.991995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60166) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:36.997727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': 'c8e3dc52-bd62-4091-ad3a-097a114e908c', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:37.089937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.161724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.221132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.235821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ae52cc8-0fb0-4cfa-9ec8-d57bab59577d req-a7c46116-f350-4ced-a216-39a180540e51 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5105731 Dec 21 04:13:37.245723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4502f3c-95e2-4896-a86a-00e17e134d7f req-203666ef-83b6-4a68-897f-2f4ffe4b8ea7 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:37.247313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4502f3c-95e2-4896-a86a-00e17e134d7f req-203666ef-83b6-4a68-897f-2f4ffe4b8ea7 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 946 time: 0.1033344 Dec 21 04:13:37.262013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.282217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=23e78d96-3ae1-42e8-92b5-91e2a88f8da9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:37.372481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.373675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4502f3c-95e2-4896-a86a-00e17e134d7f req-6bb5d1e9-cd6c-4a7f-8577-66d12bdcb35e tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0915120 Dec 21 04:13:37.373847 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-22fe25a4-21db-4eb2-a64b-41a1ab847235 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3807046 Dec 21 04:13:37.376487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60172) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:37.411725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b25955a1-8855-46bf-83bb-2f4568d4f51c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules/23e78d96-3ae1-42e8-92b5-91e2a88f8da9 HTTP/1.1" status: 200 len: 763 time: 0.0315824 Dec 21 04:13:37.412051 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60174) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:37.452543 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a6a07738-03ae-4d23-b047-e375e6c48dff tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0390906 Dec 21 04:13:37.455101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60176) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:37.478125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-471b3388-8038-48ca-9f54-cb3868311027 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.479500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Router 891be34f-8c8b-4fe7-8b96-d25300ea7c9f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:37.485778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-471b3388-8038-48ca-9f54-cb3868311027 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.591607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-471b3388-8038-48ca-9f54-cb3868311027 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.604219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:37.604330 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-471b3388-8038-48ca-9f54-cb3868311027 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.604330 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-471b3388-8038-48ca-9f54-cb3868311027 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/23e78d96-3ae1-42e8-92b5-91e2a88f8da9 HTTP/1.1" status: 204 len: 168 time: 0.1477275 Dec 21 04:13:37.608675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60182) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:37.615409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] Sync routers for ids ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:37.616917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471b3388-8038-48ca-9f54-cb3868311027 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=23e78d96-3ae1-42e8-92b5-91e2a88f8da9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:37.638780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] Routers {'891be34f-8c8b-4fe7-8b96-d25300ea7c9f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:37.639712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:37.659564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8ae2f016-6b5f-4506-8964-38d43727a3e6 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0497031 Dec 21 04:13:37.661953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60184) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:37.666717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': 'c8e3dc52-bd62-4091-ad3a-097a114e908c', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:37.677680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:37.686852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] Routers {'891be34f-8c8b-4fe7-8b96-d25300ea7c9f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:37.687505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:37.721225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:37.721896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcec8e0f-5d83-47d9-a605-c89f30bc34b8 None None] The sync data for ids ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:37.751795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.755498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-353a4890-eab8-4f1d-825f-9d533dd45411 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 3.4186945 Dec 21 04:13:37.758231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:37.762575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': False}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:37.862714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.932803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:37.999272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.019714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7ccc33ad-3451-416f-9b2a-137fe94a6b8a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:38.123775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.266184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.267459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c67734be-8e34-40e0-97a0-3252a505d15d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6042750 Dec 21 04:13:38.290122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60204) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.315249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-686ca6dc-746f-47f7-a8db-dcaf9d0d2d8d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules/7ccc33ad-3451-416f-9b2a-137fe94a6b8a HTTP/1.1" status: 200 len: 763 time: 0.0241473 Dec 21 04:13:38.316628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60206) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.393070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13972198-b5b8-490c-bf36-cc7e41f385cb req-5045f68f-93e9-4cc6-8983-d7602afbf4f8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:38.394899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13972198-b5b8-490c-bf36-cc7e41f385cb req-5045f68f-93e9-4cc6-8983-d7602afbf4f8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0598385 Dec 21 04:13:38.403333 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a83506ba-8b15-45d7-9d38-5daff3f86ade tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0846331 Dec 21 04:13:38.410399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60210) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.445876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e28228a-6806-4f4c-8a6c-85524c04334a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.518891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e28228a-6806-4f4c-8a6c-85524c04334a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.518891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13972198-b5b8-490c-bf36-cc7e41f385cb req-5742484d-8b91-403d-986c-c7061f18da4c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820086 Dec 21 04:13:38.603736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d127e4-87bc-497b-80aa-724aab8cf54b req-0cb15b02-a29a-402c-95cb-dc8b11eb57cd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:38.605624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34d127e4-87bc-497b-80aa-724aab8cf54b req-0cb15b02-a29a-402c-95cb-dc8b11eb57cd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 946 time: 0.0528309 Dec 21 04:13:38.660313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34d127e4-87bc-497b-80aa-724aab8cf54b req-fb441b58-30e3-401e-8fe1-ff5977072159 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472257 Dec 21 04:13:38.684434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e28228a-6806-4f4c-8a6c-85524c04334a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.693938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e28228a-6806-4f4c-8a6c-85524c04334a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.698353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8e28228a-6806-4f4c-8a6c-85524c04334a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/7ccc33ad-3451-416f-9b2a-137fe94a6b8a HTTP/1.1" status: 204 len: 168 time: 0.2837183 Dec 21 04:13:38.701432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60214) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.707213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60216) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.712508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-121286146', 'description': 'tempest-secgroup-smoke-121286146 description', 'project_id': '10a032d25985452584a3dcdae6969809'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:38.721672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e28228a-6806-4f4c-8a6c-85524c04334a tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7ccc33ad-3451-416f-9b2a-137fe94a6b8a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:38.803048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8429f6e0-bf78-4107-82d9-1a2693ffe628 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0986707 Dec 21 04:13:38.805730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60218) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.810883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': 'c8e3dc52-bd62-4091-ad3a-097a114e908c', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:38.842440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6b8985-9c4a-4ae9-a22c-d597c2cb0a2a req-864479c2-8b13-4c23-ae5f-92ce312bf973 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:38.849581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa6b8985-9c4a-4ae9-a22c-d597c2cb0a2a req-864479c2-8b13-4c23-ae5f-92ce312bf973 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 946 time: 0.0617094 Dec 21 04:13:38.872079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.886636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.889674 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.896046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:38.934327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa6b8985-9c4a-4ae9-a22c-d597c2cb0a2a req-e305a121-bde9-4288-8537-17c68200be82 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0810120 Dec 21 04:13:38.957306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:38.995966 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Project 62de7541efd640f0af6648d6fac404cb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:39.006174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.017712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60226) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.021585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.078037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Router 891be34f-8c8b-4fe7-8b96-d25300ea7c9f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:39.091637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.097679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.133986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e9db4a49-f2e5-4452-83e4-ada53d786f1f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.191330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b04e435c-a36a-4673-91d6-57cee61928e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.194833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.212240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.261901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=16b1a92f-ffbb-47c9-b26c-60e0c1d7a77c,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.267649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:39.272454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b04e435c-a36a-4673-91d6-57cee61928e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.272860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.277418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-69936fc8-5fa2-4a79-8d33-15b9d7272aff tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "PUT /v2.0/routers/891be34f-8c8b-4fe7-8b96-d25300ea7c9f HTTP/1.1" status: 200 len: 921 time: 1.5170109 Dec 21 04:13:39.278414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60230) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.279113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.285394 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] Sync routers for ids ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:39.297814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] Routers {'891be34f-8c8b-4fe7-8b96-d25300ea7c9f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:39.298427 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:39.308219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f9f8a49a-c6e1-46d9-9a17-77192d2462b6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.329408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd2b1532-94ca-4391-a644-8d2273613395 tempest-TestVolumeBackupRestore-1573887177 tempest-TestVolumeBackupRestore-1573887177-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:39.332108 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:39.332693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd2b1532-94ca-4391-a644-8d2273613395 tempest-TestVolumeBackupRestore-1573887177 tempest-TestVolumeBackupRestore-1573887177-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1093 time: 0.3739858 Dec 21 04:13:39.335157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60232) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.339778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:39.340675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] Routers {'891be34f-8c8b-4fe7-8b96-d25300ea7c9f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:39.341261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:39.351562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.352717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f268b2b3-6d9d-46ae-bb1d-3bdcac495c89 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5460234 Dec 21 04:13:39.355720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60234) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.364718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b04e435c-a36a-4673-91d6-57cee61928e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.376229 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:39.377277 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef2a4313-6bf0-4d7a-b2a1-3592e5de9173 None None] The sync data for ids ['891be34f-8c8b-4fe7-8b96-d25300ea7c9f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:39.398850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad2b94a8-88a4-4396-8fe3-e714908a6777 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules/16b1a92f-ffbb-47c9-b26c-60e0c1d7a77c HTTP/1.1" status: 200 len: 769 time: 0.0414839 Dec 21 04:13:39.403052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60236) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.423013 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.423013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1c45a0d2-5f49-44d6-8df2-fdd92aac5208 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.7133305 Dec 21 04:13:39.426481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b04e435c-a36a-4673-91d6-57cee61928e5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=febd71b913114226923b8a45d696ae41&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4072692 Dec 21 04:13:39.427070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60238) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.427650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04e435c-a36a-4673-91d6-57cee61928e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54410265-76ab-4fba-9f45-592052111ece,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.429998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60240) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.434306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': 'f9f8a49a-c6e1-46d9-9a17-77192d2462b6', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:39.448809 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c255ba1b-f6b2-49e1-9552-9642d27c2f9c tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/891be34f-8c8b-4fe7-8b96-d25300ea7c9f HTTP/1.1" status: 200 len: 921 time: 0.1693032 Dec 21 04:13:39.452881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60242) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.480492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ccdfd20-fc14-4836-b5b8-68267efb0985 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.503027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ccdfd20-fc14-4836-b5b8-68267efb0985 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.545839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e770839-7e22-43bf-9dc3-5de661055e20 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.1416888 Dec 21 04:13:39.548861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60246) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.567093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.572071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a37a34b-3875-4915-85b3-02a6c1819fb4 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:39.577958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7a37a34b-3875-4915-85b3-02a6c1819fb4 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=891be34f-8c8b-4fe7-8b96-d25300ea7c9f&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1177566 Dec 21 04:13:39.578092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0ec7668-5927-4608-ab05-76b5f94df9b3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.580769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60248) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.603256 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0ec7668-5927-4608-ab05-76b5f94df9b3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.603462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.646320 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ccdfd20-fc14-4836-b5b8-68267efb0985 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.648856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ccdfd20-fc14-4836-b5b8-68267efb0985 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.652448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ccdfd20-fc14-4836-b5b8-68267efb0985 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/54410265-76ab-4fba-9f45-592052111ece HTTP/1.1" status: 204 len: 168 time: 0.2186482 Dec 21 04:13:39.689956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.697323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ccdfd20-fc14-4836-b5b8-68267efb0985 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54410265-76ab-4fba-9f45-592052111ece,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.714270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.726100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-443bc7e1-5328-42a9-bd56-d87200c2dcc7 req-f5688f7f-a477-4e3b-8dcb-2fe561c36dfb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:39.727678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-443bc7e1-5328-42a9-bd56-d87200c2dcc7 req-f5688f7f-a477-4e3b-8dcb-2fe561c36dfb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1476645 Dec 21 04:13:39.759602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31efe620-63c5-48a6-8849-19a8ed052eca tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:39.760984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-31efe620-63c5-48a6-8849-19a8ed052eca tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.1778576 Dec 21 04:13:39.764225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60252) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.781072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.790254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-443bc7e1-5328-42a9-bd56-d87200c2dcc7 req-20a7937e-d2b6-4d8b-ae99-476413cb07f1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515661 Dec 21 04:13:39.795400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0ec7668-5927-4608-ab05-76b5f94df9b3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.802871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0ec7668-5927-4608-ab05-76b5f94df9b3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.813727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f0ec7668-5927-4608-ab05-76b5f94df9b3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-group-rules/16b1a92f-ffbb-47c9-b26c-60e0c1d7a77c HTTP/1.1" status: 204 len: 168 time: 0.2540948 Dec 21 04:13:39.813727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60254) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.814103 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4b69dbcc-0c05-413a-a7a4-a7567d51d6bf tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=891be34f-8c8b-4fe7-8b96-d25300ea7c9f HTTP/1.1" status: 200 len: 205 time: 0.0468955 Dec 21 04:13:39.819031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60256) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.821947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ec7668-5927-4608-ab05-76b5f94df9b3 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=16b1a92f-ffbb-47c9-b26c-60e0c1d7a77c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.848179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b4ba4b1-9701-420a-b316-5d0b269b7625,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:39.907946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9ba76b27-4e10-4566-bedd-0c373b147a69 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0958755 Dec 21 04:13:39.909205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60258) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.931105 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:39.932786 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-039da58f-9e55-40b6-b871-9c0886c4ce5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5019512 Dec 21 04:13:39.936885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60260) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:39.941211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': 'f9f8a49a-c6e1-46d9-9a17-77192d2462b6', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:39.945638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Allocated IP 172.25.5.172 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/5280f20e-a92a-416e-a26f-d0e9b22226a8) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:39.977244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.036206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed37557-2697-424f-857a-a142b0b50a18 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.066557 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.070121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed37557-2697-424f-857a-a142b0b50a18 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.117779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.121938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.135433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.222589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed37557-2697-424f-857a-a142b0b50a18 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.225169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bed37557-2697-424f-857a-a142b0b50a18 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.225406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.226397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bed37557-2697-424f-857a-a142b0b50a18 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/c8e3dc52-bd62-4091-ad3a-097a114e908c HTTP/1.1" status: 204 len: 168 time: 0.3162606 Dec 21 04:13:40.227655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.231270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60270) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:40.248559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=62767023-24f3-4a5c-9538-f49e0e686554,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:40.263455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Deleting port 04f733f6-72d8-4a61-b0af-10509ac4340b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:40.263455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.296109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bed37557-2697-424f-857a-a142b0b50a18 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8e3dc52-bd62-4091-ad3a-097a114e908c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:40.308492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:40.314976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:40.317376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:40.326802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.328291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c072067a-d110-47b8-937b-e8a53383b135 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3898911 Dec 21 04:13:40.334448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:40.344001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': 'f9f8a49a-c6e1-46d9-9a17-77192d2462b6', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:40.356817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'Port': ['ID=5280f20e-a92a-416e-a26f-d0e9b22226a8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:40.380316 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8c7325bd-88c4-4cf2-baf1-b7550ffc20cb tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1431725 Dec 21 04:13:40.384640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60276) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:40.389037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group': {'name': 'tempest-secgroup--923902530'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:40.393137 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.407626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Calling delete_port for 04f733f6-72d8-4a61-b0af-10509ac4340b owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:40.524218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.618999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.630059 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.696623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.713936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.733430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c1ce23f8-b019-40ee-8934-ffd79fe5ed35,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:40.739109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.765716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event deleted for resources: {'Port': ['ID=04f733f6-72d8-4a61-b0af-10509ac4340b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:40.768409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60286) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:40.789307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7971cfd-17ff-478b-9a0b-3f611f5bdf32 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:40.835092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.843458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.847782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.851853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fad3cfab-c818-45d2-b7a3-a218931a99ef tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5164258 Dec 21 04:13:40.852467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:40.882306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': 'f9f8a49a-c6e1-46d9-9a17-77192d2462b6', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:40.890619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=22b992de-6229-4c5e-a8db-cddb2415d1da,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:40.922777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1880618981-network', 'tenant_id': '247cb1d10db0451abe7903925d39ba07'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:40.939346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.962053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.965534 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e68745cb-9213-4c7d-b331-8267eb90ac7c tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5776389 Dec 21 04:13:40.967055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60294) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:40.979340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Request body: {'security_group_rule': {'security_group_id': '22b992de-6229-4c5e-a8db-cddb2415d1da', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:40.986816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:40.990235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.065510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc985cb2-3d4a-4c99-9353-6af82ef80dff req-ba035ea3-4520-4871-ba00-874453dc28fe tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:41.067034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc985cb2-3d4a-4c99-9353-6af82ef80dff req-ba035ea3-4520-4871-ba00-874453dc28fe tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1502702 Dec 21 04:13:41.088885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.118273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc985cb2-3d4a-4c99-9353-6af82ef80dff req-2485a9be-d615-4671-b6e0-b64d5cd451c3 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446084 Dec 21 04:13:41.133881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.150714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Made reservation on behalf of 247cb1d10db0451abe7903925d39ba07 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:41.153265 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.159670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.160187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Fanout notify agent at l3_agent the message router_deleted on router 891be34f-8c8b-4fe7-8b96-d25300ea7c9f {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:41.173788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.178258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5e296ac-558c-4685-b23b-fc91260c6f1d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/891be34f-8c8b-4fe7-8b96-d25300ea7c9f HTTP/1.1" status: 204 len: 168 time: 1.3539793 Dec 21 04:13:41.178258 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.178987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:41.183938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1131787212', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:41.185907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.256293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.269895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.294817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.312111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.321331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.337226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bee9a91e-ffbb-44d4-b621-6dbce2326d17,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:41.349841 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.350199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.356704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.360530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.378100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:13:41.381302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a3ecbab-6118-413a-a7a2-89ac37893a88,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:41.383488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=799ede8c-8253-4a1c-ae82-09f6731ecab1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:41.390703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.391110 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Added segment 542e7a2d-ea7c-4083-b387-0bdcad1cf6fc of type vlan for network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 Dec 21 04:13:41.403077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.431666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.436435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8df3480a-605a-494e-91c5-a8d3c8215fb4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5790043 Dec 21 04:13:41.436661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60298) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:41.437149 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.437993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.461462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': 'f9f8a49a-c6e1-46d9-9a17-77192d2462b6', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:41.503752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.504953 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f3545f5d-b63a-43f9-afc8-f366ae7b5e54 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5315003 Dec 21 04:13:41.507809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60300) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:41.517285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event updated for resources: {'Port': ['ID=5280f20e-a92a-416e-a26f-d0e9b22226a8,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:41.538509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.561825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.562762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:41.563460 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.577709 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.592102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89b6a69f-3863-4a42-8bcd-b0a4038bd0a9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.640147 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:41.647563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.656477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] Pushing event updated for resources: {'Network': ['ID=5a8c4312-b76b-442d-aa89-ba658f5e54a8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:41.663800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89b6a69f-3863-4a42-8bcd-b0a4038bd0a9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.668354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:13:41.676836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d413f77e-19d4-46c2-8f0e-2ea2190b1df3 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9073341 Dec 21 04:13:41.679711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:41.679854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.683327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dd5a99cc-b9dd-44db-9d15-481e822d6758 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.5009561 Dec 21 04:13:41.689424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Request body: {'subnet': {'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1880618981-subnet', 'tenant_id': '247cb1d10db0451abe7903925d39ba07', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:41.689567 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Floating IP 58193120-3154-414a-a16c-a7e0b600a2f8 associated. External IP: 172.25.5.172, port: 66e81b00-da04-499e-996a-ce50856ba3df. Dec 21 04:13:41.689567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:41.693390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:41.778914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Made reservation on behalf of 247cb1d10db0451abe7903925d39ba07 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:41.781346 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.794655 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89b6a69f-3863-4a42-8bcd-b0a4038bd0a9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.797259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89b6a69f-3863-4a42-8bcd-b0a4038bd0a9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:41.798388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89b6a69f-3863-4a42-8bcd-b0a4038bd0a9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/22b992de-6229-4c5e-a8db-cddb2415d1da HTTP/1.1" status: 204 len: 168 time: 0.2895265 Dec 21 04:13:41.806780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:41.821870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b6a69f-3863-4a42-8bcd-b0a4038bd0a9 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=22b992de-6229-4c5e-a8db-cddb2415d1da,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:42.028402 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.089957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=79a84c6f-589d-401b-8841-bdeddbc4ba1d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:42.101016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Checking segment: {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:42.101382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Network hostable DHCP agents. Network: 5a8c4312-b76b-442d-aa89-ba658f5e54a8, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:13:42.181749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:13:42.244026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-403b6a62-db25-4f49-9aee-82202adfc747 req-02002858-36f0-41a3-9f13-e852367bb278 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:42.245569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-403b6a62-db25-4f49-9aee-82202adfc747 req-02002858-36f0-41a3-9f13-e852367bb278 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0512862 Dec 21 04:13:42.246634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5a8c4312-b76b-442d-aa89-ba658f5e54a8) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:42.255943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5664611b-6307-4c61-adc4-46cd7bac1e7a None None] Network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:42.259662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:42.259662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.289728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.301240 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8c619590-07df-487f-be23-da1d6e33c0fe tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.4909854 Dec 21 04:13:42.301806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60310) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:42.307609 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-403b6a62-db25-4f49-9aee-82202adfc747 req-a68e02ee-1273-457e-a62c-e2e4ce3f6b0c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521543 Dec 21 04:13:42.365251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ff128cf-e212-47d2-9a8f-d22b5c83b897 None None] Network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:42.373981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1656cf1b-e331-4d2c-b348-34f5e2b2f4a9 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6869752 Dec 21 04:13:42.387061 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.389959 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.452216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cddfd458-1feb-4f63-af55-821426573358,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:42.473866 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4b5c44ee-502a-496c-bf72-91a31cb240b4 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.1682141 Dec 21 04:13:42.473866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60314) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:42.519572 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-e40f80c4-e466-4d4e-9390-02c1ac1d08e7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] delete failed (client error): The resource could not be found. Dec 21 04:13:42.524944 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e40f80c4-e466-4d4e-9390-02c1ac1d08e7 tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "DELETE /v2.0/security-groups/22b992de-6229-4c5e-a8db-cddb2415d1da HTTP/1.1" status: 404 len: 347 time: 0.0460615 Dec 21 04:13:42.525462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60320) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:42.560195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.561393 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-11d43e98-fcaa-4053-b8aa-805e748028e7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 1.1222308 Dec 21 04:13:42.564503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60322) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:42.569189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': 'f9f8a49a-c6e1-46d9-9a17-77192d2462b6', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:42.608902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Router fb8045d1-7b4d-4398-bde2-94a619776157 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:42.620810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d670c11-6169-4806-bb9d-e74cf3d0eb5d tempest-SecGroupIPv6Test-464499296 tempest-SecGroupIPv6Test-464499296-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0933475 Dec 21 04:13:42.657147 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:42.663623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.735250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.779912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:42.790264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] Sync routers for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:42.800450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:42.801064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:42.820931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.841367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=96ba4068-7836-4ea9-9ce1-4cf365952e02,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:42.874833 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.899491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.925020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:42.938774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:42.940318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bbc75b45-8fbb-40d6-989c-4ec4b2b00063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3747201 Dec 21 04:13:42.945223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60326) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:42.948742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'network': {'name': 'tempest-network-smoke--2084384601', 'project_id': '10a032d25985452584a3dcdae6969809', 'port_security_enabled': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:43.004958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Allocated IP 172.25.5.54 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/0bca60be-3f6e-4528-b678-17fc7870c3af) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:43.011954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.051213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60328) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:43.051444 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f06d7c9a-1da0-49c1-b63b-2911084a53cf tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 3.7150931 Dec 21 04:13:43.054359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:43.056639 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33c0259e-cb91-406f-b854-9e33f3e6dca9" -d '{"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:43.091636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:43.095259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.128776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:13:43.138383 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab215a7a-2270-4a87-acf3-e51be02b4ff6 x-openstack-request-id: req-ab215a7a-2270-4a87-acf3-e51be02b4ff6 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:43.138731 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:43.139062 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ab215a7a-2270-4a87-acf3-e51be02b4ff6 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:43.139489 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'status': 'completed', 'code': 200} Dec 21 04:13:43.142428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.142795 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Added segment 5462f583-a9fa-4260-a352-17f7da388684 of type vlan for network 3f781088-f4ae-4039-bd42-2337b91d459d Dec 21 04:13:43.175312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.204494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-379279b9-8e14-4159-96ca-1770214f9d67 tempest-TestVolumeBackupRestore-1573887177 tempest-TestVolumeBackupRestore-1573887177-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:43.209899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-379279b9-8e14-4159-96ca-1770214f9d67 tempest-TestVolumeBackupRestore-1573887177 tempest-TestVolumeBackupRestore-1573887177-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1093 time: 0.1575251 Dec 21 04:13:43.212761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.212944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60334) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:43.218312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Request body: {'floatingip': {'port_id': '66e81b00-da04-499e-996a-ce50856ba3df'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:43.273615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-dad2d1fe-f548-4438-ad8d-7cd5ce2a9d4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:43.275632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-dad2d1fe-f548-4438-ad8d-7cd5ce2a9d4e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1098 time: 0.0597799 Dec 21 04:13:43.308237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60336) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:43.318994 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.360133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.399977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.405878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:43.406476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.469912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '58193120-3154-414a-a16c-a7e0b600a2f8', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'floating_ip_address': '172.25.5.172', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 3248, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:13:40Z', 'updated_at': '2021-12-21T04:13:40Z', 'revision_number': 0, 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:43.520881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] Checking router: fb8045d1-7b4d-4398-bde2-94a619776157 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:43.530485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:43.531155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:43.539254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5948653 Dec 21 04:13:43.550426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60346) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:43.562473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:43.570740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:43.574329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'admin_state_up': True, 'project_id': '10a032d25985452584a3dcdae6969809', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:43.579112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:43.585847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event updated for resources: {'Port': ['ID=0bca60be-3f6e-4528-b678-17fc7870c3af,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:43.632722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec40f324-d180-4cbf-bae1-bf8e50b8c04a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:43.676673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:43.677498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33cfc347-2c90-48bd-8e50-fd9bae03b480 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Network': ['ID=3f781088-f4ae-4039-bd42-2337b91d459d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:43.694719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-12a6ce45-2410-4e9c-ad1e-3d5de1249c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:43.696386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-12a6ce45-2410-4e9c-ad1e-3d5de1249c71 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 915 time: 0.4127491 Dec 21 04:13:43.712375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee119930-8fee-4301-8bdf-cfb668826575 req-7ad50b69-fb7e-4d99-b4bd-00b08ca3f233 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:43.713534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3f781088-f4ae-4039-bd42-2337b91d459d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:13:43.714493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee119930-8fee-4301-8bdf-cfb668826575 req-7ad50b69-fb7e-4d99-b4bd-00b08ca3f233 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.2751160 Dec 21 04:13:43.786142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60352) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:43.788112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9404d485-1747-426b-95b8-b47fc1e882e1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=62de7541efd640f0af6648d6fac404cb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4776387 Dec 21 04:13:43.795246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.796559 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.877065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-82081cc4-f2cc-440b-9a0e-31657a44a2ed None None] Provisioning complete for port 0bca60be-3f6e-4528-b678-17fc7870c3af triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:43.877606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82081cc4-f2cc-440b-9a0e-31657a44a2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:43.956816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-82081cc4-f2cc-440b-9a0e-31657a44a2ed None None] Port 0bca60be-3f6e-4528-b678-17fc7870c3af cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:43.971701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12afe587-fce7-4599-82e0-b9195a9071bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.009986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12afe587-fce7-4599-82e0-b9195a9071bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.012127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee119930-8fee-4301-8bdf-cfb668826575 req-ac1b0d9b-013a-4623-aa41-5e25789d0e80 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2864218 Dec 21 04:13:44.032315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.047492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-c3374cad-a56a-4004-929a-4650f47272ee service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 1000 time: 0.3317852 Dec 21 04:13:44.096931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '58193120-3154-414a-a16c-a7e0b600a2f8', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'floating_ip_address': '172.25.5.172', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 3248, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:13:40Z', 'updated_at': '2021-12-21T04:13:40Z', 'revision_number': 0, 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:44.118116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-bcdb9081-4811-4dd1-9b3b-04fee95becf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:44.120009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-bcdb9081-4811-4dd1-9b3b-04fee95becf0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.0598450 Dec 21 04:13:44.141785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0eb59e9f-57e3-461a-ade1-f0c116cf6d55 None None] The sync data for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 is: [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '58193120-3154-414a-a16c-a7e0b600a2f8', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'floating_ip_address': '172.25.5.172', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 3248, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:13:40Z', 'updated_at': '2021-12-21T04:13:40Z', 'revision_number': 0, 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:44.158879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.resource_extend [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 21 04:13:44.225484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.234098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.317562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12afe587-fce7-4599-82e0-b9195a9071bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.320104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12afe587-fce7-4599-82e0-b9195a9071bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.323083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12afe587-fce7-4599-82e0-b9195a9071bd admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e9961a41-7db2-4fcd-92c0-ea404df387c0 HTTP/1.1" status: 204 len: 168 time: 0.5341938 Dec 21 04:13:44.334566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-d0aba202-da19-4cb1-bbb7-efcb72e0e983 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:44.336526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12afe587-fce7-4599-82e0-b9195a9071bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9961a41-7db2-4fcd-92c0-ea404df387c0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:44.338908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-d0aba202-da19-4cb1-bbb7-efcb72e0e983 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1715584 Dec 21 04:13:44.349726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.375762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-63221580-d053-43b3-9f93-fe4b4caa1125 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:13:44.380963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-63221580-d053-43b3-9f93-fe4b4caa1125 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0318556 Dec 21 04:13:44.381736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.560768 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac31f053-f0a1-478e-a9eb-39938f790ab3 None None] New status for floating IP 58193120-3154-414a-a16c-a7e0b600a2f8: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:13:44.566655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.574788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:44.590275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-b2601a23-bcd7-4203-a291-15337bed0cad service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2025385 Dec 21 04:13:45.145374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33c0259e-cb91-406f-b854-9e33f3e6dca9 req-d4126cda-b512-43b7-8eab-4807384a3be8 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5468547 Dec 21 04:13:45.228502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Router fb8045d1-7b4d-4398-bde2-94a619776157 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:45.271180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.281878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231900c6-bf82-4363-8837-a4da555d6c2d req-a956953e-fbd0-43df-bc32-1db4bbcee56c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:45.283420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-231900c6-bf82-4363-8837-a4da555d6c2d req-a956953e-fbd0-43df-bc32-1db4bbcee56c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1423814 Dec 21 04:13:45.302516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.331631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Router d911d424-615b-43bd-9bfb-c546498a81ff is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:45.391545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-231900c6-bf82-4363-8837-a4da555d6c2d req-fa99b678-7375-40b3-9f0e-c365bf28ba87 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905662 Dec 21 04:13:45.417065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:45.422508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.430097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] Sync routers for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:45.440185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:45.440804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:45.446486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.129 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/ff213c4b-91fe-431f-8820-93bf8429741f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:45.483946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:45.486236 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6" -d '{"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:45.536025 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aace6a77-8541-4b52-bd8a-981653eb1c6c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "PUT /v2.0/floatingips/58193120-3154-414a-a16c-a7e0b600a2f8 HTTP/1.1" status: 200 len: 992 time: 2.3167806 Dec 21 04:13:45.538889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:45.551669 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] Sync routers for ids ['d911d424-615b-43bd-9bfb-c546498a81ff'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:45.557975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.560320 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b7a04db-5300-49f0-b32f-7ef8d1091ad3 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "PUT /v2.0/routers/d911d424-615b-43bd-9bfb-c546498a81ff HTTP/1.1" status: 200 len: 879 time: 3.8704736 Dec 21 04:13:45.562242 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31759532-8ee1-43da-8686-45dc592c74ac x-openstack-request-id: req-31759532-8ee1-43da-8686-45dc592c74ac {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:45.562796 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:45.563231 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-31759532-8ee1-43da-8686-45dc592c74ac {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:45.563908 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'status': 'completed', 'code': 200} Dec 21 04:13:45.564588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60384) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:45.595050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.595586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] Routers {'d911d424-615b-43bd-9bfb-c546498a81ff'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:45.595586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d911d424-615b-43bd-9bfb-c546498a81ff'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:45.630263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:45.680183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-6cf77849-9b34-4e5f-87bc-52608c429fb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:45.682281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-6cf77849-9b34-4e5f-87bc-52608c429fb5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1098 time: 0.0619907 Dec 21 04:13:45.683215 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:45.687607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.712773 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] Routers {'d911d424-615b-43bd-9bfb-c546498a81ff'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:45.714211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d911d424-615b-43bd-9bfb-c546498a81ff'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:45.741440 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e68ab804-6d7a-4481-b2d8-e78a4185401d tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/d911d424-615b-43bd-9bfb-c546498a81ff HTTP/1.1" status: 200 len: 920 time: 0.1731157 Dec 21 04:13:45.741966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:45.768313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:45.775502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60390) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:45.778490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:45.795800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93ec928f-1d20-4252-a032-0017d09d0fca None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:45.801986 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:45.802645 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-665dce4b-4149-485a-ba34-b45d6c2b1e56 None None] The sync data for ids ['d911d424-615b-43bd-9bfb-c546498a81ff'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:45.805006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ab54502-d71b-4aa9-9d39-3c4475317fe3 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:45.807110 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ab54502-d71b-4aa9-9d39-3c4475317fe3 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=d911d424-615b-43bd-9bfb-c546498a81ff&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0641489 Dec 21 04:13:45.809996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60392) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:45.833274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=ff213c4b-91fe-431f-8820-93bf8429741f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:45.837709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:45.917909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-a41b08cf-f21f-4d84-b14d-2ee0ab828c23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:45.919454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-a41b08cf-f21f-4d84-b14d-2ee0ab828c23 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 915 time: 0.2189558 Dec 21 04:13:45.976844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f302bdac-11ca-4aab-be96-963e1a0c1f92 None None] Provisioning complete for port ff213c4b-91fe-431f-8820-93bf8429741f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:45.977220 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f302bdac-11ca-4aab-be96-963e1a0c1f92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:45.992796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e28fdc44-53ce-42d3-9beb-374673606924 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:45.994410 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e28fdc44-53ce-42d3-9beb-374673606924 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.1830556 Dec 21 04:13:45.998516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60406) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:46.015301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f302bdac-11ca-4aab-be96-963e1a0c1f92 None None] Port ff213c4b-91fe-431f-8820-93bf8429741f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:46.038055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '58193120-3154-414a-a16c-a7e0b600a2f8', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'floating_ip_address': '172.25.5.172', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 3248, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:13:40Z', 'updated_at': '2021-12-21T04:13:44Z', 'revision_number': 2, 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:46.038370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ff3d31b-a1c0-43c8-8e1b-4ee4a9373906 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=d911d424-615b-43bd-9bfb-c546498a81ff HTTP/1.1" status: 200 len: 205 time: 0.0382538 Dec 21 04:13:46.043379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60408) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:46.056643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1dc8762d-0531-4191-a070-ab0d127b1736 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'default'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:46.058252 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-1dc8762d-0531-4191-a070-ab0d127b1736 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 21 04:13:46.058802 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-1dc8762d-0531-4191-a070-ab0d127b1736 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): There was a conflict when trying to complete your request. Dec 21 04:13:46.063367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1dc8762d-0531-4191-a070-ab0d127b1736 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.2826629 Dec 21 04:13:46.065747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] Checking router: fb8045d1-7b4d-4398-bde2-94a619776157 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:46.075400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60410) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:46.075615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:46.075889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:46.108333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--1621845932'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:46.152241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.182894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:46.192183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-97abc246-0c75-438a-9ca2-a2e39643b982 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 1002 time: 0.2371490 Dec 21 04:13:46.269671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.277181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-fe434fed-ebe1-4e14-9198-ed070c9d5540 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:46.278830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-fe434fed-ebe1-4e14-9198-ed070c9d5540 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/networks?id=5a8c4312-b76b-442d-aa89-ba658f5e54a8 HTTP/1.1" status: 200 len: 809 time: 0.3218338 Dec 21 04:13:46.283800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.305921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.309052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-26ab3746-fc65-4f70-9005-4788ab155f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:46.310514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-26ab3746-fc65-4f70-9005-4788ab155f26 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.1088037 Dec 21 04:13:46.319765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-d5e6fa48-9dcf-43e2-afac-a5feb85ac628 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/quotas/247cb1d10db0451abe7903925d39ba07 HTTP/1.1" status: 200 len: 375 time: 0.0317173 Dec 21 04:13:46.423449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-e9802915-0988-4396-9f7b-8b0044a5f4e5 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=247cb1d10db0451abe7903925d39ba07&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0668447 Dec 21 04:13:46.428372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Deleting port 0bca60be-3f6e-4528-b678-17fc7870c3af {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:46.429049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.435651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '58193120-3154-414a-a16c-a7e0b600a2f8', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'floating_ip_address': '172.25.5.172', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 3248, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:13:40Z', 'updated_at': '2021-12-21T04:13:44Z', 'revision_number': 2, 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:46.467694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c888e9-c163-41f5-a0ab-97aa6852c160 None None] The sync data for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 is: [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '58193120-3154-414a-a16c-a7e0b600a2f8', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'floating_ip_address': '172.25.5.172', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'port_id': '66e81b00-da04-499e-996a-ce50856ba3df', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 3248, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'mac_address': 'fa:16:3e:ce:79:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03aef065-24b8-400c-8e95-d05a9816bd77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:13:40Z', 'updated_at': '2021-12-21T04:13:44Z', 'revision_number': 2, 'project_id': '620778ddaf44496aa625b5014155c9de', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:46.539536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.555787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Calling delete_port for 0bca60be-3f6e-4528-b678-17fc7870c3af owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:46.606975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-d1cf74b9-4134-422d-95b1-c1a0795677a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:46.608751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-d1cf74b9-4134-422d-95b1-c1a0795677a7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2541640 Dec 21 04:13:46.620002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.708374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415679c4-46de-47ab-9367-6c468609f533 req-02fff7e2-7284-4a4f-ab3e-43a939f789db tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:46.709846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-415679c4-46de-47ab-9367-6c468609f533 req-02fff7e2-7284-4a4f-ab3e-43a939f789db tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.2080524 Dec 21 04:13:46.761338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-9f6905c6-a3aa-4bf1-bc26-8af83a9f2b63 service neutron] 10.222.0.18 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2940621 Dec 21 04:13:46.784569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.812793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event deleted for resources: {'Port': ['ID=0bca60be-3f6e-4528-b678-17fc7870c3af,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:46.823362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b591f1d7-1565-4d2d-a2de-04dd8353b0c1 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:46.829421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.880157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.902591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.963431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-415679c4-46de-47ab-9367-6c468609f533 req-89890067-18e4-4379-ae6a-613b40095760 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2331111 Dec 21 04:13:46.979885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:46.982533 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.102235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.102778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Fanout notify agent at l3_agent the message router_deleted on router d911d424-615b-43bd-9bfb-c546498a81ff {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:47.110442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.114888 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6586acd1-426d-4bd3-85f2-5f605347ebc4 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/d911d424-615b-43bd-9bfb-c546498a81ff HTTP/1.1" status: 204 len: 168 time: 1.0671730 Dec 21 04:13:47.115466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60414) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:47.119743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1866275183', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:47.210695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.211819 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.268045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.297832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=03c1a130-b4eb-408b-bb74-db2daea74a65,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:47.314854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-7a7ab245-4ea8-459b-b7ff-dc919333187f service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6485121 Dec 21 04:13:47.331005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.363147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-e1b14c6b-064b-4ec9-86fc-9439c674d04b service neutron] 10.222.0.18 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5359454 Dec 21 04:13:47.413088 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.417463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fdff54f9-146f-4ab6-85d7-c2bd6dd2e539 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.2983696 Dec 21 04:13:47.417835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60416) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:47.422533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': True}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:47.424489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.458925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.503497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.562543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6442b7d-f4dd-4265-9cc7-a1ce750b84f6 req-7ae7e8a8-5c0e-4403-9b25-f65038bddbc9 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2027042 Dec 21 04:13:47.567530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:47.569870 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78381d37-e0bc-4225-8996-8543317d0628" -d '{"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:47.597264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=580b57b7-1548-4d2f-b3f3-5de19814f0c6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:47.621197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.625394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1cd3ec86-5a23-435c-9dd4-4f5268093bc8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 1.5454140 Dec 21 04:13:47.626082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:47.638610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '580b57b7-1548-4d2f-b3f3-5de19814f0c6', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:47.663805 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9209d76e-f49c-46ef-ac68-536468b7b15d x-openstack-request-id: req-9209d76e-f49c-46ef-ac68-536468b7b15d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:47.664110 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:47.664367 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9209d76e-f49c-46ef-ac68-536468b7b15d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:47.664765 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'status': 'completed', 'code': 200} Dec 21 04:13:47.670733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.680818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cbe8a4a-d6a5-4083-b0fb-9070c7c020a4 req-53934331-1518-41d7-8c6f-49ee2f426197 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 210 time: 0.0519071 Dec 21 04:13:47.750005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78381d37-e0bc-4225-8996-8543317d0628 req-d5334301-51a5-4071-a73e-9e6c01f192aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:47.751695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-d5334301-51a5-4071-a73e-9e6c01f192aa service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1098 time: 0.0586109 Dec 21 04:13:47.796797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:47.798522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.934256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.953453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:47.973537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78381d37-e0bc-4225-8996-8543317d0628 req-85410773-b7d1-4268-924c-96280e33aa81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:47.975063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-85410773-b7d1-4268-924c-96280e33aa81 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 915 time: 0.2083666 Dec 21 04:13:47.988365 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.049735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:48.059770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Sync routers for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:48.070869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:48.071524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:48.074510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Allocated IP 172.25.5.98 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/f54adb17-71c4-4b5c-bb98-00ead96f9837) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:48.074661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.120792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-f4e0d639-1c92-4a04-a7f3-d9d9c21b8c83 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 1002 time: 0.1297126 Dec 21 04:13:48.128242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=42609b4b-9966-48ce-885d-a0f0cb58e823,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:48.182062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d476d-fdd8-48c1-9730-3f9d0ca9b1f0 req-7154653d-01f9-43c2-968e-9b84fcf4e664 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:48.183687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b5d476d-fdd8-48c1-9730-3f9d0ca9b1f0 req-7154653d-01f9-43c2-968e-9b84fcf4e664 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1243069 Dec 21 04:13:48.211921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:48.212837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78381d37-e0bc-4225-8996-8543317d0628 req-f3e5b3fd-13c3-4b78-97fa-22b47e680d5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:48.214879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-f3e5b3fd-13c3-4b78-97fa-22b47e680d5e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.0808759 Dec 21 04:13:48.234360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.244031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.248381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ed04da37-cb49-4d61-b150-d011e08a27b7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 4.6897423 Dec 21 04:13:48.249075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60432) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:48.288193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b5d476d-fdd8-48c1-9730-3f9d0ca9b1f0 req-fbf22d7e-b810-4d6c-8105-cbfff2f5e3f7 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967236 Dec 21 04:13:48.298441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.299202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-67f2816d-f4eb-4b8e-af8e-784fe28c16f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6686311 Dec 21 04:13:48.301589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:48.313711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-32235893-fc28-47fc-ba8d-7907bebe2bce tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '580b57b7-1548-4d2f-b3f3-5de19814f0c6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:48.318584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78381d37-e0bc-4225-8996-8543317d0628 req-15fa1222-1922-4fb6-9b8e-c26be2d8092e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:48.320724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-15fa1222-1922-4fb6-9b8e-c26be2d8092e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0971546 Dec 21 04:13:48.352500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.397347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:48.402700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:48.406978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:48.440645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-d5ba7332-b03f-444a-9518-18457555c51f service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1103115 Dec 21 04:13:48.443545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e961363c-7afb-46c2-8826-9a0370b5caae None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:48.446448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Port': ['ID=f54adb17-71c4-4b5c-bb98-00ead96f9837,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:48.467323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32235893-fc28-47fc-ba8d-7907bebe2bce tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.478836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:46Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:48.516343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c8a9dfe-57aa-4ef0-b93c-27f5106d75f2 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=10a032d25985452584a3dcdae6969809&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2661142 Dec 21 04:13:48.521073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60440) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:48.679962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78381d37-e0bc-4225-8996-8543317d0628 req-79aba261-917b-4520-a812-958aa3797a79 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2280846 Dec 21 04:13:48.702402 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-32235893-fc28-47fc-ba8d-7907bebe2bce tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): There was a conflict when trying to complete your request. Dec 21 04:13:48.708071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60444) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:48.709177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-32235893-fc28-47fc-ba8d-7907bebe2bce tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.4060552 Dec 21 04:13:48.736447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Checking router: 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:48.736868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Updating router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 port ff213c4b-91fe-431f-8820-93bf8429741f binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:13:48.742768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f5738db-0caf-4066-a40c-5e628eb4ff38 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:48.744944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f5738db-0caf-4066-a40c-5e628eb4ff38 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2235563 Dec 21 04:13:48.748737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60446) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:48.777803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bba90944-a7ea-44ed-960f-be2e0b60264e req-ce3107fb-30c3-4255-82f5-36dd33954d19 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 210 time: 0.0366592 Dec 21 04:13:48.778793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a08dc39c-67bb-490a-b6af-755fb73ae096 None None] Provisioning complete for port f54adb17-71c4-4b5c-bb98-00ead96f9837 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:48.779387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a08dc39c-67bb-490a-b6af-755fb73ae096 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.783050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.786243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c8208592-4d37-4734-8198-cec774e82f26 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0363078 Dec 21 04:13:48.789536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60448) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:48.803873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-465142180', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'project_id': '10a032d25985452584a3dcdae6969809', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:48.818338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad098899-dede-4282-8b51-4676fb25746b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.851639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad098899-dede-4282-8b51-4676fb25746b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.855007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a08dc39c-67bb-490a-b6af-755fb73ae096 None None] Port f54adb17-71c4-4b5c-bb98-00ead96f9837 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:48.968097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.982030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad098899-dede-4282-8b51-4676fb25746b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.985665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad098899-dede-4282-8b51-4676fb25746b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:48.986506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad098899-dede-4282-8b51-4676fb25746b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/580b57b7-1548-4d2f-b3f3-5de19814f0c6 HTTP/1.1" status: 204 len: 168 time: 0.2776074 Dec 21 04:13:48.991984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60450) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:49.022161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad098899-dede-4282-8b51-4676fb25746b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=580b57b7-1548-4d2f-b3f3-5de19814f0c6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:49.081394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cb273865-ed46-48e7-a577-70da1605f0d8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0880110 Dec 21 04:13:49.087288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:49.092499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--1253717146'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:49.122709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:49.126252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.138372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.189885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.220839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.277518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33a67868-f0b7-49fe-a13a-491441547ff8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:49.295739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.308295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Attempting to bind port ff213c4b-91fe-431f-8820-93bf8429741f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:49.308547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Attempting to bind port ff213c4b-91fe-431f-8820-93bf8429741f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:49.308896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Attempting to bind port ff213c4b-91fe-431f-8820-93bf8429741f on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:49.314775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9825d1-c3aa-4d5c-9521-7c8c0ba50b5c None None] Pushing event updated for resources: {'Port': ['ID=ff213c4b-91fe-431f-8820-93bf8429741f,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:49.318605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:49.318993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:49.319379 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.319784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:49.320277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Bound port: ff213c4b-91fe-431f-8820-93bf8429741f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:49.320670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.365341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.420643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e958d5f8-b60b-4d3f-a3db-b9aa5c5780fd None None] Provisioning complete for port ff213c4b-91fe-431f-8820-93bf8429741f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:49.421014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e958d5f8-b60b-4d3f-a3db-b9aa5c5780fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.426593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] For port ff213c4b-91fe-431f-8820-93bf8429741f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:49.446410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e407e591-7bfe-4df3-a99b-0a5c1fc058a2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:49.474896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] For port ff213c4b-91fe-431f-8820-93bf8429741f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff213c4b-91fe-431f-8820-93bf8429741f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:49.475732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30139fa9-5f8b-4e27-85de-a6c53def351a req-4571d91d-5b5e-4c59-8650-ca8c522e0472 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:49.477777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30139fa9-5f8b-4e27-85de-a6c53def351a req-4571d91d-5b5e-4c59-8650-ca8c522e0472 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0661731 Dec 21 04:13:49.484145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e958d5f8-b60b-4d3f-a3db-b9aa5c5780fd None None] Port ff213c4b-91fe-431f-8820-93bf8429741f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:49.491049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.491049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-de927dee-7a58-400a-afd9-1d01ae66fca8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3968978 Dec 21 04:13:49.491049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60456) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:49.494501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4257549d-bdfa-40e9-b244-4a7389c125c2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'e407e591-7bfe-4df3-a99b-0a5c1fc058a2', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:49.495380 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-4257549d-bdfa-40e9-b244-4a7389c125c2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Dec 21 04:13:49.496442 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-4257549d-bdfa-40e9-b244-4a7389c125c2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:49.499078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4257549d-bdfa-40e9-b244-4a7389c125c2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0072737 Dec 21 04:13:49.505880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60458) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:49.568893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.578319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30139fa9-5f8b-4e27-85de-a6c53def351a req-14064a62-3b19-4fd2-a60a-112e04325851 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796721 Dec 21 04:13:49.601469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4a8ae6-2521-48cf-8450-8f9af8841503 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.633255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4a8ae6-2521-48cf-8450-8f9af8841503 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.674768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.675419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba1bf8d4-b8c6-4482-b780-153fa1a89e29 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:49.681154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.713218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:49.713952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:49.773034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4a8ae6-2521-48cf-8450-8f9af8841503 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.773688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9825d1-c3aa-4d5c-9521-7c8c0ba50b5c None None] Pushing event updated for resources: {'Port': ['ID=ff213c4b-91fe-431f-8820-93bf8429741f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:49.777818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab4a8ae6-2521-48cf-8450-8f9af8841503 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.779715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ab4a8ae6-2521-48cf-8450-8f9af8841503 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/e407e591-7bfe-4df3-a99b-0a5c1fc058a2 HTTP/1.1" status: 204 len: 168 time: 0.2717862 Dec 21 04:13:49.784813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60460) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:49.792807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4a8ae6-2521-48cf-8450-8f9af8841503 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e407e591-7bfe-4df3-a99b-0a5c1fc058a2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:49.862019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7322e991-2e0c-4d50-baa2-7528910e9a3e None None] Provisioning complete for port ff213c4b-91fe-431f-8820-93bf8429741f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:49.862654 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7322e991-2e0c-4d50-baa2-7528910e9a3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.917870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe736eea-dfb8-43d5-a161-1d5712508a51 req-ef7bf936-4974-4a3c-b631-e60ed14c034d tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 210 time: 0.0375674 Dec 21 04:13:49.942437 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8f639a5d-4c15-4ddd-ad15-da64a02fbbbf tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1529477 Dec 21 04:13:49.943234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60464) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:49.943663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b02c7e7-a8f3-4161-bb92-5523ff79d237 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:49.951643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--8236352'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:49.993237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:50.024767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.086462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Subnet': ['ID=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:50.097308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Checking segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:50.097677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network hostable DHCP agents. Network: 3f781088-f4ae-4039-bd42-2337b91d459d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:13:50.102183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Router 79a8d038-aadc-4525-8fae-ff99bd80be65 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:50.104585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.184999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7322e991-2e0c-4d50-baa2-7528910e9a3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.225951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7322e991-2e0c-4d50-baa2-7528910e9a3e None None] For port ff213c4b-91fe-431f-8820-93bf8429741f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff213c4b-91fe-431f-8820-93bf8429741f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:50.276529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:46Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:50.291219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 3f781088-f4ae-4039-bd42-2337b91d459d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:13:50.309658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc217585-3711-4096-99a6-5f8cf58e9c23 None None] The sync data for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 is: [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:46Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:50.320435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7322e991-2e0c-4d50-baa2-7528910e9a3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.382387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7322e991-2e0c-4d50-baa2-7528910e9a3e None None] Pushing event updated for resources: {'Port': ['ID=ff213c4b-91fe-431f-8820-93bf8429741f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:50.387349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:50.392501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.394222 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9bdb3d52-d233-4daa-9eba-714cd7035c89 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "PUT /v2.0/routers/79a8d038-aadc-4525-8fae-ff99bd80be65 HTTP/1.1" status: 200 len: 914 time: 2.9749286 Dec 21 04:13:50.397260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60466) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:50.399482 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] Sync routers for ids ['79a8d038-aadc-4525-8fae-ff99bd80be65'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:50.407200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.410295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 3f781088-f4ae-4039-bd42-2337b91d459d) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:50.419752 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] Routers {'79a8d038-aadc-4525-8fae-ff99bd80be65'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:50.419752 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['79a8d038-aadc-4525-8fae-ff99bd80be65'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:50.420249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-143ab323-904d-419f-a21f-f600abdcfb8b tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:50.420782 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-143ab323-904d-419f-a21f-f600abdcfb8b tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "GET /v2.0/networks?id=5a8c4312-b76b-442d-aa89-ba658f5e54a8 HTTP/1.1" status: 200 len: 809 time: 0.2476830 Dec 21 04:13:50.421301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06d6015f-13b2-42de-bd1e-db14696cdad4 None None] Network 3f781088-f4ae-4039-bd42-2337b91d459d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:50.424008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:50.424891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.439805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Request body: {'port': {'device_id': '6130694f-d802-40bc-bcba-1184a114d366', 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8', 'admin_state_up': True, 'tenant_id': '247cb1d10db0451abe7903925d39ba07'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:50.471481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.501396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:50.514316 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] Routers {'79a8d038-aadc-4525-8fae-ff99bd80be65'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:50.515571 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['79a8d038-aadc-4525-8fae-ff99bd80be65'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:50.540895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dbe9a5b7-13cb-4779-b6b1-16a1696354e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 1.7503097 Dec 21 04:13:50.546700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:50.567136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=beb245c6-08f1-4fe2-be31-1580caf65667,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:50.586057 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:50.586716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6133ec5-3222-4f19-88e8-8bca0cc8f7f0 None None] The sync data for ids ['79a8d038-aadc-4525-8fae-ff99bd80be65'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:50.646028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-3f781088-f4ae-4039-bd42-2337b91d459d', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:13:50.648576 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.656026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.658500 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ee02029-a10e-48cf-910f-286886d8f597 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.7118270 Dec 21 04:13:50.671357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:50.683412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fa49e812-002b-4f93-93c6-b9d6c7815c7b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'beb245c6-08f1-4fe2-be31-1580caf65667', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:50.684370 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-fa49e812-002b-4f93-93c6-b9d6c7815c7b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Dec 21 04:13:50.684882 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-fa49e812-002b-4f93-93c6-b9d6c7815c7b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:50.685898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fa49e812-002b-4f93-93c6-b9d6c7815c7b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0135641 Dec 21 04:13:50.692422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60474) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:50.693352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8933bd5e-29b0-4c1e-872a-a923b113f074 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/79a8d038-aadc-4525-8fae-ff99bd80be65 HTTP/1.1" status: 200 len: 920 time: 0.2945290 Dec 21 04:13:50.696457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60476) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:50.764969 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51dfa4de-d1d5-4cd3-bcd5-dc4fe264a5c3 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.778276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Made reservation on behalf of 247cb1d10db0451abe7903925d39ba07 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:50.784056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.809249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51dfa4de-d1d5-4cd3-bcd5-dc4fe264a5c3 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.856125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Allocated IP 172.20.0.2 (3f781088-f4ae-4039-bd42-2337b91d459d/cc3361a8-c44a-4f96-8ecd-d8322bcd66f1/089e9f43-1c79-4a0c-9082-6506d41f045d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:50.983613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51dfa4de-d1d5-4cd3-bcd5-dc4fe264a5c3 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.983613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-51dfa4de-d1d5-4cd3-bcd5-dc4fe264a5c3 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:50.984848 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-51dfa4de-d1d5-4cd3-bcd5-dc4fe264a5c3 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/beb245c6-08f1-4fe2-be31-1580caf65667 HTTP/1.1" status: 204 len: 168 time: 0.2912874 Dec 21 04:13:50.990732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.009444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51dfa4de-d1d5-4cd3-bcd5-dc4fe264a5c3 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=beb245c6-08f1-4fe2-be31-1580caf65667,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:51.030468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Allocated IP 172.20.0.12 (5a8c4312-b76b-442d-aa89-ba658f5e54a8/79a84c6f-589d-401b-8841-bdeddbc4ba1d/e398923b-d2b4-4502-89ec-272ed2d85b89) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:51.064043 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5f06701-0836-4617-8b16-fbd53b5166fc tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0680716 Dec 21 04:13:51.067756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60482) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.077225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--1825510693'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:51.109624 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.164796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.193974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.253907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc882eb9-12e2-4eb0-9552-ce11c09bdf61 req-bc05394b-a555-4c01-bbbe-cb1d266573d9 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 210 time: 0.0604315 Dec 21 04:13:51.283290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e2be2c3-1a45-4a82-a8a9-223c058b75b9 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:51.285807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6e2be2c3-1a45-4a82-a8a9-223c058b75b9 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=79a8d038-aadc-4525-8fae-ff99bd80be65&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.5881464 Dec 21 04:13:51.290028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.292338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Network 3f781088-f4ae-4039-bd42-2337b91d459d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:51.296406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:51.300295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:51.308046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Pushing event updated for resources: {'Port': ['ID=089e9f43-1c79-4a0c-9082-6506d41f045d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:51.327595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18555dfa-6f36-42b6-9192-dca05c779475 req-2ac8c5c7-891b-4210-b795-556590042dcd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:51.329645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18555dfa-6f36-42b6-9192-dca05c779475 req-2ac8c5c7-891b-4210-b795-556590042dcd tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.5842955 Dec 21 04:13:51.392213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff213c4b-91fe-431f-8820-93bf8429741f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:51.400104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.418051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Attempting to bind port 089e9f43-1c79-4a0c-9082-6506d41f045d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:51.418553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Attempting to bind port 089e9f43-1c79-4a0c-9082-6506d41f045d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:51.418849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Attempting to bind port 089e9f43-1c79-4a0c-9082-6506d41f045d on network 3f781088-f4ae-4039-bd42-2337b91d459d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:51.442829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.453800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:51.454699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Checking segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:51.454988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.455404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Bound using segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:51.455955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Bound port: 089e9f43-1c79-4a0c-9082-6506d41f045d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:51.456586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.477900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae7c269e-c70c-4cb7-9ba4-28e21fa9fc0a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:51.482293 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ae7c269e-c70c-4cb7-9ba4-28e21fa9fc0a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.1865013 Dec 21 04:13:51.482445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18555dfa-6f36-42b6-9192-dca05c779475 req-f28e51ad-80b5-42a3-806e-d89fc29e229f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979631 Dec 21 04:13:51.484142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.513565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7fe88360-57a2-4bdc-b377-388f0f54cbd1 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=79a8d038-aadc-4525-8fae-ff99bd80be65 HTTP/1.1" status: 200 len: 205 time: 0.0283372 Dec 21 04:13:51.515529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.528366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60488) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.560913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=434dcbae-3382-489c-beba-7f6d6be840e8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:51.588312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] For port 089e9f43-1c79-4a0c-9082-6506d41f045d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:51.592035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] For port 089e9f43-1c79-4a0c-9082-6506d41f045d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=089e9f43-1c79-4a0c-9082-6506d41f045d,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:51.602623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.619288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ff213c4b-91fe-431f-8820-93bf8429741f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:51.619938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.653028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.657372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-39ad6f86-3a64-4046-b0e3-8a6509e8cb48 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5850561 Dec 21 04:13:51.660540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.671177 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.678796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ee9b214a-68fa-44d2-b1c3-79f07ec5cb37 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '434dcbae-3382-489c-beba-7f6d6be840e8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:51.699740 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-ee9b214a-68fa-44d2-b1c3-79f07ec5cb37 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Dec 21 04:13:51.700431 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-ee9b214a-68fa-44d2-b1c3-79f07ec5cb37 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:51.704242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ee9b214a-68fa-44d2-b1c3-79f07ec5cb37 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0322547 Dec 21 04:13:51.705685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60492) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.710307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4d113183-6b00-48d9-96f8-c0cb140459df tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '434dcbae-3382-489c-beba-7f6d6be840e8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:51.712416 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-4d113183-6b00-48d9-96f8-c0cb140459df tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Dec 21 04:13:51.713546 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-4d113183-6b00-48d9-96f8-c0cb140459df tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:51.715307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4d113183-6b00-48d9-96f8-c0cb140459df tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0085835 Dec 21 04:13:51.721495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60494) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.723361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:51.769524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0a4d2a22-2b43-4fd2-8fd8-4e6612a66408 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '434dcbae-3382-489c-beba-7f6d6be840e8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:51.770990 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-0a4d2a22-2b43-4fd2-8fd8-4e6612a66408 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Dec 21 04:13:51.771710 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-0a4d2a22-2b43-4fd2-8fd8-4e6612a66408 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:51.772783 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a4d2a22-2b43-4fd2-8fd8-4e6612a66408 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0105770 Dec 21 04:13:51.777335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60496) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.779259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:51.785294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e94012-aa83-4f76-9c03-aa9af33044a2 None None] Pushing event updated for resources: {'Port': ['ID=089e9f43-1c79-4a0c-9082-6506d41f045d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:51.789400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:51.794558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Pushing event updated for resources: {'Port': ['ID=e398923b-d2b4-4502-89ec-272ed2d85b89,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:51.798751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-772b579f-c0a1-4d64-8397-99db7be4b4a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '434dcbae-3382-489c-beba-7f6d6be840e8', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:51.799593 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-772b579f-c0a1-4d64-8397-99db7be4b4a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Dec 21 04:13:51.800826 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-772b579f-c0a1-4d64-8397-99db7be4b4a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:51.804838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-772b579f-c0a1-4d64-8397-99db7be4b4a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0235574 Dec 21 04:13:51.807132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:51.855393 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.894032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.899410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:51.901063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.919178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6d1d0fa-db7e-4fd9-8f47-93ff9b30ab5f tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:51.947830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6d1d0fa-db7e-4fd9-8f47-93ff9b30ab5f tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.000054 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-2dc7cb2d-3edd-4e0c-a032-4c23b8e08acc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5642619 Dec 21 04:13:52.020876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Request body: {'port': {'device_id': '6130694f-d802-40bc-bcba-1184a114d366', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:52.047321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.089557 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.198765 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6d1d0fa-db7e-4fd9-8f47-93ff9b30ab5f tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.201472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6d1d0fa-db7e-4fd9-8f47-93ff9b30ab5f tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.202769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a6d1d0fa-db7e-4fd9-8f47-93ff9b30ab5f tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/434dcbae-3382-489c-beba-7f6d6be840e8 HTTP/1.1" status: 204 len: 168 time: 0.3946452 Dec 21 04:13:52.233395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:52.265590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6d1d0fa-db7e-4fd9-8f47-93ff9b30ab5f tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=434dcbae-3382-489c-beba-7f6d6be840e8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:52.341661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Deleting port f54adb17-71c4-4b5c-bb98-00ead96f9837 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:52.342004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.371821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1867dda9-a3ce-42a4-9354-ab2fce5b9093 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1319299 Dec 21 04:13:52.384380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60504) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:52.388869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--1215020888'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:52.471515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a4c16d-2f98-419c-bfc3-8f10bda2f31f req-a211a208-4dc2-4673-9fad-cfa1fe6325cb tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:52.473038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3a4c16d-2f98-419c-bfc3-8f10bda2f31f req-a211a208-4dc2-4673-9fad-cfa1fe6325cb tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 932 time: 0.1233163 Dec 21 04:13:52.475784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.1 (3f781088-f4ae-4039-bd42-2337b91d459d/cc3361a8-c44a-4f96-8ecd-d8322bcd66f1/b2cfca4b-dabd-466a-bfd3-52523c2cce76) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:52.491232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.512600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Calling delete_port for f54adb17-71c4-4b5c-bb98-00ead96f9837 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:52.558516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3a4c16d-2f98-419c-bfc3-8f10bda2f31f req-010fe7cf-cbef-448e-80cf-640d969534b0 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776374 Dec 21 04:13:52.586985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.597203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e398923b-d2b4-4502-89ec-272ed2d85b89 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:13:52.609612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.634363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Transition to ACTIVE for port object e398923b-d2b4-4502-89ec-272ed2d85b89 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:13:52.661874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-83faa53a-8dd9-4e25-ae3d-6bf57418c0e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.687499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.707163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7502138c-1927-4423-b8f1-a9902113a636 req-7298a90e-d12b-4efa-a584-6b7902082b9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:52.708778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7502138c-1927-4423-b8f1-a9902113a636 req-7298a90e-d12b-4efa-a584-6b7902082b9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1098180 Dec 21 04:13:52.719801 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.789446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Pushing event updated for resources: {'Port': ['ID=e398923b-d2b4-4502-89ec-272ed2d85b89,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:52.844276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.866383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7502138c-1927-4423-b8f1-a9902113a636 req-47c04710-984e-4da0-988d-63896bbf6a8b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1432686 Dec 21 04:13:52.871451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-78a74cbc-5fd9-43e1-9f26-be5b9637e4fd service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1430178 Dec 21 04:13:52.901701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Attempting to bind port e398923b-d2b4-4502-89ec-272ed2d85b89 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:52.902050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Attempting to bind port e398923b-d2b4-4502-89ec-272ed2d85b89 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:52.902391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Attempting to bind port e398923b-d2b4-4502-89ec-272ed2d85b89 on network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:52.906912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Port e398923b-d2b4-4502-89ec-272ed2d85b89 on network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:13:52.907283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Attempting to bind port e398923b-d2b4-4502-89ec-272ed2d85b89 on network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:52.913920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:52.914264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Checking segment: {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:52.914652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Bound using segment: {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:52.915109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Bound port: e398923b-d2b4-4502-89ec-272ed2d85b89, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:52.915466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.936258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.979924 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.982021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:52.989217 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.020194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event deleted for resources: {'Port': ['ID=f54adb17-71c4-4b5c-bb98-00ead96f9837,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:53.028971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] For port e398923b-d2b4-4502-89ec-272ed2d85b89, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:53.040975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f772a1f-5ea5-4ff5-9e08-e7119e2e8430 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:53.041906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 3f781088-f4ae-4039-bd42-2337b91d459d is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:53.053249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:53.056457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720795ba-5030-48ae-b271-17e062d97472 req-abbf6b67-7571-4dd5-8c48-cadff8f7121e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.058517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-abbf6b67-7571-4dd5-8c48-cadff8f7121e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1098 time: 0.1182535 Dec 21 04:13:53.062061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:53.083775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] For port e398923b-d2b4-4502-89ec-272ed2d85b89, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e398923b-d2b4-4502-89ec-272ed2d85b89,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:53.118146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=367cc9dc-330f-4ab8-bc14-b6bacb51ae24,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:53.127777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.137814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=b2cfca4b-dabd-466a-bfd3-52523c2cce76,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:53.150233 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.154181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b6945c50-f711-4fcd-bcb6-56edca839309 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7661412 Dec 21 04:13:53.157752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:53.180117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad12f6fb-9968-4a41-aa2c-4256f3f0ea85 None None] Network 3f781088-f4ae-4039-bd42-2337b91d459d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:13:53.191561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.204551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1631e01e-3021-4e74-9fda-b55aaf61c71d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:53.205339 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-1631e01e-3021-4e74-9fda-b55aaf61c71d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 21 04:13:53.205978 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-1631e01e-3021-4e74-9fda-b55aaf61c71d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:53.207131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1631e01e-3021-4e74-9fda-b55aaf61c71d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0482078 Dec 21 04:13:53.210061 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.213916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60510) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:53.232323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b1d289df-6089-43ef-b334-cf79153b9eec tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:53.300409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720795ba-5030-48ae-b271-17e062d97472 req-4f020da6-5d09-4c3d-9de9-80a32216006d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.301823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-4f020da6-5d09-4c3d-9de9-80a32216006d service neutron] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 915 time: 0.1988668 Dec 21 04:13:53.321507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e594a5e7-b54f-4eba-9e7f-8883a553db9c None None] Provisioning complete for port 089e9f43-1c79-4a0c-9082-6506d41f045d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:53.322317 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e594a5e7-b54f-4eba-9e7f-8883a553db9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.345225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.350537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.350706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 089e9f43-1c79-4a0c-9082-6506d41f045d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:53.357731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.358407 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.360781 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] 10.222.0.54 "PUT /v2.0/ports/e398923b-d2b4-4502-89ec-272ed2d85b89 HTTP/1.1" status: 200 len: 1093 time: 1.3448772 Dec 21 04:13:53.362086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.366571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6130694f-d802-40bc-bcba-1184a114d366', 'tag': 'e398923b-d2b4-4502-89ec-272ed2d85b89'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:53.369776 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f5521bc-e863-461a-b44a-5a4fea51ef9c" -d '{"events": [{"name": "network-changed", "server_uuid": "6130694f-d802-40bc-bcba-1184a114d366", "tag": "e398923b-d2b4-4502-89ec-272ed2d85b89"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:53.445875 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb7690ea-32a8-43c2-b361-2f0fd946cafc x-openstack-request-id: req-bb7690ea-32a8-43c2-b361-2f0fd946cafc {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:53.446174 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6130694f-d802-40bc-bcba-1184a114d366", "tag": "e398923b-d2b4-4502-89ec-272ed2d85b89", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:53.448435 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bb7690ea-32a8-43c2-b361-2f0fd946cafc {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:53.448435 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6130694f-d802-40bc-bcba-1184a114d366', 'tag': 'e398923b-d2b4-4502-89ec-272ed2d85b89', 'status': 'completed', 'code': 200} Dec 21 04:13:53.450651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc07eff2-bb80-478b-b7be-a66d56fa6c39 service neutron] Pushing event updated for resources: {'Port': ['ID=e398923b-d2b4-4502-89ec-272ed2d85b89,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:53.459032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-30bc98b5-5710-4c24-87a4-24fa0f32eb64 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 1002 time: 0.1418717 Dec 21 04:13:53.462457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 089e9f43-1c79-4a0c-9082-6506d41f045d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:53.462862 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.493517 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e594a5e7-b54f-4eba-9e7f-8883a553db9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.543293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e594a5e7-b54f-4eba-9e7f-8883a553db9c None None] For port 089e9f43-1c79-4a0c-9082-6506d41f045d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=089e9f43-1c79-4a0c-9082-6506d41f045d,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:53.555409 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.556533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Fanout notify agent at l3_agent the message router_deleted on router 79a8d038-aadc-4525-8fae-ff99bd80be65 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:53.576441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.581051 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e1f90ed-1841-49ac-a9bc-35dd0eea74dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/79a8d038-aadc-4525-8fae-ff99bd80be65 HTTP/1.1" status: 204 len: 168 time: 2.0225871 Dec 21 04:13:53.581243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.585228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:53.587458 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.591743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-2139158226', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:53.596640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5521bc-e863-461a-b44a-5a4fea51ef9c req-815c35da-537e-4a7f-993a-fd487e284778 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.600830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f5521bc-e863-461a-b44a-5a4fea51ef9c req-815c35da-537e-4a7f-993a-fd487e284778 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=247cb1d10db0451abe7903925d39ba07&device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 1096 time: 0.1081898 Dec 21 04:13:53.618993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720795ba-5030-48ae-b271-17e062d97472 req-1645b328-42f0-4044-996d-8e18c44334f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.623773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-1645b328-42f0-4044-996d-8e18c44334f3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.1482728 Dec 21 04:13:53.623946 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-b1d289df-6089-43ef-b334-cf79153b9eec tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:53.623946 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1d289df-6089-43ef-b334-cf79153b9eec tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.4010186 Dec 21 04:13:53.628635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60518) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:53.635678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0f670eb8-7d49-4ad1-8d7f-1d80666ee227 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:53.636444 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-0f670eb8-7d49-4ad1-8d7f-1d80666ee227 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Dec 21 04:13:53.637012 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-0f670eb8-7d49-4ad1-8d7f-1d80666ee227 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:53.640998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0f670eb8-7d49-4ad1-8d7f-1d80666ee227 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0094695 Dec 21 04:13:53.642306 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e594a5e7-b54f-4eba-9e7f-8883a553db9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.668182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60520) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:53.686574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-42650389-1f4b-4233-80cb-e442544d872d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:53.714423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e594a5e7-b54f-4eba-9e7f-8883a553db9c None None] Pushing event updated for resources: {'Port': ['ID=089e9f43-1c79-4a0c-9082-6506d41f045d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:53.755439 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:13:53.756053 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:13:53.763418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5521bc-e863-461a-b44a-5a4fea51ef9c req-3ba4b1b9-0a84-4f01-b8d4-41aaa62392a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.765103 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f5521bc-e863-461a-b44a-5a4fea51ef9c req-3ba4b1b9-0a84-4f01-b8d4-41aaa62392a7 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=247cb1d10db0451abe7903925d39ba07&shared=False HTTP/1.1" status: 200 len: 910 time: 0.1455512 Dec 21 04:13:53.771083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-235e31e1-710c-432c-b8a8-be905abe62ea None None] Provisioning complete for port 089e9f43-1c79-4a0c-9082-6506d41f045d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:53.771253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-235e31e1-710c-432c-b8a8-be905abe62ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.825807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720795ba-5030-48ae-b271-17e062d97472 req-882bc5a7-1622-481e-a5ec-67c52ff70dba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.828026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-882bc5a7-1622-481e-a5ec-67c52ff70dba service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1632960 Dec 21 04:13:53.839979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55b9c69-d23f-45f8-945b-9d42876f5008 req-b874eb21-be94-4ba6-bdc9-54801622f0fd tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.841787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55b9c69-d23f-45f8-945b-9d42876f5008 req-b874eb21-be94-4ba6-bdc9-54801622f0fd tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 944 time: 0.1628058 Dec 21 04:13:53.853022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.855003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.899933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5521bc-e863-461a-b44a-5a4fea51ef9c req-5bcc2d12-500f-480a-9d27-271852c309dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:53.902230 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f5521bc-e863-461a-b44a-5a4fea51ef9c req-5bcc2d12-500f-480a-9d27-271852c309dc service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1299653 Dec 21 04:13:53.905770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-235e31e1-710c-432c-b8a8-be905abe62ea None None] Provisioning complete for port b2cfca4b-dabd-466a-bfd3-52523c2cce76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:53.906098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-235e31e1-710c-432c-b8a8-be905abe62ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:53.962573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-235e31e1-710c-432c-b8a8-be905abe62ea None None] Port b2cfca4b-dabd-466a-bfd3-52523c2cce76 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:54.011114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-1394bb07-dc26-4720-ac5c-7f1eee5dd10a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:54.012679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-1394bb07-dc26-4720-ac5c-7f1eee5dd10a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=247cb1d10db0451abe7903925d39ba07&device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 1096 time: 0.0466163 Dec 21 04:13:54.067028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-9790db69-7547-46c2-80ae-2ffc0db5d3db service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e398923b-d2b4-4502-89ec-272ed2d85b89 HTTP/1.1" status: 200 len: 217 time: 0.0393729 Dec 21 04:13:54.084447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ab1db269-d256-45bb-96ce-0a270b3e0a5c None None] Provisioning complete for port b2cfca4b-dabd-466a-bfd3-52523c2cce76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:54.084831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab1db269-d256-45bb-96ce-0a270b3e0a5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.119570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee9af80-1a7e-4d18-b407-734206561144 req-45292ec7-0ce6-4470-9a74-00987b07978e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:54.121859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-45292ec7-0ce6-4470-9a74-00987b07978e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=79a84c6f-589d-401b-8841-bdeddbc4ba1d HTTP/1.1" status: 200 len: 849 time: 0.0482340 Dec 21 04:13:54.158329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-81a55c49-5c0a-4361-b49e-27b57dc8a902 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5a8c4312-b76b-442d-aa89-ba658f5e54a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0282376 Dec 21 04:13:54.274574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-a09904a5-9fcc-4ab2-961e-ddcb8b5695a7 service neutron] 10.222.0.54 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1090400 Dec 21 04:13:54.311375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ab1db269-d256-45bb-96ce-0a270b3e0a5c None None] Port b2cfca4b-dabd-466a-bfd3-52523c2cce76 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:54.371633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.381129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dee9af80-1a7e-4d18-b407-734206561144 req-62a78057-36bd-4162-8b29-a0d9aa62f64c service neutron] 10.222.0.54 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991933 Dec 21 04:13:54.402115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55b9c69-d23f-45f8-945b-9d42876f5008 req-6c90a013-4606-442b-8267-7250436cf16c tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5422394 Dec 21 04:13:54.435073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.453349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24ce4ec-8777-409e-b147-54f51173f075 req-ca48425a-77b1-4d8c-9de6-79bf404cf52c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:54.454813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24ce4ec-8777-409e-b147-54f51173f075 req-ca48425a-77b1-4d8c-9de6-79bf404cf52c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.2797084 Dec 21 04:13:54.461618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-380a9307-b675-4f38-972b-07039ae4f0b5 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6186354 Dec 21 04:13:54.503674 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-42650389-1f4b-4233-80cb-e442544d872d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:54.504632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-42650389-1f4b-4233-80cb-e442544d872d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.8268089 Dec 21 04:13:54.507664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60524) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:54.512851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-68146a45-300b-4bd3-add9-4b2b76438344 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:54.513346 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-68146a45-300b-4bd3-add9-4b2b76438344 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 21 04:13:54.513850 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-68146a45-300b-4bd3-add9-4b2b76438344 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:54.514818 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-68146a45-300b-4bd3-add9-4b2b76438344 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0061822 Dec 21 04:13:54.520493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60526) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:54.524795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1eacbe67-00da-4923-9731-c40c23cb698d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:54.589957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.591155 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e9dfd914-00ee-46b0-b961-cc84de2bccda tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.0040410 Dec 21 04:13:54.594243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60528) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:54.603720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'enable_snat': False}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:54.633737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f24ce4ec-8777-409e-b147-54f51173f075 req-13830fe7-ef1a-42b2-af4d-23aabf076b98 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1460042 Dec 21 04:13:54.663164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-720795ba-5030-48ae-b271-17e062d97472 req-4390074a-e93b-4066-a7a3-fc84515f3708 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1730154 Dec 21 04:13:54.668815 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-1eacbe67-00da-4923-9731-c40c23cb698d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Project 291abef56d774200a056b18bed512592 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:54.671897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.732667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.812909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=b2cfca4b-dabd-466a-bfd3-52523c2cce76,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:54.815566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:54.934972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 3f781088-f4ae-4039-bd42-2337b91d459d is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:54.936459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:54.988027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.065646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:13:55.073539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.112389 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-1eacbe67-00da-4923-9731-c40c23cb698d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:55.113494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1eacbe67-00da-4923-9731-c40c23cb698d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.5919659 Dec 21 04:13:55.116648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60530) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:55.123132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-97b7dd8c-b6cb-4bf1-a9cf-b73241a70c70 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:55.123990 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-97b7dd8c-b6cb-4bf1-a9cf-b73241a70c70 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Dec 21 04:13:55.124098 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-97b7dd8c-b6cb-4bf1-a9cf-b73241a70c70 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:55.127875 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-97b7dd8c-b6cb-4bf1-a9cf-b73241a70c70 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0071127 Dec 21 04:13:55.128163 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:55.135356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-451311b6-aa92-4547-a2de-8eea0148dd45 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:55.210517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:55.218640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7f52aa78-0db3-4c72-80e9-9f833d1f5e5f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/4e0835a1-5b43-48ca-95e4-8eeb522b41d9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6707220 Dec 21 04:13:55.219338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.231865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Sync routers for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:55.243495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:55.244163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:55.297052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 089e9f43-1c79-4a0c-9082-6506d41f045d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:55.336557 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-451311b6-aa92-4547-a2de-8eea0148dd45 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Project 291abef56d774200a056b18bed512592 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:55.391780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e398923b-d2b4-4502-89ec-272ed2d85b89 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:13:55.408510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-94ebadba-6906-47e7-9439-53a8b0f54bf7 None None] Provisioning complete for port b2cfca4b-dabd-466a-bfd3-52523c2cce76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:55.408884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-94ebadba-6906-47e7-9439-53a8b0f54bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.436243 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-451311b6-aa92-4547-a2de-8eea0148dd45 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:55.439323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-451311b6-aa92-4547-a2de-8eea0148dd45 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.3083575 Dec 21 04:13:55.440718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60548) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:55.445441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1c603dfb-69d8-4e32-85af-89beab9e16aa tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': '367cc9dc-330f-4ab8-bc14-b6bacb51ae24', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:55.473558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-0fec3773-fa28-4698-b5d8-f312b212a149 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-121286146&fields=id&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 267 time: 0.0750113 Dec 21 04:13:55.498038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:55.555326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-94ebadba-6906-47e7-9439-53a8b0f54bf7 None None] Port b2cfca4b-dabd-466a-bfd3-52523c2cce76 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:55.576253 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.605164 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-1c603dfb-69d8-4e32-85af-89beab9e16aa tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Project 291abef56d774200a056b18bed512592 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:13:55.608491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 089e9f43-1c79-4a0c-9082-6506d41f045d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:55.609068 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.610211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.630216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7320b8-73c3-4788-bca4-07f5befb7919 req-cfd3f266-f0d5-49f7-9fda-2b6728e049a3 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:55.631800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b7320b8-73c3-4788-bca4-07f5befb7919 req-cfd3f266-f0d5-49f7-9fda-2b6728e049a3 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 944 time: 0.1233892 Dec 21 04:13:55.668614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-ae0a61ed-f841-4414-8c53-946adb81ed63 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:55.670390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-ae0a61ed-f841-4414-8c53-946adb81ed63 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 797 time: 0.1900625 Dec 21 04:13:55.707304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-77ffd975-24f7-436f-b8f9-acdeccc6813e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/quotas/10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 375 time: 0.0238099 Dec 21 04:13:55.707862 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-1c603dfb-69d8-4e32-85af-89beab9e16aa tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:55.708921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c603dfb-69d8-4e32-85af-89beab9e16aa tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2673461 Dec 21 04:13:55.711888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60552) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:55.719798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b7320b8-73c3-4788-bca4-07f5befb7919 req-e124b324-47a2-44e8-a659-bbb123084947 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773885 Dec 21 04:13:55.748742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Allocated IP 172.25.5.41 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/0295916a-d6b9-444d-b23e-f6c632d0b03f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:13:55.780569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-559e03d9-b882-4880-9a3e-3fcd3bca9ed5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0597179 Dec 21 04:13:55.782473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port e398923b-d2b4-4502-89ec-272ed2d85b89, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e398923b-d2b4-4502-89ec-272ed2d85b89,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:55.807941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'e398923b-d2b4-4502-89ec-272ed2d85b89', 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8', 'port_id': 'e398923b-d2b4-4502-89ec-272ed2d85b89', 'mac_address': 'fa:16:3e:4e:b1:cc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a84c6f-589d-401b-8841-bdeddbc4ba1d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:13:55.879721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60888e95-1b41-41d6-9583-a7aecfb9d50e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.904136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.919987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60888e95-1b41-41d6-9583-a7aecfb9d50e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.924446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33902a17-44d4-4c89-9c5a-7669faa22ef1 req-9d38ebe4-cc5d-428d-bbc8-17c3e110beb0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:55.924654 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.926205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33902a17-44d4-4c89-9c5a-7669faa22ef1 req-9d38ebe4-cc5d-428d-bbc8-17c3e110beb0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1152256 Dec 21 04:13:55.942634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e398923b-d2b4-4502-89ec-272ed2d85b89 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:13:55.945010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-71bb655a-5b49-465a-9e4a-e9eaccc9d8c6 service neutron] 10.222.0.18 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1447401 Dec 21 04:13:55.961179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:55.967396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port e398923b-d2b4-4502-89ec-272ed2d85b89, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e398923b-d2b4-4502-89ec-272ed2d85b89,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:55.973587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:54Z', 'revision_number': 2, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:56.001665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Checking router: 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:13:56.002365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Updating router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 port b2cfca4b-dabd-466a-bfd3-52523c2cce76 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:13:56.026948 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.041766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.063384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33902a17-44d4-4c89-9c5a-7669faa22ef1 req-25bffa59-84c3-49e7-a600-80ac8bf964a5 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075637 Dec 21 04:13:56.067328 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60888e95-1b41-41d6-9583-a7aecfb9d50e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.071509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-60888e95-1b41-41d6-9583-a7aecfb9d50e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.077000 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-60888e95-1b41-41d6-9583-a7aecfb9d50e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/367cc9dc-330f-4ab8-bc14-b6bacb51ae24 HTTP/1.1" status: 204 len: 168 time: 0.3619347 Dec 21 04:13:56.077799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60554) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:56.093150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-b6f8d02e-49d8-4404-8a3b-2aac17c34312 service neutron] 10.222.0.18 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1395411 Dec 21 04:13:56.107961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60888e95-1b41-41d6-9583-a7aecfb9d50e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=367cc9dc-330f-4ab8-bc14-b6bacb51ae24,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:56.130045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.174875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=e398923b-d2b4-4502-89ec-272ed2d85b89,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:56.186245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:13:56.192313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:13:56.194913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:13:56.209398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f329a3b-4b09-4960-b9f7-87ec51ada05e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:56.231466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60556) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:56.235381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-265f527f-fdb3-4306-be46-16da6fdf4399 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1447263 Dec 21 04:13:56.239625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--1104483492'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:56.263029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Pushing event updated for resources: {'Port': ['ID=0295916a-d6b9-444d-b23e-f6c632d0b03f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:56.358759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['e398923b-d2b4-4502-89ec-272ed2d85b89'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:13:56.368255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1867ea37-9a7e-47c9-90da-03f8cd8b468b req-c2259fbc-743f-4842-afd4-0a667f4ee8db tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 210 time: 0.0308917 Dec 21 04:13:56.395755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.427426 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.441482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d8ac4b84-b9a8-472a-b8b0-74f7bea6beb6 None None] Provisioning complete for port 0295916a-d6b9-444d-b23e-f6c632d0b03f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:56.441716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8ac4b84-b9a8-472a-b8b0-74f7bea6beb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.482593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.497687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d8ac4b84-b9a8-472a-b8b0-74f7bea6beb6 None None] Port 0295916a-d6b9-444d-b23e-f6c632d0b03f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:56.514692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.557051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.597398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844044e2-c49e-4120-97c9-392839759b7a None None] Pushing event updated for resources: {'Port': ['ID=b2cfca4b-dabd-466a-bfd3-52523c2cce76,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:56.597866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8576dc0-4115-407e-87d8-04e6fbdc0315,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:56.664659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Attempting to bind port b2cfca4b-dabd-466a-bfd3-52523c2cce76 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:13:56.665043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Attempting to bind port b2cfca4b-dabd-466a-bfd3-52523c2cce76 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:13:56.665420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Attempting to bind port b2cfca4b-dabd-466a-bfd3-52523c2cce76 on network 3f781088-f4ae-4039-bd42-2337b91d459d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:13:56.679071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:13:56.683762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Checking segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:13:56.683762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.683762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Bound using segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:13:56.683762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Bound port: b2cfca4b-dabd-466a-bfd3-52523c2cce76, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:13:56.683762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.706223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.706481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.708448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ac754a15-6ad4-4b33-a4d0-c420f6bc29f8 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4751642 Dec 21 04:13:56.711290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60566) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:56.719110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0e16927c-0ed8-4f67-a407-4cb9f28eb14e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'e8576dc0-4115-407e-87d8-04e6fbdc0315', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:56.783921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] For port b2cfca4b-dabd-466a-bfd3-52523c2cce76, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:13:56.786785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] For port b2cfca4b-dabd-466a-bfd3-52523c2cce76, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2cfca4b-dabd-466a-bfd3-52523c2cce76,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:13:56.864791 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:13:56.876261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ef5c09-4a86-40f5-8931-dd23bf1acdd8 req-fdbe24f4-472b-4b35-9368-fea998d6a081 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:56.877741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2ef5c09-4a86-40f5-8931-dd23bf1acdd8 req-fdbe24f4-472b-4b35-9368-fea998d6a081 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 945 time: 0.0644095 Dec 21 04:13:56.928654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fade7a5e-7b7c-4a1f-89d7-d22e127c3c9d None None] Provisioning complete for port b2cfca4b-dabd-466a-bfd3-52523c2cce76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:56.929335 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fade7a5e-7b7c-4a1f-89d7-d22e127c3c9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.942173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2ef5c09-4a86-40f5-8931-dd23bf1acdd8 req-d74a5898-94b7-4d1c-b608-2bde5bbe8897 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565557 Dec 21 04:13:56.953394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.955992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:56.959835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.024764 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-0e16927c-0ed8-4f67-a407-4cb9f28eb14e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The resource could not be found. Dec 21 04:13:57.029555 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0e16927c-0ed8-4f67-a407-4cb9f28eb14e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.3120565 Dec 21 04:13:57.029797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60570) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.036544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8acb58fe-d160-45c2-af8e-65c74315db5a tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'e8576dc0-4115-407e-87d8-04e6fbdc0315', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': '53e483aa-211e-415a-bde3-7178710f73fd'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:57.041884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fade7a5e-7b7c-4a1f-89d7-d22e127c3c9d None None] Port b2cfca4b-dabd-466a-bfd3-52523c2cce76 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:13:57.057632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:57.058419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:57.106689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844044e2-c49e-4120-97c9-392839759b7a None None] Pushing event updated for resources: {'Port': ['ID=b2cfca4b-dabd-466a-bfd3-52523c2cce76,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:57.202486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:13:57.204530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Router f202cc0c-c132-4b87-b40e-142e4485b40f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:13:57.225761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c447cb5-8f17-4aea-ab2b-4f1c7d1c77b3 req-18fa0782-cc50-413f-9706-0cecd994ff94 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:57.228093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c447cb5-8f17-4aea-ab2b-4f1c7d1c77b3 req-18fa0782-cc50-413f-9706-0cecd994ff94 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0722790 Dec 21 04:13:57.275802 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-8acb58fe-d160-45c2-af8e-65c74315db5a tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The resource could not be found. Dec 21 04:13:57.281346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8acb58fe-d160-45c2-af8e-65c74315db5a tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2459836 Dec 21 04:13:57.281594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60574) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.295612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c447cb5-8f17-4aea-ab2b-4f1c7d1c77b3 req-4093bda4-37b2-4f09-a06e-252781a3ab50 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609012 Dec 21 04:13:57.381038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f9c703f-2632-467e-8f4d-c91819510483 None None] Provisioning complete for port b2cfca4b-dabd-466a-bfd3-52523c2cce76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:57.381411 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f9c703f-2632-467e-8f4d-c91819510483 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.384173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:13:57.397437 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] Sync routers for ids ['f202cc0c-c132-4b87-b40e-142e4485b40f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:13:57.403511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5c92291-5bd6-4a63-a9a0-62e2a410a5f2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.407725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.412158 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] Routers {'f202cc0c-c132-4b87-b40e-142e4485b40f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:57.412778 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-327fd839-b9a0-44c6-882b-7bc49a4b7952 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "PUT /v2.0/routers/f202cc0c-c132-4b87-b40e-142e4485b40f HTTP/1.1" status: 200 len: 915 time: 2.8170705 Dec 21 04:13:57.413767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60580) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.415150 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f202cc0c-c132-4b87-b40e-142e4485b40f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:57.444774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e398923b-d2b4-4502-89ec-272ed2d85b89 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:57.455661 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5c92291-5bd6-4a63-a9a0-62e2a410a5f2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.475358 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:57.489247 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] Routers {'f202cc0c-c132-4b87-b40e-142e4485b40f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:13:57.489953 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f202cc0c-c132-4b87-b40e-142e4485b40f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:57.503552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0300cd5a-9721-4fcd-914c-55e51d6fec71 req-2dea0754-0d52-4b9b-9861-8e99977a22d6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 210 time: 0.0392952 Dec 21 04:13:57.553684 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:57.554658 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ff0e56c-e382-4bd5-ba23-40fc104c787b None None] The sync data for ids ['f202cc0c-c132-4b87-b40e-142e4485b40f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:57.574997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-605d91dc-9bf1-44e6-90e9-a2647b3e597e tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/f202cc0c-c132-4b87-b40e-142e4485b40f HTTP/1.1" status: 200 len: 921 time: 0.1567802 Dec 21 04:13:57.575761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60582) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.588367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5c92291-5bd6-4a63-a9a0-62e2a410a5f2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.592414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5c92291-5bd6-4a63-a9a0-62e2a410a5f2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.594144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c5c92291-5bd6-4a63-a9a0-62e2a410a5f2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/e8576dc0-4115-407e-87d8-04e6fbdc0315 HTTP/1.1" status: 204 len: 168 time: 0.3114181 Dec 21 04:13:57.600686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60584) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.628835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0951745-09c7-435f-a9e7-43dfba41ecc4 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:57.630387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0951745-09c7-435f-a9e7-43dfba41ecc4 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=f202cc0c-c132-4b87-b40e-142e4485b40f&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0535228 Dec 21 04:13:57.633641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60586) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.633793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c92291-5bd6-4a63-a9a0-62e2a410a5f2 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8576dc0-4115-407e-87d8-04e6fbdc0315,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:57.669704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cfb2c6c0-7f65-445c-948a-65237581949e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0676620 Dec 21 04:13:57.673843 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.678495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-73c55df9-413f-48ad-8338-6cdebe5742a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'd5b66d03-5582-4221-b04a-a73edef10b23', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:57.734861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea153a4d-ee9b-4c01-84e0-a2fb66e15bf8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:57.739668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ea153a4d-ee9b-4c01-84e0-a2fb66e15bf8 tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/networks/30f5b79f-275c-4003-8999-814f6db142e1 HTTP/1.1" status: 200 len: 881 time: 0.1017759 Dec 21 04:13:57.739812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60590) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.772306 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1446b23d-2961-4bca-a899-25e1fbff4231 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=f202cc0c-c132-4b87-b40e-142e4485b40f HTTP/1.1" status: 200 len: 205 time: 0.0287485 Dec 21 04:13:57.772602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.775776 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f9c703f-2632-467e-8f4d-c91819510483 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.793073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:56Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:13:57.829405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7230a05b-6259-4719-a70c-dbde1c57966b None None] The sync data for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 is: [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:56Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:13:57.845112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2f9c703f-2632-467e-8f4d-c91819510483 None None] For port b2cfca4b-dabd-466a-bfd3-52523c2cce76, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2cfca4b-dabd-466a-bfd3-52523c2cce76,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:57.880823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port e398923b-d2b4-4502-89ec-272ed2d85b89 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:13:57.888957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port e398923b-d2b4-4502-89ec-272ed2d85b89 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:57.888957 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.920055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:57.955983 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-73c55df9-413f-48ad-8338-6cdebe5742a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The resource could not be found. Dec 21 04:13:57.957055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73c55df9-413f-48ad-8338-6cdebe5742a6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2822812 Dec 21 04:13:57.961273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:57.965767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--2045203136'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:58.014483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f9c703f-2632-467e-8f4d-c91819510483 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.077691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.079972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9c703f-2632-467e-8f4d-c91819510483 None None] Pushing event updated for resources: {'Port': ['ID=b2cfca4b-dabd-466a-bfd3-52523c2cce76,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:58.083973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.093250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301c9d98-665c-4570-bc7a-0d121cca4f63 req-2aaf825d-e861-4825-811c-997677d8c8ca tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:58.100897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-301c9d98-665c-4570-bc7a-0d121cca4f63 req-2aaf825d-e861-4825-811c-997677d8c8ca tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 945 time: 0.0740778 Dec 21 04:13:58.114421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6130694f-d802-40bc-bcba-1184a114d366', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e398923b-d2b4-4502-89ec-272ed2d85b89'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:13:58.116856 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40f1145b-2a65-4f38-8e6a-5056e072677a" -d '{"events": [{"server_uuid": "6130694f-d802-40bc-bcba-1184a114d366", "name": "network-vif-plugged", "status": "completed", "tag": "e398923b-d2b4-4502-89ec-272ed2d85b89"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:13:58.119207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.156415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port e398923b-d2b4-4502-89ec-272ed2d85b89, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e398923b-d2b4-4502-89ec-272ed2d85b89,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:13:58.180154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-301c9d98-665c-4570-bc7a-0d121cca4f63 req-8f1f3f4d-3c46-453e-8dbb-72724718c0ed tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773861 Dec 21 04:13:58.228862 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.272446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.286881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Deleting port 0295916a-d6b9-444d-b23e-f6c632d0b03f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:13:58.287508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.305383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=e398923b-d2b4-4502-89ec-272ed2d85b89,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:58.371714 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:13:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5edb5efe-a96a-4582-911a-7879d9097bb7 x-openstack-request-id: req-5edb5efe-a96a-4582-911a-7879d9097bb7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:13:58.372041 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6130694f-d802-40bc-bcba-1184a114d366", "name": "network-vif-plugged", "status": "completed", "tag": "e398923b-d2b4-4502-89ec-272ed2d85b89", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:13:58.372303 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5edb5efe-a96a-4582-911a-7879d9097bb7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:13:58.372861 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6130694f-d802-40bc-bcba-1184a114d366', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e398923b-d2b4-4502-89ec-272ed2d85b89', 'code': 200} Dec 21 04:13:58.379853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.434880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eed6a674-73fe-4534-882f-db15f0663399,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:58.454541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.470345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Calling delete_port for 0295916a-d6b9-444d-b23e-f6c632d0b03f owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:13:58.481306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da41199-4b90-4632-9c2a-dc6089b6e7fe req-61f8f9eb-b345-4308-801a-4bc816ca92df tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:58.489239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1da41199-4b90-4632-9c2a-dc6089b6e7fe req-61f8f9eb-b345-4308-801a-4bc816ca92df tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0869699 Dec 21 04:13:58.510739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.511987 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-024422b6-c6cc-43b2-92d1-29b5f26b8f0e tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5497804 Dec 21 04:13:58.517308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:58.562040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--648925122'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:58.566972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1da41199-4b90-4632-9c2a-dc6089b6e7fe req-6aca0bf7-9ee6-4559-93a3-9269ca459061 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675359 Dec 21 04:13:58.622613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baa59a05-23e6-4651-a787-49843f110e31 req-d42b11c9-82b6-4c0f-aa35-fcdf0beb990f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 210 time: 0.0303605 Dec 21 04:13:58.644780 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-2b47fd4b-39f8-4141-925f-fb74c48f102c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1624663 Dec 21 04:13:58.660433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73bfb486-dc2e-4f0c-8438-a427c022d574 req-9ee09439-8502-4b71-8966-d04306293a87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:58.661924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-73bfb486-dc2e-4f0c-8438-a427c022d574 req-9ee09439-8502-4b71-8966-d04306293a87 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 1098 time: 0.1489687 Dec 21 04:13:58.754891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.828514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-a75143d6-d591-4996-b483-c6581a2d83e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:58.830021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-a75143d6-d591-4996-b483-c6581a2d83e3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 1097 time: 0.1219029 Dec 21 04:13:58.844358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-73bfb486-dc2e-4f0c-8438-a427c022d574 req-e70ee63f-1909-46e5-ad63-f07f662130c1 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431534 Dec 21 04:13:58.900937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.965124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:58.970372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.011938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event deleted for resources: {'Port': ['ID=0295916a-d6b9-444d-b23e-f6c632d0b03f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:59.033750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-590b5cf7-57d7-42be-bb47-599cd3e72129 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:13:59.045958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c8ddb479-af49-4056-a8b5-0b25b524f104,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:59.090976 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.093146 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bc42163a-36b9-42f5-af02-e8c3fab3cfe7 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5339673 Dec 21 04:13:59.095663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60608) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:59.109812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d5ac27f5-7b3c-4f98-8735-6ade4d9c495b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'eed6a674-73fe-4534-882f-db15f0663399', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': 'c8ddb479-af49-4056-a8b5-0b25b524f104'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:59.134110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.143106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-3ea93a27-8027-4e2b-9e39-edc1fcb15f10 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:59.144641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-3ea93a27-8027-4e2b-9e39-edc1fcb15f10 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 797 time: 0.1618993 Dec 21 04:13:59.244843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-d4b42473-42c4-48d1-8670-97558ce39c97 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 379 time: 0.0807369 Dec 21 04:13:59.256630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'port': {'device_id': '615aae36-683b-40bc-bda6-de53bf692e14', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'admin_state_up': True, 'tenant_id': '10a032d25985452584a3dcdae6969809', 'security_groups': ['f9f8a49a-c6e1-46d9-9a17-77192d2462b6']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:59.338258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.342555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.356949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2cfca4b-dabd-466a-bfd3-52523c2cce76 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:13:59.368564 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-d5ac27f5-7b3c-4f98-8735-6ade4d9c495b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:13:59.372127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d5ac27f5-7b3c-4f98-8735-6ade4d9c495b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.2725291 Dec 21 04:13:59.376745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60612) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:59.414826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-8d2097ec-b42b-4cbb-8286-bd21c001eaba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:59.416481 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-8d2097ec-b42b-4cbb-8286-bd21c001eaba service neutron] 10.222.0.54 "GET /v2.0/networks?id=800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 200 len: 906 time: 0.3157995 Dec 21 04:13:59.416732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b2cfca4b-dabd-466a-bfd3-52523c2cce76 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:13:59.417165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.453267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6947b3f-e02d-49e5-887a-be68502ad250 req-47c1c8e3-b6c6-4a51-8404-34f31d675ed3 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:59.454787 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6947b3f-e02d-49e5-887a-be68502ad250 req-47c1c8e3-b6c6-4a51-8404-34f31d675ed3 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 946 time: 0.1167781 Dec 21 04:13:59.477481 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-51de1f3d-07d2-485c-a5e0-b12a04819256 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 200 len: 217 time: 0.0435452 Dec 21 04:13:59.481074 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.481782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Fanout notify agent at l3_agent the message router_deleted on router f202cc0c-c132-4b87-b40e-142e4485b40f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:13:59.490345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.495226 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-43ab9554-e2bd-41ab-868b-f651557cd764 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/f202cc0c-c132-4b87-b40e-142e4485b40f HTTP/1.1" status: 204 len: 168 time: 1.7180941 Dec 21 04:13:59.500368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:59.508699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7bb4028-58b9-4a2d-ab7d-67b1aaf3bbd9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.524493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1676350955', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:13:59.560644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-040e15a2-8f51-4661-99ca-95ad43e30ee1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:59.562153 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-040e15a2-8f51-4661-99ca-95ad43e30ee1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 200 len: 845 time: 0.0695157 Dec 21 04:13:59.563044 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7bb4028-58b9-4a2d-ab7d-67b1aaf3bbd9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.586235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6947b3f-e02d-49e5-887a-be68502ad250 req-84f43375-3151-4ef0-81a7-0214269eb99c tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212707 Dec 21 04:13:59.600970 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-43a493fd-3e68-49e9-9e76-1af5a3d39606 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=800834e6-2709-4cb2-81c2-4c16d3d000fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0285015 Dec 21 04:13:59.675696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:13:59.679356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.713349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e8ff7b-caa2-4fc0-ae07-808d58ed7f9f req-c9d5e0ae-b2fa-452b-a023-9a21139ee749 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:13:59.714986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29e8ff7b-caa2-4fc0-ae07-808d58ed7f9f req-c9d5e0ae-b2fa-452b-a023-9a21139ee749 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0685856 Dec 21 04:13:59.725513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7bb4028-58b9-4a2d-ab7d-67b1aaf3bbd9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.728205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7bb4028-58b9-4a2d-ab7d-67b1aaf3bbd9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:13:59.729340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d7bb4028-58b9-4a2d-ab7d-67b1aaf3bbd9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/c8ddb479-af49-4056-a8b5-0b25b524f104 HTTP/1.1" status: 204 len: 168 time: 0.3518443 Dec 21 04:13:59.742196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60620) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:59.812820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c4400f7-94a0-4f98-9886-8c52fb232c8c req-1bc7f001-3c21-44ce-906c-9229a4c85358 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 210 time: 0.0968120 Dec 21 04:13:59.830425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7bb4028-58b9-4a2d-ab7d-67b1aaf3bbd9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8ddb479-af49-4056-a8b5-0b25b524f104,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:13:59.927131 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29e8ff7b-caa2-4fc0-ae07-808d58ed7f9f req-00f49f29-5999-4999-95e1-9bf688dc8797 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2043602 Dec 21 04:13:59.937299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a93a8ef5-ce44-4069-8069-7b1817591513 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1862597 Dec 21 04:13:59.940196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60622) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:13:59.980986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.3 (3f781088-f4ae-4039-bd42-2337b91d459d/cc3361a8-c44a-4f96-8ecd-d8322bcd66f1/a1a159da-8ede-44a2-8929-065e82a2dee0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:00.017007 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.018053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.032131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84b0358b-c904-4d47-9ad8-c1adbba8280d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.083374 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84b0358b-c904-4d47-9ad8-c1adbba8280d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.089343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-0eda12e7-5a06-4c31-9bf9-b492a68a2b49 service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4795151 Dec 21 04:14:00.092473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.185858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.241010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84b0358b-c904-4d47-9ad8-c1adbba8280d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.243714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84b0358b-c904-4d47-9ad8-c1adbba8280d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.246300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-84b0358b-c904-4d47-9ad8-c1adbba8280d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/eed6a674-73fe-4534-882f-db15f0663399 HTTP/1.1" status: 204 len: 168 time: 0.3046446 Dec 21 04:14:00.249263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60624) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:00.262912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b0358b-c904-4d47-9ad8-c1adbba8280d tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=eed6a674-73fe-4534-882f-db15f0663399,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:00.292152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.335695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-619ee8da-6ec2-42bd-b9e6-5800187b8fb3 req-860f07ff-54b3-4ab1-b0bd-656c178427af service neutron] 10.222.0.54 "GET /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2205055 Dec 21 04:14:00.338077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.343771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29135166-d39f-48c4-8712-03c84f2cc730 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0922692 Dec 21 04:14:00.347470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60626) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:00.352862 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--166524318'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:00.358887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 3f781088-f4ae-4039-bd42-2337b91d459d is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:00.362173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:00.366056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:00.373811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:00.430667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:00.431401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.448192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.505454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1f3e7ba9-599b-4d55-a1f6-69973b6c8456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2534900 Dec 21 04:14:00.526967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Request body: {'port': {'device_id': '615aae36-683b-40bc-bda6-de53bf692e14', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:00.570462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.593833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.650921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.664516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cfbf9f98-120e-4357-b5d5-7f0e762f469b None None] Provisioning complete for port a1a159da-8ede-44a2-8929-065e82a2dee0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:00.665103 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cfbf9f98-120e-4357-b5d5-7f0e762f469b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.689075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.704267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cfbf9f98-120e-4357-b5d5-7f0e762f469b None None] Port a1a159da-8ede-44a2-8929-065e82a2dee0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:00.725665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.728654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f87e724e-1122-441a-b28d-119d9bbc99f6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:00.779445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:00.783749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fe4a74ee-1557-495e-af5f-820289ef9391 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4346983 Dec 21 04:14:00.784340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60630) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:00.790765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ad9bcac2-3259-4549-b997-66baa3363a49 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'f87e724e-1122-441a-b28d-119d9bbc99f6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:00.864891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Allocated IP 172.25.5.28 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/6b9b455b-3cd8-494d-92df-a716affdc3c9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:00.996895 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.056817 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-ad9bcac2-3259-4549-b997-66baa3363a49 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:01.058114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ad9bcac2-3259-4549-b997-66baa3363a49 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.2710238 Dec 21 04:14:01.060937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60636) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:01.065464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f7c024e2-76ae-4123-8854-a600c91da19b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group_rule': {'security_group_id': 'f87e724e-1122-441a-b28d-119d9bbc99f6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:01.087188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.117817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bdf4fc8-6d08-4304-a166-eb92d646c5af req-87c4c134-c894-4706-aafa-eff748b53926 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:01.119881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bdf4fc8-6d08-4304-a166-eb92d646c5af req-87c4c134-c894-4706-aafa-eff748b53926 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 946 time: 0.3973300 Dec 21 04:14:01.132938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:01.138254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:01.141898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:01.155402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-421c9213-6ef2-4130-a13c-276f5e4dbe64 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:01.182605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event updated for resources: {'Port': ['ID=6b9b455b-3cd8-494d-92df-a716affdc3c9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:01.224472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9187fc2-f76a-446d-9de1-a5dbcf0fac61 req-946ee2fb-92b4-448f-b22c-228a2874e12a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:01.225989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9187fc2-f76a-446d-9de1-a5dbcf0fac61 req-946ee2fb-92b4-448f-b22c-228a2874e12a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 931 time: 0.1256044 Dec 21 04:14:01.232618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-22d97276-d4f8-4816-bfe4-8a1c2bfe664c None None] Provisioning complete for port 6b9b455b-3cd8-494d-92df-a716affdc3c9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:01.233864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22d97276-d4f8-4816-bfe4-8a1c2bfe664c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.238549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bdf4fc8-6d08-4304-a166-eb92d646c5af req-a82fa909-0826-4ff4-bd53-71fef6006f34 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006589 Dec 21 04:14:01.317140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1a159da-8ede-44a2-8929-065e82a2dee0 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:14:01.324308 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-f7c024e2-76ae-4123-8854-a600c91da19b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:01.328165 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f7c024e2-76ae-4123-8854-a600c91da19b tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.2636313 Dec 21 04:14:01.328720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60640) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:01.333961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.338320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-22d97276-d4f8-4816-bfe4-8a1c2bfe664c None None] Port 6b9b455b-3cd8-494d-92df-a716affdc3c9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:01.341050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9187fc2-f76a-446d-9de1-a5dbcf0fac61 req-4dd3a640-519b-4aa3-a2b6-36dc7ca6e926 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0911763 Dec 21 04:14:01.353882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Transition to ACTIVE for port object a1a159da-8ede-44a2-8929-065e82a2dee0 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:14:01.389983 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9566ee66-b3da-4b5c-b465-f3ca443974b5 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.413516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9566ee66-b3da-4b5c-b465-f3ca443974b5 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.414143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9071c4-dd5d-4e85-90d6-f4b5d2f45bba req-ad1a8350-1665-44a7-9cde-a89f5fda0ae9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:01.416540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c9071c4-dd5d-4e85-90d6-f4b5d2f45bba req-ad1a8350-1665-44a7-9cde-a89f5fda0ae9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0515966 Dec 21 04:14:01.453255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.506493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c9071c4-dd5d-4e85-90d6-f4b5d2f45bba req-3591114d-9484-4566-84b5-702ca5d4f3eb tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840945 Dec 21 04:14:01.553246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.584194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:01.615181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:01.615807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:01.615900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 on network 3f781088-f4ae-4039-bd42-2337b91d459d {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:01.624550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Port a1a159da-8ede-44a2-8929-065e82a2dee0 on network 3f781088-f4ae-4039-bd42-2337b91d459d not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:14:01.624986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 on network 3f781088-f4ae-4039-bd42-2337b91d459d {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:01.632490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:01.632960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Checking segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:01.633392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Bound using segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:01.633824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Bound port: a1a159da-8ede-44a2-8929-065e82a2dee0, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:01.634327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.654843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9566ee66-b3da-4b5c-b465-f3ca443974b5 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.657505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9566ee66-b3da-4b5c-b465-f3ca443974b5 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.658676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9566ee66-b3da-4b5c-b465-f3ca443974b5 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/f87e724e-1122-441a-b28d-119d9bbc99f6 HTTP/1.1" status: 204 len: 168 time: 0.3292742 Dec 21 04:14:01.668989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60642) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:01.695904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9566ee66-b3da-4b5c-b465-f3ca443974b5 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f87e724e-1122-441a-b28d-119d9bbc99f6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:01.725651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:01.730111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:01.771438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7371222-a8ff-403f-bab7-e18855a9aee6 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1012230 Dec 21 04:14:01.775777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60644) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:01.780442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'tempest-secgroup--789165733'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:01.820499 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.843635 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.863312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:01.863312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.863312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] 10.222.0.31 "PUT /v2.0/ports/a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 1092 time: 1.3400018 Dec 21 04:14:01.863312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:01.863851 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce712a7d-bff9-4f96-81d9-550ac1d37f67" -d '{"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:01.893630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:01.912695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79f7bf0-f872-4fd8-9dae-43efab07bc71 service neutron] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:01.944822 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f2e0fad-4338-481a-9009-392b9d9fe74d x-openstack-request-id: req-5f2e0fad-4338-481a-9009-392b9d9fe74d {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:01.945328 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:01.945757 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5f2e0fad-4338-481a-9009-392b9d9fe74d {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:01.946317 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'status': 'completed', 'code': 200} Dec 21 04:14:02.030022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.043716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce712a7d-bff9-4f96-81d9-550ac1d37f67 req-cf556f44-ace4-477d-a6eb-01353305cf1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.051107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce712a7d-bff9-4f96-81d9-550ac1d37f67 req-cf556f44-ace4-477d-a6eb-01353305cf1c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1095 time: 0.0685887 Dec 21 04:14:02.126503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Router 4709875a-63b1-4bb9-8375-16c9c95a348a is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:14:02.136764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.180481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0b929d70-b834-4a0b-abdd-ed7d6dc9b18b,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:02.199987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce712a7d-bff9-4f96-81d9-550ac1d37f67 req-94954802-f363-436a-844c-aedc661bd765 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.201489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce712a7d-bff9-4f96-81d9-550ac1d37f67 req-94954802-f363-436a-844c-aedc661bd765 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=10a032d25985452584a3dcdae6969809&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1391490 Dec 21 04:14:02.260960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:14:02.272636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] Sync routers for ids ['4709875a-63b1-4bb9-8375-16c9c95a348a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:14:02.284742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] Routers {'4709875a-63b1-4bb9-8375-16c9c95a348a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:02.285292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4709875a-63b1-4bb9-8375-16c9c95a348a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:02.285547 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.286962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0178c844-9c94-4193-be3b-c8c382007077 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5099454 Dec 21 04:14:02.292263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.305141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8210472a-377b-4bfa-9530-a016aa8ccac9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Request body: {'security_group': {'name': 'default'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:02.305722 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-8210472a-377b-4bfa-9530-a016aa8ccac9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 21 04:14:02.306265 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-8210472a-377b-4bfa-9530-a016aa8ccac9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] update failed (client error): There was a conflict when trying to complete your request. Dec 21 04:14:02.309932 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8210472a-377b-4bfa-9530-a016aa8ccac9 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "PUT /v2.0/security-groups/0b929d70-b834-4a0b-abdd-ed7d6dc9b18b HTTP/1.1" status: 409 len: 330 time: 0.0160999 Dec 21 04:14:02.310363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.335800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce712a7d-bff9-4f96-81d9-550ac1d37f67 req-842f95f5-dfb5-4f3e-9435-effcc9dd69c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.338460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce712a7d-bff9-4f96-81d9-550ac1d37f67 req-842f95f5-dfb5-4f3e-9435-effcc9dd69c0 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1275494 Dec 21 04:14:02.353354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:02.368865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] Routers {'4709875a-63b1-4bb9-8375-16c9c95a348a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:02.369774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4709875a-63b1-4bb9-8375-16c9c95a348a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:02.382147 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.382147 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7008cbed-54d4-4301-bd33-39861fd7040f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 2.8772275 Dec 21 04:14:02.382387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60664) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.388897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:02.396529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-851a23ee-df2b-4edb-a83c-b9aea160b8ba tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.427862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:02.428926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-368f28ac-6b71-49c5-b8ef-f7dd139b717c None None] The sync data for ids ['4709875a-63b1-4bb9-8375-16c9c95a348a'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:14:02.462286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-3ed969c0-30d8-421a-862e-6d9fa8699feb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.464486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-3ed969c0-30d8-421a-862e-6d9fa8699feb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1095 time: 0.0629387 Dec 21 04:14:02.464707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-851a23ee-df2b-4edb-a83c-b9aea160b8ba tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.535485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-5966483a-23dd-42d6-8c95-8ac89b9e161a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 217 time: 0.0405629 Dec 21 04:14:02.562110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dccad143-ae82-47db-ac5e-d848f324300d req-594cd2cd-5ed8-4717-a891-310561da92b6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.563763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dccad143-ae82-47db-ac5e-d848f324300d req-594cd2cd-5ed8-4717-a891-310561da92b6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.0983791 Dec 21 04:14:02.617170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-a2646011-5732-4a7b-b1bd-3cc76f201a78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.619351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-a2646011-5732-4a7b-b1bd-3cc76f201a78 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0749910 Dec 21 04:14:02.629637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-851a23ee-df2b-4edb-a83c-b9aea160b8ba tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.632260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-851a23ee-df2b-4edb-a83c-b9aea160b8ba tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.636470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-851a23ee-df2b-4edb-a83c-b9aea160b8ba tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/0b929d70-b834-4a0b-abdd-ed7d6dc9b18b HTTP/1.1" status: 204 len: 168 time: 0.3222253 Dec 21 04:14:02.639622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60668) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.666950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851a23ee-df2b-4edb-a83c-b9aea160b8ba tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b929d70-b834-4a0b-abdd-ed7d6dc9b18b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:02.678790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dccad143-ae82-47db-ac5e-d848f324300d req-cac154d4-d2a7-4f7c-93c2-833bf4b4e8d2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0952244 Dec 21 04:14:02.694129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1fa3dbf2-90a5-4d6d-ab84-58e0eeee60df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.697641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1fa3dbf2-90a5-4d6d-ab84-58e0eeee60df service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0636504 Dec 21 04:14:02.832523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.847502 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5903ce5f-7c61-40d4-8941-55697f889884 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2027614 Dec 21 04:14:02.851824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60672) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.864785 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-c1c0f2e7-f399-41b2-9d71-514c1074c582 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] delete failed (client error): The resource could not be found. Dec 21 04:14:02.869707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1c0f2e7-f399-41b2-9d71-514c1074c582 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "DELETE /v2.0/security-groups/81b3426b-a6d8-47eb-be52-ad1bdd1cb99f HTTP/1.1" status: 404 len: 347 time: 0.0130522 Dec 21 04:14:02.870531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.888152 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-bb5d65b3-05c5-45f0-b6ed-dd4e0cd5bc65 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] show failed (client error): The resource could not be found. Dec 21 04:14:02.889198 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bb5d65b3-05c5-45f0-b6ed-dd4e0cd5bc65 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-groups/acdb3453-fda3-4a87-9d1b-617ddb8f359f HTTP/1.1" status: 404 len: 347 time: 0.0182056 Dec 21 04:14:02.893672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:02.906091 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-15da972d-3f3a-4396-915e-66b7eab35211 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] show failed (client error): The resource could not be found. Dec 21 04:14:02.910377 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-15da972d-3f3a-4396-915e-66b7eab35211 tempest-NegativeSecGroupIPv6Test-1906687973 tempest-NegativeSecGroupIPv6Test-1906687973-project] 10.222.0.18 "GET /v2.0/security-group-rules/b48a667a-f093-4ea1-b304-5e460917f94e HTTP/1.1" status: 404 len: 356 time: 0.0130610 Dec 21 04:14:02.929140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55fb43d-3e9a-47ba-bc01-4783dd7fa97b req-77c0fbc7-0a11-48b3-88e9-c3c46453ca0d tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.930665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a55fb43d-3e9a-47ba-bc01-4783dd7fa97b req-77c0fbc7-0a11-48b3-88e9-c3c46453ca0d tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 946 time: 0.1208203 Dec 21 04:14:02.935122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:02.940561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93432c14-a425-42ce-a6f9-e6912cc39376 req-a89bf292-a9bb-4580-bbb7-41d7383de6ad tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:02.942060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93432c14-a425-42ce-a6f9-e6912cc39376 req-a89bf292-a9bb-4580-bbb7-41d7383de6ad tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.1419084 Dec 21 04:14:02.976892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-1ef9287a-90c5-4744-b8cc-e33dd58f9184 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2716711 Dec 21 04:14:03.085725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Deleting port 6b9b455b-3cd8-494d-92df-a716affdc3c9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:03.086359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.113280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a55fb43d-3e9a-47ba-bc01-4783dd7fa97b req-f79816ef-6aad-467b-b89c-af94e44be04b tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1683872 Dec 21 04:14:03.128315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93432c14-a425-42ce-a6f9-e6912cc39376 req-15c85939-cda3-4ae9-a773-fc08a1fd275f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1753590 Dec 21 04:14:03.160863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-acd784d5-1f54-4427-a4c5-ccad098bd9fc req-bf17d9c0-a7b7-4855-a667-270bbdf0d6e5 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1730762 Dec 21 04:14:03.179902 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.195085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Calling delete_port for 6b9b455b-3cd8-494d-92df-a716affdc3c9 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:03.452505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.471642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60682) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:03.483346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Pushing event deleted for resources: {'Port': ['ID=6b9b455b-3cd8-494d-92df-a716affdc3c9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:03.493887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8af0d4ea-75ee-466e-9892-2a7f3f53e500 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:03.549541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.659372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a0edd4df-a836-4220-948b-de05a798fdc9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=291abef56d774200a056b18bed512592&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1860006 Dec 21 04:14:03.661551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60686) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:03.714406 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59f21365-26ed-4dfe-a48f-d1e35ef46f10 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.740860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59f21365-26ed-4dfe-a48f-d1e35ef46f10 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.845445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be10584c-30e6-4e8e-89ec-e1df3ce6669d req-62f1c712-db96-42b5-bd2e-f8a948564430 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:03.847056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be10584c-30e6-4e8e-89ec-e1df3ce6669d req-62f1c712-db96-42b5-bd2e-f8a948564430 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.0587640 Dec 21 04:14:03.906326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be10584c-30e6-4e8e-89ec-e1df3ce6669d req-a7a38039-aafa-4709-ac15-f6c2878dd3c1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509191 Dec 21 04:14:03.930235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59f21365-26ed-4dfe-a48f-d1e35ef46f10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.933015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-59f21365-26ed-4dfe-a48f-d1e35ef46f10 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:03.934190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-59f21365-26ed-4dfe-a48f-d1e35ef46f10 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/03c1a130-b4eb-408b-bb74-db2daea74a65 HTTP/1.1" status: 204 len: 168 time: 0.2716854 Dec 21 04:14:03.944782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f21365-26ed-4dfe-a48f-d1e35ef46f10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03c1a130-b4eb-408b-bb74-db2daea74a65,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:04.121814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.125196 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.208263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Router 4709875a-63b1-4bb9-8375-16c9c95a348a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:14:04.244970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63f7d83-6358-45c6-b6ed-396c51b61ec3 req-26640191-7f04-493f-8794-528f91121812 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:04.246589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f63f7d83-6358-45c6-b6ed-396c51b61ec3 req-26640191-7f04-493f-8794-528f91121812 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 946 time: 0.0633941 Dec 21 04:14:04.319470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:14:04.327180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.330733 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-077a412c-3230-45b8-abd3-02cd77b38603 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "PUT /v2.0/routers/4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 200 len: 706 time: 1.9443729 Dec 21 04:14:04.337185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60698) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:04.337663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb31862-6f17-427c-a375-017764d32018 req-032ae651-6cb6-4ea8-9109-90ce8832adfc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:04.337663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bb31862-6f17-427c-a375-017764d32018 req-032ae651-6cb6-4ea8-9109-90ce8832adfc tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0899351 Dec 21 04:14:04.342195 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] Sync routers for ids ['4709875a-63b1-4bb9-8375-16c9c95a348a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:14:04.350341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f63f7d83-6358-45c6-b6ed-396c51b61ec3 req-17890ed7-e126-42c0-a523-314c96a2157c tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937538 Dec 21 04:14:04.368434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] Routers {'4709875a-63b1-4bb9-8375-16c9c95a348a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:04.372714 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4709875a-63b1-4bb9-8375-16c9c95a348a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:04.412637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3bb31862-6f17-427c-a375-017764d32018 req-85a835b7-6f11-48b2-8295-28629de45d70 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666134 Dec 21 04:14:04.435586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:04.443750 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] Routers {'4709875a-63b1-4bb9-8375-16c9c95a348a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:04.444344 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4709875a-63b1-4bb9-8375-16c9c95a348a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:04.455404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-0a570f42-b409-4d22-a56a-8536d5956f67 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:04.457238 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-0a570f42-b409-4d22-a56a-8536d5956f67 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 946 time: 0.1728480 Dec 21 04:14:04.459747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf5146fe-b115-4539-8fe5-e88fcfe0fb9a tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/routers/4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 200 len: 741 time: 0.1259842 Dec 21 04:14:04.462712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60708) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:04.480758 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:04.481405 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f14c727-32be-4b97-b0f8-0f32843aea32 None None] The sync data for ids ['4709875a-63b1-4bb9-8375-16c9c95a348a'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:14:04.522979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1d95efc4-a1fe-4a99-a624-bd3512fa138c tempest-RoutersAdminTest-1901811618 tempest-RoutersAdminTest-1901811618-project-admin] 10.222.0.18 "GET /v2.0/ports?network_id=30f5b79f-275c-4003-8999-814f6db142e1&device_id=4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 200 len: 205 time: 0.0567591 Dec 21 04:14:04.523413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60710) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:04.550837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-799b68ae-30dc-49f0-99c8-c8ac54efc799 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 200 len: 205 time: 0.0263247 Dec 21 04:14:04.553374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60712) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:04.640879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.715434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Deleting port e398923b-d2b4-4502-89ec-272ed2d85b89 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:04.715778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.754995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c0325b-e7fa-4181-99a9-8d539c2b5939 req-ab3d17c7-3c76-44e3-a5dc-592e647c1772 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:04.756646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1c0325b-e7fa-4181-99a9-8d539c2b5939 req-ab3d17c7-3c76-44e3-a5dc-592e647c1772 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0545990 Dec 21 04:14:04.814679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1c0325b-e7fa-4181-99a9-8d539c2b5939 req-de94fab1-f3d0-4337-a56a-d0b521bad7c8 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512362 Dec 21 04:14:04.863904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.867726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.935328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] For port e398923b-d2b4-4502-89ec-272ed2d85b89, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=e398923b-d2b4-4502-89ec-272ed2d85b89,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:04.935851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:04.946345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be6df9b-b148-4c31-a317-3dc719d5c6c3 req-cd7ea01c-dd40-4cad-821c-0b55bc2af862 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:04.948130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5be6df9b-b148-4c31-a317-3dc719d5c6c3 req-cd7ea01c-dd40-4cad-821c-0b55bc2af862 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0582485 Dec 21 04:14:04.950920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Calling delete_port for e398923b-d2b4-4502-89ec-272ed2d85b89 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:05.028293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5be6df9b-b148-4c31-a317-3dc719d5c6c3 req-1043a010-fd45-44d3-99f5-a7d20f86658e tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712090 Dec 21 04:14:05.028541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.029084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Fanout notify agent at l3_agent the message router_deleted on router 4709875a-63b1-4bb9-8375-16c9c95a348a {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:14:05.036722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.043662 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0826709a-a316-45ef-b8b9-10431d5042dc tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 204 len: 168 time: 0.4889364 Dec 21 04:14:05.045280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60728) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.050300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cbcf7e0-2e75-4562-848e-c4f588aa34b1 req-37c38a05-53bf-4895-88bf-6a4d985cee75 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:05.055441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cbcf7e0-2e75-4562-848e-c4f588aa34b1 req-37c38a05-53bf-4895-88bf-6a4d985cee75 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.0715330 Dec 21 04:14:05.099811 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfb45f47-cb1f-4377-a41a-2a5aa20c426d tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 200 len: 205 time: 0.0511940 Dec 21 04:14:05.103937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60734) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.152925 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-780827de-afa8-4ca7-b4c9-75e409cc834b tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] delete failed (client error): The resource could not be found. Dec 21 04:14:05.154033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-780827de-afa8-4ca7-b4c9-75e409cc834b tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/4709875a-63b1-4bb9-8375-16c9c95a348a HTTP/1.1" status: 404 len: 336 time: 0.0490396 Dec 21 04:14:05.157735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60736) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.163920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cbcf7e0-2e75-4562-848e-c4f588aa34b1 req-5cc2e551-e144-460a-b24c-503c65f2523f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1062348 Dec 21 04:14:05.192144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-09fffb7b-5d97-42ca-bc66-6b30ae1e9a32 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=f202cc0c-c132-4b87-b40e-142e4485b40f HTTP/1.1" status: 200 len: 205 time: 0.0329344 Dec 21 04:14:05.206404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.230469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60740) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.245862 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-ba543342-0963-40d8-9823-003c5a093939 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] delete failed (client error): The resource could not be found. Dec 21 04:14:05.247079 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ba543342-0963-40d8-9823-003c5a093939 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/f202cc0c-c132-4b87-b40e-142e4485b40f HTTP/1.1" status: 404 len: 336 time: 0.0394585 Dec 21 04:14:05.252347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60744) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.284624 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f5204d2c-5239-4484-95cf-f06858ea8d28 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=79a8d038-aadc-4525-8fae-ff99bd80be65 HTTP/1.1" status: 200 len: 205 time: 0.0311453 Dec 21 04:14:05.285599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.287168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60746) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.312937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Pushing event deleted for resources: {'Port': ['ID=e398923b-d2b4-4502-89ec-272ed2d85b89,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:05.324010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['e398923b-d2b4-4502-89ec-272ed2d85b89'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:05.342789 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-847859cb-1ef5-4fa3-a839-03bd592c5aac tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] delete failed (client error): The resource could not be found. Dec 21 04:14:05.346126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-847859cb-1ef5-4fa3-a839-03bd592c5aac tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/79a8d038-aadc-4525-8fae-ff99bd80be65 HTTP/1.1" status: 404 len: 336 time: 0.0552874 Dec 21 04:14:05.346631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60748) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.368050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] No DVR routers for this DVR port e398923b-d2b4-4502-89ec-272ed2d85b89 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:05.370760 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.374676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4c4b56e1-d9cc-472b-93e1-2910494b03c1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'default'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:05.375067 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a5d2590b-1181-4195-9862-f9074d3b6b25 req-9fbe4d5f-a0d6-422f-94a8-e8fe025dd7e8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "DELETE /v2.0/ports/e398923b-d2b4-4502-89ec-272ed2d85b89 HTTP/1.1" status: 204 len: 173 time: 0.8999093 Dec 21 04:14:05.375421 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-4c4b56e1-d9cc-472b-93e1-2910494b03c1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 21 04:14:05.375622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6130694f-d802-40bc-bcba-1184a114d366', 'name': 'network-vif-deleted', 'tag': 'e398923b-d2b4-4502-89ec-272ed2d85b89'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:05.376437 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-4c4b56e1-d9cc-472b-93e1-2910494b03c1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): There was a conflict when trying to complete your request. Dec 21 04:14:05.376913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4c4b56e1-d9cc-472b-93e1-2910494b03c1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1452839 Dec 21 04:14:05.378265 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c16d4883-7206-4379-b41c-8230847c200d" -d '{"events": [{"server_uuid": "6130694f-d802-40bc-bcba-1184a114d366", "name": "network-vif-deleted", "tag": "e398923b-d2b4-4502-89ec-272ed2d85b89"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:05.380143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2f4195ff-9e5e-454a-b849-260fae7bf1de tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=d911d424-615b-43bd-9bfb-c546498a81ff HTTP/1.1" status: 200 len: 205 time: 0.0313585 Dec 21 04:14:05.380416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60752) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.382945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60756) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.385348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--1234790171'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:05.434203 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-77e45a28-87c8-4ca5-a165-6a9cc481f19c tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] delete failed (client error): The resource could not be found. Dec 21 04:14:05.435264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77e45a28-87c8-4ca5-a165-6a9cc481f19c tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/d911d424-615b-43bd-9bfb-c546498a81ff HTTP/1.1" status: 404 len: 336 time: 0.0472677 Dec 21 04:14:05.438024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60758) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.465917 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7db6126b-9df6-4f05-903c-d68732fbc217 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=891be34f-8c8b-4fe7-8b96-d25300ea7c9f HTTP/1.1" status: 200 len: 205 time: 0.0266466 Dec 21 04:14:05.468292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60760) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.472947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94f967f1-f1e4-4b38-980a-9f48685e69fd req-f72af7b7-c0f5-4134-8660-723a197e652f tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 210 time: 0.0322335 Dec 21 04:14:05.505065 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-38930cee-eabf-4529-99c0-7affda7604e5 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] delete failed (client error): The resource could not be found. Dec 21 04:14:05.506094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38930cee-eabf-4529-99c0-7affda7604e5 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/891be34f-8c8b-4fe7-8b96-d25300ea7c9f HTTP/1.1" status: 404 len: 336 time: 0.0369296 Dec 21 04:14:05.512603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.522463 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e687c8e8-0af6-4074-be59-05b3a4844e80 x-openstack-request-id: req-e687c8e8-0af6-4074-be59-05b3a4844e80 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:05.522748 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6130694f-d802-40bc-bcba-1184a114d366", "name": "network-vif-deleted", "tag": "e398923b-d2b4-4502-89ec-272ed2d85b89", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:05.523021 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e687c8e8-0af6-4074-be59-05b3a4844e80 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:05.523429 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6130694f-d802-40bc-bcba-1184a114d366', 'name': 'network-vif-deleted', 'tag': 'e398923b-d2b4-4502-89ec-272ed2d85b89', 'status': 'completed', 'code': 200} Dec 21 04:14:05.529436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.538797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.549260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-69d5b52b-7f12-4d4a-ab73-1b8c702355ba tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "GET /v2.0/ports?device_id=a1dc63ba-19ad-49f1-8ca5-d3867803ea90 HTTP/1.1" status: 200 len: 205 time: 0.0354371 Dec 21 04:14:05.549769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.593018 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-e708b686-2809-461c-8e22-216ae1e47fa5 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] delete failed (client error): The resource could not be found. Dec 21 04:14:05.594049 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e708b686-2809-461c-8e22-216ae1e47fa5 tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/routers/a1dc63ba-19ad-49f1-8ca5-d3867803ea90 HTTP/1.1" status: 404 len: 336 time: 0.0433798 Dec 21 04:14:05.596712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60768) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:05.633278 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-05b73c80-3356-486a-85a9-162f7410de3f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] DELETE failed (client error): The resource could not be found. Dec 21 04:14:05.633763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-05b73c80-3356-486a-85a9-162f7410de3f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:05.640740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05b73c80-3356-486a-85a9-162f7410de3f tempest-RoutersAdminTest-1137466858 tempest-RoutersAdminTest-1137466858-project] 10.222.0.18 "DELETE /v2.0/subnets/bdde89e1-00e4-4e3f-ae01-e9f3fffff0a7 HTTP/1.1" status: 404 len: 337 time: 0.0428393 Dec 21 04:14:05.655163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.666258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc55da98-cd25-4525-9b76-93cdde26c4fb req-64915ea8-fea4-4afb-8e5d-b5970b5a75db tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:05.667783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc55da98-cd25-4525-9b76-93cdde26c4fb req-64915ea8-fea4-4afb-8e5d-b5970b5a75db tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0825169 Dec 21 04:14:05.725319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc55da98-cd25-4525-9b76-93cdde26c4fb req-f90b5ba3-f6e9-4a15-98fc-3404936f0283 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505638 Dec 21 04:14:05.744713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.781303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1c6ac396-6f9d-4758-b79a-2fc3ee384419,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:05.830677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.883025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:14:05.980840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:05.985509 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:05.991680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'port_id': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'mac_address': 'fa:16:3e:b0:51:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 109, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:14:06.017037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=447d593b-91f9-4ce0-b8ef-57e4ea29e282,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:06.030725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.044483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1a159da-8ede-44a2-8929-065e82a2dee0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:14:06.063907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:06.114771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.116064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4bca0532-8603-43c6-971d-7c1c58a11344 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7347388 Dec 21 04:14:06.119766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60772) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:06.124109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '447d593b-91f9-4ce0-b8ef-57e4ea29e282', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:06.164446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.225275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:06.256231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.305210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60778) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:06.345984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.358631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a76ad23-2c24-4ee9-933c-5b65331a3cc1 req-3e3104be-ac98-42a5-9d73-e4d5a149856d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:06.360209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a76ad23-2c24-4ee9-933c-5b65331a3cc1 req-3e3104be-ac98-42a5-9d73-e4d5a149856d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 944 time: 0.0911198 Dec 21 04:14:06.414412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a76ad23-2c24-4ee9-933c-5b65331a3cc1 req-9daaa022-d35c-448a-9a44-36cc6bfc65e9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481393 Dec 21 04:14:06.418169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1915e3d-1b0e-4fca-9b5e-814bf3a47ec9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.446643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.465255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=749cc97a-ff5a-459c-b964-a84943e249f4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:06.500804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1915e3d-1b0e-4fca-9b5e-814bf3a47ec9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.512378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['a1a159da-8ede-44a2-8929-065e82a2dee0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:06.549482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.550857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-08f17e95-b504-4bfb-85e9-87f989620870 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4301319 Dec 21 04:14:06.553734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60784) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:06.559520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-94eb9c9d-5c6c-48d3-af07-6a2af3b80c16 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '447d593b-91f9-4ce0-b8ef-57e4ea29e282', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:06.595295 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b1915e3d-1b0e-4fca-9b5e-814bf3a47ec9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.595798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c99821-9ba8-4d2d-9d20-7849e7b2063d req-3f4ad9a4-6257-4355-b40d-529ed651df35 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=6130694f-d802-40bc-bcba-1184a114d366 HTTP/1.1" status: 200 len: 210 time: 0.0398502 Dec 21 04:14:06.646750 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1915e3d-1b0e-4fca-9b5e-814bf3a47ec9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=309dd654284b4e9a8ab077dc3d8c3d80&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3399451 Dec 21 04:14:06.648936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60786) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:06.657115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1915e3d-1b0e-4fca-9b5e-814bf3a47ec9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=788acda1-03b8-468d-9434-69d356d7cf24,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:06.703801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f78e096c-cbe5-4162-80fa-5057bc70368e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.724218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94eb9c9d-5c6c-48d3-af07-6a2af3b80c16 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.729776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f78e096c-cbe5-4162-80fa-5057bc70368e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.849081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c8b7f6-a289-4a5c-af0e-5145a0009890 req-1d6df7b8-1887-4b0d-9ff3-309fdc1fc8d0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:06.850570 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c8b7f6-a289-4a5c-af0e-5145a0009890 req-1d6df7b8-1887-4b0d-9ff3-309fdc1fc8d0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0493627 Dec 21 04:14:06.851838 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-94eb9c9d-5c6c-48d3-af07-6a2af3b80c16 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): There was a conflict when trying to complete your request. Dec 21 04:14:06.852779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-94eb9c9d-5c6c-48d3-af07-6a2af3b80c16 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.2981384 Dec 21 04:14:06.855733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60790) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:06.875519 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f78e096c-cbe5-4162-80fa-5057bc70368e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.878672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f78e096c-cbe5-4162-80fa-5057bc70368e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.879856 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f78e096c-cbe5-4162-80fa-5057bc70368e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/788acda1-03b8-468d-9434-69d356d7cf24 HTTP/1.1" status: 204 len: 168 time: 0.2300069 Dec 21 04:14:06.888472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78e096c-cbe5-4162-80fa-5057bc70368e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=788acda1-03b8-468d-9434-69d356d7cf24,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:06.942754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c8b7f6-a289-4a5c-af0e-5145a0009890 req-67286d88-7c5d-42ce-9bda-efd3628ae437 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0849428 Dec 21 04:14:06.943640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6de9701d-86ef-4923-873b-688a3b38c65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:06.969923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6de9701d-86ef-4923-873b-688a3b38c65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.109225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6de9701d-86ef-4923-873b-688a3b38c65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.111997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6de9701d-86ef-4923-873b-688a3b38c65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.113172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6de9701d-86ef-4923-873b-688a3b38c65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/447d593b-91f9-4ce0-b8ef-57e4ea29e282 HTTP/1.1" status: 204 len: 168 time: 0.2565353 Dec 21 04:14:07.115943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:07.153029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de9701d-86ef-4923-873b-688a3b38c65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=447d593b-91f9-4ce0-b8ef-57e4ea29e282,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:07.165152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60798) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:07.171995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6e3416c0-ccd4-4d53-bb44-621201832a24 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0437436 Dec 21 04:14:07.172792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--188756558'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:07.201667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-54f24c5a-29fb-4826-9e2f-377f950ee7c1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:07.204901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-54f24c5a-29fb-4826-9e2f-377f950ee7c1 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 945 time: 0.0862129 Dec 21 04:14:07.282696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.336493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port 757b9fc9-1d7b-47c6-b195-673ac7d7799b {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:07.336754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.424232 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.451826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port 757b9fc9-1d7b-47c6-b195-673ac7d7799b, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=757b9fc9-1d7b-47c6-b195-673ac7d7799b,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:07.452198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.465279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for 757b9fc9-1d7b-47c6-b195-673ac7d7799b owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:07.508634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.582648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=67d22411-159e-4741-a4e2-9ef7950b61d6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:07.610926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1b340d-75c8-4e97-aa70-41b7ee523365 req-d44d3c60-24bc-4331-af95-72d3680f2c4c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:07.612491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c1b340d-75c8-4e97-aa70-41b7ee523365 req-d44d3c60-24bc-4331-af95-72d3680f2c4c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 944 time: 0.1069174 Dec 21 04:14:07.613014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60802) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:07.668913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.669183 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-359caa91-01f0-4383-b06e-2b510d711339 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=67330cfb489a453f959b0551f63b990d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0549755 Dec 21 04:14:07.669790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60806) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:07.672979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-23951299-d42c-4d61-baf9-c1ed2f60d08c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5046854 Dec 21 04:14:07.673580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60808) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:07.693653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e5cf3bb9-5386-4966-a70c-6345c7aa6588 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '67d22411-159e-4741-a4e2-9ef7950b61d6', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:07.699558 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-e5cf3bb9-5386-4966-a70c-6345c7aa6588 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Dec 21 04:14:07.699558 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-e5cf3bb9-5386-4966-a70c-6345c7aa6588 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:07.699558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e5cf3bb9-5386-4966-a70c-6345c7aa6588 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0190108 Dec 21 04:14:07.701406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60812) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:07.731637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c1b340d-75c8-4e97-aa70-41b7ee523365 req-296414f2-d313-4f36-98ba-7e9a4aec3e65 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1095772 Dec 21 04:14:07.758497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-254eee38-6e28-4aec-9f21-fc1c77764b91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.795129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0db634b-c7e4-4a76-a5c1-7aedf56995e0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.798375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-254eee38-6e28-4aec-9f21-fc1c77764b91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.824601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.848640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0db634b-c7e4-4a76-a5c1-7aedf56995e0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.860744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:07.861561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=757b9fc9-1d7b-47c6-b195-673ac7d7799b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:07.871961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['757b9fc9-1d7b-47c6-b195-673ac7d7799b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:07.905316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b57ea0b-3b2a-40ba-ba95-831f964de5e7 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:07.929745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:07.959903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port 757b9fc9-1d7b-47c6-b195-673ac7d7799b on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:07.959903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:07.960240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deaefb45-b50f-4fe9-acd3-e0078410ba20 req-a49faa96-0d72-4675-8f45-e7a182965133 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.31 "DELETE /v2.0/ports/757b9fc9-1d7b-47c6-b195-673ac7d7799b HTTP/1.1" status: 204 len: 173 time: 0.7458670 Dec 21 04:14:07.960702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'name': 'network-vif-deleted', 'tag': '757b9fc9-1d7b-47c6-b195-673ac7d7799b'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:07.963035 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51156e74-a3ac-41c9-a1c1-4d2f7a445a66" -d '{"events": [{"server_uuid": "d38dd2ca-4899-4a5a-8f18-3bb66d5f1040", "name": "network-vif-deleted", "tag": "757b9fc9-1d7b-47c6-b195-673ac7d7799b"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:07.999122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0db634b-c7e4-4a76-a5c1-7aedf56995e0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.001736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0db634b-c7e4-4a76-a5c1-7aedf56995e0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.005275 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0db634b-c7e4-4a76-a5c1-7aedf56995e0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/67d22411-159e-4741-a4e2-9ef7950b61d6 HTTP/1.1" status: 204 len: 168 time: 0.3006380 Dec 21 04:14:08.007860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:08.010631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-cbf8d6a4-96f3-4062-a4cf-2eb00c2d2d6f tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:08.012318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-cbf8d6a4-96f3-4062-a4cf-2eb00c2d2d6f tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/networks?id=5a8c4312-b76b-442d-aa89-ba658f5e54a8 HTTP/1.1" status: 200 len: 809 time: 0.1533794 Dec 21 04:14:08.025734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0db634b-c7e4-4a76-a5c1-7aedf56995e0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=67d22411-159e-4741-a4e2-9ef7950b61d6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:08.048495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-254eee38-6e28-4aec-9f21-fc1c77764b91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.051979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-254eee38-6e28-4aec-9f21-fc1c77764b91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.056791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-254eee38-6e28-4aec-9f21-fc1c77764b91 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/7e4c5e9b-c9f4-4721-9f67-62b82f8f5587 HTTP/1.1" status: 204 len: 168 time: 0.3852971 Dec 21 04:14:08.078389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254eee38-6e28-4aec-9f21-fc1c77764b91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e4c5e9b-c9f4-4721-9f67-62b82f8f5587,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:08.084221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8a18b8e-ddef-4971-9c68-fea1dc61b4d9 req-eaf2bdf4-61d0-4d1d-84ea-67b1f5ebf031 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.0626154 Dec 21 04:14:08.088398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-34cd7a3c-154a-4b26-ad30-efe1567ad248 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/quotas/247cb1d10db0451abe7903925d39ba07 HTTP/1.1" status: 200 len: 375 time: 0.0689943 Dec 21 04:14:08.131024 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f511e20-311e-46d8-ae93-f8c18269b78a tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1220686 Dec 21 04:14:08.139835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port a1a159da-8ede-44a2-8929-065e82a2dee0 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:14:08.140435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:08.147661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--1948637831'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:08.156451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-e8705590-f0d7-4367-b4bc-8029dbb1e122 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=247cb1d10db0451abe7903925d39ba07&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0549860 Dec 21 04:14:08.157763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port a1a159da-8ede-44a2-8929-065e82a2dee0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:08.159048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.179254 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2b4a66f-c723-444e-97c2-6cab45b48110 x-openstack-request-id: req-b2b4a66f-c723-444e-97c2-6cab45b48110 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:08.179627 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d38dd2ca-4899-4a5a-8f18-3bb66d5f1040", "name": "network-vif-deleted", "tag": "757b9fc9-1d7b-47c6-b195-673ac7d7799b", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:08.179959 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b2b4a66f-c723-444e-97c2-6cab45b48110 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:08.180435 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd38dd2ca-4899-4a5a-8f18-3bb66d5f1040', 'name': 'network-vif-deleted', 'tag': '757b9fc9-1d7b-47c6-b195-673ac7d7799b', 'status': 'completed', 'code': 200} Dec 21 04:14:08.256089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-32c49401-d59d-4b81-95c7-495b22cec612 service neutron] 10.222.0.18 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0986793 Dec 21 04:14:08.261583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.274621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.317381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:08.318296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:08.320876 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73e50f81-045c-4ccb-845c-23b7daa7386d" -d '{"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-plugged", "status": "completed", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:08.363935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.365548 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98bcca63-7748-4feb-aed6-ed8f9889c7b1 x-openstack-request-id: req-98bcca63-7748-4feb-aed6-ed8f9889c7b1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:08.365846 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-plugged", "status": "completed", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:08.366102 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-98bcca63-7748-4feb-aed6-ed8f9889c7b1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:08.366498 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'code': 200} Dec 21 04:14:08.381505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-3e960a95-1349-4998-bbd5-f9dbc4496385 service neutron] 10.222.0.18 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1185012 Dec 21 04:14:08.441125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.442272 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.443334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 757b9fc9-1d7b-47c6-b195-673ac7d7799b no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:08.487741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=46b3b470-fa4a-4b99-8756-26543b8513cd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:08.495741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 757b9fc9-1d7b-47c6-b195-673ac7d7799b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:08.495741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 757b9fc9-1d7b-47c6-b195-673ac7d7799b not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:08.523676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:08.541021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.542433 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e84fa7df-9e60-494a-822e-f94798b297a1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4004118 Dec 21 04:14:08.546344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ecb850-34d0-4c2b-824f-a6af01e0cb8f req-dc984fd5-aa03-4411-82b4-3d5f5c4bf135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:08.547890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32ecb850-34d0-4c2b-824f-a6af01e0cb8f req-dc984fd5-aa03-4411-82b4-3d5f5c4bf135 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1097 time: 0.0583246 Dec 21 04:14:08.558004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60840) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:08.562630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fb43423f-f469-4eb4-bbb1-c9de9bf4fe9c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '46b3b470-fa4a-4b99-8756-26543b8513cd', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:08.563413 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-fb43423f-f469-4eb4-bbb1-c9de9bf4fe9c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Dec 21 04:14:08.564161 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-fb43423f-f469-4eb4-bbb1-c9de9bf4fe9c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:08.565382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb43423f-f469-4eb4-bbb1-c9de9bf4fe9c tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0061681 Dec 21 04:14:08.567833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60844) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:08.607650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32ecb850-34d0-4c2b-824f-a6af01e0cb8f req-9db39856-68e9-496f-882f-b3645353a105 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490801 Dec 21 04:14:08.625331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ab4cd51-3ae9-495c-96ed-25b10c7f7c51 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.650518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ab4cd51-3ae9-495c-96ed-25b10c7f7c51 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.818078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ab4cd51-3ae9-495c-96ed-25b10c7f7c51 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.820921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ab4cd51-3ae9-495c-96ed-25b10c7f7c51 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.822148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ab4cd51-3ae9-495c-96ed-25b10c7f7c51 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/46b3b470-fa4a-4b99-8756-26543b8513cd HTTP/1.1" status: 204 len: 168 time: 0.2533679 Dec 21 04:14:08.825587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60854) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:08.845610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ab4cd51-3ae9-495c-96ed-25b10c7f7c51 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=46b3b470-fa4a-4b99-8756-26543b8513cd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:08.867316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121451dc-30cf-4898-ab87-bdd733b6a99c req-94384850-2e3e-4866-a0f1-c47ef690f3eb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:08.869371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-121451dc-30cf-4898-ab87-bdd733b6a99c req-94384850-2e3e-4866-a0f1-c47ef690f3eb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0571885 Dec 21 04:14:08.885758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-385916d7-78bd-43f8-b964-469ad297e65b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0578442 Dec 21 04:14:08.886954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60856) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:08.900271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--1232263024'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:08.944479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-121451dc-30cf-4898-ab87-bdd733b6a99c req-da2aef5e-4c25-489e-aa01-928fe44b65cb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678515 Dec 21 04:14:08.981872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:08.992498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06186548-8043-4acf-90ca-54202713ac13 req-4a063828-e567-4843-a112-496387859196 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 210 time: 0.0342672 Dec 21 04:14:09.073769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.136403 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.166050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cbfa05c6-96ea-4b4e-95ba-e260ac2de89e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:09.219542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-633d8b24-e1ba-4e93-a008-e0dc4717fa8e req-df63d23c-f783-490c-b15c-bc17ba75c71c tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=d38dd2ca-4899-4a5a-8f18-3bb66d5f1040 HTTP/1.1" status: 200 len: 210 time: 0.0286288 Dec 21 04:14:09.271999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.273302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-175fd3d6-5a14-4ea3-83c4-eb4ed60b7817 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3774605 Dec 21 04:14:09.302346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60876) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.303151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60878) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.308534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1f496ee6-6fd6-419f-8df2-70d8b81f0241 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'cbfa05c6-96ea-4b4e-95ba-e260ac2de89e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.309430 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-1f496ee6-6fd6-419f-8df2-70d8b81f0241 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Dec 21 04:14:09.310141 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-1f496ee6-6fd6-419f-8df2-70d8b81f0241 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:09.311281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f496ee6-6fd6-419f-8df2-70d8b81f0241 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0077515 Dec 21 04:14:09.314558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60882) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.319175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6d4b389c-f5a2-480d-bfd5-e4bf90be7721 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'cbfa05c6-96ea-4b4e-95ba-e260ac2de89e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.319867 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-6d4b389c-f5a2-480d-bfd5-e4bf90be7721 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Dec 21 04:14:09.320362 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-6d4b389c-f5a2-480d-bfd5-e4bf90be7721 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:09.321459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6d4b389c-f5a2-480d-bfd5-e4bf90be7721 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0058806 Dec 21 04:14:09.324683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60884) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.329588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8a7e1224-9c97-4813-917a-847131c0c3a9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'cbfa05c6-96ea-4b4e-95ba-e260ac2de89e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.330387 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-8a7e1224-9c97-4813-917a-847131c0c3a9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Dec 21 04:14:09.330893 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-8a7e1224-9c97-4813-917a-847131c0c3a9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:09.331960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8a7e1224-9c97-4813-917a-847131c0c3a9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0063701 Dec 21 04:14:09.334512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60886) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.339352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e3ceef66-db92-4982-b3a2-b3b094908a27 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'cbfa05c6-96ea-4b4e-95ba-e260ac2de89e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.340194 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-e3ceef66-db92-4982-b3a2-b3b094908a27 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Dec 21 04:14:09.340665 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-e3ceef66-db92-4982-b3a2-b3b094908a27 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:09.341687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e3ceef66-db92-4982-b3a2-b3b094908a27 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0062857 Dec 21 04:14:09.360673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.426020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-392c57f3-3620-4797-aaa8-f624bb06b3a0 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] Request body: {'port': {'network_id': '2f59d815-15cd-44b2-bd46-e04d69931a91', 'name': 'tempest-NetworksNegativeTestJSON-1532502357'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.430600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5d0ae35-5646-4f32-b119-3d24c7a727c5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.443849 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-392c57f3-3620-4797-aaa8-f624bb06b3a0 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] POST failed (client error): The resource could not be found. Dec 21 04:14:09.444336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-392c57f3-3620-4797-aaa8-f624bb06b3a0 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.445580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-392c57f3-3620-4797-aaa8-f624bb06b3a0 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.1413629 Dec 21 04:14:09.451415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e398923b-d2b4-4502-89ec-272ed2d85b89 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:09.454146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60890) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.472230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: e398923b-d2b4-4502-89ec-272ed2d85b89 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:09.472576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device e398923b-d2b4-4502-89ec-272ed2d85b89 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:09.482571 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-84f85c62-15e6-47ab-bfe1-63c216ee1176 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] DELETE failed (client error): The resource could not be found. Dec 21 04:14:09.483106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-84f85c62-15e6-47ab-bfe1-63c216ee1176 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.486166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-84f85c62-15e6-47ab-bfe1-63c216ee1176 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "DELETE /v2.0/networks/2fce066c-2512-4492-bf6b-6d63e1dba9d0 HTTP/1.1" status: 404 len: 339 time: 0.0310881 Dec 21 04:14:09.489884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5d0ae35-5646-4f32-b119-3d24c7a727c5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.490206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60892) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.517279 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-4397da82-e012-4fcb-82e8-a43e0a688ab5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] DELETE failed (client error): The resource could not be found. Dec 21 04:14:09.517954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4397da82-e012-4fcb-82e8-a43e0a688ab5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.524598 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4397da82-e012-4fcb-82e8-a43e0a688ab5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "DELETE /v2.0/ports/233eb9cc-be9b-4921-b94e-893868bc9308 HTTP/1.1" status: 404 len: 333 time: 0.0295956 Dec 21 04:14:09.524858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.550218 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b1eb8923-7a8f-4991-a0f6-b33ccce9a0ab tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] DELETE failed (client error): The resource could not be found. Dec 21 04:14:09.552578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b1eb8923-7a8f-4991-a0f6-b33ccce9a0ab tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.553887 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1eb8923-7a8f-4991-a0f6-b33ccce9a0ab tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "DELETE /v2.0/subnets/bbbd95d4-e107-4c0f-94c0-25fca69a22e3 HTTP/1.1" status: 404 len: 337 time: 0.0281026 Dec 21 04:14:09.558498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60896) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.579010 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-37d43265-24f3-4262-904c-94c6307c0bef tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] GET failed (client error): The resource could not be found. Dec 21 04:14:09.580298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-37d43265-24f3-4262-904c-94c6307c0bef tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "GET /v2.0/networks/0be8f3f8-10a8-4c4a-a13e-b3cd1ca0400b HTTP/1.1" status: 404 len: 339 time: 0.0207965 Dec 21 04:14:09.583978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60900) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.607584 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a16d328-4f41-4ddb-b074-838acce6eca6 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] GET failed (client error): The resource could not be found. Dec 21 04:14:09.609017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a16d328-4f41-4ddb-b074-838acce6eca6 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "GET /v2.0/ports/83ad5a98-85ac-49be-bac9-9eb29e180a7e HTTP/1.1" status: 404 len: 333 time: 0.0241344 Dec 21 04:14:09.613152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.624113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5d0ae35-5646-4f32-b119-3d24c7a727c5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.626656 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a5d0ae35-5646-4f32-b119-3d24c7a727c5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.627769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a5d0ae35-5646-4f32-b119-3d24c7a727c5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/cbfa05c6-96ea-4b4e-95ba-e260ac2de89e HTTP/1.1" status: 204 len: 168 time: 0.2660306 Dec 21 04:14:09.630528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.649477 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-41805705-b241-488a-a26a-95c0984d0362 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] GET failed (client error): The resource could not be found. Dec 21 04:14:09.650709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-41805705-b241-488a-a26a-95c0984d0362 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "GET /v2.0/subnets/83e0a0ea-920f-4664-b5b9-f2e156b5d764 HTTP/1.1" status: 404 len: 337 time: 0.0367174 Dec 21 04:14:09.656165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60906) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.661461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-724142bc-905b-46d2-89cd-1c31833c8d7a tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] Request body: {'network': {'name': 'new_name'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.665181 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d0ae35-5646-4f32-b119-3d24c7a727c5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbfa05c6-96ea-4b4e-95ba-e260ac2de89e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:09.677913 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-724142bc-905b-46d2-89cd-1c31833c8d7a tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] PUT failed (client error): The resource could not be found. Dec 21 04:14:09.678427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-724142bc-905b-46d2-89cd-1c31833c8d7a tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.679625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-724142bc-905b-46d2-89cd-1c31833c8d7a tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "PUT /v2.0/networks/8ffa60e7-2ecc-4427-a74a-cb87901c4ebc HTTP/1.1" status: 404 len: 339 time: 0.0222929 Dec 21 04:14:09.683927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60908) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.689169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ad0c3cd5-7715-4336-87a2-613610ad34ca tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] Request body: {'port': {'name': 'new_name'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.702567 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-607cb07f-1bbd-4d1f-a96e-eb918c82a150 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0707290 Dec 21 04:14:09.706421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.708014 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-ad0c3cd5-7715-4336-87a2-613610ad34ca tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] PUT failed (client error): The resource could not be found. Dec 21 04:14:09.708575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ad0c3cd5-7715-4336-87a2-613610ad34ca tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.709723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad0c3cd5-7715-4336-87a2-613610ad34ca tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "PUT /v2.0/ports/3c940e4a-8295-4cc3-a0b2-0299360f5716 HTTP/1.1" status: 404 len: 333 time: 0.0248694 Dec 21 04:14:09.712772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--494087264'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.715469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60912) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:09.722439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-21a7330e-bbbb-461f-ace4-90fdff234ed5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:09.754621 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-21a7330e-bbbb-461f-ace4-90fdff234ed5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] PUT failed (client error): The resource could not be found. Dec 21 04:14:09.754621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-21a7330e-bbbb-461f-ace4-90fdff234ed5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:09.754621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-21a7330e-bbbb-461f-ace4-90fdff234ed5 tempest-NetworksNegativeTestJSON-292170066 tempest-NetworksNegativeTestJSON-292170066-project] 10.222.0.18 "PUT /v2.0/subnets/c7c1f3f6-c751-44bb-b442-895d864720a9 HTTP/1.1" status: 404 len: 337 time: 0.0350173 Dec 21 04:14:09.907221 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:09.980681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.080269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7238e1d-60b2-4300-b8ea-ed20a775d2d4 req-eb71dcc9-9998-4d69-bbaf-e7cfc87b2731 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 210 time: 0.0290604 Dec 21 04:14:10.089420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b003f15-8613-4ae5-a0af-1d047525aff9 req-179096dd-a678-4cef-90ca-44ac475b72c3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:10.091040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b003f15-8613-4ae5-a0af-1d047525aff9 req-179096dd-a678-4cef-90ca-44ac475b72c3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0738590 Dec 21 04:14:10.102002 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.137561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=32239a0d-306d-4ea5-ba90-879a226da6fe,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:10.152026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b003f15-8613-4ae5-a0af-1d047525aff9 req-9fdb82a6-c059-4e34-b964-369b165a5394 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545576 Dec 21 04:14:10.200573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.201824 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21fdd32a-7f84-4a8f-aab8-714de5d6d9ef tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4942989 Dec 21 04:14:10.204566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.208983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cf5b14ed-14e6-4146-a516-b12e0b642f1b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.209456 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-cf5b14ed-14e6-4146-a516-b12e0b642f1b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 21 04:14:10.209936 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-cf5b14ed-14e6-4146-a516-b12e0b642f1b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.210839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf5b14ed-14e6-4146-a516-b12e0b642f1b tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0052717 Dec 21 04:14:10.213557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.217316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5e3d5faa-b985-44a7-a882-f93b8469ee1e tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.347893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60932) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.393018 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-5e3d5faa-b985-44a7-a882-f93b8469ee1e tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.401061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5e3d5faa-b985-44a7-a882-f93b8469ee1e tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1796865 Dec 21 04:14:10.401620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.407559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2cad0e52-8789-4ced-b913-4ba5ce764ca3 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.408201 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-2cad0e52-8789-4ced-b913-4ba5ce764ca3 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Dec 21 04:14:10.408787 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-2cad0e52-8789-4ced-b913-4ba5ce764ca3 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.413237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60942) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.413990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2cad0e52-8789-4ced-b913-4ba5ce764ca3 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0103307 Dec 21 04:14:10.419358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-001d2e5e-9c7b-4409-aca2-c83e7c649a95 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.480077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4db4329-de60-49ab-ba24-5c52b7e5ce7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.567352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4db4329-de60-49ab-ba24-5c52b7e5ce7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.635652 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-001d2e5e-9c7b-4409-aca2-c83e7c649a95 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.636909 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-001d2e5e-9c7b-4409-aca2-c83e7c649a95 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.2226374 Dec 21 04:14:10.646189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.651938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-64e57b9d-1433-412a-948d-993c075231dd tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.652487 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-64e57b9d-1433-412a-948d-993c075231dd tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 21 04:14:10.653032 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-64e57b9d-1433-412a-948d-993c075231dd tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.654056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-64e57b9d-1433-412a-948d-993c075231dd tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0065229 Dec 21 04:14:10.656939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60960) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.662219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7e76d305-da76-4655-be4c-206c8d9389dc tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.667236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f4db4329-de60-49ab-ba24-5c52b7e5ce7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.708815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4db4329-de60-49ab-ba24-5c52b7e5ce7a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=6994a2eac4f749ed97d593b8850cdc85&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3597422 Dec 21 04:14:10.709909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4db4329-de60-49ab-ba24-5c52b7e5ce7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b2cbea1-2e3b-4a20-901b-ed90c368fbb5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:10.712994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60966) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.771069 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1c6a0be-c06d-4b04-ad97-14bbf0201965 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.795080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1c6a0be-c06d-4b04-ad97-14bbf0201965 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.938332 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-7e76d305-da76-4655-be4c-206c8d9389dc tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.942101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7e76d305-da76-4655-be4c-206c8d9389dc tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2816103 Dec 21 04:14:10.942101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1c6a0be-c06d-4b04-ad97-14bbf0201965 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.942431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.943617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1c6a0be-c06d-4b04-ad97-14bbf0201965 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:10.951105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1c6a0be-c06d-4b04-ad97-14bbf0201965 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3b2cbea1-2e3b-4a20-901b-ed90c368fbb5 HTTP/1.1" status: 204 len: 168 time: 0.2267494 Dec 21 04:14:10.951240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8dd4df31-c37b-47c1-8dd7-c64c55b121b4 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:10.951240 n-d-822053-11 neutron-server[110311]: WARNING neutron.api.v2.base [None req-8dd4df31-c37b-47c1-8dd7-c64c55b121b4 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Dec 21 04:14:10.951240 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-8dd4df31-c37b-47c1-8dd7-c64c55b121b4 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:10.952214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8dd4df31-c37b-47c1-8dd7-c64c55b121b4 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0086012 Dec 21 04:14:10.955141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60976) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:10.956382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c6a0be-c06d-4b04-ad97-14bbf0201965 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b2cbea1-2e3b-4a20-901b-ed90c368fbb5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:10.961144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-83b443bb-8931-46f7-8a47-1abb8547d728 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:11.185852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f7d7c94-de80-4df9-b03b-2b14c2a7d0d3 req-9ced20b1-81ea-4a95-bf7c-be7e28d23d7a tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 210 time: 0.0271602 Dec 21 04:14:11.234912 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-83b443bb-8931-46f7-8a47-1abb8547d728 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:11.237344 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-83b443bb-8931-46f7-8a47-1abb8547d728 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.2791986 Dec 21 04:14:11.244665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 60982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:11.249346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f1a8bf5b-82cb-4c84-99bf-a4fd8c440f04 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '32239a0d-306d-4ea5-ba90-879a226da6fe', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:11.293289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd0f7ec-75fb-4e50-b364-8a8c07785403 req-f9c3a29d-3ded-49c4-bfc5-2c5c8af2e4c3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:11.294774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdd0f7ec-75fb-4e50-b364-8a8c07785403 req-f9c3a29d-3ded-49c4-bfc5-2c5c8af2e4c3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0483537 Dec 21 04:14:11.357596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdd0f7ec-75fb-4e50-b364-8a8c07785403 req-a146eb2e-9d87-40c8-9113-9e9cb3bbef83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558004 Dec 21 04:14:11.442032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d16219bf-486f-4cf1-9492-6809b60b1da7 req-a442a21a-3b4f-447f-bccc-4f996ef30590 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:11.443549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d16219bf-486f-4cf1-9492-6809b60b1da7 req-a442a21a-3b4f-447f-bccc-4f996ef30590 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.0723875 Dec 21 04:14:11.520502 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-f1a8bf5b-82cb-4c84-99bf-a4fd8c440f04 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:11.526749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f1a8bf5b-82cb-4c84-99bf-a4fd8c440f04 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2758546 Dec 21 04:14:11.529266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b668b90-3fd2-49b0-b446-1951d8edf940 req-3fa7246d-4dce-4c7e-8150-ea731101e6e3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:11.530890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b668b90-3fd2-49b0-b446-1951d8edf940 req-3fa7246d-4dce-4c7e-8150-ea731101e6e3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0863507 Dec 21 04:14:11.534978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60996) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:11.558289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d16219bf-486f-4cf1-9492-6809b60b1da7 req-a04ca2af-401a-44a5-af9b-65f94adf628f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050670 Dec 21 04:14:11.627736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-92120cca-9a8e-4b54-8585-2ea5338a3045 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:11.629231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-92120cca-9a8e-4b54-8585-2ea5338a3045 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "GET /v2.0/networks?id=5a8c4312-b76b-442d-aa89-ba658f5e54a8 HTTP/1.1" status: 200 len: 809 time: 0.1235652 Dec 21 04:14:11.636209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b668b90-3fd2-49b0-b446-1951d8edf940 req-9a1de15d-2bff-4499-825a-a229db5ad3e5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0895481 Dec 21 04:14:11.642814 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8c05cbb-d494-4fcb-8a0a-a8c7d1993f03 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:11.666672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Request body: {'port': {'device_id': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8', 'admin_state_up': True, 'tenant_id': '247cb1d10db0451abe7903925d39ba07'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:11.669518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 60998) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:11.680404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8c05cbb-d494-4fcb-8a0a-a8c7d1993f03 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:11.735626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebf7f6db-7bb9-4571-a181-600a4e214f53 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:11.737068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ebf7f6db-7bb9-4571-a181-600a4e214f53 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1092 time: 0.0666130 Dec 21 04:14:11.740077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32770) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:11.744475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address': '172.20.0.3'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:11.857983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8c05cbb-d494-4fcb-8a0a-a8c7d1993f03 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:11.860584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8c05cbb-d494-4fcb-8a0a-a8c7d1993f03 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:11.861743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a8c05cbb-d494-4fcb-8a0a-a8c7d1993f03 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/32239a0d-306d-4ea5-ba90-879a226da6fe HTTP/1.1" status: 204 len: 168 time: 0.3255780 Dec 21 04:14:11.864504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32772) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:11.871006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c05cbb-d494-4fcb-8a0a-a8c7d1993f03 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=32239a0d-306d-4ea5-ba90-879a226da6fe,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:11.907251 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-856b32e7-c28b-44e5-b667-689b69bf3ad8 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0415471 Dec 21 04:14:11.911395 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:11.913552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32774) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:11.920197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--2137497204'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:12.028870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.029143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Made reservation on behalf of 247cb1d10db0451abe7903925d39ba07 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:12.032702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.149743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.137 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/88d82c11-2a48-49ee-b607-2bfc7e02c0ad) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:12.173903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Allocated IP 172.20.0.6 (5a8c4312-b76b-442d-aa89-ba658f5e54a8/79a84c6f-589d-401b-8841-bdeddbc4ba1d/48af1302-c6b8-44fc-a6e4-6f2b88f33a6c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:12.187997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.294186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32786) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:12.321434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.324992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a09897f-3e35-418a-969e-f8ad68085c19 req-9fe723fb-311e-4f5f-9521-5865f2fc63a2 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 210 time: 0.0525634 Dec 21 04:14:12.358056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.366379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.408719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1525457671'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:12.449830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.473275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.475843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.503636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aff770f8-5bca-4553-aae6-8e258aa469c6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:12.514189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:12.517578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.530391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:12.534331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:12.535397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.536968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:12.540192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=88d82c11-2a48-49ee-b607-2bfc7e02c0ad,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:12.546247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:12.555159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:12.564158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.564477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:12.567597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4859839c-65a1-4814-87ab-d7c7c5d3e5fe tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.6498141 Dec 21 04:14:12.567755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Pushing event updated for resources: {'Port': ['ID=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:12.568951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32790) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:12.575638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-81c18d08-32a0-4723-b04e-4aa1fdef13ac tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'aff770f8-5bca-4553-aae6-8e258aa469c6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:12.645512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:12.646150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.693314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.735400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-1329b685-3a6a-4653-97f5-f2ccb0f96b90 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0866005 Dec 21 04:14:12.753975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Request body: {'port': {'device_id': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:12.786207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.834191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:12.862646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.863125 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment 75507f0b-0fef-4b21-8254-08a0df754f10 of type vlan for network bcf1b1c3-e446-4833-886a-d47191e91971 Dec 21 04:14:12.865281 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:12.867374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be626ed3-e913-4e6a-a703-adb5034f20d3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:12.945887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.040236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3e68b6-b605-4df5-baae-19c9a2f8610a req-fe91d7d5-bc67-4760-b693-92e280b57bec tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:13.042289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e3e68b6-b605-4df5-baae-19c9a2f8610a req-fe91d7d5-bc67-4760-b693-92e280b57bec tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.3840981 Dec 21 04:14:13.073098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-21e6608e-63bd-4483-b38f-945164609440 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:13.074579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-21e6608e-63bd-4483-b38f-945164609440 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.1689646 Dec 21 04:14:13.076545 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.089404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:13.089404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.137728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e3e68b6-b605-4df5-baae-19c9a2f8610a req-03a0f3d3-84f6-4251-be0b-c0c02af2cbf0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867915 Dec 21 04:14:13.147291 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-81c18d08-32a0-4723-b04e-4aa1fdef13ac tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The resource could not be found. Dec 21 04:14:13.147862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-81c18d08-32a0-4723-b04e-4aa1fdef13ac tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.5779920 Dec 21 04:14:13.152086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:13.156535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9f56260a-3bd1-4e6b-b6f7-80283d45d9b9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'aff770f8-5bca-4553-aae6-8e258aa469c6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': '08e4ec69-f4f2-43a2-95c0-ef9361aaf87d'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:13.288786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=bcf1b1c3-e446-4833-886a-d47191e91971,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:13.297401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90de00fe-52a0-4ba7-b4e3-fee07964b1fb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 1.0022013 Dec 21 04:14:13.300600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32796) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:13.303296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:13.305289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'name': 'tempest-PortsTestJSON-392890069'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:13.458337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Deleting port cc520175-7567-482f-b183-4c12d93544ce {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:13.458675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.514603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.556185 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-9f56260a-3bd1-4e6b-b6f7-80283d45d9b9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The resource could not be found. Dec 21 04:14:13.557251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f56260a-3bd1-4e6b-b6f7-80283d45d9b9 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.4042337 Dec 21 04:14:13.561237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32800) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:13.569857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-369d6524-f06b-4b44-867a-8ab17b4db484 req-31b5cdcb-173a-4dc5-b01e-435cb4bafbeb tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:13.571410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-369d6524-f06b-4b44-867a-8ab17b4db484 req-31b5cdcb-173a-4dc5-b01e-435cb4bafbeb tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 931 time: 0.1349812 Dec 21 04:14:13.591559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:14:13.606722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:13.610206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.618485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.645020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-369d6524-f06b-4b44-867a-8ab17b4db484 req-80ad6669-2908-46ed-91f1-1751f959bbb6 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663121 Dec 21 04:14:13.670295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Transition to ACTIVE for port object 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:14:13.677237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] For port cc520175-7567-482f-b183-4c12d93544ce, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cc520175-7567-482f-b183-4c12d93544ce,segment=NetworkSegment(d4018761-5441-4eba-87c7-cb96ec8da5a9),segment_id=d4018761-5441-4eba-87c7-cb96ec8da5a9)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:13.677237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.677237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 6db3a24f-d841-4101-8985-34354a1280f9 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:13.699860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Calling delete_port for cc520175-7567-482f-b183-4c12d93544ce owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:13.734133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.742700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4091cbad-9a84-4a4d-a015-bb6d99ded3d7 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.803317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.850665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4091cbad-9a84-4a4d-a015-bb6d99ded3d7 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.889365 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:13.992692 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.067844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=88d82c11-2a48-49ee-b607-2bfc7e02c0ad,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:14.081895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.193693 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a associated. External IP: 172.25.5.137, port: a1a159da-8ede-44a2-8929-065e82a2dee0. Dec 21 04:14:14.269103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Pushing event updated for resources: {'Port': ['ID=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:14.332281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84fd4d9a-69e3-42a1-b900-71d03a5abc93 req-cfb66735-7ad8-419c-9547-debd918bf8f0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:14.333837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84fd4d9a-69e3-42a1-b900-71d03a5abc93 req-cfb66735-7ad8-419c-9547-debd918bf8f0 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 945 time: 0.1033204 Dec 21 04:14:14.400525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.430186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84fd4d9a-69e3-42a1-b900-71d03a5abc93 req-fc21a101-c045-4380-9161-6c4e5046265f tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/security-groups?id=c66accb0-bef4-4efd-8c64-1ac468371fd8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885000 Dec 21 04:14:14.452140 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4091cbad-9a84-4a4d-a015-bb6d99ded3d7 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.452256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4091cbad-9a84-4a4d-a015-bb6d99ded3d7 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.453292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4091cbad-9a84-4a4d-a015-bb6d99ded3d7 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/aff770f8-5bca-4553-aae6-8e258aa469c6 HTTP/1.1" status: 204 len: 168 time: 0.8890915 Dec 21 04:14:14.463142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32804) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:14.483855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Attempting to bind port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:14.484191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Attempting to bind port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:14.484524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Attempting to bind port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c on network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:14.491810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4091cbad-9a84-4a4d-a015-bb6d99ded3d7 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aff770f8-5bca-4553-aae6-8e258aa469c6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:14.500860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c on network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:14:14.501208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Attempting to bind port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c on network 5a8c4312-b76b-442d-aa89-ba658f5e54a8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:14.510087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:14.510429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Checking segment: {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:14.510818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Bound using segment: {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:14.511287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Bound port: 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:14.511652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.522605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:14:14.527456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-431a9725-62db-4bab-b8da-1e5ae96c72de tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0632801 Dec 21 04:14:14.531210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32806) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:14.536476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3bc1f0a9-17bf-4f47-9d52-a41b10282935 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': '36bf4bd9-579f-45e4-9345-aae0c62689ee', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:14.551759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.584609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cc520175-7567-482f-b183-4c12d93544ce'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:14.593711 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.596476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Pushing event deleted for resources: {'Port': ['ID=cc520175-7567-482f-b183-4c12d93544ce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:14.624322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ff2c913-73a6-48bd-a084-eb2f3b294ba7 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:14.688312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:14:14.693260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] No DVR routers for this DVR port cc520175-7567-482f-b183-4c12d93544ce on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:14.699067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] For port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:14.703100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.705229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] Sync routers for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:14:14.705381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2a608306-c1ea-41a7-aae6-274b399c79b6 req-e14e5059-90bc-4a2c-a740-f4ac4b9c4f9b tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.54 "DELETE /v2.0/ports/cc520175-7567-482f-b183-4c12d93544ce HTTP/1.1" status: 204 len: 173 time: 1.6133089 Dec 21 04:14:14.707302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e729315-fba6-48de-be23-a59b45172796', 'name': 'network-vif-deleted', 'tag': 'cc520175-7567-482f-b183-4c12d93544ce'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:14.709695 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-416dd7f4-20a0-4d4a-9c50-c717533c3e98" -d '{"events": [{"server_uuid": "4e729315-fba6-48de-be23-a59b45172796", "name": "network-vif-deleted", "tag": "cc520175-7567-482f-b183-4c12d93544ce"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:14.731609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] For port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:14.732683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:14.733433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:14.734690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=6db3a24f-d841-4101-8985-34354a1280f9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:14.752924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': '75507f0b-0fef-4b21-8254-08a0df754f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:14.753373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: bcf1b1c3-e446-4833-886a-d47191e91971, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:14.757719 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61d20026-f38f-434d-a174-c932286fb05b x-openstack-request-id: req-61d20026-f38f-434d-a174-c932286fb05b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:14.758013 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e729315-fba6-48de-be23-a59b45172796", "name": "network-vif-deleted", "tag": "cc520175-7567-482f-b183-4c12d93544ce", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:14.758265 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-61d20026-f38f-434d-a174-c932286fb05b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:14.758669 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e729315-fba6-48de-be23-a59b45172796', 'name': 'network-vif-deleted', 'tag': 'cc520175-7567-482f-b183-4c12d93544ce', 'status': 'completed', 'code': 200} Dec 21 04:14:14.788908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.809074 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.814337 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-3bc1f0a9-17bf-4f47-9d52-a41b10282935 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The resource could not be found. Dec 21 04:14:14.818802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3bc1f0a9-17bf-4f47-9d52-a41b10282935 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2832720 Dec 21 04:14:14.820362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32812) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:14.828441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--1353707134'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:14.838215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9a621d-ca70-43e3-9876-27a9179eba0e req-6eb83e54-8d1c-4ced-b255-586b6f3b332e tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:14.839856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9a621d-ca70-43e3-9876-27a9179eba0e req-6eb83e54-8d1c-4ced-b255-586b6f3b332e tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 943 time: 0.1010051 Dec 21 04:14:14.843828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c11b3879-4e17-4752-8a78-158b4675d6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.1003897 Dec 21 04:14:14.843828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:14.844588 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56b4caaa-93a2-4b23-937d-575b1812a3d0" -d '{"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:14.866625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:14.867272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:14.869609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] 10.222.0.54 "PUT /v2.0/ports/48af1302-c6b8-44fc-a6e4-6f2b88f33a6c HTTP/1.1" status: 200 len: 1092 time: 2.1194630 Dec 21 04:14:14.886112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:14.893623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:14.911350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c1df9e-0c1d-46f6-9b89-592eaa6316ef service neutron] Pushing event updated for resources: {'Port': ['ID=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:14.928668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9a621d-ca70-43e3-9876-27a9179eba0e req-6d24fb83-00be-4f8b-a1ba-aa27799dc7a1 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697880 Dec 21 04:14:15.000284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9438fb0-24d1-4cbf-8551-ee5dc4ca9179 req-50a2a217-2fac-4997-aca6-cd3871de74b2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.002014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9438fb0-24d1-4cbf-8551-ee5dc4ca9179 req-50a2a217-2fac-4997-aca6-cd3871de74b2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0732183 Dec 21 04:14:15.009013 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13f69904-2a4b-47a9-a5c0-312a77411c6f x-openstack-request-id: req-13f69904-2a4b-47a9-a5c0-312a77411c6f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:15.009460 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:15.009748 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-13f69904-2a4b-47a9-a5c0-312a77411c6f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:15.010162 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'status': 'completed', 'code': 200} Dec 21 04:14:15.018594 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.020440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, bcf1b1c3-e446-4833-886a-d47191e91971) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:15.042883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:15.045548 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:15.051036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.051036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.051299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-924a4f51-849f-4b5d-a35f-2b58fee620cd None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:15.088128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9438fb0-24d1-4cbf-8551-ee5dc4ca9179 req-40815cab-6857-4975-88d1-e00bc3e14143 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0754051 Dec 21 04:14:15.100347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-7c93cad8-7ae8-4c52-86c3-5b6621392737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.101896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-7c93cad8-7ae8-4c52-86c3-5b6621392737 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=247cb1d10db0451abe7903925d39ba07&device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 1095 time: 0.0941241 Dec 21 04:14:15.128205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-28256f4f-b20a-4699-b5b5-38fdee395a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.128997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32818) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:15.129578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-28256f4f-b20a-4699-b5b5-38fdee395a28 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1097 time: 0.0537701 Dec 21 04:14:15.173403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-6beab777-821a-4e74-89b3-f62b7785d9b4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c HTTP/1.1" status: 200 len: 217 time: 0.0527403 Dec 21 04:14:15.255464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0771a950-a0b3-4f43-a505-0fc28ec6d436 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 1.9509778 Dec 21 04:14:15.264416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32820) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:15.282908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1113222298'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:15.298756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.137', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'port_id': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 3360, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'mac_address': 'fa:16:3e:b0:51:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615aae36-683b-40bc-bda6-de53bf692e14', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:14:13Z', 'updated_at': '2021-12-21T04:14:13Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:57Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:15.305408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.324423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-02f7c14b-f597-4cc9-be3c-2d6555357ac5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a HTTP/1.1" status: 200 len: 991 time: 0.1928563 Dec 21 04:14:15.327669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84803a4-003e-4705-9e2a-888567701f81 req-5541f561-8d99-4e1d-ac36-7fe830066f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.329243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-5541f561-8d99-4e1d-ac36-7fe830066f6f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=79a84c6f-589d-401b-8841-bdeddbc4ba1d HTTP/1.1" status: 200 len: 849 time: 0.1151528 Dec 21 04:14:15.332100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] Checking router: 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:14:15.342436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:15.343100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:13:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:15.371632 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-7528bc17-a7d2-420b-9266-34fac9287003 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5a8c4312-b76b-442d-aa89-ba658f5e54a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0323610 Dec 21 04:14:15.440357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.460450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:15.482363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:15.486597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.517989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-7603e78b-0fdb-43fa-84fc-5eebcaa67991 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.519820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-7603e78b-0fdb-43fa-84fc-5eebcaa67991 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.3830807 Dec 21 04:14:15.545878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cebbf9cb-b68b-4165-bb3b-2445da297dad,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:15.552677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:15.556888 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-dd61b395-81a4-4ffe-a9c7-b6cd10e10430 service neutron] 10.222.0.54 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1769452 Dec 21 04:14:15.566831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.567215 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment df3c708f-a8b7-41e8-9a49-38eba1075b2a of type vlan for network 44e75a85-3908-4548-a11f-c28657d578d8 Dec 21 04:14:15.644245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b82a38af-0b69-470b-b2fe-73392576e60b req-990602d2-cd82-43f8-b0b2-5c6dd574a2b9 tempest-ServersTestJSON-1609570472 tempest-ServersTestJSON-1609570472-project] 10.222.0.18 "GET /v2.0/ports?device_id=4e729315-fba6-48de-be23-a59b45172796 HTTP/1.1" status: 200 len: 210 time: 0.0543358 Dec 21 04:14:15.656312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-f4d699aa-a0fd-48d6-80e6-722b65a6ef4c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 999 time: 0.1282620 Dec 21 04:14:15.672994 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.674242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f8b053e9-e89b-4fe6-a284-201408d56baa tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.8528266 Dec 21 04:14:15.680754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32824) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:15.682241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.690975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--1389283197'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:15.726056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-219462c3-c1a1-4ac7-82ea-c1ed1fc849c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.727559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-219462c3-c1a1-4ac7-82ea-c1ed1fc849c7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0542352 Dec 21 04:14:15.743711 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a84803a4-003e-4705-9e2a-888567701f81 req-d4ce5b9c-c78c-4f86-ab90-e617a45e693c service neutron] 10.222.0.54 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1778696 Dec 21 04:14:15.778146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-f20c7374-132c-425e-a093-bb4c54818993 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.779714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-f20c7374-132c-425e-a093-bb4c54818993 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0448966 Dec 21 04:14:15.840816 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.849492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:15.850691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.882401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:15.894472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-27221e14-924e-4f7b-8f30-fc4e6c27eb6e service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077824 Dec 21 04:14:15.904520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.137', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'port_id': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 3360, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'mac_address': 'fa:16:3e:b0:51:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615aae36-683b-40bc-bda6-de53bf692e14', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:14:13Z', 'updated_at': '2021-12-21T04:14:13Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:57Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:15.937242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b44c28d-f073-4842-a4bb-b598e5b4702d None None] The sync data for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 is: [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.137', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'port_id': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 3360, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'mac_address': 'fa:16:3e:b0:51:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '615aae36-683b-40bc-bda6-de53bf692e14', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:14:13Z', 'updated_at': '2021-12-21T04:14:13Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:57Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:14:15.959787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=44e75a85-3908-4548-a11f-c28657d578d8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:15.973518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 44e75a85-3908-4548-a11f-c28657d578d8 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:15.994917 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-34834e1b-12ae-4c1a-8ea2-ab93b15be56a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7190430 Dec 21 04:14:15.997651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:16.012902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'ports': [{'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'}, {'network_id': '44e75a85-3908-4548-a11f-c28657d578d8'}]} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:16.013273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:16.013763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '44e75a85-3908-4548-a11f-c28657d578d8'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:16.036229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56b4caaa-93a2-4b23-937d-575b1812a3d0 req-e1a025b8-a71a-4c4e-992a-deca4bef77ed service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301048 Dec 21 04:14:16.108212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491eb0c0-ad0f-450a-8c29-72b895a3db1e req-6a324fdf-9924-45ff-9e7d-420e5f05f4f2 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:16.109871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-491eb0c0-ad0f-450a-8c29-72b895a3db1e req-6a324fdf-9924-45ff-9e7d-420e5f05f4f2 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 943 time: 0.0630476 Dec 21 04:14:16.132258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.172037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-491eb0c0-ad0f-450a-8c29-72b895a3db1e req-c326dcd2-eb23-4ea3-9495-f934b2deef43 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538497 Dec 21 04:14:16.207675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54c30b2b-ed75-42d2-844d-1ae7bb386371 None None] New status for floating IP bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:14:16.251104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.284320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c9bb3c2b-8be2-4bdb-ad50-106cde051467,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:16.315101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 2} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:16.319858 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.327283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32830) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:16.337147 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.415684 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.417274 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f1f996d-e014-41d0-9670-aea2a87b220d tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.7325361 Dec 21 04:14:16.420350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32832) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:16.424940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6d86701b-5440-44bc-a314-da739d2e10cf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group_rule': {'security_group_id': 'cebbf9cb-b68b-4165-bb3b-2445da297dad', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': 'c9bb3c2b-8be2-4bdb-ad50-106cde051467'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:16.445295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 092d3386-b784-4ad6-919b-61c419adcb98 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:16.457391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-83de1bf3-1143-4ce4-8ea9-332f625fef8e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a HTTP/1.1" status: 200 len: 991 time: 0.1286042 Dec 21 04:14:16.579042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.605147 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-6d86701b-5440-44bc-a314-da739d2e10cf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:16.606293 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d86701b-5440-44bc-a314-da739d2e10cf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.1848078 Dec 21 04:14:16.609163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32834) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:16.655474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port bb1c3392-03c8-433a-9560-b74a357db4af yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:16.665832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67b0dd19-9414-4c13-9eb4-40b1babe6b91 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.691938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67b0dd19-9414-4c13-9eb4-40b1babe6b91 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.712121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32838) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:16.763474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'tag': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:16.766326 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7" -d '{"events": [{"name": "network-changed", "server_uuid": "3b51db5d-e0f3-4566-b06c-9e161cc32a62", "tag": "48af1302-c6b8-44fc-a6e4-6f2b88f33a6c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:16.771655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Deleting subnet 59294161-9bfc-416e-a51d-c4b1c78a016d {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:14:16.772915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.775428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.805838 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e18a6c1f-984e-44af-9a4c-07f1c839f16c x-openstack-request-id: req-e18a6c1f-984e-44af-9a4c-07f1c839f16c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:16.806133 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3b51db5d-e0f3-4566-b06c-9e161cc32a62", "tag": "48af1302-c6b8-44fc-a6e4-6f2b88f33a6c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:16.806393 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e18a6c1f-984e-44af-9a4c-07f1c839f16c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:16.806797 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'tag': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c', 'status': 'completed', 'code': 200} Dec 21 04:14:16.814602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.859522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.878726 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67b0dd19-9414-4c13-9eb4-40b1babe6b91 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.881333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-67b0dd19-9414-4c13-9eb4-40b1babe6b91 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.882675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-67b0dd19-9414-4c13-9eb4-40b1babe6b91 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/c9bb3c2b-8be2-4bdb-ad50-106cde051467 HTTP/1.1" status: 204 len: 168 time: 0.2720854 Dec 21 04:14:16.885826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32842) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:16.900202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b0dd19-9414-4c13-9eb4-40b1babe6b91 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9bb3c2b-8be2-4bdb-ad50-106cde051467,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:16.912076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:16.923790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-42d412b1-3321-4780-9282-380307f76e69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:16.925271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-42d412b1-3321-4780-9282-380307f76e69 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=247cb1d10db0451abe7903925d39ba07&device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 1095 time: 0.0712759 Dec 21 04:14:17.011001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:17.020406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:17.022899 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.050976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=092d3386-b784-4ad6-919b-61c419adcb98,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.053199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=59294161-9bfc-416e-a51d-c4b1c78a016d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.056144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:17.056289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.056988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.060335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd8abb1a-b21b-4981-b118-c3675391ac0f None None] Network 800834e6-2709-4cb2-81c2-4c16d3d000fa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:17.063165 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c3012aef-79d7-4c1c-907f-f27fdacc90d0 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1753523 Dec 21 04:14:17.066259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ff7bf0ed-78d4-4d60-817b-6efaa0f154e6 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/59294161-9bfc-416e-a51d-c4b1c78a016d HTTP/1.1" status: 204 len: 168 time: 0.3531163 Dec 21 04:14:17.067175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32844) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:17.069027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32846) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:17.139614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=bb1c3392-03c8-433a-9560-b74a357db4af,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.153345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-eacd59de-5be1-4244-b67e-2656c23c31cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:17.154819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-eacd59de-5be1-4244-b67e-2656c23c31cb service neutron] 10.222.0.54 "GET /v2.0/networks?id=5a8c4312-b76b-442d-aa89-ba658f5e54a8 HTTP/1.1" status: 200 len: 910 time: 0.2004342 Dec 21 04:14:17.163350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': 'df3c708f-a8b7-41e8-9a49-38eba1075b2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '44e75a85-3908-4548-a11f-c28657d578d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:17.163711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: 44e75a85-3908-4548-a11f-c28657d578d8, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:17.184464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37b0b59f-6def-4071-b006-9c429deee180 None None] DHCP port deletion for 800834e6-2709-4cb2-81c2-4c16d3d000fa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:17.184923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.205500 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-7a824482-1cf7-4850-9ddb-42a6b1349464 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c HTTP/1.1" status: 200 len: 217 time: 0.0435340 Dec 21 04:14:17.207250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a8fa172-e357-43a7-ab6d-a362db525a90 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.256502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a8fa172-e357-43a7-ab6d-a362db525a90 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.264553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-dccbdfbf-8a02-4375-9dcf-a6018fbf4060 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:17.266029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-dccbdfbf-8a02-4375-9dcf-a6018fbf4060 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=79a84c6f-589d-401b-8841-bdeddbc4ba1d HTTP/1.1" status: 200 len: 849 time: 0.0528183 Dec 21 04:14:17.299781 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-830e46d9-a3f4-432a-a386-649d723fab7f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5a8c4312-b76b-442d-aa89-ba658f5e54a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262535 Dec 21 04:14:17.300407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 44e75a85-3908-4548-a11f-c28657d578d8 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:17.353633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.368114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 44e75a85-3908-4548-a11f-c28657d578d8) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:17.374253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:17.376864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77495942-7342-4f4b-a759-5cf865ef4ab5 None None] Network 44e75a85-3908-4548-a11f-c28657d578d8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:17.385142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:17.389319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['800834e6-2709-4cb2-81c2-4c16d3d000fa']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:17.390274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:17.391929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.404848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4018761-5441-4eba-87c7-cb96ec8da5a9') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:17.405156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4018761-5441-4eba-87c7-cb96ec8da5a9') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:17.414247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34abb66-7762-44da-8015-417bd0082c3f req-d8e01484-3fd1-4e23-ab32-98cde8680c91 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:17.417285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e34abb66-7762-44da-8015-417bd0082c3f req-d8e01484-3fd1-4e23-ab32-98cde8680c91 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 943 time: 0.1555662 Dec 21 04:14:17.422707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-8dbe996f-13f3-44b7-9b97-6e976a554095 service neutron] 10.222.0.54 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1120501 Dec 21 04:14:17.427085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.454736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.461867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32850) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:17.479446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:14:17.479745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.496329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:14:17.501714 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3731a2af-18d0-4a39-9303-dd8e1f9a69c9 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 1.5002594 Dec 21 04:14:17.505529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cc520175-7567-482f-b183-4c12d93544ce no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:17.505657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32852) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:14:17.512039 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:14:17.533159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: cc520175-7567-482f-b183-4c12d93544ce {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:17.533961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cc520175-7567-482f-b183-4c12d93544ce not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:17.546205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a8fa172-e357-43a7-ab6d-a362db525a90 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.548849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a8fa172-e357-43a7-ab6d-a362db525a90 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.552508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a8fa172-e357-43a7-ab6d-a362db525a90 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/cebbf9cb-b68b-4165-bb3b-2445da297dad HTTP/1.1" status: 204 len: 168 time: 0.4818344 Dec 21 04:14:17.560913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32854) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:17.586436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e34abb66-7762-44da-8015-417bd0082c3f req-6934b91b-4b5c-40a8-9cdb-bcf9b484a8fc tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1573477 Dec 21 04:14:17.599690 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1c90c1df-3223-4ccd-ba56-2ffd90b5eae7 req-1e5f1604-6f9c-4fb5-a053-3c94e0b2a4ce service neutron] 10.222.0.54 "GET /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1702921 Dec 21 04:14:17.615782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a8fa172-e357-43a7-ab6d-a362db525a90 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cebbf9cb-b68b-4165-bb3b-2445da297dad,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.642660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c714331f-8f76-470c-9ff4-bc75344fc9b2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a HTTP/1.1" status: 200 len: 993 time: 0.1786861 Dec 21 04:14:17.654990 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ab88f736-a6c3-4632-8f48-adaaffa77ee1 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0885334 Dec 21 04:14:17.659977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32856) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:17.660150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:17.661566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'tempest-secgroup--738931518'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:17.662141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port bb1c3392-03c8-433a-9560-b74a357db4af {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:17.663211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.679033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c', 'network_id': '5a8c4312-b76b-442d-aa89-ba658f5e54a8', 'port_id': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c', 'mac_address': 'fa:16:3e:19:ca:9d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79a84c6f-589d-401b-8841-bdeddbc4ba1d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:14:17.707308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.713084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.725011 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] 10.222.0.18 "DELETE /v2.0/networks/800834e6-2709-4cb2-81c2-4c16d3d000fa HTTP/1.1" status: 204 len: 168 time: 0.6414239 Dec 21 04:14:17.725919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.734046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:14:17.734811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f94d23d-9d80-4e54-8e63-4ea9843e9337 admin admin] Pushing event deleted for resources: {'Network': ['ID=800834e6-2709-4cb2-81c2-4c16d3d000fa,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.747397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.758062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:17.764136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for bb1c3392-03c8-433a-9560-b74a357db4af owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:17.772364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.836030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.844262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.888685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.918243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.947341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.950995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a936dd5b-32c7-40f0-9862-d6f7f984ce13,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.978319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=bb1c3392-03c8-433a-9560-b74a357db4af,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:17.985149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:17.989065 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c55b6fa-bf83-4021-b8bf-d8f500279295 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/bb1c3392-03c8-433a-9560-b74a357db4af HTTP/1.1" status: 204 len: 168 time: 0.4835691 Dec 21 04:14:17.991460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32860) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.024131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.025603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8675006f-b122-4361-b6e2-d456cef07ccf tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3687353 Dec 21 04:14:18.028411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32862) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.033053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-faf35cc6-23a3-44ab-9252-15334b43227f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Request body: {'security_group': {'name': 'default'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:18.033420 n-d-822053-11 neutron-server[110310]: WARNING neutron.api.v2.base [None req-faf35cc6-23a3-44ab-9252-15334b43227f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 21 04:14:18.033905 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-faf35cc6-23a3-44ab-9252-15334b43227f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] update failed (client error): There was a conflict when trying to complete your request. Dec 21 04:14:18.037246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-faf35cc6-23a3-44ab-9252-15334b43227f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "PUT /v2.0/security-groups/a936dd5b-32c7-40f0-9862-d6f7f984ce13 HTTP/1.1" status: 409 len: 330 time: 0.0055106 Dec 21 04:14:18.044611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32864) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.044729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ba32d72-145d-439b-9b5d-1fa88059d5cd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:18.049659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ba32d72-145d-439b-9b5d-1fa88059d5cd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:18.051286 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6ba32d72-145d-439b-9b5d-1fa88059d5cd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1451 time: 0.0588777 Dec 21 04:14:18.054021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.096790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92a7fb7d-4fbf-4d68-bb75-e945ea50a10f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.106370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['48af1302-c6b8-44fc-a6e4-6f2b88f33a6c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:18.120945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92a7fb7d-4fbf-4d68-bb75-e945ea50a10f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.145516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 092d3386-b784-4ad6-919b-61c419adcb98 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:18.145913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.178597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32868) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.227116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92a7fb7d-4fbf-4d68-bb75-e945ea50a10f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.230208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.230889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92a7fb7d-4fbf-4d68-bb75-e945ea50a10f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.232194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-92a7fb7d-4fbf-4d68-bb75-e945ea50a10f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/a936dd5b-32c7-40f0-9862-d6f7f984ce13 HTTP/1.1" status: 204 len: 168 time: 0.1933856 Dec 21 04:14:18.235592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.250132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a7fb7d-4fbf-4d68-bb75-e945ea50a10f tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a936dd5b-32c7-40f0-9862-d6f7f984ce13,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:18.255585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 092d3386-b784-4ad6-919b-61c419adcb98 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:18.275137 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-009a8ff3-20c2-448a-bfbb-b28d84d50788 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=4e189e2b3dc14c41a4d5a480b6c44355&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0948596 Dec 21 04:14:18.277748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32872) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.316990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4578782e-5f0b-4d34-be4e-676625275bd5 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0789361 Dec 21 04:14:18.320798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32874) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.343444 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-60b350b2-382a-4955-a170-cd4bafce9448 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] delete failed (client error): The resource could not be found. Dec 21 04:14:18.344448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-60b350b2-382a-4955-a170-cd4bafce9448 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "DELETE /v2.0/security-groups/63481986-fb4a-4f3a-a601-2ac56295a57f HTTP/1.1" status: 404 len: 347 time: 0.0227015 Dec 21 04:14:18.345612 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c030d38f-3946-4f1b-b891-7b3f2e047be2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.348652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32876) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.372138 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-3dc8f5d5-34a9-4283-8bfe-6a9867f18486 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] show failed (client error): The resource could not be found. Dec 21 04:14:18.373169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3dc8f5d5-34a9-4283-8bfe-6a9867f18486 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-groups/882558fb-9032-4542-be7e-51ca56da4698 HTTP/1.1" status: 404 len: 347 time: 0.0237520 Dec 21 04:14:18.376952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.381501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c030d38f-3946-4f1b-b891-7b3f2e047be2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.388011 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-84c41e12-11c5-46d7-b036-5855dc3d8fa8 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] show failed (client error): The resource could not be found. Dec 21 04:14:18.389013 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84c41e12-11c5-46d7-b036-5855dc3d8fa8 tempest-NegativeSecGroupTest-1660958487 tempest-NegativeSecGroupTest-1660958487-project] 10.222.0.18 "GET /v2.0/security-group-rules/e6bd970f-0353-46aa-8489-fdae094b1b1f HTTP/1.1" status: 404 len: 356 time: 0.0111144 Dec 21 04:14:18.429073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.459857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=092d3386-b784-4ad6-919b-61c419adcb98,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:18.464033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.469796 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ebbd335-4f8a-44de-8bf9-63ac59aaf80f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/092d3386-b784-4ad6-919b-61c419adcb98 HTTP/1.1" status: 204 len: 168 time: 0.4125054 Dec 21 04:14:18.470107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32882) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.500643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c030d38f-3946-4f1b-b891-7b3f2e047be2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.503721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c030d38f-3946-4f1b-b891-7b3f2e047be2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.505289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c030d38f-3946-4f1b-b891-7b3f2e047be2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c66accb0-bef4-4efd-8c64-1ac468371fd8 HTTP/1.1" status: 204 len: 168 time: 0.2251410 Dec 21 04:14:18.513717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c030d38f-3946-4f1b-b891-7b3f2e047be2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c66accb0-bef4-4efd-8c64-1ac468371fd8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:18.525540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70b13111-9a10-404c-a008-33e1c33b1c08 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:18.529631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-70b13111-9a10-404c-a008-33e1c33b1c08 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.0559857 Dec 21 04:14:18.532891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32886) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.555497 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-6f34e291-dad0-4a3e-a10a-d036e5affba6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:18.558689 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6f34e291-dad0-4a3e-a10a-d036e5affba6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/bb1c3392-03c8-433a-9560-b74a357db4af HTTP/1.1" status: 404 len: 333 time: 0.0261993 Dec 21 04:14:18.559788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.586840 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ff78fd0-5cd7-4cac-8dae-6fb185d72e8a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:18.588706 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6ff78fd0-5cd7-4cac-8dae-6fb185d72e8a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/092d3386-b784-4ad6-919b-61c419adcb98 HTTP/1.1" status: 404 len: 333 time: 0.0279350 Dec 21 04:14:18.591317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32890) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.667471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.731524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c131ee8e-4901-4e46-adef-a29356e388be req-74e52611-5e59-4fb3-8fcf-23981c3d8924 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:18.733059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c131ee8e-4901-4e46-adef-a29356e388be req-74e52611-5e59-4fb3-8fcf-23981c3d8924 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 944 time: 0.0609438 Dec 21 04:14:18.762975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.783714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['44e75a85-3908-4548-a11f-c28657d578d8']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:18.784580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c131ee8e-4901-4e46-adef-a29356e388be req-afa42515-5d22-49fc-94dc-1e76231bfb67 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437634 Dec 21 04:14:18.793955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'df3c708f-a8b7-41e8-9a49-38eba1075b2a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:18.794261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'df3c708f-a8b7-41e8-9a49-38eba1075b2a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:18.803762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.817265 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.824083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:14:18.825668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:14:18.827615 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:14:18.918553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32896) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.976376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.981977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:18.987452 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/44e75a85-3908-4548-a11f-c28657d578d8 HTTP/1.1" status: 204 len: 168 time: 0.3950419 Dec 21 04:14:18.990876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32904) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:18.996738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-525064167'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:19.003771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e584f4c-dad1-4188-9181-54a643b1e805 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=44e75a85-3908-4548-a11f-c28657d578d8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:19.082780 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4e7c1e2-3ee0-4f8d-8844-52ebea58dce7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=fd1d7fb4df434eccb03b73009f43873b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1626182 Dec 21 04:14:19.085534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:19.101577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:19.105145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.128447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:19.135017 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-88c88c27-9f9d-420c-86ba-7364e0b7e262 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.137990 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.138444 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment 075dc073-edd4-490a-8492-797e6be4b509 of type vlan for network a37ff6eb-8de1-4d19-bbba-33320d7bce94 Dec 21 04:14:19.157368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-88c88c27-9f9d-420c-86ba-7364e0b7e262 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.177263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.275229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.281247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:19.281834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.312842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-88c88c27-9f9d-420c-86ba-7364e0b7e262 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.315484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-88c88c27-9f9d-420c-86ba-7364e0b7e262 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.319021 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-88c88c27-9f9d-420c-86ba-7364e0b7e262 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1c6ac396-6f9d-4758-b79a-2fc3ee384419 HTTP/1.1" status: 204 len: 168 time: 0.2301943 Dec 21 04:14:19.325266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c88c27-9f9d-420c-86ba-7364e0b7e262 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c6ac396-6f9d-4758-b79a-2fc3ee384419,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:19.356995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=a37ff6eb-8de1-4d19-bbba-33320d7bce94,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:19.370966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:19.397181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9059d263-f537-4c68-9290-7794f702a9bb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.4051528 Dec 21 04:14:19.400207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:19.405029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:19.520802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:19.572265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:19.576080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.640706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Performing IP validity checks on allocation pools {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 04:14:19.641081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_backend_mixin [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110310) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 04:14:19.657601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:14:19.661827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:19.662279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.762186 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.787762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32936) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:19.808248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:19.810652 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-12497cda-e0f7-4949-a0ec-3d415e2bd816" -d '{"events": [{"server_uuid": "3b51db5d-e0f3-4566-b06c-9e161cc32a62", "name": "network-vif-plugged", "status": "completed", "tag": "48af1302-c6b8-44fc-a6e4-6f2b88f33a6c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:19.828643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:19.854797 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-137bdede-3f29-4c53-8909-bc52547998b1 x-openstack-request-id: req-137bdede-3f29-4c53-8909-bc52547998b1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:19.854797 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3b51db5d-e0f3-4566-b06c-9e161cc32a62", "name": "network-vif-plugged", "status": "completed", "tag": "48af1302-c6b8-44fc-a6e4-6f2b88f33a6c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:19.855023 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-137bdede-3f29-4c53-8909-bc52547998b1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:19.855375 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c', 'code': 200} Dec 21 04:14:19.874658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-62c62c48-d38a-4bcd-bbc3-50bd5af3a74e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.903462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-network', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:19.904128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:19.940782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4742d99-22a5-42fb-9bb9-4f7187727328 req-f8d754e8-1f4e-4586-be4e-37f8baee9d7e tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:19.942608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4742d99-22a5-42fb-9bb9-4f7187727328 req-f8d754e8-1f4e-4586-be4e-37f8baee9d7e tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 944 time: 0.0823407 Dec 21 04:14:19.964221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:19.985694 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.004745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2863ad5-2464-4d5c-a39e-a17177021c7b req-3cc4b289-f5e6-4316-ba48-278d0e4a876e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:20.006325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d2863ad5-2464-4d5c-a39e-a17177021c7b req-3cc4b289-f5e6-4316-ba48-278d0e4a876e service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 1097 time: 0.0426247 Dec 21 04:14:20.029701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Made reservation on behalf of f201aa828d124b4d96ae1f68f53fe955 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:20.032010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.050310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.052554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4742d99-22a5-42fb-9bb9-4f7187727328 req-b641065c-e0fc-401b-b873-45624c5cd115 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025689 Dec 21 04:14:20.072721 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d2863ad5-2464-4d5c-a39e-a17177021c7b req-86022c07-4aa6-4d01-a0b9-71627f6be8e0 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593987 Dec 21 04:14:20.077470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=3530aaa8-279d-41c4-961b-57ea0096c0a8,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:20.084463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': '075dc073-edd4-490a-8492-797e6be4b509', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:20.084463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: a37ff6eb-8de1-4d19-bbba-33320d7bce94, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:20.142514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.176000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:20.221546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.247517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:20.256237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d160a2ca-db2b-4726-82b3-0c0ff121b17b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:20.262106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.262510 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Added segment 4e8ee42e-c970-4cdd-8f8d-9faefa309132 of type vlan for network 577a9fd0-5714-46c9-9810-f5765f640d13 Dec 21 04:14:20.274513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, a37ff6eb-8de1-4d19-bbba-33320d7bce94) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:20.279230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:20.279882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.284018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f23cf0e-2cbc-458e-adfb-fe094c40589f None None] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:20.306618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.392300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c13cdb2f-4511-455c-9179-7b07f8e4ccae tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9910011 Dec 21 04:14:20.394750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32954) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:20.400967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94', 'name': 'tempest-PortsTestJSON-144245041'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:20.408313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-a37ff6eb-8de1-4d19-bbba-33320d7bce94', 'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': '3530aaa8-279d-41c4-961b-57ea0096c0a8'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:14:20.409736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.491752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.493049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:20.494219 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.568354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] Pushing event updated for resources: {'Network': ['ID=577a9fd0-5714-46c9-9810-f5765f640d13,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:20.568589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Allocated IP 172.20.0.2 (a37ff6eb-8de1-4d19-bbba-33320d7bce94/3530aaa8-279d-41c4-961b-57ea0096c0a8/ed2efcd2-74c4-4961-a139-4a065c11a9d2) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:20.582007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 577a9fd0-5714-46c9-9810-f5765f640d13 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:20.583094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:20.587477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.606947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 2680d973-abf1-4cb0-9b5c-399ace3686b3 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:20.631866 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-935245fc-ae2d-4968-8856-2a8edd5549a2 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.8421566 Dec 21 04:14:20.635141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:20.640375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Request body: {'subnet': {'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-subnet', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:20.720131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Made reservation on behalf of f201aa828d124b4d96ae1f68f53fe955 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:20.722723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.789503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.907482 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:20.956209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Pushing event updated for resources: {'Port': ['ID=ed2efcd2-74c4-4961-a139-4a065c11a9d2,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:20.956424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.5 (a37ff6eb-8de1-4d19-bbba-33320d7bce94/3530aaa8-279d-41c4-961b-57ea0096c0a8/2680d973-abf1-4cb0-9b5c-399ace3686b3) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:20.970791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:20.972226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:20.975153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:20.976109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.035702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Pushing event updated for resources: {'Subnet': ['ID=22a88d3d-7d29-49ff-8344-5d0ad387ea51,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:21.058986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Attempting to bind port ed2efcd2-74c4-4961-a139-4a065c11a9d2 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:21.059498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Attempting to bind port ed2efcd2-74c4-4961-a139-4a065c11a9d2 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '075dc073-edd4-490a-8492-797e6be4b509', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:21.059878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Attempting to bind port ed2efcd2-74c4-4961-a139-4a065c11a9d2 on network a37ff6eb-8de1-4d19-bbba-33320d7bce94 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:21.062131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Checking segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:21.062803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Network hostable DHCP agents. Network: 577a9fd0-5714-46c9-9810-f5765f640d13, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:21.066285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:21.072059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Checking segment: {'id': '075dc073-edd4-490a-8492-797e6be4b509', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:21.072059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.072059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Bound using segment: {'id': '075dc073-edd4-490a-8492-797e6be4b509', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:21.072059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Bound port: ed2efcd2-74c4-4961-a139-4a065c11a9d2, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '075dc073-edd4-490a-8492-797e6be4b509', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'a37ff6eb-8de1-4d19-bbba-33320d7bce94'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:21.072059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.144691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.154179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] For port ed2efcd2-74c4-4961-a139-4a065c11a9d2, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:21.157579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] For port ed2efcd2-74c4-4961-a139-4a065c11a9d2, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ed2efcd2-74c4-4961-a139-4a065c11a9d2,segment=NetworkSegment(075dc073-edd4-490a-8492-797e6be4b509),segment_id=075dc073-edd4-490a-8492-797e6be4b509)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:21.206085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Network 577a9fd0-5714-46c9-9810-f5765f640d13 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:21.232956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6285dc43-af69-4e6b-95ef-7536f6d88432 req-0ce21590-4d24-42d1-8509-f3d0fdc36840 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:21.234387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6285dc43-af69-4e6b-95ef-7536f6d88432 req-0ce21590-4d24-42d1-8509-f3d0fdc36840 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 945 time: 0.0733697 Dec 21 04:14:21.285302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6285dc43-af69-4e6b-95ef-7536f6d88432 req-6f0f2062-878c-49e3-b60c-fa74b00df890 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448458 Dec 21 04:14:21.303905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.354781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 577a9fd0-5714-46c9-9810-f5765f640d13) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:21.359685 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.359847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:21.359847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.365960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9e594e8-f824-4674-aeb7-cbf908b74216 None None] Network 577a9fd0-5714-46c9-9810-f5765f640d13 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:21.417560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e2fa52-8053-4332-821f-7704bd9e0f87 None None] Pushing event updated for resources: {'Port': ['ID=ed2efcd2-74c4-4961-a139-4a065c11a9d2,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:21.443911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:21.449753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:21.454922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:21.464310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=2680d973-abf1-4cb0-9b5c-399ace3686b3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:21.502834 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f1647fbe-925d-4f31-b699-5cd7b4a31513 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.8664978 Dec 21 04:14:21.510274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 32978) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:21.511566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-577a9fd0-5714-46c9-9810-f5765f640d13', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:14:21.511707 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:21.512427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.536422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:21.537076 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.638181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.641769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.672300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9db1ac4e-5830-4673-bcb2-c71fa986be77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.2761734 Dec 21 04:14:21.674986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32980) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:21.724401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Allocated IP 172.20.0.2 (577a9fd0-5714-46c9-9810-f5765f640d13/22a88d3d-7d29-49ff-8344-5d0ad387ea51/b6a03316-05dc-428a-82da-5ebed305229c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:21.742013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.804218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 2680d973-abf1-4cb0-9b5c-399ace3686b3 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:21.804659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.903967 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.918838 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:21.919834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 2680d973-abf1-4cb0-9b5c-399ace3686b3 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:22.009491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.034887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.076779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Network 577a9fd0-5714-46c9-9810-f5765f640d13 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:22.079565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:22.083267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:22.092553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Pushing event updated for resources: {'Port': ['ID=b6a03316-05dc-428a-82da-5ebed305229c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:22.139005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Attempting to bind port b6a03316-05dc-428a-82da-5ebed305229c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:22.139378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Attempting to bind port b6a03316-05dc-428a-82da-5ebed305229c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:22.139736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Attempting to bind port b6a03316-05dc-428a-82da-5ebed305229c on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:22.144667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 13, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:22.145053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Checking segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:22.145456 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.145964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Bound using segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:22.146427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Bound port: b6a03316-05dc-428a-82da-5ebed305229c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:22.146805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.160606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.195556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=2680d973-abf1-4cb0-9b5c-399ace3686b3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:22.228685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] For port b6a03316-05dc-428a-82da-5ebed305229c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:22.233104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] For port b6a03316-05dc-428a-82da-5ebed305229c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6a03316-05dc-428a-82da-5ebed305229c,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:22.295123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.301439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db7375b0-fd58-423a-ad1a-60c758691fca tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/2680d973-abf1-4cb0-9b5c-399ace3686b3 HTTP/1.1" status: 204 len: 168 time: 0.6228945 Dec 21 04:14:22.302837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:22.342145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.348139 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d9e95ec6-f216-41f4-99da-faa149dfbf25 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:14:22.350777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d9e95ec6-f216-41f4-99da-faa149dfbf25 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:22.363738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d9e95ec6-f216-41f4-99da-faa149dfbf25 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/2680d973-abf1-4cb0-9b5c-399ace3686b3 HTTP/1.1" status: 404 len: 333 time: 0.0596917 Dec 21 04:14:22.364541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32994) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:22.403618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.432617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.454528 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-f12bad9f-fee0-4a0a-a972-ae581cf15d47 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:22.454748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f12bad9f-fee0-4a0a-a972-ae581cf15d47 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/2680d973-abf1-4cb0-9b5c-399ace3686b3 HTTP/1.1" status: 404 len: 333 time: 0.0855894 Dec 21 04:14:22.455601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5c5eaa-ccaf-484c-b33e-03dfab51c6b1 None None] Pushing event updated for resources: {'Port': ['ID=b6a03316-05dc-428a-82da-5ebed305229c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:22.458907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 32998) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:22.534343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f74e592-47d4-445b-bd31-2d12fbcda4f4 req-d4659b41-2c0f-4076-8442-5b895c883846 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:22.535946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f74e592-47d4-445b-bd31-2d12fbcda4f4 req-d4659b41-2c0f-4076-8442-5b895c883846 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 945 time: 0.1606917 Dec 21 04:14:22.547760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet 3530aaa8-279d-41c4-961b-57ea0096c0a8 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:14:22.551074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.631948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Allocated IP 172.25.5.41 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/41426124-77c3-42ec-9d47-d2e897909bee) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:22.656136 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.663977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-576d26ef-5b2a-48a3-b455-885b3132a68b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.686311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8a71901-dcc1-430b-b14b-932671e5b739 None None] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:22.707126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f74e592-47d4-445b-bd31-2d12fbcda4f4 req-be5e0f12-f7d8-480d-858d-2f3a3cacabf8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1638770 Dec 21 04:14:22.813124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.817844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.885973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-958cd4b8-766e-412d-895f-4cfbc2a6baf5 None None] Provisioning complete for port ed2efcd2-74c4-4961-a139-4a065c11a9d2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:22.886287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-958cd4b8-766e-412d-895f-4cfbc2a6baf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.943827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.980458 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-958cd4b8-766e-412d-895f-4cfbc2a6baf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.992069 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:22.995601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:23.001892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:23.006706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:23.017385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3013b5d0-f07a-42e9-9a28-0c7742b546f9 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:23.033302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.038358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Pushing event updated for resources: {'Port': ['ID=41426124-77c3-42ec-9d47-d2e897909bee,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:23.075006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=3530aaa8-279d-41c4-961b-57ea0096c0a8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:23.079076 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.085232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33002) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:23.085962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d40d32fa-55d4-4f4a-b8e4-7af1a9e718f5 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/3530aaa8-279d-41c4-961b-57ea0096c0a8 HTTP/1.1" status: 204 len: 168 time: 0.6250446 Dec 21 04:14:23.232964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2dc5d276-9e36-4907-b55a-1f1a2349c0eb None None] Network a37ff6eb-8de1-4d19-bbba-33320d7bce94 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:23.252826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.282090 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-958cd4b8-766e-412d-895f-4cfbc2a6baf5 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:14:23.282457 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-958cd4b8-766e-412d-895f-4cfbc2a6baf5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:14:23.352063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port ed2efcd2-74c4-4961-a139-4a065c11a9d2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:23.353384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.394768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.447111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed2efcd2-74c4-4961-a139-4a065c11a9d2 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:23.485425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] DHCP port deletion for a37ff6eb-8de1-4d19-bbba-33320d7bce94 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:23.586441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ed2efcd2-74c4-4961-a139-4a065c11a9d2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:23.587025 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.592087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] Deleting port ed2efcd2-74c4-4961-a139-4a065c11a9d2 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:23.592403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.673112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] For port ed2efcd2-74c4-4961-a139-4a065c11a9d2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ed2efcd2-74c4-4961-a139-4a065c11a9d2,segment=NetworkSegment(075dc073-edd4-490a-8492-797e6be4b509),segment_id=075dc073-edd4-490a-8492-797e6be4b509)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:23.673532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.712731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] Calling delete_port for ed2efcd2-74c4-4961-a139-4a065c11a9d2 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:23.870720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d6d045d-9bbe-43cf-a132-0aac04f15e9a None None] Network 577a9fd0-5714-46c9-9810-f5765f640d13 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:23.891370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] For port ed2efcd2-74c4-4961-a139-4a065c11a9d2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ed2efcd2-74c4-4961-a139-4a065c11a9d2,segment=NetworkSegment(075dc073-edd4-490a-8492-797e6be4b509),segment_id=075dc073-edd4-490a-8492-797e6be4b509)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:23.891734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.938013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for ed2efcd2-74c4-4961-a139-4a065c11a9d2 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:23.959268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-958cd4b8-766e-412d-895f-4cfbc2a6baf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.974982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:23.991979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.135426 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.164022 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.205597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No DVR routers for this DVR port ed2efcd2-74c4-4961-a139-4a065c11a9d2 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:24.207139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] No DVR routers for this DVR port ed2efcd2-74c4-4961-a139-4a065c11a9d2 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:24.209054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b6a03316-05dc-428a-82da-5ebed305229c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:24.211157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b919f5-4763-48e8-8292-9fe98d56bcf1 None None] Pushing event deleted for resources: {'Port': ['ID=ed2efcd2-74c4-4961-a139-4a065c11a9d2,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:24.239527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=ed2efcd2-74c4-4961-a139-4a065c11a9d2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:24.285685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Provisioning complete for port b6a03316-05dc-428a-82da-5ebed305229c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:24.286144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.289796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b6a03316-05dc-428a-82da-5ebed305229c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:24.289796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.297695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.298557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.298841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.299308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:24.312903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d317b308-4056-413d-ab7c-6f1864bdfa11 req-a01c0084-2b3b-488a-b64d-8d18b5c40130 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:24.315669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d317b308-4056-413d-ab7c-6f1864bdfa11 req-a01c0084-2b3b-488a-b64d-8d18b5c40130 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 945 time: 0.0774262 Dec 21 04:14:24.378145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.387517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d317b308-4056-413d-ab7c-6f1864bdfa11 req-fa1cc656-bc0f-4aa6-84d0-5d3d8d89831e tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638504 Dec 21 04:14:24.407153 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.412611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a37ff6eb-8de1-4d19-bbba-33320d7bce94']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:24.426145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '075dc073-edd4-490a-8492-797e6be4b509') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:24.426449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '075dc073-edd4-490a-8492-797e6be4b509') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:24.431035 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.468806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.477278 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.491547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.499885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b6a03316-05dc-428a-82da-5ebed305229c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6a03316-05dc-428a-82da-5ebed305229c,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:24.529907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:14:24.531903 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: self.session.flush() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:14:24.536307 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:14:24.570683 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.642051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:14:24.642431 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:14:24.645079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b6a03316-05dc-428a-82da-5ebed305229c,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:24.678667 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.686464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.689425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/a37ff6eb-8de1-4d19-bbba-33320d7bce94 HTTP/1.1" status: 204 len: 168 time: 1.6031246 Dec 21 04:14:24.693166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33022) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:24.699392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1625961218'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:24.701855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2103d7-0e25-4a6c-9eb2-caaeac39e760 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=a37ff6eb-8de1-4d19-bbba-33320d7bce94,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:24.725957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:14:24.776086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:24.779907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.803276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:24.812057 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.812410 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment 1a61dac0-9ce7-4d63-b594-f2c7460dd49f of type vlan for network f1850438-cb24-4a89-a36b-4ef22ad5cac8 Dec 21 04:14:24.832098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:14:24.843869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:14:24.853652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:24.854427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:24.855315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.949425 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.951813 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f019840d-932b-4e2c-959b-dbd7ceb66013 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 3.4425311 Dec 21 04:14:24.953588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33026) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:24.974142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.980516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:24.981104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:24.981917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:25.058508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.070670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=f1850438-cb24-4a89-a36b-4ef22ad5cac8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:25.079473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.079833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.080196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.080524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.080863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.081198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.081530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.081862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.082254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.082563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.082897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.083264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.083622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:25.105500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f69388c5-3c85-4b6a-b214-ea0992a8f034 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4108951 Dec 21 04:14:25.108323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33030) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:25.116745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:25.121191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:25.178733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.254615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Could not find standard attr ID for object ed2efcd2-74c4-4961-a139-4a065c11a9d2. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:14:25.296512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Provisioning complete for port 41426124-77c3-42ec-9d47-d2e897909bee triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:25.296885 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.325671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b6a03316-05dc-428a-82da-5ebed305229c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:25.347994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:25.352554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.386104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:23Z', 'revision_number': 3, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:25.390602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f0009440-bde9-43a9-bac4-9ba9b993fef3 None None] Port 41426124-77c3-42ec-9d47-d2e897909bee cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:25.434187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:14:25.434187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Updating router 57387dcb-f3c3-4046-bfde-40c9e2370917 port 41426124-77c3-42ec-9d47-d2e897909bee binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:14:25.478006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.530203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8e2449e8-4b20-4150-a214-399457e3b720 None None] Provisioning complete for port b6a03316-05dc-428a-82da-5ebed305229c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:25.530915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e2449e8-4b20-4150-a214-399457e3b720 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.541357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.574482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2fb5591-b2ea-4539-b9cb-1da0b1aecc40 req-075394e6-785b-4d8b-8698-ecf9ca328ed2 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:25.576119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2fb5591-b2ea-4539-b9cb-1da0b1aecc40 req-075394e6-785b-4d8b-8698-ecf9ca328ed2 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 945 time: 0.1018100 Dec 21 04:14:25.614456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b6a03316-05dc-428a-82da-5ebed305229c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:25.614791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.687031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2fb5591-b2ea-4539-b9cb-1da0b1aecc40 req-1ecc7757-3e71-45fc-9b84-625e36016e24 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/security-groups?id=799ede8c-8253-4a1c-ae82-09f6731ecab1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912421 Dec 21 04:14:25.709930 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:25.766630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=b7990c05-321d-4a74-9b03-cfcc12267eaf,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:25.789685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-da8c277b-a057-4dbd-b1b9-492a8b1ca257 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:25.792971 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-da8c277b-a057-4dbd-b1b9-492a8b1ca257 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 945 time: 0.1327994 Dec 21 04:14:25.815848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': '1a61dac0-9ce7-4d63-b594-f2c7460dd49f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:25.816128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: f1850438-cb24-4a89-a36b-4ef22ad5cac8, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:25.851610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Allocated IP 172.20.0.1 (577a9fd0-5714-46c9-9810-f5765f640d13/22a88d3d-7d29-49ff-8344-5d0ad387ea51/77c72788-b001-4ba0-932a-f9416c52277d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:25.943612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:25.975854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Deleting port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:25.976193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.052726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.073176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f1850438-cb24-4a89-a36b-4ef22ad5cac8) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:26.077633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:26.078310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.103758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f1ebb24-de99-4e2d-ad6b-a61fa59351f6 None None] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:26.110077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] For port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,segment=NetworkSegment(542e7a2d-ea7c-4083-b387-0bdcad1cf6fc),segment_id=542e7a2d-ea7c-4083-b387-0bdcad1cf6fc)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:26.110449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.121460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.128080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Calling delete_port for 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:26.175833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed2efcd2-74c4-4961-a139-4a065c11a9d2 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:26.178875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.205562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ed2efcd2-74c4-4961-a139-4a065c11a9d2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:26.205926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ed2efcd2-74c4-4961-a139-4a065c11a9d2 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:26.212893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7215489a-d9ed-4e22-ae10-5aab83eaa30c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1028423 Dec 21 04:14:26.215595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33046) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:26.222637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8', 'security_groups': [], 'name': 'tempest-PortsTestJSON-199188886'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:26.268884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-f1850438-cb24-4a89-a36b-4ef22ad5cac8', 'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': 'b7990c05-321d-4a74-9b03-cfcc12267eaf'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:14:26.269793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.282418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.355456 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.377799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Network 577a9fd0-5714-46c9-9810-f5765f640d13 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:26.391225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:26.396726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:26.399185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Pushing event updated for resources: {'Port': ['ID=77c72788-b001-4ba0-932a-f9416c52277d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:26.443396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b3c9b82-54ee-41e7-929c-a70e31961603 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:26.456019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d3662bf-b39c-4e52-ba21-41cf01cf14a7 None None] Pushing event updated for resources: {'Port': ['ID=41426124-77c3-42ec-9d47-d2e897909bee,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:26.464296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Attempting to bind port 41426124-77c3-42ec-9d47-d2e897909bee on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:26.464680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Attempting to bind port 41426124-77c3-42ec-9d47-d2e897909bee by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:26.465072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Attempting to bind port 41426124-77c3-42ec-9d47-d2e897909bee on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:26.466680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.478033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:26.478646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:26.479421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.480275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:26.481098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Bound port: 41426124-77c3-42ec-9d47-d2e897909bee, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:26.481654 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.506657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Allocated IP 172.20.0.2 (f1850438-cb24-4a89-a36b-4ef22ad5cac8/b7990c05-321d-4a74-9b03-cfcc12267eaf/339476a4-8bb1-4aeb-94aa-ec0371e2f14a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:26.544766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.584012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] For port 41426124-77c3-42ec-9d47-d2e897909bee, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:26.589395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] For port 41426124-77c3-42ec-9d47-d2e897909bee, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=41426124-77c3-42ec-9d47-d2e897909bee,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:26.595994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Pushing event deleted for resources: {'Port': ['ID=48af1302-c6b8-44fc-a6e4-6f2b88f33a6c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:26.656888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['48af1302-c6b8-44fc-a6e4-6f2b88f33a6c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:26.668105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:26.671631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.699121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] No DVR routers for this DVR port 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:26.703475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c7b938f3-1b0e-464c-a229-eab0dd50699e None None] Provisioning complete for port 41426124-77c3-42ec-9d47-d2e897909bee triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:26.703701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c7b938f3-1b0e-464c-a229-eab0dd50699e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.704188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.707554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5ae10ee3-0bb0-4c74-8e81-5c972047be90 req-5fcd041a-8bcc-40db-974e-de385b7ae2d8 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.54 "DELETE /v2.0/ports/48af1302-c6b8-44fc-a6e4-6f2b88f33a6c HTTP/1.1" status: 204 len: 173 time: 0.9067338 Dec 21 04:14:26.709094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'name': 'network-vif-deleted', 'tag': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:26.711409 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9da2d30c-3279-4ef6-a21e-455cee139145" -d '{"events": [{"server_uuid": "3b51db5d-e0f3-4566-b06c-9e161cc32a62", "name": "network-vif-deleted", "tag": "48af1302-c6b8-44fc-a6e4-6f2b88f33a6c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:26.747774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.765884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 840ebe51-c519-4ac6-9843-bc68d93b0c20 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:26.844167 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35bba07c-34aa-4a53-87dc-4611d7f80294 x-openstack-request-id: req-35bba07c-34aa-4a53-87dc-4611d7f80294 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:26.844468 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3b51db5d-e0f3-4566-b06c-9e161cc32a62", "name": "network-vif-deleted", "tag": "48af1302-c6b8-44fc-a6e4-6f2b88f33a6c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:26.851932 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-35bba07c-34aa-4a53-87dc-4611d7f80294 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:26.851932 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3b51db5d-e0f3-4566-b06c-9e161cc32a62', 'name': 'network-vif-deleted', 'tag': '48af1302-c6b8-44fc-a6e4-6f2b88f33a6c', 'status': 'completed', 'code': 200} Dec 21 04:14:26.880295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc3cde8f-1d0a-4e8b-aeca-89373c9d8700 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:26.919246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:26.933363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c7b938f3-1b0e-464c-a229-eab0dd50699e None None] Port 41426124-77c3-42ec-9d47-d2e897909bee cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:26.953019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b497fd0a-d7bd-4fec-9efb-89c40a1b1755 req-47439fc3-efd0-44a1-8bf1-154c8b359b65 tempest-VolumesActionsTest-1319283559 tempest-VolumesActionsTest-1319283559-project] 10.222.0.18 "GET /v2.0/ports?device_id=3b51db5d-e0f3-4566-b06c-9e161cc32a62 HTTP/1.1" status: 200 len: 210 time: 0.1001377 Dec 21 04:14:26.979027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:26.980658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:27.030838 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.039392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d3662bf-b39c-4e52-ba21-41cf01cf14a7 None None] Pushing event updated for resources: {'Port': ['ID=41426124-77c3-42ec-9d47-d2e897909bee,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:27.147076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.205701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.208148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.3 (f1850438-cb24-4a89-a36b-4ef22ad5cac8/b7990c05-321d-4a74-9b03-cfcc12267eaf/840ebe51-c519-4ac6-9843-bc68d93b0c20) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:27.214051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.221054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Provisioning complete for port 77c72788-b001-4ba0-932a-f9416c52277d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:27.221546 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.292882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:27.308852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:27.312288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:27.340405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.349804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:27.369317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Pushing event updated for resources: {'Port': ['ID=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:27.371662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Pushing event updated for resources: {'Port': ['ID=77c72788-b001-4ba0-932a-f9416c52277d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:27.397038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Port 77c72788-b001-4ba0-932a-f9416c52277d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:27.525914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Provisioning complete for port 41426124-77c3-42ec-9d47-d2e897909bee triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:27.526127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.530752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.543026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Network 577a9fd0-5714-46c9-9810-f5765f640d13 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:27.552393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:27.553043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Attempting to bind port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:27.553043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Attempting to bind port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1a61dac0-9ce7-4d63-b594-f2c7460dd49f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:27.553300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Attempting to bind port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a on network f1850438-cb24-4a89-a36b-4ef22ad5cac8 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:27.610877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:27.612876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Checking segment: {'id': '1a61dac0-9ce7-4d63-b594-f2c7460dd49f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:27.613706 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.614809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Bound using segment: {'id': '1a61dac0-9ce7-4d63-b594-f2c7460dd49f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:27.616032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Bound port: 339476a4-8bb1-4aeb-94aa-ec0371e2f14a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a61dac0-9ce7-4d63-b594-f2c7460dd49f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'f1850438-cb24-4a89-a36b-4ef22ad5cac8'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:27.616819 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.683830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:14:27.698266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:27.961050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] For port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:27.996870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] For port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,segment=NetworkSegment(1a61dac0-9ce7-4d63-b594-f2c7460dd49f),segment_id=1a61dac0-9ce7-4d63-b594-f2c7460dd49f)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:28.025311 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.071826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] For port 41426124-77c3-42ec-9d47-d2e897909bee, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=41426124-77c3-42ec-9d47-d2e897909bee,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:28.075957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:25Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:28.107156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18156e0c-8c5e-402f-9eab-122d3892bcec None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:25Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:14:28.109541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.208235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.230833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Pushing event updated for resources: {'Port': ['ID=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:28.249374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.249734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.250089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.250430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.250771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.251137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.251471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.251806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.252137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.252468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.252810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.253174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.253504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09adaf51-71b8-4889-adaa-2a6f1b3edb00 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:28.291025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:28.301663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:28.312090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:28.359204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0118a87d-5184-4af8-ac3c-29b2b5fb0c26 None None] Pushing event updated for resources: {'Port': ['ID=41426124-77c3-42ec-9d47-d2e897909bee,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:28.367259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b79a3bfe-f769-4069-997a-40435e998d53 None None] Provisioning complete for port 77c72788-b001-4ba0-932a-f9416c52277d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:28.367380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b79a3bfe-f769-4069-997a-40435e998d53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.374715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:28.375458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.377878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=840ebe51-c519-4ac6-9843-bc68d93b0c20,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:28.394196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:14:28.400600 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b50a849b-92e4-4c1e-bbbd-4920751ac82c admin admin] 10.222.0.18 "PUT /v2.0/routers/57387dcb-f3c3-4046-bfde-40c9e2370917/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4452083 Dec 21 04:14:28.469461 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a108cf19-a7a2-4ef5-b6d8-dd695ba15635 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 885 time: 2.2524617 Dec 21 04:14:28.470153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33084) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:28.496176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b79a3bfe-f769-4069-997a-40435e998d53 None None] Port 77c72788-b001-4ba0-932a-f9416c52277d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:28.651148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 840ebe51-c519-4ac6-9843-bc68d93b0c20 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:28.653067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.793605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:28.807783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 840ebe51-c519-4ac6-9843-bc68d93b0c20 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:29.052073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.085985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=840ebe51-c519-4ac6-9843-bc68d93b0c20,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:29.173627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33110) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:29.179580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'security_group': {'name': 'tempest-securitygroup--296258866', 'description': 'tempest-description--11181014'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:29.182566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.188435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aa3ba18f-ac59-460d-adce-a367cc86a257 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/840ebe51-c519-4ac6-9843-bc68d93b0c20 HTTP/1.1" status: 204 len: 168 time: 0.7148845 Dec 21 04:14:29.190137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33112) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:29.240483 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-16ce3172-617f-48bd-abe3-c71611606097 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:29.247460 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-16ce3172-617f-48bd-abe3-c71611606097 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/840ebe51-c519-4ac6-9843-bc68d93b0c20 HTTP/1.1" status: 404 len: 333 time: 0.0560496 Dec 21 04:14:29.250612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33114) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:29.371110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.389412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet b7990c05-321d-4a74-9b03-cfcc12267eaf {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:14:29.399703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.480988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 339476a4-8bb1-4aeb-94aa-ec0371e2f14a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:29.504131 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.546294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:29.620127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:29.620666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 48af1302-c6b8-44fc-a6e4-6f2b88f33a6c not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:29.636725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:29.637372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.643026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.672132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.733794 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.770969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.813863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1b49accc-ccae-4322-88f2-983f011cd91a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:29.844886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28b814de-9e8a-4113-8ca4-d3bf1c3cce7a None None] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:29.876643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.878641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ab24203f-b519-4a54-8b1c-e3bbd6f85d73 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.7031357 Dec 21 04:14:29.881363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33130) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:29.886239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'security_group_rule': {'security_group_id': '1b49accc-ccae-4322-88f2-983f011cd91a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:29.920558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.976437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:29.989691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=b7990c05-321d-4a74-9b03-cfcc12267eaf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:29.996598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.015454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7985802d-00dc-4385-a4e5-9496efb79ede tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/b7990c05-321d-4a74-9b03-cfcc12267eaf HTTP/1.1" status: 204 len: 168 time: 0.7634027 Dec 21 04:14:30.016311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:30.028054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-56a0fb14-cba9-4b7d-81af-c1444a2dbef7 None None] Provisioning complete for port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:30.028433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-56a0fb14-cba9-4b7d-81af-c1444a2dbef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.110173 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:14:30.110173 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:14:30.114452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.171317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.203422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a7b6fba9-a345-4931-92d5-f097db7ee789,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:30.206008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.276150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-56a0fb14-cba9-4b7d-81af-c1444a2dbef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.299665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.306479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a269789c-6798-4ebe-aa74-6c9ad7585112 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4231715 Dec 21 04:14:30.307628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33148) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:30.312481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'security_group_rule': {'security_group_id': '1b49accc-ccae-4322-88f2-983f011cd91a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:30.332769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:30.333201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.355030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-56a0fb14-cba9-4b7d-81af-c1444a2dbef7 None None] For port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,segment=NetworkSegment(1a61dac0-9ce7-4d63-b594-f2c7460dd49f),segment_id=1a61dac0-9ce7-4d63-b594-f2c7460dd49f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:30.433631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] For port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,segment=NetworkSegment(1a61dac0-9ce7-4d63-b594-f2c7460dd49f),segment_id=1a61dac0-9ce7-4d63-b594-f2c7460dd49f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:30.434338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.457158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.465717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 339476a4-8bb1-4aeb-94aa-ec0371e2f14a owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:30.468828 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-56a0fb14-cba9-4b7d-81af-c1444a2dbef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.575221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-181d3c82-eb24-4ca3-b196-91ddbe6ab073 None None] Network f1850438-cb24-4a89-a36b-4ef22ad5cac8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:30.606744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.614520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a0fb14-cba9-4b7d-81af-c1444a2dbef7 None None] Pushing event updated for resources: {'Port': ['ID=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:30.674698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.700127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-527f66ad-2317-46aa-865a-a28f2f4ecd33 None None] Provisioning complete for port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:30.700464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-527f66ad-2317-46aa-865a-a28f2f4ecd33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.721067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=339476a4-8bb1-4aeb-94aa-ec0371e2f14a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:30.724277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.729163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No DVR routers for this DVR port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:30.741029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-527f66ad-2317-46aa-865a-a28f2f4ecd33 None None] Port 339476a4-8bb1-4aeb-94aa-ec0371e2f14a was deleted so its status cannot be updated. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Dec 21 04:14:30.758925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df7d2fab-5a10-4300-aa92-398ce82aaf31,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:30.817108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e0b0845-74b0-4fd2-9d6f-848111d5cca7 None None] DHCP port deletion for f1850438-cb24-4a89-a36b-4ef22ad5cac8 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:30.851930 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.852158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.857262 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f373bcb6-eeca-4053-ac68-0c84deaf84b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5483465 Dec 21 04:14:30.857921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:30.863045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:30.886636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1850438-cb24-4a89-a36b-4ef22ad5cac8']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:30.899817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a61dac0-9ce7-4d63-b594-f2c7460dd49f') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:30.900112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a61dac0-9ce7-4d63-b594-f2c7460dd49f') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:30.912641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.929314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.939236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:14:30.939651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:14:30.943157 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:14:30.960272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.120676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.122498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.133728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.134179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/f1850438-cb24-4a89-a36b-4ef22ad5cac8 HTTP/1.1" status: 204 len: 168 time: 1.1159542 Dec 21 04:14:31.148252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33160) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:31.154915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'name': 'tempest-PortsTestJSON-750017242'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:31.160872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642a2df0-cff1-4639-bf12-76ffd28934c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=f1850438-cb24-4a89-a36b-4ef22ad5cac8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:31.343048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Allocated IP 172.25.5.221 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/79a4f55a-2457-482e-8955-594c8f9b65bd) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:31.432650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 41426124-77c3-42ec-9d47-d2e897909bee up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:31.512687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:31.513740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 41426124-77c3-42ec-9d47-d2e897909bee triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:31.514364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.518245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.523827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.538203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port e97eb678-0980-4401-8c41-eb4b39e3f249 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:31.604825 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:14:31.627250 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:31.631278 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:31.679400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.699563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 339476a4-8bb1-4aeb-94aa-ec0371e2f14a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:31.731623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 339476a4-8bb1-4aeb-94aa-ec0371e2f14a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:31.731982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 339476a4-8bb1-4aeb-94aa-ec0371e2f14a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:31.753709 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:31.772161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'Port': ['ID=79a4f55a-2457-482e-8955-594c8f9b65bd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:31.775089 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.790083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:31.791256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:31.794370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:31.905960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.915707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:31.949087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:31.971112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:31.974460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:31.984600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:31.985549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.022351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=e97eb678-0980-4401-8c41-eb4b39e3f249,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:32.040699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 2, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:32.056381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.076456 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:14:32.077281 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Updating router 57387dcb-f3c3-4046-bfde-40c9e2370917 port 77c72788-b001-4ba0-932a-f9416c52277d binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:14:32.113983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b9241f58-30f6-430f-b2c6-7a4d2d63a831 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 0.9612784 Dec 21 04:14:32.114205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33186) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:32.120718 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.315255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port e97eb678-0980-4401-8c41-eb4b39e3f249 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:32.315882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.330551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.414603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.417868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.431986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for e97eb678-0980-4401-8c41-eb4b39e3f249 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:32.444239 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.554238 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.591220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'Port': ['ID=79a4f55a-2457-482e-8955-594c8f9b65bd,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:32.604945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.616056 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Pushing event updated for resources: {'Port': ['ID=77c72788-b001-4ba0-932a-f9416c52277d,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:32.694435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.695658 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb54a72e-1ce2-4fba-bb41-bc451cb5a71a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.8367584 Dec 21 04:14:32.710699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.711095 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.711441 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.711814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.712148 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.712480 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.712808 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.713148 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.713988 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.714463 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.714791 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.715185 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.715598 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:14:32.727623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Attempting to bind port 77c72788-b001-4ba0-932a-f9416c52277d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:32.728455 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Attempting to bind port 77c72788-b001-4ba0-932a-f9416c52277d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:32.729000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Attempting to bind port 77c72788-b001-4ba0-932a-f9416c52277d on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:32.741271 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:32.741971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Checking segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:32.742737 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.744479 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Bound using segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:32.746507 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Bound port: 77c72788-b001-4ba0-932a-f9416c52277d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:32.746507 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.838043 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] For port 77c72788-b001-4ba0-932a-f9416c52277d, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:32.841737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] For port 77c72788-b001-4ba0-932a-f9416c52277d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=77c72788-b001-4ba0-932a-f9416c52277d,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:32.950106 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:32.982951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-25231f06-1af3-4594-950c-2905020416ba tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--296258866&fields=id&tenant_id=f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 267 time: 0.0592010 Dec 21 04:14:33.051288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b22be33d-d445-44b4-a7df-371e9dad1cb7 None None] Provisioning complete for port 77c72788-b001-4ba0-932a-f9416c52277d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:33.052701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b22be33d-d445-44b4-a7df-371e9dad1cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.087521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.140263 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:33.140910 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:33.183502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=e97eb678-0980-4401-8c41-eb4b39e3f249,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:33.208885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.212852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0707e685-ca63-4eb5-94f2-bceda5240160 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/e97eb678-0980-4401-8c41-eb4b39e3f249 HTTP/1.1" status: 204 len: 168 time: 1.0975299 Dec 21 04:14:33.215500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:33.223302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'mac_address': 'fa:16:3e:a3:40:0b', 'name': 'tempest-PortsTestJSON-1203627266'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:33.248475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b22be33d-d445-44b4-a7df-371e9dad1cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.300337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-ed114399-d124-4b6d-ad95-4d533e0999ef tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:33.329448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-ed114399-d124-4b6d-ad95-4d533e0999ef tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 817 time: 0.3395433 Dec 21 04:14:33.338301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b22be33d-d445-44b4-a7df-371e9dad1cb7 None None] For port 77c72788-b001-4ba0-932a-f9416c52277d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=77c72788-b001-4ba0-932a-f9416c52277d,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:33.380532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-e3009cee-66b7-43d9-be09-0389ddf403bc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/quotas/f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 375 time: 0.0501869 Dec 21 04:14:33.382612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:33.412970 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b22be33d-d445-44b4-a7df-371e9dad1cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.466568 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d942c034-3fda-4052-981a-123c2d37348d None None] Pushing event updated for resources: {'Port': ['ID=77c72788-b001-4ba0-932a-f9416c52277d,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:33.473003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-a6df1e7f-afde-4976-aa47-41dc20a801a9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0915005 Dec 21 04:14:33.487245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-e48a47b7-cb6c-4aae-a21e-570e7386c2f5 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:14:33.497111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-e48a47b7-cb6c-4aae-a21e-570e7386c2f5 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0211809 Dec 21 04:14:33.503173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:33.575933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b22be33d-d445-44b4-a7df-371e9dad1cb7 None None] Pushing event updated for resources: {'Port': ['ID=77c72788-b001-4ba0-932a-f9416c52277d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:33.596505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a6f2c625-253c-448c-8805-6fe50d235663 None None] Provisioning complete for port 77c72788-b001-4ba0-932a-f9416c52277d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:33.597402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a6f2c625-253c-448c-8805-6fe50d235663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.624289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3c4c1cb9-1874-4381-a412-1791c1cabef3 service neutron] 10.222.0.18 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237962 Dec 21 04:14:33.738029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:33.768845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 3f1b7b83-ce6b-40bd-875c-f03ef4bc9940 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:33.793242 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:32Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:33.816758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-82a8f375-a5ba-452e-9206-3556e902c425 service neutron] 10.222.0.18 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1914067 Dec 21 04:14:33.881758 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a4bfab7-a91b-4093-86b2-9ded53a60e75 None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:32Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:14:33.897720 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:14:34.111951 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:34.280697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:34.295222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13b32a7f-0736-4b63-9eb0-cdf2cd6e6163 req-e5ceb3ba-696c-4ef8-a9a7-1883a78cf654 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 210 time: 0.0600231 Dec 21 04:14:34.502239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:34.504691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:34.506819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=3f1b7b83-ce6b-40bd-875c-f03ef4bc9940,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:34.509394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:34.517423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:34.518726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:34.631883 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-916ceb96-170b-4e31-9233-8f27e05dae65 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.4134932 Dec 21 04:14:34.634334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33230) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:34.726073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ab82b12-534b-414f-9de2-038a73a08758 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:34.730769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5ab82b12-534b-414f-9de2-038a73a08758 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/3f1b7b83-ce6b-40bd-875c-f03ef4bc9940 HTTP/1.1" status: 200 len: 841 time: 0.0927665 Dec 21 04:14:34.736224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33232) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:34.999793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 3f1b7b83-ce6b-40bd-875c-f03ef4bc9940 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:35.000144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:35.178219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:35.213386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 3f1b7b83-ce6b-40bd-875c-f03ef4bc9940 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:35.415191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 77c72788-b001-4ba0-932a-f9416c52277d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:35.449811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f19f4f58-2ae6-4730-bcc9-ae1fa9f2c326 req-74e6a874-cfa2-43ca-8292-e3f9e13d8e88 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 210 time: 0.0319619 Dec 21 04:14:35.451668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:35.551136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=3f1b7b83-ce6b-40bd-875c-f03ef4bc9940,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:35.557837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:35.565918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33258) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:35.566776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b82f072e-4bec-4b18-8846-170d559edb7f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/3f1b7b83-ce6b-40bd-875c-f03ef4bc9940 HTTP/1.1" status: 204 len: 168 time: 0.8237333 Dec 21 04:14:35.575536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 77c72788-b001-4ba0-932a-f9416c52277d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:35.582107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:35.612128 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-10c26848-406b-40de-824d-def83f795974 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:35.613660 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10c26848-406b-40de-824d-def83f795974 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/3f1b7b83-ce6b-40bd-875c-f03ef4bc9940 HTTP/1.1" status: 404 len: 333 time: 0.0467544 Dec 21 04:14:35.617285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33260) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:35.629970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'name': 'tempest-PortsTestJSON-96525057'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:35.862891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:35.868749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:35.892079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 65fda63f-fe08-4f99-b16e-42b741e6ad7d yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:36.174408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:36.407696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:36.455400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:36.460451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:36.464789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:36.470971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:36.472176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:36.498524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=65fda63f-fe08-4f99-b16e-42b741e6ad7d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:36.597188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84bfb0f8-4866-4e04-9519-b54c6f8099e8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 844 time: 0.9781060 Dec 21 04:14:36.599896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33276) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:36.615136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2fcfbea-a979-4250-8c15-da4953f23025 req-d0b64b25-67e6-470d-8f84-a247f99e0d57 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 210 time: 0.0431359 Dec 21 04:14:36.625404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:36.702550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:36.889828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:36.987581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:37.003675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] In _notify_port_updated(), no bound segment for port 65fda63f-fe08-4f99-b16e-42b741e6ad7d on network bcf1b1c3-e446-4833-886a-d47191e91971 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:14:37.010212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:37.010862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:37.014045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/ports/65fda63f-fe08-4f99-b16e-42b741e6ad7d HTTP/1.1" status: 200 len: 818 time: 0.3946497 Dec 21 04:14:37.022033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33278) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:37.097679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9699a64-9624-408c-997d-da5a8c998e5b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=65fda63f-fe08-4f99-b16e-42b741e6ad7d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:37.148768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 65fda63f-fe08-4f99-b16e-42b741e6ad7d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:37.149234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:37.227515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:37.250119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 65fda63f-fe08-4f99-b16e-42b741e6ad7d owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:37.434021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-f266a734-c0c3-4ecb-ba10-b36b92ae6a14 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:37.435520 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-f266a734-c0c3-4ecb-ba10-b36b92ae6a14 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 817 time: 0.1998248 Dec 21 04:14:37.519330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:37.556857 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-58ec003e-fd94-4ed7-a84e-ed302c6d2288 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 379 time: 0.1039007 Dec 21 04:14:37.568657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'port': {'device_id': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'admin_state_up': True, 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'security_groups': ['1b49accc-ccae-4322-88f2-983f011cd91a']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:37.577447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=65fda63f-fe08-4f99-b16e-42b741e6ad7d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:37.583385 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:37.587033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6f1a9f77-2d0c-4a9a-b7d7-897acd660712 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/65fda63f-fe08-4f99-b16e-42b741e6ad7d HTTP/1.1" status: 204 len: 168 time: 0.5709193 Dec 21 04:14:37.589616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33288) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:37.731923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-924f48ae-b9d2-4f02-a286-f9b19e5abd3e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:37.734973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-924f48ae-b9d2-4f02-a286-f9b19e5abd3e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.1428509 Dec 21 04:14:37.736990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:37.762371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-419a5080-4d28-456b-afe1-2ba12f681046 req-e5b69a05-cf01-4113-8926-0fd069733c32 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 210 time: 0.0478756 Dec 21 04:14:37.783495 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e2d565c-3937-4b82-bff8-5c3992c61e69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:37.783495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6e2d565c-3937-4b82-bff8-5c3992c61e69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/65fda63f-fe08-4f99-b16e-42b741e6ad7d HTTP/1.1" status: 404 len: 333 time: 0.0423989 Dec 21 04:14:37.784210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:37.790329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1076534831'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:37.846654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Made reservation on behalf of f201aa828d124b4d96ae1f68f53fe955 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:37.851556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.005403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:38.009762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.041905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Allocated IP 172.20.0.13 (577a9fd0-5714-46c9-9810-f5765f640d13/22a88d3d-7d29-49ff-8344-5d0ad387ea51/ac11126b-e25e-4a58-b9ab-db17cde3b083) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:38.059560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:38.090397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.090752 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment 3d468df1-f39e-4631-93a8-0ef77f6535fd of type vlan for network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 Dec 21 04:14:38.169239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.280667 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.291900 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.298612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:38.299428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.413448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=3c2b0410-5123-4ec7-8201-ae90937d4ff1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:38.424345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:38.463191 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e1173b19-8896-49c5-8c89-ec97c208a9d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6747115 Dec 21 04:14:38.463518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33312) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:38.479732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:38.830595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:38.866784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Network 577a9fd0-5714-46c9-9810-f5765f640d13 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:38.870704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:38.876829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:38.928758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:38.937829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a32f84dc-526e-49db-931b-1a8fa12b1512 req-cba60ee9-6a65-4899-ad66-c85fcc719b38 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:38.939670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a32f84dc-526e-49db-931b-1a8fa12b1512 req-cba60ee9-6a65-4899-ad66-c85fcc719b38 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 932 time: 0.0909798 Dec 21 04:14:38.944195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:38.948531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.058863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:39.059913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.067366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a32f84dc-526e-49db-931b-1a8fa12b1512 req-cc7681ea-c2cc-4001-a84e-fdd945e86679 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1131511 Dec 21 04:14:39.186926 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5766f211-5ecf-473a-9a6d-56ac9e5a705f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6224625 Dec 21 04:14:39.229290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Request body: {'port': {'device_id': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:39.312404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-74020c6d-50bf-4eaa-a6f3-ea9ab23b9fac None None] Provisioning complete for port ac11126b-e25e-4a58-b9ab-db17cde3b083 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:39.312773 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-74020c6d-50bf-4eaa-a6f3-ea9ab23b9fac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.326136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.411161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.415761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-74020c6d-50bf-4eaa-a6f3-ea9ab23b9fac None None] Port ac11126b-e25e-4a58-b9ab-db17cde3b083 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:39.560771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=ebe05454-5965-4b03-8688-507b5d8ea450,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:39.589460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': '3d468df1-f39e-4631-93a8-0ef77f6535fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:39.589829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: 3c2b0410-5123-4ec7-8201-ae90937d4ff1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:39.710690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:39.757606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ac11126b-e25e-4a58-b9ab-db17cde3b083 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:14:39.766463 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.780020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Transition to ACTIVE for port object ac11126b-e25e-4a58-b9ab-db17cde3b083 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:14:39.811226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 3c2b0410-5123-4ec7-8201-ae90937d4ff1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:39.816014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:39.816676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.824647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29564af2-5e31-46f3-8aae-03e602448afd None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:39.862554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.971718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33330) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:39.976918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': 'ebe05454-5965-4b03-8688-507b5d8ea450'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:14:39.981064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:39.982192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:39.987229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0c0ed2bf-02c3-4fba-84d9-d1125507fc9f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5225384 Dec 21 04:14:39.992354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:40.093854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Attempting to bind port ac11126b-e25e-4a58-b9ab-db17cde3b083 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:40.094215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Attempting to bind port ac11126b-e25e-4a58-b9ab-db17cde3b083 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:40.094532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Attempting to bind port ac11126b-e25e-4a58-b9ab-db17cde3b083 on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:40.100541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Port ac11126b-e25e-4a58-b9ab-db17cde3b083 on network 577a9fd0-5714-46c9-9810-f5765f640d13 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:14:40.100878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Attempting to bind port ac11126b-e25e-4a58-b9ab-db17cde3b083 on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:40.123148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:40.127771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Checking segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:40.128255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Bound using segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:40.131171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Bound port: ac11126b-e25e-4a58-b9ab-db17cde3b083, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:40.134102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.169382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Allocated IP 172.20.0.2 (3c2b0410-5123-4ec7-8201-ae90937d4ff1/ebe05454-5965-4b03-8688-507b5d8ea450/551d61a1-90a3-4f41-bc80-bf8550cde525) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:40.305964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:40.311101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:40.326535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42fe6d2-018b-44b7-a27f-f5ab0612d0e9 req-f3ac8a32-1d33-4777-913a-ec6906bdb657 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:40.330621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a42fe6d2-018b-44b7-a27f-f5ab0612d0e9 req-f3ac8a32-1d33-4777-913a-ec6906bdb657 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0725362 Dec 21 04:14:40.396180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a42fe6d2-018b-44b7-a27f-f5ab0612d0e9 req-ee587c38-910e-46b9-a354-66a70327663a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587785 Dec 21 04:14:40.400207 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.455189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:40.460042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.491691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.551817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:40.555809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.560030 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] 10.222.0.54 "PUT /v2.0/ports/ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1093 time: 1.3356915 Dec 21 04:14:40.560661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:40.563795 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45c33f25-411d-43ef-a2b1-3671ae5d04da" -d '{"events": [{"name": "network-changed", "server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:40.567338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.604311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3818cac0-a90e-4ead-98de-1320a44d68a3 service neutron] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:40.614209 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet ebe05454-5965-4b03-8688-507b5d8ea450 (CIDR: 172.20.0.0/28) Dec 21 04:14:40.651057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:40.658973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:40.663517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:40.667641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Pushing event updated for resources: {'Port': ['ID=551d61a1-90a3-4f41-bc80-bf8550cde525,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:40.701875 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d21b0779-1ef0-4262-beaf-927ed9fc97fe x-openstack-request-id: req-d21b0779-1ef0-4262-beaf-927ed9fc97fe {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:40.701875 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:40.701875 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d21b0779-1ef0-4262-beaf-927ed9fc97fe {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:40.702395 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'status': 'completed', 'code': 200} Dec 21 04:14:40.703380 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:14:40.704850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:14:40.767977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Attempting to bind port 551d61a1-90a3-4f41-bc80-bf8550cde525 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:40.768751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Attempting to bind port 551d61a1-90a3-4f41-bc80-bf8550cde525 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3d468df1-f39e-4631-93a8-0ef77f6535fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:40.769351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Attempting to bind port 551d61a1-90a3-4f41-bc80-bf8550cde525 on network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:40.784200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:40.785604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Checking segment: {'id': '3d468df1-f39e-4631-93a8-0ef77f6535fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:40.786695 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.789130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Bound using segment: {'id': '3d468df1-f39e-4631-93a8-0ef77f6535fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:40.792323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Bound port: 551d61a1-90a3-4f41-bc80-bf8550cde525, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3d468df1-f39e-4631-93a8-0ef77f6535fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:40.793792 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:40.855114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c33f25-411d-43ef-a2b1-3671ae5d04da req-2aed1926-63b3-4930-997b-ad7e62fb04e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:40.856653 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45c33f25-411d-43ef-a2b1-3671ae5d04da req-2aed1926-63b3-4930-997b-ad7e62fb04e7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1096 time: 0.1160004 Dec 21 04:14:40.871696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] For port 551d61a1-90a3-4f41-bc80-bf8550cde525, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:40.874754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] For port 551d61a1-90a3-4f41-bc80-bf8550cde525, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=551d61a1-90a3-4f41-bc80-bf8550cde525,segment=NetworkSegment(3d468df1-f39e-4631-93a8-0ef77f6535fd),segment_id=3d468df1-f39e-4631-93a8-0ef77f6535fd)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:40.898666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-43e75893-3750-4827-bf54-e23acd9b1226 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9236193 Dec 21 04:14:40.902048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33348) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:40.907126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:40.988076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:41.024472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c33f25-411d-43ef-a2b1-3671ae5d04da req-a7cdbc5e-0835-4d67-81be-db5d6ebc1c94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.026233 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45c33f25-411d-43ef-a2b1-3671ae5d04da req-a7cdbc5e-0835-4d67-81be-db5d6ebc1c94 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=f201aa828d124b4d96ae1f68f53fe955&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1532202 Dec 21 04:14:41.108066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9b960a-692d-4430-8cfb-bafa7dd18d20 None None] Pushing event updated for resources: {'Port': ['ID=551d61a1-90a3-4f41-bc80-bf8550cde525,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:41.187622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c33f25-411d-43ef-a2b1-3671ae5d04da req-59110368-e0da-46ed-93b2-6a43e60441e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.189089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45c33f25-411d-43ef-a2b1-3671ae5d04da req-59110368-e0da-46ed-93b2-6a43e60441e0 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1556594 Dec 21 04:14:41.192582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:41.196781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:41.351866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5a2461eb-ab7a-41dd-abfb-6f2456bf5b92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.353462 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-5a2461eb-ab7a-41dd-abfb-6f2456bf5b92 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1096 time: 0.0933425 Dec 21 04:14:41.527691 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-f5020719-414d-488e-80d1-7b157df77c2f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 217 time: 0.1543438 Dec 21 04:14:41.611062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-a073ecdb-abdf-47b2-8abe-d5960cb92168 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.611062 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-a073ecdb-abdf-47b2-8abe-d5960cb92168 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0783908 Dec 21 04:14:41.660156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-21e2bafe-5130-41e8-bef9-9d959dd4e9bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.671605 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-21e2bafe-5130-41e8-bef9-9d959dd4e9bd service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0536683 Dec 21 04:14:41.743364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b21cb7-345a-464e-8124-5815cb74166c req-dfd18991-17a2-4ad1-9e29-2fbef2df7d66 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.751225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8b21cb7-345a-464e-8124-5815cb74166c req-dfd18991-17a2-4ad1-9e29-2fbef2df7d66 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1382611 Dec 21 04:14:41.814670 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-d8dcef16-d893-43b2-9579-e745057bccc2 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335580 Dec 21 04:14:41.837652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8b21cb7-345a-464e-8124-5815cb74166c req-235d123f-3ada-4973-aa1c-a4ad15918e16 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0854568 Dec 21 04:14:41.876519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:41.928177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:41.934303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:41.938779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:41.939398 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:41.954042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=e74653e6-7b52-42bc-b683-df3093c42515,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:41.973706 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4279ca22-b538-4e72-b22d-5b29906f41ac req-0790afda-7665-4010-8306-a94cbbcc372c service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1535888 Dec 21 04:14:42.068668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33366) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:42.071653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cf6a170c-e8cf-4f88-b3d9-77e3c5164678 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.1656604 Dec 21 04:14:42.075512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'fixed_ips': [{'subnet_id': 'ebe05454-5965-4b03-8688-507b5d8ea450'}, {'subnet_id': 'e74653e6-7b52-42bc-b683-df3093c42515'}], 'name': 'tempest-PortsTestJSON-2069160167'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:42.319677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:42.454523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:42.486054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 4eab3480-a39d-44a4-bba7-7a75338fe349 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:42.534916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9da0e4b-9e12-4cef-b576-0b60601712bf None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:42.618301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-04cd8136-4b8f-4406-bde2-e073005f538d None None] Provisioning complete for port 551d61a1-90a3-4f41-bc80-bf8550cde525 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:42.618681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-04cd8136-4b8f-4406-bde2-e073005f538d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:42.764959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-04cd8136-4b8f-4406-bde2-e073005f538d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:42.858045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-04cd8136-4b8f-4406-bde2-e073005f538d None None] For port 551d61a1-90a3-4f41-bc80-bf8550cde525, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=551d61a1-90a3-4f41-bc80-bf8550cde525,segment=NetworkSegment(3d468df1-f39e-4631-93a8-0ef77f6535fd),segment_id=3d468df1-f39e-4631-93a8-0ef77f6535fd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:42.890967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] Update dhcp port {'port': {'network_id': '3c2b0410-5123-4ec7-8201-ae90937d4ff1', 'fixed_ips': [{'subnet_id': 'ebe05454-5965-4b03-8688-507b5d8ea450', 'ip_address': '172.20.0.2'}, {'subnet_id': 'e74653e6-7b52-42bc-b683-df3093c42515'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '551d61a1-90a3-4f41-bc80-bf8550cde525'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:14:42.938005 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-04cd8136-4b8f-4406-bde2-e073005f538d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:42.961957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.5 (3c2b0410-5123-4ec7-8201-ae90937d4ff1/ebe05454-5965-4b03-8688-507b5d8ea450/4eab3480-a39d-44a4-bba7-7a75338fe349) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:42.971614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.28 (3c2b0410-5123-4ec7-8201-ae90937d4ff1/e74653e6-7b52-42bc-b683-df3093c42515/4eab3480-a39d-44a4-bba7-7a75338fe349) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:42.998006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.011532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cd8136-4b8f-4406-bde2-e073005f538d None None] Pushing event updated for resources: {'Port': ['ID=551d61a1-90a3-4f41-bc80-bf8550cde525,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:43.044877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04085d4-5c32-45d9-984d-8ad4171107ba req-4706abfe-afdc-4ab4-b973-6d8bbb39946e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:43.050074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d04085d4-5c32-45d9-984d-8ad4171107ba req-4706abfe-afdc-4ab4-b973-6d8bbb39946e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1366234 Dec 21 04:14:43.123519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d04085d4-5c32-45d9-984d-8ad4171107ba req-9b162470-8c8b-4579-b171-0ea99305b146 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0554814 Dec 21 04:14:43.206261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.313766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 551d61a1-90a3-4f41-bc80-bf8550cde525 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:43.348549 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.398115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:43.401286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:43.408493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:43.425507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] Allocated IP 172.20.0.18 (3c2b0410-5123-4ec7-8201-ae90937d4ff1/e74653e6-7b52-42bc-b683-df3093c42515/551d61a1-90a3-4f41-bc80-bf8550cde525) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:43.441180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=4eab3480-a39d-44a4-bba7-7a75338fe349,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:43.471164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:43.471936 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.473230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 551d61a1-90a3-4f41-bc80-bf8550cde525 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:43.475219 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.545757 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b59e03a8-1e48-4f2e-b445-d5dc1ede7c3c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1004 time: 1.4748733 Dec 21 04:14:43.548071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33384) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:43.553829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'ebe05454-5965-4b03-8688-507b5d8ea450'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:43.627677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:14:43.645760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] For port 551d61a1-90a3-4f41-bc80-bf8550cde525, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=551d61a1-90a3-4f41-bc80-bf8550cde525,segment=NetworkSegment(3d468df1-f39e-4631-93a8-0ef77f6535fd),segment_id=3d468df1-f39e-4631-93a8-0ef77f6535fd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:43.737617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.804490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:43.832377 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.013161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:44.026114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8890082a-34cd-441f-94f8-19c572d306fb None None] Pushing event updated for resources: {'Port': ['ID=551d61a1-90a3-4f41-bc80-bf8550cde525,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:44.048612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'mac_address': 'fa:16:3e:75:f1:18', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:14:44.240556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Delete allocated IP 172.20.0.28 (3c2b0410-5123-4ec7-8201-ae90937d4ff1/e74653e6-7b52-42bc-b683-df3093c42515) {{(pid=110310) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 21 04:14:44.348541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.369841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ac11126b-e25e-4a58-b9ab-db17cde3b083 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:14:44.392095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:44.468351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.487483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf958a15-ccdd-40c5-b28a-cd10f48dce48 req-983b35dc-deac-4bbf-abcd-aeca476b7e9c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:44.491590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf958a15-ccdd-40c5-b28a-cd10f48dce48 req-983b35dc-deac-4bbf-abcd-aeca476b7e9c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0799921 Dec 21 04:14:44.494996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.548157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.577492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:44.636448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf958a15-ccdd-40c5-b28a-cd10f48dce48 req-7012ea16-8fb7-4df4-ac43-92d8e8f263ed tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1315768 Dec 21 04:14:44.692236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=4eab3480-a39d-44a4-bba7-7a75338fe349,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:44.725311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e39e41b-0700-4684-9316-07b01897a29e None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:44.740983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] In _notify_port_updated(), no bound segment for port 4eab3480-a39d-44a4-bba7-7a75338fe349 on network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:14:44.753301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:44.753301 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.753301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-215dc2b2-ddd2-47b2-ae23-63815680c502 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/ports/4eab3480-a39d-44a4-bba7-7a75338fe349 HTTP/1.1" status: 200 len: 919 time: 1.2006688 Dec 21 04:14:44.753301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33402) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:44.759450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ac11126b-e25e-4a58-b9ab-db17cde3b083'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:14:44.760118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'ebe05454-5965-4b03-8688-507b5d8ea450'}, {'subnet_id': 'e74653e6-7b52-42bc-b683-df3093c42515'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:44.843415 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:44.893176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-133096db-d344-4a6f-850a-230ee4c61d43 None None] Provisioning complete for port 551d61a1-90a3-4f41-bc80-bf8550cde525 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:44.896823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-133096db-d344-4a6f-850a-230ee4c61d43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.300378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.30 (3c2b0410-5123-4ec7-8201-ae90937d4ff1/e74653e6-7b52-42bc-b683-df3093c42515/4eab3480-a39d-44a4-bba7-7a75338fe349) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:45.349864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 551d61a1-90a3-4f41-bc80-bf8550cde525 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:45.415911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 551d61a1-90a3-4f41-bc80-bf8550cde525 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:45.416433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.476882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.520470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1e48f06d-97c7-49f3-924b-aa0f7a035872 None None] Provisioning complete for port 551d61a1-90a3-4f41-bc80-bf8550cde525 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:45.521088 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e48f06d-97c7-49f3-924b-aa0f7a035872 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.620706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:45.623111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1e48f06d-97c7-49f3-924b-aa0f7a035872 None None] Provisioning complete for port 4eab3480-a39d-44a4-bba7-7a75338fe349 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:45.623485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e48f06d-97c7-49f3-924b-aa0f7a035872 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.685156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1e48f06d-97c7-49f3-924b-aa0f7a035872 None None] Port 4eab3480-a39d-44a4-bba7-7a75338fe349 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:45.761478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.811901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-945905ab-ed99-4aed-b735-ad2a837af2b2 None None] Provisioning complete for port 4eab3480-a39d-44a4-bba7-7a75338fe349 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:45.812489 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-945905ab-ed99-4aed-b735-ad2a837af2b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.869208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port ac11126b-e25e-4a58-b9ab-db17cde3b083 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:14:45.872514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-945905ab-ed99-4aed-b735-ad2a837af2b2 None None] Port 4eab3480-a39d-44a4-bba7-7a75338fe349 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:45.880935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port ac11126b-e25e-4a58-b9ab-db17cde3b083 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:45.881315 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:45.972168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf1ced2-1044-4e3c-b9c8-2bfd24e3b989 req-beefbe2c-e5d2-4f80-8373-4ae74529dd7b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:45.977073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdf1ced2-1044-4e3c-b9c8-2bfd24e3b989 req-beefbe2c-e5d2-4f80-8373-4ae74529dd7b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 945 time: 0.2508488 Dec 21 04:14:46.003590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.032860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2fc68f22-d65e-4c13-bed6-22cc3e8cd545 None None] Provisioning complete for port 4eab3480-a39d-44a4-bba7-7a75338fe349 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:46.033203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2fc68f22-d65e-4c13-bed6-22cc3e8cd545 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.038905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:46.041373 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07afd4fb-4e8c-4476-a71d-874d329bd7b5" -d '{"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-plugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:46.090103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=4eab3480-a39d-44a4-bba7-7a75338fe349,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:46.118219 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e68076e-7b9e-4ec6-a08a-55555f53e937 x-openstack-request-id: req-6e68076e-7b9e-4ec6-a08a-55555f53e937 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:46.118565 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-plugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:46.118786 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6e68076e-7b9e-4ec6-a08a-55555f53e937 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:46.119218 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'code': 200} Dec 21 04:14:46.125107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:46.134615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2fc68f22-d65e-4c13-bed6-22cc3e8cd545 None None] Port 4eab3480-a39d-44a4-bba7-7a75338fe349 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:46.136581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] In _notify_port_updated(), no bound segment for port 4eab3480-a39d-44a4-bba7-7a75338fe349 on network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:14:46.142777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:46.143533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.148219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:46.158463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-11d22a49-41f6-4142-b4fe-cb7445f64b93 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/ports/4eab3480-a39d-44a4-bba7-7a75338fe349 HTTP/1.1" status: 200 len: 999 time: 1.4036579 Dec 21 04:14:46.171195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.227613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdf1ced2-1044-4e3c-b9c8-2bfd24e3b989 req-13e19531-d4ec-494a-9bba-565330d3992b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1490340 Dec 21 04:14:46.276312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:46.281761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-94784807-fecd-423c-a919-123542a056db None None] Provisioning complete for port 4eab3480-a39d-44a4-bba7-7a75338fe349 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:46.282141 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-94784807-fecd-423c-a919-123542a056db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.335401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-94784807-fecd-423c-a919-123542a056db None None] Port 4eab3480-a39d-44a4-bba7-7a75338fe349 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:46.695008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95197ba3-f9f3-431f-8fde-86c830e8188c req-c9225dd1-6cbc-4797-8140-00a0d934ae73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:46.697080 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-95197ba3-f9f3-431f-8fde-86c830e8188c req-c9225dd1-6cbc-4797-8140-00a0d934ae73 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1098 time: 0.4671283 Dec 21 04:14:46.700074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 4eab3480-a39d-44a4-bba7-7a75338fe349 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:46.700414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.808504 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-95197ba3-f9f3-431f-8fde-86c830e8188c req-f3eeaa44-4cbe-4329-a42e-80580e67c37b service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0935633 Dec 21 04:14:46.827656 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:46.840592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 4eab3480-a39d-44a4-bba7-7a75338fe349 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:47.131244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.165032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=4eab3480-a39d-44a4-bba7-7a75338fe349,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:47.345583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.349341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d6489b5e-da35-4f29-87ef-4c13ef3302ed tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/4eab3480-a39d-44a4-bba7-7a75338fe349 HTTP/1.1" status: 204 len: 168 time: 1.1998346 Dec 21 04:14:47.353245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33452) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:47.414883 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b1091821-0a69-4b77-aa41-869c963f76d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:47.419271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1091821-0a69-4b77-aa41-869c963f76d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/4eab3480-a39d-44a4-bba7-7a75338fe349 HTTP/1.1" status: 404 len: 333 time: 0.0640502 Dec 21 04:14:47.420705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33454) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:47.472127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9badd937-ee04-48ad-827b-2c767ee8deee req-c37b36b5-f5f6-4102-ad34-85bf5f972adc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:47.473670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9badd937-ee04-48ad-827b-2c767ee8deee req-c37b36b5-f5f6-4102-ad34-85bf5f972adc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1228554 Dec 21 04:14:47.508769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet e74653e6-7b52-42bc-b683-df3093c42515 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:14:47.521708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.591915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.606804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9badd937-ee04-48ad-827b-2c767ee8deee req-1d6d143b-16d9-4fdd-b1e7-a7d0860e92c7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1193123 Dec 21 04:14:47.727026 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.886498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.939891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=e74653e6-7b52-42bc-b683-df3093c42515,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:47.947749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:47.953812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3069e3d1-6fa7-4b81-97bb-9262eb104e9a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/e74653e6-7b52-42bc-b683-df3093c42515 HTTP/1.1" status: 204 len: 168 time: 0.5295415 Dec 21 04:14:47.954097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33464) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:47.955126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c727712c-b72e-4daa-8ce8-ba4b5e9f1064 None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:48.050921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet ebe05454-5965-4b03-8688-507b5d8ea450 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:14:48.069091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.191084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.321087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.470756 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.510206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=ebe05454-5965-4b03-8688-507b5d8ea450,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:48.519177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.526738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8a3855d7-69f1-4869-ad76-12792311be10 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/ebe05454-5965-4b03-8688-507b5d8ea450 HTTP/1.1" status: 204 len: 168 time: 0.5714161 Dec 21 04:14:48.533711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33468) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:48.614875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.750055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 551d61a1-90a3-4f41-bc80-bf8550cde525 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:48.750414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.833144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c8ade2-8500-4538-9113-d08329b50692 req-0525ce73-2821-4b95-89bf-70d2153f2c4f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:48.835840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20c8ade2-8500-4538-9113-d08329b50692 req-0525ce73-2821-4b95-89bf-70d2153f2c4f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1017971 Dec 21 04:14:48.871344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] For port 551d61a1-90a3-4f41-bc80-bf8550cde525, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=551d61a1-90a3-4f41-bc80-bf8550cde525,segment=NetworkSegment(3d468df1-f39e-4631-93a8-0ef77f6535fd),segment_id=3d468df1-f39e-4631-93a8-0ef77f6535fd)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:48.872118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:48.892555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 551d61a1-90a3-4f41-bc80-bf8550cde525 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:48.966766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-20c8ade2-8500-4538-9113-d08329b50692 req-c2ee15f9-1e0e-4d5e-ac19-50aae6a0809f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1251280 Dec 21 04:14:49.031257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcbb874-04c5-4e81-bb3d-134d77a7f46e req-c7fed13b-dd4f-480b-9a94-3fee8d5283b6 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:49.035671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dcbb874-04c5-4e81-bb3d-134d77a7f46e req-c7fed13b-dd4f-480b-9a94-3fee8d5283b6 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1097 time: 0.1027403 Dec 21 04:14:49.056751 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcbb874-04c5-4e81-bb3d-134d77a7f46e req-54950322-613a-450b-bb07-db0a7a2763dd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:49.088238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40905877-db08-438e-b7f5-50a25b2fcff1 None None] Network 3c2b0410-5123-4ec7-8201-ae90937d4ff1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:49.171752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997aa0b6-8090-4f12-9ea2-1a9f27aa6e49 req-8ad27503-f19a-464d-9f4c-80e5c796a036 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:49.176095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-997aa0b6-8090-4f12-9ea2-1a9f27aa6e49 req-8ad27503-f19a-464d-9f4c-80e5c796a036 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0911865 Dec 21 04:14:49.188813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6046b586-1d51-4d6b-a50f-55c042fda68e None None] Could not find standard attr ID for object 551d61a1-90a3-4f41-bc80-bf8550cde525. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:14:49.189938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:49.199476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'floatingip': {'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:49.203008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:49.312858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No DVR routers for this DVR port 551d61a1-90a3-4f41-bc80-bf8550cde525 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:14:49.316746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcbb874-04c5-4e81-bb3d-134d77a7f46e req-54950322-613a-450b-bb07-db0a7a2763dd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:49.337264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=551d61a1-90a3-4f41-bc80-bf8550cde525,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:49.349006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-884ce6de-7aa4-4157-b8a0-ac248cd9c352 None None] DHCP port deletion for 3c2b0410-5123-4ec7-8201-ae90937d4ff1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:14:49.375397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9dcbb874-04c5-4e81-bb3d-134d77a7f46e req-54950322-613a-450b-bb07-db0a7a2763dd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:49.450890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:49.458707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54950322-613a-450b-bb07-db0a7a2763dd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=124c9073-1822-4ac2-b62c-b1bfb7be1bd2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:49.473968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dcbb874-04c5-4e81-bb3d-134d77a7f46e req-54950322-613a-450b-bb07-db0a7a2763dd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4319315 Dec 21 04:14:49.708074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3bb174-2e39-414b-9488-b7db624526b8 req-1bb6ba89-9154-443a-8005-4d86e199626a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:49.714782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd3bb174-2e39-414b-9488-b7db624526b8 req-1bb6ba89-9154-443a-8005-4d86e199626a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1362765 Dec 21 04:14:49.858146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4407d9a9-badc-4886-9eaa-3017325c5f8c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:49.886697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd3bb174-2e39-414b-9488-b7db624526b8 req-a2171790-5383-4cc6-8efa-6a02c414adf5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1654019 Dec 21 04:14:49.891891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:49.970856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.005626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2126dc98-b0e4-4fe5-b7e0-a53d1dd81171 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a HTTP/1.1" status: 200 len: 993 time: 0.1169710 Dec 21 04:14:50.077492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3c2b0410-5123-4ec7-8201-ae90937d4ff1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:50.101117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d468df1-f39e-4631-93a8-0ef77f6535fd') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:50.101458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d468df1-f39e-4631-93a8-0ef77f6535fd') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:50.118023 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.161406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.183021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 116 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:14:50.183433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:14:50.186684 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:14:50.322755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.354515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-264f766c-6698-4f6a-8d2a-c02be6e06f74 req-439c995c-41ad-4667-aabb-f1bd96d40010 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:14:50.362979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-264f766c-6698-4f6a-8d2a-c02be6e06f74 req-439c995c-41ad-4667-aabb-f1bd96d40010 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0057991 Dec 21 04:14:50.378542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.390229 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.390229 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/3c2b0410-5123-4ec7-8201-ae90937d4ff1 HTTP/1.1" status: 204 len: 168 time: 1.8536885 Dec 21 04:14:50.398111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33510) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:50.424780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:50.424780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fac7d9a-fc5e-4497-8b78-9b7154b190f4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=3c2b0410-5123-4ec7-8201-ae90937d4ff1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:50.516823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16302581-5f1f-43d8-823f-448cbeb939d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:50.523133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:50.523387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-16302581-5f1f-43d8-823f-448cbeb939d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.1240010 Dec 21 04:14:50.657276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-084ca566-e76a-4ad9-a76b-6b56b35e18f8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1308286 Dec 21 04:14:50.664733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:50.672700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1491626092'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:50.673822 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Floating IP bd9d5060-5264-40f0-9557-b946f1a12429 associated. External IP: 172.25.5.221, port: ac11126b-e25e-4a58-b9ab-db17cde3b083. Dec 21 04:14:50.965681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:14:51.000009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:51.004558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.043747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:14:51.060065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.060826 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment ded6302b-2cb3-45a5-a6f6-e3e455245dc9 of type vlan for network 6aba4e7a-c097-46a9-85d3-5a1da924879d Dec 21 04:14:51.113283 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.144444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:14:51.149288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.157868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:14:51.203040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9e39eb3b-3201-4be2-a4b2-09d961c6fd3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "PUT /v2.0/floatingips/bd9d5060-5264-40f0-9557-b946f1a12429 HTTP/1.1" status: 200 len: 992 time: 2.0091107 Dec 21 04:14:51.203040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:14:51.205619 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e6a1725-f955-4b01-9f72-613ad51271ae" -d '{"events": [{"name": "network-changed", "server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:14:51.213581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:51.216897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.217499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:51.223556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:51.226313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.357249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 551d61a1-90a3-4f41-bc80-bf8550cde525 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:14:51.416359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 551d61a1-90a3-4f41-bc80-bf8550cde525 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:14:51.416685 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:14:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67fa4c7e-3229-4009-b7a2-619ec030261b x-openstack-request-id: req-67fa4c7e-3229-4009-b7a2-619ec030261b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:14:51.416989 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:14:51.417252 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-67fa4c7e-3229-4009-b7a2-619ec030261b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:14:51.417648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 551d61a1-90a3-4f41-bc80-bf8550cde525 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:14:51.417757 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'status': 'completed', 'code': 200} Dec 21 04:14:51.460553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7943525 Dec 21 04:14:51.464383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:51.468531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:51.470508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:51.507291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee5ce46-1dc7-4618-97fd-c49b1470ed13 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=6aba4e7a-c097-46a9-85d3-5a1da924879d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:51.534520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:14:51.558957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398d16bc-6b4d-4540-8e07-af80fa9322a8 req-0a4f1e49-48fc-4b2f-887c-281a410af667 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:51.561900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-398d16bc-6b4d-4540-8e07-af80fa9322a8 req-0a4f1e49-48fc-4b2f-887c-281a410af667 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.3094423 Dec 21 04:14:51.657977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-398d16bc-6b4d-4540-8e07-af80fa9322a8 req-d2b1f909-dc70-420f-813a-d2fe4822f474 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0887353 Dec 21 04:14:51.795839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-288d1579-7183-40cc-b235-a5ee1c25eb24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:51.797373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-288d1579-7183-40cc-b235-a5ee1c25eb24 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1098 time: 0.2935083 Dec 21 04:14:51.841836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-8a3ae99a-768a-4005-9da7-aaca66392058 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.4029658 Dec 21 04:14:51.857247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-d5c72f8c-7a8a-411b-afa8-b9fbf73ff94c service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:14:51.859202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-d5c72f8c-7a8a-411b-afa8-b9fbf73ff94c service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0093963 Dec 21 04:14:51.914332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:51.917844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:51.964015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-b5743bbb-82d0-435c-904f-fa06888e9950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:51.967858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-b5743bbb-82d0-435c-904f-fa06888e9950 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1602132 Dec 21 04:14:52.158235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'bd9d5060-5264-40f0-9557-b946f1a12429', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'floating_ip_address': '172.25.5.221', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3404, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'mac_address': 'fa:16:3e:75:f1:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:14:31Z', 'updated_at': '2021-12-21T04:14:50Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:52.199594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:14:52.209181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:14:52.209811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:52.345674 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-68e32183-4b60-4f90-80d7-08aeed954992 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1000 time: 0.3723314 Dec 21 04:14:52.375177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:14:52.536166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-7abe2ac8-e881-4c41-8d28-b70299c24501 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:52.537932 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-7abe2ac8-e881-4c41-8d28-b70299c24501 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.1831388 Dec 21 04:14:52.634583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:52.724634 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35b81212-d1e4-491a-86c2-ffc28833c2ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:52.795683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-25f5b99a-5926-48d0-bc45-4c06b1a0586d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:52.797445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-25f5b99a-5926-48d0-bc45-4c06b1a0586d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2510703 Dec 21 04:14:52.803321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=8eee073c-0bf9-46a9-b05a-5800584a45fe,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:52.808168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:52.808732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: 6aba4e7a-c097-46a9-85d3-5a1da924879d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:14:52.905095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b880812-0240-42b2-a251-d54043542a49 req-0d6fd0f2-d1fe-4424-8f05-ddddd0d63852 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:52.908554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b880812-0240-42b2-a251-d54043542a49 req-0d6fd0f2-d1fe-4424-8f05-ddddd0d63852 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1487734 Dec 21 04:14:52.932608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'bd9d5060-5264-40f0-9557-b946f1a12429', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'floating_ip_address': '172.25.5.221', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3404, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'mac_address': 'fa:16:3e:75:f1:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:14:31Z', 'updated_at': '2021-12-21T04:14:50Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:14:52.969825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:52.971178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a96a2495-e4a7-48af-9958-32a7af7cccb7 None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'bd9d5060-5264-40f0-9557-b946f1a12429', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'floating_ip_address': '172.25.5.221', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3404, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'mac_address': 'fa:16:3e:75:f1:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:14:31Z', 'updated_at': '2021-12-21T04:14:50Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:14:53.060253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b880812-0240-42b2-a251-d54043542a49 req-0af27eb3-63b5-49f2-9aa3-145a5a2e68a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1443470 Dec 21 04:14:53.104355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-3b40fc3c-1265-4487-9cd0-da4812048239 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2878544 Dec 21 04:14:53.105490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:14:53.220398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 6aba4e7a-c097-46a9-85d3-5a1da924879d) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:53.238666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:53.239315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:53.276593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-721a6bb4-7f7d-46d0-91aa-da2aaae9bdc3 None None] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:53.364930 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e6a1725-f955-4b01-9f72-613ad51271ae req-64d58b22-6d0c-4296-a55a-f8157bd9d79e service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2531927 Dec 21 04:14:53.399881 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-add3d19b-4cb2-4f9f-8629-c15a77e211d3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9308679 Dec 21 04:14:53.400326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33586) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:53.405169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d', 'name': 'tempest-PortsTestJSON-1354243658'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:53.405383 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a23e8991-7362-4318-a9b4-63ba400a1b95 None None] New status for floating IP bd9d5060-5264-40f0-9557-b946f1a12429: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:14:53.409349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-6aba4e7a-c097-46a9-85d3-5a1da924879d', 'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': '8eee073c-0bf9-46a9-b05a-5800584a45fe'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:14:53.410796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:53.711495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:53.754115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:53.758574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:53.798625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Allocated IP 172.20.0.2 (6aba4e7a-c097-46a9-85d3-5a1da924879d/8eee073c-0bf9-46a9-b05a-5800584a45fe/1ba1871b-3420-4624-9cbc-11e712bf8f22) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:53.812681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port ad415ce7-8b3a-4159-9643-d85aa8e508fa yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:53.990891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.094064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.173336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.7 (6aba4e7a-c097-46a9-85d3-5a1da924879d/8eee073c-0bf9-46a9-b05a-5800584a45fe/ad415ce7-8b3a-4159-9643-d85aa8e508fa) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:54.231820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Pushing event updated for resources: {'Port': ['ID=1ba1871b-3420-4624-9cbc-11e712bf8f22,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:54.263300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:54.267838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:54.276826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:54.346907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd1baba-9055-4bca-aa5a-bf54abdcca6f req-1cad426b-6c36-4fa7-8dca-8121068ec7f0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:54.359209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cd1baba-9055-4bca-aa5a-bf54abdcca6f req-1cad426b-6c36-4fa7-8dca-8121068ec7f0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1456742 Dec 21 04:14:54.447611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Attempting to bind port 1ba1871b-3420-4624-9cbc-11e712bf8f22 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:14:54.447988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Attempting to bind port 1ba1871b-3420-4624-9cbc-11e712bf8f22 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:14:54.448357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Attempting to bind port 1ba1871b-3420-4624-9cbc-11e712bf8f22 on network 6aba4e7a-c097-46a9-85d3-5a1da924879d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:14:54.471095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:14:54.471328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cd1baba-9055-4bca-aa5a-bf54abdcca6f req-2321a2b2-9ccd-4b72-8fd3-1634ec8d20df tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1103148 Dec 21 04:14:54.471480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Checking segment: {'id': 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:14:54.471885 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.473632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Bound using segment: {'id': 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:14:54.474127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Bound port: 1ba1871b-3420-4624-9cbc-11e712bf8f22, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:14:54.474518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.532602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.572294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] For port 1ba1871b-3420-4624-9cbc-11e712bf8f22, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:14:54.575811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] For port 1ba1871b-3420-4624-9cbc-11e712bf8f22, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ba1871b-3420-4624-9cbc-11e712bf8f22,segment=NetworkSegment(ded6302b-2cb3-45a5-a6f6-e3e455245dc9),segment_id=ded6302b-2cb3-45a5-a6f6-e3e455245dc9)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:14:54.663629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.665301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.748165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:54.752533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:54.762181 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:54.838061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e09397-efec-48d9-8771-a3aebd429739 None None] Pushing event updated for resources: {'Port': ['ID=1ba1871b-3420-4624-9cbc-11e712bf8f22,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:54.911456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:54.914538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:54.941227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=ad415ce7-8b3a-4159-9643-d85aa8e508fa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:54.961700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-cbdcd649-8992-4d88-9b45-5d5d743dd14f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:54.965012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-cbdcd649-8992-4d88-9b45-5d5d743dd14f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1097 time: 0.1053817 Dec 21 04:14:54.983766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:55.033346 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-68727ef5-2a3c-420c-9a7f-c3d9d1ccc038 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.6322484 Dec 21 04:14:55.036099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33606) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:55.049415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '6aba4e7a-c097-46a9-85d3-5a1da924879d', 'name': 'tempest-PortsTestJSON-906496595'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:14:55.056688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:55.159590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-a9ea2c81-087d-4a1f-83d8-cfabe1366bf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:55.175983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-a9ea2c81-087d-4a1f-83d8-cfabe1366bf5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.1977963 Dec 21 04:14:55.307767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-de409a75-f3d5-41d6-85f8-b94e627a4760 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 1001 time: 0.1232340 Dec 21 04:14:55.623004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-8c8b85ea-b970-404c-81c6-7b3dfc764377 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:55.623004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-8c8b85ea-b970-404c-81c6-7b3dfc764377 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0908234 Dec 21 04:14:55.640269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ba1871b-3420-4624-9cbc-11e712bf8f22 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:55.641659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-afb1bf74-c040-44b7-9d8a-1f0c7fa87443 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:55.641659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-afb1bf74-c040-44b7-9d8a-1f0c7fa87443 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0979850 Dec 21 04:14:55.692690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1ba1871b-3420-4624-9cbc-11e712bf8f22 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:55.703484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:55.728754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df52f784-0386-4113-8b16-bab12466a6e0 req-75e7c606-857d-473b-8b5f-937fcf77fea9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:55.731542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df52f784-0386-4113-8b16-bab12466a6e0 req-75e7c606-857d-473b-8b5f-937fcf77fea9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1023378 Dec 21 04:14:55.788492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:14:55.802555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:55.838838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 68124c24-b189-4683-b232-65ce08c5f7a2 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:14:55.926217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:55.940545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:56.014616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.6 (6aba4e7a-c097-46a9-85d3-5a1da924879d/8eee073c-0bf9-46a9-b05a-5800584a45fe/68124c24-b189-4683-b232-65ce08c5f7a2) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:14:56.132263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 1ba1871b-3420-4624-9cbc-11e712bf8f22, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ba1871b-3420-4624-9cbc-11e712bf8f22,segment=NetworkSegment(ded6302b-2cb3-45a5-a6f6-e3e455245dc9),segment_id=ded6302b-2cb3-45a5-a6f6-e3e455245dc9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:14:56.193914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:56.401250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=1ba1871b-3420-4624-9cbc-11e712bf8f22,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:56.511114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:56.525099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-a98aee2e-66ad-4ff6-8522-4b39419ed6e2 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9979098 Dec 21 04:14:56.659893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfa46b60-df8f-44ca-bbbb-30eff2b9d316 None None] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:56.677637 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:56.720370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df52f784-0386-4113-8b16-bab12466a6e0 req-ca083b14-d784-4640-9ca9-71dce8747e6c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.9820819 Dec 21 04:14:56.724790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-637fa71b-bca2-403c-98f8-089b30777cc4 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1776693 Dec 21 04:14:56.766111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:14:56.771817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:14:56.778354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:14:56.810967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=68124c24-b189-4683-b232-65ce08c5f7a2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:56.851608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:56.852352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:56.920635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fc4de731-cce0-4f3a-b799-a0a954fc582c None None] Provisioning complete for port 1ba1871b-3420-4624-9cbc-11e712bf8f22 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:56.921194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc4de731-cce0-4f3a-b799-a0a954fc582c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:56.940772 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f16b9142-b8c9-47d8-b57f-e5867d43f47f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.9034727 Dec 21 04:14:56.953301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33642) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:57.185847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-373729ff-30f7-4f4d-9eef-657126bb946c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:57.193752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-373729ff-30f7-4f4d-9eef-657126bb946c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.7 HTTP/1.1" status: 200 len: 922 time: 0.2488632 Dec 21 04:14:57.197470 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33648) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:57.372785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ba1871b-3420-4624-9cbc-11e712bf8f22 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:14:57.396794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 68124c24-b189-4683-b232-65ce08c5f7a2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:57.397420 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:57.473142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1ba1871b-3420-4624-9cbc-11e712bf8f22 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:57.473769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:57.477460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33650) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:57.654197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:57.693536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 68124c24-b189-4683-b232-65ce08c5f7a2 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:57.750800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Provisioning complete for port 1ba1871b-3420-4624-9cbc-11e712bf8f22 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:57.753531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:57.874611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-438e89a2-5ffe-4466-836c-3a04f269812d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:57.927470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Provisioning complete for port ad415ce7-8b3a-4159-9643-d85aa8e508fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:57.928310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.022471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8e9dee6-46f8-42b8-8ac8-ff1b3eeaafd1 req-5a93f9a0-3247-4a25-8821-9cc1abb29c26 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:58.024821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8e9dee6-46f8-42b8-8ac8-ff1b3eeaafd1 req-5a93f9a0-3247-4a25-8821-9cc1abb29c26 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1544285 Dec 21 04:14:58.029905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Port ad415ce7-8b3a-4159-9643-d85aa8e508fa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:58.049660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Provisioning complete for port 68124c24-b189-4683-b232-65ce08c5f7a2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:58.050181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.104060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-531fb3d0-5af4-48fc-afc5-83bfc2639189 None None] Port 68124c24-b189-4683-b232-65ce08c5f7a2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:58.108325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.130789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8e9dee6-46f8-42b8-8ac8-ff1b3eeaafd1 req-81497d02-875a-4b8f-a9f8-95f31e183d4d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0991957 Dec 21 04:14:58.151646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=68124c24-b189-4683-b232-65ce08c5f7a2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:58.227259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e3cb3027-0f66-4cb8-bbaf-c287c5866221 None None] Provisioning complete for port ad415ce7-8b3a-4159-9643-d85aa8e508fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:14:58.229760 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e3cb3027-0f66-4cb8-bbaf-c287c5866221 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.235909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-438e89a2-5ffe-4466-836c-3a04f269812d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.264891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.270553 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-acaba51f-ef62-4c05-8896-55f26dfd3e9b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/68124c24-b189-4683-b232-65ce08c5f7a2 HTTP/1.1" status: 204 len: 168 time: 1.0719829 Dec 21 04:14:58.273795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33662) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:58.291631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e3cb3027-0f66-4cb8-bbaf-c287c5866221 None None] Port ad415ce7-8b3a-4159-9643-d85aa8e508fa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:14:58.308579 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-bea4dfec-d152-41f4-99c1-8d01331d37c6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:58.309684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bea4dfec-d152-41f4-99c1-8d01331d37c6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/68124c24-b189-4683-b232-65ce08c5f7a2 HTTP/1.1" status: 404 len: 333 time: 0.0345972 Dec 21 04:14:58.312281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33664) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:58.382422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-438e89a2-5ffe-4466-836c-3a04f269812d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.403972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-21cc4ecf-4315-4628-ad5b-b4ad4ebe6f63 None None] Could not find standard attr ID for object 68124c24-b189-4683-b232-65ce08c5f7a2. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:14:58.446817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-438e89a2-5ffe-4466-836c-3a04f269812d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ded20c005faa4f40b1a74b6ed60a1563&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9679761 Dec 21 04:14:58.449026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438e89a2-5ffe-4466-836c-3a04f269812d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0bb3277-cbe5-4612-a43b-b24e6dc93f77,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:58.450383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33666) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:58.464677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port ad415ce7-8b3a-4159-9643-d85aa8e508fa {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:58.465089 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.518836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d4f62a8-f6e8-414b-a090-2b518b347ace admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.558665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d4f62a8-f6e8-414b-a090-2b518b347ace admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.588756 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.603570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for ad415ce7-8b3a-4159-9643-d85aa8e508fa owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:58.690612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d4f62a8-f6e8-414b-a090-2b518b347ace admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.693807 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d4f62a8-f6e8-414b-a090-2b518b347ace admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.695211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d4f62a8-f6e8-414b-a090-2b518b347ace admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d0bb3277-cbe5-4612-a43b-b24e6dc93f77 HTTP/1.1" status: 204 len: 168 time: 0.2435784 Dec 21 04:14:58.723661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4f62a8-f6e8-414b-a090-2b518b347ace admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0bb3277-cbe5-4612-a43b-b24e6dc93f77,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:58.744012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:58.900951 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:58.956074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=ad415ce7-8b3a-4159-9643-d85aa8e508fa,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:59.130817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.135340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2539b886-4e2f-475c-9560-0c8f1a60d1c4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/ad415ce7-8b3a-4159-9643-d85aa8e508fa HTTP/1.1" status: 204 len: 168 time: 0.8220019 Dec 21 04:14:59.137914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33686) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:59.171539 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e140490-e69c-4e69-bf9f-9eff6bfba6d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:14:59.173573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5e140490-e69c-4e69-bf9f-9eff6bfba6d2 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/ad415ce7-8b3a-4159-9643-d85aa8e508fa HTTP/1.1" status: 404 len: 333 time: 0.0342641 Dec 21 04:14:59.175979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33688) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:59.189491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Deleting port 5280f20e-a92a-416e-a26f-d0e9b22226a8 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:14:59.189967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.258809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet 8eee073c-0bf9-46a9-b05a-5800584a45fe {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:14:59.265263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.393053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.410728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.414709 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.463874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf27227c-b1f8-44bd-86ed-63c8d63f1727 req-f66f3234-9ef9-4227-8d17-473352d6bfc3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:14:59.466196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf27227c-b1f8-44bd-86ed-63c8d63f1727 req-f66f3234-9ef9-4227-8d17-473352d6bfc3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1546004 Dec 21 04:14:59.466641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Calling delete_port for 5280f20e-a92a-416e-a26f-d0e9b22226a8 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:14:59.556622 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-b4888644-844f-4e44-b88a-7bf3d49bea66 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1024470 Dec 21 04:14:59.589376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf27227c-b1f8-44bd-86ed-63c8d63f1727 req-dedfb1fc-cb00-447d-851a-011ee5c3430c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1170216 Dec 21 04:14:59.605988 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.656212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33694) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:59.799830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.827729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=8eee073c-0bf9-46a9-b05a-5800584a45fe,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:14:59.840222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:14:59.847676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80fdde41-9150-40ef-bcf3-5271805fbcd0 None None] Network 6aba4e7a-c097-46a9-85d3-5a1da924879d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:14:59.848296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0547595b-91be-4a23-abcb-8eb7d4025b41 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/8eee073c-0bf9-46a9-b05a-5800584a45fe HTTP/1.1" status: 204 len: 168 time: 0.6705112 Dec 21 04:14:59.848569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33696) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:14:59.944822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.079283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 1ba1871b-3420-4624-9cbc-11e712bf8f22 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:00.079760 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.146261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] DHCP port deletion for 6aba4e7a-c097-46a9-85d3-5a1da924879d request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:00.146543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-115047ce-6246-4afe-9d83-0d5c9909dc8c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.186326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] For port 1ba1871b-3420-4624-9cbc-11e712bf8f22, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ba1871b-3420-4624-9cbc-11e712bf8f22,segment=NetworkSegment(ded6302b-2cb3-45a5-a6f6-e3e455245dc9),segment_id=ded6302b-2cb3-45a5-a6f6-e3e455245dc9)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:00.189558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.202909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] Deleting port 1ba1871b-3420-4624-9cbc-11e712bf8f22 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:00.203435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.229611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 1ba1871b-3420-4624-9cbc-11e712bf8f22 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:00.246841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-958d4db3-ba91-4ad5-98c2-5a3ba1656faf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:00.249144 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-958d4db3-ba91-4ad5-98c2-5a3ba1656faf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1098 time: 0.6109257 Dec 21 04:15:00.312470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-115047ce-6246-4afe-9d83-0d5c9909dc8c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.367533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] For port 1ba1871b-3420-4624-9cbc-11e712bf8f22, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ba1871b-3420-4624-9cbc-11e712bf8f22,segment=NetworkSegment(ded6302b-2cb3-45a5-a6f6-e3e455245dc9),segment_id=ded6302b-2cb3-45a5-a6f6-e3e455245dc9)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:00.368193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.372480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.383767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] Calling delete_port for 1ba1871b-3420-4624-9cbc-11e712bf8f22 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:00.413600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-115047ce-6246-4afe-9d83-0d5c9909dc8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.423613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event deleted for resources: {'Port': ['ID=5280f20e-a92a-416e-a26f-d0e9b22226a8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:00.468167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.517020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.517405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=1ba1871b-3420-4624-9cbc-11e712bf8f22,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:00.533373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No DVR routers for this DVR port 1ba1871b-3420-4624-9cbc-11e712bf8f22 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:00.584392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] Pushing event deleted for resources: {'Port': ['ID=1ba1871b-3420-4624-9cbc-11e712bf8f22,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:00.596091 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.596482 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Floating IP 58193120-3154-414a-a16c-a7e0b600a2f8 disassociated (deleted). External IP: 172.25.5.172, port: 66e81b00-da04-499e-996a-ce50856ba3df. Dec 21 04:15:00.616720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f67dabd-ecfb-49c5-9130-ee3304cf2b1a None None] No DVR routers for this DVR port 1ba1871b-3420-4624-9cbc-11e712bf8f22 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:00.623656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-aeacf307-96e3-46bd-9f56-f62ca7558a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:00.623656 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-aeacf307-96e3-46bd-9f56-f62ca7558a19 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.3511591 Dec 21 04:15:00.701510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-115047ce-6246-4afe-9d83-0d5c9909dc8c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=13298b4d2aaf43858f1fda0eff36ad78&name=default HTTP/1.1" status: 200 len: 3000 time: 1.0442288 Dec 21 04:15:00.702112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.702282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33706) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:00.741317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6aba4e7a-c097-46a9-85d3-5a1da924879d']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:00.744100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-115047ce-6246-4afe-9d83-0d5c9909dc8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4d2c7ef-8db5-4cbb-9142-8349f1c9376e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:00.767049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:00.767049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ded6302b-2cb3-45a5-a6f6-e3e455245dc9') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:00.800728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.821068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.831874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:00.832274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4199eb73-1d53-4208-b587-58be61314ee1 req-9584f9bc-d9fb-492d-beaf-d4d3c82248a0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4199eb73-1d53-4208-b587-58be61314ee1 req-9584f9bc-d9fb-492d-beaf-d4d3c82248a0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1033807 Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:00.850809 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:00.861222 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-4e9a1f66-ec12-4beb-b8bf-30397af819db service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1002 time: 0.1793478 Dec 21 04:15:00.883462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33fc43de-4456-4f25-9e2e-46b4c4a77565 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:00.968493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4199eb73-1d53-4208-b587-58be61314ee1 req-b9dd299d-2971-445c-87c6-1a3c590406ba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0979373 Dec 21 04:15:01.003019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33fc43de-4456-4f25-9e2e-46b4c4a77565 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.012850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-4e2f8cb4-a578-40f5-a444-8f74186bb066 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:01.020469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-4e2f8cb4-a578-40f5-a444-8f74186bb066 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.1451776 Dec 21 04:15:01.040383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.071259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.075159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/6aba4e7a-c097-46a9-85d3-5a1da924879d HTTP/1.1" status: 204 len: 168 time: 1.2254152 Dec 21 04:15:01.076149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e0e57b6-a355-49f7-9008-e0d0fd18f300 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=6aba4e7a-c097-46a9-85d3-5a1da924879d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:01.080560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33712) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:01.089251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-756057539'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:01.176879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-fd0ffadd-7507-44dd-95b9-38da3baef48e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:01.181010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-fd0ffadd-7507-44dd-95b9-38da3baef48e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1571717 Dec 21 04:15:01.220205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Router fb8045d1-7b4d-4398-bde2-94a619776157 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:01.226468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:01.231153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.357440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:15:01.380751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33fc43de-4456-4f25-9e2e-46b4c4a77565 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.390341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33fc43de-4456-4f25-9e2e-46b4c4a77565 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.394380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-33fc43de-4456-4f25-9e2e-46b4c4a77565 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a4d2c7ef-8db5-4cbb-9142-8349f1c9376e HTTP/1.1" status: 204 len: 168 time: 0.6486337 Dec 21 04:15:01.404858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-2757da4d-a97e-45c9-8967-6f8475a073ee service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2172894 Dec 21 04:15:01.421467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.423605 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment d46c65c3-f406-44e2-8432-5c0ff5dd749c of type vlan for network 5d565fe6-3d22-4998-9c07-d45f10bfa417 Dec 21 04:15:01.467542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ba1871b-3420-4624-9cbc-11e712bf8f22 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:01.468698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fc43de-4456-4f25-9e2e-46b4c4a77565 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4d2c7ef-8db5-4cbb-9142-8349f1c9376e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:01.509402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1ba1871b-3420-4624-9cbc-11e712bf8f22 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:01.510054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ba1871b-3420-4624-9cbc-11e712bf8f22 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:01.561703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.631711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:01.638779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.642652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] Sync routers for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:01.653920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:01.654546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:01.681105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.689721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:01.690422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:01.735067 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eaba629b-a8b9-4eb5-b521-7f0ccc0af713 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "DELETE /v2.0/floatingips/58193120-3154-414a-a16c-a7e0b600a2f8 HTTP/1.1" status: 204 len: 168 time: 2.9862130 Dec 21 04:15:01.781076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:01.790402 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73" -d '{"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:01.800688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4bd35ba9-ab63-432a-8bc5-d27c5a968a31 req-e2bbe715-0e21-4631-aa1f-94ec5660f192 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3839016 Dec 21 04:15:01.852277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=5d565fe6-3d22-4998-9c07-d45f10bfa417,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:01.894036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:15:01.909326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9ba94007-d898-4764-ae69-333e51f65832 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.8241861 Dec 21 04:15:01.909687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33722) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:01.915957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:02.028329 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bde15ee-1764-42db-959d-5e7bbf839ed5 x-openstack-request-id: req-4bde15ee-1764-42db-959d-5e7bbf839ed5 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:02.028624 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:02.028875 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4bde15ee-1764-42db-959d-5e7bbf839ed5 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:02.029478 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'status': 'completed', 'code': 200} Dec 21 04:15:02.086657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-1b0aa671-a850-4d93-96a4-e723c343fb41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:02.093630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-1b0aa671-a850-4d93-96a4-e723c343fb41 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=620778ddaf44496aa625b5014155c9de&device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 1098 time: 0.1108477 Dec 21 04:15:02.098718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:02.152203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:02.158143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:02.319831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb7bfea1-0d36-4196-af3c-75533936e601 req-2cd55149-86ef-4221-8d8e-f782f1a4caf6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:02.328569 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb7bfea1-0d36-4196-af3c-75533936e601 req-2cd55149-86ef-4221-8d8e-f782f1a4caf6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.2281721 Dec 21 04:15:02.498627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:02.505271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb7bfea1-0d36-4196-af3c-75533936e601 req-dce43813-2294-46d4-a400-215eb8f58b28 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1755672 Dec 21 04:15:02.545828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-328bf84f-ed99-4c86-aa41-41b3ef581b9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:02.547722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-328bf84f-ed99-4c86-aa41-41b3ef581b9a service neutron] 10.222.0.31 "GET /v2.0/networks?id=9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 200 len: 915 time: 0.4462032 Dec 21 04:15:02.565323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] Checking router: fb8045d1-7b4d-4398-bde2-94a619776157 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:02.578019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:02.580792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:02.673523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef600582-c060-4d43-be31-dbb826cd694a req-97bbfe7f-26aa-4f6d-9fc6-ac84fca42c8e tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:02.676095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef600582-c060-4d43-be31-dbb826cd694a req-97bbfe7f-26aa-4f6d-9fc6-ac84fca42c8e tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 946 time: 0.2049801 Dec 21 04:15:02.678256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-dd33dbbd-30ec-4293-a539-29f41bd2f4ab service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 200 len: 217 time: 0.1183126 Dec 21 04:15:02.723803 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:02.735624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:02.842250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-b539c0e2-af8c-4b4c-b524-307f6e594319 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:02.845723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-b539c0e2-af8c-4b4c-b524-307f6e594319 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 200 len: 853 time: 0.1562386 Dec 21 04:15:02.857578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef600582-c060-4d43-be31-dbb826cd694a req-1cadd5ab-2289-4672-918e-b797920cead2 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1739173 Dec 21 04:15:02.927001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=b78c9042-4ffd-4a26-94fd-966e82dfadb9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:02.974216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-ab4e0397-af75-4128-8e3d-b689b8f307fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:02.977264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-ab4e0397-af75-4128-8e3d-b689b8f307fc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9e019c2c-b199-4210-baef-b6bda8c43e06&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1158745 Dec 21 04:15:02.991225 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': 'd46c65c3-f406-44e2-8432-5c0ff5dd749c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:02.991601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: 5d565fe6-3d22-4998-9c07-d45f10bfa417, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:15:03.108591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:15:03.239869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-35db06f4-205c-44b3-baf4-4bbad6d731cd service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2460117 Dec 21 04:15:03.256430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5d565fe6-3d22-4998-9c07-d45f10bfa417) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:03.261147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:03.261737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:03.295467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ef3c9b0-8cc3-4e2b-b955-f64221c77ec1 None None] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:03.365078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:03.369779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-114798dd-1a51-4f3d-9a22-8d913bc6bdd3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4564898 Dec 21 04:15:03.370074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33756) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:03.375383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417', 'name': 'tempest-PortsTestJSON-116659962', 'fixed_ips': [{'subnet_id': 'b78c9042-4ffd-4a26-94fd-966e82dfadb9', 'ip_address': '172.20.0.10'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:03.474841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bc62e8e-67d7-4bb3-854f-2d80dbce07e3 None None] The sync data for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 is: [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '594f295c-89df-4262-968f-a11a1037350c', 'name': '', 'network_id': '9e019c2c-b199-4210-baef-b6bda8c43e06', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'mac_address': 'fa:16:3e:d6:68:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_interface', 'standard_attr_id': 2704, 'fixed_ips': [{'subnet_id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:05Z', 'updated_at': '2021-12-21T04:09:11Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'subnets': [{'id': 'd1e185a5-063a-405d-ae9d-3ac5d19302c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:03.536240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9b3a9dc-c105-47e7-b3f0-0ca35ac48e73 req-857eb6ad-91e0-4515-a2c0-70e82f0d1494 service neutron] 10.222.0.31 "GET /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2860038 Dec 21 04:15:03.670403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5d565fe6-3d22-4998-9c07-d45f10bfa417', 'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': 'b78c9042-4ffd-4a26-94fd-966e82dfadb9'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:03.672137 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:03.779105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a6d1e5-46fd-4169-abe8-7f77d1904042 req-3e77d6ea-ea21-4877-a4b7-674fd3ff4658 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:03.783763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1a6d1e5-46fd-4169-abe8-7f77d1904042 req-3e77d6ea-ea21-4877-a4b7-674fd3ff4658 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1590912 Dec 21 04:15:03.867176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:03.922378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1a6d1e5-46fd-4169-abe8-7f77d1904042 req-277b46fc-cd91-403e-8a5e-b7fc99016b32 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1336906 Dec 21 04:15:04.029367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Allocated IP 172.20.0.2 (5d565fe6-3d22-4998-9c07-d45f10bfa417/b78c9042-4ffd-4a26-94fd-966e82dfadb9/e1bf8ed5-b500-432e-9d85-78198c613310) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:04.164675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78776492-b747-4c28-b45b-1c5e34133a7a req-c16439ad-4b1b-48a9-ba0f-a6687de51994 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:04.166503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78776492-b747-4c28-b45b-1c5e34133a7a req-c16439ad-4b1b-48a9-ba0f-a6687de51994 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 946 time: 0.1056759 Dec 21 04:15:04.178543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.217465 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ac75e9b-9d7d-4ad0-9f7b-49235c937bb0 None None] New status for floating IP 58193120-3154-414a-a16c-a7e0b600a2f8: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:15:04.218632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port bb4ec065-e13b-4ff3-920c-c8e17334bb11 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:15:04.276243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78776492-b747-4c28-b45b-1c5e34133a7a req-19b4a067-aa5e-459c-a55e-6b4b70e9219c tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/security-groups?id=3549b741-8ac3-4c54-9db1-691842885eb8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1030157 Dec 21 04:15:04.407299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f790068-ece6-4363-9764-79f7a0c12eab req-1bb36659-2608-4918-843c-33cdcb88f737 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:04.409922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f790068-ece6-4363-9764-79f7a0c12eab req-1bb36659-2608-4918-843c-33cdcb88f737 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.31 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 946 time: 0.1061323 Dec 21 04:15:04.465077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.559718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.564501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Deleting port 66e81b00-da04-499e-996a-ce50856ba3df {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:04.564907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.670404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.10 (5d565fe6-3d22-4998-9c07-d45f10bfa417/b78c9042-4ffd-4a26-94fd-966e82dfadb9/bb4ec065-e13b-4ff3-920c-c8e17334bb11) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:04.771730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] For port 66e81b00-da04-499e-996a-ce50856ba3df, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=66e81b00-da04-499e-996a-ce50856ba3df,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:04.772261 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.794272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Calling delete_port for 66e81b00-da04-499e-996a-ce50856ba3df owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:04.894499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:04.902675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:04.908489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:04.952905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Pushing event updated for resources: {'Port': ['ID=e1bf8ed5-b500-432e-9d85-78198c613310,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:04.980465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Attempting to bind port e1bf8ed5-b500-432e-9d85-78198c613310 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:04.980856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Attempting to bind port e1bf8ed5-b500-432e-9d85-78198c613310 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd46c65c3-f406-44e2-8432-5c0ff5dd749c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:04.981228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Attempting to bind port e1bf8ed5-b500-432e-9d85-78198c613310 on network 5d565fe6-3d22-4998-9c07-d45f10bfa417 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:04.986720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:04.987155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Checking segment: {'id': 'd46c65c3-f406-44e2-8432-5c0ff5dd749c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:04.987565 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.987968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Bound using segment: {'id': 'd46c65c3-f406-44e2-8432-5c0ff5dd749c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:04.988445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Bound port: e1bf8ed5-b500-432e-9d85-78198c613310, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd46c65c3-f406-44e2-8432-5c0ff5dd749c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:04.989399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:04.992669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.057198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b850357b-193a-4705-b650-85798d9cec3a None None] For port e1bf8ed5-b500-432e-9d85-78198c613310, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:05.060836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b850357b-193a-4705-b650-85798d9cec3a None None] For port e1bf8ed5-b500-432e-9d85-78198c613310, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1bf8ed5-b500-432e-9d85-78198c613310,segment=NetworkSegment(d46c65c3-f406-44e2-8432-5c0ff5dd749c),segment_id=d46c65c3-f406-44e2-8432-5c0ff5dd749c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:05.117524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4503c69e-395a-45a3-a8b6-da7ec67b01e0 req-d67d0d77-0685-49f2-8ca4-0d980411bf68 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:05.134892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4503c69e-395a-45a3-a8b6-da7ec67b01e0 req-d67d0d77-0685-49f2-8ca4-0d980411bf68 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1238880 Dec 21 04:15:05.148751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.149171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.153370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.249038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b850357b-193a-4705-b650-85798d9cec3a None None] Pushing event updated for resources: {'Port': ['ID=e1bf8ed5-b500-432e-9d85-78198c613310,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:05.259303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=bb4ec065-e13b-4ff3-920c-c8e17334bb11,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:05.291856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:05.297791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:05.297791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:05.346317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event deleted for resources: {'Port': ['ID=66e81b00-da04-499e-996a-ce50856ba3df,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:05.403715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] No DVR routers for this DVR port 66e81b00-da04-499e-996a-ce50856ba3df on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:05.407156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.410986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f790068-ece6-4363-9764-79f7a0c12eab req-516b1100-f07f-433a-bcda-8ebde3e3d9d9 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.31 "DELETE /v2.0/ports/66e81b00-da04-499e-996a-ce50856ba3df HTTP/1.1" status: 204 len: 173 time: 0.9931595 Dec 21 04:15:05.424461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'name': 'network-vif-deleted', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:05.427103 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-336fa9fe-2ef2-4e21-b5be-fffcc8c77dac" -d '{"events": [{"server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "name": "network-vif-deleted", "tag": "66e81b00-da04-499e-996a-ce50856ba3df"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:05.438734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:05.440480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.471989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4503c69e-395a-45a3-a8b6-da7ec67b01e0 req-61d3910a-8c1f-4e28-8bbe-8ad6d64b3bb6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3270833 Dec 21 04:15:05.475919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-efe6ecc7-4586-4ce0-afb2-6a546cd4cfe1 req-9644243e-6b2a-459a-af2e-99bedccb8b88 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0943930 Dec 21 04:15:05.548502 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-96031d56-f37b-4264-9913-3b9581a2ebdd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.1771846 Dec 21 04:15:05.551182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33804) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:05.557435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '5d565fe6-3d22-4998-9c07-d45f10bfa417', 'name': 'tempest-PortsTestJSON-435415966', 'fixed_ips': [{'subnet_id': 'b78c9042-4ffd-4a26-94fd-966e82dfadb9', 'ip_address': '172.20.0.9'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:05.876498 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97bdcffb-0566-4f14-b145-0a19a607fd20 x-openstack-request-id: req-97bdcffb-0566-4f14-b145-0a19a607fd20 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:05.876836 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "03aef065-24b8-400c-8e95-d05a9816bd77", "name": "network-vif-deleted", "tag": "66e81b00-da04-499e-996a-ce50856ba3df", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:05.877104 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-97bdcffb-0566-4f14-b145-0a19a607fd20 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:05.877498 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '03aef065-24b8-400c-8e95-d05a9816bd77', 'name': 'network-vif-deleted', 'tag': '66e81b00-da04-499e-996a-ce50856ba3df', 'status': 'completed', 'code': 200} Dec 21 04:15:05.924601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:05.930587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:05.980226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 33c94ec8-599d-47bc-b69a-b03f2f862778 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:15:06.294160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.9 (5d565fe6-3d22-4998-9c07-d45f10bfa417/b78c9042-4ffd-4a26-94fd-966e82dfadb9/33c94ec8-599d-47bc-b69a-b03f2f862778) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:06.657290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70f9d690-2208-45f5-9437-df8de62d81b9 req-78f61788-4c95-4055-8d5c-edcbcd445c90 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0618324 Dec 21 04:15:06.697490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:06.723562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01f7130-09cc-4d50-ac57-20ffd44cae11 req-1cc5a2f6-6e17-48de-8c45-457e71460e61 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:06.725975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b01f7130-09cc-4d50-ac57-20ffd44cae11 req-1cc5a2f6-6e17-48de-8c45-457e71460e61 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0858786 Dec 21 04:15:06.802294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b01f7130-09cc-4d50-ac57-20ffd44cae11 req-8678774b-bf9d-416c-8f49-c3bd7cc38990 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0702038 Dec 21 04:15:06.898127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.006880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:07.006880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:07.006880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:07.029120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce508245-95c8-45f1-9dcf-bfad13688ae7 None None] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:07.057662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:07.058327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.086232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=33c94ec8-599d-47bc-b69a-b03f2f862778,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:07.125749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5d072560-bdaf-40a9-b11d-693668ad0d1a None None] Provisioning complete for port e1bf8ed5-b500-432e-9d85-78198c613310 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:07.126464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d072560-bdaf-40a9-b11d-693668ad0d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.148977 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6e987dae-9d2e-4cd2-b3bb-3f864a47a87b tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.5965106 Dec 21 04:15:07.151783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33822) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:07.247579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62db2271-e531-4968-80f2-a70acd5b0865 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:07.251995 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-62db2271-e531-4968-80f2-a70acd5b0865 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 922 time: 0.0965652 Dec 21 04:15:07.252304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:07.291905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d072560-bdaf-40a9-b11d-693668ad0d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.331839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c81f307-7c40-4b74-8693-2698a6b026a3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:07.338295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c81f307-7c40-4b74-8693-2698a6b026a3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:07.345177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c81f307-7c40-4b74-8693-2698a6b026a3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:07.346881 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8c81f307-7c40-4b74-8693-2698a6b026a3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2376 time: 0.0934889 Dec 21 04:15:07.349805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:07.407774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5d072560-bdaf-40a9-b11d-693668ad0d1a None None] For port e1bf8ed5-b500-432e-9d85-78198c613310, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1bf8ed5-b500-432e-9d85-78198c613310,segment=NetworkSegment(d46c65c3-f406-44e2-8432-5c0ff5dd749c),segment_id=d46c65c3-f406-44e2-8432-5c0ff5dd749c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:07.431732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e1bf8ed5-b500-432e-9d85-78198c613310 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:07.484551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 33c94ec8-599d-47bc-b69a-b03f2f862778 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:07.484894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.520461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e1bf8ed5-b500-432e-9d85-78198c613310 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:07.520761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.524907 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5d072560-bdaf-40a9-b11d-693668ad0d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.637427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.652007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 33c94ec8-599d-47bc-b69a-b03f2f862778 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:07.661354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d072560-bdaf-40a9-b11d-693668ad0d1a None None] Pushing event updated for resources: {'Port': ['ID=e1bf8ed5-b500-432e-9d85-78198c613310,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:07.700403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Provisioning complete for port 33c94ec8-599d-47bc-b69a-b03f2f862778 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:07.700924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.743770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Port 33c94ec8-599d-47bc-b69a-b03f2f862778 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:07.808866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Provisioning complete for port bb4ec065-e13b-4ff3-920c-c8e17334bb11 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:07.809184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:07.889426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Port bb4ec065-e13b-4ff3-920c-c8e17334bb11 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:07.897208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-045e619b-4558-427d-855f-1b7fd2f9db48 req-c8ec6a55-9d48-441a-ab08-400a4a72b3cd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0870500 Dec 21 04:15:07.936692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Provisioning complete for port e1bf8ed5-b500-432e-9d85-78198c613310 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:07.936692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-920d3db8-afe9-4c10-81a3-f0d82e066ad2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.043144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bb7c7a-cc44-4b0f-817f-fc95fc9f1a6b req-d75d8605-925d-4c04-b2fd-c13e19c868de tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:08.048639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04bb7c7a-cc44-4b0f-817f-fc95fc9f1a6b req-d75d8605-925d-4c04-b2fd-c13e19c868de tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0666938 Dec 21 04:15:08.096603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.114132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04bb7c7a-cc44-4b0f-817f-fc95fc9f1a6b req-1f85e558-fccd-46bd-b504-5c38656253f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0611084 Dec 21 04:15:08.192657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=33c94ec8-599d-47bc-b69a-b03f2f862778,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:08.193114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 66e81b00-da04-499e-996a-ce50856ba3df no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:08.221371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 66e81b00-da04-499e-996a-ce50856ba3df {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:08.221750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 66e81b00-da04-499e-996a-ce50856ba3df not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:08.224503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-aae90942-16ea-4d01-aaeb-3b477c2fbdf0 None None] Provisioning complete for port bb4ec065-e13b-4ff3-920c-c8e17334bb11 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:08.224876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aae90942-16ea-4d01-aaeb-3b477c2fbdf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.249113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.252795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c23ce83-8fd5-477a-91b7-0d605c448189 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/33c94ec8-599d-47bc-b69a-b03f2f862778 HTTP/1.1" status: 204 len: 168 time: 0.9017801 Dec 21 04:15:08.255670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33858) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:08.263410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-aae90942-16ea-4d01-aaeb-3b477c2fbdf0 None None] Port bb4ec065-e13b-4ff3-920c-c8e17334bb11 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:08.288038 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-93e66bab-3c0e-43d1-bb00-b26ef5501388 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:15:08.292384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33860) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:08.292511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-93e66bab-3c0e-43d1-bb00-b26ef5501388 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/33c94ec8-599d-47bc-b69a-b03f2f862778 HTTP/1.1" status: 404 len: 333 time: 0.0357819 Dec 21 04:15:08.376370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-592f461d-0da4-48ec-a7a4-952ede8fb6e5 None None] Could not find standard attr ID for object 33c94ec8-599d-47bc-b69a-b03f2f862778. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:15:08.423428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port bb4ec065-e13b-4ff3-920c-c8e17334bb11 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:08.424017 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.520334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.545016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for bb4ec065-e13b-4ff3-920c-c8e17334bb11 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:08.860430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.888371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=bb4ec065-e13b-4ff3-920c-c8e17334bb11,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:08.973784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:08.979352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f8450f2-0980-481e-8b09-be5f08444688 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/bb4ec065-e13b-4ff3-920c-c8e17334bb11 HTTP/1.1" status: 204 len: 168 time: 0.6847441 Dec 21 04:15:08.981375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33876) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:09.018098 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-ad52c35b-cf3b-4663-a2f6-371966fc7613 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:15:09.020050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad52c35b-cf3b-4663-a2f6-371966fc7613 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/bb4ec065-e13b-4ff3-920c-c8e17334bb11 HTTP/1.1" status: 404 len: 333 time: 0.0375929 Dec 21 04:15:09.033819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33878) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:09.036400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7275cf89-3e93-4960-9ee8-7548205cdf15 req-8adc91e4-bf1c-4719-abe3-bc914bcc93bb tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0452881 Dec 21 04:15:09.104595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet b78c9042-4ffd-4a26-94fd-966e82dfadb9 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:09.108382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.150701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.240810 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.258329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cccdafb3-48ce-4d1b-ab40-a661b2b24ec0 req-b6263e89-a768-43f7-b1c2-53360a872a1f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:09.261040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cccdafb3-48ce-4d1b-ab40-a661b2b24ec0 req-b6263e89-a768-43f7-b1c2-53360a872a1f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0671928 Dec 21 04:15:09.350087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e1bf8ed5-b500-432e-9d85-78198c613310 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:09.383202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cccdafb3-48ce-4d1b-ab40-a661b2b24ec0 req-0ca415bc-f1cd-42e5-83c9-1ffeafb8cd41 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1128886 Dec 21 04:15:09.407894 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.427459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e1bf8ed5-b500-432e-9d85-78198c613310 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:09.428151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.438180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=b78c9042-4ffd-4a26-94fd-966e82dfadb9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:09.454241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.458403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8ec1048c-f7a2-40cb-b056-d8488ed4d6e1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/b78c9042-4ffd-4a26-94fd-966e82dfadb9 HTTP/1.1" status: 204 len: 168 time: 0.4235423 Dec 21 04:15:09.462453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33886) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:09.466844 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-2f29f122-5cb3-45e5-a5c9-f2e8d806da2b service neutron] show failed (client error): The resource could not be found. Dec 21 04:15:09.467924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-2f29f122-5cb3-45e5-a5c9-f2e8d806da2b service neutron] 10.222.0.31 "GET /v2.0/ports/a1a159da-8ede-44a2-8929-065e82a2dee0/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.1294985 Dec 21 04:15:09.497376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d29d531c-bb98-4619-a12b-8eda77ca5bed None None] Network 5d565fe6-3d22-4998-9c07-d45f10bfa417 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:09.578128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.676015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port e1bf8ed5-b500-432e-9d85-78198c613310 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:09.676667 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.736642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] DHCP port deletion for 5d565fe6-3d22-4998-9c07-d45f10bfa417 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:09.821330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] For port e1bf8ed5-b500-432e-9d85-78198c613310, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1bf8ed5-b500-432e-9d85-78198c613310,segment=NetworkSegment(d46c65c3-f406-44e2-8432-5c0ff5dd749c),segment_id=d46c65c3-f406-44e2-8432-5c0ff5dd749c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:09.821973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.835444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] Deleting port e1bf8ed5-b500-432e-9d85-78198c613310 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:09.836378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.847007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for e1bf8ed5-b500-432e-9d85-78198c613310 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:09.980686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] For port e1bf8ed5-b500-432e-9d85-78198c613310, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1bf8ed5-b500-432e-9d85-78198c613310,segment=NetworkSegment(d46c65c3-f406-44e2-8432-5c0ff5dd749c),segment_id=d46c65c3-f406-44e2-8432-5c0ff5dd749c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:09.981117 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:09.995641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] Calling delete_port for e1bf8ed5-b500-432e-9d85-78198c613310 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:10.033858 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.114484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=e1bf8ed5-b500-432e-9d85-78198c613310,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:10.144352 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.169720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No DVR routers for this DVR port e1bf8ed5-b500-432e-9d85-78198c613310 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:10.171363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] Pushing event deleted for resources: {'Port': ['ID=e1bf8ed5-b500-432e-9d85-78198c613310,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:10.190320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad53effc-d627-4e4c-b029-36df53f23f3a None None] No DVR routers for this DVR port e1bf8ed5-b500-432e-9d85-78198c613310 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:10.226795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22b22dd9-b13c-4c65-8427-da9501d84e49 req-4e3d26a5-3370-42b2-9831-4f8f5855ccdd tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0729010 Dec 21 04:15:10.312260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.315755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-07f1254b-7123-4f50-8e75-feb747a60354 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:10.317289 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-07f1254b-7123-4f50-8e75-feb747a60354 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 1097 time: 0.2756515 Dec 21 04:15:10.342191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5d565fe6-3d22-4998-9c07-d45f10bfa417']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:10.348631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:10.378358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd46c65c3-f406-44e2-8432-5c0ff5dd749c') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:10.379281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd46c65c3-f406-44e2-8432-5c0ff5dd749c') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:10.392098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.431906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.439272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.442861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:10.443280 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:10.446984 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:10.536448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a36ea3-cfe3-4c84-af82-b29fdfcf2005 req-0d748029-fe37-4ad2-b2bf-096d8e89f50b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:10.546296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8a36ea3-cfe3-4c84-af82-b29fdfcf2005 req-0d748029-fe37-4ad2-b2bf-096d8e89f50b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.0655642 Dec 21 04:15:10.607980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8a36ea3-cfe3-4c84-af82-b29fdfcf2005 req-7e7a9d71-6a3b-43aa-9e17-c00d2e112ed8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0607779 Dec 21 04:15:10.878790 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:15:10.987733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.043572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.046705 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/5d565fe6-3d22-4998-9c07-d45f10bfa417 HTTP/1.1" status: 204 len: 168 time: 1.5818927 Dec 21 04:15:11.051466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33946) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:11.061379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1911438967'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:11.067542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c69a50-ee28-481d-a7db-e0151b750f38 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=5d565fe6-3d22-4998-9c07-d45f10bfa417,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:11.165938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:11.204813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:11.205220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:11.215410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.264677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:11.267264 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-30362876-9801-48f4-9c48-928f4d25664f" -d '{"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:11.271820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.289212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Transition to ACTIVE for port object a1a159da-8ede-44a2-8929-065e82a2dee0 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:15:11.306691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:15:11.359766 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.402357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.402707 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Added segment 64383d3d-c51f-435d-9679-8a31f0a45eab of type vlan for network 8170af88-8fa5-45ac-b402-8b68e70db386 Dec 21 04:15:11.461149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:11.468002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e1bf8ed5-b500-432e-9d85-78198c613310 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:11.511107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e1bf8ed5-b500-432e-9d85-78198c613310 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:11.511672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e1bf8ed5-b500-432e-9d85-78198c613310 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:11.532425 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3aced6e-ca3a-4dd9-bf3b-1d9707f1fa27 x-openstack-request-id: req-c3aced6e-ca3a-4dd9-bf3b-1d9707f1fa27 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:11.532799 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:11.533115 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c3aced6e-ca3a-4dd9-bf3b-1d9707f1fa27 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:11.533687 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'code': 200} Dec 21 04:15:11.534575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.617637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7e62f7b-1e63-4897-8091-018f4101015e req-246ec865-268f-4a6e-832b-6b5432e13267 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.1074276 Dec 21 04:15:11.679987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] No DVR routers for this DVR port a1a159da-8ede-44a2-8929-065e82a2dee0 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:11.743318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.749654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:11.750737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.790118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14399976-8055-4239-95c1-290e9dae0773 req-e20e89b1-ddb7-4e1e-ad58-ca8118e13275 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:11.792093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14399976-8055-4239-95c1-290e9dae0773 req-e20e89b1-ddb7-4e1e-ad58-ca8118e13275 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.1078782 Dec 21 04:15:11.859781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Network': ['ID=8170af88-8fa5-45ac-b402-8b68e70db386,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:11.874296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8170af88-8fa5-45ac-b402-8b68e70db386 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:15:11.880599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:11.884153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:11.884153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 on network 3f781088-f4ae-4039-bd42-2337b91d459d {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:11.887072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Port a1a159da-8ede-44a2-8929-065e82a2dee0 on network 3f781088-f4ae-4039-bd42-2337b91d459d not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:15:11.887952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Attempting to bind port a1a159da-8ede-44a2-8929-065e82a2dee0 on network 3f781088-f4ae-4039-bd42-2337b91d459d {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:11.894121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:11.895042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Checking segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:11.895661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Bound using segment: {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:11.896753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Bound port: a1a159da-8ede-44a2-8929-065e82a2dee0, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5462f583-a9fa-4260-a352-17f7da388684', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:11.897277 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:11.919442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14399976-8055-4239-95c1-290e9dae0773 req-4ebc35e3-d4e1-4f57-8c00-e7923ddae3dc tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1105669 Dec 21 04:15:11.935370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07dbc045-8d13-46ca-a9e0-f2eeda068fc6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.8776250 Dec 21 04:15:11.935993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 33962) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:11.941867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:11.999089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:12.003131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:12.090950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:12.119004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:12.122862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:12.126877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:12.127929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:12.129292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] 10.222.0.54 "PUT /v2.0/ports/a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 1092 time: 1.7935894 Dec 21 04:15:12.156133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc500ae-edb7-411b-9525-e7b2c0371d63 service neutron] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:12.193427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:12.252200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port a1a159da-8ede-44a2-8929-065e82a2dee0 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:15:12.253514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:12.264040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-44da35eb-490a-4501-bf08-cdf5d50cde9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:12.265573 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-44da35eb-490a-4501-bf08-cdf5d50cde9a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1095 time: 0.0830541 Dec 21 04:15:12.388034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-4f7187eb-448d-457f-80df-f2eb91839814 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:12.389909 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-4f7187eb-448d-457f-80df-f2eb91839814 service neutron] 10.222.0.54 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.1136544 Dec 21 04:15:12.450453 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:12.460964 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-6be6a9be-8474-441e-8c68-e0a4d7a868fa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 999 time: 0.0620606 Dec 21 04:15:12.512703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-bc54771e-0874-41ea-b0ed-8b9928a5572c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:12.514123 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-bc54771e-0874-41ea-b0ed-8b9928a5572c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0461473 Dec 21 04:15:12.515805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=8db675a6-ec65-4dd3-981e-11c4aaa13e77,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:12.527692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Checking segment: {'id': '64383d3d-c51f-435d-9679-8a31f0a45eab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:12.528126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network hostable DHCP agents. Network: 8170af88-8fa5-45ac-b402-8b68e70db386, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:15:12.570313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-fff639cf-a7c3-4ec9-bce1-2b80ed64ebfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:12.572132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-fff639cf-a7c3-4ec9-bce1-2b80ed64ebfa service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0477753 Dec 21 04:15:12.608984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 8170af88-8fa5-45ac-b402-8b68e70db386 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:15:12.681232 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-ffa84bf7-3029-4eba-9c06-10806e5a522d service neutron] 10.222.0.54 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1011822 Dec 21 04:15:12.714296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8170af88-8fa5-45ac-b402-8b68e70db386) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:12.723720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71a1416a-0491-45c3-b65b-ced2c8ed03f6 None None] Network 8170af88-8fa5-45ac-b402-8b68e70db386 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:12.752796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:12.753575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:12.794648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5783eb53-66aa-4250-a71f-cd011a65fc44 req-7dcbac29-eeb1-4220-80e8-ac9b5cae5aa3 tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "GET /v2.0/ports?device_id=03aef065-24b8-400c-8e95-d05a9816bd77 HTTP/1.1" status: 200 len: 210 time: 0.0908616 Dec 21 04:15:12.809969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-72ae20e7-5e7f-493a-8c9c-0ee9f69ae658 req-b7ee58e9-7766-4168-aec3-e2ded4d90418 service neutron] 10.222.0.54 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1195452 Dec 21 04:15:12.892382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-8170af88-8fa5-45ac-b402-8b68e70db386', 'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': '8db675a6-ec65-4dd3-981e-11c4aaa13e77'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:12.893283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:12.943377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33978) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:12.943588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fdbd953d-e5ca-43a8-b617-0244b7450517 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0064869 Dec 21 04:15:12.954205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-1794916175', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:13.079212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Allocated IP 172.20.0.2 (8170af88-8fa5-45ac-b402-8b68e70db386/8db675a6-ec65-4dd3-981e-11c4aaa13e77/b8863815-ba51-4e26-bb0b-e7895de9f625) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:13.114640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3e53e4-e95a-46e2-9ebe-6ae6c3ddcbd3 req-755291cc-e9dd-4d42-9cd3-6350c5234f2f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:13.116562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f3e53e4-e95a-46e2-9ebe-6ae6c3ddcbd3 req-755291cc-e9dd-4d42-9cd3-6350c5234f2f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.0637777 Dec 21 04:15:13.122070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.123701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.203341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.221812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f3e53e4-e95a-46e2-9ebe-6ae6c3ddcbd3 req-1cca0ee8-f2f1-41b1-b1eb-15141067b9d3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0834808 Dec 21 04:15:13.298280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.301986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.392550 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.422626 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.424882 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-296ee313-11a4-4fe0-878d-57ad54277131 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.4793861 Dec 21 04:15:13.426594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 33990) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:13.432486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386', 'name': 'tempest-PortsTestJSON-578260482'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:13.434750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Network 8170af88-8fa5-45ac-b402-8b68e70db386 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:13.440479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:13.445650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:13.473261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Pushing event updated for resources: {'Port': ['ID=b8863815-ba51-4e26-bb0b-e7895de9f625,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:13.508543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Attempting to bind port b8863815-ba51-4e26-bb0b-e7895de9f625 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:13.510593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Attempting to bind port b8863815-ba51-4e26-bb0b-e7895de9f625 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '64383d3d-c51f-435d-9679-8a31f0a45eab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:13.511302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Attempting to bind port b8863815-ba51-4e26-bb0b-e7895de9f625 on network 8170af88-8fa5-45ac-b402-8b68e70db386 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:13.522409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:13.523363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Checking segment: {'id': '64383d3d-c51f-435d-9679-8a31f0a45eab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:13.524114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.525317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Bound using segment: {'id': '64383d3d-c51f-435d-9679-8a31f0a45eab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:13.526051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Bound port: b8863815-ba51-4e26-bb0b-e7895de9f625, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64383d3d-c51f-435d-9679-8a31f0a45eab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '8170af88-8fa5-45ac-b402-8b68e70db386'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:13.527497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.538327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:13.541476 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ee9f74b-17cc-4a7f-8053-723634d8bde8" -d '{"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:13.599731 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cc1dcf6-6976-4c97-8264-5025737fabfc x-openstack-request-id: req-3cc1dcf6-6976-4c97-8264-5025737fabfc {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:13.600129 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:13.600827 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3cc1dcf6-6976-4c97-8264-5025737fabfc {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:13.601844 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'status': 'completed', 'code': 200} Dec 21 04:15:13.609460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] For port b8863815-ba51-4e26-bb0b-e7895de9f625, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:13.612936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] For port b8863815-ba51-4e26-bb0b-e7895de9f625, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b8863815-ba51-4e26-bb0b-e7895de9f625,segment=NetworkSegment(64383d3d-c51f-435d-9679-8a31f0a45eab),segment_id=64383d3d-c51f-435d-9679-8a31f0a45eab)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:13.691393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:13.695230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.714482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-3a1854d5-e701-47df-b8e2-ecac06a710eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:13.716920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-3a1854d5-e701-47df-b8e2-ecac06a710eb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1095 time: 0.0505979 Dec 21 04:15:13.719915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:13.721104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:15:13.730569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-cfcb828b-7590-4861-978f-926e9881e0e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:13.732214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-cfcb828b-7590-4861-978f-926e9881e0e3 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1095 time: 0.0849500 Dec 21 04:15:13.817543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa99c5c5-bcd8-4352-a10d-5d6eb7c65621 None None] Pushing event updated for resources: {'Port': ['ID=b8863815-ba51-4e26-bb0b-e7895de9f625,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:13.889102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-4f582e07-90c6-4f59-9855-9192299e83c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:13.899128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-4f582e07-90c6-4f59-9855-9192299e83c5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.1662600 Dec 21 04:15:13.938524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34000) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:14.016960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.11 (8170af88-8fa5-45ac-b402-8b68e70db386/8db675a6-ec65-4dd3-981e-11c4aaa13e77/6e03ab7b-08bb-4367-bb4c-d401c1912f4d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:14.017440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-ed1caef0-70d8-4d1d-b643-2493c4d46182 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 999 time: 0.1140764 Dec 21 04:15:14.115167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-170c1993-c01d-4116-9c17-d9b3bd748011 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:14.116721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-170c1993-c01d-4116-9c17-d9b3bd748011 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0872886 Dec 21 04:15:14.134114 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-b3eaabf2-8211-4875-9f00-767726d7c83d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:14.136186 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-b3eaabf2-8211-4875-9f00-767726d7c83d service neutron] 10.222.0.54 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.3045945 Dec 21 04:15:14.140242 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dabee935-83a7-4402-89da-8534c1007a8f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:14.204096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-4b83610a-348e-4747-8150-8e7231dbc3fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:14.205630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-4b83610a-348e-4747-8150-8e7231dbc3fd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0775330 Dec 21 04:15:14.258284 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-f394df84-9d40-485a-b77f-ca9edb1c7936 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 999 time: 0.1073108 Dec 21 04:15:14.380832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-1ba9b410-32f9-4e2d-8f77-6fa21767f425 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:14.382855 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-1ba9b410-32f9-4e2d-8f77-6fa21767f425 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0911424 Dec 21 04:15:14.445785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dabee935-83a7-4402-89da-8534c1007a8f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:14.560153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-e83ef484-a05a-4777-9584-458fa4f2c54e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:14.561744 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-e83ef484-a05a-4777-9584-458fa4f2c54e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1657565 Dec 21 04:15:14.613739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:14.728436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-b9a4072d-2fb5-4e85-91c3-f07a62c73d5a service neutron] 10.222.0.54 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1568580 Dec 21 04:15:14.774200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dabee935-83a7-4402-89da-8534c1007a8f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:14.777178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dabee935-83a7-4402-89da-8534c1007a8f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:14.778432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dabee935-83a7-4402-89da-8534c1007a8f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] 10.222.0.18 "DELETE /v2.0/security-groups/3549b741-8ac3-4c54-9db1-691842885eb8 HTTP/1.1" status: 204 len: 168 time: 0.8367279 Dec 21 04:15:14.795890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:14.824864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-06f21828-74b4-4b60-a7f5-fa88335d22d5 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6035264 Dec 21 04:15:14.833673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dabee935-83a7-4402-89da-8534c1007a8f tempest-TestVolumeBackupRestore-1258504778 tempest-TestVolumeBackupRestore-1258504778-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3549b741-8ac3-4c54-9db1-691842885eb8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:14.845149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2b1245-c2e2-4e72-9a24-c1c97e577b82 req-47455441-0dde-499e-8613-953c39a14082 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:14.848069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f2b1245-c2e2-4e72-9a24-c1c97e577b82 req-47455441-0dde-499e-8613-953c39a14082 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.1273572 Dec 21 04:15:14.919118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 8170af88-8fa5-45ac-b402-8b68e70db386 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:14.926640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:14.929186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:14.977848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=6e03ab7b-08bb-4367-bb4c-d401c1912f4d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:15.014855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34014) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:15.083733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Deleting subnet 79a84c6f-589d-401b-8841-bdeddbc4ba1d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:15.090040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-5f6ce843-9720-4e25-a3af-fe49abf84e80 service neutron] 10.222.0.54 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3483462 Dec 21 04:15:15.091857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f2b1245-c2e2-4e72-9a24-c1c97e577b82 req-2d54340d-4f75-45b0-997a-e7ff0e4ead94 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2328019 Dec 21 04:15:15.114469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.127724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ee9f74b-17cc-4a7f-8053-723634d8bde8 req-08a553e4-93ba-4afe-b0aa-70588e3c2956 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2779720 Dec 21 04:15:15.165917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:15.166588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.185104 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.256119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.372086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d741536-54a0-48da-abed-0d2beaf0a4e7 None None] Network 8170af88-8fa5-45ac-b402-8b68e70db386 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:15.389278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34024) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:15.390400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-19e29cf9-225b-43ee-81b1-3f0de2701ee8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.9550903 Dec 21 04:15:15.445103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.486414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8863815-ba51-4e26-bb0b-e7895de9f625 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:15.522800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=79a84c6f-589d-401b-8841-bdeddbc4ba1d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:15.525366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.546159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34036) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:15.546882 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-50eaf07d-5451-449d-8133-ff385c0b811e admin admin] 10.222.0.18 "DELETE /v2.0/subnets/79a84c6f-589d-401b-8841-bdeddbc4ba1d HTTP/1.1" status: 204 len: 168 time: 0.5243623 Dec 21 04:15:15.597779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ab070368-5bba-4330-a4ee-214bb180de3d None None] Provisioning complete for port b8863815-ba51-4e26-bb0b-e7895de9f625 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:15.599661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab070368-5bba-4330-a4ee-214bb180de3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.755520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b8863815-ba51-4e26-bb0b-e7895de9f625 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:15.756166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.784029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.947654 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:15.959479 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab070368-5bba-4330-a4ee-214bb180de3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.027383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b8863815-ba51-4e26-bb0b-e7895de9f625, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b8863815-ba51-4e26-bb0b-e7895de9f625,segment=NetworkSegment(64383d3d-c51f-435d-9679-8a31f0a45eab),segment_id=64383d3d-c51f-435d-9679-8a31f0a45eab)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:16.156727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.259265 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.325102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-ab070368-5bba-4330-a4ee-214bb180de3d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:15:16.325798 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-ab070368-5bba-4330-a4ee-214bb180de3d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:15:16.387898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b8863815-ba51-4e26-bb0b-e7895de9f625,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:16.441020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5a8c4312-b76b-442d-aa89-ba658f5e54a8']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:16.473389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:16.473693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '542e7a2d-ea7c-4083-b387-0bdcad1cf6fc') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:16.477174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.499241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.518987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2281d03a-0f95-4060-9d72-cf1f7400702b req-85466433-4a9d-4271-a98e-0165a0d614d9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:16.527837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2281d03a-0f95-4060-9d72-cf1f7400702b req-85466433-4a9d-4271-a98e-0165a0d614d9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.2470136 Dec 21 04:15:16.578456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.594319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:16.594890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:16.598749 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:16.718525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2281d03a-0f95-4060-9d72-cf1f7400702b req-282dc9d0-c56b-4f5c-abe3-a8bf1d7f5020 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1895993 Dec 21 04:15:16.826117 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.830762 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:16.836697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] 10.222.0.18 "DELETE /v2.0/networks/5a8c4312-b76b-442d-aa89-ba658f5e54a8 HTTP/1.1" status: 204 len: 168 time: 1.2871742 Dec 21 04:15:16.872704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa7ab5f-c93f-4395-beaf-776bbeefec5a admin admin] Pushing event deleted for resources: {'Network': ['ID=5a8c4312-b76b-442d-aa89-ba658f5e54a8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:17.033228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.043861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b61e1cbe-b962-4b0d-992d-8622d7361153 None None] Provisioning complete for port b8863815-ba51-4e26-bb0b-e7895de9f625 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:17.044331 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b61e1cbe-b962-4b0d-992d-8622d7361153 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.165255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.187351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b61e1cbe-b962-4b0d-992d-8622d7361153 None None] Provisioning complete for port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:17.187918 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b61e1cbe-b962-4b0d-992d-8622d7361153 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.226785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b61e1cbe-b962-4b0d-992d-8622d7361153 None None] Port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:17.319238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=6e03ab7b-08bb-4367-bb4c-d401c1912f4d,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:17.471848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8863815-ba51-4e26-bb0b-e7895de9f625 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:17.500365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34120) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:17.584506 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b8863815-ba51-4e26-bb0b-e7895de9f625 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:17.585071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.616325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a37d002f-415a-4a68-b339-9f65f8e4854b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=247cb1d10db0451abe7903925d39ba07&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1145971 Dec 21 04:15:17.620002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34128) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:17.753335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-762cf3ac-c5b0-4b87-86c4-42aee45a5842 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.811225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:15:17.813239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-762cf3ac-c5b0-4b87-86c4-42aee45a5842 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.875089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1be9b2-1d39-4528-9ed3-5c9894702f60 req-a784844b-56e0-4927-9d95-37398942f069 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:17.880087 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e1be9b2-1d39-4528-9ed3-5c9894702f60 req-a784844b-56e0-4927-9d95-37398942f069 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 943 time: 0.5479920 Dec 21 04:15:17.890433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-f4f4594c-f96a-4e75-aaee-203436738a76 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:17.891962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-f4f4594c-f96a-4e75-aaee-203436738a76 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14&tenant_id=10a032d25985452584a3dcdae6969809&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 943 time: 0.5071654 Dec 21 04:15:17.963665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:17.964877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-762cf3ac-c5b0-4b87-86c4-42aee45a5842 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.967646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-762cf3ac-c5b0-4b87-86c4-42aee45a5842 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:17.968816 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-762cf3ac-c5b0-4b87-86c4-42aee45a5842 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/799ede8c-8253-4a1c-ae82-09f6731ecab1 HTTP/1.1" status: 204 len: 168 time: 0.3477795 Dec 21 04:15:17.982295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'port_id': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'mac_address': 'fa:16:3e:b0:51:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 109, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:15:17.982518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762cf3ac-c5b0-4b87-86c4-42aee45a5842 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=799ede8c-8253-4a1c-ae82-09f6731ecab1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:18.098100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e1be9b2-1d39-4528-9ed3-5c9894702f60 req-bdc81f12-a975-4172-bd91-0f3a3721ebc3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2024260 Dec 21 04:15:18.158868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:18.164793 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-6e80cd2e-25da-4a9f-92cb-50bf9a65efa1 service neutron] delete failed (client error): The resource could not be found. Dec 21 04:15:18.165825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-6e80cd2e-25da-4a9f-92cb-50bf9a65efa1 service neutron] 10.222.0.31 "DELETE /v2.0/ports/a1a159da-8ede-44a2-8929-065e82a2dee0/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.2596676 Dec 21 04:15:18.327047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:18.351882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0f93f39b-a33d-4dae-b479-bd770d266307 None None] Provisioning complete for port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:18.351882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f93f39b-a33d-4dae-b479-bd770d266307 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:18.354990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-dcebaa62-b1da-4e18-b0eb-5e244b60a653 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:18.356035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1a159da-8ede-44a2-8929-065e82a2dee0 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:15:18.357602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-dcebaa62-b1da-4e18-b0eb-5e244b60a653 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1095 time: 0.0960281 Dec 21 04:15:18.427057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:18.428608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0f93f39b-a33d-4dae-b479-bd770d266307 None None] Port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:18.512878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:18.513598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:18.541748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-cc1a093d-51c6-4289-9e9d-6811a8c134b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:18.543539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-cc1a093d-51c6-4289-9e9d-6811a8c134b1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.1713762 Dec 21 04:15:18.632934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:18.790393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-21292035-6cb6-4df4-95a0-b0491d20996b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 1000 time: 0.2188616 Dec 21 04:15:18.832591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['a1a159da-8ede-44a2-8929-065e82a2dee0'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:15:18.901988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-b573b6ce-4e60-4cfc-94ab-372a12785006 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:18.903776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-b573b6ce-4e60-4cfc-94ab-372a12785006 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0959167 Dec 21 04:15:19.098525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-3f498dbc-e26e-4390-96e7-f9855d6a3864 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:19.100739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-3f498dbc-e26e-4390-96e7-f9855d6a3864 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1795168 Dec 21 04:15:19.430666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-e4b0dcc2-5b28-4a74-b65f-af9b931fe593 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3170879 Dec 21 04:15:19.448724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa5ce24-8ccb-41b5-811f-78458e9537db req-020c7768-1b85-4979-96d7-608390a4a98a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:19.459924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaa5ce24-8ccb-41b5-811f-78458e9537db req-020c7768-1b85-4979-96d7-608390a4a98a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 944 time: 0.1871982 Dec 21 04:15:19.477670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:19.576716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:19.691766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaa5ce24-8ccb-41b5-811f-78458e9537db req-32645706-9eb3-4a5c-ab73-d0f4a757dbae tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2308981 Dec 21 04:15:19.707402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=6e03ab7b-08bb-4367-bb4c-d401c1912f4d,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:19.802494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-30313a65-2b4e-492b-85f2-6b943da49eb7 req-e7624bcb-16eb-43e4-adc6-15516d5151a9 service neutron] 10.222.0.31 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2887769 Dec 21 04:15:19.803673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:19.870734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:19.896465 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b8201ef6-c52f-43e7-8906-8672dc36e78d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:19.970144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network 8170af88-8fa5-45ac-b402-8b68e70db386 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:19.971809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:20.043898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Request body: {'network': {'name': 'tempest-TestServerBasicOps-2080305174-network', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:20.174462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Made reservation on behalf of 73bd75f8ded64d5f8a07e09906286ea6 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:20.174462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.202875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.325777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.374814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a4925746-51c9-42e1-b734-61719d4a7799 None None] Provisioning complete for port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:20.375431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4925746-51c9-42e1-b734-61719d4a7799 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.409259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.419111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a4925746-51c9-42e1-b734-61719d4a7799 None None] Port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:20.452688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a395c2c2-e772-4042-8925-10665fcc28da,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:20.464528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:15:20.477527 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.478180 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Added segment 9ff9852b-cf38-4d4a-9c76-459b0e9cdd09 of type vlan for network ad2df216-0eaf-414a-a835-c27348ac987a Dec 21 04:15:20.534367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.661516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.662552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:20.663312 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:20.755602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] Pushing event updated for resources: {'Network': ['ID=ad2df216-0eaf-414a-a835-c27348ac987a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:20.771304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network ad2df216-0eaf-414a-a835-c27348ac987a details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:15:20.781499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Router 8c69b967-0612-4084-9ed9-0c56c658a796 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:15:20.838626 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b715bdf-2f25-48fc-a73d-921173fb1041 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9639289 Dec 21 04:15:20.838866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34262) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:20.843863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Request body: {'subnet': {'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerBasicOps-2080305174-subnet', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:20.929640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:20.938280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:20.949169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2cd5d014-6d12-4285-92f7-304cd17d0a6e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/routers/8c69b967-0612-4084-9ed9-0c56c658a796/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5481184 Dec 21 04:15:20.954490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] Sync routers for ids ['8c69b967-0612-4084-9ed9-0c56c658a796'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:20.965452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1954adbb-f7ab-40bb-a6fe-e3d9973742ee req-b0e55117-034a-41a6-8cdd-7a0f3df840c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:20.972584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1954adbb-f7ab-40bb-a6fe-e3d9973742ee req-b0e55117-034a-41a6-8cdd-7a0f3df840c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 944 time: 0.1252987 Dec 21 04:15:20.977584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] Routers {'8c69b967-0612-4084-9ed9-0c56c658a796'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:20.979030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8c69b967-0612-4084-9ed9-0c56c658a796'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:21.005394 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Made reservation on behalf of 73bd75f8ded64d5f8a07e09906286ea6 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:21.007804 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:21.025190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:21.037102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] Routers {'8c69b967-0612-4084-9ed9-0c56c658a796'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:21.038793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:14:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8c69b967-0612-4084-9ed9-0c56c658a796'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:21.088372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:21.089224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8627c12c-046a-4a51-a6ab-f741004d7196 None None] The sync data for ids ['8c69b967-0612-4084-9ed9-0c56c658a796'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:21.099487 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1954adbb-f7ab-40bb-a6fe-e3d9973742ee req-f1cb453d-3009-40ab-9f97-ffbfe12fbd57 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1177635 Dec 21 04:15:21.126322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5f544dc-34ab-4c93-9bf6-7c51e201a099 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:21.131160 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5f544dc-34ab-4c93-9bf6-7c51e201a099 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports?device_id=8c69b967-0612-4084-9ed9-0c56c658a796 HTTP/1.1" status: 200 len: 982 time: 0.1891623 Dec 21 04:15:21.131580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:21.439278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:21.510620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0707099f-c76b-4feb-9475-4cacc79c073a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:21.516209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Checking segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:21.516571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Network hostable DHCP agents. Network: ad2df216-0eaf-414a-a835-c27348ac987a, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:15:21.589064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Network ad2df216-0eaf-414a-a835-c27348ac987a is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:15:21.669034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, ad2df216-0eaf-414a-a835-c27348ac987a) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:21.680491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27c7e6db-bba7-4b3c-a3f1-a0d6983694a1 None None] Network ad2df216-0eaf-414a-a835-c27348ac987a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:21.690657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:21.691719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:21.776183 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1a62aef-074b-4ee1-a340-f80b80dec457 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.9361224 Dec 21 04:15:21.778597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:21.793619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Request body: {'router': {'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:21.805483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:21.856243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-ad2df216-0eaf-414a-a835-c27348ac987a', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:21.857104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:21.918061 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:21.920826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.034056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.039031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Allocated IP 172.20.0.2 (ad2df216-0eaf-414a-a835-c27348ac987a/0707099f-c76b-4feb-9475-4cacc79c073a/d20a7eb2-35f6-4fc1-b5e9-de262dda4c39) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:22.044585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port a1a159da-8ede-44a2-8929-065e82a2dee0 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:15:22.055398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port a1a159da-8ede-44a2-8929-065e82a2dee0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:22.056219 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.060137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.318624 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.356311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb21ee3-369e-42f4-b297-e28cd911b973 req-2078df91-9c8b-4fbd-b7b6-cc9d30ee2d63 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:22.361308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfb21ee3-369e-42f4-b297-e28cd911b973 req-2078df91-9c8b-4fbd-b7b6-cc9d30ee2d63 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 944 time: 0.1763012 Dec 21 04:15:22.361853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34328) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:22.420485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.463425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.526472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.541706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Pushing event updated for resources: {'Port': ['ID=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:22.552560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Network ad2df216-0eaf-414a-a835-c27348ac987a is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:22.556138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:22.568894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:22.636486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:22.654565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:22.657297 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce782217-d7aa-4226-997c-bd685ece2d0f" -d '{"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-plugged", "status": "completed", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:22.712566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.773429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfb21ee3-369e-42f4-b297-e28cd911b973 req-0dfd3744-4d18-42ab-bd60-3d1cc8f33a9f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3722813 Dec 21 04:15:22.810139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34350) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:22.816196 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a31f2d67-1dd3-41a4-8583-1d6b31df012a x-openstack-request-id: req-a31f2d67-1dd3-41a4-8583-1d6b31df012a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:22.816830 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-plugged", "status": "completed", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:22.817305 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a31f2d67-1dd3-41a4-8583-1d6b31df012a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:22.817956 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'code': 200} Dec 21 04:15:22.819754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:22.830692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5f19d6c-fa29-44e6-a28d-356a8f5d607e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.846232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Attempting to bind port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:22.849359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Attempting to bind port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:22.850010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Attempting to bind port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 on network ad2df216-0eaf-414a-a835-c27348ac987a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:22.864779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:22.867693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Checking segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:22.868317 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.874094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 6e03ab7b-08bb-4367-bb4c-d401c1912f4d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:22.874441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:22.874700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Bound using segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:22.875734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Bound port: d20a7eb2-35f6-4fc1-b5e9-de262dda4c39, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:22.876307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.014715 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bdff1a3b-bbd1-44cf-8308-cdd9ad2999da tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a HTTP/1.1" status: 200 len: 993 time: 0.1902375 Dec 21 04:15:23.045112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.078258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 6e03ab7b-08bb-4367-bb4c-d401c1912f4d owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:23.124794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] For port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:23.133836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] For port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:23.165525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.211603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.239993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.318276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.336334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed44f60c-d779-496d-b4d4-ebc8fb1b564e None None] Pushing event updated for resources: {'Port': ['ID=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:23.380672 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.403827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.440680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.469497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Allocated IP 172.25.5.140 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/cb742b11-dfff-4b49-bcd7-24d8c54eff5e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:23.494151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=6e03ab7b-08bb-4367-bb4c-d401c1912f4d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:23.815579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.880887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.950284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:23.998794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:24.001795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:24.005704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:24.020079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1881b8f1-f9d7-4e1f-80ee-0891595e72ca None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:24.045954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Pushing event updated for resources: {'Port': ['ID=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:24.071146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Router 8c69b967-0612-4084-9ed9-0c56c658a796 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:24.114314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d0f0595e-4847-4752-b6f9-0000b911795c None None] Provisioning complete for port cb742b11-dfff-4b49-bcd7-24d8c54eff5e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:24.114745 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d0f0595e-4847-4752-b6f9-0000b911795c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:24.191507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d0f0595e-4847-4752-b6f9-0000b911795c None None] Port cb742b11-dfff-4b49-bcd7-24d8c54eff5e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:24.205304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:24.210522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4cb8601d-551f-4b8f-a30f-7404032c83d8 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/routers/8c69b967-0612-4084-9ed9-0c56c658a796/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0776522 Dec 21 04:15:24.216494 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] Sync routers for ids ['8c69b967-0612-4084-9ed9-0c56c658a796'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:24.219617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34396) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:24.232887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] Routers {'8c69b967-0612-4084-9ed9-0c56c658a796'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:24.237437 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8c69b967-0612-4084-9ed9-0c56c658a796'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:24.237952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Deleting port 594f295c-89df-4262-968f-a11a1037350c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:24.238299 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:24.275913 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:24.289916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] Routers {'8c69b967-0612-4084-9ed9-0c56c658a796'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:24.291705 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['8c69b967-0612-4084-9ed9-0c56c658a796'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:24.329497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] For port 594f295c-89df-4262-968f-a11a1037350c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=594f295c-89df-4262-968f-a11a1037350c,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:24.329857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:24.343548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Calling delete_port for 594f295c-89df-4262-968f-a11a1037350c owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:24.345612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:24.346276 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7b4db48-6d1a-4c13-828b-eb56a3723370 None None] The sync data for ids ['8c69b967-0612-4084-9ed9-0c56c658a796'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:24.365981 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-2f6bacf7-bbef-4bfb-ba95-3dd7a3d0c96a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:15:24.367525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2f6bacf7-bbef-4bfb-ba95-3dd7a3d0c96a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/6e03ab7b-08bb-4367-bb4c-d401c1912f4d HTTP/1.1" status: 404 len: 333 time: 0.1422350 Dec 21 04:15:24.370451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34402) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:24.713409 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:24.780788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=594f295c-89df-4262-968f-a11a1037350c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:24.970454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78f1923e-a63d-4a5e-b005-dd97296ba3cc None None] Network ad2df216-0eaf-414a-a835-c27348ac987a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:25.092994 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.115043 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.164801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4cb97787-c298-4c00-b7c8-7d1ea71e2151 None None] Provisioning complete for port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:25.165280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb97787-c298-4c00-b7c8-7d1ea71e2151 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.227088 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.242198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.391801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.394773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.476443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb97787-c298-4c00-b7c8-7d1ea71e2151 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.557293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cb97787-c298-4c00-b7c8-7d1ea71e2151 None None] For port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:25.560398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:25.564731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.644255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cb97787-c298-4c00-b7c8-7d1ea71e2151 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.660119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.660673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Fanout notify agent at l3_agent the message router_deleted on router 8c69b967-0612-4084-9ed9-0c56c658a796 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:15:25.669656 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.670780 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-83026205-d001-4572-821b-7ebc5bb2922c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/routers/8c69b967-0612-4084-9ed9-0c56c658a796 HTTP/1.1" status: 204 len: 168 time: 1.2992911 Dec 21 04:15:25.682496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34452) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:25.739160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:25.744600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.778235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.780900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb97787-c298-4c00-b7c8-7d1ea71e2151 None None] Pushing event updated for resources: {'Port': ['ID=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:25.891509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-26ee1a11-930c-405d-a83e-f06bd9bfd77a None None] Provisioning complete for port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:25.892129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26ee1a11-930c-405d-a83e-f06bd9bfd77a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.898378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:25.944755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet 8db675a6-ec65-4dd3-981e-11c4aaa13e77 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:25.944971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Router fb8045d1-7b4d-4398-bde2-94a619776157 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:25.951756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.025229 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.079340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:26.088556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-27be84d2-0a7d-4ab1-b98d-9ceb03b0a5c1 admin admin] 10.222.0.18 "PUT /v2.0/routers/fb8045d1-7b4d-4398-bde2-94a619776157/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7242169 Dec 21 04:15:26.089230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34470) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:26.091186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] Sync routers for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:26.104763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:26.105748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:26.130645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.155681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Router d017679e-19f4-4f04-a0b9-8ae04d817d66 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:15:26.228738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.286341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:26.317345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:26.328908 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Sync routers for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:26.349740 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:26.351535 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:26.364591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.381696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.424879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=8db675a6-ec65-4dd3-981e-11c4aaa13e77,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:26.441833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.442513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.443111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.443800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.444982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.445570 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.445995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.446453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.446878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.447334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.447734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.448119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.448668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:26.456111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.461009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34484) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:26.462509 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ae4bbb6a-7f04-4ecb-94a4-f1704de4ace7 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 4.6809042 Dec 21 04:15:26.471204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.471204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a22a6ff0-d36e-4b38-9d1f-e2798f3b81ad tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/8db675a6-ec65-4dd3-981e-11c4aaa13e77 HTTP/1.1" status: 204 len: 168 time: 0.7860947 Dec 21 04:15:26.473384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34486) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:26.491188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb159215-a09d-4bf2-9690-bdc33f3a5bab None None] Network 8170af88-8fa5-45ac-b402-8b68e70db386 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:26.525932 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:26.608699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.706360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Deleting port 6314beb6-1533-4c57-89b0-6f0b0e5661d0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:26.709764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.716530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20'}], 'enable_snat': True}, 'gw_port_id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:15:24Z', 'revision_number': 5, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port': {'id': '6314beb6-1533-4c57-89b0-6f0b0e5661d0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:9d:69:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2693, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:00Z', 'updated_at': '2021-12-21T04:09:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:26.786034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port b8863815-ba51-4e26-bb0b-e7895de9f625 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:26.786394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.791729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] Checking router: fb8045d1-7b4d-4398-bde2-94a619776157 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:26.823302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] Routers {'fb8045d1-7b4d-4398-bde2-94a619776157'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:26.823632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb8045d1-7b4d-4398-bde2-94a619776157'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:26.853575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] For port 6314beb6-1533-4c57-89b0-6f0b0e5661d0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6314beb6-1533-4c57-89b0-6f0b0e5661d0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:26.853575 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.883302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] For port b8863815-ba51-4e26-bb0b-e7895de9f625, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b8863815-ba51-4e26-bb0b-e7895de9f625,segment=NetworkSegment(64383d3d-c51f-435d-9679-8a31f0a45eab),segment_id=64383d3d-c51f-435d-9679-8a31f0a45eab)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:26.883741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:26.901398 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:24Z', 'revision_number': 3, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:26.902302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for b8863815-ba51-4e26-bb0b-e7895de9f625 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:26.953431 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Checking router: d017679e-19f4-4f04-a0b9-8ae04d817d66 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:26.953431 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Updating router d017679e-19f4-4f04-a0b9-8ae04d817d66 port cb742b11-dfff-4b49-bcd7-24d8c54eff5e binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:15:26.959082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Calling delete_port for 6314beb6-1533-4c57-89b0-6f0b0e5661d0 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:27.015950 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.117760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcd49312-524e-4d7c-924d-85bac3256f86 None None] DHCP port deletion for 8170af88-8fa5-45ac-b402-8b68e70db386 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:27.140723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.189484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dcd49312-524e-4d7c-924d-85bac3256f86 None None] The port 'b8863815-ba51-4e26-bb0b-e7895de9f625' was deleted {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 21 04:15:27.190125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=b8863815-ba51-4e26-bb0b-e7895de9f625,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:27.196442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No DVR routers for this DVR port b8863815-ba51-4e26-bb0b-e7895de9f625 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:27.239099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] Set router fb8045d1-7b4d-4398-bde2-94a619776157 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:27.324302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:15:26Z', 'revision_number': 6, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:27.365909 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.398207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52405cff-d759-43f2-8d01-f11e942bfd88 None None] The sync data for ids ['fb8045d1-7b4d-4398-bde2-94a619776157'] in n-d-822053-11 is: [{'id': 'fb8045d1-7b4d-4398-bde2-94a619776157', 'name': 'tempest-TestVolumeBackupRestore-1364449534-router', 'tenant_id': '620778ddaf44496aa625b5014155c9de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:08:58Z', 'updated_at': '2021-12-21T04:15:26Z', 'revision_number': 6, 'project_id': '620778ddaf44496aa625b5014155c9de', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:27.406462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:27.442923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8170af88-8fa5-45ac-b402-8b68e70db386']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:27.460814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '64383d3d-c51f-435d-9679-8a31f0a45eab') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:27.461399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '64383d3d-c51f-435d-9679-8a31f0a45eab') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:27.470622 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.472923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.487680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.494176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:27.494856 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:27.514711 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:27.528400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:27.531442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.564446 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.576881 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.597542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b9ea0aa-3a4e-4e32-9c25-47f3963a9823 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:27.598332 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Attempting to bind port cb742b11-dfff-4b49-bcd7-24d8c54eff5e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:27.598770 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Attempting to bind port cb742b11-dfff-4b49-bcd7-24d8c54eff5e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:27.599273 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Attempting to bind port cb742b11-dfff-4b49-bcd7-24d8c54eff5e on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:27.629850 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:27.630235 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:27.630640 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.631058 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:27.631724 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Bound port: cb742b11-dfff-4b49-bcd7-24d8c54eff5e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:27.635438 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.635568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Pushing event deleted for resources: {'Port': ['ID=6314beb6-1533-4c57-89b0-6f0b0e5661d0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:27.656998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.676212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.681268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.683467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.683875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.684046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c25f5df-2587-413a-b04a-1c7a76e7c74a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:27.684365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.684534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.684871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.685208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.685521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.685852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.686178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.686509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.686839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:27.709206 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb400b25-9bf2-470c-9070-0cb346932959 None None] Pushing event updated for resources: {'Port': ['ID=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:27.720417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.720948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.734080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] For port cb742b11-dfff-4b49-bcd7-24d8c54eff5e, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:27.738262 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] For port cb742b11-dfff-4b49-bcd7-24d8c54eff5e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:27.740829 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/8170af88-8fa5-45ac-b402-8b68e70db386 HTTP/1.1" status: 204 len: 168 time: 1.2648685 Dec 21 04:15:27.746455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34528) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:27.747236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a26111-1283-42cf-b6df-d745a78104a4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=8170af88-8fa5-45ac-b402-8b68e70db386,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:27.789369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a9bb3089-58e4-4862-a4ed-d777e0e1de1a None None] Provisioning complete for port cb742b11-dfff-4b49-bcd7-24d8c54eff5e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:27.789940 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9bb3089-58e4-4862-a4ed-d777e0e1de1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.820130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.837104 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:27.840954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a9bb3089-58e4-4862-a4ed-d777e0e1de1a None None] Port cb742b11-dfff-4b49-bcd7-24d8c54eff5e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:27.869409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58f0d1af-9eb6-4bfa-924f-cb51167f045e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:27.870852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-58f0d1af-9eb6-4bfa-924f-cb51167f045e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/6db3a24f-d841-4101-8985-34354a1280f9 HTTP/1.1" status: 200 len: 840 time: 0.1234102 Dec 21 04:15:27.874702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34534) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:27.903087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cbbb33b-8ee4-458b-9cf8-557fa7c7b10c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:27.955492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8863815-ba51-4e26-bb0b-e7895de9f625 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:27.972740 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb400b25-9bf2-470c-9070-0cb346932959 None None] Pushing event updated for resources: {'Port': ['ID=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:27.985578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5048815-655a-4c6a-9b05-7c93f0ab2d90 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/6db3a24f-d841-4101-8985-34354a1280f9?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.1095502 Dec 21 04:15:27.989688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34538) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:27.995427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:28.001038 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:28.003751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b8863815-ba51-4e26-bb0b-e7895de9f625 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:28.004220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8863815-ba51-4e26-bb0b-e7895de9f625 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:28.008008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:28.010093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Provisioning complete for port cb742b11-dfff-4b49-bcd7-24d8c54eff5e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:28.010556 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.027828 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.041341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.156026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.185903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] For port cb742b11-dfff-4b49-bcd7-24d8c54eff5e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:28.195319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.195319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fb8045d1-7b4d-4398-bde2-94a619776157 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:15:28.202070 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.205820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1b02b096-022a-499d-a790-8dba21829397 admin admin] 10.222.0.18 "DELETE /v2.0/routers/fb8045d1-7b4d-4398-bde2-94a619776157 HTTP/1.1" status: 204 len: 168 time: 2.1133609 Dec 21 04:15:28.207136 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34556) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:28.236486 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:28.258922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Allocated IP 172.20.0.1 (ad2df216-0eaf-414a-a835-c27348ac987a/0707099f-c76b-4feb-9475-4cacc79c073a/4b6f18a4-af9d-424b-814d-903d0f928a5c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:28.264028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Deleting subnet d1e185a5-063a-405d-ae9d-3ac5d19302c8 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:28.268847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.300228 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.310337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:28.314125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.356687 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.366467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Pushing event updated for resources: {'Port': ['ID=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:28.384691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.385042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.385454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.390092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.390092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.390092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.390092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.390509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.390681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.391049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.391386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.391719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.392074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a910f4e-ff26-4a10-bee3-6d1d038edb02 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:28.408234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.498209 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:24Z', 'revision_number': 3, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:28.530719 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3d70261-70b8-459f-8473-825a147dd105 None None] The sync data for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 is: [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:24Z', 'revision_number': 3, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:28.532682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.536372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.595387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Network ad2df216-0eaf-414a-a835-c27348ac987a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:28.598455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:28.607734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:28.720000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.722728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Pushing event updated for resources: {'Port': ['ID=4b6f18a4-af9d-424b-814d-903d0f928a5c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:28.729968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.789511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.832121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d06c093-3e6f-488e-b5b1-f5171bcdc8a4 None None] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:28.841693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:28.857192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/d1e185a5-063a-405d-ae9d-3ac5d19302c8 HTTP/1.1" status: 204 len: 168 time: 0.6465821 Dec 21 04:15:28.868792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:28.869449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34578) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:28.897896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:28.918390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2dad177-2606-47f9-985b-c72cf4c8f52e None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:29.005127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=a6fc5490-20ea-48a4-b98d-0375d9beeb57,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:29.010231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:29.011506 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.054317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.062613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3ef9eaf-498d-46c1-8ac8-9a5dceaaf3b5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d1e185a5-063a-405d-ae9d-3ac5d19302c8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:29.067767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.160941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Deleting port ab033bab-c07c-4e72-a7b9-a6213791e72a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:29.169938 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.192551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-85d1b545-83d7-4e2b-b804-492c5ab3fe2e None None] Provisioning complete for port 4b6f18a4-af9d-424b-814d-903d0f928a5c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:29.193256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-85d1b545-83d7-4e2b-b804-492c5ab3fe2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.295565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-85d1b545-83d7-4e2b-b804-492c5ab3fe2e None None] Port 4b6f18a4-af9d-424b-814d-903d0f928a5c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:29.317477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] DHCP port deletion for 9e019c2c-b199-4210-baef-b6bda8c43e06 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:29.341694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34594) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:29.344385 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ba9b115-213b-4b35-bb86-2f3ee5c415a6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3475857 Dec 21 04:15:29.354606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'security_group': {'name': 'tempest-secgroup-1139925801'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:29.359173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] For port ab033bab-c07c-4e72-a7b9-a6213791e72a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab033bab-c07c-4e72-a7b9-a6213791e72a,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:29.359798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.402834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Calling delete_port for ab033bab-c07c-4e72-a7b9-a6213791e72a owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:29.430290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-bcf1b1c3-e446-4833-886a-d47191e91971', 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'project_id': '8b9d8340243a470db22458ae1b476624', 'fixed_ips': [{'subnet_id': 'a6fc5490-20ea-48a4-b98d-0375d9beeb57'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:29.432989 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.492358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Deleting port ab033bab-c07c-4e72-a7b9-a6213791e72a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:29.492931 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.493054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.498232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cb742b11-dfff-4b49-bcd7-24d8c54eff5e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:29.501289 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.545073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.650371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.680367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.696790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Pushing event updated for resources: {'Port': ['ID=4b6f18a4-af9d-424b-814d-903d0f928a5c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:29.723748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Pushing event deleted for resources: {'Port': ['ID=ab033bab-c07c-4e72-a7b9-a6213791e72a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:29.732261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] No DVR routers for this DVR port ab033bab-c07c-4e72-a7b9-a6213791e72a on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:29.744080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Allocated IP 172.20.0.2 (bcf1b1c3-e446-4833-886a-d47191e91971/a6fc5490-20ea-48a4-b98d-0375d9beeb57/ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:29.763871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.845636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.879665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.886845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f34c2c83-27bc-468c-8585-74e5f7dae309,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:29.906417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] For port ab033bab-c07c-4e72-a7b9-a6213791e72a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab033bab-c07c-4e72-a7b9-a6213791e72a,segment=NetworkSegment(45d2d62f-06f1-4722-95eb-827c5ff84c72),segment_id=45d2d62f-06f1-4722-95eb-827c5ff84c72)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:29.907066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.918390 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e019c2c-b199-4210-baef-b6bda8c43e06']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:29.919244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Network ad2df216-0eaf-414a-a835-c27348ac987a is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:29.920778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:29.929737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45d2d62f-06f1-4722-95eb-827c5ff84c72') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:29.929737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45d2d62f-06f1-4722-95eb-827c5ff84c72') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:29.939314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Calling delete_port for ab033bab-c07c-4e72-a7b9-a6213791e72a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:29.941121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.972015 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.976210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.981297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port cb742b11-dfff-4b49-bcd7-24d8c54eff5e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:29.981675 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.991413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:29.992308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:29.994953 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:30.011669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.016338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f55fd328-19d7-46a7-bb09-fafad53bc896 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6733687 Dec 21 04:15:30.020574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34618) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:30.030834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'security_group': {'name': 'tempest-secgroup-333060136'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:30.071567 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.150970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Router d017679e-19f4-4f04-a0b9-8ae04d817d66 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:30.156384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:30.168746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:30.171441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:30.179125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Pushing event updated for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:30.194013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.206810 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.212587 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.224003 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] 10.222.0.18 "DELETE /v2.0/networks/9e019c2c-b199-4210-baef-b6bda8c43e06 HTTP/1.1" status: 204 len: 168 time: 1.3466415 Dec 21 04:15:30.229010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34626) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:30.268375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413746ee-3116-4e44-b6af-adf79b0b3fc4 admin admin] Pushing event deleted for resources: {'Network': ['ID=9e019c2c-b199-4210-baef-b6bda8c43e06,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:30.334921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:30.340688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a2a7ea42-12af-46bb-9289-30873ffe2365 admin admin] 10.222.0.18 "PUT /v2.0/routers/d017679e-19f4-4f04-a0b9-8ae04d817d66/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8783009 Dec 21 04:15:30.376367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.378963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.455652 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.497309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6314beb6-1533-4c57-89b0-6f0b0e5661d0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:30.500489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Network 9e019c2c-b199-4210-baef-b6bda8c43e06 is not hosted by any dhcp agent {{(pid=110312) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 04:15:30.501225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] No DVR routers for this DVR port ab033bab-c07c-4e72-a7b9-a6213791e72a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:30.505400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b34312ab-5488-43e0-83c1-11c87712acc6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:30.520882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5b9e7a-b067-483a-9d98-35e33f404c51 None None] Pushing event deleted for resources: {'Port': ['ID=ab033bab-c07c-4e72-a7b9-a6213791e72a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:30.547446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.550097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5704963-e688-49c7-95e7-eb9b703bff06 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5261300 Dec 21 04:15:30.552888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34644) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:30.563342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1276901698', 'security_groups': ['b34312ab-5488-43e0-83c1-11c87712acc6'], 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'a6fc5490-20ea-48a4-b98d-0375d9beeb57'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:30.563498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Attempting to bind port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:30.563498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Attempting to bind port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '75507f0b-0fef-4b21-8254-08a0df754f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:30.563498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Attempting to bind port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f on network bcf1b1c3-e446-4833-886a-d47191e91971 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:30.588800 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6314beb6-1533-4c57-89b0-6f0b0e5661d0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:30.593416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6314beb6-1533-4c57-89b0-6f0b0e5661d0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:30.594634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab033bab-c07c-4e72-a7b9-a6213791e72a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:30.603535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:30.604347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Checking segment: {'id': '75507f0b-0fef-4b21-8254-08a0df754f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:30.605093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.605688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Bound using segment: {'id': '75507f0b-0fef-4b21-8254-08a0df754f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:30.606388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Bound port: ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '75507f0b-0fef-4b21-8254-08a0df754f10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:30.607002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.643675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bad6ca0b-bf43-457a-b12b-1b5d1a9af858 None None] Provisioning complete for port 4b6f18a4-af9d-424b-814d-903d0f928a5c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:30.644120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bad6ca0b-bf43-457a-b12b-1b5d1a9af858 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.649055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ab033bab-c07c-4e72-a7b9-a6213791e72a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:30.649055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab033bab-c07c-4e72-a7b9-a6213791e72a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:30.650004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 594f295c-89df-4262-968f-a11a1037350c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:30.781319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 594f295c-89df-4262-968f-a11a1037350c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:30.781644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 594f295c-89df-4262-968f-a11a1037350c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:30.825589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bad6ca0b-bf43-457a-b12b-1b5d1a9af858 None None] Port 4b6f18a4-af9d-424b-814d-903d0f928a5c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:30.828138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:30.833071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,segment=NetworkSegment(75507f0b-0fef-4b21-8254-08a0df754f10),segment_id=75507f0b-0fef-4b21-8254-08a0df754f10)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:30.889426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:30.919955 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:30.928186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.030957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a7b4b2-03a4-4c85-b603-6b2b4f0682f6 None None] Pushing event updated for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:31.468039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Sync routers for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:31.521835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Deleting port f7190364-498c-4f32-b3a4-9c317a663960 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:31.522329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.524137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:31.524781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:31.532674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.561598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:15:31.651395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34662) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:31.657903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Request body: {'network': {'name': 'tempest-TestServerBasicOps-787447733-network', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:31.707956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] For port f7190364-498c-4f32-b3a4-9c317a663960, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f7190364-498c-4f32-b3a4-9c317a663960,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:31.708566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.731190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Calling delete_port for f7190364-498c-4f32-b3a4-9c317a663960 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:31.759881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:31.799369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.10 (bcf1b1c3-e446-4833-886a-d47191e91971/a6fc5490-20ea-48a4-b98d-0375d9beeb57/73c87503-0e60-4f1f-a1aa-8c6ba738c7c7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:31.824081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Made reservation on behalf of 1e9102a96fd8406f94e19e93db5d22db for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:31.827108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.843553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.976172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:29Z', 'revision_number': 2, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:31.987178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:31.999697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.002667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Checking router: d017679e-19f4-4f04-a0b9-8ae04d817d66 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:32.003063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Updating router d017679e-19f4-4f04-a0b9-8ae04d817d66 port 4b6f18a4-af9d-424b-814d-903d0f928a5c binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:15:32.016745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.022006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Pushing event deleted for resources: {'Port': ['ID=f7190364-498c-4f32-b3a4-9c317a663960,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:32.030401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.084463 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.120526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:15:32.123087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.162978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=623cc5ed-8bf8-4dfd-bcb2-da0a3dde50ec,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:32.212958 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.213314 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Added segment f226a94f-5d12-480c-8ea4-3c6852adfa58 of type vlan for network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 Dec 21 04:15:32.236745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:32.246662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:32.252131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:32.264832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.316582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=73c87503-0e60-4f1f-a1aa-8c6ba738c7c7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:32.338322 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.380581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:32.381242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.427758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.688670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:32.691813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.766697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.766697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:32.766697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.787526 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.791348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:32.799518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-865164e6-f0ac-4338-b56a-d0da19251e77 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 2.2445605 Dec 21 04:15:32.802825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34670) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:32.813238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:32.856700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2af4d2-b7c1-441d-a4cb-1ea88a8c5f18 None None] Pushing event updated for resources: {'Port': ['ID=4b6f18a4-af9d-424b-814d-903d0f928a5c,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:32.870590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] Pushing event updated for resources: {'Network': ['ID=a3ae4a80-05f9-4f97-b130-3ef4d58b5a25,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:32.889116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,segment=NetworkSegment(75507f0b-0fef-4b21-8254-08a0df754f10),segment_id=75507f0b-0fef-4b21-8254-08a0df754f10)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:32.893025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:15:32.922919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f78bda58-aa0b-4b73-89ea-8481919ba0a5 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.2697589 Dec 21 04:15:32.923967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34674) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:32.930650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Request body: {'subnet': {'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerBasicOps-787447733-subnet', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:32.965200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:33.036622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.073805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Made reservation on behalf of 1e9102a96fd8406f94e19e93db5d22db for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:33.076213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.129789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:33.135512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.163759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:33.170001 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-555f3f39-852c-4be2-b034-3345a37de4c4 admin admin] 10.222.0.18 "PUT /v2.0/routers/dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9387925 Dec 21 04:15:33.173426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34682) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:33.176065 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] Sync routers for ids ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:33.198111 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] Routers {'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:33.199154 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:33.299053 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet a6fc5490-20ea-48a4-b98d-0375d9beeb57 (CIDR: 172.20.0.0/28) Dec 21 04:15:33.322239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Attempting to bind port 4b6f18a4-af9d-424b-814d-903d0f928a5c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:33.322608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Attempting to bind port 4b6f18a4-af9d-424b-814d-903d0f928a5c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:33.322984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Attempting to bind port 4b6f18a4-af9d-424b-814d-903d0f928a5c on network ad2df216-0eaf-414a-a835-c27348ac987a {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:33.350262 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:15:33.351593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:33.352695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:33.353071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Checking segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:33.353466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.353850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Bound using segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:33.354315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Bound port: 4b6f18a4-af9d-424b-814d-903d0f928a5c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:33.354688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.375349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Pushing event updated for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:33.380155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:33.380584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.432396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.438098 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] Set router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:33.459437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d58a9cca-1c51-4f32-a84c-abcd111bf69e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.6461511 Dec 21 04:15:33.459437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34684) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:33.461438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:33.514554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5dfda19a-cfd9-4d08-83c4-689729531393 None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:33.540194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] For port 4b6f18a4-af9d-424b-814d-903d0f928a5c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:33.543718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] For port 4b6f18a4-af9d-424b-814d-903d0f928a5c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4b6f18a4-af9d-424b-814d-903d0f928a5c,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:33.546167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:33.601111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.649234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.695278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Provisioning complete for port 4b6f18a4-af9d-424b-814d-903d0f928a5c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:33.695951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.738014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:33.738261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.741373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Checking segment: {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:33.745921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Network hostable DHCP agents. Network: a3ae4a80-05f9-4f97-b130-3ef4d58b5a25, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:15:33.746244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:33.749447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.758630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Pushing event updated for resources: {'Subnet': ['ID=0f848bba-0197-4f09-bfb3-33ead8383c9a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:33.791384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38'}], 'enable_snat': True}, 'gw_port_id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:15:31Z', 'revision_number': 5, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port': {'id': '12ec6ed9-b708-4684-8b05-b0839520bbf5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:69:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2727, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:09:13Z', 'updated_at': '2021-12-21T04:09:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:33.802919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:33.817345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2af4d2-b7c1-441d-a4cb-1ea88a8c5f18 None None] Pushing event updated for resources: {'Port': ['ID=4b6f18a4-af9d-424b-814d-903d0f928a5c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:33.828452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:33.829090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:33.895633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:15:33.986631 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] Checking router: dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:33.992377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Deleting port 12ec6ed9-b708-4684-8b05-b0839520bbf5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:33.996442 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] Routers {'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:33.997610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.009604 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:34.044494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.049182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, a3ae4a80-05f9-4f97-b130-3ef4d58b5a25) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:34.067746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b11f17a6-33e6-4561-8121-d880e7458f3e None None] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:34.070238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:34.070238 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.139363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:34.158851 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] Set router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:34.168483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] For port 12ec6ed9-b708-4684-8b05-b0839520bbf5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12ec6ed9-b708-4684-8b05-b0839520bbf5,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:34.169403 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.170427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.208277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-147bf53a-ff78-4bbc-b4ee-8e2b6100fc1d admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 1.2799451 Dec 21 04:15:34.208912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34690) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:34.216924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Request body: {'router': {'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:34.220462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Calling delete_port for 12ec6ed9-b708-4684-8b05-b0839520bbf5 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:34.244719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] For port 4b6f18a4-af9d-424b-814d-903d0f928a5c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4b6f18a4-af9d-424b-814d-903d0f928a5c,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:34.253082 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:15:33Z', 'revision_number': 6, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:34.259079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:34.262694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:34.268103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:34.268980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.291115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=3c459144-8784-4d05-850e-e2cb3e54c30f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:34.292194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ad1639f-87f1-4fbe-97a6-03511df6a697 None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:34.319216 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df3a6ca-ce74-435a-9b77-d79c7d1bef42 None None] The sync data for ids ['dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f'] in n-d-822053-11 is: [{'id': 'dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f', 'name': 'tempest-TestVolumeBackupRestore-2110630992-router', 'tenant_id': '234f738ac38343e0a26b2868b4c339cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:09:12Z', 'updated_at': '2021-12-21T04:15:33Z', 'revision_number': 6, 'project_id': '234f738ac38343e0a26b2868b4c339cf', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:34.329053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.375366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ecd4f8c9-2487-4948-80ec-8df602e1f85d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.9190183 Dec 21 04:15:34.383961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34692) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:34.393273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1329085007', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '3c459144-8784-4d05-850e-e2cb3e54c30f'}], 'security_groups': ['f34c2c83-27bc-468c-8585-74e5f7dae309']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:34.430474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.431787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.435731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'fixed_ips': [{'subnet_id': '0f848bba-0197-4f09-bfb3-33ead8383c9a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:34.436595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.494489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.515270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.531693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Provisioning complete for port 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:34.532074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.554491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Pushing event updated for resources: {'Port': ['ID=4b6f18a4-af9d-424b-814d-903d0f928a5c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:34.682056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.737039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Pushing event deleted for resources: {'Port': ['ID=12ec6ed9-b708-4684-8b05-b0839520bbf5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:34.744651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f15de948-dbc3-48df-b008-6d003401b949 None None] Port 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:34.833606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Allocated IP 172.20.0.2 (a3ae4a80-05f9-4f97-b130-3ef4d58b5a25/0f848bba-0197-4f09-bfb3-33ead8383c9a/be4e87be-3a9f-4375-9bd5-4bf953061287) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:34.837673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:33Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:34.863119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:34.924400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abc50249-9227-4a4b-88e7-34fb50d32146 None None] The sync data for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 is: [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:33Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:34.935180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78742a27-af7c-41dd-89a2-a3c8719faabb None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:35.015459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Delete allocated IP 172.20.0.10 (bcf1b1c3-e446-4833-886a-d47191e91971/a6fc5490-20ea-48a4-b98d-0375d9beeb57) {{(pid=110310) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 21 04:15:35.024337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.19 (bcf1b1c3-e446-4833-886a-d47191e91971/3c459144-8784-4d05-850e-e2cb3e54c30f/73c87503-0e60-4f1f-a1aa-8c6ba738c7c7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:35.095041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e6951c67-ad77-4af8-b115-3ac920752238 None None] Provisioning complete for port 4b6f18a4-af9d-424b-814d-903d0f928a5c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:35.095332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e6951c67-ad77-4af8-b115-3ac920752238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.102337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.152139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] Update dhcp port {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'fixed_ips': [{'subnet_id': 'a6fc5490-20ea-48a4-b98d-0375d9beeb57', 'ip_address': '172.20.0.2'}, {'subnet_id': '3c459144-8784-4d05-850e-e2cb3e54c30f'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:15:35.279119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.305546 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.315344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.352933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.419242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.432647 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.544674 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.546542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:15:35.557166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.562485 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d459429e-81bc-4cdd-9f15-2674cfd65d68 admin admin] 10.222.0.18 "DELETE /v2.0/routers/dd4392cb-83a0-4b3f-9ded-c6dfc0a8da2f HTTP/1.1" status: 204 len: 168 time: 2.3867390 Dec 21 04:15:35.580628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34698) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:35.603724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=73c87503-0e60-4f1f-a1aa-8c6ba738c7c7,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:35.676067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] In _notify_port_updated(), no bound segment for port 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 on network bcf1b1c3-e446-4833-886a-d47191e91971 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:15:35.682291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:35.683122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.687128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2b80a34b-a54b-4568-a9fd-9a4e69460b67 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/ports/73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 HTTP/1.1" status: 200 len: 921 time: 1.2979934 Dec 21 04:15:35.687309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.687418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34700) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:35.713714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.731229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Deleting subnet 97bbd748-5025-4159-b697-b3060bf9cc6e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:35.733848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:35.741373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.761154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.859111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:35.870370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:35.873523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:35.876095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:35.881211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Pushing event updated for resources: {'Port': ['ID=be4e87be-3a9f-4375-9bd5-4bf953061287,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:35.899485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] Allocated IP 172.20.0.18 (bcf1b1c3-e446-4833-886a-d47191e91971/3c459144-8784-4d05-850e-e2cb3e54c30f/ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:35.913739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Allocated IP 172.25.5.122 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/fd126033-e19b-4427-95bc-8ad2db7cc3be) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:35.963424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:35.963900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.010537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:36.014046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.019994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Attempting to bind port be4e87be-3a9f-4375-9bd5-4bf953061287 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:36.020477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Attempting to bind port be4e87be-3a9f-4375-9bd5-4bf953061287 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:36.020921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Attempting to bind port be4e87be-3a9f-4375-9bd5-4bf953061287 on network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:36.046362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.063423 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:36.063798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Checking segment: {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:36.064206 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.064606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Bound using segment: {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:36.065146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Bound port: be4e87be-3a9f-4375-9bd5-4bf953061287, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:36.065530 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.092974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.169084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.186039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,segment=NetworkSegment(75507f0b-0fef-4b21-8254-08a0df754f10),segment_id=75507f0b-0fef-4b21-8254-08a0df754f10)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:36.187045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:36.220483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4b6f18a4-af9d-424b-814d-903d0f928a5c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:36.264906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] For port be4e87be-3a9f-4375-9bd5-4bf953061287, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:36.267192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.290143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] For port be4e87be-3a9f-4375-9bd5-4bf953061287, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be4e87be-3a9f-4375-9bd5-4bf953061287,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:36.295360 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.325017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4b6f18a4-af9d-424b-814d-903d0f928a5c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:36.325466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.333887 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.346830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:36.346830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:36.356354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:36.364916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b21e1ef7-ab8a-4937-8ed0-d976bd2ec492 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:36.413399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.415489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=97bbd748-5025-4159-b697-b3060bf9cc6e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:36.425155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.432217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d34b9da7-5fcc-454b-9c53-0c6e90504325 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/97bbd748-5025-4159-b697-b3060bf9cc6e HTTP/1.1" status: 204 len: 168 time: 0.8463488 Dec 21 04:15:36.432503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.432640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34708) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:36.451192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-747b351f-f4e9-4075-bfad-a49583e942f2 None None] Network f4c77e9f-d236-48d1-a572-296b459350f9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:36.479387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Pushing event updated for resources: {'Port': ['ID=fd126033-e19b-4427-95bc-8ad2db7cc3be,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:36.556502 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.641927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=73c87503-0e60-4f1f-a1aa-8c6ba738c7c7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:36.658974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.748394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d64e6036-434d-4218-99ba-a63c30059402 None None] Provisioning complete for port fd126033-e19b-4427-95bc-8ad2db7cc3be triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:36.748775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d64e6036-434d-4218-99ba-a63c30059402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.755669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c90959e-2439-4d82-be9e-0b9368d3e2ed None None] Pushing event updated for resources: {'Port': ['ID=be4e87be-3a9f-4375-9bd5-4bf953061287,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:36.875444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12ec6ed9-b708-4684-8b05-b0839520bbf5 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:36.881716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d64e6036-434d-4218-99ba-a63c30059402 None None] Port fd126033-e19b-4427-95bc-8ad2db7cc3be cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:36.900242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:36.908100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5bb6c5ea-475b-4fa1-90f4-7eb325d55b2c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 HTTP/1.1" status: 204 len: 168 time: 1.2193887 Dec 21 04:15:36.914807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34714) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:36.950010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 12ec6ed9-b708-4684-8b05-b0839520bbf5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:36.951560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12ec6ed9-b708-4684-8b05-b0839520bbf5 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:36.951560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f7190364-498c-4f32-b3a4-9c317a663960 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:36.954216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cbb80e7-35f0-41ae-80a0-00caefac3af2 None None] Pushing event updated for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:36.996966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Deleting port b2ce3e56-61ff-4467-bd22-2ef217614e4a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:36.996966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.014892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f7190364-498c-4f32-b3a4-9c317a663960 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:37.015264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f7190364-498c-4f32-b3a4-9c317a663960 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:37.031220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] DHCP port deletion for f4c77e9f-d236-48d1-a572-296b459350f9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:37.103593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.124569 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c2a6626-8540-44de-bf1b-013c3bb7be0d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:15:37.134216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8c2a6626-8540-44de-bf1b-013c3bb7be0d tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/73c87503-0e60-4f1f-a1aa-8c6ba738c7c7 HTTP/1.1" status: 404 len: 333 time: 0.2136574 Dec 21 04:15:37.134216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34718) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:37.151307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] Deleting port b2ce3e56-61ff-4467-bd22-2ef217614e4a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:37.151785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.178202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] For port b2ce3e56-61ff-4467-bd22-2ef217614e4a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2ce3e56-61ff-4467-bd22-2ef217614e4a,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:37.183530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.202632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Calling delete_port for b2ce3e56-61ff-4467-bd22-2ef217614e4a owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:37.261499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] For port b2ce3e56-61ff-4467-bd22-2ef217614e4a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2ce3e56-61ff-4467-bd22-2ef217614e4a,segment=NetworkSegment(1d4383a4-1d40-41a1-aed5-4816cb4f0ee0),segment_id=1d4383a4-1d40-41a1-aed5-4816cb4f0ee0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:37.262457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.293315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] Calling delete_port for b2ce3e56-61ff-4467-bd22-2ef217614e4a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:37.308473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70e84f28-69f0-4668-a8b5-e6142a3536f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.354713 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70e84f28-69f0-4668-a8b5-e6142a3536f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.495176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.501201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70e84f28-69f0-4668-a8b5-e6142a3536f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.506434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-70e84f28-69f0-4668-a8b5-e6142a3536f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.507690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-70e84f28-69f0-4668-a8b5-e6142a3536f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/security-groups/b34312ab-5488-43e0-83c1-11c87712acc6 HTTP/1.1" status: 204 len: 168 time: 0.3725791 Dec 21 04:15:37.510908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34722) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:37.524192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:37.548109 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:37.563388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e84f28-69f0-4668-a8b5-e6142a3536f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b34312ab-5488-43e0-83c1-11c87712acc6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:37.587950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] No DVR routers for this DVR port b2ce3e56-61ff-4467-bd22-2ef217614e4a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:37.594235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593b3e41-12c5-40a3-8eef-9103dc0aed37 None None] Pushing event deleted for resources: {'Port': ['ID=b2ce3e56-61ff-4467-bd22-2ef217614e4a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:37.651076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be4e87be-3a9f-4375-9bd5-4bf953061287 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:37.652800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.681226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Pushing event deleted for resources: {'Port': ['ID=b2ce3e56-61ff-4467-bd22-2ef217614e4a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:37.692972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] No DVR routers for this DVR port b2ce3e56-61ff-4467-bd22-2ef217614e4a on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:37.712236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port be4e87be-3a9f-4375-9bd5-4bf953061287 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:37.712236 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.744945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad17bced-30e1-4a3a-ae84-ab93410f8a69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.782354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b7d2a552-2304-459c-b3d9-d38572485619 None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:37.783042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b7d2a552-2304-459c-b3d9-d38572485619 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.796519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad17bced-30e1-4a3a-ae84-ab93410f8a69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.821113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:15:37.842213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.886497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f4c77e9f-d236-48d1-a572-296b459350f9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:37.900228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:37.900437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1d4383a4-1d40-41a1-aed5-4816cb4f0ee0') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:37.917385 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.932302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b7d2a552-2304-459c-b3d9-d38572485619 None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:37.934296 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.935122 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.943475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Releasing vlan 118 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:37.943861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: self.session.flush() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:37.945994 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:37.972107 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad17bced-30e1-4a3a-ae84-ab93410f8a69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.975929 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad17bced-30e1-4a3a-ae84-ab93410f8a69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:37.979752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad17bced-30e1-4a3a-ae84-ab93410f8a69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/security-groups/f34c2c83-27bc-468c-8585-74e5f7dae309 HTTP/1.1" status: 204 len: 168 time: 0.4653916 Dec 21 04:15:37.987671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port be4e87be-3a9f-4375-9bd5-4bf953061287, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be4e87be-3a9f-4375-9bd5-4bf953061287,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:37.989908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b7d2a552-2304-459c-b3d9-d38572485619 None None] Could not find standard attr ID for object 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:15:37.999433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34724) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:38.001937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b7d2a552-2304-459c-b3d9-d38572485619 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:38.002473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b7d2a552-2304-459c-b3d9-d38572485619 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.036722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad17bced-30e1-4a3a-ae84-ab93410f8a69 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f34c2c83-27bc-468c-8585-74e5f7dae309,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:38.047988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.050890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:38.074546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet a6fc5490-20ea-48a4-b98d-0375d9beeb57 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:38.080769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.106767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.119224 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.127402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] 10.222.0.18 "DELETE /v2.0/networks/f4c77e9f-d236-48d1-a572-296b459350f9 HTTP/1.1" status: 204 len: 168 time: 1.6920156 Dec 21 04:15:38.187873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.191301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:38.192795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dcbc077-584d-4075-93c1-334ef7b9793c admin admin] Pushing event deleted for resources: {'Network': ['ID=f4c77e9f-d236-48d1-a572-296b459350f9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:38.221355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Sync routers for ids ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:38.236164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=be4e87be-3a9f-4375-9bd5-4bf953061287,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:38.251870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Routers {'90d26cd2-e44c-4c6e-b116-0759f2c10a50'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:38.252529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:38.373323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.399899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.400200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Set router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:38.404735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34732) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:38.412216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9bc585e4-1d31-4047-9cfe-15bac77fcfbf admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 4.2022226 Dec 21 04:15:38.502100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ea5ac88-286b-4eab-acdc-11c09c36d3c2 None None] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:38.534626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:38.535002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.581564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.651137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=a6fc5490-20ea-48a4-b98d-0375d9beeb57,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:38.670069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.673506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c0c79c40-bb3e-4afa-9014-3ef38df703fd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/a6fc5490-20ea-48a4-b98d-0375d9beeb57 HTTP/1.1" status: 204 len: 168 time: 0.6727679 Dec 21 04:15:38.679499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34734) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:38.685081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:38.688653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a7868752-073c-478d-b6e2-0441d503307b None None] Provisioning complete for port be4e87be-3a9f-4375-9bd5-4bf953061287 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:38.689032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a7868752-073c-478d-b6e2-0441d503307b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.734059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34736) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:38.809854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f6323c59-94f4-4f9d-962c-8e9b6ef42772 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=620778ddaf44496aa625b5014155c9de&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0704594 Dec 21 04:15:38.809974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34738) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:38.836935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-682af7dd-2b8b-45bb-95bb-eae4784a78cd None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:38.886189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be2bdf35-b0d8-4ada-a6df-ce84539eaf2d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.921658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be2bdf35-b0d8-4ada-a6df-ce84539eaf2d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:38.998667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:39.002893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.023548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be2bdf35-b0d8-4ada-a6df-ce84539eaf2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.026466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-be2bdf35-b0d8-4ada-a6df-ce84539eaf2d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.028154 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-be2bdf35-b0d8-4ada-a6df-ce84539eaf2d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/24b29fd1-f281-4787-b4d8-ed95c02c0e25 HTTP/1.1" status: 204 len: 168 time: 0.2155964 Dec 21 04:15:39.055252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2bdf35-b0d8-4ada-a6df-ce84539eaf2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24b29fd1-f281-4787-b4d8-ed95c02c0e25,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:39.153745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.263441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2ce3e56-61ff-4467-bd22-2ef217614e4a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:39.301756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b2ce3e56-61ff-4467-bd22-2ef217614e4a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:39.302093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2ce3e56-61ff-4467-bd22-2ef217614e4a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:39.307685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:15:36Z', 'revision_number': 3, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:39.310995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a7868752-073c-478d-b6e2-0441d503307b None None] Could not find standard attr ID for object 73c87503-0e60-4f1f-a1aa-8c6ba738c7c7. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:15:39.388884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Checking router: 90d26cd2-e44c-4c6e-b116-0759f2c10a50 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:39.389254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Updating router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 port fd126033-e19b-4427-95bc-8ad2db7cc3be binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:15:39.448129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.484672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be4e87be-3a9f-4375-9bd5-4bf953061287 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:39.494961 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.582030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Allocated IP 172.20.0.1 (a3ae4a80-05f9-4f97-b130-3ef4d58b5a25/0f848bba-0197-4f09-bfb3-33ead8383c9a/62412b52-cabc-4eed-b7fb-bc84d6e3d1b9) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:39.659169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:39.667658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:39.673832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:39.674526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.681660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=0875a9be-056f-49c1-a367-813ff135cb0d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:39.757777 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e088a19e-a266-458b-b6ee-bce7e448fed4 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0742247 Dec 21 04:15:39.759526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34748) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:39.767933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'security_group': {'name': 'tempest-secgroup-782152454'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:39.839558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.843411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port be4e87be-3a9f-4375-9bd5-4bf953061287 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:39.843785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.847329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5314675b-9eec-4283-9081-3bd8a75d9567 None None] Provisioning complete for port be4e87be-3a9f-4375-9bd5-4bf953061287 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:39.854325 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5314675b-9eec-4283-9081-3bd8a75d9567 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.907218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.992957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:39.997537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.040288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:40.043424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:40.047500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:40.073189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.101324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Pushing event updated for resources: {'Port': ['ID=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.111735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.161141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34750) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:40.166057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.181918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8aad92a0-79e4-4506-ab59-c8dc563a334e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.217494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5f7e9ddf-834e-46f6-9416-681d614d3183 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=234f738ac38343e0a26b2868b4c339cf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0551722 Dec 21 04:15:40.219974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34752) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:40.243886 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.290234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7383dc16-d7df-4803-ac8e-db053a5faf84 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:40.296948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.300685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-307afcda-625d-4c4d-82e3-4aafad8feed3 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5373590 Dec 21 04:15:40.301274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34758) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:40.306146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'security_group': {'name': 'tempest-secgroup-578292052'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:40.334050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-992db58a-bede-4084-898b-b6566bd7c246 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.338863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbb0910-1205-4247-a1f0-9448b85a1fb4 None None] Pushing event updated for resources: {'Port': ['ID=fd126033-e19b-4427-95bc-8ad2db7cc3be,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.349619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Attempting to bind port fd126033-e19b-4427-95bc-8ad2db7cc3be on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:40.350084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Attempting to bind port fd126033-e19b-4427-95bc-8ad2db7cc3be by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:40.350638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Attempting to bind port fd126033-e19b-4427-95bc-8ad2db7cc3be on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:40.357370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:40.357760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:40.358167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.358559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:40.359148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Bound port: fd126033-e19b-4427-95bc-8ad2db7cc3be, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:40.359543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.364629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-992db58a-bede-4084-898b-b6566bd7c246 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.404929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d6cb1a8-aee7-4f29-8d67-2fc9198f5bc8 None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:40.409856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.492601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.506450 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-992db58a-bede-4084-898b-b6566bd7c246 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.509351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-992db58a-bede-4084-898b-b6566bd7c246 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.513909 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-992db58a-bede-4084-898b-b6566bd7c246 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ca1f4688-d755-4dad-9d89-5caf66596f14 HTTP/1.1" status: 204 len: 168 time: 0.2927699 Dec 21 04:15:40.521835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-992db58a-bede-4084-898b-b6566bd7c246 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca1f4688-d755-4dad-9d89-5caf66596f14,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.524503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Provisioning complete for port fd126033-e19b-4427-95bc-8ad2db7cc3be triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:40.524883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.526865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] For port fd126033-e19b-4427-95bc-8ad2db7cc3be, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:40.541452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] For port fd126033-e19b-4427-95bc-8ad2db7cc3be, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fd126033-e19b-4427-95bc-8ad2db7cc3be,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:40.617010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.619419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Port fd126033-e19b-4427-95bc-8ad2db7cc3be cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:40.652790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.674167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.702299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c40625b-6417-40c5-a7c5-5358c503d485 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:40.709226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:40.709226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.722889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.752414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Routers {'90d26cd2-e44c-4c6e-b116-0759f2c10a50'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:40.753209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:40.764658 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.859675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.862781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Pushing event updated for resources: {'Port': ['ID=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.873431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c673be4f-2054-4b01-9fc4-d8aaed2a0069,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.878976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:40.880342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7bb6a96d-7023-4893-a6cb-f55510c3354c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5784702 Dec 21 04:15:40.883270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34770) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:40.888565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'security_group': {'name': 'tempest-secgroup-475656626'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:40.908791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] Set router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:40.985591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:40.993909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbb0910-1205-4247-a1f0-9448b85a1fb4 None None] Pushing event updated for resources: {'Port': ['ID=fd126033-e19b-4427-95bc-8ad2db7cc3be,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:40.999974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.070493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:41.072482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:41.227500 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.273167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:41.278253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32f88f2c-3f6b-4291-aee0-e96779664eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.300239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.377196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:41.377713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b6f2acf1-3c6b-4cd9-b8f8-865f8153661a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:41.422790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.427380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d794576b-9fbf-421e-be70-b7f2e885ce95 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5428925 Dec 21 04:15:41.428286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34776) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:41.433579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-2139443034', 'security_groups': ['b6f2acf1-3c6b-4cd9-b8f8-865f8153661a'], 'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '0875a9be-056f-49c1-a367-813ff135cb0d'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:41.449283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] Update dhcp port {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'fixed_ips': [{'subnet_id': '3c459144-8784-4d05-850e-e2cb3e54c30f', 'ip_address': '172.20.0.18'}, {'subnet_id': '0875a9be-056f-49c1-a367-813ff135cb0d'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:15:41.549320 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.577606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:41.583270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bde1acf8-230f-4a75-ba47-143b1242e44e admin admin] 10.222.0.18 "PUT /v2.0/routers/90d26cd2-e44c-4c6e-b116-0759f2c10a50/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1768756 Dec 21 04:15:41.622127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '62412b52-cabc-4eed-b7fb-bc84d6e3d1b9', 'name': '', 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'mac_address': 'fa:16:3e:25:50:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_interface', 'standard_attr_id': 3481, 'fixed_ips': [{'subnet_id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:39Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 2, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'subnets': [{'id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:41.702841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b53c0ef-d1f2-4c58-ae59-ef4643f62291 None None] The sync data for ids ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'] in n-d-822053-11 is: [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '62412b52-cabc-4eed-b7fb-bc84d6e3d1b9', 'name': '', 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'mac_address': 'fa:16:3e:25:50:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_interface', 'standard_attr_id': 3481, 'fixed_ips': [{'subnet_id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:39Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 2, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'subnets': [{'id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:41.727407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Provisioning complete for port fd126033-e19b-4427-95bc-8ad2db7cc3be triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:41.727762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:41.741688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:41.815160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] Allocated IP 172.20.0.2 (bcf1b1c3-e446-4833-886a-d47191e91971/0875a9be-056f-49c1-a367-813ff135cb0d/ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:41.852470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.039563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,segment=NetworkSegment(75507f0b-0fef-4b21-8254-08a0df754f10),segment_id=75507f0b-0fef-4b21-8254-08a0df754f10)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:42.084279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.180534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.247541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.374521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34790) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:42.380672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-677056364', 'description': 'tempest-secgroup-smoke-677056364 description', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:42.445141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] device_id is not set on port b2a3b85c-918a-4a81-a556-16012484d9db yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:15:42.491646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.582530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.589103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] For port fd126033-e19b-4427-95bc-8ad2db7cc3be, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fd126033-e19b-4427-95bc-8ad2db7cc3be,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:42.590012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c23e3c0-2c1a-44e5-9c32-e6791142b46b None None] Pushing event updated for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:42.632572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.660968 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.684895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroup': ['ID=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:42.737590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.14 (bcf1b1c3-e446-4833-886a-d47191e91971/0875a9be-056f-49c1-a367-813ff135cb0d/b2a3b85c-918a-4a81-a556-16012484d9db) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:42.759602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Provisioning complete for port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:42.759983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.824547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:42.840989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f11ccf2-b356-4bb4-9980-463fc26d05ff None None] Pushing event updated for resources: {'Port': ['ID=fd126033-e19b-4427-95bc-8ad2db7cc3be,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:42.847201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:42.851372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1e2705c-d75e-47d0-977e-1437538d4089 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4729772 Dec 21 04:15:42.852562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34794) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:42.858593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group_rule': {'security_group_id': '24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:42.967949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.015417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.090651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.099549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.141641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:43.147334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:43.151373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:43.175470 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.208347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=b2a3b85c-918a-4a81-a556-16012484d9db,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:43.208641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a53a23c7-3b0c-4397-8859-ec8808b51da1,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:43.238167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:43.239145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.257643 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.258889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0cbea724-9d57-4de2-a749-63173769ef34 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4048774 Dec 21 04:15:43.261758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34798) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:43.266673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group_rule': {'security_group_id': '24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:43.317262 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d53969cd-36e8-4baf-b937-48b843b7ba1c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 1.8781197 Dec 21 04:15:43.317660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34800) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:43.317660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:43.364486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bb46e532-5c76-4caa-9e34-efa3350fc201 None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:43.364928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb46e532-5c76-4caa-9e34-efa3350fc201 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.398910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.465937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bb46e532-5c76-4caa-9e34-efa3350fc201 None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:43.479383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bb46e532-5c76-4caa-9e34-efa3350fc201 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:43.480028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb46e532-5c76-4caa-9e34-efa3350fc201 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.506115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.586732 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.593799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fd126033-e19b-4427-95bc-8ad2db7cc3be up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:43.622294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bbead8d5-b248-4036-ad15-6e4188b5b649,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:43.667183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port fd126033-e19b-4427-95bc-8ad2db7cc3be triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:43.667720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.686286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.687918 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0fe8a45-4677-4ab7-aa09-3faf8acff395 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4250350 Dec 21 04:15:43.690534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34804) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:43.695345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group_rule': {'security_group_id': '24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:43.759783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:43.787331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ccd1d38b-33f7-44e5-8a63-3fe80f254288 None None] Provisioning complete for port b2a3b85c-918a-4a81-a556-16012484d9db triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:43.788678 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ccd1d38b-33f7-44e5-8a63-3fe80f254288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.821697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.836530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ccd1d38b-33f7-44e5-8a63-3fe80f254288 None None] Port b2a3b85c-918a-4a81-a556-16012484d9db cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:43.848332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:43.848655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.901117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.933936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:43.937621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.963396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:43.985144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a84392a-273d-490a-9c75-e0218d9e8110,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:44.025385 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 0875a9be-056f-49c1-a367-813ff135cb0d (CIDR: 172.20.0.0/28) Dec 21 04:15:44.051130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.052363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6982d3c6-b9c4-4fb7-ba7f-b31f5c08beca tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3606150 Dec 21 04:15:44.055177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34818) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:44.059563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group_rule': {'security_group_id': '24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:44.101914 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:15:44.102396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:44.165672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.223224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-002e1693-6e52-4500-80bb-9cf735d4572c tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9143138 Dec 21 04:15:44.227257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.233185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:44.237933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:44.317350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.344158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d92a111a-5b52-4d9a-9003-f7494f1cf3d1,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:44.424198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.427882 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05095300-6e65-4192-818d-6c0b145c170b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3692102 Dec 21 04:15:44.430349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34840) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:44.432853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group_rule': {'security_group_id': '24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:44.508011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:44.508409 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Project 73bd75f8ded64d5f8a07e09906286ea6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:15:44.512681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.514024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.569704 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Sync routers for ids ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:44.582604 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Routers {'90d26cd2-e44c-4c6e-b116-0759f2c10a50'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:44.583520 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:44.619827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.627710 n-d-822053-11 neutron-server[110311]: INFO neutron.db.ipam_backend_mixin [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 3c459144-8784-4d05-850e-e2cb3e54c30f (CIDR: 172.20.0.16/28) Dec 21 04:15:44.655798 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:15:44.656364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:44.679640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.696686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8bd8ff1-66f2-45aa-9496-afeae8fecb68,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:44.706716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Set router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:44.725978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dc930551-c6aa-4254-a7c8-cb43ff3d2ec7 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.4914441 Dec 21 04:15:44.728619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34844) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:44.734022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'subnet': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:44.810475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.811648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-77f1b7e4-fcc9-467e-87be-f084dd839b8f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3824196 Dec 21 04:15:44.814372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34846) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:44.820248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'security_group_rule': {'security_group_id': '24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4', 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:44.907306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '62412b52-cabc-4eed-b7fb-bc84d6e3d1b9', 'name': '', 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'mac_address': 'fa:16:3e:25:50:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_interface', 'standard_attr_id': 3481, 'fixed_ips': [{'subnet_id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:39Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 2, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'subnets': [{'id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:44.929482 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Project 73bd75f8ded64d5f8a07e09906286ea6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:15:44.936776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:44.937843 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Checking router: 90d26cd2-e44c-4c6e-b116-0759f2c10a50 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:44.938231 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Updating router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:15:44.963697 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.010476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.049180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Made reservation on behalf of 8b9d8340243a470db22458ae1b476624 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:45.052789 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.107446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.133030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a2f4d4e-2291-4cd8-a289-9d950f4868fa,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:45.236832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.238051 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-797b8656-abe9-48d7-b5a5-23256fbb0970 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4220088 Dec 21 04:15:45.263232 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.328404 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.391116 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Pushing event updated for resources: {'Port': ['ID=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:45.426585 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.427337 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.427932 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.428517 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.429081 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.429626 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.430165 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.430704 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.431266 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.431833 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.432358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.432739 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.433277 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.433822 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:15:45.441975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-9fe35076-2dfb-40d8-bed0-d25899d46930 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-677056364&fields=id&tenant_id=73bd75f8ded64d5f8a07e09906286ea6 HTTP/1.1" status: 200 len: 267 time: 0.0755339 Dec 21 04:15:45.468332 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Attempting to bind port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:45.469097 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Attempting to bind port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:45.469677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Attempting to bind port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 on network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:45.475806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:45.476546 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Checking segment: {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:45.477167 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.477933 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Bound using segment: {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:45.478618 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Bound port: 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f226a94f-5d12-480c-8ea4-3c6852adfa58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:45.479339 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.509710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Network bcf1b1c3-e446-4833-886a-d47191e91971 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:45.513571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:45.519117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:45.519716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.529221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1b0b8c7-81b1-4f36-88be-8c10fed47448 None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:45.532222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Subnet': ['ID=a6ddd7c6-302a-4880-bb3f-82e0623d3347,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:45.576306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] For port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:45.587292 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] For port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:45.608697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9580a9b6-6383-423a-b40b-8156b90e4187 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.8789122 Dec 21 04:15:45.611374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34864) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:45.619469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-2120958108', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'a6ddd7c6-302a-4880-bb3f-82e0623d3347'}], 'security_groups': ['8aad92a0-79e4-4506-ab59-c8dc563a334e', 'c673be4f-2054-4b01-9fc4-d8aaed2a0069']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:45.655882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-97e0d4df-6a3f-40ee-897f-624289fb8680 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:45.665341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-97e0d4df-6a3f-40ee-897f-624289fb8680 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/networks?id=ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 200 len: 809 time: 0.2222364 Dec 21 04:15:45.678666 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.692399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-5af98541-429c-4ab4-b422-f9f971d2270d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/quotas/73bd75f8ded64d5f8a07e09906286ea6 HTTP/1.1" status: 200 len: 375 time: 0.0258076 Dec 21 04:15:45.757742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e3b941-9efd-4d35-a552-a48c34e44da0 None None] Pushing event updated for resources: {'Port': ['ID=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:45.774157 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Routers {'90d26cd2-e44c-4c6e-b116-0759f2c10a50'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:45.774157 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:45.822261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-ac4b9e6e-a57b-42d4-982a-52d5acf83c03 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1271627 Dec 21 04:15:45.842402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] Update dhcp port {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'fixed_ips': [{'subnet_id': '3c459144-8784-4d05-850e-e2cb3e54c30f', 'ip_address': '172.20.0.18'}, {'subnet_id': '0875a9be-056f-49c1-a367-813ff135cb0d', 'ip_address': '172.20.0.2'}, {'subnet_id': 'a6ddd7c6-302a-4880-bb3f-82e0623d3347'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:15:45.844605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d420d93a-77da-4b13-a601-56a605c80919 None None] Provisioning complete for port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:45.845078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d420d93a-77da-4b13-a601-56a605c80919 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.915330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:45.925111 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] Set router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:45.965881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-c2a05db9-58ed-457b-9953-cbdaeda03ff8 service neutron] 10.222.0.18 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301417 Dec 21 04:15:46.104650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:46.160621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-227fbc17-a705-4182-b01a-6459287a3841 service neutron] 10.222.0.18 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1881938 Dec 21 04:15:46.200855 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '62412b52-cabc-4eed-b7fb-bc84d6e3d1b9', 'name': '', 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'mac_address': 'fa:16:3e:25:50:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_interface', 'standard_attr_id': 3481, 'fixed_ips': [{'subnet_id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:39Z', 'updated_at': '2021-12-21T04:15:45Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'subnets': [{'id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:46.201141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] Allocated IP 172.20.0.34 (bcf1b1c3-e446-4833-886a-d47191e91971/a6ddd7c6-302a-4880-bb3f-82e0623d3347/ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:46.231879 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748aa13f-f977-4726-9f09-00c1d61a5879 None None] The sync data for ids ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'] in n-d-822053-11 is: [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:15:40Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '62412b52-cabc-4eed-b7fb-bc84d6e3d1b9', 'name': '', 'network_id': 'a3ae4a80-05f9-4f97-b130-3ef4d58b5a25', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'mac_address': 'fa:16:3e:25:50:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_interface', 'standard_attr_id': 3481, 'fixed_ips': [{'subnet_id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:39Z', 'updated_at': '2021-12-21T04:15:45Z', 'revision_number': 4, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'subnets': [{'id': '0f848bba-0197-4f09-bfb3-33ead8383c9a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:46.238816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d420d93a-77da-4b13-a601-56a605c80919 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:46.352380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d420d93a-77da-4b13-a601-56a605c80919 None None] For port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:46.403611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,segment=NetworkSegment(75507f0b-0fef-4b21-8254-08a0df754f10),segment_id=75507f0b-0fef-4b21-8254-08a0df754f10)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:46.406228 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d420d93a-77da-4b13-a601-56a605c80919 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:46.487267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d420d93a-77da-4b13-a601-56a605c80919 None None] Pushing event updated for resources: {'Port': ['ID=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:46.493340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:46.530503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ac604953-64f8-41d9-8b7e-d6ff74bf7054 None None] Provisioning complete for port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:46.531288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac604953-64f8-41d9-8b7e-d6ff74bf7054 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:46.550826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4726b847-a9cf-45c7-885e-6d521b99054e req-c321b075-96b3-48eb-a00c-238b6a73f242 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 210 time: 0.0397582 Dec 21 04:15:46.568079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:46.728813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Delete allocated IP 172.20.0.14 (bcf1b1c3-e446-4833-886a-d47191e91971/0875a9be-056f-49c1-a367-813ff135cb0d) {{(pid=110310) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 21 04:15:46.740357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26449650-0641-4df1-b1bc-08f35c5f9a08 None None] Pushing event updated for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:46.741798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Allocated IP 172.20.0.37 (bcf1b1c3-e446-4833-886a-d47191e91971/a6ddd7c6-302a-4880-bb3f-82e0623d3347/b2a3b85c-918a-4a81-a556-16012484d9db) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:47.033542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.122766 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.212662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event updated for resources: {'Port': ['ID=b2a3b85c-918a-4a81-a556-16012484d9db,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:47.276676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] In _notify_port_updated(), no bound segment for port b2a3b85c-918a-4a81-a556-16012484d9db on network bcf1b1c3-e446-4833-886a-d47191e91971 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:15:47.283474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:47.284293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.291014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34884) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:47.292656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ef9aab73-e2b5-489c-b310-32dc6899e79f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "PUT /v2.0/ports/b2a3b85c-918a-4a81-a556-16012484d9db HTTP/1.1" status: 200 len: 960 time: 1.6785984 Dec 21 04:15:47.428697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port b2a3b85c-918a-4a81-a556-16012484d9db {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:47.428697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.529333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:47.561535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.563760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-67f3832d-95b8-4dc3-952f-aecac9fd7138 None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:47.564229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67f3832d-95b8-4dc3-952f-aecac9fd7138 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.576731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for b2a3b85c-918a-4a81-a556-16012484d9db owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:47.609734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-67f3832d-95b8-4dc3-952f-aecac9fd7138 None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:47.635393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:47.635765 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.672171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9be5f569-5e15-44cc-822a-d4f84f00260c req-b98b410a-32e1-4696-adae-caab40ddd16a tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 210 time: 0.0510192 Dec 21 04:15:47.681196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-67f3832d-95b8-4dc3-952f-aecac9fd7138 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:47.681783 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67f3832d-95b8-4dc3-952f-aecac9fd7138 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.810215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:47.816587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:47.836271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-67f3832d-95b8-4dc3-952f-aecac9fd7138 None None] Could not find standard attr ID for object b2a3b85c-918a-4a81-a556-16012484d9db. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:15:47.864517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=b2a3b85c-918a-4a81-a556-16012484d9db,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:47.879615 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:15:47.886032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:47.886712 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.004299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.009403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-33cca4a5-4576-4228-be91-e0348dde7c3a tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/b2a3b85c-918a-4a81-a556-16012484d9db HTTP/1.1" status: 204 len: 168 time: 0.7172866 Dec 21 04:15:48.012016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34896) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:48.060260 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-3ddc9728-f25a-4d16-99f0-9dc5321d9821 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] GET failed (client error): The resource could not be found. Dec 21 04:15:48.061764 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ddc9728-f25a-4d16-99f0-9dc5321d9821 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports/b2a3b85c-918a-4a81-a556-16012484d9db HTTP/1.1" status: 404 len: 333 time: 0.0485051 Dec 21 04:15:48.066758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34900) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:48.069464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a28db9-dd06-4c18-8fcc-97c0a662c419 req-c1f809eb-09d3-4c9b-917c-f3995c6940ce tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:48.078677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1a28db9-dd06-4c18-8fcc-97c0a662c419 req-c1f809eb-09d3-4c9b-917c-f3995c6940ce tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1097 time: 0.0824864 Dec 21 04:15:48.164046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ef6bfed4-8288-4031-9e3b-dd0c9a897ec4 None None] Could not find standard attr ID for object b2a3b85c-918a-4a81-a556-16012484d9db. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:15:48.178285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1a28db9-dd06-4c18-8fcc-97c0a662c419 req-91c53c93-3c00-4ff8-9243-a2ee6bd64f8d tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0845649 Dec 21 04:15:48.200182 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86e6e4fa-a7bc-497d-b52d-10e6649df6f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.207915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34902) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:48.232898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86e6e4fa-a7bc-497d-b52d-10e6649df6f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.357599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86e6e4fa-a7bc-497d-b52d-10e6649df6f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.360269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-86e6e4fa-a7bc-497d-b52d-10e6649df6f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.364058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-86e6e4fa-a7bc-497d-b52d-10e6649df6f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/security-groups/b6f2acf1-3c6b-4cd9-b8f8-865f8153661a HTTP/1.1" status: 204 len: 168 time: 0.2821777 Dec 21 04:15:48.364986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:48.382091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e6e4fa-a7bc-497d-b52d-10e6649df6f6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6f2acf1-3c6b-4cd9-b8f8-865f8153661a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:48.433217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 88d82c11-2a48-49ee-b607-2bfc7e02c0ad {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:48.433553 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.472354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9d91939-f50b-49e0-bf89-afbda0bf22ba tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.530843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9d91939-f50b-49e0-bf89-afbda0bf22ba tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.570597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.570836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.594723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 88d82c11-2a48-49ee-b607-2bfc7e02c0ad owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:48.680484 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9d91939-f50b-49e0-bf89-afbda0bf22ba tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.683083 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9d91939-f50b-49e0-bf89-afbda0bf22ba tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.684255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e9d91939-f50b-49e0-bf89-afbda0bf22ba tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/security-groups/c673be4f-2054-4b01-9fc4-d8aaed2a0069 HTTP/1.1" status: 204 len: 168 time: 0.3170352 Dec 21 04:15:48.687127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34908) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:48.698880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d91939-f50b-49e0-bf89-afbda0bf22ba tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c673be4f-2054-4b01-9fc4-d8aaed2a0069,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:48.778401 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f46a2d7b-a7b9-46c3-839a-dcd9b5900c42 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.836114 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f46a2d7b-a7b9-46c3-839a-dcd9b5900c42 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.840359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ba96454-331e-4337-a24a-f0a10d431adf req-9e90ea30-143c-4bf2-82d1-f55e138bac60 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 210 time: 0.0378001 Dec 21 04:15:48.867186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.893538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=88d82c11-2a48-49ee-b607-2bfc7e02c0ad,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:48.957080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.957399 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a disassociated (deleted). External IP: 172.25.5.137, port: a1a159da-8ede-44a2-8929-065e82a2dee0. Dec 21 04:15:48.968246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f46a2d7b-a7b9-46c3-839a-dcd9b5900c42 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.974379 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f46a2d7b-a7b9-46c3-839a-dcd9b5900c42 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:48.978507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f46a2d7b-a7b9-46c3-839a-dcd9b5900c42 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/security-groups/8aad92a0-79e4-4506-ab59-c8dc563a334e HTTP/1.1" status: 204 len: 168 time: 0.2873924 Dec 21 04:15:48.980572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34914) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:49.024390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46a2d7b-a7b9-46c3-839a-dcd9b5900c42 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8aad92a0-79e4-4506-ab59-c8dc563a334e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:49.051158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet 0875a9be-056f-49c1-a367-813ff135cb0d {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:49.055083 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.098767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.201761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.216153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:49.346448 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.383793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=0875a9be-056f-49c1-a367-813ff135cb0d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:49.387933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.391630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-efda669a-ed3e-4db0-8806-535080dc0c01 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/0875a9be-056f-49c1-a367-813ff135cb0d HTTP/1.1" status: 204 len: 168 time: 0.3992488 Dec 21 04:15:49.398355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34918) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:49.401473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-253d720a-a6f3-4427-999a-46a2b92f08d9 None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:49.433132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-03d4b2ea-96e1-4462-a207-5527c5f9d327 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:49.434699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-03d4b2ea-96e1-4462-a207-5527c5f9d327 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.54 "GET /v2.0/networks?id=ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 200 len: 809 time: 0.2156057 Dec 21 04:15:49.436170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:49.441734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.454144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] Sync routers for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:49.488363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d24aa414-0076-40da-9ddb-d3dfef71072f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/floatingips/bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a HTTP/1.1" status: 204 len: 168 time: 1.2810581 Dec 21 04:15:49.490026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:49.490640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet a6ddd7c6-302a-4880-bb3f-82e0623d3347 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:49.492802 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75a49928-a4c9-45fd-be48-2b8e213a6142" -d '{"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:49.494702 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.536007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:49.536654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:49.563297 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-e508d5cb-8a43-4815-adc8-dd1b32436dd4 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=73bd75f8ded64d5f8a07e09906286ea6 HTTP/1.1" status: 200 len: 379 time: 0.0980968 Dec 21 04:15:49.566112 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64aa52a7-14d3-49ae-9dfc-9fe8ededf3c7 x-openstack-request-id: req-64aa52a7-14d3-49ae-9dfc-9fe8ededf3c7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:49.567350 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:49.568163 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-64aa52a7-14d3-49ae-9dfc-9fe8ededf3c7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:49.569280 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'status': 'completed', 'code': 200} Dec 21 04:15:49.586918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.601099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'port': {'device_id': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'admin_state_up': True, 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'security_groups': ['24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:49.711412 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:49.744658 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.780672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-b7fc5e91-7d1c-4a2a-9629-78d27dcbc567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:49.785739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-b7fc5e91-7d1c-4a2a-9629-78d27dcbc567 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 1097 time: 0.1628406 Dec 21 04:15:49.902039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.939081 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Made reservation on behalf of 73bd75f8ded64d5f8a07e09906286ea6 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:49.947422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.949211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5692ef7-46a2-4b6c-b1c0-cf7d90b974b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.971212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=a6ddd7c6-302a-4880-bb3f-82e0623d3347,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:49.983253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:49.994381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-11eee350-2c69-4b0f-b86b-153e94aaec71 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/a6ddd7c6-302a-4880-bb3f-82e0623d3347 HTTP/1.1" status: 204 len: 168 time: 0.5937018 Dec 21 04:15:49.995584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34930) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:50.007643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-ff632783-d27b-44aa-860e-fcb4a5216f1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:50.009479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-ff632783-d27b-44aa-860e-fcb4a5216f1c service neutron] 10.222.0.54 "GET /v2.0/networks?id=3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 200 len: 898 time: 0.2107275 Dec 21 04:15:50.021928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:57Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:50.072537 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-2b6b2a8c-2b39-44fe-886d-a2e308e62d3c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 200 len: 217 time: 0.0532882 Dec 21 04:15:50.094730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] Checking router: 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:50.110200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:50.111155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:50.129236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b933b2f-ea62-4b0d-a6e9-7b14c79c2aa6 req-d2436833-c1fe-4e5b-b822-fefff58812ce tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 210 time: 0.0620220 Dec 21 04:15:50.133141 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-4fbffb1a-0d40-4053-a421-f1bed739de20 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:50.133818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4fbffb1a-0d40-4053-a421-f1bed739de20 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:50.141802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4fbffb1a-0d40-4053-a421-f1bed739de20 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/0875a9be-056f-49c1-a367-813ff135cb0d HTTP/1.1" status: 404 len: 337 time: 0.1451838 Dec 21 04:15:50.156509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-d16066fb-17b2-4a19-8bbd-bace62505792 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:50.158049 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-d16066fb-17b2-4a19-8bbd-bace62505792 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 200 len: 834 time: 0.0555749 Dec 21 04:15:50.163638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34932) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:50.215860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf0ffbc-ba6c-4271-9d3b-242a812808a7 req-1e039f30-e5f5-4b47-a6b3-ffac39300380 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:50.218627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbf0ffbc-ba6c-4271-9d3b-242a812808a7 req-1e039f30-e5f5-4b47-a6b3-ffac39300380 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.1126642 Dec 21 04:15:50.249285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting subnet 3c459144-8784-4d05-850e-e2cb3e54c30f {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:50.252703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:50.298538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:50.302076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbf0ffbc-ba6c-4271-9d3b-242a812808a7 req-2cfc1546-ba25-429e-a3ca-3356602912f8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0769303 Dec 21 04:15:50.485226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Allocated IP 172.20.0.12 (ad2df216-0eaf-414a-a835-c27348ac987a/0707099f-c76b-4feb-9475-4cacc79c073a/8ad7f863-c0ba-45c6-be94-e1b99c5857b9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:50.492095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-c5173fec-da3f-4e44-8f08-9feb13ecd058 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:50.493612 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-c5173fec-da3f-4e44-8f08-9feb13ecd058 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=3f781088-f4ae-4039-bd42-2337b91d459d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2620628 Dec 21 04:15:50.581873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:50.587815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dab0332-a324-469b-959a-1524fd209e0c None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:50.626619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:50.790608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fa6db415-7392-49f7-a28c-1650a97e212b None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:50.791006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa6db415-7392-49f7-a28c-1650a97e212b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:50.836333 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:50.846099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34942) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:50.860107 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-49eb362e-2703-4948-9d6e-8697e7cf7c97 service neutron] 10.222.0.54 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3338351 Dec 21 04:15:50.928089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fa6db415-7392-49f7-a28c-1650a97e212b None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:50.949618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:50.962819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fa6db415-7392-49f7-a28c-1650a97e212b None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:50.963313 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa6db415-7392-49f7-a28c-1650a97e212b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.009129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Subnet': ['ID=3c459144-8784-4d05-850e-e2cb3e54c30f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:51.017749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.021174 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb1ae5bf-3425-4cf6-a45d-9d27680f7fb0 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/3c459144-8784-4d05-850e-e2cb3e54c30f HTTP/1.1" status: 204 len: 168 time: 0.8586719 Dec 21 04:15:51.025125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34946) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.028468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.046754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c475f961-b8e1-4853-8e90-dcbd3b67be9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.098252 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-96b4668d-7bb4-4ca2-9314-9959052c4b84 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.098712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-96b4668d-7bb4-4ca2-9314-9959052c4b84 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.101915 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-96b4668d-7bb4-4ca2-9314-9959052c4b84 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/a6fc5490-20ea-48a4-b98d-0375d9beeb57 HTTP/1.1" status: 404 len: 337 time: 0.0757887 Dec 21 04:15:51.102538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-394f0f84-dad9-4e07-bbc2-f0a6d7a1746c None None] Update dhcp port {'port': {'network_id': 'bcf1b1c3-e446-4833-886a-d47191e91971', 'fixed_ips': [{'subnet_id': '3c459144-8784-4d05-850e-e2cb3e54c30f'}], 'binding:host_id': 'n-d-822053-11'}, 'id': 'ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:15:51.108383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34948) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.132791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-75a49928-a4c9-45fd-be48-2b8e213a6142 req-9182b06b-bfe3-4167-a64f-c30c84c5ce13 service neutron] 10.222.0.54 "GET /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2614169 Dec 21 04:15:51.135029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Network ad2df216-0eaf-414a-a835-c27348ac987a is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:51.139686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:51.145593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:51.174413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'Port': ['ID=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:51.201903 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-394f0f84-dad9-4e07-bbc2-f0a6d7a1746c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.227073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:51.227849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.246373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34952) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.248709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9e393841-dd2a-42a1-8fbb-6c28a76e8576 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "GET /v2.0/ports?device_id=8c69b967-0612-4084-9ed9-0c56c658a796 HTTP/1.1" status: 200 len: 205 time: 0.1274886 Dec 21 04:15:51.309182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:57Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:51.337866 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-fc283df6-d527-4d8c-8e07-b8f468f58e05 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] delete failed (client error): The resource could not be found. Dec 21 04:15:51.339485 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fc283df6-d527-4d8c-8e07-b8f468f58e05 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/routers/8c69b967-0612-4084-9ed9-0c56c658a796 HTTP/1.1" status: 404 len: 336 time: 0.0913234 Dec 21 04:15:51.341919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.350465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-339e88f9-297e-4c2a-b420-1158a18bdf86 None None] The sync data for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 is: [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:13:53Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b2cfca4b-dabd-466a-bfd3-52523c2cce76', 'name': '', 'network_id': '3f781088-f4ae-4039-bd42-2337b91d459d', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:d6:6a:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3293, 'fixed_ips': [{'subnet_id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:52Z', 'updated_at': '2021-12-21T04:13:57Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': 'cc3361a8-c44a-4f96-8ecd-d8322bcd66f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:51.388351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c475f961-b8e1-4853-8e90-dcbd3b67be9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.389268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-4a346521-2ded-4ffd-bbd7-5f5b1ad1462d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7993038 Dec 21 04:15:51.412627 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-0bfd8b14-ac64-4e96-b534-bfb2e40d76c1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.413463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0bfd8b14-ac64-4e96-b534-bfb2e40d76c1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.417125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0bfd8b14-ac64-4e96-b534-bfb2e40d76c1 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/8db675a6-ec65-4dd3-981e-11c4aaa13e77 HTTP/1.1" status: 404 len: 337 time: 0.0737004 Dec 21 04:15:51.439781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34958) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.462548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Request body: {'port': {'device_id': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:51.509236 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-78d9e2dd-7234-4167-b9f4-9d3bc691cbfd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.509406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-78d9e2dd-7234-4167-b9f4-9d3bc691cbfd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.513388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78d9e2dd-7234-4167-b9f4-9d3bc691cbfd tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/b78c9042-4ffd-4a26-94fd-966e82dfadb9 HTTP/1.1" status: 404 len: 337 time: 0.0716484 Dec 21 04:15:51.548183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34960) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.556284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff1d4860-ee70-46c9-b62f-fd2ba813600d None None] Network bcf1b1c3-e446-4833-886a-d47191e91971 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:51.572444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a759012-e4ec-4967-ab73-46e5c9d87fe9 req-4f6894be-df73-416d-bf58-6f532029f7d0 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:51.580335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a759012-e4ec-4967-ab73-46e5c9d87fe9 req-4f6894be-df73-416d-bf58-6f532029f7d0 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 932 time: 0.2884829 Dec 21 04:15:51.599388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c475f961-b8e1-4853-8e90-dcbd3b67be9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.628040 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-2299ba67-40a9-43a8-9ca8-09bfebf4134f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.628529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2299ba67-40a9-43a8-9ca8-09bfebf4134f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.634891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2299ba67-40a9-43a8-9ca8-09bfebf4134f tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/8eee073c-0bf9-46a9-b05a-5800584a45fe HTTP/1.1" status: 404 len: 337 time: 0.0854847 Dec 21 04:15:51.643688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-a86c1732-fc45-4fdb-9a05-8eda42680a6e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:51.645167 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-a86c1732-fc45-4fdb-9a05-8eda42680a6e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.54 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.2731824 Dec 21 04:15:51.648821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34962) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.665466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c475f961-b8e1-4853-8e90-dcbd3b67be9e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=03ca185d593f497bae1766fbfe6aa0e8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8155463 Dec 21 04:15:51.671490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34964) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.682455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Provisioning complete for port 6db3a24f-d841-4101-8985-34354a1280f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:51.685290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.685530 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-5aae6aa5-8a66-4d03-a008-11ad884988cb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.686381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5aae6aa5-8a66-4d03-a008-11ad884988cb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.692259 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5aae6aa5-8a66-4d03-a008-11ad884988cb tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/4eab3480-a39d-44a4-bba7-7a75338fe349 HTTP/1.1" status: 404 len: 333 time: 0.0428703 Dec 21 04:15:51.695911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8422a253-2d9c-4e19-9a2b-5f423829b2e0 req-afe14215-94c4-4804-84c9-bbb48f307671 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:51.700481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8422a253-2d9c-4e19-9a2b-5f423829b2e0 req-afe14215-94c4-4804-84c9-bbb48f307671 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 945 time: 0.2570183 Dec 21 04:15:51.707374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34966) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.721192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] DHCP port deletion for bcf1b1c3-e446-4833-886a-d47191e91971 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:51.721721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.762342 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-6b53defe-4b22-4ed3-aaff-d8be2e7af1db tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.763019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6b53defe-4b22-4ed3-aaff-d8be2e7af1db tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.766699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6b53defe-4b22-4ed3-aaff-d8be2e7af1db tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/e74653e6-7b52-42bc-b683-df3093c42515 HTTP/1.1" status: 404 len: 337 time: 0.0554323 Dec 21 04:15:51.772734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Port 6db3a24f-d841-4101-8985-34354a1280f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:51.795429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Provisioning complete for port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:51.795902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.801020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34968) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.805721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c475f961-b8e1-4853-8e90-dcbd3b67be9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b62f295c-a1f4-4275-804a-916a97bfff37,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:51.841286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] Deleting port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:51.842449 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.862320 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-81c5bcec-1bc3-4d0b-ac13-d56f2f67a72e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.862881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-81c5bcec-1bc3-4d0b-ac13-d56f2f67a72e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.869365 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81c5bcec-1bc3-4d0b-ac13-d56f2f67a72e tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/ebe05454-5965-4b03-8688-507b5d8ea450 HTTP/1.1" status: 404 len: 337 time: 0.0599496 Dec 21 04:15:51.869695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:15:51.870113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.884353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a759012-e4ec-4967-ab73-46e5c9d87fe9 req-fe524eaf-d261-4b15-9e77-846ecb2807a7 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3031034 Dec 21 04:15:51.887596 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2396909c-a899-467d-989e-60d90480bc41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.909128 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-29b6053f-f739-4172-be92-fe4544d3a107 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:51.916612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-29b6053f-f739-4172-be92-fe4544d3a107 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:51.923297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2396909c-a899-467d-989e-60d90480bc41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.923650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Provisioning complete for port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:15:51.924038 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c12eae2-5bdf-40a4-a566-46b5dcc46737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.924875 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-29b6053f-f739-4172-be92-fe4544d3a107 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/840ebe51-c519-4ac6-9843-bc68d93b0c20 HTTP/1.1" status: 404 len: 333 time: 0.0511761 Dec 21 04:15:51.925947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 34974) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:51.931163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] For port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,segment=NetworkSegment(75507f0b-0fef-4b21-8254-08a0df754f10),segment_id=75507f0b-0fef-4b21-8254-08a0df754f10)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:51.931477 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:51.937654 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81868f04-f154-43c4-8d8f-965e2a4ccbd0 None None] New status for floating IP bc67cbd2-d98d-4da6-88c7-4a9c75c78e1a: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:15:51.966455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] Calling delete_port for ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:52.014690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8422a253-2d9c-4e19-9a2b-5f423829b2e0 req-102e0c22-eb84-4cb2-bebc-b00a5bed1dfc tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=f9f8a49a-c6e1-46d9-9a17-77192d2462b6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2990520 Dec 21 04:15:52.030259 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-f17a9016-95dd-49b4-9eff-81133f46f7b6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:52.033896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f17a9016-95dd-49b4-9eff-81133f46f7b6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:52.039168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f17a9016-95dd-49b4-9eff-81133f46f7b6 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/b7990c05-321d-4a74-9b03-cfcc12267eaf HTTP/1.1" status: 404 len: 337 time: 0.0980146 Dec 21 04:15:52.042273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34976) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:52.082534 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-dcc0185f-b3d6-440e-8636-e5289ae43824 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] DELETE failed (client error): The resource could not be found. Dec 21 04:15:52.082692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dcc0185f-b3d6-440e-8636-e5289ae43824 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:15:52.083901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port a1a159da-8ede-44a2-8929-065e82a2dee0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:52.084239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.088919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dcc0185f-b3d6-440e-8636-e5289ae43824 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/subnets/3530aaa8-279d-41c4-961b-57ea0096c0a8 HTTP/1.1" status: 404 len: 337 time: 0.0446744 Dec 21 04:15:52.089810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34978) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:52.090458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2396909c-a899-467d-989e-60d90480bc41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.093544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2396909c-a899-467d-989e-60d90480bc41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.097750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2396909c-a899-467d-989e-60d90480bc41 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b62f295c-a1f4-4275-804a-916a97bfff37 HTTP/1.1" status: 204 len: 168 time: 0.4199743 Dec 21 04:15:52.155705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2396909c-a899-467d-989e-60d90480bc41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b62f295c-a1f4-4275-804a-916a97bfff37,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:52.203049 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.206281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Deleting port 6db3a24f-d841-4101-8985-34354a1280f9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:52.207003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.233343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] Pushing event deleted for resources: {'Port': ['ID=ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:52.235345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-929feb64-28df-4a59-86a1-9c6d202099e6 None None] No DVR routers for this DVR port ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:52.305213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.321422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Calling delete_port for 6db3a24f-d841-4101-8985-34354a1280f9 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:52.483314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.512773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Port': ['ID=6db3a24f-d841-4101-8985-34354a1280f9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:52.518591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.522736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-25cd40b9-f710-4e4c-8c57-afe2a8333b72 tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/ports/6db3a24f-d841-4101-8985-34354a1280f9 HTTP/1.1" status: 204 len: 168 time: 0.4232473 Dec 21 04:15:52.525096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34984) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:52.601880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.623451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port a1a159da-8ede-44a2-8929-065e82a2dee0, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=a1a159da-8ede-44a2-8929-065e82a2dee0,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:52.623997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.650152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for a1a159da-8ede-44a2-8929-065e82a2dee0 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:52.660266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8fdc1cee-1c43-44e5-bfe5-9bd7aa14e1d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.695855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.723367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bcf1b1c3-e446-4833-886a-d47191e91971']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:52.733263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75507f0b-0fef-4b21-8254-08a0df754f10') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:52.733628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75507f0b-0fef-4b21-8254-08a0df754f10') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:52.743176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.757764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.759076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:15:52.763726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:52.764133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:52.767165 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:52.770631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.829085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34986) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:52.841718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ccf555f-ed18-49cf-9448-d59fc5f36eac admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.913845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ccf555f-ed18-49cf-9448-d59fc5f36eac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.923197 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.932811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:52.936358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] 10.222.0.18 "DELETE /v2.0/networks/bcf1b1c3-e446-4833-886a-d47191e91971 HTTP/1.1" status: 204 len: 168 time: 0.4101737 Dec 21 04:15:52.946568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f32e5e6-a7f4-45d6-ab43-c137d5ae24fa tempest-PortsTestJSON-979032509 tempest-PortsTestJSON-979032509-project] Pushing event deleted for resources: {'Network': ['ID=bcf1b1c3-e446-4833-886a-d47191e91971,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:52.986434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Transition to ACTIVE for port object 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:15:52.987400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.014788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.015432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2ccf555f-ed18-49cf-9448-d59fc5f36eac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.023663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=a1a159da-8ede-44a2-8929-065e82a2dee0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:53.079840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] No DVR routers for this DVR port a1a159da-8ede-44a2-8929-065e82a2dee0 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:53.080074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c26c6b-3f8e-4c87-ad9f-9bc6334dbabb req-5a90213e-7353-48c5-a83b-7ec1ce59c075 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:53.082297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01c26c6b-3f8e-4c87-ad9f-9bc6334dbabb req-5a90213e-7353-48c5-a83b-7ec1ce59c075 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 932 time: 0.1095335 Dec 21 04:15:53.082759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.088495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2ccf555f-ed18-49cf-9448-d59fc5f36eac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c3122e220ae44f9c95a748964e0046ab&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2559845 Dec 21 04:15:53.088649 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e1b00-1f68-4525-ac71-3b0e9cc8d7c0 req-fe4a4c16-19f9-4954-bf8d-00940f1c244c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.54 "DELETE /v2.0/ports/a1a159da-8ede-44a2-8929-065e82a2dee0 HTTP/1.1" status: 204 len: 173 time: 1.4289069 Dec 21 04:15:53.094630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ccf555f-ed18-49cf-9448-d59fc5f36eac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e5871d2-06ba-4a12-b964-bf14f39807c5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:53.094952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-deleted', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:53.095058 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 34996) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:53.099714 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04a9f78a-42de-4d20-a98b-6e19a3deef72" -d '{"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-deleted", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:53.102538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.159974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8fae1a5b-c2d4-415b-ab79-b8de2b51828e req-9e0bb2ca-5f47-4c08-bdf1-853177df83a1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=615aae36-683b-40bc-bda6-de53bf692e14 HTTP/1.1" status: 200 len: 210 time: 0.0326147 Dec 21 04:15:53.161347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Pushing event updated for resources: {'Port': ['ID=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:53.227674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e3e01892-1dd9-49b4-9746-953f266cac1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.251747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Attempting to bind port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:53.252507 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Attempting to bind port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:53.253096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Attempting to bind port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 on network ad2df216-0eaf-414a-a835-c27348ac987a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:53.253963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e3e01892-1dd9-49b4-9746-953f266cac1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.260339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 on network ad2df216-0eaf-414a-a835-c27348ac987a not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:15:53.261032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Attempting to bind port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 on network ad2df216-0eaf-414a-a835-c27348ac987a {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:53.267497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:53.269428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Checking segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:53.269428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Bound using segment: {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:53.269946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Bound port: 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:53.270558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.273643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01c26c6b-3f8e-4c87-ad9f-9bc6334dbabb req-da605e65-58bb-4e72-a1b8-7c0341b6a25b tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1832602 Dec 21 04:15:53.329771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.349477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] For port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:53.353862 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] For port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:53.363551 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c64c238c-edd2-46c9-b830-09aa1324548d x-openstack-request-id: req-c64c238c-edd2-46c9-b830-09aa1324548d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:53.367000 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "615aae36-683b-40bc-bda6-de53bf692e14", "name": "network-vif-deleted", "tag": "a1a159da-8ede-44a2-8929-065e82a2dee0", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:53.367000 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c64c238c-edd2-46c9-b830-09aa1324548d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:53.367000 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '615aae36-683b-40bc-bda6-de53bf692e14', 'name': 'network-vif-deleted', 'tag': 'a1a159da-8ede-44a2-8929-065e82a2dee0', 'status': 'completed', 'code': 200} Dec 21 04:15:53.386105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e3e01892-1dd9-49b4-9746-953f266cac1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.389142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e3e01892-1dd9-49b4-9746-953f266cac1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.395693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e3e01892-1dd9-49b4-9746-953f266cac1e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6e5871d2-06ba-4a12-b964-bf14f39807c5 HTTP/1.1" status: 204 len: 168 time: 0.2991054 Dec 21 04:15:53.409003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e01892-1dd9-49b4-9746-953f266cac1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e5871d2-06ba-4a12-b964-bf14f39807c5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:53.416339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.462389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:53.493052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:53.493981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.495733 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] 10.222.0.54 "PUT /v2.0/ports/8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 200 len: 1093 time: 2.0774102 Dec 21 04:15:53.508750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:53.522457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ac38ad8a-cd7b-4d8f-8cf0-9169ac98895f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:53.530023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f18be4-0652-4c1c-9687-5405a17f64dc service neutron] Pushing event updated for resources: {'Port': ['ID=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:53.644971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35004) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:53.697280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-05e82edd-4f6f-44fc-befa-fc50b7493b4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:53.699953 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-05e82edd-4f6f-44fc-befa-fc50b7493b4b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1096 time: 0.0487909 Dec 21 04:15:53.754805 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-df7e2bbb-9649-4fcb-a6a4-49fd41c11b0f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 200 len: 217 time: 0.0410557 Dec 21 04:15:53.822141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-aa0ecb13-942c-4817-ab82-779243e662b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:53.827643 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-aa0ecb13-942c-4817-ab82-779243e662b8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0707099f-c76b-4feb-9475-4cacc79c073a HTTP/1.1" status: 200 len: 848 time: 0.0612440 Dec 21 04:15:53.846616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-277be29e-ee39-4788-b90b-dfd50f68dc53 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8b9d8340243a470db22458ae1b476624&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1998820 Dec 21 04:15:53.848657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35016) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:53.892481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-11de0120-a289-415b-a4d3-b68dc80fd092 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:53.893999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-11de0120-a289-415b-a4d3-b68dc80fd092 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ad2df216-0eaf-414a-a835-c27348ac987a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0538282 Dec 21 04:15:53.909096 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7d45656-ad3c-4ce3-86da-737aa183d41a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.933681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7d45656-ad3c-4ce3-86da-737aa183d41a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:53.991253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-218afaa2-082e-42df-93e5-6830d4236b4b service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893798 Dec 21 04:15:54.032961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7d45656-ad3c-4ce3-86da-737aa183d41a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:54.036194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f7d45656-ad3c-4ce3-86da-737aa183d41a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:54.040239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f7d45656-ad3c-4ce3-86da-737aa183d41a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/be626ed3-e913-4e6a-a703-adb5034f20d3 HTTP/1.1" status: 204 len: 168 time: 0.1873617 Dec 21 04:15:54.048087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7d45656-ad3c-4ce3-86da-737aa183d41a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be626ed3-e913-4e6a-a703-adb5034f20d3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:54.098447 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-eb3db588-0124-4da2-bb5a-70a6a11190ce req-ddfec7d1-3f13-41d3-94bd-2c646a24fe78 service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0997591 Dec 21 04:15:54.231829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35030) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:54.507035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d080fb5-22eb-4bd5-94ff-3396381c98f3 req-e2c70903-0fd2-40a5-b626-716bd96ed238 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:54.508773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d080fb5-22eb-4bd5-94ff-3396381c98f3 req-e2c70903-0fd2-40a5-b626-716bd96ed238 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 944 time: 0.1065657 Dec 21 04:15:54.620211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d080fb5-22eb-4bd5-94ff-3396381c98f3 req-6ba6ea21-f5bd-4a9a-bb12-bd3223c9c972 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1017516 Dec 21 04:15:54.708339 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:54.982104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port b2cfca4b-dabd-466a-bfd3-52523c2cce76 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:54.982732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.008876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.071185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.081656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port b2cfca4b-dabd-466a-bfd3-52523c2cce76, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2cfca4b-dabd-466a-bfd3-52523c2cce76,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:55.082022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.094632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for b2cfca4b-dabd-466a-bfd3-52523c2cce76 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:55.227065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35068) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:55.357955 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.366336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:15:55.370409 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb7d4b05-ca63-411a-a964-014e7942602e" -d '{"events": [{"name": "network-changed", "server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:15:55.387510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=b2cfca4b-dabd-466a-bfd3-52523c2cce76,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:55.428101 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:15:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e94142b-05bf-45b2-a294-fff87e23ccb6 x-openstack-request-id: req-5e94142b-05bf-45b2-a294-fff87e23ccb6 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:15:55.428101 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:15:55.428101 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5e94142b-05bf-45b2-a294-fff87e23ccb6 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:15:55.428101 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'status': 'completed', 'code': 200} Dec 21 04:15:55.473576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-24940577'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:55.522298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7d4b05-ca63-411a-a964-014e7942602e req-9754fe30-831f-4451-81cc-97f2ccc1eecd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:55.524140 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-9754fe30-831f-4451-81cc-97f2ccc1eecd service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1096 time: 0.0621212 Dec 21 04:15:55.617805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:55.621394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.633370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.661611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.681008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7d4b05-ca63-411a-a964-014e7942602e req-6723ed49-d9fc-4ab6-ac07-958752a9a8e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:55.684110 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-6723ed49-d9fc-4ab6-ac07-958752a9a8e1 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 200 len: 910 time: 0.1513786 Dec 21 04:15:55.745118 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-6291a004-1c7f-4b65-a90c-29bb183c1caa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 200 len: 217 time: 0.0515785 Dec 21 04:15:55.797718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:55.801292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7d4b05-ca63-411a-a964-014e7942602e req-5c92e96d-7889-45db-b5bc-21bb49569ace service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:55.803925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-5c92e96d-7889-45db-b5bc-21bb49569ace service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0707099f-c76b-4feb-9475-4cacc79c073a HTTP/1.1" status: 200 len: 848 time: 0.0503609 Dec 21 04:15:55.851401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:55.873424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7d4b05-ca63-411a-a964-014e7942602e req-cb5f741f-239e-408e-8b4f-dfc69dce9386 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:55.875490 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-cb5f741f-239e-408e-8b4f-dfc69dce9386 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ad2df216-0eaf-414a-a835-c27348ac987a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0648127 Dec 21 04:15:55.877836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: a1a159da-8ede-44a2-8929-065e82a2dee0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:55.878577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device a1a159da-8ede-44a2-8929-065e82a2dee0 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:55.979397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-ddda32d4-ddd3-4b6a-b744-1f29070d91ad service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0955498 Dec 21 04:15:56.110699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fb7d4b05-ca63-411a-a964-014e7942602e req-be039f7a-1603-40ff-87e5-39945e5f78e3 service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1223161 Dec 21 04:15:56.231682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297d57a9-04f0-440c-9e81-883d4a3f75c3 req-bd5e6690-fbca-4437-b11e-daa832bcd08c tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:56.233154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-297d57a9-04f0-440c-9e81-883d4a3f75c3 req-bd5e6690-fbca-4437-b11e-daa832bcd08c tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 944 time: 0.4801462 Dec 21 04:15:56.318764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.377912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-297d57a9-04f0-440c-9e81-883d4a3f75c3 req-90af3ed5-899e-4a21-b897-cc577bee291d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1339767 Dec 21 04:15:56.382771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.415255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:15:56.442695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.443076 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment 54bedc6b-aaee-4e25-923b-8044e5e32b53 of type vlan for network c6530219-3fd4-4549-892e-cbf62e2f1d02 Dec 21 04:15:56.454172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1152ef04-d9b9-40a0-8592-3dc2f1f4caa4,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:56.461512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:15:56.494102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.622707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.628560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:56.629215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.635631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35118) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:56.643321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:15:56.654321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] Sync routers for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:15:56.659772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b80bc786-9394-4855-9421-d8d1a30e4850 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/4e0835a1-5b43-48ca-95e4-8eeb522b41d9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4267797 Dec 21 04:15:56.660770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35122) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:56.665477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:56.666317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:56.714725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=c6530219-3fd4-4549-892e-cbf62e2f1d02,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:56.727390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:15:56.731541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting subnet cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:15:56.735310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.743851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bd8ff7d1-ecdf-474f-8c21-daa8873a0684 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 1.5152597 Dec 21 04:15:56.744668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35124) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:56.749719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-183169463'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:56.789749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-186090e3-db3b-4f3a-88da-8be20fa16abe admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.807079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.844679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:56.853023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:56.857092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.882957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:15:56.892166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.892553 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment d7a5ddea-6999-4a33-9492-d276bec32d1a of type vlan for network 2be9b333-b36f-48ac-b43e-4ff119943471 Dec 21 04:15:56.931285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.937696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:56.976467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-186090e3-db3b-4f3a-88da-8be20fa16abe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.033567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:15:55Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:57.036910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.043515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:57.044149 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.064962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] Checking router: 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:15:57.066998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-186090e3-db3b-4f3a-88da-8be20fa16abe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.073583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] Routers {'4e0835a1-5b43-48ca-95e4-8eeb522b41d9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:15:57.074178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:57.108759 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-186090e3-db3b-4f3a-88da-8be20fa16abe admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d3a134e361294d7abd56cbadc8c3ce93&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4719481 Dec 21 04:15:57.110023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186090e3-db3b-4f3a-88da-8be20fa16abe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ef30136-c41e-43cd-94fc-cac108789951,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:57.111060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=2be9b333-b36f-48ac-b43e-4ff119943471,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:57.112519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35126) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:57.121238 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.150095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7fc5f5ca-be07-4f64-a526-adfb46ffc95c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4040995 Dec 21 04:15:57.151238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35128) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:57.157766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:57.173012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Subnet': ['ID=cc3361a8-c44a-4f96-8ecd-d8322bcd66f1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:57.180665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.183874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-869bf94d-9567-43a6-a49d-212794f94007 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/subnets/cc3361a8-c44a-4f96-8ecd-d8322bcd66f1 HTTP/1.1" status: 204 len: 168 time: 0.5218761 Dec 21 04:15:57.191722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cf1d4d4-0abc-4f8a-b001-c3ecdcb17680 None None] Network 3f781088-f4ae-4039-bd42-2337b91d459d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:57.194759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35130) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:57.226138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] Set router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:15:57.254088 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-590692dd-8df8-46fe-a28a-6125037781d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.318698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-590692dd-8df8-46fe-a28a-6125037781d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.351962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:57.357268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.366675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.504183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 2be9b333-b36f-48ac-b43e-4ff119943471 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:15:57.515623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.530548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa140b4-4845-402a-9e6f-698beec852fc req-fe2c0603-d54e-4838-8180-05e738e5ef31 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:57.532220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afa140b4-4845-402a-9e6f-698beec852fc req-fe2c0603-d54e-4838-8180-05e738e5ef31 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 944 time: 0.0586798 Dec 21 04:15:57.553470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-590692dd-8df8-46fe-a28a-6125037781d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.556491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-590692dd-8df8-46fe-a28a-6125037781d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.559569 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-590692dd-8df8-46fe-a28a-6125037781d2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6ef30136-c41e-43cd-94fc-cac108789951 HTTP/1.1" status: 204 len: 168 time: 0.4442365 Dec 21 04:15:57.567339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590692dd-8df8-46fe-a28a-6125037781d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ef30136-c41e-43cd-94fc-cac108789951,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:57.656837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afa140b4-4845-402a-9e6f-698beec852fc req-f675a9f4-79d6-479c-b8f8-2be632982803 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1173089 Dec 21 04:15:57.664869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port ff213c4b-91fe-431f-8820-93bf8429741f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:57.665759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.782554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:15:55Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:57.802273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port ff213c4b-91fe-431f-8820-93bf8429741f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff213c4b-91fe-431f-8820-93bf8429741f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:57.802735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.811756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] DHCP port deletion for 3f781088-f4ae-4039-bd42-2337b91d459d request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:57.813720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9016465-ae32-4f9c-8659-0ae8c0897aaa None None] The sync data for ids ['4e0835a1-5b43-48ca-95e4-8eeb522b41d9'] in n-d-822053-11 is: [{'id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-613806390', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129'}], 'enable_snat': True}, 'gw_port_id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:13:43Z', 'updated_at': '2021-12-21T04:15:55Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'ff213c4b-91fe-431f-8820-93bf8429741f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:fa:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0835a1-5b43-48ca-95e4-8eeb522b41d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3269, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:13:45Z', 'updated_at': '2021-12-21T04:13:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:15:57.815726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for ff213c4b-91fe-431f-8820-93bf8429741f owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:57.822441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.868005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:15:57.916873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] Deleting port 089e9f43-1c79-4a0c-9082-6506d41f045d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:15:57.917875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:57.923756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=5e23a514-08a5-4f3b-ac89-5d064a78b462,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:57.941646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': '54bedc6b-aaee-4e25-923b-8044e5e32b53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:57.942019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: c6530219-3fd4-4549-892e-cbf62e2f1d02, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:15:57.984937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] For port 089e9f43-1c79-4a0c-9082-6506d41f045d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=089e9f43-1c79-4a0c-9082-6506d41f045d,segment=NetworkSegment(5462f583-a9fa-4260-a352-17f7da388684),segment_id=5462f583-a9fa-4260-a352-17f7da388684)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:57.985341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.003244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:15:58.025678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] Calling delete_port for 089e9f43-1c79-4a0c-9082-6506d41f045d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:15:58.077183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, c6530219-3fd4-4549-892e-cbf62e2f1d02) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:58.086861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:58.087756 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.088351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42743508-507f-4728-8b8a-d127ef721841 None None] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:58.128876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.134359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:58.157259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bde78b35-a723-4122-abb5-054024927ad9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0040953 Dec 21 04:15:58.160063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:58.160213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=ff213c4b-91fe-431f-8820-93bf8429741f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:58.175237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:58.198581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'port_id': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'mac_address': 'fa:16:3e:ab:dd:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:15:58.219589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8a54d00-5c71-43d1-bb82-eacd7c29c0cc None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:15:58.255273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.289782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.315909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:15:58.322557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-c6530219-3fd4-4549-892e-cbf62e2f1d02', 'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': '5e23a514-08a5-4f3b-ac89-5d064a78b462'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:58.324199 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.339890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:58.347689 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.351735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:15:58.357223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6318335b-094d-48d2-b756-1a2d2580638c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.370437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] No DVR routers for this DVR port 089e9f43-1c79-4a0c-9082-6506d41f045d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:15:58.397657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc8e29b-29d7-4177-a592-29433abea61b None None] Pushing event deleted for resources: {'Port': ['ID=089e9f43-1c79-4a0c-9082-6506d41f045d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:58.400931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.403632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.412324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:15:58.417148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.463435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.511602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.512809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Fanout notify agent at l3_agent the message router_deleted on router 4e0835a1-5b43-48ca-95e4-8eeb522b41d9 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:15:58.528908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.533936 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-642349d0-5fd9-46df-9bfa-e9649a080f33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/routers/4e0835a1-5b43-48ca-95e4-8eeb522b41d9 HTTP/1.1" status: 204 len: 168 time: 1.3386714 Dec 21 04:15:58.534550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:58.552615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:58.574850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Allocated IP 2001:db8::2 (c6530219-3fd4-4549-892e-cbf62e2f1d02/5e23a514-08a5-4f3b-ac89-5d064a78b462/c198fdf6-24d8-447f-93e8-adf76156bf46) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:58.633108 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.642838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6318335b-094d-48d2-b756-1a2d2580638c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.683843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.910354 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.913284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['8ad7f863-c0ba-45c6-be94-e1b99c5857b9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:15:58.915525 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6318335b-094d-48d2-b756-1a2d2580638c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.915890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f781088-f4ae-4039-bd42-2337b91d459d']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:58.915890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5462f583-a9fa-4260-a352-17f7da388684') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:58.915890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5462f583-a9fa-4260-a352-17f7da388684') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:15:58.916268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=fc010469-3a38-48d6-b343-2dde2753849c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:58.916361 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.916453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:15:58.916542 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:15:58.931418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6318335b-094d-48d2-b756-1a2d2580638c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=061f527864604bcd969d777a63460f5d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5457335 Dec 21 04:15:58.931829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:58.932207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6318335b-094d-48d2-b756-1a2d2580638c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=319acaef-7419-4e00-ab32-23d8b9c40a87,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:58.932207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': 'd7a5ddea-6999-4a33-9492-d276bec32d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:58.932207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: 2be9b333-b36f-48ac-b43e-4ff119943471, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:15:58.932534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:58.934419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5c83c7-cdb1-4f3b-a73c-c97d5f630dd3 req-8e04018c-c172-451c-9710-c6b78ea3f620 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:58.935705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f5c83c7-cdb1-4f3b-a73c-c97d5f630dd3 req-8e04018c-c172-451c-9710-c6b78ea3f620 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 945 time: 0.1337507 Dec 21 04:15:58.986298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:15:58.992269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:58.993710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f5c83c7-cdb1-4f3b-a73c-c97d5f630dd3 req-51751272-012c-4749-9d83-46d9278a4a22 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470703 Dec 21 04:15:58.994895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:15:59.000439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 2be9b333-b36f-48ac-b43e-4ff119943471 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:15:59.004412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e99f406c-2f59-40bb-8860-9a730cd26ede admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.021429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Pushing event updated for resources: {'Port': ['ID=c198fdf6-24d8-447f-93e8-adf76156bf46,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:59.032799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e99f406c-2f59-40bb-8860-9a730cd26ede admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.088080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.095161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Attempting to bind port c198fdf6-24d8-447f-93e8-adf76156bf46 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:15:59.097559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Attempting to bind port c198fdf6-24d8-447f-93e8-adf76156bf46 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '54bedc6b-aaee-4e25-923b-8044e5e32b53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:15:59.097559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Attempting to bind port c198fdf6-24d8-447f-93e8-adf76156bf46 on network c6530219-3fd4-4549-892e-cbf62e2f1d02 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:15:59.098068 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.102134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:59.102285 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/networks/3f781088-f4ae-4039-bd42-2337b91d459d HTTP/1.1" status: 204 len: 168 time: 0.5665929 Dec 21 04:15:59.109230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:15:59.109654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Checking segment: {'id': '54bedc6b-aaee-4e25-923b-8044e5e32b53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:15:59.110080 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.110480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Bound using segment: {'id': '54bedc6b-aaee-4e25-923b-8044e5e32b53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:15:59.110988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Bound port: c198fdf6-24d8-447f-93e8-adf76156bf46, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '54bedc6b-aaee-4e25-923b-8044e5e32b53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'c6530219-3fd4-4549-892e-cbf62e2f1d02'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:15:59.111380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.113189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12e9cc26-23ea-4ad2-96df-6a4ade208deb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Network': ['ID=3f781088-f4ae-4039-bd42-2337b91d459d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:59.126947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 2be9b333-b36f-48ac-b43e-4ff119943471) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:15:59.126947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:15:59.126947 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.141108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c28b0a89-22f5-409f-ae49-7d5fcf082560 None None] Network 2be9b333-b36f-48ac-b43e-4ff119943471 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:15:59.146663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e99f406c-2f59-40bb-8860-9a730cd26ede admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.150535 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e99f406c-2f59-40bb-8860-9a730cd26ede admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.153666 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e99f406c-2f59-40bb-8860-9a730cd26ede admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/319acaef-7419-4e00-ab32-23d8b9c40a87 HTTP/1.1" status: 204 len: 168 time: 0.2637010 Dec 21 04:15:59.166239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e99f406c-2f59-40bb-8860-9a730cd26ede admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=319acaef-7419-4e00-ab32-23d8b9c40a87,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:59.189306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-58d0cccb-4742-469a-a011-3825445dbd83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.219076 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-58d0cccb-4742-469a-a011-3825445dbd83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.246329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-572eb595-d39a-4ffe-89c6-5bb3235903f3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.0848701 Dec 21 04:15:59.249226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35156) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:59.260186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-607057893', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:15:59.327253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] For port c198fdf6-24d8-447f-93e8-adf76156bf46, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:15:59.342231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] For port c198fdf6-24d8-447f-93e8-adf76156bf46, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c198fdf6-24d8-447f-93e8-adf76156bf46,segment=NetworkSegment(54bedc6b-aaee-4e25-923b-8044e5e32b53),segment_id=54bedc6b-aaee-4e25-923b-8044e5e32b53)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:15:59.367821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-2be9b333-b36f-48ac-b43e-4ff119943471', 'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': 'fc010469-3a38-48d6-b343-2dde2753849c'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:15:59.368657 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.380432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.381819 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.415550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-58d0cccb-4742-469a-a011-3825445dbd83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.419758 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-58d0cccb-4742-469a-a011-3825445dbd83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.421121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-58d0cccb-4742-469a-a011-3825445dbd83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/security-groups/f9f8a49a-c6e1-46d9-9a17-77192d2462b6 HTTP/1.1" status: 204 len: 168 time: 0.3178215 Dec 21 04:15:59.432510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d0cccb-4742-469a-a011-3825445dbd83 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9f8a49a-c6e1-46d9-9a17-77192d2462b6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:59.471169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.480089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff213c4b-91fe-431f-8820-93bf8429741f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:59.491655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.528349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ff213c4b-91fe-431f-8820-93bf8429741f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:59.528749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff213c4b-91fe-431f-8820-93bf8429741f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:59.529177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 089e9f43-1c79-4a0c-9082-6506d41f045d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:59.556449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.593479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 089e9f43-1c79-4a0c-9082-6506d41f045d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:59.593833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 089e9f43-1c79-4a0c-9082-6506d41f045d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:59.594257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2cfca4b-dabd-466a-bfd3-52523c2cce76 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:15:59.669298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b2cfca4b-dabd-466a-bfd3-52523c2cce76 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:15:59.669663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2cfca4b-dabd-466a-bfd3-52523c2cce76 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:15:59.670208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:15:59.671508 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b6c1aed9-6c22-4a21-86ff-aa4a4dd5e85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4193909 Dec 21 04:15:59.678176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35164) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:59.684523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-240120d7-693d-494b-b82b-e7b5e60d70bb None None] Pushing event updated for resources: {'Port': ['ID=c198fdf6-24d8-447f-93e8-adf76156bf46,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:15:59.700250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Allocated IP 2001:db8:1::2 (2be9b333-b36f-48ac-b43e-4ff119943471/fc010469-3a38-48d6-b343-2dde2753849c/a92560f9-c652-45c7-a350-420747e6f5b7) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:15:59.940889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:15:59.969085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35174) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:15:59.974962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1284762407', 'description': 'tempest-secgroup-smoke-1284762407 description', 'project_id': '10a032d25985452584a3dcdae6969809'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:00.029785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.106497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.118232 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.145628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.167198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307b5513-9f5a-4d48-acf9-75ffc1fa7820 req-8688f5c8-416e-455c-9c27-38548c817045 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:00.169212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-307b5513-9f5a-4d48-acf9-75ffc1fa7820 req-8688f5c8-416e-455c-9c27-38548c817045 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 945 time: 0.0827255 Dec 21 04:16:00.176649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:16:00.190376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Network 2be9b333-b36f-48ac-b43e-4ff119943471 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:00.194243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:00.200548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:00.201009 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.203148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:00.208781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Pushing event updated for resources: {'Port': ['ID=a92560f9-c652-45c7-a350-420747e6f5b7,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:00.272816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-307b5513-9f5a-4d48-acf9-75ffc1fa7820 req-8c0928e4-8897-4ce9-9c83-a0308112ab19 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0912600 Dec 21 04:16:00.279939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.303459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Attempting to bind port a92560f9-c652-45c7-a350-420747e6f5b7 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:00.303842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Attempting to bind port a92560f9-c652-45c7-a350-420747e6f5b7 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'd7a5ddea-6999-4a33-9492-d276bec32d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:00.304217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Attempting to bind port a92560f9-c652-45c7-a350-420747e6f5b7 on network 2be9b333-b36f-48ac-b43e-4ff119943471 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:00.328401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:00.328785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Checking segment: {'id': 'd7a5ddea-6999-4a33-9492-d276bec32d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:00.329186 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.329616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Bound using segment: {'id': 'd7a5ddea-6999-4a33-9492-d276bec32d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:00.330091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Bound port: a92560f9-c652-45c7-a350-420747e6f5b7, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7a5ddea-6999-4a33-9492-d276bec32d1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '2be9b333-b36f-48ac-b43e-4ff119943471'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:00.330481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.354344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.362800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.394627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=66bddc2b-7950-4d58-9286-3d1b9fcb0295,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:00.410500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:16:00.413024 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb5bcd5e-b848-4ca0-8c39-f4c2cb6764ef" -d '{"events": [{"server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "name": "network-vif-plugged", "status": "completed", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:16:00.434561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:00.444034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] For port a92560f9-c652-45c7-a350-420747e6f5b7, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:00.449861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] For port a92560f9-c652-45c7-a350-420747e6f5b7, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a92560f9-c652-45c7-a350-420747e6f5b7,segment=NetworkSegment(d7a5ddea-6999-4a33-9492-d276bec32d1a),segment_id=d7a5ddea-6999-4a33-9492-d276bec32d1a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:00.454006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8::1 (c6530219-3fd4-4549-892e-cbf62e2f1d02/5e23a514-08a5-4f3b-ac89-5d064a78b462/cb7c0405-1b87-48d4-9e0d-604d6f6ca68f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:00.459675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.466962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dc12e9bb-dce7-45cf-a6b7-d3b730212a0b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4908881 Dec 21 04:16:00.467913 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:16:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78f5469b-d24a-49c0-8109-4bdab12b306c x-openstack-request-id: req-78f5469b-d24a-49c0-8109-4bdab12b306c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:16:00.467913 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "name": "network-vif-plugged", "status": "completed", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:16:00.467913 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-78f5469b-d24a-49c0-8109-4bdab12b306c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:16:00.467913 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'code': 200} Dec 21 04:16:00.468272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:00.471466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '66bddc2b-7950-4d58-9286-3d1b9fcb0295', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:00.512260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.542211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.587872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:00.649749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e8e307-b732-4f11-aa93-9472c0b0de78 None None] Pushing event updated for resources: {'Port': ['ID=a92560f9-c652-45c7-a350-420747e6f5b7,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:00.650994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12bc910-a4ff-4317-8d20-9602de90d715 req-621d837f-9673-449f-b08a-6e7650377ebf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:00.653153 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b12bc910-a4ff-4317-8d20-9602de90d715 req-621d837f-9673-449f-b08a-6e7650377ebf service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1098 time: 0.0823460 Dec 21 04:16:00.677824 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.680657 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.776493 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b12bc910-a4ff-4317-8d20-9602de90d715 req-297c1f81-a9a6-4a58-840f-d12ccd484510 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1115522 Dec 21 04:16:00.804817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.875542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.913328 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.939952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=adb4d661-72de-407a-a6a7-93a8fbc2cc1d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:00.967048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:00.968858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:00.971281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:00.972199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:00.975159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=cb7c0405-1b87-48d4-9e0d-604d6f6ca68f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:01.051503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.054104 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4df9e6e5-ca6e-41af-b309-42cf7f9fa73b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5847597 Dec 21 04:16:01.056063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35198) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:01.060489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '66bddc2b-7950-4d58-9286-3d1b9fcb0295', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:01.091366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9283c8eb-a09a-4285-a433-4743069c1e0b None None] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:01.212585 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.228194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.335568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-383126eb-bc85-4e31-b3b4-2a35fbedc8fd None None] Provisioning complete for port c198fdf6-24d8-447f-93e8-adf76156bf46 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:01.337209 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-383126eb-bc85-4e31-b3b4-2a35fbedc8fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.347580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-bf22b704-42ec-4926-bee6-d818bcd9432f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1316447 Dec 21 04:16:01.397433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.457668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.478641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f0b69a-eea1-4ea1-acf4-b7ba0b5782a1 req-0385c7bd-80d7-48b6-a6c0-152978dfc5eb tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:01.495473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7f0b69a-eea1-4ea1-acf4-b7ba0b5782a1 req-0385c7bd-80d7-48b6-a6c0-152978dfc5eb tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.1044183 Dec 21 04:16:01.538137 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-383126eb-bc85-4e31-b3b4-2a35fbedc8fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.561729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=864254c7-ccd4-49ec-845f-0d5b436855f3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:01.604621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-383126eb-bc85-4e31-b3b4-2a35fbedc8fd None None] For port c198fdf6-24d8-447f-93e8-adf76156bf46, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c198fdf6-24d8-447f-93e8-adf76156bf46,segment=NetworkSegment(54bedc6b-aaee-4e25-923b-8044e5e32b53),segment_id=54bedc6b-aaee-4e25-923b-8044e5e32b53)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:01.619790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7f0b69a-eea1-4ea1-acf4-b7ba0b5782a1 req-00266815-a073-490a-a5aa-b57264629611 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1221957 Dec 21 04:16:01.621933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c198fdf6-24d8-447f-93e8-adf76156bf46 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:01.663805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.667849 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ad63a7d-80e1-41a3-954d-74b6081439f3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6082375 Dec 21 04:16:01.671393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35210) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:01.679927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-383126eb-bc85-4e31-b3b4-2a35fbedc8fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.685421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-77398dd8-e742-43d5-ac16-a09cdad91cd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:01.685879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '66bddc2b-7950-4d58-9286-3d1b9fcb0295', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:01.687109 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-77398dd8-e742-43d5-ac16-a09cdad91cd2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1098 time: 0.2160726 Dec 21 04:16:01.797241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.797572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.807811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c198fdf6-24d8-447f-93e8-adf76156bf46 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:01.811339 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.875925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.876505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-383126eb-bc85-4e31-b3b4-2a35fbedc8fd None None] Pushing event updated for resources: {'Port': ['ID=c198fdf6-24d8-447f-93e8-adf76156bf46,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:01.877773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:01.953802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.009104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.026772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a92560f9-c652-45c7-a350-420747e6f5b7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:02.033724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f79ec8d-200b-40c4-8209-d5e0f48c40ce,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:02.079892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-59e7497c-6421-431c-9990-5aaa24fad800 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:02.081576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-59e7497c-6421-431c-9990-5aaa24fad800 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.3416085 Dec 21 04:16:02.090545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=cb7c0405-1b87-48d4-9e0d-604d6f6ca68f,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:02.124466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ec80bf12-7cc8-481b-b43e-a97b0ea58af9 None None] Provisioning complete for port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:02.124466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec80bf12-7cc8-481b-b43e-a97b0ea58af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.132834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.140001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-56dd10f3-30b9-4895-879d-ca3c69387dad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4644251 Dec 21 04:16:02.140149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35220) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:02.143152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '66bddc2b-7950-4d58-9286-3d1b9fcb0295', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:02.197910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a92560f9-c652-45c7-a350-420747e6f5b7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:02.198274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.199978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ec80bf12-7cc8-481b-b43e-a97b0ea58af9 None None] Port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:02.234378 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-0a138565-d603-47b1-b0d9-1641a5e69308 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1002 time: 0.1450934 Dec 21 04:16:02.237523 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:02.239393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:02.246871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ec80bf12-7cc8-481b-b43e-a97b0ea58af9 None None] Provisioning complete for port c198fdf6-24d8-447f-93e8-adf76156bf46 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:02.247273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec80bf12-7cc8-481b-b43e-a97b0ea58af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.355275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1674388-65fa-4559-b883-046e1b6cf188 None None] Network 2be9b333-b36f-48ac-b43e-4ff119943471 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:02.367910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.390078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-082fffcd-f981-4339-9f88-beaf0b17a175 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:02.391871 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-082fffcd-f981-4339-9f88-beaf0b17a175 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.1502571 Dec 21 04:16:02.420843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.522950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port a92560f9-c652-45c7-a350-420747e6f5b7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a92560f9-c652-45c7-a350-420747e6f5b7,segment=NetworkSegment(d7a5ddea-6999-4a33-9492-d276bec32d1a),segment_id=d7a5ddea-6999-4a33-9492-d276bec32d1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:02.622533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f5600416-b4dd-4979-876e-38061579f1a1 None None] Provisioning complete for port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:02.623189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5600416-b4dd-4979-876e-38061579f1a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.683706 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.779374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f5600416-b4dd-4979-876e-38061579f1a1 None None] Port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:02.823771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ee2aaa-a319-437b-add7-462d9310a7ec req-5433f57e-e051-491e-ab23-246a0a1019ad tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:02.826442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ee2aaa-a319-437b-add7-462d9310a7ec req-5433f57e-e051-491e-ab23-246a0a1019ad tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.0989604 Dec 21 04:16:02.845745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=a92560f9-c652-45c7-a350-420747e6f5b7,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:02.859291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f5600416-b4dd-4979-876e-38061579f1a1 None None] Provisioning complete for port a92560f9-c652-45c7-a350-420747e6f5b7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:02.859805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5600416-b4dd-4979-876e-38061579f1a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.922773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61ee2aaa-a319-437b-add7-462d9310a7ec req-a19d5ef9-37c1-4baa-8c8b-28df870d4f35 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0849407 Dec 21 04:16:02.984472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:02.988414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-e6a0a627-8daf-44f2-96dd-fa8798689064 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:02.992340 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-e6a0a627-8daf-44f2-96dd-fa8798689064 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.5882657 Dec 21 04:16:03.085277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b3d236-3e43-449f-8df0-4693d5221060 req-995782ba-eef4-4206-a964-4230c615445c tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:03.094589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45b3d236-3e43-449f-8df0-4693d5221060 req-995782ba-eef4-4206-a964-4230c615445c tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.0861421 Dec 21 04:16:03.110871 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-dd400c54-910d-4bfd-ad9e-8d673c2e925c service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1082213 Dec 21 04:16:03.112545 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.114521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 633ea4a8-d611-4eba-ac84-65430b3da36f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:03.162033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-547a5b96-a727-4ee4-9777-c7f9cce829bb None None] Provisioning complete for port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:03.163618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-547a5b96-a727-4ee4-9777-c7f9cce829bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.174398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45b3d236-3e43-449f-8df0-4693d5221060 req-4b44d6f6-4338-422a-91a5-c6da7d95a4be tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0731695 Dec 21 04:16:03.222602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5562e16-c191-44b2-822c-6075befaf9a1,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:03.270669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-547a5b96-a727-4ee4-9777-c7f9cce829bb None None] Port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:03.273592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-547a5b96-a727-4ee4-9777-c7f9cce829bb None None] Provisioning complete for port a92560f9-c652-45c7-a350-420747e6f5b7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:03.274481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-547a5b96-a727-4ee4-9777-c7f9cce829bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.344548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0506eb-fe42-4f8c-b881-053f79f8f27b req-12cc4b2c-6893-4f97-91ba-94d187fa7b9c tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:03.346685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf0506eb-fe42-4f8c-b881-053f79f8f27b req-12cc4b2c-6893-4f97-91ba-94d187fa7b9c tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.0681539 Dec 21 04:16:03.373429 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8fd9f8b5-4dec-441c-b0e5-9f6ba450bf73 req-0254b73f-6eb8-4101-b500-617650e5b664 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2555158 Dec 21 04:16:03.374564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:03.379717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7303ae9-8343-46be-819c-a3fa0022af05 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/633ea4a8-d611-4eba-ac84-65430b3da36f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7045650 Dec 21 04:16:03.395152 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.395152 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-caed86e5-cc04-4607-8f4c-1621c51cf6ea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.2448740 Dec 21 04:16:03.395152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35256) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.395152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35258) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.398862 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] Sync routers for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:03.414180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '66bddc2b-7950-4d58-9286-3d1b9fcb0295', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:03.414576 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:03.415483 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:03.424181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf0506eb-fe42-4f8c-b881-053f79f8f27b req-22077215-a73a-494d-9b2f-d12eec4c8d71 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0691369 Dec 21 04:16:03.453480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35260) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.474078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-547391cd-7ba1-4eae-95a2-5d3ff320659f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:03.476195 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-547391cd-7ba1-4eae-95a2-5d3ff320659f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports/cb7c0405-1b87-48d4-9e0d-604d6f6ca68f HTTP/1.1" status: 200 len: 911 time: 0.0903707 Dec 21 04:16:03.479177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35264) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.503721 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:03.530243 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:03.531296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:03.536444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c198fdf6-24d8-447f-93e8-adf76156bf46 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:03.569032 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:16:03.574589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.589064 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:03.592146 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-543219cd-732f-4049-a0ac-2ccf1593a246 None None] The sync data for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:03.617601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c198fdf6-24d8-447f-93e8-adf76156bf46 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:03.617987 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.688958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.734440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a92560f9-c652-45c7-a350-420747e6f5b7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:03.758240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.802154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a92560f9-c652-45c7-a350-420747e6f5b7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:03.802800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.814648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=65a1161e-8246-4078-9e7a-a5e6a9b61643,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:03.844320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35268) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.914000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd0c080d-1541-4948-8172-1d3f9cab1c19 tempest-TestServerBasicOps-1331959435 tempest-TestServerBasicOps-1331959435-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:03.914000 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd0c080d-1541-4948-8172-1d3f9cab1c19 tempest-TestServerBasicOps-1331959435 tempest-TestServerBasicOps-1331959435-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1093 time: 0.4482005 Dec 21 04:16:03.914000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35272) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.916090 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'fixed_ip_address': '172.20.0.12'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:03.933975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:03.935463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-86970d7f-b86a-499c-994d-1f790a59fabe tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5406015 Dec 21 04:16:03.941950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:03.947334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '66bddc2b-7950-4d58-9286-3d1b9fcb0295', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:04.009101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.028226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6546bf99-b421-4290-850a-47f5b542378f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.051424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.111366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.151636 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:16:04.167119 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.224657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Allocated IP 172.25.5.200 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/2469a803-134c-4131-bc20-0db946f56b73) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:04.299226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6546bf99-b421-4290-850a-47f5b542378f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.318174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.328569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.373805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6546bf99-b421-4290-850a-47f5b542378f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.404350 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.420592 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.467540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:04.472063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:04.477822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:04.480778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'Port': ['ID=2469a803-134c-4131-bc20-0db946f56b73,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:04.485364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b3152d58-89bc-4b1b-b10f-446d3349fe2c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:04.493581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6546bf99-b421-4290-850a-47f5b542378f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48b2cac6-e148-4506-bf65-f4ef92aa1d3e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:04.503311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6546bf99-b421-4290-850a-47f5b542378f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f649429c85064f56acbb1986e97ca5cc&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6579525 Dec 21 04:16:04.505976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35278) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:04.523763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8:1::1 (2be9b333-b36f-48ac-b43e-4ff119943471/fc010469-3a38-48d6-b343-2dde2753849c/b8b0fa5e-9044-4b39-8687-982faab27df0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:04.550225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.551454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3b15bd0f-a651-4729-a726-2180801d5470 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.6085494 Dec 21 04:16:04.557779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35280) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:04.563115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'network': {'name': 'tempest-network-smoke--261286143', 'project_id': '10a032d25985452584a3dcdae6969809', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:04.631034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cee2c8aa-d620-4e05-8019-3b0c6d7c618d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.659761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:04.664077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.667000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cee2c8aa-d620-4e05-8019-3b0c6d7c618d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.705619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.725362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:04.802595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cee2c8aa-d620-4e05-8019-3b0c6d7c618d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.806818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cee2c8aa-d620-4e05-8019-3b0c6d7c618d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.807003 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.807112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cee2c8aa-d620-4e05-8019-3b0c6d7c618d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/48b2cac6-e148-4506-bf65-f4ef92aa1d3e HTTP/1.1" status: 204 len: 168 time: 0.2997270 Dec 21 04:16:04.807215 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Added segment 5971302f-7cf0-4cbe-98fe-03300764e013 of type vlan for network eef11f28-43bc-4f45-bb74-cee477ba9652 Dec 21 04:16:04.816891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee2c8aa-d620-4e05-8019-3b0c6d7c618d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48b2cac6-e148-4506-bf65-f4ef92aa1d3e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:04.832959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.898618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 2be9b333-b36f-48ac-b43e-4ff119943471 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:04.901880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:04.905928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:04.906594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.932501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:04.951774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=b8b0fa5e-9044-4b39-8687-982faab27df0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:05.014897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.047544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.053666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:05.054290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.119443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.134146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Network': ['ID=eef11f28-43bc-4f45-bb74-cee477ba9652,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:05.146921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network eef11f28-43bc-4f45-bb74-cee477ba9652 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:05.165334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4879c70f-0782-4f0b-9034-4b8cfe8dc575 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6031313 Dec 21 04:16:05.166174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35286) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:05.181366 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'admin_state_up': True, 'project_id': '10a032d25985452584a3dcdae6969809', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:05.223177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.285062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-104b9996-cdbd-4c96-8a12-43bb9f9fba12 None None] Provisioning complete for port b8b0fa5e-9044-4b39-8687-982faab27df0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:05.285827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-104b9996-cdbd-4c96-8a12-43bb9f9fba12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.327836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-104b9996-cdbd-4c96-8a12-43bb9f9fba12 None None] Port b8b0fa5e-9044-4b39-8687-982faab27df0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:05.331923 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.336863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.412645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.432770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.448524 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.506343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.557366 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.558191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.621726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=b8b0fa5e-9044-4b39-8687-982faab27df0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:05.653020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35290) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:05.672812 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23083ea5-ab22-40aa-94ea-2cae629789c0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.708570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.714202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event updated for resources: {'Port': ['ID=2469a803-134c-4131-bc20-0db946f56b73,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:05.721508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.726445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 2be9b333-b36f-48ac-b43e-4ff119943471 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:05.728505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:05.834203 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Floating IP acd8b30d-3a70-4c8b-805f-c548d5306926 associated. External IP: 172.25.5.200, port: 8ad7f863-c0ba-45c6-be94-e1b99c5857b9. Dec 21 04:16:05.858578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23083ea5-ab22-40aa-94ea-2cae629789c0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:05.869491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 633ea4a8-d611-4eba-ac84-65430b3da36f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:05.951000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23083ea5-ab22-40aa-94ea-2cae629789c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.003212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23083ea5-ab22-40aa-94ea-2cae629789c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60cec20e-9bb5-4d68-b590-54c34792dfbf,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:06.007939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-23083ea5-ab22-40aa-94ea-2cae629789c0 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0eaf7fdbcf8145ec82cb646da20ea3e4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3531497 Dec 21 04:16:06.010394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:06.012022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:06.017074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-430256bd-99a7-46ac-8970-7b4be93a1406 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/633ea4a8-d611-4eba-ac84-65430b3da36f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5363307 Dec 21 04:16:06.022362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35294) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:06.024386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] Sync routers for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:06.038054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:06.038786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:06.079145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:06.087376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f2b4d75-7f10-43fe-9604-766904f32a1d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:06.091378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f2b4d75-7f10-43fe-9604-766904f32a1d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports/b8b0fa5e-9044-4b39-8687-982faab27df0 HTTP/1.1" status: 200 len: 913 time: 0.0609121 Dec 21 04:16:06.093476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35296) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:06.095381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:06.096058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:06.133973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6791e339-e2e2-4ab7-a44e-35ca72ddc553 None None] Provisioning complete for port b8b0fa5e-9044-4b39-8687-982faab27df0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:06.134463 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6791e339-e2e2-4ab7-a44e-35ca72ddc553 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.136261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:06.136931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5773e907-e52d-47d0-ba1f-0f8cb675fba7 None None] The sync data for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:06.174907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6791e339-e2e2-4ab7-a44e-35ca72ddc553 None None] Port b8b0fa5e-9044-4b39-8687-982faab27df0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:06.188433 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ddb083e7-0772-4f47-8f79-ef39ab028a82 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.216332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.219028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Router d017679e-19f4-4f04-a0b9-8ae04d817d66 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:06.225418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ddb083e7-0772-4f47-8f79-ef39ab028a82 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.240828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.426542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ddb083e7-0772-4f47-8f79-ef39ab028a82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.429333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ddb083e7-0772-4f47-8f79-ef39ab028a82 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.432772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ddb083e7-0772-4f47-8f79-ef39ab028a82 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/60cec20e-9bb5-4d68-b590-54c34792dfbf HTTP/1.1" status: 204 len: 168 time: 0.4173205 Dec 21 04:16:06.434918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:06.436593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.42 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/46e149e9-8aff-43c7-8263-b38b45f47403) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:06.442594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb083e7-0772-4f47-8f79-ef39ab028a82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60cec20e-9bb5-4d68-b590-54c34792dfbf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:06.448681 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] Sync routers for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:06.476617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:06.477254 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:06.525896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.555741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.589516 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-123c6010-e01f-4cb9-afdb-8fe8515879a5 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.6777849 Dec 21 04:16:06.591903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:16:06.594158 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd489197-b78d-42e5-a607-56d725d080bc" -d '{"events": [{"name": "network-changed", "server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:16:06.600219 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.660798 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:16:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6daddec5-26fc-4b71-a5d5-644e1aefc3fb x-openstack-request-id: req-6daddec5-26fc-4b71-a5d5-644e1aefc3fb {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:16:06.661133 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:16:06.661395 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6daddec5-26fc-4b71-a5d5-644e1aefc3fb {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:16:06.663098 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'status': 'completed', 'code': 200} Dec 21 04:16:06.686210 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:06.750498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.804543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:06.811671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:06.818866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:06.822062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd489197-b78d-42e5-a607-56d725d080bc req-7170e665-72c1-4098-a4f6-0427c8f93d7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:06.823907 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-7170e665-72c1-4098-a4f6-0427c8f93d7d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1098 time: 0.1159222 Dec 21 04:16:06.826139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=46e149e9-8aff-43c7-8263-b38b45f47403,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:06.847018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a91286a7-5167-400d-a965-4c6598d9457a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:06.914425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7e7e7474-c110-400f-81a4-99200b114706 None None] Provisioning complete for port 46e149e9-8aff-43c7-8263-b38b45f47403 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:06.915188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7e7e7474-c110-400f-81a4-99200b114706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:06.966924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7e7e7474-c110-400f-81a4-99200b114706 None None] Port 46e149e9-8aff-43c7-8263-b38b45f47403 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:06.973424 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'acd8b30d-3a70-4c8b-805f-c548d5306926', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'floating_ip_address': '172.25.5.200', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'port_id': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 3556, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'mac_address': 'fa:16:3e:ab:dd:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:16:04Z', 'updated_at': '2021-12-21T04:16:04Z', 'revision_number': 0, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:34Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:07.017715 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] Checking router: d017679e-19f4-4f04-a0b9-8ae04d817d66 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:16:07.031462 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:07.032856 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:07.090461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd489197-b78d-42e5-a607-56d725d080bc req-4b577f2a-fb43-4706-95d3-7728b5876136 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:07.092114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-4b577f2a-fb43-4706-95d3-7728b5876136 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 200 len: 910 time: 0.2310314 Dec 21 04:16:07.159911 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:07.183128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-35fc99ff-a433-4f79-b77c-566383475427 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 200 len: 1000 time: 0.0835965 Dec 21 04:16:07.270377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port b8b0fa5e-9044-4b39-8687-982faab27df0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:07.271015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:07.373440 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:07.389591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for b8b0fa5e-9044-4b39-8687-982faab27df0 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:07.416236 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'acd8b30d-3a70-4c8b-805f-c548d5306926', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'floating_ip_address': '172.25.5.200', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'port_id': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 3556, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'mac_address': 'fa:16:3e:ab:dd:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:16:04Z', 'updated_at': '2021-12-21T04:16:04Z', 'revision_number': 0, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:34Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:07.451819 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9e93f7-da59-4699-b84a-1a96ac0901b2 None None] The sync data for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 is: [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'acd8b30d-3a70-4c8b-805f-c548d5306926', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'floating_ip_address': '172.25.5.200', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'port_id': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 3556, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'mac_address': 'fa:16:3e:ab:dd:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:16:04Z', 'updated_at': '2021-12-21T04:16:04Z', 'revision_number': 0, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:34Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:07.643122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:07.686879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=b8b0fa5e-9044-4b39-8687-982faab27df0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:07.715075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd489197-b78d-42e5-a607-56d725d080bc req-bf2d0b22-6a57-4c41-8a7a-85ce8f07a40d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:07.716661 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-bf2d0b22-6a57-4c41-8a7a-85ce8f07a40d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0707099f-c76b-4feb-9475-4cacc79c073a HTTP/1.1" status: 200 len: 848 time: 0.5028024 Dec 21 04:16:07.764449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23bb532b-2ff3-4f7e-89bf-9013f57bba38 None None] New status for floating IP acd8b30d-3a70-4c8b-805f-c548d5306926: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:16:07.812885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:07.864916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd489197-b78d-42e5-a607-56d725d080bc req-c982ccd0-6e5c-490e-ba34-179c3a17610f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:07.866483 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-c982ccd0-6e5c-490e-ba34-179c3a17610f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ad2df216-0eaf-414a-a835-c27348ac987a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1421402 Dec 21 04:16:07.888931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:08.122011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 633ea4a8-d611-4eba-ac84-65430b3da36f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:08.133264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-4db0adf8-03e9-452e-99b5-56191a56594b service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1854298 Dec 21 04:16:08.137672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:08.223838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:08.229438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cc9884ee-fedd-4cc0-a14f-1997ad482e9d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/633ea4a8-d611-4eba-ac84-65430b3da36f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1347835 Dec 21 04:16:08.232190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35330) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:08.239516 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] Sync routers for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:08.252702 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:08.253707 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:08.293582 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:08.302316 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:08.303044 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:08.323950 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bd489197-b78d-42e5-a607-56d725d080bc req-962a96e2-19d6-44b8-9bb5-0e306e6a2b92 service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1822326 Dec 21 04:16:08.341811 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:08.342400 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97014250-05f0-4f57-b5eb-3e01fdbd047b None None] The sync data for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:08.460056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 243f6737-b79b-4ef0-a9db-fc76068ee195 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:08.573053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:08.573326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:08.587697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Sync routers for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:08.604581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:08.605381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:08.651862 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:08.656994 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35340) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:08.657307 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-40748f89-8ee1-47ea-9dac-b65886735a30 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 893 time: 3.4900455 Dec 21 04:16:08.701717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38b58dde-df2f-409f-b53d-08aa19e994e6 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=10a032d25985452584a3dcdae6969809&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0388601 Dec 21 04:16:08.702160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35342) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:08.735637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:08.858447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99af2e76-70aa-48a6-affe-9d43fb329046 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:08.859978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-99af2e76-70aa-48a6-affe-9d43fb329046 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1567762 Dec 21 04:16:08.862923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35348) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:08.898910 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3cdbfcae-9fd3-4e8e-96ae-23f075f5a224 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0345860 Dec 21 04:16:08.902553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35354) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:08.909593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1343620335', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'project_id': '10a032d25985452584a3dcdae6969809', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:08.948180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:07Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:08.981375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Checking router: 243f6737-b79b-4ef0-a9db-fc76068ee195 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:16:08.981990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Updating router 243f6737-b79b-4ef0-a9db-fc76068ee195 port 46e149e9-8aff-43c7-8263-b38b45f47403 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:16:09.011623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.077431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port cb7c0405-1b87-48d4-9e0d-604d6f6ca68f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:09.077867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.134854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:09.138258 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.229176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.249999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for cb7c0405-1b87-48d4-9e0d-604d6f6ca68f owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:09.276150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.351696 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.397731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25cda704-4abd-4799-9f7b-955a21730cd5 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:09.408599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc1d1f0-fd05-45f6-b2f2-52d383fb5a03 None None] Pushing event updated for resources: {'Port': ['ID=46e149e9-8aff-43c7-8263-b38b45f47403,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:09.411066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Attempting to bind port 46e149e9-8aff-43c7-8263-b38b45f47403 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:09.411448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Attempting to bind port 46e149e9-8aff-43c7-8263-b38b45f47403 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:09.411819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Attempting to bind port 46e149e9-8aff-43c7-8263-b38b45f47403 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:09.419329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:09.419713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:09.420118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.420873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:09.421161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Bound port: 46e149e9-8aff-43c7-8263-b38b45f47403, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:09.421380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.476678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] For port 46e149e9-8aff-43c7-8263-b38b45f47403, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:09.479704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] For port 46e149e9-8aff-43c7-8263-b38b45f47403, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=46e149e9-8aff-43c7-8263-b38b45f47403,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:09.508217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a4fedbb2-74e8-4b5a-978c-1e11c6eb5a0e None None] Provisioning complete for port 46e149e9-8aff-43c7-8263-b38b45f47403 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:09.508586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a4fedbb2-74e8-4b5a-978c-1e11c6eb5a0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.540340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.541751 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.572723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a4fedbb2-74e8-4b5a-978c-1e11c6eb5a0e None None] Port 46e149e9-8aff-43c7-8263-b38b45f47403 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:09.587367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.597347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77cbf973-8abb-446f-8a41-de15ab58b2d4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:09.616010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:09.616599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:09.637413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=cb7c0405-1b87-48d4-9e0d-604d6f6ca68f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:09.660177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Subnet': ['ID=06cf8f43-8470-4925-8b6b-b18ed572652f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:09.698634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Checking segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:09.698880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network hostable DHCP agents. Network: eef11f28-43bc-4f45-bb74-cee477ba9652, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:09.776597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.850880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc1d1f0-fd05-45f6-b2f2-52d383fb5a03 None None] Pushing event updated for resources: {'Port': ['ID=46e149e9-8aff-43c7-8263-b38b45f47403,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:09.861168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network eef11f28-43bc-4f45-bb74-cee477ba9652 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:09.875593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0139dac3-1b70-4eea-b2ad-0983b7433f31 None None] Provisioning complete for port 46e149e9-8aff-43c7-8263-b38b45f47403 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:09.876868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0139dac3-1b70-4eea-b2ad-0983b7433f31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.940925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, eef11f28-43bc-4f45-bb74-cee477ba9652) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:09.948712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:09.950689 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:09.958531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d0b0f8d-e28e-4736-abdc-11ccda2f2858 None None] Network eef11f28-43bc-4f45-bb74-cee477ba9652 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:09.973700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 633ea4a8-d611-4eba-ac84-65430b3da36f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:09.993325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:10.026083 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fd6ab442-e032-421a-8686-a41eb1925105 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.1214511 Dec 21 04:16:10.029165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35364) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:10.072469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:10.085304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1ef3b5f6-8ae9-4543-8dec-f0ed3306198d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/633ea4a8-d611-4eba-ac84-65430b3da36f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8516428 Dec 21 04:16:10.086270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35366) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:10.088905 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] Sync routers for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:10.105356 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:10.105966 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:10.139215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f40d2d4e-aaf6-49aa-8150-0f3027460c6d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=633ea4a8-d611-4eba-ac84-65430b3da36f HTTP/1.1" status: 200 len: 205 time: 0.0511336 Dec 21 04:16:10.140100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35368) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:10.167831 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:10.178117 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] Routers {'633ea4a8-d611-4eba-ac84-65430b3da36f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:10.178981 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['633ea4a8-d611-4eba-ac84-65430b3da36f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:10.228717 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:10.229612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db77f5ff-aebc-4a79-9ead-1d6a92c50dc7 None None] The sync data for ids ['633ea4a8-d611-4eba-ac84-65430b3da36f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:10.260336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.372488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-eef11f28-43bc-4f45-bb74-cee477ba9652', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:10.373787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.543036 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0139dac3-1b70-4eea-b2ad-0983b7433f31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.559495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Allocated IP 172.20.0.2 (eef11f28-43bc-4f45-bb74-cee477ba9652/06cf8f43-8470-4925-8b6b-b18ed572652f/792a90ae-0382-4de1-9cf1-69fa22231531) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:10.590017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0139dac3-1b70-4eea-b2ad-0983b7433f31 None None] For port 46e149e9-8aff-43c7-8263-b38b45f47403, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=46e149e9-8aff-43c7-8263-b38b45f47403,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:10.641241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.645479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:07Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:10.703506 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0139dac3-1b70-4eea-b2ad-0983b7433f31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.726322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05684acf-6cff-4be9-8b4a-b52ef9b66382 None None] The sync data for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 is: [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:07Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:10.801827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0139dac3-1b70-4eea-b2ad-0983b7433f31 None None] Pushing event updated for resources: {'Port': ['ID=46e149e9-8aff-43c7-8263-b38b45f47403,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:10.809617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.813768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.951917 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.953321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.953922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router 633ea4a8-d611-4eba-ac84-65430b3da36f {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:16:10.969824 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:10.970992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e7c4e584-bf41-43af-a7e2-c5d8de1fd529 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/633ea4a8-d611-4eba-ac84-65430b3da36f HTTP/1.1" status: 204 len: 168 time: 0.8296061 Dec 21 04:16:10.974223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35372) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:10.992508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.046439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet fc010469-3a38-48d6-b343-2dde2753849c {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:16:11.050280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.090569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.1 (eef11f28-43bc-4f45-bb74-cee477ba9652/06cf8f43-8470-4925-8b6b-b18ed572652f/50c6c188-4f52-464e-9bb7-62f194206ffa) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:11.097504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Network eef11f28-43bc-4f45-bb74-cee477ba9652 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:11.100905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:11.107573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:11.128787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Pushing event updated for resources: {'Port': ['ID=792a90ae-0382-4de1-9cf1-69fa22231531,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:11.134729 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.197437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Attempting to bind port 792a90ae-0382-4de1-9cf1-69fa22231531 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:11.197834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Attempting to bind port 792a90ae-0382-4de1-9cf1-69fa22231531 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:11.198170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Attempting to bind port 792a90ae-0382-4de1-9cf1-69fa22231531 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:11.205925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:11.206706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Checking segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:11.207450 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.208079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Bound using segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:11.208942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Bound port: 792a90ae-0382-4de1-9cf1-69fa22231531, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:11.209790 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.256533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.288433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.295132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] For port 792a90ae-0382-4de1-9cf1-69fa22231531, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:11.298393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] For port 792a90ae-0382-4de1-9cf1-69fa22231531, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=792a90ae-0382-4de1-9cf1-69fa22231531,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:11.363710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.392744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.394642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.449801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network eef11f28-43bc-4f45-bb74-cee477ba9652 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:11.451904 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.457679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/fc010469-3a38-48d6-b343-2dde2753849c HTTP/1.1" status: 204 len: 168 time: 0.4801028 Dec 21 04:16:11.457890 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:11.457985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c658338c-09b6-45e8-a235-511fda966b3a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=fc010469-3a38-48d6-b343-2dde2753849c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:11.458066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35376) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:11.469847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f476241-b238-4ffb-abb6-cdcc18a83877 None None] Pushing event updated for resources: {'Port': ['ID=792a90ae-0382-4de1-9cf1-69fa22231531,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:11.475420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:11.481257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0448dbb-d96e-4115-81f4-5b47ff2f8c1b None None] Network 2be9b333-b36f-48ac-b43e-4ff119943471 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:11.560193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 46e149e9-8aff-43c7-8263-b38b45f47403 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:11.584896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=50c6c188-4f52-464e-9bb7-62f194206ffa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:11.594567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.656596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 46e149e9-8aff-43c7-8263-b38b45f47403 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:11.657066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.660761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet 5e23a514-08a5-4f3b-ac89-5d064a78b462 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:16:11.670499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.808215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-793de86b-e742-4143-b006-148d66189119 None None] DHCP port deletion for 2be9b333-b36f-48ac-b43e-4ff119943471 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:11.823327 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.901936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-793de86b-e742-4143-b006-148d66189119 None None] Deleting port a92560f9-c652-45c7-a350-420747e6f5b7 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:11.902446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-793de86b-e742-4143-b006-148d66189119 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.951067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.979239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-793de86b-e742-4143-b006-148d66189119 None None] For port a92560f9-c652-45c7-a350-420747e6f5b7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a92560f9-c652-45c7-a350-420747e6f5b7,segment=NetworkSegment(d7a5ddea-6999-4a33-9492-d276bec32d1a),segment_id=d7a5ddea-6999-4a33-9492-d276bec32d1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:11.979642 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-793de86b-e742-4143-b006-148d66189119 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:11.993528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-793de86b-e742-4143-b006-148d66189119 None None] Calling delete_port for a92560f9-c652-45c7-a350-420747e6f5b7 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:12.032202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.131380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.157118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-793de86b-e742-4143-b006-148d66189119 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.172258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.175947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/5e23a514-08a5-4f3b-ac89-5d064a78b462 HTTP/1.1" status: 204 len: 168 time: 0.7132881 Dec 21 04:16:12.176961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc1ab861-fe12-4893-b1b4-6c43d6360332 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=5e23a514-08a5-4f3b-ac89-5d064a78b462,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:12.182874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35384) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:12.202889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-793de86b-e742-4143-b006-148d66189119 None None] Pushing event deleted for resources: {'Port': ['ID=a92560f9-c652-45c7-a350-420747e6f5b7,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:12.211009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8b819e6-2d94-4a4d-ac21-407451a6cbe9 None None] Network c6530219-3fd4-4549-892e-cbf62e2f1d02 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:12.239685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-793de86b-e742-4143-b006-148d66189119 None None] No DVR routers for this DVR port a92560f9-c652-45c7-a350-420747e6f5b7 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:12.273218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.415092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.436385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] DHCP port deletion for c6530219-3fd4-4549-892e-cbf62e2f1d02 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:12.445096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2be9b333-b36f-48ac-b43e-4ff119943471']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:12.457151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7a5ddea-6999-4a33-9492-d276bec32d1a') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:12.469685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7a5ddea-6999-4a33-9492-d276bec32d1a') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:12.488567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.502629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.503849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.512048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 124 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:16:12.514877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:16:12.515671 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:16:12.518873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] Deleting port c198fdf6-24d8-447f-93e8-adf76156bf46 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:12.518873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.586644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] For port c198fdf6-24d8-447f-93e8-adf76156bf46, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c198fdf6-24d8-447f-93e8-adf76156bf46,segment=NetworkSegment(54bedc6b-aaee-4e25-923b-8044e5e32b53),segment_id=54bedc6b-aaee-4e25-923b-8044e5e32b53)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:12.587094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.593186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.601175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] Calling delete_port for c198fdf6-24d8-447f-93e8-adf76156bf46 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:12.642651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.653892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.660102 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/2be9b333-b36f-48ac-b43e-4ff119943471 HTTP/1.1" status: 204 len: 168 time: 0.4736218 Dec 21 04:16:12.661458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.663594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35388) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:12.716381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e99cbfdb-d084-4814-9c4a-e30a588da249 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=2be9b333-b36f-48ac-b43e-4ff119943471,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:12.796357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e9e8ce4-5185-4d0c-8387-fb6fd04d9456 None None] Network eef11f28-43bc-4f45-bb74-cee477ba9652 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:12.800924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=50c6c188-4f52-464e-9bb7-62f194206ffa,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:12.814105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.864971 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.870785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network eef11f28-43bc-4f45-bb74-cee477ba9652 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:12.872491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:12.930912 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.956871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c6530219-3fd4-4549-892e-cbf62e2f1d02']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:12.960157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] No DVR routers for this DVR port c198fdf6-24d8-447f-93e8-adf76156bf46 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:12.963936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2c2ff32-ff32-4f75-80a4-cfff7370c23d None None] Pushing event deleted for resources: {'Port': ['ID=c198fdf6-24d8-447f-93e8-adf76156bf46,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:12.983705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54bedc6b-aaee-4e25-923b-8044e5e32b53') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:12.984260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54bedc6b-aaee-4e25-923b-8044e5e32b53') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:12.994204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bcd3f2bd-e721-4499-9b72-edd28ca29710 None None] Provisioning complete for port 792a90ae-0382-4de1-9cf1-69fa22231531 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:12.994777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcd3f2bd-e721-4499-9b72-edd28ca29710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:12.999715 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.013959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.020914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:16:13.022056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 243f6737-b79b-4ef0-a9db-fc76068ee195 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:13.022607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:16:13.025993 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:16:13.178623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:13.180075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.194038 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcd3f2bd-e721-4499-9b72-edd28ca29710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.199497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b677eb49-f7fc-49b4-8260-56edcc523fac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/243f6737-b79b-4ef0-a9db-fc76068ee195/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1691895 Dec 21 04:16:13.211992 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.216613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/c6530219-3fd4-4549-892e-cbf62e2f1d02 HTTP/1.1" status: 204 len: 168 time: 0.5512462 Dec 21 04:16:13.217939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d94a3b92-2f9f-450f-8454-1df00da3402b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=c6530219-3fd4-4549-892e-cbf62e2f1d02,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:13.221829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35392) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:13.228150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-902167941'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:13.254629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bcd3f2bd-e721-4499-9b72-edd28ca29710 None None] For port 792a90ae-0382-4de1-9cf1-69fa22231531, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=792a90ae-0382-4de1-9cf1-69fa22231531,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:13.275859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Sync routers for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:13.293059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:13.300088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:13.317027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:13.320926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.332504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcd3f2bd-e721-4499-9b72-edd28ca29710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.376141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 132, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:13.421809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.426688 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment 93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0 of type vlan for network 222291e4-881d-4bdd-a6be-c7d70f9633e1 Dec 21 04:16:13.472512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd3f2bd-e721-4499-9b72-edd28ca29710 None None] Pushing event updated for resources: {'Port': ['ID=792a90ae-0382-4de1-9cf1-69fa22231531,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:13.580497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.588430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-9e53f269-023e-4281-95a2-a4b4ea8b4e72 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1284762407&fields=id&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 267 time: 0.1034303 Dec 21 04:16:13.665759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.672026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:13.672721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.743570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0d9ae1f1-8f5c-4045-960a-144327d636a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:13.745322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0d9ae1f1-8f5c-4045-960a-144327d636a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 796 time: 0.1451380 Dec 21 04:16:13.754580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 792a90ae-0382-4de1-9cf1-69fa22231531 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:13.762729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:13.765615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-b2f969be-a68b-4faf-8413-4b58f5e20ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/quotas/10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 375 time: 0.0116525 Dec 21 04:16:13.783102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=222291e4-881d-4bdd-a6be-c7d70f9633e1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:13.800125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1399e1f-99e4-432b-b418-637ca7d9b3c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5783782 Dec 21 04:16:13.803265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35410) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:13.808770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:13.829039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:13.862269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-d9212d5e-bd9d-4bd3-a6c9-4c2399214104 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0783362 Dec 21 04:16:13.903813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1f497f20-797a-42c7-be1f-72c7de6bb576 None None] Provisioning complete for port 792a90ae-0382-4de1-9cf1-69fa22231531 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:13.904428 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f497f20-797a-42c7-be1f-72c7de6bb576 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:13.996069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-e8df9a2b-9140-4430-98ea-5037e5378fbe service neutron] 10.222.0.18 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301031 Dec 21 04:16:14.013779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:14.017352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.113963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-f28b0e17-b549-425a-99b2-2340a0876929 service neutron] 10.222.0.18 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1168494 Dec 21 04:16:14.128757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 792a90ae-0382-4de1-9cf1-69fa22231531 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:14.129264 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.243156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1f497f20-797a-42c7-be1f-72c7de6bb576 None None] Provisioning complete for port 50c6c188-4f52-464e-9bb7-62f194206ffa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:14.243423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1f497f20-797a-42c7-be1f-72c7de6bb576 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.294750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1f497f20-797a-42c7-be1f-72c7de6bb576 None None] Port 50c6c188-4f52-464e-9bb7-62f194206ffa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:14.364223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:12Z', 'revision_number': 2, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:14.368964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.393059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Checking router: 243f6737-b79b-4ef0-a9db-fc76068ee195 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:16:14.393417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Updating router 243f6737-b79b-4ef0-a9db-fc76068ee195 port 50c6c188-4f52-464e-9bb7-62f194206ffa binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:16:14.422212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.455945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dcdb6a07-d9a8-4a3a-9a79-f622e4067d08 req-7cbecb44-1bd0-4179-b0dc-f1c6ef545dce tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 210 time: 0.1094704 Dec 21 04:16:14.479667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-de528cc6-dd77-417c-a107-c55152d9e05b None None] Provisioning complete for port 50c6c188-4f52-464e-9bb7-62f194206ffa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:14.488812 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-de528cc6-dd77-417c-a107-c55152d9e05b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.488812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c198fdf6-24d8-447f-93e8-adf76156bf46 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:16:14.507633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:14.508027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: 222291e4-881d-4bdd-a6be-c7d70f9633e1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:14.515329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=f32bf567-7d81-4911-924e-f233445eae01,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:14.548231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: c198fdf6-24d8-447f-93e8-adf76156bf46 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:16:14.548585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c198fdf6-24d8-447f-93e8-adf76156bf46 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:16:14.549028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a92560f9-c652-45c7-a350-420747e6f5b7 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:16:14.597101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:14.617923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a92560f9-c652-45c7-a350-420747e6f5b7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:16:14.618246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a92560f9-c652-45c7-a350-420747e6f5b7 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:16:14.627346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-de528cc6-dd77-417c-a107-c55152d9e05b None None] Port 50c6c188-4f52-464e-9bb7-62f194206ffa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:14.660200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 222291e4-881d-4bdd-a6be-c7d70f9633e1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:14.665541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:14.666184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.675401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d716af9a-a07e-4734-bb8d-e5dd90ac7a62 None None] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:14.730330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35424) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:14.731439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e03dc34c-9175-425c-9ab6-6b050ab35399 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.9265532 Dec 21 04:16:14.736425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1763538806', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:14.855840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-222291e4-881d-4bdd-a6be-c7d70f9633e1', 'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': 'f32bf567-7d81-4911-924e-f233445eae01'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:14.857081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.871669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.874843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.931036 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:14.969789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.036932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Allocated IP 2001:db8::2 (222291e4-881d-4bdd-a6be-c7d70f9633e1/f32bf567-7d81-4911-924e-f233445eae01/8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:15.042462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.073679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.141783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.144823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2f234fc4-e5fd-41fb-aaaf-89401adf18c8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.4120419 Dec 21 04:16:15.148091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:15.154703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'port': {'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1', 'name': 'tempest-RoutersIpV6Test-1216570728'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:15.202537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59223697-abed-416e-a952-861055c5723b None None] Pushing event updated for resources: {'Port': ['ID=50c6c188-4f52-464e-9bb7-62f194206ffa,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:15.256192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Attempting to bind port 50c6c188-4f52-464e-9bb7-62f194206ffa on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:15.256573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Attempting to bind port 50c6c188-4f52-464e-9bb7-62f194206ffa by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:15.256943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Attempting to bind port 50c6c188-4f52-464e-9bb7-62f194206ffa on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:15.265351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:15.265723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Checking segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:15.266130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.266532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Bound using segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:15.267048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Bound port: 50c6c188-4f52-464e-9bb7-62f194206ffa, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:15.267434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.349352 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.383556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] For port 50c6c188-4f52-464e-9bb7-62f194206ffa, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:15.388116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] For port 50c6c188-4f52-464e-9bb7-62f194206ffa, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=50c6c188-4f52-464e-9bb7-62f194206ffa,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:15.391446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:15.396184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.420213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.427009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] device_id is not set on port 88998282-087f-4e72-8075-a9d59aadca1a yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:16:15.451346 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.480362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:15.481560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 792a90ae-0382-4de1-9cf1-69fa22231531 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:15.513048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:15.519104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:15.530068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Pushing event updated for resources: {'Port': ['ID=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:15.612510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59223697-abed-416e-a952-861055c5723b None None] Pushing event updated for resources: {'Port': ['ID=50c6c188-4f52-464e-9bb7-62f194206ffa,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:15.667061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6f17b49-8698-4a8b-9f44-f857ccc7cb9f req-9558c5ba-6888-4e3d-a4ad-f93418b1cb4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 210 time: 0.0733666 Dec 21 04:16:15.713077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:15.713727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:15.732526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8::15b (222291e4-881d-4bdd-a6be-c7d70f9633e1/f32bf567-7d81-4911-924e-f233445eae01/88998282-087f-4e72-8075-a9d59aadca1a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:15.759937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-36427398-6d77-401e-b10f-bc3fcb1105ce None None] Provisioning complete for port 50c6c188-4f52-464e-9bb7-62f194206ffa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:15.760311 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36427398-6d77-401e-b10f-bc3fcb1105ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.930533 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:15.980009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Attempting to bind port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:15.980378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Attempting to bind port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:15.980735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Attempting to bind port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 on network 222291e4-881d-4bdd-a6be-c7d70f9633e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:16.005161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:16.005572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Checking segment: {'id': '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:16.006045 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.006353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Bound using segment: {'id': '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:16.006829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Bound port: 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '222291e4-881d-4bdd-a6be-c7d70f9633e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:16.007234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.020271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.056561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 792a90ae-0382-4de1-9cf1-69fa22231531 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:16.056937 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.098289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:16.101982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=88998282-087f-4e72-8075-a9d59aadca1a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:16.104615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:16.111154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:16.120244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:16.120912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.147716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:16.199503 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dbfd08df-6aa9-4abe-84bf-c10bcfd574c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.0501273 Dec 21 04:16:16.201900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:16.243091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-777bbc30-7456-4d6c-a159-56296349badb None None] For port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:16.249682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-777bbc30-7456-4d6c-a159-56296349badb None None] For port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,segment=NetworkSegment(93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0),segment_id=93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:16.306839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36427398-6d77-401e-b10f-bc3fcb1105ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.414220 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.474481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-36427398-6d77-401e-b10f-bc3fcb1105ce None None] For port 50c6c188-4f52-464e-9bb7-62f194206ffa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=50c6c188-4f52-464e-9bb7-62f194206ffa,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:16.534331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-777bbc30-7456-4d6c-a159-56296349badb None None] Pushing event updated for resources: {'Port': ['ID=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:16.568879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-36427398-6d77-401e-b10f-bc3fcb1105ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.627753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.647545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36427398-6d77-401e-b10f-bc3fcb1105ce None None] Pushing event updated for resources: {'Port': ['ID=50c6c188-4f52-464e-9bb7-62f194206ffa,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:16.660870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:15Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:16.692848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51dc9eb2-1921-4722-acca-3c5a34120706 None None] The sync data for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 is: [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:15Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:16.715556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5ce84073-08ef-4d0d-8cab-8b2099bd0fed None None] Provisioning complete for port 50c6c188-4f52-464e-9bb7-62f194206ffa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:16.715941 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5ce84073-08ef-4d0d-8cab-8b2099bd0fed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:16.827491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3b04c49-9f54-4be5-baf6-5258c6fecf59 req-9042e24f-f035-42fa-8bf9-c5f6b265746b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 210 time: 0.0593114 Dec 21 04:16:17.425197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-76b42420-8a86-434c-ad11-c6789c1c784c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:17.427348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-76b42420-8a86-434c-ad11-c6789c1c784c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 796 time: 0.1440749 Dec 21 04:16:17.581853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-518e7e4c-ad42-4437-954c-50955d83fbf4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 380 time: 0.1288195 Dec 21 04:16:17.596745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'port': {'device_id': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'admin_state_up': True, 'tenant_id': '10a032d25985452584a3dcdae6969809', 'security_groups': ['66bddc2b-7950-4d58-9286-3d1b9fcb0295']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:17.597067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 50c6c188-4f52-464e-9bb7-62f194206ffa up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:17.624250 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:17.682409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 50c6c188-4f52-464e-9bb7-62f194206ffa triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:17.682798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:17.688361 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:17.861137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:17.908648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=88998282-087f-4e72-8075-a9d59aadca1a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:17.951324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:17.956749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:17.962583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:17.962985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.050610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b31355de-a133-4d3e-b3df-48893cc4acb1 req-82975cd1-260d-4cce-8c8a-1c7a0037e08b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 210 time: 0.0853302 Dec 21 04:16:18.057387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.081037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.141871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,segment=NetworkSegment(93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0),segment_id=93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:18.199191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4182a1af-c2c7-4880-9260-9697f3769a9d None None] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:18.202076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.237777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.7 (eef11f28-43bc-4f45-bb74-cee477ba9652/06cf8f43-8470-4925-8b6b-b18ed572652f/9b09c638-7de6-406b-80c2-cfca2ee126e8) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:18.376210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.382376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:18.411955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dab3b20f-d9d7-451c-9dfb-cdf1bef5d5e9 None None] Provisioning complete for port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:18.412336 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dab3b20f-d9d7-451c-9dfb-cdf1bef5d5e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.467469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.574675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.676671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network eef11f28-43bc-4f45-bb74-cee477ba9652 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:18.679116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:18.681928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:18.689753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:18.754809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:18.755748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.789645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.838773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.839678 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.858722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-0429a5f2-ffc1-413c-8c2a-a0ee34a5bd09 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2662911 Dec 21 04:16:18.891641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Request body: {'port': {'device_id': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:18.922177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=88998282-087f-4e72-8075-a9d59aadca1a,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:18.988037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:18.992595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b3d2ebc2-c036-430a-a0bc-0a9662fe89fe None None] Provisioning complete for port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:18.993603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b3d2ebc2-c036-430a-a0bc-0a9662fe89fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.029637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:19.036229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:19.168828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b3d2ebc2-c036-430a-a0bc-0a9662fe89fe None None] Provisioning complete for port 88998282-087f-4e72-8075-a9d59aadca1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:19.169217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b3d2ebc2-c036-430a-a0bc-0a9662fe89fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.218822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b3d2ebc2-c036-430a-a0bc-0a9662fe89fe None None] Port 88998282-087f-4e72-8075-a9d59aadca1a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:19.282960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386f85cc-96cb-4373-aac8-615d48372a09 req-72e41cc4-d3fc-4f0c-bb01-b79a73c8b380 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:19.285117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386f85cc-96cb-4373-aac8-615d48372a09 req-72e41cc4-d3fc-4f0c-bb01-b79a73c8b380 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 931 time: 0.1012931 Dec 21 04:16:19.347805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fb24e531-9571-44a3-8683-ce1c3d615fd3 None None] Provisioning complete for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:19.348174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb24e531-9571-44a3-8683-ce1c3d615fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.366161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 09e558eb-89a7-4b32-ae3c-a0c4f83f9535 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:19.389488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386f85cc-96cb-4373-aac8-615d48372a09 req-583a0450-0d1b-4865-acc0-c63e92d71fad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761380 Dec 21 04:16:19.416633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fb24e531-9571-44a3-8683-ce1c3d615fd3 None None] Port 9b09c638-7de6-406b-80c2-cfca2ee126e8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:19.437443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fb24e531-9571-44a3-8683-ce1c3d615fd3 None None] Provisioning complete for port 88998282-087f-4e72-8075-a9d59aadca1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:19.437821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb24e531-9571-44a3-8683-ce1c3d615fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.495388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fb24e531-9571-44a3-8683-ce1c3d615fd3 None None] Port 88998282-087f-4e72-8075-a9d59aadca1a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:19.525102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:19.535637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:19.542885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9b09c638-7de6-406b-80c2-cfca2ee126e8 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:16:19.546592 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] Sync routers for ids ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:19.557241 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ae10a45a-5885-4c16-9c76-bf5c28ab4829 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/09e558eb-89a7-4b32-ae3c-a0c4f83f9535/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3530741 Dec 21 04:16:19.561962 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] Routers {'09e558eb-89a7-4b32-ae3c-a0c4f83f9535'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:19.567619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35460) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:19.571345 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:19.583280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.592213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:19.592670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.604410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Transition to ACTIVE for port object 9b09c638-7de6-406b-80c2-cfca2ee126e8 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:16:19.649862 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b52d89ab-f6bd-4ca7-99e8-1e6565170055 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:19.653242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b52d89ab-f6bd-4ca7-99e8-1e6565170055 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports/88998282-087f-4e72-8075-a9d59aadca1a HTTP/1.1" status: 200 len: 984 time: 0.0832143 Dec 21 04:16:19.655450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35462) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:19.682347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.696951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ec32eb3a-d7f4-4201-9f4f-d7b4354a89fb None None] Provisioning complete for port 88998282-087f-4e72-8075-a9d59aadca1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:19.702771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ec32eb3a-d7f4-4201-9f4f-d7b4354a89fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.759716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ec32eb3a-d7f4-4201-9f4f-d7b4354a89fb None None] Port 88998282-087f-4e72-8075-a9d59aadca1a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:19.773957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:19.844534 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:19.866311 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] Routers {'09e558eb-89a7-4b32-ae3c-a0c4f83f9535'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:19.866958 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:19.915304 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:19.916198 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65f1fb62-6c6a-4cf7-8a1f-cec35d83166e None None] The sync data for ids ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:19.948446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-11ddb1bb-4de3-48d3-a073-1ccc17c287e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.958750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:19.962400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:19.962400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:19.972536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:16:19.972871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:19.980123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:19.980474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Checking segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:19.985386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Bound using segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:19.985386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Bound port: 9b09c638-7de6-406b-80c2-cfca2ee126e8, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:19.985386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:19.992790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ff736780-8d92-4675-9271-a7bdc6287f40 None None] Provisioning complete for port 88998282-087f-4e72-8075-a9d59aadca1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:19.993627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ff736780-8d92-4675-9271-a7bdc6287f40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.040906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ff736780-8d92-4675-9271-a7bdc6287f40 None None] Port 88998282-087f-4e72-8075-a9d59aadca1a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:20.084137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:20.087567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:20.174634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.222651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.223475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.225549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] 10.222.0.31 "PUT /v2.0/ports/9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1092 time: 1.3429594 Dec 21 04:16:20.226064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:16:20.228553 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1" -d '{"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:16:20.265378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce45cb3f-5876-4f21-9ffb-8a0b808ad0bf service neutron] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:20.278569 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:16:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a1ce58e-358f-4b10-9f4c-a7c56a99044f x-openstack-request-id: req-5a1ce58e-358f-4b10-9f4c-a7c56a99044f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:16:20.278866 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:16:20.284735 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5a1ce58e-358f-4b10-9f4c-a7c56a99044f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:16:20.284735 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'status': 'completed', 'code': 200} Dec 21 04:16:20.316374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.368867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1 req-9ad5f086-268e-4fe8-8643-512ebf92ba45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.370418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1 req-9ad5f086-268e-4fe8-8643-512ebf92ba45 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1095 time: 0.0456412 Dec 21 04:16:20.519057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1 req-0851d90f-5733-4e24-95cd-1c62acf7483d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.520527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1 req-0851d90f-5733-4e24-95cd-1c62acf7483d service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=10a032d25985452584a3dcdae6969809&shared=False HTTP/1.1" status: 200 len: 897 time: 0.1297717 Dec 21 04:16:20.549187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42cec35a-e4fe-462a-8382-6dad654059d5 req-7cb7a9bd-0817-4ffd-a032-cff7a0cea49e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.550628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42cec35a-e4fe-462a-8382-6dad654059d5 req-7cb7a9bd-0817-4ffd-a032-cff7a0cea49e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0716951 Dec 21 04:16:20.603076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 88998282-087f-4e72-8075-a9d59aadca1a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:20.603414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.653350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42cec35a-e4fe-462a-8382-6dad654059d5 req-b9e073dc-de4a-48e9-b394-92fc94bfed0c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0932806 Dec 21 04:16:20.667212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1 req-26934e80-96ab-4dc7-b3a1-a9a99ab039f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.668429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3f1a73d-fec3-4e7f-928f-bfa7af5c9ae1 req-26934e80-96ab-4dc7-b3a1-a9a99ab039f0 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1367490 Dec 21 04:16:20.696151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.710606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 88998282-087f-4e72-8075-a9d59aadca1a owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:20.806868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-7fee0209-1520-4133-a940-a02956ccd351 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.808407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-7fee0209-1520-4133-a940-a02956ccd351 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1095 time: 0.0442381 Dec 21 04:16:20.866268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-52e2f954-1676-47ba-8dee-cf077e3c5206 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 217 time: 0.0394228 Dec 21 04:16:20.934206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:20.937711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-7caa2c13-b8e9-4687-ba14-3611e12f2392 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:20.939217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-7caa2c13-b8e9-4687-ba14-3611e12f2392 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0450253 Dec 21 04:16:20.965589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=88998282-087f-4e72-8075-a9d59aadca1a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:21.008859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-8bff65a5-2d1e-4484-8692-1367fc4656f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:21.010457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-8bff65a5-2d1e-4484-8692-1367fc4656f2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0588422 Dec 21 04:16:21.077218 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:21.134365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-46711952-1eb5-485c-ad57-bd9209a0606b service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1112735 Dec 21 04:16:21.293381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aed4ab5-c92b-47e7-9ca7-34943d09b22f req-c7c69efe-90ee-4164-9a2b-dca706427e29 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1460249 Dec 21 04:16:21.296275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 09e558eb-89a7-4b32-ae3c-a0c4f83f9535 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:21.383297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:21.388848 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-32eaacbb-72ad-4226-aa29-9af5d723b604 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/09e558eb-89a7-4b32-ae3c-a0c4f83f9535/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7314315 Dec 21 04:16:21.391804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:21.393836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] Sync routers for ids ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:21.404752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] Routers {'09e558eb-89a7-4b32-ae3c-a0c4f83f9535'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:21.405605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:21.439430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:21.449047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] Routers {'09e558eb-89a7-4b32-ae3c-a0c4f83f9535'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:21.449833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:21.486524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:21.487202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d36070c-57dc-4a2e-83ec-0b785ca29dae None None] The sync data for ids ['09e558eb-89a7-4b32-ae3c-a0c4f83f9535'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:21.588928 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-65e08862-0f1b-4e31-a255-550dee1835cf tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] remove_router_interface failed (client error): The resource could not be found. Dec 21 04:16:21.590058 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-65e08862-0f1b-4e31-a255-550dee1835cf tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/09e558eb-89a7-4b32-ae3c-a0c4f83f9535/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.1972017 Dec 21 04:16:21.593323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35482) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:21.621245 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1c36363e-3729-4e2d-83a2-6c1ef5cd8cbb tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=09e558eb-89a7-4b32-ae3c-a0c4f83f9535 HTTP/1.1" status: 200 len: 205 time: 0.0268517 Dec 21 04:16:21.623651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:21.702525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:21.789989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a4574d-1b1d-457a-8ab5-45d6b7823b6c req-df051340-2926-43ce-a080-bb7088f8e226 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:21.791697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4a4574d-1b1d-457a-8ab5-45d6b7823b6c req-df051340-2926-43ce-a080-bb7088f8e226 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0570779 Dec 21 04:16:21.846714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4a4574d-1b1d-457a-8ab5-45d6b7823b6c req-5111da90-5518-4e8c-b185-bed77f1bb5fd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489085 Dec 21 04:16:21.867429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:21.869639 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:21.979557 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:21.980084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router 09e558eb-89a7-4b32-ae3c-a0c4f83f9535 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:16:21.986716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:21.987845 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d7a3ca93-eccc-4e1b-8836-28160b610af3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/09e558eb-89a7-4b32-ae3c-a0c4f83f9535 HTTP/1.1" status: 204 len: 168 time: 0.3632488 Dec 21 04:16:21.991169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35500) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:22.041546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet f32bf567-7d81-4911-924e-f233445eae01 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:16:22.044730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.083973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.168268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.277433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.306963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=f32bf567-7d81-4911-924e-f233445eae01,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:22.310567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.316563 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aabcbe8d-8d0d-4345-ae01-cf14687efeca tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/f32bf567-7d81-4911-924e-f233445eae01 HTTP/1.1" status: 204 len: 168 time: 0.3216968 Dec 21 04:16:22.316563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:22.320959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f25f7f9-8e72-4ce8-9bbd-1afddcff0fee None None] Network 222291e4-881d-4bdd-a6be-c7d70f9633e1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:22.404366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.481528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:22.481884 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.495381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] DHCP port deletion for 222291e4-881d-4bdd-a6be-c7d70f9633e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:22.549253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] Deleting port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:22.549630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.553583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,segment=NetworkSegment(93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0),segment_id=93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:22.553952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.566318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:22.623386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] For port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,segment=NetworkSegment(93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0),segment_id=93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:22.623794 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.636310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] Calling delete_port for 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:22.683655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-930dd3b0-1765-42b0-8d65-5de5fcdb0c4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.694980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.723110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:22.723922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.725990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:22.751283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] Pushing event deleted for resources: {'Port': ['ID=8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:22.754757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd77e1db-fbad-4ff5-a8ad-ac5b031216a1 None None] No DVR routers for this DVR port 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:22.820797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.840857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['222291e4-881d-4bdd-a6be-c7d70f9633e1']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:22.850029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:22.850331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '93ff7a56-f914-45ba-aae6-ff8a6b9a5cb0') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:22.859587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.873169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.879448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:16:22.879828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:16:22.884950 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:16:22.974359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ac1413-4fc2-4b85-8e69-eb978ba474fe req-cbc40b0a-6a5a-4886-afd3-ef8abded38d7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:22.975874 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5ac1413-4fc2-4b85-8e69-eb978ba474fe req-cbc40b0a-6a5a-4886-afd3-ef8abded38d7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0496969 Dec 21 04:16:23.007877 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.025081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5ac1413-4fc2-4b85-8e69-eb978ba474fe req-fee2a662-3c5d-4101-84e3-97135a845d2a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430114 Dec 21 04:16:23.030729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.035820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.043566 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/222291e4-881d-4bdd-a6be-c7d70f9633e1 HTTP/1.1" status: 204 len: 168 time: 0.7249131 Dec 21 04:16:23.044080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35526) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:23.049919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-826924979'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:23.060724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb350ab1-c374-4ffc-a60a-52e7c6c9f161 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=222291e4-881d-4bdd-a6be-c7d70f9633e1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:23.133624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:23.137298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.160568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:23.169770 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.170117 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment b1640c65-ed20-4ae0-ae92-8aaa6781848e of type vlan for network 7089db17-b896-4932-bf51-be7471ee383f Dec 21 04:16:23.208825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.310860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.316694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:23.317274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.356016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.388717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=7089db17-b896-4932-bf51-be7471ee383f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:23.395350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 7089db17-b896-4932-bf51-be7471ee383f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:23.413227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6760cf3b-394c-4164-b691-bb7186e5f2d2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.3658702 Dec 21 04:16:23.414639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35532) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:23.423090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': '7089db17-b896-4932-bf51-be7471ee383f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:23.466179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:16:23.488993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:16:23.489351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8629a8c9-a0c6-40a3-aabd-4045f0b7b4e7 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:16:23.636567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:23.640207 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.871111 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:23.941280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=d6db0b85-915d-4cae-9fe7-4d04fb117909,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:23.949157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': 'b1640c65-ed20-4ae0-ae92-8aaa6781848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '7089db17-b896-4932-bf51-be7471ee383f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:23.949528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: 7089db17-b896-4932-bf51-be7471ee383f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:24.019345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 7089db17-b896-4932-bf51-be7471ee383f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:24.085532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 7089db17-b896-4932-bf51-be7471ee383f) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:24.085532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:24.085532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.090346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b7dc5f3-4f27-45a4-a7ff-c543b5062fe4 None None] Network 7089db17-b896-4932-bf51-be7471ee383f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:24.141500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312ef06b-37a0-4beb-aa39-30b5a7fd2829 req-8dc7a1ea-3702-4e65-a632-0b854f4d4d28 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:24.143291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-312ef06b-37a0-4beb-aa39-30b5a7fd2829 req-8dc7a1ea-3702-4e65-a632-0b854f4d4d28 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0483651 Dec 21 04:16:24.158954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fd801273-890d-44eb-8727-efa71202c4ff tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7426627 Dec 21 04:16:24.161967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:24.167693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-2022615584', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:24.212177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-312ef06b-37a0-4beb-aa39-30b5a7fd2829 req-723d7b9b-3b2b-408e-96de-1bdab6b6c03b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623870 Dec 21 04:16:24.271998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.273145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.327791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.366448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-7089db17-b896-4932-bf51-be7471ee383f', 'network_id': '7089db17-b896-4932-bf51-be7471ee383f', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': 'd6db0b85-915d-4cae-9fe7-4d04fb117909'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:24.367552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.431470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.479393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:16:24.520085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Allocated IP 2001:db8::2 (7089db17-b896-4932-bf51-be7471ee383f/d6db0b85-915d-4cae-9fe7-4d04fb117909/ba98bd4a-dae8-467a-ada8-9c66be7c2180) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:24.530194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.533880 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2c6e7679-7856-4678-8a76-26d5f1e1e7fc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.3676660 Dec 21 04:16:24.534082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35552) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:24.671970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:24.694130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'mac_address': 'fa:16:3e:f5:3b:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:16:24.769583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.783831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.788781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b09c638-7de6-406b-80c2-cfca2ee126e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:16:24.810422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:24.846088 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.855547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.878207 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:16:24.879453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:24.898086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Network 7089db17-b896-4932-bf51-be7471ee383f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:24.900953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:24.903505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:24.913576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Pushing event updated for resources: {'Port': ['ID=ba98bd4a-dae8-467a-ada8-9c66be7c2180,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:25.046432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Attempting to bind port ba98bd4a-dae8-467a-ada8-9c66be7c2180 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:25.046835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Attempting to bind port ba98bd4a-dae8-467a-ada8-9c66be7c2180 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b1640c65-ed20-4ae0-ae92-8aaa6781848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '7089db17-b896-4932-bf51-be7471ee383f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:25.047263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Attempting to bind port ba98bd4a-dae8-467a-ada8-9c66be7c2180 on network 7089db17-b896-4932-bf51-be7471ee383f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:25.060038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:25.065018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:25.065764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Checking segment: {'id': 'b1640c65-ed20-4ae0-ae92-8aaa6781848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '7089db17-b896-4932-bf51-be7471ee383f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:25.066427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.067096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Bound using segment: {'id': 'b1640c65-ed20-4ae0-ae92-8aaa6781848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '7089db17-b896-4932-bf51-be7471ee383f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:25.068154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Bound port: ba98bd4a-dae8-467a-ada8-9c66be7c2180, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1640c65-ed20-4ae0-ae92-8aaa6781848e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '7089db17-b896-4932-bf51-be7471ee383f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:25.068780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.072676 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.152062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] For port ba98bd4a-dae8-467a-ada8-9c66be7c2180, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:25.155929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] For port ba98bd4a-dae8-467a-ada8-9c66be7c2180, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ba98bd4a-dae8-467a-ada8-9c66be7c2180,segment=NetworkSegment(b1640c65-ed20-4ae0-ae92-8aaa6781848e),segment_id=b1640c65-ed20-4ae0-ae92-8aaa6781848e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:25.157412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.209754 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.253624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9b09c638-7de6-406b-80c2-cfca2ee126e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:16:25.317642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe65b9a-b97d-4abd-8470-a60cf6aebd80 None None] Pushing event updated for resources: {'Port': ['ID=ba98bd4a-dae8-467a-ada8-9c66be7c2180,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:25.354993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109da07a-99d1-40bc-8ed0-e51b4928af21 req-be6fb63d-df13-487d-8b9f-70ee69d7f240 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:25.356548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-109da07a-99d1-40bc-8ed0-e51b4928af21 req-be6fb63d-df13-487d-8b9f-70ee69d7f240 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 944 time: 0.0700328 Dec 21 04:16:25.460382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-109da07a-99d1-40bc-8ed0-e51b4928af21 req-c5566f51-9975-4395-a55f-eb21927ac21c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0962696 Dec 21 04:16:25.566188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8::1 (7089db17-b896-4932-bf51-be7471ee383f/d6db0b85-915d-4cae-9fe7-4d04fb117909/d9f777a9-7ccf-45f7-b3f6-0324065af5ad) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:25.709908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.762130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.831404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.883738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 7089db17-b896-4932-bf51-be7471ee383f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:25.886999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:25.890842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:25.891446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:25.897695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=d9f777a9-7ccf-45f7-b3f6-0324065af5ad,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:26.069581 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.361806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.402699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.403805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.459745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab50f81a-2bd2-4d8c-a322-3f73906d8ff5 None None] Network 7089db17-b896-4932-bf51-be7471ee383f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:26.500954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=d9f777a9-7ccf-45f7-b3f6-0324065af5ad,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:26.514715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:26.516317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.516688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.517036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.517378 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.517714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.518084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.518380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.518708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.519064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.519981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.519981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.520169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.520372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:26.564786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 7089db17-b896-4932-bf51-be7471ee383f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:26.566819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:26.590622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-258b22e4-d2a9-4557-9b19-181feab0280b None None] Provisioning complete for port ba98bd4a-dae8-467a-ada8-9c66be7c2180 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:26.591089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-258b22e4-d2a9-4557-9b19-181feab0280b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.648342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67db5ce8-0973-43a9-9ade-794630eeade5 req-3faf562b-63f8-4607-bc7a-a64dc16b4577 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:26.651262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67db5ce8-0973-43a9-9ade-794630eeade5 req-3faf562b-63f8-4607-bc7a-a64dc16b4577 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 944 time: 0.1058240 Dec 21 04:16:26.721705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-67db5ce8-0973-43a9-9ade-794630eeade5 req-640871c0-de35-49fe-9ff5-8585fd79f74e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632346 Dec 21 04:16:26.722382 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-258b22e4-d2a9-4557-9b19-181feab0280b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.748327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:16:26.758251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:26.758624 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.763054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router f1509aee-4826-466b-935b-22c54bb1a00f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:26.763836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-258b22e4-d2a9-4557-9b19-181feab0280b None None] For port ba98bd4a-dae8-467a-ada8-9c66be7c2180, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ba98bd4a-dae8-467a-ada8-9c66be7c2180,segment=NetworkSegment(b1640c65-ed20-4ae0-ae92-8aaa6781848e),segment_id=b1640c65-ed20-4ae0-ae92-8aaa6781848e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:26.849796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-258b22e4-d2a9-4557-9b19-181feab0280b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.929249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:26.937342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35594) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:26.937801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e6d95cf1-f67a-487a-aadc-35d28970145e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/f1509aee-4826-466b-935b-22c54bb1a00f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4026754 Dec 21 04:16:26.940571 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] Sync routers for ids ['f1509aee-4826-466b-935b-22c54bb1a00f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:26.944376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:26.951367 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] Routers {'f1509aee-4826-466b-935b-22c54bb1a00f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:26.951991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f1509aee-4826-466b-935b-22c54bb1a00f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:26.973437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258b22e4-d2a9-4557-9b19-181feab0280b None None] Pushing event updated for resources: {'Port': ['ID=ba98bd4a-dae8-467a-ada8-9c66be7c2180,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:26.993238 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:27.020529 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] Routers {'f1509aee-4826-466b-935b-22c54bb1a00f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:27.021720 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f1509aee-4826-466b-935b-22c54bb1a00f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:27.026600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:16:27.028917 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9388eaed-7c42-4325-8d9b-b1b494782404" -d '{"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:16:27.046333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:27.087089 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:27.088060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d48f177e-6a2e-4d23-afff-01a27f98cd21 None None] The sync data for ids ['f1509aee-4826-466b-935b-22c54bb1a00f'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:27.095914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc69fb1a-a0e2-451f-890b-79a73812dc5a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:27.099741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cc69fb1a-a0e2-451f-890b-79a73812dc5a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports/d9f777a9-7ccf-45f7-b3f6-0324065af5ad HTTP/1.1" status: 200 len: 911 time: 0.1599822 Dec 21 04:16:27.102559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35604) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:27.129340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.167258 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:16:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d7a7bb9-d58e-421c-832d-c54e187b5810 x-openstack-request-id: req-7d7a7bb9-d58e-421c-832d-c54e187b5810 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:16:27.167258 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:16:27.167258 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7d7a7bb9-d58e-421c-832d-c54e187b5810 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:16:27.167979 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'code': 200} Dec 21 04:16:27.241064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-044afa42-6abc-4c71-9ec2-d038ac81146e None None] Provisioning complete for port d9f777a9-7ccf-45f7-b3f6-0324065af5ad triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:27.241448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-044afa42-6abc-4c71-9ec2-d038ac81146e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.282575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:27.311760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-044afa42-6abc-4c71-9ec2-d038ac81146e None None] Port d9f777a9-7ccf-45f7-b3f6-0324065af5ad cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:27.327929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-044afa42-6abc-4c71-9ec2-d038ac81146e None None] Provisioning complete for port ba98bd4a-dae8-467a-ada8-9c66be7c2180 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:27.328308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-044afa42-6abc-4c71-9ec2-d038ac81146e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.414437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c8a268-4b43-411d-b5c4-b40c14c6aed6 req-e315ba03-fa34-421b-9474-f432315096c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:27.416241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c8a268-4b43-411d-b5c4-b40c14c6aed6 req-e315ba03-fa34-421b-9474-f432315096c2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1097 time: 0.1401572 Dec 21 04:16:27.508588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ba98bd4a-dae8-467a-ada8-9c66be7c2180 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:27.543949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c8a268-4b43-411d-b5c4-b40c14c6aed6 req-b3804ff8-1453-465a-8403-21f2dd95270e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1140270 Dec 21 04:16:27.580276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e0b13efa-d7f5-49c8-994c-f138d4d2165c None None] Provisioning complete for port d9f777a9-7ccf-45f7-b3f6-0324065af5ad triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:27.580533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e0b13efa-d7f5-49c8-994c-f138d4d2165c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.669554 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.670124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e0b13efa-d7f5-49c8-994c-f138d4d2165c None None] Port d9f777a9-7ccf-45f7-b3f6-0324065af5ad cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:27.673941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ba98bd4a-dae8-467a-ada8-9c66be7c2180 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:27.674312 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.791956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be552616-883b-49ea-809b-914c97dd45f7 None None] Provisioning complete for port d9f777a9-7ccf-45f7-b3f6-0324065af5ad triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:27.792331 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be552616-883b-49ea-809b-914c97dd45f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:27.847043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-be552616-883b-49ea-809b-914c97dd45f7 None None] Port d9f777a9-7ccf-45f7-b3f6-0324065af5ad cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:27.919563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-078f5433-9754-4c80-919d-f6c52d32db87 req-74969b16-4a9c-4956-a237-832b8aa77383 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:27.921081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078f5433-9754-4c80-919d-f6c52d32db87 req-74969b16-4a9c-4956-a237-832b8aa77383 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0909431 Dec 21 04:16:28.024850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-078f5433-9754-4c80-919d-f6c52d32db87 req-6460fc16-2c80-4732-80cb-a6c64e70e3a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0970645 Dec 21 04:16:28.068552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port d9f777a9-7ccf-45f7-b3f6-0324065af5ad {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:28.070394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:28.164000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:28.177887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for d9f777a9-7ccf-45f7-b3f6-0324065af5ad owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:28.454040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:28.492716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=d9f777a9-7ccf-45f7-b3f6-0324065af5ad,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:28.524361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.524768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.525144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.525547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.525952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.526352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.526773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.527194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.527594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.527988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.528382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.528776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.529168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:28.625957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.175314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router f1509aee-4826-466b-935b-22c54bb1a00f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:29.204146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0a3d5e-dc1d-4a98-8019-ecc743e197b2 req-f1035f1a-a213-4d37-85bd-17fee1bf6b1c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:29.205622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c0a3d5e-dc1d-4a98-8019-ecc743e197b2 req-f1035f1a-a213-4d37-85bd-17fee1bf6b1c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0687437 Dec 21 04:16:29.282682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:29.290762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8dcf7231-5009-4142-ab5d-769d6c3e8214 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/f1509aee-4826-466b-935b-22c54bb1a00f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1859789 Dec 21 04:16:29.293462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] Sync routers for ids ['f1509aee-4826-466b-935b-22c54bb1a00f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:29.296882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35644) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:29.306068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] Routers {'f1509aee-4826-466b-935b-22c54bb1a00f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:29.307089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f1509aee-4826-466b-935b-22c54bb1a00f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:29.326848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c0a3d5e-dc1d-4a98-8019-ecc743e197b2 req-52fd3e57-0a08-45d1-8f7e-313c97eac8d6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0920432 Dec 21 04:16:29.337148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3bad3090-fa31-4a3b-bc94-3aca73a725ce tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=f1509aee-4826-466b-935b-22c54bb1a00f HTTP/1.1" status: 200 len: 205 time: 0.0389514 Dec 21 04:16:29.340118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:29.369126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:29.397817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] Routers {'f1509aee-4826-466b-935b-22c54bb1a00f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:29.398532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['f1509aee-4826-466b-935b-22c54bb1a00f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:29.426691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.444538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:29.445304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61643b02-bbc8-4bba-996d-f711b69442df None None] The sync data for ids ['f1509aee-4826-466b-935b-22c54bb1a00f'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:29.476777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60eb8625-021a-450c-8652-920919a410a5 req-7b7ca7a1-7abb-4aad-a66d-c61f2c517063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:29.478479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60eb8625-021a-450c-8652-920919a410a5 req-7b7ca7a1-7abb-4aad-a66d-c61f2c517063 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0620055 Dec 21 04:16:29.532776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60eb8625-021a-450c-8652-920919a410a5 req-7fe597c3-1d50-4ab5-aea0-db23a0f07c15 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483446 Dec 21 04:16:29.555227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35652) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:29.592862 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.594991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.598889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ada6c115-6430-44eb-81c8-191e41976bad tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:29.603189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ada6c115-6430-44eb-81c8-191e41976bad tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1092 time: 0.0441952 Dec 21 04:16:29.603389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:29.635973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:29.739391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.740518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router f1509aee-4826-466b-935b-22c54bb1a00f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:16:29.747866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.751779 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0abc0e7c-79cc-46ce-9844-2fb820e5fd1e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/f1509aee-4826-466b-935b-22c54bb1a00f HTTP/1.1" status: 204 len: 168 time: 0.4076421 Dec 21 04:16:29.751779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35658) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:29.778977 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.826250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet d6db0b85-915d-4cae-9fe7-4d04fb117909 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:16:29.830777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:29.896321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.001355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.023548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.154002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.147 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/01980dae-c1eb-4cb1-ab9a-ba8fec6c4026) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:30.156412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.195641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=d6db0b85-915d-4cae-9fe7-4d04fb117909,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:30.200565 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.203799 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a47bacda-bcb7-4132-bd35-070deab33333 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/d6db0b85-915d-4cae-9fe7-4d04fb117909 HTTP/1.1" status: 204 len: 168 time: 0.4512646 Dec 21 04:16:30.206588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35670) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:30.212426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-489864db-eaeb-41c9-9986-333271d195bb None None] Network 7089db17-b896-4932-bf51-be7471ee383f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:30.333979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.377303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] DHCP port deletion for 7089db17-b896-4932-bf51-be7471ee383f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:30.391927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.438020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Deleting port ba98bd4a-dae8-467a-ada8-9c66be7c2180 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:30.438391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.440365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port ba98bd4a-dae8-467a-ada8-9c66be7c2180 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:30.441115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.510800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port ba98bd4a-dae8-467a-ada8-9c66be7c2180, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ba98bd4a-dae8-467a-ada8-9c66be7c2180,segment=NetworkSegment(b1640c65-ed20-4ae0-ae92-8aaa6781848e),segment_id=b1640c65-ed20-4ae0-ae92-8aaa6781848e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:30.511319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.513238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] For port ba98bd4a-dae8-467a-ada8-9c66be7c2180, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ba98bd4a-dae8-467a-ada8-9c66be7c2180,segment=NetworkSegment(b1640c65-ed20-4ae0-ae92-8aaa6781848e),segment_id=b1640c65-ed20-4ae0-ae92-8aaa6781848e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:30.513825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.520024 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.529326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Calling delete_port for ba98bd4a-dae8-467a-ada8-9c66be7c2180 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:30.538160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for ba98bd4a-dae8-467a-ada8-9c66be7c2180 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:30.581238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:30.628328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:30.633672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:30.664721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=01980dae-c1eb-4cb1-ab9a-ba8fec6c4026,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:30.837186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.849093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:30.862296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] No DVR routers for this DVR port ba98bd4a-dae8-467a-ada8-9c66be7c2180 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:30.872020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=ba98bd4a-dae8-467a-ada8-9c66be7c2180,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:30.875786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port ba98bd4a-dae8-467a-ada8-9c66be7c2180 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:30.888634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Pushing event deleted for resources: {'Port': ['ID=ba98bd4a-dae8-467a-ada8-9c66be7c2180,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:30.897419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.897851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.899188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.899188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.899188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.899439 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.900996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.900996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.900996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.900996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.901333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.901464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:30.901999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94354c06-f228-4eae-858d-8fbbe7dcbc16 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:31.001808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.309391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7089db17-b896-4932-bf51-be7471ee383f']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:31.325369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b1640c65-ed20-4ae0-ae92-8aaa6781848e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:31.325665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b1640c65-ed20-4ae0-ae92-8aaa6781848e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:31.338315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.386607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.398577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:16:31.399004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:16:31.405557 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:16:31.454149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ba98bd4a-dae8-467a-ada8-9c66be7c2180 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:16:31.476575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ba98bd4a-dae8-467a-ada8-9c66be7c2180 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:16:31.477314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ba98bd4a-dae8-467a-ada8-9c66be7c2180 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:16:31.487465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d520ca5e-82e6-481a-b94b-c6843d0f315b req-e0c47df5-37e3-43c6-a421-d21ebea7ff1e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:31.493872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d520ca5e-82e6-481a-b94b-c6843d0f315b req-e0c47df5-37e3-43c6-a421-d21ebea7ff1e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0587974 Dec 21 04:16:31.503752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.560535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d520ca5e-82e6-481a-b94b-c6843d0f315b req-d3269476-7d02-4eec-bb37-97615b617a68 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529480 Dec 21 04:16:31.568434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.576685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.579247 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/7089db17-b896-4932-bf51-be7471ee383f HTTP/1.1" status: 204 len: 168 time: 1.3716929 Dec 21 04:16:31.583353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35704) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:31.595093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1739713886', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:31.596687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-726425c8-6ae0-4428-a8a5-e2f6ef0baa58 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=7089db17-b896-4932-bf51-be7471ee383f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:31.640924 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.676872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.678722 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.731551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.795362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.865021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.937918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:31.954704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=01980dae-c1eb-4cb1-ab9a-ba8fec6c4026,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:31.966258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.084301 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP ae34193d-4f2b-464a-8928-ae32066e68b4 associated. External IP: 172.25.5.147, port: 9b09c638-7de6-406b-80c2-cfca2ee126e8. Dec 21 04:16:32.189458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.209539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.304457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 243f6737-b79b-4ef0-a9db-fc76068ee195 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:32.326585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 172.25.5.158 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/6284f07f-286f-4f2c-80ae-3ac0e92d0c51) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:32.415962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:32.432972 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] Sync routers for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:32.446092 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:32.446092 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:32.451761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.512908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.540911 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4851cc1-8118-4c8d-b9ca-98eb019f4b4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.9361422 Dec 21 04:16:32.541518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:16:32.543925 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f82087b-d506-441a-9102-b49c77a8d2cd" -d '{"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:16:32.550890 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:32.585981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.591617 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:16:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d09cb0f-dc43-43d6-ae0a-9c70420654f1 x-openstack-request-id: req-4d09cb0f-dc43-43d6-ae0a-9c70420654f1 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:16:32.593097 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:16:32.598991 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4d09cb0f-dc43-43d6-ae0a-9c70420654f1 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:16:32.598991 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'status': 'completed', 'code': 200} Dec 21 04:16:32.647707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=6284f07f-286f-4f2c-80ae-3ac0e92d0c51,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:32.676262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:32.726866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:32.738875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:32.740299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc45985f-1bde-4c0a-9d73-acf2029c74ae None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:32.814426 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ae34193d-4f2b-464a-8928-ae32066e68b4', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.147', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 3581, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'mac_address': 'fa:16:3e:f5:3b:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:16:30Z', 'updated_at': '2021-12-21T04:16:30Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:32.834216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7221a131-2bb8-4e1f-bf7b-f372deeb70d8 None None] Provisioning complete for port 6284f07f-286f-4f2c-80ae-3ac0e92d0c51 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:32.834975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7221a131-2bb8-4e1f-bf7b-f372deeb70d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:32.835598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3e66c7-083c-41ab-8970-93951c75b1f0 req-6357e0d0-3d97-45c4-85eb-5ae09453eb05 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:32.837108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e3e66c7-083c-41ab-8970-93951c75b1f0 req-6357e0d0-3d97-45c4-85eb-5ae09453eb05 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1837907 Dec 21 04:16:32.848844 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] Checking router: 243f6737-b79b-4ef0-a9db-fc76068ee195 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:16:32.854224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-f301ee75-d13c-4618-b4b8-d787a341c584 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:32.856334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-f301ee75-d13c-4618-b4b8-d787a341c584 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1097 time: 0.2051065 Dec 21 04:16:32.858102 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:32.858757 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:32.863790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a40b23-4b87-4eb2-9725-fd5d2789f637 req-b964e4b2-fa9c-4dd2-a75c-d01079a1e409 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:32.865827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a40b23-4b87-4eb2-9725-fd5d2789f637 req-b964e4b2-fa9c-4dd2-a75c-d01079a1e409 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1723442 Dec 21 04:16:32.884193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7221a131-2bb8-4e1f-bf7b-f372deeb70d8 None None] Port 6284f07f-286f-4f2c-80ae-3ac0e92d0c51 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:32.975527 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:33.085933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-91a40b23-4b87-4eb2-9725-fd5d2789f637 req-c24b5f48-5bce-4a42-8b28-d829aca518e7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2085068 Dec 21 04:16:33.116200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e3e66c7-083c-41ab-8970-93951c75b1f0 req-1a45b609-8afc-4929-943d-a23858b8abea tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2599590 Dec 21 04:16:33.144836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35734) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:33.149813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-8e2bd33c-3da4-4371-9e21-cbe1976329d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:33.151935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-8e2bd33c-3da4-4371-9e21-cbe1976329d1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.2826664 Dec 21 04:16:33.247128 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ae34193d-4f2b-464a-8928-ae32066e68b4', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.147', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 3581, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'mac_address': 'fa:16:3e:f5:3b:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:16:30Z', 'updated_at': '2021-12-21T04:16:30Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:33.276867 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a502e9a5-e606-4169-94b0-7c928d5d239c None None] The sync data for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 is: [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ae34193d-4f2b-464a-8928-ae32066e68b4', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.147', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 3581, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'mac_address': 'fa:16:3e:f5:3b:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:16:30Z', 'updated_at': '2021-12-21T04:16:30Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:33.283557 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a15fa64-10ef-413c-9d37-921bdec318b0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ae34193d-4f2b-464a-8928-ae32066e68b4 HTTP/1.1" status: 200 len: 991 time: 0.1365554 Dec 21 04:16:33.295936 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-61d46da8-9410-425e-9ef3-24c86f920d13 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.1360345 Dec 21 04:16:33.384152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-ff4c079e-f605-469b-9723-7149b0e4d75a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:33.385512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-ff4c079e-f605-469b-9723-7149b0e4d75a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0626271 Dec 21 04:16:33.386168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:33.504665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1e76faa-a1f4-49ef-a10d-76715c3e1975 None None] New status for floating IP ae34193d-4f2b-464a-8928-ae32066e68b4: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:16:33.513731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-b110281c-eb0b-4441-8c69-6b12560c87a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:33.516988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-b110281c-eb0b-4441-8c69-6b12560c87a7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0969372 Dec 21 04:16:33.696152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-909a3469-9fd0-4e6a-8f30-8995ea95a335 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672583 Dec 21 04:16:33.698728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:33.880594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f82087b-d506-441a-9102-b49c77a8d2cd req-858ccfc0-3da4-41db-8284-70ece376f7e4 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1755319 Dec 21 04:16:34.059005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router a4c145c3-f1bd-4866-859e-23da74e5a9e9 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:34.181362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:34.191574 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] Sync routers for ids ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:34.203008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] Routers {'a4c145c3-f1bd-4866-859e-23da74e5a9e9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:34.204170 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:34.241873 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:34.243828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91cd0e4-34c8-486e-a2b1-7180de04625a req-d9862d6e-1ede-4ea2-8b7a-843e88a650f2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:34.251099 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] Routers {'a4c145c3-f1bd-4866-859e-23da74e5a9e9'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:34.251517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b91cd0e4-34c8-486e-a2b1-7180de04625a req-d9862d6e-1ede-4ea2-8b7a-843e88a650f2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0808356 Dec 21 04:16:34.256062 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:34.269075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:34.272909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c461846f-6030-492b-bae6-ad9b40c932e9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 2.6857824 Dec 21 04:16:34.278738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35752) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:34.287840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:34.288327 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:34.288861 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd7e220a-5742-4a66-8276-aaefc9cf3ea0 None None] The sync data for ids ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:34.360110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b91cd0e4-34c8-486e-a2b1-7180de04625a req-96acf7d4-cecb-4e80-abfb-9ef27ed9ec39 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1076186 Dec 21 04:16:34.377431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d616aca8-53fc-4e41-983c-3273553a0b88 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ae34193d-4f2b-464a-8928-ae32066e68b4 HTTP/1.1" status: 200 len: 993 time: 0.0852814 Dec 21 04:16:34.406018 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a9b0b871-2ba1-4d2f-9b99-0f3aa4d8fc9b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/routers/a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 200 len: 885 time: 0.1314490 Dec 21 04:16:34.408275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35756) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:34.638028 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-56beebc0-afda-4146-b3f9-e4a89943560a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 888 time: 0.2284994 Dec 21 04:16:34.640335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:34.644661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-1739713886'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:35.185231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:35.276476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:35.393199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router a4c145c3-f1bd-4866-859e-23da74e5a9e9 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:35.496400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5de3853e-fc9f-44e6-83e5-8b1c262c0d55 req-821d755a-461a-4f7a-a08d-8c9241b59731 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:35.498042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5de3853e-fc9f-44e6-83e5-8b1c262c0d55 req-821d755a-461a-4f7a-a08d-8c9241b59731 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0528796 Dec 21 04:16:35.507324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:35.515314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:35.518782 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-531d71ce-4f32-46d8-a792-06db910fc308 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 200 len: 892 time: 0.8751402 Dec 21 04:16:35.519742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35778) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:35.521144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] Sync routers for ids ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:35.532642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] Routers {'a4c145c3-f1bd-4866-859e-23da74e5a9e9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:35.533963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:35.549732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5de3853e-fc9f-44e6-83e5-8b1c262c0d55 req-22d5dcfb-d898-4de2-b786-284820cd2bb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455287 Dec 21 04:16:35.567340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:35.576672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] Routers {'a4c145c3-f1bd-4866-859e-23da74e5a9e9'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:35.577269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:35.613634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:35.615019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2860fa9-0374-4a86-b1af-04d1e49c667a None None] The sync data for ids ['a4c145c3-f1bd-4866-859e-23da74e5a9e9'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:35.645938 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1cd72dd-15e7-42c8-9a2e-fdd7b4818856 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/routers/a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 200 len: 892 time: 0.1237545 Dec 21 04:16:35.647328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35782) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:35.673921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f5d3a85a-f859-4b21-8ac3-877f3d57dc52 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 200 len: 205 time: 0.0253570 Dec 21 04:16:35.676347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35784) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:35.782069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:35.886240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.015203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 6284f07f-286f-4f2c-80ae-3ac0e92d0c51 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:36.015693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.091064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.103014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 6284f07f-286f-4f2c-80ae-3ac0e92d0c51 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:36.333991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.366388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=6284f07f-286f-4f2c-80ae-3ac0e92d0c51,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:36.380814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27aa1277-69c2-4100-b387-659c10b31eed None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:36.432860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.522657 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.524679 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.647891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.648844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router a4c145c3-f1bd-4866-859e-23da74e5a9e9 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:16:36.669358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.669358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f474bfce-92b9-4fe6-b240-29d534aeb50c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 204 len: 168 time: 0.9875627 Dec 21 04:16:36.669673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35804) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:36.674587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-786926383'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:36.681794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e430227-9b51-40e6-adf3-b9e2e65d96bb req-6a9afd17-5587-46b4-8c68-41a6a9201aee tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:36.683343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e430227-9b51-40e6-adf3-b9e2e65d96bb req-6a9afd17-5587-46b4-8c68-41a6a9201aee tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0545571 Dec 21 04:16:36.744368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e430227-9b51-40e6-adf3-b9e2e65d96bb req-57a4d84a-7801-4c7a-a32d-b48b0d598adb tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0525386 Dec 21 04:16:36.762021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:36.765632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.789984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 129, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:36.799499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.799849 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment 0da62b4b-f2c7-4c56-aac7-08d0acba19cd of type vlan for network afbbec10-b9ce-49b6-b4fd-fab197e6c481 Dec 21 04:16:36.840316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.910719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.916761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:36.917364 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:36.982140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=afbbec10-b9ce-49b6-b4fd-fab197e6c481,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:36.992777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:37.008630 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3bc47853-e592-4bb2-81c9-1cdd80dc9eec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.3343995 Dec 21 04:16:37.009098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35810) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:37.013793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:37.150684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:37.154479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.414191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.478810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=5c0e333f-0fee-4ff1-8247-c7f31d4833c3,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:37.483843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': '0da62b4b-f2c7-4c56-aac7-08d0acba19cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:37.484206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: afbbec10-b9ce-49b6-b4fd-fab197e6c481, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:37.562103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:37.619438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, afbbec10-b9ce-49b6-b4fd-fab197e6c481) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:37.623824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:37.624813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.628756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85330e7b-c12d-4f8d-82ac-9ce954f4b0d3 None None] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:37.702140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dfeb0ed7-03cd-4a2f-9084-b178f3e90a07 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6921766 Dec 21 04:16:37.704949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35820) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:37.710318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1596401444', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:37.739818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-afbbec10-b9ce-49b6-b4fd-fab197e6c481', 'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': '5c0e333f-0fee-4ff1-8247-c7f31d4833c3'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:37.739818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.842630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.843768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.881405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Allocated IP 2001:db8::2 (afbbec10-b9ce-49b6-b4fd-fab197e6c481/5c0e333f-0fee-4ff1-8247-c7f31d4833c3/b49c7442-fcef-42a0-9752-27dcd5044003) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:37.902230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.937472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062b3445-1a37-4b2f-aa8e-5331bf3a39cf req-e292c44b-5714-49e5-9200-121929e7a620 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:37.939037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-062b3445-1a37-4b2f-aa8e-5331bf3a39cf req-e292c44b-5714-49e5-9200-121929e7a620 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1166923 Dec 21 04:16:37.985071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:37.989719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-062b3445-1a37-4b2f-aa8e-5331bf3a39cf req-6a8f359d-0346-4b10-baf9-b33112b9fe08 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434246 Dec 21 04:16:38.033026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.055703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.058221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9644e19c-b276-42e5-8dea-78a798a1915b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.3509295 Dec 21 04:16:38.059670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:38.094748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.135387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:38.138236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:38.141665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:38.147234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Pushing event updated for resources: {'Port': ['ID=b49c7442-fcef-42a0-9752-27dcd5044003,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:38.203519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Attempting to bind port b49c7442-fcef-42a0-9752-27dcd5044003 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:38.203802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Attempting to bind port b49c7442-fcef-42a0-9752-27dcd5044003 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0da62b4b-f2c7-4c56-aac7-08d0acba19cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:38.204135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Attempting to bind port b49c7442-fcef-42a0-9752-27dcd5044003 on network afbbec10-b9ce-49b6-b4fd-fab197e6c481 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:38.209429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:38.209960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Checking segment: {'id': '0da62b4b-f2c7-4c56-aac7-08d0acba19cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:38.210374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.210768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Bound using segment: {'id': '0da62b4b-f2c7-4c56-aac7-08d0acba19cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:38.211278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Bound port: b49c7442-fcef-42a0-9752-27dcd5044003, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0da62b4b-f2c7-4c56-aac7-08d0acba19cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'afbbec10-b9ce-49b6-b4fd-fab197e6c481'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:38.211693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.284376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] For port b49c7442-fcef-42a0-9752-27dcd5044003, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:38.288172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] For port b49c7442-fcef-42a0-9752-27dcd5044003, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b49c7442-fcef-42a0-9752-27dcd5044003,segment=NetworkSegment(0da62b4b-f2c7-4c56-aac7-08d0acba19cd),segment_id=0da62b4b-f2c7-4c56-aac7-08d0acba19cd)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:38.360109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.362151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:38.433587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb83fe4f-14aa-4ec6-9731-cdbcf926de21 None None] Pushing event updated for resources: {'Port': ['ID=b49c7442-fcef-42a0-9752-27dcd5044003,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:38.666273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8::1 (afbbec10-b9ce-49b6-b4fd-fab197e6c481/5c0e333f-0fee-4ff1-8247-c7f31d4833c3/4b7e781b-0a79-407e-b950-b287b2a7176e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:39.045119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.139457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd601362-fea1-4176-a33c-d72a5da2c75b req-203e3792-90b9-4c8f-a83b-07145ad05949 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:39.142571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd601362-fea1-4176-a33c-d72a5da2c75b req-203e3792-90b9-4c8f-a83b-07145ad05949 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0597277 Dec 21 04:16:39.162873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.203524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd601362-fea1-4176-a33c-d72a5da2c75b req-a183aa52-ce08-4b19-8a8a-01b074c926bc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0552120 Dec 21 04:16:39.215880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:39.229745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=4b7e781b-0a79-407e-b950-b287b2a7176e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:39.231804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:39.233816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:39.234360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.428547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.462673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fda4f0d-f5b4-46be-8eb3-dbe2c742504c None None] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:39.526651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b49c7442-fcef-42a0-9752-27dcd5044003 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:39.603804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-289fdeb1-ad31-4317-b6e3-3a7ec539b04a None None] Provisioning complete for port b49c7442-fcef-42a0-9752-27dcd5044003 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:39.604089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-289fdeb1-ad31-4317-b6e3-3a7ec539b04a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.653705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b49c7442-fcef-42a0-9752-27dcd5044003 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:39.653922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.739605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.761187 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-289fdeb1-ad31-4317-b6e3-3a7ec539b04a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.786732 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.796053 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.796980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.821532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-289fdeb1-ad31-4317-b6e3-3a7ec539b04a None None] For port b49c7442-fcef-42a0-9752-27dcd5044003, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b49c7442-fcef-42a0-9752-27dcd5044003,segment=NetworkSegment(0da62b4b-f2c7-4c56-aac7-08d0acba19cd),segment_id=0da62b4b-f2c7-4c56-aac7-08d0acba19cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:39.882523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-289fdeb1-ad31-4317-b6e3-3a7ec539b04a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:39.912873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=4b7e781b-0a79-407e-b950-b287b2a7176e,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:39.930484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:16:39.930846 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:16:39.952243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:39.954301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:39.983997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289fdeb1-ad31-4317-b6e3-3a7ec539b04a None None] Pushing event updated for resources: {'Port': ['ID=b49c7442-fcef-42a0-9752-27dcd5044003,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:40.009561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6bee3dfc-adc5-43b8-bdf4-38e8994d0fd7 None None] Provisioning complete for port 4b7e781b-0a79-407e-b950-b287b2a7176e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:40.010247 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6bee3dfc-adc5-43b8-bdf4-38e8994d0fd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:40.054643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6bee3dfc-adc5-43b8-bdf4-38e8994d0fd7 None None] Port 4b7e781b-0a79-407e-b950-b287b2a7176e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:40.065763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6bee3dfc-adc5-43b8-bdf4-38e8994d0fd7 None None] Provisioning complete for port b49c7442-fcef-42a0-9752-27dcd5044003 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:40.066401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6bee3dfc-adc5-43b8-bdf4-38e8994d0fd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:40.207563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 22f08be2-3bed-4e09-8c3a-6244934b230d is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:40.271877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-406ef6f3-b884-409e-88da-07e9fe30407b None None] Provisioning complete for port 4b7e781b-0a79-407e-b950-b287b2a7176e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:40.272388 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-406ef6f3-b884-409e-88da-07e9fe30407b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:40.326679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:40.336909 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aa34ab77-4979-451e-afdd-4384f7390b73 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/22f08be2-3bed-4e09-8c3a-6244934b230d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2715843 Dec 21 04:16:40.336909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35866) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:40.344033 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] Sync routers for ids ['22f08be2-3bed-4e09-8c3a-6244934b230d'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:40.347590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-406ef6f3-b884-409e-88da-07e9fe30407b None None] Port 4b7e781b-0a79-407e-b950-b287b2a7176e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:40.367486 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] Routers {'22f08be2-3bed-4e09-8c3a-6244934b230d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:40.369389 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['22f08be2-3bed-4e09-8c3a-6244934b230d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:40.371707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53d22e3-8a07-4a75-afc8-5e3ccd154ade req-2539914e-b058-4ca6-9238-ce72c7e468fc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:40.381346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f53d22e3-8a07-4a75-afc8-5e3ccd154ade req-2539914e-b058-4ca6-9238-ce72c7e468fc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0780163 Dec 21 04:16:40.417279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f97a04c-6c17-43b1-9f21-764cd96974c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:40.419355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8f97a04c-6c17-43b1-9f21-764cd96974c6 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports/4b7e781b-0a79-407e-b950-b287b2a7176e HTTP/1.1" status: 200 len: 911 time: 0.0832367 Dec 21 04:16:40.422128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35868) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:40.428102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '5c0e333f-0fee-4ff1-8247-c7f31d4833c3'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:40.453641 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:40.463765 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] Routers {'22f08be2-3bed-4e09-8c3a-6244934b230d'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:40.464390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['22f08be2-3bed-4e09-8c3a-6244934b230d'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:40.511169 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:40.511832 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7f3eadd-2f36-4bd9-a55f-3b5fc4a6bfc1 None None] The sync data for ids ['22f08be2-3bed-4e09-8c3a-6244934b230d'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:40.574440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bc5ab84f-42d2-42e3-a722-171aec655387 None None] Provisioning complete for port 4b7e781b-0a79-407e-b950-b287b2a7176e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:40.575094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc5ab84f-42d2-42e3-a722-171aec655387 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:40.625584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bc5ab84f-42d2-42e3-a722-171aec655387 None None] Port 4b7e781b-0a79-407e-b950-b287b2a7176e cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:40.645076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:40.787024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f53d22e3-8a07-4a75-afc8-5e3ccd154ade req-95396077-24f7-458f-8ce9-8e4380a74f72 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4040065 Dec 21 04:16:40.876022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35878) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:41.025823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c883142-e244-4aec-b0de-5f07ddebab73 req-5a8270c2-4ec8-40d1-b1bd-7878b7654d7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:41.027913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c883142-e244-4aec-b0de-5f07ddebab73 req-5a8270c2-4ec8-40d1-b1bd-7878b7654d7b service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1098 time: 0.1503642 Dec 21 04:16:41.062198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.074572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c883142-e244-4aec-b0de-5f07ddebab73 req-006cae28-dae5-4cc9-b3e8-a8eb07457ff4 service neutron] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409229 Dec 21 04:16:41.139182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.145233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:41.146344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.147691 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/ports/4b7e781b-0a79-407e-b950-b287b2a7176e HTTP/1.1" status: 200 len: 911 time: 0.7245190 Dec 21 04:16:41.150683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35886) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:41.260429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02eea8f7-1edc-4353-b33f-8c25e950c5cd tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=4b7e781b-0a79-407e-b950-b287b2a7176e,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:41.472858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b49c7442-fcef-42a0-9752-27dcd5044003 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:41.533825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b49c7442-fcef-42a0-9752-27dcd5044003 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:41.534310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.603537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.877787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 4b7e781b-0a79-407e-b950-b287b2a7176e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:41.878234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.938415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdc7acdd-c5b3-408d-8c58-4152638e8ad6 req-9d499f5e-9b86-48c7-ba71-935be0fe4f8e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:41.940062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdc7acdd-c5b3-408d-8c58-4152638e8ad6 req-9d499f5e-9b86-48c7-ba71-935be0fe4f8e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0687973 Dec 21 04:16:41.975018 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:41.987671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 4b7e781b-0a79-407e-b950-b287b2a7176e owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:41.995468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdc7acdd-c5b3-408d-8c58-4152638e8ad6 req-c2b8cbbb-8959-4388-ace5-69d0c7044285 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471096 Dec 21 04:16:42.224537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.252332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=4b7e781b-0a79-407e-b950-b287b2a7176e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:42.351386 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.520969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 22f08be2-3bed-4e09-8c3a-6244934b230d has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:42.596771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:42.606749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cc0434c5-42d2-45ce-8be2-befe3c475e7b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/22f08be2-3bed-4e09-8c3a-6244934b230d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4501388 Dec 21 04:16:42.607774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] Sync routers for ids ['22f08be2-3bed-4e09-8c3a-6244934b230d'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:42.608858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:42.617892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] Routers {'22f08be2-3bed-4e09-8c3a-6244934b230d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:42.618021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['22f08be2-3bed-4e09-8c3a-6244934b230d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:42.637869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-285a405f-55a6-4137-9015-2b1c69b5d945 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=22f08be2-3bed-4e09-8c3a-6244934b230d HTTP/1.1" status: 200 len: 205 time: 0.0275331 Dec 21 04:16:42.642840 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35922) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:42.653250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:42.662316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] Routers {'22f08be2-3bed-4e09-8c3a-6244934b230d'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:42.663222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['22f08be2-3bed-4e09-8c3a-6244934b230d'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:42.695029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:42.695692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-908673ab-32ac-4583-9bab-6bcf0061e7b3 None None] The sync data for ids ['22f08be2-3bed-4e09-8c3a-6244934b230d'] in n-d-822053-11 is: [] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:42.726976 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.885159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.887198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.979013 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.979662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router 22f08be2-3bed-4e09-8c3a-6244934b230d {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:16:42.986642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:42.987759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8d84cae-e4cf-4ece-bc11-3841a6fd85b9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/22f08be2-3bed-4e09-8c3a-6244934b230d HTTP/1.1" status: 204 len: 168 time: 0.3439014 Dec 21 04:16:42.990828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35928) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:43.052776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet 5c0e333f-0fee-4ff1-8247-c7f31d4833c3 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:16:43.056439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.127857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.171801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8599541-1449-4bfd-8fac-cf1141a53584 req-3940f83b-ce79-4832-97ae-cfb47cdead40 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:43.173283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8599541-1449-4bfd-8fac-cf1141a53584 req-3940f83b-ce79-4832-97ae-cfb47cdead40 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0952761 Dec 21 04:16:43.255449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.261341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8599541-1449-4bfd-8fac-cf1141a53584 req-2ae9899a-b82f-4608-94aa-9d0253e37004 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0794904 Dec 21 04:16:43.374048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.402585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=5c0e333f-0fee-4ff1-8247-c7f31d4833c3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:43.414530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.420944 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a3f62a4f-15c9-41c8-a46d-423bcee31fa9 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/5c0e333f-0fee-4ff1-8247-c7f31d4833c3 HTTP/1.1" status: 204 len: 168 time: 0.4259720 Dec 21 04:16:43.420944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:43.428951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b785f12-c1a0-46e4-8934-d9db4e8e74ed None None] Network afbbec10-b9ce-49b6-b4fd-fab197e6c481 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:43.503513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.571958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port b49c7442-fcef-42a0-9752-27dcd5044003 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:43.572364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.585338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] DHCP port deletion for afbbec10-b9ce-49b6-b4fd-fab197e6c481 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:16:43.632026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] Deleting port b49c7442-fcef-42a0-9752-27dcd5044003 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:16:43.632667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.636591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port b49c7442-fcef-42a0-9752-27dcd5044003, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b49c7442-fcef-42a0-9752-27dcd5044003,segment=NetworkSegment(0da62b4b-f2c7-4c56-aac7-08d0acba19cd),segment_id=0da62b4b-f2c7-4c56-aac7-08d0acba19cd)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:43.636945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.650307 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for b49c7442-fcef-42a0-9752-27dcd5044003 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:43.697254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] For port b49c7442-fcef-42a0-9752-27dcd5044003, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b49c7442-fcef-42a0-9752-27dcd5044003,segment=NetworkSegment(0da62b4b-f2c7-4c56-aac7-08d0acba19cd),segment_id=0da62b4b-f2c7-4c56-aac7-08d0acba19cd)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:43.697524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.710570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] Calling delete_port for b49c7442-fcef-42a0-9752-27dcd5044003 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:16:43.796171 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.805538 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.829439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=b49c7442-fcef-42a0-9752-27dcd5044003,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:43.833191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port b49c7442-fcef-42a0-9752-27dcd5044003 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:43.834399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] Pushing event deleted for resources: {'Port': ['ID=b49c7442-fcef-42a0-9752-27dcd5044003,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:43.837985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0091a32-ab1b-44dd-a32f-5ade00c96867 None None] No DVR routers for this DVR port b49c7442-fcef-42a0-9752-27dcd5044003 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:16:43.919950 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.940555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['afbbec10-b9ce-49b6-b4fd-fab197e6c481']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:43.950827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0da62b4b-f2c7-4c56-aac7-08d0acba19cd') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:43.951237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0da62b4b-f2c7-4c56-aac7-08d0acba19cd') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:43.961803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.974714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.983427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 129 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:16:43.983427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:16:43.984163 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:16:44.084812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:16:44.119262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.129172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.134154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/afbbec10-b9ce-49b6-b4fd-fab197e6c481 HTTP/1.1" status: 204 len: 168 time: 0.7123744 Dec 21 04:16:44.138666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35958) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:44.154039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-958861071', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:44.160557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324ca956-ecbf-4a3d-b5ac-b00907230f16 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=afbbec10-b9ce-49b6-b4fd-fab197e6c481,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:44.210135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:44.224682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'mac_address': 'fa:16:3e:75:f1:18', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:16:44.268831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.277451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.279400 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.294804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id ac11126b-e25e-4a58-b9ab-db17cde3b083 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:16:44.328107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:44.384393 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.413791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.433268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36b55c56-81bb-46bc-882f-5c6279c54309 req-db6ca774-b0a9-442e-bc45-24a1b8c3e22c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:44.434866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36b55c56-81bb-46bc-882f-5c6279c54309 req-db6ca774-b0a9-442e-bc45-24a1b8c3e22c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0616498 Dec 21 04:16:44.481715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:44.485495 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.523279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-36b55c56-81bb-46bc-882f-5c6279c54309 req-0f2fab21-0186-4377-8107-9e77b73a2bbb tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0800695 Dec 21 04:16:44.575005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ac11126b-e25e-4a58-b9ab-db17cde3b083'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:16:44.575300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.576494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1cfaf0fb-41ba-4ad6-b6e0-5986dc920e0f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.4367695 Dec 21 04:16:44.579256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 35978) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:44.591221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1110913763'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:44.744410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:44.747961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.770812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:44.779607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.779954 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment 3fc3ce7f-e93c-4630-830b-3cbd04bac2c1 of type vlan for network 5f387254-f515-4b9c-82e8-24cd1ae33644 Dec 21 04:16:44.820244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.882126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.889345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:44.890005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:44.979473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 35994) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:44.980072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.3992178 Dec 21 04:16:44.980444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbc2ee7-6a56-4fb5-a74b-77486373e130 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=5f387254-f515-4b9c-82e8-24cd1ae33644,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:44.987074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:44.991961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:45.192598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:45.196478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:45.496921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b49c7442-fcef-42a0-9752-27dcd5044003 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:16:45.510745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:45.548843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b49c7442-fcef-42a0-9752-27dcd5044003 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:16:45.549481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b49c7442-fcef-42a0-9752-27dcd5044003 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:16:45.591709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=1516c5d5-40ed-4ede-b48a-32897eb2e1f9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:45.627765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:45.628288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: 5f387254-f515-4b9c-82e8-24cd1ae33644, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:45.683188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779335cf-6c67-48e4-b61d-40b1a7151c68 req-816d7584-7d68-4934-bfb4-48152f06dbe4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:45.684718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-779335cf-6c67-48e4-b61d-40b1a7151c68 req-816d7584-7d68-4934-bfb4-48152f06dbe4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 945 time: 0.0594335 Dec 21 04:16:45.733349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:45.758078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-779335cf-6c67-48e4-b61d-40b1a7151c68 req-29e651fd-cb14-4fb8-8d05-129a80651bbd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0672688 Dec 21 04:16:45.804468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5f387254-f515-4b9c-82e8-24cd1ae33644) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:45.824126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b3e726f-e52f-47a3-b405-3e3802d2431a None None] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:45.825456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:45.826077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:45.895017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aa004222-6cb9-4941-9e2d-1b999c7b1d06 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.9101832 Dec 21 04:16:45.896622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36008) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:45.963124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5f387254-f515-4b9c-82e8-24cd1ae33644', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:45.964287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.252477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.264652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:46.315282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Allocated IP 2001:db8::2 (5f387254-f515-4b9c-82e8-24cd1ae33644/1516c5d5-40ed-4ede-b48a-32897eb2e1f9/ab36505c-84b4-4c59-a65a-1d2014a30669) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:46.417864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port ac11126b-e25e-4a58-b9ab-db17cde3b083 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:46.418250 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.576469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.599963 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.618020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:16:46.620499 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9095f475-57fd-490f-b9b1-2a2d3dd950ac" -d '{"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-plugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:16:46.637714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:46.665334 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:16:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6bf6a7e2-33cd-4105-a9c5-ee42e1669093 x-openstack-request-id: req-6bf6a7e2-33cd-4105-a9c5-ee42e1669093 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:16:46.665730 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-plugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:16:46.666090 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6bf6a7e2-33cd-4105-a9c5-ee42e1669093 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:16:46.666650 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'code': 200} Dec 21 04:16:46.696516 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.736690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.767110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:46.767373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8::1 (5f387254-f515-4b9c-82e8-24cd1ae33644/1516c5d5-40ed-4ede-b48a-32897eb2e1f9/b2810c04-1466-47fe-8b17-c75bc444de52) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:46.774787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:46.784148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:46.787366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Pushing event updated for resources: {'Port': ['ID=ab36505c-84b4-4c59-a65a-1d2014a30669,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:46.852790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:46.937422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Attempting to bind port ab36505c-84b4-4c59-a65a-1d2014a30669 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:46.937997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Attempting to bind port ab36505c-84b4-4c59-a65a-1d2014a30669 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:46.938473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Attempting to bind port ab36505c-84b4-4c59-a65a-1d2014a30669 on network 5f387254-f515-4b9c-82e8-24cd1ae33644 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:46.945579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:46.946125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Checking segment: {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:46.947219 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.947728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Bound using segment: {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:46.948313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Bound port: ab36505c-84b4-4c59-a65a-1d2014a30669, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:46.949301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.952273 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:46.972014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9098acca-724b-4335-b2e4-2898234a7773 req-8a6da7b3-4300-46ea-8cc3-9d1bff06e851 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:46.973575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9098acca-724b-4335-b2e4-2898234a7773 req-8a6da7b3-4300-46ea-8cc3-9d1bff06e851 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0926375 Dec 21 04:16:47.023787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] For port ab36505c-84b4-4c59-a65a-1d2014a30669, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:47.028659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] For port ab36505c-84b4-4c59-a65a-1d2014a30669, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab36505c-84b4-4c59-a65a-1d2014a30669,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:47.064158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9098acca-724b-4335-b2e4-2898234a7773 req-17b4842d-eade-44b0-a164-108a4eef1e29 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0724177 Dec 21 04:16:47.128093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:47.150891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:47.207304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8883eb81-78be-402c-a666-ba103c419a6e None None] Pushing event updated for resources: {'Port': ['ID=ab36505c-84b4-4c59-a65a-1d2014a30669,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:47.242097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=b2810c04-1466-47fe-8b17-c75bc444de52,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:47.274140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:47.279335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:47.288758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:47.289344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:47.570301 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:47.956625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.024753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.024753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.160869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=b2810c04-1466-47fe-8b17-c75bc444de52,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:48.282690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4e34c3-934b-4817-8836-643c7e89c889 req-88c6e87e-dae0-4c5f-8650-cee7a65518d7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:48.286296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a4e34c3-934b-4817-8836-643c7e89c889 req-88c6e87e-dae0-4c5f-8650-cee7a65518d7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1066554 Dec 21 04:16:48.293012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:48.294807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:48.424277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a4e34c3-934b-4817-8836-643c7e89c889 req-17398d5c-cb5f-48be-aaa0-d961bd361888 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1196542 Dec 21 04:16:48.569782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:16:48.625932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0693e88-0257-441d-b899-fc0c7243efe4 None None] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:48.683089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:48.692496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c642571f-79a5-471c-9ed4-9006a08e9721 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7953601 Dec 21 04:16:48.694818 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:48.695292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36044) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:48.710889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-21456191'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:48.713959 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:48.714960 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:48.778643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ce45acc1-e2f7-42b5-a7a2-f47662bf1cba None None] Provisioning complete for port ab36505c-84b4-4c59-a65a-1d2014a30669 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:48.779196 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce45acc1-e2f7-42b5-a7a2-f47662bf1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.849772 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:48.868976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:48.872584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.885797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce45acc1-e2f7-42b5-a7a2-f47662bf1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.935100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:48.949104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ce45acc1-e2f7-42b5-a7a2-f47662bf1cba None None] For port ab36505c-84b4-4c59-a65a-1d2014a30669, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab36505c-84b4-4c59-a65a-1d2014a30669,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:48.969952 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:48.970298 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment 0cd9b1fb-b1aa-4222-b755-40f4b1918a40 of type vlan for network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee Dec 21 04:16:49.027084 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.081893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce45acc1-e2f7-42b5-a7a2-f47662bf1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.133448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.141096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:49.141827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.164010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:47Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:47Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:49.181236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce45acc1-e2f7-42b5-a7a2-f47662bf1cba None None] Pushing event updated for resources: {'Port': ['ID=ab36505c-84b4-4c59-a65a-1d2014a30669,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:49.227547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ac046aca-a738-4047-a19d-0240baecba57 None None] Provisioning complete for port b2810c04-1466-47fe-8b17-c75bc444de52 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:49.227913 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac046aca-a738-4047-a19d-0240baecba57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.240520 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:16:49.243054 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Updating router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 port b2810c04-1466-47fe-8b17-c75bc444de52 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:16:49.301922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ac046aca-a738-4047-a19d-0240baecba57 None None] Port b2810c04-1466-47fe-8b17-c75bc444de52 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:49.306272 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.306420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:49.322694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:49.375803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36052) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:49.376353 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1efe727-755f-4598-94e1-e106c3c34a34 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6796882 Dec 21 04:16:49.383808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ac046aca-a738-4047-a19d-0240baecba57 None None] Provisioning complete for port ab36505c-84b4-4c59-a65a-1d2014a30669 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:49.384682 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac046aca-a738-4047-a19d-0240baecba57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.384809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:49.648290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab36505c-84b4-4c59-a65a-1d2014a30669 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:49.693666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:49.696042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.741284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ab36505c-84b4-4c59-a65a-1d2014a30669 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:49.741521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.874108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d983f002-2c12-40ea-b21c-749e22f6fb17 None None] Provisioning complete for port b2810c04-1466-47fe-8b17-c75bc444de52 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:49.878975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d983f002-2c12-40ea-b21c-749e22f6fb17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.922961 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.933853 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d983f002-2c12-40ea-b21c-749e22f6fb17 None None] Port b2810c04-1466-47fe-8b17-c75bc444de52 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:49.938065 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4b04b9e-f179-442f-8f0e-f1034c76816a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:49.991488 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.164333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f15117dd-a8a7-4dcc-92ea-621604843244 None None] Provisioning complete for port b2810c04-1466-47fe-8b17-c75bc444de52 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:50.169465 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f15117dd-a8a7-4dcc-92ea-621604843244 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.225846 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Pushing event updated for resources: {'Port': ['ID=b2810c04-1466-47fe-8b17-c75bc444de52,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:50.240063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f15117dd-a8a7-4dcc-92ea-621604843244 None None] Port b2810c04-1466-47fe-8b17-c75bc444de52 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:50.249512 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.249867 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.250211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.250552 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.250887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.251253 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.251583 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.251923 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.252241 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.252617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.252946 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.253265 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.253587 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:16:50.288664 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Attempting to bind port b2810c04-1466-47fe-8b17-c75bc444de52 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:50.289193 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Attempting to bind port b2810c04-1466-47fe-8b17-c75bc444de52 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:50.289653 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Attempting to bind port b2810c04-1466-47fe-8b17-c75bc444de52 on network 5f387254-f515-4b9c-82e8-24cd1ae33644 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:50.296854 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:50.297539 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Checking segment: {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:50.298045 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.298675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Bound using segment: {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:50.299303 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Bound port: b2810c04-1466-47fe-8b17-c75bc444de52, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:50.299776 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.321053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0c6160-d17e-4214-85a6-eef7dc6b7988 req-c67f2844-f605-48ef-861b-195e7acd006d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:50.331043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce0c6160-d17e-4214-85a6-eef7dc6b7988 req-c67f2844-f605-48ef-861b-195e7acd006d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.7275281 Dec 21 04:16:50.378476 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] For port b2810c04-1466-47fe-8b17-c75bc444de52, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:50.382221 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] For port b2810c04-1466-47fe-8b17-c75bc444de52, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2810c04-1466-47fe-8b17-c75bc444de52,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:50.463700 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce0c6160-d17e-4214-85a6-eef7dc6b7988 req-dcbee1fc-0445-4efc-87b0-348d051fa98c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1314623 Dec 21 04:16:50.481885 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.552198 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:50.553220 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:50.556362 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2be3cc3-db69-4139-b00a-a185bfbdd1c2 None None] Pushing event updated for resources: {'Port': ['ID=b2810c04-1466-47fe-8b17-c75bc444de52,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:50.674296 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:50.691767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3d6ef7c4-12d2-42d8-937e-ff0dca120da4 None None] Provisioning complete for port b2810c04-1466-47fe-8b17-c75bc444de52 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:50.692298 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d6ef7c4-12d2-42d8-937e-ff0dca120da4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.784576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.842215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d6ef7c4-12d2-42d8-937e-ff0dca120da4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:50.885487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:50.885910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:50.891029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=366e22cc-23c7-4f8a-b45d-18713d1ac225,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:50.972268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3d6ef7c4-12d2-42d8-937e-ff0dca120da4 None None] For port b2810c04-1466-47fe-8b17-c75bc444de52, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2810c04-1466-47fe-8b17-c75bc444de52,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:50.984538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:51.030366 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:47Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:51.041924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3d6ef7c4-12d2-42d8-937e-ff0dca120da4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:51.062509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4449b51a-f322-4c7a-a8af-5370e2b122f6 None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:47Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:51.076205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:51.081680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:51.083431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:51.110111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b9af2eb-ffdd-4546-ac31-614066eb15c0 None None] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:51.177969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d6ef7c4-12d2-42d8-937e-ff0dca120da4 None None] Pushing event updated for resources: {'Port': ['ID=b2810c04-1466-47fe-8b17-c75bc444de52,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:51.206704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-836a5360-76ac-4845-afc7-d56418c632c2 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.8264699 Dec 21 04:16:51.207061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36072) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:51.249902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-53ccca44-7b11-4805-985f-f0917f16c35a None None] Provisioning complete for port b2810c04-1466-47fe-8b17-c75bc444de52 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:51.250580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-53ccca44-7b11-4805-985f-f0917f16c35a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:51.324916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:51.325895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:51.695722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Allocated IP 2001:db8:1::2 (12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee/366e22cc-23c7-4f8a-b45d-18713d1ac225/692d8ea2-3d3e-41e0-84e8-e11168c1969b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:51.772985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38e243f-3f01-49d0-8533-a6c029f5047e req-27bde346-da7d-4bec-87d1-bac2ec7a783b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:51.780708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c38e243f-3f01-49d0-8533-a6c029f5047e req-27bde346-da7d-4bec-87d1-bac2ec7a783b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1300735 Dec 21 04:16:51.897956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c38e243f-3f01-49d0-8533-a6c029f5047e req-01ea9cce-03fe-478e-9114-6d52b7c8e7d5 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1162097 Dec 21 04:16:51.931045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.024164 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.093863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.167665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:52.171192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:52.178776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:52.243563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Pushing event updated for resources: {'Port': ['ID=692d8ea2-3d3e-41e0-84e8-e11168c1969b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:52.275646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Attempting to bind port 692d8ea2-3d3e-41e0-84e8-e11168c1969b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:52.276028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Attempting to bind port 692d8ea2-3d3e-41e0-84e8-e11168c1969b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:52.276400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Attempting to bind port 692d8ea2-3d3e-41e0-84e8-e11168c1969b on network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:52.282687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:52.283149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Checking segment: {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:52.283510 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.283912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Bound using segment: {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:52.284390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Bound port: 692d8ea2-3d3e-41e0-84e8-e11168c1969b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:52.284788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.353709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8:1::1 (12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee/366e22cc-23c7-4f8a-b45d-18713d1ac225/653ea226-1be5-4ebf-a074-d952bc71d0bd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:52.427346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] For port 692d8ea2-3d3e-41e0-84e8-e11168c1969b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:52.430238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] For port 692d8ea2-3d3e-41e0-84e8-e11168c1969b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=692d8ea2-3d3e-41e0-84e8-e11168c1969b,segment=NetworkSegment(0cd9b1fb-b1aa-4222-b755-40f4b1918a40),segment_id=0cd9b1fb-b1aa-4222-b755-40f4b1918a40)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:52.502328 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.528883 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.627573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c5f72c-20c3-48d3-aeb3-e04b0367a910 None None] Pushing event updated for resources: {'Port': ['ID=692d8ea2-3d3e-41e0-84e8-e11168c1969b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:52.637666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.703137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=653ea226-1be5-4ebf-a074-d952bc71d0bd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:52.728882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:52.731978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:52.733126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:52.733876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.735441 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a3c1e9a-3107-4787-8c46-94218a048238 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.970087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:52.997022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:53.208875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b4da12-bab1-49ba-bd6b-7b1bb99ee997 req-3833708c-b84f-4686-b559-799fbdf601bd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:53.214391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6b4da12-bab1-49ba-bd6b-7b1bb99ee997 req-3833708c-b84f-4686-b559-799fbdf601bd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1728995 Dec 21 04:16:53.316532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:53.369728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6b4da12-bab1-49ba-bd6b-7b1bb99ee997 req-973b262e-8cfc-40da-a1f8-584c6c7b0a3f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1462138 Dec 21 04:16:53.476183 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:53.536741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:53.536741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:53.666049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=653ea226-1be5-4ebf-a074-d952bc71d0bd,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:53.687388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2810c04-1466-47fe-8b17-c75bc444de52 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:53.767069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:53.768731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:53.831031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b2810c04-1466-47fe-8b17-c75bc444de52 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:53.832151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:53.935217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:16:53.991224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 692d8ea2-3d3e-41e0-84e8-e11168c1969b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:54.052988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 692d8ea2-3d3e-41e0-84e8-e11168c1969b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:54.053421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.057870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:16:54.063512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-edd98635-29bd-40cb-9339-052acf3630b0 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8546953 Dec 21 04:16:54.066204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36106) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:54.071797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1854291666'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:54.083184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:16:54.110421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:54.111547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:54.240257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:54.258725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:54.264975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.273017 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.281299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6fe55dd-c4fe-4a35-8a7b-1859b57e9d2b None None] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:54.306185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:16:54.315969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.316330 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment bc7e4204-4ce6-429e-8c41-6f1be139b017 of type vlan for network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 Dec 21 04:16:54.357830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.443203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.449860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:54.453581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:54.601740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:54.619958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4a34034d-12a4-4021-8b11-e95cfb95a929 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5503066 Dec 21 04:16:54.621125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:54.626482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:16:54.659570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a295ce-b103-4583-8adf-4b50d1f1f1bb req-09983b85-21e2-45ce-ab5f-32377a629183 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:54.667752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5a295ce-b103-4583-8adf-4b50d1f1f1bb req-09983b85-21e2-45ce-ab5f-32377a629183 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1335037 Dec 21 04:16:54.688271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 692d8ea2-3d3e-41e0-84e8-e11168c1969b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=692d8ea2-3d3e-41e0-84e8-e11168c1969b,segment=NetworkSegment(0cd9b1fb-b1aa-4222-b755-40f4b1918a40),segment_id=0cd9b1fb-b1aa-4222-b755-40f4b1918a40)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:54.691309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:16:54.753777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5a295ce-b103-4583-8adf-4b50d1f1f1bb req-e4d1a46a-9b4e-4360-9bb1-c2998be7bee8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790055 Dec 21 04:16:54.925144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.002288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d8a9fc62-bbf0-4a23-97e6-ba46f0096a1e None None] Provisioning complete for port 692d8ea2-3d3e-41e0-84e8-e11168c1969b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:55.002667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a9fc62-bbf0-4a23-97e6-ba46f0096a1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.141716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.143427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=692d8ea2-3d3e-41e0-84e8-e11168c1969b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:55.150480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:52Z', 'revision_number': 3, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:53Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:55.197347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.198762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:16:55.199157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Updating router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 port 653ea226-1be5-4ebf-a074-d952bc71d0bd binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:16:55.252686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:16:55.257394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.287548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.621413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 692d8ea2-3d3e-41e0-84e8-e11168c1969b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:55.678516 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.762786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3aa10be0-d198-46ac-a3b3-d850cbe72d81 None None] Provisioning complete for port 692d8ea2-3d3e-41e0-84e8-e11168c1969b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:55.763373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3aa10be0-d198-46ac-a3b3-d850cbe72d81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.844972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:55.845839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:16:55.856554 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.875990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=79b89a53-4402-4b83-b14f-d2deb08e98fd,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:55.903673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.927050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 692d8ea2-3d3e-41e0-84e8-e11168c1969b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:55.928102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:55.957216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:16:55.994364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.008969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ce13d4-d3ff-4e53-978a-aa98cf9b9169 req-39851229-a158-441d-88fc-b14031da951f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:56.011288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95ce13d4-d3ff-4e53-978a-aa98cf9b9169 req-39851229-a158-441d-88fc-b14031da951f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1117704 Dec 21 04:16:56.043101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:56.051885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:56.052803 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.118857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95ce13d4-d3ff-4e53-978a-aa98cf9b9169 req-ac7d792a-b444-46ce-ac06-816370d74e85 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0965617 Dec 21 04:16:56.141120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21b2b92-1df2-4f70-84d6-46d820b750f3 None None] Pushing event updated for resources: {'Port': ['ID=653ea226-1be5-4ebf-a074-d952bc71d0bd,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:56.148991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5ee905a-a5d4-405b-8f4b-7d50b5c8e585 None None] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:16:56.159579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c024056-0bb7-4a54-a98a-99f3c0188e9f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.5342338 Dec 21 04:16:56.159933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36136) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:16:56.337931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3aa10be0-d198-46ac-a3b3-d850cbe72d81 None None] Provisioning complete for port 653ea226-1be5-4ebf-a074-d952bc71d0bd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:56.338307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3aa10be0-d198-46ac-a3b3-d850cbe72d81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.409077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Attempting to bind port 653ea226-1be5-4ebf-a074-d952bc71d0bd on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:56.412362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Attempting to bind port 653ea226-1be5-4ebf-a074-d952bc71d0bd by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:56.412362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Attempting to bind port 653ea226-1be5-4ebf-a074-d952bc71d0bd on network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:56.428337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3aa10be0-d198-46ac-a3b3-d850cbe72d81 None None] Port 653ea226-1be5-4ebf-a074-d952bc71d0bd cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:16:56.462955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:56.463425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Checking segment: {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:56.468453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.468453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Bound using segment: {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:56.468453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Bound port: 653ea226-1be5-4ebf-a074-d952bc71d0bd, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0cd9b1fb-b1aa-4222-b755-40f4b1918a40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:56.468453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.483417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:16:56.484325 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.557713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] For port 653ea226-1be5-4ebf-a074-d952bc71d0bd, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:56.563634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] For port 653ea226-1be5-4ebf-a074-d952bc71d0bd, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=653ea226-1be5-4ebf-a074-d952bc71d0bd,segment=NetworkSegment(0cd9b1fb-b1aa-4222-b755-40f4b1918a40),segment_id=0cd9b1fb-b1aa-4222-b755-40f4b1918a40)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:56.636514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c97ea1c1-4b98-44a3-8fa8-a2d388000d7d None None] Provisioning complete for port 653ea226-1be5-4ebf-a074-d952bc71d0bd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:56.636898 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c97ea1c1-4b98-44a3-8fa8-a2d388000d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.667619 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.866089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-0c287f90-6bc3-4308-9362-b6eed5f91652 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1258996 Dec 21 04:16:56.888763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:56.934357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21b2b92-1df2-4f70-84d6-46d820b750f3 None None] Pushing event updated for resources: {'Port': ['ID=653ea226-1be5-4ebf-a074-d952bc71d0bd,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:56.961159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:16:56.961956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:57.189021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c51644-0967-402e-a753-168925173e27 req-3734e300-4041-4ae6-917f-019cb911b726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:57.190659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-3734e300-4041-4ae6-917f-019cb911b726 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1097 time: 0.1513047 Dec 21 04:16:57.360747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c97ea1c1-4b98-44a3-8fa8-a2d388000d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:57.377027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Allocated IP 2001:db8:2::2 (5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6/79b89a53-4402-4b83-b14f-d2deb08e98fd/5e338df6-2c90-4a1b-92a7-213b2f278d76) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:57.432681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5129ba4a-2e2a-4b53-8503-54690b5dec49 req-fe10f697-0375-45d5-8d03-d1cf16ee54e9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:57.442642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5129ba4a-2e2a-4b53-8503-54690b5dec49 req-fe10f697-0375-45d5-8d03-d1cf16ee54e9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1813784 Dec 21 04:16:57.447574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:16:57.454406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c97ea1c1-4b98-44a3-8fa8-a2d388000d7d None None] For port 653ea226-1be5-4ebf-a074-d952bc71d0bd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=653ea226-1be5-4ebf-a074-d952bc71d0bd,segment=NetworkSegment(0cd9b1fb-b1aa-4222-b755-40f4b1918a40),segment_id=0cd9b1fb-b1aa-4222-b755-40f4b1918a40)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:16:57.530573 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c97ea1c1-4b98-44a3-8fa8-a2d388000d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:57.573424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c51644-0967-402e-a753-168925173e27 req-4a98ed54-6fb4-45b9-a46a-9888f62723ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:57.574694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-4a98ed54-6fb4-45b9-a46a-9888f62723ee service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.3377402 Dec 21 04:16:57.585425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5129ba4a-2e2a-4b53-8503-54690b5dec49 req-47ab3f33-8c10-4175-b7bf-fe2083278313 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1415262 Dec 21 04:16:57.652189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-e7331217-a265-47fe-95b6-7efe38e459ff service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1001 time: 0.0651524 Dec 21 04:16:57.727077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c51644-0967-402e-a753-168925173e27 req-b4725d2f-19c3-4130-97dc-258b97fb5180 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:57.729317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-b4725d2f-19c3-4130-97dc-258b97fb5180 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0666943 Dec 21 04:16:57.762713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97ea1c1-4b98-44a3-8fa8-a2d388000d7d None None] Pushing event updated for resources: {'Port': ['ID=653ea226-1be5-4ebf-a074-d952bc71d0bd,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:57.800278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6200172a-ff23-484c-8d55-084154b72518 None None] Provisioning complete for port 653ea226-1be5-4ebf-a074-d952bc71d0bd triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:57.800816 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6200172a-ff23-484c-8d55-084154b72518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:57.832357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c51644-0967-402e-a753-168925173e27 req-237f8cb9-7ab3-4460-a0be-3b6e320ff016 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:57.835502 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-237f8cb9-7ab3-4460-a0be-3b6e320ff016 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0987732 Dec 21 04:16:57.930508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:57.970712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-d2a47df9-d1ec-4089-b9b0-342e2843b715 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218109 Dec 21 04:16:57.996954 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:58.062473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:52Z', 'revision_number': 3, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:56Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:16:58.128905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac6735-69b1-4a1a-a53d-002c298a345c None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:52Z', 'revision_number': 3, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:56Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:16:58.140875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:58.146030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:58.151635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:58.161799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Pushing event updated for resources: {'Port': ['ID=5e338df6-2c90-4a1b-92a7-213b2f278d76,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:58.276001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Attempting to bind port 5e338df6-2c90-4a1b-92a7-213b2f278d76 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:16:58.276379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Attempting to bind port 5e338df6-2c90-4a1b-92a7-213b2f278d76 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:16:58.276750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Attempting to bind port 5e338df6-2c90-4a1b-92a7-213b2f278d76 on network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:16:58.282829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:16:58.284057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Checking segment: {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:16:58.284475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:58.284869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Bound using segment: {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:16:58.285351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Bound port: 5e338df6-2c90-4a1b-92a7-213b2f278d76, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:16:58.285773 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:58.388564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] For port 5e338df6-2c90-4a1b-92a7-213b2f278d76, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:16:58.392255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] For port 5e338df6-2c90-4a1b-92a7-213b2f278d76, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5e338df6-2c90-4a1b-92a7-213b2f278d76,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:16:58.482506 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:58.570810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36021b3-3506-4f40-8d1b-f2c42018ebdd None None] Pushing event updated for resources: {'Port': ['ID=5e338df6-2c90-4a1b-92a7-213b2f278d76,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:58.660424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8:2::1 (5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6/79b89a53-4402-4b83-b14f-d2deb08e98fd/96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:16:58.762752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49c51644-0967-402e-a753-168925173e27 req-914ff53e-598a-4491-aa5d-2ece942cef81 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7798111 Dec 21 04:16:59.053770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844ffb7b-a816-4caf-af40-867b7765bc1c req-21a6626b-e8ea-4395-8e00-b63590c5de3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:16:59.055404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-844ffb7b-a816-4caf-af40-867b7765bc1c req-21a6626b-e8ea-4395-8e00-b63590c5de3d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.3230453 Dec 21 04:16:59.178978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-844ffb7b-a816-4caf-af40-867b7765bc1c req-ca8b346f-276b-4d0e-986d-ac2a2312d6cb tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1160200 Dec 21 04:16:59.214874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:59.506268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:59.569849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:16:59.573114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:16:59.577059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:16:59.577841 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:59.599052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 653ea226-1be5-4ebf-a074-d952bc71d0bd up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:59.620224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:16:59.704531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 653ea226-1be5-4ebf-a074-d952bc71d0bd triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:59.705106 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:59.840152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:16:59.902063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5e338df6-2c90-4a1b-92a7-213b2f278d76 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:16:59.973689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 5e338df6-2c90-4a1b-92a7-213b2f278d76 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:16:59.974222 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.062613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.112983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 5e338df6-2c90-4a1b-92a7-213b2f278d76, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5e338df6-2c90-4a1b-92a7-213b2f278d76,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:00.181515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.234269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a7c707b-3b4d-4eea-83fd-fb1e26251abf None None] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:00.269181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.356591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.361540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.445259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:00.481710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=5e338df6-2c90-4a1b-92a7-213b2f278d76,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:00.491813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6a9f462f-f66b-4f72-883a-584fa0a3484c None None] Provisioning complete for port 5e338df6-2c90-4a1b-92a7-213b2f278d76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:00.492194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6a9f462f-f66b-4f72-883a-584fa0a3484c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:00.493924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6662ad8-fc52-4b92-b03f-01377fb87c48 req-6f4d0721-52f4-4908-b0a4-b8eef0e694e8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:00.495739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6662ad8-fc52-4b92-b03f-01377fb87c48 req-6f4d0721-52f4-4908-b0a4-b8eef0e694e8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.2026963 Dec 21 04:17:00.611673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6662ad8-fc52-4b92-b03f-01377fb87c48 req-fec250e3-a5f8-454c-a3d2-ea2dcb89683a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0859210 Dec 21 04:17:00.622037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:17:00.624592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:17:00.763842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:00.883251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:00.892146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-99205c07-317d-42fa-b85d-e960c2ccc28f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7281227 Dec 21 04:17:00.892972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36194) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:00.900457 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:00.907557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-484810770'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:00.924733 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:00.927085 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:01.047474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:17:01.052752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.063083 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:01.091455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:17:01.092403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-14ae4950-bd74-48ab-9b8a-2a7737597d15 None None] Provisioning complete for port 5e338df6-2c90-4a1b-92a7-213b2f278d76 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:01.093797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14ae4950-bd74-48ab-9b8a-2a7737597d15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.103940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.104296 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added segment 60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5 of type vlan for network c3a05095-0536-415a-9668-986d8f075b40 Dec 21 04:17:01.156590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.227805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-14ae4950-bd74-48ab-9b8a-2a7737597d15 None None] Provisioning complete for port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:01.228178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14ae4950-bd74-48ab-9b8a-2a7737597d15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.258538 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.264509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:01.265123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.273544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-14ae4950-bd74-48ab-9b8a-2a7737597d15 None None] Port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:17:01.355895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:59Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:00Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:01.357041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Network': ['ID=c3a05095-0536-415a-9668-986d8f075b40,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:01.387310 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4be427f-9b10-46ee-8522-8f4a18ee2f4f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4926574 Dec 21 04:17:01.390196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36206) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:01.396137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'subnet': {'network_id': 'c3a05095-0536-415a-9668-986d8f075b40', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:01.415605 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:01.416184 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Updating router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:17:01.423814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e57eb107-ada1-466f-94b4-a5d4643292e4 None None] Provisioning complete for port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:01.425399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e57eb107-ada1-466f-94b4-a5d4643292e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.431256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network c3a05095-0536-415a-9668-986d8f075b40 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:17:01.447865 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.620053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5e338df6-2c90-4a1b-92a7-213b2f278d76 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:01.630051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Made reservation on behalf of 8c540cedb8fe4db592c00c403a0dc6a9 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:17:01.633674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.650490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-8f9887dd-2281-4ffd-99e7-281c5f5aa1c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:01.652393 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-8f9887dd-2281-4ffd-99e7-281c5f5aa1c4 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1098 time: 0.0941024 Dec 21 04:17:01.685073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e57eb107-ada1-466f-94b4-a5d4643292e4 None None] Port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:17:01.713512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 5e338df6-2c90-4a1b-92a7-213b2f278d76 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:01.713890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.831240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-39f8543f-331b-43f6-a3b3-e17e5393b636 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:01.834118 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-39f8543f-331b-43f6-a3b3-e17e5393b636 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1545529 Dec 21 04:17:01.841072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-085eea94-d608-4ac9-adcb-971a2412fed8 None None] Provisioning complete for port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:01.841447 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-085eea94-d608-4ac9-adcb-971a2412fed8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.845825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0726d522-a4a8-4309-b8be-b3af50d5bae6 req-1b4684f1-925d-440a-873a-2ea7d7a3daec tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:01.847537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0726d522-a4a8-4309-b8be-b3af50d5bae6 req-1b4684f1-925d-440a-873a-2ea7d7a3daec tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.0969214 Dec 21 04:17:01.885854 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:17:01.904959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-085eea94-d608-4ac9-adcb-971a2412fed8 None None] Port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:17:01.914758 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:01.921764 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-b8ea14d4-1120-446d-8497-496bb46c1d99 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1002 time: 0.0801766 Dec 21 04:17:01.956557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0726d522-a4a8-4309-b8be-b3af50d5bae6 req-02dc95ce-188b-4806-9290-6669cd907809 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0976794 Dec 21 04:17:01.990389 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.041656 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187ec13e-60ba-44a4-b2ce-70632a6f4bbc None None] Pushing event updated for resources: {'Port': ['ID=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:02.051895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.103837 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Attempting to bind port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:17:02.104417 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Attempting to bind port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:17:02.104983 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Attempting to bind port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a on network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:02.113609 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:17:02.114438 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Checking segment: {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:17:02.115240 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.115796 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Bound using segment: {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:17:02.116575 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Bound port: 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc7e4204-4ce6-429e-8c41-6f1be139b017', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:17:02.117122 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.133647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Subnet': ['ID=d6af1a01-067a-4ed9-96db-0b0d216bd835,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:02.151872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Checking segment: {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:17:02.152248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network hostable DHCP agents. Network: c3a05095-0536-415a-9668-986d8f075b40, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:17:02.178105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-c80c9320-9429-4b23-8a97-1e3401f70dac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:02.195301 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-c80c9320-9429-4b23-8a97-1e3401f70dac service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.1367950 Dec 21 04:17:02.219904 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] For port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:02.223269 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] For port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:17:02.258025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-aa3c0ee4-8679-4ad4-af99-191918134258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:02.261806 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-aa3c0ee4-8679-4ad4-af99-191918134258 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0644107 Dec 21 04:17:02.305148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network c3a05095-0536-415a-9668-986d8f075b40 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:17:02.368268 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.380173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, c3a05095-0536-415a-9668-986d8f075b40) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:17:02.383035 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-079d9e0a-8b40-4d59-a5b0-9e26d85db8ba service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868282 Dec 21 04:17:02.385376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:02.386084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.393615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cac1a156-4116-476b-80d9-bcf9d3abb299 None None] Network c3a05095-0536-415a-9668-986d8f075b40 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:02.461534 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:02.462170 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:02.465319 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187ec13e-60ba-44a4-b2ce-70632a6f4bbc None None] Pushing event updated for resources: {'Port': ['ID=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:02.517527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e74b60ab-613d-4a88-9b67-e09686771d42 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.1235409 Dec 21 04:17:02.517778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36226) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:02.530891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3de79b6b-6300-4566-8f28-90ff77609d66 req-c1741a99-653f-431b-a2b1-9997cd78c33a service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1389561 Dec 21 04:17:02.580483 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:02.633327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-c3a05095-0536-415a-9668-986d8f075b40', 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40', 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'fixed_ips': [{'subnet_id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:17:02.634675 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.647697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-01b36a61-26de-4466-8acf-1398c86fd5ce None None] Provisioning complete for port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:02.648329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b36a61-26de-4466-8acf-1398c86fd5ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.715005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-405add10-93f8-4fed-a30f-34d620521791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:02.716803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-405add10-93f8-4fed-a30f-34d620521791 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1098 time: 0.0831733 Dec 21 04:17:02.884229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b36a61-26de-4466-8acf-1398c86fd5ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:02.923259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-01b36a61-26de-4466-8acf-1398c86fd5ce None None] For port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:02.939810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-33157f33-911f-45b1-90c6-51f2b958126c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:02.943730 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-33157f33-911f-45b1-90c6-51f2b958126c service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.2182603 Dec 21 04:17:02.987646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Allocated IP 2001:db8:3::2 (c3a05095-0536-415a-9668-986d8f075b40/d6af1a01-067a-4ed9-96db-0b0d216bd835/29cb9479-1a87-48a1-8c01-09d654161d26) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:17:03.005555 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b36a61-26de-4466-8acf-1398c86fd5ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:03.108619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-09a418f2-f62e-46ea-a731-75458de97bb0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1002 time: 0.1569576 Dec 21 04:17:03.115205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b36a61-26de-4466-8acf-1398c86fd5ce None None] Pushing event updated for resources: {'Port': ['ID=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:03.214162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:03.214756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-12d58e17-9ed4-4501-af16-a024aca6559b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:03.219491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-088c3a29-94f3-4f3b-a7b0-d25f2e627ed5 None None] Provisioning complete for port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:03.219847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-088c3a29-94f3-4f3b-a7b0-d25f2e627ed5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:03.220484 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-12d58e17-9ed4-4501-af16-a024aca6559b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.1001663 Dec 21 04:17:03.230768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a7736d-45a4-4a24-a8e4-b54ceead9efc req-12726b6d-92f3-4abb-9030-686e91b7b53e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:03.243799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5a7736d-45a4-4a24-a8e4-b54ceead9efc req-12726b6d-92f3-4abb-9030-686e91b7b53e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1351633 Dec 21 04:17:03.286597 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:59Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:03.325765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-02fc55fd-10a8-4bd7-9b61-ab84128196d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:03.328588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-02fc55fd-10a8-4bd7-9b61-ab84128196d5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1054342 Dec 21 04:17:03.351649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beb82072-da02-4017-a64a-1c3c2b23236c None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:16:59Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:03.474153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d5a7736d-45a4-4a24-a8e4-b54ceead9efc req-868d28aa-48da-4893-8462-5934b5ac767d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2288792 Dec 21 04:17:03.483949 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-7b306f59-6f8b-4853-a518-2253ee1f4401 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1467524 Dec 21 04:17:03.685916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:03.766117 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:03.792787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:03.795280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:03.795667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c4063b5a-95b3-4769-a768-b21b41c98eb0 req-cc2b4352-0289-462a-8e30-922ba6628329 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2780786 Dec 21 04:17:03.878256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:03.934713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Network c3a05095-0536-415a-9668-986d8f075b40 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:17:03.938351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:17:03.939201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Allocated IP 2001:db8:3::1 (c3a05095-0536-415a-9668-986d8f075b40/d6af1a01-067a-4ed9-96db-0b0d216bd835/4af75925-f218-4cd7-aa72-b372884b6c18) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:17:03.942604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:17:03.971475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Pushing event updated for resources: {'Port': ['ID=29cb9479-1a87-48a1-8c01-09d654161d26,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:04.007231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Attempting to bind port 29cb9479-1a87-48a1-8c01-09d654161d26 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:17:04.007897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Attempting to bind port 29cb9479-1a87-48a1-8c01-09d654161d26 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:17:04.008441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Attempting to bind port 29cb9479-1a87-48a1-8c01-09d654161d26 on network c3a05095-0536-415a-9668-986d8f075b40 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:04.015753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:17:04.016437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Checking segment: {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:17:04.017006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.017694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Bound using segment: {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:17:04.018377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Bound port: 29cb9479-1a87-48a1-8c01-09d654161d26, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:17:04.019030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.099898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] For port 29cb9479-1a87-48a1-8c01-09d654161d26, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:04.103415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] For port 29cb9479-1a87-48a1-8c01-09d654161d26, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29cb9479-1a87-48a1-8c01-09d654161d26,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:17:04.118964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.196608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.253909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.284724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4d764b-940b-44b4-ba75-1dd08df48f01 None None] Pushing event updated for resources: {'Port': ['ID=29cb9479-1a87-48a1-8c01-09d654161d26,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:04.335325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network c3a05095-0536-415a-9668-986d8f075b40 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:17:04.339730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:17:04.342573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:17:04.343084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.345674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=4af75925-f218-4cd7-aa72-b372884b6c18,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:04.596931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:04.742836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546d517c-fa8e-4dfa-9e01-76e90a90dd4c req-2dd9eba1-57b4-4fec-87fd-a5cf34d9542a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:04.744412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-546d517c-fa8e-4dfa-9e01-76e90a90dd4c req-2dd9eba1-57b4-4fec-87fd-a5cf34d9542a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1017792 Dec 21 04:17:04.840737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-546d517c-fa8e-4dfa-9e01-76e90a90dd4c req-82aa60dd-85d2-4a3d-8281-7f48b643a9aa tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661373 Dec 21 04:17:04.958166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:05.007892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:05.008845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:05.109638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event updated for resources: {'Port': ['ID=4af75925-f218-4cd7-aa72-b372884b6c18,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:05.149677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Network c3a05095-0536-415a-9668-986d8f075b40 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:17:05.151472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:17:05.258682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:05.370671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:05.376306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6e1d18e5-b1e0-4f9b-b834-872324fb89a1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8573747 Dec 21 04:17:05.379182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36266) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:05.384199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:05.397886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:05.445987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:05.447493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:05.508769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9fc8208-2802-466e-86d6-6b2d41825a8d None None] Network c3a05095-0536-415a-9668-986d8f075b40 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:05.604702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29cb9479-1a87-48a1-8c01-09d654161d26 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:05.651386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:05.708824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a5f13816-b37b-40b3-839e-186c8c9db7fc None None] Provisioning complete for port 29cb9479-1a87-48a1-8c01-09d654161d26 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:05.709224 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a5f13816-b37b-40b3-839e-186c8c9db7fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:05.823991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.extraroute_db [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}] {{(pid=110310) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 21 04:17:05.839980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.extraroute_db [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Removed routes are [] {{(pid=110310) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 21 04:17:05.840382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:05.870701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 29cb9479-1a87-48a1-8c01-09d654161d26 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:05.870701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.003083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a5f13816-b37b-40b3-839e-186c8c9db7fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.099288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a5f13816-b37b-40b3-839e-186c8c9db7fc None None] For port 29cb9479-1a87-48a1-8c01-09d654161d26, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29cb9479-1a87-48a1-8c01-09d654161d26,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:06.123704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.167625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:04Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '4af75925-f218-4cd7-aa72-b372884b6c18', 'name': '', 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:51:0c:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3610, 'fixed_ips': [{'subnet_id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:17:03Z', 'updated_at': '2021-12-21T04:17:04Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:06.198414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:06.198774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Updating router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 port 4af75925-f218-4cd7-aa72-b372884b6c18 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:17:06.201074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a5f13816-b37b-40b3-839e-186c8c9db7fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.247256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:06.324555 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.401908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:17:06.402620 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:17:06.402795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5f13816-b37b-40b3-839e-186c8c9db7fc None None] Pushing event updated for resources: {'Port': ['ID=29cb9479-1a87-48a1-8c01-09d654161d26,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:06.433593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eb237ead-e280-4791-85f3-82aa1816230e None None] Provisioning complete for port 4af75925-f218-4cd7-aa72-b372884b6c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:06.433967 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb237ead-e280-4791-85f3-82aa1816230e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.587586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31e6b23-23b6-42ad-9e58-f96a4efb3fd4 req-5c2f907e-984c-4c9c-bd07-69eea47687da tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:06.589044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e31e6b23-23b6-42ad-9e58-f96a4efb3fd4 req-5c2f907e-984c-4c9c-bd07-69eea47687da tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 946 time: 0.1835942 Dec 21 04:17:06.640238 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.652246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.663242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eb237ead-e280-4791-85f3-82aa1816230e None None] Port 4af75925-f218-4cd7-aa72-b372884b6c18 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:17:06.672974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e31e6b23-23b6-42ad-9e58-f96a4efb3fd4 req-38ecc89e-28c9-4d5f-984e-2ed94f25ea0a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0777695 Dec 21 04:17:06.700154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eb237ead-e280-4791-85f3-82aa1816230e None None] Provisioning complete for port 29cb9479-1a87-48a1-8c01-09d654161d26 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:06.700532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb237ead-e280-4791-85f3-82aa1816230e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.789019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:06.914977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:06.919016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.927891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:06.932239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:06.946151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e1075689-7ec3-4a53-8ac9-8b3d44f41f23 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 953 time: 1.5640972 Dec 21 04:17:07.025468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:07.027728 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7948a4c0-e511-48c8-8b87-4161849de604" -d '{"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-unplugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:07.048917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36296) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:07.053193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'routes': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:07.055671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:07.059040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f40ad24-03e6-494b-9869-0682d7a0ad1b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 953 time: 0.1254880 Dec 21 04:17:07.080909 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eae95546-7275-4375-95e1-6042b2626fc7 x-openstack-request-id: req-eae95546-7275-4375-95e1-6042b2626fc7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:07.081195 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-unplugged", "status": "failed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "code": 422}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:07.081459 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eae95546-7275-4375-95e1-6042b2626fc7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:07.081855 n-d-822053-11 neutron-server[110312]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'code': 422} returned with failed status Dec 21 04:17:07.117522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.227703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.229149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:07.293412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.368627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9bf36423-3ad5-4ff8-ae18-17061c531123 None None] Provisioning complete for port 4af75925-f218-4cd7-aa72-b372884b6c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:07.373500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9bf36423-3ad5-4ff8-ae18-17061c531123 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.373500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76638b58-5d7d-415f-a119-f5767a86a502 None None] Pushing event updated for resources: {'Port': ['ID=4af75925-f218-4cd7-aa72-b372884b6c18,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:07.495984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9bf36423-3ad5-4ff8-ae18-17061c531123 None None] Port 4af75925-f218-4cd7-aa72-b372884b6c18 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:17:07.509367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Attempting to bind port 4af75925-f218-4cd7-aa72-b372884b6c18 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:17:07.509776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Attempting to bind port 4af75925-f218-4cd7-aa72-b372884b6c18 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:17:07.510338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Attempting to bind port 4af75925-f218-4cd7-aa72-b372884b6c18 on network c3a05095-0536-415a-9668-986d8f075b40 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:07.516302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 16, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:17:07.516698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Checking segment: {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:17:07.517101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.517561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Bound using segment: {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:17:07.518041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Bound port: 4af75925-f218-4cd7-aa72-b372884b6c18, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:17:07.518427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.585929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ba301c-d6ef-422c-b2d6-d9f970133e58 req-d9435d0d-03aa-43e0-aa74-3207217c5dc3 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:07.589094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3ba301c-d6ef-422c-b2d6-d9f970133e58 req-d9435d0d-03aa-43e0-aa74-3207217c5dc3 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1097 time: 0.1099460 Dec 21 04:17:07.601327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] For port 4af75925-f218-4cd7-aa72-b372884b6c18, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:07.605660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] For port 4af75925-f218-4cd7-aa72-b372884b6c18, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4af75925-f218-4cd7-aa72-b372884b6c18,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:17:07.606308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.extraroute_db [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added routes are [] {{(pid=110310) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 21 04:17:07.606644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.extraroute_db [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Removed routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}] {{(pid=110310) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 21 04:17:07.608780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29cb9479-1a87-48a1-8c01-09d654161d26 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:07.671718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.682870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 29cb9479-1a87-48a1-8c01-09d654161d26 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:07.683219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e3ba301c-d6ef-422c-b2d6-d9f970133e58 req-3d5dfd5b-5982-4d0e-8aae-1393fb1b4f5e tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0787704 Dec 21 04:17:07.683307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.694212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.767164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:07.767164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:07.782094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76638b58-5d7d-415f-a119-f5767a86a502 None None] Pushing event updated for resources: {'Port': ['ID=4af75925-f218-4cd7-aa72-b372884b6c18,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:07.878766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4f6e4345-0fdc-4452-8673-57715a63223a None None] Provisioning complete for port 4af75925-f218-4cd7-aa72-b372884b6c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:07.880290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f6e4345-0fdc-4452-8673-57715a63223a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:07.925501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64daf6e5-69f2-46f8-a35f-8e55405b5b70 req-d9d304b2-a731-40d3-b8f7-59e96056bca6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:07.933032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64daf6e5-69f2-46f8-a35f-8e55405b5b70 req-d9d304b2-a731-40d3-b8f7-59e96056bca6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1536243 Dec 21 04:17:07.947858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:08.061283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-0e85748a-5151-4902-8a91-4f79d3ee06d0 req-5eb35beb-5cd2-4ee5-9d18-e3711c21c60e service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:17:08.062204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e85748a-5151-4902-8a91-4f79d3ee06d0 req-5eb35beb-5cd2-4ee5-9d18-e3711c21c60e service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1214807 Dec 21 04:17:08.075512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64daf6e5-69f2-46f8-a35f-8e55405b5b70 req-baf5b15f-395a-4683-bc08-dc5ae255d718 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1413114 Dec 21 04:17:08.106971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:08.106971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:08.109294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36326) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:08.191768 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eef0b414-d5cb-46b7-84f6-74f98f5edba3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ae34193d-4f2b-464a-8928-ae32066e68b4 HTTP/1.1" status: 200 len: 993 time: 0.0795925 Dec 21 04:17:08.249261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:08.291860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f6e4345-0fdc-4452-8673-57715a63223a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:08.336722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4f6e4345-0fdc-4452-8673-57715a63223a None None] For port 4af75925-f218-4cd7-aa72-b372884b6c18, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4af75925-f218-4cd7-aa72-b372884b6c18,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:08.362485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:07Z', 'revision_number': 7, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '4af75925-f218-4cd7-aa72-b372884b6c18', 'name': '', 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:51:0c:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3610, 'fixed_ips': [{'subnet_id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:17:03Z', 'updated_at': '2021-12-21T04:17:07Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:08.383125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:08.393333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:08.394542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-164d7073-246c-452b-b40b-115ce5042374 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 703 time: 1.3459423 Dec 21 04:17:08.395653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13ad926-3702-425b-a123-b9b90fcb12ae None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:07Z', 'revision_number': 7, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '4af75925-f218-4cd7-aa72-b372884b6c18', 'name': '', 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:51:0c:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3610, 'fixed_ips': [{'subnet_id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:17:03Z', 'updated_at': '2021-12-21T04:17:07Z', 'revision_number': 4, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:08.397185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36336) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:08.415978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f6e4345-0fdc-4452-8673-57715a63223a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:08.487239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b93aef50-bac9-412f-840f-bccc64fe2006 req-e3cd4eae-5f73-4751-a29d-ab24bd6338d2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:08.504574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b93aef50-bac9-412f-840f-bccc64fe2006 req-e3cd4eae-5f73-4751-a29d-ab24bd6338d2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1038532 Dec 21 04:17:08.535189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6e4345-0fdc-4452-8673-57715a63223a None None] Pushing event updated for resources: {'Port': ['ID=4af75925-f218-4cd7-aa72-b372884b6c18,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:08.560208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ca18a6e8-e18f-4817-b41b-888171d712d5 None None] Provisioning complete for port 4af75925-f218-4cd7-aa72-b372884b6c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:08.562670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ca18a6e8-e18f-4817-b41b-888171d712d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:08.617816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b93aef50-bac9-412f-840f-bccc64fe2006 req-115ed918-e967-42ec-b156-7e3c20d46b1f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1122236 Dec 21 04:17:08.618335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-85c2675e-75a9-4148-891b-a7c23813a879 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 703 time: 0.2191658 Dec 21 04:17:08.621545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36352) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:08.630405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-3a7f1548-235f-4418-aa1b-2394126a39f3 req-6144f900-04e8-487d-8be5-9d4712540ec1 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:17:08.632778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a7f1548-235f-4418-aa1b-2394126a39f3 req-6144f900-04e8-487d-8be5-9d4712540ec1 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0132089 Dec 21 04:17:09.025629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36366) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:09.111239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:09.205202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-8fcbcf22-e7f8-41ab-81ee-122b7348b67e service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1781735 Dec 21 04:17:09.220124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-d723be7f-04c8-4a74-8594-da97e0d87e50 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:17:09.221065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-d723be7f-04c8-4a74-8594-da97e0d87e50 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0063784 Dec 21 04:17:09.241874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c48c35-3648-40b2-b67f-3e9502028ecf req-7b7f37b8-7e5a-4c9f-8dd8-5c83c4034e22 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:09.251139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c48c35-3648-40b2-b67f-3e9502028ecf req-7b7f37b8-7e5a-4c9f-8dd8-5c83c4034e22 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0786121 Dec 21 04:17:09.325508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34c48c35-3648-40b2-b67f-3e9502028ecf req-8280b1d4-9b70-40ed-b2cd-f304c8d4a714 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732539 Dec 21 04:17:09.375625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-dbdeaced-465b-4f76-9d6f-0d141bcb61a6 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0784125 Dec 21 04:17:09.446354 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 4af75925-f218-4cd7-aa72-b372884b6c18 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:09.446705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:09.476627 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:09.486568 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:09.487219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:09.593042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4af75925-f218-4cd7-aa72-b372884b6c18 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:09.601608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 4af75925-f218-4cd7-aa72-b372884b6c18, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4af75925-f218-4cd7-aa72-b372884b6c18,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:09.602531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:09.626310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 4af75925-f218-4cd7-aa72-b372884b6c18 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:09.701083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4af75925-f218-4cd7-aa72-b372884b6c18 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:09.702638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:09.767250 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:09.839189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5d5482-7942-4769-a660-da92f67fe60d req-bffa2fb8-1a45-4f5d-8768-c410e730c962 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:09.840856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5d5482-7942-4769-a660-da92f67fe60d req-bffa2fb8-1a45-4f5d-8768-c410e730c962 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0705590 Dec 21 04:17:09.934697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b5d5482-7942-4769-a660-da92f67fe60d req-55e88a4b-c08e-407d-8f88-041bded0897d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0789618 Dec 21 04:17:09.963298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:10.014231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=4af75925-f218-4cd7-aa72-b372884b6c18,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:10.068514 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:07Z', 'revision_number': 7, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '4af75925-f218-4cd7-aa72-b372884b6c18', 'name': '', 'network_id': 'c3a05095-0536-415a-9668-986d8f075b40', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:51:0c:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3610, 'fixed_ips': [{'subnet_id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:17:03Z', 'updated_at': '2021-12-21T04:17:08Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': 'd6af1a01-067a-4ed9-96db-0b0d216bd835', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:10.102274 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:10.117495 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:10.118114 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:10.175950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:10.218795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:10.264803 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:10.494309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef93874-c47f-4cb4-9a9f-8d624d8da99a req-4bc21e93-ba9e-48c5-89d5-e0c3f48424e5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:10.505237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aef93874-c47f-4cb4-9a9f-8d624d8da99a req-4bc21e93-ba9e-48c5-89d5-e0c3f48424e5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0978997 Dec 21 04:17:10.572423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:10.628964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aef93874-c47f-4cb4-9a9f-8d624d8da99a req-87799fda-19fa-4c8c-8d6f-c556a85ea337 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1165519 Dec 21 04:17:10.640737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:09Z', 'revision_number': 8, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:10.687383 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17244c9-6b95-434b-b90a-a00567d78be6 None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:09Z', 'revision_number': 8, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:10.720872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:10.731617 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-48d4e30a-5240-4556-a731-1c00ee01718b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1065896 Dec 21 04:17:10.732095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36416) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:10.789989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet d6af1a01-067a-4ed9-96db-0b0d216bd835 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:17:10.793596 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:10.843813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:10.931074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.063825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.105509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=d6af1a01-067a-4ed9-96db-0b0d216bd835,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:11.119879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a574ed7c-1763-4722-a8b7-b1473015b38c None None] Network c3a05095-0536-415a-9668-986d8f075b40 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:11.124314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.128161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9fb686f5-09c6-43e9-8845-82234874cf44 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/d6af1a01-067a-4ed9-96db-0b0d216bd835 HTTP/1.1" status: 204 len: 168 time: 0.3948398 Dec 21 04:17:11.131315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36420) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:11.165024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e73b2b51-2787-42e9-9166-265292ebec1d req-2ad6cf1f-8425-4739-8feb-88946da3fbca tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:11.168809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e73b2b51-2787-42e9-9166-265292ebec1d req-2ad6cf1f-8425-4739-8feb-88946da3fbca tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1436851 Dec 21 04:17:11.250268 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.259987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e73b2b51-2787-42e9-9166-265292ebec1d req-9a9ec2a4-4497-4c17-9b58-cd97d9e25065 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0859272 Dec 21 04:17:11.330284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 29cb9479-1a87-48a1-8c01-09d654161d26 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:11.330692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.434280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] DHCP port deletion for c3a05095-0536-415a-9668-986d8f075b40 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:17:11.443655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:11.447205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 29cb9479-1a87-48a1-8c01-09d654161d26, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29cb9479-1a87-48a1-8c01-09d654161d26,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:11.447572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.461491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 29cb9479-1a87-48a1-8c01-09d654161d26 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:11.505074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:11.505866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:11.544718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4af75925-f218-4cd7-aa72-b372884b6c18 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:11.594035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Deleting port 29cb9479-1a87-48a1-8c01-09d654161d26 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:11.594376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.606720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.628491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4af75925-f218-4cd7-aa72-b372884b6c18 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:11.628491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4af75925-f218-4cd7-aa72-b372884b6c18 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:11.628857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29cb9479-1a87-48a1-8c01-09d654161d26 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:11.646871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=29cb9479-1a87-48a1-8c01-09d654161d26,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:11.649766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port 29cb9479-1a87-48a1-8c01-09d654161d26 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:11.682653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 29cb9479-1a87-48a1-8c01-09d654161d26 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:11.683018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29cb9479-1a87-48a1-8c01-09d654161d26 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:11.768455 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.794396 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3a05095-0536-415a-9668-986d8f075b40']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:11.801114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beefcdee-98c9-4e2a-bbee-ba334879e896 req-97158f93-5212-48a0-8058-3df12fbcc980 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:11.805664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:11.805970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:11.808082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beefcdee-98c9-4e2a-bbee-ba334879e896 req-97158f93-5212-48a0-8058-3df12fbcc980 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0651016 Dec 21 04:17:11.818381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.835323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.842809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:17:11.843189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.884675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-beefcdee-98c9-4e2a-bbee-ba334879e896 req-3e6e19b4-6c12-4b89-961c-d8158c989e3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715849 Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:17:11.900450 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:17:11.931731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:11.934098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-26f5390a-c1a4-4c53-b20f-ef4358e8ce53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:11.935514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-26f5390a-c1a4-4c53-b20f-ef4358e8ce53 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1097 time: 0.0736949 Dec 21 04:17:11.973745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] For port 29cb9479-1a87-48a1-8c01-09d654161d26, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29cb9479-1a87-48a1-8c01-09d654161d26,segment=NetworkSegment(60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5),segment_id=60197f2a-b1fd-4b81-bce1-c1b50ac6e8c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:11.974232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.985045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.992255 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:11.995464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/c3a05095-0536-415a-9668-986d8f075b40 HTTP/1.1" status: 204 len: 168 time: 0.8631082 Dec 21 04:17:12.000142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36426) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:12.016702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563c9c37-c620-4683-bdcf-1c49c733a913 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=c3a05095-0536-415a-9668-986d8f075b40,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:12.030660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Calling delete_port for 29cb9479-1a87-48a1-8c01-09d654161d26 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:12.069592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-b4f7d7fc-0033-4672-ba64-f986eb34ce83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:12.071429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-b4f7d7fc-0033-4672-ba64-f986eb34ce83 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1247971 Dec 21 04:17:12.167428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-24b23efe-f282-4f11-b9cb-3f817def1852 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1001 time: 0.0822380 Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:17:12.211117 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:17:12.219917 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:12.243198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-6714b3b7-03a8-44e2-845b-87234c07321a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:12.245121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-6714b3b7-03a8-44e2-845b-87234c07321a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0649569 Dec 21 04:17:12.248863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Network c3a05095-0536-415a-9668-986d8f075b40 is not hosted by any dhcp agent {{(pid=110312) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 21 04:17:12.249330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] No DVR routers for this DVR port 29cb9479-1a87-48a1-8c01-09d654161d26 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:12.256284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79d9d48-e4ad-4bb9-804f-5bbbb7251d45 None None] Pushing event deleted for resources: {'Port': ['ID=29cb9479-1a87-48a1-8c01-09d654161d26,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:12.294986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:09Z', 'revision_number': 8, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:12.340110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-9baead8e-9136-4970-8075-5e44fcf59d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:12.342299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-9baead8e-9136-4970-8075-5e44fcf59d19 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0827529 Dec 21 04:17:12.344475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:12.362541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:12.368456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:12.499702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:12.504361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c6580fe-488c-4778-81d4-bb676b820032 req-5820b3f5-6b0b-4f9a-9cf2-b954054abaa3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:12.508124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c6580fe-488c-4778-81d4-bb676b820032 req-5820b3f5-6b0b-4f9a-9cf2-b954054abaa3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1235039 Dec 21 04:17:12.512166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-7a122b91-b7e2-4145-8aa9-0371ad7ccbff service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1591780 Dec 21 04:17:12.640590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c6580fe-488c-4778-81d4-bb676b820032 req-1fe3c37e-7545-41b6-8d40-8778d28e2ccf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1259046 Dec 21 04:17:12.674600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-a9c3f5b7-ce8f-4973-8183-7c07e895a8ee service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1441505 Dec 21 04:17:12.714115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:12.753321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:09Z', 'revision_number': 8, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:12.780797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6209a778-cc67-484a-883f-c274ea5a4dd5 None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:09Z', 'revision_number': 8, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a', 'name': '', 'network_id': '5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:a1:9c:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3605, 'fixed_ips': [{'subnet_id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:57Z', 'updated_at': '2021-12-21T04:17:02Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '79b89a53-4402-4b83-b14f-d2deb08e98fd', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:12.979266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:12.979602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:13.032269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a31b757-fdf3-47a5-8d58-0671a1d246dd req-1bc08ec9-bca4-4856-ab0d-56ab6b60e050 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:13.034071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a31b757-fdf3-47a5-8d58-0671a1d246dd req-1bc08ec9-bca4-4856-ab0d-56ab6b60e050 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0598087 Dec 21 04:17:13.089231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:13.089601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:13.092019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a31b757-fdf3-47a5-8d58-0671a1d246dd req-e637421f-8eb0-4d45-9261-9231edb5a93c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503626 Dec 21 04:17:13.104257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:13.344963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:13.373103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:13.499413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:13.706269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:13.795050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7be997b-dda8-4f48-aeb5-f4e0560bf777 req-c08dfa46-8661-429f-91eb-083ac0a5cd2f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:13.796649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7be997b-dda8-4f48-aeb5-f4e0560bf777 req-c08dfa46-8661-429f-91eb-083ac0a5cd2f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0511057 Dec 21 04:17:13.808568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:13.814156 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-173d35bf-0e69-407f-848b-a8a353ca5fc8 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8128107 Dec 21 04:17:13.816573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:13.819384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:13.830597 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:13.831666 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:13.868408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7be997b-dda8-4f48-aeb5-f4e0560bf777 req-16694ab1-ed82-41c2-8a04-159af5849a8e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0647066 Dec 21 04:17:13.896855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet 79b89a53-4402-4b83-b14f-d2deb08e98fd {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:17:13.900964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:13.950504 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:13.951429 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:14.041183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.158252 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:13Z', 'revision_number': 9, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:14.173749 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.192667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:14.202384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:14.203155 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:14.203728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=79b89a53-4402-4b83-b14f-d2deb08e98fd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:14.212758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.218675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26a0a196-1265-46bf-b460-aa5591d5097d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/79b89a53-4402-4b83-b14f-d2deb08e98fd HTTP/1.1" status: 204 len: 168 time: 0.3987973 Dec 21 04:17:14.219398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36442) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:14.222318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77a87272-3729-44a7-ac10-c57a9c7bc80b None None] Network 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:14.255568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74cea190-b491-444c-8d90-6f24be8f7a83 req-edf52d8d-17e5-45df-a5f8-2f31933168ec tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:14.266215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74cea190-b491-444c-8d90-6f24be8f7a83 req-edf52d8d-17e5-45df-a5f8-2f31933168ec tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0942395 Dec 21 04:17:14.310668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.331369 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:14.381579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74cea190-b491-444c-8d90-6f24be8f7a83 req-3a9d27b1-585b-4f40-af48-7b5b7caf8f4d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1111090 Dec 21 04:17:14.405729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 5e338df6-2c90-4a1b-92a7-213b2f278d76 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:14.406288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.452358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] DHCP port deletion for 5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:17:14.496124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 5e338df6-2c90-4a1b-92a7-213b2f278d76, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5e338df6-2c90-4a1b-92a7-213b2f278d76,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:14.496503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.516039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 5e338df6-2c90-4a1b-92a7-213b2f278d76 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:14.529779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] Deleting port 5e338df6-2c90-4a1b-92a7-213b2f278d76 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:14.530412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.606405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] For port 5e338df6-2c90-4a1b-92a7-213b2f278d76, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5e338df6-2c90-4a1b-92a7-213b2f278d76,segment=NetworkSegment(bc7e4204-4ce6-429e-8c41-6f1be139b017),segment_id=bc7e4204-4ce6-429e-8c41-6f1be139b017)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:14.607107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.623221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] Calling delete_port for 5e338df6-2c90-4a1b-92a7-213b2f278d76 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:14.681662 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:13Z', 'revision_number': 9, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:14.704094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5ce549d-9728-4f46-8dc1-29256fa38be3 None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:13Z', 'revision_number': 9, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': '653ea226-1be5-4ebf-a074-d952bc71d0bd', 'name': '', 'network_id': '12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:cc:cc:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3600, 'fixed_ips': [{'subnet_id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:52Z', 'updated_at': '2021-12-21T04:16:57Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '366e22cc-23c7-4f8a-b45d-18713d1ac225', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:14.712149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.718393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.744963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] Pushing event deleted for resources: {'Port': ['ID=5e338df6-2c90-4a1b-92a7-213b2f278d76,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:14.748850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a4eb019-b141-4ed0-a1d7-93f88f2443c4 None None] No DVR routers for this DVR port 5e338df6-2c90-4a1b-92a7-213b2f278d76 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:14.779537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port 5e338df6-2c90-4a1b-92a7-213b2f278d76 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:14.781612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=5e338df6-2c90-4a1b-92a7-213b2f278d76,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:14.874888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.902583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:14.913567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bc7e4204-4ce6-429e-8c41-6f1be139b017') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:14.913863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bc7e4204-4ce6-429e-8c41-6f1be139b017') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:14.924214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.938121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.944829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:17:14.945286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:17:14.948539 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:17:15.015569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22af8e00-12c9-4584-b7b6-1d6b665f55f4 req-d75ff74d-d7dd-4077-8188-53896579273d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:15.017189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22af8e00-12c9-4584-b7b6-1d6b665f55f4 req-d75ff74d-d7dd-4077-8188-53896579273d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0502305 Dec 21 04:17:15.069720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22af8e00-12c9-4584-b7b6-1d6b665f55f4 req-d5245d41-9d93-4c11-852a-f962efc36ad5 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460756 Dec 21 04:17:15.082129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:15.097704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:15.102831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6 HTTP/1.1" status: 204 len: 168 time: 0.8825288 Dec 21 04:17:15.104325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36448) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:15.119833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c78d35e9-0d90-402e-ac1a-17605c78189a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=5dcf9804-9bc9-4dc2-a059-0a3cfc1f1ab6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:15.458492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:15.510558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5e338df6-2c90-4a1b-92a7-213b2f278d76 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:15.535116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 5e338df6-2c90-4a1b-92a7-213b2f278d76 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:15.535555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5e338df6-2c90-4a1b-92a7-213b2f278d76 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:15.536070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:15.556453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:15.556885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 96a7a1a1-9ebc-4e3e-bfda-6cddd81b555a not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:15.910445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd9a217-a336-4f63-88d6-fe7f61a78147 req-2ceed923-d2eb-4d0a-8e2b-17436ff5c923 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:15.912480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dd9a217-a336-4f63-88d6-fe7f61a78147 req-2ceed923-d2eb-4d0a-8e2b-17436ff5c923 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.4509513 Dec 21 04:17:16.017871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dd9a217-a336-4f63-88d6-fe7f61a78147 req-93593c55-9b24-456e-9824-4b3072cb5d34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754838 Dec 21 04:17:16.118041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 653ea226-1be5-4ebf-a074-d952bc71d0bd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:16.118488 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:16.251129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 653ea226-1be5-4ebf-a074-d952bc71d0bd, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=653ea226-1be5-4ebf-a074-d952bc71d0bd,segment=NetworkSegment(0cd9b1fb-b1aa-4222-b755-40f4b1918a40),segment_id=0cd9b1fb-b1aa-4222-b755-40f4b1918a40)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:16.252639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:16.260916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20f0c2e-7451-42fe-86c4-4c19fe600ebe req-265b3c52-a0c0-4942-b0d2-db2d6bf2ed1b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:16.262444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e20f0c2e-7451-42fe-86c4-4c19fe600ebe req-265b3c52-a0c0-4942-b0d2-db2d6bf2ed1b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0881217 Dec 21 04:17:16.287060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 653ea226-1be5-4ebf-a074-d952bc71d0bd owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:16.357109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e20f0c2e-7451-42fe-86c4-4c19fe600ebe req-1f139640-b23f-4df9-ad80-b006f159b339 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0885272 Dec 21 04:17:16.533907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:16.567223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=653ea226-1be5-4ebf-a074-d952bc71d0bd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:16.687746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:16.877525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:16.968484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:16.973482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-32c4d414-cf17-41e0-846d-8a710ccad278 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8680277 Dec 21 04:17:16.976786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:16.978635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:16.988483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:16.989849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:17.030376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet 366e22cc-23c7-4f8a-b45d-18713d1ac225 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:17:17.033668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.078810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:17.084802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.179587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba1863a-381b-47d2-a6da-ad8a77c68e05 req-51c7f093-82b9-48da-aa71-0b59b8395aec tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:17.184457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.188482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ba1863a-381b-47d2-a6da-ad8a77c68e05 req-51c7f093-82b9-48da-aa71-0b59b8395aec tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0763731 Dec 21 04:17:17.244081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ba1863a-381b-47d2-a6da-ad8a77c68e05 req-714b1a96-d6aa-465c-9a02-714310a79162 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544658 Dec 21 04:17:17.294240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:16Z', 'revision_number': 10, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:17.324382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:17.332805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:17.333379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:17.351543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.385904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=366e22cc-23c7-4f8a-b45d-18713d1ac225,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:17.387909 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.391224 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f27278d2-6715-4d94-b9e4-8827ecd2f195 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/366e22cc-23c7-4f8a-b45d-18713d1ac225 HTTP/1.1" status: 204 len: 168 time: 0.4131446 Dec 21 04:17:17.393744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36464) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:17.402621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24ab85a7-b55e-40a6-9d91-8a80a2683070 None None] Network 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:17.480814 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.533150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:17.539699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d3a66f8-8fcc-4828-b1ed-250c756f5d4b req-5d42ea2a-9553-4e68-a759-72d23ac972aa tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:17.541505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d3a66f8-8fcc-4828-b1ed-250c756f5d4b req-5d42ea2a-9553-4e68-a759-72d23ac972aa tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0986986 Dec 21 04:17:17.546783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port 692d8ea2-3d3e-41e0-84e8-e11168c1969b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:17.547270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.616898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d3a66f8-8fcc-4828-b1ed-250c756f5d4b req-82909cd4-a6a2-4b9c-a91b-af8055ac0bbb tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481074 Dec 21 04:17:17.630143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port 692d8ea2-3d3e-41e0-84e8-e11168c1969b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=692d8ea2-3d3e-41e0-84e8-e11168c1969b,segment=NetworkSegment(0cd9b1fb-b1aa-4222-b755-40f4b1918a40),segment_id=0cd9b1fb-b1aa-4222-b755-40f4b1918a40)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:17.630515 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.644061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for 692d8ea2-3d3e-41e0-84e8-e11168c1969b owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:17.774625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] DHCP port deletion for 12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:17:17.808494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.824885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:16Z', 'revision_number': 10, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:17.845604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=692d8ea2-3d3e-41e0-84e8-e11168c1969b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:17.851129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port 692d8ea2-3d3e-41e0-84e8-e11168c1969b on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:17.868894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Deleting port 692d8ea2-3d3e-41e0-84e8-e11168c1969b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:17.869482 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.871582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7b9a1c4-5dfc-4b6b-b071-820876b41991 None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:16Z', 'revision_number': 10, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None, '_interfaces': [{'id': 'b2810c04-1466-47fe-8b17-c75bc444de52', 'name': '', 'network_id': '5f387254-f515-4b9c-82e8-24cd1ae33644', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'mac_address': 'fa:16:3e:44:b8:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:46Z', 'updated_at': '2021-12-21T04:16:50Z', 'revision_number': 5, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'subnets': [{'id': '1516c5d5-40ed-4ede-b48a-32897eb2e1f9', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:17.966000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:17.988077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:17.998531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0cd9b1fb-b1aa-4222-b755-40f4b1918a40') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:17.998833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0cd9b1fb-b1aa-4222-b755-40f4b1918a40') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:18.009746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.024049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.030491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:17:18.030889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:17:18.034205 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:17:18.103119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] For port 692d8ea2-3d3e-41e0-84e8-e11168c1969b, host n-d-822053-11, got binding levels [] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:18.103682 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.116043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Calling delete_port for 692d8ea2-3d3e-41e0-84e8-e11168c1969b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:18.118688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.ipam_backend_mixin [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Port 692d8ea2-3d3e-41e0-84e8-e11168c1969b was not found and therefore no delete operation was performed {{(pid=110312) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 21 04:17:18.120091 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.143967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] Pushing event deleted for resources: {'Port': ['ID=692d8ea2-3d3e-41e0-84e8-e11168c1969b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:18.146486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.155442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.161236 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee HTTP/1.1" status: 204 len: 168 time: 0.7638516 Dec 21 04:17:18.161616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:18.163984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-331d0222-0dd7-4d96-a3f4-9283c336e78f None None] No DVR routers for this DVR port 692d8ea2-3d3e-41e0-84e8-e11168c1969b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:18.177359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65776452-07b4-4237-89f1-649fcb7f0808 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=12b5959a-e3d1-49f9-8bfd-cf0b9ee7fcee,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:18.423839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc146063-295c-480e-9a4a-458d928c35a2 req-c86e1056-f0c1-44a1-9114-0b503e95eacf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:18.425332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc146063-295c-480e-9a4a-458d928c35a2 req-c86e1056-f0c1-44a1-9114-0b503e95eacf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1125696 Dec 21 04:17:18.523803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc146063-295c-480e-9a4a-458d928c35a2 req-b8f6a7b7-c7fb-46a7-aa53-124c7922e723 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0860293 Dec 21 04:17:18.609006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:18.794622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8149fc6c-6802-46e4-83e9-8a5a304366a8 req-38d0d284-0c2b-4961-9696-9f1aae34a637 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:18.796046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8149fc6c-6802-46e4-83e9-8a5a304366a8 req-38d0d284-0c2b-4961-9696-9f1aae34a637 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1029339 Dec 21 04:17:18.858526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8149fc6c-6802-46e4-83e9-8a5a304366a8 req-56f3930d-712e-4ccc-b799-a93df4b674da tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0554647 Dec 21 04:17:18.947353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port b2810c04-1466-47fe-8b17-c75bc444de52 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:18.947697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.043345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port b2810c04-1466-47fe-8b17-c75bc444de52, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b2810c04-1466-47fe-8b17-c75bc444de52,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:19.043712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.056762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for b2810c04-1466-47fe-8b17-c75bc444de52 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:19.294060 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.321295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=b2810c04-1466-47fe-8b17-c75bc444de52,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:19.428494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.627315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 692d8ea2-3d3e-41e0-84e8-e11168c1969b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:19.651413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 692d8ea2-3d3e-41e0-84e8-e11168c1969b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:19.651764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 692d8ea2-3d3e-41e0-84e8-e11168c1969b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:19.652185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 653ea226-1be5-4ebf-a074-d952bc71d0bd no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:19.672309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 653ea226-1be5-4ebf-a074-d952bc71d0bd {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:19.672969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 653ea226-1be5-4ebf-a074-d952bc71d0bd not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:19.679480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:19.707870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7aeaadc-fcd2-4cdc-b148-c7226295c478 req-fd99d0c0-f3df-4618-af88-bbc781d22e8d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:19.709383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7aeaadc-fcd2-4cdc-b148-c7226295c478 req-fd99d0c0-f3df-4618-af88-bbc781d22e8d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0687692 Dec 21 04:17:19.794093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:19.799480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d897ae61-ec1d-45b3-98bc-a5b814363e85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6368210 Dec 21 04:17:19.802495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:19.815786 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:19.829574 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:19.831267 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7aeaadc-fcd2-4cdc-b148-c7226295c478 req-e1786eae-977e-421b-a85e-c19f32a46ac7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0919724 Dec 21 04:17:19.831954 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:19.876737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f667570-200e-49c7-877e-0132097b874e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.878085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting subnet 1516c5d5-40ed-4ede-b48a-32897eb2e1f9 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:17:19.881997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.922618 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:19.936723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:19.980086 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:19Z', 'revision_number': 11, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:20.007628 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:20.009942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aafd6f7-379f-4d50-88c5-20dfe1c127bc req-8f7d7a9e-088f-4e73-8f75-d49901a43024 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:20.011496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9aafd6f7-379f-4d50-88c5-20dfe1c127bc req-8f7d7a9e-088f-4e73-8f75-d49901a43024 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0560331 Dec 21 04:17:20.017437 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:20.018351 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:20.049151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.071826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9aafd6f7-379f-4d50-88c5-20dfe1c127bc req-c7c6f7af-d5e0-4941-bdd8-8fca4295840f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511572 Dec 21 04:17:20.100032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:20.158116 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:19Z', 'revision_number': 11, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:20.185731 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eed59ac1-5b58-4756-b72d-19843716f0bd None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:19Z', 'revision_number': 11, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:20.193254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.226075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.229369 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/1516c5d5-40ed-4ede-b48a-32897eb2e1f9 HTTP/1.1" status: 204 len: 168 time: 0.4252410 Dec 21 04:17:20.232219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36494) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:20.233398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b975b440-4b85-4e6f-b66c-a7edd525a28a None None] Network 5f387254-f515-4b9c-82e8-24cd1ae33644 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:17:20.240050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f800764-4c27-4a3b-b7d8-52fba508ffda tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Subnet': ['ID=1516c5d5-40ed-4ede-b48a-32897eb2e1f9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:20.321329 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.378743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Deleting port ab36505c-84b4-4c59-a65a-1d2014a30669 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:20.380858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.442057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] For port ab36505c-84b4-4c59-a65a-1d2014a30669, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab36505c-84b4-4c59-a65a-1d2014a30669,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:20.442425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.455321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Calling delete_port for ab36505c-84b4-4c59-a65a-1d2014a30669 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:20.547468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] DHCP port deletion for 5f387254-f515-4b9c-82e8-24cd1ae33644 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:17:20.611544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] Deleting port ab36505c-84b4-4c59-a65a-1d2014a30669 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:17:20.612327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.642497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.670364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Port': ['ID=ab36505c-84b4-4c59-a65a-1d2014a30669,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:20.672256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No DVR routers for this DVR port ab36505c-84b4-4c59-a65a-1d2014a30669 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:20.683127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] For port ab36505c-84b4-4c59-a65a-1d2014a30669, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ab36505c-84b4-4c59-a65a-1d2014a30669,segment=NetworkSegment(3fc3ce7f-e93c-4630-830b-3cbd04bac2c1),segment_id=3fc3ce7f-e93c-4630-830b-3cbd04bac2c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:20.683127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.695063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] Calling delete_port for ab36505c-84b4-4c59-a65a-1d2014a30669 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:17:20.780804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:20.808592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] Pushing event deleted for resources: {'Port': ['ID=ab36505c-84b4-4c59-a65a-1d2014a30669,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:20.812242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa785556-1d58-4d41-ae42-5992220c4a9f None None] No DVR routers for this DVR port ab36505c-84b4-4c59-a65a-1d2014a30669 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:21.097366 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.142114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5f387254-f515-4b9c-82e8-24cd1ae33644']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:21.163797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:21.164095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3fc3ce7f-e93c-4630-830b-3cbd04bac2c1') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:21.183686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f7ba3f-4c80-4423-8d1d-92ab77cce92b req-fbabcee4-5b64-4bcf-9d8e-1e7ff80ced6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.185215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0f7ba3f-4c80-4423-8d1d-92ab77cce92b req-fbabcee4-5b64-4bcf-9d8e-1e7ff80ced6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1010547 Dec 21 04:17:21.187029 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.235141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.248576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Releasing vlan 102 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:17:21.249000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:17:21.252900 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:17:21.322564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7caf6ae3-5788-49a9-81a3-07ef1953e836 req-ac17f75b-280f-4c98-9146-b97f70395f5d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.324550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7caf6ae3-5788-49a9-81a3-07ef1953e836 req-ac17f75b-280f-4c98-9146-b97f70395f5d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1728427 Dec 21 04:17:21.344383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0f7ba3f-4c80-4423-8d1d-92ab77cce92b req-0b88c95c-d6ae-4b65-948e-e0d431cefe5b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1426225 Dec 21 04:17:21.382085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7caf6ae3-5788-49a9-81a3-07ef1953e836 req-aeb0a8dc-3e9a-464e-9637-d335b6f211d2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475950 Dec 21 04:17:21.413738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.420777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.424469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/networks/5f387254-f515-4b9c-82e8-24cd1ae33644 HTTP/1.1" status: 204 len: 168 time: 1.1910172 Dec 21 04:17:21.428624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36508) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:21.448103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'routes': None}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:21.451284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f62277a-d72f-4b12-ac56-0d3a575dc85c tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Pushing event deleted for resources: {'Network': ['ID=5f387254-f515-4b9c-82e8-24cd1ae33644,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:21.510687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2810c04-1466-47fe-8b17-c75bc444de52 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:21.531852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b2810c04-1466-47fe-8b17-c75bc444de52 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:21.532217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b2810c04-1466-47fe-8b17-c75bc444de52 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:21.532641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab36505c-84b4-4c59-a65a-1d2014a30669 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:21.555088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ab36505c-84b4-4c59-a65a-1d2014a30669 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:17:21.555452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ab36505c-84b4-4c59-a65a-1d2014a30669 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:21.575699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-e45640be-6bf9-4365-ad9d-62f8d6ae2329 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.577507 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-e45640be-6bf9-4365-ad9d-62f8d6ae2329 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb&tenant_id=f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 1096 time: 0.0960321 Dec 21 04:17:21.639626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.extraroute_db [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Added routes are [] {{(pid=110310) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 21 04:17:21.640003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.extraroute_db [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Removed routes are [] {{(pid=110310) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 21 04:17:21.640839 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.657719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-a3e5decc-9e8d-490e-9c68-289226d6f5a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.659270 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-a3e5decc-9e8d-490e-9c68-289226d6f5a5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1096 time: 0.0423875 Dec 21 04:17:21.758003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-a687edf7-37a0-4679-9976-5af7ffa9f019 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.759583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-a687edf7-37a0-4679-9976-5af7ffa9f019 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.0934520 Dec 21 04:17:21.784307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.787688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.828767 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-0fc2efac-1389-4b57-82fc-e77e599706c0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 200 len: 1000 time: 0.0617414 Dec 21 04:17:21.861988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:17:21.881039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-7bd8c573-dc1f-43e7-b0c3-4ae85ec79d9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.882588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-7bd8c573-dc1f-43e7-b0c3-4ae85ec79d9a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0465343 Dec 21 04:17:21.940490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:21.943519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-13281e37-c1d5-4978-834d-bec7786cade0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:21.944916 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-13281e37-c1d5-4978-834d-bec7786cade0 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0478415 Dec 21 04:17:21.947844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:21.949035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e7e99de2-f18f-4a11-979b-0edefc0c80ba tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 704 time: 0.5191574 Dec 21 04:17:21.951689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36512) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:21.953339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] Sync routers for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:21.971301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:21.972194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:21.984420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1bfde336-a278-4e1c-a8ab-3c2379aca59e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 205 time: 0.0293601 Dec 21 04:17:21.984905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:22.043877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:22.051646 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-914b1e5a-c5e0-492b-baf6-39699c00cca7 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899792 Dec 21 04:17:22.064043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.099968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:19Z', 'revision_number': 11, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:22.127822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] Checking router: 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:22.137543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] Routers {'9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:22.138084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:16:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:22.212767 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a9b8180-a3e7-4747-97bd-1d1c9ab82fe2 req-3e8dc88d-25da-4ec7-a598-6494737bd19d service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1542125 Dec 21 04:17:22.221183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] Set router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:22.287490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.290542 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.296176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:19Z', 'revision_number': 11, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:22.332401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f25cbac9-bba5-4cda-b18c-a1eeb3b4b6a7 None None] The sync data for ids ['9c9cc3fe-7006-4d8b-a9f9-9ffebce59246'] in n-d-822053-11 is: [{'id': '9c9cc3fe-7006-4d8b-a9f9-9ffebce59246', 'name': 'tempest-RoutersIpV6Test-router-958861071', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:44Z', 'updated_at': '2021-12-21T04:17:19Z', 'revision_number': 11, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:22.402322 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.409301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router 9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:17:22.417691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.419450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9adb65ae-8825-4066-8c93-39a52f682873 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 204 len: 168 time: 0.4336205 Dec 21 04:17:22.423402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36524) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:22.430543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-556977731', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:22.555029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc15312-aab3-4a9e-9a36-7e7549ede6f8 req-3a553d03-78ec-4b72-b4cf-82b72cd272d2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:22.556561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccc15312-aab3-4a9e-9a36-7e7549ede6f8 req-3a553d03-78ec-4b72-b4cf-82b72cd272d2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1097579 Dec 21 04:17:22.568549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf8a82f-7ffd-4e66-a7fd-83073d008598 req-763c68ff-f153-4c71-b9de-5f247b299e88 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:22.570412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adf8a82f-7ffd-4e66-a7fd-83073d008598 req-763c68ff-f153-4c71-b9de-5f247b299e88 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0855966 Dec 21 04:17:22.602813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.602813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.699412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccc15312-aab3-4a9e-9a36-7e7549ede6f8 req-1197e1a3-07ea-4f4f-ad22-123e87d8fba0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1277916 Dec 21 04:17:22.704329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-adf8a82f-7ffd-4e66-a7fd-83073d008598 req-93c61ff8-68e4-4bfe-9fbf-cbf81c86384e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1268795 Dec 21 04:17:22.705719 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.732500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9d1ced0f-8118-4dcf-8fc5-cc18b66416ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.810717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.875284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:22.876721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d732a664-a79c-48bf-b6f9-df4e6b854c2e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4511921 Dec 21 04:17:22.882249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:22.889708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Request body: {'router': {'admin_state_up': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:22.993154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:23.305061 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:23.423826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:23.508110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:23.728245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Router ddcd9820-4aba-4416-9aa0-00bb97e46749 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:17:23.867008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:17:23.873619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:23.874796 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-425b9f47-c9b6-4ee2-bc7f-c7c436232ccc tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "PUT /v2.0/routers/ddcd9820-4aba-4416-9aa0-00bb97e46749 HTTP/1.1" status: 200 len: 697 time: 0.9905941 Dec 21 04:17:23.877831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36550) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:23.878639 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] Sync routers for ids ['ddcd9820-4aba-4416-9aa0-00bb97e46749'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:17:23.889850 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] Routers {'ddcd9820-4aba-4416-9aa0-00bb97e46749'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:23.890787 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:17:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ddcd9820-4aba-4416-9aa0-00bb97e46749'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:23.926808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e2b65b-daa9-4489-aaaa-f6c8db4cec26 req-3e93b77e-6a58-4c93-840c-029d0c99e8db tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:23.935817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95e2b65b-daa9-4489-aaaa-f6c8db4cec26 req-3e93b77e-6a58-4c93-840c-029d0c99e8db tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1335790 Dec 21 04:17:23.967777 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] Set router ddcd9820-4aba-4416-9aa0-00bb97e46749 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:23.999490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e41a9ba-b141-416d-9cd3-b354247aada1 req-89af6dd1-9e39-48ea-a58f-5a2ae69316cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:24.001073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e41a9ba-b141-416d-9cd3-b354247aada1 req-89af6dd1-9e39-48ea-a58f-5a2ae69316cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1469212 Dec 21 04:17:24.020048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95e2b65b-daa9-4489-aaaa-f6c8db4cec26 req-ed6c08e8-8822-46e0-98f0-52d888962423 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0831225 Dec 21 04:17:24.055065 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-30f90ab9-d98b-48b5-9671-66678535c586 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/routers/ddcd9820-4aba-4416-9aa0-00bb97e46749 HTTP/1.1" status: 200 len: 703 time: 0.1760974 Dec 21 04:17:24.060294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36552) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.065845 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddcd9820-4aba-4416-9aa0-00bb97e46749', 'name': 'tempest-RoutersIpV6Test-router-556977731', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:17:22Z', 'updated_at': '2021-12-21T04:17:23Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:24.094015 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] Checking router: ddcd9820-4aba-4416-9aa0-00bb97e46749 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:17:24.102674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-11c6e02a-0261-4e58-b340-ed57f03b771a tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=ddcd9820-4aba-4416-9aa0-00bb97e46749 HTTP/1.1" status: 200 len: 205 time: 0.0408893 Dec 21 04:17:24.103735 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] Routers {'ddcd9820-4aba-4416-9aa0-00bb97e46749'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:17:24.105413 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36554) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.119322 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:17:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ddcd9820-4aba-4416-9aa0-00bb97e46749'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:24.123027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e41a9ba-b141-416d-9cd3-b354247aada1 req-cc902cdb-d414-4f80-bdc5-f0d1ef051a78 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1006196 Dec 21 04:17:24.191557 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] Set router ddcd9820-4aba-4416-9aa0-00bb97e46749 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:17:24.200557 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:24.246426 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddcd9820-4aba-4416-9aa0-00bb97e46749', 'name': 'tempest-RoutersIpV6Test-router-556977731', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:17:22Z', 'updated_at': '2021-12-21T04:17:23Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:17:24.285568 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46e2ff9c-28ff-40c3-a4f9-8c375dda58d9 None None] The sync data for ids ['ddcd9820-4aba-4416-9aa0-00bb97e46749'] in n-d-822053-11 is: [{'id': 'ddcd9820-4aba-4416-9aa0-00bb97e46749', 'name': 'tempest-RoutersIpV6Test-router-556977731', 'tenant_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:17:22Z', 'updated_at': '2021-12-21T04:17:23Z', 'revision_number': 2, 'project_id': '8c540cedb8fe4db592c00c403a0dc6a9', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:17:24.413621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:24.416835 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:24.523752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:24.524362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Fanout notify agent at l3_agent the message router_deleted on router ddcd9820-4aba-4416-9aa0-00bb97e46749 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:17:24.531825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:24.539541 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77e127ee-2230-415d-b892-a7d7dc54a823 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/ddcd9820-4aba-4416-9aa0-00bb97e46749 HTTP/1.1" status: 204 len: 168 time: 0.4263921 Dec 21 04:17:24.540986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36558) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.580603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bdc30a95-3b7c-4c38-8054-1dc53bce01e7 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=ddcd9820-4aba-4416-9aa0-00bb97e46749 HTTP/1.1" status: 200 len: 205 time: 0.0381162 Dec 21 04:17:24.582963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36560) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.631671 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-4054ac8e-1e3e-42f4-9fb7-131c5dea1b72 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:24.632650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4054ac8e-1e3e-42f4-9fb7-131c5dea1b72 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/ddcd9820-4aba-4416-9aa0-00bb97e46749 HTTP/1.1" status: 404 len: 336 time: 0.0481355 Dec 21 04:17:24.635310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36562) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.665734 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b149750-6816-4ca9-aab0-0a952b26b90d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:24.666227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b149750-6816-4ca9-aab0-0a952b26b90d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:24.669387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1b149750-6816-4ca9-aab0-0a952b26b90d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/d6af1a01-067a-4ed9-96db-0b0d216bd835 HTTP/1.1" status: 404 len: 337 time: 0.0329931 Dec 21 04:17:24.672020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36564) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.702425 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-bcf467e0-576e-4817-972c-e51949938325 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:24.702923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bcf467e0-576e-4817-972c-e51949938325 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:24.706982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bcf467e0-576e-4817-972c-e51949938325 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/79b89a53-4402-4b83-b14f-d2deb08e98fd HTTP/1.1" status: 404 len: 337 time: 0.0329494 Dec 21 04:17:24.709267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.737487 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-fa08e969-a765-43c6-a15b-c7dbd4f342b4 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:24.738200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fa08e969-a765-43c6-a15b-c7dbd4f342b4 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:24.741527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa08e969-a765-43c6-a15b-c7dbd4f342b4 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/366e22cc-23c7-4f8a-b45d-18713d1ac225 HTTP/1.1" status: 404 len: 337 time: 0.0310681 Dec 21 04:17:24.744127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36568) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.771993 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-2f875a89-54b2-4f25-b5a8-c01def0656b4 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:24.772453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2f875a89-54b2-4f25-b5a8-c01def0656b4 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:24.778263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2f875a89-54b2-4f25-b5a8-c01def0656b4 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/1516c5d5-40ed-4ede-b48a-32897eb2e1f9 HTTP/1.1" status: 404 len: 337 time: 0.0308239 Dec 21 04:17:24.778624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.817140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36572) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.818914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f4c17457-160d-42f7-bcc9-a7aa60bcc9c1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 200 len: 205 time: 0.0376098 Dec 21 04:17:24.916540 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-3a362cac-5caa-4dc8-9d15-59663a91268e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:24.918994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3a362cac-5caa-4dc8-9d15-59663a91268e tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/9c9cc3fe-7006-4d8b-a9f9-9ffebce59246 HTTP/1.1" status: 404 len: 336 time: 0.0989251 Dec 21 04:17:24.920663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36574) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:24.953488 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1e3420cc-45aa-4930-bd95-b00c76d5bb66 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=22f08be2-3bed-4e09-8c3a-6244934b230d HTTP/1.1" status: 200 len: 205 time: 0.0315242 Dec 21 04:17:24.955734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36576) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.008266 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-454c733a-b17d-4f82-9a89-681d4dc6d41f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:25.009333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-454c733a-b17d-4f82-9a89-681d4dc6d41f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/22f08be2-3bed-4e09-8c3a-6244934b230d HTTP/1.1" status: 404 len: 336 time: 0.0526860 Dec 21 04:17:25.011865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36578) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.030739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:25.044894 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-fa9c4fc3-a433-486a-a2a9-e5a2835c0c9b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:25.052363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fa9c4fc3-a433-486a-a2a9-e5a2835c0c9b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:25.057829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fa9c4fc3-a433-486a-a2a9-e5a2835c0c9b tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/5c0e333f-0fee-4ff1-8247-c7f31d4833c3 HTTP/1.1" status: 404 len: 337 time: 0.0447123 Dec 21 04:17:25.060541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.115301 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d1d0f5e-7774-4943-83da-94dd6b7f30e3 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 200 len: 205 time: 0.0528586 Dec 21 04:17:25.117904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36584) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.122278 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:25.171801 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-02e05caa-7690-4e8a-a91a-e57d4218f53d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:25.175337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-02e05caa-7690-4e8a-a91a-e57d4218f53d tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/a4c145c3-f1bd-4866-859e-23da74e5a9e9 HTTP/1.1" status: 404 len: 336 time: 0.0540948 Dec 21 04:17:25.175765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.216318 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-602e3fc5-b247-430d-ba70-d69b2100cfb1 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=f1509aee-4826-466b-935b-22c54bb1a00f HTTP/1.1" status: 200 len: 205 time: 0.0368862 Dec 21 04:17:25.216940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36590) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.258775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d01b04c3-d223-4e93-8a71-93f369fd6005 req-87c1b095-81f0-46ef-bd26-e92e32842b18 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:25.261908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d01b04c3-d223-4e93-8a71-93f369fd6005 req-87c1b095-81f0-46ef-bd26-e92e32842b18 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0924368 Dec 21 04:17:25.289487 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-e5d3b020-1215-4c94-8f49-01ba662c4a66 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:25.293694 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e5d3b020-1215-4c94-8f49-01ba662c4a66 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/f1509aee-4826-466b-935b-22c54bb1a00f HTTP/1.1" status: 404 len: 336 time: 0.0634227 Dec 21 04:17:25.294069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.329991 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-4c0c8223-ec6f-42f4-a7d2-b05db195dc79 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:25.330678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4c0c8223-ec6f-42f4-a7d2-b05db195dc79 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:25.335305 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4c0c8223-ec6f-42f4-a7d2-b05db195dc79 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/d6db0b85-915d-4cae-9fe7-4d04fb117909 HTTP/1.1" status: 404 len: 337 time: 0.0397928 Dec 21 04:17:25.337936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36594) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.354326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003f5620-d99f-4835-bfdb-3226eba1db5f req-01326382-a9d1-4264-9cc7-92c8eb1563c8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:25.355992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-003f5620-d99f-4835-bfdb-3226eba1db5f req-01326382-a9d1-4264-9cc7-92c8eb1563c8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0916872 Dec 21 04:17:25.376996 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8b1bcf94-d139-4e56-a56a-588fd7ca0e68 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=09e558eb-89a7-4b32-ae3c-a0c4f83f9535 HTTP/1.1" status: 200 len: 205 time: 0.0375602 Dec 21 04:17:25.379826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36596) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.419137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d01b04c3-d223-4e93-8a71-93f369fd6005 req-685dc265-6450-4769-9259-96b38e487acc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1440725 Dec 21 04:17:25.471448 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-f742d329-d2a0-4d99-9fc0-397cf11e8a85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:25.475978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f742d329-d2a0-4d99-9fc0-397cf11e8a85 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/09e558eb-89a7-4b32-ae3c-a0c4f83f9535 HTTP/1.1" status: 404 len: 336 time: 0.0934978 Dec 21 04:17:25.476840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36598) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.504936 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-992afef8-5550-4b8b-bba7-75ea8faf578f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:25.506485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-992afef8-5550-4b8b-bba7-75ea8faf578f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:25.508835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-003f5620-d99f-4835-bfdb-3226eba1db5f req-051b54ce-5591-46fb-a82f-2c6087907090 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1345024 Dec 21 04:17:25.513301 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-992afef8-5550-4b8b-bba7-75ea8faf578f tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/f32bf567-7d81-4911-924e-f233445eae01 HTTP/1.1" status: 404 len: 337 time: 0.0353036 Dec 21 04:17:25.514128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.550183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36602) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.550867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2492111a-4632-4bae-95b0-48565cbada57 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "GET /v2.0/ports?device_id=633ea4a8-d611-4eba-ac84-65430b3da36f HTTP/1.1" status: 200 len: 205 time: 0.0352221 Dec 21 04:17:25.607978 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-a4f49e4c-c8c7-498c-9206-7ec2131f3aec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] delete failed (client error): The resource could not be found. Dec 21 04:17:25.609043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a4f49e4c-c8c7-498c-9206-7ec2131f3aec tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/routers/633ea4a8-d611-4eba-ac84-65430b3da36f HTTP/1.1" status: 404 len: 336 time: 0.0573571 Dec 21 04:17:25.611979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36606) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.644273 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-e2f8820c-6ef1-4d1e-98b4-c43f81290b82 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:25.644737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e2f8820c-6ef1-4d1e-98b4-c43f81290b82 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:25.648520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e2f8820c-6ef1-4d1e-98b4-c43f81290b82 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/fc010469-3a38-48d6-b343-2dde2753849c HTTP/1.1" status: 404 len: 337 time: 0.0352619 Dec 21 04:17:25.651245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36608) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:25.697453 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d108f4c3-5ac1-44d1-ae4e-3d995d92c072 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] DELETE failed (client error): The resource could not be found. Dec 21 04:17:25.698291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d108f4c3-5ac1-44d1-ae4e-3d995d92c072 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:17:25.705919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d108f4c3-5ac1-44d1-ae4e-3d995d92c072 tempest-RoutersIpV6Test-1010932718 tempest-RoutersIpV6Test-1010932718-project] 10.222.0.18 "DELETE /v2.0/subnets/5e23a514-08a5-4f3b-ac89-5d064a78b462 HTTP/1.1" status: 404 len: 337 time: 0.0500648 Dec 21 04:17:25.766004 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:26.226521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36616) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:26.403958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8c03d41e-cc96-4f4a-8ce6-b3eefc290033 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=8c540cedb8fe4db592c00c403a0dc6a9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1761870 Dec 21 04:17:26.406577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36622) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:26.474681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:26.510167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:26.624131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f620ec8-b335-4667-9d87-6b93c738aaf0 req-ee11d9e4-fc3b-40f1-8d2d-4f86384df40b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:26.625737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f620ec8-b335-4667-9d87-6b93c738aaf0 req-ee11d9e4-fc3b-40f1-8d2d-4f86384df40b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0926437 Dec 21 04:17:26.718272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04fb1197-1f61-48a0-975e-06778a3f2154 req-276b2b71-8da1-42de-9e0d-dd88a25f813f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:26.720279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04fb1197-1f61-48a0-975e-06778a3f2154 req-276b2b71-8da1-42de-9e0d-dd88a25f813f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0931368 Dec 21 04:17:26.721994 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:26.725244 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:26.726392 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1152ef04-d9b9-40a0-8592-3dc2f1f4caa4 HTTP/1.1" status: 204 len: 168 time: 0.3182542 Dec 21 04:17:26.734544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1152ef04-d9b9-40a0-8592-3dc2f1f4caa4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:26.742725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.743099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.743449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.743798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.744133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.744491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.744851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.745393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.745741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.746076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.746539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.746963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.747282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f1d2e17-7980-4c3f-8922-fc8f5fe70645 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:26.747754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f620ec8-b335-4667-9d87-6b93c738aaf0 req-b4a1eba9-042c-4ef6-ad8a-a164a662db40 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1105134 Dec 21 04:17:26.838235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04fb1197-1f61-48a0-975e-06778a3f2154 req-842147b9-1686-4187-af81-d5a3a589c7a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1067216 Dec 21 04:17:28.019403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ca7ef7-b1a4-404c-ba0b-07a24955d243 req-eaff3738-e6a4-4fa9-bce9-658e278e168e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:28.021932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00ca7ef7-b1a4-404c-ba0b-07a24955d243 req-eaff3738-e6a4-4fa9-bce9-658e278e168e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1708159 Dec 21 04:17:28.036962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20aab3b-417b-46e6-8ecb-33b8a04243cb req-39d66d63-2eb9-4751-8db2-978a63bf8ca1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:28.039166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e20aab3b-417b-46e6-8ecb-33b8a04243cb req-39d66d63-2eb9-4751-8db2-978a63bf8ca1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1083429 Dec 21 04:17:28.136359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00ca7ef7-b1a4-404c-ba0b-07a24955d243 req-6e253a2e-1851-4654-8fe3-d2e4ece87ada tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0952229 Dec 21 04:17:28.189734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e20aab3b-417b-46e6-8ecb-33b8a04243cb req-4913c3d8-a15f-43c6-83d1-82d77a8449bf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1314869 Dec 21 04:17:29.372047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffb5807-e173-42c0-984f-187dd541547c req-7b9cead6-5307-4bb9-994a-012152d76e31 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:29.373618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffb5807-e173-42c0-984f-187dd541547c req-7b9cead6-5307-4bb9-994a-012152d76e31 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1017566 Dec 21 04:17:29.381888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8ab33f-64f5-4626-b7d8-b804c72e185a req-03a6d504-6b28-417c-b820-f6c96683dd9b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:29.389024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c8ab33f-64f5-4626-b7d8-b804c72e185a req-03a6d504-6b28-417c-b820-f6c96683dd9b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0874710 Dec 21 04:17:29.463379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c8ab33f-64f5-4626-b7d8-b804c72e185a req-563abad1-ab5e-47aa-9e59-62e7dc4b035f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0733299 Dec 21 04:17:29.523040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffb5807-e173-42c0-984f-187dd541547c req-251e9001-5747-45f2-ad6f-8f0dbd6a1128 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1319275 Dec 21 04:17:30.334463 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-d2db832c-5eeb-4633-bcc2-945ff10ebf59 service neutron] show failed (client error): The resource could not be found. Dec 21 04:17:30.335489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-d2db832c-5eeb-4633-bcc2-945ff10ebf59 service neutron] 10.222.0.31 "GET /v2.0/ports/9b09c638-7de6-406b-80c2-cfca2ee126e8/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0547040 Dec 21 04:17:30.647530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e8b645-00e0-4771-b012-81245d687dd3 req-45f2698e-5533-4198-b08a-9c2c94c0844a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:30.656268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1e8b645-00e0-4771-b012-81245d687dd3 req-45f2698e-5533-4198-b08a-9c2c94c0844a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1114743 Dec 21 04:17:30.742288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39111cfc-0613-4746-8f0c-e638596cc100 req-0d588392-dbbb-41d5-80e1-8b2e75784983 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:30.744075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39111cfc-0613-4746-8f0c-e638596cc100 req-0d588392-dbbb-41d5-80e1-8b2e75784983 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0769560 Dec 21 04:17:30.767637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1e8b645-00e0-4771-b012-81245d687dd3 req-e7cd3f46-35bc-4807-a6c3-e33ea01efa68 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1100075 Dec 21 04:17:30.810198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39111cfc-0613-4746-8f0c-e638596cc100 req-1d0f86c8-9214-4df2-b409-46f666948e5b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575948 Dec 21 04:17:31.939680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c6c45f-8de6-4225-a736-d9e8be425c7e req-10341aac-6d38-43e1-89dc-d2e4de1e76be tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:31.941205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0c6c45f-8de6-4225-a736-d9e8be425c7e req-10341aac-6d38-43e1-89dc-d2e4de1e76be tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0907037 Dec 21 04:17:31.974072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4a10f7-6545-4293-8418-c111bf3b3728 req-096ad04a-83cb-4a60-a7e3-664070d2f32a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:31.975637 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df4a10f7-6545-4293-8418-c111bf3b3728 req-096ad04a-83cb-4a60-a7e3-664070d2f32a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0802138 Dec 21 04:17:32.023783 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0c6c45f-8de6-4225-a736-d9e8be425c7e req-23758775-b6c6-4db4-990b-d5dad5a2a365 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0743220 Dec 21 04:17:32.055331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df4a10f7-6545-4293-8418-c111bf3b3728 req-6f65c14c-8544-4beb-a96e-3702bea9731c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734992 Dec 21 04:17:33.248755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0cafc8e-2163-4eb5-aa48-2f24f996c50c req-6bd5b530-fd55-4539-94dd-83ccb9c96db0 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:33.256524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0cafc8e-2163-4eb5-aa48-2f24f996c50c req-6bd5b530-fd55-4539-94dd-83ccb9c96db0 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1250184 Dec 21 04:17:33.285210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d915bd09-d532-47a6-b040-2393bee572db req-549bd650-73dd-4f03-b877-c2c4e99c0dba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:33.287701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d915bd09-d532-47a6-b040-2393bee572db req-549bd650-73dd-4f03-b877-c2c4e99c0dba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.1408012 Dec 21 04:17:33.359843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d915bd09-d532-47a6-b040-2393bee572db req-87185579-78d9-41a0-9ca9-2b205b6186ac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631621 Dec 21 04:17:33.420000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0cafc8e-2163-4eb5-aa48-2f24f996c50c req-b4713790-6f01-49b0-a15c-0d5647ec97f8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1549923 Dec 21 04:17:34.320473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-88f33790-2c23-436b-a49c-6c133cfbcc8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:34.322634 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-88f33790-2c23-436b-a49c-6c133cfbcc8a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 1097 time: 0.0457871 Dec 21 04:17:34.342666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:34.399801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:34.527129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f708ba56-5225-48cf-8b11-72b148d9e19a req-4611cf27-dc03-4366-b644-e07885429d8a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:34.535030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f708ba56-5225-48cf-8b11-72b148d9e19a req-4611cf27-dc03-4366-b644-e07885429d8a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0672328 Dec 21 04:17:34.623392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f708ba56-5225-48cf-8b11-72b148d9e19a req-6fa149dd-f32a-4c4b-b610-24219f946654 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0874178 Dec 21 04:17:34.642831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bb0545-7cd5-460c-b285-8ebfb4a89f64 req-8d282f88-70ac-474c-94cc-c57e6d165ebd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:34.644455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71bb0545-7cd5-460c-b285-8ebfb4a89f64 req-8d282f88-70ac-474c-94cc-c57e6d165ebd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1073678 Dec 21 04:17:34.688109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:34.702854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71bb0545-7cd5-460c-b285-8ebfb4a89f64 req-ee063c0c-bf0e-425e-89b2-0f8bc5705029 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0513690 Dec 21 04:17:34.738153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:34.813173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:34.902702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:34.905700 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc346da9-7331-45a0-9d80-58278426a2b8" -d '{"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-unplugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:34.910249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:34.935370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Transition to ACTIVE for port object 9b09c638-7de6-406b-80c2-cfca2ee126e8 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:17:34.992915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:34.997768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:35.166352 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:17:35.166720 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:17:35.212739 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-478e09df-bab2-4b18-a649-067316473735 x-openstack-request-id: req-478e09df-bab2-4b18-a649-067316473735 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:35.213080 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-unplugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:35.213302 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-478e09df-bab2-4b18-a649-067316473735 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:35.213717 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'code': 200} Dec 21 04:17:35.238430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:35.299103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] No DVR routers for this DVR port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:35.478021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:17:35.478737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:17:35.480298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:35.488340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:17:35.489171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:35.494340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 17, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:17:35.494678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Checking segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:17:35.495583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Bound using segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:17:35.496026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Bound port: 9b09c638-7de6-406b-80c2-cfca2ee126e8, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:17:35.496382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:35.570466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:35.573828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:17:35.632586 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:35.702714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:35.703374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:35.704809 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] 10.222.0.54 "PUT /v2.0/ports/9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1092 time: 1.3664069 Dec 21 04:17:35.733443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fefd08e-33ef-4d40-b18d-606d3943c948 service neutron] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:35.846519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4682eac1-ef78-4cac-bda6-8eac6c79c887 req-6085817e-3017-45af-82f3-59ef55a30dcf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:35.851861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-9645751d-18d8-40c9-9f51-0c7c1cf727f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:35.853464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4682eac1-ef78-4cac-bda6-8eac6c79c887 req-6085817e-3017-45af-82f3-59ef55a30dcf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.1417654 Dec 21 04:17:35.857961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-9645751d-18d8-40c9-9f51-0c7c1cf727f6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1095 time: 0.1021249 Dec 21 04:17:35.956183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0025d3-28a3-4ede-9a4a-059464010e05 req-df40ef5a-cb0b-4acf-aad0-6721ac652dc3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:35.963866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb0025d3-28a3-4ede-9a4a-059464010e05 req-df40ef5a-cb0b-4acf-aad0-6721ac652dc3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.1093528 Dec 21 04:17:35.987298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-e1a56e41-2cec-416e-bf95-cffddff6017f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:35.989049 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-e1a56e41-2cec-416e-bf95-cffddff6017f service neutron] 10.222.0.54 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1246064 Dec 21 04:17:36.017872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4682eac1-ef78-4cac-bda6-8eac6c79c887 req-5f97301d-99b7-4a8c-bc94-eac64440bf26 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1550155 Dec 21 04:17:36.047309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb0025d3-28a3-4ede-9a4a-059464010e05 req-51bf0df8-4006-48c1-be70-def4c59305d5 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0821989 Dec 21 04:17:36.061624 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-cf4ab171-be27-4409-9be8-0ce4e745485d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.0650184 Dec 21 04:17:36.139665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-1e78db90-50ea-4035-a26c-d2ac19598dda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:36.141192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-1e78db90-50ea-4035-a26c-d2ac19598dda service neutron] 10.222.0.54 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0722356 Dec 21 04:17:36.196486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-a729cfd4-4882-4e40-9ce0-adb0942a0116 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:36.197991 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-a729cfd4-4882-4e40-9ce0-adb0942a0116 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0497215 Dec 21 04:17:36.304210 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-3a310e61-4490-4acd-99b9-674414de846d service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0987039 Dec 21 04:17:36.401686 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-084ded99-22b9-4022-8c5b-811299aa2ca7 service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907378 Dec 21 04:17:37.215056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:37.217397 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755" -d '{"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:37.223555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01dce6f-7b09-47e8-80a0-8182b3d6430d req-846b5755-f44c-424a-972c-7fd99c20b1c1 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.226149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f01dce6f-7b09-47e8-80a0-8182b3d6430d req-846b5755-f44c-424a-972c-7fd99c20b1c1 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0729983 Dec 21 04:17:37.315724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f01dce6f-7b09-47e8-80a0-8182b3d6430d req-a334f3b9-e647-447c-bee2-9067b1f979ed tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0823977 Dec 21 04:17:37.356805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b97785e-a676-464c-b7be-b3e6f12ed830 req-00826137-a4be-4429-83d3-81f36e2f106e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.356805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b97785e-a676-464c-b7be-b3e6f12ed830 req-00826137-a4be-4429-83d3-81f36e2f106e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.2620656 Dec 21 04:17:37.395536 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66e63fe4-dd48-448e-acb5-463c3a6be35d x-openstack-request-id: req-66e63fe4-dd48-448e-acb5-463c3a6be35d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:37.396020 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:37.399066 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-66e63fe4-dd48-448e-acb5-463c3a6be35d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:37.399066 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'status': 'completed', 'code': 200} Dec 21 04:17:37.419573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b97785e-a676-464c-b7be-b3e6f12ed830 req-86cdecc5-e111-490a-aafe-a375338adcb7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0589204 Dec 21 04:17:37.506564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-12313cc5-f301-4c95-bb7b-c6c8dc33900d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.515824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-12313cc5-f301-4c95-bb7b-c6c8dc33900d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1095 time: 0.0541363 Dec 21 04:17:37.518417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-2f5dd980-9d22-4524-8644-b7c09afac577 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.520553 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-2f5dd980-9d22-4524-8644-b7c09afac577 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1095 time: 0.0583515 Dec 21 04:17:37.648936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-69c87973-76bf-4dbb-b9e3-a376cf5423b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.650492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-69c87973-76bf-4dbb-b9e3-a376cf5423b6 service neutron] 10.222.0.54 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1208377 Dec 21 04:17:37.658511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-3c2d14d8-b3ae-4990-b5cd-2c0a92ed47db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.660728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-3c2d14d8-b3ae-4990-b5cd-2c0a92ed47db service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1346703 Dec 21 04:17:37.736600 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-e36b3876-2776-4593-bdfd-de2767579dcd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.0780363 Dec 21 04:17:37.746596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-4e374c9c-172d-4544-91fe-d9d2bd76d299 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.0743794 Dec 21 04:17:37.791585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-9228715f-e665-4a49-9f70-4bf1b4bdd81b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.793155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-9228715f-e665-4a49-9f70-4bf1b4bdd81b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0490711 Dec 21 04:17:37.801853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-e461d8b6-6531-4297-ad91-69f9334b5ded service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.803925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-e461d8b6-6531-4297-ad91-69f9334b5ded service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0457928 Dec 21 04:17:37.870851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-01fc1601-d08b-451f-b0e5-7bfd783bfb35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.870851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-01fc1601-d08b-451f-b0e5-7bfd783bfb35 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0699673 Dec 21 04:17:37.899948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-bf4a8eb7-ef06-45dd-a343-ddc852191c50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:37.901462 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-bf4a8eb7-ef06-45dd-a343-ddc852191c50 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0817180 Dec 21 04:17:38.014102 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-26fad5cc-69de-4e5f-924e-613b2e4c6554 service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1336303 Dec 21 04:17:38.024501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-ead0506c-ef0e-41f5-9958-ab82ee1955eb service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1102657 Dec 21 04:17:38.121423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-3991eb94-09a7-4a22-a0ee-e51240f622d3 service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0984969 Dec 21 04:17:38.145968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdac2f73-e04f-41e9-93a2-6c16ed4b9755 req-a4b6c7c6-324b-4cfa-9e52-8d704963a7ae service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1133060 Dec 21 04:17:38.384782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36870) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:38.454486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249929c5-203c-4ba1-ad69-b0074c8f66cb req-b64ed74f-4782-488a-86fe-f8bb412b84d4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:38.456006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-249929c5-203c-4ba1-ad69-b0074c8f66cb req-b64ed74f-4782-488a-86fe-f8bb412b84d4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0528824 Dec 21 04:17:38.527583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-249929c5-203c-4ba1-ad69-b0074c8f66cb req-98d920f9-c2e2-458d-9bcb-ea826c3931ae tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0546412 Dec 21 04:17:38.561286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce4d5727-5ce1-4562-9d15-24689afe2f5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.602824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0658467-7af6-4aa9-87b4-98fcd14fd065 req-b3baffc4-3cd5-489a-8fd4-ed959167e8aa tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:38.604845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0658467-7af6-4aa9-87b4-98fcd14fd065 req-b3baffc4-3cd5-489a-8fd4-ed959167e8aa tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0692830 Dec 21 04:17:38.663315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce4d5727-5ce1-4562-9d15-24689afe2f5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.667618 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0658467-7af6-4aa9-87b4-98fcd14fd065 req-ad24f90a-264f-4833-8926-f78c82c21109 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566130 Dec 21 04:17:38.740469 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce4d5727-5ce1-4562-9d15-24689afe2f5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.778270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce4d5727-5ce1-4562-9d15-24689afe2f5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cff8d49-ca9c-434f-b0e7-7d0572585ce8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:38.782478 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ce4d5727-5ce1-4562-9d15-24689afe2f5b admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d358c7fe576443cf969106a9e217a2ba&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3967166 Dec 21 04:17:38.785276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36880) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:38.838851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76d9fafd-8edf-4f77-9968-cecbe1b83945 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.867045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76d9fafd-8edf-4f77-9968-cecbe1b83945 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.886318 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:17:38.980257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76d9fafd-8edf-4f77-9968-cecbe1b83945 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.983000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76d9fafd-8edf-4f77-9968-cecbe1b83945 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:38.984311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76d9fafd-8edf-4f77-9968-cecbe1b83945 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4cff8d49-ca9c-434f-b0e7-7d0572585ce8 HTTP/1.1" status: 204 len: 168 time: 0.1980662 Dec 21 04:17:38.992673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76d9fafd-8edf-4f77-9968-cecbe1b83945 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cff8d49-ca9c-434f-b0e7-7d0572585ce8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:39.565928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 36902) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:39.581145 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d8baa3f-3aac-4157-9a89-e07b7d22719d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:39.672319 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d8baa3f-3aac-4157-9a89-e07b7d22719d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:39.717316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d8baa3f-3aac-4157-9a89-e07b7d22719d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:39.768068 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d8baa3f-3aac-4157-9a89-e07b7d22719d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=362b4ea0819f4d3d8196c0c3f475c3e1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2006049 Dec 21 04:17:39.769232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d8baa3f-3aac-4157-9a89-e07b7d22719d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a4977a8-42c2-419f-bc84-16670d347ad9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:39.770659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 36910) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:39.829656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1d714a-2f5b-4cb8-9a1a-dbc5392ce1fd req-2b10d408-295e-430c-837c-487cbe7184e5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:39.831206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d1d714a-2f5b-4cb8-9a1a-dbc5392ce1fd req-2b10d408-295e-430c-837c-487cbe7184e5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0914652 Dec 21 04:17:39.848653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:39.917093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:39.944420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d1d714a-2f5b-4cb8-9a1a-dbc5392ce1fd req-0b1591ed-b45f-4b79-9211-4934af8277d6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1058693 Dec 21 04:17:39.979458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c92001-b927-44ae-a680-68a50bb2e74c req-efd14aa7-560e-4c1d-bcd9-f754de34fbc2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:39.981015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90c92001-b927-44ae-a680-68a50bb2e74c req-efd14aa7-560e-4c1d-bcd9-f754de34fbc2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.3830004 Dec 21 04:17:40.044326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90c92001-b927-44ae-a680-68a50bb2e74c req-69fba17f-ee18-4db6-9565-c9160313e647 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481157 Dec 21 04:17:40.111787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:40.114356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:40.115549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2a4977a8-42c2-419f-bc84-16670d347ad9 HTTP/1.1" status: 204 len: 168 time: 0.3438725 Dec 21 04:17:40.123447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a4977a8-42c2-419f-bc84-16670d347ad9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:40.132137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.132495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.132842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.133219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.133705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.134047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.134387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.134720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.135234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.135591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.135953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.137120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.137120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89df344d-6cea-4579-9a19-5a8f72f6ae5e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.398716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:17:40.522680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:40.537433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'mac_address': 'fa:16:3e:f5:3b:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:17:40.543443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6927ff6d-eb6e-4090-a3b5-2db2f503ed7d req-b448f58c-cce2-464b-be2a-bf24efd72746 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:40.544997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6927ff6d-eb6e-4090-a3b5-2db2f503ed7d req-b448f58c-cce2-464b-be2a-bf24efd72746 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 943 time: 0.0919843 Dec 21 04:17:40.578919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:40.595409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b09c638-7de6-406b-80c2-cfca2ee126e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:17:40.617400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-84228e7f-129f-4ca7-b222-6ad2a96e275b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:40.618093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6927ff6d-eb6e-4090-a3b5-2db2f503ed7d req-479ab5a6-372e-477c-9cad-79631bbc117a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663974 Dec 21 04:17:40.628386 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-84228e7f-129f-4ca7-b222-6ad2a96e275b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.54 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da&tenant_id=10a032d25985452584a3dcdae6969809&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 943 time: 0.1388981 Dec 21 04:17:40.644641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:40.702654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c974bf32-b51f-4d61-90e8-569a09c9dc0e service neutron] 10.222.0.54 "GET /v2.0/ports/9b09c638-7de6-406b-80c2-cfca2ee126e8/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.0655088 Dec 21 04:17:40.723282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:40.770085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:40.778656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.779249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.779637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.780060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.780452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.781408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.781809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.782204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.782699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.783352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.783689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.784024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.784362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:17:40.797175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-e9fef7ab-0cdb-4e2a-99bc-cd92dc3e9566 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:40.798732 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-e9fef7ab-0cdb-4e2a-99bc-cd92dc3e9566 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1096 time: 0.0443192 Dec 21 04:17:40.905241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-5a19753c-6c91-4f6b-8fe9-6f5b5199e73c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:40.906732 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-5a19753c-6c91-4f6b-8fe9-6f5b5199e73c service neutron] 10.222.0.54 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.0998104 Dec 21 04:17:40.974109 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-a0d9d21e-f7ec-4808-af27-bdd8bdc614ed service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1000 time: 0.0593138 Dec 21 04:17:41.031010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-67db4bbc-aca6-48e5-917d-cc1b75eefb74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:41.033114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-67db4bbc-aca6-48e5-917d-cc1b75eefb74 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0501390 Dec 21 04:17:41.041183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9b09c638-7de6-406b-80c2-cfca2ee126e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:17:41.091653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-d074413e-36b5-4260-8a8e-4ff834b4d877 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:41.093484 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-d074413e-36b5-4260-8a8e-4ff834b4d877 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0517612 Dec 21 04:17:41.210143 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-cdde18ec-dce0-47c4-831f-8022ab7a596b service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1083291 Dec 21 04:17:41.228770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d450494c-1b00-4960-9f9c-5aff391c190c req-3340cdfc-3929-4bd4-a2f3-1ec446c0b7b7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:41.237994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d450494c-1b00-4960-9f9c-5aff391c190c req-3340cdfc-3929-4bd4-a2f3-1ec446c0b7b7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0760956 Dec 21 04:17:41.310678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d450494c-1b00-4960-9f9c-5aff391c190c req-15239dd1-d814-430f-9b59-a98928bc213d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0714791 Dec 21 04:17:41.342199 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-023929de-5a28-4c53-a172-f3870e5d7593 service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248338 Dec 21 04:17:41.761133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f73cbb4-fbc8-4400-93d1-af62ef41f03e req-6c02dcb2-d225-4c2c-904a-8e5ae4e01762 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:41.762771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f73cbb4-fbc8-4400-93d1-af62ef41f03e req-6c02dcb2-d225-4c2c-904a-8e5ae4e01762 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 944 time: 0.0706899 Dec 21 04:17:41.823826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f73cbb4-fbc8-4400-93d1-af62ef41f03e req-8524b8b7-d209-4b2f-8345-f195f3ad889f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506568 Dec 21 04:17:42.405280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:17:42.438365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:42.464964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02300dae-589b-4e3d-94cb-d6f3bdc90327 req-273405ae-d7a6-4004-8675-cfe3b82570cd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:42.466970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02300dae-589b-4e3d-94cb-d6f3bdc90327 req-273405ae-d7a6-4004-8675-cfe3b82570cd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 944 time: 0.0711136 Dec 21 04:17:42.525183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02300dae-589b-4e3d-94cb-d6f3bdc90327 req-8adbb51d-012c-449a-b875-0b2c0e0ad315 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0513463 Dec 21 04:17:42.543099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:42.556081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'port_id': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'mac_address': 'fa:16:3e:75:f1:18', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:17:42.593929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:17:42.610819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:42.610819 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:42.617340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:42.656362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ac11126b-e25e-4a58-b9ab-db17cde3b083 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:17:42.691530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:42.733800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:42.754096 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:42.807897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:42.818904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:42.822432 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5116b545-922d-40e4-b81d-18e48573770a" -d '{"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:42.835963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:42.876112 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6940aa9-bf9c-49ec-a88d-8dcfe428329b x-openstack-request-id: req-c6940aa9-bf9c-49ec-a88d-8dcfe428329b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:42.876689 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:42.876958 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c6940aa9-bf9c-49ec-a88d-8dcfe428329b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:42.877395 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'code': 200} Dec 21 04:17:42.884469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:42.940833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:42.966407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61337f81-cebc-4f5f-afe8-1684f132a0ed req-50ea9e10-4b4b-44f0-ba74-3ab9b69df125 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:42.968063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61337f81-cebc-4f5f-afe8-1684f132a0ed req-50ea9e10-4b4b-44f0-ba74-3ab9b69df125 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0581791 Dec 21 04:17:43.031105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61337f81-cebc-4f5f-afe8-1684f132a0ed req-3ab62b8f-dad4-406b-8706-833d72123745 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473597 Dec 21 04:17:43.055816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['ac11126b-e25e-4a58-b9ab-db17cde3b083'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:17:43.678870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c610d84-53e1-4636-9bc0-2b9c1f556245 req-1ca47c3c-b9ce-4f35-9ca1-f61ae712052f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:43.680430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c610d84-53e1-4636-9bc0-2b9c1f556245 req-1ca47c3c-b9ce-4f35-9ca1-f61ae712052f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 945 time: 0.0525882 Dec 21 04:17:43.730828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c610d84-53e1-4636-9bc0-2b9c1f556245 req-21a658a8-5e71-4b4a-a92b-b3a407f74598 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440476 Dec 21 04:17:44.186159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33fe8045-ca2d-4733-9de1-9107aacc4d91 req-b8b318d6-301b-412a-9552-84cf1132f0ac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:44.187809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33fe8045-ca2d-4733-9de1-9107aacc4d91 req-b8b318d6-301b-412a-9552-84cf1132f0ac tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0767910 Dec 21 04:17:44.253203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33fe8045-ca2d-4733-9de1-9107aacc4d91 req-b70f71d5-3555-422d-8e08-61edcca3d79c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0585194 Dec 21 04:17:44.419264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:44.430160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-959db43d-10f5-431e-bb4b-ea5dd7083cb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:44.436427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-959db43d-10f5-431e-bb4b-ea5dd7083cb7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 1097 time: 0.0955019 Dec 21 04:17:44.458819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:17:44.471360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port ac11126b-e25e-4a58-b9ab-db17cde3b083 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:44.471736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:44.551792 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:44.578022 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:44.632401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:44.723507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:44.808017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=10']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:44.879195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:44.891734 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-252431cf-50c6-4201-b00a-9249c3a0c85c" -d '{"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-plugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:44.931793 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de936704-1f8a-4847-bf0b-53f52cee2c45 x-openstack-request-id: req-de936704-1f8a-4847-bf0b-53f52cee2c45 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:44.932191 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-plugged", "status": "completed", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:44.932454 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-de936704-1f8a-4847-bf0b-53f52cee2c45 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:44.932878 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'code': 200} Dec 21 04:17:45.150069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96eb9b78-225a-480e-97dd-6f298a9eeb49 req-dc645e93-e189-4f1f-adc9-d67ca7589051 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:45.151675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96eb9b78-225a-480e-97dd-6f298a9eeb49 req-dc645e93-e189-4f1f-adc9-d67ca7589051 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.1030002 Dec 21 04:17:45.159612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:45.227923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:45.262878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbdb0fc5-e556-460c-8aae-1f506cbd059f req-c88d75da-92dc-441e-9fcc-08c46d233566 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:45.264597 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cbdb0fc5-e556-460c-8aae-1f506cbd059f req-c88d75da-92dc-441e-9fcc-08c46d233566 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 1099 time: 0.0444245 Dec 21 04:17:45.268017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-96eb9b78-225a-480e-97dd-6f298a9eeb49 req-4e79c7ce-99c4-4fd8-bd6c-8a2dcb633546 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1058364 Dec 21 04:17:45.299524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:45.305787 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4da88e00-e6f8-4c4c-93d8-3fa67b6e10eb" -d '{"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-unplugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:45.307538 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:45.329525 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cbdb0fc5-e556-460c-8aae-1f506cbd059f req-951c8b5f-4def-4c99-9bb1-290ecfde1b65 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0564835 Dec 21 04:17:45.336187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Transition to ACTIVE for port object 9b09c638-7de6-406b-80c2-cfca2ee126e8 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:17:45.369124 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e10c3f5-da10-482f-9cce-32b392ee980c x-openstack-request-id: req-7e10c3f5-da10-482f-9cce-32b392ee980c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:45.369124 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-unplugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:45.369124 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7e10c3f5-da10-482f-9cce-32b392ee980c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:45.369124 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'code': 200} Dec 21 04:17:45.384173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:45.581811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=10']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:45.592677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dab824-9d71-4428-ba3e-cbde3f213899 req-51455b3c-f84f-4a3c-ba7c-baf24d900fb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:45.594251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41dab824-9d71-4428-ba3e-cbde3f213899 req-51455b3c-f84f-4a3c-ba7c-baf24d900fb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.2411993 Dec 21 04:17:45.649183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] No DVR routers for this DVR port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:17:45.726702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41dab824-9d71-4428-ba3e-cbde3f213899 req-e81dc2e7-2867-4fa8-848b-9165e5af2d37 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1148763 Dec 21 04:17:45.813803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:17:45.814147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:17:45.814478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:45.819721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:17:45.820050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Attempting to bind port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on network eef11f28-43bc-4f45-bb74-cee477ba9652 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:17:45.830539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 17, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:17:45.830539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Checking segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:17:45.830539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Bound using segment: {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:17:45.830539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Bound port: 9b09c638-7de6-406b-80c2-cfca2ee126e8, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5971302f-7cf0-4cbe-98fe-03300764e013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:17:45.830539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:45.900931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:17:45.903765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:17:45.986720 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:46.031159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.031965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:46.033152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] 10.222.0.31 "PUT /v2.0/ports/9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1093 time: 1.5788667 Dec 21 04:17:46.060299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0850f22-1267-446d-8ce1-7d054056d6c6 service neutron] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=11']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:46.149395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-0b502232-2f7c-4e17-adff-bc7fc8240f06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.151461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-0b502232-2f7c-4e17-adff-bc7fc8240f06 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1096 time: 0.0527160 Dec 21 04:17:46.273801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-bb8e5c62-a10a-4b33-b23f-2c04d6cf60c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.275316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-bb8e5c62-a10a-4b33-b23f-2c04d6cf60c7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1107397 Dec 21 04:17:46.406620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:17:46.425514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-790b30d1-4128-4c9d-85ff-6471e021c1dd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.1369791 Dec 21 04:17:46.489712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:17:46.490174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:17:46.495899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-54a1dca9-6653-4e15-a710-b00f93a524aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.497264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-54a1dca9-6653-4e15-a710-b00f93a524aa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0569417 Dec 21 04:17:46.506684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e765fc4c-6376-40c9-9a64-3419c789500f req-9df91bb2-4584-4c27-adf9-6b42a1860716 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.508599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e765fc4c-6376-40c9-9a64-3419c789500f req-9df91bb2-4584-4c27-adf9-6b42a1860716 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.1504614 Dec 21 04:17:46.594825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e765fc4c-6376-40c9-9a64-3419c789500f req-cb1eb0bb-cdc0-4558-9cb9-af08523c25f8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0776484 Dec 21 04:17:46.596947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-fa75ed5d-b8b2-4a68-8d37-2c2a67cd991b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.598441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-fa75ed5d-b8b2-4a68-8d37-2c2a67cd991b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0888557 Dec 21 04:17:46.745630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-688584c0-75db-48b6-9ac7-aad54ab095b4 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279888 Dec 21 04:17:46.931108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f842b974-32cb-4bb7-98dc-b2fe5079aa2b req-0eea56a8-4b68-4a44-9333-3bb6ddbd5b05 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1600757 Dec 21 04:17:46.931108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700eda32-70db-4469-b6f2-4a7a2fe5a075 req-85bb5437-2e24-42da-abeb-41f9acbbcc8b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:46.931108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-700eda32-70db-4469-b6f2-4a7a2fe5a075 req-85bb5437-2e24-42da-abeb-41f9acbbcc8b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 944 time: 0.0903258 Dec 21 04:17:47.015955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-700eda32-70db-4469-b6f2-4a7a2fe5a075 req-4ba63f01-4408-44d2-984a-b27639c354ae tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0776393 Dec 21 04:17:47.369397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:47.372866 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f464de75-d502-475b-9bd2-5e90b1940a15" -d '{"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:47.425938 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-455ad893-6d36-4a79-99f0-d81f065cb898 x-openstack-request-id: req-455ad893-6d36-4a79-99f0-d81f065cb898 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:47.426416 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:47.426676 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-455ad893-6d36-4a79-99f0-d81f065cb898 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:47.427108 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'status': 'completed', 'code': 200} Dec 21 04:17:47.542784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-88e494b0-9c64-4d83-85af-37fb07c97492 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:47.544906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-88e494b0-9c64-4d83-85af-37fb07c97492 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1096 time: 0.0665710 Dec 21 04:17:47.552640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-0823960c-36f0-4512-b8d1-72ff89304e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:47.555215 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-0823960c-36f0-4512-b8d1-72ff89304e1a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1096 time: 0.0806768 Dec 21 04:17:47.671193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-2386767c-6e6b-4653-a121-6a2d51d2a31c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:47.672862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-2386767c-6e6b-4653-a121-6a2d51d2a31c service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1182158 Dec 21 04:17:47.799476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-1473f8d3-423c-4a27-83f2-692a18a393ba service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.1163402 Dec 21 04:17:47.823793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e513a63-e51d-4d13-aeea-9bf86011104a req-fc65acf6-c3b5-438d-9f90-5a5ae9542d67 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:47.833007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e513a63-e51d-4d13-aeea-9bf86011104a req-fc65acf6-c3b5-438d-9f90-5a5ae9542d67 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.0870721 Dec 21 04:17:47.906112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-535fc810-3280-401f-8563-8b667cd1c4d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:47.907659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-535fc810-3280-401f-8563-8b667cd1c4d0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0990436 Dec 21 04:17:47.943063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e513a63-e51d-4d13-aeea-9bf86011104a req-efcf9b31-7bfc-42c4-864f-f487f3d20cc8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1056442 Dec 21 04:17:48.000432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-e9a87090-8d1a-4e99-8023-bf07aeb61c5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:48.002909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-e9a87090-8d1a-4e99-8023-bf07aeb61c5e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0839794 Dec 21 04:17:48.088049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-e5423b8b-bf88-4ebe-8f5d-cce5f0ddc88b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:48.089736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-e5423b8b-bf88-4ebe-8f5d-cce5f0ddc88b service neutron] 10.222.0.54 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.5272102 Dec 21 04:17:48.141730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-079a927a-96d3-4833-97e6-3e91cdfdfb22 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1294248 Dec 21 04:17:48.196812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-890c5a1f-be0d-4e0a-8e78-e7ffcf760be2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 999 time: 0.0987604 Dec 21 04:17:48.252318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-e5193d08-c3ef-4176-b258-6a6eefe879d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:48.254800 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-e5193d08-c3ef-4176-b258-6a6eefe879d9 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0509126 Dec 21 04:17:48.272981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb1d84e-50c8-4f18-8222-532951b545a3 req-4f69f742-0e1f-40bd-9745-0aa000da8cce tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:48.274536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bb1d84e-50c8-4f18-8222-532951b545a3 req-4f69f742-0e1f-40bd-9745-0aa000da8cce tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 944 time: 0.1267388 Dec 21 04:17:48.311654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-c92d8322-04e5-4664-8f0e-508114121808 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1461649 Dec 21 04:17:48.337016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-28515b59-9695-44a1-a61c-7372ec873fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:48.357968 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-28515b59-9695-44a1-a61c-7372ec873fda service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0707395 Dec 21 04:17:48.358435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bb1d84e-50c8-4f18-8222-532951b545a3 req-18e47683-8775-44b1-854d-061512efcdf6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0689738 Dec 21 04:17:48.435357 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-7627f905-9bde-41ae-b0a5-880a71fdd2bc service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893247 Dec 21 04:17:48.531983 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f464de75-d502-475b-9bd2-5e90b1940a15 req-efd171e2-8699-4973-a3c7-bce417798795 service neutron] 10.222.0.54 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901206 Dec 21 04:17:48.898266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:17:49.009536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:49.028101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'port_id': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'mac_address': 'fa:16:3e:f5:3b:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:17:49.079560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b1f17b-20cd-4873-ad0a-c161c4b13cf8 req-65f16cb6-dfe1-4241-9c78-02bdb22d61a9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:49.081362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0b1f17b-20cd-4873-ad0a-c161c4b13cf8 req-65f16cb6-dfe1-4241-9c78-02bdb22d61a9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.0638654 Dec 21 04:17:49.086523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:49.102388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b09c638-7de6-406b-80c2-cfca2ee126e8 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:17:49.156547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:49.188291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0b1f17b-20cd-4873-ad0a-c161c4b13cf8 req-b3af6980-7b37-47f4-8528-1c7dd0ad3260 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0943487 Dec 21 04:17:49.220750 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:49.295352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:49.479194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade52084-18fb-4984-aab3-272a8136365b req-a9fa55fe-6531-47df-bb81-ee025477eb33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:49.480833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ade52084-18fb-4984-aab3-272a8136365b req-a9fa55fe-6531-47df-bb81-ee025477eb33 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 945 time: 0.0564003 Dec 21 04:17:49.533490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ade52084-18fb-4984-aab3-272a8136365b req-583bc165-1071-45dc-9453-85febc93f0e2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465932 Dec 21 04:17:49.559913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37202) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:49.567366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9b09c638-7de6-406b-80c2-cfca2ee126e8'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:17:49.671828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-56771875-ffb4-457a-af45-b2b3e61a2175 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ae34193d-4f2b-464a-8928-ae32066e68b4 HTTP/1.1" status: 200 len: 992 time: 0.1113317 Dec 21 04:17:49.740493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37206) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:49.873353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b5c6bb11-b713-49a0-af3b-3dea65a7fc1a admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:49.890326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-09a3f7c4-35a4-416e-87e2-de5ab5253c12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:49.968671 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b5c6bb11-b713-49a0-af3b-3dea65a7fc1a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:50.054498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b5c6bb11-b713-49a0-af3b-3dea65a7fc1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:50.093575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b5c6bb11-b713-49a0-af3b-3dea65a7fc1a admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0fd1b7e830e44abe812d6550bb8b4e71&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3517654 Dec 21 04:17:50.094420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c6bb11-b713-49a0-af3b-3dea65a7fc1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c964ee2-d9ed-49e9-bcd5-e0b34e5dc6c3,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:50.096287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37210) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:50.151137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdfaef9e-609b-4c94-ae8c-746de87791cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:50.172460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdfaef9e-609b-4c94-ae8c-746de87791cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:50.323720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdfaef9e-609b-4c94-ae8c-746de87791cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:50.326501 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bdfaef9e-609b-4c94-ae8c-746de87791cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:50.327848 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bdfaef9e-609b-4c94-ae8c-746de87791cf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/8c964ee2-d9ed-49e9-bcd5-e0b34e5dc6c3 HTTP/1.1" status: 204 len: 168 time: 0.2299597 Dec 21 04:17:50.337898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfaef9e-609b-4c94-ae8c-746de87791cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c964ee2-d9ed-49e9-bcd5-e0b34e5dc6c3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:50.910594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37218) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:50.915540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:17:50.925901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79084349-8f58-4d43-894b-5d6c68943d4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.001595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79084349-8f58-4d43-894b-5d6c68943d4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.026079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:17:51.030909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 9b09c638-7de6-406b-80c2-cfca2ee126e8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:17:51.031383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.095466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-79084349-8f58-4d43-894b-5d6c68943d4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.116938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.135309 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-79084349-8f58-4d43-894b-5d6c68943d4f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a5797afba2084a0fb756083316bdc006&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2233505 Dec 21 04:17:51.136782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79084349-8f58-4d43-894b-5d6c68943d4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5de1066c-dd35-4598-945a-280d48852e03,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:51.139798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37220) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:17:51.144812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:17:51.149796 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3aab789-75ee-4678-af20-076b629a6d14" -d '{"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:17:51.167553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:17:51.191981 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:17:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed2da37b-fc3f-4473-827e-491c0c922dff x-openstack-request-id: req-ed2da37b-fc3f-4473-827e-491c0c922dff {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:17:51.192283 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:17:51.192542 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ed2da37b-fc3f-4473-827e-491c0c922dff {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:17:51.192938 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'code': 200} Dec 21 04:17:51.204853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc81afc-461c-44d5-9340-fe035961de31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.228822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc81afc-461c-44d5-9340-fe035961de31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.243933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.312067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=13']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:51.358137 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc81afc-461c-44d5-9340-fe035961de31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.360924 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bfc81afc-461c-44d5-9340-fe035961de31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:51.364356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bfc81afc-461c-44d5-9340-fe035961de31 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5de1066c-dd35-4598-945a-280d48852e03 HTTP/1.1" status: 204 len: 168 time: 0.2208490 Dec 21 04:17:51.373973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc81afc-461c-44d5-9340-fe035961de31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5de1066c-dd35-4598-945a-280d48852e03,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:17:52.649249 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5d81237-6ee5-4343-903b-b25c322ace12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:53.003600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:53.305771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:55.054792 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:55.106658 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:55.786534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:17:56.758721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-a925fe1f-0f2e-45a4-bae1-aaafb6f67929 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0397971 Dec 21 04:17:56.874369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-4055830b-b895-4d6a-a09f-55badedc439f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:56.876042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-4055830b-b895-4d6a-a09f-55badedc439f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1098 time: 0.0558891 Dec 21 04:17:56.998577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-e37caf39-3bfe-4acd-820e-9c4874c24917 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:57.000187 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-e37caf39-3bfe-4acd-820e-9c4874c24917 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1030862 Dec 21 04:17:57.070522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-af3c4909-0000-40e5-8e9b-96c9376d5b76 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 1001 time: 0.0620973 Dec 21 04:17:57.159297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-70443457-2f87-45d9-b70c-9d2330b3e5bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:57.162832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-70443457-2f87-45d9-b70c-9d2330b3e5bd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.0841641 Dec 21 04:17:57.218766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-8d880690-3002-422f-8f8e-cd1a85ad8be7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:17:57.220289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-8d880690-3002-422f-8f8e-cd1a85ad8be7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0473762 Dec 21 04:17:57.315872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-bd3a599a-fc69-49b2-9df9-c35f403118bd service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879922 Dec 21 04:17:57.419143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5fae40b-ae28-4d62-a779-448dad80a3ec req-345d9e46-e504-471c-8cac-cfe7eab42101 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0948460 Dec 21 04:18:03.642370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-b1defd98-4ad6-4caa-ad0a-215e8d98224c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1791966 Dec 21 04:18:03.725981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-771ecbfa-b6ce-4550-9cb8-51d22851acd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:03.727643 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-771ecbfa-b6ce-4550-9cb8-51d22851acd5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1098 time: 0.0479288 Dec 21 04:18:03.854629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-e8e90fd6-dad2-45e7-9394-38eed1a9d6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:03.856332 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-e8e90fd6-dad2-45e7-9394-38eed1a9d6f1 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 200 len: 910 time: 0.0996144 Dec 21 04:18:03.931426 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-c846f132-46eb-4508-9b54-8cc2903546b6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 200 len: 1002 time: 0.0672853 Dec 21 04:18:03.994379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-877ee05e-5fdd-4bfd-8a1b-b019bed8292d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:03.994379 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-877ee05e-5fdd-4bfd-8a1b-b019bed8292d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0707099f-c76b-4feb-9475-4cacc79c073a HTTP/1.1" status: 200 len: 848 time: 0.0512347 Dec 21 04:18:04.041464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-13a42178-6077-400e-92c6-222e7853a032 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:04.043313 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-13a42178-6077-400e-92c6-222e7853a032 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ad2df216-0eaf-414a-a835-c27348ac987a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0424728 Dec 21 04:18:04.139391 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-f859a5f7-3bc1-454a-a46c-2855a33f8436 service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881426 Dec 21 04:18:04.234245 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef07f2c0-4d2d-4628-aae1-d5df45527daf req-d4de934c-92d6-499c-84fe-dc7af8c978fa service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862684 Dec 21 04:18:05.813025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 37742) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:05.927307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-654c399b-a7e9-426b-83ab-4bb992273fb8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.003034 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-654c399b-a7e9-426b-83ab-4bb992273fb8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.060908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-654c399b-a7e9-426b-83ab-4bb992273fb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.099125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-654c399b-a7e9-426b-83ab-4bb992273fb8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f703060690be423c946ca635d31f4892&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2850485 Dec 21 04:18:06.099989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654c399b-a7e9-426b-83ab-4bb992273fb8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a3740de-55b0-45b5-8d99-c78593535591,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:06.102334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37760) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:06.153149 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a4b47e5-21c6-4b8c-a4d8-2fbb335793d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.174228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a4b47e5-21c6-4b8c-a4d8-2fbb335793d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.261110 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a4b47e5-21c6-4b8c-a4d8-2fbb335793d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.263800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a4b47e5-21c6-4b8c-a4d8-2fbb335793d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.264984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5a4b47e5-21c6-4b8c-a4d8-2fbb335793d7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6a3740de-55b0-45b5-8d99-c78593535591 HTTP/1.1" status: 204 len: 168 time: 0.1598473 Dec 21 04:18:06.274035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a4b47e5-21c6-4b8c-a4d8-2fbb335793d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a3740de-55b0-45b5-8d99-c78593535591,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:06.906229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37810) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:06.920813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-406bb67d-82ef-49cd-b082-8ec007038c94 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:06.993274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-406bb67d-82ef-49cd-b082-8ec007038c94 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:07.071811 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-406bb67d-82ef-49cd-b082-8ec007038c94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:07.111682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406bb67d-82ef-49cd-b082-8ec007038c94 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4dd8c61-393c-49dd-aedd-0ea133b15556,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:07.115711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-406bb67d-82ef-49cd-b082-8ec007038c94 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a3d542c9f805422481027f084d0eec27&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2084782 Dec 21 04:18:07.118900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 37820) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:07.165486 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfdfd823-40f2-4b19-939c-5d12ff549dc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:07.187287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfdfd823-40f2-4b19-939c-5d12ff549dc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:07.289664 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfdfd823-40f2-4b19-939c-5d12ff549dc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:07.292604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cfdfd823-40f2-4b19-939c-5d12ff549dc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:07.293816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cfdfd823-40f2-4b19-939c-5d12ff549dc3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b4dd8c61-393c-49dd-aedd-0ea133b15556 HTTP/1.1" status: 204 len: 168 time: 0.1739986 Dec 21 04:18:07.301391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfdfd823-40f2-4b19-939c-5d12ff549dc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4dd8c61-393c-49dd-aedd-0ea133b15556,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:15.888225 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:18:19.860756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6687b1d3-5c83-4349-8331-6a0f475f3555 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:20.711890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38012) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:20.825037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-630348fa-98c9-43d6-90b6-a7a151351daa admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:20.913994 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-630348fa-98c9-43d6-90b6-a7a151351daa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:20.975455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-630348fa-98c9-43d6-90b6-a7a151351daa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:21.022133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-630348fa-98c9-43d6-90b6-a7a151351daa admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ff4d149b730940f4bbaca423aaa0ee96&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3069162 Dec 21 04:18:21.022133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-630348fa-98c9-43d6-90b6-a7a151351daa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0d853a8-9059-482f-90e2-ffea1ec1ef8c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:21.023001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38024) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:21.072654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cecbd903-d588-4622-a7fa-b4345b89eb93 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:21.094601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cecbd903-d588-4622-a7fa-b4345b89eb93 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:21.210471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cecbd903-d588-4622-a7fa-b4345b89eb93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:21.213877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cecbd903-d588-4622-a7fa-b4345b89eb93 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:21.215083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cecbd903-d588-4622-a7fa-b4345b89eb93 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a0d853a8-9059-482f-90e2-ffea1ec1ef8c HTTP/1.1" status: 204 len: 168 time: 0.1909671 Dec 21 04:18:21.223762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cecbd903-d588-4622-a7fa-b4345b89eb93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0d853a8-9059-482f-90e2-ffea1ec1ef8c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:22.436086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd34251-01a9-4d3d-a0bf-50a1a0b874ee req-f838fa77-8d07-430e-81cb-a0e3616776e1 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:22.444062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fd34251-01a9-4d3d-a0bf-50a1a0b874ee req-f838fa77-8d07-430e-81cb-a0e3616776e1 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1098 time: 0.0771122 Dec 21 04:18:22.493382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fd34251-01a9-4d3d-a0bf-50a1a0b874ee req-5864c19c-084e-4f69-a57c-5c8e0e6f0293 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479779 Dec 21 04:18:22.516010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38076) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:22.661665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd81e206-f2d3-44d9-ba55-9df5500b0bc3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:22.694465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 01980dae-c1eb-4cb1-ab9a-ba8fec6c4026 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:22.694820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:22.787638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:22.787897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:22.800237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 01980dae-c1eb-4cb1-ab9a-ba8fec6c4026 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:23.004648 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:23.027669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:23.063310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=01980dae-c1eb-4cb1-ab9a-ba8fec6c4026,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:23.154437 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:23.154913 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP ae34193d-4f2b-464a-8928-ae32066e68b4 disassociated (deleted). External IP: 172.25.5.147, port: 9b09c638-7de6-406b-80c2-cfca2ee126e8. Dec 21 04:18:23.342400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:23.441999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 243f6737-b79b-4ef0-a9db-fc76068ee195 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:18:23.571524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:18:23.582324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] Sync routers for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:18:23.583949 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:23.607724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:23.608388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:23.632184 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8267e9b2-f432-4ec6-a551-be279ca3e183 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/floatingips/ae34193d-4f2b-464a-8928-ae32066e68b4 HTTP/1.1" status: 204 len: 168 time: 1.1050584 Dec 21 04:18:23.632184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:23.632184 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77bdd685-2ff0-4e27-836e-0c79706d234f" -d '{"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:23.673644 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee394d22-f86a-4d8d-89ce-a70baeaf0e60 x-openstack-request-id: req-ee394d22-f86a-4d8d-89ce-a70baeaf0e60 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:23.674304 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:23.674779 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ee394d22-f86a-4d8d-89ce-a70baeaf0e60 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:23.675419 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'status': 'completed', 'code': 200} Dec 21 04:18:23.795155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-cde6efe9-f778-4089-84b2-cfecd36be298 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:23.798541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-cde6efe9-f778-4089-84b2-cfecd36be298 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 1098 time: 0.0715954 Dec 21 04:18:23.801486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:23.942646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-4c67162c-8467-4050-8dd2-883ae665cab5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:23.944251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-4c67162c-8467-4050-8dd2-883ae665cab5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 200 len: 897 time: 0.1363389 Dec 21 04:18:24.026294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-9d36b54f-9713-4eee-acec-d47dd667239c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 200 len: 217 time: 0.0701797 Dec 21 04:18:24.153464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-47f4a9ba-d7ab-4e4e-896e-c771b001a120 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:24.154973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-47f4a9ba-d7ab-4e4e-896e-c771b001a120 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 200 len: 835 time: 0.1206660 Dec 21 04:18:24.248914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-fd0258fb-2727-4270-9e57-e741b92c5479 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:24.250676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-fd0258fb-2727-4270-9e57-e741b92c5479 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eef11f28-43bc-4f45-bb74-cee477ba9652&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0868020 Dec 21 04:18:24.313586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cc9ab3-000f-4da1-97c0-98745ef6e1d1 req-e6b32bbb-2e73-42fb-b935-e79b0bb85016 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:24.321268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98cc9ab3-000f-4da1-97c0-98745ef6e1d1 req-e6b32bbb-2e73-42fb-b935-e79b0bb85016 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 946 time: 0.1092985 Dec 21 04:18:24.326820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:24.366617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] Checking router: 243f6737-b79b-4ef0-a9db-fc76068ee195 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:18:24.386712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:24.387503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:24.487994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-cfb53604-b14d-4153-a111-e465c15a2506 service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2278185 Dec 21 04:18:24.492922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98cc9ab3-000f-4da1-97c0-98745ef6e1d1 req-612728ca-4376-4b18-96fe-1afa729b3a98 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1609244 Dec 21 04:18:24.535702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:24.650338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77bdd685-2ff0-4e27-836e-0c79706d234f req-8672c8b0-d13f-4475-949c-d2d8832296fc service neutron] 10.222.0.31 "GET /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1507828 Dec 21 04:18:24.784236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:24.810521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a02e082c-8bc1-41f1-9073-5b6a4eb8bf30 None None] The sync data for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 is: [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:16:11Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '50c6c188-4f52-464e-9bb7-62f194206ffa', 'name': '', 'network_id': 'eef11f28-43bc-4f45-bb74-cee477ba9652', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:a7:a9:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_interface', 'standard_attr_id': 3566, 'fixed_ips': [{'subnet_id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:10Z', 'updated_at': '2021-12-21T04:16:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '06cf8f43-8470-4925-8b6b-b18ed572652f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:18:25.050114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:25.087181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:25.103605 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3aafb251-0836-4db4-bafc-4c35822a64e7 None None] New status for floating IP ae34193d-4f2b-464a-8928-ae32066e68b4: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:18:25.642745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19f07006-91ba-44c5-adcf-1a896c72ac8f req-6f53f2dd-820b-4a03-b289-ed1ecec64439 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:25.644330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19f07006-91ba-44c5-adcf-1a896c72ac8f req-6f53f2dd-820b-4a03-b289-ed1ecec64439 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 946 time: 0.0621839 Dec 21 04:18:25.712353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19f07006-91ba-44c5-adcf-1a896c72ac8f req-40fa8d64-6384-43c4-9791-d9ae9fec2c43 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=66bddc2b-7950-4d58-9286-3d1b9fcb0295&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523851 Dec 21 04:18:25.775812 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:25.861437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-dbfccec9-9485-49ca-bc2a-fb36704f94ce tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:25.862973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-dbfccec9-9485-49ca-bc2a-fb36704f94ce tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 946 time: 0.0494940 Dec 21 04:18:25.964763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 9b09c638-7de6-406b-80c2-cfca2ee126e8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:25.965102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:26.058309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 9b09c638-7de6-406b-80c2-cfca2ee126e8, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b09c638-7de6-406b-80c2-cfca2ee126e8,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:26.058802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:26.071674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 9b09c638-7de6-406b-80c2-cfca2ee126e8 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:26.272740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:26.313086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=9b09c638-7de6-406b-80c2-cfca2ee126e8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:26.359598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] No DVR routers for this DVR port 9b09c638-7de6-406b-80c2-cfca2ee126e8 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:18:26.360894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:26.364494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a94a9e67-ea5f-4674-ad7c-f54879487657 req-58c44e91-87c3-474a-8c0c-4c584f530459 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "DELETE /v2.0/ports/9b09c638-7de6-406b-80c2-cfca2ee126e8 HTTP/1.1" status: 204 len: 173 time: 0.4914503 Dec 21 04:18:26.364946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-deleted', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:26.367701 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-349faf19-eb06-464b-932c-7ae423e32c92" -d '{"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-deleted", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:26.404964 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7c6542e-8509-430e-a1f7-eb40dfab593e x-openstack-request-id: req-d7c6542e-8509-430e-a1f7-eb40dfab593e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:26.405480 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59d05c78-1f2f-47ce-8573-cac8ed7ee1da", "name": "network-vif-deleted", "tag": "9b09c638-7de6-406b-80c2-cfca2ee126e8", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:26.405931 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d7c6542e-8509-430e-a1f7-eb40dfab593e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:26.406492 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59d05c78-1f2f-47ce-8573-cac8ed7ee1da', 'name': 'network-vif-deleted', 'tag': '9b09c638-7de6-406b-80c2-cfca2ee126e8', 'status': 'completed', 'code': 200} Dec 21 04:18:26.865550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-763c9944-265f-4d57-86f5-ffced35cd964 req-edaf3886-99e1-43e4-bcb7-5b5163a8fe7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=59d05c78-1f2f-47ce-8573-cac8ed7ee1da HTTP/1.1" status: 200 len: 210 time: 0.0300028 Dec 21 04:18:27.285946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068b7074-7ed5-40a1-9d39-c9a611bba14b req-9c00a19e-9f7f-4e27-a634-b9915751024e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:27.287520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-068b7074-7ed5-40a1-9d39-c9a611bba14b req-9c00a19e-9f7f-4e27-a634-b9915751024e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.0741386 Dec 21 04:18:27.342483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-068b7074-7ed5-40a1-9d39-c9a611bba14b req-324066d9-03b0-418e-8be1-835d54c18232 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480375 Dec 21 04:18:27.932170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:28.318613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:28.477870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4753c5-79c1-435f-9e2f-614f16bf59e6 req-00543f5e-5045-41ff-9163-a9ab6f6a4106 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:28.486903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c4753c5-79c1-435f-9e2f-614f16bf59e6 req-00543f5e-5045-41ff-9163-a9ab6f6a4106 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.0664837 Dec 21 04:18:28.542845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c4753c5-79c1-435f-9e2f-614f16bf59e6 req-4a612af5-f1b8-472b-bffe-311effc4af9e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0544481 Dec 21 04:18:28.591103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 50c6c188-4f52-464e-9bb7-62f194206ffa {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:28.591443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:28.688023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 50c6c188-4f52-464e-9bb7-62f194206ffa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=50c6c188-4f52-464e-9bb7-62f194206ffa,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:28.688478 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:28.707943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 50c6c188-4f52-464e-9bb7-62f194206ffa owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:28.951380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-d0023e85-1de5-4f8f-9d7b-ae3368dc0f98 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:28.952964 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-d0023e85-1de5-4f8f-9d7b-ae3368dc0f98 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.2251022 Dec 21 04:18:29.034412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.101573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=50c6c188-4f52-464e-9bb7-62f194206ffa,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:29.122034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.122472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.122730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.123088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.123437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.123772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.124102 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.124439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.124758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.125088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.125417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.125747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.126064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:29.201553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Deleting port ac11126b-e25e-4a58-b9ab-db17cde3b083 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:29.201891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.346619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38216) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:29.427560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] For port ac11126b-e25e-4a58-b9ab-db17cde3b083, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=ac11126b-e25e-4a58-b9ab-db17cde3b083,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:29.427869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.443602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.531617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33bb7346-d499-486b-bebe-3d80345d7cc3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.643986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33bb7346-d499-486b-bebe-3d80345d7cc3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.698005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7763fd-e685-41ca-a520-ec2f53c6b7b8 req-760438dc-5784-43a8-a52f-b5bd34005b81 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:29.699611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da7763fd-e685-41ca-a520-ec2f53c6b7b8 req-760438dc-5784-43a8-a52f-b5bd34005b81 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 947 time: 0.0578983 Dec 21 04:18:29.723116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33bb7346-d499-486b-bebe-3d80345d7cc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.779600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33bb7346-d499-486b-bebe-3d80345d7cc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=647b383f-f2a7-4f49-8599-2fb24aeb92fd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:29.788201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-33bb7346-d499-486b-bebe-3d80345d7cc3 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=5f40d6139f3d4627beec23dbe68ce801&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4404800 Dec 21 04:18:29.791421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38226) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:29.802515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da7763fd-e685-41ca-a520-ec2f53c6b7b8 req-5dae6b56-03a9-4344-93dc-3e39ce3f064b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=1b49accc-ccae-4322-88f2-983f011cd91a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0943563 Dec 21 04:18:29.850019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-513fa551-65e0-4930-8a03-ad038fb79ea0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:29.874019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-513fa551-65e0-4930-8a03-ad038fb79ea0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.005350 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-513fa551-65e0-4930-8a03-ad038fb79ea0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.009284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-513fa551-65e0-4930-8a03-ad038fb79ea0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.013002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-513fa551-65e0-4930-8a03-ad038fb79ea0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/647b383f-f2a7-4f49-8599-2fb24aeb92fd HTTP/1.1" status: 204 len: 168 time: 0.2182789 Dec 21 04:18:30.020877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-513fa551-65e0-4930-8a03-ad038fb79ea0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=647b383f-f2a7-4f49-8599-2fb24aeb92fd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:30.123330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 243f6737-b79b-4ef0-a9db-fc76068ee195 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:18:30.186441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.186838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.187461 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Floating IP bd9d5060-5264-40f0-9557-b946f1a12429 disassociated. External IP: 172.25.5.221, port: ac11126b-e25e-4a58-b9ab-db17cde3b083. Dec 21 04:18:30.187695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Calling delete_port for ac11126b-e25e-4a58-b9ab-db17cde3b083 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:30.299687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:18:30.306263 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-32398940-f857-4cc6-ae39-71f4aff50260 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/243f6737-b79b-4ef0-a9db-fc76068ee195/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3723617 Dec 21 04:18:30.309076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38240) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:30.330505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] Sync routers for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:18:30.347218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:30.361257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:30.411839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting subnet 06cf8f43-8470-4925-8b6b-b18ed572652f {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:18:30.415779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.450434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.468911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.478816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event deleted for resources: {'Port': ['ID=ac11126b-e25e-4a58-b9ab-db17cde3b083,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:30.556189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:30.627399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:18:30.640964 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.753209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:18:30.767089 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b56c94-0933-425f-b341-899d20a44892 None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:18:30.769847 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:18:28Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:30.777991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:30.778599 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:30.797215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] No DVR routers for this DVR port ac11126b-e25e-4a58-b9ab-db17cde3b083 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:18:30.799820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.804272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.811422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] Checking router: 243f6737-b79b-4ef0-a9db-fc76068ee195 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:18:30.812742 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b26fff09-3ed0-411b-9309-5d0131be6bc9 req-c7409401-fda4-4162-b416-b02dca2b0644 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "DELETE /v2.0/ports/ac11126b-e25e-4a58-b9ab-db17cde3b083 HTTP/1.1" status: 204 len: 173 time: 1.8523812 Dec 21 04:18:30.813732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-deleted', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:30.817500 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-595e3a6b-d276-434e-8802-991c4bdd32fc" -d '{"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-deleted", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:30.823914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] Routers {'243f6737-b79b-4ef0-a9db-fc76068ee195'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:30.824846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['243f6737-b79b-4ef0-a9db-fc76068ee195'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:30.837895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Subnet': ['ID=06cf8f43-8470-4925-8b6b-b18ed572652f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:30.849013 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:30.854998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c635fc8b-465a-42fe-9796-00d7ffa32ea8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/subnets/06cf8f43-8470-4925-8b6b-b18ed572652f HTTP/1.1" status: 204 len: 168 time: 0.5429204 Dec 21 04:18:30.857438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38258) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:30.927152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c5d6441-3ed3-473a-b478-0d2327f25296 None None] Network eef11f28-43bc-4f45-bb74-cee477ba9652 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:18:30.949325 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1c07063f-39ea-460d-9de0-da053561f847 x-openstack-request-id: req-1c07063f-39ea-460d-9de0-da053561f847 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:30.949879 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "677079ab-7b24-4a37-a3d0-ace93ae32fcb", "name": "network-vif-deleted", "tag": "ac11126b-e25e-4a58-b9ab-db17cde3b083", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:30.950318 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1c07063f-39ea-460d-9de0-da053561f847 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:30.950914 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '677079ab-7b24-4a37-a3d0-ace93ae32fcb', 'name': 'network-vif-deleted', 'tag': 'ac11126b-e25e-4a58-b9ab-db17cde3b083', 'status': 'completed', 'code': 200} Dec 21 04:18:31.002328 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:31.031978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e34680b-2e96-459d-a604-4b9c71d6b5cb req-2c7a562b-e37a-4d13-8342-b40f8f6c3325 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=677079ab-7b24-4a37-a3d0-ace93ae32fcb HTTP/1.1" status: 200 len: 210 time: 0.0583909 Dec 21 04:18:31.067561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:18:31.166646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 9b09c638-7de6-406b-80c2-cfca2ee126e8 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:18:31.167150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b09c638-7de6-406b-80c2-cfca2ee126e8 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:18:31.228555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] Set router 243f6737-b79b-4ef0-a9db-fc76068ee195 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:31.388809 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:31.433446 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b56c94-0933-425f-b341-899d20a44892 None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:18:31.445677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:31.447334 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:31.480564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38274) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:31.688868 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:31.690771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1016106028-network', 'tenant_id': '57ab6cbdcda24806861df9ec12f18681'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:31.733328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] DHCP port deletion for eef11f28-43bc-4f45-bb74-cee477ba9652 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:18:31.736021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 792a90ae-0382-4de1-9cf1-69fa22231531 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:18:31.777377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.782083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Made reservation on behalf of 57ab6cbdcda24806861df9ec12f18681 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:18:31.784910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.801046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.888689 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.891542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] Deleting port 792a90ae-0382-4de1-9cf1-69fa22231531 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:31.892245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.908625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.936453 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68b56c94-0933-425f-b341-899d20a44892 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:31.938793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:18:28Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:31.964232 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b56c94-0933-425f-b341-899d20a44892 None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:18:31.981237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:31.981774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-551d8cc0-edc8-4aa3-a451-bc62e6c8884e None None] The sync data for ids ['243f6737-b79b-4ef0-a9db-fc76068ee195'] in n-d-822053-11 is: [{'id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'name': 'tempest-TestNetworkAdvancedServerOps-router-51279440', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42'}], 'enable_snat': True}, 'gw_port_id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:16:05Z', 'updated_at': '2021-12-21T04:18:28Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '46e149e9-8aff-43c7-8263-b38b45f47403', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:38:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '243f6737-b79b-4ef0-a9db-fc76068ee195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3563, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:16:06Z', 'updated_at': '2021-12-21T04:16:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:18:32.041397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 792a90ae-0382-4de1-9cf1-69fa22231531, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=792a90ae-0382-4de1-9cf1-69fa22231531,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:32.047229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 46e149e9-8aff-43c7-8263-b38b45f47403 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:32.047584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.049509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] For port 792a90ae-0382-4de1-9cf1-69fa22231531, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=792a90ae-0382-4de1-9cf1-69fa22231531,segment=NetworkSegment(5971302f-7cf0-4cbe-98fe-03300764e013),segment_id=5971302f-7cf0-4cbe-98fe-03300764e013)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:32.050032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.074634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] Calling delete_port for 792a90ae-0382-4de1-9cf1-69fa22231531 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:32.084616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.132752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:18:32.159584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af3c5167-9211-4bab-a993-0ca82cb73c62,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:32.164061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 46e149e9-8aff-43c7-8263-b38b45f47403, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=46e149e9-8aff-43c7-8263-b38b45f47403,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:32.165372 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.172418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.172903 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Added segment 412aa278-1368-4813-a350-dccd36d53daf of type vlan for network 1e06cb6d-1702-4983-bc62-4912cea57cae Dec 21 04:18:32.180085 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.185317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 46e149e9-8aff-43c7-8263-b38b45f47403 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:32.250915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.292558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=792a90ae-0382-4de1-9cf1-69fa22231531,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:32.376668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.377672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:32.378262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.415898 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.440273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] Pushing event deleted for resources: {'Port': ['ID=792a90ae-0382-4de1-9cf1-69fa22231531,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:32.449492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32149123-9118-4de9-87a9-f8f5affa2983 None None] No DVR routers for this DVR port 792a90ae-0382-4de1-9cf1-69fa22231531 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:18:32.467972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.481926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c855997e-f98f-4282-bb35-507f282fb85c None None] New status for floating IP bd9d5060-5264-40f0-9557-b946f1a12429: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:18:32.498398 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.0166438 Dec 21 04:18:32.501701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38292) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:32.504060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca223c7-2262-4cd5-b188-ace190300b95 admin admin] Pushing event updated for resources: {'Network': ['ID=1e06cb6d-1702-4983-bc62-4912cea57cae,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:32.507647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=46e149e9-8aff-43c7-8263-b38b45f47403,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:32.509808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Request body: {'subnet': {'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1016106028-subnet', 'tenant_id': '57ab6cbdcda24806861df9ec12f18681', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:32.529690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1e06cb6d-1702-4983-bc62-4912cea57cae details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:18:32.530172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eae2ab6e-1548-4e02-a5a9-7af47b9c59f4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:18:32.622599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.645515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Made reservation on behalf of 57ab6cbdcda24806861df9ec12f18681 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:18:32.649812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.654868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:18:32.718304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: ac11126b-e25e-4a58-b9ab-db17cde3b083 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:18:32.718584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device ac11126b-e25e-4a58-b9ab-db17cde3b083 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:18:32.735143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.737834 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.844497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.845365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Fanout notify agent at l3_agent the message router_deleted on router 243f6737-b79b-4ef0-a9db-fc76068ee195 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:18:32.854653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.856429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-80dd79bb-f379-4a4e-8547-327f7f81a2f4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/routers/243f6737-b79b-4ef0-a9db-fc76068ee195 HTTP/1.1" status: 204 len: 168 time: 1.9973874 Dec 21 04:18:32.859064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38298) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:32.913879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.939399 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:32.980187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Pushing event updated for resources: {'Subnet': ['ID=5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:32.997292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Checking segment: {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:32.997671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Network hostable DHCP agents. Network: 1e06cb6d-1702-4983-bc62-4912cea57cae, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:18:33.050628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Network 1e06cb6d-1702-4983-bc62-4912cea57cae is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:18:33.052487 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.074865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eef11f28-43bc-4f45-bb74-cee477ba9652']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:33.084211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5971302f-7cf0-4cbe-98fe-03300764e013') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:33.084523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5971302f-7cf0-4cbe-98fe-03300764e013') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:33.094515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.107720 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.114191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:18:33.114716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:18:33.117929 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:18:33.129376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1e06cb6d-1702-4983-bc62-4912cea57cae) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:33.139197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:33.139197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.140317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-499ed01e-647e-4c8b-8491-20f010fc6214 None None] Network 1e06cb6d-1702-4983-bc62-4912cea57cae requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:18:33.219583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f63d49af-3998-437e-bb35-d00039fe7dcf admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7163806 Dec 21 04:18:33.276250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.283177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3f443c9-244f-462a-85b1-4ba63019cf96 None None] Network 1e06cb6d-1702-4983-bc62-4912cea57cae requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:18:33.287292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:33.290561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.295997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/networks/eef11f28-43bc-4f45-bb74-cee477ba9652 HTTP/1.1" status: 204 len: 168 time: 0.4357078 Dec 21 04:18:33.298836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38308) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:33.328963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c8d9ab-f8ab-4cb1-a7bc-01099d5879c0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Network': ['ID=eef11f28-43bc-4f45-bb74-cee477ba9652,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:33.392743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc417ba8-68a2-4e94-9b34-6aa872443774 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.412232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215fe23a-e343-4a40-9953-d34d2f5bab51 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.440608 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215fe23a-e343-4a40-9953-d34d2f5bab51 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.441527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc417ba8-68a2-4e94-9b34-6aa872443774 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.574631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 50c6c188-4f52-464e-9bb7-62f194206ffa no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:18:33.600752 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215fe23a-e343-4a40-9953-d34d2f5bab51 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.602973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 50c6c188-4f52-464e-9bb7-62f194206ffa {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:18:33.603414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 50c6c188-4f52-464e-9bb7-62f194206ffa not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:18:33.603885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 46e149e9-8aff-43c7-8263-b38b45f47403 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:18:33.605043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-215fe23a-e343-4a40-9953-d34d2f5bab51 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.616091 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-215fe23a-e343-4a40-9953-d34d2f5bab51 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "DELETE /v2.0/security-groups/1b49accc-ccae-4322-88f2-983f011cd91a HTTP/1.1" status: 204 len: 168 time: 0.3273907 Dec 21 04:18:33.619066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38320) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:33.630864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 46e149e9-8aff-43c7-8263-b38b45f47403 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:18:33.631301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 46e149e9-8aff-43c7-8263-b38b45f47403 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:18:33.633529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215fe23a-e343-4a40-9953-d34d2f5bab51 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b49accc-ccae-4322-88f2-983f011cd91a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:33.640057 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc417ba8-68a2-4e94-9b34-6aa872443774 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.645500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cc417ba8-68a2-4e94-9b34-6aa872443774 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.650296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cc417ba8-68a2-4e94-9b34-6aa872443774 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/security-groups/66bddc2b-7950-4d58-9286-3d1b9fcb0295 HTTP/1.1" status: 204 len: 168 time: 0.3479662 Dec 21 04:18:33.661799 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-782e6a1b-349a-441e-9e5f-8ca4a4df1e41 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] show failed (client error): The resource could not be found. Dec 21 04:18:33.663756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-782e6a1b-349a-441e-9e5f-8ca4a4df1e41 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups/1b49accc-ccae-4322-88f2-983f011cd91a HTTP/1.1" status: 404 len: 347 time: 0.0428934 Dec 21 04:18:33.668305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc417ba8-68a2-4e94-9b34-6aa872443774 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=66bddc2b-7950-4d58-9286-3d1b9fcb0295,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:33.669512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38324) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:33.809266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Deleting port 79a4f55a-2457-482e-8955-594c8f9b65bd {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:18:33.809613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.889630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.890080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:33.903563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Calling delete_port for 79a4f55a-2457-482e-8955-594c8f9b65bd owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:18:34.102058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.128345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event deleted for resources: {'Port': ['ID=79a4f55a-2457-482e-8955-594c8f9b65bd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:34.200744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.204497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.205900 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d6258b4-4335-4bcc-adbb-2a469983d651 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "DELETE /v2.0/floatingips/bd9d5060-5264-40f0-9557-b946f1a12429 HTTP/1.1" status: 204 len: 168 time: 0.5341485 Dec 21 04:18:34.568636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38348) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:34.581522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1974001402', 'description': 'tempest-description--72067162'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:34.685004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.774633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.850489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.880137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84c01d45-ee85-45e7-a98d-551b48af6e5f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:34.955742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:34.961085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38360) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:34.961683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8446b3d7-bd8a-4fa2-81c9-3ff6e0daa6a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.3916261 Dec 21 04:18:34.965883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'security_group_rule': {'security_group_id': '84c01d45-ee85-45e7-a98d-551b48af6e5f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:35.068643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.141627 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.153967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38362) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:35.158618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1759491456', 'description': 'tempest-secgroup-smoke-1759491456 description', 'project_id': '10a032d25985452584a3dcdae6969809'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:35.259217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.275115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d606ea44-78c9-4360-af4c-3cdd54247a62,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:35.281284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.356719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.357951 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-830b6e25-7063-4978-bb88-d6e326a1718e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3958056 Dec 21 04:18:35.360839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38370) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:35.362729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.369265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'security_group_rule': {'security_group_id': '84c01d45-ee85-45e7-a98d-551b48af6e5f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:35.434564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.467776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.469195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:35.532286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.533569 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-46b6c1bf-18a0-47c5-b170-b2dabbb73ad9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3785868 Dec 21 04:18:35.536993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38374) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:35.543017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '5f5bf337-c6ec-48c8-80d3-4fbba4f9421b', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:35.558611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.634666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.655324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f1a9f048-8993-4681-bbfd-5d34a19039c4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:35.667997 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.715257 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.744612 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.745914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c6d7c3f3-7254-4165-a7d6-a7baadd490c8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3840833 Dec 21 04:18:35.756475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38380) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:35.761708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:35.786795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.800919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7da6516e-6da1-4e5e-92f0-e82fbe60e03d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:35.845409 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.882725 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.883948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-317ec0af-4246-492b-b0fa-06529d372a7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3457336 Dec 21 04:18:35.887368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:35.891924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '5f5bf337-c6ec-48c8-80d3-4fbba4f9421b', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:35.957411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:35.982113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.037174 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.063806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Allocated IP 172.25.5.139 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/2ad4bc0b-7a57-4e6e-8845-ea8903c3069a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:18:36.089664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.108054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=da50d4c5-eb88-4328-914d-acea7f1a7757,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:36.167101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.168369 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f29ed7a9-d94a-4006-bef1-aabb77680147 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2799857 Dec 21 04:18:36.171423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.173893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:36.179267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '5f5bf337-c6ec-48c8-80d3-4fbba4f9421b', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:36.301860 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.321004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.375529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:36.378513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:36.379260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.382463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:18:36.406663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'Port': ['ID=2ad4bc0b-7a57-4e6e-8845-ea8903c3069a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:36.445177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.468221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75bbcef3-0628-4372-b726-fa9fa8920e9a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:36.477178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.527689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.528953 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-185df783-f185-4b90-82ce-f8ec0c94e39d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3537121 Dec 21 04:18:36.534870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38400) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:36.539648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '5f5bf337-c6ec-48c8-80d3-4fbba4f9421b', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:36.586315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.663660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.790825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.803144 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.856695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.874968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4829db55-4173-4e49-974c-6d2ab2e97270,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:36.885142 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.951287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:36.955180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0a721145-b774-4803-bb12-ab23896fe38d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4166141 Dec 21 04:18:36.960697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38408) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:36.965087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'Port': ['ID=2ad4bc0b-7a57-4e6e-8845-ea8903c3069a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:36.965698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '5f5bf337-c6ec-48c8-80d3-4fbba4f9421b', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:36.983259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.075108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.084714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-64c710a0-8cfa-40a4-931e-4c49bfad68ac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3189535 Dec 21 04:18:37.085059 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:18:37.092183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.162254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.239544 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.274762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d207e0ea-7edf-45a4-9f7a-ab389fded7b0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:37.297889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-0efc5783-db74-4d09-82c7-d49788061e68 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--1974001402&fields=id&tenant_id=f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 267 time: 0.0490143 Dec 21 04:18:37.346507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.349461 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dbd49c85-fb7b-4803-b28a-d809a4164bc7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3920097 Dec 21 04:18:37.352037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38428) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:37.423051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-84920ca1-7b4f-4943-927b-40c70368ff01 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:37.424666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-84920ca1-7b4f-4943-927b-40c70368ff01 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 817 time: 0.1190867 Dec 21 04:18:37.446695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-1a28f8e8-d476-412f-be05-8c7c4b9e7672 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/quotas/f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 375 time: 0.0159063 Dec 21 04:18:37.490294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '5f5bf337-c6ec-48c8-80d3-4fbba4f9421b', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:37.511777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-2198ade0-26e6-412d-9938-a3116e586506 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0587258 Dec 21 04:18:37.599979 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:18:37.610010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.689015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.707323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-8f7c8c13-3243-4385-a337-8846daacaaa7 service neutron] 10.222.0.18 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1802645 Dec 21 04:18:37.753896 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.784183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7281bd0f-1ccf-4b05-8cc5-049b2c6017a6,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:37.807577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-dac2d517-e4e3-4eb5-a2b8-1c79a844b5ed service neutron] 10.222.0.18 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927689 Dec 21 04:18:37.898675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:37.900413 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2ad25b10-436e-4380-821d-300d1871451f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5466709 Dec 21 04:18:37.903228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38444) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:37.908245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'network': {'name': 'tempest-network-smoke--1552185130', 'project_id': '10a032d25985452584a3dcdae6969809', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:38.033308 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:18:38.037581 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.063315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] vlan segment allocate from pool success with {'vlan_id': 114, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:18:38.073039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.073389 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Added segment 4602fa63-f40d-4677-ab67-9cb0be8cd412 of type vlan for network aabd54e3-094a-4a25-8130-c07bb6a2856e Dec 21 04:18:38.126918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.239554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.245662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:38.246454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.326145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Network': ['ID=aabd54e3-094a-4a25-8130-c07bb6a2856e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:38.337789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network aabd54e3-094a-4a25-8130-c07bb6a2856e details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:18:38.358729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38450) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:38.364373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'admin_state_up': True, 'project_id': '10a032d25985452584a3dcdae6969809', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:38.371592 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ffb203f7-3384-4436-811f-b19e0a334de2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4671371 Dec 21 04:18:38.485523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.486620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.547337 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:38.751003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:39.016645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:39.035831 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:39.151086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a783e97e-cde3-46e0-b389-fcde35a450da req-db53707c-6ec4-4f4c-82ec-b20aec1f53a5 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 210 time: 0.0516424 Dec 21 04:18:39.178989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.196 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/aa20b1de-3fc2-48d1-899f-bec7f7aba885) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:18:39.289512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:39.428129 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:39.486703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:39.491045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:39.495618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:18:39.498716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=aa20b1de-3fc2-48d1-899f-bec7f7aba885,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:39.506711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbe385b4-766f-4995-a861-9359e159313b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:18:39.584570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8d4e40a1-47d8-4e43-8674-8d7292731ea2 None None] Provisioning complete for port aa20b1de-3fc2-48d1-899f-bec7f7aba885 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:39.585420 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d4e40a1-47d8-4e43-8674-8d7292731ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:39.632546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8d4e40a1-47d8-4e43-8674-8d7292731ea2 None None] Port aa20b1de-3fc2-48d1-899f-bec7f7aba885 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:18:39.961567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:40.173888 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:40.310035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b946e45f-9f15-49af-8928-ad1147873b81 req-54eba12a-009b-4735-a72e-c613d51035ec tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 210 time: 0.0371013 Dec 21 04:18:40.438148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 72c80be8-99de-46c5-ae5e-6b187a77c27a is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:18:40.911643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:18:40.926546 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Sync routers for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:18:40.938058 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:40.938742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:41.008644 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.013334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-068e5449-75d3-4cc4-a0da-1916b6a8f14d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 2.6532226 Dec 21 04:18:41.017131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:41.069929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:41.080191 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-36cc6010-ff57-46c1-bb8f-6603375e8b6d tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=10a032d25985452584a3dcdae6969809&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0616086 Dec 21 04:18:41.082648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38510) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:41.211061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdb01169-d421-4bbc-b163-55f30730e720 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:41.214315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bdb01169-d421-4bbc-b163-55f30730e720 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1303344 Dec 21 04:18:41.220906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38512) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:41.298130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-06dc3b51-a4d8-4b1b-8834-96593bd3f59f tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0747726 Dec 21 04:18:41.299711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38516) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:41.304823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1709311470', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'project_id': '10a032d25985452584a3dcdae6969809', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:41.310219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:39Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:41.363293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-095041e0-2083-414b-a3b3-29408e3edf86 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:41.365162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-095041e0-2083-414b-a3b3-29408e3edf86 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.31 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 817 time: 0.1317308 Dec 21 04:18:41.377917 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Checking router: 72c80be8-99de-46c5-ae5e-6b187a77c27a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:18:41.378881 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Updating router 72c80be8-99de-46c5-ae5e-6b187a77c27a port aa20b1de-3fc2-48d1-899f-bec7f7aba885 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:18:41.458378 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.509283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:18:41.512913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.568450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988502e3-4649-4e8c-80db-671c05017a44 req-39dab7ee-8c26-4557-b38d-b1bc6067e9d1 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 210 time: 0.1022339 Dec 21 04:18:41.610989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9e6e65fe-a29f-4dc7-97c0-b0579983e4c9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 380 time: 0.2207465 Dec 21 04:18:41.622798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'port': {'device_id': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'admin_state_up': True, 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'security_groups': ['84c01d45-ee85-45e7-a98d-551b48af6e5f']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:41.816520 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.892509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Made reservation on behalf of f201aa828d124b4d96ae1f68f53fe955 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:18:41.896638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.919869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.920408 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:41.970979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7cee518-8221-49be-a057-9f4b092ca572 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:18:42.007210 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Pushing event updated for resources: {'Port': ['ID=aa20b1de-3fc2-48d1-899f-bec7f7aba885,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:42.016373 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Attempting to bind port aa20b1de-3fc2-48d1-899f-bec7f7aba885 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:18:42.016918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Attempting to bind port aa20b1de-3fc2-48d1-899f-bec7f7aba885 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:18:42.017282 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Attempting to bind port aa20b1de-3fc2-48d1-899f-bec7f7aba885 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:42.022001 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.022585 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.023129 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.023750 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.024262 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.024780 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.025536 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.026017 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.026141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Subnet': ['ID=63aec071-a40e-49a6-ba2b-16c229285c1a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:42.027086 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.027566 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.028115 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.039044 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.039044 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.048020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Checking segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:42.048491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network hostable DHCP agents. Network: aabd54e3-094a-4a25-8130-c07bb6a2856e, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:18:42.050639 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 18, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:18:42.051648 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:42.052211 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.052751 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:18:42.054036 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Bound port: aa20b1de-3fc2-48d1-899f-bec7f7aba885, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:18:42.054612 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.082060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-49f1d01e-b008-4ecd-9804-d2e6c54cf13f None None] Provisioning complete for port aa20b1de-3fc2-48d1-899f-bec7f7aba885 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:42.082515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-49f1d01e-b008-4ecd-9804-d2e6c54cf13f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.113420 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] For port aa20b1de-3fc2-48d1-899f-bec7f7aba885, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:18:42.117556 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] For port aa20b1de-3fc2-48d1-899f-bec7f7aba885, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa20b1de-3fc2-48d1-899f-bec7f7aba885,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:18:42.127695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Allocated IP 172.20.0.9 (577a9fd0-5714-46c9-9810-f5765f640d13/22a88d3d-7d29-49ff-8344-5d0ad387ea51/d0bb881d-37f6-4b67-a89c-a6c72e23dd9a) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:18:42.131887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-49f1d01e-b008-4ecd-9804-d2e6c54cf13f None None] Port aa20b1de-3fc2-48d1-899f-bec7f7aba885 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:18:42.142402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network aabd54e3-094a-4a25-8130-c07bb6a2856e is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:18:42.200552 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.229811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, aabd54e3-094a-4a25-8130-c07bb6a2856e) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:42.237330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:42.238013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.253528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7afbce60-79cd-4fbd-bf84-f69f655b43fb None None] Network aabd54e3-094a-4a25-8130-c07bb6a2856e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:18:42.321241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.349281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eae04be0-7272-4b2c-a6fa-c3609cae5993 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.0480568 Dec 21 04:18:42.353226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38534) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:42.376715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beafd106-92e9-4292-954a-deb8bdd7b4b8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:18:42.407239 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013c62d6-35ea-4dee-bada-06b117559af3 None None] Pushing event updated for resources: {'Port': ['ID=aa20b1de-3fc2-48d1-899f-bec7f7aba885,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:42.410987 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:42.411803 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:42.483196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.503768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-aabd54e3-094a-4a25-8130-c07bb6a2856e', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:18:42.504727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.575546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Network 577a9fd0-5714-46c9-9810-f5765f640d13 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:42.585699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:42.604212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:18:42.674042 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:42.710277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Allocated IP 172.20.0.2 (aabd54e3-094a-4a25-8130-c07bb6a2856e/63aec071-a40e-49a6-ba2b-16c229285c1a/44b63089-18a7-4e5c-8cc8-6a4f0f129e5e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:18:42.749699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:42.751567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.824568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:42.837632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.838005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.838330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.838669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.839046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.839383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.839710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.840041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.840371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.841048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.841522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.841858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.842176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:42.871274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d016edf6-c83a-47e7-91b5-82464c26cb7e req-a1d0df90-4377-40ae-ab93-1db7dd68abc2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:42.873562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d016edf6-c83a-47e7-91b5-82464c26cb7e req-a1d0df90-4377-40ae-ab93-1db7dd68abc2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 931 time: 0.1102219 Dec 21 04:18:42.920183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-a345bc62-ad18-4266-b7d4-3b2f8c71718a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3019695 Dec 21 04:18:42.951261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2ea82c02-5449-4ec9-9e72-b991e53688b1 None None] Provisioning complete for port aa20b1de-3fc2-48d1-899f-bec7f7aba885 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:42.951640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ea82c02-5449-4ec9-9e72-b991e53688b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:42.963985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Request body: {'port': {'device_id': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:43.081489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d016edf6-c83a-47e7-91b5-82464c26cb7e req-96aae2d7-9640-4485-b5ca-f5f004541635 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1966467 Dec 21 04:18:43.087826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.129419 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.160081 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:39Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:43.196048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ea82c02-5449-4ec9-9e72-b991e53688b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.207884 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bd9dbad-5c33-4fba-8fe1-b3a5fb796b92 None None] The sync data for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 is: [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:39Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:18:43.212877 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.243779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.297948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2ea82c02-5449-4ec9-9e72-b991e53688b1 None None] For port aa20b1de-3fc2-48d1-899f-bec7f7aba885, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa20b1de-3fc2-48d1-899f-bec7f7aba885,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:43.322771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Network aabd54e3-094a-4a25-8130-c07bb6a2856e is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:43.325670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:43.329233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:18:43.358379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Pushing event updated for resources: {'Port': ['ID=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:43.385083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.385675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.386202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.386695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.387217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.387711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.388220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.388734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.389224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.389715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.390204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.390705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.391212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:18:43.409189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ea82c02-5449-4ec9-9e72-b991e53688b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.458656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Attempting to bind port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:18:43.459200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Attempting to bind port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:18:43.460331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Attempting to bind port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:43.477671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 18, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:18:43.478312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Checking segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:43.479042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.479606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Bound using segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:18:43.480270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Bound port: 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:18:43.483094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.630743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:18:43.655234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.685357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea82c02-5449-4ec9-9e72-b991e53688b1 None None] Pushing event updated for resources: {'Port': ['ID=aa20b1de-3fc2-48d1-899f-bec7f7aba885,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:43.685687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Transition to ACTIVE for port object d0bb881d-37f6-4b67-a89c-a6c72e23dd9a will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:18:43.708837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b085448a-3cf1-4fbc-8fbd-3b120b94fea2 None None] Provisioning complete for port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:43.709343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b085448a-3cf1-4fbc-8fbd-3b120b94fea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.754167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.777149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] For port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:18:43.781004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b085448a-3cf1-4fbc-8fbd-3b120b94fea2 None None] Port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:18:43.784718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] For port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:18:43.850703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.1 (aabd54e3-094a-4a25-8130-c07bb6a2856e/63aec071-a40e-49a6-ba2b-16c229285c1a/53932384-bd49-4eca-9c91-e5c410ae41e5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:18:43.851635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:43.867092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:43.971565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8f7a1c-f5dc-4e91-96d7-a12353d70b55 None None] Pushing event updated for resources: {'Port': ['ID=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:44.046330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:18:44.046572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:18:44.047452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:44.049785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.059143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on network 577a9fd0-5714-46c9-9810-f5765f640d13 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:18:44.059469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:44.079152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 18, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:18:44.079502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Checking segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:44.082862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Bound using segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:18:44.083345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Bound port: d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:18:44.083972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.182792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:18:44.186159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:18:44.188982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.303074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=53932384-bd49-4eca-9c91-e5c410ae41e5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:44.349513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network aabd54e3-094a-4a25-8130-c07bb6a2856e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:44.352019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:44.363269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:18:44.367294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0ded79-cb72-46ca-923f-e82a52913a81 req-554f3cab-c252-464c-97ae-950fe8f70006 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:44.378779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e0ded79-cb72-46ca-923f-e82a52913a81 req-554f3cab-c252-464c-97ae-950fe8f70006 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.1327014 Dec 21 04:18:44.438277 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.453640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.483433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:44.484059 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.485476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] 10.222.0.31 "PUT /v2.0/ports/d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1092 time: 1.5304461 Dec 21 04:18:44.491570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:44.494471 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b" -d '{"events": [{"name": "network-changed", "server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:44.526315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e0ded79-cb72-46ca-923f-e82a52913a81 req-465f6b68-9374-45cc-816c-742d557da973 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1464374 Dec 21 04:18:44.599162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd6b958-aef1-4155-87ed-30a3f9866970 service neutron] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:44.614176 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ec1efc5-7158-430b-a163-b9c14d207d55 x-openstack-request-id: req-5ec1efc5-7158-430b-a163-b9c14d207d55 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:44.615294 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:44.619228 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5ec1efc5-7158-430b-a163-b9c14d207d55 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:44.619228 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'status': 'completed', 'code': 200} Dec 21 04:18:44.806722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:44.868830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b req-ffad13b2-7c83-4075-b1c1-dded88926659 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:44.877816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b req-ffad13b2-7c83-4075-b1c1-dded88926659 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1095 time: 0.2060246 Dec 21 04:18:45.038371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b req-a8ecc68f-dc4f-49fd-877b-f7e6a86cbad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:45.040453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b req-a8ecc68f-dc4f-49fd-877b-f7e6a86cbad3 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=f201aa828d124b4d96ae1f68f53fe955&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1396329 Dec 21 04:18:45.154328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b req-7bb7cf98-440f-4bd0-801a-835a09beae33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:45.155964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f74d2cf-5e4e-4513-a39b-b3b1493a432b req-7bb7cf98-440f-4bd0-801a-835a09beae33 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1050065 Dec 21 04:18:45.177113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:45.240537 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:45.277746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-b48f3746-59e0-4f5a-83a0-27672971cc35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:45.279679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-b48f3746-59e0-4f5a-83a0-27672971cc35 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1095 time: 0.0565619 Dec 21 04:18:45.348828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=53932384-bd49-4eca-9c91-e5c410ae41e5,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:45.356585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-9d0b3e3a-b315-4b5c-9dea-13c15c4428d7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 217 time: 0.0523834 Dec 21 04:18:45.356957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:45.409487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-b920ee9b-be47-4e7f-941d-bf6546ceef0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:45.411078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-b920ee9b-be47-4e7f-941d-bf6546ceef0f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0458956 Dec 21 04:18:45.473424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-cc6fe355-937d-4b50-910d-d1bde5b76dfe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:45.475797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-cc6fe355-937d-4b50-910d-d1bde5b76dfe service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0548408 Dec 21 04:18:45.497119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network aabd54e3-094a-4a25-8130-c07bb6a2856e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:45.498713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:45.725073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 72c80be8-99de-46c5-ae5e-6b187a77c27a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:18:45.729953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-fd264bbd-316f-4026-8d5b-522bac944061 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2385924 Dec 21 04:18:45.794268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa20b1de-3fc2-48d1-899f-bec7f7aba885 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:18:45.851540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0982db-a122-4e9c-8b3d-c65a21a29d70 req-30d0849b-af5c-4d8d-bb24-56027ed0cfea tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:45.853641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f0982db-a122-4e9c-8b3d-c65a21a29d70 req-30d0849b-af5c-4d8d-bb24-56027ed0cfea tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.2218907 Dec 21 04:18:45.908693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aa20b1de-3fc2-48d1-899f-bec7f7aba885 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:45.909342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:46.000051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8296f8f-8227-4f2e-b612-7bcbfb4b5fae req-489b4302-1ae8-47b0-b8f7-4d0bb4d7ccbf service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2525167 Dec 21 04:18:46.003998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f0982db-a122-4e9c-8b3d-c65a21a29d70 req-ab181864-ff32-483d-85f3-1fadefcdf594 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1415651 Dec 21 04:18:46.022847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:18:46.041201 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4fa7ece7-151f-4148-b56d-822b42950420 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/72c80be8-99de-46c5-ae5e-6b187a77c27a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6864002 Dec 21 04:18:46.050868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Sync routers for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:18:46.065172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:18:46.100766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:46.101426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:46.149214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64629c6f-51d6-418a-a209-610cead509fe None None] Network aabd54e3-094a-4a25-8130-c07bb6a2856e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:18:46.226080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-5b472e80-340c-424c-b647-a8b1fbecc71b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1759491456&fields=id&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 267 time: 0.0540643 Dec 21 04:18:46.388103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-9c5e1533-2cf1-4934-afe0-9a691b1228cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:46.399297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-9c5e1533-2cf1-4934-afe0-9a691b1228cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 797 time: 0.1588490 Dec 21 04:18:46.411919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-82648a49-339c-4480-9fab-71fc1168e348 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/quotas/10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 375 time: 0.0104709 Dec 21 04:18:46.460371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:46.460731 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:46.473329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-94750c9a-4dcf-4d8a-8516-77e7c6d1a6f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0561340 Dec 21 04:18:46.488654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7908faf5-7929-4c6f-9161-86b16efd795f None None] Provisioning complete for port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:46.488985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7908faf5-7929-4c6f-9161-86b16efd795f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:46.562537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:46.605214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-73a34fa0-7ddf-4fd4-b71a-47c00c8f6258 service neutron] 10.222.0.18 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1180987 Dec 21 04:18:46.732114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-0ecc804e-2015-4be0-ae45-e22bcee944fd service neutron] 10.222.0.18 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1110029 Dec 21 04:18:46.847427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7908faf5-7929-4c6f-9161-86b16efd795f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:46.859365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:46.927546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7908faf5-7929-4c6f-9161-86b16efd795f None None] For port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:46.941615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:45Z', 'revision_number': 2, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:46.977767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Checking router: 72c80be8-99de-46c5-ae5e-6b187a77c27a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:18:46.978220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Updating router 72c80be8-99de-46c5-ae5e-6b187a77c27a port 53932384-bd49-4eca-9c91-e5c410ae41e5 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:18:47.028553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7908faf5-7929-4c6f-9161-86b16efd795f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.094226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e188922-ffe1-4415-a7f0-4076b05999bc req-ac178a84-6c30-4f92-8f60-2666b5a02668 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 210 time: 0.0547199 Dec 21 04:18:47.146368 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.221870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:18:47.222228 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:18:47.233332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf65149d-2aab-415a-8b45-f1d2e53c1303 req-b2208db6-df02-4969-b9d6-26fa03c4054d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:47.235311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf65149d-2aab-415a-8b45-f1d2e53c1303 req-b2208db6-df02-4969-b9d6-26fa03c4054d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.0788646 Dec 21 04:18:47.302458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7908faf5-7929-4c6f-9161-86b16efd795f None None] Pushing event updated for resources: {'Port': ['ID=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:47.314660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d8700b01-33c1-4249-8ec0-062767c4aa18 None None] Provisioning complete for port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:47.315654 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8700b01-33c1-4249-8ec0-062767c4aa18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.339467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf65149d-2aab-415a-8b45-f1d2e53c1303 req-886d8330-4006-4952-92ed-0976b679f01d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858693 Dec 21 04:18:47.576362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d8700b01-33c1-4249-8ec0-062767c4aa18 None None] Provisioning complete for port 53932384-bd49-4eca-9c91-e5c410ae41e5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:47.576757 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8700b01-33c1-4249-8ec0-062767c4aa18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.644448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d8700b01-33c1-4249-8ec0-062767c4aa18 None None] Port 53932384-bd49-4eca-9c91-e5c410ae41e5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:18:47.697606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.776466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-37aec6c7-eabb-4bcf-ac3f-9904f4f20d91 None None] Provisioning complete for port 53932384-bd49-4eca-9c91-e5c410ae41e5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:47.776946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-37aec6c7-eabb-4bcf-ac3f-9904f4f20d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.811869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.851514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:18:47.887126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-37aec6c7-eabb-4bcf-ac3f-9904f4f20d91 None None] Port 53932384-bd49-4eca-9c91-e5c410ae41e5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:18:47.908919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cfb3132-b4ea-4b09-93f2-d6601b2dbb67 None None] Pushing event updated for resources: {'Port': ['ID=53932384-bd49-4eca-9c91-e5c410ae41e5,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:47.971729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:47.972361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:47.977982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Attempting to bind port 53932384-bd49-4eca-9c91-e5c410ae41e5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:18:47.978352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Attempting to bind port 53932384-bd49-4eca-9c91-e5c410ae41e5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:18:47.978899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Attempting to bind port 53932384-bd49-4eca-9c91-e5c410ae41e5 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:48.014491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 18, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:18:48.015276 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Checking segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:48.016152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:48.016612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Bound using segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:18:48.017166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Bound port: 53932384-bd49-4eca-9c91-e5c410ae41e5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:18:48.017616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:48.120848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] For port 53932384-bd49-4eca-9c91-e5c410ae41e5, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:18:48.125927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] For port 53932384-bd49-4eca-9c91-e5c410ae41e5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=53932384-bd49-4eca-9c91-e5c410ae41e5,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:18:48.211707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f46efac9-260d-4155-9e6a-b346ebe34ebb req-d88e6468-fb30-45be-90fa-73c543c17734 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 210 time: 0.0355837 Dec 21 04:18:48.217021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2fcf985a-ee49-414e-898e-23c7644eb1d9 None None] Provisioning complete for port 53932384-bd49-4eca-9c91-e5c410ae41e5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:48.217274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2fcf985a-ee49-414e-898e-23c7644eb1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:48.221273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:48.325659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:48.326300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:48.333844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cfb3132-b4ea-4b09-93f2-d6601b2dbb67 None None] Pushing event updated for resources: {'Port': ['ID=53932384-bd49-4eca-9c91-e5c410ae41e5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:48.473702 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2fcf985a-ee49-414e-898e-23c7644eb1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:48.515510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2fcf985a-ee49-414e-898e-23c7644eb1d9 None None] For port 53932384-bd49-4eca-9c91-e5c410ae41e5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=53932384-bd49-4eca-9c91-e5c410ae41e5,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:48.523577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:48.523713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22d54c6-3c5b-424d-a468-3aba178b6f10 req-f53e521a-181a-4292-b7aa-caad87603c00 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:48.530189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f22d54c6-3c5b-424d-a468-3aba178b6f10 req-f53e521a-181a-4292-b7aa-caad87603c00 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.0683813 Dec 21 04:18:48.607239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f22d54c6-3c5b-424d-a468-3aba178b6f10 req-d3e765ff-d95e-4952-8c21-fb61f42168ab tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711288 Dec 21 04:18:48.629077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2fcf985a-ee49-414e-898e-23c7644eb1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:48.894611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcf985a-ee49-414e-898e-23c7644eb1d9 None None] Pushing event updated for resources: {'Port': ['ID=53932384-bd49-4eca-9c91-e5c410ae41e5,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:48.919162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-921ccff9-f7df-4a07-9592-e5fb69721f58 None None] Provisioning complete for port 53932384-bd49-4eca-9c91-e5c410ae41e5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:48.919789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-921ccff9-f7df-4a07-9592-e5fb69721f58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:49.033991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:49.070440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2c051d-43ea-49d1-8319-b0f7abcd76a1 None None] The sync data for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 is: [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:18:49.149311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:18:49.288339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:49.303881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'mac_address': 'fa:16:3e:7b:4c:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:18:49.335890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eccbb005-936c-4d79-8b5f-08955fd46eae req-41841d8b-b3a4-48e3-ae2d-07a9dad16b1a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 210 time: 0.0437341 Dec 21 04:18:49.368817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:49.391658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:18:49.419309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:49.501389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:49.574455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:49.759626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a06b1de-955c-4036-88f0-5d43db017816 req-6240ce88-122d-4274-bf96-da519ea24492 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:49.768099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a06b1de-955c-4036-88f0-5d43db017816 req-6240ce88-122d-4274-bf96-da519ea24492 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0677962 Dec 21 04:18:49.874955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d0bb881d-37f6-4b67-a89c-a6c72e23dd9a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:18:49.928724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc990490-f2bd-42ac-bd7f-5270fa0088af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:49.929727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a06b1de-955c-4036-88f0-5d43db017816 req-4d1364a9-7afb-46bb-b66b-983c0d7b65c9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1606340 Dec 21 04:18:49.933964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 53932384-bd49-4eca-9c91-e5c410ae41e5 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:18:49.941344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-4037aa52-7edf-4087-aae8-cd7f1d5203d3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:49.944607 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-4037aa52-7edf-4087-aae8-cd7f1d5203d3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.54 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 797 time: 0.6021373 Dec 21 04:18:50.062672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 53932384-bd49-4eca-9c91-e5c410ae41e5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:50.063166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:50.082854 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-0b66ae7b-cbea-4871-8908-7a85b6b9d234 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 380 time: 0.1215029 Dec 21 04:18:50.094355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'port': {'device_id': '17498f65-94f3-48c0-9a1b-af1140317b01', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'admin_state_up': True, 'tenant_id': '10a032d25985452584a3dcdae6969809', 'security_groups': ['5f5bf337-c6ec-48c8-80d3-4fbba4f9421b']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:50.392873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:18:50.399338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:50.456243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a589dc35-1804-4a04-afb7-7ef5336b994d req-0959c03e-ccb4-4314-b307-9ec23bf0b6bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 210 time: 0.0403075 Dec 21 04:18:50.561461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.11 (aabd54e3-094a-4a25-8130-c07bb6a2856e/63aec071-a40e-49a6-ba2b-16c229285c1a/81972a7a-ce99-4741-ba4b-3f427713a5f9) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:18:50.727010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:50.816401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:50.867389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network aabd54e3-094a-4a25-8130-c07bb6a2856e is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:18:50.871567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:18:50.881147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:50.888892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:18:50.950627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:50.951705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.048603 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-05defaec-062d-4151-a93f-b85e478bd8a9 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9582613 Dec 21 04:18:51.068450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Request body: {'port': {'device_id': '17498f65-94f3-48c0-9a1b-af1140317b01', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:51.069357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0cc3dd-9776-45a4-9f01-9433bcccd74f req-9e2eb27d-e6fb-40d8-aef0-5055e6029cad tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:51.071213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c0cc3dd-9776-45a4-9f01-9433bcccd74f req-9e2eb27d-e6fb-40d8-aef0-5055e6029cad tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0593081 Dec 21 04:18:51.138789 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c0cc3dd-9776-45a4-9f01-9433bcccd74f req-dbc1df33-ad4c-4d4b-9cd2-f7c8fa3a6678 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611122 Dec 21 04:18:51.142678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a0379842-121e-48a5-947c-b6d0947e4920 None None] Provisioning complete for port 81972a7a-ce99-4741-ba4b-3f427713a5f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:51.143181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a0379842-121e-48a5-947c-b6d0947e4920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.185798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:18:51.201231 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.228989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a0379842-121e-48a5-947c-b6d0947e4920 None None] Port 81972a7a-ce99-4741-ba4b-3f427713a5f9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:18:51.343199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:18:51.347386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:51.347974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.446242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.475522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:51.478728 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04c2dbfc-abe3-438e-b4a9-70db34b99660" -d '{"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:51.508680 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 81972a7a-ce99-4741-ba4b-3f427713a5f9 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:18:51.515987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:51.520619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.541195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Transition to ACTIVE for port object 81972a7a-ce99-4741-ba4b-3f427713a5f9 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:18:51.551689 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20ffc0c9-250f-4768-933d-f92bce48e379 x-openstack-request-id: req-20ffc0c9-250f-4768-933d-f92bce48e379 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:51.552240 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:51.552594 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-20ffc0c9-250f-4768-933d-f92bce48e379 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:51.553108 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'code': 200} Dec 21 04:18:51.590543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.623841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.646099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497e444e-36ba-4487-b575-2d4b25249c36 req-e2abc9b3-b9ca-4d21-9d6f-c2dd1ed6d712 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:51.647816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497e444e-36ba-4487-b575-2d4b25249c36 req-e2abc9b3-b9ca-4d21-9d6f-c2dd1ed6d712 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 932 time: 0.0832565 Dec 21 04:18:51.680473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:51.710442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:51.752753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-497e444e-36ba-4487-b575-2d4b25249c36 req-959c7eb4-057f-46a4-9cd0-ed891d989229 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0954368 Dec 21 04:18:51.761546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae9dfe6e-84c9-468b-b9d2-56f50f3d9ad2 req-c3ba29ce-ea80-48a1-8915-b74679544fb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:51.763181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae9dfe6e-84c9-468b-b9d2-56f50f3d9ad2 req-c3ba29ce-ea80-48a1-8915-b74679544fb6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1097 time: 0.0681322 Dec 21 04:18:51.781456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:18:51.782193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:18:51.783046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:51.788516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:18:51.788856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:18:51.799362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 18, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:18:51.799717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Checking segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:18:51.805738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Bound using segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:18:51.805738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Bound port: 81972a7a-ce99-4741-ba4b-3f427713a5f9, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:18:51.805738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:51.844659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae9dfe6e-84c9-468b-b9d2-56f50f3d9ad2 req-ff02b707-b188-422a-9c93-d20c35394de7 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0652919 Dec 21 04:18:51.908913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:18:51.918312 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:18:51.988965 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:52.031117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.031655 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:52.032989 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] 10.222.0.54 "PUT /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1093 time: 0.9694345 Dec 21 04:18:52.033509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:52.035864 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6" -d '{"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:52.077383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81478032-7e59-4ff6-806a-342613b0deb2 service neutron] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:52.095378 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aee54373-ce3e-43b1-bc4e-eb8230b6fcc9 x-openstack-request-id: req-aee54373-ce3e-43b1-bc4e-eb8230b6fcc9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:52.095378 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:52.095378 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-aee54373-ce3e-43b1-bc4e-eb8230b6fcc9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:52.095378 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'status': 'completed', 'code': 200} Dec 21 04:18:52.183616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6 req-17eda103-2772-4e11-9034-d934a3e86cf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.185549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6 req-17eda103-2772-4e11-9034-d934a3e86cf7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1096 time: 0.0456390 Dec 21 04:18:52.298153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6107adb1-ef8c-40a0-acbf-665fc1dea486 req-bc81929a-3f71-4292-b3ae-3c65e07d3713 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.299986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6107adb1-ef8c-40a0-acbf-665fc1dea486 req-bc81929a-3f71-4292-b3ae-3c65e07d3713 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0690055 Dec 21 04:18:52.362982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6107adb1-ef8c-40a0-acbf-665fc1dea486 req-5fa2da97-0669-4736-b963-c1f30dc85442 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530503 Dec 21 04:18:52.410010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6 req-b8637b21-b30a-4970-b704-a02a9e2c772a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.411530 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6 req-b8637b21-b30a-4970-b704-a02a9e2c772a service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=10a032d25985452584a3dcdae6969809&shared=False HTTP/1.1" status: 200 len: 898 time: 0.2124143 Dec 21 04:18:52.580220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6 req-b53851b3-c480-4ef8-a64e-ce4e3435078c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.581621 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ee7ff36f-53ad-4f6c-b36c-d98b3dc6e5e6 req-b53851b3-c480-4ef8-a64e-ce4e3435078c service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1629176 Dec 21 04:18:52.652958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4405afcb-def8-4616-bf82-f6d488326111 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:52.698097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-ba86b3bd-f4c5-4e04-8170-9b05af1dbc61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.699937 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-ba86b3bd-f4c5-4e04-8170-9b05af1dbc61 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1096 time: 0.0505743 Dec 21 04:18:52.753751 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-1526b95f-91e8-4570-bbe5-7415c682bad8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 217 time: 0.0387814 Dec 21 04:18:52.822569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-72a7ad87-f5ba-49d7-ac90-390e047165bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.824271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-72a7ad87-f5ba-49d7-ac90-390e047165bb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 200 len: 835 time: 0.0623889 Dec 21 04:18:52.872929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2750af50-69ba-471c-82f5-4cd417e67acd req-97144a4e-9a7e-4bde-a223-226b3baf02de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.876041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-97144a4e-9a7e-4bde-a223-226b3baf02de service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=aabd54e3-094a-4a25-8130-c07bb6a2856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0429940 Dec 21 04:18:52.886896 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:18:52.905967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5c7d87-25f0-4517-8feb-d760fd055544 req-d0d023d6-d67e-4cee-a2c3-cfec2b2d29e3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:52.908098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd5c7d87-25f0-4517-8feb-d760fd055544 req-d0d023d6-d67e-4cee-a2c3-cfec2b2d29e3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 944 time: 0.0695708 Dec 21 04:18:52.966681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd5c7d87-25f0-4517-8feb-d760fd055544 req-99f0c028-f5c6-4f2a-865a-d826a8f2dd57 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522318 Dec 21 04:18:52.987488 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-5d55f6fb-da4c-4f07-95e9-30532359e332 service neutron] 10.222.0.54 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1006591 Dec 21 04:18:53.057427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:53.088895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2750af50-69ba-471c-82f5-4cd417e67acd req-6938e4df-ae89-4843-8830-195e29fd3ff1 service neutron] 10.222.0.54 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993617 Dec 21 04:18:53.392996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:53.484341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6639d6e8-377b-46a6-a9fc-8c0bd947f8d9 req-e427642a-850b-4541-b407-75bbd5079d72 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:53.485716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6639d6e8-377b-46a6-a9fc-8c0bd947f8d9 req-e427642a-850b-4541-b407-75bbd5079d72 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0499740 Dec 21 04:18:53.537809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6639d6e8-377b-46a6-a9fc-8c0bd947f8d9 req-5ec5e808-2ce6-460a-99f2-b372f1fcadac tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451906 Dec 21 04:18:53.665607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce278c61-327e-418d-97e0-0a530afc7eaf req-eb5c17d1-7e1b-4f8f-b525-c827067f0d65 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:53.667042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce278c61-327e-418d-97e0-0a530afc7eaf req-eb5c17d1-7e1b-4f8f-b525-c827067f0d65 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0561149 Dec 21 04:18:53.676212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38736) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:18:53.681979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Request body: {'floatingip': {'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:18:53.722695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:54.100580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27644af0-760e-42d7-838d-495655527847 req-92a02f16-bc2a-4e43-8bf4-e9ee21f38e5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:54.101923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27644af0-760e-42d7-838d-495655527847 req-92a02f16-bc2a-4e43-8bf4-e9ee21f38e5a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 944 time: 0.0540900 Dec 21 04:18:54.164282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27644af0-760e-42d7-838d-495655527847 req-75571609-3f51-4196-9dbc-8c4376021946 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549474 Dec 21 04:18:54.215206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:54.405786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:54.508875 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Floating IP 7f236de8-d243-40db-b5f5-ceeeff3191d8 associated. External IP: 172.25.5.139, port: d0bb881d-37f6-4b67-a89c-a6c72e23dd9a. Dec 21 04:18:54.721540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:18:54.839267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:18:54.844084 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:54.850722 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:18:54.866525 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:54.867831 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:54.885177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c168105a-abaa-4c0d-8d33-cf8d901e1465 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "PUT /v2.0/floatingips/7f236de8-d243-40db-b5f5-ceeeff3191d8 HTTP/1.1" status: 200 len: 991 time: 1.2076197 Dec 21 04:18:54.885877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:54.888296 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78673f4e-201b-4152-98d4-f6017e870be2" -d '{"events": [{"name": "network-changed", "server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:54.955633 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7eacd88-6afb-4916-8fd0-9c0ee6cef2a5 x-openstack-request-id: req-a7eacd88-6afb-4916-8fd0-9c0ee6cef2a5 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:54.955994 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:54.956380 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a7eacd88-6afb-4916-8fd0-9c0ee6cef2a5 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:54.956858 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'status': 'completed', 'code': 200} Dec 21 04:18:54.989932 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:55.035674 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:55.058071 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78673f4e-201b-4152-98d4-f6017e870be2 req-b976a74b-5802-4969-be90-fde350fd6e9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:55.059758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-b976a74b-5802-4969-be90-fde350fd6e9d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1097 time: 0.0474284 Dec 21 04:18:55.096736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:55.155502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78673f4e-201b-4152-98d4-f6017e870be2 req-c58c8a2a-c3ae-4e58-8c0b-93d822f3d2e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:55.156994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-c58c8a2a-c3ae-4e58-8c0b-93d822f3d2e8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.0898075 Dec 21 04:18:55.273585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-54228637-1454-4818-8c80-71b258a65315 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 999 time: 0.1086929 Dec 21 04:18:55.299390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '7f236de8-d243-40db-b5f5-ceeeff3191d8', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 3672, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'mac_address': 'fa:16:3e:7b:4c:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:18:36Z', 'updated_at': '2021-12-21T04:18:54Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:55.335193 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:18:55.350106 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:18:55.351636 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:55.370942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78673f4e-201b-4152-98d4-f6017e870be2 req-7a34b9bd-8d5f-4520-9d3a-b79cf4facfd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:55.372524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-7a34b9bd-8d5f-4520-9d3a-b79cf4facfd5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0879705 Dec 21 04:18:55.385885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219c30c0-2d0c-4d8a-a181-23634d9a0a50 req-c0cb42b4-553d-4726-b73d-1422e2c1e518 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:55.387775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-219c30c0-2d0c-4d8a-a181-23634d9a0a50 req-c0cb42b4-553d-4726-b73d-1422e2c1e518 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 944 time: 0.0949576 Dec 21 04:18:55.476419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-219c30c0-2d0c-4d8a-a181-23634d9a0a50 req-cc79a992-078e-4c44-ac04-b2c2638c8887 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767503 Dec 21 04:18:55.486296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78673f4e-201b-4152-98d4-f6017e870be2 req-6395f941-dc07-4227-a449-a3dcddadda8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:55.491497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-6395f941-dc07-4227-a449-a3dcddadda8f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0993807 Dec 21 04:18:55.493999 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:18:55.583759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-f932e07c-95a1-42ac-a9f9-c80c0b9a7f0c service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881619 Dec 21 04:18:55.706534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78673f4e-201b-4152-98d4-f6017e870be2 req-f5a8045a-8ee5-464b-bab9-8bc2fe308a06 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1151688 Dec 21 04:18:55.770417 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:55.797306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '7f236de8-d243-40db-b5f5-ceeeff3191d8', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 3672, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'mac_address': 'fa:16:3e:7b:4c:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:18:36Z', 'updated_at': '2021-12-21T04:18:54Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:18:55.827526 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a1284d8-4b3d-4ee4-8b21-5a71ea6c8ac3 None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '7f236de8-d243-40db-b5f5-ceeeff3191d8', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 3672, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'mac_address': 'fa:16:3e:7b:4c:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:18:36Z', 'updated_at': '2021-12-21T04:18:54Z', 'revision_number': 1, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:18:56.050786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34dd3297-4ccf-41cf-a29f-b71691acb4e3 None None] New status for floating IP 7f236de8-d243-40db-b5f5-ceeeff3191d8: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:18:56.605220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cac96ef-be17-45f2-81de-a2cfd36f4b0d req-1cc02d09-2831-4562-89a7-825162aabab1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:56.607013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cac96ef-be17-45f2-81de-a2cfd36f4b0d req-1cc02d09-2831-4562-89a7-825162aabab1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 944 time: 0.0588546 Dec 21 04:18:56.659132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cac96ef-be17-45f2-81de-a2cfd36f4b0d req-1dcd731b-f470-4bff-9b37-7a47d3a8cb50 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454819 Dec 21 04:18:56.817750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:18:56.918319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:56.929636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'port_id': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'mac_address': 'fa:16:3e:14:9a:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:18:56.976484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:56.992088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81972a7a-ce99-4741-ba4b-3f427713a5f9 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:18:57.013779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:57.080332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:57.134420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:57.373676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['81972a7a-ce99-4741-ba4b-3f427713a5f9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:18:57.819822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7998ddb-3eec-4cfa-9fe8-cccfdee88869 req-2e329c99-e8b2-4039-903b-49e789d4a9da tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:57.821374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7998ddb-3eec-4cfa-9fe8-cccfdee88869 req-2e329c99-e8b2-4039-903b-49e789d4a9da tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0584266 Dec 21 04:18:57.871921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7998ddb-3eec-4cfa-9fe8-cccfdee88869 req-daf29ab7-7e45-44b3-b352-1f4fc1148b41 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431128 Dec 21 04:18:58.746898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-d7ae91f4-e6c1-4bca-b337-995ec9204bed service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0401356 Dec 21 04:18:58.833217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:18:58.864587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-fa7eb54c-ef20-4d50-83cf-f248a0b805d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:58.866246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-fa7eb54c-ef20-4d50-83cf-f248a0b805d8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1097 time: 0.0563576 Dec 21 04:18:58.948283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 81972a7a-ce99-4741-ba4b-3f427713a5f9 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:18:58.952536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 81972a7a-ce99-4741-ba4b-3f427713a5f9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:18:58.953320 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:59.017882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-995332a7-a3c5-40fc-bd75-8c270501998a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:59.019361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-995332a7-a3c5-40fc-bd75-8c270501998a service neutron] 10.222.0.31 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1308637 Dec 21 04:18:59.042287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:59.066150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:18:59.068795 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d829d81a-7a72-4e32-8ba5-6e03cfba4950" -d '{"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-plugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:18:59.089045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:18:59.094127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc4ea22-14b5-4512-9215-4e795a3bbccb req-23b3898f-3852-42b3-838f-32da4ea8bad0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:59.095876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdc4ea22-14b5-4512-9215-4e795a3bbccb req-23b3898f-3852-42b3-838f-32da4ea8bad0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.1318984 Dec 21 04:18:59.109897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-4910f27b-9bf7-435b-96f8-912993d21e70 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1001 time: 0.0835564 Dec 21 04:18:59.184958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:18:59.190358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-92242fd2-3ec7-4717-a3dd-38cfdfe4e033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:59.191866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-92242fd2-3ec7-4717-a3dd-38cfdfe4e033 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0751705 Dec 21 04:18:59.195894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdc4ea22-14b5-4512-9215-4e795a3bbccb req-957fda38-1818-46db-85ab-ff066aa0edc6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0850673 Dec 21 04:18:59.267712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-3d27ee9c-8599-418e-b81f-e013cba74333 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:59.269795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-3d27ee9c-8599-418e-b81f-e013cba74333 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0711071 Dec 21 04:18:59.296140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:18:59.361229 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:18:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbfee2fa-c75f-4fa0-a802-963e3e2417e8 x-openstack-request-id: req-dbfee2fa-c75f-4fa0-a802-963e3e2417e8 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:18:59.361821 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-plugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:18:59.362261 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dbfee2fa-c75f-4fa0-a802-963e3e2417e8 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:18:59.362839 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'code': 200} Dec 21 04:18:59.402480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-2e6f7044-dac5-4f78-b488-77c08b3786b7 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251109 Dec 21 04:18:59.490815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3e618a-eea2-4b6a-a863-073cdf2f8565 req-f6826b63-5652-4ce3-b130-cb60537ce2b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:18:59.493010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d3e618a-eea2-4b6a-a863-073cdf2f8565 req-f6826b63-5652-4ce3-b130-cb60537ce2b6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1098 time: 0.0437677 Dec 21 04:18:59.506418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1df0cc7f-acc0-4ae4-952d-e440881c748a req-7fc865de-02b2-4b6c-b2f5-ab14fe331bd4 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0948987 Dec 21 04:18:59.543039 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6d3e618a-eea2-4b6a-a863-073cdf2f8565 req-cc9aad7f-959f-48d6-8302-f1899d5bdca7 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419376 Dec 21 04:19:00.349372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b29dad63-a6cb-4597-8be2-8ae532193ae4 req-e62571ec-9c78-43b2-b7cc-631567de5e92 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:00.350958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b29dad63-a6cb-4597-8be2-8ae532193ae4 req-e62571ec-9c78-43b2-b7cc-631567de5e92 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0576918 Dec 21 04:19:00.417729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b29dad63-a6cb-4597-8be2-8ae532193ae4 req-385bc931-0dce-4d46-935c-b3ec2c78dfdd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0591505 Dec 21 04:19:01.564963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d16596-76b3-4cf5-a8b3-ecb7164147bb req-e2c1a25a-353d-4ce7-bdeb-5c7bedc46215 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:01.566485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78d16596-76b3-4cf5-a8b3-ecb7164147bb req-e2c1a25a-353d-4ce7-bdeb-5c7bedc46215 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0541034 Dec 21 04:19:01.617156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78d16596-76b3-4cf5-a8b3-ecb7164147bb req-38f3e3da-aae5-4086-b759-d826092de082 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433407 Dec 21 04:19:01.746168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267e64a4-ccf7-4d79-a1e8-68e79d383505 req-a1522238-8b77-4ccf-ab5b-791b4c5bf180 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:01.747898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-267e64a4-ccf7-4d79-a1e8-68e79d383505 req-a1522238-8b77-4ccf-ab5b-791b4c5bf180 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0552838 Dec 21 04:19:01.807037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-267e64a4-ccf7-4d79-a1e8-68e79d383505 req-85145ac8-80c7-4e3f-8c11-961919aeaedd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467412 Dec 21 04:19:01.829254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 38894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:01.976502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0207e33-4fd3-4003-bcd7-ce34c00e31b7 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:01.978591 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b0207e33-4fd3-4003-bcd7-ce34c00e31b7 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1093 time: 0.1477077 Dec 21 04:19:01.981710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:01.986231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address': '172.20.0.11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:19:02.137525 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:02.237746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:02.364684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.105 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/55e714f0-21b9-4953-90b4-cecd1b24c5e7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:19:02.470913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:02.548939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:02.599121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:19:02.600732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:19:02.613611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=55e714f0-21b9-4953-90b4-cecd1b24c5e7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:02.617385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:19:03.042551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:03.176367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:03.363207 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:03.423349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:03.497441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=55e714f0-21b9-4953-90b4-cecd1b24c5e7,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:03.511143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:03.623290 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 associated. External IP: 172.25.5.105, port: 81972a7a-ce99-4741-ba4b-3f427713a5f9. Dec 21 04:19:04.174769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 72c80be8-99de-46c5-ae5e-6b187a77c27a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:19:04.291578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:19:04.304367 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] Sync routers for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:19:04.314709 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:19:04.315350 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:04.402905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:04.427728 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:19:04.436361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8444087d-cce1-48d6-bea7-55a62e6a17a3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4535339 Dec 21 04:19:04.437119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:04.439558 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-752866f2-9d64-42ff-9256-9ae7bdd63000" -d '{"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:04.495513 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c41ca42-e10a-4ce4-833a-2fd5188c759a x-openstack-request-id: req-4c41ca42-e10a-4ce4-833a-2fd5188c759a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:04.496137 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:04.496405 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4c41ca42-e10a-4ce4-833a-2fd5188c759a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:04.496909 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'status': 'completed', 'code': 200} Dec 21 04:19:04.510375 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-b06dbcf5-d392-41aa-8594-3e7a6f9e98fe service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0785551 Dec 21 04:19:04.585976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f73cf91-34de-414b-8e57-550f4d966265 req-e0de4256-7880-42e3-af6c-8a577df4f3e0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:04.588498 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f73cf91-34de-414b-8e57-550f4d966265 req-e0de4256-7880-42e3-af6c-8a577df4f3e0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0677454 Dec 21 04:19:04.643798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-2323035c-1cd6-4af8-ad7b-08f6a0747145 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:04.645946 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-2323035c-1cd6-4af8-ad7b-08f6a0747145 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1098 time: 0.0978303 Dec 21 04:19:04.655337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-233017eb-0388-4d56-ab49-6ef12eec447b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:04.657423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-233017eb-0388-4d56-ab49-6ef12eec447b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 1098 time: 0.0666726 Dec 21 04:19:04.669666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f73cf91-34de-414b-8e57-550f4d966265 req-03291dc0-7ec7-49c8-bac9-9b30c74c8f9c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727592 Dec 21 04:19:04.694242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38926) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:04.778113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6922db67-3b36-46b6-a796-ebc07a1c3960 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 HTTP/1.1" status: 200 len: 992 time: 0.0818985 Dec 21 04:19:04.862889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-05ef396e-a9b8-481d-aa25-074aae2e9830 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:04.864257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-05ef396e-a9b8-481d-aa25-074aae2e9830 service neutron] 10.222.0.54 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 898 time: 0.2058210 Dec 21 04:19:04.870296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-654cde28-f5a4-45cc-a595-c03371649d7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:04.871787 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-654cde28-f5a4-45cc-a595-c03371649d7c service neutron] 10.222.0.54 "GET /v2.0/networks?id=ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 200 len: 910 time: 0.1895630 Dec 21 04:19:04.878869 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ef1eaa36-173d-4e81-b5ea-fcba830d3bd7', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.105', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'port_id': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3686, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'mac_address': 'fa:16:3e:14:9a:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17498f65-94f3-48c0-9a1b-af1140317b01', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:19:02Z', 'updated_at': '2021-12-21T04:19:02Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:04.907323 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] Checking router: 72c80be8-99de-46c5-ae5e-6b187a77c27a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:19:04.916403 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:19:04.917066 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:18:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:05.036339 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:19:05.281247 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ef1eaa36-173d-4e81-b5ea-fcba830d3bd7', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.105', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'port_id': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3686, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'mac_address': 'fa:16:3e:14:9a:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17498f65-94f3-48c0-9a1b-af1140317b01', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:19:02Z', 'updated_at': '2021-12-21T04:19:02Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:05.285951 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-c6b7bb34-4919-4b4f-9326-a74ac2bfb121 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1000 time: 0.4132349 Dec 21 04:19:05.288331 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-abae8666-664a-4043-9a83-39a1a59c6808 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 200 len: 1002 time: 0.4082756 Dec 21 04:19:05.314910 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-902773b7-4fff-41f3-b008-6e13aa6741a3 None None] The sync data for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 is: [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ef1eaa36-173d-4e81-b5ea-fcba830d3bd7', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.105', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'port_id': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3686, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'mac_address': 'fa:16:3e:14:9a:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17498f65-94f3-48c0-9a1b-af1140317b01', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:19:02Z', 'updated_at': '2021-12-21T04:19:02Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:19:05.388056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-c68ba0be-b5d3-4dfe-a8ab-4cf647186835 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:05.389510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-c68ba0be-b5d3-4dfe-a8ab-4cf647186835 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 200 len: 835 time: 0.0901144 Dec 21 04:19:05.391040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-5ebbbb15-1fe0-4238-9f35-f7178c6baa5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:05.392335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-5ebbbb15-1fe0-4238-9f35-f7178c6baa5a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=0707099f-c76b-4feb-9475-4cacc79c073a HTTP/1.1" status: 200 len: 848 time: 0.0785797 Dec 21 04:19:05.483772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-88e64e96-fa33-4377-a20d-dd41cd2a726f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:05.485301 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-88e64e96-fa33-4377-a20d-dd41cd2a726f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=aabd54e3-094a-4a25-8130-c07bb6a2856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0733271 Dec 21 04:19:05.487359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-232f7712-accf-4054-87b8-ce12e9fca01f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:05.488768 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-232f7712-accf-4054-87b8-ce12e9fca01f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ad2df216-0eaf-414a-a835-c27348ac987a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0683048 Dec 21 04:19:05.545242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f093e69-27a6-4a28-8d1a-1274c68eec1a None None] New status for floating IP ef1eaa36-173d-4e81-b5ea-fcba830d3bd7: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:19:05.669336 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-1fa6676a-1e9d-42e4-ac35-a239c539524c service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1619060 Dec 21 04:19:05.671308 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-8c8e28ac-66ab-40cd-b77b-bf7339195a5e service neutron] 10.222.0.54 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1546478 Dec 21 04:19:05.782323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 38936) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:05.844725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-19310b1c-1ee7-433a-afbc-14cfddaa062e req-19d9a3f8-f690-4b17-8ccd-14b64dfab711 service neutron] 10.222.0.54 "GET /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1615722 Dec 21 04:19:05.849138 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-752866f2-9d64-42ff-9256-9ae7bdd63000 req-607be29c-f67b-41a0-be9a-086db6599608 service neutron] 10.222.0.54 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1647508 Dec 21 04:19:05.892337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-37f2ed4b-00a2-40b6-9898-fc663fab8c86 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 HTTP/1.1" status: 200 len: 994 time: 0.1089115 Dec 21 04:19:19.873222 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2c8985ef-fb43-4629-94cd-d8701061a4b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:22.674768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d3e40cef-d275-4d10-811f-eb9b17233541 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:23.013256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:23.309685 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:25.054021 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:25.086399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:25.778262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:29.891807 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:19:32.602746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 39806) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:32.716805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507284a2-7104-4531-9eb2-1d763f1deb16 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:32.799934 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507284a2-7104-4531-9eb2-1d763f1deb16 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:32.870561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507284a2-7104-4531-9eb2-1d763f1deb16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:32.914457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-507284a2-7104-4531-9eb2-1d763f1deb16 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8d696de-d6c9-48fd-b4fe-50a3b956de8f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:32.920388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-507284a2-7104-4531-9eb2-1d763f1deb16 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c6365ecd8f4345b98025808b75fd8956&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3152285 Dec 21 04:19:32.923006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39812) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:32.981424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.008619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.127305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.130158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.137762 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f8d696de-d6c9-48fd-b4fe-50a3b956de8f HTTP/1.1" status: 204 len: 168 time: 0.2121525 Dec 21 04:19:33.149726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8d696de-d6c9-48fd-b4fe-50a3b956de8f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:33.160242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.160789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.161301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.161827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.162499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.163019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.163515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.164202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.164697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.165190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.165965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.166778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.167320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1d3addd-9ad6-445c-87f2-b9857ca75128 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:33.759720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39834) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:33.773482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4c231c6-1f0d-4198-a848-4510049ce08c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.852612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4c231c6-1f0d-4198-a848-4510049ce08c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.932149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a4c231c6-1f0d-4198-a848-4510049ce08c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:33.969972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c231c6-1f0d-4198-a848-4510049ce08c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25c66ae7-68af-4ed0-acaa-53c8e62efc47,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:33.975709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a4c231c6-1f0d-4198-a848-4510049ce08c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=9b443bd88508442eaa356f177fd6cd4c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2149656 Dec 21 04:19:33.978503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39836) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:34.029080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b337c46-69c3-4cf5-92f8-4809419a8344 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:34.050543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b337c46-69c3-4cf5-92f8-4809419a8344 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:34.164913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b337c46-69c3-4cf5-92f8-4809419a8344 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:34.167570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b337c46-69c3-4cf5-92f8-4809419a8344 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:34.169344 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9b337c46-69c3-4cf5-92f8-4809419a8344 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/25c66ae7-68af-4ed0-acaa-53c8e62efc47 HTTP/1.1" status: 204 len: 168 time: 0.1898944 Dec 21 04:19:34.179961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b337c46-69c3-4cf5-92f8-4809419a8344 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25c66ae7-68af-4ed0-acaa-53c8e62efc47,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:37.262802 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff5591-a062-4a5a-8815-c045a6e3e361 req-486b7e16-6d8e-4cdc-aead-2a5099a2f09f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:37.265038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4ff5591-a062-4a5a-8815-c045a6e3e361 req-486b7e16-6d8e-4cdc-aead-2a5099a2f09f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0564218 Dec 21 04:19:37.316494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4ff5591-a062-4a5a-8815-c045a6e3e361 req-38203522-20e4-49df-b2b5-6fbbb3cacc7d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447397 Dec 21 04:19:37.341032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 39988) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:37.403907 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cc15b27e-5ff5-4f18-9483-fe70a4a4fb14 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 HTTP/1.1" status: 200 len: 994 time: 0.0616300 Dec 21 04:19:37.749052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796cd170-2dd5-444f-b30b-d50f9c79420e req-a811be87-aa36-4f9e-9247-b4d8a309f63d tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:37.750564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-796cd170-2dd5-444f-b30b-d50f9c79420e req-a811be87-aa36-4f9e-9247-b4d8a309f63d tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1098 time: 0.0470829 Dec 21 04:19:37.806261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-796cd170-2dd5-444f-b30b-d50f9c79420e req-891e5e91-c998-40cc-b74a-7dd15e798aba tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458281 Dec 21 04:19:38.934779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-dd415338-79aa-4ddd-8b32-856db5ef1bbd service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0408390 Dec 21 04:19:38.943564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-b69016bc-9cbd-464a-8bb5-201e080d2bb9 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:19:38.944664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-b69016bc-9cbd-464a-8bb5-201e080d2bb9 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050521 Dec 21 04:19:39.933403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-da194acc-7fe4-4f9f-b471-783aab523d99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:39.935501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-da194acc-7fe4-4f9f-b471-783aab523d99 service neutron] 10.222.0.18 "GET /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1095 time: 0.0365474 Dec 21 04:19:39.952715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Request body: {'binding': {'host': 'n-h2-822053-11', 'vnic_type': 'normal', 'profile': {}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:19:39.953801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Unknown quota resources ['binding']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:19:40.094850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on host n-h2-822053-11 for vnic_type normal with profile None {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:19:40.095594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:19:40.096268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:19:40.100979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:19:40.101302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:19:40.106422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:19:40.107146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Checking segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:19:40.107793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Bound using segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:19:40.108464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Bound port: 81972a7a-ce99-4741-ba4b-3f427713a5f9, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:19:40.207978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:19:40.266766 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:40.267939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-33e7b2fe-0cc7-438f-b3c4-6520f62f5986 service neutron] 10.222.0.18 "POST /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9/bindings HTTP/1.1" status: 201 len: 390 time: 0.3212075 Dec 21 04:19:40.586875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d503667-f3a6-49cb-9d98-7a13910606c0 req-62a8f035-a536-41a5-8317-49ac423bbf10 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:40.588538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d503667-f3a6-49cb-9d98-7a13910606c0 req-62a8f035-a536-41a5-8317-49ac423bbf10 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0529149 Dec 21 04:19:40.642520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d503667-f3a6-49cb-9d98-7a13910606c0 req-b25e80b3-34ae-41ae-80e4-6aff6604c738 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475519 Dec 21 04:19:41.031643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-d68b6609-2e4c-4b9a-aa44-5991b15508ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:41.032862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-d68b6609-2e4c-4b9a-aa44-5991b15508ee service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1098 time: 0.0420647 Dec 21 04:19:41.143886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-49aeafd6-3749-4bf9-b6b8-1f885440dfb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:41.145400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-49aeafd6-3749-4bf9-b6b8-1f885440dfb5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 898 time: 0.1056452 Dec 21 04:19:41.232928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-42310f3a-60d7-4796-897e-8c23ff580b2b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1002 time: 0.0732172 Dec 21 04:19:41.296867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3bbf4c4c-bfd2-4213-b179-e3608c499b9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:41.298836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3bbf4c4c-bfd2-4213-b179-e3608c499b9c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 200 len: 835 time: 0.0539980 Dec 21 04:19:41.348389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-697f7e60-ff0e-4f9f-a83a-ac9d26c30224 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:41.349818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-697f7e60-ff0e-4f9f-a83a-ac9d26c30224 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=aabd54e3-094a-4a25-8130-c07bb6a2856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0422990 Dec 21 04:19:41.461579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-09ca6cb5-ab0b-4722-98f9-72c33bfc4d17 service neutron] 10.222.0.31 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0989616 Dec 21 04:19:41.576597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-13749218-e563-4153-91c9-b9d81b76eb9f service neutron] 10.222.0.31 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047101 Dec 21 04:19:41.830953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-b8aa1c4d-1971-4bb7-b353-af888c223425 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:41.832491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-b8aa1c4d-1971-4bb7-b353-af888c223425 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01&tenant_id=10a032d25985452584a3dcdae6969809&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1098 time: 0.1232207 Dec 21 04:19:41.841284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf5c5c3-b77c-448d-9ed8-365786b2bc4d req-2c78eb56-91c8-472e-b574-15cfb3c0b7e4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:41.842894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbf5c5c3-b77c-448d-9ed8-365786b2bc4d req-2c78eb56-91c8-472e-b574-15cfb3c0b7e4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.1230628 Dec 21 04:19:41.848617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-822053-11'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:19:41.939202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:41.953079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbf5c5c3-b77c-448d-9ed8-365786b2bc4d req-8ad9038f-5771-457b-9acd-28627daa4505 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1014314 Dec 21 04:19:42.097681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:42.137089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:19:42.180320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:42.182658 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-693d5d2a-a416-4f4d-ab95-5ef09605a572" -d '{"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-unplugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:42.189066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.231603 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd5c0b0e-d04c-462f-934a-6eb7fd625eab x-openstack-request-id: req-cd5c0b0e-d04c-462f-934a-6eb7fd625eab {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:42.231902 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-unplugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:42.232158 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cd5c0b0e-d04c-462f-934a-6eb7fd625eab {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:42.232560 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'code': 200} Dec 21 04:19:42.275892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.381121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:42.447943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on host n-h1-822053-11 for vnic_type normal with profile {"migrating_to": "n-h2-822053-11"} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:19:42.448120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:19:42.448414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:19:42.453270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:19:42.453604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Attempting to bind port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on network aabd54e3-094a-4a25-8130-c07bb6a2856e {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:19:42.461606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:19:42.461606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Checking segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:19:42.461606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Bound using segment: {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:19:42.461961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Bound port: 81972a7a-ce99-4741-ba4b-3f427713a5f9, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4602fa63-f40d-4677-ab67-9cb0be8cd412', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:19:42.462319 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.551584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:19:42.555273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:19:42.644715 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.683329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d15aabd0-37c2-471b-a510-1cc45acbc7c7 None None] Provisioning complete for port 81972a7a-ce99-4741-ba4b-3f427713a5f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:19:42.684079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d15aabd0-37c2-471b-a510-1cc45acbc7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.770811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=8']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:42.804570 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d15aabd0-37c2-471b-a510-1cc45acbc7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.837055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:42.839669 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14aa3cc2-03e5-4370-8ce5-1ee2ac9021a4" -d '{"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-plugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:42.842410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:42.854764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d15aabd0-37c2-471b-a510-1cc45acbc7c7 None None] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:42.856221 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:42.858554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-7441465b-871a-4e0d-abfb-6870182c57bd service neutron] 10.222.0.31 "PUT /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1124 time: 1.0147171 Dec 21 04:19:42.890772 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e5e6826-6f25-497e-9464-f03476a68929 x-openstack-request-id: req-0e5e6826-6f25-497e-9464-f03476a68929 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:42.891249 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-plugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:42.892125 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0e5e6826-6f25-497e-9464-f03476a68929 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:42.892125 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'code': 200} Dec 21 04:19:42.938723 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d15aabd0-37c2-471b-a510-1cc45acbc7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:43.030386 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['81972a7a-ce99-4741-ba4b-3f427713a5f9'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:19:43.093846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72455f5a-d94d-4c8b-976c-dcda5facad81 req-18394b1f-b187-41a8-b028-ff6ab41b37e4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:43.124402 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72455f5a-d94d-4c8b-976c-dcda5facad81 req-18394b1f-b187-41a8-b028-ff6ab41b37e4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0943930 Dec 21 04:19:43.137751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15aabd0-37c2-471b-a510-1cc45acbc7c7 None None] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:43.202948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72455f5a-d94d-4c8b-976c-dcda5facad81 req-b9a47a04-b6c8-4829-a007-6fda6abb8082 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0776088 Dec 21 04:19:43.332519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9fd5cd37-6ed0-442d-9f63-0b5d908a5512 None None] Provisioning complete for port 81972a7a-ce99-4741-ba4b-3f427713a5f9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:19:43.334374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9fd5cd37-6ed0-442d-9f63-0b5d908a5512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:44.233920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:44.237056 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-410de9ff-5b91-4d6b-84ef-17cf78190ba7" -d '{"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:44.381216 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8f46022-9013-4679-a116-dba148b8b529 x-openstack-request-id: req-d8f46022-9013-4679-a116-dba148b8b529 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:44.381216 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:44.381216 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d8f46022-9013-4679-a116-dba148b8b529 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:44.381216 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'status': 'completed', 'code': 200} Dec 21 04:19:44.381216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988cb1a8-7ff3-4d5d-938f-696701e3df31 req-d9db285c-4d9e-4c04-bd53-2b839e7becae tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:44.381216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988cb1a8-7ff3-4d5d-938f-696701e3df31 req-d9db285c-4d9e-4c04-bd53-2b839e7becae tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0552723 Dec 21 04:19:44.409175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-988cb1a8-7ff3-4d5d-938f-696701e3df31 req-99a4edd7-4f02-42a4-a649-f37d30c4911e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616109 Dec 21 04:19:44.412708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-e6623c40-e4f0-41cc-bbe3-956a3bcf62fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:44.415359 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-e6623c40-e4f0-41cc-bbe3-956a3bcf62fe service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1129 time: 0.0645931 Dec 21 04:19:44.543042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-a9433549-7fc3-4ca7-b8c0-7140ee506bb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:44.545352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-a9433549-7fc3-4ca7-b8c0-7140ee506bb8 service neutron] 10.222.0.54 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 898 time: 0.1205661 Dec 21 04:19:44.627524 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-52f1a3a3-f4eb-4b64-a75f-be59d0a96ceb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1002 time: 0.0749104 Dec 21 04:19:44.692807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-1aec11f8-c1fc-4465-b5da-43f1a1108c51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:44.694376 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-1aec11f8-c1fc-4465-b5da-43f1a1108c51 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 200 len: 835 time: 0.0606005 Dec 21 04:19:44.748589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-038be1e4-ccfc-42cf-ab61-3966695e2e66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:44.750176 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-038be1e4-ccfc-42cf-ab61-3966695e2e66 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=aabd54e3-094a-4a25-8130-c07bb6a2856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0470421 Dec 21 04:19:44.847449 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-5b63f58c-7ed1-422c-ad43-262a59766221 service neutron] 10.222.0.54 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900795 Dec 21 04:19:44.952616 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-410de9ff-5b91-4d6b-84ef-17cf78190ba7 req-eb6376cb-7a77-4efb-9a90-4272b1c84fd8 service neutron] 10.222.0.54 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0970922 Dec 21 04:19:45.327396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:19:45.489130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:45.503593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 has no active binding in host n-h2-822053-11 {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 21 04:19:45.553324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5915a42-7376-4eba-830f-83bd910c34ed req-fa90e58f-dc8b-49e0-b652-da16a37a7005 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:45.555592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5915a42-7376-4eba-830f-83bd910c34ed req-fa90e58f-dc8b-49e0-b652-da16a37a7005 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0560577 Dec 21 04:19:45.609268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5915a42-7376-4eba-830f-83bd910c34ed req-34c8ae80-e46a-4dda-b56c-f249475a94e0 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469456 Dec 21 04:19:46.737596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9fa6f40-9fea-4506-8553-61dc6ff061d3 req-a00be101-4760-42cc-833a-27825552f9dd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:46.745067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9fa6f40-9fea-4506-8553-61dc6ff061d3 req-a00be101-4760-42cc-833a-27825552f9dd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0599923 Dec 21 04:19:46.798438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9fa6f40-9fea-4506-8553-61dc6ff061d3 req-0c7f1a9a-6465-4a19-9b8a-5034fbe3e3dc tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525115 Dec 21 04:19:47.930587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ea45c4-3954-4e55-9518-32e55bb5e3fb req-04be6886-6a62-4ac3-9201-20eeaa535167 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:47.932293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13ea45c4-3954-4e55-9518-32e55bb5e3fb req-04be6886-6a62-4ac3-9201-20eeaa535167 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 946 time: 0.0612094 Dec 21 04:19:47.984762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13ea45c4-3954-4e55-9518-32e55bb5e3fb req-4ad89283-566f-4837-8f03-85d3c018e26c tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462134 Dec 21 04:19:48.362170 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-bb7bc8a3-96b1-44c4-8f63-c1dd15d36e4d service neutron] 10.222.0.54 "GET /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9/bindings/n-h2-822053-11 HTTP/1.1" status: 200 len: 385 time: 0.0697808 Dec 21 04:19:48.552383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:48.572296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:19:48.617748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:48.620018 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa957229-af62-48fb-9fd3-01d501917fc2" -d '{"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-unplugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:48.628111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:48.669501 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c613ea8f-3018-4a68-9d76-f13849f4ccdc x-openstack-request-id: req-c613ea8f-3018-4a68-9d76-f13849f4ccdc {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:48.669501 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-unplugged", "status": "completed", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:48.669501 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c613ea8f-3018-4a68-9d76-f13849f4ccdc {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:48.669501 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'code': 200} Dec 21 04:19:48.715510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:48.803305 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] Transition to ACTIVE for port object 81972a7a-ce99-4741-ba4b-3f427713a5f9 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:19:48.902562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:49.021420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] Pushing event updated for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=11']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:49.056769 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] No DVR routers for this DVR port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:19:49.128751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b84e58-166b-4445-839c-e072e8b80f20 req-3857dbd9-a6dc-48f2-b17d-caa03f8f71dd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.137284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6b84e58-166b-4445-839c-e072e8b80f20 req-3857dbd9-a6dc-48f2-b17d-caa03f8f71dd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0581057 Dec 21 04:19:49.197743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6b84e58-166b-4445-839c-e072e8b80f20 req-d6b6d60e-a282-4891-aee5-5b930d154e39 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593333 Dec 21 04:19:49.217865 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-3731e1a3-2442-4187-94b6-8d5a336a9495 service neutron] 10.222.0.54 "PUT /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9/bindings/n-h2-822053-11/activate HTTP/1.1" status: 200 len: 370 time: 0.8477399 Dec 21 04:19:49.467397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-1515b461-38a6-4799-8e1f-f61821403067 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.468913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-1515b461-38a6-4799-8e1f-f61821403067 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01&tenant_id=10a032d25985452584a3dcdae6969809&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.0584636 Dec 21 04:19:49.522150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-03518492-1cd5-421c-93af-a02d428546a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.523946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-03518492-1cd5-421c-93af-a02d428546a6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 1097 time: 0.0460613 Dec 21 04:19:49.608858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-5ebaa441-d89e-4b28-846d-519f95203ce9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.610773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-5ebaa441-d89e-4b28-846d-519f95203ce9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1097 time: 0.0498161 Dec 21 04:19:49.705592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-cd7a7a91-f7af-4569-8a7a-f245cd767603 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.707223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-cd7a7a91-f7af-4569-8a7a-f245cd767603 service neutron] 10.222.0.31 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 898 time: 0.0887866 Dec 21 04:19:49.780829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-1fe7948a-e07b-407b-ba73-0fcb517b306c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 1000 time: 0.0654263 Dec 21 04:19:49.844053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-509eb6c4-0dc8-4d7b-af17-a89f492f76ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.845568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-509eb6c4-0dc8-4d7b-af17-a89f492f76ed service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 200 len: 835 time: 0.0575681 Dec 21 04:19:49.895469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-d7410e09-a15b-4782-a7ae-bebb8f77d75f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:49.897409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-d7410e09-a15b-4782-a7ae-bebb8f77d75f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=aabd54e3-094a-4a25-8130-c07bb6a2856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0439937 Dec 21 04:19:49.915351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-990e6116-7301-4c0a-9ed4-c598db6459fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:50.034082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-01a743b3-e016-4db7-8c26-1a0ac363fa9b service neutron] 10.222.0.31 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1126719 Dec 21 04:19:50.141508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-56a14728-17af-4599-b322-a2f944922884 service neutron] 10.222.0.31 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966203 Dec 21 04:19:50.334991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20932bf-afb4-4746-886b-8c335820578e req-a5e9fb53-164f-46f8-82e0-c968b1858a75 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:50.334991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a20932bf-afb4-4746-886b-8c335820578e req-a5e9fb53-164f-46f8-82e0-c968b1858a75 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0544562 Dec 21 04:19:50.386635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a20932bf-afb4-4746-886b-8c335820578e req-fedb2ddd-af97-4261-8aaa-5c7d1e3a66af tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445855 Dec 21 04:19:50.719854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-8b495c25-1158-48dd-b519-b1b97b2a02ae tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:50.721367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-8b495c25-1158-48dd-b519-b1b97b2a02ae tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01&tenant_id=10a032d25985452584a3dcdae6969809&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 1097 time: 0.0474370 Dec 21 04:19:50.918386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-f5cf8157-31b5-49e9-9fcb-fa02ac47f1b2 service neutron] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:19:50.921820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-f5cf8157-31b5-49e9-9fcb-fa02ac47f1b2 service neutron] Publish callbacks [] for binding, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:50.928737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb8a8ba4-fe04-4d02-beff-70dc5ca2df24 req-f5cf8157-31b5-49e9-9fcb-fa02ac47f1b2 service neutron] 10.222.0.31 "DELETE /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9/bindings/n-h1-822053-11 HTTP/1.1" status: 204 len: 173 time: 0.1906979 Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:19:51.556293 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:19:51.563672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24f42831-5b3e-470e-ad95-afffb4e8cea7 req-3ccd2370-3cf4-41d2-bffc-c90297d16da1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:51.565410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24f42831-5b3e-470e-ad95-afffb4e8cea7 req-3ccd2370-3cf4-41d2-bffc-c90297d16da1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0875373 Dec 21 04:19:51.649395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24f42831-5b3e-470e-ad95-afffb4e8cea7 req-864278bf-5f28-4238-8f50-586a055b3d55 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0683863 Dec 21 04:19:51.761153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f0b7c6c-c6b5-40b1-bd84-2d32046d1e3b req-04215658-1f76-4667-a6fc-7e8dd739c431 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:51.762703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f0b7c6c-c6b5-40b1-bd84-2d32046d1e3b req-04215658-1f76-4667-a6fc-7e8dd739c431 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1097 time: 0.0425599 Dec 21 04:19:51.826556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f0b7c6c-c6b5-40b1-bd84-2d32046d1e3b req-173f3aa2-d0b2-46ad-9e0e-cdada649c9ce tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573404 Dec 21 04:19:51.962212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e6a130-8cc7-4cc2-a82c-907479359a28 req-761454a4-317b-4a12-bf93-35fe9b8f29dd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:51.964278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11e6a130-8cc7-4cc2-a82c-907479359a28 req-761454a4-317b-4a12-bf93-35fe9b8f29dd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0578098 Dec 21 04:19:52.057976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40300) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:52.067122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11e6a130-8cc7-4cc2-a82c-907479359a28 req-f2bba225-377d-4875-91d7-741f0327d8d2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911117 Dec 21 04:19:52.144580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e245b31-083c-4b4c-a030-5b75214f846e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 HTTP/1.1" status: 200 len: 992 time: 0.0799642 Dec 21 04:19:52.690832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2937eaf0-6224-44e0-97e0-afa314430637 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:53.016759 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:53.088425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:19:53.138428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 81972a7a-ce99-4741-ba4b-3f427713a5f9 host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:19:53.138759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:19:53.319545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:54.414783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40318) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:54.584490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 55e714f0-21b9-4953-90b4-cecd1b24c5e7 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:19:54.584747 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:54.666123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:54.666494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:54.680547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 55e714f0-21b9-4953-90b4-cecd1b24c5e7 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:19:54.916223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:54.943211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=55e714f0-21b9-4953-90b4-cecd1b24c5e7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:55.016360 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:55.016722 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 disassociated (deleted). External IP: 172.25.5.105, port: 81972a7a-ce99-4741-ba4b-3f427713a5f9. Dec 21 04:19:55.052899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:55.138951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:55.238087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 72c80be8-99de-46c5-ae5e-6b187a77c27a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:19:55.351870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:19:55.357510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:55.363376 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] Sync routers for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:19:55.375173 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:19:55.387785 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:55.394758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0549c136-84f3-40e8-b13c-fbeb80d70e34 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/floatingips/ef1eaa36-173d-4e81-b5ea-fcba830d3bd7 HTTP/1.1" status: 204 len: 168 time: 0.9786515 Dec 21 04:19:55.395446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:55.398256 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28905ce7-5acb-4f6c-8052-b35f961869c5" -d '{"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:55.529865 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb381e97-e6a2-4c21-ab00-ecee92c3dd34 x-openstack-request-id: req-eb381e97-e6a2-4c21-ab00-ecee92c3dd34 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:55.530507 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:55.530507 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-eb381e97-e6a2-4c21-ab00-ecee92c3dd34 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:55.530731 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:19:55.531180 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'status': 'completed', 'code': 200} Dec 21 04:19:55.620453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-54814ff4-e06f-4b6d-aff4-b20f60792ed9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:55.622206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-54814ff4-e06f-4b6d-aff4-b20f60792ed9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 1097 time: 0.0460155 Dec 21 04:19:55.763379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-2d47969d-ab67-44a2-a482-3b076df7f4b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:55.765038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-2d47969d-ab67-44a2-a482-3b076df7f4b8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 200 len: 898 time: 0.1312392 Dec 21 04:19:55.770571 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:55.801699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] Checking router: 72c80be8-99de-46c5-ae5e-6b187a77c27a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:19:55.810593 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:19:55.811238 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:55.817322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-901cda3c-b20c-4d05-9267-f54938f2cb7f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 200 len: 217 time: 0.0388527 Dec 21 04:19:55.847535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:55.885990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-db74361c-fd2f-4960-8de4-fd2be800cd6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:55.888710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-db74361c-fd2f-4960-8de4-fd2be800cd6a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 200 len: 835 time: 0.0589926 Dec 21 04:19:55.929603 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:19:56.022485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce5feac-e130-4aa1-8a9b-35fb2772bc64 req-53b29d06-49cf-4031-b7e2-a48b6db527c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:56.024161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dce5feac-e130-4aa1-8a9b-35fb2772bc64 req-53b29d06-49cf-4031-b7e2-a48b6db527c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0772927 Dec 21 04:19:56.027374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-44266102-3a69-4046-900d-868a933d0cc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:56.028853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-44266102-3a69-4046-900d-868a933d0cc5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=aabd54e3-094a-4a25-8130-c07bb6a2856e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0918133 Dec 21 04:19:56.148733 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:19:56.150585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dce5feac-e130-4aa1-8a9b-35fb2772bc64 req-20cc7fc8-cccd-4f71-9e11-4cc031306da2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1154144 Dec 21 04:19:56.178039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-7a94d797-0e48-44a5-910c-e08e0df776a4 service neutron] 10.222.0.31 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1352332 Dec 21 04:19:56.186804 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9955d45-0575-4783-84bf-c1046a7bb833 None None] The sync data for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 is: [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:18:44Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '53932384-bd49-4eca-9c91-e5c410ae41e5', 'name': '', 'network_id': 'aabd54e3-094a-4a25-8130-c07bb6a2856e', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:58:12:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_interface', 'standard_attr_id': 3683, 'fixed_ips': [{'subnet_id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:43Z', 'updated_at': '2021-12-21T04:18:48Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '63aec071-a40e-49a6-ba2b-16c229285c1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:19:56.292453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28905ce7-5acb-4f6c-8052-b35f961869c5 req-6de443ac-4c9e-4c7c-a271-69ffa0e08bb6 service neutron] 10.222.0.31 "GET /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1038752 Dec 21 04:19:56.474794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4768bc97-21ee-45f8-9ef8-0628a3c56700 None None] New status for floating IP ef1eaa36-173d-4e81-b5ea-fcba830d3bd7: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:19:56.617394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-73649f83-d221-4319-9b8c-222985fd681d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:19:56.620008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-73649f83-d221-4319-9b8c-222985fd681d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 945 time: 0.0751626 Dec 21 04:19:56.724261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 81972a7a-ce99-4741-ba4b-3f427713a5f9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:19:56.724963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:56.821906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 81972a7a-ce99-4741-ba4b-3f427713a5f9, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=81972a7a-ce99-4741-ba4b-3f427713a5f9,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:56.822222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:56.834837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 81972a7a-ce99-4741-ba4b-3f427713a5f9 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:19:57.074123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:57.109798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=81972a7a-ce99-4741-ba4b-3f427713a5f9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:19:57.122312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.122312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.122657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.123050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.123427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.123720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.124105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.124441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.124768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.125096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.125422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.125747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.126073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:19:57.163365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] No DVR routers for this DVR port 81972a7a-ce99-4741-ba4b-3f427713a5f9 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:19:57.166145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:57.169545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-954c3ad9-b6b6-479f-8dea-c621ec73c028 req-d8de24cd-0d06-4444-b05c-8f8297e47cba tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "DELETE /v2.0/ports/81972a7a-ce99-4741-ba4b-3f427713a5f9 HTTP/1.1" status: 204 len: 173 time: 0.5402098 Dec 21 04:19:57.171350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-deleted', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:19:57.172486 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-071136c9-9ee0-4b44-88eb-0600134143e9" -d '{"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-deleted", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:19:57.221036 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:19:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b916e31-b589-4c49-8a90-3230790caa00 x-openstack-request-id: req-8b916e31-b589-4c49-8a90-3230790caa00 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:19:57.221347 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17498f65-94f3-48c0-9a1b-af1140317b01", "name": "network-vif-deleted", "tag": "81972a7a-ce99-4741-ba4b-3f427713a5f9", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:19:57.221658 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8b916e31-b589-4c49-8a90-3230790caa00 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:19:57.222093 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17498f65-94f3-48c0-9a1b-af1140317b01', 'name': 'network-vif-deleted', 'tag': '81972a7a-ce99-4741-ba4b-3f427713a5f9', 'status': 'completed', 'code': 200} Dec 21 04:19:57.281957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02799511-3c1b-4211-9ac6-863a9e10a34a req-777d5428-51e2-4cfe-bd64-faf8de0b1c97 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=17498f65-94f3-48c0-9a1b-af1140317b01 HTTP/1.1" status: 200 len: 210 time: 0.0308905 Dec 21 04:19:58.342762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40370) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:19:58.761883 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:59.049024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 53932384-bd49-4eca-9c91-e5c410ae41e5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:19:59.049506 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:59.150017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 53932384-bd49-4eca-9c91-e5c410ae41e5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=53932384-bd49-4eca-9c91-e5c410ae41e5,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:19:59.150416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:59.163383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 53932384-bd49-4eca-9c91-e5c410ae41e5 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:19:59.830472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:19:59.858545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=53932384-bd49-4eca-9c91-e5c410ae41e5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:00.037494 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.269925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router 72c80be8-99de-46c5-ae5e-6b187a77c27a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:20:00.380807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:00.386138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e8647df0-621b-4f93-8189-9a938fe8453b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/72c80be8-99de-46c5-ae5e-6b187a77c27a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0414803 Dec 21 04:20:00.388942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40460) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:00.390625 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] Sync routers for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:00.405733 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:00.406349 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:00.445497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting subnet 63aec071-a40e-49a6-ba2b-16c229285c1a {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:20:00.449221 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.495484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.606091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.613419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:00.744023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-fd85f469-1321-4d16-8648-e1a266dccc9d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0441656 Dec 21 04:20:00.751243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.791363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Subnet': ['ID=63aec071-a40e-49a6-ba2b-16c229285c1a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:00.793052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cb13551-9d37-4c43-a2b1-811be0f11a59 None None] Network aabd54e3-094a-4a25-8130-c07bb6a2856e requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:20:00.797765 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.805226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:00.813013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a4b49759-8f7f-44b6-a18d-d46067f9bebb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/subnets/63aec071-a40e-49a6-ba2b-16c229285c1a HTTP/1.1" status: 204 len: 168 time: 0.4212210 Dec 21 04:20:00.815765 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:19:59Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:00.926761 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] Checking router: 72c80be8-99de-46c5-ae5e-6b187a77c27a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:20:00.938857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:00.961466 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] Routers {'72c80be8-99de-46c5-ae5e-6b187a77c27a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:00.961912 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['72c80be8-99de-46c5-ae5e-6b187a77c27a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:00.972581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-5ab78cb6-7223-4961-9af5-32c7dc5c19d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:00.975571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-5ab78cb6-7223-4961-9af5-32c7dc5c19d2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1097 time: 0.1453369 Dec 21 04:20:01.078208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.147117 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] Set router 72c80be8-99de-46c5-ae5e-6b187a77c27a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:01.190178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-cb87d244-f2ab-4083-bf8c-6ce6c534ead1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:01.191886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-cb87d244-f2ab-4083-bf8c-6ce6c534ead1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1614702 Dec 21 04:20:01.236099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41c19675-308d-4968-9190-08c6f2541230 None None] DHCP port deletion for aabd54e3-094a-4a25-8130-c07bb6a2856e request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:01.282254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port aa20b1de-3fc2-48d1-899f-bec7f7aba885 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:01.286071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.303365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-603afe1a-c24f-4e4e-b741-26ff32df67b3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1001 time: 0.0866785 Dec 21 04:20:01.332586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Deleting port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:01.333266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.394500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port aa20b1de-3fc2-48d1-899f-bec7f7aba885, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aa20b1de-3fc2-48d1-899f-bec7f7aba885,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:01.395481 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.397003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-81e87cd6-2006-4f6d-b088-703f99f63c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:01.398694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-81e87cd6-2006-4f6d-b088-703f99f63c6a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0843098 Dec 21 04:20:01.409853 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:01.411878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for aa20b1de-3fc2-48d1-899f-bec7f7aba885 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:01.413927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-41c19675-308d-4968-9190-08c6f2541230 None None] For port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,segment=NetworkSegment(4602fa63-f40d-4677-ab67-9cb0be8cd412),segment_id=4602fa63-f40d-4677-ab67-9cb0be8cd412)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:01.414472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.440492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 81972a7a-ce99-4741-ba4b-3f427713a5f9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:01.441003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 81972a7a-ce99-4741-ba4b-3f427713a5f9 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:01.447045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Calling delete_port for 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:01.465299 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:19:59Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:01.501589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-01177503-dd56-4f3c-b731-ee6a1b2d4373 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:01.503220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-01177503-dd56-4f3c-b731-ee6a1b2d4373 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0921764 Dec 21 04:20:01.510552 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-641b40f8-6345-48e2-90b5-f41f301ce427 None None] The sync data for ids ['72c80be8-99de-46c5-ae5e-6b187a77c27a'] in n-d-822053-11 is: [{'id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1057615385', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196'}], 'enable_snat': True}, 'gw_port_id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:18:38Z', 'updated_at': '2021-12-21T04:19:59Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': 'aa20b1de-3fc2-48d1-899f-bec7f7aba885', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:ca:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72c80be8-99de-46c5-ae5e-6b187a77c27a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3679, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:18:39Z', 'updated_at': '2021-12-21T04:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:20:01.668589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-f65f8301-7535-42d7-951e-c70241432ac7 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1522791 Dec 21 04:20:01.686415 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.713893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=aa20b1de-3fc2-48d1-899f-bec7f7aba885,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:01.734326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01cf5a60-98b5-44a5-9e7d-624ef785375b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:01.745159 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.775045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41c19675-308d-4968-9190-08c6f2541230 None None] No DVR routers for this DVR port 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:20:01.800366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Pushing event deleted for resources: {'Port': ['ID=44b63089-18a7-4e5c-8cc8-6a4f0f129e5e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:01.804150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ba3846-146d-4d15-8696-4e020467cfc8 req-c7bdfd34-5dc7-40fc-a703-6c26e1cedc70 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238177 Dec 21 04:20:01.809125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.810266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.810604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.810961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.811292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.811618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.812130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.812459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.812924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.814183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.814532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.814863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.815495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41c19675-308d-4968-9190-08c6f2541230 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:01.818781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.946522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:01.949467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.069304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:02.082142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.083066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Fanout notify agent at l3_agent the message router_deleted on router 72c80be8-99de-46c5-ae5e-6b187a77c27a {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:20:02.091926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.096263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:02.096699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 44b63089-18a7-4e5c-8cc8-6a4f0f129e5e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:02.097218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 53932384-bd49-4eca-9c91-e5c410ae41e5 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:02.097827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40542) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:02.099826 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d66977d2-2515-4a47-b806-a707b56ac4f1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/routers/72c80be8-99de-46c5-ae5e-6b187a77c27a HTTP/1.1" status: 204 len: 168 time: 1.2935181 Dec 21 04:20:02.118650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 53932384-bd49-4eca-9c91-e5c410ae41e5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:02.119074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 53932384-bd49-4eca-9c91-e5c410ae41e5 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:02.196823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.396784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.429186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aabd54e3-094a-4a25-8130-c07bb6a2856e']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:02.446010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4602fa63-f40d-4677-ab67-9cb0be8cd412') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:02.446308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4602fa63-f40d-4677-ab67-9cb0be8cd412') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:02.470823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.486618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.495159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:20:02.495620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:20:02.498729 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:20:02.617927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.630914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.631883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/networks/aabd54e3-094a-4a25-8130-c07bb6a2856e HTTP/1.1" status: 204 len: 168 time: 0.5328119 Dec 21 04:20:02.635370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:02.648257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab74441-dbfd-4c25-b2f6-bf13c01acd6f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Network': ['ID=aabd54e3-094a-4a25-8130-c07bb6a2856e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:02.700520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95ad7a7-fb5c-4b6e-83f1-06cbaee52ca2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.728716 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95ad7a7-fb5c-4b6e-83f1-06cbaee52ca2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.899921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95ad7a7-fb5c-4b6e-83f1-06cbaee52ca2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.904621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e95ad7a7-fb5c-4b6e-83f1-06cbaee52ca2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:02.909396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e95ad7a7-fb5c-4b6e-83f1-06cbaee52ca2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/security-groups/5f5bf337-c6ec-48c8-80d3-4fbba4f9421b HTTP/1.1" status: 204 len: 168 time: 0.2730036 Dec 21 04:20:02.938089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95ad7a7-fb5c-4b6e-83f1-06cbaee52ca2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f5bf337-c6ec-48c8-80d3-4fbba4f9421b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:03.368761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:03.377056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-19412860', 'description': 'tempest-secgroup-smoke-19412860 description', 'project_id': '10a032d25985452584a3dcdae6969809'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:03.525653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:03.625783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:03.723897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:03.755008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3e079a6d-07c4-474d-b43d-80e43478771d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:03.853398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa20b1de-3fc2-48d1-899f-bec7f7aba885 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:03.878542 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:03.880260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7edb2e6-b80a-4fe5-8f25-0715e28fde52 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.5104089 Dec 21 04:20:03.883172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40626) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:03.885447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: aa20b1de-3fc2-48d1-899f-bec7f7aba885 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:03.885808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aa20b1de-3fc2-48d1-899f-bec7f7aba885 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:03.890173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '3e079a6d-07c4-474d-b43d-80e43478771d', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:03.984715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.043508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.116299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.139095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff969e7b-3057-4d7a-90d5-7d60e64dd0e9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:04.204917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.206758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5fbe4242-fb0c-4be5-bfca-efa84e46cace tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3214397 Dec 21 04:20:04.209666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40644) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:04.227973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '3e079a6d-07c4-474d-b43d-80e43478771d', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:04.321497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.392911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.457058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.472787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=422ad52b-12b9-43f5-b174-9fe274e5c0f0,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:04.564275 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.565716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1aff629b-6102-4457-a7ec-45f0f7257866 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3551283 Dec 21 04:20:04.568621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40666) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:04.573497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '3e079a6d-07c4-474d-b43d-80e43478771d', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:04.699201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.758663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.830647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.851059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c724e41-abd3-4803-985f-0bc34c35f828,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:04.942168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:04.943788 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b7b2563-9cbe-4eee-a7f9-b060d31605bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3739064 Dec 21 04:20:04.946403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40686) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:04.952955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '3e079a6d-07c4-474d-b43d-80e43478771d', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:05.065945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.158298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.218775 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.240740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ec7aa4e1-fc01-4a0a-9dad-73faa0d3bcf1,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:05.333089 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.334361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7c349d34-949d-4ab7-aec4-1cb480b07a2d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3855624 Dec 21 04:20:05.337070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40704) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:05.341418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '3e079a6d-07c4-474d-b43d-80e43478771d', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:05.447609 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:20:05.453506 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.514259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.584588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.609340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8756043c-f824-4800-94c4-066ae62ea34b,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:05.721907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.723192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dde71029-5c8d-4d9b-8085-28e718434e9e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3851929 Dec 21 04:20:05.725836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 40726) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:05.730214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'security_group_rule': {'security_group_id': '3e079a6d-07c4-474d-b43d-80e43478771d', 'project_id': '10a032d25985452584a3dcdae6969809', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:05.828528 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Project 10a032d25985452584a3dcdae6969809 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:20:05.833897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.894305 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.976970 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:05.995184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80f3a5de-aab2-4d7f-9a7a-46a7dde0fb5b,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:06.119267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.120753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c58e0b8-78c8-4434-b6ee-519dbe894925 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3939955 Dec 21 04:20:06.124153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40742) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:06.130630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'network': {'name': 'tempest-network-smoke--1606260887', 'project_id': '10a032d25985452584a3dcdae6969809', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:06.241905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:20:06.245731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.275071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:20:06.294175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.294533 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Added segment 1509fcd6-3b48-4708-bf68-e2c05f4010da of type vlan for network 9ffc4833-7ee0-4257-9960-94e8ca848a30 Dec 21 04:20:06.348818 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.504940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.510610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:06.511227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.582457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Network': ['ID=9ffc4833-7ee0-4257-9960-94e8ca848a30,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:06.594813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:20:06.631063 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f8c0efb1-1d16-4551-b2dc-03a1451de644 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5018442 Dec 21 04:20:06.636589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:06.638866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'admin_state_up': True, 'project_id': '10a032d25985452584a3dcdae6969809', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:06.760037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.761043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.816834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:06.890663 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:20:07.371810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-c35169c4-a383-4acf-8288-795d4e55d242 req-b49fe9fc-2485-4b73-adf2-f5efb874f977 service neutron] (110311) timed out ('10.222.0.18', 47042) {{(pid=110311) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:20:07.410898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:07.743464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:07.768700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:07.898363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.95 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/90da8399-4129-44f8-9044-2b2cca661397) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:20:08.001414 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:08.098088 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:08.142532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:08.145524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:08.149012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:20:08.159900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f2ee14f-3d8f-499d-8202-e1e66f6b5221 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:08.171158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=90da8399-4129-44f8-9044-2b2cca661397,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:08.198122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4ed0adf0-ce46-478e-9f2f-5620341a2dfc None None] Provisioning complete for port 90da8399-4129-44f8-9044-2b2cca661397 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:08.200939 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4ed0adf0-ce46-478e-9f2f-5620341a2dfc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:08.243364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4ed0adf0-ce46-478e-9f2f-5620341a2dfc None None] Port 90da8399-4129-44f8-9044-2b2cca661397 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:08.480834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:08.697184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:08.939557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:20:09.054512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:09.067535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Sync routers for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:09.077814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:09.081388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:09.195132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:09.221050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.222791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e8715366-8852-43fa-8d39-51f4ccd0b713 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 2.5886090 Dec 21 04:20:09.228619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40868) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:09.261657 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-70fc86ae-7abf-4af0-a4f8-edf5b8632151 tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=10a032d25985452584a3dcdae6969809&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0319045 Dec 21 04:20:09.264172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40872) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:09.388990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:08Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:09.421378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Checking router: fb88a6b5-57b9-4b3c-b920-c99a1adf8778 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:20:09.421739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Updating router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 port 90da8399-4129-44f8-9044-2b2cca661397 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:20:09.427360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49bfd845-fe8d-46e2-8a0d-c61763aacbcd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:09.428901 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-49bfd845-fe8d-46e2-8a0d-c61763aacbcd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1637480 Dec 21 04:20:09.431818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40882) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:09.450243 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.460932 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-141020d2-0187-4927-a85a-e3dbaf6353fd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0280039 Dec 21 04:20:09.463338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:09.469014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-494136648', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'project_id': '10a032d25985452584a3dcdae6969809', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:09.653328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:20:09.657463 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.721513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.848256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.913489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0f2091a-613d-477a-968c-bd73ba2b1989 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:09.933235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Attempting to bind port 90da8399-4129-44f8-9044-2b2cca661397 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:20:09.933630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Attempting to bind port 90da8399-4129-44f8-9044-2b2cca661397 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:20:09.934137 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Attempting to bind port 90da8399-4129-44f8-9044-2b2cca661397 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:09.939002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb0047b-7b56-4660-89e1-fa9fc3057574 None None] Pushing event updated for resources: {'Port': ['ID=90da8399-4129-44f8-9044-2b2cca661397,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:09.947817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:20:09.948196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:20:09.948626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.948973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:20:09.949512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Bound port: 90da8399-4129-44f8-9044-2b2cca661397, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:20:09.949808 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:09.968387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.011075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3ef80b3d-822f-46c6-a158-242949980f8b None None] Provisioning complete for port 90da8399-4129-44f8-9044-2b2cca661397 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:10.011440 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3ef80b3d-822f-46c6-a158-242949980f8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.043335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Subnet': ['ID=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:10.052424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Checking segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:20:10.052792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network hostable DHCP agents. Network: 9ffc4833-7ee0-4257-9960-94e8ca848a30, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:20:10.056481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] For port 90da8399-4129-44f8-9044-2b2cca661397, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:20:10.072967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3ef80b3d-822f-46c6-a158-242949980f8b None None] Port 90da8399-4129-44f8-9044-2b2cca661397 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:10.076705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] For port 90da8399-4129-44f8-9044-2b2cca661397, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=90da8399-4129-44f8-9044-2b2cca661397,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:20:10.184546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:20:10.185644 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.235648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d280b3d1-75c0-4d3d-bcd5-234b6ff79267 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:10.260594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:10.261226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:10.270333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb0047b-7b56-4660-89e1-fa9fc3057574 None None] Pushing event updated for resources: {'Port': ['ID=90da8399-4129-44f8-9044-2b2cca661397,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:10.294656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9ffc4833-7ee0-4257-9960-94e8ca848a30) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:10.299445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:10.300039 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.308795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f67d314-07da-445f-ae6b-f95951a5e357 None None] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:20:10.410906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-98e70a6d-60bf-4a5f-a527-2fd0f97c7383 None None] Provisioning complete for port 90da8399-4129-44f8-9044-2b2cca661397 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:10.411307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-98e70a6d-60bf-4a5f-a527-2fd0f97c7383 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.431380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e18c54e4-0904-4279-b0ec-9e8e325e05ad tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.9668987 Dec 21 04:20:10.434169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 40910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:10.470268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:10.625809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9ffc4833-7ee0-4257-9960-94e8ca848a30', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:20:10.627162 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.693914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-98e70a6d-60bf-4a5f-a527-2fd0f97c7383 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:10.721114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-e86d3bb3-9047-4f65-bc2a-756a7b9035b6 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:10.723660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-e86d3bb3-9047-4f65-bc2a-756a7b9035b6 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/networks?id=1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 200 len: 814 time: 0.1364539 Dec 21 04:20:10.740663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-aef40709-daff-422a-a62c-f8e6eb48bba5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/quotas/57ab6cbdcda24806861df9ec12f18681 HTTP/1.1" status: 200 len: 375 time: 0.0105793 Dec 21 04:20:10.782953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-e24a96d7-94b3-4400-9121-2fdccb8e0155 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0277803 Dec 21 04:20:10.821706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-98e70a6d-60bf-4a5f-a527-2fd0f97c7383 None None] For port 90da8399-4129-44f8-9044-2b2cca661397, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=90da8399-4129-44f8-9044-2b2cca661397,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:10.899955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-4ec61a3b-15ba-4137-9df6-cb0234a3ce4f service neutron] 10.222.0.18 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1167748 Dec 21 04:20:10.916625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-98e70a6d-60bf-4a5f-a527-2fd0f97c7383 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.005240 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.020407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-e482d692-4387-4001-946a-2b3203cf3489 service neutron] 10.222.0.18 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1064348 Dec 21 04:20:11.025743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:08Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:11.028015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Allocated IP 172.20.0.2 (9ffc4833-7ee0-4257-9960-94e8ca848a30/1eab21fa-1f41-4ce7-9ab3-bf42ee33a216/c2f51307-9dc8-4fc4-b0ab-d09fdee4da47) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:20:11.034915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e70a6d-60bf-4a5f-a527-2fd0f97c7383 None None] Pushing event updated for resources: {'Port': ['ID=90da8399-4129-44f8-9044-2b2cca661397,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:11.237337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74a6ea6-27b1-4ea7-8720-ecb3278df53a None None] The sync data for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 is: [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:08Z', 'revision_number': 3, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:20:11.333227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dd972bb-d431-40bf-964c-cba24f06b357 req-3a231f19-fa45-4f7c-9c29-fa7f10839568 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 210 time: 0.0405533 Dec 21 04:20:11.431756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.499785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.538070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:11.561943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:11.565493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:20:11.582896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Pushing event updated for resources: {'Port': ['ID=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:11.602142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.1 (9ffc4833-7ee0-4257-9960-94e8ca848a30/1eab21fa-1f41-4ce7-9ab3-bf42ee33a216/0ca46fc3-a122-4ef9-96e6-70b62ba70e39) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:20:11.661878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Attempting to bind port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:20:11.663832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Attempting to bind port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:20:11.665591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Attempting to bind port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 on network 9ffc4833-7ee0-4257-9960-94e8ca848a30 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:11.672442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:20:11.673103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Checking segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:20:11.673999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.675109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Bound using segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:20:11.675725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Bound port: c2f51307-9dc8-4fc4-b0ab-d09fdee4da47, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:20:11.676212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.759606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.769525 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] For port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:20:11.773852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] For port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:20:11.891879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.936629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:11.967193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 90da8399-4129-44f8-9044-2b2cca661397 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:20:11.969629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f5516a-67a8-46fc-ad88-996b36266e86 None None] Pushing event updated for resources: {'Port': ['ID=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:12.034586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:12.041639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:12.046088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:20:12.084492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 90da8399-4129-44f8-9044-2b2cca661397 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:12.084791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:12.138417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:12.151434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:12.437895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a25b748-755c-4805-a95b-cba7a22787ab req-ff58bc7d-a074-45b5-87b8-9a45c05510ea tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 210 time: 0.0369310 Dec 21 04:20:12.474753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.154242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98d23196-5845-4ebf-8021-4f654a1bd996 None None] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:20:13.159957 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.239602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0b679a38-c666-4def-864d-8f4177f5d3a9 None None] Provisioning complete for port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:13.239973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b679a38-c666-4def-864d-8f4177f5d3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.248643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.361105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:13.363756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.386110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b679a38-c666-4def-864d-8f4177f5d3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.423141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0b679a38-c666-4def-864d-8f4177f5d3a9 None None] For port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:13.491308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b679a38-c666-4def-864d-8f4177f5d3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.496048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:13.499034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:13.581357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b679a38-c666-4def-864d-8f4177f5d3a9 None None] Pushing event updated for resources: {'Port': ['ID=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:13.647969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d074269-dca0-411d-987f-1e85e217051d req-d07c453b-1c7d-40c3-8045-db6496741695 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 210 time: 0.0756817 Dec 21 04:20:13.675853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:20:13.717658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-564dc97c-4022-4ef5-9467-1c6f1019e0e5 None None] Provisioning complete for port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:13.718114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-564dc97c-4022-4ef5-9467-1c6f1019e0e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.760485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-564dc97c-4022-4ef5-9467-1c6f1019e0e5 None None] Port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:13.776631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-564dc97c-4022-4ef5-9467-1c6f1019e0e5 None None] Provisioning complete for port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:13.777016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-564dc97c-4022-4ef5-9467-1c6f1019e0e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:13.809280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:13.826842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e937db9-3185-473f-baae-4e8643e812cf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/fb88a6b5-57b9-4b3c-b920-c99a1adf8778/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3912077 Dec 21 04:20:13.827032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Sync routers for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:13.872117 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:13.872742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:14.036571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:20:14.071435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-41cb5689-0b86-46be-8053-9520be7a30bf None None] Provisioning complete for port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:14.071565 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41cb5689-0b86-46be-8053-9520be7a30bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.141073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-41cb5689-0b86-46be-8053-9520be7a30bf None None] Port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:14.174651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:14.175343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.183085 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:14.195414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-1fd918f8-15a0-40ba-bf9b-40154832fb0a tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:14.198061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-1fd918f8-15a0-40ba-bf9b-40154832fb0a tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "GET /v2.0/networks?id=1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 200 len: 814 time: 0.2541771 Dec 21 04:20:14.230118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Request body: {'port': {'device_id': '72d46935-5a46-421f-81e7-a613884b887a', 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae', 'admin_state_up': True, 'tenant_id': '57ab6cbdcda24806861df9ec12f18681'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:14.346198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-c121f436-9c26-433e-95af-7f56352b4fed tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-19412860&fields=id&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 267 time: 0.1276050 Dec 21 04:20:14.369957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4ddd8f30-f42a-460f-bd48-a8ab0c8e99fe None None] Provisioning complete for port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:14.370364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4ddd8f30-f42a-460f-bd48-a8ab0c8e99fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.425007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4ddd8f30-f42a-460f-bd48-a8ab0c8e99fe None None] Port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:14.480201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-2ea94901-4833-413b-85a7-2405d10d7abf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:14.482201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-2ea94901-4833-413b-85a7-2405d10d7abf tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/networks?id=9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 200 len: 797 time: 0.1334479 Dec 21 04:20:14.490792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 2, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:14.503861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-2c642f22-f53e-4984-8793-641db5dc4720 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/quotas/10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 375 time: 0.0105875 Dec 21 04:20:14.517137 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Checking router: fb88a6b5-57b9-4b3c-b920-c99a1adf8778 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:20:14.517495 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Updating router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:20:14.521926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Made reservation on behalf of 57ab6cbdcda24806861df9ec12f18681 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:20:14.525794 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.550604 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.565059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-50bf6dc9-b125-4635-bd85-0382ac973fa5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0547280 Dec 21 04:20:14.705533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Allocated IP 172.20.0.8 (1e06cb6d-1702-4983-bc62-4912cea57cae/5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3/d83a62e7-ec8e-4f4b-954f-dfd863e19097) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:20:14.711893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-92b7a064-cdff-48c8-8681-cc98e2380261 service neutron] 10.222.0.18 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323657 Dec 21 04:20:14.803970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83a48543-bf51-4389-b912-376c9befdd00 req-1c277305-f3eb-433a-8194-869c28560d96 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 210 time: 0.0657129 Dec 21 04:20:14.848040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-31c4d871-4f1b-4c7e-8e56-0b2882538cd1 service neutron] 10.222.0.18 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1352603 Dec 21 04:20:14.876764 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.882250 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:14.994244 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.022913 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.061936 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Pushing event updated for resources: {'Port': ['ID=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:15.108009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Network 1e06cb6d-1702-4983-bc62-4912cea57cae is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:15.119853 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.120111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:15.120233 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.120601 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.120998 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.121386 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.121769 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.122104 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.123073 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.123632 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.124131 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.124663 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.125172 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.125670 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:15.126641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:20:15.176877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d838fc88-f91b-497a-ae89-9143442ae6f1 req-29178a88-841f-4224-acfb-85bb52ad9c45 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 210 time: 0.0905883 Dec 21 04:20:15.193914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Pushing event updated for resources: {'Port': ['ID=d83a62e7-ec8e-4f4b-954f-dfd863e19097,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:15.231717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:15.232384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.237392 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Attempting to bind port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:20:15.237778 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Attempting to bind port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:20:15.238143 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Attempting to bind port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 on network 9ffc4833-7ee0-4257-9960-94e8ca848a30 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:15.248088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:20:15.248429 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Checking segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:20:15.248846 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.249235 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Bound using segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:20:15.249716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Bound port: 0ca46fc3-a122-4ef9-96e6-70b62ba70e39, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:20:15.251337 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.337348 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] For port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:20:15.344657 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] For port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:20:15.347488 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-68ce1d6c-29bb-441a-ac6e-43166812425e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1325059 Dec 21 04:20:15.367486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Request body: {'port': {'device_id': '72d46935-5a46-421f-81e7-a613884b887a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:15.433705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.454705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-68c075a0-0407-4145-8511-56d5be4dac2e None None] Provisioning complete for port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:15.456162 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-68c075a0-0407-4145-8511-56d5be4dac2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.530185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-68c075a0-0407-4145-8511-56d5be4dac2e None None] Port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:15.608641 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.672703 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7161e5ec-3e73-4f55-aa2b-426744b5eccf None None] Pushing event updated for resources: {'Port': ['ID=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:15.677299 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:15.677890 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:19:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:15.731054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d83a62e7-ec8e-4f4b-954f-dfd863e19097 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:20:15.741148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.757533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Transition to ACTIVE for port object d83a62e7-ec8e-4f4b-954f-dfd863e19097 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:20:15.837086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.920205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Pushing event updated for resources: {'Port': ['ID=d83a62e7-ec8e-4f4b-954f-dfd863e19097,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:15.940025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b803130e-8573-4c4f-866b-0330c3e6272a None None] Provisioning complete for port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:15.942115 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b803130e-8573-4c4f-866b-0330c3e6272a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:15.968592 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:16.032964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3498f572-2af5-4f98-8175-a72d216b9fb5 req-c73b6088-a22a-41f8-8fee-03606279c46f tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:16.034725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3498f572-2af5-4f98-8175-a72d216b9fb5 req-c73b6088-a22a-41f8-8fee-03606279c46f tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 943 time: 0.0841832 Dec 21 04:20:16.041148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Attempting to bind port d83a62e7-ec8e-4f4b-954f-dfd863e19097 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:20:16.041706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Attempting to bind port d83a62e7-ec8e-4f4b-954f-dfd863e19097 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:20:16.042038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Attempting to bind port d83a62e7-ec8e-4f4b-954f-dfd863e19097 on network 1e06cb6d-1702-4983-bc62-4912cea57cae {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:16.050815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Port d83a62e7-ec8e-4f4b-954f-dfd863e19097 on network 1e06cb6d-1702-4983-bc62-4912cea57cae not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:20:16.051750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Attempting to bind port d83a62e7-ec8e-4f4b-954f-dfd863e19097 on network 1e06cb6d-1702-4983-bc62-4912cea57cae {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:16.060316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:20:16.066465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Checking segment: {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:20:16.066465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Bound using segment: {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:20:16.066465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Bound port: d83a62e7-ec8e-4f4b-954f-dfd863e19097, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:20:16.066465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:16.079132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b803130e-8573-4c4f-866b-0330c3e6272a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:16.117912 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3498f572-2af5-4f98-8175-a72d216b9fb5 req-9c2e4530-1be1-4ff4-b617-8327313ae42c tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755119 Dec 21 04:20:16.119814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b803130e-8573-4c4f-866b-0330c3e6272a None None] For port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:16.160234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] For port d83a62e7-ec8e-4f4b-954f-dfd863e19097, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:20:16.164086 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] For port d83a62e7-ec8e-4f4b-954f-dfd863e19097, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:20:16.233470 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:15Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:16.260870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b803130e-8573-4c4f-866b-0330c3e6272a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:16.268040 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72305012-48dc-49c4-befa-316f57629bd8 None None] The sync data for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 is: [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:15Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:20:16.279399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3cf56b5-af29-461a-a6dc-4cb360908fd2 req-fca11f4b-5063-4411-9e53-1d19bce19300 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 210 time: 0.0493448 Dec 21 04:20:16.300025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:16.373466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b803130e-8573-4c4f-866b-0330c3e6272a None None] Pushing event updated for resources: {'Port': ['ID=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:16.386674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:16.387338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:16.389644 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] 10.222.0.54 "PUT /v2.0/ports/d83a62e7-ec8e-4f4b-954f-dfd863e19097 HTTP/1.1" status: 200 len: 1092 time: 1.0263183 Dec 21 04:20:16.392443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '72d46935-5a46-421f-81e7-a613884b887a', 'tag': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:16.396621 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e" -d '{"events": [{"name": "network-changed", "server_uuid": "72d46935-5a46-421f-81e7-a613884b887a", "tag": "d83a62e7-ec8e-4f4b-954f-dfd863e19097"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:16.430311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe7ffbd-280f-4f83-96b1-e6abfd5795b0 service neutron] Pushing event updated for resources: {'Port': ['ID=d83a62e7-ec8e-4f4b-954f-dfd863e19097,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:16.464079 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b0724df-2c23-4893-821d-eec9b17a17fb x-openstack-request-id: req-7b0724df-2c23-4893-821d-eec9b17a17fb {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:16.464079 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "72d46935-5a46-421f-81e7-a613884b887a", "tag": "d83a62e7-ec8e-4f4b-954f-dfd863e19097", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:16.464079 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7b0724df-2c23-4893-821d-eec9b17a17fb {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:16.464079 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '72d46935-5a46-421f-81e7-a613884b887a', 'tag': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097', 'status': 'completed', 'code': 200} Dec 21 04:20:16.561657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e req-ef9b5bd1-3804-46f0-ab4b-390a0acdc08f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:16.563626 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e req-ef9b5bd1-3804-46f0-ab4b-390a0acdc08f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 1095 time: 0.0678437 Dec 21 04:20:16.711834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e req-e949dcb2-a08b-4564-9ad4-d6da9374f97b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:16.714302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e req-e949dcb2-a08b-4564-9ad4-d6da9374f97b service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=57ab6cbdcda24806861df9ec12f18681&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1362112 Dec 21 04:20:16.842199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e req-c62b7c84-9674-472f-a404-04ebdd9d3765 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:16.843795 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e72e272c-ecc1-4d4d-8a82-6ec03b37223e req-c62b7c84-9674-472f-a404-04ebdd9d3765 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1208434 Dec 21 04:20:16.949847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-054bcca8-2186-470e-821a-f1ad482fd84e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:16.952235 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-054bcca8-2186-470e-821a-f1ad482fd84e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 1095 time: 0.0489340 Dec 21 04:20:17.007922 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-34f81be3-c1aa-405f-a8a7-52fe219fddef service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097 HTTP/1.1" status: 200 len: 217 time: 0.0415328 Dec 21 04:20:17.071336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7077fb3b-a81e-42de-ad04-71b2f01f77a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:17.072988 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-7077fb3b-a81e-42de-ad04-71b2f01f77a6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3 HTTP/1.1" status: 200 len: 854 time: 0.0579348 Dec 21 04:20:17.109934 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-5bab78bf-3966-4856-9156-65bd90cb9fc7 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e06cb6d-1702-4983-bc62-4912cea57cae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287220 Dec 21 04:20:17.221723 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-46b0c296-0bb3-49f8-90d8-abb3ff1e000e service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1050119 Dec 21 04:20:17.267877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4fe76f9-192a-4343-af67-1dc6515eb767 req-f92f56d3-b8f0-400a-ab8b-8ea5dd5b073e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:17.269468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4fe76f9-192a-4343-af67-1dc6515eb767 req-f92f56d3-b8f0-400a-ab8b-8ea5dd5b073e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 943 time: 0.0695536 Dec 21 04:20:17.322276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4fe76f9-192a-4343-af67-1dc6515eb767 req-4efe2be9-2cf1-4c78-bac9-56dfcd11a345 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453494 Dec 21 04:20:17.364961 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-646b121e-efc8-429e-96e7-c759110e9e48 req-e260a4b7-b9ed-47db-aa5f-f6d837edd6d8 service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315920 Dec 21 04:20:17.430521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef77090d-5c99-4b49-96b0-8afce600faed req-4a66c9d7-f6dd-4317-9924-3f9a3288971e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 210 time: 0.0370758 Dec 21 04:20:17.793272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-91bb1d01-54ca-44eb-a06a-8793d0181283 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:17.794724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-91bb1d01-54ca-44eb-a06a-8793d0181283 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/networks?id=9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 200 len: 797 time: 0.1059437 Dec 21 04:20:17.874254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-cd327bee-985d-4b56-8da8-9f049db5699a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10a032d25985452584a3dcdae6969809 HTTP/1.1" status: 200 len: 378 time: 0.0556321 Dec 21 04:20:17.889386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'port': {'device_id': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'admin_state_up': True, 'tenant_id': '10a032d25985452584a3dcdae6969809', 'security_groups': ['3e079a6d-07c4-474d-b43d-80e43478771d']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:17.932414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:20:17.995466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:17.995865 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.121997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Made reservation on behalf of 10a032d25985452584a3dcdae6969809 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:20:18.126296 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.255385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.20.0.4 (9ffc4833-7ee0-4257-9960-94e8ca848a30/1eab21fa-1f41-4ce7-9ab3-bf42ee33a216/24d03e3d-a8fb-413a-abdd-3f3692e34091) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:20:18.404169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.484978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654e083a-0889-4956-8fb6-8b37a2b8afcb req-7c2aa87c-c378-4ff0-808e-8bd4877b3b8d tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:18.486492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-654e083a-0889-4956-8fb6-8b37a2b8afcb req-7c2aa87c-c378-4ff0-808e-8bd4877b3b8d tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 943 time: 0.0635307 Dec 21 04:20:18.547349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6202a5a7-cf5b-4fbc-921a-0e70f393d584 req-9c39e29d-6296-4419-a304-e2c49de83ca7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 210 time: 0.0392022 Dec 21 04:20:18.550561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.595506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-654e083a-0889-4956-8fb6-8b37a2b8afcb req-d4c5780f-3a63-4b20-95f9-de13234f78ea tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011524 Dec 21 04:20:18.610392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:18.613470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:18.615956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:20:18.644928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:18.678698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:18.679557 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.780327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-1c15ad52-bb43-4634-b193-d68138365eb5 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8950427 Dec 21 04:20:18.801781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Request body: {'port': {'device_id': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:18.862620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.905583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-adbbb69e-fecb-4b95-8a61-9012d32b4b28 None None] Provisioning complete for port 24d03e3d-a8fb-413a-abdd-3f3692e34091 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:18.905845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-adbbb69e-fecb-4b95-8a61-9012d32b4b28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:18.943416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-adbbb69e-fecb-4b95-8a61-9012d32b4b28 None None] Port 24d03e3d-a8fb-413a-abdd-3f3692e34091 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:20:19.151047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 24d03e3d-a8fb-413a-abdd-3f3692e34091 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:20:19.159333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:19.171041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Transition to ACTIVE for port object 24d03e3d-a8fb-413a-abdd-3f3692e34091 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:20:19.262479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:19.315875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:19.387087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Attempting to bind port 24d03e3d-a8fb-413a-abdd-3f3692e34091 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:20:19.387441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Attempting to bind port 24d03e3d-a8fb-413a-abdd-3f3692e34091 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:20:19.387776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Attempting to bind port 24d03e3d-a8fb-413a-abdd-3f3692e34091 on network 9ffc4833-7ee0-4257-9960-94e8ca848a30 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:19.392932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Port 24d03e3d-a8fb-413a-abdd-3f3692e34091 on network 9ffc4833-7ee0-4257-9960-94e8ca848a30 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:20:19.393299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Attempting to bind port 24d03e3d-a8fb-413a-abdd-3f3692e34091 on network 9ffc4833-7ee0-4257-9960-94e8ca848a30 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:20:19.398621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 19, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:20:19.399296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Checking segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:20:19.399296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Bound using segment: {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:20:19.401891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Bound port: 24d03e3d-a8fb-413a-abdd-3f3692e34091, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1509fcd6-3b48-4708-bf68-e2c05f4010da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:20:19.402315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:19.484971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:20:19.490385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:20:19.588999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:19.654284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:19.655501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:19.656927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] 10.222.0.31 "PUT /v2.0/ports/24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 200 len: 1092 time: 0.8600380 Dec 21 04:20:19.659016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:19.661362 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e68bbbb9-6b4f-481d-98ee-e9a4de426704" -d '{"events": [{"name": "network-changed", "server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:19.747281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a181d872-8898-4032-b30b-4a4f8ad379b5 service neutron] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:19.767384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd40e61-3cfe-48a3-833c-b86e891c2996 req-81db1f2c-089e-48b0-a37e-3a6f009a94b4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:19.769328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fd40e61-3cfe-48a3-833c-b86e891c2996 req-81db1f2c-089e-48b0-a37e-3a6f009a94b4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 943 time: 0.1487639 Dec 21 04:20:19.792824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279f1b76-533c-4ddf-b592-66afcd3de7a5 req-215db772-2877-4318-976d-1ce763798732 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:19.794394 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279f1b76-533c-4ddf-b592-66afcd3de7a5 req-215db772-2877-4318-976d-1ce763798732 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 943 time: 0.1096880 Dec 21 04:20:19.893915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-86071d9c-8d9d-427a-96d4-20fdce15f816 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:19.897088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fd40e61-3cfe-48a3-833c-b86e891c2996 req-f7bbda6d-eee2-4512-a74b-a7015fba7dc8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1195259 Dec 21 04:20:19.934606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-279f1b76-533c-4ddf-b592-66afcd3de7a5 req-93c9fccc-3897-477c-81ab-f816ef9d35c0 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1084299 Dec 21 04:20:19.934606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-eaf7cd75-ce6a-47a9-ae91-03914bec6e83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:19.934606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-eaf7cd75-ce6a-47a9-ae91-03914bec6e83 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1095 time: 0.1089821 Dec 21 04:20:19.987464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-582ccd15-49f1-4ce5-b4d8-dafa8e36f4e9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 200 len: 217 time: 0.0373905 Dec 21 04:20:20.060723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-586e0927-8d06-4382-aaac-b564b835eec6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:20.062877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-586e0927-8d06-4382-aaac-b564b835eec6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 HTTP/1.1" status: 200 len: 834 time: 0.0469704 Dec 21 04:20:20.099269 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cfcafe96-c5f2-45cc-98cc-18740381c6c4 x-openstack-request-id: req-cfcafe96-c5f2-45cc-98cc-18740381c6c4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:20.099567 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:20.099824 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cfcafe96-c5f2-45cc-98cc-18740381c6c4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:20.100226 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'status': 'completed', 'code': 200} Dec 21 04:20:20.120246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856b3078-df09-4ce2-a66d-61af064eff65 req-57d0b3a2-305e-41db-bb64-f5b355bf1ed6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:20.121753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-57d0b3a2-305e-41db-bb64-f5b355bf1ed6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9ffc4833-7ee0-4257-9960-94e8ca848a30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0464776 Dec 21 04:20:20.211688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-b997e5f7-0dfa-4a68-bb8c-d3b38de6bcb9 service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823576 Dec 21 04:20:20.303267 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856b3078-df09-4ce2-a66d-61af064eff65 req-9e0808b3-bf0b-4753-907f-1e4893c9cae9 service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844269 Dec 21 04:20:20.527960 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-8ac80d8a-7c8d-49c8-9352-710a6db1d1df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:20.529473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-8ac80d8a-7c8d-49c8-9352-710a6db1d1df service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1095 time: 0.0422497 Dec 21 04:20:20.636202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-8b496a93-1e4a-484d-b19a-e84748c135c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:20.637668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-8b496a93-1e4a-484d-b19a-e84748c135c5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 200 len: 898 time: 0.0994401 Dec 21 04:20:20.683583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-cea3988c-f74e-432c-a569-68b7d158e2ad service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 200 len: 217 time: 0.0377836 Dec 21 04:20:20.738136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-7937ac62-6c65-4f22-964d-337fc74daf49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:20.739958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-7937ac62-6c65-4f22-964d-337fc74daf49 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 HTTP/1.1" status: 200 len: 834 time: 0.0472791 Dec 21 04:20:20.789744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-7684c8db-0139-4593-9f24-e1b5e6469e6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:20.791281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-7684c8db-0139-4593-9f24-e1b5e6469e6f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9ffc4833-7ee0-4257-9960-94e8ca848a30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0431931 Dec 21 04:20:20.885947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-81899e45-0e28-4620-8c13-892374a2a8be service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855742 Dec 21 04:20:20.990130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e68bbbb9-6b4f-481d-98ee-e9a4de426704 req-bd36daa3-7956-4b4f-9b41-49faf075940c service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951593 Dec 21 04:20:21.064582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9705e212-0ab9-44f4-ac26-aa8c60b8600a req-3dc8a5e9-390d-4d4b-a0ec-c64a6fcca9d8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:21.066082 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9705e212-0ab9-44f4-ac26-aa8c60b8600a req-3dc8a5e9-390d-4d4b-a0ec-c64a6fcca9d8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 943 time: 0.0751042 Dec 21 04:20:21.082642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b68c6fa6-32bd-4264-805c-b77c79453551 req-98f1566d-c93a-45fa-ad9a-72eec7450c07 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:21.083996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b68c6fa6-32bd-4264-805c-b77c79453551 req-98f1566d-c93a-45fa-ad9a-72eec7450c07 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 943 time: 0.0680981 Dec 21 04:20:21.156956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9705e212-0ab9-44f4-ac26-aa8c60b8600a req-e3bd217d-5f41-45a8-9896-94773e7f16fc tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0827820 Dec 21 04:20:21.160399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b68c6fa6-32bd-4264-805c-b77c79453551 req-4913eeaf-70f7-4673-bd9a-319b6e7fc6b5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699968 Dec 21 04:20:21.167888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d83a62e7-ec8e-4f4b-954f-dfd863e19097 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:20:21.270132 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d83a62e7-ec8e-4f4b-954f-dfd863e19097, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:21.281872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097', 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae', 'port_id': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097', 'mac_address': 'fa:16:3e:9e:db:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:20:21.318536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:21.335024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d83a62e7-ec8e-4f4b-954f-dfd863e19097 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:20:21.353984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d83a62e7-ec8e-4f4b-954f-dfd863e19097, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:21.456823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:21.506286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d83a62e7-ec8e-4f4b-954f-dfd863e19097,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:21.747712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d83a62e7-ec8e-4f4b-954f-dfd863e19097'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:20:22.302763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad98960-2884-49be-ba46-9f7e8c159f2e req-62d66dc9-7585-4a39-993a-94b6c549ea7b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:22.304336 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bad98960-2884-49be-ba46-9f7e8c159f2e req-62d66dc9-7585-4a39-993a-94b6c549ea7b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 943 time: 0.0786047 Dec 21 04:20:22.327639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c3ca1a-f59f-442b-8768-c4d34698a4c2 req-072abf54-fc4c-453c-a20d-6c462a528e3c tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:22.329092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52c3ca1a-f59f-442b-8768-c4d34698a4c2 req-072abf54-fc4c-453c-a20d-6c462a528e3c tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 944 time: 0.0729272 Dec 21 04:20:22.393286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bad98960-2884-49be-ba46-9f7e8c159f2e req-7d23e1ff-3b34-41c7-8a6c-858175efb4d1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0816956 Dec 21 04:20:22.400348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52c3ca1a-f59f-442b-8768-c4d34698a4c2 req-757028bc-59db-4675-91c3-298d69463227 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650532 Dec 21 04:20:22.657169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c3a5ef1e-a7c5-4fae-af11-ec35154a2456 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.024811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.165481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d83a62e7-ec8e-4f4b-954f-dfd863e19097 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:20:23.273764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port d83a62e7-ec8e-4f4b-954f-dfd863e19097 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:20:23.277588 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port d83a62e7-ec8e-4f4b-954f-dfd863e19097 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:23.277953 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.355655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.378896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72d46935-5a46-421f-81e7-a613884b887a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:23.381116 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6fe0c66-62f4-4250-bbfa-7661199ba52f" -d '{"events": [{"server_uuid": "72d46935-5a46-421f-81e7-a613884b887a", "name": "network-vif-plugged", "status": "completed", "tag": "d83a62e7-ec8e-4f4b-954f-dfd863e19097"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:23.392326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.394519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d83a62e7-ec8e-4f4b-954f-dfd863e19097, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:23.424954 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95b2486d-1255-4173-a291-10919ef105cb x-openstack-request-id: req-95b2486d-1255-4173-a291-10919ef105cb {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:23.424954 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72d46935-5a46-421f-81e7-a613884b887a", "name": "network-vif-plugged", "status": "completed", "tag": "d83a62e7-ec8e-4f4b-954f-dfd863e19097", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:23.424954 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-95b2486d-1255-4173-a291-10919ef105cb {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:23.424954 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72d46935-5a46-421f-81e7-a613884b887a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097', 'code': 200} Dec 21 04:20:23.474126 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.527380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d83a62e7-ec8e-4f4b-954f-dfd863e19097,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:23.553358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:20:23.583078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d22a72-4563-4e0c-98fd-1f98d33c8434 req-8d5724e9-2e40-4b91-9483-2d8160833c57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:23.585231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0d22a72-4563-4e0c-98fd-1f98d33c8434 req-8d5724e9-2e40-4b91-9483-2d8160833c57 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 1097 time: 0.0512879 Dec 21 04:20:23.641138 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0d22a72-4563-4e0c-98fd-1f98d33c8434 req-31af74c3-04a0-4066-a6e2-fd23c0cce115 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484345 Dec 21 04:20:23.686344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:23.701529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'port_id': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'mac_address': 'fa:16:3e:8e:dc:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:20:23.744439 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.758285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24d03e3d-a8fb-413a-abdd-3f3692e34091 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:20:23.778958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:23.907462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2ac390-d1f5-4050-91d9-4219077393b3 req-19b48784-7e5f-48ca-8f5a-cfe9649182a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:23.909008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff2ac390-d1f5-4050-91d9-4219077393b3 req-19b48784-7e5f-48ca-8f5a-cfe9649182a4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 943 time: 0.4399452 Dec 21 04:20:23.916781 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:23.927093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cad6eb2-4295-4093-9975-b03438f8b1df req-30d6c770-e7ee-4d5c-a27a-a5441b257a0a tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:23.927093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cad6eb2-4295-4093-9975-b03438f8b1df req-30d6c770-e7ee-4d5c-a27a-a5441b257a0a tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.4137492 Dec 21 04:20:23.967833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:23.995093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff2ac390-d1f5-4050-91d9-4219077393b3 req-b2d18e24-8fed-4fce-a16c-3957d970f9be tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0726874 Dec 21 04:20:23.999512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cad6eb2-4295-4093-9975-b03438f8b1df req-16d1738f-e1b6-49bb-95a5-bbffe840218e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710506 Dec 21 04:20:24.296611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['24d03e3d-a8fb-413a-abdd-3f3692e34091'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:20:25.051854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:25.085609 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:25.141140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88633cd-0745-4345-bfce-cbb5796cba94 req-9d493d3b-076f-442d-a4de-78c14312a290 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:25.142659 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b88633cd-0745-4345-bfce-cbb5796cba94 req-9d493d3b-076f-442d-a4de-78c14312a290 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 944 time: 0.0747082 Dec 21 04:20:25.172703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe8aa65-ae41-410a-af36-c21b60272f47 req-cd8bf9ce-412e-4bdf-9ea2-d8501f961f22 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:25.174561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfe8aa65-ae41-410a-af36-c21b60272f47 req-cd8bf9ce-412e-4bdf-9ea2-d8501f961f22 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0971327 Dec 21 04:20:25.225776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b88633cd-0745-4345-bfce-cbb5796cba94 req-706f7973-e72f-4a68-baa4-56bf81abc149 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0765054 Dec 21 04:20:25.255482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfe8aa65-ae41-410a-af36-c21b60272f47 req-e3820a2b-d3ea-4ca8-94ff-d2519ebfe251 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741162 Dec 21 04:20:25.565324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:20:25.732413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 24d03e3d-a8fb-413a-abdd-3f3692e34091 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:20:25.737356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 24d03e3d-a8fb-413a-abdd-3f3692e34091 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:25.738218 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:25.830614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:25.846325 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:25.857715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:25.860715 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5478fbbb-aaca-49ac-a608-d54774092995" -d '{"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-plugged", "status": "completed", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:25.874675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:25.903430 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50f45ae5-c8ea-471f-927b-c81d5d4e6cf5 x-openstack-request-id: req-50f45ae5-c8ea-471f-927b-c81d5d4e6cf5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:25.903430 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-plugged", "status": "completed", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:25.903430 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-50f45ae5-c8ea-471f-927b-c81d5d4e6cf5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:25.903430 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'code': 200} Dec 21 04:20:25.954888 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:26.020823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:26.095442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c54eab0-ee98-407f-9bbd-70a9da1262bb req-061b2076-19bd-4557-8518-b9d26a916b87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:26.097753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c54eab0-ee98-407f-9bbd-70a9da1262bb req-061b2076-19bd-4557-8518-b9d26a916b87 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1097 time: 0.0793464 Dec 21 04:20:26.150346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c54eab0-ee98-407f-9bbd-70a9da1262bb req-916add4c-ea67-4a23-b940-4780b78e1b99 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0403669 Dec 21 04:20:26.364258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39219506-94f4-4460-a7b9-61372e2511a4 req-32a44480-c764-4243-bfb2-06e73dcce31b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:26.365776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39219506-94f4-4460-a7b9-61372e2511a4 req-32a44480-c764-4243-bfb2-06e73dcce31b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0582275 Dec 21 04:20:26.419687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39219506-94f4-4460-a7b9-61372e2511a4 req-987b64c5-5f11-42e5-acac-b3095438872a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0474370 Dec 21 04:20:27.545880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555d8ab7-567a-48ec-b13f-02ff8e53687a req-b0664e99-e8af-4596-bb5e-8040e8034f7e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:27.547459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-555d8ab7-567a-48ec-b13f-02ff8e53687a req-b0664e99-e8af-4596-bb5e-8040e8034f7e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0534558 Dec 21 04:20:27.602270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-555d8ab7-567a-48ec-b13f-02ff8e53687a req-a434f184-2225-4049-aa45-c6b3b9c8e5da tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0467052 Dec 21 04:20:28.724503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9268cf9a-e35e-44fd-b334-68ebfe3add26 req-2f7619e7-4828-4dfe-b589-0d276d2372de tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:28.725979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9268cf9a-e35e-44fd-b334-68ebfe3add26 req-2f7619e7-4828-4dfe-b589-0d276d2372de tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0493300 Dec 21 04:20:28.780227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9268cf9a-e35e-44fd-b334-68ebfe3add26 req-f2afa7cf-3a56-4c4e-9d73-cdcf79934d4e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0483880 Dec 21 04:20:28.901577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af6af4b-c408-4754-b393-6f95a4b810f3 req-b0263238-47a8-49ee-b29f-3f633d3a8fd1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:28.903319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5af6af4b-c408-4754-b393-6f95a4b810f3 req-b0263238-47a8-49ee-b29f-3f633d3a8fd1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0499167 Dec 21 04:20:28.956127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5af6af4b-c408-4754-b393-6f95a4b810f3 req-9e486de3-383e-4ae5-be58-3c86a71800fb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0463011 Dec 21 04:20:28.978013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41162) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:29.026285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21db7bd5-8670-4276-9306-cec3adf97ecd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:29.030684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41164) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:29.030891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21db7bd5-8670-4276-9306-cec3adf97ecd tempest-TestNetworkAdvancedServerOps-1985436604 tempest-TestNetworkAdvancedServerOps-1985436604-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1092 time: 0.0516634 Dec 21 04:20:29.035939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address': '172.20.0.4'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:20:29.151535 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:29.260382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:29.372156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Allocated IP 172.25.5.153 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/3aea99a9-74b1-4e5b-8ecc-4264849fe813) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:20:29.490153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:29.602619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:29.686834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:20:29.686834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:20:29.708885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:20:29.759446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=3aea99a9-74b1-4e5b-8ecc-4264849fe813,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:30.126202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:30.257181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:30.415844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:30.493595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:30.567902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event updated for resources: {'Port': ['ID=3aea99a9-74b1-4e5b-8ecc-4264849fe813,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:30.579505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:30.682474 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP 4c856b9d-40ac-4052-bd05-c7a1a73436ed associated. External IP: 172.25.5.153, port: 24d03e3d-a8fb-413a-abdd-3f3692e34091. Dec 21 04:20:30.900801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:20:31.015202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:31.028859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] Sync routers for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:31.041830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:31.041830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:31.136195 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:31.160643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:31.163960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1d49224e-44ab-4524-aca1-f9e265637bc2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.1316476 Dec 21 04:20:31.164659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:31.179853 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2652fb4-d601-4a15-bec7-145f0630de55" -d '{"events": [{"name": "network-changed", "server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:31.234977 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a15e7fa5-9331-4c0f-ac4a-6afa91e04562 x-openstack-request-id: req-a15e7fa5-9331-4c0f-ac4a-6afa91e04562 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:31.235232 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:31.235494 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a15e7fa5-9331-4c0f-ac4a-6afa91e04562 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:31.235896 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'status': 'completed', 'code': 200} Dec 21 04:20:31.282899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d99a8153-f19c-4cdf-bc8e-fa0b0fa69eb0 req-481bb831-cc9e-49da-a9b7-fc16df00fdde tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:31.284654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d99a8153-f19c-4cdf-bc8e-fa0b0fa69eb0 req-481bb831-cc9e-49da-a9b7-fc16df00fdde tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0597906 Dec 21 04:20:31.361547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-0991d246-8433-4b16-82d6-07a07ddc89be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:31.363120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-0991d246-8433-4b16-82d6-07a07ddc89be service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1097 time: 0.0775273 Dec 21 04:20:31.367088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d99a8153-f19c-4cdf-bc8e-fa0b0fa69eb0 req-e57df3bf-1ef0-4dc6-9154-c0143b1c5218 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0728760 Dec 21 04:20:31.412559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41186) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:31.441784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '4c856b9d-40ac-4052-bd05-c7a1a73436ed', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.153', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'port_id': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 3716, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'mac_address': 'fa:16:3e:8e:dc:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:20:29Z', 'updated_at': '2021-12-21T04:20:29Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:31.513410 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c3e5b502-2062-4900-93ce-4520afc45210 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/4c856b9d-40ac-4052-bd05-c7a1a73436ed HTTP/1.1" status: 200 len: 991 time: 0.0978618 Dec 21 04:20:31.525475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-3ca6defe-381c-4ab3-b130-4048ee93ea4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:31.527135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-3ca6defe-381c-4ab3-b130-4048ee93ea4e service neutron] 10.222.0.31 "GET /v2.0/networks?id=9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 200 len: 898 time: 0.1561952 Dec 21 04:20:31.610769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-5401d356-a3e6-4822-9d73-e06ec1dd6ad1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 200 len: 999 time: 0.0755734 Dec 21 04:20:31.658752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] Checking router: fb88a6b5-57b9-4b3c-b920-c99a1adf8778 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:20:31.663489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-c7f4b955-17d7-4843-b58f-735e08a0b510 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:31.665035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-c7f4b955-17d7-4843-b58f-735e08a0b510 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 HTTP/1.1" status: 200 len: 834 time: 0.0486302 Dec 21 04:20:31.668373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:31.668974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:31.725146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-4babe7b3-0422-4123-90d9-b26ce2b0052a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:31.726798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-4babe7b3-0422-4123-90d9-b26ce2b0052a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9ffc4833-7ee0-4257-9960-94e8ca848a30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0534048 Dec 21 04:20:31.781514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:31.827318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-4fa0adbe-26c4-4349-bfd3-96236c59d845 service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929034 Dec 21 04:20:31.966595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2652fb4-d601-4a15-bec7-145f0630de55 req-996dc043-9677-4c3a-9a15-20a6d8ae9d0d service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1319890 Dec 21 04:20:32.053856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '4c856b9d-40ac-4052-bd05-c7a1a73436ed', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.153', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'port_id': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 3716, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'mac_address': 'fa:16:3e:8e:dc:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:20:29Z', 'updated_at': '2021-12-21T04:20:29Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:32.082282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5851ecc-367c-4016-a114-f90097552ad5 None None] The sync data for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 is: [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '4c856b9d-40ac-4052-bd05-c7a1a73436ed', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'floating_ip_address': '172.25.5.153', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'port_id': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 3716, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'mac_address': 'fa:16:3e:8e:dc:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:20:29Z', 'updated_at': '2021-12-21T04:20:29Z', 'revision_number': 0, 'project_id': '10a032d25985452584a3dcdae6969809', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:20:32.295399 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71489541-c422-445f-969d-fbf9654fb535 None None] New status for floating IP 4c856b9d-40ac-4052-bd05-c7a1a73436ed: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:20:32.515850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41200) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:32.600177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ec9676a1-b15e-4221-a634-5e11970ed456 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/4c856b9d-40ac-4052-bd05-c7a1a73436ed HTTP/1.1" status: 200 len: 991 time: 0.0831707 Dec 21 04:20:33.604231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:33.677186 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80d0c04a-ea48-443c-ac57-081359365aa8 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/4c856b9d-40ac-4052-bd05-c7a1a73436ed HTTP/1.1" status: 200 len: 993 time: 0.0670910 Dec 21 04:20:41.818787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e085dc8-0ecb-46d8-b85e-022088d25eff req-f5020747-3978-4661-acc6-a1dbf171fe16 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:41.821563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e085dc8-0ecb-46d8-b85e-022088d25eff req-f5020747-3978-4661-acc6-a1dbf171fe16 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0578055 Dec 21 04:20:41.897573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e085dc8-0ecb-46d8-b85e-022088d25eff req-10c16f5b-1612-42d6-84f8-7925a803e597 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655279 Dec 21 04:20:43.025042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da292e3b-4f8d-4753-a0d5-b16be7d51e3b req-448afb50-52df-4a5c-b6af-fc30d47ab927 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:43.026638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da292e3b-4f8d-4753-a0d5-b16be7d51e3b req-448afb50-52df-4a5c-b6af-fc30d47ab927 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0523138 Dec 21 04:20:43.082701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da292e3b-4f8d-4753-a0d5-b16be7d51e3b req-61c66c5a-a247-443b-a085-a8204acc5553 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498238 Dec 21 04:20:43.889596 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:20:44.208753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08966887-b0fc-43a6-9740-12e76d63cae2 req-2e37af5a-e063-4a5d-ada5-d56cc3db5305 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:44.210276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08966887-b0fc-43a6-9740-12e76d63cae2 req-2e37af5a-e063-4a5d-ada5-d56cc3db5305 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0508978 Dec 21 04:20:44.261077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08966887-b0fc-43a6-9740-12e76d63cae2 req-52d0430e-387c-414e-83d5-16e076d9b7b1 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448358 Dec 21 04:20:45.385628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d03b28-2276-42a8-be75-4ee04d93b0d2 req-312c04ff-690c-436b-8ae1-ff5782048650 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:45.387247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3d03b28-2276-42a8-be75-4ee04d93b0d2 req-312c04ff-690c-436b-8ae1-ff5782048650 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0520110 Dec 21 04:20:45.440401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3d03b28-2276-42a8-be75-4ee04d93b0d2 req-78afcb39-5d09-4845-b346-ea5e441e4c8a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467751 Dec 21 04:20:46.025223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a1968f-3e2b-4318-a3a4-0514bb42db57 req-5123454e-581a-42a2-aa51-f9046b3b7711 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:46.026825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6a1968f-3e2b-4318-a3a4-0514bb42db57 req-5123454e-581a-42a2-aa51-f9046b3b7711 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.0534475 Dec 21 04:20:46.076453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6a1968f-3e2b-4318-a3a4-0514bb42db57 req-0cef81c0-9755-4004-980f-fde685183dbe tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433867 Dec 21 04:20:46.570478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca05af6a-77f1-43d7-b140-ee3fe18c002c req-2e3a5af0-b774-44a9-b94f-aa89bc91389b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:46.572053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca05af6a-77f1-43d7-b140-ee3fe18c002c req-2e3a5af0-b774-44a9-b94f-aa89bc91389b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0503039 Dec 21 04:20:46.631960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca05af6a-77f1-43d7-b140-ee3fe18c002c req-e45870c0-de63-4df0-ac13-27ac91a75026 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448916 Dec 21 04:20:47.198617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256d4d2f-3dc5-4d22-9d20-e7a09f3e6682 req-ac52cccf-afcb-42de-9637-e4981fb6e97d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:47.200205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-256d4d2f-3dc5-4d22-9d20-e7a09f3e6682 req-ac52cccf-afcb-42de-9637-e4981fb6e97d tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.0524409 Dec 21 04:20:47.267537 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-256d4d2f-3dc5-4d22-9d20-e7a09f3e6682 req-21b3115a-fc90-44e3-8537-b25a9dc34198 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/security-groups?id=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0608976 Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:47.533138 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:20:47.545575 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e450612-1d22-41e7-9269-47a7db7527bf req-6ac57470-8175-445e-99df-015ddd4eb33f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:47.548869 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e450612-1d22-41e7-9269-47a7db7527bf req-6ac57470-8175-445e-99df-015ddd4eb33f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.54 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 946 time: 0.0654781 Dec 21 04:20:47.665128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Deleting port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:47.665512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:47.776818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d91bc5-aea9-4e8d-93b6-7a8bea9c0005 req-8e51c9fc-5a1a-4891-aa5a-9f59562019be tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:47.777358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] For port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:47.777358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:47.779339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7d91bc5-aea9-4e8d-93b6-7a8bea9c0005 req-8e51c9fc-5a1a-4891-aa5a-9f59562019be tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0723984 Dec 21 04:20:47.830862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c7d91bc5-aea9-4e8d-93b6-7a8bea9c0005 req-2ca45c39-f6d6-4d38-a272-75b12a366771 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442536 Dec 21 04:20:47.980088 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:47.980453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:47.980772 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Floating IP acd8b30d-3a70-4c8b-805f-c548d5306926 disassociated. External IP: 172.25.5.200, port: 8ad7f863-c0ba-45c6-be94-e1b99c5857b9. Dec 21 04:20:47.981118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Calling delete_port for 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:48.191815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:48.233309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event deleted for resources: {'Port': ['ID=8ad7f863-c0ba-45c6-be94-e1b99c5857b9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:48.252572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.252986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.253399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.253778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.254117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.254461 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.254853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.255263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.255598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.255927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.256252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.256584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.256941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:48.364634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3d94b83-403f-49e3-bbb9-d411bdc2a731 req-7122fa52-b6e4-444c-9211-1ec6505aaa20 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 210 time: 0.0290513 Dec 21 04:20:48.384431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Router d017679e-19f4-4f04-a0b9-8ae04d817d66 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:20:48.494132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:48.504505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7424df64-8e74-4783-a534-eec243f86809 None None] Sync routers for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:48.516832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:48.517442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:48.537621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] No DVR routers for this DVR port 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:20:48.547492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:48.547492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2e450612-1d22-41e7-9269-47a7db7527bf req-58d239c6-27fc-4c85-92cd-eb2c49071946 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.54 "DELETE /v2.0/ports/8ad7f863-c0ba-45c6-be94-e1b99c5857b9 HTTP/1.1" status: 204 len: 173 time: 0.9885139 Dec 21 04:20:48.547492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'name': 'network-vif-deleted', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:48.547492 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8afd630-2365-48e5-96ea-257c5130f978" -d '{"events": [{"server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "name": "network-vif-deleted", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:48.590883 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa73891d-20aa-421d-a67f-f99679351435 x-openstack-request-id: req-aa73891d-20aa-421d-a67f-f99679351435 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:48.590883 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8dc57d0f-7aa9-49a9-835f-64f1e156a2be", "name": "network-vif-deleted", "tag": "8ad7f863-c0ba-45c6-be94-e1b99c5857b9", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:48.590883 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-aa73891d-20aa-421d-a67f-f99679351435 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:48.590883 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8dc57d0f-7aa9-49a9-835f-64f1e156a2be', 'name': 'network-vif-deleted', 'tag': '8ad7f863-c0ba-45c6-be94-e1b99c5857b9', 'status': 'completed', 'code': 200} Dec 21 04:20:48.642798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:48.873870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:34Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:48.903101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7424df64-8e74-4783-a534-eec243f86809 None None] Checking router: d017679e-19f4-4f04-a0b9-8ae04d817d66 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:20:48.912557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:48.913175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:48.973743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-353f90a2-6db7-4aed-b8f7-39c50924daf2 req-842fce39-a2c2-4f2e-b7e1-a8e011eff0f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:48.975371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-353f90a2-6db7-4aed-b8f7-39c50924daf2 req-842fce39-a2c2-4f2e-b7e1-a8e011eff0f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0586770 Dec 21 04:20:49.026773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:49.029212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-353f90a2-6db7-4aed-b8f7-39c50924daf2 req-e55dd5cb-74a8-4dec-8d79-b125f3521166 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478096 Dec 21 04:20:49.231140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7424df64-8e74-4783-a534-eec243f86809 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:34Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:49.258046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7424df64-8e74-4783-a534-eec243f86809 None None] The sync data for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 is: [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4b6f18a4-af9d-424b-814d-903d0f928a5c', 'name': '', 'network_id': 'ad2df216-0eaf-414a-a835-c27348ac987a', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'mac_address': 'fa:16:3e:1e:a6:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_interface', 'standard_attr_id': 3458, 'fixed_ips': [{'subnet_id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:27Z', 'updated_at': '2021-12-21T04:15:34Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'subnets': [{'id': '0707099f-c76b-4feb-9475-4cacc79c073a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:20:49.499758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-499ac152-dcf2-422f-8059-2915e40fb7e7 req-f0dc7cfc-9e07-43e8-94f6-2f88463acd8a tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "GET /v2.0/ports?device_id=8dc57d0f-7aa9-49a9-835f-64f1e156a2be HTTP/1.1" status: 200 len: 210 time: 0.0273130 Dec 21 04:20:49.536005 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c041004-0308-4485-9913-8fe9c5d7d0c1 None None] New status for floating IP acd8b30d-3a70-4c8b-805f-c548d5306926: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:20:49.920258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03ed7b7d-1dcc-4c69-9ab0-dbdfd55a4207 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:50.156878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc2c159-2108-45fe-bee5-a350275606ef req-ba0246a6-9a67-4b28-b6ad-8c8404b0b342 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:50.158453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc2c159-2108-45fe-bee5-a350275606ef req-ba0246a6-9a67-4b28-b6ad-8c8404b0b342 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0542955 Dec 21 04:20:50.206461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edc2c159-2108-45fe-bee5-a350275606ef req-5f67ff00-9aa7-439d-83b7-64a6a1fc2ce5 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420041 Dec 21 04:20:50.563381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41376) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:50.694707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Deleting port 2469a803-134c-4131-bc20-0db946f56b73 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:50.695095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:50.776623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:50.776871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:50.789107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Calling delete_port for 2469a803-134c-4131-bc20-0db946f56b73 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:50.997579 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.047625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event deleted for resources: {'Port': ['ID=2469a803-134c-4131-bc20-0db946f56b73,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:51.089777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.092419 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.095389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8234c673-fb7d-49f1-b0f6-630a6e856d63 tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "DELETE /v2.0/floatingips/acd8b30d-3a70-4c8b-805f-c548d5306926 HTTP/1.1" status: 204 len: 168 time: 0.5309603 Dec 21 04:20:51.165733 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:51.228877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba8a0606-d921-44e8-8453-22876424b65f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.264077 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba8a0606-d921-44e8-8453-22876424b65f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.320087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:51.343228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e0916a-ea70-4220-8c6b-7fa0e93c7784 req-86ec23f0-b5e5-4407-ab8d-bc33cfd0a840 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:51.344859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06e0916a-ea70-4220-8c6b-7fa0e93c7784 req-86ec23f0-b5e5-4407-ab8d-bc33cfd0a840 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0544028 Dec 21 04:20:51.352653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:51.353007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8ad7f863-c0ba-45c6-be94-e1b99c5857b9 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:51.411872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06e0916a-ea70-4220-8c6b-7fa0e93c7784 req-56749c7f-7ca4-405c-9191-d893d61f858f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594242 Dec 21 04:20:51.446144 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba8a0606-d921-44e8-8453-22876424b65f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.448853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba8a0606-d921-44e8-8453-22876424b65f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:51.450042 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ba8a0606-d921-44e8-8453-22876424b65f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] 10.222.0.18 "DELETE /v2.0/security-groups/24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4 HTTP/1.1" status: 204 len: 168 time: 0.2827690 Dec 21 04:20:51.460279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba8a0606-d921-44e8-8453-22876424b65f tempest-TestServerBasicOps-1693534666 tempest-TestServerBasicOps-1693534666-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=24562ad6-bc3c-4df4-8ce9-f6a5085ffcc4,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:51.592895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41392) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:52.142394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:52.671178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43dae1e9-37d8-4a3c-b3b7-27f5e214b3ab req-498991ff-b95b-409e-bcdc-aa071d960e18 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:52.672816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43dae1e9-37d8-4a3c-b3b7-27f5e214b3ab req-498991ff-b95b-409e-bcdc-aa071d960e18 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.1161470 Dec 21 04:20:52.711893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3a1d0745-ca66-4de4-9571-ae58d91ad3b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:52.782642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43dae1e9-37d8-4a3c-b3b7-27f5e214b3ab req-efd0b62a-1d8f-44d6-8e35-796316e3b34a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0977466 Dec 21 04:20:52.905919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Deleting port 4b6f18a4-af9d-424b-814d-903d0f928a5c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:52.906378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:52.990708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] For port 4b6f18a4-af9d-424b-814d-903d0f928a5c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4b6f18a4-af9d-424b-814d-903d0f928a5c,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:52.991022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:53.007882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Calling delete_port for 4b6f18a4-af9d-424b-814d-903d0f928a5c owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:53.042942 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:53.255631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:53.284318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Pushing event deleted for resources: {'Port': ['ID=4b6f18a4-af9d-424b-814d-903d0f928a5c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:53.333124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:53.488143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:53.717781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:20:53.765331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Router d017679e-19f4-4f04-a0b9-8ae04d817d66 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:20:53.845389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:53.857794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'mac_address': 'fa:16:3e:7b:4c:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:20:53.914549 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:53.935131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:20:53.967005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:53.975418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a92f921d-8c18-4cb4-8098-7d43708a9595 admin admin] 10.222.0.18 "PUT /v2.0/routers/d017679e-19f4-4f04-a0b9-8ae04d817d66/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3784900 Dec 21 04:20:53.975418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41408) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:53.976623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:53.980418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] Sync routers for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:53.991748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:53.992114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b6b621-a5fd-498e-8cb9-a104d00ec914 req-a02ab007-2ecf-4e54-beed-4c3120b3d838 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:53.992348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:53.993583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2b6b621-a5fd-498e-8cb9-a104d00ec914 req-a02ab007-2ecf-4e54-beed-4c3120b3d838 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0958109 Dec 21 04:20:54.080247 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.114855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2b6b621-a5fd-498e-8cb9-a104d00ec914 req-2aa61492-93af-45fb-9a49-14a08a5b020e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0910115 Dec 21 04:20:54.126641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.133861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:54.214686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:54.244052 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.314225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['d0bb881d-37f6-4b67-a89c-a6c72e23dd9a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:20:54.382686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Deleting port cb742b11-dfff-4b49-bcd7-24d8c54eff5e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:54.383353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.389264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140'}], 'enable_snat': True}, 'gw_port_id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:20:53Z', 'revision_number': 5, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port': {'id': 'cb742b11-dfff-4b49-bcd7-24d8c54eff5e', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e8:d9:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3457, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:23Z', 'updated_at': '2021-12-21T04:15:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:54.422820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] Checking router: d017679e-19f4-4f04-a0b9-8ae04d817d66 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:20:54.449513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] Routers {'d017679e-19f4-4f04-a0b9-8ae04d817d66'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:54.450404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['d017679e-19f4-4f04-a0b9-8ae04d817d66'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:54.478318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] For port cb742b11-dfff-4b49-bcd7-24d8c54eff5e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:54.478682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.491293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Calling delete_port for cb742b11-dfff-4b49-bcd7-24d8c54eff5e owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:54.559661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] Set router d017679e-19f4-4f04-a0b9-8ae04d817d66 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:54.621456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:20:54Z', 'revision_number': 6, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:54.655968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0038c2d6-740d-45ba-bcf4-25438759d2e6 None None] The sync data for ids ['d017679e-19f4-4f04-a0b9-8ae04d817d66'] in n-d-822053-11 is: [{'id': 'd017679e-19f4-4f04-a0b9-8ae04d817d66', 'name': 'tempest-TestServerBasicOps-2080305174-router', 'tenant_id': '73bd75f8ded64d5f8a07e09906286ea6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:21Z', 'updated_at': '2021-12-21T04:20:54Z', 'revision_number': 6, 'project_id': '73bd75f8ded64d5f8a07e09906286ea6', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:20:54.803293 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.830079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Pushing event deleted for resources: {'Port': ['ID=cb742b11-dfff-4b49-bcd7-24d8c54eff5e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:54.847074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b388963-8390-483b-b4df-8ee835709e31 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:54.896901 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.995370 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:54.997927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.044928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.131562 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.160708 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.161437 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d017679e-19f4-4f04-a0b9-8ae04d817d66 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:20:55.171718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.171718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-344f05e4-dc07-4c77-b90c-7058c90779e2 admin admin] 10.222.0.18 "DELETE /v2.0/routers/d017679e-19f4-4f04-a0b9-8ae04d817d66 HTTP/1.1" status: 204 len: 168 time: 1.1920898 Dec 21 04:20:55.171968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41432) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:55.265533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Deleting subnet 0707099f-c76b-4feb-9475-4cacc79c073a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:20:55.269809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.299692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16154782-74c5-4e92-a572-e49b682cbb88 req-ba04fdfe-faf5-4a0a-b81f-43c8ba3976cf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:55.311836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16154782-74c5-4e92-a572-e49b682cbb88 req-ba04fdfe-faf5-4a0a-b81f-43c8ba3976cf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0735276 Dec 21 04:20:55.324872 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.397564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16154782-74c5-4e92-a572-e49b682cbb88 req-6b8f4294-e7d1-4539-8b41-15b5f170f5bf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0844169 Dec 21 04:20:55.476100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.657931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.692900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0707099f-c76b-4feb-9475-4cacc79c073a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:55.698727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.703920 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-12b0eac5-d244-4edd-b0a5-5dd678edb11b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/0707099f-c76b-4feb-9475-4cacc79c073a HTTP/1.1" status: 204 len: 168 time: 0.5319679 Dec 21 04:20:55.706540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41450) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:55.733453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:20:55.736026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-619a2e23-08cb-456d-9216-d62e23f8955a None None] Network ad2df216-0eaf-414a-a835-c27348ac987a requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:20:55.825803 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.882042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:55.922751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Deleting port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:55.922751 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.031249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] For port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,segment=NetworkSegment(9ff9852b-cf38-4d4a-9c76-459b0e9cdd09),segment_id=9ff9852b-cf38-4d4a-9c76-459b0e9cdd09)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:56.031704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.047248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Calling delete_port for d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:56.208637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4b6f18a4-af9d-424b-814d-903d0f928a5c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:56.243250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4b6f18a4-af9d-424b-814d-903d0f928a5c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:56.245293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4b6f18a4-af9d-424b-814d-903d0f928a5c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:56.245904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cb742b11-dfff-4b49-bcd7-24d8c54eff5e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:56.248875 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.288179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:20:56.289595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.291980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: cb742b11-dfff-4b49-bcd7-24d8c54eff5e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:56.292689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cb742b11-dfff-4b49-bcd7-24d8c54eff5e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:56.294225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Pushing event deleted for resources: {'Port': ['ID=d20a7eb2-35f6-4fc1-b5e9-de262dda4c39,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:56.305014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] No DVR routers for this DVR port d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:20:56.401434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d7217af-a38f-4148-a16e-4cf279ea2e28 None None] DHCP port deletion for ad2df216-0eaf-414a-a835-c27348ac987a request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:20:56.435015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.480817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ad2df216-0eaf-414a-a835-c27348ac987a']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:56.501349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:56.501654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ff9852b-cf38-4d4a-9c76-459b0e9cdd09') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:56.522110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.537806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.562157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:20:56.578049 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c5c5610-a214-49e9-aee0-dff4998b2e40" -d '{"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:20:56.581409 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.592803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Releasing vlan 103 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:20:56.594527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:20:56.595931 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:20:56.637474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:56.656883 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:20:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da277486-d33f-49c5-8ec1-91e493909902 x-openstack-request-id: req-da277486-d33f-49c5-8ec1-91e493909902 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:20:56.657083 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:20:56.657348 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-da277486-d33f-49c5-8ec1-91e493909902 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:20:56.657763 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'code': 200} Dec 21 04:20:56.682178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d4d684-6d86-4619-a90f-6074a33f507b req-19a02cd3-9f5b-413d-8cf7-0e6ebcc84315 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:56.691934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d4d684-6d86-4619-a90f-6074a33f507b req-19a02cd3-9f5b-413d-8cf7-0e6ebcc84315 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.1703978 Dec 21 04:20:56.706411 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.750451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7d4d684-6d86-4619-a90f-6074a33f507b req-eff17860-0702-4df0-b4f3-e82a950d0865 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581474 Dec 21 04:20:56.764135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.782067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:56.785033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] 10.222.0.18 "DELETE /v2.0/networks/ad2df216-0eaf-414a-a835-c27348ac987a HTTP/1.1" status: 204 len: 168 time: 1.0764210 Dec 21 04:20:56.786078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27d730b4-0536-46ca-9597-a28c98b67fee admin admin] Pushing event deleted for resources: {'Network': ['ID=ad2df216-0eaf-414a-a835-c27348ac987a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:56.792336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41466) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:56.824095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:57.703522 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:58.013396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:20:58.044805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:20:58.045322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d20a7eb2-35f6-4fc1-b5e9-de262dda4c39 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:20:58.047518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125cad23-4d1d-48af-ac2c-8986f6fe1a9e req-c1cffa5b-f124-4e0a-a47e-c877afd111f8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:58.049052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-125cad23-4d1d-48af-ac2c-8986f6fe1a9e req-c1cffa5b-f124-4e0a-a47e-c877afd111f8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.1780286 Dec 21 04:20:58.124204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-125cad23-4d1d-48af-ac2c-8986f6fe1a9e req-f083e332-668a-498c-8feb-ca81241151b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0674138 Dec 21 04:20:58.205121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Deleting port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:20:58.205773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:58.304682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] For port 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:20:58.305198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:58.320694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Calling delete_port for 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:20:58.618260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:58.679095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Pushing event deleted for resources: {'Port': ['ID=62412b52-cabc-4eed-b7fb-bc84d6e3d1b9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.861485 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:20:58.927369 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:59.356302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:20:59.369394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589e6226-9516-46e6-bb10-ac94f43c9749 req-8544a4da-d3e0-452d-a0fe-1572cad2b17f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:20:59.370890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-589e6226-9516-46e6-bb10-ac94f43c9749 req-8544a4da-d3e0-452d-a0fe-1572cad2b17f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.1054051 Dec 21 04:20:59.493778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-589e6226-9516-46e6-bb10-ac94f43c9749 req-a86ddb21-d50e-4847-a65f-6ce420bdf076 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1158633 Dec 21 04:20:59.564059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:20:59.576085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07c4fb69-67f4-4eb7-bf39-820efce6aa38 admin admin] 10.222.0.18 "PUT /v2.0/routers/90d26cd2-e44c-4c6e-b116-0759f2c10a50/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7804224 Dec 21 04:20:59.576481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41488) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:20:59.582122 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] Sync routers for ids ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:20:59.610359 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] Routers {'90d26cd2-e44c-4c6e-b116-0759f2c10a50'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:20:59.611614 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:20:59.740997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:20:59.791292 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] Set router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:20:59.886796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:00.027220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Deleting port fd126033-e19b-4427-95bc-8ad2db7cc3be {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:21:00.027829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:00.140105 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122'}], 'enable_snat': True}, 'gw_port_id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:20:58Z', 'revision_number': 5, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port': {'id': 'fd126033-e19b-4427-95bc-8ad2db7cc3be', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:72:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3479, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:15:35Z', 'updated_at': '2021-12-21T04:15:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:21:00.161205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] For port fd126033-e19b-4427-95bc-8ad2db7cc3be, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fd126033-e19b-4427-95bc-8ad2db7cc3be,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:00.161575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:00.179764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Calling delete_port for fd126033-e19b-4427-95bc-8ad2db7cc3be owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:21:00.180699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] Checking router: 90d26cd2-e44c-4c6e-b116-0759f2c10a50 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:21:00.198676 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] Routers {'90d26cd2-e44c-4c6e-b116-0759f2c10a50'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:21:00.199608 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:21:00.321606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] Set router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:21:00.385012 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:20:59Z', 'revision_number': 6, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:21:00.414275 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9896fd-1b48-4867-b914-f90f6f7f216e None None] The sync data for ids ['90d26cd2-e44c-4c6e-b116-0759f2c10a50'] in n-d-822053-11 is: [{'id': '90d26cd2-e44c-4c6e-b116-0759f2c10a50', 'name': 'tempest-TestServerBasicOps-787447733-router', 'tenant_id': '1e9102a96fd8406f94e19e93db5d22db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:15:34Z', 'updated_at': '2021-12-21T04:20:59Z', 'revision_number': 6, 'project_id': '1e9102a96fd8406f94e19e93db5d22db', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:21:00.630775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:00.650348 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6145613-a6dd-4fbe-82f4-be48e4e851be req-1a24708f-3466-4516-850b-b7072ef44c6e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:00.652342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6145613-a6dd-4fbe-82f4-be48e4e851be req-1a24708f-3466-4516-850b-b7072ef44c6e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0724239 Dec 21 04:21:00.663206 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Pushing event deleted for resources: {'Port': ['ID=fd126033-e19b-4427-95bc-8ad2db7cc3be,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:00.685776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d979e7a6-520e-4c74-9992-9140e58bf7c2 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:21:00.746696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6145613-a6dd-4fbe-82f4-be48e4e851be req-a05001d9-e723-4470-97a4-8d85066a9931 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0883205 Dec 21 04:21:00.771604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:00.870431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-5c58faed-b05c-4fca-85d9-c6ef6f5cf835 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:00.872077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-5c58faed-b05c-4fca-85d9-c6ef6f5cf835 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1097 time: 0.0644021 Dec 21 04:21:00.902744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:00.905141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.010724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-a301a48d-bb4e-4099-a08d-84eed938968c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:01.012684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-a301a48d-bb4e-4099-a08d-84eed938968c service neutron] 10.222.0.31 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1137879 Dec 21 04:21:01.015483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.016411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 90d26cd2-e44c-4c6e-b116-0759f2c10a50 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:21:01.031113 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.033427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-042f0372-e879-4357-9e9d-2ebd3c32faf3 admin admin] 10.222.0.18 "DELETE /v2.0/routers/90d26cd2-e44c-4c6e-b116-0759f2c10a50 HTTP/1.1" status: 204 len: 168 time: 1.4556777 Dec 21 04:21:01.035755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41504) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:01.107047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Deleting subnet 0f848bba-0197-4f09-bfb3-33ead8383c9a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:21:01.115978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.123367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-cfb385d7-584d-40c3-8c24-d3938dd09182 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1001 time: 0.0904841 Dec 21 04:21:01.181232 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.242720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-c40bceff-ead4-4a5d-bca2-0eb16198a0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:01.244284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-c40bceff-ead4-4a5d-bca2-0eb16198a0d3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.1116076 Dec 21 04:21:01.314470 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.326158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-3ee85cb4-6e55-4613-b010-902adcba853d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:01.327762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-3ee85cb4-6e55-4613-b010-902adcba853d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0747871 Dec 21 04:21:01.444777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.499809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-ba0ad57e-cf47-453c-a943-57ad03589198 service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1631229 Dec 21 04:21:01.513768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0f848bba-0197-4f09-bfb3-33ead8383c9a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:01.530815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a05deda-b6b3-4732-82fc-762f75c83335 None None] Network a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:21:01.532378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.537259 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c6d2e1ad-c05f-41fc-9653-ad6d6da990bf admin admin] 10.222.0.18 "DELETE /v2.0/subnets/0f848bba-0197-4f09-bfb3-33ead8383c9a HTTP/1.1" status: 204 len: 168 time: 0.5003850 Dec 21 04:21:01.539759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:01.627909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34a765d4-acff-4bc0-a295-2960c13cbff8 req-ca1fbc0a-36cf-4bc2-a7aa-4b0638b7bedb service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1199756 Dec 21 04:21:01.676558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.808190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Deleting port be4e87be-3a9f-4375-9bd5-4bf953061287 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:21:01.809042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.824752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] DHCP port deletion for a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:21:01.941146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] For port be4e87be-3a9f-4375-9bd5-4bf953061287, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be4e87be-3a9f-4375-9bd5-4bf953061287,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:01.941960 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.949697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Deleting port be4e87be-3a9f-4375-9bd5-4bf953061287 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:21:01.950814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:01.958232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Calling delete_port for be4e87be-3a9f-4375-9bd5-4bf953061287 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:21:01.995717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11da743c-1eac-4408-8fa3-b88df3be1058 req-95470ee8-f60b-4176-a71f-25e9980c14d6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:01.997790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11da743c-1eac-4408-8fa3-b88df3be1058 req-95470ee8-f60b-4176-a71f-25e9980c14d6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0987775 Dec 21 04:21:02.083689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] For port be4e87be-3a9f-4375-9bd5-4bf953061287, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=be4e87be-3a9f-4375-9bd5-4bf953061287,segment=NetworkSegment(f226a94f-5d12-480c-8ea4-3c6852adfa58),segment_id=f226a94f-5d12-480c-8ea4-3c6852adfa58)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:02.085791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11da743c-1eac-4408-8fa3-b88df3be1058 req-806d7935-fe04-4e73-a0f5-4720e1070fe5 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0746064 Dec 21 04:21:02.086904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.125141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Calling delete_port for be4e87be-3a9f-4375-9bd5-4bf953061287 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:21:02.224737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fd126033-e19b-4427-95bc-8ad2db7cc3be no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:21:02.239028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.286771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=be4e87be-3a9f-4375-9bd5-4bf953061287,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:02.296047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] No DVR routers for this DVR port be4e87be-3a9f-4375-9bd5-4bf953061287 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:21:02.320232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: fd126033-e19b-4427-95bc-8ad2db7cc3be {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:21:02.321157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fd126033-e19b-4427-95bc-8ad2db7cc3be not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:21:02.324612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be4e87be-3a9f-4375-9bd5-4bf953061287 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:21:02.375160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: be4e87be-3a9f-4375-9bd5-4bf953061287 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:21:02.375959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device be4e87be-3a9f-4375-9bd5-4bf953061287 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:21:02.376656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:21:02.417640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:21:02.419120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 62412b52-cabc-4eed-b7fb-bc84d6e3d1b9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:21:02.436097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.462520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] No DVR routers for this DVR port be4e87be-3a9f-4375-9bd5-4bf953061287 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:21:02.532006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Pushing event deleted for resources: {'Port': ['ID=be4e87be-3a9f-4375-9bd5-4bf953061287,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:02.555712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.556078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.556636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.557148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.557653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.558157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.558712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.559294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.559802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.560360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.560863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.561354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.561867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-202f123c-9911-4352-9635-3a0caf4635f2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:02.809851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.840761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a3ae4a80-05f9-4f97-b130-3ef4d58b5a25']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:21:02.852745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f226a94f-5d12-480c-8ea4-3c6852adfa58') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:21:02.853303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f226a94f-5d12-480c-8ea4-3c6852adfa58') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:21:02.864606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.883574 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.890509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:21:02.891129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:21:02.893981 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:21:03.026784 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:03.042467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:03.051718 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] 10.222.0.18 "DELETE /v2.0/networks/a3ae4a80-05f9-4f97-b130-3ef4d58b5a25 HTTP/1.1" status: 204 len: 168 time: 1.5082152 Dec 21 04:21:03.102138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99cbccf-5b11-4733-a1c8-a408f48d45c3 admin admin] Pushing event deleted for resources: {'Network': ['ID=a3ae4a80-05f9-4f97-b130-3ef4d58b5a25,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:03.371277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8304a46f-9691-42ff-adc5-252413323193 req-2019667c-e41a-44b5-b62a-e2a4813a673d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:03.374365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8304a46f-9691-42ff-adc5-252413323193 req-2019667c-e41a-44b5-b62a-e2a4813a673d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.1036403 Dec 21 04:21:03.497810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8304a46f-9691-42ff-adc5-252413323193 req-0caea544-77bc-4b89-ad43-0185aecbaf41 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1089196 Dec 21 04:21:03.512423 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:03.692714 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ce75df1-9046-46b3-9be3-4dbe7598eeaf admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=73bd75f8ded64d5f8a07e09906286ea6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1791506 Dec 21 04:21:03.695325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41534) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:03.794752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd671ea-81cf-48ec-9378-54e5760e2842 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:03.843975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd671ea-81cf-48ec-9378-54e5760e2842 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:04.020590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd671ea-81cf-48ec-9378-54e5760e2842 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:04.031115 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd671ea-81cf-48ec-9378-54e5760e2842 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:04.031115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3cd671ea-81cf-48ec-9378-54e5760e2842 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a395c2c2-e772-4042-8925-10665fcc28da HTTP/1.1" status: 204 len: 168 time: 0.3281131 Dec 21 04:21:04.045245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd671ea-81cf-48ec-9378-54e5760e2842 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a395c2c2-e772-4042-8925-10665fcc28da,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:04.673649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3cf1c7a-aada-4509-903d-9c772f6d9e19 req-d7d1a529-94e2-4b63-a947-766bf6bca3ed tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:04.684074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3cf1c7a-aada-4509-903d-9c772f6d9e19 req-d7d1a529-94e2-4b63-a947-766bf6bca3ed tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0720336 Dec 21 04:21:04.753579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3cf1c7a-aada-4509-903d-9c772f6d9e19 req-fc6bf0f7-1b82-4928-9a5e-bd625d54a974 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0683811 Dec 21 04:21:05.096355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41550) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:05.144383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7c528aea-a649-48e9-9a82-66644280f68e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1e9102a96fd8406f94e19e93db5d22db&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0445683 Dec 21 04:21:05.145126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41552) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:05.225908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb6fb81a-7b9c-42da-86c2-929083176d94 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:05.272588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb6fb81a-7b9c-42da-86c2-929083176d94 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:05.408948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb6fb81a-7b9c-42da-86c2-929083176d94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:05.410885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb6fb81a-7b9c-42da-86c2-929083176d94 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:05.412406 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb6fb81a-7b9c-42da-86c2-929083176d94 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/623cc5ed-8bf8-4dfd-bcb2-da0a3dde50ec HTTP/1.1" status: 204 len: 168 time: 0.2648134 Dec 21 04:21:05.427433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6fb81a-7b9c-42da-86c2-929083176d94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=623cc5ed-8bf8-4dfd-bcb2-da0a3dde50ec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:06.128350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881cc710-5ad7-46c4-82fd-3e2269adad4a req-e19272f7-04fa-4776-973e-c65567877602 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:06.138853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-881cc710-5ad7-46c4-82fd-3e2269adad4a req-e19272f7-04fa-4776-973e-c65567877602 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.2377641 Dec 21 04:21:06.219400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-881cc710-5ad7-46c4-82fd-3e2269adad4a req-4e05d358-c70f-4d38-a474-d3bb9299d17b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0799775 Dec 21 04:21:07.405862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de870dd1-e39d-472f-99af-858fd757a8bf req-cbb815cb-fba7-4f8f-b98e-feff6b13369b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:07.407855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de870dd1-e39d-472f-99af-858fd757a8bf req-cbb815cb-fba7-4f8f-b98e-feff6b13369b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0836577 Dec 21 04:21:07.475250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de870dd1-e39d-472f-99af-858fd757a8bf req-7bd6da7d-cd0d-4aba-8052-656c4be8e98c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569353 Dec 21 04:21:08.481668 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-e6b66ef5-51c3-4dca-b829-9af20d60594a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0471573 Dec 21 04:21:08.618976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef75c146-c188-4034-bae6-67aa416ed02d req-3b9c51ba-b330-4906-a911-63cbaa97a6b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:08.621839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-3b9c51ba-b330-4906-a911-63cbaa97a6b8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 1097 time: 0.0598652 Dec 21 04:21:08.717670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd2269c-3eb9-4610-ada9-5b965d21a11e req-03757eed-2b70-4983-b04a-f064d3852aaf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:08.725200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cd2269c-3eb9-4610-ada9-5b965d21a11e req-03757eed-2b70-4983-b04a-f064d3852aaf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0757632 Dec 21 04:21:08.784179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef75c146-c188-4034-bae6-67aa416ed02d req-10bcc5a9-9405-47ed-9da4-64d601aad91c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:08.787445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-10bcc5a9-9405-47ed-9da4-64d601aad91c service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 200 len: 915 time: 0.1376932 Dec 21 04:21:08.840817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cd2269c-3eb9-4610-ada9-5b965d21a11e req-d8576a02-a998-4ccb-9d86-c5e585a75ef7 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1124020 Dec 21 04:21:08.855553 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-f3dd6bfd-1f60-4db1-8871-859e1e007536 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097 HTTP/1.1" status: 200 len: 217 time: 0.0546434 Dec 21 04:21:08.920357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef75c146-c188-4034-bae6-67aa416ed02d req-0de757e6-53c7-4dea-bebe-0710b3f09426 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:08.922458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-0de757e6-53c7-4dea-bebe-0710b3f09426 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3 HTTP/1.1" status: 200 len: 854 time: 0.0554254 Dec 21 04:21:08.979061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-00b25188-a516-48fe-81ed-885b83ab060b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e06cb6d-1702-4983-bc62-4912cea57cae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0481107 Dec 21 04:21:09.106882 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-90994d3d-91bf-484c-bf6b-3151a9d2dcba service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1161737 Dec 21 04:21:09.225897 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef75c146-c188-4034-bae6-67aa416ed02d req-825ad390-4346-43ac-90a8-2aa62bf28cdd service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1070476 Dec 21 04:21:09.620122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cec899d-c9be-4f35-9026-9cc4ac473638 req-cfdea3a4-3af3-493a-961f-06f434f429d6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:09.630528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cec899d-c9be-4f35-9026-9cc4ac473638 req-cfdea3a4-3af3-493a-961f-06f434f429d6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.1118925 Dec 21 04:21:09.722372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cec899d-c9be-4f35-9026-9cc4ac473638 req-48778911-c66b-4625-bb5f-cd3683ea3f37 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0856919 Dec 21 04:21:10.028989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea891b5-cbe6-48fc-b8b1-42937d9608f3 req-8356dea0-e261-4e2f-8e1e-c0857cc275d3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:10.030640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ea891b5-cbe6-48fc-b8b1-42937d9608f3 req-8356dea0-e261-4e2f-8e1e-c0857cc275d3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0957155 Dec 21 04:21:10.089918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ea891b5-cbe6-48fc-b8b1-42937d9608f3 req-62edcd36-58c4-4049-a094-046cd5bedce3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530462 Dec 21 04:21:10.897141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41622) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:10.940873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa3edb0-8309-464f-89bb-913c78d3a6fc req-c36eccec-6203-436b-ba68-706be507001b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:10.943594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fa3edb0-8309-464f-89bb-913c78d3a6fc req-c36eccec-6203-436b-ba68-706be507001b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0816653 Dec 21 04:21:11.004812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fa3edb0-8309-464f-89bb-913c78d3a6fc req-ccc5515f-cb6a-4bd5-a4d4-ece741333450 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0543964 Dec 21 04:21:11.036070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86c66990-a5f7-49a9-a814-9da775597345 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.124456 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86c66990-a5f7-49a9-a814-9da775597345 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.208074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7471158c-d682-488a-a0ea-45a2bd3a8190 req-8e530940-bb80-471a-a1ca-823ea4644e86 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:11.209648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7471158c-d682-488a-a0ea-45a2bd3a8190 req-8e530940-bb80-471a-a1ca-823ea4644e86 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0501423 Dec 21 04:21:11.262512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7471158c-d682-488a-a0ea-45a2bd3a8190 req-25d7db51-2289-464a-9c42-b42c331ce39b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469146 Dec 21 04:21:11.307453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-86c66990-a5f7-49a9-a814-9da775597345 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.350434 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-86c66990-a5f7-49a9-a814-9da775597345 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c7771af3efe345c5814460c36139f04e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4517021 Dec 21 04:21:11.352601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c66990-a5f7-49a9-a814-9da775597345 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29a469c4-a700-45cf-9407-67df0fbfd256,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:11.353564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41628) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:11.416447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a397e3e-3332-47d5-bd2c-592104739c31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.451677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a397e3e-3332-47d5-bd2c-592104739c31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.594602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a397e3e-3332-47d5-bd2c-592104739c31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.606167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a397e3e-3332-47d5-bd2c-592104739c31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:11.617685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5a397e3e-3332-47d5-bd2c-592104739c31 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/29a469c4-a700-45cf-9407-67df0fbfd256 HTTP/1.1" status: 204 len: 168 time: 0.2541590 Dec 21 04:21:11.632791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a397e3e-3332-47d5-bd2c-592104739c31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29a469c4-a700-45cf-9407-67df0fbfd256,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:12.142192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4711f3e1-549d-4930-b491-b89a6e8dd7e0 req-792fcd72-8b1c-4954-859f-304ebb65ed77 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:12.143731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4711f3e1-549d-4930-b491-b89a6e8dd7e0 req-792fcd72-8b1c-4954-859f-304ebb65ed77 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0548823 Dec 21 04:21:12.201043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4711f3e1-549d-4930-b491-b89a6e8dd7e0 req-a35eaefc-7eb7-44c1-9666-c7bb09d0f598 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0512941 Dec 21 04:21:12.402241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48a1120-52fe-4efe-9dfb-1761fc375ded req-f9d95ac9-d33b-4904-bd28-a02a46cc7d78 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:12.403753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d48a1120-52fe-4efe-9dfb-1761fc375ded req-f9d95ac9-d33b-4904-bd28-a02a46cc7d78 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0536871 Dec 21 04:21:12.454543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d48a1120-52fe-4efe-9dfb-1761fc375ded req-828a7a39-5a62-4496-a383-c48c4c14e800 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439858 Dec 21 04:21:13.349922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8327ef99-1b04-40e2-9b88-075244f82359 req-10ebb4eb-7045-4d43-814b-7d8096a054d7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:13.353411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8327ef99-1b04-40e2-9b88-075244f82359 req-10ebb4eb-7045-4d43-814b-7d8096a054d7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0554826 Dec 21 04:21:13.412428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8327ef99-1b04-40e2-9b88-075244f82359 req-08bfaeb5-a440-4f89-b76b-6d4064262fb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0547588 Dec 21 04:21:13.549905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-a15896cf-8a55-43e1-aad4-e686e340d8a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:13.552650 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-a15896cf-8a55-43e1-aad4-e686e340d8a3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1097 time: 0.0767729 Dec 21 04:21:13.677912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8509a9d2-e13c-4090-bdc1-6e434fe0c6f3 req-95e1c65a-1961-49fd-b550-c8f96b427aaf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:13.679533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8509a9d2-e13c-4090-bdc1-6e434fe0c6f3 req-95e1c65a-1961-49fd-b550-c8f96b427aaf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.1194758 Dec 21 04:21:13.727780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-a8e4b5f1-9720-4644-a419-cd8841776166 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:13.729284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-a8e4b5f1-9720-4644-a419-cd8841776166 service neutron] 10.222.0.31 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1675515 Dec 21 04:21:13.788008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8509a9d2-e13c-4090-bdc1-6e434fe0c6f3 req-de87848d-6329-4f03-a7ae-35c909bcb2af tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0982289 Dec 21 04:21:13.815960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-db452b71-a3c1-424b-aa55-4b0ac7e10f6a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1001 time: 0.0713322 Dec 21 04:21:13.868665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-e9f30a4f-b769-4c00-912e-1dd2510c6a95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:13.870764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-e9f30a4f-b769-4c00-912e-1dd2510c6a95 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0442162 Dec 21 04:21:13.918670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-65d747c2-118b-47d7-bfa7-3779f0e39226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:13.920175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-65d747c2-118b-47d7-bfa7-3779f0e39226 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0415316 Dec 21 04:21:14.013258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-c61fa2b7-0fd3-4241-b403-2ced1ce632cb service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852799 Dec 21 04:21:14.101956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8649c73a-67a6-4eea-9905-3182cd8d89f6 req-7e1cf2f6-430e-4b4b-bbdf-7660f413543a service neutron] 10.222.0.31 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816839 Dec 21 04:21:14.531721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a453c8-f14d-4a33-b4ef-fa2319560a44 req-64b81eeb-113c-48a4-b545-91790ae26d24 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:14.533202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4a453c8-f14d-4a33-b4ef-fa2319560a44 req-64b81eeb-113c-48a4-b545-91790ae26d24 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0485172 Dec 21 04:21:14.585308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4a453c8-f14d-4a33-b4ef-fa2319560a44 req-29b3d604-2b65-4503-9a9f-0e4c84368e8f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0456405 Dec 21 04:21:14.921078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92bc9c27-d06d-4d12-8060-e0758cd1ec28 req-0beba070-66f2-4fb1-b2ef-6ad6aba90a0e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:14.922767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92bc9c27-d06d-4d12-8060-e0758cd1ec28 req-0beba070-66f2-4fb1-b2ef-6ad6aba90a0e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0509543 Dec 21 04:21:14.971250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92bc9c27-d06d-4d12-8060-e0758cd1ec28 req-76cacc64-af15-4122-a902-8a5776eca7a8 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414345 Dec 21 04:21:15.710801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b70f7a3-6554-4e5e-9e53-3c3cf9503210 req-c41db9c6-0681-44a2-9d00-3e80cb0607c1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:15.712346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b70f7a3-6554-4e5e-9e53-3c3cf9503210 req-c41db9c6-0681-44a2-9d00-3e80cb0607c1 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0520952 Dec 21 04:21:15.761334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b70f7a3-6554-4e5e-9e53-3c3cf9503210 req-a53b9d49-287c-4193-91a3-9ca708f04c51 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428059 Dec 21 04:21:16.135362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a80ed1a-15d9-4015-a06f-d298ab4fbd52 req-5d49fd4c-7b5e-492e-81a2-a25ddd6fe279 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:16.137605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a80ed1a-15d9-4015-a06f-d298ab4fbd52 req-5d49fd4c-7b5e-492e-81a2-a25ddd6fe279 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0872674 Dec 21 04:21:16.199276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a80ed1a-15d9-4015-a06f-d298ab4fbd52 req-8b8f0e67-036a-4f59-a9d0-3204bd919fd9 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545392 Dec 21 04:21:16.879702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31be92c0-0e46-4424-880a-b67331853727 req-eae0590a-8c30-40e2-86d4-bcded1ff6a36 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:16.881217 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31be92c0-0e46-4424-880a-b67331853727 req-eae0590a-8c30-40e2-86d4-bcded1ff6a36 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0505042 Dec 21 04:21:16.934162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31be92c0-0e46-4424-880a-b67331853727 req-013b3ceb-6671-4565-a0ea-5c82ce4894fb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0466228 Dec 21 04:21:17.058024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41838) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:17.166420 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed4cb0e7-7782-4b04-8fd2-212b0efb22ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.244311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed4cb0e7-7782-4b04-8fd2-212b0efb22ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.319997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4191611f-9e83-4ab8-8b0e-2adaab21d218 req-02e2c69c-021c-40e4-b7f1-1ea46df5e6e0 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:17.321492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4191611f-9e83-4ab8-8b0e-2adaab21d218 req-02e2c69c-021c-40e4-b7f1-1ea46df5e6e0 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0492907 Dec 21 04:21:17.344290 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed4cb0e7-7782-4b04-8fd2-212b0efb22ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.402216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ed4cb0e7-7782-4b04-8fd2-212b0efb22ac admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=fe30a5be2ff0494790dd1c06dc276d2b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3429897 Dec 21 04:21:17.405075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41844) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:17.406148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4191611f-9e83-4ab8-8b0e-2adaab21d218 req-70d22d59-e25d-46bf-83d2-912960c98f33 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0787525 Dec 21 04:21:17.406762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4cb0e7-7782-4b04-8fd2-212b0efb22ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0153660d-c80a-4e5c-96e3-b4789b5099ff,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:17.478905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87a7d0aa-ee65-40f9-aa28-cf7ad46e1bd9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.502680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87a7d0aa-ee65-40f9-aa28-cf7ad46e1bd9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.626256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87a7d0aa-ee65-40f9-aa28-cf7ad46e1bd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.631765 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-87a7d0aa-ee65-40f9-aa28-cf7ad46e1bd9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.635560 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-87a7d0aa-ee65-40f9-aa28-cf7ad46e1bd9 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0153660d-c80a-4e5c-96e3-b4789b5099ff HTTP/1.1" status: 204 len: 168 time: 0.2265856 Dec 21 04:21:17.642183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a7d0aa-ee65-40f9-aa28-cf7ad46e1bd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0153660d-c80a-4e5c-96e3-b4789b5099ff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:17.872505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:21:17.953972 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:17.980464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:17.983095 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7eb72458-63b4-45df-aee8-a052d05f4d2d" -d '{"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-unplugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:17.995387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:18.059260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc9bef0-7e79-4736-9ec4-f10f987aae3d req-b2d4fa00-14d4-4723-b44b-280801b0cf85 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:18.061328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bc9bef0-7e79-4736-9ec4-f10f987aae3d req-b2d4fa00-14d4-4723-b44b-280801b0cf85 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0547662 Dec 21 04:21:18.072241 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.128508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bc9bef0-7e79-4736-9ec4-f10f987aae3d req-a9ffda4f-0481-4763-a231-5351df20e89f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0593200 Dec 21 04:21:18.130747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:18.174409 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ffa71c6e-2a20-40e3-8aa5-d35351c37913 x-openstack-request-id: req-ffa71c6e-2a20-40e3-8aa5-d35351c37913 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:18.174736 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-unplugged", "status": "failed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "code": 422}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:18.175040 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ffa71c6e-2a20-40e3-8aa5-d35351c37913 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:18.175462 n-d-822053-11 neutron-server[110312]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'code': 422} returned with failed status Dec 21 04:21:18.363017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 41866) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:18.378006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93937353-0ed0-48ac-914d-e7072fcaebb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.455354 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93937353-0ed0-48ac-914d-e7072fcaebb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.526157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93937353-0ed0-48ac-914d-e7072fcaebb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.567951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-93937353-0ed0-48ac-914d-e7072fcaebb6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=99ddc6e17fba475499da8e8ac7e747d0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2046819 Dec 21 04:21:18.569176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93937353-0ed0-48ac-914d-e7072fcaebb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5a4a7e0-9272-43c7-a189-6592e70c9669,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:18.570992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41872) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:18.630830 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b196e16-c8da-4831-b05d-573b98c47ac3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.652155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b196e16-c8da-4831-b05d-573b98c47ac3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.783968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b196e16-c8da-4831-b05d-573b98c47ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.789673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b196e16-c8da-4831-b05d-573b98c47ac3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:18.791618 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b196e16-c8da-4831-b05d-573b98c47ac3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f5a4a7e0-9272-43c7-a189-6592e70c9669 HTTP/1.1" status: 204 len: 168 time: 0.2186737 Dec 21 04:21:18.802716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b196e16-c8da-4831-b05d-573b98c47ac3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5a4a7e0-9272-43c7-a189-6592e70c9669,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:19.298102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efbe7fb-758a-45a4-ba99-42af0cb23cf0 req-61cf12a7-f9a9-404f-92df-5e5d7f54c64e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:19.299838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1efbe7fb-758a-45a4-ba99-42af0cb23cf0 req-61cf12a7-f9a9-404f-92df-5e5d7f54c64e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0924008 Dec 21 04:21:19.369308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1efbe7fb-758a-45a4-ba99-42af0cb23cf0 req-7a9538fe-3fc3-4ffd-aed6-98afaecb4680 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0581069 Dec 21 04:21:19.685800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59de0fbf-654e-464e-849a-928375913fc6 req-272187e2-dc68-42f4-9809-1d4a00a8b1b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:19.688053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59de0fbf-654e-464e-849a-928375913fc6 req-272187e2-dc68-42f4-9809-1d4a00a8b1b3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.0549076 Dec 21 04:21:19.739589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59de0fbf-654e-464e-849a-928375913fc6 req-5bf5a8fd-67df-4cfe-89d6-562b360eb29c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437434 Dec 21 04:21:19.872084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7eead693-c79e-4052-b6b5-5b33f44e94ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:19.911572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-1f5e834e-bc42-4bed-be30-404c4c52a1eb service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0428345 Dec 21 04:21:20.500193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6caad7d9-6826-4660-a1bf-069e15a7b9d1 req-854da5b7-612c-499f-9941-26571a9a198f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:20.507448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6caad7d9-6826-4660-a1bf-069e15a7b9d1 req-854da5b7-612c-499f-9941-26571a9a198f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0618591 Dec 21 04:21:20.558111 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6caad7d9-6826-4660-a1bf-069e15a7b9d1 req-3958747b-e662-4a66-a508-4ea66ce34999 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0471220 Dec 21 04:21:20.883304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16d48e2d-0331-4c4a-b021-b92393a09ee0 req-440c075f-0d90-48a7-8300-c0a4436ab168 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:20.885161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16d48e2d-0331-4c4a-b021-b92393a09ee0 req-440c075f-0d90-48a7-8300-c0a4436ab168 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.0539110 Dec 21 04:21:20.890970 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:21:20.937037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16d48e2d-0331-4c4a-b021-b92393a09ee0 req-60e9adb1-53cd-494e-900f-b76fcf3a1153 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452843 Dec 21 04:21:21.487129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-f0448182-29b7-4867-a775-fa8c93be9fb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:21.488620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-f0448182-29b7-4867-a775-fa8c93be9fb7 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7&tenant_id=f201aa828d124b4d96ae1f68f53fe955 HTTP/1.1" status: 200 len: 1095 time: 0.0438838 Dec 21 04:21:21.505497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:21:21.559698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:21.697633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1138d6e-9c0b-4502-b84f-43bcaaf21fcd req-73e9587d-a2be-46e1-b8e9-80773fc265fa tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:21.699200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1138d6e-9c0b-4502-b84f-43bcaaf21fcd req-73e9587d-a2be-46e1-b8e9-80773fc265fa tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0504630 Dec 21 04:21:21.751248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1138d6e-9c0b-4502-b84f-43bcaaf21fcd req-4d4b6de8-b68d-4501-9ede-a1c28fe35464 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0442874 Dec 21 04:21:21.785093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:21.818605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:21:21.854767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:21:21.862205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:21.874358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Transition to ACTIVE for port object d0bb881d-37f6-4b67-a89c-a6c72e23dd9a will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:21:21.954375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:22.033034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=9']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:22.085285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17a48ed-14b3-4ba0-9c03-461684096a13 req-eda516ed-4611-4ab3-8544-60349889cd1d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.085285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b17a48ed-14b3-4ba0-9c03-461684096a13 req-eda516ed-4611-4ab3-8544-60349889cd1d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 943 time: 0.0605922 Dec 21 04:21:22.085546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] No DVR routers for this DVR port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:21:22.135673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b17a48ed-14b3-4ba0-9c03-461684096a13 req-02c5d5c8-5a5a-498d-bc84-5b967b584370 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472097 Dec 21 04:21:22.230886 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:21:22.231757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:21:22.231757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:21:22.236169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on network 577a9fd0-5714-46c9-9810-f5765f640d13 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:21:22.236510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Attempting to bind port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on network 577a9fd0-5714-46c9-9810-f5765f640d13 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:21:22.241367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 20, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:21:22.241705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Checking segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:21:22.242089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Bound using segment: {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:21:22.242506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Bound port: d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4e8ee42e-c970-4cdd-8f8d-9faefa309132', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:21:22.242857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:22.306210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:21:22.309201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:21:22.392652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:22.432716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.433356 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:22.434744 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] 10.222.0.54 "PUT /v2.0/ports/d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1092 time: 0.9332025 Dec 21 04:21:22.435297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:22.437568 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-934a93e5-8224-44ef-b2d8-fa0465e1715a" -d '{"events": [{"name": "network-changed", "server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:22.463712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055135d9-aa80-48ea-add9-90f9f0c3ce70 service neutron] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:22.494335 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e8a3e74-16a5-4593-968f-8e0a4b716385 x-openstack-request-id: req-4e8a3e74-16a5-4593-968f-8e0a4b716385 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:22.494970 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:22.494970 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4e8a3e74-16a5-4593-968f-8e0a4b716385 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:22.495521 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'status': 'completed', 'code': 200} Dec 21 04:21:22.530754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-db81fb29-8267-4d6d-87aa-40b71e9947c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.532591 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-db81fb29-8267-4d6d-87aa-40b71e9947c6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1096 time: 0.0485291 Dec 21 04:21:22.639251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-f1f6a583-2206-4707-aa01-88811fc40677 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.640736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-f1f6a583-2206-4707-aa01-88811fc40677 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1003067 Dec 21 04:21:22.684039 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-427c69e4-0a4f-4133-bf74-d4827773144d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:22.727600 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-4401effa-a54a-45ef-a156-a6570a4b09ff service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 999 time: 0.0792756 Dec 21 04:21:22.785590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-4a0500f0-524a-4d53-8366-0197a3e3fc3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.787291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-4a0500f0-524a-4d53-8366-0197a3e3fc3d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0521760 Dec 21 04:21:22.836331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-58f0e4a9-9c00-44d1-8be7-9cb28139aba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.837938 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-58f0e4a9-9c00-44d1-8be7-9cb28139aba0 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0440464 Dec 21 04:21:22.873621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27b42562-4be9-4947-b242-b8d0c57b0b5e req-c3c25740-5369-40ab-9d18-36acb22878bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:22.875145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27b42562-4be9-4947-b242-b8d0c57b0b5e req-c3c25740-5369-40ab-9d18-36acb22878bb tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0503299 Dec 21 04:21:22.925541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-27b42562-4be9-4947-b242-b8d0c57b0b5e req-796e9eb7-70b0-448b-ad85-20e23b0fe3a2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0432217 Dec 21 04:21:22.943330 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-7c2b7344-17c0-4ddc-b1bb-f2675fcb74af service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0977616 Dec 21 04:21:23.017515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:23.042826 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-f89c88e5-4f21-4ed3-a601-c81ae58277cb service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913794 Dec 21 04:21:23.274664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d3618d-8592-4fe4-a99d-5b91f2e272fd req-af2a6ef0-5b84-47b2-85c9-17af996f970a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:23.281088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65d3618d-8592-4fe4-a99d-5b91f2e272fd req-af2a6ef0-5b84-47b2-85c9-17af996f970a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0535936 Dec 21 04:21:23.287749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-cc889f12-3d16-4133-a7b4-5e62816d1a2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:23.289314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-cc889f12-3d16-4133-a7b4-5e62816d1a2c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1096 time: 0.0896270 Dec 21 04:21:23.334772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:23.339175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65d3618d-8592-4fe4-a99d-5b91f2e272fd req-946fd25e-5087-4f33-b075-ceb696e6043b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555897 Dec 21 04:21:23.396415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-8f161d12-4f8d-4bb1-b8cb-7af201fc8274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:23.398022 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-8f161d12-4f8d-4bb1-b8cb-7af201fc8274 service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1011672 Dec 21 04:21:23.465044 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-4796e0d1-d66b-404c-bf4f-be8ab20f73b9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 999 time: 0.0600696 Dec 21 04:21:23.523065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-b914a0c8-da93-4088-8f02-d3bbc0103c70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:23.524529 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-b914a0c8-da93-4088-8f02-d3bbc0103c70 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0529602 Dec 21 04:21:23.570399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-9b87e21d-097c-432a-b2d0-0de6212a2a50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:23.571912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-9b87e21d-097c-432a-b2d0-0de6212a2a50 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403755 Dec 21 04:21:23.664314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-8bf21a82-a2a4-4cdb-a77b-d156f4d9fb35 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851836 Dec 21 04:21:23.839536 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-934a93e5-8224-44ef-b2d8-fa0465e1715a req-b551b16b-02e4-4f59-a544-8a22eac85bce service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1610091 Dec 21 04:21:23.977522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42840cc9-34e8-466b-ba92-a1d3a4952ee8 req-311f0c4c-350e-4334-924b-cea6ef08987e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:23.979186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42840cc9-34e8-466b-ba92-a1d3a4952ee8 req-311f0c4c-350e-4334-924b-cea6ef08987e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1097 time: 0.1182132 Dec 21 04:21:24.071506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42840cc9-34e8-466b-ba92-a1d3a4952ee8 req-68a2b5ad-ed75-4bba-9c03-8a7dceab5087 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0754392 Dec 21 04:21:24.161633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44df441d-b4a2-4dea-b547-3512ad84b5bb req-8b582891-9671-4286-9818-471460a932cc tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:24.164280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44df441d-b4a2-4dea-b547-3512ad84b5bb req-8b582891-9671-4286-9818-471460a932cc tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0915744 Dec 21 04:21:24.264287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44df441d-b4a2-4dea-b547-3512ad84b5bb req-9b1a4485-95e9-46a4-868c-552809a7de0a tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0919123 Dec 21 04:21:24.507004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e745d92-e4df-45d5-be8a-45bb5d5ed4de req-001539fe-1302-4a8f-8718-af951871af8b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:24.508946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e745d92-e4df-45d5-be8a-45bb5d5ed4de req-001539fe-1302-4a8f-8718-af951871af8b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0826857 Dec 21 04:21:24.623823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e745d92-e4df-45d5-be8a-45bb5d5ed4de req-28287df6-387f-4fe5-b74e-e1d368051c9e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1038032 Dec 21 04:21:25.055164 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:25.109131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:25.385322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11619e81-18ce-4aaa-858c-acf662a153b2 req-0eed0ef1-c529-4abc-bbaa-168134250056 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:25.386999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11619e81-18ce-4aaa-858c-acf662a153b2 req-0eed0ef1-c529-4abc-bbaa-168134250056 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0500376 Dec 21 04:21:25.447905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11619e81-18ce-4aaa-858c-acf662a153b2 req-5ed9a5d8-bf2e-4893-85a4-207bbb763349 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0544622 Dec 21 04:21:25.749603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4691abf1-0c75-4005-bd4d-29ca97c7702c req-98575214-9f60-4407-9bd9-b20b4c41ffe2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:25.751516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4691abf1-0c75-4005-bd4d-29ca97c7702c req-98575214-9f60-4407-9bd9-b20b4c41ffe2 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0490515 Dec 21 04:21:25.755149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:25.806445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4691abf1-0c75-4005-bd4d-29ca97c7702c req-0e14572e-3ff9-4c10-9210-081ea1b6aed4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467122 Dec 21 04:21:25.914676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:21:25.936697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:21:26.090567 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:26.093139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:26.120333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'port_id': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'mac_address': 'fa:16:3e:8e:dc:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:21:26.125394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:26.127606 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d89eb3ac-cc52-410f-be01-902bbe483bee" -d '{"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-unplugged", "status": "completed", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:26.153214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:26.192635 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08a67ef8-d9d9-4dc8-9ddf-8f2cf1f3c55e x-openstack-request-id: req-08a67ef8-d9d9-4dc8-9ddf-8f2cf1f3c55e {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:26.192935 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-unplugged", "status": "completed", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:26.193260 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-08a67ef8-d9d9-4dc8-9ddf-8f2cf1f3c55e {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:26.193655 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'code': 200} Dec 21 04:21:26.197945 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:26.213662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 24d03e3d-a8fb-413a-abdd-3f3692e34091 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:21:26.241798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:26.324310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:21:26.324763 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:21:26.367992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:26.581116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5548e6c-4dac-4b70-84e1-82506829adc0 req-b4331e86-aee3-441e-be71-279ccb39eef6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:26.583376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5548e6c-4dac-4b70-84e1-82506829adc0 req-b4331e86-aee3-441e-be71-279ccb39eef6 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 943 time: 0.0601709 Dec 21 04:21:26.650048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5548e6c-4dac-4b70-84e1-82506829adc0 req-a540b009-4c10-49ed-a877-d4ef90045192 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0598195 Dec 21 04:21:26.673829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 41976) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:21:26.736425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e7ef1efb-297e-47d3-8fa6-47f5d61ed59e tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/floatingips/4c856b9d-40ac-4052-bd05-c7a1a73436ed HTTP/1.1" status: 200 len: 991 time: 0.0613499 Dec 21 04:21:26.867859 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:26.892819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24d03e3d-a8fb-413a-abdd-3f3692e34091 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:21:26.945059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:26.993821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d96b807-5a9b-4536-a0de-bc393ef3c026 req-692bee13-cc48-4902-88cf-a4deaadd5004 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:26.995254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d96b807-5a9b-4536-a0de-bc393ef3c026 req-692bee13-cc48-4902-88cf-a4deaadd5004 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0636034 Dec 21 04:21:27.017349 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:27.046807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d96b807-5a9b-4536-a0de-bc393ef3c026 req-72964f18-75da-4bca-80fd-09790e1b5e7e tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455589 Dec 21 04:21:27.084201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:27.400683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['24d03e3d-a8fb-413a-abdd-3f3692e34091'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:21:28.174093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e5cc8b-0cd8-4d07-939d-122ceeb6ef36 req-cbf8c787-81bf-4899-af8b-f4b52e7550c4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:28.175596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4e5cc8b-0cd8-4d07-939d-122ceeb6ef36 req-cbf8c787-81bf-4899-af8b-f4b52e7550c4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0517476 Dec 21 04:21:28.221396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4e5cc8b-0cd8-4d07-939d-122ceeb6ef36 req-6fd9b3e5-9e00-4f5f-bc25-77bc23eabd77 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394177 Dec 21 04:21:28.544166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7485e65-d6d0-4455-b371-67d2bffcfe78 req-cfadf7e5-6dd6-46b0-8255-8047e417b4fc tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:28.545635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7485e65-d6d0-4455-b371-67d2bffcfe78 req-cfadf7e5-6dd6-46b0-8255-8047e417b4fc tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0479462 Dec 21 04:21:28.594085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7485e65-d6d0-4455-b371-67d2bffcfe78 req-1929b3c4-64b3-407e-9f25-ae211d6fcafa tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422592 Dec 21 04:21:29.346207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c3cbed-59a9-4457-aa1a-c7f8529d7adc req-f4f712f3-f01f-48ec-a94c-47099d5a7699 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:29.347706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40c3cbed-59a9-4457-aa1a-c7f8529d7adc req-f4f712f3-f01f-48ec-a94c-47099d5a7699 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0528848 Dec 21 04:21:29.393181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40c3cbed-59a9-4457-aa1a-c7f8529d7adc req-96caa6b1-37ca-4fe3-96ba-d4e0518625dd tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394611 Dec 21 04:21:29.712916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a364158-0bb1-495c-a0b0-d37064895828 req-db398605-b862-4b7a-982f-341ce4b79bb7 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:29.714395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a364158-0bb1-495c-a0b0-d37064895828 req-db398605-b862-4b7a-982f-341ce4b79bb7 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0487001 Dec 21 04:21:29.760049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a364158-0bb1-495c-a0b0-d37064895828 req-cb6d5b4b-ce02-4cfd-b984-410b6256f1f2 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397563 Dec 21 04:21:29.944206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:21:30.028886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 24d03e3d-a8fb-413a-abdd-3f3692e34091 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:21:30.029178 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:30.124679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:30.146073 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:30.148221 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f11972a5-20dd-46e7-a31c-d25d4164b9d5" -d '{"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-plugged", "status": "completed", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:30.161062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:30.185234 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65614ab1-6ab1-43ed-82d7-c5eb5b985836 x-openstack-request-id: req-65614ab1-6ab1-43ed-82d7-c5eb5b985836 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:30.185234 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-plugged", "status": "completed", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:30.185234 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-65614ab1-6ab1-43ed-82d7-c5eb5b985836 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:30.185234 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'code': 200} Dec 21 04:21:30.226434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:30.272252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:30.517479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b74b7cb9-892a-4fc1-8df4-69d86406883a req-4ddab781-9ba8-42ce-ba76-3d81062f1326 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:30.518988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b74b7cb9-892a-4fc1-8df4-69d86406883a req-4ddab781-9ba8-42ce-ba76-3d81062f1326 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0487814 Dec 21 04:21:30.568415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b74b7cb9-892a-4fc1-8df4-69d86406883a req-f306cab4-a6ac-4453-9adf-3c9167073226 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429049 Dec 21 04:21:30.883070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53e5536-9ca1-4bd6-b3ec-6b7b51720874 req-1341693b-ce31-481a-931d-6613e059486e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:30.884549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c53e5536-9ca1-4bd6-b3ec-6b7b51720874 req-1341693b-ce31-481a-931d-6613e059486e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0486255 Dec 21 04:21:30.932852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c53e5536-9ca1-4bd6-b3ec-6b7b51720874 req-426861dc-7ace-463c-b492-f2ee452f7d3e tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424197 Dec 21 04:21:31.689981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e1b90f-f2f4-4eb2-9352-ce132161a95a req-7c8bf528-60ec-49c3-9257-17cf2e989daa tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:31.691457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1e1b90f-f2f4-4eb2-9352-ce132161a95a req-7c8bf528-60ec-49c3-9257-17cf2e989daa tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0475917 Dec 21 04:21:31.742918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1e1b90f-f2f4-4eb2-9352-ce132161a95a req-ad1e989d-10b2-40c0-86e9-bb6faa9a1b25 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444028 Dec 21 04:21:32.400636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc898ace-09e1-4727-8419-73ce333d41a6 req-cca9afad-e592-4e62-ae5f-3c3669ca9ac6 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:32.402107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc898ace-09e1-4727-8419-73ce333d41a6 req-cca9afad-e592-4e62-ae5f-3c3669ca9ac6 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.3909440 Dec 21 04:21:32.452363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc898ace-09e1-4727-8419-73ce333d41a6 req-9546bedf-d12a-4d42-ad94-54417ffaeeec tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425389 Dec 21 04:21:32.864894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b895c7-729e-4907-929d-576adbc2baca req-fd73d2d5-26d9-49b7-b096-f774ece67314 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:32.866356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15b895c7-729e-4907-929d-576adbc2baca req-fd73d2d5-26d9-49b7-b096-f774ece67314 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0495446 Dec 21 04:21:32.912878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15b895c7-729e-4907-929d-576adbc2baca req-17319cfd-ca9d-4897-99c6-ef912716e055 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405445 Dec 21 04:21:33.577997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26175db5-37be-456c-9855-7607a50f7b51 req-2a5b3ce9-daa9-416b-9b93-84df634c6ab2 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:33.579455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26175db5-37be-456c-9855-7607a50f7b51 req-2a5b3ce9-daa9-416b-9b93-84df634c6ab2 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0476987 Dec 21 04:21:33.628743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26175db5-37be-456c-9855-7607a50f7b51 req-6d5fed3f-08cc-4308-95fb-c57fe69d32cf tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434372 Dec 21 04:21:34.035864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b220e790-0dd2-4812-bc44-130815ef2c55 req-0dba6a5b-0c7f-411e-a71d-dcebf472910a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:34.037361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b220e790-0dd2-4812-bc44-130815ef2c55 req-0dba6a5b-0c7f-411e-a71d-dcebf472910a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0490901 Dec 21 04:21:34.083417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b220e790-0dd2-4812-bc44-130815ef2c55 req-c2da9997-e53a-4bc6-8a4e-9c27abfcda3b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402019 Dec 21 04:21:34.749145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-034291b6-6ff9-4900-b082-8b59e4e8df6f req-e95ea587-ea91-41a8-92af-4ceaebe55110 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:34.750663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-034291b6-6ff9-4900-b082-8b59e4e8df6f req-e95ea587-ea91-41a8-92af-4ceaebe55110 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0501139 Dec 21 04:21:34.806465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-034291b6-6ff9-4900-b082-8b59e4e8df6f req-f40faaed-2901-4ad4-b4ef-34353c8d00e5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473464 Dec 21 04:21:35.222197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b29cd66-35d1-48c5-ab2e-da55b403a1d2 req-52fe0131-c23e-45a0-8cce-14820f18164d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:35.227861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b29cd66-35d1-48c5-ab2e-da55b403a1d2 req-52fe0131-c23e-45a0-8cce-14820f18164d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0536442 Dec 21 04:21:35.271479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b29cd66-35d1-48c5-ab2e-da55b403a1d2 req-8d49084d-cc1a-4eb4-bc07-c00528713952 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405071 Dec 21 04:21:35.941126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242b6075-9270-42b5-8463-c92d78fc662a req-34f265dd-98bc-4a4f-839d-6f51d5019fbc tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:35.943354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-242b6075-9270-42b5-8463-c92d78fc662a req-34f265dd-98bc-4a4f-839d-6f51d5019fbc tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0494881 Dec 21 04:21:35.989474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-242b6075-9270-42b5-8463-c92d78fc662a req-3997d75c-d929-4a9b-9576-6834e4c47a7d tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394576 Dec 21 04:21:36.389849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0101474f-b1cd-45d6-98b0-3ade1465cc38 req-7b38f990-fc3a-4b86-9b7a-7d6132fe419c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:36.392780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0101474f-b1cd-45d6-98b0-3ade1465cc38 req-7b38f990-fc3a-4b86-9b7a-7d6132fe419c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0484989 Dec 21 04:21:36.442531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0101474f-b1cd-45d6-98b0-3ade1465cc38 req-be0038a1-596c-4dd5-b88a-2cf55abf9bc0 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445871 Dec 21 04:21:37.103432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a041c3bd-596e-45c0-bea7-cb35ecaf2ef6 req-09946d4f-01cd-4126-9b1c-2dd40e905dd9 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:37.105300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a041c3bd-596e-45c0-bea7-cb35ecaf2ef6 req-09946d4f-01cd-4126-9b1c-2dd40e905dd9 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0477822 Dec 21 04:21:37.151413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a041c3bd-596e-45c0-bea7-cb35ecaf2ef6 req-df1344ed-44d4-47ca-bf3a-9259e15ff6fb tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402567 Dec 21 04:21:37.564306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f063a6f9-527a-4f8f-a39e-c38fd56e8950 req-5d1c1aef-931f-4c62-b7ed-5a7148d6571d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:37.565778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f063a6f9-527a-4f8f-a39e-c38fd56e8950 req-5d1c1aef-931f-4c62-b7ed-5a7148d6571d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0483129 Dec 21 04:21:37.611449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f063a6f9-527a-4f8f-a39e-c38fd56e8950 req-e1e177e3-4963-4bb6-b018-bee0d46dcb38 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398488 Dec 21 04:21:38.270242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4812842-e371-40a6-b9e1-5f5a480124ea req-1f0cc0e7-46a5-42a5-91d9-b6b213601a72 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:38.271719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4812842-e371-40a6-b9e1-5f5a480124ea req-1f0cc0e7-46a5-42a5-91d9-b6b213601a72 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0520504 Dec 21 04:21:38.318032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4812842-e371-40a6-b9e1-5f5a480124ea req-e4b53adb-d069-45b8-b3aa-907a2c9d3318 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404043 Dec 21 04:21:38.729876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef308d03-3468-48ea-9b0c-62984b7fc3f8 req-11ab7526-3110-4477-9673-ba2e0571b9c4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:38.731368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef308d03-3468-48ea-9b0c-62984b7fc3f8 req-11ab7526-3110-4477-9673-ba2e0571b9c4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 944 time: 0.0474749 Dec 21 04:21:38.777661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef308d03-3468-48ea-9b0c-62984b7fc3f8 req-3fff8bc8-ad51-4ec5-8e76-c351ef3b0962 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405400 Dec 21 04:21:39.326578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-ec88615d-183b-43b1-bda3-a8c3753784fa tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:39.328031 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-ec88615d-183b-43b1-bda3-a8c3753784fa tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0521724 Dec 21 04:21:39.419106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Deleting port d83a62e7-ec8e-4f4b-954f-dfd863e19097 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:21:39.419458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:39.434671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c38c0c-acaf-4f05-8735-e196358acac0 req-55f25b54-4ebb-4c8b-baab-55537d14e0d9 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:39.436172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71c38c0c-acaf-4f05-8735-e196358acac0 req-55f25b54-4ebb-4c8b-baab-55537d14e0d9 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 945 time: 0.0510774 Dec 21 04:21:39.482557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71c38c0c-acaf-4f05-8735-e196358acac0 req-d91c618a-027f-4a3b-b442-8b498baf597c tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402813 Dec 21 04:21:39.513995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] For port d83a62e7-ec8e-4f4b-954f-dfd863e19097, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d83a62e7-ec8e-4f4b-954f-dfd863e19097,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:39.514362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:39.526154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Calling delete_port for d83a62e7-ec8e-4f4b-954f-dfd863e19097 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:21:39.554918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:21:39.652611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:39.662753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'port_id': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'mac_address': 'fa:16:3e:7b:4c:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:21:39.699329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:39.711611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:21:39.730219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:39.737632 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:39.769380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Pushing event deleted for resources: {'Port': ['ID=d83a62e7-ec8e-4f4b-954f-dfd863e19097,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:39.770146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d83a62e7-ec8e-4f4b-954f-dfd863e19097'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:21:39.805509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:39.816530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] No DVR routers for this DVR port d83a62e7-ec8e-4f4b-954f-dfd863e19097 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:21:39.819406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:39.822860 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b891f925-aa01-4e9d-b94d-a8aca379955b req-0b689f83-24cb-40b2-bb46-852d228a08b8 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "DELETE /v2.0/ports/d83a62e7-ec8e-4f4b-954f-dfd863e19097 HTTP/1.1" status: 204 len: 173 time: 0.4875057 Dec 21 04:21:39.823443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72d46935-5a46-421f-81e7-a613884b887a', 'name': 'network-vif-deleted', 'tag': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:39.827274 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e808eef1-c576-440b-88f4-e516a2370878" -d '{"events": [{"server_uuid": "72d46935-5a46-421f-81e7-a613884b887a", "name": "network-vif-deleted", "tag": "d83a62e7-ec8e-4f4b-954f-dfd863e19097"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:39.858981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:39.863044 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-652e1751-f5f7-4935-a224-252c15258d69 x-openstack-request-id: req-652e1751-f5f7-4935-a224-252c15258d69 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:39.863352 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72d46935-5a46-421f-81e7-a613884b887a", "name": "network-vif-deleted", "tag": "d83a62e7-ec8e-4f4b-954f-dfd863e19097", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:39.863656 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-652e1751-f5f7-4935-a224-252c15258d69 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:39.864592 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72d46935-5a46-421f-81e7-a613884b887a', 'name': 'network-vif-deleted', 'tag': 'd83a62e7-ec8e-4f4b-954f-dfd863e19097', 'status': 'completed', 'code': 200} Dec 21 04:21:39.914253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a16051c-2b86-40e5-9cc1-4bc3ddc1471e req-af6764a9-08eb-439d-82ab-b6ec84a6b5af tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:39.915838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a16051c-2b86-40e5-9cc1-4bc3ddc1471e req-af6764a9-08eb-439d-82ab-b6ec84a6b5af tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0495870 Dec 21 04:21:39.963268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a16051c-2b86-40e5-9cc1-4bc3ddc1471e req-54e38588-3abc-4be7-b2f3-b64cc1df27ca tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414860 Dec 21 04:21:40.097330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['d0bb881d-37f6-4b67-a89c-a6c72e23dd9a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:21:40.592669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-22021b9c-065c-481b-a3b3-b6ceaed3e652 req-a3a19df4-1246-4228-8dcc-2b108ed8e216 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=72d46935-5a46-421f-81e7-a613884b887a HTTP/1.1" status: 200 len: 210 time: 0.0263131 Dec 21 04:21:41.089344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6efff597-1c62-4296-8407-15c9f2ac3be3 req-1e3bc10a-a481-4d4d-bad0-6610f994e2bf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:41.090814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6efff597-1c62-4296-8407-15c9f2ac3be3 req-1e3bc10a-a481-4d4d-bad0-6610f994e2bf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 945 time: 0.0524061 Dec 21 04:21:41.138308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6efff597-1c62-4296-8407-15c9f2ac3be3 req-17111af0-31d9-4bed-ad66-b652ca17eda0 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415053 Dec 21 04:21:41.576366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:21:41.718326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:21:41.722263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:21:41.722641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:41.797925 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:41.820217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:41.822442 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23a2166f-8ca7-4149-9ada-6e99bb6564a8" -d '{"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:41.838658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:41.861739 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b83e895-01c2-4d3c-a571-b71075709207 x-openstack-request-id: req-9b83e895-01c2-4d3c-a571-b71075709207 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:41.861739 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:41.861739 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9b83e895-01c2-4d3c-a571-b71075709207 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:41.861739 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'code': 200} Dec 21 04:21:41.960522 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:41.961443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d83a62e7-ec8e-4f4b-954f-dfd863e19097 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:21:41.981635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: d83a62e7-ec8e-4f4b-954f-dfd863e19097 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:21:41.982071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d83a62e7-ec8e-4f4b-954f-dfd863e19097 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:21:42.024092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:42.140128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06550658-b6e0-4d71-b8af-b969977b36cd req-136432fe-9967-4454-9027-89b0dea3ef46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:42.141657 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06550658-b6e0-4d71-b8af-b969977b36cd req-136432fe-9967-4454-9027-89b0dea3ef46 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1098 time: 0.0402801 Dec 21 04:21:42.187099 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06550658-b6e0-4d71-b8af-b969977b36cd req-12dac7d8-40f9-48b8-9ee9-e57b7b648a44 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379252 Dec 21 04:21:42.256234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1fab362-b451-4a0a-9009-98cdbfc59c52 req-3702238b-c3ca-4d83-8444-b4fab10847cc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:42.257725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1fab362-b451-4a0a-9009-98cdbfc59c52 req-3702238b-c3ca-4d83-8444-b4fab10847cc tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.0492511 Dec 21 04:21:42.305382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c1fab362-b451-4a0a-9009-98cdbfc59c52 req-199c080b-f2fa-4f65-af8c-121f4f5ec6ff tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416167 Dec 21 04:21:43.437686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f9b79e-c248-448f-bb64-cb82776ada1e req-766dcabd-e5d6-45b1-ad4a-87a161da3e6a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:43.439409 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18f9b79e-c248-448f-bb64-cb82776ada1e req-766dcabd-e5d6-45b1-ad4a-87a161da3e6a tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.0503469 Dec 21 04:21:43.496639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18f9b79e-c248-448f-bb64-cb82776ada1e req-db5c0de3-dded-4fb1-b98f-38c465a6505b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501478 Dec 21 04:21:44.625282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe05d4fb-73f7-4dc4-a31d-a53c8184113c req-b08ce292-3e40-48d4-9d39-713ec24e82bf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:44.627066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe05d4fb-73f7-4dc4-a31d-a53c8184113c req-b08ce292-3e40-48d4-9d39-713ec24e82bf tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.0563433 Dec 21 04:21:44.676616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe05d4fb-73f7-4dc4-a31d-a53c8184113c req-b9acc63b-7080-4ba3-83ac-60a73f8587f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424542 Dec 21 04:21:45.820543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ddbd9eb-cda0-4689-a062-c9fec182a27b req-d5e8c91e-4fd9-4d25-94f6-1e59d11294e4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:45.822197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ddbd9eb-cda0-4689-a062-c9fec182a27b req-d5e8c91e-4fd9-4d25-94f6-1e59d11294e4 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.0514498 Dec 21 04:21:45.870138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6ddbd9eb-cda0-4689-a062-c9fec182a27b req-837e163b-9985-48e0-94ad-f078ab17997f tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415733 Dec 21 04:21:49.194504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-adb677ef-6ca7-4487-8247-60112451cb77 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:49.195903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-adb677ef-6ca7-4487-8247-60112451cb77 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/networks?id=1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 200 len: 814 time: 0.1023998 Dec 21 04:21:49.210436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-1c6769b0-122d-49c6-b14f-30beb7a60e01 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/quotas/57ab6cbdcda24806861df9ec12f18681 HTTP/1.1" status: 200 len: 375 time: 0.0087879 Dec 21 04:21:49.241564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-db3b6aa3-df5a-4e55-9280-8ab311063a21 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0258267 Dec 21 04:21:49.251896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-3701ac39-e3ae-4307-8d51-1eaaf0e4ca0d service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:21:49.252835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-3701ac39-e3ae-4307-8d51-1eaaf0e4ca0d service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048883 Dec 21 04:21:49.342388 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-4910a4b6-98ca-4c46-9a06-3f584bdf7f84 service neutron] 10.222.0.18 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835428 Dec 21 04:21:49.428914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-4a1e5e39-0674-4cf3-bb7b-83a77b66b8bf service neutron] 10.222.0.18 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805609 Dec 21 04:21:49.657896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3f65370-7aac-4ecc-a27e-479b273ef148 req-93920540-91d7-4b69-9b7c-9f3d29753166 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 210 time: 0.0307717 Dec 21 04:21:49.875175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a01072af-5ebf-44d7-9983-4f1fec768d3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:50.756149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e6fc9a67-3d8a-46fe-9c67-cde9a8dac81c req-b76b3157-aa43-458b-901d-d9c3c65d6aa4 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 210 time: 0.0274808 Dec 21 04:21:51.451040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-2d1f8d37-bb2a-45b2-879d-973fe761a78a tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:51.452513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-2d1f8d37-bb2a-45b2-879d-973fe761a78a tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "GET /v2.0/networks?id=1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 200 len: 814 time: 0.1035485 Dec 21 04:21:51.470591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Request body: {'port': {'device_id': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae', 'admin_state_up': True, 'tenant_id': '57ab6cbdcda24806861df9ec12f18681'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:21:51.663590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Made reservation on behalf of 57ab6cbdcda24806861df9ec12f18681 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:21:51.667321 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:51.795357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Allocated IP 172.20.0.6 (1e06cb6d-1702-4983-bc62-4912cea57cae/5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3/00ec8d4b-c528-4b42-ba89-2725fead46df) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:21:51.854009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f046843-4f84-4d1f-8a73-8029aa3b1c01 req-e633c1a8-22af-45c2-ab1f-15bf92c6a248 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 210 time: 0.0260105 Dec 21 04:21:51.945505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.017995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.060263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Network 1e06cb6d-1702-4983-bc62-4912cea57cae is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:21:52.063249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:21:52.066697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:21:52.092182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Pushing event updated for resources: {'Port': ['ID=00ec8d4b-c528-4b42-ba89-2725fead46df,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:52.115385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.121071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:21:52.142474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:52.143120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.192545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-5fc67930-1a37-42a4-9661-ebca5b470eb5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7249994 Dec 21 04:21:52.216808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Request body: {'port': {'device_id': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:21:52.269093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.525508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 00ec8d4b-c528-4b42-ba89-2725fead46df {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:21:52.532817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.544732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Transition to ACTIVE for port object 00ec8d4b-c528-4b42-ba89-2725fead46df will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:21:52.592567 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.645908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Pushing event updated for resources: {'Port': ['ID=00ec8d4b-c528-4b42-ba89-2725fead46df,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:52.649976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-03927c45-17a7-4acf-ae79-83ea247bfb03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.718070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Attempting to bind port 00ec8d4b-c528-4b42-ba89-2725fead46df on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:21:52.718409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Attempting to bind port 00ec8d4b-c528-4b42-ba89-2725fead46df by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:21:52.718738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Attempting to bind port 00ec8d4b-c528-4b42-ba89-2725fead46df on network 1e06cb6d-1702-4983-bc62-4912cea57cae {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:21:52.723776 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Port 00ec8d4b-c528-4b42-ba89-2725fead46df on network 1e06cb6d-1702-4983-bc62-4912cea57cae not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:21:52.724098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Attempting to bind port 00ec8d4b-c528-4b42-ba89-2725fead46df on network 1e06cb6d-1702-4983-bc62-4912cea57cae {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:21:52.729772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 21, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:21:52.730112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Checking segment: {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:21:52.730501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Bound using segment: {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:21:52.730957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Bound port: 00ec8d4b-c528-4b42-ba89-2725fead46df, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '412aa278-1368-4813-a350-dccd36d53daf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:21:52.731308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.802242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] For port 00ec8d4b-c528-4b42-ba89-2725fead46df, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:21:52.805809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] For port 00ec8d4b-c528-4b42-ba89-2725fead46df, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=00ec8d4b-c528-4b42-ba89-2725fead46df,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:21:52.879162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.921955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:52.922578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:52.924065 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] 10.222.0.54 "PUT /v2.0/ports/00ec8d4b-c528-4b42-ba89-2725fead46df HTTP/1.1" status: 200 len: 1092 time: 0.7116959 Dec 21 04:21:52.924513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'tag': '00ec8d4b-c528-4b42-ba89-2725fead46df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:52.927548 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac73bb79-740c-48fb-8cb0-4d18735b298e" -d '{"events": [{"name": "network-changed", "server_uuid": "9b0d6002-95a2-4790-9020-b7a90499f7fe", "tag": "00ec8d4b-c528-4b42-ba89-2725fead46df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:52.951284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2e9f9e-df95-4102-b566-b9470ee013db service neutron] Pushing event updated for resources: {'Port': ['ID=00ec8d4b-c528-4b42-ba89-2725fead46df,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:52.987270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf550ab-9534-48c7-af7a-d0c056fdbd16 req-c4579de2-88bb-49f8-bf03-d038e0294131 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:52.987270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bf550ab-9534-48c7-af7a-d0c056fdbd16 req-c4579de2-88bb-49f8-bf03-d038e0294131 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 943 time: 0.0499454 Dec 21 04:21:53.023594 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc7caf73-421c-4982-a1af-a5dbdf821856 x-openstack-request-id: req-bc7caf73-421c-4982-a1af-a5dbdf821856 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:53.024092 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9b0d6002-95a2-4790-9020-b7a90499f7fe", "tag": "00ec8d4b-c528-4b42-ba89-2725fead46df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:53.024544 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bc7caf73-421c-4982-a1af-a5dbdf821856 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:53.025012 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'tag': '00ec8d4b-c528-4b42-ba89-2725fead46df', 'status': 'completed', 'code': 200} Dec 21 04:21:53.026775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:53.028144 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bf550ab-9534-48c7-af7a-d0c056fdbd16 req-67c0796c-bb9f-48d6-81a7-ac198299635c tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446200 Dec 21 04:21:53.082463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-90f9a1f1-a68b-41f7-836e-ac66ae3e18ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:53.083932 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-90f9a1f1-a68b-41f7-836e-ac66ae3e18ec service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 1095 time: 0.0427003 Dec 21 04:21:53.133899 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-88c2702c-912a-4940-a794-db723facc778 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=00ec8d4b-c528-4b42-ba89-2725fead46df HTTP/1.1" status: 200 len: 217 time: 0.0346293 Dec 21 04:21:53.184726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-4c59f1f9-2437-4a72-a5ff-f109475920a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:53.186257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-4c59f1f9-2437-4a72-a5ff-f109475920a5 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3 HTTP/1.1" status: 200 len: 854 time: 0.0460641 Dec 21 04:21:53.216801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-4ec60bfe-ee80-4b44-83dd-e770f199438f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e06cb6d-1702-4983-bc62-4912cea57cae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232394 Dec 21 04:21:53.307719 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-d3426107-4c34-4206-9b62-932540b4576d service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836916 Dec 21 04:21:53.329445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:53.399761 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-089215c6-ff3a-4af7-8eb7-af4805b262fa req-c4066c1a-29e2-4659-9920-ecd5405a1b67 service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846579 Dec 21 04:21:53.608117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-14240025-4314-4175-a7ad-548108246148 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:53.609637 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-14240025-4314-4175-a7ad-548108246148 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=57ab6cbdcda24806861df9ec12f18681&device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 1095 time: 0.0396345 Dec 21 04:21:53.702501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-0b70991d-8c65-4db5-9bcc-21127594b5e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:53.704009 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-0b70991d-8c65-4db5-9bcc-21127594b5e9 service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 200 len: 915 time: 0.0852880 Dec 21 04:21:53.752774 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-c64ffa24-5c04-4b11-85ea-cdcedcb1f7b5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=00ec8d4b-c528-4b42-ba89-2725fead46df HTTP/1.1" status: 200 len: 217 time: 0.0341733 Dec 21 04:21:53.802345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-cc5102dd-de2f-4d9c-a35f-fcaae4ec599d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:53.804033 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-cc5102dd-de2f-4d9c-a35f-fcaae4ec599d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3 HTTP/1.1" status: 200 len: 854 time: 0.0427334 Dec 21 04:21:53.840623 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-487c5aaf-37e0-4f7c-b7ff-5e465ff7d3d3 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e06cb6d-1702-4983-bc62-4912cea57cae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0283813 Dec 21 04:21:53.930439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-b4ece060-806b-40b4-a0bf-f937f8ffcc36 service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810258 Dec 21 04:21:54.024293 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ac73bb79-740c-48fb-8cb0-4d18735b298e req-c7b62cb3-589c-4239-b572-db090b830965 service neutron] 10.222.0.54 "GET /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833986 Dec 21 04:21:54.147144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13b84157-194a-490a-9aa7-fc5f85f0c6ef req-0f64101d-ecfb-4520-a55d-ef71adf59657 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:54.148643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13b84157-194a-490a-9aa7-fc5f85f0c6ef req-0f64101d-ecfb-4520-a55d-ef71adf59657 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 943 time: 0.0515010 Dec 21 04:21:54.194654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13b84157-194a-490a-9aa7-fc5f85f0c6ef req-5ecb6f8f-2546-4dfc-a401-a53a434dfc6f tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401976 Dec 21 04:21:55.044141 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:55.089694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:55.309803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0546650c-4080-45e0-923c-b83272aba251 req-8be62a3f-dc03-4ce2-b921-13cf5e017835 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:55.311879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0546650c-4080-45e0-923c-b83272aba251 req-8be62a3f-dc03-4ce2-b921-13cf5e017835 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 943 time: 0.0514333 Dec 21 04:21:55.361440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0546650c-4080-45e0-923c-b83272aba251 req-a0c27b4b-854d-448a-8e8d-96ff6936bbd5 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415149 Dec 21 04:21:55.569322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 00ec8d4b-c528-4b42-ba89-2725fead46df details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:21:55.663440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 00ec8d4b-c528-4b42-ba89-2725fead46df, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=00ec8d4b-c528-4b42-ba89-2725fead46df,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:55.673954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '00ec8d4b-c528-4b42-ba89-2725fead46df', 'network_id': '1e06cb6d-1702-4983-bc62-4912cea57cae', 'port_id': '00ec8d4b-c528-4b42-ba89-2725fead46df', 'mac_address': 'fa:16:3e:c2:0f:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:21:55.722788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:55.735310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 00ec8d4b-c528-4b42-ba89-2725fead46df {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:21:55.753943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 00ec8d4b-c528-4b42-ba89-2725fead46df, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=00ec8d4b-c528-4b42-ba89-2725fead46df,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:55.783230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:55.851869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:55.897643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=00ec8d4b-c528-4b42-ba89-2725fead46df,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:56.133419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['00ec8d4b-c528-4b42-ba89-2725fead46df'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:21:56.476589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dac6474-e74f-430a-af99-03e043785871 req-56db8f01-d29b-4362-9825-4cd6bb1ec24b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:56.478040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dac6474-e74f-430a-af99-03e043785871 req-56db8f01-d29b-4362-9825-4cd6bb1ec24b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 944 time: 0.0483339 Dec 21 04:21:56.527001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dac6474-e74f-430a-af99-03e043785871 req-998700d5-7ba1-4f51-bb26-e0cece9f4cd7 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430741 Dec 21 04:21:57.577179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 00ec8d4b-c528-4b42-ba89-2725fead46df up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:21:57.640746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e8e42a-6e61-48d4-a218-a6104ba9a728 req-fe4601df-32a0-486a-a04d-bba8a4ea2610 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:57.642252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43e8e42a-6e61-48d4-a218-a6104ba9a728 req-fe4601df-32a0-486a-a04d-bba8a4ea2610 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 944 time: 0.0492187 Dec 21 04:21:57.663191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 00ec8d4b-c528-4b42-ba89-2725fead46df completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:21:57.667151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 00ec8d4b-c528-4b42-ba89-2725fead46df triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:21:57.667631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:57.690361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43e8e42a-6e61-48d4-a218-a6104ba9a728 req-4b17c202-e204-465d-933a-7bd23d052798 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416479 Dec 21 04:21:57.747951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:57.769166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '00ec8d4b-c528-4b42-ba89-2725fead46df'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:21:57.771903 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a74a907-72e2-48df-9f08-f8fbb8fde85a" -d '{"events": [{"server_uuid": "9b0d6002-95a2-4790-9020-b7a90499f7fe", "name": "network-vif-plugged", "status": "completed", "tag": "00ec8d4b-c528-4b42-ba89-2725fead46df"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:21:57.784391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 00ec8d4b-c528-4b42-ba89-2725fead46df, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=00ec8d4b-c528-4b42-ba89-2725fead46df,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:21:57.808712 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:21:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ae57e33-3311-498a-b5e8-1574592df04f x-openstack-request-id: req-6ae57e33-3311-498a-b5e8-1574592df04f {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:21:57.809002 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9b0d6002-95a2-4790-9020-b7a90499f7fe", "name": "network-vif-plugged", "status": "completed", "tag": "00ec8d4b-c528-4b42-ba89-2725fead46df", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:21:57.809258 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6ae57e33-3311-498a-b5e8-1574592df04f {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:21:57.809649 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '00ec8d4b-c528-4b42-ba89-2725fead46df', 'code': 200} Dec 21 04:21:57.852197 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:21:57.889243 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:21:57.899585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=00ec8d4b-c528-4b42-ba89-2725fead46df,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:21:57.955917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5089b9e5-5bed-4589-a9c0-3d3b10591e76 req-ee21cbd5-f49e-43a7-807e-36cd5adfe45b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:57.957401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5089b9e5-5bed-4589-a9c0-3d3b10591e76 req-ee21cbd5-f49e-43a7-807e-36cd5adfe45b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 1097 time: 0.0407102 Dec 21 04:21:57.999982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5089b9e5-5bed-4589-a9c0-3d3b10591e76 req-ded8fa9f-ec3b-4620-b1f2-5a084648b77a service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355883 Dec 21 04:21:58.804133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10284122-3610-4ea8-850f-b49d3325504c req-4a82d69e-11bb-494b-b3fa-89f4cc0fd5f3 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:58.805632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10284122-3610-4ea8-850f-b49d3325504c req-4a82d69e-11bb-494b-b3fa-89f4cc0fd5f3 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 945 time: 0.0485158 Dec 21 04:21:58.851824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-10284122-3610-4ea8-850f-b49d3325504c req-4621cb34-809a-4d25-a7eb-69878cba5d54 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401669 Dec 21 04:21:59.980741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f25b764-fe2b-4619-b3ac-97ce708c202c req-d2a7b4da-437b-4fc4-8f44-293e1a021acf tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:21:59.982610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f25b764-fe2b-4619-b3ac-97ce708c202c req-d2a7b4da-437b-4fc4-8f44-293e1a021acf tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 945 time: 0.0582051 Dec 21 04:22:00.032416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f25b764-fe2b-4619-b3ac-97ce708c202c req-317646ee-fb0e-42c8-bad9-eedfbf6de70f tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437565 Dec 21 04:22:01.783464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-863b5a4f-3492-475a-86af-d4f62ed35cec service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0394104 Dec 21 04:22:01.857462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-0712a305-e22f-4e5b-a0f8-93475c9034ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:01.858974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-0712a305-e22f-4e5b-a0f8-93475c9034ab service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1097 time: 0.0408020 Dec 21 04:22:01.969227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-04fd8b09-30a2-4be8-95d4-f26710382359 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:01.970720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-04fd8b09-30a2-4be8-95d4-f26710382359 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 200 len: 898 time: 0.0899279 Dec 21 04:22:02.041270 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-7f0c790c-35c8-43fe-bcc1-f750799d58cd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 200 len: 1001 time: 0.0617423 Dec 21 04:22:02.095092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-2fff4b97-f4f7-46ae-aa90-75f680621e51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:02.096560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-2fff4b97-f4f7-46ae-aa90-75f680621e51 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 HTTP/1.1" status: 200 len: 834 time: 0.0481815 Dec 21 04:22:02.142834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-58f1f794-fc38-48bc-a83c-bd0206c1d8f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:02.144354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-58f1f794-fc38-48bc-a83c-bd0206c1d8f1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9ffc4833-7ee0-4257-9960-94e8ca848a30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0404656 Dec 21 04:22:02.233951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-05837595-18a7-4b6a-8c3d-1fc1f27406de service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814226 Dec 21 04:22:02.336024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-915145e6-1de4-43dd-898a-3bc3c519fa6b req-955a7317-79dd-4ffb-bdc5-9e3a429a50df service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860195 Dec 21 04:22:03.880173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42188) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:04.045529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 3aea99a9-74b1-4e5b-8ecc-4264849fe813 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:04.045869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:04.123758 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:04.124205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:04.136457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 3aea99a9-74b1-4e5b-8ecc-4264849fe813 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:04.377841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:04.404120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=3aea99a9-74b1-4e5b-8ecc-4264849fe813,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:04.464986 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:04.465312 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Floating IP 4c856b9d-40ac-4052-bd05-c7a1a73436ed disassociated (deleted). External IP: 172.25.5.153, port: 24d03e3d-a8fb-413a-abdd-3f3692e34091. Dec 21 04:22:04.674699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:22:04.783840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:04.788974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:04.793384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] Sync routers for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:04.803345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:04.804226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:04.821930 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-860378dd-4aaa-45ec-8c25-7af2b71b606d tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/floatingips/4c856b9d-40ac-4052-bd05-c7a1a73436ed HTTP/1.1" status: 204 len: 168 time: 0.9380448 Dec 21 04:22:04.821930 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:04.822403 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da4be4e3-8db5-457a-a5d6-1767c4e36405" -d '{"events": [{"name": "network-changed", "server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:04.872789 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9e5c032d-298b-4595-907b-8a97c605a712 x-openstack-request-id: req-9e5c032d-298b-4595-907b-8a97c605a712 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:04.873086 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:04.873476 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9e5c032d-298b-4595-907b-8a97c605a712 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:04.873959 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'status': 'completed', 'code': 200} Dec 21 04:22:04.970894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-7036f6b1-3588-4d9a-9fea-d1098cda9a7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:04.972161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-7036f6b1-3588-4d9a-9fea-d1098cda9a7a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10a032d25985452584a3dcdae6969809&device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 1097 time: 0.0463338 Dec 21 04:22:05.078556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-0c11b18e-5286-4739-b94b-c5c8d8e54669 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:05.080231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-0c11b18e-5286-4739-b94b-c5c8d8e54669 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 200 len: 898 time: 0.0991268 Dec 21 04:22:05.083650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:05.132937 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-bd4e3440-3726-4323-abf2-3fa51645d3f8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 200 len: 217 time: 0.0428836 Dec 21 04:22:05.196027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-e7ed16ed-b177-415d-8207-71e709ad0af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:05.197602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-e7ed16ed-b177-415d-8207-71e709ad0af6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 HTTP/1.1" status: 200 len: 834 time: 0.0569479 Dec 21 04:22:05.278412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-73bbb50d-b9b8-469a-8c3f-81497f768172 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:05.280779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-73bbb50d-b9b8-469a-8c3f-81497f768172 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9ffc4833-7ee0-4257-9960-94e8ca848a30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0578084 Dec 21 04:22:05.336786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:05.365500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] Checking router: fb88a6b5-57b9-4b3c-b920-c99a1adf8778 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:05.375081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:05.375323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:05.391757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b5928a-253f-43a2-beb2-0050a6dfe494 req-7c004ca0-0ab8-4a70-880a-bec6fc584035 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:05.393316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31b5928a-253f-43a2-beb2-0050a6dfe494 req-7c004ca0-0ab8-4a70-880a-bec6fc584035 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.1064155 Dec 21 04:22:05.439194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-988125f2-cb5d-4adf-a3f3-5127270cca0a service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1420407 Dec 21 04:22:05.485742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-31b5928a-253f-43a2-beb2-0050a6dfe494 req-424fa9e7-8ca9-48b1-82f1-d433be47777b tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0821507 Dec 21 04:22:05.486919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:05.559365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da4be4e3-8db5-457a-a5d6-1767c4e36405 req-6c30a4cd-9262-4c6d-bdd3-dd7b5e3672fb service neutron] 10.222.0.31 "GET /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1094954 Dec 21 04:22:05.701712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:05.728041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c61bafd0-6f98-4c91-b653-19800ace5161 None None] The sync data for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 is: [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:20:12Z', 'revision_number': 4, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '0ca46fc3-a122-4ef9-96e6-70b62ba70e39', 'name': '', 'network_id': '9ffc4833-7ee0-4257-9960-94e8ca848a30', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'mac_address': 'fa:16:3e:95:e0:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_interface', 'standard_attr_id': 3712, 'fixed_ips': [{'subnet_id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:11Z', 'updated_at': '2021-12-21T04:20:16Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'subnets': [{'id': '1eab21fa-1f41-4ce7-9ab3-bf42ee33a216', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:05.966076 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec308a23-4eeb-4222-a6a3-84f2f24b9558 None None] New status for floating IP 4c856b9d-40ac-4052-bd05-c7a1a73436ed: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:22:06.617898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e59cb-6f9a-431d-8d4f-8f9e80570433 req-5e9573b2-95c1-49a9-8268-2b1edcefbaf4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:06.624283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-197e59cb-6f9a-431d-8d4f-8f9e80570433 req-5e9573b2-95c1-49a9-8268-2b1edcefbaf4 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0545518 Dec 21 04:22:06.680810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-197e59cb-6f9a-431d-8d4f-8f9e80570433 req-cbf79eb3-4e9d-42a0-a980-5bf903994d63 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/security-groups?id=3e079a6d-07c4-474d-b43d-80e43478771d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0498402 Dec 21 04:22:06.876972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-677bfbac-fee5-45be-92a1-25f55282b8c7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:06.878307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-677bfbac-fee5-45be-92a1-25f55282b8c7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 945 time: 0.0494335 Dec 21 04:22:06.972631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 24d03e3d-a8fb-413a-abdd-3f3692e34091 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:06.972972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:07.060362 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 24d03e3d-a8fb-413a-abdd-3f3692e34091, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=24d03e3d-a8fb-413a-abdd-3f3692e34091,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:07.060722 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:07.072654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 24d03e3d-a8fb-413a-abdd-3f3692e34091 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:07.284696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:07.312245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=24d03e3d-a8fb-413a-abdd-3f3692e34091,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:07.326388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.326754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.327135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.327765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.328102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.328435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.328766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.329091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.329418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.329743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.330065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.330399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.330731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:07.364375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] No DVR routers for this DVR port 24d03e3d-a8fb-413a-abdd-3f3692e34091 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:22:07.366891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:07.370203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2858432-5a70-4753-bc4f-e1fa6233e557 req-9cbcf756-44dc-4401-b21c-ade74c27053f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.31 "DELETE /v2.0/ports/24d03e3d-a8fb-413a-abdd-3f3692e34091 HTTP/1.1" status: 204 len: 173 time: 0.4789774 Dec 21 04:22:07.370641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-deleted', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:07.372932 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49ad6d0b-de06-4a49-9784-a35bd2f191fa" -d '{"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-deleted", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:07.415987 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d6b53283-d947-45f6-8849-06cecd677b1c x-openstack-request-id: req-d6b53283-d947-45f6-8849-06cecd677b1c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:07.415987 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c291789-c988-4e47-beaa-a1520ce6cdb0", "name": "network-vif-deleted", "tag": "24d03e3d-a8fb-413a-abdd-3f3692e34091", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:07.415987 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d6b53283-d947-45f6-8849-06cecd677b1c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:07.415987 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c291789-c988-4e47-beaa-a1520ce6cdb0', 'name': 'network-vif-deleted', 'tag': '24d03e3d-a8fb-413a-abdd-3f3692e34091', 'status': 'completed', 'code': 200} Dec 21 04:22:07.795683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-899eda83-77f2-4ca1-b4ff-2a101e619448 req-4e332766-f9ae-42fc-97a2-e9b6caf9a5bd tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "GET /v2.0/ports?device_id=4c291789-c988-4e47-beaa-a1520ce6cdb0 HTTP/1.1" status: 200 len: 210 time: 0.0268550 Dec 21 04:22:08.860722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42216) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:09.537257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-042e1d5d-7edd-498c-9742-dc57fd8f3098 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0658181 Dec 21 04:22:09.549514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:09.681991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-a7669027-d616-405d-96a8-7156466b2593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:09.683506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-a7669027-d616-405d-96a8-7156466b2593 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f201aa828d124b4d96ae1f68f53fe955&device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 1098 time: 0.0824449 Dec 21 04:22:09.826111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-5cdd3e3c-02c5-443f-a31d-012ef87f260d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:09.827594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-5cdd3e3c-02c5-443f-a31d-012ef87f260d service neutron] 10.222.0.54 "GET /v2.0/networks?id=577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 200 len: 918 time: 0.1155090 Dec 21 04:22:09.948155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-b829f3e1-0480-409a-9038-045655ae280a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 200 len: 1001 time: 0.1101060 Dec 21 04:22:10.003851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:10.004228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:10.020806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-d610165f-a388-4a2a-b3ce-e979132c1bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:10.022271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-d610165f-a388-4a2a-b3ce-e979132c1bf1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 200 len: 856 time: 0.0654349 Dec 21 04:22:10.083566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:10.107620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 24d03e3d-a8fb-413a-abdd-3f3692e34091 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:10.108048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 24d03e3d-a8fb-413a-abdd-3f3692e34091 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:10.121803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-1d90197f-ca05-415e-a059-82d369968aee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:10.123325 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-1d90197f-ca05-415e-a059-82d369968aee service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=577a9fd0-5714-46c9-9810-f5765f640d13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0926025 Dec 21 04:22:10.130239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 0ca46fc3-a122-4ef9-96e6-70b62ba70e39, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:10.130602 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:10.164202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:10.281549 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-7f9c6fea-32d8-4a6f-945f-25d9b238d276 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1483529 Dec 21 04:22:10.428618 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-10bd840b-ad0e-44f7-ab2a-79cbd72eb1f0 req-15d1242d-287d-4f6d-a332-c4e6522af9f4 service neutron] 10.222.0.54 "GET /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1118836 Dec 21 04:22:10.575847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:10.603929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=0ca46fc3-a122-4ef9-96e6-70b62ba70e39,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:10.781621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:10.999364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:22:11.106169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:11.115548 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d278e88-f560-4c16-8003-5392728baeb3 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "PUT /v2.0/routers/fb88a6b5-57b9-4b3c-b920-c99a1adf8778/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2495115 Dec 21 04:22:11.115548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42226) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:11.118711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] Sync routers for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:11.133169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:11.139019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:11.166170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting subnet 1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:22:11.169446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.210750 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.251589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:11.299692 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.416462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.427499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:22:10Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:11.449112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Subnet': ['ID=1eab21fa-1f41-4ce7-9ab3-bf42ee33a216,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:11.457303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.457545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] Checking router: fb88a6b5-57b9-4b3c-b920-c99a1adf8778 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:11.460670 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2cfc622b-7ca4-4f93-9b36-ddfdb9bb8ad7 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/subnets/1eab21fa-1f41-4ce7-9ab3-bf42ee33a216 HTTP/1.1" status: 204 len: 168 time: 0.3450530 Dec 21 04:22:11.463670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42232) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:11.468211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db245b29-45df-4143-b96f-c9bd401a62f8 None None] Network 9ffc4833-7ee0-4257-9960-94e8ca848a30 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:22:11.528200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] Routers {'fb88a6b5-57b9-4b3c-b920-c99a1adf8778'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:11.528837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:11.578199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.665283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] Set router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:11.701626 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.723729 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] DHCP port deletion for 9ffc4833-7ee0-4257-9960-94e8ca848a30 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:11.828284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Deleting port 90da8399-4129-44f8-9044-2b2cca661397 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:11.828735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.860407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Deleting port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:11.860791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.907633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] For port 90da8399-4129-44f8-9044-2b2cca661397, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=90da8399-4129-44f8-9044-2b2cca661397,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:11.908167 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.922282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Calling delete_port for 90da8399-4129-44f8-9044-2b2cca661397 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:11.932346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] For port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,segment=NetworkSegment(1509fcd6-3b48-4708-bf68-e2c05f4010da),segment_id=1509fcd6-3b48-4708-bf68-e2c05f4010da)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:11.932703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:11.948564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Calling delete_port for c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:11.966192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:22:10Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:12.029566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6588f892-ee25-4d6d-9857-9db0d8721b6f None None] The sync data for ids ['fb88a6b5-57b9-4b3c-b920-c99a1adf8778'] in n-d-822053-11 is: [{'id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'name': 'tempest-TestNetworkAdvancedServerOps-router-118375547', 'tenant_id': '10a032d25985452584a3dcdae6969809', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95'}], 'enable_snat': True}, 'gw_port_id': '90da8399-4129-44f8-9044-2b2cca661397', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:20:06Z', 'updated_at': '2021-12-21T04:22:10Z', 'revision_number': 5, 'project_id': '10a032d25985452584a3dcdae6969809', 'gw_port': {'id': '90da8399-4129-44f8-9044-2b2cca661397', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:ac:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb88a6b5-57b9-4b3c-b920-c99a1adf8778', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3709, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:20:07Z', 'updated_at': '2021-12-21T04:20:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:12.069222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:12.153082 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.185993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Pushing event deleted for resources: {'Port': ['ID=c2f51307-9dc8-4fc4-b0ab-d09fdee4da47,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:12.188297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] No DVR routers for this DVR port c2f51307-9dc8-4fc4-b0ab-d09fdee4da47 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:22:12.189748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.204352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.204766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.205038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.205380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.205790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.206131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.206590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.206952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.207416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.207833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.208169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.208507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.208825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fac23d5-bbf5-4b4c-ae14-d47092d541bd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:12.233643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.264543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Port': ['ID=90da8399-4129-44f8-9044-2b2cca661397,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:12.281752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecb0c96d-3bcf-45b3-8d3a-4c0c8ab48328 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:12.332988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.731281 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.733448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.861776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.862320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Fanout notify agent at l3_agent the message router_deleted on router fb88a6b5-57b9-4b3c-b920-c99a1adf8778 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:22:12.869786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:12.870875 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ceca0354-5db3-4a3b-be0e-d262ed8100c2 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/routers/fb88a6b5-57b9-4b3c-b920-c99a1adf8778 HTTP/1.1" status: 204 len: 168 time: 1.4061027 Dec 21 04:22:12.873677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42238) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:12.962283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.052652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.072708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ffc4833-7ee0-4257-9960-94e8ca848a30']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:13.081766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1509fcd6-3b48-4708-bf68-e2c05f4010da') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:13.082062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1509fcd6-3b48-4708-bf68-e2c05f4010da') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:13.092660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.111904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.118801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:22:13.120119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:22:13.122428 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:22:13.252212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.259446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.262227 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/networks/9ffc4833-7ee0-4257-9960-94e8ca848a30 HTTP/1.1" status: 204 len: 168 time: 0.3875210 Dec 21 04:22:13.265138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42242) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:13.274251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61aaa254-16f5-4f7c-868f-389c939bad3f tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'Network': ['ID=9ffc4833-7ee0-4257-9960-94e8ca848a30,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:13.324471 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f84e646-7745-4e06-8921-cdf61973c941 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.352503 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f84e646-7745-4e06-8921-cdf61973c941 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.486473 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f84e646-7745-4e06-8921-cdf61973c941 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.489253 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f84e646-7745-4e06-8921-cdf61973c941 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:13.490419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f84e646-7745-4e06-8921-cdf61973c941 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] 10.222.0.18 "DELETE /v2.0/security-groups/3e079a6d-07c4-474d-b43d-80e43478771d HTTP/1.1" status: 204 len: 168 time: 0.2242818 Dec 21 04:22:13.500126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f84e646-7745-4e06-8921-cdf61973c941 tempest-TestNetworkAdvancedServerOps-1219351675 tempest-TestNetworkAdvancedServerOps-1219351675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e079a6d-07c4-474d-b43d-80e43478771d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:13.977966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 90da8399-4129-44f8-9044-2b2cca661397 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:14.001821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 90da8399-4129-44f8-9044-2b2cca661397 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:14.002168 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 90da8399-4129-44f8-9044-2b2cca661397 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:14.002611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:14.022819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:14.023197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0ca46fc3-a122-4ef9-96e6-70b62ba70e39 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:14.096438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42254) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:14.228643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f522d48c-a231-4bb7-9983-6d89ced05b54 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=10a032d25985452584a3dcdae6969809&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1309478 Dec 21 04:22:14.231430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42258) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:14.283664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b0781f8-4637-4423-a4b4-250c422e7e48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:14.305421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b0781f8-4637-4423-a4b4-250c422e7e48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:14.445316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b0781f8-4637-4423-a4b4-250c422e7e48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:14.448080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b0781f8-4637-4423-a4b4-250c422e7e48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:14.449650 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b0781f8-4637-4423-a4b4-250c422e7e48 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/e9db4a49-f2e5-4452-83e4-ada53d786f1f HTTP/1.1" status: 204 len: 168 time: 0.2172465 Dec 21 04:22:14.461302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0781f8-4637-4423-a4b4-250c422e7e48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9db4a49-f2e5-4452-83e4-ada53d786f1f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:15.148097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42268) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:15.188571 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d6fcb034-b812-4df7-aff0-ccb4643cc498 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=52642e626e214b6589dddbb64757a44f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0391190 Dec 21 04:22:15.191117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42270) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:15.237595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f8a77e0-65e1-46fb-bed9-d4a66e411ff8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:15.259123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f8a77e0-65e1-46fb-bed9-d4a66e411ff8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:15.392714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f8a77e0-65e1-46fb-bed9-d4a66e411ff8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:15.395820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f8a77e0-65e1-46fb-bed9-d4a66e411ff8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:15.397010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5f8a77e0-65e1-46fb-bed9-d4a66e411ff8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/124c9073-1822-4ac2-b62c-b1bfb7be1bd2 HTTP/1.1" status: 204 len: 168 time: 0.2048564 Dec 21 04:22:15.405550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f8a77e0-65e1-46fb-bed9-d4a66e411ff8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=124c9073-1822-4ac2-b62c-b1bfb7be1bd2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:16.601920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42298) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:16.705267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Request body: {'network': {'name': 'tempest-TestServerMultinode-1121844468-network', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:16.789195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Made reservation on behalf of 3a1deef4e9cd439ab363eead886eb316 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:22:16.791577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:16.800048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:16.876493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:16.958753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:16.984385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:22:16.996183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=525b06c8-0567-4d85-8e6f-ec4ab583e7c0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:17.002774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:17.003530 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Added segment 361b0dd0-371b-42cc-92f7-dcea5865d9a0 of type vlan for network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd Dec 21 04:22:17.151280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:17.263820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:17.264865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:17.265525 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:17.328425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] Pushing event updated for resources: {'Network': ['ID=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:17.340167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:22:17.363611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d06aad4e-a176-4ec6-8a48-4bf2a3348aeb admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.7604349 Dec 21 04:22:17.367800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42310) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:17.372906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Request body: {'subnet': {'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerMultinode-1121844468-subnet', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:17.440913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Made reservation on behalf of 3a1deef4e9cd439ab363eead886eb316 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:22:17.445172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:17.572093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b474aa1b-5d0e-41cd-8c1b-c45d0a4398bf req-46aa09e2-f31a-4795-8d5b-811b5b9bbbee tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:17.573588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b474aa1b-5d0e-41cd-8c1b-c45d0a4398bf req-46aa09e2-f31a-4795-8d5b-811b5b9bbbee tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.0721605 Dec 21 04:22:17.678584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b474aa1b-5d0e-41cd-8c1b-c45d0a4398bf req-6cf61410-26f4-42ef-8d5f-04f4a8554b1c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0976057 Dec 21 04:22:17.756180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:17.809396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Pushing event updated for resources: {'Subnet': ['ID=ebe0e4be-6410-4124-aa1a-5df9e39edc4f,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:17.820680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Checking segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:17.821051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Network hostable DHCP agents. Network: eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:22:17.924341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:22:18.021727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:18.027488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:18.027609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.032320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b39e800-f632-4d04-824f-a7819ca1fad4 None None] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:22:18.104694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-333f99e8-7703-439d-b496-6f4bd70cb37c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7357035 Dec 21 04:22:18.107168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42320) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:18.111588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Request body: {'router': {'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:18.133824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'fixed_ips': [{'subnet_id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:22:18.134787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.201073 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.203222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.260787 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.280868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Allocated IP 172.20.0.2 (eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd/ebe0e4be-6410-4124-aa1a-5df9e39edc4f/b664a331-512d-42b3-982c-c439f488b63f) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:18.481316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.610787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.670054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.715541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:18.720027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:18.723203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:18.731020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Pushing event updated for resources: {'Port': ['ID=b664a331-512d-42b3-982c-c439f488b63f,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:18.796657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.800532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Attempting to bind port b664a331-512d-42b3-982c-c439f488b63f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:18.800975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Attempting to bind port b664a331-512d-42b3-982c-c439f488b63f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:18.801453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Attempting to bind port b664a331-512d-42b3-982c-c439f488b63f on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:18.807479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 21, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:18.807951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Checking segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:18.808431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.808881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Bound using segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:18.809488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Bound port: b664a331-512d-42b3-982c-c439f488b63f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:18.809929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.830203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:18.878532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] For port b664a331-512d-42b3-982c-c439f488b63f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:18.882770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] For port b664a331-512d-42b3-982c-c439f488b63f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b664a331-512d-42b3-982c-c439f488b63f,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:18.909603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c6b53a-acb3-49fd-ad74-c4d2825a972a req-761890f1-882a-4478-9106-5dc29284e259 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:18.911804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98c6b53a-acb3-49fd-ad74-c4d2825a972a req-761890f1-882a-4478-9106-5dc29284e259 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.1310310 Dec 21 04:22:18.961876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.049592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Allocated IP 172.25.5.44 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/c17c370f-f407-460c-94cb-a9d329ce8ca5) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:19.063084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98c6b53a-acb3-49fd-ad74-c4d2825a972a req-6bdef908-de8c-4d02-966c-b38a25a16855 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups?id=84c01d45-ee85-45e7-a98d-551b48af6e5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1341822 Dec 21 04:22:19.081656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-d0975f1a-a8bc-4490-8da1-c2820906eb5c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:19.084690 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-d0975f1a-a8bc-4490-8da1-c2820906eb5c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 946 time: 0.0833271 Dec 21 04:22:19.089026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5138d387-fd41-4d19-8d56-0c34fede2ca8 None None] Pushing event updated for resources: {'Port': ['ID=b664a331-512d-42b3-982c-c439f488b63f,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:19.195598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Deleting port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:19.198400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.205544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.319070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] For port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:19.319978 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.324435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.376875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:19.385112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:19.397689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:19.399985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4c8aac6-a902-439a-9ae1-3e3eaa86f5e1 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:19.431454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Pushing event updated for resources: {'Port': ['ID=c17c370f-f407-460c-94cb-a9d329ce8ca5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:19.484583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1d90ab3e-5c7f-41ca-ae6e-cc70f79ebc88 None None] Provisioning complete for port c17c370f-f407-460c-94cb-a9d329ce8ca5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:19.485042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d90ab3e-5c7f-41ca-ae6e-cc70f79ebc88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.531895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1d90ab3e-5c7f-41ca-ae6e-cc70f79ebc88 None None] Port c17c370f-f407-460c-94cb-a9d329ce8ca5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:19.542326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.542754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.543108 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Floating IP 7f236de8-d243-40db-b5f5-ceeeff3191d8 disassociated. External IP: 172.25.5.139, port: d0bb881d-37f6-4b67-a89c-a6c72e23dd9a. Dec 21 04:22:19.543484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Calling delete_port for d0bb881d-37f6-4b67-a89c-a6c72e23dd9a owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:19.726832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.755227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:19.764083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event deleted for resources: {'Port': ['ID=d0bb881d-37f6-4b67-a89c-a6c72e23dd9a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:19.899660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:22:19.905497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-379d1547-310c-4b14-8437-4ceffe3130db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.053495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b664a331-512d-42b3-982c-c439f488b63f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:20.056920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:20.069108 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:20.083283 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:20.083907 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:20.127379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] No DVR routers for this DVR port d0bb881d-37f6-4b67-a89c-a6c72e23dd9a on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:22:20.134595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.158512 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4da3fa3c-026a-4b0a-b653-a5d8405cf7d0 req-bee84a83-ba3f-47a3-9965-167f368002f3 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.54 "DELETE /v2.0/ports/d0bb881d-37f6-4b67-a89c-a6c72e23dd9a HTTP/1.1" status: 204 len: 173 time: 1.0440781 Dec 21 04:22:20.160503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-deleted', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:20.166689 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5338ad5a-a436-4658-99da-cca0c371623c" -d '{"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-deleted", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:20.204433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b664a331-512d-42b3-982c-c439f488b63f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:20.205405 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.263283 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93182b85-75ca-4e6c-bd21-a6d545812c7f x-openstack-request-id: req-93182b85-75ca-4e6c-bd21-a6d545812c7f {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:20.263814 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a59be7e0-8f79-46a5-ab24-51c308396aa7", "name": "network-vif-deleted", "tag": "d0bb881d-37f6-4b67-a89c-a6c72e23dd9a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:20.264167 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-93182b85-75ca-4e6c-bd21-a6d545812c7f {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:20.265153 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a59be7e0-8f79-46a5-ab24-51c308396aa7', 'name': 'network-vif-deleted', 'tag': 'd0bb881d-37f6-4b67-a89c-a6c72e23dd9a', 'status': 'completed', 'code': 200} Dec 21 04:22:20.430279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85a4d8c-671a-4880-a8f5-6f544ad4ed3f req-87e40635-f124-41be-9515-5aeebc29304c tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/ports?device_id=a59be7e0-8f79-46a5-ab24-51c308396aa7 HTTP/1.1" status: 200 len: 210 time: 0.0457211 Dec 21 04:22:20.437412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.485611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e28e1cff-921a-47bc-b9e7-d6b08c2fcc80 None None] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:22:20.513043 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:20.554743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port b664a331-512d-42b3-982c-c439f488b63f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b664a331-512d-42b3-982c-c439f488b63f,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:20.557955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2031c225-bd70-46b9-a570-61b16ff78473 None None] Provisioning complete for port b664a331-512d-42b3-982c-c439f488b63f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:20.558552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2031c225-bd70-46b9-a570-61b16ff78473 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.563746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.642414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:20.736314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=b664a331-512d-42b3-982c-c439f488b63f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:20.777202 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:20.806762 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:20.807009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Router 3c971aaa-fb08-42fd-a092-1641149d9de6 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:22:20.815724 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:20.816448 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:20.943327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:20.958712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Sync routers for ids ['3c971aaa-fb08-42fd-a092-1641149d9de6'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:20.962227 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:20.973275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Routers {'3c971aaa-fb08-42fd-a092-1641149d9de6'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:20.973891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c971aaa-fb08-42fd-a092-1641149d9de6'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:21.014263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.018663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42338) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:21.024553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-612438df-9ec4-42a8-bcaa-5b06edd673ab admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.9155681 Dec 21 04:22:21.117036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-abc14f8f-2ca4-4ba3-80be-d91c14f25c11 None None] Provisioning complete for port b664a331-512d-42b3-982c-c439f488b63f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:21.119800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abc14f8f-2ca4-4ba3-80be-d91c14f25c11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.152791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Set router 3c971aaa-fb08-42fd-a092-1641149d9de6 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:21.267664 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:21.305915 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-208eb5f1-a8f0-43ea-a86d-bd2113459b05 None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:14:26Z', 'revision_number': 4, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '77c72788-b001-4ba0-932a-f9416c52277d', 'name': '', 'network_id': '577a9fd0-5714-46c9-9810-f5765f640d13', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'mac_address': 'fa:16:3e:ee:12:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_interface', 'standard_attr_id': 3394, 'fixed_ips': [{'subnet_id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:25Z', 'updated_at': '2021-12-21T04:14:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'subnets': [{'id': '22a88d3d-7d29-49ff-8344-5d0ad387ea51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:21.403840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:19Z', 'revision_number': 3, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:21.439992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Checking router: 3c971aaa-fb08-42fd-a092-1641149d9de6 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:21.440763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Updating router 3c971aaa-fb08-42fd-a092-1641149d9de6 port c17c370f-f407-460c-94cb-a9d329ce8ca5 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:22:21.478630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.607225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.624008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42344) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:21.705926 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51663bbf-f61a-4e48-9ecd-0fe94e031c2e None None] New status for floating IP 7f236de8-d243-40db-b5f5-ceeeff3191d8: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:22:21.736396 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b305ac-a360-4f98-b2be-9ffb8d12deb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.775625 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b305ac-a360-4f98-b2be-9ffb8d12deb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.817887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.909122 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:21.942659 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Allocated IP 172.20.0.1 (eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd/ebe0e4be-6410-4124-aa1a-5df9e39edc4f/241f2399-2c47-4de4-818d-5e152df6b298) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:21.974976 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cec7be81-88d3-469f-be66-1bfec58da27b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:21.990456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Attempting to bind port c17c370f-f407-460c-94cb-a9d329ce8ca5 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:21.990850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Attempting to bind port c17c370f-f407-460c-94cb-a9d329ce8ca5 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:21.991319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Attempting to bind port c17c370f-f407-460c-94cb-a9d329ce8ca5 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:21.997286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9bebd4-1a57-4c53-88f0-b04541ce3cc4 None None] Pushing event updated for resources: {'Port': ['ID=c17c370f-f407-460c-94cb-a9d329ce8ca5,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:22.001964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 21, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:22.002355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:22.002769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.003209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:22.003693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Bound port: c17c370f-f407-460c-94cb-a9d329ce8ca5, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:22.004082 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.018284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b305ac-a360-4f98-b2be-9ffb8d12deb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.021010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-38b305ac-a360-4f98-b2be-9ffb8d12deb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.024731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38b305ac-a360-4f98-b2be-9ffb8d12deb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "DELETE /v2.0/security-groups/84c01d45-ee85-45e7-a98d-551b48af6e5f HTTP/1.1" status: 204 len: 168 time: 0.3970709 Dec 21 04:22:22.045588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42350) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:22.061871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b305ac-a360-4f98-b2be-9ffb8d12deb6 tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=84c01d45-ee85-45e7-a98d-551b48af6e5f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:22.070164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b664a331-512d-42b3-982c-c439f488b63f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:22.078066 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-b7bee130-adc6-4b50-8f24-a19b65e9714d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] show failed (client error): The resource could not be found. Dec 21 04:22:22.081851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b7bee130-adc6-4b50-8f24-a19b65e9714d tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "GET /v2.0/security-groups/84c01d45-ee85-45e7-a98d-551b48af6e5f HTTP/1.1" status: 404 len: 347 time: 0.0145051 Dec 21 04:22:22.082036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42352) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:22.097785 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.156677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0a0fc7d7-c7fe-47fa-8028-caf43aa9f807 None None] Provisioning complete for port c17c370f-f407-460c-94cb-a9d329ce8ca5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:22.157059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a0fc7d7-c7fe-47fa-8028-caf43aa9f807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.195576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] For port c17c370f-f407-460c-94cb-a9d329ce8ca5, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:22.219176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] For port c17c370f-f407-460c-94cb-a9d329ce8ca5, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c17c370f-f407-460c-94cb-a9d329ce8ca5,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:22.224432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0a0fc7d7-c7fe-47fa-8028-caf43aa9f807 None None] Port c17c370f-f407-460c-94cb-a9d329ce8ca5 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:22.226716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Deleting port 2ad4bc0b-7a57-4e6e-8845-ea8903c3069a {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:22.227242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.228581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b664a331-512d-42b3-982c-c439f488b63f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:22.228686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.241670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.297950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Pushing event updated for resources: {'Port': ['ID=241f2399-2c47-4de4-818d-5e152df6b298,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:22.302980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:22.304983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:22.306836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:22.319893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.350642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.351339 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.353700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.365072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Calling delete_port for 2ad4bc0b-7a57-4e6e-8845-ea8903c3069a owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:22.393958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53a94031-0880-4462-9ea6-06402586cd2e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:22.412701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Routers {'3c971aaa-fb08-42fd-a092-1641149d9de6'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:22.413351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:21:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c971aaa-fb08-42fd-a092-1641149d9de6'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:22.488242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9bebd4-1a57-4c53-88f0-b04541ce3cc4 None None] Pushing event updated for resources: {'Port': ['ID=c17c370f-f407-460c-94cb-a9d329ce8ca5,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:22.513324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eca2a837-6e05-4cc5-b04c-684630ea14e9 None None] Provisioning complete for port c17c370f-f407-460c-94cb-a9d329ce8ca5 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:22.513707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eca2a837-6e05-4cc5-b04c-684630ea14e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.605866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] Set router 3c971aaa-fb08-42fd-a092-1641149d9de6 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:22.616493 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.640640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.668704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Pushing event deleted for resources: {'Port': ['ID=2ad4bc0b-7a57-4e6e-8845-ea8903c3069a,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:22.727386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b731417-7cd0-485a-bd10-89bb41951715 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.737209 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.739892 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.741250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-902c383b-2e80-4149-9de5-a57ea310b63b tempest-AttachVolumeShelveTestJSON-1538086349 tempest-AttachVolumeShelveTestJSON-1538086349-project] 10.222.0.18 "DELETE /v2.0/floatingips/7f236de8-d243-40db-b5f5-ceeeff3191d8 HTTP/1.1" status: 204 len: 168 time: 0.6582191 Dec 21 04:22:22.783013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eca2a837-6e05-4cc5-b04c-684630ea14e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.818647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.823708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-eca2a837-6e05-4cc5-b04c-684630ea14e9 None None] For port c17c370f-f407-460c-94cb-a9d329ce8ca5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c17c370f-f407-460c-94cb-a9d329ce8ca5,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:22.849341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:19Z', 'revision_number': 3, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:22.880150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92202288-3393-40ae-866e-fa5b21dd85f4 None None] The sync data for ids ['3c971aaa-fb08-42fd-a092-1641149d9de6'] in n-d-822053-11 is: [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:19Z', 'revision_number': 3, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:22.886767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.915394 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eca2a837-6e05-4cc5-b04c-684630ea14e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.962736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Pushing event updated for resources: {'Port': ['ID=241f2399-2c47-4de4-818d-5e152df6b298,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:22.965192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:22.983636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eca2a837-6e05-4cc5-b04c-684630ea14e9 None None] Pushing event updated for resources: {'Port': ['ID=c17c370f-f407-460c-94cb-a9d329ce8ca5,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:23.062397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:23.062863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:23.072599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f68af69a-cf18-405b-98ff-279c83b02828 None None] Provisioning complete for port 241f2399-2c47-4de4-818d-5e152df6b298 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:23.072773 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f68af69a-cf18-405b-98ff-279c83b02828 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:23.114774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:23.116295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f68af69a-cf18-405b-98ff-279c83b02828 None None] Port 241f2399-2c47-4de4-818d-5e152df6b298 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:23.248874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Router 3c971aaa-fb08-42fd-a092-1641149d9de6 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:22:23.336151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:23.424709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:23.432975 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8461952-6dac-4615-9c14-cbd65ad6e3a8 admin admin] 10.222.0.18 "PUT /v2.0/routers/3c971aaa-fb08-42fd-a092-1641149d9de6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4128323 Dec 21 04:22:23.451406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-93f28a60-f4a9-456c-b3a5-6377b383fa3e None None] Provisioning complete for port 241f2399-2c47-4de4-818d-5e152df6b298 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:23.451900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-93f28a60-f4a9-456c-b3a5-6377b383fa3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:23.701557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:23.734980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: d0bb881d-37f6-4b67-a89c-a6c72e23dd9a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:23.735416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device d0bb881d-37f6-4b67-a89c-a6c72e23dd9a not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:23.743300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-93f28a60-f4a9-456c-b3a5-6377b383fa3e None None] Port 241f2399-2c47-4de4-818d-5e152df6b298 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:24.044023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c17c370f-f407-460c-94cb-a9d329ce8ca5 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:24.096149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c17c370f-f407-460c-94cb-a9d329ce8ca5 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:24.096668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.306280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42380) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:24.311660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Request body: {'network': {'name': 'tempest-TestServerMultinode-1079210572-network', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:24.416351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Made reservation on behalf of 3693cbd2a0364ba0897de8f176815a28 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:22:24.419792 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.428667 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.510080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.581920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.610346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:22:24.622852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d7493d2-2e5b-4d69-b58b-8950b254ad66,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:24.628764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.629456 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Added segment 20bbb1e8-cb3f-4128-a47c-a23eed338223 of type vlan for network 8162401b-985d-47b5-98a2-49e7295bcdb9 Dec 21 04:22:24.691154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.772323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.773355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:24.773944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:24.846799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] Pushing event updated for resources: {'Network': ['ID=8162401b-985d-47b5-98a2-49e7295bcdb9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:24.860979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:22:24.884051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6ec74518-ef34-4462-bee6-57e707c92e9d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.5764179 Dec 21 04:22:24.887106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42384) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:24.902829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Request body: {'subnet': {'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerMultinode-1079210572-subnet', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:25.034136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Made reservation on behalf of 3693cbd2a0364ba0897de8f176815a28 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:22:25.036546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.064174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.091942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Sync routers for ids ['3c971aaa-fb08-42fd-a092-1641149d9de6'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:25.108939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Routers {'3c971aaa-fb08-42fd-a092-1641149d9de6'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:25.109656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c971aaa-fb08-42fd-a092-1641149d9de6'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:25.150086 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.253218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Set router 3c971aaa-fb08-42fd-a092-1641149d9de6 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:25.299154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.366269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=72b6a657-162f-4a4b-85a8-f101720cb228,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:25.375871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Checking segment: {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:25.376241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Network hostable DHCP agents. Network: 8162401b-985d-47b5-98a2-49e7295bcdb9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:22:25.477010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '241f2399-2c47-4de4-818d-5e152df6b298', 'name': '', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'mac_address': 'fa:16:3e:95:81:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 3744, 'fixed_ips': [{'subnet_id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:21Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 2, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'subnets': [{'id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:25.504189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Checking router: 3c971aaa-fb08-42fd-a092-1641149d9de6 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:25.504476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Updating router 3c971aaa-fb08-42fd-a092-1641149d9de6 port 241f2399-2c47-4de4-818d-5e152df6b298 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:22:25.530313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:22:25.534787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.651959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8162401b-985d-47b5-98a2-49e7295bcdb9) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:25.656495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:25.657085 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.661999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd1469ed-25af-4216-884f-3afc212121c5 None None] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:22:25.740518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8eacb742-e2f6-4253-8d26-4cff9b2cd1b5 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8521183 Dec 21 04:22:25.743003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42390) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:25.747336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Request body: {'router': {'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:25.844366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.849818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-8162401b-985d-47b5-98a2-49e7295bcdb9', 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9', 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'fixed_ips': [{'subnet_id': '72b6a657-162f-4a4b-85a8-f101720cb228'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:22:25.852490 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.867788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.868905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.922512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:25.982618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.032603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Allocated IP 172.20.0.2 (8162401b-985d-47b5-98a2-49e7295bcdb9/72b6a657-162f-4a4b-85a8-f101720cb228/145f098b-2b64-45bd-8b26-d862f5337913) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:26.060680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.142470 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.154039 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c189ac6-aea3-419c-b11c-13a27b90461f None None] Pushing event updated for resources: {'Port': ['ID=241f2399-2c47-4de4-818d-5e152df6b298,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:26.252964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Attempting to bind port 241f2399-2c47-4de4-818d-5e152df6b298 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:26.253353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Attempting to bind port 241f2399-2c47-4de4-818d-5e152df6b298 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:26.256618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Attempting to bind port 241f2399-2c47-4de4-818d-5e152df6b298 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:26.273966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:26.274353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Checking segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:26.274768 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.275204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Bound using segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:26.275685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Bound port: 241f2399-2c47-4de4-818d-5e152df6b298, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:26.276069 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.299583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.397946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.475515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] For port 241f2399-2c47-4de4-818d-5e152df6b298, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:26.481058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] For port 241f2399-2c47-4de4-818d-5e152df6b298, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=241f2399-2c47-4de4-818d-5e152df6b298,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:26.497563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:26.510296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:26.517282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:26.523431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Pushing event updated for resources: {'Port': ['ID=145f098b-2b64-45bd-8b26-d862f5337913,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:26.532262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.548929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4b5eec1c-c5c2-4249-9eef-5b9d55fe97bb None None] Provisioning complete for port 241f2399-2c47-4de4-818d-5e152df6b298 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:26.549221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b5eec1c-c5c2-4249-9eef-5b9d55fe97bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.569458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.605763 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.709612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c189ac6-aea3-419c-b11c-13a27b90461f None None] Pushing event updated for resources: {'Port': ['ID=241f2399-2c47-4de4-818d-5e152df6b298,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:26.714034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4b5eec1c-c5c2-4249-9eef-5b9d55fe97bb None None] Port 241f2399-2c47-4de4-818d-5e152df6b298 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:26.721790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Attempting to bind port 145f098b-2b64-45bd-8b26-d862f5337913 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:26.722248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Attempting to bind port 145f098b-2b64-45bd-8b26-d862f5337913 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:26.722684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Attempting to bind port 145f098b-2b64-45bd-8b26-d862f5337913 on network 8162401b-985d-47b5-98a2-49e7295bcdb9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:26.731683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:26.731683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Checking segment: {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:26.732221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.732701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Bound using segment: {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:26.733775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Bound port: 145f098b-2b64-45bd-8b26-d862f5337913, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:26.735225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:26.759176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Routers {'3c971aaa-fb08-42fd-a092-1641149d9de6'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:26.759831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c971aaa-fb08-42fd-a092-1641149d9de6'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:26.768069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Allocated IP 172.25.5.73 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/015874db-1a79-4a2f-b883-e5fc957f7020) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:26.920093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.003481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] For port 145f098b-2b64-45bd-8b26-d862f5337913, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:27.036513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] For port 145f098b-2b64-45bd-8b26-d862f5337913, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=145f098b-2b64-45bd-8b26-d862f5337913,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:27.053603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] Set router 3c971aaa-fb08-42fd-a092-1641149d9de6 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:27.062474 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.109919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:27.115501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:27.134133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:27.175596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Pushing event updated for resources: {'Port': ['ID=015874db-1a79-4a2f-b883-e5fc957f7020,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:27.308970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d7b57ce-00c6-4d67-a7d3-079dfab5c22d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:27.320753 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.454344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c9dbc911-c825-4db8-97b8-4483d07a6662 None None] Provisioning complete for port 241f2399-2c47-4de4-818d-5e152df6b298 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:27.454823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c9dbc911-c825-4db8-97b8-4483d07a6662 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.505055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02c50a2a-5ce9-4c4b-b844-a4b7f54d56c2 None None] Pushing event updated for resources: {'Port': ['ID=145f098b-2b64-45bd-8b26-d862f5337913,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:27.562272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.807369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c9dbc911-c825-4db8-97b8-4483d07a6662 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.878779 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:27.882535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c9dbc911-c825-4db8-97b8-4483d07a6662 None None] For port 241f2399-2c47-4de4-818d-5e152df6b298, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=241f2399-2c47-4de4-818d-5e152df6b298,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:27.897082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '241f2399-2c47-4de4-818d-5e152df6b298', 'name': '', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'mac_address': 'fa:16:3e:95:81:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 3744, 'fixed_ips': [{'subnet_id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:21Z', 'updated_at': '2021-12-21T04:22:26Z', 'revision_number': 4, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'subnets': [{'id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:27.929071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa30ed38-1c39-4135-bb49-35f22e3ec9b5 None None] The sync data for ids ['3c971aaa-fb08-42fd-a092-1641149d9de6'] in n-d-822053-11 is: [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '241f2399-2c47-4de4-818d-5e152df6b298', 'name': '', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'mac_address': 'fa:16:3e:95:81:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_interface', 'standard_attr_id': 3744, 'fixed_ips': [{'subnet_id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:21Z', 'updated_at': '2021-12-21T04:22:26Z', 'revision_number': 4, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'subnets': [{'id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:27.972840 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c9dbc911-c825-4db8-97b8-4483d07a6662 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:28.150341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 145f098b-2b64-45bd-8b26-d862f5337913 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:28.150341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e5718848-0043-4a56-a2b2-d107f296a377 None None] Provisioning complete for port 015874db-1a79-4a2f-b883-e5fc957f7020 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:28.150341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e5718848-0043-4a56-a2b2-d107f296a377 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:28.166306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9dbc911-c825-4db8-97b8-4483d07a6662 None None] Pushing event updated for resources: {'Port': ['ID=241f2399-2c47-4de4-818d-5e152df6b298,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:28.218088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Router 6f37793a-d264-49ca-9da9-5aa44999bff8 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:22:28.232524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e5718848-0043-4a56-a2b2-d107f296a377 None None] Port 015874db-1a79-4a2f-b883-e5fc957f7020 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:28.239824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 145f098b-2b64-45bd-8b26-d862f5337913 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:28.240204 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:28.397749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:28.402864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:28.425507 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Sync routers for ids ['6f37793a-d264-49ca-9da9-5aa44999bff8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:28.453623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Routers {'6f37793a-d264-49ca-9da9-5aa44999bff8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:28.453623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6f37793a-d264-49ca-9da9-5aa44999bff8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:28.461755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 145f098b-2b64-45bd-8b26-d862f5337913, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=145f098b-2b64-45bd-8b26-d862f5337913,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:28.540900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:28.542644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-983d72f9-5728-4516-bdb5-5a3097c1b91f admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.7985489 Dec 21 04:22:28.545311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42416) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:28.549736 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:28.655389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=145f098b-2b64-45bd-8b26-d862f5337913,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:28.672594 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Set router 6f37793a-d264-49ca-9da9-5aa44999bff8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:28.891382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1d1a8d8-2148-4c08-b511-9d82ba92e6cd None None] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:22:28.996913 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:22:27Z', 'revision_number': 3, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:29.035966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-46742247-99c1-4136-87ae-bd29e34b8f39 None None] Provisioning complete for port 145f098b-2b64-45bd-8b26-d862f5337913 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:29.036348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46742247-99c1-4136-87ae-bd29e34b8f39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.054116 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Checking router: 6f37793a-d264-49ca-9da9-5aa44999bff8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:29.059586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Updating router 6f37793a-d264-49ca-9da9-5aa44999bff8 port 015874db-1a79-4a2f-b883-e5fc957f7020 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:22:29.137178 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.370501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.523469 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.553577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1604fb11-92ef-462e-b1ce-bb8114ae4571 None None] Provisioning complete for port 145f098b-2b64-45bd-8b26-d862f5337913 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:29.560358 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1604fb11-92ef-462e-b1ce-bb8114ae4571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.582289 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.699849 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Pushing event updated for resources: {'Port': ['ID=015874db-1a79-4a2f-b883-e5fc957f7020,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:29.728211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.728702 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.729741 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.730341 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.730791 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.731256 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.731826 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.732285 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.732721 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.733151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.733582 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.734011 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.734531 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:29.759582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-491f2fb8-b326-40d3-aa32-a4c03d17627b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:29.777577 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Attempting to bind port 015874db-1a79-4a2f-b883-e5fc957f7020 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:29.778015 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Attempting to bind port 015874db-1a79-4a2f-b883-e5fc957f7020 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:29.780168 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Attempting to bind port 015874db-1a79-4a2f-b883-e5fc957f7020 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:29.787465 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:29.788023 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:29.788529 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.789024 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:29.789606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Bound port: 015874db-1a79-4a2f-b883-e5fc957f7020, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:29.790273 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.842503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-386f86ff-140e-492a-b2da-41c680f793e6 None None] Provisioning complete for port 015874db-1a79-4a2f-b883-e5fc957f7020 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:29.843274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-386f86ff-140e-492a-b2da-41c680f793e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:29.888129 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] For port 015874db-1a79-4a2f-b883-e5fc957f7020, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:29.892415 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] For port 015874db-1a79-4a2f-b883-e5fc957f7020, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=015874db-1a79-4a2f-b883-e5fc957f7020,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:29.925970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-386f86ff-140e-492a-b2da-41c680f793e6 None None] Port 015874db-1a79-4a2f-b883-e5fc957f7020 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:29.962018 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.043354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3651ff3e-4851-4033-aff3-ccc5df4b4f87 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:30.053891 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Routers {'6f37793a-d264-49ca-9da9-5aa44999bff8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:30.057307 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6f37793a-d264-49ca-9da9-5aa44999bff8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:30.104325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Allocated IP 172.20.0.1 (8162401b-985d-47b5-98a2-49e7295bcdb9/72b6a657-162f-4a4b-85a8-f101720cb228/b11fb225-c024-4c12-b38e-3449e750781f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:30.251062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.255854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 241f2399-2c47-4de4-818d-5e152df6b298 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:30.333511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a995819b-0f9b-49d4-85d1-1c666f4394ee None None] Pushing event updated for resources: {'Port': ['ID=015874db-1a79-4a2f-b883-e5fc957f7020,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:30.340098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-05ebcc94-cf28-44df-83ca-cf7661d6dc5e None None] Provisioning complete for port 015874db-1a79-4a2f-b883-e5fc957f7020 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:30.340744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05ebcc94-cf28-44df-83ca-cf7661d6dc5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.344273 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.359342 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] Set router 6f37793a-d264-49ca-9da9-5aa44999bff8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:30.439761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:30.447227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:30.463868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 241f2399-2c47-4de4-818d-5e152df6b298 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:30.464251 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.476765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:30.504926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Pushing event updated for resources: {'Port': ['ID=b11fb225-c024-4c12-b38e-3449e750781f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:30.595230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.696201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05ebcc94-cf28-44df-83ca-cf7661d6dc5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.764722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 145f098b-2b64-45bd-8b26-d862f5337913 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:30.815916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-05ebcc94-cf28-44df-83ca-cf7661d6dc5e None None] For port 015874db-1a79-4a2f-b883-e5fc957f7020, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=015874db-1a79-4a2f-b883-e5fc957f7020,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:30.819624 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:22:27Z', 'revision_number': 3, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:30.842850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 145f098b-2b64-45bd-8b26-d862f5337913 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:30.843261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.858019 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06cd9ce8-5635-4e28-b5fb-b1b7c0792fb5 None None] The sync data for ids ['6f37793a-d264-49ca-9da9-5aa44999bff8'] in n-d-822053-11 is: [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:22:27Z', 'revision_number': 3, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:30.879063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05ebcc94-cf28-44df-83ca-cf7661d6dc5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.881151 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:30.970483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05ebcc94-cf28-44df-83ca-cf7661d6dc5e None None] Pushing event updated for resources: {'Port': ['ID=015874db-1a79-4a2f-b883-e5fc957f7020,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:31.043297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ee1f1f4f-eb9c-472f-a550-359a825b135d None None] Provisioning complete for port b11fb225-c024-4c12-b38e-3449e750781f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:31.043910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ee1f1f4f-eb9c-472f-a550-359a825b135d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:31.093042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ee1f1f4f-eb9c-472f-a550-359a825b135d None None] Port b11fb225-c024-4c12-b38e-3449e750781f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:31.130818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:31.233424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:31.319241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:31.321104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Pushing event updated for resources: {'Port': ['ID=b11fb225-c024-4c12-b38e-3449e750781f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:31.460440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:31.462456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:31.591405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Router 6f37793a-d264-49ca-9da9-5aa44999bff8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:22:31.759355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:31.773740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-385481e1-1dd6-410a-80f9-8e0254a2254b admin admin] 10.222.0.18 "PUT /v2.0/routers/6f37793a-d264-49ca-9da9-5aa44999bff8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2270985 Dec 21 04:22:31.825013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-deb954e8-3dd3-4463-8d4b-083329bb16ff None None] Provisioning complete for port b11fb225-c024-4c12-b38e-3449e750781f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:31.825622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-deb954e8-3dd3-4463-8d4b-083329bb16ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:31.883508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-deb954e8-3dd3-4463-8d4b-083329bb16ff None None] Port b11fb225-c024-4c12-b38e-3449e750781f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:32.050254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 015874db-1a79-4a2f-b883-e5fc957f7020 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:32.161461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 015874db-1a79-4a2f-b883-e5fc957f7020 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:32.162101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:32.489756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce28f419-f976-4e7f-8d39-18d17d424968 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:32.489756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce28f419-f976-4e7f-8d39-18d17d424968 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/networks?id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd HTTP/1.1" status: 200 len: 911 time: 0.1321602 Dec 21 04:22:32.507197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-5413ae73-fe54-411d-9f10-608d7fbcc3dc tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/quotas/3693cbd2a0364ba0897de8f176815a28 HTTP/1.1" status: 200 len: 375 time: 0.0166147 Dec 21 04:22:32.561435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:32.589306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ccfbc06d-7461-4c76-913c-a484518679c3 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?tenant_id=3693cbd2a0364ba0897de8f176815a28&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0812123 Dec 21 04:22:32.738667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-d0d233ea-2300-44db-bd06-6802bce7916d service neutron] 10.222.0.18 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1390328 Dec 21 04:22:32.891451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-64a83a8b-1b57-4191-8dae-e03876735627 service neutron] 10.222.0.18 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1510501 Dec 21 04:22:33.154783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Sync routers for ids ['6f37793a-d264-49ca-9da9-5aa44999bff8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:33.182645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Routers {'6f37793a-d264-49ca-9da9-5aa44999bff8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:33.183864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6f37793a-d264-49ca-9da9-5aa44999bff8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:33.210510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b09485f2-2901-4f74-bf62-dfd184df6cc9 req-5fe69c03-e783-4725-92ab-f637924d021a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 210 time: 0.0467768 Dec 21 04:22:33.308476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:33.520741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Set router 6f37793a-d264-49ca-9da9-5aa44999bff8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:33.609983 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Deleting port 77c72788-b001-4ba0-932a-f9416c52277d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:33.610999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:33.701369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] For port 77c72788-b001-4ba0-932a-f9416c52277d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=77c72788-b001-4ba0-932a-f9416c52277d,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:33.702041 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:33.716382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Calling delete_port for 77c72788-b001-4ba0-932a-f9416c52277d owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:33.732821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b11fb225-c024-4c12-b38e-3449e750781f', 'name': '', 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'mac_address': 'fa:16:3e:90:5c:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3756, 'fixed_ips': [{'subnet_id': '72b6a657-162f-4a4b-85a8-f101720cb228', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:29Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 2, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'subnets': [{'id': '72b6a657-162f-4a4b-85a8-f101720cb228', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:33.760505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Checking router: 6f37793a-d264-49ca-9da9-5aa44999bff8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:33.760878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Updating router 6f37793a-d264-49ca-9da9-5aa44999bff8 port b11fb225-c024-4c12-b38e-3449e750781f binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:22:33.790076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:33.972763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.001900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Pushing event deleted for resources: {'Port': ['ID=77c72788-b001-4ba0-932a-f9416c52277d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:34.086955 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.144158 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.342868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc443e80-f501-4c40-afe0-3234ce876a88 req-eb8a0dc7-5a96-40b4-8a3d-5d7dc5227545 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 210 time: 0.0651057 Dec 21 04:22:34.343387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb958c10-f2e2-4ba1-ad91-4f2e0ac548f9 None None] Pushing event updated for resources: {'Port': ['ID=b11fb225-c024-4c12-b38e-3449e750781f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:34.352004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Attempting to bind port b11fb225-c024-4c12-b38e-3449e750781f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:34.352383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Attempting to bind port b11fb225-c024-4c12-b38e-3449e750781f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:34.352754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Attempting to bind port b11fb225-c024-4c12-b38e-3449e750781f on network 8162401b-985d-47b5-98a2-49e7295bcdb9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:34.359888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:34.365621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Checking segment: {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:34.365621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.365621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Bound using segment: {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:34.365621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Bound port: b11fb225-c024-4c12-b38e-3449e750781f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '20bbb1e8-cb3f-4128-a47c-a23eed338223', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:34.365621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.436487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] For port b11fb225-c024-4c12-b38e-3449e750781f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:34.440429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] For port b11fb225-c024-4c12-b38e-3449e750781f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b11fb225-c024-4c12-b38e-3449e750781f,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:34.529291 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.540529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9eafdd5c-1209-4a01-92f6-b6080e66c56b None None] Provisioning complete for port b11fb225-c024-4c12-b38e-3449e750781f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:34.540529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9eafdd5c-1209-4a01-92f6-b6080e66c56b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.606322 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.649941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb958c10-f2e2-4ba1-ad91-4f2e0ac548f9 None None] Pushing event updated for resources: {'Port': ['ID=b11fb225-c024-4c12-b38e-3449e750781f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:34.654155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Routers {'6f37793a-d264-49ca-9da9-5aa44999bff8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:34.654669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6f37793a-d264-49ca-9da9-5aa44999bff8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:34.793698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9eafdd5c-1209-4a01-92f6-b6080e66c56b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:34.822422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] Set router 6f37793a-d264-49ca-9da9-5aa44999bff8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:34.874616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9eafdd5c-1209-4a01-92f6-b6080e66c56b None None] For port b11fb225-c024-4c12-b38e-3449e750781f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b11fb225-c024-4c12-b38e-3449e750781f,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:34.889821 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:22:34.904546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Router 57387dcb-f3c3-4046-bfde-40c9e2370917 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:22:34.975542 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9eafdd5c-1209-4a01-92f6-b6080e66c56b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.028780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:22:35.034981 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61d05b91-41da-4c56-bc14-c00b466d2a1d admin admin] 10.222.0.18 "PUT /v2.0/routers/57387dcb-f3c3-4046-bfde-40c9e2370917/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4716172 Dec 21 04:22:35.037629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:35.039524 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] Sync routers for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:22:35.049192 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:35.050151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:35.065545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eafdd5c-1209-4a01-92f6-b6080e66c56b None None] Pushing event updated for resources: {'Port': ['ID=b11fb225-c024-4c12-b38e-3449e750781f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:35.126415 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cd9c55a2-fd8b-42cd-9061-0cc373859d93 None None] Provisioning complete for port b11fb225-c024-4c12-b38e-3449e750781f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:35.127333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd9c55a2-fd8b-42cd-9061-0cc373859d93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.182259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b11fb225-c024-4c12-b38e-3449e750781f', 'name': '', 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'mac_address': 'fa:16:3e:90:5c:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3756, 'fixed_ips': [{'subnet_id': '72b6a657-162f-4a4b-85a8-f101720cb228', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:29Z', 'updated_at': '2021-12-21T04:22:34Z', 'revision_number': 4, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'subnets': [{'id': '72b6a657-162f-4a4b-85a8-f101720cb228', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:35.200539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.217019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dde5b1c7-532f-4f1f-9595-22a9d5124e78 None None] The sync data for ids ['6f37793a-d264-49ca-9da9-5aa44999bff8'] in n-d-822053-11 is: [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'b11fb225-c024-4c12-b38e-3449e750781f', 'name': '', 'network_id': '8162401b-985d-47b5-98a2-49e7295bcdb9', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'mac_address': 'fa:16:3e:90:5c:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3756, 'fixed_ips': [{'subnet_id': '72b6a657-162f-4a4b-85a8-f101720cb228', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:29Z', 'updated_at': '2021-12-21T04:22:34Z', 'revision_number': 4, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'subnets': [{'id': '72b6a657-162f-4a4b-85a8-f101720cb228', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:35.220951 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:35.230894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb87266-834b-4cb8-bc98-356ba6e4a77b req-59172cb9-242d-49f2-8937-5ab05c0aef5b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:35.232699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fb87266-834b-4cb8-bc98-356ba6e4a77b req-59172cb9-242d-49f2-8937-5ab05c0aef5b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 945 time: 0.0904706 Dec 21 04:22:35.331297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2fb87266-834b-4cb8-bc98-356ba6e4a77b req-a96749ea-a480-4ca4-a95d-4c59547300a0 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900295 Dec 21 04:22:35.392234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.444584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60188236-afbd-47d1-a124-287e066895b1 req-65afe3e3-c59e-4bd2-bd73-b49f456dfefd tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 210 time: 0.0275419 Dec 21 04:22:35.483092 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41'}], 'enable_snat': True}, 'gw_port_id': '41426124-77c3-42ec-9d47-d2e897909bee', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:22:33Z', 'revision_number': 5, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port': {'id': '41426124-77c3-42ec-9d47-d2e897909bee', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b4:7b:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3390, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:14:22Z', 'updated_at': '2021-12-21T04:14:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:35.512405 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] Checking router: 57387dcb-f3c3-4046-bfde-40c9e2370917 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:22:35.522803 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] Routers {'57387dcb-f3c3-4046-bfde-40c9e2370917'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:22:35.523455 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['57387dcb-f3c3-4046-bfde-40c9e2370917'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:35.525439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Deleting port 41426124-77c3-42ec-9d47-d2e897909bee {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:35.525853 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.612383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] For port 41426124-77c3-42ec-9d47-d2e897909bee, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=41426124-77c3-42ec-9d47-d2e897909bee,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:35.612881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.627020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Calling delete_port for 41426124-77c3-42ec-9d47-d2e897909bee owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:35.628094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] Set router 57387dcb-f3c3-4046-bfde-40c9e2370917 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:22:35.688009 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:22:35Z', 'revision_number': 6, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:35.715186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-487f8164-187c-4d55-bc5b-662305afb193 None None] The sync data for ids ['57387dcb-f3c3-4046-bfde-40c9e2370917'] in n-d-822053-11 is: [{'id': '57387dcb-f3c3-4046-bfde-40c9e2370917', 'name': 'tempest-AttachVolumeShelveTestJSON-1456773622-router', 'tenant_id': 'f201aa828d124b4d96ae1f68f53fe955', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:14:21Z', 'updated_at': '2021-12-21T04:22:35Z', 'revision_number': 6, 'project_id': 'f201aa828d124b4d96ae1f68f53fe955', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:22:35.900668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-98bbbb1d-cb6b-4a97-8864-0de67605086b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:35.902412 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-98bbbb1d-cb6b-4a97-8864-0de67605086b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.54 "GET /v2.0/networks?id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd HTTP/1.1" status: 200 len: 911 time: 0.1062043 Dec 21 04:22:35.915658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Request body: {'port': {'device_id': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'admin_state_up': True, 'tenant_id': '3693cbd2a0364ba0897de8f176815a28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:35.959448 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:35.986676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Pushing event deleted for resources: {'Port': ['ID=41426124-77c3-42ec-9d47-d2e897909bee,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:36.002293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a047914d-923b-4562-a48e-5af3ab5477c0 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:36.050781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.053445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Made reservation on behalf of 3693cbd2a0364ba0897de8f176815a28 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:22:36.056552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.178918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.183739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.321407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Allocated IP 172.20.0.3 (eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd/ebe0e4be-6410-4124-aa1a-5df9e39edc4f/51503d8d-4587-495a-a6cd-b24fd1eae0d2) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:36.342285 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.342285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 57387dcb-f3c3-4046-bfde-40c9e2370917 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:22:36.343183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.344382 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7080b75b-c84e-439b-b0f6-9631458ffde9 admin admin] 10.222.0.18 "DELETE /v2.0/routers/57387dcb-f3c3-4046-bfde-40c9e2370917 HTTP/1.1" status: 204 len: 168 time: 1.3056159 Dec 21 04:22:36.347403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:36.401115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Deleting subnet 22a88d3d-7d29-49ff-8344-5d0ad387ea51 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:22:36.404858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.452692 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.502919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.546564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b11fb225-c024-4c12-b38e-3449e750781f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:36.567890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-982bd91c-57c9-4e4f-bcd0-f6fc173fb614 req-9cdf1643-e8ed-4ff6-a1dd-cea814c2a6ff tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 210 time: 0.0374870 Dec 21 04:22:36.608058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.620657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b11fb225-c024-4c12-b38e-3449e750781f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:36.621024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.642775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.679268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689f21bd-7a4c-4bc1-801f-607216ecc10a req-55e16e14-49a4-4c11-95f3-8778b1c96065 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:36.681633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-689f21bd-7a4c-4bc1-801f-607216ecc10a req-55e16e14-49a4-4c11-95f3-8778b1c96065 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 945 time: 0.2551653 Dec 21 04:22:36.708386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:36.711664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:36.714118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:36.743822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Pushing event updated for resources: {'Port': ['ID=51503d8d-4587-495a-a6cd-b24fd1eae0d2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:36.763538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-689f21bd-7a4c-4bc1-801f-607216ecc10a req-556db5d4-8dc1-4d90-aa1c-d256c8f8b19c tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/security-groups?id=af3c5167-9211-4bab-a993-0ca82cb73c62&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737300 Dec 21 04:22:36.766334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:36.767279 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.813444 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.813735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 77c72788-b001-4ba0-932a-f9416c52277d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:36.849434 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-25548ab4-b7f8-4ac0-9a22-1c768eb212b8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 0.9376183 Dec 21 04:22:36.851507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 77c72788-b001-4ba0-932a-f9416c52277d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:36.855418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=22a88d3d-7d29-49ff-8344-5d0ad387ea51,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:36.855774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 77c72788-b001-4ba0-932a-f9416c52277d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:36.862189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.866598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d387fb09-13b9-4d8e-8c81-b3afc572db19 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/22a88d3d-7d29-49ff-8344-5d0ad387ea51 HTTP/1.1" status: 204 len: 168 time: 0.5181692 Dec 21 04:22:36.869620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42494) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:36.872135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d06f5a7d-4726-4b4a-a392-590cdc798237 None None] Network 577a9fd0-5714-46c9-9810-f5765f640d13 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:22:36.873499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Request body: {'port': {'device_id': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:36.972900 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:36.982817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.046688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Deleting port b6a03316-05dc-428a-82da-5ebed305229c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:37.047082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.056654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-01803faa-c080-497d-94d4-14051c34b1ec tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:37.058164 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-01803faa-c080-497d-94d4-14051c34b1ec tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 945 time: 0.1015968 Dec 21 04:22:37.069387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a42a0391-f123-4899-a409-e54dbe0e23e4 None None] Provisioning complete for port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:37.069890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a42a0391-f123-4899-a409-e54dbe0e23e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.115183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] DHCP port deletion for 577a9fd0-5714-46c9-9810-f5765f640d13 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:22:37.127890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] For port b6a03316-05dc-428a-82da-5ebed305229c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6a03316-05dc-428a-82da-5ebed305229c,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:37.128336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.142484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Calling delete_port for b6a03316-05dc-428a-82da-5ebed305229c owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:37.152303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a42a0391-f123-4899-a409-e54dbe0e23e4 None None] Port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:37.179544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] Deleting port b6a03316-05dc-428a-82da-5ebed305229c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:37.180175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.248208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] For port b6a03316-05dc-428a-82da-5ebed305229c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b6a03316-05dc-428a-82da-5ebed305229c,segment=NetworkSegment(4e8ee42e-c970-4cdd-8f8d-9faefa309132),segment_id=4e8ee42e-c970-4cdd-8f8d-9faefa309132)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:37.248665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.261669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] Calling delete_port for b6a03316-05dc-428a-82da-5ebed305229c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:37.293822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Deleting port 00ec8d4b-c528-4b42-ba89-2725fead46df {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:22:37.294176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.296274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.338244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Pushing event deleted for resources: {'Port': ['ID=b6a03316-05dc-428a-82da-5ebed305229c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:37.342427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] No DVR routers for this DVR port b6a03316-05dc-428a-82da-5ebed305229c on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:22:37.350528 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.386763 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] Pushing event deleted for resources: {'Port': ['ID=b6a03316-05dc-428a-82da-5ebed305229c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:37.389246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e722c3ce-fff9-4d92-a7ae-3b1e0f385151 None None] No DVR routers for this DVR port b6a03316-05dc-428a-82da-5ebed305229c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:22:37.433176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.454666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['577a9fd0-5714-46c9-9810-f5765f640d13']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:37.465499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] For port 00ec8d4b-c528-4b42-ba89-2725fead46df, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=00ec8d4b-c528-4b42-ba89-2725fead46df,segment=NetworkSegment(412aa278-1368-4813-a350-dccd36d53daf),segment_id=412aa278-1368-4813-a350-dccd36d53daf)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:37.465499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.467432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4e8ee42e-c970-4cdd-8f8d-9faefa309132') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:37.467432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4e8ee42e-c970-4cdd-8f8d-9faefa309132') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:22:37.473376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 51503d8d-4587-495a-a6cd-b24fd1eae0d2 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:22:37.474439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.484899 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.487219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Calling delete_port for 00ec8d4b-c528-4b42-ba89-2725fead46df owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:22:37.487551 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.494030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Releasing vlan 106 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:22:37.495932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:22:37.496300 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:22:37.624011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.640942 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.644096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] 10.222.0.18 "DELETE /v2.0/networks/577a9fd0-5714-46c9-9810-f5765f640d13 HTTP/1.1" status: 204 len: 168 time: 0.7733076 Dec 21 04:22:37.646537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eddec2f-2cc8-4764-9d9d-b94d5713b942 admin admin] Pushing event deleted for resources: {'Network': ['ID=577a9fd0-5714-46c9-9810-f5765f640d13,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:37.687098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Transition to ACTIVE for port object 51503d8d-4587-495a-a6cd-b24fd1eae0d2 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:22:37.691185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.691357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a45dcbe-0e05-4b25-8c57-4af58a805fc6 req-a75fd6b3-9293-4e33-9b7f-809b9f3459ac tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:37.692672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a45dcbe-0e05-4b25-8c57-4af58a805fc6 req-a75fd6b3-9293-4e33-9b7f-809b9f3459ac tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1027 time: 0.0472782 Dec 21 04:22:37.721251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['00ec8d4b-c528-4b42-ba89-2725fead46df'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:22:37.722372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Pushing event deleted for resources: {'Port': ['ID=00ec8d4b-c528-4b42-ba89-2725fead46df,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:37.741863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a45dcbe-0e05-4b25-8c57-4af58a805fc6 req-935b8eea-30e2-4ebb-8107-cad428b50a0e tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421693 Dec 21 04:22:37.766794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] No DVR routers for this DVR port 00ec8d4b-c528-4b42-ba89-2725fead46df on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:22:37.768496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.775570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:37.775570 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.54 "DELETE /v2.0/ports/00ec8d4b-c528-4b42-ba89-2725fead46df HTTP/1.1" status: 204 len: 173 time: 0.7044706 Dec 21 04:22:37.776015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'name': 'network-vif-deleted', 'tag': '00ec8d4b-c528-4b42-ba89-2725fead46df'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:37.778293 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abc39087-b67b-45c3-b287-971445bc4324" -d '{"events": [{"server_uuid": "9b0d6002-95a2-4790-9020-b7a90499f7fe", "name": "network-vif-deleted", "tag": "00ec8d4b-c528-4b42-ba89-2725fead46df"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:37.866070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Pushing event updated for resources: {'Port': ['ID=51503d8d-4587-495a-a6cd-b24fd1eae0d2,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:37.895865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e75a4a6-b5de-473b-a9b0-8336bfe95741 req-43777ddd-ca7c-4b8e-be03-9698f43b9de6 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 210 time: 0.0419328 Dec 21 04:22:37.958577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Attempting to bind port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:37.963994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Attempting to bind port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:37.963994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Attempting to bind port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:37.965532 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b1294db9-2047-464c-8eaa-a8e39c808e9a x-openstack-request-id: req-b1294db9-2047-464c-8eaa-a8e39c808e9a {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:37.965863 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9b0d6002-95a2-4790-9020-b7a90499f7fe", "name": "network-vif-deleted", "tag": "00ec8d4b-c528-4b42-ba89-2725fead46df", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:37.966654 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b1294db9-2047-464c-8eaa-a8e39c808e9a {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:37.967102 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b0d6002-95a2-4790-9020-b7a90499f7fe', 'name': 'network-vif-deleted', 'tag': '00ec8d4b-c528-4b42-ba89-2725fead46df', 'status': 'completed', 'code': 200} Dec 21 04:22:37.967808 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:22:37.968166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Attempting to bind port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:37.980087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 22, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:37.980683 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Checking segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:37.980996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Bound using segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:37.981286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Bound port: 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:37.981626 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.025264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 41426124-77c3-42ec-9d47-d2e897909bee no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:38.046254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42506) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:38.050914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 41426124-77c3-42ec-9d47-d2e897909bee {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:38.052120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 41426124-77c3-42ec-9d47-d2e897909bee not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:38.052781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b6a03316-05dc-428a-82da-5ebed305229c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:38.075655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b6a03316-05dc-428a-82da-5ebed305229c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:38.076784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b6a03316-05dc-428a-82da-5ebed305229c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:38.094963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] For port 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:38.100449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6c0b0dc9-3ca1-48e5-8a2b-aa275201362f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f201aa828d124b4d96ae1f68f53fe955&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0506229 Dec 21 04:22:38.100664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] For port 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:38.100870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:38.154196 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a369a51e-24c0-4899-a376-29b6e48c2ae4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.189790 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.198625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a369a51e-24c0-4899-a376-29b6e48c2ae4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.245031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:38.255658 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.255658 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] 10.222.0.54 "PUT /v2.0/ports/51503d8d-4587-495a-a6cd-b24fd1eae0d2 HTTP/1.1" status: 200 len: 1092 time: 1.3837340 Dec 21 04:22:38.283139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce2b0f48-3b17-41fa-ac8e-0b9153f47b81 service neutron] Pushing event updated for resources: {'Port': ['ID=51503d8d-4587-495a-a6cd-b24fd1eae0d2,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:38.378188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a369a51e-24c0-4899-a376-29b6e48c2ae4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.381598 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a369a51e-24c0-4899-a376-29b6e48c2ae4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:38.383573 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a369a51e-24c0-4899-a376-29b6e48c2ae4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d160a2ca-db2b-4726-82b3-0c0ff121b17b HTTP/1.1" status: 204 len: 168 time: 0.2814496 Dec 21 04:22:38.393032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a369a51e-24c0-4899-a376-29b6e48c2ae4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d160a2ca-db2b-4726-82b3-0c0ff121b17b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:38.445009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-f2850508-fa7d-4e26-9d2b-45b836538f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:38.446659 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-f2850508-fa7d-4e26-9d2b-45b836538f99 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3693cbd2a0364ba0897de8f176815a28&device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1095 time: 0.0505781 Dec 21 04:22:38.498842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-404365cf-3791-40cb-8bd4-4165e6c09dc4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2 HTTP/1.1" status: 200 len: 217 time: 0.0366728 Dec 21 04:22:38.553628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-a1fc31f1-d79a-4599-b412-7dd80f8e4ae3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:38.556134 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-a1fc31f1-d79a-4599-b412-7dd80f8e4ae3 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ebe0e4be-6410-4124-aa1a-5df9e39edc4f HTTP/1.1" status: 200 len: 849 time: 0.0474327 Dec 21 04:22:38.606356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-09dd9b4e-2f40-40b1-b24f-ff6661837378 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:38.607902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-09dd9b4e-2f40-40b1-b24f-ff6661837378 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0448699 Dec 21 04:22:38.700022 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-aaf9ce72-c3bd-4d00-99d5-affcb35c7133 service neutron] 10.222.0.54 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841119 Dec 21 04:22:38.807529 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3ffd8af4-5e40-4d07-837a-1a0e6e8c8d7a req-96ffaf25-35ac-4678-b5e8-dc271a284e93 service neutron] 10.222.0.54 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1000750 Dec 21 04:22:39.013264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d103316-65a5-42aa-8718-c71f17ff78db req-9eb79af1-b807-41f7-bf70-a3085932f058 tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] 10.222.0.18 "GET /v2.0/ports?device_id=9b0d6002-95a2-4790-9020-b7a90499f7fe HTTP/1.1" status: 200 len: 210 time: 0.0321264 Dec 21 04:22:39.065387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2e7d6c-8b61-423b-9ff1-c950c9bd888b req-e1911488-d9b5-491b-b41f-4d8e7fdcb47c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:39.066969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa2e7d6c-8b61-423b-9ff1-c950c9bd888b req-e1911488-d9b5-491b-b41f-4d8e7fdcb47c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1095 time: 0.2443197 Dec 21 04:22:39.110734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa2e7d6c-8b61-423b-9ff1-c950c9bd888b req-aa536495-8a30-455d-86bd-5f35bef0812e tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371525 Dec 21 04:22:39.797066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 00ec8d4b-c528-4b42-ba89-2725fead46df no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:22:39.818070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 00ec8d4b-c528-4b42-ba89-2725fead46df {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:22:39.818441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 00ec8d4b-c528-4b42-ba89-2725fead46df not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:22:39.967947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'tag': '51503d8d-4587-495a-a6cd-b24fd1eae0d2'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:39.970172 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b" -d '{"events": [{"name": "network-changed", "server_uuid": "7c9a9435-a927-4c6e-8342-dd1e4c3ad667", "tag": "51503d8d-4587-495a-a6cd-b24fd1eae0d2"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:40.007585 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-72887c04-fc51-4ac4-b472-225e381c475f x-openstack-request-id: req-72887c04-fc51-4ac4-b472-225e381c475f {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:40.007877 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7c9a9435-a927-4c6e-8342-dd1e4c3ad667", "tag": "51503d8d-4587-495a-a6cd-b24fd1eae0d2", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:40.008134 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-72887c04-fc51-4ac4-b472-225e381c475f {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:40.008541 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'tag': '51503d8d-4587-495a-a6cd-b24fd1eae0d2', 'status': 'completed', 'code': 200} Dec 21 04:22:40.095916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-d213a945-f497-4e29-af82-4de8399b3eec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:40.096793 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-d213a945-f497-4e29-af82-4de8399b3eec service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3693cbd2a0364ba0897de8f176815a28&device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1095 time: 0.0455458 Dec 21 04:22:40.207220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-0c7d8528-ab2b-47be-9268-6e527eb6d9fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:40.208754 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-0c7d8528-ab2b-47be-9268-6e527eb6d9fb service neutron] 10.222.0.54 "GET /v2.0/networks?id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd HTTP/1.1" status: 200 len: 911 time: 0.1043444 Dec 21 04:22:40.226204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d0bd75-ed95-4f21-83e4-cef0e84d0b48 req-931adb11-914b-4188-a5a9-b746dfcc237c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:40.227914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2d0bd75-ed95-4f21-83e4-cef0e84d0b48 req-931adb11-914b-4188-a5a9-b746dfcc237c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1095 time: 0.0404325 Dec 21 04:22:40.252242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-122c634d-a03b-4085-833a-171debb64dfb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2 HTTP/1.1" status: 200 len: 217 time: 0.0350800 Dec 21 04:22:40.278162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2d0bd75-ed95-4f21-83e4-cef0e84d0b48 req-6a9e2cf5-5b53-4d3a-9310-2319faf79afa tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440545 Dec 21 04:22:40.303921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-932b07bd-5ed5-4e0d-8dcd-64464e5c6809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:40.305648 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-932b07bd-5ed5-4e0d-8dcd-64464e5c6809 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ebe0e4be-6410-4124-aa1a-5df9e39edc4f HTTP/1.1" status: 200 len: 849 time: 0.0464244 Dec 21 04:22:40.356001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-d167a9c9-39e5-4593-9a55-f9c24a274cf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:40.357604 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-d167a9c9-39e5-4593-9a55-f9c24a274cf5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0447068 Dec 21 04:22:40.448186 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-0160475b-a9e4-4b4e-8943-2336ffd530ab service neutron] 10.222.0.54 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831203 Dec 21 04:22:40.544250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f0f067d2-3143-4144-9c28-7bcd2f8cab2b req-a661f02e-4ab4-440c-aa83-63528cf24f94 service neutron] 10.222.0.54 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893915 Dec 21 04:22:41.388780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998ba508-ae8b-4752-97ba-cc5b3105339e req-f9372f13-c9c6-4813-b8c6-325f2193bd56 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:41.390695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-998ba508-ae8b-4752-97ba-cc5b3105339e req-f9372f13-c9c6-4813-b8c6-325f2193bd56 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1095 time: 0.0429647 Dec 21 04:22:41.439302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-998ba508-ae8b-4752-97ba-cc5b3105339e req-e6f9d368-3e8b-41d0-a5f9-d5f0f8b3f95f tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420406 Dec 21 04:22:41.803918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 51503d8d-4587-495a-a6cd-b24fd1eae0d2 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:22:41.899447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:41.911252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '51503d8d-4587-495a-a6cd-b24fd1eae0d2', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'port_id': '51503d8d-4587-495a-a6cd-b24fd1eae0d2', 'mac_address': 'fa:16:3e:6f:68:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:22:41.948864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:41.961307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 51503d8d-4587-495a-a6cd-b24fd1eae0d2 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:22:41.981122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:42.056813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.105155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=51503d8d-4587-495a-a6cd-b24fd1eae0d2,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:42.327861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['51503d8d-4587-495a-a6cd-b24fd1eae0d2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:22:42.397404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42600) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:42.511934 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-867200bf-2533-4036-9123-f75c88523190 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.546706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6d803a-88d4-4fb1-9a01-303e7357dea1 req-46801c44-e054-4280-8706-1be48fb4b2ca tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:42.548251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff6d803a-88d4-4fb1-9a01-303e7357dea1 req-46801c44-e054-4280-8706-1be48fb4b2ca tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1096 time: 0.0405796 Dec 21 04:22:42.585936 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-867200bf-2533-4036-9123-f75c88523190 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.592438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff6d803a-88d4-4fb1-9a01-303e7357dea1 req-4ad3f1af-8002-469d-92ef-00d245590ffc tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374947 Dec 21 04:22:42.663686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-867200bf-2533-4036-9123-f75c88523190 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.703056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-867200bf-2533-4036-9123-f75c88523190 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=805edecb64e347f484db8d88140c4813&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3042181 Dec 21 04:22:42.703686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867200bf-2533-4036-9123-f75c88523190 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a67b1f1c-7986-4bd8-b9d0-ee4d9b83b211,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:42.705508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42608) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:42.756241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84e9db7c-8e00-4c86-9e7b-52bcbefdb376 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.777530 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84e9db7c-8e00-4c86-9e7b-52bcbefdb376 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.909639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84e9db7c-8e00-4c86-9e7b-52bcbefdb376 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.912308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84e9db7c-8e00-4c86-9e7b-52bcbefdb376 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:42.913520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-84e9db7c-8e00-4c86-9e7b-52bcbefdb376 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a67b1f1c-7986-4bd8-b9d0-ee4d9b83b211 HTTP/1.1" status: 204 len: 168 time: 0.2058260 Dec 21 04:22:42.921277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84e9db7c-8e00-4c86-9e7b-52bcbefdb376 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a67b1f1c-7986-4bd8-b9d0-ee4d9b83b211,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:43.571841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42618) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:43.585216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a154f5bd-aeb1-4757-85ee-d9dcd121a97c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.662203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a154f5bd-aeb1-4757-85ee-d9dcd121a97c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.704449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd7c1673-4246-4821-9e6b-42bbc8ed2feb req-05241d20-dc75-4d3c-b003-24a592932562 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:43.705968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd7c1673-4246-4821-9e6b-42bbc8ed2feb req-05241d20-dc75-4d3c-b003-24a592932562 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1096 time: 0.0427730 Dec 21 04:22:43.732551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a154f5bd-aeb1-4757-85ee-d9dcd121a97c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.753064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd7c1673-4246-4821-9e6b-42bbc8ed2feb req-472ee69e-c223-4956-b0c1-c71cab2b3b9a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405834 Dec 21 04:22:43.785415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42622) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:43.785710 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a154f5bd-aeb1-4757-85ee-d9dcd121a97c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c6377f892c294b97a7d845f18e15e448&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2125039 Dec 21 04:22:43.787931 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a154f5bd-aeb1-4757-85ee-d9dcd121a97c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76ab00bb-4c5f-4106-a06d-f39f8e5fc113,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:43.797272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 51503d8d-4587-495a-a6cd-b24fd1eae0d2 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:43.835903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bee302a7-12c9-4596-b6b3-9421dd62d125 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.857314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bee302a7-12c9-4596-b6b3-9421dd62d125 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.908308 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:22:43.913255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:43.913631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.984250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bee302a7-12c9-4596-b6b3-9421dd62d125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.987102 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bee302a7-12c9-4596-b6b3-9421dd62d125 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:43.991348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bee302a7-12c9-4596-b6b3-9421dd62d125 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/76ab00bb-4c5f-4106-a06d-f39f8e5fc113 HTTP/1.1" status: 204 len: 168 time: 0.2014558 Dec 21 04:22:43.999177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee302a7-12c9-4596-b6b3-9421dd62d125 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76ab00bb-4c5f-4106-a06d-f39f8e5fc113,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:44.173545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:44.196946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51503d8d-4587-495a-a6cd-b24fd1eae0d2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:44.199079 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-caaebcb8-5b9b-4284-b86e-d73c6913bf34" -d '{"events": [{"server_uuid": "7c9a9435-a927-4c6e-8342-dd1e4c3ad667", "name": "network-vif-plugged", "status": "completed", "tag": "51503d8d-4587-495a-a6cd-b24fd1eae0d2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:44.212294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:44.241599 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b615b539-4027-4a56-8014-e2cee647ccd2 x-openstack-request-id: req-b615b539-4027-4a56-8014-e2cee647ccd2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:44.241963 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c9a9435-a927-4c6e-8342-dd1e4c3ad667", "name": "network-vif-plugged", "status": "completed", "tag": "51503d8d-4587-495a-a6cd-b24fd1eae0d2", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:44.242289 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b615b539-4027-4a56-8014-e2cee647ccd2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:44.242806 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51503d8d-4587-495a-a6cd-b24fd1eae0d2', 'code': 200} Dec 21 04:22:44.285188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:44.344878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=51503d8d-4587-495a-a6cd-b24fd1eae0d2,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:44.374468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebf658f2-4aae-4fd7-9a41-7ae87dd673c3 req-bbc4b81c-9b84-4efc-907d-1a1110e141a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:44.376114 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ebf658f2-4aae-4fd7-9a41-7ae87dd673c3 req-bbc4b81c-9b84-4efc-907d-1a1110e141a4 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0430903 Dec 21 04:22:44.424458 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ebf658f2-4aae-4fd7-9a41-7ae87dd673c3 req-af6d2c0f-81dc-468a-9e94-8490a58e2a54 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401461 Dec 21 04:22:44.897863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb0674c-3a70-43ca-90ab-c38569ce7cc7 req-4bd3e8bf-b0d4-403c-808b-6d3f70a2a322 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:44.899481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6cb0674c-3a70-43ca-90ab-c38569ce7cc7 req-4bd3e8bf-b0d4-403c-808b-6d3f70a2a322 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0514474 Dec 21 04:22:44.954922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6cb0674c-3a70-43ca-90ab-c38569ce7cc7 req-77ddeeb0-e438-4a84-8fdd-2059d38e434c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477078 Dec 21 04:22:46.063122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dfc5d05-fbaf-49a3-acc2-0d3196434387 req-f95943b6-8acf-4400-987c-e83ab6ae94f6 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:46.064677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1dfc5d05-fbaf-49a3-acc2-0d3196434387 req-f95943b6-8acf-4400-987c-e83ab6ae94f6 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0406282 Dec 21 04:22:46.113071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1dfc5d05-fbaf-49a3-acc2-0d3196434387 req-8b347930-9c72-4a70-9dec-c2900126f545 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414464 Dec 21 04:22:46.218255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb396a6-f9d4-4e5d-9668-b22ac0a69fad req-3503bc2e-c6db-4a92-910b-46c57d55bf1b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:46.219801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcb396a6-f9d4-4e5d-9668-b22ac0a69fad req-3503bc2e-c6db-4a92-910b-46c57d55bf1b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0403042 Dec 21 04:22:46.279474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bcb396a6-f9d4-4e5d-9668-b22ac0a69fad req-b8fb405b-337f-4eb5-84a4-343cef792b09 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516367 Dec 21 04:22:46.400508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4268db97-dd25-47f7-9f9a-fb337f5d4e35 req-ed98024f-82e4-4ec5-be11-a202f7c9fb7d tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:46.408256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4268db97-dd25-47f7-9f9a-fb337f5d4e35 req-ed98024f-82e4-4ec5-be11-a202f7c9fb7d tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0596881 Dec 21 04:22:46.454296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4268db97-dd25-47f7-9f9a-fb337f5d4e35 req-9eb8fc33-d216-4e0e-82a6-07d3bdeb3d9e tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403230 Dec 21 04:22:46.748602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-8acc6d5b-6196-4591-96f6-093f00d9b5f2 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:46.753663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-8acc6d5b-6196-4591-96f6-093f00d9b5f2 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/networks?id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd HTTP/1.1" status: 200 len: 911 time: 0.0888610 Dec 21 04:22:46.767085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-03d2d5f8-021b-467c-8c40-8ad2d8b969e2 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/quotas/3693cbd2a0364ba0897de8f176815a28 HTTP/1.1" status: 200 len: 375 time: 0.0111156 Dec 21 04:22:46.826558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-97af513c-777f-4b8b-a2fb-90809f787501 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?tenant_id=3693cbd2a0364ba0897de8f176815a28&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0512886 Dec 21 04:22:47.106282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-f7e66057-0c88-46c6-b964-d5b1a398886e service neutron] 10.222.0.18 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2696121 Dec 21 04:22:47.205416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-e39731d9-9a20-4432-bd32-2dd2e1dff198 service neutron] 10.222.0.18 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931861 Dec 21 04:22:47.508859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c43e49c3-2a23-4e7b-a277-e9d73de7ee71 req-ac323da2-3282-491e-8780-2fe3561a0ff8 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 210 time: 0.0285714 Dec 21 04:22:48.620185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8fa9779-09a5-4ef1-afa4-7aa1c92ba274 req-8028c445-4385-4079-accd-911d36ba6bd3 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 210 time: 0.0419574 Dec 21 04:22:49.722421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f82cfe1b-17a9-4ae0-9686-bb8b35c29e2a req-f8418646-d884-48f7-af80-728060191f3e tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 210 time: 0.0330381 Dec 21 04:22:49.745397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-1005eb5a-57d5-4237-87a4-87ab5a7ffc5a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:49.747304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-1005eb5a-57d5-4237-87a4-87ab5a7ffc5a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.31 "GET /v2.0/networks?id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd HTTP/1.1" status: 200 len: 911 time: 0.1226749 Dec 21 04:22:49.762766 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Request body: {'port': {'device_id': '3fa6cae0-1497-4463-afee-24cc0e296739', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'admin_state_up': True, 'tenant_id': '3693cbd2a0364ba0897de8f176815a28'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:49.898147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Made reservation on behalf of 3693cbd2a0364ba0897de8f176815a28 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:22:49.900528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:49.932737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0364d6ba-5b94-429d-a647-8a1380959397 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:50.059270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Allocated IP 172.20.0.12 (eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd/ebe0e4be-6410-4124-aa1a-5df9e39edc4f/2739d3da-a731-4bfc-80e2-5f6c46ba9862) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:22:50.198161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:50.319854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:50.355385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['51503d8d-4587-495a-a6cd-b24fd1eae0d2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:22:50.373898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:22:50.379250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:22:50.384342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:22:50.428934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Pushing event updated for resources: {'Port': ['ID=2739d3da-a731-4bfc-80e2-5f6c46ba9862,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:50.442398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:50.443103 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:50.524373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-d422d011-e4ec-4edc-9ad2-c42f1fe35e96 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1030 time: 0.7655602 Dec 21 04:22:50.553079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Request body: {'port': {'device_id': '3fa6cae0-1497-4463-afee-24cc0e296739', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:22:50.625845 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:50.712058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c2e4d34c-e32d-469c-bf83-72202727bea9 None None] Provisioning complete for port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:50.712435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c2e4d34c-e32d-469c-bf83-72202727bea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:50.754028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c2e4d34c-e32d-469c-bf83-72202727bea9 None None] Port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:22:50.893132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68a31fbd-f98a-46a8-8cce-f48bc78bca39 req-8c360fca-921b-4ef2-bc12-ef26c8bf6873 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:50.894730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68a31fbd-f98a-46a8-8cce-f48bc78bca39 req-8c360fca-921b-4ef2-bc12-ef26c8bf6873 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1028 time: 0.0932674 Dec 21 04:22:50.991350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68a31fbd-f98a-46a8-8cce-f48bc78bca39 req-6a20af02-0894-4847-b304-d908df3ca7d3 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843353 Dec 21 04:22:50.994970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2739d3da-a731-4bfc-80e2-5f6c46ba9862 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:22:51.007422 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:51.026922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Transition to ACTIVE for port object 2739d3da-a731-4bfc-80e2-5f6c46ba9862 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:22:51.109587 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:51.209563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Pushing event updated for resources: {'Port': ['ID=2739d3da-a731-4bfc-80e2-5f6c46ba9862,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:51.263641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Attempting to bind port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:22:51.264051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Attempting to bind port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:22:51.264447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Attempting to bind port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:51.273406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:22:51.273738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Attempting to bind port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 on network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:22:51.279700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 22, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:22:51.280288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Checking segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:22:51.280865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Bound using segment: {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:22:51.281297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Bound port: 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '361b0dd0-371b-42cc-92f7-dcea5865d9a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:22:51.281656 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:51.361588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] For port 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:22:51.367545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] For port 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2739d3da-a731-4bfc-80e2-5f6c46ba9862,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:22:51.446268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:51.480191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:51.480826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:51.482821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] 10.222.0.31 "PUT /v2.0/ports/2739d3da-a731-4bfc-80e2-5f6c46ba9862 HTTP/1.1" status: 200 len: 1093 time: 0.9343207 Dec 21 04:22:51.485306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3fa6cae0-1497-4463-afee-24cc0e296739', 'tag': '2739d3da-a731-4bfc-80e2-5f6c46ba9862'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:51.488074 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-978d86b9-ccee-42e7-9339-2acd110a97d1" -d '{"events": [{"name": "network-changed", "server_uuid": "3fa6cae0-1497-4463-afee-24cc0e296739", "tag": "2739d3da-a731-4bfc-80e2-5f6c46ba9862"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:51.554010 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3c02668-6f6c-4a32-ab5d-cd385bb6514f x-openstack-request-id: req-a3c02668-6f6c-4a32-ab5d-cd385bb6514f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:51.554307 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3fa6cae0-1497-4463-afee-24cc0e296739", "tag": "2739d3da-a731-4bfc-80e2-5f6c46ba9862", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:51.554689 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a3c02668-6f6c-4a32-ab5d-cd385bb6514f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:51.554987 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3fa6cae0-1497-4463-afee-24cc0e296739', 'tag': '2739d3da-a731-4bfc-80e2-5f6c46ba9862', 'status': 'completed', 'code': 200} Dec 21 04:22:51.555954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b571053f-3456-460b-836f-26cd1e75f4e8 service neutron] Pushing event updated for resources: {'Port': ['ID=2739d3da-a731-4bfc-80e2-5f6c46ba9862,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:51.672109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978d86b9-ccee-42e7-9339-2acd110a97d1 req-20e8555e-ab5a-4aa5-899d-83734527fdfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:51.673810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-978d86b9-ccee-42e7-9339-2acd110a97d1 req-20e8555e-ab5a-4aa5-899d-83734527fdfb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3693cbd2a0364ba0897de8f176815a28&device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1096 time: 0.0650387 Dec 21 04:22:51.801226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978d86b9-ccee-42e7-9339-2acd110a97d1 req-489b7eb9-0c1d-4103-8268-79594be0e6c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:51.806849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-978d86b9-ccee-42e7-9339-2acd110a97d1 req-489b7eb9-0c1d-4103-8268-79594be0e6c3 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=3693cbd2a0364ba0897de8f176815a28&shared=False HTTP/1.1" status: 200 len: 911 time: 0.1050398 Dec 21 04:22:51.920785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978d86b9-ccee-42e7-9339-2acd110a97d1 req-ae39ed60-e231-4598-9304-55d23bb60a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:51.922283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-978d86b9-ccee-42e7-9339-2acd110a97d1 req-ae39ed60-e231-4598-9304-55d23bb60a6c service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1079333 Dec 21 04:22:52.028380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-8e360df3-6410-4524-8121-56dbad1b23c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:52.030085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-8e360df3-6410-4524-8121-56dbad1b23c6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3693cbd2a0364ba0897de8f176815a28&device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1096 time: 0.0415041 Dec 21 04:22:52.088930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-c0ba1d3f-556d-467c-a490-e69fa6e8a809 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2739d3da-a731-4bfc-80e2-5f6c46ba9862 HTTP/1.1" status: 200 len: 217 time: 0.0379734 Dec 21 04:22:52.163863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55c2c409-c8e4-46c7-ad5c-5473b5276009 req-1f41afdd-0783-4651-9d1d-0366ff152a9b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:52.165399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55c2c409-c8e4-46c7-ad5c-5473b5276009 req-1f41afdd-0783-4651-9d1d-0366ff152a9b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1096 time: 0.0793445 Dec 21 04:22:52.174247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-3fc498c7-5a5a-4acb-96f4-d67bf9318b58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:52.175667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-3fc498c7-5a5a-4acb-96f4-d67bf9318b58 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ebe0e4be-6410-4124-aa1a-5df9e39edc4f HTTP/1.1" status: 200 len: 849 time: 0.0597212 Dec 21 04:22:52.240024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55c2c409-c8e4-46c7-ad5c-5473b5276009 req-c1c2d856-6be3-4c2c-9238-906c9219e7c9 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682254 Dec 21 04:22:52.245908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-05e1749b-b915-4b89-a7bf-41269702ffe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:52.247380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-05e1749b-b915-4b89-a7bf-41269702ffe4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0592384 Dec 21 04:22:52.348202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-f98f0d79-e35d-44f7-9afb-57e9f22f576b service neutron] 10.222.0.31 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887325 Dec 21 04:22:52.397974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 42904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:52.450780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8468be82-0c93-4809-9cec-b2c2bc8aeb70 req-f0d8700d-4d23-4d2d-9ea4-5d7e507ae7a7 service neutron] 10.222.0.31 "GET /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930095 Dec 21 04:22:52.511996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:52.587376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:52.658260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:52.695524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d37a40f-3497-437c-8c31-d045bcd3d547,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:52.696788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e54863fb-7fbd-4384-9b87-3cdce7816937 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:52.699226 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bf0ad5726cdf4b05af9c1777c9fe5eca&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2996140 Dec 21 04:22:52.702329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42908) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:52.705872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.706236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.706580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.706920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.707288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.707621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.708551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.708885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.709214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.709540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.709891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.710258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.710583 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d4b077a-eb5e-4637-b7d7-f23884dc99ff admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:22:52.754595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9aea9af-e1fd-4a27-b257-6c50796728ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:52.780171 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9aea9af-e1fd-4a27-b257-6c50796728ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:53.069717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:53.245390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9aea9af-e1fd-4a27-b257-6c50796728ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:53.248078 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9aea9af-e1fd-4a27-b257-6c50796728ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:53.249251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a9aea9af-e1fd-4a27-b257-6c50796728ec admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/3d37a40f-3497-437c-8c31-d045bcd3d547 HTTP/1.1" status: 204 len: 168 time: 0.5459061 Dec 21 04:22:53.258072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9aea9af-e1fd-4a27-b257-6c50796728ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d37a40f-3497-437c-8c31-d045bcd3d547,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:53.360898 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:53.370466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5bbb03-d352-4234-b772-85086619190e req-42180465-e53d-4978-98f3-8f53d388697c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:53.372219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e5bbb03-d352-4234-b772-85086619190e req-42180465-e53d-4978-98f3-8f53d388697c tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1096 time: 0.0428951 Dec 21 04:22:53.416987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e5bbb03-d352-4234-b772-85086619190e req-44b55e9b-def7-43b3-b649-131a6815f831 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387805 Dec 21 04:22:53.907308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42918) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:53.921101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4782387e-7650-4164-aa99-5b38a2965837 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:53.993505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4782387e-7650-4164-aa99-5b38a2965837 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:54.073584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4782387e-7650-4164-aa99-5b38a2965837 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:54.112130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4782387e-7650-4164-aa99-5b38a2965837 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=097db809-3076-44aa-b99d-5ba05fbcfa68,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:54.116430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4782387e-7650-4164-aa99-5b38a2965837 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b9678c5109074de9b456e17a4c59f06e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2081082 Dec 21 04:22:54.119072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 42920) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:54.167742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e63966a4-6795-4509-ad7c-4ab37cb5edc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:54.189191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e63966a4-6795-4509-ad7c-4ab37cb5edc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:54.326704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e63966a4-6795-4509-ad7c-4ab37cb5edc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:54.329544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e63966a4-6795-4509-ad7c-4ab37cb5edc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:54.330770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e63966a4-6795-4509-ad7c-4ab37cb5edc3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/097db809-3076-44aa-b99d-5ba05fbcfa68 HTTP/1.1" status: 204 len: 168 time: 0.2106905 Dec 21 04:22:54.339255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e63966a4-6795-4509-ad7c-4ab37cb5edc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=097db809-3076-44aa-b99d-5ba05fbcfa68,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:54.522335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d01ed4-1645-44f6-b5af-b366a9abf4f8 req-b686fe0d-e2d5-4e06-8a20-48876c495c29 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:54.523994 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8d01ed4-1645-44f6-b5af-b366a9abf4f8 req-b686fe0d-e2d5-4e06-8a20-48876c495c29 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1096 time: 0.0412037 Dec 21 04:22:54.570157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8d01ed4-1645-44f6-b5af-b366a9abf4f8 req-3aea17aa-27d4-45cb-8146-d398ddf5d355 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399222 Dec 21 04:22:55.096434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:55.159197 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:55.686711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d883d9e-6289-45b9-b5fa-f732424e0dcd req-c912ccca-99ea-4440-94eb-91a57fc59b9b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:55.688397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d883d9e-6289-45b9-b5fa-f732424e0dcd req-c912ccca-99ea-4440-94eb-91a57fc59b9b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1096 time: 0.0437179 Dec 21 04:22:55.744298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d883d9e-6289-45b9-b5fa-f732424e0dcd req-47d922b5-2d0f-4d28-be89-ab4f653d4b5b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490963 Dec 21 04:22:55.783796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:56.364070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2739d3da-a731-4bfc-80e2-5f6c46ba9862 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:22:56.462898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2739d3da-a731-4bfc-80e2-5f6c46ba9862,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:56.477479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '2739d3da-a731-4bfc-80e2-5f6c46ba9862', 'network_id': 'eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd', 'port_id': '2739d3da-a731-4bfc-80e2-5f6c46ba9862', 'mac_address': 'fa:16:3e:0d:b3:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ebe0e4be-6410-4124-aa1a-5df9e39edc4f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:22:56.513385 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:56.528216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2739d3da-a731-4bfc-80e2-5f6c46ba9862 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:22:56.555028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2739d3da-a731-4bfc-80e2-5f6c46ba9862,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:56.657875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:56.711341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2739d3da-a731-4bfc-80e2-5f6c46ba9862,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:56.871370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be5b796c-ef32-483e-ad13-102c06d8b382 req-efbc0051-23bb-460f-a0d2-93c9688b93d9 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:56.872802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be5b796c-ef32-483e-ad13-102c06d8b382 req-efbc0051-23bb-460f-a0d2-93c9688b93d9 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1097 time: 0.0425718 Dec 21 04:22:56.918139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be5b796c-ef32-483e-ad13-102c06d8b382 req-c6330cdc-7d8b-49c2-94fd-d40b83d05ea2 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392077 Dec 21 04:22:57.026952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['2739d3da-a731-4bfc-80e2-5f6c46ba9862'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:22:58.035297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc221e7f-6bfd-4971-9093-a235373b750e req-fb9dee94-9586-4639-8a53-ae40cf6c698a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:58.036773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc221e7f-6bfd-4971-9093-a235373b750e req-fb9dee94-9586-4639-8a53-ae40cf6c698a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1097 time: 0.0409484 Dec 21 04:22:58.093127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc221e7f-6bfd-4971-9093-a235373b750e req-190985d1-89f3-47fd-8c04-96e27cfdea71 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504668 Dec 21 04:22:58.363950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2739d3da-a731-4bfc-80e2-5f6c46ba9862 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:22:58.486325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:22:58.490586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:22:58.490988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:58.572434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:58.597034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fa6cae0-1497-4463-afee-24cc0e296739', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2739d3da-a731-4bfc-80e2-5f6c46ba9862'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:22:58.600550 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4631033b-1c71-4a00-9277-04730a4f9ac5" -d '{"events": [{"server_uuid": "3fa6cae0-1497-4463-afee-24cc0e296739", "name": "network-vif-plugged", "status": "completed", "tag": "2739d3da-a731-4bfc-80e2-5f6c46ba9862"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:22:58.615225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2739d3da-a731-4bfc-80e2-5f6c46ba9862,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:22:58.644288 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:22:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67992387-36c1-47e5-a232-916dd3da6bce x-openstack-request-id: req-67992387-36c1-47e5-a232-916dd3da6bce {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:22:58.644288 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3fa6cae0-1497-4463-afee-24cc0e296739", "name": "network-vif-plugged", "status": "completed", "tag": "2739d3da-a731-4bfc-80e2-5f6c46ba9862", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:22:58.644288 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-67992387-36c1-47e5-a232-916dd3da6bce {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:22:58.644594 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fa6cae0-1497-4463-afee-24cc0e296739', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2739d3da-a731-4bfc-80e2-5f6c46ba9862', 'code': 200} Dec 21 04:22:58.683780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43002) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:58.698266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:58.753776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=2739d3da-a731-4bfc-80e2-5f6c46ba9862,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:58.802179 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7382b2f1-f893-4b73-b0d5-43864200aa6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:58.813092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636dbe2e-c622-4c8b-bee4-49698d87edd2 req-2ca0abd9-c0b7-436f-b1fe-3054aeafa020 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:58.814663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-636dbe2e-c622-4c8b-bee4-49698d87edd2 req-2ca0abd9-c0b7-436f-b1fe-3054aeafa020 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0663791 Dec 21 04:22:58.885885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-636dbe2e-c622-4c8b-bee4-49698d87edd2 req-8df50410-5c59-4cc6-90ab-4e7a4bbf5b66 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595548 Dec 21 04:22:58.916662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7382b2f1-f893-4b73-b0d5-43864200aa6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:59.000967 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7382b2f1-f893-4b73-b0d5-43864200aa6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:59.042519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7382b2f1-f893-4b73-b0d5-43864200aa6e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=78eb058c17134092a672409d759312f5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3577263 Dec 21 04:22:59.043441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7382b2f1-f893-4b73-b0d5-43864200aa6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09ed6a8b-3e8a-4fd7-9a9c-0fcbd6d53266,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:22:59.046492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43006) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:22:59.099662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-592746b4-57f9-4e47-b0c4-db742e23ae97 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:59.121939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-592746b4-57f9-4e47-b0c4-db742e23ae97 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:59.201821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95426af0-ab72-4595-a0aa-b2609f545dce req-4437f9e7-874d-4bc5-bf8f-78d33decd08e tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:22:59.203358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95426af0-ab72-4595-a0aa-b2609f545dce req-4437f9e7-874d-4bc5-bf8f-78d33decd08e tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0417161 Dec 21 04:22:59.236844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-592746b4-57f9-4e47-b0c4-db742e23ae97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:59.239800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-592746b4-57f9-4e47-b0c4-db742e23ae97 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:22:59.240984 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-592746b4-57f9-4e47-b0c4-db742e23ae97 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/09ed6a8b-3e8a-4fd7-9a9c-0fcbd6d53266 HTTP/1.1" status: 204 len: 168 time: 0.1934564 Dec 21 04:22:59.256525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95426af0-ab72-4595-a0aa-b2609f545dce req-1964499d-0f2e-46ce-ad15-fa856fa24007 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418549 Dec 21 04:22:59.256749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-592746b4-57f9-4e47-b0c4-db742e23ae97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09ed6a8b-3e8a-4fd7-9a9c-0fcbd6d53266,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:00.363603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08814911-10d9-414d-98d0-c59f30a9fe5b req-5eddc95b-7cdb-4c6f-b505-9826810a9304 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:00.365079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08814911-10d9-414d-98d0-c59f30a9fe5b req-5eddc95b-7cdb-4c6f-b505-9826810a9304 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0411491 Dec 21 04:23:00.411001 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08814911-10d9-414d-98d0-c59f30a9fe5b req-59eec032-5014-4cff-bc2f-f5b929f9f3c1 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389419 Dec 21 04:23:01.519636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d302a36-ffee-4ca8-8792-ed4f771561d2 req-6aac874c-3af8-49b9-a0fa-101cab375a6a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:01.521200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d302a36-ffee-4ca8-8792-ed4f771561d2 req-6aac874c-3af8-49b9-a0fa-101cab375a6a tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0436018 Dec 21 04:23:01.565754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d302a36-ffee-4ca8-8792-ed4f771561d2 req-b65c0cdc-d1ce-4505-bd7a-f584cb50d0b6 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378368 Dec 21 04:23:01.675588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e24ce7d-9cb2-44e0-b31b-ce3e0ea16923 req-2bf15a2a-b394-4d0f-98ac-0a494f09867f tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:01.677103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e24ce7d-9cb2-44e0-b31b-ce3e0ea16923 req-2bf15a2a-b394-4d0f-98ac-0a494f09867f tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0428627 Dec 21 04:23:01.726652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e24ce7d-9cb2-44e0-b31b-ce3e0ea16923 req-5fb73a9d-a06a-4134-9b24-53b5b0c0f246 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422513 Dec 21 04:23:01.837743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3d051e-b1d8-484d-97e4-c8f5b8d4f385 req-cdc0f5fa-5b35-4da2-bb93-e1585c8fe148 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:01.839640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f3d051e-b1d8-484d-97e4-c8f5b8d4f385 req-cdc0f5fa-5b35-4da2-bb93-e1585c8fe148 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0421610 Dec 21 04:23:01.889168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f3d051e-b1d8-484d-97e4-c8f5b8d4f385 req-b0edd749-1e60-450d-a614-d37adc280ff7 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436769 Dec 21 04:23:02.577567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3690b507-779b-4352-ba06-1fc9f41ad88c req-9c0a9c97-7b36-48a1-9bc8-5b001f6fe905 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:02.579139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3690b507-779b-4352-ba06-1fc9f41ad88c req-9c0a9c97-7b36-48a1-9bc8-5b001f6fe905 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0417488 Dec 21 04:23:02.625470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3690b507-779b-4352-ba06-1fc9f41ad88c req-ee3ed1b1-7b1d-4ab6-b6b7-8ed2692ca6b2 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401998 Dec 21 04:23:03.749565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c63346e-6d13-4bd3-87e7-b315b59c8543 req-9ddc9511-958e-4af2-9ab9-95c223c68017 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:03.751113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c63346e-6d13-4bd3-87e7-b315b59c8543 req-9ddc9511-958e-4af2-9ab9-95c223c68017 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0416613 Dec 21 04:23:03.806229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c63346e-6d13-4bd3-87e7-b315b59c8543 req-349f8e6f-baef-487f-bc2a-4345c6499846 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389163 Dec 21 04:23:04.137074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-c52fc8a9-c595-4b7a-93b0-35f48825ad52 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:04.138497 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-c52fc8a9-c595-4b7a-93b0-35f48825ad52 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 1098 time: 0.0431604 Dec 21 04:23:04.219760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Deleting port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:04.220040 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:04.299978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] For port 2739d3da-a731-4bfc-80e2-5f6c46ba9862, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=2739d3da-a731-4bfc-80e2-5f6c46ba9862,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:04.300313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:04.313070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Calling delete_port for 2739d3da-a731-4bfc-80e2-5f6c46ba9862 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:04.520907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:04.554988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Pushing event deleted for resources: {'Port': ['ID=2739d3da-a731-4bfc-80e2-5f6c46ba9862,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:04.568248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['2739d3da-a731-4bfc-80e2-5f6c46ba9862'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:23:04.572188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['51503d8d-4587-495a-a6cd-b24fd1eae0d2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:23:04.607901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] No DVR routers for this DVR port 2739d3da-a731-4bfc-80e2-5f6c46ba9862 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:23:04.614077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:04.618339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c71c8eb6-bd0d-4b9e-8bec-9bee567b119e req-3de21b17-d651-4714-8034-d2a9fbb50176 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.31 "DELETE /v2.0/ports/2739d3da-a731-4bfc-80e2-5f6c46ba9862 HTTP/1.1" status: 204 len: 173 time: 0.4701860 Dec 21 04:23:04.618506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fa6cae0-1497-4463-afee-24cc0e296739', 'name': 'network-vif-deleted', 'tag': '2739d3da-a731-4bfc-80e2-5f6c46ba9862'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:23:04.621262 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c44809b3-952c-4733-9085-a39952d805c1" -d '{"events": [{"server_uuid": "3fa6cae0-1497-4463-afee-24cc0e296739", "name": "network-vif-deleted", "tag": "2739d3da-a731-4bfc-80e2-5f6c46ba9862"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:23:04.701860 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:23:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3abe6d02-973e-4d27-9072-6a0ec8a9cbd1 x-openstack-request-id: req-3abe6d02-973e-4d27-9072-6a0ec8a9cbd1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:23:04.702212 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3fa6cae0-1497-4463-afee-24cc0e296739", "name": "network-vif-deleted", "tag": "2739d3da-a731-4bfc-80e2-5f6c46ba9862", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:23:04.702422 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3abe6d02-973e-4d27-9072-6a0ec8a9cbd1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:23:04.703510 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fa6cae0-1497-4463-afee-24cc0e296739', 'name': 'network-vif-deleted', 'tag': '2739d3da-a731-4bfc-80e2-5f6c46ba9862', 'status': 'completed', 'code': 200} Dec 21 04:23:04.903110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a74e3ae5-d939-4efb-9af9-a0287e47b3f0 req-87036bf5-b4e8-43de-b929-21edaa0810a0 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=3fa6cae0-1497-4463-afee-24cc0e296739 HTTP/1.1" status: 200 len: 210 time: 0.0275197 Dec 21 04:23:06.345936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1832107d-2b87-4c66-ab8f-aa8affc62333 req-c23a64d5-3ede-43d9-92ee-ca190155b01b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:06.347539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1832107d-2b87-4c66-ab8f-aa8affc62333 req-c23a64d5-3ede-43d9-92ee-ca190155b01b tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0415766 Dec 21 04:23:06.396456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1832107d-2b87-4c66-ab8f-aa8affc62333 req-a041f312-4850-4d28-ab43-36b25779b51f tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425830 Dec 21 04:23:07.505608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec8d3a6-a3e8-4bdd-a4ba-8c0ad16121aa req-e0ab57d9-5532-450c-b59b-ce56d2feecff tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:07.507312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bec8d3a6-a3e8-4bdd-a4ba-8c0ad16121aa req-e0ab57d9-5532-450c-b59b-ce56d2feecff tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0405910 Dec 21 04:23:07.555794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bec8d3a6-a3e8-4bdd-a4ba-8c0ad16121aa req-1dd750eb-c7c8-4d09-bdf9-446db9512ff9 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/security-groups?id=0d7493d2-2e5b-4d69-b58b-8950b254ad66&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418627 Dec 21 04:23:07.825332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-a811bfa3-34ba-4ecf-ba16-c8fbd8af6850 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:07.826884 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-a811bfa3-34ba-4ecf-ba16-c8fbd8af6850 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.54 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 1097 time: 0.0410695 Dec 21 04:23:07.910763 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Deleting port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:07.911439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:07.989690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] For port 51503d8d-4587-495a-a6cd-b24fd1eae0d2, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=51503d8d-4587-495a-a6cd-b24fd1eae0d2,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:07.990047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:08.002010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Calling delete_port for 51503d8d-4587-495a-a6cd-b24fd1eae0d2 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:08.233555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:08.258668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Pushing event deleted for resources: {'Port': ['ID=51503d8d-4587-495a-a6cd-b24fd1eae0d2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:08.264689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['51503d8d-4587-495a-a6cd-b24fd1eae0d2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:23:08.303108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] No DVR routers for this DVR port 51503d8d-4587-495a-a6cd-b24fd1eae0d2 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:23:08.305670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:08.310292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2fcbf48f-84b4-4453-b355-31e8cb368ab3 req-187c406c-e78b-46af-a7eb-a91bc7325913 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.54 "DELETE /v2.0/ports/51503d8d-4587-495a-a6cd-b24fd1eae0d2 HTTP/1.1" status: 204 len: 173 time: 0.4765778 Dec 21 04:23:08.310772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'name': 'network-vif-deleted', 'tag': '51503d8d-4587-495a-a6cd-b24fd1eae0d2'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:23:08.314741 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af00d26d-a47a-4cb3-a5c1-8fb86d26727d" -d '{"events": [{"server_uuid": "7c9a9435-a927-4c6e-8342-dd1e4c3ad667", "name": "network-vif-deleted", "tag": "51503d8d-4587-495a-a6cd-b24fd1eae0d2"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:23:08.353497 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:23:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-279d2df9-91e5-4c20-a28a-f10aeb901962 x-openstack-request-id: req-279d2df9-91e5-4c20-a28a-f10aeb901962 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:23:08.353799 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c9a9435-a927-4c6e-8342-dd1e4c3ad667", "name": "network-vif-deleted", "tag": "51503d8d-4587-495a-a6cd-b24fd1eae0d2", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:23:08.354057 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-279d2df9-91e5-4c20-a28a-f10aeb901962 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:23:08.355038 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c9a9435-a927-4c6e-8342-dd1e4c3ad667', 'name': 'network-vif-deleted', 'tag': '51503d8d-4587-495a-a6cd-b24fd1eae0d2', 'status': 'completed', 'code': 200} Dec 21 04:23:08.378753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2739d3da-a731-4bfc-80e2-5f6c46ba9862 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:08.418833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 2739d3da-a731-4bfc-80e2-5f6c46ba9862 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:08.420174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 2739d3da-a731-4bfc-80e2-5f6c46ba9862 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:08.657592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e92f2f73-f940-4bb3-9ec2-01caa8755095 req-317ac18d-d39c-4f7e-a31b-f6831fe52859 tempest-TestServerMultinode-1212668530 tempest-TestServerMultinode-1212668530-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7c9a9435-a927-4c6e-8342-dd1e4c3ad667 HTTP/1.1" status: 200 len: 210 time: 0.0274134 Dec 21 04:23:09.726858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:10.081428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:10.320253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Deleting port 241f2399-2c47-4de4-818d-5e152df6b298 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:10.320496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:10.398185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] For port 241f2399-2c47-4de4-818d-5e152df6b298, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=241f2399-2c47-4de4-818d-5e152df6b298,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:10.398876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:10.412566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Calling delete_port for 241f2399-2c47-4de4-818d-5e152df6b298 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:10.651691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:10.692412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Pushing event deleted for resources: {'Port': ['ID=241f2399-2c47-4de4-818d-5e152df6b298,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:11.220783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:11.429791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Router 3c971aaa-fb08-42fd-a092-1641149d9de6 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:23:11.543284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:23:11.548571 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-36eeb9fe-2d2c-433b-9221-5e0966830f0a admin admin] 10.222.0.18 "PUT /v2.0/routers/3c971aaa-fb08-42fd-a092-1641149d9de6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8205917 Dec 21 04:23:11.551178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:11.552227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] Sync routers for ids ['3c971aaa-fb08-42fd-a092-1641149d9de6'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:23:11.562637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] Routers {'3c971aaa-fb08-42fd-a092-1641149d9de6'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:23:11.563287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c971aaa-fb08-42fd-a092-1641149d9de6'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:11.654145 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:11.667725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] Set router 3c971aaa-fb08-42fd-a092-1641149d9de6 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:23:11.759084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:11.846645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:23:10Z', 'revision_number': 5, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port': {'id': 'c17c370f-f407-460c-94cb-a9d329ce8ca5', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2d:aa:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3743, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:22:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:11.882016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] Checking router: 3c971aaa-fb08-42fd-a092-1641149d9de6 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:23:11.891498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] Routers {'3c971aaa-fb08-42fd-a092-1641149d9de6'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:23:11.892116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c971aaa-fb08-42fd-a092-1641149d9de6'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:11.902812 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:23:11.927083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 51503d8d-4587-495a-a6cd-b24fd1eae0d2 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:11.935222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Deleting port c17c370f-f407-460c-94cb-a9d329ce8ca5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:11.936184 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:11.977502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 51503d8d-4587-495a-a6cd-b24fd1eae0d2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:11.977845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 51503d8d-4587-495a-a6cd-b24fd1eae0d2 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:12.000772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] Set router 3c971aaa-fb08-42fd-a092-1641149d9de6 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:23:12.021546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] For port c17c370f-f407-460c-94cb-a9d329ce8ca5, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c17c370f-f407-460c-94cb-a9d329ce8ca5,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:12.021915 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.034122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Calling delete_port for c17c370f-f407-460c-94cb-a9d329ce8ca5 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:12.055027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:23:11Z', 'revision_number': 6, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:12.082065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f5bd45a-9960-42a2-9903-3247e5f5ddc7 None None] The sync data for ids ['3c971aaa-fb08-42fd-a092-1641149d9de6'] in n-d-822053-11 is: [{'id': '3c971aaa-fb08-42fd-a092-1641149d9de6', 'name': 'tempest-TestServerMultinode-1121844468-router', 'tenant_id': '3a1deef4e9cd439ab363eead886eb316', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:18Z', 'updated_at': '2021-12-21T04:23:11Z', 'revision_number': 6, 'project_id': '3a1deef4e9cd439ab363eead886eb316', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:23:12.291077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.317423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Pushing event deleted for resources: {'Port': ['ID=c17c370f-f407-460c-94cb-a9d329ce8ca5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:12.329718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.330073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.330410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.330749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.331116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.331463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.331773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.332097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.332422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.332742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.333064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.333204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93a2980b-33dd-4cc4-9799-708ad0ea3996 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:23:12.333387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.333716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:12.387005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.490851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.493327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.601733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.602411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3c971aaa-fb08-42fd-a092-1641149d9de6 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:12.607223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.608519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a0c1fc3-bc07-47ff-9388-dfbe1569a492 admin admin] 10.222.0.18 "DELETE /v2.0/routers/3c971aaa-fb08-42fd-a092-1641149d9de6 HTTP/1.1" status: 204 len: 168 time: 1.0562239 Dec 21 04:23:12.611107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43150) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:12.657597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Deleting subnet ebe0e4be-6410-4124-aa1a-5df9e39edc4f {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:23:12.660719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.695897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.780686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.925850 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.958169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ebe0e4be-6410-4124-aa1a-5df9e39edc4f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:12.962282 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:12.966516 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98a67df7-d452-49c4-87d6-523aa1d001c9 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/ebe0e4be-6410-4124-aa1a-5df9e39edc4f HTTP/1.1" status: 204 len: 168 time: 0.3536289 Dec 21 04:23:12.968699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43152) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:12.972027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e0ac263-3d9e-4b36-8888-9f7534af4f24 None None] Network eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:23:13.045464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.114386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Deleting port b664a331-512d-42b3-982c-c439f488b63f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:13.114829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.154529 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] DHCP port deletion for eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:23:13.194592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] For port b664a331-512d-42b3-982c-c439f488b63f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b664a331-512d-42b3-982c-c439f488b63f,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:13.195201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.207710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Deleting port b664a331-512d-42b3-982c-c439f488b63f {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:13.208190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.213783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Calling delete_port for b664a331-512d-42b3-982c-c439f488b63f owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:13.278458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] For port b664a331-512d-42b3-982c-c439f488b63f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b664a331-512d-42b3-982c-c439f488b63f,segment=NetworkSegment(361b0dd0-371b-42cc-92f7-dcea5865d9a0),segment_id=361b0dd0-371b-42cc-92f7-dcea5865d9a0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:13.278860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.293389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Calling delete_port for b664a331-512d-42b3-982c-c439f488b63f owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:13.367005 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.374377 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.394469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Pushing event deleted for resources: {'Port': ['ID=b664a331-512d-42b3-982c-c439f488b63f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:13.397955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] No DVR routers for this DVR port b664a331-512d-42b3-982c-c439f488b63f on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:23:13.408082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Pushing event deleted for resources: {'Port': ['ID=b664a331-512d-42b3-982c-c439f488b63f,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:13.416109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] No DVR routers for this DVR port b664a331-512d-42b3-982c-c439f488b63f on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:23:13.418984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.419349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.419754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.420103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.420772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.420984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.421384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.421677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.422095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.422569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.422756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.423120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.423443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6a3fdee-c71c-4996-b573-26e4eb8e2d09 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:13.486188 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.506675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:13.515704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '361b0dd0-371b-42cc-92f7-dcea5865d9a0') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:13.516003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '361b0dd0-371b-42cc-92f7-dcea5865d9a0') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:13.525123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.538603 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.545364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:23:13.545768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:23:13.547463 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:23:13.701555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.702917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:13.706142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] 10.222.0.18 "DELETE /v2.0/networks/eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd HTTP/1.1" status: 204 len: 168 time: 0.7358255 Dec 21 04:23:13.709128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:13.718536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7247eb2d-d95f-4507-b5ca-8bade531f5ff admin admin] Pushing event deleted for resources: {'Network': ['ID=eeaecf07-fbc6-4eec-aa9b-d6fca86b29bd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:14.019055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c17c370f-f407-460c-94cb-a9d329ce8ca5 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:14.046291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: c17c370f-f407-460c-94cb-a9d329ce8ca5 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:14.046635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c17c370f-f407-460c-94cb-a9d329ce8ca5 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:14.047329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 241f2399-2c47-4de4-818d-5e152df6b298 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:14.069788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 241f2399-2c47-4de4-818d-5e152df6b298 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:14.069788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 241f2399-2c47-4de4-818d-5e152df6b298 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:14.069788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b664a331-512d-42b3-982c-c439f488b63f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:14.088731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b664a331-512d-42b3-982c-c439f488b63f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:14.090057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b664a331-512d-42b3-982c-c439f488b63f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:14.121666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:14.363488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Deleting port b11fb225-c024-4c12-b38e-3449e750781f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:14.363837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:14.444517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] For port b11fb225-c024-4c12-b38e-3449e750781f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b11fb225-c024-4c12-b38e-3449e750781f,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:14.444878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:14.457167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Calling delete_port for b11fb225-c024-4c12-b38e-3449e750781f owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:14.698130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:14.725012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Pushing event deleted for resources: {'Port': ['ID=b11fb225-c024-4c12-b38e-3449e750781f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:14.909633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:15.128434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Router 6f37793a-d264-49ca-9da9-5aa44999bff8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:23:15.234996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:23:15.243467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ad3340b8-2eb7-4127-abf1-4b35806111b1 admin admin] 10.222.0.18 "PUT /v2.0/routers/6f37793a-d264-49ca-9da9-5aa44999bff8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5297701 Dec 21 04:23:15.243580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43168) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:15.251133 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] Sync routers for ids ['6f37793a-d264-49ca-9da9-5aa44999bff8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:23:15.261242 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] Routers {'6f37793a-d264-49ca-9da9-5aa44999bff8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:23:15.261845 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6f37793a-d264-49ca-9da9-5aa44999bff8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:15.358579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:15.367002 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] Set router 6f37793a-d264-49ca-9da9-5aa44999bff8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:23:15.471764 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:15.546667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73'}], 'enable_snat': True}, 'gw_port_id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:23:14Z', 'revision_number': 5, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port': {'id': '015874db-1a79-4a2f-b883-e5fc957f7020', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:3e:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3755, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:22:26Z', 'updated_at': '2021-12-21T04:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:15.576250 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] Checking router: 6f37793a-d264-49ca-9da9-5aa44999bff8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:23:15.585224 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] Routers {'6f37793a-d264-49ca-9da9-5aa44999bff8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:23:15.585826 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:22:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6f37793a-d264-49ca-9da9-5aa44999bff8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:15.587740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Deleting port 015874db-1a79-4a2f-b883-e5fc957f7020 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:15.588389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:15.669313 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] Set router 6f37793a-d264-49ca-9da9-5aa44999bff8 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:23:15.675833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] For port 015874db-1a79-4a2f-b883-e5fc957f7020, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=015874db-1a79-4a2f-b883-e5fc957f7020,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:15.676269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:15.689083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Calling delete_port for 015874db-1a79-4a2f-b883-e5fc957f7020 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:15.816170 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:23:15Z', 'revision_number': 6, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:15.862112 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-955fe786-104c-45fd-bb81-82cc1a3488a3 None None] The sync data for ids ['6f37793a-d264-49ca-9da9-5aa44999bff8'] in n-d-822053-11 is: [{'id': '6f37793a-d264-49ca-9da9-5aa44999bff8', 'name': 'tempest-TestServerMultinode-1079210572-router', 'tenant_id': '3693cbd2a0364ba0897de8f176815a28', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:22:25Z', 'updated_at': '2021-12-21T04:23:15Z', 'revision_number': 6, 'project_id': '3693cbd2a0364ba0897de8f176815a28', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:23:15.961033 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:15.991836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Pushing event deleted for resources: {'Port': ['ID=015874db-1a79-4a2f-b883-e5fc957f7020,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:16.000236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0cba88b-e7b8-4eee-868c-11769b66bc3b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:23:16.052885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.143494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.145634 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.234103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.234795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6f37793a-d264-49ca-9da9-5aa44999bff8 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:16.240405 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.241910 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b0b16c4b-7b48-4020-9fb5-45abe6d1c0cb admin admin] 10.222.0.18 "DELETE /v2.0/routers/6f37793a-d264-49ca-9da9-5aa44999bff8 HTTP/1.1" status: 204 len: 168 time: 0.9973221 Dec 21 04:23:16.244581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43172) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:16.313768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b11fb225-c024-4c12-b38e-3449e750781f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:16.328030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Deleting subnet 72b6a657-162f-4a4b-85a8-f101720cb228 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:23:16.334013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.339460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b11fb225-c024-4c12-b38e-3449e750781f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:16.339808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b11fb225-c024-4c12-b38e-3449e750781f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:16.373120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.453694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.560536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.585895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=72b6a657-162f-4a4b-85a8-f101720cb228,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:16.592685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.596004 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3c076837-9822-4f14-8439-204b4a6cfc5b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/72b6a657-162f-4a4b-85a8-f101720cb228 HTTP/1.1" status: 204 len: 168 time: 0.3497558 Dec 21 04:23:16.598677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43174) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:16.601533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96dab305-e04d-4cb5-aa3e-fc0e1ad16ee1 None None] Network 8162401b-985d-47b5-98a2-49e7295bcdb9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:23:16.686838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.749634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Deleting port 145f098b-2b64-45bd-8b26-d862f5337913 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:16.750009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.780839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] DHCP port deletion for 8162401b-985d-47b5-98a2-49e7295bcdb9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:23:16.818825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] For port 145f098b-2b64-45bd-8b26-d862f5337913, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=145f098b-2b64-45bd-8b26-d862f5337913,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:16.819229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.833969 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Calling delete_port for 145f098b-2b64-45bd-8b26-d862f5337913 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:16.845287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] Deleting port 145f098b-2b64-45bd-8b26-d862f5337913 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:16.845778 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.920805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] For port 145f098b-2b64-45bd-8b26-d862f5337913, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=145f098b-2b64-45bd-8b26-d862f5337913,segment=NetworkSegment(20bbb1e8-cb3f-4128-a47c-a23eed338223),segment_id=20bbb1e8-cb3f-4128-a47c-a23eed338223)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:16.922793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:16.942646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] Calling delete_port for 145f098b-2b64-45bd-8b26-d862f5337913 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:17.023843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.030487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.062361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] Pushing event deleted for resources: {'Port': ['ID=145f098b-2b64-45bd-8b26-d862f5337913,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:17.064215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Pushing event deleted for resources: {'Port': ['ID=145f098b-2b64-45bd-8b26-d862f5337913,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:17.066600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f0e0350-d010-48ac-8c1c-b1b768416ce1 None None] No DVR routers for this DVR port 145f098b-2b64-45bd-8b26-d862f5337913 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:23:17.078442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] No DVR routers for this DVR port 145f098b-2b64-45bd-8b26-d862f5337913 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:23:17.159231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.181699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8162401b-985d-47b5-98a2-49e7295bcdb9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:17.192242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '20bbb1e8-cb3f-4128-a47c-a23eed338223') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:17.192532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '20bbb1e8-cb3f-4128-a47c-a23eed338223') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:17.202365 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.215961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.222041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:23:17.222516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:23:17.224296 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:23:17.349449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.355884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.358955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] 10.222.0.18 "DELETE /v2.0/networks/8162401b-985d-47b5-98a2-49e7295bcdb9 HTTP/1.1" status: 204 len: 168 time: 0.7592137 Dec 21 04:23:17.371044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bd07e43-f0b2-4dd6-a3d7-86b34bbfe55e admin admin] Pushing event deleted for resources: {'Network': ['ID=8162401b-985d-47b5-98a2-49e7295bcdb9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:17.739558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43180) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:17.783594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1d998b3e-d8b6-4ead-a5e9-1a8d4fa1e95c admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3a1deef4e9cd439ab363eead886eb316&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0428190 Dec 21 04:23:17.786013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43182) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:17.833374 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-214dcbb5-142e-4f0d-9ab0-a8e3ba6abe61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:17.856231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-214dcbb5-142e-4f0d-9ab0-a8e3ba6abe61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.005456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 015874db-1a79-4a2f-b883-e5fc957f7020 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:18.005631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-214dcbb5-142e-4f0d-9ab0-a8e3ba6abe61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.008511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-214dcbb5-142e-4f0d-9ab0-a8e3ba6abe61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.009798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-214dcbb5-142e-4f0d-9ab0-a8e3ba6abe61 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/525b06c8-0567-4d85-8e6f-ec4ab583e7c0 HTTP/1.1" status: 204 len: 168 time: 0.2228868 Dec 21 04:23:18.019804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214dcbb5-142e-4f0d-9ab0-a8e3ba6abe61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=525b06c8-0567-4d85-8e6f-ec4ab583e7c0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:18.034086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 015874db-1a79-4a2f-b883-e5fc957f7020 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:18.034575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 015874db-1a79-4a2f-b883-e5fc957f7020 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:18.034842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 145f098b-2b64-45bd-8b26-d862f5337913 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:23:18.058601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 145f098b-2b64-45bd-8b26-d862f5337913 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:23:18.059207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 145f098b-2b64-45bd-8b26-d862f5337913 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:23:18.761601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43190) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:18.800728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-897f732c-9c24-483a-910a-4f2c7fbf4081 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3693cbd2a0364ba0897de8f176815a28&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0379300 Dec 21 04:23:18.803125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43192) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:18.849553 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbbad378-a6a6-4d3a-830d-28c420c4aac3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.871440 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbbad378-a6a6-4d3a-830d-28c420c4aac3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.995043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbbad378-a6a6-4d3a-830d-28c420c4aac3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.998266 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cbbad378-a6a6-4d3a-830d-28c420c4aac3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:18.999464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cbbad378-a6a6-4d3a-830d-28c420c4aac3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0d7493d2-2e5b-4d69-b58b-8950b254ad66 HTTP/1.1" status: 204 len: 168 time: 0.1954396 Dec 21 04:23:19.009153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbad378-a6a6-4d3a-830d-28c420c4aac3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d7493d2-2e5b-4d69-b58b-8950b254ad66,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:19.903783 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfa69956-cb56-4aa4-9a90-d35e73eaafff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:22.663785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb7f4cdf-d16a-4335-bc12-d1628c040e48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:23.074149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:23.360847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:25.075208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:25.166004 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:25.766395 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:26.769140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43246) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:26.912422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1561ee2-17a2-4cd1-94dc-4e646cda78f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:26.998189 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1561ee2-17a2-4cd1-94dc-4e646cda78f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:27.097864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e1561ee2-17a2-4cd1-94dc-4e646cda78f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:27.134845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1561ee2-17a2-4cd1-94dc-4e646cda78f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef853482-2846-4999-a129-6f6d87f6a2b7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:27.139649 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e1561ee2-17a2-4cd1-94dc-4e646cda78f5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=488c713c54fc422989ac00ce2f089b27&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3689191 Dec 21 04:23:27.141774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43250) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:27.199353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96c27602-9611-40ca-91b4-dc17f4b807ad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:27.220294 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96c27602-9611-40ca-91b4-dc17f4b807ad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:27.332394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96c27602-9611-40ca-91b4-dc17f4b807ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:27.334973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-96c27602-9611-40ca-91b4-dc17f4b807ad admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:27.336125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-96c27602-9611-40ca-91b4-dc17f4b807ad admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/ef853482-2846-4999-a129-6f6d87f6a2b7 HTTP/1.1" status: 204 len: 168 time: 0.1932399 Dec 21 04:23:27.344380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c27602-9611-40ca-91b4-dc17f4b807ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef853482-2846-4999-a129-6f6d87f6a2b7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:31.297261 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:31.408130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61e40bf8-1bb2-483b-af5f-cb4db9e075e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.480115 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61e40bf8-1bb2-483b-af5f-cb4db9e075e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.583797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61e40bf8-1bb2-483b-af5f-cb4db9e075e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.621647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e40bf8-1bb2-483b-af5f-cb4db9e075e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa52936a-e60f-48e5-98ff-ea26de7d79ab,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:31.628652 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61e40bf8-1bb2-483b-af5f-cb4db9e075e5 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=13465910b64d468fae76d770655a596c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3278339 Dec 21 04:23:31.629054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43376) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:31.692384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11017baf-e57d-459f-930f-05314bc9e355 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.715028 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11017baf-e57d-459f-930f-05314bc9e355 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.846726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11017baf-e57d-459f-930f-05314bc9e355 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.849613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-11017baf-e57d-459f-930f-05314bc9e355 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:31.850835 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-11017baf-e57d-459f-930f-05314bc9e355 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/aa52936a-e60f-48e5-98ff-ea26de7d79ab HTTP/1.1" status: 204 len: 168 time: 0.2208779 Dec 21 04:23:31.858787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11017baf-e57d-459f-930f-05314bc9e355 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa52936a-e60f-48e5-98ff-ea26de7d79ab,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:32.428835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43384) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:32.442264 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd1a1815-bc58-48e2-a22e-ee4b388636cb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.515061 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd1a1815-bc58-48e2-a22e-ee4b388636cb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.594362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cd1a1815-bc58-48e2-a22e-ee4b388636cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.631056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd1a1815-bc58-48e2-a22e-ee4b388636cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82bfe3fe-6cab-4b64-98a1-86016d37eb43,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:32.636272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cd1a1815-bc58-48e2-a22e-ee4b388636cb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7da89c22e56f4340aa320dd2042017a2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2064397 Dec 21 04:23:32.638958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43386) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:32.688673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1d049c6-49cd-4828-ae5d-341bdf86db70 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.709327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1d049c6-49cd-4828-ae5d-341bdf86db70 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.846027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1d049c6-49cd-4828-ae5d-341bdf86db70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.848665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1d049c6-49cd-4828-ae5d-341bdf86db70 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:32.849827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f1d049c6-49cd-4828-ae5d-341bdf86db70 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/82bfe3fe-6cab-4b64-98a1-86016d37eb43 HTTP/1.1" status: 204 len: 168 time: 0.2098832 Dec 21 04:23:32.858189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1d049c6-49cd-4828-ae5d-341bdf86db70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82bfe3fe-6cab-4b64-98a1-86016d37eb43,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:34.867023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43434) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:34.966915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3de5a265-d30f-464b-a485-24369771e706 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-174010135'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:34.971070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3de5a265-d30f-464b-a485-24369771e706 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Unknown quota resources ['metering_label']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:23:35.195228 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3de5a265-d30f-464b-a485-24369771e706 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:35.196372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3de5a265-d30f-464b-a485-24369771e706 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 477 time: 0.3283014 Dec 21 04:23:35.199219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43438) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:35.203269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-94d6ad1f-4f18-466b-b300-478eb52666d7 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': 'e2a4e7f5-99f1-4978-a9e3-9ea4f553dac2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:35.203748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-94d6ad1f-4f18-466b-b300-478eb52666d7 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:23:35.674380 n-d-822053-11 neutron-server[110310]: WARNING neutron.services.metering.metering_plugin [None req-94d6ad1f-4f18-466b-b300-478eb52666d7 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 21 04:23:35.775864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-94d6ad1f-4f18-466b-b300-478eb52666d7 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:35.777057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-94d6ad1f-4f18-466b-b300-478eb52666d7 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.5768809 Dec 21 04:23:35.780267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43442) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:35.784673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-be0979ba-bf10-4b27-a1cd-1ac7ed39ee01 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': 'e2a4e7f5-99f1-4978-a9e3-9ea4f553dac2'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:35.785147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-be0979ba-bf10-4b27-a1cd-1ac7ed39ee01 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:23:35.904115 n-d-822053-11 neutron-server[110310]: WARNING neutron.services.metering.metering_plugin [None req-be0979ba-bf10-4b27-a1cd-1ac7ed39ee01 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 21 04:23:35.986688 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be0979ba-bf10-4b27-a1cd-1ac7ed39ee01 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:35.987802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-be0979ba-bf10-4b27-a1cd-1ac7ed39ee01 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.2065279 Dec 21 04:23:35.990403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43444) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.001384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e719170a-2ce3-4572-9276-91dab5609efc tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules?id=e3818407-525b-47cc-9101-0d54098fe52c HTTP/1.1" status: 200 len: 462 time: 0.0099030 Dec 21 04:23:36.003704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43446) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.201978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9db8d47e-76d0-49d3-a243-f55e652c5432 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:36.203732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9db8d47e-76d0-49d3-a243-f55e652c5432 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-label-rules/e3818407-525b-47cc-9101-0d54098fe52c HTTP/1.1" status: 204 len: 168 time: 0.1985488 Dec 21 04:23:36.206335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43448) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.214638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-945dc7e1-8fdc-40a8-a883-dea81490db5e tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules?id=e3818407-525b-47cc-9101-0d54098fe52c HTTP/1.1" status: 200 len: 221 time: 0.0072899 Dec 21 04:23:36.217818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43450) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.221880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7b6a8ec6-0cf4-4098-b44f-3cea04cbb0b2 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--2059539916', 'description': 'label created by tempest'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:36.222326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7b6a8ec6-0cf4-4098-b44f-3cea04cbb0b2 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Unknown quota resources ['metering_label']. {{(pid=110310) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 21 04:23:36.450645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7b6a8ec6-0cf4-4098-b44f-3cea04cbb0b2 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:36.455238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7b6a8ec6-0cf4-4098-b44f-3cea04cbb0b2 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.2329845 Dec 21 04:23:36.456404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.537271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2e35ef73-d5df-4b1c-b762-d1fad5a08077 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels?id=afba1538-3cc2-4533-bdde-5406a28e0617 HTTP/1.1" status: 200 len: 468 time: 0.0759118 Dec 21 04:23:36.537520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43460) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.798469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a169f829-0532-4999-8d85-b991f79b9462 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:36.802380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a169f829-0532-4999-8d85-b991f79b9462 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-labels/afba1538-3cc2-4533-bdde-5406a28e0617 HTTP/1.1" status: 204 len: 168 time: 0.2613215 Dec 21 04:23:36.802742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43464) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.817278 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fdcddb57-9e2d-4304-bf6a-f1b1a069127b tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels?id=afba1538-3cc2-4533-bdde-5406a28e0617 HTTP/1.1" status: 200 len: 216 time: 0.0133333 Dec 21 04:23:36.820708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43466) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.831415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7bab92c5-a906-4afa-a8dd-0db3dd588784 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0092187 Dec 21 04:23:36.834604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43468) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.845661 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7feabec0-fe03-4c0e-a2ba-11c3c7bdf0c6 tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0099096 Dec 21 04:23:36.849024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43470) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.907953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f1fea537-8dfc-4540-b42a-028ccf6b73fa tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-labels/e2a4e7f5-99f1-4978-a9e3-9ea4f553dac2 HTTP/1.1" status: 200 len: 472 time: 0.0568333 Dec 21 04:23:36.912137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43472) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.925856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43474) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:36.926849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-47882f84-5242-4d47-9f1d-65bd24878cbc tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "GET /v2.0/metering/metering-label-rules/e23d9974-6152-44b4-8b37-6d2e57e2a956 HTTP/1.1" status: 200 len: 459 time: 0.0134394 Dec 21 04:23:37.114287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0b09955c-586a-4e54-9849-117bfede46bd tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:37.115446 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0b09955c-586a-4e54-9849-117bfede46bd tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-label-rules/e23d9974-6152-44b4-8b37-6d2e57e2a956 HTTP/1.1" status: 204 len: 168 time: 0.1880426 Dec 21 04:23:37.117942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43476) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:37.391290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bdbc867-2d49-4d23-90c8-e71193ee15ec tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:37.392544 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8bdbc867-2d49-4d23-90c8-e71193ee15ec tempest-MeteringIpV6TestJSON-203461874 tempest-MeteringIpV6TestJSON-203461874-project-admin] 10.222.0.18 "DELETE /v2.0/metering/metering-labels/e2a4e7f5-99f1-4978-a9e3-9ea4f553dac2 HTTP/1.1" status: 204 len: 168 time: 0.2735207 Dec 21 04:23:37.844666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43484) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:37.976060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39e0219f-64f9-47ab-9fc3-eeb8eeb01b5e admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.049435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39e0219f-64f9-47ab-9fc3-eeb8eeb01b5e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.098011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-39e0219f-64f9-47ab-9fc3-eeb8eeb01b5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.139939 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-39e0219f-64f9-47ab-9fc3-eeb8eeb01b5e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=02338e5faf384911a868c4a2b0717ecf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2946439 Dec 21 04:23:38.140710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e0219f-64f9-47ab-9fc3-eeb8eeb01b5e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e37aba0-a0bc-4faf-8b00-357f7bffa6ca,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:38.143670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43488) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:38.196772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b83a0b5-2e13-46cb-830e-39cf472ebc4a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.217616 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b83a0b5-2e13-46cb-830e-39cf472ebc4a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.326352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b83a0b5-2e13-46cb-830e-39cf472ebc4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.329018 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b83a0b5-2e13-46cb-830e-39cf472ebc4a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.330183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b83a0b5-2e13-46cb-830e-39cf472ebc4a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4e37aba0-a0bc-4faf-8b00-357f7bffa6ca HTTP/1.1" status: 204 len: 168 time: 0.1846058 Dec 21 04:23:38.339626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b83a0b5-2e13-46cb-830e-39cf472ebc4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e37aba0-a0bc-4faf-8b00-357f7bffa6ca,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:38.874355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:38.887526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d7e114b-1903-47b2-b488-7be4207b28d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:38.964322 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d7e114b-1903-47b2-b488-7be4207b28d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:39.052298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d7e114b-1903-47b2-b488-7be4207b28d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:39.096229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d7e114b-1903-47b2-b488-7be4207b28d4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e44ae1f4f3434e2a952fdb63e2971edb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2206755 Dec 21 04:23:39.097089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d7e114b-1903-47b2-b488-7be4207b28d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4323674-11f3-4bc0-bbe0-3d0b037f9ec2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:39.099069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43502) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:39.147788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b52879-11c3-4d1e-8ed9-69fc52d0f426 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:39.169254 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b52879-11c3-4d1e-8ed9-69fc52d0f426 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:39.280303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b52879-11c3-4d1e-8ed9-69fc52d0f426 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:39.283435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-76b52879-11c3-4d1e-8ed9-69fc52d0f426 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:39.284662 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76b52879-11c3-4d1e-8ed9-69fc52d0f426 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a4323674-11f3-4bc0-bbe0-3d0b037f9ec2 HTTP/1.1" status: 204 len: 168 time: 0.1840234 Dec 21 04:23:39.292632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b52879-11c3-4d1e-8ed9-69fc52d0f426 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4323674-11f3-4bc0-bbe0-3d0b037f9ec2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:41.098286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:41.196559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-2060240798'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:41.315397 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:41.316344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:41.369690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:41.423127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:41.482367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:41.483696 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5a0fff25-5ffd-4afd-8ee5-e43d5ae2eb63 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 0.3843155 Dec 21 04:23:41.488927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:41.558826 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.028925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.031150 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.144624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.145276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Fanout notify agent at l3_agent the message router_deleted on router b30eeba2-bc7a-48ce-a8f5-2b1d0e90139d {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:42.159888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.159888 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cbe0dbbc-579a-4b70-9a7e-612e64429c1c tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "DELETE /v2.0/routers/b30eeba2-bc7a-48ce-a8f5-2b1d0e90139d HTTP/1.1" status: 204 len: 168 time: 0.6679077 Dec 21 04:23:42.161536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43554) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:42.165940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Request body: {'router': {'name': 'tempest-router-269548028', 'distributed': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:42.268245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.268245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.321751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.389172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.477458 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.478687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cb06b212-fa16-44f9-897f-debbedf594e5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.3161457 Dec 21 04:23:42.481520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43558) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:42.554138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.716813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.719518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.829975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.830408 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 206b30e2-8fc2-4bb8-9bc3-ca1006c79a13 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:42.834735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.835785 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8351a465-4236-4351-9749-ceb50f88f6c5 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "DELETE /v2.0/routers/206b30e2-8fc2-4bb8-9bc3-ca1006c79a13 HTTP/1.1" status: 204 len: 168 time: 0.3533335 Dec 21 04:23:42.840079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43560) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:42.845718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Request body: {'router': {'name': 'tempest-router-1079546178', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': 'b6442fa8e3214c7cae814cf041ff0748'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:42.943999 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.945037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:42.995522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.051811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.128571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.129699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c9bcae0-f0ce-426a-a980-7295e6b66ed4 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.2886145 Dec 21 04:23:43.132270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43562) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:43.136480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Request body: {'router': {'distributed': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:43.335936 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7874137', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7876236', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-14300'] for router, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.336571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.414581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=110311) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Dec 21 04:23:43.414913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Router cccf0a77-0284-4f8a-82ef-4e8dba460c5f migrating from provider to provider. {{(pid=110311) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Dec 21 04:23:43.415392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.421552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.497962 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7874158', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7874167', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7876245'] for router, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.585452 n-d-822053-11 neutron-server[110311]: WARNING neutron.scheduler.l3_agent_scheduler [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] No L3 agents can host the router cccf0a77-0284-4f8a-82ef-4e8dba460c5f Dec 21 04:23:43.701852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Hosts for router cccf0a77-0284-4f8a-82ef-4e8dba460c5f: [] {{(pid=110311) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Dec 21 04:23:43.726329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Hosts for other DVR routers connected to router cccf0a77-0284-4f8a-82ef-4e8dba460c5f: set() {{(pid=110311) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Dec 21 04:23:43.729079 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:43.730311 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ed037e9b-003b-455e-b624-69033dfb486b tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "PUT /v2.0/routers/cccf0a77-0284-4f8a-82ef-4e8dba460c5f HTTP/1.1" status: 200 len: 717 time: 0.5971224 Dec 21 04:23:43.732883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:43.811877 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a6789964-db12-4db4-8320-2bc63b8df473 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "GET /v2.0/routers/cccf0a77-0284-4f8a-82ef-4e8dba460c5f HTTP/1.1" status: 200 len: 717 time: 0.0756629 Dec 21 04:23:43.812970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43568) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:43.981535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-04a1c697-4e78-4c42-9add-0547fa3be3ed tempest-RoutersTestDVR-550273604 tempest-RoutersTestDVR-550273604-project] 10.222.0.18 "GET /v2.0/routers/cccf0a77-0284-4f8a-82ef-4e8dba460c5f HTTP/1.1" status: 200 len: 683 time: 0.1672456 Dec 21 04:23:43.984153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43572) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:44.062199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.216921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.219009 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.309636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.310170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Fanout notify agent at l3_agent the message router_deleted on router cccf0a77-0284-4f8a-82ef-4e8dba460c5f {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:44.315207 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.316326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-235e5f45-901c-4078-921d-5e1b28071b85 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "DELETE /v2.0/routers/cccf0a77-0284-4f8a-82ef-4e8dba460c5f HTTP/1.1" status: 204 len: 168 time: 0.3312795 Dec 21 04:23:44.319827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43578) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:44.327572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Request body: {'router': {'name': 'tempest-router-1067505108', 'distributed': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:44.401274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.402241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.456062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.554707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.647815 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.649068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-369c680d-3206-48f8-8a74-913591234f20 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.3282392 Dec 21 04:23:44.652054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43582) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:44.725751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.883284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.885367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.989822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.990325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 7904f799-5327-421d-8a9e-3eea4cdfe21a {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:44.994543 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:44.999397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3f5802b7-864b-412b-8f8c-09f0d6927923 tempest-RoutersTestDVR-1608467763 tempest-RoutersTestDVR-1608467763-project-admin] 10.222.0.18 "DELETE /v2.0/routers/7904f799-5327-421d-8a9e-3eea4cdfe21a HTTP/1.1" status: 204 len: 168 time: 0.3463223 Dec 21 04:23:45.418069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:45.524212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6c3dc61-d814-422f-bc25-4a09ed46c4b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.608252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6c3dc61-d814-422f-bc25-4a09ed46c4b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.674246 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6c3dc61-d814-422f-bc25-4a09ed46c4b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.713641 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d6c3dc61-d814-422f-bc25-4a09ed46c4b6 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b6442fa8e3214c7cae814cf041ff0748&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2944789 Dec 21 04:23:45.714791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c3dc61-d814-422f-bc25-4a09ed46c4b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b09613ba-1558-4133-9d5a-24d12a46140c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:45.716294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43594) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:45.769449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdb45f9-e8c3-4d01-bbad-bd62e82cc99d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.789984 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdb45f9-e8c3-4d01-bbad-bd62e82cc99d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.937520 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdb45f9-e8c3-4d01-bbad-bd62e82cc99d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.940244 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afdb45f9-e8c3-4d01-bbad-bd62e82cc99d admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:45.941436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-afdb45f9-e8c3-4d01-bbad-bd62e82cc99d admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/b09613ba-1558-4133-9d5a-24d12a46140c HTTP/1.1" status: 204 len: 168 time: 0.2241659 Dec 21 04:23:45.949817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdb45f9-e8c3-4d01-bbad-bd62e82cc99d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b09613ba-1558-4133-9d5a-24d12a46140c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:46.464883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-93ee1a20-5b06-46ff-b595-51bd687250ee req-c42324b7-1167-463b-8191-3e36fa4ab740 tempest-TestNetworkBasicOps-1606583118 tempest-TestNetworkBasicOps-1606583118-project] (110311) timed out ('10.222.0.31', 52079) {{(pid=110311) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:23:46.596266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43600) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:46.610921 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11171fe9-01f4-428c-b46c-d4f02d9c2742 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:46.687967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-cb380268-9b4a-4b21-93f0-6722a118fca1 req-0f06ace4-4016-4954-a05c-c5f372594b93 tempest-TestServerAdvancedOps-1404431587 tempest-TestServerAdvancedOps-1404431587-project] (110310) timed out ('10.222.0.54', 58379) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:23:46.689709 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11171fe9-01f4-428c-b46c-d4f02d9c2742 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:46.767180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-11171fe9-01f4-428c-b46c-d4f02d9c2742 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:46.805332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-11171fe9-01f4-428c-b46c-d4f02d9c2742 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=1660c39f7dce4c3887273836c1725bee&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2079456 Dec 21 04:23:46.806289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11171fe9-01f4-428c-b46c-d4f02d9c2742 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f97f6f0e-c69d-4ed5-aea0-bc680d04e52c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:46.808359 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43604) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:46.861286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6f4aa85-2fed-4fb1-8841-5ca7ba011b65 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:46.882618 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6f4aa85-2fed-4fb1-8841-5ca7ba011b65 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:47.006788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6f4aa85-2fed-4fb1-8841-5ca7ba011b65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:47.010100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e6f4aa85-2fed-4fb1-8841-5ca7ba011b65 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:47.011292 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e6f4aa85-2fed-4fb1-8841-5ca7ba011b65 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/f97f6f0e-c69d-4ed5-aea0-bc680d04e52c HTTP/1.1" status: 204 len: 168 time: 0.2017934 Dec 21 04:23:47.021272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f4aa85-2fed-4fb1-8841-5ca7ba011b65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f97f6f0e-c69d-4ed5-aea0-bc680d04e52c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:48.772545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43660) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:48.873288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-1259193901', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:48.893181 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:23:48.960170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Made reservation on behalf of dc453819abec4a60b37beabea42de97c for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:23:48.962551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:48.972212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.050210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.115228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.120798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] device_id is not set on port 8c3717e7-aba5-4361-95a5-8fbea71d9396 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:23:49.176814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be44fcb3-641e-45e3-83f3-4f411acb69b3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:49.237975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Allocated IP 172.25.5.24 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/8c3717e7-aba5-4361-95a5-8fbea71d9396) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:23:49.372350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.464391 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.506652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:23:49.510002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:23:49.513788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:23:49.526478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3536c603-348b-407f-9356-4785b8ed799e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:23:49.539845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Pushing event updated for resources: {'Port': ['ID=8c3717e7-aba5-4361-95a5-8fbea71d9396,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:49.564678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:49.565281 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.632049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f6a72712-f65c-40d1-9d0d-b180852380c6 None None] Provisioning complete for port 8c3717e7-aba5-4361-95a5-8fbea71d9396 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:49.632275 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0d25810b-ff23-4105-92a4-e1fbc107bbb0 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1036 time: 0.8583913 Dec 21 04:23:49.632840 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f6a72712-f65c-40d1-9d0d-b180852380c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.635296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43666) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:49.640299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.24'}]}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:49.666651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f6a72712-f65c-40d1-9d0d-b180852380c6 None None] Port 8c3717e7-aba5-4361-95a5-8fbea71d9396 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:23:49.721344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.722450 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.772609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.886797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cbc46c62-6e98-4458-ab27-fdc15dd7bc4b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:49.995270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.274487 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.297051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.458347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.615973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.618031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.749597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.750780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Fanout notify agent at l3_agent the message router_deleted on router ce301d80-2324-4d16-86e2-9027a3e7d9f9 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:23:50.806727 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] create failed (client error): There was a conflict when trying to complete your request. Dec 21 04:23:50.808132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f63f9e0c-9b82-4cef-a6c4-bf88bebd8106 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 1.1716285 Dec 21 04:23:50.811016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43670) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:50.886912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Deleting port 8c3717e7-aba5-4361-95a5-8fbea71d9396 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:50.887297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.966189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:50.977706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Calling delete_port for 8c3717e7-aba5-4361-95a5-8fbea71d9396 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:51.155582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:51.188338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Pushing event deleted for resources: {'Port': ['ID=8c3717e7-aba5-4361-95a5-8fbea71d9396,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:51.207141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b01a2ce0-2c5e-42bd-a0e2-6959e3e593f8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:23:51.257681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:51.264041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bf89361f-d57a-4a83-b1f4-9ed05c26fa70 tempest-RoutersAdminNegativeIpV6Test-1731006671 tempest-RoutersAdminNegativeIpV6Test-1731006671-project-admin] 10.222.0.18 "DELETE /v2.0/ports/8c3717e7-aba5-4361-95a5-8fbea71d9396 HTTP/1.1" status: 204 len: 168 time: 0.4490426 Dec 21 04:23:51.748090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43682) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:51.864182 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c4b15ed-8293-4d3e-a6d6-734dfc617088 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:51.944323 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c4b15ed-8293-4d3e-a6d6-734dfc617088 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.028935 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9c4b15ed-8293-4d3e-a6d6-734dfc617088 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.072758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9c4b15ed-8293-4d3e-a6d6-734dfc617088 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=dc0027eb31d34b9da2850387758ee43b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3210638 Dec 21 04:23:52.072980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43686) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:52.080543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4b15ed-8293-4d3e-a6d6-734dfc617088 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=947d5599-2bf7-465f-9945-e68945ce7e0f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:52.141417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8846a16f-bb61-4be9-9ee9-e9014cf8b5de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.162681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8846a16f-bb61-4be9-9ee9-e9014cf8b5de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.280973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8846a16f-bb61-4be9-9ee9-e9014cf8b5de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.284741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8846a16f-bb61-4be9-9ee9-e9014cf8b5de admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.288330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8846a16f-bb61-4be9-9ee9-e9014cf8b5de admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/947d5599-2bf7-465f-9945-e68945ce7e0f HTTP/1.1" status: 204 len: 168 time: 0.2121599 Dec 21 04:23:52.295115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8846a16f-bb61-4be9-9ee9-e9014cf8b5de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=947d5599-2bf7-465f-9945-e68945ce7e0f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:52.669391 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c10c6bcf-afe6-418a-9b99-1ee40fad73f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:52.989465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43694) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:53.027954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c0de4854-2564-4fa9-ad43-0c891f4381b8 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=dc453819abec4a60b37beabea42de97c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0374370 Dec 21 04:23:53.030468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43696) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:53.075556 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:53.079657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1f5efae-1d94-43db-8d6b-296322a076e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:53.103585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1f5efae-1d94-43db-8d6b-296322a076e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:53.206802 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1f5efae-1d94-43db-8d6b-296322a076e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:53.209416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f1f5efae-1d94-43db-8d6b-296322a076e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:53.210607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f1f5efae-1d94-43db-8d6b-296322a076e2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/be44fcb3-641e-45e3-83f3-4f411acb69b3 HTTP/1.1" status: 204 len: 168 time: 0.1786935 Dec 21 04:23:53.219490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f5efae-1d94-43db-8d6b-296322a076e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be44fcb3-641e-45e3-83f3-4f411acb69b3,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:53.344188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.246818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43724) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:54.343275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-1684247210'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:54.435235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:23:54.438861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.450267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.530068 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.588880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.618722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:23:54.624142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'SecurityGroup': ['ID=12ceb68c-a26b-4b09-89ba-8c4e94ae5c2e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:54.632462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.632798 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Added segment b91564f8-841b-4a0a-813b-d648b8d9395a of type vlan for network 9a7534dd-cb36-4278-8600-3bfba1f41e16 Dec 21 04:23:54.675031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.754590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.760387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:54.761008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:54.832877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Network': ['ID=9a7534dd-cb36-4278-8600-3bfba1f41e16,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:54.845599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:23:54.884298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-33b97763-a7c8-4865-b0b7-38ab1b314dd0 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 0.6362641 Dec 21 04:23:54.887408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43730) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:54.893588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'subnet': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:55.051609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:23:55.055390 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.161400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.184256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.292147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.356161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Subnet': ['ID=19922169-2a09-4259-8885-9ae54e91b05c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:55.365303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Checking segment: {'id': 'b91564f8-841b-4a0a-813b-d648b8d9395a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:23:55.365691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network hostable DHCP agents. Network: 9a7534dd-cb36-4278-8600-3bfba1f41e16, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:23:55.435504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:23:55.509424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 9a7534dd-cb36-4278-8600-3bfba1f41e16) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:23:55.513475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:55.514173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.518469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e13b18a-4780-49f6-9e31-4390cade5f80 None None] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:23:55.614678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fdaa8d86-48e6-4518-9653-010180ee2455 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7217968 Dec 21 04:23:55.614678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43732) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:55.618264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'name': 'tempest-AllowedAddressPairTestJSON-1579218288'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:55.624418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-9a7534dd-cb36-4278-8600-3bfba1f41e16', 'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'project_id': 'f58248f4ae074e6283e64c72bb240d3e', 'fixed_ips': [{'subnet_id': '19922169-2a09-4259-8885-9ae54e91b05c'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:23:55.625964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.773333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Allocated IP 172.20.0.2 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/16e0a604-8659-41da-934f-e0959204017e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:23:55.805942 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.846753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:23:55.851591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.874065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] device_id is not set on port 6372f655-5e2b-46c2-8592-5310ad3c2a68 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:23:55.930544 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:55.985553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.022129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:23:56.025542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:23:56.028675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:23:56.051386 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Allocated IP 172.20.0.12 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/6372f655-5e2b-46c2-8592-5310ad3c2a68) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:23:56.073134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Pushing event updated for resources: {'Port': ['ID=16e0a604-8659-41da-934f-e0959204017e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:56.102513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Attempting to bind port 16e0a604-8659-41da-934f-e0959204017e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:23:56.102905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Attempting to bind port 16e0a604-8659-41da-934f-e0959204017e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b91564f8-841b-4a0a-813b-d648b8d9395a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:23:56.103302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Attempting to bind port 16e0a604-8659-41da-934f-e0959204017e on network 9a7534dd-cb36-4278-8600-3bfba1f41e16 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:23:56.108464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:23:56.108798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Checking segment: {'id': 'b91564f8-841b-4a0a-813b-d648b8d9395a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:23:56.109236 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.109634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Bound using segment: {'id': 'b91564f8-841b-4a0a-813b-d648b8d9395a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:23:56.110100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Bound port: 16e0a604-8659-41da-934f-e0959204017e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b91564f8-841b-4a0a-813b-d648b8d9395a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:23:56.110483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.172713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] For port 16e0a604-8659-41da-934f-e0959204017e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:23:56.175784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] For port 16e0a604-8659-41da-934f-e0959204017e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16e0a604-8659-41da-934f-e0959204017e,segment=NetworkSegment(b91564f8-841b-4a0a-813b-d648b8d9395a),segment_id=b91564f8-841b-4a0a-813b-d648b8d9395a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:23:56.216099 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.258438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.311731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.315492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57a3d56b-c049-4aa4-a4ff-53273b934c9b None None] Pushing event updated for resources: {'Port': ['ID=16e0a604-8659-41da-934f-e0959204017e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:56.361037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:23:56.364398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:23:56.368210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:23:56.396374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=6372f655-5e2b-46c2-8592-5310ad3c2a68,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:56.422522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:56.423250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.512524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0ce73e50-11c8-4c42-a8e9-252564af7bd3 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8983305 Dec 21 04:23:56.515938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43736) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:56.520792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'name': 'tempest-AllowedAddressPairTestJSON-572596316', 'allowed_address_pairs': [{'ip_address': '172.20.0.12', 'mac_address': 'fa:16:3e:c1:a6:9a'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:56.738063 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:23:56.827121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:56.843647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] device_id is not set on port a9a37e68-e690-4d6c-b8ee-49ab7517fd22 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:23:56.957350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Allocated IP 172.20.0.4 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/a9a37e68-e690-4d6c-b8ee-49ab7517fd22) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:23:57.126960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.213127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.261224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:23:57.264299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:23:57.268039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:23:57.274971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=a9a37e68-e690-4d6c-b8ee-49ab7517fd22,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:57.317301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8db4c2b1-f3fd-415c-aa07-0f41d7abb1a6 None None] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:23:57.337452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:57.338097 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.399260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bdbf4139-689d-4fb5-9b8d-c582df0d1c3d None None] Provisioning complete for port 16e0a604-8659-41da-934f-e0959204017e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:57.399668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdbf4139-689d-4fb5-9b8d-c582df0d1c3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.414876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ab03a816-e7f2-4675-bb17-2c22a84751d8 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 998 time: 0.8978972 Dec 21 04:23:57.417275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43740) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:57.473330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a81add-9fb7-4da4-9005-5ca35c01c518 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:57.480745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a81add-9fb7-4da4-9005-5ca35c01c518 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:57.487740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a81add-9fb7-4da4-9005-5ca35c01c518 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:57.492092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-83a81add-9fb7-4da4-9005-5ca35c01c518 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2465 time: 0.0710421 Dec 21 04:23:57.492351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43742) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:57.519503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdbf4139-689d-4fb5-9b8d-c582df0d1c3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.564969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bdbf4139-689d-4fb5-9b8d-c582df0d1c3d None None] For port 16e0a604-8659-41da-934f-e0959204017e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16e0a604-8659-41da-934f-e0959204017e,segment=NetworkSegment(b91564f8-841b-4a0a-813b-d648b8d9395a),segment_id=b91564f8-841b-4a0a-813b-d648b8d9395a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:23:57.594634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port a9a37e68-e690-4d6c-b8ee-49ab7517fd22 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:23:57.595328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.667389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bdbf4139-689d-4fb5-9b8d-c582df0d1c3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.728173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdbf4139-689d-4fb5-9b8d-c582df0d1c3d None None] Pushing event updated for resources: {'Port': ['ID=16e0a604-8659-41da-934f-e0959204017e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:57.791712 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Provisioning complete for port 16e0a604-8659-41da-934f-e0959204017e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:57.792548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:57.839630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43746) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:57.982811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Provisioning complete for port 6372f655-5e2b-46c2-8592-5310ad3c2a68 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:57.983227 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.052718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Port 6372f655-5e2b-46c2-8592-5310ad3c2a68 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:23:58.084664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Provisioning complete for port a9a37e68-e690-4d6c-b8ee-49ab7517fd22 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:58.085499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.132284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.147602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for a9a37e68-e690-4d6c-b8ee-49ab7517fd22 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:23:58.155987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Deleting subnet 5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:23:58.157867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16e0a604-8659-41da-934f-e0959204017e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:23:58.160043 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.199236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.204321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e5e04fc4-4816-4a3b-bb39-29a8eb5ef9f5 None None] Port a9a37e68-e690-4d6c-b8ee-49ab7517fd22 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:23:58.250734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.252716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 16e0a604-8659-41da-934f-e0959204017e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:58.253102 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.356987 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40466fa3-a873-48d1-b742-226657de7853 None None] Provisioning complete for port 6372f655-5e2b-46c2-8592-5310ad3c2a68 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:58.357616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40466fa3-a873-48d1-b742-226657de7853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.389889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.392931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-40466fa3-a873-48d1-b742-226657de7853 None None] Port 6372f655-5e2b-46c2-8592-5310ad3c2a68 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:23:58.395900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40466fa3-a873-48d1-b742-226657de7853 None None] Could not find standard attr ID for object a9a37e68-e690-4d6c-b8ee-49ab7517fd22. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:23:58.419029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.431662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=a9a37e68-e690-4d6c-b8ee-49ab7517fd22,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:58.450642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:58.458995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.463155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d775c802-8005-427c-a569-034d5012252b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/5da0f4f6-a8bd-44a6-85f9-7a9cdcad20e3 HTTP/1.1" status: 204 len: 168 time: 0.6224537 Dec 21 04:23:58.465513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.466050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.466574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.467111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.468423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43750) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:58.468558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.468558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.468558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.469213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.469558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.470058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.470572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.471140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.471476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d775c802-8005-427c-a569-034d5012252b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:23:58.592352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.690070 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.693230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e205c36d-1fdf-4f95-8a43-0ae0f7dd0f2a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/ports/a9a37e68-e690-4d6c-b8ee-49ab7517fd22 HTTP/1.1" status: 204 len: 168 time: 1.1999547 Dec 21 04:23:58.695986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43752) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:58.725392 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-c82390c6-1414-4132-a7d2-708b99e68edb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] GET failed (client error): The resource could not be found. Dec 21 04:23:58.726570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.726847 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c82390c6-1414-4132-a7d2-708b99e68edb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "GET /v2.0/ports/a9a37e68-e690-4d6c-b8ee-49ab7517fd22 HTTP/1.1" status: 404 len: 333 time: 0.0298178 Dec 21 04:23:58.730600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43754) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:58.737637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'name': 'tempest-AllowedAddressPairTestJSON-1159858421'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:58.747745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1e06cb6d-1702-4983-bc62-4912cea57cae']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:58.756964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '412aa278-1368-4813-a350-dccd36d53daf') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:58.757260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '412aa278-1368-4813-a350-dccd36d53daf') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:23:58.766753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.779900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.786393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Releasing vlan 122 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:23:58.786776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:23:58.788495 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:23:58.955229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.961862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.964940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] 10.222.0.18 "DELETE /v2.0/networks/1e06cb6d-1702-4983-bc62-4912cea57cae HTTP/1.1" status: 204 len: 168 time: 0.4968600 Dec 21 04:23:58.967116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:23:58.971365 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:58.974954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e7caee6-1b37-4a52-a324-d5eccda3141a admin admin] Pushing event deleted for resources: {'Network': ['ID=1e06cb6d-1702-4983-bc62-4912cea57cae,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:58.990107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] device_id is not set on port 14329217-40ee-41c8-b43b-070e65e7f7a8 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:23:59.106331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Allocated IP 172.20.0.9 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/14329217-40ee-41c8-b43b-070e65e7f7a8) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:23:59.256505 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.279721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43760) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:59.319404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6eb27548-99c0-4da6-9680-546be515b0b2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=57ab6cbdcda24806861df9ec12f18681&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0383191 Dec 21 04:23:59.321760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43762) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:59.355779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.372505 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cadfd7e9-d7a7-4f83-9194-8e7cff9f829f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.396234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cadfd7e9-d7a7-4f83-9194-8e7cff9f829f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.416605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:23:59.419738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:23:59.424063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:23:59.457966 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=14329217-40ee-41c8-b43b-070e65e7f7a8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:59.489272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:23:59.490060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.509975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cadfd7e9-d7a7-4f83-9194-8e7cff9f829f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.512668 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cadfd7e9-d7a7-4f83-9194-8e7cff9f829f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.516353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cadfd7e9-d7a7-4f83-9194-8e7cff9f829f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/af3c5167-9211-4bab-a993-0ca82cb73c62 HTTP/1.1" status: 204 len: 168 time: 0.1912146 Dec 21 04:23:59.523540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cadfd7e9-d7a7-4f83-9194-8e7cff9f829f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af3c5167-9211-4bab-a993-0ca82cb73c62,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:23:59.571141 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2353dcd4-2bfb-42e6-9db1-ace070ff5120 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.8365102 Dec 21 04:23:59.571425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43766) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:23:59.576580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.12', 'mac_address': 'fa:16:3e:c1:a6:9a'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:23:59.727579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b39f1a14-d76c-4d71-8bb0-e37a0014a949 None None] Provisioning complete for port 14329217-40ee-41c8-b43b-070e65e7f7a8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:23:59.728192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b39f1a14-d76c-4d71-8bb0-e37a0014a949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.735010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:23:59.784909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b39f1a14-d76c-4d71-8bb0-e37a0014a949 None None] Port 14329217-40ee-41c8-b43b-070e65e7f7a8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:23:59.933344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.018306 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.103486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=14329217-40ee-41c8-b43b-070e65e7f7a8,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:00.117859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] In _notify_port_updated(), no bound segment for port 14329217-40ee-41c8-b43b-070e65e7f7a8 on network 9a7534dd-cb36-4278-8600-3bfba1f41e16 {{(pid=110311) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:24:00.123632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:00.124300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.126475 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05bdcfdc-d104-4f48-aa13-9e5049c0177a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "PUT /v2.0/ports/14329217-40ee-41c8-b43b-070e65e7f7a8 HTTP/1.1" status: 200 len: 994 time: 0.5541973 Dec 21 04:24:00.129196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43768) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:00.223945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port 14329217-40ee-41c8-b43b-070e65e7f7a8 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:00.224286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.302689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e98d1a00-71b4-421c-be36-48123a509710 None None] Provisioning complete for port 14329217-40ee-41c8-b43b-070e65e7f7a8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:00.303094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e98d1a00-71b4-421c-be36-48123a509710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.321400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.333516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for 14329217-40ee-41c8-b43b-070e65e7f7a8 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:00.336910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e98d1a00-71b4-421c-be36-48123a509710 None None] Port 14329217-40ee-41c8-b43b-070e65e7f7a8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:00.532382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.566491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=14329217-40ee-41c8-b43b-070e65e7f7a8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:00.725532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.729468 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-586e079a-351b-4838-9e3f-e419467c46ee tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/ports/14329217-40ee-41c8-b43b-070e65e7f7a8 HTTP/1.1" status: 204 len: 168 time: 0.5993383 Dec 21 04:24:00.732006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43770) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:00.756630 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-a41ac7de-b770-42f6-8101-c8647371c12a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] GET failed (client error): The resource could not be found. Dec 21 04:24:00.757945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a41ac7de-b770-42f6-8101-c8647371c12a tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "GET /v2.0/ports/14329217-40ee-41c8-b43b-070e65e7f7a8 HTTP/1.1" status: 404 len: 333 time: 0.0249650 Dec 21 04:24:00.761468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43772) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:00.766764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'name': 'tempest-AllowedAddressPairTestJSON-471855065'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:00.972020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:00.975518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:00.992642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] device_id is not set on port ac380cef-a0b6-4689-9b2d-e0a305851da8 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:01.098471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Allocated IP 172.20.0.8 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/ac380cef-a0b6-4689-9b2d-e0a305851da8) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:01.241840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.338477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.380070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:01.383155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:01.386603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:01.418577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=ac380cef-a0b6-4689-9b2d-e0a305851da8,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:01.445108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:01.445721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.554680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43774) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:01.555831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ddccd69-b429-403b-bea6-751a7c5a07f4 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 0.7887661 Dec 21 04:24:01.560298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:c1:a6:9a'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:01.565592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f7735954-c5f5-4864-8562-32d5ed6613a7 None None] Provisioning complete for port ac380cef-a0b6-4689-9b2d-e0a305851da8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:01.566107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f7735954-c5f5-4864-8562-32d5ed6613a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.600130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f7735954-c5f5-4864-8562-32d5ed6613a7 None None] Port ac380cef-a0b6-4689-9b2d-e0a305851da8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:01.627202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.797236 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.898233 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.973697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=ac380cef-a0b6-4689-9b2d-e0a305851da8,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:01.987607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] In _notify_port_updated(), no bound segment for port ac380cef-a0b6-4689-9b2d-e0a305851da8 on network 9a7534dd-cb36-4278-8600-3bfba1f41e16 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:24:01.994016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:01.994710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:01.996191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4edc6840-358a-4fbd-9065-a5b258a26719 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "PUT /v2.0/ports/ac380cef-a0b6-4689-9b2d-e0a305851da8 HTTP/1.1" status: 200 len: 995 time: 0.4404845 Dec 21 04:24:02.000213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43776) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:02.090089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port ac380cef-a0b6-4689-9b2d-e0a305851da8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:02.090428 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:02.122828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-37fa2fa7-abbc-4169-9ef4-3e7e9d15e07b None None] Provisioning complete for port ac380cef-a0b6-4689-9b2d-e0a305851da8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:02.123320 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-37fa2fa7-abbc-4169-9ef4-3e7e9d15e07b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:02.159577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-37fa2fa7-abbc-4169-9ef4-3e7e9d15e07b None None] Port ac380cef-a0b6-4689-9b2d-e0a305851da8 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:02.174516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:02.186150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for ac380cef-a0b6-4689-9b2d-e0a305851da8 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:02.389611 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:02.415847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=ac380cef-a0b6-4689-9b2d-e0a305851da8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:02.491302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:02.494622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5b27dcf2-b8e6-4da2-91c7-0a451efec996 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/ports/ac380cef-a0b6-4689-9b2d-e0a305851da8 HTTP/1.1" status: 204 len: 168 time: 0.4939198 Dec 21 04:24:02.497619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43780) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:02.522695 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8f3e0e9-2caa-4deb-ae54-70700ca370df tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] GET failed (client error): The resource could not be found. Dec 21 04:24:02.524183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8f3e0e9-2caa-4deb-ae54-70700ca370df tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "GET /v2.0/ports/ac380cef-a0b6-4689-9b2d-e0a305851da8 HTTP/1.1" status: 404 len: 333 time: 0.0256026 Dec 21 04:24:02.527916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43782) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:02.533697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'name': 'tempest-AllowedAddressPairTestJSON-1899657952'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:03.023697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:03.027160 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:03.044754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] device_id is not set on port 54ec299e-efbe-42f4-b5b4-b170ef12a9ce yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:03.152309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Allocated IP 172.20.0.5 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/54ec299e-efbe-42f4-b5b4-b170ef12a9ce) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:03.294536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:03.373138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:03.418577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:03.421579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:03.425227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:03.449719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=54ec299e-efbe-42f4-b5b4-b170ef12a9ce,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:03.479194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:03.479841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:03.542863 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2881521-c3ca-4d52-9c29-47bf2b0f3ed5 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.0136547 Dec 21 04:24:03.544442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43784) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:03.561450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'network_id': '9a7534dd-cb36-4278-8600-3bfba1f41e16', 'name': 'tempest-AllowedAddressPairTestJSON-1774889570'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:03.686959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7276b245-e46e-4dc3-9522-3b53ae5f036e None None] Provisioning complete for port 54ec299e-efbe-42f4-b5b4-b170ef12a9ce triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:03.688194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7276b245-e46e-4dc3-9522-3b53ae5f036e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:03.724261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7276b245-e46e-4dc3-9522-3b53ae5f036e None None] Port 54ec299e-efbe-42f4-b5b4-b170ef12a9ce cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:03.898400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Made reservation on behalf of f58248f4ae074e6283e64c72bb240d3e for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:03.901932 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:03.919837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] device_id is not set on port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:04.037298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Allocated IP 172.20.0.11 (9a7534dd-cb36-4278-8600-3bfba1f41e16/19922169-2a09-4259-8885-9ae54e91b05c/306656eb-9a33-41b1-8ef1-a84b6cc2a9d1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:04.183382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.252489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.295965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:04.299446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:04.303060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:04.327070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=306656eb-9a33-41b1-8ef1-a84b6cc2a9d1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:04.357373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:04.358215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.420652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-16703603-4531-4322-a8bb-1be3202025e7 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8750069 Dec 21 04:24:04.423322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43786) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:04.428518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.12', 'mac_address': 'fa:16:3e:c1:a6:9a'}, {'ip_address': '172.20.0.5', 'mac_address': 'fa:16:3e:8c:b5:29'}]}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:04.547466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f0837fe0-1ce9-427e-90a1-695e45982d8a None None] Provisioning complete for port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:04.547831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0837fe0-1ce9-427e-90a1-695e45982d8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.574597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.585989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f0837fe0-1ce9-427e-90a1-695e45982d8a None None] Port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:04.752357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.818206 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.897178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event updated for resources: {'Port': ['ID=306656eb-9a33-41b1-8ef1-a84b6cc2a9d1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:04.912368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] In _notify_port_updated(), no bound segment for port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 on network 9a7534dd-cb36-4278-8600-3bfba1f41e16 {{(pid=110310) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 21 04:24:04.918236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:04.921633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:04.921633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-265368d2-ec16-4d55-90dd-08a55d16e142 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "PUT /v2.0/ports/306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 HTTP/1.1" status: 200 len: 1057 time: 0.4959989 Dec 21 04:24:04.923237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43788) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:05.013391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:05.013660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.107180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.110151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-521dd7ad-4878-47cd-8463-341973b6a1bb None None] Provisioning complete for port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:05.110711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-521dd7ad-4878-47cd-8463-341973b6a1bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.120235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:05.147945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-521dd7ad-4878-47cd-8463-341973b6a1bb None None] Port 306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:05.303869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.336556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=306656eb-9a33-41b1-8ef1-a84b6cc2a9d1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:05.533974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.537222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9e7a0362-d7f8-42ac-85be-5866f1cff885 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/ports/306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 HTTP/1.1" status: 204 len: 168 time: 0.6130257 Dec 21 04:24:05.539820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43790) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:05.563856 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-ead4c49d-0a3a-4249-8bd6-f17102edced2 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] GET failed (client error): The resource could not be found. Dec 21 04:24:05.565093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ead4c49d-0a3a-4249-8bd6-f17102edced2 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "GET /v2.0/ports/306656eb-9a33-41b1-8ef1-a84b6cc2a9d1 HTTP/1.1" status: 404 len: 333 time: 0.0243793 Dec 21 04:24:05.567530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43792) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:05.651937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port 54ec299e-efbe-42f4-b5b4-b170ef12a9ce {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:05.652597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.736743 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.748184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for 54ec299e-efbe-42f4-b5b4-b170ef12a9ce owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:05.961030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:05.989652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=54ec299e-efbe-42f4-b5b4-b170ef12a9ce,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:06.060483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.063998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-493f1861-ee7f-4434-a1e3-4f0c278b4f71 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/ports/54ec299e-efbe-42f4-b5b4-b170ef12a9ce HTTP/1.1" status: 204 len: 168 time: 0.4953339 Dec 21 04:24:06.066627 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:06.092006 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9317203e-5fd1-444d-9e31-215e5c03a7c9 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] GET failed (client error): The resource could not be found. Dec 21 04:24:06.093524 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9317203e-5fd1-444d-9e31-215e5c03a7c9 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "GET /v2.0/ports/54ec299e-efbe-42f4-b5b4-b170ef12a9ce HTTP/1.1" status: 404 len: 333 time: 0.0257952 Dec 21 04:24:06.097481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43796) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:06.185962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port 6372f655-5e2b-46c2-8592-5310ad3c2a68 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:06.186300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.269728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.281257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for 6372f655-5e2b-46c2-8592-5310ad3c2a68 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:06.463622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.491486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=6372f655-5e2b-46c2-8592-5310ad3c2a68,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:06.563462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.566877 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4f5c988-c7ca-4c5a-88ab-a45d6dde387e tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/ports/6372f655-5e2b-46c2-8592-5310ad3c2a68 HTTP/1.1" status: 204 len: 168 time: 0.4684429 Dec 21 04:24:06.569499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43798) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:06.623510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting subnet 19922169-2a09-4259-8885-9ae54e91b05c {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:06.626900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.669697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.753783 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.897966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.924976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Subnet': ['ID=19922169-2a09-4259-8885-9ae54e91b05c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:06.928376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:06.932034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-26a27fdb-92de-4884-83e9-6c79cb022681 tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/subnets/19922169-2a09-4259-8885-9ae54e91b05c HTTP/1.1" status: 204 len: 168 time: 0.3610866 Dec 21 04:24:06.934298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43800) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:06.936788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a483e7a1-3112-41df-9abc-aed72840cf65 None None] Network 9a7534dd-cb36-4278-8600-3bfba1f41e16 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:07.009426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.070595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Deleting port 16e0a604-8659-41da-934f-e0959204017e {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:07.071006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.084516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] DHCP port deletion for 9a7534dd-cb36-4278-8600-3bfba1f41e16 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:07.134564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] For port 16e0a604-8659-41da-934f-e0959204017e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16e0a604-8659-41da-934f-e0959204017e,segment=NetworkSegment(b91564f8-841b-4a0a-813b-d648b8d9395a),segment_id=b91564f8-841b-4a0a-813b-d648b8d9395a)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:07.134944 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.136919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] Deleting port 16e0a604-8659-41da-934f-e0959204017e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:07.137365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.148715 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Calling delete_port for 16e0a604-8659-41da-934f-e0959204017e owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:07.199125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] For port 16e0a604-8659-41da-934f-e0959204017e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16e0a604-8659-41da-934f-e0959204017e,segment=NetworkSegment(b91564f8-841b-4a0a-813b-d648b8d9395a),segment_id=b91564f8-841b-4a0a-813b-d648b8d9395a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:07.199667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.212788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] Calling delete_port for 16e0a604-8659-41da-934f-e0959204017e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:07.298641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.304129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.325972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Port': ['ID=16e0a604-8659-41da-934f-e0959204017e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:07.327740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] No DVR routers for this DVR port 16e0a604-8659-41da-934f-e0959204017e on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:07.330467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] No DVR routers for this DVR port 16e0a604-8659-41da-934f-e0959204017e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:07.331928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e7868de-8559-4f98-a2fb-fdc7ba5f34f6 None None] Pushing event deleted for resources: {'Port': ['ID=16e0a604-8659-41da-934f-e0959204017e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:07.407315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.430837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a7534dd-cb36-4278-8600-3bfba1f41e16']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:07.440883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b91564f8-841b-4a0a-813b-d648b8d9395a') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:07.441183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b91564f8-841b-4a0a-813b-d648b8d9395a') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:07.450491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.464359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.470966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:24:07.471359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:24:07.474314 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:24:07.589602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.597153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:07.600325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] 10.222.0.18 "DELETE /v2.0/networks/9a7534dd-cb36-4278-8600-3bfba1f41e16 HTTP/1.1" status: 204 len: 168 time: 0.6651058 Dec 21 04:24:07.612358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63760aa5-4b5a-4e56-b9ec-6a80b13a7bdb tempest-AllowedAddressPairTestJSON-250174864 tempest-AllowedAddressPairTestJSON-250174864-project] Pushing event deleted for resources: {'Network': ['ID=9a7534dd-cb36-4278-8600-3bfba1f41e16,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:08.002763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43806) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:08.036589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16e0a604-8659-41da-934f-e0959204017e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:08.057028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 16e0a604-8659-41da-934f-e0959204017e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:08.057375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16e0a604-8659-41da-934f-e0959204017e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:08.137392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e2845f42-f4be-4f84-8348-7ddd0e048c53 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f58248f4ae074e6283e64c72bb240d3e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1334386 Dec 21 04:24:08.139812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43810) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:08.198774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1977fa69-96ea-4fef-a97f-9e525182fea3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:08.220533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1977fa69-96ea-4fef-a97f-9e525182fea3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:08.338211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1977fa69-96ea-4fef-a97f-9e525182fea3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:08.340798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1977fa69-96ea-4fef-a97f-9e525182fea3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:08.341983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1977fa69-96ea-4fef-a97f-9e525182fea3 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/12ceb68c-a26b-4b09-89ba-8c4e94ae5c2e HTTP/1.1" status: 204 len: 168 time: 0.2012866 Dec 21 04:24:08.351594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1977fa69-96ea-4fef-a97f-9e525182fea3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12ceb68c-a26b-4b09-89ba-8c4e94ae5c2e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:09.413714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43832) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:09.508018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-1094361220'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:09.594203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:09.597716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.606269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.678600 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.742854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.769059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] vlan segment allocate from pool success with {'vlan_id': 114, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:24:09.779015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'SecurityGroup': ['ID=54dfef0e-cbda-49a4-bef9-2f2ada1710de,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:09.783731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.787282 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Added segment 71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1 of type vlan for network b93c538b-c177-45d8-ae5b-37770a1f77ba Dec 21 04:24:09.823282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.915087 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.920855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:09.921527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:09.989389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Network': ['ID=b93c538b-c177-45d8-ae5b-37770a1f77ba,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:09.998922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:24:10.026479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3512aca3-0429-4a9e-bd89-8d745619a609 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.6116426 Dec 21 04:24:10.029767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43836) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:10.035237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:10.172756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:10.176163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:10.412766 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:10.473729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=e34aa4a1-5ab5-40ea-8942-20087e43c26e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:10.483543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:10.483910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network hostable DHCP agents. Network: b93c538b-c177-45d8-ae5b-37770a1f77ba, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:24:10.555993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:24:10.623867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b93c538b-c177-45d8-ae5b-37770a1f77ba) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:10.628093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:10.628692 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:10.633616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b045739-4376-4fb1-9d4c-0c1cbeab35a2 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:10.712387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4b6af4c8-d67f-4edd-9523-4a5447f556f2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6815643 Dec 21 04:24:10.715378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43838) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:10.720317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'name': 'tempest-NetworksTestDHCPv6-1409887715'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:10.733070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'e34aa4a1-5ab5-40ea-8942-20087e43c26e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:10.733959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:10.865500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/e34aa4a1-5ab5-40ea-8942-20087e43c26e/dc24fa80-70a8-4ab7-b1df-33a250cec9ab) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:10.898027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:10.902659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:10.919479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 55348ae0-fde0-450d-bd4b-9bd7d6c1acc0 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:11.004888 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.081266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.131760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:11.134547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:11.138965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:11.141990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Pushing event updated for resources: {'Port': ['ID=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:11.143892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::208 (b93c538b-c177-45d8-ae5b-37770a1f77ba/e34aa4a1-5ab5-40ea-8942-20087e43c26e/55348ae0-fde0-450d-bd4b-9bd7d6c1acc0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:11.193484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Attempting to bind port dc24fa80-70a8-4ab7-b1df-33a250cec9ab on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:11.193985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Attempting to bind port dc24fa80-70a8-4ab7-b1df-33a250cec9ab by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:11.194357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Attempting to bind port dc24fa80-70a8-4ab7-b1df-33a250cec9ab on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:11.199299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:11.199674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:11.200073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.200466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:11.200936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Bound port: dc24fa80-70a8-4ab7-b1df-33a250cec9ab, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:11.201315 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.262244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] For port dc24fa80-70a8-4ab7-b1df-33a250cec9ab, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:11.265240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] For port dc24fa80-70a8-4ab7-b1df-33a250cec9ab, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:11.288875 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.327147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.378300 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.390504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23d2900-914e-408c-9342-df55db57c0ee None None] Pushing event updated for resources: {'Port': ['ID=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:11.417963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:11.424006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:11.428045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:11.434013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:11.434640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.449195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=55348ae0-fde0-450d-bd4b-9bd7d6c1acc0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:11.528915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5986049-3e51-4fd9-9156-42f910543d61 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 0.8122187 Dec 21 04:24:11.539000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43840) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:11.599404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96f43d4c-95e9-422e-818f-e4e6fc05e66c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:11.605611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96f43d4c-95e9-422e-818f-e4e6fc05e66c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:11.607315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-96f43d4c-95e9-422e-818f-e4e6fc05e66c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.0683424 Dec 21 04:24:11.610803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43842) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:11.701827 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 55348ae0-fde0-450d-bd4b-9bd7d6c1acc0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:11.702263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.788837 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:11.802420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 55348ae0-fde0-450d-bd4b-9bd7d6c1acc0 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:12.007471 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.040268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=55348ae0-fde0-450d-bd4b-9bd7d6c1acc0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:12.067971 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.069583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dc24fa80-70a8-4ab7-b1df-33a250cec9ab up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:12.073604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-268b7f90-5b2b-4ed6-8e6d-33e12d152a5b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/55348ae0-fde0-450d-bd4b-9bd7d6c1acc0 HTTP/1.1" status: 204 len: 168 time: 0.4595571 Dec 21 04:24:12.073910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43846) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:12.126661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port dc24fa80-70a8-4ab7-b1df-33a250cec9ab triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:12.127359 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.162758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59b77184-3a47-4bda-a8e7-24746ceeec02 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:12.164394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59b77184-3a47-4bda-a8e7-24746ceeec02 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:12.165926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-59b77184-3a47-4bda-a8e7-24746ceeec02 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0910032 Dec 21 04:24:12.168743 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43848) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:12.211129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.223958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet e34aa4a1-5ab5-40ea-8942-20087e43c26e {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:12.226905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.243432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port dc24fa80-70a8-4ab7-b1df-33a250cec9ab, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:12.269392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.309850 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.339341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20b7e4c7-3996-4328-83c7-4ad439872f29 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:12.360570 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.414303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:12.439449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-aed27ea0-778a-49e6-b62a-9c824f3d024a None None] Provisioning complete for port dc24fa80-70a8-4ab7-b1df-33a250cec9ab triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:12.439820 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aed27ea0-778a-49e6-b62a-9c824f3d024a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.487217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.517131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=e34aa4a1-5ab5-40ea-8942-20087e43c26e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:12.519289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.522590 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-353bc316-b75d-47c4-84f6-ba0f1a161f69 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/e34aa4a1-5ab5-40ea-8942-20087e43c26e HTTP/1.1" status: 204 len: 168 time: 0.3528538 Dec 21 04:24:12.525499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43850) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:12.590902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78e5cfcd-4e34-4846-9f68-0f5d0bc0668c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0639246 Dec 21 04:24:12.593944 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43852) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:12.599137 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:12.712077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6234efcc-0a3c-4299-b6e9-626929f2858e None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:12.784171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:12.787762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.793387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6817fe4e-8ebf-43a6-8c98-e23ca91c82b7 None None] Provisioning complete for port dc24fa80-70a8-4ab7-b1df-33a250cec9ab triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:12.793761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6817fe4e-8ebf-43a6-8c98-e23ca91c82b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:12.903245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:12.951157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] Deleting port dc24fa80-70a8-4ab7-b1df-33a250cec9ab {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:12.951653 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.017456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] For port dc24fa80-70a8-4ab7-b1df-33a250cec9ab, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:13.017851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.029843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] Calling delete_port for dc24fa80-70a8-4ab7-b1df-33a250cec9ab owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:13.058122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.097282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:13.100529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:13.104771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:13.105359 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.121926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=23082c16-9240-4e06-af3e-0df971424b1c,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:13.173001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.187000 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b6533b4b-2330-4a21-8e47-c69b46b14a8a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5918734 Dec 21 04:24:13.189573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43854) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:13.194510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'name': 'tempest-NetworksTestDHCPv6-1768055359'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:13.198346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] Pushing event deleted for resources: {'Port': ['ID=dc24fa80-70a8-4ab7-b1df-33a250cec9ab,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:13.203374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb59e6c7-3783-43cb-bb46-d15cef570a78 None None] No DVR routers for this DVR port dc24fa80-70a8-4ab7-b1df-33a250cec9ab on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:13.220885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd306999-e0f7-4f45-b643-c12cb8d0aaf6 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:13.325139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '23082c16-9240-4e06-af3e-0df971424b1c'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:13.325988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.372504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:13.376225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.395674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 4176ac2e-4478-48bc-880c-3ac24c9bd351 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:13.513591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::5f (b93c538b-c177-45d8-ae5b-37770a1f77ba/23082c16-9240-4e06-af3e-0df971424b1c/4176ac2e-4478-48bc-880c-3ac24c9bd351) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:13.661421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.743668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.788868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/23082c16-9240-4e06-af3e-0df971424b1c/b34c3d5e-919a-48fc-a0a0-0821244731e8) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:13.790027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:13.793063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:13.796757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:13.802430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:13.803065 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.809593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=4176ac2e-4478-48bc-880c-3ac24c9bd351,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:13.889250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-261dbb26-514a-4531-a7dd-15dfc5510067 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.6986220 Dec 21 04:24:13.892248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43856) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:13.950899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:13.973593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ff2b149-2d5a-4afa-bdec-4e7b530a2f31 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:13.975119 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5ff2b149-2d5a-4afa-bdec-4e7b530a2f31 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.0819030 Dec 21 04:24:13.977737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43858) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:14.034190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dc24fa80-70a8-4ab7-b1df-33a250cec9ab no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:14.038084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.063882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: dc24fa80-70a8-4ab7-b1df-33a250cec9ab {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:14.064120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 4176ac2e-4478-48bc-880c-3ac24c9bd351 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:14.064274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device dc24fa80-70a8-4ab7-b1df-33a250cec9ab not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:14.064413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.099183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:14.103710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:14.108102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:14.111594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Pushing event updated for resources: {'Port': ['ID=b34c3d5e-919a-48fc-a0a0-0821244731e8,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:14.122921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.123291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.123629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.123966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.124297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.124625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.125595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.125927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.126265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.126575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.126895 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.127241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.127561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:14.160877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.176233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 4176ac2e-4478-48bc-880c-3ac24c9bd351 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:14.178210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Attempting to bind port b34c3d5e-919a-48fc-a0a0-0821244731e8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:14.178711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Attempting to bind port b34c3d5e-919a-48fc-a0a0-0821244731e8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:14.178858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Attempting to bind port b34c3d5e-919a-48fc-a0a0-0821244731e8 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:14.184063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:14.184459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:14.184857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.185246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:14.185707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Bound port: b34c3d5e-919a-48fc-a0a0-0821244731e8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:14.186085 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.245857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] For port b34c3d5e-919a-48fc-a0a0-0821244731e8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:14.248699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] For port b34c3d5e-919a-48fc-a0a0-0821244731e8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b34c3d5e-919a-48fc-a0a0-0821244731e8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:14.332924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.367019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.395848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d57b706-1c79-4954-b042-387fbf143219 None None] Pushing event updated for resources: {'Port': ['ID=b34c3d5e-919a-48fc-a0a0-0821244731e8,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:14.397788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=4176ac2e-4478-48bc-880c-3ac24c9bd351,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:14.427439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.430797 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dd4f91f3-d5d1-4d21-ba3c-6707300eeeef tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/4176ac2e-4478-48bc-880c-3ac24c9bd351 HTTP/1.1" status: 204 len: 168 time: 0.4521286 Dec 21 04:24:14.433700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43860) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:14.525742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c4f12f4-97a9-427f-8cbd-ccf15c5873a1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:14.528202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c4f12f4-97a9-427f-8cbd-ccf15c5873a1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:14.528962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0c4f12f4-97a9-427f-8cbd-ccf15c5873a1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0942900 Dec 21 04:24:14.532110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43862) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:14.591438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 23082c16-9240-4e06-af3e-0df971424b1c {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:14.596133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.641877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.729671 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.869700 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.898317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=23082c16-9240-4e06-af3e-0df971424b1c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:14.900301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:14.905421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bc7f5f15-9f4a-43e3-8824-46d0e4800bdc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/23082c16-9240-4e06-af3e-0df971424b1c HTTP/1.1" status: 204 len: 168 time: 0.3723354 Dec 21 04:24:14.906743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43864) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:14.942765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2bfaaedf-a6d7-4fcd-b7c8-4949115bd17e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0347228 Dec 21 04:24:14.945309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43866) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:14.949923 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:15.109515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:15.113348 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.295189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e647fae8-7408-461a-9c2b-f5d4d0382feb None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:15.357441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-596e9b48-75cc-4dbe-aaa6-4f42d8817051 None None] Provisioning complete for port b34c3d5e-919a-48fc-a0a0-0821244731e8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:15.357735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-596e9b48-75cc-4dbe-aaa6-4f42d8817051 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.378369 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.422531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:15.425908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:15.430192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:15.430784 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.436718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=d0bc3489-2d34-490e-9519-eead2861fa9e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:15.449876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.450622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.450622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.451212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.451313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.451618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.452304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.452304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.452555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.452936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.453953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.454671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.455038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:15.466782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-596e9b48-75cc-4dbe-aaa6-4f42d8817051 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.478537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:15.512179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d4b0a358-742a-413f-bd9d-8ccfa8eb4dea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5658865 Dec 21 04:24:15.514623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43868) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:15.520032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'name': 'tempest-NetworksTestDHCPv6-843763505'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:15.521541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-596e9b48-75cc-4dbe-aaa6-4f42d8817051 None None] For port b34c3d5e-919a-48fc-a0a0-0821244731e8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b34c3d5e-919a-48fc-a0a0-0821244731e8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:15.543785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] Deleting port b34c3d5e-919a-48fc-a0a0-0821244731e8 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:15.544085 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.593874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-596e9b48-75cc-4dbe-aaa6-4f42d8817051 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.658370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] For port b34c3d5e-919a-48fc-a0a0-0821244731e8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b34c3d5e-919a-48fc-a0a0-0821244731e8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:15.658762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.666893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-596e9b48-75cc-4dbe-aaa6-4f42d8817051 None None] Pushing event updated for resources: {'Port': ['ID=b34c3d5e-919a-48fc-a0a0-0821244731e8,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:15.674421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] Calling delete_port for b34c3d5e-919a-48fc-a0a0-0821244731e8 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:15.704158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:15.707753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.725205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 5a06fcb0-53d1-4346-aad0-8c60d847cddf yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:15.818585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:15.839363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::b2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/d0bc3489-2d34-490e-9519-eead2861fa9e/5a06fcb0-53d1-4346-aad0-8c60d847cddf) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:15.844645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] Pushing event deleted for resources: {'Port': ['ID=b34c3d5e-919a-48fc-a0a0-0821244731e8,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:15.849027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cd67ed3-e2f9-4014-a68e-82c25b27101b None None] No DVR routers for this DVR port b34c3d5e-919a-48fc-a0a0-0821244731e8 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:15.864739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c62731b-7454-44e8-a324-cb2ef1fa23f7 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:15.966713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'd0bc3489-2d34-490e-9519-eead2861fa9e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:15.967744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.339442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.446907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.491897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:16.493544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/d0bc3489-2d34-490e-9519-eead2861fa9e/0c556dfc-2f1c-4587-b519-6a92f8df5950) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:16.494831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:16.498584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:16.505396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:16.506031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.512514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=5a06fcb0-53d1-4346-aad0-8c60d847cddf,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:16.581205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d9adeb18-3754-4ab6-8235-28b9ab472a00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.0655024 Dec 21 04:24:16.583722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:16.634720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7b9d3c5-cefb-4442-82bf-a53f69da3566 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:16.636298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c7b9d3c5-cefb-4442-82bf-a53f69da3566 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 928 time: 0.0516222 Dec 21 04:24:16.638833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43872) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:16.641053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.692701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.723040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 5a06fcb0-53d1-4346-aad0-8c60d847cddf {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:16.723526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.734538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:16.737460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:16.740838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:16.749370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Pushing event updated for resources: {'Port': ['ID=0c556dfc-2f1c-4587-b519-6a92f8df5950,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:16.798173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Attempting to bind port 0c556dfc-2f1c-4587-b519-6a92f8df5950 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:16.803852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Attempting to bind port 0c556dfc-2f1c-4587-b519-6a92f8df5950 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:16.803852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Attempting to bind port 0c556dfc-2f1c-4587-b519-6a92f8df5950 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:16.803852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:16.804246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:16.804633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.805025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:16.805669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Bound port: 0c556dfc-2f1c-4587-b519-6a92f8df5950, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:16.806071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.811844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.824492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 5a06fcb0-53d1-4346-aad0-8c60d847cddf owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:16.867189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] For port 0c556dfc-2f1c-4587-b519-6a92f8df5950, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:16.870393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] For port 0c556dfc-2f1c-4587-b519-6a92f8df5950, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0c556dfc-2f1c-4587-b519-6a92f8df5950,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:16.926830 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:16.986882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80a72ad-b99f-4734-a6c4-f0ba168611fd None None] Pushing event updated for resources: {'Port': ['ID=0c556dfc-2f1c-4587-b519-6a92f8df5950,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:16.995659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.031781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=5a06fcb0-53d1-4346-aad0-8c60d847cddf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:17.055696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.061512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-968d1830-b178-4359-bc54-ed25bd75eb75 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/5a06fcb0-53d1-4346-aad0-8c60d847cddf HTTP/1.1" status: 204 len: 168 time: 0.4195204 Dec 21 04:24:17.061814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43874) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.115225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78df75e5-285f-419c-a27d-95be0c907836 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:17.116742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78df75e5-285f-419c-a27d-95be0c907836 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:17.118298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-78df75e5-285f-419c-a27d-95be0c907836 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0548296 Dec 21 04:24:17.120930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43876) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.185013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet d0bc3489-2d34-490e-9519-eead2861fa9e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:17.189302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.235670 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.320190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.436077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.466867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=d0bc3489-2d34-490e-9519-eead2861fa9e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:17.481770 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.481770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3fe61d72-55f0-49f5-989e-528334fc4030 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/d0bc3489-2d34-490e-9519-eead2861fa9e HTTP/1.1" status: 204 len: 168 time: 0.3537593 Dec 21 04:24:17.481770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43878) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.514807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-79564e82-cb87-4a2c-af19-c7d8997e48c1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0356555 Dec 21 04:24:17.518629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43880) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.564918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0d498d8-fcbb-4dca-9e4e-1c529dde424c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:17.566355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b0d498d8-fcbb-4dca-9e4e-1c529dde424c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0468016 Dec 21 04:24:17.568856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43882) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.622103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ea898cd-2ad6-4bd9-a7d6-31610cc2de04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:17.623778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3ea898cd-2ad6-4bd9-a7d6-31610cc2de04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0540087 Dec 21 04:24:17.626875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43884) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.669273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e6af1148-59a2-4ea2-bcc8-8868d432274d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0412798 Dec 21 04:24:17.673546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43886) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:17.678457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:17.846156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:17.849868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:17.898123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf7b9248-5f61-4715-a4aa-f821fc35fc13 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:17.977542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-363cc9df-2c8e-48f3-b592-d792a52770cf None None] Provisioning complete for port 0c556dfc-2f1c-4587-b519-6a92f8df5950 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:17.977821 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-363cc9df-2c8e-48f3-b592-d792a52770cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.075011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-363cc9df-2c8e-48f3-b592-d792a52770cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.106887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:18.110479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.113776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-363cc9df-2c8e-48f3-b592-d792a52770cf None None] For port 0c556dfc-2f1c-4587-b519-6a92f8df5950, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0c556dfc-2f1c-4587-b519-6a92f8df5950,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:18.155698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:18.157790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] Deleting port 0c556dfc-2f1c-4587-b519-6a92f8df5950 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:18.158210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.159517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:18.162523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:18.163147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.181518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=651b7ce4-f828-4781-a897-bd92f396794a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:18.209078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-363cc9df-2c8e-48f3-b592-d792a52770cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.243986 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6a5c077d-df40-4d70-a905-6f52f6023630 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5692494 Dec 21 04:24:18.246613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:18.252152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '651b7ce4-f828-4781-a897-bd92f396794a', 'ip_address': '2001:db8::a372:58fc:131c:5e1c'}], 'name': 'tempest-NetworksTestDHCPv6-455460640'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:18.271568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] For port 0c556dfc-2f1c-4587-b519-6a92f8df5950, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0c556dfc-2f1c-4587-b519-6a92f8df5950,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:18.271969 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.284945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-363cc9df-2c8e-48f3-b592-d792a52770cf None None] Pushing event updated for resources: {'Port': ['ID=0c556dfc-2f1c-4587-b519-6a92f8df5950,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:18.290438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] Calling delete_port for 0c556dfc-2f1c-4587-b519-6a92f8df5950 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:18.418119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:18.452162 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.475566 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] Pushing event deleted for resources: {'Port': ['ID=0c556dfc-2f1c-4587-b519-6a92f8df5950,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:18.481503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df1f49b6-2ae5-45ad-90ee-73c2ef09e863 None None] No DVR routers for this DVR port 0c556dfc-2f1c-4587-b519-6a92f8df5950 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:18.495450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-219fcbe0-9613-4e53-82b8-b4108d230a3d None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:18.506558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.524078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 59231703-1288-4a9a-b99d-5693b471bc6c yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:18.591064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '651b7ce4-f828-4781-a897-bd92f396794a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:18.592030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.684146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::a372:58fc:131c:5e1c (b93c538b-c177-45d8-ae5b-37770a1f77ba/651b7ce4-f828-4781-a897-bd92f396794a/59231703-1288-4a9a-b99d-5693b471bc6c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:18.827358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.920870 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.965235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:18.965522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/651b7ce4-f828-4781-a897-bd92f396794a/206cba7f-7b96-4e0f-882e-f9b641fd101c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:18.968294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:18.972478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:18.978118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:18.981863 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:18.985626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=59231703-1288-4a9a-b99d-5693b471bc6c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:19.055214 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ebe65cde-9590-4ba3-a3b5-ac6168393377 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 0.8069129 Dec 21 04:24:19.057615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43890) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:19.106988 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-003a75df-c633-4148-b1da-fb7ca1bdec55 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:19.111359 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-003a75df-c633-4148-b1da-fb7ca1bdec55 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.0498896 Dec 21 04:24:19.111531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.111732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43892) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:19.179465 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.211079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 59231703-1288-4a9a-b99d-5693b471bc6c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:19.211628 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.240127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:19.242899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:19.245778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:19.254238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Pushing event updated for resources: {'Port': ['ID=206cba7f-7b96-4e0f-882e-f9b641fd101c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:19.303206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Attempting to bind port 206cba7f-7b96-4e0f-882e-f9b641fd101c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:19.303586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Attempting to bind port 206cba7f-7b96-4e0f-882e-f9b641fd101c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:19.303946 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Attempting to bind port 206cba7f-7b96-4e0f-882e-f9b641fd101c on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:19.307507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.311054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:19.311437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:19.311870 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.312632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:19.313110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Bound port: 206cba7f-7b96-4e0f-882e-f9b641fd101c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:19.313496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.320170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 59231703-1288-4a9a-b99d-5693b471bc6c owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:19.376836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] For port 206cba7f-7b96-4e0f-882e-f9b641fd101c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:19.379745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] For port 206cba7f-7b96-4e0f-882e-f9b641fd101c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=206cba7f-7b96-4e0f-882e-f9b641fd101c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:19.464059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.521610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6a7805c-9063-42e7-ac1b-84555965bc52 None None] Pushing event updated for resources: {'Port': ['ID=206cba7f-7b96-4e0f-882e-f9b641fd101c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:19.527124 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.558027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=59231703-1288-4a9a-b99d-5693b471bc6c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:19.586759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.590586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4faaf24a-95e2-4300-bac6-7aa9571a4fd6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/59231703-1288-4a9a-b99d-5693b471bc6c HTTP/1.1" status: 204 len: 168 time: 0.4774556 Dec 21 04:24:19.592831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:19.652569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33123773-3313-41d3-a471-33c7e9e974d9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:19.654336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33123773-3313-41d3-a471-33c7e9e974d9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:19.656551 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-33123773-3313-41d3-a471-33c7e9e974d9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0621603 Dec 21 04:24:19.659048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43896) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:19.712913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 651b7ce4-f828-4781-a897-bd92f396794a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:19.716389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.757972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.846836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.903958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-191402a9-6f79-491f-ac23-48fbb28fe260 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:19.978597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.006383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=651b7ce4-f828-4781-a897-bd92f396794a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:20.010036 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.013360 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d574bd34-d7f1-4fc4-8745-b6d443afa320 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/651b7ce4-f828-4781-a897-bd92f396794a HTTP/1.1" status: 204 len: 168 time: 0.3533778 Dec 21 04:24:20.016121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43898) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:20.057348 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-179b86dd-e425-413d-ab7c-03b27fa4db2e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0389748 Dec 21 04:24:20.060657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43900) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:20.065758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:20.074644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 206cba7f-7b96-4e0f-882e-f9b641fd101c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:20.126140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 206cba7f-7b96-4e0f-882e-f9b641fd101c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:20.126623 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.208584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.241463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:20.245236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 206cba7f-7b96-4e0f-882e-f9b641fd101c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=206cba7f-7b96-4e0f-882e-f9b641fd101c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:20.245412 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.321716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.381704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0c556dfc-2f1c-4587-b519-6a92f8df5950 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:20.411296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=206cba7f-7b96-4e0f-882e-f9b641fd101c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:20.414063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 0c556dfc-2f1c-4587-b519-6a92f8df5950 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:20.414374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0c556dfc-2f1c-4587-b519-6a92f8df5950 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:20.417565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b939694a-b0ef-43eb-a241-a2e4aa2fbb7a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:20.495703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f7217da9-c271-431a-840a-dbd2507bd8f4 None None] Provisioning complete for port 206cba7f-7b96-4e0f-882e-f9b641fd101c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:20.496072 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f7217da9-c271-431a-840a-dbd2507bd8f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.516170 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.555917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:20.561678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:20.566711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:20.567334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.581868 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=8b4199cf-5716-475a-85ab-001400dbf4c0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:20.621640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:20.650886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43902) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:20.652250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26094177-4d53-4cc4-94b5-9162e7d26296 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5859091 Dec 21 04:24:20.656793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '8b4199cf-5716-475a-85ab-001400dbf4c0', 'ip_address': '2001:db8::8f40:283b:2ad3:1d50'}], 'name': 'tempest-NetworksTestDHCPv6-912379410'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:20.672154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] Deleting port 206cba7f-7b96-4e0f-882e-f9b641fd101c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:20.672454 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.851937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:20.911454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] For port 206cba7f-7b96-4e0f-882e-f9b641fd101c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=206cba7f-7b96-4e0f-882e-f9b641fd101c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:20.911845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.924676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] Calling delete_port for 206cba7f-7b96-4e0f-882e-f9b641fd101c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:20.933773 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:20.950503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 16d3200b-bc85-4652-9272-eb617e3935e7 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:21.075113 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.100302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] Pushing event deleted for resources: {'Port': ['ID=206cba7f-7b96-4e0f-882e-f9b641fd101c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:21.103716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52c502b0-e3c2-4cd0-8286-426ad06479e6 None None] No DVR routers for this DVR port 206cba7f-7b96-4e0f-882e-f9b641fd101c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:21.112352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::8f40:283b:2ad3:1d50 (b93c538b-c177-45d8-ae5b-37770a1f77ba/8b4199cf-5716-475a-85ab-001400dbf4c0/16d3200b-bc85-4652-9272-eb617e3935e7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:21.120057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b718a6a-86aa-4d57-b3c8-3cda18cc404c None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:21.228263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '8b4199cf-5716-475a-85ab-001400dbf4c0'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:21.229128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.264677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.344592 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.389305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/8b4199cf-5716-475a-85ab-001400dbf4c0/4c4ebdc9-3313-40fe-a9b1-5da668b462b0) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:21.390713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:21.394120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:21.399760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:21.404477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:21.405080 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.409118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=16d3200b-bc85-4652-9272-eb617e3935e7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:21.478164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-20abb4b6-7d80-43e2-9935-cf087e9bbf2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 0.8255277 Dec 21 04:24:21.480629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43904) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:21.527193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c19a66f-7bd5-4895-abcc-dc750721ed72 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:21.529006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1c19a66f-7bd5-4895-abcc-dc750721ed72 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.0474708 Dec 21 04:24:21.532200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43906) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:21.532578 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.601044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.621531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 16d3200b-bc85-4652-9272-eb617e3935e7 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:21.621846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.643718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:21.646604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:21.650916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:21.653975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Pushing event updated for resources: {'Port': ['ID=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:21.706989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Attempting to bind port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:21.707374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Attempting to bind port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:21.707747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Attempting to bind port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:21.712074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.712605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:21.712988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:21.713399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.714110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:21.714265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Bound port: 4c4ebdc9-3313-40fe-a9b1-5da668b462b0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:21.714640 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.724546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 16d3200b-bc85-4652-9272-eb617e3935e7 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:21.778375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] For port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:21.782000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] For port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:21.910136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.943898 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:21.975435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=16d3200b-bc85-4652-9272-eb617e3935e7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:21.982496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4784a048-f473-4bf4-916f-a58e956fcb12 None None] Pushing event updated for resources: {'Port': ['ID=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:22.005355 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.008740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1bb8b28e-3883-43c9-980c-56c74703d2b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/16d3200b-bc85-4652-9272-eb617e3935e7 HTTP/1.1" status: 204 len: 168 time: 0.4756274 Dec 21 04:24:22.011275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:22.067442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2cb6a35-e395-417f-9d31-980698718177 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:22.069047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2cb6a35-e395-417f-9d31-980698718177 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:22.070924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e2cb6a35-e395-417f-9d31-980698718177 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0582850 Dec 21 04:24:22.073260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:22.081139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 206cba7f-7b96-4e0f-882e-f9b641fd101c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:22.105416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 206cba7f-7b96-4e0f-882e-f9b641fd101c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:22.105531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 206cba7f-7b96-4e0f-882e-f9b641fd101c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:22.152768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 8b4199cf-5716-475a-85ab-001400dbf4c0 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:22.155939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.204205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.288721 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.396127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.427688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=8b4199cf-5716-475a-85ab-001400dbf4c0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:22.431261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.434664 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-035413b4-2677-4b8a-b1c8-0878f57e51a2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/8b4199cf-5716-475a-85ab-001400dbf4c0 HTTP/1.1" status: 204 len: 168 time: 0.3604960 Dec 21 04:24:22.437199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43912) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:22.473917 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9622c83b-67d1-43e2-9f43-ab6da6ff72f5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0349951 Dec 21 04:24:22.476535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43914) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:22.481067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:22.647171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:22.650703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.675698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f5fa92d-42eb-44ca-8d3d-26d32a531317 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.845732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e145c36-838a-4fac-8a42-f5e828007b52 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:22.892882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.933422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:22.936888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-938ac6f7-5448-4b39-877c-f018893d056f None None] Provisioning complete for port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:22.937044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:22.937795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-938ac6f7-5448-4b39-877c-f018893d056f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.941617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:22.942259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:22.957322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=183dac44-e150-4742-83fd-ba7145350398,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:23.022966 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-952cf9b0-ef00-420a-9eb0-488d7f22e923 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5454302 Dec 21 04:24:23.025628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43916) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:23.030266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:23.030804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '183dac44-e150-4742-83fd-ba7145350398', 'ip_address': '2001:db8::18d2:771a:2459:f9a2'}], 'name': 'tempest-NetworksTestDHCPv6-1327594862'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:23.057520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-938ac6f7-5448-4b39-877c-f018893d056f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.098544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-938ac6f7-5448-4b39-877c-f018893d056f None None] For port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:23.110014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] Deleting port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:23.110858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.113509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.162396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-938ac6f7-5448-4b39-877c-f018893d056f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.217999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:23.223775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.227257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] For port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:23.227661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.239948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-938ac6f7-5448-4b39-877c-f018893d056f None None] Pushing event updated for resources: {'Port': ['ID=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:23.241053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port dc0500e6-b457-4092-95ae-ae4b3674b7e6 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:23.245607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] Calling delete_port for 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:23.344266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.389539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.401140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::18d2:771a:2459:f9a2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/183dac44-e150-4742-83fd-ba7145350398/dc0500e6-b457-4092-95ae-ae4b3674b7e6) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:23.419395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] Pushing event deleted for resources: {'Port': ['ID=4c4ebdc9-3313-40fe-a9b1-5da668b462b0,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:23.423185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5db9773b-6850-44ec-a362-dc8eaf47e843 None None] No DVR routers for this DVR port 4c4ebdc9-3313-40fe-a9b1-5da668b462b0 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:23.439244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-679190c2-d8f3-4337-9a23-0a9fea19c6ce None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:23.540316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '183dac44-e150-4742-83fd-ba7145350398'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:23.541193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.567705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.642029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.684475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:23.686118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/183dac44-e150-4742-83fd-ba7145350398/9b191e2f-49b2-4751-bfb3-76aa545a976c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:23.688085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:23.691603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:23.697239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:23.697843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.708615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=dc0500e6-b457-4092-95ae-ae4b3674b7e6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:23.758140 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f89d6c3f-ab1c-4937-9b22-eda5111b45ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 0.7311592 Dec 21 04:24:23.760630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43918) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:23.807914 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:24:23.813487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9048a80a-e088-475f-9baa-d2d009cbe6f9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:23.815016 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9048a80a-e088-475f-9baa-d2d009cbe6f9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 946 time: 0.0534048 Dec 21 04:24:23.817489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:23.832590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.901563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port dc0500e6-b457-4092-95ae-ae4b3674b7e6 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:23.901906 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.927010 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:23.961344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:23.965956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:23.969827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:23.983243 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Pushing event updated for resources: {'Port': ['ID=9b191e2f-49b2-4751-bfb3-76aa545a976c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:23.991645 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.004482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for dc0500e6-b457-4092-95ae-ae4b3674b7e6 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:24.032017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Attempting to bind port 9b191e2f-49b2-4751-bfb3-76aa545a976c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:24.033604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Attempting to bind port 9b191e2f-49b2-4751-bfb3-76aa545a976c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:24.033604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Attempting to bind port 9b191e2f-49b2-4751-bfb3-76aa545a976c on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:24.037713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 23, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:24.038091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:24.038493 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.038886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:24.039383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Bound port: 9b191e2f-49b2-4751-bfb3-76aa545a976c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:24.039762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.100864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] For port 9b191e2f-49b2-4751-bfb3-76aa545a976c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:24.195290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.196083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] For port 9b191e2f-49b2-4751-bfb3-76aa545a976c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b191e2f-49b2-4751-bfb3-76aa545a976c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:24.225455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=dc0500e6-b457-4092-95ae-ae4b3674b7e6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:24.251821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.255086 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-31f8567e-e1c4-4994-b5ef-a02c5a82c5a3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/dc0500e6-b457-4092-95ae-ae4b3674b7e6 HTTP/1.1" status: 204 len: 168 time: 0.4366591 Dec 21 04:24:24.257603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.258612 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.313292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79598c83-bc5d-43ee-b63a-23977f074b55 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:24.315046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79598c83-bc5d-43ee-b63a-23977f074b55 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:24.318984 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-79598c83-bc5d-43ee-b63a-23977f074b55 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0580838 Dec 21 04:24:24.319259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43924) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.320723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-491a587d-1abf-457b-a834-ffe4db56dde0 None None] Pushing event updated for resources: {'Port': ['ID=9b191e2f-49b2-4751-bfb3-76aa545a976c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:24.371538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 183dac44-e150-4742-83fd-ba7145350398 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:24.374940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.420182 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.521703 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.624200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.651246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=183dac44-e150-4742-83fd-ba7145350398,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:24.654589 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:24.658337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f63cc646-addd-49a1-a792-6b750effbe7a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/183dac44-e150-4742-83fd-ba7145350398 HTTP/1.1" status: 204 len: 168 time: 0.3380914 Dec 21 04:24:24.661350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43926) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.701108 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e4bc74e2-ef85-47d1-a36b-89bf2f28945e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0386744 Dec 21 04:24:24.703925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43928) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.749286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dea5fcaa-524a-4f3f-a96e-74753eed0eaf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:24.750721 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dea5fcaa-524a-4f3f-a96e-74753eed0eaf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0459011 Dec 21 04:24:24.753276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43930) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.802848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14d2f4c6-e791-4be4-ac29-2c29093a769e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:24.804335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-14d2f4c6-e791-4be4-ac29-2c29093a769e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0501316 Dec 21 04:24:24.806853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43932) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.848451 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-454e3d09-c2bd-4cb4-ad86-843456f8a7e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0405037 Dec 21 04:24:24.852375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43934) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:24.857430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:25.006556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:25.010037 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.069805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.127130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.265151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14153a66-bfa5-437e-abf1-89acfd863f99 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:25.339404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e8176c31-cfe5-4074-82cf-fd447110f6e0 None None] Provisioning complete for port 9b191e2f-49b2-4751-bfb3-76aa545a976c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:25.339780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8176c31-cfe5-4074-82cf-fd447110f6e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.449994 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8176c31-cfe5-4074-82cf-fd447110f6e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.456802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:25.508064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e8176c31-cfe5-4074-82cf-fd447110f6e0 None None] For port 9b191e2f-49b2-4751-bfb3-76aa545a976c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b191e2f-49b2-4751-bfb3-76aa545a976c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:25.528932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] Deleting port 9b191e2f-49b2-4751-bfb3-76aa545a976c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:25.529337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.595086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] For port 9b191e2f-49b2-4751-bfb3-76aa545a976c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9b191e2f-49b2-4751-bfb3-76aa545a976c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:25.595487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.605932 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8176c31-cfe5-4074-82cf-fd447110f6e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.614977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] Calling delete_port for 9b191e2f-49b2-4751-bfb3-76aa545a976c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:25.629713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.676194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:25.679463 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:25.683917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:25.684495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.693705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=6c468f5c-7231-4fba-881b-9350f000d16c,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:25.702708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8176c31-cfe5-4074-82cf-fd447110f6e0 None None] Pushing event updated for resources: {'Port': ['ID=9b191e2f-49b2-4751-bfb3-76aa545a976c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:25.757891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c6ae3166-96c0-492d-a4a8-2b52d8b870e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9043100 Dec 21 04:24:25.760568 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43936) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:25.765525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '6c468f5c-7231-4fba-881b-9350f000d16c', 'ip_address': '2001:db8::63e5:b69d:6efd:2d6b'}], 'name': 'tempest-NetworksTestDHCPv6-2088746788'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:25.801226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.852438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:25.881230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] Pushing event deleted for resources: {'Port': ['ID=9b191e2f-49b2-4751-bfb3-76aa545a976c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:25.886810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c1642d-b0bf-45eb-a820-4b102e87b497 None None] No DVR routers for this DVR port 9b191e2f-49b2-4751-bfb3-76aa545a976c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:25.895898 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:24:25.901871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fab46e96-bad1-47f7-beef-f21f6f79168d None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:25.944215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:26.002332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '6c468f5c-7231-4fba-881b-9350f000d16c'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:26.003309 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.029701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.047948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 70bfb611-fa1d-45a8-9b5a-0638f6046958 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:26.137684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/6c468f5c-7231-4fba-881b-9350f000d16c/d2d74b5f-9381-4069-ab0b-191e1fde0568) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:26.275203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.355524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.397681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:26.400540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:26.403480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:26.408569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::63e5:b69d:6efd:2d6b (b93c538b-c177-45d8-ae5b-37770a1f77ba/6c468f5c-7231-4fba-881b-9350f000d16c/70bfb611-fa1d-45a8-9b5a-0638f6046958) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:26.415005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Pushing event updated for resources: {'Port': ['ID=d2d74b5f-9381-4069-ab0b-191e1fde0568,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:26.467135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Attempting to bind port d2d74b5f-9381-4069-ab0b-191e1fde0568 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:26.467509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Attempting to bind port d2d74b5f-9381-4069-ab0b-191e1fde0568 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:26.467869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Attempting to bind port d2d74b5f-9381-4069-ab0b-191e1fde0568 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:26.472757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:26.473758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:26.473758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.473996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:26.474368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Bound port: d2d74b5f-9381-4069-ab0b-191e1fde0568, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:26.474748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.534767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] For port d2d74b5f-9381-4069-ab0b-191e1fde0568, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:26.537839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] For port d2d74b5f-9381-4069-ab0b-191e1fde0568, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d74b5f-9381-4069-ab0b-191e1fde0568,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:26.552690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.613233 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.647510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.676174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed45ed40-79aa-4ddf-a3eb-d32f94e930ed None None] Pushing event updated for resources: {'Port': ['ID=d2d74b5f-9381-4069-ab0b-191e1fde0568,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:26.711104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:26.714310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:26.717931 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:26.723636 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:26.724256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:26.741151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=70bfb611-fa1d-45a8-9b5a-0638f6046958,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:26.798867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-384bfbfd-f149-400d-a39c-14a9e35b0e46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.0373092 Dec 21 04:24:26.804490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43938) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:26.809925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '6c468f5c-7231-4fba-881b-9350f000d16c', 'ip_address': '2001:db8::63e5:b69d:6efd:2d6b'}], 'name': 'tempest-NetworksTestDHCPv6-654988982'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:26.989405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:27.076008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.093033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 3fdc49de-759d-4b05-8ab8-204e85b8fef7 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:27.276120 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): There was a conflict when trying to complete your request. Dec 21 04:24:27.276648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:27.361769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ccb6af0f-b2a8-4473-9c65-68fb7f3790e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 409 len: 389 time: 0.5553794 Dec 21 04:24:27.361769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43940) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:27.412120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1787861-5e1e-4947-8492-e0e65d08a6cb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:27.418137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1787861-5e1e-4947-8492-e0e65d08a6cb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:27.419830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1787861-5e1e-4947-8492-e0e65d08a6cb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1685 time: 0.0572267 Dec 21 04:24:27.423144 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43942) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:27.511624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 70bfb611-fa1d-45a8-9b5a-0638f6046958 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:27.512005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.605778 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.618813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 70bfb611-fa1d-45a8-9b5a-0638f6046958 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:27.644495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9875250f-e93c-46a6-b0ac-f87bdd153d91 None None] Provisioning complete for port d2d74b5f-9381-4069-ab0b-191e1fde0568 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:27.645060 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9875250f-e93c-46a6-b0ac-f87bdd153d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.731029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9875250f-e93c-46a6-b0ac-f87bdd153d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.766725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9875250f-e93c-46a6-b0ac-f87bdd153d91 None None] For port d2d74b5f-9381-4069-ab0b-191e1fde0568, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d74b5f-9381-4069-ab0b-191e1fde0568,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:27.864349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.892614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=70bfb611-fa1d-45a8-9b5a-0638f6046958,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:27.902655 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9875250f-e93c-46a6-b0ac-f87bdd153d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.929690 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:27.934231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0c2d5ec9-6ad0-4760-b2da-72c9478a0833 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/70bfb611-fa1d-45a8-9b5a-0638f6046958 HTTP/1.1" status: 204 len: 168 time: 0.5098403 Dec 21 04:24:27.936937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43944) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:27.952305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9875250f-e93c-46a6-b0ac-f87bdd153d91 None None] Pushing event updated for resources: {'Port': ['ID=d2d74b5f-9381-4069-ab0b-191e1fde0568,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:27.993033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f17b5cf3-5721-4a12-a1c9-72d3f642649a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:27.994899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f17b5cf3-5721-4a12-a1c9-72d3f642649a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:27.999372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f17b5cf3-5721-4a12-a1c9-72d3f642649a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0582006 Dec 21 04:24:28.000282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43946) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:28.013963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-de9919fb-291a-45cc-9322-614cc28ad6db None None] Could not find standard attr ID for object 4176ac2e-4478-48bc-880c-3ac24c9bd351. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:28.019150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-de9919fb-291a-45cc-9322-614cc28ad6db None None] Could not find standard attr ID for object 55348ae0-fde0-450d-bd4b-9bd7d6c1acc0. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:28.064036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 6c468f5c-7231-4fba-881b-9350f000d16c {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:28.067619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.088227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d74b5f-9381-4069-ab0b-191e1fde0568 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:28.109739 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.144708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d2d74b5f-9381-4069-ab0b-191e1fde0568 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:28.145508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.217821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.242019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9bfb849d-dac9-404b-9cc6-2c96097138b4 None None] Could not find standard attr ID for object 5a06fcb0-53d1-4346-aad0-8c60d847cddf. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:28.338756 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.369263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=6c468f5c-7231-4fba-881b-9350f000d16c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:28.372781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.379208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5f320641-7c1a-4c01-be40-f4ee249378f1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/6c468f5c-7231-4fba-881b-9350f000d16c HTTP/1.1" status: 204 len: 168 time: 0.3779047 Dec 21 04:24:28.379498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43948) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:28.381880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74009c44-29d0-4c25-ae60-ce9a621cbff3 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:28.420444 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-33c940c3-52e9-46e4-8c08-99ac31b67b0a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0395157 Dec 21 04:24:28.425124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43950) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:28.431952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:28.589893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:28.594331 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.657687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fe9c44a7-4c42-4a13-8b4d-6a67793d9a00 None None] Could not find standard attr ID for object 59231703-1288-4a9a-b99d-5693b471bc6c. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:28.731092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:28.777856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] Deleting port d2d74b5f-9381-4069-ab0b-191e1fde0568 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:28.778236 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.841331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] For port d2d74b5f-9381-4069-ab0b-191e1fde0568, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d74b5f-9381-4069-ab0b-191e1fde0568,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:28.841610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.841747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.854544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] Calling delete_port for d2d74b5f-9381-4069-ab0b-191e1fde0568 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:28.880430 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:28.883656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:28.887863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:28.888466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:28.904622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=4b06f33b-daa1-47fb-97c7-11ec7374428b,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:28.958090 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26a4a62b-7c9a-427d-b6ba-f733ffbcdd98 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5301337 Dec 21 04:24:28.960848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43952) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:28.967250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '4b06f33b-daa1-47fb-97c7-11ec7374428b', 'ip_address': '2001:db8:0:1::'}], 'name': 'tempest-NetworksTestDHCPv6-1880488894'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:29.001707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.026860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] Pushing event deleted for resources: {'Port': ['ID=d2d74b5f-9381-4069-ab0b-191e1fde0568,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:29.030365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b2b64d0-65b6-451b-82fa-5e1b02fcadd1 None None] No DVR routers for this DVR port d2d74b5f-9381-4069-ab0b-191e1fde0568 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:29.048871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33004f44-abdb-4bee-82c0-c6d69eb6659f None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:29.147277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '4b06f33b-daa1-47fb-97c7-11ec7374428b'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:29.148127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.149906 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:29.154974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.172710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port ae7cd3d7-22f5-454a-9a77-ad0cd89fc852 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:29.287781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/4b06f33b-daa1-47fb-97c7-11ec7374428b/7da45251-6fb8-4c7c-b3ca-b55b5317438c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:29.425217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.481104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.509979 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:29.510439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:29.518879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:29.521626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:29.524963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:29.530382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Pushing event updated for resources: {'Port': ['ID=7da45251-6fb8-4c7c-b3ca-b55b5317438c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:29.575153 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2353087a-d7a2-44dc-b891-63c2392b0abf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 400 len: 349 time: 0.6116505 Dec 21 04:24:29.577357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43954) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:29.580957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Attempting to bind port 7da45251-6fb8-4c7c-b3ca-b55b5317438c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:29.581333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Attempting to bind port 7da45251-6fb8-4c7c-b3ca-b55b5317438c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:29.581698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Attempting to bind port 7da45251-6fb8-4c7c-b3ca-b55b5317438c on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:29.586473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:29.586848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:29.587277 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.587671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:29.588138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Bound port: 7da45251-6fb8-4c7c-b3ca-b55b5317438c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:29.588538 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.633446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e82b2203-dee0-4906-a453-83566c7fcdf8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:29.635084 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e82b2203-dee0-4906-a453-83566c7fcdf8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.0567873 Dec 21 04:24:29.637698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43956) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:29.660937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] For port 7da45251-6fb8-4c7c-b3ca-b55b5317438c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:29.663960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] For port 7da45251-6fb8-4c7c-b3ca-b55b5317438c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7da45251-6fb8-4c7c-b3ca-b55b5317438c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:29.694892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5616fcc0-e99c-43b7-9480-63b04d4f4d26 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:29.696528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5616fcc0-e99c-43b7-9480-63b04d4f4d26 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:29.698013 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5616fcc0-e99c-43b7-9480-63b04d4f4d26 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0575645 Dec 21 04:24:29.702245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43958) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:29.710246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.757626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 4b06f33b-daa1-47fb-97c7-11ec7374428b {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:29.761131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.772942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d347eda-ffb6-4338-92a0-1481fe736e3e None None] Pushing event updated for resources: {'Port': ['ID=7da45251-6fb8-4c7c-b3ca-b55b5317438c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:29.803761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:29.894727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.041368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.074074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=4b06f33b-daa1-47fb-97c7-11ec7374428b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:30.074257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7da45251-6fb8-4c7c-b3ca-b55b5317438c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:30.079842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.083387 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7e8b7840-635c-4980-820c-17d432db53ad tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/4b06f33b-daa1-47fb-97c7-11ec7374428b HTTP/1.1" status: 204 len: 168 time: 0.3801813 Dec 21 04:24:30.085804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43960) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:30.124131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d78a26d0-b1e9-4881-8315-3e988d0b0bc2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0372000 Dec 21 04:24:30.127750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43962) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:30.132551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:30.137537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7da45251-6fb8-4c7c-b3ca-b55b5317438c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:30.137930 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.217656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.250806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 7da45251-6fb8-4c7c-b3ca-b55b5317438c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7da45251-6fb8-4c7c-b3ca-b55b5317438c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:30.298371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:30.302073 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.326924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.375780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d74b5f-9381-4069-ab0b-191e1fde0568 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:30.399670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=7da45251-6fb8-4c7c-b3ca-b55b5317438c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:30.402399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d2d74b5f-9381-4069-ab0b-191e1fde0568 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:30.402855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d74b5f-9381-4069-ab0b-191e1fde0568 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:30.550090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.600355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:30.603935 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:30.611963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:30.611963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.615979 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=3f43dc66-463f-4a85-9d56-0952b5bea3cb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:30.684197 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d5bb2fb-d242-41e4-a989-6d53e20ba726 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5551178 Dec 21 04:24:30.686767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43964) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:30.694445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1639191285', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:30.717017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10b631cc-d7de-4454-bcec-3e4f1c8dd11e None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:30.778556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.779728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.814378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9af36130-798d-4c42-8a76-317cfcf92d52 None None] Provisioning complete for port 7da45251-6fb8-4c7c-b3ca-b55b5317438c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:30.814748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9af36130-798d-4c42-8a76-317cfcf92d52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.836723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:30.912848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.008695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.010133 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-afafab07-cafe-4338-b9a6-351bb79674a5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.3217380 Dec 21 04:24:31.013059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43966) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:31.150353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9b4071a4-6db2-40c9-848f-c755175b473a None None] Provisioning complete for port 7da45251-6fb8-4c7c-b3ca-b55b5317438c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:31.150777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9b4071a4-6db2-40c9-848f-c755175b473a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.319044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.369487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-69c07514-59e6-4ad4-9360-29d3b93b2fd1 None None] Could not find standard attr ID for object 16d3200b-bc85-4652-9272-eb617e3935e7. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:31.485163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-88804453-e84e-40d5-81b1-50164cf41508 None None] Could not find standard attr ID for object dc0500e6-b457-4092-95ae-ae4b3674b7e6. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:31.562847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::1 (b93c538b-c177-45d8-ae5b-37770a1f77ba/3f43dc66-463f-4a85-9d56-0952b5bea3cb/bce3588e-c6b5-4361-96ca-64ab8a0bd933) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:31.684650 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.699441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d9b75b82-2e83-4b51-99e4-3d6a0a99dece None None] Could not find standard attr ID for object 70bfb611-fa1d-45a8-9b5a-0638f6046958. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:31.795905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.847448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:31.851023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:31.857075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:31.857630 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:31.901439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=bce3588e-c6b5-4361-96ca-64ab8a0bd933,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:32.055479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7da45251-6fb8-4c7c-b3ca-b55b5317438c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:32.058746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.108103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7da45251-6fb8-4c7c-b3ca-b55b5317438c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:32.108410 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.238341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c154838d-0de5-4ca4-b7f0-c70d38715f4d None None] Provisioning complete for port bce3588e-c6b5-4361-96ca-64ab8a0bd933 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:32.238811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c154838d-0de5-4ca4-b7f0-c70d38715f4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.284341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c154838d-0de5-4ca4-b7f0-c70d38715f4d None None] Port bce3588e-c6b5-4361-96ca-64ab8a0bd933 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:32.362722 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.424032 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.424848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.514384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=bce3588e-c6b5-4361-96ca-64ab8a0bd933,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:32.551864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:32.553232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:32.738029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Router 3ac40dda-c004-439b-8bbe-84c1a4889b3c is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:24:32.806622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d671d615-fba6-479d-8a62-b781e353daa3 None None] Provisioning complete for port bce3588e-c6b5-4361-96ca-64ab8a0bd933 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:32.806918 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d671d615-fba6-479d-8a62-b781e353daa3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:32.831755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:24:32.836858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6236f2e3-cb06-4644-8ab3-0bf5c95b29a0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "PUT /v2.0/routers/3ac40dda-c004-439b-8bbe-84c1a4889b3c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8227973 Dec 21 04:24:32.839474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43968) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:32.841958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Sync routers for ids ['3ac40dda-c004-439b-8bbe-84c1a4889b3c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:24:32.850373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d671d615-fba6-479d-8a62-b781e353daa3 None None] Port bce3588e-c6b5-4361-96ca-64ab8a0bd933 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:32.856837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Routers {'3ac40dda-c004-439b-8bbe-84c1a4889b3c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:32.857465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3ac40dda-c004-439b-8bbe-84c1a4889b3c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:32.887806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1ec63f9-44b0-45c3-838f-a9842be7a4f9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:32.889440 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c1ec63f9-44b0-45c3-838f-a9842be7a4f9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports/bce3588e-c6b5-4361-96ca-64ab8a0bd933 HTTP/1.1" status: 200 len: 911 time: 0.0487213 Dec 21 04:24:32.891735 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43970) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:32.939900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d4e9ce8-9d0c-42c1-82f2-7af515185ddb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:32.944464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Set router 3ac40dda-c004-439b-8bbe-84c1a4889b3c gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:24:32.945897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d4e9ce8-9d0c-42c1-82f2-7af515185ddb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:32.947497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d4e9ce8-9d0c-42c1-82f2-7af515185ddb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1576 time: 0.0548472 Dec 21 04:24:32.950116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43972) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:33.136389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3ac40dda-c004-439b-8bbe-84c1a4889b3c', 'name': 'tempest-NetworksTestDHCPv6-router-1639191285', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:30Z', 'updated_at': '2021-12-21T04:24:31Z', 'revision_number': 2, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None, '_interfaces': [{'id': 'bce3588e-c6b5-4361-96ca-64ab8a0bd933', 'name': '', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'mac_address': 'fa:16:3e:30:cd:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ac40dda-c004-439b-8bbe-84c1a4889b3c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3885, 'fixed_ips': [{'subnet_id': '3f43dc66-463f-4a85-9d56-0952b5bea3cb', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:24:31Z', 'updated_at': '2021-12-21T04:24:32Z', 'revision_number': 2, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'subnets': [{'id': '3f43dc66-463f-4a85-9d56-0952b5bea3cb', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:33.162911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Checking router: 3ac40dda-c004-439b-8bbe-84c1a4889b3c for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:24:33.163302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Updating router 3ac40dda-c004-439b-8bbe-84c1a4889b3c port bce3588e-c6b5-4361-96ca-64ab8a0bd933 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:24:33.187893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.252590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.445144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.456433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port bce3588e-c6b5-4361-96ca-64ab8a0bd933 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:33.456948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.503705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.545460 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.555629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d0ea59-4345-4577-8f94-c4ec8776bcd9 None None] Pushing event updated for resources: {'Port': ['ID=bce3588e-c6b5-4361-96ca-64ab8a0bd933,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:33.560502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for bce3588e-c6b5-4361-96ca-64ab8a0bd933 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:33.604604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Attempting to bind port bce3588e-c6b5-4361-96ca-64ab8a0bd933 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:33.604978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Attempting to bind port bce3588e-c6b5-4361-96ca-64ab8a0bd933 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:33.605341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Attempting to bind port bce3588e-c6b5-4361-96ca-64ab8a0bd933 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:33.613392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:33.613392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:33.613392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.613392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:33.613392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Bound port: bce3588e-c6b5-4361-96ca-64ab8a0bd933, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:33.613392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.680040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] For port bce3588e-c6b5-4361-96ca-64ab8a0bd933, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:33.683721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] For port bce3588e-c6b5-4361-96ca-64ab8a0bd933, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=bce3588e-c6b5-4361-96ca-64ab8a0bd933,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:33.739059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.815503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-510bb276-15b8-40d7-8fd1-90ccd14d6de2 None None] Provisioning complete for port bce3588e-c6b5-4361-96ca-64ab8a0bd933 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:33.815879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-510bb276-15b8-40d7-8fd1-90ccd14d6de2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.817928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Routers {'3ac40dda-c004-439b-8bbe-84c1a4889b3c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:33.818549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3ac40dda-c004-439b-8bbe-84c1a4889b3c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:33.821181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d0ea59-4345-4577-8f94-c4ec8776bcd9 None None] Pushing event updated for resources: {'Port': ['ID=bce3588e-c6b5-4361-96ca-64ab8a0bd933,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:33.847352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:33.875891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=bce3588e-c6b5-4361-96ca-64ab8a0bd933,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:33.931375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-510bb276-15b8-40d7-8fd1-90ccd14d6de2 None None] Could not find standard attr ID for object bce3588e-c6b5-4361-96ca-64ab8a0bd933. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:33.939188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] Set router 3ac40dda-c004-439b-8bbe-84c1a4889b3c gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:24:33.941313 n-d-822053-11 neutron-server[110312]: INFO neutron.plugins.ml2.db [None req-510bb276-15b8-40d7-8fd1-90ccd14d6de2 None None] No ports have port_id starting with bce3588e-c6b5-4361-96ca-64ab8a0bd933 Dec 21 04:24:33.979042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:34.090648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-430873c3-2e49-4e02-8f03-9329c72089b7 None None] Could not find standard attr ID for object bce3588e-c6b5-4361-96ca-64ab8a0bd933. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:34.160869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3ac40dda-c004-439b-8bbe-84c1a4889b3c', 'name': 'tempest-NetworksTestDHCPv6-router-1639191285', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:30Z', 'updated_at': '2021-12-21T04:24:31Z', 'revision_number': 2, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None, '_interfaces': [{'id': 'bce3588e-c6b5-4361-96ca-64ab8a0bd933', 'name': '', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'mac_address': 'fa:16:3e:30:cd:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ac40dda-c004-439b-8bbe-84c1a4889b3c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3885, 'fixed_ips': [{'subnet_id': '3f43dc66-463f-4a85-9d56-0952b5bea3cb', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:24:31Z', 'updated_at': '2021-12-21T04:24:33Z', 'revision_number': 4, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'subnets': [{'id': '3f43dc66-463f-4a85-9d56-0952b5bea3cb', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:34.190020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26affa7d-0c47-4317-9f9f-0606a45d968d None None] The sync data for ids ['3ac40dda-c004-439b-8bbe-84c1a4889b3c'] in n-d-822053-11 is: [{'id': '3ac40dda-c004-439b-8bbe-84c1a4889b3c', 'name': 'tempest-NetworksTestDHCPv6-router-1639191285', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:30Z', 'updated_at': '2021-12-21T04:24:31Z', 'revision_number': 2, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None, '_interfaces': [{'id': 'bce3588e-c6b5-4361-96ca-64ab8a0bd933', 'name': '', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'mac_address': 'fa:16:3e:30:cd:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ac40dda-c004-439b-8bbe-84c1a4889b3c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3885, 'fixed_ips': [{'subnet_id': '3f43dc66-463f-4a85-9d56-0952b5bea3cb', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:24:31Z', 'updated_at': '2021-12-21T04:24:33Z', 'revision_number': 4, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'subnets': [{'id': '3f43dc66-463f-4a85-9d56-0952b5bea3cb', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:24:34.524320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Router 3ac40dda-c004-439b-8bbe-84c1a4889b3c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:24:34.608493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:24:34.614258 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b976260b-aaf2-47c0-bee4-1eaba7b3ade9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "PUT /v2.0/routers/3ac40dda-c004-439b-8bbe-84c1a4889b3c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6631815 Dec 21 04:24:34.616731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43974) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:34.668451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d9b4a0f-5b2a-460d-9bb9-0332e0029b23 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:34.670052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d9b4a0f-5b2a-460d-9bb9-0332e0029b23 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:34.671676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d9b4a0f-5b2a-460d-9bb9-0332e0029b23 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0539789 Dec 21 04:24:34.675055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43976) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:34.731624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 3f43dc66-463f-4a85-9d56-0952b5bea3cb {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:34.735507 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:34.775808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:34.820275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:34.955566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:34.988441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=3f43dc66-463f-4a85-9d56-0952b5bea3cb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:34.992194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:34.995513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-041525e7-baa6-4fef-adcb-9db1b880b32a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/3f43dc66-463f-4a85-9d56-0952b5bea3cb HTTP/1.1" status: 204 len: 168 time: 0.3195133 Dec 21 04:24:34.997932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43978) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:35.000212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cae8292f-3601-4266-8eff-e5bf1b17274d None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:35.081350 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-89b59e3b-0186-4f6d-8566-2276a329d6e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.0813930 Dec 21 04:24:35.083813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43980) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:35.154021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:35.163355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.201009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] Deleting port 7da45251-6fb8-4c7c-b3ca-b55b5317438c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:35.201633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.274432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] For port 7da45251-6fb8-4c7c-b3ca-b55b5317438c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7da45251-6fb8-4c7c-b3ca-b55b5317438c,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:35.274432 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.324489 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.327355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.423939 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.424581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Fanout notify agent at l3_agent the message router_deleted on router 3ac40dda-c004-439b-8bbe-84c1a4889b3c {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:24:35.432435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.435644 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-462177b3-ee71-4fcd-9160-eab9aa191a09 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/routers/3ac40dda-c004-439b-8bbe-84c1a4889b3c HTTP/1.1" status: 204 len: 168 time: 0.3489172 Dec 21 04:24:35.437738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43982) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:35.443151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:35.449706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] Calling delete_port for 7da45251-6fb8-4c7c-b3ca-b55b5317438c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:35.578575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.589635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:35.593226 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.605482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] No DVR routers for this DVR port 7da45251-6fb8-4c7c-b3ca-b55b5317438c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:35.607077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cded1793-e626-42e5-b427-6e4a8d7de339 None None] Pushing event deleted for resources: {'Port': ['ID=7da45251-6fb8-4c7c-b3ca-b55b5317438c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:35.636759 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Sync routers for ids ['3ac40dda-c004-439b-8bbe-84c1a4889b3c'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:24:35.646578 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Routers set() bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:35.648319 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Router IDs set() for agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 21 04:24:35.648319 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_agentschedulers_db [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'3ac40dda-c004-439b-8bbe-84c1a4889b3c'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent'). {{(pid=110313) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 21 04:24:35.655440 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Routers set() bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:35.655797 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Router IDs set() for agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 21 04:24:35.656412 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_agentschedulers_db [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'3ac40dda-c004-439b-8bbe-84c1a4889b3c'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent'). {{(pid=110313) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 21 04:24:35.656778 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff62ea5-4ffa-43bb-9c24-181aeb6a05cb None None] The sync data for ids ['3ac40dda-c004-439b-8bbe-84c1a4889b3c'] in n-d-822053-11 is: [] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:24:35.852779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.895742 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:35.898842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:35.903006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:35.903604 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:35.908014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7606f255-3a7c-428a-a49a-9c9e93c2287a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:35.913015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=afbb2103-388c-45e1-80d7-a063919772a0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:35.980645 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2417c159-0ef9-4653-b68e-f5f4f80cf7ba tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5416148 Dec 21 04:24:35.983249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43984) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:35.987766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:36.007434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'afbb2103-388c-45e1-80d7-a063919772a0'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:36.009251 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.079808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7da45251-6fb8-4c7c-b3ca-b55b5317438c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:36.086726 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.087972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.106084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7da45251-6fb8-4c7c-b3ca-b55b5317438c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:36.106435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7da45251-6fb8-4c7c-b3ca-b55b5317438c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:36.144200 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.165788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/afbb2103-388c-45e1-80d7-a063919772a0/01591ac3-3624-4e4a-bb7e-900225923608) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:36.212821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.294496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.295839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9b700670-a6d3-4be9-a93a-55754629dd12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.3116195 Dec 21 04:24:36.304892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.306107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43986) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:36.355848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.398065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:36.400928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:36.405292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:36.409094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Pushing event updated for resources: {'Port': ['ID=01591ac3-3624-4e4a-bb7e-900225923608,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:36.462979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Attempting to bind port 01591ac3-3624-4e4a-bb7e-900225923608 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:36.463359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Attempting to bind port 01591ac3-3624-4e4a-bb7e-900225923608 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:36.463725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Attempting to bind port 01591ac3-3624-4e4a-bb7e-900225923608 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:36.468663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:36.469049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:36.469452 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.469848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:36.470320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Bound port: 01591ac3-3624-4e4a-bb7e-900225923608, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:36.470701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.531413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] For port 01591ac3-3624-4e4a-bb7e-900225923608, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:36.534344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] For port 01591ac3-3624-4e4a-bb7e-900225923608, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=01591ac3-3624-4e4a-bb7e-900225923608,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:36.582121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.595887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:36.660809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-894fd418-9108-4a18-b300-71a5a93add34 None None] Pushing event updated for resources: {'Port': ['ID=01591ac3-3624-4e4a-bb7e-900225923608,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:36.837531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::1 (b93c538b-c177-45d8-ae5b-37770a1f77ba/afbb2103-388c-45e1-80d7-a063919772a0/64e56fcc-8063-458d-8cce-452f64afdd5f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:36.964184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.035465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.072260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:37.077194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:37.079757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:37.080485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.131223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=64e56fcc-8063-458d-8cce-452f64afdd5f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:37.274677 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.539572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.589588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.590406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.643076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9adfb377-ce1a-4a1b-a4ca-3d464dd048d7 None None] Provisioning complete for port 01591ac3-3624-4e4a-bb7e-900225923608 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:37.643076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9adfb377-ce1a-4a1b-a4ca-3d464dd048d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.694980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=64e56fcc-8063-458d-8cce-452f64afdd5f,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:37.723435 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9adfb377-ce1a-4a1b-a4ca-3d464dd048d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.737859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:37.739284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:37.756663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9adfb377-ce1a-4a1b-a4ca-3d464dd048d7 None None] For port 01591ac3-3624-4e4a-bb7e-900225923608, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=01591ac3-3624-4e4a-bb7e-900225923608,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:37.835293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9adfb377-ce1a-4a1b-a4ca-3d464dd048d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.886407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adfb377-ce1a-4a1b-a4ca-3d464dd048d7 None None] Pushing event updated for resources: {'Port': ['ID=01591ac3-3624-4e4a-bb7e-900225923608,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:37.938412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:24:37.962470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0db8c77a-a71f-4b73-bb1a-9688260230d3 None None] Provisioning complete for port 64e56fcc-8063-458d-8cce-452f64afdd5f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:37.962847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0db8c77a-a71f-4b73-bb1a-9688260230d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:37.997909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0db8c77a-a71f-4b73-bb1a-9688260230d3 None None] Port 64e56fcc-8063-458d-8cce-452f64afdd5f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:38.035990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:24:38.041017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-67192fb5-7d15-401f-9270-a1df8dfce910 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "PUT /v2.0/routers/3fd36ea1-d3c2-40f1-bdda-653a67b95ac3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7338979 Dec 21 04:24:38.043912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43988) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:38.051116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Sync routers for ids ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:24:38.061493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Routers {'3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:38.062812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:38.096854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-144548d6-a411-4f00-b953-1e8ffcc91802 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:38.098312 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-144548d6-a411-4f00-b953-1e8ffcc91802 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports/64e56fcc-8063-458d-8cce-452f64afdd5f HTTP/1.1" status: 200 len: 911 time: 0.0533478 Dec 21 04:24:38.100887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:38.102158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 01591ac3-3624-4e4a-bb7e-900225923608 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:38.148250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c154e19-fa0a-4330-a8ec-dde5597a231b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:38.154105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c154e19-fa0a-4330-a8ec-dde5597a231b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:38.155966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7c154e19-fa0a-4330-a8ec-dde5597a231b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.0538292 Dec 21 04:24:38.158468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43992) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:38.195845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Set router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:24:38.197669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7bc5aee8-281c-48c6-a4b4-f7d06b19b082 None None] Provisioning complete for port 64e56fcc-8063-458d-8cce-452f64afdd5f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:38.198038 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7bc5aee8-281c-48c6-a4b4-f7d06b19b082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.303399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 01591ac3-3624-4e4a-bb7e-900225923608 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:38.303771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.314596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7bc5aee8-281c-48c6-a4b4-f7d06b19b082 None None] Port 64e56fcc-8063-458d-8cce-452f64afdd5f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:38.462639 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.489748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:37Z', 'revision_number': 2, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None, '_interfaces': [{'id': '64e56fcc-8063-458d-8cce-452f64afdd5f', 'name': '', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'mac_address': 'fa:16:3e:81:d0:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': 'afbb2103-388c-45e1-80d7-a063919772a0', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:37Z', 'revision_number': 2, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'subnets': [{'id': 'afbb2103-388c-45e1-80d7-a063919772a0', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:38.516327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Checking router: 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:24:38.516686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Updating router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 port 64e56fcc-8063-458d-8cce-452f64afdd5f binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:24:38.543825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.671705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 64e56fcc-8063-458d-8cce-452f64afdd5f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:38.672046 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.765989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.772300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 64e56fcc-8063-458d-8cce-452f64afdd5f owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:38.810803 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.897863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:38.947963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1bea115-e9b9-4e9e-b4be-9ba4f4ab51a4 None None] Pushing event updated for resources: {'Port': ['ID=64e56fcc-8063-458d-8cce-452f64afdd5f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:39.006330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Attempting to bind port 64e56fcc-8063-458d-8cce-452f64afdd5f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:39.006788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Attempting to bind port 64e56fcc-8063-458d-8cce-452f64afdd5f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:39.007245 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Attempting to bind port 64e56fcc-8063-458d-8cce-452f64afdd5f on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:39.012455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:39.012828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:39.013414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.014015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:39.014806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Bound port: 64e56fcc-8063-458d-8cce-452f64afdd5f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:39.015519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.018205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.047842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=64e56fcc-8063-458d-8cce-452f64afdd5f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:39.057122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Port 64e56fcc-8063-458d-8cce-452f64afdd5f has been deleted concurrently {{(pid=110312) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Dec 21 04:24:39.066656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Routers {'3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:39.067322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:39.141435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] Set router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:24:39.143774 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.198138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:38Z', 'revision_number': 3, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:39.235957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e27d01fa-5855-4f3a-b653-2e111acbbd5a None None] The sync data for ids ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'] in n-d-822053-11 is: [{'id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:38Z', 'revision_number': 3, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:24:39.239267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-102d2a33-bac9-4970-9f50-e376c1bee3f6 None None] Could not find standard attr ID for object 64e56fcc-8063-458d-8cce-452f64afdd5f. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:39.311359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:24:39.387301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:24:39.394752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-92bb0b3a-2f6a-4efd-950e-a1b894b963e5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "PUT /v2.0/routers/3fd36ea1-d3c2-40f1-bdda-653a67b95ac3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.2331500 Dec 21 04:24:39.395034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43994) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:39.451171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d3951da-986e-4244-aacc-c11d9fc9d3ec tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:39.452676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d3951da-986e-4244-aacc-c11d9fc9d3ec tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:39.454281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d3951da-986e-4244-aacc-c11d9fc9d3ec tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0583506 Dec 21 04:24:39.456859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 43996) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:39.506660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet afbb2103-388c-45e1-80d7-a063919772a0 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:39.509712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.548899 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.635980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.744000 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.770426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=afbb2103-388c-45e1-80d7-a063919772a0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:39.775467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:39.781593 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 43998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:39.782100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8eee3dc0-428a-49e2-9b84-96c9bca6a8eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/afbb2103-388c-45e1-80d7-a063919772a0 HTTP/1.1" status: 204 len: 168 time: 0.3242886 Dec 21 04:24:39.785291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b01833cf-941b-48be-84fa-b5a8bef218f0 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:39.878261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44000) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:39.878982 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b51c8db8-e51c-4992-8abb-2bda94336c64 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.0961783 Dec 21 04:24:39.950055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:39.961776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.007281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] Deleting port 01591ac3-3624-4e4a-bb7e-900225923608 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:40.007912 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.057671 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] Sync routers for ids ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:24:40.073159 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] Routers {'3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:40.073954 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:40.087301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 01591ac3-3624-4e4a-bb7e-900225923608 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:40.148553 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] Set router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:24:40.207635 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:38Z', 'revision_number': 3, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:40.236160 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] Checking router: 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:24:40.245917 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] Routers {'3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:24:40.246696 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:24:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:40.299130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] For port 01591ac3-3624-4e4a-bb7e-900225923608, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=01591ac3-3624-4e4a-bb7e-900225923608,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:40.299553 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.317606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] Calling delete_port for 01591ac3-3624-4e4a-bb7e-900225923608 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:40.322968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] Set router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:24:40.378921 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:38Z', 'revision_number': 3, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:24:40.406966 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0ef7062-a160-4b76-a7f4-28b31764c569 None None] The sync data for ids ['3fd36ea1-d3c2-40f1-bdda-653a67b95ac3'] in n-d-822053-11 is: [{'id': '3fd36ea1-d3c2-40f1-bdda-653a67b95ac3', 'name': 'tempest-NetworksTestDHCPv6-router-1657387260', 'tenant_id': 'a88d2e6974504a06a3b42dbe344029d5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:24:36Z', 'updated_at': '2021-12-21T04:24:38Z', 'revision_number': 3, 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:24:40.413096 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.488467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.490682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.526448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 21 04:24:40.526448 n-d-822053-11 neutron-server[110312]: [SQL: UPDATE ports SET status=%(status)s WHERE ports.id = %(ports_id)s] Dec 21 04:24:40.526448 n-d-822053-11 neutron-server[110312]: [parameters: {'status': 'DOWN', 'ports_id': '01591ac3-3624-4e4a-bb7e-900225923608'}] Dec 21 04:24:40.526448 n-d-822053-11 neutron-server[110312]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:24:40.527150 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:24:40.528604 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.540975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] No DVR routers for this DVR port 01591ac3-3624-4e4a-bb7e-900225923608 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:40.560176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-874e255c-81ff-4cb6-ab75-75ebb1b79111 None None] Pushing event deleted for resources: {'Port': ['ID=01591ac3-3624-4e4a-bb7e-900225923608,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:40.624022 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.624539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Fanout notify agent at l3_agent the message router_deleted on router 3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:24:40.631752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:40.632889 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd6ac4e4-da7f-4497-b440-08ee980bf790 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/routers/3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 HTTP/1.1" status: 204 len: 168 time: 0.7536433 Dec 21 04:24:40.635511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44002) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:40.666907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-21db03d5-40d7-43a4-9236-8b1bb553b8cb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0302835 Dec 21 04:24:40.670685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44004) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:40.724300 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61f1d356-0e04-4b99-852b-def10913fdf5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:40.725663 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61f1d356-0e04-4b99-852b-def10913fdf5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0539849 Dec 21 04:24:40.728145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44006) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:40.768371 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-95d71000-e4e0-4bc3-980d-27a8ca875e4f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0391769 Dec 21 04:24:40.772290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:40.777077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:40.921377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:40.925056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.047606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Port 01591ac3-3624-4e4a-bb7e-900225923608 update to DOWN by agent not found {{(pid=110312) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 21 04:24:41.236117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:24:41.237588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.279039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:41.282064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:41.286100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:41.286686 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.290733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26dcdfc8-e201-4a1f-9cb4-d063b66eadd5 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:41.297122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=365ba9e0-c13b-4758-aec5-6a058bf541b1,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:41.369689 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2d48b361-65ea-4a7f-a6b7-61f787ccaa07 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.5963631 Dec 21 04:24:41.372431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44010) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:41.377958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:41.390372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '365ba9e0-c13b-4758-aec5-6a058bf541b1'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:41.391321 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.524252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Allocated IP 2001:db8::f816:3eff:fe49:6c46 (b93c538b-c177-45d8-ae5b-37770a1f77ba/365ba9e0-c13b-4758-aec5-6a058bf541b1/2f5f4ea9-2dca-467b-8869-d2dcf5449037) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:41.543615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:41.547744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.666772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.721448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.759903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:41.764118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:41.768481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:41.771551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Pushing event updated for resources: {'Port': ['ID=2f5f4ea9-2dca-467b-8869-d2dcf5449037,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:41.822478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Attempting to bind port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:41.822854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Attempting to bind port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:41.823260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Attempting to bind port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:41.828623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:41.828999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:41.829396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.829787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:41.830279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Bound port: 2f5f4ea9-2dca-467b-8869-d2dcf5449037, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:41.830659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.858605 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.894224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] For port 2f5f4ea9-2dca-467b-8869-d2dcf5449037, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:41.897311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] For port 2f5f4ea9-2dca-467b-8869-d2dcf5449037, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2f5f4ea9-2dca-467b-8869-d2dcf5449037,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:41.899144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:41.902271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:41.906924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:41.907531 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:41.921329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=48a49de9-f126-43d2-8ce0-0a401994d544,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:41.978781 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:42.010640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-28de8f36-e80e-4ca2-9f1a-23ccb7deeef3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6371911 Dec 21 04:24:42.013383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:42.021151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:27:dc:e8', 'name': 'tempest-NetworksTestDHCPv6-1274046929'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:42.040962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf25a6c-0476-4cad-885a-8ae2c0cd610a None None] Pushing event updated for resources: {'Port': ['ID=2f5f4ea9-2dca-467b-8869-d2dcf5449037,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:42.201118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:42.285213 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:42.311547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port cd29c08f-88e8-47dd-8250-4f66165dbeff yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:42.463846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 172.20.0.13 (b93c538b-c177-45d8-ae5b-37770a1f77ba/48a49de9-f126-43d2-8ce0-0a401994d544/cd29c08f-88e8-47dd-8250-4f66165dbeff) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:42.469780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe27:dce8 (b93c538b-c177-45d8-ae5b-37770a1f77ba/365ba9e0-c13b-4758-aec5-6a058bf541b1/cd29c08f-88e8-47dd-8250-4f66165dbeff) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:42.613777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:42.709883 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:42.756101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:42.759150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:42.762842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:42.790204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=cd29c08f-88e8-47dd-8250-4f66165dbeff,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:42.822960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:42.823831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:42.908979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af42cf62-215e-42e3-a2fe-621cabb726fb None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:42.924156 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d109ae4-50cb-4871-8fdd-e97097b30cff tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 0.9095993 Dec 21 04:24:42.926594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44014) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:42.975304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c4801d6-68e4-4203-b984-6d72d3a328d7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:42.981094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c4801d6-68e4-4203-b984-6d72d3a328d7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:42.982708 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c4801d6-68e4-4203-b984-6d72d3a328d7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1783 time: 0.0550919 Dec 21 04:24:42.986357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44016) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:43.014586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-13d160f4-97a1-4f3a-8357-106bdba3e746 None None] Provisioning complete for port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:43.014982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13d160f4-97a1-4f3a-8357-106bdba3e746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.072782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port cd29c08f-88e8-47dd-8250-4f66165dbeff {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:43.073376 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.128986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13d160f4-97a1-4f3a-8357-106bdba3e746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.150578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] Update dhcp port {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '365ba9e0-c13b-4758-aec5-6a058bf541b1', 'ip_address': '2001:db8::f816:3eff:fe49:6c46'}, {'subnet_id': '48a49de9-f126-43d2-8ce0-0a401994d544'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '2f5f4ea9-2dca-467b-8869-d2dcf5449037'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:24:43.162208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.174427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for cd29c08f-88e8-47dd-8250-4f66165dbeff owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:43.187979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-13d160f4-97a1-4f3a-8357-106bdba3e746 None None] For port 2f5f4ea9-2dca-467b-8869-d2dcf5449037, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2f5f4ea9-2dca-467b-8869-d2dcf5449037,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:43.189339 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.285758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13d160f4-97a1-4f3a-8357-106bdba3e746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.373103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d160f4-97a1-4f3a-8357-106bdba3e746 None None] Pushing event updated for resources: {'Port': ['ID=2f5f4ea9-2dca-467b-8869-d2dcf5449037,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:43.390232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] Allocated IP 172.20.0.2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/48a49de9-f126-43d2-8ce0-0a401994d544/2f5f4ea9-2dca-467b-8869-d2dcf5449037) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:43.412599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.441483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=cd29c08f-88e8-47dd-8250-4f66165dbeff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:43.487968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] For port 2f5f4ea9-2dca-467b-8869-d2dcf5449037, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2f5f4ea9-2dca-467b-8869-d2dcf5449037,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:43.516445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.528133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.532046 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6539a11f-7b4c-4e7f-9dc7-c556e97ad322 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/cd29c08f-88e8-47dd-8250-4f66165dbeff HTTP/1.1" status: 204 len: 168 time: 0.5441399 Dec 21 04:24:43.534462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44018) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:43.566585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.586786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d82f05e-1fd7-43ed-b882-df2d0b968f2b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:43.588346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d82f05e-1fd7-43ed-b882-df2d0b968f2b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:43.589968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d82f05e-1fd7-43ed-b882-df2d0b968f2b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:43.591538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d82f05e-1fd7-43ed-b882-df2d0b968f2b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.0561402 Dec 21 04:24:43.594815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44020) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:43.645873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 365ba9e0-c13b-4758-aec5-6a058bf541b1 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:43.649438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.650904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd00bda0-3e72-4922-a976-55d8244d631a None None] Pushing event updated for resources: {'Port': ['ID=2f5f4ea9-2dca-467b-8869-d2dcf5449037,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:43.690730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.779767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.904371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.931975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=365ba9e0-c13b-4758-aec5-6a058bf541b1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:43.935968 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:43.939729 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3f527701-6166-46ab-8d4f-14160ace53d1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/365ba9e0-c13b-4758-aec5-6a058bf541b1 HTTP/1.1" status: 204 len: 168 time: 0.3439589 Dec 21 04:24:43.942242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44022) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:43.997286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 48a49de9-f126-43d2-8ce0-0a401994d544 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:44.001252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.053259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.115653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2f5f4ea9-2dca-467b-8869-d2dcf5449037 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:44.143276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.169455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:44.169824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.218320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-661134e8-e8df-4c2c-87e8-efa7233f376e None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:44.246841 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.275168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=48a49de9-f126-43d2-8ce0-0a401994d544,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:44.277091 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.282546 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f06d4cc9-68c7-469c-8528-72fbfdf1e593 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/48a49de9-f126-43d2-8ce0-0a401994d544 HTTP/1.1" status: 204 len: 168 time: 0.3371117 Dec 21 04:24:44.282722 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44024) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:44.325512 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8a5d0b13-57f1-4d9e-ab04-ab6373b967e6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0377386 Dec 21 04:24:44.325858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44026) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:44.328859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-73b74788-7345-431d-9b98-ee55696a21a9 None None] Provisioning complete for port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:44.329240 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-73b74788-7345-431d-9b98-ee55696a21a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.330441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:44.466746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-73b74788-7345-431d-9b98-ee55696a21a9 None None] Could not find standard attr ID for object cd29c08f-88e8-47dd-8250-4f66165dbeff. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:44.468387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2553db47-498d-4fe4-abd2-d286cd14ab8c None None] Update dhcp port {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': '48a49de9-f126-43d2-8ce0-0a401994d544'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '2f5f4ea9-2dca-467b-8869-d2dcf5449037'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:24:44.494098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2553db47-498d-4fe4-abd2-d286cd14ab8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.498212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:44.501773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.651410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f38e98e-64e3-43dd-84a4-6154a98e218c None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:44.738676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-101b9b7b-2db0-4add-9a40-ae025fdf1cb8 None None] Provisioning complete for port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:44.738997 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-101b9b7b-2db0-4add-9a40-ae025fdf1cb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.821309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:44.883977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] Deleting port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:44.884267 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.971266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] For port 2f5f4ea9-2dca-467b-8869-d2dcf5449037, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2f5f4ea9-2dca-467b-8869-d2dcf5449037,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:44.971672 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:44.986544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] Calling delete_port for 2f5f4ea9-2dca-467b-8869-d2dcf5449037 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:45.110083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.132335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] Pushing event deleted for resources: {'Port': ['ID=2f5f4ea9-2dca-467b-8869-d2dcf5449037,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:45.137969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-264e28f3-07f3-46ef-aa5b-78a5fa97676a None None] No DVR routers for this DVR port 2f5f4ea9-2dca-467b-8869-d2dcf5449037 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:45.138131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:24:45.139609 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.185154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:45.188823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:45.192968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:45.193558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.197646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75c9fd73-040d-4db0-89e5-c65e82ec1103 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:45.203700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=ba7cd752-db67-4e82-87ed-8c513c439651,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:45.250168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-89889973-7552-41d5-be51-7fe81b607ab9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.9229960 Dec 21 04:24:45.252790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44028) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:45.257780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:45.301683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'ba7cd752-db67-4e82-87ed-8c513c439651'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:45.302543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.412251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:45.415859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.434842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Allocated IP 2001:db8::f816:3eff:fee1:1b8d (b93c538b-c177-45d8-ae5b-37770a1f77ba/ba7cd752-db67-4e82-87ed-8c513c439651/8d7273ea-d70e-43d0-ab93-e4288749ec4b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:45.575504 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.647193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.686575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:45.689911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:45.692313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:45.700787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Pushing event updated for resources: {'Port': ['ID=8d7273ea-d70e-43d0-ab93-e4288749ec4b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:45.726735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.750862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Attempting to bind port 8d7273ea-d70e-43d0-ab93-e4288749ec4b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:45.751271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Attempting to bind port 8d7273ea-d70e-43d0-ab93-e4288749ec4b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:45.751642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Attempting to bind port 8d7273ea-d70e-43d0-ab93-e4288749ec4b on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:45.756564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:45.756944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:45.757351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.757751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:45.758250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Bound port: 8d7273ea-d70e-43d0-ab93-e4288749ec4b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:45.758637 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.768012 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:45.771138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:45.774170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:45.774770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.790912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=93f1efc1-13f3-472e-8a30-b6e7faaa93b8,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:45.824343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] For port 8d7273ea-d70e-43d0-ab93-e4288749ec4b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:45.827971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] For port 8d7273ea-d70e-43d0-ab93-e4288749ec4b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8d7273ea-d70e-43d0-ab93-e4288749ec4b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:45.872495 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-03959884-4d90-433a-86bc-fbad5f104781 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6186230 Dec 21 04:24:45.875873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44030) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:45.880752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:32:53:0b', 'name': 'tempest-NetworksTestDHCPv6-2134194277'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:45.898671 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:45.960293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a15437ab-f60e-4397-a3c4-c51417d6eca7 None None] Pushing event updated for resources: {'Port': ['ID=8d7273ea-d70e-43d0-ab93-e4288749ec4b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:46.048531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:46.052510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:46.065285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2f5f4ea9-2dca-467b-8869-d2dcf5449037 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:46.075716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port d7796245-28c1-4a31-b88f-52fc4bc05544 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:46.086730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 2f5f4ea9-2dca-467b-8869-d2dcf5449037 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:46.087178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2f5f4ea9-2dca-467b-8869-d2dcf5449037 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:46.257476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 172.20.0.13 (b93c538b-c177-45d8-ae5b-37770a1f77ba/93f1efc1-13f3-472e-8a30-b6e7faaa93b8/d7796245-28c1-4a31-b88f-52fc4bc05544) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:46.263831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe32:530b (b93c538b-c177-45d8-ae5b-37770a1f77ba/ba7cd752-db67-4e82-87ed-8c513c439651/d7796245-28c1-4a31-b88f-52fc4bc05544) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:46.414601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:46.516283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:46.562869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:46.568060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:46.574645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:46.601870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=d7796245-28c1-4a31-b88f-52fc4bc05544,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:46.632824 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:46.633442 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:46.712173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3576818-9a5f-4e21-9cdb-b678eb167bfa tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 0.8352349 Dec 21 04:24:46.714809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44032) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:46.763927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-022dc10c-4047-44a0-8770-e8aae82fc628 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:46.770696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-022dc10c-4047-44a0-8770-e8aae82fc628 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:46.774836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-022dc10c-4047-44a0-8770-e8aae82fc628 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1783 time: 0.0564995 Dec 21 04:24:46.775195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44034) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:46.875696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port d7796245-28c1-4a31-b88f-52fc4bc05544 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:46.876043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:46.883703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9ffdf4d-444f-40e7-b2b7-ea47ac74ea0d None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:46.972740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:46.984965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for d7796245-28c1-4a31-b88f-52fc4bc05544 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:47.000887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-148ef1ff-5e0c-42ae-a8ba-d864ed69f83e None None] Provisioning complete for port 8d7273ea-d70e-43d0-ab93-e4288749ec4b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:47.001264 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-148ef1ff-5e0c-42ae-a8ba-d864ed69f83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.090607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] Update dhcp port {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': 'ba7cd752-db67-4e82-87ed-8c513c439651', 'ip_address': '2001:db8::f816:3eff:fee1:1b8d'}, {'subnet_id': '93f1efc1-13f3-472e-8a30-b6e7faaa93b8'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '8d7273ea-d70e-43d0-ab93-e4288749ec4b'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:24:47.241391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.270826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=d7796245-28c1-4a31-b88f-52fc4bc05544,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:47.287811 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.310407 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-148ef1ff-5e0c-42ae-a8ba-d864ed69f83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.353286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.356603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ed7d3c35-fba2-44cc-8e12-1cf8dc1261e1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/d7796245-28c1-4a31-b88f-52fc4bc05544 HTTP/1.1" status: 204 len: 168 time: 0.5806007 Dec 21 04:24:47.359831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44036) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:47.413129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0198acb-8f9d-46a7-a5fd-726bf7887a6a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:47.414765 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0198acb-8f9d-46a7-a5fd-726bf7887a6a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:47.416462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0198acb-8f9d-46a7-a5fd-726bf7887a6a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:47.418026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0198acb-8f9d-46a7-a5fd-726bf7887a6a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.0574322 Dec 21 04:24:47.419829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-148ef1ff-5e0c-42ae-a8ba-d864ed69f83e None None] For port 8d7273ea-d70e-43d0-ab93-e4288749ec4b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8d7273ea-d70e-43d0-ab93-e4288749ec4b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:47.420724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44038) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:47.476401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 93f1efc1-13f3-472e-8a30-b6e7faaa93b8 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:47.477970 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-148ef1ff-5e0c-42ae-a8ba-d864ed69f83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.480430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] Allocated IP 172.20.0.2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/93f1efc1-13f3-472e-8a30-b6e7faaa93b8/8d7273ea-d70e-43d0-ab93-e4288749ec4b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:47.581411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-148ef1ff-5e0c-42ae-a8ba-d864ed69f83e None None] Pushing event updated for resources: {'Port': ['ID=8d7273ea-d70e-43d0-ab93-e4288749ec4b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:47.615348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] For port 8d7273ea-d70e-43d0-ab93-e4288749ec4b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8d7273ea-d70e-43d0-ab93-e4288749ec4b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:47.643073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.691885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.692057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.733004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.782337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159f2764-bdeb-45d0-b2b4-ad304e617414 None None] Pushing event updated for resources: {'Port': ['ID=8d7273ea-d70e-43d0-ab93-e4288749ec4b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:47.816806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.961811 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.988440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=93f1efc1-13f3-472e-8a30-b6e7faaa93b8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:47.995406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:47.998606 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-59c6bcb2-34d4-4a71-8a74-2f6800b4ccd2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/93f1efc1-13f3-472e-8a30-b6e7faaa93b8 HTTP/1.1" status: 204 len: 168 time: 0.5769928 Dec 21 04:24:48.002326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44040) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:48.065547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet ba7cd752-db67-4e82-87ed-8c513c439651 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:48.074120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.095502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8d7273ea-d70e-43d0-ab93-e4288749ec4b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:48.120039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.146660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 8d7273ea-d70e-43d0-ab93-e4288749ec4b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:48.147076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.208128 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.338776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.339910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28860be6-98da-45ab-89a3-bc5ad0205861 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:48.367433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=ba7cd752-db67-4e82-87ed-8c513c439651,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:48.371034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.374208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-61f3e493-58bf-4aa3-9ae8-8548a3516de4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/ba7cd752-db67-4e82-87ed-8c513c439651 HTTP/1.1" status: 204 len: 168 time: 0.3702977 Dec 21 04:24:48.376607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44042) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:48.414535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bdca0a29-7d59-47b9-82ba-3d24ccf53df6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0367892 Dec 21 04:24:48.417173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44044) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:48.420174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-83303fc5-3b00-4d7f-8dc1-bcb48c1546aa None None] Provisioning complete for port 8d7273ea-d70e-43d0-ab93-e4288749ec4b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:48.420589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-83303fc5-3b00-4d7f-8dc1-bcb48c1546aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.422589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:48.516127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-83303fc5-3b00-4d7f-8dc1-bcb48c1546aa None None] Could not find standard attr ID for object d7796245-28c1-4a31-b88f-52fc4bc05544. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:48.546087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:48.555379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:48.559108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.594173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] Deleting port 8d7273ea-d70e-43d0-ab93-e4288749ec4b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:48.594556 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.660089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] For port 8d7273ea-d70e-43d0-ab93-e4288749ec4b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=8d7273ea-d70e-43d0-ab93-e4288749ec4b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:48.660492 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.672815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] Calling delete_port for 8d7273ea-d70e-43d0-ab93-e4288749ec4b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:48.778210 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.801396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.821783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:48.825006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:48.828797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:48.828983 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] Pushing event deleted for resources: {'Port': ['ID=8d7273ea-d70e-43d0-ab93-e4288749ec4b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:48.829622 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:48.830711 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34d4454c-8eba-4b32-885e-0e30302e8462 None None] No DVR routers for this DVR port 8d7273ea-d70e-43d0-ab93-e4288749ec4b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:48.849394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=5f0c21a2-3d75-46bb-979e-8f15db59a0cf,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:48.850043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b56ee988-2328-4e99-9014-9f46527eaae0 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:48.900849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4d7d4df5-69bf-4ea8-9f9d-bd52789e2150 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4825947 Dec 21 04:24:48.903635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44046) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:48.909255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:48.950483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '5f0c21a2-3d75-46bb-979e-8f15db59a0cf'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:48.951377 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.052401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:49.056070 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.084547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Allocated IP 172.20.0.2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/5f0c21a2-3d75-46bb-979e-8f15db59a0cf/4a1e9bf8-5484-41be-97f4-d1d6be223fe7) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:49.225078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.286943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.328077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:49.330807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:49.334974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:49.337910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Pushing event updated for resources: {'Port': ['ID=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:49.392874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Attempting to bind port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:49.393256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Attempting to bind port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:49.393625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Attempting to bind port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:49.398413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:49.398793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:49.399225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.399623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:49.400090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Bound port: 4a1e9bf8-5484-41be-97f4-d1d6be223fe7, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:49.400469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.465307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] For port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:49.468445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] For port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:49.480620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:24:49.538484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.604167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab057201-7acf-454f-bdd9-28ef3d59bcba None None] Pushing event updated for resources: {'Port': ['ID=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:49.785896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.880922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e50e36e-acdc-49d9-80bc-0631cefc0504 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:49.954789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] For port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:49.983167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.035491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.036358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.085326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:50.111608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:50.118097 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:50.125790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:50.126382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.133457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:50.133835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.142651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=7f033d5c-9db6-453e-a5a3-58b4d77c17d9,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:50.149690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,revision_number=4']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:50.216711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.232421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d15d173c-a6cd-4397-a9b7-cab56f5b389b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.3277719 Dec 21 04:24:50.235198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44048) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:50.241020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:af:79:56', 'name': 'tempest-NetworksTestDHCPv6-1235037510'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:50.252822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:50.298120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.361028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8d7273ea-d70e-43d0-ab93-e4288749ec4b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:50.391806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 8d7273ea-d70e-43d0-ab93-e4288749ec4b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:50.392252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 8d7273ea-d70e-43d0-ab93-e4288749ec4b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:50.393785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:50.429409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:50.511764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f7a8c4a-7907-4bcf-870b-f98416f7ee0e None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:50.520030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.541705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 68f9798d-0e3f-4f1a-b68a-7047e97a24d2 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:50.586235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2bf1bdc9-fc45-42b8-9e68-9663ca100d1e None None] Provisioning complete for port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:50.586703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2bf1bdc9-fc45-42b8-9e68-9663ca100d1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.708284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 172.20.0.8 (b93c538b-c177-45d8-ae5b-37770a1f77ba/5f0c21a2-3d75-46bb-979e-8f15db59a0cf/68f9798d-0e3f-4f1a-b68a-7047e97a24d2) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:50.714161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:feaf:7956 (b93c538b-c177-45d8-ae5b-37770a1f77ba/7f033d5c-9db6-453e-a5a3-58b4d77c17d9/68f9798d-0e3f-4f1a-b68a-7047e97a24d2) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:50.869019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.944463 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:50.993624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:50.996653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:51.001042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:51.025299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=68f9798d-0e3f-4f1a-b68a-7047e97a24d2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:51.054247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:51.055066 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.146759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7b618cdc-b5a4-4ed7-b122-3d16b8ba09ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 0.9102809 Dec 21 04:24:51.149296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44050) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:51.198852 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac4dd7c3-52de-4bc2-9722-7573f482a708 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:51.204943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac4dd7c3-52de-4bc2-9722-7573f482a708 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:51.206620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ac4dd7c3-52de-4bc2-9722-7573f482a708 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.0564210 Dec 21 04:24:51.209558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44052) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:51.224304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-62d9a57c-e2c3-4e89-92c0-0b772f6aefa7 None None] Provisioning complete for port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:51.224673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-62d9a57c-e2c3-4e89-92c0-0b772f6aefa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.303378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 68f9798d-0e3f-4f1a-b68a-7047e97a24d2 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:51.303717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.395830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.408768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 68f9798d-0e3f-4f1a-b68a-7047e97a24d2 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:51.423907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b9f3c7d5-ec31-4be0-9a8f-19423b1750cf None None] Could not find standard attr ID for object d7796245-28c1-4a31-b88f-52fc4bc05544. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:51.648191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-669c72e6-7a89-4f65-8514-61764ac410f0 None None] Provisioning complete for port 68f9798d-0e3f-4f1a-b68a-7047e97a24d2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:51.652774 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-669c72e6-7a89-4f65-8514-61764ac410f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.675350 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.688940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-669c72e6-7a89-4f65-8514-61764ac410f0 None None] Port 68f9798d-0e3f-4f1a-b68a-7047e97a24d2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:24:51.712023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=68f9798d-0e3f-4f1a-b68a-7047e97a24d2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:51.803663 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.807006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-724c7390-faa0-4d02-b83d-76c2619f31b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/68f9798d-0e3f-4f1a-b68a-7047e97a24d2 HTTP/1.1" status: 204 len: 168 time: 0.5918782 Dec 21 04:24:51.809842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44054) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:51.865202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d180d10-b57e-44fd-9cf2-8c53a1af2b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:51.866897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d180d10-b57e-44fd-9cf2-8c53a1af2b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:51.868347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d180d10-b57e-44fd-9cf2-8c53a1af2b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:51.870087 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d180d10-b57e-44fd-9cf2-8c53a1af2b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.0591140 Dec 21 04:24:51.872887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44056) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:51.925561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 5f0c21a2-3d75-46bb-979e-8f15db59a0cf {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:51.928885 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:51.971197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.064086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.070065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:24:52.116477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:52.116897 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.178593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.207334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=5f0c21a2-3d75-46bb-979e-8f15db59a0cf,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:52.210905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.214091 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b0a7a929-ecf5-40b5-b81c-596b25337192 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/5f0c21a2-3d75-46bb-979e-8f15db59a0cf HTTP/1.1" status: 204 len: 168 time: 0.3401973 Dec 21 04:24:52.217524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44058) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:52.219247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c1712f8-6fad-44b6-9663-c50b21e9c815 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:52.270186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 7f033d5c-9db6-453e-a5a3-58b4d77c17d9 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:52.273533 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.314973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.402687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.516053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.543998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=7f033d5c-9db6-453e-a5a3-58b4d77c17d9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:52.548310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.551970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5d7f7289-d832-4ad9-b805-cc38d25b863c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/7f033d5c-9db6-453e-a5a3-58b4d77c17d9 HTTP/1.1" status: 204 len: 168 time: 0.3327243 Dec 21 04:24:52.554349 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44060) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:52.601716 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-713ddde1-629d-4c60-8d9e-9bb844d2cc46 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0435553 Dec 21 04:24:52.601970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44062) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:52.606892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:52.636003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-93a80ba2-3fc7-451d-84d5-a907bc7b4f9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.743870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:52.747560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.800528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6c1205b-9c5c-49e8-9520-758dc1881c0b None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:52.886408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5f8d2dcb-be01-4d15-bf38-d665b0c265a8 None None] Provisioning complete for port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:52.886687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f8d2dcb-be01-4d15-bf38-d665b0c265a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.978673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:52.991885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:53.020676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:53.024130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:53.028278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:53.028886 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.042360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=b75d57ef-b812-4a8b-ab2e-ecb1371f5066,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:53.048716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] Deleting port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:53.049094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.066884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.084008 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d1cf786d-cba8-44f4-aace-2fb13f061f29 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4810436 Dec 21 04:24:53.086741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44064) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:53.091545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:53.136831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] For port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:53.137145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.149445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] Calling delete_port for 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:53.280950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:53.285348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.310279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.334165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] Pushing event deleted for resources: {'Port': ['ID=4a1e9bf8-5484-41be-97f4-d1d6be223fe7,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:53.340740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edef6f5b-5b92-4400-beae-0d797dcee3d8 None None] No DVR routers for this DVR port 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:53.356624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-029fa374-b346-4b0a-a85b-441c8934b71c None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:53.376986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.457159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'b75d57ef-b812-4a8b-ab2e-ecb1371f5066'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:53.458097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.649736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:24:53.651388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.696708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:53.700159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:53.705109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:53.705707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.711228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=5339d581-1a34-4b45-92df-8a58f75ed8f6,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:53.752893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Allocated IP 172.20.0.2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/b75d57ef-b812-4a8b-ab2e-ecb1371f5066/4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:53.792146 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ef4e609-5f09-4f13-a3d5-8eef036fd15a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7043355 Dec 21 04:24:53.795373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44066) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:53.800889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:9e:4a:9a', 'name': 'tempest-NetworksTestDHCPv6-379953301'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:53.893106 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.944595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:53.967074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:53.984475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:53.987248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:53.990644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:53.997694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Pushing event updated for resources: {'Port': ['ID=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:54.049716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Attempting to bind port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:54.050097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Attempting to bind port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:54.050469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Attempting to bind port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:54.056042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:54.056355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:54.056873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.057277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:54.057755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Bound port: 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:54.058142 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.059864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.074152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:24:54.080598 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 7604a201-5d08-433c-995e-730a101078e5 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:54.097709 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:24:54.105077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4a1e9bf8-5484-41be-97f4-d1d6be223fe7 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:24:54.152818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] For port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:54.156738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] For port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:54.224487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.240989 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 172.20.0.13 (b93c538b-c177-45d8-ae5b-37770a1f77ba/b75d57ef-b812-4a8b-ab2e-ecb1371f5066/7604a201-5d08-433c-995e-730a101078e5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:54.246762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe9e:4a9a (b93c538b-c177-45d8-ae5b-37770a1f77ba/5339d581-1a34-4b45-92df-8a58f75ed8f6/7604a201-5d08-433c-995e-730a101078e5) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:54.287633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2256c3-1bb7-4988-a8af-af5a3913aa75 None None] Pushing event updated for resources: {'Port': ['ID=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:54.407966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.516426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.563108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:54.566193 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:54.570045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:54.576748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=7604a201-5d08-433c-995e-730a101078e5,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:54.622539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:54.623175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.723695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-644a1f0b-8239-48f6-82e1-f6e5cfd992e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 0.9273026 Dec 21 04:24:54.726103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44068) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:54.773980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffe5f9bd-1ee7-499a-bf41-96ee66f56d39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:54.779968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffe5f9bd-1ee7-499a-bf41-96ee66f56d39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:54.781516 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ffe5f9bd-1ee7-499a-bf41-96ee66f56d39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1763 time: 0.0544224 Dec 21 04:24:54.784291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44070) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:54.871476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 7604a201-5d08-433c-995e-730a101078e5 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:54.871904 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.962684 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:54.976088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 7604a201-5d08-433c-995e-730a101078e5 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:55.092593 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.126560 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.202055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89dc8658-f614-4f0c-a85b-5fd2eef0f2c1 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:55.224114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.267269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=7604a201-5d08-433c-995e-730a101078e5,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:55.330523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-52dcaaa3-a237-4a7b-9396-8615b0719ed3 None None] Provisioning complete for port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:55.330861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52dcaaa3-a237-4a7b-9396-8615b0719ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.353317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.356813 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3b586484-d7fd-490e-83c4-e614048a3eb8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/7604a201-5d08-433c-995e-730a101078e5 HTTP/1.1" status: 204 len: 168 time: 0.5716136 Dec 21 04:24:55.359252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44072) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:55.413450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6317607-90b3-44fe-927c-236795a5fb39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:55.415130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6317607-90b3-44fe-927c-236795a5fb39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:55.416679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6317607-90b3-44fe-927c-236795a5fb39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:55.418271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a6317607-90b3-44fe-927c-236795a5fb39 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.0580640 Dec 21 04:24:55.420848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44074) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:55.440438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52dcaaa3-a237-4a7b-9396-8615b0719ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.455088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23d33c11-5c99-47d0-b60f-b6d20ad9e755 None None] Update dhcp port {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': 'b75d57ef-b812-4a8b-ab2e-ecb1371f5066', 'ip_address': '172.20.0.2'}, {'subnet_id': '5339d581-1a34-4b45-92df-8a58f75ed8f6'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:24:55.476548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 5339d581-1a34-4b45-92df-8a58f75ed8f6 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:55.479696 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.493788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23d33c11-5c99-47d0-b60f-b6d20ad9e755 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.503848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-52dcaaa3-a237-4a7b-9396-8615b0719ed3 None None] For port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:55.520284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.563389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.588412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52dcaaa3-a237-4a7b-9396-8615b0719ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.653548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52dcaaa3-a237-4a7b-9396-8615b0719ed3 None None] Pushing event updated for resources: {'Port': ['ID=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:55.698548 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server [None req-23d33c11-5c99-47d0-b60f-b6d20ad9e755 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 5339d581-1a34-4b45-92df-8a58f75ed8f6: This subnet is being modified by another concurrent operation. Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in update_dhcp_port Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 118, in _port_action Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1518, in update_port Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise exception Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 5339d581-1a34-4b45-92df-8a58f75ed8f6: This subnet is being modified by another concurrent operation. Dec 21 04:24:55.704291 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Dec 21 04:24:55.736392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=5339d581-1a34-4b45-92df-8a58f75ed8f6,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:55.738518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.741742 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b03631e7-9d87-4c0d-871a-a90f6d62a073 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/5339d581-1a34-4b45-92df-8a58f75ed8f6 HTTP/1.1" status: 204 len: 168 time: 0.3199785 Dec 21 04:24:55.744412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44076) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:55.783850 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.800092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet b75d57ef-b812-4a8b-ab2e-ecb1371f5066 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:24:55.804020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.813316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2e5bf768-878d-4817-a9f8-98a80bef0b35 None None] Provisioning complete for port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:55.813868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e5bf768-878d-4817-a9f8-98a80bef0b35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:55.848380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.058211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb1f5f8f-1771-4de2-996c-bfe6af4c63db None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:24:56.059477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.059906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb1f5f8f-1771-4de2-996c-bfe6af4c63db None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:24:56.059906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-938ca023-caf6-4fdc-9141-323efeb81bb1 None None] Could not find standard attr ID for object 7604a201-5d08-433c-995e-730a101078e5. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:24:56.139698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.170737 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.174709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/b75d57ef-b812-4a8b-ab2e-ecb1371f5066 HTTP/1.1" status: 204 len: 168 time: 0.4293652 Dec 21 04:24:56.175531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90916091-dc81-4268-a83a-0cb62f612870 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=b75d57ef-b812-4a8b-ab2e-ecb1371f5066,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:56.177335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44078) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.225450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-16ff9fbe-d624-46b6-9d89-31a18cf4861e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0422938 Dec 21 04:24:56.227841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44080) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.229315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0ce8455-8952-48cc-a436-2e66e05e9ef9 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:24:56.282300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-411284a4-b33b-4706-b97e-b56fdbbe3624 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:56.283866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-411284a4-b33b-4706-b97e-b56fdbbe3624 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0547414 Dec 21 04:24:56.286433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44082) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.287347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fa88fd45-4768-4c48-be45-c475ebc7f767 None None] Provisioning complete for port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:56.287716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa88fd45-4768-4c48-be45-c475ebc7f767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.328410 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0ce8455-8952-48cc-a436-2e66e05e9ef9 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:24:56.337409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b7a3e52-bdab-4f29-940d-f174e64b62a1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:56.339980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6b7a3e52-bdab-4f29-940d-f174e64b62a1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0520487 Dec 21 04:24:56.342589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44084) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.385814 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4f70bcc9-1457-4804-880f-265ba2560318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0421057 Dec 21 04:24:56.392291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44086) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.396190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-713cb7aa-c76d-46d9-b02c-3c0fad745193 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:56.557165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-150d36e7-06ba-462d-a578-422fcc8f03cf None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:56.566380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-713cb7aa-c76d-46d9-b02c-3c0fad745193 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:56.570132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-713cb7aa-c76d-46d9-b02c-3c0fad745193 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.571744 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-713cb7aa-c76d-46d9-b02c-3c0fad745193 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:56.572177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-713cb7aa-c76d-46d9-b02c-3c0fad745193 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:56.663019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5f60cf8a-2364-447d-a0d5-4a8847611bfa None None] Provisioning complete for port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:24:56.663495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f60cf8a-2364-447d-a0d5-4a8847611bfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.664038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44088) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.669745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6e091c0c-a0d5-4e41-b558-e2914579cdd9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:56.674552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-713cb7aa-c76d-46d9-b02c-3c0fad745193 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.2827430 Dec 21 04:24:56.687334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:24:56.780164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] Deleting port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:56.780550 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.812320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e091c0c-a0d5-4e41-b558-e2914579cdd9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:56.815937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6e091c0c-a0d5-4e41-b558-e2914579cdd9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.817431 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e091c0c-a0d5-4e41-b558-e2914579cdd9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:56.817885 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6e091c0c-a0d5-4e41-b558-e2914579cdd9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:56.855189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] For port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:24:56.855615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:56.867812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] Calling delete_port for 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:56.893274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44090) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:56.893425 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6e091c0c-a0d5-4e41-b558-e2914579cdd9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2282095 Dec 21 04:24:56.898391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5a865675-d677-45c2-888e-f0b3b7d41db1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:57.006922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:57.031581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] Pushing event deleted for resources: {'Port': ['ID=4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:57.035258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b207bb-aefd-45b6-87c2-7c6537195162 None None] No DVR routers for this DVR port 4ae1d1c1-bcf9-4c15-93fb-e2514cc0616a on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:24:57.047125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a865675-d677-45c2-888e-f0b3b7d41db1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:57.050734 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5a865675-d677-45c2-888e-f0b3b7d41db1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:57.052197 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-5a865675-d677-45c2-888e-f0b3b7d41db1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:57.052626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5a865675-d677-45c2-888e-f0b3b7d41db1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:57.146530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5a865675-d677-45c2-888e-f0b3b7d41db1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.2521386 Dec 21 04:24:57.149441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44092) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.154221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c7689753-e09c-416a-8dca-6e4b93f16f5d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:57.303878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7689753-e09c-416a-8dca-6e4b93f16f5d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:57.307285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c7689753-e09c-416a-8dca-6e4b93f16f5d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:57.308675 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7689753-e09c-416a-8dca-6e4b93f16f5d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:57.309136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c7689753-e09c-416a-8dca-6e4b93f16f5d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:57.369272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c7689753-e09c-416a-8dca-6e4b93f16f5d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.2188640 Dec 21 04:24:57.372146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44094) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.376988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3fc6929a-fb09-4931-8bc8-1eb12e730102 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:57.526484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3fc6929a-fb09-4931-8bc8-1eb12e730102 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:57.530086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3fc6929a-fb09-4931-8bc8-1eb12e730102 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:57.532033 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-3fc6929a-fb09-4931-8bc8-1eb12e730102 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:57.532459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3fc6929a-fb09-4931-8bc8-1eb12e730102 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:57.581179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3fc6929a-fb09-4931-8bc8-1eb12e730102 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.2080400 Dec 21 04:24:57.584293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44096) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.589235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f4e341da-2dbb-4978-aac7-358d2f7493e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:57.737529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4e341da-2dbb-4978-aac7-358d2f7493e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:57.741007 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4e341da-2dbb-4978-aac7-358d2f7493e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:57.742359 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-f4e341da-2dbb-4978-aac7-358d2f7493e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:24:57.742813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f4e341da-2dbb-4978-aac7-358d2f7493e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:24:57.854778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f4e341da-2dbb-4978-aac7-358d2f7493e3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2693491 Dec 21 04:24:57.857329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44098) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.888686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8a350d9-ea9b-4343-a555-2051b16a7ded tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0302813 Dec 21 04:24:57.891520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44100) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.941421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9ad2e3d-d49b-42d7-b364-ca789343288e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:57.942886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e9ad2e3d-d49b-42d7-b364-ca789343288e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0504861 Dec 21 04:24:57.945372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44102) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.981956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-58e6c2bb-9e76-475b-9100-668be337fbe7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0355396 Dec 21 04:24:57.985904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44104) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:57.990519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:58.149531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:58.153038 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.453244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:24:58.454806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.498839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:58.502611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:58.506735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:58.507357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.512492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c42eb05c-f920-4ff8-bff7-473e9248738a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:24:58.521678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=e49522c9-4381-45b8-8c96-0e06d3d64484,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:58.592251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0ebd5ff0-260d-4f63-9a85-1fc9477db32f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.6053467 Dec 21 04:24:58.594795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44106) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:58.599675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:7b:22:fa', 'name': 'tempest-NetworksTestDHCPv6-1139491915'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:24:58.617922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'e49522c9-4381-45b8-8c96-0e06d3d64484'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:24:58.618793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.744757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Allocated IP 2001:db8::f816:3eff:fe29:7a15 (b93c538b-c177-45d8-ae5b-37770a1f77ba/e49522c9-4381-45b8-8c96-0e06d3d64484/302a4f0d-87fb-4ffc-9cf0-d61275624bd0) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:58.755428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:24:58.849298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.869285 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port c7b7ac91-26c3-4a21-9cb1-be5c5f697da7 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:24:58.883502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.949823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:58.993140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:58.996161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe7b:22fa (b93c538b-c177-45d8-ae5b-37770a1f77ba/e49522c9-4381-45b8-8c96-0e06d3d64484/c7b7ac91-26c3-4a21-9cb1-be5c5f697da7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:24:58.997599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:59.001986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:59.004981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Pushing event updated for resources: {'Port': ['ID=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:59.055580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Attempting to bind port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:24:59.055955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Attempting to bind port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:24:59.056312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Attempting to bind port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:24:59.061537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:24:59.061918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:24:59.062346 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.062734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:24:59.063398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Bound port: 302a4f0d-87fb-4ffc-9cf0-d61275624bd0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:24:59.063780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.122447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] For port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:24:59.125392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] For port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:24:59.145425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.218262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.246967 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.276823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2bca119-5afb-4697-b1e2-56be7e5b5d6b None None] Pushing event updated for resources: {'Port': ['ID=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:59.298174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:24:59.302341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:24:59.304263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=c7b7ac91-26c3-4a21-9cb1-be5c5f697da7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:59.306409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: items = [ Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:24:59.310348 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:24:59.312986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:59.313534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.397939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-91c0a884-fa6e-4842-b0d7-dfa8747b1e43 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 0.8020415 Dec 21 04:24:59.400803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44108) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:59.464577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e01fe5c-d376-409c-bb6b-3be794c76724 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:59.470606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e01fe5c-d376-409c-bb6b-3be794c76724 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:59.472318 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e01fe5c-d376-409c-bb6b-3be794c76724 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.0704873 Dec 21 04:24:59.474923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44110) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:59.567459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port c7b7ac91-26c3-4a21-9cb1-be5c5f697da7 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:24:59.567799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.662471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.674067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for c7b7ac91-26c3-4a21-9cb1-be5c5f697da7 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:24:59.858344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.892821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=c7b7ac91-26c3-4a21-9cb1-be5c5f697da7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:24:59.905405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.905764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.906145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.906490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.906833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.907202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.907536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.907870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.908203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.908531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.908939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.909176 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.909502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:24:59.928887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:24:59.932187 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8440d364-71d6-434d-a0f0-ce5d8a437318 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/c7b7ac91-26c3-4a21-9cb1-be5c5f697da7 HTTP/1.1" status: 204 len: 168 time: 0.4563029 Dec 21 04:24:59.934672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44112) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:24:59.988442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd06d88d-fee0-4724-8943-4044b27bdae3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:59.989970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd06d88d-fee0-4724-8943-4044b27bdae3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:24:59.991547 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cd06d88d-fee0-4724-8943-4044b27bdae3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.0556226 Dec 21 04:24:59.994123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:00.051614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet e49522c9-4381-45b8-8c96-0e06d3d64484 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:00.055129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.102773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.114958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:00.166720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:00.167210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.193256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.273554 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.292153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-90c46232-2e5c-4ddd-9d40-bbea04a710a0 None None] Provisioning complete for port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:00.292524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90c46232-2e5c-4ddd-9d40-bbea04a710a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.338778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.369265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=e49522c9-4381-45b8-8c96-0e06d3d64484,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:00.371344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.374591 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-357ae807-3950-4c18-a0d7-e5ecbefaf03c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/e49522c9-4381-45b8-8c96-0e06d3d64484 HTTP/1.1" status: 204 len: 168 time: 0.3795185 Dec 21 04:25:00.377396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44116) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:00.413083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90c46232-2e5c-4ddd-9d40-bbea04a710a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.414958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:25:00.415326 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:25:00.421203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c4b90521-2eec-44bf-8bd0-b27de3538bd0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0420215 Dec 21 04:25:00.425085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44118) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:00.430449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:00.448850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-90c46232-2e5c-4ddd-9d40-bbea04a710a0 None None] For port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:00.482335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a4bfe83-70ab-4d45-a2d9-50469f9d42f8 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:00.536442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-90c46232-2e5c-4ddd-9d40-bbea04a710a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.566646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:00.570544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.615090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c46232-2e5c-4ddd-9d40-bbea04a710a0 None None] Pushing event updated for resources: {'Port': ['ID=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:00.653218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c6a6eb85-a5df-44d7-954c-95c9abb88e76 None None] Could not find standard attr ID for object c7b7ac91-26c3-4a21-9cb1-be5c5f697da7. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:00.695724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:00.909017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] Deleting port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:00.909307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:00.981502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:01.023973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] For port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:01.024373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:01.040391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] Calling delete_port for 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:01.207254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:01.247124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:01.272133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] Pushing event deleted for resources: {'Port': ['ID=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:01.279409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-052265f2-da52-4b3d-b486-028e4b924bb9 None None] No DVR routers for this DVR port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:01.370357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] For port 302a4f0d-87fb-4ffc-9cf0-d61275624bd0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:01.853870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:01.915569 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:01.916364 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:01.970353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=302a4f0d-87fb-4ffc-9cf0-d61275624bd0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:01.990557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:01.993668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:01.999452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:02.000556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.003638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e3c5562-13b1-4102-857f-26ef6cb1b818 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:02.014046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=d07a55be-b435-4fb8-b8f7-802b53ab3a3c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:02.076145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:02.083546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9edf4b21-1586-4b68-a03f-42a494563cae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.6574178 Dec 21 04:25:02.086023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44120) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:02.091030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:3c:c5:e9', 'name': 'tempest-NetworksTestDHCPv6-1346729185'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:02.102418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:25:02.102773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 302a4f0d-87fb-4ffc-9cf0-d61275624bd0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:25:02.126332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'd07a55be-b435-4fb8-b8f7-802b53ab3a3c'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:02.127290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.256753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Allocated IP 2001:db8::f816:3eff:fed9:4501 (b93c538b-c177-45d8-ae5b-37770a1f77ba/d07a55be-b435-4fb8-b8f7-802b53ab3a3c/b9fe5308-db3b-4164-9bec-e5f4678b5782) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:02.280776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:02.285429 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.304718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 7ca79cfb-90c5-4fe4-9795-c1f9cdd77015 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:02.398110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.469793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.508949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:02.511700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:02.515085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:02.517518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe3c:c5e9 (b93c538b-c177-45d8-ae5b-37770a1f77ba/d07a55be-b435-4fb8-b8f7-802b53ab3a3c/7ca79cfb-90c5-4fe4-9795-c1f9cdd77015) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:02.521236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Pushing event updated for resources: {'Port': ['ID=b9fe5308-db3b-4164-9bec-e5f4678b5782,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:02.579590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Attempting to bind port b9fe5308-db3b-4164-9bec-e5f4678b5782 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:02.579967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Attempting to bind port b9fe5308-db3b-4164-9bec-e5f4678b5782 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:02.580331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Attempting to bind port b9fe5308-db3b-4164-9bec-e5f4678b5782 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:02.585285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:02.585664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:02.586064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.586475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:02.586926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Bound port: b9fe5308-db3b-4164-9bec-e5f4678b5782, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:02.587334 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.648741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] For port b9fe5308-db3b-4164-9bec-e5f4678b5782, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:02.651779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] For port b9fe5308-db3b-4164-9bec-e5f4678b5782, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b9fe5308-db3b-4164-9bec-e5f4678b5782,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:02.670431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.733353 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.762164 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.797193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c057aa-cb4f-4457-aae1-ad0f96a118e0 None None] Pushing event updated for resources: {'Port': ['ID=b9fe5308-db3b-4164-9bec-e5f4678b5782,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:02.819989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:02.823591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:02.826284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:02.834256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:02.834969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:02.865979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=7ca79cfb-90c5-4fe4-9795-c1f9cdd77015,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:02.895957 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:25:02.912727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d36e95c2-edd7-43ca-a383-d8a61717f60b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 0.8256686 Dec 21 04:25:02.915418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44122) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:02.991681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17d52e90-7b32-4c95-ba83-171221ca55cc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:02.997674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17d52e90-7b32-4c95-ba83-171221ca55cc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:02.999318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-17d52e90-7b32-4c95-ba83-171221ca55cc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.0827484 Dec 21 04:25:03.002278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44124) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:03.107490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 7ca79cfb-90c5-4fe4-9795-c1f9cdd77015 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:03.107844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.196367 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.209238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 7ca79cfb-90c5-4fe4-9795-c1f9cdd77015 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:03.378343 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.415254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=7ca79cfb-90c5-4fe4-9795-c1f9cdd77015,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:03.448990 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.453585 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2b216ce3-c864-4d77-b197-283ec45a2ff3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/7ca79cfb-90c5-4fe4-9795-c1f9cdd77015 HTTP/1.1" status: 204 len: 168 time: 0.4496753 Dec 21 04:25:03.456222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44126) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:03.509204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91420033-0744-4a0d-9c5b-b0b85de10ec5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:03.510904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91420033-0744-4a0d-9c5b-b0b85de10ec5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:03.515160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-91420033-0744-4a0d-9c5b-b0b85de10ec5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0553560 Dec 21 04:25:03.515357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44128) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:03.569023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet d07a55be-b435-4fb8-b8f7-802b53ab3a3c {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:03.572443 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.619032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.709973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.802684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-67437c6a-c4fd-464b-a7b0-62f48028476c None None] Provisioning complete for port b9fe5308-db3b-4164-9bec-e5f4678b5782 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:03.803208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67437c6a-c4fd-464b-a7b0-62f48028476c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.847847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.896119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67437c6a-c4fd-464b-a7b0-62f48028476c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.899317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=d07a55be-b435-4fb8-b8f7-802b53ab3a3c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:03.909850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:03.913701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d12352ea-d0d7-4387-ab93-4d10ae46ae38 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/d07a55be-b435-4fb8-b8f7-802b53ab3a3c HTTP/1.1" status: 204 len: 168 time: 0.3967135 Dec 21 04:25:03.916076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44130) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:03.934318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-67437c6a-c4fd-464b-a7b0-62f48028476c None None] For port b9fe5308-db3b-4164-9bec-e5f4678b5782, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b9fe5308-db3b-4164-9bec-e5f4678b5782,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:03.962361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-777995af-6238-4c14-a4b0-3217cc73b465 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0449278 Dec 21 04:25:03.964727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44132) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:03.985721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a391df8-91a1-4065-aaf1-9373ea4f93d7 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:04.008382 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-67437c6a-c4fd-464b-a7b0-62f48028476c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.021906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe2b3662-b196-4735-b4e8-8c01b9fea7c8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:04.025892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fe2b3662-b196-4735-b4e8-8c01b9fea7c8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0579681 Dec 21 04:25:04.026142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44134) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:04.092202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4842c543-94bd-49fa-a164-23ce40535d28 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:04.094349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4842c543-94bd-49fa-a164-23ce40535d28 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0672536 Dec 21 04:25:04.099189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44136) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:04.120936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67437c6a-c4fd-464b-a7b0-62f48028476c None None] Pushing event updated for resources: {'Port': ['ID=b9fe5308-db3b-4164-9bec-e5f4678b5782,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:04.131320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a7854ae8-4c3b-41ae-9f87-d759f95f6a29 None None] Could not find standard attr ID for object 7ca79cfb-90c5-4fe4-9795-c1f9cdd77015. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:04.140939 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f79fc5c8-47ec-4723-96e0-78d6ec7b8a7b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0363848 Dec 21 04:25:04.141159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:04.147198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:04.149446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b9fe5308-db3b-4164-9bec-e5f4678b5782 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:04.203558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b9fe5308-db3b-4164-9bec-e5f4678b5782 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:04.203934 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.207884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:04.321022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] Deleting port b9fe5308-db3b-4164-9bec-e5f4678b5782 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:04.321320 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.332845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:04.336492 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.386010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] For port b9fe5308-db3b-4164-9bec-e5f4678b5782, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b9fe5308-db3b-4164-9bec-e5f4678b5782,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:04.386408 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.399833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] Calling delete_port for b9fe5308-db3b-4164-9bec-e5f4678b5782 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:04.532981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.555097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] Pushing event deleted for resources: {'Port': ['ID=b9fe5308-db3b-4164-9bec-e5f4678b5782,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:04.560554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46708339-f01c-483c-a8ab-605e25575d5c None None] No DVR routers for this DVR port b9fe5308-db3b-4164-9bec-e5f4678b5782 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:04.654606 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:04.655820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.699749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:04.703488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:04.706329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:04.706919 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.712419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c58fd448-8f82-460e-b688-c827d25a9bac None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:04.717154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=afdb4367-e13b-4877-802f-4134576628ec,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:04.780650 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-675d30c1-a29d-4659-b06f-fceefd4c4901 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 0.6382792 Dec 21 04:25:04.783215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44140) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:04.788321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:64:dc:f8', 'name': 'tempest-NetworksTestDHCPv6-429991593'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:04.810261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'afdb4367-e13b-4877-802f-4134576628ec'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:04.811644 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:04.944671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Allocated IP 2001:db8::f816:3eff:fee5:f0b (b93c538b-c177-45d8-ae5b-37770a1f77ba/afdb4367-e13b-4877-802f-4134576628ec/7b370e7f-9967-43c9-9e5a-eaf71477051b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:04.995235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:05.075382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.086134 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.094407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 888b099a-cf16-4d8e-8db7-cbbb94bea122 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:05.161843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.202686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:05.205407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:05.208882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:05.210381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe64:dcf8 (b93c538b-c177-45d8-ae5b-37770a1f77ba/afdb4367-e13b-4877-802f-4134576628ec/888b099a-cf16-4d8e-8db7-cbbb94bea122) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:05.215779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Pushing event updated for resources: {'Port': ['ID=7b370e7f-9967-43c9-9e5a-eaf71477051b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:05.267029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Attempting to bind port 7b370e7f-9967-43c9-9e5a-eaf71477051b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:05.267404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Attempting to bind port 7b370e7f-9967-43c9-9e5a-eaf71477051b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:05.267768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Attempting to bind port 7b370e7f-9967-43c9-9e5a-eaf71477051b on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:05.273090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:05.273545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:05.273878 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.274278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:05.274740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Bound port: 7b370e7f-9967-43c9-9e5a-eaf71477051b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:05.275159 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.340366 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] For port 7b370e7f-9967-43c9-9e5a-eaf71477051b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:05.343550 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] For port 7b370e7f-9967-43c9-9e5a-eaf71477051b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7b370e7f-9967-43c9-9e5a-eaf71477051b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:05.360345 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.390579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.447310 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4597f263-7d21-45d5-8a42-9806aeccf411 None None] Pushing event updated for resources: {'Port': ['ID=7b370e7f-9967-43c9-9e5a-eaf71477051b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:05.459159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.505799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:05.508970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:05.511556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:05.517658 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:05.518284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.533306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=888b099a-cf16-4d8e-8db7-cbbb94bea122,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:05.582198 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a5ca2244-6c61-49cd-8294-1ad6b7657655 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 0.7977314 Dec 21 04:25:05.588246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:05.660831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccf91fe9-532c-4180-bab9-f45f369a7753 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:05.666992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccf91fe9-532c-4180-bab9-f45f369a7753 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:05.668630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ccf91fe9-532c-4180-bab9-f45f369a7753 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1701 time: 0.0821204 Dec 21 04:25:05.671410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:05.763256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 888b099a-cf16-4d8e-8db7-cbbb94bea122 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:05.763600 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.849943 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:05.861643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 888b099a-cf16-4d8e-8db7-cbbb94bea122 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:06.046778 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.080761 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=888b099a-cf16-4d8e-8db7-cbbb94bea122,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:06.103481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7b370e7f-9967-43c9-9e5a-eaf71477051b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:06.106434 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.109774 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d6ee395d-c22b-49f3-bac1-8a21b7d44a9a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/888b099a-cf16-4d8e-8db7-cbbb94bea122 HTTP/1.1" status: 204 len: 168 time: 0.4367976 Dec 21 04:25:06.112343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44146) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:06.156978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7b370e7f-9967-43c9-9e5a-eaf71477051b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:06.157348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.171187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da6528eb-fb23-47d6-86c3-198e08ca2bd3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:06.172902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da6528eb-fb23-47d6-86c3-198e08ca2bd3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:06.174444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-da6528eb-fb23-47d6-86c3-198e08ca2bd3 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.0610855 Dec 21 04:25:06.177201 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44148) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:06.232295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet afdb4367-e13b-4877-802f-4134576628ec {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:06.235911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.245498 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.276818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.279830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 7b370e7f-9967-43c9-9e5a-eaf71477051b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7b370e7f-9967-43c9-9e5a-eaf71477051b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:06.356028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.376386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.416971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=7b370e7f-9967-43c9-9e5a-eaf71477051b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:06.420883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b9fe5308-db3b-4164-9bec-e5f4678b5782 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:06.445573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b9fe5308-db3b-4164-9bec-e5f4678b5782 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:25:06.445690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b9fe5308-db3b-4164-9bec-e5f4678b5782 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:25:06.477915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c0fbcc2c-c56e-4f24-bfaf-cd9e17947801 None None] Provisioning complete for port 7b370e7f-9967-43c9-9e5a-eaf71477051b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:06.478363 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c0fbcc2c-c56e-4f24-bfaf-cd9e17947801 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.538698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.568727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=afdb4367-e13b-4877-802f-4134576628ec,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:06.572832 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.576115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-507e2342-d1fd-4217-889d-6ae56ede500a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/afdb4367-e13b-4877-802f-4134576628ec HTTP/1.1" status: 204 len: 168 time: 0.3979590 Dec 21 04:25:06.578647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44150) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:06.622992 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a518acc-67f2-41ad-907f-17e0dcd20784 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0414066 Dec 21 04:25:06.624000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:06.629395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:06.659592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96383a5c-c3b5-4bf3-89db-3e37f6a2527b None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:06.686917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6ac01e96-74db-4fa3-b1b1-64519f405c63 None None] Could not find standard attr ID for object 888b099a-cf16-4d8e-8db7-cbbb94bea122. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:06.800004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:06.800004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.830548 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:06.877167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] Deleting port 7b370e7f-9967-43c9-9e5a-eaf71477051b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:06.877584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.944813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] For port 7b370e7f-9967-43c9-9e5a-eaf71477051b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7b370e7f-9967-43c9-9e5a-eaf71477051b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:06.945208 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:06.958354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] Calling delete_port for 7b370e7f-9967-43c9-9e5a-eaf71477051b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:07.069687 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.094852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] Pushing event deleted for resources: {'Port': ['ID=7b370e7f-9967-43c9-9e5a-eaf71477051b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:07.098347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c6a29a2-130e-4472-9af2-424c472a9606 None None] No DVR routers for this DVR port 7b370e7f-9967-43c9-9e5a-eaf71477051b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:07.113411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.objects.ports [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=110310) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:07.210034 n-d-822053-11 neutron-server[110310]: WARNING neutron.services.revisions.revision_plugin [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Could not find related port for resource to bump revision. Dec 21 04:25:07.246829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_pluggable_backend [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Port 7b370e7f-9967-43c9-9e5a-eaf71477051b was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=110310) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Dec 21 04:25:07.247166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_pluggable_backend [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Reverting IP allocation for 2001:db8::f816:3eff:fee5:f0b {{(pid=110310) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Dec 21 04:25:07.250967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.ipam_pluggable_backend [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fee5:f0b {{(pid=110310) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Dec 21 04:25:07.252084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.296444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:07.300090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:07.304142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:07.304732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.308957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-305ae763-27ba-492f-9d5d-691faa8558d5 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:07.318957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=393f407d-e958-4eeb-a6eb-1327abfff520,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:07.369509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-756049eb-49c7-4ac9-afd1-b9c0e39d8ef1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.7443721 Dec 21 04:25:07.372296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:07.377726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:c7:a7:cc', 'name': 'tempest-NetworksTestDHCPv6-1020095581'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:07.412761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '393f407d-e958-4eeb-a6eb-1327abfff520'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:07.413618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.526768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:07.544902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Allocated IP 2001:db8::f816:3eff:fefe:ccd1 (b93c538b-c177-45d8-ae5b-37770a1f77ba/393f407d-e958-4eeb-a6eb-1327abfff520/e1b8b596-a26b-4e5f-b554-5b4abd35f067) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:07.614985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.635148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 73efe961-04bc-433a-b2f6-d8f0e60feacc yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:07.687748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.755945 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.797696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:07.800569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:07.803962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:07.807708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fec7:a7cc (b93c538b-c177-45d8-ae5b-37770a1f77ba/393f407d-e958-4eeb-a6eb-1327abfff520/73efe961-04bc-433a-b2f6-d8f0e60feacc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:07.811058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Pushing event updated for resources: {'Port': ['ID=e1b8b596-a26b-4e5f-b554-5b4abd35f067,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:07.860795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Attempting to bind port e1b8b596-a26b-4e5f-b554-5b4abd35f067 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:07.861328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Attempting to bind port e1b8b596-a26b-4e5f-b554-5b4abd35f067 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:07.861698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Attempting to bind port e1b8b596-a26b-4e5f-b554-5b4abd35f067 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:07.866634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:07.866982 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:07.867392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.867788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:07.868262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Bound port: e1b8b596-a26b-4e5f-b554-5b4abd35f067, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:07.868659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:07.931636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] For port e1b8b596-a26b-4e5f-b554-5b4abd35f067, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:07.934686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] For port e1b8b596-a26b-4e5f-b554-5b4abd35f067, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1b8b596-a26b-4e5f-b554-5b4abd35f067,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:07.957351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.018405 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.047992 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.098117 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:08.101263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:08.106030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:08.112407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:08.113051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.116979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=73efe961-04bc-433a-b2f6-d8f0e60feacc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:08.192419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c5ec91c4-335d-4294-9adc-446184d2242a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 0.8190446 Dec 21 04:25:08.195357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:08.217656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7b370e7f-9967-43c9-9e5a-eaf71477051b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:08.246490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99a317e6-9374-4216-8423-cc0cf36f3f0b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:08.253382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99a317e6-9374-4216-8423-cc0cf36f3f0b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:08.254333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7b370e7f-9967-43c9-9e5a-eaf71477051b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:25:08.257461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7b370e7f-9967-43c9-9e5a-eaf71477051b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:25:08.257558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-99a317e6-9374-4216-8423-cc0cf36f3f0b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.0584888 Dec 21 04:25:08.257558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44158) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:08.275046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c801309-6883-41e0-88b8-fb40aec893a4 None None] Pushing event updated for resources: {'Port': ['ID=e1b8b596-a26b-4e5f-b554-5b4abd35f067,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:08.347807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 73efe961-04bc-433a-b2f6-d8f0e60feacc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:08.348154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.450129 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.462318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 73efe961-04bc-433a-b2f6-d8f0e60feacc owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:08.675855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.706586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=73efe961-04bc-433a-b2f6-d8f0e60feacc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:08.733332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.737282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e55526a5-b60b-4614-9e03-b94dade5b4ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/73efe961-04bc-433a-b2f6-d8f0e60feacc HTTP/1.1" status: 204 len: 168 time: 0.4788275 Dec 21 04:25:08.739683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44160) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:08.789017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb8026a0-effb-471c-9fd5-90c853afb1d5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:08.790652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb8026a0-effb-471c-9fd5-90c853afb1d5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:08.792175 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fb8026a0-effb-471c-9fd5-90c853afb1d5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.0515854 Dec 21 04:25:08.794778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44162) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:08.850861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 393f407d-e958-4eeb-a6eb-1327abfff520 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:08.854540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.896166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:08.993432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.133412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.161778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=393f407d-e958-4eeb-a6eb-1327abfff520,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:09.163785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.166964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f23eebc7-e38f-4fcc-8498-b1f4dd473048 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/393f407d-e958-4eeb-a6eb-1327abfff520 HTTP/1.1" status: 204 len: 168 time: 0.3712292 Dec 21 04:25:09.169347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44166) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:09.180387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a714cbc-d112-4f96-8f4c-c780dcc2fc08 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:09.212192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0309d398-836b-4c42-985a-03e9646abcfc tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0416760 Dec 21 04:25:09.214414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44168) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:09.261374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0b72596-74b1-48ce-926c-daa0e82d94ca tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:09.262862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b0b72596-74b1-48ce-926c-daa0e82d94ca tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0475299 Dec 21 04:25:09.265494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44170) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:09.272518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ffc858d3-0e22-43f9-988f-3466a98b8e2a None None] Provisioning complete for port e1b8b596-a26b-4e5f-b554-5b4abd35f067 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:09.272901 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ffc858d3-0e22-43f9-988f-3466a98b8e2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.315554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75da9f77-b89f-4ed2-a51a-3e73e13f25b6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:09.316809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-75da9f77-b89f-4ed2-a51a-3e73e13f25b6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0504172 Dec 21 04:25:09.319606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44172) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:09.364508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-02304a84-6c54-445e-9e64-5b449dd21960 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0433903 Dec 21 04:25:09.369081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ffc858d3-0e22-43f9-988f-3466a98b8e2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.369202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44174) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:09.378637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:09.382560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:09.429907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ffc858d3-0e22-43f9-988f-3466a98b8e2a None None] For port e1b8b596-a26b-4e5f-b554-5b4abd35f067, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1b8b596-a26b-4e5f-b554-5b4abd35f067,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:09.450271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] Deleting port e1b8b596-a26b-4e5f-b554-5b4abd35f067 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:09.450656 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.497629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ffc858d3-0e22-43f9-988f-3466a98b8e2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.526900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:09.530590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.541286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] For port e1b8b596-a26b-4e5f-b554-5b4abd35f067, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e1b8b596-a26b-4e5f-b554-5b4abd35f067,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:09.541692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.560585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] Calling delete_port for e1b8b596-a26b-4e5f-b554-5b4abd35f067 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:09.575184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc858d3-0e22-43f9-988f-3466a98b8e2a None None] Pushing event updated for resources: {'Port': ['ID=e1b8b596-a26b-4e5f-b554-5b4abd35f067,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:09.727026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.751449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] Pushing event deleted for resources: {'Port': ['ID=e1b8b596-a26b-4e5f-b554-5b4abd35f067,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:09.754780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4a6875c-181b-4ead-937b-3ae4e4911989 None None] No DVR routers for this DVR port e1b8b596-a26b-4e5f-b554-5b4abd35f067 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:09.784192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.824891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:09.828586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:09.831889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:09.832518 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.837442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-566b5a92-d2d1-43e4-95ad-782e5096332f None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:09.850078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=a9ccdadf-314a-456b-8d4b-cafa3689be3d,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:09.938352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'a9ccdadf-314a-456b-8d4b-cafa3689be3d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:09.939242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:09.941644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d5b9fc9c-c209-4b42-884a-cca04060a91b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5721524 Dec 21 04:25:09.944233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:09.949138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:4c:97:f3', 'name': 'tempest-NetworksTestDHCPv6-1504681835'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:10.076672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/a9ccdadf-314a-456b-8d4b-cafa3689be3d/b0d8d636-36e9-4853-af77-07d7cbda43e0) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:10.132377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:10.136560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.156731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 6698d795-fb72-4f1b-995c-c2dce099d807 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:10.219171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.309842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.349380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:10.352244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:10.355171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:10.368672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Pushing event updated for resources: {'Port': ['ID=b0d8d636-36e9-4853-af77-07d7cbda43e0,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:10.370270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::93 (b93c538b-c177-45d8-ae5b-37770a1f77ba/a9ccdadf-314a-456b-8d4b-cafa3689be3d/6698d795-fb72-4f1b-995c-c2dce099d807) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:10.416796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Attempting to bind port b0d8d636-36e9-4853-af77-07d7cbda43e0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:10.417370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Attempting to bind port b0d8d636-36e9-4853-af77-07d7cbda43e0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:10.417724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Attempting to bind port b0d8d636-36e9-4853-af77-07d7cbda43e0 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:10.423444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:10.423826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:10.424232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.424909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:10.425388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Bound port: b0d8d636-36e9-4853-af77-07d7cbda43e0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:10.425772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.491913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] For port b0d8d636-36e9-4853-af77-07d7cbda43e0, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:10.495060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] For port b0d8d636-36e9-4853-af77-07d7cbda43e0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b0d8d636-36e9-4853-af77-07d7cbda43e0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:10.515182 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.573099 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.608366 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.637939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b792b8-b995-480a-99a9-89a011286752 None None] Pushing event updated for resources: {'Port': ['ID=b0d8d636-36e9-4853-af77-07d7cbda43e0,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:10.668194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:10.674059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:10.677782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:10.683543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:10.684171 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:10.690870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=6698d795-fb72-4f1b-995c-c2dce099d807,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:10.758364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d334ccb3-73de-4100-80b0-8f7de79255e2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.8127353 Dec 21 04:25:10.760947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44178) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:10.823324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28525601-e337-4d29-9573-366db857b243 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:10.830844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28525601-e337-4d29-9573-366db857b243 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:10.835232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-28525601-e337-4d29-9573-366db857b243 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1668 time: 0.0730593 Dec 21 04:25:10.837907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44180) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:10.925929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 6698d795-fb72-4f1b-995c-c2dce099d807 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:10.926271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.015698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.027526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 6698d795-fb72-4f1b-995c-c2dce099d807 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:11.183818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.214236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=6698d795-fb72-4f1b-995c-c2dce099d807,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:11.239403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.242967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-23fac399-f655-416a-9217-b9224ca1c635 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/6698d795-fb72-4f1b-995c-c2dce099d807 HTTP/1.1" status: 204 len: 168 time: 0.4037981 Dec 21 04:25:11.245509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44182) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.297313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0f0d5b6-978c-4c6b-9eb0-621907a4f0ce tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:11.298901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0f0d5b6-978c-4c6b-9eb0-621907a4f0ce tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:11.300531 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e0f0d5b6-978c-4c6b-9eb0-621907a4f0ce tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.0540233 Dec 21 04:25:11.304477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44184) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.361383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet a9ccdadf-314a-456b-8d4b-cafa3689be3d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:11.367202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.411503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.495427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.540676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-48c7be24-b167-47fe-b357-d855b6cf841f None None] Provisioning complete for port b0d8d636-36e9-4853-af77-07d7cbda43e0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:11.541150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48c7be24-b167-47fe-b357-d855b6cf841f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.622114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48c7be24-b167-47fe-b357-d855b6cf841f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.642694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.657438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.660915 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/a9ccdadf-314a-456b-8d4b-cafa3689be3d HTTP/1.1" status: 204 len: 168 time: 0.3554354 Dec 21 04:25:11.664333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44186) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.682872 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-48c7be24-b167-47fe-b357-d855b6cf841f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:25:11.683395 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-48c7be24-b167-47fe-b357-d855b6cf841f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:25:11.699638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab079dc1-e3c0-49b4-a35b-0866ef72cb2c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=a9ccdadf-314a-456b-8d4b-cafa3689be3d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:11.702480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ee15ddb1-c348-4288-9885-ef3bf714c3ce tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0369997 Dec 21 04:25:11.705411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44188) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.733528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3eed68dd-7684-4c97-8951-41d38edd30bc None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:11.760381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40d41355-fab9-4904-abad-5e1e43569a96 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:11.761758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-40d41355-fab9-4904-abad-5e1e43569a96 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0553782 Dec 21 04:25:11.764301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44190) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.813673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0df4cb7e-2933-4ff9-bd76-f33e226b6c16 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:11.815606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0df4cb7e-2933-4ff9-bd76-f33e226b6c16 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0499825 Dec 21 04:25:11.819157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44192) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.856810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8bb680a9-4df5-46eb-bab6-bacc0a22dfb1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0364053 Dec 21 04:25:11.861065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44194) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:11.866072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:11.878539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:11.925184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] Deleting port b0d8d636-36e9-4853-af77-07d7cbda43e0 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:11.925568 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.985845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] For port b0d8d636-36e9-4853-af77-07d7cbda43e0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b0d8d636-36e9-4853-af77-07d7cbda43e0,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:11.986174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:11.998238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] Calling delete_port for b0d8d636-36e9-4853-af77-07d7cbda43e0 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:12.001814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:12.005762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.127255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.149631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] Pushing event deleted for resources: {'Port': ['ID=b0d8d636-36e9-4853-af77-07d7cbda43e0,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:12.155192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-784f2145-ef96-4472-a46e-1cf5ee016b03 None None] No DVR routers for this DVR port b0d8d636-36e9-4853-af77-07d7cbda43e0 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:12.203562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-48c7be24-b167-47fe-b357-d855b6cf841f None None] Port b0d8d636-36e9-4853-af77-07d7cbda43e0 update to ACTIVE by agent not found {{(pid=110312) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 21 04:25:12.314284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1788afe8-1758-43d8-a9bf-809d2c60b898 None None] Could not find standard attr ID for object 6698d795-fb72-4f1b-995c-c2dce099d807. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:12.346447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:12.347744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.386981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:12.390036 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:12.394039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:12.394622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.398448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a396e27-2bd2-4d0e-ac42-cf4a4e273df8 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:12.408006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=c5b2e238-1ea4-4a29-8f94-1cfe3c1773db,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:12.496655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'c5b2e238-1ea4-4a29-8f94-1cfe3c1773db'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:12.497530 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.501069 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-adb9348d-5704-4143-9fab-830f87910115 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.6389253 Dec 21 04:25:12.504000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44196) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:12.509020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:12.628082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Allocated IP 2001:db8::f816:3eff:fe94:21e1 (b93c538b-c177-45d8-ae5b-37770a1f77ba/c5b2e238-1ea4-4a29-8f94-1cfe3c1773db/2a702520-87f2-434e-9462-16b53443411b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:12.675491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:12.679267 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.770091 n-d-822053-11 neutron-server[110310]: INFO neutron.db.ipam_backend_mixin [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet c5b2e238-1ea4-4a29-8f94-1cfe3c1773db (CIDR: 2001:db8::/64) Dec 21 04:25:12.773210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.813278 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:25:12.813734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:12.835890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.873516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:12.876278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:12.879667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:12.887953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Pushing event updated for resources: {'Port': ['ID=2a702520-87f2-434e-9462-16b53443411b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:12.896378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9039a562-5ece-473d-8adc-b1d29cbec7bd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3912857 Dec 21 04:25:12.899104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44200) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:12.904200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:12.939581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Attempting to bind port 2a702520-87f2-434e-9462-16b53443411b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:12.939952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Attempting to bind port 2a702520-87f2-434e-9462-16b53443411b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:12.940315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Attempting to bind port 2a702520-87f2-434e-9462-16b53443411b on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:12.945152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:12.945534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:12.945927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:12.946322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:12.946783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Bound port: 2a702520-87f2-434e-9462-16b53443411b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:12.947188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:13.014364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] For port 2a702520-87f2-434e-9462-16b53443411b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:13.018364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] For port 2a702520-87f2-434e-9462-16b53443411b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2a702520-87f2-434e-9462-16b53443411b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:13.098998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:13.158848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb829611-b7c6-4e17-a23a-66790b1ab74e None None] Pushing event updated for resources: {'Port': ['ID=2a702520-87f2-434e-9462-16b53443411b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:13.332819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:13.336426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:13.607577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:13.647361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:13.650354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:13.654500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:13.655045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:13.668860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=94893949-32ce-42ae-b0c6-14deffc3b7dd,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:13.718286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a6cefc5d-44c7-4470-a511-db932b1c1798 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8179867 Dec 21 04:25:13.721052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44202) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:13.725821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:7c:36:18', 'name': 'tempest-NetworksTestDHCPv6-646978558'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:13.920972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:14.005861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.026269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 79810def-66ab-41c6-acbe-2b05c3598e22 yet. {{(pid=110310) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:14.064295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-414b305d-d38d-4b86-88e1-f385a24cb9e3 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:14.126241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2a702520-87f2-434e-9462-16b53443411b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:14.194075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Provisioning complete for port 2a702520-87f2-434e-9462-16b53443411b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:14.194448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.198804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8:0:1::16c (b93c538b-c177-45d8-ae5b-37770a1f77ba/94893949-32ce-42ae-b0c6-14deffc3b7dd/79810def-66ab-41c6-acbe-2b05c3598e22) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:14.204890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fe7c:3618 (b93c538b-c177-45d8-ae5b-37770a1f77ba/c5b2e238-1ea4-4a29-8f94-1cfe3c1773db/79810def-66ab-41c6-acbe-2b05c3598e22) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:14.260236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 2a702520-87f2-434e-9462-16b53443411b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:14.260589 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.353072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.365794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] Update dhcp port {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': 'c5b2e238-1ea4-4a29-8f94-1cfe3c1773db', 'ip_address': '2001:db8::f816:3eff:fe94:21e1'}, {'subnet_id': '94893949-32ce-42ae-b0c6-14deffc3b7dd'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '2a702520-87f2-434e-9462-16b53443411b'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:25:14.397709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.432138 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.441451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.477209 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.486390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:14.489403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:14.493102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:14.498810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:14.499461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.500122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] For port 2a702520-87f2-434e-9462-16b53443411b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2a702520-87f2-434e-9462-16b53443411b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:14.509968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=79810def-66ab-41c6-acbe-2b05c3598e22,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:14.575199 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.587179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f0f0d77-ea54-4464-8d11-c20452982d95 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 0.8650665 Dec 21 04:25:14.589921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44204) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:14.683726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 79810def-66ab-41c6-acbe-2b05c3598e22 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:14.684071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.685588 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:25:14.685932 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:25:14.702395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Pushing event updated for resources: {'Port': ['ID=2a702520-87f2-434e-9462-16b53443411b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:14.725482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.725846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.726197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.726538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.726879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.727302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.727592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.727927 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.728257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.728585 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.728912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.729242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.729564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a18de273-1707-4485-8de7-c9914b0961ab None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:14.735463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] Allocated IP 2001:db8:0:1::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/94893949-32ce-42ae-b0c6-14deffc3b7dd/2a702520-87f2-434e-9462-16b53443411b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:14.775767 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.788321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 79810def-66ab-41c6-acbe-2b05c3598e22 owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:14.832242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] For port 2a702520-87f2-434e-9462-16b53443411b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2a702520-87f2-434e-9462-16b53443411b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:14.865744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:14.961354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.047399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d63f581-2a25-4c64-bd52-0db9ced443ca None None] Pushing event updated for resources: {'Port': ['ID=2a702520-87f2-434e-9462-16b53443411b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:15.052735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.449597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=79810def-66ab-41c6-acbe-2b05c3598e22,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:15.496252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.499643 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a8660c4a-9c77-416c-88d5-5e852ba9bc2a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/79810def-66ab-41c6-acbe-2b05c3598e22 HTTP/1.1" status: 204 len: 168 time: 0.9087200 Dec 21 04:25:15.502626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44206) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: items = [ Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:15.547089 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:15.550542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25c0dfb2-cba9-4e59-a092-5b7a618f2ad5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:15.552128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-25c0dfb2-cba9-4e59-a092-5b7a618f2ad5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0484233 Dec 21 04:25:15.554656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44208) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:15.603458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a50e5434-618a-4b37-9383-c01446ddf4b7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:15.604067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-249583a9-0794-42e9-9361-c09213a845aa None None] Provisioning complete for port 2a702520-87f2-434e-9462-16b53443411b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:15.604422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-249583a9-0794-42e9-9361-c09213a845aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.607485 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a50e5434-618a-4b37-9383-c01446ddf4b7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0493977 Dec 21 04:25:15.607700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44210) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:15.670760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa666328-e7d2-4a57-b9be-0a5c7c4c9a12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:15.672604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa666328-e7d2-4a57-b9be-0a5c7c4c9a12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:15.674118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa666328-e7d2-4a57-b9be-0a5c7c4c9a12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:15.675762 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fa666328-e7d2-4a57-b9be-0a5c7c4c9a12 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0671246 Dec 21 04:25:15.678974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44212) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:15.731245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 94893949-32ce-42ae-b0c6-14deffc3b7dd {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:15.739160 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.779665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.805621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c539f810-fbf1-4d37-95fd-0eb513105751 None None] Could not find standard attr ID for object 79810def-66ab-41c6-acbe-2b05c3598e22. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:15.869910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:15.985064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.010909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=94893949-32ce-42ae-b0c6-14deffc3b7dd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:16.014486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.017722 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fad30018-cb28-4930-ad26-4b92f01bc467 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/94893949-32ce-42ae-b0c6-14deffc3b7dd HTTP/1.1" status: 204 len: 168 time: 0.3382454 Dec 21 04:25:16.020455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44214) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:16.028736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-906a356c-1faa-47b7-ac17-457b3b7dec6a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:16.081806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet c5b2e238-1ea4-4a29-8f94-1cfe3c1773db {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:16.086194 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.129477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.212430 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.249352 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2a702520-87f2-434e-9462-16b53443411b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:16.333185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 2a702520-87f2-434e-9462-16b53443411b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:16.333575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.338764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.376044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=c5b2e238-1ea4-4a29-8f94-1cfe3c1773db,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:16.378693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.384451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/c5b2e238-1ea4-4a29-8f94-1cfe3c1773db HTTP/1.1" status: 204 len: 168 time: 0.3604589 Dec 21 04:25:16.384656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44216) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:16.435938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.436284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.436625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.436958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.437319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.437647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.437995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.438292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.438614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.438975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.439282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.439636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.439957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39f71641-a8ba-4bf7-9244-c638cb156904 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:25:16.445180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c2743d7a-f89d-48f6-8370-b6bf4b48193a tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0593965 Dec 21 04:25:16.448914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44218) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:16.454643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:16.641924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:16.645578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:16.895508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aff2446-461b-462c-b016-cf4493872635 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:16.978262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d7eb19c9-7796-43e4-805f-676a2695aa51 None None] Provisioning complete for port 2a702520-87f2-434e-9462-16b53443411b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:16.978642 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7eb19c9-7796-43e4-805f-676a2695aa51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.032360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:17.102130 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:17.151971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] Deleting port 2a702520-87f2-434e-9462-16b53443411b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:17.152244 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.227724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] For port 2a702520-87f2-434e-9462-16b53443411b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2a702520-87f2-434e-9462-16b53443411b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:17.228127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.239845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] Calling delete_port for 2a702520-87f2-434e-9462-16b53443411b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:17.313710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.372881 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.398924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] Pushing event deleted for resources: {'Port': ['ID=2a702520-87f2-434e-9462-16b53443411b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:17.400814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-806f3e83-30cb-4bd3-8c0e-9a89e09830d2 None None] No DVR routers for this DVR port 2a702520-87f2-434e-9462-16b53443411b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:17.478770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] For port 2a702520-87f2-434e-9462-16b53443411b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=2a702520-87f2-434e-9462-16b53443411b,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:17.509225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.566719 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.567508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.627351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=2a702520-87f2-434e-9462-16b53443411b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:17.636918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:17.640144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:17.644254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:17.644840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.649164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8acdc89d-3a81-4949-be54-9313634c7f70 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:17.654336 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=c786307d-847a-4840-a3d1-7108fd3f495e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:17.695222 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8b981257-76a6-450d-895f-7a34542297cf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2451477 Dec 21 04:25:17.698139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44220) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:17.703158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:17.749911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'c786307d-847a-4840-a3d1-7108fd3f495e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:17.750824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.852535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:17.856237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:17.877975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Allocated IP 2001:db8::f816:3eff:fee5:e528 (b93c538b-c177-45d8-ae5b-37770a1f77ba/c786307d-847a-4840-a3d1-7108fd3f495e/9de638b3-95dc-45ff-badf-c45779e7b0f2) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:17.954487 n-d-822053-11 neutron-server[110311]: INFO neutron.db.ipam_backend_mixin [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet c786307d-847a-4840-a3d1-7108fd3f495e (CIDR: 2001:db8::/64) Dec 21 04:25:17.996571 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:25:17.997093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:18.022707 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.075839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2a702520-87f2-434e-9462-16b53443411b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:18.083664 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2e40901b-cd36-40c3-ab8d-5f0d7fb2071f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3844826 Dec 21 04:25:18.086222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44222) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:18.091169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:18.098161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.101379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 2a702520-87f2-434e-9462-16b53443411b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:25:18.101730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 2a702520-87f2-434e-9462-16b53443411b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:25:18.143684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:18.146862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:18.150261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:18.158133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Pushing event updated for resources: {'Port': ['ID=9de638b3-95dc-45ff-badf-c45779e7b0f2,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:18.207736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Attempting to bind port 9de638b3-95dc-45ff-badf-c45779e7b0f2 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:18.208031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Attempting to bind port 9de638b3-95dc-45ff-badf-c45779e7b0f2 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:18.208425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Attempting to bind port 9de638b3-95dc-45ff-badf-c45779e7b0f2 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:18.213263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:18.213672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:18.214067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.214460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:18.214920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Bound port: 9de638b3-95dc-45ff-badf-c45779e7b0f2, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:18.215325 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.252602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:18.256273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.279661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] For port 9de638b3-95dc-45ff-badf-c45779e7b0f2, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:18.282870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] For port 9de638b3-95dc-45ff-badf-c45779e7b0f2, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9de638b3-95dc-45ff-badf-c45779e7b0f2,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:18.350338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.409385 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2453639f-3d76-4ebb-ba40-541e04e7ba24 None None] Pushing event updated for resources: {'Port': ['ID=9de638b3-95dc-45ff-badf-c45779e7b0f2,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:18.538971 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.597009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:18.600330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:18.603457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:18.604062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.620290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=404cb2f4-de3e-4937-ac1f-ecb8fdab6edb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:18.690675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e5060300-6914-4dbf-9a69-efb77f610e32 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6033261 Dec 21 04:25:18.693541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44224) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:18.698474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:f6:97:e5', 'name': 'tempest-NetworksTestDHCPv6-1765700230'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:18.881402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:18.965691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:18.985392 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 4102965e-1098-477a-afa8-3d654ec258fd yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:19.155108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8:0:1::2b4 (b93c538b-c177-45d8-ae5b-37770a1f77ba/404cb2f4-de3e-4937-ac1f-ecb8fdab6edb/4102965e-1098-477a-afa8-3d654ec258fd) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:19.161791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::f816:3eff:fef6:97e5 (b93c538b-c177-45d8-ae5b-37770a1f77ba/c786307d-847a-4840-a3d1-7108fd3f495e/4102965e-1098-477a-afa8-3d654ec258fd) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:19.313894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec4ca882-25ab-4023-ae9c-6e2b1c571869 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:19.315151 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.402056 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.424167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6bb62e61-9fa9-4a11-934b-230a7437eac3 None None] Provisioning complete for port 9de638b3-95dc-45ff-badf-c45779e7b0f2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:19.424529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6bb62e61-9fa9-4a11-934b-230a7437eac3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.446042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:19.449405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:19.453800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:19.459587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:19.460225 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.472055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=4102965e-1098-477a-afa8-3d654ec258fd,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:19.512336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] Update dhcp port {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'fixed_ips': [{'subnet_id': 'c786307d-847a-4840-a3d1-7108fd3f495e', 'ip_address': '2001:db8::f816:3eff:fee5:e528'}, {'subnet_id': '404cb2f4-de3e-4937-ac1f-ecb8fdab6edb'}], 'binding:host_id': 'n-d-822053-11'}, 'id': '9de638b3-95dc-45ff-badf-c45779e7b0f2'} from n-d-822053-11. {{(pid=110312) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 21 04:25:19.530429 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9792b1f6-8e29-470a-a454-b7197694956b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 0.8353138 Dec 21 04:25:19.533190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44226) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:19.563612 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.580488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6bb62e61-9fa9-4a11-934b-230a7437eac3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.626580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 4102965e-1098-477a-afa8-3d654ec258fd {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:19.626944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.681507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6bb62e61-9fa9-4a11-934b-230a7437eac3 None None] For port 9de638b3-95dc-45ff-badf-c45779e7b0f2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9de638b3-95dc-45ff-badf-c45779e7b0f2,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:19.721269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.730961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6bb62e61-9fa9-4a11-934b-230a7437eac3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.734965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 4102965e-1098-477a-afa8-3d654ec258fd owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:19.788015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] Allocated IP 2001:db8:0:1::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/404cb2f4-de3e-4937-ac1f-ecb8fdab6edb/9de638b3-95dc-45ff-badf-c45779e7b0f2) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:19.817617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bb62e61-9fa9-4a11-934b-230a7437eac3 None None] Pushing event updated for resources: {'Port': ['ID=9de638b3-95dc-45ff-badf-c45779e7b0f2,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:19.898359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] For port 9de638b3-95dc-45ff-badf-c45779e7b0f2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9de638b3-95dc-45ff-badf-c45779e7b0f2,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:19.910366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdc715d4-59e5-49f2-a015-60e0276d53a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.928230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:19.989427 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.054272 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.075214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d563213-ee97-416d-98c7-30956ca1d281 None None] Pushing event updated for resources: {'Port': ['ID=9de638b3-95dc-45ff-badf-c45779e7b0f2,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:20.090340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=4102965e-1098-477a-afa8-3d654ec258fd,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:20.122865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9de638b3-95dc-45ff-badf-c45779e7b0f2 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:20.149031 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.154180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-225369c4-fcdf-44d9-9582-0b344c6c6b2d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/4102965e-1098-477a-afa8-3d654ec258fd HTTP/1.1" status: 204 len: 168 time: 0.6178222 Dec 21 04:25:20.154451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44228) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:20.179555 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9de638b3-95dc-45ff-badf-c45779e7b0f2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:20.179929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.212676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f26421e-8de7-47d0-ab12-53fa869ff77e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:20.214290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0f26421e-8de7-47d0-ab12-53fa869ff77e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0584211 Dec 21 04:25:20.216839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44230) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:20.266783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ab2d546-e44e-4c0a-b151-334a2ce42c51 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:20.268392 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9ab2d546-e44e-4c0a-b151-334a2ce42c51 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0506179 Dec 21 04:25:20.270810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44232) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:20.326384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd10d0f8-fc3c-4680-9396-6824c9fbe9e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:20.328091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd10d0f8-fc3c-4680-9396-6824c9fbe9e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:20.329673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd10d0f8-fc3c-4680-9396-6824c9fbe9e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:20.331190 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cd10d0f8-fc3c-4680-9396-6824c9fbe9e0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0588133 Dec 21 04:25:20.333802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44234) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:20.386594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 404cb2f4-de3e-4937-ac1f-ecb8fdab6edb {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:20.390003 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.437601 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.522610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.654592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d2025b12-8c13-4f15-a19e-dc3503b5cf62 None None] Provisioning complete for port 9de638b3-95dc-45ff-badf-c45779e7b0f2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:20.655150 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d2025b12-8c13-4f15-a19e-dc3503b5cf62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.658629 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.694752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=404cb2f4-de3e-4937-ac1f-ecb8fdab6edb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:20.701916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.705550 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-78d11408-017c-4836-924f-64e4ba753683 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/404cb2f4-de3e-4937-ac1f-ecb8fdab6edb HTTP/1.1" status: 204 len: 168 time: 0.3707781 Dec 21 04:25:20.708426 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44236) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:20.767004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet c786307d-847a-4840-a3d1-7108fd3f495e {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:20.770876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.791915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-194ca198-3816-4518-b5d8-64fec0b490f7 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:20.816529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:20.869488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a38322ec-a256-492a-9294-1fc36b3b9805 None None] Could not find standard attr ID for object 4102965e-1098-477a-afa8-3d654ec258fd. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:20.898373 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.024843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.055700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=c786307d-847a-4840-a3d1-7108fd3f495e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:21.061699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.065643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-145b838a-ea57-4991-8359-448f6d9ea0c5 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/c786307d-847a-4840-a3d1-7108fd3f495e HTTP/1.1" status: 204 len: 168 time: 0.3554459 Dec 21 04:25:21.068144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44238) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:21.106890 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-def6ddf7-12c7-49f3-af47-aec30349998f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0374503 Dec 21 04:25:21.109757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44240) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:21.114674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:21.275642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:21.279426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.385004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85948bb3-8bc2-4ea4-b749-fdf257f51b19 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:21.443070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f220598c-6139-44b8-ac34-25698c1e309c None None] Provisioning complete for port 9de638b3-95dc-45ff-badf-c45779e7b0f2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:21.443452 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f220598c-6139-44b8-ac34-25698c1e309c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.535148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.567837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:21.580079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:21.583258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:21.587468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:21.588054 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.599822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=adfc65c1-2044-4bea-ae57-c426dd59f850,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:21.621669 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] Deleting port 9de638b3-95dc-45ff-badf-c45779e7b0f2 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:21.622051 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.683875 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-66cfdc28-e998-4af3-8bed-83e5cf796b78 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5730631 Dec 21 04:25:21.686920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44242) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:21.692350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:21.700358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] For port 9de638b3-95dc-45ff-badf-c45779e7b0f2, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9de638b3-95dc-45ff-badf-c45779e7b0f2,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:21.700933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.718155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] Calling delete_port for 9de638b3-95dc-45ff-badf-c45779e7b0f2 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:21.881527 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.904291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:21.910262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] Pushing event deleted for resources: {'Port': ['ID=9de638b3-95dc-45ff-badf-c45779e7b0f2,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:21.910380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:21.910459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c503465f-d6ac-4811-a7f4-22ef5832eec3 None None] No DVR routers for this DVR port 9de638b3-95dc-45ff-badf-c45779e7b0f2 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:21.926804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a25e3f77-12ed-4b02-a07c-d293fe0cc351 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:22.009996 n-d-822053-11 neutron-server[110311]: INFO neutron.db.ipam_backend_mixin [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet adfc65c1-2044-4bea-ae57-c426dd59f850 (CIDR: 2001:db8::/64) Dec 21 04:25:22.024843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': 'adfc65c1-2044-4bea-ae57-c426dd59f850'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:22.025705 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.048778 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:25:22.049236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:22.094012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9de638b3-95dc-45ff-badf-c45779e7b0f2 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:22.119985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9de638b3-95dc-45ff-badf-c45779e7b0f2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:25:22.120377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9de638b3-95dc-45ff-badf-c45779e7b0f2 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:25:22.136554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cc8465f1-3322-4009-9e99-a4093daf4890 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4479835 Dec 21 04:25:22.145273 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44244) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:22.150233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:22.183880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/adfc65c1-2044-4bea-ae57-c426dd59f850/0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:22.318067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.344927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:22.348553 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.412733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.627992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:22.632235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:22.634085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Pushing event updated for resources: {'Port': ['ID=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:22.636232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:22.687813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d3047c34-7e97-49c5-be8c-041ee8e4c187 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.693000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Attempting to bind port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:22.693382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Attempting to bind port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:22.693751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Attempting to bind port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:22.698874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 24, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:22.699269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:22.699666 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.700060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:22.700526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Bound port: 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:22.701138 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.711667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:22.764666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] For port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:22.768421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] For port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:22.801521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:22.860634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8a526ed-2b5f-493e-aa45-9a3297385ced None None] Pushing event updated for resources: {'Port': ['ID=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:22.917897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.086668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.089445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] For port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:23.120090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.189582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.190347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.261573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:23.270371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:23.281419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:23.282015 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.289150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=1c6fe024-e753-430c-8351-ff4a6f832234,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:23.297515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,revision_number=4']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:23.343930 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.363695 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8bbcffcb-0660-4844-b14f-cde772be75ea tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.2173848 Dec 21 04:25:23.366445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44246) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:23.371410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:a5:0c:2b', 'name': 'tempest-NetworksTestDHCPv6-551308024'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:23.555522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:23.559744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.581194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 0612f2e4-b7d6-472d-ad7d-a00c5cd53459 yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:23.753728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::4e (b93c538b-c177-45d8-ae5b-37770a1f77ba/adfc65c1-2044-4bea-ae57-c426dd59f850/0612f2e4-b7d6-472d-ad7d-a00c5cd53459) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:23.759657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8:0:1:f816:3eff:fea5:c2b (b93c538b-c177-45d8-ae5b-37770a1f77ba/1c6fe024-e753-430c-8351-ff4a6f832234/0612f2e4-b7d6-472d-ad7d-a00c5cd53459) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:23.763199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-388927ff-056a-4c87-936d-24109cffafb3 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:23.835106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-78f3db5c-2127-461e-a08b-3ce6f1d27730 None None] Provisioning complete for port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:23.835401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78f3db5c-2127-461e-a08b-3ce6f1d27730 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.918387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.944358 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78f3db5c-2127-461e-a08b-3ce6f1d27730 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:23.977876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-78f3db5c-2127-461e-a08b-3ce6f1d27730 None None] For port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:24.007563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.060144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:24.063581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:24.064191 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-78f3db5c-2127-461e-a08b-3ce6f1d27730 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.068478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:24.076830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:24.077497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.084718 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=0612f2e4-b7d6-472d-ad7d-a00c5cd53459,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:24.129305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:24.158047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f3db5c-2127-461e-a08b-3ce6f1d27730 None None] Pushing event updated for resources: {'Port': ['ID=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:24.170142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ec475aba-a21b-4e9e-a1af-6d145654af04 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1030 time: 0.8025982 Dec 21 04:25:24.173379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44248) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:24.192902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:24.193280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.271685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 0612f2e4-b7d6-472d-ad7d-a00c5cd53459 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:24.272276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.373836 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.387013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 0612f2e4-b7d6-472d-ad7d-a00c5cd53459 owned by {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:24.494921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-df4344f9-fca0-435e-aade-15ff5a833905 None None] Provisioning complete for port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:24.495319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df4344f9-fca0-435e-aade-15ff5a833905 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.636165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.665652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=0612f2e4-b7d6-472d-ad7d-a00c5cd53459,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:24.690658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-22fcb816-369d-4218-b6ec-681676ad9765 None None] Could not find standard attr ID for object 0612f2e4-b7d6-472d-ad7d-a00c5cd53459. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:24.719125 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.723446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9ed87ad7-43a3-4f52-a830-4099436b41c0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/0612f2e4-b7d6-472d-ad7d-a00c5cd53459 HTTP/1.1" status: 204 len: 168 time: 0.5484171 Dec 21 04:25:24.725284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44250) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:24.774140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd08bb99-18d6-4f4a-b56c-6319bc55697c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:24.775755 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bd08bb99-18d6-4f4a-b56c-6319bc55697c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.0493984 Dec 21 04:25:24.778292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44252) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:24.826609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04b6a7a4-7b1f-4f82-a38b-97dbbbf28019 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:24.828285 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04b6a7a4-7b1f-4f82-a38b-97dbbbf28019 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1046 time: 0.0489640 Dec 21 04:25:24.830767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44254) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:24.890303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edd8ff75-98f1-4eba-be52-b53e36fa3e90 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:24.892285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edd8ff75-98f1-4eba-be52-b53e36fa3e90 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:24.893508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edd8ff75-98f1-4eba-be52-b53e36fa3e90 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:24.895110 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-edd8ff75-98f1-4eba-be52-b53e36fa3e90 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0633328 Dec 21 04:25:24.902840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44256) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:24.953555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 1c6fe024-e753-430c-8351-ff4a6f832234 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:24.956624 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:24.996090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.078958 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.086704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.115661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.213173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.238912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=1c6fe024-e753-430c-8351-ff4a6f832234,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:25.244313 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.247799 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-71dc8ec6-67b7-447a-a21a-95d90b8a9099 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/1c6fe024-e753-430c-8351-ff4a6f832234 HTTP/1.1" status: 204 len: 168 time: 0.3436837 Dec 21 04:25:25.249969 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44258) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:25.253102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6592f6b-33de-4383-8c5e-cc621fb0a23a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:25.302288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet adfc65c1-2044-4bea-ae57-c426dd59f850 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:25.305457 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.350047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.435479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.562400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.596641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=adfc65c1-2044-4bea-ae57-c426dd59f850,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:25.600310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.603539 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-562e463d-15ae-442e-a62d-e66ed57cb4e4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/adfc65c1-2044-4bea-ae57-c426dd59f850 HTTP/1.1" status: 204 len: 168 time: 0.3526261 Dec 21 04:25:25.605905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44260) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:25.644964 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-907dce78-675a-4e6e-848e-d649d3d09d7f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0371950 Dec 21 04:25:25.647108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44262) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:25.652095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:25.795393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.824017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:25.828614 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:25.861808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97555edb-094d-4a99-922e-cbcf65652f1a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:25.945702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-235dcd6c-5d5e-42a2-a0a8-3d41896bb867 None None] Provisioning complete for port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:25.946079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-235dcd6c-5d5e-42a2-a0a8-3d41896bb867 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.054963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:26.058777 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.108517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:26.117149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:26.120384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:26.124586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:26.125851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.133437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=766dcfb4-9f83-478b-b944-64db13341991,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:26.153652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] Deleting port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:26.154029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.187798 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e13f16f-fb28-4650-9631-40b9e1f74b19 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5390570 Dec 21 04:25:26.190609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44264) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:26.195540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:26.247912 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.271633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] For port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:26.272025 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.292648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] Calling delete_port for 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:26.308269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:26.367089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:26.370705 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.372292 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.422503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:26.469858 n-d-822053-11 neutron-server[110311]: INFO neutron.db.ipam_backend_mixin [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 766dcfb4-9f83-478b-b944-64db13341991 (CIDR: 2001:db8::/64) Dec 21 04:25:26.475147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.502252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] Pushing event deleted for resources: {'Port': ['ID=0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:26.504044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17e91bb4-0293-4573-95f3-6294243a7527 None None] No DVR routers for this DVR port 0dae69ec-f2d0-49c8-acdd-01e56b1dd3d8 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:26.507201 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:25:26.507666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:26.524353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b782ea3-188f-42e2-90c0-d41c55c94953 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:26.603559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8012ce19-7184-4f5c-bc98-9c509d6872b4 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4118493 Dec 21 04:25:26.606234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44266) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:26.611938 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'subnet': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:26.625123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b93c538b-c177-45d8-ae5b-37770a1f77ba', 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'project_id': 'a88d2e6974504a06a3b42dbe344029d5', 'fixed_ips': [{'subnet_id': '766dcfb4-9f83-478b-b944-64db13341991'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:25:26.625996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.761181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Allocated IP 2001:db8::2 (b93c538b-c177-45d8-ae5b-37770a1f77ba/766dcfb4-9f83-478b-b944-64db13341991/a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:26.796173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:26.800453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.901200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:26.962033 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.006122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:27.008914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:27.012380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:27.018319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Pushing event updated for resources: {'Port': ['ID=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:27.069635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Attempting to bind port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:25:27.070008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Attempting to bind port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:25:27.070372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Attempting to bind port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 on network b93c538b-c177-45d8-ae5b-37770a1f77ba {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:25:27.075318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 25, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:25:27.075692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Checking segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:25:27.076104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.076475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Bound using segment: {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:25:27.076935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Bound port: a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:25:27.077310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.139510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] For port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:25:27.143172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] For port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:25:27.145161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.objects.ports [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=110311) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 21 04:25:27.189861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.247082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd265860-8c1c-4000-bcaf-0c02a1e0129a None None] Pushing event updated for resources: {'Port': ['ID=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:27.356426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.540564 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] For port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:27.570041 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.612564 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.613372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.700497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:27.706609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:27.709616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:27.711981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:27.717532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,revision_number=4']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:27.720815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Subnet': ['ID=4c2dfe9f-d740-4b72-81f4-aeff725fc34e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:27.775582 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d1972c1-6f2e-4176-b6e1-46150df880eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 1.1680231 Dec 21 04:25:27.778211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44268) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:27.783011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Request body: {'port': {'network_id': 'b93c538b-c177-45d8-ae5b-37770a1f77ba', 'mac_address': 'fa:16:3e:d6:2c:0c', 'name': 'tempest-NetworksTestDHCPv6-54906749'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:28.120347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:28.176242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:28.176753 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.199958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c45c8a08-0201-4e67-aa1d-1674a33caf55 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:28.298566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Made reservation on behalf of a88d2e6974504a06a3b42dbe344029d5 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:28.316531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9086bd3a-b9d6-48e8-84f1-af21fd326ccd None None] Provisioning complete for port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:28.316830 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9086bd3a-b9d6-48e8-84f1-af21fd326ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.373620 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.382396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.402173 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] device_id is not set on port 19ba15a0-16bf-41af-a414-19fc5c27077c yet. {{(pid=110311) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 21 04:25:28.443967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:28.458406 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9086bd3a-b9d6-48e8-84f1-af21fd326ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.506113 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.581334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8::17a (b93c538b-c177-45d8-ae5b-37770a1f77ba/766dcfb4-9f83-478b-b944-64db13341991/19ba15a0-16bf-41af-a414-19fc5c27077c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:28.584602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9086bd3a-b9d6-48e8-84f1-af21fd326ccd None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:25:28.584960 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9086bd3a-b9d6-48e8-84f1-af21fd326ccd None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:25:28.589790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:28.590120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Allocated IP 2001:db8:0:1:f816:3eff:fed6:2c0c (b93c538b-c177-45d8-ae5b-37770a1f77ba/4c2dfe9f-d740-4b72-81f4-aeff725fc34e/19ba15a0-16bf-41af-a414-19fc5c27077c) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:25:28.741707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.836730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.880705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Network b93c538b-c177-45d8-ae5b-37770a1f77ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:25:28.885792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:25:28.889509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:25:28.895850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:28.896593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:28.903034 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event updated for resources: {'Port': ['ID=19ba15a0-16bf-41af-a414-19fc5c27077c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:28.987242 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6f64b04a-c9d1-43cd-aa5e-2d959bd15431 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 1.2079639 Dec 21 04:25:28.989852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44270) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:29.086849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting port 19ba15a0-16bf-41af-a414-19fc5c27077c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:29.087144 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.182466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.196617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Calling delete_port for 19ba15a0-16bf-41af-a414-19fc5c27077c owned by {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:29.397543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fbe993dd-1308-42f8-a7c6-c27dbe6b3f95 None None] Provisioning complete for port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:29.398114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fbe993dd-1308-42f8-a7c6-c27dbe6b3f95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.412813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.442249 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Port': ['ID=19ba15a0-16bf-41af-a414-19fc5c27077c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:29.478362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fbe993dd-1308-42f8-a7c6-c27dbe6b3f95 None None] Could not find standard attr ID for object 19ba15a0-16bf-41af-a414-19fc5c27077c. {{(pid=110312) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 21 04:25:29.487062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.490322 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-59afe7ca-4b57-4429-97f0-ce46219ce907 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/19ba15a0-16bf-41af-a414-19fc5c27077c HTTP/1.1" status: 204 len: 168 time: 0.4995136 Dec 21 04:25:29.492789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44272) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:29.545202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14971a2c-a549-47b5-b43b-b3095c3dd62e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:29.547408 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-14971a2c-a549-47b5-b43b-b3095c3dd62e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1045 time: 0.0530059 Dec 21 04:25:29.549894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44274) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:29.597948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-157e57cb-0bb4-4a3c-a9cc-6bb5a8453c2b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:29.599668 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-157e57cb-0bb4-4a3c-a9cc-6bb5a8453c2b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1045 time: 0.0488377 Dec 21 04:25:29.602199 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44276) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:29.656482 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84e4a5bb-bb3b-4f39-a6a2-cde795f66fae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:29.657977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84e4a5bb-bb3b-4f39-a6a2-cde795f66fae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:29.659641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84e4a5bb-bb3b-4f39-a6a2-cde795f66fae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:29.661197 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-84e4a5bb-bb3b-4f39-a6a2-cde795f66fae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0580716 Dec 21 04:25:29.663873 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44278) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:29.713994 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 4c2dfe9f-d740-4b72-81f4-aeff725fc34e {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:29.717181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.760096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.836697 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.944428 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.976112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=4c2dfe9f-d740-4b72-81f4-aeff725fc34e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:29.978119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:29.981304 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e480f059-1835-4434-8063-2167f04f3882 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/4c2dfe9f-d740-4b72-81f4-aeff725fc34e HTTP/1.1" status: 204 len: 168 time: 0.3165321 Dec 21 04:25:29.983221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0c5c0e2-7e21-4e06-b57e-cc00cab1fe8d None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:29.983882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44280) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.034727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Deleting subnet 766dcfb4-9f83-478b-b944-64db13341991 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:25:30.037893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.079293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.096546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:25:30.150517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:30.150889 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.173641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.304595 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.330237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Subnet': ['ID=766dcfb4-9f83-478b-b944-64db13341991,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:30.339298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.342554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04b78174-655c-4f55-ba95-fd00df9f6c89 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/766dcfb4-9f83-478b-b944-64db13341991 HTTP/1.1" status: 204 len: 168 time: 0.3572528 Dec 21 04:25:30.345676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44282) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.384004 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a47e28b2-be38-444d-bec0-1adb3210cb65 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0369878 Dec 21 04:25:30.386315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44284) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.439229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-539aaeec-de44-43cf-8db6-4d308d9c5348 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:30.440769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-539aaeec-de44-43cf-8db6-4d308d9c5348 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0535538 Dec 21 04:25:30.443352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44286) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.494628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afa2155c-f5e9-4f5f-99b2-5277014e4297 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:30.498448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-afa2155c-f5e9-4f5f-99b2-5277014e4297 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0518622 Dec 21 04:25:30.498730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44288) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.537170 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d4750062-f777-4f8c-bdd2-51a9de89e60d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0372870 Dec 21 04:25:30.542397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44290) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.570437 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-45f52813-dbae-44c9-8b51-ab340213aaee tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.571014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-45f52813-dbae-44c9-8b51-ab340213aaee tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.573999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-45f52813-dbae-44c9-8b51-ab340213aaee tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/19ba15a0-16bf-41af-a414-19fc5c27077c HTTP/1.1" status: 404 len: 333 time: 0.0306520 Dec 21 04:25:30.576621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44292) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.601750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-361bbbc8-f0b6-43c7-b40c-182cc18789e8 None None] Network b93c538b-c177-45d8-ae5b-37770a1f77ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:25:30.604901 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-27a44a94-59e9-422a-a787-58626d201827 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.605355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-27a44a94-59e9-422a-a787-58626d201827 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.610977 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-27a44a94-59e9-422a-a787-58626d201827 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/4c2dfe9f-d740-4b72-81f4-aeff725fc34e HTTP/1.1" status: 404 len: 337 time: 0.0308735 Dec 21 04:25:30.610977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44294) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.636142 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ae6dbcd-0d74-4dd2-86e9-3767ee76857b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.636587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4ae6dbcd-0d74-4dd2-86e9-3767ee76857b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.640891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ae6dbcd-0d74-4dd2-86e9-3767ee76857b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/766dcfb4-9f83-478b-b944-64db13341991 HTTP/1.1" status: 404 len: 337 time: 0.0277460 Dec 21 04:25:30.643267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44296) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.666468 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-db99ce72-7e61-4782-b567-56d28641a8d7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.667621 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-db99ce72-7e61-4782-b567-56d28641a8d7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.670037 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-db99ce72-7e61-4782-b567-56d28641a8d7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/0612f2e4-b7d6-472d-ad7d-a00c5cd53459 HTTP/1.1" status: 404 len: 333 time: 0.0258701 Dec 21 04:25:30.672553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44298) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.698021 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-81c10f18-8e0b-4791-baa6-22bb429b5d1e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.698489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-81c10f18-8e0b-4791-baa6-22bb429b5d1e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.701668 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81c10f18-8e0b-4791-baa6-22bb429b5d1e tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/1c6fe024-e753-430c-8351-ff4a6f832234 HTTP/1.1" status: 404 len: 337 time: 0.0281126 Dec 21 04:25:30.703512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9649062b-353f-4a7b-9a91-725e8bce82ab None None] Provisioning complete for port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:25:30.703894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9649062b-353f-4a7b-9a91-725e8bce82ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.704677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44300) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.736832 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-3e0f0280-091a-43dc-b1b2-256e253a3470 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.737297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3e0f0280-091a-43dc-b1b2-256e253a3470 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.740363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3e0f0280-091a-43dc-b1b2-256e253a3470 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/adfc65c1-2044-4bea-ae57-c426dd59f850 HTTP/1.1" status: 404 len: 337 time: 0.0345249 Dec 21 04:25:30.742857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44302) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.752034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] DHCP port deletion for b93c538b-c177-45d8-ae5b-37770a1f77ba request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:25:30.774942 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-5b11d5bd-b2ff-40cf-99af-5a6985f47c20 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.775498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5b11d5bd-b2ff-40cf-99af-5a6985f47c20 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.778632 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5b11d5bd-b2ff-40cf-99af-5a6985f47c20 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/4102965e-1098-477a-afa8-3d654ec258fd HTTP/1.1" status: 404 len: 333 time: 0.0331585 Dec 21 04:25:30.782228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.808769 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-7fcabed3-d098-4267-8563-7804e3360659 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.820106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7fcabed3-d098-4267-8563-7804e3360659 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.820106 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7fcabed3-d098-4267-8563-7804e3360659 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/404cb2f4-de3e-4937-ac1f-ecb8fdab6edb HTTP/1.1" status: 404 len: 337 time: 0.0293427 Dec 21 04:25:30.820106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.835087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] Deleting port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:25:30.835465 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.841346 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-82864b57-6f3d-4116-9b26-4b5548865a23 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.841750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-82864b57-6f3d-4116-9b26-4b5548865a23 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.845336 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-82864b57-6f3d-4116-9b26-4b5548865a23 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/c786307d-847a-4840-a3d1-7108fd3f495e HTTP/1.1" status: 404 len: 337 time: 0.0292709 Dec 21 04:25:30.847895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44308) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.871026 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b0390ec-3122-42f0-8f08-13d8dfe580b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.873827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7b0390ec-3122-42f0-8f08-13d8dfe580b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.874648 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7b0390ec-3122-42f0-8f08-13d8dfe580b9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/79810def-66ab-41c6-acbe-2b05c3598e22 HTTP/1.1" status: 404 len: 333 time: 0.0258629 Dec 21 04:25:30.877183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44310) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.897265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] For port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,segment=NetworkSegment(71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1),segment_id=71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:25:30.897667 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:30.902791 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-871700f9-b897-4f27-949c-b3dce829a831 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.903274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-871700f9-b897-4f27-949c-b3dce829a831 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.906845 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-871700f9-b897-4f27-949c-b3dce829a831 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/94893949-32ce-42ae-b0c6-14deffc3b7dd HTTP/1.1" status: 404 len: 337 time: 0.0281780 Dec 21 04:25:30.909343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44312) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.910626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] Calling delete_port for a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:25:30.939453 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-76ea1c0a-97de-4177-868c-bfd48f8b480d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.939911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-76ea1c0a-97de-4177-868c-bfd48f8b480d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.942919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76ea1c0a-97de-4177-868c-bfd48f8b480d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/c5b2e238-1ea4-4a29-8f94-1cfe3c1773db HTTP/1.1" status: 404 len: 337 time: 0.0326829 Dec 21 04:25:30.945490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44314) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:30.972355 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b6fb6b23-6ebd-4df7-81d9-467c4592624d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:30.972879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b6fb6b23-6ebd-4df7-81d9-467c4592624d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:30.975821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b6fb6b23-6ebd-4df7-81d9-467c4592624d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/6698d795-fb72-4f1b-995c-c2dce099d807 HTTP/1.1" status: 404 len: 333 time: 0.0294456 Dec 21 04:25:30.978277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44316) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.003357 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-dd3e214b-304f-47de-ab4a-a121b100344c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.003727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dd3e214b-304f-47de-ab4a-a121b100344c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.006615 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-dd3e214b-304f-47de-ab4a-a121b100344c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/a9ccdadf-314a-456b-8d4b-cafa3689be3d HTTP/1.1" status: 404 len: 337 time: 0.0274549 Dec 21 04:25:31.008932 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44318) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.031284 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-10d5836e-693e-43a1-911e-0be9bdc6bebd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.031787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-10d5836e-693e-43a1-911e-0be9bdc6bebd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.034662 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10d5836e-693e-43a1-911e-0be9bdc6bebd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/73efe961-04bc-433a-b2f6-d8f0e60feacc HTTP/1.1" status: 404 len: 333 time: 0.0248666 Dec 21 04:25:31.037039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44320) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.041605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:31.061921 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-00024200-4de7-41cb-af7e-60fed07ba4c7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.062877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-00024200-4de7-41cb-af7e-60fed07ba4c7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.068837 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-00024200-4de7-41cb-af7e-60fed07ba4c7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/393f407d-e958-4eeb-a6eb-1327abfff520 HTTP/1.1" status: 404 len: 337 time: 0.0280313 Dec 21 04:25:31.070767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] Pushing event deleted for resources: {'Port': ['ID=a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:31.070891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44322) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.071002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35577ddd-1614-43f2-a43f-804b07974cc2 None None] No DVR routers for this DVR port a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:25:31.091925 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-49e830d6-cead-4a0f-85e7-f77c93055ca2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.092465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-49e830d6-cead-4a0f-85e7-f77c93055ca2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.095497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-49e830d6-cead-4a0f-85e7-f77c93055ca2 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/888b099a-cf16-4d8e-8db7-cbbb94bea122 HTTP/1.1" status: 404 len: 333 time: 0.0260017 Dec 21 04:25:31.098207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44324) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.124534 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-82a0deff-ec78-49d8-bf0f-50a258fbf8b1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.128190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-82a0deff-ec78-49d8-bf0f-50a258fbf8b1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.128552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-82a0deff-ec78-49d8-bf0f-50a258fbf8b1 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/afdb4367-e13b-4877-802f-4134576628ec HTTP/1.1" status: 404 len: 337 time: 0.0293133 Dec 21 04:25:31.131173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44326) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.153412 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-e0b66f4e-79b3-4ec2-a4ae-d59fb672747c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.153925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e0b66f4e-79b3-4ec2-a4ae-d59fb672747c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.156859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e0b66f4e-79b3-4ec2-a4ae-d59fb672747c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/7ca79cfb-90c5-4fe4-9795-c1f9cdd77015 HTTP/1.1" status: 404 len: 333 time: 0.0247629 Dec 21 04:25:31.159182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44328) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.186558 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-d3efc2e9-4582-4c8b-bd9e-7b560c2b4448 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.187024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d3efc2e9-4582-4c8b-bd9e-7b560c2b4448 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.190486 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d3efc2e9-4582-4c8b-bd9e-7b560c2b4448 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/d07a55be-b435-4fb8-b8f7-802b53ab3a3c HTTP/1.1" status: 404 len: 337 time: 0.0304039 Dec 21 04:25:31.192823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44330) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.215045 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-40bdec52-cdc1-454a-89cd-6b05baa19ceb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.215603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-40bdec52-cdc1-454a-89cd-6b05baa19ceb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.218821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-40bdec52-cdc1-454a-89cd-6b05baa19ceb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/c7b7ac91-26c3-4a21-9cb1-be5c5f697da7 HTTP/1.1" status: 404 len: 333 time: 0.0250854 Dec 21 04:25:31.221261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44332) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.246448 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-90f15c20-1ed0-4e9d-aee7-3b8bf98b7b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.246892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-90f15c20-1ed0-4e9d-aee7-3b8bf98b7b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.253709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-90f15c20-1ed0-4e9d-aee7-3b8bf98b7b86 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/e49522c9-4381-45b8-8c96-0e06d3d64484 HTTP/1.1" status: 404 len: 337 time: 0.0314786 Dec 21 04:25:31.253827 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44334) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.277267 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-10cc56a0-6e99-49d3-b52d-542f9f3f5ffd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.277806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-10cc56a0-6e99-49d3-b52d-542f9f3f5ffd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.281813 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-10cc56a0-6e99-49d3-b52d-542f9f3f5ffd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/7604a201-5d08-433c-995e-730a101078e5 HTTP/1.1" status: 404 len: 333 time: 0.0267098 Dec 21 04:25:31.283500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44336) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.309445 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-881fc84a-196d-478f-89ad-77f4169f511f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.309900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-881fc84a-196d-478f-89ad-77f4169f511f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.314171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-881fc84a-196d-478f-89ad-77f4169f511f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/5339d581-1a34-4b45-92df-8a58f75ed8f6 HTTP/1.1" status: 404 len: 337 time: 0.0292604 Dec 21 04:25:31.316374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44338) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.341454 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-bf91ea8d-e2a6-49a0-8132-f6c2aaeae9ae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.341902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bf91ea8d-e2a6-49a0-8132-f6c2aaeae9ae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.344895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bf91ea8d-e2a6-49a0-8132-f6c2aaeae9ae tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/b75d57ef-b812-4a8b-ab2e-ecb1371f5066 HTTP/1.1" status: 404 len: 337 time: 0.0275667 Dec 21 04:25:31.347480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44340) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.369480 n-d-822053-11 neutron-server[110310]: INFO neutron.pecan_wsgi.hooks.translation [None req-479c6a21-4942-45ac-969e-68419eedeadd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.370017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-479c6a21-4942-45ac-969e-68419eedeadd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110310) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.376220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44342) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.376349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-479c6a21-4942-45ac-969e-68419eedeadd tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/68f9798d-0e3f-4f1a-b68a-7047e97a24d2 HTTP/1.1" status: 404 len: 333 time: 0.0278926 Dec 21 04:25:31.406903 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-3ef80333-7fee-4da4-8058-e891fcd759ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.407380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3ef80333-7fee-4da4-8058-e891fcd759ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.410477 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3ef80333-7fee-4da4-8058-e891fcd759ab tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/7f033d5c-9db6-453e-a5a3-58b4d77c17d9 HTTP/1.1" status: 404 len: 337 time: 0.0329690 Dec 21 04:25:31.413057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44344) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.439877 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-cfa4e3dc-347a-4d16-baaf-48af46aa66b8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.440571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cfa4e3dc-347a-4d16-baaf-48af46aa66b8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.446512 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cfa4e3dc-347a-4d16-baaf-48af46aa66b8 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/5f0c21a2-3d75-46bb-979e-8f15db59a0cf HTTP/1.1" status: 404 len: 337 time: 0.0324817 Dec 21 04:25:31.448947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44346) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.471223 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-633499bf-1c23-4c89-8aa7-d04c73ab82d9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.471738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-633499bf-1c23-4c89-8aa7-d04c73ab82d9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.474666 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-633499bf-1c23-4c89-8aa7-d04c73ab82d9 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/d7796245-28c1-4a31-b88f-52fc4bc05544 HTTP/1.1" status: 404 len: 333 time: 0.0248144 Dec 21 04:25:31.477112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44348) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.503160 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-d3197822-4569-405d-92de-56fa8eee5850 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.503338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d3197822-4569-405d-92de-56fa8eee5850 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.506239 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d3197822-4569-405d-92de-56fa8eee5850 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/93f1efc1-13f3-472e-8a30-b6e7faaa93b8 HTTP/1.1" status: 404 len: 337 time: 0.0281973 Dec 21 04:25:31.508527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44350) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.533051 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-f32a91f8-e0f8-45d7-9d72-a7d9af5a961b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.533492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f32a91f8-e0f8-45d7-9d72-a7d9af5a961b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.536427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f32a91f8-e0f8-45d7-9d72-a7d9af5a961b tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/ba7cd752-db67-4e82-87ed-8c513c439651 HTTP/1.1" status: 404 len: 337 time: 0.0270286 Dec 21 04:25:31.538635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44352) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.560167 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f6fc382-dd16-4eca-8a5e-594cc524b23f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.560678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f6fc382-dd16-4eca-8a5e-594cc524b23f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.564411 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3f6fc382-dd16-4eca-8a5e-594cc524b23f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/cd29c08f-88e8-47dd-8250-4f66165dbeff HTTP/1.1" status: 404 len: 333 time: 0.0248823 Dec 21 04:25:31.566574 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44354) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.595155 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b1112fa0-7905-4cca-9fba-99fc3bfebb14 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.595601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b1112fa0-7905-4cca-9fba-99fc3bfebb14 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.598554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b1112fa0-7905-4cca-9fba-99fc3bfebb14 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/48a49de9-f126-43d2-8ce0-0a401994d544 HTTP/1.1" status: 404 len: 337 time: 0.0310435 Dec 21 04:25:31.600871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44356) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.626999 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-666cedde-293f-4a99-a480-1b0cc78091eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.627451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-666cedde-293f-4a99-a480-1b0cc78091eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.630373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-666cedde-293f-4a99-a480-1b0cc78091eb tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/365ba9e0-c13b-4758-aec5-6a058bf541b1 HTTP/1.1" status: 404 len: 337 time: 0.0286224 Dec 21 04:25:31.632744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44358) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.659052 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-81ebda76-99d6-4f9a-9292-3d6a3cb85e22 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports?device_id=3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 HTTP/1.1" status: 200 len: 205 time: 0.0250881 Dec 21 04:25:31.661127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44360) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.697828 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-c221e7bd-64c0-4317-9740-166257e19398 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] delete failed (client error): The resource could not be found. Dec 21 04:25:31.698811 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c221e7bd-64c0-4317-9740-166257e19398 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/routers/3fd36ea1-d3c2-40f1-bdda-653a67b95ac3 HTTP/1.1" status: 404 len: 336 time: 0.0367863 Dec 21 04:25:31.701082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44362) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.726296 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-57652d94-9b0a-447c-8663-3e413937dfda tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.726749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-57652d94-9b0a-447c-8663-3e413937dfda tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.729712 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-57652d94-9b0a-447c-8663-3e413937dfda tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/afbb2103-388c-45e1-80d7-a063919772a0 HTTP/1.1" status: 404 len: 337 time: 0.0277615 Dec 21 04:25:31.732070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44364) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.762815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8fcdc509-ef13-494d-92fb-feb3f518f458 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "GET /v2.0/ports?device_id=3ac40dda-c004-439b-8bbe-84c1a4889b3c HTTP/1.1" status: 200 len: 205 time: 0.0295851 Dec 21 04:25:31.765040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44366) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.802621 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-b9c04fdd-586e-4560-a8a2-4f4fb3e8f33f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] delete failed (client error): The resource could not be found. Dec 21 04:25:31.803690 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b9c04fdd-586e-4560-a8a2-4f4fb3e8f33f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/routers/3ac40dda-c004-439b-8bbe-84c1a4889b3c HTTP/1.1" status: 404 len: 336 time: 0.0376945 Dec 21 04:25:31.814623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44368) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.840339 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac4d9183-3d2f-4ceb-b655-e6392b45da7d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.840795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac4d9183-3d2f-4ceb-b655-e6392b45da7d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.844347 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ac4d9183-3d2f-4ceb-b655-e6392b45da7d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/3f43dc66-463f-4a85-9d56-0952b5bea3cb HTTP/1.1" status: 404 len: 337 time: 0.0287943 Dec 21 04:25:31.846590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44370) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.871583 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-484d5b2d-b91e-4f93-98bd-79aa69197199 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.872030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-484d5b2d-b91e-4f93-98bd-79aa69197199 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.875111 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-484d5b2d-b91e-4f93-98bd-79aa69197199 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/4b06f33b-daa1-47fb-97c7-11ec7374428b HTTP/1.1" status: 404 len: 337 time: 0.0275970 Dec 21 04:25:31.877290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.902682 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-f685fad9-2b63-4072-a64f-1fcc78300d83 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.903229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f685fad9-2b63-4072-a64f-1fcc78300d83 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.906749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f685fad9-2b63-4072-a64f-1fcc78300d83 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/70bfb611-fa1d-45a8-9b5a-0638f6046958 HTTP/1.1" status: 404 len: 333 time: 0.0280526 Dec 21 04:25:31.908990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44374) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.933713 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-bd92a94c-41d9-4e15-9fc2-766c6fd98c00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.934154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bd92a94c-41d9-4e15-9fc2-766c6fd98c00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.937417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bd92a94c-41d9-4e15-9fc2-766c6fd98c00 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/6c468f5c-7231-4fba-881b-9350f000d16c HTTP/1.1" status: 404 len: 337 time: 0.0275018 Dec 21 04:25:31.939469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44376) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.960428 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-ff69ba37-a0b5-4481-8afc-65c84e67a114 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.960948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ff69ba37-a0b5-4481-8afc-65c84e67a114 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.963859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ff69ba37-a0b5-4481-8afc-65c84e67a114 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/dc0500e6-b457-4092-95ae-ae4b3674b7e6 HTTP/1.1" status: 404 len: 333 time: 0.0235333 Dec 21 04:25:31.965900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44378) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:31.990924 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9f7446f-5644-49c1-90fa-fb282b51a283 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:31.991383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a9f7446f-5644-49c1-90fa-fb282b51a283 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:31.994289 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a9f7446f-5644-49c1-90fa-fb282b51a283 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/183dac44-e150-4742-83fd-ba7145350398 HTTP/1.1" status: 404 len: 337 time: 0.0275424 Dec 21 04:25:31.996383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44380) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.017403 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e181b71-0ecb-4788-8e80-4ba20c3b941c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.017855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e181b71-0ecb-4788-8e80-4ba20c3b941c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.020815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5e181b71-0ecb-4788-8e80-4ba20c3b941c tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/16d3200b-bc85-4652-9272-eb617e3935e7 HTTP/1.1" status: 404 len: 333 time: 0.0235476 Dec 21 04:25:32.022848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.048872 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-7fcd686f-1d05-487f-9e18-e3f9866fd2e7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.049333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7fcd686f-1d05-487f-9e18-e3f9866fd2e7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.052427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7fcd686f-1d05-487f-9e18-e3f9866fd2e7 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/8b4199cf-5716-475a-85ab-001400dbf4c0 HTTP/1.1" status: 404 len: 337 time: 0.0285356 Dec 21 04:25:32.059227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44384) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.083086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:25:32.088248 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c0a271f-8ecd-4a04-b4b8-f4021e5a27bf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.088805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c0a271f-8ecd-4a04-b4b8-f4021e5a27bf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.091862 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5c0a271f-8ecd-4a04-b4b8-f4021e5a27bf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/59231703-1288-4a9a-b99d-5693b471bc6c HTTP/1.1" status: 404 len: 333 time: 0.0316939 Dec 21 04:25:32.095009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44386) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.104275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:25:32.104633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a6a0e263-ae13-4366-bdc0-c5c0bfd53bf9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:25:32.121333 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-90497f30-ac6e-455a-8038-380e1ea1bc18 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.121793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-90497f30-ac6e-455a-8038-380e1ea1bc18 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.124896 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-90497f30-ac6e-455a-8038-380e1ea1bc18 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/651b7ce4-f828-4781-a897-bd92f396794a HTTP/1.1" status: 404 len: 337 time: 0.0289655 Dec 21 04:25:32.127440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.150264 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-31189bff-6724-45da-b43f-b429923fb6de tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.150791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-31189bff-6724-45da-b43f-b429923fb6de tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.153756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-31189bff-6724-45da-b43f-b429923fb6de tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/5a06fcb0-53d1-4346-aad0-8c60d847cddf HTTP/1.1" status: 404 len: 333 time: 0.0254359 Dec 21 04:25:32.156071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44390) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.181544 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-d6f096cb-8759-4174-af00-ec65dfb1eed6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.181990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d6f096cb-8759-4174-af00-ec65dfb1eed6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.184958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d6f096cb-8759-4174-af00-ec65dfb1eed6 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/d0bc3489-2d34-490e-9519-eead2861fa9e HTTP/1.1" status: 404 len: 337 time: 0.0275183 Dec 21 04:25:32.187478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44392) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.209161 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-e15431bd-6a3e-457b-ba5f-8abc314456b0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.209682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e15431bd-6a3e-457b-ba5f-8abc314456b0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.212617 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e15431bd-6a3e-457b-ba5f-8abc314456b0 tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/4176ac2e-4478-48bc-880c-3ac24c9bd351 HTTP/1.1" status: 404 len: 333 time: 0.0242791 Dec 21 04:25:32.214706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44394) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.239675 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-914de0b8-3ca2-4110-bdd1-f331feceb17d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.240122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-914de0b8-3ca2-4110-bdd1-f331feceb17d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.243354 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-914de0b8-3ca2-4110-bdd1-f331feceb17d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/23082c16-9240-4e06-af3e-0df971424b1c HTTP/1.1" status: 404 len: 337 time: 0.0277600 Dec 21 04:25:32.245577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44396) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.271403 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-330ffadd-e0a8-4dbd-a144-bb3eece3931d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.271845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-330ffadd-e0a8-4dbd-a144-bb3eece3931d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.274717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-330ffadd-e0a8-4dbd-a144-bb3eece3931d tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/ports/55348ae0-fde0-450d-bd4b-9bd7d6c1acc0 HTTP/1.1" status: 404 len: 333 time: 0.0282364 Dec 21 04:25:32.276918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44398) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.301134 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-f2bec7fe-c6ac-49f2-8e7b-a3fb09dd89bf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] DELETE failed (client error): The resource could not be found. Dec 21 04:25:32.301566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f2bec7fe-c6ac-49f2-8e7b-a3fb09dd89bf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:25:32.304424 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f2bec7fe-c6ac-49f2-8e7b-a3fb09dd89bf tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/subnets/e34aa4a1-5ab5-40ea-8942-20087e43c26e HTTP/1.1" status: 404 len: 337 time: 0.0266676 Dec 21 04:25:32.306487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44400) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:32.385483 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.472776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.491900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b93c538b-c177-45d8-ae5b-37770a1f77ba']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:32.501288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:32.501584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71bdaae4-9c3c-4c62-b6b6-94fe00a2a4c1') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:32.510660 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.523987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.529611 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Releasing vlan 114 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:25:32.529985 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:25:32.532946 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:25:32.635849 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.643725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:32.646556 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] 10.222.0.18 "DELETE /v2.0/networks/b93c538b-c177-45d8-ae5b-37770a1f77ba HTTP/1.1" status: 204 len: 168 time: 0.3390443 Dec 21 04:25:32.659618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b2f73d-3602-468c-a15f-b8aeba61337f tempest-NetworksTestDHCPv6-1248014171 tempest-NetworksTestDHCPv6-1248014171-project] Pushing event deleted for resources: {'Network': ['ID=b93c538b-c177-45d8-ae5b-37770a1f77ba,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:33.028087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44406) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:33.159070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4cb2b4c8-a42d-43c2-b709-036db695574e admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a88d2e6974504a06a3b42dbe344029d5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1297812 Dec 21 04:25:33.161508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44410) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:33.208021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46cc18ac-37a9-4299-bff4-26c3f5ae1c01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:33.228916 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46cc18ac-37a9-4299-bff4-26c3f5ae1c01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:33.327110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46cc18ac-37a9-4299-bff4-26c3f5ae1c01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:33.330050 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-46cc18ac-37a9-4299-bff4-26c3f5ae1c01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:33.331285 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-46cc18ac-37a9-4299-bff4-26c3f5ae1c01 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/54dfef0e-cbda-49a4-bef9-2f2ada1710de HTTP/1.1" status: 204 len: 168 time: 0.1688714 Dec 21 04:25:33.339790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cc18ac-37a9-4299-bff4-26c3f5ae1c01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54dfef0e-cbda-49a4-bef9-2f2ada1710de,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:34.272282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44432) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:34.367310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-2077823923'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:25:34.424459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Made reservation on behalf of e1c138293092407a942f58304b597263 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:25:34.427898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.436887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.511780 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.572372 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.595439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:25:34.610601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d3fa785f-ee23-4046-89c4-cd6bcb84a811,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:34.614926 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.615780 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Added segment 8687b181-c79c-4e37-9ecb-5be8113cd751 of type vlan for network 747b08ec-0f2c-4915-80e1-1f09e442aa88 Dec 21 04:25:34.655210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.755526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.761221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:25:34.761805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:34.825896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Pushing event updated for resources: {'Network': ['ID=747b08ec-0f2c-4915-80e1-1f09e442aa88,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:34.836936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 747b08ec-0f2c-4915-80e1-1f09e442aa88 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:25:34.849861 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04ba9172-70a3-4bdd-b5c3-9e3d839b846c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 776 time: 0.5765119 Dec 21 04:25:34.853128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44436) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:34.859440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-2f7fca65-8d69-4979-9cfa-57575b6cfaec tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-1694396642') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:34.985111 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f7fca65-8d69-4979-9cfa-57575b6cfaec tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "PUT /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-1694396642 HTTP/1.1" status: 201 len: 201 time: 0.1309450 Dec 21 04:25:34.987654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44438) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:34.991915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-25c08e36-514a-4d76-99e1-7acc3723368b tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-1694396642') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.057026 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-25c08e36-514a-4d76-99e1-7acc3723368b tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-1694396642 HTTP/1.1" status: 204 len: 168 time: 0.0682716 Dec 21 04:25:35.059448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44440) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.064315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-35fa2e4a-3215-43b4-9e65-6d2d926f9009 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.132822 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-35fa2e4a-3215-43b4-9e65-6d2d926f9009 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags HTTP/1.1" status: 200 len: 238 time: 0.0723844 Dec 21 04:25:35.135444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44442) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.139799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-8683f440-6bcc-4366-bd5d-774dd37e6c0c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', {'tags': ['tempest-TagsTest-Tag-1276201809', 'tempest-TagsTest-Tag-518393937', 'tempest-TagsTest-Tag-547853865']}) {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.304856 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8683f440-6bcc-4366-bd5d-774dd37e6c0c tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "PUT /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags HTTP/1.1" status: 200 len: 307 time: 0.1684074 Dec 21 04:25:35.307459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44444) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.311880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-6bda3f6c-38d5-49de-8d2f-5e017df5accf tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-1276201809') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.453319 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6bda3f6c-38d5-49de-8d2f-5e017df5accf tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "DELETE /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-1276201809 HTTP/1.1" status: 204 len: 168 time: 0.1448834 Dec 21 04:25:35.455957 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44446) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.460190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-56ee7edf-360d-403b-9baa-49a8a2e81e25 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-1276201809') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.526125 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-56ee7edf-360d-403b-9baa-49a8a2e81e25 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] show failed (client error): The resource could not be found. Dec 21 04:25:35.527218 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-56ee7edf-360d-403b-9baa-49a8a2e81e25 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-1276201809 HTTP/1.1" status: 404 len: 326 time: 0.0703042 Dec 21 04:25:35.529866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44448) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.534512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-51e0d638-213f-4d72-aa6e-5699e6fa15d1 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-518393937') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.605145 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-51e0d638-213f-4d72-aa6e-5699e6fa15d1 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-518393937 HTTP/1.1" status: 204 len: 168 time: 0.0740943 Dec 21 04:25:35.607313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44450) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.612029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-703724ee-e6ce-45a0-a4c8-13b287bbb2e9 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-547853865') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.677445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-703724ee-e6ce-45a0-a4c8-13b287bbb2e9 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-547853865 HTTP/1.1" status: 204 len: 168 time: 0.0690873 Dec 21 04:25:35.679698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44452) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.683838 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-6b90e6f5-e383-424d-9f4a-53a866a7562d tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.819055 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b90e6f5-e383-424d-9f4a-53a866a7562d tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "DELETE /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags HTTP/1.1" status: 204 len: 168 time: 0.1383386 Dec 21 04:25:35.821670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44454) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.825896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-922b3931-f67f-4dc6-a017-dad3f0104588 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-518393937') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.890782 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-922b3931-f67f-4dc6-a017-dad3f0104588 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] show failed (client error): The resource could not be found. Dec 21 04:25:35.891832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-922b3931-f67f-4dc6-a017-dad3f0104588 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-518393937 HTTP/1.1" status: 404 len: 325 time: 0.0692492 Dec 21 04:25:35.894520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44456) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.898628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-befe8e99-b01b-42a8-a586-8205d49f6e9e tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88', 'tempest-TagsTest-Tag-547853865') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:35.969260 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-befe8e99-b01b-42a8-a586-8205d49f6e9e tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] show failed (client error): The resource could not be found. Dec 21 04:25:35.970305 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-befe8e99-b01b-42a8-a586-8205d49f6e9e tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "GET /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags/tempest-TagsTest-Tag-547853865 HTTP/1.1" status: 404 len: 325 time: 0.0748589 Dec 21 04:25:35.973008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44458) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:35.977142 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.tag.tag_plugin [None req-61d3b1c6-7b11-473a-bf8c-9ba7c337bfd6 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '747b08ec-0f2c-4915-80e1-1f09e442aa88') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:36.045364 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61d3b1c6-7b11-473a-bf8c-9ba7c337bfd6 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "DELETE /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88/tags HTTP/1.1" status: 204 len: 168 time: 0.0713992 Dec 21 04:25:36.049432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 44460) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:36.127230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.214798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.234778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['747b08ec-0f2c-4915-80e1-1f09e442aa88']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:36.243736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8687b181-c79c-4e37-9ecb-5be8113cd751') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:36.244032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8687b181-c79c-4e37-9ecb-5be8113cd751') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:25:36.253134 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.265775 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.271615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:25:36.271991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:25:36.274806 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:25:36.395070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.404612 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:36.405111 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] 10.222.0.18 "DELETE /v2.0/networks/747b08ec-0f2c-4915-80e1-1f09e442aa88 HTTP/1.1" status: 204 len: 168 time: 0.3547544 Dec 21 04:25:36.419003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea919626-73a6-4187-b96c-6124f42dd037 tempest-TagsTest-291439384 tempest-TagsTest-291439384-project] Pushing event deleted for resources: {'Network': ['ID=747b08ec-0f2c-4915-80e1-1f09e442aa88,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:36.840710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44466) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:36.976953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cd01f670-50bd-4db7-8522-92fc90fef670 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=e1c138293092407a942f58304b597263&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1350889 Dec 21 04:25:36.979351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44470) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:25:37.025563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-60fd8ca5-0f41-454c-bf86-840fe7062dc6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:37.045754 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-60fd8ca5-0f41-454c-bf86-840fe7062dc6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:37.127091 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-60fd8ca5-0f41-454c-bf86-840fe7062dc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:37.129827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-60fd8ca5-0f41-454c-bf86-840fe7062dc6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:37.130991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-60fd8ca5-0f41-454c-bf86-840fe7062dc6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d3fa785f-ee23-4046-89c4-cd6bcb84a811 HTTP/1.1" status: 204 len: 168 time: 0.1507208 Dec 21 04:25:37.138859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60fd8ca5-0f41-454c-bf86-840fe7062dc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3fa785f-ee23-4046-89c4-cd6bcb84a811,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:25:39.895033 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:25:49.926984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-120a6a02-f822-45c0-ace3-c8516d39a566 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:52.664028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-83bc076e-14fc-46f2-a2cd-f74831284c0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:53.104342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:53.343984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:55.087288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:55.150425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:25:55.818858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:16.893858 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:26:19.874965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-29786af5-baca-4c49-83ed-807941f2ca50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:22.652225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-651af191-5e55-4d5d-acdc-21c70ad34fd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:23.081275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:23.345089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:25.088177 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:25.104518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:25.784265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:49.887644 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d1e8ad0-77df-4d49-9ba8-511d4eece2c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:52.657748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9885dd8-a235-48bf-a4b8-352118ef939b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:53.087564 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:53.356272 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:53.892486 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:26:54.817661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 44998) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:26:54.923442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:54.997094 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.065318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.093274 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.106983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=198cef244b434362a737b611e3405723&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2881253 Dec 21 04:26:55.107674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b01a785-ec1c-4476-abc0-6eafa2d33fa7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:26:55.109608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45004) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:26:55.126331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.126679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.127119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.127459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.127791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.128120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.128456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.128779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.129103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.129429 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.129752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.130072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.130394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0ab8140-6f8b-400d-9538-c3793702169f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:55.136265 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.170002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a06dba6c-23ce-4c2b-93da-3aa3dfd2ea22 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.191571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a06dba6c-23ce-4c2b-93da-3aa3dfd2ea22 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.310113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a06dba6c-23ce-4c2b-93da-3aa3dfd2ea22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.312693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a06dba6c-23ce-4c2b-93da-3aa3dfd2ea22 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.314106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a06dba6c-23ce-4c2b-93da-3aa3dfd2ea22 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/6b01a785-ec1c-4476-abc0-6eafa2d33fa7 HTTP/1.1" status: 204 len: 168 time: 0.2036173 Dec 21 04:26:55.322623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06dba6c-23ce-4c2b-93da-3aa3dfd2ea22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b01a785-ec1c-4476-abc0-6eafa2d33fa7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:26:55.796496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:55.933036 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45010) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:26:55.946721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d093e2e-9348-4168-8957-5e29cad97c69 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.019704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d093e2e-9348-4168-8957-5e29cad97c69 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.076269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3d093e2e-9348-4168-8957-5e29cad97c69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.113333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3d093e2e-9348-4168-8957-5e29cad97c69 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bd0b5a1d95a44ea0a214b262e0f4109d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1792407 Dec 21 04:26:56.114278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d093e2e-9348-4168-8957-5e29cad97c69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92b621f5-6ba8-4a48-b8f0-cbcc6073c149,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:26:56.116039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45012) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:26:56.165616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.192146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.315844 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.318441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:56.319694 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/92b621f5-6ba8-4a48-b8f0-cbcc6073c149 HTTP/1.1" status: 204 len: 168 time: 0.2026234 Dec 21 04:26:56.327865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92b621f5-6ba8-4a48-b8f0-cbcc6073c149,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:26:56.335382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.335740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.336157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.337060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.337402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.337744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.338083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.338422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.338752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.339113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.339448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.339782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:56.340201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9d407ef-2ac6-4bc9-9d70-09e4e64b6e4b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:26:57.865002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45048) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:26:57.969733 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3baecf78-e60d-41d3-8d7b-4a7183d160fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.042803 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3baecf78-e60d-41d3-8d7b-4a7183d160fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.093402 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3baecf78-e60d-41d3-8d7b-4a7183d160fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.133127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3baecf78-e60d-41d3-8d7b-4a7183d160fc admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=bdbe92f0ae264c2c9f0cc69003f5bf74&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2670641 Dec 21 04:26:58.134085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baecf78-e60d-41d3-8d7b-4a7183d160fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f7e01ca-b5e5-4cea-ad29-5536b94e9d96,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:26:58.135868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45052) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:26:58.187333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0ff6d97-0f0d-4763-9560-c261d23960b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.208211 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0ff6d97-0f0d-4763-9560-c261d23960b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.293318 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0ff6d97-0f0d-4763-9560-c261d23960b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.295857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e0ff6d97-0f0d-4763-9560-c261d23960b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:26:58.296983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e0ff6d97-0f0d-4763-9560-c261d23960b0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5f7e01ca-b5e5-4cea-ad29-5536b94e9d96 HTTP/1.1" status: 204 len: 168 time: 0.1600630 Dec 21 04:26:58.304361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ff6d97-0f0d-4763-9560-c261d23960b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f7e01ca-b5e5-4cea-ad29-5536b94e9d96,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:15.366603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45192) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:27:15.479394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6efd1c28-5a33-4435-b672-4e488b6163ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.550414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6efd1c28-5a33-4435-b672-4e488b6163ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.613977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6efd1c28-5a33-4435-b672-4e488b6163ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.652481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6efd1c28-5a33-4435-b672-4e488b6163ea admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=afc05baee17146358e3e0ed8984d20ca&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2847145 Dec 21 04:27:15.653284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6efd1c28-5a33-4435-b672-4e488b6163ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d8aba84-b392-44e9-91ce-151ceb65830d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:15.655101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45196) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:27:15.704606 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4332f55a-aa67-4aac-92e0-a6f24ec0447f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.726445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4332f55a-aa67-4aac-92e0-a6f24ec0447f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.842212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4332f55a-aa67-4aac-92e0-a6f24ec0447f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.847175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4332f55a-aa67-4aac-92e0-a6f24ec0447f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:15.847175 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4332f55a-aa67-4aac-92e0-a6f24ec0447f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/9d8aba84-b392-44e9-91ce-151ceb65830d HTTP/1.1" status: 204 len: 168 time: 0.1899335 Dec 21 04:27:15.854237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4332f55a-aa67-4aac-92e0-a6f24ec0447f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d8aba84-b392-44e9-91ce-151ceb65830d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:16.474549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45204) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:27:16.488520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e453ade-5633-460f-977f-182e8f419ce1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.561839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e453ade-5633-460f-977f-182e8f419ce1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.624889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e453ade-5633-460f-977f-182e8f419ce1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.663155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e453ade-5633-460f-977f-182e8f419ce1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=d8ae21f76d094ca38fda92bbeca2046d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1873295 Dec 21 04:27:16.664022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e453ade-5633-460f-977f-182e8f419ce1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c558b285-7203-4f21-abbe-e51da12bb230,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:16.666299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45206) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:27:16.713854 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65c921a0-8541-4cb7-9645-089453b13e29 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.738030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65c921a0-8541-4cb7-9645-089453b13e29 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.874748 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65c921a0-8541-4cb7-9645-089453b13e29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.877324 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-65c921a0-8541-4cb7-9645-089453b13e29 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:16.878520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-65c921a0-8541-4cb7-9645-089453b13e29 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c558b285-7203-4f21-abbe-e51da12bb230 HTTP/1.1" status: 204 len: 168 time: 0.2111216 Dec 21 04:27:16.886591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c921a0-8541-4cb7-9645-089453b13e29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c558b285-7203-4f21-abbe-e51da12bb230,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:17.512895 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45212) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:27:17.526673 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a73fad3c-ba0e-49b6-8cb7-e352824a8a47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.599610 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a73fad3c-ba0e-49b6-8cb7-e352824a8a47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.687664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a73fad3c-ba0e-49b6-8cb7-e352824a8a47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.726401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a73fad3c-ba0e-49b6-8cb7-e352824a8a47 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f9733723f43c4bd6ab2135ffe7e2e778&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2124531 Dec 21 04:27:17.727434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73fad3c-ba0e-49b6-8cb7-e352824a8a47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61125639-9e4a-4538-84de-93ed11c5c2b2,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:17.729784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45214) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:27:17.777563 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8aa0703-ffcd-446a-b33f-0d621fed1810 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.798384 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8aa0703-ffcd-446a-b33f-0d621fed1810 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.931786 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8aa0703-ffcd-446a-b33f-0d621fed1810 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.934403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c8aa0703-ffcd-446a-b33f-0d621fed1810 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:17.935632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c8aa0703-ffcd-446a-b33f-0d621fed1810 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/61125639-9e4a-4538-84de-93ed11c5c2b2 HTTP/1.1" status: 204 len: 168 time: 0.2047522 Dec 21 04:27:17.943824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8aa0703-ffcd-446a-b33f-0d621fed1810 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61125639-9e4a-4538-84de-93ed11c5c2b2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:27:19.864929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-30d03e3f-2486-4e43-9f00-171be3b84065 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:22.645735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a8edc8f-4fbc-4cca-82ce-a25cd4ce7e9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:23.093665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:23.351222 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:25.128128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:25.156500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:25.779128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:30.891252 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:27:49.882152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f682f212-4ada-458d-9c4e-7e59515d728e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:52.670436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af8a129b-7f41-4f57-879f-a6e608656ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:53.105282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:53.377464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:55.129136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:55.129827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:27:55.790622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:07.890100 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:28:19.902699 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e1db70a-15b6-42a5-8c7e-0a27e757e5a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:22.682331 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6bf8e4f6-2ab5-44b1-8031-10a058bb223f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:23.151469 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:23.293808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-91a6d8a5-0b58-4888-99b1-dd916cf91fe3 req-d39fb314-08ec-4334-96ee-f925cecc11fc service neutron] (110310) timed out ('10.222.0.31', 52285) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:28:23.383447 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:25.128670 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:25.162108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:25.788310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.461296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45608) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:39.583523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.657482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.722529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.762085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e47f6ff-b6ad-4c8a-b06f-505eadf5ca9e,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:39.765893 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=92a3542031044f769bc29567924c6010&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3035808 Dec 21 04:28:39.768792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:39.772465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.772820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.773168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.773512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.773851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.774188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.774521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.774859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.775210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.775540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.775866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.776191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.776515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55759189-aded-4d47-91a4-755c3f4e6b99 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.820560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.841786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.973656 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.976316 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:39.977469 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/5e47f6ff-b6ad-4c8a-b06f-505eadf5ca9e HTTP/1.1" status: 204 len: 168 time: 0.2076981 Dec 21 04:28:39.985145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e47f6ff-b6ad-4c8a-b06f-505eadf5ca9e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:39.993479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.996650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.997441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:39.997441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0aeb976c-e8ad-47c2-93a8-2641c59d9194 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:41.524172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45646) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:41.634779 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30296a7f-37b1-4ed8-9f76-2766076fbb49 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.706757 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30296a7f-37b1-4ed8-9f76-2766076fbb49 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.779175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30296a7f-37b1-4ed8-9f76-2766076fbb49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.819681 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-30296a7f-37b1-4ed8-9f76-2766076fbb49 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=65d71fbeefc14e428b300acea47bf449&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2943962 Dec 21 04:28:41.820397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30296a7f-37b1-4ed8-9f76-2766076fbb49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=131faf7a-45a8-4dd8-8aed-d20fae8ee68e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:41.823174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45650) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:41.871781 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-62f1a91c-b665-4c8e-ac67-5dabf8abf125 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.894189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-62f1a91c-b665-4c8e-ac67-5dabf8abf125 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.991075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-62f1a91c-b665-4c8e-ac67-5dabf8abf125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.993603 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-62f1a91c-b665-4c8e-ac67-5dabf8abf125 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:41.994761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-62f1a91c-b665-4c8e-ac67-5dabf8abf125 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/131faf7a-45a8-4dd8-8aed-d20fae8ee68e HTTP/1.1" status: 204 len: 168 time: 0.1701279 Dec 21 04:28:42.002491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f1a91c-b665-4c8e-ac67-5dabf8abf125 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=131faf7a-45a8-4dd8-8aed-d20fae8ee68e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:44.889062 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:28:49.874190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a18aa56-4304-46c5-b339-44243040133e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:52.702223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b70bb02-0991-4206-abb8-0681ea2e0567 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:53.123482 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:53.354235 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.348972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45728) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:54.465274 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7676ea7-3b36-43cc-ab4d-f381eec894e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.537212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7676ea7-3b36-43cc-ab4d-f381eec894e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.593584 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d7676ea7-3b36-43cc-ab4d-f381eec894e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.631299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d7676ea7-3b36-43cc-ab4d-f381eec894e1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0b8bafa81fca4cb9ad61bdbed3709341&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2811849 Dec 21 04:28:54.643607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7676ea7-3b36-43cc-ab4d-f381eec894e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d78dbcfd-fb01-4659-b261-0a732a219d41,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:54.644094 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45732) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:54.682523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cac63046-9d5a-4f24-8b47-f1fdfa961cb0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.706840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cac63046-9d5a-4f24-8b47-f1fdfa961cb0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.810796 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cac63046-9d5a-4f24-8b47-f1fdfa961cb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.813490 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cac63046-9d5a-4f24-8b47-f1fdfa961cb0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:54.814667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cac63046-9d5a-4f24-8b47-f1fdfa961cb0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d78dbcfd-fb01-4659-b261-0a732a219d41 HTTP/1.1" status: 204 len: 168 time: 0.1796300 Dec 21 04:28:54.822830 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cac63046-9d5a-4f24-8b47-f1fdfa961cb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d78dbcfd-fb01-4659-b261-0a732a219d41,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:55.128972 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:55.151229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:55.769035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45754) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:55.779555 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:55.867549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1046353531-network', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:28:55.951265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:28:55.953630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:55.963334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.037662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.116833 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.140958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:28:56.150374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:56.155032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.155381 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Added segment 173aa79c-71ed-4484-bccf-831b4729873e of type vlan for network 2c8a03ed-591d-40ac-889b-d93086a1e436 Dec 21 04:28:56.194049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.279165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.280126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:28:56.280705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.372233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] Pushing event updated for resources: {'Network': ['ID=2c8a03ed-591d-40ac-889b-d93086a1e436,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:56.382508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:28:56.408063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-471c1eea-8ac6-4b62-8caf-d575f47aae45 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6378675 Dec 21 04:28:56.411303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 45758) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:56.416911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Request body: {'subnet': {'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1046353531-subnet', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:28:56.507975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:28:56.510340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.722996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.777419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ac2bd887-ab04-4643-8e7a-49082c17e848,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:56.785255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:28:56.785621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Network hostable DHCP agents. Network: 2c8a03ed-591d-40ac-889b-d93086a1e436, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:28:56.882309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:28:56.945016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 2c8a03ed-591d-40ac-889b-d93086a1e436) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:28:56.949163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:28:56.949757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:56.955795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1522ea41-40f5-4463-b7d2-c5eda9c669a9 None None] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:28:57.011097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45760) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:57.015728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fe290516-0bba-4bea-8186-eec9b4fb3609 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5985854 Dec 21 04:28:57.016363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:28:57.056055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-2c8a03ed-591d-40ac-889b-d93086a1e436', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:28:57.056445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.111146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.112281 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.162950 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.186062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Allocated IP 172.20.0.2 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/147c629c-b2ab-4e46-a17a-1299006ec08d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:28:57.324595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.374562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.396956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.434112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:28:57.438380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:28:57.442514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:28:57.449400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Pushing event updated for resources: {'Port': ['ID=147c629c-b2ab-4e46-a17a-1299006ec08d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:57.460060 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.460426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.460776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.461126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.461472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.461817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.462167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.462491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.462823 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.463181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.463513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.464912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.464912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:28:57.509269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Attempting to bind port 147c629c-b2ab-4e46-a17a-1299006ec08d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:28:57.509655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Attempting to bind port 147c629c-b2ab-4e46-a17a-1299006ec08d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:28:57.510026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Attempting to bind port 147c629c-b2ab-4e46-a17a-1299006ec08d on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:28:57.514867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:28:57.515279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:28:57.515690 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.516089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:28:57.516561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Bound port: 147c629c-b2ab-4e46-a17a-1299006ec08d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:28:57.516951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.580866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] For port 147c629c-b2ab-4e46-a17a-1299006ec08d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:28:57.583784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] For port 147c629c-b2ab-4e46-a17a-1299006ec08d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=147c629c-b2ab-4e46-a17a-1299006ec08d,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:28:57.647059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.671694 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.698773 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:57.805442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Allocated IP 172.25.5.57 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/7abfecb3-7118-4e01-9caa-e662d782f262) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:28:57.868086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4035fa93-7e49-4920-b964-24db685b1b82 None None] Pushing event updated for resources: {'Port': ['ID=147c629c-b2ab-4e46-a17a-1299006ec08d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:57.921334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.017665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.065453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:28:58.068797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:28:58.072346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:28:58.081511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b67b86d-9f40-4304-afea-a4f0a52357ea None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:28:58.094756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Pushing event updated for resources: {'Port': ['ID=7abfecb3-7118-4e01-9caa-e662d782f262,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:58.137461 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7ba95e0d-e731-4bec-85c1-27d7f90bd274 None None] Provisioning complete for port 7abfecb3-7118-4e01-9caa-e662d782f262 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:28:58.137983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ba95e0d-e731-4bec-85c1-27d7f90bd274 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.186500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7ba95e0d-e731-4bec-85c1-27d7f90bd274 None None] Port 7abfecb3-7118-4e01-9caa-e662d782f262 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:28:58.258450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 147c629c-b2ab-4e46-a17a-1299006ec08d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:28:58.307595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 147c629c-b2ab-4e46-a17a-1299006ec08d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:28:58.307894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.385999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.402164 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.418668 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 147c629c-b2ab-4e46-a17a-1299006ec08d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=147c629c-b2ab-4e46-a17a-1299006ec08d,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:28:58.485406 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.539568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=147c629c-b2ab-4e46-a17a-1299006ec08d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:28:58.809485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15829173-e7a3-49d0-b5cd-0755f17b244c None None] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:28:58.922645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eb66c2c6-0cf2-498a-b544-ba77d532c90d None None] Provisioning complete for port 147c629c-b2ab-4e46-a17a-1299006ec08d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:28:58.923048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb66c2c6-0cf2-498a-b544-ba77d532c90d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:58.976001 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:59.162127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Router 09fea275-edd6-479a-bf89-852a4ce60666 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:28:59.229159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b64f3a62-28d0-4c6e-94ad-b3ea027acd1d None None] Provisioning complete for port 147c629c-b2ab-4e46-a17a-1299006ec08d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:28:59.229448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b64f3a62-28d0-4c6e-94ad-b3ea027acd1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:59.268008 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:28:59.276542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:28:59.316032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:28:59.316933 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:28:59.341822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:59.343134 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-26fa2138-29c6-4297-85a7-51a6b19cf059 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.3303635 Dec 21 04:28:59.345814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45762) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:28:59.430271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:28:59.605504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:28:58Z', 'revision_number': 3, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:28:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:28:59.632254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:28:59.632614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Updating router 09fea275-edd6-479a-bf89-852a4ce60666 port 7abfecb3-7118-4e01-9caa-e662d782f262 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:28:59.667974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:59.765499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:59.937738 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:28:59.963483 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Allocated IP 172.20.0.1 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/e8b200b7-2299-4dd4-b8d3-c1c5d42502f0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:28:59.996921 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.045202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bab2ee92-a118-4a21-ac87-eb82e7843271 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:29:00.055867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68dbfb0c-5fb1-42fd-9eb6-a99ff6328851 None None] Pushing event updated for resources: {'Port': ['ID=7abfecb3-7118-4e01-9caa-e662d782f262,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:00.058102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Attempting to bind port 7abfecb3-7118-4e01-9caa-e662d782f262 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:29:00.058480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Attempting to bind port 7abfecb3-7118-4e01-9caa-e662d782f262 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:29:00.058851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Attempting to bind port 7abfecb3-7118-4e01-9caa-e662d782f262 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:00.065964 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:29:00.067258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:00.067986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.068384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:29:00.068880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Bound port: 7abfecb3-7118-4e01-9caa-e662d782f262, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:29:00.069258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.076494 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.123011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] For port 7abfecb3-7118-4e01-9caa-e662d782f262, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:29:00.126138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] For port 7abfecb3-7118-4e01-9caa-e662d782f262, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7abfecb3-7118-4e01-9caa-e662d782f262,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:29:00.185780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8d3ef4f1-2478-4e47-94fc-33cc74ed206b None None] Provisioning complete for port 7abfecb3-7118-4e01-9caa-e662d782f262 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:00.186144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8d3ef4f1-2478-4e47-94fc-33cc74ed206b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.194394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.209920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 147c629c-b2ab-4e46-a17a-1299006ec08d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:00.234912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:00.237823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:00.238674 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.241324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:29:00.264754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Pushing event updated for resources: {'Port': ['ID=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:00.284934 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.289520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8d3ef4f1-2478-4e47-94fc-33cc74ed206b None None] Port 7abfecb3-7118-4e01-9caa-e662d782f262 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:00.312516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17c7f712-ecd0-4968-9595-89403eb03c0b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:29:00.346919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:00.349091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:00.351058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68dbfb0c-5fb1-42fd-9eb6-a99ff6328851 None None] Pushing event updated for resources: {'Port': ['ID=7abfecb3-7118-4e01-9caa-e662d782f262,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:00.393331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 147c629c-b2ab-4e46-a17a-1299006ec08d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:00.393706 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.485261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.487456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1e2c0367-b9c5-4b45-8908-b136490dbc98 None None] Provisioning complete for port 7abfecb3-7118-4e01-9caa-e662d782f262 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:00.488151 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e2c0367-b9c5-4b45-8908-b136490dbc98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.537013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:00.649280 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.730673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e2c0367-b9c5-4b45-8908-b136490dbc98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.734027 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.772049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1e2c0367-b9c5-4b45-8908-b136490dbc98 None None] For port 7abfecb3-7118-4e01-9caa-e662d782f262, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7abfecb3-7118-4e01-9caa-e662d782f262,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:00.797813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:28:58Z', 'revision_number': 3, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:00.804710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.807411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Pushing event updated for resources: {'Port': ['ID=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:00.826127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb2319bd-7b53-434b-88e8-37529a860547 None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:28:58Z', 'revision_number': 3, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:29:00.839616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1e2c0367-b9c5-4b45-8908-b136490dbc98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:00.894592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2c0367-b9c5-4b45-8908-b136490dbc98 None None] Pushing event updated for resources: {'Port': ['ID=7abfecb3-7118-4e01-9caa-e662d782f262,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:00.909613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:00.911281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:00.975640 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5fd5cef1-79ef-4151-abdd-512f9af98bb6 None None] Provisioning complete for port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:00.976154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5fd5cef1-79ef-4151-abdd-512f9af98bb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:01.016861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5fd5cef1-79ef-4151-abdd-512f9af98bb6 None None] Port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:01.041410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:29:01.175644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:29:01.190554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cbb01aee-ed43-49a9-9bc3-d2a201bfc6bc admin admin] 10.222.0.18 "PUT /v2.0/routers/09fea275-edd6-479a-bf89-852a4ce60666/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8337591 Dec 21 04:29:01.239396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bcda3fb7-0f62-4d91-b59e-098e326b2b37 None None] Provisioning complete for port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:01.239895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bcda3fb7-0f62-4d91-b59e-098e326b2b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:01.275135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bcda3fb7-0f62-4d91-b59e-098e326b2b37 None None] Port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:01.847403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45778) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:29:01.852521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1915949755-network', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:29:01.962355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Made reservation on behalf of 7c0c80d80600428d87b721f3075b40d3 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:29:01.964753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:01.973616 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.047388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.128759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.156909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:29:02.166711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1dc8e157-5135-452f-989f-1391a573412c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:02.169935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.170288 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Added segment 65447a85-6a66-47f6-b3e5-9775ebe3388e of type vlan for network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 Dec 21 04:29:02.224269 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.231833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7abfecb3-7118-4e01-9caa-e662d782f262 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:02.284089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7abfecb3-7118-4e01-9caa-e662d782f262 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:02.284472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.305812 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.306748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:02.307404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.397148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] Pushing event updated for resources: {'Network': ['ID=4ef8856a-bba4-4df0-a09f-3e3d18a925e9,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:02.406223 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:29:02.407158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:29:02.417156 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:02.417860 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:02.431007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b83f01b8-c15b-421f-ad8c-41bcb0b21407 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5824063 Dec 21 04:29:02.433665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45782) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:29:02.438967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Request body: {'subnet': {'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1915949755-subnet', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:29:02.525458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Made reservation on behalf of 7c0c80d80600428d87b721f3075b40d3 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:29:02.527890 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.528014 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:02.735752 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 2, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:02.765758 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:29:02.770038 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Updating router 09fea275-edd6-479a-bf89-852a4ce60666 port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:29:02.788283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:02.791300 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.061999 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.084816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=67ef1c7f-d6e4-4a34-8120-e30bb4929e71,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:03.093122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Checking segment: {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:03.093484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Network hostable DHCP agents. Network: 4ef8856a-bba4-4df0-a09f-3e3d18a925e9, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:29:03.128144 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.182088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Pushing event updated for resources: {'Port': ['ID=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:03.206815 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.207295 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.207638 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.207971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.208321 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.208620 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.208943 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.209265 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.209584 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.209900 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.210219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.210535 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.210845 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:29:03.210970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:29:03.243626 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Attempting to bind port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:29:03.243991 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Attempting to bind port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:29:03.244351 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Attempting to bind port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:03.249462 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:29:03.250060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:03.250367 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.250760 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:29:03.251276 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Bound port: e8b200b7-2299-4dd4-b8d3-c1c5d42502f0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:29:03.251654 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.291287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4ef8856a-bba4-4df0-a09f-3e3d18a925e9) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:03.295521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:03.296177 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.303004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-986bc3c0-90b8-4b86-8937-a5eab1d89d4b None None] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:29:03.317164 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] For port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:29:03.321326 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] For port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:29:03.373720 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80ab8d97-cabc-4cdf-9184-45dc5dc880cf admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.9365516 Dec 21 04:29:03.379108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45784) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:29:03.379650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:29:03.397935 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.433783 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-aec98e77-aae3-447c-af8b-5323dd34234f None None] Provisioning complete for port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:03.434255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aec98e77-aae3-447c-af8b-5323dd34234f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.468587 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.470508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.471740 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:03.472529 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:03.474515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'fixed_ips': [{'subnet_id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:29:03.476956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.548699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.569184 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6255e8f-5bed-4b26-be32-5616a3b124c6 None None] Pushing event updated for resources: {'Port': ['ID=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:03.607825 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:03.650540 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aec98e77-aae3-447c-af8b-5323dd34234f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.678975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Allocated IP 172.20.0.2 (4ef8856a-bba4-4df0-a09f-3e3d18a925e9/67ef1c7f-d6e4-4a34-8120-e30bb4929e71/7c347b4f-0c9e-4525-b86f-04c6a84a2057) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:29:03.713873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aec98e77-aae3-447c-af8b-5323dd34234f None None] For port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:03.819326 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.827431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aec98e77-aae3-447c-af8b-5323dd34234f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.875869 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:03.917306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-769afa02-28d8-4b8f-a35b-535feeadd908 None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:29:03.918638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:03.920361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec98e77-aae3-447c-af8b-5323dd34234f None None] Pushing event updated for resources: {'Port': ['ID=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:03.981494 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3651627c-770a-4662-a5b9-0f6efb083805 None None] Provisioning complete for port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:03.982296 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3651627c-770a-4662-a5b9-0f6efb083805 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.029585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.101627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:04.107497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:04.116254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:29:04.120360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Pushing event updated for resources: {'Port': ['ID=7c347b4f-0c9e-4525-b86f-04c6a84a2057,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:04.148423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.186685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Attempting to bind port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:29:04.187540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Attempting to bind port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:29:04.188080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Attempting to bind port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 on network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:04.189156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.194785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:29:04.197450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Checking segment: {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:04.198350 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.198848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Bound using segment: {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:29:04.200014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Bound port: 7c347b4f-0c9e-4525-b86f-04c6a84a2057, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:29:04.200512 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.293460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:04.323888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] For port 7c347b4f-0c9e-4525-b86f-04c6a84a2057, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:29:04.328591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Allocated IP 172.25.5.8 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/58b2ff15-ec0a-47d1-bfbc-64d54bc572dc) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:29:04.349691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] For port 7c347b4f-0c9e-4525-b86f-04c6a84a2057, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7c347b4f-0c9e-4525-b86f-04c6a84a2057,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:29:04.381117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:04.381495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.414536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.459503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.489710 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc410389-61d6-4c04-b2dd-28b2fbfee29a None None] Pushing event updated for resources: {'Port': ['ID=7c347b4f-0c9e-4525-b86f-04c6a84a2057,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:04.559935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.598198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:04.609591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:04.614156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:29:04.622465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f42d68bb-72e9-45a3-bc7b-aa9b50f7c85f None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:29:04.648986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Pushing event updated for resources: {'Port': ['ID=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:04.669154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-81387410-4a80-4510-b353-ca7693236d99 None None] Provisioning complete for port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:04.669538 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-81387410-4a80-4510-b353-ca7693236d99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:04.723438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-81387410-4a80-4510-b353-ca7693236d99 None None] Port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:05.028461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:05.251680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:05.477093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Router 93d96019-0e87-487d-984c-3ea216bdcd13 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:29:05.532992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7072769c-dc3c-426a-a0f0-b01196ac72d5 None None] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:29:05.589046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:29:05.602248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Sync routers for ids ['93d96019-0e87-487d-984c-3ea216bdcd13'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:29:05.608775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d4ed6f51-995a-4fe8-9473-02182d889a63 None None] Provisioning complete for port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:05.609145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ed6f51-995a-4fe8-9473-02182d889a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:05.647570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Routers {'93d96019-0e87-487d-984c-3ea216bdcd13'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:05.648185 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93d96019-0e87-487d-984c-3ea216bdcd13'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:05.670401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:05.671751 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8575280-0beb-4d13-a317-d3a88c470fb2 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.2967689 Dec 21 04:29:05.675091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 45786) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:29:05.823024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Set router 93d96019-0e87-487d-984c-3ea216bdcd13 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:05.824872 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ed6f51-995a-4fe8-9473-02182d889a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:05.954842 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d4ed6f51-995a-4fe8-9473-02182d889a63 None None] For port 7c347b4f-0c9e-4525-b86f-04c6a84a2057, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7c347b4f-0c9e-4525-b86f-04c6a84a2057,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:06.032815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:29:04Z', 'revision_number': 3, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:06.063302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Checking router: 93d96019-0e87-487d-984c-3ea216bdcd13 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:29:06.063658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Updating router 93d96019-0e87-487d-984c-3ea216bdcd13 port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:29:06.065535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ed6f51-995a-4fe8-9473-02182d889a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.108172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.112284 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.155824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ed6f51-995a-4fe8-9473-02182d889a63 None None] Pushing event updated for resources: {'Port': ['ID=7c347b4f-0c9e-4525-b86f-04c6a84a2057,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:06.251381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-57b3a5af-e1b1-48ab-b69e-d4160d9d713c None None] Provisioning complete for port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:06.251978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57b3a5af-e1b1-48ab-b69e-d4160d9d713c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.264184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7c347b4f-0c9e-4525-b86f-04c6a84a2057 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:06.277933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Allocated IP 172.20.0.1 (4ef8856a-bba4-4df0-a09f-3e3d18a925e9/67ef1c7f-d6e4-4a34-8120-e30bb4929e71/9165936d-83ba-4e83-868f-2e4db5e600d0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:29:06.387438 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.442203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:06.442571 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.483008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.526355 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:06.529266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:06.533065 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:29:06.557587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Pushing event updated for resources: {'Port': ['ID=9165936d-83ba-4e83-868f-2e4db5e600d0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:06.578498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.709147 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.782825 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.839918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c04677f0-2b97-4867-b8cd-d8a87b204da9 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:29:06.856868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc50b4f-be98-4fea-be3c-131e0bf892f4 None None] Pushing event updated for resources: {'Port': ['ID=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:06.861953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Attempting to bind port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:29:06.862336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Attempting to bind port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:29:06.862703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Attempting to bind port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:06.874596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:29:06.875019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:06.875429 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.875825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:29:06.876304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Bound port: 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:29:06.876688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.903922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f8d300cd-3a54-4a67-8abc-e1f215e4bc74 None None] Provisioning complete for port 9165936d-83ba-4e83-868f-2e4db5e600d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:06.904302 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8d300cd-3a54-4a67-8abc-e1f215e4bc74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:06.957509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f8d300cd-3a54-4a67-8abc-e1f215e4bc74 None None] Port 9165936d-83ba-4e83-868f-2e4db5e600d0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:06.962924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] For port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:29:06.966008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] For port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:29:07.031407 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.047877 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.080165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bc45914-c531-420b-b770-301bb0bb964c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:29:07.103699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Routers {'93d96019-0e87-487d-984c-3ea216bdcd13'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:07.104395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93d96019-0e87-487d-984c-3ea216bdcd13'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:07.109840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc50b4f-be98-4fea-be3c-131e0bf892f4 None None] Pushing event updated for resources: {'Port': ['ID=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:07.149747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-279c8620-5436-4d43-8522-c18a87227faf None None] Provisioning complete for port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:07.150121 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-279c8620-5436-4d43-8522-c18a87227faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.217831 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.251248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] Set router 93d96019-0e87-487d-984c-3ea216bdcd13 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:07.268509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.334959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Pushing event updated for resources: {'Port': ['ID=9165936d-83ba-4e83-868f-2e4db5e600d0,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:07.337491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.345434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-279c8620-5436-4d43-8522-c18a87227faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.385325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-279c8620-5436-4d43-8522-c18a87227faf None None] For port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:07.433187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:07.434605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:07.469234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-279c8620-5436-4d43-8522-c18a87227faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.536879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279c8620-5436-4d43-8522-c18a87227faf None None] Pushing event updated for resources: {'Port': ['ID=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:07.545465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9165936d-83ba-4e83-868f-2e4db5e600d0', 'name': '', 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'mac_address': 'fa:16:3e:f8:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_interface', 'standard_attr_id': 4012, 'fixed_ips': [{'subnet_id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:06Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 1, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'subnets': [{'id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:07.555527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Router 93d96019-0e87-487d-984c-3ea216bdcd13 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:29:07.575930 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735d1ceb-2bbc-4620-b115-2af0a5c05983 None None] The sync data for ids ['93d96019-0e87-487d-984c-3ea216bdcd13'] in n-d-822053-11 is: [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9165936d-83ba-4e83-868f-2e4db5e600d0', 'name': '', 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'mac_address': 'fa:16:3e:f8:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_interface', 'standard_attr_id': 4012, 'fixed_ips': [{'subnet_id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:06Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 1, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'subnets': [{'id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:29:07.591630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-95ff1e25-ad03-453b-9eab-46dd31dd062c None None] Provisioning complete for port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:07.591929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-95ff1e25-ad03-453b-9eab-46dd31dd062c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.688916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:29:07.695668 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a41fd8cd-7bce-4f8c-aeb4-6c0d07558ae7 admin admin] 10.222.0.18 "PUT /v2.0/routers/93d96019-0e87-487d-984c-3ea216bdcd13/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0193150 Dec 21 04:29:07.825747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1983e583-aafc-4866-a1c9-a27e3c4169b2 None None] Provisioning complete for port 9165936d-83ba-4e83-868f-2e4db5e600d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:07.829451 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1983e583-aafc-4866-a1c9-a27e3c4169b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:07.868685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1983e583-aafc-4866-a1c9-a27e3c4169b2 None None] Port 9165936d-83ba-4e83-868f-2e4db5e600d0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:08.222411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7c347b4f-0c9e-4525-b86f-04c6a84a2057 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:08.295659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:08.296036 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:10.225872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:10.273610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:10.274003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:11.034793 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Sync routers for ids ['93d96019-0e87-487d-984c-3ea216bdcd13'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:29:11.044406 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Routers {'93d96019-0e87-487d-984c-3ea216bdcd13'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:11.045020 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93d96019-0e87-487d-984c-3ea216bdcd13'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:11.152598 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Set router 93d96019-0e87-487d-984c-3ea216bdcd13 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:11.442771 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9165936d-83ba-4e83-868f-2e4db5e600d0', 'name': '', 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'mac_address': 'fa:16:3e:f8:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_interface', 'standard_attr_id': 4012, 'fixed_ips': [{'subnet_id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:06Z', 'updated_at': '2021-12-21T04:29:07Z', 'revision_number': 2, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'subnets': [{'id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:11.468623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Checking router: 93d96019-0e87-487d-984c-3ea216bdcd13 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:29:11.468979 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Updating router 93d96019-0e87-487d-984c-3ea216bdcd13 port 9165936d-83ba-4e83-868f-2e4db5e600d0 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:29:11.493255 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:11.641965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-80aef964-9417-4e61-abda-55a140ccd77c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:11.643523 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-80aef964-9417-4e61-abda-55a140ccd77c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1743147 Dec 21 04:29:11.658589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3a548912-faa9-40e7-a824-8b91cf12907f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0091128 Dec 21 04:29:11.745669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-471109c5-bf44-43d9-86a0-c9d7c3a77abb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0808156 Dec 21 04:29:11.757340 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:11.822403 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:11.874419 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5aaed5-1c58-4d75-84fd-e363b776350d None None] Pushing event updated for resources: {'Port': ['ID=9165936d-83ba-4e83-868f-2e4db5e600d0,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:11.934745 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Attempting to bind port 9165936d-83ba-4e83-868f-2e4db5e600d0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:29:11.935253 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Attempting to bind port 9165936d-83ba-4e83-868f-2e4db5e600d0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:29:11.935725 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Attempting to bind port 9165936d-83ba-4e83-868f-2e4db5e600d0 on network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:11.940007 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-44ccc2b9-61e9-44b8-9a11-4a6bc2b9229b service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1862016 Dec 21 04:29:11.941566 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:29:11.942310 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Checking segment: {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:11.942798 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:11.943315 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Bound using segment: {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:29:11.943868 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Bound port: 9165936d-83ba-4e83-868f-2e4db5e600d0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65447a85-6a66-47f6-b3e5-9775ebe3388e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:29:11.944334 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:12.008291 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] For port 9165936d-83ba-4e83-868f-2e4db5e600d0, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:29:12.012978 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] For port 9165936d-83ba-4e83-868f-2e4db5e600d0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9165936d-83ba-4e83-868f-2e4db5e600d0,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:29:12.032905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-beb42917-9284-4935-8cc8-bff4d642fe86 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0900478 Dec 21 04:29:12.085922 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:12.125154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fce41f13-317c-47ab-8316-fec3ce3d7bc9 None None] Provisioning complete for port 9165936d-83ba-4e83-868f-2e4db5e600d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:12.125621 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fce41f13-317c-47ab-8316-fec3ce3d7bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:12.155455 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Routers {'93d96019-0e87-487d-984c-3ea216bdcd13'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:29:12.155455 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:28:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93d96019-0e87-487d-984c-3ea216bdcd13'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:12.159428 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5aaed5-1c58-4d75-84fd-e363b776350d None None] Pushing event updated for resources: {'Port': ['ID=9165936d-83ba-4e83-868f-2e4db5e600d0,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:12.222888 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fce41f13-317c-47ab-8316-fec3ce3d7bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:12.261004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fce41f13-317c-47ab-8316-fec3ce3d7bc9 None None] For port 9165936d-83ba-4e83-868f-2e4db5e600d0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9165936d-83ba-4e83-868f-2e4db5e600d0,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:12.284430 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] Set router 93d96019-0e87-487d-984c-3ea216bdcd13 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:29:12.328875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fce41f13-317c-47ab-8316-fec3ce3d7bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:12.383175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce41f13-317c-47ab-8316-fec3ce3d7bc9 None None] Pushing event updated for resources: {'Port': ['ID=9165936d-83ba-4e83-868f-2e4db5e600d0,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:12.449102 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4c67f95e-4d01-43f8-a3d2-cdea96b9d3ae None None] Provisioning complete for port 9165936d-83ba-4e83-868f-2e4db5e600d0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:12.449370 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4c67f95e-4d01-43f8-a3d2-cdea96b9d3ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:12.512916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9165936d-83ba-4e83-868f-2e4db5e600d0', 'name': '', 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'mac_address': 'fa:16:3e:f8:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_interface', 'standard_attr_id': 4012, 'fixed_ips': [{'subnet_id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:06Z', 'updated_at': '2021-12-21T04:29:12Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'subnets': [{'id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:29:12.541698 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb2dcfd-6a99-458b-8d3f-c89dacb0f816 None None] The sync data for ids ['93d96019-0e87-487d-984c-3ea216bdcd13'] in n-d-822053-11 is: [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:29:06Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '9165936d-83ba-4e83-868f-2e4db5e600d0', 'name': '', 'network_id': '4ef8856a-bba4-4df0-a09f-3e3d18a925e9', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'mac_address': 'fa:16:3e:f8:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_interface', 'standard_attr_id': 4012, 'fixed_ips': [{'subnet_id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:06Z', 'updated_at': '2021-12-21T04:29:12Z', 'revision_number': 4, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'subnets': [{'id': '67ef1c7f-d6e4-4a34-8120-e30bb4929e71', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:29:12.672234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a1180cd-0147-4b1c-ba42-372e50305f46 req-2ea315c5-ff21-4fc0-9925-8bd3b677ed1a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.1189907 Dec 21 04:29:13.769264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f6cfcc07-be78-4472-a5d1-8f45ef41012b req-734eef32-980d-49d8-9d20-ecca00ff42d9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.0271406 Dec 21 04:29:14.234140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9165936d-83ba-4e83-868f-2e4db5e600d0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:14.281557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 9165936d-83ba-4e83-868f-2e4db5e600d0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:14.281851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:14.876596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d070109-4a50-4ea5-929e-28ff15c82a97 req-bf0869c9-1182-4f33-b10e-a836c6a0bdac tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.0260470 Dec 21 04:29:14.949428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-cea784c6-1479-438c-8f68-e8d350fef172 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:14.950894 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-cea784c6-1479-438c-8f68-e8d350fef172 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1776195 Dec 21 04:29:14.982241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:29:15.173863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:29:15.178070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:15.303576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.10 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/c0e9f169-b16f-48a4-b4bf-e85b0c8149e3) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:29:15.458092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:15.554301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:15.604534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:29:15.609525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:29:15.614456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:15.616877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:29:15.669247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:15.670296 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:15.762381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-3fc1ddec-87de-4976-8539-63fd71931143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7839544 Dec 21 04:29:15.775625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-000b1e96-3f3a-4228-8ddd-027356f5ec27 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:29:15.776851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-000b1e96-3f3a-4228-8ddd-027356f5ec27 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0076821 Dec 21 04:29:15.854852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Request body: {'port': {'device_id': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:29:15.897756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-20814e0f-1a5b-4eb3-ba7c-a643c95478f7 None None] Provisioning complete for port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:15.899922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20814e0f-1a5b-4eb3-ba7c-a643c95478f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:15.922706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:15.937165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-20814e0f-1a5b-4eb3-ba7c-a643c95478f7 None None] Port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:29:16.009010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e0753d5-eab6-4d79-bc56-f69285d3921d req-65973a86-9dee-4b7c-9d6f-e82c3fd12814 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:16.010588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e0753d5-eab6-4d79-bc56-f69285d3921d req-65973a86-9dee-4b7c-9d6f-e82c3fd12814 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 932 time: 0.0622394 Dec 21 04:29:16.067480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e0753d5-eab6-4d79-bc56-f69285d3921d req-65f92fcb-2ce3-476b-82b1-04aad9c73de9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499163 Dec 21 04:29:16.251202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:29:16.260040 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:16.275725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Transition to ACTIVE for port object c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:29:16.342536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:16.399759 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Pushing event updated for resources: {'Port': ['ID=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:16.476148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Attempting to bind port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:29:16.476884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Attempting to bind port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:29:16.480619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Attempting to bind port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:16.487358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:29:16.487685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Attempting to bind port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:29:16.493220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 28, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:29:16.493566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:29:16.493954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:29:16.494380 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Bound port: c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:29:16.494731 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:16.560462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] For port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:29:16.563640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] For port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:29:16.626651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:16.673561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:16.673561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:16.673561 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] 10.222.0.54 "PUT /v2.0/ports/c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 HTTP/1.1" status: 200 len: 1093 time: 0.8814077 Dec 21 04:29:16.673561 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'tag': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:29:16.675865 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db949363-9972-4b4e-a688-63e00020ea95" -d '{"events": [{"name": "network-changed", "server_uuid": "e533131b-57c0-456e-b0e2-ae7bda8b58b0", "tag": "c0e9f169-b16f-48a4-b4bf-e85b0c8149e3"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:29:16.720084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b341ce-764a-4db1-a02a-f3dcc5f49a9a service neutron] Pushing event updated for resources: {'Port': ['ID=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:16.858418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-94052b4d-a11b-45b3-bcf1-dbe3c1fbfd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:16.860012 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-94052b4d-a11b-45b3-bcf1-dbe3c1fbfd51 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 1096 time: 0.0840344 Dec 21 04:29:16.911489 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-2c3b99bb-886b-4cce-82f1-df71f3573a87 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 HTTP/1.1" status: 200 len: 217 time: 0.0375149 Dec 21 04:29:16.965143 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-ec7090fe-7a1d-496b-a93f-28a1cc47dc36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:16.966516 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-ec7090fe-7a1d-496b-a93f-28a1cc47dc36 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0472934 Dec 21 04:29:17.011608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-e2863864-b221-4e68-b2d6-367bd0a337f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:17.013140 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-e2863864-b221-4e68-b2d6-367bd0a337f7 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0400393 Dec 21 04:29:17.106069 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-6590a363-2daa-42a5-b799-39749dcaa04c service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857966 Dec 21 04:29:17.201620 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7214d69a-0778-4e9f-8092-0a2c91d5e487 req-89cad4a3-4e59-44b3-9868-e438727559ce service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877562 Dec 21 04:29:17.453913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9a3912-3078-450f-b922-42f957890957 req-7140784e-539d-4eb0-9547-2124fac0a114 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:17.456034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c9a3912-3078-450f-b922-42f957890957 req-7140784e-539d-4eb0-9547-2124fac0a114 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.3100348 Dec 21 04:29:17.504939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c9a3912-3078-450f-b922-42f957890957 req-6f7da9a7-0d4d-403f-ac07-be87447a76c8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428524 Dec 21 04:29:17.810396 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:29:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ccb3be97-7ce7-4842-93db-d653793aca86 x-openstack-request-id: req-ccb3be97-7ce7-4842-93db-d653793aca86 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:29:17.810877 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e533131b-57c0-456e-b0e2-ae7bda8b58b0", "tag": "c0e9f169-b16f-48a4-b4bf-e85b0c8149e3", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:29:17.811004 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ccb3be97-7ce7-4842-93db-d653793aca86 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:29:17.811376 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'tag': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3', 'status': 'completed', 'code': 200} Dec 21 04:29:17.905457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db949363-9972-4b4e-a688-63e00020ea95 req-4b05bbe1-da62-4598-936e-bd783f79c7b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:17.906989 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-4b05bbe1-da62-4598-936e-bd783f79c7b2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 1096 time: 0.0422206 Dec 21 04:29:18.004661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db949363-9972-4b4e-a688-63e00020ea95 req-508e3437-0341-4dec-8123-6100b37b4b2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:18.006136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-508e3437-0341-4dec-8123-6100b37b4b2a service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0880644 Dec 21 04:29:18.049445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-dda96c54-ce6a-4a47-a0e5-5fca41677b48 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 HTTP/1.1" status: 200 len: 217 time: 0.0348368 Dec 21 04:29:18.103812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db949363-9972-4b4e-a688-63e00020ea95 req-1b6b2f60-632b-4ef3-b48b-d5c0973b83bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:18.105190 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-1b6b2f60-632b-4ef3-b48b-d5c0973b83bc service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0479546 Dec 21 04:29:18.180092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db949363-9972-4b4e-a688-63e00020ea95 req-08d179a3-c822-4d28-9eac-2d31c3e23001 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:18.181596 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-08d179a3-c822-4d28-9eac-2d31c3e23001 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0409324 Dec 21 04:29:18.273679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-d6e406f2-556a-47d6-a900-8d8c00e6a7e0 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845883 Dec 21 04:29:18.368436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db949363-9972-4b4e-a688-63e00020ea95 req-a5662e48-9f8c-4aac-9b0a-f50685b0b642 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872853 Dec 21 04:29:18.621320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8ca616-ae71-4032-8779-387cb92ff984 req-899db331-e7e2-48b8-9ec5-9d618b9de09b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:18.622973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c8ca616-ae71-4032-8779-387cb92ff984 req-899db331-e7e2-48b8-9ec5-9d618b9de09b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0498593 Dec 21 04:29:18.669306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c8ca616-ae71-4032-8779-387cb92ff984 req-7f8ecf22-0335-499d-96ec-5f2d0f71e146 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402324 Dec 21 04:29:19.784756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-615337f1-6692-48a5-85e8-eece898e2aa4 req-bf8e06a9-6ba4-42f1-a859-589b60b346c1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:19.786247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-615337f1-6692-48a5-85e8-eece898e2aa4 req-bf8e06a9-6ba4-42f1-a859-589b60b346c1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0481746 Dec 21 04:29:19.839352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-615337f1-6692-48a5-85e8-eece898e2aa4 req-b524e92e-30b6-4a63-abe1-06210cc117dd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469100 Dec 21 04:29:19.873824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef34c93a-fa0b-4844-88e6-6d2ef411168d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:20.953601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf7de83-b4ab-4c0a-b8c2-8bbdb96f548a req-00193d17-1d95-4953-bc23-7a486b90f117 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:20.955392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbf7de83-b4ab-4c0a-b8c2-8bbdb96f548a req-00193d17-1d95-4953-bc23-7a486b90f117 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0499935 Dec 21 04:29:21.001606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbf7de83-b4ab-4c0a-b8c2-8bbdb96f548a req-3c1d1f5f-df02-4bf9-96dd-de099244e701 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405257 Dec 21 04:29:21.887608 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:29:22.129608 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b141f0cf-d23f-4efb-b631-15d22c2ec9ae req-d7305c5e-0fbd-46aa-827f-c42a66b9acba tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:22.131834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b141f0cf-d23f-4efb-b631-15d22c2ec9ae req-d7305c5e-0fbd-46aa-827f-c42a66b9acba tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0624008 Dec 21 04:29:22.188544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b141f0cf-d23f-4efb-b631-15d22c2ec9ae req-be84499e-f28b-492a-a6e2-7fba6c201718 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508649 Dec 21 04:29:22.656615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2b4f32d2-b069-4b6c-a2a3-789a5d813da2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:23.111919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:23.305536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c389dc3c-7815-423c-9aea-c90c50e5bed5 req-ad4ae99a-b02b-4ba4-9dc9-316894394e14 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:23.307063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c389dc3c-7815-423c-9aea-c90c50e5bed5 req-ad4ae99a-b02b-4ba4-9dc9-316894394e14 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0518138 Dec 21 04:29:23.353386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c389dc3c-7815-423c-9aea-c90c50e5bed5 req-f8b6fe33-f5d5-4f56-b721-2de25aea2595 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403013 Dec 21 04:29:23.374131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:24.467797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61069e30-a381-4403-9f02-91fcc0fa0081 req-a845f0be-9d6c-4b67-82bb-b26436ad8282 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:24.469266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61069e30-a381-4403-9f02-91fcc0fa0081 req-a845f0be-9d6c-4b67-82bb-b26436ad8282 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0486550 Dec 21 04:29:24.516437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61069e30-a381-4403-9f02-91fcc0fa0081 req-89fda5aa-66aa-4535-a317-fa5d50c19096 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405424 Dec 21 04:29:25.107880 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:25.133997 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:25.631713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5273186-5e97-4050-a3b8-5622dd87670b req-3fd099ef-c1fe-44e3-a9a8-6bcd27025cd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:25.633203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5273186-5e97-4050-a3b8-5622dd87670b req-3fd099ef-c1fe-44e3-a9a8-6bcd27025cd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0485280 Dec 21 04:29:25.682254 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5273186-5e97-4050-a3b8-5622dd87670b req-0a3af9fa-bd40-4848-bf41-2320c1012ec8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430732 Dec 21 04:29:25.775976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:26.795708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24aeb0a8-9d25-4e24-a179-3a7bfeb43859 req-46913d87-5d97-4dc1-b672-54f76c126bd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:26.797165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24aeb0a8-9d25-4e24-a179-3a7bfeb43859 req-46913d87-5d97-4dc1-b672-54f76c126bd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 944 time: 0.0490901 Dec 21 04:29:26.844078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24aeb0a8-9d25-4e24-a179-3a7bfeb43859 req-410abad2-bae7-4c49-819d-bd012f47e30a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410135 Dec 21 04:29:27.579672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:29:27.675496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:27.685496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3', 'mac_address': 'fa:16:3e:1c:74:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:29:27.722333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:27.735071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:29:27.757521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:27.813906 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:27.860546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:27.957571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e82de05-9f73-4d0c-a45d-5a752387e938 req-a2058c65-1fa7-496d-bea3-2d1a031fb194 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:27.959064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e82de05-9f73-4d0c-a45d-5a752387e938 req-a2058c65-1fa7-496d-bea3-2d1a031fb194 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 945 time: 0.0478773 Dec 21 04:29:28.004909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e82de05-9f73-4d0c-a45d-5a752387e938 req-378f2114-a64b-4b37-a347-a91c13e474b5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400198 Dec 21 04:29:28.119421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['c0e9f169-b16f-48a4-b4bf-e85b0c8149e3'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:29:29.120793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0f7382-f4d2-47d8-8245-ed22d64513dc req-e2b4d3c1-c6e2-46f2-ae31-1121fdcff014 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:29.122258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a0f7382-f4d2-47d8-8245-ed22d64513dc req-e2b4d3c1-c6e2-46f2-ae31-1121fdcff014 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 945 time: 0.0518410 Dec 21 04:29:29.168628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a0f7382-f4d2-47d8-8245-ed22d64513dc req-e60cca2f-4c5d-4926-8b7a-83d0b6900859 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404451 Dec 21 04:29:29.599290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:29:29.739762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:29:29.743664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:29:29.744033 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:29.820064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:29.846615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:29:29.848876 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08a23790-eac8-48ed-a755-8bb371af1cfd" -d '{"events": [{"server_uuid": "e533131b-57c0-456e-b0e2-ae7bda8b58b0", "name": "network-vif-plugged", "status": "completed", "tag": "c0e9f169-b16f-48a4-b4bf-e85b0c8149e3"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:29:29.861887 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:29.934188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:29.983280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:30.281075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567acf68-58f6-4c38-8878-e912f796ec70 req-395cb64c-a4dc-464a-8679-f344f97232b3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:30.282563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-567acf68-58f6-4c38-8878-e912f796ec70 req-395cb64c-a4dc-464a-8679-f344f97232b3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0483499 Dec 21 04:29:30.331370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-567acf68-58f6-4c38-8878-e912f796ec70 req-88a2a94a-916a-49a7-a981-7be9e3af87f2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424340 Dec 21 04:29:30.961714 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:29:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11e781cb-579d-48f8-9046-4e1a6b9c77d7 x-openstack-request-id: req-11e781cb-579d-48f8-9046-4e1a6b9c77d7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:29:30.962178 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e533131b-57c0-456e-b0e2-ae7bda8b58b0", "name": "network-vif-plugged", "status": "completed", "tag": "c0e9f169-b16f-48a4-b4bf-e85b0c8149e3", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:29:30.962268 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-11e781cb-579d-48f8-9046-4e1a6b9c77d7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:29:30.962646 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3', 'code': 200} Dec 21 04:29:31.090161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c640db-4ae0-4f60-a622-2569e49ec007 req-98c0c2b5-6ae3-48ca-8e54-2bddff47946f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:31.091681 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-49c640db-4ae0-4f60-a622-2569e49ec007 req-98c0c2b5-6ae3-48ca-8e54-2bddff47946f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 1098 time: 0.0400429 Dec 21 04:29:31.134636 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-49c640db-4ae0-4f60-a622-2569e49ec007 req-9bfcf5b1-b284-41c6-93de-a169886d6f1d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361965 Dec 21 04:29:31.447603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f6bc9f-3e3f-4bf8-a49d-9903d7c4a9cd req-e9f56f29-fb32-42b6-9f62-d22a9f415d64 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:31.449096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98f6bc9f-3e3f-4bf8-a49d-9903d7c4a9cd req-e9f56f29-fb32-42b6-9f62-d22a9f415d64 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0523014 Dec 21 04:29:31.495138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98f6bc9f-3e3f-4bf8-a49d-9903d7c4a9cd req-51f325eb-c79f-4961-bfba-1e3134cfabf6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401709 Dec 21 04:29:32.612123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae038b5-23e3-4d54-a4ba-556dab6e266f req-7cf55685-3582-4a4c-9fa4-a8d5655ed5b7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:32.613636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae038b5-23e3-4d54-a4ba-556dab6e266f req-7cf55685-3582-4a4c-9fa4-a8d5655ed5b7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0489364 Dec 21 04:29:32.660704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae038b5-23e3-4d54-a4ba-556dab6e266f req-ed14dc93-f81b-4e1b-838b-304825453332 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409925 Dec 21 04:29:32.772247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ef119b-8d77-4a90-b380-0c36b6cd17e0 req-c23880df-02c8-45ab-bfbd-fc3824461d87 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:32.773768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9ef119b-8d77-4a90-b380-0c36b6cd17e0 req-c23880df-02c8-45ab-bfbd-fc3824461d87 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0480261 Dec 21 04:29:32.824534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9ef119b-8d77-4a90-b380-0c36b6cd17e0 req-e7f19abc-ccd4-4dbf-8bc2-1fd3db6bfbf0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448995 Dec 21 04:29:32.938676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3aab77-caac-47d1-abfa-6f060fbb514a req-04f50be6-f0e6-4673-a6d9-07add3837edf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:32.940179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff3aab77-caac-47d1-abfa-6f060fbb514a req-04f50be6-f0e6-4673-a6d9-07add3837edf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0480058 Dec 21 04:29:32.986157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff3aab77-caac-47d1-abfa-6f060fbb514a req-113871d3-a4d1-455e-a576-f29865263039 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392683 Dec 21 04:29:33.408474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-822f2b56-a221-43c2-bc2e-e0e523cfac62 req-31eaf94b-5520-4cad-80c3-2782afea3d20 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:33.410457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-822f2b56-a221-43c2-bc2e-e0e523cfac62 req-31eaf94b-5520-4cad-80c3-2782afea3d20 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0490012 Dec 21 04:29:33.456752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-822f2b56-a221-43c2-bc2e-e0e523cfac62 req-c28a0f60-86e7-4a02-ba25-a3dd7e9d0ae4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403571 Dec 21 04:29:34.577389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18562cce-ba1d-4cb1-84ea-2cbc12bec92a req-e9a32824-b08a-4107-8343-5bc99800ac5c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:34.578884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18562cce-ba1d-4cb1-84ea-2cbc12bec92a req-e9a32824-b08a-4107-8343-5bc99800ac5c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0537343 Dec 21 04:29:34.626761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18562cce-ba1d-4cb1-84ea-2cbc12bec92a req-475978c7-5a16-4ada-8500-cf3bbb4eab3f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412087 Dec 21 04:29:35.086900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-866805cd-6aec-47c8-abb4-f971136033fa tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:35.088335 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-866805cd-6aec-47c8-abb4-f971136033fa tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 946 time: 0.0619164 Dec 21 04:29:35.175760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:29:35.176098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:35.506806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:29:35.507205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:35.519525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:29:35.716925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:35.741683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fe086d-2600-4c1c-83a9-5cf66fe96048 req-65708857-2986-46e7-9293-8090c8d1766d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:29:35.743203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15fe086d-2600-4c1c-83a9-5cf66fe96048 req-65708857-2986-46e7-9293-8090c8d1766d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 867 time: 0.0511129 Dec 21 04:29:35.748767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=c0e9f169-b16f-48a4-b4bf-e85b0c8149e3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:29:35.792558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:29:35.795959 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:35.797390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15fe086d-2600-4c1c-83a9-5cf66fe96048 req-7db9a32f-7d5d-4d28-8cd5-5ff9989e4c25 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482025 Dec 21 04:29:35.799453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ece72ce5-4d1d-40a4-91c7-5dfab650d199 req-33a2092b-c585-4a12-88c2-88526d9da74c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "DELETE /v2.0/ports/c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 HTTP/1.1" status: 204 len: 173 time: 0.7050977 Dec 21 04:29:35.799991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'name': 'network-vif-deleted', 'tag': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:29:35.802900 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6e9b7b2-8a9c-4610-8ff7-071ee1ef0605" -d '{"events": [{"server_uuid": "e533131b-57c0-456e-b0e2-ae7bda8b58b0", "name": "network-vif-deleted", "tag": "c0e9f169-b16f-48a4-b4bf-e85b0c8149e3"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:29:35.845125 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:29:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2739fec8-e2f9-40ed-8d4e-9c2913e38cc3 x-openstack-request-id: req-2739fec8-e2f9-40ed-8d4e-9c2913e38cc3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:29:35.845432 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e533131b-57c0-456e-b0e2-ae7bda8b58b0", "name": "network-vif-deleted", "tag": "c0e9f169-b16f-48a4-b4bf-e85b0c8149e3", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:29:35.845692 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2739fec8-e2f9-40ed-8d4e-9c2913e38cc3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:29:35.846100 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e533131b-57c0-456e-b0e2-ae7bda8b58b0', 'name': 'network-vif-deleted', 'tag': 'c0e9f169-b16f-48a4-b4bf-e85b0c8149e3', 'status': 'completed', 'code': 200} Dec 21 04:29:36.898602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-945e7c01-b76f-4045-b2d6-3d2539857333 req-d5375be0-c305-4ad6-927e-8980bac64e58 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.0261869 Dec 21 04:29:37.641894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:29:37.663643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:29:37.664001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c0e9f169-b16f-48a4-b4bf-e85b0c8149e3 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:29:37.997393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6664ad22-5e39-49a0-86c7-6a2da3fe4f28 req-0b7d6ab3-9dc2-47bf-a3b9-7d005cf639c8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.0304441 Dec 21 04:29:39.096141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3f3702d-6579-4036-b424-c21b91d0b98d req-ac44a811-685d-441f-85ee-be1de0520c1c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.0261543 Dec 21 04:29:40.193856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3244cc68-fd18-46c5-8940-20c8c44a7dce req-24b50f49-081c-4716-9c99-8ebb70f5e9a5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=e533131b-57c0-456e-b0e2-ae7bda8b58b0 HTTP/1.1" status: 200 len: 210 time: 0.0269539 Dec 21 04:29:49.888333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c7681a27-ef21-494c-a3e0-418c4a0ceed2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:52.671502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-85cc7337-c9e2-4e9f-b548-713cb72e1959 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:53.142018 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:53.376316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:55.105594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:55.136956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:55.805175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:29:58.887034 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:30:08.156281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-fa3ae7fb-e1c9-4e8d-afa0-a8ac99f83ab6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:08.157635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-fa3ae7fb-e1c9-4e8d-afa0-a8ac99f83ab6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1024663 Dec 21 04:30:08.172004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-4eb41522-0084-4e40-aea7-38167c85e641 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0088122 Dec 21 04:30:08.224329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-80a78293-2417-40f3-bfc4-ead894cc416d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0472760 Dec 21 04:30:08.288023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-3cdc0fdd-0767-497a-be9a-069578ef2d65 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:30:08.289037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-3cdc0fdd-0767-497a-be9a-069578ef2d65 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0583265 Dec 21 04:30:08.377340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-a32e9cc6-adf1-4400-86c2-2969024b1043 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819809 Dec 21 04:30:08.467671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-f1cb6b08-d907-46a3-9066-7c84e56ae551 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838120 Dec 21 04:30:08.747560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-336e1971-95e7-4dc2-985b-6e8c6bc3f117 req-03744b04-7277-47f9-bb2d-0846410fe3b7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0262222 Dec 21 04:30:09.852633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81df13c5-e77c-4949-a99e-52feddc9a013 req-55834116-58ff-4352-bf8f-4cafda65fa34 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0271516 Dec 21 04:30:10.425419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-f0cec530-9281-4219-b764-fbb464f12e5e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:10.426791 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-f0cec530-9281-4219-b764-fbb464f12e5e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1060283 Dec 21 04:30:10.445625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:30:10.637112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:30:10.637112 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:10.765445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.9 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:30:10.911829 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:10.956257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ca82a35-4a47-4a6e-aead-dc0ec23ee89d req-797bfe12-98cc-4f33-a8ce-ae2d4992c933 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0264463 Dec 21 04:30:11.028365 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.071809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:30:11.074921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:30:11.078473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:30:11.115543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:30:11.131373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.131730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.132073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.132468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.132831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.133166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.133511 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.134098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.134741 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.135148 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.138038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.138038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.138038 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:11.159334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:11.160979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.259269 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-84ebd3d5-d976-4747-9320-9106f76eeb4c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8175147 Dec 21 04:30:11.279269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Request body: {'port': {'device_id': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:30:11.338270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.342233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-89fdfcda-f2c8-4228-bd71-e183f72d675b None None] Provisioning complete for port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:30:11.343467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89fdfcda-f2c8-4228-bd71-e183f72d675b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.379834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-89fdfcda-f2c8-4228-bd71-e183f72d675b None None] Port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:30:11.606516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:30:11.614521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.626395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Transition to ACTIVE for port object bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:30:11.688341 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.751037 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Pushing event updated for resources: {'Port': ['ID=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:30:11.824171 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Attempting to bind port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:30:11.824547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Attempting to bind port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:30:11.824820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Attempting to bind port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:30:11.829457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:30:11.829782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Attempting to bind port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:30:11.836332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 29, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:30:11.839126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:30:11.839126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:30:11.839126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Bound port: bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:30:11.839126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:11.912555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] For port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:30:11.915494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] For port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:30:11.982558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:12.016270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.016982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:12.018517 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] 10.222.0.54 "PUT /v2.0/ports/bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b HTTP/1.1" status: 200 len: 1092 time: 0.7437313 Dec 21 04:30:12.019000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'tag': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:30:12.021313 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3eb0d160-ff8a-438d-81ca-34c732f1b239" -d '{"events": [{"name": "network-changed", "server_uuid": "029b96ee-f7b3-473a-9db8-e0757cb8ad3c", "tag": "bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:30:12.062325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8179f6-0e36-45e7-b1f6-363331871146 service neutron] Pushing event updated for resources: {'Port': ['ID=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:30:12.099722 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:30:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec4b97db-5ddf-4838-8fd5-9188f2b893d3 x-openstack-request-id: req-ec4b97db-5ddf-4838-8fd5-9188f2b893d3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:30:12.100009 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "029b96ee-f7b3-473a-9db8-e0757cb8ad3c", "tag": "bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:30:12.100269 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ec4b97db-5ddf-4838-8fd5-9188f2b893d3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:30:12.100707 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'tag': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b', 'status': 'completed', 'code': 200} Dec 21 04:30:12.174164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ec6ad0-d8c3-4bd0-9119-81c4c598971d req-2140b70a-9b29-4191-9785-c4c688257e1f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.185929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ec6ad0-d8c3-4bd0-9119-81c4c598971d req-2140b70a-9b29-4191-9785-c4c688257e1f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0922377 Dec 21 04:30:12.219956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb0d160-ff8a-438d-81ca-34c732f1b239 req-c6777d29-44bd-49c4-b73c-d5d91632131d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.221783 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3eb0d160-ff8a-438d-81ca-34c732f1b239 req-c6777d29-44bd-49c4-b73c-d5d91632131d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 1095 time: 0.0799079 Dec 21 04:30:12.263539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0ec6ad0-d8c3-4bd0-9119-81c4c598971d req-8fa9ba1d-d93f-4a04-9715-dd726dd5ef58 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723364 Dec 21 04:30:12.430538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb0d160-ff8a-438d-81ca-34c732f1b239 req-23d91a00-b6a8-4682-ab0d-669c06c26fe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.432037 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3eb0d160-ff8a-438d-81ca-34c732f1b239 req-23d91a00-b6a8-4682-ab0d-669c06c26fe6 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=58b4b41701714161aa0a78adc3f5ff66&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1965387 Dec 21 04:30:12.601183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb0d160-ff8a-438d-81ca-34c732f1b239 req-9cdde456-ce28-4ac1-ba17-87d6bc04ba7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.602591 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3eb0d160-ff8a-438d-81ca-34c732f1b239 req-9cdde456-ce28-4ac1-ba17-87d6bc04ba7d service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1636059 Dec 21 04:30:12.704101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-7efdc84f-655e-42a7-aeaa-0f533eafa0db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.705713 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-7efdc84f-655e-42a7-aeaa-0f533eafa0db service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 1095 time: 0.0450413 Dec 21 04:30:12.755327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-88998052-df8a-46cb-8a31-03a0a2bb7b1e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b HTTP/1.1" status: 200 len: 217 time: 0.0344660 Dec 21 04:30:12.804877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-7cc33796-5e81-4d8d-a9e9-a64b3c1fcc63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.806347 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-7cc33796-5e81-4d8d-a9e9-a64b3c1fcc63 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0439246 Dec 21 04:30:12.854379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-6874fec5-cfd9-48f7-a3b8-970a550da754 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:12.855802 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-6874fec5-cfd9-48f7-a3b8-970a550da754 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0430808 Dec 21 04:30:12.948805 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-b5125ebd-ee4a-4404-a8a5-5ec3d4caba53 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853701 Dec 21 04:30:13.047959 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-38812308-c689-4e0e-a87f-4b945d4dcf0c req-71663496-00da-43f4-946d-990ed5cd9b78 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850811 Dec 21 04:30:13.377440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97cffad6-06a8-409c-a569-e338cf5a88b0 req-6891b1f9-6965-401c-9827-fd906fdf3e04 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:13.378946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97cffad6-06a8-409c-a569-e338cf5a88b0 req-6891b1f9-6965-401c-9827-fd906fdf3e04 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0482433 Dec 21 04:30:13.435037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97cffad6-06a8-409c-a569-e338cf5a88b0 req-4891f688-eee4-4aec-8dc4-7757f98af15a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493958 Dec 21 04:30:14.558333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab2a41a1-14d8-4e1b-9409-e40bf7abd0d1 req-f749c10b-6f6d-4fae-bee2-f6e7f8709cdc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:14.559832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab2a41a1-14d8-4e1b-9409-e40bf7abd0d1 req-f749c10b-6f6d-4fae-bee2-f6e7f8709cdc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0539002 Dec 21 04:30:14.613391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ab2a41a1-14d8-4e1b-9409-e40bf7abd0d1 req-a61df1d7-250e-4b84-8c88-f7374671aff5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468471 Dec 21 04:30:15.731308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e4d3794-9b81-477e-b3f7-cfd9177484b3 req-554d6b68-df62-4030-923d-c9acc6890fc2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:15.732831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e4d3794-9b81-477e-b3f7-cfd9177484b3 req-554d6b68-df62-4030-923d-c9acc6890fc2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0518637 Dec 21 04:30:15.782638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1e4d3794-9b81-477e-b3f7-cfd9177484b3 req-01d11035-99ac-4a60-b56e-3e878e93d2d4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435886 Dec 21 04:30:16.905534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacb10d-2c04-4b23-9d50-f84af91d8360 req-e795c886-a7d8-42db-bf05-e2274c374a8a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:16.906954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bacb10d-2c04-4b23-9d50-f84af91d8360 req-e795c886-a7d8-42db-bf05-e2274c374a8a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0497999 Dec 21 04:30:16.962909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bacb10d-2c04-4b23-9d50-f84af91d8360 req-57eba952-7856-4c6a-aeac-a9fbc31acb33 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494082 Dec 21 04:30:18.082579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb483f7-a57c-4913-80c7-9e84c9f5c604 req-2487e33e-87b6-493a-8193-837a6044b105 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:18.084093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afb483f7-a57c-4913-80c7-9e84c9f5c604 req-2487e33e-87b6-493a-8193-837a6044b105 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0509460 Dec 21 04:30:18.136863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afb483f7-a57c-4913-80c7-9e84c9f5c604 req-c9ddbc81-d37f-4732-a8fc-3c14377bd749 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434966 Dec 21 04:30:19.261617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae629d30-c086-4fe2-9bd3-699d3b11b775 req-5a358e2e-126b-4236-9e26-458ee966fadf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:19.263141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae629d30-c086-4fe2-9bd3-699d3b11b775 req-5a358e2e-126b-4236-9e26-458ee966fadf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0514109 Dec 21 04:30:19.313112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae629d30-c086-4fe2-9bd3-699d3b11b775 req-f7356fc3-c768-46b8-8d97-a96a11819cda tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428257 Dec 21 04:30:19.912834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b7e33dbe-cdbb-4994-afea-73ee20976fc0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:20.438858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a7fc08-6f8e-4907-8917-d911b4d0db97 req-81266dc5-baf0-4c13-a79d-3a6960f89465 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:20.440371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73a7fc08-6f8e-4907-8917-d911b4d0db97 req-81266dc5-baf0-4c13-a79d-3a6960f89465 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0547726 Dec 21 04:30:20.490227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73a7fc08-6f8e-4907-8917-d911b4d0db97 req-d343ca76-54b3-427b-a9ff-dbf5162846f2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431173 Dec 21 04:30:21.618806 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dd7f56-422b-4814-9163-15b5178a3445 req-090817f7-bcab-4100-bc39-62560af012c6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:21.620346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5dd7f56-422b-4814-9163-15b5178a3445 req-090817f7-bcab-4100-bc39-62560af012c6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0539408 Dec 21 04:30:21.672988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5dd7f56-422b-4814-9163-15b5178a3445 req-7aff7339-effc-4afe-b70d-8fef4450bc0f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464225 Dec 21 04:30:22.665796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-491f1391-21c0-44a5-8b8a-f25e6f0c2887 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:22.800309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af843222-493f-4102-a81b-81b0e75906b8 req-8fa110c8-7b70-4d04-bb7e-714f2e30b3e1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:22.801794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af843222-493f-4102-a81b-81b0e75906b8 req-8fa110c8-7b70-4d04-bb7e-714f2e30b3e1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0521541 Dec 21 04:30:22.854649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af843222-493f-4102-a81b-81b0e75906b8 req-e5d2d392-2368-449b-aa64-f240f79cf143 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462904 Dec 21 04:30:23.122724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:23.368320 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:23.981936 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e340a34-a5cf-4547-af8f-88ab17ea01bd req-d97cb8dc-4ce0-4412-b5d0-4105ec6dd910 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:23.983428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e340a34-a5cf-4547-af8f-88ab17ea01bd req-d97cb8dc-4ce0-4412-b5d0-4105ec6dd910 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0557122 Dec 21 04:30:24.032511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e340a34-a5cf-4547-af8f-88ab17ea01bd req-e7579e8f-0cdc-43ee-8191-360e6d9b63a7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430834 Dec 21 04:30:25.158947 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:25.161363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90bdcdda-2e63-450f-8a8a-358ee0ca1f62 req-e831a993-3bee-409d-ac07-932c1b12c509 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:25.162909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90bdcdda-2e63-450f-8a8a-358ee0ca1f62 req-e831a993-3bee-409d-ac07-932c1b12c509 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0514817 Dec 21 04:30:25.191333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:25.217064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90bdcdda-2e63-450f-8a8a-358ee0ca1f62 req-2765892e-ed4d-4f9f-8762-ef218d6b51ba tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457990 Dec 21 04:30:25.798949 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:26.338547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-463d183c-34df-4cc9-aca5-b98aeb490f63 req-0afa0703-fdf6-4f98-a312-6c7c558805a4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:26.340055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-463d183c-34df-4cc9-aca5-b98aeb490f63 req-0afa0703-fdf6-4f98-a312-6c7c558805a4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0536067 Dec 21 04:30:26.389262 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-463d183c-34df-4cc9-aca5-b98aeb490f63 req-aee0d7f2-5d15-48fb-9948-17f73a36233c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430660 Dec 21 04:30:27.510674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-358c9ed0-2fd0-4b51-9d0a-10f59118ca24 req-dc1ee235-1c00-4a7b-9b23-38d38e37c641 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:27.513075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-358c9ed0-2fd0-4b51-9d0a-10f59118ca24 req-dc1ee235-1c00-4a7b-9b23-38d38e37c641 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0511773 Dec 21 04:30:27.568135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-358c9ed0-2fd0-4b51-9d0a-10f59118ca24 req-c30ff15c-7fa2-49c3-b0dc-975561f7cb36 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475502 Dec 21 04:30:28.687760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a129bdf-5670-4f5f-8fbf-3b69eefdf12d req-c13846dc-e905-465f-a2cd-746788056477 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:28.689225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a129bdf-5670-4f5f-8fbf-3b69eefdf12d req-c13846dc-e905-465f-a2cd-746788056477 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0526667 Dec 21 04:30:28.737327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a129bdf-5670-4f5f-8fbf-3b69eefdf12d req-65ee0c86-eaf7-49a4-b001-914cdc5077d4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415769 Dec 21 04:30:29.852995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03ede0f-177b-499f-9ef8-a54648316e8e req-c7ece870-a634-4ff0-a6bd-e6d03539fe71 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:29.854472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e03ede0f-177b-499f-9ef8-a54648316e8e req-c7ece870-a634-4ff0-a6bd-e6d03539fe71 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0490406 Dec 21 04:30:29.902335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e03ede0f-177b-499f-9ef8-a54648316e8e req-767e3e49-d3d7-49e9-adf8-ee0341c32733 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408800 Dec 21 04:30:31.017572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc542741-bd3f-42ea-ab09-34467d4b5c33 req-81711010-f4e9-4794-8d6b-6c9087bb55e4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:31.019804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc542741-bd3f-42ea-ab09-34467d4b5c33 req-81711010-f4e9-4794-8d6b-6c9087bb55e4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0491881 Dec 21 04:30:31.070415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc542741-bd3f-42ea-ab09-34467d4b5c33 req-9cc2a5d0-d9d1-4457-a0a8-890da231f4c9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446723 Dec 21 04:30:32.184172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b2b31a-2a6e-4a8a-8592-822c1127e1d2 req-f1923fca-2d51-439a-bbce-b872634be1d2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:32.185658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94b2b31a-2a6e-4a8a-8592-822c1127e1d2 req-f1923fca-2d51-439a-bbce-b872634be1d2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0487182 Dec 21 04:30:32.235981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94b2b31a-2a6e-4a8a-8592-822c1127e1d2 req-ddf40b8e-c2a8-4068-9559-2ac26afea0aa tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428329 Dec 21 04:30:33.349925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6648e78f-e1c8-4a75-ba01-a97f0c6e59f1 req-3f55aeba-21ed-4686-8ca9-fca5d68b83b6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:33.351399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6648e78f-e1c8-4a75-ba01-a97f0c6e59f1 req-3f55aeba-21ed-4686-8ca9-fca5d68b83b6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0482595 Dec 21 04:30:33.397603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6648e78f-e1c8-4a75-ba01-a97f0c6e59f1 req-e6cdffe5-be0f-460d-a5fe-38ce551aa103 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403762 Dec 21 04:30:34.514855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2ef398-2f0f-4775-afee-e481b37d2959 req-151dd4b3-2bbf-4848-8a87-c01fd466ca7f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:34.516877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f2ef398-2f0f-4775-afee-e481b37d2959 req-151dd4b3-2bbf-4848-8a87-c01fd466ca7f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0530615 Dec 21 04:30:34.563932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f2ef398-2f0f-4775-afee-e481b37d2959 req-7685793b-1364-4018-a21e-e91cf51e6b52 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410640 Dec 21 04:30:35.681487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2074f5-e8c4-4977-9dfd-c54e9b8b4712 req-361eb9af-d3ee-44b9-9a94-60204b458773 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:35.682958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b2074f5-e8c4-4977-9dfd-c54e9b8b4712 req-361eb9af-d3ee-44b9-9a94-60204b458773 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0477862 Dec 21 04:30:35.730050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b2074f5-e8c4-4977-9dfd-c54e9b8b4712 req-808d224f-95c0-48ca-97ad-9ea9c3ab43c3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411682 Dec 21 04:30:35.885704 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:30:36.844930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec9f88f-a004-4fb0-85dc-15cb4a6ca17b req-8ac7913a-ad63-4eca-adb7-98c1aa1caf87 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:36.847501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eec9f88f-a004-4fb0-85dc-15cb4a6ca17b req-8ac7913a-ad63-4eca-adb7-98c1aa1caf87 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0495160 Dec 21 04:30:36.902090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eec9f88f-a004-4fb0-85dc-15cb4a6ca17b req-fc65a15c-1872-4544-af42-e8cd2c039256 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449562 Dec 21 04:30:38.015902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1617f98-f1fe-445d-9224-3722fc701490 req-ababb138-2d64-4004-84e1-d78f6fbab71b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:38.017900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1617f98-f1fe-445d-9224-3722fc701490 req-ababb138-2d64-4004-84e1-d78f6fbab71b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0484231 Dec 21 04:30:38.065124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1617f98-f1fe-445d-9224-3722fc701490 req-e73a4f62-735d-4641-bbf5-5f5f24e22ae6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412250 Dec 21 04:30:39.191446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb24e52-eb62-4b73-8677-f13eea83672b req-5fe3e48f-9eeb-4a23-8d5c-4077d2ae80d2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:39.192935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cb24e52-eb62-4b73-8677-f13eea83672b req-5fe3e48f-9eeb-4a23-8d5c-4077d2ae80d2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0589092 Dec 21 04:30:39.243264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cb24e52-eb62-4b73-8677-f13eea83672b req-b30d1376-681d-4d48-8c22-e9c3500470ad tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412812 Dec 21 04:30:40.362470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ac4425-7fec-4341-8525-ee967c1be795 req-1de30ed3-e257-4d6b-9b7f-6c57fb2a4c26 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:40.364050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ac4425-7fec-4341-8525-ee967c1be795 req-1de30ed3-e257-4d6b-9b7f-6c57fb2a4c26 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0531945 Dec 21 04:30:40.428532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9ac4425-7fec-4341-8525-ee967c1be795 req-4a3757e9-db74-445b-a399-76202d95623d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568557 Dec 21 04:30:41.540821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79b0b89-83f2-487d-b443-3a8889dbb945 req-0f9c2ec4-a9d0-4643-a136-4528e2c47f97 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:41.542294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b79b0b89-83f2-487d-b443-3a8889dbb945 req-0f9c2ec4-a9d0-4643-a136-4528e2c47f97 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0484555 Dec 21 04:30:41.589694 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b79b0b89-83f2-487d-b443-3a8889dbb945 req-612fd224-1d20-4744-b93d-26b81025e3f6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407636 Dec 21 04:30:42.716457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be6fc760-9aaa-4ee0-a647-fbd319f416c8 req-7fbd3fcf-d726-4979-992c-7be0ba000dd6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:42.717928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be6fc760-9aaa-4ee0-a647-fbd319f416c8 req-7fbd3fcf-d726-4979-992c-7be0ba000dd6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0521398 Dec 21 04:30:42.763522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-be6fc760-9aaa-4ee0-a647-fbd319f416c8 req-0191fb2f-5e23-40c7-98ab-7d02377eb42d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397542 Dec 21 04:30:43.874505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7570a046-80d9-45a3-8f14-c3ffbd413ab7 req-8d59e0e6-3f6f-4101-a089-277afeba6687 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:43.876457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7570a046-80d9-45a3-8f14-c3ffbd413ab7 req-8d59e0e6-3f6f-4101-a089-277afeba6687 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0479832 Dec 21 04:30:43.922314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7570a046-80d9-45a3-8f14-c3ffbd413ab7 req-de0e3788-4a44-4e1b-8a6e-4df014da072b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400231 Dec 21 04:30:45.035096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cd502a7-d6c2-43a0-a606-f9d54d17e5ee req-3687b7a3-8da2-4ee6-af93-0119bb42482e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:45.036561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cd502a7-d6c2-43a0-a606-f9d54d17e5ee req-3687b7a3-8da2-4ee6-af93-0119bb42482e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0477455 Dec 21 04:30:45.085680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9cd502a7-d6c2-43a0-a606-f9d54d17e5ee req-ccca6baf-6739-4a4d-829d-0d9e24dbcb3a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432682 Dec 21 04:30:46.199020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebf87a23-b84c-446a-a40d-7d7436d8419b req-c8a036c2-e666-4493-a830-f6aa390f7e2b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:46.200434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebf87a23-b84c-446a-a40d-7d7436d8419b req-c8a036c2-e666-4493-a830-f6aa390f7e2b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0480368 Dec 21 04:30:46.246301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ebf87a23-b84c-446a-a40d-7d7436d8419b req-0a0817f7-5268-4713-86c6-852662e5113e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398853 Dec 21 04:30:47.357466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c92d4e-809b-4dc9-98b1-8c4557e51c28 req-9a9b61b0-c12d-423c-b81e-03602053aec4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:47.358958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80c92d4e-809b-4dc9-98b1-8c4557e51c28 req-9a9b61b0-c12d-423c-b81e-03602053aec4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 943 time: 0.0479808 Dec 21 04:30:47.405128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80c92d4e-809b-4dc9-98b1-8c4557e51c28 req-5d6b6f7f-a231-446b-ab04-1705f17e1141 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398364 Dec 21 04:30:48.082852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:30:48.174237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:30:48.184337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b', 'mac_address': 'fa:16:3e:d1:8c:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:30:48.221189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:48.236433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:30:48.254942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:30:48.313232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:48.358301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:30:48.365292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.365647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.365997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.366339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.366676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.367034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.367372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.367704 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.368034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.368364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.368688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.369014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.369339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:30:48.524274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe6918a-4b62-4b25-b9d9-2000fa10d134 req-49a1f46b-1cb7-4584-9678-396b56175a07 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:48.525730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fe6918a-4b62-4b25-b9d9-2000fa10d134 req-49a1f46b-1cb7-4584-9678-396b56175a07 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 944 time: 0.0539980 Dec 21 04:30:48.572526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fe6918a-4b62-4b25-b9d9-2000fa10d134 req-4b395ccc-0dda-4708-bd87-5b66199b2746 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407939 Dec 21 04:30:48.588477 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:30:49.685105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41eb111b-c13e-4503-96d5-1e622edfcaee req-e723ad13-ccc4-49f3-84b2-9ca2c2fa1f3f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:49.686546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41eb111b-c13e-4503-96d5-1e622edfcaee req-e723ad13-ccc4-49f3-84b2-9ca2c2fa1f3f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 944 time: 0.0476818 Dec 21 04:30:49.732203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41eb111b-c13e-4503-96d5-1e622edfcaee req-97ea53b5-b6ea-4009-baf0-71e5aeca3452 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397530 Dec 21 04:30:49.900165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-56c00fe1-14e0-44e2-a88d-e4d71974a2d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:50.093528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:30:50.197206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:30:50.201963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:30:50.202420 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:50.276691 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:50.298481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:30:50.300699 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d50e9a0-3e55-4e33-8012-fc3e151fcec3" -d '{"events": [{"server_uuid": "029b96ee-f7b3-473a-9db8-e0757cb8ad3c", "name": "network-vif-plugged", "status": "completed", "tag": "bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:30:50.316816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:30:50.336470 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:30:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1684ea16-8bff-4068-9743-43c26b98e599 x-openstack-request-id: req-1684ea16-8bff-4068-9743-43c26b98e599 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:30:50.336761 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "029b96ee-f7b3-473a-9db8-e0757cb8ad3c", "name": "network-vif-plugged", "status": "completed", "tag": "bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:30:50.337019 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1684ea16-8bff-4068-9743-43c26b98e599 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:30:50.337415 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b', 'code': 200} Dec 21 04:30:50.373808 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:50.420168 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:30:50.469594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbc41a8-9753-4167-924c-d7fde64f046d req-bd3f718f-e665-4ad1-b001-89e5956a8937 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:50.469594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1bbc41a8-9753-4167-924c-d7fde64f046d req-bd3f718f-e665-4ad1-b001-89e5956a8937 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 1097 time: 0.0400965 Dec 21 04:30:50.512303 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1bbc41a8-9753-4167-924c-d7fde64f046d req-3ba0749f-c215-4319-ad01-f60d7bca2a9d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367393 Dec 21 04:30:50.844624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5301b54e-6437-4127-b698-b9275b910f1f req-c60f5ada-20b2-4a0b-96cb-25dd0967815a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:50.846154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5301b54e-6437-4127-b698-b9275b910f1f req-c60f5ada-20b2-4a0b-96cb-25dd0967815a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0477042 Dec 21 04:30:50.897956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5301b54e-6437-4127-b698-b9275b910f1f req-bfda3221-817a-4608-a216-9cb82317ef50 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458081 Dec 21 04:30:52.013270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa95adcf-6bc0-4e7d-9819-cfaba66aab22 req-3b759638-1bda-4685-8302-5b895572ba7a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:52.014714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa95adcf-6bc0-4e7d-9819-cfaba66aab22 req-3b759638-1bda-4685-8302-5b895572ba7a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0477531 Dec 21 04:30:52.060918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa95adcf-6bc0-4e7d-9819-cfaba66aab22 req-a45449e2-634c-4ea3-8ae6-d9f713d52663 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402539 Dec 21 04:30:52.173367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce5a025-1516-46fd-8e59-5e8410f7dc07 req-05d42945-082b-487f-81d4-0f5f2145913d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:52.174824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ce5a025-1516-46fd-8e59-5e8410f7dc07 req-05d42945-082b-487f-81d4-0f5f2145913d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0481741 Dec 21 04:30:52.220928 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ce5a025-1516-46fd-8e59-5e8410f7dc07 req-cd82e5b8-71ad-4c63-8733-319d8fb37dad tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401065 Dec 21 04:30:52.336402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f845402-a3d4-4459-865a-67b98b1a69e0 req-2c5b6e97-0c2f-4d08-896e-86dcead65a67 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:52.337858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f845402-a3d4-4459-865a-67b98b1a69e0 req-2c5b6e97-0c2f-4d08-896e-86dcead65a67 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0512931 Dec 21 04:30:52.383414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f845402-a3d4-4459-865a-67b98b1a69e0 req-9050b1e3-a7a5-44ee-b0b6-9ed8692693c9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397053 Dec 21 04:30:52.648311 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ead8edf-dd95-479a-b26a-52744a0979ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:52.910574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e83cdfd-377c-440b-ada6-8355eef87147 req-ea0f1ee1-2f24-4fee-af80-0be7f3b0b391 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:52.912055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e83cdfd-377c-440b-ada6-8355eef87147 req-ea0f1ee1-2f24-4fee-af80-0be7f3b0b391 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0482514 Dec 21 04:30:52.959882 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e83cdfd-377c-440b-ada6-8355eef87147 req-5c185284-f74e-4f0c-8ca9-4c5a2a942763 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419888 Dec 21 04:30:53.089907 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:53.363763 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:54.077644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711e0d02-7c85-445c-bd99-ca3506c1893e req-d6febf92-5674-42b3-9855-6209355ac2ff tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:54.080647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-711e0d02-7c85-445c-bd99-ca3506c1893e req-d6febf92-5674-42b3-9855-6209355ac2ff tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0542390 Dec 21 04:30:54.130620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-711e0d02-7c85-445c-bd99-ca3506c1893e req-09c7c9a4-5fbf-4186-9708-b830610602fe tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431602 Dec 21 04:30:54.490209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-2f3e3246-d26f-44bf-ba14-41332e267cb8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:30:54.491690 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-2f3e3246-d26f-44bf-ba14-41332e267cb8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 945 time: 0.0551844 Dec 21 04:30:54.582691 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:30:54.583064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:54.667939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:30:54.668300 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:54.680368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:30:54.878549 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:54.908421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:30:54.911253 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:30:54.952464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:30:54.955918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:54.959738 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2030ec40-dc62-48db-89ba-d637d30cad60 req-6f61a52d-fae2-45e6-aa22-2a352ef58b95 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "DELETE /v2.0/ports/bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b HTTP/1.1" status: 204 len: 173 time: 0.4614434 Dec 21 04:30:54.960224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'name': 'network-vif-deleted', 'tag': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:30:54.962480 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2eb15f9-3052-4427-a7ab-db5b5a6f2127" -d '{"events": [{"server_uuid": "029b96ee-f7b3-473a-9db8-e0757cb8ad3c", "name": "network-vif-deleted", "tag": "bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:30:55.003282 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:30:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1795c302-52b6-4a33-820e-0a16245511e7 x-openstack-request-id: req-1795c302-52b6-4a33-820e-0a16245511e7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:30:55.003585 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "029b96ee-f7b3-473a-9db8-e0757cb8ad3c", "name": "network-vif-deleted", "tag": "bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:30:55.003842 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1795c302-52b6-4a33-820e-0a16245511e7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:30:55.004247 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '029b96ee-f7b3-473a-9db8-e0757cb8ad3c', 'name': 'network-vif-deleted', 'tag': 'bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b', 'status': 'completed', 'code': 200} Dec 21 04:30:55.136535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:55.181255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:55.225818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e11f4204-ba09-4b22-a225-e2988051bc40 req-4a8edd84-7fda-4aa8-a1d7-e0ec070e1594 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0261078 Dec 21 04:30:55.792857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:30:56.320611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-81bc5e8c-0faa-479f-980d-c35888b3099a req-c8374e77-d807-4890-9285-6fdfc7d37696 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0271103 Dec 21 04:30:57.412803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8141676e-4075-45ac-a306-190724c63a81 req-468b7bd5-2e46-4c0e-9736-00483201886d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0264211 Dec 21 04:30:58.111234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:30:58.130827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:30:58.131196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bc9bb67f-2a6c-4ac3-90cf-28e1af9b312b not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:30:58.504625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1c3e867-efbd-4ec5-ae24-6044e6dae2d1 req-7902b2e5-10bf-4371-b88e-7045b9dbaf21 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0251400 Dec 21 04:30:59.600875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-421cb49d-a507-4bd6-a10a-150244f5544c req-8c7beeab-7989-45ad-b731-c08c178fb6de tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=029b96ee-f7b3-473a-9db8-e0757cb8ad3c HTTP/1.1" status: 200 len: 210 time: 0.0301170 Dec 21 04:31:12.885332 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:31:19.929750 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-842df3a6-3a0b-4f76-abb3-ee0b42c120d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:22.696007 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-15454ae3-e491-4237-a975-9d1143772e1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:23.164096 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:23.392610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:25.158234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:25.203999 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:25.802997 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:28.217439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-d171a3e4-c47c-406d-b539-15ad2e13a302 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:28.218942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-d171a3e4-c47c-406d-b539-15ad2e13a302 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.0976655 Dec 21 04:31:28.234120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0213e1ff-1d6e-4f2f-87da-dc949aa2f206 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0089161 Dec 21 04:31:28.282092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-29eb5b70-afe5-46c1-a77d-0261286231d5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0422597 Dec 21 04:31:28.373458 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-715dd23a-6058-4f71-8f93-dbb4617f57c6 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840411 Dec 21 04:31:28.471026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c72fef-84fa-4066-b6f4-59de145b4c48 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895274 Dec 21 04:31:29.060374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5f9bb5c-39cc-43ba-9d67-d8909cbfab1f req-bd4eaf1a-3725-497d-8589-c4f0bec8129a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0265608 Dec 21 04:31:30.151009 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5119c7b1-3c83-41a2-8b6e-841a16420e4b req-e33d0a82-b044-426a-b7ab-bfd119299d94 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0259395 Dec 21 04:31:31.024662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-dc614873-04aa-43ea-9d99-547c8081fd83 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:31.026125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-dc614873-04aa-43ea-9d99-547c8081fd83 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1017351 Dec 21 04:31:31.044091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:31:31.246556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6cb61c84-97fe-43d1-9775-198617c53723 req-6e726d45-a07f-45ad-afa1-8250632af41d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0266201 Dec 21 04:31:31.261098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:31:31.265114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:31.389497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.4 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/7c4097a9-6708-494f-a91a-ad822fcaf846) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:31:31.535557 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:31.632563 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:31.681520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:31:31.684559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:31:31.688241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:31:31.713133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=7c4097a9-6708-494f-a91a-ad822fcaf846,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:31.728290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.728637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.728987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.729329 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.729670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.730014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.730345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.730675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.731023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.731352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.731678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.732002 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.732325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:31.755332 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:31:31.759916 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:31.760649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:31.892479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-f6c4ecb1-f515-4182-a49e-26ec5255655a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8519499 Dec 21 04:31:31.910839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Request body: {'port': {'device_id': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:31:31.965249 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:31.979822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e1c3dd15-581e-4eb4-ab6c-834702d54fb8 None None] Provisioning complete for port 7c4097a9-6708-494f-a91a-ad822fcaf846 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:31:31.980801 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e1c3dd15-581e-4eb4-ab6c-834702d54fb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:32.017187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e1c3dd15-581e-4eb4-ab6c-834702d54fb8 None None] Port 7c4097a9-6708-494f-a91a-ad822fcaf846 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:31:32.231595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c4097a9-6708-494f-a91a-ad822fcaf846 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:31:32.239207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:32.250914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Transition to ACTIVE for port object 7c4097a9-6708-494f-a91a-ad822fcaf846 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:31:32.317802 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:32.367763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7fc762-4853-4ed3-80f5-ba25761da66c req-244f969e-7205-460f-82a6-349ee2630b5f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:32.370003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a7fc762-4853-4ed3-80f5-ba25761da66c req-244f969e-7205-460f-82a6-349ee2630b5f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0540979 Dec 21 04:31:32.397602 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Pushing event updated for resources: {'Port': ['ID=7c4097a9-6708-494f-a91a-ad822fcaf846,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:32.431614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a7fc762-4853-4ed3-80f5-ba25761da66c req-920c66e2-f5cc-4e3c-a0eb-be03946571e8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527813 Dec 21 04:31:32.460908 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Attempting to bind port 7c4097a9-6708-494f-a91a-ad822fcaf846 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:31:32.461244 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Attempting to bind port 7c4097a9-6708-494f-a91a-ad822fcaf846 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:31:32.461601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Attempting to bind port 7c4097a9-6708-494f-a91a-ad822fcaf846 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:31:32.466321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Port 7c4097a9-6708-494f-a91a-ad822fcaf846 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:31:32.466750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Attempting to bind port 7c4097a9-6708-494f-a91a-ad822fcaf846 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:31:32.472535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 31, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:31:32.472817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:31:32.473200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:31:32.473630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Bound port: 7c4097a9-6708-494f-a91a-ad822fcaf846, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:31:32.473988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:32.540458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] For port 7c4097a9-6708-494f-a91a-ad822fcaf846, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:31:32.543709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] For port 7c4097a9-6708-494f-a91a-ad822fcaf846, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7c4097a9-6708-494f-a91a-ad822fcaf846,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:31:32.587086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:32.624435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:32.625040 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:32.626389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] 10.222.0.54 "PUT /v2.0/ports/7c4097a9-6708-494f-a91a-ad822fcaf846 HTTP/1.1" status: 200 len: 1092 time: 0.7199113 Dec 21 04:31:32.626835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'tag': '7c4097a9-6708-494f-a91a-ad822fcaf846'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:31:32.629648 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e" -d '{"events": [{"name": "network-changed", "server_uuid": "98b8da6f-2bab-4225-8beb-eb706fa96f70", "tag": "7c4097a9-6708-494f-a91a-ad822fcaf846"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:31:32.661023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9e12b4-afee-4c1e-aae6-375d82321ccf service neutron] Pushing event updated for resources: {'Port': ['ID=7c4097a9-6708-494f-a91a-ad822fcaf846,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:32.689757 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:31:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c20a94e-c0e4-4b7d-9ca5-fa3bb0d43622 x-openstack-request-id: req-5c20a94e-c0e4-4b7d-9ca5-fa3bb0d43622 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:31:32.695568 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98b8da6f-2bab-4225-8beb-eb706fa96f70", "tag": "7c4097a9-6708-494f-a91a-ad822fcaf846", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:31:32.695979 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5c20a94e-c0e4-4b7d-9ca5-fa3bb0d43622 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:31:32.696995 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'tag': '7c4097a9-6708-494f-a91a-ad822fcaf846', 'status': 'completed', 'code': 200} Dec 21 04:31:32.806126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e req-eee04c56-bd9c-4bad-bd95-caaffc277952 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:32.808789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e req-eee04c56-bd9c-4bad-bd95-caaffc277952 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 1095 time: 0.0753570 Dec 21 04:31:32.937589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e req-8f48f680-6fd5-4ee5-ba46-1f29e8a3d316 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:32.939135 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e req-8f48f680-6fd5-4ee5-ba46-1f29e8a3d316 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=58b4b41701714161aa0a78adc3f5ff66&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1153147 Dec 21 04:31:33.051149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e req-2120db69-d642-4c09-ae43-b9502f11b5a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:33.052732 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f3ee5ba5-04c7-4482-9d7c-87e59e96944e req-2120db69-d642-4c09-ae43-b9502f11b5a5 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1067426 Dec 21 04:31:33.408918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-31a8836d-0e31-4d28-82db-db1155f13c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:33.410856 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-31a8836d-0e31-4d28-82db-db1155f13c8b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 1095 time: 0.2994187 Dec 21 04:31:33.458874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-c13026a4-e79b-4c60-9995-bfc918d2ccda service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=7c4097a9-6708-494f-a91a-ad822fcaf846 HTTP/1.1" status: 200 len: 217 time: 0.0338759 Dec 21 04:31:33.510835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-46844706-e3d5-4958-8a76-3b2118426003 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:33.512336 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-46844706-e3d5-4958-8a76-3b2118426003 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0465999 Dec 21 04:31:33.562616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17268a6-08ec-4998-85cf-b0d80087aad4 req-e79e2b09-71cc-4978-bd30-211b9457c1a6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:33.563229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-17d9691e-6df8-4057-8e32-042f9198cd70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:33.564178 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a17268a6-08ec-4998-85cf-b0d80087aad4 req-e79e2b09-71cc-4978-bd30-211b9457c1a6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0557332 Dec 21 04:31:33.567285 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-17d9691e-6df8-4057-8e32-042f9198cd70 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0472026 Dec 21 04:31:33.620224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a17268a6-08ec-4998-85cf-b0d80087aad4 req-41263e22-ae05-401a-a86c-587ec9d458b6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492773 Dec 21 04:31:33.665691 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-9a5cbfec-192b-4152-8768-d54622796988 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0941651 Dec 21 04:31:33.760955 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cca8aa23-161d-48ca-b0d7-973816b9d447 req-3459d771-27fe-4e9d-9fd7-70150a108c52 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875571 Dec 21 04:31:34.740003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f8da60-2dd0-4d56-ac9a-5f3f86cfcbac req-cb83d376-b1cc-4950-b23e-a1913e8d4fa3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:34.741525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04f8da60-2dd0-4d56-ac9a-5f3f86cfcbac req-cb83d376-b1cc-4950-b23e-a1913e8d4fa3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0508399 Dec 21 04:31:34.789624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04f8da60-2dd0-4d56-ac9a-5f3f86cfcbac req-8bb3d2f9-b7cb-4b3c-8578-489cb4674b33 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417762 Dec 21 04:31:35.908322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a699220-ab19-4ffa-8135-58d144750b21 req-50efdd10-07e3-47a7-8eba-7833d1d02741 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:35.909945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a699220-ab19-4ffa-8135-58d144750b21 req-50efdd10-07e3-47a7-8eba-7833d1d02741 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0524147 Dec 21 04:31:35.958276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a699220-ab19-4ffa-8135-58d144750b21 req-acbbfeae-75b5-48b5-8279-ccc6e7b5c600 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419164 Dec 21 04:31:37.071445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844d9a53-b04c-44f0-84d8-d50a5bbba68f req-3ea18547-d519-40b5-bb15-c942045e80b1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:37.072827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-844d9a53-b04c-44f0-84d8-d50a5bbba68f req-3ea18547-d519-40b5-bb15-c942045e80b1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0480423 Dec 21 04:31:37.118725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-844d9a53-b04c-44f0-84d8-d50a5bbba68f req-63ddec2d-4153-4d78-bd31-a761c1594f92 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399921 Dec 21 04:31:38.231762 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-268ff28c-647a-429d-a2c8-26a3fe162e0d req-aa3d96d6-7977-4745-9a8e-abed50778fa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:38.233223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-268ff28c-647a-429d-a2c8-26a3fe162e0d req-aa3d96d6-7977-4745-9a8e-abed50778fa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0489798 Dec 21 04:31:38.282776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-268ff28c-647a-429d-a2c8-26a3fe162e0d req-a99d392c-29bf-4312-9a18-640554e4ef61 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430536 Dec 21 04:31:39.396264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660ee4e6-2de5-4f0a-8bba-9794babab3ea req-57940f96-7a8b-4644-b188-0d0d44bf5253 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:39.397733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-660ee4e6-2de5-4f0a-8bba-9794babab3ea req-57940f96-7a8b-4644-b188-0d0d44bf5253 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0488565 Dec 21 04:31:39.443244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-660ee4e6-2de5-4f0a-8bba-9794babab3ea req-3eecc218-3b98-4670-9ef1-a751d333e53e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395639 Dec 21 04:31:40.562468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df50981-998e-43b1-bc42-4b97fac50cf9 req-d448633c-f401-400f-967a-ca856d183479 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:40.563983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7df50981-998e-43b1-bc42-4b97fac50cf9 req-d448633c-f401-400f-967a-ca856d183479 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0521531 Dec 21 04:31:40.610972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7df50981-998e-43b1-bc42-4b97fac50cf9 req-dc4489ce-10d7-429e-a237-26990dac749f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410223 Dec 21 04:31:41.075545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-8c883142-e244-4aec-b0de-5f07ddebab73 req-006cae28-dae5-4cc9-b3e8-a8eb07457ff4 service neutron] (110310) timed out ('10.222.0.18', 35878) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:31:41.728872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fb3b69-3618-4df4-9174-2988baf4f55c req-757632d5-fd1b-4616-8348-57981e470cf8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:41.730321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fb3b69-3618-4df4-9174-2988baf4f55c req-757632d5-fd1b-4616-8348-57981e470cf8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0520413 Dec 21 04:31:41.780185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43fb3b69-3618-4df4-9174-2988baf4f55c req-f1335744-96dc-4667-8d49-2cf3296efed5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439687 Dec 21 04:31:42.895390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307d0139-5872-48e4-80b8-6eec0addc871 req-71d73290-aade-49ee-8804-c6b5d6088e43 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:42.896909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-307d0139-5872-48e4-80b8-6eec0addc871 req-71d73290-aade-49ee-8804-c6b5d6088e43 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0500405 Dec 21 04:31:42.942551 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-307d0139-5872-48e4-80b8-6eec0addc871 req-3a78d562-4b84-4e4a-a0bd-310aeaae6e3e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398457 Dec 21 04:31:44.052875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70dd07e0-d330-42a9-85c4-472d8caf428d req-1f4726db-f3a9-4b5a-8369-b736bea10950 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:44.054337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70dd07e0-d330-42a9-85c4-472d8caf428d req-1f4726db-f3a9-4b5a-8369-b736bea10950 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 943 time: 0.0479808 Dec 21 04:31:44.103884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70dd07e0-d330-42a9-85c4-472d8caf428d req-db37c759-72df-40b5-bfc2-d77eab3347f0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436523 Dec 21 04:31:44.345429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7c4097a9-6708-494f-a91a-ad822fcaf846 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:31:44.439297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7c4097a9-6708-494f-a91a-ad822fcaf846, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7c4097a9-6708-494f-a91a-ad822fcaf846,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:31:44.450876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '7c4097a9-6708-494f-a91a-ad822fcaf846', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': '7c4097a9-6708-494f-a91a-ad822fcaf846', 'mac_address': 'fa:16:3e:6b:29:3d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:31:44.486523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:44.498664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c4097a9-6708-494f-a91a-ad822fcaf846 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:31:44.517573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7c4097a9-6708-494f-a91a-ad822fcaf846, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7c4097a9-6708-494f-a91a-ad822fcaf846,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:31:44.586229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:44.635233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7c4097a9-6708-494f-a91a-ad822fcaf846,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:44.840872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7c4097a9-6708-494f-a91a-ad822fcaf846'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:31:45.218807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f1a8a28-dd06-486e-9be6-77b5872b38e6 req-ba0da975-027a-485c-99d6-b900b3e37f7f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:45.220628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1a8a28-dd06-486e-9be6-77b5872b38e6 req-ba0da975-027a-485c-99d6-b900b3e37f7f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 944 time: 0.0485423 Dec 21 04:31:45.267221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f1a8a28-dd06-486e-9be6-77b5872b38e6 req-d5a2004c-2138-47ed-8887-1dba903f4c81 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401621 Dec 21 04:31:46.342491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7c4097a9-6708-494f-a91a-ad822fcaf846 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:31:46.386149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a41ad0fe-d8fa-4fc4-ad89-fe38a2a6a2f7 req-80b1ff96-32e9-44f1-b7b8-458d13123deb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:46.388149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a41ad0fe-d8fa-4fc4-ad89-fe38a2a6a2f7 req-80b1ff96-32e9-44f1-b7b8-458d13123deb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 944 time: 0.0537782 Dec 21 04:31:46.437676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a41ad0fe-d8fa-4fc4-ad89-fe38a2a6a2f7 req-15b6a1a2-4d6b-4f86-be94-42a389acd3ec tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410008 Dec 21 04:31:46.494055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 7c4097a9-6708-494f-a91a-ad822fcaf846 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:31:46.498003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 7c4097a9-6708-494f-a91a-ad822fcaf846 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:31:46.498384 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:46.573525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:46.595432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c4097a9-6708-494f-a91a-ad822fcaf846'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:31:46.598201 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec86bf5b-02d1-4acc-b6f8-d1412b97ad2b" -d '{"events": [{"server_uuid": "98b8da6f-2bab-4225-8beb-eb706fa96f70", "name": "network-vif-plugged", "status": "completed", "tag": "7c4097a9-6708-494f-a91a-ad822fcaf846"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:31:46.610560 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 7c4097a9-6708-494f-a91a-ad822fcaf846, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7c4097a9-6708-494f-a91a-ad822fcaf846,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:31:46.636885 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:31:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22b29c25-68ef-4aec-bd66-4b3023bbbe8a x-openstack-request-id: req-22b29c25-68ef-4aec-bd66-4b3023bbbe8a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:31:46.637180 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98b8da6f-2bab-4225-8beb-eb706fa96f70", "name": "network-vif-plugged", "status": "completed", "tag": "7c4097a9-6708-494f-a91a-ad822fcaf846", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:31:46.637466 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-22b29c25-68ef-4aec-bd66-4b3023bbbe8a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:31:46.637864 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c4097a9-6708-494f-a91a-ad822fcaf846', 'code': 200} Dec 21 04:31:46.683619 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:46.738442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=7c4097a9-6708-494f-a91a-ad822fcaf846,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:46.765224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcee810-2a34-4637-b272-1f2eb5e07f1c req-171b3251-e526-479c-8a50-222c25edb5a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:46.766716 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cdcee810-2a34-4637-b272-1f2eb5e07f1c req-171b3251-e526-479c-8a50-222c25edb5a1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 1097 time: 0.0395980 Dec 21 04:31:46.808631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cdcee810-2a34-4637-b272-1f2eb5e07f1c req-a1beb39c-6d24-4855-b3ee-33d7d072f2e9 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352697 Dec 21 04:31:47.557190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9f9ea3-4059-4c19-a838-96ac41a22c5f req-356e4d68-bf4d-491a-8e70-f92c660964dd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:47.558630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9f9ea3-4059-4c19-a838-96ac41a22c5f req-356e4d68-bf4d-491a-8e70-f92c660964dd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 945 time: 0.0511732 Dec 21 04:31:47.605746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9f9ea3-4059-4c19-a838-96ac41a22c5f req-ce2b5ed9-5b98-4298-a7a7-7a6db757ee9d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411670 Dec 21 04:31:48.720291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06787b28-a2b5-424b-a952-133f954cab81 req-d5ade962-2b38-4f66-bac2-fd5c8de8febc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:48.721736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06787b28-a2b5-424b-a952-133f954cab81 req-d5ade962-2b38-4f66-bac2-fd5c8de8febc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 945 time: 0.0483465 Dec 21 04:31:48.767866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06787b28-a2b5-424b-a952-133f954cab81 req-73b2f4ed-cc2c-4918-8cf5-8a7154471cd4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393012 Dec 21 04:31:48.884275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f4280a-5f13-4d41-99b4-9a853db85c2f req-b33a467f-6577-4d4f-9855-fd0b2e9cb8bc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:48.885775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8f4280a-5f13-4d41-99b4-9a853db85c2f req-b33a467f-6577-4d4f-9855-fd0b2e9cb8bc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 945 time: 0.0526369 Dec 21 04:31:48.935604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8f4280a-5f13-4d41-99b4-9a853db85c2f req-62d3f262-5c3a-4564-99eb-ad40fbac1eee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424795 Dec 21 04:31:49.868253 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6de03149-8f7d-492a-8aba-4ad7e2b6bd7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:49.977940 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:31:52.159664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-6d86141e-3d1e-4434-98d2-3493f1b03e16 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:52.161647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-6d86141e-3d1e-4434-98d2-3493f1b03e16 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.0989547 Dec 21 04:31:52.176699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-6ec1cd41-9120-4c78-8c18-caa4903dbb46 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0093687 Dec 21 04:31:52.237432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-564a39d9-00e5-4c63-8b5d-46e1fa5a6559 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0493538 Dec 21 04:31:52.243184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-3c80ea29-eeee-4ef7-b221-3372c5af7c8f service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:31:52.244130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-3c80ea29-eeee-4ef7-b221-3372c5af7c8f service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056562 Dec 21 04:31:52.329689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-5997336f-a4c3-43f9-ae7a-77615ecf4171 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800397 Dec 21 04:31:52.425015 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-29818dce-dfc0-42de-ac60-d9af7f545b70 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888376 Dec 21 04:31:52.636779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2b40d5b0-caa7-4948-a3ad-85a3af71c4a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:52.683803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1a8319f-cff9-43ad-b605-d9fec37d00a7 req-78d519f8-ac3d-4295-a6b1-1f86b49d1f50 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0270543 Dec 21 04:31:53.123264 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:53.374579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:53.775744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16d3925d-c7a0-4c31-bd96-a68bd9dd93e9 req-cfe58f54-a47a-4a75-80a1-83adbce6d995 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0259726 Dec 21 04:31:54.954890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-5d871da9-35d6-4536-aace-f54a0391eea9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:54.956866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-5d871da9-35d6-4536-aace-f54a0391eea9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.3878968 Dec 21 04:31:54.986130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:31:55.117156 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.132938 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47801c24-e20b-4eef-b4c8-4a62cc4df5f3 req-35e499d0-547a-4171-84f0-5542ec28edb0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0263681 Dec 21 04:31:55.186025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:31:55.186190 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.189870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.313217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.8 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/b16bd99e-1fde-431c-8f90-a49f42471e75) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:31:55.464851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.569568 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.605214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7c4097a9-6708-494f-a91a-ad822fcaf846'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:31:55.620366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:31:55.623464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:31:55.627220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:31:55.655544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=b16bd99e-1fde-431c-8f90-a49f42471e75,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:31:55.696615 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:31:55.699912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:55.699912 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.710730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.711120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.711470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.711816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.712156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.712555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.712815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.713146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.713629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.713966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.714295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.714624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.714966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:31:55.772383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-f6e035b1-3f28-4f3f-b864-4eaa71697294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7902350 Dec 21 04:31:55.787514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-083bf33b-b148-4f6d-95ea-cc693f7072a6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:31:55.788530 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-083bf33b-b148-4f6d-95ea-cc693f7072a6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055037 Dec 21 04:31:55.831813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.928369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Request body: {'port': {'device_id': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:31:55.940119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-981424b7-03ed-402a-bdb0-cc41af38801a None None] Provisioning complete for port b16bd99e-1fde-431c-8f90-a49f42471e75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:31:55.940119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-981424b7-03ed-402a-bdb0-cc41af38801a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:55.974742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-981424b7-03ed-402a-bdb0-cc41af38801a None None] Port b16bd99e-1fde-431c-8f90-a49f42471e75 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:31:55.995169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:56.286959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d83d34f1-1785-4d3d-a268-4cf5e3b7d16f req-3462ae32-f4c4-4dbf-8fae-14dabc741af4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:56.288431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d83d34f1-1785-4d3d-a268-4cf5e3b7d16f req-3462ae32-f4c4-4dbf-8fae-14dabc741af4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 931 time: 0.0798328 Dec 21 04:31:56.374970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b16bd99e-1fde-431c-8f90-a49f42471e75 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:31:56.384263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d83d34f1-1785-4d3d-a268-4cf5e3b7d16f req-35911d77-e078-4262-9aaf-d70b56aa13d4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890443 Dec 21 04:31:56.393127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:56.420318 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Transition to ACTIVE for port object b16bd99e-1fde-431c-8f90-a49f42471e75 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:31:56.477813 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:56.558177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Pushing event updated for resources: {'Port': ['ID=b16bd99e-1fde-431c-8f90-a49f42471e75,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:56.632098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Attempting to bind port b16bd99e-1fde-431c-8f90-a49f42471e75 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:31:56.632445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Attempting to bind port b16bd99e-1fde-431c-8f90-a49f42471e75 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:31:56.632830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Attempting to bind port b16bd99e-1fde-431c-8f90-a49f42471e75 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:31:56.637469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Port b16bd99e-1fde-431c-8f90-a49f42471e75 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:31:56.638405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Attempting to bind port b16bd99e-1fde-431c-8f90-a49f42471e75 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:31:56.643720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 31, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:31:56.644067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:31:56.644459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:31:56.644891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Bound port: b16bd99e-1fde-431c-8f90-a49f42471e75, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:31:56.645250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:56.712854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] For port b16bd99e-1fde-431c-8f90-a49f42471e75, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:31:56.715977 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] For port b16bd99e-1fde-431c-8f90-a49f42471e75, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b16bd99e-1fde-431c-8f90-a49f42471e75,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:31:56.775523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:56.814570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:56.815746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:31:56.817671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] 10.222.0.31 "PUT /v2.0/ports/b16bd99e-1fde-431c-8f90-a49f42471e75 HTTP/1.1" status: 200 len: 1092 time: 1.0086679 Dec 21 04:31:56.819942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'tag': 'b16bd99e-1fde-431c-8f90-a49f42471e75'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:31:56.822444 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6" -d '{"events": [{"name": "network-changed", "server_uuid": "5a5e9778-9afc-468a-a5e3-7666b9b83179", "tag": "b16bd99e-1fde-431c-8f90-a49f42471e75"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:31:56.852717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63655aac-2e1e-4725-b794-e5b857b12c65 service neutron] Pushing event updated for resources: {'Port': ['ID=b16bd99e-1fde-431c-8f90-a49f42471e75,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:31:56.977720 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:31:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0a7e687-6355-4d62-957f-4ca9d8038984 x-openstack-request-id: req-d0a7e687-6355-4d62-957f-4ca9d8038984 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:31:56.978074 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5a5e9778-9afc-468a-a5e3-7666b9b83179", "tag": "b16bd99e-1fde-431c-8f90-a49f42471e75", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:31:56.978334 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d0a7e687-6355-4d62-957f-4ca9d8038984 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:31:56.978741 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'tag': 'b16bd99e-1fde-431c-8f90-a49f42471e75', 'status': 'completed', 'code': 200} Dec 21 04:31:56.996023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-d79e4c89-5d55-43ca-bacd-eac82a3fe702 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:56.997801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-d79e4c89-5d55-43ca-bacd-eac82a3fe702 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 1095 time: 0.0494606 Dec 21 04:31:57.049920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-a3fcfddf-4b6b-4c48-ab93-8fdf04f7b9c1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b16bd99e-1fde-431c-8f90-a49f42471e75 HTTP/1.1" status: 200 len: 217 time: 0.0377600 Dec 21 04:31:57.101733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-a770af9d-e539-4db5-82b7-8a5c79816e1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.103110 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-a770af9d-e539-4db5-82b7-8a5c79816e1b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0439544 Dec 21 04:31:57.159847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-0e26c8bf-976b-413c-a6bf-a8fae391f8d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.161415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-0e26c8bf-976b-413c-a6bf-a8fae391f8d2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0473397 Dec 21 04:31:57.256526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-95f2c158-94a5-4d85-8626-7728722bf01e service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832961 Dec 21 04:31:57.353695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1699ff9b-f555-4e80-9c82-32c45344ad40 req-2c367dac-0f9c-4d8f-a9e6-1eeb34ff9841 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858674 Dec 21 04:31:57.515888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61c9ea6a-498c-4527-9743-e42b68462fde req-98f970db-8a7a-4cb1-82a4-c8140a73af03 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.517374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61c9ea6a-498c-4527-9743-e42b68462fde req-98f970db-8a7a-4cb1-82a4-c8140a73af03 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0619233 Dec 21 04:31:57.593102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-1e041d32-2662-41fc-9374-5bea97237b1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.594597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-1e041d32-2662-41fc-9374-5bea97237b1b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 1095 time: 0.0763588 Dec 21 04:31:57.598311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61c9ea6a-498c-4527-9743-e42b68462fde req-eba1ca68-1a6a-4907-87b8-3ada75dea8fd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721567 Dec 21 04:31:57.770634 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-c4cc4e0f-3962-4a3e-8f44-102567f20984 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.772146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-c4cc4e0f-3962-4a3e-8f44-102567f20984 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.1646528 Dec 21 04:31:57.818000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-10bccf8d-b2ff-46cb-928b-7dd06d512031 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b16bd99e-1fde-431c-8f90-a49f42471e75 HTTP/1.1" status: 200 len: 217 time: 0.0348523 Dec 21 04:31:57.870153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-e9fa0363-3578-44a1-afd3-eb674227f250 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.871615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-e9fa0363-3578-44a1-afd3-eb674227f250 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0434999 Dec 21 04:31:57.927902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-5cdd4aef-c32a-4de8-989b-d81016acb3da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:57.929398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-5cdd4aef-c32a-4de8-989b-d81016acb3da service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0451825 Dec 21 04:31:58.024122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-0e906955-9f56-4b81-a2ca-8d3fc28aee45 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836096 Dec 21 04:31:58.125792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dbaf4832-2776-4b63-9370-d5e9ef1b8da6 req-0cf20821-720f-42bc-98c8-bd2fada5d00c service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0906625 Dec 21 04:31:58.727946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf9ec20-1a53-4268-9d0c-d241695d7bbc req-c414490b-3a88-41d9-8305-e99b53c2f0f3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:58.729505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbf9ec20-1a53-4268-9d0c-d241695d7bbc req-c414490b-3a88-41d9-8305-e99b53c2f0f3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0547667 Dec 21 04:31:58.780830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cbf9ec20-1a53-4268-9d0c-d241695d7bbc req-6dfc1499-d960-4ef0-afaf-682227bd5c06 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440743 Dec 21 04:31:59.902687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efe061f-8c24-4d4f-91f4-7fc86cc8f786 req-76e50abc-d0ce-423e-a5f5-214eb36a2170 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:31:59.904158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8efe061f-8c24-4d4f-91f4-7fc86cc8f786 req-76e50abc-d0ce-423e-a5f5-214eb36a2170 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0520506 Dec 21 04:31:59.961904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8efe061f-8c24-4d4f-91f4-7fc86cc8f786 req-a7cd0080-1e5b-485b-b1f1-723ec63770d3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518177 Dec 21 04:32:01.081194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9746f34d-5a7c-4886-8a94-10e6d9712213 req-6e1c5fb6-daf6-4ead-83f9-8a57a8f75dc3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:01.085267 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9746f34d-5a7c-4886-8a94-10e6d9712213 req-6e1c5fb6-daf6-4ead-83f9-8a57a8f75dc3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0531738 Dec 21 04:32:01.135075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9746f34d-5a7c-4886-8a94-10e6d9712213 req-5f6bfa26-f38d-47d6-908b-2d4a3405e25c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448558 Dec 21 04:32:02.257622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17727948-aabc-4da6-a548-0bdd46552c1f req-18091425-13fc-4355-9993-32c3409e1e6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:02.259196 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17727948-aabc-4da6-a548-0bdd46552c1f req-18091425-13fc-4355-9993-32c3409e1e6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0499976 Dec 21 04:32:02.308504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17727948-aabc-4da6-a548-0bdd46552c1f req-21ecc5a4-2857-484b-b59c-4e385f4489dd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433164 Dec 21 04:32:03.438873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba749e13-105d-4ea1-8573-d496432ecc17 req-d14764de-d73e-479d-81ea-650745eabba1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:03.440401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba749e13-105d-4ea1-8573-d496432ecc17 req-d14764de-d73e-479d-81ea-650745eabba1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0571258 Dec 21 04:32:03.493768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba749e13-105d-4ea1-8573-d496432ecc17 req-ca2de68a-2803-458e-bcca-274f93a71b3f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469470 Dec 21 04:32:04.625150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29e5709-ba52-4101-949b-5ddc829fc50d req-2ba5ae74-09d0-402e-97f5-99ef841ccfd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:04.627032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a29e5709-ba52-4101-949b-5ddc829fc50d req-2ba5ae74-09d0-402e-97f5-99ef841ccfd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0569096 Dec 21 04:32:04.676788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a29e5709-ba52-4101-949b-5ddc829fc50d req-3d4e5eb2-f72b-4f63-9021-252ffed161db tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431702 Dec 21 04:32:05.806229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-678a0778-40dd-4609-9bad-e523088cbe89 req-e22b7e69-841c-40c5-85ad-6a12592875a3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:05.808575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-678a0778-40dd-4609-9bad-e523088cbe89 req-e22b7e69-841c-40c5-85ad-6a12592875a3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0591853 Dec 21 04:32:05.864503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-678a0778-40dd-4609-9bad-e523088cbe89 req-55c50c65-d255-4059-981a-d910a62137c3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498953 Dec 21 04:32:07.014248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d629be0d-a833-4a42-909b-b39448ea9ec4 req-b174b428-64dd-4c9d-b1f3-97a417dfee99 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:07.015773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d629be0d-a833-4a42-909b-b39448ea9ec4 req-b174b428-64dd-4c9d-b1f3-97a417dfee99 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0529299 Dec 21 04:32:07.068490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d629be0d-a833-4a42-909b-b39448ea9ec4 req-9fe3a297-773e-4dde-9218-70c7c3aa19d0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464249 Dec 21 04:32:08.196060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5590dc1-e4e4-4888-bf4d-5f438a1035e9 req-87bdbdd0-f75b-4d31-b377-bb83188cbada tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:08.197870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5590dc1-e4e4-4888-bf4d-5f438a1035e9 req-87bdbdd0-f75b-4d31-b377-bb83188cbada tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0566399 Dec 21 04:32:08.262088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5590dc1-e4e4-4888-bf4d-5f438a1035e9 req-381923da-b08f-43d8-be09-eca402311415 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551515 Dec 21 04:32:09.377203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-ac719e58-46da-41af-9b2d-0dbbf310cd5b req-dbdeaced-465b-4f76-9d6f-0d141bcb61a6 service neutron] (110310) timed out ('10.222.0.18', 43758) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:32:09.387047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb72d18-78b8-4238-995c-153f9f6d1cac req-79568a80-052b-432e-acee-5c8f5e2c1c64 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:09.389114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cb72d18-78b8-4238-995c-153f9f6d1cac req-79568a80-052b-432e-acee-5c8f5e2c1c64 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0578380 Dec 21 04:32:09.440056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cb72d18-78b8-4238-995c-153f9f6d1cac req-d77ffb27-264a-4328-81fa-03b8cd44fa63 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444589 Dec 21 04:32:10.561383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cacefaf-c176-45bf-bb42-9aaaf762a71f req-3e69cbb4-2c2c-4d23-8b4a-edb7b7324c48 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:10.562779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cacefaf-c176-45bf-bb42-9aaaf762a71f req-3e69cbb4-2c2c-4d23-8b4a-edb7b7324c48 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0502379 Dec 21 04:32:10.609977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cacefaf-c176-45bf-bb42-9aaaf762a71f req-6861776c-e73b-4e27-9fd2-eddb36c74cfd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411406 Dec 21 04:32:11.733668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c20ee-3865-46c8-ba23-347344e29385 req-f23fbb1f-6e76-4e43-8170-8bcb151dbbb3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:11.735167 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba4c20ee-3865-46c8-ba23-347344e29385 req-f23fbb1f-6e76-4e43-8170-8bcb151dbbb3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0561898 Dec 21 04:32:11.783798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ba4c20ee-3865-46c8-ba23-347344e29385 req-4cf0862a-c3c8-44c2-b017-cee6ffb7fb23 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425680 Dec 21 04:32:12.901794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98d39c1-506a-42b0-b985-c3b9ec087992 req-be2ce4d1-3dc1-4699-8771-955e507455bd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:12.903234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f98d39c1-506a-42b0-b985-c3b9ec087992 req-be2ce4d1-3dc1-4699-8771-955e507455bd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0496469 Dec 21 04:32:12.957798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f98d39c1-506a-42b0-b985-c3b9ec087992 req-a5473351-ce31-40cf-ba02-883df7aed819 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481594 Dec 21 04:32:14.080186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d9719d-85ec-46f0-b55f-728b91861108 req-e71bae9e-cc15-44e6-86fa-1546aa6f04e0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:14.081667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00d9719d-85ec-46f0-b55f-728b91861108 req-e71bae9e-cc15-44e6-86fa-1546aa6f04e0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0506287 Dec 21 04:32:14.133505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00d9719d-85ec-46f0-b55f-728b91861108 req-19706057-bea8-496d-958b-d1594202dad6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458755 Dec 21 04:32:15.249619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50102484-91c3-4cf9-aaa4-435c42c8d2f0 req-e83ad880-ba82-4cdd-bcdf-c1cb628f9734 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:15.251137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50102484-91c3-4cf9-aaa4-435c42c8d2f0 req-e83ad880-ba82-4cdd-bcdf-c1cb628f9734 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0496118 Dec 21 04:32:15.298514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50102484-91c3-4cf9-aaa4-435c42c8d2f0 req-3874beb1-dd43-4082-8f45-9e8167f65b73 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414135 Dec 21 04:32:16.419051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c9ac6a-1526-460f-9b9e-cb02adfb258d req-6608b9b7-1341-473e-bc90-dcf8aac92551 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:16.420539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2c9ac6a-1526-460f-9b9e-cb02adfb258d req-6608b9b7-1341-473e-bc90-dcf8aac92551 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0499299 Dec 21 04:32:16.468165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2c9ac6a-1526-460f-9b9e-cb02adfb258d req-7d909361-47a0-4b9b-b33c-c55a6b203c7c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415573 Dec 21 04:32:17.592242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978afd66-60c4-48a6-9910-6785001b06a7 req-dc52ca51-1659-45d8-a5d5-4d569bdb692c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:17.593712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-978afd66-60c4-48a6-9910-6785001b06a7 req-dc52ca51-1659-45d8-a5d5-4d569bdb692c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0562272 Dec 21 04:32:17.646835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-978afd66-60c4-48a6-9910-6785001b06a7 req-0bfa7aa8-9624-4354-8742-6b57246b4667 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467532 Dec 21 04:32:18.764302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430d0fd3-80a2-42a5-9c0c-5efcc861e772 req-7dea371a-3b3b-484f-98cb-4d907621d066 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:18.765828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-430d0fd3-80a2-42a5-9c0c-5efcc861e772 req-7dea371a-3b3b-484f-98cb-4d907621d066 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0490971 Dec 21 04:32:18.812290 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-430d0fd3-80a2-42a5-9c0c-5efcc861e772 req-1eb2ef71-bcf6-4922-8e52-2c91e293a424 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405188 Dec 21 04:32:19.892727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3ac6cf67-9a99-49a6-9a49-6bfb3835a853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:19.935246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5125aaff-ab26-44e1-a1ae-6219bccb341f req-3aaec2ac-1348-4457-809c-bfbf4c314bfb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:19.936726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5125aaff-ab26-44e1-a1ae-6219bccb341f req-3aaec2ac-1348-4457-809c-bfbf4c314bfb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0527217 Dec 21 04:32:19.984793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5125aaff-ab26-44e1-a1ae-6219bccb341f req-0d06e39b-f118-465f-8f79-eae7a9cf9316 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414650 Dec 21 04:32:21.107504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c4578c-2244-427c-8c06-7efa7303859f req-c950bcdf-9ce2-4d11-9dcb-a1bdd47f82d6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:21.109036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14c4578c-2244-427c-8c06-7efa7303859f req-c950bcdf-9ce2-4d11-9dcb-a1bdd47f82d6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0552866 Dec 21 04:32:21.156975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14c4578c-2244-427c-8c06-7efa7303859f req-d5abb269-db1e-4df1-94fa-72287312b2ee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412467 Dec 21 04:32:22.273862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df243070-ef34-4319-b67b-9713ead0375e req-eaaec621-fcba-4e69-a685-ae5f01823b68 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:22.275425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df243070-ef34-4319-b67b-9713ead0375e req-eaaec621-fcba-4e69-a685-ae5f01823b68 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0490413 Dec 21 04:32:22.329413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-df243070-ef34-4319-b67b-9713ead0375e req-2084e4e3-effd-4a8f-b87b-5a6d2b06e037 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479913 Dec 21 04:32:22.694845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-05a8f116-5c78-4423-aad7-b31cce55c10e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:23.134071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:23.397421 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:23.443774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1315f59-01e3-44e3-b90f-49eb107c65a8 req-2a87526a-9e05-4c46-bf63-88b923509556 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:23.445235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1315f59-01e3-44e3-b90f-49eb107c65a8 req-2a87526a-9e05-4c46-bf63-88b923509556 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0481389 Dec 21 04:32:23.494367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1315f59-01e3-44e3-b90f-49eb107c65a8 req-a12cbc2e-4e0a-4f8a-9e34-a919f7286d6b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421731 Dec 21 04:32:24.611109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e1402f-a600-4c64-87e6-eb6fd5aaa289 req-2408741b-f1e0-444c-bb75-f409dac0f7ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:24.612591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61e1402f-a600-4c64-87e6-eb6fd5aaa289 req-2408741b-f1e0-444c-bb75-f409dac0f7ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0489020 Dec 21 04:32:24.660744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-61e1402f-a600-4c64-87e6-eb6fd5aaa289 req-5c6e0cdb-235e-427a-b47d-f098af9f95c8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419447 Dec 21 04:32:25.157148 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:25.185841 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:25.477943 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-c032d730-7d8d-477a-b970-0e0d185e820c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0432632 Dec 21 04:32:25.573078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-1b4c7838-c99d-4b0e-ac2d-c94698d3ab91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:25.574575 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-1b4c7838-c99d-4b0e-ac2d-c94698d3ab91 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 1097 time: 0.0395086 Dec 21 04:32:25.679536 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-4c6c6444-59c4-4da1-aa2e-e018f92d8c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:25.680976 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-4c6c6444-59c4-4da1-aa2e-e018f92d8c67 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0855269 Dec 21 04:32:25.733955 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-31755d94-77a7-45ed-9d4d-506aafdf1731 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=7c4097a9-6708-494f-a91a-ad822fcaf846 HTTP/1.1" status: 200 len: 217 time: 0.0459361 Dec 21 04:32:25.783115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aaac82e-d08b-4f78-87df-1304ed509288 req-cd048ece-31a2-46e3-b78b-c913c50788ae tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:25.784660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aaac82e-d08b-4f78-87df-1304ed509288 req-cd048ece-31a2-46e3-b78b-c913c50788ae tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0535910 Dec 21 04:32:25.786087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-9d7c70fa-f343-4784-bc00-015869517147 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:25.787550 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-9d7c70fa-f343-4784-bc00-015869517147 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0466816 Dec 21 04:32:25.797268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:25.834589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-e8c0679c-bbfc-4a9a-8bff-83ca8c362039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:25.836202 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-e8c0679c-bbfc-4a9a-8bff-83ca8c362039 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0415292 Dec 21 04:32:25.837095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aaac82e-d08b-4f78-87df-1304ed509288 req-d5bc5766-a4e9-4bdd-8990-421ce43ad076 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442071 Dec 21 04:32:25.929450 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-a9566f7c-bc28-4c38-8415-6ecb2488db79 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851471 Dec 21 04:32:26.022479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1ea28de-743f-47ce-bfcd-34d79711d249 req-c223e0fe-9924-43ee-928a-564b3093428f service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848327 Dec 21 04:32:26.886961 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:32:26.961491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91e6bcd-dd3b-4081-bd47-179f7562dc8a req-475c541f-9bd3-41bb-ade1-78d8e7affd4d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:26.963073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c91e6bcd-dd3b-4081-bd47-179f7562dc8a req-475c541f-9bd3-41bb-ade1-78d8e7affd4d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0565658 Dec 21 04:32:27.019529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c91e6bcd-dd3b-4081-bd47-179f7562dc8a req-c5cd075a-357c-4c87-8549-5eb1d446ff42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497367 Dec 21 04:32:28.137494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d6d20c-3598-4d66-ab49-5d7382c7a4e1 req-3812728d-cc5c-4bc6-b30c-39b2e8783cbe tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:28.139118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11d6d20c-3598-4d66-ab49-5d7382c7a4e1 req-3812728d-cc5c-4bc6-b30c-39b2e8783cbe tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0493877 Dec 21 04:32:28.190054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11d6d20c-3598-4d66-ab49-5d7382c7a4e1 req-22f55732-896e-44b8-bb08-72dc9ceff9fa tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447550 Dec 21 04:32:29.305252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb610a8-a066-4613-a0eb-c15901d00a74 req-d40b5c96-b587-48f1-af21-0eb605cbeb5e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:29.306727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feb610a8-a066-4613-a0eb-c15901d00a74 req-d40b5c96-b587-48f1-af21-0eb605cbeb5e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0488155 Dec 21 04:32:29.354470 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-feb610a8-a066-4613-a0eb-c15901d00a74 req-a9127b7d-642f-4c9a-9e1f-060c35483e28 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410116 Dec 21 04:32:30.482676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad95de69-2a98-4b17-b060-273601c49aed req-8cd655ff-fd10-4f36-aceb-fb8df2918392 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:30.483269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad95de69-2a98-4b17-b060-273601c49aed req-8cd655ff-fd10-4f36-aceb-fb8df2918392 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0542362 Dec 21 04:32:30.532451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad95de69-2a98-4b17-b060-273601c49aed req-1bf78a88-8b70-4c77-ac58-b1e7e28b25de tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424688 Dec 21 04:32:31.657784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5341962-4b84-4f3d-8d71-0a25ceca2a12 req-764d57e8-449a-47ba-a7d2-770f93ac414b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:31.659324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5341962-4b84-4f3d-8d71-0a25ceca2a12 req-764d57e8-449a-47ba-a7d2-770f93ac414b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0589967 Dec 21 04:32:31.708122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5341962-4b84-4f3d-8d71-0a25ceca2a12 req-6ec7bca3-916e-4430-81c7-049469b5f391 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425434 Dec 21 04:32:32.825695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3916609d-edef-4203-8703-53f15f9ac1e1 req-0ca5e80e-683c-45db-a807-60f28a891694 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:32.827224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3916609d-edef-4203-8703-53f15f9ac1e1 req-0ca5e80e-683c-45db-a807-60f28a891694 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0499637 Dec 21 04:32:32.874634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3916609d-edef-4203-8703-53f15f9ac1e1 req-94f91711-0f7f-4174-9c48-b9716c764f1e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414100 Dec 21 04:32:33.993160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e2e9b00-119b-4002-930a-0d1cbd475012 req-8ae01ded-2134-4e80-be9c-0bce0972abf1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:33.994614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e2e9b00-119b-4002-930a-0d1cbd475012 req-8ae01ded-2134-4e80-be9c-0bce0972abf1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0513663 Dec 21 04:32:34.041632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6e2e9b00-119b-4002-930a-0d1cbd475012 req-f54e19bb-62f0-4ea4-8806-7dfdecb9a460 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402904 Dec 21 04:32:35.161216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f3d8f6-d527-478d-bf7b-ed887a3a0574 req-c83d8537-4d25-4173-83b9-d8c43eed627d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:35.162857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1f3d8f6-d527-478d-bf7b-ed887a3a0574 req-c83d8537-4d25-4173-83b9-d8c43eed627d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0513463 Dec 21 04:32:35.209745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1f3d8f6-d527-478d-bf7b-ed887a3a0574 req-cc2a8dfe-3096-4551-92e2-26858d458886 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409977 Dec 21 04:32:36.324123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b68b74-d182-46b6-8157-c139375e0f6b req-e3792060-6d68-4e31-9934-99f3b4c4280c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:36.325564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04b68b74-d182-46b6-8157-c139375e0f6b req-e3792060-6d68-4e31-9934-99f3b4c4280c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0476971 Dec 21 04:32:36.380113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04b68b74-d182-46b6-8157-c139375e0f6b req-d2e2d43c-856d-41f9-a5eb-f6e2082fd3b9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479529 Dec 21 04:32:37.496346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e16911c-1284-4107-8e26-f027cb4179dc req-9e3f9fa6-499f-4da5-baba-a9b30537caad tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:37.497834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e16911c-1284-4107-8e26-f027cb4179dc req-9e3f9fa6-499f-4da5-baba-a9b30537caad tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0488930 Dec 21 04:32:37.545219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e16911c-1284-4107-8e26-f027cb4179dc req-539392ea-ddde-4584-9760-1a5712674b76 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411165 Dec 21 04:32:38.662385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f67dce7-676f-4882-b5b4-71466bcb2d19 req-99e136fe-d892-44b8-8c32-b6d641ce570a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:38.663883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f67dce7-676f-4882-b5b4-71466bcb2d19 req-99e136fe-d892-44b8-8c32-b6d641ce570a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0473650 Dec 21 04:32:38.710520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f67dce7-676f-4882-b5b4-71466bcb2d19 req-f6ef3199-db79-47e9-a28c-fc322aeafc78 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407100 Dec 21 04:32:39.830410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576f1b52-185e-442a-95f4-482fda688361 req-dc9aaa9e-b9c0-407c-aa35-388a321f0d3f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:39.831907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-576f1b52-185e-442a-95f4-482fda688361 req-dc9aaa9e-b9c0-407c-aa35-388a321f0d3f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0544744 Dec 21 04:32:39.877879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-576f1b52-185e-442a-95f4-482fda688361 req-84ca8e34-45cf-4050-9932-b02a9e8a1a78 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399106 Dec 21 04:32:40.997909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa721de7-769a-41a0-973b-56615897c2d0 req-fb5231ab-8ce4-45bd-9457-8838968658dc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:40.999753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa721de7-769a-41a0-973b-56615897c2d0 req-fb5231ab-8ce4-45bd-9457-8838968658dc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 943 time: 0.0535026 Dec 21 04:32:41.048165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa721de7-769a-41a0-973b-56615897c2d0 req-95caa68d-9464-4313-b582-91ae1afa1736 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422697 Dec 21 04:32:41.346082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b16bd99e-1fde-431c-8f90-a49f42471e75 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:32:41.440977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b16bd99e-1fde-431c-8f90-a49f42471e75, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b16bd99e-1fde-431c-8f90-a49f42471e75,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:32:41.451300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b16bd99e-1fde-431c-8f90-a49f42471e75', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': 'b16bd99e-1fde-431c-8f90-a49f42471e75', 'mac_address': 'fa:16:3e:d4:fa:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:32:41.487408 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:41.500032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b16bd99e-1fde-431c-8f90-a49f42471e75 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:32:41.519878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b16bd99e-1fde-431c-8f90-a49f42471e75, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b16bd99e-1fde-431c-8f90-a49f42471e75,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:32:41.568305 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:41.614377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b16bd99e-1fde-431c-8f90-a49f42471e75,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:32:41.621546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.621897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.623444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.623444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.623444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.623444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.623767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.623877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.624201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.624527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.624851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.625175 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.625503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:32:41.971628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b16bd99e-1fde-431c-8f90-a49f42471e75'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:32:42.162694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3621e3f8-a135-4804-bea3-cc46dc16c9fb req-3e1eb95d-be07-4e83-8fd2-44d180590f2c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:42.164185 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3621e3f8-a135-4804-bea3-cc46dc16c9fb req-3e1eb95d-be07-4e83-8fd2-44d180590f2c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 944 time: 0.0483086 Dec 21 04:32:42.214689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3621e3f8-a135-4804-bea3-cc46dc16c9fb req-33d2e196-f85a-4ac2-897b-4be8d9cbc521 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446248 Dec 21 04:32:43.334799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5750dd3e-0b6e-4d40-ac57-23c36493f31a req-c64ea8c9-2792-44bf-8a5c-d2e5ca81dfd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:43.336287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5750dd3e-0b6e-4d40-ac57-23c36493f31a req-c64ea8c9-2792-44bf-8a5c-d2e5ca81dfd8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 944 time: 0.0485685 Dec 21 04:32:43.346057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b16bd99e-1fde-431c-8f90-a49f42471e75 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:32:43.384733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5750dd3e-0b6e-4d40-ac57-23c36493f31a req-24784301-2b9d-483e-9756-532dbb89bf90 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425153 Dec 21 04:32:43.471869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port b16bd99e-1fde-431c-8f90-a49f42471e75 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:32:43.475932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b16bd99e-1fde-431c-8f90-a49f42471e75 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:32:43.476277 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:43.555303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:43.577610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b16bd99e-1fde-431c-8f90-a49f42471e75'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:32:43.579845 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c06f33b-d197-4e70-978d-db586ad06135" -d '{"events": [{"server_uuid": "5a5e9778-9afc-468a-a5e3-7666b9b83179", "name": "network-vif-plugged", "status": "completed", "tag": "b16bd99e-1fde-431c-8f90-a49f42471e75"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:32:43.592322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b16bd99e-1fde-431c-8f90-a49f42471e75, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b16bd99e-1fde-431c-8f90-a49f42471e75,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:32:43.619351 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:32:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fae67589-52ca-4bb3-9be4-ef4dc8f607df x-openstack-request-id: req-fae67589-52ca-4bb3-9be4-ef4dc8f607df {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:32:43.622747 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5a5e9778-9afc-468a-a5e3-7666b9b83179", "name": "network-vif-plugged", "status": "completed", "tag": "b16bd99e-1fde-431c-8f90-a49f42471e75", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:32:43.622747 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fae67589-52ca-4bb3-9be4-ef4dc8f607df {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:32:43.622747 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b16bd99e-1fde-431c-8f90-a49f42471e75', 'code': 200} Dec 21 04:32:43.631127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:43.678777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b16bd99e-1fde-431c-8f90-a49f42471e75,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:32:43.767132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54205598-fb49-4414-8942-4a4215c1fe1e req-6dcebe93-642a-41f2-99a3-e6d546f09178 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:43.769234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54205598-fb49-4414-8942-4a4215c1fe1e req-6dcebe93-642a-41f2-99a3-e6d546f09178 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 1097 time: 0.0399034 Dec 21 04:32:43.813461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54205598-fb49-4414-8942-4a4215c1fe1e req-9c84db9e-91f6-4aa1-b54d-d4a40d14d053 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360436 Dec 21 04:32:44.504104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef87cd37-6b63-4f46-ac56-f58c048c491b req-fae40a58-5780-47b6-b8bc-a4f4d1305800 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:44.505801 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef87cd37-6b63-4f46-ac56-f58c048c491b req-fae40a58-5780-47b6-b8bc-a4f4d1305800 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 945 time: 0.0523479 Dec 21 04:32:44.552636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef87cd37-6b63-4f46-ac56-f58c048c491b req-d6d2ffa6-9d46-47b5-90ef-a89c26d7c982 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405755 Dec 21 04:32:45.673511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c99eab-a182-4e5a-9734-152e93a1fb82 req-9c924771-5a41-4cd0-83e8-4353be29db98 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:45.675023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28c99eab-a182-4e5a-9734-152e93a1fb82 req-9c924771-5a41-4cd0-83e8-4353be29db98 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 945 time: 0.0483041 Dec 21 04:32:45.723557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28c99eab-a182-4e5a-9734-152e93a1fb82 req-bf9bb60a-8cf8-4c64-b829-40ba4188ce66 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424736 Dec 21 04:32:45.841924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edcba1cf-cf89-4531-86e8-ec8466887e11 req-dbd99b71-2fb1-4114-9b1e-dc27c724ce5c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:45.843324 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edcba1cf-cf89-4531-86e8-ec8466887e11 req-dbd99b71-2fb1-4114-9b1e-dc27c724ce5c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 945 time: 0.0515044 Dec 21 04:32:46.153247 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edcba1cf-cf89-4531-86e8-ec8466887e11 req-52f32600-c5f8-4733-8412-be9a9ca2e940 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3029683 Dec 21 04:32:46.632929 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3744390d-1f00-4b4c-8ee5-ce8d701febc1 req-cc5f3519-2131-4fb4-9b20-4e26a68f94a9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:46.634431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3744390d-1f00-4b4c-8ee5-ce8d701febc1 req-cc5f3519-2131-4fb4-9b20-4e26a68f94a9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 945 time: 0.0540314 Dec 21 04:32:46.681123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3744390d-1f00-4b4c-8ee5-ce8d701febc1 req-89749f65-e316-4e8f-b0fa-b427a0fe00f8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407088 Dec 21 04:32:47.798172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8cbb8-53c5-49ba-89ba-a92c32641ff5 req-4da264f8-6256-46ec-9271-425ee7b586ee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:47.799662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecd8cbb8-53c5-49ba-89ba-a92c32641ff5 req-4da264f8-6256-46ec-9271-425ee7b586ee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 945 time: 0.0480394 Dec 21 04:32:47.849315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecd8cbb8-53c5-49ba-89ba-a92c32641ff5 req-83cbe96e-7625-4825-ba7c-3d91eb976680 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436819 Dec 21 04:32:48.382758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8458505e-f00f-4626-9c6a-580656d487c8 req-0bdffbe8-a773-4cd7-8bb5-27675782cff2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:32:48.384238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8458505e-f00f-4626-9c6a-580656d487c8 req-0bdffbe8-a773-4cd7-8bb5-27675782cff2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 945 time: 0.0468273 Dec 21 04:32:48.474611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port b16bd99e-1fde-431c-8f90-a49f42471e75 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:32:48.474991 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:48.568321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port b16bd99e-1fde-431c-8f90-a49f42471e75, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b16bd99e-1fde-431c-8f90-a49f42471e75,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:32:48.569126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:48.581059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for b16bd99e-1fde-431c-8f90-a49f42471e75 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:32:48.757632 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:48.785488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=b16bd99e-1fde-431c-8f90-a49f42471e75,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:32:48.790795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7c4097a9-6708-494f-a91a-ad822fcaf846'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:32:48.822553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b16bd99e-1fde-431c-8f90-a49f42471e75'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:32:48.833182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port b16bd99e-1fde-431c-8f90-a49f42471e75 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:32:48.836148 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:48.839567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8458505e-f00f-4626-9c6a-580656d487c8 req-02cf3aee-56f6-404a-856d-6aac7e48ab2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "DELETE /v2.0/ports/b16bd99e-1fde-431c-8f90-a49f42471e75 HTTP/1.1" status: 204 len: 173 time: 0.4466236 Dec 21 04:32:48.840197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'name': 'network-vif-deleted', 'tag': 'b16bd99e-1fde-431c-8f90-a49f42471e75'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:32:48.842856 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aac5cdfa-fd46-4b85-b286-addaa831fb50" -d '{"events": [{"server_uuid": "5a5e9778-9afc-468a-a5e3-7666b9b83179", "name": "network-vif-deleted", "tag": "b16bd99e-1fde-431c-8f90-a49f42471e75"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:32:48.909291 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:32:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bbcc365-43c9-4f7b-aa2a-052fc9b2aaf5 x-openstack-request-id: req-0bbcc365-43c9-4f7b-aa2a-052fc9b2aaf5 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:32:48.909596 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5a5e9778-9afc-468a-a5e3-7666b9b83179", "name": "network-vif-deleted", "tag": "b16bd99e-1fde-431c-8f90-a49f42471e75", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:32:48.909854 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0bbcc365-43c9-4f7b-aa2a-052fc9b2aaf5 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:32:48.910975 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5a5e9778-9afc-468a-a5e3-7666b9b83179', 'name': 'network-vif-deleted', 'tag': 'b16bd99e-1fde-431c-8f90-a49f42471e75', 'status': 'completed', 'code': 200} Dec 21 04:32:48.964227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da179717-4e14-4aab-83a8-71b7a5c18614 req-c3d156d4-c81a-47dd-bd34-cdc5955b9d28 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0374596 Dec 21 04:32:49.865600 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1b81f033-472e-4d05-a1ab-f4a0a32eb4e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:50.076012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51d092c6-f9f2-4ada-aa24-e5e90568a43e req-0f169c02-274d-4284-9ae8-47b9295550eb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0316958 Dec 21 04:32:51.170305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4becc4c1-5f32-4899-a602-24ccf7a86ce9 req-de29fc38-3047-4582-8ffc-6b679fa6bf71 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0260811 Dec 21 04:32:51.399299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b16bd99e-1fde-431c-8f90-a49f42471e75 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:32:51.419196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: b16bd99e-1fde-431c-8f90-a49f42471e75 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:32:51.419540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b16bd99e-1fde-431c-8f90-a49f42471e75 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:32:52.263574 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5687673b-8335-4dab-a025-4518c0fd0047 req-0d05aca6-245d-41bc-842d-b0375ae971d0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0253296 Dec 21 04:32:52.677472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4105150a-c6f8-428b-ae92-a7cd85fbc73e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:53.134267 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:53.360534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-957a17db-7865-4e5a-a8a8-8f7fbe4d1662 req-ca6153dc-a1d8-4dbc-b1dd-be12018b68cd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0256655 Dec 21 04:32:53.414333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:54.471381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a9228d6-bd1d-4c45-a5f1-a315870922ee req-9ad8b783-cb86-48bf-9d01-d058a4c03b94 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=5a5e9778-9afc-468a-a5e3-7666b9b83179 HTTP/1.1" status: 200 len: 210 time: 0.0281236 Dec 21 04:32:55.123321 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:55.151582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:32:55.796744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:00.296477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06075c13-313c-4e16-8727-2c0bc20b77e7 req-00bcb9c3-30f1-4f89-a0fb-00558d12feaa tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:00.297961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06075c13-313c-4e16-8727-2c0bc20b77e7 req-00bcb9c3-30f1-4f89-a0fb-00558d12feaa tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 945 time: 0.0486474 Dec 21 04:33:00.348085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06075c13-313c-4e16-8727-2c0bc20b77e7 req-a5a7287f-ccf3-4218-9e43-32941313580a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440228 Dec 21 04:33:01.464912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe5f9d3-79c8-4bf2-9207-7d901acb3e37 req-5ddf5a80-fb4c-4a83-8b99-03968e18864f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:01.466363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fe5f9d3-79c8-4bf2-9207-7d901acb3e37 req-5ddf5a80-fb4c-4a83-8b99-03968e18864f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 945 time: 0.0494404 Dec 21 04:33:01.513062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fe5f9d3-79c8-4bf2-9207-7d901acb3e37 req-4b04afd0-a499-419a-b84e-40443ed75e63 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406113 Dec 21 04:33:01.957368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11f6c77-9eba-468b-970f-6039c295c724 req-4312ab0f-c145-4c5d-8789-9cbd583fadca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:01.958804 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e11f6c77-9eba-468b-970f-6039c295c724 req-4312ab0f-c145-4c5d-8789-9cbd583fadca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 945 time: 0.0566747 Dec 21 04:33:02.045961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port 7c4097a9-6708-494f-a91a-ad822fcaf846 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:33:02.046298 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:02.135174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port 7c4097a9-6708-494f-a91a-ad822fcaf846, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=7c4097a9-6708-494f-a91a-ad822fcaf846,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:33:02.136114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:02.147748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for 7c4097a9-6708-494f-a91a-ad822fcaf846 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:33:02.351387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:02.384281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=7c4097a9-6708-494f-a91a-ad822fcaf846,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:02.384502 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['7c4097a9-6708-494f-a91a-ad822fcaf846'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:33:02.396406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.396758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.397122 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.397437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.397775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.398108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.398441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.398768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.399121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.399447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.399773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.400097 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.400425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:02.435183 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port 7c4097a9-6708-494f-a91a-ad822fcaf846 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:33:02.437739 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:02.441108 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e11f6c77-9eba-468b-970f-6039c295c724 req-8f2e421a-9cf6-4d93-b1f1-cc5b86af3d4f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "DELETE /v2.0/ports/7c4097a9-6708-494f-a91a-ad822fcaf846 HTTP/1.1" status: 204 len: 173 time: 0.4757318 Dec 21 04:33:02.441541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'name': 'network-vif-deleted', 'tag': '7c4097a9-6708-494f-a91a-ad822fcaf846'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:33:02.443841 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5225a6fb-020c-474f-a6f2-923cf762c222" -d '{"events": [{"server_uuid": "98b8da6f-2bab-4225-8beb-eb706fa96f70", "name": "network-vif-deleted", "tag": "7c4097a9-6708-494f-a91a-ad822fcaf846"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:33:02.480041 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:33:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1d4de52-c32b-41c9-8eec-8168ad7f257b x-openstack-request-id: req-f1d4de52-c32b-41c9-8eec-8168ad7f257b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:33:02.480342 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98b8da6f-2bab-4225-8beb-eb706fa96f70", "name": "network-vif-deleted", "tag": "7c4097a9-6708-494f-a91a-ad822fcaf846", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:33:02.480595 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f1d4de52-c32b-41c9-8eec-8168ad7f257b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:33:02.481000 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98b8da6f-2bab-4225-8beb-eb706fa96f70', 'name': 'network-vif-deleted', 'tag': '7c4097a9-6708-494f-a91a-ad822fcaf846', 'status': 'completed', 'code': 200} Dec 21 04:33:02.612717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ecf4229-4853-4854-b86a-4fd635201aa3 req-321299f1-fa7d-4efd-88b9-1b58f096ba34 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0276899 Dec 21 04:33:03.711772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3b6958dc-7852-4626-b5e0-703e9eb91ae0 req-dfdf9f7e-561e-426e-8451-fc5bf25e508e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0275800 Dec 21 04:33:03.885909 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:33:04.810032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-165d9eda-a709-4fe8-8062-53395cb9905a req-19723fef-ef63-4afa-a5be-2673c923bf18 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0292773 Dec 21 04:33:05.908059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d3873449-c39b-43e8-a765-28cbdbc4a422 req-c61bc1f1-1c4c-4e4c-8b1c-afeb420279de tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0269051 Dec 21 04:33:06.728965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7c4097a9-6708-494f-a91a-ad822fcaf846 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:33:06.755458 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 7c4097a9-6708-494f-a91a-ad822fcaf846 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:33:06.755801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 7c4097a9-6708-494f-a91a-ad822fcaf846 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:33:07.002077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0b9699c-6d87-420b-9f2a-ec49f5c0f204 req-e170fb76-3db5-49bb-a6cf-73696fe822c7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=98b8da6f-2bab-4225-8beb-eb706fa96f70 HTTP/1.1" status: 200 len: 210 time: 0.0256262 Dec 21 04:33:12.570917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46816) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:12.575940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1552595983', 'description': 'tempest-secgroup-smoke-1552595983 description', 'project_id': '58b4b41701714161aa0a78adc3f5ff66'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:12.660248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:12.740206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:12.779235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:12.806771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0a9eab09-71e8-4468-82c6-b69ddd8f076b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:12.849712 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:12.851099 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8cede39e-0662-43e2-a324-90cad5f9b152 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2790265 Dec 21 04:33:12.853933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46820) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:12.858260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group_rule': {'security_group_id': '0a9eab09-71e8-4468-82c6-b69ddd8f076b', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:12.924141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:12.993681 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.036931 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.054545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f43b03d2-42c5-4257-873e-5d819ea1e8de,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:13.096176 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.097409 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1137945-07ec-45ff-9bdd-73bec6b30031 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2424974 Dec 21 04:33:13.100174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46822) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:13.104467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group_rule': {'security_group_id': '0a9eab09-71e8-4468-82c6-b69ddd8f076b', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:13.178485 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.233413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.316954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.335935 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f91bb3e2-75eb-4cd6-89e9-e5e4f4b4bbd7,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:13.410266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.411499 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8f2b855e-5ba6-40aa-b17c-4c20576585e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3104048 Dec 21 04:33:13.414279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46824) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:13.418637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group_rule': {'security_group_id': '0a9eab09-71e8-4468-82c6-b69ddd8f076b', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:13.504132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.559172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.637290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.656857 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=09e6b8e6-83a9-4e6e-a5b9-f443a44725bc,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:13.707653 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.709136 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4e1576b1-3a43-4949-8cce-852ffbf12f55 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2936358 Dec 21 04:33:13.711640 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46826) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:13.715924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group_rule': {'security_group_id': '0a9eab09-71e8-4468-82c6-b69ddd8f076b', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:13.796332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.855025 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.899638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.917905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=632dd4d4-235a-4965-99a9-55c2544083d2,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:13.975935 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:13.977180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8e1ad585-2c1a-4b4a-9767-1918ba1b7109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2646170 Dec 21 04:33:13.979847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46828) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:13.989246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group_rule': {'security_group_id': '0a9eab09-71e8-4468-82c6-b69ddd8f076b', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:14.059897 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Project 58b4b41701714161aa0a78adc3f5ff66 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:33:14.064689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.122190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.185512 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.203238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63b7d2dc-ec59-494e-b596-613b38c46894,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:14.262198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.263518 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0a9548a1-bb3a-4495-844a-5ba2c88035c2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2827048 Dec 21 04:33:14.266317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 46830) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:14.270595 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'security_group_rule': {'security_group_id': '0a9eab09-71e8-4468-82c6-b69ddd8f076b', 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:14.351338 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Project 58b4b41701714161aa0a78adc3f5ff66 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 04:33:14.356770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.415622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.482283 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.500041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=757075e4-50f5-48ab-84d5-e47906055d8e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:14.558459 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:14.560201 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c6f7404e-ba3f-4a37-a524-1d30070e7aa5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2929683 Dec 21 04:33:19.894459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6c64f2f6-d59b-4a9b-8256-2e67a66bf0bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:22.677095 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e364efc9-5a50-434d-9c7f-ba8a7187c4b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:23.128160 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:23.402437 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:25.140535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:25.163128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:25.802693 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:35.224953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-be5ea104-8f02-428c-93d2-417dca8c7c43 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1552595983&fields=id&tenant_id=58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 267 time: 0.0534880 Dec 21 04:33:35.333481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-c6f361ec-1cac-4564-99c8-0add84637105 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:35.334888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-c6f361ec-1cac-4564-99c8-0add84637105 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1031199 Dec 21 04:33:35.349923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-b30a7dc9-cb65-4470-b248-afe2c9f45157 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0093107 Dec 21 04:33:35.400346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-1bc7893d-f674-47c3-b569-4acba7e97767 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0451972 Dec 21 04:33:35.501477 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-53deaa73-17db-46dd-8da1-359a3326bfa2 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867331 Dec 21 04:33:35.588733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-a3acc9e9-0fe1-4947-8ada-5d0d6d63a86c service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811503 Dec 21 04:33:36.050628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6def723-d221-47a1-8f34-f6fbed3b7eda req-7ab30b33-7b90-4bdc-b272-60f4ede9b194 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0269692 Dec 21 04:33:37.160186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9b6f9ca-ac95-4d8b-aa12-5af30c086ce1 req-a8c4ff95-71c7-405e-819f-589c68f398d9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0356131 Dec 21 04:33:37.968070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-c12c2420-b08f-4bcb-828a-39c2769941b9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:37.969538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-c12c2420-b08f-4bcb-828a-39c2769941b9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1048119 Dec 21 04:33:38.048573 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-346e1b6f-acf7-485b-8d91-199d26d3ae23 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 380 time: 0.0627739 Dec 21 04:33:38.057929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': 'a148c036-889f-4659-91d2-c436ed3d162e', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'security_groups': ['0a9eab09-71e8-4468-82c6-b69ddd8f076b']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:38.256654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-63a1cab6-f59a-4b52-84d0-7451a6689c15 req-a62b745d-79de-413f-89cf-3f1c6667d079 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0267494 Dec 21 04:33:38.275605 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:33:38.279154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:38.414069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.11 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/bf40e2d5-8b45-49ae-88d4-130e1280ac72) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:33:38.549346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:38.637518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:38.689871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:33:38.693155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:33:38.696834 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:33:38.723282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=bf40e2d5-8b45-49ae-88d4-130e1280ac72,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:38.753160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:38.753847 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:38.823289 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-d25c6b2b-4007-4bdf-8ef8-1ce6ac62d825 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7686806 Dec 21 04:33:38.843950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Request body: {'port': {'device_id': 'a148c036-889f-4659-91d2-c436ed3d162e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:38.898421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d2f85a24-03c7-4907-9ec6-0601e76a4c75 None None] Provisioning complete for port bf40e2d5-8b45-49ae-88d4-130e1280ac72 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:33:38.898973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d2f85a24-03c7-4907-9ec6-0601e76a4c75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:38.904720 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:38.936903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d2f85a24-03c7-4907-9ec6-0601e76a4c75 None None] Port bf40e2d5-8b45-49ae-88d4-130e1280ac72 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:33:39.172854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf40e2d5-8b45-49ae-88d4-130e1280ac72 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:33:39.180509 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:39.192848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Transition to ACTIVE for port object bf40e2d5-8b45-49ae-88d4-130e1280ac72 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:33:39.253867 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:39.303314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Pushing event updated for resources: {'Port': ['ID=bf40e2d5-8b45-49ae-88d4-130e1280ac72,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:39.384745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Attempting to bind port bf40e2d5-8b45-49ae-88d4-130e1280ac72 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:33:39.385146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Attempting to bind port bf40e2d5-8b45-49ae-88d4-130e1280ac72 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:33:39.385489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Attempting to bind port bf40e2d5-8b45-49ae-88d4-130e1280ac72 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:33:39.390113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Port bf40e2d5-8b45-49ae-88d4-130e1280ac72 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:33:39.390491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Attempting to bind port bf40e2d5-8b45-49ae-88d4-130e1280ac72 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:33:39.396440 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 33, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:33:39.396789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:33:39.397237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:33:39.397580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5022163b-864e-43b1-99ef-76849fc6cda6 req-8c1e98a2-fdb4-42d5-91dd-8be634a14bce tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:39.398055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Bound port: bf40e2d5-8b45-49ae-88d4-130e1280ac72, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:33:39.398055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:39.405741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5022163b-864e-43b1-99ef-76849fc6cda6 req-8c1e98a2-fdb4-42d5-91dd-8be634a14bce tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0624065 Dec 21 04:33:39.463713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5022163b-864e-43b1-99ef-76849fc6cda6 req-fe258a17-582e-4427-a9f3-e7ea409af560 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569644 Dec 21 04:33:39.487175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] For port bf40e2d5-8b45-49ae-88d4-130e1280ac72, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:33:39.490974 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] For port bf40e2d5-8b45-49ae-88d4-130e1280ac72, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:33:39.552087 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:39.590706 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:39.590706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:39.592297 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] 10.222.0.54 "PUT /v2.0/ports/bf40e2d5-8b45-49ae-88d4-130e1280ac72 HTTP/1.1" status: 200 len: 1093 time: 0.7530744 Dec 21 04:33:39.595188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:33:39.597674 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f" -d '{"events": [{"name": "network-changed", "server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:33:39.656993 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:33:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95bbb5cf-23e0-4538-a509-8750e0ae98c6 x-openstack-request-id: req-95bbb5cf-23e0-4538-a509-8750e0ae98c6 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:33:39.657296 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:33:39.657556 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-95bbb5cf-23e0-4538-a509-8750e0ae98c6 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:33:39.657968 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'status': 'completed', 'code': 200} Dec 21 04:33:39.659506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34bec6df-583e-4733-af93-f4026ee2f73a service neutron] Pushing event updated for resources: {'Port': ['ID=bf40e2d5-8b45-49ae-88d4-130e1280ac72,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:39.742223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f req-3158959e-be19-4e1d-abbc-c04df34e74a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:39.743902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f req-3158959e-be19-4e1d-abbc-c04df34e74a7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1096 time: 0.0459368 Dec 21 04:33:39.858456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f req-c7cf9df5-ba12-4d2b-b752-249ad706d730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:39.860544 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f req-c7cf9df5-ba12-4d2b-b752-249ad706d730 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=58b4b41701714161aa0a78adc3f5ff66&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1018891 Dec 21 04:33:39.956465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f req-19d38121-80f5-411e-8b87-c3583dd11426 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:39.957858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c5a5b81a-1ee8-4391-a7b8-d8f6bc54a50f req-19d38121-80f5-411e-8b87-c3583dd11426 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0902240 Dec 21 04:33:40.060387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-1b6510fd-e7d6-4eae-a26c-2ad8c9e10038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:40.061872 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-1b6510fd-e7d6-4eae-a26c-2ad8c9e10038 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1096 time: 0.0452776 Dec 21 04:33:40.111288 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-09856605-3bda-436f-b49d-648c608ed7ca service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72 HTTP/1.1" status: 200 len: 217 time: 0.0352316 Dec 21 04:33:40.160258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-85339876-22c7-4fc9-b318-6d1f9b52e9c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:40.161689 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-85339876-22c7-4fc9-b318-6d1f9b52e9c0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0439534 Dec 21 04:33:40.210005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-aaad23bf-cb8d-4e42-91fe-7db3fabfdfe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:40.211471 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-aaad23bf-cb8d-4e42-91fe-7db3fabfdfe5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0404077 Dec 21 04:33:40.307155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-72fb9c1a-98fe-4d38-b02d-d80da94a496f service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880313 Dec 21 04:33:40.401421 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02bb6da9-10a4-4a1e-8206-65c6b0983e6a req-0b0eeda5-3cb9-4efb-b308-9c7942e421ee service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864301 Dec 21 04:33:40.583055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aadcf10c-a046-4c89-87c2-91389b42048f req-19888894-4d2f-4823-9805-f910c202cb0b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:40.584529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aadcf10c-a046-4c89-87c2-91389b42048f req-19888894-4d2f-4823-9805-f910c202cb0b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0484095 Dec 21 04:33:40.638322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aadcf10c-a046-4c89-87c2-91389b42048f req-42332fed-c274-4b86-9008-46174e954021 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476341 Dec 21 04:33:40.885025 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:33:41.758125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c61193-cd9f-439f-bb5f-19050555ede1 req-fbb0323e-9d9c-4941-bb5b-9ca9c8ea9e99 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:41.759645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2c61193-cd9f-439f-bb5f-19050555ede1 req-fbb0323e-9d9c-4941-bb5b-9ca9c8ea9e99 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0497091 Dec 21 04:33:41.808999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d2c61193-cd9f-439f-bb5f-19050555ede1 req-659397ed-a765-41b6-b96a-a04128ce388c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434153 Dec 21 04:33:42.923905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a88819-b8f6-4b7f-9acc-6ee6869f46cf req-ffcfcf49-6c6e-4e17-856a-6c3cfeb84be1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:42.925379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7a88819-b8f6-4b7f-9acc-6ee6869f46cf req-ffcfcf49-6c6e-4e17-856a-6c3cfeb84be1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0489028 Dec 21 04:33:42.976248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7a88819-b8f6-4b7f-9acc-6ee6869f46cf req-e7576c4d-e96c-4f3b-9d64-5fb9b517e6a1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447218 Dec 21 04:33:44.094988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f91db32-0c8f-4b56-a1f3-5d45432e3d56 req-3209ece2-1d2b-42a3-b689-6a5488c3deb5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:44.096439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f91db32-0c8f-4b56-a1f3-5d45432e3d56 req-3209ece2-1d2b-42a3-b689-6a5488c3deb5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0530512 Dec 21 04:33:44.144582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f91db32-0c8f-4b56-a1f3-5d45432e3d56 req-d9ba5aa9-2904-48e2-a37e-e25f4e392b35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422053 Dec 21 04:33:45.257874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51261cbb-908d-4c6b-932d-dc8bc41945dd req-32e9fef7-983e-490f-8d87-8d94a1386b2b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:45.259431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51261cbb-908d-4c6b-932d-dc8bc41945dd req-32e9fef7-983e-490f-8d87-8d94a1386b2b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0481169 Dec 21 04:33:45.308002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51261cbb-908d-4c6b-932d-dc8bc41945dd req-c39e836c-5523-4809-9f46-1a0a7e10af43 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427206 Dec 21 04:33:46.421179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f798731-d52e-4a01-8545-7005db0aafd1 req-6216a97a-83f4-4f07-881d-6f340035e13d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:46.422675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f798731-d52e-4a01-8545-7005db0aafd1 req-6216a97a-83f4-4f07-881d-6f340035e13d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0484967 Dec 21 04:33:46.475365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f798731-d52e-4a01-8545-7005db0aafd1 req-4e90de79-77cc-4fad-a3fa-9fe9520f7c27 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465331 Dec 21 04:33:47.587254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6970ed71-15a1-4165-b6bf-8138534c3e62 req-8d2c1151-78f1-4c05-bd02-33b89a6cda34 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:47.588711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6970ed71-15a1-4165-b6bf-8138534c3e62 req-8d2c1151-78f1-4c05-bd02-33b89a6cda34 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0476899 Dec 21 04:33:47.642049 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6970ed71-15a1-4165-b6bf-8138534c3e62 req-92cb3709-dcb8-4fe3-9883-bf47673e8bba tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467556 Dec 21 04:33:48.760542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c01e1e-a9f1-4e5e-aaac-c14f391c878a req-a7707374-4315-48ed-a12e-e305e9e3d1eb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:48.762017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5c01e1e-a9f1-4e5e-aaac-c14f391c878a req-a7707374-4315-48ed-a12e-e305e9e3d1eb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0487797 Dec 21 04:33:48.809201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5c01e1e-a9f1-4e5e-aaac-c14f391c878a req-ed368800-1b40-4444-9298-444d6ea00099 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412295 Dec 21 04:33:49.860509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2be547a0-4d3b-4265-8921-6fd01b0cf2b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:49.929052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af931cef-f189-4d7d-8606-5341a797fc01 req-c15ac54e-816e-42c7-9a88-febd86726100 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:49.930522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af931cef-f189-4d7d-8606-5341a797fc01 req-c15ac54e-816e-42c7-9a88-febd86726100 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0520828 Dec 21 04:33:49.979587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af931cef-f189-4d7d-8606-5341a797fc01 req-9b562cb3-d80a-4037-9da6-91a50837bb2e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431035 Dec 21 04:33:51.091366 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb16cd4-0762-4a09-be0d-b80c2f19a9be req-09100500-26cc-4be8-ad4d-2bce92aa41b0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:51.092812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfb16cd4-0762-4a09-be0d-b80c2f19a9be req-09100500-26cc-4be8-ad4d-2bce92aa41b0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0476301 Dec 21 04:33:51.140675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfb16cd4-0762-4a09-be0d-b80c2f19a9be req-4ed14453-cdfc-42ed-acbe-1ca90b3af8ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412564 Dec 21 04:33:52.257804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486ed40-9d73-48fe-9ca9-27814ee0b41b req-863611f9-da88-4226-8552-c4a751c71d14 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:52.259276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1486ed40-9d73-48fe-9ca9-27814ee0b41b req-863611f9-da88-4226-8552-c4a751c71d14 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 944 time: 0.0507040 Dec 21 04:33:52.307494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1486ed40-9d73-48fe-9ca9-27814ee0b41b req-88de05fb-1d34-4404-8b5e-471ed6337a21 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423234 Dec 21 04:33:52.648001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad47b5d8-13a1-4868-8dd1-818da3338377 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:52.871351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf40e2d5-8b45-49ae-88d4-130e1280ac72 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:33:52.965970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bf40e2d5-8b45-49ae-88d4-130e1280ac72, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:33:52.976510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'mac_address': 'fa:16:3e:bf:db:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:33:53.012506 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:53.024637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf40e2d5-8b45-49ae-88d4-130e1280ac72 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:33:53.047050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bf40e2d5-8b45-49ae-88d4-130e1280ac72, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:33:53.104976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:53.150641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=bf40e2d5-8b45-49ae-88d4-130e1280ac72,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:53.158620 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.159002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.159885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.159885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.160134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.160324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.160656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.160986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.161316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.161649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.161978 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.162305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.162631 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:53.165855 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:53.381965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['bf40e2d5-8b45-49ae-88d4-130e1280ac72'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:33:53.415863 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:53.424667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc08ab45-e879-4de4-b52a-95a6f7ffb5cb req-91941c97-cd11-4566-8bf8-6dadbabfad9b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:53.426522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc08ab45-e879-4de4-b52a-95a6f7ffb5cb req-91941c97-cd11-4566-8bf8-6dadbabfad9b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 945 time: 0.0515306 Dec 21 04:33:53.481443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc08ab45-e879-4de4-b52a-95a6f7ffb5cb req-6e948a04-96be-40cf-b941-91e042762de0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443182 Dec 21 04:33:54.595723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11fc0f90-b908-4814-9533-92e78f5d7dff req-df1c8b0d-f0de-4643-9e81-cc41b2f397f3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:54.597109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11fc0f90-b908-4814-9533-92e78f5d7dff req-df1c8b0d-f0de-4643-9e81-cc41b2f397f3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 945 time: 0.0481427 Dec 21 04:33:54.648956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11fc0f90-b908-4814-9533-92e78f5d7dff req-a49aa76d-731c-475f-a2f0-78275e4c75c3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458643 Dec 21 04:33:54.887853 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf40e2d5-8b45-49ae-88d4-130e1280ac72 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:33:54.979605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port bf40e2d5-8b45-49ae-88d4-130e1280ac72 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:33:54.983407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port bf40e2d5-8b45-49ae-88d4-130e1280ac72 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:33:54.983782 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:55.059615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:55.090602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:33:55.092809 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f500e00-22d6-419c-9a2f-50d1d23823f4" -d '{"events": [{"server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "name": "network-vif-plugged", "status": "completed", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:33:55.117985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port bf40e2d5-8b45-49ae-88d4-130e1280ac72, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:33:55.129952 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:33:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49cf14d4-756a-487e-9822-11e178246c11 x-openstack-request-id: req-49cf14d4-756a-487e-9822-11e178246c11 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:33:55.130246 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "name": "network-vif-plugged", "status": "completed", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:33:55.130504 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-49cf14d4-756a-487e-9822-11e178246c11 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:33:55.130896 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'code': 200} Dec 21 04:33:55.156796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:55.180110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:55.180983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:55.239988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=bf40e2d5-8b45-49ae-88d4-130e1280ac72,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:55.273066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da22cb83-4c77-4104-a70e-04b883e36a3d req-75e811e3-cfa3-4707-9ab3-75ac13681ce7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:55.274630 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da22cb83-4c77-4104-a70e-04b883e36a3d req-75e811e3-cfa3-4707-9ab3-75ac13681ce7 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1098 time: 0.0421238 Dec 21 04:33:55.323555 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da22cb83-4c77-4104-a70e-04b883e36a3d req-fd266128-512e-47f5-b296-8dad96056f22 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387518 Dec 21 04:33:55.763165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9d9993-2ffa-48d6-a943-6194735ee6fd req-a0947fc6-6638-4bd0-b9fd-4c87544beb6e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:55.764639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e9d9993-2ffa-48d6-a943-6194735ee6fd req-a0947fc6-6638-4bd0-b9fd-4c87544beb6e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 946 time: 0.0487094 Dec 21 04:33:55.814617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3e9d9993-2ffa-48d6-a943-6194735ee6fd req-6d8cf03f-0f56-4c3e-8ad1-a2dd2188909a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434380 Dec 21 04:33:55.819731 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:56.934382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d0ce6f-da72-400e-9cb9-f56a6df4fb58 req-5d6abcc4-e697-42ca-a225-52138b4515b6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:56.935897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9d0ce6f-da72-400e-9cb9-f56a6df4fb58 req-5d6abcc4-e697-42ca-a225-52138b4515b6 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 946 time: 0.0486894 Dec 21 04:33:56.985152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9d0ce6f-da72-400e-9cb9-f56a6df4fb58 req-8465e756-6459-4906-8d93-ecd1220b9692 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420051 Dec 21 04:33:57.105227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ffccdc-550b-4b9a-98f8-22e89cfc42d9 req-028bdf94-aadc-4757-b1c7-72de24502938 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:57.106686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0ffccdc-550b-4b9a-98f8-22e89cfc42d9 req-028bdf94-aadc-4757-b1c7-72de24502938 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 946 time: 0.0533485 Dec 21 04:33:57.154252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0ffccdc-550b-4b9a-98f8-22e89cfc42d9 req-916845f1-27e6-4070-b34e-44cd8e330cb0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411620 Dec 21 04:33:57.176811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47044) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:57.215498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e2b7c00-b198-49a2-9ee6-2078b0bfbc6f tempest-TestVolumeBootPattern-1744010602 tempest-TestVolumeBootPattern-1744010602-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:57.216907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2e2b7c00-b198-49a2-9ee6-2078b0bfbc6f tempest-TestVolumeBootPattern-1744010602 tempest-TestVolumeBootPattern-1744010602-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1093 time: 0.0390968 Dec 21 04:33:57.220387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47046) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:33:57.224730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address': '172.20.0.11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:33:57.334096 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:57.432648 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:57.532194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.25.5.68 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/e5f2698a-29ab-4710-8643-3eb539217fb0) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:33:57.633918 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:57.723004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:57.761805 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:33:57.764593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:33:57.769260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:33:57.774770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=e5f2698a-29ab-4710-8643-3eb539217fb0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:57.802677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.802988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.803334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.803672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.804011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.804342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.804672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.805000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.805324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.805647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.805974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.806299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:57.806624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:33:58.260411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:58.427640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:58.570601 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:58.636790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:58.706707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=e5f2698a-29ab-4710-8643-3eb539217fb0,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:33:58.716483 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:59.097016 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Floating IP ee95f490-34e8-4979-8fab-69cbec7901c2 associated. External IP: 172.25.5.68, port: bf40e2d5-8b45-49ae-88d4-130e1280ac72. Dec 21 04:33:59.302073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:33:59.407641 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:33:59.417314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:33:59.429965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:33:59.430569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:33:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:33:59.478897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:33:59.509556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d8e04cac-6dc4-43d5-b29a-f2b9fc9ed314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2881157 Dec 21 04:33:59.510397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:33:59.512736 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfbefe4b-d07c-4407-80ec-3998dd890be1" -d '{"events": [{"name": "network-changed", "server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:33:59.533202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:33:59.550390 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:33:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90573737-5b58-4faf-9a39-891fa10f60a0 x-openstack-request-id: req-90573737-5b58-4faf-9a39-891fa10f60a0 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:33:59.550710 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:33:59.550993 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-90573737-5b58-4faf-9a39-891fa10f60a0 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:33:59.551424 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'status': 'completed', 'code': 200} Dec 21 04:33:59.643486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-d3f63641-981c-45c5-8cd7-10de50564e58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:59.646914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-d3f63641-981c-45c5-8cd7-10de50564e58 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1098 time: 0.0489161 Dec 21 04:33:59.741105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-eebfe2cf-a9a5-4f33-bfae-0f3969d555be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:59.742572 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-eebfe2cf-a9a5-4f33-bfae-0f3969d555be service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0905619 Dec 21 04:33:59.840526 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-1826c65e-185d-4c3c-a145-29465881fbec service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72 HTTP/1.1" status: 200 len: 999 time: 0.0910037 Dec 21 04:33:59.890326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-3db3427a-5aca-4bec-9ea6-f3bd74d7b2ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:59.891814 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-3db3427a-5aca-4bec-9ea6-f3bd74d7b2ca service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0450161 Dec 21 04:33:59.911342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ee95f490-34e8-4979-8fab-69cbec7901c2', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.68', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4028, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:bf:db:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a148c036-889f-4659-91d2-c436ed3d162e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:33:57Z', 'updated_at': '2021-12-21T04:33:57Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:33:59.936749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-4d4f6e85-240e-4b7d-b091-56204141af30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:33:59.938949 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-4d4f6e85-240e-4b7d-b091-56204141af30 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0401042 Dec 21 04:33:59.941931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:33:59.952919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:33:59.953554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:33:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:34:00.035846 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-caf8f13f-f7aa-4b38-a882-8cd5ba9eefb5 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900602 Dec 21 04:34:00.058617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:34:00.124572 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dfbefe4b-d07c-4407-80ec-3998dd890be1 req-42f55ede-58ee-4b28-94ff-1c5df9d9d605 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816803 Dec 21 04:34:00.285724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ee95f490-34e8-4979-8fab-69cbec7901c2', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.68', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4028, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:bf:db:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a148c036-889f-4659-91d2-c436ed3d162e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:33:57Z', 'updated_at': '2021-12-21T04:33:57Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:34:00.311388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-155f2fc3-de52-4ec0-a4a0-28d076155b93 None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'ee95f490-34e8-4979-8fab-69cbec7901c2', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.68', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4028, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:bf:db:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a148c036-889f-4659-91d2-c436ed3d162e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:33:57Z', 'updated_at': '2021-12-21T04:33:57Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:34:00.505166 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5fe16f1-09a7-4a23-b23b-1a41f75d6da0 None None] New status for floating IP ee95f490-34e8-4979-8fab-69cbec7901c2: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:34:17.887822 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:34:19.888196 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4358c730-1120-43bb-800b-b70cfaf325be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:22.693883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-132f5041-c153-46ba-bb8f-7b877cb5b7ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:23.174014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:23.418579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:25.197047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:25.214057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:25.785174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:26.589837 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-214416c4-c510-4761-93aa-a5eda4ba61b6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1528678 Dec 21 04:34:26.694814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-50e2e007-445d-4391-b278-b777b7067712 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:34:26.696315 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-50e2e007-445d-4391-b278-b777b7067712 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1098 time: 0.0434005 Dec 21 04:34:26.803212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-6a5af263-ca06-4b6a-bd83-fc25cc8ec743 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:34:26.804679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-6a5af263-ca06-4b6a-bd83-fc25cc8ec743 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0878623 Dec 21 04:34:26.874180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-27453928-0564-41b0-adcf-967970292b81 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72 HTTP/1.1" status: 200 len: 1001 time: 0.0624056 Dec 21 04:34:26.923245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-7459d932-8d9a-43ec-99a6-a960c00aafb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:34:26.924667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-7459d932-8d9a-43ec-99a6-a960c00aafb1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0432301 Dec 21 04:34:26.969790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-844cc57e-c8f5-428e-9ba8-9ff5032c695e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:34:26.971297 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-844cc57e-c8f5-428e-9ba8-9ff5032c695e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0395718 Dec 21 04:34:27.064649 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-95fb88d6-9db2-410c-8d1b-cbd7cf1d6915 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860746 Dec 21 04:34:27.151707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8630be0b-39ad-486f-bbc9-7fcafc9b2f45 req-b74a7575-ee85-4fa6-ba80-041fab106c3f service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804563 Dec 21 04:34:49.886512 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e69caf98-93d2-43e5-aaa2-a2c2c6cff0f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:52.665046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7b374ffa-bae0-45a5-a80c-f0cb5ecdcb7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:53.150951 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:53.419543 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:54.886540 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:34:55.166364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:55.190698 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:34:55.790659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:19.871003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-608181db-a84f-4071-9e4d-24a33a521c00 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:22.659500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bd0e1682-5a52-410a-8343-48fbdc038723 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:23.166049 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:23.388883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:25.172016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:25.196491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:25.789166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:27.087707 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-de2a475f-67f4-4052-a401-8bf4d8ecc097 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0459139 Dec 21 04:35:27.183443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-0c2752da-1d9e-41c8-bb3d-f552e62c3344 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:35:27.184894 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-0c2752da-1d9e-41c8-bb3d-f552e62c3344 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 1098 time: 0.0390785 Dec 21 04:35:27.285871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-b9471403-f599-474d-a5cd-37d56d849165 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:35:27.287359 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-b9471403-f599-474d-a5cd-37d56d849165 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0836518 Dec 21 04:35:27.355371 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-542fcebb-403a-476e-82ea-683e1754b2b3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72 HTTP/1.1" status: 200 len: 1001 time: 0.0606692 Dec 21 04:35:27.407861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-143bd67b-b02d-4fa6-8107-327347b9a1f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:35:27.413501 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-143bd67b-b02d-4fa6-8107-327347b9a1f2 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0509436 Dec 21 04:35:27.457917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-2a902096-00d1-4e7a-b958-1d2bac676fc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:35:27.459444 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-2a902096-00d1-4e7a-b958-1d2bac676fc1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0389650 Dec 21 04:35:27.812436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-b70d2e52-0577-438c-a610-3456a637350a service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3452077 Dec 21 04:35:27.905427 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c338e752-5f35-41d8-88f0-8fbc98989bf3 req-2b928ebd-7b38-4c40-bbbc-6ea550217c8f service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845304 Dec 21 04:35:31.884602 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:35:49.864683 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-95165523-011c-46ae-baa7-b89102781e0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:52.670283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7687324c-8149-4b40-b2fa-8dabebb8ce64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:53.167956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:53.402338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:55.190894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:55.207890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:35:55.784596 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:08.883021 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:36:19.882184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f497c86a-d5f8-42f7-8b48-cfa01206e90a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:19.913265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-0b981e1f-ece9-4f01-bf10-77cde049b03b req-1f5e834e-bc42-4bed-be30-404c4c52a1eb service neutron] (110310) timed out ('10.222.0.18', 36366) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:36:22.673642 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4df4840d-6a92-412e-b8b5-642c58f82791 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:23.190761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:23.395875 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:25.202484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:25.230516 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:25.787923 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:26.418412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68022aed-cf18-4a56-b503-98827dd4871b req-76499a36-c744-43d5-80c1-6a3f2e6fba20 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:26.419929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68022aed-cf18-4a56-b503-98827dd4871b req-76499a36-c744-43d5-80c1-6a3f2e6fba20 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 946 time: 0.0990233 Dec 21 04:36:26.469802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68022aed-cf18-4a56-b503-98827dd4871b req-e54053d1-3589-488f-99a9-9954585b89a3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428636 Dec 21 04:36:27.645413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc7df2a-8b40-4548-8034-70344b9da035 req-0eaeb1d5-5510-4cac-8439-54879403fd88 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:27.646919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cfc7df2a-8b40-4548-8034-70344b9da035 req-0eaeb1d5-5510-4cac-8439-54879403fd88 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 946 time: 0.0993102 Dec 21 04:36:27.699125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cfc7df2a-8b40-4548-8034-70344b9da035 req-1d4174c9-9a85-4ce4-bc7b-8ce1f8eba4c4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460708 Dec 21 04:36:28.060326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a014f013-d180-40ff-ba35-76123e885314 req-57239fe8-9173-4bd3-828d-8e8c9e3e6877 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:28.061767 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a014f013-d180-40ff-ba35-76123e885314 req-57239fe8-9173-4bd3-828d-8e8c9e3e6877 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 946 time: 0.0488462 Dec 21 04:36:28.148131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port bf40e2d5-8b45-49ae-88d4-130e1280ac72 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:36:28.148461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:28.240108 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port bf40e2d5-8b45-49ae-88d4-130e1280ac72, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=bf40e2d5-8b45-49ae-88d4-130e1280ac72,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:36:28.240579 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:28.509937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:28.510497 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:28.510644 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Floating IP ee95f490-34e8-4979-8fab-69cbec7901c2 disassociated. External IP: 172.25.5.68, port: bf40e2d5-8b45-49ae-88d4-130e1280ac72. Dec 21 04:36:28.510927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for bf40e2d5-8b45-49ae-88d4-130e1280ac72 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:36:28.696817 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:28.727210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=bf40e2d5-8b45-49ae-88d4-130e1280ac72,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:28.737628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.737986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.738333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.738672 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.739043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.739386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.739728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.740047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.740368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.740698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.741028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.741356 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.741685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:28.814154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-062fa952-da5e-4a82-b058-33b3f9afb8fa req-adb03623-6621-4f67-9c8c-506fd4d64780 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0255044 Dec 21 04:36:28.850807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:36:28.956264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:36:28.966422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:36:28.976087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:36:28.976693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:36:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:36:28.997345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port bf40e2d5-8b45-49ae-88d4-130e1280ac72 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:36:29.000014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:29.003314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a014f013-d180-40ff-ba35-76123e885314 req-86cbd294-b821-468d-aa3e-d458683a33ed tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "DELETE /v2.0/ports/bf40e2d5-8b45-49ae-88d4-130e1280ac72 HTTP/1.1" status: 204 len: 173 time: 0.9355206 Dec 21 04:36:29.003755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'name': 'network-vif-deleted', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:36:29.005967 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e7934c7-e795-46d4-afcb-7026b437bb76" -d '{"events": [{"server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "name": "network-vif-deleted", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:36:29.088221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:36:29.105638 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:36:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09485a89-3a25-4a94-a14e-f91aa180931d x-openstack-request-id: req-09485a89-3a25-4a94-a14e-f91aa180931d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:36:29.106145 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a148c036-889f-4659-91d2-c436ed3d162e", "name": "network-vif-deleted", "tag": "bf40e2d5-8b45-49ae-88d4-130e1280ac72", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:36:29.106145 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-09485a89-3a25-4a94-a14e-f91aa180931d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:36:29.106724 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a148c036-889f-4659-91d2-c436ed3d162e', 'name': 'network-vif-deleted', 'tag': 'bf40e2d5-8b45-49ae-88d4-130e1280ac72', 'status': 'completed', 'code': 200} Dec 21 04:36:29.303619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:36:29.329329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:36:29.337995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:36:29.338605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:36:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:36:29.441815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:36:29.638119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:36:29.667834 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f06c1930-ef99-4db3-a57c-66d09174b8ab None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:36:29.886020 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03f4c499-bea4-4861-8eea-2a2a30de5c0c None None] New status for floating IP ee95f490-34e8-4979-8fab-69cbec7901c2: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:36:29.913581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-faecb2a4-c018-45e5-a064-5f25e8424860 req-4d22a3ba-5b68-4a0c-9ca0-9c6ee79034e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0268583 Dec 21 04:36:31.011159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f60a4dbd-1632-4e1f-9e41-622d4e51966f req-e30f81e9-4f63-4c6a-8c11-f1c9a797519a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0260143 Dec 21 04:36:31.742889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf40e2d5-8b45-49ae-88d4-130e1280ac72 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:36:31.762341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: bf40e2d5-8b45-49ae-88d4-130e1280ac72 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:36:31.762687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device bf40e2d5-8b45-49ae-88d4-130e1280ac72 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:36:32.103785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-768082ee-c982-4b30-acba-88ac00581bf5 req-6f7f3a68-ebce-48ea-8e2d-234bbf9715f5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0267820 Dec 21 04:36:33.199105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-719b6de7-b2f2-48da-9701-5f4b99c8c6d4 req-700291c5-edf8-42bf-a58a-29a875eaa3c4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0259869 Dec 21 04:36:34.310146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c434226-269f-4677-9064-0af7c04f523d req-c3c5e19c-2f6e-4234-b3eb-fa6c52724029 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=a148c036-889f-4659-91d2-c436ed3d162e HTTP/1.1" status: 200 len: 210 time: 0.0294678 Dec 21 04:36:35.513844 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-bb3a7609-6a70-4a03-b1c9-70cb57db53bd tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1552595983&fields=id&tenant_id=58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 267 time: 0.0433269 Dec 21 04:36:35.620344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-aca9127c-c275-47da-9ad0-b28804bbe411 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:35.621867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-aca9127c-c275-47da-9ad0-b28804bbe411 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1013868 Dec 21 04:36:35.637330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-30705327-8de5-4213-8f2e-4f4db57bc04e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0092993 Dec 21 04:36:35.694103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-b3dbe8bb-8f5a-4b91-9e35-7e58f6bcc0ef tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0503874 Dec 21 04:36:35.835454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-cff65450-8deb-4783-adba-9b8f2871c611 service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288979 Dec 21 04:36:35.925793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-18f6c9d1-95f3-4b98-bdfd-998a3aec49ac service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842969 Dec 21 04:36:36.471604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07848aa3-7068-4fad-841c-d955f2116b23 req-d2c8cd07-ba8d-47da-a647-2b426c5247d9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0268428 Dec 21 04:36:37.561476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8e2f9ee-dc29-4713-99d5-3a2e7d9c9ce9 req-8bc9be34-d459-408d-820e-bdd6e80edb90 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0257163 Dec 21 04:36:38.498787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-b5e50588-1a7f-4072-b4f0-1ce9a1003d78 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:38.500289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-b5e50588-1a7f-4072-b4f0-1ce9a1003d78 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1085269 Dec 21 04:36:38.583428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-ad07bdab-d98d-489a-8479-59516e5edf74 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 380 time: 0.0645311 Dec 21 04:36:38.607371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'security_groups': ['0a9eab09-71e8-4468-82c6-b69ddd8f076b']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:36:38.689135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19c09d79-55d8-45c5-bd46-5c898c0b48f8 req-d7c8001e-5975-449d-bbe2-241c57ab6284 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0571957 Dec 21 04:36:38.793979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:36:38.797595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:38.922712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.7 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/29105788-9a26-4cbb-bd40-1e033f7557da) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:36:39.062474 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.145158 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.190118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:36:39.192991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:36:39.196621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:36:39.222970 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=29105788-9a26-4cbb-bd40-1e033f7557da,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:39.242983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.243338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.243681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.244020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.244355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.244694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.245023 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.245353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.245682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.246006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.246332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.246656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.247001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:39.267211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:39.268393 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.368060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-e5153fcd-3430-40b2-98ec-22354a81bbe2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7650282 Dec 21 04:36:39.391323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Request body: {'port': {'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:36:39.445079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.467936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bfd0b784-7862-466c-8b15-cf5ff6b8181f None None] Provisioning complete for port 29105788-9a26-4cbb-bd40-1e033f7557da triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:36:39.468929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfd0b784-7862-466c-8b15-cf5ff6b8181f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.507375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bfd0b784-7862-466c-8b15-cf5ff6b8181f None None] Port 29105788-9a26-4cbb-bd40-1e033f7557da cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:36:39.713501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 29105788-9a26-4cbb-bd40-1e033f7557da {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:36:39.721957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.734037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Transition to ACTIVE for port object 29105788-9a26-4cbb-bd40-1e033f7557da will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:36:39.807875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98ba8ca0-36d5-463a-b58a-aa5e6974fa9a req-df4b2d07-890e-47bf-ab58-ca20fb5ecb6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:39.809949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98ba8ca0-36d5-463a-b58a-aa5e6974fa9a req-df4b2d07-890e-47bf-ab58-ca20fb5ecb6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 931 time: 0.0499651 Dec 21 04:36:39.816427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:39.893939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Pushing event updated for resources: {'Port': ['ID=29105788-9a26-4cbb-bd40-1e033f7557da,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:39.957542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98ba8ca0-36d5-463a-b58a-aa5e6974fa9a req-b1c62a38-760c-45ca-9b5b-5b3a7cb90e9c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1387510 Dec 21 04:36:39.996155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Attempting to bind port 29105788-9a26-4cbb-bd40-1e033f7557da on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:36:39.996552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Attempting to bind port 29105788-9a26-4cbb-bd40-1e033f7557da by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:36:39.996889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Attempting to bind port 29105788-9a26-4cbb-bd40-1e033f7557da on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:36:40.002276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Port 29105788-9a26-4cbb-bd40-1e033f7557da on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:36:40.002607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Attempting to bind port 29105788-9a26-4cbb-bd40-1e033f7557da on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:36:40.007919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 36, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:36:40.008262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:36:40.008651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:36:40.009184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Bound port: 29105788-9a26-4cbb-bd40-1e033f7557da, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:36:40.009541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:40.080177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] For port 29105788-9a26-4cbb-bd40-1e033f7557da, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:36:40.083220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] For port 29105788-9a26-4cbb-bd40-1e033f7557da, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=29105788-9a26-4cbb-bd40-1e033f7557da,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:36:40.171332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:40.210388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.211050 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:40.212490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] 10.222.0.31 "PUT /v2.0/ports/29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 1092 time: 0.8256426 Dec 21 04:36:40.212948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:36:40.215382 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-272f4fbb-6839-4858-869e-dffe80252db2" -d '{"events": [{"name": "network-changed", "server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:36:40.241156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9e18e7-4250-464f-8b23-41df56e14e8d service neutron] Pushing event updated for resources: {'Port': ['ID=29105788-9a26-4cbb-bd40-1e033f7557da,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:40.264034 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:36:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9574af6f-7547-482b-9d64-89b82e18b129 x-openstack-request-id: req-9574af6f-7547-482b-9d64-89b82e18b129 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:36:40.264476 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:36:40.264740 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9574af6f-7547-482b-9d64-89b82e18b129 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:36:40.265202 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da', 'status': 'completed', 'code': 200} Dec 21 04:36:40.360084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272f4fbb-6839-4858-869e-dffe80252db2 req-4968fed9-f469-4c8f-9ebb-5464d739c411 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.362252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-272f4fbb-6839-4858-869e-dffe80252db2 req-4968fed9-f469-4c8f-9ebb-5464d739c411 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1095 time: 0.0447171 Dec 21 04:36:40.480331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272f4fbb-6839-4858-869e-dffe80252db2 req-796f8eac-7248-48e8-87f2-2a744a4491d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.481748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-272f4fbb-6839-4858-869e-dffe80252db2 req-796f8eac-7248-48e8-87f2-2a744a4491d1 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=58b4b41701714161aa0a78adc3f5ff66&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0969300 Dec 21 04:36:40.583255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272f4fbb-6839-4858-869e-dffe80252db2 req-b42ec8b6-40eb-4250-ac9d-ce687047f42c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.584828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-272f4fbb-6839-4858-869e-dffe80252db2 req-b42ec8b6-40eb-4250-ac9d-ce687047f42c service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0917287 Dec 21 04:36:40.705444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-ef7be2c4-9c7f-4295-a4a2-b3beec05e738 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.706961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-ef7be2c4-9c7f-4295-a4a2-b3beec05e738 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1095 time: 0.0408204 Dec 21 04:36:40.762553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-09c0875f-40ec-4eb9-9bba-e6c36eceaacc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 217 time: 0.0340478 Dec 21 04:36:40.817774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-4f4f7d35-5b8d-4f3f-8ba8-83e6b97c0413 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.819263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-4f4f7d35-5b8d-4f3f-8ba8-83e6b97c0413 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0488279 Dec 21 04:36:40.869979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-24362fb2-3cb0-429b-93c0-a11b2c676004 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:40.871505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-24362fb2-3cb0-429b-93c0-a11b2c676004 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0413153 Dec 21 04:36:40.964854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-27bd7c77-005b-4394-8caa-7971e9dccef5 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813415 Dec 21 04:36:41.096496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b48be9be-300c-41d4-bdf4-2dcf055b8830 req-94e4ebd8-21da-4352-808e-844f11c98c6e service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1189122 Dec 21 04:36:41.108183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359a360e-1319-449b-a34a-759a7f14dd79 req-de46c78f-8475-4f39-9de0-ceac0a4f4af4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:41.109604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-359a360e-1319-449b-a34a-759a7f14dd79 req-de46c78f-8475-4f39-9de0-ceac0a4f4af4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0700688 Dec 21 04:36:41.170758 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-359a360e-1319-449b-a34a-759a7f14dd79 req-c324b407-6388-421c-957d-6b6db443fd73 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493751 Dec 21 04:36:42.293179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b58f51d-2020-4e7f-9fb7-de1e2d26687b req-c01c2583-0161-4cc1-aebd-baaff54580c4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:42.294698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b58f51d-2020-4e7f-9fb7-de1e2d26687b req-c01c2583-0161-4cc1-aebd-baaff54580c4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0530367 Dec 21 04:36:42.343910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b58f51d-2020-4e7f-9fb7-de1e2d26687b req-a7346d24-0551-417b-8547-acc04a666ee8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431435 Dec 21 04:36:43.461344 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d932a92-cd29-4f4d-a1e0-2511e2b9c1b6 req-1497c933-f950-4d3f-9cba-67049368d449 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:43.462829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d932a92-cd29-4f4d-a1e0-2511e2b9c1b6 req-1497c933-f950-4d3f-9cba-67049368d449 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0482073 Dec 21 04:36:43.514225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d932a92-cd29-4f4d-a1e0-2511e2b9c1b6 req-4a3dad81-4f0a-46c4-b824-6a7c64b2b34e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452919 Dec 21 04:36:44.629103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023f43ee-5755-43cf-9514-29a8f1bd9660 req-fe94cde4-d6b0-4c6d-8349-adde8aa77237 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:44.630490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-023f43ee-5755-43cf-9514-29a8f1bd9660 req-fe94cde4-d6b0-4c6d-8349-adde8aa77237 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0478649 Dec 21 04:36:44.681232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-023f43ee-5755-43cf-9514-29a8f1bd9660 req-73427527-54ce-41b1-bb9c-90cd3d4c2547 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446749 Dec 21 04:36:45.796498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60853f36-0a9f-496b-a77f-3659560b72ab req-2fbbb42a-ba5e-4769-a010-f7bb03b7c529 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:45.797958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60853f36-0a9f-496b-a77f-3659560b72ab req-2fbbb42a-ba5e-4769-a010-f7bb03b7c529 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0489299 Dec 21 04:36:45.849803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60853f36-0a9f-496b-a77f-3659560b72ab req-68cea84b-4641-4a37-b9dd-0f1fd5d9bd7a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441127 Dec 21 04:36:45.882304 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:36:46.962957 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9210f63-59b0-46d2-8552-0dace7a1c358 req-23858613-b491-4882-bfc5-83c30e5b7a07 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:46.966521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9210f63-59b0-46d2-8552-0dace7a1c358 req-23858613-b491-4882-bfc5-83c30e5b7a07 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0491765 Dec 21 04:36:47.012097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9210f63-59b0-46d2-8552-0dace7a1c358 req-0cf673dc-3dcf-42ea-8ceb-a379e18cbf9e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417447 Dec 21 04:36:48.131598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c5ba7b-288f-4950-a55e-4eab419dbf92 req-fbcb0df4-793f-40e6-925e-5462cfc704e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:48.133042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76c5ba7b-288f-4950-a55e-4eab419dbf92 req-fbcb0df4-793f-40e6-925e-5462cfc704e5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0508838 Dec 21 04:36:48.180188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76c5ba7b-288f-4950-a55e-4eab419dbf92 req-6cd4d9e4-83db-4b27-8295-889bedce4567 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413623 Dec 21 04:36:49.294447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f40b98b-2b24-49c0-82a6-87e79913afe7 req-12ceb9bf-10fd-4a6c-a42a-4e80c80cce91 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:49.295948 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f40b98b-2b24-49c0-82a6-87e79913afe7 req-12ceb9bf-10fd-4a6c-a42a-4e80c80cce91 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0486889 Dec 21 04:36:49.345248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f40b98b-2b24-49c0-82a6-87e79913afe7 req-e59ea647-a4b2-47c4-8bb3-c04296daf58c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434418 Dec 21 04:36:49.862252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c16db049-fd34-4125-8585-d59f90723ae7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:50.462478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64f347c-8ac9-44b8-af88-7896fa21537e req-35128856-a5ae-442c-8b55-2b4ea8c945b2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:50.463962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a64f347c-8ac9-44b8-af88-7896fa21537e req-35128856-a5ae-442c-8b55-2b4ea8c945b2 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0507927 Dec 21 04:36:50.511838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a64f347c-8ac9-44b8-af88-7896fa21537e req-f1fe7777-811b-4c49-a5a9-2283ece0bd76 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420442 Dec 21 04:36:51.624107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97718ef0-f287-4ba2-986f-9110f1079132 req-24c4471e-a3f7-4a51-97a6-93ab8fd53da4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:51.625583 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97718ef0-f287-4ba2-986f-9110f1079132 req-24c4471e-a3f7-4a51-97a6-93ab8fd53da4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0478947 Dec 21 04:36:51.673558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97718ef0-f287-4ba2-986f-9110f1079132 req-43a1d044-9f86-4044-a293-1173b72128fe tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409572 Dec 21 04:36:52.621870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 29105788-9a26-4cbb-bd40-1e033f7557da details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:36:52.717862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 29105788-9a26-4cbb-bd40-1e033f7557da, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=29105788-9a26-4cbb-bd40-1e033f7557da,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:36:52.724692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dac78610-6772-4635-81ed-7db6e69bcbd2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:52.729624 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '29105788-9a26-4cbb-bd40-1e033f7557da', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:36:52.767046 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:52.780718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 29105788-9a26-4cbb-bd40-1e033f7557da {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:36:52.789467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06718a34-f7af-453d-8fa8-22878ba5cbe9 req-69a62abd-af64-4a23-8580-626543f50f2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:52.790959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06718a34-f7af-453d-8fa8-22878ba5cbe9 req-69a62abd-af64-4a23-8580-626543f50f2a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 943 time: 0.0482593 Dec 21 04:36:52.803998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 29105788-9a26-4cbb-bd40-1e033f7557da, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=29105788-9a26-4cbb-bd40-1e033f7557da,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:36:52.843627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06718a34-f7af-453d-8fa8-22878ba5cbe9 req-5c1a46d6-a3ca-43bf-b19a-5ddd5f6709ea tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465696 Dec 21 04:36:52.867474 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:52.913848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=29105788-9a26-4cbb-bd40-1e033f7557da,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:52.921010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.921365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.921713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.922071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.922394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.922733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.923096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.923428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.923757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.924090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.924417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.924741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:52.925623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:36:53.207823 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:53.260166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['29105788-9a26-4cbb-bd40-1e033f7557da'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:36:53.420109 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:53.959576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86354103-9847-42aa-a4c2-73dd622d1e77 req-b2f99b81-a8f7-43f1-ad45-8d62b346ee62 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:53.961031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86354103-9847-42aa-a4c2-73dd622d1e77 req-b2f99b81-a8f7-43f1-ad45-8d62b346ee62 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 944 time: 0.0489292 Dec 21 04:36:54.009365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86354103-9847-42aa-a4c2-73dd622d1e77 req-da18ffe3-301c-40ed-bd62-701d314e3418 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421529 Dec 21 04:36:54.635379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 29105788-9a26-4cbb-bd40-1e033f7557da up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:36:54.724294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 29105788-9a26-4cbb-bd40-1e033f7557da completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:36:54.727941 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 29105788-9a26-4cbb-bd40-1e033f7557da triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:36:54.728339 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:54.804967 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:54.826897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:36:54.829115 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c08b00fc-a864-477e-83f7-cf4dc980a8ed" -d '{"events": [{"server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "name": "network-vif-plugged", "status": "completed", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:36:54.841361 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 29105788-9a26-4cbb-bd40-1e033f7557da, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=29105788-9a26-4cbb-bd40-1e033f7557da,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:36:54.902255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:54.930414 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:36:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d9a34d1-6209-4dd0-ba4b-6aa11edcf42a x-openstack-request-id: req-1d9a34d1-6209-4dd0-ba4b-6aa11edcf42a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:36:54.930717 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "name": "network-vif-plugged", "status": "completed", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:36:54.931024 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1d9a34d1-6209-4dd0-ba4b-6aa11edcf42a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:36:54.931422 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da', 'code': 200} Dec 21 04:36:54.953935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=29105788-9a26-4cbb-bd40-1e033f7557da,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:55.135279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-379acd9b-59a7-4da7-8ec2-97da17a83b83 req-8464bc90-39af-45cd-a825-f4a6f721501b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:55.136764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-379acd9b-59a7-4da7-8ec2-97da17a83b83 req-8464bc90-39af-45cd-a825-f4a6f721501b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.1147976 Dec 21 04:36:55.148551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10efdf2-458f-4d59-8da1-a53e4905c2af req-9727d1fc-dad8-4e82-8dd7-93a2687dcb84 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:55.149897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f10efdf2-458f-4d59-8da1-a53e4905c2af req-9727d1fc-dad8-4e82-8dd7-93a2687dcb84 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0727816 Dec 21 04:36:55.170471 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:55.219461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:55.220975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-379acd9b-59a7-4da7-8ec2-97da17a83b83 req-4794e7d7-4657-435a-b7b7-9c4f6f74ded2 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701513 Dec 21 04:36:55.226411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f10efdf2-458f-4d59-8da1-a53e4905c2af req-8dfd5676-4025-4d46-871e-a0f731cde8d0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704231 Dec 21 04:36:55.801501 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:56.341899 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ae32fd-22f1-4253-9384-8c267e79615b req-b3acfa5b-df41-43d9-9b69-5fee1f918b51 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:56.343418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4ae32fd-22f1-4253-9384-8c267e79615b req-b3acfa5b-df41-43d9-9b69-5fee1f918b51 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0493228 Dec 21 04:36:56.392100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4ae32fd-22f1-4253-9384-8c267e79615b req-02957c3f-802a-4507-9d07-530571499cee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422978 Dec 21 04:36:57.509519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deb5959-2a5f-46ca-8c3d-a7533adaa986 req-ecb6114a-ea95-4e8a-97d3-de7f930a628d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:57.511439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5deb5959-2a5f-46ca-8c3d-a7533adaa986 req-ecb6114a-ea95-4e8a-97d3-de7f930a628d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0524867 Dec 21 04:36:57.563410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5deb5959-2a5f-46ca-8c3d-a7533adaa986 req-6bcf4fd1-ca82-4b2c-a32d-77e02bd8f352 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461981 Dec 21 04:36:57.678034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6966a2de-815d-4327-933a-c83e3ed37a9b req-1457b67e-d50f-442a-b76d-b265c0347013 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:57.679412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6966a2de-815d-4327-933a-c83e3ed37a9b req-1457b67e-d50f-442a-b76d-b265c0347013 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0469880 Dec 21 04:36:57.727215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6966a2de-815d-4327-933a-c83e3ed37a9b req-1009dfcb-b809-4954-8566-f6c0b4383850 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419202 Dec 21 04:36:57.749049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47228) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:36:57.827922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1bea4d3-7ec3-493f-b6ef-d10c655e86ca tempest-TestVolumeBootPattern-1744010602 tempest-TestVolumeBootPattern-1744010602-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:36:57.829405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d1bea4d3-7ec3-493f-b6ef-d10c655e86ca tempest-TestVolumeBootPattern-1744010602 tempest-TestVolumeBootPattern-1744010602-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1092 time: 0.0794284 Dec 21 04:36:57.832226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47232) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:36:57.836558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:36:57.927555 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:58.024248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:58.123751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.25.5.110 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/ecd04955-7083-4fb3-8cf1-80500f8f79a5) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:36:58.229057 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:58.304856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:58.343993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:36:58.347405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:36:58.350842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:36:58.375066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=ecd04955-7083-4fb3-8cf1-80500f8f79a5,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:59.020512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:59.152359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:59.312763 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:59.373020 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:59.445843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=ecd04955-7083-4fb3-8cf1-80500f8f79a5,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:36:59.454053 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:59.552024 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Floating IP 91a17a9e-af06-4345-a11f-9b0b09cf89e6 associated. External IP: 172.25.5.110, port: 29105788-9a26-4cbb-bd40-1e033f7557da. Dec 21 04:36:59.755410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:36:59.857491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:36:59.868215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:36:59.877179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:36:59.881787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:36:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:36:59.929736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:36:59.974958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3653169d-ba31-49ac-8f18-d6c22fb049ca tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.1277549 Dec 21 04:36:59.974958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:36:59.974958 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5" -d '{"events": [{"name": "network-changed", "server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:36:59.984174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:37:00.057519 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:36:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-face7102-6758-4647-8905-4e79c94fd2f3 x-openstack-request-id: req-face7102-6758-4647-8905-4e79c94fd2f3 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:37:00.058019 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:37:00.058108 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-face7102-6758-4647-8905-4e79c94fd2f3 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:37:00.058453 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da', 'status': 'completed', 'code': 200} Dec 21 04:37:00.141703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-26b71c4f-4c8c-4458-b81b-da6cb33e64cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:00.143174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-26b71c4f-4c8c-4458-b81b-da6cb33e64cc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0397296 Dec 21 04:37:00.207106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:36:58Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:37:00.231937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-48eff06b-85c0-409b-86e0-72eab268acd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:00.233418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-48eff06b-85c0-409b-86e0-72eab268acd5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0835311 Dec 21 04:37:00.236026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:37:00.244636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:37:00.245268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:36:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:37:00.332249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-4c28c855-cb3b-46f7-ae40-824042c41ee4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 999 time: 0.0917115 Dec 21 04:37:00.348876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:37:00.380599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-85eb0559-b511-4306-be73-f9f8377236aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:00.382064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-85eb0559-b511-4306-be73-f9f8377236aa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0432742 Dec 21 04:37:00.433034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-16ef41a4-9d0d-4d9f-9fa7-6c83b47a3090 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:00.434561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-16ef41a4-9d0d-4d9f-9fa7-6c83b47a3090 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0448129 Dec 21 04:37:00.523189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-4643d233-a7d8-4e1f-a9b4-51af04df13f5 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810294 Dec 21 04:37:00.566635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:36:58Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:37:00.595670 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e72630d1-db59-4bfd-9902-9c32b0481262 None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:36:58Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:37:00.619188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-92c02092-8e68-4d8d-afa5-cabad2aeb9b5 req-1225ef6c-74c1-4387-9c3c-c8f313b1471e service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870051 Dec 21 04:37:00.789307 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97354486-68d0-4661-a1a7-086e2d424967 None None] New status for floating IP 91a17a9e-af06-4345-a11f-9b0b09cf89e6: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:37:14.754822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-355847c9-278e-4e06-9087-c5e67851aec8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0410471 Dec 21 04:37:14.866633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-75d9738b-5223-46f5-b6dd-5fc0fe0e6ef7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:14.868148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-75d9738b-5223-46f5-b6dd-5fc0fe0e6ef7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0406353 Dec 21 04:37:14.988726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-19ff811f-06be-41d0-863f-ceef2b57869c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:14.990372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-19ff811f-06be-41d0-863f-ceef2b57869c service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0971441 Dec 21 04:37:15.056860 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-507fddb9-3d59-453f-8e50-3daa373879e4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 1001 time: 0.0591116 Dec 21 04:37:15.116358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-3ca9b2e0-c55a-442e-84cb-13fc1c4c0609 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:15.117822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-3ca9b2e0-c55a-442e-84cb-13fc1c4c0609 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0486348 Dec 21 04:37:15.165038 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-be40b299-b8ae-44db-b86d-a0b6f0710265 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:37:15.168269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-be40b299-b8ae-44db-b86d-a0b6f0710265 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0413673 Dec 21 04:37:15.264543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-b85a4128-15e2-4ce9-8702-fb695ee78275 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893867 Dec 21 04:37:15.362190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-102fc30a-c3e4-403d-b8ef-072a83098284 req-b038d6f8-14fb-422e-afec-db9f143ee830 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901179 Dec 21 04:37:19.872587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b58e1b49-8819-49d0-bc4c-1cf65740b637 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:22.687564 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f33984d4-dd51-4697-adfe-ba7a433fd297 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:22.880343 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:37:23.226722 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:23.436115 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:25.207481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:25.252899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:25.787329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:37.776943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-f1f377a2-74c0-45ae-bbd8-fabe5b5286ea req-ffec961f-8854-4c93-b855-162219b5689b tempest-VolumesSnapshotTestJSON-1212227643 tempest-VolumesSnapshotTestJSON-1212227643-project] (110311) timed out ('10.222.0.54', 58390) {{(pid=110311) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 04:37:49.855083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f8f36a2-3398-4e85-b0eb-9e5273334573 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:52.706342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3211b7c6-a904-4b18-8519-8b3a9093adef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:53.241680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:53.432319 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:55.218827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:55.255098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:55.820494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:37:59.882425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:38:15.727867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-61b95db3-b214-4db1-840a-6682bfb1e284 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0408108 Dec 21 04:38:15.829606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-9953779f-a593-462a-b901-815c79350da9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:38:15.831159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-9953779f-a593-462a-b901-815c79350da9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0411916 Dec 21 04:38:15.936453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-f65bec02-c8eb-47be-b836-9ae9696a8afe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:38:15.937931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-f65bec02-c8eb-47be-b836-9ae9696a8afe service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0884242 Dec 21 04:38:16.008073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-9815ad37-716e-4d20-9c49-f81fb99dd551 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 1001 time: 0.0580928 Dec 21 04:38:16.064590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-c062c4a1-7a4f-42e9-9c05-932e4c105fb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:38:16.066016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-c062c4a1-7a4f-42e9-9c05-932e4c105fb6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0474961 Dec 21 04:38:16.112888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-8ec7ffd9-4a3a-4e71-a145-0d9556e52595 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:38:16.114347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-8ec7ffd9-4a3a-4e71-a145-0d9556e52595 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0396926 Dec 21 04:38:16.208780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-fb8a7489-ebac-4d53-840e-cd20e48351dd service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819471 Dec 21 04:38:16.309170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55577f59-bdbf-43f0-bcfc-cafbf00fa840 req-0a1c66b2-144e-43a9-90d5-74fd0b9da65c service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874624 Dec 21 04:38:19.870018 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e687f295-eb21-45e9-bad6-568bcb11f535 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:22.687055 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e6c284bd-77df-44c9-9fc3-a72a3d85bc9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:23.231507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:23.432013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:25.214346 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:25.246984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:25.795935 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:36.881060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:38:49.882851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a374aeb6-c018-493c-92b8-01018f45b55c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:52.711510 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fa09dc84-52a6-43e8-a871-2adc5f3cee14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:53.242569 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:53.402518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:55.208304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:55.235330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:38:55.802340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:13.880735 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:39:16.730114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-b62a272a-5558-4796-8d38-74ff1498e889 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0401912 Dec 21 04:39:16.838789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-d6225956-a610-428f-8fcd-66f340816653 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:16.840075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-d6225956-a610-428f-8fcd-66f340816653 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0409021 Dec 21 04:39:16.959841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-3b11c802-f20e-4bd4-92a8-d97d13b05716 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:16.961284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-3b11c802-f20e-4bd4-92a8-d97d13b05716 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0955801 Dec 21 04:39:17.036397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-df229fa1-bda6-4d4c-a329-47fb5d53e160 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 1001 time: 0.0628157 Dec 21 04:39:17.088469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-7a471c48-6687-4f85-b3be-95b24cd5a1ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:17.090249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-7a471c48-6687-4f85-b3be-95b24cd5a1ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0425768 Dec 21 04:39:17.157408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-d53126b1-2444-46b7-888e-89c00b6e73ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:17.158922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-d53126b1-2444-46b7-888e-89c00b6e73ab service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0416191 Dec 21 04:39:17.267663 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-44acb1a9-c96d-47bd-9fd0-47d2653f4317 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973363 Dec 21 04:39:17.360875 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb55f064-9830-4906-9f69-b9ded76efa32 req-abfd36ca-cd9c-42ca-8564-62f608c36846 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825408 Dec 21 04:39:19.875387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8248f2a-a7b4-4a87-82f0-5b9fe8f3a275 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:22.768200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-76dcd0bf-4baf-4f43-8e79-b5280672acf1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:23.242033 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:23.448321 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:25.242519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:25.258893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:25.813710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:41.203621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-e73bc6c6-dcf6-4562-af1c-9c9acbecfb94 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1552595983&fields=id&tenant_id=58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 267 time: 0.0435014 Dec 21 04:39:41.312458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f8f4d24b-c805-43e3-a998-db23831cb8ae tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:41.313976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f8f4d24b-c805-43e3-a998-db23831cb8ae tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1029172 Dec 21 04:39:41.329448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-0b95e240-3c0a-4400-ada4-1dc2a0d319de tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/quotas/58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 375 time: 0.0088358 Dec 21 04:39:41.381356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-224ed4d5-1aaa-45a0-bbf9-6528372c0645 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0466278 Dec 21 04:39:41.478413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-5eaacd8e-248a-4091-8f47-979b5addcf7c service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852160 Dec 21 04:39:41.565260 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-5a1272f4-4f83-430c-aa7b-19f723b5472e service neutron] 10.222.0.18 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807257 Dec 21 04:39:42.122722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9c1aca7-295c-4503-8c04-6218c4216a06 req-f15f9a7c-585e-415a-934a-a1cbd5d4dcd5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0320969 Dec 21 04:39:43.221281 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23037324-4af8-43cf-9caf-15c7033b46c2 req-ad86cd6b-fb7d-4222-8ace-c8f165e67227 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0266955 Dec 21 04:39:44.164990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-03399797-0ab2-45ba-aa45-0b5df464ed11 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:44.166533 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-03399797-0ab2-45ba-aa45-0b5df464ed11 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 812 time: 0.1067474 Dec 21 04:39:44.240299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-0a168345-3123-4587-87f9-c07509639776 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=58b4b41701714161aa0a78adc3f5ff66 HTTP/1.1" status: 200 len: 380 time: 0.0587671 Dec 21 04:39:44.251726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'port': {'device_id': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'admin_state_up': True, 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'security_groups': ['0a9eab09-71e8-4468-82c6-b69ddd8f076b']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:39:44.320828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23703152-9952-4a14-93bc-8b3b3761ab76 req-9dc974e1-0a20-4f26-9d9b-4db502b5d449 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0272043 Dec 21 04:39:44.498140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Made reservation on behalf of 58b4b41701714161aa0a78adc3f5ff66 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:39:44.501820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:44.633589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.20.0.14 (2c8a03ed-591d-40ac-889b-d93086a1e436/ac2bd887-ab04-4643-8e7a-49082c17e848/f7678683-8f68-49ea-8ed8-d401d4914c70) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:39:44.769770 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:44.852873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:44.896415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:39:44.899622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:39:44.903289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:39:44.928303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=f7678683-8f68-49ea-8ed8-d401d4914c70,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:39:44.942289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.942651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.943016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.943456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.943751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.944089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.944424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.944754 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.945080 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.945405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.945729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.946052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.946382 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:44.971064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:44.971641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.079739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-f3992864-21fb-4ec0-8d3d-0a38e85a3abf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8323579 Dec 21 04:39:45.092861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-ac5f1ee8-7482-4213-b91e-576743a432cb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:39:45.093911 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-ac5f1ee8-7482-4213-b91e-576743a432cb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0061765 Dec 21 04:39:45.196908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-73584c0a-d5fa-43cd-88e1-410c07dcee06 None None] Provisioning complete for port f7678683-8f68-49ea-8ed8-d401d4914c70 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:39:45.197475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-73584c0a-d5fa-43cd-88e1-410c07dcee06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.224033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Request body: {'port': {'device_id': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:39:45.234610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-73584c0a-d5fa-43cd-88e1-410c07dcee06 None None] Port f7678683-8f68-49ea-8ed8-d401d4914c70 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:39:45.280566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.442679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c04634a6-af49-484b-9733-8010a8316303 req-d62cd96c-2de4-48c9-8fc0-8a2d345db5db tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:45.444250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c04634a6-af49-484b-9733-8010a8316303 req-d62cd96c-2de4-48c9-8fc0-8a2d345db5db tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 932 time: 0.0520995 Dec 21 04:39:45.497924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c04634a6-af49-484b-9733-8010a8316303 req-1c2e6d3d-3bcd-4309-839e-a9b1047c0510 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451095 Dec 21 04:39:45.549871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f7678683-8f68-49ea-8ed8-d401d4914c70 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:39:45.557334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.569796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Transition to ACTIVE for port object f7678683-8f68-49ea-8ed8-d401d4914c70 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:39:45.630859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.680258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Pushing event updated for resources: {'Port': ['ID=f7678683-8f68-49ea-8ed8-d401d4914c70,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:39:45.756309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Attempting to bind port f7678683-8f68-49ea-8ed8-d401d4914c70 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:39:45.756780 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Attempting to bind port f7678683-8f68-49ea-8ed8-d401d4914c70 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:39:45.757121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Attempting to bind port f7678683-8f68-49ea-8ed8-d401d4914c70 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:39:45.762045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Port f7678683-8f68-49ea-8ed8-d401d4914c70 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:39:45.762374 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Attempting to bind port f7678683-8f68-49ea-8ed8-d401d4914c70 on network 2c8a03ed-591d-40ac-889b-d93086a1e436 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:39:45.767630 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 39, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:39:45.767975 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Checking segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:39:45.768371 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Bound using segment: {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:39:45.768800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Bound port: f7678683-8f68-49ea-8ed8-d401d4914c70, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '173aa79c-71ed-4484-bccf-831b4729873e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:39:45.769159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.839151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] For port f7678683-8f68-49ea-8ed8-d401d4914c70, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:39:45.842395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] For port f7678683-8f68-49ea-8ed8-d401d4914c70, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f7678683-8f68-49ea-8ed8-d401d4914c70,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:39:45.905329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.945157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:45.945157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:45.948735 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] 10.222.0.54 "PUT /v2.0/ports/f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 200 len: 1093 time: 0.8385644 Dec 21 04:39:45.951196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:39:45.953425 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3ed4c586ef080839469f58230c206466186513e7123e2deb2f5f457df0994371" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee143815-745b-4010-a33e-79eab61eb0ac" -d '{"events": [{"name": "network-changed", "server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:39:45.987746 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f85603c-e409-4b78-8f98-e843ee316861 service neutron] Pushing event updated for resources: {'Port': ['ID=f7678683-8f68-49ea-8ed8-d401d4914c70,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:39:46.010795 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:39:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8afd9062-b0f6-4f76-b2f9-d16a08a6a9d9 x-openstack-request-id: req-8afd9062-b0f6-4f76-b2f9-d16a08a6a9d9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:39:46.011168 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:39:46.015927 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8afd9062-b0f6-4f76-b2f9-d16a08a6a9d9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:39:46.015927 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'status': 'completed', 'code': 200} Dec 21 04:39:46.104253 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee143815-745b-4010-a33e-79eab61eb0ac req-0eaef225-8ea0-4c65-8861-b06a8d50da99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.105675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ee143815-745b-4010-a33e-79eab61eb0ac req-0eaef225-8ea0-4c65-8861-b06a8d50da99 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1096 time: 0.0450222 Dec 21 04:39:46.224757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee143815-745b-4010-a33e-79eab61eb0ac req-b63c517c-6bb6-4a6c-a6eb-839206a72cda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.226239 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ee143815-745b-4010-a33e-79eab61eb0ac req-b63c517c-6bb6-4a6c-a6eb-839206a72cda service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=58b4b41701714161aa0a78adc3f5ff66&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1061964 Dec 21 04:39:46.325577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee143815-745b-4010-a33e-79eab61eb0ac req-ce423923-9550-48b3-8b26-a70611567ad7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.326999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ee143815-745b-4010-a33e-79eab61eb0ac req-ce423923-9550-48b3-8b26-a70611567ad7 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0928001 Dec 21 04:39:46.430514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-5fb6c275-d57b-4762-8acd-b4fe16cdbe0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.432050 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-5fb6c275-d57b-4762-8acd-b4fe16cdbe0a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1096 time: 0.0436080 Dec 21 04:39:46.481428 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-e4996dfb-fbf4-44da-bc99-ec4c18ad01c8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 200 len: 217 time: 0.0359497 Dec 21 04:39:46.531502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6a8bfe24-544a-40b7-88ab-723a21bd3f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.532969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-6a8bfe24-544a-40b7-88ab-723a21bd3f05 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0451632 Dec 21 04:39:46.591480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-c7947a80-44ec-4bbc-9275-1932de1c14b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.592962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-c7947a80-44ec-4bbc-9275-1932de1c14b6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0506482 Dec 21 04:39:46.626504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2afc722a-bbb1-422c-b3f3-86cb8079d2d8 req-be603dc7-a313-4ae6-942c-cbd0d199ff53 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:46.628123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2afc722a-bbb1-422c-b3f3-86cb8079d2d8 req-be603dc7-a313-4ae6-942c-cbd0d199ff53 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0550809 Dec 21 04:39:46.681794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2afc722a-bbb1-422c-b3f3-86cb8079d2d8 req-32dc03f1-f622-4c39-8dcf-f38082d6191b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459547 Dec 21 04:39:46.690855 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-951c23ee-d84e-4d38-a090-6aaadc4fc741 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904741 Dec 21 04:39:46.797887 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b1eb058f-e0a0-4792-9907-acded81baac0 req-82e3a7d7-695b-4705-99e5-bb32e78529be service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0980124 Dec 21 04:39:47.805626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7b4ed7-9208-4bd6-8c88-d415c80ceb56 req-e96a3555-6c2b-4aea-82f8-ff449e654ab1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:47.807160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db7b4ed7-9208-4bd6-8c88-d415c80ceb56 req-e96a3555-6c2b-4aea-82f8-ff449e654ab1 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0553989 Dec 21 04:39:47.859091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db7b4ed7-9208-4bd6-8c88-d415c80ceb56 req-6819895f-81a9-4599-8863-984a3d4dfe28 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431008 Dec 21 04:39:48.973888 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329ea768-eec1-4018-9918-40d06288ceb3 req-334434f7-28e8-49e0-8d8e-973aa4be8ecf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:48.975401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-329ea768-eec1-4018-9918-40d06288ceb3 req-334434f7-28e8-49e0-8d8e-973aa4be8ecf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0483298 Dec 21 04:39:49.028613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-329ea768-eec1-4018-9918-40d06288ceb3 req-a70ffd65-bdd5-45a3-842d-90bd98f81fbc tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472746 Dec 21 04:39:49.920928 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a2831e4-0c9f-4ae2-870f-f8e1052e40a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:50.150104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef6455c-d59f-4776-be28-f4ad23e374e8 req-8464e80b-07bc-41d1-a866-69c76b169b6e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:50.151617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ef6455c-d59f-4776-be28-f4ad23e374e8 req-8464e80b-07bc-41d1-a866-69c76b169b6e tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0486264 Dec 21 04:39:50.203257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ef6455c-d59f-4776-be28-f4ad23e374e8 req-90c0c4f2-0b90-4dec-be2a-bec2b1bb9837 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447874 Dec 21 04:39:50.882321 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:39:51.315336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4a289a-c6b9-47bd-a3c2-2aaf3c5a75a9 req-4a828550-f3c0-4af5-a13b-f1b8396a44c5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:51.316802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f4a289a-c6b9-47bd-a3c2-2aaf3c5a75a9 req-4a828550-f3c0-4af5-a13b-f1b8396a44c5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0482588 Dec 21 04:39:51.365521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f4a289a-c6b9-47bd-a3c2-2aaf3c5a75a9 req-6818a2d9-1b2b-496a-bfd2-6d9d8e6b6314 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427253 Dec 21 04:39:52.486734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b3d7a9-031d-4093-8517-97641c243d75 req-0dd1eb2c-4267-4d68-ab2f-94bfca6ffa1c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:52.488380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16b3d7a9-031d-4093-8517-97641c243d75 req-0dd1eb2c-4267-4d68-ab2f-94bfca6ffa1c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0524771 Dec 21 04:39:52.536668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16b3d7a9-031d-4093-8517-97641c243d75 req-8cc0197a-dfa8-471b-8c0e-60d58d71dc2c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419712 Dec 21 04:39:52.698475 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f34caa70-9070-4749-ba90-74a5b63fffce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:53.241679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:53.429722 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:53.653351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067cfae6-a231-4abe-9040-8ef53e5f489d req-c0427c0c-5963-4552-b226-19a20651c4ea tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:53.654854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-067cfae6-a231-4abe-9040-8ef53e5f489d req-c0427c0c-5963-4552-b226-19a20651c4ea tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0484879 Dec 21 04:39:53.705877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-067cfae6-a231-4abe-9040-8ef53e5f489d req-2701316e-5a55-4b1d-bdf5-1eaafaf5f109 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440671 Dec 21 04:39:54.820702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9217a840-579b-46e5-bf4f-970cf097ece9 req-f06c29c8-68f3-4c13-995e-455640e49fc5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:54.822157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9217a840-579b-46e5-bf4f-970cf097ece9 req-f06c29c8-68f3-4c13-995e-455640e49fc5 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0485830 Dec 21 04:39:54.873337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9217a840-579b-46e5-bf4f-970cf097ece9 req-ad2f9be5-129c-4a35-9487-dd5ded458ef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452113 Dec 21 04:39:55.184301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:55.217827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:55.790085 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:55.988975 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d126814e-5717-4354-b7e6-bd85a8839dba req-84d7449f-953f-464f-8b5f-fd5a45a3621d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:55.991109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d126814e-5717-4354-b7e6-bd85a8839dba req-84d7449f-953f-464f-8b5f-fd5a45a3621d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0499306 Dec 21 04:39:56.040834 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d126814e-5717-4354-b7e6-bd85a8839dba req-838f0d02-7727-4ebd-a401-d4a7dc9dd96b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437338 Dec 21 04:39:57.155783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0be1a41-d88a-4ab9-84df-a6a23b9af0fd req-4403885b-9f2a-4f7a-be58-a23d42b1d8b3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:57.157263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0be1a41-d88a-4ab9-84df-a6a23b9af0fd req-4403885b-9f2a-4f7a-be58-a23d42b1d8b3 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0495765 Dec 21 04:39:57.206035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0be1a41-d88a-4ab9-84df-a6a23b9af0fd req-c44cd447-6c60-4c7a-9b9d-967cefe47010 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427928 Dec 21 04:39:58.323035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c7f3da-4b87-4e23-8689-185e286c0e1d req-26e8319a-416b-416a-bbaf-f715a590cf50 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:58.324521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0c7f3da-4b87-4e23-8689-185e286c0e1d req-26e8319a-416b-416a-bbaf-f715a590cf50 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 944 time: 0.0516689 Dec 21 04:39:58.372430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0c7f3da-4b87-4e23-8689-185e286c0e1d req-213a1053-e091-4b1a-b6dc-a8e08b914c92 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417881 Dec 21 04:39:58.691393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f7678683-8f68-49ea-8ed8-d401d4914c70 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:39:58.781981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f7678683-8f68-49ea-8ed8-d401d4914c70, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f7678683-8f68-49ea-8ed8-d401d4914c70,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:39:58.792496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'port_id': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'mac_address': 'fa:16:3e:70:a9:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:39:58.829067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:58.841562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f7678683-8f68-49ea-8ed8-d401d4914c70 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:39:58.860144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f7678683-8f68-49ea-8ed8-d401d4914c70, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f7678683-8f68-49ea-8ed8-d401d4914c70,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:39:58.938457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:39:58.987401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=f7678683-8f68-49ea-8ed8-d401d4914c70,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:39:58.995160 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.995572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.995919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.996259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.996594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.996924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.997252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.997579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.997904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.998227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.998551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.998871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:58.999220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:39:59.240642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['f7678683-8f68-49ea-8ed8-d401d4914c70'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:39:59.486443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bb8c99-ffb9-4af3-845f-d981a7bf68a1 req-8e0d1658-159e-43dd-b748-f1e84264c294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:39:59.488052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5bb8c99-ffb9-4af3-845f-d981a7bf68a1 req-8e0d1658-159e-43dd-b748-f1e84264c294 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 945 time: 0.0481467 Dec 21 04:39:59.537200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b5bb8c99-ffb9-4af3-845f-d981a7bf68a1 req-7dfb8264-e84a-46d5-a265-3bc57b8cb23a tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430918 Dec 21 04:40:00.656563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c4a7aa-09cc-409e-829a-bc8dc3f4b581 req-de4a6080-d62c-4f71-9731-666ca7d2cd00 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:00.658041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c4a7aa-09cc-409e-829a-bc8dc3f4b581 req-de4a6080-d62c-4f71-9731-666ca7d2cd00 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 945 time: 0.0523763 Dec 21 04:40:00.707193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6c4a7aa-09cc-409e-829a-bc8dc3f4b581 req-ebaf860f-eff9-4715-8474-362664cc3d70 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429366 Dec 21 04:40:00.719224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f7678683-8f68-49ea-8ed8-d401d4914c70 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:40:00.841328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port f7678683-8f68-49ea-8ed8-d401d4914c70 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:40:00.845030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port f7678683-8f68-49ea-8ed8-d401d4914c70 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:40:00.845408 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:00.922594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:00.944516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:40:00.947320 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eba4b85a349eca4b558b5e6123f698aff0056608ab02d1018ce2be950da0b69e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56e7dbd0-79ca-4c7e-899a-5ad8178f8e2b" -d '{"events": [{"server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "name": "network-vif-plugged", "status": "completed", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:40:00.960167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port f7678683-8f68-49ea-8ed8-d401d4914c70, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f7678683-8f68-49ea-8ed8-d401d4914c70,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:40:00.984378 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:40:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3b1ced7-8af6-45e6-a109-50c41319bc9d x-openstack-request-id: req-a3b1ced7-8af6-45e6-a109-50c41319bc9d {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:40:00.984670 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "name": "network-vif-plugged", "status": "completed", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:40:00.984932 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a3b1ced7-8af6-45e6-a109-50c41319bc9d {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:40:00.985326 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'code': 200} Dec 21 04:40:01.052630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:01.099695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=f7678683-8f68-49ea-8ed8-d401d4914c70,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:40:01.117866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7eab9ba-6723-4be4-8c4a-4c6ae9cda092 req-19e91403-490c-4297-b4f4-035d4b0086b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:01.119399 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7eab9ba-6723-4be4-8c4a-4c6ae9cda092 req-19e91403-490c-4297-b4f4-035d4b0086b5 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1098 time: 0.0419919 Dec 21 04:40:01.166034 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b7eab9ba-6723-4be4-8c4a-4c6ae9cda092 req-e8fa22b5-0a3c-43e6-8887-41883d315a56 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391498 Dec 21 04:40:01.822878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38eed666-a1a2-4fe0-8fef-1700bbf95ec7 req-89ceb425-c6c9-4006-81ea-07741f86ad8c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:01.824368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38eed666-a1a2-4fe0-8fef-1700bbf95ec7 req-89ceb425-c6c9-4006-81ea-07741f86ad8c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 946 time: 0.0481355 Dec 21 04:40:01.872633 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38eed666-a1a2-4fe0-8fef-1700bbf95ec7 req-5903da85-5e98-4765-8e1a-cb860bc81ba7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419552 Dec 21 04:40:02.992954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0518632-1655-4b2f-9b6d-b91242b6cd45 req-91cb764f-465c-4f13-a8c4-92825c5cafe9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:02.994406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0518632-1655-4b2f-9b6d-b91242b6cd45 req-91cb764f-465c-4f13-a8c4-92825c5cafe9 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 946 time: 0.0493636 Dec 21 04:40:03.049862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0518632-1655-4b2f-9b6d-b91242b6cd45 req-41c02607-3800-422b-8689-a3c574645ab7 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492947 Dec 21 04:40:03.172691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0933f6-9b2e-46fd-b57e-50765a77c462 req-e1882cd6-5687-4071-8ac6-d9d895f1430c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:03.174156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae0933f6-9b2e-46fd-b57e-50765a77c462 req-e1882cd6-5687-4071-8ac6-d9d895f1430c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 946 time: 0.0528839 Dec 21 04:40:03.222656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae0933f6-9b2e-46fd-b57e-50765a77c462 req-177ffacc-5c7e-4e3a-a941-d4239f72228b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424392 Dec 21 04:40:03.245475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47466) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:40:03.284506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-518c72d7-c16c-46ef-8e75-49df48b28111 tempest-TestVolumeBootPattern-1744010602 tempest-TestVolumeBootPattern-1744010602-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:03.286094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-518c72d7-c16c-46ef-8e75-49df48b28111 tempest-TestVolumeBootPattern-1744010602 tempest-TestVolumeBootPattern-1744010602-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1093 time: 0.0396993 Dec 21 04:40:03.288842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:40:03.292999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:40:03.407250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:03.807738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:03.910238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Allocated IP 172.25.5.199 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/13f99b99-5767-4b50-bfdc-1da3af73fbea) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:40:04.017222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:04.104680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:04.144790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:40:04.147654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:40:04.151245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:40:04.172812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=13f99b99-5767-4b50-bfdc-1da3af73fbea,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:40:04.190476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.190831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.191204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.191547 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.191893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.192230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.192562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.192892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.193221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.193548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.193910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.194245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.194572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:40:04.516960 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:04.665500 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:04.810981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:04.887198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:04.958986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event updated for resources: {'Port': ['ID=13f99b99-5767-4b50-bfdc-1da3af73fbea,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:40:04.969595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:05.069142 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Floating IP 92e60a56-f226-4b72-ade6-1f8364e73046 associated. External IP: 172.25.5.199, port: f7678683-8f68-49ea-8ed8-d401d4914c70. Dec 21 04:40:05.275771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:40:05.383928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:40:05.393953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:40:05.402665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:40:05.403306 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:39:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:40:05.495431 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:05.524748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8f1d3be1-ab56-4b31-a5e1-a4d50203fa35 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2348592 Dec 21 04:40:05.525358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:40:05.527999 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}fa225c411ef3f79664bfec0e63bf56ca722650319e2e059c896a5ce88d57a9d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b565114-fcc4-4912-9490-cd96a3770f8f" -d '{"events": [{"name": "network-changed", "server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:40:05.568346 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:40:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d4c7660-c9d1-44fe-9a8d-4fd9b9f48e98 x-openstack-request-id: req-9d4c7660-c9d1-44fe-9a8d-4fd9b9f48e98 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:40:05.568638 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:40:05.568890 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9d4c7660-c9d1-44fe-9a8d-4fd9b9f48e98 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:40:05.569294 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'status': 'completed', 'code': 200} Dec 21 04:40:05.657506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-1db74145-3d3a-4604-aa6a-3c1ee4b320bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:05.658912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-1db74145-3d3a-4604-aa6a-3c1ee4b320bc service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1098 time: 0.0397937 Dec 21 04:40:05.667966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:40:05.760567 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-77b8f065-158e-4f72-be34-35bd4f692e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:05.762083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-77b8f065-158e-4f72-be34-35bd4f692e26 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0955744 Dec 21 04:40:05.837119 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-512300e0-2def-45f6-af90-c88d3491cf6d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 200 len: 1000 time: 0.0626462 Dec 21 04:40:05.888239 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-3c1081c4-42b8-4544-8021-fc7e238e51fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:05.889943 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-3c1081c4-42b8-4544-8021-fc7e238e51fc service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0447795 Dec 21 04:40:05.908388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:37:00Z', 'revision_number': 1, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}, {'id': '92e60a56-f226-4b72-ade6-1f8364e73046', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.199', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4034, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:70:a9:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:40:04Z', 'updated_at': '2021-12-21T04:40:04Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:40:05.935509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:40:05.937750 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-183f6afd-a6ea-4e0b-92b3-d1e0a2c2c3b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:05.939280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-183f6afd-a6ea-4e0b-92b3-d1e0a2c2c3b4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0416632 Dec 21 04:40:05.943921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:40:05.944520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:39:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:40:06.041231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-840e52ad-56e4-425a-9819-0b79b4e90911 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929260 Dec 21 04:40:06.054425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:40:06.131146 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b565114-fcc4-4912-9490-cd96a3770f8f req-5505133f-22e9-422d-9a1a-3731b40cfdd2 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827513 Dec 21 04:40:06.284892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:37:00Z', 'revision_number': 1, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}, {'id': '92e60a56-f226-4b72-ade6-1f8364e73046', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.199', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4034, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:70:a9:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:40:04Z', 'updated_at': '2021-12-21T04:40:04Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:40:06.311590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fac1616-29af-4f26-ac8f-d6c84ca58fbe None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:37:00Z', 'revision_number': 1, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}, {'id': '92e60a56-f226-4b72-ade6-1f8364e73046', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.199', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4034, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:70:a9:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:40:04Z', 'updated_at': '2021-12-21T04:40:04Z', 'revision_number': 0, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:40:06.503574 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09dbfb0a-8364-4931-bf3f-8e623027db3d None None] New status for floating IP 92e60a56-f226-4b72-ade6-1f8364e73046: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:40:17.732766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-76029d34-aed4-4495-bc19-03c8995028aa service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0397060 Dec 21 04:40:17.830444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-d2c7a3b3-90d2-4300-917b-7ceef6b7cd70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:17.831975 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-d2c7a3b3-90d2-4300-917b-7ceef6b7cd70 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0400312 Dec 21 04:40:17.944879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-e8447056-2ac4-4c7d-bfaa-efe8c4949754 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:17.946323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-e8447056-2ac4-4c7d-bfaa-efe8c4949754 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0862737 Dec 21 04:40:18.014483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-0eb69204-7806-4884-ab35-77c1f1a2c885 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 1001 time: 0.0572870 Dec 21 04:40:18.072236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-870c1f6d-4ace-4da0-b8dc-616a75334728 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:18.073687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-870c1f6d-4ace-4da0-b8dc-616a75334728 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0475664 Dec 21 04:40:18.128992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-a2bd7a1b-d65c-4641-99ff-48963fc9486c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:18.130467 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-a2bd7a1b-d65c-4641-99ff-48963fc9486c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0453072 Dec 21 04:40:18.224157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-46e84290-280a-43bc-ae3a-f0ff2d7687cf service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802145 Dec 21 04:40:18.321024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16360380-7d4d-4945-b8f8-3a17b4b3c16f req-79de813d-bcb4-4dd4-bf13-1836be1d36c8 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854135 Dec 21 04:40:19.875562 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0af66760-b699-4ddb-a853-d6e3f3202ff0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:22.692759 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa10acd0-561c-4599-b880-be9aee1f4912 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:23.229847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:23.441064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:25.212330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:25.224108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:25.777956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:27.882301 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:40:31.466358 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-61d486b1-090a-4beb-bc9b-bbc224b1fd55 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0391498 Dec 21 04:40:31.575076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-5550d9ea-970e-4daa-b70e-4ea4db8e54b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:31.576574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-5550d9ea-970e-4daa-b70e-4ea4db8e54b8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1098 time: 0.0513802 Dec 21 04:40:31.681457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-7c8f7f7b-8b1e-4baf-b97b-347278bb8261 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:31.683352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-7c8f7f7b-8b1e-4baf-b97b-347278bb8261 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0863910 Dec 21 04:40:31.762461 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-b71bb3ae-e59e-44f7-97e8-7782abf2c169 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 200 len: 1002 time: 0.0715210 Dec 21 04:40:31.815721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-b5dcced1-901b-483e-aab0-55c801896305 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:31.817238 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-b5dcced1-901b-483e-aab0-55c801896305 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0478644 Dec 21 04:40:31.870455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-2db5083c-052a-4f4a-9fa4-f9ef45e2e5e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:40:31.872271 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-2db5083c-052a-4f4a-9fa4-f9ef45e2e5e5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0405128 Dec 21 04:40:31.967479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-7ca443fc-ac60-488f-917a-9a92e974437e service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876272 Dec 21 04:40:32.065284 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a4b496a3-f7c9-4d93-8a09-679ebb2d4331 req-ac7cdb07-9191-439b-b7cb-7049ebc5bb23 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902317 Dec 21 04:40:49.931651 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a51f26de-2ff4-45ab-9522-2c260634a0a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:52.698039 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad7dafd4-d3ca-4750-a050-0e814be80cfc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:53.263153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:53.417380 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:55.189482 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:55.223720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:40:55.817524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:04.880776 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:41:19.826326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-6c7b496c-249a-490f-b2d4-78be35321639 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0854084 Dec 21 04:41:19.863402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a812be61-89df-4a1e-8e19-c2d419d8b50c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:19.944816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-1c3201c7-ec54-4967-a3c0-eade7db6a92a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:19.946364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-1c3201c7-ec54-4967-a3c0-eade7db6a92a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0432792 Dec 21 04:41:20.061478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-6e43051e-7834-4d27-ae1d-698e89a56db3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:20.063008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-6e43051e-7834-4d27-ae1d-698e89a56db3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0891340 Dec 21 04:41:20.133805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-7d545d2b-196a-4ae8-8667-8fe36787a063 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 1001 time: 0.0598686 Dec 21 04:41:20.191581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-aeb5b252-9a27-41df-8d0e-769e55909024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:20.193123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-aeb5b252-9a27-41df-8d0e-769e55909024 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0483260 Dec 21 04:41:20.244570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-8194fe4d-62e9-44bb-bbba-4e06d1c115fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:20.246021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-8194fe4d-62e9-44bb-bbba-4e06d1c115fe service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0413589 Dec 21 04:41:20.344791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-66272101-6e5c-420f-b953-52e8cd5cd1ab service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871906 Dec 21 04:41:20.440165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41fb1465-923c-45c0-b2e2-38c7fc99d38e req-666c3033-e2ca-4663-8aef-bcaadde523cd service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839937 Dec 21 04:41:22.663725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fbad0475-1c65-462a-b1bc-8e68be02897f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:23.246125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:23.417560 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:25.196156 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:25.234587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:25.829055 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:33.546156 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-314209a4-dcce-431f-9513-ba1fda883fd6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0805905 Dec 21 04:41:33.644655 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-820d2df3-9b23-407f-8394-6c089c3c98a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:33.646142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-820d2df3-9b23-407f-8394-6c089c3c98a1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1098 time: 0.0398839 Dec 21 04:41:33.746209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-9436828a-8855-4bc7-a9c1-16f446943c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:33.747605 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-9436828a-8855-4bc7-a9c1-16f446943c42 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0827386 Dec 21 04:41:33.815545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-935783d8-ebd4-4e5b-be55-d29cc24ec8a3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 200 len: 1002 time: 0.0605845 Dec 21 04:41:33.867214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-14913260-ad57-4da8-b22b-b3b4b41ffd90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:33.868655 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-14913260-ad57-4da8-b22b-b3b4b41ffd90 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0462871 Dec 21 04:41:33.913643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-24d48dc4-d834-41fc-8bdf-50bb1fcb37c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:33.915128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-24d48dc4-d834-41fc-8bdf-50bb1fcb37c4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0392673 Dec 21 04:41:34.006269 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-5dbd0dc4-ac90-4e29-af39-4f31de312038 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841541 Dec 21 04:41:34.099998 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d8f5fca4-d8c4-4ab0-ae68-4a0bf74cc0c0 req-7781fb5b-4a9a-42f6-9e05-acb8b237b4cd service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870898 Dec 21 04:41:41.882585 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:41:49.892513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48ed627c-5a7a-4074-93e3-17795a5fca65 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:52.697164 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57d568cf-d106-4b72-bb4d-eee9f67d7405 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:53.263342 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:53.429067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:55.222125 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:55.244727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:55.643717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47506) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:41:55.805791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:55.902757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port 13f99b99-5767-4b50-bfdc-1da3af73fbea {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:41:55.903031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:55.988368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:55.988698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:56.000197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for 13f99b99-5767-4b50-bfdc-1da3af73fbea owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:41:56.229192 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:56.258054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=13f99b99-5767-4b50-bfdc-1da3af73fbea,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:41:56.285013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.294460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:56.327155 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:56.327495 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Floating IP 92e60a56-f226-4b72-ade6-1f8364e73046 disassociated (deleted). External IP: 172.25.5.199, port: f7678683-8f68-49ea-8ed8-d401d4914c70. Dec 21 04:41:56.533868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:41:56.941597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:41:56.946219 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:56.950690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:41:56.959761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:41:56.960376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:41:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:41:56.972982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e85ec19a-1623-4a1d-b1b2-b27bcfe1fef4 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "DELETE /v2.0/floatingips/92e60a56-f226-4b72-ade6-1f8364e73046 HTTP/1.1" status: 204 len: 168 time: 1.3281400 Dec 21 04:41:56.973588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:41:57.074568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:41:57.124863 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27dda598-b688-47d2-af2a-656ff8ecafe5" -d '{"events": [{"name": "network-changed", "server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:41:57.256902 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:41:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13900133-9bc9-44d4-9357-6bebd3dfc5a9 x-openstack-request-id: req-13900133-9bc9-44d4-9357-6bebd3dfc5a9 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:41:57.260599 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:41:57.260599 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-13900133-9bc9-44d4-9357-6bebd3dfc5a9 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:41:57.260599 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'status': 'completed', 'code': 200} Dec 21 04:41:57.312917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:37:00Z', 'revision_number': 1, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:41:57.342221 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-b5714f24-ceef-4a04-910a-8361c114d776 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:57.343745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:41:57.343883 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-b5714f24-ceef-4a04-910a-8361c114d776 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 1098 time: 0.0415063 Dec 21 04:41:57.353065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:41:57.353692 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:41:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:41:57.443539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-d39a0f29-8efb-449e-be04-04015d020862 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:57.445490 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-d39a0f29-8efb-449e-be04-04015d020862 service neutron] 10.222.0.54 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.0932946 Dec 21 04:41:57.459434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:41:57.495027 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-128e1b51-9bdc-4694-b190-6fb6c85269bc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 200 len: 217 time: 0.0409865 Dec 21 04:41:57.523668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286a9b40-7cdf-4b83-918b-5d063243759f req-a727239a-8e08-409f-a970-b1051734c288 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:57.525149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-286a9b40-7cdf-4b83-918b-5d063243759f req-a727239a-8e08-409f-a970-b1051734c288 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 946 time: 0.1029909 Dec 21 04:41:57.549048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-f8ec3488-e415-4d43-aed9-e12da29f1f07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:57.550547 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-f8ec3488-e415-4d43-aed9-e12da29f1f07 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0478914 Dec 21 04:41:57.580521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-286a9b40-7cdf-4b83-918b-5d063243759f req-a42c5767-bdb3-4c1f-846b-71998c9d6fe8 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480704 Dec 21 04:41:57.597345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-6c3fdba7-a96b-4975-aec7-fa11057f7e80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:57.598841 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-6c3fdba7-a96b-4975-aec7-fa11057f7e80 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0410297 Dec 21 04:41:57.689332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:37:00Z', 'revision_number': 1, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:41:57.691343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-375cd293-9e7d-42ce-9239-5e92df91ad0c service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843387 Dec 21 04:41:57.715891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25cbf7ae-36a9-47f7-a9a1-0a42455fb5ad None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '91a17a9e-af06-4345-a11f-9b0b09cf89e6', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'floating_ip_address': '172.25.5.110', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'port_id': '29105788-9a26-4cbb-bd40-1e033f7557da', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'mac_address': 'fa:16:3e:2b:fa:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:36:58Z', 'updated_at': '2021-12-21T04:37:00Z', 'revision_number': 1, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:41:57.783499 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-27dda598-b688-47d2-af2a-656ff8ecafe5 req-d1f75761-5c29-493e-91ea-86045a5436b1 service neutron] 10.222.0.54 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848825 Dec 21 04:41:57.940466 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26cadab8-29f4-44de-a32e-68230d817bbc None None] New status for floating IP 92e60a56-f226-4b72-ade6-1f8364e73046: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:41:58.817399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ea193a-2df1-4f2e-b734-8eb3cd8bd85e req-b27d0939-7cab-4db0-8723-524fe9a8612b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:58.818754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ea193a-2df1-4f2e-b734-8eb3cd8bd85e req-b27d0939-7cab-4db0-8723-524fe9a8612b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 946 time: 0.0955524 Dec 21 04:41:58.867399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66ea193a-2df1-4f2e-b734-8eb3cd8bd85e req-b80a0f8d-508f-42b8-a33a-0b7a2b458432 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427825 Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:41:59.100368 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:41:59.104725 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-70c8cbbd-e78a-4264-a19f-06e959e1d10f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:41:59.106157 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-70c8cbbd-e78a-4264-a19f-06e959e1d10f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 946 time: 0.0526922 Dec 21 04:41:59.464496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port f7678683-8f68-49ea-8ed8-d401d4914c70 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:41:59.464837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:59.551912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port f7678683-8f68-49ea-8ed8-d401d4914c70, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=f7678683-8f68-49ea-8ed8-d401d4914c70,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:41:59.552271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:59.564422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for f7678683-8f68-49ea-8ed8-d401d4914c70 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:41:59.766289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:59.793169 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=f7678683-8f68-49ea-8ed8-d401d4914c70,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:41:59.803565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.803915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.804252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.804589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.804968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.805303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.805632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.806442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.806442 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.806615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.806877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.807230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.807550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:41:59.847431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port f7678683-8f68-49ea-8ed8-d401d4914c70 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:41:59.850000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:41:59.853453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8162a55c-0d51-4d7c-bed1-d495846059ff req-5f183181-1f9c-4883-96f1-676eff57da45 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.54 "DELETE /v2.0/ports/f7678683-8f68-49ea-8ed8-d401d4914c70 HTTP/1.1" status: 204 len: 173 time: 0.7406652 Dec 21 04:41:59.853882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'name': 'network-vif-deleted', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:41:59.893060 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4dd81daf-4d89-4353-b3de-0af52edfef7d" -d '{"events": [{"server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "name": "network-vif-deleted", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:41:59.972364 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eea61e3a-08a6-46d6-9d0d-2b8b48248fae req-c4c0bc77-0ee3-4028-a9f3-0882fb9b47e0 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0310605 Dec 21 04:41:59.989931 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:41:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05d393cf-9443-41dc-995b-c2b7b27a3909 x-openstack-request-id: req-05d393cf-9443-41dc-995b-c2b7b27a3909 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:41:59.990226 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29e07b90-ad10-47f0-a900-45bdf16a6777", "name": "network-vif-deleted", "tag": "f7678683-8f68-49ea-8ed8-d401d4914c70", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:41:59.990474 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-05d393cf-9443-41dc-995b-c2b7b27a3909 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:41:59.990871 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29e07b90-ad10-47f0-a900-45bdf16a6777', 'name': 'network-vif-deleted', 'tag': 'f7678683-8f68-49ea-8ed8-d401d4914c70', 'status': 'completed', 'code': 200} Dec 21 04:42:01.067226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11ef2327-c744-482c-9490-3dc0b8e59025 req-752e49e7-0b19-4dfa-ab34-453c94eb369f tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0259216 Dec 21 04:42:02.162616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed1923bd-a08a-411a-80ee-c9d6df6f753b req-bda764f5-0e6a-477d-bff9-44da7cdc1f75 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0263896 Dec 21 04:42:03.262010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2912dda8-8562-4539-9838-9dcba26c9b4a req-d451f23c-dc42-4ec4-95e5-982825e8e51b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0302210 Dec 21 04:42:03.326041 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f7678683-8f68-49ea-8ed8-d401d4914c70 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:03.348121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: f7678683-8f68-49ea-8ed8-d401d4914c70 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:03.348607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device f7678683-8f68-49ea-8ed8-d401d4914c70 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:04.358056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6cec29bf-6e9a-4907-acf3-17c74a060eca req-6fa48fae-94ff-40a1-a081-e0a67814b343 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=29e07b90-ad10-47f0-a900-45bdf16a6777 HTTP/1.1" status: 200 len: 210 time: 0.0255160 Dec 21 04:42:10.970148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47592) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:11.131055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port ecd04955-7083-4fb3-8cf1-80500f8f79a5 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:11.131262 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:11.205518 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:11.205847 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:11.218127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for ecd04955-7083-4fb3-8cf1-80500f8f79a5 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:11.434637 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:11.465102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=ecd04955-7083-4fb3-8cf1-80500f8f79a5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:11.529210 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:11.529583 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Floating IP 91a17a9e-af06-4345-a11f-9b0b09cf89e6 disassociated (deleted). External IP: 172.25.5.110, port: 29105788-9a26-4cbb-bd40-1e033f7557da. Dec 21 04:42:11.762276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:42:11.881555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:42:11.886242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:11.892596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:42:11.902858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:42:11.907008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:41:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:11.913577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1664ff4c-5627-4886-b883-092ace98bb4b tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "DELETE /v2.0/floatingips/91a17a9e-af06-4345-a11f-9b0b09cf89e6 HTTP/1.1" status: 204 len: 168 time: 0.9422553 Dec 21 04:42:11.914248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:42:11.916826 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9fdd5780-5926-4b3d-9006-4ff22747196e" -d '{"events": [{"name": "network-changed", "server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:42:11.961231 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:42:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c5dfe26-f608-4744-9053-e5054184471f x-openstack-request-id: req-9c5dfe26-f608-4744-9053-e5054184471f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:42:11.961581 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:42:11.961798 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9c5dfe26-f608-4744-9053-e5054184471f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:42:11.962213 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da', 'status': 'completed', 'code': 200} Dec 21 04:42:12.015652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:42:12.061378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-8c64e12b-0eed-4d3a-8e07-d0ee0f575b2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:12.062911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-8c64e12b-0eed-4d3a-8e07-d0ee0f575b2c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=58b4b41701714161aa0a78adc3f5ff66&device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 1097 time: 0.0425978 Dec 21 04:42:12.170961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-0bf3ac30-8fd6-4fa7-81c8-b53d2f7a0dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:12.172529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-0bf3ac30-8fd6-4fa7-81c8-b53d2f7a0dd4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 200 len: 913 time: 0.1016722 Dec 21 04:42:12.225629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-75a071b2-fcbc-4f17-a1ab-868fc6684901 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 200 len: 217 time: 0.0390146 Dec 21 04:42:12.319337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-8b9c8865-2efc-44ce-b193-5c55168c116e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:12.320750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-8b9c8865-2efc-44ce-b193-5c55168c116e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 200 len: 851 time: 0.0687132 Dec 21 04:42:12.330889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-692942a4-0850-42c7-8f58-02a73418d45c req-e5363957-e3e0-48cc-9a6e-96847d592859 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:12.332575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-692942a4-0850-42c7-8f58-02a73418d45c req-e5363957-e3e0-48cc-9a6e-96847d592859 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0895267 Dec 21 04:42:12.388226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:12.407822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-fd5facaf-307f-41ee-8d73-6103fdc5f0d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:12.409332 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-fd5facaf-307f-41ee-8d73-6103fdc5f0d1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c8a03ed-591d-40ac-889b-d93086a1e436&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0718398 Dec 21 04:42:12.414304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-692942a4-0850-42c7-8f58-02a73418d45c req-eb99e281-b4e6-4e1d-b657-50d463a0e135 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680962 Dec 21 04:42:12.414535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:42:12.423430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:42:12.424048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:41:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:12.427347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-eb3c717a-c760-49d5-aebe-8cb148d2af5b service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:42:12.428444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-eb3c717a-c760-49d5-aebe-8cb148d2af5b service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0061951 Dec 21 04:42:12.524230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-4b8f1dea-19e8-4a6f-abe4-b41c0dcb2075 service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865340 Dec 21 04:42:12.539570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:42:12.622710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fdd5780-5926-4b3d-9006-4ff22747196e req-4413bc57-1485-4ef6-8da3-f7abc4766d6f service neutron] 10.222.0.31 "GET /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894265 Dec 21 04:42:12.733178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:12.762211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ffdee2b-7884-490a-83ee-bb453a5470dc None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'e8b200b7-2299-4dd4-b8d3-c1c5d42502f0', 'name': '', 'network_id': '2c8a03ed-591d-40ac-889b-d93086a1e436', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'mac_address': 'fa:16:3e:90:31:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_interface', 'standard_attr_id': 4000, 'fixed_ips': [{'subnet_id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:59Z', 'updated_at': '2021-12-21T04:29:03Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'subnets': [{'id': 'ac2bd887-ab04-4643-8e7a-49082c17e848', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:42:12.982132 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99fc8501-a43f-46dd-918d-cc8bea9e4c3d None None] New status for floating IP 91a17a9e-af06-4345-a11f-9b0b09cf89e6: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:42:13.215680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-3bf0d0fc-f43e-46d0-afc5-dbd4b02b00bf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:13.217103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-3bf0d0fc-f43e-46d0-afc5-dbd4b02b00bf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0525131 Dec 21 04:42:13.308210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port 29105788-9a26-4cbb-bd40-1e033f7557da {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:13.308560 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:13.397740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] For port 29105788-9a26-4cbb-bd40-1e033f7557da, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=29105788-9a26-4cbb-bd40-1e033f7557da,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:13.398100 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:13.410562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for 29105788-9a26-4cbb-bd40-1e033f7557da owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:13.570194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c33b4c1-42a0-4e04-a0b6-d46afff68049 req-2e816ee1-110d-4d80-a62d-106dabbeecee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:13.571660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c33b4c1-42a0-4e04-a0b6-d46afff68049 req-2e816ee1-110d-4d80-a62d-106dabbeecee tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 945 time: 0.0857770 Dec 21 04:42:13.621627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c33b4c1-42a0-4e04-a0b6-d46afff68049 req-facef037-57a0-44f0-80b2-14589ce0f00c tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/security-groups?id=0a9eab09-71e8-4468-82c6-b69ddd8f076b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437951 Dec 21 04:42:13.622874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:13.658084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=29105788-9a26-4cbb-bd40-1e033f7557da,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:13.691640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] No DVR routers for this DVR port 29105788-9a26-4cbb-bd40-1e033f7557da on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:42:13.694726 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:13.698114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b26d2b8-8a29-4931-a949-006659ca1fa5 req-b4522596-e5b5-4ea3-8898-079d3a2d4d6d tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.31 "DELETE /v2.0/ports/29105788-9a26-4cbb-bd40-1e033f7557da HTTP/1.1" status: 204 len: 173 time: 0.4706433 Dec 21 04:42:13.963275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'name': 'network-vif-deleted', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:42:13.965989 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fa0dd9c-2acb-4464-8662-0f2598236e59" -d '{"events": [{"server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "name": "network-vif-deleted", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:42:14.018245 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:42:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff93974e-3523-4893-a3b3-a0a45e9d78b5 x-openstack-request-id: req-ff93974e-3523-4893-a3b3-a0a45e9d78b5 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:42:14.019572 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1572c73f-6830-4083-bb3c-bcc71b4517e5", "name": "network-vif-deleted", "tag": "29105788-9a26-4cbb-bd40-1e033f7557da", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:42:14.021318 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ff93974e-3523-4893-a3b3-a0a45e9d78b5 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:42:14.021747 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1572c73f-6830-4083-bb3c-bcc71b4517e5', 'name': 'network-vif-deleted', 'tag': '29105788-9a26-4cbb-bd40-1e033f7557da', 'status': 'completed', 'code': 200} Dec 21 04:42:14.721355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34daedf9-f532-456f-9cc3-7319b641c741 req-91fbeb7e-45a3-46e6-963e-fef16b9cfc46 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0281491 Dec 21 04:42:15.821738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ca32a10-d6b5-45ea-99c6-6eb42597ddfb req-95684e56-4019-4b27-8fbb-2ae73041df71 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0310042 Dec 21 04:42:16.915288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2eed8ed-81ae-4e19-8683-6b4606a488aa req-c41d4833-488e-4417-9d04-c38ca92bffaf tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0265527 Dec 21 04:42:18.015357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16226abb-752f-4a8d-827a-ed1f3beb4df6 req-68f2163d-22a7-4ce3-baf6-c6b8edb9fa98 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0277734 Dec 21 04:42:18.117917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 29105788-9a26-4cbb-bd40-1e033f7557da no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:18.137382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 29105788-9a26-4cbb-bd40-1e033f7557da {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:18.137706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 29105788-9a26-4cbb-bd40-1e033f7557da not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:18.883428 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:42:19.122442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8308ab4a-0857-4cbf-a6bd-b8986e050d77 req-62c907d4-675c-433d-8c34-d938f45f2b66 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "GET /v2.0/ports?device_id=1572c73f-6830-4083-bb3c-bcc71b4517e5 HTTP/1.1" status: 200 len: 210 time: 0.0273070 Dec 21 04:42:19.880199 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2b4ca5d6-8909-477c-ab9d-075bdcc99704 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.178378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47616) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:20.297189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Deleting port e5f2698a-29ab-4710-8643-3eb539217fb0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:20.297529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.372704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.373025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.384249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Calling delete_port for e5f2698a-29ab-4710-8643-3eb539217fb0 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:20.589082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.615156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'Port': ['ID=e5f2698a-29ab-4710-8643-3eb539217fb0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:20.673962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.676641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:20.677809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ef3f68c6-fbd6-4c1b-b677-ac1ef7751d42 tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "DELETE /v2.0/floatingips/ee95f490-34e8-4979-8fab-69cbec7901c2 HTTP/1.1" status: 204 len: 168 time: 0.4983599 Dec 21 04:42:22.702778 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44abef4e-26db-4fa5-a60d-436f354bc72c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:23.280324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:23.434587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:24.044419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47634) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:24.104163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3606274-be4e-401b-b3d8-898058e7d9bb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:24.128567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3606274-be4e-401b-b3d8-898058e7d9bb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:24.262923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3606274-be4e-401b-b3d8-898058e7d9bb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:24.265523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a3606274-be4e-401b-b3d8-898058e7d9bb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:24.269269 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a3606274-be4e-401b-b3d8-898058e7d9bb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] 10.222.0.18 "DELETE /v2.0/security-groups/0a9eab09-71e8-4468-82c6-b69ddd8f076b HTTP/1.1" status: 204 len: 168 time: 0.2213705 Dec 21 04:42:24.276682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3606274-be4e-401b-b3d8-898058e7d9bb tempest-TestVolumeBootPattern-631575295 tempest-TestVolumeBootPattern-631575295-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a9eab09-71e8-4468-82c6-b69ddd8f076b,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:25.239594 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:25.262631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:25.423517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47640) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:25.794302 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:25.894568 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:26.138488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Deleting port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:26.138751 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:26.536828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] For port e8b200b7-2299-4dd4-b8d3-c1c5d42502f0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:26.537521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:26.549211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Calling delete_port for e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:26.794477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:26.820627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Pushing event deleted for resources: {'Port': ['ID=e8b200b7-2299-4dd4-b8d3-c1c5d42502f0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:26.989771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:27.195098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Router 09fea275-edd6-479a-bf89-852a4ce60666 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:42:27.299065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:42:27.304035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f4859f10-c24a-47ad-800f-b4b53515ffa5 admin admin] 10.222.0.18 "PUT /v2.0/routers/09fea275-edd6-479a-bf89-852a4ce60666/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8794999 Dec 21 04:42:27.306902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47648) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:27.307872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] Sync routers for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:42:27.319444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:42:27.320059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:42:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:27.409594 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:27.421731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:42:27.512678 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:27.596828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57'}], 'enable_snat': True}, 'gw_port_id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:42:26Z', 'revision_number': 5, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port': {'id': '7abfecb3-7118-4e01-9caa-e662d782f262', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:27:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09fea275-edd6-479a-bf89-852a4ce60666', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3999, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:29:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:27.623957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] Checking router: 09fea275-edd6-479a-bf89-852a4ce60666 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:42:27.632856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] Routers {'09fea275-edd6-479a-bf89-852a4ce60666'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:42:27.633481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:42:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['09fea275-edd6-479a-bf89-852a4ce60666'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:27.637939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Deleting port 7abfecb3-7118-4e01-9caa-e662d782f262 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:27.638527 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:27.716700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] Set router 09fea275-edd6-479a-bf89-852a4ce60666 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:42:27.720194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] For port 7abfecb3-7118-4e01-9caa-e662d782f262, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7abfecb3-7118-4e01-9caa-e662d782f262,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:27.720567 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:27.732832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Calling delete_port for 7abfecb3-7118-4e01-9caa-e662d782f262 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:27.767284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:42:27Z', 'revision_number': 6, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:27.795761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1efd0b0-88a3-496e-ab27-54c6f1ea85ed None None] The sync data for ids ['09fea275-edd6-479a-bf89-852a4ce60666'] in n-d-822053-11 is: [{'id': '09fea275-edd6-479a-bf89-852a4ce60666', 'name': 'tempest-TestVolumeBootPattern-1046353531-router', 'tenant_id': '58b4b41701714161aa0a78adc3f5ff66', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:28:57Z', 'updated_at': '2021-12-21T04:42:27Z', 'revision_number': 6, 'project_id': '58b4b41701714161aa0a78adc3f5ff66', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:42:27.952953 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:27.976978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Pushing event deleted for resources: {'Port': ['ID=7abfecb3-7118-4e01-9caa-e662d782f262,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:27.992311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95cd62cd-5dc7-4115-98a0-caac0f6ab7c2 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:42:28.039038 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.132776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.135157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.238852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.239626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 09fea275-edd6-479a-bf89-852a4ce60666 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:42:28.243906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.245064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6fa5490e-e25d-4646-ae2f-a00ae5dfdbb0 admin admin] 10.222.0.18 "DELETE /v2.0/routers/09fea275-edd6-479a-bf89-852a4ce60666 HTTP/1.1" status: 204 len: 168 time: 0.9372163 Dec 21 04:42:28.247524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47650) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:28.292506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Deleting subnet ac2bd887-ab04-4643-8e7a-49082c17e848 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:42:28.295475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.329704 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.411272 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.537674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.565321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ac2bd887-ab04-4643-8e7a-49082c17e848,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:28.577414 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.580984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e73278bf-7f28-4c41-a688-4bfb9a3ea61a admin admin] 10.222.0.18 "DELETE /v2.0/subnets/ac2bd887-ab04-4643-8e7a-49082c17e848 HTTP/1.1" status: 204 len: 168 time: 0.3325264 Dec 21 04:42:28.584516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47654) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:28.586957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02a4e7a2-5a58-4815-95d8-10451480185d None None] Network 2c8a03ed-591d-40ac-889b-d93086a1e436 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:42:28.613309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7abfecb3-7118-4e01-9caa-e662d782f262 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:28.674270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.678048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7abfecb3-7118-4e01-9caa-e662d782f262 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:28.678408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7abfecb3-7118-4e01-9caa-e662d782f262 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:28.678837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:28.702110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:28.702465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device e8b200b7-2299-4dd4-b8d3-c1c5d42502f0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:28.731775 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Deleting port 147c629c-b2ab-4e46-a17a-1299006ec08d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:28.732119 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.808867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] DHCP port deletion for 2c8a03ed-591d-40ac-889b-d93086a1e436 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:42:28.809061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] For port 147c629c-b2ab-4e46-a17a-1299006ec08d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=147c629c-b2ab-4e46-a17a-1299006ec08d,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:28.809355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.826465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Calling delete_port for 147c629c-b2ab-4e46-a17a-1299006ec08d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:28.862871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Deleting port 147c629c-b2ab-4e46-a17a-1299006ec08d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:28.863367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.931091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] For port 147c629c-b2ab-4e46-a17a-1299006ec08d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=147c629c-b2ab-4e46-a17a-1299006ec08d,segment=NetworkSegment(173aa79c-71ed-4484-bccf-831b4729873e),segment_id=173aa79c-71ed-4484-bccf-831b4729873e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:28.931499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:28.944212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Calling delete_port for 147c629c-b2ab-4e46-a17a-1299006ec08d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:28.993216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.018355 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.021346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] No DVR routers for this DVR port 147c629c-b2ab-4e46-a17a-1299006ec08d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:42:29.026846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Pushing event deleted for resources: {'Port': ['ID=147c629c-b2ab-4e46-a17a-1299006ec08d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:29.031487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] No DVR routers for this DVR port 147c629c-b2ab-4e46-a17a-1299006ec08d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:42:29.048200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Pushing event deleted for resources: {'Port': ['ID=147c629c-b2ab-4e46-a17a-1299006ec08d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:29.056445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.056900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.057145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.057547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.057824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.058242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.058485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.058957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.059166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.059498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.059832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.060163 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.060511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef6bef52-9735-4512-92c8-ba1b42c9b982 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:42:29.100078 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.119861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c8a03ed-591d-40ac-889b-d93086a1e436']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:29.128958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '173aa79c-71ed-4484-bccf-831b4729873e') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:29.129941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '173aa79c-71ed-4484-bccf-831b4729873e') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:29.139129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.152583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.158491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:42:29.158854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:42:29.165329 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:42:29.274583 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.280109 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.283217 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] 10.222.0.18 "DELETE /v2.0/networks/2c8a03ed-591d-40ac-889b-d93086a1e436 HTTP/1.1" status: 204 len: 168 time: 0.6975787 Dec 21 04:42:29.286710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47660) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:29.294335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669cf1ba-a5e5-4c92-9ad6-6e4124cf4a12 admin admin] Pushing event deleted for resources: {'Network': ['ID=2c8a03ed-591d-40ac-889b-d93086a1e436,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:29.621030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.856383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Deleting port 9165936d-83ba-4e83-868f-2e4db5e600d0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:29.856718 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.934459 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] For port 9165936d-83ba-4e83-868f-2e4db5e600d0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=9165936d-83ba-4e83-868f-2e4db5e600d0,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:29.934819 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:29.946501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Calling delete_port for 9165936d-83ba-4e83-868f-2e4db5e600d0 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:30.223377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:30.248446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Pushing event deleted for resources: {'Port': ['ID=9165936d-83ba-4e83-868f-2e4db5e600d0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:30.420548 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:30.644024 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Router 93d96019-0e87-487d-984c-3ea216bdcd13 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:42:30.653972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 147c629c-b2ab-4e46-a17a-1299006ec08d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:30.672465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 147c629c-b2ab-4e46-a17a-1299006ec08d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:30.672812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 147c629c-b2ab-4e46-a17a-1299006ec08d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:30.751099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:42:30.756104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-720a87db-8297-4029-a425-2f960e42a19f admin admin] 10.222.0.18 "PUT /v2.0/routers/93d96019-0e87-487d-984c-3ea216bdcd13/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4682353 Dec 21 04:42:30.758836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47662) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:30.759539 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] Sync routers for ids ['93d96019-0e87-487d-984c-3ea216bdcd13'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:42:30.771528 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] Routers {'93d96019-0e87-487d-984c-3ea216bdcd13'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:42:30.772140 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:42:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93d96019-0e87-487d-984c-3ea216bdcd13'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:30.861439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:30.873951 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] Set router 93d96019-0e87-487d-984c-3ea216bdcd13 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:42:30.963674 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.045259 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8'}], 'enable_snat': True}, 'gw_port_id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:42:30Z', 'revision_number': 5, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port': {'id': '58b2ff15-ec0a-47d1-bfbc-64d54bc572dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:31:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4011, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:29:04Z', 'updated_at': '2021-12-21T04:29:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:31.075037 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] Checking router: 93d96019-0e87-487d-984c-3ea216bdcd13 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:42:31.080205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Deleting port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:31.080545 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.084314 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] Routers {'93d96019-0e87-487d-984c-3ea216bdcd13'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:42:31.084912 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:42:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93d96019-0e87-487d-984c-3ea216bdcd13'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:31.164689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] For port 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:31.165135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.168621 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] Set router 93d96019-0e87-487d-984c-3ea216bdcd13 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:42:31.178205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Calling delete_port for 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:31.219628 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:42:30Z', 'revision_number': 6, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:31.249117 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064d02d9-3ed4-419e-aa95-d60f5e39a89e None None] The sync data for ids ['93d96019-0e87-487d-984c-3ea216bdcd13'] in n-d-822053-11 is: [{'id': '93d96019-0e87-487d-984c-3ea216bdcd13', 'name': 'tempest-TestVolumeBootPattern-1915949755-router', 'tenant_id': '7c0c80d80600428d87b721f3075b40d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:29:03Z', 'updated_at': '2021-12-21T04:42:30Z', 'revision_number': 6, 'project_id': '7c0c80d80600428d87b721f3075b40d3', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:42:31.399781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.429977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Pushing event deleted for resources: {'Port': ['ID=58b2ff15-ec0a-47d1-bfbc-64d54bc572dc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:31.437989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faf02506-fcea-4aaf-9d7c-97e5b58b6800 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:42:31.490375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.577972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.580183 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.663045 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.663592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 93d96019-0e87-487d-984c-3ea216bdcd13 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:42:31.667881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.668972 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e10a9191-2439-4047-8d89-65fccb26ad76 admin admin] 10.222.0.18 "DELETE /v2.0/routers/93d96019-0e87-487d-984c-3ea216bdcd13 HTTP/1.1" status: 204 len: 168 time: 0.9091277 Dec 21 04:42:31.673809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47668) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:31.716265 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Deleting subnet 67ef1c7f-d6e4-4a34-8120-e30bb4929e71 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:42:31.719276 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.752129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.831427 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:31.983489 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.011524 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.017174 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/67ef1c7f-d6e4-4a34-8120-e30bb4929e71 HTTP/1.1" status: 204 len: 168 time: 0.3424435 Dec 21 04:42:32.017615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a168ca76-5576-4bd5-b3b4-15362f2b672e None None] Network 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:42:32.018138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba885709-3616-4bcb-8fbe-ab525d9769f3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=67ef1c7f-d6e4-4a34-8120-e30bb4929e71,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:32.018240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47670) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:32.097658 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.161549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Deleting port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:32.161890 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.182751 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] DHCP port deletion for 4ef8856a-bba4-4df0-a09f-3e3d18a925e9 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:42:32.232351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] Deleting port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:42:32.232735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.235434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] For port 7c347b4f-0c9e-4525-b86f-04c6a84a2057, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7c347b4f-0c9e-4525-b86f-04c6a84a2057,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:32.235747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.248894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Calling delete_port for 7c347b4f-0c9e-4525-b86f-04c6a84a2057 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:32.300101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] For port 7c347b4f-0c9e-4525-b86f-04c6a84a2057, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=7c347b4f-0c9e-4525-b86f-04c6a84a2057,segment=NetworkSegment(65447a85-6a66-47f6-b3e5-9775ebe3388e),segment_id=65447a85-6a66-47f6-b3e5-9775ebe3388e)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:32.300793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.315126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] Calling delete_port for 7c347b4f-0c9e-4525-b86f-04c6a84a2057 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:42:32.412010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.417157 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.437971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Pushing event deleted for resources: {'Port': ['ID=7c347b4f-0c9e-4525-b86f-04c6a84a2057,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:32.439819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] No DVR routers for this DVR port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:42:32.441086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] Pushing event deleted for resources: {'Port': ['ID=7c347b4f-0c9e-4525-b86f-04c6a84a2057,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:32.445845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ded6e0c-136f-4920-a156-2c0e37109cfa None None] No DVR routers for this DVR port 7c347b4f-0c9e-4525-b86f-04c6a84a2057 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:42:32.514132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.533884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ef8856a-bba4-4df0-a09f-3e3d18a925e9']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:32.542871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65447a85-6a66-47f6-b3e5-9775ebe3388e') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:32.543178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65447a85-6a66-47f6-b3e5-9775ebe3388e') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:42:32.552640 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.566205 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.579587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:42:32.579987 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:42:32.582037 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:42:32.589000 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:42:32.612996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7c347b4f-0c9e-4525-b86f-04c6a84a2057 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:32.635980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 7c347b4f-0c9e-4525-b86f-04c6a84a2057 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:32.636421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 7c347b4f-0c9e-4525-b86f-04c6a84a2057 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:32.636911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:32.655034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:32.655629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 58b2ff15-ec0a-47d1-bfbc-64d54bc572dc not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:32.655764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9165936d-83ba-4e83-868f-2e4db5e600d0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:42:32.677405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 9165936d-83ba-4e83-868f-2e4db5e600d0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:42:32.677753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 9165936d-83ba-4e83-868f-2e4db5e600d0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:42:32.708985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.714234 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:32.717355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] 10.222.0.18 "DELETE /v2.0/networks/4ef8856a-bba4-4df0-a09f-3e3d18a925e9 HTTP/1.1" status: 204 len: 168 time: 0.6981928 Dec 21 04:42:32.727842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8225f396-2125-477f-b342-9c7d7bdf6fb4 admin admin] Pushing event deleted for resources: {'Network': ['ID=4ef8856a-bba4-4df0-a09f-3e3d18a925e9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:33.026318 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47676) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:33.067446 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-52e80249-0f0a-4e08-ba83-b02d943d9ef4 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=58b4b41701714161aa0a78adc3f5ff66&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0399747 Dec 21 04:42:33.069813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47678) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:33.119992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb65785-de01-4ca3-bc38-8b8c07c84eff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:33.140206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb65785-de01-4ca3-bc38-8b8c07c84eff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:33.251394 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb65785-de01-4ca3-bc38-8b8c07c84eff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:33.253972 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5cb65785-de01-4ca3-bc38-8b8c07c84eff admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:33.255148 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5cb65785-de01-4ca3-bc38-8b8c07c84eff admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/baf5be1b-2cf4-4c7c-b9ff-2869baf65dde HTTP/1.1" status: 204 len: 168 time: 0.1844285 Dec 21 04:42:33.262855 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cb65785-de01-4ca3-bc38-8b8c07c84eff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=baf5be1b-2cf4-4c7c-b9ff-2869baf65dde,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:33.887991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47684) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:33.926830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4bd69df1-4282-4044-b11c-fc948c1b00ee admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7c0c80d80600428d87b721f3075b40d3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0375938 Dec 21 04:42:33.936954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47686) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:42:33.984508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2b93d42-efe6-4283-8185-94eae7908f92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:34.005480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2b93d42-efe6-4283-8185-94eae7908f92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:34.143235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2b93d42-efe6-4283-8185-94eae7908f92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:34.145729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b2b93d42-efe6-4283-8185-94eae7908f92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:34.146885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b2b93d42-efe6-4283-8185-94eae7908f92 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1dc8e157-5135-452f-989f-1391a573412c HTTP/1.1" status: 204 len: 168 time: 0.2090192 Dec 21 04:42:34.154951 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b93d42-efe6-4283-8185-94eae7908f92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1dc8e157-5135-452f-989f-1391a573412c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:45.257666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-64f94902-66c6-4f44-9d4e-a41c58b18a4d tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/networks?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0355983 Dec 21 04:42:45.445195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-15e87276-c209-48e8-b713-30731c37410c tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:45.446654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-15e87276-c209-48e8-b713-30731c37410c tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1833086 Dec 21 04:42:45.462538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-d8282349-165b-4881-9faa-47dffb203d4c tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/quotas/ef8e0048e42048988bd86fdedf9a8df4 HTTP/1.1" status: 200 len: 375 time: 0.0099847 Dec 21 04:42:45.492538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-e5f4fa7a-fb1e-4d01-b83d-bb489fc562d1 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0248904 Dec 21 04:42:45.722538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6189500-6590-4ce9-9a66-ea7a1335f3ca req-ecd29944-9d10-4c44-8e8e-ec31ec34e04b tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 210 time: 0.0269072 Dec 21 04:42:47.136760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2eb6ed8-9594-4aa1-bac8-ea0c7356389d req-45dc6855-c05a-418e-8ee8-802922e71539 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 210 time: 0.3471072 Dec 21 04:42:47.910615 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-ffe14410-6a72-44f4-9180-12e7fb5cd8da tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0333824 Dec 21 04:42:48.093878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-f85c1b44-4f67-47ee-8fab-a75267674d6e tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:48.095332 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-f85c1b44-4f67-47ee-8fab-a75267674d6e tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1795473 Dec 21 04:42:48.121501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Request body: {'port': {'device_id': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'admin_state_up': True, 'tenant_id': 'ef8e0048e42048988bd86fdedf9a8df4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:42:48.233121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e37ba6d8-22e5-42f7-80f6-a3d08e2cce7f req-4f386f07-2273-4c30-8dd2-2e0be4134472 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 210 time: 0.0266542 Dec 21 04:42:48.286418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Made reservation on behalf of ef8e0048e42048988bd86fdedf9a8df4 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:42:48.290047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:48.299203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:48.373222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:48.449781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:48.511544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Pushing event updated for resources: {'SecurityGroup': ['ID=25ce2404-7216-4382-9fa9-9fbd145dab4f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:48.580344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Allocated IP 192.168.233.190 (bfd89982-1206-47e5-b884-d7d59ce490d8/a989d27f-6484-4ad7-8d07-9ce1c321b9d2/adce7b08-1b01-4228-aacc-9eba8defe071) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:42:48.726230 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:48.811672 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:48.857223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Network bfd89982-1206-47e5-b884-d7d59ce490d8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:42:48.860398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:42:48.863940 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:42:48.889278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Pushing event updated for resources: {'Port': ['ID=adce7b08-1b01-4228-aacc-9eba8defe071,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:48.918369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:48.919082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.014655 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-21ddc7c1-d80e-4133-841d-6c7d53380b90 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8967888 Dec 21 04:42:49.032848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Request body: {'port': {'device_id': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:42:49.084449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.146503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4b0278c0-ea13-4529-854c-41e94da1dc4a None None] Provisioning complete for port adce7b08-1b01-4228-aacc-9eba8defe071 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:42:49.146503 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4b0278c0-ea13-4529-854c-41e94da1dc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.178294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4b0278c0-ea13-4529-854c-41e94da1dc4a None None] Port adce7b08-1b01-4228-aacc-9eba8defe071 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:42:49.345324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id adce7b08-1b01-4228-aacc-9eba8defe071 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:42:49.352290 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.353649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63dc692-9942-4cd8-99ce-ec14e072c30e req-52ff9734-389d-4069-aca1-12c0ab8af2aa tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:49.355362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f63dc692-9942-4cd8-99ce-ec14e072c30e req-52ff9734-389d-4069-aca1-12c0ab8af2aa tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 936 time: 0.0528030 Dec 21 04:42:49.367618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Transition to ACTIVE for port object adce7b08-1b01-4228-aacc-9eba8defe071 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:42:49.402854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f63dc692-9942-4cd8-99ce-ec14e072c30e req-6d065615-cc66-454a-b1ad-5176b0f70843 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414748 Dec 21 04:42:49.445914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.494878 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Pushing event updated for resources: {'Port': ['ID=adce7b08-1b01-4228-aacc-9eba8defe071,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:49.565690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Attempting to bind port adce7b08-1b01-4228-aacc-9eba8defe071 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:42:49.566026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Attempting to bind port adce7b08-1b01-4228-aacc-9eba8defe071 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:42:49.566348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Attempting to bind port adce7b08-1b01-4228-aacc-9eba8defe071 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:42:49.571493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Port adce7b08-1b01-4228-aacc-9eba8defe071 on network bfd89982-1206-47e5-b884-d7d59ce490d8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:42:49.571814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Attempting to bind port adce7b08-1b01-4228-aacc-9eba8defe071 on network bfd89982-1206-47e5-b884-d7d59ce490d8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:42:49.576752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 42, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:42:49.577092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Checking segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:42:49.577474 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Bound using segment: {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:42:49.577899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Bound port: adce7b08-1b01-4228-aacc-9eba8defe071, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fe6a8e81-8288-4b64-be23-c7427ee6dc4c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:42:49.578258 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.645619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] For port adce7b08-1b01-4228-aacc-9eba8defe071, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:42:49.648512 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] For port adce7b08-1b01-4228-aacc-9eba8defe071, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=adce7b08-1b01-4228-aacc-9eba8defe071,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:42:49.755082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.788275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:49.788930 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.790492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] 10.222.0.54 "PUT /v2.0/ports/adce7b08-1b01-4228-aacc-9eba8defe071 HTTP/1.1" status: 200 len: 1097 time: 0.7619941 Dec 21 04:42:49.792810 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'tag': 'adce7b08-1b01-4228-aacc-9eba8defe071'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:42:49.795090 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ec68c4c-110e-4b03-8ce8-9f8452b9b32b" -d '{"events": [{"name": "network-changed", "server_uuid": "1e46df7f-6567-4008-b1d1-6b57d7a4d234", "tag": "adce7b08-1b01-4228-aacc-9eba8defe071"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:42:49.833205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6902327e-2878-4cb1-b5d4-3845363130de service neutron] Pushing event updated for resources: {'Port': ['ID=adce7b08-1b01-4228-aacc-9eba8defe071,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:49.848946 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:42:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f498fd77-0a81-46bc-b847-84c5a5852be1 x-openstack-request-id: req-f498fd77-0a81-46bc-b847-84c5a5852be1 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:42:49.848946 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e46df7f-6567-4008-b1d1-6b57d7a4d234", "tag": "adce7b08-1b01-4228-aacc-9eba8defe071", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:42:49.848946 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f498fd77-0a81-46bc-b847-84c5a5852be1 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:42:49.848946 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'tag': 'adce7b08-1b01-4228-aacc-9eba8defe071', 'status': 'completed', 'code': 200} Dec 21 04:42:49.891686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d5088da-18a4-4b23-a912-247e90f78d7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:49.926875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec68c4c-110e-4b03-8ce8-9f8452b9b32b req-c4442cf2-c2fe-47cc-8df0-c85644d9ef65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:49.928432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ec68c4c-110e-4b03-8ce8-9f8452b9b32b req-c4442cf2-c2fe-47cc-8df0-c85644d9ef65 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 1100 time: 0.0433669 Dec 21 04:42:49.964202 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ec68c4c-110e-4b03-8ce8-9f8452b9b32b req-c566afa5-f4f3-4a3d-aa98-6ee0dd64a5c8 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0204690 Dec 21 04:42:50.060071 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec68c4c-110e-4b03-8ce8-9f8452b9b32b req-7f4cce60-b350-439b-86e6-bdeae0be0f4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:50.061433 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ec68c4c-110e-4b03-8ce8-9f8452b9b32b req-7f4cce60-b350-439b-86e6-bdeae0be0f4b service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0901296 Dec 21 04:42:50.153635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-cb8d315d-bca1-4a0a-bf09-d8d4133f4074 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:50.155102 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-cb8d315d-bca1-4a0a-bf09-d8d4133f4074 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 1100 time: 0.0389562 Dec 21 04:42:50.204609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-e8624f94-ef08-4886-b108-be2840531fad service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.190&port_id=adce7b08-1b01-4228-aacc-9eba8defe071 HTTP/1.1" status: 200 len: 217 time: 0.0364668 Dec 21 04:42:50.251352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-1ea5cd7a-ce77-43d5-b13c-927b6a89d6ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:50.252725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-1ea5cd7a-ce77-43d5-b13c-927b6a89d6ed service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a989d27f-6484-4ad7-8d07-9ce1c321b9d2 HTTP/1.1" status: 200 len: 843 time: 0.0412631 Dec 21 04:42:50.296585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-13d1fb23-eb88-4b17-84e3-6ad615a62e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:50.297991 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-13d1fb23-eb88-4b17-84e3-6ad615a62e45 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=bfd89982-1206-47e5-b884-d7d59ce490d8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0379486 Dec 21 04:42:50.390355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-5333209d-6e0c-4190-84b4-f6a7229a0842 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848939 Dec 21 04:42:50.477403 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-02f3f68e-7bb2-4128-aa18-6f09ab61c047 req-00541d24-1586-4d72-9d2a-1017549b1536 service neutron] 10.222.0.54 "GET /v2.0/networks/bfd89982-1206-47e5-b884-d7d59ce490d8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800040 Dec 21 04:42:50.527393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d3ba88-1f81-4c92-a578-844ac800df3f req-189afacf-81e8-412a-9a56-8266fc11422a tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:50.528981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6d3ba88-1f81-4c92-a578-844ac800df3f req-189afacf-81e8-412a-9a56-8266fc11422a tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 948 time: 0.0529010 Dec 21 04:42:50.576039 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6d3ba88-1f81-4c92-a578-844ac800df3f req-ef66744d-d7e5-49ea-8a9c-a63ae0261e06 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411367 Dec 21 04:42:51.692788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08c2a3f-b84e-4533-a132-7466bd0f40bd req-8ff9f41e-69e0-4ee2-a4d9-35489d317549 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:51.694276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f08c2a3f-b84e-4533-a132-7466bd0f40bd req-8ff9f41e-69e0-4ee2-a4d9-35489d317549 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 948 time: 0.0497077 Dec 21 04:42:51.740835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f08c2a3f-b84e-4533-a132-7466bd0f40bd req-421f1dc8-a814-4b20-b769-64a6ebdeefd6 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406554 Dec 21 04:42:52.702502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d3f11da-bbe5-4ed4-8999-ccebc7528597 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:52.853416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a9f77b-7f35-4e69-a443-cc4852f3aed7 req-8f00de8e-c7a7-4b72-be79-a03ff63dcd97 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:52.854779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72a9f77b-7f35-4e69-a443-cc4852f3aed7 req-8f00de8e-c7a7-4b72-be79-a03ff63dcd97 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 948 time: 0.0479224 Dec 21 04:42:52.903892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72a9f77b-7f35-4e69-a443-cc4852f3aed7 req-6b9380bf-4140-40c4-8124-e0485344ff53 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431974 Dec 21 04:42:53.262724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:53.438301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:53.558024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device adce7b08-1b01-4228-aacc-9eba8defe071 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:42:53.652446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port adce7b08-1b01-4228-aacc-9eba8defe071, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=adce7b08-1b01-4228-aacc-9eba8defe071,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:53.662673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'adce7b08-1b01-4228-aacc-9eba8defe071', 'network_id': 'bfd89982-1206-47e5-b884-d7d59ce490d8', 'port_id': 'adce7b08-1b01-4228-aacc-9eba8defe071', 'mac_address': 'fa:16:3e:67:d4:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a989d27f-6484-4ad7-8d07-9ce1c321b9d2', 'ip_address': '192.168.233.190'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:42:53.699116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:53.711608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id adce7b08-1b01-4228-aacc-9eba8defe071 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:42:53.730096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port adce7b08-1b01-4228-aacc-9eba8defe071, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=adce7b08-1b01-4228-aacc-9eba8defe071,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:53.811097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:53.859790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=adce7b08-1b01-4228-aacc-9eba8defe071,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:54.059209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d907cb-1212-486c-9b8d-a09118719fb3 req-a18fce4f-e7d9-42bb-858b-0895cf9153dc tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:54.060710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55d907cb-1212-486c-9b8d-a09118719fb3 req-a18fce4f-e7d9-42bb-858b-0895cf9153dc tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 949 time: 0.0898750 Dec 21 04:42:54.108422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55d907cb-1212-486c-9b8d-a09118719fb3 req-ac969711-58b8-4773-bffa-961a774bb29f tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416608 Dec 21 04:42:54.112207 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['adce7b08-1b01-4228-aacc-9eba8defe071'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:42:55.224641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:55.232901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ac6316-5683-4f7d-8fe7-ae77190f73c3 req-618cb88c-92ee-45f0-96d8-22c029bf254e tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:55.232901 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00ac6316-5683-4f7d-8fe7-ae77190f73c3 req-618cb88c-92ee-45f0-96d8-22c029bf254e tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 949 time: 0.0512006 Dec 21 04:42:55.274065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00ac6316-5683-4f7d-8fe7-ae77190f73c3 req-504860fc-b338-42fb-9fa4-958706af63bf tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415246 Dec 21 04:42:55.286473 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:55.590169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device adce7b08-1b01-4228-aacc-9eba8defe071 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:42:55.851338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:55.878082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port adce7b08-1b01-4228-aacc-9eba8defe071 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:42:55.882528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port adce7b08-1b01-4228-aacc-9eba8defe071 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:42:55.883015 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:55.883216 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:42:55.960458 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:55.987078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adce7b08-1b01-4228-aacc-9eba8defe071'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:42:56.001279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port adce7b08-1b01-4228-aacc-9eba8defe071, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=adce7b08-1b01-4228-aacc-9eba8defe071,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:42:56.026883 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e70365c-ce27-4138-95b2-b4204d8d58cd" -d '{"events": [{"server_uuid": "1e46df7f-6567-4008-b1d1-6b57d7a4d234", "name": "network-vif-plugged", "status": "completed", "tag": "adce7b08-1b01-4228-aacc-9eba8defe071"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:42:56.063014 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:42:56.111658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=adce7b08-1b01-4228-aacc-9eba8defe071,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:42:56.118585 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:42:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3dd4e6f-9f86-430d-a920-c1d33636472c x-openstack-request-id: req-a3dd4e6f-9f86-430d-a920-c1d33636472c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:42:56.118877 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e46df7f-6567-4008-b1d1-6b57d7a4d234", "name": "network-vif-plugged", "status": "completed", "tag": "adce7b08-1b01-4228-aacc-9eba8defe071", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:42:56.119183 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a3dd4e6f-9f86-430d-a920-c1d33636472c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:42:56.119689 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'adce7b08-1b01-4228-aacc-9eba8defe071', 'code': 200} Dec 21 04:42:56.248223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b241f9b3-b9f2-4442-971b-045e45067bed req-4ea7277c-e32b-4100-ad2b-35590f9e5ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:56.249675 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b241f9b3-b9f2-4442-971b-045e45067bed req-4ea7277c-e32b-4100-ad2b-35590f9e5ce6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 1102 time: 0.0404685 Dec 21 04:42:56.297070 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b241f9b3-b9f2-4442-971b-045e45067bed req-017c3759-5af7-45ae-8fb2-0b16a9b0b927 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393684 Dec 21 04:42:56.393301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7544b57d-5ae7-4f9f-bda3-a9a4d2b4ca0c req-dc961c09-6c4e-44bd-9203-567f8bada9c4 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:56.394692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7544b57d-5ae7-4f9f-bda3-a9a4d2b4ca0c req-dc961c09-6c4e-44bd-9203-567f8bada9c4 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 950 time: 0.0532341 Dec 21 04:42:56.441149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7544b57d-5ae7-4f9f-bda3-a9a4d2b4ca0c req-18d36aa8-134d-4c33-bb1d-50526aade8e4 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405087 Dec 21 04:42:57.560598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a04bcdc-ad25-4e6a-a9b3-e0cb01b1a294 req-052bace3-c9a6-4c50-bb17-2bb2056d8a4c tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:57.562962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a04bcdc-ad25-4e6a-a9b3-e0cb01b1a294 req-052bace3-c9a6-4c50-bb17-2bb2056d8a4c tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 950 time: 0.0508721 Dec 21 04:42:57.610220 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1a04bcdc-ad25-4e6a-a9b3-e0cb01b1a294 req-64e46748-aab1-4cd6-9a6f-b33e3029ee34 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405581 Dec 21 04:42:58.067772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-6034de39-99dc-41b3-a058-662c09513f6b req-7cf9700a-8829-409c-8c11-8b3c3b8a76ed service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:42:58.068780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6034de39-99dc-41b3-a058-662c09513f6b req-7cf9700a-8829-409c-8c11-8b3c3b8a76ed service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0476017 Dec 21 04:42:58.596137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-c135f0a5-829b-4db5-9641-a568fb019598 req-44c73bea-ec91-4f35-8378-349668b645cb service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:42:58.597181 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c135f0a5-829b-4db5-9641-a568fb019598 req-44c73bea-ec91-4f35-8378-349668b645cb service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0448279 Dec 21 04:42:59.133401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d92fe00-b0f2-486d-a9c6-45e8ae01b043 req-53ae239c-99c8-482f-8e8f-b8d9143a3f3f tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:42:59.134895 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d92fe00-b0f2-486d-a9c6-45e8ae01b043 req-53ae239c-99c8-482f-8e8f-b8d9143a3f3f tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 950 time: 0.0516887 Dec 21 04:42:59.180404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d92fe00-b0f2-486d-a9c6-45e8ae01b043 req-f29662ec-e846-4b27-9624-234f4bfe4a94 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395610 Dec 21 04:43:00.295774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a840b57-ec21-4463-84e5-c08a1e4af17e req-2f5290ab-0b2c-4fe7-b6a8-be3c66ce4673 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:00.297252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a840b57-ec21-4463-84e5-c08a1e4af17e req-2f5290ab-0b2c-4fe7-b6a8-be3c66ce4673 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 950 time: 0.0476632 Dec 21 04:43:00.343294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a840b57-ec21-4463-84e5-c08a1e4af17e req-ff8786c2-0171-400b-b629-d0a960ace39d tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/security-groups?id=25ce2404-7216-4382-9fa9-9fbd145dab4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395181 Dec 21 04:43:00.490907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9526004f-6062-4cef-861a-c716b2572b64 req-5f80cd74-6cf2-4683-aba3-14c69e8fd2e6 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:00.492273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9526004f-6062-4cef-861a-c716b2572b64 req-5f80cd74-6cf2-4683-aba3-14c69e8fd2e6 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.54 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 950 time: 0.0503311 Dec 21 04:43:00.577416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Deleting port adce7b08-1b01-4228-aacc-9eba8defe071 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:43:00.577748 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:00.670301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] For port adce7b08-1b01-4228-aacc-9eba8defe071, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=adce7b08-1b01-4228-aacc-9eba8defe071,segment=NetworkSegment(fe6a8e81-8288-4b64-be23-c7427ee6dc4c),segment_id=fe6a8e81-8288-4b64-be23-c7427ee6dc4c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:00.670659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:00.682226 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Calling delete_port for adce7b08-1b01-4228-aacc-9eba8defe071 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:43:00.902782 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:00.934870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['adce7b08-1b01-4228-aacc-9eba8defe071'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:43:00.935992 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Pushing event deleted for resources: {'Port': ['ID=adce7b08-1b01-4228-aacc-9eba8defe071,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:00.963098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.963457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.963809 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.964154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.964494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.964828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.965166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.965953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.965953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.966182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.966451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.966894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.967118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:00.989764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] No DVR routers for this DVR port adce7b08-1b01-4228-aacc-9eba8defe071 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:43:00.992496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:00.995947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9526004f-6062-4cef-861a-c716b2572b64 req-ab6eb548-6fb2-4aa6-a70d-41868f1e65b7 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.54 "DELETE /v2.0/ports/adce7b08-1b01-4228-aacc-9eba8defe071 HTTP/1.1" status: 204 len: 173 time: 0.4964595 Dec 21 04:43:00.996404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'name': 'network-vif-deleted', 'tag': 'adce7b08-1b01-4228-aacc-9eba8defe071'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:43:00.998756 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c995906-2020-46f9-94c8-4a6e64955e39" -d '{"events": [{"server_uuid": "1e46df7f-6567-4008-b1d1-6b57d7a4d234", "name": "network-vif-deleted", "tag": "adce7b08-1b01-4228-aacc-9eba8defe071"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:43:01.038398 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:43:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0970d15e-b68a-4abd-af41-032d0af8e424 x-openstack-request-id: req-0970d15e-b68a-4abd-af41-032d0af8e424 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:43:01.038707 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e46df7f-6567-4008-b1d1-6b57d7a4d234", "name": "network-vif-deleted", "tag": "adce7b08-1b01-4228-aacc-9eba8defe071", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:43:01.039000 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0970d15e-b68a-4abd-af41-032d0af8e424 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:43:01.042299 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e46df7f-6567-4008-b1d1-6b57d7a4d234', 'name': 'network-vif-deleted', 'tag': 'adce7b08-1b01-4228-aacc-9eba8defe071', 'status': 'completed', 'code': 200} Dec 21 04:43:01.446961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdac6611-3247-46e4-a861-baaa3728882c req-2f4a6bc3-7acf-46dc-a320-998eb52a2810 tempest-ServersAdminNegativeTestJSON-1762065520 tempest-ServersAdminNegativeTestJSON-1762065520-project] 10.222.0.18 "GET /v2.0/ports?device_id=1e46df7f-6567-4008-b1d1-6b57d7a4d234 HTTP/1.1" status: 200 len: 210 time: 0.0265231 Dec 21 04:43:02.951153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47884) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:03.084029 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c3efcea-7d8c-4f43-bd07-79f733c68eeb admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ef8e0048e42048988bd86fdedf9a8df4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1317081 Dec 21 04:43:03.086509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47888) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:03.132982 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de543170-3649-4a78-8065-3e26aea1d4c2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:03.156518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de543170-3649-4a78-8065-3e26aea1d4c2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:03.251439 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de543170-3649-4a78-8065-3e26aea1d4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:03.254071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-de543170-3649-4a78-8065-3e26aea1d4c2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:03.255261 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-de543170-3649-4a78-8065-3e26aea1d4c2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/25ce2404-7216-4382-9fa9-9fbd145dab4f HTTP/1.1" status: 204 len: 168 time: 0.1677957 Dec 21 04:43:03.263162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de543170-3649-4a78-8065-3e26aea1d4c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25ce2404-7216-4382-9fa9-9fbd145dab4f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:03.632707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device adce7b08-1b01-4228-aacc-9eba8defe071 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:43:03.653471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: adce7b08-1b01-4228-aacc-9eba8defe071 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:43:03.653758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device adce7b08-1b01-4228-aacc-9eba8defe071 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:43:03.833585 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47894) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:03.841148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce526e8e-ab6f-4ae2-b9eb-b4c127175d33 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:03.916452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce526e8e-ab6f-4ae2-b9eb-b4c127175d33 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:04.005940 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ce526e8e-ab6f-4ae2-b9eb-b4c127175d33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:04.046428 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ce526e8e-ab6f-4ae2-b9eb-b4c127175d33 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b806866a820e441ab653720e161890e2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2179029 Dec 21 04:43:04.048267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce526e8e-ab6f-4ae2-b9eb-b4c127175d33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfdd014a-c864-4bf1-b3ad-9c326f5f1f25,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:04.049333 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47896) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:04.099381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:04.123593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:04.251048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:04.253805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:04.255496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/dfdd014a-c864-4bf1-b3ad-9c326f5f1f25 HTTP/1.1" status: 204 len: 168 time: 0.2038598 Dec 21 04:43:04.263078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfdd014a-c864-4bf1-b3ad-9c326f5f1f25,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:04.270517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.270860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.271229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.271569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.271897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.272266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.272611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.272938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.273261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.273583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.273915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.274211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:04.274527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87568ccf-6715-45a0-b5ab-4fc547ebf1e6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:05.205680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47918) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:05.301702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-660074163-network', 'tenant_id': 'eed08be4fb1b4c2999fb1316eb0024ae'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:43:05.365486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Made reservation on behalf of eed08be4fb1b4c2999fb1316eb0024ae for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:43:05.367961 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.376413 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.447123 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.491162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.514858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:43:05.523368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a162592-fcea-40e5-b63b-930d3de715a9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:05.529335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.529497 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Added segment a63f7c1c-7009-44f7-a58e-f87f08675ca0 of type vlan for network d055ed14-f49a-46c9-88b9-4390090d4790 Dec 21 04:43:05.568413 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.661707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.662623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:05.663231 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:05.724714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] Pushing event updated for resources: {'Network': ['ID=d055ed14-f49a-46c9-88b9-4390090d4790,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:05.734435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d055ed14-f49a-46c9-88b9-4390090d4790 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:43:05.757123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-19d23da0-234d-4c8d-a74f-e8b13c3cbb81 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5503259 Dec 21 04:43:05.760118 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 47922) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:05.765171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Request body: {'subnet': {'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-660074163-subnet', 'tenant_id': 'eed08be4fb1b4c2999fb1316eb0024ae', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:43:05.851050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Made reservation on behalf of eed08be4fb1b4c2999fb1316eb0024ae for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:43:05.853452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:06.103430 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:06.160409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2ac37f7e-7727-41b3-9adf-a58080abbf07,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:06.167861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Checking segment: {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:43:06.168269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Network hostable DHCP agents. Network: d055ed14-f49a-46c9-88b9-4390090d4790, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:43:06.226363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Network d055ed14-f49a-46c9-88b9-4390090d4790 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:43:06.306710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d055ed14-f49a-46c9-88b9-4390090d4790) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:43:06.310821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:06.311489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:06.317322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfc665a3-cc5a-4e67-bfcd-82f7749dd50a None None] Network d055ed14-f49a-46c9-88b9-4390090d4790 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:43:06.384149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a901201a-a789-4fc9-8602-1c17b1052717 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6227739 Dec 21 04:43:06.423602 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d648ae2c-611e-47e2-854a-401c2413b766 None None] Network d055ed14-f49a-46c9-88b9-4390090d4790 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:43:06.812904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-aee20e85-15a4-4f66-831d-a5d1e7c912af tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:06.814375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-aee20e85-15a4-4f66-831d-a5d1e7c912af tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 811 time: 0.1092176 Dec 21 04:43:06.829755 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-b186bb10-9d4f-4bd7-b688-4a5cff58e693 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/quotas/eed08be4fb1b4c2999fb1316eb0024ae HTTP/1.1" status: 200 len: 375 time: 0.0089576 Dec 21 04:43:06.860816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-f4ec254c-1e31-42f8-8922-188e1e426ac5 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0249302 Dec 21 04:43:06.871296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-47a3069f-d088-43ed-9b92-dc723b115250 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:43:06.872253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-47a3069f-d088-43ed-9b92-dc723b115250 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049286 Dec 21 04:43:06.966519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-cf95b399-1f55-4d02-8652-19dee5d29dab service neutron] 10.222.0.18 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888076 Dec 21 04:43:07.058746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-224a3c50-abcf-4cd0-af18-01509f659c68 service neutron] 10.222.0.18 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858805 Dec 21 04:43:07.289533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80fe57d2-4a94-44f6-96df-dc26652e46c9 req-79e941ad-5899-4b9d-a11b-23acc212d216 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 210 time: 0.0260892 Dec 21 04:43:08.405310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13bc0813-d5d2-44a4-8eed-8ef85322caab req-7ae5df4a-f973-47ab-ae35-e3720edc5186 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 210 time: 0.0439682 Dec 21 04:43:09.416832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-ae6a3e94-02bc-4b90-874a-9b8d6204d36d tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:09.418253 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-ae6a3e94-02bc-4b90-874a-9b8d6204d36d tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.54 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 811 time: 0.1028211 Dec 21 04:43:09.436175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Request body: {'port': {'device_id': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790', 'admin_state_up': True, 'tenant_id': 'eed08be4fb1b4c2999fb1316eb0024ae'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:43:09.501714 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdfe4bd3-887e-4a61-add3-2bbdc2936fe3 req-1154f928-de41-4ae1-b050-7dfebda6e3f4 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 210 time: 0.0270491 Dec 21 04:43:09.616937 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Made reservation on behalf of eed08be4fb1b4c2999fb1316eb0024ae for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:43:09.620572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.043453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Allocated IP 172.20.0.14 (d055ed14-f49a-46c9-88b9-4390090d4790/2ac37f7e-7727-41b3-9adf-a58080abbf07/9b7f5376-fa94-4390-b930-a86dcaa52799) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:43:10.184993 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.272842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.314807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Network d055ed14-f49a-46c9-88b9-4390090d4790 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:43:10.317882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:43:10.321389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:43:10.345991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:10.374428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:10.375049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.446355 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-fdfb082a-089b-415e-ab16-e5d7cacf57e0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0139053 Dec 21 04:43:10.464407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Request body: {'port': {'device_id': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:43:10.518875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.621599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b713e6c8-d6a1-4f1e-a2e6-ab946a59b40c req-5052ed60-92c8-442b-8a68-c66235ee1707 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:10.623126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b713e6c8-d6a1-4f1e-a2e6-ab946a59b40c req-5052ed60-92c8-442b-8a68-c66235ee1707 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 932 time: 0.0499058 Dec 21 04:43:10.670591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b713e6c8-d6a1-4f1e-a2e6-ab946a59b40c req-0a378af5-a7d5-4205-9928-111fdd495e0b tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415366 Dec 21 04:43:10.777728 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9b7f5376-fa94-4390-b930-a86dcaa52799 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:43:10.785080 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.796632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Transition to ACTIVE for port object 9b7f5376-fa94-4390-b930-a86dcaa52799 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:43:10.850975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:10.918058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:10.967856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:43:10.968195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:43:10.968524 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 on network d055ed14-f49a-46c9-88b9-4390090d4790 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:43:10.972705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Port 9b7f5376-fa94-4390-b930-a86dcaa52799 on network d055ed14-f49a-46c9-88b9-4390090d4790 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:43:10.973030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 on network d055ed14-f49a-46c9-88b9-4390090d4790 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:43:10.977751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 42, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:43:10.978116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Checking segment: {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:43:10.978533 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Bound using segment: {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:43:10.978968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Bound port: 9b7f5376-fa94-4390-b930-a86dcaa52799, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:43:10.979323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:11.040615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:43:11.043565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:43:11.132154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:11.167981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.168584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:11.169951 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] 10.222.0.54 "PUT /v2.0/ports/9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 1093 time: 0.7096214 Dec 21 04:43:11.170398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:43:11.172655 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f" -d '{"events": [{"name": "network-changed", "server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:43:11.195594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de8c1fd-e8af-40cd-880d-6d3f900d96db service neutron] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:11.215528 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:43:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76261378-d3de-43bd-ae65-6f6c31e9cc2b x-openstack-request-id: req-76261378-d3de-43bd-ae65-6f6c31e9cc2b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:43:11.215528 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:43:11.215528 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-76261378-d3de-43bd-ae65-6f6c31e9cc2b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:43:11.215835 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'status': 'completed', 'code': 200} Dec 21 04:43:11.300710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f req-c0af2b86-f586-4fb1-bdc7-c8430194b77e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.302900 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f req-c0af2b86-f586-4fb1-bdc7-c8430194b77e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1096 time: 0.0455108 Dec 21 04:43:11.406556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f req-f446b092-b5df-46d4-895e-5cd95e8655aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.408031 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f req-f446b092-b5df-46d4-895e-5cd95e8655aa service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&shared=False HTTP/1.1" status: 200 len: 912 time: 0.0893395 Dec 21 04:43:11.503227 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f req-8cf48c26-2b70-444e-b758-6c34a59ddf59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.504783 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6a0a9e6e-d21b-41bc-90d7-81d8baf6764f req-8cf48c26-2b70-444e-b758-6c34a59ddf59 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0901868 Dec 21 04:43:11.602304 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-8489346a-116d-47a0-bda8-66739daf0157 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.603836 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-8489346a-116d-47a0-bda8-66739daf0157 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1096 time: 0.0407221 Dec 21 04:43:11.652414 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-78643aff-91d5-4ae0-97cc-274607fbc222 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0341828 Dec 21 04:43:11.711731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-b3b8a60c-d40f-4794-85e6-b2994f88ffd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.713244 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-b3b8a60c-d40f-4794-85e6-b2994f88ffd8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0525391 Dec 21 04:43:11.748751 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-01887cf7-79a0-479c-bf64-3e13657e90aa service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271251 Dec 21 04:43:11.785509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bbb5e4-e70d-48f1-b340-cd0345950859 req-79826bec-7ac3-4f5d-a5f5-d1708e1a236c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:11.787599 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15bbb5e4-e70d-48f1-b340-cd0345950859 req-79826bec-7ac3-4f5d-a5f5-d1708e1a236c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0487654 Dec 21 04:43:11.838168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-f9ba5646-ebad-453c-9735-bb13dc33436d service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821888 Dec 21 04:43:11.839109 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15bbb5e4-e70d-48f1-b340-cd0345950859 req-4d9cf008-e760-48ec-a7a7-df402e1592c2 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453339 Dec 21 04:43:11.933042 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-45bb3308-0734-4e5b-ada1-34d1ab0f8535 req-3a14e63c-2ad6-4cdf-9cb1-cc052a7543c8 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867596 Dec 21 04:43:12.967135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452404ec-763c-4e1d-ba80-e7c24c587a67 req-8bf60374-84c9-4124-b312-9133302abc09 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:12.968623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-452404ec-763c-4e1d-ba80-e7c24c587a67 req-8bf60374-84c9-4124-b312-9133302abc09 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0512187 Dec 21 04:43:13.015643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-452404ec-763c-4e1d-ba80-e7c24c587a67 req-c7ec9a2c-7632-4e3d-b1b3-0ce9f91bee86 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404983 Dec 21 04:43:14.127368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fbc7e0b-4195-4fe0-ba1b-cf4c8afb608b req-63d11830-80e5-48a0-bcc5-bb95287fb713 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:14.128849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fbc7e0b-4195-4fe0-ba1b-cf4c8afb608b req-63d11830-80e5-48a0-bcc5-bb95287fb713 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0478227 Dec 21 04:43:14.175334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4fbc7e0b-4195-4fe0-ba1b-cf4c8afb608b req-97c6c6ba-e347-4b31-81f6-cab9da575fdb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395198 Dec 21 04:43:15.293579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dcc7e59-2d7a-4dd5-b958-87988c8ed9b7 req-087aac46-883e-42dc-aa67-d24c399df13d tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:15.295757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dcc7e59-2d7a-4dd5-b958-87988c8ed9b7 req-087aac46-883e-42dc-aa67-d24c399df13d tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0529659 Dec 21 04:43:15.342922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dcc7e59-2d7a-4dd5-b958-87988c8ed9b7 req-fabe86d1-28d3-459f-bae7-ed408f960f2a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410647 Dec 21 04:43:15.682432 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:43:15.772813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:15.782882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790', 'port_id': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'mac_address': 'fa:16:3e:a8:86:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 102, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ac37f7e-7727-41b3-9adf-a58080abbf07', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:43:15.822911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:15.835674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b7f5376-fa94-4390-b930-a86dcaa52799 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:43:15.854650 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:15.902486 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:15.949451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:16.158442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['9b7f5376-fa94-4390-b930-a86dcaa52799'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:43:16.456647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bdc6c41-fe6a-4f2d-8a0a-b32d2e9ab2cb req-fc85abfa-3162-4bf5-b97f-c4f2e3c17ade tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:16.458999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bdc6c41-fe6a-4f2d-8a0a-b32d2e9ab2cb req-fc85abfa-3162-4bf5-b97f-c4f2e3c17ade tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 945 time: 0.0505431 Dec 21 04:43:16.506677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2bdc6c41-fe6a-4f2d-8a0a-b32d2e9ab2cb req-6602df27-9564-4c54-b9d7-1161914a0c0a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415325 Dec 21 04:43:17.623090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f68d80-9876-47d6-b05b-a94b4960e37e req-6b0d7b47-b9f0-48d8-a7ba-9d564f001007 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:17.624562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71f68d80-9876-47d6-b05b-a94b4960e37e req-6b0d7b47-b9f0-48d8-a7ba-9d564f001007 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 945 time: 0.0483446 Dec 21 04:43:17.673750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71f68d80-9876-47d6-b05b-a94b4960e37e req-7386853c-0b9f-40b8-9476-a00cbc79059e tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425477 Dec 21 04:43:17.697917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:43:17.799881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 9b7f5376-fa94-4390-b930-a86dcaa52799 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:43:17.804055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 9b7f5376-fa94-4390-b930-a86dcaa52799 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:43:17.804431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:17.878037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:17.903727 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:43:17.905920 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c16b12b0-e5c4-465c-b99c-8a76ac142966" -d '{"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-plugged", "status": "completed", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:43:17.918485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:17.944257 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:43:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e54c0361-afa3-41d9-b0d7-d6d0e51473ea x-openstack-request-id: req-e54c0361-afa3-41d9-b0d7-d6d0e51473ea {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:43:17.944257 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-plugged", "status": "completed", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:43:17.944257 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e54c0361-afa3-41d9-b0d7-d6d0e51473ea {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:43:17.944257 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'code': 200} Dec 21 04:43:18.005798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:18.054187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:18.083078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5ad216-5034-4b61-b836-0d62cb895fda req-712b1c34-942f-459b-8078-5f45b9a84507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:18.084576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e5ad216-5034-4b61-b836-0d62cb895fda req-712b1c34-942f-459b-8078-5f45b9a84507 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1098 time: 0.0410707 Dec 21 04:43:18.128243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-0e5ad216-5034-4b61-b836-0d62cb895fda req-38cc2433-86cc-45cd-a9f4-3df3a7c43895 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369163 Dec 21 04:43:18.788562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baabba83-81e8-4c03-9c50-14a819093f82 req-105ceccf-444b-4fcf-bd48-8f34d9d63256 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:18.790033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baabba83-81e8-4c03-9c50-14a819093f82 req-105ceccf-444b-4fcf-bd48-8f34d9d63256 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0492928 Dec 21 04:43:18.840673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baabba83-81e8-4c03-9c50-14a819093f82 req-761c8d12-0f57-43f2-9cf0-e50b79ba4a22 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444520 Dec 21 04:43:19.936897 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1612a4fa-08fb-4f98-94d2-c1fac8f264b3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:19.956502 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5840de46-1872-4f49-afcd-d8f8a9e6f0f3 req-4b21184b-4b35-404b-9251-a7e6f7a93be3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:19.958788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5840de46-1872-4f49-afcd-d8f8a9e6f0f3 req-4b21184b-4b35-404b-9251-a7e6f7a93be3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0492845 Dec 21 04:43:20.005145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5840de46-1872-4f49-afcd-d8f8a9e6f0f3 req-8e0a91c7-2730-42aa-9ffa-07b7b0e070f3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403223 Dec 21 04:43:20.356148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3610efc-3ee3-4649-8fd6-cba0898658b5 req-ceeaaf53-fdd6-4997-8a1c-a1a1be5bfcf2 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:20.357611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3610efc-3ee3-4649-8fd6-cba0898658b5 req-ceeaaf53-fdd6-4997-8a1c-a1a1be5bfcf2 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0533972 Dec 21 04:43:20.404602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3610efc-3ee3-4649-8fd6-cba0898658b5 req-8e9934d4-50d4-4bc9-9041-c04bc1927795 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409820 Dec 21 04:43:20.476109 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 47994) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:43:20.563800 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-636d0d4b-05d1-4d44-98a2-587341d9769d service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0865133 Dec 21 04:43:20.572961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-3a32115c-882f-40b5-85a1-2acf5d48339c service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:43:20.573912 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-3a32115c-882f-40b5-85a1-2acf5d48339c service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049052 Dec 21 04:43:21.520420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5628e896-ee7f-4d36-ab8b-a9b757b1232a req-28719b29-f863-4f3c-b53d-4c966353a6cb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:21.522073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5628e896-ee7f-4d36-ab8b-a9b757b1232a req-28719b29-f863-4f3c-b53d-4c966353a6cb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0497057 Dec 21 04:43:21.569754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5628e896-ee7f-4d36-ab8b-a9b757b1232a req-afeacb0b-cb92-429b-bb82-7d98edb9cee4 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416164 Dec 21 04:43:22.689531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-22fde0db-8494-4c97-8013-95a0a6646634 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:22.697396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e14ba7d-fea9-4deb-a650-16958a781ed3 req-13e02388-e92d-41ab-9e47-92bac36875b0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:22.699095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e14ba7d-fea9-4deb-a650-16958a781ed3 req-13e02388-e92d-41ab-9e47-92bac36875b0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0594473 Dec 21 04:43:22.736419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-d2f8858b-21e9-4680-8c0d-e8fb56518bad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:22.737903 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-d2f8858b-21e9-4680-8c0d-e8fb56518bad service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1098 time: 0.0405052 Dec 21 04:43:22.748406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e14ba7d-fea9-4deb-a650-16958a781ed3 req-b716258a-0a69-4aa5-9e85-13814b8d1053 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431566 Dec 21 04:43:22.829048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-438abcf7-9bc6-4fb6-8345-5576b4e9b26c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:22.830406 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-438abcf7-9bc6-4fb6-8345-5576b4e9b26c service neutron] 10.222.0.54 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 912 time: 0.0846112 Dec 21 04:43:22.873937 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-f92a26cc-3206-4e57-8d08-26e710b7fe71 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0369406 Dec 21 04:43:22.923762 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-1ecf00de-3131-4d02-a439-1d7040591cd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:22.925135 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-1ecf00de-3131-4d02-a439-1d7040591cd5 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0436156 Dec 21 04:43:22.954754 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-b58ca3df-f788-4f7d-80aa-f4a21cc4dc64 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0227988 Dec 21 04:43:23.046303 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-6680fb1c-42a7-4e7c-bf52-6b347db09898 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848072 Dec 21 04:43:23.134389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-40142b93-e045-4769-a67d-1cf9a8ff0966 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809355 Dec 21 04:43:23.302786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:23.433977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:23.862683 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a505ca98-7f32-47df-bb20-89d6c8864f56 req-85fb9c06-5f93-48ee-b24b-970dea0420a0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:23.864272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a505ca98-7f32-47df-bb20-89d6c8864f56 req-85fb9c06-5f93-48ee-b24b-970dea0420a0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0483506 Dec 21 04:43:23.909287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a505ca98-7f32-47df-bb20-89d6c8864f56 req-c48353b8-d8e3-48de-b31f-48ad0b448cb1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392182 Dec 21 04:43:25.029480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdde64d2-1bdd-40f7-b9c3-02d4f5f768ed req-77625050-e63e-4032-add8-c6cbfc84f0fe tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:25.030951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdde64d2-1bdd-40f7-b9c3-02d4f5f768ed req-77625050-e63e-4032-add8-c6cbfc84f0fe tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0531337 Dec 21 04:43:25.080818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bdde64d2-1bdd-40f7-b9c3-02d4f5f768ed req-e94be1d8-1533-4cad-ae38-2a860862db94 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438128 Dec 21 04:43:25.205462 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:25.278395 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:25.786709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:26.199759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d88b762-2155-4807-a99c-3900747e1b80 req-bd60dd9d-d5a1-414d-8115-cd414a635306 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:26.201222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d88b762-2155-4807-a99c-3900747e1b80 req-bd60dd9d-d5a1-414d-8115-cd414a635306 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0487092 Dec 21 04:43:26.248701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d88b762-2155-4807-a99c-3900747e1b80 req-5b735955-fa69-46b7-81cd-3bce30c20ae6 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398281 Dec 21 04:43:27.362578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9edee08-c727-4f5f-a273-d7cae4f89361 req-0e87c178-ce22-41ea-8103-b76deeb68036 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:27.364620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9edee08-c727-4f5f-a273-d7cae4f89361 req-0e87c178-ce22-41ea-8103-b76deeb68036 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0477867 Dec 21 04:43:27.410365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a9edee08-c727-4f5f-a273-d7cae4f89361 req-110361ef-137d-431e-a8c8-8d07e8cca633 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398653 Dec 21 04:43:28.528142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58612ab1-2a79-4a90-9e41-c512e928a7a2 req-dc63486a-2c24-485a-82f2-243ad053a6f0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:28.529613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58612ab1-2a79-4a90-9e41-c512e928a7a2 req-dc63486a-2c24-485a-82f2-243ad053a6f0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0518782 Dec 21 04:43:28.575210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-58612ab1-2a79-4a90-9e41-c512e928a7a2 req-f2540f89-2ca5-43aa-a673-758bd309470e tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396073 Dec 21 04:43:29.688132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8687f558-f058-4caf-8e06-c957d8bf65ba req-81b901ed-fb4a-48d5-98f0-dd21817bff57 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:29.689596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8687f558-f058-4caf-8e06-c957d8bf65ba req-81b901ed-fb4a-48d5-98f0-dd21817bff57 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0483143 Dec 21 04:43:29.737496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8687f558-f058-4caf-8e06-c957d8bf65ba req-6f5a9f31-4c3b-4a39-9c85-79d3932d9df6 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419831 Dec 21 04:43:30.852120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76eefdf4-f359-4725-a729-fa40061a87fd req-ac5af738-473c-45d2-b6b9-084619d8f18b tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:30.856057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76eefdf4-f359-4725-a729-fa40061a87fd req-ac5af738-473c-45d2-b6b9-084619d8f18b tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0512211 Dec 21 04:43:30.905738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76eefdf4-f359-4725-a729-fa40061a87fd req-06eb753e-21d1-4d2e-a724-8db3040ff3f1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438108 Dec 21 04:43:32.019875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9265c8f8-3d1c-4d12-9c16-e19eef39df4a req-69692a9d-daa7-432c-8327-ea7764c9e49c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:32.021961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9265c8f8-3d1c-4d12-9c16-e19eef39df4a req-69692a9d-daa7-432c-8327-ea7764c9e49c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0492980 Dec 21 04:43:32.070058 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9265c8f8-3d1c-4d12-9c16-e19eef39df4a req-78f52844-c9b6-4b72-82ea-d7520336b3d9 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417948 Dec 21 04:43:32.882623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:43:33.185022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bae915-9077-444f-896c-18c8c1dd132f req-4de31c6e-7743-4046-8b8a-566cbb7f30e7 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:33.186540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9bae915-9077-444f-896c-18c8c1dd132f req-4de31c6e-7743-4046-8b8a-566cbb7f30e7 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0479372 Dec 21 04:43:33.232945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9bae915-9077-444f-896c-18c8c1dd132f req-2f4d0bb3-52b2-4bd9-a58b-38e36680183f tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401254 Dec 21 04:43:34.349844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c62f90-0920-4212-9917-d9c4fdb0c9e6 req-7c01c0c1-5b11-4f1e-969a-7d899c2fa6d7 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:34.351334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6c62f90-0920-4212-9917-d9c4fdb0c9e6 req-7c01c0c1-5b11-4f1e-969a-7d899c2fa6d7 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0514803 Dec 21 04:43:34.401711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6c62f90-0920-4212-9917-d9c4fdb0c9e6 req-8c999d88-1438-4845-9e7a-387262eb05a1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402219 Dec 21 04:43:35.519839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba85e11-fe6e-4711-bf0e-0f18c9562d87 req-c13fbf3d-b2ed-4480-92de-88b7ce9d9aba tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:35.522063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ba85e11-fe6e-4711-bf0e-0f18c9562d87 req-c13fbf3d-b2ed-4480-92de-88b7ce9d9aba tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0497944 Dec 21 04:43:35.568103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5ba85e11-fe6e-4711-bf0e-0f18c9562d87 req-d5a2e6d3-a545-419e-85f6-bc3f75c34af6 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399859 Dec 21 04:43:35.631178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-3c7e556a-5cf4-4050-ab7c-90fc9a5d0488 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:35.632676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-3c7e556a-5cf4-4050-ab7c-90fc9a5d0488 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1098 time: 0.0457485 Dec 21 04:43:35.740981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-a931c25c-37c3-4429-9fcd-ed7f616ca843 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:35.742374 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-a931c25c-37c3-4429-9fcd-ed7f616ca843 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 912 time: 0.0877113 Dec 21 04:43:35.789532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-1aa2002b-f094-4ffb-9b9c-7f9964fb6f02 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0394483 Dec 21 04:43:35.841494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-c5e4adf4-ce08-466f-9e3f-6ce24f12a808 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:35.843001 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-c5e4adf4-ce08-466f-9e3f-6ce24f12a808 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0460646 Dec 21 04:43:35.875146 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-5c184ab3-cb4e-431e-829d-825d0a6ecdfa service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249395 Dec 21 04:43:35.967797 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-25617efa-4d5d-4e0f-9ee2-d4dc9fcf5b87 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844412 Dec 21 04:43:36.056796 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-74bb488d-94d3-47d8-869e-c4c84657e0e9 req-3c5812c1-e491-424f-93e3-1e05bb57e2f5 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816069 Dec 21 04:43:36.703691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28544c99-7895-488f-b7a1-3f47769b7a52 req-78c6b8e6-b19c-460b-ad9a-e05f204369ea tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:36.705160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28544c99-7895-488f-b7a1-3f47769b7a52 req-78c6b8e6-b19c-460b-ad9a-e05f204369ea tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0527294 Dec 21 04:43:36.751318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28544c99-7895-488f-b7a1-3f47769b7a52 req-a8b8ef94-2c49-4292-88fa-ca9185585d3f tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396340 Dec 21 04:43:37.865924 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c3b0084-276c-440a-9e23-21cda01327ea req-894986da-6b40-4e15-8603-4d09c97d7b1e tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:37.867319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c3b0084-276c-440a-9e23-21cda01327ea req-894986da-6b40-4e15-8603-4d09c97d7b1e tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0476162 Dec 21 04:43:37.912616 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c3b0084-276c-440a-9e23-21cda01327ea req-3fc5c4a5-8f99-4715-940f-4cd41cb7a820 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394206 Dec 21 04:43:39.041768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc377c3f-a96f-4153-b54f-486449d90109 req-e9d12b4a-bbe6-49dd-a351-f99001eb2b7c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:39.043477 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc377c3f-a96f-4153-b54f-486449d90109 req-e9d12b4a-bbe6-49dd-a351-f99001eb2b7c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0623460 Dec 21 04:43:39.093774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc377c3f-a96f-4153-b54f-486449d90109 req-c5d35b13-afa4-41bc-bd96-0631be240ba5 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443444 Dec 21 04:43:40.208967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9279ca-6f12-4cf4-9754-bb542cd8a5f2 req-6130ccbe-b489-4ebe-bada-5df7571e093d tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:40.210426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed9279ca-6f12-4cf4-9754-bb542cd8a5f2 req-6130ccbe-b489-4ebe-bada-5df7571e093d tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0474734 Dec 21 04:43:40.256066 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed9279ca-6f12-4cf4-9754-bb542cd8a5f2 req-9021a044-c877-41f0-a260-1bf047aad175 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398324 Dec 21 04:43:41.370845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac26906-89c5-463f-b21c-4c1cc8137417 req-c65d8d8d-d081-4a04-80bc-128c7df7a03a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:41.372341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac26906-89c5-463f-b21c-4c1cc8137417 req-c65d8d8d-d081-4a04-80bc-128c7df7a03a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0488760 Dec 21 04:43:41.419173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fac26906-89c5-463f-b21c-4c1cc8137417 req-67523d07-479d-4872-93c3-c224caca5626 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409434 Dec 21 04:43:42.535406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce5a9dc-8d3f-4ca4-bdca-18809e01dc84 req-66bbb766-2e93-44da-8879-dcde7ab398c3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:42.537517 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ce5a9dc-8d3f-4ca4-bdca-18809e01dc84 req-66bbb766-2e93-44da-8879-dcde7ab398c3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0517099 Dec 21 04:43:42.584658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ce5a9dc-8d3f-4ca4-bdca-18809e01dc84 req-12820a22-0721-4a67-a003-a9ded2b3fd5b tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412686 Dec 21 04:43:43.699184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f29dcc2-83b2-41bd-a292-8d9d37affad9 req-d7cfcf86-ddd1-48ce-8968-ae7a1f58bdf5 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:43.700655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f29dcc2-83b2-41bd-a292-8d9d37affad9 req-d7cfcf86-ddd1-48ce-8968-ae7a1f58bdf5 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0479879 Dec 21 04:43:43.747062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f29dcc2-83b2-41bd-a292-8d9d37affad9 req-724ba2f9-c380-4494-9478-8791fcb405ac tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405917 Dec 21 04:43:44.859615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137a1c85-aa8d-4282-8cd6-d20c078bde33 req-cfaec754-09c7-4434-8d34-4ae4332db8da tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:44.860989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-137a1c85-aa8d-4282-8cd6-d20c078bde33 req-cfaec754-09c7-4434-8d34-4ae4332db8da tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0483680 Dec 21 04:43:44.914068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-137a1c85-aa8d-4282-8cd6-d20c078bde33 req-1e43fb7a-06ff-4782-8324-f1aac1f51eb1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471900 Dec 21 04:43:46.028323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad6bf72b-b423-4ca3-a8ed-25952fd0786c req-64cbe8ba-bbfd-4a17-811a-d93bce408ab4 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:46.029837 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad6bf72b-b423-4ca3-a8ed-25952fd0786c req-64cbe8ba-bbfd-4a17-811a-d93bce408ab4 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0487692 Dec 21 04:43:46.076333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad6bf72b-b423-4ca3-a8ed-25952fd0786c req-3166efce-7857-448b-b5cd-ef07a2140188 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404820 Dec 21 04:43:47.193183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562f7c5c-3be2-46a6-bd5b-616516dbb67a req-d1f63aa6-53ae-4d45-98bb-b79f935212c0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:47.194556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562f7c5c-3be2-46a6-bd5b-616516dbb67a req-d1f63aa6-53ae-4d45-98bb-b79f935212c0 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0478976 Dec 21 04:43:47.240400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562f7c5c-3be2-46a6-bd5b-616516dbb67a req-0ac3c2ce-c825-463a-badb-37813566e395 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398829 Dec 21 04:43:48.357744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9cd694-8cab-42c7-94de-f0b17a434bb7 req-5a06015e-f5f5-4458-b056-a90c084d2f88 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:48.359227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9cd694-8cab-42c7-94de-f0b17a434bb7 req-5a06015e-f5f5-4458-b056-a90c084d2f88 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0516536 Dec 21 04:43:48.404649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a9cd694-8cab-42c7-94de-f0b17a434bb7 req-3c9a8a03-6ee4-41b7-991a-26ad5422d668 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395014 Dec 21 04:43:49.522958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8829b870-a2de-4ac8-8bf2-075bf6875567 req-b08ecb47-e848-41eb-9dfc-9c66e2aeb16c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:49.524419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8829b870-a2de-4ac8-8bf2-075bf6875567 req-b08ecb47-e848-41eb-9dfc-9c66e2aeb16c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0478487 Dec 21 04:43:49.570510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8829b870-a2de-4ac8-8bf2-075bf6875567 req-cfdfb578-7e90-412d-bf26-6c8c564d0ade tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402114 Dec 21 04:43:49.900161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a3305a06-1e7a-46f0-8357-d0263b2358bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:50.395065 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-876dd959-7c44-4382-995d-b85c9f7d04db req-28b719bf-892a-47da-aecd-8ee8e6514838 service neutron] show failed (client error): The resource could not be found. Dec 21 04:43:50.396156 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-28b719bf-892a-47da-aecd-8ee8e6514838 service neutron] 10.222.0.54 "GET /v2.0/ports/9b7f5376-fa94-4390-b930-a86dcaa52799/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0545630 Dec 21 04:43:50.694910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f83ef72-c4c6-43f0-86b1-39b3521d027f req-6629d488-86b6-46a0-aca7-f17adce2c4b4 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:50.696459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f83ef72-c4c6-43f0-86b1-39b3521d027f req-6629d488-86b6-46a0-aca7-f17adce2c4b4 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0554161 Dec 21 04:43:50.745521 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f83ef72-c4c6-43f0-86b1-39b3521d027f req-f5efc4de-cca7-4b9e-b3c9-9e595c6b9fbd tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425191 Dec 21 04:43:50.863478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-37590446-e5f6-4b0d-90f2-5f6ed12ef5b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:50.865017 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-37590446-e5f6-4b0d-90f2-5f6ed12ef5b5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8&tenant_id=eed08be4fb1b4c2999fb1316eb0024ae HTTP/1.1" status: 200 len: 1098 time: 0.0686171 Dec 21 04:43:50.891507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:43:50.950454 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:51.145983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:51.177749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:43:51.217313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:43:51.219625 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be9d327c-52bc-4a9b-b690-1d26ec43cd5d" -d '{"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-unplugged", "status": "completed", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:43:51.223565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:51.235933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Transition to ACTIVE for port object 9b7f5376-fa94-4390-b930-a86dcaa52799 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:43:51.272100 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:43:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70708aa4-2be0-4188-bb91-2ae9215af36b x-openstack-request-id: req-70708aa4-2be0-4188-bb91-2ae9215af36b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:43:51.272404 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-unplugged", "status": "completed", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:43:51.272662 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-70708aa4-2be0-4188-bb91-2ae9215af36b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:43:51.273070 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'code': 200} Dec 21 04:43:51.300268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:51.365422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] No DVR routers for this DVR port 9b7f5376-fa94-4390-b930-a86dcaa52799 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:43:51.367425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:51.401536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:43:51.406667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:43:51.406667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 on network d055ed14-f49a-46c9-88b9-4390090d4790 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:43:51.406667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Port 9b7f5376-fa94-4390-b930-a86dcaa52799 on network d055ed14-f49a-46c9-88b9-4390090d4790 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:43:51.406980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Attempting to bind port 9b7f5376-fa94-4390-b930-a86dcaa52799 on network d055ed14-f49a-46c9-88b9-4390090d4790 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:43:51.411914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 43, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:43:51.412259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Checking segment: {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:43:51.412647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Bound using segment: {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:43:51.413078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Bound port: 9b7f5376-fa94-4390-b930-a86dcaa52799, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a63f7c1c-7009-44f7-a58e-f87f08675ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:43:51.413437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:51.474291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:43:51.477150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:43:51.568878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:51.605920 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:51.609199 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:51.609199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] 10.222.0.31 "PUT /v2.0/ports/9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 1093 time: 0.7203422 Dec 21 04:43:51.624503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e41688-3044-4b69-ad33-8bab9ec95f05 service neutron] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:51.689889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-55258a4d-2dfc-4a47-9f60-1ce90c6a21b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:51.691422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-55258a4d-2dfc-4a47-9f60-1ce90c6a21b6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1096 time: 0.0435748 Dec 21 04:43:51.781007 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-15bbdc08-2dbc-45d9-a209-1bb1e572891d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:51.782485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-15bbdc08-2dbc-45d9-a209-1bb1e572891d service neutron] 10.222.0.31 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 912 time: 0.0820959 Dec 21 04:43:51.833440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-d93a5cd3-9ec0-4688-9553-f334edf27e27 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0397680 Dec 21 04:43:51.905867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876dd959-7c44-4382-995d-b85c9f7d04db req-f78ea08e-4ce0-42e1-a107-daf7bbe1298e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:51.907331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-f78ea08e-4ce0-42e1-a107-daf7bbe1298e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0508914 Dec 21 04:43:51.916177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf066d7b-d15d-4541-99aa-79190e0837c5 req-18d31901-a2c7-4c2b-88e7-4170032ddd62 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:51.917509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf066d7b-d15d-4541-99aa-79190e0837c5 req-18d31901-a2c7-4c2b-88e7-4170032ddd62 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0868244 Dec 21 04:43:51.963457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-f32f4901-60e1-4a61-bdb7-97cb2667c62f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0443485 Dec 21 04:43:52.015977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf066d7b-d15d-4541-99aa-79190e0837c5 req-d0ab20b4-ef8e-4208-8ef1-47cfb246a8b9 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888751 Dec 21 04:43:52.072518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-d2214705-08c6-4243-8046-3075b93b998a service neutron] 10.222.0.31 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959699 Dec 21 04:43:52.170311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-876dd959-7c44-4382-995d-b85c9f7d04db req-9eb818b0-1221-43b0-9cf5-8fa15b9a74b7 service neutron] 10.222.0.31 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861020 Dec 21 04:43:52.679207 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24916f25-72a6-40ca-93fc-aaa27967505e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:53.132627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa09653-3eb5-4295-9a30-cbf330a9d1d5 req-9e8b86e9-d058-44f6-ac90-09cb5775e9c3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.134073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baa09653-3eb5-4295-9a30-cbf330a9d1d5 req-9e8b86e9-d058-44f6-ac90-09cb5775e9c3 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0478981 Dec 21 04:43:53.180796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-baa09653-3eb5-4295-9a30-cbf330a9d1d5 req-6f524683-1817-42e6-84a6-ea3f0ee979ec tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408833 Dec 21 04:43:53.273780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:43:53.276132 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25e676b7-3129-490a-8c9b-8169393f08a5" -d '{"events": [{"name": "network-changed", "server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:43:53.311485 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:53.329713 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:43:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96e6e702-026e-473f-bb75-740d2f1aaa59 x-openstack-request-id: req-96e6e702-026e-473f-bb75-740d2f1aaa59 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:43:53.330008 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:43:53.330263 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-96e6e702-026e-473f-bb75-740d2f1aaa59 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:43:53.330667 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'status': 'completed', 'code': 200} Dec 21 04:43:53.413619 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-d68abf15-6876-4f11-8999-5a2e2dffc359 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.415168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-d68abf15-6876-4f11-8999-5a2e2dffc359 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1096 time: 0.0461791 Dec 21 04:43:53.420357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-1101c8c4-6686-403c-b6bb-80e6d29ca584 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.423227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-1101c8c4-6686-403c-b6bb-80e6d29ca584 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1096 time: 0.0418413 Dec 21 04:43:53.437615 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:53.506447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-5b87f3d1-24f6-48c4-bd7c-07a919cb305d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.507941 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-5b87f3d1-24f6-48c4-bd7c-07a919cb305d service neutron] 10.222.0.54 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 912 time: 0.0847292 Dec 21 04:43:53.519297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-57cb1813-34e8-4bf0-a26d-17f47dad2a6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.521384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-57cb1813-34e8-4bf0-a26d-17f47dad2a6b service neutron] 10.222.0.31 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 912 time: 0.0901880 Dec 21 04:43:53.553813 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-8d7b6d3e-f8a7-4819-bbb8-91a7aa93c3a9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0388091 Dec 21 04:43:53.564016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-04c4f5d7-e260-402e-adbf-6947b47378b8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0340762 Dec 21 04:43:53.602466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-4c91a43b-520c-45a3-acda-5a4842ba7690 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.603965 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-4c91a43b-520c-45a3-acda-5a4842ba7690 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0433486 Dec 21 04:43:53.621462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-950899fc-ac60-478f-a93f-a467f2970a05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:53.622991 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-950899fc-ac60-478f-a93f-a467f2970a05 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0489810 Dec 21 04:43:53.636452 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-70859b16-3abd-400a-b189-2acc6dd8d9e8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252502 Dec 21 04:43:53.656296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-6b407408-a6cd-428b-81f2-3f15616094d9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246792 Dec 21 04:43:53.736446 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-d40f8c31-de53-4bf5-94cf-b441f05d9089 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932424 Dec 21 04:43:53.755345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-03168848-24d6-40c8-a432-2f555b688d6b service neutron] 10.222.0.31 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864911 Dec 21 04:43:53.826515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-67a6d544-14ce-4415-a96e-77949097076d service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826406 Dec 21 04:43:53.848169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25e676b7-3129-490a-8c9b-8169393f08a5 req-1237a07d-b505-4512-9fbb-3a0eb8ba1216 service neutron] 10.222.0.31 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849469 Dec 21 04:43:53.862140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:43:53.902270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 9b7f5376-fa94-4390-b930-a86dcaa52799 host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:43:53.902658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:43:54.301746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260a9bf6-61e4-4385-ba97-f4d52d931c19 req-c559bbd2-bdbc-4c40-b5ff-56abc25a760a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:54.303297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-260a9bf6-61e4-4385-ba97-f4d52d931c19 req-c559bbd2-bdbc-4c40-b5ff-56abc25a760a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0501020 Dec 21 04:43:54.353404 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-260a9bf6-61e4-4385-ba97-f4d52d931c19 req-8f99523f-c6ba-44c4-a4ea-7e43f270088b tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441396 Dec 21 04:43:55.227986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:55.282814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:55.471846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a172cb9-6127-41ae-8c9a-e10320386abd req-041c8224-211a-4530-8c3c-44f6ec9a0029 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:55.473222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a172cb9-6127-41ae-8c9a-e10320386abd req-041c8224-211a-4530-8c3c-44f6ec9a0029 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 944 time: 0.0511453 Dec 21 04:43:55.521768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a172cb9-6127-41ae-8c9a-e10320386abd req-ee997c69-b4bf-437b-adbc-cb53356a8e8c tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406814 Dec 21 04:43:55.820281 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:56.010710 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-8a7ddc21-6949-414a-bc81-199219d2e217 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:56.012188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-8a7ddc21-6949-414a-bc81-199219d2e217 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.54 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8&tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 944 time: 0.0900953 Dec 21 04:43:56.073713 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-57a99c59-afbc-443a-b5f8-9a7a635fa071 service neutron] delete failed (client error): The resource could not be found. Dec 21 04:43:56.074616 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-57a99c59-afbc-443a-b5f8-9a7a635fa071 service neutron] 10.222.0.54 "DELETE /v2.0/ports/9b7f5376-fa94-4390-b930-a86dcaa52799/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0520046 Dec 21 04:43:56.179801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-cfd4e61d-9921-4cf3-b44f-fc8112cc7327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:56.181275 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-cfd4e61d-9921-4cf3-b44f-fc8112cc7327 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 1096 time: 0.0405924 Dec 21 04:43:56.276264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-5b0276d2-23d8-4514-9e40-45da0cde1337 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:56.277746 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-5b0276d2-23d8-4514-9e40-45da0cde1337 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 200 len: 912 time: 0.0882695 Dec 21 04:43:56.319100 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-741431a7-9e1a-4d24-a8e2-adcbceeb2472 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 200 len: 217 time: 0.0337694 Dec 21 04:43:56.366362 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-2e89e3c4-2c62-4cfe-a9c1-3d61ee265b7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:56.367716 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-2e89e3c4-2c62-4cfe-a9c1-3d61ee265b7a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 200 len: 851 time: 0.0424178 Dec 21 04:43:56.405861 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-cb1d2787-56fc-436e-9435-fc4f083e05b1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d055ed14-f49a-46c9-88b9-4390090d4790&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278633 Dec 21 04:43:56.484424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:43:56.499017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-8681041a-26d4-4375-9207-517a8eb86e10 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853238 Dec 21 04:43:56.579342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:56.590081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'network_id': 'd055ed14-f49a-46c9-88b9-4390090d4790', 'port_id': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'mac_address': 'fa:16:3e:a8:86:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 102, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ac37f7e-7727-41b3-9adf-a58080abbf07', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:43:56.592531 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-19522b15-4ab1-4694-8290-618e32b227e0 service neutron] 10.222.0.54 "GET /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861979 Dec 21 04:43:56.634871 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:56.647597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b7f5376-fa94-4390-b930-a86dcaa52799 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:43:56.665655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:56.728417 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:56.774605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:56.781765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.782118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.782459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.782792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.783166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.783500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.783826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.784151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.784473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.784794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.785116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.785436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:56.785754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:43:57.086788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9b7f5376-fa94-4390-b930-a86dcaa52799'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:43:58.073630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-385ac767-0be6-42f7-8f1a-464a537849a2 req-0672a43a-d551-4c7d-86c6-806619767b00 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:58.075134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-385ac767-0be6-42f7-8f1a-464a537849a2 req-0672a43a-d551-4c7d-86c6-806619767b00 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 945 time: 0.0505209 Dec 21 04:43:58.121690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-385ac767-0be6-42f7-8f1a-464a537849a2 req-d25b4d91-f953-4cb7-b950-84d225039b58 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406573 Dec 21 04:43:58.506568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:43:58.611036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 9b7f5376-fa94-4390-b930-a86dcaa52799 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:43:58.615780 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 9b7f5376-fa94-4390-b930-a86dcaa52799 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:43:58.616155 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:58.693900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:58.715557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:43:58.717801 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4df6c3bb-a48b-4f02-a625-a19547347827" -d '{"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-plugged", "status": "completed", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:43:58.731124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:58.754894 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:43:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-267c267a-c4c6-4748-9428-919ecd069bb5 x-openstack-request-id: req-267c267a-c4c6-4748-9428-919ecd069bb5 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:43:58.757906 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-plugged", "status": "completed", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:43:58.757906 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-267c267a-c4c6-4748-9428-919ecd069bb5 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:43:58.757906 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'code': 200} Dec 21 04:43:58.802767 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:58.849302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:43:59.233495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa77ac01-6a70-4c6e-8d9a-a1082e4d0ccc req-7b9f7a50-75b5-454f-b719-9c588832adb1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:59.234955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa77ac01-6a70-4c6e-8d9a-a1082e4d0ccc req-7b9f7a50-75b5-454f-b719-9c588832adb1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0467179 Dec 21 04:43:59.283271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa77ac01-6a70-4c6e-8d9a-a1082e4d0ccc req-7f642cb1-10a5-47d6-859d-8d435c4abd2a tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/security-groups?id=4a162592-fcea-40e5-b63b-930d3de715a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417559 Dec 21 04:43:59.691315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-5cffd4fe-9524-4d1b-b867-3b04d5b13025 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:43:59.692779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-5cffd4fe-9524-4d1b-b867-3b04d5b13025 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.31 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 946 time: 0.0475991 Dec 21 04:43:59.782142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Deleting port 9b7f5376-fa94-4390-b930-a86dcaa52799 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:43:59.782472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:59.870411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] For port 9b7f5376-fa94-4390-b930-a86dcaa52799, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=9b7f5376-fa94-4390-b930-a86dcaa52799,segment=NetworkSegment(a63f7c1c-7009-44f7-a58e-f87f08675ca0),segment_id=a63f7c1c-7009-44f7-a58e-f87f08675ca0)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:43:59.870690 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:43:59.882046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Calling delete_port for 9b7f5376-fa94-4390-b930-a86dcaa52799 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:44:00.151504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:00.179244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Pushing event deleted for resources: {'Port': ['ID=9b7f5376-fa94-4390-b930-a86dcaa52799,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:00.200027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['9b7f5376-fa94-4390-b930-a86dcaa52799'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:44:00.219493 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] No DVR routers for this DVR port 9b7f5376-fa94-4390-b930-a86dcaa52799 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:44:00.222200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:00.225603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7ec2f1a-cca3-4e44-bead-2b710b264fff req-9187e772-c9aa-44ab-a258-24e55fea35bb tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.31 "DELETE /v2.0/ports/9b7f5376-fa94-4390-b930-a86dcaa52799 HTTP/1.1" status: 204 len: 173 time: 0.5235806 Dec 21 04:44:00.226044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-deleted', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:44:00.228359 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5b1cf9d-2580-4155-acd9-cbbd41955d06" -d '{"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-deleted", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:44:00.265199 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:44:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79f573c2-b6f4-4bde-a8f0-7ab00bfb446f x-openstack-request-id: req-79f573c2-b6f4-4bde-a8f0-7ab00bfb446f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:44:00.271132 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ce9fd7b-0979-4136-99cf-b6e842a566d8", "name": "network-vif-deleted", "tag": "9b7f5376-fa94-4390-b930-a86dcaa52799", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:44:00.271132 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-79f573c2-b6f4-4bde-a8f0-7ab00bfb446f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:44:00.271132 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ce9fd7b-0979-4136-99cf-b6e842a566d8', 'name': 'network-vif-deleted', 'tag': '9b7f5376-fa94-4390-b930-a86dcaa52799', 'status': 'completed', 'code': 200} Dec 21 04:44:00.376081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8bc5585a-12b6-4b93-aa81-f769f2650e43 req-e64c1a88-3a0c-4326-adfb-cd21a78ba2a1 tempest-DeleteServersTestJSON-2040911732 tempest-DeleteServersTestJSON-2040911732-project] 10.222.0.18 "GET /v2.0/ports?device_id=4ce9fd7b-0979-4136-99cf-b6e842a566d8 HTTP/1.1" status: 200 len: 210 time: 0.0258441 Dec 21 04:44:01.507527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48106) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:44:01.551222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Deleting subnet 2ac37f7e-7727-41b3-9adf-a58080abbf07 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:44:01.554873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.588740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.627192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.746123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.771432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2ac37f7e-7727-41b3-9adf-a58080abbf07,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:01.775837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.778895 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] 10.222.0.18 "DELETE /v2.0/subnets/2ac37f7e-7727-41b3-9adf-a58080abbf07 HTTP/1.1" status: 204 len: 168 time: 0.2703040 Dec 21 04:44:01.781664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48108) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:44:01.784072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.784417 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.784760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.785092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.785420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.785749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.786675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.787024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.787352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.787676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.788000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.788321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.788665 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e23e7d3-c89f-46c2-b999-4648659740cb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:01.853416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.937048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.960613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d055ed14-f49a-46c9-88b9-4390090d4790']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:44:01.969883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a63f7c1c-7009-44f7-a58e-f87f08675ca0') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:44:01.970186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a63f7c1c-7009-44f7-a58e-f87f08675ca0') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:44:01.979981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.992830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:01.998636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Releasing vlan 102 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:44:01.998989 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:44:02.000674 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:44:02.113835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.119241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.122300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] 10.222.0.18 "DELETE /v2.0/networks/d055ed14-f49a-46c9-88b9-4390090d4790 HTTP/1.1" status: 204 len: 168 time: 0.3396816 Dec 21 04:44:02.136617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9bb46a-b04b-43e0-aa57-05a5f6ad5145 admin admin] Pushing event deleted for resources: {'Network': ['ID=d055ed14-f49a-46c9-88b9-4390090d4790,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:02.443395 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48114) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:44:02.482672 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-73c4090a-6be1-45cb-afd8-4b91f319bc97 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=eed08be4fb1b4c2999fb1316eb0024ae&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0381124 Dec 21 04:44:02.485059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:44:02.530864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d903b66-9e9f-4cdd-82c7-6be5bd5a5630 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.550820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d903b66-9e9f-4cdd-82c7-6be5bd5a5630 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.668067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d903b66-9e9f-4cdd-82c7-6be5bd5a5630 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.670769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3d903b66-9e9f-4cdd-82c7-6be5bd5a5630 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:02.671956 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3d903b66-9e9f-4cdd-82c7-6be5bd5a5630 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/4a162592-fcea-40e5-b63b-930d3de715a9 HTTP/1.1" status: 204 len: 168 time: 0.1860218 Dec 21 04:44:02.680414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d903b66-9e9f-4cdd-82c7-6be5bd5a5630 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a162592-fcea-40e5-b63b-930d3de715a9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:03.670387 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:44:03.767093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-1692501763-network', 'tenant_id': 'f7b615eafc65424db7a815a0a38d03dd'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:44:03.848350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Made reservation on behalf of f7b615eafc65424db7a815a0a38d03dd for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:44:03.850815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:03.863162 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:03.934728 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:03.994190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.021214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:44:04.031510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbdff638-5597-4555-bba1-7c3c545b7525,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:04.036384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.036739 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Added segment 00c1d574-0a76-4fdf-b133-37af2dcc6cce of type vlan for network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba Dec 21 04:44:04.076524 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.182044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.183073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:04.183647 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.244405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] Pushing event updated for resources: {'Network': ['ID=1e70133e-472c-4d88-b3fb-89d0a5bb03ba,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:04.253792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:44:04.282279 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6dc55788-9020-4aa8-94a1-2293f2ed0f20 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6105859 Dec 21 04:44:04.285197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 48142) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:44:04.290077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Request body: {'subnet': {'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-1692501763-subnet', 'tenant_id': 'f7b615eafc65424db7a815a0a38d03dd', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:44:04.359188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Made reservation on behalf of f7b615eafc65424db7a815a0a38d03dd for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:44:04.361539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.525827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:44:04.545996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 9b7f5376-fa94-4390-b930-a86dcaa52799 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:44:04.546364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 9b7f5376-fa94-4390-b930-a86dcaa52799 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:44:04.594129 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.644819 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4a405c87-34b7-4932-9aba-98b9f8052558,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:04.660422 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Checking segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:44:04.660782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Network hostable DHCP agents. Network: 1e70133e-472c-4d88-b3fb-89d0a5bb03ba, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:44:04.736280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:44:04.799411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1e70133e-472c-4d88-b3fb-89d0a5bb03ba) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:44:04.803316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:04.803893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:04.807676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecc521da-133a-46a5-b8b1-aaa444acaf40 None None] Network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:44:04.882154 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f19201be-30b2-4057-977f-58a3865f0462 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5957570 Dec 21 04:44:04.901945 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9e870b5-4b20-43ac-b18f-ba51d56cd8c2 None None] Network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:44:05.298196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-6af84b92-490d-488c-b5bd-d52eb43aa64d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:05.299715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-6af84b92-490d-488c-b5bd-d52eb43aa64d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 815 time: 0.1045525 Dec 21 04:44:05.314479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-57e9ce21-6098-4bab-971a-38b7e29f1626 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/quotas/f7b615eafc65424db7a815a0a38d03dd HTTP/1.1" status: 200 len: 375 time: 0.0089118 Dec 21 04:44:05.345741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-508cbd44-eee0-4eaf-968c-ef7df0c69334 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0255661 Dec 21 04:44:05.436851 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7ce7dc95-d3fa-4359-a2ef-575136fde373 service neutron] 10.222.0.18 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840988 Dec 21 04:44:05.843152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-1699df40-29f1-48ef-baa8-5dabf077ca12 service neutron] 10.222.0.18 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4000902 Dec 21 04:44:06.084406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e6f5cfb-df88-4229-87f7-e1c4f1a0458c req-da5580ab-1f49-4149-8816-1de101e51b32 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 210 time: 0.0266426 Dec 21 04:44:07.184691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-577b8a08-3824-4199-a896-d697a5e4768d req-f54d584a-5336-4155-a0fb-83f93461c084 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 210 time: 0.0288706 Dec 21 04:44:08.308287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-edeb5f20-d860-48a9-8fbd-ff1b4eea7e65 req-244302f1-d297-429a-bc57-eb8b206640a7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 210 time: 0.0324271 Dec 21 04:44:08.338773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-75cfffae-70d6-418d-9aae-7fb58428d5bd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:08.340227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-75cfffae-70d6-418d-9aae-7fb58428d5bd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 815 time: 0.1221099 Dec 21 04:44:08.367788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Request body: {'port': {'device_id': '1423fd61-734e-434b-a502-27cda4e01aae', 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'admin_state_up': True, 'tenant_id': 'f7b615eafc65424db7a815a0a38d03dd'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:44:08.542558 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Made reservation on behalf of f7b615eafc65424db7a815a0a38d03dd for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:44:08.546163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:08.671458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Allocated IP 172.20.0.7 (1e70133e-472c-4d88-b3fb-89d0a5bb03ba/4a405c87-34b7-4932-9aba-98b9f8052558/1afefbc9-b06d-4ec0-9617-841f4f3c15ba) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:44:08.817529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:08.905826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:08.952578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:44:08.955528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:44:08.961844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:44:08.969954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:08.998912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:08.999295 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:08.999647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:08.999990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.000328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.000661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.000993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.001325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.001654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.001984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.002314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.002638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.002987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:09.026095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:09.026716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.097137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-7052753a-d58b-4715-bac3-74c7300f0dbd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7333908 Dec 21 04:44:09.123476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Request body: {'port': {'device_id': '1423fd61-734e-434b-a502-27cda4e01aae', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:44:09.174609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.468609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026d7750-8481-4814-9ebc-5304a6230cad req-bdeb7982-d7ae-4b32-9af1-5eeeb14be08d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:09.470057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-026d7750-8481-4814-9ebc-5304a6230cad req-bdeb7982-d7ae-4b32-9af1-5eeeb14be08d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 931 time: 0.0859578 Dec 21 04:44:09.493745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1afefbc9-b06d-4ec0-9617-841f4f3c15ba {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:44:09.502983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.530477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Transition to ACTIVE for port object 1afefbc9-b06d-4ec0-9617-841f4f3c15ba will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:44:09.537806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-026d7750-8481-4814-9ebc-5304a6230cad req-0ffa95f7-bee6-47f3-8bb0-0858a384cbff tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614197 Dec 21 04:44:09.617079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.669293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:09.737376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:44:09.737716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:44:09.738044 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:44:09.742950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:44:09.743294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:44:09.748100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:44:09.748442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Checking segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:44:09.748830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Bound using segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:44:09.749252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Bound port: 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:44:09.749602 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.810503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:44:09.813474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:44:09.881284 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:44:09.890978 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.926249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:09.926868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:09.929287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] 10.222.0.31 "PUT /v2.0/ports/1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 1092 time: 0.8098409 Dec 21 04:44:09.931448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:44:09.933879 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48712956-9813-43bc-bb82-206312646c2d" -d '{"events": [{"name": "network-changed", "server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:44:09.959779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0399a050-894a-4c07-807d-7cb134ff4648 service neutron] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:09.978551 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:44:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-982b46f3-5062-44c6-a08b-3ace7809dacf x-openstack-request-id: req-982b46f3-5062-44c6-a08b-3ace7809dacf {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:44:09.978849 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:44:09.979680 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-982b46f3-5062-44c6-a08b-3ace7809dacf {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:44:09.980094 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'status': 'completed', 'code': 200} Dec 21 04:44:10.067095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48712956-9813-43bc-bb82-206312646c2d req-7850c567-0068-45ee-be46-2bfab2921c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:10.068731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48712956-9813-43bc-bb82-206312646c2d req-7850c567-0068-45ee-be46-2bfab2921c42 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1095 time: 0.0402670 Dec 21 04:44:10.174509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48712956-9813-43bc-bb82-206312646c2d req-972bdb22-2d7e-4b7e-a90e-439bc956dcd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:10.176061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48712956-9813-43bc-bb82-206312646c2d req-972bdb22-2d7e-4b7e-a90e-439bc956dcd5 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=f7b615eafc65424db7a815a0a38d03dd&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0876427 Dec 21 04:44:10.275299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48712956-9813-43bc-bb82-206312646c2d req-f00ce3f3-20c3-4f46-8b6b-4722170b77e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:10.276751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48712956-9813-43bc-bb82-206312646c2d req-f00ce3f3-20c3-4f46-8b6b-4722170b77e1 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0889618 Dec 21 04:44:10.379779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-8e071c76-5e18-4ff8-8035-f482aa6bbe15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:10.382035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-8e071c76-5e18-4ff8-8035-f482aa6bbe15 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1095 time: 0.0402150 Dec 21 04:44:10.442578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-d4d33df0-bd23-401e-b145-a229658d85e0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0373411 Dec 21 04:44:10.494711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-2c51015e-5fa9-4604-a661-ad95491403a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:10.496152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-2c51015e-5fa9-4604-a661-ad95491403a4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0424523 Dec 21 04:44:10.530964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-5dbf39dd-5bbe-4ad4-a6fe-c78908a133bc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235014 Dec 21 04:44:10.658780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-dce1d55e-946f-4e89-92be-bd21c69fb327 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1142509 Dec 21 04:44:10.676440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9678c371-d8df-48a3-a700-19e5da79ada1 req-2e5d627b-68ef-4f37-94f4-aae18d2ebd7c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:10.678496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678c371-d8df-48a3-a700-19e5da79ada1 req-2e5d627b-68ef-4f37-94f4-aae18d2ebd7c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0713556 Dec 21 04:44:10.779626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9678c371-d8df-48a3-a700-19e5da79ada1 req-09814696-f86c-4536-afc4-41721a7b5a5f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941219 Dec 21 04:44:10.797613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f9910af-0a28-42b0-94e5-d74fabd87f1b req-fc48da49-9dcc-4537-a98a-c91a3d492144 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1294124 Dec 21 04:44:11.897352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-046b9fd3-2aa7-4d00-8ad1-a11babb8bbeb req-a4ce6395-ea73-4604-92da-db53ecef15b5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:11.898769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-046b9fd3-2aa7-4d00-8ad1-a11babb8bbeb req-a4ce6395-ea73-4604-92da-db53ecef15b5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0501835 Dec 21 04:44:11.944357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-046b9fd3-2aa7-4d00-8ad1-a11babb8bbeb req-61106c06-0f02-496b-8c68-c27030d7e94f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396686 Dec 21 04:44:13.074534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a1214c3-81e1-4d30-b924-ef093fa7fe66 req-63be6a72-e579-4bc8-8652-100e3e2d042b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:13.076160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a1214c3-81e1-4d30-b924-ef093fa7fe66 req-63be6a72-e579-4bc8-8652-100e3e2d042b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0487716 Dec 21 04:44:13.126652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a1214c3-81e1-4d30-b924-ef093fa7fe66 req-a6191d2b-17ce-4368-bfe0-89df1e4de956 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446501 Dec 21 04:44:14.241161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0b2680-1b55-479f-bbcd-e05ad2be09ac req-df815baf-3899-4f3f-8ee3-cdafbb90b41d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:14.242629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac0b2680-1b55-479f-bbcd-e05ad2be09ac req-df815baf-3899-4f3f-8ee3-cdafbb90b41d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0498483 Dec 21 04:44:14.289031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac0b2680-1b55-479f-bbcd-e05ad2be09ac req-53a3d39a-5085-418a-8768-f12970f250e7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404148 Dec 21 04:44:14.553019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:44:14.647558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:14.658424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'port_id': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'mac_address': 'fa:16:3e:2d:f0:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 130, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a405c87-34b7-4932-9aba-98b9f8052558', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:44:14.694665 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:14.706986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1afefbc9-b06d-4ec0-9617-841f4f3c15ba {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:44:14.730453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:14.785570 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:14.830655 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:15.133688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['1afefbc9-b06d-4ec0-9617-841f4f3c15ba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:44:15.402730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943ce5a-d0f4-4b1d-801a-3401f199a396 req-3aee51e0-1495-47f5-a1bb-228005e47fc5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:15.404130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1943ce5a-d0f4-4b1d-801a-3401f199a396 req-3aee51e0-1495-47f5-a1bb-228005e47fc5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 944 time: 0.0483434 Dec 21 04:44:15.451581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1943ce5a-d0f4-4b1d-801a-3401f199a396 req-b8227f9c-355c-4cf5-a840-6d5d3862e056 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415158 Dec 21 04:44:16.555508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:44:16.568999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e0a6b11-a565-44ef-9f75-ac152aeda91e req-244459e1-4124-47ab-9a82-5934ebd402d4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:16.570514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e0a6b11-a565-44ef-9f75-ac152aeda91e req-244459e1-4124-47ab-9a82-5934ebd402d4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 944 time: 0.0535908 Dec 21 04:44:16.618105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e0a6b11-a565-44ef-9f75-ac152aeda91e req-fa10b137-51d2-45ad-a8b4-84006c49054b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415721 Dec 21 04:44:16.661911 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:44:16.666025 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:44:16.666399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:16.741312 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:16.762923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:44:16.765147 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7acc383b-5095-490c-ad65-9bc3aa0ef6c1" -d '{"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-plugged", "status": "completed", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:44:16.783951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:16.805119 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:44:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a22909b8-2685-4f81-b007-51c75ee2d8c1 x-openstack-request-id: req-a22909b8-2685-4f81-b007-51c75ee2d8c1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:44:16.805408 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-plugged", "status": "completed", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:44:16.805662 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a22909b8-2685-4f81-b007-51c75ee2d8c1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:44:16.806053 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'code': 200} Dec 21 04:44:16.850924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:16.902153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:16.962768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e75eb1-4fdc-4e7a-ab34-6e649b2135b4 req-30bf84a5-c777-49f3-aa67-268626f8debf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:16.964368 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02e75eb1-4fdc-4e7a-ab34-6e649b2135b4 req-30bf84a5-c777-49f3-aa67-268626f8debf service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1097 time: 0.0403864 Dec 21 04:44:17.016309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02e75eb1-4fdc-4e7a-ab34-6e649b2135b4 req-0e61cd1a-a1b8-444a-8403-48a49f2b4d03 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412016 Dec 21 04:44:17.732570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f402ca8-97c3-40d0-829d-9069e4ff7be0 req-e58bdef6-9382-4e72-ab1a-16c8fa62b9f3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:17.734031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f402ca8-97c3-40d0-829d-9069e4ff7be0 req-e58bdef6-9382-4e72-ab1a-16c8fa62b9f3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0477242 Dec 21 04:44:17.784222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f402ca8-97c3-40d0-829d-9069e4ff7be0 req-24df354b-7ab7-4c7a-b2eb-e09d6f9d52cf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441480 Dec 21 04:44:18.901487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4eb1212-780e-42a8-868e-d29fbaff2fe7 req-5c839a50-6bb2-4c22-89be-baad1ae7350f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:18.902864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4eb1212-780e-42a8-868e-d29fbaff2fe7 req-5c839a50-6bb2-4c22-89be-baad1ae7350f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0489943 Dec 21 04:44:18.948306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c4eb1212-780e-42a8-868e-d29fbaff2fe7 req-af1f620a-96f4-42bb-9382-926881866c63 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393806 Dec 21 04:44:19.065523 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f44ed3d5-9a18-4fd0-baef-e8d7fa888c49 req-c599ef78-1c47-484c-973c-b75b229f288e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:19.067103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f44ed3d5-9a18-4fd0-baef-e8d7fa888c49 req-c599ef78-1c47-484c-973c-b75b229f288e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0484979 Dec 21 04:44:19.112639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f44ed3d5-9a18-4fd0-baef-e8d7fa888c49 req-70eb79ee-510c-46db-86be-9502b027e0aa tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391524 Dec 21 04:44:19.400246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f292de70-694f-4ae7-8c8f-b30fb7aeded9 req-6833e3b1-5828-4e20-a755-77e6e1618a94 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:19.401692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f292de70-694f-4ae7-8c8f-b30fb7aeded9 req-6833e3b1-5828-4e20-a755-77e6e1618a94 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0518317 Dec 21 04:44:19.447403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f292de70-694f-4ae7-8c8f-b30fb7aeded9 req-92dcbc8a-2312-4a27-992d-048b9cd6246d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398152 Dec 21 04:44:19.566795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a023134b-4882-4c72-aece-da4452dbb8d7 req-870538d4-894b-45ed-9a38-d4585052c6cf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:19.568219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a023134b-4882-4c72-aece-da4452dbb8d7 req-870538d4-894b-45ed-9a38-d4585052c6cf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0485435 Dec 21 04:44:19.615576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a023134b-4882-4c72-aece-da4452dbb8d7 req-649c07b2-529f-47fd-b28e-cff812c2694f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408902 Dec 21 04:44:19.905641 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-38053c1b-0bb2-401b-8d23-b83f106b0d79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:20.004574 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7247ca-6f09-4388-9038-0d91d79033a7 req-824d49f7-af39-45ae-b8d8-f1f8aabfdee4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:20.006651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f7247ca-6f09-4388-9038-0d91d79033a7 req-824d49f7-af39-45ae-b8d8-f1f8aabfdee4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0527706 Dec 21 04:44:20.053249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f7247ca-6f09-4388-9038-0d91d79033a7 req-f8e4c14a-ea3e-42ea-ade7-2d85fdd3fbd6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400281 Dec 21 04:44:20.131272 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-7dc73cd6-ef9a-42f3-894b-4e2a499fcb30 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0392406 Dec 21 04:44:20.789015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-5d256140-733b-42c7-a623-dfb4bd9a01eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:20.790526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-5d256140-733b-42c7-a623-dfb4bd9a01eb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1097 time: 0.0417387 Dec 21 04:44:20.900250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-147a04e6-9e75-471f-814e-3401323adf90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:20.901742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-147a04e6-9e75-471f-814e-3401323adf90 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0914490 Dec 21 04:44:20.942430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-7accf2cb-b612-493c-9245-fa950a438486 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0339119 Dec 21 04:44:20.993332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-27fb0e8c-7150-45e4-a903-ea79d3010be0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:20.995272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-27fb0e8c-7150-45e4-a903-ea79d3010be0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0450513 Dec 21 04:44:21.031374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-016a93e6-4f71-4377-987f-55ec156bdc08 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249207 Dec 21 04:44:21.137116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-83933529-6712-4831-aebe-b8692a197009 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0983407 Dec 21 04:44:21.231729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-816795eb-42c6-4cd5-9c7d-73bcfc99683c req-0a6d4221-30f9-44eb-bac4-f22e3e967a48 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:21.233229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-816795eb-42c6-4cd5-9c7d-73bcfc99683c req-0a6d4221-30f9-44eb-bac4-f22e3e967a48 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.1093354 Dec 21 04:44:21.269023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c36b011-ceea-4bf1-8d51-f585764657f6 req-115f8b52-8f67-4282-a120-ccbe2df81d69 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1179173 Dec 21 04:44:21.296372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-816795eb-42c6-4cd5-9c7d-73bcfc99683c req-97968a8e-1d97-4c3d-be84-60fe7c113d19 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566785 Dec 21 04:44:22.239520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-1aba7843-5d92-423a-81d1-001dd63bc8de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:22.241099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-1aba7843-5d92-423a-81d1-001dd63bc8de service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1097 time: 0.0412769 Dec 21 04:44:22.334356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5342f87f-99e1-403c-be86-62e0ef3508d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:22.335835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5342f87f-99e1-403c-be86-62e0ef3508d3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0871401 Dec 21 04:44:22.379090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-a3ace88e-3265-4e64-904c-cf3e2149e611 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0359418 Dec 21 04:44:22.450157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-dd4f8363-64ff-4699-9712-f0230fa68c5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:22.451612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-dd4f8363-64ff-4699-9712-f0230fa68c5a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0650628 Dec 21 04:44:22.464135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d858b8-4abf-4932-bf17-afa6d34417b3 req-00aab43c-8203-437c-b4be-b8def64c34e2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:22.465536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7d858b8-4abf-4932-bf17-afa6d34417b3 req-00aab43c-8203-437c-b4be-b8def64c34e2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0891056 Dec 21 04:44:22.494695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-01ef41fb-9098-4e69-930a-33b81aaf954d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0281675 Dec 21 04:44:22.581785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7d858b8-4abf-4932-bf17-afa6d34417b3 req-831f2ecf-9cd6-4df6-835a-ab1d9b46266d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1082709 Dec 21 04:44:22.609380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-9a4ef4ac-2994-4658-89ab-cb5ea3e97cc3 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1070826 Dec 21 04:44:22.694429 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-500021ed-9d71-4622-ba2d-aa8a5600f1c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:22.709788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-504287c8-fdae-4abe-8b98-754995f7ebe9 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928731 Dec 21 04:44:23.310892 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:23.456401 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:23.702679 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4497bec-38f5-499a-91ac-4c893b9ace00 req-6c62aab8-09b1-4e64-8926-927001b770ea tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:23.704180 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4497bec-38f5-499a-91ac-4c893b9ace00 req-6c62aab8-09b1-4e64-8926-927001b770ea tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0539744 Dec 21 04:44:23.750021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4497bec-38f5-499a-91ac-4c893b9ace00 req-86925885-302b-48bc-a4c5-37a14d4f61bd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396545 Dec 21 04:44:24.867377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228fdfff-0752-44c4-9d2a-8d3cb845a461 req-c698a993-ef90-44c6-be11-164ec58482a7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:24.868766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-228fdfff-0752-44c4-9d2a-8d3cb845a461 req-c698a993-ef90-44c6-be11-164ec58482a7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0486965 Dec 21 04:44:24.914510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-228fdfff-0752-44c4-9d2a-8d3cb845a461 req-5db63ed5-b3ae-4736-bc88-d6f3131d6ec1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399046 Dec 21 04:44:25.221959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:25.302263 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:25.793541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:26.033026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8d88b2-fef0-4c3b-8b84-ae0245108512 req-47b03294-3ca0-4a6f-9e21-aa7207ca8109 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:26.034500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea8d88b2-fef0-4c3b-8b84-ae0245108512 req-47b03294-3ca0-4a6f-9e21-aa7207ca8109 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0500462 Dec 21 04:44:26.085916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea8d88b2-fef0-4c3b-8b84-ae0245108512 req-0ed9d3d5-89cb-440f-a76b-b45b9a333acf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453537 Dec 21 04:44:27.200408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806f4006-1cf7-4f89-abbe-d384534919b2 req-d85b431b-f98a-47b2-bd37-ed7ebefcf0d0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:27.201864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-806f4006-1cf7-4f89-abbe-d384534919b2 req-d85b431b-f98a-47b2-bd37-ed7ebefcf0d0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0493040 Dec 21 04:44:27.250055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-806f4006-1cf7-4f89-abbe-d384534919b2 req-de6365e8-c196-45ae-86b0-7c3a83bd262e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422759 Dec 21 04:44:28.364788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d1d92f-ecdd-4cf6-8e2c-58739b54572e req-06a66414-5062-4420-86b5-ac69c2335a29 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:28.366258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6d1d92f-ecdd-4cf6-8e2c-58739b54572e req-06a66414-5062-4420-86b5-ac69c2335a29 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0490873 Dec 21 04:44:28.412378 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6d1d92f-ecdd-4cf6-8e2c-58739b54572e req-2fec7959-8afa-479d-8274-47eaba947062 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402482 Dec 21 04:44:29.529263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6144db66-34aa-4a04-9701-da3b7708cd5c req-e0c2fb0c-9eec-4504-8711-4271f30c319c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:29.530716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6144db66-34aa-4a04-9701-da3b7708cd5c req-e0c2fb0c-9eec-4504-8711-4271f30c319c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0516922 Dec 21 04:44:29.576460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6144db66-34aa-4a04-9701-da3b7708cd5c req-006bc113-ef46-4471-96c9-fa1bb7ce860c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398624 Dec 21 04:44:30.695246 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0adaea-9b8e-4cc0-9f0d-9603ea118a14 req-2f869b7c-840c-40fa-9a9b-d69ea4d6d8d3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:30.696712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d0adaea-9b8e-4cc0-9f0d-9603ea118a14 req-2f869b7c-840c-40fa-9a9b-d69ea4d6d8d3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0487995 Dec 21 04:44:30.743821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d0adaea-9b8e-4cc0-9f0d-9603ea118a14 req-cf9d8aa6-3c10-4c51-9c3d-ebd40fec582d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411463 Dec 21 04:44:31.856871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c363062-d439-4299-8a49-7123061ccc83 req-73fe281f-687a-4b08-b4f6-02f016afa162 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:31.858640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c363062-d439-4299-8a49-7123061ccc83 req-73fe281f-687a-4b08-b4f6-02f016afa162 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0481000 Dec 21 04:44:31.909188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0c363062-d439-4299-8a49-7123061ccc83 req-c59fba6c-7503-42af-a878-51053dea2032 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445943 Dec 21 04:44:33.023177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa92de8d-320d-4dd3-b418-fa209541c54a req-b1d4e92d-e0e9-4f53-9ed2-27dfcda6fa5a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:33.024620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa92de8d-320d-4dd3-b418-fa209541c54a req-b1d4e92d-e0e9-4f53-9ed2-27dfcda6fa5a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0480418 Dec 21 04:44:33.072465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa92de8d-320d-4dd3-b418-fa209541c54a req-f474e6c1-3d35-4267-a89a-c362f651fb1a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418839 Dec 21 04:44:34.187198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40d865dd-aaf2-488d-8828-36725ffe503b req-88ded580-d196-4f5e-8b6c-58b3460c9ba8 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:34.188666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40d865dd-aaf2-488d-8828-36725ffe503b req-88ded580-d196-4f5e-8b6c-58b3460c9ba8 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0479615 Dec 21 04:44:34.234973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-40d865dd-aaf2-488d-8828-36725ffe503b req-50ceb8d9-e8f5-433a-ad93-656b9677778f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397270 Dec 21 04:44:35.353322 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c164405-cb5e-424f-97d3-b451d5a07b05 req-9ee0ceb3-04c0-4d40-b5f2-fe6c12fe9a2e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:35.354799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c164405-cb5e-424f-97d3-b451d5a07b05 req-9ee0ceb3-04c0-4d40-b5f2-fe6c12fe9a2e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0520375 Dec 21 04:44:35.401452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c164405-cb5e-424f-97d3-b451d5a07b05 req-a6024037-ad3c-45f5-96cf-c2f63536c357 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407417 Dec 21 04:44:36.517772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6143566-435e-4028-811d-bb15b88e1171 req-df24fbb5-78e2-4ce8-91c4-de292916e515 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:36.519274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6143566-435e-4028-811d-bb15b88e1171 req-df24fbb5-78e2-4ce8-91c4-de292916e515 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0499520 Dec 21 04:44:36.566025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6143566-435e-4028-811d-bb15b88e1171 req-82cf8c5d-de3c-4a95-92c4-63f43274c825 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407333 Dec 21 04:44:37.687215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b07641a-d8c4-4c5f-b771-7266f98e9453 req-63e14fa9-bc4e-4951-ada5-101732de9f41 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:37.688679 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b07641a-d8c4-4c5f-b771-7266f98e9453 req-63e14fa9-bc4e-4951-ada5-101732de9f41 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0512698 Dec 21 04:44:37.735145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b07641a-d8c4-4c5f-b771-7266f98e9453 req-1c289713-17b5-4f1e-8af3-7d765d081d5a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399806 Dec 21 04:44:38.850242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581cc564-71b1-407f-8c8c-f79078bb79af req-71916494-d323-4426-877b-923a3fcf3745 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:38.851748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-581cc564-71b1-407f-8c8c-f79078bb79af req-71916494-d323-4426-877b-923a3fcf3745 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0503848 Dec 21 04:44:38.898772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-581cc564-71b1-407f-8c8c-f79078bb79af req-b1e6aea9-ad73-47b2-9126-6fda8095ad4f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409772 Dec 21 04:44:40.019243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728f6efb-47f3-47e2-8f0a-92928e7b4d3b req-ad01e078-31e1-4ab9-960e-7f4b2538e9c5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:40.021243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728f6efb-47f3-47e2-8f0a-92928e7b4d3b req-ad01e078-31e1-4ab9-960e-7f4b2538e9c5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0530875 Dec 21 04:44:40.070702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-728f6efb-47f3-47e2-8f0a-92928e7b4d3b req-406d7baa-1cef-45aa-abf5-3518e9d88f3a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436032 Dec 21 04:44:41.188557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-595331b5-dc8b-4c97-a50a-70ebb6503b23 req-c5813dc4-95b4-4a12-ad08-e4445ba83c53 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:41.190041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-595331b5-dc8b-4c97-a50a-70ebb6503b23 req-c5813dc4-95b4-4a12-ad08-e4445ba83c53 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0492625 Dec 21 04:44:41.236600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-595331b5-dc8b-4c97-a50a-70ebb6503b23 req-68d4ed54-8b13-41a9-9ce4-c2efa960d79c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404749 Dec 21 04:44:42.354742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a32aed81-61b2-4157-935b-854ca2b04642 req-052dd003-2639-4bcd-9c28-348209770325 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:42.356229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a32aed81-61b2-4157-935b-854ca2b04642 req-052dd003-2639-4bcd-9c28-348209770325 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0478938 Dec 21 04:44:42.402075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a32aed81-61b2-4157-935b-854ca2b04642 req-1c51a6fd-27f6-4d9b-a6df-f19b260102f3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400252 Dec 21 04:44:43.517765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274b8d38-2a4b-4075-a9a1-109898eca55a req-1d6bbbb5-95dd-44c1-94e6-a2f5e134241e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:43.519241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-274b8d38-2a4b-4075-a9a1-109898eca55a req-1d6bbbb5-95dd-44c1-94e6-a2f5e134241e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0510113 Dec 21 04:44:43.564608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-274b8d38-2a4b-4075-a9a1-109898eca55a req-a9704105-aefe-406c-b637-e35ecdf2782a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388670 Dec 21 04:44:44.682773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983fd018-e5de-4eb4-b116-cc7e5f173644 req-56e7bee9-2321-4d81-9cd5-2ce68d1c5fda tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:44.684294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-983fd018-e5de-4eb4-b116-cc7e5f173644 req-56e7bee9-2321-4d81-9cd5-2ce68d1c5fda tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0488563 Dec 21 04:44:44.730806 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-983fd018-e5de-4eb4-b116-cc7e5f173644 req-27813cb0-5d65-4b45-9887-4100f43b5487 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405037 Dec 21 04:44:45.844991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81fce2e-a438-456a-a741-e2c8dbbebd0e req-acc0ce4a-f121-4f73-923a-0f879115d63c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:45.846469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b81fce2e-a438-456a-a741-e2c8dbbebd0e req-acc0ce4a-f121-4f73-923a-0f879115d63c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0480506 Dec 21 04:44:45.896443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b81fce2e-a438-456a-a741-e2c8dbbebd0e req-889768f8-a898-43c3-96fa-0fa3cd0edc67 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433993 Dec 21 04:44:46.879494 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:44:47.014461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c7ac36-a888-4186-baf2-066b2a3bfa32 req-82f29f97-c337-424e-b40d-14002bd3ab50 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:47.015968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44c7ac36-a888-4186-baf2-066b2a3bfa32 req-82f29f97-c337-424e-b40d-14002bd3ab50 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0518401 Dec 21 04:44:47.062534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44c7ac36-a888-4186-baf2-066b2a3bfa32 req-f20e2498-4628-424b-a014-fc66bcb5b05f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400712 Dec 21 04:44:48.181240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550c1cfe-dd62-47e8-8a8a-a06a8d767210 req-632b81b5-df56-48b2-80a2-345523d3215c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:48.182704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-550c1cfe-dd62-47e8-8a8a-a06a8d767210 req-632b81b5-df56-48b2-80a2-345523d3215c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0514977 Dec 21 04:44:48.227701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-550c1cfe-dd62-47e8-8a8a-a06a8d767210 req-88ab9119-e08c-494d-aefe-4e61638c3da6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391440 Dec 21 04:44:49.345814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e9ca02-bb4a-4ee6-b557-26708bdaa5c5 req-e81b2add-4651-414e-b9d0-b1c01e14b2b6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:49.347420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85e9ca02-bb4a-4ee6-b557-26708bdaa5c5 req-e81b2add-4651-414e-b9d0-b1c01e14b2b6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0524476 Dec 21 04:44:49.394191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85e9ca02-bb4a-4ee6-b557-26708bdaa5c5 req-66b1b869-dcff-471a-a6d9-ba9397e0651d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401809 Dec 21 04:44:49.901952 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64c11381-bd81-4bd5-a7a4-8e12fdbdf62e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:50.536628 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-926def82-3027-4d68-be7e-5debb5018da2 service neutron] show failed (client error): The resource could not be found. Dec 21 04:44:50.537640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-926def82-3027-4d68-be7e-5debb5018da2 service neutron] 10.222.0.31 "GET /v2.0/ports/1afefbc9-b06d-4ec0-9617-841f4f3c15ba/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0846171 Dec 21 04:44:50.545221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-919e83f2-76d5-4065-94a5-ef8b3090a66c req-5338e1a8-a70b-4340-a1e7-8f98c5f4ec9b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:50.546604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-919e83f2-76d5-4065-94a5-ef8b3090a66c req-5338e1a8-a70b-4340-a1e7-8f98c5f4ec9b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0850916 Dec 21 04:44:50.597298 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-919e83f2-76d5-4065-94a5-ef8b3090a66c req-5ce41163-3f4e-48b1-a2ae-ab58eacc0e57 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441566 Dec 21 04:44:51.061369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-70e560fe-a9db-493a-9a96-98ed758b6d79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:51.062858 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-70e560fe-a9db-493a-9a96-98ed758b6d79 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae&tenant_id=f7b615eafc65424db7a815a0a38d03dd HTTP/1.1" status: 200 len: 1097 time: 0.0730500 Dec 21 04:44:51.080453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:44:51.135172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:51.330457 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:51.363447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:44:51.404416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:44:51.406620 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aef67a22-01b3-4e2e-9ac2-8f6c5f5f6556" -d '{"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-unplugged", "status": "completed", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:44:51.410521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:51.423085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Transition to ACTIVE for port object 1afefbc9-b06d-4ec0-9617-841f4f3c15ba will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:44:51.455309 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:44:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bd66e77-b736-4bda-96e8-e75219d92a26 x-openstack-request-id: req-3bd66e77-b736-4bda-96e8-e75219d92a26 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:44:51.455666 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-unplugged", "status": "completed", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:44:51.455924 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3bd66e77-b736-4bda-96e8-e75219d92a26 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:44:51.456317 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'code': 200} Dec 21 04:44:51.496474 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:51.556294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] No DVR routers for this DVR port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:44:51.559290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:51.592104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:44:51.592368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:44:51.592693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:44:51.596912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:44:51.597237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Attempting to bind port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:44:51.602495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 44, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:44:51.602837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Checking segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:44:51.603264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Bound using segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:44:51.603693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Bound port: 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:44:51.604068 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:51.670376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:44:51.673509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:44:51.711148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abac4fa5-747a-44f3-8ad9-b25e03683056 req-cd676f29-9a18-4c6b-87a2-debc27e906e3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:51.712642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abac4fa5-747a-44f3-8ad9-b25e03683056 req-cd676f29-9a18-4c6b-87a2-debc27e906e3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0469072 Dec 21 04:44:51.758728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-abac4fa5-747a-44f3-8ad9-b25e03683056 req-15d0c88e-0602-4e58-9293-a4cc8f5d0389 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402493 Dec 21 04:44:51.767879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:51.800572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:51.801146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:51.802526 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] 10.222.0.54 "PUT /v2.0/ports/1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 1092 time: 0.7259066 Dec 21 04:44:51.823405 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5270d54d-ef1e-425f-82fe-16046148a70e service neutron] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:51.874398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-228d4fb0-bd13-4a10-aa2e-e43de8a88d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:51.875821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-228d4fb0-bd13-4a10-aa2e-e43de8a88d88 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1095 time: 0.0397499 Dec 21 04:44:51.966296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-bf8a6be3-9ca2-4d3c-95a6-33d63592a028 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:51.967804 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-bf8a6be3-9ca2-4d3c-95a6-33d63592a028 service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0854259 Dec 21 04:44:52.009351 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-ab1e3e01-ad0b-487a-848a-9a246f82fb9a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0348482 Dec 21 04:44:52.057099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-43238fed-ff0b-404b-80d8-eefabb7a708c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:52.058475 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-43238fed-ff0b-404b-80d8-eefabb7a708c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0418515 Dec 21 04:44:52.091190 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-0eb3444a-57d0-4491-b5c3-85260efaf639 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242460 Dec 21 04:44:52.180602 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-7cb75c28-504b-4804-b5f3-297f2241a26b service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827351 Dec 21 04:44:52.275061 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2dba98b6-4fbc-43ac-b25e-5fe96c1cd0a5 req-1c036cb5-d037-42f0-be9e-baa27bc6f11f service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865738 Dec 21 04:44:52.701677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-63ecda75-2cef-47fa-a9c3-ea9ea9242975 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:52.874942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107be0a4-52be-41eb-b607-b2de4a6169f6 req-6f04421c-f1cc-4a9e-bcdf-4d15e9fe1d0f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:52.876424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-107be0a4-52be-41eb-b607-b2de4a6169f6 req-6f04421c-f1cc-4a9e-bcdf-4d15e9fe1d0f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0483155 Dec 21 04:44:52.922624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-107be0a4-52be-41eb-b607-b2de4a6169f6 req-1884453d-a3a7-4cd7-954f-559684d60c4d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397725 Dec 21 04:44:53.324842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:53.450445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:53.457128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:44:53.459729 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a491ceb5-34b1-4f83-982c-2bdf17487593" -d '{"events": [{"name": "network-changed", "server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:44:53.511310 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:44:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2f5e546-02c6-4ec0-9691-eaafbc544303 x-openstack-request-id: req-e2f5e546-02c6-4ec0-9691-eaafbc544303 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:44:53.511609 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:44:53.511862 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e2f5e546-02c6-4ec0-9691-eaafbc544303 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:44:53.512260 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'status': 'completed', 'code': 200} Dec 21 04:44:53.593005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-bc81e8b7-f4bc-4605-8188-933988c1fbd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:53.594400 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-bc81e8b7-f4bc-4605-8188-933988c1fbd2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1095 time: 0.0398757 Dec 21 04:44:53.610396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-1afec72a-6650-4358-bb07-172d08d155cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:53.611952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-1afec72a-6650-4358-bb07-172d08d155cb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1095 time: 0.0442379 Dec 21 04:44:53.683980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-f115d6fb-b5ff-4cc9-aec0-2745f6f3069e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:53.685442 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-f115d6fb-b5ff-4cc9-aec0-2745f6f3069e service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0838790 Dec 21 04:44:53.702618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-898e1ff7-beae-46e7-88c3-9deb152fbcb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:53.704258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-898e1ff7-beae-46e7-88c3-9deb152fbcb1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0843911 Dec 21 04:44:53.730925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-14c01c97-b4c7-4b80-80c2-b68a3356d20d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0373991 Dec 21 04:44:53.754343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-3a4665a1-f4bb-4b3f-b17d-cb398b80a3c8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0386925 Dec 21 04:44:53.779744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-4dd5a91f-7686-4229-8888-a9dbef4aaaaf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:53.781171 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-4dd5a91f-7686-4229-8888-a9dbef4aaaaf service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0429046 Dec 21 04:44:53.806009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-8876c05e-7e55-4372-bfe8-07cb10ab8111 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:53.807578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-8876c05e-7e55-4372-bfe8-07cb10ab8111 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0444291 Dec 21 04:44:53.813314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-faff2f85-d3d8-496f-8d47-35b6361185a5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236995 Dec 21 04:44:53.845059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-02e4843b-622d-4cd1-b6b8-a2e4abb63f1a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249522 Dec 21 04:44:53.907729 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-1ed00e16-5f0e-432e-849b-5160a0329cb8 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861359 Dec 21 04:44:53.943412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-7385323a-0ca7-4152-b805-204b0fb54ebd service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864716 Dec 21 04:44:54.004830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-99c5b3fa-f1de-4435-96c4-29f9a0af96bd service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865607 Dec 21 04:44:54.077266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a491ceb5-34b1-4f83-982c-2bdf17487593 req-84485300-1e77-4947-b64e-69629f738bb7 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232934 Dec 21 04:44:54.088190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-775e9f7e-e67d-4bb2-b1d4-0a9b5a380d81 req-6775e7c1-b528-421e-a2ec-5e783e4c4546 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:54.089546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-775e9f7e-e67d-4bb2-b1d4-0a9b5a380d81 req-6775e7c1-b528-421e-a2ec-5e783e4c4546 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0749512 Dec 21 04:44:54.137314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-775e9f7e-e67d-4bb2-b1d4-0a9b5a380d81 req-a96a965f-7202-4631-9f1f-e2ec36f3f5a1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412018 Dec 21 04:44:54.706002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:44:54.743298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:44:54.743689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:44:55.227625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:55.255866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199a4bc3-9059-46cd-9f53-6b19c34e9882 req-4227ce13-cd79-42b1-95f2-809d1da9b33d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:55.260824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-199a4bc3-9059-46cd-9f53-6b19c34e9882 req-4227ce13-cd79-42b1-95f2-809d1da9b33d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0499289 Dec 21 04:44:55.279327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:55.303773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-199a4bc3-9059-46cd-9f53-6b19c34e9882 req-31212872-7376-4f04-b8d7-59dc345871e5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398002 Dec 21 04:44:55.647614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95bfae8e-f223-4022-97df-c6e584b77eec req-50a2d1de-2991-486a-842d-c535b999bd78 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:55.649191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95bfae8e-f223-4022-97df-c6e584b77eec req-50a2d1de-2991-486a-842d-c535b999bd78 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 943 time: 0.0507421 Dec 21 04:44:55.810832 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:56.052757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95bfae8e-f223-4022-97df-c6e584b77eec req-3a4e6f0b-0525-4433-bee7-3a6d69fad9a7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3976340 Dec 21 04:44:56.103919 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-c930c0f7-9fff-45ea-9a0e-6fdffeca4d5f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:56.105360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-c930c0f7-9fff-45ea-9a0e-6fdffeca4d5f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.31 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae&tenant_id=f7b615eafc65424db7a815a0a38d03dd&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 943 time: 0.4085417 Dec 21 04:44:56.165440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:44:56.168939 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-4d89b787-a7de-4619-859b-82af95872629 service neutron] delete failed (client error): The resource could not be found. Dec 21 04:44:56.169939 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-4d89b787-a7de-4619-859b-82af95872629 service neutron] 10.222.0.31 "DELETE /v2.0/ports/1afefbc9-b06d-4ec0-9617-841f4f3c15ba/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0516698 Dec 21 04:44:56.261522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:56.273058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'port_id': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'mac_address': 'fa:16:3e:2d:f0:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 130, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a405c87-34b7-4932-9aba-98b9f8052558', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:44:56.287540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-181e7432-6893-4d64-9304-6ee8d53aa10d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:56.289054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-181e7432-6893-4d64-9304-6ee8d53aa10d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 1095 time: 0.0437877 Dec 21 04:44:56.314583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:56.327863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1afefbc9-b06d-4ec0-9617-841f4f3c15ba {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:44:56.347061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:56.386251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-633ad54c-5d2a-4fe1-a478-8a0eb1512fb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:56.387771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-633ad54c-5d2a-4fe1-a478-8a0eb1512fb3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0863109 Dec 21 04:44:56.427704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:56.439696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-c16f6d04-259e-4776-b41b-dee102442352 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 200 len: 217 time: 0.0377104 Dec 21 04:44:56.478825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:56.493765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-2e34e0fd-be0f-49a3-b6e2-e13b79d8b122 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:56.495306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-2e34e0fd-be0f-49a3-b6e2-e13b79d8b122 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0451367 Dec 21 04:44:56.531183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-b5558660-ab07-4c20-9313-885097fb4641 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249012 Dec 21 04:44:56.625347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-4bd4f003-b176-4e83-aea3-a53e5fa35154 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852115 Dec 21 04:44:56.721315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e63c4e13-abc3-418d-a9bc-86d2f7bb4a8e req-a70cf91e-769c-43a8-bae5-5983ccaf1169 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849335 Dec 21 04:44:56.730054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['1afefbc9-b06d-4ec0-9617-841f4f3c15ba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:44:57.176468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c607746a-4ae6-4279-8a61-ab5961de3b18 req-e5541df4-b477-4081-ba5b-85a0893a8238 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:57.177925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c607746a-4ae6-4279-8a61-ab5961de3b18 req-e5541df4-b477-4081-ba5b-85a0893a8238 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 944 time: 0.0486379 Dec 21 04:44:57.228719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c607746a-4ae6-4279-8a61-ab5961de3b18 req-6e2e0871-db82-4d06-8db1-37ebb836f2af tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448823 Dec 21 04:44:58.156596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:44:58.267607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:44:58.271546 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:44:58.271910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:58.342768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d319db57-cfa9-46c8-9311-c6eabced44bf req-a95179a5-57be-4444-ae8b-04dfa46d61e2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:58.344301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d319db57-cfa9-46c8-9311-c6eabced44bf req-a95179a5-57be-4444-ae8b-04dfa46d61e2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 944 time: 0.0484946 Dec 21 04:44:58.351024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:58.373516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:44:58.375795 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29247be3-202b-4f96-ba6a-321d26080585" -d '{"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-plugged", "status": "completed", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:44:58.389195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:44:58.393715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d319db57-cfa9-46c8-9311-c6eabced44bf req-4748713d-4953-42a3-83f0-1838aba5e798 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428441 Dec 21 04:44:58.420240 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:44:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-690c5b99-f7f0-4398-b0c4-8d4116f63bbd x-openstack-request-id: req-690c5b99-f7f0-4398-b0c4-8d4116f63bbd {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:44:58.420560 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-plugged", "status": "completed", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:44:58.420813 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-690c5b99-f7f0-4398-b0c4-8d4116f63bbd {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:44:58.421302 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'code': 200} Dec 21 04:44:58.456449 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:44:58.504454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:44:58.510984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d06ae16-dd81-4f4b-9dd0-ecc2071df42e req-0a8247af-0a42-4f96-b48b-af89497fa258 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:58.511701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.512082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.512433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.512548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d06ae16-dd81-4f4b-9dd0-ecc2071df42e req-0a8247af-0a42-4f96-b48b-af89497fa258 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0505812 Dec 21 04:44:58.512776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.513114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.513452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.513786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.514121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.514446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.514770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.515314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.515648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.515977 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:44:58.558917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d06ae16-dd81-4f4b-9dd0-ecc2071df42e req-6d47dbea-ec7e-44c1-9816-9dd63805a6d8 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405397 Dec 21 04:44:58.676086 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7e4ecf-b2e0-444e-bb9a-4668a1c924a6 req-57b62d87-8993-4d56-b4b5-518aefe2bc15 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:58.677559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b7e4ecf-b2e0-444e-bb9a-4668a1c924a6 req-57b62d87-8993-4d56-b4b5-518aefe2bc15 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0523300 Dec 21 04:44:58.730503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b7e4ecf-b2e0-444e-bb9a-4668a1c924a6 req-e5c7fdee-b5a1-4618-be46-e1c39d5350c8 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468495 Dec 21 04:44:59.321836 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-2f3691ef-59ea-43d9-b81c-1469ba2e5b6b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:44:59.323335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-2f3691ef-59ea-43d9-b81c-1469ba2e5b6b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 815 time: 0.0995767 Dec 21 04:44:59.338346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-abd4babb-4d1c-4da9-b971-71fb853f6b18 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/quotas/f7b615eafc65424db7a815a0a38d03dd HTTP/1.1" status: 200 len: 375 time: 0.0094700 Dec 21 04:44:59.389465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-76ad792a-8920-4f8b-925e-a57bb8d715ca tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0459847 Dec 21 04:44:59.401801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-47c28379-9417-4ba8-aec7-98c16a79cfb7 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:44:59.402769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-47c28379-9417-4ba8-aec7-98c16a79cfb7 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048866 Dec 21 04:44:59.494052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-1cf53847-4ec7-4e33-b771-e360abfe2eea service neutron] 10.222.0.18 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846605 Dec 21 04:44:59.588472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-d86f37b8-ca04-4b30-907c-6de706e1b39d service neutron] 10.222.0.18 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876999 Dec 21 04:44:59.811907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-735d9fb6-c639-42f1-8e24-a7ce10fedb86 req-fb7262e9-0ec8-4bf3-906d-f075ba3c0344 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 210 time: 0.0259726 Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:00.619129 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:45:00.622310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-01f10cec-9d6b-49ed-bfc0-aa959dcf0e9a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:00.622789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-01f10cec-9d6b-49ed-bfc0-aa959dcf0e9a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.54 "GET /v2.0/ports?device_id=1423fd61-734e-434b-a502-27cda4e01aae HTTP/1.1" status: 200 len: 945 time: 0.0528657 Dec 21 04:45:00.716527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Deleting port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:45:00.716864 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:00.913798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6c7b6eb6-f8eb-4707-9150-e687d1bcec4c req-c9994a0d-3f35-47f8-b7f9-53a50c70bfd5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 210 time: 0.0280108 Dec 21 04:45:01.114332 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] For port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:01.114689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:01.132437 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Calling delete_port for 1afefbc9-b06d-4ec0-9617-841f4f3c15ba owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:45:01.313209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:01.341415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Pushing event deleted for resources: {'Port': ['ID=1afefbc9-b06d-4ec0-9617-841f4f3c15ba,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:01.349282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['1afefbc9-b06d-4ec0-9617-841f4f3c15ba'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:45:01.382870 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] No DVR routers for this DVR port 1afefbc9-b06d-4ec0-9617-841f4f3c15ba on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:45:01.385378 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:01.388765 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f7fe7d9a-ff60-4456-8cab-a43899898e58 req-a2125100-e8f4-4b8a-8ddc-5175961f842e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.54 "DELETE /v2.0/ports/1afefbc9-b06d-4ec0-9617-841f4f3c15ba HTTP/1.1" status: 204 len: 173 time: 0.7592349 Dec 21 04:45:01.389208 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-deleted', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:01.391445 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db821334-1a81-44ff-af02-9da96f6d9517" -d '{"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-deleted", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:01.428325 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df86dbfe-a8a1-4daf-8ecf-b403a72b95f5 x-openstack-request-id: req-df86dbfe-a8a1-4daf-8ecf-b403a72b95f5 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:01.428660 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1423fd61-734e-434b-a502-27cda4e01aae", "name": "network-vif-deleted", "tag": "1afefbc9-b06d-4ec0-9617-841f4f3c15ba", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:01.428920 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-df86dbfe-a8a1-4daf-8ecf-b403a72b95f5 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:01.429335 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1423fd61-734e-434b-a502-27cda4e01aae', 'name': 'network-vif-deleted', 'tag': '1afefbc9-b06d-4ec0-9617-841f4f3c15ba', 'status': 'completed', 'code': 200} Dec 21 04:45:01.834888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-6d76b667-2e5a-4373-b39b-ee54e150efb4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:01.836401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-6d76b667-2e5a-4373-b39b-ee54e150efb4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 815 time: 0.1043599 Dec 21 04:45:01.854285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Request body: {'port': {'device_id': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'admin_state_up': True, 'tenant_id': 'f7b615eafc65424db7a815a0a38d03dd'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:45:02.014417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f7dc24c-eb13-4764-bb68-30d4ac10a4be req-f95c6a5f-debb-4ef8-8a7f-6d0f1fece4f4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 210 time: 0.0259635 Dec 21 04:45:02.036044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Made reservation on behalf of f7b615eafc65424db7a815a0a38d03dd for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:45:02.039680 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:02.166275 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Allocated IP 172.20.0.8 (1e70133e-472c-4d88-b3fb-89d0a5bb03ba/4a405c87-34b7-4932-9aba-98b9f8052558/0494c075-f120-4ff6-b205-484eadd57c79) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:45:02.311746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:02.396307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:02.439348 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:45:02.442268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:45:02.446465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:45:02.468978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:02.483633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.487893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:02.507712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:02.508323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:02.569680 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-56da9e7d-9c40-4e1b-961d-00e435de6780 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7189777 Dec 21 04:45:02.587518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Request body: {'port': {'device_id': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:45:02.646631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:02.905519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0494c075-f120-4ff6-b205-484eadd57c79 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:45:02.913424 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:02.925060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Transition to ACTIVE for port object 0494c075-f120-4ff6-b205-484eadd57c79 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:45:02.984685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:03.036849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:03.119894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:45:03.120282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:45:03.120550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:45:03.125479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Port 0494c075-f120-4ff6-b205-484eadd57c79 on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:45:03.125653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:45:03.130791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 44, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:45:03.131166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Checking segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:45:03.131560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Bound using segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:45:03.131997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Bound port: 0494c075-f120-4ff6-b205-484eadd57c79, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:45:03.132356 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:03.155508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0257e82-49b7-4afe-8a47-138355534681 req-a560d20e-c0b3-46bd-9650-878db896ee63 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:03.157098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0257e82-49b7-4afe-8a47-138355534681 req-a560d20e-c0b3-46bd-9650-878db896ee63 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 943 time: 0.0656099 Dec 21 04:45:03.197674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:45:03.200881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:45:03.206809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0257e82-49b7-4afe-8a47-138355534681 req-60168e5d-5c36-493d-9d8b-0fab27d14015 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429351 Dec 21 04:45:03.259596 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:03.295958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:03.296571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:03.297967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] 10.222.0.54 "PUT /v2.0/ports/0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 1092 time: 0.7148991 Dec 21 04:45:03.315821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305b3157-463e-49a1-9771-fe2b3ee0f854 service neutron] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:03.435842 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:03.438036 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef38f8ca-f35d-4669-98cf-b5989033a409" -d '{"events": [{"name": "network-changed", "server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "tag": "0494c075-f120-4ff6-b205-484eadd57c79"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:03.457823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-55c0b91e-f751-40e9-90ab-378b928f85ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:03.460359 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-55c0b91e-f751-40e9-90ab-378b928f85ae service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1095 time: 0.0527012 Dec 21 04:45:03.474776 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aa7aca5-bcad-4ae1-9480-f0e170c5f9cf x-openstack-request-id: req-1aa7aca5-bcad-4ae1-9480-f0e170c5f9cf {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:03.475154 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "tag": "0494c075-f120-4ff6-b205-484eadd57c79", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:03.475373 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1aa7aca5-bcad-4ae1-9480-f0e170c5f9cf {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:03.475770 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79', 'status': 'completed', 'code': 200} Dec 21 04:45:03.525216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-1ff09c11-2c03-4f2e-8637-5828a811b667 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0357959 Dec 21 04:45:03.575186 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-25fd0b40-6ca0-435b-9aaa-21811625b98e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:03.576637 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-25fd0b40-6ca0-435b-9aaa-21811625b98e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0432727 Dec 21 04:45:03.614317 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-a707ad08-7eed-4e12-8b67-42eb6dfc923a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286183 Dec 21 04:45:03.706453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-52a4f9e9-00b7-4eaa-ae5b-0201003a0e03 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846653 Dec 21 04:45:03.799321 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-39cd86de-117e-4b1d-a4bb-e0ad5182f763 req-e07a8a3e-1b3d-4cdf-bdb1-44ecacacb4e2 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862145 Dec 21 04:45:03.991449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-c26f3a9a-257f-4ac7-80a3-612561fac8f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:03.992918 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-c26f3a9a-257f-4ac7-80a3-612561fac8f9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1095 time: 0.0438108 Dec 21 04:45:04.088131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-e4a4d200-dcac-4577-b756-20e518061e49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:04.089617 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-e4a4d200-dcac-4577-b756-20e518061e49 service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0889537 Dec 21 04:45:04.136621 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-11af7c49-e94b-464f-8f4f-98d8a374ac49 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0384011 Dec 21 04:45:04.165894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:45:04.186119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-7d93b673-8339-4d09-aab9-ad202dbfdc79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:04.187616 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-7d93b673-8339-4d09-aab9-ad202dbfdc79 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0433512 Dec 21 04:45:04.188580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 1afefbc9-b06d-4ec0-9617-841f4f3c15ba {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:45:04.188929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 1afefbc9-b06d-4ec0-9617-841f4f3c15ba not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:45:04.219067 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-73daea43-bdfb-4125-9f41-34fbd22dec8d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239291 Dec 21 04:45:04.313703 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-bd7e5bc8-8a14-4a48-bd00-46aee565473c service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863731 Dec 21 04:45:04.323590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce06712-4a95-4b5b-b873-06eaf05f24f4 req-65aab340-191c-44b5-b93b-daf7aa633959 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:04.325130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cce06712-4a95-4b5b-b873-06eaf05f24f4 req-65aab340-191c-44b5-b93b-daf7aa633959 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 943 time: 0.0485837 Dec 21 04:45:04.373622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cce06712-4a95-4b5b-b873-06eaf05f24f4 req-6a955f03-d2eb-40af-9ce0-9b3712ab06f5 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424516 Dec 21 04:45:04.404586 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef38f8ca-f35d-4669-98cf-b5989033a409 req-39bb5f12-bba3-41aa-8d30-470fe6da9c6e service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835171 Dec 21 04:45:05.492658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343f5549-d50d-4f73-a950-eec89eefbda1 req-9a2aa382-a1fa-4230-9f25-ddf07d58887f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:05.494123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-343f5549-d50d-4f73-a950-eec89eefbda1 req-9a2aa382-a1fa-4230-9f25-ddf07d58887f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 943 time: 0.0496745 Dec 21 04:45:05.544784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-343f5549-d50d-4f73-a950-eec89eefbda1 req-6f449e48-f1af-4012-afa2-a14a6c3c53ac tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446687 Dec 21 04:45:06.164813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:45:06.256998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:06.266925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '0494c075-f120-4ff6-b205-484eadd57c79', 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'port_id': '0494c075-f120-4ff6-b205-484eadd57c79', 'mac_address': 'fa:16:3e:a8:82:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 130, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a405c87-34b7-4932-9aba-98b9f8052558', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:45:06.464254 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:06.477371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0494c075-f120-4ff6-b205-484eadd57c79 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:45:06.497182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:06.559163 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:06.606252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:06.660380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95b60c01-164f-4a81-8ca2-36f7ce22ca72 req-f0c781e7-6f92-437f-a7d8-17b0a6db7b68 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:06.661866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95b60c01-164f-4a81-8ca2-36f7ce22ca72 req-f0c781e7-6f92-437f-a7d8-17b0a6db7b68 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 944 time: 0.0480013 Dec 21 04:45:06.713059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95b60c01-164f-4a81-8ca2-36f7ce22ca72 req-b605c21f-24b3-4952-9373-4d13ea6bb965 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444720 Dec 21 04:45:06.816934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['0494c075-f120-4ff6-b205-484eadd57c79'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:45:07.829544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea96beb1-aa26-4cf9-8eac-2cdcdd93951c req-427918e8-e0a3-47d0-8628-ab22035fee6f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:07.831051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea96beb1-aa26-4cf9-8eac-2cdcdd93951c req-427918e8-e0a3-47d0-8628-ab22035fee6f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 944 time: 0.0502081 Dec 21 04:45:07.878786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea96beb1-aa26-4cf9-8eac-2cdcdd93951c req-78a4e4a7-42e5-4eca-a4ab-1e80eb374a7b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415175 Dec 21 04:45:08.166027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:45:08.269813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 0494c075-f120-4ff6-b205-484eadd57c79 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:45:08.273400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 0494c075-f120-4ff6-b205-484eadd57c79 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:08.274260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:08.349308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:08.370663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:08.372887 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9e2d282-ca95-432f-9dd0-ecd39a81d60f" -d '{"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-plugged", "status": "completed", "tag": "0494c075-f120-4ff6-b205-484eadd57c79"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:08.387401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:08.409598 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60bbbe1c-c553-445a-b117-a8a00c6c6477 x-openstack-request-id: req-60bbbe1c-c553-445a-b117-a8a00c6c6477 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:08.409892 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-plugged", "status": "completed", "tag": "0494c075-f120-4ff6-b205-484eadd57c79", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:08.410153 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-60bbbe1c-c553-445a-b117-a8a00c6c6477 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:08.410972 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79', 'code': 200} Dec 21 04:45:08.450526 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:08.497826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:08.543506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeb93d1-93a6-4ad4-924d-1e9394db322c req-c16a347b-b92b-446f-99c4-f1702c9f0991 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:08.545001 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-afeb93d1-93a6-4ad4-924d-1e9394db322c req-c16a347b-b92b-446f-99c4-f1702c9f0991 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1097 time: 0.0457983 Dec 21 04:45:08.589131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-afeb93d1-93a6-4ad4-924d-1e9394db322c req-988ee325-a492-4458-9e3c-42d304cbbca2 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373323 Dec 21 04:45:08.996927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869adb13-8636-495c-bfdc-85dffd76d8f5 req-d66053d7-bb02-428f-9958-b77212667da7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:08.998392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-869adb13-8636-495c-bfdc-85dffd76d8f5 req-d66053d7-bb02-428f-9958-b77212667da7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0529790 Dec 21 04:45:09.046027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-869adb13-8636-495c-bfdc-85dffd76d8f5 req-61c83068-16d2-4255-ae08-2aa89ce0b232 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411808 Dec 21 04:45:10.162542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07f3c74-7515-4fd2-86d2-2260f3bb08ec req-1b739aac-2d30-4ec5-a3bc-cd6f601ccbe1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:10.164044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07f3c74-7515-4fd2-86d2-2260f3bb08ec req-1b739aac-2d30-4ec5-a3bc-cd6f601ccbe1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0481403 Dec 21 04:45:10.217582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07f3c74-7515-4fd2-86d2-2260f3bb08ec req-320a2844-2eb7-45b1-b928-4ef5613335f3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476375 Dec 21 04:45:10.335653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6e1538-81a1-4948-b0c8-f32a1e403e61 req-2212b6c3-56c7-4c3e-b634-0c4f9261ca7b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:10.337033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a6e1538-81a1-4948-b0c8-f32a1e403e61 req-2212b6c3-56c7-4c3e-b634-0c4f9261ca7b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0487242 Dec 21 04:45:10.386902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a6e1538-81a1-4948-b0c8-f32a1e403e61 req-6d09f77d-fdac-4c93-b4f4-54ee8c332703 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440578 Dec 21 04:45:10.862661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-969ef30c-7163-4c01-98b0-d46b349777ee req-b6410a47-d372-458b-bffb-3125437661b1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:10.864192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-969ef30c-7163-4c01-98b0-d46b349777ee req-b6410a47-d372-458b-bffb-3125437661b1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0500112 Dec 21 04:45:10.912089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-969ef30c-7163-4c01-98b0-d46b349777ee req-3e696569-1dcd-4fcd-afc9-a9ecb7b01cd4 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417516 Dec 21 04:45:10.995819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-a7de182a-f238-404a-8b00-de5d289a747e service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0395091 Dec 21 04:45:12.030252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee7341d-232c-4a1b-8581-317684100124 req-a7c73a94-bb76-4e5c-9e83-4ad83572e4dc tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:12.031691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee7341d-232c-4a1b-8581-317684100124 req-a7c73a94-bb76-4e5c-9e83-4ad83572e4dc tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0491073 Dec 21 04:45:12.077990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cee7341d-232c-4a1b-8581-317684100124 req-78db121b-e8de-4e68-bd85-bae31f2f5fd9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402801 Dec 21 04:45:13.139150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-f4774002-bc30-4970-ae0b-73c5d2ea1e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:13.144908 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-f4774002-bc30-4970-ae0b-73c5d2ea1e15 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1097 time: 0.0513043 Dec 21 04:45:13.208500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eeea35c-9ecd-4739-8ddf-e140a84474ea req-7be1040a-b06f-43aa-a3e1-98cf099eac96 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:13.210888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1eeea35c-9ecd-4739-8ddf-e140a84474ea req-7be1040a-b06f-43aa-a3e1-98cf099eac96 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0558658 Dec 21 04:45:13.240980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-8afce212-168e-4ae7-b4fb-322381758a5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:13.243053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-8afce212-168e-4ae7-b4fb-322381758a5a service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0893784 Dec 21 04:45:13.258785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1eeea35c-9ecd-4739-8ddf-e140a84474ea req-6196bea7-5f84-4977-a739-d38dcced2c2d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418675 Dec 21 04:45:13.283204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-2906fc5a-5832-474f-8659-43b1d9742227 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0340438 Dec 21 04:45:13.335823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-8d20d974-9a90-424b-ae81-19ae64755f9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:13.337763 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-8d20d974-9a90-424b-ae81-19ae64755f9d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0483358 Dec 21 04:45:13.368861 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-53c1150f-3344-4fa4-bfd9-ee6886ae5aa8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238013 Dec 21 04:45:13.456017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-590ae543-7510-487e-af4f-cd90d7dec002 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795407 Dec 21 04:45:13.556305 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-1e55abf7-58fa-4fa4-862d-d988c36a4cdb service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934963 Dec 21 04:45:14.379633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73227cdd-56c0-4b9a-b8a1-f7343b6888f4 req-139c3c61-5192-4a14-9802-e958e913b999 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:14.381152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73227cdd-56c0-4b9a-b8a1-f7343b6888f4 req-139c3c61-5192-4a14-9802-e958e913b999 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0546944 Dec 21 04:45:14.432877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73227cdd-56c0-4b9a-b8a1-f7343b6888f4 req-aa5037ac-d4fc-49ba-a04c-28359f406621 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432899 Dec 21 04:45:15.551435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea3cb247-16e0-49b0-9093-480a19532da8 req-8f6862f9-293b-49fa-8585-eb66ce423216 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:15.552911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea3cb247-16e0-49b0-9093-480a19532da8 req-8f6862f9-293b-49fa-8585-eb66ce423216 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0518777 Dec 21 04:45:15.600014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea3cb247-16e0-49b0-9093-480a19532da8 req-308aceb1-b520-4988-ba91-230f1c27f60d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406249 Dec 21 04:45:16.714570 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eced4dbe-7ef4-44ae-9526-89978310e1f1 req-24cb97cc-77f4-44a6-9e8f-683b2dbc79f0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:16.716748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eced4dbe-7ef4-44ae-9526-89978310e1f1 req-24cb97cc-77f4-44a6-9e8f-683b2dbc79f0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0481966 Dec 21 04:45:16.766982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eced4dbe-7ef4-44ae-9526-89978310e1f1 req-ca43dabe-db75-47a2-85df-81bdf3006628 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415614 Dec 21 04:45:17.883419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f81c33a-9ff4-461b-bd6d-083fe473ea3f req-035efc7c-cfbf-4f8b-b313-ece3953881ac tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:17.884784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f81c33a-9ff4-461b-bd6d-083fe473ea3f req-035efc7c-cfbf-4f8b-b313-ece3953881ac tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0469496 Dec 21 04:45:17.933935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f81c33a-9ff4-461b-bd6d-083fe473ea3f req-ebf45f9b-36ad-4722-a601-75aef7d83bae tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433145 Dec 21 04:45:19.047373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6260f648-09a4-467d-becf-0ec5418262b9 req-465fe0c1-70d3-4015-b627-332ab0368cf2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:19.048821 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6260f648-09a4-467d-becf-0ec5418262b9 req-465fe0c1-70d3-4015-b627-332ab0368cf2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0473170 Dec 21 04:45:19.095284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6260f648-09a4-467d-becf-0ec5418262b9 req-867d9083-67bf-46c6-96b5-561869c672a9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405514 Dec 21 04:45:19.892933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6f28f98-0118-45fb-9ed7-794258963c22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:20.208625 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e008a8b4-ac98-4962-afc6-d606dd5ae2fb req-51317e45-c2ac-491c-b3ec-f6433a260ee3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:20.210330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e008a8b4-ac98-4962-afc6-d606dd5ae2fb req-51317e45-c2ac-491c-b3ec-f6433a260ee3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0481865 Dec 21 04:45:20.257434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e008a8b4-ac98-4962-afc6-d606dd5ae2fb req-c38b1ab5-a628-4998-a72b-335b1703a38f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406570 Dec 21 04:45:21.375676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d2d1ab-3e5f-46c8-bce9-6ff894a00fe0 req-e7983310-7c50-4eb8-88d0-b6f3f4a3d75c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:21.377121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47d2d1ab-3e5f-46c8-bce9-6ff894a00fe0 req-e7983310-7c50-4eb8-88d0-b6f3f4a3d75c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0526025 Dec 21 04:45:21.423421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47d2d1ab-3e5f-46c8-bce9-6ff894a00fe0 req-f8640186-168e-4fc8-8b8f-cfba7f27f3bf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404117 Dec 21 04:45:22.538261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeb8d7f-526c-45d3-a5e8-a22ea3dc340f req-462ef9d5-1382-49e3-9eec-804562a946c9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:22.540430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5aeb8d7f-526c-45d3-a5e8-a22ea3dc340f req-462ef9d5-1382-49e3-9eec-804562a946c9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0492015 Dec 21 04:45:22.586682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5aeb8d7f-526c-45d3-a5e8-a22ea3dc340f req-4bac32c4-6a7b-46c1-b2e1-20575bb940bd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398302 Dec 21 04:45:22.696115 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1bec0436-712f-456a-988a-986ad8ac24b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:23.353215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:23.458366 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:23.701569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04482b6-a8c7-4462-82a8-1cc920191829 req-3061aa27-e375-4be9-9e0f-607e0df5ac89 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:23.703136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b04482b6-a8c7-4462-82a8-1cc920191829 req-3061aa27-e375-4be9-9e0f-607e0df5ac89 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0497372 Dec 21 04:45:23.752913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b04482b6-a8c7-4462-82a8-1cc920191829 req-04bf8580-5dd8-4a6e-9593-7a7c61ad79e7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439684 Dec 21 04:45:23.877754 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:45:24.868335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c2c28c-027e-4e7f-b6b0-c5d78b9598cc req-e4e49615-065a-4650-858f-79196bf4c3f6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:24.869744 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0c2c28c-027e-4e7f-b6b0-c5d78b9598cc req-e4e49615-065a-4650-858f-79196bf4c3f6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0498493 Dec 21 04:45:24.916566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0c2c28c-027e-4e7f-b6b0-c5d78b9598cc req-1d2b3349-9d75-46ed-939a-37cec2190ad0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408101 Dec 21 04:45:25.224042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:25.278536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:25.795276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:26.032439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad1dd358-b2a0-448a-9ec9-3b96834689d1 req-c604ae72-8978-4f1b-b649-32e899b620a7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:26.033920 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad1dd358-b2a0-448a-9ec9-3b96834689d1 req-c604ae72-8978-4f1b-b649-32e899b620a7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0479639 Dec 21 04:45:26.080756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ad1dd358-b2a0-448a-9ec9-3b96834689d1 req-6f7d9aa7-9281-420f-8b3c-bca8b54de360 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400169 Dec 21 04:45:27.204098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e72b3f-c7be-4f5f-8df6-72b9e45b5bd1 req-157c2fff-1fc4-4845-9184-648d76a0cb40 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:27.205622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8e72b3f-c7be-4f5f-8df6-72b9e45b5bd1 req-157c2fff-1fc4-4845-9184-648d76a0cb40 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0553839 Dec 21 04:45:27.253245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8e72b3f-c7be-4f5f-8df6-72b9e45b5bd1 req-bb9e014e-b5ee-412d-a524-010e0258a6b3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410812 Dec 21 04:45:28.367047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9b5304-b66c-4ec4-a6c8-36e79065944c req-c617b91e-9873-4fc5-8ba9-b42450249c95 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:28.368516 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9b5304-b66c-4ec4-a6c8-36e79065944c req-c617b91e-9873-4fc5-8ba9-b42450249c95 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0483739 Dec 21 04:45:28.415412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b9b5304-b66c-4ec4-a6c8-36e79065944c req-a2afdb38-cfca-47a4-81f4-95c82014b819 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409513 Dec 21 04:45:29.537066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabb5bb8-01d2-4e9c-adc2-742e47aa7350 req-112b73d4-ce86-4c60-b7a1-751a6b149b45 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:29.538540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aabb5bb8-01d2-4e9c-adc2-742e47aa7350 req-112b73d4-ce86-4c60-b7a1-751a6b149b45 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0521865 Dec 21 04:45:29.584625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aabb5bb8-01d2-4e9c-adc2-742e47aa7350 req-bfb15e6d-08b1-4246-b518-adb8f4a7a54d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399628 Dec 21 04:45:30.697481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73eaecf1-be6b-44d3-91e9-d58cbc2620a1 req-0dad342a-fc92-4f78-8eae-4f8743fe233f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:30.698977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73eaecf1-be6b-44d3-91e9-d58cbc2620a1 req-0dad342a-fc92-4f78-8eae-4f8743fe233f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0477524 Dec 21 04:45:30.753424 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73eaecf1-be6b-44d3-91e9-d58cbc2620a1 req-d27495ed-6cae-4096-92a1-9a2b7fed3490 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485487 Dec 21 04:45:31.872798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ef33b3-9a7d-44e2-aa2f-09d67900a167 req-072c0a20-5d76-453a-a518-a17d15000a3d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:31.874319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5ef33b3-9a7d-44e2-aa2f-09d67900a167 req-072c0a20-5d76-453a-a518-a17d15000a3d tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0502729 Dec 21 04:45:31.924835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5ef33b3-9a7d-44e2-aa2f-09d67900a167 req-015c6fae-2a9c-4b58-b54c-630544fee038 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444465 Dec 21 04:45:33.042577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b226f4-a3fe-4b1c-9323-f62a3fb743bb req-09bb9107-2ecb-4adc-8d2a-8c1ef639623b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:33.044059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66b226f4-a3fe-4b1c-9323-f62a3fb743bb req-09bb9107-2ecb-4adc-8d2a-8c1ef639623b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0481544 Dec 21 04:45:33.089529 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66b226f4-a3fe-4b1c-9323-f62a3fb743bb req-371cd157-73d7-422c-a48b-77b369e9d9f8 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395291 Dec 21 04:45:34.202665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7653fc13-0998-4a98-90f2-47a6af6a304d req-731ecc6b-28b2-4413-8dc8-74ede09e116f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:34.204146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7653fc13-0998-4a98-90f2-47a6af6a304d req-731ecc6b-28b2-4413-8dc8-74ede09e116f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0472026 Dec 21 04:45:34.250363 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7653fc13-0998-4a98-90f2-47a6af6a304d req-6f859071-c74e-4d47-b93a-0aa81dd3ad32 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401220 Dec 21 04:45:35.369127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83da52e0-ddf5-4ea3-ae5f-8471088c3daa req-c8a01668-e0da-4a78-8991-c93525940c17 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:35.370588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83da52e0-ddf5-4ea3-ae5f-8471088c3daa req-c8a01668-e0da-4a78-8991-c93525940c17 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0523710 Dec 21 04:45:35.417050 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83da52e0-ddf5-4ea3-ae5f-8471088c3daa req-0e9e3a4a-55dd-4000-aec9-ad1a6459f1ca tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405602 Dec 21 04:45:36.531045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5463a2df-d433-42c4-8e1f-fa4c4822d544 req-05e2c9c0-150a-480f-99e6-a0499a22cfbf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:36.532533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5463a2df-d433-42c4-8e1f-fa4c4822d544 req-05e2c9c0-150a-480f-99e6-a0499a22cfbf tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0483203 Dec 21 04:45:36.579357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5463a2df-d433-42c4-8e1f-fa4c4822d544 req-7e827405-41e7-4996-8f5f-7ef8f04fa16a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406601 Dec 21 04:45:37.484832 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83644019-ca98-4502-be69-42b852febd6d req-bcd177a6-be31-4f82-9000-b82e418ef7e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:37.486283 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-bcd177a6-be31-4f82-9000-b82e418ef7e8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1097 time: 0.0393522 Dec 21 04:45:37.595612 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83644019-ca98-4502-be69-42b852febd6d req-d2e4daae-d37b-4105-87a6-372c7df38cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:37.597130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-d2e4daae-d37b-4105-87a6-372c7df38cf0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0881045 Dec 21 04:45:37.641860 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-d63e2f68-7b47-4bc3-ad21-c462c27752d5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0360634 Dec 21 04:45:37.690910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83644019-ca98-4502-be69-42b852febd6d req-2696ea03-fd3c-4752-a93c-7630312d02df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:37.692462 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-2696ea03-fd3c-4752-a93c-7630312d02df service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0437741 Dec 21 04:45:37.693785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde191f1-16c5-464c-b962-189cab86eaac req-600fc67f-9e50-467b-9f16-a525590321f0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:37.695852 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fde191f1-16c5-464c-b962-189cab86eaac req-600fc67f-9e50-467b-9f16-a525590321f0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0474374 Dec 21 04:45:37.731281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-5aca51b0-4861-461c-b333-be44e7e84c60 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0289390 Dec 21 04:45:37.747379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fde191f1-16c5-464c-b962-189cab86eaac req-b8cfad27-36c7-4d46-a7a8-f849e775eaa9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454111 Dec 21 04:45:37.819606 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-5a5d5496-2328-449d-8a8d-deb352cb341f service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816493 Dec 21 04:45:37.911515 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83644019-ca98-4502-be69-42b852febd6d req-6e3bd161-602d-4680-9275-ba34960ae246 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843294 Dec 21 04:45:38.861775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98c57e4-6c45-48a2-abe3-97873520ee2c req-4a50c3e0-eaee-41c0-983a-877cab086b2f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:38.863295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e98c57e4-6c45-48a2-abe3-97873520ee2c req-4a50c3e0-eaee-41c0-983a-877cab086b2f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0484104 Dec 21 04:45:38.910258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e98c57e4-6c45-48a2-abe3-97873520ee2c req-e1300bc7-94de-4ad8-93cd-d6d15e6e76e6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403759 Dec 21 04:45:40.023857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1f89d6-ad98-4ace-bc56-566753adb890 req-804c1146-253b-4521-8972-174d0a0f135a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:40.026063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1f89d6-ad98-4ace-bc56-566753adb890 req-804c1146-253b-4521-8972-174d0a0f135a tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0487032 Dec 21 04:45:40.071474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1f89d6-ad98-4ace-bc56-566753adb890 req-8985cbaa-1d33-4392-9bdc-fc78f105d9da tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389225 Dec 21 04:45:40.796750 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-9b300caf-f7e2-49fc-8299-727e4bc38cb4 service neutron] show failed (client error): The resource could not be found. Dec 21 04:45:40.797775 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-9b300caf-f7e2-49fc-8299-727e4bc38cb4 service neutron] 10.222.0.54 "GET /v2.0/ports/0494c075-f120-4ff6-b205-484eadd57c79/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0530338 Dec 21 04:45:41.193358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d39466-1eab-48d7-b35f-932175c4c84b req-b8acb127-b0cc-4d95-8898-8a0cb3bde26f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:41.194908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21d39466-1eab-48d7-b35f-932175c4c84b req-b8acb127-b0cc-4d95-8898-8a0cb3bde26f tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0537605 Dec 21 04:45:41.247318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21d39466-1eab-48d7-b35f-932175c4c84b req-550aa7ff-4336-483b-9607-03dc90ef88bc tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461333 Dec 21 04:45:41.314669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-0082c378-bd9b-41af-9748-a41e1c7f4a7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:41.316183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-0082c378-bd9b-41af-9748-a41e1c7f4a7c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1&tenant_id=f7b615eafc65424db7a815a0a38d03dd HTTP/1.1" status: 200 len: 1097 time: 0.0402505 Dec 21 04:45:41.343240 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:45:41.406637 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:41.602089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:41.633629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:45:41.672610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:41.679831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:41.679831 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56ea52a1-99d6-4f20-a791-bbc50db3c2e5" -d '{"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-unplugged", "status": "completed", "tag": "0494c075-f120-4ff6-b205-484eadd57c79"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:41.689186 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Transition to ACTIVE for port object 0494c075-f120-4ff6-b205-484eadd57c79 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:45:41.728562 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5540b8d8-e8ed-4d2d-ab31-fa3f8786da24 x-openstack-request-id: req-5540b8d8-e8ed-4d2d-ab31-fa3f8786da24 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:41.728866 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-unplugged", "status": "completed", "tag": "0494c075-f120-4ff6-b205-484eadd57c79", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:41.729130 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5540b8d8-e8ed-4d2d-ab31-fa3f8786da24 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:41.729540 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79', 'code': 200} Dec 21 04:45:41.755025 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:41.816374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:41.818433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] No DVR routers for this DVR port 0494c075-f120-4ff6-b205-484eadd57c79 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:45:41.827971 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.828329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.828680 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.829028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.829367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.829702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.830033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.830363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.830699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.831050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.831384 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.831711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.832065 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:41.868396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:45:41.869280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:45:41.869612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:45:41.873826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Port 0494c075-f120-4ff6-b205-484eadd57c79 on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:45:41.874151 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Attempting to bind port 0494c075-f120-4ff6-b205-484eadd57c79 on network 1e70133e-472c-4d88-b3fb-89d0a5bb03ba {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:45:41.878997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 45, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:45:41.879342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Checking segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:45:41.879731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Bound using segment: {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:45:41.880157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Bound port: 0494c075-f120-4ff6-b205-484eadd57c79, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00c1d574-0a76-4fdf-b133-37af2dcc6cce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:45:41.880506 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:41.941648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:45:41.944600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:45:42.007198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:42.042822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:42.043571 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:42.044950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] 10.222.0.31 "PUT /v2.0/ports/0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 1092 time: 0.7056127 Dec 21 04:45:42.062871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10666718-587e-453f-a28c-11f3ee549f2a service neutron] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:42.126576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-2fb5ca30-44d9-442c-8c0d-8649e284aa1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:42.128130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-2fb5ca30-44d9-442c-8c0d-8649e284aa1f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1095 time: 0.0418231 Dec 21 04:45:42.224954 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-76de56bf-45fe-46e9-8cdf-bfb0a9f1404d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:42.227243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-76de56bf-45fe-46e9-8cdf-bfb0a9f1404d service neutron] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0872273 Dec 21 04:45:42.269183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-9cec8516-8706-4ceb-bbb9-7f0c429f27e5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0339844 Dec 21 04:45:42.354252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-7a80d409-b466-4614-af07-fdde9571cd33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:42.355743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-7a80d409-b466-4614-af07-fdde9571cd33 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0748804 Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:42.369693 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:42.373148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104805f3-bbe7-4857-865e-221ade43fd9c req-b08dcaef-046f-44fe-9018-c9678a6991ff tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:42.373263 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-104805f3-bbe7-4857-865e-221ade43fd9c req-b08dcaef-046f-44fe-9018-c9678a6991ff tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 943 time: 0.0565507 Dec 21 04:45:42.411777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-53b361c2-3521-47cd-9a60-c2e590aa2b68 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0375936 Dec 21 04:45:42.464792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-104805f3-bbe7-4857-865e-221ade43fd9c req-566275f6-9659-4281-938a-e48d8c7b2269 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835421 Dec 21 04:45:42.525344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-4f0c5e2a-fe76-471e-8624-6746a21a2fcf service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978863 Dec 21 04:45:42.617554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-386e4ba9-9499-4268-b420-162c209d7ff9 req-542bd5e4-c783-4a44-ab4e-5b03db24034e service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815563 Dec 21 04:45:43.583724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6a7f6e-2db9-4345-84c3-1c0f4645d158 req-26921362-7a4c-4d80-92f4-5cb7d6ae7720 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:43.585472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c6a7f6e-2db9-4345-84c3-1c0f4645d158 req-26921362-7a4c-4d80-92f4-5cb7d6ae7720 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 943 time: 0.0524378 Dec 21 04:45:43.632151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c6a7f6e-2db9-4345-84c3-1c0f4645d158 req-99dc6474-da13-4a4c-b414-b2ad7b283ae2 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400972 Dec 21 04:45:43.730956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:43.733368 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1" -d '{"events": [{"name": "network-changed", "server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "tag": "0494c075-f120-4ff6-b205-484eadd57c79"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:43.783011 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ff12ab3-cf36-425b-9f6e-26b859d4e0c3 x-openstack-request-id: req-7ff12ab3-cf36-425b-9f6e-26b859d4e0c3 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:43.783310 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "tag": "0494c075-f120-4ff6-b205-484eadd57c79", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:43.783567 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7ff12ab3-cf36-425b-9f6e-26b859d4e0c3 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:43.783972 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79', 'status': 'completed', 'code': 200} Dec 21 04:45:43.863600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-c8415830-23c4-480f-996b-e213b74f8ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:43.865113 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-c8415830-23c4-480f-996b-e213b74f8ef8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1095 time: 0.0414855 Dec 21 04:45:43.876999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-681aa8bc-40f9-4a87-b0c0-c64ab887d0e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:43.878511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-681aa8bc-40f9-4a87-b0c0-c64ab887d0e3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1095 time: 0.0409822 Dec 21 04:45:43.958784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-064a73dd-ef47-4f4c-ba24-3e431ebcfe3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:43.968276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-064a73dd-ef47-4f4c-ba24-3e431ebcfe3c service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0877137 Dec 21 04:45:43.971765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-a82e9f43-564a-4e62-894b-73aec1b95783 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:43.973258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-a82e9f43-564a-4e62-894b-73aec1b95783 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0869429 Dec 21 04:45:44.001687 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-b7235f36-eb75-46b4-9ea1-4cc2db50ac2e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0339277 Dec 21 04:45:44.015890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-dc6b42d4-9e13-4174-a673-6df29180f52d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0346420 Dec 21 04:45:44.053075 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-1dfcf9aa-f684-4888-9c06-13425f80aed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:44.054578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-1dfcf9aa-f684-4888-9c06-13425f80aed0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0466881 Dec 21 04:45:44.082173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-b32cf59e-6d48-4e23-94df-b80a74ae88d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:44.083690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-b32cf59e-6d48-4e23-94df-b80a74ae88d9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0567281 Dec 21 04:45:44.090966 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-2234a569-5856-4ce1-817b-16ed34e030e5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0288031 Dec 21 04:45:44.115711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-e7611dee-81da-4beb-9efd-ad971671465f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241518 Dec 21 04:45:44.179094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-dfe813c5-7e59-4d55-a16a-22b74e76be1c service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806596 Dec 21 04:45:44.209881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-15717de1-5540-4297-a930-c8ae5909a3c0 service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857909 Dec 21 04:45:44.271950 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-ea6a0be3-ac46-48f1-a96d-f5df643b08f6 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850425 Dec 21 04:45:44.304705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d81a1c2-d99e-4fb4-a7e1-f3ccb2e37ba1 req-01277128-3eac-4921-a7ba-18a836ab7d2b service neutron] 10.222.0.31 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858858 Dec 21 04:45:44.335279 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:45:44.374795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 0494c075-f120-4ff6-b205-484eadd57c79 host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:45:44.375286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:45:44.749898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44545c43-97f2-4df9-9827-38222743e963 req-caa605b5-ff4d-4a0a-bf8d-7017881ca8f7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:44.751473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44545c43-97f2-4df9-9827-38222743e963 req-caa605b5-ff4d-4a0a-bf8d-7017881ca8f7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 943 time: 0.0493114 Dec 21 04:45:44.800548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44545c43-97f2-4df9-9827-38222743e963 req-c9978589-e6ae-43c0-8a1d-99689605b256 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419190 Dec 21 04:45:44.995492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:45:45.086840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:45.097528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '0494c075-f120-4ff6-b205-484eadd57c79', 'network_id': '1e70133e-472c-4d88-b3fb-89d0a5bb03ba', 'port_id': '0494c075-f120-4ff6-b205-484eadd57c79', 'mac_address': 'fa:16:3e:a8:82:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 130, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a405c87-34b7-4932-9aba-98b9f8052558', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:45:45.133593 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:45.146216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0494c075-f120-4ff6-b205-484eadd57c79 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:45:45.165062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:45.232737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:45.283299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:45.536986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['0494c075-f120-4ff6-b205-484eadd57c79'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:45:45.916257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa0f937-25cc-4111-9479-043d9f1f87f1 req-d97470e5-79da-4767-81c4-9a6ea8afae08 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:45.917768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aa0f937-25cc-4111-9479-043d9f1f87f1 req-d97470e5-79da-4767-81c4-9a6ea8afae08 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 944 time: 0.0479672 Dec 21 04:45:45.964415 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6aa0f937-25cc-4111-9479-043d9f1f87f1 req-e5dcdbb2-7808-4691-9c4f-662dd9bf229b tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407457 Dec 21 04:45:46.275601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8b6e6d-b5ba-46dc-8464-8140f1c85960 req-29ebef48-0578-4d3b-b8cf-12ebf7b93dc0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:46.277057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c8b6e6d-b5ba-46dc-8464-8140f1c85960 req-29ebef48-0578-4d3b-b8cf-12ebf7b93dc0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 944 time: 0.0524449 Dec 21 04:45:46.326600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c8b6e6d-b5ba-46dc-8464-8140f1c85960 req-167db05d-ac25-4f17-8a8a-689dbe788df6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435059 Dec 21 04:45:46.377942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-6abecd18-852e-4391-b420-9d96159f24dd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:46.379408 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-6abecd18-852e-4391-b420-9d96159f24dd tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.54 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1&tenant_id=f7b615eafc65424db7a815a0a38d03dd&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 944 time: 0.0560038 Dec 21 04:45:46.438894 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-cb26aecc-12f1-46c5-83a5-0f0690fd2c13 service neutron] delete failed (client error): The resource could not be found. Dec 21 04:45:46.439832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-cb26aecc-12f1-46c5-83a5-0f0690fd2c13 service neutron] 10.222.0.54 "DELETE /v2.0/ports/0494c075-f120-4ff6-b205-484eadd57c79/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0532126 Dec 21 04:45:46.542535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-54caeaed-62a8-467a-9d55-afbbbf891462 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:46.544069 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-54caeaed-62a8-467a-9d55-afbbbf891462 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=f7b615eafc65424db7a815a0a38d03dd&device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 1096 time: 0.0411558 Dec 21 04:45:46.641976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-dc0ef498-6e48-4db1-9a1d-e0afd5b541ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:46.643554 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-dc0ef498-6e48-4db1-9a1d-e0afd5b541ba service neutron] 10.222.0.54 "GET /v2.0/networks?id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 200 len: 916 time: 0.0919492 Dec 21 04:45:46.684815 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-3a058aef-6c62-4db6-931d-ce194874f1f8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 200 len: 217 time: 0.0346615 Dec 21 04:45:46.737306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-be1c92a9-4178-417b-80f2-79bc54b229ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:46.738631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-be1c92a9-4178-417b-80f2-79bc54b229ab service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 200 len: 855 time: 0.0471923 Dec 21 04:45:46.768703 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-eac80297-a2af-4507-aad2-9ee5e94230b4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=1e70133e-472c-4d88-b3fb-89d0a5bb03ba&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235078 Dec 21 04:45:46.860155 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-a9596305-e34c-4c70-bb68-fe45db1df6e8 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838022 Dec 21 04:45:46.952332 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-dd674e66-3157-442b-b0a4-8c7bc1a44f13 req-2cddaf36-00c1-4eb6-a125-7230b8a277f5 service neutron] 10.222.0.54 "GET /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856535 Dec 21 04:45:47.002736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:45:47.124083 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 0494c075-f120-4ff6-b205-484eadd57c79 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:45:47.128154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 0494c075-f120-4ff6-b205-484eadd57c79 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:47.128534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:47.203183 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:47.224826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:47.227104 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be1aeaaa-e826-4512-b6fb-eabc3642cdd4" -d '{"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-plugged", "status": "completed", "tag": "0494c075-f120-4ff6-b205-484eadd57c79"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:47.239369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:47.278624 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de9bfef4-fdfc-4922-a8bc-b0495aa3f0b1 x-openstack-request-id: req-de9bfef4-fdfc-4922-a8bc-b0495aa3f0b1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:47.278914 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-plugged", "status": "completed", "tag": "0494c075-f120-4ff6-b205-484eadd57c79", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:47.282384 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-de9bfef4-fdfc-4922-a8bc-b0495aa3f0b1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:47.282384 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79', 'code': 200} Dec 21 04:45:47.301375 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:47.350965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:47.445541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b080d90-7c02-42ec-aade-4baf088726b5 req-91cf1e3a-23bf-46a6-a3b6-f18a5a5b1000 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:47.447139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b080d90-7c02-42ec-aade-4baf088726b5 req-91cf1e3a-23bf-46a6-a3b6-f18a5a5b1000 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0495796 Dec 21 04:45:47.495631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2b080d90-7c02-42ec-aade-4baf088726b5 req-c54b27b8-eb1a-4eca-be3f-12be208d31c3 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424211 Dec 21 04:45:48.613569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23476108-ad24-46f8-a600-14866403236e req-ba6e6f04-e707-417a-b83a-d86d25dbf23e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:48.615079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23476108-ad24-46f8-a600-14866403236e req-ba6e6f04-e707-417a-b83a-d86d25dbf23e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0514364 Dec 21 04:45:48.662154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23476108-ad24-46f8-a600-14866403236e req-3bf2f35c-3f9a-42e4-b6ea-4f3bc3bfb229 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406551 Dec 21 04:45:48.774372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0368fb35-5713-492c-b1b7-5e2e8a7948a7 req-3725945f-daa6-4a20-9f50-f10482612a3c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:48.775777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0368fb35-5713-492c-b1b7-5e2e8a7948a7 req-3725945f-daa6-4a20-9f50-f10482612a3c tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0480304 Dec 21 04:45:48.820997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0368fb35-5713-492c-b1b7-5e2e8a7948a7 req-64beac5b-b568-4d9a-99fb-32382e61677e tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393107 Dec 21 04:45:48.938578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc6f26c-bc24-4903-82f5-b21717f8ea01 req-5a278a11-fbe4-494e-ac3e-6df3c9ffc1d9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:48.940080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbc6f26c-bc24-4903-82f5-b21717f8ea01 req-5a278a11-fbe4-494e-ac3e-6df3c9ffc1d9 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0479221 Dec 21 04:45:48.996003 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbc6f26c-bc24-4903-82f5-b21717f8ea01 req-6e43cb12-f6bb-4211-b97b-2fede9849c66 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500004 Dec 21 04:45:49.501990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91e75c7-5d1e-4890-b745-58a125776710 req-8a9c2579-46f2-499a-a35a-acb61bde67b6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:49.503476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e91e75c7-5d1e-4890-b745-58a125776710 req-8a9c2579-46f2-499a-a35a-acb61bde67b6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0481455 Dec 21 04:45:49.549441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e91e75c7-5d1e-4890-b745-58a125776710 req-bebb9381-2262-45a8-bc98-bf1fdca44df6 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400672 Dec 21 04:45:49.891905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-26d9b26b-fa77-4b39-85a7-214c77814bfb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:50.661751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08db3c6f-fddc-4e57-beb2-b70bafff09ea req-2176e320-aafb-4d88-b9aa-0627f41ed139 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:50.663221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08db3c6f-fddc-4e57-beb2-b70bafff09ea req-2176e320-aafb-4d88-b9aa-0627f41ed139 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0471325 Dec 21 04:45:50.709372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08db3c6f-fddc-4e57-beb2-b70bafff09ea req-c1516cfa-f058-4970-8220-aafdcfcfd609 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/security-groups?id=bbdff638-5597-4555-bba1-7c3c545b7525&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397778 Dec 21 04:45:51.205056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-31ad2ea2-17fe-4e90-97a7-b752d92072b7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:51.206507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-31ad2ea2-17fe-4e90-97a7-b752d92072b7 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.31 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 945 time: 0.0505116 Dec 21 04:45:51.297531 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Deleting port 0494c075-f120-4ff6-b205-484eadd57c79 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:45:51.297872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:51.387321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] For port 0494c075-f120-4ff6-b205-484eadd57c79, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=0494c075-f120-4ff6-b205-484eadd57c79,segment=NetworkSegment(00c1d574-0a76-4fdf-b133-37af2dcc6cce),segment_id=00c1d574-0a76-4fdf-b133-37af2dcc6cce)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:51.387677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:51.399160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Calling delete_port for 0494c075-f120-4ff6-b205-484eadd57c79 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:45:51.583605 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:51.615166 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Pushing event deleted for resources: {'Port': ['ID=0494c075-f120-4ff6-b205-484eadd57c79,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:51.633616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['0494c075-f120-4ff6-b205-484eadd57c79'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:45:51.655474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] No DVR routers for this DVR port 0494c075-f120-4ff6-b205-484eadd57c79 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:45:51.658116 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:51.661475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1187cb5a-d02e-4127-ae69-e0fdadb1b342 req-6fe10bd9-bc6e-4bc7-a9f8-b8f0c5097cd0 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.31 "DELETE /v2.0/ports/0494c075-f120-4ff6-b205-484eadd57c79 HTTP/1.1" status: 204 len: 173 time: 0.4446430 Dec 21 04:45:51.661909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-deleted', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:45:51.664129 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be79748a-775f-4059-adad-99bffb7c05c1" -d '{"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-deleted", "tag": "0494c075-f120-4ff6-b205-484eadd57c79"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:45:51.703672 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:45:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5196038-e997-4759-a01b-5cefeb6540c4 x-openstack-request-id: req-c5196038-e997-4759-a01b-5cefeb6540c4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:45:51.704050 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d727675-9b53-48f2-a75a-342ceeb7c6e1", "name": "network-vif-deleted", "tag": "0494c075-f120-4ff6-b205-484eadd57c79", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:45:51.704314 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c5196038-e997-4759-a01b-5cefeb6540c4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:45:51.704723 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d727675-9b53-48f2-a75a-342ceeb7c6e1', 'name': 'network-vif-deleted', 'tag': '0494c075-f120-4ff6-b205-484eadd57c79', 'status': 'completed', 'code': 200} Dec 21 04:45:51.804242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90f1ded8-e8c9-4d22-a675-5b49486235a4 req-7db230a4-8256-43b0-bc58-817fbef5adf1 tempest-ServerDiskConfigTestJSON-2118609504 tempest-ServerDiskConfigTestJSON-2118609504-project] 10.222.0.18 "GET /v2.0/ports?device_id=6d727675-9b53-48f2-a75a-342ceeb7c6e1 HTTP/1.1" status: 200 len: 210 time: 0.0258133 Dec 21 04:45:52.669259 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41d5b7c5-ef59-4235-9bc6-22bbbf5c5ff7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:52.925540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48502) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:52.969093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Deleting subnet 4a405c87-34b7-4932-9aba-98b9f8052558 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:45:52.972112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.009453 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.046962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.175995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.202134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4a405c87-34b7-4932-9aba-98b9f8052558,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:53.204172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.207353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-22d6f1c2-d520-4a74-b242-2886987332e3 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/4a405c87-34b7-4932-9aba-98b9f8052558 HTTP/1.1" status: 204 len: 168 time: 0.2807305 Dec 21 04:45:53.210083 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48504) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:53.286723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.318901 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.363297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.382339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1e70133e-472c-4d88-b3fb-89d0a5bb03ba']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:45:53.391986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00c1d574-0a76-4fdf-b133-37af2dcc6cce') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:45:53.392292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00c1d574-0a76-4fdf-b133-37af2dcc6cce') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:45:53.406558 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.419369 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.425155 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Releasing vlan 130 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:45:53.425528 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:45:53.432503 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:45:53.469500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.549426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.554764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:53.558558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] 10.222.0.18 "DELETE /v2.0/networks/1e70133e-472c-4d88-b3fb-89d0a5bb03ba HTTP/1.1" status: 204 len: 168 time: 0.3475718 Dec 21 04:45:53.569076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02fb20fe-db3a-4f74-af52-e0394e41a72c admin admin] Pushing event deleted for resources: {'Network': ['ID=1e70133e-472c-4d88-b3fb-89d0a5bb03ba,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:53.895014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48508) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:53.933606 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b70806b3-ce97-4649-981f-5833dd264d4f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=f7b615eafc65424db7a815a0a38d03dd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0373986 Dec 21 04:45:53.936048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48510) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:53.981737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20955086-fdc3-40e5-9e6d-71bc2298d67a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:54.006581 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20955086-fdc3-40e5-9e6d-71bc2298d67a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:54.124255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20955086-fdc3-40e5-9e6d-71bc2298d67a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:54.126863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20955086-fdc3-40e5-9e6d-71bc2298d67a admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:54.128062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-20955086-fdc3-40e5-9e6d-71bc2298d67a admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bbdff638-5597-4555-bba1-7c3c545b7525 HTTP/1.1" status: 204 len: 168 time: 0.1911478 Dec 21 04:45:54.136290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20955086-fdc3-40e5-9e6d-71bc2298d67a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbdff638-5597-4555-bba1-7c3c545b7525,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:55.065950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48532) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:55.066581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:45:55.085986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 0494c075-f120-4ff6-b205-484eadd57c79 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:45:55.086330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 0494c075-f120-4ff6-b205-484eadd57c79 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:45:55.171241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-457471715-network', 'tenant_id': '684628052e674280965f258699338238'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:45:55.244851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.275091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Made reservation on behalf of 684628052e674280965f258699338238 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:45:55.277456 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.288768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.336073 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.362309 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.434899 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.462223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:45:55.468355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a140649-b938-4ffc-8673-ac8176d2c242,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:55.474383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.474735 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Added segment 81f5185c-a794-4d79-83a8-8df408b86384 of type vlan for network fc0ae40f-7660-4c02-8692-f49eb5531fe8 Dec 21 04:45:55.514497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.598685 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.599667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:55.600243 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.660551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] Pushing event updated for resources: {'Network': ['ID=fc0ae40f-7660-4c02-8692-f49eb5531fe8,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:55.670629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:45:55.704532 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-52d2f3c1-961f-467b-ae8b-d298e50f037d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6373718 Dec 21 04:45:55.707267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48536) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:55.712182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Request body: {'subnet': {'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-457471715-subnet', 'tenant_id': '684628052e674280965f258699338238', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:45:55.806598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Made reservation on behalf of 684628052e674280965f258699338238 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:45:55.809564 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:55.833203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.029388 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.094011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Pushing event updated for resources: {'Subnet': ['ID=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:56.105812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:45:56.106286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Network hostable DHCP agents. Network: fc0ae40f-7660-4c02-8692-f49eb5531fe8, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:45:56.183410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:45:56.251600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, fc0ae40f-7660-4c02-8692-f49eb5531fe8) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:45:56.255597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:45:56.256196 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.260969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6298526d-70f6-4397-9d8b-6dc463b05dbb None None] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:45:56.341706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0c752ba5-1193-4024-b130-67d1d2a2a6ed admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6326120 Dec 21 04:45:56.343832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48538) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:56.348053 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:45:56.360576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'project_id': '684628052e674280965f258699338238', 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:45:56.361538 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.462132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.463259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.490861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Allocated IP 172.20.0.2 (fc0ae40f-7660-4c02-8692-f49eb5531fe8/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5/ee962e15-6e89-48a1-a53f-396aa9cc086d) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:45:56.517850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.631284 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.703924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.745949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:45:56.749644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:45:56.753940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:45:56.766745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Pushing event updated for resources: {'Port': ['ID=ee962e15-6e89-48a1-a53f-396aa9cc086d,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:56.822000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Attempting to bind port ee962e15-6e89-48a1-a53f-396aa9cc086d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:45:56.822407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Attempting to bind port ee962e15-6e89-48a1-a53f-396aa9cc086d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:45:56.822767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Attempting to bind port ee962e15-6e89-48a1-a53f-396aa9cc086d on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:45:56.828255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:45:56.828632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:45:56.829031 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.829422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:45:56.829886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Bound port: ee962e15-6e89-48a1-a53f-396aa9cc086d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:45:56.830262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:56.897678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] For port ee962e15-6e89-48a1-a53f-396aa9cc086d, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:45:56.901353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] For port ee962e15-6e89-48a1-a53f-396aa9cc086d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ee962e15-6e89-48a1-a53f-396aa9cc086d,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:45:56.961233 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.021291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ad9080-ae6b-442a-b577-94588c575608 None None] Pushing event updated for resources: {'Port': ['ID=ee962e15-6e89-48a1-a53f-396aa9cc086d,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:57.073793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.340740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.359955 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.467991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Allocated IP 172.25.5.66 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/30aeec0a-1fc6-4a88-a74c-65103927c2b1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:45:57.566857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.670049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.715982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:45:57.720481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:45:57.724070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:45:57.734051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-169aee1d-1567-4f94-ad25-06928714c863 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:45:57.750379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Pushing event updated for resources: {'Port': ['ID=30aeec0a-1fc6-4a88-a74c-65103927c2b1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:57.853197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3b1264db-9e34-4ff3-918e-2678869e4989 None None] Provisioning complete for port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:57.853712 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3b1264db-9e34-4ff3-918e-2678869e4989 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:57.892844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3b1264db-9e34-4ff3-918e-2678869e4989 None None] Port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:45:57.944986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebf76364-9ff6-46ea-9182-7d1e897fe8a4 None None] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:45:58.023112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-50317620-d4c4-4103-a59a-e563031457b0 None None] Provisioning complete for port ee962e15-6e89-48a1-a53f-396aa9cc086d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:58.023393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50317620-d4c4-4103-a59a-e563031457b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.037011 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.129074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50317620-d4c4-4103-a59a-e563031457b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.162781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-50317620-d4c4-4103-a59a-e563031457b0 None None] For port ee962e15-6e89-48a1-a53f-396aa9cc086d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ee962e15-6e89-48a1-a53f-396aa9cc086d,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:45:58.240525 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.256199 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-50317620-d4c4-4103-a59a-e563031457b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.306218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50317620-d4c4-4103-a59a-e563031457b0 None None] Pushing event updated for resources: {'Port': ['ID=ee962e15-6e89-48a1-a53f-396aa9cc086d,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:58.377153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1d0657d6-78da-4c61-8ea4-a052bbcf8653 None None] Provisioning complete for port ee962e15-6e89-48a1-a53f-396aa9cc086d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:58.377527 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d0657d6-78da-4c61-8ea4-a052bbcf8653 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.427555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Router 9fadfb45-221e-4dae-8d11-274585fd6638 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:45:58.530803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:45:58.540174 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:45:58.549755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:45:58.550370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:45:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:45:58.602808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.607146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0008d285-3534-4cf4-ba0e-666816a13422 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.2598085 Dec 21 04:45:58.612520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48540) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:45:58.655354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:45:58.764814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ee962e15-6e89-48a1-a53f-396aa9cc086d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:45:58.861344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ee962e15-6e89-48a1-a53f-396aa9cc086d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:58.861625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:58.922434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:57Z', 'revision_number': 3, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:45:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:45:58.969003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:45:58.969003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Updating router 9fadfb45-221e-4dae-8d11-274585fd6638 port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:45:59.005160 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.040619 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.194903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Allocated IP 172.20.0.1 (fc0ae40f-7660-4c02-8692-f49eb5531fe8/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5/1ffa1487-395d-47a0-8d58-ee6681b0e531) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:45:59.247387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.294203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.320758 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.365004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a343a84-8708-4923-948e-9b5839f79c9c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:45:59.382444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Attempting to bind port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:45:59.382821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Attempting to bind port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:45:59.383281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Attempting to bind port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:45:59.386637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Pushing event updated for resources: {'Port': ['ID=30aeec0a-1fc6-4a88-a74c-65103927c2b1,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:59.395255 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.395932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:45:59.396315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:45:59.396717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.397111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:45:59.397583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Bound port: 30aeec0a-1fc6-4a88-a74c-65103927c2b1, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:45:59.397961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.401204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.401552 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.401893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.402229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.402564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.402896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.403249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.403577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.403909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.404237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.404559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.404879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.405203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:45:59.443896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:45:59.448935 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:45:59.451442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:45:59.477232 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Pushing event updated for resources: {'Port': ['ID=1ffa1487-395d-47a0-8d58-ee6681b0e531,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:59.502015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.626798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6d1b5ee5-41d9-43c9-aaa8-30c6fcb9be60 None None] Provisioning complete for port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:59.802988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6d1b5ee5-41d9-43c9-aaa8-30c6fcb9be60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.802988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] For port 30aeec0a-1fc6-4a88-a74c-65103927c2b1, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:45:59.802988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] For port 30aeec0a-1fc6-4a88-a74c-65103927c2b1, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30aeec0a-1fc6-4a88-a74c-65103927c2b1,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:45:59.802988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6d1b5ee5-41d9-43c9-aaa8-30c6fcb9be60 None None] Port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:45:59.802988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2824507f-01f9-4587-bf8c-8007bf7b8e09 None None] Provisioning complete for port 1ffa1487-395d-47a0-8d58-ee6681b0e531 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:59.802988 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2824507f-01f9-4587-bf8c-8007bf7b8e09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.831718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2824507f-01f9-4587-bf8c-8007bf7b8e09 None None] Port 1ffa1487-395d-47a0-8d58-ee6681b0e531 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:45:59.834445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.848330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:45:59.876030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-813884ca-f442-4508-add7-1f15fda3bc13 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:45:59.902198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:45:59.902832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:45:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:45:59.906613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a8e8d1d-3a9c-4dbc-80f8-bd95a90bd547 None None] Pushing event updated for resources: {'Port': ['ID=30aeec0a-1fc6-4a88-a74c-65103927c2b1,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:45:59.966061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bf363bbe-0814-4be6-a195-60467640b946 None None] Provisioning complete for port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:45:59.966433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bf363bbe-0814-4be6-a195-60467640b946 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.027216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.049457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:46:00.086588 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.154659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Pushing event updated for resources: {'Port': ['ID=1ffa1487-395d-47a0-8d58-ee6681b0e531,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:00.158316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.171364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bf363bbe-0814-4be6-a195-60467640b946 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.228307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bf363bbe-0814-4be6-a195-60467640b946 None None] For port 30aeec0a-1fc6-4a88-a74c-65103927c2b1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30aeec0a-1fc6-4a88-a74c-65103927c2b1,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:46:00.251855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:46:00.253443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:46:00.319414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 1, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:00.319414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bf363bbe-0814-4be6-a195-60467640b946 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.325512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e55feb9-6a01-4b9a-aa93-1ba754b125a0 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 1, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:46:00.381643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf363bbe-0814-4be6-a195-60467640b946 None None] Pushing event updated for resources: {'Port': ['ID=30aeec0a-1fc6-4a88-a74c-65103927c2b1,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:00.390712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:46:00.513718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:46:00.521304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-172ed445-b1c8-4d04-8f4e-b455ab8b1dad admin admin] 10.222.0.18 "PUT /v2.0/routers/9fadfb45-221e-4dae-8d11-274585fd6638/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9128432 Dec 21 04:46:00.522269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-79cf9ebc-34c5-454f-8977-82e35304deae None None] Provisioning complete for port 1ffa1487-395d-47a0-8d58-ee6681b0e531 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:00.522779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-79cf9ebc-34c5-454f-8977-82e35304deae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:00.564255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-79cf9ebc-34c5-454f-8977-82e35304deae None None] Port 1ffa1487-395d-47a0-8d58-ee6681b0e531 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:46:00.876681 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:46:01.112896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48548) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:46:01.117594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'security_group': {'name': 'tempest-securitygroup--386554186', 'description': 'tempest-description--1804550192'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:01.210437 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.280576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.357095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.388716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f316a23c-9c52-424d-a1e8-aa67bc3eba50,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:01.442842 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.445413 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f0d66487-2f7e-4f10-8579-a91ed72e7023 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.3303690 Dec 21 04:46:01.447334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48550) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:46:01.452021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'security_group_rule': {'security_group_id': 'f316a23c-9c52-424d-a1e8-aa67bc3eba50', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:01.556741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.633817 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.701549 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.720075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f65a8468-a99d-429b-9aa3-f32e6baf3248,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:01.785333 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.786553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3cd26542-3c91-48e7-874c-43f829bbfa73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3381639 Dec 21 04:46:01.789150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48552) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:46:01.794252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'security_group_rule': {'security_group_id': 'f316a23c-9c52-424d-a1e8-aa67bc3eba50', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:01.896900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:01.957785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.023749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.042408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3eeba408-b9c3-48be-b300-45656d197771,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:02.121347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.122605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4a1119b1-2898-4f4e-83c3-d7c0caf7034a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3325195 Dec 21 04:46:02.125639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48554) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:46:02.130116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:02.211945 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.310152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.321217 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:46:02.331739 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:46:02.336685 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:45:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:02.415111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Allocated IP 172.25.5.55 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/6c639e34-d366-48a6-be55-624f325a0219) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:46:02.437392 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:46:02.514491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.583865 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.629229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:46:02.632143 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:46:02.635723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:46:02.644290 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 2, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:02.657830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'Port': ['ID=6c639e34-d366-48a6-be55-624f325a0219,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:02.671464 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:46:02.672425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Updating router 9fadfb45-221e-4dae-8d11-274585fd6638 port 1ffa1487-395d-47a0-8d58-ee6681b0e531 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:46:02.697662 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.733710 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.758247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30aeec0a-1fc6-4a88-a74c-65103927c2b1 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:46:02.813273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:02.813735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.831041 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:02.996247 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.005695 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.086539 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.113241 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.137755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Pushing event updated for resources: {'Port': ['ID=1ffa1487-395d-47a0-8d58-ee6681b0e531,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:03.161959 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.162311 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.162685 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.163007 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.163352 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.163693 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.164017 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.164350 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.164668 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.164996 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.165321 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.165649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.166005 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:46:03.208177 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Attempting to bind port 1ffa1487-395d-47a0-8d58-ee6681b0e531 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:46:03.209340 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Attempting to bind port 1ffa1487-395d-47a0-8d58-ee6681b0e531 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:46:03.210246 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Attempting to bind port 1ffa1487-395d-47a0-8d58-ee6681b0e531 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:46:03.218766 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:46:03.219661 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:46:03.220181 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.220690 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:46:03.221279 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Bound port: 1ffa1487-395d-47a0-8d58-ee6681b0e531, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:46:03.221767 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.300661 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] For port 1ffa1487-395d-47a0-8d58-ee6681b0e531, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:46:03.303999 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] For port 1ffa1487-395d-47a0-8d58-ee6681b0e531, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ffa1487-395d-47a0-8d58-ee6681b0e531,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:46:03.355545 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.412665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0c1a04bf-b5e9-4a72-b637-6a6f4cf35167 None None] Provisioning complete for port 1ffa1487-395d-47a0-8d58-ee6681b0e531 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:03.413047 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c1a04bf-b5e9-4a72-b637-6a6f4cf35167 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.421918 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:46:03.422715 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:45:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:03.465428 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3293bee7-3a66-446d-b12f-21f0cf33409e None None] Pushing event updated for resources: {'Port': ['ID=1ffa1487-395d-47a0-8d58-ee6681b0e531,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:03.549879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c1a04bf-b5e9-4a72-b637-6a6f4cf35167 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.584032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:46:03.586788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0c1a04bf-b5e9-4a72-b637-6a6f4cf35167 None None] For port 1ffa1487-395d-47a0-8d58-ee6681b0e531, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ffa1487-395d-47a0-8d58-ee6681b0e531,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:46:03.603755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.607624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'Port': ['ID=6c639e34-d366-48a6-be55-624f325a0219,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:03.673416 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0c1a04bf-b5e9-4a72-b637-6a6f4cf35167 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.703546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.713835 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-20034b55-eca9-45ed-87c0-f5d79358102e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.5870802 Dec 21 04:46:03.751034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c1a04bf-b5e9-4a72-b637-6a6f4cf35167 None None] Pushing event updated for resources: {'Port': ['ID=1ffa1487-395d-47a0-8d58-ee6681b0e531,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:03.800372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-02cecef2-6993-41d7-b2fe-fb5d65f99589 None None] Provisioning complete for port 1ffa1487-395d-47a0-8d58-ee6681b0e531 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:03.801802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-02cecef2-6993-41d7-b2fe-fb5d65f99589 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:03.803719 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:03.840552 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-988e9543-c58b-4be9-8b3d-5c26815a6f9b None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:46:03.916504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-52dbce34-4244-4dfb-8231-9e0e9cde857c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--386554186&fields=id&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 267 time: 0.0613589 Dec 21 04:46:04.032073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-05263c60-2cc0-4702-81df-bd626abdca95 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:04.035392 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-05263c60-2cc0-4702-81df-bd626abdca95 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.1119492 Dec 21 04:46:04.050545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-66afa25e-a04a-4aff-ab6e-058fdc8a0262 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/quotas/684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 375 time: 0.0103714 Dec 21 04:46:04.112916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-6e02bf9b-02b8-433d-a58f-d1f9a0df48aa tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0561543 Dec 21 04:46:04.215143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-08b4d29b-1eeb-4b31-835b-9a12731f34ee service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893619 Dec 21 04:46:04.314210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-a7af7b50-aaa7-4e6b-8af5-9e09a66d3e23 service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922534 Dec 21 04:46:04.578186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e75a9b4b-b719-4e10-ae27-f210cc4a08af req-2aa4c3e4-a43a-418f-a0e5-53d46c5d8ceb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 210 time: 0.0271144 Dec 21 04:46:04.722722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ffa1487-395d-47a0-8d58-ee6681b0e531 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:46:04.774237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1ffa1487-395d-47a0-8d58-ee6681b0e531 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:04.774606 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:05.673067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c920ac0-7b2f-4265-b0ad-af6ba9fe67bd req-6c24d211-47f7-4562-b2a2-d7439091b4cc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 210 time: 0.0265567 Dec 21 04:46:06.692457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-727df67e-54fd-4fe3-b8a7-e1bd3aa2fd3a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:06.693924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-727df67e-54fd-4fe3-b8a7-e1bd3aa2fd3a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.1066687 Dec 21 04:46:06.777008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d6d91b9-ae9f-4080-888c-977d1c7b4a97 req-2511abd8-e282-4d05-ad07-fb825a147265 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 210 time: 0.0313385 Dec 21 04:46:06.796034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8a0e8831-77c6-464e-bd6b-533fa2fa8a7a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 379 time: 0.0763474 Dec 21 04:46:06.808793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'port': {'device_id': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'admin_state_up': True, 'tenant_id': '684628052e674280965f258699338238', 'security_groups': ['f316a23c-9c52-424d-a1e8-aa67bc3eba50']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:07.006013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Made reservation on behalf of 684628052e674280965f258699338238 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:46:07.010045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.130821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Allocated IP 172.20.0.11 (fc0ae40f-7660-4c02-8692-f49eb5531fe8/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5/040f8fb8-8233-4f3f-800a-ad6eeea6c4ec) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:46:07.266314 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.355403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.397758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:46:07.400807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:46:07.404259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:46:07.433996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:07.462965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:07.463570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.535107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-8ac4b8b2-7069-459e-b94f-fe8e7d6bf991 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7297833 Dec 21 04:46:07.562854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Request body: {'port': {'device_id': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:07.616048 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.637594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a2113430-6699-4601-abae-810623fd7fba None None] Provisioning complete for port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:07.638176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2113430-6699-4601-abae-810623fd7fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.674077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a2113430-6699-4601-abae-810623fd7fba None None] Port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:46:07.901828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:46:07.911072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:07.927870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Transition to ACTIVE for port object 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:46:07.936607 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0036a699-3e73-427e-a2a6-443940ab7cb4 req-c603b146-c1ff-4fec-981e-3a8075857b40 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:07.938291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0036a699-3e73-427e-a2a6-443940ab7cb4 req-c603b146-c1ff-4fec-981e-3a8075857b40 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 932 time: 0.0939395 Dec 21 04:46:07.985510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0036a699-3e73-427e-a2a6-443940ab7cb4 req-ec9ce01b-aced-4e15-afb9-d60e36cc7d55 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410764 Dec 21 04:46:07.995421 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:08.044694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:08.120215 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:46:08.120555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:46:08.120891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:46:08.125458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:46:08.125782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:46:08.130817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 45, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:46:08.131189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:46:08.131576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:46:08.132004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Bound port: 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:46:08.132357 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:08.196664 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:46:08.199804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:46:08.274681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:08.311579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.312208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:08.313617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] 10.222.0.31 "PUT /v2.0/ports/040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 1093 time: 0.7552412 Dec 21 04:46:08.314056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:46:08.316354 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31" -d '{"events": [{"name": "network-changed", "server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:46:08.340327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-531defdf-3594-4a12-a25d-fcbe4f0f25a8 service neutron] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:08.357494 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:46:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-48724b32-dc46-4964-adcd-80034fec205c x-openstack-request-id: req-48724b32-dc46-4964-adcd-80034fec205c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:46:08.357820 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:46:08.358145 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-48724b32-dc46-4964-adcd-80034fec205c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:46:08.358568 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'status': 'completed', 'code': 200} Dec 21 04:46:08.445325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31 req-7560d776-d92a-4264-bafb-4442f5f3fd1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.446843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31 req-7560d776-d92a-4264-bafb-4442f5f3fd1b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1096 time: 0.0427971 Dec 21 04:46:08.563887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31 req-a779144c-99b9-43ee-9481-e3db2646dd63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.565382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31 req-a779144c-99b9-43ee-9481-e3db2646dd63 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=684628052e674280965f258699338238&shared=False HTTP/1.1" status: 200 len: 912 time: 0.0956383 Dec 21 04:46:08.666794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31 req-6616f5a5-16fd-496e-a983-d3b981d60506 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.668327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ad9bd6f-5cd4-47e3-887a-5418d649cc31 req-6616f5a5-16fd-496e-a983-d3b981d60506 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0922291 Dec 21 04:46:08.780367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-5b72849b-7f7e-4d22-bb38-b4aa1f1add8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.781839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-5b72849b-7f7e-4d22-bb38-b4aa1f1add8b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1096 time: 0.0411866 Dec 21 04:46:08.836149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-f76d38ac-c1e9-43ac-8a99-1dbf116160ce service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 217 time: 0.0344238 Dec 21 04:46:08.887631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-dbf5ca7a-cdf8-4443-b222-906219974e32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.888932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-dbf5ca7a-cdf8-4443-b222-906219974e32 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0424383 Dec 21 04:46:08.943532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-7daae6b1-5fc2-42a5-b152-7c8bfbd070a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:08.945008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-7daae6b1-5fc2-42a5-b152-7c8bfbd070a5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0447428 Dec 21 04:46:09.039412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-147c2adb-f3fa-4ea8-b674-ba0b3a80860f service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832181 Dec 21 04:46:09.174292 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae85a99-0dd1-47a2-96b0-150f2317a9d9 req-690740ed-10e9-4c1e-99b1-60fbe54ed24e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:09.175828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae85a99-0dd1-47a2-96b0-150f2317a9d9 req-690740ed-10e9-4c1e-99b1-60fbe54ed24e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 944 time: 0.1167314 Dec 21 04:46:09.181222 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cc374f9-6ca8-4ed1-a8c4-de35fc83423e req-4e745a6a-85e7-4ee2-8ba7-623ade9f43e4 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306002 Dec 21 04:46:09.223824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ae85a99-0dd1-47a2-96b0-150f2317a9d9 req-c04730b6-a3ac-4779-b176-9b3b936d8633 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409877 Dec 21 04:46:10.341624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25e9ffe-653c-40f6-b4d7-d72ce577e1a3 req-9f1e1a45-ddb7-46d9-8094-da279a5e8be4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:10.343121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d25e9ffe-653c-40f6-b4d7-d72ce577e1a3 req-9f1e1a45-ddb7-46d9-8094-da279a5e8be4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 944 time: 0.0520716 Dec 21 04:46:10.388892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d25e9ffe-653c-40f6-b4d7-d72ce577e1a3 req-081017a0-9a6a-4e0e-b139-bf4feaa26401 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397682 Dec 21 04:46:11.127808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:46:11.235878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:46:11.250059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'mac_address': 'fa:16:3e:f0:d2:1b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:46:11.286329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:11.299336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:46:11.318404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:46:11.411960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:11.458226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:11.503956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0bbb45-d4e6-4bbb-bf0d-279a672047a1 req-94fc25ba-9aef-47ea-9ec2-93acec334984 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:11.505411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a0bbb45-d4e6-4bbb-bf0d-279a672047a1 req-94fc25ba-9aef-47ea-9ec2-93acec334984 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 945 time: 0.0492146 Dec 21 04:46:11.575643 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a0bbb45-d4e6-4bbb-bf0d-279a672047a1 req-8aaef508-4cdb-4e45-bc37-1e5fc1d251ee tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0636389 Dec 21 04:46:11.751244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:46:12.693404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a8f01c-fd74-49f2-855b-7ce84d1b6267 req-7b1697b0-8f64-4bda-a193-df15d4257c06 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:12.694880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93a8f01c-fd74-49f2-855b-7ce84d1b6267 req-7b1697b0-8f64-4bda-a193-df15d4257c06 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 945 time: 0.0474410 Dec 21 04:46:12.745129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-93a8f01c-fd74-49f2-855b-7ce84d1b6267 req-3b077e07-ca57-4ac1-afdc-9cbb4730caa1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436921 Dec 21 04:46:13.145229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:46:13.249817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:46:13.253406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:46:13.253775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:13.330002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:13.355203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:46:13.357482 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cac31b94-33a9-4e33-938c-e030dc217488" -d '{"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-plugged", "status": "completed", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:46:13.369539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:46:13.395622 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:46:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e875615a-b02c-4762-a24c-9b029540fea4 x-openstack-request-id: req-e875615a-b02c-4762-a24c-9b029540fea4 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:46:13.395863 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-plugged", "status": "completed", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:46:13.396122 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e875615a-b02c-4762-a24c-9b029540fea4 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:46:13.396519 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'code': 200} Dec 21 04:46:13.428577 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:13.481094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:46:13.541412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c80e8d-fcc9-40ff-b91a-1297bec931d9 req-b4b2acee-492a-4041-b72e-b67206ece2e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:13.542945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17c80e8d-fcc9-40ff-b91a-1297bec931d9 req-b4b2acee-492a-4041-b72e-b67206ece2e6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1098 time: 0.0403965 Dec 21 04:46:13.587299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-17c80e8d-fcc9-40ff-b91a-1297bec931d9 req-c413403d-e79e-4046-9049-0a68fa908b61 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0359898 Dec 21 04:46:13.857444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-376f2032-efb3-4124-9cb4-0106d2678b9c req-97fcc8d5-aa23-48e6-b01e-22312bced2f6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:13.858904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-376f2032-efb3-4124-9cb4-0106d2678b9c req-97fcc8d5-aa23-48e6-b01e-22312bced2f6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0483057 Dec 21 04:46:13.905623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-376f2032-efb3-4124-9cb4-0106d2678b9c req-6f60b4a3-cb83-430b-a096-006f631e5e1e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408015 Dec 21 04:46:15.025958 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a230315-327b-42e4-a16b-b8cc0373bccb req-700721d6-515a-47ce-8493-9a040443213c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:15.027487 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a230315-327b-42e4-a16b-b8cc0373bccb req-700721d6-515a-47ce-8493-9a040443213c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0524364 Dec 21 04:46:15.073604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a230315-327b-42e4-a16b-b8cc0373bccb req-555efa85-e578-483a-8112-0f5950cd1271 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401115 Dec 21 04:46:16.193867 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2fa76d6-b857-4602-a9e1-d760f2f7494f req-542008f0-2c37-4f29-8f54-dc02dafb9b5f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:16.195374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2fa76d6-b857-4602-a9e1-d760f2f7494f req-542008f0-2c37-4f29-8f54-dc02dafb9b5f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0533566 Dec 21 04:46:16.241549 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a2fa76d6-b857-4602-a9e1-d760f2f7494f req-98c030a4-6a2c-4b3b-8b80-bc30bda06ea4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401087 Dec 21 04:46:16.361478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-007735f8-f548-40e2-9e37-bfe811eebc98 req-7125739d-2c5d-46dc-b0e0-5618a6899adb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:16.362877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-007735f8-f548-40e2-9e37-bfe811eebc98 req-7125739d-2c5d-46dc-b0e0-5618a6899adb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0563467 Dec 21 04:46:16.371364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48608) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:46:16.375643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'floatingip': {'port_id': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:46:16.414286 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:16.843393 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:16.886178 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:16.987733 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 associated. External IP: 172.25.5.55, port: 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec. Dec 21 04:46:17.197983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:46:17.300016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:46:17.304742 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:17.310224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:46:17.320145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:46:17.320799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:45:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:17.335798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bad28508-561d-4183-abee-5d8c9bd43a18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "PUT /v2.0/floatingips/107ec780-6cdd-4fdc-886a-90ca42f9c9c0 HTTP/1.1" status: 200 len: 991 time: 0.9634101 Dec 21 04:46:17.336403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:46:17.341259 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-612f3d2c-c23a-4581-a20c-9a1830e9b533" -d '{"events": [{"name": "network-changed", "server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:46:17.382705 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:46:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7155585-5c4c-433e-a863-e2664510c385 x-openstack-request-id: req-f7155585-5c4c-433e-a863-e2664510c385 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:46:17.383037 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:46:17.383303 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f7155585-5c4c-433e-a863-e2664510c385 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:46:17.383716 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'status': 'completed', 'code': 200} Dec 21 04:46:17.437721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:46:17.479772 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-5f6bd888-4238-4423-bfd9-782321214f2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:17.481195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-5f6bd888-4238-4423-bfd9-782321214f2b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1098 time: 0.0413291 Dec 21 04:46:17.570220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-37c09a57-a362-4fbb-92c5-94e64e2dfb47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:17.571729 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-37c09a57-a362-4fbb-92c5-94e64e2dfb47 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0836191 Dec 21 04:46:17.642143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-a1b3d441-87b4-404a-8db6-4344ffa12830 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 999 time: 0.0634575 Dec 21 04:46:17.664493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:f0:d2:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:46:16Z', 'revision_number': 1, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:17.691022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-47bf597f-4618-4065-b78d-fd873770d5bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:17.691275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:46:17.692489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-47bf597f-4618-4065-b78d-fd873770d5bc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0433121 Dec 21 04:46:17.699613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:46:17.700218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:45:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:17.741540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-9308596e-7bcc-4195-86e8-b4d73578a0b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:17.742945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-9308596e-7bcc-4195-86e8-b4d73578a0b7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0434580 Dec 21 04:46:17.804962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:46:17.833886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-df6d0285-7a40-4e00-820c-58a9579cb4f7 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838671 Dec 21 04:46:17.927104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-612f3d2c-c23a-4581-a20c-9a1830e9b533 req-cdfdddd5-4195-4050-995a-87fb82db3a1a service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862849 Dec 21 04:46:18.023180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:f0:d2:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:46:16Z', 'revision_number': 1, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:46:18.049589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698780b9-31b0-43c9-b56f-245348daaae0 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:f0:d2:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:46:16Z', 'revision_number': 1, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:46:18.235911 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37be9f90-fbd6-46fd-a712-5774526954fc None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:46:19.918198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a7bbce79-cde0-4a32-af1e-92dc8da6d576 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:22.695814 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d1469bfc-71f6-489a-9d24-88fdc7fdf28a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:22.761577 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-70897619-171f-4409-aae3-5aa87564e5c9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0847082 Dec 21 04:46:22.881822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-ef095092-c4cd-46df-bf1a-ba80d9b72359 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:22.883238 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-ef095092-c4cd-46df-bf1a-ba80d9b72359 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1098 time: 0.0401411 Dec 21 04:46:22.987444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-39f88bbb-de30-45ee-ae1e-37f125c44eef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:22.988926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-39f88bbb-de30-45ee-ae1e-37f125c44eef service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0867944 Dec 21 04:46:23.054981 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-7ebc15ed-1e30-48cc-9840-73012f7c7efb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 1001 time: 0.0586555 Dec 21 04:46:23.102724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-729d833c-7e43-4ca4-95ad-6429cb2cab8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:23.104828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-729d833c-7e43-4ca4-95ad-6429cb2cab8f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0429456 Dec 21 04:46:23.152575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-8c671d52-7773-44dd-9502-e1962f2ebdeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:46:23.153982 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-8c671d52-7773-44dd-9502-e1962f2ebdeb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0421932 Dec 21 04:46:23.243396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-d43639f1-2aac-49ce-b362-de1911a786d9 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807054 Dec 21 04:46:23.307356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:23.446175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:23.674334 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf2fea4-a106-4d2d-ac10-44beb6fc2d1c req-7cdeedd2-065a-4f5d-98c7-7fb4f4672106 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4241512 Dec 21 04:46:25.222985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:25.312884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:25.821461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:37.875410 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:46:49.890891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4efbfb2e-f3aa-4b82-8faf-13db75dd0df5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:52.702012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f64405df-c80a-43e3-9cc1-877715ee1113 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:53.352213 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:53.472344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:55.246362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:55.286281 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:46:55.798241 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:14.873996 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:47:19.889449 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-45c36ada-a44e-4a34-ae0a-9403fed057f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:22.672916 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad811dfa-173a-461d-875a-e4425055b078 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:22.739471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-b6897c88-525c-443e-b812-c97a865d70c5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0393929 Dec 21 04:47:22.850793 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-6665f44c-04cf-4cc4-bea7-942281e6c04b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:47:22.852342 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-6665f44c-04cf-4cc4-bea7-942281e6c04b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1098 time: 0.0401051 Dec 21 04:47:22.959369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-5936f0d6-1206-43cf-957d-d64d1f3d9e9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:47:22.960825 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-5936f0d6-1206-43cf-957d-d64d1f3d9e9b service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0865033 Dec 21 04:47:23.025749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-5ea950cd-ec84-49a7-a53e-f789ad937c31 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 1001 time: 0.0572200 Dec 21 04:47:23.080729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-a9b620e6-cf1b-4be8-b401-3780ffa929a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:47:23.082168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-a9b620e6-cf1b-4be8-b401-3780ffa929a3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0463476 Dec 21 04:47:23.130681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-60e77cbb-f7a3-4876-bd9d-66c386da3834 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:47:23.132169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-60e77cbb-f7a3-4876-bd9d-66c386da3834 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383425 Dec 21 04:47:23.225059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-44421cf8-59bd-42a7-bd11-7e745451cc0b service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818875 Dec 21 04:47:23.323221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3dca4ae5-c45d-4e6b-a464-78913cd6e935 req-6aba7f54-0af4-4d9a-aa05-541491547b94 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872717 Dec 21 04:47:23.347703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:23.460791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:25.237461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:25.324576 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:25.776120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:49.901030 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9612b76b-5576-446f-bc92-cf12247d772e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:51.872263 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:47:52.683910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-caccc29e-4106-4b6e-8782-f4ee55ec11d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:53.363716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:53.472198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:55.252164 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:55.340232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:55.826973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:47:58.662312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bbcfd22-75cf-440a-a242-b28ce1332c9a req-f8ff614e-f793-4b79-a417-667109a19a09 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:47:58.664338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bbcfd22-75cf-440a-a242-b28ce1332c9a req-f8ff614e-f793-4b79-a417-667109a19a09 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.1083217 Dec 21 04:47:58.710472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4bbcfd22-75cf-440a-a242-b28ce1332c9a req-49df7e80-1899-43d9-85c0-f4909c0506d6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403328 Dec 21 04:47:59.072849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d27a0e9-2637-4113-9ba7-208c7df7da52 req-9e3cfd6b-33c9-4ed4-b513-34dda10218e0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:47:59.074354 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d27a0e9-2637-4113-9ba7-208c7df7da52 req-9e3cfd6b-33c9-4ed4-b513-34dda10218e0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0535240 Dec 21 04:47:59.121761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d27a0e9-2637-4113-9ba7-208c7df7da52 req-a8d68f5c-9bad-413e-938a-3856c920481b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413239 Dec 21 04:47:59.167034 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-15431dde-cf2f-4243-8b3a-d52066de097f service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0397923 Dec 21 04:48:00.293353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a48cd6e5-ee61-4396-9ae6-a3a09c8888fb req-e9e0fabf-e04d-4232-820f-efbd9845ffa5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:00.294988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a48cd6e5-ee61-4396-9ae6-a3a09c8888fb req-e9e0fabf-e04d-4232-820f-efbd9845ffa5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.1007679 Dec 21 04:48:00.347106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a48cd6e5-ee61-4396-9ae6-a3a09c8888fb req-1154953a-622f-4890-ba2f-0ebdbc534a13 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458403 Dec 21 04:48:01.244881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-a45c5802-b8e8-4638-8c94-1080c9b5bf77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:01.246377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-a45c5802-b8e8-4638-8c94-1080c9b5bf77 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1098 time: 0.0407543 Dec 21 04:48:01.338617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-18aefeea-9f50-42de-ab8f-cffed720774f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:01.340089 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-18aefeea-9f50-42de-ab8f-cffed720774f service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0857904 Dec 21 04:48:01.409947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-a6ed6dc0-23c2-40e5-96bf-f5dae183636e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 1001 time: 0.0585506 Dec 21 04:48:01.493804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-2df768ba-b71e-4554-b96a-7d804e4bbeac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:01.495463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-2df768ba-b71e-4554-b96a-7d804e4bbeac service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0705695 Dec 21 04:48:01.505942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f8dcc8-fccf-46b2-9c78-c0d1e4e896c2 req-0ffdadf4-ab18-45cb-8e11-4621a5546310 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:01.507327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28f8dcc8-fccf-46b2-9c78-c0d1e4e896c2 req-0ffdadf4-ab18-45cb-8e11-4621a5546310 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0907207 Dec 21 04:48:01.576424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-6799f105-c5de-41da-a39b-ab768e99b11f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:01.577932 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-6799f105-c5de-41da-a39b-ab768e99b11f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0697310 Dec 21 04:48:01.582344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-28f8dcc8-fccf-46b2-9c78-c0d1e4e896c2 req-43fb6445-67c9-448c-93b9-314f13caa7d1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0671828 Dec 21 04:48:01.675707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-e2876991-6a42-4f5c-b532-ff44c9e57c5d service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860083 Dec 21 04:48:01.769736 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-67ce7976-824f-4272-83c7-f015c2be0bc2 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825706 Dec 21 04:48:02.704149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dec82c6-86b0-4838-9dbe-c5d7625506bc req-8f7effad-5a8e-4146-8f9c-874bc2df83af tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:02.705635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dec82c6-86b0-4838-9dbe-c5d7625506bc req-8f7effad-5a8e-4146-8f9c-874bc2df83af tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0537345 Dec 21 04:48:02.753030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8dec82c6-86b0-4838-9dbe-c5d7625506bc req-f97e09b3-6f22-4541-88ec-b39747d63b79 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413229 Dec 21 04:48:03.876596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436a4a14-f345-4aab-8747-dc1676438256 req-cecb9f6b-1c30-4d17-b3be-361d8e8bff81 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:03.878127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-436a4a14-f345-4aab-8747-dc1676438256 req-cecb9f6b-1c30-4d17-b3be-361d8e8bff81 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0491529 Dec 21 04:48:03.924833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-436a4a14-f345-4aab-8747-dc1676438256 req-bc54d0fe-ee3d-4d1f-8a7b-c5487873f0a9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400770 Dec 21 04:48:05.048947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e468a0be-a57e-4dc2-89f4-a14066373f10 req-809aad40-e35f-4161-b9b3-174335869a39 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:05.050477 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e468a0be-a57e-4dc2-89f4-a14066373f10 req-809aad40-e35f-4161-b9b3-174335869a39 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0577433 Dec 21 04:48:05.100626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e468a0be-a57e-4dc2-89f4-a14066373f10 req-2db9c211-5649-4589-90a0-f7125d1d8c0e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441639 Dec 21 04:48:06.216978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1556445e-bf99-4e82-b513-0f8eaa040e54 req-d66cc1c0-5747-4b1c-a47c-8af7411be6d3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:06.218431 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1556445e-bf99-4e82-b513-0f8eaa040e54 req-d66cc1c0-5747-4b1c-a47c-8af7411be6d3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0477860 Dec 21 04:48:06.264765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1556445e-bf99-4e82-b513-0f8eaa040e54 req-e7d2aee9-bb6c-4cec-adbd-f999f8f00848 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404918 Dec 21 04:48:07.382858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdb2321-8986-431f-9b58-25038ea69e81 req-35dec192-aea3-4c61-a910-100253b29a24 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:07.390662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cdb2321-8986-431f-9b58-25038ea69e81 req-35dec192-aea3-4c61-a910-100253b29a24 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0506756 Dec 21 04:48:07.432064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cdb2321-8986-431f-9b58-25038ea69e81 req-42c51dea-de13-4e03-a72f-69e3a9e0580d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417581 Dec 21 04:48:08.548610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6731e610-011c-425a-8fde-1ea17743a10a req-725e6b11-f3ff-4a76-9203-ba4418aa9912 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:08.550060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6731e610-011c-425a-8fde-1ea17743a10a req-725e6b11-f3ff-4a76-9203-ba4418aa9912 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0508275 Dec 21 04:48:08.595499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6731e610-011c-425a-8fde-1ea17743a10a req-2c636a1b-734a-4229-ad72-a5342c8593f8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388706 Dec 21 04:48:09.709373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20a0a62-e16c-4df0-8c75-2b14ca70387c req-a4f4e423-baa9-4e9d-864a-cc05b3f5ab74 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:09.711472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e20a0a62-e16c-4df0-8c75-2b14ca70387c req-a4f4e423-baa9-4e9d-864a-cc05b3f5ab74 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0488284 Dec 21 04:48:09.757684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e20a0a62-e16c-4df0-8c75-2b14ca70387c req-38500003-8ba6-4e83-917d-c6bdca7e3588 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400338 Dec 21 04:48:10.875632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3216231a-37f3-42eb-a5ad-950edf0367c5 req-faa51e3c-74dd-49bd-9d43-9d7a316e63c5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:10.877016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3216231a-37f3-42eb-a5ad-950edf0367c5 req-faa51e3c-74dd-49bd-9d43-9d7a316e63c5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0518823 Dec 21 04:48:10.923261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3216231a-37f3-42eb-a5ad-950edf0367c5 req-d71acce2-a6e2-446d-9b0e-cc6517ede9d9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397906 Dec 21 04:48:12.036668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77939fc1-c01e-49d9-902e-ab9022203d27 req-7dda5134-c3f2-4efa-ae4a-d31dd2b9d556 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:12.038132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77939fc1-c01e-49d9-902e-ab9022203d27 req-7dda5134-c3f2-4efa-ae4a-d31dd2b9d556 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0478759 Dec 21 04:48:12.083691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77939fc1-c01e-49d9-902e-ab9022203d27 req-2e39bb91-127d-4ff2-ab38-436aec8db220 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396872 Dec 21 04:48:13.197005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714695f4-ece2-4faa-afbd-8b2a583f9922 req-33aebdfd-4cb4-4b48-bdcc-3e78fc8878fa tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:13.198608 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714695f4-ece2-4faa-afbd-8b2a583f9922 req-33aebdfd-4cb4-4b48-bdcc-3e78fc8878fa tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0481222 Dec 21 04:48:13.249126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714695f4-ece2-4faa-afbd-8b2a583f9922 req-b001e353-78fa-4d7b-9a4e-f2432ee4121c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447540 Dec 21 04:48:14.302685 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-c6e502a0-288a-4bd9-991c-d2432d5e3939 service neutron] show failed (client error): The resource could not be found. Dec 21 04:48:14.303749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-c6e502a0-288a-4bd9-991c-d2432d5e3939 service neutron] 10.222.0.31 "GET /v2.0/ports/040f8fb8-8233-4f3f-800a-ad6eeea6c4ec/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0549052 Dec 21 04:48:14.363029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7ff154-e292-4cfd-8a71-3097c29fa08a req-bb017d73-10ee-44c2-b5ec-ee6d078b3e79 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:14.364511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c7ff154-e292-4cfd-8a71-3097c29fa08a req-bb017d73-10ee-44c2-b5ec-ee6d078b3e79 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0490122 Dec 21 04:48:14.412594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c7ff154-e292-4cfd-8a71-3097c29fa08a req-83a78829-ffbb-4daf-939f-ef2a136e6e22 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415709 Dec 21 04:48:14.853236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-088c68a7-860d-45f5-80f9-f7c4a1b80bcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:14.854723 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-088c68a7-860d-45f5-80f9-f7c4a1b80bcb service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 1098 time: 0.0929930 Dec 21 04:48:14.873323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:48:14.927741 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:15.133933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:15.166876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:48:15.204881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:15.207131 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e9f482d-3082-48a5-b4b8-43f1e555c264" -d '{"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-unplugged", "status": "completed", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:15.212086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:15.224381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Transition to ACTIVE for port object 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:48:15.283954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:15.315624 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f591f53f-104d-47a8-aec3-d0a3447dc531 x-openstack-request-id: req-f591f53f-104d-47a8-aec3-d0a3447dc531 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:15.320379 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-unplugged", "status": "completed", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:15.320379 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f591f53f-104d-47a8-aec3-d0a3447dc531 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:15.320379 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'code': 200} Dec 21 04:48:15.398517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:15.428562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.428915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.429291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.429626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.429962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.430296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.430622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.430968 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.431290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.431615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.431939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.432260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.432579 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:15.484924 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] No DVR routers for this DVR port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:48:15.548194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6593fdef-b2e7-4426-986e-c47ea266961f req-2ea60369-8182-4ca4-8042-5fa7b5df74f4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:15.549689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6593fdef-b2e7-4426-986e-c47ea266961f req-2ea60369-8182-4ca4-8042-5fa7b5df74f4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 944 time: 0.0501850 Dec 21 04:48:15.602593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6593fdef-b2e7-4426-986e-c47ea266961f req-50cb1132-ab4b-4212-b703-72c7c11c8927 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462208 Dec 21 04:48:15.621588 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:48:15.621927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:48:15.622255 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:48:15.626629 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:48:15.626955 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Attempting to bind port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:48:15.631681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 47, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:48:15.632011 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:48:15.633007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:48:15.633420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Bound port: 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:48:15.633762 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:15.693572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:48:15.697079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:48:15.769666 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:15.801688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:15.802310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:15.803728 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] 10.222.0.54 "PUT /v2.0/ports/040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 1093 time: 0.9343550 Dec 21 04:48:15.829248 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5734c0bb-372b-47e6-b932-4c8354ffea48 service neutron] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:15.886215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-74cc81ba-9e4d-4738-8b66-f1033667ea6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:15.888589 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-74cc81ba-9e4d-4738-8b66-f1033667ea6f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1096 time: 0.0472696 Dec 21 04:48:15.980667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-7bd1792a-bbf7-4ca9-b1cc-791d6af867af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:15.982150 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-7bd1792a-bbf7-4ca9-b1cc-791d6af867af service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0865421 Dec 21 04:48:16.051211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-cf43bfd8-5b39-4c3c-8564-d554ca3e1001 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 999 time: 0.0618384 Dec 21 04:48:16.097652 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-d0847471-ae61-4685-ada0-afd2af94dc25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:16.098972 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-d0847471-ae61-4685-ada0-afd2af94dc25 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0415483 Dec 21 04:48:16.144645 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-92d36226-c6a6-4b74-9749-b9fd90459648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:16.146080 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-92d36226-c6a6-4b74-9749-b9fd90459648 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383348 Dec 21 04:48:16.235811 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-db4c06a6-a6b7-475f-a973-062f8d9ce2ec service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822225 Dec 21 04:48:16.321605 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-fcafd529-1c71-471f-b14a-b34054005ae1 req-c7becfdb-3916-4e2c-b606-f27f126f414c service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0784025 Dec 21 04:48:16.725820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126feef5-6dba-419d-9387-1b97895e7498 req-59c935c3-2e57-4ed1-9dfa-32a89329906b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:16.727465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-126feef5-6dba-419d-9387-1b97895e7498 req-59c935c3-2e57-4ed1-9dfa-32a89329906b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 944 time: 0.0496771 Dec 21 04:48:16.776956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-126feef5-6dba-419d-9387-1b97895e7498 req-cba1bfd1-ff37-4190-bf40-cbca9c715878 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428979 Dec 21 04:48:17.317290 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:17.319683 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea" -d '{"events": [{"name": "network-changed", "server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:17.374251 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f8f3de2-6704-43b0-a25b-506dee23bb06 x-openstack-request-id: req-0f8f3de2-6704-43b0-a25b-506dee23bb06 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:17.374543 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:17.374853 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0f8f3de2-6704-43b0-a25b-506dee23bb06 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:17.375278 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'status': 'completed', 'code': 200} Dec 21 04:48:17.456393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-0f806590-0fdf-43c7-94f1-799629596d16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.457884 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-0f806590-0fdf-43c7-94f1-799629596d16 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1096 time: 0.0452390 Dec 21 04:48:17.471657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-9f41b9fc-95e6-4f67-a6e5-1cdfd66b8c05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.473202 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-9f41b9fc-95e6-4f67-a6e5-1cdfd66b8c05 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1096 time: 0.0397189 Dec 21 04:48:17.546911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-e9024b44-cd4c-477e-98df-7fc52512d121 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.548402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-e9024b44-cd4c-477e-98df-7fc52512d121 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0831361 Dec 21 04:48:17.572784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-0fea0e24-fa9f-4bc0-ada0-518901095126 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.574197 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-0fea0e24-fa9f-4bc0-ada0-518901095126 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0905395 Dec 21 04:48:17.641741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-80e77445-2a9f-44b8-bb8f-d9e6391e068c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 999 time: 0.0596342 Dec 21 04:48:17.702510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-42bc3aa8-db3b-4aa0-a40a-6482537ff48e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.704035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-42bc3aa8-db3b-4aa0-a40a-6482537ff48e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0512102 Dec 21 04:48:17.757184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-7b73120b-8bb5-4039-975f-84c0143b2959 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.758717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-7b73120b-8bb5-4039-975f-84c0143b2959 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0425873 Dec 21 04:48:17.779589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:48:17.827105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:48:17.827754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:48:17.860407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-922bcb74-36ea-46af-a5ef-90e40507bd73 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897954 Dec 21 04:48:17.927597 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-d4c89ecf-e940-4065-8819-e2cde0cc3c99 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 999 time: 0.3710277 Dec 21 04:48:17.979508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23231f56-61ae-457f-a5a5-5e8b4e2de4e3 req-2a7b544d-b076-4c1a-8384-f5cc8f78e0b7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.980997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23231f56-61ae-457f-a5a5-5e8b4e2de4e3 req-2a7b544d-b076-4c1a-8384-f5cc8f78e0b7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 944 time: 0.1153374 Dec 21 04:48:17.981635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-9f5539f3-faab-4fc7-a60f-da04231c19e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:17.983100 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-9f5539f3-faab-4fc7-a60f-da04231c19e6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0436997 Dec 21 04:48:18.009085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-8e7f32c2-13df-4636-851f-e4b4af9d25dc service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1349728 Dec 21 04:48:18.028510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-17e5dc57-ae75-443b-9d3f-a6fcb1a28799 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:18.029971 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-17e5dc57-ae75-443b-9d3f-a6fcb1a28799 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0392165 Dec 21 04:48:18.044853 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-23231f56-61ae-457f-a5a5-5e8b4e2de4e3 req-2cb22718-1b7b-431f-9558-fc250d05c1ec tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0568924 Dec 21 04:48:18.122869 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-2b89cb4c-ebbc-4434-ad06-27e5437de0e4 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852621 Dec 21 04:48:18.223739 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e74dd9dd-b6b5-4080-bffe-4d78655ee9ea req-001257ee-c9fb-4127-a6e7-754eba3c7562 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849466 Dec 21 04:48:19.054962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:48:19.149507 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:19.160762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'mac_address': 'fa:16:3e:f0:d2:1b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:48:19.165615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806015ac-b230-4615-8b91-4b206c8a9f3f req-04e121d8-60d4-4eb9-845b-c800567e8fe4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:19.167688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-806015ac-b230-4615-8b91-4b206c8a9f3f req-04e121d8-60d4-4eb9-845b-c800567e8fe4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 944 time: 0.0478172 Dec 21 04:48:19.201742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:19.214278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:48:19.214894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-806015ac-b230-4615-8b91-4b206c8a9f3f req-aa676c9b-c513-497f-8a5e-e03da22b0fe8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418468 Dec 21 04:48:19.234011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:19.295012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:19.342274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:19.349505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.349862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.350211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.350556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.351586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.351931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.352272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.352663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.352942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.353274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.353606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.353935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.354264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:19.513632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94fdf24e-2fc1-4a54-99d2-548a11d56e1a req-a7151d61-c491-4fe6-b04a-273d1af2cef6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:19.516173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94fdf24e-2fc1-4a54-99d2-548a11d56e1a req-a7151d61-c491-4fe6-b04a-273d1af2cef6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 945 time: 0.0499077 Dec 21 04:48:19.572863 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94fdf24e-2fc1-4a54-99d2-548a11d56e1a req-5b1cfd1e-29eb-449f-a22a-5ffafd91ba0d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488558 Dec 21 04:48:19.602649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:48:19.619490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-d0540c20-859a-4f63-bbd6-444577d50239 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:19.620972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-d0540c20-859a-4f63-bbd6-444577d50239 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03&tenant_id=684628052e674280965f258699338238&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 945 time: 0.0588527 Dec 21 04:48:19.684741 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-919eecfb-9a37-4c13-a0ed-1ac12b94f0d3 service neutron] delete failed (client error): The resource could not be found. Dec 21 04:48:19.685751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-919eecfb-9a37-4c13-a0ed-1ac12b94f0d3 service neutron] 10.222.0.31 "DELETE /v2.0/ports/040f8fb8-8233-4f3f-800a-ad6eeea6c4ec/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0522921 Dec 21 04:48:19.803519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-bf1ff275-8043-4497-b84e-65de7b54d545 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:19.805008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-bf1ff275-8043-4497-b84e-65de7b54d545 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 1097 time: 0.0406244 Dec 21 04:48:19.903394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-2b0e7575-2a7b-4141-9123-7ad48a75ed8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:19.905950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-2b0e7575-2a7b-4141-9123-7ad48a75ed8a service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0926714 Dec 21 04:48:19.906692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17eea291-cbf1-48ab-98e0-2601975d7bd9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:19.976998 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-cb073e03-735e-4886-ae7d-7e4849902749 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 200 len: 1000 time: 0.0588405 Dec 21 04:48:20.035177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-d2ebf20d-782b-4233-8d7f-0c49d136ccdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:20.036632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-d2ebf20d-782b-4233-8d7f-0c49d136ccdd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0478556 Dec 21 04:48:20.091075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-8be7c553-eeac-4760-b3f6-25b4aaf058e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:20.092581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-8be7c553-eeac-4760-b3f6-25b4aaf058e0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0446296 Dec 21 04:48:20.186137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-c14c2cd4-a1a7-4b4e-baf3-3cd783d2bd1e service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810802 Dec 21 04:48:20.281950 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ffa5fddc-c05d-428c-941d-5277c620bb08 req-f67d1e2b-0cdb-481b-ac12-673a178100b2 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846550 Dec 21 04:48:20.705891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55f46cf-930e-4b80-8596-970fbad590fa req-70fa6fe0-009f-4aed-80a0-df0de731cd92 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:20.707432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b55f46cf-930e-4b80-8596-970fbad590fa req-70fa6fe0-009f-4aed-80a0-df0de731cd92 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 945 time: 0.0642707 Dec 21 04:48:20.755201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b55f46cf-930e-4b80-8596-970fbad590fa req-017677ab-07f0-4dcf-a2f7-6134f2ac96ae tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413578 Dec 21 04:48:21.070315 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:48:21.203379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:48:21.207280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:48:21.207650 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:21.285711 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:21.311522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:21.313753 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e6c21cd-45a7-4f60-951a-1ddd0a321892" -d '{"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-plugged", "status": "completed", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:21.326752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:21.398514 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:21.421455 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af7bf34b-1098-4c6e-ab46-838e000ce182 x-openstack-request-id: req-af7bf34b-1098-4c6e-ab46-838e000ce182 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:21.423446 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-plugged", "status": "completed", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:21.423446 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-af7bf34b-1098-4c6e-ab46-838e000ce182 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:21.423446 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'code': 200} Dec 21 04:48:21.447460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:21.869206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-861f5b65-e989-4d22-95d9-ab86c9c09f49 req-7a39af5c-06ad-4ea4-a834-ae61e836acab tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:21.870573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-861f5b65-e989-4d22-95d9-ab86c9c09f49 req-7a39af5c-06ad-4ea4-a834-ae61e836acab tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0479383 Dec 21 04:48:21.924640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-861f5b65-e989-4d22-95d9-ab86c9c09f49 req-37122c81-65e4-4a8d-9e5e-f2f7296438c9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481386 Dec 21 04:48:22.038178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea21769-4bcc-42cb-967e-1b321c92ad37 req-1c315a08-f547-4183-93b0-1965e6b053c8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:22.040279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aea21769-4bcc-42cb-967e-1b321c92ad37 req-1c315a08-f547-4183-93b0-1965e6b053c8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0489049 Dec 21 04:48:22.086216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aea21769-4bcc-42cb-967e-1b321c92ad37 req-242f4745-eb52-40fc-9311-9678dd2da5e3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400846 Dec 21 04:48:22.197094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61e6879-7949-4b6c-9f0b-3c3da9a047a9 req-45f0ca08-6993-44e2-901d-51e70f28ae27 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:22.198545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b61e6879-7949-4b6c-9f0b-3c3da9a047a9 req-45f0ca08-6993-44e2-901d-51e70f28ae27 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0483582 Dec 21 04:48:22.244526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b61e6879-7949-4b6c-9f0b-3c3da9a047a9 req-e9c6c1f5-5ad7-41c8-ab6e-d53806680b3a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401473 Dec 21 04:48:22.660422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c6b11b5-c74e-46c3-a8b3-a1f42b7c43b7 req-b53ddb9e-47cf-4567-b134-7dc85dd8a6d6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:22.661913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c6b11b5-c74e-46c3-a8b3-a1f42b7c43b7 req-b53ddb9e-47cf-4567-b134-7dc85dd8a6d6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0536768 Dec 21 04:48:22.689217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-175bcc0a-7705-4dc3-b511-a319db918e10 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:22.709691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c6b11b5-c74e-46c3-a8b3-a1f42b7c43b7 req-82bfa763-b9cb-4202-a7a4-6eb2ccda789e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411706 Dec 21 04:48:23.391802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:23.465781 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:23.826190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5aab7ee-9422-464e-a280-34f77fe6be5f req-ec589699-5e43-4dca-a8a4-93442283743c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:23.827807 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5aab7ee-9422-464e-a280-34f77fe6be5f req-ec589699-5e43-4dca-a8a4-93442283743c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0482230 Dec 21 04:48:23.876425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5aab7ee-9422-464e-a280-34f77fe6be5f req-ced80418-5698-4355-b9ed-b526fb188676 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428748 Dec 21 04:48:24.057209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-7103a30c-72bb-4a03-8fc6-abea0bb80da4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:24.058587 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-7103a30c-72bb-4a03-8fc6-abea0bb80da4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 946 time: 0.0475061 Dec 21 04:48:24.148835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Deleting port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:48:24.149178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:24.238150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] For port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:24.238511 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:24.403267 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:24.403539 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:24.403869 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 disassociated. External IP: 172.25.5.55, port: 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec. Dec 21 04:48:24.404215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Calling delete_port for 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:48:24.620799 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:24.651135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event deleted for resources: {'Port': ['ID=040f8fb8-8233-4f3f-800a-ad6eeea6c4ec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:24.770956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:48:24.880303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:48:24.890186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:48:24.902396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:48:24.903062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:48:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:24.924266 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] No DVR routers for this DVR port 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:48:24.926879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:24.930821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-d85ed484-ff02-4589-8766-caa3add0fe56 req-d318e612-84aa-4e28-850b-fe2ec5741a03 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "DELETE /v2.0/ports/040f8fb8-8233-4f3f-800a-ad6eeea6c4ec HTTP/1.1" status: 204 len: 173 time: 0.8651922 Dec 21 04:48:24.930821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-deleted', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:24.933034 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8757cdc3-cc14-470b-bf84-465e548b0dad" -d '{"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-deleted", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:24.976786 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2361df54-6df7-4973-b95d-f1e57352c194 x-openstack-request-id: req-2361df54-6df7-4973-b95d-f1e57352c194 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:24.977109 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e4676407-62cf-4b2c-bf56-8ea6709d2b03", "name": "network-vif-deleted", "tag": "040f8fb8-8233-4f3f-800a-ad6eeea6c4ec", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:24.977361 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2361df54-6df7-4973-b95d-f1e57352c194 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:24.977768 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e4676407-62cf-4b2c-bf56-8ea6709d2b03', 'name': 'network-vif-deleted', 'tag': '040f8fb8-8233-4f3f-800a-ad6eeea6c4ec', 'status': 'completed', 'code': 200} Dec 21 04:48:24.980778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2dd011e-99e5-485d-99da-2957afdecc88 req-90cf9912-5920-487b-80db-35d0d22d5f69 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=e4676407-62cf-4b2c-bf56-8ea6709d2b03 HTTP/1.1" status: 200 len: 210 time: 0.0319741 Dec 21 04:48:25.017671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:48:25.226580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:25.254265 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:48:25.272772 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:48:25.273372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:48:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:25.311617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:25.353079 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:25.380778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:48:25.578734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:25.608564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ce30cf6-1603-46b7-9597-cf0d146c2a55 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:48:25.797906 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:25.828995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9c4bad-fc41-4862-92a3-379747db34e5 None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:48:26.220123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-9a2e5dbb-8bf0-48b8-9b10-6b9704c2f67a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--386554186&fields=id&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 267 time: 0.0450597 Dec 21 04:48:26.323982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-4f096df3-aca1-4a64-b475-cd4aad59090b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:26.325438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-4f096df3-aca1-4a64-b475-cd4aad59090b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.0980222 Dec 21 04:48:26.340724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-2ac7e7bb-7c0a-43c8-9521-a0da7158829a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/quotas/684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 375 time: 0.0095267 Dec 21 04:48:26.390077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-2548a433-1146-40b1-8758-f8b9a6a02504 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0443928 Dec 21 04:48:26.534021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-270caa82-5a21-4431-9e17-08f0fd8027b1 service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319783 Dec 21 04:48:26.622817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41c454f2-13ad-4f24-9de4-b17dbe67cda3 service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825546 Dec 21 04:48:26.853685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f5ca145e-e84f-46e2-bff6-2be061af2003 req-7674a7be-fa5c-41ee-b60f-3b3f5bf493e2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 210 time: 0.0306487 Dec 21 04:48:27.057513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:48:27.077844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:48:27.078204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 040f8fb8-8233-4f3f-800a-ad6eeea6c4ec not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:48:27.951186 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71f1e9ca-b430-4601-bd6e-3a07abb42a31 req-8f849c14-a335-4358-8c47-d26d1b045e61 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 210 time: 0.0291233 Dec 21 04:48:28.851780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-30f8a739-e5cc-4b23-99ff-7dd5e0ed1fcd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:28.853228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-30f8a739-e5cc-4b23-99ff-7dd5e0ed1fcd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.1017072 Dec 21 04:48:28.875219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:48:28.927289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-5eeec3fe-7e33-4c65-bbaf-8b997f259f3d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 379 time: 0.0563309 Dec 21 04:48:28.941009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'port': {'device_id': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'admin_state_up': True, 'tenant_id': '684628052e674280965f258699338238', 'security_groups': ['f316a23c-9c52-424d-a1e8-aa67bc3eba50']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:48:29.061229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e17ee15-4292-4975-9f65-6e257ece6f93 req-661cfe3f-924b-4fb7-bbbd-570713ed7c2f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 210 time: 0.0313551 Dec 21 04:48:29.169111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Made reservation on behalf of 684628052e674280965f258699338238 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:48:29.172677 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:29.296474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Allocated IP 172.20.0.11 (fc0ae40f-7660-4c02-8692-f49eb5531fe8/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5/b47d1b3a-6216-4b25-b70b-23135ef24425) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:48:29.431074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:29.506644 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:29.553392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:48:29.556999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:48:29.560689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:48:29.567198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:29.597039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.597388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.597728 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.598068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.598401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.598736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.599090 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.599415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.599735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.600055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.600378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.600694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.601041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:48:29.625075 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:48:29.629213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:29.629213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:29.703377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-06721fd4-79b4-4b69-a1f7-8adf9ae7f135 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7661331 Dec 21 04:48:29.726689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Request body: {'port': {'device_id': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:48:29.791534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:29.812268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-15e6c516-64aa-4ab6-ad20-46bbdaaa2aa1 None None] Provisioning complete for port b47d1b3a-6216-4b25-b70b-23135ef24425 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:48:29.812868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-15e6c516-64aa-4ab6-ad20-46bbdaaa2aa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:29.849114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-15e6c516-64aa-4ab6-ad20-46bbdaaa2aa1 None None] Port b47d1b3a-6216-4b25-b70b-23135ef24425 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:48:30.047438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b47d1b3a-6216-4b25-b70b-23135ef24425 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:48:30.054626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:30.073233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Transition to ACTIVE for port object b47d1b3a-6216-4b25-b70b-23135ef24425 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:48:30.128939 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:30.214288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:30.265446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f03224-5ff4-4631-82f8-e8e3ead2b9f8 req-d3f0f56a-6426-456b-8a9c-cd50eded58ed tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:30.267024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54f03224-5ff4-4631-82f8-e8e3ead2b9f8 req-d3f0f56a-6426-456b-8a9c-cd50eded58ed tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.1111503 Dec 21 04:48:30.321906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:48:30.322250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:48:30.322591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:48:30.334239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Port b47d1b3a-6216-4b25-b70b-23135ef24425 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:48:30.335192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:48:30.341005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54f03224-5ff4-4631-82f8-e8e3ead2b9f8 req-ca868b2f-01ef-4ecd-b38a-ae9a79706542 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0674386 Dec 21 04:48:30.344914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 48, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:48:30.345258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:48:30.345642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:48:30.346079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Bound port: b47d1b3a-6216-4b25-b70b-23135ef24425, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:48:30.346439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:30.413521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:48:30.416510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:48:30.466032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:30.501470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:30.506081 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:30.506081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] 10.222.0.31 "PUT /v2.0/ports/b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1093 time: 0.7811654 Dec 21 04:48:30.506081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:30.506081 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3711278-8efa-4279-81c0-07df2bba87d3" -d '{"events": [{"name": "network-changed", "server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:30.528798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a4f464-70c5-418a-820b-87e18996c9fc service neutron] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:30.619415 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f173642d-737c-4913-a0a9-63f2cb0f0c00 x-openstack-request-id: req-f173642d-737c-4913-a0a9-63f2cb0f0c00 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:30.619704 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:30.619958 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f173642d-737c-4913-a0a9-63f2cb0f0c00 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:30.620366 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'status': 'completed', 'code': 200} Dec 21 04:48:30.684965 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-2ea2b9c9-5625-4663-b025-9d3b941c5de0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:30.685454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-2ea2b9c9-5625-4663-b025-9d3b941c5de0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0461547 Dec 21 04:48:30.743867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-e366d415-e119-4796-a130-622ec5b79c82 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 217 time: 0.0384324 Dec 21 04:48:30.797383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-0374472d-df74-438e-953e-046cc2345c88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:30.798962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-0374472d-df74-438e-953e-046cc2345c88 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0442269 Dec 21 04:48:30.848343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-17239f98-f844-4ee7-8bdc-3af174f02a6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:30.849705 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-17239f98-f844-4ee7-8bdc-3af174f02a6a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0392919 Dec 21 04:48:30.951163 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-ab73d69d-287a-4738-976a-7164dac57517 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865974 Dec 21 04:48:31.048371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6171604e-f61e-4d21-8f95-d583f3b56ab5 req-a19b8738-bf8a-4a96-9c81-c04001f0c1eb service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844264 Dec 21 04:48:31.298504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-2b295c22-6a72-4a08-a90f-e81626f99373 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:31.300029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-2b295c22-6a72-4a08-a90f-e81626f99373 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0408797 Dec 21 04:48:31.395361 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-0ce9eb10-fcd3-4e5e-9af5-5f98b8d9e3ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:31.396902 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-0ce9eb10-fcd3-4e5e-9af5-5f98b8d9e3ed service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0886066 Dec 21 04:48:31.448940 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-9ddc9a06-3896-44e1-b863-02b2d02eacb5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 217 time: 0.0448315 Dec 21 04:48:31.518685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136a4c0c-cb6b-4498-81ec-5f7737f107be req-ddcc7373-0901-4c3e-81d6-3b2b9b41282f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:31.520161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-136a4c0c-cb6b-4498-81ec-5f7737f107be req-ddcc7373-0901-4c3e-81d6-3b2b9b41282f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.1102455 Dec 21 04:48:31.521411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-d0574bb4-6510-4d9f-882a-621b697e7308 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:31.522698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-d0574bb4-6510-4d9f-882a-621b697e7308 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0599091 Dec 21 04:48:31.596584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-136a4c0c-cb6b-4498-81ec-5f7737f107be req-224e0e8b-dee7-4855-ab17-0197cd174654 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0697527 Dec 21 04:48:31.600801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-c01f38dd-5b92-4158-9125-c9f2090d328e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:31.602819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-c01f38dd-5b92-4158-9125-c9f2090d328e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0678520 Dec 21 04:48:31.698250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-059a1ed8-50cc-46f8-bbb1-bd62af52915d service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850704 Dec 21 04:48:31.791925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3711278-8efa-4279-81c0-07df2bba87d3 req-34d14fc5-4975-43a8-bca1-c5986f1008d5 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849185 Dec 21 04:48:32.718672 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3de39c-3de0-44c4-a068-13c4bce29aff req-b52dc8f6-fbdd-499d-9c57-c102cd462a0f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:32.720224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c3de39c-3de0-44c4-a068-13c4bce29aff req-b52dc8f6-fbdd-499d-9c57-c102cd462a0f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.0546803 Dec 21 04:48:32.766855 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c3de39c-3de0-44c4-a068-13c4bce29aff req-2fc1b82c-4c9b-495c-873d-d79c26099252 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406117 Dec 21 04:48:33.848951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:48:33.880760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039f836a-fac8-4064-bd00-d0078d1615e7 req-7337b2c9-42cd-4dc2-a414-c7dd9af4aa06 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:33.882134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-039f836a-fac8-4064-bd00-d0078d1615e7 req-7337b2c9-42cd-4dc2-a414-c7dd9af4aa06 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.0481734 Dec 21 04:48:33.928630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-039f836a-fac8-4064-bd00-d0078d1615e7 req-2b2d7a2e-5848-4886-9cab-dcc7598aaa27 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399666 Dec 21 04:48:33.943526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:33.954284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'mac_address': 'fa:16:3e:38:56:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:48:33.991157 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:34.003981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b47d1b3a-6216-4b25-b70b-23135ef24425 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:48:34.023393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:34.077552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:34.124441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:34.464811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['b47d1b3a-6216-4b25-b70b-23135ef24425'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:48:35.047959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca088813-d636-447f-89d8-92f525a372a4 req-ce8c2e00-9fa7-4550-99f5-44c5ccd46f7c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:35.049350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca088813-d636-447f-89d8-92f525a372a4 req-ce8c2e00-9fa7-4550-99f5-44c5ccd46f7c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 945 time: 0.0530798 Dec 21 04:48:35.094611 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca088813-d636-447f-89d8-92f525a372a4 req-655e6037-ca65-4d1a-989b-4be988386b18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394478 Dec 21 04:48:35.877985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:48:35.974453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port b47d1b3a-6216-4b25-b70b-23135ef24425 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:48:35.979518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port b47d1b3a-6216-4b25-b70b-23135ef24425 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:48:35.979893 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:36.060398 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:36.083072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:36.085289 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6d2d438-2118-4ba9-b60f-4951112c160d" -d '{"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-plugged", "status": "completed", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:36.098197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:48:36.125171 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bb1654f-94de-4dee-80cd-12c0622be1c7 x-openstack-request-id: req-4bb1654f-94de-4dee-80cd-12c0622be1c7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:36.125171 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-plugged", "status": "completed", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:36.125171 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4bb1654f-94de-4dee-80cd-12c0622be1c7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:36.125171 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'code': 200} Dec 21 04:48:36.158200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:36.209063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:48:36.212701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9115cbe2-46be-44c4-9040-cc8aee58a2d0 req-1a72d55d-f956-46a0-a5d7-fa9490f9a7d8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:36.214321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9115cbe2-46be-44c4-9040-cc8aee58a2d0 req-1a72d55d-f956-46a0-a5d7-fa9490f9a7d8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0519674 Dec 21 04:48:36.292678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9115cbe2-46be-44c4-9040-cc8aee58a2d0 req-e8902ed2-4446-4cef-9375-12b14847f271 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0685866 Dec 21 04:48:36.298383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4327516f-cf33-45f5-a1c2-e9480f713e12 req-91700f46-30db-4bcb-8225-5e1abc8562e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:36.299850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4327516f-cf33-45f5-a1c2-e9480f713e12 req-91700f46-30db-4bcb-8225-5e1abc8562e1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1098 time: 0.0627022 Dec 21 04:48:36.350381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4327516f-cf33-45f5-a1c2-e9480f713e12 req-14d2a20d-83c3-4693-81bf-f7ea2e2ef365 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393815 Dec 21 04:48:37.409582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c6255a-0a9d-427e-8a75-128551fd2d2d req-7cb08005-a0ba-4e28-87e8-ec63a5a6155f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:37.411101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14c6255a-0a9d-427e-8a75-128551fd2d2d req-7cb08005-a0ba-4e28-87e8-ec63a5a6155f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0496035 Dec 21 04:48:37.457304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-14c6255a-0a9d-427e-8a75-128551fd2d2d req-e97c487e-923e-44e1-850b-0c5fdc2a41e6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396914 Dec 21 04:48:38.569359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b8e89b-0e0e-4813-bf1e-1708fcba2894 req-553f1822-8bcf-4c84-816f-c1dcd35fb9c7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:38.571345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1b8e89b-0e0e-4813-bf1e-1708fcba2894 req-553f1822-8bcf-4c84-816f-c1dcd35fb9c7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0460730 Dec 21 04:48:38.620588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1b8e89b-0e0e-4813-bf1e-1708fcba2894 req-b120c61a-7eac-4a94-9342-922ba9ea23b0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434015 Dec 21 04:48:38.738148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c378a69b-0d50-4e08-89ac-f774cb1cafe5 req-06f013c4-4d48-4381-a8fb-b3acc6e6c065 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:38.739559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c378a69b-0d50-4e08-89ac-f774cb1cafe5 req-06f013c4-4d48-4381-a8fb-b3acc6e6c065 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0487649 Dec 21 04:48:38.748605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 48990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:48:38.752763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'floatingip': {'port_id': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:48:38.790669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:39.541378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:39.580139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:39.679724 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 associated. External IP: 172.25.5.55, port: b47d1b3a-6216-4b25-b70b-23135ef24425. Dec 21 04:48:39.883313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:48:39.989881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:48:39.994800 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:39.999430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:48:40.008536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:48:40.009642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:48:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:40.021673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6b4cd5e5-1c90-40b3-aad2-a8717c1edbe6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "PUT /v2.0/floatingips/107ec780-6cdd-4fdc-886a-90ca42f9c9c0 HTTP/1.1" status: 200 len: 991 time: 1.2720520 Dec 21 04:48:40.022271 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:48:40.024560 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9" -d '{"events": [{"name": "network-changed", "server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:48:40.067720 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:48:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b59765eb-63c4-4249-86ea-8194e77e85f7 x-openstack-request-id: req-b59765eb-63c4-4249-86ea-8194e77e85f7 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:48:40.068038 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:48:40.068293 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b59765eb-63c4-4249-86ea-8194e77e85f7 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:48:40.068717 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'status': 'completed', 'code': 200} Dec 21 04:48:40.115530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:48:40.164894 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-07c66baa-dc78-48a9-a43e-e5625366ad60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:40.166451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-07c66baa-dc78-48a9-a43e-e5625366ad60 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1098 time: 0.0406070 Dec 21 04:48:40.262184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-938984de-2ffa-4cfc-8a84-2e991f0e6e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:40.263692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-938984de-2ffa-4cfc-8a84-2e991f0e6e2e service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0880027 Dec 21 04:48:40.331341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-1bafe9af-6911-44e6-a3ff-c7642f56d894 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 999 time: 0.0596488 Dec 21 04:48:40.344776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:38:56:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:48:39Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:40.370476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:48:40.378652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:48:40.379278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:48:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:40.380456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-6da168b9-7beb-4bd1-8b4e-93aed24ca0be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:40.389411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-6da168b9-7beb-4bd1-8b4e-93aed24ca0be service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0434506 Dec 21 04:48:40.432092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-1b68b86d-0483-4639-8598-8378f414463e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:48:40.433641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-1b68b86d-0483-4639-8598-8378f414463e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0445275 Dec 21 04:48:40.483262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:48:40.524244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-06d644a8-87be-4a0c-8da6-765778a198ac service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827782 Dec 21 04:48:40.625276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2d2741f-831d-4e86-a17a-d4c2a3d1c8b9 req-66c27751-66d2-42af-b392-6b4d42763271 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0935390 Dec 21 04:48:40.861856 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:38:56:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:48:39Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:48:40.887675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0cb6893-e4ea-45d2-9601-11c7a5e1bd56 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:38:56:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:48:39Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:48:41.063098 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8278c5cc-845a-4cb1-a36b-7d0f0199a7c6 None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:48:49.871650 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2960922e-39d8-4aaf-ab91-56d0e0d788df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:52.694060 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-08e63de7-00a9-4a72-af50-ff4a761c623e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:53.391387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:53.459789 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:55.248873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:55.339725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:48:55.785798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:05.874654 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:49:19.882780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e8c9c10e-7465-49f8-acae-55f6f39ad91d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:22.693915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e4323ee-f7e2-4206-a0fe-0587dd2ab176 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:23.390668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:23.482050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:23.720766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-1081941d-315a-4ebc-b3ea-cf1830507448 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0402913 Dec 21 04:49:23.828979 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-4a5ab480-3f51-43cb-81c9-a50f7a905c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:49:23.830455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-4a5ab480-3f51-43cb-81c9-a50f7a905c67 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1098 time: 0.0391567 Dec 21 04:49:23.940951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-ef9cd428-8285-48be-9959-734cf9275d59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:49:23.942420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-ef9cd428-8285-48be-9959-734cf9275d59 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0866699 Dec 21 04:49:24.012310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-eb0f6525-d053-411b-9682-2065aa83b4a9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1001 time: 0.0583086 Dec 21 04:49:24.072222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-2a9d780a-7d6f-44e3-9610-32939ae0dee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:49:24.074024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-2a9d780a-7d6f-44e3-9610-32939ae0dee3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0492215 Dec 21 04:49:24.122075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-7e1d7b5a-abd3-421f-9e37-b1a6c65a1e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:49:24.123585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-7e1d7b5a-abd3-421f-9e37-b1a6c65a1e59 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0393085 Dec 21 04:49:24.217234 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-b2e67224-951c-4107-8d2c-66abab4adf24 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833282 Dec 21 04:49:24.313177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-34234502-e9e7-4fd5-85a0-d0aaed91134c req-5116f90e-5dc3-47bd-8e11-b39d5751c26e service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845854 Dec 21 04:49:25.248664 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:25.328139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:25.791425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:42.873765 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:49:49.876520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-966060df-2aac-489e-83dd-aa156027bdd3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:52.699717 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a48ecce8-272e-402c-a425-d85bea86fc1a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:53.420393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:53.482001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:55.282438 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:55.327800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:49:55.808721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:19.872362 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:50:19.899728 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f8288da-f35d-4888-9bc7-6046fa905bfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:21.524831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a642fc54-50a2-4e6a-ae2b-486ba7e16995 req-f9049146-dab8-4724-aa54-603dc75648da tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:21.526847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a642fc54-50a2-4e6a-ae2b-486ba7e16995 req-f9049146-dab8-4724-aa54-603dc75648da tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0503147 Dec 21 04:50:21.578132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a642fc54-50a2-4e6a-ae2b-486ba7e16995 req-27444c58-dd78-4611-a1f1-9de437ed8356 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410430 Dec 21 04:50:22.699348 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-45403eb0-747f-481b-ae17-dea16de2c70a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:22.704855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae87f811-9cc3-42ad-9299-1d459ca681a5 req-b8443fe1-479f-49b2-803e-683a4ee1cd32 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:22.706353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae87f811-9cc3-42ad-9299-1d459ca681a5 req-b8443fe1-479f-49b2-803e-683a4ee1cd32 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0537345 Dec 21 04:50:22.752614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae87f811-9cc3-42ad-9299-1d459ca681a5 req-bf0c575c-3ccd-465c-b51b-10e7643297b4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401976 Dec 21 04:50:23.407943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:23.492515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:23.768171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-973769c0-9a11-47ea-89ec-a191855e105c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:23.769664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-973769c0-9a11-47ea-89ec-a191855e105c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1098 time: 0.0395026 Dec 21 04:50:23.913747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-ed29aa26-5967-4938-b05d-8373b4b37220 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:23.915285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-ed29aa26-5967-4938-b05d-8373b4b37220 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.1241441 Dec 21 04:50:23.925467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b112edc8-8387-42f5-897c-bac8ed053442 req-20481fca-5d70-476a-97b7-a48c7bf005c4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:23.929319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b112edc8-8387-42f5-897c-bac8ed053442 req-20481fca-5d70-476a-97b7-a48c7bf005c4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.1078804 Dec 21 04:50:24.018104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-85f16628-5fbf-4349-8846-0447f3103686 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1001 time: 0.0878210 Dec 21 04:50:24.025266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b112edc8-8387-42f5-897c-bac8ed053442 req-e3cf68de-42e3-43e1-8934-edc947b55310 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0890121 Dec 21 04:50:24.070783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-49a29c02-fac0-42f0-84d0-b2bf99617f10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:24.072265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-49a29c02-fac0-42f0-84d0-b2bf99617f10 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0434060 Dec 21 04:50:24.121073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-ec20502c-6fa3-4891-9a60-d1e01b411747 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:24.122546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-ec20502c-6fa3-4891-9a60-d1e01b411747 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0394974 Dec 21 04:50:24.221190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-2b51d976-4fe4-4b22-a9c6-4b6a53960046 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909960 Dec 21 04:50:24.312712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2ebd62eb-f2b3-4783-9f49-25b438854301 req-bda9416f-634f-4096-8111-1656d8a59511 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832036 Dec 21 04:50:25.141229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14c146d-716f-43e7-b2c0-9be5c1596cff req-843e025b-6201-433c-ae25-97489dcda7de tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:25.142713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e14c146d-716f-43e7-b2c0-9be5c1596cff req-843e025b-6201-433c-ae25-97489dcda7de tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0495670 Dec 21 04:50:25.195092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e14c146d-716f-43e7-b2c0-9be5c1596cff req-c543edd4-9457-4093-9ac1-abaf0ea67f11 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465174 Dec 21 04:50:25.267123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:25.343959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:25.791075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:26.309619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e549e0-c160-4480-9cbb-3248cd29db5e req-6f1298b2-a45d-49c1-a27d-1117207c5259 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:26.311128 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15e549e0-c160-4480-9cbb-3248cd29db5e req-6f1298b2-a45d-49c1-a27d-1117207c5259 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0476940 Dec 21 04:50:26.357707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15e549e0-c160-4480-9cbb-3248cd29db5e req-6f67cd78-62dd-4aec-921e-18d0278ead6a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407631 Dec 21 04:50:27.470752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94a11f5-9e26-419b-b7fc-28f5a088d998 req-3a96eede-ea2b-4312-af18-caf6904e4dca tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:27.472259 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e94a11f5-9e26-419b-b7fc-28f5a088d998 req-3a96eede-ea2b-4312-af18-caf6904e4dca tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0478804 Dec 21 04:50:27.519068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e94a11f5-9e26-419b-b7fc-28f5a088d998 req-94eb68db-a21f-481c-a46c-3e5acccc7d9c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408747 Dec 21 04:50:28.635022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe321ad-fd01-4a89-a21f-99ace533f74f req-3dcb7e88-047a-4c80-b929-ac71e463519d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:28.637107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1fe321ad-fd01-4a89-a21f-99ace533f74f req-3dcb7e88-047a-4c80-b929-ac71e463519d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0524604 Dec 21 04:50:28.683350 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1fe321ad-fd01-4a89-a21f-99ace533f74f req-0e3e2a04-a836-44cc-ae1e-433a8b5f890b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403216 Dec 21 04:50:29.797774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207b1e4f-940f-4dc3-b9dd-6930baa3b339 req-a3de14de-2dad-4888-b85c-ca8f16547afc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:29.799296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-207b1e4f-940f-4dc3-b9dd-6930baa3b339 req-a3de14de-2dad-4888-b85c-ca8f16547afc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0486162 Dec 21 04:50:29.845379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-207b1e4f-940f-4dc3-b9dd-6930baa3b339 req-fca90837-7331-4f9a-8388-7e869cba21ae tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402207 Dec 21 04:50:30.961921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c386c6-015b-4405-aa43-830a49968ecc req-61946a94-699d-4446-be7f-4751cd669c2f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:30.963391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51c386c6-015b-4405-aa43-830a49968ecc req-61946a94-699d-4446-be7f-4751cd669c2f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0512962 Dec 21 04:50:31.010672 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51c386c6-015b-4405-aa43-830a49968ecc req-2337bc5a-4756-42ea-ab4e-50cfb56b5cc5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408511 Dec 21 04:50:32.126259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43eba2f1-b242-4c52-a0b8-88fe9e8d2701 req-62283a14-f7c8-4dae-99d6-511588004e4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:32.127774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43eba2f1-b242-4c52-a0b8-88fe9e8d2701 req-62283a14-f7c8-4dae-99d6-511588004e4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0486028 Dec 21 04:50:32.173935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43eba2f1-b242-4c52-a0b8-88fe9e8d2701 req-06b21e46-29e6-4c56-874c-f16a5b2f6c48 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403099 Dec 21 04:50:33.527443 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c7c60c-4c43-4c26-a144-5d702b8735f3 req-1fc046db-8385-43dd-b989-f067d1e105d1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:33.528931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21c7c60c-4c43-4c26-a144-5d702b8735f3 req-1fc046db-8385-43dd-b989-f067d1e105d1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0484111 Dec 21 04:50:33.579006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-21c7c60c-4c43-4c26-a144-5d702b8735f3 req-3326c8ab-467d-45f4-9475-28b455a83db7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440974 Dec 21 04:50:33.674264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-91276356-d985-4283-a4d4-9148d844136a service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0967860 Dec 21 04:50:34.704496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029c4f32-ea7f-4ba5-953a-dbbf3e5053ff req-272301a2-4430-4ead-aeab-965887f40af0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:34.706154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-029c4f32-ea7f-4ba5-953a-dbbf3e5053ff req-272301a2-4430-4ead-aeab-965887f40af0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0491331 Dec 21 04:50:34.753443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-029c4f32-ea7f-4ba5-953a-dbbf3e5053ff req-3a040cc3-a19f-4045-94f9-a7f2b5cab68d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411179 Dec 21 04:50:35.695079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-4dcd53f6-2253-483e-b02a-caba1e2affa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:35.696557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-4dcd53f6-2253-483e-b02a-caba1e2affa9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1098 time: 0.0395765 Dec 21 04:50:35.793297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-bc6b8d85-290e-4602-9855-d3a7ed26eac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:35.794804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-bc6b8d85-290e-4602-9855-d3a7ed26eac9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0860007 Dec 21 04:50:35.895891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-8a6428b5-6350-4e30-a60a-a0879870314b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1001 time: 0.0897360 Dec 21 04:50:35.913214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6a3804-acad-4441-a00f-d48e3189112b req-11775760-e627-4da0-9154-55d42c721568 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:35.914718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca6a3804-acad-4441-a00f-d48e3189112b req-11775760-e627-4da0-9154-55d42c721568 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0735650 Dec 21 04:50:35.988849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-51c8b16f-f58d-46d6-a406-5c4ecf690282 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:35.990315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-51c8b16f-f58d-46d6-a406-5c4ecf690282 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0745454 Dec 21 04:50:35.997506 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca6a3804-acad-4441-a00f-d48e3189112b req-5c5e4777-e939-4e16-835d-0f1d57521e9f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0712264 Dec 21 04:50:36.040197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-70772cb0-3cab-4d90-84b9-8cf232032660 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:36.041653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-70772cb0-3cab-4d90-84b9-8cf232032660 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0398803 Dec 21 04:50:36.134134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-2e926582-4da6-4e48-b1d2-63ef82b9e723 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814841 Dec 21 04:50:36.225862 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-ddf02084-e8fd-42b2-b221-a3570adc723e service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799959 Dec 21 04:50:37.115416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0390a0-bbdb-40c9-86fd-4a3fde75db05 req-6ecf46ef-88ad-4161-b23b-53558fdc1ec9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:37.116884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce0390a0-bbdb-40c9-86fd-4a3fde75db05 req-6ecf46ef-88ad-4161-b23b-53558fdc1ec9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0525877 Dec 21 04:50:37.164550 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ce0390a0-bbdb-40c9-86fd-4a3fde75db05 req-b41b1743-7843-4858-908c-a8a32d240074 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412607 Dec 21 04:50:38.278927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3832f557-8318-4164-a54f-5c8401dbf8ca req-dcc5d65a-fa0e-4c20-a6be-4986bc2b40f9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:38.280419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3832f557-8318-4164-a54f-5c8401dbf8ca req-dcc5d65a-fa0e-4c20-a6be-4986bc2b40f9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0479786 Dec 21 04:50:38.325706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3832f557-8318-4164-a54f-5c8401dbf8ca req-e1a54dbe-0779-4cec-8f3d-fae1545656ba tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395441 Dec 21 04:50:38.673581 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-269b719c-f009-4fd1-9ef5-eb40db6524cc service neutron] show failed (client error): The resource could not be found. Dec 21 04:50:38.674593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-269b719c-f009-4fd1-9ef5-eb40db6524cc service neutron] 10.222.0.31 "GET /v2.0/ports/b47d1b3a-6216-4b25-b70b-23135ef24425/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0566909 Dec 21 04:50:39.138420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-23983283-6b4e-4050-aef0-2036016cb36a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:39.139934 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-23983283-6b4e-4050-aef0-2036016cb36a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 1098 time: 0.0407259 Dec 21 04:50:39.150565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-2a2a7a66-3e33-447c-9ca1-eac01e780189 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:50:39.151545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-2a2a7a66-3e33-447c-9ca1-eac01e780189 service neutron] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049365 Dec 21 04:50:39.174556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:50:39.227453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:39.429867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:50:39.440654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4ce543-9838-4c49-99d4-309b47e8900d req-2c67952c-a334-4063-8805-0f9c07d4746f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:39.442161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d4ce543-9838-4c49-99d4-309b47e8900d req-2c67952c-a334-4063-8805-0f9c07d4746f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0488830 Dec 21 04:50:39.467407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:50:39.489927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d4ce543-9838-4c49-99d4-309b47e8900d req-d7ebbfe7-d25d-4d97-8303-8ddbddfbfbd8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418062 Dec 21 04:50:39.507151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:50:39.509412 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-359dd502-3765-4e6d-9ff6-3e25cf1611de" -d '{"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-unplugged", "status": "completed", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:50:39.513320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:39.527042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Transition to ACTIVE for port object b47d1b3a-6216-4b25-b70b-23135ef24425 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:50:39.570336 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:50:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0fe03f87-5dd2-45c9-9121-ce9d1db4631d x-openstack-request-id: req-0fe03f87-5dd2-45c9-9121-ce9d1db4631d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:50:39.570638 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-unplugged", "status": "completed", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:50:39.570900 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0fe03f87-5dd2-45c9-9121-ce9d1db4631d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:50:39.571340 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'code': 200} Dec 21 04:50:39.608157 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:39.682484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:50:39.696798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.697145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.697489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.697831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.698166 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.698504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.698863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.699224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.699552 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.699879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.700214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.700557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.700847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:39.744604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] No DVR routers for this DVR port b47d1b3a-6216-4b25-b70b-23135ef24425 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:50:39.885240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:50:39.886092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:50:39.886426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:50:39.891118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Port b47d1b3a-6216-4b25-b70b-23135ef24425 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:50:39.891446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Attempting to bind port b47d1b3a-6216-4b25-b70b-23135ef24425 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:50:39.896268 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 50, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:50:39.896609 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:50:39.896996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:50:39.897426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Bound port: b47d1b3a-6216-4b25-b70b-23135ef24425, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:50:39.897797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:39.963339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:50:39.967170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:50:40.054114 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:40.087129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.087751 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:40.090031 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] 10.222.0.54 "PUT /v2.0/ports/b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1093 time: 0.9190755 Dec 21 04:50:40.117794 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56be84b9-19ff-417d-b17b-28547aba6163 service neutron] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:50:40.172720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-fd46a71f-9457-4515-b8d2-e32bb53019e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.174255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-fd46a71f-9457-4515-b8d2-e32bb53019e4 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0486021 Dec 21 04:50:40.268271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-92ff7d22-f08b-4438-b80c-f031f30a9faa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.269828 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-92ff7d22-f08b-4438-b80c-f031f30a9faa service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0882542 Dec 21 04:50:40.340665 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-87a69abb-9d4a-47f7-9569-f350a2bb7ff5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 999 time: 0.0634058 Dec 21 04:50:40.411594 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-861a94e7-9b39-405f-b7e8-deb7574506bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.413011 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-861a94e7-9b39-405f-b7e8-deb7574506bf service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0445292 Dec 21 04:50:40.458144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-451a3174-fa8f-4ae6-bc09-820aba4ae647 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.459641 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-451a3174-fa8f-4ae6-bc09-820aba4ae647 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0393038 Dec 21 04:50:40.557231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-f91cffa7-af76-48c1-b2b7-b21d246111ee service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878215 Dec 21 04:50:40.605372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654de3d6-989c-4fc0-bb83-c63191351175 req-809d6e12-bad0-4df8-bf6c-c30e5938194e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.606867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-654de3d6-989c-4fc0-bb83-c63191351175 req-809d6e12-bad0-4df8-bf6c-c30e5938194e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.0484662 Dec 21 04:50:40.648370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1955b72f-f26f-4ac3-872a-4b158f991469 req-19bd20f2-d02c-4e17-b894-8c60c891eae1 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834415 Dec 21 04:50:40.655478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-654de3d6-989c-4fc0-bb83-c63191351175 req-15e9582e-9f83-4fa5-81d7-ddab437f9355 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422940 Dec 21 04:50:40.864280 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-72fc5024-f9f2-44d7-ba9b-01e8b603c6a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.865765 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-72fc5024-f9f2-44d7-ba9b-01e8b603c6a0 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0449233 Dec 21 04:50:40.969145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-cffccc40-6130-4863-b4d9-00b4543e1adf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:40.970614 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-cffccc40-6130-4863-b4d9-00b4543e1adf service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0851591 Dec 21 04:50:41.039534 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-3174d03b-093c-4f1b-964e-3228305143e5 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 999 time: 0.0621562 Dec 21 04:50:41.100315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-dfb5c745-5a30-4989-be2f-30c2f1c3baa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.101736 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-dfb5c745-5a30-4989-be2f-30c2f1c3baa7 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0426674 Dec 21 04:50:41.147984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-975dde9b-55ac-4141-957b-1e4837a0619a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.149423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-975dde9b-55ac-4141-957b-1e4837a0619a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0392706 Dec 21 04:50:41.243538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-7466bf0b-c38d-4663-85f5-e863dad6e40d service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860705 Dec 21 04:50:41.334314 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-82df2f12-4a3d-42df-b172-df96703de1d3 req-8c516f1e-e337-4502-af7d-7bc6d16490ae service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828295 Dec 21 04:50:41.572344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:50:41.574712 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aca5cfe3-8808-42c2-8005-88e2227bd42e" -d '{"events": [{"name": "network-changed", "server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:50:41.628306 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:50:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-569710e6-2963-40ad-9fd7-72113bd1388f x-openstack-request-id: req-569710e6-2963-40ad-9fd7-72113bd1388f {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:50:41.628306 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:50:41.628306 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-569710e6-2963-40ad-9fd7-72113bd1388f {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:50:41.628306 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'status': 'completed', 'code': 200} Dec 21 04:50:41.710922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-0dc03e1d-6c0e-4d80-b170-bf8e7b339d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.712481 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-0dc03e1d-6c0e-4d80-b170-bf8e7b339d49 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0472598 Dec 21 04:50:41.732535 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-f99693ba-a6c6-4bf1-8508-31f9053c762d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.734043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-f99693ba-a6c6-4bf1-8508-31f9053c762d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0471659 Dec 21 04:50:41.805676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-74232f63-a634-41f0-9a5b-bb14d7370468 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.807170 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-74232f63-a634-41f0-9a5b-bb14d7370468 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0864792 Dec 21 04:50:41.835253 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2898c5f-da0a-43ef-a2f7-6640c65b6859 req-35eb9404-0b7f-42c8-9107-1654a387f0ef tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.836781 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2898c5f-da0a-43ef-a2f7-6640c65b6859 req-35eb9404-0b7f-42c8-9107-1654a387f0ef tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.1091335 Dec 21 04:50:41.877686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-f46c0e3a-e905-49b8-9aa2-786325739874 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.879174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-f46c0e3a-e905-49b8-9aa2-786325739874 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.1219194 Dec 21 04:50:41.880928 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-3fc81fe3-0f0a-4dfd-b2a4-f152551c282c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 999 time: 0.0636559 Dec 21 04:50:41.906907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2898c5f-da0a-43ef-a2f7-6640c65b6859 req-ab44e854-e5fc-4925-b24f-7dc36aba3351 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0638614 Dec 21 04:50:41.932101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-8d4fea7a-a669-42e6-9d71-431bbef29c34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.934260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-8d4fea7a-a669-42e6-9d71-431bbef29c34 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0455265 Dec 21 04:50:41.960898 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-9b8ca8ce-9365-4f23-91be-bd8f6290da9c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 999 time: 0.0677409 Dec 21 04:50:41.982310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-8a433175-e683-4a78-be39-c8f2d393d030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:41.983882 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-8a433175-e683-4a78-be39-c8f2d393d030 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0419078 Dec 21 04:50:42.013506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-2168b046-5c9c-497a-88e1-9d7e6575c276 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:42.015086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-2168b046-5c9c-497a-88e1-9d7e6575c276 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0432963 Dec 21 04:50:42.064868 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-ac56bdcd-c9c8-45ca-88df-3a1105126f25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:42.066357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-ac56bdcd-c9c8-45ca-88df-3a1105126f25 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0429754 Dec 21 04:50:42.080053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-e189f557-1f50-460f-932c-28e5283f7f9c service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874202 Dec 21 04:50:42.163933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-9669af45-58ee-4f29-8eeb-7a1d883c8b04 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855641 Dec 21 04:50:42.172390 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-8dd77a71-32c1-4e61-8fe5-ad8232ce48c3 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842600 Dec 21 04:50:42.263325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aca5cfe3-8808-42c2-8005-88e2227bd42e req-004b7688-6927-42ba-b361-ed7a79735769 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875192 Dec 21 04:50:42.513659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:50:42.550981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port b47d1b3a-6216-4b25-b70b-23135ef24425 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:50:42.551368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:50:43.023205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1df779-0478-4aeb-b0a2-5e66b787b27e req-4a06298a-ebf2-4d18-b812-cbcb800c66f2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:43.024653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c1df779-0478-4aeb-b0a2-5e66b787b27e req-4a06298a-ebf2-4d18-b812-cbcb800c66f2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.0476539 Dec 21 04:50:43.070121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c1df779-0478-4aeb-b0a2-5e66b787b27e req-1000a210-9f8e-4a5b-8195-8e0734e1c640 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390799 Dec 21 04:50:43.422991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4bce05-360b-4b1f-a3b6-da86ac2367f9 req-0ab0d858-5461-49e3-8211-7c6299e9c066 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:43.424635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca4bce05-360b-4b1f-a3b6-da86ac2367f9 req-0ab0d858-5461-49e3-8211-7c6299e9c066 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 944 time: 0.0531116 Dec 21 04:50:43.484279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca4bce05-360b-4b1f-a3b6-da86ac2367f9 req-b86995f2-3c81-46b4-8c63-742a2fd81edc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517521 Dec 21 04:50:43.522064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-507bde19-253a-4118-bffd-c1f275a43b61 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:43.523662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-507bde19-253a-4118-bffd-c1f275a43b61 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060&tenant_id=684628052e674280965f258699338238&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 944 time: 0.0549724 Dec 21 04:50:43.591044 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-8e958e58-29f3-4a4a-b616-3042f8e78462 service neutron] delete failed (client error): The resource could not be found. Dec 21 04:50:43.591044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-8e958e58-29f3-4a4a-b616-3042f8e78462 service neutron] 10.222.0.31 "DELETE /v2.0/ports/b47d1b3a-6216-4b25-b70b-23135ef24425/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0523803 Dec 21 04:50:43.701489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-3d84b57b-3b9d-4091-86ee-cf13296dfd76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:43.702989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-3d84b57b-3b9d-4091-86ee-cf13296dfd76 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1096 time: 0.0406065 Dec 21 04:50:43.716149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:50:43.815077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:50:43.826749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'mac_address': 'fa:16:3e:38:56:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:50:43.866234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:43.880235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b47d1b3a-6216-4b25-b70b-23135ef24425 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:50:43.900151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:50:43.956386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:44.005309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:50:44.012651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.013002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.013348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.013689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.014023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.014355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.014680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.015030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.015353 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.015673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.016001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.016493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.016818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:50:44.140674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-98e9715d-3c6e-4439-8043-df99c220f07a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:44.142063 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-98e9715d-3c6e-4439-8043-df99c220f07a service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.4282422 Dec 21 04:50:44.215421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-64ea49ab-c6c0-471c-8f12-06d1777a909e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1000 time: 0.0615976 Dec 21 04:50:44.228934 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['b47d1b3a-6216-4b25-b70b-23135ef24425'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:50:44.269916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-10f226bb-dab1-4212-aa44-61d56e69a2e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:44.271568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-10f226bb-dab1-4212-aa44-61d56e69a2e8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0442708 Dec 21 04:50:44.320661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-85d6da5c-755f-40d7-9b76-11049cda5402 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:44.322165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-85d6da5c-755f-40d7-9b76-11049cda5402 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0395622 Dec 21 04:50:44.418299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-402738c3-b77b-4ec3-87f9-3c353f962c05 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845966 Dec 21 04:50:44.513900 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db97ecd6-9afb-4d94-b4a4-e2b844a536ec req-37ea7938-7be8-4892-ad23-43428625307b service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843976 Dec 21 04:50:44.607359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57050d1a-cf8c-4930-be8f-a75be1531246 req-f04a4c71-c29c-47f6-b766-50549a15a797 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:44.608850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57050d1a-cf8c-4930-be8f-a75be1531246 req-f04a4c71-c29c-47f6-b766-50549a15a797 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 945 time: 0.0501647 Dec 21 04:50:44.662054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-57050d1a-cf8c-4930-be8f-a75be1531246 req-8b99cc54-0717-4569-bf3b-c05f172c0e39 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456617 Dec 21 04:50:45.732237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:50:45.781478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856616f3-61ad-48fd-ab1e-fa6b578fbd3c req-ab019a93-e23d-478c-b9b9-cc6c0f013878 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:45.783002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856616f3-61ad-48fd-ab1e-fa6b578fbd3c req-ab019a93-e23d-478c-b9b9-cc6c0f013878 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 945 time: 0.0489416 Dec 21 04:50:45.831914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856616f3-61ad-48fd-ab1e-fa6b578fbd3c req-a730fa4a-42da-4ed8-96a6-a694fffe60f1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417571 Dec 21 04:50:45.859745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port b47d1b3a-6216-4b25-b70b-23135ef24425 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:50:45.863889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port b47d1b3a-6216-4b25-b70b-23135ef24425 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:50:45.864373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:45.947345 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:45.949270 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dac5f30-f700-4c16-b899-62bbb670caa2 req-cce1f9f3-973b-48be-b4b0-e8ec299f9d9a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:45.950839 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dac5f30-f700-4c16-b899-62bbb670caa2 req-cce1f9f3-973b-48be-b4b0-e8ec299f9d9a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 945 time: 0.0509205 Dec 21 04:50:45.969932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:50:45.972149 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af9a3187-a314-4a62-9426-2eddf9e0c0e7" -d '{"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-plugged", "status": "completed", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:50:45.985294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:50:45.999603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dac5f30-f700-4c16-b899-62bbb670caa2 req-78def9c2-8fc2-457e-bf6f-a864cdb16b89 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425003 Dec 21 04:50:46.010996 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:50:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f462bea4-2ab7-4dff-aabc-f7fe00cf3af6 x-openstack-request-id: req-f462bea4-2ab7-4dff-aabc-f7fe00cf3af6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:50:46.011330 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-plugged", "status": "completed", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:50:46.011648 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f462bea4-2ab7-4dff-aabc-f7fe00cf3af6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:50:46.012046 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'code': 200} Dec 21 04:50:46.059755 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:46.106508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:50:46.313076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4eecdf8-9143-4360-a7d2-a61290a9c856 req-3cd1de50-f29c-456c-9e97-01f830621b4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:46.314722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4eecdf8-9143-4360-a7d2-a61290a9c856 req-3cd1de50-f29c-456c-9e97-01f830621b4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0559859 Dec 21 04:50:46.361800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a4eecdf8-9143-4360-a7d2-a61290a9c856 req-57b9fc7d-9456-47e1-873a-ee783ec65cdb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410600 Dec 21 04:50:46.421105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-566bb587-6480-47e9-a436-efc2980bff58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:46.422567 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-566bb587-6480-47e9-a436-efc2980bff58 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 1098 time: 0.0441697 Dec 21 04:50:46.515446 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-d2d63bea-534b-4c61-b35f-9f18f433c0b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:46.516919 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-d2d63bea-534b-4c61-b35f-9f18f433c0b3 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0873299 Dec 21 04:50:46.586705 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-b03fc6d2-1d9f-48aa-9f8f-bcf83edd02fb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 200 len: 1001 time: 0.0620143 Dec 21 04:50:46.637294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-f43644d4-3cd9-4152-990d-b36fc4080711 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:46.638692 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-f43644d4-3cd9-4152-990d-b36fc4080711 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0442753 Dec 21 04:50:46.684190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-4711fd7b-937d-4c0f-9b06-24300f88fe5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:46.685685 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-4711fd7b-937d-4c0f-9b06-24300f88fe5a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0397081 Dec 21 04:50:46.776945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-4ab31b21-dfbc-43ee-aa6a-a6865cb528ad service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833766 Dec 21 04:50:46.865679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-4a71d598-d3b6-48b0-ae59-061d64b383e9 req-a7b0dddc-9bc9-412c-a3cb-046c78f164e2 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811913 Dec 21 04:50:47.484275 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579905a9-2efe-45ad-bbeb-80fd3fca383c req-e870a5d5-5f85-4386-b852-e109133fb969 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:47.485827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-579905a9-2efe-45ad-bbeb-80fd3fca383c req-e870a5d5-5f85-4386-b852-e109133fb969 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0486500 Dec 21 04:50:47.533330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-579905a9-2efe-45ad-bbeb-80fd3fca383c req-ebd1d380-4597-4d3e-b6b4-d0ae45772ed6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415168 Dec 21 04:50:48.661818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9ebdae-1f38-4558-b509-118f500a03b6 req-52aa82de-13d5-41d3-b8f9-85d3edb2445e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:48.663383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a9ebdae-1f38-4558-b509-118f500a03b6 req-52aa82de-13d5-41d3-b8f9-85d3edb2445e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0561247 Dec 21 04:50:48.710147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a9ebdae-1f38-4558-b509-118f500a03b6 req-fa1de85b-afc4-4d99-a66e-2a97ca8c8e18 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404029 Dec 21 04:50:49.189489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ce3083-1382-4734-8e80-04e1d778966a req-04f8908e-81b3-4e78-9a4a-7ecbccd15bc1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:49.191037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1ce3083-1382-4734-8e80-04e1d778966a req-04f8908e-81b3-4e78-9a4a-7ecbccd15bc1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0481701 Dec 21 04:50:49.239748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1ce3083-1382-4734-8e80-04e1d778966a req-a8cd8c0e-d222-41c3-89df-c25e792d94f3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427535 Dec 21 04:50:49.897710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41b2c400-1f49-4eab-aea3-54b1f0a79b60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:50.358657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8579b926-bc22-46af-a320-f7884720c0e1 req-6a9dc5d2-b8d2-4464-97a8-c2257ce54e2d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:50.360157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8579b926-bc22-46af-a320-f7884720c0e1 req-6a9dc5d2-b8d2-4464-97a8-c2257ce54e2d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0485220 Dec 21 04:50:50.409581 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8579b926-bc22-46af-a320-f7884720c0e1 req-d7caa746-7ea2-41d8-8e1b-812240681f9d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436924 Dec 21 04:50:50.598047 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-7d34ec8c-b77a-411f-bcd4-49c6260d6a0d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:50.598047 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-7d34ec8c-b77a-411f-bcd4-49c6260d6a0d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 946 time: 0.0523984 Dec 21 04:50:50.680950 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Deleting port b47d1b3a-6216-4b25-b70b-23135ef24425 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:50:50.681286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:50.770264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] For port b47d1b3a-6216-4b25-b70b-23135ef24425, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=b47d1b3a-6216-4b25-b70b-23135ef24425,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:50:50.770625 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:51.250840 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:51.251223 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:51.251546 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 disassociated. External IP: 172.25.5.55, port: b47d1b3a-6216-4b25-b70b-23135ef24425. Dec 21 04:50:51.251892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Calling delete_port for b47d1b3a-6216-4b25-b70b-23135ef24425 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:50:51.413644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:51.442880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event deleted for resources: {'Port': ['ID=b47d1b3a-6216-4b25-b70b-23135ef24425,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:50:51.513246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fec1eb16-3744-45cf-a708-4d79fd9534c2 req-a938a6b0-3630-42de-883a-2091cf903e88 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=7634e33d-d1f0-4357-8f89-b4e2cebca060 HTTP/1.1" status: 200 len: 210 time: 0.0284564 Dec 21 04:50:51.573987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:50:51.684723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:50:51.694575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:50:51.707820 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:50:51.708433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:50:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:50:51.724179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] No DVR routers for this DVR port b47d1b3a-6216-4b25-b70b-23135ef24425 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:50:51.726825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:51.730333 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-73ed4d5e-e496-499e-bf67-f5f020c701a7 req-136d855a-734b-4f60-8e80-6aca78c3b233 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "DELETE /v2.0/ports/b47d1b3a-6216-4b25-b70b-23135ef24425 HTTP/1.1" status: 204 len: 173 time: 1.1309886 Dec 21 04:50:51.730777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-deleted', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:50:51.733048 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00946c11-baf3-4ed0-bd89-18c470647a06" -d '{"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-deleted", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:50:51.771718 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:50:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3c49f5f-8e08-40c3-ad8b-1ea6e477a37c x-openstack-request-id: req-d3c49f5f-8e08-40c3-ad8b-1ea6e477a37c {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:50:51.772010 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7634e33d-d1f0-4357-8f89-b4e2cebca060", "name": "network-vif-deleted", "tag": "b47d1b3a-6216-4b25-b70b-23135ef24425", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:50:51.772264 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d3c49f5f-8e08-40c3-ad8b-1ea6e477a37c {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:50:51.772804 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7634e33d-d1f0-4357-8f89-b4e2cebca060', 'name': 'network-vif-deleted', 'tag': 'b47d1b3a-6216-4b25-b70b-23135ef24425', 'status': 'completed', 'code': 200} Dec 21 04:50:51.819302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:50:52.021910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:50:52.048984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:50:52.057622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:50:52.058235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:50:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:50:52.164337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:50:52.358449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:50:52.386808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d46413d6-0e58-4c1b-a88c-4920f88f74e2 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:50:52.634671 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08eceb71-1864-49d6-907e-c4f25b1f92ff None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:50:52.716296 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d347b623-2d58-402a-8bd5-e19673b4466d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:52.809558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-211d85a4-5b72-43e1-bc89-28b5f9e57928 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--386554186&fields=id&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 267 time: 0.0422146 Dec 21 04:50:52.921939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e95755c7-6416-4ea0-8167-767f2f67f4a1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:52.923444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e95755c7-6416-4ea0-8167-767f2f67f4a1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.1052668 Dec 21 04:50:52.938752 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-c24a1911-3392-4863-ac62-44c8d02e866e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/quotas/684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 375 time: 0.0095208 Dec 21 04:50:52.988085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-5a5135dd-8076-4351-b79c-8452bd3fbf0e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0442195 Dec 21 04:50:53.081114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-30c61101-8dd2-4626-b51f-7d369fd79d54 service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807266 Dec 21 04:50:53.172524 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-fbd16dd6-c9b4-449a-aaad-b15537c6628c service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852633 Dec 21 04:50:53.399289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e965aa53-814a-41db-ab66-7d9386a07a56 req-23e71952-75bd-409f-8593-79ca00197af4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0264058 Dec 21 04:50:53.414192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:53.476075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:53.772738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:50:53.792792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: b47d1b3a-6216-4b25-b70b-23135ef24425 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:50:53.793144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device b47d1b3a-6216-4b25-b70b-23135ef24425 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:50:54.478313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bfa1f2fa-3f3d-4565-a308-9918b2a12616 req-ca1ca498-9e89-4290-b8e5-c7d7a6e9f442 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0259879 Dec 21 04:50:55.293614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:55.371975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:55.559512 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a97ac88-1f23-4c03-a8f4-be8ca3acd461 req-98aff9d3-0e63-47ad-8658-658b1f4fa33d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0269911 Dec 21 04:50:55.811786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:56.640277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f0d33128-46ea-4224-aed9-1d1aa68a69e3 req-60d605dc-3545-4df9-876b-d7fcfb1bb786 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0307641 Dec 21 04:50:56.871360 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:50:57.735607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c90d7340-59b1-4e01-8210-c25f269fe6a1 req-f0e81e28-ac42-459c-800c-086abe7f5588 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0269825 Dec 21 04:50:58.836558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b02dda2-f0f0-4dc1-83b2-e25f2326d533 req-ac857534-a798-4be2-97d6-3ab88f88d1d2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0258808 Dec 21 04:50:59.485313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-1df20776-e587-46cb-bb38-f7084e5eb379 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:50:59.486833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-1df20776-e587-46cb-bb38-f7084e5eb379 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.0998883 Dec 21 04:50:59.559553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-c3c4bc21-cb8a-4f24-9822-c9b0715d684e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 379 time: 0.0561361 Dec 21 04:50:59.573328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'port': {'device_id': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'admin_state_up': True, 'tenant_id': '684628052e674280965f258699338238', 'security_groups': ['f316a23c-9c52-424d-a1e8-aa67bc3eba50']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:50:59.790768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Made reservation on behalf of 684628052e674280965f258699338238 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:50:59.812532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:50:59.943374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1f4ef16-a56d-4a2a-8b2c-f9713b3749b0 req-5f427049-5ac4-48c2-890c-84776a7a19e1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0340862 Dec 21 04:50:59.949503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Allocated IP 172.20.0.9 (fc0ae40f-7660-4c02-8692-f49eb5531fe8/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5/8b319c1c-d3f8-4870-a7ed-ee0127062932) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:51:00.091621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.168665 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.210619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:51:00.214530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:51:00.218062 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.277022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:51:00.282503 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:51:00.286185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:00.286185 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.336553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-9994b089-9044-463c-bf21-e720f6726300 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7673526 Dec 21 04:51:00.363330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Request body: {'port': {'device_id': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:51:00.421822 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.449216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-507cd07a-8f0a-42f7-aa8e-08c0da27ee07 None None] Provisioning complete for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:51:00.449805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-507cd07a-8f0a-42f7-aa8e-08c0da27ee07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.482639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-507cd07a-8f0a-42f7-aa8e-08c0da27ee07 None None] Port 8b319c1c-d3f8-4870-a7ed-ee0127062932 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:51:00.679471 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8b319c1c-d3f8-4870-a7ed-ee0127062932 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:51:00.686745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.698951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Transition to ACTIVE for port object 8b319c1c-d3f8-4870-a7ed-ee0127062932 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:51:00.762075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.834332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:51:00.887591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:51:00.887846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:51:00.888185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:51:00.892905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:51:00.893233 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:51:00.898299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 50, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:51:00.898645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:51:00.899068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:51:00.899501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Bound port: 8b319c1c-d3f8-4870-a7ed-ee0127062932, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:51:00.899860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:00.965484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:51:00.968519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:51:01.023789 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:01.057629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.058449 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:01.059881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] 10.222.0.31 "PUT /v2.0/ports/8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1092 time: 0.7010179 Dec 21 04:51:01.060328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:51:01.062564 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2b6d334-b13f-4a72-9571-a70b7aeabc08" -d '{"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:51:01.115405 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:51:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b553c73c-5fc2-4b8a-86f4-4fbe8bafb5f9 x-openstack-request-id: req-b553c73c-5fc2-4b8a-86f4-4fbe8bafb5f9 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:51:01.122022 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:51:01.122022 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b553c73c-5fc2-4b8a-86f4-4fbe8bafb5f9 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:51:01.122022 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'status': 'completed', 'code': 200} Dec 21 04:51:01.122665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a6d1c3-d628-4357-80b1-0850d52d78a0 service neutron] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:51:01.142336 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8e0c21-d429-497a-93b7-4d3be9ccd1e2 req-502e0506-0636-4000-b708-a2341a30c066 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.144199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e0c21-d429-497a-93b7-4d3be9ccd1e2 req-502e0506-0636-4000-b708-a2341a30c066 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0787325 Dec 21 04:51:01.223620 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca8e0c21-d429-497a-93b7-4d3be9ccd1e2 req-95d3f1e6-8cdf-4cd2-96e7-ca592045ccfb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0732009 Dec 21 04:51:01.228259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b6d334-b13f-4a72-9571-a70b7aeabc08 req-cfe8fee0-c8b2-4267-b241-f2cd844a1571 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.229761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2b6d334-b13f-4a72-9571-a70b7aeabc08 req-cfe8fee0-c8b2-4267-b241-f2cd844a1571 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1095 time: 0.0714111 Dec 21 04:51:01.342209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b6d334-b13f-4a72-9571-a70b7aeabc08 req-54e1efaf-17e4-4f1a-b9bc-033a3163883d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.343802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2b6d334-b13f-4a72-9571-a70b7aeabc08 req-54e1efaf-17e4-4f1a-b9bc-033a3163883d service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=684628052e674280965f258699338238&shared=False HTTP/1.1" status: 200 len: 912 time: 0.0973403 Dec 21 04:51:01.438404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b6d334-b13f-4a72-9571-a70b7aeabc08 req-75fbc0a9-aaf8-4e8b-ba46-12d2daf30092 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.439892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2b6d334-b13f-4a72-9571-a70b7aeabc08 req-75fbc0a9-aaf8-4e8b-ba46-12d2daf30092 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0849829 Dec 21 04:51:01.551717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-c2b0f1fa-8123-4bc4-9bdb-d3ea20b00ab4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.553188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-c2b0f1fa-8123-4bc4-9bdb-d3ea20b00ab4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1095 time: 0.0440192 Dec 21 04:51:01.606745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-51c1dd1f-8b29-4926-a475-1374db83a655 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 217 time: 0.0343707 Dec 21 04:51:01.656126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-662fa9ec-4075-4a00-8c34-4ccaf77561fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.657545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-662fa9ec-4075-4a00-8c34-4ccaf77561fc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0435205 Dec 21 04:51:01.711416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf638962-9274-4c5f-85ee-85f612ce862d req-af3d77dd-9621-43c9-95eb-06ed1fa86f1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:01.712780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-af3d77dd-9621-43c9-95eb-06ed1fa86f1a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0425537 Dec 21 04:51:01.804935 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-00a34c27-e30c-4288-ad7b-68cef4ade3cf service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795727 Dec 21 04:51:01.900359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf638962-9274-4c5f-85ee-85f612ce862d req-cea910f4-151f-4935-839f-e0b406a5db81 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843842 Dec 21 04:51:02.338133 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7994d416-820b-4df0-ad78-e86e99940368 req-48d5a46f-2e3b-485b-bcd9-cd5d3ec572d2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:02.340380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7994d416-820b-4df0-ad78-e86e99940368 req-48d5a46f-2e3b-485b-bcd9-cd5d3ec572d2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0488658 Dec 21 04:51:02.385799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7994d416-820b-4df0-ad78-e86e99940368 req-545ac229-b38c-462f-9925-31cd177e2324 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396519 Dec 21 04:51:03.503196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6980fbb3-1657-4461-a704-838940901f4e req-1ffa14ee-c08f-4947-aa59-b7357fcd618c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:03.504687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6980fbb3-1657-4461-a704-838940901f4e req-1ffa14ee-c08f-4947-aa59-b7357fcd618c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0521481 Dec 21 04:51:03.552046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6980fbb3-1657-4461-a704-838940901f4e req-6b0351d9-4942-4ee8-9839-57d131ad67dc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407517 Dec 21 04:51:04.638260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:51:04.671248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1fac599-6d69-43f5-98ab-d3d8152205d2 req-846e7835-a655-487b-808b-1e0e608081c1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:04.672753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1fac599-6d69-43f5-98ab-d3d8152205d2 req-846e7835-a655-487b-808b-1e0e608081c1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0527890 Dec 21 04:51:04.719489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1fac599-6d69-43f5-98ab-d3d8152205d2 req-d08ba9f4-cd17-4164-bbb1-c2357cea1092 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407321 Dec 21 04:51:04.731770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:51:04.742221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'mac_address': 'fa:16:3e:e7:3f:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:51:04.779316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:04.796079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8b319c1c-d3f8-4870-a7ed-ee0127062932 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:51:04.814480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:51:04.893455 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:04.938476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:51:05.256858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['8b319c1c-d3f8-4870-a7ed-ee0127062932'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:51:05.833845 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5dde57-3ad0-49f1-afb6-23340612d2c2 req-79daa262-5676-419d-86ce-36225fbea600 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:05.835361 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae5dde57-3ad0-49f1-afb6-23340612d2c2 req-79daa262-5676-419d-86ce-36225fbea600 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0491297 Dec 21 04:51:05.882664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae5dde57-3ad0-49f1-afb6-23340612d2c2 req-037f568c-98b2-4afd-aa7d-98ef98b58eaf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410595 Dec 21 04:51:06.643038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:51:06.748663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:51:06.752426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:51:06.752805 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:06.832883 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:06.854633 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:51:06.856904 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b69be38-f960-4095-bd4a-7a4fd55a71a8" -d '{"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-plugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:51:06.868994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:51:06.894397 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:51:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bef0576e-bfa2-45f2-97ce-bab4338fe8fd x-openstack-request-id: req-bef0576e-bfa2-45f2-97ce-bab4338fe8fd {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:51:06.894690 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-plugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:51:06.894974 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bef0576e-bfa2-45f2-97ce-bab4338fe8fd {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:51:06.895376 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'code': 200} Dec 21 04:51:06.943824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:07.002765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7772c9b9-998c-4be6-a1ce-8edd03d8f31f req-393bda12-3252-4392-b12f-4f3114b1f63e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:07.004307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7772c9b9-998c-4be6-a1ce-8edd03d8f31f req-393bda12-3252-4392-b12f-4f3114b1f63e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0541089 Dec 21 04:51:07.021446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:51:07.074879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520d7863-a0ad-4e6e-9f83-8ab82b5d9945 req-435b2879-f9a6-4552-a52a-ba1ec8cb7ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:07.076455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-520d7863-a0ad-4e6e-9f83-8ab82b5d9945 req-435b2879-f9a6-4552-a52a-ba1ec8cb7ef4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1097 time: 0.0709336 Dec 21 04:51:07.080244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7772c9b9-998c-4be6-a1ce-8edd03d8f31f req-124b307e-7828-43bf-afa5-7b7ed00c404e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669558 Dec 21 04:51:07.129207 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-520d7863-a0ad-4e6e-9f83-8ab82b5d9945 req-a46b01c8-3eb2-4587-bbdb-02486cdc6b26 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413644 Dec 21 04:51:08.194804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f41d1807-dcbf-4be2-8b2a-541a38efc58f req-0989e29f-7107-4f6e-86c6-743ff293e4cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:08.196293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f41d1807-dcbf-4be2-8b2a-541a38efc58f req-0989e29f-7107-4f6e-86c6-743ff293e4cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0478480 Dec 21 04:51:08.247303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f41d1807-dcbf-4be2-8b2a-541a38efc58f req-9d2b4ef2-c11f-47b3-87be-c23c699844cb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445259 Dec 21 04:51:09.364214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ee551-cab3-4bc6-92b6-a53f66661ddc req-abd85803-10b2-4140-bb98-00d6d1302505 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:09.365680 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-174ee551-cab3-4bc6-92b6-a53f66661ddc req-abd85803-10b2-4140-bb98-00d6d1302505 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0487428 Dec 21 04:51:09.411216 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-174ee551-cab3-4bc6-92b6-a53f66661ddc req-3d1029d1-edbf-4234-9a08-a558ee0b10d9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391018 Dec 21 04:51:09.523800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9b3e0e-9978-483d-b2aa-0a1574d422a5 req-2afbe39e-7882-456c-8022-c515b3e0473c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:09.525321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8e9b3e0e-9978-483d-b2aa-0a1574d422a5 req-2afbe39e-7882-456c-8022-c515b3e0473c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0478334 Dec 21 04:51:09.533718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49390) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:51:09.537913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'floatingip': {'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:51:09.578741 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:09.993134 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:10.041885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:10.165599 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 associated. External IP: 172.25.5.55, port: 8b319c1c-d3f8-4870-a7ed-ee0127062932. Dec 21 04:51:10.367121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:51:10.488067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:51:10.493189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:10.498159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76f031bd-64c1-4877-9436-c01854477649 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:51:10.507884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:51:10.508568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:50:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:51:10.521479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4fc5d29b-9702-44e7-8a9a-8fffe4a37643 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "PUT /v2.0/floatingips/107ec780-6cdd-4fdc-886a-90ca42f9c9c0 HTTP/1.1" status: 200 len: 990 time: 0.9867334 Dec 21 04:51:10.522064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:51:10.524323 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b7d7257-94ab-4b41-941a-edce966e9bb2" -d '{"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:51:10.561852 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:51:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8a668f4-56e7-4a20-82eb-571cbf98d9be x-openstack-request-id: req-d8a668f4-56e7-4a20-82eb-571cbf98d9be {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:51:10.562149 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:51:10.562405 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d8a668f4-56e7-4a20-82eb-571cbf98d9be {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:51:10.562876 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'status': 'completed', 'code': 200} Dec 21 04:51:10.618532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:51:10.659863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-5b264621-f296-404c-9e6a-d697ecb7cfce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:10.661480 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-5b264621-f296-404c-9e6a-d697ecb7cfce service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1097 time: 0.0408866 Dec 21 04:51:10.754835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-feeb9bac-5ac8-41de-85a1-19f62f204ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:10.757013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-feeb9bac-5ac8-41de-85a1-19f62f204ea2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0880008 Dec 21 04:51:10.822208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-a0771d49-856a-46a5-92c7-93d8010b9021 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 998 time: 0.0583639 Dec 21 04:51:10.858601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:e7:3f:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:51:09Z', 'revision_number': 9, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:51:10.875519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-fdb94801-a3b9-453e-b6e2-bc82a7318602 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:10.876930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-fdb94801-a3b9-453e-b6e2-bc82a7318602 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0481291 Dec 21 04:51:10.888367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76f031bd-64c1-4877-9436-c01854477649 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:51:10.896522 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:51:10.897122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:50:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:51:10.921878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-8f30f4dd-4162-4e80-a67a-490c018f834e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:10.923389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-8f30f4dd-4162-4e80-a67a-490c018f834e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0390205 Dec 21 04:51:11.001521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:51:11.013442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-8076aa9e-76bb-4c3a-bdee-a8cda36982e8 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812631 Dec 21 04:51:11.105760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b7d7257-94ab-4b41-941a-edce966e9bb2 req-46bba98d-cbbd-469e-a8fb-34c0a37792da service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844374 Dec 21 04:51:11.229296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-76f031bd-64c1-4877-9436-c01854477649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:e7:3f:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:51:09Z', 'revision_number': 9, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:51:11.258886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76f031bd-64c1-4877-9436-c01854477649 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:e7:3f:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:51:09Z', 'revision_number': 9, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:51:11.440559 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b201caf4-cd54-480e-89fa-89efcadc16ad None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:51:19.898703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1710a1b7-bc9f-4871-955a-0ffac52470b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:22.699044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57e6f76d-bb1a-4333-83e0-6f23898a1e51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:23.427362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:23.504846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:23.760460 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-50bcad19-edfc-4ec6-8ae8-8bfd5cf78ee6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0769448 Dec 21 04:51:23.858591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-5537518b-2e28-40bc-998b-c867adf277ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:23.860080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-5537518b-2e28-40bc-998b-c867adf277ac service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1097 time: 0.0389991 Dec 21 04:51:23.972129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-f6eca63f-0b12-4792-8eef-d07f890f6d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:23.973493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-f6eca63f-0b12-4792-8eef-d07f890f6d96 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0876029 Dec 21 04:51:24.042133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-f6915ff8-0711-4b7a-9f70-96b49e3cad69 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1001 time: 0.0586991 Dec 21 04:51:24.419835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-9cfffd4a-673a-4e52-8cb1-94b798a838d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:24.421282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-9cfffd4a-673a-4e52-8cb1-94b798a838d3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.3714616 Dec 21 04:51:24.468665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-b98835f5-2457-4cb3-8269-3a71126dfeed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:51:24.470076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-b98835f5-2457-4cb3-8269-3a71126dfeed service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0382233 Dec 21 04:51:24.560408 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-d90a8dab-6428-4beb-b777-35dd17a4ca1a service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819750 Dec 21 04:51:24.660022 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b61a97f-8bc0-44c8-a19f-269ccd120a53 req-1ecf7d0d-3a71-435d-814a-001e2bdaea7b service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875802 Dec 21 04:51:25.263264 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:25.342871 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:25.802228 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:33.870642 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:51:49.893447 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9e1980b8-df65-4e7b-8436-69e29f5ff968 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:52.765671 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a5c7396e-3ded-4a33-b3a2-ed3d76eb686b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:53.429066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:53.510239 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:55.288084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:55.393882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:51:55.828375 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:10.869613 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:52:19.922069 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5fae47f2-c923-4500-b521-3a376af029d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:22.702489 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57e83846-b249-4167-b0b6-f13eddf31444 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:23.447387 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:23.502144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:23.787078 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-219d1b36-30d8-426b-8b3b-e20464b11762 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0380490 Dec 21 04:52:23.919229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e092898-828e-47a8-82e6-66b5499296e4 req-a5e588a2-7ef3-452d-aaff-286ac83e1b52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:23.921886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-a5e588a2-7ef3-452d-aaff-286ac83e1b52 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1097 time: 0.0586751 Dec 21 04:52:24.026209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e092898-828e-47a8-82e6-66b5499296e4 req-b8cf3d68-4b1e-42cc-951d-dd26d408ddbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:24.027684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-b8cf3d68-4b1e-42cc-951d-dd26d408ddbb service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0825076 Dec 21 04:52:24.099610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-4ca9156a-951d-45b5-8c1f-4fa3cb72e002 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1001 time: 0.0604429 Dec 21 04:52:24.151269 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e092898-828e-47a8-82e6-66b5499296e4 req-35b453de-720a-4476-ba35-e38cfd75af93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:24.152652 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-35b453de-720a-4476-ba35-e38cfd75af93 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0412192 Dec 21 04:52:24.204783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e092898-828e-47a8-82e6-66b5499296e4 req-448e39f2-c42a-433a-b329-09b44b7ddfee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:24.207275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-448e39f2-c42a-433a-b329-09b44b7ddfee service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0431447 Dec 21 04:52:24.220226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-e94929ce-a711-4b61-9e38-f58c8ff68a5a service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:52:24.221160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-e94929ce-a711-4b61-9e38-f58c8ff68a5a service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056860 Dec 21 04:52:24.313385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-bfadb6c0-246b-4ea7-bf54-97403a7f4468 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844426 Dec 21 04:52:24.410317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e092898-828e-47a8-82e6-66b5499296e4 req-01c6caea-1547-4e59-b28c-a16cc8dc300d service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837622 Dec 21 04:52:25.276180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:25.373515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:25.813298 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:47.868015 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:52:49.907267 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-949b663f-dd47-429f-9410-dfebfcdcc039 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:52.009363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d39892-f3a5-4043-baf0-81f25991d027 req-e1fcd821-0469-4674-b0d9-47e4952bfb80 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:52.010847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50d39892-f3a5-4043-baf0-81f25991d027 req-e1fcd821-0469-4674-b0d9-47e4952bfb80 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0538127 Dec 21 04:52:52.058213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50d39892-f3a5-4043-baf0-81f25991d027 req-7820274d-1a70-49f4-adc3-13750fbbcabc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414100 Dec 21 04:52:52.101255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-54bd2162-e10c-4491-ab34-b9161fbf3b5e service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0445461 Dec 21 04:52:52.712919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-16165a46-ce78-4367-ad57-a5f824017969 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:53.182287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b58c41-3be7-46e8-be1a-935301e23ab2 req-021402b2-1fcd-431c-be2a-5ed58cff57b3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:53.183838 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5b58c41-3be7-46e8-be1a-935301e23ab2 req-021402b2-1fcd-431c-be2a-5ed58cff57b3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0556238 Dec 21 04:52:53.231292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5b58c41-3be7-46e8-be1a-935301e23ab2 req-21bd5a04-fbd4-4ef1-84e5-2e11464c7283 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408201 Dec 21 04:52:53.467813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:53.493480 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:54.216743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-8d6354f6-5ff3-4b31-a73e-7105fd66a4ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:54.218232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-8d6354f6-5ff3-4b31-a73e-7105fd66a4ee service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1097 time: 0.0466335 Dec 21 04:52:54.335297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-d085d17e-1185-4bba-9f3a-b0a8aa472ace service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:54.336749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-d085d17e-1185-4bba-9f3a-b0a8aa472ace service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.1071310 Dec 21 04:52:54.365620 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0fd31b7-9e98-4896-9164-17cc4e902fac req-32d9ae8c-b2c0-4c58-8175-325e8a9400b3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:54.367080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0fd31b7-9e98-4896-9164-17cc4e902fac req-32d9ae8c-b2c0-4c58-8175-325e8a9400b3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0655925 Dec 21 04:52:54.449971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-5c1b1f3b-3176-4301-b6c9-457de38f30af service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1001 time: 0.1004126 Dec 21 04:52:54.463641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a0fd31b7-9e98-4896-9164-17cc4e902fac req-14d3c265-4925-4ca2-b780-5f70a09a846d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584676 Dec 21 04:52:54.507541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-b18c654d-ac69-4fb7-a929-cdce1d0ed8f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:54.509018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-b18c654d-ac69-4fb7-a929-cdce1d0ed8f3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0445478 Dec 21 04:52:54.568877 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-dd795992-c119-481f-89b8-64fe060ba45c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:54.570584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-dd795992-c119-481f-89b8-64fe060ba45c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0502281 Dec 21 04:52:54.668723 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-4bd5ba89-b1cb-4ff6-93d1-3e376a859749 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868859 Dec 21 04:52:54.764560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-a628e183-f6db-43bc-872b-44e894a9383e service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847631 Dec 21 04:52:55.278857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:55.361945 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:55.579615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afebbed6-e709-4951-a552-c58457c31278 req-1e72c916-fafd-4ed6-9af9-9d623631cf7e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:55.580997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afebbed6-e709-4951-a552-c58457c31278 req-1e72c916-fafd-4ed6-9af9-9d623631cf7e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0488160 Dec 21 04:52:55.628205 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afebbed6-e709-4951-a552-c58457c31278 req-e53f55aa-74f4-403c-9242-51ae327cc9b1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412812 Dec 21 04:52:55.798626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:52:56.741820 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6bc122b-cacf-4775-bda1-dfc8818d9756 req-5d932660-5785-4e97-aa07-7bbe4436ac4f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:56.743328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6bc122b-cacf-4775-bda1-dfc8818d9756 req-5d932660-5785-4e97-aa07-7bbe4436ac4f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0481927 Dec 21 04:52:56.789607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b6bc122b-cacf-4775-bda1-dfc8818d9756 req-9c5a8f33-c98c-4d39-b5d9-3e1c7d11ede3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400217 Dec 21 04:52:57.911727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e8c0b5-53f9-41b9-b8fe-9e3f466bf8aa req-4e72e309-db3a-4baf-8dd6-fb6a14b184d9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:57.913075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6e8c0b5-53f9-41b9-b8fe-9e3f466bf8aa req-4e72e309-db3a-4baf-8dd6-fb6a14b184d9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0517521 Dec 21 04:52:57.960027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6e8c0b5-53f9-41b9-b8fe-9e3f466bf8aa req-39080019-4163-403f-a22a-853576abf394 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410585 Dec 21 04:52:59.134230 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f19832b-676b-440c-a346-fadc3d836a53 req-78df67a1-a924-42f8-9851-dcafed0e1d4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:52:59.135732 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f19832b-676b-440c-a346-fadc3d836a53 req-78df67a1-a924-42f8-9851-dcafed0e1d4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.1087401 Dec 21 04:52:59.182061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f19832b-676b-440c-a346-fadc3d836a53 req-13583f91-cecb-4533-bb97-8ee3318f0e51 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398540 Dec 21 04:53:00.338241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd180437-0d58-4797-9298-b62293c98b79 req-ae9a4e07-959d-473b-a951-e5fb65cd13e5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:00.339741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd180437-0d58-4797-9298-b62293c98b79 req-ae9a4e07-959d-473b-a951-e5fb65cd13e5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0901625 Dec 21 04:53:00.390123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bd180437-0d58-4797-9298-b62293c98b79 req-3ba82f07-fc40-41a4-9247-387162785af9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436609 Dec 21 04:53:01.504156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76eb0f11-d309-4ffa-8037-3c0e0d90e4f3 req-7b0a9a65-a719-4e84-99dd-c4aa81b0007d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:01.505646 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76eb0f11-d309-4ffa-8037-3c0e0d90e4f3 req-7b0a9a65-a719-4e84-99dd-c4aa81b0007d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0495439 Dec 21 04:53:01.551500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-76eb0f11-d309-4ffa-8037-3c0e0d90e4f3 req-02cb4864-c5f9-4549-b496-e52a36e52ff2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399721 Dec 21 04:53:02.667254 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ae7852-85f9-4f3d-ad96-8185fd52400b req-0f520463-c04d-4e72-8bdd-dbe6055553fe tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:02.668740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26ae7852-85f9-4f3d-ad96-8185fd52400b req-0f520463-c04d-4e72-8bdd-dbe6055553fe tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0496192 Dec 21 04:53:02.717024 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-26ae7852-85f9-4f3d-ad96-8185fd52400b req-eb262aef-e945-48d2-bb0f-2983b50c4bef tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420370 Dec 21 04:53:03.836154 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4d4b7bb-a8d3-4377-a783-10fc196bf576 req-04dd0417-bcc5-48ac-9787-231a2608ba53 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:03.837657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4d4b7bb-a8d3-4377-a783-10fc196bf576 req-04dd0417-bcc5-48ac-9787-231a2608ba53 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0520859 Dec 21 04:53:03.889461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d4d4b7bb-a8d3-4377-a783-10fc196bf576 req-61d78f61-a43a-4d24-b76d-c9259e4bc2a1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444288 Dec 21 04:53:05.007217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a2c2876-cbe2-4c8d-bb94-f56f7c89190c req-222c1aaf-8795-4827-8c12-dd7a0a57afb6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:05.008690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a2c2876-cbe2-4c8d-bb94-f56f7c89190c req-222c1aaf-8795-4827-8c12-dd7a0a57afb6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0496047 Dec 21 04:53:05.055188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2a2c2876-cbe2-4c8d-bb94-f56f7c89190c req-d4496c8b-28f6-40e6-92c1-efb2d8305be7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403152 Dec 21 04:53:06.174146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73117da-383d-4377-8d55-19dc61601000 req-db949ded-04bc-4e29-b0ce-64ee2130230f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:06.175674 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f73117da-383d-4377-8d55-19dc61601000 req-db949ded-04bc-4e29-b0ce-64ee2130230f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0524130 Dec 21 04:53:06.222642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f73117da-383d-4377-8d55-19dc61601000 req-c90652a9-56e2-4c0e-b9e3-957ec4d0c575 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411274 Dec 21 04:53:07.331755 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-404e3390-b66f-4aaf-b255-284efa33af3f service neutron] show failed (client error): The resource could not be found. Dec 21 04:53:07.332765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-404e3390-b66f-4aaf-b255-284efa33af3f service neutron] 10.222.0.31 "GET /v2.0/ports/8b319c1c-d3f8-4870-a7ed-ee0127062932/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0778298 Dec 21 04:53:07.351702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98504d18-b8f7-429a-9995-9c9eb1a9d9a0 req-c5a343ee-ea36-418c-840a-771f096962bd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:07.353162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98504d18-b8f7-429a-9995-9c9eb1a9d9a0 req-c5a343ee-ea36-418c-840a-771f096962bd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0624998 Dec 21 04:53:07.401436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98504d18-b8f7-429a-9995-9c9eb1a9d9a0 req-26122d30-40e2-4ee1-bbc0-41cf2ab6d5be tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415134 Dec 21 04:53:07.892023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-0f4e5680-5d4a-444f-af07-af65e54f5020 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:07.893432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-0f4e5680-5d4a-444f-af07-af65e54f5020 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 1097 time: 0.0543690 Dec 21 04:53:07.912256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:53:07.963848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:08.164779 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:08.200714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:53:08.244674 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:08.252597 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7d811d6-629a-482e-b3ba-1c987d17356a" -d '{"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-unplugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:08.252597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:08.263411 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Transition to ACTIVE for port object 8b319c1c-d3f8-4870-a7ed-ee0127062932 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:53:08.295519 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebfe2e66-137d-4811-8dc7-82919f9ed251 x-openstack-request-id: req-ebfe2e66-137d-4811-8dc7-82919f9ed251 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:08.295815 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-unplugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:08.296077 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ebfe2e66-137d-4811-8dc7-82919f9ed251 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:08.296486 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'code': 200} Dec 21 04:53:08.333013 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:08.420985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:08.435168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.435628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.435973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.436310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.436647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.436960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.437406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.437670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.437934 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.438322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.438540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.438880 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.439207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:08.475076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] No DVR routers for this DVR port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:53:08.531576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286a5e5e-b865-4abe-9220-0d5f492a9987 req-63a8bb41-efaf-4549-a95b-3e5a2b09d973 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:08.533142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-286a5e5e-b865-4abe-9220-0d5f492a9987 req-63a8bb41-efaf-4549-a95b-3e5a2b09d973 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0597546 Dec 21 04:53:08.587595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-286a5e5e-b865-4abe-9220-0d5f492a9987 req-e037c812-6c5a-401d-81c9-12f3cef392fb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433092 Dec 21 04:53:08.619894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:53:08.620228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:53:08.620551 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:53:08.625379 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:53:08.625711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:53:08.630462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 52, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:53:08.630740 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:53:08.631159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:53:08.631573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Bound port: 8b319c1c-d3f8-4870-a7ed-ee0127062932, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:53:08.631918 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:08.692757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:53:08.695631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:53:08.785099 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:08.820687 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:08.821299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:08.822654 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] 10.222.0.54 "PUT /v2.0/ports/8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1092 time: 0.9144301 Dec 21 04:53:08.842556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30afb4ee-54d2-4170-8dd2-612be77cf589 service neutron] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:08.907872 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-302bc627-2674-42f4-82ec-05358e2c72bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:08.909412 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-302bc627-2674-42f4-82ec-05358e2c72bb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1095 time: 0.0468485 Dec 21 04:53:09.009154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-a1ecd49a-bdb3-469d-b92d-94713ed8eb43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:09.010924 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-a1ecd49a-bdb3-469d-b92d-94713ed8eb43 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0937614 Dec 21 04:53:09.081005 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-e01918c1-be29-4cba-bbe8-6a787c5a9c10 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 999 time: 0.0627792 Dec 21 04:53:09.130151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-f6900176-2673-4a33-b290-c8340d7547ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:09.131602 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-f6900176-2673-4a33-b290-c8340d7547ce service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0438082 Dec 21 04:53:09.176214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-6c58b4a9-693e-4a94-9b3f-4c50a5f0eba5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:09.177693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-6c58b4a9-693e-4a94-9b3f-4c50a5f0eba5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0385368 Dec 21 04:53:09.267941 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-17878309-fa48-484f-8ddf-9eca1753c167 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832410 Dec 21 04:53:09.355160 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e163b446-0b5a-44b1-93ce-51a55dad7283 req-79509710-c68a-4bd9-9f73-53e68118aee1 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806878 Dec 21 04:53:09.705542 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54647253-9dab-4848-adb4-1c9300e0f5c6 req-476743f5-9fe3-4b6f-88c8-74e785efc319 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:09.707091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54647253-9dab-4848-adb4-1c9300e0f5c6 req-476743f5-9fe3-4b6f-88c8-74e785efc319 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0498273 Dec 21 04:53:09.753878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54647253-9dab-4848-adb4-1c9300e0f5c6 req-9de0ec8b-34a9-43ef-8dba-e8f792f8b410 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408890 Dec 21 04:53:10.297705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:10.300098 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85a2a46e-8400-4101-8694-bddf7771c7e3" -d '{"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:10.347702 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0c20530-6f56-4ebf-b3c7-5ac52efb993b x-openstack-request-id: req-d0c20530-6f56-4ebf-b3c7-5ac52efb993b {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:10.348020 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:10.348282 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-d0c20530-6f56-4ebf-b3c7-5ac52efb993b {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:10.348692 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'status': 'completed', 'code': 200} Dec 21 04:53:10.440799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-51e30fe4-7cf4-4afc-843d-37d61bba9147 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.442306 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-51e30fe4-7cf4-4afc-843d-37d61bba9147 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1095 time: 0.0454164 Dec 21 04:53:10.455524 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-d3533103-67c4-42b1-9358-53ca0d2918d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.456996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-d3533103-67c4-42b1-9358-53ca0d2918d0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1095 time: 0.0404282 Dec 21 04:53:10.537264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-eb883cc2-e764-4ea4-9975-76319a32fdb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.538859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-eb883cc2-e764-4ea4-9975-76319a32fdb0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0889854 Dec 21 04:53:10.561670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-efccad72-990f-44f5-a9de-8638810f7a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.563114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-efccad72-990f-44f5-a9de-8638810f7a8c service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0953555 Dec 21 04:53:10.611735 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-cf096abd-8869-490a-ba2a-c015ed95908f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 999 time: 0.0630684 Dec 21 04:53:10.639276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-a57de0f0-52c7-464b-961d-530f2554f108 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 999 time: 0.0636628 Dec 21 04:53:10.662513 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-4cffc1b3-599b-450f-bf9f-5b53abc7eae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.663999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-4cffc1b3-599b-450f-bf9f-5b53abc7eae6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0444145 Dec 21 04:53:10.691922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-f806f6a2-0b9e-4a04-90b7-bec20dcaa124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.693429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-f806f6a2-0b9e-4a04-90b7-bec20dcaa124 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0445015 Dec 21 04:53:10.710294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-2c34c37e-6871-433d-be40-19ebd2539363 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.711885 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-2c34c37e-6871-433d-be40-19ebd2539363 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0393388 Dec 21 04:53:10.742874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-b61d8c9a-29e1-4ea4-b599-9b4b800a7c13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.744548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-b61d8c9a-29e1-4ea4-b599-9b4b800a7c13 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0399585 Dec 21 04:53:10.811250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-7427da63-79ba-41a2-b203-58c7ca8fbd18 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880797 Dec 21 04:53:10.871578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-fe918a1e-4492-4be6-9a04-9899e124c3ec service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1159172 Dec 21 04:53:10.885499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ddd1ec6-ab13-4a9a-a200-e308fc1e361c req-fd2ad7a2-0a46-44e2-9850-37de77f20fb1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:10.886976 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ddd1ec6-ab13-4a9a-a200-e308fc1e361c req-fd2ad7a2-0a46-44e2-9850-37de77f20fb1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0621119 Dec 21 04:53:10.902538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-84748ba2-9e9b-473c-b800-ee33be1b0447 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842564 Dec 21 04:53:10.993147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ddd1ec6-ab13-4a9a-a200-e308fc1e361c req-6213e95f-5a0e-4f45-bc51-c102ea11acfc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0973151 Dec 21 04:53:11.010513 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a2a46e-8400-4101-8694-bddf7771c7e3 req-85c7709b-384f-448e-a31f-0974ded94ebb service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1226172 Dec 21 04:53:11.213218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:53:11.252968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:53:11.253362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:53:12.116658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb3581a-d9ab-4cc2-b5b3-edd7ee92210f req-7e70786b-768d-4294-82ef-88080d0e867f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:12.118113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deb3581a-d9ab-4cc2-b5b3-edd7ee92210f req-7e70786b-768d-4294-82ef-88080d0e867f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 943 time: 0.0509079 Dec 21 04:53:12.164598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-deb3581a-d9ab-4cc2-b5b3-edd7ee92210f req-b282ef55-aaa9-4d8b-ae77-80a92b6bdb17 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405974 Dec 21 04:53:12.392815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:53:12.491771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:12.504325 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'mac_address': 'fa:16:3e:e7:3f:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:53:12.545626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:12.558268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8b319c1c-d3f8-4870-a7ed-ee0127062932 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:53:12.577909 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:12.659466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:12.706827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:12.709849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b979c8-2e25-4503-972b-648f29bbc2c3 req-21373b52-b391-4fc3-81f8-8560ab0ac048 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:12.711386 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74b979c8-2e25-4503-972b-648f29bbc2c3 req-21373b52-b391-4fc3-81f8-8560ab0ac048 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0491061 Dec 21 04:53:12.714092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.714455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.714836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.715297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.715543 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.715876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.716206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.716534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.717161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.717488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.717818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.718142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.718459 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:12.760352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74b979c8-2e25-4503-972b-648f29bbc2c3 req-090ab379-b9f8-4510-886c-cba91a4ecf2b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422962 Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:53:12.782226 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:53:12.785805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5cc47199-c2de-4a94-8544-3fe7f888c9a2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:12.785805 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5cc47199-c2de-4a94-8544-3fe7f888c9a2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad&tenant_id=684628052e674280965f258699338238&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 944 time: 0.0576169 Dec 21 04:53:12.851733 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-826046c3-436a-4a12-8242-8ed45277b125 service neutron] 10.222.0.54 "GET /v2.0/ports/8b319c1c-d3f8-4870-a7ed-ee0127062932/bindings/n-h1-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.0587928 Dec 21 04:53:12.936016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-63171092-e776-4910-8ff9-b4b77de204bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:12.937496 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-63171092-e776-4910-8ff9-b4b77de204bf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1096 time: 0.0407779 Dec 21 04:53:12.978307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['8b319c1c-d3f8-4870-a7ed-ee0127062932'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:53:13.031337 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-348e524a-cb5b-419f-9aa1-3e1f76705be5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:13.032856 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-348e524a-cb5b-419f-9aa1-3e1f76705be5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0879607 Dec 21 04:53:13.097789 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-6c8d2529-5c5c-4a53-ba92-68e854667276 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1000 time: 0.0578523 Dec 21 04:53:13.145600 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-fd50fe21-8f08-40cf-ada9-9491fcdf0e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:13.147083 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-fd50fe21-8f08-40cf-ada9-9491fcdf0e41 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0429788 Dec 21 04:53:13.202370 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-f4f3acc8-3ca4-44ce-a481-3a4673f3c094 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:13.203832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-f4f3acc8-3ca4-44ce-a481-3a4673f3c094 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0486875 Dec 21 04:53:13.293408 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-2418e613-5199-465b-bba9-1db7eaafb84e service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813534 Dec 21 04:53:13.384514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-d8b46886-b56b-48d2-9fa4-a77d0d977425 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830209 Dec 21 04:53:13.880940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e9a75b-183f-4891-b0b8-0362af013ec0 req-1fff4c3d-4f0e-4484-9614-5033a0c4a583 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:13.882322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72e9a75b-183f-4891-b0b8-0362af013ec0 req-1fff4c3d-4f0e-4484-9614-5033a0c4a583 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0521121 Dec 21 04:53:13.928432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72e9a75b-183f-4891-b0b8-0362af013ec0 req-f6d0656d-53e9-409d-a4e7-78faf71f055b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402687 Dec 21 04:53:14.395833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:53:14.533635 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:53:14.537849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:53:14.538225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:14.616852 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:14.639430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:14.641612 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee9362a8-2da2-41c0-a0fa-7477e95ea562" -d '{"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-plugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:14.653871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:14.690442 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d095af7-6753-421f-a9e0-7c12b5cb6ff6 x-openstack-request-id: req-1d095af7-6753-421f-a9e0-7c12b5cb6ff6 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:14.690732 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-plugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:14.691003 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1d095af7-6753-421f-a9e0-7c12b5cb6ff6 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:14.691392 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'code': 200} Dec 21 04:53:14.722120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:14.768574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:15.052372 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee319e07-206c-449e-80ab-5e3295369c38 req-e0fcbd27-d831-48f4-bc54-6ebc48ea6c70 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:15.053864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee319e07-206c-449e-80ab-5e3295369c38 req-e0fcbd27-d831-48f4-bc54-6ebc48ea6c70 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0524840 Dec 21 04:53:15.101069 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee319e07-206c-449e-80ab-5e3295369c38 req-ce490e6d-b049-4c37-bb68-f2182ef5f8b9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412557 Dec 21 04:53:16.020591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-8d3ed32e-7529-4127-9fee-62a03e87a252 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:16.022068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-8d3ed32e-7529-4127-9fee-62a03e87a252 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 1097 time: 0.0442743 Dec 21 04:53:16.048089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:53:16.099933 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:16.300087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08148df0-557c-4bd4-b89a-8ae611135b14 req-15768e23-c181-43b7-95ad-f16c8fa93e61 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:16.301557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08148df0-557c-4bd4-b89a-8ae611135b14 req-15768e23-c181-43b7-95ad-f16c8fa93e61 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.1031854 Dec 21 04:53:16.360466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:16.380605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-08148df0-557c-4bd4-b89a-8ae611135b14 req-d7e10b42-585e-4ca7-926a-850d0da60a04 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0731699 Dec 21 04:53:16.401696 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:53:16.440212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:16.442450 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9104e72a-7952-418b-b5f4-d2320ca545b5" -d '{"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-unplugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:16.446077 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:16.458381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Transition to ACTIVE for port object 8b319c1c-d3f8-4870-a7ed-ee0127062932 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:53:16.494752 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4343e725-d346-43d2-879e-2055e129c700 x-openstack-request-id: req-4343e725-d346-43d2-879e-2055e129c700 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:16.495072 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-unplugged", "status": "completed", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:16.495353 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4343e725-d346-43d2-879e-2055e129c700 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:16.495760 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'code': 200} Dec 21 04:53:16.539445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:16.644308 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=10']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:16.670472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.670823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.671205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.671549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.671887 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.672221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.672555 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.672881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.673211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.673538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.673881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.674226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.674556 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:53:16.724420 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] No DVR routers for this DVR port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:53:16.853759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:53:16.854128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:53:16.854414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:53:16.859478 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:53:16.859662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Attempting to bind port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:53:16.864360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 52, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:53:16.864693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:53:16.865072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:53:16.865490 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Bound port: 8b319c1c-d3f8-4870-a7ed-ee0127062932, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:53:16.865838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:16.928470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:53:16.931516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:53:17.007721 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:17.043712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:17.044335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:17.046365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] 10.222.0.31 "PUT /v2.0/ports/8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 1093 time: 1.0023308 Dec 21 04:53:17.065081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fe019d2-60a1-4bec-993d-12b95dccc7ba service neutron] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=11']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:17.136807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-8a4b36f7-5a16-4898-82a4-80129809daad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:17.139157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-8a4b36f7-5a16-4898-82a4-80129809daad service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1096 time: 0.0425017 Dec 21 04:53:17.242256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-baec9147-9c34-49eb-b8e2-8e977ef66169 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:17.243832 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-baec9147-9c34-49eb-b8e2-8e977ef66169 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0925241 Dec 21 04:53:17.308779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-24c6eceb-9118-42b8-93af-7173127bfcc9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 999 time: 0.0579708 Dec 21 04:53:17.363785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-29815aa4-97a5-4a80-85f5-8c2dc501a10b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:17.365213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-29815aa4-97a5-4a80-85f5-8c2dc501a10b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0470846 Dec 21 04:53:17.414278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-43b342d6-0c05-4ba0-b765-916cd5dcbd1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:17.415840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-43b342d6-0c05-4ba0-b765-916cd5dcbd1b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0394361 Dec 21 04:53:17.544937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d71d223d-5e06-4bea-a579-4a20e1b29f80 req-8dddbb57-42c7-49c9-a1bc-c39f4d4ac0c9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:17.546389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d71d223d-5e06-4bea-a579-4a20e1b29f80 req-8dddbb57-42c7-49c9-a1bc-c39f4d4ac0c9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0954456 Dec 21 04:53:17.548720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-415446e9-3c83-4818-b47b-4d7c6a9902a9 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1215982 Dec 21 04:53:17.644248 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d71d223d-5e06-4bea-a579-4a20e1b29f80 req-446fec15-4c65-4517-b953-2b4691d74d27 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0918305 Dec 21 04:53:17.669014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7193a5c3-83c3-4073-8083-6484665b7a4f req-a9b6eac2-6a2e-4c26-8a12-4d6bd1a09e22 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1033013 Dec 21 04:53:18.447129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:53:18.484762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port 8b319c1c-d3f8-4870-a7ed-ee0127062932 host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:53:18.485154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:53:18.497159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:18.499514 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-163a51eb-a76e-43d4-849b-61365fd457e1" -d '{"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:18.548801 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2b19f26-81b9-4592-8226-29a3b5285d19 x-openstack-request-id: req-e2b19f26-81b9-4592-8226-29a3b5285d19 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:18.549097 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:18.549354 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e2b19f26-81b9-4592-8226-29a3b5285d19 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:18.549762 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'status': 'completed', 'code': 200} Dec 21 04:53:18.643359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-1f58a1c0-9d5e-4cf5-8af3-d033aea0574a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.644969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-1f58a1c0-9d5e-4cf5-8af3-d033aea0574a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1096 time: 0.0469661 Dec 21 04:53:18.671059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-d50d6e19-d4f4-430c-8d60-4b114baab1d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.672573 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-d50d6e19-d4f4-430c-8d60-4b114baab1d2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 1096 time: 0.0855801 Dec 21 04:53:18.767715 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-34902589-0d75-4f45-9345-7e54f2e56ad2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.769112 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-34902589-0d75-4f45-9345-7e54f2e56ad2 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0890207 Dec 21 04:53:18.770795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-866d7605-e589-4acb-b2ea-ac554612dd69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.772285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-866d7605-e589-4acb-b2ea-ac554612dd69 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.1194828 Dec 21 04:53:18.784597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7b5e210-acea-408d-b49d-2a8dd4693ac3 req-ef09b5c0-0bb6-4ff6-8800-3e238644bba2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.786025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7b5e210-acea-408d-b49d-2a8dd4693ac3 req-ef09b5c0-0bb6-4ff6-8800-3e238644bba2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0705805 Dec 21 04:53:18.833579 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-449a78c1-3d61-4aa1-8792-e2b0b10bb290 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 999 time: 0.0578897 Dec 21 04:53:18.872474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-c631d97e-13f5-46ce-8c16-87ed898b5ef1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 200 len: 999 time: 0.0854983 Dec 21 04:53:18.876145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7b5e210-acea-408d-b49d-2a8dd4693ac3 req-bf97228d-56a4-43bb-b594-273a39c98364 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0834785 Dec 21 04:53:18.883198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-945465a8-6049-4e0e-8cdc-d1ea7203b97f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.884679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-945465a8-6049-4e0e-8cdc-d1ea7203b97f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0443141 Dec 21 04:53:18.924698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-797798f6-52f4-4c63-8590-5b3ddaeb093e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.926182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-797798f6-52f4-4c63-8590-5b3ddaeb093e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0448737 Dec 21 04:53:18.933656 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-1e422e9f-f19b-45d3-a177-34af6f57dc8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.935221 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-1e422e9f-f19b-45d3-a177-34af6f57dc8c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0426621 Dec 21 04:53:18.975287 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-879affe4-f2c5-43e5-af2c-570eef9859a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:18.976782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-879affe4-f2c5-43e5-af2c-570eef9859a1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0428669 Dec 21 04:53:19.028357 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-07b93640-16bb-4ef5-9d53-a9e14f936306 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861454 Dec 21 04:53:19.080587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-301ec16e-7ae1-479b-829f-20b440d6feab service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865221 Dec 21 04:53:19.122281 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-7e994b6b-a004-48e5-8139-fa61809d0549 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869155 Dec 21 04:53:19.175038 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-163a51eb-a76e-43d4-849b-61365fd457e1 req-41324fe7-c2e7-4aa1-94b1-e4ad5a6e1cc2 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853827 Dec 21 04:53:19.907200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-94c9bec8-2cdf-4c00-b054-8e03d5c9dc38 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:19.993812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ccbe60-7212-4d5d-b4cc-984393946a1c req-745b1478-99b4-4265-bf97-ce25be79761b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:19.995343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78ccbe60-7212-4d5d-b4cc-984393946a1c req-745b1478-99b4-4265-bf97-ce25be79761b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0490119 Dec 21 04:53:20.040931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78ccbe60-7212-4d5d-b4cc-984393946a1c req-cf46672e-4749-4ede-b12c-4821860007d5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396848 Dec 21 04:53:20.159585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f90c4a-5688-4ec1-ae86-876c8c7449b2 req-54266995-361e-4d94-a939-d0d658546903 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:20.161091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82f90c4a-5688-4ec1-ae86-876c8c7449b2 req-54266995-361e-4d94-a939-d0d658546903 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0515714 Dec 21 04:53:20.206661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82f90c4a-5688-4ec1-ae86-876c8c7449b2 req-10f9b8bb-456f-4eb6-a7f3-fb6a1d5a6e5f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396552 Dec 21 04:53:20.316673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ee5d37-f113-4e14-ba4b-06900c3f2e12 req-e8c25dee-38a5-4de3-997f-38f96e94764d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:20.318113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43ee5d37-f113-4e14-ba4b-06900c3f2e12 req-e8c25dee-38a5-4de3-997f-38f96e94764d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0481236 Dec 21 04:53:20.363328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43ee5d37-f113-4e14-ba4b-06900c3f2e12 req-d1e8676b-680f-4501-9fa3-4edebaf29466 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394640 Dec 21 04:53:20.745218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fc1d7d2-1275-48cb-80cd-6c69b3e99457 req-ead6c39f-5db1-4361-ac1b-4f0d3faafc90 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:20.746617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fc1d7d2-1275-48cb-80cd-6c69b3e99457 req-ead6c39f-5db1-4361-ac1b-4f0d3faafc90 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 944 time: 0.0481708 Dec 21 04:53:20.799446 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0fc1d7d2-1275-48cb-80cd-6c69b3e99457 req-53a54037-b0f1-4ae2-93fa-846d9bea655e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461144 Dec 21 04:53:21.269094 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:53:21.375368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:21.385482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'mac_address': 'fa:16:3e:e7:3f:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:53:21.423859 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:21.436464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8b319c1c-d3f8-4870-a7ed-ee0127062932 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:53:21.454892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:21.541756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:21.587428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:22.279491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872af23c-b305-4078-999a-df663f8659b8 req-d35bb948-5048-4f4d-9e89-abfe89200414 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:22.280973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-872af23c-b305-4078-999a-df663f8659b8 req-d35bb948-5048-4f4d-9e89-abfe89200414 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.4124875 Dec 21 04:53:22.292456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-34a52e83-0cef-47f8-8220-956ec21d2659 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:22.293819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-34a52e83-0cef-47f8-8220-956ec21d2659 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 945 time: 0.0642328 Dec 21 04:53:22.367117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-872af23c-b305-4078-999a-df663f8659b8 req-076406cb-c0d6-41c9-b0b1-fc278a1ebf3d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0723429 Dec 21 04:53:22.410577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Deleting port 8b319c1c-d3f8-4870-a7ed-ee0127062932 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:53:22.410913 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:22.500750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] For port 8b319c1c-d3f8-4870-a7ed-ee0127062932, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=8b319c1c-d3f8-4870-a7ed-ee0127062932,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:22.501112 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:22.704422 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-434b4573-9a5c-430c-bf71-56c4675b3b62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:22.723054 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:22.723418 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:22.723734 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 disassociated. External IP: 172.25.5.55, port: 8b319c1c-d3f8-4870-a7ed-ee0127062932. Dec 21 04:53:22.724072 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Calling delete_port for 8b319c1c-d3f8-4870-a7ed-ee0127062932 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:53:22.933597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:22.961562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event deleted for resources: {'Port': ['ID=8b319c1c-d3f8-4870-a7ed-ee0127062932,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:23.083411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:53:23.203801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:53:23.214498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6639320c-1b84-4593-946f-52c910791f3b None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:53:23.224778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:53:23.225482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:53:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:23.246559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] No DVR routers for this DVR port 8b319c1c-d3f8-4870-a7ed-ee0127062932 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:53:23.249212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:23.252629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00999c1d-bbc4-4dab-a7a8-3fd1aba588b6 req-a81a7bae-dfb3-41de-b617-e04a1a66b580 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "DELETE /v2.0/ports/8b319c1c-d3f8-4870-a7ed-ee0127062932 HTTP/1.1" status: 204 len: 173 time: 0.9456575 Dec 21 04:53:23.253077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-deleted', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:23.255344 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-173ae394-df8a-4b42-9576-f5da2f0db6df" -d '{"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-deleted", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:23.294175 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2905b8b5-f182-471f-8761-3605ad9c8946 x-openstack-request-id: req-2905b8b5-f182-471f-8761-3605ad9c8946 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:23.294175 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfba6768-29c5-4ba7-950c-c576d0e8bbad", "name": "network-vif-deleted", "tag": "8b319c1c-d3f8-4870-a7ed-ee0127062932", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:23.294175 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2905b8b5-f182-471f-8761-3605ad9c8946 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:23.294175 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfba6768-29c5-4ba7-950c-c576d0e8bbad', 'name': 'network-vif-deleted', 'tag': '8b319c1c-d3f8-4870-a7ed-ee0127062932', 'status': 'completed', 'code': 200} Dec 21 04:53:23.317198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:53:23.470988 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-47e29c52-c02e-4d77-8b4e-9a78bc852d96 req-39a7c932-2cdb-46c6-96c9-42d610168234 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=dfba6768-29c5-4ba7-950c-c576d0e8bbad HTTP/1.1" status: 200 len: 210 time: 0.0283546 Dec 21 04:53:23.502904 n-d-822053-11 neutron-server[110312]: INFO neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No ports have port_id starting with 8b319c1c-d3f8-4870-a7ed-ee0127062932 Dec 21 04:53:23.517357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 requested by agent hyperv_n-h2-822053-11 not found in database {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:115}} Dec 21 04:53:23.536775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:53:23.615535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:23.664181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:23.739235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:23.769054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6639320c-1b84-4593-946f-52c910791f3b None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:53:23.777270 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:53:23.777873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:53:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:23.880830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:53:24.074684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-6639320c-1b84-4593-946f-52c910791f3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:24.100027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6639320c-1b84-4593-946f-52c910791f3b None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:53:24.327015 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff543038-367e-470e-97c5-bece197b12a6 None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:53:24.784468 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-9b249688-4355-497d-b2f4-99c4cf496cb0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-securitygroup--386554186&fields=id&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 267 time: 0.0414894 Dec 21 04:53:24.868794 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:53:24.897458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-a4f308d4-9dc5-4b98-8123-a6f847b306bc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:24.898960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-a4f308d4-9dc5-4b98-8123-a6f847b306bc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.1078956 Dec 21 04:53:24.914299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-aae56b2c-74fd-41d0-94ab-444b361d681f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/quotas/684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 375 time: 0.0090408 Dec 21 04:53:24.963953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-4e728795-e84a-4850-b0db-8272c0bc663c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0444000 Dec 21 04:53:25.024479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-36b7b44b-0aee-4963-b799-1eada7d5acda service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:53:25.025522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-36b7b44b-0aee-4963-b799-1eada7d5acda service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0496726 Dec 21 04:53:25.115653 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-a48747a6-1f50-44f2-89ea-27c5b924211b service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838356 Dec 21 04:53:25.207472 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-689a5b50-a5b5-4f40-9abc-c46225a5659b service neutron] 10.222.0.18 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857470 Dec 21 04:53:25.270642 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:25.296307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:53:25.316957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 8b319c1c-d3f8-4870-a7ed-ee0127062932 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:53:25.317311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 8b319c1c-d3f8-4870-a7ed-ee0127062932 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:53:25.375359 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:25.453418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49a9c1ff-8c5c-40d9-b1c5-ebd0aeb9bc59 req-89eb3aa8-69d4-4221-a36e-a298e8312f73 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0266702 Dec 21 04:53:25.836718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:26.548817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a63db176-95a7-4703-9ee5-e466ffac10ee req-cebef6b1-e361-4182-9b1f-b2f09cf17a27 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0260258 Dec 21 04:53:27.303936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-3b0b47ad-5c99-4394-bf59-e650ca56923a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:27.305389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-3b0b47ad-5c99-4394-bf59-e650ca56923a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 811 time: 0.1013942 Dec 21 04:53:27.377748 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-d9941b01-6e78-4bb4-8f58-60b176b3559e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 379 time: 0.0560772 Dec 21 04:53:27.386967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'port': {'device_id': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'admin_state_up': True, 'tenant_id': '684628052e674280965f258699338238', 'security_groups': ['f316a23c-9c52-424d-a1e8-aa67bc3eba50']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:53:27.579247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Made reservation on behalf of 684628052e674280965f258699338238 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:53:27.582837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:27.645872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ed583843-6617-4f1e-91d8-5ca36294ee98 req-28e8cce9-b510-4d32-903a-55bbfe94404a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0268807 Dec 21 04:53:27.714608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Allocated IP 172.20.0.5 (fc0ae40f-7660-4c02-8692-f49eb5531fe8/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:53:27.850921 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:27.956325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.003238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:53:28.006185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:53:28.008666 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:53:28.033986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:28.064018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:28.064651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.125302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-635eebd9-f487-4f5c-ac47-2ecf09dfbe7f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7419081 Dec 21 04:53:28.146539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Request body: {'port': {'device_id': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:53:28.194587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2e302490-77ee-4263-8515-13fc3bb4c9f2 None None] Provisioning complete for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:53:28.195242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e302490-77ee-4263-8515-13fc3bb4c9f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.213122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.239859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2e302490-77ee-4263-8515-13fc3bb4c9f2 None None] Port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:53:28.467213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:53:28.474468 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.486444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Transition to ACTIVE for port object c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:53:28.564289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.613984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:28.691751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:53:28.692101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:53:28.692438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:53:28.697486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:53:28.697822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:53:28.704365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 53, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:53:28.704712 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:53:28.705112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:53:28.705544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Bound port: c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:53:28.705953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:28.778606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b251c61-67dd-4b57-8068-7cfb8bcd21f6 req-f6f05ff5-1364-471f-9868-e25dfda62fc1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:28.780474 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b251c61-67dd-4b57-8068-7cfb8bcd21f6 req-f6f05ff5-1364-471f-9868-e25dfda62fc1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0617471 Dec 21 04:53:28.833594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b251c61-67dd-4b57-8068-7cfb8bcd21f6 req-5308f879-0edb-47da-bae2-e339bcaeeb8d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468013 Dec 21 04:53:29.080708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:53:29.083544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:53:29.162730 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:29.199548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:29.200179 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:29.201574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] 10.222.0.54 "PUT /v2.0/ports/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1092 time: 1.0627694 Dec 21 04:53:29.202021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:29.204298 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-458f7ce9-6109-459f-8150-59e7cde47cba" -d '{"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:29.226263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1585cdc9-be40-4f9e-a1db-cd642bd3de17 service neutron] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:29.305680 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-522df960-b8e3-4688-a215-34784071caa0 x-openstack-request-id: req-522df960-b8e3-4688-a215-34784071caa0 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:29.305980 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:29.306251 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-522df960-b8e3-4688-a215-34784071caa0 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:29.306672 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'status': 'completed', 'code': 200} Dec 21 04:53:29.367603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1505ce08-c7b5-4e0f-8e20-9e1764b4e388 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:29.369254 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-1505ce08-c7b5-4e0f-8e20-9e1764b4e388 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1095 time: 0.0448623 Dec 21 04:53:29.419978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-d3330cfc-9faf-46d3-8438-f2978317a1c0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 217 time: 0.0364339 Dec 21 04:53:29.484879 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-adcd6fb7-8ef6-4af8-8467-6841b917ea43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:29.486290 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-adcd6fb7-8ef6-4af8-8467-6841b917ea43 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0556114 Dec 21 04:53:29.530980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-0dbb2514-65e7-44ca-91f5-d679d3b80e4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:29.532504 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-0dbb2514-65e7-44ca-91f5-d679d3b80e4a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0394466 Dec 21 04:53:29.623724 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-a4f6066f-969f-4316-8778-555a3a1164e8 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839171 Dec 21 04:53:29.712090 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-da1d5d0a-f906-4b79-b8fc-53d2e873db15 req-88f791db-57fd-44da-aa36-6684045f4d77 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817964 Dec 21 04:53:29.919601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458f7ce9-6109-459f-8150-59e7cde47cba req-636a715d-4a64-4020-aef0-ecb642177281 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:29.921167 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-636a715d-4a64-4020-aef0-ecb642177281 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1095 time: 0.0455043 Dec 21 04:53:29.948818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b04546-5138-4df5-906a-47cb58360fa6 req-f88999da-37cd-41ee-af96-d99c287af3be tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:29.950302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59b04546-5138-4df5-906a-47cb58360fa6 req-f88999da-37cd-41ee-af96-d99c287af3be tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0478771 Dec 21 04:53:29.999016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-59b04546-5138-4df5-906a-47cb58360fa6 req-e24780f8-9a98-49d8-8251-929fe1af6e69 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419428 Dec 21 04:53:30.010910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458f7ce9-6109-459f-8150-59e7cde47cba req-4ec924de-1467-4150-849c-1d09e1c929c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:30.012639 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-4ec924de-1467-4150-849c-1d09e1c929c6 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0846002 Dec 21 04:53:30.057227 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-61cda6b2-2849-4f02-95f1-849150b77ae3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 217 time: 0.0368803 Dec 21 04:53:30.105860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458f7ce9-6109-459f-8150-59e7cde47cba req-ee7a30d6-a28c-4389-80c6-3b85b6da926b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:30.107288 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-ee7a30d6-a28c-4389-80c6-3b85b6da926b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0424471 Dec 21 04:53:30.151858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458f7ce9-6109-459f-8150-59e7cde47cba req-00c2c137-066c-4e6a-a539-7eabaec9ed77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:30.153187 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-00c2c137-066c-4e6a-a539-7eabaec9ed77 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0378196 Dec 21 04:53:30.243235 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-2dbf2ab8-c19d-44bb-a676-58baa384a104 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816860 Dec 21 04:53:30.332025 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-458f7ce9-6109-459f-8150-59e7cde47cba req-d75c7a61-5ce8-437a-ad09-acad698ee62d service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800102 Dec 21 04:53:31.113697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25acefcd-d737-457c-bcab-8ff91f2d1c3c req-5b45f41e-2bbf-481f-a49b-f416da96e9a9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:31.115239 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25acefcd-d737-457c-bcab-8ff91f2d1c3c req-5b45f41e-2bbf-481f-a49b-f416da96e9a9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0481982 Dec 21 04:53:31.165268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25acefcd-d737-457c-bcab-8ff91f2d1c3c req-003283a2-5acf-4334-aef7-57b14ed1eca4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442536 Dec 21 04:53:32.278405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55cc896b-97c4-4127-909e-4e7b51fe5493 req-cbfb04ce-64d6-4522-9a5f-1f438d2b3420 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:32.279897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55cc896b-97c4-4127-909e-4e7b51fe5493 req-cbfb04ce-64d6-4522-9a5f-1f438d2b3420 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0482416 Dec 21 04:53:32.326306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55cc896b-97c4-4127-909e-4e7b51fe5493 req-1c63c138-122f-45a0-a07d-15a85906ea07 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405436 Dec 21 04:53:32.461485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:53:32.556702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:32.566728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'mac_address': 'fa:16:3e:00:70:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:53:32.603480 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:32.620714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:53:32.639123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:32.735158 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:32.780444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:32.997720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:53:33.439694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae964384-f15e-4b47-af40-6ac512c4728e req-81b51208-eeec-4f86-8246-c7e06a6e85dc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:33.441146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae964384-f15e-4b47-af40-6ac512c4728e req-81b51208-eeec-4f86-8246-c7e06a6e85dc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0485234 Dec 21 04:53:33.487019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae964384-f15e-4b47-af40-6ac512c4728e req-08135885-e061-4c15-a65c-c97f0370f2cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401106 Dec 21 04:53:34.480869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:53:34.609030 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fbf5be-69e6-473e-8dd2-87d7c1336647 req-2e3c75a7-6678-43e1-9f6f-8fee69f241fb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:34.610541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51fbf5be-69e6-473e-8dd2-87d7c1336647 req-2e3c75a7-6678-43e1-9f6f-8fee69f241fb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0563829 Dec 21 04:53:34.624721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:53:34.628748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:53:34.630169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:34.660876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-51fbf5be-69e6-473e-8dd2-87d7c1336647 req-36ade280-3c45-4236-8bce-ab8f03065585 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443370 Dec 21 04:53:34.706228 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:34.728465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:34.730660 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57d6ec51-d8d2-4d5e-a5e5-7dcfb9cfd9c7" -d '{"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-plugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:34.743568 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:53:34.802111 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:34.828656 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be325210-b38b-415b-a8ba-98ac190c23ba x-openstack-request-id: req-be325210-b38b-415b-a8ba-98ac190c23ba {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:34.828957 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-plugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:34.829217 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-be325210-b38b-415b-a8ba-98ac190c23ba {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:34.829614 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'code': 200} Dec 21 04:53:34.854463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:53:34.944952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a0fad6e-df76-4603-a863-99e94e603ed5 req-44f47c50-6195-4a05-a63b-4191f3c7846e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:34.946460 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a0fad6e-df76-4603-a863-99e94e603ed5 req-44f47c50-6195-4a05-a63b-4191f3c7846e service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1097 time: 0.0394201 Dec 21 04:53:34.994978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9a0fad6e-df76-4603-a863-99e94e603ed5 req-db444e64-085b-4630-b28d-802b50757c37 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400100 Dec 21 04:53:35.776857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dfa1a67-c236-422f-93ea-f48b821f283a req-990337ac-d545-47ed-ac54-af0777463ab1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:35.778344 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dfa1a67-c236-422f-93ea-f48b821f283a req-990337ac-d545-47ed-ac54-af0777463ab1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0492804 Dec 21 04:53:35.824340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dfa1a67-c236-422f-93ea-f48b821f283a req-230e20a8-bdd5-4c11-8905-2c84b0339275 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400839 Dec 21 04:53:36.952767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3331dce9-551a-42c7-83c1-db572468c1ee req-71292d5b-0e6c-4014-a2fc-4936583440e6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:36.954734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3331dce9-551a-42c7-83c1-db572468c1ee req-71292d5b-0e6c-4014-a2fc-4936583440e6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0522599 Dec 21 04:53:37.002489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3331dce9-551a-42c7-83c1-db572468c1ee req-e7e44bfc-413f-49c9-a374-9ff78767843a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418406 Dec 21 04:53:37.116825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf535360-31bf-4e68-affd-fcfbf3dd6ae3 req-7f005d1c-cf79-49b4-9e88-d97bae0fae49 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:37.118225 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf535360-31bf-4e68-affd-fcfbf3dd6ae3 req-7f005d1c-cf79-49b4-9e88-d97bae0fae49 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0525041 Dec 21 04:53:37.127272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 49768) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:53:37.132235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Request body: {'floatingip': {'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:53:37.172313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:37.602564 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:37.655187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:37.754362 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 associated. External IP: 172.25.5.55, port: c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a. Dec 21 04:53:37.957051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:53:38.065494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:53:38.070550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:38.077794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:53:38.089001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:53:38.089849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:53:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:38.099369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c9a52d29-9a83-4b52-98d6-540154a036a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "PUT /v2.0/floatingips/107ec780-6cdd-4fdc-886a-90ca42f9c9c0 HTTP/1.1" status: 200 len: 991 time: 0.9707191 Dec 21 04:53:38.100056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:53:38.102685 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29be96c3-3c55-404e-850e-594094b1f0f3" -d '{"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:53:38.216148 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:53:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81f7c6df-399a-47f2-852c-c0fb61c164c7 x-openstack-request-id: req-81f7c6df-399a-47f2-852c-c0fb61c164c7 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:53:38.216690 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:53:38.216822 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-81f7c6df-399a-47f2-852c-c0fb61c164c7 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:53:38.217483 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'status': 'completed', 'code': 200} Dec 21 04:53:38.220595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:53:38.316054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-722463db-091e-4ab7-af76-ffa80c618426 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:38.317551 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-722463db-091e-4ab7-af76-ffa80c618426 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1097 time: 0.0461903 Dec 21 04:53:38.407829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-23ba2386-813e-4d1b-932f-4d0447a8dfd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:38.409345 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-23ba2386-813e-4d1b-932f-4d0447a8dfd0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0840168 Dec 21 04:53:38.440936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:00:70:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:53:37Z', 'revision_number': 13, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:38.471335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:53:38.479716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:53:38.480326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:53:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:38.482035 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-7a2ba60e-b55b-4451-ae8e-5770a26af33e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0635984 Dec 21 04:53:38.531066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-8374bffc-8d5d-4cc0-b512-4ef03997aab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:38.533089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-8374bffc-8d5d-4cc0-b512-4ef03997aab1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0432725 Dec 21 04:53:38.587492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-18c10e93-5189-4851-9340-a286c507e375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:38.588996 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-18c10e93-5189-4851-9340-a286c507e375 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0485361 Dec 21 04:53:38.589172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:53:38.687168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-a5dc7276-b544-4877-9524-88fe4362ab01 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895991 Dec 21 04:53:38.779967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-29be96c3-3c55-404e-850e-594094b1f0f3 req-dee222cc-79db-4cc8-b2b2-c146c1b76de3 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855813 Dec 21 04:53:38.813942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:00:70:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:53:37Z', 'revision_number': 13, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:53:38.843844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d2b7b37-2fe0-4769-b7e4-9e4c306e39f9 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '107ec780-6cdd-4fdc-886a-90ca42f9c9c0', 'tenant_id': '684628052e674280965f258699338238', 'floating_ip_address': '172.25.5.55', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'mac_address': 'fa:16:3e:00:70:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T04:46:02Z', 'updated_at': '2021-12-21T04:53:37Z', 'revision_number': 13, 'project_id': '684628052e674280965f258699338238', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:53:39.040716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb58e1b0-e323-462f-8694-8070717ee01f None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:53:44.440769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-6a46a7ed-99f9-4a72-b51d-8404f2d259e2 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0404480 Dec 21 04:53:44.538560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-2277e428-ebc0-41a3-9e69-a73db35e363c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:44.540393 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-2277e428-ebc0-41a3-9e69-a73db35e363c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1097 time: 0.0405726 Dec 21 04:53:44.652073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-556533a8-8411-4c02-961f-a3627bdeeb4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:44.653534 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-556533a8-8411-4c02-961f-a3627bdeeb4b service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0946918 Dec 21 04:53:44.719398 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-d8ef0274-19bb-472e-8b47-94393f564bf3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1001 time: 0.0579033 Dec 21 04:53:44.766445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-0494f084-2bbc-4f40-8928-53c143bd3712 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:44.768418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-0494f084-2bbc-4f40-8928-53c143bd3712 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0425060 Dec 21 04:53:44.818571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-7a1d0054-1c15-4700-8d27-934989ecb35e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:53:44.820094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-7a1d0054-1c15-4700-8d27-934989ecb35e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0448980 Dec 21 04:53:44.908667 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-fb6d848a-c8ba-4872-9746-3bc68db06777 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808489 Dec 21 04:53:45.000022 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bf9b946f-dd26-4b92-ae98-31e252a4979a req-ff7bacf9-d508-4b2a-9ce6-c4b1fe090142 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841725 Dec 21 04:53:49.894979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e9391cea-ad51-4fa5-b9d5-8378bd557b95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:52.690566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c7128716-dd7e-4210-b0a1-f3c3a94a46cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:53.443872 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:53.512110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:55.299101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:55.363314 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:53:55.804221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:01.868396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:54:19.899081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-013beda6-b32f-4a68-a655-4ddbecdd8760 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:22.729169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c2b76143-06bd-4710-928e-c7ef1663144c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:23.460407 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:23.518112 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:25.288820 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:25.380048 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:25.818496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:38.867228 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:54:45.424830 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-7b973333-b9e0-46bb-9ecc-fae3efc72143 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0401928 Dec 21 04:54:45.529839 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-10579453-06a0-4253-9250-332e86a336e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:54:45.529839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-10579453-06a0-4253-9250-332e86a336e8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1097 time: 0.0448396 Dec 21 04:54:45.639911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-e1971ffa-01ec-4503-b64a-399199522f4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:54:45.641384 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-e1971ffa-01ec-4503-b64a-399199522f4a service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0902205 Dec 21 04:54:45.713025 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-7524214b-e8e4-455a-a0fc-3866b6aefd01 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1001 time: 0.0580397 Dec 21 04:54:45.766054 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-0203e066-48fc-4ce6-9834-425f77d0f39f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:54:45.767513 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-0203e066-48fc-4ce6-9834-425f77d0f39f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0473702 Dec 21 04:54:45.810899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-ddc0c8c9-95b1-404b-be12-44146032f994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:54:45.812369 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-ddc0c8c9-95b1-404b-be12-44146032f994 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0384305 Dec 21 04:54:45.905418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-5132b6f6-2731-424b-97e2-5778b0930305 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855675 Dec 21 04:54:45.997033 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3d172233-e740-47ca-a624-4a3cf3ace9b9 req-1f8e1cc8-f756-42af-ba93-6c50318c449a service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843606 Dec 21 04:54:49.900215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db07da70-7828-4c1a-b733-e44f95f4ba9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:52.705718 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4ba74721-460a-4766-9f03-da0c4141b547 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:53.448483 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:53.494282 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:55.282867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:55.402836 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:54:55.818521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:15.869304 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:55:17.254757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc14266e-6440-4105-8fdd-9872cabd3cc7 req-b2022e72-f8f8-4a10-97dd-4d5d67cf83ca tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:17.256276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc14266e-6440-4105-8fdd-9872cabd3cc7 req-b2022e72-f8f8-4a10-97dd-4d5d67cf83ca tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0508351 Dec 21 04:55:17.303325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc14266e-6440-4105-8fdd-9872cabd3cc7 req-130c0ca7-cb9c-49bc-86c8-4955cea45f83 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412412 Dec 21 04:55:19.905332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a69912c-815a-428c-a0f1-20fb77298c62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:22.738799 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-de649ed3-8eb4-4a65-8508-4258b0980cd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:23.464414 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:23.538919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:25.276827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:25.385528 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:25.847700 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:29.668231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-9bb0331f-1966-46f2-a78a-19e72784f2b5 req-fd2acb1c-acb6-4499-a230-d22b17a1a405 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:55:29.669257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bb0331f-1966-46f2-a78a-19e72784f2b5 req-fd2acb1c-acb6-4499-a230-d22b17a1a405 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053627 Dec 21 04:55:29.955310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f805de5-a4a3-4411-ae69-08074b9a6b4d req-eda68f72-2341-4944-9795-1e244228a516 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:29.957282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f805de5-a4a3-4411-ae69-08074b9a6b4d req-eda68f72-2341-4944-9795-1e244228a516 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0534859 Dec 21 04:55:30.006019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f805de5-a4a3-4411-ae69-08074b9a6b4d req-f1d73b5f-ebc3-4ee3-9a56-1b2ed40a30db tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421391 Dec 21 04:55:30.042322 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-8c4860ce-4dbe-485a-8365-da2cd9ce6fbd service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0407572 Dec 21 04:55:30.051020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-6a52b9d2-505d-4c17-872a-e6b9d4675ca9 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:55:30.051963 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-6a52b9d2-505d-4c17-872a-e6b9d4675ca9 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048890 Dec 21 04:55:31.121046 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21cfdb7-6c31-4c81-aff3-9a37fc9e0d87 req-d8d9755a-908b-4322-8358-1766049f58f3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:31.122520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b21cfdb7-6c31-4c81-aff3-9a37fc9e0d87 req-d8d9755a-908b-4322-8358-1766049f58f3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0483615 Dec 21 04:55:31.173964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b21cfdb7-6c31-4c81-aff3-9a37fc9e0d87 req-27972bb1-aff1-407e-a206-8d2d29ca4725 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453911 Dec 21 04:55:32.281676 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-851ad083-a547-41c7-968f-3b1438062aac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:32.283907 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-851ad083-a547-41c7-968f-3b1438062aac service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1097 time: 0.0407887 Dec 21 04:55:32.293875 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5985d722-c4e3-4d8c-8df8-1c0c87c56de4 req-879c8cde-c45f-4c6f-9137-600acf3068b7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:32.295370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5985d722-c4e3-4d8c-8df8-1c0c87c56de4 req-879c8cde-c45f-4c6f-9137-600acf3068b7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0479300 Dec 21 04:55:32.346681 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5985d722-c4e3-4d8c-8df8-1c0c87c56de4 req-7bbb7b15-062b-48ba-a936-4cc72d60daae tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452638 Dec 21 04:55:32.378116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-5703e534-d890-4e80-bc1c-87ba48120515 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:32.379643 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-5703e534-d890-4e80-bc1c-87ba48120515 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0889895 Dec 21 04:55:32.443999 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-992f5bcb-8e59-4fd3-bff4-53e9e092ab3a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1001 time: 0.0575008 Dec 21 04:55:32.497535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-b23a6dd6-13d0-4cf8-9462-3470d405d6c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:32.498878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-b23a6dd6-13d0-4cf8-9462-3470d405d6c2 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0479848 Dec 21 04:55:32.543540 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-4f07c4e2-e1ff-4a1c-8467-a551d36000e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:32.545007 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-4f07c4e2-e1ff-4a1c-8467-a551d36000e7 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0387840 Dec 21 04:55:32.635610 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-c7d0b78c-afdc-448b-80bc-d5baa5d8aa39 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830188 Dec 21 04:55:32.728769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-3689cf5b-6de7-4fd1-bca7-d236d8441644 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852432 Dec 21 04:55:33.462720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4923ac-6cce-4a90-9904-b36566e0be24 req-b1737a3d-b1ac-4260-af2a-f8857341869d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:33.464329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc4923ac-6cce-4a90-9904-b36566e0be24 req-b1737a3d-b1ac-4260-af2a-f8857341869d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0485971 Dec 21 04:55:33.515398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc4923ac-6cce-4a90-9904-b36566e0be24 req-e9908410-37c0-49b1-8bc2-0dcdabea1fb9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440421 Dec 21 04:55:34.631250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3999fdc8-82aa-4dc2-aeb6-bbaff26d4ae5 req-aed725a7-32f1-41b8-bbd8-7696198846a9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:34.632743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3999fdc8-82aa-4dc2-aeb6-bbaff26d4ae5 req-aed725a7-32f1-41b8-bbd8-7696198846a9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0494225 Dec 21 04:55:34.679433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3999fdc8-82aa-4dc2-aeb6-bbaff26d4ae5 req-b454b9f3-2c11-4fc2-b204-763765e4251a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404060 Dec 21 04:55:35.796501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd875e59-6da5-47d8-8e74-86b7200a8b52 req-20deba9e-83fe-4427-88fe-cd6acd904623 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:35.797971 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd875e59-6da5-47d8-8e74-86b7200a8b52 req-20deba9e-83fe-4427-88fe-cd6acd904623 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0511627 Dec 21 04:55:35.845031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fd875e59-6da5-47d8-8e74-86b7200a8b52 req-761c2bb2-768d-4734-99a8-0d206b865982 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405111 Dec 21 04:55:36.959363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00c2144-b09f-423f-a23f-62a0f0ab92d2 req-a9b1fb92-d1b9-45ab-a086-caee84fd6272 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:36.960844 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a00c2144-b09f-423f-a23f-62a0f0ab92d2 req-a9b1fb92-d1b9-45ab-a086-caee84fd6272 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0482712 Dec 21 04:55:37.006578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a00c2144-b09f-423f-a23f-62a0f0ab92d2 req-2cd7badf-cb87-4b82-ac04-11fa7649a9ce tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398207 Dec 21 04:55:38.122571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56604605-9077-49b7-a5a2-a15bfeab8cb2 req-75273772-e2b4-4d45-8ae2-59caa10e51eb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:38.124044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56604605-9077-49b7-a5a2-a15bfeab8cb2 req-75273772-e2b4-4d45-8ae2-59caa10e51eb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0513330 Dec 21 04:55:38.169813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56604605-9077-49b7-a5a2-a15bfeab8cb2 req-ceb922c7-35d0-423e-9157-0d3d230af2f0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399508 Dec 21 04:55:39.287515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4d53e9-6240-4a55-87f2-f1615def7d22 req-5baca65f-8506-42a8-9ee7-c604b1de33db tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:39.289008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc4d53e9-6240-4a55-87f2-f1615def7d22 req-5baca65f-8506-42a8-9ee7-c604b1de33db tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0481970 Dec 21 04:55:39.335236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc4d53e9-6240-4a55-87f2-f1615def7d22 req-44451ae7-55e0-448b-9127-084df84c562f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403550 Dec 21 04:55:40.450407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c929413a-4b4f-4fd1-8ec2-ed9b19a04f87 req-84f770f4-dbdc-45c5-8635-6013ae35539a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:40.451886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c929413a-4b4f-4fd1-8ec2-ed9b19a04f87 req-84f770f4-dbdc-45c5-8635-6013ae35539a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0480053 Dec 21 04:55:40.500836 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c929413a-4b4f-4fd1-8ec2-ed9b19a04f87 req-9e123020-2831-4e65-b612-355835f768cc tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431330 Dec 21 04:55:41.620657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07521d05-c594-41be-b2e8-a6e470870cb5 req-cb757035-c1e6-4863-a7a3-d80d452ceaa1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:41.622120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07521d05-c594-41be-b2e8-a6e470870cb5 req-cb757035-c1e6-4863-a7a3-d80d452ceaa1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0479600 Dec 21 04:55:41.669123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07521d05-c594-41be-b2e8-a6e470870cb5 req-a760c612-0610-4ebc-9954-11aae3cdefd2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409603 Dec 21 04:55:42.784713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e40c3c-323b-453d-9473-a41e18074f53 req-54f8f0af-cdf1-467b-80fa-a02569e19ef2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:42.786194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56e40c3c-323b-453d-9473-a41e18074f53 req-54f8f0af-cdf1-467b-80fa-a02569e19ef2 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0488272 Dec 21 04:55:42.833033 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-56e40c3c-323b-453d-9473-a41e18074f53 req-d7886a99-5e62-495f-8f16-e9cfab8b5c4d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403669 Dec 21 04:55:43.953323 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8efcfe-9755-4fa5-a744-f2391296a1d1 req-c4ad35b2-27bb-4914-bfc5-5c1f430ef81f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:43.954793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c8efcfe-9755-4fa5-a744-f2391296a1d1 req-c4ad35b2-27bb-4914-bfc5-5c1f430ef81f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0513170 Dec 21 04:55:44.001019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c8efcfe-9755-4fa5-a744-f2391296a1d1 req-88b34e44-5662-42a8-9e7e-cf3c3cc2776f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404589 Dec 21 04:55:45.116723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715ec583-8f32-4e09-bc51-6305602e9509 req-a40e6c60-f619-4986-a0e3-b21ac3f161c3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:45.118179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-715ec583-8f32-4e09-bc51-6305602e9509 req-a40e6c60-f619-4986-a0e3-b21ac3f161c3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0493557 Dec 21 04:55:45.164351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-715ec583-8f32-4e09-bc51-6305602e9509 req-f6064904-afde-4478-bb5b-560d4be650cb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396090 Dec 21 04:55:46.281000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de835f75-64d4-4c7f-85f9-2e97862a9d7e req-7deabf6d-d3f0-47b5-8562-6cbe05b037cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:46.282451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de835f75-64d4-4c7f-85f9-2e97862a9d7e req-7deabf6d-d3f0-47b5-8562-6cbe05b037cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0476043 Dec 21 04:55:46.331750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-de835f75-64d4-4c7f-85f9-2e97862a9d7e req-16118586-77ea-475b-a82f-e41d2d666f87 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434270 Dec 21 04:55:46.490803 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-96a51ce9-6d94-4395-97f4-3afa395286a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:46.492238 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-96a51ce9-6d94-4395-97f4-3afa395286a7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1097 time: 0.0433135 Dec 21 04:55:46.600731 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-2d556f96-fb0e-4a30-8c69-c14a3d0a0549 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:46.602216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-2d556f96-fb0e-4a30-8c69-c14a3d0a0549 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0897257 Dec 21 04:55:46.667842 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-56ab3629-1a60-4494-b37c-9bd8dd61b63f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1001 time: 0.0587215 Dec 21 04:55:46.717618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-1729741e-c537-4e48-a2a8-17deb93ceb25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:46.719043 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-1729741e-c537-4e48-a2a8-17deb93ceb25 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0430710 Dec 21 04:55:46.768425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-fcb81108-0e2c-40c1-9478-faf763a42d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:46.770925 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-fcb81108-0e2c-40c1-9478-faf763a42d14 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0451193 Dec 21 04:55:46.860996 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-f56f4ff3-4a93-4a55-9834-b52310e002e6 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825562 Dec 21 04:55:46.952520 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-67b60698-a3a4-433d-9ce7-1b2b8d5e28be req-19739f0c-68f5-4e46-9ff4-c5927c4961ef service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846303 Dec 21 04:55:47.460907 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73517544-792b-42b8-8a80-8d153b1b3bbe req-b9cb55ff-be2e-4bf0-9861-32b5cffcd78a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:47.462398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73517544-792b-42b8-8a80-8d153b1b3bbe req-b9cb55ff-be2e-4bf0-9861-32b5cffcd78a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0487192 Dec 21 04:55:47.508915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-73517544-792b-42b8-8a80-8d153b1b3bbe req-cb50999a-9950-4b60-9805-a9c2beb4ba88 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403874 Dec 21 04:55:48.624147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5f1c20-f700-4c72-87e4-17eff48663b0 req-58ce619b-c706-4d1b-a764-6afed2a69dd4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:48.625630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f5f1c20-f700-4c72-87e4-17eff48663b0 req-58ce619b-c706-4d1b-a764-6afed2a69dd4 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0491569 Dec 21 04:55:48.671671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f5f1c20-f700-4c72-87e4-17eff48663b0 req-39991c8c-bdba-4ad9-b811-a1919d0d82d9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400417 Dec 21 04:55:49.789000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b697124a-3cb8-46d0-9caa-090a2cbfbd83 req-86c66127-adfc-48d3-a090-a96204ecc08d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:49.790489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b697124a-3cb8-46d0-9caa-090a2cbfbd83 req-86c66127-adfc-48d3-a090-a96204ecc08d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0514822 Dec 21 04:55:49.836759 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b697124a-3cb8-46d0-9caa-090a2cbfbd83 req-2b7b4923-fd90-4e92-8962-a619c3f8140d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402524 Dec 21 04:55:49.910324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-766fa0ba-e9b7-4648-81b6-802823a0c0b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:50.952775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7adae5b0-6428-4c43-afd0-a81bbe36503c req-5a9b7b72-d3e3-4b6f-b8eb-baad476f334d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:50.954280 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7adae5b0-6428-4c43-afd0-a81bbe36503c req-5a9b7b72-d3e3-4b6f-b8eb-baad476f334d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0485005 Dec 21 04:55:51.001503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7adae5b0-6428-4c43-afd0-a81bbe36503c req-cce4d7df-90ae-43a8-8d25-edd268d63ddb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407579 Dec 21 04:55:52.120564 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276dc60c-e463-4507-9042-5eb02cba1734 req-50680c0a-26d0-4897-aa44-422926e63b6f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:52.122075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-276dc60c-e463-4507-9042-5eb02cba1734 req-50680c0a-26d0-4897-aa44-422926e63b6f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0525811 Dec 21 04:55:52.170061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-276dc60c-e463-4507-9042-5eb02cba1734 req-44a3df21-29ae-442d-9686-1c3694c15376 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419424 Dec 21 04:55:52.235959 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-151c22c4-125d-4372-84a6-dea637cce02f service neutron] show failed (client error): The resource could not be found. Dec 21 04:55:52.236967 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-151c22c4-125d-4372-84a6-dea637cce02f service neutron] 10.222.0.54 "GET /v2.0/ports/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0544701 Dec 21 04:55:52.645719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-5618d611-5dd2-4243-a564-d19f7fef1cd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:52.647255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-5618d611-5dd2-4243-a564-d19f7fef1cd5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 1097 time: 0.0410912 Dec 21 04:55:52.674070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:55:52.724848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:52.733296 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0f205ca7-3beb-4a4d-8f95-206c7e4163cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:52.870182 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:55:52.920419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:55:52.952217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:55:52.990369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:55:52.992635 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2acc30fa-3d6d-43ac-b55e-64cdc5b01594" -d '{"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-unplugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:55:52.996587 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.008702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Transition to ACTIVE for port object c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:55:53.041885 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:55:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73f6f1c4-decc-4e51-8c21-767691e0aa76 x-openstack-request-id: req-73f6f1c4-decc-4e51-8c21-767691e0aa76 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:55:53.042181 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-unplugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:55:53.042439 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-73f6f1c4-decc-4e51-8c21-767691e0aa76 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:55:53.042869 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'code': 200} Dec 21 04:55:53.070724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.155522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:55:53.170200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.170559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.170904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.171272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.171610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.171943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.172276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.172604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.172930 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.173256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.173587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.173914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.174238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:55:53.209621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] No DVR routers for this DVR port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on host n-h1-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:55:53.339667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b9bef04-dd8b-48b4-980f-e674b35a6372 req-6f619133-593e-48ac-85db-c6cf81c737e5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:53.341140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b9bef04-dd8b-48b4-980f-e674b35a6372 req-6f619133-593e-48ac-85db-c6cf81c737e5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0985987 Dec 21 04:55:53.381814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:55:53.411338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:55:53.411601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:55:53.412102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:55:53.419725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0b9bef04-dd8b-48b4-980f-e674b35a6372 req-576ea0fa-ca42-4cb2-bca8-6c5ec3a180fb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0701780 Dec 21 04:55:53.420731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:55:53.421028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:55:53.426109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 55, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:55:53.426447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:55:53.426829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:55:53.427288 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Bound port: c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:55:53.427642 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.432283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] The host n-h1-822053-11 is not matching for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a host n-h2-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:55:53.436374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:55:53.493859 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.516631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.830801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:55:53.833752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:55:53.882202 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.916719 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:53.917356 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:53.918727 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-417449c5-f718-412b-834c-ef63b832e007 service neutron] 10.222.0.31 "PUT /v2.0/ports/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1092 time: 1.2486341 Dec 21 04:55:53.936912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417449c5-f718-412b-834c-ef63b832e007 service neutron] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:55:53.999980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-32177a3d-6f8c-4823-8b27-d825a8a1c729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:54.001531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-32177a3d-6f8c-4823-8b27-d825a8a1c729 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1095 time: 0.0425189 Dec 21 04:55:54.100776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-a56b67db-0142-4ad7-bdf0-9719030c87b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:54.102253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-a56b67db-0142-4ad7-bdf0-9719030c87b4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0899351 Dec 21 04:55:54.168113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-92134614-aba9-442a-ac50-7131420720a1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0564117 Dec 21 04:55:54.224234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-425dbb23-feea-4ecb-b010-0f13378fff25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:54.225673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-425dbb23-feea-4ecb-b010-0f13378fff25 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0468125 Dec 21 04:55:54.273139 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-ce6e8a5d-a29e-42f2-bd3c-f218db7c135f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:54.274580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-ce6e8a5d-a29e-42f2-bd3c-f218db7c135f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0382884 Dec 21 04:55:54.366662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-859e0454-626c-41bf-8a7a-db391843729f service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837812 Dec 21 04:55:54.459601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-fe703f54-fcee-44a4-aaec-b87534168d42 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806165 Dec 21 04:55:54.539616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3d1f6e-0d38-455e-99d4-fa81db596264 req-026e7f89-bb63-4375-8baa-2263cd7cb306 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:54.541123 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f3d1f6e-0d38-455e-99d4-fa81db596264 req-026e7f89-bb63-4375-8baa-2263cd7cb306 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0485902 Dec 21 04:55:54.597817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f3d1f6e-0d38-455e-99d4-fa81db596264 req-fb95ad6d-08a4-4133-ab8a-a641a8500b19 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491686 Dec 21 04:55:55.043903 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:55:55.046320 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4" -d '{"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:55:55.094041 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:55:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1c142061-d9cc-42ad-ba61-202ba4108156 x-openstack-request-id: req-1c142061-d9cc-42ad-ba61-202ba4108156 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:55:55.094341 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:55:55.094603 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1c142061-d9cc-42ad-ba61-202ba4108156 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:55:55.095310 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'status': 'completed', 'code': 200} Dec 21 04:55:55.176077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-1e359c13-f7f1-4477-a170-5ca72342cfc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.178184 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-1e359c13-f7f1-4477-a170-5ca72342cfc7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1095 time: 0.0420573 Dec 21 04:55:55.189375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-dabb0cd5-1933-4b2e-95ff-622ac648642a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.190915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-dabb0cd5-1933-4b2e-95ff-622ac648642a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1095 time: 0.0422564 Dec 21 04:55:55.278751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-ed78ef27-5112-4e26-ae9c-ce75e61c9b63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.280540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-ed78ef27-5112-4e26-ae9c-ce75e61c9b63 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0943022 Dec 21 04:55:55.288304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-ac6f0891-5fbb-48f5-9ba6-b7d79baa599b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.289792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-ac6f0891-5fbb-48f5-9ba6-b7d79baa599b service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0881689 Dec 21 04:55:55.299985 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:55.350189 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-ae841abc-b8c7-4281-bbd0-27f4b64e0385 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0618782 Dec 21 04:55:55.376174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-1316d175-94ad-43e0-a7de-d9d3958fc173 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0738053 Dec 21 04:55:55.385061 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:55.406961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-f2edd2c0-670c-44e3-823d-2ef542594fba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.408834 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-f2edd2c0-670c-44e3-823d-2ef542594fba service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0513628 Dec 21 04:55:55.431467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-848e1ee3-8ce3-4e9a-9c6d-85ccb3849da4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.432923 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-848e1ee3-8ce3-4e9a-9c6d-85ccb3849da4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0452967 Dec 21 04:55:55.453991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-4bf4a8a1-5eea-40cf-8a35-51e2e9a90a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.455724 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-4bf4a8a1-5eea-40cf-8a35-51e2e9a90a71 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0405147 Dec 21 04:55:55.485835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-2ef328b1-6c0e-4d87-bb8a-28887b45488c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.487795 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-2ef328b1-6c0e-4d87-bb8a-28887b45488c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0433180 Dec 21 04:55:55.554752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-5935fffd-867f-40cd-a2f7-1f178e1c836e service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908806 Dec 21 04:55:55.608956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-5ad7b69c-2108-4b32-849d-0540226a404c service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1075101 Dec 21 04:55:55.661637 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-4ce68d6c-0cf4-4c62-b179-a1dea73502e0 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0984116 Dec 21 04:55:55.754124 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-caf1063f-0e95-4068-9f59-a7ab6d59dfa4 req-4caf23e5-5154-4d4f-b8a8-b92d4b147a29 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1312532 Dec 21 04:55:55.763170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ad0517-79f6-4fc6-ad6c-8a8f74d42955 req-66f4238a-e0e5-4ba0-a936-c34f2690005a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:55.764515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90ad0517-79f6-4fc6-ad6c-8a8f74d42955 req-66f4238a-e0e5-4ba0-a936-c34f2690005a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0759783 Dec 21 04:55:55.825400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90ad0517-79f6-4fc6-ad6c-8a8f74d42955 req-8694f146-0755-408a-be52-18f726706d39 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0546126 Dec 21 04:55:55.862128 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:55:56.945565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa1ea50-5f00-4fe4-a854-4b5179c59eaa req-48d587b6-5618-4787-bcb7-5fd5d6140ac0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:56.947099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aa1ea50-5f00-4fe4-a854-4b5179c59eaa req-48d587b6-5618-4787-bcb7-5fd5d6140ac0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0483835 Dec 21 04:55:56.996610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3aa1ea50-5f00-4fe4-a854-4b5179c59eaa req-eac50ca1-8111-46a9-89bb-e12103765c52 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435250 Dec 21 04:55:58.120109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7d53a7-c56d-42cb-8965-89b79c0e3b7c req-905ea17e-873b-401b-8669-ca4d30afe816 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:58.121724 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d7d53a7-c56d-42cb-8965-89b79c0e3b7c req-905ea17e-873b-401b-8669-ca4d30afe816 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0549955 Dec 21 04:55:58.168482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d7d53a7-c56d-42cb-8965-89b79c0e3b7c req-b6fa98e3-b5ea-46a2-8a41-dbd6621ccad6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407994 Dec 21 04:55:59.287346 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52cdd8d-dce6-40ba-80fd-c84202e15619 req-afacd420-31e2-44cc-bb27-23d68da8bb5c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:55:59.288945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a52cdd8d-dce6-40ba-80fd-c84202e15619 req-afacd420-31e2-44cc-bb27-23d68da8bb5c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0503929 Dec 21 04:55:59.335272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a52cdd8d-dce6-40ba-80fd-c84202e15619 req-6df5f350-505b-40d4-bdd7-ece3673f23ab tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401204 Dec 21 04:56:00.451010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af2149b0-8efa-4d4b-be7e-ddf91974b0c6 req-bdd7aa29-45d9-42d0-8767-c20f089ec2b9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:00.452519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af2149b0-8efa-4d4b-be7e-ddf91974b0c6 req-bdd7aa29-45d9-42d0-8767-c20f089ec2b9 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0479705 Dec 21 04:56:00.502268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af2149b0-8efa-4d4b-be7e-ddf91974b0c6 req-a8008d42-6569-4860-9c2d-15fdde781488 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439274 Dec 21 04:56:01.826422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d542fca-f899-4dba-9e5c-1985cd152c42 req-064a50f4-9682-427a-b184-ff27844166d6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:01.827858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d542fca-f899-4dba-9e5c-1985cd152c42 req-064a50f4-9682-427a-b184-ff27844166d6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0538402 Dec 21 04:56:01.876489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1d542fca-f899-4dba-9e5c-1985cd152c42 req-ff120b7c-f9e6-47a0-8412-0c009b830333 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425875 Dec 21 04:56:02.994012 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4300a6c2-2129-4b2b-bdaf-7c80f05b758e req-16e9a122-de5a-481d-b5c1-7a2de38ddbf8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:02.995528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4300a6c2-2129-4b2b-bdaf-7c80f05b758e req-16e9a122-de5a-481d-b5c1-7a2de38ddbf8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0488825 Dec 21 04:56:03.043076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4300a6c2-2129-4b2b-bdaf-7c80f05b758e req-037710aa-3742-4ad3-8bb4-4a2de66ae74b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409918 Dec 21 04:56:04.162124 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f34122e-dd9f-4253-ba44-8bb35ea6fd1a req-ba447fef-5e94-456f-a22b-e957395e205f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:04.163634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f34122e-dd9f-4253-ba44-8bb35ea6fd1a req-ba447fef-5e94-456f-a22b-e957395e205f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0522337 Dec 21 04:56:04.209587 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f34122e-dd9f-4253-ba44-8bb35ea6fd1a req-2ee3ebe3-4dd3-4d3b-931e-d91092239556 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400603 Dec 21 04:56:05.323603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f476d-f6b6-4a1e-afd4-a7eda128d0c4 req-ff8b7c5d-5fba-4d02-9a03-142917f98cdf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:05.325105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-060f476d-f6b6-4a1e-afd4-a7eda128d0c4 req-ff8b7c5d-5fba-4d02-9a03-142917f98cdf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0485616 Dec 21 04:56:05.372170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-060f476d-f6b6-4a1e-afd4-a7eda128d0c4 req-bd7d7a50-bdf5-4a10-8580-6291a2384363 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410895 Dec 21 04:56:06.487709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a34cdd7-06ef-40fa-ae22-6ee7427d81ef req-fa261e86-d596-4bcd-89fa-8bd7ffda7915 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:06.489199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a34cdd7-06ef-40fa-ae22-6ee7427d81ef req-fa261e86-d596-4bcd-89fa-8bd7ffda7915 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0487170 Dec 21 04:56:06.540713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a34cdd7-06ef-40fa-ae22-6ee7427d81ef req-71f96de1-0e55-4e51-a825-caaa117e4fbe tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453844 Dec 21 04:56:07.660187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d523c9dc-51eb-4859-912d-56bc59549ae5 req-2e142a0d-e2ba-4827-b9d6-a1d369192916 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:07.662221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d523c9dc-51eb-4859-912d-56bc59549ae5 req-2e142a0d-e2ba-4827-b9d6-a1d369192916 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 943 time: 0.0524900 Dec 21 04:56:07.708425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d523c9dc-51eb-4859-912d-56bc59549ae5 req-4e709a30-6ece-420b-b5ea-5076e5f13ed6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402400 Dec 21 04:56:08.226181 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:56:08.318281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:08.329323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'mac_address': 'fa:16:3e:00:70:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:56:08.369055 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:08.381511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:56:08.401065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:08.481781 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:08.528416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:08.535584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.535936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.536280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.536619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.536954 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.537285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.537618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.537951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.538277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.538604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.538942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.539278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.539603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:08.824402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58cd22c-6576-4773-80e1-26f32b33ddc1 req-628a46e6-6049-461e-bd61-112b6b44bd57 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:08.825883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c58cd22c-6576-4773-80e1-26f32b33ddc1 req-628a46e6-6049-461e-bd61-112b6b44bd57 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0485110 Dec 21 04:56:08.851451 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:56:08.873649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c58cd22c-6576-4773-80e1-26f32b33ddc1 req-b15a8177-2862-4c6d-aecb-32255730bdf0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418122 Dec 21 04:56:09.413695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9939a847-3f9c-4ae2-93b4-3d627ae3b8d7 req-61b05193-4487-44bb-a92f-5c9fe576e645 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:09.415211 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9939a847-3f9c-4ae2-93b4-3d627ae3b8d7 req-61b05193-4487-44bb-a92f-5c9fe576e645 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0803580 Dec 21 04:56:09.444020 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-fcc76be7-2d4a-4887-bed1-31d8a6f386ba tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:09.445436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-fcc76be7-2d4a-4887-bed1-31d8a6f386ba tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.31 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91&tenant_id=684628052e674280965f258699338238&binding%3Ahost_id=n-h2-822053-11 HTTP/1.1" status: 200 len: 944 time: 0.0772736 Dec 21 04:56:09.500996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9939a847-3f9c-4ae2-93b4-3d627ae3b8d7 req-33036a54-ba19-4013-a69b-48043daf7e8b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0798516 Dec 21 04:56:09.523884 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-07340349-2db9-4aba-b957-6747a215852a service neutron] 10.222.0.31 "GET /v2.0/ports/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a/bindings/n-h2-822053-11 HTTP/1.1" status: 200 len: 383 time: 0.0666120 Dec 21 04:56:09.610635 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-5c5337b0-611e-4d6f-a3a7-a2d87c93a77f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:09.612212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-5c5337b0-611e-4d6f-a3a7-a2d87c93a77f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1096 time: 0.0460279 Dec 21 04:56:09.707245 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-8e46bddd-c39e-48f0-baab-3d4a66843dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:09.709190 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-8e46bddd-c39e-48f0-baab-3d4a66843dbd service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0901654 Dec 21 04:56:09.779910 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-99d342df-f1cd-483d-8ce6-b6975863d6b4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1000 time: 0.0625000 Dec 21 04:56:09.828862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-e80fc7e6-3568-4e8f-9433-084199eb96cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:09.830358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-e80fc7e6-3568-4e8f-9433-084199eb96cc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0428517 Dec 21 04:56:09.875031 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-000d322b-cd38-44de-aa2b-5f499b27d4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:09.876384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-000d322b-cd38-44de-aa2b-5f499b27d4f9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383627 Dec 21 04:56:09.967934 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-d249e3c2-9b46-4fca-a4e5-bc3f73f9af56 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837498 Dec 21 04:56:10.056046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-fe7b15a3-77a6-4d1a-916f-f4d0abdcab41 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803301 Dec 21 04:56:10.248863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:56:10.372608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:56:10.376411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:56:10.376778 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:10.454515 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:10.475591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:10.477781 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce4d4315-73fd-4c38-83bf-29730e67ac2a" -d '{"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-plugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:10.490514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:10.530725 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b5908bb-7b01-4fca-9ca5-1b3da721e872 x-openstack-request-id: req-7b5908bb-7b01-4fca-9ca5-1b3da721e872 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:10.530725 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-plugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:10.534971 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7b5908bb-7b01-4fca-9ca5-1b3da721e872 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:10.534971 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'code': 200} Dec 21 04:56:10.550454 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:10.597035 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:10.624545 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:56:10.629060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecafd6f2-dc95-47f1-9f2f-2a053d7dbb1f req-5a43a06f-c8ea-4fd3-b36e-308cee2c5530 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:10.630552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecafd6f2-dc95-47f1-9f2f-2a053d7dbb1f req-5a43a06f-c8ea-4fd3-b36e-308cee2c5530 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0562482 Dec 21 04:56:10.676933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecafd6f2-dc95-47f1-9f2f-2a053d7dbb1f req-ad874d02-bdb7-46f4-86ab-ffb0a816628c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402372 Dec 21 04:56:12.055403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf92f3a2-07cd-4e26-a7bd-385c7d7df351 req-044dba0a-363b-46b1-903e-b8f5512b13cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:12.057682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf92f3a2-07cd-4e26-a7bd-385c7d7df351 req-044dba0a-363b-46b1-903e-b8f5512b13cd tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0498137 Dec 21 04:56:12.105728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bf92f3a2-07cd-4e26-a7bd-385c7d7df351 req-2a01e3a1-eec4-4c4a-9513-cd0fb6874166 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419073 Dec 21 04:56:13.222147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ece1a19f-87ae-4724-bf20-114ebbfb3bdd req-3d1b6817-aded-47bf-9603-7cd62367e1f7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:13.223598 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ece1a19f-87ae-4724-bf20-114ebbfb3bdd req-3d1b6817-aded-47bf-9603-7cd62367e1f7 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0494936 Dec 21 04:56:13.276316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ece1a19f-87ae-4724-bf20-114ebbfb3bdd req-a8835c69-b78e-4e34-897e-75bd8dbcefd0 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466793 Dec 21 04:56:14.400663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b20f6c2-9a24-4b3a-b214-c565a12e440b req-f19c05f0-15b8-4a82-9803-b27cae4d334a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:14.402142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b20f6c2-9a24-4b3a-b214-c565a12e440b req-f19c05f0-15b8-4a82-9803-b27cae4d334a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0545428 Dec 21 04:56:14.448036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9b20f6c2-9a24-4b3a-b214-c565a12e440b req-a83b83e1-0201-498f-b2e4-bdb70ac9f749 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399179 Dec 21 04:56:15.501592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-19e26173-899b-4a97-9ee5-2cfedf81c28a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:15.503147 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-19e26173-899b-4a97-9ee5-2cfedf81c28a service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91&tenant_id=684628052e674280965f258699338238 HTTP/1.1" status: 200 len: 1097 time: 0.0419152 Dec 21 04:56:15.523160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:56:15.569740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45543057-7627-4ef8-833c-6a2670e6eb48 req-00a41424-fa14-468f-a285-60fd798dd85b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:15.571416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45543057-7627-4ef8-833c-6a2670e6eb48 req-00a41424-fa14-468f-a285-60fd798dd85b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0506289 Dec 21 04:56:15.580408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:15.619505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45543057-7627-4ef8-833c-6a2670e6eb48 req-cbdc2459-2014-4990-a4fb-b7439dbf4128 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418494 Dec 21 04:56:15.783922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:15.816007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:56:15.854660 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:15.856913 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-299fc165-de1a-49b5-b097-d452e7a2ba94" -d '{"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-unplugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:15.860620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:15.874245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Transition to ACTIVE for port object c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:56:15.908162 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7754670-5c1c-44a6-a22b-f5a10e84a569 x-openstack-request-id: req-f7754670-5c1c-44a6-a22b-f5a10e84a569 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:15.908461 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-unplugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:15.908723 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-f7754670-5c1c-44a6-a22b-f5a10e84a569 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:15.909132 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'code': 200} Dec 21 04:56:15.938718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:16.016917 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:16.032074 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.032433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.032783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.033127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.033462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.033795 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.034179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.034455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.034783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.035155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.035488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.035814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.036140 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:56:16.073956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] No DVR routers for this DVR port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:56:16.207462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:56:16.207792 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:56:16.208116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:56:16.212260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:56:16.212577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Attempting to bind port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on network fc0ae40f-7660-4c02-8692-f49eb5531fe8 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:56:16.217286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 55, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:56:16.217616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Checking segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:56:16.217996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Bound using segment: {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:56:16.218410 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Bound port: c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f5185c-a794-4d79-83a8-8df408b86384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:56:16.218753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:16.274038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:56:16.281167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:56:16.284334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:56:16.314753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 04:56:16.315170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:56:16.367838 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:16.406145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:16.406756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:16.408142 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] 10.222.0.54 "PUT /v2.0/ports/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 1093 time: 0.8891783 Dec 21 04:56:16.426005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0069c933-36bb-4454-9c40-e91f010316a6 service neutron] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=11']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:16.489297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-6cba8760-e125-48ae-89d9-1b23aa109fc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:16.491471 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-6cba8760-e125-48ae-89d9-1b23aa109fc1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1096 time: 0.0435541 Dec 21 04:56:16.590724 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-e6fe9b54-038c-430c-b260-3c020f52078d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:16.592304 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-e6fe9b54-038c-430c-b260-3c020f52078d service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0935111 Dec 21 04:56:16.661139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-ea44c028-2874-4e60-afd1-90d48d9ae2e6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0608289 Dec 21 04:56:16.710323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-9148ed96-7c9b-4196-a240-bd9d1fbdcde6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:16.711746 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-9148ed96-7c9b-4196-a240-bd9d1fbdcde6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0439239 Dec 21 04:56:16.743657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d064f8a4-3fe4-4f85-bb57-ed30a93422ab req-4dfb1d87-a563-459b-83f1-140707e95919 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:16.745143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d064f8a4-3fe4-4f85-bb57-ed30a93422ab req-4dfb1d87-a563-459b-83f1-140707e95919 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0535092 Dec 21 04:56:16.760973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0b78b3da-ea5d-43e2-a0e0-a2d3936ae483 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:16.763298 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-0b78b3da-ea5d-43e2-a0e0-a2d3936ae483 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0436211 Dec 21 04:56:16.793135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d064f8a4-3fe4-4f85-bb57-ed30a93422ab req-52ba59c9-72f1-4a91-b50b-334d9cdd679e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413454 Dec 21 04:56:16.853584 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-902a8d99-d4d7-45f6-af0d-24e3219b8f8b service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826123 Dec 21 04:56:16.947564 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc0db428-b8e7-4c3f-afe9-a92d095584e9 req-1412113f-32c4-4869-8c54-39e7a1b11c91 service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860393 Dec 21 04:56:17.911021 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:17.913322 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797" -d '{"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:17.914088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf8bd09-9019-44c8-9c89-885caaee8aae req-b4b9facf-5324-4848-90ca-0930a0b222a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:17.915667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bf8bd09-9019-44c8-9c89-885caaee8aae req-b4b9facf-5324-4848-90ca-0930a0b222a8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0518835 Dec 21 04:56:17.962468 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a36c341b-1ed9-4813-92ab-dbba4a415200 x-openstack-request-id: req-a36c341b-1ed9-4813-92ab-dbba4a415200 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:17.962765 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:17.963046 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a36c341b-1ed9-4813-92ab-dbba4a415200 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:17.963727 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'status': 'completed', 'code': 200} Dec 21 04:56:17.969149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7bf8bd09-9019-44c8-9c89-885caaee8aae req-d96f8500-669f-4e4e-8cfd-f9d284d9b6b6 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467095 Dec 21 04:56:18.044998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-323a5187-74c5-464b-8bd8-d9693a1db015 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.046548 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-323a5187-74c5-464b-8bd8-d9693a1db015 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1096 time: 0.0416174 Dec 21 04:56:18.061800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-14e23e0d-8bc3-4dae-9181-e7f18557c6b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.063484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-14e23e0d-8bc3-4dae-9181-e7f18557c6b3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=684628052e674280965f258699338238&device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 1096 time: 0.0425892 Dec 21 04:56:18.143073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-de162c46-20f5-4c3b-89b9-964e3bc7b73b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.144559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-de162c46-20f5-4c3b-89b9-964e3bc7b73b service neutron] 10.222.0.54 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0911071 Dec 21 04:56:18.165910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-8980a23b-7c94-441e-8fd2-9524c0aca6be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.167435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-8980a23b-7c94-441e-8fd2-9524c0aca6be service neutron] 10.222.0.31 "GET /v2.0/networks?id=fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 200 len: 912 time: 0.0904882 Dec 21 04:56:18.224959 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-74aa392a-e281-4fbe-b8c7-e306373accca service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0733218 Dec 21 04:56:18.250734 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-1096be8d-0c3d-400d-b83f-3d95fbdee4d1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 200 len: 999 time: 0.0717587 Dec 21 04:56:18.276767 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-172605ee-84cd-4b99-bddd-232cbab685f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.278333 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-172605ee-84cd-4b99-bddd-232cbab685f0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0444365 Dec 21 04:56:18.307937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-543868a9-c36d-4ab2-b9ae-d8f13245e67d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.309546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-543868a9-c36d-4ab2-b9ae-d8f13245e67d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 200 len: 850 time: 0.0466757 Dec 21 04:56:18.328214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-354e3761-9071-409e-90e2-8fce2ca5d524 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.330966 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-354e3761-9071-409e-90e2-8fce2ca5d524 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0436749 Dec 21 04:56:18.360424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-57736680-2ee3-4890-b90f-7ce17de610fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:18.362020 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-57736680-2ee3-4890-b90f-7ce17de610fb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fc0ae40f-7660-4c02-8692-f49eb5531fe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0412512 Dec 21 04:56:18.423431 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-14887712-4620-4283-a74d-00ab6823c42e service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861304 Dec 21 04:56:18.465500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-688d8937-737d-497f-b493-35b83de1124b service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909224 Dec 21 04:56:18.524018 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-c0843d3b-58d6-4816-ba2d-2b57f44da4da service neutron] 10.222.0.54 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0937309 Dec 21 04:56:18.572235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-12ff1526-b1e3-44b1-b3b6-d9436a8ad797 req-58df5c65-2cf7-4912-aa86-fed5e79bff41 service neutron] 10.222.0.31 "GET /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955782 Dec 21 04:56:19.088553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32aae640-039d-4d20-9d34-d53f9a12e66d req-d82798a5-099c-4768-bffb-6acceccec23d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:19.090047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32aae640-039d-4d20-9d34-d53f9a12e66d req-d82798a5-099c-4768-bffb-6acceccec23d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0492313 Dec 21 04:56:19.141136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32aae640-039d-4d20-9d34-d53f9a12e66d req-3badc10b-5030-4c9f-ba88-f59400cfadd8 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447283 Dec 21 04:56:19.910201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-55b124dd-8522-4021-a295-57ebf30eb326 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:20.257597 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bb1ce6-ca7e-4c3a-bc0b-58aa9a9341a9 req-8b4cee24-6d2b-4b79-b73e-e4910de277ee tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:20.259158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bb1ce6-ca7e-4c3a-bc0b-58aa9a9341a9 req-8b4cee24-6d2b-4b79-b73e-e4910de277ee tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0492494 Dec 21 04:56:20.307321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bb1ce6-ca7e-4c3a-bc0b-58aa9a9341a9 req-f150aed4-b9fc-4aa2-8024-d168eaa68e36 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417979 Dec 21 04:56:21.426040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1c2136-b5b8-47f2-82b7-af51c973c907 req-8ff90136-393f-4d1e-ba6a-9ecfc871276c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:21.428172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d1c2136-b5b8-47f2-82b7-af51c973c907 req-8ff90136-393f-4d1e-ba6a-9ecfc871276c tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0508616 Dec 21 04:56:21.477716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3d1c2136-b5b8-47f2-82b7-af51c973c907 req-3efcf515-5a26-4b8f-937e-97af3862b284 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432527 Dec 21 04:56:22.598061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734ebbc0-2e6b-4dfe-9b7d-52345b2a56e2 req-3a263f4c-e267-4bc7-876a-2f493fdfda5f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:22.600057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-734ebbc0-2e6b-4dfe-9b7d-52345b2a56e2 req-3a263f4c-e267-4bc7-876a-2f493fdfda5f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0517540 Dec 21 04:56:22.646872 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-734ebbc0-2e6b-4dfe-9b7d-52345b2a56e2 req-204f2ba5-70a6-4617-942e-4aeb59e5c1eb tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408978 Dec 21 04:56:22.727335 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dc2deee3-db69-454b-ad57-b55f3525241f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:23.549616 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:23.584679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:23.764067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-106e83bc-5429-4824-a454-f91fdb0a1c00 req-f0ec3326-537e-44f4-94f9-efb31c71348d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:23.765541 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-106e83bc-5429-4824-a454-f91fdb0a1c00 req-f0ec3326-537e-44f4-94f9-efb31c71348d tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0493910 Dec 21 04:56:23.811084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-106e83bc-5429-4824-a454-f91fdb0a1c00 req-4a3acb26-7932-4024-a7ad-382d5d1776ff tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394318 Dec 21 04:56:24.930413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6534b4bf-e32a-4e23-9d92-755de74a99ab req-805afe16-6669-41b3-962d-d2a14923c263 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:24.931897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6534b4bf-e32a-4e23-9d92-755de74a99ab req-805afe16-6669-41b3-962d-d2a14923c263 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0508327 Dec 21 04:56:24.978375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6534b4bf-e32a-4e23-9d92-755de74a99ab req-00c26c97-5ada-474b-a2c9-84f359fd04fe tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406749 Dec 21 04:56:25.333119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:25.401100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:25.795922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:26.095549 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a4a19f-2cfb-4310-8064-cd6ddb37984b req-8555fe1e-3d0d-4878-9d86-8ec5e6f82b12 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:26.097014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78a4a19f-2cfb-4310-8064-cd6ddb37984b req-8555fe1e-3d0d-4878-9d86-8ec5e6f82b12 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0482256 Dec 21 04:56:26.142791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78a4a19f-2cfb-4310-8064-cd6ddb37984b req-43cdbfea-b8b7-471e-bd06-12c3bf679ada tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393484 Dec 21 04:56:27.260847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7994793-8897-4426-843e-bea9d2805020 req-af211d9d-b4c3-4511-a44a-bb6c77d8432a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:27.262266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7994793-8897-4426-843e-bea9d2805020 req-af211d9d-b4c3-4511-a44a-bb6c77d8432a tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0497110 Dec 21 04:56:27.320997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7994793-8897-4426-843e-bea9d2805020 req-cffab6d9-347a-4e6a-bb25-911f809cb302 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463626 Dec 21 04:56:28.435231 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829e5181-3d6d-402f-8af2-0e041e15076b req-baad5694-da89-4542-be05-212cdf503687 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:28.436682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-829e5181-3d6d-402f-8af2-0e041e15076b req-baad5694-da89-4542-be05-212cdf503687 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0479040 Dec 21 04:56:28.483743 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-829e5181-3d6d-402f-8af2-0e041e15076b req-74f2adaa-8558-497a-9638-23fd6ba10434 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412147 Dec 21 04:56:29.463167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:56:29.557593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:29.568348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'port_id': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'mac_address': 'fa:16:3e:00:70:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:56:29.611979 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:29.620604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ada2c1c-bec4-4cfc-9e2a-2570977ad0cc req-c2ece652-5daf-48c8-9702-fde3571d6716 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:29.622750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ada2c1c-bec4-4cfc-9e2a-2570977ad0cc req-c2ece652-5daf-48c8-9702-fde3571d6716 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 944 time: 0.0685289 Dec 21 04:56:29.625999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:56:29.647028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:29.673025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ada2c1c-bec4-4cfc-9e2a-2570977ad0cc req-997ccaf0-4dec-4f7a-97cf-d3050282f338 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437891 Dec 21 04:56:29.727566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:29.775062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:29.794882 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f982b65-533e-4fcd-960b-a25fadc76a18 req-fb9049cf-14f4-45f9-ac91-f422adad0b95 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:29.796384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f982b65-533e-4fcd-960b-a25fadc76a18 req-fb9049cf-14f4-45f9-ac91-f422adad0b95 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0526686 Dec 21 04:56:29.842045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f982b65-533e-4fcd-960b-a25fadc76a18 req-0133155b-9516-4856-a22a-0d68ed04ff4e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396950 Dec 21 04:56:29.871166 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:56:29.955116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d65d94-99d2-4baf-8a0d-17e8906764dd req-e1057320-6e32-48fa-9c8e-724e0ad51cd5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:29.956594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2d65d94-99d2-4baf-8a0d-17e8906764dd req-e1057320-6e32-48fa-9c8e-724e0ad51cd5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0480831 Dec 21 04:56:30.003418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f2d65d94-99d2-4baf-8a0d-17e8906764dd req-b5520801-3851-48d5-bce2-a7c89b8929a1 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403407 Dec 21 04:56:30.031571 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:56:30.365189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17831c8-6083-4849-ac78-207c50486fd7 req-fd2a36c5-70a1-449f-aa54-8f969b599b1f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:30.366657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17831c8-6083-4849-ac78-207c50486fd7 req-fd2a36c5-70a1-449f-aa54-8f969b599b1f tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0477006 Dec 21 04:56:30.416473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c17831c8-6083-4849-ac78-207c50486fd7 req-61bd072b-da2d-4999-b3d5-041ef3b22ee5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438437 Dec 21 04:56:31.479106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:56:31.532742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33eaf950-bd0d-4b67-ae24-a55b26b4e169 req-98cd983e-0750-4c21-8377-45cce68969a3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:31.534894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33eaf950-bd0d-4b67-ae24-a55b26b4e169 req-98cd983e-0750-4c21-8377-45cce68969a3 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 945 time: 0.0490847 Dec 21 04:56:31.578594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:56:31.581954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-33eaf950-bd0d-4b67-ae24-a55b26b4e169 req-56a7ab42-9ab3-4641-908e-ad2105ce58ca tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411386 Dec 21 04:56:31.586545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:56:31.586545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:31.664089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:31.686322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:31.688586 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eee71836-fb54-4dc8-b8c2-f5188f3c365a" -d '{"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-plugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:31.700992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:31.724911 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10a10501-8d07-4647-9228-5113211b32a4 x-openstack-request-id: req-10a10501-8d07-4647-9228-5113211b32a4 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:31.725217 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-plugged", "status": "completed", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:31.725561 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-10a10501-8d07-4647-9228-5113211b32a4 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:31.725860 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'code': 200} Dec 21 04:56:31.755827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:31.803908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=13']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:32.137099 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-a642c0e9-6928-4006-b7c9-ab95b05669c5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:32.138418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-a642c0e9-6928-4006-b7c9-ab95b05669c5 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 946 time: 0.0481086 Dec 21 04:56:32.225755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Deleting port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:56:32.226187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:32.337766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] For port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:32.338122 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:32.501479 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:32.501879 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:32.502179 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0 disassociated. External IP: 172.25.5.55, port: c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a. Dec 21 04:56:32.502520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Calling delete_port for c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:56:32.704511 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95b2f7a-4022-4c8e-9287-c05b83fbfb8c req-573d7de3-4313-41fe-bca4-8f5073eccc67 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:32.706098 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c95b2f7a-4022-4c8e-9287-c05b83fbfb8c req-573d7de3-4313-41fe-bca4-8f5073eccc67 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 946 time: 0.0507646 Dec 21 04:56:32.756307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c95b2f7a-4022-4c8e-9287-c05b83fbfb8c req-6ed258e5-d207-4a67-81bb-90b41925d02e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups?id=f316a23c-9c52-424d-a1e8-aa67bc3eba50&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440631 Dec 21 04:56:33.007234 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:33.034962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event deleted for resources: {'Port': ['ID=c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:33.151678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:56:33.268277 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:56:33.278746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:56:33.289145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:56:33.289767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:56:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:33.310125 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] No DVR routers for this DVR port c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:56:33.312744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:33.316128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-df9026c0-0379-4d9c-9011-1a6265e41c84 req-3e7ae9a1-e74e-489b-b6cb-1babc0155edf tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.54 "DELETE /v2.0/ports/c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a HTTP/1.1" status: 204 len: 173 time: 1.1704822 Dec 21 04:56:33.316569 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-deleted', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:33.318858 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b04ffd83-8b97-42e2-86a4-6e3e34a5e18a" -d '{"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-deleted", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:33.357011 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-324eba35-2397-45c2-8ff8-9352bba2b3c6 x-openstack-request-id: req-324eba35-2397-45c2-8ff8-9352bba2b3c6 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:33.357387 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feae03ff-cfea-4e38-847b-a6cad3da1c91", "name": "network-vif-deleted", "tag": "c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:33.357891 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-324eba35-2397-45c2-8ff8-9352bba2b3c6 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:33.358301 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feae03ff-cfea-4e38-847b-a6cad3da1c91', 'name': 'network-vif-deleted', 'tag': 'c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a', 'status': 'completed', 'code': 200} Dec 21 04:56:33.397771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:56:33.613371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:33.641370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:56:33.651392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:56:33.652017 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:56:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:33.761805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:56:33.863483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42f6bef4-eed1-4ecf-8faa-80861b063fc9 req-c5425c70-652b-43a6-a3de-5462deefce70 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0333521 Dec 21 04:56:33.985716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:34.016128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8910a122-ced1-4ecc-95d9-9d0999b40859 None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:45:59Z', 'revision_number': 4, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '1ffa1487-395d-47a0-8d58-ee6681b0e531', 'name': '', 'network_id': 'fc0ae40f-7660-4c02-8692-f49eb5531fe8', 'tenant_id': '684628052e674280965f258699338238', 'mac_address': 'fa:16:3e:e0:2a:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:59Z', 'updated_at': '2021-12-21T04:46:03Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'subnets': [{'id': 'a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:56:34.242051 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b773fb04-267d-4663-9955-71c1609f3449 None None] New status for floating IP 107ec780-6cdd-4fdc-886a-90ca42f9c9c0: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 04:56:34.969654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97fed5cc-a29e-4f3e-a1e8-7e5a6c5a0571 req-03c916b1-51d8-4e47-868a-f79d7484278b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0286160 Dec 21 04:56:36.066125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d85190e-746b-4b49-8718-b1b60cbfc1ad req-e9c26057-12d8-46e9-8e93-03e9c8896c10 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0267038 Dec 21 04:56:37.161571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f7bd357d-7bf5-4575-a1fa-2d00243b9c3c req-43831f39-3874-4ed2-88a1-e2203f158142 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0261800 Dec 21 04:56:37.510794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:56:37.530691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:56:37.531087 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device c7051fa0-f0d8-45cf-b8fa-9bc4c597ec1a not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:56:38.267138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5fc9d0ce-3fbf-424b-a0eb-0afb547df6f3 req-653d27f4-8229-45c1-bdb5-b9305f6c562e tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/ports?device_id=feae03ff-cfea-4e38-847b-a6cad3da1c91 HTTP/1.1" status: 200 len: 210 time: 0.0254400 Dec 21 04:56:43.251852 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50244) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:43.314401 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ca1dd8a-4581-475f-b509-cef47a71c719 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.341792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ca1dd8a-4581-475f-b509-cef47a71c719 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.459454 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ca1dd8a-4581-475f-b509-cef47a71c719 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.462245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4ca1dd8a-4581-475f-b509-cef47a71c719 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.463531 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4ca1dd8a-4581-475f-b509-cef47a71c719 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "DELETE /v2.0/security-groups/f316a23c-9c52-424d-a1e8-aa67bc3eba50 HTTP/1.1" status: 204 len: 168 time: 0.2106674 Dec 21 04:56:43.466327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50246) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:43.474110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca1dd8a-4581-475f-b509-cef47a71c719 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f316a23c-9c52-424d-a1e8-aa67bc3eba50,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:43.481660 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [None req-d88a3b95-0b57-4838-9762-d23d4604c95b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] show failed (client error): The resource could not be found. Dec 21 04:56:43.482915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d88a3b95-0b57-4838-9762-d23d4604c95b tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "GET /v2.0/security-groups/f316a23c-9c52-424d-a1e8-aa67bc3eba50 HTTP/1.1" status: 404 len: 347 time: 0.0154498 Dec 21 04:56:43.485786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50248) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:43.610773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Deleting port 6c639e34-d366-48a6-be55-624f325a0219 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:56:43.611165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.706407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.706624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.718850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Calling delete_port for 6c639e34-d366-48a6-be55-624f325a0219 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:56:43.916093 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:43.940456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Pushing event deleted for resources: {'Port': ['ID=6c639e34-d366-48a6-be55-624f325a0219,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:44.007207 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:44.009886 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:44.011130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-758e6915-c415-40ba-ba0a-823ef2bb1813 tempest-ServerActionsTestJSON-1138524203 tempest-ServerActionsTestJSON-1138524203-project] 10.222.0.18 "DELETE /v2.0/floatingips/107ec780-6cdd-4fdc-886a-90ca42f9c9c0 HTTP/1.1" status: 204 len: 168 time: 0.5241907 Dec 21 04:56:44.013953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50250) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:44.539793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:44.774915 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Deleting port 1ffa1487-395d-47a0-8d58-ee6681b0e531 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:56:44.775282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:44.849707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] For port 1ffa1487-395d-47a0-8d58-ee6681b0e531, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1ffa1487-395d-47a0-8d58-ee6681b0e531,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:44.849975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:44.861177 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Calling delete_port for 1ffa1487-395d-47a0-8d58-ee6681b0e531 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:56:45.115804 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:45.141218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Pushing event deleted for resources: {'Port': ['ID=1ffa1487-395d-47a0-8d58-ee6681b0e531,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:45.308705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:45.528466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Router 9fadfb45-221e-4dae-8d11-274585fd6638 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:56:45.972135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:56:45.977710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ffd3c7c8-cae3-4926-9129-86906aa69ffe admin admin] 10.222.0.18 "PUT /v2.0/routers/9fadfb45-221e-4dae-8d11-274585fd6638/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9627845 Dec 21 04:56:45.980263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50254) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:45.983121 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] Sync routers for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:56:45.993479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:56:45.994157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:56:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:46.080963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.097466 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:56:46.180925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.271769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66'}], 'enable_snat': True}, 'gw_port_id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:56:44Z', 'revision_number': 5, 'project_id': '684628052e674280965f258699338238', 'gw_port': {'id': '30aeec0a-1fc6-4a88-a74c-65103927c2b1', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:85:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:45:57Z', 'updated_at': '2021-12-21T04:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:46.295054 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Deleting port 30aeec0a-1fc6-4a88-a74c-65103927c2b1 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:56:46.295396 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.298271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] Checking router: 9fadfb45-221e-4dae-8d11-274585fd6638 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:56:46.306394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] Routers {'9fadfb45-221e-4dae-8d11-274585fd6638'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:56:46.307021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:56:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['9fadfb45-221e-4dae-8d11-274585fd6638'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:46.371433 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] For port 30aeec0a-1fc6-4a88-a74c-65103927c2b1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=30aeec0a-1fc6-4a88-a74c-65103927c2b1,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:46.371798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.383148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Calling delete_port for 30aeec0a-1fc6-4a88-a74c-65103927c2b1 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:56:46.390950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] Set router 9fadfb45-221e-4dae-8d11-274585fd6638 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:56:46.441111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:56:46Z', 'revision_number': 6, 'project_id': '684628052e674280965f258699338238', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:46.469705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25258974-faab-4c3e-96a3-e79071c01dab None None] The sync data for ids ['9fadfb45-221e-4dae-8d11-274585fd6638'] in n-d-822053-11 is: [{'id': '9fadfb45-221e-4dae-8d11-274585fd6638', 'name': 'tempest-ServerActionsTestJSON-457471715-router', 'tenant_id': '684628052e674280965f258699338238', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:45:56Z', 'updated_at': '2021-12-21T04:56:46Z', 'revision_number': 6, 'project_id': '684628052e674280965f258699338238', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:56:46.601737 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.631543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Pushing event deleted for resources: {'Port': ['ID=30aeec0a-1fc6-4a88-a74c-65103927c2b1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:46.645065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e445ce4-e88b-4d8a-9567-9be11022c93e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:56:46.690683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.778920 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.780982 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.892955 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.893537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9fadfb45-221e-4dae-8d11-274585fd6638 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:56:46.898681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.899978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c1ee2693-e76e-4330-b8e9-05fd20db0958 admin admin] 10.222.0.18 "DELETE /v2.0/routers/9fadfb45-221e-4dae-8d11-274585fd6638 HTTP/1.1" status: 204 len: 168 time: 0.9187653 Dec 21 04:56:46.902394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50256) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:46.946738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Deleting subnet a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:56:46.949755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:46.984084 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.061037 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.173377 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.201805 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.206421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5 HTTP/1.1" status: 204 len: 168 time: 0.3026645 Dec 21 04:56:47.207864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd90488c-9aaa-4276-9da5-a5f52f06fa65 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a2cfb25d-b889-4ade-8bb7-cbaa4d7c5fa5,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:47.208129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-959a8c10-cd00-4690-9841-b8397abb56d3 None None] Network fc0ae40f-7660-4c02-8692-f49eb5531fe8 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:56:47.208841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50258) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:47.301027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ffa1487-395d-47a0-8d58-ee6681b0e531 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:56:47.303351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.323095 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1ffa1487-395d-47a0-8d58-ee6681b0e531 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:56:47.323448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1ffa1487-395d-47a0-8d58-ee6681b0e531 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:56:47.323876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30aeec0a-1fc6-4a88-a74c-65103927c2b1 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:56:47.344531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 30aeec0a-1fc6-4a88-a74c-65103927c2b1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:56:47.344885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 30aeec0a-1fc6-4a88-a74c-65103927c2b1 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:56:47.369840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Deleting port ee962e15-6e89-48a1-a53f-396aa9cc086d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:56:47.370172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.423344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] DHCP port deletion for fc0ae40f-7660-4c02-8692-f49eb5531fe8 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:56:47.437068 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] For port ee962e15-6e89-48a1-a53f-396aa9cc086d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ee962e15-6e89-48a1-a53f-396aa9cc086d,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:47.437453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.450149 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Calling delete_port for ee962e15-6e89-48a1-a53f-396aa9cc086d owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:56:47.472377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] Deleting port ee962e15-6e89-48a1-a53f-396aa9cc086d {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:56:47.472869 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.624256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.648900 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Pushing event deleted for resources: {'Port': ['ID=ee962e15-6e89-48a1-a53f-396aa9cc086d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:47.654326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] No DVR routers for this DVR port ee962e15-6e89-48a1-a53f-396aa9cc086d on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:56:47.709972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] For port ee962e15-6e89-48a1-a53f-396aa9cc086d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ee962e15-6e89-48a1-a53f-396aa9cc086d,segment=NetworkSegment(81f5185c-a794-4d79-83a8-8df408b86384),segment_id=81f5185c-a794-4d79-83a8-8df408b86384)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:47.710272 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.723098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] Calling delete_port for ee962e15-6e89-48a1-a53f-396aa9cc086d owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:56:47.725051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.748428 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc0ae40f-7660-4c02-8692-f49eb5531fe8']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:47.757559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '81f5185c-a794-4d79-83a8-8df408b86384') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:47.757853 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '81f5185c-a794-4d79-83a8-8df408b86384') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:56:47.767131 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.780355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.787990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:56:47.788374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:56:47.790080 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:56:47.801374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.829957 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] Pushing event deleted for resources: {'Port': ['ID=ee962e15-6e89-48a1-a53f-396aa9cc086d,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:47.831827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d2aaac-68f9-40c6-bdaa-8503f05c05bf None None] No DVR routers for this DVR port ee962e15-6e89-48a1-a53f-396aa9cc086d on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:56:47.887208 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.892582 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:47.896341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] 10.222.0.18 "DELETE /v2.0/networks/fc0ae40f-7660-4c02-8692-f49eb5531fe8 HTTP/1.1" status: 204 len: 168 time: 0.6864536 Dec 21 04:56:47.906817 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da8b8db-c68d-45a0-8d78-c3a34e5c7024 admin admin] Pushing event deleted for resources: {'Network': ['ID=fc0ae40f-7660-4c02-8692-f49eb5531fe8,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:48.182553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50262) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:48.221810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2aa2f03d-502a-4e4e-bc67-afd1e274d27f admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=684628052e674280965f258699338238&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0380220 Dec 21 04:56:48.224123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50264) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:48.274203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2ac35fd-b186-464f-bfd4-5b0c3d2017f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:48.308252 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2ac35fd-b186-464f-bfd4-5b0c3d2017f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:48.424148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2ac35fd-b186-464f-bfd4-5b0c3d2017f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:48.427465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a2ac35fd-b186-464f-bfd4-5b0c3d2017f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:48.428662 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a2ac35fd-b186-464f-bfd4-5b0c3d2017f4 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/0a140649-b938-4ffc-8673-ac8176d2c242 HTTP/1.1" status: 204 len: 168 time: 0.2036674 Dec 21 04:56:48.436993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ac35fd-b186-464f-bfd4-5b0c3d2017f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a140649-b938-4ffc-8673-ac8176d2c242,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:49.016347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ee962e15-6e89-48a1-a53f-396aa9cc086d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:56:49.036511 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ee962e15-6e89-48a1-a53f-396aa9cc086d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:56:49.036863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ee962e15-6e89-48a1-a53f-396aa9cc086d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:56:49.414604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50286) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:49.507530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-1119183016-network', 'tenant_id': '94f434f7a6524c97955d220df41c0889'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:56:49.584376 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Made reservation on behalf of 94f434f7a6524c97955d220df41c0889 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:56:49.586823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.595301 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.668184 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.738576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.762915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:56:49.773049 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=950d69ad-b290-48ca-a35c-872e65dd9cce,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:49.777704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.778054 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Added segment 8f7eac35-b618-4f6e-98b9-65f65e31c2c5 of type vlan for network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 Dec 21 04:56:49.816377 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.927744 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.928755 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:49.929332 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.938081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f312ebd2-37ea-4307-928a-7d68d9323051 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:49.990464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] Pushing event updated for resources: {'Network': ['ID=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:49.999969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:56:50.027445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ae9cac3a-0e8c-44eb-9c8b-d32f1f618edb admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6117058 Dec 21 04:56:50.029604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50290) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:56:50.034662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Request body: {'subnet': {'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-1119183016-subnet', 'tenant_id': '94f434f7a6524c97955d220df41c0889', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:56:50.103866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Made reservation on behalf of 94f434f7a6524c97955d220df41c0889 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:56:50.106248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:50.327459 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:50.384085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dc9e7aa6-925b-449a-bf9d-6ec1d606be6d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:50.391539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Checking segment: {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:56:50.391926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Network hostable DHCP agents. Network: 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:56:50.458111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:56:50.538504 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:56:50.542499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:50.543098 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:50.546915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe698397-5a08-4510-8577-457ae738838d None None] Network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:56:50.626864 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-85407bf2-2924-4e46-84a6-c147535e13b8 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.5961688 Dec 21 04:56:50.643833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e17bf60b-6bd1-4386-bd40-472b3dc99c7a None None] Network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:56:51.041091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-74b67f62-8466-4a29-94ba-0723971b58bb tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:51.042567 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-74b67f62-8466-4a29-94ba-0723971b58bb tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/networks?id=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 HTTP/1.1" status: 200 len: 814 time: 0.1016998 Dec 21 04:56:51.057448 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-76ddf600-dd9b-45d6-a2e0-bb747879c113 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/quotas/94f434f7a6524c97955d220df41c0889 HTTP/1.1" status: 200 len: 375 time: 0.0089417 Dec 21 04:56:51.092371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-bc0b9483-3026-437c-94c2-815dce770e89 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=94f434f7a6524c97955d220df41c0889&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0297771 Dec 21 04:56:51.178511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-92019da7-9537-4cac-969c-43e9d4b5c327 service neutron] 10.222.0.18 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789673 Dec 21 04:56:51.269479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-78acaa4b-2a7d-4faa-a609-3433a6e764b2 service neutron] 10.222.0.18 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849254 Dec 21 04:56:51.482788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4b654ef9-7382-4fd9-9e45-ac859e596fe4 req-8c36a421-7b5e-49bd-ba93-616a5e35370d tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 210 time: 0.0266047 Dec 21 04:56:52.579868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-142079f3-b130-44a3-861a-02ebbe31efad req-a21e3a2d-10e8-4cc6-aa86-a238a690900b tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 210 time: 0.0265675 Dec 21 04:56:52.710351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c460cda-33c3-4fb3-8af8-cf33f135a915 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:53.469407 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-00744366-3c04-4d5a-b8e5-a98256f976d6 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:53.471173 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-00744366-3c04-4d5a-b8e5-a98256f976d6 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.54 "GET /v2.0/networks?id=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 HTTP/1.1" status: 200 len: 814 time: 0.1069567 Dec 21 04:56:53.490129 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Request body: {'port': {'device_id': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97', 'admin_state_up': True, 'tenant_id': '94f434f7a6524c97955d220df41c0889'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:56:53.504534 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:53.521496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:53.670925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8c3f206-a95b-4433-9bd2-d7b50c94604d req-feabbb46-a270-4b99-9658-8bf082e44f88 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 210 time: 0.0269017 Dec 21 04:56:53.685204 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Made reservation on behalf of 94f434f7a6524c97955d220df41c0889 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:56:53.685204 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:53.808200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Allocated IP 172.20.0.11 (48c0ec1d-5cb9-4e2b-a948-f4b61a508f97/dc9e7aa6-925b-449a-bf9d-6ec1d606be6d/fde35d0b-f223-4803-af79-96c463346e0e) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:56:53.951260 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.035925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.079653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:56:54.082635 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:56:54.086858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:56:54.093353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Pushing event updated for resources: {'Port': ['ID=fde35d0b-f223-4803-af79-96c463346e0e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:54.142391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:54.143019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.238296 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-e68702db-3462-473b-9e06-18d2b702b234 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7520883 Dec 21 04:56:54.258278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Request body: {'port': {'device_id': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:56:54.309979 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.567165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fde35d0b-f223-4803-af79-96c463346e0e {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:56:54.575166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.587010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Transition to ACTIVE for port object fde35d0b-f223-4803-af79-96c463346e0e will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:56:54.664014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.715788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Pushing event updated for resources: {'Port': ['ID=fde35d0b-f223-4803-af79-96c463346e0e,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:54.783644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Attempting to bind port fde35d0b-f223-4803-af79-96c463346e0e on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:56:54.783985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Attempting to bind port fde35d0b-f223-4803-af79-96c463346e0e by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:56:54.784315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Attempting to bind port fde35d0b-f223-4803-af79-96c463346e0e on network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:56:54.784870 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b08b155a-0b81-4259-a7f2-427c4581bb00 req-b45b9234-9b36-4b0e-a1ff-14b2dab0e2e9 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:54.786366 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b08b155a-0b81-4259-a7f2-427c4581bb00 req-b45b9234-9b36-4b0e-a1ff-14b2dab0e2e9 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 944 time: 0.0477297 Dec 21 04:56:54.789223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Port fde35d0b-f223-4803-af79-96c463346e0e on network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:56:54.789543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Attempting to bind port fde35d0b-f223-4803-af79-96c463346e0e on network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:56:54.794353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 56, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:56:54.794693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Checking segment: {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:56:54.795111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Bound using segment: {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:56:54.795534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Bound port: fde35d0b-f223-4803-af79-96c463346e0e, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:56:54.795888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.838565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b08b155a-0b81-4259-a7f2-427c4581bb00 req-94d2b424-57e6-4dda-abfc-689bdfb58199 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455048 Dec 21 04:56:54.862296 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] For port fde35d0b-f223-4803-af79-96c463346e0e, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:56:54.865313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] For port fde35d0b-f223-4803-af79-96c463346e0e, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fde35d0b-f223-4803-af79-96c463346e0e,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:56:54.955738 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.993530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:54.994155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:54.995631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] 10.222.0.54 "PUT /v2.0/ports/fde35d0b-f223-4803-af79-96c463346e0e HTTP/1.1" status: 200 len: 1093 time: 0.7420352 Dec 21 04:56:54.996069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'tag': 'fde35d0b-f223-4803-af79-96c463346e0e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:54.998358 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71" -d '{"events": [{"name": "network-changed", "server_uuid": "7fdd2f69-1e41-4786-9c8e-2454790e2955", "tag": "fde35d0b-f223-4803-af79-96c463346e0e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:55.024478 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ee8aa4-6241-4c3b-b7ce-81fd2d46cca7 service neutron] Pushing event updated for resources: {'Port': ['ID=fde35d0b-f223-4803-af79-96c463346e0e,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:55.034618 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab205594-ae86-4bc3-992b-ecefbbf372e7 x-openstack-request-id: req-ab205594-ae86-4bc3-992b-ecefbbf372e7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:55.034991 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7fdd2f69-1e41-4786-9c8e-2454790e2955", "tag": "fde35d0b-f223-4803-af79-96c463346e0e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:55.035260 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ab205594-ae86-4bc3-992b-ecefbbf372e7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:55.035670 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'tag': 'fde35d0b-f223-4803-af79-96c463346e0e', 'status': 'completed', 'code': 200} Dec 21 04:56:55.118144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71 req-59e3b4e7-da1d-4975-826a-6facb3c75894 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:55.119571 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71 req-59e3b4e7-da1d-4975-826a-6facb3c75894 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=94f434f7a6524c97955d220df41c0889&device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 1096 time: 0.0416539 Dec 21 04:56:55.227386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71 req-39a9437f-d0f1-4060-8603-8933a014f11d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:55.228945 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71 req-39a9437f-d0f1-4060-8603-8933a014f11d service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=94f434f7a6524c97955d220df41c0889&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0931754 Dec 21 04:56:55.298905 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:55.323791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71 req-bc7dc8fd-218a-40a2-a153-10b9a935618a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:55.325257 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ef13a074-64ca-45d0-9e0f-b7b66d7e5b71 req-bc7dc8fd-218a-40a2-a153-10b9a935618a service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0891802 Dec 21 04:56:55.424479 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:55.426111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-138e0e40-9701-488b-9055-f060aa62602b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:55.427635 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-138e0e40-9701-488b-9055-f060aa62602b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=94f434f7a6524c97955d220df41c0889&device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 1096 time: 0.0409584 Dec 21 04:56:55.481370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-c06fe859-64dd-4b38-9cbb-87a5aa83ffd3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fde35d0b-f223-4803-af79-96c463346e0e HTTP/1.1" status: 200 len: 217 time: 0.0382671 Dec 21 04:56:55.531790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3762e8-253a-4625-bf08-caab165f8bed req-292b160d-d8d5-4110-aace-6feec1e77e60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:55.533299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-292b160d-d8d5-4110-aace-6feec1e77e60 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=dc9e7aa6-925b-449a-bf9d-6ec1d606be6d HTTP/1.1" status: 200 len: 854 time: 0.0445008 Dec 21 04:56:55.563717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-64b43c9b-01c8-45f9-a971-16bf1b1b5228 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234144 Dec 21 04:56:55.657043 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-32a41f03-4a33-4f32-ade7-fadf89912d0e service neutron] 10.222.0.54 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859580 Dec 21 04:56:55.747337 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8b3762e8-253a-4625-bf08-caab165f8bed req-697739da-701a-4f70-934b-1f9f96b50ff3 service neutron] 10.222.0.54 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0808933 Dec 21 04:56:55.806744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:55.965179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05776ec9-de39-44a6-8b84-ccfc7c5eab4a req-f4e91c56-b5ba-4365-a0e4-9de159abedaf tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:55.966664 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05776ec9-de39-44a6-8b84-ccfc7c5eab4a req-f4e91c56-b5ba-4365-a0e4-9de159abedaf tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 944 time: 0.0606720 Dec 21 04:56:56.013390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-05776ec9-de39-44a6-8b84-ccfc7c5eab4a req-ebc1146d-c6e9-4031-bc3c-3a835cd82418 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404005 Dec 21 04:56:57.127228 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012d30ee-54a9-40fb-a383-8db015d24cbf req-bff40c53-e118-4846-8606-713306ecb403 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:57.128701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-012d30ee-54a9-40fb-a383-8db015d24cbf req-bff40c53-e118-4846-8606-713306ecb403 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 944 time: 0.0481303 Dec 21 04:56:57.174796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-012d30ee-54a9-40fb-a383-8db015d24cbf req-bd0b3bd5-2ee1-4b77-b37f-eb8ed534971f tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397556 Dec 21 04:56:57.645295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fde35d0b-f223-4803-af79-96c463346e0e details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:56:57.738943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port fde35d0b-f223-4803-af79-96c463346e0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fde35d0b-f223-4803-af79-96c463346e0e,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:57.749523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'fde35d0b-f223-4803-af79-96c463346e0e', 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97', 'port_id': 'fde35d0b-f223-4803-af79-96c463346e0e', 'mac_address': 'fa:16:3e:c6:fe:08', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dc9e7aa6-925b-449a-bf9d-6ec1d606be6d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:56:57.784977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:57.797755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fde35d0b-f223-4803-af79-96c463346e0e {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:56:57.819707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port fde35d0b-f223-4803-af79-96c463346e0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fde35d0b-f223-4803-af79-96c463346e0e,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:57.880920 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:57.925360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=fde35d0b-f223-4803-af79-96c463346e0e,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:56:58.142052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['fde35d0b-f223-4803-af79-96c463346e0e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:56:58.297794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ceb004-1ff2-498f-bef9-442f20e04078 req-0aa47e53-c9de-485a-a95f-4b043f18e3af tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:58.299357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4ceb004-1ff2-498f-bef9-442f20e04078 req-0aa47e53-c9de-485a-a95f-4b043f18e3af tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 945 time: 0.0571218 Dec 21 04:56:58.345519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b4ceb004-1ff2-498f-bef9-442f20e04078 req-f960eedb-2974-40bd-9c76-8f49c55e308e tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402014 Dec 21 04:56:59.464525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303493cc-b936-4e39-b878-782b1894b65f req-2422bdc1-dd36-4300-8557-e712ac3959c3 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:56:59.465987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-303493cc-b936-4e39-b878-782b1894b65f req-2422bdc1-dd36-4300-8557-e712ac3959c3 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 945 time: 0.0480292 Dec 21 04:56:59.512772 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-303493cc-b936-4e39-b878-782b1894b65f req-de657143-dcc2-4ff6-a8bf-8b37c9227ffb tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406983 Dec 21 04:56:59.670093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fde35d0b-f223-4803-af79-96c463346e0e up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:56:59.783797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port fde35d0b-f223-4803-af79-96c463346e0e completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:56:59.787747 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port fde35d0b-f223-4803-af79-96c463346e0e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:56:59.788117 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:59.868095 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:56:59.889284 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fde35d0b-f223-4803-af79-96c463346e0e'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:56:59.891531 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44037242-9e79-4787-9b12-f6b511e29ae8" -d '{"events": [{"server_uuid": "7fdd2f69-1e41-4786-9c8e-2454790e2955", "name": "network-vif-plugged", "status": "completed", "tag": "fde35d0b-f223-4803-af79-96c463346e0e"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:56:59.903959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port fde35d0b-f223-4803-af79-96c463346e0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fde35d0b-f223-4803-af79-96c463346e0e,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:56:59.929349 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:56:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3153632a-fca6-4248-8b87-84c911f11e31 x-openstack-request-id: req-3153632a-fca6-4248-8b87-84c911f11e31 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:56:59.929646 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdd2f69-1e41-4786-9c8e-2454790e2955", "name": "network-vif-plugged", "status": "completed", "tag": "fde35d0b-f223-4803-af79-96c463346e0e", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:56:59.929907 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3153632a-fca6-4248-8b87-84c911f11e31 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:56:59.930310 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fde35d0b-f223-4803-af79-96c463346e0e', 'code': 200} Dec 21 04:56:59.955663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:00.003905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=fde35d0b-f223-4803-af79-96c463346e0e,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:00.065607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c65325cc-2e6a-41ce-a48a-da6e2beed1c7 req-b5141764-953f-434c-8bcb-75aaa6ab9dc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:00.067120 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c65325cc-2e6a-41ce-a48a-da6e2beed1c7 req-b5141764-953f-434c-8bcb-75aaa6ab9dc1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 1098 time: 0.0428672 Dec 21 04:57:00.110777 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c65325cc-2e6a-41ce-a48a-da6e2beed1c7 req-97bdd0cd-ec5c-4dd5-a242-bd79ad854edb service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362368 Dec 21 04:57:00.647399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9de460d3-9fdb-4c8b-aa6e-3ba2230a2154 req-fee443ef-ccb9-467f-a50b-b8355dc76536 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:00.648962 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9de460d3-9fdb-4c8b-aa6e-3ba2230a2154 req-fee443ef-ccb9-467f-a50b-b8355dc76536 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0704553 Dec 21 04:57:00.704365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9de460d3-9fdb-4c8b-aa6e-3ba2230a2154 req-aa4e4d9f-3d23-4020-b249-101ce0e70fee tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470097 Dec 21 04:57:01.818665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a45a94d-761c-4cb2-a600-ad8f42ce6105 req-fca98168-d2bc-477b-92b5-fb3a122e8fd9 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:01.820658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a45a94d-761c-4cb2-a600-ad8f42ce6105 req-fca98168-d2bc-477b-92b5-fb3a122e8fd9 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0480235 Dec 21 04:57:01.870435 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a45a94d-761c-4cb2-a600-ad8f42ce6105 req-97cb8ab4-1484-42a9-a0ec-79267a4c797d tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437279 Dec 21 04:57:02.090258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-463df7c9-be44-4590-ac74-d432dd22f255 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:02.091770 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-463df7c9-be44-4590-ac74-d432dd22f255 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/networks?id=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 HTTP/1.1" status: 200 len: 814 time: 0.1038442 Dec 21 04:57:02.106542 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-9dadca94-5679-41bb-9629-b70434ce2505 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/quotas/94f434f7a6524c97955d220df41c0889 HTTP/1.1" status: 200 len: 375 time: 0.0088422 Dec 21 04:57:02.154741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-107ca049-081a-4d0f-bdb7-25074879dbc4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=94f434f7a6524c97955d220df41c0889&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0429595 Dec 21 04:57:02.210505 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-d3594a04-43d4-415b-8854-870e0e39d6f0 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 04:57:02.211591 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-d3594a04-43d4-415b-8854-870e0e39d6f0 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0504403 Dec 21 04:57:02.298596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b076da9f-2174-4401-955b-858cf1d70d27 service neutron] 10.222.0.18 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808113 Dec 21 04:57:02.389954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-7aab8207-27bc-4415-9a26-4acd036a0062 service neutron] 10.222.0.18 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846834 Dec 21 04:57:02.633481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7b4ec43c-d5e1-4c13-894a-4d87b45f59a0 req-2051d152-38b4-48b2-bc0f-d2df80827c79 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 210 time: 0.0266016 Dec 21 04:57:03.734475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-110caadf-86f2-439a-b67d-7596896d0495 req-df12238d-352d-4696-bbcc-c778cb8e3400 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 210 time: 0.0285041 Dec 21 04:57:04.761529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-e2d1f0c2-12a6-49ef-8b17-088477e4339e tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:04.765535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-e2d1f0c2-12a6-49ef-8b17-088477e4339e tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.31 "GET /v2.0/networks?id=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 HTTP/1.1" status: 200 len: 814 time: 0.1050603 Dec 21 04:57:04.794389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Request body: {'port': {'device_id': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97', 'admin_state_up': True, 'tenant_id': '94f434f7a6524c97955d220df41c0889'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:04.845769 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50295f44-dc09-4716-8e79-609dbb16a9b7 req-013696f2-a6c7-47bd-9134-906335a83c1f tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 210 time: 0.0358508 Dec 21 04:57:05.001167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Made reservation on behalf of 94f434f7a6524c97955d220df41c0889 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:05.004809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:05.127681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Allocated IP 172.20.0.6 (48c0ec1d-5cb9-4e2b-a948-f4b61a508f97/dc9e7aa6-925b-449a-bf9d-6ec1d606be6d/48b26db5-4ca9-4347-abff-da7f8b6ecea2) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:05.272948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:05.373284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:05.407419 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['fde35d0b-f223-4803-af79-96c463346e0e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:57:05.417110 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:05.420480 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:05.424273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:05.454265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Pushing event updated for resources: {'Port': ['ID=48b26db5-4ca9-4347-abff-da7f8b6ecea2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:05.469149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.469509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.469856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.470199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.470539 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.470874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.471495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.471821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.472145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.472470 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.472795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.473120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.473439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:05.495250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:05.499311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:05.575713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-8f844847-2224-45c9-a2f7-921daa925ca4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7853277 Dec 21 04:57:05.648756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Request body: {'port': {'device_id': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:05.700630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:05.999138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 48b26db5-4ca9-4347-abff-da7f8b6ecea2 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:57:06.010704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a104cd-f662-4d64-8f44-274a0ff178cb req-23dca0f9-3ae8-4d39-b1e9-7b060b55a495 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.012210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a104cd-f662-4d64-8f44-274a0ff178cb req-23dca0f9-3ae8-4d39-b1e9-7b060b55a495 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 931 time: 0.0957024 Dec 21 04:57:06.016156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:06.041774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Transition to ACTIVE for port object 48b26db5-4ca9-4347-abff-da7f8b6ecea2 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:57:06.066489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85a104cd-f662-4d64-8f44-274a0ff178cb req-e0e430d4-f4ab-4ece-b569-e24647b19f8a tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479784 Dec 21 04:57:06.092968 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:06.147040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Pushing event updated for resources: {'Port': ['ID=48b26db5-4ca9-4347-abff-da7f8b6ecea2,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:06.209496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Attempting to bind port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:06.209833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Attempting to bind port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:06.210785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Attempting to bind port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 on network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:06.215121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 on network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:57:06.215446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Attempting to bind port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 on network 48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:06.220180 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 56, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:06.220518 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Checking segment: {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:06.220902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Bound using segment: {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:06.221579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Bound port: 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f7eac35-b618-4f6e-98b9-65f65e31c2c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:06.221928 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:06.282047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] For port 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:06.285026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] For port 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=48b26db5-4ca9-4347-abff-da7f8b6ecea2,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:06.355570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:06.389309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.389928 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:06.391341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] 10.222.0.31 "PUT /v2.0/ports/48b26db5-4ca9-4347-abff-da7f8b6ecea2 HTTP/1.1" status: 200 len: 1092 time: 0.7935977 Dec 21 04:57:06.393137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'tag': '48b26db5-4ca9-4347-abff-da7f8b6ecea2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:57:06.394079 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb" -d '{"events": [{"name": "network-changed", "server_uuid": "3a59a109-1af5-459f-97a0-7ba7e051a7f0", "tag": "48b26db5-4ca9-4347-abff-da7f8b6ecea2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:57:06.418251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7f0569f-6405-4864-b1c4-822f28df0d6f service neutron] Pushing event updated for resources: {'Port': ['ID=48b26db5-4ca9-4347-abff-da7f8b6ecea2,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:06.435564 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:57:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b6e0fde-f7eb-469a-829e-879611650f69 x-openstack-request-id: req-5b6e0fde-f7eb-469a-829e-879611650f69 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:57:06.435857 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3a59a109-1af5-459f-97a0-7ba7e051a7f0", "tag": "48b26db5-4ca9-4347-abff-da7f8b6ecea2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:57:06.436115 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-5b6e0fde-f7eb-469a-829e-879611650f69 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:57:06.436525 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'tag': '48b26db5-4ca9-4347-abff-da7f8b6ecea2', 'status': 'completed', 'code': 200} Dec 21 04:57:06.530064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb req-ed8c475f-5cb5-4f4a-ae78-fcddebe2c821 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.531539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb req-ed8c475f-5cb5-4f4a-ae78-fcddebe2c821 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=94f434f7a6524c97955d220df41c0889&device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 1095 time: 0.0453625 Dec 21 04:57:06.645176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb req-cc1cb96f-0866-419f-8c25-89f4255c8e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.646737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb req-cc1cb96f-0866-419f-8c25-89f4255c8e59 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=94f434f7a6524c97955d220df41c0889&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0915422 Dec 21 04:57:06.749446 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb req-fb4c8454-8f0a-4cf6-a47c-9328f01bb02f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.750906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a53b88ff-29c7-4e8a-84f7-000bc7c127bb req-fb4c8454-8f0a-4cf6-a47c-9328f01bb02f service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0923638 Dec 21 04:57:06.859964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-9c396eeb-cd1e-4103-bf2b-ce2764331d03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.861469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-9c396eeb-cd1e-4103-bf2b-ce2764331d03 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=94f434f7a6524c97955d220df41c0889&device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 1095 time: 0.0431178 Dec 21 04:57:06.872799 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:57:06.913843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-00fa9b43-81bf-4d5c-abd3-b8dd4614eec7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=48b26db5-4ca9-4347-abff-da7f8b6ecea2 HTTP/1.1" status: 200 len: 217 time: 0.0335112 Dec 21 04:57:06.965720 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-172c3dbe-fabe-4039-91e9-046e153628fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:06.967183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-172c3dbe-fabe-4039-91e9-046e153628fd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=dc9e7aa6-925b-449a-bf9d-6ec1d606be6d HTTP/1.1" status: 200 len: 854 time: 0.0465741 Dec 21 04:57:07.003612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-b2ac5acd-78da-4130-96e0-da15f74ff3ab service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252602 Dec 21 04:57:07.094636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-12419f30-b3b0-4b3c-a93b-7201813a3b75 service neutron] 10.222.0.31 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820234 Dec 21 04:57:07.229312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-853dcbd0-65be-4fd0-b417-47813acb8eca req-fa58d23c-77b0-4847-9fa9-e6d8417b0e2a tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:07.232035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-853dcbd0-65be-4fd0-b417-47813acb8eca req-fa58d23c-77b0-4847-9fa9-e6d8417b0e2a tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 943 time: 0.0933576 Dec 21 04:57:07.235739 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f67f23c1-5e45-4109-93f9-714d6206ac39 req-ab0d64d5-5440-4744-8c36-a5b93edb9ef4 service neutron] 10.222.0.31 "GET /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1287715 Dec 21 04:57:07.279745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-853dcbd0-65be-4fd0-b417-47813acb8eca req-922e30cf-ec10-422c-8bcc-616cb322c597 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412652 Dec 21 04:57:08.399259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89a420f-5fff-4b0b-9fb2-c978a59d376c req-3d5ab6e7-e381-48d9-97cd-33dfff8c0588 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:08.400713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a89a420f-5fff-4b0b-9fb2-c978a59d376c req-3d5ab6e7-e381-48d9-97cd-33dfff8c0588 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 943 time: 0.0519683 Dec 21 04:57:08.446147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a89a420f-5fff-4b0b-9fb2-c978a59d376c req-23ca7d80-f0a8-4bae-a5f4-a13ec99cca5c tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396490 Dec 21 04:57:09.561302 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c15a68-6c82-48fd-8c52-ad15c36e5a29 req-f63132cf-0074-466c-b9d8-c36f4d708d29 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:09.562751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c15a68-6c82-48fd-8c52-ad15c36e5a29 req-f63132cf-0074-466c-b9d8-c36f4d708d29 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 943 time: 0.0479739 Dec 21 04:57:09.609333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32c15a68-6c82-48fd-8c52-ad15c36e5a29 req-311e7193-15f5-4724-ae44-80b9f14b67d6 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407619 Dec 21 04:57:10.477407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 48b26db5-4ca9-4347-abff-da7f8b6ecea2 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:57:10.569750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=48b26db5-4ca9-4347-abff-da7f8b6ecea2,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:10.580309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '48b26db5-4ca9-4347-abff-da7f8b6ecea2', 'network_id': '48c0ec1d-5cb9-4e2b-a948-f4b61a508f97', 'port_id': '48b26db5-4ca9-4347-abff-da7f8b6ecea2', 'mac_address': 'fa:16:3e:a3:8f:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dc9e7aa6-925b-449a-bf9d-6ec1d606be6d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:57:10.615753 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:10.628397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 48b26db5-4ca9-4347-abff-da7f8b6ecea2 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:57:10.648332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=48b26db5-4ca9-4347-abff-da7f8b6ecea2,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:10.709749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:10.722367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54bfe40a-c58c-42a1-83ba-8f54d896332d req-28266e8c-a844-434a-b4f1-0a708852e0cf tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:10.723943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54bfe40a-c58c-42a1-83ba-8f54d896332d req-28266e8c-a844-434a-b4f1-0a708852e0cf tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 943 time: 0.0490212 Dec 21 04:57:10.760739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=48b26db5-4ca9-4347-abff-da7f8b6ecea2,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:10.768345 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.768696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.769042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.769380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.769713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.770048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.770377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.770707 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.771053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.771382 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.771703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.772026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.772383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:10.774775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54bfe40a-c58c-42a1-83ba-8f54d896332d req-459510b7-3a26-4b12-b676-b502f56f635d tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441411 Dec 21 04:57:11.087713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['48b26db5-4ca9-4347-abff-da7f8b6ecea2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:57:11.892296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f28f62-3360-4ab8-8203-599f1b61cdc4 req-2e685faf-7a19-4312-9b4c-4a2cb737d788 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:11.893667 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65f28f62-3360-4ab8-8203-599f1b61cdc4 req-2e685faf-7a19-4312-9b4c-4a2cb737d788 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 944 time: 0.0527198 Dec 21 04:57:11.941054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-65f28f62-3360-4ab8-8203-599f1b61cdc4 req-d12134b1-4821-4925-ac55-c9278d07fdd7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408447 Dec 21 04:57:12.512196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 48b26db5-4ca9-4347-abff-da7f8b6ecea2 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:57:12.624524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:57:12.628678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:12.634746 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:12.703423 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:12.726172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b26db5-4ca9-4347-abff-da7f8b6ecea2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:57:12.728435 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23756ce5-5848-4579-aeee-9f021456bfc4" -d '{"events": [{"server_uuid": "3a59a109-1af5-459f-97a0-7ba7e051a7f0", "name": "network-vif-plugged", "status": "completed", "tag": "48b26db5-4ca9-4347-abff-da7f8b6ecea2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:57:12.740858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=48b26db5-4ca9-4347-abff-da7f8b6ecea2,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:12.764957 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:57:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-628d8e09-3b1a-4678-a3fe-a27013ed80e2 x-openstack-request-id: req-628d8e09-3b1a-4678-a3fe-a27013ed80e2 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:57:12.765254 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3a59a109-1af5-459f-97a0-7ba7e051a7f0", "name": "network-vif-plugged", "status": "completed", "tag": "48b26db5-4ca9-4347-abff-da7f8b6ecea2", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:57:12.765513 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-628d8e09-3b1a-4678-a3fe-a27013ed80e2 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:57:12.765913 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48b26db5-4ca9-4347-abff-da7f8b6ecea2', 'code': 200} Dec 21 04:57:12.783929 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:12.833220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=48b26db5-4ca9-4347-abff-da7f8b6ecea2,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:12.910862 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69882fa-70ef-416a-8403-4ce11753bf1a req-d5db4fff-d0a7-49fe-bb6d-d2c527336b31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:12.912391 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b69882fa-70ef-416a-8403-4ce11753bf1a req-d5db4fff-d0a7-49fe-bb6d-d2c527336b31 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 1097 time: 0.0382042 Dec 21 04:57:12.958592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b69882fa-70ef-416a-8403-4ce11753bf1a req-5001bcfd-0f58-407c-b345-68ff90bad79b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353010 Dec 21 04:57:13.058548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2a5c57-e087-4aff-88e3-db71eeb19fc5 req-584f7236-a88a-49c6-9bb5-e259c964ceb7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:13.060265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd2a5c57-e087-4aff-88e3-db71eeb19fc5 req-584f7236-a88a-49c6-9bb5-e259c964ceb7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 945 time: 0.0519719 Dec 21 04:57:13.106760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd2a5c57-e087-4aff-88e3-db71eeb19fc5 req-7064561a-4663-4852-988e-95934d91c9a7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405662 Dec 21 04:57:14.228566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d56aa7-e800-40f3-8f51-065e16d47239 req-b4472dfc-a9ef-4c46-a6d2-8b7aeae6edc5 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:14.230056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7d56aa7-e800-40f3-8f51-065e16d47239 req-b4472dfc-a9ef-4c46-a6d2-8b7aeae6edc5 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 945 time: 0.0505898 Dec 21 04:57:14.277118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d7d56aa7-e800-40f3-8f51-065e16d47239 req-f762fae4-e3f6-46ff-a82e-3f40efbfb60d tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410860 Dec 21 04:57:15.395614 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99128e83-3ea4-4faa-8517-4d795b169aa7 req-090ce1a8-7e9a-4ee4-8216-5bdacee3d64b tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:15.397086 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99128e83-3ea4-4faa-8517-4d795b169aa7 req-090ce1a8-7e9a-4ee4-8216-5bdacee3d64b tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 945 time: 0.0535967 Dec 21 04:57:15.443043 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99128e83-3ea4-4faa-8517-4d795b169aa7 req-c65a5b39-78ad-46ad-97dd-b83e708bed87 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398343 Dec 21 04:57:15.824826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d927d05-a4cb-4283-8a16-030b75406464 req-4db9ceb8-3d69-4bf9-ab41-ef8e37b48ef8 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:15.826316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d927d05-a4cb-4283-8a16-030b75406464 req-4db9ceb8-3d69-4bf9-ab41-ef8e37b48ef8 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 945 time: 0.0496345 Dec 21 04:57:15.873983 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5d927d05-a4cb-4283-8a16-030b75406464 req-b67912a3-ff9c-43d0-a14f-bdef76cf6bdc tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413816 Dec 21 04:57:16.995801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb4665c-1d03-4343-81db-8d803f64689a req-1c93d746-300e-43ae-b38e-5a69ac0ff65c tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:16.997286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdb4665c-1d03-4343-81db-8d803f64689a req-1c93d746-300e-43ae-b38e-5a69ac0ff65c tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 945 time: 0.0488532 Dec 21 04:57:17.047440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdb4665c-1d03-4343-81db-8d803f64689a req-bf1d28f1-9172-41be-931e-7049b283fe65 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441647 Dec 21 04:57:17.385667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-4a777057-b98d-444b-963c-50eff6a4d326 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:17.387133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-4a777057-b98d-444b-963c-50eff6a4d326 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.31 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 945 time: 0.0476737 Dec 21 04:57:17.474165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Deleting port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:17.474504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:17.563082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] For port 48b26db5-4ca9-4347-abff-da7f8b6ecea2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=48b26db5-4ca9-4347-abff-da7f8b6ecea2,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:17.563442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:17.575561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Calling delete_port for 48b26db5-4ca9-4347-abff-da7f8b6ecea2 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:17.829985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:17.858225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Pushing event deleted for resources: {'Port': ['ID=48b26db5-4ca9-4347-abff-da7f8b6ecea2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:17.869164 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['fde35d0b-f223-4803-af79-96c463346e0e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:57:17.870634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['48b26db5-4ca9-4347-abff-da7f8b6ecea2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:57:17.904056 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] No DVR routers for this DVR port 48b26db5-4ca9-4347-abff-da7f8b6ecea2 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:17.907162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:17.910654 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f9824d72-8f60-40b0-b266-51d57fb81ba7 req-bd9eef11-b86e-45ee-bedc-d350fec02ee1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.31 "DELETE /v2.0/ports/48b26db5-4ca9-4347-abff-da7f8b6ecea2 HTTP/1.1" status: 204 len: 173 time: 0.5174010 Dec 21 04:57:17.911137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'name': 'network-vif-deleted', 'tag': '48b26db5-4ca9-4347-abff-da7f8b6ecea2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:57:17.913447 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0440dab-1116-4e6e-b58c-6b028b2198c2" -d '{"events": [{"server_uuid": "3a59a109-1af5-459f-97a0-7ba7e051a7f0", "name": "network-vif-deleted", "tag": "48b26db5-4ca9-4347-abff-da7f8b6ecea2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:57:17.950956 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:57:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-660e8df3-e6bb-446c-9be8-43b82ec900d4 x-openstack-request-id: req-660e8df3-e6bb-446c-9be8-43b82ec900d4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:57:17.951262 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3a59a109-1af5-459f-97a0-7ba7e051a7f0", "name": "network-vif-deleted", "tag": "48b26db5-4ca9-4347-abff-da7f8b6ecea2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:57:17.951523 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-660e8df3-e6bb-446c-9be8-43b82ec900d4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:57:17.951931 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3a59a109-1af5-459f-97a0-7ba7e051a7f0', 'name': 'network-vif-deleted', 'tag': '48b26db5-4ca9-4347-abff-da7f8b6ecea2', 'status': 'completed', 'code': 200} Dec 21 04:57:18.140816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ff0c8042-0903-4fb5-81af-77107e3af076 req-bb757695-eea7-492a-8273-85de2781057d tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=3a59a109-1af5-459f-97a0-7ba7e051a7f0 HTTP/1.1" status: 200 len: 210 time: 0.0265958 Dec 21 04:57:19.309771 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde28ea4-a9c7-4734-9b0b-4e3d7e71bc71 req-312ca527-5ce3-41dd-96c3-40d84da55ce0 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:19.311231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fde28ea4-a9c7-4734-9b0b-4e3d7e71bc71 req-312ca527-5ce3-41dd-96c3-40d84da55ce0 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0707996 Dec 21 04:57:19.360797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fde28ea4-a9c7-4734-9b0b-4e3d7e71bc71 req-64418509-63a1-4e49-89d6-ef21c1416928 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432456 Dec 21 04:57:19.493453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d59d3e-c0f2-415c-9a31-61e8855cc6bb req-b74f2e00-ef3f-43f2-909a-de71f8bd9eba tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:19.494957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77d59d3e-c0f2-415c-9a31-61e8855cc6bb req-b74f2e00-ef3f-43f2-909a-de71f8bd9eba tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0534959 Dec 21 04:57:19.540444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77d59d3e-c0f2-415c-9a31-61e8855cc6bb req-f65946a7-303a-4813-b5ba-83343d364d6a tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396068 Dec 21 04:57:19.661421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cae08c2-85d1-44ce-968d-99bf3d3b26ce req-cdf55282-af14-437c-b2d3-529af519078c tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:19.663449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cae08c2-85d1-44ce-968d-99bf3d3b26ce req-cdf55282-af14-437c-b2d3-529af519078c tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0512390 Dec 21 04:57:19.713229 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8cae08c2-85d1-44ce-968d-99bf3d3b26ce req-3b0597ab-ad18-4053-97b0-a41ba6a92ec7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438643 Dec 21 04:57:19.880837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef27ad47-9864-4b42-9d1b-f8cc8389b4e5 req-57479b0d-9a22-4c36-90e7-c1e23f99a0a1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:19.882230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef27ad47-9864-4b42-9d1b-f8cc8389b4e5 req-57479b0d-9a22-4c36-90e7-c1e23f99a0a1 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0492549 Dec 21 04:57:19.892745 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5b0d1af4-2bf3-4616-9af0-b80c2ec3c434 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:19.937479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef27ad47-9864-4b42-9d1b-f8cc8389b4e5 req-fc1f4790-71d2-4473-80b1-2c30c5d26ef4 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492504 Dec 21 04:57:20.050196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c05a8a1-669d-41ab-8ba5-17fc81749743 req-521d2c11-3bf2-4193-8796-0dc535d04d23 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:20.051691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c05a8a1-669d-41ab-8ba5-17fc81749743 req-521d2c11-3bf2-4193-8796-0dc535d04d23 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0480974 Dec 21 04:57:20.097231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c05a8a1-669d-41ab-8ba5-17fc81749743 req-c891b071-94b1-4b91-bb0b-cd969463abad tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396852 Dec 21 04:57:20.222829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd4c387-e625-4759-aa9a-396f971ef111 req-b5eb3ee8-9a38-466e-afc4-1a9c13e49abc tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:20.224308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fd4c387-e625-4759-aa9a-396f971ef111 req-b5eb3ee8-9a38-466e-afc4-1a9c13e49abc tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0511000 Dec 21 04:57:20.270682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3fd4c387-e625-4759-aa9a-396f971ef111 req-e11133b0-09aa-4e3e-9aa4-9f0ac265f0fa tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396061 Dec 21 04:57:20.526305 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 48b26db5-4ca9-4347-abff-da7f8b6ecea2 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:57:20.545699 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 48b26db5-4ca9-4347-abff-da7f8b6ecea2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:57:20.550274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 48b26db5-4ca9-4347-abff-da7f8b6ecea2 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:57:20.748335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7e66fc-d618-4aa2-b8de-8021f3f1d03e req-aa0464d2-dd88-4ab5-b83e-307294c45f21 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:20.749830 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea7e66fc-d618-4aa2-b8de-8021f3f1d03e req-aa0464d2-dd88-4ab5-b83e-307294c45f21 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0487866 Dec 21 04:57:20.796092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea7e66fc-d618-4aa2-b8de-8021f3f1d03e req-d7fe0f65-2542-4245-a979-5ad6a64f2feb tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403075 Dec 21 04:57:21.911407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537c1a0b-0383-4ae9-9bd6-186930806048 req-984b04b8-5f56-4835-b799-bb53b5a61588 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:21.912792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-537c1a0b-0383-4ae9-9bd6-186930806048 req-984b04b8-5f56-4835-b799-bb53b5a61588 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0477297 Dec 21 04:57:21.967065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-537c1a0b-0383-4ae9-9bd6-186930806048 req-e9fc22e4-f5ea-4b94-a2be-3576e9418b37 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/security-groups?id=950d69ad-b290-48ca-a35c-872e65dd9cce&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448322 Dec 21 04:57:22.217527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3696292-c316-476c-b736-01c8352eee27 req-e762c8f4-cbdd-4963-8a70-b01c433b17e7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:22.218991 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3696292-c316-476c-b736-01c8352eee27 req-e762c8f4-cbdd-4963-8a70-b01c433b17e7 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.54 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 946 time: 0.0472529 Dec 21 04:57:22.306476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Deleting port fde35d0b-f223-4803-af79-96c463346e0e {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:22.306800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:22.391315 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] For port fde35d0b-f223-4803-af79-96c463346e0e, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=fde35d0b-f223-4803-af79-96c463346e0e,segment=NetworkSegment(8f7eac35-b618-4f6e-98b9-65f65e31c2c5),segment_id=8f7eac35-b618-4f6e-98b9-65f65e31c2c5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:22.391668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:22.403151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Calling delete_port for fde35d0b-f223-4803-af79-96c463346e0e owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:22.589797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:22.618980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Pushing event deleted for resources: {'Port': ['ID=fde35d0b-f223-4803-af79-96c463346e0e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:22.624114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['fde35d0b-f223-4803-af79-96c463346e0e'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:57:22.633850 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.634202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.634547 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.634891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.635251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.635580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.635927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.636238 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.636577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.636892 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.637215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.637534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.637982 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:22.675459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] No DVR routers for this DVR port fde35d0b-f223-4803-af79-96c463346e0e on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:22.678100 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:22.682123 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3696292-c316-476c-b736-01c8352eee27 req-86c408c0-c3a4-412b-981f-2961b6a03c41 tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.54 "DELETE /v2.0/ports/fde35d0b-f223-4803-af79-96c463346e0e HTTP/1.1" status: 204 len: 173 time: 0.4573023 Dec 21 04:57:22.682563 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'name': 'network-vif-deleted', 'tag': 'fde35d0b-f223-4803-af79-96c463346e0e'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:57:22.684803 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-688e292f-0f48-445d-883a-0064861c4d4e" -d '{"events": [{"server_uuid": "7fdd2f69-1e41-4786-9c8e-2454790e2955", "name": "network-vif-deleted", "tag": "fde35d0b-f223-4803-af79-96c463346e0e"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:57:22.709901 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-455e309e-cf4c-45c5-ab5c-5068487725ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:22.722570 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:57:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-994cf066-76dd-4a39-9ab2-0256181708f3 x-openstack-request-id: req-994cf066-76dd-4a39-9ab2-0256181708f3 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:57:22.723201 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdd2f69-1e41-4786-9c8e-2454790e2955", "name": "network-vif-deleted", "tag": "fde35d0b-f223-4803-af79-96c463346e0e", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:57:22.723463 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-994cf066-76dd-4a39-9ab2-0256181708f3 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:57:22.724129 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdd2f69-1e41-4786-9c8e-2454790e2955', 'name': 'network-vif-deleted', 'tag': 'fde35d0b-f223-4803-af79-96c463346e0e', 'status': 'completed', 'code': 200} Dec 21 04:57:23.074134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4682e399-e774-47b9-b99c-95cef6217cff req-bb1422a6-ab05-4661-8b53-d716a8a506ee tempest-ServersNegativeTestJSON-405111762 tempest-ServersNegativeTestJSON-405111762-project] 10.222.0.18 "GET /v2.0/ports?device_id=7fdd2f69-1e41-4786-9c8e-2454790e2955 HTTP/1.1" status: 200 len: 210 time: 0.0297575 Dec 21 04:57:23.539268 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:23.540351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.131215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50446) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:24.178467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Deleting subnet dc9e7aa6-925b-449a-bf9d-6ec1d606be6d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:57:24.182149 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.214659 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.252503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.372828 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.397039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dc9e7aa6-925b-449a-bf9d-6ec1d606be6d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:24.401062 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.404195 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-17a5a613-a507-4250-a341-09103ba98d29 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/dc9e7aa6-925b-449a-bf9d-6ec1d606be6d HTTP/1.1" status: 204 len: 168 time: 0.2719941 Dec 21 04:57:24.406753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50448) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:24.482431 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.568000 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.589473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48c0ec1d-5cb9-4e2b-a948-f4b61a508f97']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:24.599662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f7eac35-b618-4f6e-98b9-65f65e31c2c5') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:24.599954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f7eac35-b618-4f6e-98b9-65f65e31c2c5') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:24.610106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.623210 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.629087 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Releasing vlan 133 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:24.629464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:24.631118 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:24.773168 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.779021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:24.781960 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] 10.222.0.18 "DELETE /v2.0/networks/48c0ec1d-5cb9-4e2b-a948-f4b61a508f97 HTTP/1.1" status: 204 len: 168 time: 0.3742573 Dec 21 04:57:24.792697 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f9daf4-8261-43bc-8ee4-16b64c1688c5 admin admin] Pushing event deleted for resources: {'Network': ['ID=48c0ec1d-5cb9-4e2b-a948-f4b61a508f97,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:25.061240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50452) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:25.104879 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d58f8ffa-ec4e-4af4-bf56-33833f10b574 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=94f434f7a6524c97955d220df41c0889&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0424953 Dec 21 04:57:25.107344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50454) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:25.154093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbf2d716-abc4-42f3-a59e-0c40c762c88c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:25.174259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbf2d716-abc4-42f3-a59e-0c40c762c88c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:25.309076 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbf2d716-abc4-42f3-a59e-0c40c762c88c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:25.312875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cbf2d716-abc4-42f3-a59e-0c40c762c88c admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:25.313131 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cbf2d716-abc4-42f3-a59e-0c40c762c88c admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/950d69ad-b290-48ca-a35c-872e65dd9cce HTTP/1.1" status: 204 len: 168 time: 0.2045658 Dec 21 04:57:25.321685 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf2d716-abc4-42f3-a59e-0c40c762c88c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=950d69ad-b290-48ca-a35c-872e65dd9cce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:25.334563 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:25.360772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:25.789854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.283349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50476) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:26.381193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1187887058'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:26.475631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:26.478973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.487452 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.558368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.624436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.651770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:26.661901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2883fc2b-9b1a-40e5-9675-3e20cd2ae302,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:26.666565 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.666914 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Added segment e9652bd2-7f62-40ee-af69-487a967db7b2 of type vlan for network 4e984ce3-74d4-4b90-af1e-df07142076ae Dec 21 04:57:26.706529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.778287 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.783863 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:26.784844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:26.849033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Network': ['ID=4e984ce3-74d4-4b90-af1e-df07142076ae,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:26.855154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6fc6c6bd-979e-4dc2-b68c-cbb8eb404066 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.5705388 Dec 21 04:57:26.859445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4e984ce3-74d4-4b90-af1e-df07142076ae details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:27.918302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fde35d0b-f223-4803-af79-96c463346e0e no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:57:27.940660 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: fde35d0b-f223-4803-af79-96c463346e0e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:57:27.941015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device fde35d0b-f223-4803-af79-96c463346e0e not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:57:30.047675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:30.052694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'subnet': {'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:30.205708 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:30.209172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.452757 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.511651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Subnet': ['ID=4c988bb5-1743-4113-9d72-d6925d63a9cb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:30.521976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Checking segment: {'id': 'e9652bd2-7f62-40ee-af69-487a967db7b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:30.521976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network hostable DHCP agents. Network: 4e984ce3-74d4-4b90-af1e-df07142076ae, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:30.589464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network 4e984ce3-74d4-4b90-af1e-df07142076ae is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:30.658297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4e984ce3-74d4-4b90-af1e-df07142076ae) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:30.662518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:30.663139 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.669047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af0841d4-d63d-42ec-8b99-bfc3d667f226 None None] Network 4e984ce3-74d4-4b90-af1e-df07142076ae requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:30.741238 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-157f99bb-2f18-4c6c-a580-c848927aab8c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6923609 Dec 21 04:57:30.744694 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50482) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:30.749684 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1140495515'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:30.768745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4e984ce3-74d4-4b90-af1e-df07142076ae', 'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae', 'project_id': 'ef1595cdc326400d88ccafc2bd0a6a64', 'fixed_ips': [{'subnet_id': '4c988bb5-1743-4113-9d72-d6925d63a9cb'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:30.769677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.812822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:30.816634 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.844964 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] vlan segment allocate from pool success with {'vlan_id': 121, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:30.854286 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.854634 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Added segment a6a0af65-cbdc-4080-b7df-69707722cd40 of type vlan for network 376efa06-326d-4e90-ae16-43bcc7d509d0 Dec 21 04:57:30.894392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.906388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Allocated IP 2001:db8:0:ffff::2 (4e984ce3-74d4-4b90-af1e-df07142076ae/4c988bb5-1743-4113-9d72-d6925d63a9cb/f12ef4b5-26dc-4f81-9a81-a63d12733e45) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:30.984130 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:30.990053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:30.990642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.053130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.060814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Network': ['ID=376efa06-326d-4e90-ae16-43bcc7d509d0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:31.071492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 376efa06-326d-4e90-ae16-43bcc7d509d0 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:31.090216 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a003cd34-376d-4a36-8e6a-f7e61ab4ccd5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3444524 Dec 21 04:57:31.093516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50484) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:31.103780 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'subnet': {'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': True, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:31.130727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.172197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Network 4e984ce3-74d4-4b90-af1e-df07142076ae is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:31.176564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:31.180524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:31.187657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Pushing event updated for resources: {'Port': ['ID=f12ef4b5-26dc-4f81-9a81-a63d12733e45,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:31.240443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Attempting to bind port f12ef4b5-26dc-4f81-9a81-a63d12733e45 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:31.240815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Attempting to bind port f12ef4b5-26dc-4f81-9a81-a63d12733e45 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'e9652bd2-7f62-40ee-af69-487a967db7b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:31.241182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Attempting to bind port f12ef4b5-26dc-4f81-9a81-a63d12733e45 on network 4e984ce3-74d4-4b90-af1e-df07142076ae {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:31.246576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:31.246979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Checking segment: {'id': 'e9652bd2-7f62-40ee-af69-487a967db7b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:31.247386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.247784 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Bound using segment: {'id': 'e9652bd2-7f62-40ee-af69-487a967db7b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:31.248252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Bound port: f12ef4b5-26dc-4f81-9a81-a63d12733e45, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9652bd2-7f62-40ee-af69-487a967db7b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4e984ce3-74d4-4b90-af1e-df07142076ae'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:31.248635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.259467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:31.263124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.315030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] For port f12ef4b5-26dc-4f81-9a81-a63d12733e45, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:31.318184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] For port f12ef4b5-26dc-4f81-9a81-a63d12733e45, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f12ef4b5-26dc-4f81-9a81-a63d12733e45,segment=NetworkSegment(e9652bd2-7f62-40ee-af69-487a967db7b2),segment_id=e9652bd2-7f62-40ee-af69-487a967db7b2)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:31.407519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.464801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad77576-bcd2-4fb7-ae4e-2195288afb68 None None] Pushing event updated for resources: {'Port': ['ID=f12ef4b5-26dc-4f81-9a81-a63d12733e45,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:31.537177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.610509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Subnet': ['ID=3fb884b2-3d9f-47c7-9b8b-17afaccc8cff,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:31.615637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Checking segment: {'id': 'a6a0af65-cbdc-4080-b7df-69707722cd40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:31.616122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network hostable DHCP agents. Network: 376efa06-326d-4e90-ae16-43bcc7d509d0, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:31.732922 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network 376efa06-326d-4e90-ae16-43bcc7d509d0 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:31.806424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 376efa06-326d-4e90-ae16-43bcc7d509d0) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:31.810652 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:31.811292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:31.815091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0da4746a-088c-4412-b13f-6227a416e310 None None] Network 376efa06-326d-4e90-ae16-43bcc7d509d0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:31.895165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db566e5a-2e68-45ac-92c2-bf2df6ac7eb5 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 913 time: 0.8003821 Dec 21 04:57:31.898371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50486) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:31.916217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-376efa06-326d-4e90-ae16-43bcc7d509d0', 'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0', 'project_id': 'ef1595cdc326400d88ccafc2bd0a6a64', 'fixed_ips': [{'subnet_id': '3fb884b2-3d9f-47c7-9b8b-17afaccc8cff'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:31.919378 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.001728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.054175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.059691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Allocated IP 2001:db8::2 (376efa06-326d-4e90-ae16-43bcc7d509d0/3fb884b2-3d9f-47c7-9b8b-17afaccc8cff/5b10e22d-10ca-4b87-a423-6e043bb439ee) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:32.369496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.387781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7ab10fe-6e5a-4030-83cf-5fcecf94c029 None None] Network 4e984ce3-74d4-4b90-af1e-df07142076ae requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:32.443585 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.503752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1611403b-61d1-4c60-a1a3-81aa842d1bf7 None None] Provisioning complete for port f12ef4b5-26dc-4f81-9a81-a63d12733e45 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:32.504129 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1611403b-61d1-4c60-a1a3-81aa842d1bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.505017 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.506627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Network 376efa06-326d-4e90-ae16-43bcc7d509d0 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:32.514184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Pushing event updated for resources: {'Port': ['ID=5b10e22d-10ca-4b87-a423-6e043bb439ee,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:32.518349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:32.536140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Subnet': ['ID=3fb884b2-3d9f-47c7-9b8b-17afaccc8cff,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:32.539915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:32.602649 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.628026 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['376efa06-326d-4e90-ae16-43bcc7d509d0']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:32.636684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Attempting to bind port 5b10e22d-10ca-4b87-a423-6e043bb439ee on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:32.637267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Attempting to bind port 5b10e22d-10ca-4b87-a423-6e043bb439ee by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'a6a0af65-cbdc-4080-b7df-69707722cd40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:32.637505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Attempting to bind port 5b10e22d-10ca-4b87-a423-6e043bb439ee on network 376efa06-326d-4e90-ae16-43bcc7d509d0 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:32.639121 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a6a0af65-cbdc-4080-b7df-69707722cd40') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:32.639464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a6a0af65-cbdc-4080-b7df-69707722cd40') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:32.650727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.666167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.668281 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:32.668764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Checking segment: {'id': 'a6a0af65-cbdc-4080-b7df-69707722cd40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:32.669193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.669596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Bound using segment: {'id': 'a6a0af65-cbdc-4080-b7df-69707722cd40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:32.670100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Bound port: 5b10e22d-10ca-4b87-a423-6e043bb439ee, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a6a0af65-cbdc-4080-b7df-69707722cd40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '376efa06-326d-4e90-ae16-43bcc7d509d0'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:32.670540 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.673217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 121 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:32.673624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:32.676720 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:32.685873 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:32.685873 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:32.685873 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:32.695762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1611403b-61d1-4c60-a1a3-81aa842d1bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.767657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1611403b-61d1-4c60-a1a3-81aa842d1bf7 None None] For port f12ef4b5-26dc-4f81-9a81-a63d12733e45, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f12ef4b5-26dc-4f81-9a81-a63d12733e45,segment=NetworkSegment(e9652bd2-7f62-40ee-af69-487a967db7b2),segment_id=e9652bd2-7f62-40ee-af69-487a967db7b2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:32.773549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] For port 5b10e22d-10ca-4b87-a423-6e043bb439ee, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:32.776636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] For port 5b10e22d-10ca-4b87-a423-6e043bb439ee, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5b10e22d-10ca-4b87-a423-6e043bb439ee,segment=NetworkSegment(a6a0af65-cbdc-4080-b7df-69707722cd40),segment_id=a6a0af65-cbdc-4080-b7df-69707722cd40)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:32.779573 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.db.api [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:57:32.779573 n-d-822053-11 neutron-server[110310]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:57:32.779573 n-d-822053-11 neutron-server[110310]: [parameters: {'id': '376efa06-326d-4e90-ae16-43bcc7d509d0'}] Dec 21 04:57:32.779573 n-d-822053-11 neutron-server[110310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110310) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:57:32.780000 n-d-822053-11 neutron-server[110310]: DEBUG oslo_db.api [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:57:32.829974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1611403b-61d1-4c60-a1a3-81aa842d1bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.854680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:32.895118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1611403b-61d1-4c60-a1a3-81aa842d1bf7 None None] Pushing event updated for resources: {'Port': ['ID=f12ef4b5-26dc-4f81-9a81-a63d12733e45,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:32.956875 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cfcbd64-e905-4d15-af45-34d0b0b66db9 None None] Network 376efa06-326d-4e90-ae16-43bcc7d509d0 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:32.995202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd3c6d1-326a-4973-a706-9015d9b861f9 None None] Pushing event updated for resources: {'Port': ['ID=5b10e22d-10ca-4b87-a423-6e043bb439ee,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:33.024906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b792827c-bf4f-46e1-873d-93240749d534 None None] Provisioning complete for port f12ef4b5-26dc-4f81-9a81-a63d12733e45 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:33.025286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b792827c-bf4f-46e1-873d-93240749d534 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:33.075642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f12ef4b5-26dc-4f81-9a81-a63d12733e45 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:57:33.141736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecf7a84a-f0fc-46d3-af54-83b8e7fee544 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:57:33.208313 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f12ef4b5-26dc-4f81-9a81-a63d12733e45 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:33.208604 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:33.278239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecf7a84a-f0fc-46d3-af54-83b8e7fee544 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:57:33.280886 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:33.686220 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Deleting port 5b10e22d-10ca-4b87-a423-6e043bb439ee {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:33.686959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:33.747695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] For port 5b10e22d-10ca-4b87-a423-6e043bb439ee, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5b10e22d-10ca-4b87-a423-6e043bb439ee,segment=NetworkSegment(a6a0af65-cbdc-4080-b7df-69707722cd40),segment_id=a6a0af65-cbdc-4080-b7df-69707722cd40)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:33.748058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:33.760595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Calling delete_port for 5b10e22d-10ca-4b87-a423-6e043bb439ee owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:33.903957 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:33.930234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Port': ['ID=5b10e22d-10ca-4b87-a423-6e043bb439ee,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:33.932091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No DVR routers for this DVR port 5b10e22d-10ca-4b87-a423-6e043bb439ee on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:34.014614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.034388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['376efa06-326d-4e90-ae16-43bcc7d509d0']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:34.043375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a6a0af65-cbdc-4080-b7df-69707722cd40') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:34.043678 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a6a0af65-cbdc-4080-b7df-69707722cd40') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:34.052617 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.065006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.071309 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 121 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:34.071868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:34.074896 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:34.178441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.185687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.190803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/376efa06-326d-4e90-ae16-43bcc7d509d0 HTTP/1.1" status: 204 len: 168 time: 2.2894483 Dec 21 04:57:34.192424 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50488) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:34.198202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1713841808'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:34.200675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5f7045-3600-49e4-8f2f-95471dea5bab tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Network': ['ID=376efa06-326d-4e90-ae16-43bcc7d509d0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:34.287302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:34.291072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.315622 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:34.326135 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.326868 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Added segment 5bbffbc5-ca5f-429f-8b96-df5bb88dcef5 of type vlan for network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f Dec 21 04:57:34.367349 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.458132 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.463596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:34.464172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.530805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Network': ['ID=4c86bc13-ce12-4e0e-bea7-70094b2cc56f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:34.541045 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:34.597572 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-df2621da-1081-4723-9813-e2b1a8e4da16 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.4039764 Dec 21 04:57:34.600369 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50490) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:34.607357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'subnet': {'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:34.749730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:34.753173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:34.811264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Performing IP validity checks on allocation pools {{(pid=110311) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 21 04:57:34.811782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.ipam_backend_mixin [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Checking for overlaps among allocation pools and gateway ip {{(pid=110311) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 21 04:57:35.001217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.063322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Subnet': ['ID=d5681e9e-ce53-45a9-8392-b8932cc2e1d2,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:35.071831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Checking segment: {'id': '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:35.072182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network hostable DHCP agents. Network: 4c86bc13-ce12-4e0e-bea7-70094b2cc56f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:35.144111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:35.218389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 4c86bc13-ce12-4e0e-bea7-70094b2cc56f) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:35.223119 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:35.224055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.227148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc29873e-7091-43ce-ae54-c6c584e344c6 None None] Network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:35.300941 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-520bfe30-57ae-4a37-b1da-a34690f739c6 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.6988022 Dec 21 04:57:35.303466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50492) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:35.332649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-4c86bc13-ce12-4e0e-bea7-70094b2cc56f', 'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f', 'project_id': 'ef1595cdc326400d88ccafc2bd0a6a64', 'fixed_ips': [{'subnet_id': 'd5681e9e-ce53-45a9-8392-b8932cc2e1d2'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:35.333519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.401566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.451175 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.466426 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Allocated IP 2001:db8::3 (4c86bc13-ce12-4e0e-bea7-70094b2cc56f/d5681e9e-ce53-45a9-8392-b8932cc2e1d2/52affa66-f907-4919-9c44-1068bd695380) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:35.603044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.703987 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.748143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:35.750893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:35.753812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:35.765320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Pushing event updated for resources: {'Port': ['ID=52affa66-f907-4919-9c44-1068bd695380,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:35.790508 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.813372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Attempting to bind port 52affa66-f907-4919-9c44-1068bd695380 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:35.813743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Attempting to bind port 52affa66-f907-4919-9c44-1068bd695380 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:35.814237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Attempting to bind port 52affa66-f907-4919-9c44-1068bd695380 on network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:35.817729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Subnet': ['ID=d5681e9e-ce53-45a9-8392-b8932cc2e1d2,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:35.821561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:35.821951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Checking segment: {'id': '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:35.822356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.822752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Bound using segment: {'id': '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:35.823261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Bound port: 52affa66-f907-4919-9c44-1068bd695380, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:35.823639 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.877651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.885754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] For port 52affa66-f907-4919-9c44-1068bd695380, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:35.888797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] For port 52affa66-f907-4919-9c44-1068bd695380, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=52affa66-f907-4919-9c44-1068bd695380,segment=NetworkSegment(5bbffbc5-ca5f-429f-8b96-df5bb88dcef5),segment_id=5bbffbc5-ca5f-429f-8b96-df5bb88dcef5)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:35.898631 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c86bc13-ce12-4e0e-bea7-70094b2cc56f']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:35.907772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:35.908104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:35.917631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.950293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.952715 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.959783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:35.960194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:35.963195 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:36.036885 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cfe58d-6c55-4f8d-b578-57f1296d6a3a None None] Pushing event updated for resources: {'Port': ['ID=52affa66-f907-4919-9c44-1068bd695380,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:36.052062 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22b1b2d5-6ec0-441e-8228-ffa26a47bae6 None None] Network 4c86bc13-ce12-4e0e-bea7-70094b2cc56f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:36.058631 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.db.api [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 21 04:57:36.058631 n-d-822053-11 neutron-server[110311]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 21 04:57:36.058631 n-d-822053-11 neutron-server[110311]: [parameters: {'id': '4c86bc13-ce12-4e0e-bea7-70094b2cc56f'}] Dec 21 04:57:36.058631 n-d-822053-11 neutron-server[110311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=110311) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:57:36.059082 n-d-822053-11 neutron-server[110311]: DEBUG oslo_db.api [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:57:36.146898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-484e845b-1577-46dd-ac2d-58db91300831 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:57:36.215417 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-484e845b-1577-46dd-ac2d-58db91300831 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:57:36.561820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:36.615530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Deleting port 52affa66-f907-4919-9c44-1068bd695380 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:36.615912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:36.992365 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] For port 52affa66-f907-4919-9c44-1068bd695380, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=52affa66-f907-4919-9c44-1068bd695380,segment=NetworkSegment(5bbffbc5-ca5f-429f-8b96-df5bb88dcef5),segment_id=5bbffbc5-ca5f-429f-8b96-df5bb88dcef5)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:36.992727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.004913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Calling delete_port for 52affa66-f907-4919-9c44-1068bd695380 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:37.121380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.145214 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Port': ['ID=52affa66-f907-4919-9c44-1068bd695380,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:37.151180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No DVR routers for this DVR port 52affa66-f907-4919-9c44-1068bd695380 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:37.232514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.256293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c86bc13-ce12-4e0e-bea7-70094b2cc56f']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:37.267981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:37.268292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5bbffbc5-ca5f-429f-8b96-df5bb88dcef5') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:37.280848 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.295462 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.302020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:37.303070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:37.306808 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:37.406760 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.414693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.416688 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/4c86bc13-ce12-4e0e-bea7-70094b2cc56f HTTP/1.1" status: 204 len: 168 time: 2.1123111 Dec 21 04:57:37.420702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50494) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:37.425891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-372034411'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:37.427996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a0280b3-56e3-48ba-a1c9-8bc9c1e33b99 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Network': ['ID=4c86bc13-ce12-4e0e-bea7-70094b2cc56f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:37.515236 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:37.518585 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.549896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:37.559124 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.559468 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Added segment 5255e39d-da73-4f16-84e8-5ac7ecc5d282 of type vlan for network 5c117c3e-1598-4847-90e4-e08435e1d546 Dec 21 04:57:37.597139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.681344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.686946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:37.691411 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:37.752461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Network': ['ID=5c117c3e-1598-4847-90e4-e08435e1d546,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:37.762748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5c117c3e-1598-4847-90e4-e08435e1d546 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:37.797750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f6344d31-fe38-46fa-89e2-f690406ab230 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3758638 Dec 21 04:57:37.800398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50496) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:37.805928 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'subnet': {'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:37.961567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:37.965161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.189959 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.247081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Subnet': ['ID=74186779-32de-45e0-a9d5-4b383dfc31ed,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:38.257640 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Checking segment: {'id': '5255e39d-da73-4f16-84e8-5ac7ecc5d282', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:38.258009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network hostable DHCP agents. Network: 5c117c3e-1598-4847-90e4-e08435e1d546, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:38.332510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network 5c117c3e-1598-4847-90e4-e08435e1d546 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:38.400951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5c117c3e-1598-4847-90e4-e08435e1d546) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:38.404931 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:38.405523 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.409937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e62a2020-fbe0-496b-983c-1162ed74232f None None] Network 5c117c3e-1598-4847-90e4-e08435e1d546 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:38.472668 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-54b9cf95-8995-4ab2-b258-d0888977b119 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6710157 Dec 21 04:57:38.476475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:38.481498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2112016911'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:38.509739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5c117c3e-1598-4847-90e4-e08435e1d546', 'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546', 'project_id': 'ef1595cdc326400d88ccafc2bd0a6a64', 'fixed_ips': [{'subnet_id': '74186779-32de-45e0-a9d5-4b383dfc31ed'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:38.509739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.555883 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:38.559634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.584259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:38.594342 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.595051 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Added segment 884ba59a-77f9-4979-9d12-5aa675c64105 of type vlan for network 81a89269-de1b-474f-a61f-8d9b33277b06 Dec 21 04:57:38.636170 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.648537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Allocated IP 2001:db8::2 (5c117c3e-1598-4847-90e4-e08435e1d546/74186779-32de-45e0-a9d5-4b383dfc31ed/cb08a802-c432-4a22-b81e-65f54400f343) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:38.708853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.715638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:38.716232 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.785324 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Network': ['ID=81a89269-de1b-474f-a61f-8d9b33277b06,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:38.789304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.795533 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 81a89269-de1b-474f-a61f-8d9b33277b06 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:38.828504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b880b026-59a2-4b85-b94c-48cbf669cc4a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3483291 Dec 21 04:57:38.828768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50500) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:38.833602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Request body: {'subnet': {'network_id': '81a89269-de1b-474f-a61f-8d9b33277b06', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:38.855266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.901623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Network 5c117c3e-1598-4847-90e4-e08435e1d546 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:38.904470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:38.909018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:38.910979 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Pushing event updated for resources: {'Port': ['ID=cb08a802-c432-4a22-b81e-65f54400f343,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:38.964111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Attempting to bind port cb08a802-c432-4a22-b81e-65f54400f343 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:38.964542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Attempting to bind port cb08a802-c432-4a22-b81e-65f54400f343 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5255e39d-da73-4f16-84e8-5ac7ecc5d282', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:38.964843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Attempting to bind port cb08a802-c432-4a22-b81e-65f54400f343 on network 5c117c3e-1598-4847-90e4-e08435e1d546 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:38.969657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:38.970032 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Checking segment: {'id': '5255e39d-da73-4f16-84e8-5ac7ecc5d282', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:38.970428 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.970821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Bound using segment: {'id': '5255e39d-da73-4f16-84e8-5ac7ecc5d282', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:38.971311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Bound port: cb08a802-c432-4a22-b81e-65f54400f343, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5255e39d-da73-4f16-84e8-5ac7ecc5d282', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5c117c3e-1598-4847-90e4-e08435e1d546'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:38.971949 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:38.983175 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Made reservation on behalf of ef1595cdc326400d88ccafc2bd0a6a64 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:38.987135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.033532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] For port cb08a802-c432-4a22-b81e-65f54400f343, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:39.036995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] For port cb08a802-c432-4a22-b81e-65f54400f343, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb08a802-c432-4a22-b81e-65f54400f343,segment=NetworkSegment(5255e39d-da73-4f16-84e8-5ac7ecc5d282),segment_id=5255e39d-da73-4f16-84e8-5ac7ecc5d282)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:39.121738 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.192970 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23eb7bba-6fd3-4e06-93e3-5e123746c1cc None None] Pushing event updated for resources: {'Port': ['ID=cb08a802-c432-4a22-b81e-65f54400f343,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:39.246511 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.309434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event updated for resources: {'Subnet': ['ID=457d027e-a37c-4cb4-9b28-7486bef3de83,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:39.318289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Checking segment: {'id': '884ba59a-77f9-4979-9d12-5aa675c64105', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '81a89269-de1b-474f-a61f-8d9b33277b06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:39.318653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network hostable DHCP agents. Network: 81a89269-de1b-474f-a61f-8d9b33277b06, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:39.417692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Network 81a89269-de1b-474f-a61f-8d9b33277b06 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:39.509520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 81a89269-de1b-474f-a61f-8d9b33277b06) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:39.513709 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:39.514340 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.517953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-840310be-7759-4fbe-96f3-53d7a0050452 None None] Network 81a89269-de1b-474f-a61f-8d9b33277b06 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:39.592638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-68448bfe-cd5c-4d50-8f8b-4f5c0dab4c4c tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7627575 Dec 21 04:57:39.595113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50502) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:39.618899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07153b6b-83d9-449c-a004-5e59436f9cf6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-81a89269-de1b-474f-a61f-8d9b33277b06', 'network_id': '81a89269-de1b-474f-a61f-8d9b33277b06', 'project_id': 'ef1595cdc326400d88ccafc2bd0a6a64', 'fixed_ips': [{'subnet_id': '457d027e-a37c-4cb4-9b28-7486bef3de83'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:39.619850 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07153b6b-83d9-449c-a004-5e59436f9cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.697986 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.760518 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.910498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:39.939183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Subnet': ['ID=457d027e-a37c-4cb4-9b28-7486bef3de83,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server [None req-07153b6b-83d9-449c-a004-5e59436f9cf6 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 457d027e-a37c-4cb4-9b28-7486bef3de83: This subnet is being modified by another concurrent operation. Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 701, in inner Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1463, in create_port_db Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise self.value Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server raise exception Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 457d027e-a37c-4cb4-9b28-7486bef3de83: This subnet is being modified by another concurrent operation. Dec 21 04:57:39.948151 n-d-822053-11 neutron-server[110312]: ERROR oslo_messaging.rpc.server Dec 21 04:57:39.979959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ad2f87d-1388-40f7-8ebe-76a3eab9437d None None] Network 81a89269-de1b-474f-a61f-8d9b33277b06 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:40.011624 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.035339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['81a89269-de1b-474f-a61f-8d9b33277b06']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:40.047706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '884ba59a-77f9-4979-9d12-5aa675c64105') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:40.048261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '884ba59a-77f9-4979-9d12-5aa675c64105') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:40.061792 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.075504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.081791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:40.082174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:40.085782 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:40.133925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37de3209-6a4a-49e9-b4c6-d5fe438e4f34 None None] Network 5c117c3e-1598-4847-90e4-e08435e1d546 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:40.201065 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3c7d26cc-b177-4692-93a9-f5a43c7982f1 None None] Provisioning complete for port cb08a802-c432-4a22-b81e-65f54400f343 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:40.201444 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c7d26cc-b177-4692-93a9-f5a43c7982f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.212550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.217160 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.221208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/81a89269-de1b-474f-a61f-8d9b33277b06 HTTP/1.1" status: 204 len: 168 time: 0.6251421 Dec 21 04:57:40.224910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50504) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:40.236781 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c33e34-9c70-4150-98e2-b7149cd38638 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Network': ['ID=81a89269-de1b-474f-a61f-8d9b33277b06,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:40.259154 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-781250ab-ed58-415d-ab62-a1933437dd23 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] GET failed (client error): The resource could not be found. Dec 21 04:57:40.260464 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-781250ab-ed58-415d-ab62-a1933437dd23 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "GET /v2.0/subnets/457d027e-a37c-4cb4-9b28-7486bef3de83 HTTP/1.1" status: 404 len: 337 time: 0.0334101 Dec 21 04:57:40.263375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50506) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:40.281525 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-d8824b3e-4d57-43b5-a6b5-dfc201b8da22 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:40.282006 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d8824b3e-4d57-43b5-a6b5-dfc201b8da22 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:40.284969 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8824b3e-4d57-43b5-a6b5-dfc201b8da22 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/81a89269-de1b-474f-a61f-8d9b33277b06 HTTP/1.1" status: 404 len: 339 time: 0.0204623 Dec 21 04:57:40.289327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50508) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:40.316834 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-76f8187e-f990-44c4-ab24-fffcc32fa805 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:40.317004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-76f8187e-f990-44c4-ab24-fffcc32fa805 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:40.320642 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-76f8187e-f990-44c4-ab24-fffcc32fa805 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/subnets/457d027e-a37c-4cb4-9b28-7486bef3de83 HTTP/1.1" status: 404 len: 337 time: 0.0302844 Dec 21 04:57:40.323223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50510) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:40.324280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c7d26cc-b177-4692-93a9-f5a43c7982f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.341950 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d04e7a7-448f-49f6-a7b9-f386f2811022 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:40.343111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9d04e7a7-448f-49f6-a7b9-f386f2811022 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:40.349189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50512) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:40.349392 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9d04e7a7-448f-49f6-a7b9-f386f2811022 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/81a89269-de1b-474f-a61f-8d9b33277b06 HTTP/1.1" status: 404 len: 339 time: 0.0250950 Dec 21 04:57:40.367436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3c7d26cc-b177-4692-93a9-f5a43c7982f1 None None] For port cb08a802-c432-4a22-b81e-65f54400f343, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb08a802-c432-4a22-b81e-65f54400f343,segment=NetworkSegment(5255e39d-da73-4f16-84e8-5ac7ecc5d282),segment_id=5255e39d-da73-4f16-84e8-5ac7ecc5d282)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:40.409096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Deleting subnet 74186779-32de-45e0-a9d5-4b383dfc31ed {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:57:40.412423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.454387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.464154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3c7d26cc-b177-4692-93a9-f5a43c7982f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.489201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c9a90d8-f6a7-4206-9bae-872f707feb72 None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:57:40.540540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.549736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c7d26cc-b177-4692-93a9-f5a43c7982f1 None None] Pushing event updated for resources: {'Port': ['ID=cb08a802-c432-4a22-b81e-65f54400f343,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:40.592662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c9a90d8-f6a7-4206-9bae-872f707feb72 None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:57:40.603167 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c8d2e768-ebf2-4e25-9fc3-ca2e0db2be1e None None] Provisioning complete for port cb08a802-c432-4a22-b81e-65f54400f343 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:40.603541 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c8d2e768-ebf2-4e25-9fc3-ca2e0db2be1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.659130 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.687770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Subnet': ['ID=74186779-32de-45e0-a9d5-4b383dfc31ed,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:40.691347 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.695303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07526440-fa7c-435f-be46-de6efcc78724 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/subnets/74186779-32de-45e0-a9d5-4b383dfc31ed HTTP/1.1" status: 204 len: 168 time: 0.3445330 Dec 21 04:57:40.697727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50514) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:40.777578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.841111 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Deleting port cb08a802-c432-4a22-b81e-65f54400f343 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:40.841478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.860108 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d36fb11-712a-4f01-9674-d77d3b3e734d None None] Network 5c117c3e-1598-4847-90e4-e08435e1d546 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:40.908173 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] For port cb08a802-c432-4a22-b81e-65f54400f343, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb08a802-c432-4a22-b81e-65f54400f343,segment=NetworkSegment(5255e39d-da73-4f16-84e8-5ac7ecc5d282),segment_id=5255e39d-da73-4f16-84e8-5ac7ecc5d282)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:40.908458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:40.920583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Calling delete_port for cb08a802-c432-4a22-b81e-65f54400f343 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:41.005547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] DHCP port deletion for 5c117c3e-1598-4847-90e4-e08435e1d546 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:41.051138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] Deleting port cb08a802-c432-4a22-b81e-65f54400f343 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:41.051494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.092213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.114900 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] For port cb08a802-c432-4a22-b81e-65f54400f343, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb08a802-c432-4a22-b81e-65f54400f343,segment=NetworkSegment(5255e39d-da73-4f16-84e8-5ac7ecc5d282),segment_id=5255e39d-da73-4f16-84e8-5ac7ecc5d282)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:41.115405 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.118464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Port': ['ID=cb08a802-c432-4a22-b81e-65f54400f343,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:41.122045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No DVR routers for this DVR port cb08a802-c432-4a22-b81e-65f54400f343 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:41.129576 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] Calling delete_port for cb08a802-c432-4a22-b81e-65f54400f343 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:41.200573 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.207704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.226501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c117c3e-1598-4847-90e4-e08435e1d546']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:41.232661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] Pushing event deleted for resources: {'Port': ['ID=cb08a802-c432-4a22-b81e-65f54400f343,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:41.236593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d59fa21-5e67-4d07-9326-898f2be3170e None None] No DVR routers for this DVR port cb08a802-c432-4a22-b81e-65f54400f343 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:41.238305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5255e39d-da73-4f16-84e8-5ac7ecc5d282') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:41.238665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5255e39d-da73-4f16-84e8-5ac7ecc5d282') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:41.250150 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.267311 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.273432 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:41.273878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:41.276901 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:41.424045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.431669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.434741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/5c117c3e-1598-4847-90e4-e08435e1d546 HTTP/1.1" status: 204 len: 168 time: 0.7359717 Dec 21 04:57:41.437386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50516) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:41.445705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d70e1744-d777-448b-aec6-79331b4afea9 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Network': ['ID=5c117c3e-1598-4847-90e4-e08435e1d546,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:41.463497 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-fbb8f23b-aeef-4ab2-acf6-957a280e79c1 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:41.463942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fbb8f23b-aeef-4ab2-acf6-957a280e79c1 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:41.466852 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fbb8f23b-aeef-4ab2-acf6-957a280e79c1 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/subnets/d5681e9e-ce53-45a9-8392-b8932cc2e1d2 HTTP/1.1" status: 404 len: 337 time: 0.0285087 Dec 21 04:57:41.469307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50518) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:41.491085 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8256eaf-e6f9-4661-80fc-82e575d02220 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:41.492198 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b8256eaf-e6f9-4661-80fc-82e575d02220 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:41.495060 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b8256eaf-e6f9-4661-80fc-82e575d02220 tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/4c86bc13-ce12-4e0e-bea7-70094b2cc56f HTTP/1.1" status: 404 len: 339 time: 0.0248606 Dec 21 04:57:41.497363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50520) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:41.521418 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-f8b93eed-58ac-4448-ba66-d322308fc3cb tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:41.521788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f8b93eed-58ac-4448-ba66-d322308fc3cb tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:41.524674 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f8b93eed-58ac-4448-ba66-d322308fc3cb tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/subnets/3fb884b2-3d9f-47c7-9b8b-17afaccc8cff HTTP/1.1" status: 404 len: 337 time: 0.0264628 Dec 21 04:57:41.527007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50522) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:41.543926 n-d-822053-11 neutron-server[110311]: INFO neutron.pecan_wsgi.hooks.translation [None req-98cd4dec-8dc7-482a-a9e4-a0246e73dbbb tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] DELETE failed (client error): The resource could not be found. Dec 21 04:57:41.544391 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-98cd4dec-8dc7-482a-a9e4-a0246e73dbbb tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=110311) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 21 04:57:41.547208 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-98cd4dec-8dc7-482a-a9e4-a0246e73dbbb tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/376efa06-326d-4e90-ae16-43bcc7d509d0 HTTP/1.1" status: 404 len: 339 time: 0.0193219 Dec 21 04:57:41.549313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50524) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:41.598771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Deleting subnet 4c988bb5-1743-4113-9d72-d6925d63a9cb {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:57:41.602528 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.641467 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.727746 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.824284 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.849058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Subnet': ['ID=4c988bb5-1743-4113-9d72-d6925d63a9cb,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:41.855392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:41.858595 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8db49e30-4992-413e-9010-41a31c3d187e tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/subnets/4c988bb5-1743-4113-9d72-d6925d63a9cb HTTP/1.1" status: 204 len: 168 time: 0.3081484 Dec 21 04:57:41.860845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50526) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:41.863138 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-978daa40-5d83-4a67-9bbc-08d10348e374 None None] Network 4e984ce3-74d4-4b90-af1e-df07142076ae requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:41.942714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.002866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Deleting port f12ef4b5-26dc-4f81-9a81-a63d12733e45 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:42.003323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.022438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] DHCP port deletion for 4e984ce3-74d4-4b90-af1e-df07142076ae request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:42.065978 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] For port f12ef4b5-26dc-4f81-9a81-a63d12733e45, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f12ef4b5-26dc-4f81-9a81-a63d12733e45,segment=NetworkSegment(e9652bd2-7f62-40ee-af69-487a967db7b2),segment_id=e9652bd2-7f62-40ee-af69-487a967db7b2)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:42.066335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.075107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] Deleting port f12ef4b5-26dc-4f81-9a81-a63d12733e45 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:42.077363 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.083734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Calling delete_port for f12ef4b5-26dc-4f81-9a81-a63d12733e45 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:42.141739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] For port f12ef4b5-26dc-4f81-9a81-a63d12733e45, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f12ef4b5-26dc-4f81-9a81-a63d12733e45,segment=NetworkSegment(e9652bd2-7f62-40ee-af69-487a967db7b2),segment_id=e9652bd2-7f62-40ee-af69-487a967db7b2)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:42.142226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.156198 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] Calling delete_port for f12ef4b5-26dc-4f81-9a81-a63d12733e45 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:42.241011 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.251784 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.268128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Port': ['ID=f12ef4b5-26dc-4f81-9a81-a63d12733e45,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:42.270048 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] No DVR routers for this DVR port f12ef4b5-26dc-4f81-9a81-a63d12733e45 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:42.271314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] Pushing event deleted for resources: {'Port': ['ID=f12ef4b5-26dc-4f81-9a81-a63d12733e45,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:42.277019 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-801812b2-710b-4ac8-9277-90a4555bf92c None None] No DVR routers for this DVR port f12ef4b5-26dc-4f81-9a81-a63d12733e45 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:42.354553 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.374515 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4e984ce3-74d4-4b90-af1e-df07142076ae']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:42.384484 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e9652bd2-7f62-40ee-af69-487a967db7b2') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:42.384844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e9652bd2-7f62-40ee-af69-487a967db7b2') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:42.394212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.406868 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.412714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:42.413096 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:42.416060 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:42.538099 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.544747 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:42.547878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] 10.222.0.18 "DELETE /v2.0/networks/4e984ce3-74d4-4b90-af1e-df07142076ae HTTP/1.1" status: 204 len: 168 time: 0.6861022 Dec 21 04:57:42.564737 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca85658-10d9-4073-9ecc-317cc994fd3a tempest-NetworksIpV6Test-57334648 tempest-NetworksIpV6Test-57334648-project] Pushing event deleted for resources: {'Network': ['ID=4e984ce3-74d4-4b90-af1e-df07142076ae,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:42.994562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:43.057381 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f12ef4b5-26dc-4f81-9a81-a63d12733e45 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:57:43.076988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f12ef4b5-26dc-4f81-9a81-a63d12733e45 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:57:43.077347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f12ef4b5-26dc-4f81-9a81-a63d12733e45 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:57:43.127329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e1b8e7c8-bbec-4f85-b844-c35fa4834ef9 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=ef1595cdc326400d88ccafc2bd0a6a64&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1315711 Dec 21 04:57:43.134314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50536) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:43.180344 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-889adec9-4aa0-48ae-8e86-d0d44f6145b7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:43.200593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-889adec9-4aa0-48ae-8e86-d0d44f6145b7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:43.298502 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-889adec9-4aa0-48ae-8e86-d0d44f6145b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:43.301120 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-889adec9-4aa0-48ae-8e86-d0d44f6145b7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:43.302280 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-889adec9-4aa0-48ae-8e86-d0d44f6145b7 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2883fc2b-9b1a-40e5-9675-3e20cd2ae302 HTTP/1.1" status: 204 len: 168 time: 0.1670797 Dec 21 04:57:43.310381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-889adec9-4aa0-48ae-8e86-d0d44f6145b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2883fc2b-9b1a-40e5-9675-3e20cd2ae302,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:43.872536 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:57:44.236045 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50558) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:44.330582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-867540830', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:44.423964 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.424975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.476792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.566974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.643447 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.644693 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-48b85a26-78f0-4416-848c-4ddf2ab65b36 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.4076486 Dec 21 04:57:44.647448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50562) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:44.657675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-213575273'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:44.732717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Made reservation on behalf of c1f0524f8db64f9db6f5734da3964c23 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:44.736143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.745128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.816337 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.880898 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.903833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:44.918764 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d34b9a22-1f7d-482b-a91d-bac9200139ee,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:44.922759 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:44.923138 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Added segment 89f87d59-7bd8-49e8-b028-9a1f94be85f7 of type vlan for network 410787fd-62bd-467f-9743-3b4ea48804af Dec 21 04:57:44.964599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.035083 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.040721 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:45.041303 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.107662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event updated for resources: {'Network': ['ID=410787fd-62bd-467f-9743-3b4ea48804af,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:45.117464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 410787fd-62bd-467f-9743-3b4ea48804af details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:45.129576 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a94f63c0-d11a-45ba-b3df-ad99fd233562 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.4806046 Dec 21 04:57:45.133170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50564) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:45.138126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Request body: {'subnet': {'network_id': '410787fd-62bd-467f-9743-3b4ea48804af', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:45.286679 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Made reservation on behalf of c1f0524f8db64f9db6f5734da3964c23 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:45.290206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.521289 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.586902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event updated for resources: {'Subnet': ['ID=e3e585a4-b5cd-4a9b-bcfe-f846ccd407c3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:45.599022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Checking segment: {'id': '89f87d59-7bd8-49e8-b028-9a1f94be85f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '410787fd-62bd-467f-9743-3b4ea48804af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:45.599398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Network hostable DHCP agents. Network: 410787fd-62bd-467f-9743-3b4ea48804af, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:45.698172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Network 410787fd-62bd-467f-9743-3b4ea48804af is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:45.749467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 410787fd-62bd-467f-9743-3b4ea48804af) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:45.754615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:45.755663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.758657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c03ba820-ceac-4a26-b128-197672aabbfb None None] Network 410787fd-62bd-467f-9743-3b4ea48804af requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:45.841039 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-21785c37-807e-4697-b032-43e79963de70 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7039576 Dec 21 04:57:45.841263 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:45.846200 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1546821679'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:45.855914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-410787fd-62bd-467f-9743-3b4ea48804af', 'network_id': '410787fd-62bd-467f-9743-3b4ea48804af', 'project_id': 'c1f0524f8db64f9db6f5734da3964c23', 'fixed_ips': [{'subnet_id': 'e3e585a4-b5cd-4a9b-bcfe-f846ccd407c3'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:45.856796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.937973 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Made reservation on behalf of c1f0524f8db64f9db6f5734da3964c23 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:45.941520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.971479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:45.982030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:45.982374 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Added segment 070325a8-7f98-4dd6-bb8c-6d050b02cc2c of type vlan for network 084e21de-a78e-4286-b00e-be4bf935e977 Dec 21 04:57:45.989066 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Allocated IP 172.20.0.2 (410787fd-62bd-467f-9743-3b4ea48804af/e3e585a4-b5cd-4a9b-bcfe-f846ccd407c3/6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:46.022910 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.109638 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.115276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:46.115909 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.124183 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.179913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event updated for resources: {'Network': ['ID=084e21de-a78e-4286-b00e-be4bf935e977,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:46.189497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 084e21de-a78e-4286-b00e-be4bf935e977 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:46.213354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.232304 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e9dad41b-a824-4284-821a-3d5c1f4641cf tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.3901193 Dec 21 04:57:46.235153 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50568) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:46.240168 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Request body: {'subnet': {'network_id': '084e21de-a78e-4286-b00e-be4bf935e977', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:46.295120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Network 410787fd-62bd-467f-9743-3b4ea48804af is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:46.301097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:46.303104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Pushing event updated for resources: {'Port': ['ID=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:46.305256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:46.358716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Attempting to bind port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:46.359125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Attempting to bind port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '89f87d59-7bd8-49e8-b028-9a1f94be85f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '410787fd-62bd-467f-9743-3b4ea48804af'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:46.359493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Attempting to bind port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 on network 410787fd-62bd-467f-9743-3b4ea48804af {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:46.364380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:46.364695 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Checking segment: {'id': '89f87d59-7bd8-49e8-b028-9a1f94be85f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '410787fd-62bd-467f-9743-3b4ea48804af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:46.365092 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.365486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Bound using segment: {'id': '89f87d59-7bd8-49e8-b028-9a1f94be85f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '410787fd-62bd-467f-9743-3b4ea48804af'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:46.365951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Bound port: 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89f87d59-7bd8-49e8-b028-9a1f94be85f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '410787fd-62bd-467f-9743-3b4ea48804af'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:46.366359 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.395321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Made reservation on behalf of c1f0524f8db64f9db6f5734da3964c23 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:46.399465 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.432435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] For port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:46.435427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] For port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,segment=NetworkSegment(89f87d59-7bd8-49e8-b028-9a1f94be85f7),segment_id=89f87d59-7bd8-49e8-b028-9a1f94be85f7)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:46.515982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.577435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24a8ff14-83fd-4dc2-8dbd-dfe3dd424c03 None None] Pushing event updated for resources: {'Port': ['ID=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:46.670128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.737419 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event updated for resources: {'Subnet': ['ID=dcc4f5d8-a787-4f7f-8d82-31741fb958df,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:46.754753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Checking segment: {'id': '070325a8-7f98-4dd6-bb8c-6d050b02cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '084e21de-a78e-4286-b00e-be4bf935e977'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:46.755161 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Network hostable DHCP agents. Network: 084e21de-a78e-4286-b00e-be4bf935e977, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:46.834730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Network 084e21de-a78e-4286-b00e-be4bf935e977 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:46.898388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 084e21de-a78e-4286-b00e-be4bf935e977) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:46.902913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:46.903576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:46.906653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac4b9d8c-136b-41b5-90ef-23eaff00a116 None None] Network 084e21de-a78e-4286-b00e-be4bf935e977 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:46.976211 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-27a21331-5ead-4119-af0b-c0c58004684b tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7397509 Dec 21 04:57:46.979025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:46.983787 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-61c493cc-1cf0-45d2-981f-4556a88a6031 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Request body: {'router': {'external_gateway_info': {'network_id': '084e21de-a78e-4286-b00e-be4bf935e977'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:47.013246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-084e21de-a78e-4286-b00e-be4bf935e977', 'network_id': '084e21de-a78e-4286-b00e-be4bf935e977', 'project_id': 'c1f0524f8db64f9db6f5734da3964c23', 'fixed_ips': [{'subnet_id': 'dcc4f5d8-a787-4f7f-8d82-31741fb958df'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:47.014110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.106200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:57:47.189610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Allocated IP 172.21.0.2 (084e21de-a78e-4286-b00e-be4bf935e977/dcc4f5d8-a787-4f7f-8d82-31741fb958df/d9c559cc-ce6c-48a7-b555-27761ee5ae16) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:47.205948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:47.206327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.206518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-61c493cc-1cf0-45d2-981f-4556a88a6031 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.357446 n-d-822053-11 neutron-server[110311]: INFO neutron.api.v2.resource [None req-61c493cc-1cf0-45d2-981f-4556a88a6031 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 21 04:57:47.359417 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-61c493cc-1cf0-45d2-981f-4556a88a6031 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "PUT /v2.0/routers/c242edbc-d308-4817-98d2-e8d1305b321a HTTP/1.1" status: 400 len: 364 time: 0.3793621 Dec 21 04:57:47.359578 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.364393 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50572) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:47.421527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Deleting subnet dcc4f5d8-a787-4f7f-8d82-31741fb958df {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:57:47.430739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,segment=NetworkSegment(89f87d59-7bd8-49e8-b028-9a1f94be85f7),segment_id=89f87d59-7bd8-49e8-b028-9a1f94be85f7)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:47.443912 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.487352 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.515441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.521539 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.559482 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Network 084e21de-a78e-4286-b00e-be4bf935e977 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:47.561096 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:47.563015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:47.565580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:47.565837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.596080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63941cd7-d7e7-4d30-adca-123f2ae68c99 None None] Network 410787fd-62bd-467f-9743-3b4ea48804af requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:47.661305 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.819324 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.852126 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event deleted for resources: {'Subnet': ['ID=dcc4f5d8-a787-4f7f-8d82-31741fb958df,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:47.855834 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.861376 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-598b2a94-2b5d-47e7-a9c3-56938792af7d tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "DELETE /v2.0/subnets/dcc4f5d8-a787-4f7f-8d82-31741fb958df HTTP/1.1" status: 204 len: 168 time: 0.4935646 Dec 21 04:57:47.861699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50574) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:47.873816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Pushing event updated for resources: {'Port': ['ID=d9c559cc-ce6c-48a7-b555-27761ee5ae16,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:47.886805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-69851898-412f-4d90-8d30-366879aba7d0 None None] Provisioning complete for port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:47.887203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-69851898-412f-4d90-8d30-366879aba7d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.895607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Attempting to bind port d9c559cc-ce6c-48a7-b555-27761ee5ae16 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:47.895986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Attempting to bind port d9c559cc-ce6c-48a7-b555-27761ee5ae16 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '070325a8-7f98-4dd6-bb8c-6d050b02cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '084e21de-a78e-4286-b00e-be4bf935e977'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:47.896355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Attempting to bind port d9c559cc-ce6c-48a7-b555-27761ee5ae16 on network 084e21de-a78e-4286-b00e-be4bf935e977 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:47.941338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:47.941717 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Checking segment: {'id': '070325a8-7f98-4dd6-bb8c-6d050b02cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '084e21de-a78e-4286-b00e-be4bf935e977'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:47.942127 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.942530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Bound using segment: {'id': '070325a8-7f98-4dd6-bb8c-6d050b02cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '084e21de-a78e-4286-b00e-be4bf935e977'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:47.942686 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.943034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Bound port: d9c559cc-ce6c-48a7-b555-27761ee5ae16, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '070325a8-7f98-4dd6-bb8c-6d050b02cc2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '084e21de-a78e-4286-b00e-be4bf935e977'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:47.943426 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:47.995769 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Deleting port d9c559cc-ce6c-48a7-b555-27761ee5ae16 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:47.996451 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.058492 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] For port d9c559cc-ce6c-48a7-b555-27761ee5ae16, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:48.058742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] For port d9c559cc-ce6c-48a7-b555-27761ee5ae16, host n-d-822053-11, got binding levels [] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:48.059152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.063036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] For port d9c559cc-ce6c-48a7-b555-27761ee5ae16, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d9c559cc-ce6c-48a7-b555-27761ee5ae16,segment=NetworkSegment(070325a8-7f98-4dd6-bb8c-6d050b02cc2c),segment_id=070325a8-7f98-4dd6-bb8c-6d050b02cc2c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:48.078156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Calling delete_port for d9c559cc-ce6c-48a7-b555-27761ee5ae16 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:48.173536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.250914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f69489-1a9e-46f4-957e-6ede60f0db41 None None] Pushing event updated for resources: {'Port': ['ID=d9c559cc-ce6c-48a7-b555-27761ee5ae16,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:48.252023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.265653 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67e63997-2c1b-4759-901c-f7a1c21c4161 None None] Network 084e21de-a78e-4286-b00e-be4bf935e977 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:48.279573 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event deleted for resources: {'Port': ['ID=d9c559cc-ce6c-48a7-b555-27761ee5ae16,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:48.283019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] No DVR routers for this DVR port d9c559cc-ce6c-48a7-b555-27761ee5ae16 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:48.332902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ce22bb7a-e559-4fcd-8b44-93d12e79b402 None None] Provisioning complete for port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:48.333181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce22bb7a-e559-4fcd-8b44-93d12e79b402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.365427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.373808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed87f7ee-6ca1-49e9-9441-8374b582adca None None] get_active_networks_info from n-d-822053-11 {{(pid=110312) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 21 04:57:48.387682 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['084e21de-a78e-4286-b00e-be4bf935e977']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:48.397081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '070325a8-7f98-4dd6-bb8c-6d050b02cc2c') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:48.397383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '070325a8-7f98-4dd6-bb8c-6d050b02cc2c') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:48.406891 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.420599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.427048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:48.427441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:48.431262 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:48.480109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed87f7ee-6ca1-49e9-9441-8374b582adca None None] Resources bound (agent type, host, resource id): {{(pid=110312) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 21 04:57:48.555135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.562441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.565709 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "DELETE /v2.0/networks/084e21de-a78e-4286-b00e-be4bf935e977 HTTP/1.1" status: 204 len: 168 time: 0.7030070 Dec 21 04:57:48.572004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50576) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:48.577991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e36cdc-0ebf-4c16-ae85-5951120cc593 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event deleted for resources: {'Network': ['ID=084e21de-a78e-4286-b00e-be4bf935e977,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:48.625603 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Deleting subnet e3e585a4-b5cd-4a9b-bcfe-f846ccd407c3 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:57:48.628859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.668526 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.754607 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.864356 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.890647 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event deleted for resources: {'Subnet': ['ID=e3e585a4-b5cd-4a9b-bcfe-f846ccd407c3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:48.894138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:48.897609 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b30cc44-b659-4da0-a14c-2244a5a743b0 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "DELETE /v2.0/subnets/e3e585a4-b5cd-4a9b-bcfe-f846ccd407c3 HTTP/1.1" status: 204 len: 168 time: 0.3242218 Dec 21 04:57:48.899768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50578) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:48.899903 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cbcba25-ffbc-4e9c-b519-37183d6021a9 None None] Network 410787fd-62bd-467f-9743-3b4ea48804af requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:48.978487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.038675 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Deleting port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:49.039069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.059806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] DHCP port deletion for 410787fd-62bd-467f-9743-3b4ea48804af request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:49.103681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] For port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,segment=NetworkSegment(89f87d59-7bd8-49e8-b028-9a1f94be85f7),segment_id=89f87d59-7bd8-49e8-b028-9a1f94be85f7)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:49.104046 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.108033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] Deleting port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:57:49.108411 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.116847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Calling delete_port for 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:49.168860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] For port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,segment=NetworkSegment(89f87d59-7bd8-49e8-b028-9a1f94be85f7),segment_id=89f87d59-7bd8-49e8-b028-9a1f94be85f7)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:49.169262 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.182081 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] Calling delete_port for 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:57:49.261944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.270714 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.290757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event deleted for resources: {'Port': ['ID=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:49.294138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] No DVR routers for this DVR port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:49.296484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] Pushing event deleted for resources: {'Port': ['ID=6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:49.300503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd317ed2-8f9e-4fda-a2f4-698b36a7717f None None] No DVR routers for this DVR port 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:57:49.374855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.394716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['410787fd-62bd-467f-9743-3b4ea48804af']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:49.404531 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '89f87d59-7bd8-49e8-b028-9a1f94be85f7') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:49.404835 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '89f87d59-7bd8-49e8-b028-9a1f94be85f7') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:49.414651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.427486 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.433498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Releasing vlan 126 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:57:49.433891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:57:49.436935 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:57:49.555475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.562446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.565564 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "DELETE /v2.0/networks/410787fd-62bd-467f-9743-3b4ea48804af HTTP/1.1" status: 204 len: 168 time: 0.6649003 Dec 21 04:57:49.568083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50580) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:49.586617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9988ad4d-a794-4c15-a3f1-eebe0c205b06 tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Pushing event deleted for resources: {'Network': ['ID=410787fd-62bd-467f-9743-3b4ea48804af,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:49.607532 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c84682a-83f9-4ef8-aa25-cf98d79b474e tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "GET /v2.0/ports?device_id=c242edbc-d308-4817-98d2-e8d1305b321a HTTP/1.1" status: 200 len: 205 time: 0.0382190 Dec 21 04:57:49.609982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50582) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:49.688338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.848132 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.850312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.909355 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6f54ee76-55ec-43aa-ace1-325fc00a6615 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.961070 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.961617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Fanout notify agent at l3_agent the message router_deleted on router c242edbc-d308-4817-98d2-e8d1305b321a {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:57:49.968693 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:49.973112 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3cb9ea7f-7bae-464f-97ca-0308f5015b0f tempest-RoutersNegativeTest-1942549137 tempest-RoutersNegativeTest-1942549137-project] 10.222.0.18 "DELETE /v2.0/routers/c242edbc-d308-4817-98d2-e8d1305b321a HTTP/1.1" status: 204 len: 168 time: 0.3587680 Dec 21 04:57:50.373632 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50588) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:50.502187 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3cae4b3f-3d60-4eed-9ccc-684c8552048d admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=c1f0524f8db64f9db6f5734da3964c23&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1273117 Dec 21 04:57:50.504616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50592) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:50.552818 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f243b2ab-d450-40f3-ad58-41e3db36fd23 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:50.573640 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f243b2ab-d450-40f3-ad58-41e3db36fd23 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:50.680901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f243b2ab-d450-40f3-ad58-41e3db36fd23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:50.683491 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f243b2ab-d450-40f3-ad58-41e3db36fd23 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:50.684709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f243b2ab-d450-40f3-ad58-41e3db36fd23 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d34b9a22-1f7d-482b-a91d-bac9200139ee HTTP/1.1" status: 204 len: 168 time: 0.1791437 Dec 21 04:57:50.692490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f243b2ab-d450-40f3-ad58-41e3db36fd23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d34b9a22-1f7d-482b-a91d-bac9200139ee,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:51.046469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:57:51.068557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:57:51.068915 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6f27cfd1-6c0b-4dc7-94d7-80e3eb5ba193 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:57:51.515236 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50614) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:51.624772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-522507390-network', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:51.709412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Made reservation on behalf of a5be355061f74db2b46c76c8d1c73846 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:51.711690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:51.720003 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:51.795222 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:51.864245 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:51.891172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:51.900829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64d71606-29cc-44ce-a343-ed84a8dd6001,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:51.905476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:51.908520 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Added segment c46f8d2d-f7c7-436c-a683-8b94014d3642 of type vlan for network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 Dec 21 04:57:51.945148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.018257 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.019264 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:52.019836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.077326 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] Pushing event updated for resources: {'Network': ['ID=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:52.088676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:52.109054 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-df7796cd-0fbe-4ae3-9c83-258c96d9510d admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5900660 Dec 21 04:57:52.109346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50618) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:52.114096 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Request body: {'subnet': {'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-subnet', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:52.234283 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Made reservation on behalf of a5be355061f74db2b46c76c8d1c73846 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:52.236755 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.463350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.521400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f8de83e1-f132-4b61-b68b-db53b889943d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:52.530555 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Checking segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:52.530919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Network hostable DHCP agents. Network: 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:52.600215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:52.669639 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:52.673790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:52.674388 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.678814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ea1d5b6-b9c4-4b18-97e3-5ebffa826f35 None None] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:52.731949 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-420c49b9-d3d1-4b27-995e-59a5d420cdf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.758747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fb0d25eb-c3bc-400c-abbe-86098df140c9 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.6483366 Dec 21 04:57:52.761399 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50620) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:52.765793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:52.779178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'fixed_ips': [{'subnet_id': 'f8de83e1-f132-4b61-b68b-db53b889943d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:52.780044 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.852756 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.853813 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.905138 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:52.914298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Allocated IP 172.20.0.2 (8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1/f8de83e1-f132-4b61-b68b-db53b889943d/cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:53.056886 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.080571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.127264 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.167000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:53.169770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:53.173192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:53.181241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Pushing event updated for resources: {'Port': ['ID=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:53.230797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Attempting to bind port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:53.231222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Attempting to bind port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:53.231586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Attempting to bind port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:53.236558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:53.236991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Checking segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:53.237396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.237794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Bound using segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:53.238263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Bound port: cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:53.238645 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.302434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] For port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:53.305822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] For port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:53.348071 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.371496 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.373167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.438051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7b653c-0662-4957-8461-d065c1bc2be6 None None] Pushing event updated for resources: {'Port': ['ID=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:53.488828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Allocated IP 172.25.5.55 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/a36b25e7-3a72-406d-90fc-f37aef6674a0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:53.503943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.532495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.624663 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.728004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.767216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:53.769967 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:53.773954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:53.782706 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7370f44a-5e9e-4bb5-88bd-b13e66f1ed91 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:53.797949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Pushing event updated for resources: {'Port': ['ID=a36b25e7-3a72-406d-90fc-f37aef6674a0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:53.842730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c49a290a-d0ef-4adb-b81f-f6aac7cddd3a None None] Provisioning complete for port a36b25e7-3a72-406d-90fc-f37aef6674a0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:53.843275 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c49a290a-d0ef-4adb-b81f-f6aac7cddd3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:53.878179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-c49a290a-d0ef-4adb-b81f-f6aac7cddd3a None None] Port a36b25e7-3a72-406d-90fc-f37aef6674a0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:57:54.363949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-673eb165-8b52-411b-92d8-d57f9729cde2 None None] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:54.389573 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.434189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fea8257c-cf38-40ba-9da9-ccf3a9d6ec9e None None] Provisioning complete for port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:54.434584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fea8257c-cf38-40ba-9da9-ccf3a9d6ec9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.549605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fea8257c-cf38-40ba-9da9-ccf3a9d6ec9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.586057 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.586291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fea8257c-cf38-40ba-9da9-ccf3a9d6ec9e None None] For port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:54.635800 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fea8257c-cf38-40ba-9da9-ccf3a9d6ec9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.686407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea8257c-cf38-40ba-9da9-ccf3a9d6ec9e None None] Pushing event updated for resources: {'Port': ['ID=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:54.756266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b699bf6d-6acc-4596-b943-f0851e3c0631 None None] Provisioning complete for port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:54.756633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b699bf6d-6acc-4596-b943-f0851e3c0631 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.790481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Router 48a30153-10d2-4ead-af40-5748b63e4738 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:57:54.894800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:57:54.903551 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Sync routers for ids ['48a30153-10d2-4ead-af40-5748b63e4738'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:57:54.912582 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Routers {'48a30153-10d2-4ead-af40-5748b63e4738'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:57:54.917831 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['48a30153-10d2-4ead-af40-5748b63e4738'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:54.967917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:54.972156 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-eab386cf-b6ba-49b5-987a-f2135064bcfd admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.2069592 Dec 21 04:57:54.972361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50622) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:55.014689 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Set router 48a30153-10d2-4ead-af40-5748b63e4738 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:57:55.087404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:57:55.135144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:55.135520 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.205361 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:57:53Z', 'revision_number': 3, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:55.233847 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Checking router: 48a30153-10d2-4ead-af40-5748b63e4738 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:57:55.234189 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Updating router 48a30153-10d2-4ead-af40-5748b63e4738 port a36b25e7-3a72-406d-90fc-f37aef6674a0 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:57:55.258183 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.286959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.403617 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.406819 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.507406 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.560077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Allocated IP 172.20.0.1 (8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1/f8de83e1-f132-4b61-b68b-db53b889943d/5c40e3b0-cc94-43d4-8226-38dca2abf4fa) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:55.589837 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.632275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7a0e914-c984-4357-b977-127922e89736 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:55.640010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Attempting to bind port a36b25e7-3a72-406d-90fc-f37aef6674a0 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:55.640381 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Attempting to bind port a36b25e7-3a72-406d-90fc-f37aef6674a0 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:55.640751 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Attempting to bind port a36b25e7-3a72-406d-90fc-f37aef6674a0 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:55.653362 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:55.660627 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:55.660627 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.660627 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:55.660627 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Bound port: a36b25e7-3a72-406d-90fc-f37aef6674a0, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:55.660627 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.664043 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eae78071-b56a-4162-90c5-4400f983c7f9 None None] Provisioning complete for port a36b25e7-3a72-406d-90fc-f37aef6674a0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:55.664415 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eae78071-b56a-4162-90c5-4400f983c7f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.673670 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.676176 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Pushing event updated for resources: {'Port': ['ID=a36b25e7-3a72-406d-90fc-f37aef6674a0,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:55.689214 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.689564 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.689908 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.690232 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.690561 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.690994 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.691327 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.691650 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.691968 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.692489 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.692812 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.693132 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.693452 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:57:55.708262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-eae78071-b56a-4162-90c5-4400f983c7f9 None None] Port a36b25e7-3a72-406d-90fc-f37aef6674a0 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:57:55.720687 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] For port a36b25e7-3a72-406d-90fc-f37aef6674a0, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:55.723925 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] For port a36b25e7-3a72-406d-90fc-f37aef6674a0, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a36b25e7-3a72-406d-90fc-f37aef6674a0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:55.738561 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.774648 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:55.779587 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:55.783398 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:55.794887 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.811179 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Pushing event updated for resources: {'Port': ['ID=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:55.828837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.836124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.851078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7db0035-f8e8-4a16-9645-79d30018e2d1 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:55.855561 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Routers {'48a30153-10d2-4ead-af40-5748b63e4738'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:57:55.856184 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['48a30153-10d2-4ead-af40-5748b63e4738'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:55.905976 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df37ad3a-90ff-457e-abe9-e015a3b9cb93 None None] Pushing event updated for resources: {'Port': ['ID=a36b25e7-3a72-406d-90fc-f37aef6674a0,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:55.934077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f1028c05-410c-43b8-9b6f-6aa362f44f2f None None] Provisioning complete for port a36b25e7-3a72-406d-90fc-f37aef6674a0 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:55.934563 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1028c05-410c-43b8-9b6f-6aa362f44f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:55.981023 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] Set router 48a30153-10d2-4ead-af40-5748b63e4738 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:57:56.033746 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1028c05-410c-43b8-9b6f-6aa362f44f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.051698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f1028c05-410c-43b8-9b6f-6aa362f44f2f None None] For port a36b25e7-3a72-406d-90fc-f37aef6674a0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a36b25e7-3a72-406d-90fc-f37aef6674a0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:56.053429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.149817 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1028c05-410c-43b8-9b6f-6aa362f44f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.169947 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:57:53Z', 'revision_number': 3, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:56.196742 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08f5d47-57a4-4d17-9b9b-820b0c9cd388 None None] The sync data for ids ['48a30153-10d2-4ead-af40-5748b63e4738'] in n-d-822053-11 is: [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:57:53Z', 'revision_number': 3, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:57:56.198684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1028c05-410c-43b8-9b6f-6aa362f44f2f None None] Pushing event updated for resources: {'Port': ['ID=a36b25e7-3a72-406d-90fc-f37aef6674a0,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:56.226771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.270139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dedc6832-af20-4c1b-a1ab-3ea7bd78bcd7 None None] Provisioning complete for port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:56.270513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dedc6832-af20-4c1b-a1ab-3ea7bd78bcd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.287228 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.308445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-dedc6832-af20-4c1b-a1ab-3ea7bd78bcd7 None None] Port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:57:56.355356 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.357064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Pushing event updated for resources: {'Port': ['ID=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:56.462508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:56.464671 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:56.601072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Router 48a30153-10d2-4ead-af40-5748b63e4738 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:57:56.721418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:57:56.734975 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a548e837-af93-44c1-9933-8acb3c6d3a17 admin admin] 10.222.0.18 "PUT /v2.0/routers/48a30153-10d2-4ead-af40-5748b63e4738/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7546322 Dec 21 04:57:56.735192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-344551fa-6876-464d-8f53-f200f5ae3e70 None None] Provisioning complete for port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:56.735192 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-344551fa-6876-464d-8f53-f200f5ae3e70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:56.775309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-344551fa-6876-464d-8f53-f200f5ae3e70 None None] Port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:57:57.088882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a36b25e7-3a72-406d-90fc-f37aef6674a0 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:57:57.137356 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port a36b25e7-3a72-406d-90fc-f37aef6674a0 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:57.137724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.391013 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50638) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:57.396057 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-305838602-network', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:57.481155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Made reservation on behalf of 09d278e115a94d3092fb69fdbc7145dc for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:57.483691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.497052 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.572529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.668937 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.694702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:57:57.704582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=642d72bf-73e2-41e4-a659-b0f4c1f2e48c,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:57.709207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.709553 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Added segment b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a of type vlan for network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa Dec 21 04:57:57.749093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.784841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Sync routers for ids ['48a30153-10d2-4ead-af40-5748b63e4738'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:57:57.799348 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Routers {'48a30153-10d2-4ead-af40-5748b63e4738'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:57:57.799966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['48a30153-10d2-4ead-af40-5748b63e4738'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:57.848572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.849628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:57.850214 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:57.905896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Set router 48a30153-10d2-4ead-af40-5748b63e4738 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:57:57.913368 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] Pushing event updated for resources: {'Network': ['ID=0d8d8e5a-da70-45f2-87d6-77f83a452ffa,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:57.932746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:57:57.972725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e2aab82d-9929-4ec5-ad2b-ff279d53319c admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5777817 Dec 21 04:57:57.972898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50640) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:57.978135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Request body: {'subnet': {'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-subnet', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:58.087426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Made reservation on behalf of 09d278e115a94d3092fb69fdbc7145dc for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:57:58.089805 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.161147 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:57:55Z', 'revision_number': 4, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '5c40e3b0-cc94-43d4-8226-38dca2abf4fa', 'name': '', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'mac_address': 'fa:16:3e:1a:45:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_interface', 'standard_attr_id': 4148, 'fixed_ips': [{'subnet_id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:55Z', 'updated_at': '2021-12-21T04:57:56Z', 'revision_number': 2, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'subnets': [{'id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:58.186971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Checking router: 48a30153-10d2-4ead-af40-5748b63e4738 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:57:58.187335 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Updating router 48a30153-10d2-4ead-af40-5748b63e4738 port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:57:58.211478 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.316063 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.374711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Pushing event updated for resources: {'Subnet': ['ID=e2db6233-d4b2-4671-b90d-90682af7738e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:58.384084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Checking segment: {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:58.384452 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Network hostable DHCP agents. Network: 0d8d8e5a-da70-45f2-87d6-77f83a452ffa, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:57:58.447052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:57:58.504052 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 0d8d8e5a-da70-45f2-87d6-77f83a452ffa) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:58.508657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:57:58.509237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.514278 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6197a9d-6ab4-4521-ac29-9a17ddb93c29 None None] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:57:58.566516 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b23279b7-83ad-404d-bd08-fec5bbf8ca6c admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5900760 Dec 21 04:57:58.566713 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50642) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:57:58.571295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:57:58.690362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-0d8d8e5a-da70-45f2-87d6-77f83a452ffa', 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa', 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'fixed_ips': [{'subnet_id': 'e2db6233-d4b2-4671-b90d-90682af7738e'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:57:58.691260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.715220 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.722499 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.732364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.771206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.807686 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:58.888991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Allocated IP 172.20.0.2 (0d8d8e5a-da70-45f2-87d6-77f83a452ffa/e2db6233-d4b2-4671-b90d-90682af7738e/d2d71924-8483-44f7-8fdc-7e10e1f715d1) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:58.906686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769648d2-f6e2-4bfc-93b6-779979ee0244 None None] Pushing event updated for resources: {'Port': ['ID=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:58.982003 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.002673 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Attempting to bind port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:59.003079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Attempting to bind port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:59.003449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Attempting to bind port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:59.012857 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:59.013233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Checking segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:59.013635 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.014031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Bound using segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:59.014501 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Bound port: 5c40e3b0-cc94-43d4-8226-38dca2abf4fa, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:59.014889 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.146577 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.150280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be66c224-28a5-4507-b2b3-a29a68a7ca5b None None] Provisioning complete for port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:59.154402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be66c224-28a5-4507-b2b3-a29a68a7ca5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.154402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] For port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:59.156078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] For port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:59.187705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-be66c224-28a5-4507-b2b3-a29a68a7ca5b None None] Port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:57:59.236100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.241893 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.261827 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.269653 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.279914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:59.287663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:59.292721 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:59.315551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Pushing event updated for resources: {'Port': ['ID=d2d71924-8483-44f7-8fdc-7e10e1f715d1,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:59.353989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Routers {'48a30153-10d2-4ead-af40-5748b63e4738'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:57:59.355046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['48a30153-10d2-4ead-af40-5748b63e4738'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:59.380010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Allocated IP 172.25.5.184 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/fec6f416-e744-42e4-ae1e-0472c56f5a28) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:57:59.460509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Attempting to bind port d2d71924-8483-44f7-8fdc-7e10e1f715d1 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:57:59.460925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Attempting to bind port d2d71924-8483-44f7-8fdc-7e10e1f715d1 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:57:59.461294 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Attempting to bind port d2d71924-8483-44f7-8fdc-7e10e1f715d1 on network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:57:59.503228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769648d2-f6e2-4bfc-93b6-779979ee0244 None None] Pushing event updated for resources: {'Port': ['ID=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:59.514861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:57:59.515283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Checking segment: {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:57:59.515691 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.516092 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Bound using segment: {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:57:59.516591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Bound port: d2d71924-8483-44f7-8fdc-7e10e1f715d1, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:57:59.516977 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.553079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] Set router 48a30153-10d2-4ead-af40-5748b63e4738 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:57:59.572104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-858bc11b-9e7b-47d7-8be2-ab423f63c8e5 None None] Provisioning complete for port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:57:59.572395 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-858bc11b-9e7b-47d7-8be2-ab423f63c8e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.701414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] For port d2d71924-8483-44f7-8fdc-7e10e1f715d1, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:57:59.734342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] For port d2d71924-8483-44f7-8fdc-7e10e1f715d1, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d71924-8483-44f7-8fdc-7e10e1f715d1,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:57:59.809834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.816021 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.846779 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-858bc11b-9e7b-47d7-8be2-ab423f63c8e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.911280 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:57:59.940693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ce9a74-e08e-4f91-a4c5-651dd0adebb2 None None] Pushing event updated for resources: {'Port': ['ID=d2d71924-8483-44f7-8fdc-7e10e1f715d1,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:57:59.946995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-858bc11b-9e7b-47d7-8be2-ab423f63c8e5 None None] For port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:57:59.966324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:57:59.967732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:57:59.970287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:57:59.981781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:57:55Z', 'revision_number': 4, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '5c40e3b0-cc94-43d4-8226-38dca2abf4fa', 'name': '', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'mac_address': 'fa:16:3e:1a:45:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_interface', 'standard_attr_id': 4148, 'fixed_ips': [{'subnet_id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:55Z', 'updated_at': '2021-12-21T04:57:59Z', 'revision_number': 4, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'subnets': [{'id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:57:59.985289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aee85dff-4cce-441d-911d-64a8cc5d85d4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:57:59.996213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Pushing event updated for resources: {'Port': ['ID=fec6f416-e744-42e4-ae1e-0472c56f5a28,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:00.021775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c43ffd73-2238-43e0-b7e0-efcd29d59c34 None None] The sync data for ids ['48a30153-10d2-4ead-af40-5748b63e4738'] in n-d-822053-11 is: [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:57:55Z', 'revision_number': 4, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '5c40e3b0-cc94-43d4-8226-38dca2abf4fa', 'name': '', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'mac_address': 'fa:16:3e:1a:45:ba', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_interface', 'standard_attr_id': 4148, 'fixed_ips': [{'subnet_id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:55Z', 'updated_at': '2021-12-21T04:57:59Z', 'revision_number': 4, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'subnets': [{'id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:58:00.026226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-858bc11b-9e7b-47d7-8be2-ab423f63c8e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:00.103667 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858bc11b-9e7b-47d7-8be2-ab423f63c8e5 None None] Pushing event updated for resources: {'Port': ['ID=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:00.156454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d5aa8db9-d51a-4846-95d4-e6cb0d88c05b None None] Provisioning complete for port fec6f416-e744-42e4-ae1e-0472c56f5a28 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:00.157139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5aa8db9-d51a-4846-95d4-e6cb0d88c05b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:00.202908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d5aa8db9-d51a-4846-95d4-e6cb0d88c05b None None] Port fec6f416-e744-42e4-ae1e-0472c56f5a28 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:58:00.388988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:00.595212 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:00.835770 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:58:00.918228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d66f4bac-3f67-4bde-9a94-4f4af8d61cb6 None None] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:58:00.953714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:58:00.968167 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Sync routers for ids ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:58:00.981441 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Routers {'93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:58:00.983305 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:01.026266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.030725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50644) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:58:01.034128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6ad14d4c-d3dd-4630-8068-dac71fe3b8d8 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 2.4657285 Dec 21 04:58:01.076430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-c09a2d99-066d-4ce9-9d0f-a61d8974ef06 None None] Provisioning complete for port d2d71924-8483-44f7-8fdc-7e10e1f715d1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:01.076900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c09a2d99-066d-4ce9-9d0f-a61d8974ef06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.103120 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Set router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:58:01.215441 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5c40e3b0-cc94-43d4-8226-38dca2abf4fa up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:01.282507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c09a2d99-066d-4ce9-9d0f-a61d8974ef06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.284728 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:01.285217 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.316253 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:58:00Z', 'revision_number': 3, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:57:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:01.350480 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Checking router: 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:58:01.352617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Updating router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 port fec6f416-e744-42e4-ae1e-0472c56f5a28 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:58:01.359675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-c09a2d99-066d-4ce9-9d0f-a61d8974ef06 None None] For port d2d71924-8483-44f7-8fdc-7e10e1f715d1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d71924-8483-44f7-8fdc-7e10e1f715d1,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:01.382077 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.441071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d71924-8483-44f7-8fdc-7e10e1f715d1 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:01.444679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c09a2d99-066d-4ce9-9d0f-a61d8974ef06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.520047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c09a2d99-066d-4ce9-9d0f-a61d8974ef06 None None] Pushing event updated for resources: {'Port': ['ID=d2d71924-8483-44f7-8fdc-7e10e1f715d1,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:01.532940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d2d71924-8483-44f7-8fdc-7e10e1f715d1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:01.533381 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.584557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3840acde-23fd-46ce-987a-17f97afd1e9f None None] Provisioning complete for port d2d71924-8483-44f7-8fdc-7e10e1f715d1 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:01.585020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3840acde-23fd-46ce-987a-17f97afd1e9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.594917 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.652648 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.727618 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.776864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Allocated IP 172.20.0.1 (0d8d8e5a-da70-45f2-87d6-77f83a452ffa/e2db6233-d4b2-4671-b90d-90682af7738e/4905f196-a52c-4705-8b1a-009f7e0ce8e7) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:58:01.785727 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Attempting to bind port fec6f416-e744-42e4-ae1e-0472c56f5a28 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:58:01.786139 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Attempting to bind port fec6f416-e744-42e4-ae1e-0472c56f5a28 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:58:01.786475 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Attempting to bind port fec6f416-e744-42e4-ae1e-0472c56f5a28 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:58:01.788517 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd2fe906-e8c0-43b7-80d2-794d0af9b87d None None] Pushing event updated for resources: {'Port': ['ID=fec6f416-e744-42e4-ae1e-0472c56f5a28,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:01.794394 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:58:01.794788 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:58:01.795253 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.795638 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:58:01.796152 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Bound port: fec6f416-e744-42e4-ae1e-0472c56f5a28, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:58:01.796527 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.815049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ead8214-7730-4ba7-8c53-f599d729c011 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:58:01.856338 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] For port fec6f416-e744-42e4-ae1e-0472c56f5a28, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:58:01.859617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] For port fec6f416-e744-42e4-ae1e-0472c56f5a28, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fec6f416-e744-42e4-ae1e-0472c56f5a28,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:58:01.875853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.938640 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.961564 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:01.984049 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42dbddfc-8325-4888-8643-cab2ed386fee None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:58:02.005124 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Routers {'93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:58:02.005821 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:02.014953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5df1132b-7f70-4a33-88ea-3751d122dc00 None None] Provisioning complete for port fec6f416-e744-42e4-ae1e-0472c56f5a28 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:02.015123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:58:02.015466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5df1132b-7f70-4a33-88ea-3751d122dc00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.017967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:58:02.021598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:58:02.028864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Pushing event updated for resources: {'Port': ['ID=4905f196-a52c-4705-8b1a-009f7e0ce8e7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:02.066905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.124154 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd2fe906-e8c0-43b7-80d2-794d0af9b87d None None] Pushing event updated for resources: {'Port': ['ID=fec6f416-e744-42e4-ae1e-0472c56f5a28,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:02.127548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5df1132b-7f70-4a33-88ea-3751d122dc00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.153354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-5df1132b-7f70-4a33-88ea-3751d122dc00 None None] For port fec6f416-e744-42e4-ae1e-0472c56f5a28, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fec6f416-e744-42e4-ae1e-0472c56f5a28,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:02.160837 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] Set router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:58:02.241211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5df1132b-7f70-4a33-88ea-3751d122dc00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.291498 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.311142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df1132b-7f70-4a33-88ea-3751d122dc00 None None] Pushing event updated for resources: {'Port': ['ID=fec6f416-e744-42e4-ae1e-0472c56f5a28,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:02.365776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e16ff083-ac51-4e6b-9a1a-8c2082ac5f93 None None] Provisioning complete for port fec6f416-e744-42e4-ae1e-0472c56f5a28 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:02.366304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e16ff083-ac51-4e6b-9a1a-8c2082ac5f93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.444360 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:58:00Z', 'revision_number': 3, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:58:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:02.458536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e16ff083-ac51-4e6b-9a1a-8c2082ac5f93 None None] Provisioning complete for port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:02.459104 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e16ff083-ac51-4e6b-9a1a-8c2082ac5f93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.463866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.471314 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f23524e6-20c5-4a66-997a-1bc8670ecca7 None None] The sync data for ids ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'] in n-d-822053-11 is: [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:58:00Z', 'revision_number': 3, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:58:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:58:02.497337 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e16ff083-ac51-4e6b-9a1a-8c2082ac5f93 None None] Port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:58:02.521215 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.591557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Pushing event updated for resources: {'Port': ['ID=4905f196-a52c-4705-8b1a-009f7e0ce8e7,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:02.593900 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:02.719375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:58:02.721197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:58:02.849943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:58:02.974147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:58:02.980005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fe0c8533-860e-4182-9d9f-d1c62c136623 admin admin] 10.222.0.18 "PUT /v2.0/routers/93ed7f2f-ebe9-4b24-86b4-2a853a894cd3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9481940 Dec 21 04:58:03.034145 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-35022646-5ab3-439a-ae74-7295857f4dad None None] Provisioning complete for port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:03.034759 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35022646-5ab3-439a-ae74-7295857f4dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:03.084274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-35022646-5ab3-439a-ae74-7295857f4dad None None] Port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:58:03.182495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d71924-8483-44f7-8fdc-7e10e1f715d1 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:03.234321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d2d71924-8483-44f7-8fdc-7e10e1f715d1 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:03.234772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:03.336232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fec6f416-e744-42e4-ae1e-0472c56f5a28 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:03.385257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port fec6f416-e744-42e4-ae1e-0472c56f5a28 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:03.385651 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:04.100325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-576eb494-ca4c-46bd-8c88-b2280114010c tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:04.101804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-576eb494-ca4c-46bd-8c88-b2280114010c tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/networks?id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 HTTP/1.1" status: 200 len: 816 time: 0.1107032 Dec 21 04:58:04.118230 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-d840ff4e-e557-4f15-9511-39b11041985b tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/quotas/a5be355061f74db2b46c76c8d1c73846 HTTP/1.1" status: 200 len: 375 time: 0.0102842 Dec 21 04:58:04.173310 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-3895e92a-048c-4208-b687-5ab8088d3516 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=a5be355061f74db2b46c76c8d1c73846&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0492730 Dec 21 04:58:04.206288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Sync routers for ids ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:58:04.216293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Routers {'93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:58:04.216918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:04.277106 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-3e0cb6f3-5100-486c-a01c-896c5ae0f93c service neutron] 10.222.0.18 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869262 Dec 21 04:58:04.321641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Set router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:58:04.365613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-5d02b881-3a58-4f9e-b9b8-de2f021016cb service neutron] 10.222.0.18 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819211 Dec 21 04:58:04.517516 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4905f196-a52c-4705-8b1a-009f7e0ce8e7', 'name': '', 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'mac_address': 'fa:16:3e:63:8c:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4160, 'fixed_ips': [{'subnet_id': 'e2db6233-d4b2-4671-b90d-90682af7738e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:58:01Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 2, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'subnets': [{'id': 'e2db6233-d4b2-4671-b90d-90682af7738e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:04.550312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Checking router: 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:58:04.550312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Updating router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:58:04.575838 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:04.738369 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cd35e5f-2427-4d73-9e0f-29bc959085fa req-094f12fc-b81e-4692-8cf6-431fce151fe6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 210 time: 0.1603777 Dec 21 04:58:04.864938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:04.949593 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.009189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36666bb-f0cb-45c6-948c-d067526a361c None None] Pushing event updated for resources: {'Port': ['ID=4905f196-a52c-4705-8b1a-009f7e0ce8e7,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:05.074590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Attempting to bind port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:58:05.074999 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Attempting to bind port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:58:05.075369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Attempting to bind port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 on network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:58:05.080424 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:58:05.080811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Checking segment: {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:58:05.081207 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.081606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Bound using segment: {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:58:05.082080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Bound port: 4905f196-a52c-4705-8b1a-009f7e0ce8e7, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:58:05.082471 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.157732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] For port 4905f196-a52c-4705-8b1a-009f7e0ce8e7, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:58:05.161077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] For port 4905f196-a52c-4705-8b1a-009f7e0ce8e7, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4905f196-a52c-4705-8b1a-009f7e0ce8e7,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:58:05.217534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d7f39333-fb67-43af-9be5-871118a15d05 None None] Provisioning complete for port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:05.218101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7f39333-fb67-43af-9be5-871118a15d05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.247706 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.292142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d7f39333-fb67-43af-9be5-871118a15d05 None None] Port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:58:05.313023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Routers {'93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:58:05.313638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:57:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:05.316580 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36666bb-f0cb-45c6-948c-d067526a361c None None] Pushing event updated for resources: {'Port': ['ID=4905f196-a52c-4705-8b1a-009f7e0ce8e7,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:05.434150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] Set router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:58:05.566641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e9318676-b2b1-4ab4-81bb-5e823a0ec40a None None] Provisioning complete for port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:05.567040 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e9318676-b2b1-4ab4-81bb-5e823a0ec40a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.694733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e9318676-b2b1-4ab4-81bb-5e823a0ec40a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.727183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4905f196-a52c-4705-8b1a-009f7e0ce8e7', 'name': '', 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'mac_address': 'fa:16:3e:63:8c:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4160, 'fixed_ips': [{'subnet_id': 'e2db6233-d4b2-4671-b90d-90682af7738e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:58:01Z', 'updated_at': '2021-12-21T04:58:05Z', 'revision_number': 4, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'subnets': [{'id': 'e2db6233-d4b2-4671-b90d-90682af7738e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:58:05.758553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e9318676-b2b1-4ab4-81bb-5e823a0ec40a None None] For port 4905f196-a52c-4705-8b1a-009f7e0ce8e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4905f196-a52c-4705-8b1a-009f7e0ce8e7,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:05.760058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd8a928-c21e-4a56-9fa2-6450b1011457 None None] The sync data for ids ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'] in n-d-822053-11 is: [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4905f196-a52c-4705-8b1a-009f7e0ce8e7', 'name': '', 'network_id': '0d8d8e5a-da70-45f2-87d6-77f83a452ffa', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'mac_address': 'fa:16:3e:63:8c:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_interface', 'standard_attr_id': 4160, 'fixed_ips': [{'subnet_id': 'e2db6233-d4b2-4671-b90d-90682af7738e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:58:01Z', 'updated_at': '2021-12-21T04:58:05Z', 'revision_number': 4, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'subnets': [{'id': 'e2db6233-d4b2-4671-b90d-90682af7738e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:58:05.847617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e9318676-b2b1-4ab4-81bb-5e823a0ec40a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:05.858414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-691fb128-c6ce-433e-83fe-25ea50eb145e req-7c625907-0fca-41f5-8305-e3923705f7cd tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 210 time: 0.0484843 Dec 21 04:58:05.910551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9318676-b2b1-4ab4-81bb-5e823a0ec40a None None] Pushing event updated for resources: {'Port': ['ID=4905f196-a52c-4705-8b1a-009f7e0ce8e7,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:06.697473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-79303c64-a560-45ca-91bf-d49e5552c673 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:06.698962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-79303c64-a560-45ca-91bf-d49e5552c673 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.54 "GET /v2.0/networks?id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 HTTP/1.1" status: 200 len: 816 time: 0.1073191 Dec 21 04:58:06.718506 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Request body: {'port': {'device_id': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'admin_state_up': True, 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:58:06.904172 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Made reservation on behalf of a5be355061f74db2b46c76c8d1c73846 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:58:06.908669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:06.959812 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1681b727-a3e5-4783-b6fc-ae65edb6baf6 req-3b0a7907-56b3-4859-885e-764349494a02 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 210 time: 0.0367136 Dec 21 04:58:07.047313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Allocated IP 172.20.0.13 (8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1/f8de83e1-f132-4b61-b68b-db53b889943d/81ae2458-bf79-4ed9-985f-c571080d3559) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:58:07.096120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4905f196-a52c-4705-8b1a-009f7e0ce8e7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:07.149541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:07.149920 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.213654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.322432 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.373383 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:58:07.377260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:58:07.379689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:58:07.409302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Pushing event updated for resources: {'Port': ['ID=81ae2458-bf79-4ed9-985f-c571080d3559,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:07.438692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:07.439335 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.511492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-1a11d10a-e860-4dca-a3eb-242e15f19ea6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7969015 Dec 21 04:58:07.531155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Request body: {'port': {'device_id': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:58:07.578598 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8f73a27a-72c8-4ed3-96c2-c4d9e4a43fe1 None None] Provisioning complete for port 81ae2458-bf79-4ed9-985f-c571080d3559 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:07.579024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8f73a27a-72c8-4ed3-96c2-c4d9e4a43fe1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.590069 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.625577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8f73a27a-72c8-4ed3-96c2-c4d9e4a43fe1 None None] Port 81ae2458-bf79-4ed9-985f-c571080d3559 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:58:07.855997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 81ae2458-bf79-4ed9-985f-c571080d3559 {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:58:07.863839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.875881 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Transition to ACTIVE for port object 81ae2458-bf79-4ed9-985f-c571080d3559 will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:58:07.926789 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:07.983861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Pushing event updated for resources: {'Port': ['ID=81ae2458-bf79-4ed9-985f-c571080d3559,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:08.064431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Attempting to bind port 81ae2458-bf79-4ed9-985f-c571080d3559 on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:58:08.064782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Attempting to bind port 81ae2458-bf79-4ed9-985f-c571080d3559 by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:58:08.065138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Attempting to bind port 81ae2458-bf79-4ed9-985f-c571080d3559 on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:58:08.071039 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Port 81ae2458-bf79-4ed9-985f-c571080d3559 on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:58:08.071373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Attempting to bind port 81ae2458-bf79-4ed9-985f-c571080d3559 on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:58:08.076541 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:58:08.076883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Checking segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:58:08.077288 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Bound using segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:58:08.077727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Bound port: 81ae2458-bf79-4ed9-985f-c571080d3559, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:58:08.078110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:08.080164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3d2440-0458-468e-b271-c9f2e56db62f req-35f496c6-54f4-42a6-9ff1-16c08f4d2259 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.081678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f3d2440-0458-468e-b271-c9f2e56db62f req-35f496c6-54f4-42a6-9ff1-16c08f4d2259 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 944 time: 0.0545774 Dec 21 04:58:08.135553 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f3d2440-0458-468e-b271-c9f2e56db62f req-51a585dd-b684-4846-bcfe-43aa40b60f19 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467298 Dec 21 04:58:08.263689 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] For port 81ae2458-bf79-4ed9-985f-c571080d3559, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:58:08.266914 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] For port 81ae2458-bf79-4ed9-985f-c571080d3559, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81ae2458-bf79-4ed9-985f-c571080d3559,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:58:08.344390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:08.380088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.380718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:08.382097 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] 10.222.0.54 "PUT /v2.0/ports/81ae2458-bf79-4ed9-985f-c571080d3559 HTTP/1.1" status: 200 len: 1093 time: 0.8556552 Dec 21 04:58:08.382543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'tag': '81ae2458-bf79-4ed9-985f-c571080d3559'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:58:08.385354 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae" -d '{"events": [{"name": "network-changed", "server_uuid": "5d31f726-80e7-4b8d-8b99-77bd21ce69c5", "tag": "81ae2458-bf79-4ed9-985f-c571080d3559"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:58:08.414489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3c5764f-734f-43a0-bf85-3eff66f50fd2 service neutron] Pushing event updated for resources: {'Port': ['ID=81ae2458-bf79-4ed9-985f-c571080d3559,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:08.429075 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:58:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64e2ebe3-e77a-4a9d-9312-c0d5eb993d86 x-openstack-request-id: req-64e2ebe3-e77a-4a9d-9312-c0d5eb993d86 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:58:08.429374 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5d31f726-80e7-4b8d-8b99-77bd21ce69c5", "tag": "81ae2458-bf79-4ed9-985f-c571080d3559", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:58:08.429631 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-64e2ebe3-e77a-4a9d-9312-c0d5eb993d86 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:58:08.430072 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'tag': '81ae2458-bf79-4ed9-985f-c571080d3559', 'status': 'completed', 'code': 200} Dec 21 04:58:08.518717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae req-854735a4-133c-41e0-afef-72c6ca2fc3ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.520381 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae req-854735a4-133c-41e0-afef-72c6ca2fc3ef service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a5be355061f74db2b46c76c8d1c73846&device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 1096 time: 0.0468600 Dec 21 04:58:08.626274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae req-237bdddc-2279-4c79-97dd-d7ef7cd0018e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.627807 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae req-237bdddc-2279-4c79-97dd-d7ef7cd0018e service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=a5be355061f74db2b46c76c8d1c73846&shared=False HTTP/1.1" status: 200 len: 917 time: 0.0938418 Dec 21 04:58:08.723260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae req-c5702db0-4510-4f6f-9b79-ffaaa6379ae9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.724758 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c30afa2e-7fe3-4abd-a830-c82fb4e6e8ae req-c5702db0-4510-4f6f-9b79-ffaaa6379ae9 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0893950 Dec 21 04:58:08.818815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-5a2bf817-7807-490c-aed3-b9a6a2eb91ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.820291 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-5a2bf817-7807-490c-aed3-b9a6a2eb91ba service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a5be355061f74db2b46c76c8d1c73846&device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 1096 time: 0.0392227 Dec 21 04:58:08.866851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-790a19d4-54c4-4b21-b229-f86fb9ede947 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=81ae2458-bf79-4ed9-985f-c571080d3559 HTTP/1.1" status: 200 len: 217 time: 0.0327468 Dec 21 04:58:08.918131 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-74e057e3-37d0-4595-b49c-d75b958af618 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.919569 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-74e057e3-37d0-4595-b49c-d75b958af618 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=f8de83e1-f132-4b61-b68b-db53b889943d HTTP/1.1" status: 200 len: 855 time: 0.0460131 Dec 21 04:58:08.964487 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-dea030d7-900d-4215-876e-98a17ae8f70f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:08.965948 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-dea030d7-900d-4215-876e-98a17ae8f70f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0384758 Dec 21 04:58:09.057014 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-a582bc06-f3d6-4eed-910b-2a62c2c10cc0 service neutron] 10.222.0.54 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829866 Dec 21 04:58:09.143448 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-64bdafeb-67d6-4f66-a1c1-1f2755ec2a97 req-b901d1d1-d4e7-4cde-8caf-aec4c486bacd service neutron] 10.222.0.54 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789711 Dec 21 04:58:09.253611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e0543f-828a-456b-86c8-239a9bc9bb8a req-2bc6d179-bce4-4fa8-af0e-da6a3d3c76b1 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:09.255032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16e0543f-828a-456b-86c8-239a9bc9bb8a req-2bc6d179-bce4-4fa8-af0e-da6a3d3c76b1 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 944 time: 0.0493631 Dec 21 04:58:09.306871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-16e0543f-828a-456b-86c8-239a9bc9bb8a req-8c37fb33-098b-4df5-bb48-351699d7de2a tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442579 Dec 21 04:58:10.425864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2a898f-4b63-48dc-9d8f-fd571db67835 req-f737f503-31c0-4bab-aaa8-a0f7cbfc9232 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:10.427351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa2a898f-4b63-48dc-9d8f-fd571db67835 req-f737f503-31c0-4bab-aaa8-a0f7cbfc9232 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 944 time: 0.0519345 Dec 21 04:58:10.472870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa2a898f-4b63-48dc-9d8f-fd571db67835 req-79c4a72b-6614-483a-8d00-5e088c6e4fb6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388067 Dec 21 04:58:11.586861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855b118a-68b1-459d-a97b-a137e53cef69 req-7f337d19-1b71-4eeb-9d03-cd739d46d88f tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:11.588297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-855b118a-68b1-459d-a97b-a137e53cef69 req-7f337d19-1b71-4eeb-9d03-cd739d46d88f tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 944 time: 0.0468447 Dec 21 04:58:11.635418 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-855b118a-68b1-459d-a97b-a137e53cef69 req-d3b8e5be-5c63-43a6-bd75-2db89ce86a46 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410578 Dec 21 04:58:12.082055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81ae2458-bf79-4ed9-985f-c571080d3559 details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:58:12.176398 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 81ae2458-bf79-4ed9-985f-c571080d3559, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81ae2458-bf79-4ed9-985f-c571080d3559,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:12.186431 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '81ae2458-bf79-4ed9-985f-c571080d3559', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'port_id': '81ae2458-bf79-4ed9-985f-c571080d3559', 'mac_address': 'fa:16:3e:fc:e2:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:58:12.223537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:12.235989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81ae2458-bf79-4ed9-985f-c571080d3559 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:58:12.255052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 81ae2458-bf79-4ed9-985f-c571080d3559, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81ae2458-bf79-4ed9-985f-c571080d3559,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:12.348760 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:12.393680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=81ae2458-bf79-4ed9-985f-c571080d3559,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:12.400690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.401038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.401403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.401742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.402074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.402404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.402731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.403089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.403416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.403739 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.404063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.404394 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.404700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:12.625252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['81ae2458-bf79-4ed9-985f-c571080d3559'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:58:12.757731 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d5a3f93-cb07-43d5-a992-f7b9ac37d76a req-1e592aaf-808e-4c16-bc4e-c8e74ac37d1c tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:12.759276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d5a3f93-cb07-43d5-a992-f7b9ac37d76a req-1e592aaf-808e-4c16-bc4e-c8e74ac37d1c tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 945 time: 0.0556276 Dec 21 04:58:12.806019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d5a3f93-cb07-43d5-a992-f7b9ac37d76a req-b5b07e73-cbfc-49a1-ada5-f19729b62e44 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406590 Dec 21 04:58:13.918752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf1df07-17cc-4d49-99ca-8cc502259530 req-a7c72c02-acf0-4b63-83cc-c66603d67950 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:13.920228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbf1df07-17cc-4d49-99ca-8cc502259530 req-a7c72c02-acf0-4b63-83cc-c66603d67950 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 945 time: 0.0476456 Dec 21 04:58:13.965047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbf1df07-17cc-4d49-99ca-8cc502259530 req-304324a4-f111-4e67-b967-08d9b4dff76a tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389609 Dec 21 04:58:14.095259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81ae2458-bf79-4ed9-985f-c571080d3559 up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:14.224021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 81ae2458-bf79-4ed9-985f-c571080d3559 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:58:14.227600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 81ae2458-bf79-4ed9-985f-c571080d3559 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:14.227970 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:14.305324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:14.326753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81ae2458-bf79-4ed9-985f-c571080d3559'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:58:14.329018 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb3ec7ef-0496-4c48-9c0a-bd048a1dd31b" -d '{"events": [{"server_uuid": "5d31f726-80e7-4b8d-8b99-77bd21ce69c5", "name": "network-vif-plugged", "status": "completed", "tag": "81ae2458-bf79-4ed9-985f-c571080d3559"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:58:14.343666 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 81ae2458-bf79-4ed9-985f-c571080d3559, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81ae2458-bf79-4ed9-985f-c571080d3559,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:14.366428 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:58:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8e6c8eb-832e-4163-aac3-c7786137f6d1 x-openstack-request-id: req-a8e6c8eb-832e-4163-aac3-c7786137f6d1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:58:14.366759 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5d31f726-80e7-4b8d-8b99-77bd21ce69c5", "name": "network-vif-plugged", "status": "completed", "tag": "81ae2458-bf79-4ed9-985f-c571080d3559", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:58:14.367049 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-a8e6c8eb-832e-4163-aac3-c7786137f6d1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:58:14.370957 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81ae2458-bf79-4ed9-985f-c571080d3559', 'code': 200} Dec 21 04:58:14.418357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:14.466402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=81ae2458-bf79-4ed9-985f-c571080d3559,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:14.498782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffed4cf1-493d-46fa-a9ca-6652d7884b79 req-8d084f33-24a8-480b-bf03-3412b5150839 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:14.500323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ffed4cf1-493d-46fa-a9ca-6652d7884b79 req-8d084f33-24a8-480b-bf03-3412b5150839 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 1098 time: 0.0399997 Dec 21 04:58:14.550243 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ffed4cf1-493d-46fa-a9ca-6652d7884b79 req-66336a99-6e8c-43d9-9c76-fbc99ac8b184 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401316 Dec 21 04:58:15.082964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf3d60d-a345-4604-9951-83115a772e43 req-889ec458-120e-44a0-9b16-c21e8653dc09 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:15.084450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bf3d60d-a345-4604-9951-83115a772e43 req-889ec458-120e-44a0-9b16-c21e8653dc09 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 946 time: 0.0522132 Dec 21 04:58:15.130651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1bf3d60d-a345-4604-9951-83115a772e43 req-38989348-097e-4486-87df-52950f464709 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401995 Dec 21 04:58:16.246699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71231a21-bdbb-4b63-81b5-0fa9e5bc09bb req-794676bc-ba7e-4691-95aa-a72e48082270 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:16.248195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71231a21-bdbb-4b63-81b5-0fa9e5bc09bb req-794676bc-ba7e-4691-95aa-a72e48082270 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 946 time: 0.0490055 Dec 21 04:58:16.293819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71231a21-bdbb-4b63-81b5-0fa9e5bc09bb req-783c9255-99b4-4679-b384-08b94aa119fc tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398347 Dec 21 04:58:16.420383 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ad0766-5ba7-4536-8ae3-356854e9ac4f req-62b22149-0b6e-467f-b317-11b3c070113e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:16.421865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2ad0766-5ba7-4536-8ae3-356854e9ac4f req-62b22149-0b6e-467f-b317-11b3c070113e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 946 time: 0.0493624 Dec 21 04:58:16.471641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2ad0766-5ba7-4536-8ae3-356854e9ac4f req-69241e4a-5f53-4c9f-95ff-3a00002b986e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437062 Dec 21 04:58:19.925676 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-33e318c2-bf5b-4369-8e0d-389adb02b582 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:20.873523 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:58:22.703757 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dbac9800-a597-4da9-adcc-28fb2bdceee6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:23.527078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:23.572874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:25.310406 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:25.440767 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:25.812107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:41.638581 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d50af49-41b2-4979-81fa-59cbb62a806b req-9b496284-b5dc-443d-abe2-7d979e5add0e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:41.640127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d50af49-41b2-4979-81fa-59cbb62a806b req-9b496284-b5dc-443d-abe2-7d979e5add0e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 946 time: 0.0489941 Dec 21 04:58:41.689450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9d50af49-41b2-4979-81fa-59cbb62a806b req-a9ec88d9-3837-46c4-bef2-c5f79d0a9703 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433354 Dec 21 04:58:42.808390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a53d2-8c4e-4a3d-a9ee-adbf6c75110a req-a81ff57d-d6d7-4d63-853e-406f7b1b138a tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:42.809879 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c75a53d2-8c4e-4a3d-a9ee-adbf6c75110a req-a81ff57d-d6d7-4d63-853e-406f7b1b138a tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 946 time: 0.0483687 Dec 21 04:58:42.857326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c75a53d2-8c4e-4a3d-a9ee-adbf6c75110a req-f6b70f1f-d2bb-4855-8b5d-853f8b1f81ef tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413721 Dec 21 04:58:43.498311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-85e761c7-fcce-431c-9771-df9d005b2cbf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:43.499790 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-85e761c7-fcce-431c-9771-df9d005b2cbf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.54 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 946 time: 0.0479679 Dec 21 04:58:43.589319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Deleting port 81ae2458-bf79-4ed9-985f-c571080d3559 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:58:43.589577 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:43.680877 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] For port 81ae2458-bf79-4ed9-985f-c571080d3559, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=81ae2458-bf79-4ed9-985f-c571080d3559,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:43.681237 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:43.693023 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Calling delete_port for 81ae2458-bf79-4ed9-985f-c571080d3559 owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:58:43.897915 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:43.926477 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Pushing event deleted for resources: {'Port': ['ID=81ae2458-bf79-4ed9-985f-c571080d3559,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:43.933326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['81ae2458-bf79-4ed9-985f-c571080d3559'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:58:43.940152 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.940502 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.940847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.941220 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.941509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.941840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.942167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.942491 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.942814 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.943165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.943677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.944003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.944322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:43.966641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-39b53c95-5032-4200-b445-30af4bc5f6c0 req-a6f0e8b8-a096-4641-8902-2d51d789ce4f tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=5d31f726-80e7-4b8d-8b99-77bd21ce69c5 HTTP/1.1" status: 200 len: 210 time: 0.0388083 Dec 21 04:58:43.979252 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] No DVR routers for this DVR port 81ae2458-bf79-4ed9-985f-c571080d3559 on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:58:43.981824 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:43.985401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7a699ed7-e489-4186-aa8e-1d1a5a0b2c18 req-043d482d-b840-4123-9aa0-eeef3cefb908 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.54 "DELETE /v2.0/ports/81ae2458-bf79-4ed9-985f-c571080d3559 HTTP/1.1" status: 204 len: 173 time: 0.4782293 Dec 21 04:58:43.985846 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'name': 'network-vif-deleted', 'tag': '81ae2458-bf79-4ed9-985f-c571080d3559'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:58:43.988175 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9fe3b65-be68-4af9-b528-0d4b0626339d" -d '{"events": [{"server_uuid": "5d31f726-80e7-4b8d-8b99-77bd21ce69c5", "name": "network-vif-deleted", "tag": "81ae2458-bf79-4ed9-985f-c571080d3559"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:58:44.084765 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:58:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-818aeea1-2e4c-4d06-b4a8-dbff75ae050a x-openstack-request-id: req-818aeea1-2e4c-4d06-b4a8-dbff75ae050a {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:58:44.085061 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5d31f726-80e7-4b8d-8b99-77bd21ce69c5", "name": "network-vif-deleted", "tag": "81ae2458-bf79-4ed9-985f-c571080d3559", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:58:44.085349 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-818aeea1-2e4c-4d06-b4a8-dbff75ae050a {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:58:44.085761 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5d31f726-80e7-4b8d-8b99-77bd21ce69c5', 'name': 'network-vif-deleted', 'tag': '81ae2458-bf79-4ed9-985f-c571080d3559', 'status': 'completed', 'code': 200} Dec 21 04:58:45.586414 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-98db63c3-fa85-401e-bf99-9e259ef2f364 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:45.587957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-98db63c3-fa85-401e-bf99-9e259ef2f364 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/networks?id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 HTTP/1.1" status: 200 len: 816 time: 0.0992246 Dec 21 04:58:45.603384 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-1a51c2eb-100f-410f-8f7d-18eee4569af5 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/quotas/a5be355061f74db2b46c76c8d1c73846 HTTP/1.1" status: 200 len: 375 time: 0.0091937 Dec 21 04:58:45.654721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-0ba15998-5546-42e4-b63e-c45c4564db2b tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=a5be355061f74db2b46c76c8d1c73846&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0448964 Dec 21 04:58:45.793484 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-a58bdf19-b5e2-4941-b683-dd9ea9d3411f service neutron] 10.222.0.18 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1271477 Dec 21 04:58:45.880501 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-50572c71-f93d-4c1a-8653-9e14e1fa9b2c service neutron] 10.222.0.18 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809605 Dec 21 04:58:46.103441 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e2699fe-4bb6-4e9b-abd1-37f76097462b req-96f203bd-96e1-42ec-a8cd-5cbb6da5147c tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 210 time: 0.0296538 Dec 21 04:58:47.195870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7eb6a548-0d2e-4e09-8c25-2aa2b87329e8 req-ae7716af-f0ac-4725-bcfa-418d3fcbd873 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 210 time: 0.0255713 Dec 21 04:58:48.084999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-5989b8d8-c3b4-425e-9b73-1bc251af89d2 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:48.086443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-5989b8d8-c3b4-425e-9b73-1bc251af89d2 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.31 "GET /v2.0/networks?id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 HTTP/1.1" status: 200 len: 816 time: 0.0979795 Dec 21 04:58:48.108651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Request body: {'port': {'device_id': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'admin_state_up': True, 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:58:48.236391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81ae2458-bf79-4ed9-985f-c571080d3559 no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:58:48.261162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 81ae2458-bf79-4ed9-985f-c571080d3559 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:58:48.261517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 81ae2458-bf79-4ed9-985f-c571080d3559 not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:58:48.302129 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0f59e61a-231b-489d-b71e-eb7b52b4e7e2 req-d87d7e5d-10fc-4eb7-9a33-93bb255a48af tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 210 time: 0.0285087 Dec 21 04:58:48.302839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Made reservation on behalf of a5be355061f74db2b46c76c8d1c73846 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:58:48.306349 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:48.430507 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Allocated IP 172.20.0.8 (8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1/f8de83e1-f132-4b61-b68b-db53b889943d/7998c83c-a0e4-483a-85f0-618881d8e32f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:58:48.572021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:48.653005 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:48.695571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:58:48.699350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:58:48.701773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:58:48.731916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Pushing event updated for resources: {'Port': ['ID=7998c83c-a0e4-483a-85f0-618881d8e32f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:48.746512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.746873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.747257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.747601 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.747942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.748280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.748628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.748948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.749281 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.749612 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.749943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.750268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.750592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:58:48.769804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:48.770419 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:48.850400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-2e22b09e-4dd3-445b-abbc-a334a3f05edf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7454875 Dec 21 04:58:48.876401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Request body: {'port': {'device_id': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:58:48.928179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-fbc69acb-b1bf-4f85-b917-656818dc3990 None None] Provisioning complete for port 7998c83c-a0e4-483a-85f0-618881d8e32f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:48.928650 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fbc69acb-b1bf-4f85-b917-656818dc3990 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:48.929003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:48.962609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fbc69acb-b1bf-4f85-b917-656818dc3990 None None] Port 7998c83c-a0e4-483a-85f0-618881d8e32f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:58:49.487438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2ec14-5b5d-4451-9d54-16f5f6ad677d req-660f7124-cb86-47ae-a319-c9ee67043634 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:49.488905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8e2ec14-5b5d-4451-9d54-16f5f6ad677d req-660f7124-cb86-47ae-a319-c9ee67043634 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 931 time: 0.1056576 Dec 21 04:58:49.562341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e8e2ec14-5b5d-4451-9d54-16f5f6ad677d req-9b884b1d-51e1-4a55-bae1-813d5f7dbbca tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656219 Dec 21 04:58:49.609203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7998c83c-a0e4-483a-85f0-618881d8e32f {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:58:49.616831 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:49.629131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Transition to ACTIVE for port object 7998c83c-a0e4-483a-85f0-618881d8e32f will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 04:58:49.720359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:49.776685 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Pushing event updated for resources: {'Port': ['ID=7998c83c-a0e4-483a-85f0-618881d8e32f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:49.845421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Attempting to bind port 7998c83c-a0e4-483a-85f0-618881d8e32f on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:58:49.851747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Attempting to bind port 7998c83c-a0e4-483a-85f0-618881d8e32f by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:58:49.851747 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Attempting to bind port 7998c83c-a0e4-483a-85f0-618881d8e32f on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:58:49.856984 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Port 7998c83c-a0e4-483a-85f0-618881d8e32f on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 04:58:49.857319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Attempting to bind port 7998c83c-a0e4-483a-85f0-618881d8e32f on network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:58:49.862893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 58, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:58:49.862893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Checking segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:58:49.863247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Bound using segment: {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:58:49.863677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Bound port: 7998c83c-a0e4-483a-85f0-618881d8e32f, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c46f8d2d-f7c7-436c-a683-8b94014d3642', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:58:49.864039 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:49.934808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] For port 7998c83c-a0e4-483a-85f0-618881d8e32f, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:58:49.937769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-37cf26da-71f6-425b-b92a-4305e7dcba34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:49.938259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] For port 7998c83c-a0e4-483a-85f0-618881d8e32f, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7998c83c-a0e4-483a-85f0-618881d8e32f,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:58:50.007200 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:50.039889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.040510 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:50.042534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] 10.222.0.31 "PUT /v2.0/ports/7998c83c-a0e4-483a-85f0-618881d8e32f HTTP/1.1" status: 200 len: 1092 time: 1.1704884 Dec 21 04:58:50.043006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'tag': '7998c83c-a0e4-483a-85f0-618881d8e32f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:58:50.045326 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9fb21241-32c1-442f-a797-82b40537b8d3" -d '{"events": [{"name": "network-changed", "server_uuid": "6faf205e-3bab-4881-8702-dbc00e9c361e", "tag": "7998c83c-a0e4-483a-85f0-618881d8e32f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:58:50.072869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba9a822-d939-46e4-87b5-8d22a7b92e15 service neutron] Pushing event updated for resources: {'Port': ['ID=7998c83c-a0e4-483a-85f0-618881d8e32f,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:50.150173 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 04:58:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4e3cbe8-472a-4567-86ac-23ee1f1fd0dd x-openstack-request-id: req-e4e3cbe8-472a-4567-86ac-23ee1f1fd0dd {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:58:50.150508 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6faf205e-3bab-4881-8702-dbc00e9c361e", "tag": "7998c83c-a0e4-483a-85f0-618881d8e32f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:58:50.151368 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e4e3cbe8-472a-4567-86ac-23ee1f1fd0dd {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:58:50.151780 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'tag': '7998c83c-a0e4-483a-85f0-618881d8e32f', 'status': 'completed', 'code': 200} Dec 21 04:58:50.215171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-a1a1346d-19c4-43a5-8688-9a828e5afb10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.216740 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-a1a1346d-19c4-43a5-8688-9a828e5afb10 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a5be355061f74db2b46c76c8d1c73846&device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 1095 time: 0.0461209 Dec 21 04:58:50.279365 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-cdf72068-22dc-4476-b7b4-c2bb684552b1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7998c83c-a0e4-483a-85f0-618881d8e32f HTTP/1.1" status: 200 len: 217 time: 0.0381975 Dec 21 04:58:50.331404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-7cfa4cce-34e9-4146-b2ee-77f95ddd6573 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.332847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-7cfa4cce-34e9-4146-b2ee-77f95ddd6573 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f8de83e1-f132-4b61-b68b-db53b889943d HTTP/1.1" status: 200 len: 855 time: 0.0441945 Dec 21 04:58:50.380746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b000ae77-c128-45ff-addb-179a56625e2c req-d68fd43b-42ae-49f5-a9a2-b6a9a268257b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.382105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-d68fd43b-42ae-49f5-a9a2-b6a9a268257b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0380731 Dec 21 04:58:50.479669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-69a50a45-b7c8-41fc-863b-4c8be90308a3 service neutron] 10.222.0.31 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854094 Dec 21 04:58:50.573251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b000ae77-c128-45ff-addb-179a56625e2c req-9a2fd62a-3439-4f54-a328-feeae1ca4315 service neutron] 10.222.0.31 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817454 Dec 21 04:58:50.683033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dbb48b-de37-4537-876a-9995f0269b02 req-c51df1fa-e4ee-4a9a-baa0-065ececa6761 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.684520 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94dbb48b-de37-4537-876a-9995f0269b02 req-c51df1fa-e4ee-4a9a-baa0-065ececa6761 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 943 time: 0.0495696 Dec 21 04:58:50.737168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94dbb48b-de37-4537-876a-9995f0269b02 req-ff5ba4bb-fd86-426c-ad4f-9b6c64c0712a tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463758 Dec 21 04:58:50.785098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-6744b470-595e-41da-879f-a3eac5744564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.786626 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-6744b470-595e-41da-879f-a3eac5744564 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a5be355061f74db2b46c76c8d1c73846&device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 1095 time: 0.0409307 Dec 21 04:58:50.877340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-76d3e005-2b46-4b8f-832b-8f2ce53854ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.878822 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-76d3e005-2b46-4b8f-832b-8f2ce53854ea service neutron] 10.222.0.31 "GET /v2.0/networks?id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 HTTP/1.1" status: 200 len: 917 time: 0.0843313 Dec 21 04:58:50.924294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-155844a2-1f32-43bb-9728-87cd4dd0e3e6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=7998c83c-a0e4-483a-85f0-618881d8e32f HTTP/1.1" status: 200 len: 217 time: 0.0379827 Dec 21 04:58:50.986148 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-1a75d236-f292-4702-ae00-0095095d2c5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:50.987554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-1a75d236-f292-4702-ae00-0095095d2c5e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f8de83e1-f132-4b61-b68b-db53b889943d HTTP/1.1" status: 200 len: 855 time: 0.0515366 Dec 21 04:58:51.033172 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-91ae8d61-f1fe-46e3-a4bc-87a31684e303 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:51.034748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-91ae8d61-f1fe-46e3-a4bc-87a31684e303 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0389590 Dec 21 04:58:51.129979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-ef5b9b5f-0315-4707-8622-5423a0f5055a service neutron] 10.222.0.31 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849824 Dec 21 04:58:51.220828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9fb21241-32c1-442f-a797-82b40537b8d3 req-419f2a18-335c-40dd-b330-1becd3ce1db2 service neutron] 10.222.0.31 "GET /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817595 Dec 21 04:58:51.862908 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a396546-1905-47bb-a03b-6de1982ae451 req-cdf5cc72-591b-4ab7-96ed-690fcfb55f28 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:51.864508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a396546-1905-47bb-a03b-6de1982ae451 req-cdf5cc72-591b-4ab7-96ed-690fcfb55f28 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 943 time: 0.0541711 Dec 21 04:58:51.910603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3a396546-1905-47bb-a03b-6de1982ae451 req-c71555be-65f2-4798-865f-5b93c9fb421d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402093 Dec 21 04:58:52.707358 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c8efdc87-0af0-42d9-9852-ce949b2f9e0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:53.023704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8062a48-da51-452d-b358-037d50d10b59 req-51a8ef3f-10a5-4e54-a894-25a03d4c1c3d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:53.025194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8062a48-da51-452d-b358-037d50d10b59 req-51a8ef3f-10a5-4e54-a894-25a03d4c1c3d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 943 time: 0.0482690 Dec 21 04:58:53.072376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8062a48-da51-452d-b358-037d50d10b59 req-82528a02-b15c-4128-8a4c-f58ad851e2fb tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404963 Dec 21 04:58:53.531963 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:53.554680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:54.189070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40baa56-986f-4faa-9ac0-e621f27d103e req-64c91f41-a9ba-4b95-b594-fe41ded02595 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:54.190572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a40baa56-986f-4faa-9ac0-e621f27d103e req-64c91f41-a9ba-4b95-b594-fe41ded02595 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 943 time: 0.0517042 Dec 21 04:58:54.237245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a40baa56-986f-4faa-9ac0-e621f27d103e req-a3046c4e-deb9-4ea5-93c3-fe7b3c1d0065 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407252 Dec 21 04:58:54.834370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7998c83c-a0e4-483a-85f0-618881d8e32f details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 04:58:54.925312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7998c83c-a0e4-483a-85f0-618881d8e32f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7998c83c-a0e4-483a-85f0-618881d8e32f,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:54.935981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '7998c83c-a0e4-483a-85f0-618881d8e32f', 'network_id': '8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1', 'port_id': '7998c83c-a0e4-483a-85f0-618881d8e32f', 'mac_address': 'fa:16:3e:31:93:25', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f8de83e1-f132-4b61-b68b-db53b889943d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 04:58:54.972818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:54.989755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7998c83c-a0e4-483a-85f0-618881d8e32f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 04:58:55.164443 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7998c83c-a0e4-483a-85f0-618881d8e32f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7998c83c-a0e4-483a-85f0-618881d8e32f,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:55.224202 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:55.280026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=7998c83c-a0e4-483a-85f0-618881d8e32f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:55.330519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:55.355962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a687079-b926-4487-bae4-d2322bcb5fcf req-f1ead7d0-ebd8-423d-b1ff-a0fe6d947b1e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:55.357461 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a687079-b926-4487-bae4-d2322bcb5fcf req-f1ead7d0-ebd8-423d-b1ff-a0fe6d947b1e tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 944 time: 0.0522854 Dec 21 04:58:55.405265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a687079-b926-4487-bae4-d2322bcb5fcf req-72ce11b9-4012-49f1-a170-d8dd4799a2c4 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417006 Dec 21 04:58:55.406592 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:55.589563 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['7998c83c-a0e4-483a-85f0-618881d8e32f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:58:55.811952 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:56.519311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901ebccf-73f2-41f9-b8c6-68afef87a3f3 req-47ea3d9a-42b6-4cd3-9790-246a1c8e1530 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:56.520810 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901ebccf-73f2-41f9-b8c6-68afef87a3f3 req-47ea3d9a-42b6-4cd3-9790-246a1c8e1530 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 944 time: 0.0485685 Dec 21 04:58:56.571870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-901ebccf-73f2-41f9-b8c6-68afef87a3f3 req-1e45bd52-09cd-4892-9ed9-3b88ec9e7d4b tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451064 Dec 21 04:58:56.831434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7998c83c-a0e4-483a-85f0-618881d8e32f up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:58:56.926010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 7998c83c-a0e4-483a-85f0-618881d8e32f completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 04:58:56.929788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 7998c83c-a0e4-483a-85f0-618881d8e32f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:58:56.930181 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:57.008286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:57.032734 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7998c83c-a0e4-483a-85f0-618881d8e32f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:58:57.035023 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-507b18cb-f33c-4152-880c-dc1f2dd59c98" -d '{"events": [{"server_uuid": "6faf205e-3bab-4881-8702-dbc00e9c361e", "name": "network-vif-plugged", "status": "completed", "tag": "7998c83c-a0e4-483a-85f0-618881d8e32f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:58:57.048235 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 7998c83c-a0e4-483a-85f0-618881d8e32f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7998c83c-a0e4-483a-85f0-618881d8e32f,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:58:57.136556 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:58:57.136556 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:58:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ae5d401-96ea-43be-88e1-8f084f966f25 x-openstack-request-id: req-0ae5d401-96ea-43be-88e1-8f084f966f25 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:58:57.136556 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6faf205e-3bab-4881-8702-dbc00e9c361e", "name": "network-vif-plugged", "status": "completed", "tag": "7998c83c-a0e4-483a-85f0-618881d8e32f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:58:57.136556 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0ae5d401-96ea-43be-88e1-8f084f966f25 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:58:57.136556 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7998c83c-a0e4-483a-85f0-618881d8e32f', 'code': 200} Dec 21 04:58:57.175008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=7998c83c-a0e4-483a-85f0-618881d8e32f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:58:57.269341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a18fe90-e767-4966-9c0c-7643929850f6 req-7d1494fd-d355-4b06-839e-8dc83790ccfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:57.270805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a18fe90-e767-4966-9c0c-7643929850f6 req-7d1494fd-d355-4b06-839e-8dc83790ccfd service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 1097 time: 0.0381866 Dec 21 04:58:57.319584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a18fe90-e767-4966-9c0c-7643929850f6 req-d43a3d19-32c4-4fcb-a637-e76af936f68d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368786 Dec 21 04:58:57.689095 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e160f4-0e4c-4fa3-b367-805d7aaf878f req-91b7d763-2b0f-4e2e-b4ed-a74cf9b5c2cf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:57.690560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3e160f4-0e4c-4fa3-b367-805d7aaf878f req-91b7d763-2b0f-4e2e-b4ed-a74cf9b5c2cf tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 945 time: 0.0500321 Dec 21 04:58:57.737791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3e160f4-0e4c-4fa3-b367-805d7aaf878f req-0aaf7496-bd62-40d6-acb1-2a27396412ad tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413404 Dec 21 04:58:57.873498 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:58:58.856752 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66be10c2-5979-4f89-8995-dc4b3f44d2d2 req-41951f42-f948-4b27-8f95-0e6030aed3b6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:58.858226 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66be10c2-5979-4f89-8995-dc4b3f44d2d2 req-41951f42-f948-4b27-8f95-0e6030aed3b6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 945 time: 0.0528607 Dec 21 04:58:58.904869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-66be10c2-5979-4f89-8995-dc4b3f44d2d2 req-b3a42a7c-556f-419a-975e-190fbbd12df6 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405798 Dec 21 04:58:59.018554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5aed46c-cca7-4ce4-8f09-f71685b1b58e req-8fb0a4c9-b970-4a9e-bde4-a9f96776f673 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:58:59.020057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5aed46c-cca7-4ce4-8f09-f71685b1b58e req-8fb0a4c9-b970-4a9e-bde4-a9f96776f673 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 945 time: 0.0494034 Dec 21 04:58:59.066880 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5aed46c-cca7-4ce4-8f09-f71685b1b58e req-1014177c-a236-4542-87db-f9935530fca9 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409346 Dec 21 04:59:19.941189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4840cdb3-0451-4feb-b740-878733311e58 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:22.709100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c7464496-efca-4681-93ef-de5776227f2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:23.560630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:23.589819 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:24.110633 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73ac9da-038b-4911-a735-cb74ea6188f5 req-e1add514-98a3-42c8-953c-d9dcb7789e3b tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:24.113737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a73ac9da-038b-4911-a735-cb74ea6188f5 req-e1add514-98a3-42c8-953c-d9dcb7789e3b tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 945 time: 0.0528548 Dec 21 04:59:24.165980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a73ac9da-038b-4911-a735-cb74ea6188f5 req-71801e8a-6604-40b0-837d-bd2f2ca0b906 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476429 Dec 21 04:59:25.282767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99dfbb46-6719-466d-a8cc-8a900463a12c req-7641096d-1251-4a34-8ab0-46d4071dcbd8 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:25.284289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99dfbb46-6719-466d-a8cc-8a900463a12c req-7641096d-1251-4a34-8ab0-46d4071dcbd8 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 945 time: 0.0487108 Dec 21 04:59:25.314834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:25.332947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99dfbb46-6719-466d-a8cc-8a900463a12c req-b2df7f8d-27c3-4b3a-b3e6-e64f70474d40 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/security-groups?id=64d71606-29cc-44ce-a343-ed84a8dd6001&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426149 Dec 21 04:59:25.366025 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:25.811854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:25.938197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-be5bfdde-e0f4-4da9-b537-d2da23464485 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:25.939737 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-be5bfdde-e0f4-4da9-b537-d2da23464485 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.31 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 945 time: 0.0471706 Dec 21 04:59:26.034809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Deleting port 7998c83c-a0e4-483a-85f0-618881d8e32f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:26.035172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:26.122532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] For port 7998c83c-a0e4-483a-85f0-618881d8e32f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=7998c83c-a0e4-483a-85f0-618881d8e32f,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:26.122895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:26.134510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Calling delete_port for 7998c83c-a0e4-483a-85f0-618881d8e32f owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:26.320841 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:26.349636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Pushing event deleted for resources: {'Port': ['ID=7998c83c-a0e4-483a-85f0-618881d8e32f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:26.374793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['7998c83c-a0e4-483a-85f0-618881d8e32f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 04:59:26.397136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] No DVR routers for this DVR port 7998c83c-a0e4-483a-85f0-618881d8e32f on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:59:26.400171 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:26.403841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77c77178-0380-449d-aa38-9f3fed0255d6 req-1cf6b47d-1118-4111-96cb-ea4b08c63c4d tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.31 "DELETE /v2.0/ports/7998c83c-a0e4-483a-85f0-618881d8e32f HTTP/1.1" status: 204 len: 173 time: 0.4536669 Dec 21 04:59:26.404291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'name': 'network-vif-deleted', 'tag': '7998c83c-a0e4-483a-85f0-618881d8e32f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 04:59:26.406644 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d55fba58-8c96-4763-8fa2-60c8c13dd761" -d '{"events": [{"server_uuid": "6faf205e-3bab-4881-8702-dbc00e9c361e", "name": "network-vif-deleted", "tag": "7998c83c-a0e4-483a-85f0-618881d8e32f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 04:59:26.442856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98824732-bfe6-4eec-af1b-0dac03b61618 req-142aacea-bb1f-4bd9-985f-5d39e86b62e9 tempest-TestEncryptedCinderVolumes-1553383285 tempest-TestEncryptedCinderVolumes-1553383285-project] 10.222.0.18 "GET /v2.0/ports?device_id=6faf205e-3bab-4881-8702-dbc00e9c361e HTTP/1.1" status: 200 len: 210 time: 0.0283129 Dec 21 04:59:26.448458 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 04:59:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4962c37-1ca4-4eaf-a3b2-05930191c7b4 x-openstack-request-id: req-b4962c37-1ca4-4eaf-a3b2-05930191c7b4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 04:59:26.449320 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6faf205e-3bab-4881-8702-dbc00e9c361e", "name": "network-vif-deleted", "tag": "7998c83c-a0e4-483a-85f0-618881d8e32f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 04:59:26.449591 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b4962c37-1ca4-4eaf-a3b2-05930191c7b4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 04:59:26.450004 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6faf205e-3bab-4881-8702-dbc00e9c361e', 'name': 'network-vif-deleted', 'tag': '7998c83c-a0e4-483a-85f0-618881d8e32f', 'status': 'completed', 'code': 200} Dec 21 04:59:27.579905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50988) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:27.920578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:28.160946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Deleting port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:28.161284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:28.237080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] For port 5c40e3b0-cc94-43d4-8226-38dca2abf4fa, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:28.237380 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:28.248700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Calling delete_port for 5c40e3b0-cc94-43d4-8226-38dca2abf4fa owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:28.512638 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:28.537989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Pushing event deleted for resources: {'Port': ['ID=5c40e3b0-cc94-43d4-8226-38dca2abf4fa,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:28.705823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:28.914284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Router 48a30153-10d2-4ead-af40-5748b63e4738 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:59:29.019522 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:59:29.024592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29f8812a-0dfd-4483-9c1b-5ad4053670ba admin admin] 10.222.0.18 "PUT /v2.0/routers/48a30153-10d2-4ead-af40-5748b63e4738/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4436736 Dec 21 04:59:29.027214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50990) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:29.028205 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] Sync routers for ids ['48a30153-10d2-4ead-af40-5748b63e4738'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:59:29.038181 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] Routers {'48a30153-10d2-4ead-af40-5748b63e4738'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:29.038792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['48a30153-10d2-4ead-af40-5748b63e4738'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:29.130849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:29.154456 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] Set router 48a30153-10d2-4ead-af40-5748b63e4738 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:29.230703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:29.327344 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55'}], 'enable_snat': True}, 'gw_port_id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:59:28Z', 'revision_number': 5, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port': {'id': 'a36b25e7-3a72-406d-90fc-f37aef6674a0', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:5d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a30153-10d2-4ead-af40-5748b63e4738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:53Z', 'updated_at': '2021-12-21T04:57:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:29.332739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Deleting port a36b25e7-3a72-406d-90fc-f37aef6674a0 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:29.333162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:29.357388 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] Checking router: 48a30153-10d2-4ead-af40-5748b63e4738 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:59:29.365565 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] Routers {'48a30153-10d2-4ead-af40-5748b63e4738'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:29.366165 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['48a30153-10d2-4ead-af40-5748b63e4738'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:29.415284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] For port a36b25e7-3a72-406d-90fc-f37aef6674a0, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=a36b25e7-3a72-406d-90fc-f37aef6674a0,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:29.416168 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:29.427723 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Calling delete_port for a36b25e7-3a72-406d-90fc-f37aef6674a0 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:29.446656 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] Set router 48a30153-10d2-4ead-af40-5748b63e4738 gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:29.500293 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:59:29Z', 'revision_number': 6, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:29.525973 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e1b213d-43f4-4d70-b1af-53191ff34071 None None] The sync data for ids ['48a30153-10d2-4ead-af40-5748b63e4738'] in n-d-822053-11 is: [{'id': '48a30153-10d2-4ead-af40-5748b63e4738', 'name': 'tempest-TestEncryptedCinderVolumes-522507390-router', 'tenant_id': 'a5be355061f74db2b46c76c8d1c73846', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:52Z', 'updated_at': '2021-12-21T04:59:29Z', 'revision_number': 6, 'project_id': 'a5be355061f74db2b46c76c8d1c73846', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:59:29.663776 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:29.689872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Pushing event deleted for resources: {'Port': ['ID=a36b25e7-3a72-406d-90fc-f37aef6674a0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:29.703300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fed046b3-47a8-411c-a3b0-ef034e10777f None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:29.753998 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.184074 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.186179 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.269856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.270330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 48a30153-10d2-4ead-af40-5748b63e4738 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:59:30.275169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.276466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-588f70d3-88b4-499c-972b-4073da74af93 admin admin] 10.222.0.18 "DELETE /v2.0/routers/48a30153-10d2-4ead-af40-5748b63e4738 HTTP/1.1" status: 204 len: 168 time: 1.2482657 Dec 21 04:59:30.281467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50992) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:30.327250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Deleting subnet f8de83e1-f132-4b61-b68b-db53b889943d {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:59:30.330270 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.364540 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.445307 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.570853 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.596462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f8de83e1-f132-4b61-b68b-db53b889943d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:30.605316 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.608780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-7ac94177-c80e-4d7c-be30-67b4a9422720 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/f8de83e1-f132-4b61-b68b-db53b889943d HTTP/1.1" status: 204 len: 168 time: 0.3258255 Dec 21 04:59:30.611136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 50994) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:30.616364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d760b28a-242b-4169-a5e0-a931a58e59dd None None] Network 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:59:30.682303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.736527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Deleting port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:30.736869 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.794648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] DHCP port deletion for 8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:30.798853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] For port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:30.799326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.814320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Calling delete_port for cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:30.852474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Deleting port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:30.852807 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.919508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] For port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,segment=NetworkSegment(c46f8d2d-f7c7-436c-a683-8b94014d3642),segment_id=c46f8d2d-f7c7-436c-a683-8b94014d3642)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:30.919910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:30.932021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Calling delete_port for cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:30.989910 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 21 04:59:31.003880 n-d-822053-11 neutron-server[110312]: self.session.flush() Dec 21 04:59:31.009395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7998c83c-a0e4-483a-85f0-618881d8e32f no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:31.012234 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.017866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Pushing event deleted for resources: {'Port': ['ID=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:31.019717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] No DVR routers for this DVR port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:59:31.036786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 7998c83c-a0e4-483a-85f0-618881d8e32f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:31.037142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 7998c83c-a0e4-483a-85f0-618881d8e32f not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:31.056075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Pushing event deleted for resources: {'Port': ['ID=cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:31.063223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] No DVR routers for this DVR port cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.069771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.070142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.070364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.070689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e6287a0-5b07-4f25-9587-0b3f1ec0d3c9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:31.094315 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.114893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:31.120639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5c40e3b0-cc94-43d4-8226-38dca2abf4fa no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:31.124926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c46f8d2d-f7c7-436c-a683-8b94014d3642') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:31.125224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c46f8d2d-f7c7-436c-a683-8b94014d3642') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:31.135313 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.141438 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 5c40e3b0-cc94-43d4-8226-38dca2abf4fa {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:31.141792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 5c40e3b0-cc94-43d4-8226-38dca2abf4fa not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:31.142214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:31.148504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.154350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:59:31.154727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: timer() Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:59:31.156446 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:59:31.160693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:31.161000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cb4d3d3f-a7e4-4311-971a-2a2e0b6548d4 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:31.161422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a36b25e7-3a72-406d-90fc-f37aef6674a0 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:31.183244 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: a36b25e7-3a72-406d-90fc-f37aef6674a0 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:31.183601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device a36b25e7-3a72-406d-90fc-f37aef6674a0 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:31.290049 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.294389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.297658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] 10.222.0.18 "DELETE /v2.0/networks/8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1 HTTP/1.1" status: 204 len: 168 time: 0.6853597 Dec 21 04:59:31.300610 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50996) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:31.310586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76a1b86-d516-4a55-80e3-d8bad099649d admin admin] Pushing event deleted for resources: {'Network': ['ID=8f9a2dd6-6d86-46fa-8d3d-4063f85aebb1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:31.641729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.879851 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Deleting port 4905f196-a52c-4705-8b1a-009f7e0ce8e7 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:31.880106 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.956066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] For port 4905f196-a52c-4705-8b1a-009f7e0ce8e7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4905f196-a52c-4705-8b1a-009f7e0ce8e7,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:31.956435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:31.968235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Calling delete_port for 4905f196-a52c-4705-8b1a-009f7e0ce8e7 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:32.229475 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:32.253041 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Pushing event deleted for resources: {'Port': ['ID=4905f196-a52c-4705-8b1a-009f7e0ce8e7,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:32.728901 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:32.941518 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:59:33.046327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:59:33.051634 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0224cb80-9c8e-4d9b-ab8c-2cffb5c68054 admin admin] 10.222.0.18 "PUT /v2.0/routers/93ed7f2f-ebe9-4b24-86b4-2a853a894cd3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7499526 Dec 21 04:59:33.054014 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 50998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:33.063457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] Sync routers for ids ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:59:33.078288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] Routers {'93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:33.079030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:33.158698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.183144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] Set router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:33.265205 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.359503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184'}], 'enable_snat': True}, 'gw_port_id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:59:32Z', 'revision_number': 5, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port': {'id': 'fec6f416-e744-42e4-ae1e-0472c56f5a28', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8d:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.184', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:57:59Z', 'updated_at': '2021-12-21T04:58:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:33.382963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Deleting port fec6f416-e744-42e4-ae1e-0472c56f5a28 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:33.383320 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.386153 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] Checking router: 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:59:33.394301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] Routers {'93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:33.394904 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:33.462059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] For port fec6f416-e744-42e4-ae1e-0472c56f5a28, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=fec6f416-e744-42e4-ae1e-0472c56f5a28,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:33.462433 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.474616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Calling delete_port for fec6f416-e744-42e4-ae1e-0472c56f5a28 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:33.478756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] Set router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:33.532030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:59:33Z', 'revision_number': 6, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:33.557696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-719d1bd2-709a-4435-9d95-2fdc79f04443 None None] The sync data for ids ['93ed7f2f-ebe9-4b24-86b4-2a853a894cd3'] in n-d-822053-11 is: [{'id': '93ed7f2f-ebe9-4b24-86b4-2a853a894cd3', 'name': 'tempest-TestEncryptedCinderVolumes-305838602-router', 'tenant_id': '09d278e115a94d3092fb69fdbc7145dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:57:58Z', 'updated_at': '2021-12-21T04:59:33Z', 'revision_number': 6, 'project_id': '09d278e115a94d3092fb69fdbc7145dc', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:59:33.701441 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.726546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Pushing event deleted for resources: {'Port': ['ID=fec6f416-e744-42e4-ae1e-0472c56f5a28,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:33.740449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff7adf88-df1f-42cf-88b1-1d5ce14c88d6 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:33.789446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.879358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.881482 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.989584 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.990345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 04:59:33.996318 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:33.997477 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a7df1a76-fc75-4407-9550-cf6dea323b25 admin admin] 10.222.0.18 "DELETE /v2.0/routers/93ed7f2f-ebe9-4b24-86b4-2a853a894cd3 HTTP/1.1" status: 204 len: 168 time: 0.9425561 Dec 21 04:59:33.999970 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51000) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:34.049271 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Deleting subnet e2db6233-d4b2-4671-b90d-90682af7738e {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 04:59:34.052288 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.086067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.161029 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.261866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.291284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e2db6233-d4b2-4671-b90d-90682af7738e,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:34.297914 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.309761 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b7d58751-38e5-46aa-bc8f-d4c8df1e3de1 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/e2db6233-d4b2-4671-b90d-90682af7738e HTTP/1.1" status: 204 len: 168 time: 0.3020673 Dec 21 04:59:34.309994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2079a85d-b1e3-45f5-af83-d18406ad5ffb None None] Network 0d8d8e5a-da70-45f2-87d6-77f83a452ffa requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:59:34.311565 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51002) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:34.381578 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.435307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Deleting port d2d71924-8483-44f7-8fdc-7e10e1f715d1 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:34.435615 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.448497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] DHCP port deletion for 0d8d8e5a-da70-45f2-87d6-77f83a452ffa request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:34.499879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] Deleting port d2d71924-8483-44f7-8fdc-7e10e1f715d1 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 04:59:34.500255 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.503651 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] For port d2d71924-8483-44f7-8fdc-7e10e1f715d1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d71924-8483-44f7-8fdc-7e10e1f715d1,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:34.504004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.518282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Calling delete_port for d2d71924-8483-44f7-8fdc-7e10e1f715d1 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:34.565676 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] For port d2d71924-8483-44f7-8fdc-7e10e1f715d1, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d2d71924-8483-44f7-8fdc-7e10e1f715d1,segment=NetworkSegment(b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a),segment_id=b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:34.566081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.579758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] Calling delete_port for d2d71924-8483-44f7-8fdc-7e10e1f715d1 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 04:59:34.663981 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.670185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.687922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Pushing event deleted for resources: {'Port': ['ID=d2d71924-8483-44f7-8fdc-7e10e1f715d1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:34.692610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] Pushing event deleted for resources: {'Port': ['ID=d2d71924-8483-44f7-8fdc-7e10e1f715d1,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:34.695127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] No DVR routers for this DVR port d2d71924-8483-44f7-8fdc-7e10e1f715d1 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:59:34.698488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa93103e-92c8-4988-a21e-6c8543a4bca6 None None] No DVR routers for this DVR port d2d71924-8483-44f7-8fdc-7e10e1f715d1 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 04:59:34.772488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.791786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d8d8e5a-da70-45f2-87d6-77f83a452ffa']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:34.800729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:34.801024 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b72e11ea-3eb9-4ac3-ab54-1c9b58e78b1a') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:34.810642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.824110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.829813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Releasing vlan 118 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 04:59:34.831421 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: timer() Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 04:59:34.832001 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 04:59:34.873482 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 04:59:34.964654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.970092 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:34.974861 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] 10.222.0.18 "DELETE /v2.0/networks/0d8d8e5a-da70-45f2-87d6-77f83a452ffa HTTP/1.1" status: 204 len: 168 time: 0.6607342 Dec 21 04:59:34.984860 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c81691e-5fc0-4727-9588-0fb2a4a4e6ac admin admin] Pushing event deleted for resources: {'Network': ['ID=0d8d8e5a-da70-45f2-87d6-77f83a452ffa,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:35.104765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fec6f416-e744-42e4-ae1e-0472c56f5a28 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:35.125534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: fec6f416-e744-42e4-ae1e-0472c56f5a28 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:35.125874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device fec6f416-e744-42e4-ae1e-0472c56f5a28 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:35.126277 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d71924-8483-44f7-8fdc-7e10e1f715d1 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:35.144762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d2d71924-8483-44f7-8fdc-7e10e1f715d1 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:35.145122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d2d71924-8483-44f7-8fdc-7e10e1f715d1 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:35.145574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4905f196-a52c-4705-8b1a-009f7e0ce8e7 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 04:59:35.164368 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4905f196-a52c-4705-8b1a-009f7e0ce8e7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 04:59:35.164818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4905f196-a52c-4705-8b1a-009f7e0ce8e7 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 04:59:35.347388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51006) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:35.387679 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-158b3c23-ada5-43fd-aff8-35f4a8eaf903 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=a5be355061f74db2b46c76c8d1c73846&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0391169 Dec 21 04:59:35.390145 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51008) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:35.436534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48a48786-c6bb-46da-b3ae-f9760ff84210 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:35.456695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48a48786-c6bb-46da-b3ae-f9760ff84210 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:35.560825 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48a48786-c6bb-46da-b3ae-f9760ff84210 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:35.563473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-48a48786-c6bb-46da-b3ae-f9760ff84210 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:35.566562 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-48a48786-c6bb-46da-b3ae-f9760ff84210 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/64d71606-29cc-44ce-a343-ed84a8dd6001 HTTP/1.1" status: 204 len: 168 time: 0.1736391 Dec 21 04:59:35.572644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a48786-c6bb-46da-b3ae-f9760ff84210 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64d71606-29cc-44ce-a343-ed84a8dd6001,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:36.208650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51014) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:36.252831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b3281d83-7c61-4335-9237-18605aba0f96 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=09d278e115a94d3092fb69fdbc7145dc&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0430298 Dec 21 04:59:36.255222 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51016) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:36.301621 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-76c6ff78-3415-4d04-a886-5cda959d2ccf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:36.323439 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-76c6ff78-3415-4d04-a886-5cda959d2ccf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:36.446514 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-76c6ff78-3415-4d04-a886-5cda959d2ccf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:36.449794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-76c6ff78-3415-4d04-a886-5cda959d2ccf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:36.450973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-76c6ff78-3415-4d04-a886-5cda959d2ccf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/642d72bf-73e2-41e4-a659-b0f4c1f2e48c HTTP/1.1" status: 204 len: 168 time: 0.1948493 Dec 21 04:59:36.458417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c6ff78-3415-4d04-a886-5cda959d2ccf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=642d72bf-73e2-41e4-a659-b0f4c1f2e48c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:37.427101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51038) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:37.520881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-588383305-network', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:59:37.629376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Made reservation on behalf of 681e67c9ff5d464bb22e16bfdba91dd8 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:59:37.631798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.641086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.713589 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.777292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.800995 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:59:37.810972 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=253b8954-9125-4930-b54c-ae86fc284949,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:37.815544 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.815886 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Added segment 171c2697-66fb-4ffa-9a66-539614ac1012 of type vlan for network d5c9a809-6115-4194-a1d9-258aa32ac87f Dec 21 04:59:37.858166 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.937476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:37.938462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:37.939064 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.001933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] Pushing event updated for resources: {'Network': ['ID=d5c9a809-6115-4194-a1d9-258aa32ac87f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:38.012627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network d5c9a809-6115-4194-a1d9-258aa32ac87f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:59:38.029534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29e95d8a-5115-488d-9971-5c5417ec89bf admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6011419 Dec 21 04:59:38.032161 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51042) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:38.037008 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Request body: {'subnet': {'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-588383305-subnet', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:59:38.146736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Made reservation on behalf of 681e67c9ff5d464bb22e16bfdba91dd8 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:59:38.149095 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.383681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.439304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Pushing event updated for resources: {'Subnet': ['ID=3cfc2d61-2a54-421d-842e-875448a9778a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:38.447003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Checking segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:38.447369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Network hostable DHCP agents. Network: d5c9a809-6115-4194-a1d9-258aa32ac87f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:59:38.509135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Network d5c9a809-6115-4194-a1d9-258aa32ac87f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:59:38.560701 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, d5c9a809-6115-4194-a1d9-258aa32ac87f) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:38.564940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:38.565532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.569220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-112796ac-fc1f-4d5e-b51d-e3b870173c80 None None] Network d5c9a809-6115-4194-a1d9-258aa32ac87f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:59:38.647204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-757b3af1-e44e-45ad-9240-7388858ce4db admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.6138852 Dec 21 04:59:38.649734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51044) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:38.654456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:59:38.672969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-d5c9a809-6115-4194-a1d9-258aa32ac87f', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:59:38.673834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.738327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.739447 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.794472 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.806460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Allocated IP 172.20.0.2 (d5c9a809-6115-4194-a1d9-258aa32ac87f/3cfc2d61-2a54-421d-842e-875448a9778a/6c8b3462-356a-4734-9ecf-7200fb3172d8) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:59:38.943723 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:38.990310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.012201 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.054561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Network d5c9a809-6115-4194-a1d9-258aa32ac87f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:39.057341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:39.060700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:59:39.067570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Pushing event updated for resources: {'Port': ['ID=6c8b3462-356a-4734-9ecf-7200fb3172d8,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:39.118679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Attempting to bind port 6c8b3462-356a-4734-9ecf-7200fb3172d8 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:59:39.119086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Attempting to bind port 6c8b3462-356a-4734-9ecf-7200fb3172d8 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:59:39.119447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Attempting to bind port 6c8b3462-356a-4734-9ecf-7200fb3172d8 on network d5c9a809-6115-4194-a1d9-258aa32ac87f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:59:39.124238 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:59:39.124612 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Checking segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:39.125037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.125430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Bound using segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:59:39.125890 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Bound port: 6c8b3462-356a-4734-9ecf-7200fb3172d8, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:59:39.126269 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.196085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] For port 6c8b3462-356a-4734-9ecf-7200fb3172d8, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:59:39.199788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] For port 6c8b3462-356a-4734-9ecf-7200fb3172d8, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6c8b3462-356a-4734-9ecf-7200fb3172d8,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:59:39.257879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.271165 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.291650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.320781 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b00d72-829c-49fd-abc3-3b329b50fdf4 None None] Pushing event updated for resources: {'Port': ['ID=6c8b3462-356a-4734-9ecf-7200fb3172d8,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:39.402203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Allocated IP 172.25.5.63 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/d0975c49-305e-443e-b8ee-45876cca0ad9) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:59:39.520489 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.612785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.669851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:39.672893 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:39.678042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:59:39.681737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Pushing event updated for resources: {'Port': ['ID=d0975c49-305e-443e-b8ee-45876cca0ad9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:39.693186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f9436a4-0aa6-4eb7-9b78-c53df8c06b39 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:39.747332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f12a115f-97e9-4003-b286-a2a4f3dc09be None None] Provisioning complete for port d0975c49-305e-443e-b8ee-45876cca0ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:39.747843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f12a115f-97e9-4003-b286-a2a4f3dc09be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:39.782836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f12a115f-97e9-4003-b286-a2a4f3dc09be None None] Port d0975c49-305e-443e-b8ee-45876cca0ad9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:40.069672 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:40.225619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d096b1a-20aa-4a54-a1f6-6e045f96c259 None None] Network d5c9a809-6115-4194-a1d9-258aa32ac87f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:59:40.268703 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:40.467217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:59:40.490177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-01b66a0a-4c93-48e4-b355-8aae98f4fcd7 None None] Provisioning complete for port 6c8b3462-356a-4734-9ecf-7200fb3172d8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:40.490446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b66a0a-4c93-48e4-b355-8aae98f4fcd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:40.573337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b66a0a-4c93-48e4-b355-8aae98f4fcd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:40.574157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:59:40.584302 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Sync routers for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:59:40.602306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:40.605006 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:40.612258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-01b66a0a-4c93-48e4-b355-8aae98f4fcd7 None None] For port 6c8b3462-356a-4734-9ecf-7200fb3172d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6c8b3462-356a-4734-9ecf-7200fb3172d8,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:40.689027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:40.690926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5772eaba-2895-4e7c-83a3-b4a8b448c5a6 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.0392294 Dec 21 04:59:40.693178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51046) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:40.698389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01b66a0a-4c93-48e4-b355-8aae98f4fcd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:40.736950 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:40.756786 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b66a0a-4c93-48e4-b355-8aae98f4fcd7 None None] Pushing event updated for resources: {'Port': ['ID=6c8b3462-356a-4734-9ecf-7200fb3172d8,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:40.819746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f229f513-bfe3-469e-abeb-774febf0abf9 None None] Provisioning complete for port 6c8b3462-356a-4734-9ecf-7200fb3172d8 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:40.820057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f229f513-bfe3-469e-abeb-774febf0abf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.009874 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:39Z', 'revision_number': 3, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:41.035140 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Checking router: 5d24adef-3ed6-4dab-92e7-c87f5c1d738b for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:59:41.035495 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Updating router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b port d0975c49-305e-443e-b8ee-45876cca0ad9 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:59:41.060588 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.125308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.148452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6c8b3462-356a-4734-9ecf-7200fb3172d8 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:41.203682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6c8b3462-356a-4734-9ecf-7200fb3172d8 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:41.204157 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.293428 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Allocated IP 172.20.0.1 (d5c9a809-6115-4194-a1d9-258aa32ac87f/3cfc2d61-2a54-421d-842e-875448a9778a/4f8948a0-4f57-462d-b5fc-49e73da31715) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:59:41.326981 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.371780 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.392797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.414000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67aab934-2339-4b8c-970d-784cc6dbedd4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:41.420562 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Attempting to bind port d0975c49-305e-443e-b8ee-45876cca0ad9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:59:41.421090 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Attempting to bind port d0975c49-305e-443e-b8ee-45876cca0ad9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:59:41.421461 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Attempting to bind port d0975c49-305e-443e-b8ee-45876cca0ad9 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:59:41.432261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:59:41.432630 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:41.433025 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.433407 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:59:41.433916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Bound port: d0975c49-305e-443e-b8ee-45876cca0ad9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:59:41.434274 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.435927 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Pushing event updated for resources: {'Port': ['ID=d0975c49-305e-443e-b8ee-45876cca0ad9,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:41.458024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.458798 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.459219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.459502 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.459832 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.460163 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.460486 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.460804 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.461119 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.461433 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.461749 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.462064 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.462909 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.463244 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 04:59:41.499453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Network d5c9a809-6115-4194-a1d9-258aa32ac87f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:41.501207 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] For port d0975c49-305e-443e-b8ee-45876cca0ad9, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:59:41.503795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:41.504291 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] For port d0975c49-305e-443e-b8ee-45876cca0ad9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d0975c49-305e-443e-b8ee-45876cca0ad9,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:59:41.508373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:59:41.512206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Pushing event updated for resources: {'Port': ['ID=4f8948a0-4f57-462d-b5fc-49e73da31715,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:41.531421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-96add472-5751-4777-bdc7-0108ecdbe0cc None None] Provisioning complete for port d0975c49-305e-443e-b8ee-45876cca0ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:41.531793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-96add472-5751-4777-bdc7-0108ecdbe0cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.552109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.568748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-96add472-5751-4777-bdc7-0108ecdbe0cc None None] Port d0975c49-305e-443e-b8ee-45876cca0ad9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:41.573065 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.628198 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:41.628198 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:41.629554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34357254-cbb5-4110-9ba9-b9ca63fe36cd None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:41.675887 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9f2729-605b-4170-a61b-5002e6a79abd None None] Pushing event updated for resources: {'Port': ['ID=d0975c49-305e-443e-b8ee-45876cca0ad9,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:41.694981 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-870418bf-26f7-4366-8f6d-f8858361a1e0 None None] Provisioning complete for port d0975c49-305e-443e-b8ee-45876cca0ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:41.701637 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-870418bf-26f7-4366-8f6d-f8858361a1e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.753799 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.758330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:41.787467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-870418bf-26f7-4366-8f6d-f8858361a1e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.808596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-870418bf-26f7-4366-8f6d-f8858361a1e0 None None] For port d0975c49-305e-443e-b8ee-45876cca0ad9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d0975c49-305e-443e-b8ee-45876cca0ad9,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:41.890149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-870418bf-26f7-4366-8f6d-f8858361a1e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.922795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:41.937088 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-870418bf-26f7-4366-8f6d-f8858361a1e0 None None] Pushing event updated for resources: {'Port': ['ID=d0975c49-305e-443e-b8ee-45876cca0ad9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:41.945834 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:39Z', 'revision_number': 3, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:41.975851 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3229a572-d82e-421b-bc2c-38486562a526 None None] The sync data for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 is: [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:39Z', 'revision_number': 3, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:59:42.001698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:42.013874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-daea5194-7376-49bf-ba60-ce43d1c5e1f8 None None] Provisioning complete for port 4f8948a0-4f57-462d-b5fc-49e73da31715 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:42.014261 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-daea5194-7376-49bf-ba60-ce43d1c5e1f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:42.052851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-daea5194-7376-49bf-ba60-ce43d1c5e1f8 None None] Port 4f8948a0-4f57-462d-b5fc-49e73da31715 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:42.077248 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:42.079212 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Pushing event updated for resources: {'Port': ['ID=4f8948a0-4f57-462d-b5fc-49e73da31715,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:42.172624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Network d5c9a809-6115-4194-a1d9-258aa32ac87f is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:42.174032 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:42.305816 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:59:42.429993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:59:42.435534 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-249870fd-aefe-4b3e-94c5-f2f50403184f admin admin] 10.222.0.18 "PUT /v2.0/routers/5d24adef-3ed6-4dab-92e7-c87f5c1d738b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7413297 Dec 21 04:59:42.475536 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-61a73660-b2fb-491a-907e-7872138775fe None None] Provisioning complete for port 4f8948a0-4f57-462d-b5fc-49e73da31715 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:42.476132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-61a73660-b2fb-491a-907e-7872138775fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:42.515433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-61a73660-b2fb-491a-907e-7872138775fe None None] Port 4f8948a0-4f57-462d-b5fc-49e73da31715 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:43.110813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51062) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:43.115826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1121074967-network', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:59:43.130740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d0975c49-305e-443e-b8ee-45876cca0ad9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:43.177475 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d0975c49-305e-443e-b8ee-45876cca0ad9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:43.177847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.244116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Made reservation on behalf of 0fedbaf394ae4e48a93861dac9fcd986 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:59:43.247436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.257380 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.332306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.392709 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.426690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 04:59:43.435390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c656d271-949c-4c81-9059-deded100231a,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:43.441212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.441564 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Added segment 3b413b91-3c50-4639-81fe-609be14e54a3 of type vlan for network f0fd2ac8-9110-4931-8fb6-89e6d58075dd Dec 21 04:59:43.482308 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.535985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Sync routers for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:59:43.545395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:43.546015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:43.563999 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.565035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:43.565626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.624949 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] Pushing event updated for resources: {'Network': ['ID=f0fd2ac8-9110-4931-8fb6-89e6d58075dd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:43.637508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 04:59:43.681397 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d07920a6-4d89-4df6-954d-45039890468b admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5693820 Dec 21 04:59:43.684178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51064) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:43.688951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Request body: {'subnet': {'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1121074967-subnet', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:59:43.701479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:43.775390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Made reservation on behalf of 0fedbaf394ae4e48a93861dac9fcd986 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 04:59:43.777798 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.909363 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 2, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:43.935371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Checking router: 5d24adef-3ed6-4dab-92e7-c87f5c1d738b for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:59:43.935724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Updating router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b port 4f8948a0-4f57-462d-b5fc-49e73da31715 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:59:43.964169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:43.995821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.236915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.275174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.327408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e28564-a78b-4f05-b6c3-5e0365ba07fb None None] Pushing event updated for resources: {'Port': ['ID=4f8948a0-4f57-462d-b5fc-49e73da31715,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:44.388733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Attempting to bind port 4f8948a0-4f57-462d-b5fc-49e73da31715 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:59:44.389951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Attempting to bind port 4f8948a0-4f57-462d-b5fc-49e73da31715 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:59:44.390521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Attempting to bind port 4f8948a0-4f57-462d-b5fc-49e73da31715 on network d5c9a809-6115-4194-a1d9-258aa32ac87f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:59:44.397156 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:59:44.402050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Checking segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:44.402050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.402050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Bound using segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:59:44.402050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Bound port: 4f8948a0-4f57-462d-b5fc-49e73da31715, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:59:44.402050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.429214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Pushing event updated for resources: {'Subnet': ['ID=e6c500ed-ddca-42eb-9fd9-60a27f9cdefc,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:44.434455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Checking segment: {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:44.435237 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Network hostable DHCP agents. Network: f0fd2ac8-9110-4931-8fb6-89e6d58075dd, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 04:59:44.467724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] For port 4f8948a0-4f57-462d-b5fc-49e73da31715, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:59:44.470902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] For port 4f8948a0-4f57-462d-b5fc-49e73da31715, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4f8948a0-4f57-462d-b5fc-49e73da31715,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:59:44.518184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 04:59:44.550827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.578504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b1e835d8-dac9-47f8-9448-62f9b28ebee8 None None] Provisioning complete for port 4f8948a0-4f57-462d-b5fc-49e73da31715 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:44.578799 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1e835d8-dac9-47f8-9448-62f9b28ebee8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.604859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f0fd2ac8-9110-4931-8fb6-89e6d58075dd) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:44.611037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 04:59:44.611752 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.629377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3a03b43-d206-41dd-a75a-306976e13a64 None None] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:59:44.666886 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e28564-a78b-4f05-b6c3-5e0365ba07fb None None] Pushing event updated for resources: {'Port': ['ID=4f8948a0-4f57-462d-b5fc-49e73da31715,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:44.677178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:44.677801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:44.689579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0d05c968-dc05-49d9-863e-a2e3e7124ccf admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.0041118 Dec 21 04:59:44.695554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51066) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:44.696932 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 04:59:44.804526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.805747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.862031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.871935 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-f0fd2ac8-9110-4931-8fb6-89e6d58075dd', 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd', 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'fixed_ips': [{'subnet_id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 04:59:44.872771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.876479 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1e835d8-dac9-47f8-9448-62f9b28ebee8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:44.893079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:45.044572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b1e835d8-dac9-47f8-9448-62f9b28ebee8 None None] For port 4f8948a0-4f57-462d-b5fc-49e73da31715, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4f8948a0-4f57-462d-b5fc-49e73da31715,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:45.059757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.114315 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b1e835d8-dac9-47f8-9448-62f9b28ebee8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.332436 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.352362 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.377836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Allocated IP 172.20.0.2 (f0fd2ac8-9110-4931-8fb6-89e6d58075dd/e6c500ed-ddca-42eb-9fd9-60a27f9cdefc/4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:59:45.398874 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e3445635-6fd5-4c81-aee4-8151cfac3208 None None] Provisioning complete for port 4f8948a0-4f57-462d-b5fc-49e73da31715 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:45.399308 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e3445635-6fd5-4c81-aee4-8151cfac3208 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.421063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e835d8-dac9-47f8-9448-62f9b28ebee8 None None] Pushing event updated for resources: {'Port': ['ID=4f8948a0-4f57-462d-b5fc-49e73da31715,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:45.461692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Allocated IP 172.25.5.249 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/465e55d2-31e5-427d-b171-32bf5cde2472) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:59:45.565470 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.595994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:45.634573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad512b9f-8985-4560-995b-f5fb188c5e1a None None] The sync data for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 is: [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:59:45.671566 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.686545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.723085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:45.726218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:45.731310 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:59:45.735068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Pushing event updated for resources: {'Port': ['ID=465e55d2-31e5-427d-b171-32bf5cde2472,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:45.739489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-178fa7ab-dcd9-44fa-b693-01de251c86b3 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:45.778088 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.830948 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:45.834259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:45.840384 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:59:45.846921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Pushing event updated for resources: {'Port': ['ID=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:45.889894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7d8c9484-780e-4fe1-9b97-589630a233e0 None None] Provisioning complete for port 465e55d2-31e5-427d-b171-32bf5cde2472 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:45.890374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7d8c9484-780e-4fe1-9b97-589630a233e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.946497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Attempting to bind port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:59:45.946910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Attempting to bind port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:59:45.947318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Attempting to bind port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc on network f0fd2ac8-9110-4931-8fb6-89e6d58075dd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:59:45.954865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7d8c9484-780e-4fe1-9b97-589630a233e0 None None] Port 465e55d2-31e5-427d-b171-32bf5cde2472 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:45.956606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:59:45.958389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Checking segment: {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:45.958389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:45.958389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Bound using segment: {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:59:45.958389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Bound port: 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:59:45.958900 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:46.029343 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] For port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:59:46.033489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] For port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:59:46.087923 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:46.109995 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:46.179314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a154a0a1-4df5-452d-8d7b-ae6dbf56871e None None] Pushing event updated for resources: {'Port': ['ID=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:46.306871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:46.520615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Router 3c97bf2c-fafb-4739-9847-0e090ab1444c is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 04:59:46.634729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:59:46.646425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Sync routers for ids ['3c97bf2c-fafb-4739-9847-0e090ab1444c'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:59:46.660890 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Routers {'3c97bf2c-fafb-4739-9847-0e090ab1444c'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:46.662640 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c97bf2c-fafb-4739-9847-0e090ab1444c'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:46.726795 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:46.728813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-317eb508-008f-4551-afbb-f1ee530739d6 admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.0351992 Dec 21 04:59:46.731637 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51070) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 04:59:46.772532 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Set router 3c97bf2c-fafb-4739-9847-0e090ab1444c gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:46.969252 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T04:59:45Z', 'revision_number': 3, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:47.001280 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Checking router: 3c97bf2c-fafb-4739-9847-0e090ab1444c for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:59:47.001639 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Updating router 3c97bf2c-fafb-4739-9847-0e090ab1444c port 465e55d2-31e5-427d-b171-32bf5cde2472 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:59:47.036567 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.200504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.217888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:47.277521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:47.277890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.302326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4bc8162-f47a-4825-9661-660a54caadc5 None None] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 04:59:47.334611 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.380595 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Allocated IP 172.20.0.1 (f0fd2ac8-9110-4931-8fb6-89e6d58075dd/e6c500ed-ddca-42eb-9fd9-60a27f9cdefc/aaeb205a-b602-42fa-936f-20bcfd7d3ad9) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 04:59:47.406158 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.442798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-14158410-db8d-4e23-a950-881a9d72641a None None] Provisioning complete for port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:47.443508 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14158410-db8d-4e23-a950-881a9d72641a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.460340 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Attempting to bind port 465e55d2-31e5-427d-b171-32bf5cde2472 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:59:47.460852 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Attempting to bind port 465e55d2-31e5-427d-b171-32bf5cde2472 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:59:47.461313 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Attempting to bind port 465e55d2-31e5-427d-b171-32bf5cde2472 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:59:47.464104 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1586a3-d42a-4402-ad60-084829da2ef3 None None] Pushing event updated for resources: {'Port': ['ID=465e55d2-31e5-427d-b171-32bf5cde2472,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:47.469774 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:59:47.470276 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:47.470778 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.471395 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:59:47.472044 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Bound port: 465e55d2-31e5-427d-b171-32bf5cde2472, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:59:47.472565 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.481189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6b9e9f8-e41d-4b60-b7ae-7432cec6f513 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:47.499432 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.507629 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.531015 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] For port 465e55d2-31e5-427d-b171-32bf5cde2472, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:59:47.534234 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] For port 465e55d2-31e5-427d-b171-32bf5cde2472, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=465e55d2-31e5-427d-b171-32bf5cde2472,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:59:47.554779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:47.592180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14158410-db8d-4e23-a950-881a9d72641a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.612387 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.635724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.638251 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.638764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4f8948a0-4f57-462d-b5fc-49e73da31715 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:47.713688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:47.718004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:47.722205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 04:59:47.756645 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Pushing event updated for resources: {'Port': ['ID=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:47.779271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.796525 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-14158410-db8d-4e23-a950-881a9d72641a None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 04:59:47.796891 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-14158410-db8d-4e23-a950-881a9d72641a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 04:59:47.797374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:47.809085 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4f8948a0-4f57-462d-b5fc-49e73da31715 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:47.809466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:47.812114 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Routers {'3c97bf2c-fafb-4739-9847-0e090ab1444c'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:47.812916 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c97bf2c-fafb-4739-9847-0e090ab1444c'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:47.853421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cf98620-225f-412b-a709-158f2bf45b81 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 04:59:47.916375 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1586a3-d42a-4402-ad60-084829da2ef3 None None] Pushing event updated for resources: {'Port': ['ID=465e55d2-31e5-427d-b171-32bf5cde2472,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:47.934082 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] Set router 3c97bf2c-fafb-4739-9847-0e090ab1444c gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:48.010616 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.116069 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T04:59:45Z', 'revision_number': 3, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:48.146091 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f9effd-4859-42fb-be6a-1eb5ac77852b None None] The sync data for ids ['3c97bf2c-fafb-4739-9847-0e090ab1444c'] in n-d-822053-11 is: [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T04:59:45Z', 'revision_number': 3, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:59:48.180796 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.244303 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.313901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Pushing event updated for resources: {'Port': ['ID=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:48.316661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.430825 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 04:59:48.432328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 04:59:48.463748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Provisioning complete for port 465e55d2-31e5-427d-b171-32bf5cde2472 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:48.464226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.552911 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.567951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Router 3c97bf2c-fafb-4739-9847-0e090ab1444c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 04:59:48.576007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] For port 465e55d2-31e5-427d-b171-32bf5cde2472, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=465e55d2-31e5-427d-b171-32bf5cde2472,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:48.670172 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.690849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 04:59:48.697917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-178529ef-2c6f-4da3-856e-19190a21e173 admin admin] 10.222.0.18 "PUT /v2.0/routers/3c97bf2c-fafb-4739-9847-0e090ab1444c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9649310 Dec 21 04:59:48.717735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Provisioning complete for port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:48.717735 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.756876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Pushing event updated for resources: {'Port': ['ID=465e55d2-31e5-427d-b171-32bf5cde2472,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:48.824646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Provisioning complete for port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:48.824646 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:48.860736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7fe8291e-be15-428a-8405-4596cbcac1e7 None None] Port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:48.979221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-21531e03-d0aa-4347-a28e-cdde60ea9c0f None None] Provisioning complete for port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:48.979601 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21531e03-d0aa-4347-a28e-cdde60ea9c0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:49.019795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-21531e03-d0aa-4347-a28e-cdde60ea9c0f None None] Port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 04:59:49.193527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:49.256989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:49.257610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:49.342028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 465e55d2-31e5-427d-b171-32bf5cde2472 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:49.393248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 465e55d2-31e5-427d-b171-32bf5cde2472 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:49.393848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:49.809562 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Sync routers for ids ['3c97bf2c-fafb-4739-9847-0e090ab1444c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 04:59:49.822295 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Routers {'3c97bf2c-fafb-4739-9847-0e090ab1444c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:49.822752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c97bf2c-fafb-4739-9847-0e090ab1444c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:49.972091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Set router 3c97bf2c-fafb-4739-9847-0e090ab1444c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:49.974338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-20cd020e-8de1-4075-b318-bd34d788eee1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:50.216125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T04:59:47Z', 'revision_number': 4, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'aaeb205a-b602-42fa-936f-20bcfd7d3ad9', 'name': '', 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'mac_address': 'fa:16:3e:cc:5e:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_interface', 'standard_attr_id': 4186, 'fixed_ips': [{'subnet_id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:47Z', 'updated_at': '2021-12-21T04:59:48Z', 'revision_number': 2, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'subnets': [{'id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:50.243493 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Checking router: 3c97bf2c-fafb-4739-9847-0e090ab1444c for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 04:59:50.243877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Updating router 3c97bf2c-fafb-4739-9847-0e090ab1444c port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 04:59:50.272695 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:50.728625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:50.829175 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:50.888328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c6a60e-a9d9-44d4-925a-f323b781a320 None None] Pushing event updated for resources: {'Port': ['ID=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:50.945581 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Attempting to bind port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 04:59:50.946114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Attempting to bind port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 04:59:50.946642 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Attempting to bind port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 on network f0fd2ac8-9110-4931-8fb6-89e6d58075dd {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 04:59:50.954428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 04:59:50.954906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Checking segment: {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 04:59:50.955410 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:50.955882 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Bound using segment: {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 04:59:50.956445 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Bound port: aaeb205a-b602-42fa-936f-20bcfd7d3ad9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3b413b91-3c50-4639-81fe-609be14e54a3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 04:59:50.960171 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:51.038038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] For port aaeb205a-b602-42fa-936f-20bcfd7d3ad9, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 04:59:51.042034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] For port aaeb205a-b602-42fa-936f-20bcfd7d3ad9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 04:59:51.116491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:51.197209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Routers {'3c97bf2c-fafb-4739-9847-0e090ab1444c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 04:59:51.197907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T04:59:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c97bf2c-fafb-4739-9847-0e090ab1444c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:51.199804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2715cfdc-6e09-4c0f-aa91-467c9d8f187b None None] Provisioning complete for port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:51.205001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2715cfdc-6e09-4c0f-aa91-467c9d8f187b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:51.250496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c6a60e-a9d9-44d4-925a-f323b781a320 None None] Pushing event updated for resources: {'Port': ['ID=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:51.413152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2715cfdc-6e09-4c0f-aa91-467c9d8f187b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:51.444504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] Set router 3c97bf2c-fafb-4739-9847-0e090ab1444c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 04:59:51.488292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2715cfdc-6e09-4c0f-aa91-467c9d8f187b None None] For port aaeb205a-b602-42fa-936f-20bcfd7d3ad9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 04:59:51.554864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2715cfdc-6e09-4c0f-aa91-467c9d8f187b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:51.640680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2715cfdc-6e09-4c0f-aa91-467c9d8f187b None None] Pushing event updated for resources: {'Port': ['ID=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 04:59:51.706725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-316963ff-ea0b-434a-94ff-8b0b020b448e None None] Provisioning complete for port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:51.707131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-316963ff-ea0b-434a-94ff-8b0b020b448e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:51.768658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T04:59:47Z', 'revision_number': 4, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'aaeb205a-b602-42fa-936f-20bcfd7d3ad9', 'name': '', 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'mac_address': 'fa:16:3e:cc:5e:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_interface', 'standard_attr_id': 4186, 'fixed_ips': [{'subnet_id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:47Z', 'updated_at': '2021-12-21T04:59:51Z', 'revision_number': 4, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'subnets': [{'id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 04:59:51.803142 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4de4b583-19e9-4b5c-b460-f17ab7c1e807 None None] The sync data for ids ['3c97bf2c-fafb-4739-9847-0e090ab1444c'] in n-d-822053-11 is: [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T04:59:47Z', 'revision_number': 4, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'aaeb205a-b602-42fa-936f-20bcfd7d3ad9', 'name': '', 'network_id': 'f0fd2ac8-9110-4931-8fb6-89e6d58075dd', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'mac_address': 'fa:16:3e:cc:5e:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_interface', 'standard_attr_id': 4186, 'fixed_ips': [{'subnet_id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:47Z', 'updated_at': '2021-12-21T04:59:51Z', 'revision_number': 4, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'subnets': [{'id': 'e6c500ed-ddca-42eb-9fd9-60a27f9cdefc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 04:59:52.781347 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bbcdf2d4-7b3b-4da3-beb4-a0cb7230a443 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:53.156916 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aaeb205a-b602-42fa-936f-20bcfd7d3ad9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 04:59:53.207700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 04:59:53.208123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:53.547396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:53.573026 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:55.308813 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:55.389280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 04:59:55.843773 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:00.332098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2beb0493-4e83-4492-8456-71217384f0f5 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:00.333546 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2beb0493-4e83-4492-8456-71217384f0f5 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 814 time: 0.1036897 Dec 21 05:00:00.348314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-fc225abd-ffe0-43a8-8a6c-85858d54a7ed tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/quotas/681e67c9ff5d464bb22e16bfdba91dd8 HTTP/1.1" status: 200 len: 375 time: 0.0089440 Dec 21 05:00:00.397514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-ffee33fe-6302-4bbc-ad91-41e42d620b77 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0435355 Dec 21 05:00:00.496651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-88776003-5898-46a5-8297-54fbfed3c73b service neutron] 10.222.0.18 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877025 Dec 21 05:00:00.585107 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-de76b1f3-1ac7-4839-95a0-9dacf2cec2c7 service neutron] 10.222.0.18 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820749 Dec 21 05:00:00.860993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b22b069a-d1b3-4f39-a5b6-486688fb7094 req-3d59d657-f295-488c-875b-a045b3bbdc89 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 210 time: 0.0268476 Dec 21 05:00:01.941235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71e43cfe-9ee9-41ea-912f-072352d8c7d6 req-863ce732-66d5-4aed-b4b2-c48ece72cdc6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 210 time: 0.0298774 Dec 21 05:00:03.034519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f4520a9-a278-472e-95ba-4ab086bd908f req-ce7bd9ab-a996-4ad5-906a-5544a76db8ea tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 210 time: 0.0263507 Dec 21 05:00:03.143699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-5bc2f0b8-a853-4e45-b054-394838648a6e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:03.145171 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-5bc2f0b8-a853-4e45-b054-394838648a6e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 814 time: 0.1092858 Dec 21 05:00:03.163118 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'port': {'device_id': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'admin_state_up': True, 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:03.348841 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Made reservation on behalf of 681e67c9ff5d464bb22e16bfdba91dd8 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:00:03.352855 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:03.486903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Allocated IP 172.20.0.12 (d5c9a809-6115-4194-a1d9-258aa32ac87f/3cfc2d61-2a54-421d-842e-875448a9778a/28f82c96-ab4a-421c-815f-04200e2767ff) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:00:03.642876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:03.749797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:03.800132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:03.809849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.812836 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.813240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.813490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.813893 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.814298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:03.845281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Network d5c9a809-6115-4194-a1d9-258aa32ac87f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:00:03.847566 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:00:03.855509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:00:03.959292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:03.960683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:04.048268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-64260dce-d20f-42ae-980f-c27a6bdf55d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8887820 Dec 21 05:00:04.245103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e41f60-612c-40b9-862e-e09caa56276e req-13eb3a80-b152-4c09-ad17-f524e51d0997 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:04.248172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9e41f60-612c-40b9-862e-e09caa56276e req-13eb3a80-b152-4c09-ad17-f524e51d0997 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0867372 Dec 21 05:00:04.260917 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b5eb3a96-a30e-4f8b-a556-8a669315e713 None None] Provisioning complete for port 28f82c96-ab4a-421c-815f-04200e2767ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:00:04.261509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b5eb3a96-a30e-4f8b-a556-8a669315e713 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:04.300052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b5eb3a96-a30e-4f8b-a556-8a669315e713 None None] Port 28f82c96-ab4a-421c-815f-04200e2767ff cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:00:04.309540 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9e41f60-612c-40b9-862e-e09caa56276e req-e72342cd-461c-4015-8efd-ecf91c052147 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544531 Dec 21 05:00:05.435241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8222b522-980c-4fe6-b33a-b0daaf275e60 req-f5e6dce0-352d-40f7-9c9e-84f15b969147 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:05.438311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8222b522-980c-4fe6-b33a-b0daaf275e60 req-f5e6dce0-352d-40f7-9c9e-84f15b969147 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0544963 Dec 21 05:00:05.505788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8222b522-980c-4fe6-b33a-b0daaf275e60 req-d439a8fd-60d3-4b9b-a07f-cc761e795a77 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560431 Dec 21 05:00:06.620712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e79cb6-2212-4dff-ac1e-60f2fd54d6d7 req-5f20fe79-755e-4cbc-aee7-04b3750664a2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:06.627735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8e79cb6-2212-4dff-ac1e-60f2fd54d6d7 req-5f20fe79-755e-4cbc-aee7-04b3750664a2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0545225 Dec 21 05:00:06.679482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8e79cb6-2212-4dff-ac1e-60f2fd54d6d7 req-dc26f141-d71d-4ce5-ac37-3979fc2259ee tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505464 Dec 21 05:00:07.819326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1681cd-2865-4b24-a72b-9c442d5f8a73 req-36b82805-27be-49fb-8b34-8d3e82b0fe11 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:07.820917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea1681cd-2865-4b24-a72b-9c442d5f8a73 req-36b82805-27be-49fb-8b34-8d3e82b0fe11 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0500927 Dec 21 05:00:07.870628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ea1681cd-2865-4b24-a72b-9c442d5f8a73 req-40ed358d-8a82-4c16-b9a4-d973b178a757 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433397 Dec 21 05:00:09.007272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44de5550-30b1-4d49-88b2-c6bcd44878e4 req-d7b67678-234e-4316-a1f4-0615c488f0a6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:09.008778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44de5550-30b1-4d49-88b2-c6bcd44878e4 req-d7b67678-234e-4316-a1f4-0615c488f0a6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0537915 Dec 21 05:00:09.054398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-44de5550-30b1-4d49-88b2-c6bcd44878e4 req-3d1fed1b-114d-42d0-83e3-139c22e9baa6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396488 Dec 21 05:00:10.168812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6900c940-d759-49ff-a316-3fa831182b2a req-fd6328db-3c75-4b65-a0ef-3748308e52a6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:10.170275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6900c940-d759-49ff-a316-3fa831182b2a req-fd6328db-3c75-4b65-a0ef-3748308e52a6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0482564 Dec 21 05:00:10.216757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6900c940-d759-49ff-a316-3fa831182b2a req-0d36b53a-98d4-4a67-b805-81f8c64a4259 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406058 Dec 21 05:00:11.328611 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98bf47dd-2ae2-4ff4-aaf1-91f9730e8c92 req-35716ed0-a386-47f6-ab4c-3074769959f1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:11.330021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98bf47dd-2ae2-4ff4-aaf1-91f9730e8c92 req-35716ed0-a386-47f6-ab4c-3074769959f1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0478067 Dec 21 05:00:11.380362 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-98bf47dd-2ae2-4ff4-aaf1-91f9730e8c92 req-189a66e3-0e51-4b33-b02c-97aefcccbcad tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442579 Dec 21 05:00:11.873413 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:00:12.508079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15cab2eb-850b-4d09-a0cb-bac1b6469afb req-b7d90f5b-4206-416e-ba64-d3d5efb4d18c tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:12.509657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15cab2eb-850b-4d09-a0cb-bac1b6469afb req-b7d90f5b-4206-416e-ba64-d3d5efb4d18c tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0588069 Dec 21 05:00:12.557261 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15cab2eb-850b-4d09-a0cb-bac1b6469afb req-8bd52a1c-cd3d-413a-8cff-641230c1be47 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416558 Dec 21 05:00:13.680509 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f2f8d4-64b9-4f02-88d8-d1ae03358ab7 req-46cdd59b-1400-4802-b259-d7adfdf02c01 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:13.682307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69f2f8d4-64b9-4f02-88d8-d1ae03358ab7 req-46cdd59b-1400-4802-b259-d7adfdf02c01 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0496929 Dec 21 05:00:13.730556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69f2f8d4-64b9-4f02-88d8-d1ae03358ab7 req-c778c8a4-db1b-4505-885f-500e4f2e174f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412600 Dec 21 05:00:14.846986 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f12551b-75f6-4e08-b3a6-1624204a8d8f req-219a89bf-d0b4-4e4e-b3f8-1ae997cbe450 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:14.848502 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f12551b-75f6-4e08-b3a6-1624204a8d8f req-219a89bf-d0b4-4e4e-b3f8-1ae997cbe450 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0512328 Dec 21 05:00:14.895799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f12551b-75f6-4e08-b3a6-1624204a8d8f req-a2e9e8d7-c02a-4b01-bc92-1cae4518457f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409303 Dec 21 05:00:15.907596 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Request body: {'port': {'device_id': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:15.966329 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:16.013136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e49f187-ba5f-4cbc-a8b4-eaf36af7b070 req-3020c326-8471-4a62-a0e1-92daad105e2d tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:16.014631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e49f187-ba5f-4cbc-a8b4-eaf36af7b070 req-3020c326-8471-4a62-a0e1-92daad105e2d tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 932 time: 0.0486186 Dec 21 05:00:16.061282 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4e49f187-ba5f-4cbc-a8b4-eaf36af7b070 req-5997b964-b492-4322-b0bc-d41b9b762a11 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405593 Dec 21 05:00:16.223963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 28f82c96-ab4a-421c-815f-04200e2767ff {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:00:16.232236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:16.243664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Transition to ACTIVE for port object 28f82c96-ab4a-421c-815f-04200e2767ff will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:00:16.300576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:16.354415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:16.428472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Attempting to bind port 28f82c96-ab4a-421c-815f-04200e2767ff on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:00:16.428818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Attempting to bind port 28f82c96-ab4a-421c-815f-04200e2767ff by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:00:16.429157 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Attempting to bind port 28f82c96-ab4a-421c-815f-04200e2767ff on network d5c9a809-6115-4194-a1d9-258aa32ac87f {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:00:16.433714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Port 28f82c96-ab4a-421c-815f-04200e2767ff on network d5c9a809-6115-4194-a1d9-258aa32ac87f not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:00:16.434053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Attempting to bind port 28f82c96-ab4a-421c-815f-04200e2767ff on network d5c9a809-6115-4194-a1d9-258aa32ac87f {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:00:16.439158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 4, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:00:16.439505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Checking segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:00:16.439898 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Bound using segment: {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:00:16.440328 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Bound port: 28f82c96-ab4a-421c-815f-04200e2767ff, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '171c2697-66fb-4ffa-9a66-539614ac1012', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:00:16.440689 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:16.505912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:00:16.508945 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:00:16.598665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:16.635240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:16.635861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:16.637272 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] 10.222.0.54 "PUT /v2.0/ports/28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 1093 time: 0.8236251 Dec 21 05:00:16.639458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:00:16.641711 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e81981f-f36e-40d7-a071-98b7adebf7bb" -d '{"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:00:16.685572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7dc297-4c31-444a-b2c0-a2842a353e10 service neutron] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:16.695388 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:00:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8393d294-cf1c-462a-a94e-9cf1b26b10b7 x-openstack-request-id: req-8393d294-cf1c-462a-a94e-9cf1b26b10b7 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:00:16.695821 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:00:16.696166 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8393d294-cf1c-462a-a94e-9cf1b26b10b7 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:00:16.696685 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'status': 'completed', 'code': 200} Dec 21 05:00:16.779134 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e81981f-f36e-40d7-a071-98b7adebf7bb req-af6dd776-3f30-4e9c-9833-cb47febfa7bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:16.780709 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3e81981f-f36e-40d7-a071-98b7adebf7bb req-af6dd776-3f30-4e9c-9833-cb47febfa7bd service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1096 time: 0.0447011 Dec 21 05:00:16.886654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e81981f-f36e-40d7-a071-98b7adebf7bb req-6220afd3-c995-4aaf-8b64-b7ddb11204bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:16.888168 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3e81981f-f36e-40d7-a071-98b7adebf7bb req-6220afd3-c995-4aaf-8b64-b7ddb11204bb service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0931134 Dec 21 05:00:16.988001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e81981f-f36e-40d7-a071-98b7adebf7bb req-af35fa87-8933-4a09-8949-1590e27604ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:16.989435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3e81981f-f36e-40d7-a071-98b7adebf7bb req-af35fa87-8933-4a09-8949-1590e27604ab service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0912557 Dec 21 05:00:17.087499 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-c93de088-e972-40c7-9893-3138f190690a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:17.089040 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-c93de088-e972-40c7-9893-3138f190690a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1096 time: 0.0413043 Dec 21 05:00:17.142261 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-1bdefa53-1deb-4916-a860-00137fe5eabc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 217 time: 0.0378723 Dec 21 05:00:17.180013 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e17c36-3312-4f8a-b321-15f2e22d9a81 req-842813b2-4550-4421-b5aa-82517512ac0a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:17.182166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85e17c36-3312-4f8a-b321-15f2e22d9a81 req-842813b2-4550-4421-b5aa-82517512ac0a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 944 time: 0.0516520 Dec 21 05:00:17.193866 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-8d541c00-f8d7-48a6-9c78-5239625d34c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:17.195397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-8d541c00-f8d7-48a6-9c78-5239625d34c6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0460765 Dec 21 05:00:17.229090 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-85e17c36-3312-4f8a-b321-15f2e22d9a81 req-8d602e58-b295-46fd-a73f-7c249574e87a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403283 Dec 21 05:00:17.241184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-271a4749-b711-48bf-b7fe-8badc8f9fdbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:17.242727 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-271a4749-b711-48bf-b7fe-8badc8f9fdbf service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0402844 Dec 21 05:00:17.333770 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-049375cd-6453-43c1-ac44-8447e8a4c277 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836112 Dec 21 05:00:17.421395 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-7ebf9289-5a0c-4e4c-a183-c0a04ab81616 req-fa9e1b6b-1af1-4daa-b683-bbf2e81b6698 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805423 Dec 21 05:00:18.345700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45881e55-a8a1-493b-8c34-669abca6bbdf req-19df8830-53aa-43bd-acb7-f5c714d31b6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:18.347393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45881e55-a8a1-493b-8c34-669abca6bbdf req-19df8830-53aa-43bd-acb7-f5c714d31b6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 944 time: 0.0479524 Dec 21 05:00:18.393152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-45881e55-a8a1-493b-8c34-669abca6bbdf req-09c095c0-187e-4e2c-ada2-6a6568b6f532 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396452 Dec 21 05:00:19.508917 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15efa0a-bbb2-47e4-a15f-e1852a918706 req-adb048f1-4c78-435d-9eb0-99c580740043 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:19.510411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b15efa0a-bbb2-47e4-a15f-e1852a918706 req-adb048f1-4c78-435d-9eb0-99c580740043 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 944 time: 0.0480909 Dec 21 05:00:19.559711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b15efa0a-bbb2-47e4-a15f-e1852a918706 req-bb15a471-8c01-42e1-8b75-cff401b2d678 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434275 Dec 21 05:00:20.297409 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0524f47e-39d0-4a11-936a-77e4adba3e72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:20.654722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 28f82c96-ab4a-421c-815f-04200e2767ff details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:00:20.675296 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8785f28-2f9d-4e92-800a-d7b86cf447fb req-bd6d5910-1f30-440d-b9c1-62b5b65af72f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:20.676779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8785f28-2f9d-4e92-800a-d7b86cf447fb req-bd6d5910-1f30-440d-b9c1-62b5b65af72f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 944 time: 0.0512810 Dec 21 05:00:20.723615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8785f28-2f9d-4e92-800a-d7b86cf447fb req-b4c9a870-12ca-40e6-a351-372a74d888de tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402567 Dec 21 05:00:20.749068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:00:20.759190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '28f82c96-ab4a-421c-815f-04200e2767ff', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'port_id': '28f82c96-ab4a-421c-815f-04200e2767ff', 'mac_address': 'fa:16:3e:4d:3e:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:00:20.799034 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:20.811797 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 28f82c96-ab4a-421c-815f-04200e2767ff {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:00:20.830645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:00:20.917674 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:20.963836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:21.220782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['28f82c96-ab4a-421c-815f-04200e2767ff'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:00:21.836515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d33dc5-91f9-414c-81f4-64e2bb28d815 req-00059b4c-6c62-4005-aa4f-c215f6831582 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:21.838638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06d33dc5-91f9-414c-81f4-64e2bb28d815 req-00059b4c-6c62-4005-aa4f-c215f6831582 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 945 time: 0.0487370 Dec 21 05:00:21.884189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06d33dc5-91f9-414c-81f4-64e2bb28d815 req-6649126f-3fd7-4807-a331-6c3be5a7c53c tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393913 Dec 21 05:00:22.653720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 28f82c96-ab4a-421c-815f-04200e2767ff up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:00:22.737542 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-86c44ef5-25ff-4a99-bab2-74672ddd5662 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:22.760056 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 28f82c96-ab4a-421c-815f-04200e2767ff completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:00:22.763896 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 28f82c96-ab4a-421c-815f-04200e2767ff triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:00:22.764260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:22.838728 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:22.864760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:00:22.866907 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dace2155-1ba0-41cb-95ec-90e03c3d3860" -d '{"events": [{"server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "name": "network-vif-plugged", "status": "completed", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:00:22.879256 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:00:22.903961 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:00:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bea10c86-55fe-4609-af30-897be0d244f1 x-openstack-request-id: req-bea10c86-55fe-4609-af30-897be0d244f1 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:00:22.908429 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "name": "network-vif-plugged", "status": "completed", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:00:22.908429 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-bea10c86-55fe-4609-af30-897be0d244f1 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:00:22.908429 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'code': 200} Dec 21 05:00:22.937545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:22.997109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:23.005060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45353c6-9deb-4ca5-90ee-80575f2c519e req-c7fd174e-9e51-4ab1-add9-3827d688a956 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:23.006778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a45353c6-9deb-4ca5-90ee-80575f2c519e req-c7fd174e-9e51-4ab1-add9-3827d688a956 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0550799 Dec 21 05:00:23.052948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f53affe-bf87-47da-a41f-f4ad9954efe2 req-00407ffb-658e-485b-ac0d-270c88b76ba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:23.057496 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f53affe-bf87-47da-a41f-f4ad9954efe2 req-00407ffb-658e-485b-ac0d-270c88b76ba8 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1098 time: 0.0455968 Dec 21 05:00:23.063313 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a45353c6-9deb-4ca5-90ee-80575f2c519e req-787c2643-50cd-4846-9849-81c384d7003d tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502687 Dec 21 05:00:23.108486 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f53affe-bf87-47da-a41f-f4ad9954efe2 req-7ad6b51f-4dec-4b94-984f-24a0a30886ff service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456583 Dec 21 05:00:23.557946 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:23.580095 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:24.187740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2f7a83-c34e-4918-a4ae-a55853435af1 req-2b8af590-b123-4850-8bb7-a04d42c5e49e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:24.189219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c2f7a83-c34e-4918-a4ae-a55853435af1 req-2b8af590-b123-4850-8bb7-a04d42c5e49e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0530372 Dec 21 05:00:24.235711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c2f7a83-c34e-4918-a4ae-a55853435af1 req-af76567a-86cf-4cc9-8c27-b99115363c06 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406387 Dec 21 05:00:25.308831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:25.354835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a974656-9a18-4488-a7f0-87435bdae271 req-35a8846b-19eb-4481-9086-9799eb2cc639 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:25.356272 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a974656-9a18-4488-a7f0-87435bdae271 req-35a8846b-19eb-4481-9086-9799eb2cc639 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0545599 Dec 21 05:00:25.403271 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:25.751888 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a974656-9a18-4488-a7f0-87435bdae271 req-6c8b03f9-8074-4d98-bd37-e06588577cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3894112 Dec 21 05:00:25.811749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:25.864423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90939e4a-5aec-4adb-89ce-4a6a012d5c97 req-caeb8fcc-5978-4c79-b5c7-31e7939fc48e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:25.865775 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90939e4a-5aec-4adb-89ce-4a6a012d5c97 req-caeb8fcc-5978-4c79-b5c7-31e7939fc48e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0475850 Dec 21 05:00:25.912018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90939e4a-5aec-4adb-89ce-4a6a012d5c97 req-ae480b20-a442-4ba1-ad6b-65eda53a09f7 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397060 Dec 21 05:00:26.094311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4b6619-e434-4980-9466-a4b63000fee7 req-00b0969e-e00b-4c52-b7a6-d86ddc8cf00b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:26.095804 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c4b6619-e434-4980-9466-a4b63000fee7 req-00b0969e-e00b-4c52-b7a6-d86ddc8cf00b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0477605 Dec 21 05:00:26.149750 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2c4b6619-e434-4980-9466-a4b63000fee7 req-b0c5ab5a-2696-48b1-a8f0-8923e7703893 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410421 Dec 21 05:00:41.457660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b9bf76-d128-4d94-827e-3e9f0e431921 req-1e19e75f-6785-40f9-9a26-ed95d9636d2a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:41.459143 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86b9bf76-d128-4d94-827e-3e9f0e431921 req-1e19e75f-6785-40f9-9a26-ed95d9636d2a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0508235 Dec 21 05:00:41.505054 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-86b9bf76-d128-4d94-827e-3e9f0e431921 req-3a6666b5-6fdc-495e-85af-fd2697cb510e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399373 Dec 21 05:00:41.527339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51284) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:41.615195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e26aa478-acbd-4780-918b-36f50c3e3ba5 tempest-TestMinimumBasicScenario-722205558 tempest-TestMinimumBasicScenario-722205558-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:41.616704 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e26aa478-acbd-4780-918b-36f50c3e3ba5 tempest-TestMinimumBasicScenario-722205558 tempest-TestMinimumBasicScenario-722205558-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1093 time: 0.0883939 Dec 21 05:00:41.619669 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51288) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:41.624350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '28f82c96-ab4a-421c-815f-04200e2767ff', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'fixed_ip_address': '172.20.0.12'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:41.716867 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:41.813654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:41.911149 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Allocated IP 172.25.5.109 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/42d68af8-85b0-4dde-b30f-c38ccabccdc6) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:00:42.013141 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:42.088676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:42.128778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:00:42.131609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:00:42.135037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:00:42.140394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'Port': ['ID=42d68af8-85b0-4dde-b30f-c38ccabccdc6,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:42.172363 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.172721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.173073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.173417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.173755 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.174092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.174427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.174760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.175116 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.175448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.175783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.176107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.176431 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:00:42.495701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:42.617759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:42.764728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:42.834512 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:42.906460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'Port': ['ID=42d68af8-85b0-4dde-b30f-c38ccabccdc6,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:42.916246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.016832 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Floating IP 6696e552-1bdf-486c-b76c-04ae57443de2 associated. External IP: 172.25.5.109, port: 28f82c96-ab4a-421c-815f-04200e2767ff. Dec 21 05:00:43.222473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:00:43.331624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:00:43.344064 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] Sync routers for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:00:43.353400 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:00:43.354009 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:00:43.403645 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.431952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8c2bfcc8-a653-4b15-9110-859ae41c5be1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8107612 Dec 21 05:00:43.432818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:00:43.435611 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde" -d '{"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:00:43.435920 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51292) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:43.447170 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1616491536', 'description': 'tempest-secgroup-smoke-1616491536 description', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:43.467819 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:00:43.478022 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:00:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7da277ff-ab78-419d-b900-c2930a3082a4 x-openstack-request-id: req-7da277ff-ab78-419d-b900-c2930a3082a4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:00:43.478384 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:00:43.478859 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7da277ff-ab78-419d-b900-c2930a3082a4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:00:43.479383 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'status': 'completed', 'code': 200} Dec 21 05:00:43.517386 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.619384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.622319 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-eb03b4f9-e4fb-4e90-96b7-6095ed43a5a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:43.623870 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-eb03b4f9-e4fb-4e90-96b7-6095ed43a5a1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1098 time: 0.0952694 Dec 21 05:00:43.662156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.696836 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6696e552-1bdf-486c-b76c-04ae57443de2', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'floating_ip_address': '172.25.5.109', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'port_id': '28f82c96-ab4a-421c-815f-04200e2767ff', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4189, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'mac_address': 'fa:16:3e:4d:3e:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:00:42Z', 'updated_at': '2021-12-21T05:00:42Z', 'revision_number': 0, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:00:43.728008 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] Checking router: 5d24adef-3ed6-4dab-92e7-c87f5c1d738b for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:00:43.736519 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:00:43.737832 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:00:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:00:43.741185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroup': ['ID=829c0b32-c10b-448d-bf60-30e29b78434b,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:43.754476 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.755750 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7246845d-010a-4dbc-b38c-aaaff8eb6959 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3188062 Dec 21 05:00:43.758797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51296) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:43.764282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group_rule': {'security_group_id': '829c0b32-c10b-448d-bf60-30e29b78434b', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:43.781056 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-9cd82cde-f84e-4058-bbc7-5a77a7803aa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:43.783134 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-9cd82cde-f84e-4058-bbc7-5a77a7803aa1 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.1292932 Dec 21 05:00:43.843123 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:00:43.850974 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-aea14dad-d18e-4d85-935d-1f912706c51f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 1000 time: 0.0594921 Dec 21 05:00:43.877203 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.905286 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-8bd83549-7293-4d0f-b4e6-d9a8c3968fa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:43.906756 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-8bd83549-7293-4d0f-b4e6-d9a8c3968fa2 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0486808 Dec 21 05:00:43.935485 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:43.956043 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-faba8ec2-e5a0-414e-b26d-4b01d913bab4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:43.957640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-faba8ec2-e5a0-414e-b26d-4b01d913bab4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0414927 Dec 21 05:00:43.970448 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-c297bb69-f6a0-4383-b25f-29aab33dbdc3 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:00:43.971433 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-c297bb69-f6a0-4383-b25f-29aab33dbdc3 service neutron] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050173 Dec 21 05:00:44.031381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.051394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=492be08e-bb5e-4036-971c-f81be9f5b858,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:44.066212 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-09055589-f3dd-4de0-a0da-a12c2ea1bf75 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873904 Dec 21 05:00:44.075396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6696e552-1bdf-486c-b76c-04ae57443de2', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'floating_ip_address': '172.25.5.109', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'port_id': '28f82c96-ab4a-421c-815f-04200e2767ff', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4189, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'mac_address': 'fa:16:3e:4d:3e:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:00:42Z', 'updated_at': '2021-12-21T05:00:42Z', 'revision_number': 0, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:00:44.101301 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257323f2-0b61-4b7c-b79f-daa5b01597a1 None None] The sync data for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 is: [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6696e552-1bdf-486c-b76c-04ae57443de2', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'floating_ip_address': '172.25.5.109', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'port_id': '28f82c96-ab4a-421c-815f-04200e2767ff', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4189, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'mac_address': 'fa:16:3e:4d:3e:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:00:42Z', 'updated_at': '2021-12-21T05:00:42Z', 'revision_number': 0, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:00:44.123086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.127987 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07062a71-2b94-409f-a321-bdd0e53d8d9b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3651063 Dec 21 05:00:44.128371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51298) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:44.133639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group_rule': {'security_group_id': '829c0b32-c10b-448d-bf60-30e29b78434b', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:44.169130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6f1dcd2-1481-4f97-9aaa-5d8f2fb0cdde req-ce1bf46b-657e-45c5-9bfd-11e93e7d86dc service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0933652 Dec 21 05:00:44.234764 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.295159 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.312866 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7046d447-c3ed-48de-9afc-2031d5258188 None None] New status for floating IP 6696e552-1bdf-486c-b76c-04ae57443de2: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:00:44.355297 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.376764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d4bdf423-6679-4d99-ae20-abb7b9c61503,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:44.436809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.438037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-69054fae-3794-4593-87f1-93bbb4a7da53 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3087246 Dec 21 05:00:44.440848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51300) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:44.445189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group_rule': {'security_group_id': '829c0b32-c10b-448d-bf60-30e29b78434b', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:44.525547 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.585235 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.668935 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.688284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=605cb219-752f-4ef3-89c5-fd547709a50e,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:44.736075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.737311 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a8136848-9cfd-4b99-bbd5-55a3c0b4b8fd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2955256 Dec 21 05:00:44.740273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:44.744748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group_rule': {'security_group_id': '829c0b32-c10b-448d-bf60-30e29b78434b', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:44.822806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.880139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.943446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:44.963122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=772891d7-3348-47c2-91c3-20d5025393e4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:45.033490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.034719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-951f26f8-cdf7-40dc-8109-17cdd048c928 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2933896 Dec 21 05:00:45.037454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51304) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:45.041758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group_rule': {'security_group_id': '829c0b32-c10b-448d-bf60-30e29b78434b', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:45.128665 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Project 681e67c9ff5d464bb22e16bfdba91dd8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:00:45.133758 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.190736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.260152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.277559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4c06a40-246c-486a-83d5-4857f719ebdb,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:45.364868 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.366198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0ec2f6ee-70bb-4289-ab81-5e443e5369ab tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3278139 Dec 21 05:00:45.368960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51306) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:00:45.374026 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'security_group_rule': {'security_group_id': '829c0b32-c10b-448d-bf60-30e29b78434b', 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:45.465561 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Project 681e67c9ff5d464bb22e16bfdba91dd8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:00:45.470704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.529541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.657251 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.676781 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ccb55351-f696-49a6-8c37-3bdabd4a29ba,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:45.759256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:45.760491 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4b387d35-4e1a-454f-a783-59446772bd03 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3905478 Dec 21 05:00:45.855780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42554aea-7d88-429c-8e72-f8a29a94471e req-d56fbc67-350d-4ad5-a5c0-2a1315acbfe9 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1616491536&fields=id&tenant_id=681e67c9ff5d464bb22e16bfdba91dd8 HTTP/1.1" status: 200 len: 267 time: 0.0487127 Dec 21 05:00:45.910487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42554aea-7d88-429c-8e72-f8a29a94471e req-85bec73d-aecf-4d6b-a440-8220003a4e46 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:45.912026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42554aea-7d88-429c-8e72-f8a29a94471e req-85bec73d-aecf-4d6b-a440-8220003a4e46 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0506146 Dec 21 05:00:45.923756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'port': {'security_groups': ['253b8954-9125-4930-b54c-ae86fc284949', '829c0b32-c10b-448d-bf60-30e29b78434b']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:00:45.985777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:46.173425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:00:46.202720 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:46.288714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:46.339778 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['28f82c96-ab4a-421c-815f-04200e2767ff'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:00:46.340328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:46.340442 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:46.344070 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42554aea-7d88-429c-8e72-f8a29a94471e req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "PUT /v2.0/ports/28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 982 time: 0.4242215 Dec 21 05:00:46.344070 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:00:46.349520 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c0567da-1907-47a7-8033-8676a8a43d72" -d '{"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:00:46.387398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254c042f-7103-4113-bcca-8603b6440cc0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=6']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:00:46.404452 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:00:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47683396-5f86-4e2f-9690-bd54d0b3d1ec x-openstack-request-id: req-47683396-5f86-4e2f-9690-bd54d0b3d1ec {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:00:46.405031 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:00:46.405474 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-47683396-5f86-4e2f-9690-bd54d0b3d1ec {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:00:46.406009 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'status': 'completed', 'code': 200} Dec 21 05:00:46.485716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d41ab6b-4112-40f7-ba53-2c0068e44d1f req-4db8f65a-7fa3-499a-8dfe-cad785bbfcb6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:46.487696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d41ab6b-4112-40f7-ba53-2c0068e44d1f req-4db8f65a-7fa3-499a-8dfe-cad785bbfcb6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0569522 Dec 21 05:00:46.496864 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['28f82c96-ab4a-421c-815f-04200e2767ff'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:00:46.544088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-84415f93-cdf6-4664-a946-d394c108f514 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:46.545740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-84415f93-cdf6-4664-a946-d394c108f514 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1137 time: 0.0492356 Dec 21 05:00:46.603055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d41ab6b-4112-40f7-ba53-2c0068e44d1f req-5dd99d28-0fc5-4f27-8f18-e518ec6a03dd tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0915179 Dec 21 05:00:46.676667 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-7a9bcde5-242a-4c0e-ac6b-e180a7154463 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:46.678319 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-7a9bcde5-242a-4c0e-ac6b-e180a7154463 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.1069882 Dec 21 05:00:46.697808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1aa618c3-5f70-4a8e-b18f-75a3dd0d15f2 None None] Provisioning complete for port 28f82c96-ab4a-421c-815f-04200e2767ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:00:46.698747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1aa618c3-5f70-4a8e-b18f-75a3dd0d15f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:46.753405 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-ae88dfde-7fe2-45e4-91f5-0831f4fb09f6 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 1002 time: 0.0635760 Dec 21 05:00:47.127178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-facd943e-3417-4de5-a6c0-314e8cddcb6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:47.128659 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-facd943e-3417-4de5-a6c0-314e8cddcb6a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.3665874 Dec 21 05:00:47.176663 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-6f4b91df-f1e0-4b29-bf69-24585a1b92d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:47.178157 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-6f4b91df-f1e0-4b29-bf69-24585a1b92d8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0401077 Dec 21 05:00:47.296631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-23838dea-a38f-4058-a73c-d0743afa9eef service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907335 Dec 21 05:00:47.387370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6c0567da-1907-47a7-8033-8676a8a43d72 req-8678c751-26ca-4f35-b82b-b65c153d86aa service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809512 Dec 21 05:00:48.873193 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:00:49.940018 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f569e88c-339c-4f6d-a085-44bf0f0ea90e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:52.737517 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a40194a-1309-4f57-8ace-f46bf228acde None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:53.438409 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-7e1c051c-6527-4eb6-a571-9a3372a5a144 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0409458 Dec 21 05:00:53.543120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b19f565-1972-496d-8578-92e400a95067 req-e96aaaf0-0bdb-47ec-9c15-8302aa07d3a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:53.544640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-e96aaaf0-0bdb-47ec-9c15-8302aa07d3a5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1137 time: 0.0459104 Dec 21 05:00:53.554899 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:53.597020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:53.652532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b19f565-1972-496d-8578-92e400a95067 req-17931eef-1f40-4f9d-bc78-5fcacc71b148 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:53.654030 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-17931eef-1f40-4f9d-bc78-5fcacc71b148 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.0858512 Dec 21 05:00:53.728158 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-a38247de-6e9e-4364-a705-c55ce1b5b8ad service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 1002 time: 0.0638692 Dec 21 05:00:53.777601 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b19f565-1972-496d-8578-92e400a95067 req-c01b4b91-b56f-4685-8e78-af9ddf709af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:53.779145 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-c01b4b91-b56f-4685-8e78-af9ddf709af6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0441260 Dec 21 05:00:53.829732 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b19f565-1972-496d-8578-92e400a95067 req-54ea2757-a985-4cd4-b1ca-52cb51d86cd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:53.831276 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-54ea2757-a985-4cd4-b1ca-52cb51d86cd2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403678 Dec 21 05:00:53.925117 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-020563e2-8d74-4abf-acbd-c54ff3ed09e8 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853157 Dec 21 05:00:54.016130 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-6b19f565-1972-496d-8578-92e400a95067 req-281bc87c-3702-4b34-b38e-2fe43a2301ec service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829113 Dec 21 05:00:55.311834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:55.385902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:55.840729 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:00:59.904202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0541086-f696-44ee-abf9-cd46f41c675b req-37e9ea49-9523-4d74-9c96-8fdd6dbeb5ac tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:00:59.982395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0541086-f696-44ee-abf9-cd46f41c675b req-37e9ea49-9523-4d74-9c96-8fdd6dbeb5ac tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0508482 Dec 21 05:00:59.985515 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0541086-f696-44ee-abf9-cd46f41c675b req-ac0457db-3b66-4a4c-a4b2-f187110b04ff tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0729833 Dec 21 05:01:00.007310 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-ed48e9c3-da27-43e6-a10b-f1c17997251f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:00.008821 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-ed48e9c3-da27-43e6-a10b-f1c17997251f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1137 time: 0.0469820 Dec 21 05:01:00.096592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-fd6aabd0-4201-4b41-9895-6e382959e4f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:00.098039 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-fd6aabd0-4201-4b41-9895-6e382959e4f8 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.0820515 Dec 21 05:01:00.168329 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-a268ba1a-8144-40c4-8d1d-ee8c6304a1f9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 1002 time: 0.0615931 Dec 21 05:01:00.216670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-a179472d-10eb-48d4-90fc-08f771051c96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:00.218198 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-a179472d-10eb-48d4-90fc-08f771051c96 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0424550 Dec 21 05:01:00.266069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-e5c8b780-a94a-406f-b4d4-5b2b6d29b239 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:00.268699 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-e5c8b780-a94a-406f-b4d4-5b2b6d29b239 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0426080 Dec 21 05:01:00.362720 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-206892dc-cd95-415f-918f-dbb2f4682d90 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858190 Dec 21 05:01:00.452506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2f6ae49c-0578-4a1f-a33f-7eabb6da4456 req-f05c11c7-35b6-4804-97c0-8cb96e1edd82 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813260 Dec 21 05:01:01.107146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ceb1af1-d2ad-4988-a39e-08dd25eaa69e req-7d85dce6-7539-47a1-8088-7cd2675a118b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:01.108629 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ceb1af1-d2ad-4988-a39e-08dd25eaa69e req-7d85dce6-7539-47a1-8088-7cd2675a118b tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0496426 Dec 21 05:01:01.167416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ceb1af1-d2ad-4988-a39e-08dd25eaa69e req-6acbda9a-2ad9-4c96-8187-9e13cf79255e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0527315 Dec 21 05:01:02.294076 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e736c7-bc7e-4de4-8951-7aa76c329604 req-3a62ff96-332e-4e87-a4a4-129943986522 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:02.295632 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8e736c7-bc7e-4de4-8951-7aa76c329604 req-3a62ff96-332e-4e87-a4a4-129943986522 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0610836 Dec 21 05:01:02.355444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8e736c7-bc7e-4de4-8951-7aa76c329604 req-ec578a31-3adf-453f-9681-d926863dcc43 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0536861 Dec 21 05:01:03.474801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9acabc93-95db-4e66-a334-80b983963538 req-90c87a9c-cbe7-4b26-aac2-9e09190a3535 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:03.476590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9acabc93-95db-4e66-a334-80b983963538 req-90c87a9c-cbe7-4b26-aac2-9e09190a3535 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0522954 Dec 21 05:01:03.536031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9acabc93-95db-4e66-a334-80b983963538 req-7ebfa815-67a5-435c-a6c2-b0d2b742c3a0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0528557 Dec 21 05:01:04.657080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e96200-ae88-43c3-8b3e-85af77c89320 req-a5a62f72-c91b-4fa1-90b7-48a7008d65d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:04.658558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0e96200-ae88-43c3-8b3e-85af77c89320 req-a5a62f72-c91b-4fa1-90b7-48a7008d65d1 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0493090 Dec 21 05:01:04.717296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c0e96200-ae88-43c3-8b3e-85af77c89320 req-a95380a9-80eb-4179-ae03-271cb33d736a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0524595 Dec 21 05:01:05.832419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd99a33-9315-4e0f-a54a-bfb80f09d20b req-65e307d3-895a-43ce-b5ec-e0e25df34509 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:05.833941 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dd99a33-9315-4e0f-a54a-bfb80f09d20b req-65e307d3-895a-43ce-b5ec-e0e25df34509 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0490930 Dec 21 05:01:05.897924 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9dd99a33-9315-4e0f-a54a-bfb80f09d20b req-32af414f-c585-4a48-b06d-99aea8d65583 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0575142 Dec 21 05:01:07.015014 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68fc7fc-6aaf-45de-a817-3646ede330ca req-e20a4beb-d49c-47f3-9f07-c439d9acfc99 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:07.016505 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68fc7fc-6aaf-45de-a817-3646ede330ca req-e20a4beb-d49c-47f3-9f07-c439d9acfc99 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0499134 Dec 21 05:01:07.075507 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f68fc7fc-6aaf-45de-a817-3646ede330ca req-551167cd-6b41-49e5-b886-21ef5182872f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0527699 Dec 21 05:01:08.192450 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa76667-0cd4-4c44-8810-6bd1f73be489 req-7d9c2897-2281-42c6-8671-44d257bfbd80 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:08.193933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fa76667-0cd4-4c44-8810-6bd1f73be489 req-7d9c2897-2281-42c6-8671-44d257bfbd80 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0472953 Dec 21 05:01:08.252943 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fa76667-0cd4-4c44-8810-6bd1f73be489 req-7bb11ca3-2b53-4457-a64e-62d7339b4756 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0530035 Dec 21 05:01:09.370777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783b7195-7f28-4a8f-8c0c-642b85df7b1f req-e7ebfddc-82d9-4967-b805-793480a14ade tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:09.372195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-783b7195-7f28-4a8f-8c0c-642b85df7b1f req-e7ebfddc-82d9-4967-b805-793480a14ade tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0527337 Dec 21 05:01:09.431792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-783b7195-7f28-4a8f-8c0c-642b85df7b1f req-20da58fd-be9c-47dc-832f-2949c866e12f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0534990 Dec 21 05:01:10.551081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e5dd0f-abcc-4d69-8b4c-597f18882809 req-ebd6ed64-8bd9-4266-828d-02e7431fe9e9 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:10.552578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90e5dd0f-abcc-4d69-8b4c-597f18882809 req-ebd6ed64-8bd9-4266-828d-02e7431fe9e9 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0538335 Dec 21 05:01:10.612264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90e5dd0f-abcc-4d69-8b4c-597f18882809 req-1c894e45-a771-4ea0-844e-a8d5e5ad5f62 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0536752 Dec 21 05:01:11.730313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d542ea0-368f-47e2-a011-a0835ee2dbb6 req-429b2fa3-7575-40aa-a573-f0b9f0692764 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:11.731828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d542ea0-368f-47e2-a011-a0835ee2dbb6 req-429b2fa3-7575-40aa-a573-f0b9f0692764 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0529761 Dec 21 05:01:11.790745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d542ea0-368f-47e2-a011-a0835ee2dbb6 req-eeeab06c-7107-476a-9579-aadc7c1d046a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0528169 Dec 21 05:01:12.906125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251ced39-67da-4ba7-bb35-403aeb818783 req-5f44ecc6-b560-40b1-a5b9-8fa61ae7dacc tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:12.907528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-251ced39-67da-4ba7-bb35-403aeb818783 req-5f44ecc6-b560-40b1-a5b9-8fa61ae7dacc tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0481739 Dec 21 05:01:12.966412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-251ced39-67da-4ba7-bb35-403aeb818783 req-1ef21993-945b-488d-89c6-c35e1f573e48 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0528510 Dec 21 05:01:14.079885 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac684bde-aa22-40ce-9784-232000425983 req-e9c66e97-ef45-48a0-8a84-57166f7519f2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:14.081337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac684bde-aa22-40ce-9784-232000425983 req-e9c66e97-ef45-48a0-8a84-57166f7519f2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0477412 Dec 21 05:01:14.143173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac684bde-aa22-40ce-9784-232000425983 req-cf683159-63da-4cff-ab05-e49c81904ebf tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0558362 Dec 21 05:01:15.256803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed1c0ad-e124-4dc6-882a-7fd699edcea5 req-9c608c1d-6328-46da-8380-f09473b339a3 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:15.258292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed1c0ad-e124-4dc6-882a-7fd699edcea5 req-9c608c1d-6328-46da-8380-f09473b339a3 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0496485 Dec 21 05:01:15.318430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed1c0ad-e124-4dc6-882a-7fd699edcea5 req-7d8122fd-2f63-4c94-8a70-3009c76bad4e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0522420 Dec 21 05:01:16.437128 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6ff7f5-9eff-457d-92b2-872c4d21fad4 req-ca773154-792e-4889-86d8-ed79faf40214 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:16.438605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd6ff7f5-9eff-457d-92b2-872c4d21fad4 req-ca773154-792e-4889-86d8-ed79faf40214 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0511491 Dec 21 05:01:16.499833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd6ff7f5-9eff-457d-92b2-872c4d21fad4 req-1cbd597a-5ec0-42f5-b574-f7f0659fbfe9 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0545878 Dec 21 05:01:17.618687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f792bf-57e9-4bb1-9dac-08255ee549cd req-df9f1a94-a46f-4301-9c72-fddd7be56202 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:17.620224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11f792bf-57e9-4bb1-9dac-08255ee549cd req-df9f1a94-a46f-4301-9c72-fddd7be56202 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0522072 Dec 21 05:01:17.679589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-11f792bf-57e9-4bb1-9dac-08255ee549cd req-ac46e48d-575c-4c5a-906c-038afc21290e tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&id=829c0b32-c10b-448d-bf60-30e29b78434b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525153 Dec 21 05:01:19.925367 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9d673fc8-136c-4fd7-a75d-1e05dec0ab24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:22.720012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9adb01e3-0803-4a63-8296-a2a385705df3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:23.548582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:23.645843 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:25.336942 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:25.382897 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:25.799804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:25.872136 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:01:46.563639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-8567e027-ce28-49ba-881e-df0ce2355509 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1616491536&fields=id&tenant_id=681e67c9ff5d464bb22e16bfdba91dd8 HTTP/1.1" status: 200 len: 267 time: 0.0440586 Dec 21 05:01:46.616791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-1ec10419-8c11-4bc2-a202-fb8e7ad833de tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:46.618322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-1ec10419-8c11-4bc2-a202-fb8e7ad833de tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 985 time: 0.0490119 Dec 21 05:01:46.629434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Request body: {'port': {'security_groups': ['253b8954-9125-4930-b54c-ae86fc284949']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:01:46.697225 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:46.871973 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:01:46.900482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:46.956188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.003345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:47.004043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.006047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f0adfbd-c6c8-4ba0-85ab-6d8d9f1775f5 req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "PUT /v2.0/ports/28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 943 time: 0.3810570 Dec 21 05:01:47.006530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:01:47.009300 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-efbf0f15-3a1c-4eea-a73a-287c85e2d859" -d '{"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:01:47.012473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['28f82c96-ab4a-421c-815f-04200e2767ff'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:01:47.042560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event updated for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=7']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:01:47.055269 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:01:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5087bfa-a419-4ea6-9108-de7e7d1991e4 x-openstack-request-id: req-c5087bfa-a419-4ea6-9108-de7e7d1991e4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:01:47.055633 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:01:47.055891 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c5087bfa-a419-4ea6-9108-de7e7d1991e4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:01:47.056316 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'status': 'completed', 'code': 200} Dec 21 05:01:47.057514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51368) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:01:47.057991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.057991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.058332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.058688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.059027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.059359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.060165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.060165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.060656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.061017 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.061367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.061744 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.062087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62751709-ca6e-41c0-91d1-4a7d548026b2 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.145464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['28f82c96-ab4a-421c-815f-04200e2767ff'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:01:47.171809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.188772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-f2fcd161-bcd9-4821-8456-688d8ef5beae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:47.190397 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-f2fcd161-bcd9-4821-8456-688d8ef5beae service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1098 time: 0.0832686 Dec 21 05:01:47.225668 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.309674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4d646781-f781-43a3-a664-de6293a99f9b None None] Provisioning complete for port 28f82c96-ab4a-421c-815f-04200e2767ff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:01:47.309965 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4d646781-f781-43a3-a664-de6293a99f9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.322247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-3050d432-0d21-4be4-9a85-ce448e57e699 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:47.323752 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-3050d432-0d21-4be4-9a85-ce448e57e699 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.1239853 Dec 21 05:01:47.395998 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-880c26f9-f472-4ef1-942a-286a075458dd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 1002 time: 0.0614476 Dec 21 05:01:47.445415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-aa5b6724-71ab-4e2a-be58-62461129aafe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:47.446802 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-aa5b6724-71ab-4e2a-be58-62461129aafe service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0431406 Dec 21 05:01:47.484262 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.486734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.487873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "DELETE /v2.0/security-groups/829c0b32-c10b-448d-bf60-30e29b78434b HTTP/1.1" status: 204 len: 168 time: 0.4293725 Dec 21 05:01:47.491628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51370) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:01:47.499451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=829c0b32-c10b-448d-bf60-30e29b78434b,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:01:47.509717 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.510069 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.510416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.510756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.511139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.512015 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.514644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c467cd8e-c968-4641-928c-c4e445e41bf0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:01:47.525559 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-72b39792-75e4-4b14-8db3-898b195f627a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:47.527218 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-72b39792-75e4-4b14-8db3-898b195f627a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0722706 Dec 21 05:01:47.628533 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-15677ccb-de02-4e71-8adf-69455bd9f727 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929687 Dec 21 05:01:47.654418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Deleting port 42d68af8-85b0-4dde-b30f-c38ccabccdc6 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:01:47.655127 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.731786 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-efbf0f15-3a1c-4eea-a73a-287c85e2d859 req-69439161-bcfd-4707-944c-137ea3f15f0d service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0941672 Dec 21 05:01:47.732856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.733181 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.744734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Calling delete_port for 42d68af8-85b0-4dde-b30f-c38ccabccdc6 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:01:47.959979 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:47.988317 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event deleted for resources: {'Port': ['ID=42d68af8-85b0-4dde-b30f-c38ccabccdc6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:01:48.048464 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:48.052602 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Floating IP 6696e552-1bdf-486c-b76c-04ae57443de2 disassociated (deleted). External IP: 172.25.5.109, port: 28f82c96-ab4a-421c-815f-04200e2767ff. Dec 21 05:01:48.252947 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:01:48.356528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:01:48.361880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:48.366680 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] Sync routers for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:01:48.376619 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:01:48.377215 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:01:48.388556 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c4b0dcb9-ec82-46fd-9a7e-f81cb7dd7e75 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "DELETE /v2.0/floatingips/6696e552-1bdf-486c-b76c-04ae57443de2 HTTP/1.1" status: 204 len: 168 time: 0.8967488 Dec 21 05:01:48.481672 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:01:48.765554 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:01:48.791160 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] Checking router: 5d24adef-3ed6-4dab-92e7-c87f5c1d738b for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:01:48.800026 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:01:48.800630 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:01:48.909547 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:01:49.057267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:01:49.059639 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58" -d '{"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:01:49.099001 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:01:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dde6a7a4-3213-44c7-b0e9-920e8c85b02c x-openstack-request-id: req-dde6a7a4-3213-44c7-b0e9-920e8c85b02c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:01:49.099291 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:01:49.099555 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-dde6a7a4-3213-44c7-b0e9-920e8c85b02c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:01:49.099966 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'status': 'completed', 'code': 200} Dec 21 05:01:49.103995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:01:49.129463 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ee8008a-99ed-4c30-a50c-8dd20a6f304a None None] The sync data for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 is: [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4f8948a0-4f57-462d-b5fc-49e73da31715', 'name': '', 'network_id': 'd5c9a809-6115-4194-a1d9-258aa32ac87f', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'mac_address': 'fa:16:3e:d7:98:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_interface', 'standard_attr_id': 4174, 'fixed_ips': [{'subnet_id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:41Z', 'updated_at': '2021-12-21T04:59:44Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'subnets': [{'id': '3cfc2d61-2a54-421d-842e-875448a9778a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:01:49.196661 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-4a9166c2-4d7c-4854-95d2-7f432fa0b904 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:49.198267 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-4a9166c2-4d7c-4854-95d2-7f432fa0b904 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1098 time: 0.0418327 Dec 21 05:01:49.296017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-04c5502b-f6a2-45d7-8871-dd62ff1389d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:49.297538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-04c5502b-f6a2-45d7-8871-dd62ff1389d4 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.0913005 Dec 21 05:01:49.348015 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-95deaf09-b593-4101-951c-756c2c615223 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 217 time: 0.0367894 Dec 21 05:01:49.354016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea0e70a-e520-4c21-bfa3-87ade3c34887 None None] New status for floating IP 6696e552-1bdf-486c-b76c-04ae57443de2: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:01:49.401216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-4b175479-8f13-4ab6-9d0e-93fe942ba128 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:49.402689 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-4b175479-8f13-4ab6-9d0e-93fe942ba128 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0478594 Dec 21 05:01:49.463384 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-e53b49b5-27ce-4a2c-a2c1-a4cde2a9d61e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:49.464937 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-e53b49b5-27ce-4a2c-a2c1-a4cde2a9d61e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0548882 Dec 21 05:01:49.556778 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-21ed397d-d5d5-4bc3-88ba-13eec7b8d925 service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844686 Dec 21 05:01:49.651334 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-de4e1bd7-5fce-4a68-b41a-81a4d45a8c58 req-3a52c04e-66b6-4493-9c16-c2dbeb03d5aa service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873282 Dec 21 05:01:49.931314 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2f2ffa74-68f7-4ff0-ace5-8c5c6c94d4a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:52.714244 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f4cad2cb-0be0-4c8c-a7b8-02278c3d3eb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:53.561804 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:53.636288 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:54.432497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-8f78ce5c-6019-4023-805d-4821ba45ef30 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0461464 Dec 21 05:01:54.531915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-4774b044-d7b4-40a8-b90b-8215d59bda10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:54.533409 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-4774b044-d7b4-40a8-b90b-8215d59bda10 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 1098 time: 0.0407400 Dec 21 05:01:54.642441 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-cc4fea7b-ce68-4029-9d21-c21ae5e45d0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:54.643960 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-cc4fea7b-ce68-4029-9d21-c21ae5e45d0c service neutron] 10.222.0.54 "GET /v2.0/networks?id=d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 200 len: 915 time: 0.0911489 Dec 21 05:01:54.685559 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-2c3198af-4466-41d2-b599-2e6cdd4110cf service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 200 len: 217 time: 0.0340083 Dec 21 05:01:54.735005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-1e56591d-afc1-49ff-b292-e17ca89859a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:54.736494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-1e56591d-afc1-49ff-b292-e17ca89859a0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 200 len: 853 time: 0.0432830 Dec 21 05:01:54.786723 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-e8a69eca-6843-4865-b05e-0a276ebb8597 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:54.789177 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-e8a69eca-6843-4865-b05e-0a276ebb8597 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d5c9a809-6115-4194-a1d9-258aa32ac87f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0453658 Dec 21 05:01:54.882857 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-ad0b7e77-7049-4827-96f4-74449735d46b service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863459 Dec 21 05:01:54.975422 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-bc504cdd-ce24-4b96-9f9c-fcb98761a771 req-cdde3850-7707-4ee2-aaf4-13b3c07fd10d service neutron] 10.222.0.54 "GET /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849969 Dec 21 05:01:55.304252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:55.422445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:55.807060 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:57.901371 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142cc352-3d93-409e-9310-79622e5619fe req-f81395a2-94fa-4e9e-8dc4-98bd176d661a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:57.902865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-142cc352-3d93-409e-9310-79622e5619fe req-f81395a2-94fa-4e9e-8dc4-98bd176d661a tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0501580 Dec 21 05:01:57.949688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-142cc352-3d93-409e-9310-79622e5619fe req-f1211499-fa51-46ed-84c9-50cacced4c82 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400414 Dec 21 05:01:59.069385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074c2957-6fa5-405b-b991-50d3d291cc09 req-4ac32592-fddf-4058-a948-f6668cee1388 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:59.070861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-074c2957-6fa5-405b-b991-50d3d291cc09 req-4ac32592-fddf-4058-a948-f6668cee1388 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0513284 Dec 21 05:01:59.117093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-074c2957-6fa5-405b-b991-50d3d291cc09 req-c5710fb1-4f84-46cf-a14b-5905eeee2329 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/security-groups?id=253b8954-9125-4930-b54c-ae86fc284949&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403948 Dec 21 05:01:59.669956 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-8f953614-1d50-474a-a3c5-1307e70c66e0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:01:59.671497 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-8f953614-1d50-474a-a3c5-1307e70c66e0 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.54 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 946 time: 0.0483379 Dec 21 05:01:59.761323 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Deleting port 28f82c96-ab4a-421c-815f-04200e2767ff {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:01:59.761669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:59.847961 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] For port 28f82c96-ab4a-421c-815f-04200e2767ff, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=28f82c96-ab4a-421c-815f-04200e2767ff,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:01:59.848317 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:01:59.860341 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Calling delete_port for 28f82c96-ab4a-421c-815f-04200e2767ff owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:00.047241 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:00.074993 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Pushing event deleted for resources: {'Port': ['ID=28f82c96-ab4a-421c-815f-04200e2767ff,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:00.081799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['28f82c96-ab4a-421c-815f-04200e2767ff'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:02:00.118322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] No DVR routers for this DVR port 28f82c96-ab4a-421c-815f-04200e2767ff on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:02:00.120967 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:00.124499 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-83e7584b-7ec1-40cd-85fa-a840ea2d0ea7 req-4a8193a9-76c3-4f17-a47c-4de9e3f2dc6f tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.54 "DELETE /v2.0/ports/28f82c96-ab4a-421c-815f-04200e2767ff HTTP/1.1" status: 204 len: 173 time: 0.4473176 Dec 21 05:02:00.124933 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'name': 'network-vif-deleted', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:02:00.127959 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5cd134e-0b33-4905-84a6-54c82704d81a" -d '{"events": [{"server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "name": "network-vif-deleted", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:02:00.163281 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:02:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b122270-274f-46a6-bd2f-9b1ff1c2df08 x-openstack-request-id: req-1b122270-274f-46a6-bd2f-9b1ff1c2df08 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:02:00.163584 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "618d6a0f-0e31-467f-aad7-b832e4d340c6", "name": "network-vif-deleted", "tag": "28f82c96-ab4a-421c-815f-04200e2767ff", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:02:00.163840 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-1b122270-274f-46a6-bd2f-9b1ff1c2df08 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:02:00.164299 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '618d6a0f-0e31-467f-aad7-b832e4d340c6', 'name': 'network-vif-deleted', 'tag': '28f82c96-ab4a-421c-815f-04200e2767ff', 'status': 'completed', 'code': 200} Dec 21 05:02:00.210212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c743672-0153-4979-a30a-528bd4a7c2cc req-00d898c5-fb13-468a-9a83-23b9a43846c6 tempest-TestMinimumBasicScenario-2064464517 tempest-TestMinimumBasicScenario-2064464517-project] 10.222.0.18 "GET /v2.0/ports?device_id=618d6a0f-0e31-467f-aad7-b832e4d340c6 HTTP/1.1" status: 200 len: 210 time: 0.0261650 Dec 21 05:02:02.345962 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51468) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:02.871526 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:02:03.035925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:03.080241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 28f82c96-ab4a-421c-815f-04200e2767ff no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:03.103953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 28f82c96-ab4a-421c-815f-04200e2767ff {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:03.104296 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 28f82c96-ab4a-421c-815f-04200e2767ff not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:03.279435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Deleting port 4f8948a0-4f57-462d-b5fc-49e73da31715 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:03.279771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:03.356027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] For port 4f8948a0-4f57-462d-b5fc-49e73da31715, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4f8948a0-4f57-462d-b5fc-49e73da31715,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:03.356981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:03.371080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Calling delete_port for 4f8948a0-4f57-462d-b5fc-49e73da31715 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:03.618740 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:03.642408 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Pushing event deleted for resources: {'Port': ['ID=4f8948a0-4f57-462d-b5fc-49e73da31715,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:03.813676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.034798 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:02:04.137837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:02:04.143451 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d4fa8056-6d2e-4ac4-b2b2-30de8d9f7170 admin admin] 10.222.0.18 "PUT /v2.0/routers/5d24adef-3ed6-4dab-92e7-c87f5c1d738b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7964096 Dec 21 05:02:04.146135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51470) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:04.147425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] Sync routers for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:02:04.156709 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:04.157872 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:04.248650 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.260028 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:04.350854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.433958 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63'}], 'enable_snat': True}, 'gw_port_id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T05:02:03Z', 'revision_number': 5, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port': {'id': 'd0975c49-305e-443e-b8ee-45876cca0ad9', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:64:82:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:39Z', 'updated_at': '2021-12-21T04:59:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:04.460840 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] Checking router: 5d24adef-3ed6-4dab-92e7-c87f5c1d738b for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:02:04.469249 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] Routers {'5d24adef-3ed6-4dab-92e7-c87f5c1d738b'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:04.469720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Deleting port d0975c49-305e-443e-b8ee-45876cca0ad9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:04.469900 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:04.470066 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.548146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] For port d0975c49-305e-443e-b8ee-45876cca0ad9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d0975c49-305e-443e-b8ee-45876cca0ad9,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:04.548524 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.553617 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] Set router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:04.560681 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Calling delete_port for d0975c49-305e-443e-b8ee-45876cca0ad9 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:04.604110 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T05:02:04Z', 'revision_number': 6, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:04.634787 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c210bac7-4925-4579-83cf-6fa755a81c33 None None] The sync data for ids ['5d24adef-3ed6-4dab-92e7-c87f5c1d738b'] in n-d-822053-11 is: [{'id': '5d24adef-3ed6-4dab-92e7-c87f5c1d738b', 'name': 'tempest-TestMinimumBasicScenario-588383305-router', 'tenant_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:38Z', 'updated_at': '2021-12-21T05:02:04Z', 'revision_number': 6, 'project_id': '681e67c9ff5d464bb22e16bfdba91dd8', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:02:04.782710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.812756 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Pushing event deleted for resources: {'Port': ['ID=d0975c49-305e-443e-b8ee-45876cca0ad9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:04.826472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cea7a60-b37d-433b-a922-9ba6c73ef8e7 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:04.875973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.966086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:04.968347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.075881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.076409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5d24adef-3ed6-4dab-92e7-c87f5c1d738b {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:02:05.081363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.082640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d0bd6bbc-8bd5-47ca-8e2c-d3db2c60fced admin admin] 10.222.0.18 "DELETE /v2.0/routers/5d24adef-3ed6-4dab-92e7-c87f5c1d738b HTTP/1.1" status: 204 len: 168 time: 0.9355078 Dec 21 05:02:05.085247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51472) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:05.129525 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Deleting subnet 3cfc2d61-2a54-421d-842e-875448a9778a {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:02:05.132591 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.170729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.251209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.362907 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.389314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3cfc2d61-2a54-421d-842e-875448a9778a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:05.394724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.398092 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8406abe6-819a-41b8-8160-4c3e7e65206e admin admin] 10.222.0.18 "DELETE /v2.0/subnets/3cfc2d61-2a54-421d-842e-875448a9778a HTTP/1.1" status: 204 len: 168 time: 0.3118935 Dec 21 05:02:05.401230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf62d4b8-cf40-4d23-bcb9-e49f3d202ad6 None None] Network d5c9a809-6115-4194-a1d9-258aa32ac87f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:02:05.401403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51474) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:05.417790 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d0975c49-305e-443e-b8ee-45876cca0ad9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:05.446400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d0975c49-305e-443e-b8ee-45876cca0ad9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:05.446748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d0975c49-305e-443e-b8ee-45876cca0ad9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:05.447193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4f8948a0-4f57-462d-b5fc-49e73da31715 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:05.479336 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.495859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4f8948a0-4f57-462d-b5fc-49e73da31715 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:05.496215 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4f8948a0-4f57-462d-b5fc-49e73da31715 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:05.535819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Deleting port 6c8b3462-356a-4734-9ecf-7200fb3172d8 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:05.536138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.599578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] DHCP port deletion for d5c9a809-6115-4194-a1d9-258aa32ac87f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:05.608498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] For port 6c8b3462-356a-4734-9ecf-7200fb3172d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6c8b3462-356a-4734-9ecf-7200fb3172d8,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:05.608816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.623636 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Calling delete_port for 6c8b3462-356a-4734-9ecf-7200fb3172d8 owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:05.649226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Deleting port 6c8b3462-356a-4734-9ecf-7200fb3172d8 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:05.649631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.718242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] For port 6c8b3462-356a-4734-9ecf-7200fb3172d8, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6c8b3462-356a-4734-9ecf-7200fb3172d8,segment=NetworkSegment(171c2697-66fb-4ffa-9a66-539614ac1012),segment_id=171c2697-66fb-4ffa-9a66-539614ac1012)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:05.718644 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.731227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Calling delete_port for 6c8b3462-356a-4734-9ecf-7200fb3172d8 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:05.776806 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.802706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Pushing event deleted for resources: {'Port': ['ID=6c8b3462-356a-4734-9ecf-7200fb3172d8,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:05.806393 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] No DVR routers for this DVR port 6c8b3462-356a-4734-9ecf-7200fb3172d8 on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:02:05.808304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.837123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] No DVR routers for this DVR port 6c8b3462-356a-4734-9ecf-7200fb3172d8 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:02:05.839340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Pushing event deleted for resources: {'Port': ['ID=6c8b3462-356a-4734-9ecf-7200fb3172d8,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:05.852810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.852810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.853490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.853846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.854187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.854524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.854859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.855237 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.855544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.855878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.856206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.856654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.856986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08ff081-74db-4262-84aa-fed105b560c7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:05.886259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.906643 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d5c9a809-6115-4194-a1d9-258aa32ac87f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:05.915876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '171c2697-66fb-4ffa-9a66-539614ac1012') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:05.916178 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '171c2697-66fb-4ffa-9a66-539614ac1012') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:05.925461 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.938996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.944878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:02:05.945239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:02:05.946867 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:02:06.065062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:06.069680 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:06.073291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] 10.222.0.18 "DELETE /v2.0/networks/d5c9a809-6115-4194-a1d9-258aa32ac87f HTTP/1.1" status: 204 len: 168 time: 0.6711533 Dec 21 05:02:06.076260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51476) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:06.085796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75b2ab6-bb62-4ec0-9b7c-203249d976f9 admin admin] Pushing event deleted for resources: {'Network': ['ID=d5c9a809-6115-4194-a1d9-258aa32ac87f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:06.412955 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:06.655943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Deleting port aaeb205a-b602-42fa-936f-20bcfd7d3ad9 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:06.656287 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:06.732245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] For port aaeb205a-b602-42fa-936f-20bcfd7d3ad9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:06.732522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:06.744546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Calling delete_port for aaeb205a-b602-42fa-936f-20bcfd7d3ad9 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:06.961426 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:06.985941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Pushing event deleted for resources: {'Port': ['ID=aaeb205a-b602-42fa-936f-20bcfd7d3ad9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:07.244990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6c8b3462-356a-4734-9ecf-7200fb3172d8 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:07.270806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6c8b3462-356a-4734-9ecf-7200fb3172d8 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:07.271195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6c8b3462-356a-4734-9ecf-7200fb3172d8 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:07.459008 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:07.673840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Router 3c97bf2c-fafb-4739-9847-0e090ab1444c has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:02:07.776025 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:02:07.783941 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-09a3af2f-eb6f-4632-9ca2-579158235519 admin admin] 10.222.0.18 "PUT /v2.0/routers/3c97bf2c-fafb-4739-9847-0e090ab1444c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7035844 Dec 21 05:02:07.783941 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51478) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:07.785773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] Sync routers for ids ['3c97bf2c-fafb-4739-9847-0e090ab1444c'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:02:07.796723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] Routers {'3c97bf2c-fafb-4739-9847-0e090ab1444c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:07.797369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c97bf2c-fafb-4739-9847-0e090ab1444c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:07.888707 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:07.904114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] Set router 3c97bf2c-fafb-4739-9847-0e090ab1444c gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:07.989334 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.079350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249'}], 'enable_snat': True}, 'gw_port_id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T05:02:06Z', 'revision_number': 5, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port': {'id': '465e55d2-31e5-427d-b171-32bf5cde2472', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:83:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T04:59:45Z', 'updated_at': '2021-12-21T04:59:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:08.096871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Deleting port 465e55d2-31e5-427d-b171-32bf5cde2472 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:08.097217 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.106183 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] Checking router: 3c97bf2c-fafb-4739-9847-0e090ab1444c for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:02:08.115005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] Routers {'3c97bf2c-fafb-4739-9847-0e090ab1444c'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:08.115618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3c97bf2c-fafb-4739-9847-0e090ab1444c'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:08.174699 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] For port 465e55d2-31e5-427d-b171-32bf5cde2472, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=465e55d2-31e5-427d-b171-32bf5cde2472,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:08.175089 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.189260 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Calling delete_port for 465e55d2-31e5-427d-b171-32bf5cde2472 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:08.203405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] Set router 3c97bf2c-fafb-4739-9847-0e090ab1444c gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:08.257393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T05:02:07Z', 'revision_number': 6, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:08.283760 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed024c8-d58d-4c09-868f-52451f371e74 None None] The sync data for ids ['3c97bf2c-fafb-4739-9847-0e090ab1444c'] in n-d-822053-11 is: [{'id': '3c97bf2c-fafb-4739-9847-0e090ab1444c', 'name': 'tempest-TestMinimumBasicScenario-1121074967-router', 'tenant_id': '0fedbaf394ae4e48a93861dac9fcd986', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T04:59:44Z', 'updated_at': '2021-12-21T05:02:07Z', 'revision_number': 6, 'project_id': '0fedbaf394ae4e48a93861dac9fcd986', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:02:08.435837 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.460317 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Pushing event deleted for resources: {'Port': ['ID=465e55d2-31e5-427d-b171-32bf5cde2472,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:08.477021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09bbebc5-1b65-40e7-872e-f99589cc3ffb None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:08.531945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.623662 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.625922 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.716355 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.717147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3c97bf2c-fafb-4739-9847-0e090ab1444c {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:02:08.721887 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.723401 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5640e02e-312e-452d-b346-dfe040a4ca48 admin admin] 10.222.0.18 "DELETE /v2.0/routers/3c97bf2c-fafb-4739-9847-0e090ab1444c HTTP/1.1" status: 204 len: 168 time: 0.9390476 Dec 21 05:02:08.725918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51480) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:08.772004 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Deleting subnet e6c500ed-ddca-42eb-9fd9-60a27f9cdefc {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:02:08.775201 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.813123 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:08.890166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.030453 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.056670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e6c500ed-ddca-42eb-9fd9-60a27f9cdefc,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:09.061786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.066034 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-55298b7c-78ac-4631-a3fa-8aa702674f8b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/e6c500ed-ddca-42eb-9fd9-60a27f9cdefc HTTP/1.1" status: 204 len: 168 time: 0.3388155 Dec 21 05:02:09.068799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51482) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:09.069280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e53ff34c-1191-49b3-a3c5-79581933fd96 None None] Network f0fd2ac8-9110-4931-8fb6-89e6d58075dd requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:02:09.140118 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.192532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aaeb205a-b602-42fa-936f-20bcfd7d3ad9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:09.201649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Deleting port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:09.202382 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.217468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: aaeb205a-b602-42fa-936f-20bcfd7d3ad9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:09.218103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device aaeb205a-b602-42fa-936f-20bcfd7d3ad9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:09.218731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 465e55d2-31e5-427d-b171-32bf5cde2472 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:09.239889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] DHCP port deletion for f0fd2ac8-9110-4931-8fb6-89e6d58075dd request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:09.241950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 465e55d2-31e5-427d-b171-32bf5cde2472 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:09.242297 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 465e55d2-31e5-427d-b171-32bf5cde2472 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:09.280294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] For port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:09.280715 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.290621 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] Deleting port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:02:09.291185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.293675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Calling delete_port for 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:09.353586 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] For port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,segment=NetworkSegment(3b413b91-3c50-4639-81fe-609be14e54a3),segment_id=3b413b91-3c50-4639-81fe-609be14e54a3)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:09.353938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.367722 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] Calling delete_port for 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:02:09.436027 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.445841 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.465860 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Pushing event deleted for resources: {'Port': ['ID=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:09.467966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] Pushing event deleted for resources: {'Port': ['ID=4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:09.470011 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] No DVR routers for this DVR port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:02:09.473808 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fad9c23a-dcd8-4929-a59e-d10b67d4fd18 None None] No DVR routers for this DVR port 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:02:09.542232 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.561955 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f0fd2ac8-9110-4931-8fb6-89e6d58075dd']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:09.570895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3b413b91-3c50-4639-81fe-609be14e54a3') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:09.571227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3b413b91-3c50-4639-81fe-609be14e54a3') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:09.584376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.597599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.604214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Releasing vlan 147 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:02:09.604614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:02:09.608025 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:02:09.704107 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.709644 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:09.712871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] 10.222.0.18 "DELETE /v2.0/networks/f0fd2ac8-9110-4931-8fb6-89e6d58075dd HTTP/1.1" status: 204 len: 168 time: 0.6430502 Dec 21 05:02:09.724326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f76bb96-e4ce-4b33-a95c-0398d3a626b4 admin admin] Pushing event deleted for resources: {'Network': ['ID=f0fd2ac8-9110-4931-8fb6-89e6d58075dd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:10.027001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51486) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:10.069819 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-74b1eff0-7e62-4327-bbab-bd4832240ee7 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=681e67c9ff5d464bb22e16bfdba91dd8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0416706 Dec 21 05:02:10.077005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51488) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:10.123446 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8764fa0-97f7-4257-aaa7-991ea7eee11f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:10.144187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8764fa0-97f7-4257-aaa7-991ea7eee11f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:10.247248 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8764fa0-97f7-4257-aaa7-991ea7eee11f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:10.249936 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e8764fa0-97f7-4257-aaa7-991ea7eee11f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:10.251658 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e8764fa0-97f7-4257-aaa7-991ea7eee11f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/253b8954-9125-4930-b54c-ae86fc284949 HTTP/1.1" status: 204 len: 168 time: 0.1737771 Dec 21 05:02:10.259363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8764fa0-97f7-4257-aaa7-991ea7eee11f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=253b8954-9125-4930-b54c-ae86fc284949,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:10.826295 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51494) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:10.864878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-30cf7de6-1a96-4d4b-9082-81422593e4f1 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=0fedbaf394ae4e48a93861dac9fcd986&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0374296 Dec 21 05:02:10.867347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51496) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:10.915211 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-036e557b-58ff-4d2f-8654-a0f34ffeeee8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:10.936035 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-036e557b-58ff-4d2f-8654-a0f34ffeeee8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:11.081171 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-036e557b-58ff-4d2f-8654-a0f34ffeeee8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:11.083948 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-036e557b-58ff-4d2f-8654-a0f34ffeeee8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:11.085147 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-036e557b-58ff-4d2f-8654-a0f34ffeeee8 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/c656d271-949c-4c81-9059-deded100231a HTTP/1.1" status: 204 len: 168 time: 0.2168548 Dec 21 05:02:11.092690 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036e557b-58ff-4d2f-8654-a0f34ffeeee8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c656d271-949c-4c81-9059-deded100231a,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:11.188324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:02:11.207370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:02:11.207720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4df77cbf-67bb-4e3f-aad1-6f1dfb4e44cc not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:02:14.304638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51538) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:14.309219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1250473768', 'description': 'tempest-secgroup-smoke-1250473768 description', 'project_id': '7037c5e415f34eb2b218d59f1243d003'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:14.378443 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.386207 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.457925 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.504192 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.542760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5566c4b-fac5-4b4f-a5a1-a08f2fd39b77,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:14.579823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.664127 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.692927 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ece4b4a6-c46a-48a4-b0fc-78d1231ab855,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:14.757698 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.758958 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-38772340-40e5-4c1f-abc9-524d42061fad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4532824 Dec 21 05:02:14.761826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51540) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:14.766347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': 'ece4b4a6-c46a-48a4-b0fc-78d1231ab855', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:14.845987 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.899873 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.955575 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:14.982799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b99f2862-c684-44a8-8b24-aee21c49c268,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:15.026209 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.027439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-80a80fa9-8b26-46e0-a53b-e6f312e184af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2646651 Dec 21 05:02:15.030062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:15.035053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': 'ece4b4a6-c46a-48a4-b0fc-78d1231ab855', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:15.108944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.163763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.212794 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.230637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6a2d03d4-58fb-498a-8a65-6ef765f4cb0b,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:15.284070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.285275 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77947fd3-f96b-4162-a367-a9d4c14bcc40 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2542639 Dec 21 05:02:15.288029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51544) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:15.292350 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': 'ece4b4a6-c46a-48a4-b0fc-78d1231ab855', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:15.382051 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.438576 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.486588 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.504251 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c2066e0c-2929-404f-a4c1-1803fc36dd60,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:15.555876 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.557089 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cffd190c-9c03-49c0-97fd-984f31bf3638 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2681437 Dec 21 05:02:15.559818 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51546) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:15.564615 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': 'ece4b4a6-c46a-48a4-b0fc-78d1231ab855', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:15.650235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.706399 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.765090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.784891 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f68cf9f3-a79d-45e2-b9a4-1f12bf59a691,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:15.841390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.842589 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0cfd9325-7240-4328-91fe-03ecfe253d94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2818601 Dec 21 05:02:15.845340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51548) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:15.849571 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': 'ece4b4a6-c46a-48a4-b0fc-78d1231ab855', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:15.925662 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:02:15.931651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:15.989338 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.058236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.077416 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=65877917-0e53-4199-9868-fdd301b7e273,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:16.140510 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.141884 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a453262f-bf10-497a-9b10-2054953039e7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2956333 Dec 21 05:02:16.144796 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51550) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:16.149558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': 'ece4b4a6-c46a-48a4-b0fc-78d1231ab855', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:16.229609 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:02:16.234362 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.291858 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.353555 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.371501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0337cfb7-f22f-4dda-b203-9ab5ed4db508,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:16.437146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.438514 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bb632c37-b0f2-4769-a35a-07eb32b80601 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2925811 Dec 21 05:02:16.441455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51552) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:16.446231 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'network': {'name': 'tempest-network-smoke--1850251132', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:16.526926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:02:16.530409 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.554182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:02:16.562623 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.562986 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Added segment 7c30338c-a326-46e8-b06e-79fd17163058 of type vlan for network b31abc0b-3587-4d7d-924c-d10c8a3f7dad Dec 21 05:02:16.605996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.704452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.710141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:16.710717 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.774158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Network': ['ID=b31abc0b-3587-4d7d-924c-d10c8a3f7dad,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:16.785355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:02:16.821073 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4775a551-9f8f-46c5-a9b2-31f9c7d730fa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.3786101 Dec 21 05:02:16.823996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51554) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:16.828342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'admin_state_up': True, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:16.904373 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.905445 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:16.959369 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.153745 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.399489 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.418111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.516784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.187 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/26497f35-2546-4587-8859-68985e27d356) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:02:17.619058 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.722787 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.771165 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:02:17.774343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:17.777485 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:02:17.790644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fb61732-ba4d-488d-a872-f54126a49684 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:17.813772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=26497f35-2546-4587-8859-68985e27d356,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:17.894639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9cadfbe3-27de-42c9-a284-625d608653df None None] Provisioning complete for port 26497f35-2546-4587-8859-68985e27d356 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:17.895041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9cadfbe3-27de-42c9-a284-625d608653df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:17.931192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9cadfbe3-27de-42c9-a284-625d608653df None None] Port 26497f35-2546-4587-8859-68985e27d356 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:02:18.117082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:18.612074 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:18.835543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 6b9c3642-c9d3-4da7-9647-f789f543630f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:02:18.944059 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:02:18.953308 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Sync routers for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:02:18.962774 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:18.968927 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:19.020688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.021962 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7c94bebc-3bf4-4462-901e-0a6ee4d209e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 2.1970086 Dec 21 05:02:19.025129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51556) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:19.066776 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:19.152964 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3fa4b5dc-ccb7-421a-a4db-13c6e93546ae tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=7037c5e415f34eb2b218d59f1243d003&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1260407 Dec 21 05:02:19.155653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51560) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:19.311398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d7d73d6-186a-4ed5-8533-8608963f3311 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:19.312819 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8d7d73d6-186a-4ed5-8533-8608963f3311 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1561847 Dec 21 05:02:19.315569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51562) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:19.331425 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:17Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:19.362832 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Checking router: 6b9c3642-c9d3-4da7-9647-f789f543630f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:02:19.363177 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Updating router 6b9c3642-c9d3-4da7-9647-f789f543630f port 26497f35-2546-4587-8859-68985e27d356 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:02:19.373762 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38a697c9-87d1-4110-9d69-869d56fa4ab0 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0571437 Dec 21 05:02:19.376455 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51564) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:19.381127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-491255734', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:19.387090 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.526823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:02:19.530573 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.626528 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.675743 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.727122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-396c6a7d-9902-479f-bf1c-9516728ffe6c None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:19.732434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Attempting to bind port 26497f35-2546-4587-8859-68985e27d356 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:02:19.734072 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Attempting to bind port 26497f35-2546-4587-8859-68985e27d356 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:02:19.734072 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Attempting to bind port 26497f35-2546-4587-8859-68985e27d356 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:02:19.735230 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Pushing event updated for resources: {'Port': ['ID=26497f35-2546-4587-8859-68985e27d356,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:19.744667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.745016 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.745357 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.745696 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.746039 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.746363 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.746689 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.747034 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.751434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.751434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.751434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.751434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.751434 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:02:19.751929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 1, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:02:19.752076 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:02:19.752455 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.752840 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:02:19.753306 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Bound port: 26497f35-2546-4587-8859-68985e27d356, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:02:19.753679 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.765433 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e22e1d66-b499-4176-8016-125da5926183 None None] Provisioning complete for port 26497f35-2546-4587-8859-68985e27d356 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:19.766103 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e22e1d66-b499-4176-8016-125da5926183 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.778169 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.807464 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] For port 26497f35-2546-4587-8859-68985e27d356, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:02:19.812146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e22e1d66-b499-4176-8016-125da5926183 None None] Port 26497f35-2546-4587-8859-68985e27d356 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:02:19.812352 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] For port 26497f35-2546-4587-8859-68985e27d356, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=26497f35-2546-4587-8859-68985e27d356,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:02:19.856165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Subnet': ['ID=7b9d3b95-8eed-4d78-b371-f9e95f352a79,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:19.865075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Checking segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:02:19.865390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network hostable DHCP agents. Network: b31abc0b-3587-4d7d-924c-d10c8a3f7dad, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:02:19.870431 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.911111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-977b3ae7-8231-4fee-ab26-34b7914148bd None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:02:19.922044 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:19.922162 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:19.935390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07e9ef8a-4f0d-4a67-af36-3c859bbb04d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.941657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-968f45f2-1998-4a12-b04a-481ac12b4230 None None] Provisioning complete for port 26497f35-2546-4587-8859-68985e27d356 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:19.946304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-968f45f2-1998-4a12-b04a-481ac12b4230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:19.965745 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b5046e-8597-4c6e-86d6-e73599853dc1 None None] Pushing event updated for resources: {'Port': ['ID=26497f35-2546-4587-8859-68985e27d356,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:20.011243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:02:20.023727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-968f45f2-1998-4a12-b04a-481ac12b4230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.034880 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:20.043289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-968f45f2-1998-4a12-b04a-481ac12b4230 None None] For port 26497f35-2546-4587-8859-68985e27d356, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=26497f35-2546-4587-8859-68985e27d356,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:20.098469 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, b31abc0b-3587-4d7d-924c-d10c8a3f7dad) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:20.103033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:20.107696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.107967 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-412a1425-2c8d-43b9-9950-9f347250647e None None] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:02:20.130139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-968f45f2-1998-4a12-b04a-481ac12b4230 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.196778 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51566) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:20.197731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-0caa0482-f43d-49ef-bfd2-08ee351dab1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.8194911 Dec 21 05:02:20.223561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968f45f2-1998-4a12-b04a-481ac12b4230 None None] Pushing event updated for resources: {'Port': ['ID=26497f35-2546-4587-8859-68985e27d356,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:20.229498 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:17Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:20.253530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:02:20.253762 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da27d836-c01b-4112-b0ba-bfdced1d2a36 None None] The sync data for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 is: [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:17Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:02:20.254400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.396075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Allocated IP 172.20.0.2 (b31abc0b-3587-4d7d-924c-d10c8a3f7dad/7b9d3b95-8eed-4d78-b371-f9e95f352a79/d55e2bd2-55f9-4600-9d0d-9b9f46acca87) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:02:20.563920 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.647356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.695908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:02:20.699048 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:20.703600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:02:20.705699 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.706853 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Pushing event updated for resources: {'Port': ['ID=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:20.924637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Attempting to bind port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:02:20.925220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Attempting to bind port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:02:20.925220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Attempting to bind port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 on network b31abc0b-3587-4d7d-924c-d10c8a3f7dad {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:02:20.930713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 1, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:02:20.931168 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Checking segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:02:20.931570 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:20.932837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Bound using segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:02:20.932837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Bound port: d55e2bd2-55f9-4600-9d0d-9b9f46acca87, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:02:20.932837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.001100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] For port d55e2bd2-55f9-4600-9d0d-9b9f46acca87, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:02:21.004364 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] For port d55e2bd2-55f9-4600-9d0d-9b9f46acca87, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:02:21.020361 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.1 (b31abc0b-3587-4d7d-924c-d10c8a3f7dad/7b9d3b95-8eed-4d78-b371-f9e95f352a79/039b623b-ec76-451a-bf19-63e9f3a1544f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:02:21.081750 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.146498 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.146719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdf9f18-b57b-4bf2-ac10-e1c1c1fc9756 None None] Pushing event updated for resources: {'Port': ['ID=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:21.240228 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 26497f35-2546-4587-8859-68985e27d356 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:02:21.243743 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.289333 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:02:21.292386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:21.296747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:02:21.305029 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 26497f35-2546-4587-8859-68985e27d356 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:21.308887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.361734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=039b623b-ec76-451a-bf19-63e9f3a1544f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:21.372064 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.546621 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.823514 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.873966 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:21.949816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=039b623b-ec76-451a-bf19-63e9f3a1544f,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:21.952371 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:22.043539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:02:22.044918 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:22.158826 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 6b9c3642-c9d3-4da7-9647-f789f543630f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:02:22.271070 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:02:22.281594 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ec255d95-52f9-4525-ac05-0831ef185f9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/6b9c3642-c9d3-4da7-9647-f789f543630f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0782831 Dec 21 05:02:22.286226 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Sync routers for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:02:22.299373 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:22.299942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:01:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:22.429107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:22.442548 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-2d63dee4-bcd1-4ecf-8013-06cb90caa59d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1250473768&fields=id&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 267 time: 0.0540664 Dec 21 05:02:22.550411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-dbd33650-5795-43a7-b4c3-eb9afb27c02a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:22.555405 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-dbd33650-5795-43a7-b4c3-eb9afb27c02a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/networks?id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad HTTP/1.1" status: 200 len: 797 time: 0.1119823 Dec 21 05:02:22.566827 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbe34fd7-0a20-4430-bd97-54b1bbf247a4 None None] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:02:22.567565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-8ef9d56c-6de1-40bf-bab4-1f924b530e24 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/quotas/7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 375 time: 0.0097628 Dec 21 05:02:22.626908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6a75644c-e971-464a-8bc4-401df7e8142b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0536208 Dec 21 05:02:22.662582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b24104c4-7428-4575-8132-69fbdc0efe00 None None] Provisioning complete for port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:22.662976 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b24104c4-7428-4575-8132-69fbdc0efe00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:22.768565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-c09f30f6-0124-48f4-af22-48e2d8c47479 service neutron] 10.222.0.18 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1290691 Dec 21 05:02:22.770301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9f4d5dea-010a-4846-a0c0-7738bf2cb9af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:22.831090 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 2, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:22.833433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b24104c4-7428-4575-8132-69fbdc0efe00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:22.871760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-3ef368d3-95e7-4118-9167-0e136b701c62 service neutron] 10.222.0.18 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0970669 Dec 21 05:02:22.872006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Checking router: 6b9c3642-c9d3-4da7-9647-f789f543630f for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:02:22.872202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Updating router 6b9c3642-c9d3-4da7-9647-f789f543630f port 039b623b-ec76-451a-bf19-63e9f3a1544f binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:02:22.915049 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:22.927180 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b24104c4-7428-4575-8132-69fbdc0efe00 None None] For port d55e2bd2-55f9-4600-9d0d-9b9f46acca87, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:23.019795 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b24104c4-7428-4575-8132-69fbdc0efe00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.102437 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24104c4-7428-4575-8132-69fbdc0efe00 None None] Pushing event updated for resources: {'Port': ['ID=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:23.159880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27ef7e18-1a4a-447a-b8b7-3d4c50103419 None None] Provisioning complete for port 039b623b-ec76-451a-bf19-63e9f3a1544f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:23.160294 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27ef7e18-1a4a-447a-b8b7-3d4c50103419 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.220192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-27ef7e18-1a4a-447a-b8b7-3d4c50103419 None None] Port 039b623b-ec76-451a-bf19-63e9f3a1544f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:02:23.237140 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d55e2bd2-55f9-4600-9d0d-9b9f46acca87 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:02:23.303870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-27ef7e18-1a4a-447a-b8b7-3d4c50103419 None None] Provisioning complete for port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:23.304513 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27ef7e18-1a4a-447a-b8b7-3d4c50103419 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.348198 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.377097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:23.377472 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.434479 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.511777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7ac932-92ef-4cf9-ae7f-5e894b7c490b None None] Pushing event updated for resources: {'Port': ['ID=039b623b-ec76-451a-bf19-63e9f3a1544f,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:23.568287 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.614355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Attempting to bind port 039b623b-ec76-451a-bf19-63e9f3a1544f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:02:23.614736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Attempting to bind port 039b623b-ec76-451a-bf19-63e9f3a1544f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:02:23.615134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Attempting to bind port 039b623b-ec76-451a-bf19-63e9f3a1544f on network b31abc0b-3587-4d7d-924c-d10c8a3f7dad {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:02:23.623464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8c8bf76e-7d29-424c-b42f-362afab113b7 None None] Provisioning complete for port 039b623b-ec76-451a-bf19-63e9f3a1544f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8c8bf76e-7d29-424c-b42f-362afab113b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 1, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Checking segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Bound using segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Bound port: 039b623b-ec76-451a-bf19-63e9f3a1544f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:02:23.629193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.693123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.695372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8c8bf76e-7d29-424c-b42f-362afab113b7 None None] Port 039b623b-ec76-451a-bf19-63e9f3a1544f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:02:23.722992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] For port 039b623b-ec76-451a-bf19-63e9f3a1544f, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:02:23.725913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] For port 039b623b-ec76-451a-bf19-63e9f3a1544f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=039b623b-ec76-451a-bf19-63e9f3a1544f,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:02:23.790256 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.854470 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-34ea7da3-d0f4-4c04-825a-9ebb529c6a1d None None] Provisioning complete for port 039b623b-ec76-451a-bf19-63e9f3a1544f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:23.854835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34ea7da3-d0f4-4c04-825a-9ebb529c6a1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:23.862285 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:23.862841 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:02:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:23.881474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7ac932-92ef-4cf9-ae7f-5e894b7c490b None None] Pushing event updated for resources: {'Port': ['ID=039b623b-ec76-451a-bf19-63e9f3a1544f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:24.027868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:24.064826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34ea7da3-d0f4-4c04-825a-9ebb529c6a1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:24.140722 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6edabf9b-135f-4676-871e-a2f579916206 req-0c3a5f02-37c0-4105-a161-3f19fdf8f7f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 210 time: 0.0294516 Dec 21 05:02:24.145745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-34ea7da3-d0f4-4c04-825a-9ebb529c6a1d None None] For port 039b623b-ec76-451a-bf19-63e9f3a1544f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=039b623b-ec76-451a-bf19-63e9f3a1544f,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:24.337323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34ea7da3-d0f4-4c04-825a-9ebb529c6a1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:24.408767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ea7da3-d0f4-4c04-825a-9ebb529c6a1d None None] Pushing event updated for resources: {'Port': ['ID=039b623b-ec76-451a-bf19-63e9f3a1544f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:24.468812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:23Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:24.471086 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-52908f8a-70fa-43d0-a291-de3b9527856a None None] Provisioning complete for port 039b623b-ec76-451a-bf19-63e9f3a1544f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:24.471452 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52908f8a-70fa-43d0-a291-de3b9527856a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:24.513380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeb3cd74-aa73-4eef-81d1-e35c5eb2e079 None None] The sync data for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 is: [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:23Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:02:25.235530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 039b623b-ec76-451a-bf19-63e9f3a1544f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:02:25.240473 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-99819264-be12-4532-bc4f-87921f83f26c req-918b38cf-d83e-402b-98f0-2392a020c451 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 210 time: 0.0266559 Dec 21 05:02:25.303463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 039b623b-ec76-451a-bf19-63e9f3a1544f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:25.303837 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:25.384106 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:25.469997 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:25.812436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:26.343108 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323571be-8e42-46d4-8f9e-784152e97443 req-b71158ba-98ce-4162-bc85-6b30df6f606b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 210 time: 0.0264964 Dec 21 05:02:26.754835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-03e76ace-e736-4309-aeb0-73326f4b1c80 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:26.756485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-03e76ace-e736-4309-aeb0-73326f4b1c80 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/networks?id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad HTTP/1.1" status: 200 len: 797 time: 0.1105335 Dec 21 05:02:26.845013 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-a3716f71-70b5-4de5-9985-ab198674f2dd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 380 time: 0.0631597 Dec 21 05:02:26.858465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'port': {'device_id': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'admin_state_up': True, 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'security_groups': ['ece4b4a6-c46a-48a4-b0fc-78d1231ab855']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:27.085165 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:02:27.088856 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:27.269831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.6 (b31abc0b-3587-4d7d-924c-d10c8a3f7dad/7b9d3b95-8eed-4d78-b371-f9e95f352a79/470d7971-130d-4ff8-b024-f18d00f12069) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:02:27.402826 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:27.451568 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fcf61125-a2e0-47fa-930a-2c72464817eb req-289f230d-275b-48c9-89cd-bc0c0e750bb4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 210 time: 0.0360208 Dec 21 05:02:27.521545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:27.568142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:02:27.571114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:27.574726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:02:27.598532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=470d7971-130d-4ff8-b024-f18d00f12069,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:27.629196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:27.630143 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:27.701121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-6653aa40-c615-4e55-a952-4e0c08ed6e9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8463326 Dec 21 05:02:27.716750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-cb192550-2b35-4e26-9db5-01a4cbb204bc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:02:27.717785 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-cb192550-2b35-4e26-9db5-01a4cbb204bc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054462 Dec 21 05:02:27.790565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Request body: {'port': {'device_id': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:27.831105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2320fba3-1cc8-455e-a386-590a4f037d8a None None] Provisioning complete for port 470d7971-130d-4ff8-b024-f18d00f12069 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:27.831701 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2320fba3-1cc8-455e-a386-590a4f037d8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:27.853936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:27.871430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2320fba3-1cc8-455e-a386-590a4f037d8a None None] Port 470d7971-130d-4ff8-b024-f18d00f12069 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:02:28.487968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 470d7971-130d-4ff8-b024-f18d00f12069 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:02:28.496176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:28.512991 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Transition to ACTIVE for port object 470d7971-130d-4ff8-b024-f18d00f12069 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:02:28.577403 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33f21ca-0845-455f-b755-7c0439413a14 req-3b4ebbfe-e743-441a-94dd-a4b14262a16f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:28.578870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a33f21ca-0845-455f-b755-7c0439413a14 req-3b4ebbfe-e743-441a-94dd-a4b14262a16f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 931 time: 0.0524998 Dec 21 05:02:28.597543 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:28.664676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Pushing event updated for resources: {'Port': ['ID=470d7971-130d-4ff8-b024-f18d00f12069,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:28.675307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a33f21ca-0845-455f-b755-7c0439413a14 req-61dcc037-70fd-4025-8482-7b2b5eaf9057 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0903127 Dec 21 05:02:28.751690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Attempting to bind port 470d7971-130d-4ff8-b024-f18d00f12069 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:02:28.751980 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Attempting to bind port 470d7971-130d-4ff8-b024-f18d00f12069 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:02:28.752311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Attempting to bind port 470d7971-130d-4ff8-b024-f18d00f12069 on network b31abc0b-3587-4d7d-924c-d10c8a3f7dad {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:02:28.756846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Port 470d7971-130d-4ff8-b024-f18d00f12069 on network b31abc0b-3587-4d7d-924c-d10c8a3f7dad not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:02:28.757169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Attempting to bind port 470d7971-130d-4ff8-b024-f18d00f12069 on network b31abc0b-3587-4d7d-924c-d10c8a3f7dad {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:02:28.762109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 2, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:02:28.762445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Checking segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:02:28.762838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Bound using segment: {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:02:28.763349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Bound port: 470d7971-130d-4ff8-b024-f18d00f12069, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7c30338c-a326-46e8-b06e-79fd17163058', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:02:28.763714 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:28.832681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] For port 470d7971-130d-4ff8-b024-f18d00f12069, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:02:28.835613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] For port 470d7971-130d-4ff8-b024-f18d00f12069, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=470d7971-130d-4ff8-b024-f18d00f12069,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:02:28.897733 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:28.934815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:28.935492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:28.936929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] 10.222.0.31 "PUT /v2.0/ports/470d7971-130d-4ff8-b024-f18d00f12069 HTTP/1.1" status: 200 len: 1092 time: 1.1989701 Dec 21 05:02:28.937343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:02:28.939661 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca" -d '{"events": [{"name": "network-changed", "server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "tag": "470d7971-130d-4ff8-b024-f18d00f12069"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:02:28.960843 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59c10d6-31b2-4490-b721-8fe68a0d28bb service neutron] Pushing event updated for resources: {'Port': ['ID=470d7971-130d-4ff8-b024-f18d00f12069,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:28.981110 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:02:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11c5e8e6-eb7f-426c-8c80-576dde59771b x-openstack-request-id: req-11c5e8e6-eb7f-426c-8c80-576dde59771b {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:02:28.981613 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "tag": "470d7971-130d-4ff8-b024-f18d00f12069", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:02:28.981954 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-11c5e8e6-eb7f-426c-8c80-576dde59771b {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:02:28.982431 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069', 'status': 'completed', 'code': 200} Dec 21 05:02:29.107865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca req-a596fadc-4d97-4eab-9367-cdc0bac6ec18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.109379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca req-a596fadc-4d97-4eab-9367-cdc0bac6ec18 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 1095 time: 0.0776014 Dec 21 05:02:29.286170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca req-be8209ff-47dd-4bdc-b888-92b5dc0eb5a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.287593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca req-be8209ff-47dd-4bdc-b888-92b5dc0eb5a6 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=7037c5e415f34eb2b218d59f1243d003&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1600213 Dec 21 05:02:29.446916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca req-d59994ab-c029-4647-802b-da00a27785f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.448417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d4eb93a-46b7-4ec9-bdf5-c488e7338cca req-d59994ab-c029-4647-802b-da00a27785f6 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1501467 Dec 21 05:02:29.556503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-bc839da8-21d8-4177-a8e5-9c9c8a95ab90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.558012 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-bc839da8-21d8-4177-a8e5-9c9c8a95ab90 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 1095 time: 0.0402055 Dec 21 05:02:29.616595 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-1fc2fb0f-1347-4b75-8fae-7c3f81ca2eed service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=470d7971-130d-4ff8-b024-f18d00f12069 HTTP/1.1" status: 200 len: 217 time: 0.0349889 Dec 21 05:02:29.671952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-5807e61e-26c6-477b-973a-71efef9365db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.673379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-5807e61e-26c6-477b-973a-71efef9365db service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7b9d3b95-8eed-4d78-b371-f9e95f352a79 HTTP/1.1" status: 200 len: 834 time: 0.0459259 Dec 21 05:02:29.723830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-77d705b7-18d9-4cc1-b3d6-58163ddcef7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.725326 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-77d705b7-18d9-4cc1-b3d6-58163ddcef7c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0401945 Dec 21 05:02:29.850449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700d5751-5b00-44d4-8d61-4f6f277628c5 req-3ef37b57-e17f-4f8d-8427-67d26d21590e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:29.852096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-700d5751-5b00-44d4-8d61-4f6f277628c5 req-3ef37b57-e17f-4f8d-8427-67d26d21590e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 943 time: 0.1010990 Dec 21 05:02:29.854231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-a6012e2e-d583-40b5-88d0-b834772ffe95 service neutron] 10.222.0.31 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1196828 Dec 21 05:02:29.949913 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-700d5751-5b00-44d4-8d61-4f6f277628c5 req-5989cf0d-e880-4565-9e87-81feda9e1a97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0918550 Dec 21 05:02:29.974817 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-826fefbb-6c93-42f0-8008-9cd57ebf075f req-62374a40-97da-4497-9f0f-3749ee7b51d3 service neutron] 10.222.0.31 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1040165 Dec 21 05:02:31.071976 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb44cd7-8c38-48b0-98bb-e09377d79711 req-873a6be5-7568-463a-86f9-82a70e7fc5fc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:31.073438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7eb44cd7-8c38-48b0-98bb-e09377d79711 req-873a6be5-7568-463a-86f9-82a70e7fc5fc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 943 time: 0.0550864 Dec 21 05:02:31.121274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7eb44cd7-8c38-48b0-98bb-e09377d79711 req-e1beb68f-c28a-4ccc-a46f-03d3565d62e1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419850 Dec 21 05:02:31.877762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 470d7971-130d-4ff8-b024-f18d00f12069 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:02:31.976809 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 470d7971-130d-4ff8-b024-f18d00f12069, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=470d7971-130d-4ff8-b024-f18d00f12069,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:31.988321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '470d7971-130d-4ff8-b024-f18d00f12069', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'port_id': '470d7971-130d-4ff8-b024-f18d00f12069', 'mac_address': 'fa:16:3e:ee:c1:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 140, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:02:32.023715 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:32.036357 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 470d7971-130d-4ff8-b024-f18d00f12069 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:02:32.055892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 470d7971-130d-4ff8-b024-f18d00f12069, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=470d7971-130d-4ff8-b024-f18d00f12069,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:32.144132 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:32.190891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=470d7971-130d-4ff8-b024-f18d00f12069,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:32.237753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a6a26f-d0bd-482a-bcac-c01b40c6da96 req-ce9f9764-8b54-48db-bbd3-ed6cc02ad8ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:32.239930 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24a6a26f-d0bd-482a-bcac-c01b40c6da96 req-ce9f9764-8b54-48db-bbd3-ed6cc02ad8ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 944 time: 0.0494823 Dec 21 05:02:32.288041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24a6a26f-d0bd-482a-bcac-c01b40c6da96 req-0eda6875-d599-4767-b7b7-ae35564ef810 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421846 Dec 21 05:02:32.575932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['470d7971-130d-4ff8-b024-f18d00f12069'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:02:33.403661 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7f62926-e450-496e-b258-bc854cb116da req-ab7082f3-ca84-4036-b2df-11c35394ea42 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:33.405023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7f62926-e450-496e-b258-bc854cb116da req-ab7082f3-ca84-4036-b2df-11c35394ea42 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 944 time: 0.0505862 Dec 21 05:02:33.452508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b7f62926-e450-496e-b258-bc854cb116da req-a472607a-39e1-4185-90e4-146f252700e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409114 Dec 21 05:02:33.895732 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 470d7971-130d-4ff8-b024-f18d00f12069 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:02:33.995468 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 470d7971-130d-4ff8-b024-f18d00f12069 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:02:33.999054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 470d7971-130d-4ff8-b024-f18d00f12069 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:02:33.999424 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:34.073993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:34.096750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:02:34.099011 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-407ccc0e-c5f4-48a2-b408-6b1051acdf15" -d '{"events": [{"server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "name": "network-vif-plugged", "status": "completed", "tag": "470d7971-130d-4ff8-b024-f18d00f12069"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:02:34.112002 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 470d7971-130d-4ff8-b024-f18d00f12069, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=470d7971-130d-4ff8-b024-f18d00f12069,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:02:34.138351 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:02:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6a8ab9b-fa40-4f38-aaba-0a4c7d55b612 x-openstack-request-id: req-e6a8ab9b-fa40-4f38-aaba-0a4c7d55b612 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:02:34.138646 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "name": "network-vif-plugged", "status": "completed", "tag": "470d7971-130d-4ff8-b024-f18d00f12069", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:02:34.138926 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e6a8ab9b-fa40-4f38-aaba-0a4c7d55b612 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:02:34.139356 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069', 'code': 200} Dec 21 05:02:34.166889 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:34.216773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=470d7971-130d-4ff8-b024-f18d00f12069,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:34.284926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1045176-a384-48e1-b600-513a9dc3652e req-7fb9d7a9-fde3-46c0-9dbf-c8b122f1000f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:34.286376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1045176-a384-48e1-b600-513a9dc3652e req-7fb9d7a9-fde3-46c0-9dbf-c8b122f1000f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 1097 time: 0.0383065 Dec 21 05:02:34.330745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1045176-a384-48e1-b600-513a9dc3652e req-87ea2df7-512e-4d6a-8692-67c46962186c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369256 Dec 21 05:02:34.565530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d413bf-fd15-4333-81c2-036345d6098e req-0757162e-3373-458a-ba3e-b3c94a4ad9e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:34.566904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01d413bf-fd15-4333-81c2-036345d6098e req-0757162e-3373-458a-ba3e-b3c94a4ad9e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0474107 Dec 21 05:02:34.620485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01d413bf-fd15-4333-81c2-036345d6098e req-0183ab51-20bc-489a-8294-3c4d10e34046 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472524 Dec 21 05:02:35.739015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b4ce83-6f0d-42d8-8d47-a1f37cd270d4 req-261aac9c-c2bb-46be-8958-259899416dbe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:35.740531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25b4ce83-6f0d-42d8-8d47-a1f37cd270d4 req-261aac9c-c2bb-46be-8958-259899416dbe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0502257 Dec 21 05:02:35.790425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25b4ce83-6f0d-42d8-8d47-a1f37cd270d4 req-5667fa3b-2a2f-45b4-96b9-511f760a71da tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429571 Dec 21 05:02:36.905710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41b103f2-d373-4dfa-b00d-75b69100a828 req-93c95213-9ae4-4160-a01e-d05896a4cf7d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:36.907134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41b103f2-d373-4dfa-b00d-75b69100a828 req-93c95213-9ae4-4160-a01e-d05896a4cf7d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0480208 Dec 21 05:02:36.955237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41b103f2-d373-4dfa-b00d-75b69100a828 req-2ac34b1d-dd18-4693-b53b-2dd88cfb9d47 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420702 Dec 21 05:02:37.071438 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69d6227-1aef-4032-bbf8-77f62e1b7ab4 req-62510a15-b402-4b46-8f70-2a72c644aa34 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:37.072904 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c69d6227-1aef-4032-bbf8-77f62e1b7ab4 req-62510a15-b402-4b46-8f70-2a72c644aa34 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0515602 Dec 21 05:02:37.120955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c69d6227-1aef-4032-bbf8-77f62e1b7ab4 req-8db66c03-4ef7-4d3f-aecf-689c09332049 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419774 Dec 21 05:02:37.142562 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51630) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:37.185560 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-868ccc02-3387-452b-98a9-575bb7b22b81 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:37.187098 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-868ccc02-3387-452b-98a9-575bb7b22b81 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 1092 time: 0.0434821 Dec 21 05:02:37.189954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51632) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:37.194120 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '470d7971-130d-4ff8-b024-f18d00f12069', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address': '172.20.0.6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:02:37.292404 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:37.385798 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:37.489786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.13 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/5a09f3f1-d83f-4e82-b7c4-7dfdb0618c69) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:02:37.588771 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:37.668532 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:37.707527 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:02:37.710298 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:02:37.712903 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:02:37.740897 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=5a09f3f1-d83f-4e82-b7c4-7dfdb0618c69,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:38.207423 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:38.358117 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:38.503988 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:38.583888 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:38.659237 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=5a09f3f1-d83f-4e82-b7c4-7dfdb0618c69,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:02:38.670309 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:38.765454 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP 6c135f91-51b5-405e-aa68-e312fccfc2ee associated. External IP: 172.25.5.13, port: 470d7971-130d-4ff8-b024-f18d00f12069. Dec 21 05:02:39.305449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 6b9c3642-c9d3-4da7-9647-f789f543630f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:02:39.411095 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:02:39.420676 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] Sync routers for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:02:39.429568 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:39.430170 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:02:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:39.488865 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:39.515946 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-473e6bc1-8745-449f-809f-63d8c5b4b973 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.3249962 Dec 21 05:02:39.517281 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:02:39.523837 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94060f23-2100-46b1-8f07-65911a077692" -d '{"events": [{"name": "network-changed", "server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "tag": "470d7971-130d-4ff8-b024-f18d00f12069"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:02:39.536665 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:39.561805 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:02:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50f99cdd-db83-4ee6-8c8f-b3c554341f5d x-openstack-request-id: req-50f99cdd-db83-4ee6-8c8f-b3c554341f5d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:02:39.562109 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "tag": "470d7971-130d-4ff8-b024-f18d00f12069", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:02:39.562371 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-50f99cdd-db83-4ee6-8c8f-b3c554341f5d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:02:39.562813 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069', 'status': 'completed', 'code': 200} Dec 21 05:02:39.629515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623e05aa-a592-4da8-89fe-234d1a14b93c req-23bc2165-26f1-407d-b613-717807faae66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:39.631028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-623e05aa-a592-4da8-89fe-234d1a14b93c req-23bc2165-26f1-407d-b613-717807faae66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0608053 Dec 21 05:02:39.695360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94060f23-2100-46b1-8f07-65911a077692 req-7afd7481-0615-4dbd-b209-7a8284cede0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:39.696871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-7afd7481-0615-4dbd-b209-7a8284cede0e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 1097 time: 0.0846245 Dec 21 05:02:39.701845 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-623e05aa-a592-4da8-89fe-234d1a14b93c req-b281ffc7-dad3-4827-ade5-47cc69ece492 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568547 Dec 21 05:02:39.725112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51638) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:39.771718 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6c135f91-51b5-405e-aa68-e312fccfc2ee', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.13', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'port_id': '470d7971-130d-4ff8-b024-f18d00f12069', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4222, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'mac_address': 'fa:16:3e:ee:c1:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:02:37Z', 'updated_at': '2021-12-21T05:02:37Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:39.789492 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7aaecf04-641a-44c2-9df1-b0e0d2875842 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6c135f91-51b5-405e-aa68-e312fccfc2ee HTTP/1.1" status: 200 len: 990 time: 0.0632465 Dec 21 05:02:39.799116 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] Checking router: 6b9c3642-c9d3-4da7-9647-f789f543630f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:02:39.807509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:02:39.808228 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:02:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:39.828532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94060f23-2100-46b1-8f07-65911a077692 req-2b919708-c87d-4943-8008-a8a12ea329a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:39.830045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-2b919708-c87d-4943-8008-a8a12ea329a0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad HTTP/1.1" status: 200 len: 898 time: 0.1211739 Dec 21 05:02:39.895860 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:02:39.918217 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:02:39.928543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-9c671b93-2798-4592-978d-132231724f8f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=470d7971-130d-4ff8-b024-f18d00f12069 HTTP/1.1" status: 200 len: 998 time: 0.0911767 Dec 21 05:02:39.981140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94060f23-2100-46b1-8f07-65911a077692 req-7d0a438a-126f-4ebd-aa34-b962f4d31999 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:39.982509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-7d0a438a-126f-4ebd-aa34-b962f4d31999 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7b9d3b95-8eed-4d78-b371-f9e95f352a79 HTTP/1.1" status: 200 len: 834 time: 0.0441759 Dec 21 05:02:40.030616 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94060f23-2100-46b1-8f07-65911a077692 req-2d4d0c44-bdb0-43fb-9512-8bf19ee13375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:02:40.032200 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-2d4d0c44-bdb0-43fb-9512-8bf19ee13375 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0424469 Dec 21 05:02:40.119947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-178e3641-9aa5-4251-8143-2064ec0b3e0e service neutron] 10.222.0.31 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801702 Dec 21 05:02:40.140623 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6c135f91-51b5-405e-aa68-e312fccfc2ee', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.13', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'port_id': '470d7971-130d-4ff8-b024-f18d00f12069', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4222, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'mac_address': 'fa:16:3e:ee:c1:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:02:37Z', 'updated_at': '2021-12-21T05:02:37Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:02:40.216357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94060f23-2100-46b1-8f07-65911a077692 req-d8e8d0b0-bcfd-49f4-8089-b27b7904d27d service neutron] 10.222.0.31 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873053 Dec 21 05:02:40.261299 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7e0c91f-4350-41be-ba8c-d44b70d9320a None None] The sync data for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 is: [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6c135f91-51b5-405e-aa68-e312fccfc2ee', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.13', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'port_id': '470d7971-130d-4ff8-b024-f18d00f12069', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4222, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'mac_address': 'fa:16:3e:ee:c1:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:02:37Z', 'updated_at': '2021-12-21T05:02:37Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:02:40.465807 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da5ffdcd-150f-488f-bff4-a96c2fd30aac None None] New status for floating IP 6c135f91-51b5-405e-aa68-e312fccfc2ee: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:02:40.793145 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51640) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:02:40.852764 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8f1d9bc-9d4f-4588-b605-7fc2baa1bd94 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6c135f91-51b5-405e-aa68-e312fccfc2ee HTTP/1.1" status: 200 len: 992 time: 0.0584884 Dec 21 05:02:49.943210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c9783ba4-90d1-4722-9947-7c5ca27683ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:52.743295 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a19709b6-cee7-4424-9ae3-3da3c6ef1ac8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:53.543492 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:53.675248 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:55.331637 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:55.417402 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:02:55.799552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:14.463497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d6fb11f-ba17-4664-8c49-e36109682746 req-feee99a5-d010-40dc-b79c-a0be3808a292 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:14.464980 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d6fb11f-ba17-4664-8c49-e36109682746 req-feee99a5-d010-40dc-b79c-a0be3808a292 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.1164186 Dec 21 05:03:14.517649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d6fb11f-ba17-4664-8c49-e36109682746 req-fe6d4906-0998-4746-ae42-19ae5347d201 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461965 Dec 21 05:03:15.683760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8756ace-14ce-4c54-a6cf-38dd7114f6e6 req-fee6e881-44ef-4618-92c6-7f009100d03f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:15.685221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8756ace-14ce-4c54-a6cf-38dd7114f6e6 req-fee6e881-44ef-4618-92c6-7f009100d03f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0975814 Dec 21 05:03:15.732730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8756ace-14ce-4c54-a6cf-38dd7114f6e6 req-b5d70a75-1e27-4f99-94e6-195ecf5a1cf8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415444 Dec 21 05:03:15.754848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51662) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:15.818169 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a606d990-dfa4-4f62-ad8d-1c27be8e1d37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6c135f91-51b5-405e-aa68-e312fccfc2ee HTTP/1.1" status: 200 len: 992 time: 0.0619924 Dec 21 05:03:16.875027 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:03:17.222565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb04597-7f5c-4873-a081-4faed8303b45 req-7930ec2a-1ac6-41fc-8d55-6b4e9d03fb59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:17.224104 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cb04597-7f5c-4873-a081-4faed8303b45 req-7930ec2a-1ac6-41fc-8d55-6b4e9d03fb59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0498009 Dec 21 05:03:17.272885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cb04597-7f5c-4873-a081-4faed8303b45 req-ff27abb3-02e0-4245-99ab-894d40cde998 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424731 Dec 21 05:03:18.394091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b9df0a-5ce6-4cb5-ab32-c11981c909f8 req-c5a34c5a-1327-4ce4-832c-c6dbed7dec57 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:18.395622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68b9df0a-5ce6-4cb5-ab32-c11981c909f8 req-c5a34c5a-1327-4ce4-832c-c6dbed7dec57 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0518394 Dec 21 05:03:18.445615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68b9df0a-5ce6-4cb5-ab32-c11981c909f8 req-91671e00-f5eb-4b53-885d-2ab38269441b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440938 Dec 21 05:03:18.467773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51672) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:18.527514 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-29ad78db-982a-4944-8bdd-d4039cf91ada tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6c135f91-51b5-405e-aa68-e312fccfc2ee HTTP/1.1" status: 200 len: 992 time: 0.0585794 Dec 21 05:03:18.781218 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51678) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:19.187249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 5a09f3f1-d83f-4e82-b7c4-7dfdb0618c69 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:03:19.187591 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.264515 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.264843 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.276476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 5a09f3f1-d83f-4e82-b7c4-7dfdb0618c69 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:03:19.480569 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.506320 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=5a09f3f1-d83f-4e82-b7c4-7dfdb0618c69,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:19.518815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.519204 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.519560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.519906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.520243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.520579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.520916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.521248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.521582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.521913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.522248 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.522572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.522898 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:19.578682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.579553 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP 6c135f91-51b5-405e-aa68-e312fccfc2ee disassociated (deleted). External IP: 172.25.5.13, port: 470d7971-130d-4ff8-b024-f18d00f12069. Dec 21 05:03:19.778108 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 6b9c3642-c9d3-4da7-9647-f789f543630f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:03:19.885619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:03:19.894338 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.895094 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] Sync routers for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:03:19.906652 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:19.907805 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:02:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:19.921006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-19f56d2b-a1ff-4ca7-aba1-15676dbafbd9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/floatingips/6c135f91-51b5-405e-aa68-e312fccfc2ee HTTP/1.1" status: 204 len: 168 time: 1.1387103 Dec 21 05:03:19.921697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:03:19.924542 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43d4ef60-fb85-4477-809c-2aba873bf02b" -d '{"events": [{"name": "network-changed", "server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "tag": "470d7971-130d-4ff8-b024-f18d00f12069"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:03:19.955054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b2a9350d-cb28-431e-b957-94c76b20c11c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:19.962669 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:03:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e6a2c4f-5c31-4135-85d9-c565db629519 x-openstack-request-id: req-2e6a2c4f-5c31-4135-85d9-c565db629519 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:03:19.962669 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "tag": "470d7971-130d-4ff8-b024-f18d00f12069", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:03:19.963429 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2e6a2c4f-5c31-4135-85d9-c565db629519 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:03:19.963429 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069', 'status': 'completed', 'code': 200} Dec 21 05:03:20.022448 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:20.062534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-9fa16393-8517-43ad-885d-f107c8331f12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:20.064539 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-9fa16393-8517-43ad-885d-f107c8331f12 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 1097 time: 0.0419807 Dec 21 05:03:20.170416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-cfc92bcd-7dcc-43f7-8054-db31baf9dc14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:20.172113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-cfc92bcd-7dcc-43f7-8054-db31baf9dc14 service neutron] 10.222.0.31 "GET /v2.0/networks?id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad HTTP/1.1" status: 200 len: 898 time: 0.0953031 Dec 21 05:03:20.224944 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:20.233519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-7a8e7bff-2d17-4f7e-a1f8-bda64c0ef942 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=470d7971-130d-4ff8-b024-f18d00f12069 HTTP/1.1" status: 200 len: 217 time: 0.0397174 Dec 21 05:03:20.251859 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] Checking router: 6b9c3642-c9d3-4da7-9647-f789f543630f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:03:20.260086 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:20.260677 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:02:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:20.284100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-4eed25ab-352b-4ad3-874e-91fc19b8784e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:20.285612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-4eed25ab-352b-4ad3-874e-91fc19b8784e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7b9d3b95-8eed-4d78-b371-f9e95f352a79 HTTP/1.1" status: 200 len: 834 time: 0.0447757 Dec 21 05:03:20.359040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-3593c153-8ff0-494e-8c20-77414efe7d57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:20.360996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-3593c153-8ff0-494e-8c20-77414efe7d57 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=b31abc0b-3587-4d7d-924c-d10c8a3f7dad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0663273 Dec 21 05:03:20.371744 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:20.387339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10be8f8-882f-4d40-b33e-2ba88fd5dd30 req-58c9a72c-9b1a-46fe-bf21-ce123ca911cf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:20.388780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c10be8f8-882f-4d40-b33e-2ba88fd5dd30 req-58c9a72c-9b1a-46fe-bf21-ce123ca911cf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0656872 Dec 21 05:03:20.489118 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c10be8f8-882f-4d40-b33e-2ba88fd5dd30 req-fcf35b84-fa17-4530-a894-ad514ceb5334 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0866451 Dec 21 05:03:20.505114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-a4d1055e-3220-4220-9f54-b4ddf6e685c5 service neutron] 10.222.0.31 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335104 Dec 21 05:03:20.575019 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:20.601046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cb8da83-5002-4ff2-a274-31c9d6b5e508 None None] The sync data for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 is: [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:02:21Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '039b623b-ec76-451a-bf19-63e9f3a1544f', 'name': '', 'network_id': 'b31abc0b-3587-4d7d-924c-d10c8a3f7dad', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:f4:f0:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4219, 'fixed_ips': [{'subnet_id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:20Z', 'updated_at': '2021-12-21T05:02:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7b9d3b95-8eed-4d78-b371-f9e95f352a79', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:03:20.601905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43d4ef60-fb85-4477-809c-2aba873bf02b req-97e3ff96-b359-44a9-b20a-6874be4f92a8 service neutron] 10.222.0.31 "GET /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886650 Dec 21 05:03:20.825463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928511e8-8406-40ae-96f5-e6585bbf1b9e None None] New status for floating IP 6c135f91-51b5-405e-aa68-e312fccfc2ee: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:03:21.610876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06488622-e23d-4dfe-b952-d27c4bedd75d req-6eb39392-e173-45c7-a61d-23b31b5280a9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:21.612410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06488622-e23d-4dfe-b952-d27c4bedd75d req-6eb39392-e173-45c7-a61d-23b31b5280a9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0494099 Dec 21 05:03:21.661047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06488622-e23d-4dfe-b952-d27c4bedd75d req-30abbc2a-e4fa-41f7-8110-65c7409658bb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=ece4b4a6-c46a-48a4-b0fc-78d1231ab855&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426404 Dec 21 05:03:22.302401 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-68a8c90d-da1d-46b8-a977-e6e89f94dca1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:22.303907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-68a8c90d-da1d-46b8-a977-e6e89f94dca1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 945 time: 0.0473747 Dec 21 05:03:22.398170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 470d7971-130d-4ff8-b024-f18d00f12069 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:03:22.398513 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:22.486544 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 470d7971-130d-4ff8-b024-f18d00f12069, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=470d7971-130d-4ff8-b024-f18d00f12069,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:22.493745 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:22.498473 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 470d7971-130d-4ff8-b024-f18d00f12069 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:03:22.686245 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:22.714594 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=470d7971-130d-4ff8-b024-f18d00f12069,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:22.731720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f7b71799-4f3a-494c-881d-d3d91bc81dd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:22.788777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-254c4469-77ef-4c80-8c2b-4e5998d95e3a req-45e5a518-6731-4c26-800e-d2f2fea09d7d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a HTTP/1.1" status: 200 len: 210 time: 0.0470850 Dec 21 05:03:22.789604 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] No DVR routers for this DVR port 470d7971-130d-4ff8-b024-f18d00f12069 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:03:22.792176 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:22.795442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-356cf9ef-cc2c-46ad-b72d-7317d79729e7 req-d9780baf-1622-4e6e-b20c-6b2ed4de05e3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "DELETE /v2.0/ports/470d7971-130d-4ff8-b024-f18d00f12069 HTTP/1.1" status: 204 len: 173 time: 0.4820912 Dec 21 05:03:22.795914 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'name': 'network-vif-deleted', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:03:22.798798 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1b071cd-30cc-475c-9025-8f5fc6729fe6" -d '{"events": [{"server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "name": "network-vif-deleted", "tag": "470d7971-130d-4ff8-b024-f18d00f12069"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:03:22.834894 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:03:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8de94a85-71e0-4e50-a116-9e9cc78a9ee4 x-openstack-request-id: req-8de94a85-71e0-4e50-a116-9e9cc78a9ee4 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:03:22.841283 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a", "name": "network-vif-deleted", "tag": "470d7971-130d-4ff8-b024-f18d00f12069", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:03:22.841283 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-8de94a85-71e0-4e50-a116-9e9cc78a9ee4 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:03:22.841283 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b218ca6-b4b4-4e5f-b567-e5a4ee711a1a', 'name': 'network-vif-deleted', 'tag': '470d7971-130d-4ff8-b024-f18d00f12069', 'status': 'completed', 'code': 200} Dec 21 05:03:23.588436 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:23.645597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:23.851207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51694) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:24.302486 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:24.552129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 039b623b-ec76-451a-bf19-63e9f3a1544f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:03:24.552480 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:24.638742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 039b623b-ec76-451a-bf19-63e9f3a1544f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=039b623b-ec76-451a-bf19-63e9f3a1544f,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:24.639137 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:24.651732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 039b623b-ec76-451a-bf19-63e9f3a1544f owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:03:24.885002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:24.915724 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=039b623b-ec76-451a-bf19-63e9f3a1544f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:25.086023 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.319497 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.463154 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.569358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 6b9c3642-c9d3-4da7-9647-f789f543630f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:03:25.674756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:03:25.679791 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-543fedfc-b1af-4064-8745-4af329388530 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/6b9c3642-c9d3-4da7-9647-f789f543630f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8275115 Dec 21 05:03:25.682746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51696) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:25.684599 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] Sync routers for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:03:25.694010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:25.694609 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:25.732987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting subnet 7b9d3b95-8eed-4d78-b371-f9e95f352a79 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:03:25.737239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.778492 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.800139 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:25.828446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.867268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:25.974542 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:03:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:26.000936 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.005286 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] Checking router: 6b9c3642-c9d3-4da7-9647-f789f543630f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:03:26.014132 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] Routers {'6b9c3642-c9d3-4da7-9647-f789f543630f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:26.014737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['6b9c3642-c9d3-4da7-9647-f789f543630f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:26.029018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Subnet': ['ID=7b9d3b95-8eed-4d78-b371-f9e95f352a79,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:26.032626 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.036453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-34f02b7b-e6f3-4cb2-87dc-220d9ad0d056 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/subnets/7b9d3b95-8eed-4d78-b371-f9e95f352a79 HTTP/1.1" status: 204 len: 168 time: 0.3526218 Dec 21 05:03:26.039206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51698) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:26.042199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6da28611-d414-4a1a-af29-c7e801c70af9 None None] Network b31abc0b-3587-4d7d-924c-d10c8a3f7dad requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:03:26.127025 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] Set router 6b9c3642-c9d3-4da7-9647-f789f543630f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:26.148133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.184510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 470d7971-130d-4ff8-b024-f18d00f12069 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:03:26.212436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] DHCP port deletion for b31abc0b-3587-4d7d-924c-d10c8a3f7dad request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:03:26.214688 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 470d7971-130d-4ff8-b024-f18d00f12069 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:03:26.215072 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 470d7971-130d-4ff8-b024-f18d00f12069 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:03:26.261965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.263899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Deleting port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:03:26.264290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.335211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] For port d55e2bd2-55f9-4600-9d0d-9b9f46acca87, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,segment=NetworkSegment(7c30338c-a326-46e8-b06e-79fd17163058),segment_id=7c30338c-a326-46e8-b06e-79fd17163058)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:26.335931 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.349931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Calling delete_port for d55e2bd2-55f9-4600-9d0d-9b9f46acca87 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:03:26.361785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 26497f35-2546-4587-8859-68985e27d356 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:03:26.362138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.404049 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:03:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:26.430956 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43cd364f-cd49-46ff-869a-cb2f9ba7ab5b None None] The sync data for ids ['6b9c3642-c9d3-4da7-9647-f789f543630f'] in n-d-822053-11 is: [{'id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1750798331', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187'}], 'enable_snat': True}, 'gw_port_id': '26497f35-2546-4587-8859-68985e27d356', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:02:16Z', 'updated_at': '2021-12-21T05:03:24Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '26497f35-2546-4587-8859-68985e27d356', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:1f:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b9c3642-c9d3-4da7-9647-f789f543630f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4216, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.187', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:02:17Z', 'updated_at': '2021-12-21T05:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:03:26.448278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 26497f35-2546-4587-8859-68985e27d356, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=26497f35-2546-4587-8859-68985e27d356,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:26.448646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.464427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 26497f35-2546-4587-8859-68985e27d356 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:03:26.480412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.507891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Pushing event deleted for resources: {'Port': ['ID=d55e2bd2-55f9-4600-9d0d-9b9f46acca87,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:26.512812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] No DVR routers for this DVR port d55e2bd2-55f9-4600-9d0d-9b9f46acca87 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:03:26.520969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.521316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.521657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.521993 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.522324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.522651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.523024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.523379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.523992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.523992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.524320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.524931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.525123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-720af1e5-48fe-46e1-9723-4737bc11192a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:26.725646 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.756365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=26497f35-2546-4587-8859-68985e27d356,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:26.769958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37b8a705-eaa0-4267-981c-2010b48a3c1b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:03:26.820860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.915735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:26.917893 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.046042 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.046653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Fanout notify agent at l3_agent the message router_deleted on router 6b9c3642-c9d3-4da7-9647-f789f543630f {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:03:27.054412 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.055561 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-81284fc6-9872-4f23-82ff-a234c2c44ca8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/routers/6b9c3642-c9d3-4da7-9647-f789f543630f HTTP/1.1" status: 204 len: 168 time: 1.0154390 Dec 21 05:03:27.058331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51700) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:27.141860 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.240577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.260714 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b31abc0b-3587-4d7d-924c-d10c8a3f7dad']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:27.270653 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7c30338c-a326-46e8-b06e-79fd17163058') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:27.270974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7c30338c-a326-46e8-b06e-79fd17163058') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:27.280187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.293556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.299756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Releasing vlan 140 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:03:27.300606 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:03:27.303549 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:03:27.433952 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.441391 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.444076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/networks/b31abc0b-3587-4d7d-924c-d10c8a3f7dad HTTP/1.1" status: 204 len: 168 time: 0.3848076 Dec 21 05:03:27.452792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51702) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:27.470510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05923b44-80a0-4b56-9bc7-1d4148133f31 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Network': ['ID=b31abc0b-3587-4d7d-924c-d10c8a3f7dad,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:27.539404 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f439d9b9-f07a-4964-bbef-50ade13a1aa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.559089 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 039b623b-ec76-451a-bf19-63e9f3a1544f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:03:27.570679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f439d9b9-f07a-4964-bbef-50ade13a1aa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.582116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 039b623b-ec76-451a-bf19-63e9f3a1544f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:03:27.582473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 039b623b-ec76-451a-bf19-63e9f3a1544f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:03:27.582905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 26497f35-2546-4587-8859-68985e27d356 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:03:27.606582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 26497f35-2546-4587-8859-68985e27d356 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:03:27.606951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 26497f35-2546-4587-8859-68985e27d356 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:03:27.609738 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d55e2bd2-55f9-4600-9d0d-9b9f46acca87 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:03:27.634740 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d55e2bd2-55f9-4600-9d0d-9b9f46acca87 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:03:27.635097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d55e2bd2-55f9-4600-9d0d-9b9f46acca87 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:03:27.685838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f439d9b9-f07a-4964-bbef-50ade13a1aa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.688501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f439d9b9-f07a-4964-bbef-50ade13a1aa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:27.689687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f439d9b9-f07a-4964-bbef-50ade13a1aa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/security-groups/ece4b4a6-c46a-48a4-b0fc-78d1231ab855 HTTP/1.1" status: 204 len: 168 time: 0.2359602 Dec 21 05:03:27.700838 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f439d9b9-f07a-4964-bbef-50ade13a1aa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ece4b4a6-c46a-48a4-b0fc-78d1231ab855,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:28.181100 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51708) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:28.185607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-517277508', 'description': 'tempest-secgroup-smoke-517277508 description', 'project_id': '7037c5e415f34eb2b218d59f1243d003'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:28.268530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.333291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.394387 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.432050 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:28.442044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.445521 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.446453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.446453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:28.487540 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.488803 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-199efde4-1703-47f5-a535-b90cb193eb93 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3066905 Dec 21 05:03:28.491669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51710) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:28.496233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '7bfe2059-fe02-46b5-a7cb-25c431bbf5e3', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:28.605190 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.660293 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.708266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.728124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=90f752fe-b974-4727-974d-082eae5827fb,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:28.767875 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.769128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1f250156-89c7-4fad-afb8-7eec31b3049f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2765360 Dec 21 05:03:28.772489 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51712) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:28.776869 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '7bfe2059-fe02-46b5-a7cb-25c431bbf5e3', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:28.863126 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.920473 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.982292 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:28.999749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=014d90c8-f51b-4d08-a555-7b9cbedbda4f,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:29.064536 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.066341 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fd6777d2-13c8-4c06-906b-04e1cba29d58 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2928529 Dec 21 05:03:29.069042 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51714) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:29.073434 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '7bfe2059-fe02-46b5-a7cb-25c431bbf5e3', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:29.164651 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.225206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.286187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.304062 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=449a1b84-19e0-423b-8920-6dd8feb4a649,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:29.384382 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.385584 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6bfc761f-3ef2-405e-9a8c-5fb6c28a4c41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3156221 Dec 21 05:03:29.388353 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51716) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:29.392714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '7bfe2059-fe02-46b5-a7cb-25c431bbf5e3', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:29.473146 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.530014 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.588824 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.606453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1f89e86-a3d3-489d-8948-ae9b7fa1d952,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:29.681753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.683059 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-697afd9e-6ec1-49ed-9eec-9b84fbf328fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2936876 Dec 21 05:03:29.685753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51718) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:29.690083 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '7bfe2059-fe02-46b5-a7cb-25c431bbf5e3', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:29.748635 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:03:29.753920 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.812374 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.862654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.881092 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1b7a9bc-a7c2-41cf-81ed-3ff5fc571b26,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:29.921685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:29.922891 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-40e7aeb4-4f9d-4ce5-9f4a-1731ceb0aed6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2362187 Dec 21 05:03:29.926110 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51720) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:29.930426 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '7bfe2059-fe02-46b5-a7cb-25c431bbf5e3', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:29.989138 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:03:29.994026 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.051763 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.125137 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.142558 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=884419a0-5164-446b-9876-dbe179c24e9a,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:30.242082 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.243302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-535b7ec2-c511-473a-a888-228c1b1527c5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3162813 Dec 21 05:03:30.246082 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51722) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:30.251156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'network': {'name': 'tempest-network-smoke--264303324', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:30.348343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:03:30.351809 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.375040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:03:30.383529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.383812 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Added segment 5862eccc-95bf-4326-ba5f-201bda6d9e8c of type vlan for network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 Dec 21 05:03:30.422187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.514158 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.521628 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:30.523905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.588340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Network': ['ID=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:30.598906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:03:30.642979 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3eda1acc-a7ff-4949-bc02-d9676642616c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3957825 Dec 21 05:03:30.645591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51724) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:30.650076 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'admin_state_up': True, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:30.725945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.727187 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.776472 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:30.979070 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:31.223111 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:31.242350 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:31.340217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.176 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/4e494d7c-b77a-4adc-aeb5-e8759f6e1a75) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:03:31.442783 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:31.531086 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:31.569340 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:03:31.572213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:31.575646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:03:31.585545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d99a80f0-fca0-48e8-a1ad-15decf953e10 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:03:31.602686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:31.621037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1d8081b7-de06-4a73-a717-c59ce2c13966 None None] Provisioning complete for port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:31.621521 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1d8081b7-de06-4a73-a717-c59ce2c13966 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:31.654421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1d8081b7-de06-4a73-a717-c59ce2c13966 None None] Port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:03:31.915815 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:32.115820 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:32.303020 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 7c042ab7-bbdc-4f76-9f64-7e273303a817 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:03:32.406714 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:03:32.416943 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Sync routers for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:03:32.427323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:32.429520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:32.482055 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:32.483350 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-980ac1cf-b44d-4255-b547-e9624aa25db7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.8367794 Dec 21 05:03:32.486488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51726) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:32.521545 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6d12a0d9-bfb6-4743-8218-36bab93b8920 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=7037c5e415f34eb2b218d59f1243d003&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0338140 Dec 21 05:03:32.524135 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51728) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:32.531518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:32.671385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdeefb56-a815-40a9-b315-d582067dcf0d tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:32.672902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-fdeefb56-a815-40a9-b315-d582067dcf0d tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1478872 Dec 21 05:03:32.676192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51730) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:32.709676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b3897569-7d33-4c1c-8f93-7f255957fba9 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0323553 Dec 21 05:03:32.712164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51732) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:32.713775 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:31Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:32.716861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-527559288', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:32.741076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Checking router: 7c042ab7-bbdc-4f76-9f64-7e273303a817 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:03:32.741498 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Updating router 7c042ab7-bbdc-4f76-9f64-7e273303a817 port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:03:32.765567 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:32.851466 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:03:32.855488 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.018786 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.090587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.103060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.141013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22119395-9a90-4ab4-97e8-f4b156f1c4c1 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:03:33.150852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed096b02-8efb-4591-bf33-d90c1aef4154 None None] Pushing event updated for resources: {'Port': ['ID=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:33.153914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Attempting to bind port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:03:33.154300 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Attempting to bind port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:03:33.154652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Attempting to bind port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:03:33.161637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 3, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:03:33.162026 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:03:33.162434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.162825 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:03:33.163319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Bound port: 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:03:33.163703 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.167686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Subnet': ['ID=7dc8df11-1a1b-4a8c-aad1-88dc84503821,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:33.178278 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Checking segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:03:33.178642 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network hostable DHCP agents. Network: 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:03:33.218166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] For port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:03:33.221246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] For port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:03:33.251217 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:03:33.280824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1edba12e-e718-4c5f-a05a-1df951dde7d2 None None] Provisioning complete for port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:33.281124 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1edba12e-e718-4c5f-a05a-1df951dde7d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.307323 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.325496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:33.330063 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:33.330944 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.342869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbbf47e4-22a1-4fd4-ae6f-e7fefde825a9 None None] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:03:33.373006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c7aa93a-c0d6-4797-a79a-4627f30d97e8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:03:33.375534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1edba12e-e718-4c5f-a05a-1df951dde7d2 None None] Port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:03:33.391453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-aa7ed300-ce7a-4c9e-afc2-4de1d98ebfa9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6782532 Dec 21 05:03:33.394182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51734) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:33.444206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:33.444840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:33.446524 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed096b02-8efb-4591-bf33-d90c1aef4154 None None] Pushing event updated for resources: {'Port': ['ID=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:33.527990 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-01835d68-bf88-40c2-ab7a-0b23729a1486 None None] Provisioning complete for port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:33.528443 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01835d68-bf88-40c2-ab7a-0b23729a1486 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.535490 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:03:33.541396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.857311 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:33.870051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:34.032465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Allocated IP 172.20.0.2 (5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6/7dc8df11-1a1b-4a8c-aad1-88dc84503821/d74becff-b991-4854-bdec-9b775473ba6e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:03:34.047801 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01835d68-bf88-40c2-ab7a-0b23729a1486 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.081582 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-01835d68-bf88-40c2-ab7a-0b23729a1486 None None] For port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:34.160442 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-01835d68-bf88-40c2-ab7a-0b23729a1486 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.235796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01835d68-bf88-40c2-ab7a-0b23729a1486 None None] Pushing event updated for resources: {'Port': ['ID=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:34.285436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:31Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:34.319414 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd2ec36-a67c-494c-bd54-f968b8d3690f None None] The sync data for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 is: [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:31Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:03:34.321110 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.366351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.409291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:03:34.412702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:34.416091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:03:34.421996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.1 (5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6/7dc8df11-1a1b-4a8c-aad1-88dc84503821/cff7f0c1-4a84-4bd5-b71e-9db34a1ef455) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:03:34.425427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Pushing event updated for resources: {'Port': ['ID=d74becff-b991-4854-bdec-9b775473ba6e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:34.478479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Attempting to bind port d74becff-b991-4854-bdec-9b775473ba6e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:03:34.478851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Attempting to bind port d74becff-b991-4854-bdec-9b775473ba6e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:03:34.479351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Attempting to bind port d74becff-b991-4854-bdec-9b775473ba6e on network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:03:34.484501 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 3, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:03:34.484879 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Checking segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:03:34.485280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.485672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Bound using segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:03:34.486166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Bound port: d74becff-b991-4854-bdec-9b775473ba6e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:03:34.486548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.540945 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.555832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] For port d74becff-b991-4854-bdec-9b775473ba6e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:03:34.558792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] For port d74becff-b991-4854-bdec-9b775473ba6e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d74becff-b991-4854-bdec-9b775473ba6e,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:03:34.600661 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.624261 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.659150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eef8b00-0f74-4519-b4c2-b5f9dcd2bd43 None None] Pushing event updated for resources: {'Port': ['ID=d74becff-b991-4854-bdec-9b775473ba6e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:34.687455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:03:34.691003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:34.695229 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:03:34.704240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:34.755701 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:34.988927 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.294128 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.315488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:03:35.337102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.374481 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:35.374861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.439614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:35.446525 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.470989 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d74becff-b991-4854-bdec-9b775473ba6e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:03:35.530358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d74becff-b991-4854-bdec-9b775473ba6e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:35.532771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.554599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:03:35.556439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:35.621146 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.658974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port d74becff-b991-4854-bdec-9b775473ba6e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d74becff-b991-4854-bdec-9b775473ba6e,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:35.687255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90e1c48b-7aac-4038-b9de-5898b1bcbc3f None None] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:03:35.711699 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:35.821080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=d74becff-b991-4854-bdec-9b775473ba6e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:35.826829 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-10259f09-699c-4c6c-9fb9-c79e40a2f6ec None None] Provisioning complete for port d74becff-b991-4854-bdec-9b775473ba6e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:35.827252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-10259f09-699c-4c6c-9fb9-c79e40a2f6ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.034469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 7c042ab7-bbdc-4f76-9f64-7e273303a817 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:03:36.147845 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:03:36.153017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-94dc61f9-24e1-49f9-bd0f-29f503fa85e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/7c042ab7-bbdc-4f76-9f64-7e273303a817/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7576764 Dec 21 05:03:36.163966 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Sync routers for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:03:36.169893 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-136cfac1-ca98-46e3-b617-1c1d1ae10a63 None None] Provisioning complete for port d74becff-b991-4854-bdec-9b775473ba6e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:36.170400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-136cfac1-ca98-46e3-b617-1c1d1ae10a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.174912 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:36.176466 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:36.276259 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-136cfac1-ca98-46e3-b617-1c1d1ae10a63 None None] Provisioning complete for port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:36.279333 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-136cfac1-ca98-46e3-b617-1c1d1ae10a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.327139 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:36.330009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-136cfac1-ca98-46e3-b617-1c1d1ae10a63 None None] Port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:03:36.369115 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-7ce12155-221e-48fe-bc63-908d3486823d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-517277508&fields=id&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 267 time: 0.0535626 Dec 21 05:03:36.464556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-89c68a36-cf19-44a9-a6f8-c19641f0f111 None None] Provisioning complete for port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:36.465180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-89c68a36-cf19-44a9-a6f8-c19641f0f111 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.496646 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-3c56d7bc-846f-44c9-af8c-598cc693b935 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:36.498445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-3c56d7bc-846f-44c9-af8c-598cc693b935 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 796 time: 0.1237512 Dec 21 05:03:36.502636 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-89c68a36-cf19-44a9-a6f8-c19641f0f111 None None] Port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:03:36.515651 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-c110d890-85e4-4dc9-abbd-a8a955fc8f8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/quotas/7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 375 time: 0.0103250 Dec 21 05:03:36.557315 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:35Z', 'revision_number': 2, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:36.570352 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-3d106939-6b2f-47d8-b0f1-b530a10ef9ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0481813 Dec 21 05:03:36.585913 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Checking router: 7c042ab7-bbdc-4f76-9f64-7e273303a817 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:03:36.586269 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Updating router 7c042ab7-bbdc-4f76-9f64-7e273303a817 port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:03:36.619798 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.629939 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-59edf617-3744-485c-b33f-6cb1fc47e3ac None None] Provisioning complete for port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:36.630390 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59edf617-3744-485c-b33f-6cb1fc47e3ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.665428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-59edf617-3744-485c-b33f-6cb1fc47e3ac None None] Port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:03:36.681655 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-8ee7a3f8-b189-4053-adba-c8927d60a830 service neutron] 10.222.0.18 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0987859 Dec 21 05:03:36.769691 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-8a0f0943-3f74-420a-adeb-deb859bef33a service neutron] 10.222.0.18 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836773 Dec 21 05:03:36.880958 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:36.954103 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.004375 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Pushing event updated for resources: {'Port': ['ID=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:37.014387 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.014753 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.015141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.015675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.016193 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.016801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.017314 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.017762 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.018503 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.018503 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.018740 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.019834 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.020115 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:03:37.032440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-323a580f-db29-4d2c-9824-6af177536c72 req-2445133e-58dd-487a-8907-ace80e2ca00c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 210 time: 0.0496023 Dec 21 05:03:37.089026 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Attempting to bind port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:03:37.089416 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Attempting to bind port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:03:37.089781 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Attempting to bind port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 on network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:03:37.096103 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 3, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:03:37.096480 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Checking segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:03:37.096886 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.097310 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Bound using segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:03:37.097817 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Bound port: cff7f0c1-4a84-4bd5-b71e-9db34a1ef455, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:03:37.098195 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.167806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] For port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:03:37.174236 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] For port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:03:37.245983 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.255239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d74becff-b991-4854-bdec-9b775473ba6e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:03:37.308059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-52f94b2a-0e60-4bbe-8f58-66cae3108e30 None None] Provisioning complete for port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:37.315135 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:37.315956 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52f94b2a-0e60-4bbe-8f58-66cae3108e30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.316600 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:37.349184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d74becff-b991-4854-bdec-9b775473ba6e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:37.349752 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.354427 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a396732-3f85-4671-af14-3a1f023058fb None None] Pushing event updated for resources: {'Port': ['ID=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:37.431894 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:37.460941 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52f94b2a-0e60-4bbe-8f58-66cae3108e30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.510901 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-52f94b2a-0e60-4bbe-8f58-66cae3108e30 None None] For port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:37.583790 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-52f94b2a-0e60-4bbe-8f58-66cae3108e30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:37.634877 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f94b2a-0e60-4bbe-8f58-66cae3108e30 None None] Pushing event updated for resources: {'Port': ['ID=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:37.644989 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:37.672259 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-560afb67-865f-4994-b393-b6d8a6a4cadc None None] The sync data for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 is: [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:03:37.703301 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-07a95864-4ced-4e58-b940-db7ec1c9af01 None None] Provisioning complete for port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:37.703672 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07a95864-4ced-4e58-b940-db7ec1c9af01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:38.119796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-246ffd57-c975-4926-9c43-0adb7b261ed9 req-b5b77bd4-dec6-4b11-ad31-513a4375504d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 210 time: 0.0278099 Dec 21 05:03:39.125854 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-c5cc4646-dd8b-44eb-80c1-8322966df3db tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:39.127371 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-c5cc4646-dd8b-44eb-80c1-8322966df3db tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 796 time: 0.1039386 Dec 21 05:03:39.215182 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-448d3eeb-936b-45fc-a958-3f549f677dc9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 379 time: 0.0630889 Dec 21 05:03:39.216481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'port': {'device_id': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'admin_state_up': True, 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'security_groups': ['7bfe2059-fe02-46b5-a7cb-25c431bbf5e3']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:39.223213 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cd511b90-e28d-40bb-bb90-846cc2802568 req-6a6be87a-36a4-493e-9f95-8d177d6a4db2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 210 time: 0.0292006 Dec 21 05:03:39.292591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:03:39.346055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:39.346529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:39.405907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:03:39.409566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:39.538212 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.6 (5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6/7dc8df11-1a1b-4a8c-aad1-88dc84503821/6fb99fb1-584a-4ecf-9896-225c6a7fd3de) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:03:39.679030 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:39.765641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:39.811522 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:03:39.814459 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:39.818121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:03:39.841864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:39.878634 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:39.879395 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:39.951502 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-cf2e6df4-49f3-4864-baa2-6bb16b963078 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7391887 Dec 21 05:03:39.970837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Request body: {'port': {'device_id': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:40.024429 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.036271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-46191821-a638-4d4b-ae8a-dbed3673c420 None None] Provisioning complete for port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:40.036721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46191821-a638-4d4b-ae8a-dbed3673c420 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.073100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-46191821-a638-4d4b-ae8a-dbed3673c420 None None] Port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:03:40.288223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6fb99fb1-584a-4ecf-9896-225c6a7fd3de {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:03:40.295801 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.308539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Transition to ACTIVE for port object 6fb99fb1-584a-4ecf-9896-225c6a7fd3de will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:03:40.340150 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc64812-144b-4a4e-8dfd-927920c091cd req-404ea230-d124-4285-96c6-b55cf93b91f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:40.341638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecc64812-144b-4a4e-8dfd-927920c091cd req-404ea230-d124-4285-96c6-b55cf93b91f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 931 time: 0.0499127 Dec 21 05:03:40.371461 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.392338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ecc64812-144b-4a4e-8dfd-927920c091cd req-bf880d24-0965-4c6f-8dc0-932b35e8f85c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438306 Dec 21 05:03:40.459480 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Pushing event updated for resources: {'Port': ['ID=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:40.512246 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Attempting to bind port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:03:40.512590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Attempting to bind port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:03:40.513190 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Attempting to bind port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de on network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:03:40.517910 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de on network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:03:40.518215 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Attempting to bind port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de on network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:03:40.523899 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:03:40.524284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Checking segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:03:40.524673 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Bound using segment: {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:03:40.525098 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Bound port: 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5862eccc-95bf-4326-ba5f-201bda6d9e8c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:03:40.525455 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.640345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] For port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:03:40.643367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] For port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:03:40.703383 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.741971 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:40.742597 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:40.744212 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] 10.222.0.54 "PUT /v2.0/ports/6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 1092 time: 0.7777534 Dec 21 05:03:40.748753 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:03:40.750905 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb" -d '{"events": [{"name": "network-changed", "server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:03:40.779960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b45bc874-091d-46b7-afc0-46a61ab73105 service neutron] Pushing event updated for resources: {'Port': ['ID=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:40.796716 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:03:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4602ae67-cc0d-4145-a078-1d4c222de166 x-openstack-request-id: req-4602ae67-cc0d-4145-a078-1d4c222de166 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:03:40.797013 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:03:40.797269 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4602ae67-cc0d-4145-a078-1d4c222de166 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:03:40.799866 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'status': 'completed', 'code': 200} Dec 21 05:03:40.890162 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb req-eca760eb-9bc8-4785-b5de-35b80d5de168 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:40.891827 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb req-eca760eb-9bc8-4785-b5de-35b80d5de168 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1095 time: 0.0487626 Dec 21 05:03:40.999821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb req-ab3865ed-3813-4407-aec4-af968ae30cae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:41.001273 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb req-ab3865ed-3813-4407-aec4-af968ae30cae service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=7037c5e415f34eb2b218d59f1243d003&shared=False HTTP/1.1" status: 200 len: 897 time: 0.0958335 Dec 21 05:03:41.092799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb req-e46258e6-a112-43e6-9790-23d8becbe16f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:41.094268 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3668d9be-a784-4fbf-9fc4-ce8d06292cfb req-e46258e6-a112-43e6-9790-23d8becbe16f service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0849919 Dec 21 05:03:41.193324 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-755e3f6d-8408-4893-bd67-b5a49869481d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:41.194784 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-755e3f6d-8408-4893-bd67-b5a49869481d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1095 time: 0.0403614 Dec 21 05:03:41.250817 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-17a9ad56-66b2-4b0c-a20f-29abc9dd90a9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 217 time: 0.0415792 Dec 21 05:03:41.299475 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-a024bf31-b0d0-489e-adad-b361606635ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:41.301410 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-a024bf31-b0d0-489e-adad-b361606635ff service neutron] 10.222.0.54 "GET /v2.0/subnets?id=7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 200 len: 834 time: 0.0436752 Dec 21 05:03:41.347444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-47ad2263-05c8-42c4-8fb4-85c752bb0310 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:41.348943 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-47ad2263-05c8-42c4-8fb4-85c752bb0310 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0405726 Dec 21 05:03:41.443389 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-71820f5b-1400-4dda-af4d-58fa6a3648ed service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866342 Dec 21 05:03:41.514099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d622ac-5d9b-4c81-942f-ea8be44b0195 req-30092fe3-48de-4ae9-af1c-fa15b6906011 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:41.515638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19d622ac-5d9b-4c81-942f-ea8be44b0195 req-30092fe3-48de-4ae9-af1c-fa15b6906011 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 943 time: 0.0535655 Dec 21 05:03:41.534605 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c3d6be9b-ccc7-4538-b213-a08e723e3b86 req-7eca073c-4db4-4a64-8845-7cbd74f3b43b service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846007 Dec 21 05:03:41.565351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19d622ac-5d9b-4c81-942f-ea8be44b0195 req-23acd8fc-b09e-4cd7-bc3c-b9bc21cf2b89 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428283 Dec 21 05:03:42.683102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85115fc-60d5-453d-a662-53465b43b96f req-9801b370-1d69-4464-94f9-469048644a80 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:42.684612 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85115fc-60d5-453d-a662-53465b43b96f req-9801b370-1d69-4464-94f9-469048644a80 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 943 time: 0.0496495 Dec 21 05:03:42.732921 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85115fc-60d5-453d-a662-53465b43b96f req-c76bcba4-4bb7-49c4-88a0-8db325ee9893 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424049 Dec 21 05:03:43.846735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69454e34-656c-4c79-80ef-cde313a2ebdf req-cfec4697-1a87-4422-b685-cfbe8f957054 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:43.848233 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69454e34-656c-4c79-80ef-cde313a2ebdf req-cfec4697-1a87-4422-b685-cfbe8f957054 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 943 time: 0.0479913 Dec 21 05:03:43.900815 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-69454e34-656c-4c79-80ef-cde313a2ebdf req-b800888a-b8a0-4062-bb21-067b37d3e692 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464616 Dec 21 05:03:45.013808 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575324aa-ac9c-46eb-936a-79bfec67b65e req-d4b43fb2-67dd-4c37-b56e-a05da497c9ed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:45.015294 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-575324aa-ac9c-46eb-936a-79bfec67b65e req-d4b43fb2-67dd-4c37-b56e-a05da497c9ed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 943 time: 0.0484555 Dec 21 05:03:45.063414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-575324aa-ac9c-46eb-936a-79bfec67b65e req-9033c75a-3651-49ef-92e2-c52acb8a61e0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417206 Dec 21 05:03:45.429955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6fb99fb1-584a-4ecf-9896-225c6a7fd3de details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:03:45.525815 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:45.537118 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'port_id': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'mac_address': 'fa:16:3e:32:3e:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:03:45.573685 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:45.588055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6fb99fb1-584a-4ecf-9896-225c6a7fd3de {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:03:45.607617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:45.673771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:45.719593 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:45.973307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6fb99fb1-584a-4ecf-9896-225c6a7fd3de'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:03:46.178896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1500667-7749-43aa-a6ff-1ece7031bbef req-aa803264-e65d-4b43-9300-6a7964aec3fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:46.180412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1500667-7749-43aa-a6ff-1ece7031bbef req-aa803264-e65d-4b43-9300-6a7964aec3fe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 944 time: 0.0474977 Dec 21 05:03:46.229564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e1500667-7749-43aa-a6ff-1ece7031bbef req-f8e35871-d275-4855-b932-fafb5de0e440 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431228 Dec 21 05:03:47.355158 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0aa7002-26c4-4851-904e-06383dacae25 req-9389f6e1-63b0-4f46-8af7-f39419edc4ea tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:47.356657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0aa7002-26c4-4851-904e-06383dacae25 req-9389f6e1-63b0-4f46-8af7-f39419edc4ea tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 944 time: 0.0526388 Dec 21 05:03:47.404438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0aa7002-26c4-4851-904e-06383dacae25 req-a28634df-6ddc-46cd-b10d-1b5e4f1be44f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418119 Dec 21 05:03:47.444731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6fb99fb1-584a-4ecf-9896-225c6a7fd3de up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:03:47.553756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:03:47.557766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:03:47.558139 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:47.632866 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:47.654033 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:03:47.656269 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ddd0567-d4e5-4479-a29d-f382cbdee946" -d '{"events": [{"server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "name": "network-vif-plugged", "status": "completed", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:03:47.668545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:03:47.694610 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:03:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c78466c5-ab84-4ee3-8151-f129fd7bfb04 x-openstack-request-id: req-c78466c5-ab84-4ee3-8151-f129fd7bfb04 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:03:47.699244 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "name": "network-vif-plugged", "status": "completed", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:03:47.699244 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-c78466c5-ab84-4ee3-8151-f129fd7bfb04 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:03:47.699244 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'code': 200} Dec 21 05:03:47.736119 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:47.800958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:47.830282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53252514-cf37-4943-9b59-5cf44c275135 req-fa17792b-d1e6-4a5d-a4d3-40d24665b359 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:47.831926 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-53252514-cf37-4943-9b59-5cf44c275135 req-fa17792b-d1e6-4a5d-a4d3-40d24665b359 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1097 time: 0.0455208 Dec 21 05:03:47.880222 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-53252514-cf37-4943-9b59-5cf44c275135 req-c4c14918-ff07-4ca3-a499-3951564d451c service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412478 Dec 21 05:03:48.523297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bfd8610-57ef-495f-9484-024eb8c5f0a0 req-09e6c33f-c4e7-44c2-a305-d1072a1008f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:48.524774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bfd8610-57ef-495f-9484-024eb8c5f0a0 req-09e6c33f-c4e7-44c2-a305-d1072a1008f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0483983 Dec 21 05:03:48.573209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0bfd8610-57ef-495f-9484-024eb8c5f0a0 req-de8f97fa-ee72-4590-9782-5169731caecb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423806 Dec 21 05:03:49.688382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e2208a9-11d9-4f7c-b150-8dd05f9e836c req-da05a5b7-ec48-4f29-80e9-f2ebb05530ce tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:49.689866 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e2208a9-11d9-4f7c-b150-8dd05f9e836c req-da05a5b7-ec48-4f29-80e9-f2ebb05530ce tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0477760 Dec 21 05:03:49.742014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e2208a9-11d9-4f7c-b150-8dd05f9e836c req-3dab1f9e-a705-46b6-8f09-7493401aa671 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456312 Dec 21 05:03:49.854609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3831e198-5d7b-4112-8cd2-67b28e00b449 req-a092d682-7373-48df-8d72-0e9a2b445e0e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:49.856029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3831e198-5d7b-4112-8cd2-67b28e00b449 req-a092d682-7373-48df-8d72-0e9a2b445e0e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0479214 Dec 21 05:03:49.907642 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3831e198-5d7b-4112-8cd2-67b28e00b449 req-40555ce5-6a4a-4394-979c-ae0db5f0bccd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456262 Dec 21 05:03:49.947338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51794) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:49.991800 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4285d54a-77bf-48a6-8515-0fdd7b060f81 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:49.993543 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4285d54a-77bf-48a6-8515-0fdd7b060f81 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1092 time: 0.0451322 Dec 21 05:03:49.996546 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51796) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:50.000998 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address': '172.20.0.6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:03:50.040053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f32038b-2d4b-49a1-8970-e41a3e021fe5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:50.085521 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:50.185667 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:50.286297 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.233 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/ca5c1e31-e87f-467a-925c-c0c5fdba8229) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:03:50.388413 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:50.485091 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:50.524962 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:03:50.527837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:03:50.531256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:03:50.537282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=ca5c1e31-e87f-467a-925c-c0c5fdba8229,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:50.895882 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:51.017408 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:51.164216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:51.233569 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:51.309301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=ca5c1e31-e87f-467a-925c-c0c5fdba8229,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:03:51.319236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:51.419536 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9 associated. External IP: 172.25.5.233, port: 6fb99fb1-584a-4ecf-9896-225c6a7fd3de. Dec 21 05:03:51.625195 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 7c042ab7-bbdc-4f76-9f64-7e273303a817 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:03:51.726783 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:03:51.736514 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] Sync routers for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:03:51.746486 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:51.748597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:51.790142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:51.821298 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d35be0ad-3ccb-4bbd-a39c-27b51de51055 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8237154 Dec 21 05:03:51.821996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:03:51.824398 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-daaacc13-7cfd-402e-914e-e9566a826f97" -d '{"events": [{"name": "network-changed", "server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:03:51.929060 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:03:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31ab3375-4126-4191-b316-c7dea9304f9e x-openstack-request-id: req-31ab3375-4126-4191-b316-c7dea9304f9e {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:03:51.929402 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:03:51.929637 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-31ab3375-4126-4191-b316-c7dea9304f9e {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:03:51.930050 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'status': 'completed', 'code': 200} Dec 21 05:03:51.936328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48547451-fbb5-4240-b79a-10e711598903 req-5e77251b-fb52-4678-beee-2a3277f4c8cb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:51.937914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48547451-fbb5-4240-b79a-10e711598903 req-5e77251b-fb52-4678-beee-2a3277f4c8cb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0634060 Dec 21 05:03:51.990195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48547451-fbb5-4240-b79a-10e711598903 req-9cfbd941-ee31-4975-80cc-0a1157b9e333 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449924 Dec 21 05:03:52.013474 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51804) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:52.017242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-793eae7c-0136-4e57-9b23-402427d3860c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:52.018950 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-793eae7c-0136-4e57-9b23-402427d3860c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1097 time: 0.0452316 Dec 21 05:03:52.026362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:52.079669 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3b2affca-8897-4f10-bd98-4c03bfe9df0b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9 HTTP/1.1" status: 200 len: 991 time: 0.0649402 Dec 21 05:03:52.111447 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-f9bf9f40-0631-416d-8aa5-d9c56a74fac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:52.113527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-f9bf9f40-0631-416d-8aa5-d9c56a74fac5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 897 time: 0.0864229 Dec 21 05:03:52.183127 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-44ec1aa8-7a7f-4e7a-8de3-3cab625e004f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 999 time: 0.0609822 Dec 21 05:03:52.231282 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-4b7d5b36-b9b3-4565-87d0-150df1d30b50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:52.232740 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-4b7d5b36-b9b3-4565-87d0-150df1d30b50 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 200 len: 834 time: 0.0429053 Dec 21 05:03:52.256158 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.233', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'port_id': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4241, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'mac_address': 'fa:16:3e:32:3e:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:03:50Z', 'updated_at': '2021-12-21T05:03:50Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:52.278174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-e8e2e539-5a02-40f6-b4a6-aea050fa25a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:52.279700 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-e8e2e539-5a02-40f6-b4a6-aea050fa25a5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0396559 Dec 21 05:03:52.285613 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] Checking router: 7c042ab7-bbdc-4f76-9f64-7e273303a817 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:03:52.294289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:03:52.294899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:03:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:52.372289 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-5070c116-07be-4cfd-b899-67c58a01c2c6 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853312 Dec 21 05:03:52.400101 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:03:52.466947 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-daaacc13-7cfd-402e-914e-e9566a826f97 req-0013f04b-4a6a-41b1-9e9b-039d0476e761 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870740 Dec 21 05:03:52.620689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.233', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'port_id': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4241, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'mac_address': 'fa:16:3e:32:3e:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:03:50Z', 'updated_at': '2021-12-21T05:03:50Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:03:52.655091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-649d2aaa-fb0e-49bc-9d3c-8ff2e8975b1f None None] The sync data for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 is: [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.233', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'port_id': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4241, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'mac_address': 'fa:16:3e:32:3e:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:03:50Z', 'updated_at': '2021-12-21T05:03:50Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:03:52.720072 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fe067f4d-a84d-4347-ad43-fe3cb3cbcb15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:52.857586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-161adb49-00e0-40c3-9076-745faa57a460 None None] New status for floating IP f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:03:53.082925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51806) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:03:53.143445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-edc9337e-2f1f-4a25-ad76-39478655544c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9 HTTP/1.1" status: 200 len: 993 time: 0.0593200 Dec 21 05:03:53.587848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:53.668114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:53.874869 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:03:55.336383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:55.445049 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:55.827914 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:03:57.414805 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-caf3634a-c8b6-44c8-a83b-40d11d48a23c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0387430 Dec 21 05:03:57.526088 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-c06264ba-bbfe-407e-8789-b490575b956f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:57.527672 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-c06264ba-bbfe-407e-8789-b490575b956f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1097 time: 0.0408230 Dec 21 05:03:57.638270 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-81c4e744-27c2-467e-a9be-9a6b9978de44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:57.639747 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-81c4e744-27c2-467e-a9be-9a6b9978de44 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 897 time: 0.0940228 Dec 21 05:03:57.703402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-b04ab299-6d3b-4c49-8d73-cd8f0b33b91c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 1001 time: 0.0556083 Dec 21 05:03:57.750458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-bbb9cf94-b14f-4bc7-9167-492e80c57ce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:57.751852 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-bbb9cf94-b14f-4bc7-9167-492e80c57ce2 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 200 len: 834 time: 0.0414233 Dec 21 05:03:57.799132 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-c3df69b2-833e-47db-9dd1-7e9d0a379000 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:03:57.801166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-c3df69b2-833e-47db-9dd1-7e9d0a379000 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0416806 Dec 21 05:03:57.888249 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-3799e4b2-5d65-437f-b52c-9cac1c9f4de4 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803657 Dec 21 05:03:57.981212 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-09b76ab6-8937-494b-91ca-7e1de1e32f74 req-d6a62e5f-ad9e-4871-b971-1e805970843a service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853963 Dec 21 05:04:19.958775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34cd0d30-833f-4692-b5f1-b4fe53a787bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:22.720781 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1dc665e6-6121-480b-a8c8-1e4f6c8b0c96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:23.564602 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:23.633131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:24.691305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1659302d-95f0-4875-afeb-392e51a55717 req-b7736fc7-7acb-4679-ad7e-13423454c004 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:24.693518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1659302d-95f0-4875-afeb-392e51a55717 req-b7736fc7-7acb-4679-ad7e-13423454c004 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0528276 Dec 21 05:04:24.743716 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1659302d-95f0-4875-afeb-392e51a55717 req-00c3c12b-1c2d-44a7-9429-8b50d73cf283 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442748 Dec 21 05:04:24.765617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-659ad66d-72c9-4314-8d63-84289c436f7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:24.767187 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-659ad66d-72c9-4314-8d63-84289c436f7f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1097 time: 0.0423355 Dec 21 05:04:24.857744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-e0d3c08e-5928-40c1-a1d0-d43ae12be4c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:24.859210 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-e0d3c08e-5928-40c1-a1d0-d43ae12be4c2 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 897 time: 0.0849905 Dec 21 05:04:25.263804 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-41d39f8a-833c-4c05-9adc-4c74ab308376 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 1001 time: 0.3960223 Dec 21 05:04:25.313862 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-d2ec3965-4c3a-44e9-8f63-6d77b9234a5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:25.315323 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-d2ec3965-4c3a-44e9-8f63-6d77b9234a5a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 200 len: 834 time: 0.0432684 Dec 21 05:04:25.330143 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:25.364196 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-d89f3da6-6b14-4244-a76d-e1252c1250b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:25.365669 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-d89f3da6-6b14-4244-a76d-e1252c1250b8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0425835 Dec 21 05:04:25.456283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:25.459402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-9160e3c4-ef01-46b3-b833-27a1b6bd2e05 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857396 Dec 21 05:04:25.551330 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c91a7d06-f157-450d-92d3-3366bb1e2a58 req-969999e6-4372-4946-a4e0-3f4bf83cb34f service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846236 Dec 21 05:04:25.798945 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:25.861655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937bddb6-84e1-4d3e-8fa3-fc40d0419778 req-5bb05cbb-8e4f-46fe-8253-200ee245d371 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:25.863215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-937bddb6-84e1-4d3e-8fa3-fc40d0419778 req-5bb05cbb-8e4f-46fe-8253-200ee245d371 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0489354 Dec 21 05:04:25.911447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-937bddb6-84e1-4d3e-8fa3-fc40d0419778 req-50979a3d-1ac3-4568-855d-6a40adf287d4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417633 Dec 21 05:04:27.034255 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd62971d-3fea-47cf-b618-faf82a9d0fb5 req-733b61cd-a877-4f2a-ac5f-17733a65b75b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:27.036283 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd62971d-3fea-47cf-b618-faf82a9d0fb5 req-733b61cd-a877-4f2a-ac5f-17733a65b75b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0540950 Dec 21 05:04:27.087154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd62971d-3fea-47cf-b618-faf82a9d0fb5 req-ccfc02da-e4d9-4f97-bcff-efd0b7e6d323 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448506 Dec 21 05:04:28.203080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfdb7a37-9d55-4b52-b87b-27778a656840 req-ee339240-07a1-4ddd-bb27-9ca6dd647774 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:28.204538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfdb7a37-9d55-4b52-b87b-27778a656840 req-ee339240-07a1-4ddd-bb27-9ca6dd647774 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0474508 Dec 21 05:04:28.252683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dfdb7a37-9d55-4b52-b87b-27778a656840 req-f2ea6fdf-b7ba-44cc-a461-2654b82c3913 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417819 Dec 21 05:04:29.378830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ecfe79-9889-446d-a215-fe19f28e90b0 req-d41cb84f-2100-425b-996c-d90dbdfa0a38 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:29.380485 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1ecfe79-9889-446d-a215-fe19f28e90b0 req-d41cb84f-2100-425b-996c-d90dbdfa0a38 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0565715 Dec 21 05:04:29.447240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a1ecfe79-9889-446d-a215-fe19f28e90b0 req-4f833b78-f493-4d14-8219-aafe66d2b2b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577369 Dec 21 05:04:30.560142 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc8dd96-8b72-4599-b063-020c2a6255ad req-19109bfd-4f61-483d-bed0-e622e28e482b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:30.561644 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dc8dd96-8b72-4599-b063-020c2a6255ad req-19109bfd-4f61-483d-bed0-e622e28e482b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0481222 Dec 21 05:04:30.609622 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6dc8dd96-8b72-4599-b063-020c2a6255ad req-cee98568-5ead-4172-90c8-0c6429d0a87b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414169 Dec 21 05:04:30.874764 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:04:31.723718 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a719ac2a-ba0f-44e8-8f3b-d49f93e05543 req-597160f3-eed5-4cba-9460-3391f4c9d0f3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:31.725189 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a719ac2a-ba0f-44e8-8f3b-d49f93e05543 req-597160f3-eed5-4cba-9460-3391f4c9d0f3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0483022 Dec 21 05:04:31.773284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a719ac2a-ba0f-44e8-8f3b-d49f93e05543 req-ced4644b-0f8a-4ac1-9ab4-97e9899595a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418816 Dec 21 05:04:32.890305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d010d03c-97f2-4550-84b6-ad0e430ef931 req-0cde594f-c601-4778-abc8-35f0cffff750 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:32.891712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d010d03c-97f2-4550-84b6-ad0e430ef931 req-0cde594f-c601-4778-abc8-35f0cffff750 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0518398 Dec 21 05:04:32.939628 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d010d03c-97f2-4550-84b6-ad0e430ef931 req-8470e39a-a273-4bcb-9b7a-f2984b74ef59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415235 Dec 21 05:04:34.054713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6bb9a79-1c51-4219-80d0-6772ff4328f5 req-ae9b635a-b023-471e-9300-0c50d2d71036 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:34.056224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6bb9a79-1c51-4219-80d0-6772ff4328f5 req-ae9b635a-b023-471e-9300-0c50d2d71036 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0482485 Dec 21 05:04:34.104684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6bb9a79-1c51-4219-80d0-6772ff4328f5 req-130016c4-00fe-4b6a-b573-36da3ee5a8a4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426152 Dec 21 05:04:35.217376 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-668be4b9-3f5c-4a2d-b716-808153461b6f req-46929ca2-70b0-4a27-b561-4531447c56de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:35.218823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-668be4b9-3f5c-4a2d-b716-808153461b6f req-46929ca2-70b0-4a27-b561-4531447c56de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0473263 Dec 21 05:04:35.270952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-668be4b9-3f5c-4a2d-b716-808153461b6f req-e5694a7e-963d-4a72-b442-ca4d3484c8df tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456066 Dec 21 05:04:36.384773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41086359-4e16-4355-8798-86fd4438b487 req-aa1f67a1-1698-465b-930a-d319add92c4b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:36.386245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41086359-4e16-4355-8798-86fd4438b487 req-aa1f67a1-1698-465b-930a-d319add92c4b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0484300 Dec 21 05:04:36.433345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41086359-4e16-4355-8798-86fd4438b487 req-2bc6f9c6-bbc3-473a-b535-02b249ef3858 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412104 Dec 21 05:04:37.550210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199714cb-15fd-471b-a315-cf15e0242886 req-5ec4f8aa-874b-40af-9564-4b387407daa7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:37.551720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-199714cb-15fd-471b-a315-cf15e0242886 req-5ec4f8aa-874b-40af-9564-4b387407daa7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0474401 Dec 21 05:04:37.600504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-199714cb-15fd-471b-a315-cf15e0242886 req-fc29980c-47c4-4aaf-b224-86bcc772cdb5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427818 Dec 21 05:04:38.716776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b19093-85a4-41d2-978c-5409f957dcdd req-401f3245-7be6-44dc-8efd-c5ff091620fd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:38.718265 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80b19093-85a4-41d2-978c-5409f957dcdd req-401f3245-7be6-44dc-8efd-c5ff091620fd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0504644 Dec 21 05:04:38.766147 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-80b19093-85a4-41d2-978c-5409f957dcdd req-d32746e0-ca1e-4db7-8bf4-958ae16114a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413790 Dec 21 05:04:39.880992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77038041-0746-4954-82e1-a1d5754ff889 req-b35a6af2-2437-41d6-8bc9-070865029c2c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:39.882370 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77038041-0746-4954-82e1-a1d5754ff889 req-b35a6af2-2437-41d6-8bc9-070865029c2c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0484450 Dec 21 05:04:39.931526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77038041-0746-4954-82e1-a1d5754ff889 req-908163c7-ce7e-4c60-9715-ae3e6d6f2211 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431790 Dec 21 05:04:41.055534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d773375d-23db-4c5c-aee4-61a26f6e99dc req-dc24bf92-95a0-41b6-bd4c-0f6b15d65a83 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:41.058044 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d773375d-23db-4c5c-aee4-61a26f6e99dc req-dc24bf92-95a0-41b6-bd4c-0f6b15d65a83 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0586400 Dec 21 05:04:41.109289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d773375d-23db-4c5c-aee4-61a26f6e99dc req-dbfddffb-cc7a-40cf-969e-b02723545d03 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448682 Dec 21 05:04:42.226006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94ef000c-12d5-424a-8717-ee88b0294265 req-a9756ae7-88e0-465f-b897-50263293baa5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:42.227504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94ef000c-12d5-424a-8717-ee88b0294265 req-a9756ae7-88e0-465f-b897-50263293baa5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0474260 Dec 21 05:04:42.276430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-94ef000c-12d5-424a-8717-ee88b0294265 req-3f441e04-6044-4d54-9029-c5f9257dd64c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427248 Dec 21 05:04:42.298000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51854) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:04:42.359582 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9d7cfde2-d99e-43d8-94c2-4e9752e1674f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9 HTTP/1.1" status: 200 len: 993 time: 0.0604761 Dec 21 05:04:49.918827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e7b203f8-f289-44d8-b3d4-c889b61b36f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:52.730120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d0015a96-5817-4ccf-8c15-a201c3496a2b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:53.581720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:53.684349 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:55.329923 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:55.444559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:55.832723 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:04:58.420208 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-0edbc4c5-1112-4315-a5c6-98591102279d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0392361 Dec 21 05:04:58.516822 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06378531-9a8c-4912-8244-19b78c520fa2 req-906d8208-407e-43ff-956f-93774f9a71db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:58.518299 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-906d8208-407e-43ff-956f-93774f9a71db service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1097 time: 0.0398927 Dec 21 05:04:58.625185 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06378531-9a8c-4912-8244-19b78c520fa2 req-dbe7b419-0021-461c-b0d0-8a431662f6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:58.627081 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-dbe7b419-0021-461c-b0d0-8a431662f6bc service neutron] 10.222.0.54 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 897 time: 0.0874698 Dec 21 05:04:58.690537 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-d24f1e62-2c4d-44fd-9889-517e85776fd2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 1001 time: 0.0564313 Dec 21 05:04:58.742739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06378531-9a8c-4912-8244-19b78c520fa2 req-31465ea1-1730-4b95-b43d-5b9f0ba4698d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:58.744277 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-31465ea1-1730-4b95-b43d-5b9f0ba4698d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 200 len: 834 time: 0.0466430 Dec 21 05:04:58.790085 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06378531-9a8c-4912-8244-19b78c520fa2 req-93a40118-96fb-4ddf-8cb6-21f3b19036aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:04:58.791583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-93a40118-96fb-4ddf-8cb6-21f3b19036aa service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0391061 Dec 21 05:04:58.879753 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-61d6af1c-bca9-4414-8271-27b7163370a9 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799108 Dec 21 05:04:58.970415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06378531-9a8c-4912-8244-19b78c520fa2 req-0755dcc4-b001-4f1b-b0f7-6a39d6233569 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825450 Dec 21 05:05:07.873162 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:05:12.914404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51870) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:13.069561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port ca5c1e31-e87f-467a-925c-c0c5fdba8229 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:05:13.069927 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:13.142285 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:13.142605 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:13.154565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for ca5c1e31-e87f-467a-925c-c0c5fdba8229 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:05:13.382387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:13.405491 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=ca5c1e31-e87f-467a-925c-c0c5fdba8229,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:13.415902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.416264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.416617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.416964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.417303 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.418130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.418130 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.418334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.418605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.418964 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.419294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.419621 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.419948 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:13.481607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:13.481835 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9 disassociated (deleted). External IP: 172.25.5.233, port: 6fb99fb1-584a-4ecf-9896-225c6a7fd3de. Dec 21 05:05:13.974312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 7c042ab7-bbdc-4f76-9f64-7e273303a817 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:05:14.079378 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:05:14.084216 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:14.088765 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] Sync routers for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:05:14.097700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:14.098355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:04:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:14.112241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-d01c38f6-5ca0-46c8-8508-348d8b2dc505 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/floatingips/f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9 HTTP/1.1" status: 204 len: 168 time: 1.1942976 Dec 21 05:05:14.112241 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:05:14.112840 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1435a5ce-cf04-4417-8af1-77f631152551" -d '{"events": [{"name": "network-changed", "server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:05:14.210725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:14.211475 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:05:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-031c4f21-f6db-490e-a8fc-928804d3c36d x-openstack-request-id: req-031c4f21-f6db-490e-a8fc-928804d3c36d {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:05:14.211768 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:05:14.212027 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-031c4f21-f6db-490e-a8fc-928804d3c36d {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:05:14.212432 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'status': 'completed', 'code': 200} Dec 21 05:05:14.294995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1435a5ce-cf04-4417-8af1-77f631152551 req-6a2ab111-8ca1-4d16-806f-2a7ba6932afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:14.296416 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-6a2ab111-8ca1-4d16-806f-2a7ba6932afe service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 1097 time: 0.0419524 Dec 21 05:05:14.391292 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1435a5ce-cf04-4417-8af1-77f631152551 req-9ddd03fa-e556-495f-bed4-0101bdec1439 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:14.392878 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-9ddd03fa-e556-495f-bed4-0101bdec1439 service neutron] 10.222.0.54 "GET /v2.0/networks?id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 200 len: 897 time: 0.0897839 Dec 21 05:05:14.412362 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:14.434438 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-e85d0a49-bca2-4173-b7fe-c4037eab6e5f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 200 len: 217 time: 0.0347104 Dec 21 05:05:14.438813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] Checking router: 7c042ab7-bbdc-4f76-9f64-7e273303a817 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:05:14.448186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:14.448836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:04:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:14.507859 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1435a5ce-cf04-4417-8af1-77f631152551 req-4f1aef8b-ab8f-4cc0-960c-bbf97ca82807 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:14.509361 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-4f1aef8b-ab8f-4cc0-960c-bbf97ca82807 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 200 len: 834 time: 0.0456457 Dec 21 05:05:14.549345 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbdbba58-4ca6-47de-b4dd-fdd5e1708a0e req-d8ca3bb1-122b-4f9a-b253-6bf5f8bddeed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:14.550865 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbdbba58-4ca6-47de-b4dd-fdd5e1708a0e req-d8ca3bb1-122b-4f9a-b253-6bf5f8bddeed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0506032 Dec 21 05:05:14.557383 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:14.562739 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1435a5ce-cf04-4417-8af1-77f631152551 req-8fb19aa9-52ce-4d63-8e26-aef5c560bd9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:14.564436 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-8fb19aa9-52ce-4d63-8e26-aef5c560bd9c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0466926 Dec 21 05:05:14.608942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fbdbba58-4ca6-47de-b4dd-fdd5e1708a0e req-19a9966f-67e3-4c1d-a902-6aad80d486aa tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491953 Dec 21 05:05:14.663580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-a8328ae2-ad20-4700-9529-3a490293623a service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906858 Dec 21 05:05:14.759418 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-1435a5ce-cf04-4417-8af1-77f631152551 req-ebd5c1b8-b690-45e0-b1e9-096b258484f5 service neutron] 10.222.0.54 "GET /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866232 Dec 21 05:05:14.770117 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:14.796565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca5b8a60-5fdb-44ae-9072-08249548533c None None] The sync data for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 is: [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'cff7f0c1-4a84-4bd5-b71e-9db34a1ef455', 'name': '', 'network_id': '5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:5a:d9:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_interface', 'standard_attr_id': 4238, 'fixed_ips': [{'subnet_id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:33Z', 'updated_at': '2021-12-21T05:03:37Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '7dc8df11-1a1b-4a8c-aad1-88dc84503821', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:05:15.016004 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9afbc677-822b-4a58-b2a8-adb75f6dc67a None None] New status for floating IP f3e6d7b8-5665-41f9-9ba8-ffc6ecba26f9: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:05:15.730259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2223e8-b4d0-4a21-8153-af9517bce732 req-55903712-5463-4996-840d-77344926d0c1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:15.731760 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f2223e8-b4d0-4a21-8153-af9517bce732 req-55903712-5463-4996-840d-77344926d0c1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0483668 Dec 21 05:05:15.782926 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9f2223e8-b4d0-4a21-8153-af9517bce732 req-82568130-0681-4e74-a7eb-0ef8796a8be8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452740 Dec 21 05:05:16.116067 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-82c983f6-fc37-467a-a72a-c1a08b220ac6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:16.117631 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-82c983f6-fc37-467a-a72a-c1a08b220ac6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 945 time: 0.0480413 Dec 21 05:05:16.206977 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:05:16.207314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:16.302954 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:16.303325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:16.315363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 6fb99fb1-584a-4ecf-9896-225c6a7fd3de owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:05:16.518839 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:16.546005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=6fb99fb1-584a-4ecf-9896-225c6a7fd3de,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:16.560943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.560943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.560943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.560943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.560943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.560943 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.561427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.561614 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.561864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.562174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.562508 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.562837 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.563203 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:16.607420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] No DVR routers for this DVR port 6fb99fb1-584a-4ecf-9896-225c6a7fd3de on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:05:16.610311 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:16.614098 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b2902271-cfdf-4e8a-9370-02f50fbc4eea req-077d0905-5e37-46d0-8a90-a82e443ca9c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "DELETE /v2.0/ports/6fb99fb1-584a-4ecf-9896-225c6a7fd3de HTTP/1.1" status: 204 len: 173 time: 0.4888513 Dec 21 05:05:16.615276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'name': 'network-vif-deleted', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:05:16.617587 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d29026dd-43f8-481e-afcf-a9a5b3d77a54" -d '{"events": [{"server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "name": "network-vif-deleted", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:05:16.653022 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:05:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-734a10e4-02fa-460e-9ff5-44f773e71283 x-openstack-request-id: req-734a10e4-02fa-460e-9ff5-44f773e71283 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:05:16.653325 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd71c1aa-0c2a-49f4-af07-8f91511aec9c", "name": "network-vif-deleted", "tag": "6fb99fb1-584a-4ecf-9896-225c6a7fd3de", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:05:16.653592 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-734a10e4-02fa-460e-9ff5-44f773e71283 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:05:16.654040 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd71c1aa-0c2a-49f4-af07-8f91511aec9c', 'name': 'network-vif-deleted', 'tag': '6fb99fb1-584a-4ecf-9896-225c6a7fd3de', 'status': 'completed', 'code': 200} Dec 21 05:05:16.877065 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-06007016-35cc-428f-ba2b-3bf9ff299c04 req-e505982e-22a5-47c0-b042-36f80f1a5781 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=cd71c1aa-0c2a-49f4-af07-8f91511aec9c HTTP/1.1" status: 200 len: 210 time: 0.0259795 Dec 21 05:05:17.935006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51888) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:18.284963 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:18.532081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:05:18.532425 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:18.622049 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port cff7f0c1-4a84-4bd5-b71e-9db34a1ef455, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:18.622416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:18.634610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:05:18.879004 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:18.903107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=cff7f0c1-4a84-4bd5-b71e-9db34a1ef455,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:19.076636 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.296357 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 7c042ab7-bbdc-4f76-9f64-7e273303a817 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:05:19.402190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:05:19.407494 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-84f51e47-ed47-4bd6-b292-c5aee125c804 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/7c042ab7-bbdc-4f76-9f64-7e273303a817/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4713686 Dec 21 05:05:19.410315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51890) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:19.411731 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] Sync routers for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:05:19.421139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:19.421744 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:04:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:19.460527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting subnet 7dc8df11-1a1b-4a8c-aad1-88dc84503821 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:05:19.463683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.508610 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.526462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:19.590172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.707351 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:05:18Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:19.724778 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.733816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] Checking router: 7c042ab7-bbdc-4f76-9f64-7e273303a817 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:05:19.742360 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] Routers {'7c042ab7-bbdc-4f76-9f64-7e273303a817'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:19.742992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:04:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['7c042ab7-bbdc-4f76-9f64-7e273303a817'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:19.756687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Subnet': ['ID=7dc8df11-1a1b-4a8c-aad1-88dc84503821,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:19.760457 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.763602 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bf00b3dc-9dd1-43ee-8bd3-cc49435385b9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/subnets/7dc8df11-1a1b-4a8c-aad1-88dc84503821 HTTP/1.1" status: 204 len: 168 time: 0.3523254 Dec 21 05:05:19.766123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51892) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:19.779192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-552aaa3a-c1b1-46cf-bdd8-c0a21cb50e0c None None] Network 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:05:19.872720 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:19.980661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.009448 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6fb99fb1-584a-4ecf-9896-225c6a7fd3de no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:05:20.076291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 6fb99fb1-584a-4ecf-9896-225c6a7fd3de {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:05:20.076551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6fb99fb1-584a-4ecf-9896-225c6a7fd3de not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:05:20.086482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:05:20.096072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.117261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] Set router 7c042ab7-bbdc-4f76-9f64-7e273303a817 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:20.165881 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:20.166292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.172998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d88f3dab-f38e-4ac3-b951-9149d8a4a3cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.180492 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:05:20.251745 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] DHCP port deletion for 5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:05:20.341689 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:05:18Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:20.345685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Deleting port d74becff-b991-4854-bdec-9b775473ba6e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:05:20.346083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.372322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e84df5c7-9e19-435c-aa31-1086b414bb09 None None] The sync data for ids ['7c042ab7-bbdc-4f76-9f64-7e273303a817'] in n-d-822053-11 is: [{'id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'name': 'tempest-TestNetworkAdvancedServerOps-router-2077190863', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176'}], 'enable_snat': True}, 'gw_port_id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:03:30Z', 'updated_at': '2021-12-21T05:05:18Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '4e494d7c-b77a-4adc-aeb5-e8759f6e1a75', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:18:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7c042ab7-bbdc-4f76-9f64-7e273303a817', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4235, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:03:31Z', 'updated_at': '2021-12-21T05:03:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:05:20.416147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.436777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] For port d74becff-b991-4854-bdec-9b775473ba6e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d74becff-b991-4854-bdec-9b775473ba6e,segment=NetworkSegment(5862eccc-95bf-4326-ba5f-201bda6d9e8c),segment_id=5862eccc-95bf-4326-ba5f-201bda6d9e8c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:20.437376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.440494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=4e494d7c-b77a-4adc-aeb5-e8759f6e1a75,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:20.451845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Calling delete_port for d74becff-b991-4854-bdec-9b775473ba6e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:05:20.457369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-decd1a7e-adf8-47bc-811a-6de40338487f None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:05:20.509191 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.604728 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.605561 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.607862 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.631018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Pushing event deleted for resources: {'Port': ['ID=d74becff-b991-4854-bdec-9b775473ba6e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:20.635169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] No DVR routers for this DVR port d74becff-b991-4854-bdec-9b775473ba6e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:05:20.642144 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.642504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.642855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.643227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.643570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.643910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.644496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.644590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.644880 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.645209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.645544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.645870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.647173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abb81315-010e-4b6d-8935-cc8be97de3de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:20.718682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.719282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Fanout notify agent at l3_agent the message router_deleted on router 7c042ab7-bbdc-4f76-9f64-7e273303a817 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:05:20.728466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.728466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4e2d74b7-9a4b-4b16-a89f-b12e1b973e4a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/routers/7c042ab7-bbdc-4f76-9f64-7e273303a817 HTTP/1.1" status: 204 len: 168 time: 0.9612825 Dec 21 05:05:20.731395 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51894) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:20.807331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.902030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.922692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:20.932513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5862eccc-95bf-4326-ba5f-201bda6d9e8c') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:20.932812 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5862eccc-95bf-4326-ba5f-201bda6d9e8c') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:20.942705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.956389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.963367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:05:20.963682 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:05:20.968573 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:05:21.095260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.102189 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.105466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/networks/5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6 HTTP/1.1" status: 204 len: 168 time: 0.3731246 Dec 21 05:05:21.108351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51896) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:21.116219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5880938b-0ce6-40ff-baa9-ccde40fb9790 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Network': ['ID=5792c3ec-1d8e-4e7c-93b2-5f2dfd1e14b6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:21.165430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b385e9e-280a-474e-ba91-f4601c7d6d73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.189358 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b385e9e-280a-474e-ba91-f4601c7d6d73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.319477 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b385e9e-280a-474e-ba91-f4601c7d6d73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.322095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6b385e9e-280a-474e-ba91-f4601c7d6d73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.323527 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6b385e9e-280a-474e-ba91-f4601c7d6d73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/security-groups/7bfe2059-fe02-46b5-a7cb-25c431bbf5e3 HTTP/1.1" status: 204 len: 168 time: 0.2140379 Dec 21 05:05:21.332985 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b385e9e-280a-474e-ba91-f4601c7d6d73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bfe2059-fe02-46b5-a7cb-25c431bbf5e3,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:21.411316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:05:21.437944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:05:21.437944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device cff7f0c1-4a84-4bd5-b71e-9db34a1ef455 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:05:21.437944 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d74becff-b991-4854-bdec-9b775473ba6e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:05:21.456937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d74becff-b991-4854-bdec-9b775473ba6e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:05:21.457250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d74becff-b991-4854-bdec-9b775473ba6e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:05:21.457663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:05:21.477103 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:05:21.477528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4e494d7c-b77a-4adc-aeb5-e8759f6e1a75 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:05:21.619401 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51902) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:21.624133 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1995665', 'description': 'tempest-secgroup-smoke-1995665 description', 'project_id': '7037c5e415f34eb2b218d59f1243d003'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:21.684195 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.747206 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.826620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.854997 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=06bf9a23-2390-4757-a9ff-a84d58c37b72,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:21.908723 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:21.909940 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-30174d3f-451d-4dba-a38b-40976624e3ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1807 time: 0.2895174 Dec 21 05:05:21.913346 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51904) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:21.917557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '06bf9a23-2390-4757-a9ff-a84d58c37b72', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:22.038379 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.102155 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.198325 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.216959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5be7ea56-3726-4fa2-9d45-022c1580a3a3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:22.280435 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.281641 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6dad496a-0416-4cc6-9043-9cbeb3177a78 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3673892 Dec 21 05:05:22.284403 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51906) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:22.289538 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '06bf9a23-2390-4757-a9ff-a84d58c37b72', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:22.391266 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.444620 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.518352 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.539031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1c44daf6-e35c-4846-a1c2-1a339f2e86e4,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:22.588866 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.591318 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-910cd769-e49e-4a7f-9a91-eb1f0500f6e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3047729 Dec 21 05:05:22.592811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51908) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:22.599116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '06bf9a23-2390-4757-a9ff-a84d58c37b72', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:22.677912 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.724500 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7f0f0610-7a24-468c-8ccc-ca481933cb99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.733991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.810194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.827115 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1ee1c44a-07f5-4324-b4ed-bc87d0ad594e,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:22.909495 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:22.910737 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7aa37c43-f69d-4b57-8ca5-0a029cd31027 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3169873 Dec 21 05:05:22.914030 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51910) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:22.918314 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '06bf9a23-2390-4757-a9ff-a84d58c37b72', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:23.020339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.080125 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.158440 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.175942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c72aac9d-caab-4b41-8a19-0172439248a6,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:23.258199 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.259479 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-faacdcd6-f774-46a4-9b02-ec86ae6a653a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3445101 Dec 21 05:05:23.262064 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51912) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:23.266347 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '06bf9a23-2390-4757-a9ff-a84d58c37b72', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:23.352944 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:05:23.358093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.414400 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.472768 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.495363 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1855866-ea29-41ac-a4fe-4065f2686bf6,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:23.554422 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.555686 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e2815ff7-69a5-478a-a1db-505f7c7a762b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2926848 Dec 21 05:05:23.558415 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51914) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:23.562716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '06bf9a23-2390-4757-a9ff-a84d58c37b72', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:23.575835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.644608 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:05:23.650259 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.667392 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.707169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.764307 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.781867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1cf4a4d9-5849-44ed-895c-3c71487a66da,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:23.845357 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.846633 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c5414033-de71-4eaa-ba50-a6c4a369b6af tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2871873 Dec 21 05:05:23.849433 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51916) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:23.855101 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'network': {'name': 'tempest-network-smoke--887477040', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:23.958316 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:05:23.962418 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.985018 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:05:23.993390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:23.993737 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Added segment 021f92d0-9a21-40a5-a75a-1804a88c5dc1 of type vlan for network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb Dec 21 05:05:24.033275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.112611 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:05:24.114983 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:05:24.118377 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:24.118908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.184863 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Network': ['ID=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:24.195354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:05:24.230619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c0d7e177-3f2c-41e6-9b7d-6da9d95d7f0a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3800981 Dec 21 05:05:24.233327 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51918) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:24.237806 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'admin_state_up': True, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:24.324161 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.325271 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.375068 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.582832 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.838974 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.858142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:24.970060 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.118 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/1cae8d20-2120-474a-82b2-95856ba3683f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:05:25.073704 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.164823 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.201709 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:05:25.204545 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:25.207947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:05:25.218795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9e1ad58-f50d-43a2-b67d-3c3ae79495c8 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:05:25.253211 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=1cae8d20-2120-474a-82b2-95856ba3683f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:25.283195 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d2a7549-2b11-49a0-9016-ed1c6d252c6a None None] Provisioning complete for port 1cae8d20-2120-474a-82b2-95856ba3683f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:25.283582 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d2a7549-2b11-49a0-9016-ed1c6d252c6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.318199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-2d2a7549-2b11-49a0-9016-ed1c6d252c6a None None] Port 1cae8d20-2120-474a-82b2-95856ba3683f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:05:25.341663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.461683 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.559953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.757792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.816003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:25.980557 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:05:26.086150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:05:26.095511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Sync routers for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:05:26.104940 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:26.105543 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:05:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:26.155006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.159250 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-04e856ce-dc17-4e4a-bb32-77632b584b5c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 893 time: 1.9220896 Dec 21 05:05:26.159520 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51920) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:26.188437 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a8dd6d51-584a-4038-b0f4-08113c4bc2cc tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=7037c5e415f34eb2b218d59f1243d003&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0278256 Dec 21 05:05:26.191033 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51922) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:26.208716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:26.279175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f84d2e4-e8a6-4658-85e9-e80fc02e4769 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:26.282327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8f84d2e4-e8a6-4658-85e9-e80fc02e4769 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0904346 Dec 21 05:05:26.283432 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51924) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:26.311538 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-60c298f1-3443-4d5b-896b-5d6ef230e3a4 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0270395 Dec 21 05:05:26.314009 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51926) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:26.318553 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-902310790', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:26.381615 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:25Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:26.410333 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Checking router: ba84f4c8-a332-4ad1-8223-2f24b165fbe8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:05:26.416410 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Updating router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 port 1cae8d20-2120-474a-82b2-95856ba3683f binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:05:26.434863 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.461500 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:05:26.465169 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.678920 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.736178 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.775746 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.800450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Subnet': ['ID=350d6f1e-fe44-464c-8289-ee6194ca3e98,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:26.807597 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Checking segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:05:26.807960 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network hostable DHCP agents. Network: e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:05:26.816446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e722f326-d93f-4fea-8ff3-34c51a67390a None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:05:26.826712 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Attempting to bind port 1cae8d20-2120-474a-82b2-95856ba3683f on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:05:26.826712 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Attempting to bind port 1cae8d20-2120-474a-82b2-95856ba3683f by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:05:26.826712 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Attempting to bind port 1cae8d20-2120-474a-82b2-95856ba3683f on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:05:26.838846 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 5, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:05:26.839328 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:05:26.839728 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.840118 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:05:26.840584 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Bound port: 1cae8d20-2120-474a-82b2-95856ba3683f, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:05:26.840962 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.846048 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Pushing event updated for resources: {'Port': ['ID=1cae8d20-2120-474a-82b2-95856ba3683f,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:26.847851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-553748c2-367c-43f7-9717-53053ab4cdfe None None] Provisioning complete for port 1cae8d20-2120-474a-82b2-95856ba3683f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:26.848219 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-553748c2-367c-43f7-9717-53053ab4cdfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:26.873675 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.874025 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.874368 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.874708 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.875073 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.875408 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.875735 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.876061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.876387 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.876712 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.877263 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.877527 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.877816 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:05:26.888584 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-553748c2-367c-43f7-9717-53053ab4cdfe None None] Port 1cae8d20-2120-474a-82b2-95856ba3683f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:05:26.907342 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:05:26.910846 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] For port 1cae8d20-2120-474a-82b2-95856ba3683f, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:05:26.913810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] For port 1cae8d20-2120-474a-82b2-95856ba3683f, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1cae8d20-2120-474a-82b2-95856ba3683f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:05:26.998751 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:27.002510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:27.003194 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.009289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e0a7139-10ce-4cd2-a48b-8c327c75fce1 None None] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:05:27.010594 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.064386 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:27.065007 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:05:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:27.066146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dde8e959-2646-4bb9-845e-ff1d6b1a5a6d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:05:27.082529 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-453d2826-b852-4f14-a9e2-d0c594ea2fb1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.7669423 Dec 21 05:05:27.085360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51928) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:27.105167 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5e03e9-9976-4177-8a45-a5fbc12fbba5 None None] Pushing event updated for resources: {'Port': ['ID=1cae8d20-2120-474a-82b2-95856ba3683f,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:27.132209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bb05b2db-d033-4ac9-90ae-9a5db6e98ee9 None None] Provisioning complete for port 1cae8d20-2120-474a-82b2-95856ba3683f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:27.132627 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb05b2db-d033-4ac9-90ae-9a5db6e98ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.158483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:05:27.159499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.175054 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:27.338377 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb05b2db-d033-4ac9-90ae-9a5db6e98ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.361159 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:25Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:27.369500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb05b2db-d033-4ac9-90ae-9a5db6e98ee9 None None] For port 1cae8d20-2120-474a-82b2-95856ba3683f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1cae8d20-2120-474a-82b2-95856ba3683f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:27.373519 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Allocated IP 172.20.0.2 (e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb/350d6f1e-fe44-464c-8289-ee6194ca3e98/6db7f1fb-e3e5-4752-8739-7b511ffeedff) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:05:27.392252 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18a76faa-7f9b-44b9-8dc4-0b875518700b None None] The sync data for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 is: [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:25Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:05:27.445182 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb05b2db-d033-4ac9-90ae-9a5db6e98ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.515703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb05b2db-d033-4ac9-90ae-9a5db6e98ee9 None None] Pushing event updated for resources: {'Port': ['ID=1cae8d20-2120-474a-82b2-95856ba3683f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:27.546905 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.576626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.660272 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.718779 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:05:27.723750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:27.727723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:05:27.735614 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Pushing event updated for resources: {'Port': ['ID=6db7f1fb-e3e5-4752-8739-7b511ffeedff,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:27.788135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Attempting to bind port 6db7f1fb-e3e5-4752-8739-7b511ffeedff on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:05:27.788517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Attempting to bind port 6db7f1fb-e3e5-4752-8739-7b511ffeedff by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:05:27.788892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Attempting to bind port 6db7f1fb-e3e5-4752-8739-7b511ffeedff on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:05:27.794637 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 5, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:05:27.795188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Checking segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:05:27.795608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.796009 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Bound using segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:05:27.796487 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Bound port: 6db7f1fb-e3e5-4752-8739-7b511ffeedff, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:05:27.797597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:27.864192 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] For port 6db7f1fb-e3e5-4752-8739-7b511ffeedff, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:05:27.868323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] For port 6db7f1fb-e3e5-4752-8739-7b511ffeedff, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6db7f1fb-e3e5-4752-8739-7b511ffeedff,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:05:27.961474 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:28.035230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59137651-17c5-4af6-b843-2da234bf7aeb None None] Pushing event updated for resources: {'Port': ['ID=6db7f1fb-e3e5-4752-8739-7b511ffeedff,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:28.255150 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.1 (e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb/350d6f1e-fe44-464c-8289-ee6194ca3e98/ff73299b-5c54-4eb2-9338-87a3ec3142ce) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:05:28.388323 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:28.478734 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:28.520730 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:05:28.524453 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:28.528303 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:05:28.551727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=ff73299b-5c54-4eb2-9338-87a3ec3142ce,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:28.574547 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:28.793101 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:28.987112 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47068246-85f3-49ef-80e6-fa3db6223d6b None None] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:05:29.086558 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.094953 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b6c87abc-a76c-4cd5-b632-d3c774414032 None None] Provisioning complete for port 6db7f1fb-e3e5-4752-8739-7b511ffeedff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:29.095334 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6c87abc-a76c-4cd5-b632-d3c774414032 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.144724 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.192697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6c87abc-a76c-4cd5-b632-d3c774414032 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.233532 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b6c87abc-a76c-4cd5-b632-d3c774414032 None None] For port 6db7f1fb-e3e5-4752-8739-7b511ffeedff, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6db7f1fb-e3e5-4752-8739-7b511ffeedff,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:29.243184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=ff73299b-5c54-4eb2-9338-87a3ec3142ce,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:29.248709 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.307694 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6c87abc-a76c-4cd5-b632-d3c774414032 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.373579 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c87abc-a76c-4cd5-b632-d3c774414032 None None] Pushing event updated for resources: {'Port': ['ID=6db7f1fb-e3e5-4752-8739-7b511ffeedff,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:29.404104 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:05:29.406245 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:29.434627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db7f1fb-e3e5-4752-8739-7b511ffeedff up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:05:29.491805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1286fc16-2d48-4753-9bfd-b4ab6ba036ba None None] Provisioning complete for port 6db7f1fb-e3e5-4752-8739-7b511ffeedff triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:29.492169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1286fc16-2d48-4753-9bfd-b4ab6ba036ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.539725 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6db7f1fb-e3e5-4752-8739-7b511ffeedff triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:29.540098 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.559607 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:05:29.689211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-1286fc16-2d48-4753-9bfd-b4ab6ba036ba None None] Provisioning complete for port ff73299b-5c54-4eb2-9338-87a3ec3142ce triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:29.689584 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1286fc16-2d48-4753-9bfd-b4ab6ba036ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.695046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1cae8d20-2120-474a-82b2-95856ba3683f up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:05:29.706233 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:05:29.714980 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2192a081-f119-4760-85dd-d2ff9eb56c51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/ba84f4c8-a332-4ad1-8223-2f24b165fbe8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6257102 Dec 21 05:05:29.746589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Sync routers for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:05:29.788395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-1286fc16-2d48-4753-9bfd-b4ab6ba036ba None None] Port ff73299b-5c54-4eb2-9338-87a3ec3142ce cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:05:29.789227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:29.789855 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:05:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:29.877051 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-4343bbfb-fd05-43a3-8207-4a29fbea6217 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1995665&fields=id&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 267 time: 0.0469267 Dec 21 05:05:29.890672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 1cae8d20-2120-474a-82b2-95856ba3683f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:29.891267 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:29.963037 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:30.001662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-d0c96808-f9bf-4877-b92a-1351e033e264 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:30.003299 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-d0c96808-f9bf-4877-b92a-1351e033e264 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 796 time: 0.1173577 Dec 21 05:05:30.019125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-776f5a8a-065c-427c-8537-268b8e2efc96 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/quotas/7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 375 time: 0.0097449 Dec 21 05:05:30.072560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-f5b38de8-2482-4949-860a-dd077590669d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0474579 Dec 21 05:05:30.157388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-297d91fa-d57d-4a60-b69c-133ca882a1f7 None None] Provisioning complete for port ff73299b-5c54-4eb2-9338-87a3ec3142ce triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:30.157983 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-297d91fa-d57d-4a60-b69c-133ca882a1f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:30.168096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-c8706911-2352-428e-bf01-777d7af02cb1 service neutron] 10.222.0.18 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834460 Dec 21 05:05:30.248099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-297d91fa-d57d-4a60-b69c-133ca882a1f7 None None] Port ff73299b-5c54-4eb2-9338-87a3ec3142ce cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:05:30.261221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bce7352d-c8e8-427e-aeef-72fa127cd79c service neutron] 10.222.0.18 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868177 Dec 21 05:05:30.390206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 2, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:30.417422 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Checking router: ba84f4c8-a332-4ad1-8223-2f24b165fbe8 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:05:30.417788 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Updating router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 port ff73299b-5c54-4eb2-9338-87a3ec3142ce binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:05:30.443431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:30.483158 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-37d6340f-8190-46df-bae9-c659e09a2ace req-422f4c44-3a0d-4b74-8cc6-deaf07cc4612 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 210 time: 0.0280476 Dec 21 05:05:30.705537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:30.803822 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:30.871106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed1abc9-708c-4bcc-814e-2d51bd0b9cab None None] Pushing event updated for resources: {'Port': ['ID=ff73299b-5c54-4eb2-9338-87a3ec3142ce,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:30.905907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Attempting to bind port ff73299b-5c54-4eb2-9338-87a3ec3142ce on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:05:30.906416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Attempting to bind port ff73299b-5c54-4eb2-9338-87a3ec3142ce by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:05:30.906794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Attempting to bind port ff73299b-5c54-4eb2-9338-87a3ec3142ce on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:05:30.911980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 5, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:05:30.920860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Checking segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:05:30.920860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:30.920860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Bound using segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:05:30.920860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Bound port: ff73299b-5c54-4eb2-9338-87a3ec3142ce, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:05:30.920860 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:30.994656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] For port ff73299b-5c54-4eb2-9338-87a3ec3142ce, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:05:31.000309 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] For port ff73299b-5c54-4eb2-9338-87a3ec3142ce, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff73299b-5c54-4eb2-9338-87a3ec3142ce,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:05:31.069668 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:31.100518 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-eca3e490-0ec5-4df1-8c9b-3fca5dc590a3 None None] Provisioning complete for port ff73299b-5c54-4eb2-9338-87a3ec3142ce triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:31.100885 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eca3e490-0ec5-4df1-8c9b-3fca5dc590a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:31.160962 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed1abc9-708c-4bcc-814e-2d51bd0b9cab None None] Pushing event updated for resources: {'Port': ['ID=ff73299b-5c54-4eb2-9338-87a3ec3142ce,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:31.166726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:31.167377 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:05:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:31.307087 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eca3e490-0ec5-4df1-8c9b-3fca5dc590a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:31.313913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db7f1fb-e3e5-4752-8739-7b511ffeedff up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:05:31.326646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:31.456057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-eca3e490-0ec5-4df1-8c9b-3fca5dc590a3 None None] For port ff73299b-5c54-4eb2-9338-87a3ec3142ce, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff73299b-5c54-4eb2-9338-87a3ec3142ce,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:31.517469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6db7f1fb-e3e5-4752-8739-7b511ffeedff triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:31.517846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:31.545453 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eca3e490-0ec5-4df1-8c9b-3fca5dc590a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:31.577199 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-72590d13-1188-41fc-85e4-c4d1e5064832 req-54ee1c83-449e-4f49-b8b4-d0d2aea286bc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 210 time: 0.0259120 Dec 21 05:05:31.650213 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eca3e490-0ec5-4df1-8c9b-3fca5dc590a3 None None] Pushing event updated for resources: {'Port': ['ID=ff73299b-5c54-4eb2-9338-87a3ec3142ce,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:31.714986 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0055bc79-6662-47f4-a210-08782ce6084b None None] Provisioning complete for port ff73299b-5c54-4eb2-9338-87a3ec3142ce triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:31.717982 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0055bc79-6662-47f4-a210-08782ce6084b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:31.762769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:30Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:31.792630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f58e66c3-936c-4e4c-a676-e3b07d882432 None None] The sync data for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 is: [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:30Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:05:32.886121 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a496bef-3726-4340-9e9d-124729f42a69 req-70b2d85b-2203-4326-adcd-357afcb60c4e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 210 time: 0.0350411 Dec 21 05:05:32.917234 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-fba8b467-e18b-45ee-97d5-ef45581417a6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:32.918671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-fba8b467-e18b-45ee-97d5-ef45581417a6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 796 time: 0.4410682 Dec 21 05:05:33.006314 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-f883bace-2936-43dc-af87-de9985151368 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 377 time: 0.0532017 Dec 21 05:05:33.035873 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'port': {'device_id': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'admin_state_up': True, 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'security_groups': ['06bf9a23-2390-4757-a9ff-a84d58c37b72']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:33.204085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:05:33.207659 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.326152 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff73299b-5c54-4eb2-9338-87a3ec3142ce up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:05:33.341967 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.14 (e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb/350d6f1e-fe44-464c-8289-ee6194ca3e98/16cce430-838f-4d22-97f3-2706eaad819c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:05:33.377541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port ff73299b-5c54-4eb2-9338-87a3ec3142ce triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:33.378003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.479596 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.564531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.611515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:05:33.614729 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:33.617251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:05:33.654598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:33.676871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:33.677493 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.767171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-bf7f917b-8e6c-4c08-9b90-5f431b036501 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7347901 Dec 21 05:05:33.794810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Request body: {'port': {'device_id': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:33.847790 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.869331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-13bef1e6-5981-4cbd-ab5c-60afa94c56da None None] Provisioning complete for port 16cce430-838f-4d22-97f3-2706eaad819c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:33.869704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13bef1e6-5981-4cbd-ab5c-60afa94c56da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:33.904246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-13bef1e6-5981-4cbd-ab5c-60afa94c56da None None] Port 16cce430-838f-4d22-97f3-2706eaad819c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:05:34.062447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd8645c-01e0-4d92-b1d7-c21328f3b170 req-f401828b-c638-40bb-8f3b-551371e6cd66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:34.063878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cd8645c-01e0-4d92-b1d7-c21328f3b170 req-f401828b-c638-40bb-8f3b-551371e6cd66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 932 time: 0.1065211 Dec 21 05:05:34.140236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cd8645c-01e0-4d92-b1d7-c21328f3b170 req-298e8108-06b8-4c4c-b458-5d327298fd03 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0685511 Dec 21 05:05:34.183606 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 16cce430-838f-4d22-97f3-2706eaad819c {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:05:34.191067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:34.203274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Transition to ACTIVE for port object 16cce430-838f-4d22-97f3-2706eaad819c will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:05:34.266650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:34.317321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:34.390578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:05:34.390916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:05:34.391279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:05:34.395927 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Port 16cce430-838f-4d22-97f3-2706eaad819c on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:05:34.396249 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:05:34.401190 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 5, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:05:34.401528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Checking segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:05:34.401912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Bound using segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:05:34.402337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Bound port: 16cce430-838f-4d22-97f3-2706eaad819c, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:05:34.402700 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:34.467733 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:05:34.473513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:05:34.524517 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:34.557910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:34.558641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:34.559947 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] 10.222.0.31 "PUT /v2.0/ports/16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1093 time: 0.7695308 Dec 21 05:05:34.560379 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:05:34.562670 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0700ab0-00d1-4c41-9916-10140c4e0f73" -d '{"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:05:34.590468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b16cdea3-655c-4841-bba5-f1ffda8e96cb service neutron] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:34.612095 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:05:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99eb02cb-4cdc-48d2-88df-09bf0e18c03a x-openstack-request-id: req-99eb02cb-4cdc-48d2-88df-09bf0e18c03a {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:05:34.612740 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:05:34.613213 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-99eb02cb-4cdc-48d2-88df-09bf0e18c03a {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:05:34.614192 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'status': 'completed', 'code': 200} Dec 21 05:05:34.697033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0700ab0-00d1-4c41-9916-10140c4e0f73 req-c3eafbe8-0b1a-45d8-9e33-17145e26d2f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:34.698571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0700ab0-00d1-4c41-9916-10140c4e0f73 req-c3eafbe8-0b1a-45d8-9e33-17145e26d2f8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1096 time: 0.0473356 Dec 21 05:05:34.812016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0700ab0-00d1-4c41-9916-10140c4e0f73 req-ad98a337-b47c-4337-9011-011f8f98fe28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:34.813500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0700ab0-00d1-4c41-9916-10140c4e0f73 req-ad98a337-b47c-4337-9011-011f8f98fe28 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=7037c5e415f34eb2b218d59f1243d003&shared=False HTTP/1.1" status: 200 len: 897 time: 0.0920768 Dec 21 05:05:34.915264 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0700ab0-00d1-4c41-9916-10140c4e0f73 req-879be462-e9bb-4025-84a3-7282566b0754 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:34.916756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0700ab0-00d1-4c41-9916-10140c4e0f73 req-879be462-e9bb-4025-84a3-7282566b0754 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0918975 Dec 21 05:05:35.030152 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-12641842-430e-4f3e-99c2-8c4b4a1d0ed6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:35.031696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-12641842-430e-4f3e-99c2-8c4b4a1d0ed6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1096 time: 0.0408432 Dec 21 05:05:35.086174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-4fd14ec2-daa3-4982-956a-406db7a2a9c7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 217 time: 0.0334926 Dec 21 05:05:35.142647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-4b8261ce-1b1f-42d1-91ae-f279cfb345de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:35.144035 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-4b8261ce-1b1f-42d1-91ae-f279cfb345de service neutron] 10.222.0.31 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0471215 Dec 21 05:05:35.192757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-2aa6a602-1953-4b11-9080-a4a0e6baa2b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:35.194808 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-2aa6a602-1953-4b11-9080-a4a0e6baa2b2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0392902 Dec 21 05:05:35.311337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514d3149-652a-42e6-ae19-1d49adab5ea8 req-12339ed5-75cb-4996-8294-62cd6058d0bd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:35.312792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-514d3149-652a-42e6-ae19-1d49adab5ea8 req-12339ed5-75cb-4996-8294-62cd6058d0bd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.0981584 Dec 21 05:05:35.341958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-c5661765-9489-4453-8ec2-4e6533ff7358 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1350279 Dec 21 05:05:35.390685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-514d3149-652a-42e6-ae19-1d49adab5ea8 req-5d9576e8-3c9f-4757-910c-05872a7d5376 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0718343 Dec 21 05:05:35.454172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dd566deb-c15c-48e4-b0b7-5fc2ade5006a req-c04f9d3c-e657-48c7-84ab-d0879c4bb6cb service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0969448 Dec 21 05:05:36.508390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e337faff-3371-4fb2-8219-1a87e78c2ac9 req-5b6c856c-57cc-46a3-bbf5-62d174d24904 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:36.510047 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e337faff-3371-4fb2-8219-1a87e78c2ac9 req-5b6c856c-57cc-46a3-bbf5-62d174d24904 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.0507157 Dec 21 05:05:36.558004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e337faff-3371-4fb2-8219-1a87e78c2ac9 req-946a09ac-1138-4ddc-97eb-79cdebe191c7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0420291 Dec 21 05:05:36.762630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:05:36.854656 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:36.864839 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '16cce430-838f-4d22-97f3-2706eaad819c', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'port_id': '16cce430-838f-4d22-97f3-2706eaad819c', 'mac_address': 'fa:16:3e:a3:93:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:05:36.905145 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:36.917980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 16cce430-838f-4d22-97f3-2706eaad819c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:05:36.937135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:37.009597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:37.055814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:37.410863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['16cce430-838f-4d22-97f3-2706eaad819c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:05:37.678413 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6180b8ac-acd7-4e4d-adc1-f13aa5c1e88d req-ce9cdbd0-c011-4300-b891-ab76e6fda1ba tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:37.679905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6180b8ac-acd7-4e4d-adc1-f13aa5c1e88d req-ce9cdbd0-c011-4300-b891-ab76e6fda1ba tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 945 time: 0.0530729 Dec 21 05:05:37.727406 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6180b8ac-acd7-4e4d-adc1-f13aa5c1e88d req-9b37d99a-2fae-4c58-9372-4c3bee43e239 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0416281 Dec 21 05:05:38.766320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:05:38.848559 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90da0bb1-7b1d-4121-875d-cedc01e015c6 req-96677866-615e-4c17-afdd-fdbb38b5e164 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:38.850080 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90da0bb1-7b1d-4121-875d-cedc01e015c6 req-96677866-615e-4c17-afdd-fdbb38b5e164 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 945 time: 0.0531342 Dec 21 05:05:38.867683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 16cce430-838f-4d22-97f3-2706eaad819c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:05:38.871791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 16cce430-838f-4d22-97f3-2706eaad819c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:05:38.872165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:38.899833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-90da0bb1-7b1d-4121-875d-cedc01e015c6 req-b742cb20-ce6f-4fa4-907e-9f93f99ea090 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0434139 Dec 21 05:05:38.951293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:38.972804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:05:38.975569 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62195bc0-58c2-4a2c-a0ca-8993b1770746" -d '{"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-plugged", "status": "completed", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:05:38.987758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:05:39.032851 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:39.080851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:39.087290 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:05:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fbb9c9d4-803a-4e8a-aed4-30e93da8a46b x-openstack-request-id: req-fbb9c9d4-803a-4e8a-aed4-30e93da8a46b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:05:39.087580 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-plugged", "status": "completed", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:05:39.087915 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-fbb9c9d4-803a-4e8a-aed4-30e93da8a46b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:05:39.088218 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'code': 200} Dec 21 05:05:39.237497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2dfe7a9-7d77-4908-a7c1-9a1de33ab152 req-76e7ad34-8b1d-43f3-a362-be897a81bb7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:39.239014 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2dfe7a9-7d77-4908-a7c1-9a1de33ab152 req-76e7ad34-8b1d-43f3-a362-be897a81bb7b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1098 time: 0.0397754 Dec 21 05:05:39.285056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c2dfe7a9-7d77-4908-a7c1-9a1de33ab152 req-4967c542-3a1d-42b1-b076-298a65377b78 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0387688 Dec 21 05:05:40.013526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae0b641-d5a8-4d2d-bb46-e3148bc4d879 req-e9c493db-1651-4265-82e4-cea870c89cf9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:40.015008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eae0b641-d5a8-4d2d-bb46-e3148bc4d879 req-e9c493db-1651-4265-82e4-cea870c89cf9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0482979 Dec 21 05:05:40.066585 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eae0b641-d5a8-4d2d-bb46-e3148bc4d879 req-dd231ff1-5ae3-4efc-8174-6f45a4842e44 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0456994 Dec 21 05:05:41.185174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd4e54c-d105-4bff-8f2a-aa55346de517 req-111df9ec-8da5-4894-a23b-ee70faa6136e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:41.186907 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cd4e54c-d105-4bff-8f2a-aa55346de517 req-111df9ec-8da5-4894-a23b-ee70faa6136e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0495429 Dec 21 05:05:41.236170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3cd4e54c-d105-4bff-8f2a-aa55346de517 req-e78a7a28-a1e8-4c5a-b844-76102d2403f4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0432410 Dec 21 05:05:41.361942 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d41b8af-2cdb-4550-b9e8-a861f1d3dd74 req-e7d469e5-0adc-4f96-86c9-f32bef706f68 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:41.363373 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d41b8af-2cdb-4550-b9e8-a861f1d3dd74 req-e7d469e5-0adc-4f96-86c9-f32bef706f68 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0514457 Dec 21 05:05:41.414134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d41b8af-2cdb-4550-b9e8-a861f1d3dd74 req-1627dbbc-9531-4600-a19b-9b60336000ed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0435441 Dec 21 05:05:41.436113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51982) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:41.477855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89429a61-ca09-4ab8-b2fa-aefad674c3dc tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:41.479597 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-89429a61-ca09-4ab8-b2fa-aefad674c3dc tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1093 time: 0.0422623 Dec 21 05:05:41.482332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 51984) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:41.486447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '16cce430-838f-4d22-97f3-2706eaad819c', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:05:41.580221 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:41.677478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:41.779527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.177 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/a5954d46-7bd6-4fc3-bfe3-563d381eb5b1) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:05:41.877911 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:41.964477 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:42.006846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:05:42.009707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:05:42.013085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:05:42.036066 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=a5954d46-7bd6-4fc3-bfe3-563d381eb5b1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:42.354882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:42.473598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:42.618258 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:42.666902 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:42.748273 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=a5954d46-7bd6-4fc3-bfe3-563d381eb5b1,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:05:42.758006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:42.856422 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP a1a4cf46-00b3-48e9-b78c-58035e3847fe associated. External IP: 172.25.5.177, port: 16cce430-838f-4d22-97f3-2706eaad819c. Dec 21 05:05:43.064871 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:05:43.170546 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:05:43.180811 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] Sync routers for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:05:43.190203 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:43.190810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:05:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:43.240458 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:43.267748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-4d63f7c5-b6a0-4dc5-87a3-b2ba0459cf37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.7844343 Dec 21 05:05:43.268337 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:05:43.270852 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2044b66-a194-415d-9a8f-d1807f8e4cc3" -d '{"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:05:43.310327 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:43.310614 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:05:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-024cb29c-61e0-4393-8e0d-73aac2e1b8b8 x-openstack-request-id: req-024cb29c-61e0-4393-8e0d-73aac2e1b8b8 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:05:43.310908 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:05:43.311190 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-024cb29c-61e0-4393-8e0d-73aac2e1b8b8 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:05:43.311651 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'status': 'completed', 'code': 200} Dec 21 05:05:43.391676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc9286f-c4fc-4971-a6da-c4edd9c0aba5 req-2bf28bf9-d5c2-4493-ab87-cf8305de06c7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:43.393258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdc9286f-c4fc-4971-a6da-c4edd9c0aba5 req-2bf28bf9-d5c2-4493-ab87-cf8305de06c7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0760894 Dec 21 05:05:43.431279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-5701c9a7-61d2-4ed8-aa7d-a3f0e87c2df8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:43.432721 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-5701c9a7-61d2-4ed8-aa7d-a3f0e87c2df8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1098 time: 0.0764129 Dec 21 05:05:43.489870 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cdc9286f-c4fc-4971-a6da-c4edd9c0aba5 req-2d9b8b81-17d8-46c7-ae33-2c6f299af9f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0893829 Dec 21 05:05:43.513788 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51992) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:43.547999 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-43482718-f455-4252-94fd-61da852d12dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:43.549459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-43482718-f455-4252-94fd-61da852d12dd service neutron] 10.222.0.31 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.1068721 Dec 21 05:05:43.579771 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d22c5a28-d9c0-4da6-afb2-bb8ea1bd7bdf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/a1a4cf46-00b3-48e9-b78c-58035e3847fe HTTP/1.1" status: 200 len: 992 time: 0.0638525 Dec 21 05:05:43.623558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-b86fb1fd-7e01-48e0-9f04-3ef263281879 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1000 time: 0.0666280 Dec 21 05:05:43.655274 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a1a4cf46-00b3-48e9-b78c-58035e3847fe', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.177', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'port_id': '16cce430-838f-4d22-97f3-2706eaad819c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4260, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'mac_address': 'fa:16:3e:a3:93:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:05:42Z', 'updated_at': '2021-12-21T05:05:42Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:43.684727 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] Checking router: ba84f4c8-a332-4ad1-8223-2f24b165fbe8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:05:43.694534 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:05:43.695186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:05:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:43.802223 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:05:43.959423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-660b5d22-b07a-4fd9-8824-71913ae855f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:43.961072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-660b5d22-b07a-4fd9-8824-71913ae855f6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.3305917 Dec 21 05:05:44.011797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-8801b5c6-4ecb-4d94-a01d-5202d9213795 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:05:44.013337 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-8801b5c6-4ecb-4d94-a01d-5202d9213795 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0446503 Dec 21 05:05:44.033946 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a1a4cf46-00b3-48e9-b78c-58035e3847fe', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.177', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'port_id': '16cce430-838f-4d22-97f3-2706eaad819c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4260, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'mac_address': 'fa:16:3e:a3:93:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:05:42Z', 'updated_at': '2021-12-21T05:05:42Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:05:44.065186 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e062ac89-be28-4577-804c-65e6524c1113 None None] The sync data for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 is: [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a1a4cf46-00b3-48e9-b78c-58035e3847fe', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.177', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'port_id': '16cce430-838f-4d22-97f3-2706eaad819c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4260, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'mac_address': 'fa:16:3e:a3:93:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:05:42Z', 'updated_at': '2021-12-21T05:05:42Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:05:44.105974 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-f9249a52-7b71-4f9e-849d-5e29c093ca87 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851514 Dec 21 05:05:44.200487 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2044b66-a194-415d-9a8f-d1807f8e4cc3 req-136eecd8-6cca-4a6c-8da2-f39230d90d69 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870965 Dec 21 05:05:44.267682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b781bbd-38f2-46e5-9714-e0c59cc6e7d8 None None] New status for floating IP a1a4cf46-00b3-48e9-b78c-58035e3847fe: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:05:44.581058 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 51994) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:05:44.645825 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-d8a72d14-a685-42b8-9173-643df60f374a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/a1a4cf46-00b3-48e9-b78c-58035e3847fe HTTP/1.1" status: 200 len: 994 time: 0.0635858 Dec 21 05:05:44.872949 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:05:49.952535 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-80fb9a73-b689-4011-bc2d-5698a5ed15eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:52.723903 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cf484cbd-6075-4c25-b19c-2f056f55f6b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:53.575245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:53.701050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:55.340239 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:55.454590 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:05:55.821101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:19.935028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9b6faece-10eb-48a3-935c-90487788714c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:20.005688 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-120cc1e6-d4f1-4bc4-82f6-7148c8a0add9 req-0c9297bf-290f-4d4e-94df-e53315ef7420 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:06:20.006697 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-120cc1e6-d4f1-4bc4-82f6-7148c8a0add9 req-0c9297bf-290f-4d4e-94df-e53315ef7420 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054622 Dec 21 05:06:20.301552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a2a8af-1fa1-4ead-83e3-5a0d9d855525 req-eacfddf2-1cbf-4732-82cb-2843a2f17fa0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:20.303055 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0a2a8af-1fa1-4ead-83e3-5a0d9d855525 req-eacfddf2-1cbf-4732-82cb-2843a2f17fa0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0495336 Dec 21 05:06:20.356586 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e0a2a8af-1fa1-4ead-83e3-5a0d9d855525 req-5441efb5-2e10-46c5-9777-cade6819632f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0468643 Dec 21 05:06:20.443571 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52020) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:06:20.520786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-65e57f65-f9e9-4556-b055-26e58a0e5779 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0760574 Dec 21 05:06:20.529998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-64869d7e-7ca8-4492-a039-7e50416c7f56 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:06:20.530956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-64869d7e-7ca8-4492-a039-7e50416c7f56 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049202 Dec 21 05:06:21.486068 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9c91f5-2144-4320-b441-1b4291ecd5b7 req-213fcffe-d355-49a9-9829-88f1bef53776 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:21.487593 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c9c91f5-2144-4320-b441-1b4291ecd5b7 req-213fcffe-d355-49a9-9829-88f1bef53776 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0531986 Dec 21 05:06:21.537919 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7c9c91f5-2144-4320-b441-1b4291ecd5b7 req-f04faf1e-e00d-4053-a8ab-c86d390741e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0439703 Dec 21 05:06:21.873390 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:06:22.587878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-57e68537-b8f7-456c-8bfc-bb5449e36608 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:22.589401 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-57e68537-b8f7-456c-8bfc-bb5449e36608 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1098 time: 0.0444791 Dec 21 05:06:22.715725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2bc39e-b7aa-43fa-9981-08ed2b67f492 req-ccc7867b-7757-462f-a7d6-90e6744666b0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:22.717193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc2bc39e-b7aa-43fa-9981-08ed2b67f492 req-ccc7867b-7757-462f-a7d6-90e6744666b0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.1065111 Dec 21 05:06:22.721880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-fc3cf9c3-5ddf-4e64-8241-67f4b5c57042 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:22.723307 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-fc3cf9c3-5ddf-4e64-8241-67f4b5c57042 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.1208782 Dec 21 05:06:22.735700 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a3e93f94-98c7-4deb-9633-dd53ccc873bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:22.818018 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fc2bc39e-b7aa-43fa-9981-08ed2b67f492 req-ad3545aa-8df7-42b9-8210-2652b2752e6d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0936844 Dec 21 05:06:22.819979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-f3ed99ba-8d46-4a98-80c1-8b96f9da9e84 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1002 time: 0.0787632 Dec 21 05:06:22.871562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-e2d8110c-6758-4906-b2ad-de797cdcfca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:22.873056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-e2d8110c-6758-4906-b2ad-de797cdcfca6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0451164 Dec 21 05:06:22.922075 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-3c1fceb0-b2c7-4faf-b1f6-a2f5689718dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:22.923596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-3c1fceb0-b2c7-4faf-b1f6-a2f5689718dc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0429490 Dec 21 05:06:23.011782 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-2e5624ec-14e5-4eeb-8cf4-687a0e7ecf9c service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808091 Dec 21 05:06:23.103277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-8b566d44-213f-4970-80e8-0f9e8cdf57ab service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839994 Dec 21 05:06:23.633796 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:23.727830 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:23.934830 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1801c161-980a-4795-9084-be346aec6991 req-3cb66845-7016-44d0-8bf4-17238707fdcd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:23.936317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1801c161-980a-4795-9084-be346aec6991 req-3cb66845-7016-44d0-8bf4-17238707fdcd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0491004 Dec 21 05:06:23.985139 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1801c161-980a-4795-9084-be346aec6991 req-c8b78f9e-e7ca-4cdb-acec-eb5e11413761 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0428357 Dec 21 05:06:25.098943 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e239c7a-4ba5-4b2e-9051-767407e85b1e req-db34b706-7dfe-49fc-a630-164e23395202 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:25.100427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e239c7a-4ba5-4b2e-9051-767407e85b1e req-db34b706-7dfe-49fc-a630-164e23395202 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0480037 Dec 21 05:06:25.153305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5e239c7a-4ba5-4b2e-9051-767407e85b1e req-16a4b632-5548-4374-91d2-66fae01b6ee9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0462761 Dec 21 05:06:25.370089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:25.449708 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:25.808077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:26.269528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4421a0c-0026-4171-bc33-ca0bf010d9ba req-dd09614f-aa21-4cda-a05e-e8a68b5cd5c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:26.271027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4421a0c-0026-4171-bc33-ca0bf010d9ba req-dd09614f-aa21-4cda-a05e-e8a68b5cd5c0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0484149 Dec 21 05:06:26.319685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e4421a0c-0026-4171-bc33-ca0bf010d9ba req-4cde20c8-afc4-443e-8cff-61cc3863921a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0418487 Dec 21 05:06:27.436120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a39e94d0-2e54-45bd-9092-2cbe6f183dcf req-b7a4125a-d07b-43d2-9e80-4a9a247a7e3f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:27.437610 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a39e94d0-2e54-45bd-9092-2cbe6f183dcf req-b7a4125a-d07b-43d2-9e80-4a9a247a7e3f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0483234 Dec 21 05:06:27.485170 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a39e94d0-2e54-45bd-9092-2cbe6f183dcf req-231d0c30-260e-48f5-822c-704bbb5337f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0416515 Dec 21 05:06:28.602686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1403124-a1a9-40e7-8447-ff86c084880f req-63d53035-f0b3-47ca-b9aa-24e0dd136142 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:28.605380 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1403124-a1a9-40e7-8447-ff86c084880f req-63d53035-f0b3-47ca-b9aa-24e0dd136142 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0529795 Dec 21 05:06:28.655600 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b1403124-a1a9-40e7-8447-ff86c084880f req-ea25f6af-e7d0-45ca-9a79-272c4a234c50 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0440528 Dec 21 05:06:29.768042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e1ca50-c7f6-4323-9309-a9af7e5a2f11 req-a87c2126-f06d-467d-bef0-cf37874e9812 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:29.769489 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8e1ca50-c7f6-4323-9309-a9af7e5a2f11 req-a87c2126-f06d-467d-bef0-cf37874e9812 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0475514 Dec 21 05:06:29.818538 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f8e1ca50-c7f6-4323-9309-a9af7e5a2f11 req-53d6276c-5d34-49dd-ad63-c70041615197 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0422232 Dec 21 05:06:30.934147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8403aa81-f69e-435e-887b-de97e1d3d33c req-26f36b1d-e9ca-424e-be14-bfaad6d10832 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:30.935634 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8403aa81-f69e-435e-887b-de97e1d3d33c req-26f36b1d-e9ca-424e-be14-bfaad6d10832 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0480037 Dec 21 05:06:30.992237 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8403aa81-f69e-435e-887b-de97e1d3d33c req-ab5b2230-5089-43cd-987d-5e6fccac1d8f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0506620 Dec 21 05:06:32.105846 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84aee54-a359-462f-90ec-f24061ca41aa req-f376618f-9b89-4ffc-8412-c14d1fb3e9f4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:32.107347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e84aee54-a359-462f-90ec-f24061ca41aa req-f376618f-9b89-4ffc-8412-c14d1fb3e9f4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0477777 Dec 21 05:06:32.155748 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e84aee54-a359-462f-90ec-f24061ca41aa req-1f840aa9-6b32-432f-b44b-137149841d41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0424702 Dec 21 05:06:33.277488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09e6fbc-0aaf-4c6f-8f49-e94f9435750a req-243b0b0a-0c8c-4728-8d13-127fe90742b8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:33.278990 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d09e6fbc-0aaf-4c6f-8f49-e94f9435750a req-243b0b0a-0c8c-4728-8d13-127fe90742b8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0526068 Dec 21 05:06:33.327304 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d09e6fbc-0aaf-4c6f-8f49-e94f9435750a req-38fe1de1-b8b0-4f95-b72c-f973e82a0f92 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0422487 Dec 21 05:06:34.446427 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e921b605-5ff7-452c-9593-68e5280240a3 req-8f478aa1-4fd4-47da-b001-0fd4fdc43cdb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:34.447918 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e921b605-5ff7-452c-9593-68e5280240a3 req-8f478aa1-4fd4-47da-b001-0fd4fdc43cdb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0529966 Dec 21 05:06:34.497343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e921b605-5ff7-452c-9593-68e5280240a3 req-4abeefef-72ed-4c8c-8639-93aaab00b4f4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0435691 Dec 21 05:06:35.616777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c80cb4-dafc-40af-844a-d734fce2a439 req-db1ce8d0-9193-46b7-a232-a54660a605e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:35.618305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7c80cb4-dafc-40af-844a-d734fce2a439 req-db1ce8d0-9193-46b7-a232-a54660a605e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0518606 Dec 21 05:06:35.667831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7c80cb4-dafc-40af-844a-d734fce2a439 req-27985990-3713-4f7e-b088-cf95be7025f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0433838 Dec 21 05:06:36.787814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a51b864-8570-4a90-a465-ac055c52616d req-ddbf21ab-4f6f-4131-8637-5aed02f65b82 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:36.789305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a51b864-8570-4a90-a465-ac055c52616d req-ddbf21ab-4f6f-4131-8637-5aed02f65b82 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0517981 Dec 21 05:06:36.837841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4a51b864-8570-4a90-a465-ac055c52616d req-83e0370e-97f6-4289-b021-9a8519f885c6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0420492 Dec 21 05:06:37.952050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25196629-2bec-4de3-8cee-08d8c3dc57c5 req-4af62c98-9aa9-4b6b-adfc-ac3f7f787c90 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:37.953533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25196629-2bec-4de3-8cee-08d8c3dc57c5 req-4af62c98-9aa9-4b6b-adfc-ac3f7f787c90 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0480237 Dec 21 05:06:38.001684 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25196629-2bec-4de3-8cee-08d8c3dc57c5 req-c6d54590-c0fa-440d-b342-3ef630fbf600 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0422752 Dec 21 05:06:39.114397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba5af4b-e216-4eed-b891-47a0beb1e875 req-4ce095c3-3ac5-45f5-acec-bd5dfffbb318 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:39.115886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ba5af4b-e216-4eed-b891-47a0beb1e875 req-4ce095c3-3ac5-45f5-acec-bd5dfffbb318 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0472722 Dec 21 05:06:39.167891 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4ba5af4b-e216-4eed-b891-47a0beb1e875 req-6fdff12e-8ace-49d0-94aa-3cb7d6685c8a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0454392 Dec 21 05:06:39.747319 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-238e9658-14a5-460f-b1d7-caf704a3bef0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:39.748805 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-238e9658-14a5-460f-b1d7-caf704a3bef0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1098 time: 0.0403681 Dec 21 05:06:39.851592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-6204ad2e-f091-421b-9c22-6afb457e0ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:39.853068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-6204ad2e-f091-421b-9c22-6afb457e0ef4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.0837586 Dec 21 05:06:39.926114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-8d16d2b7-ea64-4165-bbdf-0e1c59d43ab2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1002 time: 0.0653238 Dec 21 05:06:39.971727 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-fb6b55a3-df39-4571-8d07-0e164d36bb8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:39.973120 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-fb6b55a3-df39-4571-8d07-0e164d36bb8c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0427632 Dec 21 05:06:40.019016 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-ee5a46a5-f9b8-4e71-870f-7acd5d81272c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:40.020463 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-ee5a46a5-f9b8-4e71-870f-7acd5d81272c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0391126 Dec 21 05:06:40.111130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-21e3c93c-f734-433f-a256-4ece7b6a8820 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826628 Dec 21 05:06:40.202340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-83d22bfe-b6f2-44cc-a103-8541257265f6 req-a0adffe0-06bb-41d4-a8f6-91cbb38b0010 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819490 Dec 21 05:06:40.287069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4059e622-c8c1-48ed-bb28-25fc4c0f77a5 req-afda249f-24c7-41b7-bc35-b73bdc4b6b27 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:40.288531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4059e622-c8c1-48ed-bb28-25fc4c0f77a5 req-afda249f-24c7-41b7-bc35-b73bdc4b6b27 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0529346 Dec 21 05:06:40.337141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4059e622-c8c1-48ed-bb28-25fc4c0f77a5 req-92f07b59-8703-41c0-b689-f517f1151758 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0421281 Dec 21 05:06:40.733976 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-08788a43-f039-4bd2-9188-ceffbdd20034 service neutron] show failed (client error): The resource could not be found. Dec 21 05:06:40.735002 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-08788a43-f039-4bd2-9188-ceffbdd20034 service neutron] 10.222.0.31 "GET /v2.0/ports/16cce430-838f-4d22-97f3-2706eaad819c/bindings/n-h1-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0547976 Dec 21 05:06:41.169919 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-38522178-1275-43be-b293-12947bb060f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:41.176839 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-38522178-1275-43be-b293-12947bb060f5 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 1098 time: 0.0875251 Dec 21 05:06:41.190752 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:06:41.242843 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:41.451182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:06:41.464896 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989d59b6-c485-46c7-a7e8-df2159ceee38 req-2381732f-bb16-4722-908e-3b290e3193b5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:41.467383 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-989d59b6-c485-46c7-a7e8-df2159ceee38 req-2381732f-bb16-4722-908e-3b290e3193b5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0586245 Dec 21 05:06:41.485963 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:06:41.529040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:06:41.531373 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-879495db-0dc5-4f82-a543-1ac88510edc3" -d '{"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-unplugged", "status": "completed", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:06:41.538578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-989d59b6-c485-46c7-a7e8-df2159ceee38 req-8c9bbbbd-8e79-4ce2-b1e5-b3c8722143e1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0566115 Dec 21 05:06:41.539299 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:41.552882 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Transition to ACTIVE for port object 16cce430-838f-4d22-97f3-2706eaad819c will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:06:41.591245 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 05:06:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-136426db-249d-4dfa-b3cc-8920eea41179 x-openstack-request-id: req-136426db-249d-4dfa-b3cc-8920eea41179 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:06:41.591715 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-unplugged", "status": "completed", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:06:41.591974 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-136426db-249d-4dfa-b3cc-8920eea41179 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:06:41.592383 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'code': 200} Dec 21 05:06:41.627291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:41.706549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=6']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:06:41.720773 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.721124 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.721473 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.721816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.722154 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.722495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.722820 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.723174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.723501 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.723829 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.724159 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.724481 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.724801 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:41.760749 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] No DVR routers for this DVR port 16cce430-838f-4d22-97f3-2706eaad819c on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:06:41.895320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:06:41.895580 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:06:41.895901 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:06:41.900155 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Port 16cce430-838f-4d22-97f3-2706eaad819c on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:06:41.900471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Attempting to bind port 16cce430-838f-4d22-97f3-2706eaad819c on network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:06:41.905175 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:06:41.905509 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Checking segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:06:41.905887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Bound using segment: {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:06:41.906301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Bound port: 16cce430-838f-4d22-97f3-2706eaad819c, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '021f92d0-9a21-40a5-a75a-1804a88c5dc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:06:41.906643 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:41.968813 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:06:41.971785 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:06:42.048551 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:42.081105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:42.081735 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:42.083161 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] 10.222.0.54 "PUT /v2.0/ports/16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1093 time: 0.8966928 Dec 21 05:06:42.111291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a48308a-c6c4-4daa-b301-3b0a09bb8c72 service neutron] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=7']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:06:42.172192 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-42e90e76-e79c-4268-b5f6-19a4fd328a1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:42.173780 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-42e90e76-e79c-4268-b5f6-19a4fd328a1d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1096 time: 0.0471365 Dec 21 05:06:42.265692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-0cd3ad4f-f38d-4406-aabf-d026f16efee7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:42.267232 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-0cd3ad4f-f38d-4406-aabf-d026f16efee7 service neutron] 10.222.0.54 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.0867593 Dec 21 05:06:42.335510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-dff3f086-a5dd-4e4d-9600-2082545ae102 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1000 time: 0.0616882 Dec 21 05:06:42.384831 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-4db7673f-e7e5-4cf8-81d6-205ba835638f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:42.386373 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-4db7673f-e7e5-4cf8-81d6-205ba835638f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0436082 Dec 21 05:06:42.430668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-876ba4a3-c907-4a9e-a807-38dfebbe627e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:42.432032 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-876ba4a3-c907-4a9e-a807-38dfebbe627e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0390453 Dec 21 05:06:42.521120 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-bdecdd84-23b8-4f1b-8bb9-6dfa9cc82071 service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819242 Dec 21 05:06:42.612038 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2d56c3f8-ac35-431c-936b-20041a6b4c41 req-a0ef13ec-5599-41d1-a101-681022052487 service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830183 Dec 21 05:06:42.642135 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711a6ede-7120-42ae-bb50-ed92397bd918 req-c2e205e6-9739-4eed-936f-f427ced47478 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:42.644573 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-711a6ede-7120-42ae-bb50-ed92397bd918 req-c2e205e6-9739-4eed-936f-f427ced47478 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.0515056 Dec 21 05:06:42.692718 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-711a6ede-7120-42ae-bb50-ed92397bd918 req-46396d6d-d276-4ab5-a918-6bb58edd5ae9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0420301 Dec 21 05:06:43.099682 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:06:43.140813 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] The host n-h2-822053-11 is not matching for port 16cce430-838f-4d22-97f3-2706eaad819c host n-h1-822053-11! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 05:06:43.141210 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:06:43.594243 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:06:43.596553 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9af3a93-10d6-4deb-ab6f-53ea7713151e" -d '{"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:06:43.647447 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:06:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34541fe1-0fa9-49a5-83e7-38a76cac70f5 x-openstack-request-id: req-34541fe1-0fa9-49a5-83e7-38a76cac70f5 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:06:43.647745 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:06:43.648007 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-34541fe1-0fa9-49a5-83e7-38a76cac70f5 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:06:43.648417 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'status': 'completed', 'code': 200} Dec 21 05:06:43.736167 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-c06216ba-722c-4eb7-abd2-3a385d5a75b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:43.737853 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-c06216ba-722c-4eb7-abd2-3a385d5a75b7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1096 time: 0.0492492 Dec 21 05:06:43.750568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-8cc1760f-e85a-4408-83b3-7f7d7eee5c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:43.752240 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-8cc1760f-e85a-4408-83b3-7f7d7eee5c0d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1096 time: 0.0419712 Dec 21 05:06:43.831201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-5523811b-d352-478d-8b2c-29144f372ccc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:43.832697 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-5523811b-d352-478d-8b2c-29144f372ccc service neutron] 10.222.0.54 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.0848992 Dec 21 05:06:43.869521 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c79a0f-f28b-40aa-8ace-be20f9a9bf15 req-cb33d07e-2db5-430c-8e33-9d3c0d6787d7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:43.870911 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00c79a0f-f28b-40aa-8ace-be20f9a9bf15 req-cb33d07e-2db5-430c-8e33-9d3c0d6787d7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.1006157 Dec 21 05:06:43.901306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-32ca9a1f-6c25-41d7-9091-4f154628d526 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:43.902749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-32ca9a1f-6c25-41d7-9091-4f154628d526 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.1400645 Dec 21 05:06:43.907522 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-c2d8727f-3485-4540-af69-858647212f98 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1000 time: 0.0625880 Dec 21 05:06:43.960768 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-8bdfca74-51f8-4346-aea5-aa5a1e0bf560 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:43.962771 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-8bdfca74-51f8-4346-aea5-aa5a1e0bf560 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0479465 Dec 21 05:06:43.978411 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00c79a0f-f28b-40aa-8ace-be20f9a9bf15 req-8ba5436c-4727-4628-a118-1af32a128fb5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0986168 Dec 21 05:06:43.999693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-2a8f7aa8-ddfe-4b41-bdfa-a9743b06e0a6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1000 time: 0.0863345 Dec 21 05:06:44.015027 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-81604f31-a20c-4164-aac9-f9478372a0bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:44.016516 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-81604f31-a20c-4164-aac9-f9478372a0bc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0451417 Dec 21 05:06:44.054545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-c58654ba-488e-478f-8a6d-c6f5e1ebd808 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:44.056117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-c58654ba-488e-478f-8a6d-c6f5e1ebd808 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0445054 Dec 21 05:06:44.105627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-f5b59c7d-1cba-4b94-a77d-8179f0b4c583 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:44.107206 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-f5b59c7d-1cba-4b94-a77d-8179f0b4c583 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0405698 Dec 21 05:06:44.111393 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-0564521a-dd2c-4338-bd2b-627ae23b0002 service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873845 Dec 21 05:06:44.202081 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-46d47bba-f886-4cbf-b7a0-7fa666ad827d service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813942 Dec 21 05:06:44.204432 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-2fd0a76f-3227-412f-8ea5-185144980f5d service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859385 Dec 21 05:06:44.296956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c9af3a93-10d6-4deb-ab6f-53ea7713151e req-eae4eb79-eb28-4e7a-b7e5-52100c108709 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814149 Dec 21 05:06:45.098831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245deb96-5ae7-4cc0-9635-74d859cda221 req-ba06ed70-5b4c-45df-8093-20c7200b3277 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:45.100302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-245deb96-5ae7-4cc0-9635-74d859cda221 req-ba06ed70-5b4c-45df-8093-20c7200b3277 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.0512962 Dec 21 05:06:45.150322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-245deb96-5ae7-4cc0-9635-74d859cda221 req-82cddba3-4bbd-4487-851b-bfddbb4e13b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0425255 Dec 21 05:06:45.472519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6584e478-fe14-41e5-9d28-f1008a6c8998 req-9ee29872-f4d8-4ea9-96c5-ba13b9f1da8f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:45.474443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6584e478-fe14-41e5-9d28-f1008a6c8998 req-9ee29872-f4d8-4ea9-96c5-ba13b9f1da8f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.0498562 Dec 21 05:06:45.551816 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6584e478-fe14-41e5-9d28-f1008a6c8998 req-87b45c25-b348-45a7-8149-5a4abc4fdd14 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0701759 Dec 21 05:06:45.613456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-6a9aa775-5cdd-406f-8059-fdb9a7bf9859 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:45.621496 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-6a9aa775-5cdd-406f-8059-fdb9a7bf9859 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8&tenant_id=7037c5e415f34eb2b218d59f1243d003&binding%3Ahost_id=n-h1-822053-11 HTTP/1.1" status: 200 len: 944 time: 0.0995724 Dec 21 05:06:45.707468 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab34add-1d18-45be-a4c6-a58142c14c0c req-df3fd4ff-5bed-4a71-9e3d-cc3465f6fbad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:45.708960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ab34add-1d18-45be-a4c6-a58142c14c0c req-df3fd4ff-5bed-4a71-9e3d-cc3465f6fbad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 944 time: 0.0857651 Dec 21 05:06:45.714551 n-d-822053-11 neutron-server[110310]: INFO neutron.api.v2.resource [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-738163bd-8cd6-42c4-a1b7-f28bf3710ae1 service neutron] delete failed (client error): The resource could not be found. Dec 21 05:06:45.715558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-738163bd-8cd6-42c4-a1b7-f28bf3710ae1 service neutron] 10.222.0.31 "DELETE /v2.0/ports/16cce430-838f-4d22-97f3-2706eaad819c/bindings/n-h2-822053-11 HTTP/1.1" status: 404 len: 381 time: 0.0840604 Dec 21 05:06:45.759615 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ab34add-1d18-45be-a4c6-a58142c14c0c req-f408bced-90ef-41fc-9b14-ac5d26e09e2b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0422218 Dec 21 05:06:45.834301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-e4e7c078-aac6-4154-8c99-0e766d2dd8fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:45.835742 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-e4e7c078-aac6-4154-8c99-0e766d2dd8fb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1096 time: 0.0426140 Dec 21 05:06:45.929461 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-e46aead5-ef6a-4863-90e0-6082922ab22d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:45.931455 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-e46aead5-ef6a-4863-90e0-6082922ab22d service neutron] 10.222.0.31 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.0827196 Dec 21 05:06:46.004869 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-16dfd944-fbb4-4f0d-a983-807d192250aa service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1000 time: 0.0629411 Dec 21 05:06:46.056138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-21f7abff-58a2-4f07-84c8-816072f4029b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:46.057547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-21f7abff-58a2-4f07-84c8-816072f4029b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0420587 Dec 21 05:06:46.107183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-b4ab0255-ca5b-40d9-ba3f-d2116a09bcf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:46.108545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-b4ab0255-ca5b-40d9-ba3f-d2116a09bcf1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0400617 Dec 21 05:06:46.203479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-7a8c0df0-d0c2-4189-9f38-ff827ff04464 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827346 Dec 21 05:06:46.208252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:06:46.303255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f213bc05-2c6a-4f02-ba43-f635c29f4948 req-948615e1-b169-41e4-b0c7-ffe84d6743d3 service neutron] 10.222.0.31 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887067 Dec 21 05:06:46.316018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:06:46.484057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '16cce430-838f-4d22-97f3-2706eaad819c', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'port_id': '16cce430-838f-4d22-97f3-2706eaad819c', 'mac_address': 'fa:16:3e:a3:93:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:06:46.519876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:46.532093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 16cce430-838f-4d22-97f3-2706eaad819c {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:06:46.551196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:06:46.647909 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:46.694005 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:06:46.701169 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.701523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.701872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.702218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.702559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.702907 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.703267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.703601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.703931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.704267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.704597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.704924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.705251 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:06:46.884707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1482176-7239-4a50-a574-0a6ddfdaba71 req-90a69bde-3c35-4641-b893-af41f71a175d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:46.888738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1482176-7239-4a50-a574-0a6ddfdaba71 req-90a69bde-3c35-4641-b893-af41f71a175d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 945 time: 0.0577316 Dec 21 05:06:46.939338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1482176-7239-4a50-a574-0a6ddfdaba71 req-4130dfb6-9b88-4617-9535-65a6986d5afd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0467799 Dec 21 05:06:46.966001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['16cce430-838f-4d22-97f3-2706eaad819c'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:06:48.053205 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4fb1d7-9bf3-40fd-9d5c-2f44189d603c req-eb92c4b0-1a63-4f1a-9ffc-d55a38801cbd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:48.054657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae4fb1d7-9bf3-40fd-9d5c-2f44189d603c req-eb92c4b0-1a63-4f1a-9ffc-d55a38801cbd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 945 time: 0.0481744 Dec 21 05:06:48.103673 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae4fb1d7-9bf3-40fd-9d5c-2f44189d603c req-94a18a84-11a6-4cff-ba65-9f65d324c01f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0424764 Dec 21 05:06:48.126669 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52104) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:06:48.192503 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3013ddce-286a-4711-930e-9bf695c448f8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/a1a4cf46-00b3-48e9-b78c-58035e3847fe HTTP/1.1" status: 200 len: 993 time: 0.0646348 Dec 21 05:06:48.231485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:06:48.339292 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 16cce430-838f-4d22-97f3-2706eaad819c completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:06:48.343234 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 16cce430-838f-4d22-97f3-2706eaad819c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:06:48.343611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:48.417739 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:48.438793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:06:48.445799 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5201833d-06ee-4afa-a300-323ddd87f77d" -d '{"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-plugged", "status": "completed", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:06:48.452865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:06:48.481640 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:06:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d268f4e-49f3-4149-acf4-070cd3b7f0bc x-openstack-request-id: req-0d268f4e-49f3-4149-acf4-070cd3b7f0bc {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:06:48.481874 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-plugged", "status": "completed", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:06:48.482309 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0d268f4e-49f3-4149-acf4-070cd3b7f0bc {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:06:48.482767 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'code': 200} Dec 21 05:06:48.518013 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:48.567485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=9']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:06:49.969215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5613d3d8-d5e1-4c81-bcd6-b3e5a4ceab99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:52.728136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1b734321-10de-4457-bd4f-e7b79c91ecf0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:53.575361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:53.699424 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:55.375194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:55.464377 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:55.830148 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:06:58.872729 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:06:59.429524 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-37873bec-56f0-45d9-a6f0-22bff16d6298 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0389364 Dec 21 05:06:59.529858 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bdd503-6943-4379-9134-f1868633ba1b req-16921a63-6bf3-4e29-9f9d-28bac58adc96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:59.531383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-16921a63-6bf3-4e29-9f9d-28bac58adc96 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1098 time: 0.0407369 Dec 21 05:06:59.638351 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bdd503-6943-4379-9134-f1868633ba1b req-c12d2a55-2657-41b0-bb5d-e02470bfa15e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:59.639900 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-c12d2a55-2657-41b0-bb5d-e02470bfa15e service neutron] 10.222.0.54 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.0883615 Dec 21 05:06:59.706583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-dfda229e-9a81-4ce7-b061-532a79efd8aa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 1002 time: 0.0570033 Dec 21 05:06:59.760720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bdd503-6943-4379-9134-f1868633ba1b req-fb74aab6-bd5c-4914-a8a1-10e49c33a994 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:59.762125 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-fb74aab6-bd5c-4914-a8a1-10e49c33a994 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0479429 Dec 21 05:06:59.807158 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bdd503-6943-4379-9134-f1868633ba1b req-5e1ced26-104b-4a91-93ed-eb582f14b618 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:06:59.808648 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-5e1ced26-104b-4a91-93ed-eb582f14b618 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0391583 Dec 21 05:06:59.895053 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-277730ce-8db8-451e-b42d-ca5a8cc38990 service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787435 Dec 21 05:06:59.986580 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a0bdd503-6943-4379-9134-f1868633ba1b req-dbe37d7d-a6ce-4b1c-a863-97b28348d330 service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821879 Dec 21 05:07:16.841066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52116) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:17.046247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port a5954d46-7bd6-4fc3-bfe3-563d381eb5b1 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:07:17.046706 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:17.123800 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:17.124038 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:17.135462 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for a5954d46-7bd6-4fc3-bfe3-563d381eb5b1 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:07:17.418375 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:17.443576 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=a5954d46-7bd6-4fc3-bfe3-563d381eb5b1,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:17.502997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:17.503338 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP a1a4cf46-00b3-48e9-b78c-58035e3847fe disassociated (deleted). External IP: 172.25.5.177, port: 16cce430-838f-4d22-97f3-2706eaad819c. Dec 21 05:07:18.057913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:07:18.169972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:07:18.177725 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:18.180682 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] Sync routers for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:07:18.190658 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:18.191322 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:18.205847 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-b5f384da-eb15-48ba-a5ae-259430629f59 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/floatingips/a1a4cf46-00b3-48e9-b78c-58035e3847fe HTTP/1.1" status: 204 len: 168 time: 1.3636680 Dec 21 05:07:18.206497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:07:18.208766 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b" -d '{"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:07:18.246681 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:07:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70ade6b7-58e7-4195-85e1-a513ad0f7828 x-openstack-request-id: req-70ade6b7-58e7-4195-85e1-a513ad0f7828 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:07:18.247022 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:07:18.247286 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-70ade6b7-58e7-4195-85e1-a513ad0f7828 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:07:18.247746 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'status': 'completed', 'code': 200} Dec 21 05:07:18.302330 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:18.331888 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-fbfc1765-6c42-4ff2-84f2-f2a40e524924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:18.333302 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-fbfc1765-6c42-4ff2-84f2-f2a40e524924 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 1098 time: 0.0426097 Dec 21 05:07:18.427624 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-26038c20-ce85-4272-a0f1-d31c6fc98572 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:18.429145 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-26038c20-ce85-4272-a0f1-d31c6fc98572 service neutron] 10.222.0.54 "GET /v2.0/networks?id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 200 len: 897 time: 0.0885925 Dec 21 05:07:18.472874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-7f6ac529-b591-44fc-bde8-99b4c80b40c4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 200 len: 217 time: 0.0364058 Dec 21 05:07:18.501662 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:18.529270 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] Checking router: ba84f4c8-a332-4ad1-8223-2f24b165fbe8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:07:18.531438 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-3dc561f7-3ae2-41a3-afea-eab44876be1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:18.533010 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-3dc561f7-3ae2-41a3-afea-eab44876be1f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 200 len: 834 time: 0.0503156 Dec 21 05:07:18.537518 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:18.538110 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:06:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:18.613734 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-133e78b0-e4aa-4649-a34a-ce3b0569c28e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:18.615343 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-133e78b0-e4aa-4649-a34a-ce3b0569c28e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0458617 Dec 21 05:07:18.649377 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:18.658576 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55cb14bf-d5b1-4c13-b98c-d08a24b87d6b req-e49925c2-75e2-48f7-a65c-94a05f3fd96c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:18.660345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55cb14bf-d5b1-4c13-b98c-d08a24b87d6b req-e49925c2-75e2-48f7-a65c-94a05f3fd96c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0562820 Dec 21 05:07:18.711124 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-4991d19b-da92-42aa-8f89-6770ce8f4f0c service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863600 Dec 21 05:07:18.715682 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-55cb14bf-d5b1-4c13-b98c-d08a24b87d6b req-ecfe268d-1dc1-42e2-80fc-fe1d2410e5f0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0478580 Dec 21 05:07:18.806568 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-ccb05ac6-740f-45fd-89e4-fdaa3fa6a65b req-f8167a84-4eff-493f-8d88-3f158c409adf service neutron] 10.222.0.54 "GET /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881667 Dec 21 05:07:18.872172 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:18.989060 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-858af7bf-5bfe-4ece-8868-d08f6011c381 None None] The sync data for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 is: [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:28Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'ff73299b-5c54-4eb2-9338-87a3ec3142ce', 'name': '', 'network_id': 'e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:d9:11:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4257, 'fixed_ips': [{'subnet_id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:27Z', 'updated_at': '2021-12-21T05:05:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '350d6f1e-fe44-464c-8289-ee6194ca3e98', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:07:19.203316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b99a944-61bb-4857-9c4d-a65427fe5048 None None] New status for floating IP a1a4cf46-00b3-48e9-b78c-58035e3847fe: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:07:19.840122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb62c49-1e7d-4dcd-a3f3-f0c55348bb18 req-78d8eeda-c5e1-4155-9438-6979b05bae62 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:19.841604 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddb62c49-1e7d-4dcd-a3f3-f0c55348bb18 req-78d8eeda-c5e1-4155-9438-6979b05bae62 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0532889 Dec 21 05:07:19.890690 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ddb62c49-1e7d-4dcd-a3f3-f0c55348bb18 req-35e161c4-f8d8-48eb-a6af-b4a849725c29 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=06bf9a23-2390-4757-a9ff-a84d58c37b72&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0429873 Dec 21 05:07:19.952053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-aede49d1-6915-4532-92aa-eddd2455c7d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:20.048946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-3279f640-b5ae-4f13-aa53-66b3bc490fcc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:20.050376 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-3279f640-b5ae-4f13-aa53-66b3bc490fcc tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 946 time: 0.0486727 Dec 21 05:07:20.157543 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 16cce430-838f-4d22-97f3-2706eaad819c {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:07:20.157791 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:20.243435 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 16cce430-838f-4d22-97f3-2706eaad819c, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=16cce430-838f-4d22-97f3-2706eaad819c,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:20.243792 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:20.255455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 16cce430-838f-4d22-97f3-2706eaad819c owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:07:20.443556 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:20.472117 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=16cce430-838f-4d22-97f3-2706eaad819c,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:20.516360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] No DVR routers for this DVR port 16cce430-838f-4d22-97f3-2706eaad819c on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:07:20.518991 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:20.522352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a55b455b-32ca-4953-a1b3-b061a265bb0d req-63437317-511e-4074-933c-1e234443e0b7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "DELETE /v2.0/ports/16cce430-838f-4d22-97f3-2706eaad819c HTTP/1.1" status: 204 len: 173 time: 0.4648943 Dec 21 05:07:20.522791 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-deleted', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:07:20.525134 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f094b28-293d-4f03-a550-e923bf21f354" -d '{"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-deleted", "tag": "16cce430-838f-4d22-97f3-2706eaad819c"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:07:20.561271 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:07:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9375f9a1-c36c-4a85-a972-1a3dc6bb5c31 x-openstack-request-id: req-9375f9a1-c36c-4a85-a972-1a3dc6bb5c31 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:07:20.561697 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed9f10ec-5138-4b95-b3c4-8b704d48d8b8", "name": "network-vif-deleted", "tag": "16cce430-838f-4d22-97f3-2706eaad819c", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:07:20.561958 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9375f9a1-c36c-4a85-a972-1a3dc6bb5c31 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:07:20.562396 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed9f10ec-5138-4b95-b3c4-8b704d48d8b8', 'name': 'network-vif-deleted', 'tag': '16cce430-838f-4d22-97f3-2706eaad819c', 'status': 'completed', 'code': 200} Dec 21 05:07:20.999963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c225c9a7-2659-4596-b1f8-0893814552f6 req-e9fb6595-0eea-4832-adc7-1a13211f56ca tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=ed9f10ec-5138-4b95-b3c4-8b704d48d8b8 HTTP/1.1" status: 200 len: 210 time: 0.0267403 Dec 21 05:07:22.057495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52134) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:22.473690 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:22.723524 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a7be1c2f-ec05-445d-9ec7-8230e84b2822 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:22.782202 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port ff73299b-5c54-4eb2-9338-87a3ec3142ce {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:07:22.782202 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:22.869682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port ff73299b-5c54-4eb2-9338-87a3ec3142ce, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=ff73299b-5c54-4eb2-9338-87a3ec3142ce,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:22.870044 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:22.881590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for ff73299b-5c54-4eb2-9338-87a3ec3142ce owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:07:23.138385 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:23.169084 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=ff73299b-5c54-4eb2-9338-87a3ec3142ce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:23.349858 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:23.578704 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:23.715746 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:23.810256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:07:23.909789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:07:23.915128 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-bfb06329-9ec0-4f8b-9610-40d5fa8aebe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/ba84f4c8-a332-4ad1-8223-2f24b165fbe8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8564410 Dec 21 05:07:23.917638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52138) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:23.920168 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] Sync routers for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:07:23.929660 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:23.930340 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:23.971269 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting subnet 350d6f1e-fe44-464c-8289-ee6194ca3e98 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:07:23.974384 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.014193 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.032974 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:24.137710 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.205786 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:07:23Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:24.235050 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] Checking router: ba84f4c8-a332-4ad1-8223-2f24b165fbe8 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:07:24.243771 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] Routers {'ba84f4c8-a332-4ad1-8223-2f24b165fbe8'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:24.244395 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:24.255554 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.289235 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Subnet': ['ID=350d6f1e-fe44-464c-8289-ee6194ca3e98,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:24.294471 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.299993 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-7d4669d9-5910-43bb-8d8d-abbeaf8b05e8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/subnets/350d6f1e-fe44-464c-8289-ee6194ca3e98 HTTP/1.1" status: 204 len: 168 time: 0.3790374 Dec 21 05:07:24.300693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52140) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:24.303997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f502a08-20b2-4f4b-9a39-afb0333e9ee5 None None] Network e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:07:24.345138 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] Set router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:24.382339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:07:24.409407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 16cce430-838f-4d22-97f3-2706eaad819c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:07:24.409789 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 16cce430-838f-4d22-97f3-2706eaad819c not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:07:24.414324 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.488161 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] DHCP port deletion for e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:07:24.524597 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.532799 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:07:23Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:24.536018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] Deleting port 6db7f1fb-e3e5-4752-8739-7b511ffeedff {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:07:24.540769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.559404 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd3258b4-e942-44b9-b244-c968df68dad4 None None] The sync data for ids ['ba84f4c8-a332-4ad1-8223-2f24b165fbe8'] in n-d-822053-11 is: [{'id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-9504085', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118'}], 'enable_snat': True}, 'gw_port_id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:07:23Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '1cae8d20-2120-474a-82b2-95856ba3683f', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:48:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba84f4c8-a332-4ad1-8223-2f24b165fbe8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4254, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:05:24Z', 'updated_at': '2021-12-21T05:05:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:07:24.610341 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] For port 6db7f1fb-e3e5-4752-8739-7b511ffeedff, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6db7f1fb-e3e5-4752-8739-7b511ffeedff,segment=NetworkSegment(021f92d0-9a21-40a5-a75a-1804a88c5dc1),segment_id=021f92d0-9a21-40a5-a75a-1804a88c5dc1)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:24.610748 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.623210 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 1cae8d20-2120-474a-82b2-95856ba3683f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:07:24.623568 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.624545 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] Calling delete_port for 6db7f1fb-e3e5-4752-8739-7b511ffeedff owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:07:24.710565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 1cae8d20-2120-474a-82b2-95856ba3683f, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=1cae8d20-2120-474a-82b2-95856ba3683f,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:24.710851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.722382 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 1cae8d20-2120-474a-82b2-95856ba3683f owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:07:24.795943 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.825141 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] No DVR routers for this DVR port 6db7f1fb-e3e5-4752-8739-7b511ffeedff on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:07:24.834539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-428e89ca-66db-4bb6-bd6f-857d6f132dab None None] Pushing event deleted for resources: {'Port': ['ID=6db7f1fb-e3e5-4752-8739-7b511ffeedff,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:24.962467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:24.998422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=1cae8d20-2120-474a-82b2-95856ba3683f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:25.011802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd8998c4-2658-4f23-a871-9d19dd7d7ea6 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:07:25.030890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.031280 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.031631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.031978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.032325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.032707 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.032963 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.033294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.033708 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.033933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.034263 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.034624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.034905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:25.074855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.165476 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.167630 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.260269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.260861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Fanout notify agent at l3_agent the message router_deleted on router ba84f4c8-a332-4ad1-8223-2f24b165fbe8 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:07:25.267681 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.269481 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-953ac529-713d-4bf6-ad54-99df99c70da8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/routers/ba84f4c8-a332-4ad1-8223-2f24b165fbe8 HTTP/1.1" status: 204 len: 168 time: 0.9673102 Dec 21 05:07:25.271735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52142) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:25.357721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.364056 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.468233 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.468906 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.489146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:25.498125 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '021f92d0-9a21-40a5-a75a-1804a88c5dc1') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:25.500162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '021f92d0-9a21-40a5-a75a-1804a88c5dc1') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:25.507676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.520896 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.527392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:07:25.528816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:07:25.530672 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:07:25.632075 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.640030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.642703 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/networks/e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb HTTP/1.1" status: 204 len: 168 time: 0.3618970 Dec 21 05:07:25.645688 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52144) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:25.654421 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf4aae2-63b2-453e-995f-07aab67a3fe9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Network': ['ID=e9cb0459-ee81-47b8-a9c0-1a7a3ab3babb,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:25.703103 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00199bd7-80ee-4f40-ae90-c107598f8c3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.728956 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00199bd7-80ee-4f40-ae90-c107598f8c3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.730034 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db7f1fb-e3e5-4752-8739-7b511ffeedff no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:07:25.760122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6db7f1fb-e3e5-4752-8739-7b511ffeedff {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:07:25.760474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6db7f1fb-e3e5-4752-8739-7b511ffeedff not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:07:25.760902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff73299b-5c54-4eb2-9338-87a3ec3142ce no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:07:25.787601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: ff73299b-5c54-4eb2-9338-87a3ec3142ce {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:07:25.787975 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device ff73299b-5c54-4eb2-9338-87a3ec3142ce not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:07:25.854727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.872314 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00199bd7-80ee-4f40-ae90-c107598f8c3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.874881 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-00199bd7-80ee-4f40-ae90-c107598f8c3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:25.876060 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-00199bd7-80ee-4f40-ae90-c107598f8c3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/security-groups/06bf9a23-2390-4757-a9ff-a84d58c37b72 HTTP/1.1" status: 204 len: 168 time: 0.2292945 Dec 21 05:07:25.886581 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00199bd7-80ee-4f40-ae90-c107598f8c3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=06bf9a23-2390-4757-a9ff-a84d58c37b72,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:26.360628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52150) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:26.365203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-708979268', 'description': 'tempest-secgroup-smoke-708979268 description', 'project_id': '7037c5e415f34eb2b218d59f1243d003'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:26.454623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.518277 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.568730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.597314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=497aecae-1e6d-432c-8c91-4cde7a7c64ce,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:26.673903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.675182 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a1562360-37ff-45f1-b594-f8a6024d6811 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3135173 Dec 21 05:07:26.678035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52152) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:26.683381 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '497aecae-1e6d-432c-8c91-4cde7a7c64ce', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:26.768462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.825696 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.888985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.906510 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=97d104e6-004e-46c8-b66c-67084c4b56b7,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:26.986105 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:26.987356 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-68788cd9-0a65-442e-a9fe-a1cc63dfbe8c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3083878 Dec 21 05:07:26.990238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52154) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:26.995286 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '497aecae-1e6d-432c-8c91-4cde7a7c64ce', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:27.091788 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.152321 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.237757 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.255454 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b60856d1-956a-4586-a048-3795b3f20ba1,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:27.311298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1cae8d20-2120-474a-82b2-95856ba3683f no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:07:27.331530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 1cae8d20-2120-474a-82b2-95856ba3683f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:07:27.331881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 1cae8d20-2120-474a-82b2-95856ba3683f not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:07:27.340736 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.341972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-119361e1-dfaa-4cf5-8017-8016b6b38e9d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3507717 Dec 21 05:07:27.344725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52156) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:27.349022 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '497aecae-1e6d-432c-8c91-4cde7a7c64ce', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:27.452268 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.506227 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.583863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.601193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fcaab376-d011-4a80-996c-c52c73930dbf,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:27.666676 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.667960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6d72f18b-aa93-4b6f-9dbf-98bbd5bf91e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3222907 Dec 21 05:07:27.676479 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52158) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:27.681422 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '497aecae-1e6d-432c-8c91-4cde7a7c64ce', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:27.771534 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.827871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.889351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.909091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e197b16-0bb5-4260-9abf-33a533a115b2,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:27.965284 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:27.966522 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-14181b5e-0c01-4ed8-bad0-4f864db6ea51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2890887 Dec 21 05:07:27.970750 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52160) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:27.975101 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '497aecae-1e6d-432c-8c91-4cde7a7c64ce', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:28.049144 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:07:28.053872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.113460 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.200929 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.218905 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=20405a3a-9243-4164-aba5-c70b8c452419,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:28.296919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.298142 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1e81134f-694c-4d33-997f-667464fee1e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3264439 Dec 21 05:07:28.301453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52162) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:28.305278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '497aecae-1e6d-432c-8c91-4cde7a7c64ce', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:28.368885 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:07:28.374246 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.434582 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.498222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.515330 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8a42c46b-aa3d-444d-8019-75442021d093,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:28.580153 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.581284 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b4972c4e-ea16-4524-9493-ecee20bde8e4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2795026 Dec 21 05:07:28.584182 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52164) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:28.589759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'network': {'name': 'tempest-network-smoke--2105049702', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'port_security_enabled': True}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:28.666458 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:07:28.670034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.692481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:07:28.700903 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.701249 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Added segment 903fae24-6602-406d-b0f9-53cb7e690b3f of type vlan for network 1c282743-4b36-44de-afe3-6ab389c44276 Dec 21 05:07:28.739550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.808938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:28.814631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:28.815242 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.183732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Network': ['ID=1c282743-4b36-44de-afe3-6ab389c44276,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:29.193899 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 1c282743-4b36-44de-afe3-6ab389c44276 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:07:29.196675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-47e04a49-ff9f-4649-9d86-b2041daf1c09 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6108949 Dec 21 05:07:29.199355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52166) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:29.203777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'admin_state_up': True, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:29.289687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.290759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.342823 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.511755 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.735850 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.754045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:29.855676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.133 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/22492e2a-2bad-42d8-a0f2-643ad0059c18) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:07:29.951478 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:30.047055 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:30.090560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:07:30.093476 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:30.096900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:07:30.102987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=22492e2a-2bad-42d8-a0f2-643ad0059c18,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:30.111599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f85d185-ee09-45e7-9546-cc318339a006 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:07:30.194135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-51e3d751-2399-48e7-aa71-1972d7da1ac4 None None] Provisioning complete for port 22492e2a-2bad-42d8-a0f2-643ad0059c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:30.194864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-51e3d751-2399-48e7-aa71-1972d7da1ac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:30.226736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-51e3d751-2399-48e7-aa71-1972d7da1ac4 None None] Port 22492e2a-2bad-42d8-a0f2-643ad0059c18 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:07:30.402969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:30.596889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:30.775167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 0fc2541e-6961-4d31-aa7d-70b3fd301601 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:07:30.878439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:07:30.889003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Sync routers for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:07:30.903199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:30.903821 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:30.954010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:30.955309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-bf37c425-c8a4-4c39-b0ca-3a86351ff3e2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.7549980 Dec 21 05:07:30.958475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52168) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:31.009197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:31.029519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a0f2ab3-b2e1-4c7a-8c06-481a9b2b171c tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=7037c5e415f34eb2b218d59f1243d003&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0698497 Dec 21 05:07:31.032025 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52172) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:31.115770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a61569a3-eccd-429c-924f-7e22b89a5a0d tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:31.117297 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a61569a3-eccd-429c-924f-7e22b89a5a0d tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0843608 Dec 21 05:07:31.120599 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52174) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:31.148169 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b16a944f-563f-4911-af06-9c5222159d0f tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0265186 Dec 21 05:07:31.150622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52176) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:31.155272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-356747104', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:31.182720 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:30Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:31.208858 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Checking router: 0fc2541e-6961-4d31-aa7d-70b3fd301601 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:07:31.209557 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Updating router 0fc2541e-6961-4d31-aa7d-70b3fd301601 port 22492e2a-2bad-42d8-a0f2-643ad0059c18 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:07:31.233238 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.300676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:07:31.304341 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.485517 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.561657 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.590032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.624003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Subnet': ['ID=e8766881-d7e1-4c7e-b0c4-73add5df4bd6,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:31.631937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Checking segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:07:31.632115 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network hostable DHCP agents. Network: 1c282743-4b36-44de-afe3-6ab389c44276, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:07:31.639059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1ca20d1-52a3-43ef-a593-327f7aef97e7 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:07:31.653547 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Attempting to bind port 22492e2a-2bad-42d8-a0f2-643ad0059c18 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:07:31.653932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Attempting to bind port 22492e2a-2bad-42d8-a0f2-643ad0059c18 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:07:31.654291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Attempting to bind port 22492e2a-2bad-42d8-a0f2-643ad0059c18 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:07:31.656680 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d9fa2c-4e71-42f8-9367-97b518c02c08 None None] Pushing event updated for resources: {'Port': ['ID=22492e2a-2bad-42d8-a0f2-643ad0059c18,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:31.663273 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:07:31.663605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:07:31.663998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.664395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:07:31.665523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Bound port: 22492e2a-2bad-42d8-a0f2-643ad0059c18, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:07:31.665910 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.714881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] For port 22492e2a-2bad-42d8-a0f2-643ad0059c18, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:07:31.717793 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] For port 22492e2a-2bad-42d8-a0f2-643ad0059c18, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22492e2a-2bad-42d8-a0f2-643ad0059c18,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:07:31.726904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 1c282743-4b36-44de-afe3-6ab389c44276 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:07:31.756851 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-93ad7d9b-ca04-4685-9346-7f5eddab265f None None] Provisioning complete for port 22492e2a-2bad-42d8-a0f2-643ad0059c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:31.757223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-93ad7d9b-ca04-4685-9346-7f5eddab265f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.778559 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.812856 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 1c282743-4b36-44de-afe3-6ab389c44276) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:31.816790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:31.817634 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:31.829611 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b61605a9-0c91-49cf-a0aa-d1856d404249 None None] Network 1c282743-4b36-44de-afe3-6ab389c44276 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:07:31.838761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-862e1f5a-8798-4b91-b61b-079a8dfa0c59 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:07:31.856746 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-93ad7d9b-ca04-4685-9346-7f5eddab265f None None] Port 22492e2a-2bad-42d8-a0f2-643ad0059c18 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:07:31.877539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d9fa2c-4e71-42f8-9367-97b518c02c08 None None] Pushing event updated for resources: {'Port': ['ID=22492e2a-2bad-42d8-a0f2-643ad0059c18,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:31.895531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1ab5313f-fbc1-4c5d-b712-dd33de98140b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.7438633 Dec 21 05:07:31.898659 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52178) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:31.910397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:31.911061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:32.205379 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-1c282743-4b36-44de-afe3-6ab389c44276', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:07:32.206252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.214959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-be1992e0-71a4-4965-b4dd-a3958091e6a9 None None] Provisioning complete for port 22492e2a-2bad-42d8-a0f2-643ad0059c18 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:32.215610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be1992e0-71a4-4965-b4dd-a3958091e6a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.251143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:32.546252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be1992e0-71a4-4965-b4dd-a3958091e6a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.552436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Allocated IP 172.20.0.2 (1c282743-4b36-44de-afe3-6ab389c44276/e8766881-d7e1-4c7e-b0c4-73add5df4bd6/6dc5a2b8-b326-4dc1-9575-5f025514cb9e) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:07:32.618537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-be1992e0-71a4-4965-b4dd-a3958091e6a9 None None] For port 22492e2a-2bad-42d8-a0f2-643ad0059c18, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22492e2a-2bad-42d8-a0f2-643ad0059c18,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:32.692496 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.694534 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:30Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:32.729304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2460071e-27ee-4a56-850e-7876f76022b3 None None] The sync data for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 is: [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:30Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:07:32.730881 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-be1992e0-71a4-4965-b4dd-a3958091e6a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.819071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.823843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1992e0-71a4-4965-b4dd-a3958091e6a9 None None] Pushing event updated for resources: {'Port': ['ID=22492e2a-2bad-42d8-a0f2-643ad0059c18,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:32.882064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:32.925064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Network 1c282743-4b36-44de-afe3-6ab389c44276 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:07:32.927937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:32.933154 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:07:32.936339 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Pushing event updated for resources: {'Port': ['ID=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:32.996876 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Attempting to bind port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:07:32.997814 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Attempting to bind port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:07:32.998515 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Attempting to bind port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e on network 1c282743-4b36-44de-afe3-6ab389c44276 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:07:33.004826 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:07:33.009724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Checking segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:07:33.009724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.009724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Bound using segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:07:33.009724 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Bound port: 6dc5a2b8-b326-4dc1-9575-5f025514cb9e, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:07:33.009724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.083677 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] For port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:07:33.085247 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.1 (1c282743-4b36-44de-afe3-6ab389c44276/e8766881-d7e1-4c7e-b0c4-73add5df4bd6/092dd239-3dd4-431b-9665-a3117c083a88) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:07:33.087824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] For port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:07:33.175625 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.214113 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.247968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb17adbd-584e-4f4f-af4d-0ce6afabd46f None None] Pushing event updated for resources: {'Port': ['ID=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:33.310455 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.373442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 1c282743-4b36-44de-afe3-6ab389c44276 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:07:33.378171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:33.381100 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=092dd239-3dd4-431b-9665-a3117c083a88,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:33.384238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:07:33.447051 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.456170 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22492e2a-2bad-42d8-a0f2-643ad0059c18 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:07:33.531849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 22492e2a-2bad-42d8-a0f2-643ad0059c18 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:33.532363 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.667230 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:33.946250 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.007090 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.084703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=092dd239-3dd4-431b-9665-a3117c083a88,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:34.087697 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.199686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 1c282743-4b36-44de-afe3-6ab389c44276 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:07:34.201084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:34.253342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5984f466-a9c7-4c89-ba33-debfbab99e66 None None] Network 1c282743-4b36-44de-afe3-6ab389c44276 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:07:34.314743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 0fc2541e-6961-4d31-aa7d-70b3fd301601 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:07:34.370742 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a74c4632-5742-4ea0-90cf-993ece3950fb None None] Provisioning complete for port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:34.371149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a74c4632-5742-4ea0-90cf-993ece3950fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.431442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:07:34.441256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a9ac7f42-029b-4ded-a37c-7f4708b9e166 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/0fc2541e-6961-4d31-aa7d-70b3fd301601/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5412309 Dec 21 05:07:34.462187 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a74c4632-5742-4ea0-90cf-993ece3950fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.507761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a74c4632-5742-4ea0-90cf-993ece3950fb None None] For port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:34.573185 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a74c4632-5742-4ea0-90cf-993ece3950fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.646672 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74c4632-5742-4ea0-90cf-993ece3950fb None None] Pushing event updated for resources: {'Port': ['ID=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:34.653360 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-506905e9-486a-47d7-81db-b5c216a1e498 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-708979268&fields=id&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 267 time: 0.0626991 Dec 21 05:07:34.704817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cba2d407-73aa-43bc-8d4e-5bb6ef643ec6 None None] Provisioning complete for port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:34.705194 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cba2d407-73aa-43bc-8d4e-5bb6ef643ec6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.784250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-a3caac8d-9460-4f69-a87f-93d6c6d58844 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:34.789719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-a3caac8d-9460-4f69-a87f-93d6c6d58844 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/networks?id=1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 200 len: 797 time: 0.1288404 Dec 21 05:07:34.807557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-7bc1dbac-46dc-49e8-8a22-3f5eb40e214d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/quotas/7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 375 time: 0.0168691 Dec 21 05:07:34.809107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-cba2d407-73aa-43bc-8d4e-5bb6ef643ec6 None None] Provisioning complete for port 092dd239-3dd4-431b-9665-a3117c083a88 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:34.809491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cba2d407-73aa-43bc-8d4e-5bb6ef643ec6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:34.839505 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Sync routers for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:07:34.850079 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:34.850760 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:34.858257 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-cba2d407-73aa-43bc-8d4e-5bb6ef643ec6 None None] Port 092dd239-3dd4-431b-9665-a3117c083a88 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:07:34.868315 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-d059caeb-ca60-4b02-b808-2901525a85c6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0537558 Dec 21 05:07:34.918081 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-d6814a98-53b0-42dd-884d-6ee9a7feeb13 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:07:34.919132 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-d6814a98-53b0-42dd-884d-6ee9a7feeb13 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0467324 Dec 21 05:07:34.967396 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:34.977592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8432ea7e-81f6-43b4-8e5d-1c3a3ffaa186 None None] Provisioning complete for port 092dd239-3dd4-431b-9665-a3117c083a88 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:34.977993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8432ea7e-81f6-43b4-8e5d-1c3a3ffaa186 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.020536 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-e7d1d2b1-5704-4488-811d-99ff8e1acfab service neutron] 10.222.0.18 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0942469 Dec 21 05:07:35.031848 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8432ea7e-81f6-43b4-8e5d-1c3a3ffaa186 None None] Port 092dd239-3dd4-431b-9665-a3117c083a88 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:07:35.116712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-67e4f54b-d715-470f-a9f6-1e2a6c3dc449 service neutron] 10.222.0.18 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898089 Dec 21 05:07:35.156408 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9c53afe2-61e4-4255-a61c-5af8a1b25edd None None] Provisioning complete for port 092dd239-3dd4-431b-9665-a3117c083a88 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:35.156785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9c53afe2-61e4-4255-a61c-5af8a1b25edd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.192323 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 2, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:35.200392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9c53afe2-61e4-4255-a61c-5af8a1b25edd None None] Port 092dd239-3dd4-431b-9665-a3117c083a88 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:07:35.219247 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Checking router: 0fc2541e-6961-4d31-aa7d-70b3fd301601 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:07:35.219247 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Updating router 0fc2541e-6961-4d31-aa7d-70b3fd301601 port 092dd239-3dd4-431b-9665-a3117c083a88 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:07:35.244530 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.371138 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-230c2486-6d7a-4c78-aa4f-b2d027184243 req-61ec1510-e989-42c9-a05a-e3cd40bf15ef tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 210 time: 0.0358076 Dec 21 05:07:35.431304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6dc5a2b8-b326-4dc1-9575-5f025514cb9e up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:07:35.495627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:35.496277 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.557336 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.597554 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.646263 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Pushing event updated for resources: {'Port': ['ID=092dd239-3dd4-431b-9665-a3117c083a88,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:35.670249 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.670598 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.670943 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.671284 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.671612 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.671937 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.672262 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.672578 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.672895 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.673211 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.673528 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.673841 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.674222 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:07:35.708030 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Attempting to bind port 092dd239-3dd4-431b-9665-a3117c083a88 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:07:35.708506 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Attempting to bind port 092dd239-3dd4-431b-9665-a3117c083a88 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:07:35.708801 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Attempting to bind port 092dd239-3dd4-431b-9665-a3117c083a88 on network 1c282743-4b36-44de-afe3-6ab389c44276 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:07:35.715216 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:07:35.715700 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Checking segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:07:35.716094 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.716487 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Bound using segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:07:35.717031 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Bound port: 092dd239-3dd4-431b-9665-a3117c083a88, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:07:35.717313 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.787426 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] For port 092dd239-3dd4-431b-9665-a3117c083a88, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:07:35.790814 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] For port 092dd239-3dd4-431b-9665-a3117c083a88, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=092dd239-3dd4-431b-9665-a3117c083a88,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:07:35.859103 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.893741 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:07:35.914160 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:35.914777 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:35.922898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d5148da0-88ce-41a1-9c68-737b3a2c71b1 None None] Provisioning complete for port 092dd239-3dd4-431b-9665-a3117c083a88 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:35.923310 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5148da0-88ce-41a1-9c68-737b3a2c71b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:35.961197 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9872063d-aefb-4fea-8fec-f73ebf5eb809 None None] Pushing event updated for resources: {'Port': ['ID=092dd239-3dd4-431b-9665-a3117c083a88,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:36.011852 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5148da0-88ce-41a1-9c68-737b3a2c71b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:36.052220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d5148da0-88ce-41a1-9c68-737b3a2c71b1 None None] For port 092dd239-3dd4-431b-9665-a3117c083a88, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=092dd239-3dd4-431b-9665-a3117c083a88,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:36.137811 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:36.141003 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d5148da0-88ce-41a1-9c68-737b3a2c71b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:36.188889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5148da0-88ce-41a1-9c68-737b3a2c71b1 None None] Pushing event updated for resources: {'Port': ['ID=092dd239-3dd4-431b-9665-a3117c083a88,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:36.260483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2efec3dd-9dda-492c-90ab-6460d463cc2c None None] Provisioning complete for port 092dd239-3dd4-431b-9665-a3117c083a88 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:36.260764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2efec3dd-9dda-492c-90ab-6460d463cc2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:36.338385 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:35Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:36.366552 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d85c2c0-3d18-4f5c-8270-f732cb3f1c4d None None] The sync data for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 is: [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:35Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:07:36.495603 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7064c55f-823c-46d7-bd9a-b2618d58b382 req-0c01b1b3-e6d3-450b-8891-1e47775860b3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 210 time: 0.0274413 Dec 21 05:07:37.386863 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 092dd239-3dd4-431b-9665-a3117c083a88 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:07:37.440743 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 092dd239-3dd4-431b-9665-a3117c083a88 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:37.440915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:37.461712 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-bcfb52eb-91d8-4168-9316-f9b076f7af5d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:37.463794 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-bcfb52eb-91d8-4168-9316-f9b076f7af5d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/networks?id=1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 200 len: 797 time: 0.1276851 Dec 21 05:07:37.542096 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-c346405f-0934-4321-81c3-a5b42f5f5d8b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 379 time: 0.0557222 Dec 21 05:07:37.555187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'port': {'device_id': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'admin_state_up': True, 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'security_groups': ['497aecae-1e6d-432c-8c91-4cde7a7c64ce']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:37.611973 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6a62f7d4-b977-44c2-909d-b02e4328d849 req-dba58baa-5d15-4185-83c9-0b5bc9d32bb6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 210 time: 0.0418057 Dec 21 05:07:37.774588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:07:37.778753 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:37.909823 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.7 (1c282743-4b36-44de-afe3-6ab389c44276/e8766881-d7e1-4c7e-b0c4-73add5df4bd6/ead4d4e8-e293-4403-8b0f-df5746455b2f) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:07:38.042156 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.147008 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.194120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 1c282743-4b36-44de-afe3-6ab389c44276 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:07:38.197615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:38.201258 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:07:38.207837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=ead4d4e8-e293-4403-8b0f-df5746455b2f,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:38.255209 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:38.255836 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.332173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-8a561aff-761f-4cac-bd18-95c9d61d720b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7808149 Dec 21 05:07:38.404169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Request body: {'port': {'device_id': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:38.453317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.476862 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f1cbc3fd-4f21-42e4-8fcb-abee9ae71782 None None] Provisioning complete for port ead4d4e8-e293-4403-8b0f-df5746455b2f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:38.477396 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1cbc3fd-4f21-42e4-8fcb-abee9ae71782 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.513074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f1cbc3fd-4f21-42e4-8fcb-abee9ae71782 None None] Port ead4d4e8-e293-4403-8b0f-df5746455b2f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:07:38.735315 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ead4d4e8-e293-4403-8b0f-df5746455b2f {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:07:38.745108 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.768690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2484ce03-44d8-4d1d-a08f-a4773668fc6c req-f6003398-5e90-457f-a2c3-b2616ddc5b15 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:38.770171 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2484ce03-44d8-4d1d-a08f-a4773668fc6c req-f6003398-5e90-457f-a2c3-b2616ddc5b15 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 931 time: 0.0869670 Dec 21 05:07:38.771114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Transition to ACTIVE for port object ead4d4e8-e293-4403-8b0f-df5746455b2f will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:07:38.819967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2484ce03-44d8-4d1d-a08f-a4773668fc6c req-fdc174b8-9ae2-48e3-9218-f791ffd77c9a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437174 Dec 21 05:07:38.835482 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:38.888615 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Pushing event updated for resources: {'Port': ['ID=ead4d4e8-e293-4403-8b0f-df5746455b2f,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:38.957082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Attempting to bind port ead4d4e8-e293-4403-8b0f-df5746455b2f on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:07:38.957423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Attempting to bind port ead4d4e8-e293-4403-8b0f-df5746455b2f by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:07:38.957753 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Attempting to bind port ead4d4e8-e293-4403-8b0f-df5746455b2f on network 1c282743-4b36-44de-afe3-6ab389c44276 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:07:38.962568 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Port ead4d4e8-e293-4403-8b0f-df5746455b2f on network 1c282743-4b36-44de-afe3-6ab389c44276 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:07:38.962895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Attempting to bind port ead4d4e8-e293-4403-8b0f-df5746455b2f on network 1c282743-4b36-44de-afe3-6ab389c44276 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:07:38.968160 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 7, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:07:38.968504 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Checking segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:07:38.968895 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Bound using segment: {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:07:38.969329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Bound port: ead4d4e8-e293-4403-8b0f-df5746455b2f, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '903fae24-6602-406d-b0f9-53cb7e690b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:07:38.969683 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:39.034605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] For port ead4d4e8-e293-4403-8b0f-df5746455b2f, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:07:39.037713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] For port ead4d4e8-e293-4403-8b0f-df5746455b2f, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:07:39.092972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:39.126079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.126877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:39.128387 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] 10.222.0.31 "PUT /v2.0/ports/ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 200 len: 1092 time: 0.7725458 Dec 21 05:07:39.128760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:07:39.131144 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64" -d '{"events": [{"name": "network-changed", "server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:07:39.165099 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30dc00eb-6c6f-41f2-9aff-eaff6737d5dd service neutron] Pushing event updated for resources: {'Port': ['ID=ead4d4e8-e293-4403-8b0f-df5746455b2f,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:39.181941 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:07:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b4873e7-4987-4f2f-b540-60e18950394e x-openstack-request-id: req-3b4873e7-4987-4f2f-b540-60e18950394e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:07:39.182244 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:07:39.182499 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3b4873e7-4987-4f2f-b540-60e18950394e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:07:39.182906 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'status': 'completed', 'code': 200} Dec 21 05:07:39.276758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64 req-63b9dc03-d728-44be-87a0-2a62e864e7d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.278578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64 req-63b9dc03-d728-44be-87a0-2a62e864e7d2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1095 time: 0.0474594 Dec 21 05:07:39.388847 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64 req-d9775f4d-d0f5-4f5e-898e-fba5f882b674 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.390329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64 req-d9775f4d-d0f5-4f5e-898e-fba5f882b674 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=7037c5e415f34eb2b218d59f1243d003&shared=False HTTP/1.1" status: 200 len: 898 time: 0.0903976 Dec 21 05:07:39.489311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64 req-f14e109b-8d15-4172-a411-a1fecc8869bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.490763 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-71dfe40e-f2fd-49a4-9b3e-4bd7e9890d64 req-f14e109b-8d15-4172-a411-a1fecc8869bb service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0894501 Dec 21 05:07:39.609665 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-f32a9b87-2cc4-4bf0-a3df-d03d97cef5a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.611161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-f32a9b87-2cc4-4bf0-a3df-d03d97cef5a4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1095 time: 0.0406201 Dec 21 05:07:39.667444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-ba2315fa-740d-4628-89b7-b84c9b7df920 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 200 len: 217 time: 0.0385828 Dec 21 05:07:39.720674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-2dd16815-e735-4796-9a0a-4cd55f5a1ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.722071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-2dd16815-e735-4796-9a0a-4cd55f5a1ec8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e8766881-d7e1-4c7e-b0c4-73add5df4bd6 HTTP/1.1" status: 200 len: 834 time: 0.0428107 Dec 21 05:07:39.770074 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-4acfc845-5ccd-42fd-8574-b4cb33b492f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.771544 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-4acfc845-5ccd-42fd-8574-b4cb33b492f7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1c282743-4b36-44de-afe3-6ab389c44276&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383484 Dec 21 05:07:39.871244 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-dea1baf8-5420-4b2a-82b4-7a9d4b0b6440 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884402 Dec 21 05:07:39.984961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc2d6015-aac7-45a5-a238-9a385c880754 req-507990a5-034b-4b81-921f-1264d521993c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:39.986442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc2d6015-aac7-45a5-a238-9a385c880754 req-507990a5-034b-4b81-921f-1264d521993c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 943 time: 0.0950980 Dec 21 05:07:40.019227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-38dee0b1-bd2f-40b9-a87d-e81441db7b56 req-5db38810-8fbc-4371-b743-0d38d8c5bf24 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1361589 Dec 21 05:07:40.049103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-dc2d6015-aac7-45a5-a238-9a385c880754 req-df8d722c-d948-4fb2-9e52-d92b6771755a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542405 Dec 21 05:07:41.164831 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50157e0d-c476-4018-95b9-907ef1eb93a9 req-52bbd8ef-88c7-4db2-91e1-36ad4424272e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:41.166321 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50157e0d-c476-4018-95b9-907ef1eb93a9 req-52bbd8ef-88c7-4db2-91e1-36ad4424272e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 943 time: 0.0480402 Dec 21 05:07:41.214150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-50157e0d-c476-4018-95b9-907ef1eb93a9 req-62eefb29-39ca-46ee-a6c5-ea69ab78547e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419152 Dec 21 05:07:42.326953 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8afeebc-d0e6-4a2b-8336-aace645e712b req-36d1c92c-9228-4214-b897-448d70ee45b6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:42.328444 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8afeebc-d0e6-4a2b-8336-aace645e712b req-36d1c92c-9228-4214-b897-448d70ee45b6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 943 time: 0.0477502 Dec 21 05:07:42.377062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c8afeebc-d0e6-4a2b-8336-aace645e712b req-055c1791-3eb3-4c4c-af98-42d549a68d1c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426860 Dec 21 05:07:43.357143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ead4d4e8-e293-4403-8b0f-df5746455b2f details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:07:43.454104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port ead4d4e8-e293-4403-8b0f-df5746455b2f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:43.464791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'port_id': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'mac_address': 'fa:16:3e:ca:c3:3e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 142, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:07:43.501367 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb35b50-45b6-4667-a055-753bb357f50f req-a1bde78f-fbfb-4e13-bacd-d1822f99cd8d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:43.502258 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:43.502857 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fb35b50-45b6-4667-a055-753bb357f50f req-a1bde78f-fbfb-4e13-bacd-d1822f99cd8d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 943 time: 0.0520406 Dec 21 05:07:43.515124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ead4d4e8-e293-4403-8b0f-df5746455b2f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:07:43.534440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port ead4d4e8-e293-4403-8b0f-df5746455b2f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:43.550813 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6fb35b50-45b6-4667-a055-753bb357f50f req-3aae4ba5-4c54-49b6-89e4-61249deb5628 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417438 Dec 21 05:07:43.597411 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:43.644346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=ead4d4e8-e293-4403-8b0f-df5746455b2f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:43.956289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['ead4d4e8-e293-4403-8b0f-df5746455b2f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:07:44.663968 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60dd8903-404c-4228-a94e-7948764cbb66 req-ef53b675-1baf-4ea5-b72a-755ae3bb4242 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:44.666103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60dd8903-404c-4228-a94e-7948764cbb66 req-ef53b675-1baf-4ea5-b72a-755ae3bb4242 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 944 time: 0.0478160 Dec 21 05:07:44.713649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-60dd8903-404c-4228-a94e-7948764cbb66 req-ddaed578-625d-4f95-a5ff-b871d782b14f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416865 Dec 21 05:07:45.357261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ead4d4e8-e293-4403-8b0f-df5746455b2f up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:07:45.460201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port ead4d4e8-e293-4403-8b0f-df5746455b2f completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:07:45.464587 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port ead4d4e8-e293-4403-8b0f-df5746455b2f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:07:45.464961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:45.540461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:45.561913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:07:45.564217 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cac9dbf4-19f4-4055-b1b7-73d01012e574" -d '{"events": [{"server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "name": "network-vif-plugged", "status": "completed", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:07:45.577182 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port ead4d4e8-e293-4403-8b0f-df5746455b2f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:07:45.600778 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:07:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b0a83e6-03dc-4e7a-98ee-355ef0f7ec7f x-openstack-request-id: req-7b0a83e6-03dc-4e7a-98ee-355ef0f7ec7f {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:07:45.601073 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "name": "network-vif-plugged", "status": "completed", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:07:45.601330 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7b0a83e6-03dc-4e7a-98ee-355ef0f7ec7f {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:07:45.601730 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'code': 200} Dec 21 05:07:45.620413 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:45.677024 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=ead4d4e8-e293-4403-8b0f-df5746455b2f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:45.739462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a1378b-350b-4489-ad3a-fa6efd30dffd req-ba8084b2-d450-4b96-98de-a7458bb31f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:45.740999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48a1378b-350b-4489-ad3a-fa6efd30dffd req-ba8084b2-d450-4b96-98de-a7458bb31f15 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1097 time: 0.0434995 Dec 21 05:07:45.799735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48a1378b-350b-4489-ad3a-fa6efd30dffd req-1f989d88-17a9-4ee1-b4ff-e3826fbe302b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472937 Dec 21 05:07:45.834391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f09c00b3-1715-4f42-b296-fc031efc6047 req-bd3cc157-650e-468c-a638-b8cae5b905ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:45.835784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f09c00b3-1715-4f42-b296-fc031efc6047 req-bd3cc157-650e-468c-a638-b8cae5b905ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0520480 Dec 21 05:07:45.883854 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f09c00b3-1715-4f42-b296-fc031efc6047 req-df383351-338e-4987-b5c3-22eb471fde0b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415471 Dec 21 05:07:47.000551 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8e2c31-7ca4-444c-a7a1-ea85d77992e1 req-a997a4ed-baa6-41c5-b09a-a19aee7a3377 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:47.002042 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a8e2c31-7ca4-444c-a7a1-ea85d77992e1 req-a997a4ed-baa6-41c5-b09a-a19aee7a3377 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0487223 Dec 21 05:07:47.054563 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a8e2c31-7ca4-444c-a7a1-ea85d77992e1 req-ca7a848a-813e-4785-915b-7fd7b69a05ee tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464706 Dec 21 05:07:48.172137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77241562-a58d-4a7c-be6d-9115bd83f769 req-7818aacf-8fcf-4290-b2c3-611de7e22f5a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:48.173601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77241562-a58d-4a7c-be6d-9115bd83f769 req-7818aacf-8fcf-4290-b2c3-611de7e22f5a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0495231 Dec 21 05:07:48.225423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77241562-a58d-4a7c-be6d-9115bd83f769 req-b0d06d9f-d84d-4eef-a54f-2e2aaf36ab15 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457227 Dec 21 05:07:48.337423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3814a80-3024-4e49-8f0b-82dbf544bee5 req-0c9ea156-26ed-4416-a640-a840a807a8e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:48.338774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3814a80-3024-4e49-8f0b-82dbf544bee5 req-0c9ea156-26ed-4416-a640-a840a807a8e6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0475314 Dec 21 05:07:48.386399 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f3814a80-3024-4e49-8f0b-82dbf544bee5 req-01a5610f-ac7c-46d4-b35c-26b49d4e85c2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417805 Dec 21 05:07:48.407064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52242) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:48.448268 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88811a2d-cbc3-4039-ab08-99a3d5f83a74 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:48.449720 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-88811a2d-cbc3-4039-ab08-99a3d5f83a74 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1092 time: 0.0416994 Dec 21 05:07:48.452405 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52244) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:48.456619 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:07:48.563423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:48.656598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.043341 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.25 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/58c7c5d3-25d3-4d91-a046-5bf801a3eb42) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:07:49.142794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.215326 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.257983 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:07:49.260842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:07:49.264835 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:07:49.286290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=58c7c5d3-25d3-4d91-a046-5bf801a3eb42,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:49.619675 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.732160 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.881801 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.955445 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:49.984117 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84436b6c-b247-4ce2-a0e0-9fd457acb228 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:50.026373 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=58c7c5d3-25d3-4d91-a046-5bf801a3eb42,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:07:50.037024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:50.141183 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP 6839110b-fba3-4ede-9213-de121a999b12 associated. External IP: 172.25.5.25, port: ead4d4e8-e293-4403-8b0f-df5746455b2f. Dec 21 05:07:50.349078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 0fc2541e-6961-4d31-aa7d-70b3fd301601 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:07:50.459392 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:07:50.474440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] Sync routers for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:07:50.484773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:50.496615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:50.586271 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:50.591055 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:50.615656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd032ddb-2f47-46d6-bfb2-156a2dabee97 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.1615009 Dec 21 05:07:50.615656 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:07:50.617821 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b23fff8-0898-4199-877a-9c59db9f1ae3" -d '{"events": [{"name": "network-changed", "server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:07:50.654371 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:07:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d8de285-1a95-4698-9f8c-272bff577972 x-openstack-request-id: req-2d8de285-1a95-4698-9f8c-272bff577972 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:07:50.654660 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:07:50.654916 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2d8de285-1a95-4698-9f8c-272bff577972 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:07:50.655339 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'status': 'completed', 'code': 200} Dec 21 05:07:50.746466 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-445e00be-7e12-430c-bc21-01cc19096171 req-1b5d5cf0-5463-4d69-9752-132fa92e1bff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:50.747892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-445e00be-7e12-430c-bc21-01cc19096171 req-1b5d5cf0-5463-4d69-9752-132fa92e1bff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0782943 Dec 21 05:07:50.769069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-d5665828-83ad-427f-8129-c635c1329664 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:50.772061 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-d5665828-83ad-427f-8129-c635c1329664 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1097 time: 0.0706089 Dec 21 05:07:50.822769 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6839110b-fba3-4ede-9213-de121a999b12', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.25', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'port_id': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4279, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'mac_address': 'fa:16:3e:ca:c3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:07:49Z', 'updated_at': '2021-12-21T05:07:49Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:36Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:50.848791 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] Checking router: 0fc2541e-6961-4d31-aa7d-70b3fd301601 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:07:50.857326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:07:50.857936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:07:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:50.864127 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-445e00be-7e12-430c-bc21-01cc19096171 req-3db410fc-8748-4b8a-8617-38a9633376c7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1088729 Dec 21 05:07:50.887046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52250) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:50.897754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-c6b73d6f-e9e6-4729-97a8-a37907eea270 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:50.899367 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-c6b73d6f-e9e6-4729-97a8-a37907eea270 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 200 len: 898 time: 0.1191187 Dec 21 05:07:50.953855 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-1d93081c-81c9-4cf6-9335-3650354a90ef tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6839110b-fba3-4ede-9213-de121a999b12 HTTP/1.1" status: 200 len: 990 time: 0.0645401 Dec 21 05:07:50.972592 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-4cf44c28-19fa-4c59-ba6c-f5a02863b9c3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 200 len: 998 time: 0.0657263 Dec 21 05:07:51.024107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-c4e5d829-5900-415f-b743-0afffe5dfecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:51.026243 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-c4e5d829-5900-415f-b743-0afffe5dfecf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e8766881-d7e1-4c7e-b0c4-73add5df4bd6 HTTP/1.1" status: 200 len: 834 time: 0.0471671 Dec 21 05:07:51.073675 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-5904f006-0457-4220-93b8-6f215a7f1908 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:07:51.075235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-5904f006-0457-4220-93b8-6f215a7f1908 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1c282743-4b36-44de-afe3-6ab389c44276&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0418565 Dec 21 05:07:51.130190 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:07:51.169427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-a69c930a-f869-421b-8547-da6bb3f9ba08 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871575 Dec 21 05:07:51.259731 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b23fff8-0898-4199-877a-9c59db9f1ae3 req-6db6da91-9920-4868-b690-664ca0d17090 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821657 Dec 21 05:07:51.348106 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6839110b-fba3-4ede-9213-de121a999b12', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.25', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'port_id': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4279, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'mac_address': 'fa:16:3e:ca:c3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:07:49Z', 'updated_at': '2021-12-21T05:07:49Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:36Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:07:51.377961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de3fa593-6084-46f6-9406-c94da484b5ef None None] The sync data for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 is: [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '6839110b-fba3-4ede-9213-de121a999b12', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.25', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'port_id': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 4279, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'mac_address': 'fa:16:3e:ca:c3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:07:49Z', 'updated_at': '2021-12-21T05:07:49Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:36Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:07:51.572822 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a3a2fa2-4923-4d05-ac86-7fbac85884a0 None None] New status for floating IP 6839110b-fba3-4ede-9213-de121a999b12: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:07:51.956258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52252) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:07:52.019019 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-3dc2cbbc-7fac-487c-bad3-8f3143045ed2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6839110b-fba3-4ede-9213-de121a999b12 HTTP/1.1" status: 200 len: 992 time: 0.0615618 Dec 21 05:07:52.772029 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0563dc55-3dd8-4ed4-93c5-674e2c08692a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:53.600727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:53.732557 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:55.346165 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:55.442894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:07:55.823461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:12.872649 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:08:19.951861 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6497728d-9d3b-4854-8e5d-24b3594224fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:22.711238 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-631d4740-4ef9-4981-b106-01eac1a140de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:23.591994 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:23.768806 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:25.386059 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:25.463575 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:25.676019 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ca3e4a-ad1b-432e-80e1-1a8c30045518 req-a765f1a2-a049-4cea-a346-3bbc1cfcfef5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:25.677552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2ca3e4a-ad1b-432e-80e1-1a8c30045518 req-a765f1a2-a049-4cea-a346-3bbc1cfcfef5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.1032975 Dec 21 05:08:25.731398 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e2ca3e4a-ad1b-432e-80e1-1a8c30045518 req-b42b7754-f3ad-440e-9583-cb22a45dbdde tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473678 Dec 21 05:08:25.829066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:26.894897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4270c4fd-0685-4848-9cf1-32a59c72adc2 req-5e198785-6256-4328-b6ee-a542af81f3ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:26.896316 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4270c4fd-0685-4848-9cf1-32a59c72adc2 req-5e198785-6256-4328-b6ee-a542af81f3ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0958242 Dec 21 05:08:26.944873 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4270c4fd-0685-4848-9cf1-32a59c72adc2 req-bd02b74c-be00-42a0-873b-0fc778375b62 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424895 Dec 21 05:08:28.059060 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d411fde4-c2c3-432a-9793-27a702976335 req-c1a21f0c-5e8e-49d2-86a1-f5328e2700ac tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:28.060751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d411fde4-c2c3-432a-9793-27a702976335 req-c1a21f0c-5e8e-49d2-86a1-f5328e2700ac tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0479078 Dec 21 05:08:28.108596 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d411fde4-c2c3-432a-9793-27a702976335 req-5bc13cdd-d7a7-4fbb-95ab-25e0a31c3c47 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420861 Dec 21 05:08:29.228537 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3af9bcd-f1d9-41da-880f-4c8fdadaf7aa req-0983dc2e-1fe6-4dbf-bd48-aafe5b6bfec0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:29.229984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3af9bcd-f1d9-41da-880f-4c8fdadaf7aa req-0983dc2e-1fe6-4dbf-bd48-aafe5b6bfec0 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0518224 Dec 21 05:08:29.277696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3af9bcd-f1d9-41da-880f-4c8fdadaf7aa req-f93b566c-a0f4-4302-bee2-d3cdd5dfb8da tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415556 Dec 21 05:08:30.391282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a9ac6d-6617-486c-a700-1278e0629cb5 req-d49d1217-ea87-4a25-b827-acb4cfd36ad7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:30.392754 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3a9ac6d-6617-486c-a700-1278e0629cb5 req-d49d1217-ea87-4a25-b827-acb4cfd36ad7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0485790 Dec 21 05:08:30.441733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3a9ac6d-6617-486c-a700-1278e0629cb5 req-419a7096-6f5d-422d-99d1-ddc1bed28940 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430539 Dec 21 05:08:31.560098 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69a4c9f-387c-4de5-8c82-9ee1bd8c2e0a req-54870a88-3b5a-4001-9160-aef2f4bc9f9f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:31.561560 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f69a4c9f-387c-4de5-8c82-9ee1bd8c2e0a req-54870a88-3b5a-4001-9160-aef2f4bc9f9f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0520415 Dec 21 05:08:31.610209 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f69a4c9f-387c-4de5-8c82-9ee1bd8c2e0a req-2eaf47cc-09d3-40c5-9420-88d39640e692 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426321 Dec 21 05:08:32.723540 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89785a4d-0659-4982-a10f-290f3fa386c4 req-8f1f7b2b-4291-4c15-876d-f1abf7550baf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:32.725006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89785a4d-0659-4982-a10f-290f3fa386c4 req-8f1f7b2b-4291-4c15-876d-f1abf7550baf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0474095 Dec 21 05:08:32.773977 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89785a4d-0659-4982-a10f-290f3fa386c4 req-2fcad6d0-2ca0-499b-8abf-810c359f7e73 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431089 Dec 21 05:08:33.888168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495f62ce-98fc-4436-994c-33991e0f7877 req-b121d168-f41b-43f4-8fc4-8f554023593a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:33.889614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-495f62ce-98fc-4436-994c-33991e0f7877 req-b121d168-f41b-43f4-8fc4-8f554023593a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0488911 Dec 21 05:08:33.943423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-495f62ce-98fc-4436-994c-33991e0f7877 req-ea0efd27-83df-46f9-a007-682c51d6e5e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477095 Dec 21 05:08:35.056757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7622fbaa-be88-4363-83d8-a4a4ea928e51 req-acc65a09-414b-4b1d-aea1-0bb1bf9783b5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:35.058212 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7622fbaa-be88-4363-83d8-a4a4ea928e51 req-acc65a09-414b-4b1d-aea1-0bb1bf9783b5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0485551 Dec 21 05:08:35.110328 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7622fbaa-be88-4363-83d8-a4a4ea928e51 req-ae290e32-153a-4fbf-9e94-f5b1d9f85645 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454011 Dec 21 05:08:36.228354 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78e76a2-5b57-4a7e-97fa-5fbe23413200 req-b846dff4-3614-4542-8340-82b8fda8974f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:36.229827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c78e76a2-5b57-4a7e-97fa-5fbe23413200 req-b846dff4-3614-4542-8340-82b8fda8974f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0482612 Dec 21 05:08:36.283037 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c78e76a2-5b57-4a7e-97fa-5fbe23413200 req-81baf6b1-2379-4d89-939b-8d6d462e2cfe tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463579 Dec 21 05:08:36.305188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52290) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:08:36.369686 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-974bfdb5-c45e-4fb8-8afa-6dfec81302d2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6839110b-fba3-4ede-9213-de121a999b12 HTTP/1.1" status: 200 len: 992 time: 0.0620313 Dec 21 05:08:37.799358 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1beb5e-4331-4c94-98d7-ae1954dd95ba req-e2aa0b8e-3366-4555-86ee-389a0e61a669 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:37.800929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee1beb5e-4331-4c94-98d7-ae1954dd95ba req-e2aa0b8e-3366-4555-86ee-389a0e61a669 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0501189 Dec 21 05:08:37.851968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee1beb5e-4331-4c94-98d7-ae1954dd95ba req-a691da81-27d9-4792-a621-19e2b1736fa8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448151 Dec 21 05:08:37.911548 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-e4c03934-8373-4ed4-a716-0d1e2cf48648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:37.913046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-e4c03934-8373-4ed4-a716-0d1e2cf48648 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1097 time: 0.0443730 Dec 21 05:08:38.005410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-594ba6b4-f25a-4aa8-ab43-f0707b0ab170 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:38.006881 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-594ba6b4-f25a-4aa8-ab43-f0707b0ab170 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 200 len: 898 time: 0.0833237 Dec 21 05:08:38.080087 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-0308de06-0cab-4374-923a-b012afcea7e7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 200 len: 1000 time: 0.0612197 Dec 21 05:08:38.133693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-788d91b8-1a22-4854-8f3a-9ed16eb806ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:38.135133 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-788d91b8-1a22-4854-8f3a-9ed16eb806ff service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e8766881-d7e1-4c7e-b0c4-73add5df4bd6 HTTP/1.1" status: 200 len: 834 time: 0.0431406 Dec 21 05:08:38.185489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-e71438ce-508c-4d2d-b7fe-ac43e38c2809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:38.186965 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-e71438ce-508c-4d2d-b7fe-ac43e38c2809 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1c282743-4b36-44de-afe3-6ab389c44276&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0385857 Dec 21 05:08:38.290357 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-c8bcf6a8-ac9c-4d3e-83d4-af4f7e0eab07 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869391 Dec 21 05:08:38.385010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fb7109c6-5cc7-4faa-b8d6-7e5fad746c1d req-98b155ba-ec65-47bc-ba31-08ff57c2dc32 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813456 Dec 21 05:08:38.976206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c6fcdde-0eaf-432b-ba73-1c768df536c2 req-a3c390c3-9469-42c1-905c-b67655f68592 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:38.977713 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c6fcdde-0eaf-432b-ba73-1c768df536c2 req-a3c390c3-9469-42c1-905c-b67655f68592 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0544705 Dec 21 05:08:39.026452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c6fcdde-0eaf-432b-ba73-1c768df536c2 req-5fc1a061-9229-4d12-9c0f-64d34fcafdf1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418396 Dec 21 05:08:40.142499 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09636206-756c-4445-b782-d4d437359c5b req-eaaa5284-7f07-4024-bc39-5ecddbebc45f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:40.144000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09636206-756c-4445-b782-d4d437359c5b req-eaaa5284-7f07-4024-bc39-5ecddbebc45f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0491569 Dec 21 05:08:40.191547 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09636206-756c-4445-b782-d4d437359c5b req-523f27d2-3229-4509-b159-1722bcbf6c28 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414717 Dec 21 05:08:40.213596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:08:40.277426 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e38da89f-13bf-4c29-94ae-7bed829c64b8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/6839110b-fba3-4ede-9213-de121a999b12 HTTP/1.1" status: 200 len: 992 time: 0.0627322 Dec 21 05:08:42.698478 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-0aa10348-4efe-4f83-96bd-7621e759d650 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0392501 Dec 21 05:08:42.794250 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-3ddff269-cc1e-4dd4-8366-831552b21cdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:42.795751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-3ddff269-cc1e-4dd4-8366-831552b21cdf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1097 time: 0.0391843 Dec 21 05:08:42.899129 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-0712cf4f-bbda-4e39-b8ae-35cccc998c8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:42.900483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-0712cf4f-bbda-4e39-b8ae-35cccc998c8f service neutron] 10.222.0.31 "GET /v2.0/networks?id=1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 200 len: 898 time: 0.0855567 Dec 21 05:08:42.963877 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-d3588c2c-8907-4397-8dc9-f3ac1aa9fdbb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 200 len: 1000 time: 0.0560799 Dec 21 05:08:43.011695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-caa550fe-f2b7-41bb-893b-9e48b98fbff8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:43.013678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-caa550fe-f2b7-41bb-893b-9e48b98fbff8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e8766881-d7e1-4c7e-b0c4-73add5df4bd6 HTTP/1.1" status: 200 len: 834 time: 0.0426571 Dec 21 05:08:43.061938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-397896af-a61a-4ad1-9f8d-6e92260a90f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:08:43.063469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-397896af-a61a-4ad1-9f8d-6e92260a90f1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1c282743-4b36-44de-afe3-6ab389c44276&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0426342 Dec 21 05:08:43.151419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-ad2cd3a2-413c-424f-8002-7db265aee5a9 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803211 Dec 21 05:08:43.243008 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-562b81da-72e8-4c34-9d5e-6d62fde2bdc3 req-2b33d4fc-d1bc-4003-8758-9d592d596710 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829153 Dec 21 05:08:49.872538 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:08:49.979986 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-849f9f38-743d-48d8-ba90-8e8a2cc26742 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:52.736831 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0ca286ae-087c-45e8-bb12-9af8e281c7b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:53.605651 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:53.759461 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:55.376996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:55.485200 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:08:55.810807 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:12.736624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52322) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:12.891040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 58c7c5d3-25d3-4d91-a046-5bf801a3eb42 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:09:12.891298 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:12.965830 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:12.966154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:12.977866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 58c7c5d3-25d3-4d91-a046-5bf801a3eb42 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:09:13.482925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:13.508085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=58c7c5d3-25d3-4d91-a046-5bf801a3eb42,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:13.521695 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.522050 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.522400 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.522734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.523092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.523419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.523746 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.524078 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.524404 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.524725 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.525047 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.525365 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.525684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:13.577504 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:13.577835 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP 6839110b-fba3-4ede-9213-de121a999b12 disassociated (deleted). External IP: 172.25.5.25, port: ead4d4e8-e293-4403-8b0f-df5746455b2f. Dec 21 05:09:13.813418 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 0fc2541e-6961-4d31-aa7d-70b3fd301601 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:09:13.921385 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:09:13.925793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:13.931323 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] Sync routers for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:09:13.945344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:13.945961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:13.954683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cf414644-3240-4df2-b935-4f0b6f99a271 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/floatingips/6839110b-fba3-4ede-9213-de121a999b12 HTTP/1.1" status: 204 len: 168 time: 1.2169569 Dec 21 05:09:13.955343 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:09:13.959809 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ab63082-579b-4514-abf3-cbaa05efda7e" -d '{"events": [{"name": "network-changed", "server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:09:13.997717 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:09:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3470fc02-3970-4220-be5e-490c6966a16c x-openstack-request-id: req-3470fc02-3970-4220-be5e-490c6966a16c {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:09:13.998872 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:09:13.999267 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3470fc02-3970-4220-be5e-490c6966a16c {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:09:13.999693 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'status': 'completed', 'code': 200} Dec 21 05:09:14.059969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:14.097397 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-d6db4b90-0bdf-4962-9441-764ca95b9731 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:14.099140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-d6db4b90-0bdf-4962-9441-764ca95b9731 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 1097 time: 0.0410736 Dec 21 05:09:14.200356 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-e2e78e9d-8d8e-47f2-b327-1711d168fd56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:14.202292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-e2e78e9d-8d8e-47f2-b327-1711d168fd56 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 200 len: 898 time: 0.0906854 Dec 21 05:09:14.255826 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-ac03710a-11d3-4c34-912b-999c9cd6bbb6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 200 len: 217 time: 0.0360985 Dec 21 05:09:14.259316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:36Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:14.290674 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] Checking router: 0fc2541e-6961-4d31-aa7d-70b3fd301601 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:09:14.300539 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:14.301288 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:14.320796 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-9b016edd-f709-4b20-9d4a-2a4ce3f996df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:14.322289 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-9b016edd-f709-4b20-9d4a-2a4ce3f996df service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e8766881-d7e1-4c7e-b0c4-73add5df4bd6 HTTP/1.1" status: 200 len: 834 time: 0.0542319 Dec 21 05:09:14.401811 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab4d00-1733-4dbd-9e42-8039dcc4b077 req-f5979397-68ef-456a-b19a-5cedaf3948b8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:14.403333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaab4d00-1733-4dbd-9e42-8039dcc4b077 req-f5979397-68ef-456a-b19a-5cedaf3948b8 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0751529 Dec 21 05:09:14.410063 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:14.420586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-8d5a8153-cb25-4ba2-be77-2e9f500eca9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:14.422031 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-8d5a8153-cb25-4ba2-be77-2e9f500eca9d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1c282743-4b36-44de-afe3-6ab389c44276&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0621498 Dec 21 05:09:14.482057 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaab4d00-1733-4dbd-9e42-8039dcc4b077 req-4cc16a39-9ad2-4fd3-b067-0bd985e5a96d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0715497 Dec 21 05:09:14.541433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-ca1ef2c1-b58b-44ba-ab69-8fd72d273713 service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1076880 Dec 21 05:09:14.610538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:36Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:14.634075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0ab63082-579b-4514-abf3-cbaa05efda7e req-b8201480-366a-40b7-891f-ede1753e7cbc service neutron] 10.222.0.31 "GET /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839524 Dec 21 05:09:14.636776 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e1be3ed-1ac2-4910-9f71-2198d41e54a1 None None] The sync data for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 is: [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:33Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '092dd239-3dd4-431b-9665-a3117c083a88', 'name': '', 'network_id': '1c282743-4b36-44de-afe3-6ab389c44276', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:ea:f2:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_interface', 'standard_attr_id': 4276, 'fixed_ips': [{'subnet_id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:32Z', 'updated_at': '2021-12-21T05:07:36Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': 'e8766881-d7e1-4c7e-b0c4-73add5df4bd6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:09:14.854667 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c8533d9-5875-46e0-817a-e5d46c9037f0 None None] New status for floating IP 6839110b-fba3-4ede-9213-de121a999b12: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:09:15.605743 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef681c0b-4181-4754-99f3-c03564325f5e req-e2ee3ea8-f6a3-44cb-885e-419545d898ee tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:15.607253 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef681c0b-4181-4754-99f3-c03564325f5e req-e2ee3ea8-f6a3-44cb-885e-419545d898ee tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0541894 Dec 21 05:09:15.657266 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef681c0b-4181-4754-99f3-c03564325f5e req-d1812590-372d-4e79-ab86-f5c4c911b5c6 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436683 Dec 21 05:09:16.359171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-84ef4213-21dc-4531-a280-579b292389f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:16.360903 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-84ef4213-21dc-4531-a280-579b292389f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0474243 Dec 21 05:09:16.450593 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port ead4d4e8-e293-4403-8b0f-df5746455b2f {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:09:16.451479 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:16.541563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port ead4d4e8-e293-4403-8b0f-df5746455b2f, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=ead4d4e8-e293-4403-8b0f-df5746455b2f,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:16.541925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:16.553629 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for ead4d4e8-e293-4403-8b0f-df5746455b2f owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:09:16.772503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cbdfb19-4d32-4395-a200-36003563e60d req-040c8738-19b9-4753-9c72-595789fbf817 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:16.773997 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cbdfb19-4d32-4395-a200-36003563e60d req-040c8738-19b9-4753-9c72-595789fbf817 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=6764484d-2e77-4a0c-9ec1-cdb98af1e385 HTTP/1.1" status: 200 len: 945 time: 0.0489857 Dec 21 05:09:16.775063 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:16.816238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=ead4d4e8-e293-4403-8b0f-df5746455b2f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:16.868123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] No DVR routers for this DVR port ead4d4e8-e293-4403-8b0f-df5746455b2f on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:09:16.872497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:16.875858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a925aa9-7dd1-46a3-9399-67eebecda592 req-122c5f40-ea6e-447e-89d0-84ceef6893f7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.31 "DELETE /v2.0/ports/ead4d4e8-e293-4403-8b0f-df5746455b2f HTTP/1.1" status: 204 len: 173 time: 0.5061331 Dec 21 05:09:16.876298 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'name': 'network-vif-deleted', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:09:16.878500 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9fed77b2-5462-4ed9-b8fe-421c295596d1" -d '{"events": [{"server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "name": "network-vif-deleted", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:09:16.895183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1cbdfb19-4d32-4395-a200-36003563e60d req-24db02ea-ba01-465d-892d-9feaafe0ac41 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=497aecae-1e6d-432c-8c91-4cde7a7c64ce&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1135974 Dec 21 05:09:16.917260 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:09:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca19dff3-af77-4e46-9892-0c4fb8907d97 x-openstack-request-id: req-ca19dff3-af77-4e46-9892-0c4fb8907d97 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:09:16.917568 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6764484d-2e77-4a0c-9ec1-cdb98af1e385", "name": "network-vif-deleted", "tag": "ead4d4e8-e293-4403-8b0f-df5746455b2f", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:09:16.922549 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ca19dff3-af77-4e46-9892-0c4fb8907d97 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:09:16.922549 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6764484d-2e77-4a0c-9ec1-cdb98af1e385', 'name': 'network-vif-deleted', 'tag': 'ead4d4e8-e293-4403-8b0f-df5746455b2f', 'status': 'completed', 'code': 200} Dec 21 05:09:17.953448 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52338) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:18.305358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:18.559839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 092dd239-3dd4-431b-9665-a3117c083a88 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:09:18.560106 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:18.650055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 092dd239-3dd4-431b-9665-a3117c083a88, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=092dd239-3dd4-431b-9665-a3117c083a88,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:18.650424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:18.662528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 092dd239-3dd4-431b-9665-a3117c083a88 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:09:18.908072 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:18.933225 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=092dd239-3dd4-431b-9665-a3117c083a88,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:19.106446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.318035 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 0fc2541e-6961-4d31-aa7d-70b3fd301601 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:09:19.425777 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:09:19.430710 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5ab58feb-640c-4d71-bcd5-2d965cb1f0de tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/0fc2541e-6961-4d31-aa7d-70b3fd301601/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4761703 Dec 21 05:09:19.433514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52346) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:19.436191 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] Sync routers for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:09:19.448151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:19.448845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:19.485057 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting subnet e8766881-d7e1-4c7e-b0c4-73add5df4bd6 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:09:19.488240 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.527526 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.566472 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:19.615871 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.746013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ead4d4e8-e293-4403-8b0f-df5746455b2f no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:09:19.749088 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.751318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:09:18Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:19.776786 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Subnet': ['ID=e8766881-d7e1-4c7e-b0c4-73add5df4bd6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:19.778810 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.782093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-12585093-b6c4-47d4-8919-f422fa01d663 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/subnets/e8766881-d7e1-4c7e-b0c4-73add5df4bd6 HTTP/1.1" status: 204 len: 168 time: 0.3474417 Dec 21 05:09:19.784735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52348) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:19.791327 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: ead4d4e8-e293-4403-8b0f-df5746455b2f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:09:19.791687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device ead4d4e8-e293-4403-8b0f-df5746455b2f not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:09:19.796100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e0623fc-8df7-4ae4-b21d-0c74ae82408a None None] Network 1c282743-4b36-44de-afe3-6ab389c44276 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:09:19.798561 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] Checking router: 0fc2541e-6961-4d31-aa7d-70b3fd301601 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:09:19.830480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] Routers {'0fc2541e-6961-4d31-aa7d-70b3fd301601'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:19.831003 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:08:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['0fc2541e-6961-4d31-aa7d-70b3fd301601'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:19.897036 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:19.983802 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-38d3ff39-b660-45de-8c53-4ccead687439 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.008021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] Set router 0fc2541e-6961-4d31-aa7d-70b3fd301601 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:20.015771 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.082267 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] DHCP port deletion for 1c282743-4b36-44de-afe3-6ab389c44276 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:09:20.131332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 22492e2a-2bad-42d8-a0f2-643ad0059c18 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:09:20.131332 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.213482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 22492e2a-2bad-42d8-a0f2-643ad0059c18, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=22492e2a-2bad-42d8-a0f2-643ad0059c18,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:20.213879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.227077 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 22492e2a-2bad-42d8-a0f2-643ad0059c18 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:09:20.385125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Deleting port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:09:20.385389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.451317 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.457261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:09:18Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:20.460040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] For port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,segment=NetworkSegment(903fae24-6602-406d-b0f9-53cb7e690b3f),segment_id=903fae24-6602-406d-b0f9-53cb7e690b3f)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:20.461340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.480745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=22492e2a-2bad-42d8-a0f2-643ad0059c18,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:20.497512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd974a55-d99f-4af8-b156-7c1e5efbd7b4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:09:20.503435 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b520d38c-1612-4aa8-bd7d-10453474ae10 None None] The sync data for ids ['0fc2541e-6961-4d31-aa7d-70b3fd301601'] in n-d-822053-11 is: [{'id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'name': 'tempest-TestNetworkAdvancedServerOps-router-828283529', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133'}], 'enable_snat': True}, 'gw_port_id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:09:18Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '22492e2a-2bad-42d8-a0f2-643ad0059c18', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:0b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0fc2541e-6961-4d31-aa7d-70b3fd301601', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4273, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:07:29Z', 'updated_at': '2021-12-21T05:07:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:09:20.507312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Calling delete_port for 6dc5a2b8-b326-4dc1-9575-5f025514cb9e owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:09:20.553519 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.646797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.648878 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.660369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:20.686319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Pushing event deleted for resources: {'Port': ['ID=6dc5a2b8-b326-4dc1-9575-5f025514cb9e,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:20.690691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] No DVR routers for this DVR port 6dc5a2b8-b326-4dc1-9575-5f025514cb9e on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:09:20.697713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.698064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.700703 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.702888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.702888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:20.702888 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f63bbf7-ad25-496b-8b55-15ca60be3e55 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.068794 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.069721 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Fanout notify agent at l3_agent the message router_deleted on router 0fc2541e-6961-4d31-aa7d-70b3fd301601 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:09:21.077777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.078915 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-3c99fa81-c8ba-45bf-88fe-17ecd464d5a3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/routers/0fc2541e-6961-4d31-aa7d-70b3fd301601 HTTP/1.1" status: 204 len: 168 time: 1.2932737 Dec 21 05:09:21.081754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52352) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:21.163595 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.248919 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.268340 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c282743-4b36-44de-afe3-6ab389c44276']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:21.277321 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '903fae24-6602-406d-b0f9-53cb7e690b3f') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:21.277623 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '903fae24-6602-406d-b0f9-53cb7e690b3f') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:21.286658 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.299808 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.305538 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Releasing vlan 142 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:09:21.305925 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:09:21.308875 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:09:21.462167 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.467604 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.479227 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/networks/1c282743-4b36-44de-afe3-6ab389c44276 HTTP/1.1" status: 204 len: 168 time: 0.3881571 Dec 21 05:09:21.479331 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52354) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:21.486690 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb749e6-c8ef-442f-9b70-f044bd4ff740 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Network': ['ID=1c282743-4b36-44de-afe3-6ab389c44276,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:21.542619 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.572522 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.574036 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22492e2a-2bad-42d8-a0f2-643ad0059c18 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:09:21.598104 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 22492e2a-2bad-42d8-a0f2-643ad0059c18 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:09:21.598463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 22492e2a-2bad-42d8-a0f2-643ad0059c18 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:09:21.598905 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6dc5a2b8-b326-4dc1-9575-5f025514cb9e no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:09:21.622639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6dc5a2b8-b326-4dc1-9575-5f025514cb9e {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:09:21.622639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6dc5a2b8-b326-4dc1-9575-5f025514cb9e not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:09:21.622639 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 092dd239-3dd4-431b-9665-a3117c083a88 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:09:21.640221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 092dd239-3dd4-431b-9665-a3117c083a88 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:09:21.640574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 092dd239-3dd4-431b-9665-a3117c083a88 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:09:21.678992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.681669 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:21.682831 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/security-groups/497aecae-1e6d-432c-8c91-4cde7a7c64ce HTTP/1.1" status: 204 len: 168 time: 0.2079079 Dec 21 05:09:21.692591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=497aecae-1e6d-432c-8c91-4cde7a7c64ce,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:21.699876 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.700228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.700577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.700921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.701262 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.701589 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.701925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.702258 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.702592 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.702948 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.703285 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.703616 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:21.703965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-049c61fa-ac74-4f30-8a65-6956d2dc0eda tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:22.083182 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52362) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:22.087784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1233388417', 'description': 'tempest-secgroup-smoke-1233388417 description', 'project_id': '7037c5e415f34eb2b218d59f1243d003'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:22.191480 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.256275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.318806 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.351044 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3692b211-f578-4c45-abd6-9cf58e5cbf76,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:22.423953 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.425239 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-5412397e-f405-43d3-90a2-1ce4cc72c803 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3410382 Dec 21 05:09:22.428222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52364) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:22.432623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '3692b211-f578-4c45-abd6-9cf58e5cbf76', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:22.523869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.577769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.663090 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.680542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3bbde51-b326-4259-bfc8-251bfb6a1cd3,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:22.747612 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f1fe139c-8e69-478b-a95d-f7358b01243d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.784156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.785435 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c68697e1-c7fc-4709-9bec-fc606eac382e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3562553 Dec 21 05:09:22.788207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52366) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:22.792638 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '3692b211-f578-4c45-abd6-9cf58e5cbf76', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:22.872133 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.928019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:22.981963 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.000223 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f250090-d94a-45ce-bbe8-30c05f71ccf9,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:23.058110 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.059363 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-47121258-0e6d-4315-9869-535116c1ed4f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2701883 Dec 21 05:09:23.062578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52368) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:23.067005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '3692b211-f578-4c45-abd6-9cf58e5cbf76', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:23.161464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.216753 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.299714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.315066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5fa0c39-510b-4d62-b32f-93b4a6076a83,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:23.389571 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.390767 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a1176b33-f456-4492-8017-519f753661ad tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3271360 Dec 21 05:09:23.394358 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52370) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:23.398815 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '3692b211-f578-4c45-abd6-9cf58e5cbf76', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:23.506236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.565019 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.650434 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.678917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.696748 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f91d1940-b035-48ae-932f-7ea1d6cf0c41,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:23.764669 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.778159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.779921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-8d5d6997-4301-4d05-ada0-d73c65a8a025 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3845632 Dec 21 05:09:23.782686 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52372) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:23.787010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '3692b211-f578-4c45-abd6-9cf58e5cbf76', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:23.873098 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:09:23.877930 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:23.934644 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.002256 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.020840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=07c9033a-2156-4605-a539-63d5adf736c0,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:24.081173 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.082388 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-23cda14c-0696-43cf-94e5-ea11c1d4961e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2987273 Dec 21 05:09:24.085141 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52374) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:24.089400 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'security_group_rule': {'security_group_id': '3692b211-f578-4c45-abd6-9cf58e5cbf76', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:24.157077 n-d-822053-11 neutron-server[110311]: INFO neutron.db.securitygroups_db [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Project 7037c5e415f34eb2b218d59f1243d003 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:09:24.161878 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.219366 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.290859 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.307650 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bf45b71a-c517-40f7-a282-3e0cebc7886b,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:24.390430 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.394223 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-45fcb598-469a-4441-995d-5ba87078359a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3081479 Dec 21 05:09:24.398201 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52376) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:24.403247 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'network': {'name': 'tempest-network-smoke--878872471', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'port_security_enabled': True}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:24.496029 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:09:24.499992 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.523123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:09:24.531541 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.531885 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Added segment 93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b of type vlan for network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f Dec 21 05:09:24.572941 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.656622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.662456 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:24.663075 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.727925 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Network': ['ID=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:24.739218 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:09:24.759088 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-32abc2de-3657-42bc-b599-0a600fcc9060 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3573153 Dec 21 05:09:24.759465 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52378) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:24.764503 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'admin_state_up': True, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:24.873973 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.874998 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:24.931121 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.131270 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.359552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.392459 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.412975 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.488276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.519123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.103 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/6dc10ebc-63c9-4970-a5ad-748930e89072) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:09:25.618622 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.711729 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.758539 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:09:25.761352 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:25.764668 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:09:25.776304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2810dd60-6b3b-4f1c-b945-79bb2cf3606d None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:09:25.795388 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=6dc10ebc-63c9-4970-a5ad-748930e89072,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:25.809040 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-0025832c-19d5-4313-998a-96189097f0ea None None] Provisioning complete for port 6dc10ebc-63c9-4970-a5ad-748930e89072 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:25.809418 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0025832c-19d5-4313-998a-96189097f0ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.834766 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:25.848197 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-0025832c-19d5-4313-998a-96189097f0ea None None] Port 6dc10ebc-63c9-4970-a5ad-748930e89072 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:09:26.074047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:26.266664 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:26.473653 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 292e0712-f9c6-4569-91c4-010b7036813f is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:09:26.579670 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:09:26.589052 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Sync routers for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:09:26.600180 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:26.603798 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:26.681009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:26.683463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-77e51d9e-c7dc-42a7-a3f2-6946c091c7ae tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.9229465 Dec 21 05:09:26.685942 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52380) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:26.705220 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:26.714633 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ca3f9c00-e160-4fe4-899c-6ef2e0104e3d tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?project_id=7037c5e415f34eb2b218d59f1243d003&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0275791 Dec 21 05:09:26.717357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52382) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:26.807700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a50181fe-f391-44c2-90fa-419c1fd299ca tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:26.811902 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-a50181fe-f391-44c2-90fa-419c1fd299ca tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0908990 Dec 21 05:09:26.811902 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52384) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:26.839236 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-05fe90fd-e271-41b7-915b-31a8e8a8a7ef tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/subnets?network_id=30f5b79f-275c-4003-8999-814f6db142e1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0261054 Dec 21 05:09:26.842272 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52386) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:26.847001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-45129238', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:26.875265 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:09:26.891479 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:25Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:26.918847 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Checking router: 292e0712-f9c6-4569-91c4-010b7036813f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:09:26.919221 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Updating router 292e0712-f9c6-4569-91c4-010b7036813f port 6dc10ebc-63c9-4970-a5ad-748930e89072 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:09:26.943111 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:26.985590 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:09:26.989235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.201707 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.231649 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.282520 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.298121 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Subnet': ['ID=17d18fa4-b9a9-40db-98a9-79b9f4df816d,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:27.306257 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Checking segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:09:27.306625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network hostable DHCP agents. Network: 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:09:27.324380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac74c63d-976d-4017-b6a0-82460e442c16 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:09:27.340357 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Attempting to bind port 6dc10ebc-63c9-4970-a5ad-748930e89072 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:09:27.340732 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Attempting to bind port 6dc10ebc-63c9-4970-a5ad-748930e89072 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:09:27.341103 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Attempting to bind port 6dc10ebc-63c9-4970-a5ad-748930e89072 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:09:27.351847 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:09:27.353026 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:09:27.353428 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.353823 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:09:27.354281 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Bound port: 6dc10ebc-63c9-4970-a5ad-748930e89072, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:09:27.354655 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.358085 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Pushing event updated for resources: {'Port': ['ID=6dc10ebc-63c9-4970-a5ad-748930e89072,revision_number=2']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:27.376678 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a7f6e847-c52d-45ce-8157-affaa942b09c None None] Provisioning complete for port 6dc10ebc-63c9-4970-a5ad-748930e89072 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:27.377049 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a7f6e847-c52d-45ce-8157-affaa942b09c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.381766 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.382121 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.382468 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.382809 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.383179 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.383511 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.383839 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.384169 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.384496 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.384822 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.385145 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.385468 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.385788 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:09:27.387984 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:09:27.412425 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a7f6e847-c52d-45ce-8157-affaa942b09c None None] Port 6dc10ebc-63c9-4970-a5ad-748930e89072 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:09:27.418684 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] For port 6dc10ebc-63c9-4970-a5ad-748930e89072, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:09:27.421674 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] For port 6dc10ebc-63c9-4970-a5ad-748930e89072, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6dc10ebc-63c9-4970-a5ad-748930e89072,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:09:27.490649 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:27.494758 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:27.495562 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.499330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35539fd0-e21d-451b-97bf-7920617e603b None None] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:09:27.502270 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.552529 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:27.553156 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:27.553317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4e5f944-4ea0-4235-865e-5e69e05b87b4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:09:27.593078 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-35f738f8-d599-456d-9bdf-e3aa03de1914 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.7474434 Dec 21 05:09:27.593807 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52388) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:27.598334 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b610b0bf-fa69-4920-ac97-f3b60d42cd90 None None] Pushing event updated for resources: {'Port': ['ID=6dc10ebc-63c9-4970-a5ad-748930e89072,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:27.617242 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:09:27.618536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.652996 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6b308bca-93f7-444c-b656-954d276495c2 None None] Provisioning complete for port 6dc10ebc-63c9-4970-a5ad-748930e89072 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:27.653373 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b308bca-93f7-444c-b656-954d276495c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.683140 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:27.828148 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Allocated IP 172.20.0.2 (42647dd1-7d66-4fbf-bb18-cf7307fe0f9f/17d18fa4-b9a9-40db-98a9-79b9f4df816d/d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:09:27.843107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b308bca-93f7-444c-b656-954d276495c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:27.883544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-6b308bca-93f7-444c-b656-954d276495c2 None None] For port 6dc10ebc-63c9-4970-a5ad-748930e89072, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6dc10ebc-63c9-4970-a5ad-748930e89072,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:27.983066 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:25Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:28.005764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.007737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b308bca-93f7-444c-b656-954d276495c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.011598 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe4dbc7-11d1-4b95-9305-889d4b07ceb5 None None] The sync data for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 is: [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:25Z', 'revision_number': 3, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:09:28.063521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b308bca-93f7-444c-b656-954d276495c2 None None] Pushing event updated for resources: {'Port': ['ID=6dc10ebc-63c9-4970-a5ad-748930e89072,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:28.102412 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.144165 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:09:28.148467 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:28.153109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:09:28.156806 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Pushing event updated for resources: {'Port': ['ID=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:28.221299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Attempting to bind port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:09:28.221299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Attempting to bind port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:09:28.221299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Attempting to bind port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b on network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:09:28.224873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:09:28.225263 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Checking segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:09:28.225676 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.226078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Bound using segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:09:28.226556 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Bound port: d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:09:28.226959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.321378 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] For port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:09:28.324630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] For port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:09:28.352436 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.399680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.465231 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f00302-b07e-4b37-954a-65e9eae32f24 None None] Pushing event updated for resources: {'Port': ['ID=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:28.688294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.1 (42647dd1-7d66-4fbf-bb18-cf7307fe0f9f/17d18fa4-b9a9-40db-98a9-79b9f4df816d/25863508-9dfd-41a8-98d8-066e59a7a267) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:09:28.822487 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.934954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:28.983187 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:09:28.986427 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:28.989458 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:09:29.019613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=25863508-9dfd-41a8-98d8-066e59a7a267,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:29.041310 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.250693 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.431622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1574576b-6e8b-4fbe-849b-83d27c94c9ac None None] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:09:29.520811 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ab1015ff-2323-4f17-ad1f-445d562b1728 None None] Provisioning complete for port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:29.521283 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab1015ff-2323-4f17-ad1f-445d562b1728 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.549805 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:09:29.570219 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.628003 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.703178 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=25863508-9dfd-41a8-98d8-066e59a7a267,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:29.705788 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.733631 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab1015ff-2323-4f17-ad1f-445d562b1728 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.753684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:29.753846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.796758 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ab1015ff-2323-4f17-ad1f-445d562b1728 None None] For port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:29.811106 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:09:29.811528 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:29.855188 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.868180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ab1015ff-2323-4f17-ad1f-445d562b1728 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:29.936188 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 292e0712-f9c6-4569-91c4-010b7036813f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:09:29.960252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110312) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 21 05:09:29.960915 n-d-822053-11 neutron-server[110312]: DEBUG oslo_db.api [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 21 05:09:29.961619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1015ff-2323-4f17-ad1f-445d562b1728 None None] Pushing event updated for resources: {'Port': ['ID=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:29.988918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e7f070d7-d8ea-4ecd-9a9a-fb9aa807cec7 None None] Provisioning complete for port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:29.989376 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e7f070d7-d8ea-4ecd-9a9a-fb9aa807cec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:30.073360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:09:30.089267 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f0a296a6-4c7c-47da-b828-47afe54fe7e9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/292e0712-f9c6-4569-91c4-010b7036813f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4942660 Dec 21 05:09:30.090504 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e7f070d7-d8ea-4ecd-9a9a-fb9aa807cec7 None None] Provisioning complete for port 25863508-9dfd-41a8-98d8-066e59a7a267 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:30.090882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e7f070d7-d8ea-4ecd-9a9a-fb9aa807cec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:30.115914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Sync routers for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:09:30.140298 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:30.140940 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:30.142951 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e7f070d7-d8ea-4ecd-9a9a-fb9aa807cec7 None None] Port 25863508-9dfd-41a8-98d8-066e59a7a267 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:09:30.250753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-867b073f-a117-4767-b796-d76b398c1e19 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1233388417&fields=id&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 267 time: 0.0481031 Dec 21 05:09:30.262757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:30.318389 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-431358e5-7052-46bd-85a1-3be53d9e2d90 None None] Provisioning complete for port 25863508-9dfd-41a8-98d8-066e59a7a267 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:30.318762 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-431358e5-7052-46bd-85a1-3be53d9e2d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:30.370311 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-69a3f804-26dc-4e80-9035-1d75a0fc6d3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:30.372029 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-69a3f804-26dc-4e80-9035-1d75a0fc6d3a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 796 time: 0.1132016 Dec 21 05:09:30.389157 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cd3c521f-6dff-4251-af1b-4cd1ae404aa7 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/quotas/7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 375 time: 0.0100431 Dec 21 05:09:30.426785 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-431358e5-7052-46bd-85a1-3be53d9e2d90 None None] Port 25863508-9dfd-41a8-98d8-066e59a7a267 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:09:30.445657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-7f1505f8-487c-4c81-bbb1-22e6d19da5a9 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0492826 Dec 21 05:09:30.517188 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6dc10ebc-63c9-4970-a5ad-748930e89072 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:09:30.518132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-24be1ea1-f5f4-4921-904b-c36e789aab87 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:09:30.519692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-24be1ea1-f5f4-4921-904b-c36e789aab87 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0622888 Dec 21 05:09:30.568369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-578204ea-5d46-4c5d-a38e-da65704e81ff None None] Provisioning complete for port 25863508-9dfd-41a8-98d8-066e59a7a267 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:30.568737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-578204ea-5d46-4c5d-a38e-da65704e81ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:30.620059 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-0949fea9-d840-4110-b2ac-6fcec057dc03 service neutron] 10.222.0.18 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0942810 Dec 21 05:09:30.713741 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-95ae9bad-fbfb-4109-9e65-4c0117017c76 service neutron] 10.222.0.18 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867660 Dec 21 05:09:30.761928 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 2, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:30.798311 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Checking router: 292e0712-f9c6-4569-91c4-010b7036813f for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:09:30.798671 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Updating router 292e0712-f9c6-4569-91c4-010b7036813f port 25863508-9dfd-41a8-98d8-066e59a7a267 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:09:30.819099 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-578204ea-5d46-4c5d-a38e-da65704e81ff None None] Port 25863508-9dfd-41a8-98d8-066e59a7a267 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:09:30.824594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 6dc10ebc-63c9-4970-a5ad-748930e89072 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:30.824958 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:30.846215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:30.954802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9e59aa6f-28b2-4777-9608-fbee464863b1 req-59288e03-f4a4-4d4a-8b53-994ac11af293 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 210 time: 0.0299969 Dec 21 05:09:31.165008 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.231246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.284249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e337e4d-07d1-4c3b-9cba-6e8f4a1b7147 None None] Pushing event updated for resources: {'Port': ['ID=25863508-9dfd-41a8-98d8-066e59a7a267,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:31.342334 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Attempting to bind port 25863508-9dfd-41a8-98d8-066e59a7a267 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:09:31.342575 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Attempting to bind port 25863508-9dfd-41a8-98d8-066e59a7a267 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:09:31.342817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Attempting to bind port 25863508-9dfd-41a8-98d8-066e59a7a267 on network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:09:31.349884 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:09:31.350260 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Checking segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:09:31.350713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.351219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Bound using segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:09:31.351693 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Bound port: 25863508-9dfd-41a8-98d8-066e59a7a267, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:09:31.352076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.423268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] For port 25863508-9dfd-41a8-98d8-066e59a7a267, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:09:31.426920 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] For port 25863508-9dfd-41a8-98d8-066e59a7a267, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=25863508-9dfd-41a8-98d8-066e59a7a267,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:09:31.439926 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:09:31.492074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:31.492462 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.514824 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.597659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-34a23da5-2947-41c3-967a-31ded4bca995 None None] Provisioning complete for port 25863508-9dfd-41a8-98d8-066e59a7a267 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:31.602918 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34a23da5-2947-41c3-967a-31ded4bca995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.603713 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e337e4d-07d1-4c3b-9cba-6e8f4a1b7147 None None] Pushing event updated for resources: {'Port': ['ID=25863508-9dfd-41a8-98d8-066e59a7a267,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:31.630753 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:31.631418 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:31.808405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:31.847100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34a23da5-2947-41c3-967a-31ded4bca995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:31.953016 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-34a23da5-2947-41c3-967a-31ded4bca995 None None] For port 25863508-9dfd-41a8-98d8-066e59a7a267, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=25863508-9dfd-41a8-98d8-066e59a7a267,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:32.010909 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34a23da5-2947-41c3-967a-31ded4bca995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:32.064509 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-00cd8fdc-47e4-4ed9-bf53-6f54583b4f76 req-9319dd23-5f48-41b3-9322-df53c852bc7d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 210 time: 0.0263128 Dec 21 05:09:32.068984 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a23da5-2947-41c3-967a-31ded4bca995 None None] Pushing event updated for resources: {'Port': ['ID=25863508-9dfd-41a8-98d8-066e59a7a267,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:32.080428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:32.108799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40658cae-fb6e-4478-b51f-3b86c0214264 None None] The sync data for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 is: [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:09:32.131606 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-2d926bfc-b634-47b0-be07-99226111e332 None None] Provisioning complete for port 25863508-9dfd-41a8-98d8-066e59a7a267 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:32.131980 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2d926bfc-b634-47b0-be07-99226111e332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:33.064406 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-1502ebdc-39e0-42ba-a91b-3b1c49387074 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:33.066048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-1502ebdc-39e0-42ba-a91b-3b1c49387074 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 796 time: 0.1984987 Dec 21 05:09:33.153445 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-472b7e06-374e-4e5d-b85b-818e5ebd8521 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7037c5e415f34eb2b218d59f1243d003 HTTP/1.1" status: 200 len: 380 time: 0.0723510 Dec 21 05:09:33.162986 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'port': {'device_id': '48a86438-ca34-45c2-803a-3956404c8351', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'admin_state_up': True, 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'security_groups': ['3692b211-f578-4c45-abd6-9cf58e5cbf76']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:33.181730 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-02853d31-207b-42aa-b988-19e8514d2be1 req-94eb110a-5787-4d6a-9b35-6e59880cf03b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 210 time: 0.0312357 Dec 21 05:09:33.370420 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Made reservation on behalf of 7037c5e415f34eb2b218d59f1243d003 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:09:33.376348 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:33.439046 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25863508-9dfd-41a8-98d8-066e59a7a267 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:09:33.486530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 25863508-9dfd-41a8-98d8-066e59a7a267 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:33.486924 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:33.508291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.20.0.10 (42647dd1-7d66-4fbf-bb18-cf7307fe0f9f/17d18fa4-b9a9-40db-98a9-79b9f4df816d/cb6ab336-54db-4e4c-a1f7-bc013cd3d40d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:09:33.664141 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:33.768740 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:33.812444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:09:33.815373 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:33.818889 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:09:33.825449 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:33.877744 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:33.878389 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:33.983139 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-cc3b28e2-1b7f-42b3-b1ed-034838876a25 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8237092 Dec 21 05:09:34.001664 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Request body: {'port': {'device_id': '48a86438-ca34-45c2-803a-3956404c8351', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:34.058198 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.063204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-40e505fd-dd08-4c99-9dba-cfa5104454b9 None None] Provisioning complete for port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:34.063579 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-40e505fd-dd08-4c99-9dba-cfa5104454b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.098052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-40e505fd-dd08-4c99-9dba-cfa5104454b9 None None] Port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:09:34.312290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23d0fbd-551c-4169-879e-2fb52cfb8edd req-c297e7e9-bd4d-4735-9b91-f4e932da3e2c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:34.317264 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c23d0fbd-551c-4169-879e-2fb52cfb8edd req-c297e7e9-bd4d-4735-9b91-f4e932da3e2c tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 932 time: 0.0621464 Dec 21 05:09:34.348079 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb6ab336-54db-4e4c-a1f7-bc013cd3d40d {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:09:34.356419 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.369262 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Transition to ACTIVE for port object cb6ab336-54db-4e4c-a1f7-bc013cd3d40d will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:09:34.377343 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c23d0fbd-551c-4169-879e-2fb52cfb8edd req-3139f289-e76f-4052-8c88-6fcba40d27bd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541503 Dec 21 05:09:34.442980 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.504334 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Pushing event updated for resources: {'Port': ['ID=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:34.577958 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Attempting to bind port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:09:34.578307 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Attempting to bind port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:09:34.578696 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Attempting to bind port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d on network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:09:34.583774 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d on network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:09:34.584105 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Attempting to bind port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d on network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:09:34.589578 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 9, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:09:34.589926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Checking segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:09:34.590386 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Bound using segment: {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:09:34.590816 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Bound port: cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:09:34.591385 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.672287 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] For port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:09:34.676643 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] For port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:09:34.742513 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.777007 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:34.777908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:34.779383 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] 10.222.0.54 "PUT /v2.0/ports/cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 1093 time: 0.7818389 Dec 21 05:09:34.781823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:09:34.784172 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2215507b-29dd-40d2-a099-2b0306541393" -d '{"events": [{"name": "network-changed", "server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:09:34.820584 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3b8d127-7023-46b4-b632-76ccbfc25dcf service neutron] Pushing event updated for resources: {'Port': ['ID=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:34.888753 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:09:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b107c820-609e-4c8a-8a98-999d7ef1201e x-openstack-request-id: req-b107c820-609e-4c8a-8a98-999d7ef1201e {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:09:34.889059 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:09:34.889323 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b107c820-609e-4c8a-8a98-999d7ef1201e {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:09:34.889740 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'status': 'completed', 'code': 200} Dec 21 05:09:34.959330 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-5660e5d9-4260-4d42-b6c8-13e463f37dc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:34.961440 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-5660e5d9-4260-4d42-b6c8-13e463f37dc6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1096 time: 0.0438559 Dec 21 05:09:35.010812 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-dec99f77-2e01-4793-85af-6b71766020a3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 217 time: 0.0345879 Dec 21 05:09:35.062777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-3b4986af-eeb5-4ab4-bf4d-d9f05fdd8672 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.064259 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-3b4986af-eeb5-4ab4-bf4d-d9f05fdd8672 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 200 len: 833 time: 0.0467653 Dec 21 05:09:35.109242 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-4d58cef7-2534-401b-89c7-53d7ae9d297c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.110704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-4d58cef7-2534-401b-89c7-53d7ae9d297c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0398421 Dec 21 05:09:35.203170 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-5c314619-8632-4e3c-b38b-3ae9b0c3199e service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851583 Dec 21 05:09:35.291572 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-b3ea817e-a0be-4e0a-b51e-97aa19495bec req-c9a0245e-b899-4466-ad05-8843b22647aa service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812252 Dec 21 05:09:35.486279 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2215507b-29dd-40d2-a099-2b0306541393 req-fbaa7722-caa2-4085-a547-4664314d0109 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.487836 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-fbaa7722-caa2-4085-a547-4664314d0109 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1096 time: 0.0465262 Dec 21 05:09:35.502532 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820cac4a-7228-4e5d-901b-44931a4555a9 req-205b0895-3807-444e-8719-e6e793ad2fcb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.504048 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-820cac4a-7228-4e5d-901b-44931a4555a9 req-205b0895-3807-444e-8719-e6e793ad2fcb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 944 time: 0.0535674 Dec 21 05:09:35.552843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-820cac4a-7228-4e5d-901b-44931a4555a9 req-9ae9d1dc-8157-4d6d-88ac-712c52afbd23 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427859 Dec 21 05:09:35.582548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2215507b-29dd-40d2-a099-2b0306541393 req-e2a3396e-30b2-46b7-ac5b-8d66e1672b17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.584095 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-e2a3396e-30b2-46b7-ac5b-8d66e1672b17 service neutron] 10.222.0.54 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 897 time: 0.0891922 Dec 21 05:09:35.630470 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-14a06602-63fd-4fb9-8f61-64397963b0af service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 217 time: 0.0357819 Dec 21 05:09:35.683987 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2215507b-29dd-40d2-a099-2b0306541393 req-e63952c5-c63c-40df-b947-581a32b9a5be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.685452 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-e63952c5-c63c-40df-b947-581a32b9a5be service neutron] 10.222.0.54 "GET /v2.0/subnets?id=17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 200 len: 833 time: 0.0473928 Dec 21 05:09:35.730364 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2215507b-29dd-40d2-a099-2b0306541393 req-5c63b41d-68bd-499d-968d-e1c12246de6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:35.732454 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-5c63b41d-68bd-499d-968d-e1c12246de6f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0387237 Dec 21 05:09:35.825235 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-7feefaea-1a0d-42d1-b635-554532cb659b service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861607 Dec 21 05:09:35.917769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-2215507b-29dd-40d2-a099-2b0306541393 req-94906057-a2ed-4209-b5b6-5892b3b6a94e service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842247 Dec 21 05:09:36.677439 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-748ba597-a047-4f33-8a23-88f43aadc0da req-4d5e7ceb-6061-4581-893b-0b6751ff3ddf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:36.678916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-748ba597-a047-4f33-8a23-88f43aadc0da req-4d5e7ceb-6061-4581-893b-0b6751ff3ddf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 944 time: 0.0526757 Dec 21 05:09:36.728286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-748ba597-a047-4f33-8a23-88f43aadc0da req-de05ccb0-e353-4e4b-935e-40a59bae6827 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433254 Dec 21 05:09:37.843824 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97343026-13a0-413d-a1c2-91f6db90f6b1 req-391440a4-c486-4f7f-826e-ed8589ea93e1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:37.845295 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97343026-13a0-413d-a1c2-91f6db90f6b1 req-391440a4-c486-4f7f-826e-ed8589ea93e1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 944 time: 0.0495503 Dec 21 05:09:37.894639 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-97343026-13a0-413d-a1c2-91f6db90f6b1 req-e27684fa-b0f1-4b24-a85f-de3400ebc2f1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433600 Dec 21 05:09:39.011000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421818d0-ba78-4410-953a-bee3cae5d43f req-77397a2c-1a29-4cc3-aac6-7e7093945c5b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:39.012452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-421818d0-ba78-4410-953a-bee3cae5d43f req-77397a2c-1a29-4cc3-aac6-7e7093945c5b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 944 time: 0.0518942 Dec 21 05:09:39.046135 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cb6ab336-54db-4e4c-a1f7-bc013cd3d40d details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:09:39.063483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-421818d0-ba78-4410-953a-bee3cae5d43f req-602068ce-77c9-44e0-bb0a-d36691e5236f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446074 Dec 21 05:09:39.141252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:39.151972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'port_id': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'mac_address': 'fa:16:3e:8a:3d:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:09:39.187444 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:39.199558 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb6ab336-54db-4e4c-a1f7-bc013cd3d40d {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:09:39.219411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:39.290131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:39.340266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:39.583187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['cb6ab336-54db-4e4c-a1f7-bc013cd3d40d'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:09:40.176859 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a50313-4f10-4a5c-8546-0e064e16e2d7 req-ebf7903e-06d5-4d9e-83eb-4dbf2b061567 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:40.178325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32a50313-4f10-4a5c-8546-0e064e16e2d7 req-ebf7903e-06d5-4d9e-83eb-4dbf2b061567 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 945 time: 0.0481765 Dec 21 05:09:40.226137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-32a50313-4f10-4a5c-8546-0e064e16e2d7 req-9813d014-d326-437a-924d-be6e7babeee4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418706 Dec 21 05:09:41.070399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cb6ab336-54db-4e4c-a1f7-bc013cd3d40d up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:09:41.181755 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:09:41.186495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:09:41.186873 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:41.262195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:41.289302 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:09:41.291564 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3305416d-aa04-45ee-9226-6c1b65dfec77" -d '{"events": [{"server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "name": "network-vif-plugged", "status": "completed", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:09:41.304824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:09:41.337839 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:09:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08af34b2-987b-41c3-8fea-56a05d518ba3 x-openstack-request-id: req-08af34b2-987b-41c3-8fea-56a05d518ba3 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:09:41.338140 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "name": "network-vif-plugged", "status": "completed", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:09:41.338402 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-08af34b2-987b-41c3-8fea-56a05d518ba3 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:09:41.338809 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'code': 200} Dec 21 05:09:41.346774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40ccd91-f0fc-4fb3-8859-526912384ef6 req-5ae49896-d984-4ae2-9d7b-8b7d00344fbf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:41.348300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b40ccd91-f0fc-4fb3-8859-526912384ef6 req-5ae49896-d984-4ae2-9d7b-8b7d00344fbf tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 945 time: 0.0544715 Dec 21 05:09:41.380844 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:41.402552 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b40ccd91-f0fc-4fb3-8859-526912384ef6 req-c6eb0717-238b-4422-af88-a2f92f03a310 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482686 Dec 21 05:09:41.435963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:41.468936 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030bd816-02ce-4ba7-921d-635799c67a6c req-b383daf9-c64a-4049-8930-91de8976ea6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:41.470439 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-030bd816-02ce-4ba7-921d-635799c67a6c req-b383daf9-c64a-4049-8930-91de8976ea6d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1098 time: 0.0407631 Dec 21 05:09:41.515827 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-030bd816-02ce-4ba7-921d-635799c67a6c req-fbd1242a-a8c0-4e54-8c1a-117881385b97 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381827 Dec 21 05:09:42.522706 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b74cd0-e7c3-49c5-b8e9-9059cc246ab8 req-da043b2a-c18e-4d38-bd40-651292813bc3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:42.524232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15b74cd0-e7c3-49c5-b8e9-9059cc246ab8 req-da043b2a-c18e-4d38-bd40-651292813bc3 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0486572 Dec 21 05:09:42.573696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-15b74cd0-e7c3-49c5-b8e9-9059cc246ab8 req-c9b5740f-31eb-450f-97f1-9b233294678a tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426152 Dec 21 05:09:43.687687 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1ffdf1-5c08-4315-bc9b-c548f0e2821b req-3b9f132d-f7c5-4f96-b70f-2fa81e7aff95 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:43.689172 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee1ffdf1-5c08-4315-bc9b-c548f0e2821b req-3b9f132d-f7c5-4f96-b70f-2fa81e7aff95 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0480874 Dec 21 05:09:43.737954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ee1ffdf1-5c08-4315-bc9b-c548f0e2821b req-0ff18b2f-a80c-44fd-a560-f21ca8548eeb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429692 Dec 21 05:09:43.853992 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bf4549-7dab-45c5-b07d-e2c5918f39c2 req-45441164-35cc-47c7-95c3-1c7b69e721eb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:43.855407 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25bf4549-7dab-45c5-b07d-e2c5918f39c2 req-45441164-35cc-47c7-95c3-1c7b69e721eb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0523388 Dec 21 05:09:43.903198 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-25bf4549-7dab-45c5-b07d-e2c5918f39c2 req-597154e4-4aa8-4f87-9b91-bf1168fd3308 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410168 Dec 21 05:09:43.925096 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52450) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:43.962770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7e01859-12b3-4a3a-9291-0619be545647 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:43.964300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b7e01859-12b3-4a3a-9291-0619be545647 tempest-TestNetworkAdvancedServerOps-1547780295 tempest-TestNetworkAdvancedServerOps-1547780295-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1093 time: 0.0382588 Dec 21 05:09:43.967085 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52452) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:43.971874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address': '172.20.0.10'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:09:44.038955 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:44.137772 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:44.235978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Allocated IP 172.25.5.232 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/e6c4496a-1399-44d0-ab48-61c3a8a57344) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:09:44.336879 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:44.425358 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:44.465189 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:09:44.468140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:09:44.470596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:09:44.494560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=e6c4496a-1399-44d0-ab48-61c3a8a57344,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:44.834674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:44.951629 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:45.100055 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:45.156863 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:45.227938 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event updated for resources: {'Port': ['ID=e6c4496a-1399-44d0-ab48-61c3a8a57344,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:09:45.237818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:45.335549 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP 10b3781e-ba2f-4a56-9403-5dea963aa45b associated. External IP: 172.25.5.232, port: cb6ab336-54db-4e4c-a1f7-bc013cd3d40d. Dec 21 05:09:45.539257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 292e0712-f9c6-4569-91c4-010b7036813f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:09:45.645216 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:09:45.655752 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] Sync routers for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:09:45.664995 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:45.665582 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:45.715351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:45.743126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9f119935-ccbb-4a3d-8a35-bfde1f81f099 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.7744279 Dec 21 05:09:45.743814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:09:45.746180 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c7057f4-351d-4d65-8d1e-151d63a27467" -d '{"events": [{"name": "network-changed", "server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:09:45.771837 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:45.783710 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:09:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27cbc91f-8e68-4703-8f24-1f7ded3e89d7 x-openstack-request-id: req-27cbc91f-8e68-4703-8f24-1f7ded3e89d7 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:09:45.784242 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:09:45.784590 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-27cbc91f-8e68-4703-8f24-1f7ded3e89d7 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:09:45.785113 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'status': 'completed', 'code': 200} Dec 21 05:09:45.847198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f4ec4b-2808-42fc-90ac-5bc658f73829 req-f3e8c894-f649-4af8-8783-cbb8a8a04b98 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:45.848999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95f4ec4b-2808-42fc-90ac-5bc658f73829 req-f3e8c894-f649-4af8-8783-cbb8a8a04b98 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0518141 Dec 21 05:09:45.873293 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-33928b9d-799f-404d-b715-d8fa7f0a7fbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:45.874976 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-33928b9d-799f-404d-b715-d8fa7f0a7fbb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1098 time: 0.0467882 Dec 21 05:09:45.903126 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-95f4ec4b-2808-42fc-90ac-5bc658f73829 req-3389df9c-490d-4775-a007-ea225911125b tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467916 Dec 21 05:09:45.926693 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52458) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:45.981005 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-8a792113-73c9-4ab8-a220-dad8b8e91f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:45.982542 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-8a792113-73c9-4ab8-a220-dad8b8e91f39 service neutron] 10.222.0.54 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 897 time: 0.1011975 Dec 21 05:09:45.993753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f5f6be07-31a2-4cdb-af9d-0364cdf0a31d tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/10b3781e-ba2f-4a56-9403-5dea963aa45b HTTP/1.1" status: 200 len: 992 time: 0.0648017 Dec 21 05:09:46.003289 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '10b3781e-ba2f-4a56-9403-5dea963aa45b', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.232', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'port_id': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4298, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'mac_address': 'fa:16:3e:8a:3d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a86438-ca34-45c2-803a-3956404c8351', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:09:44Z', 'updated_at': '2021-12-21T05:09:44Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:46.031893 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] Checking router: 292e0712-f9c6-4569-91c4-010b7036813f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:09:46.039980 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:09:46.040577 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:09:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:46.051851 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-1269c96a-23e4-44cb-9767-fa4b9dde17cc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 1000 time: 0.0625508 Dec 21 05:09:46.102704 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-97ffe51f-2d54-40c0-937d-1fe189140a78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:46.104198 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-97ffe51f-2d54-40c0-937d-1fe189140a78 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 200 len: 833 time: 0.0442851 Dec 21 05:09:46.148059 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:09:46.149469 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-7eb6c2b3-2fdc-40cb-857e-b28859900cc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:09:46.150978 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-7eb6c2b3-2fdc-40cb-857e-b28859900cc4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0398495 Dec 21 05:09:46.243547 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-e40d865d-59da-48bb-9c61-7309b7674d85 service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854986 Dec 21 05:09:46.331810 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3c7057f4-351d-4d65-8d1e-151d63a27467 req-d688da10-9555-443e-b7e4-4914bc448e51 service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810909 Dec 21 05:09:46.364606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '10b3781e-ba2f-4a56-9403-5dea963aa45b', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.232', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'port_id': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4298, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'mac_address': 'fa:16:3e:8a:3d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a86438-ca34-45c2-803a-3956404c8351', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:09:44Z', 'updated_at': '2021-12-21T05:09:44Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:09:46.394046 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afda18c1-7b41-4fc4-9b0f-bc2d7f16bf59 None None] The sync data for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 is: [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': '10b3781e-ba2f-4a56-9403-5dea963aa45b', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'floating_ip_address': '172.25.5.232', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'port_id': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4298, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'mac_address': 'fa:16:3e:8a:3d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48a86438-ca34-45c2-803a-3956404c8351', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:09:44Z', 'updated_at': '2021-12-21T05:09:44Z', 'revision_number': 0, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:09:46.583963 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de1cc647-157d-4dc9-a55b-f02be3942053 None None] New status for floating IP 10b3781e-ba2f-4a56-9403-5dea963aa45b: ACTIVE {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:09:46.996530 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52460) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:09:47.056146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38dd34f9-14fc-467e-af9e-cb029ae1cf72 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/10b3781e-ba2f-4a56-9403-5dea963aa45b HTTP/1.1" status: 200 len: 994 time: 0.0584006 Dec 21 05:09:49.953393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dd36931b-971f-443e-9e9d-3a52eeb6a178 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:52.734409 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c9bf1984-77cd-44ef-8aba-d27152c706bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:53.602447 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:53.747184 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:55.379996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:55.482730 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:09:55.832777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:01.420676 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-f73d6956-44b7-4d05-9b55-5527a5d2bddd service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0436540 Dec 21 05:10:01.772711 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-158e6b44-3db6-445b-acf4-c14753bc7700 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:01.774204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-158e6b44-3db6-445b-acf4-c14753bc7700 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1098 time: 0.2876241 Dec 21 05:10:01.878821 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-dd0def83-801c-4eda-8108-2e068f0e6f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:01.880416 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-dd0def83-801c-4eda-8108-2e068f0e6f39 service neutron] 10.222.0.54 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 897 time: 0.0826499 Dec 21 05:10:01.948985 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-497e32fe-a11b-4fe4-8701-ea6c88e14112 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 1002 time: 0.0595171 Dec 21 05:10:01.998431 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-eae513ea-f199-4219-b204-0c710f0829be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:01.999859 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-eae513ea-f199-4219-b204-0c710f0829be service neutron] 10.222.0.54 "GET /v2.0/subnets?id=17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 200 len: 833 time: 0.0425878 Dec 21 05:10:02.043871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-a2fbb72a-e540-4fe6-9819-ecf75392e7c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:02.045240 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-a2fbb72a-e540-4fe6-9819-ecf75392e7c1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0382771 Dec 21 05:10:02.134780 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-e399552f-1e51-492f-a885-eec971d53949 service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823722 Dec 21 05:10:02.232973 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-cc0f35aa-211c-4b83-9e3e-f6c45b7fa2a6 req-c53efd93-4617-41f4-baaa-170d7b809911 service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904679 Dec 21 05:10:03.874338 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:10:18.653990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b079c4a6-1af5-4f74-b5ba-b3ca17ebe878 req-35f8def0-2509-4342-adb4-8fa7cac0e7d5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:18.655543 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b079c4a6-1af5-4f74-b5ba-b3ca17ebe878 req-35f8def0-2509-4342-adb4-8fa7cac0e7d5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0517290 Dec 21 05:10:18.707820 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b079c4a6-1af5-4f74-b5ba-b3ca17ebe878 req-60f08609-e16b-4ce4-bcc9-3757bd387bfd tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461266 Dec 21 05:10:19.824776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55c700-ada0-4891-b957-a3788bd98308 req-0a04b336-6739-4dc8-b9e8-d79617555677 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:19.826250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac55c700-ada0-4891-b957-a3788bd98308 req-0a04b336-6739-4dc8-b9e8-d79617555677 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0483518 Dec 21 05:10:19.874358 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ac55c700-ada0-4891-b957-a3788bd98308 req-4cb97825-0156-4a0e-8016-565eedce707f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420616 Dec 21 05:10:19.901787 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52480) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:19.946377 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ebe04c7f-c8f7-4932-bc4e-e86d20580827 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:19.961753 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-cd4eb6fa-7a5b-44ed-9e7a-00d576c93909 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/10b3781e-ba2f-4a56-9403-5dea963aa45b HTTP/1.1" status: 200 len: 994 time: 0.0587900 Dec 21 05:10:21.462530 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32caeed2-3164-4767-8858-9042ad7c82fb req-2ec058e1-f68f-4a77-af0a-0a9db4e89a7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:21.464094 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-2ec058e1-f68f-4a77-af0a-0a9db4e89a7f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1098 time: 0.0454376 Dec 21 05:10:21.558912 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32caeed2-3164-4767-8858-9042ad7c82fb req-818ac084-85d7-4408-846d-4ee8ca5c8975 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:21.560317 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-818ac084-85d7-4408-846d-4ee8ca5c8975 service neutron] 10.222.0.54 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 897 time: 0.0894072 Dec 21 05:10:21.633264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-a3a4165b-d6ef-4434-8907-be556349e53e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 1002 time: 0.0655243 Dec 21 05:10:21.671536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9036158d-1aa1-44d1-8a8d-c6450499c2e5 req-72b9f253-e90f-406a-926e-1db49b599606 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:21.673153 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9036158d-1aa1-44d1-8a8d-c6450499c2e5 req-72b9f253-e90f-406a-926e-1db49b599606 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.3666649 Dec 21 05:10:21.685486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32caeed2-3164-4767-8858-9042ad7c82fb req-da151670-b128-41d8-b08e-8f0b3b804c40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:21.687119 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-da151670-b128-41d8-b08e-8f0b3b804c40 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 200 len: 833 time: 0.0455220 Dec 21 05:10:21.723228 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9036158d-1aa1-44d1-8a8d-c6450499c2e5 req-a85ee5c2-b405-44d3-ad04-084b052c6947 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440154 Dec 21 05:10:21.735949 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32caeed2-3164-4767-8858-9042ad7c82fb req-d24fd88f-16a4-433c-97c1-85a9beab32af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:21.739954 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-d24fd88f-16a4-433c-97c1-85a9beab32af service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0458977 Dec 21 05:10:21.834049 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-3d917694-034e-48c1-80d3-81d12c88921a service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859101 Dec 21 05:10:21.927832 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-32caeed2-3164-4767-8858-9042ad7c82fb req-f503904b-750d-4012-b37c-2d6fee96bfe5 service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864964 Dec 21 05:10:22.730406 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a305fad1-a5a0-4f6c-b334-b48b98aa6691 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:22.846791 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f54e37-c211-4378-9b41-cf4a6e82a090 req-207adbc3-76bd-479d-bbb6-30b4903c3d0f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:22.848322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43f54e37-c211-4378-9b41-cf4a6e82a090 req-207adbc3-76bd-479d-bbb6-30b4903c3d0f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0510752 Dec 21 05:10:22.897412 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-43f54e37-c211-4378-9b41-cf4a6e82a090 req-dfc7d275-8346-485d-a18f-634f23b38ee1 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426383 Dec 21 05:10:23.609518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:23.757692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:24.018526 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eedaa12-fb52-4f7b-8b49-a800c216feb2 req-f0f31e89-9e2d-4975-a7c2-83cdec4ecb37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:24.019929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8eedaa12-fb52-4f7b-8b49-a800c216feb2 req-f0f31e89-9e2d-4975-a7c2-83cdec4ecb37 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0522022 Dec 21 05:10:24.067735 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8eedaa12-fb52-4f7b-8b49-a800c216feb2 req-755da2a2-d4e3-4be6-ba2b-607d44e16b1e tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418320 Dec 21 05:10:24.090909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52492) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:24.151306 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a7bf6ea9-1901-4614-9c9b-fe389cb26ecb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/floatingips/10b3781e-ba2f-4a56-9403-5dea963aa45b HTTP/1.1" status: 200 len: 994 time: 0.0592146 Dec 21 05:10:24.426399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52498) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:24.583200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port e6c4496a-1399-44d0-ab48-61c3a8a57344 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:10:24.583545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:24.657768 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:24.658092 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:24.669394 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for e6c4496a-1399-44d0-ab48-61c3a8a57344 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:10:24.872204 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:24.896654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=e6c4496a-1399-44d0-ab48-61c3a8a57344,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:24.907224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.908206 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.908553 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.908890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.909226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.909545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.909876 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.910200 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.910525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.910850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.911243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.911567 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.911884 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:24.969471 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:24.969732 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Floating IP 10b3781e-ba2f-4a56-9403-5dea963aa45b disassociated (deleted). External IP: 172.25.5.232, port: cb6ab336-54db-4e4c-a1f7-bc013cd3d40d. Dec 21 05:10:25.168705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 292e0712-f9c6-4569-91c4-010b7036813f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:10:25.273314 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:10:25.277914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:25.283384 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] Sync routers for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:10:25.300209 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:25.300806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:25.311580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-edfdbb5f-0280-42bd-8145-cc4657af4fed tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/floatingips/10b3781e-ba2f-4a56-9403-5dea963aa45b HTTP/1.1" status: 204 len: 168 time: 0.8815303 Dec 21 05:10:25.311580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:10:25.316855 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-21473630-f6c5-4e9a-9370-054879ef7464" -d '{"events": [{"name": "network-changed", "server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:10:25.375545 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:25.402861 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:10:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3aa6751-310e-4c7d-883b-ab4ffd592eb1 x-openstack-request-id: req-e3aa6751-310e-4c7d-883b-ab4ffd592eb1 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:10:25.403404 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:10:25.403828 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e3aa6751-310e-4c7d-883b-ab4ffd592eb1 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:10:25.404241 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'status': 'completed', 'code': 200} Dec 21 05:10:25.426010 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:25.488678 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21473630-f6c5-4e9a-9370-054879ef7464 req-87dbb8eb-e36e-4e1e-a1d4-a262218c03ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:25.491181 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-87dbb8eb-e36e-4e1e-a1d4-a262218c03ae service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=7037c5e415f34eb2b218d59f1243d003&device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 1098 time: 0.0455079 Dec 21 05:10:25.512331 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:25.587793 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21473630-f6c5-4e9a-9370-054879ef7464 req-a7decab3-329f-48c2-8004-12e4aee49e9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:25.589264 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-a7decab3-329f-48c2-8004-12e4aee49e9b service neutron] 10.222.0.54 "GET /v2.0/networks?id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 200 len: 897 time: 0.0855832 Dec 21 05:10:25.635873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-073da1d9-d683-4416-acca-a2809682ca1d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 200 len: 217 time: 0.0398726 Dec 21 05:10:25.639767 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:25.688335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21473630-f6c5-4e9a-9370-054879ef7464 req-c278bf99-81e0-40d0-ad1c-ab5362582f78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:25.690017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-c278bf99-81e0-40d0-ad1c-ab5362582f78 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 200 len: 833 time: 0.0467963 Dec 21 05:10:25.744745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21473630-f6c5-4e9a-9370-054879ef7464 req-cbf79c77-af2e-49c5-a75c-07711720b22b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:25.746432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-cbf79c77-af2e-49c5-a75c-07711720b22b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0493443 Dec 21 05:10:25.764011 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] Checking router: 292e0712-f9c6-4569-91c4-010b7036813f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:10:25.773329 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:25.773921 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:25.824575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a2c6f54-0275-4c04-9006-f5ca61c7909e req-0094f052-1ddd-468f-af29-c7f12a511cc2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:25.825494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:25.826883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a2c6f54-0275-4c04-9006-f5ca61c7909e req-0094f052-1ddd-468f-af29-c7f12a511cc2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0581918 Dec 21 05:10:25.880327 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:25.880574 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-e933f545-39ef-4672-a91d-48c48d36503a service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944288 Dec 21 05:10:25.883803 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7a2c6f54-0275-4c04-9006-f5ca61c7909e req-8d3207ab-8566-411a-90cc-559976c56709 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475788 Dec 21 05:10:25.975231 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-21473630-f6c5-4e9a-9370-054879ef7464 req-b0ee9cf9-2286-43ab-94a0-98734e77c57d service neutron] 10.222.0.54 "GET /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870879 Dec 21 05:10:26.077454 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:26.106740 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-262b4c07-a207-46b0-9c2c-262850741a13 None None] The sync data for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 is: [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:09:29Z', 'revision_number': 4, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '25863508-9dfd-41a8-98d8-066e59a7a267', 'name': '', 'network_id': '42647dd1-7d66-4fbf-bb18-cf7307fe0f9f', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'mac_address': 'fa:16:3e:77:39:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_interface', 'standard_attr_id': 4295, 'fixed_ips': [{'subnet_id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:28Z', 'updated_at': '2021-12-21T05:09:31Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'subnets': [{'id': '17d18fa4-b9a9-40db-98a9-79b9f4df816d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:10:26.331929 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa1b6a19-fe9f-42c0-a85b-cbd472953263 None None] New status for floating IP 10b3781e-ba2f-4a56-9403-5dea963aa45b: DOWN {{(pid=110312) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:10:27.002987 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b341dd93-fdcd-482c-9d08-10b57ef6652b req-cc1b3b2e-1fbc-4782-b8d2-7a14c23c9e51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:27.004504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b341dd93-fdcd-482c-9d08-10b57ef6652b req-cc1b3b2e-1fbc-4782-b8d2-7a14c23c9e51 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0482996 Dec 21 05:10:27.055605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b341dd93-fdcd-482c-9d08-10b57ef6652b req-535e8780-ddaa-4aa6-ad7b-0ff6cccd5dfb tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/security-groups?id=3692b211-f578-4c45-abd6-9cf58e5cbf76&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448737 Dec 21 05:10:27.506693 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-1e48a05f-bbc7-4eb1-85f8-08426cac44f4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:27.508192 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-1e48a05f-bbc7-4eb1-85f8-08426cac44f4 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 946 time: 0.0543935 Dec 21 05:10:27.596189 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:10:27.596530 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:27.687322 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:27.687688 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:27.700091 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for cb6ab336-54db-4e4c-a1f7-bc013cd3d40d owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:10:27.895235 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:27.925953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=cb6ab336-54db-4e4c-a1f7-bc013cd3d40d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:27.939700 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.940066 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.940421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.940771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.941113 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.941445 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.941782 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.942116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.942450 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.942789 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.943144 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.943476 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.943804 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:27.978345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] No DVR routers for this DVR port cb6ab336-54db-4e4c-a1f7-bc013cd3d40d on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:10:27.987185 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:27.990531 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-c55328f6-11bc-4ad5-a7f2-809efadbd5d2 req-36f2bd04-7001-43d0-9400-aebbb8363e66 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.54 "DELETE /v2.0/ports/cb6ab336-54db-4e4c-a1f7-bc013cd3d40d HTTP/1.1" status: 204 len: 173 time: 0.4755871 Dec 21 05:10:27.991073 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'name': 'network-vif-deleted', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:10:27.993336 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9edda324-4cef-413e-8fdf-60ea555bdb14" -d '{"events": [{"server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "name": "network-vif-deleted", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:10:28.030385 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:10:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78ac6798-5395-48af-ad4e-7194575cd498 x-openstack-request-id: req-78ac6798-5395-48af-ad4e-7194575cd498 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:10:28.030695 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48a86438-ca34-45c2-803a-3956404c8351", "name": "network-vif-deleted", "tag": "cb6ab336-54db-4e4c-a1f7-bc013cd3d40d", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:10:28.030983 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-78ac6798-5395-48af-ad4e-7194575cd498 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:10:28.031404 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48a86438-ca34-45c2-803a-3956404c8351', 'name': 'network-vif-deleted', 'tag': 'cb6ab336-54db-4e4c-a1f7-bc013cd3d40d', 'status': 'completed', 'code': 200} Dec 21 05:10:28.156122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-220dddfc-421f-416d-ab64-5265a38586e1 req-68b9e033-1ec4-40f1-9aec-99ff7ff3c813 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "GET /v2.0/ports?device_id=48a86438-ca34-45c2-803a-3956404c8351 HTTP/1.1" status: 200 len: 210 time: 0.0326469 Dec 21 05:10:29.214320 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52516) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:29.568464 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:29.816637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 25863508-9dfd-41a8-98d8-066e59a7a267 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:10:29.816983 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:29.906894 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 25863508-9dfd-41a8-98d8-066e59a7a267, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=25863508-9dfd-41a8-98d8-066e59a7a267,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:29.907203 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:29.918833 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 25863508-9dfd-41a8-98d8-066e59a7a267 owned by network:router_interface {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:10:30.052760 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-db46c83d-6894-4498-a1be-b1a36e652e9f req-6a52b9d2-505d-4c17-872a-e6b9d4675ca9 service neutron] (110311) timed out ('10.222.0.18', 47994) {{(pid=110311) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 05:10:30.186648 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:30.211160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=25863508-9dfd-41a8-98d8-066e59a7a267,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:30.386713 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:30.596626 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Router 292e0712-f9c6-4569-91c4-010b7036813f has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:10:30.703802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:10:30.709349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-ead4c116-182d-4078-9b04-17251668e7ff tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "PUT /v2.0/routers/292e0712-f9c6-4569-91c4-010b7036813f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4939549 Dec 21 05:10:30.712160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52518) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:30.771542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting subnet 17d18fa4-b9a9-40db-98a9-79b9f4df816d {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:10:30.775315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:30.817503 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:30.839820 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] Sync routers for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:10:30.850088 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:30.850621 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:30.900275 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:30.952346 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:31.038102 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.066549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Subnet': ['ID=17d18fa4-b9a9-40db-98a9-79b9f4df816d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:31.070370 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.073600 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-08ad4da6-5fff-4cf7-b0e6-8c9e144d137f tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/subnets/17d18fa4-b9a9-40db-98a9-79b9f4df816d HTTP/1.1" status: 204 len: 168 time: 0.3604784 Dec 21 05:10:31.076234 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52520) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:31.082544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d1478a4-8017-46f6-9adb-45b078059499 None None] Network 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:10:31.127219 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:10:30Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:31.157308 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] Checking router: 292e0712-f9c6-4569-91c4-010b7036813f for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:10:31.165915 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] Routers {'292e0712-f9c6-4569-91c4-010b7036813f'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:31.166528 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['292e0712-f9c6-4569-91c4-010b7036813f'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:31.231708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] DHCP port deletion for 42647dd1-7d66-4fbf-bb18-cf7307fe0f9f request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:31.281997 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Deleting port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:10:31.282419 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.286606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] Set router 292e0712-f9c6-4569-91c4-010b7036813f gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:31.339444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cb6ab336-54db-4e4c-a1f7-bc013cd3d40d no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:10:31.370924 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: cb6ab336-54db-4e4c-a1f7-bc013cd3d40d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:10:31.371299 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device cb6ab336-54db-4e4c-a1f7-bc013cd3d40d not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:10:31.378651 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] For port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,segment=NetworkSegment(93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b),segment_id=93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:31.379037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.391460 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Calling delete_port for d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:10:31.467047 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.497350 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:10:30Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:31.520645 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59cecd33-65ec-4b27-b2c2-98e33ca849a6 None None] The sync data for ids ['292e0712-f9c6-4569-91c4-010b7036813f'] in n-d-822053-11 is: [{'id': '292e0712-f9c6-4569-91c4-010b7036813f', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1806712399', 'tenant_id': '7037c5e415f34eb2b218d59f1243d003', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103'}], 'enable_snat': True}, 'gw_port_id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:09:24Z', 'updated_at': '2021-12-21T05:10:30Z', 'revision_number': 5, 'project_id': '7037c5e415f34eb2b218d59f1243d003', 'gw_port': {'id': '6dc10ebc-63c9-4970-a5ad-748930e89072', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:ae:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292e0712-f9c6-4569-91c4-010b7036813f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4292, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:09:25Z', 'updated_at': '2021-12-21T05:09:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:10:31.553850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:10:31.581049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.582666 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.616304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Pushing event deleted for resources: {'Port': ['ID=d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:31.620455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] No DVR routers for this DVR port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:10:31.635304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.635658 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.636004 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.636344 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.636687 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.637123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.637464 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.637796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.638125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.638453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.638782 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.639134 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.639462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef690c1a-2ae8-4f46-a40e-3c17de0dc5bd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:31.648038 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No active binding found for port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b {{(pid=110312) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 21 05:10:31.648449 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] The host n-d-822053-11 is not matching for port d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b host None! {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2286}} Dec 21 05:10:31.648830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d01a23fd-d4b6-4b59-a5b6-0b8c43d5660b not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:10:31.745516 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Deleting port 6dc10ebc-63c9-4970-a5ad-748930e89072 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:10:31.745851 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.821946 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] For port 6dc10ebc-63c9-4970-a5ad-748930e89072, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=6dc10ebc-63c9-4970-a5ad-748930e89072,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:31.822227 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:31.834139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Calling delete_port for 6dc10ebc-63c9-4970-a5ad-748930e89072 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:10:32.066180 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.094556 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Port': ['ID=6dc10ebc-63c9-4970-a5ad-748930e89072,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:32.111252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90d9c4b3-a22f-4a05-a0c2-cf8aa4bdf6d4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:32.158154 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.259006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.261118 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.409466 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.409921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Fanout notify agent at l3_agent the message router_deleted on router 292e0712-f9c6-4569-91c4-010b7036813f {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:10:32.419727 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.419727 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f3ada4ce-ba1a-4628-b579-440d4fd154f2 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/routers/292e0712-f9c6-4569-91c4-010b7036813f HTTP/1.1" status: 204 len: 168 time: 1.3408928 Dec 21 05:10:32.420912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52522) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:32.499187 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.590712 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.612347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42647dd1-7d66-4fbf-bb18-cf7307fe0f9f']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:32.621946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:32.622252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '93d0774c-d0d1-482e-bb9c-bd9e4ec4d10b') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:32.631767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.644866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.650732 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:10:32.651174 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:10:32.654202 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:10:32.763475 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.775403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.778792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/networks/42647dd1-7d66-4fbf-bb18-cf7307fe0f9f HTTP/1.1" status: 204 len: 168 time: 0.3568408 Dec 21 05:10:32.781720 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52524) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:32.788569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-585fe8a0-0038-4a0b-aba8-a2bd4b9ac7a5 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'Network': ['ID=42647dd1-7d66-4fbf-bb18-cf7307fe0f9f,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:32.841654 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf6e659f-8036-4602-be6a-936d99666923 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.868930 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf6e659f-8036-4602-be6a-936d99666923 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.992181 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf6e659f-8036-4602-be6a-936d99666923 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.994736 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-cf6e659f-8036-4602-be6a-936d99666923 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:32.995930 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-cf6e659f-8036-4602-be6a-936d99666923 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] 10.222.0.18 "DELETE /v2.0/security-groups/3692b211-f578-4c45-abd6-9cf58e5cbf76 HTTP/1.1" status: 204 len: 168 time: 0.2123952 Dec 21 05:10:33.005514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6e659f-8036-4602-be6a-936d99666923 tempest-TestNetworkAdvancedServerOps-787896189 tempest-TestNetworkAdvancedServerOps-787896189-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3692b211-f578-4c45-abd6-9cf58e5cbf76,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:33.448726 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6dc10ebc-63c9-4970-a5ad-748930e89072 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:10:33.468420 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 6dc10ebc-63c9-4970-a5ad-748930e89072 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:10:33.468777 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 6dc10ebc-63c9-4970-a5ad-748930e89072 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:10:33.469200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25863508-9dfd-41a8-98d8-066e59a7a267 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:10:33.492187 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 25863508-9dfd-41a8-98d8-066e59a7a267 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:10:33.492549 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 25863508-9dfd-41a8-98d8-066e59a7a267 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:10:33.594498 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52532) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:33.730463 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9692e205-fc53-4f41-b322-bb4fc230d6a2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=7037c5e415f34eb2b218d59f1243d003&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1342762 Dec 21 05:10:33.732923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52536) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:33.789996 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e575bef1-e338-4cf5-a44f-b04af4606583 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:33.811020 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e575bef1-e338-4cf5-a44f-b04af4606583 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:33.928943 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e575bef1-e338-4cf5-a44f-b04af4606583 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:33.931593 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e575bef1-e338-4cf5-a44f-b04af4606583 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:33.932749 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e575bef1-e338-4cf5-a44f-b04af4606583 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/d5566c4b-fac5-4b4f-a5a1-a08f2fd39b77 HTTP/1.1" status: 204 len: 168 time: 0.1989396 Dec 21 05:10:33.941218 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e575bef1-e338-4cf5-a44f-b04af4606583 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5566c4b-fac5-4b4f-a5a1-a08f2fd39b77,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:34.575479 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:34.590105 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c52b35d9-5c7d-4993-b841-7359b3ec87ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.674869 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c52b35d9-5c7d-4993-b841-7359b3ec87ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.729351 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c52b35d9-5c7d-4993-b841-7359b3ec87ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.768850 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c52b35d9-5c7d-4993-b841-7359b3ec87ef admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b5b4720f0e7f4388a052a583305908d2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1921756 Dec 21 05:10:34.769729 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52b35d9-5c7d-4993-b841-7359b3ec87ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6f515f1-3fec-4c0e-8032-21c0addb053e,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:34.771578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52544) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:34.824223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1eb2a1a-4766-4a02-96b3-c85ff81128bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.845620 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1eb2a1a-4766-4a02-96b3-c85ff81128bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.957797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1eb2a1a-4766-4a02-96b3-c85ff81128bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.960467 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-e1eb2a1a-4766-4a02-96b3-c85ff81128bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:34.961683 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e1eb2a1a-4766-4a02-96b3-c85ff81128bf admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/a6f515f1-3fec-4c0e-8032-21c0addb053e HTTP/1.1" status: 204 len: 168 time: 0.1885889 Dec 21 05:10:34.969329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1eb2a1a-4766-4a02-96b3-c85ff81128bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6f515f1-3fec-4c0e-8032-21c0addb053e,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:35.996757 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52566) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:36.090742 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-502757730-network', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:36.174676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Made reservation on behalf of 449c18c6acb14eab9ae3cbb2fa4f9b75 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:10:36.177031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.185491 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.256212 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.323259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.347484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:10:36.356858 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf752882-3e55-4013-abdd-8f5804ba7ba1,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:36.362331 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.362685 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Added segment c28886ab-df75-4037-9026-f1cc95da771c of type vlan for network 645a6cd1-6742-4469-afd8-b9c3665fe576 Dec 21 05:10:36.400306 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.493593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.494578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:36.495188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.556602 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] Pushing event updated for resources: {'Network': ['ID=645a6cd1-6742-4469-afd8-b9c3665fe576,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:36.566136 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:10:36.611638 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b3482e25-77d6-468e-a3c5-024dfe195692 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6136351 Dec 21 05:10:36.614591 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52570) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:36.619947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Request body: {'subnet': {'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-502757730-subnet', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'ip_version': 4}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:36.716736 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Made reservation on behalf of 449c18c6acb14eab9ae3cbb2fa4f9b75 for: {'subnet': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:10:36.719278 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529064675'] for subnet, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:36.956891 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529006784', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529064689'] for subnet, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.021180 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Pushing event updated for resources: {'Subnet': ['ID=65e74147-5f7e-4b8c-956b-aec144967429,revision_number=0']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:37.025757 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Checking segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:37.026128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Network hostable DHCP agents. Network: 645a6cd1-6742-4469-afd8-b9c3665fe576, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110311) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:10:37.099549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110311) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:10:37.179495 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 645a6cd1-6742-4469-afd8-b9c3665fe576) {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:37.183573 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:37.185027 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.189690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27be9dda-0664-4923-8ff3-60c77c7c31bf None None] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:10:37.270204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-645405aa-4780-49be-9d7e-5b634d23785b admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6540494 Dec 21 05:10:37.272692 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52572) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:37.276980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:37.289172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-645a6cd1-6742-4469-afd8-b9c3665fe576', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:10:37.290041 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.357983 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.359347 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.424984 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.432114 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Allocated IP 172.20.0.2 (645a6cd1-6742-4469-afd8-b9c3665fe576/65e74147-5f7e-4b8c-956b-aec144967429/b1ecb840-5245-4faa-8f1f-70019b110295) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:37.571000 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.623997 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.655163 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.704333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:37.707220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:37.710632 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:37.717804 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Pushing event updated for resources: {'Port': ['ID=b1ecb840-5245-4faa-8f1f-70019b110295,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:37.767955 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Attempting to bind port b1ecb840-5245-4faa-8f1f-70019b110295 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:37.768643 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Attempting to bind port b1ecb840-5245-4faa-8f1f-70019b110295 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:37.769030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Attempting to bind port b1ecb840-5245-4faa-8f1f-70019b110295 on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:37.773912 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:37.774318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Checking segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:37.774720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.775146 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Bound using segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:37.775619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Bound port: b1ecb840-5245-4faa-8f1f-70019b110295, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:37.775996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.842116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] For port b1ecb840-5245-4faa-8f1f-70019b110295, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:37.845056 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] For port b1ecb840-5245-4faa-8f1f-70019b110295, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b1ecb840-5245-4faa-8f1f-70019b110295,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:37.889761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.901197 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.919786 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:37.953133 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4042ebcc-53f6-4350-8b1c-39ac6616a45e None None] Pushing event updated for resources: {'Port': ['ID=b1ecb840-5245-4faa-8f1f-70019b110295,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:38.041343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Allocated IP 172.25.5.195 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/586dffac-02e1-40bc-8a0e-dee67f8086a7) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:38.171302 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:38.260159 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:38.303284 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:38.306256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:38.309856 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:38.320446 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49ba7d38-6ac5-4f2a-a7fc-0adb86ce073f None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:38.333274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Pushing event updated for resources: {'Port': ['ID=586dffac-02e1-40bc-8a0e-dee67f8086a7,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:38.366450 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5996b353-17f3-4c03-94da-ee5a477f5927 None None] Provisioning complete for port 586dffac-02e1-40bc-8a0e-dee67f8086a7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:38.366450 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5996b353-17f3-4c03-94da-ee5a477f5927 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:38.396078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5996b353-17f3-4c03-94da-ee5a477f5927 None None] Port 586dffac-02e1-40bc-8a0e-dee67f8086a7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:38.655613 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:38.865676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:38.893030 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fabbce9d-02dc-4bf7-a24d-8930d27889fb None None] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:10:38.963968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-af2fb527-aa3d-4b7a-a1b5-d919ff47047a None None] Provisioning complete for port b1ecb840-5245-4faa-8f1f-70019b110295 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:38.964345 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af2fb527-aa3d-4b7a-a1b5-d919ff47047a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.079306 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110311) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:10:39.083842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af2fb527-aa3d-4b7a-a1b5-d919ff47047a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.122342 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-af2fb527-aa3d-4b7a-a1b5-d919ff47047a None None] For port b1ecb840-5245-4faa-8f1f-70019b110295, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b1ecb840-5245-4faa-8f1f-70019b110295,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:39.180902 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af2fb527-aa3d-4b7a-a1b5-d919ff47047a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.198599 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:10:39.216867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:10:39.241737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:39.242376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:39.245227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2fb527-aa3d-4b7a-a1b5-d919ff47047a None None] Pushing event updated for resources: {'Port': ['ID=b1ecb840-5245-4faa-8f1f-70019b110295,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:39.272642 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.274733 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-337aca62-fda0-4bc1-8c3f-113d7bdd9fdb admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.0008366 Dec 21 05:10:39.277250 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52574) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:39.343564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-583e3c14-a706-49bf-99f9-442242dd88e7 None None] Provisioning complete for port b1ecb840-5245-4faa-8f1f-70019b110295 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:39.343940 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-583e3c14-a706-49bf-99f9-442242dd88e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.386818 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:39.506594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b1ecb840-5245-4faa-8f1f-70019b110295 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:39.640293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b1ecb840-5245-4faa-8f1f-70019b110295 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:39.640583 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.690595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:38Z', 'revision_number': 3, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:39.721105 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:10:39.721462 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Updating router 3f1b1a41-109f-4ec6-a12e-6653fe62790a port 586dffac-02e1-40bc-8a0e-dee67f8086a7 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:10:39.768153 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:39.958797 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.021566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.094808 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.145018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78e7f0c4-f1b3-48ff-9050-cd1ca2f8c0ba None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:40.156495 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f357a06e-086b-45d0-ba46-44381039aa4e None None] Pushing event updated for resources: {'Port': ['ID=586dffac-02e1-40bc-8a0e-dee67f8086a7,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:40.159455 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Allocated IP 172.20.0.1 (645a6cd1-6742-4469-afd8-b9c3665fe576/65e74147-5f7e-4b8c-956b-aec144967429/29a51ce0-49b9-46d0-ba67-ac7c76850f34) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:40.161828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Attempting to bind port 586dffac-02e1-40bc-8a0e-dee67f8086a7 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:40.162206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Attempting to bind port 586dffac-02e1-40bc-8a0e-dee67f8086a7 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:40.162570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Attempting to bind port 586dffac-02e1-40bc-8a0e-dee67f8086a7 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:40.168402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:40.177176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:40.177176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.177176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:40.177176 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Bound port: 586dffac-02e1-40bc-8a0e-dee67f8086a7, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:40.177176 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.227434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] For port 586dffac-02e1-40bc-8a0e-dee67f8086a7, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:40.240261 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] For port 586dffac-02e1-40bc-8a0e-dee67f8086a7, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=586dffac-02e1-40bc-8a0e-dee67f8086a7,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:40.244597 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-82e407c6-c720-4117-b234-a9825021becb None None] Provisioning complete for port 586dffac-02e1-40bc-8a0e-dee67f8086a7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:40.245984 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-82e407c6-c720-4117-b234-a9825021becb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.266520 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.282280 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-82e407c6-c720-4117-b234-a9825021becb None None] Port 586dffac-02e1-40bc-8a0e-dee67f8086a7 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:40.322548 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.366365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-552dbb82-47c5-45d0-906d-b988a48fb1ce None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:40.379995 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.389051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:40.389663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:40.397715 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f357a06e-086b-45d0-ba46-44381039aa4e None None] Pushing event updated for resources: {'Port': ['ID=586dffac-02e1-40bc-8a0e-dee67f8086a7,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:40.422532 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:40.426028 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:40.429529 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:40.453719 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Pushing event updated for resources: {'Port': ['ID=29a51ce0-49b9-46d0-ba67-ac7c76850f34,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:40.471380 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.517098 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:40.519717 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a2c1c50b-a60f-4eaa-87b9-00dee3c13b7d None None] Provisioning complete for port 586dffac-02e1-40bc-8a0e-dee67f8086a7 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:40.519879 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2c1c50b-a60f-4eaa-87b9-00dee3c13b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.652675 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.738203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2c1c50b-a60f-4eaa-87b9-00dee3c13b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.764974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a2c1c50b-a60f-4eaa-87b9-00dee3c13b7d None None] For port 586dffac-02e1-40bc-8a0e-dee67f8086a7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=586dffac-02e1-40bc-8a0e-dee67f8086a7,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:40.780958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:38Z', 'revision_number': 3, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:40.808616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e78e2725-7ca4-48ce-a066-c688674498de None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:38Z', 'revision_number': 3, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:10:40.822754 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.827028 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2c1c50b-a60f-4eaa-87b9-00dee3c13b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.873618 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:10:40.880691 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c1c50b-a60f-4eaa-87b9-00dee3c13b7d None None] Pushing event updated for resources: {'Port': ['ID=586dffac-02e1-40bc-8a0e-dee67f8086a7,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:40.883821 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.949998 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-5c7c8bee-e357-48a1-9812-ad4a48de6eb8 None None] Provisioning complete for port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:40.950365 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5c7c8bee-e357-48a1-9812-ad4a48de6eb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.955560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:40.957497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Pushing event updated for resources: {'Port': ['ID=29a51ce0-49b9-46d0-ba67-ac7c76850f34,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:41.077325 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:41.078772 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:41.195860 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-5c7c8bee-e357-48a1-9812-ad4a48de6eb8 None None] Port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:41.215078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:10:41.341139 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:10:41.347704 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-9906bca5-477f-482e-8948-880db72563d3 admin admin] 10.222.0.18 "PUT /v2.0/routers/3f1b1a41-109f-4ec6-a12e-6653fe62790a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0690534 Dec 21 05:10:41.420333 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ccde7762-a30b-4688-9f4e-6ab484d7a4b6 None None] Provisioning complete for port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:41.423011 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ccde7762-a30b-4688-9f4e-6ab484d7a4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:41.482166 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ccde7762-a30b-4688-9f4e-6ab484d7a4b6 None None] Port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:41.512551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 586dffac-02e1-40bc-8a0e-dee67f8086a7 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:41.565771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 586dffac-02e1-40bc-8a0e-dee67f8086a7 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:41.566144 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.050259 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52590) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:42.055274 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-136682029-network', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:42.117241 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Made reservation on behalf of 91cbbaa4ae4745df999125b302081ed4 for: {'network': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:10:42.119599 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.129273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks [] for security_group, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.206356 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.243590 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.269490 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=110311) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:10:42.279451 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be34e5c4-4b22-42c0-9d04-00c376ec7e36,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:42.284897 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.285247 n-d-822053-11 neutron-server[110311]: INFO neutron.db.segments_db [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Added segment ca1b71b2-6f11-4807-a847-6e1b04ec9c39 of type vlan for network 79f795c6-4f78-4a77-bf67-1d759df61db6 Dec 21 05:10:42.325929 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.402646 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.403874 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:42.404523 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.474639 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:10:42.485099 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:42.485736 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:42.497849 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] Pushing event updated for resources: {'Network': ['ID=79f795c6-4f78-4a77-bf67-1d759df61db6,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:42.508367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:10:42.522415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52594) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:42.523075 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-e25b9cdc-aea5-4931-bf1d-ddae8aa767ce admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4711740 Dec 21 05:10:42.532105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Request body: {'subnet': {'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-136682029-subnet', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:42.615560 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Made reservation on behalf of 91cbbaa4ae4745df999125b302081ed4 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:10:42.618975 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.705989 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:42.860980 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.901261 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 2, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:42.915784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Pushing event updated for resources: {'Subnet': ['ID=14f97133-ef5a-4adb-8e05-a6ec84399e14,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:42.927803 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:10:42.928165 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Updating router 3f1b1a41-109f-4ec6-a12e-6653fe62790a port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:10:42.928430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Checking segment: {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:42.928803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Network hostable DHCP agents. Network: 79f795c6-4f78-4a77-bf67-1d759df61db6, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:10:42.952390 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:42.997662 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:10:43.076335 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 79f795c6-4f78-4a77-bf67-1d759df61db6) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:43.080686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:43.082175 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.085172 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b1b03de-4bae-4d61-803d-9bc6933ee243 None None] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:10:43.183251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-be9ce8fa-f8e6-4ad8-bb34-39b766c19939 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6584091 Dec 21 05:10:43.183679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-79f795c6-4f78-4a77-bf67-1d759df61db6', 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'fixed_ips': [{'subnet_id': '14f97133-ef5a-4adb-8e05-a6ec84399e14'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:10:43.185160 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.185745 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52596) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:43.190410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:43.224678 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.272407 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.273572 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.300580 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.324125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Allocated IP 172.20.0.2 (79f795c6-4f78-4a77-bf67-1d759df61db6/14f97133-ef5a-4adb-8e05-a6ec84399e14/12f58b38-55df-4fb2-a086-81f69d8d539c) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:43.332962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.369878 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Pushing event updated for resources: {'Port': ['ID=29a51ce0-49b9-46d0-ba67-ac7c76850f34,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:43.408100 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.408449 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.408792 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.409110 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.409460 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.416000 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.416697 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.417208 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.417703 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.418264 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.418755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.419279 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.419764 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:10:43.428605 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Attempting to bind port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:43.429319 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Attempting to bind port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:43.429862 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Attempting to bind port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:43.439399 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:43.439399 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Checking segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:43.439399 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.439399 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Bound using segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:43.439399 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Bound port: 29a51ce0-49b9-46d0-ba67-ac7c76850f34, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:43.439399 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.495457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.512068 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] For port 29a51ce0-49b9-46d0-ba67-ac7c76850f34, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:43.515489 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] For port 29a51ce0-49b9-46d0-ba67-ac7c76850f34, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29a51ce0-49b9-46d0-ba67-ac7c76850f34,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:43.557050 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.577389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.585344 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.598340 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:43.604324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:43.612538 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:43.617799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Pushing event updated for resources: {'Port': ['ID=12f58b38-55df-4fb2-a086-81f69d8d539c,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:43.642622 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:43.643273 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:43.657186 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a2208fe3-45c5-4487-a626-db9f5b4792f3 None None] Provisioning complete for port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:43.658075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2208fe3-45c5-4487-a626-db9f5b4792f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.713478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Attempting to bind port 12f58b38-55df-4fb2-a086-81f69d8d539c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:43.713771 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Attempting to bind port 12f58b38-55df-4fb2-a086-81f69d8d539c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:43.714139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Attempting to bind port 12f58b38-55df-4fb2-a086-81f69d8d539c on network 79f795c6-4f78-4a77-bf67-1d759df61db6 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:43.721416 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:43.721796 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Checking segment: {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:43.722210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.722610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Bound using segment: {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:43.723162 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Bound port: 12f58b38-55df-4fb2-a086-81f69d8d539c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:43.723544 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.742140 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c22d22-0112-4fd2-bd5c-e8a501f79ba5 None None] Pushing event updated for resources: {'Port': ['ID=29a51ce0-49b9-46d0-ba67-ac7c76850f34,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:43.770377 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:43.827956 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] For port 12f58b38-55df-4fb2-a086-81f69d8d539c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:43.832675 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] For port 12f58b38-55df-4fb2-a086-81f69d8d539c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12f58b38-55df-4fb2-a086-81f69d8d539c,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:43.837065 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2208fe3-45c5-4487-a626-db9f5b4792f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.868376 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.880690 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-a2208fe3-45c5-4487-a626-db9f5b4792f3 None None] For port 29a51ce0-49b9-46d0-ba67-ac7c76850f34, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29a51ce0-49b9-46d0-ba67-ac7c76850f34,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:43.888335 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.915385 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.951326 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2208fe3-45c5-4487-a626-db9f5b4792f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:43.982604 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7f41ad-36f5-4c64-99e0-41abbda64718 None None] Pushing event updated for resources: {'Port': ['ID=12f58b38-55df-4fb2-a086-81f69d8d539c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:43.986629 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:44.013785 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Allocated IP 172.25.5.166 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:44.019948 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe74c28a-c166-4512-b111-c535a4478d1c None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:10:44.084922 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2208fe3-45c5-4487-a626-db9f5b4792f3 None None] Pushing event updated for resources: {'Port': ['ID=29a51ce0-49b9-46d0-ba67-ac7c76850f34,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:44.109840 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-265649bd-fe6b-449c-ab6d-25c068e91f2f None None] Provisioning complete for port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:44.110242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-265649bd-fe6b-449c-ab6d-25c068e91f2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:44.172545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:44.272985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:44.323456 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:44.326911 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:44.331697 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:44.336162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Pushing event updated for resources: {'Port': ['ID=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:44.347701 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93edd1ea-5129-40fd-b8a1-a5d0817a1023 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:44.468110 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6fa3656b-565e-4ce0-aa89-1fe04da38f97 None None] Provisioning complete for port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:44.468571 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6fa3656b-565e-4ce0-aa89-1fe04da38f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:44.503469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6fa3656b-565e-4ce0-aa89-1fe04da38f97 None None] Port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:44.683876 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:44.903981 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.082992 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc29e95b-3e24-43c6-b00d-bc1ba32ae862 None None] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:10:45.106300 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Router 30c9ab26-4ac0-46d3-904b-64a8314b242a is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:10:45.166910 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-73dde001-6071-4c24-b03f-eb14932c1257 None None] Provisioning complete for port 12f58b38-55df-4fb2-a086-81f69d8d539c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:45.167307 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-73dde001-6071-4c24-b03f-eb14932c1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.223575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:10:45.236708 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Sync routers for ids ['30c9ab26-4ac0-46d3-904b-64a8314b242a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:10:45.277845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Routers {'30c9ab26-4ac0-46d3-904b-64a8314b242a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:45.278657 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['30c9ab26-4ac0-46d3-904b-64a8314b242a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:45.299152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.303471 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 52598) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:45.307798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-61f19d42-7714-4901-ab34-988003d90a4d admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.1208391 Dec 21 05:10:45.330226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-73dde001-6071-4c24-b03f-eb14932c1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.413067 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-73dde001-6071-4c24-b03f-eb14932c1257 None None] For port 12f58b38-55df-4fb2-a086-81f69d8d539c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12f58b38-55df-4fb2-a086-81f69d8d539c,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:45.428497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Set router 30c9ab26-4ac0-46d3-904b-64a8314b242a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:45.492451 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-73dde001-6071-4c24-b03f-eb14932c1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.568718 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29a51ce0-49b9-46d0-ba67-ac7c76850f34 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:45.633149 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73dde001-6071-4c24-b03f-eb14932c1257 None None] Pushing event updated for resources: {'Port': ['ID=12f58b38-55df-4fb2-a086-81f69d8d539c,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:45.664271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-4e7bb0d5-f1e1-406e-ade8-b987404570b8 None None] Provisioning complete for port 12f58b38-55df-4fb2-a086-81f69d8d539c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:45.664646 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e7bb0d5-f1e1-406e-ade8-b987404570b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.729991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:45.730374 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.796566 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.819930 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:44Z', 'revision_number': 3, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:45.853610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Checking router: 30c9ab26-4ac0-46d3-904b-64a8314b242a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:10:45.853972 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Updating router 30c9ab26-4ac0-46d3-904b-64a8314b242a port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:10:45.901094 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:45.925476 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12f58b38-55df-4fb2-a086-81f69d8d539c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:45.954705 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Allocated IP 172.20.0.1 (79f795c6-4f78-4a77-bf67-1d759df61db6/14f97133-ef5a-4adb-8e05-a6ec84399e14/c0ddd3e1-97d0-4ba0-8ec8-3a184319131d) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:46.056842 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.057080 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 12f58b38-55df-4fb2-a086-81f69d8d539c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:46.057286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.175449 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.215022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:46.217909 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:46.221929 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:46.246369 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.248716 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Pushing event updated for resources: {'Port': ['ID=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:46.268861 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.312489 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.448684 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.539735 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-453eeb8b-e94f-4128-97f8-b86795815368 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:46.548664 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c979ade-9564-4937-99e4-57cedbda1791 None None] Pushing event updated for resources: {'Port': ['ID=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:46.553553 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Attempting to bind port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:46.553925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Attempting to bind port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:46.554287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Attempting to bind port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:46.557868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-77211cf6-de9d-40e8-8b4f-d4dc514fca48 None None] Provisioning complete for port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:46.558233 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-77211cf6-de9d-40e8-8b4f-d4dc514fca48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.573006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:46.573006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:46.573006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.573006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:46.573006 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Bound port: 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:46.573006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.622946 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.636960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-77211cf6-de9d-40e8-8b4f-d4dc514fca48 None None] Port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:46.646082 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] For port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:46.649076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] For port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:46.711908 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.712316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.759429 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca82cec8-ae93-4fcd-b421-5f3fcaee5739 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:10:46.786130 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Pushing event updated for resources: {'Port': ['ID=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:46.788683 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.790023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c979ade-9564-4937-99e4-57cedbda1791 None None] Pushing event updated for resources: {'Port': ['ID=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:46.792685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Routers {'30c9ab26-4ac0-46d3-904b-64a8314b242a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:46.793289 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['30c9ab26-4ac0-46d3-904b-64a8314b242a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:46.795157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-d7640d61-0d63-47c5-8a03-072e751125b1 None None] Provisioning complete for port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:46.795523 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7640d61-0d63-47c5-8a03-072e751125b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:46.882003 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:46.883467 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:46.959919 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] Set router 30c9ab26-4ac0-46d3-904b-64a8314b242a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:46.991997 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7640d61-0d63-47c5-8a03-072e751125b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.004695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Router 30c9ab26-4ac0-46d3-904b-64a8314b242a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:10:47.050574 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d7640d61-0d63-47c5-8a03-072e751125b1 None None] For port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:47.118702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:10:47.124180 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-4aa3386f-77aa-463b-b58e-2736ec7cebc6 admin admin] 10.222.0.18 "PUT /v2.0/routers/30c9ab26-4ac0-46d3-904b-64a8314b242a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8196747 Dec 21 05:10:47.132357 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d7640d61-0d63-47c5-8a03-072e751125b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.207204 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7640d61-0d63-47c5-8a03-072e751125b1 None None] Pushing event updated for resources: {'Port': ['ID=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:47.226007 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c0ddd3e1-97d0-4ba0-8ec8-3a184319131d', 'name': '', 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'mac_address': 'fa:16:3e:e2:dd:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4327, 'fixed_ips': [{'subnet_id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:45Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 2, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'subnets': [{'id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:47.261629 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44627637-55d9-4af0-ab54-8ec524d1c93b None None] The sync data for ids ['30c9ab26-4ac0-46d3-904b-64a8314b242a'] in n-d-822053-11 is: [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c0ddd3e1-97d0-4ba0-8ec8-3a184319131d', 'name': '', 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'mac_address': 'fa:16:3e:e2:dd:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4327, 'fixed_ips': [{'subnet_id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:45Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 2, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'subnets': [{'id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:10:47.272365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a84a41b7-25c3-412d-ac30-47cfee287d3d None None] Provisioning complete for port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:47.272747 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a84a41b7-25c3-412d-ac30-47cfee287d3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.309075 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-a84a41b7-25c3-412d-ac30-47cfee287d3d None None] Port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:47.320694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-a84a41b7-25c3-412d-ac30-47cfee287d3d None None] Provisioning complete for port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:47.321215 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a84a41b7-25c3-412d-ac30-47cfee287d3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.505828 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12f58b38-55df-4fb2-a086-81f69d8d539c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:47.562159 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 12f58b38-55df-4fb2-a086-81f69d8d539c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:47.562599 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.712006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52606) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:47.716739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-787526157', 'description': 'tempest-secgroup-smoke-787526157 description', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:47.797908 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.869260 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.929889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:47.967647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroup': ['ID=141091aa-eae9-463e-bc9d-4f14079e4d65,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:48.017003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.018590 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd3501ba-bdd3-44f6-a76f-ed27107141ce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3054669 Dec 21 05:10:48.021467 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52608) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:48.026061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '141091aa-eae9-463e-bc9d-4f14079e4d65', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:48.110730 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.169386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.243660 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.265788 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80a1a6eb-9c2f-43de-9797-88903f44f70a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:48.342767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.344072 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6219d95b-e0a5-4083-94fd-da30bdcf9618 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3216209 Dec 21 05:10:48.347613 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52610) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:48.352147 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '141091aa-eae9-463e-bc9d-4f14079e4d65', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:48.437386 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.495662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.540263 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.558475 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b0b2ef88-6b09-4b2f-96fa-cd0c0dc059c9,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:48.605782 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.607099 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2aad8dc3-647e-4d6c-8c56-8128f4d3109a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2584751 Dec 21 05:10:48.610159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52614) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:48.614809 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '141091aa-eae9-463e-bc9d-4f14079e4d65', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:48.705547 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.763631 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.843252 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.863004 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba738508-1068-4463-a41f-130ed0587193,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:48.948288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:48.949527 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-27319638-3be2-463b-b9c2-234d47c411d7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3384423 Dec 21 05:10:48.952326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52616) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:48.956765 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '141091aa-eae9-463e-bc9d-4f14079e4d65', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:49.048578 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.104541 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.174726 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.195749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2faa8b59-b77d-4dd4-bbfc-ea03c1442880,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:49.251835 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.253075 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2a84b497-dcbe-43a1-893b-bec597fca000 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2998059 Dec 21 05:10:49.255792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52618) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:49.260069 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '141091aa-eae9-463e-bc9d-4f14079e4d65', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:49.329393 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Project 449c18c6acb14eab9ae3cbb2fa4f9b75 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:10:49.334453 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.392426 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.470598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.489055 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=984e445b-0c08-47ee-af95-095a938112bd,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:49.491757 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:49.539407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:49.539783 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.552353 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.553617 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-26c5eca6-6fc9-409d-8b59-c92d7788ced4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2968888 Dec 21 05:10:49.556577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52620) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:10:49.560913 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '141091aa-eae9-463e-bc9d-4f14079e4d65', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:49.642111 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Project 449c18c6acb14eab9ae3cbb2fa4f9b75 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:10:49.647328 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.706547 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.774345 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Sync routers for ids ['30c9ab26-4ac0-46d3-904b-64a8314b242a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:10:49.784824 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Routers {'30c9ab26-4ac0-46d3-904b-64a8314b242a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:49.785423 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['30c9ab26-4ac0-46d3-904b-64a8314b242a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:49.786345 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.803892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c137392-7873-414c-9d95-80032fd834f2,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:49.879749 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:49.889416 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5c60c344-4a1d-45ac-a147-c18334afaea0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3317368 Dec 21 05:10:49.890005 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Set router 30c9ab26-4ac0-46d3-904b-64a8314b242a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:49.980628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d543b353-7b06-4562-93e6-1e5c2f93a3e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.038774 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-04596842-2df0-4431-832f-03bb09ce719c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-787526157&fields=id&tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 267 time: 0.0454030 Dec 21 05:10:50.092834 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c0ddd3e1-97d0-4ba0-8ec8-3a184319131d', 'name': '', 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'mac_address': 'fa:16:3e:e2:dd:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4327, 'fixed_ips': [{'subnet_id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:45Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 2, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'subnets': [{'id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:50.123569 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Checking router: 30c9ab26-4ac0-46d3-904b-64a8314b242a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:10:50.123929 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Updating router 30c9ab26-4ac0-46d3-904b-64a8314b242a port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:10:50.148371 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.148575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-8c46fd66-482c-40dd-83c6-d8eccb46bf31 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:50.149890 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-8c46fd66-482c-40dd-83c6-d8eccb46bf31 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 808 time: 0.1025224 Dec 21 05:10:50.165210 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-d35a8df3-b4f3-47c9-9268-fda9904f3d91 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/quotas/449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 375 time: 0.0093882 Dec 21 05:10:50.214440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-deeb329e-e5e5-4310-a027-ce53d2bc0e2d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0436804 Dec 21 05:10:50.313479 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-c7e40afd-c202-41ed-b788-352f560489f9 service neutron] 10.222.0.18 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864799 Dec 21 05:10:50.405615 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.411662 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-85c23f05-5539-4a51-a922-d71ab404e96e service neutron] 10.222.0.18 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917330 Dec 21 05:10:50.465244 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.612694 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee2fa24-8b90-45f7-ba4c-4b5d3e24099f None None] Pushing event updated for resources: {'Port': ['ID=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:50.648077 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-673ee128-1866-4c50-a229-b5d38f50723d req-786e533a-f154-4e32-a1db-5921f34b1f4a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 210 time: 0.0305910 Dec 21 05:10:50.670049 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Attempting to bind port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:50.670420 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Attempting to bind port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:50.670780 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Attempting to bind port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d on network 79f795c6-4f78-4a77-bf67-1d759df61db6 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:50.675971 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:50.676469 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Checking segment: {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:50.676873 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.677269 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Bound using segment: {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:50.677732 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Bound port: c0ddd3e1-97d0-4ba0-8ec8-3a184319131d, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:50.678109 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.743851 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] For port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:50.747001 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] For port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:50.809577 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.845838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7293ff45-7ad0-4275-bd92-7937919f7d5a None None] Provisioning complete for port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:50.846303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7293ff45-7ad0-4275-bd92-7937919f7d5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.871032 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee2fa24-8b90-45f7-ba4c-4b5d3e24099f None None] Pushing event updated for resources: {'Port': ['ID=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:50.873563 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Routers {'30c9ab26-4ac0-46d3-904b-64a8314b242a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:10:50.874064 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['30c9ab26-4ac0-46d3-904b-64a8314b242a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:50.930618 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7293ff45-7ad0-4275-bd92-7937919f7d5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:50.965206 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-7293ff45-7ad0-4275-bd92-7937919f7d5a None None] For port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:10:50.985670 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] Set router 30c9ab26-4ac0-46d3-904b-64a8314b242a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:10:51.026280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7293ff45-7ad0-4275-bd92-7937919f7d5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:51.077683 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7293ff45-7ad0-4275-bd92-7937919f7d5a None None] Pushing event updated for resources: {'Port': ['ID=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:51.145961 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-722d632d-1f0a-45e9-8cca-08db7e256f2a None None] Provisioning complete for port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:51.146306 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-722d632d-1f0a-45e9-8cca-08db7e256f2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:51.183977 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c0ddd3e1-97d0-4ba0-8ec8-3a184319131d', 'name': '', 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'mac_address': 'fa:16:3e:e2:dd:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4327, 'fixed_ips': [{'subnet_id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:45Z', 'updated_at': '2021-12-21T05:10:50Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'subnets': [{'id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:10:51.209602 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a88275b-8b11-4034-afdb-57ab108b28b4 None None] The sync data for ids ['30c9ab26-4ac0-46d3-904b-64a8314b242a'] in n-d-822053-11 is: [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'c0ddd3e1-97d0-4ba0-8ec8-3a184319131d', 'name': '', 'network_id': '79f795c6-4f78-4a77-bf67-1d759df61db6', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'mac_address': 'fa:16:3e:e2:dd:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4327, 'fixed_ips': [{'subnet_id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:45Z', 'updated_at': '2021-12-21T05:10:50Z', 'revision_number': 4, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'subnets': [{'id': '14f97133-ef5a-4adb-8e05-a6ec84399e14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:10:51.507685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0ddd3e1-97d0-4ba0-8ec8-3a184319131d up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:10:51.557091 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:51.557460 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:52.025726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f3ea9fb-3239-439b-bd26-263e7d8311e2 req-2b8659e7-b604-4c87-9627-ae96aa3192d6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 210 time: 0.3241937 Dec 21 05:10:52.728278 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0ed9a968-8799-4ec5-8324-7e76e1305b93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:53.103052 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0ebf56c-b8dd-446e-b310-0e8affa8f66b req-10153514-c80d-4d31-992d-8618396b3a83 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 210 time: 0.0255861 Dec 21 05:10:53.596327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:53.752505 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:54.197949 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b2136caa-8b53-4489-8e4c-6fc814f3ea22 req-eb36bc11-89fe-4a34-9a36-d4b9e6c7654b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 210 time: 0.0247724 Dec 21 05:10:55.023390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-e6f446f8-81c7-4363-ac10-6f13170dfc2c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:55.024847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-e6f446f8-81c7-4363-ac10-6f13170dfc2c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 808 time: 0.1160944 Dec 21 05:10:55.102101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-65e8ad8a-0d08-48c4-ae75-d5adc19ef5e5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 379 time: 0.0530140 Dec 21 05:10:55.113276 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'port': {'device_id': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'admin_state_up': True, 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'security_groups': ['141091aa-eae9-463e-bc9d-4f14079e4d65']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:55.293676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d09a7c1-be71-4074-911c-f52a47ed1fce req-307815e1-6a68-49cd-98e4-d0d53d39947d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 210 time: 0.0274928 Dec 21 05:10:55.299749 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Made reservation on behalf of 449c18c6acb14eab9ae3cbb2fa4f9b75 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:10:55.303429 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.396386 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.432123 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Allocated IP 172.20.0.14 (645a6cd1-6742-4469-afd8-b9c3665fe576/65e74147-5f7e-4b8c-956b-aec144967429/6652b6d3-003f-4d37-afc5-107d726e7cec) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:10:55.516959 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.569201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.678383 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.723543 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:10:55.726517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:10:55.730375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:10:55.759716 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:55.789235 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:55.789894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.843252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.874447 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-ef30cb8a-31b9-4496-b079-491982474ab0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7650163 Dec 21 05:10:55.901297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Request body: {'port': {'device_id': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:10:55.955109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:55.973469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b54703ea-28bf-4a63-8082-527edaf3bcf2 None None] Provisioning complete for port 6652b6d3-003f-4d37-afc5-107d726e7cec triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:10:55.973894 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b54703ea-28bf-4a63-8082-527edaf3bcf2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:56.006554 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-b54703ea-28bf-4a63-8082-527edaf3bcf2 None None] Port 6652b6d3-003f-4d37-afc5-107d726e7cec cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:10:56.212689 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:10:56.220107 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:56.231508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Transition to ACTIVE for port object 6652b6d3-003f-4d37-afc5-107d726e7cec will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:10:56.299889 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:56.353842 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:56.447541 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:10:56.447886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:10:56.448219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:56.459692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c39a860-a881-4e73-b30e-ddc2771c0fb2 req-db164358-3af3-41cb-a3b2-1d9612f0c5de tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:56.461242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c39a860-a881-4e73-b30e-ddc2771c0fb2 req-db164358-3af3-41cb-a3b2-1d9612f0c5de tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0931780 Dec 21 05:10:56.463703 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Port 6652b6d3-003f-4d37-afc5-107d726e7cec on network 645a6cd1-6742-4469-afd8-b9c3665fe576 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:10:56.463966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:10:56.471904 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 10, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:10:56.472244 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Checking segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:10:56.472627 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Bound using segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:10:56.473059 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Bound port: 6652b6d3-003f-4d37-afc5-107d726e7cec, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:10:56.473417 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:56.560204 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1c39a860-a881-4e73-b30e-ddc2771c0fb2 req-26be198a-3fdf-4590-ad54-f58030d78c14 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0909765 Dec 21 05:10:56.575565 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:10:56.578529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:10:56.645716 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:56.685084 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:56.685705 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:10:56.687135 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] 10.222.0.31 "PUT /v2.0/ports/6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 1093 time: 0.7903652 Dec 21 05:10:56.687584 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:10:56.689862 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7" -d '{"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:10:56.723104 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3743b749-b2dc-4aee-a2eb-ff3ae8922a17 service neutron] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:10:56.736693 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:10:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b018ec8a-6b6e-4317-bf2f-d5517daf3ac2 x-openstack-request-id: req-b018ec8a-6b6e-4317-bf2f-d5517daf3ac2 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:10:56.736693 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:10:56.736693 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b018ec8a-6b6e-4317-bf2f-d5517daf3ac2 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:10:56.736693 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'status': 'completed', 'code': 200} Dec 21 05:10:56.829776 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7 req-74289206-3cd1-445c-8bba-88863d6c93bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:56.831349 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7 req-74289206-3cd1-445c-8bba-88863d6c93bd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1096 time: 0.0448067 Dec 21 05:10:56.949092 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7 req-e6d7297e-2f0c-49b0-bf26-20c29b127c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:56.950490 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7 req-e6d7297e-2f0c-49b0-bf26-20c29b127c38 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0984442 Dec 21 05:10:57.050600 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7 req-86045e03-1774-467d-964c-69eb9d26381a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:57.052028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0519cc72-40ad-4334-8e0c-1f3f5218b3e7 req-86045e03-1774-467d-964c-69eb9d26381a service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0903587 Dec 21 05:10:57.155872 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-9c1f9356-59d4-4254-8cae-1e31ccb4507e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:57.157375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-9c1f9356-59d4-4254-8cae-1e31ccb4507e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1096 time: 0.0403483 Dec 21 05:10:57.212320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-e73f7dd7-a765-4fde-893c-0efa5f3e1679 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 217 time: 0.0340116 Dec 21 05:10:57.268676 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-a275b958-34eb-4a14-b3ab-c1954a50920d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:57.270101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-a275b958-34eb-4a14-b3ab-c1954a50920d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0470581 Dec 21 05:10:57.319037 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-1606ed49-0877-4f91-bd38-23911b34c567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:57.320438 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-1606ed49-0877-4f91-bd38-23911b34c567 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0392182 Dec 21 05:10:57.412327 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-54361ec6-2d45-4858-a783-a79e56b656d2 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806439 Dec 21 05:10:57.508456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e96103d3-d0f4-4b46-90fd-e4af2544ab2f req-22ae3e8d-596b-4de7-b133-2446f8e40e01 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849342 Dec 21 05:10:57.675946 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7bd3c1-e758-4a04-95ce-891583caa74a req-3c7dd773-3e12-4c72-a8d4-68bcd38de407 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:57.677423 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d7bd3c1-e758-4a04-95ce-891583caa74a req-3c7dd773-3e12-4c72-a8d4-68bcd38de407 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0493996 Dec 21 05:10:57.726346 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7d7bd3c1-e758-4a04-95ce-891583caa74a req-56ae5471-2b56-439d-b1bd-0cf7a5193285 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428348 Dec 21 05:10:58.855364 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0eba6d-c45d-40ad-b7e3-ba4b30d78012 req-3b83bb49-8dcc-4d61-b756-ceec6749a8a3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:10:58.856831 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f0eba6d-c45d-40ad-b7e3-ba4b30d78012 req-3b83bb49-8dcc-4d61-b756-ceec6749a8a3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0524230 Dec 21 05:10:58.905531 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1f0eba6d-c45d-40ad-b7e3-ba4b30d78012 req-62c6825d-2490-4e75-96e0-a9950d37ae60 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424314 Dec 21 05:11:00.027214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa6b672-7523-487a-8884-37c9cbe65291 req-a8b0b61f-e83d-466f-9161-b92ea2b3640a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:00.028746 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5aa6b672-7523-487a-8884-37c9cbe65291 req-a8b0b61f-e83d-466f-9161-b92ea2b3640a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0530472 Dec 21 05:11:00.084482 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5aa6b672-7523-487a-8884-37c9cbe65291 req-e1826fd8-54ef-47e3-932a-e20c2e02fc95 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472224 Dec 21 05:11:00.290371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:11:00.381365 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:11:00.391320 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'mac_address': 'fa:16:3e:2d:20:ee', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:11:00.431742 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:00.445069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:11:00.463837 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:11:00.574793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:00.659211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:11:00.983000 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6652b6d3-003f-4d37-afc5-107d726e7cec'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:11:01.199388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef222a04-eadd-41bf-93c4-a7357fe3ad63 req-af9275fc-e81a-44e2-bc60-1a238db8e5df tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:01.200802 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef222a04-eadd-41bf-93c4-a7357fe3ad63 req-af9275fc-e81a-44e2-bc60-1a238db8e5df tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0483658 Dec 21 05:11:01.253427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef222a04-eadd-41bf-93c4-a7357fe3ad63 req-a6dd3fb0-9fc6-4ac1-b13d-757b0c69a62a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463812 Dec 21 05:11:02.290290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:11:02.366768 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f02e5a3-1e84-42e6-bcfe-a6d4391bfffa req-9aa82d4b-1e9d-49ba-8971-90b3527e6482 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:02.368274 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f02e5a3-1e84-42e6-bcfe-a6d4391bfffa req-9aa82d4b-1e9d-49ba-8971-90b3527e6482 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0479100 Dec 21 05:11:02.402980 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 6652b6d3-003f-4d37-afc5-107d726e7cec completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:11:02.408269 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 6652b6d3-003f-4d37-afc5-107d726e7cec triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:11:02.408756 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:02.416961 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6f02e5a3-1e84-42e6-bcfe-a6d4391bfffa req-d38ed373-0340-486a-a9bb-67fb58fb88c9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425701 Dec 21 05:11:02.488519 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:02.510350 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:11:02.512590 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-131455d3-9b0f-4ced-8e90-5a77f894ceb8" -d '{"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-plugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:11:02.524959 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:11:02.574170 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:02.607089 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:11:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7113f6a0-960e-4bf3-857a-093de8e1552c x-openstack-request-id: req-7113f6a0-960e-4bf3-857a-093de8e1552c {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:11:02.607388 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-plugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:11:02.607648 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7113f6a0-960e-4bf3-857a-093de8e1552c {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:11:02.608049 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'code': 200} Dec 21 05:11:02.626480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:11:02.747897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9efffa1b-f1f3-41c5-b3e6-5ccb3d4bf5d0 req-824dda74-d088-4c7a-9326-7fca3c77ff92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:02.749374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9efffa1b-f1f3-41c5-b3e6-5ccb3d4bf5d0 req-824dda74-d088-4c7a-9326-7fca3c77ff92 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1098 time: 0.0386765 Dec 21 05:11:02.797097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9efffa1b-f1f3-41c5-b3e6-5ccb3d4bf5d0 req-d345cdf2-1120-480c-85dd-bb0258cedf8c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402589 Dec 21 05:11:03.538284 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c07583-a3e8-4347-8cac-31d529a5cec0 req-3f0438a4-2d25-4e10-a95c-f5be78c29539 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:03.539796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77c07583-a3e8-4347-8cac-31d529a5cec0 req-3f0438a4-2d25-4e10-a95c-f5be78c29539 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0526152 Dec 21 05:11:03.589006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-77c07583-a3e8-4347-8cac-31d529a5cec0 req-f62bc87f-1ddb-4b73-b0ac-6cdebfcea091 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432146 Dec 21 05:11:04.704901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cba24df-52b7-4212-9663-276ab5994fc4 req-66875e16-d06f-4065-8649-d37185628db8 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:04.706376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cba24df-52b7-4212-9663-276ab5994fc4 req-66875e16-d06f-4065-8649-d37185628db8 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0480752 Dec 21 05:11:04.755176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5cba24df-52b7-4212-9663-276ab5994fc4 req-ac64f466-ec5d-4a39-8236-de9d2b6504d3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427659 Dec 21 05:11:04.870562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f51a3019-3760-43ea-aacb-8ce8b9ba31dd req-fdcf46d5-87d7-4035-a5b4-33f4d126bf68 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:04.871968 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f51a3019-3760-43ea-aacb-8ce8b9ba31dd req-fdcf46d5-87d7-4035-a5b4-33f4d126bf68 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0470223 Dec 21 05:11:04.923942 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f51a3019-3760-43ea-aacb-8ce8b9ba31dd req-991c0d97-9dfd-4091-b491-3d7f84a6cd01 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456064 Dec 21 05:11:04.945380 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52684) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:11:05.077952 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8193277f-0fb8-4482-979e-b7f3b532dac0 tempest-TestShelveInstance-404619495 tempest-TestShelveInstance-404619495-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:05.079692 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8193277f-0fb8-4482-979e-b7f3b532dac0 tempest-TestShelveInstance-404619495 tempest-TestShelveInstance-404619495-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1093 time: 0.1333334 Dec 21 05:11:05.082797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 52688) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:11:05.087041 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:11:05.191501 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:05.285034 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:05.387347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Allocated IP 172.25.5.64 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/0762950f-756e-4a70-b7a5-d867778f51dd) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:11:05.485838 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:05.574666 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:05.614527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:11:05.619153 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:11:05.622638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:11:05.628415 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'Port': ['ID=0762950f-756e-4a70-b7a5-d867778f51dd,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:11:05.973870 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:06.090761 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:06.236352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:06.298977 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:06.364854 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'Port': ['ID=0762950f-756e-4a70-b7a5-d867778f51dd,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:11:06.374852 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:06.471952 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Floating IP b375a2cd-46cd-4bd1-a485-bb07828aef82 associated. External IP: 172.25.5.64, port: 6652b6d3-003f-4d37-afc5-107d726e7cec. Dec 21 05:11:06.677486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:11:06.792042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:11:06.802217 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:11:06.816969 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:11:06.817583 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:11:06.879819 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:06.906305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b8fec9f9-f3ea-467c-bc06-c79d680c2615 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8224678 Dec 21 05:11:06.907040 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:11:06.909291 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a" -d '{"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:11:06.920318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:11:06.948846 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:11:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3aa41672-4ebb-447a-b88f-721ff43075ac x-openstack-request-id: req-3aa41672-4ebb-447a-b88f-721ff43075ac {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:11:06.949145 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:11:06.949398 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-3aa41672-4ebb-447a-b88f-721ff43075ac {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:11:06.949798 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'status': 'completed', 'code': 200} Dec 21 05:11:07.039748 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-80cef6f8-9455-46e7-bb6d-44eebb766b40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:07.050375 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-80cef6f8-9455-46e7-bb6d-44eebb766b40 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1098 time: 0.0524497 Dec 21 05:11:07.146945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-8a2a3974-6d4a-4156-950b-35c11e598058 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:07.148325 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-8a2a3974-6d4a-4156-950b-35c11e598058 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0906250 Dec 21 05:11:07.214134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-effb719c-848e-4233-9283-d18cfb177603 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 999 time: 0.0580964 Dec 21 05:11:07.270187 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-e1b5aa64-b60d-4bfe-8264-e4ce6883dff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:07.271952 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-e1b5aa64-b60d-4bfe-8264-e4ce6883dff6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0500309 Dec 21 05:11:07.320224 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-d34dd77b-3c32-4bb1-825f-46491386f3a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:07.321766 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-d34dd77b-3c32-4bb1-825f-46491386f3a4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0425360 Dec 21 05:11:07.413031 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'b375a2cd-46cd-4bd1-a485-bb07828aef82', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'floating_ip_address': '172.25.5.64', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4339, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'mac_address': 'fa:16:3e:2d:20:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:11:05Z', 'updated_at': '2021-12-21T05:11:05Z', 'revision_number': 0, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:11:07.413347 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-d41a664c-bd76-48b7-b329-577827598c13 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842590 Dec 21 05:11:07.441107 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:11:07.456390 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:11:07.457001 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:10:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:11:07.506566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aa1a34e9-c2a5-4d61-b401-f9b2f5d42f3a req-90a2120a-f58d-45cc-8c43-c1374cd1a520 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864544 Dec 21 05:11:07.567307 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:11:07.809129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'b375a2cd-46cd-4bd1-a485-bb07828aef82', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'floating_ip_address': '172.25.5.64', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4339, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'mac_address': 'fa:16:3e:2d:20:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:11:05Z', 'updated_at': '2021-12-21T05:11:05Z', 'revision_number': 0, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:11:07.835542 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ace9b3f-1ad0-4bbd-9d61-9cee50555647 None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'b375a2cd-46cd-4bd1-a485-bb07828aef82', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'floating_ip_address': '172.25.5.64', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4339, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'mac_address': 'fa:16:3e:2d:20:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:11:05Z', 'updated_at': '2021-12-21T05:11:05Z', 'revision_number': 0, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:11:08.033938 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb8e0513-19e7-4f7e-bc2a-feba6669aac2 None None] New status for floating IP b375a2cd-46cd-4bd1-a485-bb07828aef82: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:11:17.872992 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:11:19.967180 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7c72b534-5925-40bd-a2d0-5844f316f9e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:22.723216 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-43c29a97-a1fc-48c4-81ac-a86cd3c05b46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:23.585574 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:23.773727 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:25.379931 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:25.505211 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:25.813721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:46.713162 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-ab26379c-531a-44ae-b389-5650b6483bd7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0419347 Dec 21 05:11:46.826886 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-81cb73d4-1473-428a-8a4f-6febca69da8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:46.828377 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-81cb73d4-1473-428a-8a4f-6febca69da8b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1098 time: 0.0394001 Dec 21 05:11:46.937869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-559d49dd-8198-4d39-813d-4e346720fbc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:46.939425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-559d49dd-8198-4d39-813d-4e346720fbc0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0906157 Dec 21 05:11:47.012130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-4bc0253b-cec7-4412-89ff-5aaa2d49675d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 1001 time: 0.0612590 Dec 21 05:11:47.061484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-b213862f-5da3-464b-b71e-abf37f1a8e68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:47.063032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-b213862f-5da3-464b-b71e-abf37f1a8e68 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0432026 Dec 21 05:11:47.107488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-c3dea897-b692-4b2e-8c1c-7855c501d211 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:11:47.108969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-c3dea897-b692-4b2e-8c1c-7855c501d211 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0380235 Dec 21 05:11:47.204579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-86d36610-56cb-4b7b-be56-ee4dc7a38c61 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836029 Dec 21 05:11:47.296565 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5b92fb31-3907-40ba-aca5-09850b6015a3 req-1365b1af-85ff-49c2-a90f-6955df4cc5ad service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804360 Dec 21 05:11:49.990895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-771e6d7f-c046-405c-bea9-bddd55122ab2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:52.733496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-71175daf-cf87-4e53-b631-7ca850c2bd08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:53.607771 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:53.773324 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:54.873173 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:11:55.350330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:55.498556 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:11:55.830345 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:20.001290 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f8fa2cc9-5a59-4358-a561-d6b9a9b949b7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:22.738225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0bfd35cf-5c0f-46a1-8d49-2de8165cb89f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:23.612632 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:23.801459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:25.372356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:25.521280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:25.807299 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:31.873230 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:12:48.801518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-956d5d01-54d1-4b8c-a715-d2124b2f8b8e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0846322 Dec 21 05:12:48.903790 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-17136507-ce1c-490b-b70d-60327fdaf96a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:12:48.905174 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-17136507-ce1c-490b-b70d-60327fdaf96a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1098 time: 0.0434117 Dec 21 05:12:49.007892 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-4d4b0a8a-5e85-44a6-b7c0-19a752af46de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:12:49.009371 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-4d4b0a8a-5e85-44a6-b7c0-19a752af46de service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0834589 Dec 21 05:12:49.081995 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-8b215ed8-73f8-4e79-9580-5ee28c243223 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 1001 time: 0.0604050 Dec 21 05:12:49.138472 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-28890197-bf08-4fbf-8fc8-e75875e38548 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:12:49.139929 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-28890197-bf08-4fbf-8fc8-e75875e38548 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0478377 Dec 21 05:12:49.189934 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-5f7548c3-24fd-498e-8e03-61680c98a696 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:12:49.191420 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-5f7548c3-24fd-498e-8e03-61680c98a696 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383766 Dec 21 05:12:49.206463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-027e732b-96a7-40c6-8917-df8aa5587f41 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:12:49.207427 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-027e732b-96a7-40c6-8917-df8aa5587f41 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047619 Dec 21 05:12:49.297784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-b5a8ccc6-dc37-4c5a-b91a-4b598b7b0f0d service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826168 Dec 21 05:12:49.388559 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fdd532a0-da7b-4f54-ac83-8961ddbf36d4 req-8480ec76-0ed0-4252-900d-4f63c19f6fc7 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0791419 Dec 21 05:12:50.035526 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-34307628-f295-4a67-b482-1f2c06212d0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:52.732780 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-65da36bc-d9fd-46fb-a038-13d71e8554e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:53.589463 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:53.783673 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:55.377915 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:55.526858 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:12:55.812529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:05.474974 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e0a4a75-d672-4464-bf4e-efc45ef0e958 req-461baae6-b057-4d40-8969-f0d36aaf96c5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:05.476452 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e0a4a75-d672-4464-bf4e-efc45ef0e958 req-461baae6-b057-4d40-8969-f0d36aaf96c5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.3477900 Dec 21 05:13:05.525094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2e0a4a75-d672-4464-bf4e-efc45ef0e958 req-8e3fca0e-8d22-4bc4-b829-83650deb162a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416026 Dec 21 05:13:06.648163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33778ae-540b-49ae-8bd4-023f89ad5dc1 req-e2a9de9f-8b22-406d-b659-38e5b5e70db0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:06.649648 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a33778ae-540b-49ae-8bd4-023f89ad5dc1 req-e2a9de9f-8b22-406d-b659-38e5b5e70db0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0488124 Dec 21 05:13:06.698450 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a33778ae-540b-49ae-8bd4-023f89ad5dc1 req-3eaeebe8-6f10-4e9d-be57-cdd4b4752681 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428305 Dec 21 05:13:07.828506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da7e7ba-df9e-4066-94f9-e5261015c8fe req-e2de6b5d-1ea2-4b8a-9435-9bc0d72ec762 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:07.829957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6da7e7ba-df9e-4066-94f9-e5261015c8fe req-e2de6b5d-1ea2-4b8a-9435-9bc0d72ec762 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0475249 Dec 21 05:13:07.881329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6da7e7ba-df9e-4066-94f9-e5261015c8fe req-d977e0c1-14f0-4439-9414-ec4e3649cef1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453961 Dec 21 05:13:08.873347 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:13:09.002282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-159c1457-3d8f-4309-87a9-040814a25df1 req-4e9452d1-aaab-4a34-8899-1a8f84901b4b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:09.003784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-159c1457-3d8f-4309-87a9-040814a25df1 req-4e9452d1-aaab-4a34-8899-1a8f84901b4b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0504341 Dec 21 05:13:09.052088 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-159c1457-3d8f-4309-87a9-040814a25df1 req-dc2dcda0-688d-47e7-9df5-92db08cabc58 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423851 Dec 21 05:13:10.170624 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8de565-866c-4d72-950f-4b2172668b64 req-6ee961ee-07c6-44fb-9993-04d0658fa73b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:10.172097 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c8de565-866c-4d72-950f-4b2172668b64 req-6ee961ee-07c6-44fb-9993-04d0658fa73b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0475659 Dec 21 05:13:10.219449 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3c8de565-866c-4d72-950f-4b2172668b64 req-6433ecb6-a6c5-4aa5-a1a8-ac0537187b46 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415270 Dec 21 05:13:11.335735 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bc37e1-d9f5-4e43-8d98-547942537386 req-2c7bedea-3d51-4435-aca8-53f6e602f176 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:11.337176 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13bc37e1-d9f5-4e43-8d98-547942537386 req-2c7bedea-3d51-4435-aca8-53f6e602f176 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0515690 Dec 21 05:13:11.386148 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-13bc37e1-d9f5-4e43-8d98-547942537386 req-144cf3bc-26dc-450d-b8c0-95cb18db4b23 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428951 Dec 21 05:13:12.500497 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184a8de0-563f-45c0-937c-b7674a49ab62 req-3b8f1f28-b6fe-4b40-8fc3-c005b31f7359 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:12.501958 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-184a8de0-563f-45c0-937c-b7674a49ab62 req-3b8f1f28-b6fe-4b40-8fc3-c005b31f7359 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0480790 Dec 21 05:13:12.550359 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-184a8de0-563f-45c0-937c-b7674a49ab62 req-31d0b57f-0239-4e65-a11a-1848e52f5443 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424874 Dec 21 05:13:13.665412 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942d7fa0-2f2f-40c3-8394-524157ef043e req-c8d18600-f3b3-4214-8a7b-659a8e0c0629 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:13.667417 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-942d7fa0-2f2f-40c3-8394-524157ef043e req-c8d18600-f3b3-4214-8a7b-659a8e0c0629 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0482192 Dec 21 05:13:13.717719 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-942d7fa0-2f2f-40c3-8394-524157ef043e req-1e9fa98c-e081-4b86-a36e-50d3c3d2dad7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444489 Dec 21 05:13:14.834350 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f3e106-83ae-4cb1-a0b0-e579e8123fb1 req-d8dce452-eee5-4e2e-9cc4-818833105314 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:14.835850 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89f3e106-83ae-4cb1-a0b0-e579e8123fb1 req-d8dce452-eee5-4e2e-9cc4-818833105314 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0486829 Dec 21 05:13:14.886201 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-89f3e106-83ae-4cb1-a0b0-e579e8123fb1 req-d2c67e78-5922-472f-aa99-a1ed41f74214 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432744 Dec 21 05:13:15.999700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2670b3ec-50f1-44ad-b8d5-5627a02fb299 req-02412fc8-471e-489b-93b9-c2e9e619252d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:16.001165 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2670b3ec-50f1-44ad-b8d5-5627a02fb299 req-02412fc8-471e-489b-93b9-c2e9e619252d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0482323 Dec 21 05:13:16.048433 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2670b3ec-50f1-44ad-b8d5-5627a02fb299 req-f2b2601b-eacd-4598-ad08-fd799da28328 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413535 Dec 21 05:13:17.065189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:13:17.159430 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:17.166779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f8b2ccd-6a77-4397-8f68-0edc99999f5d req-fdebebdd-9300-4eae-a587-511dd03baf58 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:17.168300 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f8b2ccd-6a77-4397-8f68-0edc99999f5d req-fdebebdd-9300-4eae-a587-511dd03baf58 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0519128 Dec 21 05:13:17.169616 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'mac_address': 'fa:16:3e:2d:20:ee', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:13:17.207024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:17.217780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8f8b2ccd-6a77-4397-8f68-0edc99999f5d req-1acc18e5-4e43-4400-bb96-7f7bd35da51c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435684 Dec 21 05:13:17.222749 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:13:17.242442 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:17.287074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:17.333608 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:17.340819 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.341173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.341520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.341861 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.342199 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.342535 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.342872 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.343233 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.343565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.343891 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.344219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.344544 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.344865 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:17.485093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6652b6d3-003f-4d37-afc5-107d726e7cec'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:13:18.340199 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-541ad663-e19c-4b81-aae8-b9e431b19b93 req-6cfb4d6e-97cc-4833-94df-62d6d50253ef tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:18.341738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-541ad663-e19c-4b81-aae8-b9e431b19b93 req-6cfb4d6e-97cc-4833-94df-62d6d50253ef tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0488462 Dec 21 05:13:18.393725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-541ad663-e19c-4b81-aae8-b9e431b19b93 req-80bad3ef-a499-45c8-bf6d-2c19aeac5645 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459645 Dec 21 05:13:19.065603 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:13:19.119756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 6652b6d3-003f-4d37-afc5-107d726e7cec triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:13:19.120446 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:19.218975 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:19.245513 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:13:19.247978 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db11bcfd-aa9a-4766-9384-b8f573a544c9" -d '{"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-plugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:13:19.269208 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:19.289208 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:13:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-935d90ce-0271-4d0e-a8af-0784691e6095 x-openstack-request-id: req-935d90ce-0271-4d0e-a8af-0784691e6095 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:13:19.289545 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-plugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:13:19.289938 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-935d90ce-0271-4d0e-a8af-0784691e6095 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:13:19.290362 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'code': 200} Dec 21 05:13:19.327055 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:19.376401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:19.522463 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d415f2c-7984-4212-989d-6db7395fe942 req-2fc31e7b-de67-41fc-9d46-0996acf32dad tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:19.524309 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d415f2c-7984-4212-989d-6db7395fe942 req-2fc31e7b-de67-41fc-9d46-0996acf32dad tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0557935 Dec 21 05:13:19.586006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d415f2c-7984-4212-989d-6db7395fe942 req-d7493265-b9db-4f8a-936c-54b6f1497194 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548365 Dec 21 05:13:19.972845 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-fd59c09d-6427-49f4-8753-e1f7e03a991c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:20.711658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5e21ce-adde-4095-8ab4-7e0d841a8449 req-620bc1e5-e40b-450d-a5d6-4894a855b3fb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:20.713833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d5e21ce-adde-4095-8ab4-7e0d841a8449 req-620bc1e5-e40b-450d-a5d6-4894a855b3fb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0521564 Dec 21 05:13:20.767613 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8d5e21ce-adde-4095-8ab4-7e0d841a8449 req-3ecc702a-f07a-4d2b-9cd5-e2c1f7b6fa7f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470152 Dec 21 05:13:21.899525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8c647c-87d3-4b8b-af46-8a154c8ccde4 req-45ad70ee-fc08-4f17-83a8-688a56eae566 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:21.901589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf8c647c-87d3-4b8b-af46-8a154c8ccde4 req-45ad70ee-fc08-4f17-83a8-688a56eae566 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0555763 Dec 21 05:13:21.970382 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf8c647c-87d3-4b8b-af46-8a154c8ccde4 req-19bfe22e-0f45-4244-9f1c-a305e142fffd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0599780 Dec 21 05:13:22.738536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-db6f7815-22c4-469e-aa97-14d11eb256b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:23.103052 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c98d2e0-d0e6-45fe-aa9f-452f1c636995 req-27462e76-7a91-48f9-8c4e-bc6271da4258 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:23.105430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c98d2e0-d0e6-45fe-aa9f-452f1c636995 req-27462e76-7a91-48f9-8c4e-bc6271da4258 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0531971 Dec 21 05:13:23.161440 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8c98d2e0-d0e6-45fe-aa9f-452f1c636995 req-038b928f-1408-408f-9681-a7e5c23ac6cb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494969 Dec 21 05:13:23.629887 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:23.795404 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:24.285064 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a12bb7-0f4e-4f8a-8349-507a934fa23b req-27e73e7c-4b33-4c6d-b793-75e3a84159aa tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:24.286658 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62a12bb7-0f4e-4f8a-8349-507a934fa23b req-27e73e7c-4b33-4c6d-b793-75e3a84159aa tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0514705 Dec 21 05:13:24.342858 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-62a12bb7-0f4e-4f8a-8349-507a934fa23b req-d3f1294f-1677-4f70-9e04-6e1abedb3bce tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484757 Dec 21 05:13:25.396445 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:25.499441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e5d3d2-1389-4e72-9016-6a3c7dfcc55d req-273267bc-3155-42ef-8151-c936dc73b521 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:25.501428 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6e5d3d2-1389-4e72-9016-6a3c7dfcc55d req-273267bc-3155-42ef-8151-c936dc73b521 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0749025 Dec 21 05:13:25.532839 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:25.554466 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d6e5d3d2-1389-4e72-9016-6a3c7dfcc55d req-05fb9e24-f82e-43d1-a5c4-219fff8895c6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465348 Dec 21 05:13:25.812273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:26.764751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a0427f-d126-4747-a7fd-f5d127c277c9 req-077e1493-8bfe-49ad-b804-46d2bfbe0edd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:26.766689 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8a0427f-d126-4747-a7fd-f5d127c277c9 req-077e1493-8bfe-49ad-b804-46d2bfbe0edd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.1338925 Dec 21 05:13:26.822500 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8a0427f-d126-4747-a7fd-f5d127c277c9 req-5de9c848-0210-4f97-9857-a47ed2a1be7a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488818 Dec 21 05:13:28.007496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41297333-92e2-4753-8e94-5af39496c240 req-b07a2c9a-5f47-478a-a728-6800e4739073 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:28.009140 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41297333-92e2-4753-8e94-5af39496c240 req-b07a2c9a-5f47-478a-a728-6800e4739073 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.1120012 Dec 21 05:13:28.079564 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-41297333-92e2-4753-8e94-5af39496c240 req-eb893f2b-3dc8-48a4-9729-8a2577747c01 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0631812 Dec 21 05:13:29.199982 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29691655-df2c-45f0-aa3f-6de25718de00 req-aba16e77-2e77-47e9-a189-d1cfc9188513 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:29.201429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29691655-df2c-45f0-aa3f-6de25718de00 req-aba16e77-2e77-47e9-a189-d1cfc9188513 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0474689 Dec 21 05:13:29.250403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-29691655-df2c-45f0-aa3f-6de25718de00 req-58a7d086-8ef6-47c6-82e3-40e343e019a3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431161 Dec 21 05:13:29.889961 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-6626e331-609b-4c7c-a444-bde76859a6b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:29.891483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-6626e331-609b-4c7c-a444-bde76859a6b0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1098 time: 0.0408108 Dec 21 05:13:29.993644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-409deb3a-af29-4efa-bbfc-baa461f89785 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:29.995797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-409deb3a-af29-4efa-bbfc-baa461f89785 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0933189 Dec 21 05:13:30.063868 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-ab66c98c-0133-45cb-bb4a-35b6eb7f0000 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 1001 time: 0.0575817 Dec 21 05:13:30.121169 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-b30bb035-82d5-4209-aa88-a5c9648ebb4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:30.122594 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-b30bb035-82d5-4209-aa88-a5c9648ebb4c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0471978 Dec 21 05:13:30.170853 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-4d55b801-ccba-4f9f-9120-5def1c271519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:30.172351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-4d55b801-ccba-4f9f-9120-5def1c271519 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0388944 Dec 21 05:13:30.269130 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-19725b97-757a-48cc-a9cb-42f0459133d4 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852766 Dec 21 05:13:30.397908 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec786e7b-186b-4536-8739-2c4fd7cedca2 req-2d275d80-2963-42f6-83b7-f5cfd0f92362 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1167412 Dec 21 05:13:30.406648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b0c9eed-c27c-4f68-b35a-75678bbd5252 req-6a1f809f-a0c9-49b4-9671-7a4276799ce0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:30.408060 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b0c9eed-c27c-4f68-b35a-75678bbd5252 req-6a1f809f-a0c9-49b4-9671-7a4276799ce0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0703018 Dec 21 05:13:30.456708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1b0c9eed-c27c-4f68-b35a-75678bbd5252 req-78ffb449-38e3-43ce-b89d-ddde712be1d6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426538 Dec 21 05:13:31.574299 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d62a744-e027-428c-a262-543c1fc36651 req-8a0bc97a-59fc-413b-95f7-bccb654a34c4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:31.575786 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d62a744-e027-428c-a262-543c1fc36651 req-8a0bc97a-59fc-413b-95f7-bccb654a34c4 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0517731 Dec 21 05:13:31.623864 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0d62a744-e027-428c-a262-543c1fc36651 req-a83ba72c-20b9-429d-9db4-d8568c187a08 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422163 Dec 21 05:13:32.739692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b776dd-98d5-43d6-b1b9-ea4dd02c4c30 req-5d82601f-aa23-4a9b-86ee-fe991accdde6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:32.741150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8b776dd-98d5-43d6-b1b9-ea4dd02c4c30 req-5d82601f-aa23-4a9b-86ee-fe991accdde6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0486550 Dec 21 05:13:32.789032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a8b776dd-98d5-43d6-b1b9-ea4dd02c4c30 req-78819105-ab47-49bd-aeeb-a4d7ccbce4dc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420818 Dec 21 05:13:32.857122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-4dad945e-20f6-468c-81a2-56fe996aab26 req-6c1b8ddd-f48b-4e67-9577-ed8bfea0b3d1 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:13:32.858113 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4dad945e-20f6-468c-81a2-56fe996aab26 req-6c1b8ddd-f48b-4e67-9577-ed8bfea0b3d1 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0060191 Dec 21 05:13:33.108057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:13:33.186341 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:33.208258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:13:33.210454 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65ff1e0c-6951-4ed4-bb68-91fc71b50796" -d '{"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-unplugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:13:33.223421 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:33.242126 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 21 Dec 2021 05:13:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0e68cbc-439c-4303-a345-4768f337f559 x-openstack-request-id: req-b0e68cbc-439c-4303-a345-4768f337f559 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:13:33.242421 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-unplugged", "status": "failed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "code": 422}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:13:33.242706 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b0e68cbc-439c-4303-a345-4768f337f559 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:13:33.243136 n-d-822053-11 neutron-server[110312]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'code': 422} returned with failed status Dec 21 05:13:33.291933 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:33.338595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:34.153159 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97e788f-423f-4e35-8422-bd061d86e3cf req-1ed763d2-4f49-4bc7-a8fd-17d61b8cd309 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:34.154778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c97e788f-423f-4e35-8422-bd061d86e3cf req-1ed763d2-4f49-4bc7-a8fd-17d61b8cd309 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0539017 Dec 21 05:13:34.204250 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c97e788f-423f-4e35-8422-bd061d86e3cf req-a484e234-9179-4a29-b806-2e3b244d9a9b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434163 Dec 21 05:13:34.613064 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-1118bad8-4ab1-4a1f-8928-d7eaa08909f7 service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0811248 Dec 21 05:13:35.320369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4b5869-e21c-4128-82a8-1679aa14d4f5 req-1a0d08fe-03f5-4c13-ac11-c9f4045b6358 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:35.321848 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c4b5869-e21c-4128-82a8-1679aa14d4f5 req-1a0d08fe-03f5-4c13-ac11-c9f4045b6358 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0491953 Dec 21 05:13:35.373425 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4c4b5869-e21c-4128-82a8-1679aa14d4f5 req-deb7125f-df3d-4f09-8868-fa1778ca3909 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454633 Dec 21 05:13:35.867344 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-f831eba1-87b9-4a62-b62c-ca73fb20f6c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:35.868801 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-f831eba1-87b9-4a62-b62c-ca73fb20f6c9 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48&tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 1096 time: 0.0863883 Dec 21 05:13:35.879802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-5c9c80b7-1b9a-4077-a6fe-8f6b3d53cd48 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:13:35.880725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-5c9c80b7-1b9a-4077-a6fe-8f6b3d53cd48 service neutron] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048251 Dec 21 05:13:35.898443 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Request body: {'port': {'binding:host_id': 'n-h1-822053-11', 'device_owner': 'compute:nova'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:13:35.953808 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:36.150321 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:36.181947 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h2-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:13:36.212884 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:13:36.220857 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:36.232404 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Transition to ACTIVE for port object 6652b6d3-003f-4d37-afc5-107d726e7cec will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:13:36.298060 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:36.374771 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=9']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:36.389662 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.390017 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.390357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.390703 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.391077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.391414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.391747 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.392078 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.392409 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.392745 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.393077 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.393402 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.393726 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:13:36.433464 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] No DVR routers for this DVR port 6652b6d3-003f-4d37-afc5-107d726e7cec on host n-h2-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:13:36.500826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70861c18-cd82-4215-8b2b-ae7e5c542e58 req-14939180-edbd-455d-901b-5a24803cb387 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:36.502554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70861c18-cd82-4215-8b2b-ae7e5c542e58 req-14939180-edbd-455d-901b-5a24803cb387 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 944 time: 0.0586898 Dec 21 05:13:36.551972 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-70861c18-cd82-4215-8b2b-ae7e5c542e58 req-a201df57-4199-40c8-bc14-ab00955c37cb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434234 Dec 21 05:13:36.574151 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:13:36.574505 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:13:36.574828 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:13:36.579147 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Port 6652b6d3-003f-4d37-afc5-107d726e7cec on network 645a6cd1-6742-4469-afd8-b9c3665fe576 not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:13:36.579468 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Attempting to bind port 6652b6d3-003f-4d37-afc5-107d726e7cec on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:13:36.584213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 13, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:13:36.584544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Checking segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:13:36.584923 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Bound using segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:13:36.585335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Bound port: 6652b6d3-003f-4d37-afc5-107d726e7cec, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:13:36.585685 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:36.650138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:13:36.653577 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:13:36.727142 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:36.760493 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:36.761186 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:36.762570 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] 10.222.0.54 "PUT /v2.0/ports/6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 1093 time: 0.8677166 Dec 21 05:13:36.763046 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:13:36.765291 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06d5c8a8-fda0-4e89-8813-0682c57861e3" -d '{"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:13:36.795184 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3efaf88d-ffa1-43e3-8d51-90d5536b329d service neutron] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=10']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:36.823377 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:13:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e5e84a75-b02a-4d59-b8dc-f5f9fb6adcac x-openstack-request-id: req-e5e84a75-b02a-4d59-b8dc-f5f9fb6adcac {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:13:36.823678 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:13:36.823989 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-e5e84a75-b02a-4d59-b8dc-f5f9fb6adcac {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:13:36.824404 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'status': 'completed', 'code': 200} Dec 21 05:13:36.854790 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-b0c52d99-dc24-4d2c-842a-4eef38237615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:36.856437 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-b0c52d99-dc24-4d2c-842a-4eef38237615 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1097 time: 0.0466609 Dec 21 05:13:37.220412 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-45632c01-1353-4388-b348-1c0468735ade service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.221794 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-45632c01-1353-4388-b348-1c0468735ade service neutron] 10.222.0.54 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.3574286 Dec 21 05:13:37.286370 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-71ee8e89-ae5a-47e8-92d8-e5dd10a93f57 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 999 time: 0.0557160 Dec 21 05:13:37.337999 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-06feb81a-c1bd-4e9b-9ecb-318b51469e79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.340041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-06feb81a-c1bd-4e9b-9ecb-318b51469e79 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0460746 Dec 21 05:13:37.387309 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-63093372-cd60-49af-a0ab-5c6e8bee678d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.388737 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-63093372-cd60-49af-a0ab-5c6e8bee678d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0418451 Dec 21 05:13:37.475826 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-5f1d3bb5-1dec-45cf-be4d-391c6fcd940d service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798295 Dec 21 05:13:37.567175 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-991aea24-f714-48e5-9fa8-8dd27b050d1e req-3de14d4e-a3ea-4dc0-94bb-ca445a43b1ab service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829108 Dec 21 05:13:37.668483 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f3fdf0-6597-4fdf-a723-1b2b1f5a2989 req-42524d4b-0548-43cf-8e79-46456d3645c2 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.669996 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07f3fdf0-6597-4fdf-a723-1b2b1f5a2989 req-42524d4b-0548-43cf-8e79-46456d3645c2 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0496140 Dec 21 05:13:37.720379 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-07f3fdf0-6597-4fdf-a723-1b2b1f5a2989 req-61c55b99-2394-4b96-b4f1-ed8e17a5f522 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440977 Dec 21 05:13:37.725537 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-2a9c7d5f-825d-4e29-b5ff-d56c8336155a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.727143 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-2a9c7d5f-825d-4e29-b5ff-d56c8336155a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1097 time: 0.0421319 Dec 21 05:13:37.823702 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-e2193707-68a4-440f-becb-409e98e11e20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.825175 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-e2193707-68a4-440f-becb-409e98e11e20 service neutron] 10.222.0.54 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0901346 Dec 21 05:13:37.894356 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-6125fd3b-fcba-445c-b993-e69777e8f328 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 999 time: 0.0623231 Dec 21 05:13:37.944339 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-9cbce0ad-2792-4978-a9b3-1577d810d0e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:37.945769 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-9cbce0ad-2792-4978-a9b3-1577d810d0e8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0442450 Dec 21 05:13:38.003210 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-661b8a7d-c217-451e-9c30-3ba3a3beefe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:38.005188 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-661b8a7d-c217-451e-9c30-3ba3a3beefe6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0508990 Dec 21 05:13:38.855639 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73cf92f-54fe-4d6d-baae-75e20ee0e603 req-49226a38-f479-4b53-b333-baef1b84c50c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:38.859588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d73cf92f-54fe-4d6d-baae-75e20ee0e603 req-49226a38-f479-4b53-b333-baef1b84c50c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0598829 Dec 21 05:13:38.917953 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d73cf92f-54fe-4d6d-baae-75e20ee0e603 req-02fe7ccb-63d2-4c65-8190-6abc56e2becf tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540235 Dec 21 05:13:40.042134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5279a98-771d-43c0-a2f3-a35c9fc5175a req-679eaff7-c859-43a4-a6a9-a96b7d6662aa tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:40.043778 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5279a98-771d-43c0-a2f3-a35c9fc5175a req-679eaff7-c859-43a4-a6a9-a96b7d6662aa tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0525305 Dec 21 05:13:40.095464 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5279a98-771d-43c0-a2f3-a35c9fc5175a req-4dc3cb07-cebf-4597-a4f5-c18c74059adb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457525 Dec 21 05:13:41.218617 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d7f7f35-9f8e-4403-be57-f4f26dd60420 req-2330a5c3-fa7c-4ffa-9cb8-d142612ea631 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:41.222154 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d7f7f35-9f8e-4403-be57-f4f26dd60420 req-2330a5c3-fa7c-4ffa-9cb8-d142612ea631 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0530248 Dec 21 05:13:41.271278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6d7f7f35-9f8e-4403-be57-f4f26dd60420 req-b278b489-4cfd-4761-98c4-b26f772e1959 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450466 Dec 21 05:13:42.406460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92072a6-51e5-42c7-b7f1-772f8c12fcfc req-570cf45e-d2a6-416a-9e3c-73ecfc47104b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:42.408151 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a92072a6-51e5-42c7-b7f1-772f8c12fcfc req-570cf45e-d2a6-416a-9e3c-73ecfc47104b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0557086 Dec 21 05:13:42.458883 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a92072a6-51e5-42c7-b7f1-772f8c12fcfc req-a0e584ce-e8d3-45ad-b621-be3edac108ab tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444505 Dec 21 05:13:43.580262 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24607d9e-c669-4986-a682-b273efed14d9 req-5da2aebd-c264-453a-998e-4541dc1bcbcc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:43.581799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24607d9e-c669-4986-a682-b273efed14d9 req-5da2aebd-c264-453a-998e-4541dc1bcbcc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0508900 Dec 21 05:13:43.632897 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-24607d9e-c669-4986-a682-b273efed14d9 req-8456dd28-2f19-42dc-bdcd-9a4c605ad43c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449798 Dec 21 05:13:44.772003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e968c38-2355-4317-869f-eaa4eab594f4 req-bb77fdb9-bd01-4c1b-9856-0a3dceb2c6e0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:44.773492 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e968c38-2355-4317-869f-eaa4eab594f4 req-bb77fdb9-bd01-4c1b-9856-0a3dceb2c6e0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0584908 Dec 21 05:13:44.825809 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0e968c38-2355-4317-869f-eaa4eab594f4 req-bedb6789-d5c0-4d6e-a28c-98c21a306ed5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454764 Dec 21 05:13:45.875061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:13:45.952668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca10b8a8-d754-414c-84c3-1cfd938bcef0 req-51b0159b-b854-4a1d-8b9c-f95e39262214 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:45.954317 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca10b8a8-d754-414c-84c3-1cfd938bcef0 req-51b0159b-b854-4a1d-8b9c-f95e39262214 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0581210 Dec 21 05:13:46.008699 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca10b8a8-d754-414c-84c3-1cfd938bcef0 req-9e90e492-d6b9-4062-a9bf-e78c8174782c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480468 Dec 21 05:13:47.131770 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebe2520-731c-4689-a3cb-a01c0ed37776 req-c9912a3d-bf5f-476a-8c96-8a80d874ffda tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:47.134257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ebe2520-731c-4689-a3cb-a01c0ed37776 req-c9912a3d-bf5f-476a-8c96-8a80d874ffda tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0510721 Dec 21 05:13:47.187957 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8ebe2520-731c-4689-a3cb-a01c0ed37776 req-a38a7227-5799-4f47-b7ff-fea065f6f76e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471337 Dec 21 05:13:48.072494 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-d458ece7-7f57-44ef-b51a-5ab0c0f2dce9 service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829465 Dec 21 05:13:48.166331 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-06d5c8a8-fda0-4e89-8813-0682c57861e3 req-420fb938-f6ce-4b2c-ac9e-df9d8f75c4e5 service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858676 Dec 21 05:13:48.304009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85be048-ff68-4d4e-92e0-ce14b7b3a99a req-9f632b78-72f8-4b15-8f13-ae4e81e17e7b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:48.305475 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85be048-ff68-4d4e-92e0-ce14b7b3a99a req-9f632b78-72f8-4b15-8f13-ae4e81e17e7b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0478439 Dec 21 05:13:48.353122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c85be048-ff68-4d4e-92e0-ce14b7b3a99a req-2cb78d11-b10f-412e-a091-d034a15f627a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412135 Dec 21 05:13:49.467572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7d6915-2597-4d6b-86b8-215c354798d6 req-14e7b866-18d3-4acb-8a4f-67b183c4db2a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:49.469040 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb7d6915-2597-4d6b-86b8-215c354798d6 req-14e7b866-18d3-4acb-8a4f-67b183c4db2a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 945 time: 0.0482340 Dec 21 05:13:49.517335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eb7d6915-2597-4d6b-86b8-215c354798d6 req-047d33d1-21c6-49b7-b0c3-32656e2691ed tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424721 Dec 21 05:13:49.966035 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2e8d622b-0df2-4b40-88ce-d3956973e9ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:50.256216 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:13:50.350497 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:50.360719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'port_id': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'mac_address': 'fa:16:3e:2d:20:ee', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:13:50.397242 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:50.410318 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:13:50.429068 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:50.485353 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:50.531232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=11']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:50.635527 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54209356-9c00-4217-b4e4-5d30445b16ae req-ad309a92-1898-4e38-bfe4-349cb4d3e08b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:50.637607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54209356-9c00-4217-b4e4-5d30445b16ae req-ad309a92-1898-4e38-bfe4-349cb4d3e08b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0528700 Dec 21 05:13:50.686268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-54209356-9c00-4217-b4e4-5d30445b16ae req-7f65cb00-de68-4884-96de-0bf6a8f93139 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427322 Dec 21 05:13:50.800937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['6652b6d3-003f-4d37-afc5-107d726e7cec'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:13:51.799700 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af37ceb-5a36-4be7-af85-f3540311ef41 req-6a935901-9d0e-4eeb-a79c-dee79a4073b9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:51.801062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9af37ceb-5a36-4be7-af85-f3540311ef41 req-6a935901-9d0e-4eeb-a79c-dee79a4073b9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 946 time: 0.0480917 Dec 21 05:13:51.848726 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9af37ceb-5a36-4be7-af85-f3540311ef41 req-47719a2b-5050-4be0-8d2a-df575316ae42 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418141 Dec 21 05:13:52.270252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:13:52.383336 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 6652b6d3-003f-4d37-afc5-107d726e7cec completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:13:52.388221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 6652b6d3-003f-4d37-afc5-107d726e7cec triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:13:52.388647 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:52.462279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:52.484116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:13:52.486367 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f840ee5d-36cf-44ef-a4b3-1e4db85a2b80" -d '{"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-plugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:13:52.499396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:13:52.522693 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:13:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d6c821e-2140-4803-ad85-55656020ee02 x-openstack-request-id: req-9d6c821e-2140-4803-ad85-55656020ee02 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:13:52.523017 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-plugged", "status": "completed", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:13:52.523281 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-9d6c821e-2140-4803-ad85-55656020ee02 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:13:52.523676 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'code': 200} Dec 21 05:13:52.560494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:52.610473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=12']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:13:52.760650 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fbc9cc7-668c-4a1f-ac54-2d207049525b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:52.784644 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1601227-5966-461f-a1a8-d4e93be4b076 req-c038e6f4-85f2-4a3e-8d23-576031cb051c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:52.786048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a1601227-5966-461f-a1a8-d4e93be4b076 req-c038e6f4-85f2-4a3e-8d23-576031cb051c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1099 time: 0.0405493 Dec 21 05:13:52.832619 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-a1601227-5966-461f-a1a8-d4e93be4b076 req-11b8589e-bcf7-4240-b721-2ac18f43a8af service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378458 Dec 21 05:13:52.963227 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2308b58d-76be-49de-9156-85d7eb456d5f req-04663016-f19c-4d06-bb02-53411fd29063 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:52.965193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2308b58d-76be-49de-9156-85d7eb456d5f req-04663016-f19c-4d06-bb02-53411fd29063 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 947 time: 0.0467114 Dec 21 05:13:53.017702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-2308b58d-76be-49de-9156-85d7eb456d5f req-c22f042d-aec2-4472-9688-2bb298e4b706 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465972 Dec 21 05:13:53.612502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:53.800981 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:54.138998 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9afc49ef-2075-4a2f-b578-a3f213451d0d req-5d7a9df5-4683-48c0-85a0-71c485c04ee1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:54.140476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9afc49ef-2075-4a2f-b578-a3f213451d0d req-5d7a9df5-4683-48c0-85a0-71c485c04ee1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 947 time: 0.0491297 Dec 21 05:13:54.190847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9afc49ef-2075-4a2f-b578-a3f213451d0d req-2e8463d9-5360-4188-b1bb-a7e15aa102ed tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443079 Dec 21 05:13:55.304387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1961b1ca-d03d-4679-9605-74d9a08e0838 req-ee79684f-0f33-4873-890d-f5ff22da444c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:13:55.305842 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1961b1ca-d03d-4679-9605-74d9a08e0838 req-ee79684f-0f33-4873-890d-f5ff22da444c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 947 time: 0.0475333 Dec 21 05:13:55.354956 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1961b1ca-d03d-4679-9605-74d9a08e0838 req-8ab6d44a-aeaa-4f8a-9bb9-cbc54fc56123 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419350 Dec 21 05:13:55.372896 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:55.514721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:13:55.806340 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:09.403453 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-1d745303-656d-4116-aed5-90c6326a7872 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0373433 Dec 21 05:14:09.513766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-ce12df0b-eb55-4a5d-ab81-194d60951865 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:14:09.515285 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-ce12df0b-eb55-4a5d-ab81-194d60951865 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1099 time: 0.0444314 Dec 21 05:14:09.617976 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-a174e112-be59-4e4b-834b-717a39c4b8cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:14:09.619510 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-a174e112-be59-4e4b-834b-717a39c4b8cd service neutron] 10.222.0.54 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0841894 Dec 21 05:14:09.689540 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-1a01dbef-cad8-4a5a-91ee-3e151b9284e0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 1001 time: 0.0623584 Dec 21 05:14:09.738990 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-9d95251d-9255-45b4-8ed8-b3a4956b7e73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:14:09.740396 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-9d95251d-9255-45b4-8ed8-b3a4956b7e73 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0431573 Dec 21 05:14:09.790604 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-eb776950-0f31-4b5c-8a7f-04ef9002fecc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:14:09.792158 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-eb776950-0f31-4b5c-8a7f-04ef9002fecc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0444894 Dec 21 05:14:09.886178 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-e1b44e2c-1eff-49b7-ba34-de888bd38e3d service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851367 Dec 21 05:14:09.977017 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-54170a57-6900-4b6a-ab76-18cfe100ee54 req-116b2fbe-4a0c-456e-ac54-bf78155c9878 service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814097 Dec 21 05:14:19.983949 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f3d720f-ff14-43d7-9d88-d7e83c15af9d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:22.754626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5f1bb52d-40da-4789-af20-48ed6e3ad638 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:22.874537 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:14:23.622077 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:23.817666 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:25.393163 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:25.547848 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:25.806063 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:49.977285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f928999-efb1-464d-9d54-d7ef8a2bf771 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:52.752797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc05ec4d-bbc1-41fd-abf0-5de04141dfa7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:53.623480 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:53.849996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:55.388884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:55.558149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:55.811459 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:14:59.874215 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:15:04.289799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53004) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:04.449389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Deleting port 0762950f-756e-4a70-b7a5-d867778f51dd {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:15:04.449732 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:04.523926 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:04.524254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:04.536327 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Calling delete_port for 0762950f-756e-4a70-b7a5-d867778f51dd owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:15:04.783570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:04.809436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event deleted for resources: {'Port': ['ID=0762950f-756e-4a70-b7a5-d867778f51dd,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:04.836039 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.836390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.836736 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.837080 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.837444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.837778 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.838106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.838434 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.838760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.839109 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.839435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.839760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.840082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:04.883070 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:04.883328 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Floating IP b375a2cd-46cd-4bd1-a485-bb07828aef82 disassociated (deleted). External IP: 172.25.5.64, port: 6652b6d3-003f-4d37-afc5-107d726e7cec. Dec 21 05:15:05.082132 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:15:05.187034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:15:05.191895 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:05.196440 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:15:05.208212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:15:05.208836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:14:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:15:05.221799 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-07fdf783-5cd1-45f3-96b2-1a65547ea11c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "DELETE /v2.0/floatingips/b375a2cd-46cd-4bd1-a485-bb07828aef82 HTTP/1.1" status: 204 len: 168 time: 0.9309912 Dec 21 05:15:05.222402 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:15:05.224720 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6fe9650-9672-4c36-b92c-bb0215da9fec" -d '{"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:15:05.267593 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:15:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-760ee775-74f0-4228-942c-edfd1523e12e x-openstack-request-id: req-760ee775-74f0-4228-942c-edfd1523e12e {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:15:05.267901 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:15:05.268159 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-760ee775-74f0-4228-942c-edfd1523e12e {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:15:05.268567 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'status': 'completed', 'code': 200} Dec 21 05:15:05.319541 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:15:05.353871 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-c4719758-7919-4e16-9e01-804f3808ca4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:05.355432 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-c4719758-7919-4e16-9e01-804f3808ca4c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 1099 time: 0.0463977 Dec 21 05:15:05.452357 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-6b1d987b-6756-43f4-b0ec-0054c87f6c3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:05.453755 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-6b1d987b-6756-43f4-b0ec-0054c87f6c3c service neutron] 10.222.0.54 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0853653 Dec 21 05:15:05.500041 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-006701c9-2e9f-434c-91ef-f31ea12d2363 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 200 len: 217 time: 0.0394316 Dec 21 05:15:05.524878 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:15:05.551061 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:15:05.553494 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-bbf891fa-e2b4-4320-9344-c7d3da6e548c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:05.555095 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-bbf891fa-e2b4-4320-9344-c7d3da6e548c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0481451 Dec 21 05:15:05.560011 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:15:05.560663 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:14:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:15:05.617335 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-1cdf5e13-7cda-4507-b594-e72c38d5214d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:05.618921 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-1cdf5e13-7cda-4507-b594-e72c38d5214d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0556650 Dec 21 05:15:05.700061 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4887a955-d228-4abc-8f2f-39be362a649a req-daca88e4-ff41-4172-aee8-a43112e16b1c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:05.703103 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4887a955-d228-4abc-8f2f-39be362a649a req-daca88e4-ff41-4172-aee8-a43112e16b1c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 947 time: 0.0555253 Dec 21 05:15:05.729376 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-97ef3727-013a-43cc-9413-84cd822fc64f service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1012046 Dec 21 05:15:05.757933 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4887a955-d228-4abc-8f2f-39be362a649a req-07dc0477-f6c8-43f7-843d-81e4f58695cb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482299 Dec 21 05:15:05.824423 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-e6fe9650-9672-4c36-b92c-bb0215da9fec req-1516270a-9f08-4d39-8fe2-2e1e6453ad9f service neutron] 10.222.0.54 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858536 Dec 21 05:15:05.855193 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:15:06.048123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:15:06.078570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9a9fd0-962d-4ba2-9c14-976de488eb7e None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:15:06.293676 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-394da609-2471-4d9d-bc00-a87c0f5f88f0 None None] New status for floating IP b375a2cd-46cd-4bd1-a485-bb07828aef82: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:15:06.874826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fdf6bb-523e-48dd-acc5-6b41ac8bb839 req-6ad7f4f9-25e7-4f45-bb11-6335ab0feee3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:06.876256 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52fdf6bb-523e-48dd-acc5-6b41ac8bb839 req-6ad7f4f9-25e7-4f45-bb11-6335ab0feee3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 947 time: 0.0494175 Dec 21 05:15:06.928389 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-52fdf6bb-523e-48dd-acc5-6b41ac8bb839 req-ce81bc84-2c98-49e2-8812-85bb7fec9b57 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=141091aa-eae9-463e-bc9d-4f14079e4d65&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450289 Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:distributed failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_router:ha failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:07.093504 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:15:07.097928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-523f28f9-aca8-42d2-918b-f28eb862c68a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:07.099406 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-523f28f9-aca8-42d2-918b-f28eb862c68a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.54 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 947 time: 0.0479407 Dec 21 05:15:07.192544 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Deleting port 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:15:07.192883 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:07.282625 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] For port 6652b6d3-003f-4d37-afc5-107d726e7cec, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=6652b6d3-003f-4d37-afc5-107d726e7cec,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:15:07.283006 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:07.299608 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Calling delete_port for 6652b6d3-003f-4d37-afc5-107d726e7cec owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:15:07.495572 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:07.526222 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event deleted for resources: {'Port': ['ID=6652b6d3-003f-4d37-afc5-107d726e7cec,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:07.536965 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.537313 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.537654 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.538016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.538367 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.538701 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.539053 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.539385 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.540128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.540128 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.540389 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.541107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.541107 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:07.581641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] No DVR routers for this DVR port 6652b6d3-003f-4d37-afc5-107d726e7cec on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:15:07.584239 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:07.587578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-49198edf-d2d2-41a3-9769-3a1dba8bc52e req-78e0d5fc-cc0f-4337-aa7d-0f6f0674508d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.54 "DELETE /v2.0/ports/6652b6d3-003f-4d37-afc5-107d726e7cec HTTP/1.1" status: 204 len: 173 time: 0.4804833 Dec 21 05:15:07.588019 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-deleted', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:15:07.590244 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f4c36f5-64a7-4f8d-bdf5-a27e0812e16f" -d '{"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-deleted", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:15:07.681471 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:15:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4cd11de6-9742-4365-914a-49cf60031d1d x-openstack-request-id: req-4cd11de6-9742-4365-914a-49cf60031d1d {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:15:07.681794 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "554fbedc-b7bd-4264-8173-833ec79bfe48", "name": "network-vif-deleted", "tag": "6652b6d3-003f-4d37-afc5-107d726e7cec", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:15:07.682049 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4cd11de6-9742-4365-914a-49cf60031d1d {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:15:07.682453 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '554fbedc-b7bd-4264-8173-833ec79bfe48', 'name': 'network-vif-deleted', 'tag': '6652b6d3-003f-4d37-afc5-107d726e7cec', 'status': 'completed', 'code': 200} Dec 21 05:15:08.041093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-143ffff6-0209-4538-9eb5-3de8c430f5e5 req-5d701aee-44c1-41c9-956e-866069c97261 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=554fbedc-b7bd-4264-8173-833ec79bfe48 HTTP/1.1" status: 200 len: 210 time: 0.0315499 Dec 21 05:15:09.100512 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53028) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:09.156529 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6488be30-7542-4874-8315-cd5996cdf38b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:09.181097 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6488be30-7542-4874-8315-cd5996cdf38b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:09.291614 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6488be30-7542-4874-8315-cd5996cdf38b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:09.294334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6488be30-7542-4874-8315-cd5996cdf38b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:09.296214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6488be30-7542-4874-8315-cd5996cdf38b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "DELETE /v2.0/security-groups/141091aa-eae9-463e-bc9d-4f14079e4d65 HTTP/1.1" status: 204 len: 168 time: 0.1946247 Dec 21 05:15:09.305243 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6488be30-7542-4874-8315-cd5996cdf38b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=141091aa-eae9-463e-bc9d-4f14079e4d65,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:10.803759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:15:10.823329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 6652b6d3-003f-4d37-afc5-107d726e7cec {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:15:10.823685 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 6652b6d3-003f-4d37-afc5-107d726e7cec not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:15:10.931804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53036) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:10.936561 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-185919578', 'description': 'tempest-secgroup-smoke-185919578 description', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:11.028765 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.093872 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.171208 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.197997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:11.265487 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.266745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b563ed7a-c20d-4a7a-9736-59ff16f8d6e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3339312 Dec 21 05:15:11.269579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53038) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:11.273909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '16e3d713-3ca7-4cfd-95e9-1bf09df78bf0', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:11.380673 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.437394 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.523942 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.541087 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2851422c-670e-4124-af64-cc4b21f6f44a,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:11.601905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.603224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-330f8244-7335-4233-91b5-2252a31e94ee tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3326724 Dec 21 05:15:11.605951 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53040) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:11.610396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '16e3d713-3ca7-4cfd-95e9-1bf09df78bf0', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:11.696490 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.751403 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.815059 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.832997 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c73cc711-e53f-46e9-b130-336feca1c268,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:11.891427 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:11.892696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dbb5c6bf-abb9-4ca3-b110-2ff81393168c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2857707 Dec 21 05:15:11.895514 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53042) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:11.899909 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '16e3d713-3ca7-4cfd-95e9-1bf09df78bf0', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:11.988723 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.042796 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.096857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.114126 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c6086512-6ce6-4feb-b78f-d450f4dc6abb,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:12.184707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.186576 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dd37257c-d1fa-49cb-9eed-40bee29d9266 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2894983 Dec 21 05:15:12.189239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53044) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:12.193579 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '16e3d713-3ca7-4cfd-95e9-1bf09df78bf0', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:12.272931 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.339330 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.411809 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.430195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d3fb449f-e674-409c-b9f1-32132eebaaa4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:12.510735 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.512053 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-64912830-7de7-49e3-846f-876a9e77d787 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3218625 Dec 21 05:15:12.514681 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53046) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:12.519211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '16e3d713-3ca7-4cfd-95e9-1bf09df78bf0', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:12.588843 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Project 449c18c6acb14eab9ae3cbb2fa4f9b75 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:15:12.594154 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.650701 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.718859 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.736563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bf5fa505-ec8a-4bd5-845f-88eec398aa85,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:12.796111 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.797305 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a1e24bd9-aadf-44c2-89d2-bc3ab1d16afd tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2816660 Dec 21 05:15:12.800028 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53048) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:15:12.804213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'security_group_rule': {'security_group_id': '16e3d713-3ca7-4cfd-95e9-1bf09df78bf0', 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:12.886074 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Project 449c18c6acb14eab9ae3cbb2fa4f9b75 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:15:12.891539 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:12.947759 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:13.006103 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:13.023741 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5826c60d-b29f-4c35-8bea-0e8625405ba7,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:13.093724 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:13.094955 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-dce76454-5df1-4144-9092-089e643497ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2940176 Dec 21 05:15:20.006327 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5a6e9f30-adb5-418f-a83a-3cf301d9090f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:23.369300 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b51c8f64-3ca3-49d2-9ebc-9565fd5ba344 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:23.626393 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:23.840355 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:25.423225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:25.563697 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:25.828608 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:33.914188 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-33914543-1f45-4cac-946b-723cfe40cde6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-185919578&fields=id&tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 267 time: 0.0505238 Dec 21 05:15:34.021329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-97a92f73-49b6-43a3-aa72-6675b4a1a0e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:34.022798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-97a92f73-49b6-43a3-aa72-6675b4a1a0e9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 808 time: 0.1017914 Dec 21 05:15:34.037330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-270a2afc-9e18-4e38-a2e8-bee7586650e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/quotas/449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 375 time: 0.0087571 Dec 21 05:15:34.087619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-7be6bee7-2c45-4961-8378-40dffb1ca72c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0450788 Dec 21 05:15:34.230340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-ef3863ed-1a1a-4467-8555-8c6fea93d336 service neutron] 10.222.0.18 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1315231 Dec 21 05:15:34.318117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-df56fde9-1bbb-4ccb-9d57-f6b4b4124764 service neutron] 10.222.0.18 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817013 Dec 21 05:15:34.908403 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-afa4200d-56c2-42f2-b969-886b3c774e09 req-4e2ddb45-7f8b-4bbd-8605-d1a290c8af24 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0295436 Dec 21 05:15:35.986091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9eaea45f-c6ef-412d-9ebd-f5c2c2b521c6 req-6391afc1-f82a-4c86-8f52-547ca32a8a84 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0272779 Dec 21 05:15:36.873996 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:15:37.064761 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5f4c93ab-6b37-49b0-8e62-ddfbc19cddb1 req-a6069d46-466f-4cdf-b647-37fbe01a4413 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0260959 Dec 21 05:15:38.140640 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e36a27f2-64f3-477b-8f2b-561cfcfec633 req-a5167104-bfee-4770-a915-5b5fda5fdd1b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0253141 Dec 21 05:15:39.236454 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6b3f11c1-07ec-4769-baf9-45780be43d90 req-9ee79111-9e3f-4882-89b7-9cffc129f705 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0254095 Dec 21 05:15:40.330191 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5207baaa-e278-4dae-bbc3-394a440708ab req-b046b1c4-431f-4390-a7ed-3371dc2eac4c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0262463 Dec 21 05:15:41.183668 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-d432b1d2-ad7f-468d-8da4-2ec764349cd1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:41.185105 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-d432b1d2-ad7f-468d-8da4-2ec764349cd1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 808 time: 0.1048028 Dec 21 05:15:41.263236 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-3be01d73-fe83-4c71-aeee-a2b6be75601a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 379 time: 0.0531037 Dec 21 05:15:41.273027 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'port': {'device_id': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'admin_state_up': True, 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'security_groups': ['16e3d713-3ca7-4cfd-95e9-1bf09df78bf0']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:41.431173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f55abda9-8390-4377-aff2-24e4265f47d8 req-5bef96c1-0f85-4f23-8a64-b38c14842f6f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0257990 Dec 21 05:15:41.462851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Made reservation on behalf of 449c18c6acb14eab9ae3cbb2fa4f9b75 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:15:41.466446 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:41.595996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Allocated IP 172.20.0.13 (645a6cd1-6742-4469-afd8-b9c3665fe576/65e74147-5f7e-4b8c-956b-aec144967429/6f3caea7-f5dc-4568-b257-5093de789fb2) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:15:41.732374 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:41.849441 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:41.898648 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:15:41.901663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:15:41.905411 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:15:41.929671 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:41.959642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:41.960269 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.035277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b8fb2876-3939-4d74-ba44-af426f60d707 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7656674 Dec 21 05:15:42.061347 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Request body: {'port': {'device_id': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:15:42.119139 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.200264 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-6265acec-2223-4226-87f1-da7f95c25cec None None] Provisioning complete for port 6f3caea7-f5dc-4568-b257-5093de789fb2 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:15:42.200882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6265acec-2223-4226-87f1-da7f95c25cec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.239409 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-6265acec-2223-4226-87f1-da7f95c25cec None None] Port 6f3caea7-f5dc-4568-b257-5093de789fb2 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:15:42.387900 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f3caea7-f5dc-4568-b257-5093de789fb2 {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:15:42.395206 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.406874 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Transition to ACTIVE for port object 6f3caea7-f5dc-4568-b257-5093de789fb2 will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:15:42.480367 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.561722 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:42.631305 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e7d525-e055-48c3-b784-79c3a7fcaba8 req-beded887-ff2c-4f19-b62c-e5ea32855b53 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:42.631695 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04e7d525-e055-48c3-b784-79c3a7fcaba8 req-beded887-ff2c-4f19-b62c-e5ea32855b53 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.1243865 Dec 21 05:15:42.676368 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Attempting to bind port 6f3caea7-f5dc-4568-b257-5093de789fb2 on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:15:42.676710 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Attempting to bind port 6f3caea7-f5dc-4568-b257-5093de789fb2 by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:15:42.677045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Attempting to bind port 6f3caea7-f5dc-4568-b257-5093de789fb2 on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:15:42.695891 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Port 6f3caea7-f5dc-4568-b257-5093de789fb2 on network 645a6cd1-6742-4469-afd8-b9c3665fe576 not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:15:42.696223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Attempting to bind port 6f3caea7-f5dc-4568-b257-5093de789fb2 on network 645a6cd1-6742-4469-afd8-b9c3665fe576 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:15:42.705864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 15, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:15:42.706239 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Checking segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:15:42.706630 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Bound using segment: {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:15:42.707103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Bound port: 6f3caea7-f5dc-4568-b257-5093de789fb2, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c28886ab-df75-4037-9026-f1cc95da771c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:15:42.707466 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.712979 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-04e7d525-e055-48c3-b784-79c3a7fcaba8 req-478c5db2-4ae6-4d9b-a9be-41c2efcca4f8 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0715735 Dec 21 05:15:42.779759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:15:42.782844 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:15:42.861302 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.904864 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:42.906002 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:42.907279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] 10.222.0.31 "PUT /v2.0/ports/6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 1093 time: 0.8502700 Dec 21 05:15:42.907609 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:15:42.910610 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ed27f7f-9923-4745-beed-ce7ee47e66c9" -d '{"events": [{"name": "network-changed", "server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:15:42.956440 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6f3fe2-6c31-4a8b-8524-62bafa46aeb7 service neutron] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:43.073290 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:15:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de14bbba-85f6-419a-952c-379c91823320 x-openstack-request-id: req-de14bbba-85f6-419a-952c-379c91823320 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:15:43.073603 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:15:43.073854 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-de14bbba-85f6-419a-952c-379c91823320 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:15:43.074240 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'status': 'completed', 'code': 200} Dec 21 05:15:43.091566 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-0e3bc7c4-be4a-402d-badb-172490f0a245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:43.093192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-0e3bc7c4-be4a-402d-badb-172490f0a245 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1096 time: 0.0541542 Dec 21 05:15:43.149136 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-b50e6001-7b46-4565-8f12-aa4ccf050c69 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 217 time: 0.0363283 Dec 21 05:15:43.201739 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-77e16b38-99b8-4391-9f60-d123bb9e31b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:43.203322 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-77e16b38-99b8-4391-9f60-d123bb9e31b3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0471990 Dec 21 05:15:43.257848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-5169823d-e592-4a48-8e5d-333de18eb8f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:43.259445 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-5169823d-e592-4a48-8e5d-333de18eb8f1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0442691 Dec 21 05:15:43.359004 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-5a8b31fe-bd9d-4d4d-9526-910ad05f33a0 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868056 Dec 21 05:15:43.462588 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f13f7805-4d64-4805-87b0-94b629caa1e2 req-30b578e7-8971-40bb-b2a6-48324b85224d service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917866 Dec 21 05:15:43.655519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-969ef090-7222-4148-bc66-f4a6a3f6546a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:43.657026 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-969ef090-7222-4148-bc66-f4a6a3f6546a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1096 time: 0.0422292 Dec 21 05:15:43.767800 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-9ce6573b-710e-40ef-a62b-c5d595193493 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:43.770276 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-9ce6573b-710e-40ef-a62b-c5d595193493 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.1007433 Dec 21 05:15:43.853886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-cf5f39d4-2e33-4e3d-afb0-78fd477b1489 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 217 time: 0.0708504 Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:15:43.901679 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:15:43.905939 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f21002-1792-4f17-9a95-0b46d517cbd6 req-929c4845-b4a0-4ab3-9e12-a1d517ba9c5f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:43.906453 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b9f21002-1792-4f17-9a95-0b46d517cbd6 req-929c4845-b4a0-4ab3-9e12-a1d517ba9c5f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.1122208 Dec 21 05:15:44.232484 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-663687fe-54cc-4959-94f4-2204285e4ff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:44.233925 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-663687fe-54cc-4959-94f4-2204285e4ff0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.3693442 Dec 21 05:15:44.282504 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b9f21002-1792-4f17-9a95-0b46d517cbd6 req-e77c3687-98c2-4137-bbec-8aca9e3060c5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3681235 Dec 21 05:15:44.295861 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-33bb248a-035e-4a36-b7b5-b9e966179533 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:44.297330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-33bb248a-035e-4a36-b7b5-b9e966179533 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0493922 Dec 21 05:15:44.395535 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-9c314ed2-92aa-490e-b54a-8399f102d6e9 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861104 Dec 21 05:15:44.487660 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1ed27f7f-9923-4745-beed-ce7ee47e66c9 req-9a669346-d2b3-42c2-802f-3f1b68370e10 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816090 Dec 21 05:15:45.403192 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1604d213-ccf8-44a4-9f5d-101c4a181678 req-a4ebff18-1cd0-4187-824a-14e7dc163e3d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:45.404951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1604d213-ccf8-44a4-9f5d-101c4a181678 req-a4ebff18-1cd0-4187-824a-14e7dc163e3d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0533733 Dec 21 05:15:45.460339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1604d213-ccf8-44a4-9f5d-101c4a181678 req-c9bc4f18-c20b-4c21-8f7f-34d5a160b209 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482178 Dec 21 05:15:46.576067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac88048-c3ae-48ce-b3ac-287cbe383577 req-4398166e-dc40-4309-8585-f7ae9684bab6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:46.577528 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cac88048-c3ae-48ce-b3ac-287cbe383577 req-4398166e-dc40-4309-8585-f7ae9684bab6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0480716 Dec 21 05:15:46.631685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cac88048-c3ae-48ce-b3ac-287cbe383577 req-6e4ce478-8ede-4cb7-a2cf-5ba2fc832f37 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480974 Dec 21 05:15:47.795328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12d88a0-4843-45e7-9341-e329699f341a req-e92e8dab-f220-43b4-ad93-24cbb0d9267b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:47.796792 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a12d88a0-4843-45e7-9341-e329699f341a req-e92e8dab-f220-43b4-ad93-24cbb0d9267b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0473928 Dec 21 05:15:47.851231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a12d88a0-4843-45e7-9341-e329699f341a req-4a7e5c6c-1ccc-4e46-b9d1-48a8c120d5f8 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473690 Dec 21 05:15:48.969902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a721ea40-5ff1-4c6c-b7c5-b3aafdad318d req-3e033d38-c6e3-4de4-8837-ecd61a311fa5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:48.971414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a721ea40-5ff1-4c6c-b7c5-b3aafdad318d req-3e033d38-c6e3-4de4-8837-ecd61a311fa5 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0518222 Dec 21 05:15:49.019459 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a721ea40-5ff1-4c6c-b7c5-b3aafdad318d req-734f5dfd-88b5-42fc-97ee-36c9ac0991ad tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416448 Dec 21 05:15:49.985681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5ee8de40-02f3-4571-9800-efc24463e11f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:50.131267 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db2f9db-1570-4582-b4a9-01ca6006095a req-f4535f15-d60b-4480-bb8a-34c8cf9fa60d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:50.132733 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3db2f9db-1570-4582-b4a9-01ca6006095a req-f4535f15-d60b-4480-bb8a-34c8cf9fa60d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0481303 Dec 21 05:15:50.180374 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3db2f9db-1570-4582-b4a9-01ca6006095a req-cdd4c983-f8b4-4a08-aa0a-8693068c186b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417700 Dec 21 05:15:51.292436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ca4a58-b18c-46d2-a7dd-96840ecd81cd req-157ed3a5-c527-4536-b137-28e2b05d0d08 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:51.293894 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09ca4a58-b18c-46d2-a7dd-96840ecd81cd req-157ed3a5-c527-4536-b137-28e2b05d0d08 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0470886 Dec 21 05:15:51.345421 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-09ca4a58-b18c-46d2-a7dd-96840ecd81cd req-e511acdc-c952-496d-ac6f-cc3dcbd9b263 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456197 Dec 21 05:15:52.461018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1236bc-7f79-464c-806a-f55e107627d3 req-8f587304-eed5-456c-9be7-ba210c96fa93 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:52.462491 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db1236bc-7f79-464c-806a-f55e107627d3 req-8f587304-eed5-456c-9be7-ba210c96fa93 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0494566 Dec 21 05:15:52.511073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db1236bc-7f79-464c-806a-f55e107627d3 req-848e3d50-acb9-4ab6-8067-abb4ac598d0b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426879 Dec 21 05:15:52.748120 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41f70cef-fe32-45c0-997e-503aa7dd6a11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:53.625301 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10bd21-8556-4d93-8382-eca4621a5b5d req-08372abb-6870-4604-8c10-c7b58b53169a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:53.626849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef10bd21-8556-4d93-8382-eca4621a5b5d req-08372abb-6870-4604-8c10-c7b58b53169a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0490241 Dec 21 05:15:53.629204 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:53.676751 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ef10bd21-8556-4d93-8382-eca4621a5b5d req-7fa8e23d-b68b-48b8-af22-8215c8d2e112 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425222 Dec 21 05:15:53.835463 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:54.794342 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0803358-5b56-4539-9de3-3d09a7b3a7de req-c8e9695d-9ebc-4e87-9c5c-d5883ad469a1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:54.795849 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0803358-5b56-4539-9de3-3d09a7b3a7de req-c8e9695d-9ebc-4e87-9c5c-d5883ad469a1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0520911 Dec 21 05:15:54.845829 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d0803358-5b56-4539-9de3-3d09a7b3a7de req-ac6639cf-e65c-4d8f-a780-26687f6ff29a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440104 Dec 21 05:15:55.402710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:55.551481 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:55.833827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:55.962119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82fd7e43-196a-465d-84a9-5858b51c5a71 req-539e1425-118e-4067-a7c3-baff9915d17a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:55.963625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82fd7e43-196a-465d-84a9-5858b51c5a71 req-539e1425-118e-4067-a7c3-baff9915d17a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0485642 Dec 21 05:15:56.012032 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-82fd7e43-196a-465d-84a9-5858b51c5a71 req-54749b6e-07d0-45ca-9a6c-dd3d7580be9c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425422 Dec 21 05:15:57.132822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e313694-3054-4445-bf6a-6b78fd852f6b req-2b042fbe-3b51-4b0d-9df4-e51ade96ec2d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:57.134296 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e313694-3054-4445-bf6a-6b78fd852f6b req-2b042fbe-3b51-4b0d-9df4-e51ade96ec2d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0520630 Dec 21 05:15:57.182219 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7e313694-3054-4445-bf6a-6b78fd852f6b req-93cb0782-c6ee-4ab7-986f-0e089ef0985e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420043 Dec 21 05:15:57.875681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:15:57.970275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:15:57.982100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'port_id': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'mac_address': 'fa:16:3e:68:ed:44', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:15:58.022136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:58.038126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f3caea7-f5dc-4568-b257-5093de789fb2 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:15:58.058370 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:15:58.148509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:15:58.195201 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:15:58.202286 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.202634 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.203064 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.203413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.203748 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.204077 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.204404 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.204730 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.205053 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.205374 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.205697 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.206569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.206889 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:15:58.304140 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bbedc7-a3dd-4e95-adb4-7de1cf6ba78b req-1de6ade7-f9b1-41f5-814a-3747210dd757 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:58.305624 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6bbedc7-a3dd-4e95-adb4-7de1cf6ba78b req-1de6ade7-f9b1-41f5-814a-3747210dd757 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 945 time: 0.0558009 Dec 21 05:15:58.353963 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a6bbedc7-a3dd-4e95-adb4-7de1cf6ba78b req-933877cf-31d9-4831-8766-19766a7f670a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424364 Dec 21 05:15:58.531326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6f3caea7-f5dc-4568-b257-5093de789fb2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:15:59.470122 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec78551c-1f7d-41af-ba7c-7762c6d851c8 req-87dd2bda-2f73-490f-adc5-f5592f9f265c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:15:59.472173 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec78551c-1f7d-41af-ba7c-7762c6d851c8 req-87dd2bda-2f73-490f-adc5-f5592f9f265c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 945 time: 0.0514977 Dec 21 05:15:59.523292 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ec78551c-1f7d-41af-ba7c-7762c6d851c8 req-b003b9a5-810c-4fbc-a13a-6e64b0f9b254 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452166 Dec 21 05:15:59.907852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:16:00.022832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port 6f3caea7-f5dc-4568-b257-5093de789fb2 completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:16:00.027447 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 6f3caea7-f5dc-4568-b257-5093de789fb2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:16:00.032364 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:00.106027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:00.129224 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:16:00.131483 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49c45b8d-82c7-4dbe-a817-0fbd28bb5e29" -d '{"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-plugged", "status": "completed", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:16:00.144371 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:16:00.168011 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:16:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-579ed1df-81f6-4eb3-98db-c17d67717345 x-openstack-request-id: req-579ed1df-81f6-4eb3-98db-c17d67717345 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:16:00.168305 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-plugged", "status": "completed", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:16:00.168589 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-579ed1df-81f6-4eb3-98db-c17d67717345 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:16:00.168990 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'code': 200} Dec 21 05:16:00.225657 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:00.274113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:16:00.312146 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a3dda2-c059-4d3c-991b-ca2b1c30e643 req-0c4ce88e-36ee-473e-8788-fdb98634dd7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:00.313636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84a3dda2-c059-4d3c-991b-ca2b1c30e643 req-0c4ce88e-36ee-473e-8788-fdb98634dd7b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0400851 Dec 21 05:16:00.358575 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-84a3dda2-c059-4d3c-991b-ca2b1c30e643 req-293f2608-880b-4a0b-a88f-0bd035a67417 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379541 Dec 21 05:16:00.722094 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae58893d-226a-4675-8cbf-5f9e21c7cc64 req-8d90179b-d012-4eed-b820-012ea5a5496a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:00.722094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae58893d-226a-4675-8cbf-5f9e21c7cc64 req-8d90179b-d012-4eed-b820-012ea5a5496a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0515311 Dec 21 05:16:00.722094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ae58893d-226a-4675-8cbf-5f9e21c7cc64 req-14ecea24-710d-4986-bc1a-479822b03a99 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442059 Dec 21 05:16:01.812462 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c74363-5080-43de-92aa-d5e15124143c req-f1b6cc39-a853-49b9-85af-01f41b27fede tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:01.813959 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c74363-5080-43de-92aa-d5e15124143c req-f1b6cc39-a853-49b9-85af-01f41b27fede tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0528035 Dec 21 05:16:01.863101 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b0c74363-5080-43de-92aa-d5e15124143c req-f86cd367-552e-4ee0-b1ed-24db396b591a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423760 Dec 21 05:16:01.988042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1900d944-e8c0-4137-94e2-3cf688ce9c72 req-3ba06f1b-25fb-4de4-aea2-6013a6c7c4ff tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:01.989777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1900d944-e8c0-4137-94e2-3cf688ce9c72 req-3ba06f1b-25fb-4de4-aea2-6013a6c7c4ff tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0486190 Dec 21 05:16:02.038224 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1900d944-e8c0-4137-94e2-3cf688ce9c72 req-179206f4-bd35-4274-bf4f-6ebd59f2a8d6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425363 Dec 21 05:16:02.058921 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53290) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:16:02.097091 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38bffa12-9fe8-40bc-aabb-14d3763d92af tempest-TestShelveInstance-404619495 tempest-TestShelveInstance-404619495-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:02.098545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-38bffa12-9fe8-40bc-aabb-14d3763d92af tempest-TestShelveInstance-404619495 tempest-TestShelveInstance-404619495-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1093 time: 0.0386546 Dec 21 05:16:02.101256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:16:02.105586 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address': '172.20.0.13'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:16:02.187015 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:02.287006 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:02.392211 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Allocated IP 172.25.5.60 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/cfd4199d-308c-49f8-9137-3dcc20bfcb55) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:16:02.490063 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:02.574654 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:02.612587 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:16:02.615756 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:16:02.619198 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:16:02.646528 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'Port': ['ID=cfd4199d-308c-49f8-9137-3dcc20bfcb55,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:16:02.978674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:03.103687 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:03.253962 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:03.314254 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:03.386164 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event updated for resources: {'Port': ['ID=cfd4199d-308c-49f8-9137-3dcc20bfcb55,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:16:03.398883 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:03.507096 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Floating IP a48332f2-af0e-4b85-90dd-5a148b739d99 associated. External IP: 172.25.5.60, port: 6f3caea7-f5dc-4568-b257-5093de789fb2. Dec 21 05:16:03.727937 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:16:03.835328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:16:03.844686 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:16:03.854392 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:16:03.855115 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:16:03.916031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:03.943526 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f169979a-f970-4a27-886e-3c77618d591c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8411899 Dec 21 05:16:03.944138 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:16:03.946474 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd" -d '{"events": [{"name": "network-changed", "server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:16:03.967764 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:16:03.993562 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:16:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03959693-c891-4203-a7d1-84b7511dc3b0 x-openstack-request-id: req-03959693-c891-4203-a7d1-84b7511dc3b0 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:16:03.994097 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:16:03.994097 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-03959693-c891-4203-a7d1-84b7511dc3b0 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:16:03.994500 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'status': 'completed', 'code': 200} Dec 21 05:16:04.086304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-ee535b3e-9c93-47d4-b317-4a9acaacbbc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:04.087867 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-ee535b3e-9c93-47d4-b317-4a9acaacbbc4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0468981 Dec 21 05:16:04.181005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-4262ea28-015b-40a4-bfd3-a81fd5ed4789 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:04.182499 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-4262ea28-015b-40a4-bfd3-a81fd5ed4789 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0877366 Dec 21 05:16:04.207488 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a48332f2-af0e-4b85-90dd-5a148b739d99', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'floating_ip_address': '172.25.5.60', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'port_id': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4351, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'mac_address': 'fa:16:3e:68:ed:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:16:02Z', 'updated_at': '2021-12-21T05:16:02Z', 'revision_number': 0, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:16:04.233013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:16:04.242069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:16:04.242623 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:15:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:16:04.248355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-8da4f0d0-2b51-40f4-9cb7-cfc78bb5f048 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 999 time: 0.0590384 Dec 21 05:16:04.298699 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-0789a688-8bf7-4ddf-a445-dd1dd9e051a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:04.303119 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-0789a688-8bf7-4ddf-a445-dd1dd9e051a8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0465777 Dec 21 05:16:04.353515 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-f22ce144-1293-41b9-919c-a4c831112f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:04.355117 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-f22ce144-1293-41b9-919c-a4c831112f64 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0457273 Dec 21 05:16:04.358638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:16:04.446092 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-4c074bca-e28e-4633-8d3d-c1abbdbb6062 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842133 Dec 21 05:16:04.539707 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-68cbd4c2-521a-47a5-a8ea-3da8aef83cbd req-85f055bd-1f61-4351-98cc-20be9566e7bb service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858450 Dec 21 05:16:04.581627 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a48332f2-af0e-4b85-90dd-5a148b739d99', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'floating_ip_address': '172.25.5.60', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'port_id': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4351, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'mac_address': 'fa:16:3e:68:ed:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:16:02Z', 'updated_at': '2021-12-21T05:16:02Z', 'revision_number': 0, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:16:04.613097 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28d3f50a-b30c-42c7-b800-a3084f7583e5 None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'a48332f2-af0e-4b85-90dd-5a148b739d99', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'floating_ip_address': '172.25.5.60', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'port_id': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4351, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'mac_address': 'fa:16:3e:68:ed:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:16:02Z', 'updated_at': '2021-12-21T05:16:02Z', 'revision_number': 0, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:16:04.808928 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44c1dbe3-36fa-41cf-b4b4-ffbe6fb90038 None None] New status for floating IP a48332f2-af0e-4b85-90dd-5a148b739d99: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:16:13.874332 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:16:19.962595 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-14376528-7e59-47d6-bb7d-b5ed069417f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:22.748457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a18e29a5-3037-4e2c-ba7e-e59323e1ee9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:23.662793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:23.834245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:25.413857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:25.562238 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:25.819447 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:49.985020 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a76bec7-8eb3-417d-9048-5df5830ea4b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:50.698036 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-d093e27d-80b0-4785-a002-b234758669ea service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0390506 Dec 21 05:16:50.814105 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-110e5ede-6f7d-408c-8cff-4f47369917a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:50.815670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-110e5ede-6f7d-408c-8cff-4f47369917a4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0406933 Dec 21 05:16:50.873815 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:16:50.922916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-6dc3c05b-c248-41d6-93b8-ffc63ec5b304 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:50.924410 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-6dc3c05b-c248-41d6-93b8-ffc63ec5b304 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0896409 Dec 21 05:16:50.990301 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-db7e5674-8675-44ac-a857-e16b4e85a69e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 1001 time: 0.0571418 Dec 21 05:16:51.046391 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-22c31691-539e-43ad-b08c-85aaf0540bf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:51.047843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-22c31691-539e-43ad-b08c-85aaf0540bf5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0467529 Dec 21 05:16:51.097088 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-bca827cb-a3ec-418d-ac03-e31ae97ba32d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:16:51.098607 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-bca827cb-a3ec-418d-ac03-e31ae97ba32d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0394158 Dec 21 05:16:51.189027 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-7adbfe29-ad26-4722-95af-48995cd791dc service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812726 Dec 21 05:16:51.290693 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5dda400e-b786-472d-b7c0-e2110ac7ce62 req-b97a6d5f-3216-494f-ad04-b9c5468e2402 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902541 Dec 21 05:16:52.748131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0dc565f4-77b2-48c0-8594-8499e78a3167 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:53.636223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:53.818689 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:55.424737 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:55.605313 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:16:55.841613 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:19.966996 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0cbd8ed4-1c7e-4bd6-960e-04d99802d6cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:22.749827 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5ea7c177-97f0-4dfb-b98f-c9bc922e8de5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:23.639555 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:23.844960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:25.429603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:25.532293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:25.800922 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:27.873111 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:17:49.993834 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f915d30f-964e-4e4a-b5c0-04d099a7358e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:50.748645 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-5e4dd0e3-ab69-4ea2-aa7a-365c6a167023 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0770802 Dec 21 05:17:50.865183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-80c7ab93-64d8-40e3-9be5-04cba0d35658 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:17:50.866625 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-80c7ab93-64d8-40e3-9be5-04cba0d35658 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0390193 Dec 21 05:17:51.266848 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-6efd0c8e-b361-4bee-924f-713dbabd8d8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:17:51.268355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-6efd0c8e-b361-4bee-924f-713dbabd8d8e service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.3810363 Dec 21 05:17:51.338000 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-2f9b0b62-3cdf-4b85-94ea-9e80845b80fb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 1001 time: 0.0572519 Dec 21 05:17:51.394506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-df38f9a7-0a3c-4979-854f-e5c5323ecf07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:17:51.396073 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-df38f9a7-0a3c-4979-854f-e5c5323ecf07 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0465612 Dec 21 05:17:51.440783 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-18a32c9d-1462-4f4f-9cde-6bcfd83fc5b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:17:51.442241 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-18a32c9d-1462-4f4f-9cde-6bcfd83fc5b8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0387492 Dec 21 05:17:51.536329 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-12d199c3-e1dd-4523-8d00-408d3dc7b649 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844522 Dec 21 05:17:51.634557 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e9869d9f-f927-47dd-bcda-ed1eb50c074c req-dd2133d1-8e13-4b04-b1ad-f5517af11d34 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839427 Dec 21 05:17:52.752940 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d0fc78e7-b07b-4e92-8512-e8048eaa19bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:53.644692 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:53.856082 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:55.429078 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:55.577536 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:17:55.824159 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:04.872522 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:18:19.942720 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bf52d568-9b6b-4a79-9d66-7c549b50f5bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:22.786919 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5751b5ee-4b6b-4e05-bbb3-2d3ca3c71bea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:23.651362 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:23.833994 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:25.394431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:25.588622 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:25.845972 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:30.852829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af02c429-51e7-45bf-8b60-359fdbe8dea3 req-04c08fd6-c73d-47a3-8e3c-0ccc1a3fc367 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:30.854355 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af02c429-51e7-45bf-8b60-359fdbe8dea3 req-04c08fd6-c73d-47a3-8e3c-0ccc1a3fc367 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.1048169 Dec 21 05:18:30.906887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-af02c429-51e7-45bf-8b60-359fdbe8dea3 req-b279ec6e-a48c-452e-8501-960e4d3a1766 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463922 Dec 21 05:18:32.069801 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c844e4e8-2cbd-408d-b87e-18d3cb33f002 req-9fb9e745-dabc-43b1-8bcb-d2218fc61bcc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:32.071319 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c844e4e8-2cbd-408d-b87e-18d3cb33f002 req-9fb9e745-dabc-43b1-8bcb-d2218fc61bcc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0918851 Dec 21 05:18:32.119970 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c844e4e8-2cbd-408d-b87e-18d3cb33f002 req-04d65cfb-2f2a-4f98-9c01-6badbf1f1f2d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427103 Dec 21 05:18:33.238673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1882dd89-2186-465a-b61e-aab85c0337e2 req-72111441-c62d-47f2-92d0-5963cd428024 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:33.240179 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1882dd89-2186-465a-b61e-aab85c0337e2 req-72111441-c62d-47f2-92d0-5963cd428024 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0486102 Dec 21 05:18:33.288840 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-1882dd89-2186-465a-b61e-aab85c0337e2 req-57521e70-8c71-4dcc-961e-064f654e384f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422893 Dec 21 05:18:34.407174 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8593a65d-f306-4d1a-aec5-442cca4200c6 req-72bcd342-6984-4c64-a944-86a99717b746 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:34.408630 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8593a65d-f306-4d1a-aec5-442cca4200c6 req-72bcd342-6984-4c64-a944-86a99717b746 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0522242 Dec 21 05:18:34.457330 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8593a65d-f306-4d1a-aec5-442cca4200c6 req-71e3adb6-0ec6-42ca-80f0-53e8c7e61471 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421867 Dec 21 05:18:35.576670 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c530edc7-79e0-4551-aa5c-90b6d8f9a3c1 req-c436a3b8-a56d-4955-8b01-ea60dbe455c6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:35.578152 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c530edc7-79e0-4551-aa5c-90b6d8f9a3c1 req-c436a3b8-a56d-4955-8b01-ea60dbe455c6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0509782 Dec 21 05:18:35.629589 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c530edc7-79e0-4551-aa5c-90b6d8f9a3c1 req-41cd2146-67fb-4f8e-8d32-217c10ca8738 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445762 Dec 21 05:18:36.744758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2d4e37-ec6a-4712-99dc-a4217eff6cd1 req-cae9f4a6-8fb1-4c2e-b9bf-9ae4e2896208 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:36.746235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a2d4e37-ec6a-4712-99dc-a4217eff6cd1 req-cae9f4a6-8fb1-4c2e-b9bf-9ae4e2896208 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0486891 Dec 21 05:18:36.798728 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9a2d4e37-ec6a-4712-99dc-a4217eff6cd1 req-85a84cee-1f0c-4939-bb8f-0726842e496e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463629 Dec 21 05:18:37.916477 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca39113a-393c-483f-bd71-c94941fc4f4e req-039ce852-bdc7-4c4e-8c3d-027081021726 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:37.920906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca39113a-393c-483f-bd71-c94941fc4f4e req-039ce852-bdc7-4c4e-8c3d-027081021726 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0498736 Dec 21 05:18:37.968245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ca39113a-393c-483f-bd71-c94941fc4f4e req-ea5ba487-7d37-48b9-80a3-e4afb45f87d6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440595 Dec 21 05:18:39.081897 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a05c8aa-4a33-4379-8aa2-7d7707d49318 req-362d5dfe-d59f-4421-aeea-49726419b27e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:39.083878 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a05c8aa-4a33-4379-8aa2-7d7707d49318 req-362d5dfe-d59f-4421-aeea-49726419b27e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0485435 Dec 21 05:18:39.136046 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5a05c8aa-4a33-4379-8aa2-7d7707d49318 req-5aa3aa77-8593-43ae-ab7d-a5707730cdd0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462155 Dec 21 05:18:40.255278 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba0b3a9-069c-4573-8acf-973e62ae5f90 req-94541b98-e2df-4fda-a20b-b7fa834f41dc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:40.256738 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba0b3a9-069c-4573-8acf-973e62ae5f90 req-94541b98-e2df-4fda-a20b-b7fa834f41dc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0533731 Dec 21 05:18:40.304914 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cba0b3a9-069c-4573-8acf-973e62ae5f90 req-4a5f00ef-8cf7-4426-bf0a-e68c46fa0eca tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423067 Dec 21 05:18:41.141042 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-b613f8cc-63fa-4af2-98f9-7ac9d8b47923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:41.142533 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-b613f8cc-63fa-4af2-98f9-7ac9d8b47923 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0398765 Dec 21 05:18:41.233141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-c3481d4b-3579-4ab4-91b0-efde6b659ce0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:41.234578 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-c3481d4b-3579-4ab4-91b0-efde6b659ce0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0847409 Dec 21 05:18:41.307095 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-a8749db2-5ee8-48a7-9372-e52c8a32c0fc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 1001 time: 0.0571396 Dec 21 05:18:41.359795 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-baca42a2-7042-41b0-8d17-87802224f817 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:41.361268 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-baca42a2-7042-41b0-8d17-87802224f817 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0424490 Dec 21 05:18:41.442545 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-2169cf22-4611-443e-9ccf-6d5205f28a31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:41.444094 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-2169cf22-4611-443e-9ccf-6d5205f28a31 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0708547 Dec 21 05:18:41.455713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccaf387e-fe8f-4b48-85ef-aebbb8dfd5b1 req-58e707f2-74d9-4d68-9400-dc450818abd9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:41.457116 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccaf387e-fe8f-4b48-85ef-aebbb8dfd5b1 req-58e707f2-74d9-4d68-9400-dc450818abd9 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0756984 Dec 21 05:18:41.562906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccaf387e-fe8f-4b48-85ef-aebbb8dfd5b1 req-2f6b5a06-fc01-4fc0-a66d-e1bf5f4cd47a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0970759 Dec 21 05:18:41.577503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-cd8e8516-6044-42f5-8f70-3313d432d6e3 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1194820 Dec 21 05:18:41.671166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e120b0e2-8814-4514-a8c8-3f33c4c65f64 req-e5a89b63-fb86-4d26-8f42-c0a556e8c7fe service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821664 Dec 21 05:18:41.872443 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:18:42.682569 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6168387d-c545-43d1-bbcf-984209f0d531 req-f435b0ab-9816-4d38-928c-25aff7034db6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:42.684079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6168387d-c545-43d1-bbcf-984209f0d531 req-f435b0ab-9816-4d38-928c-25aff7034db6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0525720 Dec 21 05:18:42.731439 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6168387d-c545-43d1-bbcf-984209f0d531 req-597a7f90-afdb-4a83-8dc9-54e98f98582f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415652 Dec 21 05:18:43.847618 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3188573-0bc9-4469-ab0b-05b53ed7ca47 req-44d7c4f7-d71c-4149-bea9-e277cf822365 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:43.849677 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3188573-0bc9-4469-ab0b-05b53ed7ca47 req-44d7c4f7-d71c-4149-bea9-e277cf822365 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0509067 Dec 21 05:18:43.899796 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3188573-0bc9-4469-ab0b-05b53ed7ca47 req-b2163aab-e9a3-4f7b-b6c0-4b936483f112 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440402 Dec 21 05:18:45.013642 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa87b6e-57d3-4100-9c66-2b5690fa1a4a req-198b4c18-39d2-449d-ba9b-fbb6a4c1f540 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:45.015164 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaa87b6e-57d3-4100-9c66-2b5690fa1a4a req-198b4c18-39d2-449d-ba9b-fbb6a4c1f540 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0482974 Dec 21 05:18:45.068687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-aaa87b6e-57d3-4100-9c66-2b5690fa1a4a req-dbdd5e3e-dd59-449b-81b9-b8d04f472653 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468295 Dec 21 05:18:46.183495 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491e9eff-74d5-4cc7-8bcc-595cef2c923b req-8c225289-178d-4c1a-9e29-f1c18f891855 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:46.184978 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-491e9eff-74d5-4cc7-8bcc-595cef2c923b req-8c225289-178d-4c1a-9e29-f1c18f891855 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0487502 Dec 21 05:18:46.232790 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-491e9eff-74d5-4cc7-8bcc-595cef2c923b req-9229a825-d326-41f4-9404-4229bf02f66a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419328 Dec 21 05:18:46.556667 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5dd3949-5241-4d71-8d4b-a6257ca8ee53 req-2de2468c-7d3f-46d8-86c2-4b25936bd045 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:46.558341 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5dd3949-5241-4d71-8d4b-a6257ca8ee53 req-2de2468c-7d3f-46d8-86c2-4b25936bd045 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0536585 Dec 21 05:18:46.560795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:18:46.649971 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:46.654798 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a5dd3949-5241-4d71-8d4b-a6257ca8ee53 req-f62a03f0-bc93-4630-961f-454fbd7dc6bf tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0788746 Dec 21 05:18:46.658471 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-a3b9e14e-6219-4067-b891-cf0b806314cd service neutron] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1262877 Dec 21 05:18:46.668773 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-7de041ee-db57-428e-ab36-37e57a799889 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:18:46.669905 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-7de041ee-db57-428e-ab36-37e57a799889 service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054669 Dec 21 05:18:46.675211 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:18:46.677845 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f8c5831-81cf-4512-aa33-ff74d0879918" -d '{"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:18:46.690700 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:18:46.765678 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:46.791457 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 21 Dec 2021 05:18:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-deb82ccb-6555-4706-b85c-215d92da3a39 x-openstack-request-id: req-deb82ccb-6555-4706-b85c-215d92da3a39 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:18:46.791755 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-unplugged", "status": "failed", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "code": 422}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:18:46.792009 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-deb82ccb-6555-4706-b85c-215d92da3a39 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:18:46.792399 n-d-822053-11 neutron-server[110312]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'code': 422} returned with failed status Dec 21 05:18:46.815122 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:18:46.822510 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.822870 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.823246 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.823591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.823932 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.824271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.824607 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.824937 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.825266 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.825595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.825960 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.826248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:46.826573 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:18:47.775740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c639fe3-6c9e-48cb-84cd-b914bacb2d45 req-7c44579a-bd64-44fe-9f12-74bac7233a7c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:47.777145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c639fe3-6c9e-48cb-84cd-b914bacb2d45 req-7c44579a-bd64-44fe-9f12-74bac7233a7c tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0488682 Dec 21 05:18:47.825511 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9c639fe3-6c9e-48cb-84cd-b914bacb2d45 req-c46793d0-432b-46dc-9231-deb9db28337f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424414 Dec 21 05:18:48.946370 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf611cb-7fc4-49fd-908c-2a39c67dda81 req-2bea7f92-b92b-4b0f-a409-b7dfe9c0a2eb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:48.947945 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf611cb-7fc4-49fd-908c-2a39c67dda81 req-2bea7f92-b92b-4b0f-a409-b7dfe9c0a2eb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0522795 Dec 21 05:18:48.998168 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9bf611cb-7fc4-49fd-908c-2a39c67dda81 req-ceb39bcf-dfef-4996-87dd-3ec3dc0dcd19 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439527 Dec 21 05:18:49.975476 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a2c48ccf-3e42-41b4-88da-5f131feccbc9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:50.117374 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18bcbf5e-4fd1-4dd3-b27d-0e2ce7f56961 req-96214644-b78f-427a-9248-022beb3bd94d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:50.118756 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18bcbf5e-4fd1-4dd3-b27d-0e2ce7f56961 req-96214644-b78f-427a-9248-022beb3bd94d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0526543 Dec 21 05:18:50.167430 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-18bcbf5e-4fd1-4dd3-b27d-0e2ce7f56961 req-284501a9-b989-48d8-9793-7cc83aa58deb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427024 Dec 21 05:18:51.283578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d00f7bf-64b1-40e9-ab3a-02d93da0c658 req-c5b3afe6-037f-4ef6-ae8c-b486bd72f4ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:51.285045 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d00f7bf-64b1-40e9-ab3a-02d93da0c658 req-c5b3afe6-037f-4ef6-ae8c-b486bd72f4ea tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0507538 Dec 21 05:18:51.333922 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4d00f7bf-64b1-40e9-ab3a-02d93da0c658 req-457305b3-31ac-45e9-9559-e5c2e1a10a79 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417380 Dec 21 05:18:52.454217 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbc3663-9157-465d-9343-b70678914966 req-1b4b6a4a-c29b-45b5-a286-e8149f022231 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:52.455698 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccbc3663-9157-465d-9343-b70678914966 req-1b4b6a4a-c29b-45b5-a286-e8149f022231 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0511558 Dec 21 05:18:52.503896 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ccbc3663-9157-465d-9343-b70678914966 req-064a5e81-2ca3-4ac7-881e-266256382816 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422611 Dec 21 05:18:52.788549 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-730e28d8-9b1b-44c0-9d60-9e78bf9427a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:53.618655 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93c251b-7929-4fae-bcff-55ae5c167af8 req-1daeac8d-6e1d-41b7-a365-cffe97cde348 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:53.620177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f93c251b-7929-4fae-bcff-55ae5c167af8 req-1daeac8d-6e1d-41b7-a365-cffe97cde348 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0495222 Dec 21 05:18:53.633732 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:53.669483 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f93c251b-7929-4fae-bcff-55ae5c167af8 req-5ea0c6de-0c88-4f89-a3bf-f16afc540bbe tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432568 Dec 21 05:18:53.769290 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-9173bad5-4954-4b08-9881-a5435938608d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:53.770823 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-9173bad5-4954-4b08-9881-a5435938608d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c&tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75 HTTP/1.1" status: 200 len: 1096 time: 0.0735154 Dec 21 05:18:53.863821 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-fddf9cbe-7cd9-4e7b-963c-d71026f5b231 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:53.865235 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-fddf9cbe-7cd9-4e7b-963c-d71026f5b231 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1096 time: 0.0461295 Dec 21 05:18:53.874067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:53.957945 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-d7859c97-8d51-4f6c-b3c0-b8577bd867ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:53.962339 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-d7859c97-8d51-4f6c-b3c0-b8577bd867ee service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0867712 Dec 21 05:18:54.035122 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-b02e0992-9573-4223-9c96-080496ac4540 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 999 time: 0.0614021 Dec 21 05:18:54.087252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-d74af290-93ad-4273-8cf2-4e972fe4b833 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:54.088702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-d74af290-93ad-4273-8cf2-4e972fe4b833 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0428357 Dec 21 05:18:54.145578 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-6770a572-d703-4f31-aa6e-71fef7d3564c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:54.147071 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-6770a572-d703-4f31-aa6e-71fef7d3564c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0463052 Dec 21 05:18:54.242246 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-8df1eba9-2a32-416c-a063-42a40e43f1a3 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839324 Dec 21 05:18:54.333966 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-aaade369-b9ac-4ebe-b258-910d34287b5b service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804780 Dec 21 05:18:54.791223 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592b641d-517e-4b9f-a6e8-d462993a1dd7 req-d9a12b32-5205-47c5-83f4-bc8873061855 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:54.792749 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-592b641d-517e-4b9f-a6e8-d462993a1dd7 req-d9a12b32-5205-47c5-83f4-bc8873061855 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0568841 Dec 21 05:18:54.840828 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-592b641d-517e-4b9f-a6e8-d462993a1dd7 req-a5b539cc-fb5c-4577-a7d9-32abca2dda4d tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420883 Dec 21 05:18:55.409743 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:55.586586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:55.827777 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:18:55.954294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49fd4c77-5502-4b71-aec1-84597e087f12 req-585cae3a-39e9-4e64-b308-2ad10742468e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:55.955784 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49fd4c77-5502-4b71-aec1-84597e087f12 req-585cae3a-39e9-4e64-b308-2ad10742468e tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0470328 Dec 21 05:18:56.007999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49fd4c77-5502-4b71-aec1-84597e087f12 req-e9d2fd0e-2063-4b27-82ca-61397c6a8a90 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457389 Dec 21 05:18:57.129906 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a6877e6-ed5e-42b8-b8d0-4c3efd02e5a1 req-527e6bfa-02a0-4e77-8766-485538e74b99 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:57.129906 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a6877e6-ed5e-42b8-b8d0-4c3efd02e5a1 req-527e6bfa-02a0-4e77-8766-485538e74b99 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0542326 Dec 21 05:18:57.176800 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0a6877e6-ed5e-42b8-b8d0-4c3efd02e5a1 req-7cef552e-5cde-4b83-88b6-a6507e5e2c02 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427618 Dec 21 05:18:58.290751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9831919-de57-47e3-9b48-9ae058c020b2 req-5e9b48f3-b2b1-4b6c-8c3d-ff8614e02ac6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:58.292249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9831919-de57-47e3-9b48-9ae058c020b2 req-5e9b48f3-b2b1-4b6c-8c3d-ff8614e02ac6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0475230 Dec 21 05:18:58.340833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d9831919-de57-47e3-9b48-9ae058c020b2 req-ea3209ed-e62d-47f8-b478-7621ba17a3fb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425320 Dec 21 05:18:59.455213 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded1e054-e3b6-4194-bbbf-68b670c91824 req-42fc671f-a9da-4e6e-b1fe-c2d5cee3eadb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:18:59.456670 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ded1e054-e3b6-4194-bbbf-68b670c91824 req-42fc671f-a9da-4e6e-b1fe-c2d5cee3eadb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0480340 Dec 21 05:18:59.508584 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-ded1e054-e3b6-4194-bbbf-68b670c91824 req-762e638d-acff-4ecb-892d-3c0877bd4ccf tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458465 Dec 21 05:19:00.623005 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f782d3c-4fff-4c24-b43d-58df3d9ed2a1 req-64e8174f-2b25-447a-b088-0398c1fdc5f3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:00.624525 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f782d3c-4fff-4c24-b43d-58df3d9ed2a1 req-64e8174f-2b25-447a-b088-0398c1fdc5f3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0484753 Dec 21 05:19:00.673960 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7f782d3c-4fff-4c24-b43d-58df3d9ed2a1 req-fc7c06bd-9d1e-4aa5-94a4-25f378991920 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430937 Dec 21 05:19:01.789804 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c7320d-ac2c-40c4-887d-1c3b077a5e06 req-23fabea8-0275-44d5-bc6e-6442e066c0d6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:01.791288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5c7320d-ac2c-40c4-887d-1c3b077a5e06 req-23fabea8-0275-44d5-bc6e-6442e066c0d6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 944 time: 0.0479400 Dec 21 05:19:01.838518 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e5c7320d-ac2c-40c4-887d-1c3b077a5e06 req-1d262168-da56-4d7c-aed5-445e507209fb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412977 Dec 21 05:19:02.624619 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:19:02.716324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:19:02.726973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'port_id': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'mac_address': 'fa:16:3e:68:ed:44', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:19:02.763152 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:02.778551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f3caea7-f5dc-4568-b257-5093de789fb2 {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:19:02.797817 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:19:02.856688 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:02.908526 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:19:02.963127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b26e6c2-87e2-43a8-81c8-0b607f864edf req-c8d34e61-5470-49c1-bff7-278af026fcfc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:02.964614 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b26e6c2-87e2-43a8-81c8-0b607f864edf req-c8d34e61-5470-49c1-bff7-278af026fcfc tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 945 time: 0.0548108 Dec 21 05:19:03.014255 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8b26e6c2-87e2-43a8-81c8-0b607f864edf req-50e71acc-dda3-4705-a295-06aab88b7767 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432830 Dec 21 05:19:03.232540 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['6f3caea7-f5dc-4568-b257-5093de789fb2'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:19:04.126717 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49bb47bc-04b5-491c-9c5d-987da8d01a27 req-4f96f60b-dbf4-49f5-817f-7ff135922825 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:04.128221 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49bb47bc-04b5-491c-9c5d-987da8d01a27 req-4f96f60b-dbf4-49f5-817f-7ff135922825 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 945 time: 0.0474696 Dec 21 05:19:04.176285 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-49bb47bc-04b5-491c-9c5d-987da8d01a27 req-9d10b4d9-4e6d-4363-b942-eb888e2cc5a2 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415454 Dec 21 05:19:04.623754 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:19:04.670100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port 6f3caea7-f5dc-4568-b257-5093de789fb2 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:19:04.670464 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:04.746057 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:04.767304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:19:04.769527 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1255471e-494a-4f80-b43a-d663a78c8aae" -d '{"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-plugged", "status": "completed", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:19:04.782405 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:19:04.805544 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:19:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26c221b1-f005-4355-affc-2d1252fcf79b x-openstack-request-id: req-26c221b1-f005-4355-affc-2d1252fcf79b {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:19:04.805832 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-plugged", "status": "completed", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:19:04.806112 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-26c221b1-f005-4355-affc-2d1252fcf79b {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:19:04.806504 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'code': 200} Dec 21 05:19:04.839733 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:04.888291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:19:05.014266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0be44b-ef50-42b2-9beb-07d88a243f07 req-ff2ef5d7-3232-4115-af90-d5691145de9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:05.015780 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c0be44b-ef50-42b2-9beb-07d88a243f07 req-ff2ef5d7-3232-4115-af90-d5691145de9d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0389349 Dec 21 05:19:05.068649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5c0be44b-ef50-42b2-9beb-07d88a243f07 req-7321cc02-badf-4ddd-a44f-308e95b89f11 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415323 Dec 21 05:19:05.289506 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-494aa4a7-9e66-48dc-bbee-564dd50a73cb req-9c84bca0-448e-4c7c-be9a-1a1c37200c11 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:05.290969 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-494aa4a7-9e66-48dc-bbee-564dd50a73cb req-9c84bca0-448e-4c7c-be9a-1a1c37200c11 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0473063 Dec 21 05:19:05.338687 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-494aa4a7-9e66-48dc-bbee-564dd50a73cb req-63d8d69e-0efc-40ef-9f47-617ffb5013cb tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418241 Dec 21 05:19:06.456583 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3787364-20f2-4096-9b6d-1142e4d2cd33 req-333007f3-6121-4903-8b8e-33837610b66b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:06.458062 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3787364-20f2-4096-9b6d-1142e4d2cd33 req-333007f3-6121-4903-8b8e-33837610b66b tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0488667 Dec 21 05:19:06.506989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a3787364-20f2-4096-9b6d-1142e4d2cd33 req-0acb288c-aa12-4911-963a-5b11d73a12d3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426929 Dec 21 05:19:18.873421 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:19:19.952971 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b611dae1-f0cc-428a-9e49-6d86d8a6eeb4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:22.759136 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-778effd4-76a1-4ee7-b340-18fef0f80308 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:23.661716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:23.879087 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:25.416100 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:25.592533 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:25.827491 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:49.941425 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-541b6c3b-bb55-4123-82e8-bbed1afc67a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:52.757857 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-53fe226e-08ce-4cf7-9609-6667e34279fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:53.655927 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:53.907449 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:54.717422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-a58873d6-1054-4125-942c-33f9f28bd81c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0528982 Dec 21 05:19:54.825520 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-e5a46c83-7a7b-42e3-b3ad-76e2779a7256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:54.827023 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-e5a46c83-7a7b-42e3-b3ad-76e2779a7256 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0424433 Dec 21 05:19:54.943353 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-31ef0379-c481-4d34-94b9-99510cd70e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:54.944833 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-31ef0379-c481-4d34-94b9-99510cd70e46 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0938232 Dec 21 05:19:55.017676 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-0a673f9e-1ded-4261-a10b-450c487c477a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 1001 time: 0.0610166 Dec 21 05:19:55.072238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-243b2485-5eb5-47a7-9807-e361ad52c148 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:55.073678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-243b2485-5eb5-47a7-9807-e361ad52c148 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0444646 Dec 21 05:19:55.123849 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-1a1dc0bc-f7b7-4427-9d6e-144948b243c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:19:55.125318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-1a1dc0bc-f7b7-4427-9d6e-144948b243c8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0432653 Dec 21 05:19:55.221252 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-6a1e6cf1-764d-4a53-bb54-6979f4b9a330 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819101 Dec 21 05:19:55.320635 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c5a93f8b-4686-4886-90a5-31eeb54db726 req-022186eb-f535-4c48-b514-554102a9d3ab service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884850 Dec 21 05:19:55.444408 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:55.592826 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:55.837564 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:19:55.872917 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:20:19.946230 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b32b5120-9151-4a6e-a311-a6258f91d7a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:22.757891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bc0d8499-d34f-4640-99d3-4d58e8ea0ff6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:23.666450 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:23.900702 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:25.399263 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:25.614874 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:25.814502 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:32.871716 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:20:45.353465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53466) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:20:45.511981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Deleting port cfd4199d-308c-49f8-9137-3dcc20bfcb55 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:20:45.512320 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:45.584992 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:45.585310 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:45.596730 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Calling delete_port for cfd4199d-308c-49f8-9137-3dcc20bfcb55 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:20:45.803334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:45.828767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event deleted for resources: {'Port': ['ID=cfd4199d-308c-49f8-9137-3dcc20bfcb55,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:20:45.855554 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.855910 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.856257 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.856598 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.856933 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.857266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.857596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.857925 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.858251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.858577 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.858902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.859256 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.859658 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:20:45.902140 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:45.902463 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Floating IP a48332f2-af0e-4b85-90dd-5a148b739d99 disassociated (deleted). External IP: 172.25.5.60, port: 6f3caea7-f5dc-4568-b257-5093de789fb2. Dec 21 05:20:46.102734 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:20:46.207171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:20:46.212650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:46.217973 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b43241-501a-4de0-8d28-79622f043394 None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:20:46.229483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:20:46.230120 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:46.355471 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:20:46.540068 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-afac30e6-2d7d-4cec-907a-5fcf6e8d52b6 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "DELETE /v2.0/floatingips/a48332f2-af0e-4b85-90dd-5a148b739d99 HTTP/1.1" status: 204 len: 168 time: 1.1853805 Dec 21 05:20:46.540644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:20:46.543075 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e55c0be1-07eb-4156-a009-bce668004596" -d '{"events": [{"name": "network-changed", "server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:20:46.559452 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:46.590500 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b43241-501a-4de0-8d28-79622f043394 None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:20:46.600403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:20:46.601200 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:46.635131 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:20:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce2d45e2-a079-458e-98b5-da2634fc9906 x-openstack-request-id: req-ce2d45e2-a079-458e-98b5-da2634fc9906 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:20:46.635435 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:20:46.635693 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ce2d45e2-a079-458e-98b5-da2634fc9906 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:20:46.636125 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'status': 'completed', 'code': 200} Dec 21 05:20:46.716798 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:20:46.727901 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55c0be1-07eb-4156-a009-bce668004596 req-f0ffa8de-bbcc-45ea-88b4-3a806a3bcbbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:46.729396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-f0ffa8de-bbcc-45ea-88b4-3a806a3bcbbf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 1098 time: 0.0407019 Dec 21 05:20:46.831266 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55c0be1-07eb-4156-a009-bce668004596 req-17256fc3-f871-4576-8c08-329e52d64013 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:46.832773 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-17256fc3-f871-4576-8c08-329e52d64013 service neutron] 10.222.0.31 "GET /v2.0/networks?id=645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 200 len: 909 time: 0.0945647 Dec 21 05:20:46.875400 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-27e5d732-f8f0-4ed8-ab42-bb2e849176a3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 200 len: 217 time: 0.0354743 Dec 21 05:20:46.916023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-12b43241-501a-4de0-8d28-79622f043394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:46.929666 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55c0be1-07eb-4156-a009-bce668004596 req-e2efdf95-6b14-4ad9-9900-30a846743263 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:46.931183 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-e2efdf95-6b14-4ad9-9900-30a846743263 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 200 len: 847 time: 0.0438058 Dec 21 05:20:46.945093 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b43241-501a-4de0-8d28-79622f043394 None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '29a51ce0-49b9-46d0-ba67-ac7c76850f34', 'name': '', 'network_id': '645a6cd1-6742-4469-afd8-b9c3665fe576', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'mac_address': 'fa:16:3e:79:d3:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_interface', 'standard_attr_id': 4315, 'fixed_ips': [{'subnet_id': '65e74147-5f7e-4b8c-956b-aec144967429', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:39Z', 'updated_at': '2021-12-21T05:10:43Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'subnets': [{'id': '65e74147-5f7e-4b8c-956b-aec144967429', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:20:46.980817 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55c0be1-07eb-4156-a009-bce668004596 req-db1755b3-3942-4303-87bb-e03680013c96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:46.982351 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-db1755b3-3942-4303-87bb-e03680013c96 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=645a6cd1-6742-4469-afd8-b9c3665fe576&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0406637 Dec 21 05:20:47.082137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-596a8be2-35b7-4dde-89a8-4925c844cc88 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873468 Dec 21 05:20:47.184810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-764b5a70-cf96-4f11-895f-e56538f9dea2 None None] New status for floating IP a48332f2-af0e-4b85-90dd-5a148b739d99: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:20:47.186776 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e55c0be1-07eb-4156-a009-bce668004596 req-9931b781-b098-4c24-8be9-f71d36dcef22 service neutron] 10.222.0.31 "GET /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926023 Dec 21 05:20:48.186592 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ba2413-f0a3-4dc9-bce8-d0e81fa2a0e9 req-3e69ab53-1cd5-4b4f-83ef-b25e6da3c0b3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:48.188081 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6ba2413-f0a3-4dc9-bce8-d0e81fa2a0e9 req-3e69ab53-1cd5-4b4f-83ef-b25e6da3c0b3 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0473230 Dec 21 05:20:48.235931 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6ba2413-f0a3-4dc9-bce8-d0e81fa2a0e9 req-6b745be7-313d-4a97-94b4-561639723fb2 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414295 Dec 21 05:20:49.352001 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adf0ef3-516d-4cc1-924a-1e8257ce5880 req-d909650c-2385-4b88-84dc-e43066e69301 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:49.353465 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0adf0ef3-516d-4cc1-924a-1e8257ce5880 req-d909650c-2385-4b88-84dc-e43066e69301 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0483925 Dec 21 05:20:49.403678 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0adf0ef3-516d-4cc1-924a-1e8257ce5880 req-49692eac-b5ed-4a9d-bda1-5a4df9240021 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/security-groups?id=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444207 Dec 21 05:20:49.980709 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2acd0392-4195-4b9e-8d40-682a59d5aa81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:50.022481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-5ec98080-c8d5-404a-9727-f1470506c91f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:50.023967 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-5ec98080-c8d5-404a-9727-f1470506c91f tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 946 time: 0.0520425 Dec 21 05:20:50.114329 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Deleting port 6f3caea7-f5dc-4568-b257-5093de789fb2 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:20:50.114674 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:50.203416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] For port 6f3caea7-f5dc-4568-b257-5093de789fb2, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=6f3caea7-f5dc-4568-b257-5093de789fb2,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:20:50.203777 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:50.215359 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Calling delete_port for 6f3caea7-f5dc-4568-b257-5093de789fb2 owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:20:50.398577 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:50.431194 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event deleted for resources: {'Port': ['ID=6f3caea7-f5dc-4568-b257-5093de789fb2,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:20:50.472003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] No DVR routers for this DVR port 6f3caea7-f5dc-4568-b257-5093de789fb2 on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:20:50.476590 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:50.479841 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-48ab5d95-520d-471d-88cb-85d977d2cef6 req-4ef723e4-8e39-4d23-af3f-dfdcfc9d7196 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.31 "DELETE /v2.0/ports/6f3caea7-f5dc-4568-b257-5093de789fb2 HTTP/1.1" status: 204 len: 173 time: 0.4459772 Dec 21 05:20:50.480283 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-deleted', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:20:50.482464 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f0fce01-dc97-474c-af65-084ed42151f2" -d '{"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-deleted", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:20:50.510623 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-74935397-dd7b-498c-8fc9-5db1a4f9720e req-43a4d3f3-9a3f-4dd7-a7f6-4264cc085708 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0366037 Dec 21 05:20:50.520044 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:20:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc7014f0-6087-409a-81aa-87bf508d469f x-openstack-request-id: req-cc7014f0-6087-409a-81aa-87bf508d469f {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:20:50.520377 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "398317a6-376b-4b74-9e15-4bdb2a87049c", "name": "network-vif-deleted", "tag": "6f3caea7-f5dc-4568-b257-5093de789fb2", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:20:50.520658 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-cc7014f0-6087-409a-81aa-87bf508d469f {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:20:50.521066 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '398317a6-376b-4b74-9e15-4bdb2a87049c', 'name': 'network-vif-deleted', 'tag': '6f3caea7-f5dc-4568-b257-5093de789fb2', 'status': 'completed', 'code': 200} Dec 21 05:20:51.607091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c427f815-d321-4918-9e7d-0ba2e33d9bf9 req-bcc2bad0-db1a-4abe-b3fc-15a566b95111 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0263565 Dec 21 05:20:52.707916 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-790891f3-c279-4715-905a-832904e70d65 req-68e137f9-aa74-4d51-944c-77d4684b75a0 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0304067 Dec 21 05:20:52.786023 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-403b7a17-8fe8-4802-9627-9cdb73d64175 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:53.245868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:20:53.265249 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: 6f3caea7-f5dc-4568-b257-5093de789fb2 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:20:53.265600 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device 6f3caea7-f5dc-4568-b257-5093de789fb2 not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:20:53.665960 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:53.806034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-223b59b3-d79a-4cf4-96d5-ee105d877548 req-1636b613-9ab2-4272-b699-cc528bfda02a tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0269310 Dec 21 05:20:53.888998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:54.899558 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-5386fd10-99d4-4b3d-b483-cb737245966e req-82bebf25-18c3-4ed3-8ab6-483f8ce93f16 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0266316 Dec 21 05:20:55.425797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:55.615071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:55.674993 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a616d390-a01d-4b6e-b332-41cab6aebefa req-e1afc3fc-d64a-4971-94b6-bb13cbcfaad9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0257795 Dec 21 05:20:55.774627 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a616d390-a01d-4b6e-b332-41cab6aebefa req-98ff97a8-e646-4063-9c56-b0fe3209ff07 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0267191 Dec 21 05:20:55.854749 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:55.908168 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a616d390-a01d-4b6e-b332-41cab6aebefa req-eb7c016c-e8c9-4811-a47a-2d7dc9a7d998 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:55.909666 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a616d390-a01d-4b6e-b332-41cab6aebefa req-eb7c016c-e8c9-4811-a47a-2d7dc9a7d998 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1065400 Dec 21 05:20:56.059711 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78bb8aaa-e3a2-4328-a015-c15c8b973c29 req-82e11fdd-ca65-4ed5-9f1f-4ffbf71094a1 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "GET /v2.0/ports?device_id=398317a6-376b-4b74-9e15-4bdb2a87049c HTTP/1.1" status: 200 len: 210 time: 0.0418096 Dec 21 05:20:56.067572 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a616d390-a01d-4b6e-b332-41cab6aebefa req-71d1d2b2-f515-4821-8a86-5f8a4457c9cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:20:56.067572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a616d390-a01d-4b6e-b332-41cab6aebefa req-71d1d2b2-f515-4821-8a86-5f8a4457c9cb service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1303990 Dec 21 05:20:57.124966 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53522) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:20:57.183186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73238bbe-5d73-494d-aa26-107af98019e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:57.208633 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73238bbe-5d73-494d-aa26-107af98019e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:57.334825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73238bbe-5d73-494d-aa26-107af98019e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:57.337532 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-73238bbe-5d73-494d-aa26-107af98019e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:57.338702 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-73238bbe-5d73-494d-aa26-107af98019e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] 10.222.0.18 "DELETE /v2.0/security-groups/16e3d713-3ca7-4cfd-95e9-1bf09df78bf0 HTTP/1.1" status: 204 len: 168 time: 0.2127399 Dec 21 05:20:57.348425 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73238bbe-5d73-494d-aa26-107af98019e7 tempest-TestShelveInstance-2089661460 tempest-TestShelveInstance-2089661460-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=16e3d713-3ca7-4cfd-95e9-1bf09df78bf0,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:20:57.458119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53526) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:20:57.969094 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:58.216093 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Deleting port 29a51ce0-49b9-46d0-ba67-ac7c76850f34 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:20:58.216818 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:58.292837 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] For port 29a51ce0-49b9-46d0-ba67-ac7c76850f34, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=29a51ce0-49b9-46d0-ba67-ac7c76850f34,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:20:58.293101 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:58.304988 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Calling delete_port for 29a51ce0-49b9-46d0-ba67-ac7c76850f34 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:20:58.534785 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:58.561481 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Pushing event deleted for resources: {'Port': ['ID=29a51ce0-49b9-46d0-ba67-ac7c76850f34,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:20:58.748861 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:58.965352 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Router 3f1b1a41-109f-4ec6-a12e-6653fe62790a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:20:59.069449 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:20:59.074793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-93907b09-5b1b-4006-aa06-44905a1b451a admin admin] 10.222.0.18 "PUT /v2.0/routers/3f1b1a41-109f-4ec6-a12e-6653fe62790a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6154416 Dec 21 05:20:59.077226 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53534) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:20:59.080609 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] Sync routers for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:20:59.092070 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:20:59.092958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:59.182725 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:59.203630 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:20:59.286121 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:59.385479 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195'}], 'enable_snat': True}, 'gw_port_id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:20:58Z', 'revision_number': 5, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port': {'id': '586dffac-02e1-40bc-8a0e-dee67f8086a7', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:ad:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.195', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:10:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:59.414686 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Deleting port 586dffac-02e1-40bc-8a0e-dee67f8086a7 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:20:59.415222 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:59.503423 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] For port 586dffac-02e1-40bc-8a0e-dee67f8086a7, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=586dffac-02e1-40bc-8a0e-dee67f8086a7,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:20:59.503789 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:59.516869 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Calling delete_port for 586dffac-02e1-40bc-8a0e-dee67f8086a7 owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:20:59.582714 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] Checking router: 3f1b1a41-109f-4ec6-a12e-6653fe62790a for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:20:59.591698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] Routers {'3f1b1a41-109f-4ec6-a12e-6653fe62790a'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:20:59.592324 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:59.681271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] Set router 3f1b1a41-109f-4ec6-a12e-6653fe62790a gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:20:59.732591 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:20:59Z', 'revision_number': 6, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:20:59.752180 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:20:59.762179 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0356fb4f-32e2-4b6c-b859-1b692d9c2d06 None None] The sync data for ids ['3f1b1a41-109f-4ec6-a12e-6653fe62790a'] in n-d-822053-11 is: [{'id': '3f1b1a41-109f-4ec6-a12e-6653fe62790a', 'name': 'tempest-TestShelveInstance-502757730-router', 'tenant_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:37Z', 'updated_at': '2021-12-21T05:20:59Z', 'revision_number': 6, 'project_id': '449c18c6acb14eab9ae3cbb2fa4f9b75', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:20:59.779179 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Pushing event deleted for resources: {'Port': ['ID=586dffac-02e1-40bc-8a0e-dee67f8086a7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:20:59.793918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93431c74-1129-4183-99dd-91ef37b26708 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:20:59.844717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.227177 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.229259 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.328866 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.329563 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3f1b1a41-109f-4ec6-a12e-6653fe62790a {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:21:00.333550 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.335331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-53bf9976-25b0-4312-9676-bb2a89a4a9bc admin admin] 10.222.0.18 "DELETE /v2.0/routers/3f1b1a41-109f-4ec6-a12e-6653fe62790a HTTP/1.1" status: 204 len: 168 time: 1.2571716 Dec 21 05:21:00.337797 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53538) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:00.381325 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Deleting subnet 65e74147-5f7e-4b8c-956b-aec144967429 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:21:00.384276 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.421126 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.499885 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.620844 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.766380 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03fe0d55-2a28-4eb9-82d0-2c6e4377f54e None None] Network 645a6cd1-6742-4469-afd8-b9c3665fe576 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:21:00.767079 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.767079 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] 10.222.0.18 "DELETE /v2.0/subnets/65e74147-5f7e-4b8c-956b-aec144967429 HTTP/1.1" status: 204 len: 168 time: 0.3184855 Dec 21 05:21:00.767079 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-555f620c-297b-4426-9ae6-be9bfeeae4a2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=65e74147-5f7e-4b8c-956b-aec144967429,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:00.767381 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53542) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:00.767381 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.808846 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] DHCP port deletion for 645a6cd1-6742-4469-afd8-b9c3665fe576 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:00.809905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Deleting port b1ecb840-5245-4faa-8f1f-70019b110295 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:21:00.810236 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.864867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Deleting port b1ecb840-5245-4faa-8f1f-70019b110295 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:21:00.865793 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.873414 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] For port b1ecb840-5245-4faa-8f1f-70019b110295, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b1ecb840-5245-4faa-8f1f-70019b110295,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:00.873781 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.892646 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Calling delete_port for b1ecb840-5245-4faa-8f1f-70019b110295 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:21:00.926388 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] For port b1ecb840-5245-4faa-8f1f-70019b110295, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b1ecb840-5245-4faa-8f1f-70019b110295,segment=NetworkSegment(c28886ab-df75-4037-9026-f1cc95da771c),segment_id=c28886ab-df75-4037-9026-f1cc95da771c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:00.926797 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:00.939469 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Calling delete_port for b1ecb840-5245-4faa-8f1f-70019b110295 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:21:01.071883 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.077466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.098294 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Pushing event deleted for resources: {'Port': ['ID=b1ecb840-5245-4faa-8f1f-70019b110295,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:01.101111 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] No DVR routers for this DVR port b1ecb840-5245-4faa-8f1f-70019b110295 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:21:01.102012 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Pushing event deleted for resources: {'Port': ['ID=b1ecb840-5245-4faa-8f1f-70019b110295,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:01.110359 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] No DVR routers for this DVR port b1ecb840-5245-4faa-8f1f-70019b110295 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:21:01.112767 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.113113 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.113453 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.113868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.114202 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.114531 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.114859 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.115832 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.116131 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.116484 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.116795 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.117116 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.117434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4209b974-d46b-4765-9235-3c044f101c04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.128194 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.128549 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.128922 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.129224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.129637 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.129883 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.130213 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.130548 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.130904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.131254 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.131582 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.131907 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.132232 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:01.185390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.205016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['645a6cd1-6742-4469-afd8-b9c3665fe576']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:01.220865 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c28886ab-df75-4037-9026-f1cc95da771c') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:01.221160 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c28886ab-df75-4037-9026-f1cc95da771c') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:01.236822 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.257093 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.263633 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:21:01.264009 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: timer() Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:21:01.265631 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:21:01.466294 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.472010 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.475778 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] 10.222.0.18 "DELETE /v2.0/networks/645a6cd1-6742-4469-afd8-b9c3665fe576 HTTP/1.1" status: 204 len: 168 time: 0.8133135 Dec 21 05:21:01.478833 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53546) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:01.486623 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6b63d9-b408-45d5-8f2f-aef31cc53848 admin admin] Pushing event deleted for resources: {'Network': ['ID=645a6cd1-6742-4469-afd8-b9c3665fe576,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:01.773508 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29a51ce0-49b9-46d0-ba67-ac7c76850f34 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:21:01.793126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 29a51ce0-49b9-46d0-ba67-ac7c76850f34 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:21:01.793478 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 29a51ce0-49b9-46d0-ba67-ac7c76850f34 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:21:01.793902 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 586dffac-02e1-40bc-8a0e-dee67f8086a7 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:21:01.813042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 586dffac-02e1-40bc-8a0e-dee67f8086a7 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:21:01.813403 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 586dffac-02e1-40bc-8a0e-dee67f8086a7 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:21:01.813822 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b1ecb840-5245-4faa-8f1f-70019b110295 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:21:01.821344 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:01.835836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b1ecb840-5245-4faa-8f1f-70019b110295 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:21:01.836194 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b1ecb840-5245-4faa-8f1f-70019b110295 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:21:02.060338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Deleting port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:21:02.060598 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:02.135369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] For port c0ddd3e1-97d0-4ba0-8ec8-3a184319131d, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:02.135728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:02.147102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Calling delete_port for c0ddd3e1-97d0-4ba0-8ec8-3a184319131d owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:21:02.374851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:02.400644 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Pushing event deleted for resources: {'Port': ['ID=c0ddd3e1-97d0-4ba0-8ec8-3a184319131d,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:02.575969 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:02.787419 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Router 30c9ab26-4ac0-46d3-904b-64a8314b242a has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:21:02.898651 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:21:02.906203 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-051ae730-b887-4593-9dd3-949f1b03c1ba admin admin] 10.222.0.18 "PUT /v2.0/routers/30c9ab26-4ac0-46d3-904b-64a8314b242a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4237411 Dec 21 05:21:02.906203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53548) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:02.910911 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] Sync routers for ids ['30c9ab26-4ac0-46d3-904b-64a8314b242a'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:21:02.921141 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] Routers {'30c9ab26-4ac0-46d3-904b-64a8314b242a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:02.921904 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['30c9ab26-4ac0-46d3-904b-64a8314b242a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:03.014556 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.027880 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] Set router 30c9ab26-4ac0-46d3-904b-64a8314b242a gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:03.113024 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.201591 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166'}], 'enable_snat': True}, 'gw_port_id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:21:02Z', 'revision_number': 5, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port': {'id': '375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:ba:3a:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:10:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:03.230370 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] Checking router: 30c9ab26-4ac0-46d3-904b-64a8314b242a for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:21:03.239810 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] Routers {'30c9ab26-4ac0-46d3-904b-64a8314b242a'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:03.240911 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['30c9ab26-4ac0-46d3-904b-64a8314b242a'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:03.246503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Deleting port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:21:03.246851 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.327021 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] For port 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:03.327312 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.332926 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] Set router 30c9ab26-4ac0-46d3-904b-64a8314b242a gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:03.339119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Calling delete_port for 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:21:03.385890 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:21:03Z', 'revision_number': 6, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:03.412751 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a52f5084-85f0-4df3-9d83-a04f1f175ba9 None None] The sync data for ids ['30c9ab26-4ac0-46d3-904b-64a8314b242a'] in n-d-822053-11 is: [{'id': '30c9ab26-4ac0-46d3-904b-64a8314b242a', 'name': 'tempest-TestShelveInstance-136682029-router', 'tenant_id': '91cbbaa4ae4745df999125b302081ed4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:10:43Z', 'updated_at': '2021-12-21T05:21:03Z', 'revision_number': 6, 'project_id': '91cbbaa4ae4745df999125b302081ed4', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:21:03.552173 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.578441 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Pushing event deleted for resources: {'Port': ['ID=375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:03.597393 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8730c26e-75b0-408b-bd9c-fa8d3e0cfcf4 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:03.649058 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.740857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.744062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.877948 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.878534 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 30c9ab26-4ac0-46d3-904b-64a8314b242a {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:21:03.882894 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.884091 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6117e8b5-1aed-4f8c-ba1e-db4020e56bcd admin admin] 10.222.0.18 "DELETE /v2.0/routers/30c9ab26-4ac0-46d3-904b-64a8314b242a HTTP/1.1" status: 204 len: 168 time: 0.9770429 Dec 21 05:21:03.886829 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53550) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:03.935698 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Deleting subnet 14f97133-ef5a-4adb-8e05-a6ec84399e14 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:21:03.938727 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:03.972223 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.046279 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.166124 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0ddd3e1-97d0-4ba0-8ec8-3a184319131d no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:21:04.186707 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.187119 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: c0ddd3e1-97d0-4ba0-8ec8-3a184319131d {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:21:04.187684 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c0ddd3e1-97d0-4ba0-8ec8-3a184319131d not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:21:04.216137 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=14f97133-ef5a-4adb-8e05-a6ec84399e14,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:04.226157 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.231701 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-16a75c90-ca21-4135-b569-568f48821a9c admin admin] 10.222.0.18 "DELETE /v2.0/subnets/14f97133-ef5a-4adb-8e05-a6ec84399e14 HTTP/1.1" status: 204 len: 168 time: 0.3419507 Dec 21 05:21:04.231871 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f69b7bc6-85b0-4816-9d08-6daf179dd056 None None] Network 79f795c6-4f78-4a77-bf67-1d759df61db6 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:21:04.232516 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53552) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:04.305816 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.360794 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Deleting port 12f58b38-55df-4fb2-a086-81f69d8d539c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:21:04.361218 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.379184 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-384eb958-66e8-4708-937c-be7acee7879e None None] DHCP port deletion for 79f795c6-4f78-4a77-bf67-1d759df61db6 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:04.431741 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-384eb958-66e8-4708-937c-be7acee7879e None None] Deleting port 12f58b38-55df-4fb2-a086-81f69d8d539c {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:21:04.432269 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-384eb958-66e8-4708-937c-be7acee7879e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.440818 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] For port 12f58b38-55df-4fb2-a086-81f69d8d539c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12f58b38-55df-4fb2-a086-81f69d8d539c,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:04.440966 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.455334 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Calling delete_port for 12f58b38-55df-4fb2-a086-81f69d8d539c owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:21:04.500457 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-384eb958-66e8-4708-937c-be7acee7879e None None] For port 12f58b38-55df-4fb2-a086-81f69d8d539c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=12f58b38-55df-4fb2-a086-81f69d8d539c,segment=NetworkSegment(ca1b71b2-6f11-4807-a847-6e1b04ec9c39),segment_id=ca1b71b2-6f11-4807-a847-6e1b04ec9c39)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:04.500854 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-384eb958-66e8-4708-937c-be7acee7879e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.513578 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-384eb958-66e8-4708-937c-be7acee7879e None None] Calling delete_port for 12f58b38-55df-4fb2-a086-81f69d8d539c owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:21:04.585378 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.591106 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-384eb958-66e8-4708-937c-be7acee7879e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.616562 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] No DVR routers for this DVR port 12f58b38-55df-4fb2-a086-81f69d8d539c on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:21:04.618268 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-384eb958-66e8-4708-937c-be7acee7879e None None] No DVR routers for this DVR port 12f58b38-55df-4fb2-a086-81f69d8d539c on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:21:04.619773 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384eb958-66e8-4708-937c-be7acee7879e None None] Pushing event deleted for resources: {'Port': ['ID=12f58b38-55df-4fb2-a086-81f69d8d539c,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:04.622029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Pushing event deleted for resources: {'Port': ['ID=12f58b38-55df-4fb2-a086-81f69d8d539c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:04.701062 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.720673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['79f795c6-4f78-4a77-bf67-1d759df61db6']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:04.730188 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:04.730487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca1b71b2-6f11-4807-a847-6e1b04ec9c39') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:04.739607 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.753368 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.759981 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:21:04.765288 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:21:04.894907 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.900825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:04.904019 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] 10.222.0.18 "DELETE /v2.0/networks/79f795c6-4f78-4a77-bf67-1d759df61db6 HTTP/1.1" status: 204 len: 168 time: 0.6705678 Dec 21 05:21:04.916398 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b07d7f0-9dfd-4201-896a-cc0c8e33db4f admin admin] Pushing event deleted for resources: {'Network': ['ID=79f795c6-4f78-4a77-bf67-1d759df61db6,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:05.216626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53556) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:05.256385 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-84d743d7-75b6-4029-81e6-4b6e803bbfe2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=449c18c6acb14eab9ae3cbb2fa4f9b75&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0379817 Dec 21 05:21:05.258758 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53558) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:05.303820 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b51808dc-fdc9-4484-81c1-e0ece28decd2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:05.325198 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b51808dc-fdc9-4484-81c1-e0ece28decd2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:05.443387 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b51808dc-fdc9-4484-81c1-e0ece28decd2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:05.446416 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b51808dc-fdc9-4484-81c1-e0ece28decd2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:05.447647 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b51808dc-fdc9-4484-81c1-e0ece28decd2 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/bf752882-3e55-4013-abdd-8f5804ba7ba1 HTTP/1.1" status: 204 len: 168 time: 0.1879780 Dec 21 05:21:05.455464 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b51808dc-fdc9-4484-81c1-e0ece28decd2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf752882-3e55-4013-abdd-8f5804ba7ba1,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:05.782647 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:21:05.806157 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:21:05.806499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 375c69e0-400c-4fa3-a6aa-e4bfdcdb62dc not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:21:05.806908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12f58b38-55df-4fb2-a086-81f69d8d539c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:21:05.824908 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 12f58b38-55df-4fb2-a086-81f69d8d539c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:21:05.825250 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 12f58b38-55df-4fb2-a086-81f69d8d539c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:21:06.070360 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53564) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:06.108605 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e6a70ad2-d2fa-4250-a071-8a497efcfd49 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=91cbbaa4ae4745df999125b302081ed4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0370760 Dec 21 05:21:06.111457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53566) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:06.160827 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6964104b-4c20-488e-b722-afef389be0de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:06.181746 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6964104b-4c20-488e-b722-afef389be0de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:06.288599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6964104b-4c20-488e-b722-afef389be0de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:06.291150 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-6964104b-4c20-488e-b722-afef389be0de admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:06.292303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-6964104b-4c20-488e-b722-afef389be0de admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/be34e5c4-4b22-42c0-9d04-00c376ec7e36 HTTP/1.1" status: 204 len: 168 time: 0.1799624 Dec 21 05:21:06.300000 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6964104b-4c20-488e-b722-afef389be0de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be34e5c4-4b22-42c0-9d04-00c376ec7e36,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:07.310349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53588) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:07.413702 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-68287596-network', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:07.494508 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Made reservation on behalf of 3928a1cc9e5f4c3d9b1a3ff5f3888786 for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:21:07.496938 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.505531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.577648 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.614410 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.642136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:21:07.648313 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f8bce25-cff9-427a-90d9-db71f7e1de87,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:07.654010 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.654359 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Added segment 518585f4-844a-464b-a4c0-42cf93fc264b of type vlan for network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d Dec 21 05:21:07.696239 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.751497 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.752452 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:07.753032 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:07.819134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] Pushing event updated for resources: {'Network': ['ID=74eac97f-efc7-44f7-b3cc-cbbaa49c512d,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:07.828510 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1a59ae4e-68da-4a2a-a1a6-aa4600e50d53 admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5170686 Dec 21 05:21:07.828968 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:21:07.831880 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53592) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:07.836807 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Request body: {'subnet': {'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-68287596-subnet', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:07.900338 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Made reservation on behalf of 3928a1cc9e5f4c3d9b1a3ff5f3888786 for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:21:07.902691 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.461003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.515761 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Pushing event updated for resources: {'Subnet': ['ID=12634cd6-e77e-46eb-a92e-3842a73fc8c4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:08.524918 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Checking segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:08.525282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Network hostable DHCP agents. Network: 74eac97f-efc7-44f7-b3cc-cbbaa49c512d, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:21:08.603207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:21:08.683238 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, 74eac97f-efc7-44f7-b3cc-cbbaa49c512d) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:08.687291 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:08.687874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.692559 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4652bac5-2ad9-44ab-bd4a-42734789158a None None] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:21:08.772715 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8e57cb4-60bd-4d52-b02b-c088cf38692e admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.9396551 Dec 21 05:21:08.775289 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53594) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:08.779632 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:08.800100 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:21:08.800964 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.865968 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.867082 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.921229 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:08.937076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Allocated IP 172.20.0.2 (74eac97f-efc7-44f7-b3cc-cbbaa49c512d/12634cd6-e77e-46eb-a92e-3842a73fc8c4/d9b6a06b-3897-4a78-a12c-ff1e0ea00983) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:09.085462 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.119840 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.158053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.198021 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:09.200803 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:09.204127 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:09.210756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Pushing event updated for resources: {'Port': ['ID=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:09.263646 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Attempting to bind port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:09.264027 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Attempting to bind port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:09.264396 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Attempting to bind port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:09.269221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 20, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:09.269617 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Checking segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:09.270012 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.270411 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Bound using segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:09.270892 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Bound port: d9b6a06b-3897-4a78-a12c-ff1e0ea00983, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:09.271372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.332590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] For port d9b6a06b-3897-4a78-a12c-ff1e0ea00983, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:09.335794 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] For port d9b6a06b-3897-4a78-a12c-ff1e0ea00983, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:09.392276 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.406855 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.426135 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.450914 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685e758b-dd1e-43e2-a3cd-e8364c39f9f6 None None] Pushing event updated for resources: {'Port': ['ID=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:09.535304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Allocated IP 172.25.5.213 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:09.667423 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.758363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.799486 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:09.802312 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:09.811009 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:09.812691 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Pushing event updated for resources: {'Port': ['ID=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:09.819824 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be27d968-bafe-441a-ab09-9d2975420c1e None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:09.821971 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d9b6a06b-3897-4a78-a12c-ff1e0ea00983 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:09.871178 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:21:09.878254 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:09.878630 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.962531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:09.978143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-3e754368-54fe-4894-94d5-cc18b4f167d4 None None] Provisioning complete for port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:09.978509 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3e754368-54fe-4894-94d5-cc18b4f167d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.031455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port d9b6a06b-3897-4a78-a12c-ff1e0ea00983, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:10.035074 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-3e754368-54fe-4894-94d5-cc18b4f167d4 None None] Port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:10.129037 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.132914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.181283 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:10.334965 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.373845 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51700d66-49b7-4c69-b93f-f05944189b69 None None] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:21:10.477898 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dae9dbce-52f6-4393-8088-4e147dda1c24 None None] Provisioning complete for port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:10.479232 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dae9dbce-52f6-4393-8088-4e147dda1c24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.563498 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Router bf0cf4ff-9300-40db-969b-d101cac14f74 is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:21:10.674444 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:21:10.684376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:21:10.695232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:10.698395 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:10.753953 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.755251 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f8e73c2b-e9d9-40c0-b079-9803773b508f admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.9789877 Dec 21 05:21:10.758580 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53596) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:10.806413 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-dc64e7f2-868e-4de8-b54c-24f0917c7b58 None None] Provisioning complete for port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:10.806775 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dc64e7f2-868e-4de8-b54c-24f0917c7b58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:10.809258 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:11.048850 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:09Z', 'revision_number': 3, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:11.079047 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:21:11.079401 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Updating router bf0cf4ff-9300-40db-969b-d101cac14f74 port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:21:11.176524 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.265193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.334136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Allocated IP 172.20.0.1 (74eac97f-efc7-44f7-b3cc-cbbaa49c512d/12634cd6-e77e-46eb-a92e-3842a73fc8c4/f364b532-7fef-48b8-b74d-74ae1a6e73e9) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:11.435359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.515663 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.540905 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.584445 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:11.587229 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:11.589590 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:11.605917 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.614294 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Pushing event updated for resources: {'Port': ['ID=f364b532-7fef-48b8-b74d-74ae1a6e73e9,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:11.635469 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.663931 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Attempting to bind port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:11.664397 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Attempting to bind port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:11.664838 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Attempting to bind port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:11.670128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-540f038b-f1b4-40b9-bab5-dfce76113c97 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:11.688317 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 20, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:11.688792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:11.689269 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.689736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:11.690304 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Bound port: c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:11.690761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.694312 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21c294b-be3f-419e-9298-820ce2976710 None None] Pushing event updated for resources: {'Port': ['ID=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:11.766496 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] For port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:11.768762 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f43d30c1-91d8-4763-bfb1-327c8cad3f31 None None] Provisioning complete for port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:11.769131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f43d30c1-91d8-4763-bfb1-327c8cad3f31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.805330 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d9b6a06b-3897-4a78-a12c-ff1e0ea00983 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:11.810831 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] For port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:11.842099 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.844812 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f43d30c1-91d8-4763-bfb1-327c8cad3f31 None None] Port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:11.865705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:11.865991 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.887610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:11.936275 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea80057d-9a0b-427a-bc8f-320fa5d0adcc None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:11.976770 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:11.977474 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:11.983084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21c294b-be3f-419e-9298-820ce2976710 None None] Pushing event updated for resources: {'Port': ['ID=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:12.008430 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.054428 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ce170bc9-2161-4754-96a8-e0bb671f5dc1 None None] Provisioning complete for port f364b532-7fef-48b8-b74d-74ae1a6e73e9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:12.055081 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce170bc9-2161-4754-96a8-e0bb671f5dc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.066618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.134858 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.136626 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Pushing event updated for resources: {'Port': ['ID=f364b532-7fef-48b8-b74d-74ae1a6e73e9,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:12.148129 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ce170bc9-2161-4754-96a8-e0bb671f5dc1 None None] Port f364b532-7fef-48b8-b74d-74ae1a6e73e9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:12.165799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:12.232102 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:12.233588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:12.307376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-07644296-3214-4791-a92b-bba9bdfedcf7 None None] Provisioning complete for port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:12.307757 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07644296-3214-4791-a92b-bba9bdfedcf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.349940 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Router bf0cf4ff-9300-40db-969b-d101cac14f74 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:21:12.455597 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07644296-3214-4791-a92b-bba9bdfedcf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.468473 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:12.469316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:21:12.475396 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2a1b777f-0d38-4821-b289-96d9c1f8c3ae admin admin] 10.222.0.18 "PUT /v2.0/routers/bf0cf4ff-9300-40db-969b-d101cac14f74/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7158537 Dec 21 05:21:12.502491 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35f5b889-0be5-4777-9f5b-ce7548fee37b None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:21:12.505262 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-07644296-3214-4791-a92b-bba9bdfedcf7 None None] For port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:12.575066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-07644296-3214-4791-a92b-bba9bdfedcf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.628128 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07644296-3214-4791-a92b-bba9bdfedcf7 None None] Pushing event updated for resources: {'Port': ['ID=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:12.693991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-13094447-b6a0-45c1-9118-1bdf18366d64 None None] Provisioning complete for port f364b532-7fef-48b8-b74d-74ae1a6e73e9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:12.694375 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-13094447-b6a0-45c1-9118-1bdf18366d64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:12.746645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-13094447-b6a0-45c1-9118-1bdf18366d64 None None] Port f364b532-7fef-48b8-b74d-74ae1a6e73e9 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:13.209889 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53612) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:13.214815 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-657709559-network', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:13.305851 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Made reservation on behalf of b471e347d90547b48bfcfdbcaf9be0da for: {'network': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:21:13.308570 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for network, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.318521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.404161 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.454531 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.480185 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=110310) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 21 05:21:13.490649 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cb0efc6-d71d-4a90-8ba7-ae12589b5190,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:13.496028 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.496373 n-d-822053-11 neutron-server[110310]: INFO neutron.db.segments_db [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Added segment 6e6195e2-63f8-4ffb-81a0-74d6fc41301c of type vlan for network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 Dec 21 05:21:13.541649 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8762542276684'] for network, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.603133 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153'] for network, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.604134 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:13.604709 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.666136 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] Pushing event updated for resources: {'Network': ['ID=f6b3c46a-0ebe-43fd-bb0e-e777fa04e221,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:13.675897 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 details requested by agent ovs-agent-n-d-822053-11 with host n-d-822053-11 {{(pid=110312) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 21 05:21:13.705675 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-930e4550-0789-484d-b638-e1da26794e9f admin admin] 10.222.0.18 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4919434 Dec 21 05:21:13.705890 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53614) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:13.711120 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Request body: {'subnet': {'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-657709559-subnet', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'ip_version': 4}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:13.786033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Made reservation on behalf of b471e347d90547b48bfcfdbcaf9be0da for: {'subnet': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:21:13.788651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-529437196'] for subnet, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:13.812205 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:13.867355 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:13.868001 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.323618 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-529853736', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-529437214'] for subnet, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.382184 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:14.393261 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Checking segment: {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:14.393694 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Network hostable DHCP agents. Network: f6b3c46a-0ebe-43fd-bb0e-e777fa04e221, hostable agents: ['0e7efdb6-b734-456d-b1f1-e0d11b32e01e'], hosted agents: [] {{(pid=110310) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 21 05:21:14.449482 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 is scheduled to be hosted by DHCP agent 0e7efdb6-b734-456d-b1f1-e0d11b32e01e with binding_index 1 {{(pid=110310) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 21 05:21:14.505799 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-822053-11, f6b3c46a-0ebe-43fd-bb0e-e777fa04e221) {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:14.505990 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:21:14.510196 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:14.510797 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.514618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da848c2a-4290-48b6-8a2e-e3f20c60d514 None None] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:21:14.518148 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:14.519394 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:14.584231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-be2c0f8a-b2b9-4ce7-90b2-673040edcab9 admin admin] 10.222.0.18 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8765283 Dec 21 05:21:14.586754 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53616) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:14.591106 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:14.623230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcf2d0915-0a8b-52c8-8422-a991e902b6da-f6b3c46a-0ebe-43fd-bb0e-e777fa04e221', 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221', 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'fixed_ips': [{'subnet_id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9'}]}} from n-d-822053-11. {{(pid=110312) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 21 05:21:14.624167 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.627100 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:14.700679 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7876106', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14273'] for router, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.702120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7876350', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7874123', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7866378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-14286'] for router, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.757793 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.762716 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.db_base_plugin_common [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Allocated IP 172.20.0.2 (f6b3c46a-0ebe-43fd-bb0e-e777fa04e221/f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9/16f49bd6-c1af-49c5-a052-8b58a438cbdf) {{(pid=110312) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:14.824793 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 2, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:14.856112 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:21:14.856723 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Updating router bf0cf4ff-9300-40db-969b-d101cac14f74 port f364b532-7fef-48b8-b74d-74ae1a6e73e9 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:21:14.882807 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.912074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Publish callbacks [] for port, precommit_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.971880 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:14.992617 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718'] for port, after_create {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.038225 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 is already hosted by enough agents. {{(pid=110312) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:15.040985 n-d-822053-11 neutron-server[110312]: DEBUG neutron.scheduler.base_scheduler [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Resources bound (agent type, host, resource id): {{(pid=110312) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:15.043520 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Received port after_create {{(pid=110312) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:15.052844 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Pushing event updated for resources: {'Port': ['ID=16f49bd6-c1af-49c5-a052-8b58a438cbdf,revision_number=1']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:15.103054 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Attempting to bind port 16f49bd6-c1af-49c5-a052-8b58a438cbdf on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:15.103595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Attempting to bind port 16f49bd6-c1af-49c5-a052-8b58a438cbdf by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:15.103952 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Attempting to bind port 16f49bd6-c1af-49c5-a052-8b58a438cbdf on network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:15.109189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 20, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:15.109489 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Checking segment: {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:15.109890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.110282 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Bound using segment: {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:15.110833 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Bound port: 16f49bd6-c1af-49c5-a052-8b58a438cbdf, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:15.111229 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.175236 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] For port 16f49bd6-c1af-49c5-a052-8b58a438cbdf, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:15.178801 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] For port 16f49bd6-c1af-49c5-a052-8b58a438cbdf, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16f49bd6-c1af-49c5-a052-8b58a438cbdf,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:15.241459 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.249681 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.264435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.284104 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.306507 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.313569 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb7f7bd-6fef-4a8f-b231-4c2600b735c7 None None] Pushing event updated for resources: {'Port': ['ID=16f49bd6-c1af-49c5-a052-8b58a438cbdf,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:15.382982 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Pushing event updated for resources: {'Port': ['ID=f364b532-7fef-48b8-b74d-74ae1a6e73e9,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:15.416586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.418606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.418606 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.418866 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Allocated IP 172.25.5.44 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:15.419372 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.419372 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.419372 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.419372 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.419372 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.419868 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.420440 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.420795 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.421188 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.421572 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110313) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:21:15.447024 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Attempting to bind port f364b532-7fef-48b8-b74d-74ae1a6e73e9 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:15.447378 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Attempting to bind port f364b532-7fef-48b8-b74d-74ae1a6e73e9 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:15.447565 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Attempting to bind port f364b532-7fef-48b8-b74d-74ae1a6e73e9 on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:15.453586 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 20, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:15.454049 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Checking segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:15.454514 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.454987 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Bound using segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:15.455517 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Bound port: f364b532-7fef-48b8-b74d-74ae1a6e73e9, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:15.456072 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.554692 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] For port f364b532-7fef-48b8-b74d-74ae1a6e73e9, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:15.558061 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] For port f364b532-7fef-48b8-b74d-74ae1a6e73e9, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f364b532-7fef-48b8-b74d-74ae1a6e73e9,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:15.582983 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.640313 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.691221 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b5f64846-faf7-4a20-9d43-6010ed824cac None None] Provisioning complete for port f364b532-7fef-48b8-b74d-74ae1a6e73e9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:15.691601 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b5f64846-faf7-4a20-9d43-6010ed824cac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.702575 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:15.703246 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:15.709995 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.781145 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da49374-abf8-4285-b905-de32e48234b0 None None] Pushing event updated for resources: {'Port': ['ID=f364b532-7fef-48b8-b74d-74ae1a6e73e9,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:15.796243 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b5f64846-faf7-4a20-9d43-6010ed824cac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:15.825388 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:15.828377 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:15.837944 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:15.844605 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Pushing event updated for resources: {'Port': ['ID=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:15.857867 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-203b73fd-49ec-47d3-b345-5d9d0917cb47 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:15.863321 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b5f64846-faf7-4a20-9d43-6010ed824cac None None] For port f364b532-7fef-48b8-b74d-74ae1a6e73e9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f364b532-7fef-48b8-b74d-74ae1a6e73e9,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:15.887007 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:15.908936 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16f49bd6-c1af-49c5-a052-8b58a438cbdf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:15.954713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b5f64846-faf7-4a20-9d43-6010ed824cac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.016139 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f64846-faf7-4a20-9d43-6010ed824cac None None] Pushing event updated for resources: {'Port': ['ID=f364b532-7fef-48b8-b74d-74ae1a6e73e9,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:16.026881 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 16f49bd6-c1af-49c5-a052-8b58a438cbdf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:16.027285 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.079240 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ead66727-5475-424b-bc57-6ba4c909dd26 None None] Provisioning complete for port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:16.079610 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ead66727-5475-424b-bc57-6ba4c909dd26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.112685 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:16.144031 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4db9ff-e478-44c8-9f3f-7f9d62bda378 None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:21:16.144517 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-ead66727-5475-424b-bc57-6ba4c909dd26 None None] Port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:16.155089 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.177662 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ead66727-5475-424b-bc57-6ba4c909dd26 None None] Provisioning complete for port f364b532-7fef-48b8-b74d-74ae1a6e73e9 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:16.178123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ead66727-5475-424b-bc57-6ba4c909dd26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.226590 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] For port 16f49bd6-c1af-49c5-a052-8b58a438cbdf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16f49bd6-c1af-49c5-a052-8b58a438cbdf,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:16.235650 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.306260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.383456 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Pushing event updated for resources: {'Port': ['ID=16f49bd6-c1af-49c5-a052-8b58a438cbdf,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:16.466327 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7876231', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7874172'] for router, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.522338 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49db055f-092f-4ebe-b177-19ddd190a6cc None None] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:21:16.609894 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9a9dd4de-13f3-49b6-a5d3-4dd2ac95f6fe None None] Provisioning complete for port 16f49bd6-c1af-49c5-a052-8b58a438cbdf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:16.610603 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a9dd4de-13f3-49b6-a5d3-4dd2ac95f6fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.701003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Router 107c160a-a146-4cde-9dc4-dd53242e5ddf is scheduled to L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 with binding_index 1 {{(pid=110310) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 21 05:21:16.829003 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:21:16.839230 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Sync routers for ids ['107c160a-a146-4cde-9dc4-dd53242e5ddf'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:21:16.851454 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Routers {'107c160a-a146-4cde-9dc4-dd53242e5ddf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:16.852247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['107c160a-a146-4cde-9dc4-dd53242e5ddf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:16.890909 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:16.892984 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-20652647-08f9-4798-a997-a2d909560a6e admin admin] 10.222.0.18 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.3045385 Dec 21 05:21:16.895240 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53618) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:17.107247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-ddece2a1-b244-4bfe-8e76-d674f417ac82 None None] Provisioning complete for port 16f49bd6-c1af-49c5-a052-8b58a438cbdf triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:17.107614 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ddece2a1-b244-4bfe-8e76-d674f417ac82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.163150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Set router 107c160a-a146-4cde-9dc4-dd53242e5ddf gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:17.306769 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.377227 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:21:16Z', 'revision_number': 3, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:17.408059 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Checking router: 107c160a-a146-4cde-9dc4-dd53242e5ddf for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:21:17.408505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Updating router 107c160a-a146-4cde-9dc4-dd53242e5ddf port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 binding host n-d-822053-11 {{(pid=110312) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:21:17.435075 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.690467 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Publish callbacks [] for port, precommit_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.736921 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Allocated IP 172.20.0.1 (f6b3c46a-0ebe-43fd-bb0e-e777fa04e221/f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9/4983446e-9d52-4c9d-90f9-7706c99a4437) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:17.741140 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.794761 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03951657-d0b9-45c6-b0af-b67bbf0eaedd None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:17.808942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Attempting to bind port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:17.809326 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Attempting to bind port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:17.809698 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Attempting to bind port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 on network 30f5b79f-275c-4003-8999-814f6db142e1 {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:17.814314 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96989fbb-3b01-4a48-9773-40578f2ae37b None None] Pushing event updated for resources: {'Port': ['ID=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,revision_number=2']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:17.822076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 20, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:17.822076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Checking segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110312) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:17.822076 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.822076 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Bound using segment: {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'} {{(pid=110312) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:17.823123 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.managers [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Bound port: b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4831152c-b350-45f0-9c97-ced0bcd6cc54', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1'}}] {{(pid=110312) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:17.823123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.847463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f364b532-7fef-48b8-b74d-74ae1a6e73e9 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:17.874406 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.915013 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-bb6d656b-8f13-4934-99d2-e1023cd6480f None None] Provisioning complete for port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:17.915383 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-bb6d656b-8f13-4934-99d2-e1023cd6480f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.920178 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] For port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793, host n-d-822053-11, cleared binding levels {{(pid=110312) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:17.923322 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] For port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:17.964974 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port f364b532-7fef-48b8-b74d-74ae1a6e73e9 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:17.965344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:17.966852 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-bb6d656b-8f13-4934-99d2-e1023cd6480f None None] Port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:17.985518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.009611 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.021613 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:18.027995 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:18.031514 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:18.056429 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Pushing event updated for resources: {'Port': ['ID=4983446e-9d52-4c9d-90f9-7706c99a4437,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:18.068830 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59970182-0c5a-4e83-8d0e-dfc1c39632c6 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:21:18.076954 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7878731'] for router_interface, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.109942 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16f49bd6-c1af-49c5-a052-8b58a438cbdf up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:18.112358 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96989fbb-3b01-4a48-9773-40578f2ae37b None None] Pushing event updated for resources: {'Port': ['ID=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,revision_number=3']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:18.115923 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Routers {'107c160a-a146-4cde-9dc4-dd53242e5ddf'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:18.116551 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['107c160a-a146-4cde-9dc4-dd53242e5ddf'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:18.244654 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-b89ab28f-7834-49b7-80c8-3edf79ff322a None None] Provisioning complete for port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:18.245032 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b89ab28f-7834-49b7-80c8-3edf79ff322a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.266776 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.302010 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] Set router 107c160a-a146-4cde-9dc4-dd53242e5ddf gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:18.305293 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 16f49bd6-c1af-49c5-a052-8b58a438cbdf triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:18.306061 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.432315 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.506718 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.532266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b89ab28f-7834-49b7-80c8-3edf79ff322a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.578081 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7993199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7878719'] for router_interface, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.578537 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-b89ab28f-7834-49b7-80c8-3edf79ff322a None None] For port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:18.580848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Pushing event updated for resources: {'Port': ['ID=4983446e-9d52-4c9d-90f9-7706c99a4437,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:18.610625 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:21:16Z', 'revision_number': 3, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:18.638527 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f032ca9-2fee-4d13-97ef-ad22ae153b6e None None] The sync data for ids ['107c160a-a146-4cde-9dc4-dd53242e5ddf'] in n-d-822053-11 is: [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:21:16Z', 'revision_number': 3, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:21:18.642855 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b89ab28f-7834-49b7-80c8-3edf79ff322a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.684617 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:18.686093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:18.713648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89ab28f-7834-49b7-80c8-3edf79ff322a None None] Pushing event updated for resources: {'Port': ['ID=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:18.770346 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-e9600c16-21d2-4f85-ada8-950cd4d8f3f2 None None] Provisioning complete for port 4983446e-9d52-4c9d-90f9-7706c99a4437 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:18.770726 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e9600c16-21d2-4f85-ada8-950cd4d8f3f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:18.807248 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-e9600c16-21d2-4f85-ada8-950cd4d8f3f2 None None] Port 4983446e-9d52-4c9d-90f9-7706c99a4437 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:18.819209 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Router 107c160a-a146-4cde-9dc4-dd53242e5ddf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:21:18.959460 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:21:18.964942 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f27cb252-2647-4677-94b2-e8f4497a3bcb admin admin] 10.222.0.18 "PUT /v2.0/routers/107c160a-a146-4cde-9dc4-dd53242e5ddf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0686004 Dec 21 05:21:19.031058 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-f63b212e-8f3e-48ac-aa1a-ce5e18fcb587 None None] Provisioning complete for port 4983446e-9d52-4c9d-90f9-7706c99a4437 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:19.032741 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-f63b212e-8f3e-48ac-aa1a-ce5e18fcb587 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:19.070434 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-f63b212e-8f3e-48ac-aa1a-ce5e18fcb587 None None] Port 4983446e-9d52-4c9d-90f9-7706c99a4437 cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:19.680841 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53626) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:19.685513 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-339590498', 'description': 'tempest-secgroup-smoke-339590498 description', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:19.780731 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:19.801925 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:19.854030 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:19.858173 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:19.858574 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:19.929163 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:19.959417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fe74e25e-03de-475d-9b15-eac39b9c01e7,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:19.980995 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-3911056f-3a82-4131-9771-bb11c6b53540 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.008067 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.008067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ee3bf843-d3fd-4a60-8623-da2797e890a1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3257325 Dec 21 05:21:20.010603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53628) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:20.015176 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group_rule': {'security_group_id': 'fe74e25e-03de-475d-9b15-eac39b9c01e7', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:20.117288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.173098 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.248996 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.267242 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=79360734-ca89-4247-982e-c9abf2a77554,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:20.307468 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Sync routers for ids ['107c160a-a146-4cde-9dc4-dd53242e5ddf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:21:20.318758 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Routers {'107c160a-a146-4cde-9dc4-dd53242e5ddf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:20.328048 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['107c160a-a146-4cde-9dc4-dd53242e5ddf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:20.348086 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.349429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-1063593b-df33-4aba-b5a2-ccf0b1c074b8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3378317 Dec 21 05:21:20.352119 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53630) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:20.361015 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group_rule': {'security_group_id': 'fe74e25e-03de-475d-9b15-eac39b9c01e7', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:20.422198 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Set router 107c160a-a146-4cde-9dc4-dd53242e5ddf gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:20.441974 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.510120 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.585882 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.606406 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=53dbc110-c685-4481-8565-ab355032fa2c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:20.630605 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4983446e-9d52-4c9d-90f9-7706c99a4437', 'name': '', 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'mac_address': 'fa:16:3e:ce:e8:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_interface', 'standard_attr_id': 4375, 'fixed_ips': [{'subnet_id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:17Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 2, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'subnets': [{'id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:20.656806 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Checking router: 107c160a-a146-4cde-9dc4-dd53242e5ddf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:21:20.659737 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Updating router 107c160a-a146-4cde-9dc4-dd53242e5ddf port 4983446e-9d52-4c9d-90f9-7706c99a4437 binding host n-d-822053-11 {{(pid=110313) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 21 05:21:20.679864 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.681093 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-c3267832-5aee-4661-8edb-fa8999e42362 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3280523 Dec 21 05:21:20.682682 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.683850 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53632) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:20.688274 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group_rule': {'security_group_id': 'fe74e25e-03de-475d-9b15-eac39b9c01e7', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:20.773751 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.829525 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.903045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.921631 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40cceb1e-4e37-418f-9699-3eddb7c59126,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:20.943596 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Publish callbacks [] for port, precommit_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.988019 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:20.989273 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-717068d3-4cc5-4c8e-9043-7299cd4fcbdc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3044019 Dec 21 05:21:20.992684 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53634) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:20.997436 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group_rule': {'security_group_id': 'fe74e25e-03de-475d-9b15-eac39b9c01e7', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:21.014415 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.058699 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb74d8d-a496-4319-8e4b-1c6c2be0ea58 None None] Pushing event updated for resources: {'Port': ['ID=4983446e-9d52-4c9d-90f9-7706c99a4437,revision_number=3']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:21.094016 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.114411 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Attempting to bind port 4983446e-9d52-4c9d-90f9-7706c99a4437 on host n-d-822053-11 for vnic_type normal with profile {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:21.115080 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Attempting to bind port 4983446e-9d52-4c9d-90f9-7706c99a4437 by drivers openvswitch,hyperv on host n-d-822053-11 at level 0 using segments [{'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:21.115509 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Attempting to bind port 4983446e-9d52-4c9d-90f9-7706c99a4437 on network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:21.120972 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Checking agent: {'id': '2f1f6510-15a8-4d66-af21-9c6bb2362eeb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 32, 26), 'started_at': datetime.datetime(2021, 12, 21, 3, 32, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 20, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-822053-11'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:21.121428 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Checking segment: {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110313) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:21.121949 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.122435 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Bound using segment: {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'} {{(pid=110313) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:21.122999 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.managers [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Bound port: 4983446e-9d52-4c9d-90f9-7706c99a4437, host: n-d-822053-11, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e6195e2-63f8-4ffb-81a0-74d6fc41301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221'}}] {{(pid=110313) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:21.123445 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.159698 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.190391 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] For port 4983446e-9d52-4c9d-90f9-7706c99a4437, host n-d-822053-11, cleared binding levels {{(pid=110313) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:21.193618 n-d-822053-11 neutron-server[110313]: DEBUG neutron.plugins.ml2.db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] For port 4983446e-9d52-4c9d-90f9-7706c99a4437, host n-d-822053-11, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4983446e-9d52-4c9d-90f9-7706c99a4437,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110313) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:21.243562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.258926 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=49569f04-99c0-44b5-925f-78b5536df9a4,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:21.266557 n-d-822053-11 neutron-server[110313]: DEBUG neutron_lib.callbacks.manager [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110313) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.314252 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-17c0342a-5a57-44bd-8b71-75eb77af2397 None None] Provisioning complete for port 4983446e-9d52-4c9d-90f9-7706c99a4437 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:21.314252 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17c0342a-5a57-44bd-8b71-75eb77af2397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.330034 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Routers {'107c160a-a146-4cde-9dc4-dd53242e5ddf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:21.330721 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:20:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['107c160a-a146-4cde-9dc4-dd53242e5ddf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:21.359821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.361271 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9d75b9d7-51d4-4b4a-b99c-40e01bcbb0d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3673358 Dec 21 05:21:21.364127 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53636) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:21.367531 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb74d8d-a496-4319-8e4b-1c6c2be0ea58 None None] Pushing event updated for resources: {'Port': ['ID=4983446e-9d52-4c9d-90f9-7706c99a4437,revision_number=4']} {{(pid=110313) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:21.368839 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group_rule': {'security_group_id': 'fe74e25e-03de-475d-9b15-eac39b9c01e7', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:21.414637 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17c0342a-5a57-44bd-8b71-75eb77af2397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.450354 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-17c0342a-5a57-44bd-8b71-75eb77af2397 None None] For port 4983446e-9d52-4c9d-90f9-7706c99a4437, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4983446e-9d52-4c9d-90f9-7706c99a4437,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:21.455582 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Project 3928a1cc9e5f4c3d9b1a3ff5f3888786 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:21:21.462247 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.529002 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-17c0342a-5a57-44bd-8b71-75eb77af2397 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.538016 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.549151 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] Set router 107c160a-a146-4cde-9dc4-dd53242e5ddf gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:21.576020 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c0342a-5a57-44bd-8b71-75eb77af2397 None None] Pushing event updated for resources: {'Port': ['ID=4983446e-9d52-4c9d-90f9-7706c99a4437,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:21.580280 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.596496 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=73c62cf5-288b-40eb-b45b-6ae30ffe051c,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:21.649759 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-46dd3583-372a-4846-b661-3a3755308614 None None] Provisioning complete for port 4983446e-9d52-4c9d-90f9-7706c99a4437 triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:21.650130 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46dd3583-372a-4846-b661-3a3755308614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.662031 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.666114 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f14740e5-7212-4a2d-ab89-5498c729ef30 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2983348 Dec 21 05:21:21.666259 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53638) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:21.671349 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'security_group_rule': {'security_group_id': 'fe74e25e-03de-475d-9b15-eac39b9c01e7', 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:21.751167 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4983446e-9d52-4c9d-90f9-7706c99a4437', 'name': '', 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'mac_address': 'fa:16:3e:ce:e8:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_interface', 'standard_attr_id': 4375, 'fixed_ips': [{'subnet_id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:17Z', 'updated_at': '2021-12-21T05:21:21Z', 'revision_number': 4, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'subnets': [{'id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:21.751944 n-d-822053-11 neutron-server[110310]: INFO neutron.db.securitygroups_db [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Project 3928a1cc9e5f4c3d9b1a3ff5f3888786 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 21 05:21:21.757593 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.780541 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb4f1284-5657-428e-a3bd-d25fe2eaba93 None None] The sync data for ids ['107c160a-a146-4cde-9dc4-dd53242e5ddf'] in n-d-822053-11 is: [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': '4983446e-9d52-4c9d-90f9-7706c99a4437', 'name': '', 'network_id': 'f6b3c46a-0ebe-43fd-bb0e-e777fa04e221', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'mac_address': 'fa:16:3e:ce:e8:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_interface', 'standard_attr_id': 4375, 'fixed_ips': [{'subnet_id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:17Z', 'updated_at': '2021-12-21T05:21:21Z', 'revision_number': 4, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'subnets': [{'id': 'f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:21:21.822653 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.906188 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451204'] for security_group_rule, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:21.924306 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0843f147-1d43-40ac-aa32-6c5ef71929d3,revision_number=0']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:22.011065 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group_rule, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:22.012476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-5599b4f2-507e-4fa7-9525-17df93e91f96 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3449523 Dec 21 05:21:22.232177 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-9bfa57e0-a3d3-4a49-b660-4a6361ac0800 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-339590498&fields=id&tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786 HTTP/1.1" status: 200 len: 267 time: 0.0457327 Dec 21 05:21:22.344737 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-6281b3a4-5198-4ac7-8f96-dafbe5a74f35 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:22.346335 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-6281b3a4-5198-4ac7-8f96-dafbe5a74f35 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 808 time: 0.1071856 Dec 21 05:21:22.362641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-1a2f3a9c-814c-4a55-acb2-155ce569eeca tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/quotas/3928a1cc9e5f4c3d9b1a3ff5f3888786 HTTP/1.1" status: 200 len: 375 time: 0.0094640 Dec 21 05:21:22.414016 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-765ee07b-8cef-4633-be2f-4a14d6af47d4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0452068 Dec 21 05:21:22.519399 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-62c143c1-afdd-45ba-a346-5549c5d61a2f service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:21:22.520414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-62c143c1-afdd-45ba-a346-5549c5d61a2f service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0941405 Dec 21 05:21:22.607395 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-abd95b4c-5bac-4022-8f82-13f73df0ab56 service neutron] 10.222.0.18 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806990 Dec 21 05:21:22.700917 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-51b4fb48-7e3f-4804-895c-1c5a5531f04c service neutron] 10.222.0.18 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873103 Dec 21 05:21:22.797885 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fae65a4-82a7-45c4-9784-fa3119f6d757 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:22.936414 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fa466c27-b403-48ad-854c-ae68eed91146 req-53090bd0-9618-4d41-afdf-13404ec5bd9a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 210 time: 0.0292552 Dec 21 05:21:23.649113 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:23.801565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4983446e-9d52-4c9d-90f9-7706c99a4437 up at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:23.860802 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Provisioning complete for port 4983446e-9d52-4c9d-90f9-7706c99a4437 triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:23.861169 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:23.945659 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:24.030100 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d1158fc5-9aad-4d70-87ca-64a50a93e967 req-8115d510-9050-4044-b401-125407e2ac15 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 210 time: 0.0262959 Dec 21 05:21:25.123320 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b8b95e82-f095-4479-8ef5-6022256157cb req-cea06d31-4aea-4022-bafe-7b3c0dcc9d6d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 210 time: 0.0262878 Dec 21 05:21:25.253339 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-5592c785-3849-4c79-b229-592a1b8aadcd tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:25.254777 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-5592c785-3849-4c79-b229-592a1b8aadcd tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 808 time: 0.1048546 Dec 21 05:21:25.331562 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-da9e01cf-64b5-4a1a-847c-b035226ca942 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786 HTTP/1.1" status: 200 len: 379 time: 0.0532169 Dec 21 05:21:25.344171 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'port': {'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'admin_state_up': True, 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'security_groups': ['fe74e25e-03de-475d-9b15-eac39b9c01e7']}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:25.437245 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:25.523103 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Made reservation on behalf of 3928a1cc9e5f4c3d9b1a3ff5f3888786 for: {'port': 1} {{(pid=110310) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:21:25.526651 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:25.637865 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:25.649814 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Allocated IP 172.20.0.13 (74eac97f-efc7-44f7-b3cc-cbbaa49c512d/12634cd6-e77e-46eb-a92e-3842a73fc8c4/c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:25.787846 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:25.814441 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:25.871043 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:25.908501 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:25.913990 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:25.917711 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:25.951519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:25.980764 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:25.981381 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.045954 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-e1da7657-8518-4730-a0a8-7e92c239bcb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7055268 Dec 21 05:21:26.073332 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Request body: {'port': {'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-822053-11'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:26.132363 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.175752 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9a05fe65-efad-49db-afde-9a03ec418864 None None] Provisioning complete for port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:26.176488 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9a05fe65-efad-49db-afde-9a03ec418864 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.214290 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9a05fe65-efad-49db-afde-9a03ec418864 None None] Port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:21:26.330002 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a220ec02-9d0f-404c-9d07-d90d7a864090 req-79d67137-3c68-482e-8347-a454a98e5ab4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:26.331508 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a220ec02-9d0f-404c-9d07-d90d7a864090 req-79d67137-3c68-482e-8347-a454a98e5ab4 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 932 time: 0.1028862 Dec 21 05:21:26.409258 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a220ec02-9d0f-404c-9d07-d90d7a864090 req-a96e6549-64bd-46d4-92c5-ccf517f96923 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0697279 Dec 21 05:21:26.456673 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc {{(pid=110310) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:21:26.464434 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.476453 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.provisioning_blocks [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Transition to ACTIVE for port object c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc will not be triggered until provisioned by entity L2. {{(pid=110310) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:21:26.540352 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.590487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:26.665141 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Attempting to bind port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc on host n-h2-822053-11 for vnic_type normal with profile {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:21:26.665489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Attempting to bind port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc by drivers openvswitch,hyperv on host n-h2-822053-11 at level 0 using segments [{'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:21:26.665826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Attempting to bind port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:26.670603 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d not bound, no agent of type Open vSwitch agent registered on host n-h2-822053-11 {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:21:26.670956 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Attempting to bind port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:21:26.676089 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Checking agent: {'id': '9185a4b4-235c-4ade-85c2-094723fa6ad3', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 25), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 21, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:21:26.676435 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Checking segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110310) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:21:26.676828 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Bound using segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} {{(pid=110310) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:21:26.677260 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.managers [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Bound port: c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host: n-h2-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}}] {{(pid=110310) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:21:26.677662 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.743430 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, cleared binding levels {{(pid=110310) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:21:26.746488 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110310) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:21:26.809122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.850767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:26.850767 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:26.850767 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] 10.222.0.31 "PUT /v2.0/ports/c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1093 time: 0.7790782 Dec 21 05:21:26.850767 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:21:26.850767 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db9104ce-fe37-4503-9fab-59d724735d02" -d '{"events": [{"name": "network-changed", "server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:21:26.875650 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd4edad5-4f78-4c58-8dd6-767e9b01bc59 service neutron] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=3']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:26.896205 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:21:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ecac60b0-07f3-44b7-917c-6ad762a678aa x-openstack-request-id: req-ecac60b0-07f3-44b7-917c-6ad762a678aa {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:21:26.896503 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:21:26.897277 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-ecac60b0-07f3-44b7-917c-6ad762a678aa {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:21:26.897686 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'status': 'completed', 'code': 200} Dec 21 05:21:26.984251 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9104ce-fe37-4503-9fab-59d724735d02 req-9a85fa9b-e1e2-49e6-beda-16846fc9ba93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:26.985818 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db9104ce-fe37-4503-9fab-59d724735d02 req-9a85fa9b-e1e2-49e6-beda-16846fc9ba93 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1096 time: 0.0433729 Dec 21 05:21:27.101487 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9104ce-fe37-4503-9fab-59d724735d02 req-ba92f65f-171f-4140-9330-48350c8a9bba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:27.103161 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db9104ce-fe37-4503-9fab-59d724735d02 req-ba92f65f-171f-4140-9330-48350c8a9bba service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0994506 Dec 21 05:21:27.202297 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9104ce-fe37-4503-9fab-59d724735d02 req-df6bd847-80f2-48c8-9352-b16077724469 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:27.203788 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-db9104ce-fe37-4503-9fab-59d724735d02 req-df6bd847-80f2-48c8-9352-b16077724469 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0888338 Dec 21 05:21:27.309738 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-b70375b3-25b1-4e48-95e6-5f80e0523a7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:27.311293 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-b70375b3-25b1-4e48-95e6-5f80e0523a7f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1096 time: 0.0394111 Dec 21 05:21:27.365149 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-d84982dc-5d15-4713-9ca6-9c944d0a66e1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 217 time: 0.0340240 Dec 21 05:21:27.420293 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-118161e4-4f70-4136-be7d-cd42c386afc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:27.421771 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-118161e4-4f70-4136-be7d-cd42c386afc6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0456381 Dec 21 05:21:27.474389 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-9cf312dd-15d9-4027-b17c-e54d86f50852 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:27.476442 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-9cf312dd-15d9-4027-b17c-e54d86f50852 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0431633 Dec 21 05:21:27.580855 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3daa69d-0c83-4c29-99c9-a5a4ee91cc24 req-8305e375-322a-4592-b200-82c633bf2488 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:27.582303 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3daa69d-0c83-4c29-99c9-a5a4ee91cc24 req-8305e375-322a-4592-b200-82c633bf2488 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 944 time: 0.1023796 Dec 21 05:21:27.613712 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-aec6de27-7f28-4c0e-8d49-6c43d2d8fc9e service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1241586 Dec 21 05:21:27.663476 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b3daa69d-0c83-4c29-99c9-a5a4ee91cc24 req-9827e9ed-3fc3-4e3b-bc1e-302482bf550e tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0753129 Dec 21 05:21:27.723195 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-75c9c3e3-7ef5-4168-9b41-800c726e5152 req-557e95a6-076e-4f37-95ab-b3d8c1dc92f8 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958228 Dec 21 05:21:29.077170 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ddf6f0d-ff4c-472c-9a63-9f2781f57a80 req-8a587e34-0d37-410c-a2f1-554b25b85aff tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:29.078649 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ddf6f0d-ff4c-472c-9a63-9f2781f57a80 req-8a587e34-0d37-410c-a2f1-554b25b85aff tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 944 time: 0.3456025 Dec 21 05:21:29.128661 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ddf6f0d-ff4c-472c-9a63-9f2781f57a80 req-34736e78-9b36-4bc4-9a1d-79b446ecb5ae tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433633 Dec 21 05:21:29.376868 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:21:29.466577 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:29.480810 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:21:29.671518 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:29.683521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:21:29.702255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:29.802904 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:29.848274 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:30.198247 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:21:30.245457 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87087ce-c35c-4c89-8b5f-f8fc9c1e4338 req-2a73aa87-ab94-4c36-a4e5-6d753462ae1e tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:30.246989 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a87087ce-c35c-4c89-8b5f-f8fc9c1e4338 req-2a73aa87-ab94-4c36-a4e5-6d753462ae1e tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 945 time: 0.0475671 Dec 21 05:21:30.295074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a87087ce-c35c-4c89-8b5f-f8fc9c1e4338 req-274af1b4-7e1e-4302-ab9f-cf9c28656b2e tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420589 Dec 21 05:21:31.384883 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:21:31.414442 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4689f261-43a0-4b37-be8a-851044a127fe req-1b711795-77a6-4348-9478-182102b4a9ec tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:31.416076 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4689f261-43a0-4b37-be8a-851044a127fe req-1b711795-77a6-4348-9478-182102b4a9ec tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 945 time: 0.0538063 Dec 21 05:21:31.468846 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4689f261-43a0-4b37-be8a-851044a127fe req-0eab752c-225c-4664-a51e-a485c449fb3d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467508 Dec 21 05:21:31.494652 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning for port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:21:31.498615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:21:31.499027 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:31.573354 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:31.595008 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:21:31.597233 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29b75a83-2e78-4ee9-803a-a773719e91d2" -d '{"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-plugged", "status": "completed", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:21:31.611766 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:21:31.634108 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:21:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e8d207d-19f1-43de-84e1-e9951feec8aa x-openstack-request-id: req-0e8d207d-19f1-43de-84e1-e9951feec8aa {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:21:31.634400 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-plugged", "status": "completed", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:21:31.634665 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-0e8d207d-19f1-43de-84e1-e9951feec8aa {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:21:31.635091 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'code': 200} Dec 21 05:21:31.676876 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:31.730836 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:31.782813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed4f824-d3e7-4a7b-95f2-f4831a320cd0 req-d16a5a65-8834-4ff6-a974-b8ca29b14b1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:31.784291 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed4f824-d3e7-4a7b-95f2-f4831a320cd0 req-d16a5a65-8834-4ff6-a974-b8ca29b14b1f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1098 time: 0.0386372 Dec 21 05:21:31.829333 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ed4f824-d3e7-4a7b-95f2-f4831a320cd0 req-9966a4a2-aedc-45a9-b0fe-0308eae35f1c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375297 Dec 21 05:21:32.586326 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6340d8dd-f762-4081-9161-a137023035ff req-3a31f1dd-91ec-4f72-908c-aaf952c5ed0b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:32.587847 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6340d8dd-f762-4081-9161-a137023035ff req-3a31f1dd-91ec-4f72-908c-aaf952c5ed0b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 946 time: 0.0482466 Dec 21 05:21:32.640085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6340d8dd-f762-4081-9161-a137023035ff req-37ebc8f6-53f4-42b0-b098-ce0bc1b829a2 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462878 Dec 21 05:21:33.755588 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f892d92-99ce-4ba3-806e-7cf9690e7093 req-465e2633-cef1-4753-9e5d-d5ec32742e6a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:33.756999 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f892d92-99ce-4ba3-806e-7cf9690e7093 req-465e2633-cef1-4753-9e5d-d5ec32742e6a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 946 time: 0.0488312 Dec 21 05:21:33.804951 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4f892d92-99ce-4ba3-806e-7cf9690e7093 req-4c749c70-4440-4b3a-9cde-ff608785ad7c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421278 Dec 21 05:21:33.918784 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c754f6-b165-48cf-ab10-a7c0ee9ec8cb req-6e6ff7a4-e18e-40db-99d9-e5e933db4d9b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:33.920287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42c754f6-b165-48cf-ab10-a7c0ee9ec8cb req-6e6ff7a4-e18e-40db-99d9-e5e933db4d9b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 946 time: 0.0498538 Dec 21 05:21:33.967571 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-42c754f6-b165-48cf-ab10-a7c0ee9ec8cb req-12553700-328a-453b-a4c0-8e293f445f8a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414643 Dec 21 05:21:33.989657 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53694) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:34.072048 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6805444-e895-414f-ae85-61deb763d359 tempest-TestSnapshotPattern-1516056974 tempest-TestSnapshotPattern-1516056974-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:34.073566 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-a6805444-e895-414f-ae85-61deb763d359 tempest-TestSnapshotPattern-1516056974 tempest-TestSnapshotPattern-1516056974-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1093 time: 0.0829072 Dec 21 05:21:34.076447 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 53698) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:21:34.080704 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.v2.base [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address': '172.20.0.13'}} {{(pid=110310) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:21:34.179972 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:34.273138 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:34.375813 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_common [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Allocated IP 172.25.5.139 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/9cdfbede-d6b9-4d99-80c7-96e18e2f4322) {{(pid=110310) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:21:34.471912 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for port, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:34.534641 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:34.580810 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110310) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:21:34.585654 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.base_scheduler [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Resources bound (agent type, host, resource id): {{(pid=110310) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:21:34.588029 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Received port after_create {{(pid=110310) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:21:34.611713 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'Port': ['ID=9cdfbede-d6b9-4d99-80c7-96e18e2f4322,revision_number=1']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:34.939599 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:35.061516 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:35.208576 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for port, precommit_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:35.265669 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529846419'] for port, after_update {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:35.332051 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'Port': ['ID=9cdfbede-d6b9-4d99-80c7-96e18e2f4322,revision_number=2']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:21:35.342045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:35.439181 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Floating IP d9b694c3-ee61-4202-a4c1-ef963d6c034a associated. External IP: 172.25.5.139, port: c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc. Dec 21 05:21:35.645396 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Router bf0cf4ff-9300-40db-969b-d101cac14f74 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:21:35.753585 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:21:35.763126 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:21:35.771854 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:35.774530 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:21:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:35.832609 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:35.859619 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-b724a5db-b3a3-4b03-b8e4-81d828a92859 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.7821412 Dec 21 05:21:35.860202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:21:35.862438 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb850c02-fd71-4caf-b741-0304b3e83253" -d '{"events": [{"name": "network-changed", "server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:21:35.882376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:35.898849 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:21:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-feb2385f-064d-4718-a58a-f5f958488403 x-openstack-request-id: req-feb2385f-064d-4718-a58a-f5f958488403 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:21:35.899175 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:21:35.899457 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-feb2385f-064d-4718-a58a-f5f958488403 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:21:35.899864 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'status': 'completed', 'code': 200} Dec 21 05:21:35.987331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-d78a3857-e603-48a3-9fcb-e6b6318ddb4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:35.988871 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-d78a3857-e603-48a3-9fcb-e6b6318ddb4c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1098 time: 0.0421047 Dec 21 05:21:36.086857 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-08e53f8e-04b9-4c37-80f9-f78ed6404672 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:36.088443 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-08e53f8e-04b9-4c37-80f9-f78ed6404672 service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0905917 Dec 21 05:21:36.114212 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:34Z', 'revision_number': 0, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:36.143768 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:21:36.152455 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:21:36.153057 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:21:23Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:36.154006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-c49c222a-a190-401a-ab6d-bce66109b73b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1000 time: 0.0582354 Dec 21 05:21:36.207272 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-091b76bb-cd6b-4ade-ba2b-8a1fffb85b70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:36.209372 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-091b76bb-cd6b-4ade-ba2b-8a1fffb85b70 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0476871 Dec 21 05:21:36.254465 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-f27bceba-7d5c-4c02-a877-c139d50e3ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:36.256028 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-f27bceba-7d5c-4c02-a877-c139d50e3ebd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0402074 Dec 21 05:21:36.256219 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:21:36.344376 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-a4368fe7-ff99-4950-849c-28809345fde8 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811987 Dec 21 05:21:36.436572 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb850c02-fd71-4caf-b741-0304b3e83253 req-77f10ec0-7938-45b4-a35f-d0eaa4590135 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843654 Dec 21 05:21:36.472565 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:34Z', 'revision_number': 0, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:21:36.502229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6136827-efc5-47b3-97f1-5271cddbc463 None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:34Z', 'revision_number': 0, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:21:36.698686 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9c3a467-233f-418a-8dc3-2505afab3aad None None] New status for floating IP d9b694c3-ee61-4202-a4c1-ef963d6c034a: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:21:46.869630 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:21:49.957097 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0a7b1d81-f57f-42e9-9b40-35227d82c7a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:52.739650 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-46f61249-b40c-490a-b12e-ed583a085188 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:53.665565 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:53.911586 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:55.435628 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:55.665531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:55.718419 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-69113bf2-b509-465d-a777-4196ded2d052 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0394366 Dec 21 05:21:55.816355 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f462452c-c0e3-437a-91db-da8d10ee414d req-02394436-0652-4f48-b0e6-1945da74b89c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:55.817824 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-02394436-0652-4f48-b0e6-1945da74b89c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1098 time: 0.0397320 Dec 21 05:21:55.831626 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:21:55.931424 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f462452c-c0e3-437a-91db-da8d10ee414d req-9208680e-c587-4915-9c76-dd31cb3b5bee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:55.932899 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-9208680e-c587-4915-9c76-dd31cb3b5bee service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0900896 Dec 21 05:21:56.003146 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-8ecf1b38-50ad-4cf0-83f6-eb1f08e1bd60 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1002 time: 0.0619431 Dec 21 05:21:56.054916 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f462452c-c0e3-437a-91db-da8d10ee414d req-0fe355a2-03ad-4180-84b1-330d93270e8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:56.056353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-0fe355a2-03ad-4180-84b1-330d93270e8a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0434277 Dec 21 05:21:56.104692 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f462452c-c0e3-437a-91db-da8d10ee414d req-8d67f197-e8d6-456b-8ec0-e64a544c0de0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:21:56.106134 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-8d67f197-e8d6-456b-8ec0-e64a544c0de0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383329 Dec 21 05:21:56.200757 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-b9393950-f0b9-413f-a767-dbbfd2ff81c0 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824647 Dec 21 05:21:56.290429 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f462452c-c0e3-437a-91db-da8d10ee414d req-2b8fd14c-dce5-47b8-b514-128fd638d359 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805256 Dec 21 05:22:19.995260 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6751ca86-c520-43b4-a2bd-b8edfecd1189 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:22.745638 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d16f3ef5-2bfd-4548-a4be-2f6dad7f0e9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:23.653882 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:23.869974 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:22:23.926723 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:25.446891 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:25.657978 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:25.817867 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:49.977361 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eec34425-efdf-4c42-b282-6e2452345e3c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:52.773679 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6b08ba10-92fc-4c86-9604-2ca3471214a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:53.676225 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:53.933359 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:55.436272 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:55.648053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:55.817552 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:22:57.746665 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-eb123705-50a7-4d52-bb60-bb6fb73033b7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0832767 Dec 21 05:22:57.863494 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-19649cc8-bed0-43a8-a3de-25f26788e8f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:22:57.865010 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-19649cc8-bed0-43a8-a3de-25f26788e8f1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1098 time: 0.0425317 Dec 21 05:22:57.971460 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-12cbf0b9-bbeb-46a4-9b3a-b633fe67f80b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:22:57.972946 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-12cbf0b9-bbeb-46a4-9b3a-b633fe67f80b service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0819414 Dec 21 05:22:58.047696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-8f33fe3f-a392-4dcd-a213-681c7ea17184 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1002 time: 0.0616448 Dec 21 05:22:58.098202 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-6cde8510-6917-4efa-b446-dd7fdff55969 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:22:58.099621 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-6cde8510-6917-4efa-b446-dd7fdff55969 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0417929 Dec 21 05:22:58.147410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-c026f70e-5b49-4c4e-a07c-ebccc2b060e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:22:58.148797 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-c026f70e-5b49-4c4e-a07c-ebccc2b060e7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0385718 Dec 21 05:22:58.164407 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-acbaad29-c346-40eb-ae2b-94fbc93ed008 service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:22:58.165685 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-acbaad29-c346-40eb-ae2b-94fbc93ed008 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053020 Dec 21 05:22:58.264725 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-528c2bfd-aea0-4556-bb00-8be7732890c7 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852354 Dec 21 05:22:58.356856 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e7e2f61f-e4b2-4c0e-bbd4-5d648dfae8b4 req-162eace5-0634-4cb5-b815-736f70fa71f5 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805819 Dec 21 05:23:00.869110 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:23:19.990338 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9ed62467-085f-4aec-bf27-79f2df5493ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:22.761998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a9d4bab7-9ebe-4f2b-a905-ea7bd64617dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:23.676487 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:23.939214 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:25.434228 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:25.670846 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:25.813343 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:36.085528 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc details requested by agent hyperv_n-h2-822053-11 with host n-h2-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:23:36.175521 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:23:36.186994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Returning: {'device': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:23:36.224798 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:36.237255 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:23:36.256367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:23:36.348233 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:36.393564 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:23:36.400705 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.401050 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.401391 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.401723 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.402051 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.402376 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.402702 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.403052 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.403375 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.403694 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.404014 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.404331 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.404648 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:36.522329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] get_ports_and_sgs() called for port_ids ['c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:23:37.868905 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:23:38.082596 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc up at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:23:38.130150 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Provisioning complete for port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:23:38.130507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:38.215532 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:38.239272 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:23:38.241484 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba2a272c-ead9-46ac-b7f7-393b755499a3" -d '{"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-plugged", "status": "completed", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:23:38.254610 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:23:38.281847 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:23:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ec6c4b3-23ab-437b-8fa6-26e5b285a0d9 x-openstack-request-id: req-6ec6c4b3-23ab-437b-8fa6-26e5b285a0d9 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:23:38.282169 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-plugged", "status": "completed", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:23:38.282427 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-6ec6c4b3-23ab-437b-8fa6-26e5b285a0d9 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:23:38.282828 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'code': 200} Dec 21 05:23:38.325433 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:38.372229 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:23:49.626074 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-24d9b700-beec-4d98-9a7d-4cbcefc51d53 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-339590498&fields=id&tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786 HTTP/1.1" status: 200 len: 267 time: 0.0497880 Dec 21 05:23:49.730203 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f87c07c-51d0-439f-88af-de51fe2778ae tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:49.731768 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f87c07c-51d0-439f-88af-de51fe2778ae tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 808 time: 0.0986094 Dec 21 05:23:49.746215 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-dace0dfa-9f67-4bf2-be2a-6ec4a5e1c67d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/quotas/3928a1cc9e5f4c3d9b1a3ff5f3888786 HTTP/1.1" status: 200 len: 375 time: 0.0088780 Dec 21 05:23:49.797859 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-0d4daa77-106a-4260-9f30-e6cbaf947ede tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0464327 Dec 21 05:23:49.855208 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-d36097a2-c608-4054-ab98-47431b55731f service neutron] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110310) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:23:49.856223 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-d36097a2-c608-4054-ab98-47431b55731f service neutron] 10.222.0.18 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0473917 Dec 21 05:23:49.948390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-a71496b4-de5c-4f15-91db-e8153a1296ad service neutron] 10.222.0.18 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859547 Dec 21 05:23:49.982084 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-25e5e65b-5139-426d-a8f0-cca0a5272697 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:50.037502 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-5a3e1070-82ca-4787-aa62-9d10bee9bcb1 service neutron] 10.222.0.18 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830762 Dec 21 05:23:51.335085 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-b16b45bf-6866-4aeb-bc30-5a850e51a571 req-9b62b77f-fecf-4b69-acaa-a723961a182d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 210 time: 0.0811043 Dec 21 05:23:52.165402 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:23:52.240466 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:52.265601 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:23:52.267932 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b477053-e63b-4035-aeac-b94dbf8e2c9b" -d '{"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-unplugged", "status": "completed", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:23:52.280681 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:23:52.348226 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:52.373696 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 05:23:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2d40a3a-598e-458e-9dc3-374b488db0ec x-openstack-request-id: req-b2d40a3a-598e-458e-9dc3-374b488db0ec {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:23:52.373989 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-unplugged", "status": "completed", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:23:52.374242 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-b2d40a3a-598e-458e-9dc3-374b488db0ec {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:23:52.374724 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'code': 200} Dec 21 05:23:52.401733 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Pushing event updated for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:23:52.430493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-9ab077d2-4c56-4758-a643-571735bb982f req-e5f61cb7-6763-4abc-b135-b310254dd60c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 210 time: 0.0263309 Dec 21 05:23:52.761708 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-21b0cb23-920c-44c5-84e7-cab596ca5148 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:53.370641 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-96976720-3e32-4cca-a512-4b83a0ae67ba tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:53.372129 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-96976720-3e32-4cca-a512-4b83a0ae67ba tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.54 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 808 time: 0.1064250 Dec 21 05:23:53.442701 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-b944bb6c-8d30-4846-969f-7f048813193f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786 HTTP/1.1" status: 200 len: 379 time: 0.0554085 Dec 21 05:23:53.452952 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'port': {'device_id': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'admin_state_up': True, 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'security_groups': ['fe74e25e-03de-475d-9b15-eac39b9c01e7']}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:23:53.553156 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-4eab1e78-a780-4050-a2e6-a9d724a7dd3d req-828bb463-6233-4c2b-a2f3-9d921692fc36 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 210 time: 0.0262089 Dec 21 05:23:53.616519 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Made reservation on behalf of 3928a1cc9e5f4c3d9b1a3ff5f3888786 for: {'port': 1} {{(pid=110311) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 21 05:23:53.620396 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:53.702842 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:53.751586 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Allocated IP 172.20.0.6 (74eac97f-efc7-44f7-b3cc-cbbaa49c512d/12634cd6-e77e-46eb-a92e-3842a73fc8c4/113df5e1-1df5-4972-91a0-a269fa50320f) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:23:53.896695 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:53.966699 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:53.994529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:54.047032 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:23:54.050657 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:23:54.055823 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:23:54.111496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:23:54.121164 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:54.121836 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:54.130345 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.130738 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.131123 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.131472 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.131811 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.132216 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.132550 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.132939 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.133228 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.133572 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.133905 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.134276 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.134618 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:23:54.243262 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8745e29b-d8c6-4937-bbf1-824b1216ecde tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7939370 Dec 21 05:23:54.368736 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-7fbc7b97-23b6-4749-af51-48fe95f7a50b None None] Provisioning complete for port 113df5e1-1df5-4972-91a0-a269fa50320f triggered by entity DHCP. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:23:54.379993 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7fbc7b97-23b6-4749-af51-48fe95f7a50b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:54.418665 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-7fbc7b97-23b6-4749-af51-48fe95f7a50b None None] Port 113df5e1-1df5-4972-91a0-a269fa50320f cannot update to ACTIVE because it is not bound. {{(pid=110312) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 21 05:23:54.678107 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec49f77-3c3a-4ebb-81c0-34d8461c8e48 req-274b5a27-29ea-4007-86e6-f64ad2ce00b1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:54.681056 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cec49f77-3c3a-4ebb-81c0-34d8461c8e48 req-274b5a27-29ea-4007-86e6-f64ad2ce00b1 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0551872 Dec 21 05:23:54.734436 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cec49f77-3c3a-4ebb-81c0-34d8461c8e48 req-4fd2e5d9-cba5-4a5a-99bb-203975e3f17c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466959 Dec 21 05:23:55.470680 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:55.708004 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:55.816596 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:23:55.878705 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069c4994-a3a9-421c-8eef-e1078b161e16 req-b460d67d-1cd9-484d-b20f-94fbaa97c4c7 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:55.886456 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-069c4994-a3a9-421c-8eef-e1078b161e16 req-b460d67d-1cd9-484d-b20f-94fbaa97c4c7 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0626504 Dec 21 05:23:55.932208 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-069c4994-a3a9-421c-8eef-e1078b161e16 req-2b5c9d13-9492-43c8-9b1b-0db4a729a47a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448461 Dec 21 05:23:57.059663 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6f395b-495d-45b0-88c5-033eea07d111 req-ad921a03-709e-4572-98d8-edb0eda21c4d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:57.061150 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f6f395b-495d-45b0-88c5-033eea07d111 req-ad921a03-709e-4572-98d8-edb0eda21c4d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0537136 Dec 21 05:23:57.111278 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3f6f395b-495d-45b0-88c5-033eea07d111 req-ca73d554-b569-4f1c-b91a-f002d51b49c0 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441060 Dec 21 05:23:58.231591 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856bb359-a0b4-48b0-973c-01ddc5e593a5 req-6ab2bbf0-3c00-452d-9fa1-38a97a7e18d9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:58.233390 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856bb359-a0b4-48b0-973c-01ddc5e593a5 req-6ab2bbf0-3c00-452d-9fa1-38a97a7e18d9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0533943 Dec 21 05:23:58.287827 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-856bb359-a0b4-48b0-973c-01ddc5e593a5 req-aac388d0-d323-4f64-9d84-bc76dfc934ba tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480320 Dec 21 05:23:58.740886 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-30d9f65b-9230-4ef1-9499-5558c1e1b293 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0407505 Dec 21 05:23:58.857779 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-7200c36f-d06f-4a21-b63f-eead6765d7a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:58.859302 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-7200c36f-d06f-4a21-b63f-eead6765d7a1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1096 time: 0.0422587 Dec 21 05:23:58.976163 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-944afbdd-ba61-49e2-89cf-59f8a7851fac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:58.977631 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-944afbdd-ba61-49e2-89cf-59f8a7851fac service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0939741 Dec 21 05:23:59.058021 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-61d6db27-cf52-4384-bbb1-540fa89ab8f7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1000 time: 0.0676627 Dec 21 05:23:59.111114 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-27250212-1d19-4358-bc45-3b355786784a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:59.112545 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-27250212-1d19-4358-bc45-3b355786784a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0443132 Dec 21 05:23:59.171191 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-ac08a7d4-e9f4-484d-9b7d-a87d289a9e87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:59.172717 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-ac08a7d4-e9f4-484d-9b7d-a87d289a9e87 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0480437 Dec 21 05:23:59.271579 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-605be597-5354-420b-98f9-b08adef3bc88 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866470 Dec 21 05:23:59.424308 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f4af4679-6e0f-4100-9c91-85350edb3cae req-fd3d8764-905e-4b1b-8e40-5528cf474c19 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1412554 Dec 21 05:23:59.440519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714c5b90-3463-4471-8dad-3283e8d4dc0c req-3e5519f6-c780-493b-a790-9b967fc15dfc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:23:59.442084 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714c5b90-3463-4471-8dad-3283e8d4dc0c req-3e5519f6-c780-493b-a790-9b967fc15dfc tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0829129 Dec 21 05:23:59.493249 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-714c5b90-3463-4471-8dad-3283e8d4dc0c req-17073f83-3d11-4301-bb9d-d3ee46e724e9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451055 Dec 21 05:24:00.640417 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78da915c-bc09-4976-b768-32231b40e3ce req-243e3818-1fbc-4022-bc4d-4f0a1aecfeb9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:00.642034 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78da915c-bc09-4976-b768-32231b40e3ce req-243e3818-1fbc-4022-bc4d-4f0a1aecfeb9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0714121 Dec 21 05:24:00.711318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-78da915c-bc09-4976-b768-32231b40e3ce req-15c5cdf8-8f80-4605-8a71-0751b2ee3cf2 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0618331 Dec 21 05:24:01.841034 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aeb8141-d26a-4a3b-8c12-d506fed916a7 req-d8006271-9407-4443-b25a-91549c76dc2b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:01.843257 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aeb8141-d26a-4a3b-8c12-d506fed916a7 req-d8006271-9407-4443-b25a-91549c76dc2b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0519152 Dec 21 05:24:01.896025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-7aeb8141-d26a-4a3b-8c12-d506fed916a7 req-e858056c-3bf3-4985-b849-15a2aa931898 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470686 Dec 21 05:24:03.046789 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb678ea7-4eb6-4fcc-8204-9eb1635e6895 req-dc1b8385-d848-4222-94b0-89de773a8b91 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:03.055381 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb678ea7-4eb6-4fcc-8204-9eb1635e6895 req-dc1b8385-d848-4222-94b0-89de773a8b91 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0702574 Dec 21 05:24:03.106457 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-bb678ea7-4eb6-4fcc-8204-9eb1635e6895 req-f938c0d6-b5b7-4e97-b2e8-8949fa817e68 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0497363 Dec 21 05:24:04.238557 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf609dbc-b0ac-447c-9173-286073d74aae req-0230d599-3fc6-4dce-9849-d649490ec1eb tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:04.262192 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf609dbc-b0ac-447c-9173-286073d74aae req-0230d599-3fc6-4dce-9849-d649490ec1eb tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0535049 Dec 21 05:24:04.295393 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cf609dbc-b0ac-447c-9173-286073d74aae req-44e88407-e2dc-4663-99cc-cf6463f7d1ad tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486856 Dec 21 05:24:05.114861 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-ba9b3914-1bc9-4d76-9229-8da7e7eeb9ea tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] http://10.222.0.18:9696/v2.0/extensions returned with HTTP 200 {{(pid=110311) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 21 05:24:05.115873 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-ba9b3914-1bc9-4d76-9229-8da7e7eeb9ea tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054693 Dec 21 05:24:05.189000 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Request body: {'port': {'device_id': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-822053-11'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:24:05.244874 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:05.410351 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241e3cb0-4f08-424e-bdae-dcfaa77eb58f req-998b3c36-1e50-48be-8eb4-99d1ab03241a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:05.411765 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-241e3cb0-4f08-424e-bdae-dcfaa77eb58f req-998b3c36-1e50-48be-8eb4-99d1ab03241a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 931 time: 0.0483792 Dec 21 05:24:05.461469 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-241e3cb0-4f08-424e-bdae-dcfaa77eb58f req-1157aeec-0b20-49c1-90f9-cb703639f9f9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431333 Dec 21 05:24:05.505928 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 113df5e1-1df5-4972-91a0-a269fa50320f {{(pid=110311) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:24:05.515097 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:05.530620 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.provisioning_blocks [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Transition to ACTIVE for port object 113df5e1-1df5-4972-91a0-a269fa50320f will not be triggered until provisioned by entity L2. {{(pid=110311) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 21 05:24:05.587691 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:05.658797 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:24:05.713093 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Attempting to bind port 113df5e1-1df5-4972-91a0-a269fa50320f on host n-h1-822053-11 for vnic_type normal with profile {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 21 05:24:05.713972 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Attempting to bind port 113df5e1-1df5-4972-91a0-a269fa50320f by drivers openvswitch,hyperv on host n-h1-822053-11 at level 0 using segments [{'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 21 05:24:05.714267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Attempting to bind port 113df5e1-1df5-4972-91a0-a269fa50320f on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:24:05.718904 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Port 113df5e1-1df5-4972-91a0-a269fa50320f on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d not bound, no agent of type Open vSwitch agent registered on host n-h1-822053-11 {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 21 05:24:05.719302 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Attempting to bind port 113df5e1-1df5-4972-91a0-a269fa50320f on network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 21 05:24:05.724360 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Checking agent: {'id': '00c11013-ac28-4abc-8da7-3f4af1a59c0d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-822053-11', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'started_at': datetime.datetime(2021, 12, 21, 3, 40, 22), 'heartbeat_timestamp': datetime.datetime(2021, 12, 21, 5, 23, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 21 05:24:05.729072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Checking segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110311) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 21 05:24:05.729072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Bound using segment: {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'} {{(pid=110311) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 21 05:24:05.729072 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.managers [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Bound port: 113df5e1-1df5-4972-91a0-a269fa50320f, host: n-h1-822053-11, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '518585f4-844a-464b-a4c0-42cf93fc264b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d'}}] {{(pid=110311) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 21 05:24:05.729072 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:05.790289 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, cleared binding levels {{(pid=110311) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 21 05:24:05.793425 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110311) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 21 05:24:05.874216 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:05.908526 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:05.909172 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:05.910640 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] 10.222.0.54 "PUT /v2.0/ports/113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 1092 time: 0.7720990 Dec 21 05:24:05.911103 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:24:05.913312 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736" -d '{"events": [{"name": "network-changed", "server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:24:05.940996 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f52b99e-8bc1-4fea-a90c-31c21493a1cf service neutron] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=3']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:24:06.024407 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:24:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a3536cc-13c5-44b8-bfda-696ef3550182 x-openstack-request-id: req-2a3536cc-13c5-44b8-bfda-696ef3550182 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:24:06.024704 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:24:06.024961 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2a3536cc-13c5-44b8-bfda-696ef3550182 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:24:06.025367 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'status': 'completed', 'code': 200} Dec 21 05:24:06.100001 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-6d86accb-d7db-4f25-aa1c-6318e623ac02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.101521 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-6d86accb-d7db-4f25-aa1c-6318e623ac02 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1095 time: 0.0470750 Dec 21 05:24:06.160103 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-007267f1-10c6-43d5-acfb-9516a48eca51 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 217 time: 0.0348125 Dec 21 05:24:06.209116 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-55424a6e-bf5f-4b23-a0b0-c0815fa1ef19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.210372 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-55424a6e-bf5f-4b23-a0b0-c0815fa1ef19 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0427389 Dec 21 05:24:06.261799 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-efe5923b-5028-4050-bc75-81a049befe88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.263300 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-efe5923b-5028-4050-bc75-81a049befe88 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0429864 Dec 21 05:24:06.351792 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-8af42724-c6dc-421c-afc7-80f5c15d2035 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808349 Dec 21 05:24:06.444048 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-f07b9059-93e8-4013-9da0-5d3d5195c3cf req-c2e44620-6540-45d9-8419-e6ea81d31326 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841250 Dec 21 05:24:06.581214 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0413a54f-1d03-411d-9235-82130aec4ae4 req-902fd0b1-e3cb-4562-9825-3b250fd70aa6 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.582688 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0413a54f-1d03-411d-9235-82130aec4ae4 req-902fd0b1-e3cb-4562-9825-3b250fd70aa6 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 943 time: 0.0537457 Dec 21 05:24:06.634286 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-0413a54f-1d03-411d-9235-82130aec4ae4 req-e300636a-01c9-4073-848c-b7c17d3f2b61 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456667 Dec 21 05:24:06.668267 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-3788be24-ca78-4e6c-bedf-c66f1eb1f629 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.669759 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-3788be24-ca78-4e6c-bedf-c66f1eb1f629 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1095 time: 0.0409360 Dec 21 05:24:06.764980 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-7c40d311-e0b1-4c77-bcd3-f673af0c3d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.766402 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-7c40d311-e0b1-4c77-bcd3-f673af0c3d9b service neutron] 10.222.0.54 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0878189 Dec 21 05:24:06.811056 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-345c799a-32b3-4e69-81db-af72bbf8a142 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 217 time: 0.0344436 Dec 21 05:24:06.859343 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-d0a691c1-bfa8-424f-86dd-19a15f120c1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.860753 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-d0a691c1-bfa8-424f-86dd-19a15f120c1c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0425885 Dec 21 05:24:06.908497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-861138e7-87ad-4362-a363-8043f842e2f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:06.909957 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-861138e7-87ad-4362-a363-8043f842e2f5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0383625 Dec 21 05:24:07.003926 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-3cee2246-e643-41d3-ad78-64fd643afa59 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849385 Dec 21 05:24:07.100352 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-9e7bdc9c-cf6f-4f0f-b0f7-93d758620736 req-532c8a5e-9b44-4093-accb-f9b7d26bb8ef service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886655 Dec 21 05:24:07.755197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3806a60f-d282-44c7-9b3b-2c1fe591fc22 req-8f5bff31-7438-4331-85d1-1f9468c07dc8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:07.756671 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3806a60f-d282-44c7-9b3b-2c1fe591fc22 req-8f5bff31-7438-4331-85d1-1f9468c07dc8 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 943 time: 0.0505567 Dec 21 05:24:07.808137 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3806a60f-d282-44c7-9b3b-2c1fe591fc22 req-1c1108a9-d887-48df-bb17-e4b17ae63f28 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455108 Dec 21 05:24:08.931162 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc8442cb-5aba-47ec-be68-a5a4b3d06497 req-c4713d81-24aa-4fba-89be-b78e954527d2 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:08.933194 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc8442cb-5aba-47ec-be68-a5a4b3d06497 req-c4713d81-24aa-4fba-89be-b78e954527d2 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 943 time: 0.0480556 Dec 21 05:24:08.983779 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-cc8442cb-5aba-47ec-be68-a5a4b3d06497 req-ad3d6867-a430-4e7f-b02f-865bad26850e tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446734 Dec 21 05:24:09.499792 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:24:09.624427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:24:09.624427 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '113df5e1-1df5-4972-91a0-a269fa50320f', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'port_id': '113df5e1-1df5-4972-91a0-a269fa50320f', 'mac_address': 'fa:16:3e:cd:0e:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:24:09.657702 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:09.670239 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 113df5e1-1df5-4972-91a0-a269fa50320f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:24:09.693463 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:24:09.762484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:09.806849 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=4']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:24:10.091406 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['113df5e1-1df5-4972-91a0-a269fa50320f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:24:10.100221 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe207f74-5caa-42b8-aef0-e6e7e7e2bf64 req-f8da7863-8ed9-4f26-8a85-e8521eb2acc5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:10.101706 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe207f74-5caa-42b8-aef0-e6e7e7e2bf64 req-f8da7863-8ed9-4f26-8a85-e8521eb2acc5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 944 time: 0.0506938 Dec 21 05:24:10.151160 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-fe207f74-5caa-42b8-aef0-e6e7e7e2bf64 req-8cbce30b-b8a0-4d6b-a4d2-4e5ec92f854b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425520 Dec 21 05:24:11.268819 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01619ffb-80e2-49c6-852f-445368324b91 req-a4d9e511-f01a-467f-8a3a-9c918f2b0281 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:11.270323 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01619ffb-80e2-49c6-852f-445368324b91 req-a4d9e511-f01a-467f-8a3a-9c918f2b0281 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 944 time: 0.0483947 Dec 21 05:24:11.319067 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-01619ffb-80e2-49c6-852f-445368324b91 req-ce2f1fa7-1431-4fe2-9298-8eb7039dc55e tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427783 Dec 21 05:24:11.499966 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:24:11.605661 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning for port 113df5e1-1df5-4972-91a0-a269fa50320f completed by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 21 05:24:11.610595 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 113df5e1-1df5-4972-91a0-a269fa50320f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:24:11.611006 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:11.691864 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:11.713930 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:24:11.716400 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4dc77e62-1ba0-4043-884e-b050082b92e9" -d '{"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-plugged", "status": "completed", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:24:11.728835 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:24:11.756826 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:24:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-022bad40-3de0-4b33-bb37-f5135b4648d7 x-openstack-request-id: req-022bad40-3de0-4b33-bb37-f5135b4648d7 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:24:11.757126 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-plugged", "status": "completed", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:24:11.757389 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-022bad40-3de0-4b33-bb37-f5135b4648d7 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:24:11.757794 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'code': 200} Dec 21 05:24:11.802251 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:11.849594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=5']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:24:11.894844 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-403231be-91d8-430a-8325-d90bbc617d0d req-9ca3a396-0b6e-4d78-9a9e-4e4c57203829 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:11.896349 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-403231be-91d8-430a-8325-d90bbc617d0d req-9ca3a396-0b6e-4d78-9a9e-4e4c57203829 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1097 time: 0.0390372 Dec 21 05:24:11.942914 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-403231be-91d8-430a-8325-d90bbc617d0d req-48b21e5e-34f2-4e6a-aa9b-4db1b6445266 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378978 Dec 21 05:24:12.436390 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40b6d41-410d-43f5-8e7f-42f9f5fe4053 req-30ed94c0-3a16-4670-9c5b-b36d8e35b19c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:12.437843 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e40b6d41-410d-43f5-8e7f-42f9f5fe4053 req-30ed94c0-3a16-4670-9c5b-b36d8e35b19c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 945 time: 0.0507081 Dec 21 05:24:12.485793 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-e40b6d41-410d-43f5-8e7f-42f9f5fe4053 req-5aa78d1f-7191-42b5-9bb2-a40a53b31306 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421112 Dec 21 05:24:13.602131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563e80bd-ecfa-47b0-bedd-53fbdaf7b61b req-91d42f04-bf12-436d-af13-98813f34ec5a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:13.603657 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-563e80bd-ecfa-47b0-bedd-53fbdaf7b61b req-91d42f04-bf12-436d-af13-98813f34ec5a tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 945 time: 0.0473936 Dec 21 05:24:13.654641 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-563e80bd-ecfa-47b0-bedd-53fbdaf7b61b req-09fd3667-003a-4de3-aa9b-4e0be50b736d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443420 Dec 21 05:24:13.771647 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff365f2-4df4-42e1-ae58-501d1a5951b3 req-80779b14-67ec-4498-940b-f9e05402d389 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:13.773025 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eff365f2-4df4-42e1-ae58-501d1a5951b3 req-80779b14-67ec-4498-940b-f9e05402d389 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 945 time: 0.0521750 Dec 21 05:24:13.820892 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-eff365f2-4df4-42e1-ae58-501d1a5951b3 req-8b2f2926-4e8e-46d0-869e-1b0a4e034498 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412786 Dec 21 05:24:13.843488 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 53998) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:24:13.884061 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4515ba1-dad9-40f2-9f68-d581d2136ff3 tempest-TestSnapshotPattern-1516056974 tempest-TestSnapshotPattern-1516056974-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:13.886143 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c4515ba1-dad9-40f2-9f68-d581d2136ff3 tempest-TestSnapshotPattern-1516056974 tempest-TestSnapshotPattern-1516056974-project-admin] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1092 time: 0.0409429 Dec 21 05:24:13.888953 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54000) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:24:13.893174 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.v2.base [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Request body: {'floatingip': {'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'port_id': '113df5e1-1df5-4972-91a0-a269fa50320f', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address': '172.20.0.6'}} {{(pid=110311) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 21 05:24:13.990273 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:14.087518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:14.191375 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_common [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Allocated IP 172.25.5.250 (30f5b79f-275c-4003-8999-814f6db142e1/d97763f7-6055-4080-b2b6-7cd4d7f7d537/707dd879-b663-45af-bf68-4aed269133a0) {{(pid=110311) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 21 05:24:14.289917 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for port, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:14.359392 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8762542260718', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:14.394486 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Network 30f5b79f-275c-4003-8999-814f6db142e1 is already hosted by enough agents. {{(pid=110311) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 21 05:24:14.399219 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.base_scheduler [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Resources bound (agent type, host, resource id): {{(pid=110311) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 21 05:24:14.401777 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Received port after_create {{(pid=110311) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 21 05:24:14.439230 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'Port': ['ID=707dd879-b663-45af-bf68-4aed269133a0,revision_number=1']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:24:14.761018 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, precommit_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:14.867852 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:24:14.890702 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:15.032385 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for port, precommit_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:15.101552 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-529022331'] for port, after_update {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:15.178847 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event updated for resources: {'Port': ['ID=707dd879-b663-45af-bf68-4aed269133a0,revision_number=2']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:24:15.188339 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7874258'] for floatingip, after_create {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:15.566839 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Floating IP c56ee72f-c578-4f8b-9248-758f56d9dca0 associated. External IP: 172.25.5.250, port: 113df5e1-1df5-4972-91a0-a269fa50320f. Dec 21 05:24:15.769439 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Router bf0cf4ff-9300-40db-969b-d101cac14f74 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:24:15.878421 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:24:15.888756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:24:15.897988 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:24:15.898605 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:23:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:24:15.955641 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:15.986095 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-f9e243e4-6041-41cc-8699-6ed0910b143d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0961246 Dec 21 05:24:15.986682 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:24:15.989072 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5820d42f-350d-4ed1-8cf4-56f3130a79c5" -d '{"events": [{"name": "network-changed", "server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:24:16.005079 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:24:16.026246 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:24:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4096f88f-df01-49c6-b477-fd10f4d3b52e x-openstack-request-id: req-4096f88f-df01-49c6-b477-fd10f4d3b52e {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:24:16.026551 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:24:16.026806 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-4096f88f-df01-49c6-b477-fd10f4d3b52e {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:24:16.027246 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'status': 'completed', 'code': 200} Dec 21 05:24:16.119138 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-966cb631-d00a-4639-a5e2-06b890abf478 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:16.121204 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-966cb631-d00a-4639-a5e2-06b890abf478 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1097 time: 0.0416272 Dec 21 05:24:16.231480 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c56ee72f-c578-4f8b-9248-758f56d9dca0', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.250', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': '113df5e1-1df5-4972-91a0-a269fa50320f', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4390, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:cd:0e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:24:14Z', 'updated_at': '2021-12-21T05:24:14Z', 'revision_number': 0, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}, {'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:36Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:24:16.239497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-496b18cd-6ffe-43a9-acef-b2b14ffe7bca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:16.241004 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-496b18cd-6ffe-43a9-acef-b2b14ffe7bca service neutron] 10.222.0.54 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.1122892 Dec 21 05:24:16.258209 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:24:16.266485 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:24:16.267111 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:23:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:24:16.308809 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-16577565-ffda-464c-9eed-0152f497a21f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 999 time: 0.0610611 Dec 21 05:24:16.361497 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-90f17be4-603c-4d55-b25d-35e93168a5fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:16.362987 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-90f17be4-603c-4d55-b25d-35e93168a5fb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0477045 Dec 21 05:24:16.371329 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:24:16.408535 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-1678180e-cf7d-47e4-85e5-4bab5a743246 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:16.410035 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-1678180e-cf7d-47e4-85e5-4bab5a743246 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0390861 Dec 21 05:24:16.502874 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-fbb0759e-8eee-47a4-99e9-968f867682b2 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850008 Dec 21 05:24:16.590387 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c56ee72f-c578-4f8b-9248-758f56d9dca0', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.250', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': '113df5e1-1df5-4972-91a0-a269fa50320f', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4390, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:cd:0e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:24:14Z', 'updated_at': '2021-12-21T05:24:14Z', 'revision_number': 0, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}, {'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:36Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:24:16.596449 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-5820d42f-350d-4ed1-8cf4-56f3130a79c5 req-30871780-031c-4118-afe2-3d0a4f6f20d2 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857553 Dec 21 05:24:16.620995 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7632e5ff-77ee-4078-9100-263e7bcab108 None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'c56ee72f-c578-4f8b-9248-758f56d9dca0', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.250', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': '113df5e1-1df5-4972-91a0-a269fa50320f', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4390, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:cd:0e:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:24:14Z', 'updated_at': '2021-12-21T05:24:14Z', 'revision_number': 0, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}, {'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:36Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:24:16.813361 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31d9df4c-634e-44e3-aa0e-0b8e47292b7e None None] New status for floating IP c56ee72f-c578-4f8b-9248-758f56d9dca0: ACTIVE {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:24:18.407725 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-1a186e51-0443-493b-a797-f93608615276 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0423136 Dec 21 05:24:18.505887 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b35904b-6926-4499-bf95-acc3a265a322 req-d0911298-14da-4586-94ac-dcfd70b8e973 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:18.507380 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-d0911298-14da-4586-94ac-dcfd70b8e973 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1097 time: 0.0393639 Dec 21 05:24:18.612418 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b35904b-6926-4499-bf95-acc3a265a322 req-36b8faf1-13b8-4c62-ba5a-8340590b3995 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:18.613901 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-36b8faf1-13b8-4c62-ba5a-8340590b3995 service neutron] 10.222.0.54 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0865240 Dec 21 05:24:18.678331 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-77d36b3e-35bb-4f27-8108-621a03a2c934 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 1001 time: 0.0568252 Dec 21 05:24:18.727695 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b35904b-6926-4499-bf95-acc3a265a322 req-ffddace5-cf6b-4624-b968-7d1e342f60f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:18.729132 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-ffddace5-cf6b-4624-b968-7d1e342f60f6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0437117 Dec 21 05:24:18.779677 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b35904b-6926-4499-bf95-acc3a265a322 req-cbcf6c57-1ee1-4802-9e11-43fa2c175a33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:24:18.781166 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-cbcf6c57-1ee1-4802-9e11-43fa2c175a33 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0432348 Dec 21 05:24:18.868092 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-f578f3e9-a17c-4b82-9141-703293a1b6b1 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797427 Dec 21 05:24:18.959583 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-3b35904b-6926-4499-bf95-acc3a265a322 req-deb431d9-9b9d-42e9-82fd-27f378900389 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842354 Dec 21 05:24:20.016118 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e155497b-1b42-4256-80fa-649016fb9e5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:22.747016 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-93e7ec47-d3ae-4db6-9820-d01b8434dd04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:23.676036 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:23.950210 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:25.458358 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:25.690114 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:25.841399 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:49.978660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-2ddedc6d-f39f-4127-93a9-e1f8ebb0f0fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:51.867345 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:24:52.749752 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-48a95dc0-74aa-411f-85d3-041de1ec5f3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:53.706566 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:53.949731 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:55.435304 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:55.732732 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:24:55.809527 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:00.677885 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-8eb4a26e-f28f-45b2-ad3b-aea57ebbb1ef service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0385730 Dec 21 05:25:00.783792 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-ff875a21-f3e0-4dde-a3d9-f42d1b1313c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:00.785287 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-ff875a21-f3e0-4dde-a3d9-f42d1b1313c5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1096 time: 0.0406215 Dec 21 05:25:01.190959 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-b40b20c8-6265-4d89-8b74-bdd169e4fd03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:01.192437 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-b40b20c8-6265-4d89-8b74-bdd169e4fd03 service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.3794250 Dec 21 05:25:01.260745 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-fabe0376-2cea-43a5-a195-485b2973f5d9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1000 time: 0.0562394 Dec 21 05:25:01.317157 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-844a4d22-2ab7-4051-8393-20ccd0b427c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:01.318580 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-844a4d22-2ab7-4051-8393-20ccd0b427c9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0463543 Dec 21 05:25:01.368775 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-357804f9-e63c-4570-a748-9e9a77379f5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:01.370275 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-357804f9-e63c-4570-a748-9e9a77379f5a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0397267 Dec 21 05:25:01.462166 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-46b7480c-eb59-4164-bea5-66398b80df0e service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796864 Dec 21 05:25:01.553503 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a37148aa-2f87-47b9-90dc-fe1adb3dcc53 req-331d8f99-7940-4b5f-a4a6-cd70cead296d service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829082 Dec 21 05:25:18.371682 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-1e9dc963-9b4d-4e70-b4d3-2251a86386d4 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0395586 Dec 21 05:25:18.470766 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-5cfc8ba8-b405-4153-a89b-4e72847e262b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:18.472260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-5cfc8ba8-b405-4153-a89b-4e72847e262b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1097 time: 0.0391006 Dec 21 05:25:18.581055 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-8c260925-b6e6-4855-901c-255d97caa69c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:18.582546 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-8c260925-b6e6-4855-901c-255d97caa69c service neutron] 10.222.0.54 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0899217 Dec 21 05:25:18.652327 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-5860dc61-f451-4851-b1ca-2dabab6617fa service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 1001 time: 0.0573204 Dec 21 05:25:18.701177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-3197a352-51b1-4a4a-a085-90d38c04801f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:18.702578 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-3197a352-51b1-4a4a-a085-90d38c04801f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0471585 Dec 21 05:25:18.748022 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-f3fe6ec0-263c-4b9c-88ba-288949ea6afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:25:18.749481 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-f3fe6ec0-263c-4b9c-88ba-288949ea6afe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0401444 Dec 21 05:25:18.836248 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-bfdc0864-8de4-4ad3-8768-cc28afa026b4 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794952 Dec 21 05:25:18.928014 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-675ba647-2673-4a3b-88f6-38d9dc170f39 req-e40944b6-0615-4f9f-a29a-90b78005eea4 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846932 Dec 21 05:25:19.974484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e2982211-f71a-4c73-b538-bee9f3e983ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:22.768724 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce37ec67-920d-449f-aa5b-d51ef5e42225 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:23.694456 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:23.969053 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:25.483301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:25.803409 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:25.859973 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:28.866753 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:25:46.002196 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f details requested by agent hyperv_n-h1-822053-11 with host n-h1-822053-11 {{(pid=110312) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 21 05:25:46.097222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:25:46.107921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Returning: {'device': '113df5e1-1df5-4972-91a0-a269fa50320f', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'port_id': '113df5e1-1df5-4972-91a0-a269fa50320f', 'mac_address': 'fa:16:3e:cd:0e:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110312) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 21 05:25:46.143790 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:46.155816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 113df5e1-1df5-4972-91a0-a269fa50320f {{(pid=110312) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 21 05:25:46.176638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:25:46.237017 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:46.284626 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=6']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:25:46.297044 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.297589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.298125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.298659 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.299241 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.299774 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.300316 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.300869 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.301407 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.301950 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.302499 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.303071 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.303628 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110312) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:46.377965 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] get_ports_and_sgs() called for port_ids ['113df5e1-1df5-4972-91a0-a269fa50320f'] {{(pid=110312) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 21 05:25:48.011599 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f up at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 21 05:25:48.071332 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.provisioning_blocks [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Provisioning complete for port 113df5e1-1df5-4972-91a0-a269fa50320f triggered by entity L2. {{(pid=110312) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 21 05:25:48.072058 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7771348'] for port, provisioning_complete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:48.189695 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:48.217799 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:25:48.220212 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7361f08-e1ae-422f-b6b2-a5789aace65b" -d '{"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-plugged", "status": "completed", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:25:48.234143 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:25:48.267933 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:25:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47e4035a-91ab-4399-9f64-7b064491d25a x-openstack-request-id: req-47e4035a-91ab-4399-9f64-7b064491d25a {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:25:48.268280 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-plugged", "status": "completed", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:25:48.269424 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-47e4035a-91ab-4399-9f64-7b064491d25a {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:25:48.269424 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'code': 200} Dec 21 05:25:48.327054 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:48.388483 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=7']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:25:49.969329 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ce2bde15-f9c5-432b-8ff6-3e391daf5612 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:52.769071 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-df136420-9495-4e68-98a9-f93eecb28cdc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:53.704605 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:54.003131 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:55.437101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:55.746529 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:55.833660 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:58.953510 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54212) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:25:59.109177 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Deleting port 707dd879-b663-45af-bf68-4aed269133a0 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:25:59.109518 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:59.187095 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:59.187336 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:59.199311 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Calling delete_port for 707dd879-b663-45af-bf68-4aed269133a0 owned by network:floatingip {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:25:59.448665 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:59.480798 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event deleted for resources: {'Port': ['ID=707dd879-b663-45af-bf68-4aed269133a0,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:25:59.506146 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.506496 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.506840 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.507205 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.507542 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.507875 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.508207 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.508534 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.508864 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.509191 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.509517 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.509848 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.510197 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110311) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:25:59.553308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:59.553647 n-d-822053-11 neutron-server[110311]: INFO neutron.db.l3_db [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Floating IP c56ee72f-c578-4f8b-9248-758f56d9dca0 disassociated (deleted). External IP: 172.25.5.250, port: 113df5e1-1df5-4972-91a0-a269fa50320f. Dec 21 05:25:59.761786 n-d-822053-11 neutron-server[110311]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Router bf0cf4ff-9300-40db-969b-d101cac14f74 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110311) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:25:59.868040 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110311) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:25:59.873148 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:25:59.878369 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:25:59.890015 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:25:59.890737 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:25:59.902098 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-c3bf171a-3cb3-46da-8010-e68145b01acf tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "DELETE /v2.0/floatingips/c56ee72f-c578-4f8b-9248-758f56d9dca0 HTTP/1.1" status: 204 len: 168 time: 0.9474833 Dec 21 05:25:59.902698 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:25:59.904967 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3" -d '{"events": [{"name": "network-changed", "server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:25:59.942575 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:25:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7af17d08-970d-46ed-a369-acbb3e3215d8 x-openstack-request-id: req-7af17d08-970d-46ed-a369-acbb3e3215d8 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:25:59.942873 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:25:59.943162 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-7af17d08-970d-46ed-a369-acbb3e3215d8 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:25:59.943583 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'status': 'completed', 'code': 200} Dec 21 05:26:00.004367 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:00.027805 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-a49d6f16-5fc6-44dd-8b06-966eb1f44dc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.029255 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-a49d6f16-5fc6-44dd-8b06-966eb1f44dc1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 1097 time: 0.0416737 Dec 21 05:26:00.125802 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-0bf954dc-13a7-4d3a-b2ab-80ed8fc7e1a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.127506 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-0bf954dc-13a7-4d3a-b2ab-80ed8fc7e1a4 service neutron] 10.222.0.54 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0912480 Dec 21 05:26:00.174260 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-32f12a1b-d590-43a8-8095-379f2a5a6fe9 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 200 len: 217 time: 0.0391731 Dec 21 05:26:00.225913 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-50bf335f-534d-42b8-8dd9-8192025f44a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.227338 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-50bf335f-534d-42b8-8dd9-8192025f44a0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0462375 Dec 21 05:26:00.281301 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-fea30b54-ca28-4bda-a3fe-bd57fb09ca86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.282828 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-fea30b54-ca28-4bda-a3fe-bd57fb09ca86 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0478144 Dec 21 05:26:00.371822 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e4b70c-09eb-4b07-9d79-57559454418e req-7a4d0a46-ff8e-4de2-b318-8ad7c984cd87 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.373656 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7e4b70c-09eb-4b07-9d79-57559454418e req-7a4d0a46-ff8e-4de2-b318-8ad7c984cd87 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 945 time: 0.0512900 Dec 21 05:26:00.393717 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-eb21cdd9-52d3-4f2a-9b02-213fa9f0d8f5 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882936 Dec 21 05:26:00.398078 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:36Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:00.424345 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-a7e4b70c-09eb-4b07-9d79-57559454418e req-0b01b279-79f7-4b9a-b7e3-99dde85378f7 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441906 Dec 21 05:26:00.427347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:26:00.436291 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:00.436906 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:00.489601 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-279fcf4b-a2b0-4393-9b2f-cbffc49c1ba3 req-12a6a566-3b7e-426e-87b2-bb7a6696bfc3 service neutron] 10.222.0.54 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877323 Dec 21 05:26:00.548913 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:00.702030 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-d28d176c-5c1a-4c39-9c5f-ee4e9d7f7fcf service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0511787 Dec 21 05:26:00.801594 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:36Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:00.806073 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-90b47ba6-fde9-49ba-806c-4f039041dee9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.806349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e69a3b62-8a25-42f6-b056-969eb3231b0c None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_floatingips': [{'id': 'd9b694c3-ee61-4202-a4c1-ef963d6c034a', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'floating_ip_address': '172.25.5.139', 'floating_network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'router_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'port_id': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 4387, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'mac_address': 'fa:16:3e:c2:40:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-21T05:21:34Z', 'updated_at': '2021-12-21T05:21:36Z', 'revision_number': 1, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:26:00.807636 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-90b47ba6-fde9-49ba-806c-4f039041dee9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1096 time: 0.0407543 Dec 21 05:26:00.916552 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-04547872-26af-420b-a1ba-330ffd2f31d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:00.918041 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-04547872-26af-420b-a1ba-330ffd2f31d8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.0873506 Dec 21 05:26:00.995193 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-3ba315ba-2bdd-4377-bdc9-4539f90ecdee service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 1000 time: 0.0657487 Dec 21 05:26:01.047387 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73a9117e-821a-4672-9cf5-2557e5a8ae1d None None] New status for floating IP c56ee72f-c578-4f8b-9248-758f56d9dca0: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:26:01.051265 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-4e623290-c51a-4170-b6f1-5d481bea9ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:01.052811 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-4e623290-c51a-4170-b6f1-5d481bea9ac1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0466249 Dec 21 05:26:01.102156 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-edccc438-b4bb-45b5-9332-230d7107c6f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:01.103696 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-edccc438-b4bb-45b5-9332-230d7107c6f9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0398922 Dec 21 05:26:01.203909 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-342c9600-a2d2-48c7-a5b2-b4552fb4d7c7 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908213 Dec 21 05:26:01.299232 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-d8c7f2da-bba5-4eee-81fe-31b1f6975748 req-651922cd-50eb-433d-8c53-58cd4bd6632c service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827944 Dec 21 05:26:01.552183 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727b40d0-147a-43f6-babe-67f816dd1f31 req-96619899-ecf4-4b7e-9232-6d000a3ef473 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:01.554006 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-727b40d0-147a-43f6-babe-67f816dd1f31 req-96619899-ecf4-4b7e-9232-6d000a3ef473 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 945 time: 0.0540628 Dec 21 05:26:01.602340 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-727b40d0-147a-43f6-babe-67f816dd1f31 req-18039eec-692b-427f-a0a1-fc3d1ff7ffb3 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425549 Dec 21 05:26:02.068622 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:02.074444 n-d-822053-11 neutron-server[110311]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-9ea9ebeb-9349-4959-84f7-de8a40a9853d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110311) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:02.075951 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-9ea9ebeb-9349-4959-84f7-de8a40a9853d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.54 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 945 time: 0.0485344 Dec 21 05:26:02.145395 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-637721'] for port, before_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:02.171812 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Deleting port 113df5e1-1df5-4972-91a0-a269fa50320f {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:02.172143 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:02.184679 n-d-822053-11 neutron-server[110312]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110312) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:26:02.185521 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}38d943eea819edb4ab998dde99d54c2a98b668ab74c71951c4117e88a109412f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-843090eb-6dac-47d0-928f-b6ef0647b247" -d '{"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-unplugged", "status": "completed", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110312) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:26:02.191509 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:02.225231 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 21 Dec 2021 05:26:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70efc6cc-0bf3-45e4-9a2e-18c4b40f0c77 x-openstack-request-id: req-70efc6cc-0bf3-45e4-9a2e-18c4b40f0c77 {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:26:02.225231 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-unplugged", "status": "completed", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "code": 200}]} {{(pid=110312) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:26:02.225231 n-d-822053-11 neutron-server[110312]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-70efc6cc-0bf3-45e4-9a2e-18c4b40f0c77 {{(pid=110312) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:26:02.225231 n-d-822053-11 neutron-server[110312]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'code': 200} Dec 21 05:26:02.260243 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8762542841411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8762542257156', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8762542257174'] for port, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:02.267156 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] For port 113df5e1-1df5-4972-91a0-a269fa50320f, host n-h1-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-822053-11',level=0,port_id=113df5e1-1df5-4972-91a0-a269fa50320f,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:02.267529 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:02.280016 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Calling delete_port for 113df5e1-1df5-4972-91a0-a269fa50320f owned by compute:nova {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:02.311023 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Pushing event updated for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=8']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:02.719536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1037da0-1794-4eaf-9338-b3a3e68d59e8 req-f859387d-0589-4459-9193-eebe6c1268ac tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:02.721005 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1037da0-1794-4eaf-9338-b3a3e68d59e8 req-f859387d-0589-4459-9193-eebe6c1268ac tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=87f87100-5a05-40a2-a522-bb8cc593e36e HTTP/1.1" status: 200 len: 943 time: 0.0489142 Dec 21 05:26:02.767067 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:02.770141 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-f1037da0-1794-4eaf-9338-b3a3e68d59e8 req-eeb71463-7962-49e7-abe8-9ba2564fe25b tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431116 Dec 21 05:26:02.796911 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event deleted for resources: {'Port': ['ID=113df5e1-1df5-4972-91a0-a269fa50320f,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:02.851867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] No DVR routers for this DVR port 113df5e1-1df5-4972-91a0-a269fa50320f on host n-h1-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:26:02.851867 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:02.851867 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [req-8d5426c9-eab8-489c-bc07-9c88671f9ade req-3b07731f-cf0f-4e2c-993a-b02f0459f8a5 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.54 "DELETE /v2.0/ports/113df5e1-1df5-4972-91a0-a269fa50320f HTTP/1.1" status: 204 len: 173 time: 0.7674692 Dec 21 05:26:02.851867 n-d-822053-11 neutron-server[110311]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-deleted', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f'}] {{(pid=110311) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:26:02.853084 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}03df235e52d0d0a21b464b0327c91277771fa4554e5ca7d07b093588cb24975e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7aa47cd4-95ed-4e6d-8d03-1291b9067a45" -d '{"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-deleted", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f"}]}' {{(pid=110311) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:26:02.889660 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:26:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69019f5e-8e96-4960-b95b-0de9ee1717d9 x-openstack-request-id: req-69019f5e-8e96-4960-b95b-0de9ee1717d9 {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:26:02.889957 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87f87100-5a05-40a2-a522-bb8cc593e36e", "name": "network-vif-deleted", "tag": "113df5e1-1df5-4972-91a0-a269fa50320f", "status": "completed", "code": 200}]} {{(pid=110311) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:26:02.890211 n-d-822053-11 neutron-server[110311]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-69019f5e-8e96-4960-b95b-0de9ee1717d9 {{(pid=110311) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:26:02.890674 n-d-822053-11 neutron-server[110311]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87f87100-5a05-40a2-a522-bb8cc593e36e', 'name': 'network-vif-deleted', 'tag': '113df5e1-1df5-4972-91a0-a269fa50320f', 'status': 'completed', 'code': 200} Dec 21 05:26:04.979740 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54274) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:05.137628 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Deleting port 9cdfbede-d6b9-4d99-80c7-96e18e2f4322 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:05.137877 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:05.210152 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:05.210484 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:05.222369 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Calling delete_port for 9cdfbede-d6b9-4d99-80c7-96e18e2f4322 owned by network:floatingip {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:05.419769 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:05.442912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event deleted for resources: {'Port': ['ID=9cdfbede-d6b9-4d99-80c7-96e18e2f4322,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:05.470519 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.470832 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.471195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.471529 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.471865 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.472197 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.472950 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.473282 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.473610 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.474316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.474316 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.474550 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.474879 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-822053-11 {{(pid=110310) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 21 05:26:05.519147 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for floatingip, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:05.520027 n-d-822053-11 neutron-server[110310]: INFO neutron.db.l3_db [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Floating IP d9b694c3-ee61-4202-a4c1-ef963d6c034a disassociated (deleted). External IP: 172.25.5.139, port: c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc. Dec 21 05:26:05.732760 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Router bf0cf4ff-9300-40db-969b-d101cac14f74 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:26:05.839489 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:26:05.844738 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for floatingip, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:05.849349 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:26:05.861319 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:05.862232 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:05.869358 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:26:05.877277 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-305ce219-0db3-4a0e-bc0b-82d7e8e21d1f tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "DELETE /v2.0/floatingips/d9b694c3-ee61-4202-a4c1-ef963d6c034a HTTP/1.1" status: 204 len: 168 time: 0.8939202 Dec 21 05:26:05.877277 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:26:05.877975 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c" -d '{"events": [{"name": "network-changed", "server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:26:05.976505 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:05.980632 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 21 Dec 2021 05:26:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36f66ddd-8d3f-4543-8577-6d92fe828188 x-openstack-request-id: req-36f66ddd-8d3f-4543-8577-6d92fe828188 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:26:05.981130 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:26:05.985487 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-36f66ddd-8d3f-4543-8577-6d92fe828188 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:26:05.985487 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'status': 'completed', 'code': 200} Dec 21 05:26:06.082167 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-fb630540-e1c3-46ed-a995-e75ca75c6bba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:06.083708 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-fb630540-e1c3-46ed-a995-e75ca75c6bba service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 1096 time: 0.0481589 Dec 21 05:26:06.098436 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f no longer exists at agent hyperv_n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:06.130171 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] No Port match for: 113df5e1-1df5-4972-91a0-a269fa50320f {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:06.130523 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Device 113df5e1-1df5-4972-91a0-a269fa50320f not bound to the agent host n-h1-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:06.193902 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-472679cc-5750-45c3-a990-23b3409dccca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:06.195519 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-472679cc-5750-45c3-a990-23b3409dccca service neutron] 10.222.0.31 "GET /v2.0/networks?id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 200 len: 909 time: 0.1045451 Dec 21 05:26:06.211084 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:06.243223 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:26:06.247434 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-ba641a6d-f3b7-4f07-bb24-53e1c57643fd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 200 len: 217 time: 0.0405984 Dec 21 05:26:06.251589 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:06.252214 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:06.321878 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-9c72f6f5-c4ae-4498-9914-450153425d70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:06.323422 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-9c72f6f5-c4ae-4498-9914-450153425d70 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 200 len: 847 time: 0.0680039 Dec 21 05:26:06.360189 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:06.369195 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e0a963-d98d-43a7-bdcb-d1bd385362ee req-290a9524-868b-40dd-b660-34beb38532d9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:06.371318 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19e0a963-d98d-43a7-bdcb-d1bd385362ee req-290a9524-868b-40dd-b660-34beb38532d9 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 944 time: 0.0808527 Dec 21 05:26:06.397726 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-5efec9cc-85f6-411f-a7ee-3201d3b65a8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:06.399242 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-5efec9cc-85f6-411f-a7ee-3201d3b65a8a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=74eac97f-efc7-44f7-b3cc-cbbaa49c512d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0673113 Dec 21 05:26:06.456876 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-19e0a963-d98d-43a7-bdcb-d1bd385362ee req-4fe00128-bd2a-48c5-9916-3cc8de3f6965 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0774734 Dec 21 05:26:06.516125 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-cef833b7-88af-487e-8b40-bd90e2d5eafc service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1062925 Dec 21 05:26:06.555400 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:06.584750 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5efe7cb0-8d89-4a89-83ec-6f2f3f4549fd None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:21:11Z', 'revision_number': 4, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11', '_interfaces': [{'id': 'f364b532-7fef-48b8-b74d-74ae1a6e73e9', 'name': '', 'network_id': '74eac97f-efc7-44f7-b3cc-cbbaa49c512d', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'mac_address': 'fa:16:3e:0f:79:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_interface', 'standard_attr_id': 4363, 'fixed_ips': [{'subnet_id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:11Z', 'updated_at': '2021-12-21T05:21:15Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'subnets': [{'id': '12634cd6-e77e-46eb-a92e-3842a73fc8c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:26:06.614554 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-3ea7b300-552e-4bc7-9d65-69c0424b0c4c req-5e4b04d4-f427-4aae-9afe-3580760e0e56 service neutron] 10.222.0.31 "GET /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891249 Dec 21 05:26:06.809108 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edbb3c70-358a-4c72-adfe-bd6e84875a8a None None] New status for floating IP d9b694c3-ee61-4202-a4c1-ef963d6c034a: DOWN {{(pid=110313) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 21 05:26:07.574331 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6dcc8eb-0021-4253-87f8-a261d5dea699 req-6179c964-277c-4169-bb67-818da308edac tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:07.575861 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6dcc8eb-0021-4253-87f8-a261d5dea699 req-6179c964-277c-4169-bb67-818da308edac tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 944 time: 0.0496416 Dec 21 05:26:07.625495 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-c6dcc8eb-0021-4253-87f8-a261d5dea699 req-9d461a9c-9bfd-40ea-987c-1041a570b64d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436933 Dec 21 05:26:08.366674 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-699134f7-0bfb-40b3-9c35-d5949f28540c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:08.368145 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-699134f7-0bfb-40b3-9c35-d5949f28540c tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.31 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 944 time: 0.0479121 Dec 21 05:26:08.462375 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Deleting port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:08.462715 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:08.549993 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] For port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc, host n-h2-822053-11, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-822053-11',level=0,port_id=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:08.550359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:08.562622 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Calling delete_port for c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc owned by compute:nova {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:08.741575 n-d-822053-11 neutron-server[110310]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a531e3f-e3f6-492a-a3ba-a60ba0cc9479 req-2cf5ee97-a3a8-4cfe-9720-080d88a14998 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110310) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 21 05:26:08.743231 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a531e3f-e3f6-492a-a3ba-a60ba0cc9479 req-2cf5ee97-a3a8-4cfe-9720-080d88a14998 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/ports?device_id=7086edf6-6751-4f4b-a1f7-3767556f0193 HTTP/1.1" status: 200 len: 944 time: 0.0478973 Dec 21 05:26:08.773857 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:08.814525 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event deleted for resources: {'Port': ['ID=c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:08.845887 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-8a531e3f-e3f6-492a-a3ba-a60ba0cc9479 req-e443fc81-74b2-4f9c-96d1-f4e51f447d85 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "GET /v2.0/security-groups?id=fe74e25e-03de-475d-9b15-eac39b9c01e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0958900 Dec 21 05:26:08.865536 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] No DVR routers for this DVR port c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc on host n-h2-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:26:08.868728 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-39481'] for port, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:08.873279 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [req-6064c75a-9252-46b7-904e-a48e2c7c7fff req-54a836a1-2c2d-4866-8bcb-8b82491df35d tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.31 "DELETE /v2.0/ports/c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc HTTP/1.1" status: 204 len: 173 time: 0.4950650 Dec 21 05:26:08.873803 n-d-822053-11 neutron-server[110310]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-deleted', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc'}] {{(pid=110310) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 21 05:26:08.876029 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.18/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7d15c2eff332aa2e83c11f1a9f48ae6ab964ef1f1a3b144887ce44647a9418af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37d1bc3d-b03f-4852-9b08-dbf3ccdc971a" -d '{"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-deleted", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc"}]}' {{(pid=110310) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 21 05:26:08.912002 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 21 Dec 2021 05:26:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e167199-bf30-47f1-a04d-62764ce699a5 x-openstack-request-id: req-2e167199-bf30-47f1-a04d-62764ce699a5 {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 21 05:26:08.912301 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7086edf6-6751-4f4b-a1f7-3767556f0193", "name": "network-vif-deleted", "tag": "c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc", "status": "completed", "code": 200}]} {{(pid=110310) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 21 05:26:08.912556 n-d-822053-11 neutron-server[110310]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.18/compute/v2.1/os-server-external-events used request id req-2e167199-bf30-47f1-a04d-62764ce699a5 {{(pid=110310) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 21 05:26:08.912963 n-d-822053-11 neutron-server[110310]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7086edf6-6751-4f4b-a1f7-3767556f0193', 'name': 'network-vif-deleted', 'tag': 'c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc', 'status': 'completed', 'code': 200} Dec 21 05:26:09.902660 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54292) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:09.961109 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92020a43-967c-4a46-9900-7e68041f5d25 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:09.985914 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92020a43-967c-4a46-9900-7e68041f5d25 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:10.094359 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92020a43-967c-4a46-9900-7e68041f5d25 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:10.096985 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-92020a43-967c-4a46-9900-7e68041f5d25 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:10.098159 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-92020a43-967c-4a46-9900-7e68041f5d25 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] 10.222.0.18 "DELETE /v2.0/security-groups/fe74e25e-03de-475d-9b15-eac39b9c01e7 HTTP/1.1" status: 204 len: 168 time: 0.1943963 Dec 21 05:26:10.111989 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92020a43-967c-4a46-9900-7e68041f5d25 tempest-TestSnapshotPattern-1134126631 tempest-TestSnapshotPattern-1134126631-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe74e25e-03de-475d-9b15-eac39b9c01e7,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:10.219010 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54296) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:10.643201 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:10.879985 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Deleting port f364b532-7fef-48b8-b74d-74ae1a6e73e9 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:10.880226 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:10.964112 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] For port f364b532-7fef-48b8-b74d-74ae1a6e73e9, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=f364b532-7fef-48b8-b74d-74ae1a6e73e9,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:10.964825 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:10.975774 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Calling delete_port for f364b532-7fef-48b8-b74d-74ae1a6e73e9 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:11.225874 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:11.259751 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Pushing event deleted for resources: {'Port': ['ID=f364b532-7fef-48b8-b74d-74ae1a6e73e9,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:11.424122 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:11.635759 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Router bf0cf4ff-9300-40db-969b-d101cac14f74 has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:26:12.036416 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:26:12.041331 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-2c320af6-a3c4-46d5-be47-430fb95b6457 admin admin] 10.222.0.18 "PUT /v2.0/routers/bf0cf4ff-9300-40db-969b-d101cac14f74/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8212421 Dec 21 05:26:12.043912 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54300) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:12.046512 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] Sync routers for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:26:12.056042 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:12.056649 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:12.145521 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks [] for router, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.159069 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: n-d-822053-11 {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:12.241462 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.334203 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213'}], 'enable_snat': True}, 'gw_port_id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:26:11Z', 'revision_number': 5, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port': {'id': 'c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:a3:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:09Z', 'updated_at': '2021-12-21T05:21:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:12.355409 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Deleting port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:12.355747 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.364994 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] Checking router: bf0cf4ff-9300-40db-969b-d101cac14f74 for host: n-d-822053-11 {{(pid=110312) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:26:12.374328 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] Routers {'bf0cf4ff-9300-40db-969b-d101cac14f74'} bound to L3 agent in host n-d-822053-11 {{(pid=110312) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:12.374958 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['bf0cf4ff-9300-40db-969b-d101cac14f74'], 'active': True} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:12.433596 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] For port c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:12.434021 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.446018 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Calling delete_port for c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c owned by network:router_gateway {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:12.626638 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvr_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] Set router bf0cf4ff-9300-40db-969b-d101cac14f74 gateway port host: None {{(pid=110312) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:12.678303 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc no longer exists at agent hyperv_n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:12.681641 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_hamode_db [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:26:12Z', 'revision_number': 6, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110312) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:12.699347 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] No Port match for: c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:12.699644 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Device c9e39c9f-be67-4ec7-bdb9-22f4c9437fcc not bound to the agent host n-h2-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:12.710295 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.726843 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-321583c1-5ed3-4d5b-b268-bcf9fcb8a018 None None] The sync data for ids ['bf0cf4ff-9300-40db-969b-d101cac14f74'] in n-d-822053-11 is: [{'id': 'bf0cf4ff-9300-40db-969b-d101cac14f74', 'name': 'tempest-TestSnapshotPattern-68287596-router', 'tenant_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:08Z', 'updated_at': '2021-12-21T05:26:12Z', 'revision_number': 6, 'project_id': '3928a1cc9e5f4c3d9b1a3ff5f3888786', 'gw_port_host': None}] {{(pid=110312) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:26:12.737978 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Pushing event deleted for resources: {'Port': ['ID=c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:12.754018 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ab3ed36-8ec4-4021-b45e-7f819278274b None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:26:12.811288 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.899424 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.902172 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.997623 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:12.998131 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router bf0cf4ff-9300-40db-969b-d101cac14f74 {{(pid=110310) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:26:13.002562 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] Publish callbacks [] for router, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.006338 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-8465abd1-bc05-4c91-a995-25a4ed16add9 admin admin] 10.222.0.18 "DELETE /v2.0/routers/bf0cf4ff-9300-40db-969b-d101cac14f74 HTTP/1.1" status: 204 len: 168 time: 0.9589310 Dec 21 05:26:13.006638 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54302) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:13.056387 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Deleting subnet 12634cd6-e77e-46eb-a92e-3842a73fc8c4 {{(pid=110310) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:26:13.059973 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.096545 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529819129'] for subnet, precommit_delete_associations {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.175045 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.298968 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529846501', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529437201'] for subnet, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.331113 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12634cd6-e77e-46eb-a92e-3842a73fc8c4,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:13.333292 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] Publish callbacks [] for subnet, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.336719 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1b9c34e-66be-43d2-8d77-16c9568d9b03 None None] Network 74eac97f-efc7-44f7-b3cc-cbbaa49c512d requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:26:13.341214 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-f5dd25f8-f699-4209-8f83-3bf56c32169f admin admin] 10.222.0.18 "DELETE /v2.0/subnets/12634cd6-e77e-46eb-a92e-3842a73fc8c4 HTTP/1.1" status: 204 len: 168 time: 0.3337648 Dec 21 05:26:13.343896 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54304) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:13.415854 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.472338 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Deleting port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:13.472682 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.515287 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] DHCP port deletion for 74eac97f-efc7-44f7-b3cc-cbbaa49c512d request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:26:13.537010 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] For port d9b6a06b-3897-4a78-a12c-ff1e0ea00983, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:13.537452 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.559492 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Calling delete_port for d9b6a06b-3897-4a78-a12c-ff1e0ea00983 owned by network:dhcp {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:13.564109 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] Deleting port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:13.564750 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.637503 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] For port d9b6a06b-3897-4a78-a12c-ff1e0ea00983, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,segment=NetworkSegment(518585f4-844a-464b-a4c0-42cf93fc264b),segment_id=518585f4-844a-464b-a4c0-42cf93fc264b)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:13.638015 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.657399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] Calling delete_port for d9b6a06b-3897-4a78-a12c-ff1e0ea00983 owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:13.711889 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.736457 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.741915 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Pushing event deleted for resources: {'Port': ['ID=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:13.748089 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] No DVR routers for this DVR port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 on host n-d-822053-11 {{(pid=110311) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:26:13.764177 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] Pushing event deleted for resources: {'Port': ['ID=d9b6a06b-3897-4a78-a12c-ff1e0ea00983,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:13.768220 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e5f50f8-42a8-4d0d-b96c-144758adccf6 None None] No DVR routers for this DVR port d9b6a06b-3897-4a78-a12c-ff1e0ea00983 on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:26:13.831280 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.850397 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74eac97f-efc7-44f7-b3cc-cbbaa49c512d']}} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:13.859959 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '518585f4-844a-464b-a4c0-42cf93fc264b') {'for_net_delete': True} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:13.860256 n-d-822053-11 neutron-server[110311]: DEBUG neutron.services.segments.db [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '518585f4-844a-464b-a4c0-42cf93fc264b') {} {{(pid=110311) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:13.869363 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529033796'] for segment, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.883560 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.889981 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=110311) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:26:13.890390 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529022375'] for segment, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: warnings.warn(msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: Traceback (most recent call last): Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: timer() Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: cb(*args, **kw) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: return func(*args, **kwargs) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: self._notify() Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: self.callback(batched_events) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: event.method(event) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: return f(self, *a, **k) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: return self._get(url).json() Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: return self.request(url, 'GET', **kwargs) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:26:13.892227 n-d-822053-11 neutron-server[110311]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:26:13.930615 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d9b6a06b-3897-4a78-a12c-ff1e0ea00983 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:13.954222 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: d9b6a06b-3897-4a78-a12c-ff1e0ea00983 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:13.954572 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device d9b6a06b-3897-4a78-a12c-ff1e0ea00983 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:13.955028 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f364b532-7fef-48b8-b74d-74ae1a6e73e9 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:13.975645 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: f364b532-7fef-48b8-b74d-74ae1a6e73e9 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:13.975991 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device f364b532-7fef-48b8-b74d-74ae1a6e73e9 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:13.976399 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:13.995570 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:13.995918 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device c1ddd244-3389-4ab5-89b9-d27f5f0eaf8c not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:14.020049 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:14.026416 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Publish callbacks [] for network, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:14.029588 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] 10.222.0.18 "DELETE /v2.0/networks/74eac97f-efc7-44f7-b3cc-cbbaa49c512d HTTP/1.1" status: 204 len: 168 time: 0.6846943 Dec 21 05:26:14.032677 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54306) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:14.041112 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0853b467-8a2d-411e-9d40-2ddefb9e8252 admin admin] Pushing event deleted for resources: {'Network': ['ID=74eac97f-efc7-44f7-b3cc-cbbaa49c512d,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:14.373397 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7878866'] for router_interface, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:14.618006 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Deleting port 4983446e-9d52-4c9d-90f9-7706c99a4437 {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:14.618351 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:14.694517 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] For port 4983446e-9d52-4c9d-90f9-7706c99a4437, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=4983446e-9d52-4c9d-90f9-7706c99a4437,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:14.694884 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:14.706252 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Calling delete_port for 4983446e-9d52-4c9d-90f9-7706c99a4437 owned by network:router_interface {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:14.946162 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:14.974045 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Pushing event deleted for resources: {'Port': ['ID=4983446e-9d52-4c9d-90f9-7706c99a4437,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:15.136546 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7993174', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7875138'] for router_interface, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:15.350996 n-d-822053-11 neutron-server[110310]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Router 107c160a-a146-4cde-9dc4-dd53242e5ddf has already been hosted by L3 agent ffd816c0-dc96-440a-9a98-3255832e6046 {{(pid=110310) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 21 05:26:15.454219 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] Notify agent at l3_agent.n-d-822053-11 the message routers_updated {{(pid=110310) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 21 05:26:15.460353 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-ef17ca9d-6404-4fca-a923-83e6971d2b2f admin admin] 10.222.0.18 "PUT /v2.0/routers/107c160a-a146-4cde-9dc4-dd53242e5ddf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4264657 Dec 21 05:26:15.461727 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54308) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:15.462676 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] Sync routers for ids ['107c160a-a146-4cde-9dc4-dd53242e5ddf'] in n-d-822053-11 {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 21 05:26:15.472845 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] Routers {'107c160a-a146-4cde-9dc4-dd53242e5ddf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:15.473461 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['107c160a-a146-4cde-9dc4-dd53242e5ddf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:15.570652 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks [] for router, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:15.577200 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] Set router 107c160a-a146-4cde-9dc4-dd53242e5ddf gateway port host: n-d-822053-11 {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:15.674068 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:15.753235 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'external_fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44'}], 'enable_snat': True}, 'gw_port_id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:26:14Z', 'revision_number': 5, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port': {'id': 'b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793', 'name': '', 'network_id': '30f5b79f-275c-4003-8999-814f6db142e1', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:9b:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'ip_address': '172.25.5.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-822053-11', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-21T05:21:15Z', 'updated_at': '2021-12-21T05:21:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd97763f7-6055-4080-b2b6-7cd4d7f7d537', 'cidr': '172.25.5.0/24', 'gateway_ip': '172.25.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-822053-11'}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:15.779685 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] Checking router: 107c160a-a146-4cde-9dc4-dd53242e5ddf for host: n-d-822053-11 {{(pid=110313) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 21 05:26:15.787755 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] Routers {'107c160a-a146-4cde-9dc4-dd53242e5ddf'} bound to L3 agent in host n-d-822053-11 {{(pid=110313) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 21 05:26:15.788358 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-822053-11', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-21T03:32:22Z,description=,heartbeat_timestamp=2021-12-21T05:25:53Z,host='n-d-822053-11',id=ffd816c0-dc96-440a-9a98-3255832e6046,load=0,resource_versions=,resources_synced=,started_at=2021-12-21T03:32:23Z,topic='l3_agent')) {'router_ids': ['107c160a-a146-4cde-9dc4-dd53242e5ddf'], 'active': True} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:15.788991 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Deleting port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 {{(pid=110311) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:15.789346 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:15.869224 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.db [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] For port b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,segment=NetworkSegment(4831152c-b350-45f0-9c97-ced0bcd6cc54),segment_id=4831152c-b350-45f0-9c97-ced0bcd6cc54)] {{(pid=110311) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:15.870042 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:15.886031 n-d-822053-11 neutron-server[110311]: DEBUG neutron.plugins.ml2.plugin [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Calling delete_port for b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 owned by network:router_gateway {{(pid=110311) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:15.967199 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_dvr_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] Set router 107c160a-a146-4cde-9dc4-dd53242e5ddf gateway port host: None {{(pid=110313) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 21 05:26:16.020807 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.l3_hamode_db [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:26:15Z', 'revision_number': 6, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port_host': None}], 'n-d-822053-11', False) {} {{(pid=110313) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:16.047071 n-d-822053-11 neutron-server[110313]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6ea6486-bccf-4cab-9939-30eb562f249e None None] The sync data for ids ['107c160a-a146-4cde-9dc4-dd53242e5ddf'] in n-d-822053-11 is: [{'id': '107c160a-a146-4cde-9dc4-dd53242e5ddf', 'name': 'tempest-TestSnapshotPattern-657709559-router', 'tenant_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-21T05:21:14Z', 'updated_at': '2021-12-21T05:26:15Z', 'revision_number': 6, 'project_id': 'b471e347d90547b48bfcfdbcaf9be0da', 'gw_port_host': None}] {{(pid=110313) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 21 05:26:16.115676 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529022320'] for port, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.145784 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Pushing event deleted for resources: {'Port': ['ID=b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:16.158618 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb4724d4-e3d6-46fd-8cad-d9337448e3d6 None None] DHCP port deletion for 30f5b79f-275c-4003-8999-814f6db142e1 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:26:16.205291 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7874072'] for router_gateway, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.294166 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7876264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-14295'] for router, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.296308 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.385714 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7876273'] for router, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.386291 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 107c160a-a146-4cde-9dc4-dd53242e5ddf {{(pid=110311) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 21 05:26:16.391368 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] Publish callbacks [] for router, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.392587 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-2f18a4d6-f1a2-4677-8e5f-53ee65dbe7b6 admin admin] 10.222.0.18 "DELETE /v2.0/routers/107c160a-a146-4cde-9dc4-dd53242e5ddf HTTP/1.1" status: 204 len: 168 time: 0.9298799 Dec 21 05:26:16.395127 n-d-822053-11 neutron-server[110311]: DEBUG neutron.wsgi [-] (110311) accepted ('10.222.0.18', 54310) {{(pid=110311) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:16.446372 n-d-822053-11 neutron-server[110311]: DEBUG neutron.db.db_base_plugin_v2 [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Deleting subnet f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9 {{(pid=110311) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1062}} Dec 21 05:26:16.449761 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.486004 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-529033805'] for subnet, precommit_delete_associations {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.566156 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7766178'] for subnet, precommit_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.694136 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7766203', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-436421', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-529022221', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-529064702'] for subnet, after_delete {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.722926 n-d-822053-11 neutron-server[110311]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9,revision_number=None']} {{(pid=110311) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:16.728534 n-d-822053-11 neutron-server[110311]: DEBUG neutron_lib.callbacks.manager [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] Publish callbacks [] for subnet, before_response {{(pid=110311) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.733415 n-d-822053-11 neutron-server[110311]: INFO neutron.wsgi [None req-719b5447-531f-4067-b6d6-39559ced1d1b admin admin] 10.222.0.18 "DELETE /v2.0/subnets/f3e594cd-4ef1-40e6-9aa0-6ebf7874f0a9 HTTP/1.1" status: 204 len: 168 time: 0.3373177 Dec 21 05:26:16.735125 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb40a063-3b1a-4593-9c64-34fa38b67942 None None] Network f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 requested from n-d-822053-11 {{(pid=110312) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 21 05:26:16.739193 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54312) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:16.807720 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-595993'] for network, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.871503 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Deleting port 16f49bd6-c1af-49c5-a052-8b58a438cbdf {{(pid=110310) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:16.871848 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.896816 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] DHCP port deletion for f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 request from n-d-822053-11 {{(pid=110312) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 21 05:26:16.936033 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.db [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] For port 16f49bd6-c1af-49c5-a052-8b58a438cbdf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16f49bd6-c1af-49c5-a052-8b58a438cbdf,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110310) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:16.936849 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:16.950826 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.plugin [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Calling delete_port for 16f49bd6-c1af-49c5-a052-8b58a438cbdf owned by network:dhcp {{(pid=110310) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:16.952444 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] Deleting port 16f49bd6-c1af-49c5-a052-8b58a438cbdf {{(pid=110312) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 21 05:26:16.952818 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8762542786250'] for port, before_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.018873 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.db [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] For port 16f49bd6-c1af-49c5-a052-8b58a438cbdf, host n-d-822053-11, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-822053-11',level=0,port_id=16f49bd6-c1af-49c5-a052-8b58a438cbdf,segment=NetworkSegment(6e6195e2-63f8-4ffb-81a0-74d6fc41301c),segment_id=6e6195e2-63f8-4ffb-81a0-74d6fc41301c)] {{(pid=110312) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 21 05:26:17.019293 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7870981'] for port, precommit_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.033787 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] Calling delete_port for 16f49bd6-c1af-49c5-a052-8b58a438cbdf owned by network:dhcp {{(pid=110312) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 21 05:26:17.098821 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-529846424'] for port, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.114639 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-637140', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-120000', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8762542841393', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8762542260727'] for port, after_delete {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.127279 n-d-822053-11 neutron-server[110310]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] No DVR routers for this DVR port 16f49bd6-c1af-49c5-a052-8b58a438cbdf on host n-d-822053-11 {{(pid=110310) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:26:17.131834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Pushing event deleted for resources: {'Port': ['ID=16f49bd6-c1af-49c5-a052-8b58a438cbdf,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:17.142022 n-d-822053-11 neutron-server[110312]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] Pushing event deleted for resources: {'Port': ['ID=16f49bd6-c1af-49c5-a052-8b58a438cbdf,revision_number=None']} {{(pid=110312) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:17.145465 n-d-822053-11 neutron-server[110312]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d194cb7c-9fd7-4a98-977b-edaa608a8862 None None] No DVR routers for this DVR port 16f49bd6-c1af-49c5-a052-8b58a438cbdf on host n-d-822053-11 {{(pid=110312) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 21 05:26:17.206435 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7773231', 'neutron.services.segments.db._delete_segments_for_network-8762542825948'] for network, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.227304 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f6b3c46a-0ebe-43fd-bb0e-e777fa04e221']}} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:17.236207 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6e6195e2-63f8-4ffb-81a0-74d6fc41301c') {'for_net_delete': True} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:17.236500 n-d-822053-11 neutron-server[110310]: DEBUG neutron.services.segments.db [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6e6195e2-63f8-4ffb-81a0-74d6fc41301c') {} {{(pid=110310) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 21 05:26:17.250334 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8762542830565', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-529819120'] for segment, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.263661 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381'] for segment, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.269763 n-d-822053-11 neutron-server[110310]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Releasing vlan 109 on physical network physnet1 to pool {{(pid=110310) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7768381', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-529846351'] for segment, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: warnings.warn(msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: Traceback (most recent call last): Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: timer() Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: cb(*args, **kw) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: return func(*args, **kwargs) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: self._notify() Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: self.callback(batched_events) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: event.method(event) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: aggregate_uuid = self.p_client.list_aggregates( Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: return f(self, *a, **k) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: return self._get(url).json() Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: return self.request(url, 'GET', **kwargs) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: base_url = self.get_endpoint(auth, allow=allow, Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 21 05:26:17.274003 n-d-822053-11 neutron-server[110310]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 21 05:26:17.374186 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7773220', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-454436', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7993153', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7874244'] for network, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.379699 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Publish callbacks [] for network, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.383601 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] 10.222.0.18 "DELETE /v2.0/networks/f6b3c46a-0ebe-43fd-bb0e-e777fa04e221 HTTP/1.1" status: 204 len: 168 time: 0.6465867 Dec 21 05:26:17.394410 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb317506-19f5-496d-8531-80e8fc17dd80 admin admin] Pushing event deleted for resources: {'Network': ['ID=f6b3c46a-0ebe-43fd-bb0e-e777fa04e221,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:17.673782 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54316) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:17.713245 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fd7a7527-3db2-452c-ada1-f6896de0a1c2 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=3928a1cc9e5f4c3d9b1a3ff5f3888786&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0382774 Dec 21 05:26:17.715589 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54318) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:17.761389 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe881314-8ba5-4b17-9e5a-92e194f0c3f0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.785943 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe881314-8ba5-4b17-9e5a-92e194f0c3f0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.888615 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe881314-8ba5-4b17-9e5a-92e194f0c3f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.891282 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-fe881314-8ba5-4b17-9e5a-92e194f0c3f0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:17.892493 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-fe881314-8ba5-4b17-9e5a-92e194f0c3f0 admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/2f8bce25-cff9-427a-90d9-db71f7e1de87 HTTP/1.1" status: 204 len: 168 time: 0.1760194 Dec 21 05:26:17.906328 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe881314-8ba5-4b17-9e5a-92e194f0c3f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f8bce25-cff9-427a-90d9-db71f7e1de87,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:17.939151 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4983446e-9d52-4c9d-90f9-7706c99a4437 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:17.961921 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 4983446e-9d52-4c9d-90f9-7706c99a4437 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:17.962271 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 4983446e-9d52-4c9d-90f9-7706c99a4437 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:17.962696 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16f49bd6-c1af-49c5-a052-8b58a438cbdf no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:17.982372 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: 16f49bd6-c1af-49c5-a052-8b58a438cbdf {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:17.982756 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device 16f49bd6-c1af-49c5-a052-8b58a438cbdf not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:17.983155 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 no longer exists at agent ovs-agent-n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 21 05:26:18.001592 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.plugin [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] No Port match for: b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 {{(pid=110312) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 21 05:26:18.001949 n-d-822053-11 neutron-server[110312]: DEBUG neutron.plugins.ml2.rpc [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Device b8b67b3d-ac71-4d8b-8aee-4e5bcd6a0793 not bound to the agent host n-d-822053-11 {{(pid=110312) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 21 05:26:18.457067 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54324) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:18.496288 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-e466245a-4545-40eb-91de-caec6bc6a457 admin admin] 10.222.0.18 "GET /v2.0/security-groups?tenant_id=b471e347d90547b48bfcfdbcaf9be0da&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0380189 Dec 21 05:26:18.499082 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [-] (110310) accepted ('10.222.0.18', 54326) {{(pid=110310) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 21 05:26:18.544213 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9415885f-78c1-447c-a636-19793619a91f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:18.564897 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9415885f-78c1-447c-a636-19793619a91f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:18.648190 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9415885f-78c1-447c-a636-19793619a91f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-451319'] for security_group, after_delete {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:18.650717 n-d-822053-11 neutron-server[110310]: DEBUG neutron_lib.callbacks.manager [None req-9415885f-78c1-447c-a636-19793619a91f admin admin] Publish callbacks [] for security_group, before_response {{(pid=110310) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:18.651927 n-d-822053-11 neutron-server[110310]: INFO neutron.wsgi [None req-9415885f-78c1-447c-a636-19793619a91f admin admin] 10.222.0.18 "DELETE /v2.0/security-groups/1cb0efc6-d71d-4a90-8ba7-ae12589b5190 HTTP/1.1" status: 204 len: 168 time: 0.1519697 Dec 21 05:26:18.659582 n-d-822053-11 neutron-server[110310]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9415885f-78c1-447c-a636-19793619a91f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cb0efc6-d71d-4a90-8ba7-ae12589b5190,revision_number=None']} {{(pid=110310) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 21 05:26:19.962890 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a289b8d6-acc9-49fa-93cf-a9bc382464b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:22.756652 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-218e0774-21cb-43a8-b83c-01b5ebe6bb87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:23.693764 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:23.985772 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:25.441074 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:25.732389 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:25.825761 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:42.868388 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:26:49.990580 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8a6772bd-b7e8-4b6d-ae98-3b151f109485 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:52.762182 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-024d3363-115a-4917-b6bb-3309cc6d06c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:53.670721 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:53.996494 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:55.464544 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:55.762884 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:26:55.841939 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:19.867637 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:27:19.972108 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cafec394-daa3-42c5-8480-1fbd28d314e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:22.732998 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5bd7d201-fe1a-4304-9b0c-8777061b3f28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:23.681468 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:24.006537 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:25.481335 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:25.738809 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:25.835967 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:49.961042 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4a3c119b-0d58-4daa-ab67-4d022446bbd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:52.738270 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e80ed9c6-7275-4644-915d-6c3faac220e5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:53.680791 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:54.040853 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:55.458273 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:55.763542 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:55.840716 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:27:56.867855 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:28:19.955372 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-ac2c6770-825b-482a-a559-ef269c24b2c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:22.732061 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7381e0be-8d99-4773-856b-485946ec554b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:23.697835 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:24.023576 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:25.469112 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:25.812066 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:25.840974 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:33.866897 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:28:49.960633 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9b8ecb2d-e6ad-4332-8305-e79fedc5faa8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:52.760507 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5aa2697b-8432-4da1-971f-7f502cf286cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:53.703096 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:54.035182 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:55.491886 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:55.795116 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:28:55.869101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:10.865901 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:29:19.971195 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-873078de-c28d-4b43-9d88-bd5362b9ed8e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:22.749381 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1379b376-aa3c-4467-8d1d-02a0d513360a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:23.709223 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:24.097332 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:25.502769 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:25.761400 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:25.834849 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:47.865073 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:29:50.006149 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-41959f10-8c04-47cd-b187-860aa2abeacd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:52.766471 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-6e428255-0fe8-4928-af3d-5bc1f6d0a97a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:53.725931 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:54.079587 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:55.463344 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:55.762495 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:29:55.839303 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:19.977316 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-cfc023b8-eb22-42e8-a582-007fed1cd529 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:22.776024 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d549b756-a292-4f45-9623-3ab675c7b3e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:23.753356 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:24.074620 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:24.864859 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:30:25.479868 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:25.777279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:25.834291 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:49.971286 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d0c8bc1e-8083-4329-bf08-351766118e3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:52.766123 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-1c0f4a55-6fe5-4523-8d35-ee3f22ffa4b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:53.708301 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:54.060738 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:55.504429 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:55.792448 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:30:55.814938 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:01.864865 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:31:19.980677 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-b6845fd4-2042-4cad-86d8-c4d958488aec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:22.768785 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-af10b59c-8c0c-4d1a-ad42-18b4a4ee8b86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:23.717745 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:24.089266 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:25.489713 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:25.776957 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:25.816847 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:38.864503 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:31:49.997067 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5e845805-04d9-42c7-9473-d1f17d5f5144 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:52.792193 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-84112550-537d-4578-bf11-5e9368a19f79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:53.711161 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:54.074246 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:55.474431 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:55.794008 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:31:55.868166 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:15.865270 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:32:20.002189 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-57a569f6-848a-4ac3-940b-6273c35dee6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:22.770961 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-4e41ca9c-99b2-4e68-b1cc-f9e0584d55d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:23.708093 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:24.104953 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:25.487908 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:25.796492 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:25.853787 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:49.988895 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-dcb9adee-9cef-486c-922f-9f465621887e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:52.773101 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-a3715367-4a1f-4137-baa1-324c3fa61871 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:52.865379 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:32:53.729064 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:54.133499 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:55.490643 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:55.822531 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:32:55.845221 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:19.970744 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-44bc7fbb-4f49-474c-97bc-d8b4b1031a0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:22.777107 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-7529d47b-98d4-4fb4-8d0d-12a06663d503 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:23.727337 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:24.104403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:25.510005 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:25.824212 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:25.857966 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:29.865680 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:33:46.672834 n-d-822053-11 neutron-server[110310]: DEBUG neutron.wsgi [req-993e2d85-72cd-40ce-ae83-c0a333cceaf9 req-7de041ee-db57-428e-ab36-37e57a799889 service neutron] (110310) timed out ('10.222.0.18', 52020) {{(pid=110310) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 21 05:33:49.989280 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-0faa5da7-6a76-489a-b38a-0b08f5528a11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:52.776083 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-27aa5af4-e4e2-4649-b929-97b96f696f65 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:53.726330 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:54.126954 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:55.475403 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:55.851496 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:33:55.852090 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:06.866265 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:34:19.977725 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-5112547d-0546-49bc-b1a9-2b04a652fdcd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:22.817484 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-c6b2c0b9-aeae-47c8-a43b-c76bd023701c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:23.743069 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:24.120279 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-8dddc4bc-4a56-47fd-b1bd-508d9286ef30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:25.496174 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-718bfe5f-6746-4e97-80a3-6777691731ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:25.840486 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9acc6ef6-502a-4105-9050-637211ee2ea9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:25.874351 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-9303fb17-3999-4b07-b4ed-b341888c3ee0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:43.865935 n-d-822053-11 neutron-server[110313]: DEBUG neutron.db.agents_db [None req-77c6bd86-75f0-4d8d-930e-a95ae1799acb None None] Agent healthcheck: found 7 active agents {{(pid=110313) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 21 05:34:49.981710 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-e59d42c4-0c83-4853-bf4c-677d91163ed8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:52.771203 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-d313da88-2c8e-42c5-bafe-74676a53c79c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 21 05:34:53.725788 n-d-822053-11 neutron-server[110312]: DEBUG neutron_lib.callbacks.manager [None req-eb81c6e6-a06a-4951-b728-01aa2132a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8762542825930', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7771237'] for agent, after_update {{(pid=110312) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}}